2023-10-06T02:03:50.394 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T02:03:50.394 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage} --name yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi --verbose --archive /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412131 -- /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412131/orig.config.yaml 2023-10-06T02:03:50.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T02:03:50.538 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412131 branch: wip-yuri-testing-2023-10-05-0730-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage} email: yweinste@redhat.com first_in_suite: false job_id: '7412131' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-05-0730-quincy ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - bad backtrace - object missing on disk - error reading table object - error reading sessionmap - Error loading MDS rank - missing journal object - Error recovering journal - error decoding table object - failed to read JournalPointer - Corrupt directory entry - Corrupt fnode header - corrupt sessionmap header - Corrupt dentry - Scrub error on inode - Metadata damage detected - MDS_READ_ONLY - force file system read-only - with standby daemon mds sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-05-0730-quincy sha1: f1e315a9732d36c05ec316678e2397dc58561c7f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7519 sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-05-0730-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f1e315a9732d36c05ec316678e2397dc58561c7f targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCSFSdiZKcLmyGO0r296YGrht1THF1fBW73f3MsIa+MU/HIO1DrrFx2l/eDdgLmxb+srEPoasttona7m0Rn3HQM= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLYCW+Bineqy7fYATmxxFptUdHyHPy9Dx0sRKEZSHpKp64Um7RUy20PZtLf6QTL/lmWCndY+bmPXbO76XS726Wg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_damage teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:52:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T02:03:50.539 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa; will attempt to use it 2023-10-06T02:03:50.540 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa/tasks 2023-10-06T02:03:50.540 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T02:03:50.541 INFO:teuthology.task.internal:Checking packages... 2023-10-06T02:03:50.563 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2' 2023-10-06T02:03:50.563 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T02:03:50.563 INFO:teuthology.packaging:ref: None 2023-10-06T02:03:50.563 INFO:teuthology.packaging:tag: None 2023-10-06T02:03:50.563 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T02:03:50.563 INFO:teuthology.packaging:sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:03:50.564 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T02:03:50.712 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1296.gf1e315a9 2023-10-06T02:03:50.712 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T02:03:50.721 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T02:03:50.721 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T02:03:50.767 INFO:teuthology.task.internal:Saving configuration 2023-10-06T02:03:50.782 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T02:03:50.796 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T02:03:50.820 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412131', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 01:58:53.242942', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCSFSdiZKcLmyGO0r296YGrht1THF1fBW73f3MsIa+MU/HIO1DrrFx2l/eDdgLmxb+srEPoasttona7m0Rn3HQM='} 2023-10-06T02:03:50.845 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412131', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 01:58:53.244356', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLYCW+Bineqy7fYATmxxFptUdHyHPy9Dx0sRKEZSHpKp64Um7RUy20PZtLf6QTL/lmWCndY+bmPXbO76XS726Wg='} 2023-10-06T02:03:50.845 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T02:03:50.856 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T02:03:50.857 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T02:03:50.857 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T02:03:50.949 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2736d03b80>, signals=[15]) 2023-10-06T02:03:50.950 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T02:03:50.961 INFO:teuthology.task.internal:Opening connections... 2023-10-06T02:03:50.961 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:03:50.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:03:51.030 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:03:51.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:03:51.095 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T02:03:51.104 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-10-06T02:03:51.121 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-10-06T02:03:51.121 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-10-06T02:03:51.179 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T02:03:51.179 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T02:03:51.179 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2023-10-06T02:03:51.179 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2023-10-06T02:03:51.179 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.4" 2023-10-06T02:03:51.179 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-10-06T02:03:51.179 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T02:03:51.179 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-10-06T02:03:51.179 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T02:03:51.180 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T02:03:51.180 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T02:03:51.180 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T02:03:51.180 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:03:51.180 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T02:03:51.180 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T02:03:51.180 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T02:03:51.180 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T02:03:51.181 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-10-06T02:03:51.203 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2023-10-06T02:03:51.218 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2023-10-06T02:03:51.218 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-10-06T02:03:51.271 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T02:03:51.272 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T02:03:51.272 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel" 2023-10-06T02:03:51.272 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora" 2023-10-06T02:03:51.272 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.4" 2023-10-06T02:03:51.272 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-10-06T02:03:51.272 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T02:03:51.272 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-10-06T02:03:51.272 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T02:03:51.272 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T02:03:51.272 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T02:03:51.272 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T02:03:51.273 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:03:51.273 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T02:03:51.273 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T02:03:51.273 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T02:03:51.273 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T02:03:51.273 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-10-06T02:03:51.295 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T02:03:51.306 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T02:03:51.336 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T02:03:51.337 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2023-10-06T02:03:51.339 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2023-10-06T02:03:51.353 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T02:03:51.364 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T02:03:51.364 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2023-10-06T02:03:51.396 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2023-10-06T02:03:51.410 INFO:teuthology.orchestra.run.smithi175.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T02:03:51.410 INFO:teuthology.orchestra.run.smithi006.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T02:03:51.411 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T02:03:51.472 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T02:03:51.490 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-06T02:03:51.491 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-06T02:03:51.491 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T02:03:51.491 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T02:03:51.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:03:51.504 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2023-10-06T02:03:51.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:03:51.507 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2023-10-06T02:03:51.558 INFO:teuthology.orchestra.run.smithi175.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T02:03:51.558 INFO:teuthology.task.kernel:Running kernel on smithi175: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T02:03:51.558 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum install -y kernel 2023-10-06T02:03:51.564 INFO:teuthology.orchestra.run.smithi006.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T02:03:51.565 INFO:teuthology.task.kernel:Running kernel on smithi006: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T02:03:51.565 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum install -y kernel 2023-10-06T02:03:52.976 INFO:teuthology.orchestra.run.smithi175.stdout:Updating Subscription Management repositories. 2023-10-06T02:03:52.976 INFO:teuthology.orchestra.run.smithi175.stdout:Unable to read consumer identity 2023-10-06T02:03:53.028 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-10-06T02:03:53.028 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-10-06T02:03:54.319 INFO:teuthology.orchestra.run.smithi175.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-06T02:03:54.425 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 33 kB/s | 3.5 kB 00:00 2023-10-06T02:03:54.845 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 32 MB/s | 16 MB 00:00 2023-10-06T02:03:55.339 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-10-06T02:03:58.171 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-06T02:03:58.858 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 4.0 MB/s | 24 kB 00:00 2023-10-06T02:03:58.897 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T02:03:58.897 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T02:03:58.898 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T02:03:59.058 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2023-10-06T02:03:59.059 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2023-10-06T02:03:59.059 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2023-10-06T02:03:59.184 DEBUG:teuthology.orchestra.run.smithi175:> echo no | sudo yum reinstall kernel || true 2023-10-06T02:03:59.527 INFO:teuthology.orchestra.run.smithi175.stdout:Updating Subscription Management repositories. 2023-10-06T02:03:59.528 INFO:teuthology.orchestra.run.smithi175.stdout:Unable to read consumer identity 2023-10-06T02:03:59.580 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T02:03:59.580 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T02:03:59.580 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T02:03:59.735 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-10-06T02:03:59.736 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2023-10-06T02:03:59.737 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-10-06T02:03:59.814 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:01 ago on Fri 06 Oct 2023 02:03:58 AM UTC. 2023-10-06T02:03:59.850 DEBUG:teuthology.orchestra.run.smithi006:> echo no | sudo yum reinstall kernel || true 2023-10-06T02:03:59.957 INFO:teuthology.orchestra.run.smithi175.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T02:03:59.958 INFO:teuthology.orchestra.run.smithi175.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:03:59.958 INFO:teuthology.orchestra.run.smithi175.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:03:59.986 INFO:teuthology.orchestra.run.smithi175.stderr:Error: No packages marked for reinstall. 2023-10-06T02:04:00.036 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum reinstall -y kernel || true 2023-10-06T02:04:00.254 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-10-06T02:04:00.254 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-10-06T02:04:00.377 INFO:teuthology.orchestra.run.smithi175.stdout:Updating Subscription Management repositories. 2023-10-06T02:04:00.377 INFO:teuthology.orchestra.run.smithi175.stdout:Unable to read consumer identity 2023-10-06T02:04:00.563 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 02:03:58 AM UTC. 2023-10-06T02:04:00.662 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 02:03:58 AM UTC. 2023-10-06T02:04:00.698 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T02:04:00.698 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:04:00.698 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:04:00.725 INFO:teuthology.orchestra.run.smithi006.stderr:Error: No packages marked for reinstall. 2023-10-06T02:04:00.776 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum reinstall -y kernel || true 2023-10-06T02:04:00.806 INFO:teuthology.orchestra.run.smithi175.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T02:04:00.806 INFO:teuthology.orchestra.run.smithi175.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:04:00.806 INFO:teuthology.orchestra.run.smithi175.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:04:00.820 INFO:teuthology.orchestra.run.smithi175.stderr:Error: No packages marked for reinstall. 2023-10-06T02:04:00.876 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:04:01.001 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:04:01.001 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:04:01.001 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:04:01.001 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T02:04:01.002 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T02:04:01.002 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-06T02:04:01.002 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi175.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T02:04:01.002 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:04:01.129 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:04:01.129 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:04:01.129 DEBUG:teuthology.orchestra.run.smithi175:> sudo rpm -qi grub2-tools 2023-10-06T02:04:01.141 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-10-06T02:04:01.141 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-10-06T02:04:01.156 INFO:teuthology.orchestra.run.smithi175.stdout:Name : grub2-tools 2023-10-06T02:04:01.156 INFO:teuthology.orchestra.run.smithi175.stdout:Epoch : 1 2023-10-06T02:04:01.156 INFO:teuthology.orchestra.run.smithi175.stdout:Version : 2.02 2023-10-06T02:04:01.156 INFO:teuthology.orchestra.run.smithi175.stdout:Release : 99.el8_4.1 2023-10-06T02:04:01.156 INFO:teuthology.orchestra.run.smithi175.stdout:Architecture: x86_64 2023-10-06T02:04:01.156 INFO:teuthology.orchestra.run.smithi175.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T02:04:01.156 INFO:teuthology.orchestra.run.smithi175.stdout:Group : System Environment/Base 2023-10-06T02:04:01.156 INFO:teuthology.orchestra.run.smithi175.stdout:Size : 9264631 2023-10-06T02:04:01.156 INFO:teuthology.orchestra.run.smithi175.stdout:License : GPLv3+ 2023-10-06T02:04:01.156 INFO:teuthology.orchestra.run.smithi175.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T02:04:01.156 INFO:teuthology.orchestra.run.smithi175.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T02:04:01.157 INFO:teuthology.orchestra.run.smithi175.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T02:04:01.157 INFO:teuthology.orchestra.run.smithi175.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T02:04:01.157 INFO:teuthology.orchestra.run.smithi175.stdout:Relocations : (not relocatable) 2023-10-06T02:04:01.157 INFO:teuthology.orchestra.run.smithi175.stdout:Packager : Red Hat, Inc. 2023-10-06T02:04:01.157 INFO:teuthology.orchestra.run.smithi175.stdout:Vendor : Red Hat, Inc. 2023-10-06T02:04:01.157 INFO:teuthology.orchestra.run.smithi175.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T02:04:01.157 INFO:teuthology.orchestra.run.smithi175.stdout:Summary : Support tools for GRUB. 2023-10-06T02:04:01.157 INFO:teuthology.orchestra.run.smithi175.stdout:Description : 2023-10-06T02:04:01.157 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:04:01.157 INFO:teuthology.orchestra.run.smithi175.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T02:04:01.157 INFO:teuthology.orchestra.run.smithi175.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T02:04:01.157 INFO:teuthology.orchestra.run.smithi175.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T02:04:01.157 INFO:teuthology.orchestra.run.smithi175.stdout:hardware devices. 2023-10-06T02:04:01.158 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:04:01.158 INFO:teuthology.orchestra.run.smithi175.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T02:04:01.158 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T02:04:01.159 INFO:teuthology.task.kernel:Updating grub on smithi175 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:04:01.159 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T02:04:01.443 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:00:03 ago on Fri 06 Oct 2023 02:03:58 AM UTC. 2023-10-06T02:04:01.592 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T02:04:01.592 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:04:01.592 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:04:01.605 INFO:teuthology.orchestra.run.smithi006.stderr:Error: No packages marked for reinstall. 2023-10-06T02:04:01.661 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:04:01.791 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:04:01.791 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:04:01.792 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:04:01.792 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T02:04:01.792 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T02:04:01.792 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-06T02:04:01.792 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi006.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T02:04:01.792 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:04:01.922 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:04:01.923 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:04:01.923 DEBUG:teuthology.orchestra.run.smithi006:> sudo rpm -qi grub2-tools 2023-10-06T02:04:01.950 INFO:teuthology.orchestra.run.smithi006.stdout:Name : grub2-tools 2023-10-06T02:04:01.951 INFO:teuthology.orchestra.run.smithi006.stdout:Epoch : 1 2023-10-06T02:04:01.951 INFO:teuthology.orchestra.run.smithi006.stdout:Version : 2.02 2023-10-06T02:04:01.951 INFO:teuthology.orchestra.run.smithi006.stdout:Release : 99.el8_4.1 2023-10-06T02:04:01.951 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: x86_64 2023-10-06T02:04:01.951 INFO:teuthology.orchestra.run.smithi006.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T02:04:01.951 INFO:teuthology.orchestra.run.smithi006.stdout:Group : System Environment/Base 2023-10-06T02:04:01.951 INFO:teuthology.orchestra.run.smithi006.stdout:Size : 9264631 2023-10-06T02:04:01.951 INFO:teuthology.orchestra.run.smithi006.stdout:License : GPLv3+ 2023-10-06T02:04:01.951 INFO:teuthology.orchestra.run.smithi006.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T02:04:01.951 INFO:teuthology.orchestra.run.smithi006.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T02:04:01.952 INFO:teuthology.orchestra.run.smithi006.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T02:04:01.952 INFO:teuthology.orchestra.run.smithi006.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T02:04:01.952 INFO:teuthology.orchestra.run.smithi006.stdout:Relocations : (not relocatable) 2023-10-06T02:04:01.952 INFO:teuthology.orchestra.run.smithi006.stdout:Packager : Red Hat, Inc. 2023-10-06T02:04:01.952 INFO:teuthology.orchestra.run.smithi006.stdout:Vendor : Red Hat, Inc. 2023-10-06T02:04:01.952 INFO:teuthology.orchestra.run.smithi006.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T02:04:01.952 INFO:teuthology.orchestra.run.smithi006.stdout:Summary : Support tools for GRUB. 2023-10-06T02:04:01.952 INFO:teuthology.orchestra.run.smithi006.stdout:Description : 2023-10-06T02:04:01.952 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:04:01.952 INFO:teuthology.orchestra.run.smithi006.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T02:04:01.952 INFO:teuthology.orchestra.run.smithi006.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T02:04:01.952 INFO:teuthology.orchestra.run.smithi006.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T02:04:01.952 INFO:teuthology.orchestra.run.smithi006.stdout:hardware devices. 2023-10-06T02:04:01.953 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:04:01.953 INFO:teuthology.orchestra.run.smithi006.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T02:04:01.953 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T02:04:01.954 INFO:teuthology.task.kernel:Updating grub on smithi006 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:04:01.954 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T02:04:02.463 INFO:teuthology.orchestra.run.smithi175.stderr:Generating grub configuration file ... 2023-10-06T02:04:03.136 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2023-10-06T02:04:04.256 INFO:teuthology.orchestra.run.smithi175.stderr:done 2023-10-06T02:04:04.258 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2023-10-06T02:04:04.272 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.Z7ETlVFJcg 2023-10-06T02:04:04.272 DEBUG:teuthology.orchestra.run.smithi175:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Z7ETlVFJcg 2023-10-06T02:04:04.350 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.Z7ETlVFJcg 2023-10-06T02:04:04.503 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.Z7ETlVFJcg is 6KB 2023-10-06T02:04:04.551 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.Z7ETlVFJcg 2023-10-06T02:04:04.564 DEBUG:teuthology.orchestra.run.smithi175:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T02:04:04.626 INFO:teuthology.orchestra.run.smithi175.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T02:04:04.626 INFO:teuthology.orchestra.run.smithi175.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T02:04:04.626 INFO:teuthology.orchestra.run.smithi175.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T02:04:04.626 INFO:teuthology.orchestra.run.smithi175.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T02:04:04.627 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:04:04.777 DEBUG:teuthology.orchestra.run.smithi175:> sudo shutdown -r now 2023-10-06T02:04:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:done 2023-10-06T02:04:05.256 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2023-10-06T02:04:05.270 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.fPK6BW0Jps 2023-10-06T02:04:05.270 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.fPK6BW0Jps 2023-10-06T02:04:05.356 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.fPK6BW0Jps 2023-10-06T02:04:05.467 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.fPK6BW0Jps is 6KB 2023-10-06T02:04:05.486 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.fPK6BW0Jps 2023-10-06T02:04:05.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T02:04:05.567 INFO:teuthology.orchestra.run.smithi006.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T02:04:05.567 INFO:teuthology.orchestra.run.smithi006.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T02:04:05.567 INFO:teuthology.orchestra.run.smithi006.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T02:04:05.567 INFO:teuthology.orchestra.run.smithi006.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T02:04:05.568 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:04:05.727 DEBUG:teuthology.orchestra.run.smithi006:> sudo shutdown -r now 2023-10-06T02:04:34.805 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-06T02:04:34.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-10-06T02:04:34.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:04:35.730 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-06T02:04:35.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-10-06T02:04:35.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:04:53.242 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-06T02:04:54.266 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-10-06T02:05:02.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-10-06T02:05:02.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:05:03.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-10-06T02:05:03.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:05:05.306 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-06T02:05:17.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-10-06T02:05:17.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:05:35.738 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-06T02:05:50.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-10-06T02:05:50.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:05:51.200 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-10-06T02:05:51.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-10-06T02:05:51.438 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T02:05:51.438 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2023-10-06T02:05:51.452 INFO:teuthology.orchestra.run.smithi175.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T02:05:51.452 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:05:51.452 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T02:05:51.452 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T02:05:52.453 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-06T02:05:52.454 DEBUG:teuthology.orchestra.run.smithi175:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T02:05:53.077 INFO:teuthology.orchestra.run.smithi175.stdout:ttyS1 2023-10-06T02:05:53.134 DEBUG:teuthology.parallel:result is None 2023-10-06T02:06:03.271 DEBUG:teuthology.orchestra.remote:timed out 2023-10-06T02:06:15.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-10-06T02:06:15.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:06:15.581 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-10-06T02:06:15.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-10-06T02:06:15.863 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T02:06:15.863 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2023-10-06T02:06:15.878 INFO:teuthology.orchestra.run.smithi006.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T02:06:15.879 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:06:15.879 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T02:06:15.879 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T02:06:16.880 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-06T02:06:16.880 DEBUG:teuthology.orchestra.run.smithi006:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T02:06:16.971 INFO:teuthology.orchestra.run.smithi006.stdout:ttyS1 2023-10-06T02:06:16.987 DEBUG:teuthology.parallel:result is None 2023-10-06T02:06:16.987 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T02:06:17.000 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T02:06:17.000 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T02:06:17.002 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T02:06:17.020 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T02:06:17.039 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T02:06:17.074 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T02:06:17.075 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T02:06:17.077 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T02:06:17.129 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T02:06:17.137 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T02:06:17.137 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T02:06:17.147 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T02:06:17.185 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:06:17.194 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:06:17.197 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:06:17.206 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:06:17.208 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T02:06:17.217 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T02:06:17.217 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T02:06:17.219 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T02:06:17.267 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T02:06:17.281 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T02:06:17.281 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T02:06:17.287 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T02:06:17.322 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:06:17.384 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:06:17.437 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:06:17.518 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:06:17.561 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:06:17.561 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T02:06:17.626 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:06:17.670 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:06:17.712 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:06:17.794 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:06:17.836 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:06:17.836 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T02:06:17.901 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2023-10-06T02:06:17.903 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2023-10-06T02:06:17.959 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T02:06:18.008 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T02:06:18.427 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T02:06:18.437 INFO:teuthology.task.internal:Starting timer... 2023-10-06T02:06:18.437 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T02:06:18.469 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T02:06:18.505 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T02:06:18.505 DEBUG:teuthology.orchestra.run.smithi006:> sudo service auditd rotate 2023-10-06T02:06:18.575 INFO:teuthology.orchestra.run.smithi006.stdout:Rotating logs: [ OK ] 2023-10-06T02:06:18.577 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2023-10-06T02:06:18.638 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: [ OK ] 2023-10-06T02:06:18.640 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T02:06:18.640 DEBUG:teuthology.orchestra.run.smithi006:> /usr/sbin/getenforce 2023-10-06T02:06:18.660 INFO:teuthology.orchestra.run.smithi006.stdout:Permissive 2023-10-06T02:06:18.660 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2023-10-06T02:06:18.684 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2023-10-06T02:06:18.684 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi006.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2023-10-06T02:06:18.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T02:06:18.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:06:18.729 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T02:06:18.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:06:18.755 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T02:06:18.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo /usr/sbin/setenforce permissive 2023-10-06T02:06:18.794 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2023-10-06T02:06:18.820 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T02:06:18.830 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-06T02:06:18.830 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T02:06:18.847 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T02:06:18.848 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T02:14:40.011 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2023-10-06T02:14:40.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-10-06T02:14:40.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:14:40.082 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-10-06T02:14:40.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-10-06T02:14:40.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-10-06T02:14:40.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:14:40.176 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-10-06T02:14:40.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-10-06T02:14:40.241 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T02:14:40.254 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T02:14:40.254 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T02:14:40.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:14:40.257 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T02:14:40.257 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:14:40.288 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T02:14:40.304 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T02:14:40.309 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T02:14:40.323 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T02:14:40.345 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: ntpd: command not found 2023-10-06T02:14:40.356 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2023-10-06T02:14:40.356 INFO:teuthology.orchestra.run.smithi006.stdout:506 Cannot talk to daemon 2023-10-06T02:14:40.366 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2023-10-06T02:14:40.371 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T02:14:40.380 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T02:14:40.386 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T02:14:40.394 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T02:14:40.457 INFO:teuthology.orchestra.run.smithi006.stderr:bash: ntpq: command not found 2023-10-06T02:14:40.459 INFO:teuthology.orchestra.run.smithi175.stderr:bash: ntpq: command not found 2023-10-06T02:14:40.459 INFO:teuthology.orchestra.run.smithi006.stdout:210 Number of sources = 4 2023-10-06T02:14:40.459 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T02:14:40.459 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2023-10-06T02:14:40.459 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:14:40.460 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:14:40.460 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:14:40.460 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:14:40.461 INFO:teuthology.orchestra.run.smithi175.stdout:210 Number of sources = 4 2023-10-06T02:14:40.461 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T02:14:40.461 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2023-10-06T02:14:40.461 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:14:40.461 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:14:40.461 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:14:40.462 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:14:40.463 INFO:teuthology.run_tasks:Running task install... 2023-10-06T02:14:40.471 DEBUG:teuthology.task.install:project ceph 2023-10-06T02:14:40.471 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}} 2023-10-06T02:14:40.471 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'} 2023-10-06T02:14:40.472 INFO:teuthology.task.install:Using flavor: default 2023-10-06T02:14:40.477 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T02:14:40.477 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T02:14:40.478 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T02:14:40.478 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:14:40.480 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T02:14:40.480 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:14:40.703 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T02:14:40.703 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T02:14:40.718 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T02:14:40.718 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T02:14:40.827 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T02:14:40.829 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:14:40.829 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T02:14:40.854 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T02:14:40.855 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T02:14:40.881 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T02:14:40.881 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:14:40.881 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T02:14:40.909 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T02:14:40.910 DEBUG:teuthology.orchestra.run.smithi006:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T02:14:40.920 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T02:14:40.976 DEBUG:teuthology.orchestra.run.smithi006:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T02:14:40.995 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T02:14:41.053 DEBUG:teuthology.orchestra.run.smithi006:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T02:14:41.059 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2023-10-06T02:14:41.061 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2023-10-06T02:14:41.118 INFO:teuthology.orchestra.run.smithi006.stdout:check_obsoletes = 1 2023-10-06T02:14:41.119 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum clean all 2023-10-06T02:14:41.451 INFO:teuthology.orchestra.run.smithi175.stdout:Updating Subscription Management repositories. 2023-10-06T02:14:41.531 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-10-06T02:14:41.929 INFO:teuthology.orchestra.run.smithi175.stdout:44 files removed 2023-10-06T02:14:41.979 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T02:14:41.988 INFO:teuthology.orchestra.run.smithi006.stdout:44 files removed 2023-10-06T02:14:42.042 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T02:14:42.328 INFO:teuthology.orchestra.run.smithi175.stdout:Updating Subscription Management repositories. 2023-10-06T02:14:42.412 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-10-06T02:14:43.316 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 208 kB/s | 78 kB 00:00 2023-10-06T02:14:43.386 INFO:teuthology.orchestra.run.smithi006.stdout:ceph packages for x86_64 248 kB/s | 78 kB 00:00 2023-10-06T02:14:43.602 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 37 kB/s | 9.2 kB 00:00 2023-10-06T02:14:43.616 INFO:teuthology.orchestra.run.smithi006.stdout:ceph noarch packages 49 kB/s | 9.2 kB 00:00 2023-10-06T02:14:43.877 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 5.9 kB/s | 1.4 kB 00:00 2023-10-06T02:14:43.894 INFO:teuthology.orchestra.run.smithi006.stdout:ceph source packages 5.9 kB/s | 1.4 kB 00:00 2023-10-06T02:14:43.984 INFO:teuthology.orchestra.run.smithi175.stdout:Copr repo for python3-asyncssh owned by ceph 44 kB/s | 3.5 kB 00:00 2023-10-06T02:14:44.006 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 43 kB/s | 3.5 kB 00:00 2023-10-06T02:14:44.815 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-10-06T02:14:45.374 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-10-06T02:14:48.057 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-06T02:14:48.425 INFO:teuthology.orchestra.run.smithi175.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 116 MB/s | 33 MB 00:00 2023-10-06T02:14:49.025 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-06T02:14:49.493 INFO:teuthology.orchestra.run.smithi006.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 100 MB/s | 38 MB 00:00 2023-10-06T02:14:53.600 INFO:teuthology.orchestra.run.smithi175.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 105 MB/s | 38 MB 00:00 2023-10-06T02:14:55.858 INFO:teuthology.orchestra.run.smithi006.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 52 MB/s | 33 MB 00:00 2023-10-06T02:15:01.862 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T02:15:01.862 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T02:15:01.873 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T02:15:01.873 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T02:15:01.874 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T02:15:01.875 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T02:15:01.877 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T02:15:01.879 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T02:15:01.880 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T02:15:02.377 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2023-10-06T02:15:02.388 INFO:teuthology.orchestra.run.smithi175.stdout:====================================================================================================================== 2023-10-06T02:15:02.388 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2023-10-06T02:15:02.388 INFO:teuthology.orchestra.run.smithi175.stdout:====================================================================================================================== 2023-10-06T02:15:02.388 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2023-10-06T02:15:02.388 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T02:15:02.389 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T02:15:02.389 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T02:15:02.389 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T02:15:02.389 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T02:15:02.389 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T02:15:02.389 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T02:15:02.389 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T02:15:02.389 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T02:15:02.389 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T02:15:02.389 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T02:15:02.389 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T02:15:02.389 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T02:15:02.389 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T02:15:02.390 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T02:15:02.390 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T02:15:02.390 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T02:15:02.390 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T02:15:02.390 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T02:15:02.390 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T02:15:02.390 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T02:15:02.390 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T02:15:02.390 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T02:15:02.390 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T02:15:02.390 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T02:15:02.390 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T02:15:02.391 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T02:15:02.391 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T02:15:02.391 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T02:15:02.391 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T02:15:02.391 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T02:15:02.391 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T02:15:02.391 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T02:15:02.391 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2023-10-06T02:15:02.391 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T02:15:02.391 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T02:15:02.391 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2023-10-06T02:15:02.391 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T02:15:02.391 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T02:15:02.392 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T02:15:02.392 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T02:15:02.392 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T02:15:02.392 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T02:15:02.392 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T02:15:02.392 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T02:15:02.392 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T02:15:02.392 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T02:15:02.392 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T02:15:02.392 INFO:teuthology.orchestra.run.smithi175.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T02:15:02.392 INFO:teuthology.orchestra.run.smithi175.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T02:15:02.392 INFO:teuthology.orchestra.run.smithi175.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T02:15:02.393 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T02:15:02.393 INFO:teuthology.orchestra.run.smithi175.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T02:15:02.393 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T02:15:02.393 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T02:15:02.393 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T02:15:02.393 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T02:15:02.393 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T02:15:02.393 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T02:15:02.393 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T02:15:02.393 INFO:teuthology.orchestra.run.smithi175.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T02:15:02.393 INFO:teuthology.orchestra.run.smithi175.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T02:15:02.393 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T02:15:02.393 INFO:teuthology.orchestra.run.smithi175.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T02:15:02.394 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T02:15:02.394 INFO:teuthology.orchestra.run.smithi175.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T02:15:02.394 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T02:15:02.394 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T02:15:02.394 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T02:15:02.394 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T02:15:02.394 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T02:15:02.394 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T02:15:02.394 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T02:15:02.394 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T02:15:02.394 INFO:teuthology.orchestra.run.smithi175.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T02:15:02.395 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T02:15:02.395 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T02:15:02.395 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T02:15:02.395 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T02:15:02.395 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T02:15:02.395 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T02:15:02.395 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T02:15:02.395 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T02:15:02.395 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T02:15:02.395 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T02:15:02.395 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T02:15:02.395 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T02:15:02.395 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T02:15:02.396 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T02:15:02.396 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T02:15:02.396 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T02:15:02.396 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T02:15:02.397 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T02:15:02.397 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T02:15:02.397 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T02:15:02.397 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T02:15:02.397 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T02:15:02.397 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T02:15:02.397 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T02:15:02.397 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T02:15:02.398 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T02:15:02.398 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T02:15:02.398 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T02:15:02.398 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T02:15:02.398 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T02:15:02.398 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T02:15:02.398 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T02:15:02.398 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T02:15:02.398 INFO:teuthology.orchestra.run.smithi175.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T02:15:02.398 INFO:teuthology.orchestra.run.smithi175.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T02:15:02.398 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T02:15:02.398 INFO:teuthology.orchestra.run.smithi175.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T02:15:02.399 INFO:teuthology.orchestra.run.smithi175.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T02:15:02.399 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T02:15:02.399 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T02:15:02.399 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T02:15:02.399 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T02:15:02.399 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T02:15:02.399 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T02:15:02.399 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T02:15:02.399 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T02:15:02.399 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T02:15:02.399 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:15:02.399 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2023-10-06T02:15:02.400 INFO:teuthology.orchestra.run.smithi175.stdout:====================================================================================================================== 2023-10-06T02:15:02.400 INFO:teuthology.orchestra.run.smithi175.stdout:Install 118 Packages 2023-10-06T02:15:02.400 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 2 Packages 2023-10-06T02:15:02.400 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:15:02.400 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 201 M 2023-10-06T02:15:02.401 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2023-10-06T02:15:02.935 INFO:teuthology.orchestra.run.smithi175.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 42 kB/s | 6.4 kB 00:00 2023-10-06T02:15:03.270 INFO:teuthology.orchestra.run.smithi175.stdout:(2/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 11 MB/s | 5.2 MB 00:00 2023-10-06T02:15:03.309 INFO:teuthology.orchestra.run.smithi175.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 4.1 MB/s | 162 kB 00:00 2023-10-06T02:15:03.500 INFO:teuthology.orchestra.run.smithi175.stdout:(4/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 12 MB/s | 2.3 MB 00:00 2023-10-06T02:15:03.890 INFO:teuthology.orchestra.run.smithi175.stdout:(5/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 4.0 MB/s | 1.6 MB 00:00 2023-10-06T02:15:04.169 INFO:teuthology.orchestra.run.smithi175.stdout:(6/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 710 kB/s | 876 kB 00:01 2023-10-06T02:15:04.319 INFO:teuthology.orchestra.run.smithi175.stdout:(7/120): ceph-common-17.2.6-1296.g736ac5ba.el8. 15 MB/s | 23 MB 00:01 2023-10-06T02:15:04.400 INFO:teuthology.orchestra.run.smithi175.stdout:(8/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 7.7 MB/s | 3.9 MB 00:00 2023-10-06T02:15:04.446 INFO:teuthology.orchestra.run.smithi175.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 540 kB/s | 24 kB 00:00 2023-10-06T02:15:04.477 INFO:teuthology.orchestra.run.smithi006.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T02:15:04.478 INFO:teuthology.orchestra.run.smithi006.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T02:15:04.490 INFO:teuthology.orchestra.run.smithi006.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T02:15:04.491 INFO:teuthology.orchestra.run.smithi006.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T02:15:04.491 INFO:teuthology.orchestra.run.smithi006.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T02:15:04.492 INFO:teuthology.orchestra.run.smithi006.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T02:15:04.494 INFO:teuthology.orchestra.run.smithi006.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T02:15:04.497 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T02:15:04.498 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T02:15:05.011 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-10-06T02:15:05.023 INFO:teuthology.orchestra.run.smithi006.stdout:====================================================================================================================== 2023-10-06T02:15:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2023-10-06T02:15:05.024 INFO:teuthology.orchestra.run.smithi006.stdout:====================================================================================================================== 2023-10-06T02:15:05.024 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2023-10-06T02:15:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T02:15:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T02:15:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T02:15:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T02:15:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T02:15:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T02:15:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T02:15:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T02:15:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T02:15:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T02:15:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T02:15:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T02:15:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T02:15:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T02:15:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T02:15:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T02:15:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T02:15:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T02:15:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T02:15:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T02:15:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T02:15:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T02:15:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T02:15:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T02:15:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T02:15:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T02:15:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T02:15:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T02:15:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T02:15:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T02:15:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T02:15:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T02:15:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T02:15:05.027 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2023-10-06T02:15:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T02:15:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T02:15:05.028 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2023-10-06T02:15:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T02:15:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T02:15:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T02:15:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T02:15:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T02:15:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T02:15:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T02:15:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T02:15:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T02:15:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T02:15:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T02:15:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T02:15:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T02:15:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T02:15:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T02:15:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T02:15:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T02:15:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T02:15:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T02:15:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T02:15:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T02:15:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T02:15:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T02:15:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T02:15:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T02:15:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T02:15:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T02:15:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T02:15:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T02:15:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T02:15:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T02:15:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T02:15:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T02:15:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T02:15:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T02:15:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T02:15:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T02:15:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T02:15:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T02:15:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T02:15:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T02:15:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T02:15:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T02:15:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T02:15:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T02:15:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T02:15:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T02:15:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T02:15:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T02:15:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T02:15:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T02:15:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T02:15:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T02:15:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T02:15:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T02:15:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T02:15:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T02:15:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T02:15:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T02:15:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T02:15:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T02:15:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T02:15:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T02:15:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T02:15:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T02:15:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T02:15:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T02:15:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T02:15:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T02:15:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T02:15:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T02:15:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T02:15:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T02:15:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T02:15:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T02:15:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T02:15:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T02:15:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T02:15:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T02:15:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T02:15:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T02:15:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T02:15:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T02:15:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T02:15:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T02:15:05.037 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:15:05.037 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2023-10-06T02:15:05.037 INFO:teuthology.orchestra.run.smithi006.stdout:====================================================================================================================== 2023-10-06T02:15:05.037 INFO:teuthology.orchestra.run.smithi006.stdout:Install 118 Packages 2023-10-06T02:15:05.037 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 2 Packages 2023-10-06T02:15:05.037 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:15:05.038 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 201 M 2023-10-06T02:15:05.038 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2023-10-06T02:15:05.297 INFO:teuthology.orchestra.run.smithi175.stdout:(10/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el 17 MB/s | 17 MB 00:00 2023-10-06T02:15:05.331 INFO:teuthology.orchestra.run.smithi175.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 7.3 MB/s | 255 kB 00:00 2023-10-06T02:15:05.354 INFO:teuthology.orchestra.run.smithi175.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 1.1 MB/s | 25 kB 00:00 2023-10-06T02:15:05.408 INFO:teuthology.orchestra.run.smithi175.stdout:(13/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 14 MB/s | 797 kB 00:00 2023-10-06T02:15:05.439 INFO:teuthology.orchestra.run.smithi175.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 5.6 MB/s | 174 kB 00:00 2023-10-06T02:15:05.468 INFO:teuthology.orchestra.run.smithi175.stdout:(15/120): librados-devel-17.2.6-1296.g736ac5ba. 4.3 MB/s | 130 kB 00:00 2023-10-06T02:15:05.509 INFO:teuthology.orchestra.run.smithi175.stdout:(16/120): libradosstriper1-17.2.6-1296.g736ac5b 12 MB/s | 507 kB 00:00 2023-10-06T02:15:05.687 INFO:teuthology.orchestra.run.smithi006.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 24 kB/s | 6.4 kB 00:00 2023-10-06T02:15:05.842 INFO:teuthology.orchestra.run.smithi175.stdout:(17/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 17 MB/s | 5.6 MB 00:00 2023-10-06T02:15:05.866 INFO:teuthology.orchestra.run.smithi175.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 1.7 MB/s | 45 kB 00:00 2023-10-06T02:15:05.903 INFO:teuthology.orchestra.run.smithi175.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 3.1 MB/s | 115 kB 00:00 2023-10-06T02:15:05.952 INFO:teuthology.orchestra.run.smithi175.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 3.8 MB/s | 190 kB 00:00 2023-10-06T02:15:06.015 INFO:teuthology.orchestra.run.smithi175.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 5.8 MB/s | 371 kB 00:00 2023-10-06T02:15:06.086 INFO:teuthology.orchestra.run.smithi175.stdout:(22/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 5.0 MB/s | 358 kB 00:00 2023-10-06T02:15:06.149 INFO:teuthology.orchestra.run.smithi175.stdout:(23/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 1.7 MB/s | 107 kB 00:00 2023-10-06T02:15:06.198 INFO:teuthology.orchestra.run.smithi175.stdout:(24/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.8 MB/s | 90 kB 00:00 2023-10-06T02:15:06.199 INFO:teuthology.orchestra.run.smithi006.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.7 MB/s | 876 kB 00:00 2023-10-06T02:15:06.492 INFO:teuthology.orchestra.run.smithi175.stdout:(25/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 12 MB/s | 3.5 MB 00:00 2023-10-06T02:15:06.533 INFO:teuthology.orchestra.run.smithi175.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 4.2 MB/s | 173 kB 00:00 2023-10-06T02:15:06.571 INFO:teuthology.orchestra.run.smithi175.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 603 kB/s | 23 kB 00:00 2023-10-06T02:15:06.606 INFO:teuthology.orchestra.run.smithi175.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 3.4 MB/s | 121 kB 00:00 2023-10-06T02:15:06.745 INFO:teuthology.orchestra.run.smithi175.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 12 MB/s | 1.7 MB 00:00 2023-10-06T02:15:06.955 INFO:teuthology.orchestra.run.smithi006.stdout:(3/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 3.4 MB/s | 5.2 MB 00:01 2023-10-06T02:15:06.956 INFO:teuthology.orchestra.run.smithi006.stdout:(4/120): ceph-immutable-object-cache-17.2.6-129 214 kB/s | 162 kB 00:00 2023-10-06T02:15:07.403 INFO:teuthology.orchestra.run.smithi175.stdout:(30/120): ceph-mgr-diskprediction-local-17.2.6- 11 MB/s | 7.4 MB 00:00 2023-10-06T02:15:07.457 INFO:teuthology.orchestra.run.smithi175.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 4.4 MB/s | 238 kB 00:00 2023-10-06T02:15:07.504 INFO:teuthology.orchestra.run.smithi006.stdout:(5/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 4.2 MB/s | 2.3 MB 00:00 2023-10-06T02:15:07.505 INFO:teuthology.orchestra.run.smithi175.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 990 kB/s | 47 kB 00:00 2023-10-06T02:15:07.552 INFO:teuthology.orchestra.run.smithi175.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 311 kB/s | 14 kB 00:00 2023-10-06T02:15:07.602 INFO:teuthology.orchestra.run.smithi175.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 5.2 MB/s | 267 kB 00:00 2023-10-06T02:15:07.653 INFO:teuthology.orchestra.run.smithi175.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 1.6 MB/s | 80 kB 00:00 2023-10-06T02:15:07.691 INFO:teuthology.orchestra.run.smithi175.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 472 kB/s | 18 kB 00:00 2023-10-06T02:15:07.700 INFO:teuthology.orchestra.run.smithi006.stdout:(6/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 2.1 MB/s | 1.6 MB 00:00 2023-10-06T02:15:07.799 INFO:teuthology.orchestra.run.smithi175.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 2.8 MB/s | 306 kB 00:00 2023-10-06T02:15:07.817 INFO:teuthology.orchestra.run.smithi175.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 3.1 MB/s | 59 kB 00:00 2023-10-06T02:15:07.837 INFO:teuthology.orchestra.run.smithi175.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 3.8 MB/s | 75 kB 00:00 2023-10-06T02:15:07.878 INFO:teuthology.orchestra.run.smithi175.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 11 MB/s | 476 kB 00:00 2023-10-06T02:15:07.898 INFO:teuthology.orchestra.run.smithi175.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.2 MB/s | 44 kB 00:00 2023-10-06T02:15:07.919 INFO:teuthology.orchestra.run.smithi175.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 8.5 MB/s | 185 kB 00:00 2023-10-06T02:15:07.939 INFO:teuthology.orchestra.run.smithi175.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 1.6 MB/s | 33 kB 00:00 2023-10-06T02:15:07.958 INFO:teuthology.orchestra.run.smithi175.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 848 kB/s | 16 kB 00:00 2023-10-06T02:15:07.980 INFO:teuthology.orchestra.run.smithi175.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 7.8 MB/s | 173 kB 00:00 2023-10-06T02:15:08.005 INFO:teuthology.orchestra.run.smithi175.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 15 MB/s | 384 kB 00:00 2023-10-06T02:15:08.027 INFO:teuthology.orchestra.run.smithi175.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 3.8 MB/s | 81 kB 00:00 2023-10-06T02:15:08.046 INFO:teuthology.orchestra.run.smithi175.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 583 kB/s | 11 kB 00:00 2023-10-06T02:15:08.065 INFO:teuthology.orchestra.run.smithi175.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 912 kB/s | 18 kB 00:00 2023-10-06T02:15:08.111 INFO:teuthology.orchestra.run.smithi175.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 26 MB/s | 1.2 MB 00:00 2023-10-06T02:15:08.131 INFO:teuthology.orchestra.run.smithi175.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 2.4 MB/s | 49 kB 00:00 2023-10-06T02:15:08.151 INFO:teuthology.orchestra.run.smithi175.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 2.9 MB/s | 59 kB 00:00 2023-10-06T02:15:08.161 INFO:teuthology.orchestra.run.smithi006.stdout:(7/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 6.0 MB/s | 3.9 MB 00:00 2023-10-06T02:15:08.172 INFO:teuthology.orchestra.run.smithi175.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 2.8 MB/s | 60 kB 00:00 2023-10-06T02:15:08.196 INFO:teuthology.orchestra.run.smithi175.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 11 MB/s | 283 kB 00:00 2023-10-06T02:15:08.216 INFO:teuthology.orchestra.run.smithi175.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 815 kB/s | 16 kB 00:00 2023-10-06T02:15:08.235 INFO:teuthology.orchestra.run.smithi175.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.7 MB/s | 34 kB 00:00 2023-10-06T02:15:08.258 INFO:teuthology.orchestra.run.smithi175.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 8.4 MB/s | 196 kB 00:00 2023-10-06T02:15:08.282 INFO:teuthology.orchestra.run.smithi175.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 2.7 MB/s | 64 kB 00:00 2023-10-06T02:15:08.302 INFO:teuthology.orchestra.run.smithi175.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 962 kB/s | 19 kB 00:00 2023-10-06T02:15:08.321 INFO:teuthology.orchestra.run.smithi175.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 1.2 MB/s | 24 kB 00:00 2023-10-06T02:15:08.341 INFO:teuthology.orchestra.run.smithi175.stdout:(61/120): python3-tempora-1.14.1-5.el8.noarch.r 1.5 MB/s | 29 kB 00:00 2023-10-06T02:15:08.360 INFO:teuthology.orchestra.run.smithi175.stdout:(62/120): python3-trustme-0.6.0-4.el8.noarch.rp 1.4 MB/s | 27 kB 00:00 2023-10-06T02:15:08.384 INFO:teuthology.orchestra.run.smithi175.stdout:(63/120): python3-waitress-1.4.3-1.el8.noarch.r 11 MB/s | 255 kB 00:00 2023-10-06T02:15:08.407 INFO:teuthology.orchestra.run.smithi175.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 11 MB/s | 251 kB 00:00 2023-10-06T02:15:08.428 INFO:teuthology.orchestra.run.smithi175.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 2.9 MB/s | 61 kB 00:00 2023-10-06T02:15:08.448 INFO:teuthology.orchestra.run.smithi175.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 4.2 MB/s | 85 kB 00:00 2023-10-06T02:15:08.468 INFO:teuthology.orchestra.run.smithi175.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 1.2 MB/s | 23 kB 00:00 2023-10-06T02:15:08.510 INFO:teuthology.orchestra.run.smithi175.stdout:(68/120): thrift-0.13.0-2.el8.x86_64.rpm 43 MB/s | 1.7 MB 00:00 2023-10-06T02:15:08.513 INFO:teuthology.orchestra.run.smithi175.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 18 MB/s | 70 kB 00:00 2023-10-06T02:15:08.788 INFO:teuthology.orchestra.run.smithi175.stdout:(70/120): python3-scipy-1.0.0-20.module+el8.1.0 53 MB/s | 15 MB 00:00 2023-10-06T02:15:08.826 INFO:teuthology.orchestra.run.smithi175.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 1.1 MB/s | 44 kB 00:00 2023-10-06T02:15:08.855 INFO:teuthology.orchestra.run.smithi175.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 937 kB/s | 27 kB 00:00 2023-10-06T02:15:08.880 INFO:teuthology.orchestra.run.smithi175.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 6.3 MB/s | 161 kB 00:00 2023-10-06T02:15:08.902 INFO:teuthology.orchestra.run.smithi175.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 15 MB/s | 320 kB 00:00 2023-10-06T02:15:08.959 INFO:teuthology.orchestra.run.smithi175.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 7.8 MB/s | 457 kB 00:00 2023-10-06T02:15:09.037 INFO:teuthology.orchestra.run.smithi175.stdout:(76/120): python3-babel-2.5.1-5.el8.noarch.rpm 62 MB/s | 4.8 MB 00:00 2023-10-06T02:15:09.058 INFO:teuthology.orchestra.run.smithi175.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 1.8 MB/s | 39 kB 00:00 2023-10-06T02:15:09.094 INFO:teuthology.orchestra.run.smithi175.stdout:(78/120): bison-3.0.4-10.el8.x86_64.rpm 19 MB/s | 688 kB 00:00 2023-10-06T02:15:09.131 INFO:teuthology.orchestra.run.smithi175.stdout:(79/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.8 MB/s | 259 kB 00:00 2023-10-06T02:15:09.164 INFO:teuthology.orchestra.run.smithi175.stdout:(80/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 6.8 MB/s | 225 kB 00:00 2023-10-06T02:15:09.215 INFO:teuthology.orchestra.run.smithi175.stdout:(81/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.4 MB/s | 126 kB 00:00 2023-10-06T02:15:09.630 INFO:teuthology.orchestra.run.smithi175.stdout:(82/120): ceph-test-17.2.6-1296.g736ac5ba.el8.x 10 MB/s | 52 MB 00:05 2023-10-06T02:15:09.675 INFO:teuthology.orchestra.run.smithi175.stdout:(83/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 8.1 MB/s | 3.7 MB 00:00 2023-10-06T02:15:09.677 INFO:teuthology.orchestra.run.smithi175.stdout:(84/120): oniguruma-6.8.2-2.el8.x86_64.rpm 3.9 MB/s | 187 kB 00:00 2023-10-06T02:15:09.702 INFO:teuthology.orchestra.run.smithi175.stdout:(85/120): python3-jinja2-2.10.1-2.el8_0.noarch. 20 MB/s | 538 kB 00:00 2023-10-06T02:15:09.711 INFO:teuthology.orchestra.run.smithi175.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 8.7 MB/s | 302 kB 00:00 2023-10-06T02:15:09.732 INFO:teuthology.orchestra.run.smithi175.stdout:(87/120): python3-pyasn1-modules-0.3.7-6.el8.no 5.1 MB/s | 110 kB 00:00 2023-10-06T02:15:09.734 INFO:teuthology.orchestra.run.smithi175.stdout:(88/120): python3-mako-1.0.6-13.el8.noarch.rpm 4.7 MB/s | 157 kB 00:00 2023-10-06T02:15:09.761 INFO:teuthology.orchestra.run.smithi175.stdout:(89/120): python3-jsonpointer-1.10-11.el8.noarc 746 kB/s | 20 kB 00:00 2023-10-06T02:15:09.766 INFO:teuthology.orchestra.run.smithi175.stdout:(90/120): librdkafka-0.11.4-1.el8.x86_64.rpm 10 MB/s | 353 kB 00:00 2023-10-06T02:15:09.789 INFO:teuthology.orchestra.run.smithi006.stdout:(8/120): ceph-common-17.2.6-1296.g736ac5ba.el8. 5.4 MB/s | 23 MB 00:04 2023-10-06T02:15:09.792 INFO:teuthology.orchestra.run.smithi175.stdout:(91/120): libtool-2.4.6-25.el8.x86_64.rpm 22 MB/s | 709 kB 00:00 2023-10-06T02:15:09.801 INFO:teuthology.orchestra.run.smithi175.stdout:(92/120): python3-pytz-2017.2-9.el8.noarch.rpm 1.5 MB/s | 54 kB 00:00 2023-10-06T02:15:09.826 INFO:teuthology.orchestra.run.smithi006.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 672 kB/s | 24 kB 00:00 2023-10-06T02:15:09.898 INFO:teuthology.orchestra.run.smithi175.stdout:(93/120): openblas-threads-0.3.12-1.el8.x86_64. 45 MB/s | 4.7 MB 00:00 2023-10-06T02:15:09.911 INFO:teuthology.orchestra.run.smithi175.stdout:(94/120): openblas-0.3.12-1.el8.x86_64.rpm 42 MB/s | 4.6 MB 00:00 2023-10-06T02:15:09.924 INFO:teuthology.orchestra.run.smithi175.stdout:(95/120): automake-1.16.1-7.el8.noarch.rpm 27 MB/s | 713 kB 00:00 2023-10-06T02:15:09.934 INFO:teuthology.orchestra.run.smithi175.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 820 kB/s | 19 kB 00:00 2023-10-06T02:15:09.947 INFO:teuthology.orchestra.run.smithi175.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.9 MB/s | 43 kB 00:00 2023-10-06T02:15:09.957 INFO:teuthology.orchestra.run.smithi175.stdout:(98/120): python3-oauthlib-2.1.0-1.el8.noarch.r 6.5 MB/s | 155 kB 00:00 2023-10-06T02:15:09.971 INFO:teuthology.orchestra.run.smithi175.stdout:(99/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 8.9 MB/s | 220 kB 00:00 2023-10-06T02:15:09.991 INFO:teuthology.orchestra.run.smithi175.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 1.4 MB/s | 48 kB 00:00 2023-10-06T02:15:10.021 INFO:teuthology.orchestra.run.smithi175.stdout:(101/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-10-06T02:15:10.040 INFO:teuthology.orchestra.run.smithi175.stdout:(102/120): python3-requests-oauthlib-1.0.0-1.el 876 kB/s | 43 kB 00:00 2023-10-06T02:15:10.080 INFO:teuthology.orchestra.run.smithi175.stdout:(103/120): openssl-devel-1.1.1g-15.el8_3.x86_64 39 MB/s | 2.3 MB 00:00 2023-10-06T02:15:10.081 INFO:teuthology.orchestra.run.smithi175.stdout:(104/120): libverto-devel-0.3.0-5.el8.x86_64.rp 441 kB/s | 18 kB 00:00 2023-10-06T02:15:10.112 INFO:teuthology.orchestra.run.smithi175.stdout:(105/120): fuse-2.9.7-12.el8.x86_64.rpm 2.6 MB/s | 83 kB 00:00 2023-10-06T02:15:10.149 INFO:teuthology.orchestra.run.smithi175.stdout:(106/120): pcre2-devel-10.32-2.el8.x86_64.rpm 8.7 MB/s | 605 kB 00:00 2023-10-06T02:15:10.153 INFO:teuthology.orchestra.run.smithi175.stdout:(107/120): elfutils-libelf-devel-0.182-3.el8.x8 1.5 MB/s | 59 kB 00:00 2023-10-06T02:15:10.193 INFO:teuthology.orchestra.run.smithi175.stdout:(108/120): libquadmath-8.4.1-1.el8.x86_64.rpm 3.8 MB/s | 169 kB 00:00 2023-10-06T02:15:10.202 INFO:teuthology.orchestra.run.smithi175.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 762 kB/s | 38 kB 00:00 2023-10-06T02:15:10.223 INFO:teuthology.orchestra.run.smithi175.stdout:(110/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 2.7 MB/s | 58 kB 00:00 2023-10-06T02:15:10.242 INFO:teuthology.orchestra.run.smithi175.stdout:(111/120): libsepol-devel-2.9-2.el8.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2023-10-06T02:15:10.258 INFO:teuthology.orchestra.run.smithi175.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.3 MB/s | 47 kB 00:00 2023-10-06T02:15:10.285 INFO:teuthology.orchestra.run.smithi175.stdout:(113/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 13 MB/s | 559 kB 00:00 2023-10-06T02:15:10.293 INFO:teuthology.orchestra.run.smithi175.stdout:(114/120): libgfortran-8.4.1-1.el8.x86_64.rpm 18 MB/s | 639 kB 00:00 2023-10-06T02:15:10.318 INFO:teuthology.orchestra.run.smithi006.stdout:(10/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el 7.8 MB/s | 17 MB 00:02 2023-10-06T02:15:10.320 INFO:teuthology.orchestra.run.smithi175.stdout:(115/120): libselinux-devel-2.9-5.el8.x86_64.rp 7.0 MB/s | 200 kB 00:00 2023-10-06T02:15:10.322 INFO:teuthology.orchestra.run.smithi175.stdout:(116/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 1.8 MB/s | 70 kB 00:00 2023-10-06T02:15:10.341 INFO:teuthology.orchestra.run.smithi175.stdout:(117/120): libuuid-devel-2.32.1-27.el8.x86_64.r 4.6 MB/s | 97 kB 00:00 2023-10-06T02:15:10.376 INFO:teuthology.orchestra.run.smithi006.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 4.4 MB/s | 255 kB 00:00 2023-10-06T02:15:10.412 INFO:teuthology.orchestra.run.smithi006.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 691 kB/s | 25 kB 00:00 2023-10-06T02:15:10.540 INFO:teuthology.orchestra.run.smithi006.stdout:(13/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 6.1 MB/s | 797 kB 00:00 2023-10-06T02:15:10.614 INFO:teuthology.orchestra.run.smithi006.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 2.3 MB/s | 174 kB 00:00 2023-10-06T02:15:10.697 INFO:teuthology.orchestra.run.smithi006.stdout:(15/120): librados-devel-17.2.6-1296.g736ac5ba. 1.5 MB/s | 130 kB 00:00 2023-10-06T02:15:10.854 INFO:teuthology.orchestra.run.smithi175.stdout:(118/120): librados2-17.2.6-1296.g736ac5ba.el8. 6.5 MB/s | 3.5 MB 00:00 2023-10-06T02:15:10.854 INFO:teuthology.orchestra.run.smithi006.stdout:(16/120): libradosstriper1-17.2.6-1296.g736ac5b 3.2 MB/s | 507 kB 00:00 2023-10-06T02:15:10.865 INFO:teuthology.orchestra.run.smithi175.stdout:(119/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 6.8 MB/s | 3.6 MB 00:00 2023-10-06T02:15:11.414 INFO:teuthology.orchestra.run.smithi006.stdout:(17/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 9.9 MB/s | 5.6 MB 00:00 2023-10-06T02:15:11.458 INFO:teuthology.orchestra.run.smithi006.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 1.0 MB/s | 45 kB 00:00 2023-10-06T02:15:11.498 INFO:teuthology.orchestra.run.smithi006.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 2.9 MB/s | 115 kB 00:00 2023-10-06T02:15:11.536 INFO:teuthology.orchestra.run.smithi006.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 4.8 MB/s | 190 kB 00:00 2023-10-06T02:15:11.579 INFO:teuthology.orchestra.run.smithi006.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 8.3 MB/s | 371 kB 00:00 2023-10-06T02:15:11.703 INFO:teuthology.orchestra.run.smithi006.stdout:(22/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x8 4.2 MB/s | 17 MB 00:04 2023-10-06T02:15:11.706 INFO:teuthology.orchestra.run.smithi006.stdout:(23/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 2.8 MB/s | 358 kB 00:00 2023-10-06T02:15:11.740 INFO:teuthology.orchestra.run.smithi006.stdout:(24/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 2.8 MB/s | 107 kB 00:00 2023-10-06T02:15:11.743 INFO:teuthology.orchestra.run.smithi006.stdout:(25/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 2.4 MB/s | 90 kB 00:00 2023-10-06T02:15:11.785 INFO:teuthology.orchestra.run.smithi006.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 4.0 MB/s | 173 kB 00:00 2023-10-06T02:15:11.822 INFO:teuthology.orchestra.run.smithi006.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 638 kB/s | 23 kB 00:00 2023-10-06T02:15:11.859 INFO:teuthology.orchestra.run.smithi006.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 3.2 MB/s | 121 kB 00:00 2023-10-06T02:15:12.032 INFO:teuthology.orchestra.run.smithi006.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 9.8 MB/s | 1.7 MB 00:00 2023-10-06T02:15:12.397 INFO:teuthology.orchestra.run.smithi006.stdout:(30/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 5.3 MB/s | 3.5 MB 00:00 2023-10-06T02:15:12.475 INFO:teuthology.orchestra.run.smithi006.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 3.0 MB/s | 238 kB 00:00 2023-10-06T02:15:12.512 INFO:teuthology.orchestra.run.smithi006.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 1.3 MB/s | 47 kB 00:00 2023-10-06T02:15:12.548 INFO:teuthology.orchestra.run.smithi006.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 402 kB/s | 14 kB 00:00 2023-10-06T02:15:12.629 INFO:teuthology.orchestra.run.smithi006.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 3.2 MB/s | 267 kB 00:00 2023-10-06T02:15:12.667 INFO:teuthology.orchestra.run.smithi006.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 2.1 MB/s | 80 kB 00:00 2023-10-06T02:15:12.703 INFO:teuthology.orchestra.run.smithi006.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 500 kB/s | 18 kB 00:00 2023-10-06T02:15:12.726 INFO:teuthology.orchestra.run.smithi006.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 11 MB/s | 7.4 MB 00:00 2023-10-06T02:15:13.224 INFO:teuthology.orchestra.run.smithi006.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 118 kB/s | 59 kB 00:00 2023-10-06T02:15:13.386 INFO:teuthology.orchestra.run.smithi006.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 463 kB/s | 75 kB 00:00 2023-10-06T02:15:13.456 INFO:teuthology.orchestra.run.smithi006.stdout:(40/120): gperftools-libs-2.7-9.el8.x86_64.rpm 407 kB/s | 306 kB 00:00 2023-10-06T02:15:13.566 INFO:teuthology.orchestra.run.smithi006.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 398 kB/s | 44 kB 00:00 2023-10-06T02:15:13.705 INFO:teuthology.orchestra.run.smithi006.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2023-10-06T02:15:13.732 INFO:teuthology.orchestra.run.smithi006.stdout:(43/120): python3-asyncssh-2.7.0-2.el8.noarch.r 1.3 MB/s | 476 kB 00:00 2023-10-06T02:15:13.810 INFO:teuthology.orchestra.run.smithi006.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 316 kB/s | 33 kB 00:00 2023-10-06T02:15:13.832 INFO:teuthology.orchestra.run.smithi006.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 162 kB/s | 16 kB 00:00 2023-10-06T02:15:13.871 INFO:teuthology.orchestra.run.smithi175.stdout:(120/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x 1.7 MB/s | 17 MB 00:09 2023-10-06T02:15:13.875 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2023-10-06T02:15:13.876 INFO:teuthology.orchestra.run.smithi175.stdout:Total 18 MB/s | 201 MB 00:11 2023-10-06T02:15:13.925 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2023-10-06T02:15:13.946 INFO:teuthology.orchestra.run.smithi006.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2023-10-06T02:15:13.978 INFO:teuthology.orchestra.run.smithi006.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 2.6 MB/s | 384 kB 00:00 2023-10-06T02:15:14.038 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2023-10-06T02:15:14.039 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2023-10-06T02:15:14.061 INFO:teuthology.orchestra.run.smithi006.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 705 kB/s | 81 kB 00:00 2023-10-06T02:15:14.075 INFO:teuthology.orchestra.run.smithi006.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 115 kB/s | 11 kB 00:00 2023-10-06T02:15:14.165 INFO:teuthology.orchestra.run.smithi006.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 169 kB/s | 18 kB 00:00 2023-10-06T02:15:14.281 INFO:teuthology.orchestra.run.smithi006.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 423 kB/s | 49 kB 00:00 2023-10-06T02:15:14.342 INFO:teuthology.orchestra.run.smithi006.stdout:(52/120): python3-kubernetes-11.0.0-6.el8.noarc 4.4 MB/s | 1.2 MB 00:00 2023-10-06T02:15:14.405 INFO:teuthology.orchestra.run.smithi006.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 473 kB/s | 59 kB 00:00 2023-10-06T02:15:14.458 INFO:teuthology.orchestra.run.smithi006.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 521 kB/s | 60 kB 00:00 2023-10-06T02:15:14.592 INFO:teuthology.orchestra.run.smithi006.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 117 kB/s | 16 kB 00:00 2023-10-06T02:15:14.596 INFO:teuthology.orchestra.run.smithi006.stdout:(56/120): python3-pecan-1.3.2-9.el8.noarch.rpm 1.5 MB/s | 283 kB 00:00 2023-10-06T02:15:14.689 INFO:teuthology.orchestra.run.smithi006.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 347 kB/s | 34 kB 00:00 2023-10-06T02:15:14.737 INFO:teuthology.orchestra.run.smithi006.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2023-10-06T02:15:14.788 INFO:teuthology.orchestra.run.smithi006.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 653 kB/s | 64 kB 00:00 2023-10-06T02:15:15.223 INFO:teuthology.orchestra.run.smithi006.stdout:(60/120): ceph-test-17.2.6-1296.g736ac5ba.el8.x 9.6 MB/s | 52 MB 00:05 2023-10-06T02:15:15.224 INFO:teuthology.orchestra.run.smithi006.stdout:(61/120): python3-simplegeneric-0.8.1-17.el8.no 38 kB/s | 19 kB 00:00 2023-10-06T02:15:15.224 INFO:teuthology.orchestra.run.smithi006.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 55 kB/s | 24 kB 00:00 2023-10-06T02:15:15.327 INFO:teuthology.orchestra.run.smithi006.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 269 kB/s | 27 kB 00:00 2023-10-06T02:15:15.333 INFO:teuthology.orchestra.run.smithi006.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2023-10-06T02:15:15.431 INFO:teuthology.orchestra.run.smithi006.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 623 kB/s | 61 kB 00:00 2023-10-06T02:15:15.483 INFO:teuthology.orchestra.run.smithi006.stdout:(66/120): python3-webob-1.8.5-1.el8.1.noarch.rp 1.6 MB/s | 251 kB 00:00 2023-10-06T02:15:15.531 INFO:teuthology.orchestra.run.smithi006.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 860 kB/s | 85 kB 00:00 2023-10-06T02:15:15.585 INFO:teuthology.orchestra.run.smithi006.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 226 kB/s | 23 kB 00:00 2023-10-06T02:15:15.589 INFO:teuthology.orchestra.run.smithi006.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-10-06T02:15:15.629 INFO:teuthology.orchestra.run.smithi006.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 474 kB/s | 19 kB 00:00 2023-10-06T02:15:15.643 INFO:teuthology.orchestra.run.smithi006.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.0 MB/s | 43 kB 00:00 2023-10-06T02:15:15.645 INFO:teuthology.orchestra.run.smithi006.stdout:(72/120): python3-tempora-1.14.1-5.el8.noarch.r 69 kB/s | 29 kB 00:00 2023-10-06T02:15:15.669 INFO:teuthology.orchestra.run.smithi006.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 5.9 MB/s | 155 kB 00:00 2023-10-06T02:15:15.688 INFO:teuthology.orchestra.run.smithi006.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2023-10-06T02:15:15.689 INFO:teuthology.orchestra.run.smithi006.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 2.4 MB/s | 48 kB 00:00 2023-10-06T02:15:15.708 INFO:teuthology.orchestra.run.smithi006.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 2.2 MB/s | 43 kB 00:00 2023-10-06T02:15:15.715 INFO:teuthology.orchestra.run.smithi006.stdout:(77/120): thrift-0.13.0-2.el8.x86_64.rpm 9.4 MB/s | 1.7 MB 00:00 2023-10-06T02:15:15.717 INFO:teuthology.orchestra.run.smithi006.stdout:(78/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 7.6 MB/s | 229 kB 00:00 2023-10-06T02:15:15.724 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2023-10-06T02:15:15.728 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2023-10-06T02:15:15.758 INFO:teuthology.orchestra.run.smithi006.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 15 MB/s | 605 kB 00:00 2023-10-06T02:15:15.759 INFO:teuthology.orchestra.run.smithi006.stdout:(80/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 411 kB/s | 18 kB 00:00 2023-10-06T02:15:15.777 INFO:teuthology.orchestra.run.smithi006.stdout:(81/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 34 MB/s | 2.3 MB 00:00 2023-10-06T02:15:15.788 INFO:teuthology.orchestra.run.smithi006.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 2.0 MB/s | 59 kB 00:00 2023-10-06T02:15:15.802 INFO:teuthology.orchestra.run.smithi006.stdout:(83/120): fuse-2.9.7-12.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-10-06T02:15:15.815 INFO:teuthology.orchestra.run.smithi006.stdout:(84/120): libquadmath-8.4.1-1.el8.x86_64.rpm 4.4 MB/s | 169 kB 00:00 2023-10-06T02:15:15.827 INFO:teuthology.orchestra.run.smithi006.stdout:(85/120): libcom_err-devel-1.45.6-1.el8.x86_64. 981 kB/s | 38 kB 00:00 2023-10-06T02:15:15.846 INFO:teuthology.orchestra.run.smithi006.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 1.8 MB/s | 58 kB 00:00 2023-10-06T02:15:15.855 INFO:teuthology.orchestra.run.smithi006.stdout:(87/120): libsepol-devel-2.9-2.el8.x86_64.rpm 1.6 MB/s | 86 kB 00:00 2023-10-06T02:15:15.857 INFO:teuthology.orchestra.run.smithi006.stdout:(88/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.5 MB/s | 47 kB 00:00 2023-10-06T02:15:15.889 INFO:teuthology.orchestra.run.smithi006.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 18 MB/s | 639 kB 00:00 2023-10-06T02:15:15.894 INFO:teuthology.orchestra.run.smithi006.stdout:(90/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 12 MB/s | 559 kB 00:00 2023-10-06T02:15:15.905 INFO:teuthology.orchestra.run.smithi006.stdout:(91/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-06T02:15:15.924 INFO:teuthology.orchestra.run.smithi006.stdout:(92/120): libselinux-devel-2.9-5.el8.x86_64.rpm 5.8 MB/s | 200 kB 00:00 2023-10-06T02:15:15.937 INFO:teuthology.orchestra.run.smithi006.stdout:(93/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 2.2 MB/s | 97 kB 00:00 2023-10-06T02:15:15.957 INFO:teuthology.orchestra.run.smithi006.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.3 MB/s | 27 kB 00:00 2023-10-06T02:15:15.970 INFO:teuthology.orchestra.run.smithi006.stdout:(95/120): python3-prettytable-0.7.2-14.el8.noar 944 kB/s | 44 kB 00:00 2023-10-06T02:15:15.988 INFO:teuthology.orchestra.run.smithi006.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 5.1 MB/s | 161 kB 00:00 2023-10-06T02:15:16.013 INFO:teuthology.orchestra.run.smithi006.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 7.3 MB/s | 320 kB 00:00 2023-10-06T02:15:16.028 INFO:teuthology.orchestra.run.smithi006.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-10-06T02:15:16.057 INFO:teuthology.orchestra.run.smithi006.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 1.3 MB/s | 39 kB 00:00 2023-10-06T02:15:16.098 INFO:teuthology.orchestra.run.smithi006.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 17 MB/s | 688 kB 00:00 2023-10-06T02:15:16.125 INFO:teuthology.orchestra.run.smithi006.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 9.5 MB/s | 259 kB 00:00 2023-10-06T02:15:16.155 INFO:teuthology.orchestra.run.smithi006.stdout:(102/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 7.4 MB/s | 225 kB 00:00 2023-10-06T02:15:16.174 INFO:teuthology.orchestra.run.smithi006.stdout:(103/120): python3-babel-2.5.1-5.el8.noarch.rpm 30 MB/s | 4.8 MB 00:00 2023-10-06T02:15:16.178 INFO:teuthology.orchestra.run.smithi006.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 5.4 MB/s | 126 kB 00:00 2023-10-06T02:15:16.291 INFO:teuthology.orchestra.run.smithi006.stdout:(105/120): python3-scipy-1.0.0-20.module+el8.1. 38 MB/s | 15 MB 00:00 2023-10-06T02:15:16.294 INFO:teuthology.orchestra.run.smithi006.stdout:(106/120): oniguruma-6.8.2-2.el8.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2023-10-06T02:15:16.322 INFO:teuthology.orchestra.run.smithi006.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 17 MB/s | 538 kB 00:00 2023-10-06T02:15:16.328 INFO:teuthology.orchestra.run.smithi006.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 9.0 MB/s | 302 kB 00:00 2023-10-06T02:15:16.348 INFO:teuthology.orchestra.run.smithi006.stdout:(109/120): python3-numpy-1.14.3-9.el8.x86_64.rp 22 MB/s | 3.7 MB 00:00 2023-10-06T02:15:16.350 INFO:teuthology.orchestra.run.smithi006.stdout:(110/120): python3-mako-1.0.6-13.el8.noarch.rpm 5.5 MB/s | 157 kB 00:00 2023-10-06T02:15:16.360 INFO:teuthology.orchestra.run.smithi006.stdout:(111/120): python3-pyasn1-modules-0.3.7-6.el8.n 3.4 MB/s | 110 kB 00:00 2023-10-06T02:15:16.402 INFO:teuthology.orchestra.run.smithi006.stdout:(112/120): librdkafka-0.11.4-1.el8.x86_64.rpm 6.5 MB/s | 353 kB 00:00 2023-10-06T02:15:16.411 INFO:teuthology.orchestra.run.smithi006.stdout:(113/120): libtool-2.4.6-25.el8.x86_64.rpm 14 MB/s | 709 kB 00:00 2023-10-06T02:15:16.413 INFO:teuthology.orchestra.run.smithi006.stdout:(114/120): python3-jsonpointer-1.10-11.el8.noar 328 kB/s | 20 kB 00:00 2023-10-06T02:15:16.430 INFO:teuthology.orchestra.run.smithi006.stdout:(115/120): python3-pytz-2017.2-9.el8.noarch.rpm 1.9 MB/s | 54 kB 00:00 2023-10-06T02:15:16.481 INFO:teuthology.orchestra.run.smithi006.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2023-10-06T02:15:16.520 INFO:teuthology.orchestra.run.smithi006.stdout:(117/120): openblas-0.3.12-1.el8.x86_64.rpm 43 MB/s | 4.6 MB 00:00 2023-10-06T02:15:16.545 INFO:teuthology.orchestra.run.smithi006.stdout:(118/120): openblas-threads-0.3.12-1.el8.x86_64 35 MB/s | 4.7 MB 00:00 2023-10-06T02:15:17.000 INFO:teuthology.orchestra.run.smithi006.stdout:(119/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 7.5 MB/s | 3.6 MB 00:00 2023-10-06T02:15:17.174 INFO:teuthology.orchestra.run.smithi006.stdout:(120/120): librados2-17.2.6-1296.g736ac5ba.el8. 5.0 MB/s | 3.5 MB 00:00 2023-10-06T02:15:17.179 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2023-10-06T02:15:17.180 INFO:teuthology.orchestra.run.smithi006.stdout:Total 17 MB/s | 201 MB 00:12 2023-10-06T02:15:17.234 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2023-10-06T02:15:17.358 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2023-10-06T02:15:17.359 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2023-10-06T02:15:19.185 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2023-10-06T02:15:19.190 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2023-10-06T02:15:20.349 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2023-10-06T02:15:20.549 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T02:15:20.768 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-06T02:15:20.939 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T02:15:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T02:15:21.272 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T02:15:21.661 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T02:15:21.931 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T02:15:22.334 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T02:15:22.539 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:15:22.673 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:15:22.906 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T02:15:23.009 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T02:15:23.377 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T02:15:23.916 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2023-10-06T02:15:24.082 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T02:15:24.143 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T02:15:24.272 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:15:24.343 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T02:15:24.366 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:15:24.479 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T02:15:24.659 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T02:15:24.693 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T02:15:24.845 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T02:15:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:15:25.093 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T02:15:25.184 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:15:25.326 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:15:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T02:15:25.437 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T02:15:25.572 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-06T02:15:25.741 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:15:25.755 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T02:15:25.895 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T02:15:25.968 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T02:15:26.088 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T02:15:26.100 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T02:15:26.326 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:15:26.427 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:15:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T02:15:26.838 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T02:15:27.369 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T02:15:27.441 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T02:15:27.596 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T02:15:27.752 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T02:15:28.312 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T02:15:28.418 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T02:15:28.568 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:15:28.591 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-06T02:15:28.704 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:15:28.770 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-06T02:15:28.955 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T02:15:28.968 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-06T02:15:29.117 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T02:15:29.228 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-06T02:15:29.334 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:15:29.444 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:15:29.540 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-06T02:15:29.652 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T02:15:29.730 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T02:15:29.816 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T02:15:29.898 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T02:15:30.011 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T02:15:30.140 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T02:15:30.173 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T02:15:30.399 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T02:15:30.404 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T02:15:30.544 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T02:15:30.692 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T02:15:30.836 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T02:15:31.025 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T02:15:31.391 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-06T02:15:31.606 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T02:15:31.710 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-06T02:15:31.767 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T02:15:32.005 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-06T02:15:32.285 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-06T02:15:32.328 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T02:15:32.542 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T02:15:32.545 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-06T02:15:32.795 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T02:15:33.453 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T02:15:33.739 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T02:15:34.023 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T02:15:34.315 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T02:15:34.499 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T02:15:34.679 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T02:15:34.883 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T02:15:34.958 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T02:15:35.184 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T02:15:35.198 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-06T02:15:35.451 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T02:15:35.474 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T02:15:35.640 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T02:15:35.733 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T02:15:35.864 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T02:15:36.078 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T02:15:36.266 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T02:15:36.484 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-06T02:15:36.651 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-06T02:15:36.829 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-06T02:15:37.005 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-06T02:15:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-06T02:15:37.400 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-06T02:15:37.606 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-06T02:15:37.922 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-06T02:15:37.952 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T02:15:38.201 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-06T02:15:38.336 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T02:15:38.449 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-06T02:15:38.806 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-06T02:15:39.042 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-06T02:15:39.226 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-06T02:15:39.406 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T02:15:39.442 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-06T02:15:39.631 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-06T02:15:39.787 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T02:15:39.819 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T02:15:39.902 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T02:15:40.089 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T02:15:40.119 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-06T02:15:40.295 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-06T02:15:40.351 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T02:15:40.486 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T02:15:40.571 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T02:15:40.658 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T02:15:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T02:15:40.951 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T02:15:40.965 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T02:15:41.195 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T02:15:41.252 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T02:15:41.384 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T02:15:41.499 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T02:15:41.598 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T02:15:41.674 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T02:15:41.763 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T02:15:41.893 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T02:15:42.004 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T02:15:42.096 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T02:15:42.214 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T02:15:42.274 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T02:15:42.362 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T02:15:42.438 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T02:15:42.551 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T02:15:42.655 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T02:15:42.722 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T02:15:42.825 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T02:15:42.932 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T02:15:43.073 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T02:15:43.088 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T02:15:43.278 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T02:15:43.347 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T02:15:43.420 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T02:15:43.574 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T02:15:43.606 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T02:15:43.787 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T02:15:43.882 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T02:15:43.971 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T02:15:44.151 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T02:15:44.322 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T02:15:44.334 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T02:15:44.593 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T02:15:44.613 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T02:15:44.902 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T02:15:45.176 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T02:15:45.325 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T02:15:45.539 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T02:15:45.747 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T02:15:45.804 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T02:15:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T02:15:46.067 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T02:15:46.273 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T02:15:46.312 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T02:15:46.489 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T02:15:46.657 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T02:15:46.702 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T02:15:46.900 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T02:15:46.965 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T02:15:47.117 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T02:15:47.291 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T02:15:47.350 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T02:15:47.519 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T02:15:47.570 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T02:15:47.715 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T02:15:47.726 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T02:15:47.926 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T02:15:47.975 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T02:15:48.255 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T02:15:48.510 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T02:15:48.843 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T02:15:49.149 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T02:15:49.359 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T02:15:49.641 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T02:15:50.898 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T02:15:51.258 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T02:15:51.518 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T02:15:51.861 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T02:15:52.149 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T02:15:52.471 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T02:15:52.686 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T02:15:52.893 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T02:15:53.078 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:15:53.140 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T02:15:53.342 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:15:53.953 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:15:54.244 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T02:15:54.338 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T02:15:54.516 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T02:15:58.688 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:15:59.823 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:16:00.462 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:16:00.765 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T02:16:00.855 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T02:16:01.039 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T02:16:12.522 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T02:16:12.523 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2023-10-06T02:16:12.523 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2023-10-06T02:16:12.523 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /dev 2023-10-06T02:16:12.523 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /run 2023-10-06T02:16:12.523 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2023-10-06T02:16:12.523 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2023-10-06T02:16:12.523 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2023-10-06T02:16:12.523 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2023-10-06T02:16:12.523 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /dev 2023-10-06T02:16:12.523 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:12.880 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T02:16:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T02:16:14.540 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T02:16:14.763 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T02:16:14.905 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T02:16:15.311 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T02:16:15.487 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T02:16:15.505 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T02:16:18.317 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T02:16:18.509 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T02:16:18.677 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T02:16:18.887 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T02:16:19.124 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T02:16:19.341 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T02:16:19.546 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T02:16:19.546 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /sys 2023-10-06T02:16:19.547 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /proc 2023-10-06T02:16:19.547 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2023-10-06T02:16:19.547 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /run 2023-10-06T02:16:19.547 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /mnt 2023-10-06T02:16:19.547 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /var/tmp 2023-10-06T02:16:19.547 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /home 2023-10-06T02:16:19.547 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /tmp 2023-10-06T02:16:19.547 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2023-10-06T02:16:19.547 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:19.580 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T02:16:19.954 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T02:16:20.548 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T02:16:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T02:16:20.843 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T02:16:21.211 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T02:16:21.389 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T02:16:21.426 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T02:16:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T02:16:21.611 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T02:16:21.622 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T02:16:21.711 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T02:16:21.947 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T02:16:22.103 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T02:16:22.532 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T02:16:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T02:16:22.730 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T02:16:23.240 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T02:16:23.505 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T02:16:23.593 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T02:16:23.761 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T02:16:23.805 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T02:16:23.969 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T02:16:24.317 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T02:16:24.502 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T02:16:25.884 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T02:16:26.035 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T02:16:26.259 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T02:16:26.423 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T02:16:26.624 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T02:16:26.856 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T02:16:27.093 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T02:16:28.126 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T02:16:28.327 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T02:16:28.431 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T02:16:28.859 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T02:16:29.035 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T02:16:29.074 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T02:16:29.285 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T02:16:29.297 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T02:16:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T02:16:29.733 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T02:16:29.901 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T02:16:30.612 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T02:16:30.979 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T02:16:31.014 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-06T02:16:31.209 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 111/122 2023-10-06T02:16:31.252 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T02:16:31.346 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T02:16:31.380 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-06T02:16:31.519 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T02:16:31.564 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T02:16:31.572 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T02:16:31.702 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T02:16:31.714 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T02:16:31.901 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T02:16:32.058 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T02:16:32.072 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T02:16:32.227 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T02:16:32.268 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T02:16:32.433 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-06T02:16:32.659 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T02:16:32.717 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T02:16:32.926 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T02:16:32.935 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T02:16:32.935 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T02:16:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T02:16:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:16:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:16:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T02:16:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T02:16:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T02:16:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:16:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T02:16:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:16:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T02:16:34.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T02:16:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T02:16:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:16:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T02:16:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T02:16:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:16:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T02:16:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T02:16:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T02:16:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T02:16:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T02:16:34.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T02:16:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T02:16:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T02:16:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T02:16:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T02:16:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T02:16:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T02:16:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T02:16:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T02:16:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T02:16:34.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T02:16:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T02:16:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T02:16:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T02:16:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T02:16:34.079 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T02:16:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T02:16:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T02:16:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T02:16:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T02:16:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T02:16:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T02:16:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T02:16:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T02:16:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T02:16:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T02:16:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T02:16:34.080 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T02:16:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T02:16:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T02:16:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T02:16:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T02:16:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T02:16:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T02:16:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T02:16:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T02:16:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T02:16:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T02:16:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T02:16:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T02:16:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T02:16:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T02:16:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T02:16:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T02:16:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T02:16:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T02:16:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T02:16:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T02:16:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T02:16:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T02:16:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T02:16:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T02:16:34.082 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T02:16:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-06T02:16:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-06T02:16:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-06T02:16:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-06T02:16:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-06T02:16:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-06T02:16:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-06T02:16:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-06T02:16:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-06T02:16:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-06T02:16:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-06T02:16:34.083 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-06T02:16:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-06T02:16:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-06T02:16:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-06T02:16:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-06T02:16:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-06T02:16:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-06T02:16:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-06T02:16:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-06T02:16:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-06T02:16:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-06T02:16:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-06T02:16:34.084 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-06T02:16:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-06T02:16:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-06T02:16:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-06T02:16:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-06T02:16:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-06T02:16:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-06T02:16:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-06T02:16:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-06T02:16:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-06T02:16:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-06T02:16:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-06T02:16:34.085 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-06T02:16:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-06T02:16:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-06T02:16:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-06T02:16:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-06T02:16:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-06T02:16:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-06T02:16:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-06T02:16:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-06T02:16:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-06T02:16:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-06T02:16:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-06T02:16:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T02:16:34.086 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T02:16:34.087 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T02:16:36.383 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:16:36.383 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:43 ago on Fri 06 Oct 2023 02:14:53 AM UTC. 2023-10-06T02:16:37.506 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T02:16:38.408 INFO:teuthology.orchestra.run.smithi175.stdout:Installed products updated. 2023-10-06T02:16:38.539 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T02:16:38.566 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:38.567 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2023-10-06T02:16:38.567 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.567 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.567 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2023-10-06T02:16:38.567 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T02:16:38.567 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T02:16:38.567 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.567 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.567 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.568 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.568 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:38.568 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.568 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.568 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.568 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:38.568 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:38.568 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:38.568 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:38.568 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:38.568 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.569 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.569 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:38.569 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.569 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.569 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.569 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:38.569 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:38.569 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.569 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:38.569 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T02:16:38.569 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T02:16:38.569 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T02:16:38.570 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T02:16:38.570 INFO:teuthology.orchestra.run.smithi175.stdout: jq-1.5-12.el8.x86_64 2023-10-06T02:16:38.570 INFO:teuthology.orchestra.run.smithi175.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T02:16:38.570 INFO:teuthology.orchestra.run.smithi175.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T02:16:38.570 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T02:16:38.570 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.570 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.570 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.570 INFO:teuthology.orchestra.run.smithi175.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T02:16:38.570 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T02:16:38.570 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T02:16:38.571 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T02:16:38.571 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T02:16:38.571 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.571 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.571 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T02:16:38.571 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.571 INFO:teuthology.orchestra.run.smithi175.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T02:16:38.571 INFO:teuthology.orchestra.run.smithi175.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T02:16:38.571 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T02:16:38.571 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T02:16:38.571 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T02:16:38.572 INFO:teuthology.orchestra.run.smithi175.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T02:16:38.572 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T02:16:38.572 INFO:teuthology.orchestra.run.smithi175.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T02:16:38.572 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T02:16:38.572 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T02:16:38.572 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T02:16:38.572 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T02:16:38.572 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T02:16:38.572 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T02:16:38.572 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T02:16:38.572 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T02:16:38.572 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T02:16:38.573 INFO:teuthology.orchestra.run.smithi175.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T02:16:38.573 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T02:16:38.573 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.573 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.573 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.573 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T02:16:38.573 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T02:16:38.573 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T02:16:38.573 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T02:16:38.573 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T02:16:38.573 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T02:16:38.574 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T02:16:38.574 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T02:16:38.574 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T02:16:38.574 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T02:16:38.574 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T02:16:38.574 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T02:16:38.574 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T02:16:38.574 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T02:16:38.574 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T02:16:38.575 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T02:16:38.575 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T02:16:38.575 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T02:16:38.575 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T02:16:38.575 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T02:16:38.575 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T02:16:38.575 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T02:16:38.575 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T02:16:38.575 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T02:16:38.575 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T02:16:38.575 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.575 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.576 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T02:16:38.576 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T02:16:38.576 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.576 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T02:16:38.576 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T02:16:38.576 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T02:16:38.576 INFO:teuthology.orchestra.run.smithi175.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T02:16:38.576 INFO:teuthology.orchestra.run.smithi175.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T02:16:38.576 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T02:16:38.577 INFO:teuthology.orchestra.run.smithi175.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T02:16:38.577 INFO:teuthology.orchestra.run.smithi175.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T02:16:38.577 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T02:16:38.577 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T02:16:38.577 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T02:16:38.577 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T02:16:38.577 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T02:16:38.577 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.577 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.577 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:38.578 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T02:16:38.578 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T02:16:38.578 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T02:16:38.578 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T02:16:38.578 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T02:16:38.578 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:38.578 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2023-10-06T02:16:38.838 DEBUG:teuthology.parallel:result is None 2023-10-06T02:16:38.945 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T02:16:39.152 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 110/122 2023-10-06T02:16:39.397 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T02:16:39.534 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T02:16:39.547 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T02:16:39.722 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T02:16:39.864 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T02:16:40.052 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T02:16:40.243 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T02:16:40.520 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T02:16:40.734 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T02:16:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T02:16:40.950 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T02:16:40.961 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T02:16:41.095 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T02:16:41.095 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T02:16:41.327 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T02:16:41.327 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:16:42.234 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:16:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T02:16:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T02:16:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T02:16:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:16:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T02:16:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:16:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T02:16:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T02:16:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T02:16:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:16:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T02:16:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T02:16:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:16:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T02:16:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T02:16:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T02:16:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T02:16:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T02:16:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T02:16:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T02:16:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T02:16:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T02:16:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T02:16:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T02:16:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T02:16:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T02:16:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T02:16:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T02:16:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T02:16:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T02:16:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T02:16:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T02:16:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T02:16:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T02:16:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T02:16:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T02:16:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T02:16:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T02:16:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T02:16:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T02:16:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T02:16:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T02:16:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T02:16:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T02:16:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T02:16:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T02:16:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T02:16:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T02:16:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T02:16:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T02:16:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T02:16:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T02:16:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T02:16:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T02:16:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T02:16:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T02:16:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T02:16:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T02:16:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T02:16:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T02:16:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T02:16:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T02:16:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T02:16:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T02:16:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T02:16:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T02:16:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T02:16:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T02:16:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T02:16:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T02:16:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T02:16:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T02:16:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T02:16:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T02:16:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T02:16:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T02:16:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T02:16:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T02:16:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T02:16:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T02:16:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T02:16:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T02:16:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T02:16:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T02:16:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T02:16:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T02:16:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T02:16:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T02:16:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T02:16:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T02:16:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T02:16:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T02:16:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T02:16:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T02:16:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T02:16:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T02:16:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T02:16:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T02:16:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T02:16:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T02:16:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T02:16:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T02:16:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T02:16:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T02:16:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T02:16:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T02:16:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T02:16:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T02:16:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T02:16:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T02:16:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T02:16:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T02:16:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T02:16:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T02:16:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T02:16:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T02:16:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T02:16:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T02:16:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T02:16:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T02:16:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T02:16:44.501 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:16:44.501 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:49 ago on Fri 06 Oct 2023 02:14:55 AM UTC. 2023-10-06T02:16:46.741 INFO:teuthology.orchestra.run.smithi006.stdout:Installed products updated. 2023-10-06T02:16:46.899 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:46.899 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2023-10-06T02:16:46.900 INFO:teuthology.orchestra.run.smithi006.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.900 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.900 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2023-10-06T02:16:46.900 INFO:teuthology.orchestra.run.smithi006.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T02:16:46.900 INFO:teuthology.orchestra.run.smithi006.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T02:16:46.900 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.900 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.900 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.900 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.900 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:46.900 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.902 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.902 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.902 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:46.902 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:46.902 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.902 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:16:46.902 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T02:16:46.902 INFO:teuthology.orchestra.run.smithi006.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T02:16:46.902 INFO:teuthology.orchestra.run.smithi006.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T02:16:46.902 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T02:16:46.902 INFO:teuthology.orchestra.run.smithi006.stdout: jq-1.5-12.el8.x86_64 2023-10-06T02:16:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T02:16:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T02:16:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T02:16:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T02:16:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T02:16:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T02:16:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T02:16:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T02:16:46.904 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.904 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.904 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T02:16:46.904 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.904 INFO:teuthology.orchestra.run.smithi006.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T02:16:46.904 INFO:teuthology.orchestra.run.smithi006.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T02:16:46.904 INFO:teuthology.orchestra.run.smithi006.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T02:16:46.904 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T02:16:46.904 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T02:16:46.904 INFO:teuthology.orchestra.run.smithi006.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T02:16:46.904 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T02:16:46.904 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T02:16:46.905 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T02:16:46.905 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T02:16:46.905 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T02:16:46.905 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T02:16:46.905 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T02:16:46.905 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T02:16:46.905 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T02:16:46.905 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T02:16:46.905 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T02:16:46.905 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T02:16:46.905 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T02:16:46.905 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.906 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.906 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.906 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T02:16:46.906 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T02:16:46.906 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T02:16:46.906 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T02:16:46.906 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T02:16:46.906 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T02:16:46.906 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T02:16:46.906 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T02:16:46.906 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T02:16:46.907 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T02:16:46.907 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T02:16:46.907 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T02:16:46.907 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T02:16:46.907 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T02:16:46.907 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T02:16:46.907 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T02:16:46.907 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T02:16:46.907 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T02:16:46.907 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T02:16:46.907 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T02:16:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T02:16:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T02:16:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T02:16:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T02:16:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T02:16:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T02:16:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T02:16:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T02:16:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T02:16:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T02:16:46.909 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T02:16:46.909 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T02:16:46.909 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T02:16:46.909 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T02:16:46.909 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T02:16:46.909 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T02:16:46.909 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T02:16:46.909 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T02:16:46.909 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T02:16:46.909 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T02:16:46.909 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.909 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.910 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:16:46.910 INFO:teuthology.orchestra.run.smithi006.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T02:16:46.910 INFO:teuthology.orchestra.run.smithi006.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T02:16:46.910 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T02:16:46.910 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T02:16:46.911 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T02:16:46.911 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:46.911 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-10-06T02:16:47.187 DEBUG:teuthology.parallel:result is None 2023-10-06T02:16:47.188 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:16:47.328 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T02:16:47.350 INFO:teuthology.orchestra.run.smithi006.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T02:16:47.350 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T02:16:47.351 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T02:16:47.351 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:16:47.562 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T02:16:47.587 INFO:teuthology.orchestra.run.smithi175.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T02:16:47.588 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T02:16:47.588 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T02:16:47.588 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T02:16:47.588 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:16:47.588 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T02:16:47.628 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:16:47.628 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T02:16:47.670 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T02:16:47.671 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:16:47.671 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T02:16:47.695 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T02:16:47.761 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:16:47.761 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T02:16:47.788 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T02:16:47.854 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T02:16:47.854 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:16:47.854 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T02:16:47.879 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T02:16:47.944 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:16:47.944 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T02:16:47.970 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T02:16:48.035 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T02:16:48.035 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:16:48.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T02:16:48.060 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T02:16:48.126 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:16:48.126 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T02:16:48.150 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T02:16:48.216 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T02:16:48.285 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T02:16:48.285 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /var/log/ceph 2023-10-06T02:16:48.287 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /var/log/ceph 2023-10-06T02:16:48.311 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T02:16:48.311 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T02:16:48.352 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T02:16:48.376 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T02:16:48.376 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T02:16:48.417 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T02:16:48.447 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T02:16:48.447 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T02:16:48.447 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T02:16:48.448 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:16:48.448 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T02:16:48.496 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T02:16:48.608 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T02:16:48.634 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:16:48.634 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T02:16:48.649 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T02:16:48.760 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T02:16:48.789 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T02:16:48.790 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'Error loading MDS rank', 'missing journal object', 'Error recovering journal', 'error decoding table object', 'failed to read JournalPointer', 'Corrupt directory entry', 'Corrupt fnode header', 'corrupt sessionmap header', 'Corrupt dentry', 'Scrub error on inode', 'Metadata damage detected', 'MDS_READ_ONLY', 'force file system read-only', 'with standby daemon mds'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T02:16:48.790 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412131', 'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412131', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'Error loading MDS rank', 'missing journal object', 'Error recovering journal', 'error decoding table object', 'failed to read JournalPointer', 'Corrupt directory entry', 'Corrupt fnode header', 'corrupt sessionmap header', 'Corrupt dentry', 'Scrub error on inode', 'Metadata damage detected', 'MDS_READ_ONLY', 'force file system read-only', 'with standby daemon mds'], 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7519, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f', 'targets': {'smithi006.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCSFSdiZKcLmyGO0r296YGrht1THF1fBW73f3MsIa+MU/HIO1DrrFx2l/eDdgLmxb+srEPoasttona7m0Rn3HQM=', 'smithi175.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLYCW+Bineqy7fYATmxxFptUdHyHPy9Dx0sRKEZSHpKp64Um7RUy20PZtLf6QTL/lmWCndY+bmPXbO76XS726Wg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_damage']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:52:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T02:16:48.790 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T02:16:48.793 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T02:16:48.838 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T02:16:48.848 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T02:16:48.903 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:16:48.903 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T02:16:48.927 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T02:16:48.928 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2023-10-06T02:16:48.982 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T02:16:48.982 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:16:48.983 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 221281 Links: 1 2023-10-06T02:16:48.983 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:16:48.983 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:16:48.983 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-10-06 02:16:41.793684828 +0000 2023-10-06T02:16:48.983 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-10-06 02:14:10.699696198 +0000 2023-10-06T02:16:48.983 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-10-06 02:14:10.699696198 +0000 2023-10-06T02:16:48.983 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-10-06T02:16:48.983 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T02:16:49.046 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-10-06T02:16:49.046 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-10-06T02:16:49.047 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000245187 s, 2.1 MB/s 2023-10-06T02:16:49.048 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T02:16:49.104 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2023-10-06T02:16:49.159 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T02:16:49.159 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:16:49.159 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 221365 Links: 1 2023-10-06T02:16:49.159 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:16:49.159 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:16:49.159 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-10-06 02:16:41.793684828 +0000 2023-10-06T02:16:49.160 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-10-06 02:14:11.206691349 +0000 2023-10-06T02:16:49.160 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-10-06 02:14:11.206691349 +0000 2023-10-06T02:16:49.160 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-10-06T02:16:49.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T02:16:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-10-06T02:16:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-10-06T02:16:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000225995 s, 2.3 MB/s 2023-10-06T02:16:49.224 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T02:16:49.280 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2023-10-06T02:16:49.337 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T02:16:49.337 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:16:49.337 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 213957 Links: 1 2023-10-06T02:16:49.337 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:16:49.337 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:16:49.337 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-10-06 02:16:41.794684819 +0000 2023-10-06T02:16:49.337 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-10-06 02:14:11.708686546 +0000 2023-10-06T02:16:49.337 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-10-06 02:14:11.708686546 +0000 2023-10-06T02:16:49.337 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-10-06T02:16:49.338 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T02:16:49.400 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-10-06T02:16:49.400 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-10-06T02:16:49.400 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.00023475 s, 2.2 MB/s 2023-10-06T02:16:49.401 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T02:16:49.458 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2023-10-06T02:16:49.513 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T02:16:49.513 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:16:49.513 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 224268 Links: 1 2023-10-06T02:16:49.514 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:16:49.514 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:16:49.514 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-10-06 02:16:41.794684819 +0000 2023-10-06T02:16:49.514 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-10-06 02:14:12.209681754 +0000 2023-10-06T02:16:49.514 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-10-06 02:14:12.209681754 +0000 2023-10-06T02:16:49.514 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-10-06T02:16:49.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T02:16:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-10-06T02:16:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-10-06T02:16:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000191914 s, 2.7 MB/s 2023-10-06T02:16:49.579 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T02:16:49.635 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:16:49.635 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:16:49.635 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T02:16:49.650 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T02:16:49.650 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2023-10-06T02:16:49.706 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T02:16:49.706 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:16:49.706 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 222354 Links: 1 2023-10-06T02:16:49.706 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:16:49.707 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:16:49.707 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-10-06 02:16:33.637905478 +0000 2023-10-06T02:16:49.707 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-10-06 02:13:57.665338826 +0000 2023-10-06T02:16:49.707 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-10-06 02:13:57.665338826 +0000 2023-10-06T02:16:49.707 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2023-10-06T02:16:49.707 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T02:16:49.770 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-10-06T02:16:49.771 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-10-06T02:16:49.771 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000249707 s, 2.1 MB/s 2023-10-06T02:16:49.772 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T02:16:49.829 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2023-10-06T02:16:49.884 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T02:16:49.885 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:16:49.885 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 218644 Links: 1 2023-10-06T02:16:49.885 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:16:49.885 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:16:49.885 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-10-06 02:16:33.638905463 +0000 2023-10-06T02:16:49.885 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-10-06 02:13:58.158331294 +0000 2023-10-06T02:16:49.885 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-10-06 02:13:58.158331294 +0000 2023-10-06T02:16:49.886 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2023-10-06T02:16:49.886 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T02:16:49.949 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-10-06T02:16:49.949 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-10-06T02:16:49.949 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000226525 s, 2.3 MB/s 2023-10-06T02:16:49.950 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T02:16:50.006 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2023-10-06T02:16:50.061 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T02:16:50.061 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:16:50.061 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 223379 Links: 1 2023-10-06T02:16:50.062 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:16:50.062 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:16:50.062 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-10-06 02:16:33.638905463 +0000 2023-10-06T02:16:50.062 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-10-06 02:13:58.649323793 +0000 2023-10-06T02:16:50.062 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-10-06 02:13:58.649323793 +0000 2023-10-06T02:16:50.062 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2023-10-06T02:16:50.062 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T02:16:50.124 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-10-06T02:16:50.124 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-10-06T02:16:50.124 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000237966 s, 2.2 MB/s 2023-10-06T02:16:50.125 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T02:16:50.181 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2023-10-06T02:16:50.236 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T02:16:50.236 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:16:50.236 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 218854 Links: 1 2023-10-06T02:16:50.236 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:16:50.236 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:16:50.237 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-10-06 02:16:33.638905463 +0000 2023-10-06T02:16:50.237 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-10-06 02:13:59.199315391 +0000 2023-10-06T02:16:50.237 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-10-06 02:13:59.199315391 +0000 2023-10-06T02:16:50.237 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2023-10-06T02:16:50.237 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T02:16:50.299 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-10-06T02:16:50.299 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-10-06T02:16:50.299 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000230018 s, 2.2 MB/s 2023-10-06T02:16:50.300 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T02:16:50.355 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:16:50.355 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T02:16:50.355 INFO:tasks.ceph:Generating config... 2023-10-06T02:16:50.356 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T02:16:50.357 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T02:16:50.357 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T02:16:50.357 INFO:tasks.ceph:[client] pid file = 2023-10-06T02:16:50.357 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T02:16:50.357 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T02:16:50.357 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T02:16:50.357 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T02:16:50.357 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T02:16:50.357 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T02:16:50.357 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T02:16:50.357 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T02:16:50.358 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T02:16:50.358 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T02:16:50.358 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T02:16:50.358 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T02:16:50.358 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T02:16:50.358 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T02:16:50.358 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T02:16:50.358 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T02:16:50.358 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T02:16:50.359 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T02:16:50.359 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T02:16:50.359 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-06T02:16:50.359 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-06T02:16:50.359 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T02:16:50.359 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T02:16:50.359 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-06T02:16:50.359 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T02:16:50.359 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T02:16:50.359 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T02:16:50.359 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T02:16:50.359 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T02:16:50.360 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T02:16:50.360 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T02:16:50.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T02:16:50.422 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T02:16:50.425 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T02:16:50.467 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:16:50.533 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.6'), ('mon.b', '172.21.15.175'), ('mon.c', '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]')] 2023-10-06T02:16:50.533 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.6,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T02:16:50.534 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:16:50.534 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T02:16:50.588 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.6 --add b 172.21.15.175 --addv c '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:16:50.672 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:16:50.672 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: generated fsid c557bd13-0401-4965-a08f-5579f545617e 2023-10-06T02:16:50.672 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = octopus 2023-10-06T02:16:50.672 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 0 2023-10-06T02:16:50.673 INFO:teuthology.orchestra.run.smithi006.stdout:fsid c557bd13-0401-4965-a08f-5579f545617e 2023-10-06T02:16:50.673 INFO:teuthology.orchestra.run.smithi006.stdout:last_changed 2023-10-06T02:16:50.673058+0000 2023-10-06T02:16:50.673 INFO:teuthology.orchestra.run.smithi006.stdout:created 2023-10-06T02:16:50.673058+0000 2023-10-06T02:16:50.673 INFO:teuthology.orchestra.run.smithi006.stdout:min_mon_release 15 (octopus) 2023-10-06T02:16:50.673 INFO:teuthology.orchestra.run.smithi006.stdout:election_strategy: 1 2023-10-06T02:16:50.673 INFO:teuthology.orchestra.run.smithi006.stdout:0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2023-10-06T02:16:50.673 INFO:teuthology.orchestra.run.smithi006.stdout:1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.b 2023-10-06T02:16:50.673 INFO:teuthology.orchestra.run.smithi006.stdout:2: [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] mon.c 2023-10-06T02:16:50.673 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T02:16:50.674 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T02:16:50.689 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c557bd13-0401-4965-a08f-5579f545617e... 2023-10-06T02:16:50.690 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:16:50.731 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:16:50.773 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2023-10-06T02:16:50.773 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2023-10-06T02:16:50.773 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:16:50.774 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2023-10-06T02:16:50.774 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.774 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2023-10-06T02:16:50.774 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.774 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2023-10-06T02:16:50.774 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.774 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2023-10-06T02:16:50.774 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2023-10-06T02:16:50.774 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.774 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2023-10-06T02:16:50.775 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2023-10-06T02:16:50.775 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.775 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:16:50.775 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2023-10-06T02:16:50.775 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.775 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:16:50.775 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:16:50.775 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.775 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2023-10-06T02:16:50.775 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.775 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2023-10-06T02:16:50.775 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2023-10-06T02:16:50.776 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:16:50.776 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:16:50.776 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2023-10-06T02:16:50.776 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:16:50.776 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2023-10-06T02:16:50.776 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:16:50.776 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:16:50.776 INFO:teuthology.orchestra.run.smithi006.stdout: mon_allow_pool_size_one = true 2023-10-06T02:16:50.776 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.776 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:16:50.776 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.776 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2023-10-06T02:16:50.777 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.777 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2023-10-06T02:16:50.777 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.777 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2023-10-06T02:16:50.777 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2023-10-06T02:16:50.777 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2023-10-06T02:16:50.777 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.6,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2023-10-06T02:16:50.777 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = c557bd13-0401-4965-a08f-5579f545617e 2023-10-06T02:16:50.777 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.777 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2023-10-06T02:16:50.777 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2023-10-06T02:16:50.778 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.778 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2023-10-06T02:16:50.778 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2023-10-06T02:16:50.778 INFO:teuthology.orchestra.run.smithi006.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:16:50.778 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.778 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2023-10-06T02:16:50.778 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2023-10-06T02:16:50.778 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.778 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2023-10-06T02:16:50.778 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2023-10-06T02:16:50.778 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2023-10-06T02:16:50.779 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.779 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2023-10-06T02:16:50.779 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2023-10-06T02:16:50.779 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.779 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:16:50.779 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.779 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2023-10-06T02:16:50.779 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.779 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2023-10-06T02:16:50.779 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.779 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:16:50.779 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2023-10-06T02:16:50.780 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.780 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2023-10-06T02:16:50.780 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2023-10-06T02:16:50.780 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore block size = 96636764160 2023-10-06T02:16:50.780 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore fsck on mount = True 2023-10-06T02:16:50.780 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluefs = 20 2023-10-06T02:16:50.780 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluestore = 20 2023-10-06T02:16:50.780 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-10-06T02:16:50.780 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 20 2023-10-06T02:16:50.780 INFO:teuthology.orchestra.run.smithi006.stdout: debug rocksdb = 10 2023-10-06T02:16:50.780 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:16:50.781 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd full ratio = 0.9 2023-10-06T02:16:50.781 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:16:50.781 INFO:teuthology.orchestra.run.smithi006.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:16:50.781 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = bluestore 2023-10-06T02:16:50.781 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2023-10-06T02:16:50.781 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.781 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2023-10-06T02:16:50.781 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-10-06T02:16:50.781 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2023-10-06T02:16:50.781 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2023-10-06T02:16:50.781 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2023-10-06T02:16:50.782 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:16:50.782 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:16:50.782 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2023-10-06T02:16:50.782 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.782 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2023-10-06T02:16:50.782 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-10-06T02:16:50.782 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2023-10-06T02:16:50.782 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2023-10-06T02:16:50.782 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2023-10-06T02:16:50.782 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2023-10-06T02:16:50.782 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2023-10-06T02:16:50.782 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:16:50.783 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2023-10-06T02:16:50.783 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2023-10-06T02:16:50.783 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:16:50.783 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.783 INFO:teuthology.orchestra.run.smithi006.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:16:50.783 INFO:teuthology.orchestra.run.smithi006.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:16:50.783 INFO:teuthology.orchestra.run.smithi006.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:16:50.783 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.783 INFO:teuthology.orchestra.run.smithi006.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:16:50.783 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:16:50.784 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:16:50.784 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.784 INFO:teuthology.orchestra.run.smithi006.stdout: # 1m isn't quite enough 2023-10-06T02:16:50.784 INFO:teuthology.orchestra.run.smithi006.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:16:50.784 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.784 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:16:50.785 INFO:teuthology.orchestra.run.smithi006.stdout: mon op complaint time = 120 2023-10-06T02:16:50.785 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:16:50.785 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2023-10-06T02:16:50.785 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2023-10-06T02:16:50.786 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2023-10-06T02:16:50.786 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2023-10-06T02:16:50.786 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:16:50.786 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:16:50.786 INFO:teuthology.orchestra.run.smithi006.stdout: client mount timeout = 600 2023-10-06T02:16:50.786 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2023-10-06T02:16:50.787 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-10-06T02:16:50.787 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = "" 2023-10-06T02:16:50.787 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2023-10-06T02:16:50.787 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2023-10-06T02:16:50.787 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2023-10-06T02:16:50.787 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2023-10-06T02:16:50.787 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2023-10-06T02:16:50.787 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2023-10-06T02:16:50.787 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2023-10-06T02:16:50.787 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2023-10-06T02:16:50.787 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2023-10-06T02:16:50.788 INFO:teuthology.orchestra.run.smithi006.stdout:[mds] 2023-10-06T02:16:50.788 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds = 20 2023-10-06T02:16:50.788 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-10-06T02:16:50.788 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug frag = True 2023-10-06T02:16:50.788 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug scatterstat = True 2023-10-06T02:16:50.788 INFO:teuthology.orchestra.run.smithi006.stdout: mds op complaint time = 180 2023-10-06T02:16:50.788 INFO:teuthology.orchestra.run.smithi006.stdout: mds verify scatter = True 2023-10-06T02:16:50.788 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2023-10-06T02:16:50.788 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2023-10-06T02:16:50.788 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2023-10-06T02:16:50.790 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2023-10-06T02:16:50.790 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2023-10-06T02:16:50.790 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:16:50.790 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2023-10-06T02:16:50.790 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.790 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2023-10-06T02:16:50.790 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.791 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2023-10-06T02:16:50.791 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.791 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2023-10-06T02:16:50.791 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2023-10-06T02:16:50.791 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.791 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2023-10-06T02:16:50.791 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2023-10-06T02:16:50.791 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.791 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:16:50.791 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2023-10-06T02:16:50.791 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.791 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:16:50.791 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:16:50.792 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.792 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2023-10-06T02:16:50.792 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.792 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2023-10-06T02:16:50.792 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2023-10-06T02:16:50.792 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:16:50.792 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:16:50.792 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2023-10-06T02:16:50.792 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:16:50.793 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2023-10-06T02:16:50.793 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:16:50.793 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:16:50.793 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2023-10-06T02:16:50.793 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.793 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:16:50.793 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.793 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2023-10-06T02:16:50.793 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.793 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2023-10-06T02:16:50.793 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.793 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2023-10-06T02:16:50.794 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2023-10-06T02:16:50.794 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2023-10-06T02:16:50.794 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.6,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2023-10-06T02:16:50.794 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = c557bd13-0401-4965-a08f-5579f545617e 2023-10-06T02:16:50.794 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.794 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2023-10-06T02:16:50.794 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2023-10-06T02:16:50.794 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.794 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2023-10-06T02:16:50.794 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2023-10-06T02:16:50.794 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:16:50.795 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.795 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2023-10-06T02:16:50.795 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2023-10-06T02:16:50.795 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.795 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2023-10-06T02:16:50.795 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2023-10-06T02:16:50.795 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2023-10-06T02:16:50.795 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.795 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2023-10-06T02:16:50.795 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2023-10-06T02:16:50.795 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.796 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:16:50.796 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.796 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2023-10-06T02:16:50.796 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.796 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2023-10-06T02:16:50.796 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.796 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:16:50.796 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2023-10-06T02:16:50.796 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.796 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2023-10-06T02:16:50.796 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2023-10-06T02:16:50.797 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2023-10-06T02:16:50.797 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2023-10-06T02:16:50.797 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 20 2023-10-06T02:16:50.797 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 20 2023-10-06T02:16:50.797 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-10-06T02:16:50.797 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2023-10-06T02:16:50.797 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 10 2023-10-06T02:16:50.797 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:16:50.797 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2023-10-06T02:16:50.797 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:16:50.797 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:16:50.798 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2023-10-06T02:16:50.798 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2023-10-06T02:16:50.798 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.798 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2023-10-06T02:16:50.798 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-10-06T02:16:50.798 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2023-10-06T02:16:50.798 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2023-10-06T02:16:50.798 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2023-10-06T02:16:50.798 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:16:50.798 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:16:50.798 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2023-10-06T02:16:50.799 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.799 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2023-10-06T02:16:50.799 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-10-06T02:16:50.799 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2023-10-06T02:16:50.799 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2023-10-06T02:16:50.799 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2023-10-06T02:16:50.799 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2023-10-06T02:16:50.799 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2023-10-06T02:16:50.799 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:16:50.799 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2023-10-06T02:16:50.799 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2023-10-06T02:16:50.799 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:16:50.800 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.800 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:16:50.800 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:16:50.800 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:16:50.800 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.800 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:16:50.800 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:16:50.800 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:16:50.800 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.800 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2023-10-06T02:16:50.800 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:16:50.800 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.800 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:16:50.801 INFO:teuthology.orchestra.run.smithi175.stdout: mon op complaint time = 120 2023-10-06T02:16:50.801 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-06T02:16:50.801 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2023-10-06T02:16:50.801 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2023-10-06T02:16:50.801 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2023-10-06T02:16:50.801 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2023-10-06T02:16:50.801 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:16:50.801 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:16:50.801 INFO:teuthology.orchestra.run.smithi175.stdout: client mount timeout = 600 2023-10-06T02:16:50.801 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2023-10-06T02:16:50.801 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-10-06T02:16:50.801 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = "" 2023-10-06T02:16:50.802 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2023-10-06T02:16:50.802 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2023-10-06T02:16:50.802 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2023-10-06T02:16:50.802 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2023-10-06T02:16:50.802 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2023-10-06T02:16:50.802 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2023-10-06T02:16:50.802 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2023-10-06T02:16:50.802 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2023-10-06T02:16:50.803 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2023-10-06T02:16:50.803 INFO:teuthology.orchestra.run.smithi175.stdout:[mds] 2023-10-06T02:16:50.803 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds = 20 2023-10-06T02:16:50.803 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-10-06T02:16:50.803 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug frag = True 2023-10-06T02:16:50.805 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug scatterstat = True 2023-10-06T02:16:50.805 INFO:teuthology.orchestra.run.smithi175.stdout: mds op complaint time = 180 2023-10-06T02:16:50.805 INFO:teuthology.orchestra.run.smithi175.stdout: mds verify scatter = True 2023-10-06T02:16:50.805 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2023-10-06T02:16:50.805 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2023-10-06T02:16:50.806 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2023-10-06T02:16:50.806 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T02:16:50.806 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T02:16:50.882 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T02:16:50.882 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:16:50.882 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T02:16:50.897 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:16:50.897 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T02:16:50.952 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:16:50.952 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:16:50.952 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T02:16:50.952 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:16:51.027 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:16:51.027 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:16:51.082 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:16:51.082 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:16:51.082 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T02:16:51.082 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:16:51.116 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:16:51.116 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:16:51.172 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T02:16:51.172 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T02:16:51.173 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T02:16:51.222 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T02:16:51.225 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T02:16:51.303 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T02:16:51.306 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T02:16:51.306 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T02:16:51.356 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T02:16:51.358 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T02:16:51.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T02:16:51.473 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T02:16:51.475 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T02:16:51.500 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T02:16:51.549 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T02:16:51.551 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T02:16:51.576 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T02:16:51.663 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T02:16:51.666 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T02:16:51.689 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T02:16:51.690 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T02:16:51.729 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T02:16:51.742 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T02:16:51.821 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T02:16:51.834 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T02:16:51.872 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T02:16:51.884 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T02:16:51.962 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T02:16:51.974 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T02:16:51.974 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T02:16:51.974 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T02:16:51.999 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:16:51.999 INFO:tasks.ceph:role: osd.0 2023-10-06T02:16:51.999 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:16:51.999 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T02:16:52.072 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:16:52.072 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:16:52.072 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:16:52.072 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 2023-10-06T02:16:52.072 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:16:52.072 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:16:52.072 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:16:52.072 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:16:52.072 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:16:52.073 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:16:52.495 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-10-06T02:16:52.497 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-10-06T02:16:52.497 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T02:16:52.674 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T02:16:52.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T02:16:52.778 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:16:52.778 INFO:tasks.ceph:role: osd.1 2023-10-06T02:16:52.778 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:16:52.778 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T02:16:52.851 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:16:52.852 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:16:52.852 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:16:52.852 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 2023-10-06T02:16:52.852 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:16:52.852 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:16:52.852 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:16:52.852 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:16:52.852 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:16:52.852 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:16:53.272 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-10-06T02:16:53.274 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-10-06T02:16:53.274 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T02:16:53.386 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T02:16:53.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T02:16:53.483 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:16:53.483 INFO:tasks.ceph:role: osd.2 2023-10-06T02:16:53.483 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:16:53.484 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T02:16:53.557 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:16:53.557 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:16:53.557 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:16:53.557 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 2023-10-06T02:16:53.557 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:16:53.557 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:16:53.557 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:16:53.557 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:16:53.557 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:16:53.557 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:16:53.999 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-10-06T02:16:54.001 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-10-06T02:16:54.001 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T02:16:54.173 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T02:16:54.206 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T02:16:54.273 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:16:54.273 INFO:tasks.ceph:role: osd.3 2023-10-06T02:16:54.273 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:16:54.273 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T02:16:54.347 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:16:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:16:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:16:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 2023-10-06T02:16:54.347 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:16:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:16:54.348 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:16:54.348 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:16:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:16:54.348 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:16:54.785 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-10-06T02:16:54.788 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-10-06T02:16:54.788 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T02:16:54.961 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T02:16:54.996 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:16:55.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:16:55.293+0000 7fa5e608c540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T02:16:55.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:16:55.293+0000 7fa5e608c540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T02:16:55.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:16:55.293+0000 7fa5e608c540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T02:16:55.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:16:55.293+0000 7fa5e608c540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T02:16:55.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:16:55.293+0000 7fa5e608c540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T02:16:55.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:16:55.294+0000 7fa5e608c540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T02:16:55.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:16:55.820+0000 7fa5e608c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:16:56.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:16:56.583+0000 7fa5e608c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:16:57.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:16:57.345+0000 7fa5e608c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:16:58.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T02:16:58.175 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:16:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:16:58.264+0000 7fe6b803e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T02:16:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:16:58.264+0000 7fe6b803e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T02:16:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:16:58.264+0000 7fe6b803e540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T02:16:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:16:58.264+0000 7fe6b803e540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T02:16:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:16:58.264+0000 7fe6b803e540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T02:16:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:16:58.265+0000 7fe6b803e540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T02:16:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:16:58.793+0000 7fe6b803e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:16:59.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:16:59.555+0000 7fe6b803e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:00.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:00.319+0000 7fe6b803e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:01.114 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T02:17:01.144 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:17:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:01.340+0000 7fcb05cac540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T02:17:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:01.341+0000 7fcb05cac540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T02:17:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:01.341+0000 7fcb05cac540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T02:17:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:01.341+0000 7fcb05cac540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T02:17:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:01.341+0000 7fcb05cac540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T02:17:01.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:01.341+0000 7fcb05cac540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T02:17:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:01.882+0000 7fcb05cac540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:02.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:02.646+0000 7fcb05cac540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:03.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:03.412+0000 7fcb05cac540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:04.208 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T02:17:04.239 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:17:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:04.325+0000 7f30135cd540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T02:17:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:04.326+0000 7f30135cd540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T02:17:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:04.326+0000 7f30135cd540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T02:17:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:04.326+0000 7f30135cd540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T02:17:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:04.326+0000 7f30135cd540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T02:17:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:04.326+0000 7f30135cd540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T02:17:04.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:04.854+0000 7f30135cd540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:05.616+0000 7f30135cd540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:06.379+0000 7f30135cd540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:07.172 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T02:17:07.203 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T02:17:07.235 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:17:07.236 INFO:tasks.ceph:role: osd.4 2023-10-06T02:17:07.236 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:17:07.236 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T02:17:07.310 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:17:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:17:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:17:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 2023-10-06T02:17:07.311 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:17:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:17:07.311 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:17:07.311 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:17:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:17:07.312 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:17:07.740 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-10-06T02:17:07.742 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-10-06T02:17:07.743 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T02:17:07.896 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T02:17:07.930 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T02:17:07.998 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:17:07.998 INFO:tasks.ceph:role: osd.5 2023-10-06T02:17:07.998 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:17:07.998 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T02:17:08.071 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:17:08.071 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:17:08.071 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:17:08.072 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 2023-10-06T02:17:08.072 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:17:08.072 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:17:08.072 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:17:08.072 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:17:08.072 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:17:08.072 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:17:08.489 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-10-06T02:17:08.491 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-10-06T02:17:08.491 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T02:17:08.605 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T02:17:08.634 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T02:17:08.699 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:17:08.699 INFO:tasks.ceph:role: osd.6 2023-10-06T02:17:08.699 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:17:08.699 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T02:17:08.770 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:17:08.771 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:17:08.771 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:17:08.771 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 2023-10-06T02:17:08.771 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:17:08.771 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:17:08.771 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:17:08.771 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:17:08.771 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:17:08.771 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:17:09.218 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-10-06T02:17:09.219 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-10-06T02:17:09.220 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T02:17:09.389 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T02:17:09.418 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T02:17:09.483 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:17:09.483 INFO:tasks.ceph:role: osd.7 2023-10-06T02:17:09.483 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:17:09.483 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T02:17:09.555 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:17:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:17:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:17:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 2023-10-06T02:17:09.556 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:17:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:17:09.556 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:17:09.556 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:17:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:17:09.556 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:17:09.996 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-10-06T02:17:09.997 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-10-06T02:17:09.998 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T02:17:10.176 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T02:17:10.208 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:17:10.300 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:10.300+0000 7fc96deff540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T02:17:10.301 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:10.300+0000 7fc96deff540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T02:17:10.301 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:10.300+0000 7fc96deff540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T02:17:10.301 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:10.300+0000 7fc96deff540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T02:17:10.301 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:10.300+0000 7fc96deff540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T02:17:10.301 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:10.301+0000 7fc96deff540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T02:17:10.829 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:10.829+0000 7fc96deff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:11.594 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:11.594+0000 7fc96deff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:12.357 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:12.357+0000 7fc96deff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:13.151 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T02:17:13.177 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:17:13.259 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:13.258+0000 7f186df93540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T02:17:13.259 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:13.258+0000 7f186df93540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T02:17:13.260 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:13.258+0000 7f186df93540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T02:17:13.260 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:13.258+0000 7f186df93540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T02:17:13.260 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:13.258+0000 7f186df93540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T02:17:13.260 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:13.258+0000 7f186df93540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T02:17:13.783 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:13.782+0000 7f186df93540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:14.549 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:14.549+0000 7f186df93540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:15.312 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:15.312+0000 7f186df93540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:16.104 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T02:17:16.170 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:17:16.257 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:16.256+0000 7f6ac84b2540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T02:17:16.257 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:16.256+0000 7f6ac84b2540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T02:17:16.257 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:16.256+0000 7f6ac84b2540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T02:17:16.257 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:16.256+0000 7f6ac84b2540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T02:17:16.257 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:16.256+0000 7f6ac84b2540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T02:17:16.258 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:16.257+0000 7f6ac84b2540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T02:17:16.780 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:16.780+0000 7f6ac84b2540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:17.545 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:17.545+0000 7f6ac84b2540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:18.308 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:18.307+0000 7f6ac84b2540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:18.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:17:18.795 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:17:19.102 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T02:17:19.127 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:17:19.208 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:19.207+0000 7f2da2916540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T02:17:19.208 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:19.207+0000 7f2da2916540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T02:17:19.208 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:19.207+0000 7f2da2916540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T02:17:19.208 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:19.207+0000 7f2da2916540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T02:17:19.208 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:19.207+0000 7f2da2916540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T02:17:19.209 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:19.208+0000 7f2da2916540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T02:17:19.730 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:19.730+0000 7f2da2916540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:20.493 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:20.493+0000 7f2da2916540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:21.256 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:21.255+0000 7f2da2916540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:17:22.046 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T02:17:22.111 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T02:17:22.111 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:17:22.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T02:17:22.140 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:17:22.140 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T02:17:22.207 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:17:22.207 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T02:17:22.274 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:17:22.274 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T02:17:22.341 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:17:22.341 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T02:17:22.407 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:17:22.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T02:17:22.473 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:17:22.474 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T02:17:22.540 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:17:22.540 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T02:17:22.565 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:17:22.565 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T02:17:22.630 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:17:22.630 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T02:17:22.695 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:17:22.695 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T02:17:22.759 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:17:22.760 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T02:17:22.823 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:17:22.823 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T02:17:22.887 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:17:22.887 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T02:17:22.951 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:17:22.951 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T02:17:22.967 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:17:22.967 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T02:17:23.024 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:17:23.024 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T02:17:23.038 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:17:23.039 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T02:17:23.092 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T02:17:23.093 DEBUG:teuthology.orchestra.run.smithi006:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T02:17:23.095 DEBUG:teuthology.orchestra.run.smithi175:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T02:17:23.135 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.y] 2023-10-06T02:17:23.135 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQATbh9lxXZSDRAALw3s8FP+gOrz+VIDN7tkuw== 2023-10-06T02:17:23.135 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2023-10-06T02:17:23.135 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQATbh9l3UdFFRAAahVHXJW+fzPcTwa/MxOW7A== 2023-10-06T02:17:23.135 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2023-10-06T02:17:23.135 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQATbh9ls7FDHBAA746JdAc0gr6+qLK9tuWCZg== 2023-10-06T02:17:23.135 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.0] 2023-10-06T02:17:23.136 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAXbh9lLVWHERAAoYIaMicUCppJKlSwl1K8UQ== 2023-10-06T02:17:23.136 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.1] 2023-10-06T02:17:23.136 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAabh9lgpbHDxAAXOwtusarMKccKIu9+SmmHg== 2023-10-06T02:17:23.136 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.2] 2023-10-06T02:17:23.136 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAdbh9lG/ZcFBAA3WpHCcm2R2+IyFMK460CYw== 2023-10-06T02:17:23.136 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.3] 2023-10-06T02:17:23.136 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAgbh9lz8J4ExAAggyFHpD2wvM/b+WKLvVneA== 2023-10-06T02:17:23.136 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.x] 2023-10-06T02:17:23.136 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQATbh9lMk4mEhAAbIAiSwyo+ygZRqxKBKRxuQ== 2023-10-06T02:17:23.136 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2023-10-06T02:17:23.136 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQATbh9lcq7HIBAA/3Gaa7gNbUHq176zcCFgjA== 2023-10-06T02:17:23.136 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2023-10-06T02:17:23.137 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQATbh9llEyZJxAAKXcHXIywnLQVZlbOGKdTTg== 2023-10-06T02:17:23.137 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.4] 2023-10-06T02:17:23.137 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAmbh9lpSX1ERAA1vkI0SvrJb6mAciDTIGZtA== 2023-10-06T02:17:23.137 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.5] 2023-10-06T02:17:23.137 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQApbh9ljSxwDxAACjsHigTRkZIY+lHrr9/17g== 2023-10-06T02:17:23.137 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.6] 2023-10-06T02:17:23.137 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAsbh9l6vlZDxAAfff29OvnP+8zxQFDDt8SFA== 2023-10-06T02:17:23.137 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.7] 2023-10-06T02:17:23.137 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAvbh9lz+1sDBAANCvbv4nJUuaVde42koP8fA== 2023-10-06T02:17:23.137 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-10-06T02:17:23.137 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQATbh9lO6GJKxAASfNnkG3FXno1BWm5XiqIMA== 2023-10-06T02:17:23.137 INFO:teuthology.orchestra.run.smithi006.stdout:[client.2] 2023-10-06T02:17:23.137 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQATbh9l1hsHMRAANI0CeqE+ZB7uQ9ZB4cF/Ig== 2023-10-06T02:17:23.138 INFO:teuthology.orchestra.run.smithi006.stdout:[client.1] 2023-10-06T02:17:23.138 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQATbh9lpRgFNBAAYE7yue5MPAzdm5k3EOcvcg== 2023-10-06T02:17:23.138 INFO:teuthology.orchestra.run.smithi006.stdout:[client.3] 2023-10-06T02:17:23.138 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQATbh9lAV9fORAAXCO4NdIb62PH2IX0y1siCw== 2023-10-06T02:17:23.154 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.y] 2023-10-06T02:17:23.154 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQATbh9lxXZSDRAALw3s8FP+gOrz+VIDN7tkuw== 2023-10-06T02:17:23.155 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2023-10-06T02:17:23.155 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQATbh9l3UdFFRAAahVHXJW+fzPcTwa/MxOW7A== 2023-10-06T02:17:23.155 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2023-10-06T02:17:23.155 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQATbh9ls7FDHBAA746JdAc0gr6+qLK9tuWCZg== 2023-10-06T02:17:23.155 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.0] 2023-10-06T02:17:23.155 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQAXbh9lLVWHERAAoYIaMicUCppJKlSwl1K8UQ== 2023-10-06T02:17:23.155 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.1] 2023-10-06T02:17:23.155 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQAabh9lgpbHDxAAXOwtusarMKccKIu9+SmmHg== 2023-10-06T02:17:23.155 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.2] 2023-10-06T02:17:23.155 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQAdbh9lG/ZcFBAA3WpHCcm2R2+IyFMK460CYw== 2023-10-06T02:17:23.155 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.3] 2023-10-06T02:17:23.155 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQAgbh9lz8J4ExAAggyFHpD2wvM/b+WKLvVneA== 2023-10-06T02:17:23.156 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.x] 2023-10-06T02:17:23.156 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQATbh9lMk4mEhAAbIAiSwyo+ygZRqxKBKRxuQ== 2023-10-06T02:17:23.156 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2023-10-06T02:17:23.156 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQATbh9lcq7HIBAA/3Gaa7gNbUHq176zcCFgjA== 2023-10-06T02:17:23.156 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2023-10-06T02:17:23.156 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQATbh9llEyZJxAAKXcHXIywnLQVZlbOGKdTTg== 2023-10-06T02:17:23.156 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.4] 2023-10-06T02:17:23.156 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQAmbh9lpSX1ERAA1vkI0SvrJb6mAciDTIGZtA== 2023-10-06T02:17:23.156 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.5] 2023-10-06T02:17:23.156 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQApbh9ljSxwDxAACjsHigTRkZIY+lHrr9/17g== 2023-10-06T02:17:23.156 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.6] 2023-10-06T02:17:23.156 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQAsbh9l6vlZDxAAfff29OvnP+8zxQFDDt8SFA== 2023-10-06T02:17:23.157 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.7] 2023-10-06T02:17:23.157 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQAvbh9lz+1sDBAANCvbv4nJUuaVde42koP8fA== 2023-10-06T02:17:23.157 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2023-10-06T02:17:23.157 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQATbh9lO6GJKxAASfNnkG3FXno1BWm5XiqIMA== 2023-10-06T02:17:23.157 INFO:teuthology.orchestra.run.smithi175.stdout:[client.2] 2023-10-06T02:17:23.157 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQATbh9l1hsHMRAANI0CeqE+ZB7uQ9ZB4cF/Ig== 2023-10-06T02:17:23.157 INFO:teuthology.orchestra.run.smithi175.stdout:[client.1] 2023-10-06T02:17:23.157 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQATbh9lpRgFNBAAYE7yue5MPAzdm5k3EOcvcg== 2023-10-06T02:17:23.157 INFO:teuthology.orchestra.run.smithi175.stdout:[client.3] 2023-10-06T02:17:23.157 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQATbh9lAV9fORAAXCO4NdIb62PH2IX0y1siCw== 2023-10-06T02:17:23.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:17:23.181 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:17:23.245 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:17:23.247 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:17:23.297 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:17:23.299 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:17:23.349 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:17:23.351 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:17:23.398 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:17:23.400 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:17:23.447 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:17:23.450 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:17:23.497 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:17:23.499 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:17:23.546 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:17:23.548 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:17:23.595 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:17:23.597 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:17:23.647 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:17:23.650 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:17:23.700 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:17:23.702 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:17:23.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:17:23.751 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:17:23.799 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:17:23.801 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:17:23.848 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:17:23.850 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:17:23.898 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:17:23.900 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:17:23.950 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:17:23.952 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:17:24.002 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:17:24.006 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:17:24.056 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:17:24.058 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:17:24.108 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T02:17:24.108 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T02:17:24.133 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T02:17:24.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T02:17:24.252 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T02:17:24.276 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T02:17:24.367 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T02:17:24.391 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T02:17:24.455 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T02:17:24.547 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T02:17:24.571 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:17:24.573 DEBUG:teuthology.orchestra.run.smithi175:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:17:24.625 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T02:17:24.626 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T02:17:24.626 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T02:17:24.628 INFO:tasks.ceph.mon.a:Started 2023-10-06T02:17:24.628 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T02:17:24.628 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T02:17:24.667 INFO:tasks.ceph.mon.b:Started 2023-10-06T02:17:24.668 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T02:17:24.668 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T02:17:24.670 INFO:tasks.ceph.mon.c:Started 2023-10-06T02:17:24.670 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T02:17:24.670 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T02:17:24.670 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T02:17:24.672 INFO:tasks.ceph.mgr.y:Started 2023-10-06T02:17:24.672 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T02:17:24.672 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T02:17:24.674 INFO:tasks.ceph.mgr.x:Started 2023-10-06T02:17:24.675 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T02:17:24.675 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T02:17:24.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.794+0000 7fba2ff30700 1 Processor -- start 2023-10-06T02:17:24.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.794+0000 7fba2ff30700 1 -- start start 2023-10-06T02:17:24.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.795+0000 7fba2ff30700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba280d0400 0x7fba280b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:24.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.795+0000 7fba2ff30700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba280d07d0 0x7fba280b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:24.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.795+0000 7fba2ff30700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba280b6170 con 0x7fba280ccd40 2023-10-06T02:17:24.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.795+0000 7fba2ff30700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2815dd40 con 0x7fba280d07d0 2023-10-06T02:17:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.795+0000 7fba2ff30700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2815e020 con 0x7fba280d0400 2023-10-06T02:17:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.795+0000 7fba2e4cd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba280d07d0 0x7fba280b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.795+0000 7fba2e4cd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba280d07d0 0x7fba280b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34922/0 (socket says 172.21.15.6:34922) 2023-10-06T02:17:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.795+0000 7fba2e4cd700 1 -- 172.21.15.6:0/1030874475 learned_addr learned my addr 172.21.15.6:0/1030874475 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.796+0000 7fba2dccc700 1 --2- 172.21.15.6:0/1030874475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba280d0400 0x7fba280b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.796+0000 7fba2e4cd700 1 -- 172.21.15.6:0/1030874475 >> v2:172.21.15.6:3300/0 conn(0x7fba280d07d0 msgr2=0x7fba280b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T02:17:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.796+0000 7fba2e4cd700 1 -- 172.21.15.6:0/1030874475 >> v2:172.21.15.6:3300/0 conn(0x7fba280d07d0 msgr2=0x7fba280b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:17:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.796+0000 7fba2e4cd700 1 --2- 172.21.15.6:0/1030874475 >> v2:172.21.15.6:3300/0 conn(0x7fba280d07d0 0x7fba280b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:17:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.796+0000 7fba2e4cd700 1 --2- 172.21.15.6:0/1030874475 >> v2:172.21.15.6:3300/0 conn(0x7fba280d07d0 0x7fba280b3aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T02:17:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.796+0000 7fba2dccc700 1 -- 172.21.15.6:0/1030874475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba280d0400 msgr2=0x7fba280b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T02:17:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.796+0000 7fba2dccc700 1 -- 172.21.15.6:0/1030874475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba280d0400 msgr2=0x7fba280b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:17:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.796+0000 7fba2dccc700 1 --2- 172.21.15.6:0/1030874475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba280d0400 0x7fba280b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:17:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.796+0000 7fba2dccc700 1 --2- 172.21.15.6:0/1030874475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba280d0400 0x7fba280b5c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T02:17:24.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2ccca700 1 -- 172.21.15.6:0/1030874475 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289086973 0 0) 0x7fba280b6170 con 0x7fba280ccd40 2023-10-06T02:17:24.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2ccca700 1 -- 172.21.15.6:0/1030874475 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba10003570 con 0x7fba280ccd40 2023-10-06T02:17:24.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2ccca700 1 -- 172.21.15.6:0/1030874475 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1635041562 0 0) 0x7fba10003570 con 0x7fba280ccd40 2023-10-06T02:17:24.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2ccca700 1 -- 172.21.15.6:0/1030874475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba280d0400 msgr2=0x7fba280b5c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:17:24.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2ccca700 1 --2- 172.21.15.6:0/1030874475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba280d0400 0x7fba280b5c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:24.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2ccca700 1 -- 172.21.15.6:0/1030874475 >> v2:172.21.15.6:3300/0 conn(0x7fba280d07d0 msgr2=0x7fba280b3aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:17:24.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2ccca700 1 --2- 172.21.15.6:0/1030874475 >> v2:172.21.15.6:3300/0 conn(0x7fba280d07d0 0x7fba280b3aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:24.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2ccca700 1 -- 172.21.15.6:0/1030874475 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba280ceaa0 con 0x7fba280ccd40 2023-10-06T02:17:24.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2ccca700 1 -- 172.21.15.6:0/1030874475 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fba1c001470 con 0x7fba280ccd40 2023-10-06T02:17:24.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2ccca700 1 -- 172.21.15.6:0/1030874475 >> v1:172.21.15.175:6789/0 conn(0x7fba280ccd40 legacy=0x7fba280cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:24.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2ccca700 1 --2- 172.21.15.6:0/1030874475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba10003a60 0x7fba10003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:24.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2ccca700 1 --2- 172.21.15.6:0/1030874475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba10004810 0x7fba10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:24.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2ccca700 1 --2- 172.21.15.6:0/1030874475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba280d0400 0x7fba100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:24.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2ccca700 1 -- 172.21.15.6:0/1030874475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2815dd40 con 0x7fba10003a60 2023-10-06T02:17:24.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2ccca700 1 -- 172.21.15.6:0/1030874475 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2815e020 con 0x7fba10004810 2023-10-06T02:17:24.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2ccca700 1 -- 172.21.15.6:0/1030874475 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1000bb90 con 0x7fba280d0400 2023-10-06T02:17:24.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2dccc700 1 --2- 172.21.15.6:0/1030874475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba10003a60 0x7fba10003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:24.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2d4cb700 1 --2- 172.21.15.6:0/1030874475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba10004810 0x7fba10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:24.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.983+0000 7fba2e4cd700 1 --2- 172.21.15.6:0/1030874475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba280d0400 0x7fba100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:24.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.984+0000 7fba2dccc700 1 -- 172.21.15.6:0/1030874475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba280d0400 msgr2=0x7fba100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:24.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.984+0000 7fba2dccc700 1 --2- 172.21.15.6:0/1030874475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba280d0400 0x7fba100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:24.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.984+0000 7fba2dccc700 1 -- 172.21.15.6:0/1030874475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba10004810 msgr2=0x7fba10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:24.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.984+0000 7fba2dccc700 1 --2- 172.21.15.6:0/1030874475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba10004810 0x7fba10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:24.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.984+0000 7fba2dccc700 1 -- 172.21.15.6:0/1030874475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba10003570 con 0x7fba10003a60 2023-10-06T02:17:24.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.984+0000 7fba2dccc700 1 --2- 172.21.15.6:0/1030874475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba10003a60 0x7fba10003e70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fba2000bb40 tx=0x7fba20008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fba3bcc58714d96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:24.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.984+0000 7fba2ccca700 1 -- 172.21.15.6:0/1030874475 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20005a00 con 0x7fba10003a60 2023-10-06T02:17:24.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.984+0000 7fba2ccca700 1 -- 172.21.15.6:0/1030874475 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba20005b80 con 0x7fba10003a60 2023-10-06T02:17:24.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.984+0000 7fba2ccca700 1 -- 172.21.15.6:0/1030874475 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2000d5d0 con 0x7fba10003a60 2023-10-06T02:17:24.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.985+0000 7fba2ff30700 1 -- 172.21.15.6:0/1030874475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba10003a60 msgr2=0x7fba10003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:24.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.985+0000 7fba2ff30700 1 --2- 172.21.15.6:0/1030874475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba10003a60 0x7fba10003e70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fba2000bb40 tx=0x7fba20008040 comp rx=0 tx=0).stop 2023-10-06T02:17:24.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.985+0000 7fba2e4cd700 1 -- 172.21.15.6:0/1030874475 reap_dead start 2023-10-06T02:17:24.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.985+0000 7fba2ff30700 1 -- 172.21.15.6:0/1030874475 shutdown_connections 2023-10-06T02:17:24.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.985+0000 7fba2ff30700 1 -- 172.21.15.6:0/1030874475 >> 172.21.15.6:0/1030874475 conn(0x7fba2806a220 msgr2=0x7fba2806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:24.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.986+0000 7fba2ff30700 1 -- 172.21.15.6:0/1030874475 shutdown_connections 2023-10-06T02:17:24.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.986+0000 7fba2ff30700 1 -- 172.21.15.6:0/1030874475 wait complete. 2023-10-06T02:17:24.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.987+0000 7fba2ff30700 1 Processor -- start 2023-10-06T02:17:24.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.987+0000 7fba2ff30700 1 -- start start 2023-10-06T02:17:24.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.988+0000 7fba2ff30700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba10003a60 0x7fba2816d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:24.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.988+0000 7fba2ff30700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba2816ddf0 0x7fba280c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:24.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.988+0000 7fba2ff30700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba280c8fd0 0x7fba280b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:24.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.988+0000 7fba2ff30700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba280c9600 con 0x7fba280c8fd0 2023-10-06T02:17:24.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.988+0000 7fba2ff30700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba28169c30 con 0x7fba10003a60 2023-10-06T02:17:24.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.988+0000 7fba2ff30700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2816ac00 con 0x7fba2816ddf0 2023-10-06T02:17:24.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.988+0000 7fba2e4cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba280c8fd0 0x7fba280b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:24.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.988+0000 7fba2dccc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba10003a60 0x7fba2816d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:24.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.988+0000 7fba2d4cb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba2816ddf0 0x7fba280c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:24.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.988+0000 7fba2e4cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba280c8fd0 0x7fba280b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34966/0 (socket says 172.21.15.6:34966) 2023-10-06T02:17:24.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.988+0000 7fba2d4cb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba2816ddf0 0x7fba280c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:40714/0 (socket says 172.21.15.6:40714) 2023-10-06T02:17:24.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.988+0000 7fba2e4cd700 1 -- 172.21.15.6:0/2296530631 learned_addr learned my addr 172.21.15.6:0/2296530631 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:24.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.989+0000 7fba2e4cd700 1 -- 172.21.15.6:0/2296530631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba2816ddf0 msgr2=0x7fba280c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:24.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.989+0000 7fba2e4cd700 1 --2- 172.21.15.6:0/2296530631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba2816ddf0 0x7fba280c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:24.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.989+0000 7fba2e4cd700 1 -- 172.21.15.6:0/2296530631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba10003a60 msgr2=0x7fba2816d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:24.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.989+0000 7fba2e4cd700 1 --2- 172.21.15.6:0/2296530631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba10003a60 0x7fba2816d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:24.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.989+0000 7fba2e4cd700 1 -- 172.21.15.6:0/2296530631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba28169e40 con 0x7fba280c8fd0 2023-10-06T02:17:24.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.989+0000 7fba2e4cd700 1 --2- 172.21.15.6:0/2296530631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba280c8fd0 0x7fba280b2140 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fba18009650 tx=0x7fba180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:24.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.990+0000 7fba25ffb700 1 -- 172.21.15.6:0/2296530631 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1800f920 con 0x7fba280c8fd0 2023-10-06T02:17:24.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.990+0000 7fba2ff30700 1 -- 172.21.15.6:0/2296530631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2816a120 con 0x7fba280c8fd0 2023-10-06T02:17:24.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.990+0000 7fba2ff30700 1 -- 172.21.15.6:0/2296530631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2816a6e0 con 0x7fba280c8fd0 2023-10-06T02:17:24.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.990+0000 7fba25ffb700 1 -- 172.21.15.6:0/2296530631 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1800fa80 con 0x7fba280c8fd0 2023-10-06T02:17:24.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.990+0000 7fba25ffb700 1 -- 172.21.15.6:0/2296530631 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1800fe40 con 0x7fba280c8fd0 2023-10-06T02:17:24.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.990+0000 7fba25ffb700 1 -- 172.21.15.6:0/2296530631 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fba18009c50 con 0x7fba280c8fd0 2023-10-06T02:17:24.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.990+0000 7fba25ffb700 1 -- 172.21.15.6:0/2296530631 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fba1801d760 con 0x7fba280c8fd0 2023-10-06T02:17:24.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.991+0000 7fba2ff30700 1 -- 172.21.15.6:0/2296530631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba080052b0 con 0x7fba280c8fd0 2023-10-06T02:17:24.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:24.993+0000 7fba25ffb700 1 -- 172.21.15.6:0/2296530631 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fba1800a1b0 con 0x7fba280c8fd0 2023-10-06T02:17:25.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:25.072+0000 7fba2ff30700 1 -- 172.21.15.6:0/2296530631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fba08005830 con 0x7fba280c8fd0 2023-10-06T02:17:25.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:25.079+0000 7fba25ffb700 1 -- 172.21.15.6:0/2296530631 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fba1800a350 con 0x7fba280c8fd0 2023-10-06T02:17:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:25.080+0000 7fba2ff30700 1 -- 172.21.15.6:0/2296530631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba280c8fd0 msgr2=0x7fba280b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:25.080+0000 7fba2ff30700 1 --2- 172.21.15.6:0/2296530631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba280c8fd0 0x7fba280b2140 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fba18009650 tx=0x7fba180091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:25.080+0000 7fba2ff30700 1 -- 172.21.15.6:0/2296530631 shutdown_connections 2023-10-06T02:17:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:25.080+0000 7fba2ff30700 1 --2- 172.21.15.6:0/2296530631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba280c8fd0 0x7fba280b2140 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:25.080+0000 7fba2ff30700 1 --2- 172.21.15.6:0/2296530631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba10003a60 0x7fba2816d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:25.080+0000 7fba2ff30700 1 --2- 172.21.15.6:0/2296530631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba2816ddf0 0x7fba280c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:25.080+0000 7fba2ff30700 1 -- 172.21.15.6:0/2296530631 >> 172.21.15.6:0/2296530631 conn(0x7fba2806a220 msgr2=0x7fba280b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:25.080+0000 7fba2ff30700 1 -- 172.21.15.6:0/2296530631 shutdown_connections 2023-10-06T02:17:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:25.080+0000 7fba2ff30700 1 -- 172.21.15.6:0/2296530631 wait complete. 2023-10-06T02:17:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2023-10-06T02:17:25.092 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T02:17:25.092 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:17:25.092 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T02:17:25.117 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:17:25.117 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T02:17:25.182 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:17:25.182 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T02:17:25.249 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-06T02:17:25.250 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T02:17:25.315 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:17:25.315 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T02:17:25.340 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:17:25.340 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T02:17:25.404 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:17:25.405 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T02:17:25.468 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-06T02:17:25.468 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T02:17:25.532 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 4805a88b-858b-4389-87ba-2b19c52161fb 0 2023-10-06T02:17:25.687 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.687+0000 7ff9ba39b700 1 Processor -- start 2023-10-06T02:17:25.688 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.687+0000 7ff9ba39b700 1 -- start start 2023-10-06T02:17:25.690 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9ba39b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff9b40afb20 0x7ff9b40aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:25.690 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9ba39b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b4156060 0x7ff9b406bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:25.690 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9ba39b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff9b40afef0 0x7ff9b406ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:25.690 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9ba39b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b40af410 con 0x7ff9b40afb20 2023-10-06T02:17:25.691 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9ba39b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b4150540 con 0x7ff9b40afef0 2023-10-06T02:17:25.691 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9ba39b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b4157040 con 0x7ff9b4156060 2023-10-06T02:17:25.691 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9b8938700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff9b40afef0 0x7ff9b406ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:25.691 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9b37fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b4156060 0x7ff9b406bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:25.691 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9b37fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b4156060 0x7ff9b406bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:51810/0 (socket says 172.21.15.175:51810) 2023-10-06T02:17:25.691 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9b37fe700 1 -- 172.21.15.175:0/2223360096 learned_addr learned my addr 172.21.15.175:0/2223360096 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-10-06T02:17:25.692 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9b8938700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff9b40afef0 0x7ff9b406ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59356/0 (socket says 172.21.15.175:59356) 2023-10-06T02:17:25.692 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9b3fff700 1 --2- 172.21.15.175:0/2223360096 >> v2:172.21.15.6:3300/0 conn(0x7ff9b40afb20 0x7ff9b40aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:25.692 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9b37fe700 1 -- 172.21.15.175:0/2223360096 >> v2:172.21.15.175:3300/0 conn(0x7ff9b40afef0 msgr2=0x7ff9b406ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:25.692 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9b37fe700 1 --2- 172.21.15.175:0/2223360096 >> v2:172.21.15.175:3300/0 conn(0x7ff9b40afef0 0x7ff9b406ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.692 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9b37fe700 1 -- 172.21.15.175:0/2223360096 >> v2:172.21.15.6:3300/0 conn(0x7ff9b40afb20 msgr2=0x7ff9b40aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:25.692 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9b37fe700 1 --2- 172.21.15.175:0/2223360096 >> v2:172.21.15.6:3300/0 conn(0x7ff9b40afb20 0x7ff9b40aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.693 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9b37fe700 1 -- 172.21.15.175:0/2223360096 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b4156500 con 0x7ff9b4156060 2023-10-06T02:17:25.693 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.688+0000 7ff9b37fe700 1 --2- 172.21.15.175:0/2223360096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b4156060 0x7ff9b406bb60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4159590 tx=0x7ff9a4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d74a8c75e170696f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:25.693 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.689+0000 7ff9b2ffd700 1 -- 172.21.15.175:0/2223360096 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a400b640 con 0x7ff9b4156060 2023-10-06T02:17:25.693 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.689+0000 7ff9b2ffd700 1 -- 172.21.15.175:0/2223360096 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a400b7a0 con 0x7ff9b4156060 2023-10-06T02:17:25.693 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.689+0000 7ff9b2ffd700 1 -- 172.21.15.175:0/2223360096 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a400bb60 con 0x7ff9b4156060 2023-10-06T02:17:25.693 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.689+0000 7ff9ba39b700 1 -- 172.21.15.175:0/2223360096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b4156060 msgr2=0x7ff9b406bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:25.694 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.689+0000 7ff9ba39b700 1 --2- 172.21.15.175:0/2223360096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b4156060 0x7ff9b406bb60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4159590 tx=0x7ff9a4009250 comp rx=0 tx=0).stop 2023-10-06T02:17:25.694 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.689+0000 7ff9ba39b700 1 -- 172.21.15.175:0/2223360096 shutdown_connections 2023-10-06T02:17:25.694 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.689+0000 7ff9ba39b700 1 --2- 172.21.15.175:0/2223360096 >> v2:172.21.15.175:3300/0 conn(0x7ff9b40afef0 0x7ff9b406ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.694 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.689+0000 7ff9ba39b700 1 --2- 172.21.15.175:0/2223360096 >> v2:172.21.15.6:3300/0 conn(0x7ff9b40afb20 0x7ff9b40aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.694 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.689+0000 7ff9ba39b700 1 --2- 172.21.15.175:0/2223360096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b4156060 0x7ff9b406bb60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.694 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.689+0000 7ff9ba39b700 1 -- 172.21.15.175:0/2223360096 >> 172.21.15.175:0/2223360096 conn(0x7ff9b40cc110 msgr2=0x7ff9b40cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:25.695 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.689+0000 7ff9ba39b700 1 -- 172.21.15.175:0/2223360096 shutdown_connections 2023-10-06T02:17:25.695 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.689+0000 7ff9ba39b700 1 -- 172.21.15.175:0/2223360096 wait complete. 2023-10-06T02:17:25.697 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.690+0000 7ff9ba39b700 1 Processor -- start 2023-10-06T02:17:25.698 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.691+0000 7ff9ba39b700 1 -- start start 2023-10-06T02:17:25.698 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.691+0000 7ff9ba39b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9b40afb20 0x7ff9b41483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:25.698 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.691+0000 7ff9ba39b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b40afef0 0x7ff9b40ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:25.698 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.691+0000 7ff9ba39b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b4156060 0x7ff9b414a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:25.698 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.691+0000 7ff9ba39b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b4148930 con 0x7ff9b40afef0 2023-10-06T02:17:25.698 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.691+0000 7ff9ba39b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b40ad390 con 0x7ff9b40afb20 2023-10-06T02:17:25.699 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.691+0000 7ff9ba39b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b40ac780 con 0x7ff9b4156060 2023-10-06T02:17:25.699 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.691+0000 7ff9b8938700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b4156060 0x7ff9b414a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:25.699 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.691+0000 7ff9b8938700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b4156060 0x7ff9b414a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:51816/0 (socket says 172.21.15.175:51816) 2023-10-06T02:17:25.699 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.691+0000 7ff9b3fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9b40afb20 0x7ff9b41483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:25.699 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.692+0000 7ff9b8938700 1 -- 172.21.15.175:0/772192549 learned_addr learned my addr 172.21.15.175:0/772192549 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-10-06T02:17:25.699 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.692+0000 7ff9b37fe700 1 --2- 172.21.15.175:0/772192549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b40afef0 0x7ff9b40ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:25.700 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.692+0000 7ff9b8938700 1 -- 172.21.15.175:0/772192549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9b40afb20 msgr2=0x7ff9b41483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:25.700 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.692+0000 7ff9b8938700 1 --2- 172.21.15.175:0/772192549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9b40afb20 0x7ff9b41483f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.700 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.692+0000 7ff9b8938700 1 -- 172.21.15.175:0/772192549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b40afef0 msgr2=0x7ff9b40ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:25.700 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.692+0000 7ff9b8938700 1 --2- 172.21.15.175:0/772192549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b40afef0 0x7ff9b40ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.700 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.692+0000 7ff9b8938700 1 -- 172.21.15.175:0/772192549 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a40094f0 con 0x7ff9b4156060 2023-10-06T02:17:25.700 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.692+0000 7ff9b3fff700 1 --2- 172.21.15.175:0/772192549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9b40afb20 0x7ff9b41483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:25.701 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.692+0000 7ff9b8938700 1 --2- 172.21.15.175:0/772192549 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b4156060 0x7ff9b414a940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009e90 tx=0x7ff9ac00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:25.701 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.692+0000 7ff99bfff700 1 -- 172.21.15.175:0/772192549 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac00cb70 con 0x7ff9b4156060 2023-10-06T02:17:25.701 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.692+0000 7ff99bfff700 1 -- 172.21.15.175:0/772192549 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac00f040 con 0x7ff9b4156060 2023-10-06T02:17:25.701 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.692+0000 7ff9ba39b700 1 -- 172.21.15.175:0/772192549 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b40aca60 con 0x7ff9b4156060 2023-10-06T02:17:25.701 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.692+0000 7ff99bfff700 1 -- 172.21.15.175:0/772192549 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac014480 con 0x7ff9b4156060 2023-10-06T02:17:25.701 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.692+0000 7ff9ba39b700 1 -- 172.21.15.175:0/772192549 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b40ad020 con 0x7ff9b4156060 2023-10-06T02:17:25.701 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.692+0000 7ff99bfff700 1 -- 172.21.15.175:0/772192549 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff9ac0147f0 con 0x7ff9b4156060 2023-10-06T02:17:25.701 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.692+0000 7ff99bfff700 1 -- 172.21.15.175:0/772192549 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff9ac01da00 con 0x7ff9b4156060 2023-10-06T02:17:25.702 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.693+0000 7ff9ba39b700 1 -- 172.21.15.175:0/772192549 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b406d430 con 0x7ff9b4156060 2023-10-06T02:17:25.702 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.695+0000 7ff99bfff700 1 -- 172.21.15.175:0/772192549 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff9ac018020 con 0x7ff9b4156060 2023-10-06T02:17:25.777 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.777+0000 7ff9ba39b700 1 -- 172.21.15.175:0/772192549 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4805a88b-858b-4389-87ba-2b19c52161fb", "id": 0} v 0) v1 -- 0x7ff9b4159130 con 0x7ff9b4156060 2023-10-06T02:17:25.782 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.782+0000 7ff99bfff700 1 -- 172.21.15.175:0/772192549 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4805a88b-858b-4389-87ba-2b19c52161fb", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff9ac014cd0 con 0x7ff9b4156060 2023-10-06T02:17:25.782 INFO:teuthology.orchestra.run.smithi175.stdout:0 2023-10-06T02:17:25.783 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.783+0000 7ff9ba39b700 1 -- 172.21.15.175:0/772192549 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b4156060 msgr2=0x7ff9b414a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:25.783 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.783+0000 7ff9ba39b700 1 --2- 172.21.15.175:0/772192549 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b4156060 0x7ff9b414a940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009e90 tx=0x7ff9ac00b040 comp rx=0 tx=0).stop 2023-10-06T02:17:25.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.783+0000 7ff9ba39b700 1 -- 172.21.15.175:0/772192549 shutdown_connections 2023-10-06T02:17:25.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.783+0000 7ff9ba39b700 1 --2- 172.21.15.175:0/772192549 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9b4156060 0x7ff9b414a940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.783+0000 7ff9ba39b700 1 --2- 172.21.15.175:0/772192549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9b40afb20 0x7ff9b41483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.783+0000 7ff9ba39b700 1 --2- 172.21.15.175:0/772192549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b40afef0 0x7ff9b40ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.783+0000 7ff9ba39b700 1 -- 172.21.15.175:0/772192549 >> 172.21.15.175:0/772192549 conn(0x7ff9b40cc110 msgr2=0x7ff9b41586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:25.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.783+0000 7ff9ba39b700 1 -- 172.21.15.175:0/772192549 shutdown_connections 2023-10-06T02:17:25.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.783+0000 7ff9ba39b700 1 -- 172.21.15.175:0/772192549 wait complete. 2023-10-06T02:17:25.795 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 350f60b6-7772-43a2-b25c-7d49920c7bb5 1 2023-10-06T02:17:25.909 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.909+0000 7fe1fd51d700 1 Processor -- start 2023-10-06T02:17:25.910 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.909+0000 7fe1fd51d700 1 -- start start 2023-10-06T02:17:25.912 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.910+0000 7fe1fd51d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f8155600 0x7fe1f806c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:25.913 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.910+0000 7fe1fd51d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe1f81559d0 0x7fe1f806c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:25.913 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.910+0000 7fe1fd51d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f80ca680 con 0x7fe1f80688b0 2023-10-06T02:17:25.913 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.910+0000 7fe1fd51d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f8069440 con 0x7fe1f81559d0 2023-10-06T02:17:25.913 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.910+0000 7fe1fd51d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f80ca350 con 0x7fe1f8155600 2023-10-06T02:17:25.913 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.910+0000 7fe1f77fe700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe1f80688b0 0x7fe1f8068d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:36206/0 (socket says 172.21.15.175:36206) 2023-10-06T02:17:25.913 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.910+0000 7fe1f77fe700 1 -- 172.21.15.175:0/3909722945 learned_addr learned my addr 172.21.15.175:0/3909722945 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-10-06T02:17:25.913 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.910+0000 7fe1f6ffd700 1 --2- 172.21.15.175:0/3909722945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f8155600 0x7fe1f806c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:25.914 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.910+0000 7fe1f67fc700 1 --2- 172.21.15.175:0/3909722945 >> v2:172.21.15.6:3300/0 conn(0x7fe1f81559d0 0x7fe1f806c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:25.914 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.910+0000 7fe1f5ffb700 1 -- 172.21.15.175:0/3909722945 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1064749754 0 0) 0x7fe1f80ca680 con 0x7fe1f80688b0 2023-10-06T02:17:25.914 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.910+0000 7fe1f5ffb700 1 -- 172.21.15.175:0/3909722945 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1e0003570 con 0x7fe1f80688b0 2023-10-06T02:17:25.914 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.910+0000 7fe1f6ffd700 1 -- 172.21.15.175:0/3909722945 >> v2:172.21.15.6:3300/0 conn(0x7fe1f81559d0 msgr2=0x7fe1f806c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:25.914 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.910+0000 7fe1f6ffd700 1 --2- 172.21.15.175:0/3909722945 >> v2:172.21.15.6:3300/0 conn(0x7fe1f81559d0 0x7fe1f806c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.914 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.910+0000 7fe1f6ffd700 1 -- 172.21.15.175:0/3909722945 >> v1:172.21.15.175:6789/0 conn(0x7fe1f80688b0 legacy=0x7fe1f8068d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:25.915 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.910+0000 7fe1f6ffd700 1 -- 172.21.15.175:0/3909722945 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f8069620 con 0x7fe1f8155600 2023-10-06T02:17:25.915 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.910+0000 7fe1f6ffd700 1 --2- 172.21.15.175:0/3909722945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f8155600 0x7fe1f806c210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0098e0 tx=0x7fe1ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9669532fe00601b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:25.915 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.911+0000 7fe1f5ffb700 1 -- 172.21.15.175:0/3909722945 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec011630 con 0x7fe1f8155600 2023-10-06T02:17:25.915 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.911+0000 7fe1f5ffb700 1 -- 172.21.15.175:0/3909722945 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec011790 con 0x7fe1f8155600 2023-10-06T02:17:25.915 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.911+0000 7fe1f5ffb700 1 -- 172.21.15.175:0/3909722945 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec011b30 con 0x7fe1f8155600 2023-10-06T02:17:25.915 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.911+0000 7fe1fd51d700 1 -- 172.21.15.175:0/3909722945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f8155600 msgr2=0x7fe1f806c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:25.915 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.911+0000 7fe1fd51d700 1 --2- 172.21.15.175:0/3909722945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f8155600 0x7fe1f806c210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0098e0 tx=0x7fe1ec0091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.915 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.911+0000 7fe1fd51d700 1 -- 172.21.15.175:0/3909722945 shutdown_connections 2023-10-06T02:17:25.916 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.911+0000 7fe1fd51d700 1 --2- 172.21.15.175:0/3909722945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f8155600 0x7fe1f806c210 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.916 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.911+0000 7fe1fd51d700 1 --2- 172.21.15.175:0/3909722945 >> v2:172.21.15.6:3300/0 conn(0x7fe1f81559d0 0x7fe1f806c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.916 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.911+0000 7fe1fd51d700 1 -- 172.21.15.175:0/3909722945 >> 172.21.15.175:0/3909722945 conn(0x7fe1f80c9cc0 msgr2=0x7fe1f806acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:25.916 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.911+0000 7fe1fd51d700 1 -- 172.21.15.175:0/3909722945 shutdown_connections 2023-10-06T02:17:25.916 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.911+0000 7fe1fd51d700 1 -- 172.21.15.175:0/3909722945 wait complete. 2023-10-06T02:17:25.921 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.913+0000 7fe1fd51d700 1 Processor -- start 2023-10-06T02:17:25.921 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.913+0000 7fe1fd51d700 1 -- start start 2023-10-06T02:17:25.921 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.914+0000 7fe1fd51d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f80688b0 0x7fe1f80c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:25.921 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.914+0000 7fe1fd51d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1f8155600 0x7fe1f8151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:25.921 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.914+0000 7fe1fd51d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f81559d0 0x7fe1f80c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:25.922 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.914+0000 7fe1fd51d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f8151850 con 0x7fe1f80688b0 2023-10-06T02:17:25.922 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.914+0000 7fe1fd51d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f80c63a0 con 0x7fe1f8155600 2023-10-06T02:17:25.922 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.914+0000 7fe1fd51d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f80c5790 con 0x7fe1f81559d0 2023-10-06T02:17:25.922 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1f67fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1f8155600 0x7fe1f8151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:25.922 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1f67fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1f8155600 0x7fe1f8151310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59378/0 (socket says 172.21.15.175:59378) 2023-10-06T02:17:25.922 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1f67fc700 1 -- 172.21.15.175:0/3184235736 learned_addr learned my addr 172.21.15.175:0/3184235736 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-10-06T02:17:25.923 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1f6ffd700 1 --2- 172.21.15.175:0/3184235736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f80688b0 0x7fe1f80c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:25.923 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1f77fe700 1 --2- 172.21.15.175:0/3184235736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f81559d0 0x7fe1f80c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:25.923 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1f67fc700 1 -- 172.21.15.175:0/3184235736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f81559d0 msgr2=0x7fe1f80c24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:25.923 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1f67fc700 1 --2- 172.21.15.175:0/3184235736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f81559d0 0x7fe1f80c24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.923 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1f67fc700 1 -- 172.21.15.175:0/3184235736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f80688b0 msgr2=0x7fe1f80c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:25.923 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1f67fc700 1 --2- 172.21.15.175:0/3184235736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f80688b0 0x7fe1f80c5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:25.924 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1f67fc700 1 -- 172.21.15.175:0/3184235736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec009420 con 0x7fe1f8155600 2023-10-06T02:17:25.924 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1f6ffd700 1 --2- 172.21.15.175:0/3184235736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f80688b0 0x7fe1f80c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:25.924 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1f67fc700 1 --2- 172.21.15.175:0/3184235736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1f8155600 0x7fe1f8151310 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8010b40 tx=0x7fe1e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:25.924 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1deffd700 1 -- 172.21.15.175:0/3184235736 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e800ea60 con 0x7fe1f8155600 2023-10-06T02:17:25.924 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1deffd700 1 -- 172.21.15.175:0/3184235736 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e800ebc0 con 0x7fe1f8155600 2023-10-06T02:17:25.924 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1fd51d700 1 -- 172.21.15.175:0/3184235736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f80c5a70 con 0x7fe1f8155600 2023-10-06T02:17:25.924 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1deffd700 1 -- 172.21.15.175:0/3184235736 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8011450 con 0x7fe1f8155600 2023-10-06T02:17:25.925 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1fd51d700 1 -- 172.21.15.175:0/3184235736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f80c6030 con 0x7fe1f8155600 2023-10-06T02:17:25.925 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1deffd700 1 -- 172.21.15.175:0/3184235736 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe1e8005c80 con 0x7fe1f8155600 2023-10-06T02:17:25.926 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.915+0000 7fe1deffd700 1 -- 172.21.15.175:0/3184235736 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fe1e80063e0 con 0x7fe1f8155600 2023-10-06T02:17:25.926 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.916+0000 7fe1fd51d700 1 -- 172.21.15.175:0/3184235736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f806e140 con 0x7fe1f8155600 2023-10-06T02:17:25.926 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:25.918+0000 7fe1deffd700 1 -- 172.21.15.175:0/3184235736 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe1e801e070 con 0x7fe1f8155600 2023-10-06T02:17:26.003 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.002+0000 7fe1fd51d700 1 -- 172.21.15.175:0/3184235736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "350f60b6-7772-43a2-b25c-7d49920c7bb5", "id": 1} v 0) v1 -- 0x7fe1f80c64e0 con 0x7fe1f8155600 2023-10-06T02:17:26.006 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.006+0000 7fe1deffd700 1 -- 172.21.15.175:0/3184235736 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "350f60b6-7772-43a2-b25c-7d49920c7bb5", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe1e8011de0 con 0x7fe1f8155600 2023-10-06T02:17:26.007 INFO:teuthology.orchestra.run.smithi175.stdout:1 2023-10-06T02:17:26.008 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.007+0000 7fe1fd51d700 1 -- 172.21.15.175:0/3184235736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1f8155600 msgr2=0x7fe1f8151310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.008 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.007+0000 7fe1fd51d700 1 --2- 172.21.15.175:0/3184235736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1f8155600 0x7fe1f8151310 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8010b40 tx=0x7fe1e80091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.008 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.007+0000 7fe1fd51d700 1 -- 172.21.15.175:0/3184235736 shutdown_connections 2023-10-06T02:17:26.008 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.007+0000 7fe1fd51d700 1 --2- 172.21.15.175:0/3184235736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f81559d0 0x7fe1f80c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.008 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.007+0000 7fe1fd51d700 1 --2- 172.21.15.175:0/3184235736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f80688b0 0x7fe1f80c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.008 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.007+0000 7fe1fd51d700 1 --2- 172.21.15.175:0/3184235736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1f8155600 0x7fe1f8151310 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.008 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.007+0000 7fe1fd51d700 1 -- 172.21.15.175:0/3184235736 >> 172.21.15.175:0/3184235736 conn(0x7fe1f80c9cc0 msgr2=0x7fe1f80aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:26.008 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.007+0000 7fe1fd51d700 1 -- 172.21.15.175:0/3184235736 shutdown_connections 2023-10-06T02:17:26.008 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.007+0000 7fe1fd51d700 1 -- 172.21.15.175:0/3184235736 wait complete. 2023-10-06T02:17:26.019 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 92d3458b-f56f-4d6e-b928-c1b9e61cd9ba 2 2023-10-06T02:17:26.135 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.134+0000 7f903d1c7700 1 Processor -- start 2023-10-06T02:17:26.135 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.135+0000 7f903d1c7700 1 -- start start 2023-10-06T02:17:26.137 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.135+0000 7f903d1c7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90380c3fd0 0x7f90380c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.137 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.135+0000 7f903d1c7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f90380cbcc0 0x7f90380cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.137 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.135+0000 7f903d1c7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90380c3b40 con 0x7f90381574b0 2023-10-06T02:17:26.138 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.135+0000 7f903d1c7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90380c4980 con 0x7f90380cbcc0 2023-10-06T02:17:26.138 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.135+0000 7f903d1c7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90380cc680 con 0x7f90380c3fd0 2023-10-06T02:17:26.138 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.135+0000 7f903759e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f90380cbcc0 0x7f90380cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.138 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.135+0000 7f903659c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90380c3fd0 0x7f90380c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.138 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.135+0000 7f9036d9d700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f90381574b0 0x7f90380b0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:36222/0 (socket says 172.21.15.175:36222) 2023-10-06T02:17:26.138 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.135+0000 7f903759e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f90380cbcc0 0x7f90380cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59382/0 (socket says 172.21.15.175:59382) 2023-10-06T02:17:26.138 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.135+0000 7f9036d9d700 1 -- 172.21.15.175:0/3302414556 learned_addr learned my addr 172.21.15.175:0/3302414556 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-10-06T02:17:26.138 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.136+0000 7f903759e700 1 -- 172.21.15.175:0/3302414556 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90380c3fd0 msgr2=0x7f90380c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:26.138 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.136+0000 7f903759e700 1 --2- 172.21.15.175:0/3302414556 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90380c3fd0 0x7f90380c4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.138 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.136+0000 7f903759e700 1 -- 172.21.15.175:0/3302414556 >> v1:172.21.15.175:6789/0 conn(0x7f90381574b0 legacy=0x7f90380b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.138 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.136+0000 7f903759e700 1 -- 172.21.15.175:0/3302414556 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90380c2f30 con 0x7f90380cbcc0 2023-10-06T02:17:26.139 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.136+0000 7f903659c700 1 --2- 172.21.15.175:0/3302414556 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90380c3fd0 0x7f90380c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:26.139 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.136+0000 7f903759e700 1 --2- 172.21.15.175:0/3302414556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90380cbcc0 0x7f90380cc140 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9030009e60 tx=0x7f9030009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7abbaaba029e4de7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:26.139 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.136+0000 7f9035d9b700 1 -- 172.21.15.175:0/3302414556 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903000e070 con 0x7f90380cbcc0 2023-10-06T02:17:26.139 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.136+0000 7f9035d9b700 1 -- 172.21.15.175:0/3302414556 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903000bb60 con 0x7f90380cbcc0 2023-10-06T02:17:26.139 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.136+0000 7f9035d9b700 1 -- 172.21.15.175:0/3302414556 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030012430 con 0x7f90380cbcc0 2023-10-06T02:17:26.139 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.137+0000 7f903d1c7700 1 -- 172.21.15.175:0/3302414556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90380cbcc0 msgr2=0x7f90380cc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.139 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.137+0000 7f903d1c7700 1 --2- 172.21.15.175:0/3302414556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90380cbcc0 0x7f90380cc140 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9030009e60 tx=0x7f9030009780 comp rx=0 tx=0).stop 2023-10-06T02:17:26.139 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.137+0000 7f903d1c7700 1 -- 172.21.15.175:0/3302414556 shutdown_connections 2023-10-06T02:17:26.139 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.137+0000 7f903d1c7700 1 --2- 172.21.15.175:0/3302414556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90380cbcc0 0x7f90380cc140 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.139 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.137+0000 7f903d1c7700 1 --2- 172.21.15.175:0/3302414556 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90380c3fd0 0x7f90380c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.140 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.137+0000 7f903d1c7700 1 -- 172.21.15.175:0/3302414556 >> 172.21.15.175:0/3302414556 conn(0x7f9038067910 msgr2=0x7f90380ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:26.140 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.137+0000 7f903d1c7700 1 -- 172.21.15.175:0/3302414556 shutdown_connections 2023-10-06T02:17:26.140 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.137+0000 7f903d1c7700 1 -- 172.21.15.175:0/3302414556 wait complete. 2023-10-06T02:17:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.138+0000 7f903d1c7700 1 Processor -- start 2023-10-06T02:17:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.138+0000 7f903d1c7700 1 -- start start 2023-10-06T02:17:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f903d1c7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90380c3fd0 0x7f903814cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f903d1c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90380cbcc0 0x7f9038157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f903d1c7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90381574b0 0x7f9038157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f903d1c7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90380c5c70 con 0x7f90380cbcc0 2023-10-06T02:17:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f903d1c7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90380c5340 con 0x7f90381574b0 2023-10-06T02:17:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f903d1c7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90380c5620 con 0x7f90380c3fd0 2023-10-06T02:17:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f9036d9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90380c3fd0 0x7f903814cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f903759e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90381574b0 0x7f9038157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f9036d9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90380c3fd0 0x7f903814cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:51852/0 (socket says 172.21.15.175:51852) 2023-10-06T02:17:26.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f903759e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90381574b0 0x7f9038157dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59396/0 (socket says 172.21.15.175:59396) 2023-10-06T02:17:26.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f9036d9d700 1 -- 172.21.15.175:0/732574616 learned_addr learned my addr 172.21.15.175:0/732574616 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-10-06T02:17:26.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f903659c700 1 --2- 172.21.15.175:0/732574616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90380cbcc0 0x7f9038157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f903759e700 1 -- 172.21.15.175:0/732574616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90380c3fd0 msgr2=0x7f903814cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f903759e700 1 --2- 172.21.15.175:0/732574616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90380c3fd0 0x7f903814cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f903759e700 1 -- 172.21.15.175:0/732574616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90380cbcc0 msgr2=0x7f9038157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f903759e700 1 --2- 172.21.15.175:0/732574616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90380cbcc0 0x7f9038157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f903759e700 1 -- 172.21.15.175:0/732574616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9028009420 con 0x7f90381574b0 2023-10-06T02:17:26.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f903659c700 1 --2- 172.21.15.175:0/732574616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90380cbcc0 0x7f9038157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:26.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f9036d9d700 1 --2- 172.21.15.175:0/732574616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90380c3fd0 0x7f903814cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:26.144 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f903759e700 1 --2- 172.21.15.175:0/732574616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90381574b0 0x7f9038157dc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9030016000 tx=0x7f9030019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:26.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f901effd700 1 -- 172.21.15.175:0/732574616 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030012e50 con 0x7f90381574b0 2023-10-06T02:17:26.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f901effd700 1 -- 172.21.15.175:0/732574616 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903001d630 con 0x7f90381574b0 2023-10-06T02:17:26.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f901effd700 1 -- 172.21.15.175:0/732574616 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903001d9f0 con 0x7f90381574b0 2023-10-06T02:17:26.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.139+0000 7f903d1c7700 1 -- 172.21.15.175:0/732574616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9030009a20 con 0x7f90381574b0 2023-10-06T02:17:26.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.140+0000 7f903d1c7700 1 -- 172.21.15.175:0/732574616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9038159ff0 con 0x7f90381574b0 2023-10-06T02:17:26.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.140+0000 7f901effd700 1 -- 172.21.15.175:0/732574616 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9030024070 con 0x7f90381574b0 2023-10-06T02:17:26.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.140+0000 7f901effd700 1 -- 172.21.15.175:0/732574616 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f9030027ad0 con 0x7f90381574b0 2023-10-06T02:17:26.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.140+0000 7f903d1c7700 1 -- 172.21.15.175:0/732574616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90380c5de0 con 0x7f90381574b0 2023-10-06T02:17:26.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.144+0000 7f901effd700 1 -- 172.21.15.175:0/732574616 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f903002c020 con 0x7f90381574b0 2023-10-06T02:17:26.177 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:26.177+0000 7fda26bec180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T02:17:26.228 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.227+0000 7f903d1c7700 1 -- 172.21.15.175:0/732574616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "92d3458b-f56f-4d6e-b928-c1b9e61cd9ba", "id": 2} v 0) v1 -- 0x7f903806e590 con 0x7f90381574b0 2023-10-06T02:17:26.231 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.231+0000 7f901effd700 1 -- 172.21.15.175:0/732574616 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "92d3458b-f56f-4d6e-b928-c1b9e61cd9ba", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f903001de00 con 0x7f90381574b0 2023-10-06T02:17:26.232 INFO:teuthology.orchestra.run.smithi175.stdout:2 2023-10-06T02:17:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.232+0000 7f903d1c7700 1 -- 172.21.15.175:0/732574616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90381574b0 msgr2=0x7f9038157dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.232+0000 7f903d1c7700 1 --2- 172.21.15.175:0/732574616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90381574b0 0x7f9038157dc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9030016000 tx=0x7f9030019000 comp rx=0 tx=0).stop 2023-10-06T02:17:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.232+0000 7f903d1c7700 1 -- 172.21.15.175:0/732574616 shutdown_connections 2023-10-06T02:17:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.232+0000 7f903d1c7700 1 --2- 172.21.15.175:0/732574616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90381574b0 0x7f9038157dc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.232+0000 7f903d1c7700 1 --2- 172.21.15.175:0/732574616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90380c3fd0 0x7f903814cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.232+0000 7f903d1c7700 1 --2- 172.21.15.175:0/732574616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90380cbcc0 0x7f9038157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.234 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.232+0000 7f903d1c7700 1 -- 172.21.15.175:0/732574616 >> 172.21.15.175:0/732574616 conn(0x7f9038067910 msgr2=0x7f90380c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:26.234 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.232+0000 7f903d1c7700 1 -- 172.21.15.175:0/732574616 shutdown_connections 2023-10-06T02:17:26.234 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.232+0000 7f903d1c7700 1 -- 172.21.15.175:0/732574616 wait complete. 2023-10-06T02:17:26.245 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 62d5d34d-f6f8-424d-889e-676fae270ec4 3 2023-10-06T02:17:26.279 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:26.279+0000 7fae4d153180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T02:17:26.316 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:26.316+0000 7fda26bec180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T02:17:26.360 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.359+0000 7ff624db3700 1 Processor -- start 2023-10-06T02:17:26.360 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.359+0000 7ff624db3700 1 -- start start 2023-10-06T02:17:26.362 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.360+0000 7ff624db3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff62006a750 0x7ff62015d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.362 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.360+0000 7ff624db3700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff62015d770 0x7ff620159170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.362 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.360+0000 7ff624db3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6200cae80 con 0x7ff62006a380 2023-10-06T02:17:26.363 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.360+0000 7ff624db3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6200cba20 con 0x7ff62006a750 2023-10-06T02:17:26.363 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.360+0000 7ff624db3700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6200cc3d0 con 0x7ff62015d770 2023-10-06T02:17:26.363 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.360+0000 7ff61ed9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff62015d770 0x7ff620159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.363 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.360+0000 7ff61ed9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff62015d770 0x7ff620159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59408/0 (socket says 172.21.15.175:59408) 2023-10-06T02:17:26.363 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.360+0000 7ff61ed9d700 1 -- 172.21.15.175:0/118607648 learned_addr learned my addr 172.21.15.175:0/118607648 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-10-06T02:17:26.363 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.360+0000 7ff61dd9b700 1 --2- 172.21.15.175:0/118607648 >> v2:172.21.15.6:3300/0 conn(0x7ff62006a750 0x7ff62015d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.363 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.361+0000 7ff61ed9d700 1 -- 172.21.15.175:0/118607648 >> v2:172.21.15.6:3300/0 conn(0x7ff62006a750 msgr2=0x7ff62015d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:26.363 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.361+0000 7ff61ed9d700 1 --2- 172.21.15.175:0/118607648 >> v2:172.21.15.6:3300/0 conn(0x7ff62006a750 0x7ff62015d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.363 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.361+0000 7ff61ed9d700 1 -- 172.21.15.175:0/118607648 >> v1:172.21.15.6:6789/0 conn(0x7ff62006a380 legacy=0x7ff6200cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.364 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.361+0000 7ff61ed9d700 1 -- 172.21.15.175:0/118607648 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62015dcd0 con 0x7ff62015d770 2023-10-06T02:17:26.364 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.361+0000 7ff61ed9d700 1 --2- 172.21.15.175:0/118607648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff62015d770 0x7ff620159170 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff62015d190 tx=0x7ff618009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=211690701c734cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:26.364 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.361+0000 7ff61d59a700 1 -- 172.21.15.175:0/118607648 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61800e070 con 0x7ff62015d770 2023-10-06T02:17:26.364 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.361+0000 7ff61d59a700 1 -- 172.21.15.175:0/118607648 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61800ba20 con 0x7ff62015d770 2023-10-06T02:17:26.364 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.361+0000 7ff61d59a700 1 -- 172.21.15.175:0/118607648 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6180092e0 con 0x7ff62015d770 2023-10-06T02:17:26.364 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.362+0000 7ff624db3700 1 -- 172.21.15.175:0/118607648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff62015d770 msgr2=0x7ff620159170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.364 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.362+0000 7ff624db3700 1 --2- 172.21.15.175:0/118607648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff62015d770 0x7ff620159170 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff62015d190 tx=0x7ff618009840 comp rx=0 tx=0).stop 2023-10-06T02:17:26.364 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.362+0000 7ff624db3700 1 -- 172.21.15.175:0/118607648 shutdown_connections 2023-10-06T02:17:26.364 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.362+0000 7ff624db3700 1 --2- 172.21.15.175:0/118607648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff62015d770 0x7ff620159170 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.364 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.362+0000 7ff624db3700 1 --2- 172.21.15.175:0/118607648 >> v2:172.21.15.6:3300/0 conn(0x7ff62006a750 0x7ff62015d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.364 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.362+0000 7ff624db3700 1 -- 172.21.15.175:0/118607648 >> 172.21.15.175:0/118607648 conn(0x7ff6200d0350 msgr2=0x7ff6200d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:26.365 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.362+0000 7ff624db3700 1 -- 172.21.15.175:0/118607648 shutdown_connections 2023-10-06T02:17:26.365 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.362+0000 7ff624db3700 1 -- 172.21.15.175:0/118607648 wait complete. 2023-10-06T02:17:26.367 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.363+0000 7ff624db3700 1 Processor -- start 2023-10-06T02:17:26.367 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.363+0000 7ff624db3700 1 -- start start 2023-10-06T02:17:26.367 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.363+0000 7ff624db3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff62006a380 0x7ff6200b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.367 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.363+0000 7ff624db3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff62006a750 0x7ff620149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.367 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.363+0000 7ff624db3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff62015d770 0x7ff620156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.367 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff624db3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6200c85f0 con 0x7ff62006a750 2023-10-06T02:17:26.367 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff624db3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6200c8a80 con 0x7ff62015d770 2023-10-06T02:17:26.368 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff624db3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6200c79e0 con 0x7ff62006a380 2023-10-06T02:17:26.368 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff61ed9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff62015d770 0x7ff620156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.368 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff61e59c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff62006a380 0x7ff6200b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.368 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff61ed9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff62015d770 0x7ff620156cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59422/0 (socket says 172.21.15.175:59422) 2023-10-06T02:17:26.368 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff61ed9d700 1 -- 172.21.15.175:0/604274393 learned_addr learned my addr 172.21.15.175:0/604274393 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-10-06T02:17:26.368 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff61e59c700 1 --2- 172.21.15.175:0/604274393 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff62006a380 0x7ff6200b5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:51860/0 (socket says 172.21.15.175:51860) 2023-10-06T02:17:26.368 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff61dd9b700 1 --2- 172.21.15.175:0/604274393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff62006a750 0x7ff620149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.369 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff61ed9d700 1 -- 172.21.15.175:0/604274393 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff62006a380 msgr2=0x7ff6200b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.369 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff61ed9d700 1 --2- 172.21.15.175:0/604274393 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff62006a380 0x7ff6200b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.369 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff61ed9d700 1 -- 172.21.15.175:0/604274393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff62006a750 msgr2=0x7ff620149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.369 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff61ed9d700 1 --2- 172.21.15.175:0/604274393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff62006a750 0x7ff620149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.369 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff61ed9d700 1 -- 172.21.15.175:0/604274393 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff618009ae0 con 0x7ff62015d770 2023-10-06T02:17:26.369 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff61ed9d700 1 --2- 172.21.15.175:0/604274393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff62015d770 0x7ff620156cf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff6180072f0 tx=0x7ff618018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:26.369 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff60e7fc700 1 -- 172.21.15.175:0/604274393 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618008a30 con 0x7ff62015d770 2023-10-06T02:17:26.369 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff60e7fc700 1 -- 172.21.15.175:0/604274393 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff618008b90 con 0x7ff62015d770 2023-10-06T02:17:26.370 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff60e7fc700 1 -- 172.21.15.175:0/604274393 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618025460 con 0x7ff62015d770 2023-10-06T02:17:26.370 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff624db3700 1 -- 172.21.15.175:0/604274393 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6200c7cc0 con 0x7ff62015d770 2023-10-06T02:17:26.370 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff624db3700 1 -- 172.21.15.175:0/604274393 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6200c8280 con 0x7ff62015d770 2023-10-06T02:17:26.370 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff60e7fc700 1 -- 172.21.15.175:0/604274393 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff618003040 con 0x7ff62015d770 2023-10-06T02:17:26.370 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.364+0000 7ff60e7fc700 1 -- 172.21.15.175:0/604274393 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7ff618025cc0 con 0x7ff62015d770 2023-10-06T02:17:26.370 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.365+0000 7ff624db3700 1 -- 172.21.15.175:0/604274393 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff620088a40 con 0x7ff62015d770 2023-10-06T02:17:26.371 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.367+0000 7ff60e7fc700 1 -- 172.21.15.175:0/604274393 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff61802a020 con 0x7ff62015d770 2023-10-06T02:17:26.395 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:26.395+0000 7fda26bec180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T02:17:26.418 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:26.418+0000 7fae4d153180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T02:17:26.449 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.449+0000 7ff624db3700 1 -- 172.21.15.175:0/604274393 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "62d5d34d-f6f8-424d-889e-676fae270ec4", "id": 3} v 0) v1 -- 0x7ff62015dfb0 con 0x7ff62015d770 2023-10-06T02:17:26.453 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.453+0000 7ff60e7fc700 1 -- 172.21.15.175:0/604274393 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "62d5d34d-f6f8-424d-889e-676fae270ec4", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff618020070 con 0x7ff62015d770 2023-10-06T02:17:26.453 INFO:teuthology.orchestra.run.smithi175.stdout:3 2023-10-06T02:17:26.454 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.454+0000 7ff624db3700 1 -- 172.21.15.175:0/604274393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff62015d770 msgr2=0x7ff620156cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.455 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.454+0000 7ff624db3700 1 --2- 172.21.15.175:0/604274393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff62015d770 0x7ff620156cf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff6180072f0 tx=0x7ff618018000 comp rx=0 tx=0).stop 2023-10-06T02:17:26.455 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.454+0000 7ff624db3700 1 -- 172.21.15.175:0/604274393 shutdown_connections 2023-10-06T02:17:26.455 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.454+0000 7ff624db3700 1 --2- 172.21.15.175:0/604274393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff62015d770 0x7ff620156cf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.455 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.454+0000 7ff624db3700 1 --2- 172.21.15.175:0/604274393 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff62006a380 0x7ff6200b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.455 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.454+0000 7ff624db3700 1 --2- 172.21.15.175:0/604274393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff62006a750 0x7ff620149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.455 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.454+0000 7ff624db3700 1 -- 172.21.15.175:0/604274393 >> 172.21.15.175:0/604274393 conn(0x7ff6200d0350 msgr2=0x7ff6200af220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:26.455 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.454+0000 7ff624db3700 1 -- 172.21.15.175:0/604274393 shutdown_connections 2023-10-06T02:17:26.455 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.454+0000 7ff624db3700 1 -- 172.21.15.175:0/604274393 wait complete. 2023-10-06T02:17:26.468 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new cfc25148-d4c5-46f3-b224-df03a90efcad 4 2023-10-06T02:17:26.498 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:26.498+0000 7fae4d153180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T02:17:26.583 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.583+0000 7fcce1839700 1 Processor -- start 2023-10-06T02:17:26.583 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.583+0000 7fcce1839700 1 -- start start 2023-10-06T02:17:26.586 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.584+0000 7fcce1839700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fccdc0b28c0 0x7fccdc087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.586 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.584+0000 7fcce1839700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccdc0afc50 con 0x7fccdc15a030 2023-10-06T02:17:26.586 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.584+0000 7fcce1839700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccdc0aff30 con 0x7fccdc086ff0 2023-10-06T02:17:26.586 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.584+0000 7fcce1839700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccdc0b0cf0 con 0x7fccdc0b28c0 2023-10-06T02:17:26.586 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.584+0000 7fccda7fc700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fccdc086ff0 0x7fccdc0b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:36224/0 (socket says 172.21.15.175:36224) 2023-10-06T02:17:26.586 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.584+0000 7fccda7fc700 1 -- 172.21.15.175:0/274784269 learned_addr learned my addr 172.21.15.175:0/274784269 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-10-06T02:17:26.586 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.584+0000 7fccdb7fe700 1 --2- 172.21.15.175:0/274784269 >> v2:172.21.15.6:3300/0 conn(0x7fccdc0b28c0 0x7fccdc087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.586 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.584+0000 7fccd9ffb700 1 -- 172.21.15.175:0/274784269 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453218482 0 0) 0x7fccdc0aff30 con 0x7fccdc086ff0 2023-10-06T02:17:26.586 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.584+0000 7fccd9ffb700 1 -- 172.21.15.175:0/274784269 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc4003570 con 0x7fccdc086ff0 2023-10-06T02:17:26.586 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.584+0000 7fccd9ffb700 1 -- 172.21.15.175:0/274784269 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1395304616 0 0) 0x7fccc4003570 con 0x7fccdc086ff0 2023-10-06T02:17:26.587 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.584+0000 7fccdb7fe700 1 -- 172.21.15.175:0/274784269 >> v1:172.21.15.175:6789/0 conn(0x7fccdc086ff0 legacy=0x7fccdc0b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.587 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.584+0000 7fccdb7fe700 1 -- 172.21.15.175:0/274784269 >> v1:172.21.15.6:6789/0 conn(0x7fccdc15a030 legacy=0x7fccdc15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.587 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.584+0000 7fccdb7fe700 1 -- 172.21.15.175:0/274784269 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc0b0210 con 0x7fccdc0b28c0 2023-10-06T02:17:26.587 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.584+0000 7fccdb7fe700 1 --2- 172.21.15.175:0/274784269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0b28c0 0x7fccdc087470 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009de0 tx=0x7fccd4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd1d215d329b43a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:26.587 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.585+0000 7fccd9ffb700 1 -- 172.21.15.175:0/274784269 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd400e070 con 0x7fccdc0b28c0 2023-10-06T02:17:26.587 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.585+0000 7fccd9ffb700 1 -- 172.21.15.175:0/274784269 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd400b850 con 0x7fccdc0b28c0 2023-10-06T02:17:26.587 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.585+0000 7fccd9ffb700 1 -- 172.21.15.175:0/274784269 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc001470 con 0x7fccdc0b28c0 2023-10-06T02:17:26.587 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.585+0000 7fcce1839700 1 -- 172.21.15.175:0/274784269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0b28c0 msgr2=0x7fccdc087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.587 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.585+0000 7fcce1839700 1 --2- 172.21.15.175:0/274784269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0b28c0 0x7fccdc087470 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009de0 tx=0x7fccd4009780 comp rx=0 tx=0).stop 2023-10-06T02:17:26.587 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.585+0000 7fcce1839700 1 -- 172.21.15.175:0/274784269 shutdown_connections 2023-10-06T02:17:26.587 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.585+0000 7fcce1839700 1 --2- 172.21.15.175:0/274784269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0b28c0 0x7fccdc087470 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.587 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.585+0000 7fcce1839700 1 -- 172.21.15.175:0/274784269 >> 172.21.15.175:0/274784269 conn(0x7fccdc068680 msgr2=0x7fccdc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:26.588 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.585+0000 7fcce1839700 1 -- 172.21.15.175:0/274784269 shutdown_connections 2023-10-06T02:17:26.588 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.585+0000 7fcce1839700 1 -- 172.21.15.175:0/274784269 wait complete. 2023-10-06T02:17:26.590 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.586+0000 7fcce1839700 1 Processor -- start 2023-10-06T02:17:26.590 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.587+0000 7fcce1839700 1 -- start start 2023-10-06T02:17:26.590 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.587+0000 7fcce1839700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccdc086ff0 0x7fccdc16d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.591 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.587+0000 7fcce1839700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0b28c0 0x7fccdc155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.591 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.587+0000 7fcce1839700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccdc15a030 0x7fccdc15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.591 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.587+0000 7fcce1839700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0b3530 con 0x7fccdc0b28c0 2023-10-06T02:17:26.591 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.587+0000 7fcce1839700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc16d9f0 con 0x7fccdc086ff0 2023-10-06T02:17:26.591 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.587+0000 7fcce1839700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc16dcd0 con 0x7fccdc15a030 2023-10-06T02:17:26.591 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.587+0000 7fccdaffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccdc086ff0 0x7fccdc16d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.591 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.587+0000 7fccdb7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccdc15a030 0x7fccdc15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.591 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.587+0000 7fccdaffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccdc086ff0 0x7fccdc16d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59436/0 (socket says 172.21.15.175:59436) 2023-10-06T02:17:26.591 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.587+0000 7fccdaffd700 1 -- 172.21.15.175:0/3341094712 learned_addr learned my addr 172.21.15.175:0/3341094712 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-10-06T02:17:26.591 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.587+0000 7fccda7fc700 1 --2- 172.21.15.175:0/3341094712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0b28c0 0x7fccdc155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.591 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.588+0000 7fccdb7fe700 1 -- 172.21.15.175:0/3341094712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccdc086ff0 msgr2=0x7fccdc16d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.591 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.588+0000 7fccdb7fe700 1 --2- 172.21.15.175:0/3341094712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccdc086ff0 0x7fccdc16d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.592 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.588+0000 7fccdb7fe700 1 -- 172.21.15.175:0/3341094712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0b28c0 msgr2=0x7fccdc155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.592 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.588+0000 7fccdb7fe700 1 --2- 172.21.15.175:0/3341094712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0b28c0 0x7fccdc155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.592 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.588+0000 7fccdb7fe700 1 -- 172.21.15.175:0/3341094712 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd4009a20 con 0x7fccdc15a030 2023-10-06T02:17:26.592 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.588+0000 7fccdaffd700 1 --2- 172.21.15.175:0/3341094712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccdc086ff0 0x7fccdc16d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:26.592 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.588+0000 7fccdb7fe700 1 --2- 172.21.15.175:0/3341094712 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccdc15a030 0x7fccdc15bcf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fccd4014000 tx=0x7fccd4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:26.592 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.588+0000 7fccc2ffd700 1 -- 172.21.15.175:0/3341094712 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4009420 con 0x7fccdc15a030 2023-10-06T02:17:26.592 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.588+0000 7fccc2ffd700 1 -- 172.21.15.175:0/3341094712 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd401f410 con 0x7fccdc15a030 2023-10-06T02:17:26.592 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.588+0000 7fcce1839700 1 -- 172.21.15.175:0/3341094712 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccdc0b31c0 con 0x7fccdc15a030 2023-10-06T02:17:26.592 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.588+0000 7fccc2ffd700 1 -- 172.21.15.175:0/3341094712 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd401f7d0 con 0x7fccdc15a030 2023-10-06T02:17:26.592 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.588+0000 7fcce1839700 1 -- 172.21.15.175:0/3341094712 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc16d7a0 con 0x7fccdc15a030 2023-10-06T02:17:26.592 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.588+0000 7fccc2ffd700 1 -- 172.21.15.175:0/3341094712 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fccd401fc00 con 0x7fccdc15a030 2023-10-06T02:17:26.592 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.588+0000 7fccc2ffd700 1 -- 172.21.15.175:0/3341094712 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fccd40118c0 con 0x7fccdc15a030 2023-10-06T02:17:26.593 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:26.589+0000 7fda26bec180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:17:26.593 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.589+0000 7fcce1839700 1 -- 172.21.15.175:0/3341094712 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccdc0b36a0 con 0x7fccdc15a030 2023-10-06T02:17:26.593 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.591+0000 7fccc2ffd700 1 -- 172.21.15.175:0/3341094712 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fccd4023070 con 0x7fccdc15a030 2023-10-06T02:17:26.673 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.673+0000 7fcce1839700 1 -- 172.21.15.175:0/3341094712 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cfc25148-d4c5-46f3-b224-df03a90efcad", "id": 4} v 0) v1 -- 0x7fccdc068420 con 0x7fccdc15a030 2023-10-06T02:17:26.677 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.677+0000 7fccc2ffd700 1 -- 172.21.15.175:0/3341094712 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cfc25148-d4c5-46f3-b224-df03a90efcad", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fccd4017070 con 0x7fccdc15a030 2023-10-06T02:17:26.677 INFO:teuthology.orchestra.run.smithi175.stdout:4 2023-10-06T02:17:26.678 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.677+0000 7fcce1839700 1 -- 172.21.15.175:0/3341094712 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccdc15a030 msgr2=0x7fccdc15bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.678 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.678+0000 7fcce1839700 1 --2- 172.21.15.175:0/3341094712 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccdc15a030 0x7fccdc15bcf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fccd4014000 tx=0x7fccd4017000 comp rx=0 tx=0).stop 2023-10-06T02:17:26.679 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.678+0000 7fcce1839700 1 -- 172.21.15.175:0/3341094712 shutdown_connections 2023-10-06T02:17:26.679 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.678+0000 7fcce1839700 1 --2- 172.21.15.175:0/3341094712 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccdc15a030 0x7fccdc15bcf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.679 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.678+0000 7fcce1839700 1 --2- 172.21.15.175:0/3341094712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccdc086ff0 0x7fccdc16d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.679 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.678+0000 7fcce1839700 1 --2- 172.21.15.175:0/3341094712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0b28c0 0x7fccdc155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.679 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.678+0000 7fcce1839700 1 -- 172.21.15.175:0/3341094712 >> 172.21.15.175:0/3341094712 conn(0x7fccdc068680 msgr2=0x7fccdc15da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:26.679 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.678+0000 7fcce1839700 1 -- 172.21.15.175:0/3341094712 shutdown_connections 2023-10-06T02:17:26.679 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.678+0000 7fcce1839700 1 -- 172.21.15.175:0/3341094712 wait complete. 2023-10-06T02:17:26.689 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 3bf97848-ae01-464c-b917-16e3c79a5b9b 5 2023-10-06T02:17:26.697 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:26.697+0000 7fae4d153180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:17:26.770 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:26.770+0000 7fda26bec180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T02:17:26.805 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.805+0000 7fe5ce8a9700 1 Processor -- start 2023-10-06T02:17:26.805 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.805+0000 7fe5ce8a9700 1 -- start start 2023-10-06T02:17:26.808 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.806+0000 7fe5ce8a9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe5c815a030 0x7fe5c815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.808 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.806+0000 7fe5ce8a9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c80afc50 con 0x7fe5c815a940 2023-10-06T02:17:26.808 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.806+0000 7fe5ce8a9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c80aff30 con 0x7fe5c8087700 2023-10-06T02:17:26.808 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.806+0000 7fe5ce8a9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c80b0cf0 con 0x7fe5c815a030 2023-10-06T02:17:26.809 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.806+0000 7fe5c7fff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe5c815a030 0x7fe5c815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.809 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.806+0000 7fe5cce46700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe5c8087700 0x7fe5c80b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:36234/0 (socket says 172.21.15.175:36234) 2023-10-06T02:17:26.809 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.806+0000 7fe5c7fff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe5c815a030 0x7fe5c815a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59442/0 (socket says 172.21.15.175:59442) 2023-10-06T02:17:26.809 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.806+0000 7fe5cce46700 1 -- 172.21.15.175:0/2884353357 learned_addr learned my addr 172.21.15.175:0/2884353357 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-10-06T02:17:26.809 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.806+0000 7fe5c7fff700 1 -- 172.21.15.175:0/2884353357 >> v1:172.21.15.175:6789/0 conn(0x7fe5c8087700 legacy=0x7fe5c80b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.809 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.806+0000 7fe5c7fff700 1 -- 172.21.15.175:0/2884353357 >> v1:172.21.15.6:6789/0 conn(0x7fe5c815a940 legacy=0x7fe5c8086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.809 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.806+0000 7fe5c7fff700 1 -- 172.21.15.175:0/2884353357 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c80b0210 con 0x7fe5c815a030 2023-10-06T02:17:26.809 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.806+0000 7fe5c7fff700 1 --2- 172.21.15.175:0/2884353357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5c815a030 0x7fe5c815a400 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0098e0 tx=0x7fe5bc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b61b6efe2dbd190e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:26.809 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.806+0000 7fe5c6ffd700 1 -- 172.21.15.175:0/2884353357 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc009e80 con 0x7fe5c815a030 2023-10-06T02:17:26.809 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.806+0000 7fe5c6ffd700 1 -- 172.21.15.175:0/2884353357 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5bc00b860 con 0x7fe5c815a030 2023-10-06T02:17:26.809 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.807+0000 7fe5c6ffd700 1 -- 172.21.15.175:0/2884353357 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc00bbe0 con 0x7fe5c815a030 2023-10-06T02:17:26.810 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.807+0000 7fe5ce8a9700 1 -- 172.21.15.175:0/2884353357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5c815a030 msgr2=0x7fe5c815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.810 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.807+0000 7fe5ce8a9700 1 --2- 172.21.15.175:0/2884353357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5c815a030 0x7fe5c815a400 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0098e0 tx=0x7fe5bc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.810 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.807+0000 7fe5ce8a9700 1 -- 172.21.15.175:0/2884353357 shutdown_connections 2023-10-06T02:17:26.810 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.807+0000 7fe5ce8a9700 1 --2- 172.21.15.175:0/2884353357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5c815a030 0x7fe5c815a400 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.810 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.807+0000 7fe5ce8a9700 1 -- 172.21.15.175:0/2884353357 >> 172.21.15.175:0/2884353357 conn(0x7fe5c8068680 msgr2=0x7fe5c8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:26.810 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.807+0000 7fe5ce8a9700 1 -- 172.21.15.175:0/2884353357 shutdown_connections 2023-10-06T02:17:26.810 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.807+0000 7fe5ce8a9700 1 -- 172.21.15.175:0/2884353357 wait complete. 2023-10-06T02:17:26.812 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.808+0000 7fe5ce8a9700 1 Processor -- start 2023-10-06T02:17:26.813 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.808+0000 7fe5ce8a9700 1 -- start start 2023-10-06T02:17:26.813 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.809+0000 7fe5ce8a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c8087700 0x7fe5c816d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.813 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.809+0000 7fe5ce8a9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5c815a030 0x7fe5c816b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.813 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.809+0000 7fe5ce8a9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c815a940 0x7fe5c81554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:26.813 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.809+0000 7fe5ce8a9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c8154220 con 0x7fe5c8087700 2023-10-06T02:17:26.813 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.809+0000 7fe5ce8a9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c816e9a0 con 0x7fe5c815a030 2023-10-06T02:17:26.813 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.809+0000 7fe5ce8a9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c8154400 con 0x7fe5c815a940 2023-10-06T02:17:26.813 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.809+0000 7fe5c77fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5c815a030 0x7fe5c816b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.813 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.809+0000 7fe5cce46700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c815a940 0x7fe5c81554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.813 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.809+0000 7fe5c77fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5c815a030 0x7fe5c816b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59450/0 (socket says 172.21.15.175:59450) 2023-10-06T02:17:26.813 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.809+0000 7fe5c77fe700 1 -- 172.21.15.175:0/2424723916 learned_addr learned my addr 172.21.15.175:0/2424723916 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-10-06T02:17:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.809+0000 7fe5c7fff700 1 --2- 172.21.15.175:0/2424723916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c8087700 0x7fe5c816d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.809+0000 7fe5c77fe700 1 -- 172.21.15.175:0/2424723916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c815a940 msgr2=0x7fe5c81554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.809+0000 7fe5c77fe700 1 --2- 172.21.15.175:0/2424723916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c815a940 0x7fe5c81554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.810+0000 7fe5c77fe700 1 -- 172.21.15.175:0/2424723916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c8087700 msgr2=0x7fe5c816d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.810+0000 7fe5c77fe700 1 --2- 172.21.15.175:0/2424723916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c8087700 0x7fe5c816d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.810+0000 7fe5c77fe700 1 -- 172.21.15.175:0/2424723916 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc009420 con 0x7fe5c815a030 2023-10-06T02:17:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.810+0000 7fe5cce46700 1 --2- 172.21.15.175:0/2424723916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c815a940 0x7fe5c81554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.810+0000 7fe5c77fe700 1 --2- 172.21.15.175:0/2424723916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5c815a030 0x7fe5c816b690 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800c560 tx=0x7fe5b8007f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.810+0000 7fe5affff700 1 -- 172.21.15.175:0/2424723916 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8011590 con 0x7fe5c815a030 2023-10-06T02:17:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.810+0000 7fe5affff700 1 -- 172.21.15.175:0/2424723916 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b8011710 con 0x7fe5c815a030 2023-10-06T02:17:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.810+0000 7fe5ce8a9700 1 -- 172.21.15.175:0/2424723916 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c81546e0 con 0x7fe5c815a030 2023-10-06T02:17:26.815 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.810+0000 7fe5affff700 1 -- 172.21.15.175:0/2424723916 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8011ad0 con 0x7fe5c815a030 2023-10-06T02:17:26.815 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.810+0000 7fe5ce8a9700 1 -- 172.21.15.175:0/2424723916 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c8154a70 con 0x7fe5c815a030 2023-10-06T02:17:26.815 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.810+0000 7fe5affff700 1 -- 172.21.15.175:0/2424723916 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe5b8006aa0 con 0x7fe5c815a030 2023-10-06T02:17:26.815 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.810+0000 7fe5affff700 1 -- 172.21.15.175:0/2424723916 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fe5b8007690 con 0x7fe5c815a030 2023-10-06T02:17:26.815 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.811+0000 7fe5ce8a9700 1 -- 172.21.15.175:0/2424723916 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c8154870 con 0x7fe5c815a030 2023-10-06T02:17:26.815 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.813+0000 7fe5affff700 1 -- 172.21.15.175:0/2424723916 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe5b8017070 con 0x7fe5c815a030 2023-10-06T02:17:26.851 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:26.851+0000 7fda26bec180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T02:17:26.878 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:26.878+0000 7fae4d153180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T02:17:26.895 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.895+0000 7fe5ce8a9700 1 -- 172.21.15.175:0/2424723916 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3bf97848-ae01-464c-b917-16e3c79a5b9b", "id": 5} v 0) v1 -- 0x7fe5c80b04f0 con 0x7fe5c815a030 2023-10-06T02:17:26.901 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.901+0000 7fe5affff700 1 -- 172.21.15.175:0/2424723916 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3bf97848-ae01-464c-b917-16e3c79a5b9b", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe5b8007110 con 0x7fe5c815a030 2023-10-06T02:17:26.901 INFO:teuthology.orchestra.run.smithi175.stdout:5 2023-10-06T02:17:26.905 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.902+0000 7fe5ce8a9700 1 -- 172.21.15.175:0/2424723916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5c815a030 msgr2=0x7fe5c816b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:26.905 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.902+0000 7fe5ce8a9700 1 --2- 172.21.15.175:0/2424723916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5c815a030 0x7fe5c816b690 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800c560 tx=0x7fe5b8007f20 comp rx=0 tx=0).stop 2023-10-06T02:17:26.905 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.902+0000 7fe5ce8a9700 1 -- 172.21.15.175:0/2424723916 shutdown_connections 2023-10-06T02:17:26.905 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.902+0000 7fe5ce8a9700 1 --2- 172.21.15.175:0/2424723916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c815a940 0x7fe5c81554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.905 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.902+0000 7fe5ce8a9700 1 --2- 172.21.15.175:0/2424723916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c8087700 0x7fe5c816d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.905 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.902+0000 7fe5ce8a9700 1 --2- 172.21.15.175:0/2424723916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5c815a030 0x7fe5c816b690 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:26.906 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.902+0000 7fe5ce8a9700 1 -- 172.21.15.175:0/2424723916 >> 172.21.15.175:0/2424723916 conn(0x7fe5c8068680 msgr2=0x7fe5c80cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:26.906 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.902+0000 7fe5ce8a9700 1 -- 172.21.15.175:0/2424723916 shutdown_connections 2023-10-06T02:17:26.906 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:26.902+0000 7fe5ce8a9700 1 -- 172.21.15.175:0/2424723916 wait complete. 2023-10-06T02:17:26.915 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 3c10208f-a53c-4e01-adc8-88d62cdc60a7 6 2023-10-06T02:17:26.959 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:26.959+0000 7fae4d153180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T02:17:26.995 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:26.994+0000 7fda26bec180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T02:17:27.032 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.031+0000 7f6294e16700 1 Processor -- start 2023-10-06T02:17:27.032 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.031+0000 7f6294e16700 1 -- start start 2023-10-06T02:17:27.034 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.032+0000 7f6294e16700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6290086ff0 0x7f6290087440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:27.034 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.032+0000 7f6294e16700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6290087980 con 0x7f62900b21b0 2023-10-06T02:17:27.034 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.032+0000 7f6294e16700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62900afc50 con 0x7f629015a030 2023-10-06T02:17:27.034 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.032+0000 7f6294e16700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62900b0cf0 con 0x7f6290086ff0 2023-10-06T02:17:27.034 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.032+0000 7f628dd9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6290086ff0 0x7f6290087440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:27.034 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.032+0000 7f628e59c700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f629015a030 0x7f629015a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:36248/0 (socket says 172.21.15.175:36248) 2023-10-06T02:17:27.034 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.032+0000 7f628e59c700 1 -- 172.21.15.175:0/1992576376 learned_addr learned my addr 172.21.15.175:0/1992576376 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-10-06T02:17:27.035 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.032+0000 7f628d59a700 1 -- 172.21.15.175:0/1992576376 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107436871 0 0) 0x7f62900afc50 con 0x7f629015a030 2023-10-06T02:17:27.035 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.033+0000 7f628d59a700 1 -- 172.21.15.175:0/1992576376 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6278003570 con 0x7f629015a030 2023-10-06T02:17:27.035 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.033+0000 7f628dd9b700 1 -- 172.21.15.175:0/1992576376 >> v1:172.21.15.175:6789/0 conn(0x7f629015a030 legacy=0x7f629015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:27.035 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.033+0000 7f628dd9b700 1 -- 172.21.15.175:0/1992576376 >> v1:172.21.15.6:6789/0 conn(0x7f62900b21b0 legacy=0x7f62900b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:27.035 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.033+0000 7f628dd9b700 1 -- 172.21.15.175:0/1992576376 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62900aff30 con 0x7f6290086ff0 2023-10-06T02:17:27.035 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.033+0000 7f628dd9b700 1 --2- 172.21.15.175:0/1992576376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6290086ff0 0x7f6290087440 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6284009910 tx=0x7f62840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce941772fed204a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:27.035 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.033+0000 7f628d59a700 1 -- 172.21.15.175:0/1992576376 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628400b680 con 0x7f6290086ff0 2023-10-06T02:17:27.035 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.033+0000 7f628d59a700 1 -- 172.21.15.175:0/1992576376 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628400b7e0 con 0x7f6290086ff0 2023-10-06T02:17:27.035 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.033+0000 7f628d59a700 1 -- 172.21.15.175:0/1992576376 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628400bba0 con 0x7f6290086ff0 2023-10-06T02:17:27.035 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.033+0000 7f6294e16700 1 -- 172.21.15.175:0/1992576376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6290086ff0 msgr2=0x7f6290087440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:27.035 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.034+0000 7f6294e16700 1 --2- 172.21.15.175:0/1992576376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6290086ff0 0x7f6290087440 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6284009910 tx=0x7f62840091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.035 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.034+0000 7f6294e16700 1 -- 172.21.15.175:0/1992576376 shutdown_connections 2023-10-06T02:17:27.036 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.034+0000 7f6294e16700 1 --2- 172.21.15.175:0/1992576376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6290086ff0 0x7f6290087440 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.036 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.034+0000 7f6294e16700 1 -- 172.21.15.175:0/1992576376 >> 172.21.15.175:0/1992576376 conn(0x7f6290068680 msgr2=0x7f6290068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:27.036 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.034+0000 7f6294e16700 1 -- 172.21.15.175:0/1992576376 shutdown_connections 2023-10-06T02:17:27.036 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.034+0000 7f6294e16700 1 -- 172.21.15.175:0/1992576376 wait complete. 2023-10-06T02:17:27.038 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.035+0000 7f6294e16700 1 Processor -- start 2023-10-06T02:17:27.038 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.035+0000 7f6294e16700 1 -- start start 2023-10-06T02:17:27.038 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.035+0000 7f6294e16700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6290086ff0 0x7f6290169f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:27.038 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.035+0000 7f6294e16700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62900b21b0 0x7f6290155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:27.038 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.035+0000 7f6294e16700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f629015a030 0x7f629015c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:27.039 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.035+0000 7f6294e16700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62900c3cd0 con 0x7f629015a030 2023-10-06T02:17:27.039 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f6294e16700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6290156350 con 0x7f62900b21b0 2023-10-06T02:17:27.039 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f6294e16700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629016a5a0 con 0x7f6290086ff0 2023-10-06T02:17:27.039 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f628dd9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62900b21b0 0x7f6290155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:27.039 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f628e59c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6290086ff0 0x7f6290169f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:27.039 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f628dd9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62900b21b0 0x7f6290155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59456/0 (socket says 172.21.15.175:59456) 2023-10-06T02:17:27.039 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f628dd9b700 1 -- 172.21.15.175:0/3881931172 learned_addr learned my addr 172.21.15.175:0/3881931172 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-10-06T02:17:27.039 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f628ed9d700 1 --2- 172.21.15.175:0/3881931172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f629015a030 0x7f629015c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:27.039 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f628e59c700 1 -- 172.21.15.175:0/3881931172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62900b21b0 msgr2=0x7f6290155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:27.039 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f628e59c700 1 --2- 172.21.15.175:0/3881931172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62900b21b0 0x7f6290155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.039 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f628e59c700 1 -- 172.21.15.175:0/3881931172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f629015a030 msgr2=0x7f629015c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:27.040 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f628e59c700 1 --2- 172.21.15.175:0/3881931172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f629015a030 0x7f629015c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.040 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f628e59c700 1 -- 172.21.15.175:0/3881931172 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6284009420 con 0x7f6290086ff0 2023-10-06T02:17:27.040 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f628dd9b700 1 --2- 172.21.15.175:0/3881931172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62900b21b0 0x7f6290155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:27.040 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f628e59c700 1 --2- 172.21.15.175:0/3881931172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6290086ff0 0x7f6290169f70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f628000c560 tx=0x7f6280007d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:27.040 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f627e7fc700 1 -- 172.21.15.175:0/3881931172 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6280005b30 con 0x7f6290086ff0 2023-10-06T02:17:27.040 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f627e7fc700 1 -- 172.21.15.175:0/3881931172 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6280005cb0 con 0x7f6290086ff0 2023-10-06T02:17:27.040 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f627e7fc700 1 -- 172.21.15.175:0/3881931172 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6280007320 con 0x7f6290086ff0 2023-10-06T02:17:27.040 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f6294e16700 1 -- 172.21.15.175:0/3881931172 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629016a880 con 0x7f6290086ff0 2023-10-06T02:17:27.040 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f6294e16700 1 -- 172.21.15.175:0/3881931172 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629016ae40 con 0x7f6290086ff0 2023-10-06T02:17:27.040 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f627e7fc700 1 -- 172.21.15.175:0/3881931172 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f628001c6c0 con 0x7f6290086ff0 2023-10-06T02:17:27.040 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.036+0000 7f627e7fc700 1 -- 172.21.15.175:0/3881931172 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f6280005e20 con 0x7f6290086ff0 2023-10-06T02:17:27.040 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.037+0000 7f6294e16700 1 -- 172.21.15.175:0/3881931172 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6290088700 con 0x7f6290086ff0 2023-10-06T02:17:27.041 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.039+0000 7f627e7fc700 1 -- 172.21.15.175:0/3881931172 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6280017070 con 0x7f6290086ff0 2023-10-06T02:17:27.095 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:27.094+0000 7fda26bec180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T02:17:27.101 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:27.101+0000 7fae4d153180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T02:17:27.122 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.121+0000 7f6294e16700 1 -- 172.21.15.175:0/3881931172 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3c10208f-a53c-4e01-adc8-88d62cdc60a7", "id": 6} v 0) v1 -- 0x7f6290068420 con 0x7f6290086ff0 2023-10-06T02:17:27.125 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.125+0000 7f627e7fc700 1 -- 172.21.15.175:0/3881931172 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3c10208f-a53c-4e01-adc8-88d62cdc60a7", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6280007710 con 0x7f6290086ff0 2023-10-06T02:17:27.126 INFO:teuthology.orchestra.run.smithi175.stdout:6 2023-10-06T02:17:27.127 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.126+0000 7f6294e16700 1 -- 172.21.15.175:0/3881931172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6290086ff0 msgr2=0x7f6290169f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:27.127 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.126+0000 7f6294e16700 1 --2- 172.21.15.175:0/3881931172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6290086ff0 0x7f6290169f70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f628000c560 tx=0x7f6280007d50 comp rx=0 tx=0).stop 2023-10-06T02:17:27.127 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.126+0000 7f6294e16700 1 -- 172.21.15.175:0/3881931172 shutdown_connections 2023-10-06T02:17:27.127 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.126+0000 7f6294e16700 1 --2- 172.21.15.175:0/3881931172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f629015a030 0x7f629015c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.127 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.126+0000 7f6294e16700 1 --2- 172.21.15.175:0/3881931172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6290086ff0 0x7f6290169f70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.127 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.126+0000 7f6294e16700 1 --2- 172.21.15.175:0/3881931172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62900b21b0 0x7f6290155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.127 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.126+0000 7f6294e16700 1 -- 172.21.15.175:0/3881931172 >> 172.21.15.175:0/3881931172 conn(0x7f6290068680 msgr2=0x7f62900cafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:27.127 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.126+0000 7f6294e16700 1 -- 172.21.15.175:0/3881931172 shutdown_connections 2023-10-06T02:17:27.127 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.126+0000 7f6294e16700 1 -- 172.21.15.175:0/3881931172 wait complete. 2023-10-06T02:17:27.138 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 95f66d89-d412-4721-b9b4-5ae33fb762e1 7 2023-10-06T02:17:27.200 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:27.200+0000 7fae4d153180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T02:17:27.254 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.253+0000 7f4e0cc50700 1 Processor -- start 2023-10-06T02:17:27.254 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.253+0000 7f4e0cc50700 1 -- start start 2023-10-06T02:17:27.256 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.254+0000 7f4e0cc50700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4e081593f0 0x7f4e080ab720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:27.256 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.254+0000 7f4e0cc50700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e080a9d70 0x7f4e08068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:27.256 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.254+0000 7f4e0cc50700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e08067130 con 0x7f4e080a91f0 2023-10-06T02:17:27.256 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.254+0000 7f4e0cc50700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e080cce90 con 0x7f4e081593f0 2023-10-06T02:17:27.256 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.254+0000 7f4e0cc50700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e08069b80 con 0x7f4e080a9d70 2023-10-06T02:17:27.257 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.254+0000 7f4e077fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4e081593f0 0x7f4e080ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:27.257 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.254+0000 7f4e07fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e080a9d70 0x7f4e08068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:27.257 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.254+0000 7f4e06ffd700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4e080a91f0 0x7f4e080a9660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:36264/0 (socket says 172.21.15.175:36264) 2023-10-06T02:17:27.257 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.254+0000 7f4e06ffd700 1 -- 172.21.15.175:0/125426780 learned_addr learned my addr 172.21.15.175:0/125426780 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-10-06T02:17:27.257 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e077fe700 1 -- 172.21.15.175:0/125426780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e080a9d70 msgr2=0x7f4e08068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:27.257 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e077fe700 1 --2- 172.21.15.175:0/125426780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e080a9d70 0x7f4e08068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.257 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e077fe700 1 -- 172.21.15.175:0/125426780 >> v1:172.21.15.175:6789/0 conn(0x7f4e080a91f0 legacy=0x7f4e080a9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:27.257 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e077fe700 1 -- 172.21.15.175:0/125426780 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e080abc60 con 0x7f4e081593f0 2023-10-06T02:17:27.257 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e067fc700 1 -- 172.21.15.175:0/125426780 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967334870 0 0) 0x7f4e08067130 con 0x7f4e080a91f0 2023-10-06T02:17:27.257 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e07fff700 1 --2- 172.21.15.175:0/125426780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e080a9d70 0x7f4e08068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:27.257 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e077fe700 1 --2- 172.21.15.175:0/125426780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e081593f0 0x7f4e080ab720 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4df80098e0 tx=0x7f4df80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9dedcf3457f44bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:27.257 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e067fc700 1 -- 172.21.15.175:0/125426780 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800b640 con 0x7f4e081593f0 2023-10-06T02:17:27.258 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e067fc700 1 -- 172.21.15.175:0/125426780 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df800b7a0 con 0x7f4e081593f0 2023-10-06T02:17:27.258 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e067fc700 1 -- 172.21.15.175:0/125426780 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800bb40 con 0x7f4e081593f0 2023-10-06T02:17:27.258 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e0cc50700 1 -- 172.21.15.175:0/125426780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e081593f0 msgr2=0x7f4e080ab720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:27.258 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e0cc50700 1 --2- 172.21.15.175:0/125426780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e081593f0 0x7f4e080ab720 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4df80098e0 tx=0x7f4df80091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.258 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e0cc50700 1 -- 172.21.15.175:0/125426780 shutdown_connections 2023-10-06T02:17:27.258 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e0cc50700 1 --2- 172.21.15.175:0/125426780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e080a9d70 0x7f4e08068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.258 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e0cc50700 1 --2- 172.21.15.175:0/125426780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e081593f0 0x7f4e080ab720 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.258 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e0cc50700 1 -- 172.21.15.175:0/125426780 >> 172.21.15.175:0/125426780 conn(0x7f4e080af4c0 msgr2=0x7f4e080af8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:27.258 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e0cc50700 1 -- 172.21.15.175:0/125426780 shutdown_connections 2023-10-06T02:17:27.258 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.255+0000 7f4e0cc50700 1 -- 172.21.15.175:0/125426780 wait complete. 2023-10-06T02:17:27.261 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.257+0000 7f4e0cc50700 1 Processor -- start 2023-10-06T02:17:27.261 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.257+0000 7f4e0cc50700 1 -- start start 2023-10-06T02:17:27.261 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.257+0000 7f4e0cc50700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e080a91f0 0x7f4e08169fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:27.261 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.257+0000 7f4e0cc50700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080a9d70 0x7f4e08147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:27.261 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.257+0000 7f4e0cc50700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e081593f0 0x7f4e08068680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:27.261 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.257+0000 7f4e0cc50700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0816a510 con 0x7f4e080a9d70 2023-10-06T02:17:27.261 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.257+0000 7f4e0cc50700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e080cbb60 con 0x7f4e081593f0 2023-10-06T02:17:27.261 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.257+0000 7f4e0cc50700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e080caf50 con 0x7f4e080a91f0 2023-10-06T02:17:27.261 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.257+0000 7f4e077fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e080a91f0 0x7f4e08169fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:27.261 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.257+0000 7f4e077fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e080a91f0 0x7f4e08169fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:51902/0 (socket says 172.21.15.175:51902) 2023-10-06T02:17:27.261 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.257+0000 7f4e077fe700 1 -- 172.21.15.175:0/2153013224 learned_addr learned my addr 172.21.15.175:0/2153013224 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-10-06T02:17:27.262 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.258+0000 7f4e07fff700 1 --2- 172.21.15.175:0/2153013224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e081593f0 0x7f4e08068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:27.262 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.258+0000 7f4e06ffd700 1 --2- 172.21.15.175:0/2153013224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080a9d70 0x7f4e08147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:27.262 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.258+0000 7f4e077fe700 1 -- 172.21.15.175:0/2153013224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e081593f0 msgr2=0x7f4e08068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:27.262 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.258+0000 7f4e077fe700 1 --2- 172.21.15.175:0/2153013224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e081593f0 0x7f4e08068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.262 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.258+0000 7f4e077fe700 1 -- 172.21.15.175:0/2153013224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080a9d70 msgr2=0x7f4e08147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:27.262 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.258+0000 7f4e077fe700 1 --2- 172.21.15.175:0/2153013224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080a9d70 0x7f4e08147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.262 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.258+0000 7f4e077fe700 1 -- 172.21.15.175:0/2153013224 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e00009a20 con 0x7f4e080a91f0 2023-10-06T02:17:27.262 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.258+0000 7f4e077fe700 1 --2- 172.21.15.175:0/2153013224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e080a91f0 0x7f4e08169fd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4df80097b0 tx=0x7f4df8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:27.262 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.258+0000 7f4def7fe700 1 -- 172.21.15.175:0/2153013224 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df801f070 con 0x7f4e080a91f0 2023-10-06T02:17:27.262 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.258+0000 7f4def7fe700 1 -- 172.21.15.175:0/2153013224 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df8000c90 con 0x7f4e080a91f0 2023-10-06T02:17:27.262 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.258+0000 7f4e0cc50700 1 -- 172.21.15.175:0/2153013224 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df8009420 con 0x7f4e080a91f0 2023-10-06T02:17:27.263 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.258+0000 7f4def7fe700 1 -- 172.21.15.175:0/2153013224 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df8025420 con 0x7f4e080a91f0 2023-10-06T02:17:27.263 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.258+0000 7f4e0cc50700 1 -- 172.21.15.175:0/2153013224 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e080cb590 con 0x7f4e080a91f0 2023-10-06T02:17:27.263 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.258+0000 7f4def7fe700 1 -- 172.21.15.175:0/2153013224 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4df8023070 con 0x7f4e080a91f0 2023-10-06T02:17:27.263 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.258+0000 7f4def7fe700 1 -- 172.21.15.175:0/2153013224 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f4df8011a90 con 0x7f4e080a91f0 2023-10-06T02:17:27.263 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.259+0000 7f4e0cc50700 1 -- 172.21.15.175:0/2153013224 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e080cb910 con 0x7f4e080a91f0 2023-10-06T02:17:27.263 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.261+0000 7f4def7fe700 1 -- 172.21.15.175:0/2153013224 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4df802a070 con 0x7f4e080a91f0 2023-10-06T02:17:27.343 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.343+0000 7f4e0cc50700 1 -- 172.21.15.175:0/2153013224 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "95f66d89-d412-4721-b9b4-5ae33fb762e1", "id": 7} v 0) v1 -- 0x7f4e080cccd0 con 0x7f4e080a91f0 2023-10-06T02:17:27.352 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.352+0000 7f4def7fe700 1 -- 172.21.15.175:0/2153013224 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "95f66d89-d412-4721-b9b4-5ae33fb762e1", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4df8015020 con 0x7f4e080a91f0 2023-10-06T02:17:27.353 INFO:teuthology.orchestra.run.smithi175.stdout:7 2023-10-06T02:17:27.354 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.353+0000 7f4e0cc50700 1 -- 172.21.15.175:0/2153013224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e080a91f0 msgr2=0x7f4e08169fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:27.354 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.353+0000 7f4e0cc50700 1 --2- 172.21.15.175:0/2153013224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e080a91f0 0x7f4e08169fd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4df80097b0 tx=0x7f4df8017000 comp rx=0 tx=0).stop 2023-10-06T02:17:27.354 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.353+0000 7f4e0cc50700 1 -- 172.21.15.175:0/2153013224 shutdown_connections 2023-10-06T02:17:27.354 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.353+0000 7f4e0cc50700 1 --2- 172.21.15.175:0/2153013224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e081593f0 0x7f4e08068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.354 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.353+0000 7f4e0cc50700 1 --2- 172.21.15.175:0/2153013224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e080a91f0 0x7f4e08169fd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.354 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.353+0000 7f4e0cc50700 1 --2- 172.21.15.175:0/2153013224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080a9d70 0x7f4e08147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.354 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.353+0000 7f4e0cc50700 1 -- 172.21.15.175:0/2153013224 >> 172.21.15.175:0/2153013224 conn(0x7f4e080af4c0 msgr2=0x7f4e08158430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:27.355 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.353+0000 7f4e0cc50700 1 -- 172.21.15.175:0/2153013224 shutdown_connections 2023-10-06T02:17:27.355 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-06T02:17:27.353+0000 7f4e0cc50700 1 -- 172.21.15.175:0/2153013224 wait complete. 2023-10-06T02:17:27.366 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T02:17:27.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T02:17:27.368 INFO:tasks.ceph.osd.0:Started 2023-10-06T02:17:27.368 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T02:17:27.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T02:17:27.371 INFO:tasks.ceph.osd.1:Started 2023-10-06T02:17:27.371 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T02:17:27.371 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T02:17:27.373 INFO:tasks.ceph.osd.2:Started 2023-10-06T02:17:27.373 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T02:17:27.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T02:17:27.375 INFO:tasks.ceph.osd.3:Started 2023-10-06T02:17:27.375 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T02:17:27.375 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T02:17:27.378 INFO:tasks.ceph.osd.4:Started 2023-10-06T02:17:27.378 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T02:17:27.378 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T02:17:27.380 INFO:tasks.ceph.osd.5:Started 2023-10-06T02:17:27.380 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T02:17:27.380 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T02:17:27.382 INFO:tasks.ceph.osd.6:Started 2023-10-06T02:17:27.383 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T02:17:27.383 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T02:17:27.385 INFO:tasks.ceph.osd.7:Started 2023-10-06T02:17:27.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:17:27.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.536+0000 7f21a6de5700 1 Processor -- start 2023-10-06T02:17:27.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.536+0000 7f21a6de5700 1 -- start start 2023-10-06T02:17:27.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.536+0000 7f21a6de5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f21a0140040 0x7f21a0161600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:27.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.536+0000 7f21a6de5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a00ca3e0 con 0x7f21a00cd6e0 2023-10-06T02:17:27.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.536+0000 7f21a6de5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a00c3140 con 0x7f21a00c78d0 2023-10-06T02:17:27.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.536+0000 7f21a6de5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a00c95c0 con 0x7f21a0140040 2023-10-06T02:17:27.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.537+0000 7f219ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f21a00cd6e0 0x7f21a013f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38368/0 (socket says 172.21.15.6:38368) 2023-10-06T02:17:27.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.537+0000 7f219ffff700 1 -- 172.21.15.6:0/343307275 learned_addr learned my addr 172.21.15.6:0/343307275 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:27.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.537+0000 7f21a5382700 1 --2- 172.21.15.6:0/343307275 >> v2:172.21.15.175:3300/0 conn(0x7f21a0140040 0x7f21a0161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:27.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.537+0000 7f219f7fe700 1 -- 172.21.15.6:0/343307275 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190957432 0 0) 0x7f21a00ca3e0 con 0x7f21a00cd6e0 2023-10-06T02:17:27.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.537+0000 7f219f7fe700 1 -- 172.21.15.6:0/343307275 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2190003570 con 0x7f21a00cd6e0 2023-10-06T02:17:27.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.537+0000 7f21a5382700 1 -- 172.21.15.6:0/343307275 >> v1:172.21.15.175:6789/0 conn(0x7f21a00c78d0 legacy=0x7f21a00ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:27.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.537+0000 7f21a5382700 1 -- 172.21.15.6:0/343307275 >> v1:172.21.15.6:6789/0 conn(0x7f21a00cd6e0 legacy=0x7f21a013f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:27.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.537+0000 7f21a5382700 1 -- 172.21.15.6:0/343307275 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a00c97d0 con 0x7f21a0140040 2023-10-06T02:17:27.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.537+0000 7f21a5382700 1 --2- 172.21.15.6:0/343307275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21a0140040 0x7f21a0161600 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2198009e60 tx=0x7f2198009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=990552b2f4dde93f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:27.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.537+0000 7f219f7fe700 1 -- 172.21.15.6:0/343307275 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219800bb60 con 0x7f21a0140040 2023-10-06T02:17:27.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.537+0000 7f219f7fe700 1 -- 172.21.15.6:0/343307275 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219800bcc0 con 0x7f21a0140040 2023-10-06T02:17:27.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.537+0000 7f219f7fe700 1 -- 172.21.15.6:0/343307275 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21980116b0 con 0x7f21a0140040 2023-10-06T02:17:27.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.538+0000 7f21a6de5700 1 -- 172.21.15.6:0/343307275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21a0140040 msgr2=0x7f21a0161600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:27.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.538+0000 7f21a6de5700 1 --2- 172.21.15.6:0/343307275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21a0140040 0x7f21a0161600 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2198009e60 tx=0x7f2198009780 comp rx=0 tx=0).stop 2023-10-06T02:17:27.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.538+0000 7f21a6de5700 1 -- 172.21.15.6:0/343307275 shutdown_connections 2023-10-06T02:17:27.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.538+0000 7f21a6de5700 1 --2- 172.21.15.6:0/343307275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21a0140040 0x7f21a0161600 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.538+0000 7f21a6de5700 1 -- 172.21.15.6:0/343307275 >> 172.21.15.6:0/343307275 conn(0x7f21a0069790 msgr2=0x7f21a0069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:27.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.538+0000 7f21a6de5700 1 -- 172.21.15.6:0/343307275 shutdown_connections 2023-10-06T02:17:27.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.538+0000 7f21a6de5700 1 -- 172.21.15.6:0/343307275 wait complete. 2023-10-06T02:17:27.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.539+0000 7f21a6de5700 1 Processor -- start 2023-10-06T02:17:27.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.540+0000 7f21a6de5700 1 -- start start 2023-10-06T02:17:27.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.540+0000 7f21a6de5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21a00c78d0 0x7f21a00c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:27.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.540+0000 7f21a6de5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21a00cd6e0 0x7f21a0138020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:27.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.540+0000 7f21a6de5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21a0140040 0x7f21a00b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:27.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.540+0000 7f21a6de5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a01394d0 con 0x7f21a00cd6e0 2023-10-06T02:17:27.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.540+0000 7f21a6de5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a01388c0 con 0x7f21a00c78d0 2023-10-06T02:17:27.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.540+0000 7f21a6de5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a0138ba0 con 0x7f21a0140040 2023-10-06T02:17:27.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.540+0000 7f219ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21a00cd6e0 0x7f21a0138020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:27.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.540+0000 7f219ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21a00cd6e0 0x7f21a0138020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35008/0 (socket says 172.21.15.6:35008) 2023-10-06T02:17:27.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.540+0000 7f219ffff700 1 -- 172.21.15.6:0/2969258111 learned_addr learned my addr 172.21.15.6:0/2969258111 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:27.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.540+0000 7f21a4b81700 1 --2- 172.21.15.6:0/2969258111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21a00c78d0 0x7f21a00c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:27.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.541+0000 7f21a5382700 1 --2- 172.21.15.6:0/2969258111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21a0140040 0x7f21a00b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:27.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.541+0000 7f219ffff700 1 -- 172.21.15.6:0/2969258111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21a0140040 msgr2=0x7f21a00b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:27.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.541+0000 7f219ffff700 1 --2- 172.21.15.6:0/2969258111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21a0140040 0x7f21a00b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.541+0000 7f219ffff700 1 -- 172.21.15.6:0/2969258111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21a00c78d0 msgr2=0x7f21a00c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.541+0000 7f219ffff700 1 --2- 172.21.15.6:0/2969258111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21a00c78d0 0x7f21a00c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.541+0000 7f219ffff700 1 -- 172.21.15.6:0/2969258111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2198009a20 con 0x7f21a00cd6e0 2023-10-06T02:17:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.541+0000 7f219ffff700 1 --2- 172.21.15.6:0/2969258111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21a00cd6e0 0x7f21a0138020 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f218c00c7c0 tx=0x7f218c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.541+0000 7f219cff9700 1 -- 172.21.15.6:0/2969258111 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c005cd0 con 0x7f21a00cd6e0 2023-10-06T02:17:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.541+0000 7f219cff9700 1 -- 172.21.15.6:0/2969258111 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c005e30 con 0x7f21a00cd6e0 2023-10-06T02:17:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.541+0000 7f21a6de5700 1 -- 172.21.15.6:0/2969258111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a0138e80 con 0x7f21a00cd6e0 2023-10-06T02:17:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.541+0000 7f219cff9700 1 -- 172.21.15.6:0/2969258111 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c007320 con 0x7f21a00cd6e0 2023-10-06T02:17:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.541+0000 7f21a6de5700 1 -- 172.21.15.6:0/2969258111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a0138560 con 0x7f21a00cd6e0 2023-10-06T02:17:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.541+0000 7f219cff9700 1 -- 172.21.15.6:0/2969258111 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f218c01c6c0 con 0x7f21a00cd6e0 2023-10-06T02:17:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.541+0000 7f219cff9700 1 -- 172.21.15.6:0/2969258111 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f218c007720 con 0x7f21a00cd6e0 2023-10-06T02:17:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.542+0000 7f21a6de5700 1 -- 172.21.15.6:0/2969258111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a0139640 con 0x7f21a00cd6e0 2023-10-06T02:17:27.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.544+0000 7f219cff9700 1 -- 172.21.15.6:0/2969258111 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f218c017070 con 0x7f21a00cd6e0 2023-10-06T02:17:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.615+0000 7f21a6de5700 1 -- 172.21.15.6:0/2969258111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21a015b100 con 0x7f21a00cd6e0 2023-10-06T02:17:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.615+0000 7f219cff9700 1 -- 172.21.15.6:0/2969258111 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f218c01cc60 con 0x7f21a00cd6e0 2023-10-06T02:17:27.615 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:27.616 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:27.345038+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:17:27.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.616+0000 7f21a6de5700 1 -- 172.21.15.6:0/2969258111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21a00cd6e0 msgr2=0x7f21a0138020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:27.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.616+0000 7f21a6de5700 1 --2- 172.21.15.6:0/2969258111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21a00cd6e0 0x7f21a0138020 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f218c00c7c0 tx=0x7f218c007e00 comp rx=0 tx=0).stop 2023-10-06T02:17:27.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.616+0000 7f21a6de5700 1 -- 172.21.15.6:0/2969258111 shutdown_connections 2023-10-06T02:17:27.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.616+0000 7f21a6de5700 1 --2- 172.21.15.6:0/2969258111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21a0140040 0x7f21a00b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.616+0000 7f21a6de5700 1 --2- 172.21.15.6:0/2969258111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21a00c78d0 0x7f21a00c4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.616+0000 7f21a6de5700 1 --2- 172.21.15.6:0/2969258111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21a00cd6e0 0x7f21a0138020 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:27.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.616+0000 7f21a6de5700 1 -- 172.21.15.6:0/2969258111 >> 172.21.15.6:0/2969258111 conn(0x7f21a0069790 msgr2=0x7f21a013edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:27.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.616+0000 7f21a6de5700 1 -- 172.21.15.6:0/2969258111 shutdown_connections 2023-10-06T02:17:27.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:27.616+0000 7f21a6de5700 1 -- 172.21.15.6:0/2969258111 wait complete. 2023-10-06T02:17:27.628 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T02:17:27.628 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T02:17:27.641 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:27.641+0000 7fda26bec180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T02:17:27.721 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:27.718+0000 7fda26bec180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T02:17:27.752 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:27.752+0000 7fae4d153180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T02:17:27.798 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:27.797+0000 7fda26bec180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T02:17:27.833 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:27.833+0000 7fae4d153180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T02:17:27.914 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:27.914+0000 7fae4d153180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T02:17:27.971 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-10-06T02:17:27.971+0000 7f9a411b2540 -1 Falling back to public interface 2023-10-06T02:17:27.979 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-10-06T02:17:27.978+0000 7f22e3dee540 -1 Falling back to public interface 2023-10-06T02:17:27.979 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-10-06T02:17:27.979+0000 7f390ae9c540 -1 Falling back to public interface 2023-10-06T02:17:27.982 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-10-06T02:17:27.982+0000 7f5471158540 -1 Falling back to public interface 2023-10-06T02:17:27.983 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-10-06T02:17:27.983+0000 7f2df0ee4540 -1 Falling back to public interface 2023-10-06T02:17:27.985 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-10-06T02:17:27.985+0000 7f0a21dd9540 -1 Falling back to public interface 2023-10-06T02:17:27.991 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-10-06T02:17:27.991+0000 7f1e0935b540 -1 Falling back to public interface 2023-10-06T02:17:28.009 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-10-06T02:17:28.008+0000 7fada07cb540 -1 Falling back to public interface 2023-10-06T02:17:28.384 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:28.383+0000 7fda26bec180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T02:17:28.434 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T02:17:28.520 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:28.520+0000 7fda26bec180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:17:28.582 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.582+0000 7fc7b3b76700 1 Processor -- start 2023-10-06T02:17:28.582 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.582+0000 7fc7b3b76700 1 -- start start 2023-10-06T02:17:28.584 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.583+0000 7fc7b3b76700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc7ac1576b0 0x7fc7ac0cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:28.584 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.583+0000 7fc7b3b76700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7ac0b0ee0 0x7fc7ac0b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:28.584 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.583+0000 7fc7b3b76700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ac0cce40 con 0x7fc7ac157a80 2023-10-06T02:17:28.584 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.583+0000 7fc7b3b76700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ac0c9d60 con 0x7fc7ac1576b0 2023-10-06T02:17:28.584 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.583+0000 7fc7b3b76700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac0cc600 con 0x7fc7ac0b0ee0 2023-10-06T02:17:28.584 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.583+0000 7fc7b1912700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc7ac1576b0 0x7fc7ac0cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:28.584 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.583+0000 7fc7b2113700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7ac0b0ee0 0x7fc7ac0b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:28.584 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.583+0000 7fc7b1111700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc7ac157a80 0x7fc7ac0cd2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:53886/0 (socket says 172.21.15.6:53886) 2023-10-06T02:17:28.584 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.583+0000 7fc7b1111700 1 -- 172.21.15.6:0/3694147542 learned_addr learned my addr 172.21.15.6:0/3694147542 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:28.584 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.583+0000 7fc7b0910700 1 -- 172.21.15.6:0/3694147542 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138901478 0 0) 0x7fc7ac0cce40 con 0x7fc7ac157a80 2023-10-06T02:17:28.584 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.583+0000 7fc7b0910700 1 -- 172.21.15.6:0/3694147542 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc798003570 con 0x7fc7ac157a80 2023-10-06T02:17:28.585 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.583+0000 7fc7b2113700 1 -- 172.21.15.6:0/3694147542 >> v2:172.21.15.175:3300/0 conn(0x7fc7ac1576b0 msgr2=0x7fc7ac0cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:28.585 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.583+0000 7fc7b2113700 1 --2- 172.21.15.6:0/3694147542 >> v2:172.21.15.175:3300/0 conn(0x7fc7ac1576b0 0x7fc7ac0cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:28.585 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.583+0000 7fc7b2113700 1 -- 172.21.15.6:0/3694147542 >> v1:172.21.15.175:6789/0 conn(0x7fc7ac157a80 legacy=0x7fc7ac0cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:28.585 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.583+0000 7fc7b2113700 1 -- 172.21.15.6:0/3694147542 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac0cef70 con 0x7fc7ac0b0ee0 2023-10-06T02:17:28.585 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.583+0000 7fc7b2113700 1 --2- 172.21.15.6:0/3694147542 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7ac0b0ee0 0x7fc7ac0b1340 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009e60 tx=0x7fc7a4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f3056071fffcad9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:28.585 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.584+0000 7fc7b0910700 1 -- 172.21.15.6:0/3694147542 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a400e070 con 0x7fc7ac0b0ee0 2023-10-06T02:17:28.585 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.584+0000 7fc7b0910700 1 -- 172.21.15.6:0/3694147542 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a400bab0 con 0x7fc7ac0b0ee0 2023-10-06T02:17:28.585 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.584+0000 7fc7b0910700 1 -- 172.21.15.6:0/3694147542 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a400be70 con 0x7fc7ac0b0ee0 2023-10-06T02:17:28.587 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.584+0000 7fc7b3b76700 1 -- 172.21.15.6:0/3694147542 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7ac0b0ee0 msgr2=0x7fc7ac0b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:28.588 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.584+0000 7fc7b3b76700 1 --2- 172.21.15.6:0/3694147542 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7ac0b0ee0 0x7fc7ac0b1340 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009e60 tx=0x7fc7a4009780 comp rx=0 tx=0).stop 2023-10-06T02:17:28.588 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.584+0000 7fc7b3b76700 1 -- 172.21.15.6:0/3694147542 shutdown_connections 2023-10-06T02:17:28.588 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.584+0000 7fc7b3b76700 1 --2- 172.21.15.6:0/3694147542 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7ac0b0ee0 0x7fc7ac0b1340 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:28.588 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.584+0000 7fc7b3b76700 1 --2- 172.21.15.6:0/3694147542 >> v2:172.21.15.175:3300/0 conn(0x7fc7ac1576b0 0x7fc7ac0cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:28.588 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.584+0000 7fc7b3b76700 1 -- 172.21.15.6:0/3694147542 >> 172.21.15.6:0/3694147542 conn(0x7fc7ac067910 msgr2=0x7fc7ac0ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:28.588 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.584+0000 7fc7b3b76700 1 -- 172.21.15.6:0/3694147542 shutdown_connections 2023-10-06T02:17:28.588 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.584+0000 7fc7b3b76700 1 -- 172.21.15.6:0/3694147542 wait complete. 2023-10-06T02:17:28.588 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.585+0000 7fc7b3b76700 1 Processor -- start 2023-10-06T02:17:28.588 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.585+0000 7fc7b3b76700 1 -- start start 2023-10-06T02:17:28.588 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.586+0000 7fc7b3b76700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7ac0b0ee0 0x7fc7ac152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:28.588 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.586+0000 7fc7b3b76700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7ac1576b0 0x7fc7ac167bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:28.589 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.586+0000 7fc7b3b76700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7ac157a80 0x7fc7ac168100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:28.589 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.586+0000 7fc7b3b76700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac151ed0 con 0x7fc7ac1576b0 2023-10-06T02:17:28.589 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.586+0000 7fc7b3b76700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac1512c0 con 0x7fc7ac0b0ee0 2023-10-06T02:17:28.589 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.586+0000 7fc7b3b76700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac1515a0 con 0x7fc7ac157a80 2023-10-06T02:17:28.589 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.586+0000 7fc7b1111700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7ac1576b0 0x7fc7ac167bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:28.589 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.586+0000 7fc7b1111700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7ac1576b0 0x7fc7ac167bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35012/0 (socket says 172.21.15.6:35012) 2023-10-06T02:17:28.589 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.586+0000 7fc7b1111700 1 -- 172.21.15.6:0/1468569067 learned_addr learned my addr 172.21.15.6:0/1468569067 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:28.589 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.586+0000 7fc7b1912700 1 --2- 172.21.15.6:0/1468569067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7ac0b0ee0 0x7fc7ac152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:28.589 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.586+0000 7fc7b2113700 1 --2- 172.21.15.6:0/1468569067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7ac157a80 0x7fc7ac168100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:28.589 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.587+0000 7fc7b1111700 1 -- 172.21.15.6:0/1468569067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7ac157a80 msgr2=0x7fc7ac168100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:28.589 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.587+0000 7fc7b1111700 1 --2- 172.21.15.6:0/1468569067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7ac157a80 0x7fc7ac168100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:28.590 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.587+0000 7fc7b1111700 1 -- 172.21.15.6:0/1468569067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7ac0b0ee0 msgr2=0x7fc7ac152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:28.590 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.587+0000 7fc7b1111700 1 --2- 172.21.15.6:0/1468569067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7ac0b0ee0 0x7fc7ac152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:28.590 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.587+0000 7fc7b1111700 1 -- 172.21.15.6:0/1468569067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a4009a20 con 0x7fc7ac1576b0 2023-10-06T02:17:28.590 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.587+0000 7fc7b2113700 1 --2- 172.21.15.6:0/1468569067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7ac157a80 0x7fc7ac168100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:28.590 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.587+0000 7fc7b1111700 1 --2- 172.21.15.6:0/1468569067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7ac1576b0 0x7fc7ac167bc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800c7c0 tx=0x7fc7a8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:28.590 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.587+0000 7fc7a1ffb700 1 -- 172.21.15.6:0/1468569067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8005cd0 con 0x7fc7ac1576b0 2023-10-06T02:17:28.590 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.587+0000 7fc7a1ffb700 1 -- 172.21.15.6:0/1468569067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a8005e30 con 0x7fc7ac1576b0 2023-10-06T02:17:28.590 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.587+0000 7fc7b3b76700 1 -- 172.21.15.6:0/1468569067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ac151880 con 0x7fc7ac1576b0 2023-10-06T02:17:28.590 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.587+0000 7fc7a1ffb700 1 -- 172.21.15.6:0/1468569067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8007320 con 0x7fc7ac1576b0 2023-10-06T02:17:28.590 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.587+0000 7fc7a1ffb700 1 -- 172.21.15.6:0/1468569067 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc7a8012680 con 0x7fc7ac1576b0 2023-10-06T02:17:28.590 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.587+0000 7fc7b3b76700 1 -- 172.21.15.6:0/1468569067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ac1528a0 con 0x7fc7ac1576b0 2023-10-06T02:17:28.590 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.587+0000 7fc7a1ffb700 1 -- 172.21.15.6:0/1468569067 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fc7a801ba90 con 0x7fc7ac1576b0 2023-10-06T02:17:28.591 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.588+0000 7fc7b3b76700 1 -- 172.21.15.6:0/1468569067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7ac087170 con 0x7fc7ac1576b0 2023-10-06T02:17:28.591 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.590+0000 7fc7a1ffb700 1 -- 172.21.15.6:0/1468569067 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc7a8021060 con 0x7fc7ac1576b0 2023-10-06T02:17:28.620 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:28.620+0000 7fda26bec180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T02:17:28.641 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:28.641+0000 7fae4d153180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T02:17:28.730 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.730+0000 7fc7b3b76700 1 -- 172.21.15.6:0/1468569067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7ac152040 con 0x7fc7ac1576b0 2023-10-06T02:17:28.731 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.731+0000 7fc7a1ffb700 1 -- 172.21.15.6:0/1468569067 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fc7a8017070 con 0x7fc7ac1576b0 2023-10-06T02:17:28.731 INFO:teuthology.misc.health.smithi006.stdout: 2023-10-06T02:17:28.731 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":10,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:27.345038+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:17:28.732 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.732+0000 7fc7b3b76700 1 -- 172.21.15.6:0/1468569067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7ac1576b0 msgr2=0x7fc7ac167bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:28.732 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.732+0000 7fc7b3b76700 1 --2- 172.21.15.6:0/1468569067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7ac1576b0 0x7fc7ac167bc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800c7c0 tx=0x7fc7a8007e00 comp rx=0 tx=0).stop 2023-10-06T02:17:28.732 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.732+0000 7fc7b3b76700 1 -- 172.21.15.6:0/1468569067 shutdown_connections 2023-10-06T02:17:28.733 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.732+0000 7fc7b3b76700 1 --2- 172.21.15.6:0/1468569067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7ac157a80 0x7fc7ac168100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:28.733 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.732+0000 7fc7b3b76700 1 --2- 172.21.15.6:0/1468569067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7ac0b0ee0 0x7fc7ac152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:28.733 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.732+0000 7fc7b3b76700 1 --2- 172.21.15.6:0/1468569067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7ac1576b0 0x7fc7ac167bc0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:28.733 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.732+0000 7fc7b3b76700 1 -- 172.21.15.6:0/1468569067 >> 172.21.15.6:0/1468569067 conn(0x7fc7ac067910 msgr2=0x7fc7ac06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:28.733 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.732+0000 7fc7b3b76700 1 -- 172.21.15.6:0/1468569067 shutdown_connections 2023-10-06T02:17:28.733 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:28.732+0000 7fc7b3b76700 1 -- 172.21.15.6:0/1468569067 wait complete. 2023-10-06T02:17:28.743 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T02:17:28.818 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:28.818+0000 7fae4d153180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:17:28.873 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:28.872+0000 7fda26bec180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T02:17:28.909 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:28.909+0000 7fae4d153180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T02:17:28.949 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:28.949+0000 7fda26bec180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T02:17:29.167 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:29.167+0000 7fae4d153180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T02:17:29.247 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:29.247+0000 7fae4d153180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T02:17:29.770 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:29.768+0000 7fda26bec180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T02:17:29.841 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:29.841+0000 7fda26bec180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T02:17:29.916 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:29.916+0000 7fda26bec180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T02:17:30.047 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:30.047+0000 7fda26bec180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T02:17:30.113 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:30.113+0000 7fae4d153180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T02:17:30.131 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:30.130+0000 7fda26bec180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T02:17:30.190 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:30.190+0000 7fae4d153180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T02:17:30.271 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:30.271+0000 7fae4d153180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T02:17:30.285 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:30.284+0000 7fda26bec180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T02:17:30.361 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:30.360+0000 7fda26bec180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T02:17:30.410 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:30.410+0000 7fae4d153180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T02:17:30.437 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:30.436+0000 7fda26bec180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T02:17:30.506 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:30.506+0000 7fae4d153180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T02:17:30.533 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:30.533+0000 7fda26bec180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T02:17:30.666 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:30.666+0000 7fae4d153180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T02:17:30.773 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:30.773+0000 7fae4d153180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T02:17:30.878 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:30.878+0000 7fae4d153180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T02:17:30.957 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-06T02:17:30.957+0000 7fae4d153180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T02:17:31.227 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-10-06T02:17:31.227+0000 7f22e3dee540 -1 osd.5 0 log_to_monitors true 2023-10-06T02:17:31.254 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-10-06T02:17:31.253+0000 7f5471158540 -1 osd.4 0 log_to_monitors true 2023-10-06T02:17:31.463 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-10-06T02:17:31.463+0000 7f9a411b2540 -1 osd.1 0 log_to_monitors true 2023-10-06T02:17:31.495 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-10-06T02:17:31.495+0000 7f2df0ee4540 -1 osd.6 0 log_to_monitors true 2023-10-06T02:17:31.500 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-10-06T02:17:31.501+0000 7f390ae9c540 -1 osd.2 0 log_to_monitors true 2023-10-06T02:17:31.504 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-10-06T02:17:31.504+0000 7f0a21dd9540 -1 osd.0 0 log_to_monitors true 2023-10-06T02:17:31.509 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-10-06T02:17:31.509+0000 7f1e0935b540 -1 osd.3 0 log_to_monitors true 2023-10-06T02:17:31.516 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-10-06T02:17:31.516+0000 7fada07cb540 -1 osd.7 0 log_to_monitors true 2023-10-06T02:17:31.558 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:31.557+0000 7fd9dffed700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T02:17:31.560 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-10-06T02:17:31.560+0000 7fd9dffed700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T02:17:34.719 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-10-06T02:17:34.718+0000 7f546957d700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T02:17:34.723 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-10-06T02:17:34.722+0000 7f5460b71700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:17:34.731 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-10-06T02:17:34.731+0000 7f3901abe700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T02:17:34.745 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-10-06T02:17:34.743+0000 7f38fa8b5700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:17:34.751 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-10-06T02:17:34.750+0000 7f1dfff7d700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T02:17:34.754 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-10-06T02:17:34.749+0000 7f22daa10700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T02:17:34.754 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-10-06T02:17:34.754+0000 7f1df8d74700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:17:34.755 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-10-06T02:17:34.754+0000 7f22d3807700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:17:34.759 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-10-06T02:17:34.759+0000 7f9a37dd4700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T02:17:34.762 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-10-06T02:17:34.762+0000 7f0a1a1fe700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T02:17:34.766 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-10-06T02:17:34.766+0000 7f9a30bcb700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:17:34.767 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-10-06T02:17:34.767+0000 7f0a117f2700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:17:34.793 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-10-06T02:17:34.792+0000 7fad973ed700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T02:17:34.798 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-10-06T02:17:34.797+0000 7fad901e4700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:17:34.818 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-10-06T02:17:34.817+0000 7f2de7b06700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T02:17:34.825 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-10-06T02:17:34.823+0000 7f2de08fd700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:17:35.551 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T02:17:35.673 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.673+0000 7ff6c2e1f700 1 Processor -- start 2023-10-06T02:17:35.673 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.673+0000 7ff6c2e1f700 1 -- start start 2023-10-06T02:17:35.675 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6c2e1f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6bc1570b0 0x7ff6bc06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:35.676 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6c2e1f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff6bc06e7e0 0x7ff6bc06c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:35.676 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6c2e1f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6bc06ec40 con 0x7ff6bc156ce0 2023-10-06T02:17:35.676 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6c2e1f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6bc06be50 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.676 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6c2e1f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc0cb0c0 con 0x7ff6bc1570b0 2023-10-06T02:17:35.676 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6c13bc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff6bc06e7e0 0x7ff6bc06c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:35.676 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6c0bbb700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff6bc156ce0 0x7ff6bc0ca9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33986/0 (socket says 172.21.15.6:33986) 2023-10-06T02:17:35.676 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6c0bbb700 1 -- 172.21.15.6:0/4262393337 learned_addr learned my addr 172.21.15.6:0/4262393337 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:35.676 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6bbfff700 1 --2- 172.21.15.6:0/4262393337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6bc1570b0 0x7ff6bc06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:35.676 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6bb7fe700 1 -- 172.21.15.6:0/4262393337 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199182751 0 0) 0x7ff6ac001110 con 0x7ff6bc156ce0 2023-10-06T02:17:35.676 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6bb7fe700 1 -- 172.21.15.6:0/4262393337 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6a8003570 con 0x7ff6bc156ce0 2023-10-06T02:17:35.676 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6c13bc700 1 -- 172.21.15.6:0/4262393337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6bc1570b0 msgr2=0x7ff6bc06e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:35.677 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6c13bc700 1 --2- 172.21.15.6:0/4262393337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6bc1570b0 0x7ff6bc06e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:35.677 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6c13bc700 1 -- 172.21.15.6:0/4262393337 >> v1:172.21.15.6:6789/0 conn(0x7ff6bc156ce0 legacy=0x7ff6bc0ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:35.677 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6c13bc700 1 -- 172.21.15.6:0/4262393337 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc0cedc0 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.677 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6c13bc700 1 --2- 172.21.15.6:0/4262393337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc06e7e0 0x7ff6bc06c2e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009e60 tx=0x7ff6b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8503da8c6bf56619 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:35.677 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6bb7fe700 1 -- 172.21.15.6:0/4262393337 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b400e070 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.677 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6bb7fe700 1 -- 172.21.15.6:0/4262393337 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b400bab0 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.677 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.674+0000 7ff6bb7fe700 1 -- 172.21.15.6:0/4262393337 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b400be70 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.677 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.675+0000 7ff6c2e1f700 1 -- 172.21.15.6:0/4262393337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc06e7e0 msgr2=0x7ff6bc06c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:35.677 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.675+0000 7ff6c2e1f700 1 --2- 172.21.15.6:0/4262393337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc06e7e0 0x7ff6bc06c2e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009e60 tx=0x7ff6b4009780 comp rx=0 tx=0).stop 2023-10-06T02:17:35.677 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.675+0000 7ff6c2e1f700 1 -- 172.21.15.6:0/4262393337 shutdown_connections 2023-10-06T02:17:35.677 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.675+0000 7ff6c2e1f700 1 --2- 172.21.15.6:0/4262393337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc06e7e0 0x7ff6bc06c2e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:35.677 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.675+0000 7ff6c2e1f700 1 --2- 172.21.15.6:0/4262393337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6bc1570b0 0x7ff6bc06e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:35.677 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.675+0000 7ff6c2e1f700 1 -- 172.21.15.6:0/4262393337 >> 172.21.15.6:0/4262393337 conn(0x7ff6bc0d0370 msgr2=0x7ff6bc0d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:35.678 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.675+0000 7ff6c2e1f700 1 -- 172.21.15.6:0/4262393337 shutdown_connections 2023-10-06T02:17:35.678 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.675+0000 7ff6c2e1f700 1 -- 172.21.15.6:0/4262393337 wait complete. 2023-10-06T02:17:35.680 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.676+0000 7ff6c2e1f700 1 Processor -- start 2023-10-06T02:17:35.680 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.676+0000 7ff6c2e1f700 1 -- start start 2023-10-06T02:17:35.681 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.677+0000 7ff6c2e1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc06e7e0 0x7ff6bc16a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:35.681 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.677+0000 7ff6c2e1f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6bc156ce0 0x7ff6bc154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:35.681 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.677+0000 7ff6c2e1f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6bc1570b0 0x7ff6bc159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:35.681 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.677+0000 7ff6c2e1f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc0b3a70 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.681 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.677+0000 7ff6c2e1f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc16a3c0 con 0x7ff6bc1570b0 2023-10-06T02:17:35.681 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.677+0000 7ff6c2e1f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc0b3420 con 0x7ff6bc156ce0 2023-10-06T02:17:35.681 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.677+0000 7ff6c0bbb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc06e7e0 0x7ff6bc16a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:35.681 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.677+0000 7ff6c0bbb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc06e7e0 0x7ff6bc16a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42306/0 (socket says 172.21.15.6:42306) 2023-10-06T02:17:35.681 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.677+0000 7ff6c0bbb700 1 -- 172.21.15.6:0/985763456 learned_addr learned my addr 172.21.15.6:0/985763456 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:35.681 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.678+0000 7ff6c13bc700 1 --2- 172.21.15.6:0/985763456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6bc1570b0 0x7ff6bc159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:35.681 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.678+0000 7ff6bbfff700 1 --2- 172.21.15.6:0/985763456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6bc156ce0 0x7ff6bc154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:35.682 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.678+0000 7ff6c0bbb700 1 -- 172.21.15.6:0/985763456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6bc156ce0 msgr2=0x7ff6bc154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:35.682 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.678+0000 7ff6c0bbb700 1 --2- 172.21.15.6:0/985763456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6bc156ce0 0x7ff6bc154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:35.682 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.678+0000 7ff6c0bbb700 1 -- 172.21.15.6:0/985763456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6bc1570b0 msgr2=0x7ff6bc159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:35.682 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.678+0000 7ff6c0bbb700 1 --2- 172.21.15.6:0/985763456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6bc1570b0 0x7ff6bc159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:35.682 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.678+0000 7ff6c0bbb700 1 -- 172.21.15.6:0/985763456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b4009a20 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.682 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.678+0000 7ff6c13bc700 1 --2- 172.21.15.6:0/985763456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6bc1570b0 0x7ff6bc159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:17:35.682 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.678+0000 7ff6bbfff700 1 --2- 172.21.15.6:0/985763456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6bc156ce0 0x7ff6bc154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:17:35.682 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.678+0000 7ff6c0bbb700 1 --2- 172.21.15.6:0/985763456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc06e7e0 0x7ff6bc16a7d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00c7c0 tx=0x7ff6ac007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:35.682 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.678+0000 7ff6b8ff9700 1 -- 172.21.15.6:0/985763456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac005b30 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.682 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.678+0000 7ff6b8ff9700 1 -- 172.21.15.6:0/985763456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac005c90 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.683 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.678+0000 7ff6c2e1f700 1 -- 172.21.15.6:0/985763456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6bc0b3700 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.683 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.678+0000 7ff6b8ff9700 1 -- 172.21.15.6:0/985763456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac007340 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.683 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.678+0000 7ff6c2e1f700 1 -- 172.21.15.6:0/985763456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6bc155470 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.683 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.679+0000 7ff6c2e1f700 1 -- 172.21.15.6:0/985763456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6bc04c3c0 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.683 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.679+0000 7ff6b8ff9700 1 -- 172.21.15.6:0/985763456 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7ff6ac0076f0 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.683 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.680+0000 7ff6b8ff9700 1 --2- 172.21.15.6:0/985763456 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff69c066ea0 0x7ff69c069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:35.683 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.680+0000 7ff6b8ff9700 1 -- 172.21.15.6:0/985763456 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7ff6ac0838d0 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.683 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.680+0000 7ff6bbfff700 1 --2- 172.21.15.6:0/985763456 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff69c066ea0 0x7ff69c069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:35.683 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.680+0000 7ff6bbfff700 1 --2- 172.21.15.6:0/985763456 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff69c066ea0 0x7ff69c069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4006f00 tx=0x7ff6a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:35.684 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.684+0000 7ff6b8ff9700 1 -- 172.21.15.6:0/985763456 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6ac0510f0 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.881 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.881+0000 7ff6c2e1f700 1 -- 172.21.15.6:0/985763456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6bc06ec40 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.882 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.882+0000 7ff6b8ff9700 1 -- 172.21.15.6:0/985763456 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10348 (secure 0 0 0) 0x7ff6bc06ec40 con 0x7ff6bc06e7e0 2023-10-06T02:17:35.882 INFO:teuthology.misc.health.smithi006.stdout: 2023-10-06T02:17:35.882 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":13,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:34.901956+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:17:35.885 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.883+0000 7ff6c2e1f700 1 -- 172.21.15.6:0/985763456 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff69c066ea0 msgr2=0x7ff69c069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:35.885 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.883+0000 7ff6c2e1f700 1 --2- 172.21.15.6:0/985763456 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff69c066ea0 0x7ff69c069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4006f00 tx=0x7ff6a4008040 comp rx=0 tx=0).stop 2023-10-06T02:17:35.885 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.883+0000 7ff6c2e1f700 1 -- 172.21.15.6:0/985763456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc06e7e0 msgr2=0x7ff6bc16a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:35.885 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.883+0000 7ff6c2e1f700 1 --2- 172.21.15.6:0/985763456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc06e7e0 0x7ff6bc16a7d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00c7c0 tx=0x7ff6ac007c70 comp rx=0 tx=0).stop 2023-10-06T02:17:35.885 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.883+0000 7ff6c2e1f700 1 -- 172.21.15.6:0/985763456 shutdown_connections 2023-10-06T02:17:35.885 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.883+0000 7ff6c2e1f700 1 --2- 172.21.15.6:0/985763456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6bc1570b0 0x7ff6bc159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:35.886 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.883+0000 7ff6c2e1f700 1 --2- 172.21.15.6:0/985763456 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff69c066ea0 0x7ff69c069350 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:35.886 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.883+0000 7ff6c2e1f700 1 --2- 172.21.15.6:0/985763456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6bc06e7e0 0x7ff6bc16a7d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:35.886 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.883+0000 7ff6c2e1f700 1 --2- 172.21.15.6:0/985763456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6bc156ce0 0x7ff6bc154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:35.886 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.883+0000 7ff6c2e1f700 1 -- 172.21.15.6:0/985763456 >> 172.21.15.6:0/985763456 conn(0x7ff6bc0d0370 msgr2=0x7ff6bc0c5110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:35.886 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.884+0000 7ff6c2e1f700 1 -- 172.21.15.6:0/985763456 shutdown_connections 2023-10-06T02:17:35.887 INFO:teuthology.misc.health.smithi006.stderr:2023-10-06T02:17:35.884+0000 7ff6c2e1f700 1 -- 172.21.15.6:0/985763456 wait complete. 2023-10-06T02:17:35.895 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T02:17:35.895 INFO:tasks.ceph:Creating RBD pool 2023-10-06T02:17:35.895 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T02:17:36.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.014+0000 7f50c86b1700 1 Processor -- start 2023-10-06T02:17:36.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.014+0000 7f50c86b1700 1 -- start start 2023-10-06T02:17:36.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.015+0000 7f50c86b1700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f50c0159190 0x7f50c00ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:36.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.015+0000 7f50c86b1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50c006a900 0x7f50c00b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:36.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.015+0000 7f50c86b1700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c00b4e20 con 0x7f50c00ceed0 2023-10-06T02:17:36.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.015+0000 7f50c86b1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c00cd5a0 con 0x7f50c006a900 2023-10-06T02:17:36.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.015+0000 7f50c86b1700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c00b4570 con 0x7f50c0159190 2023-10-06T02:17:36.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.015+0000 7f50c6c4e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50c006a900 0x7f50c00b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:36.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.015+0000 7f50c6c4e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50c006a900 0x7f50c00b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42310/0 (socket says 172.21.15.6:42310) 2023-10-06T02:17:36.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.015+0000 7f50c6c4e700 1 -- 172.21.15.6:0/2325660107 learned_addr learned my addr 172.21.15.6:0/2325660107 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:36.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.016+0000 7f50c644d700 1 --2- 172.21.15.6:0/2325660107 >> v2:172.21.15.175:3300/0 conn(0x7f50c0159190 0x7f50c00ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:36.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.016+0000 7f50c6c4e700 1 -- 172.21.15.6:0/2325660107 >> v2:172.21.15.175:3300/0 conn(0x7f50c0159190 msgr2=0x7f50c00ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:36.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.016+0000 7f50c6c4e700 1 --2- 172.21.15.6:0/2325660107 >> v2:172.21.15.175:3300/0 conn(0x7f50c0159190 0x7f50c00ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:36.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.016+0000 7f50c6c4e700 1 -- 172.21.15.6:0/2325660107 >> v1:172.21.15.175:6789/0 conn(0x7f50c00ceed0 legacy=0x7f50c006a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:36.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.016+0000 7f50c6c4e700 1 -- 172.21.15.6:0/2325660107 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c00cd2c0 con 0x7f50c006a900 2023-10-06T02:17:36.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.016+0000 7f50c6c4e700 1 --2- 172.21.15.6:0/2325660107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c006a900 0x7f50c00b52b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f50c00d1380 tx=0x7f50b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf356e223cfd3fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:36.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.016+0000 7f50c544b700 1 -- 172.21.15.6:0/2325660107 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0009e70 con 0x7f50c006a900 2023-10-06T02:17:36.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.016+0000 7f50c544b700 1 -- 172.21.15.6:0/2325660107 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b000b860 con 0x7f50c006a900 2023-10-06T02:17:36.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.016+0000 7f50c544b700 1 -- 172.21.15.6:0/2325660107 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b000bc00 con 0x7f50c006a900 2023-10-06T02:17:36.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.017+0000 7f50c86b1700 1 -- 172.21.15.6:0/2325660107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c006a900 msgr2=0x7f50c00b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:36.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.017+0000 7f50c86b1700 1 --2- 172.21.15.6:0/2325660107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c006a900 0x7f50c00b52b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f50c00d1380 tx=0x7f50b0009250 comp rx=0 tx=0).stop 2023-10-06T02:17:36.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.017+0000 7f50c86b1700 1 -- 172.21.15.6:0/2325660107 shutdown_connections 2023-10-06T02:17:36.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.017+0000 7f50c86b1700 1 --2- 172.21.15.6:0/2325660107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c006a900 0x7f50c00b52b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:36.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.017+0000 7f50c86b1700 1 --2- 172.21.15.6:0/2325660107 >> v2:172.21.15.175:3300/0 conn(0x7f50c0159190 0x7f50c00ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:36.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.017+0000 7f50c86b1700 1 -- 172.21.15.6:0/2325660107 >> 172.21.15.6:0/2325660107 conn(0x7f50c0087340 msgr2=0x7f50c0087710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:36.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.017+0000 7f50c86b1700 1 -- 172.21.15.6:0/2325660107 shutdown_connections 2023-10-06T02:17:36.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.017+0000 7f50c86b1700 1 -- 172.21.15.6:0/2325660107 wait complete. 2023-10-06T02:17:36.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.018+0000 7f50c86b1700 1 Processor -- start 2023-10-06T02:17:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.018+0000 7f50c86b1700 1 -- start start 2023-10-06T02:17:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c86b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c006a900 0x7f50c016b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c86b1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50c00ceed0 0x7f50c0153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c86b1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50c0159190 0x7f50c00d0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c86b1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00c85c0 con 0x7f50c006a900 2023-10-06T02:17:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c86b1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00c5250 con 0x7f50c00ceed0 2023-10-06T02:17:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c86b1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00c5530 con 0x7f50c0159190 2023-10-06T02:17:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c644d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c006a900 0x7f50c016b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c644d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c006a900 0x7f50c016b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42322/0 (socket says 172.21.15.6:42322) 2023-10-06T02:17:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c644d700 1 -- 172.21.15.6:0/4197599971 learned_addr learned my addr 172.21.15.6:0/4197599971 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c5c4c700 1 --2- 172.21.15.6:0/4197599971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50c00ceed0 0x7f50c0153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:36.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c6c4e700 1 --2- 172.21.15.6:0/4197599971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50c0159190 0x7f50c00d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:36.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c644d700 1 -- 172.21.15.6:0/4197599971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50c0159190 msgr2=0x7f50c00d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:36.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c644d700 1 --2- 172.21.15.6:0/4197599971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50c0159190 0x7f50c00d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:36.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c644d700 1 -- 172.21.15.6:0/4197599971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50c00ceed0 msgr2=0x7f50c0153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:36.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c644d700 1 --2- 172.21.15.6:0/4197599971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50c00ceed0 0x7f50c0153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:36.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c644d700 1 -- 172.21.15.6:0/4197599971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b00094f0 con 0x7f50c006a900 2023-10-06T02:17:36.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c644d700 1 --2- 172.21.15.6:0/4197599971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c006a900 0x7f50c016b0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009e70 tx=0x7f50b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:36.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50be7fc700 1 -- 172.21.15.6:0/4197599971 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b800caa0 con 0x7f50c006a900 2023-10-06T02:17:36.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50be7fc700 1 -- 172.21.15.6:0/4197599971 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b800f040 con 0x7f50c006a900 2023-10-06T02:17:36.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c86b1700 1 -- 172.21.15.6:0/4197599971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c00c5810 con 0x7f50c006a900 2023-10-06T02:17:36.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50be7fc700 1 -- 172.21.15.6:0/4197599971 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b800ce70 con 0x7f50c006a900 2023-10-06T02:17:36.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.019+0000 7f50c86b1700 1 -- 172.21.15.6:0/4197599971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c016b5f0 con 0x7f50c006a900 2023-10-06T02:17:36.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.020+0000 7f50c86b1700 1 -- 172.21.15.6:0/4197599971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c00c5d30 con 0x7f50c006a900 2023-10-06T02:17:36.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.021+0000 7f50be7fc700 1 -- 172.21.15.6:0/4197599971 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f50b8014690 con 0x7f50c006a900 2023-10-06T02:17:36.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.021+0000 7f50be7fc700 1 --2- 172.21.15.6:0/4197599971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f50ac066ea0 0x7f50ac069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:36.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.021+0000 7f50be7fc700 1 -- 172.21.15.6:0/4197599971 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f50b8084ae0 con 0x7f50c006a900 2023-10-06T02:17:36.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.021+0000 7f50c5c4c700 1 --2- 172.21.15.6:0/4197599971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f50ac066ea0 0x7f50ac069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:36.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.022+0000 7f50c5c4c700 1 --2- 172.21.15.6:0/4197599971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f50ac066ea0 0x7f50ac069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f50c00cd1b0 tx=0x7f50b4007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:36.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.025+0000 7f50be7fc700 1 -- 172.21.15.6:0/4197599971 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50c00c5d30 con 0x7f50c006a900 2023-10-06T02:17:36.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.224+0000 7f50c86b1700 1 -- 172.21.15.6:0/4197599971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f50c00c5d30 con 0x7f50c006a900 2023-10-06T02:17:36.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.925+0000 7f50be7fc700 1 -- 172.21.15.6:0/4197599971 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f50c00c5d30 con 0x7f50c006a900 2023-10-06T02:17:36.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.928+0000 7f50c86b1700 1 -- 172.21.15.6:0/4197599971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f50ac066ea0 msgr2=0x7f50ac069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:36.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.928+0000 7f50c86b1700 1 --2- 172.21.15.6:0/4197599971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f50ac066ea0 0x7f50ac069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f50c00cd1b0 tx=0x7f50b4007ec0 comp rx=0 tx=0).stop 2023-10-06T02:17:36.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.928+0000 7f50c86b1700 1 -- 172.21.15.6:0/4197599971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c006a900 msgr2=0x7f50c016b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:36.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.928+0000 7f50c86b1700 1 --2- 172.21.15.6:0/4197599971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c006a900 0x7f50c016b0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009e70 tx=0x7f50b800b040 comp rx=0 tx=0).stop 2023-10-06T02:17:36.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.928+0000 7f50c86b1700 1 -- 172.21.15.6:0/4197599971 shutdown_connections 2023-10-06T02:17:36.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.928+0000 7f50c86b1700 1 --2- 172.21.15.6:0/4197599971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50c0159190 0x7f50c00d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:36.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.928+0000 7f50c86b1700 1 --2- 172.21.15.6:0/4197599971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f50ac066ea0 0x7f50ac069350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:36.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.928+0000 7f50c86b1700 1 --2- 172.21.15.6:0/4197599971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c006a900 0x7f50c016b0b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:36.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.928+0000 7f50c86b1700 1 --2- 172.21.15.6:0/4197599971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50c00ceed0 0x7f50c0153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:36.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.928+0000 7f50c86b1700 1 -- 172.21.15.6:0/4197599971 >> 172.21.15.6:0/4197599971 conn(0x7f50c0087340 msgr2=0x7f50c00af390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:36.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.928+0000 7f50c86b1700 1 -- 172.21.15.6:0/4197599971 shutdown_connections 2023-10-06T02:17:36.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:36.928+0000 7f50c86b1700 1 -- 172.21.15.6:0/4197599971 wait complete. 2023-10-06T02:17:36.929 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'rbd' created 2023-10-06T02:17:36.943 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T02:17:37.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.070+0000 7fc11b4fe700 1 Processor -- start 2023-10-06T02:17:37.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.070+0000 7fc11b4fe700 1 -- start start 2023-10-06T02:17:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.071+0000 7fc11b4fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc1140d0970 0x7fc114164070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.071+0000 7fc11b4fe700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11415a710 con 0x7fc1140cfa90 2023-10-06T02:17:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.071+0000 7fc11b4fe700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc114159b40 con 0x7fc114142df0 2023-10-06T02:17:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.071+0000 7fc11b4fe700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc114159de0 con 0x7fc1140d0970 2023-10-06T02:17:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.071+0000 7fc118a99700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc1140cfa90 0x7fc1140d0260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33990/0 (socket says 172.21.15.6:33990) 2023-10-06T02:17:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.071+0000 7fc118a99700 1 -- 172.21.15.6:0/1307369762 learned_addr learned my addr 172.21.15.6:0/1307369762 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.071+0000 7fc119a9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc1140d0970 0x7fc114164070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.071+0000 7fc113fff700 1 -- 172.21.15.6:0/1307369762 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359886805 0 0) 0x7fc11415a710 con 0x7fc1140cfa90 2023-10-06T02:17:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.071+0000 7fc113fff700 1 -- 172.21.15.6:0/1307369762 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0fc003570 con 0x7fc1140cfa90 2023-10-06T02:17:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.071+0000 7fc119a9b700 1 -- 172.21.15.6:0/1307369762 >> v1:172.21.15.175:6789/0 conn(0x7fc114142df0 legacy=0x7fc1140cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.071+0000 7fc119a9b700 1 -- 172.21.15.6:0/1307369762 >> v1:172.21.15.6:6789/0 conn(0x7fc1140cfa90 legacy=0x7fc1140d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.071+0000 7fc119a9b700 1 -- 172.21.15.6:0/1307369762 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11415a0c0 con 0x7fc1140d0970 2023-10-06T02:17:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.071+0000 7fc119a9b700 1 --2- 172.21.15.6:0/1307369762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1140d0970 0x7fc114164070 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009910 tx=0x7fc10c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb9488c7bb046e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.071+0000 7fc113fff700 1 -- 172.21.15.6:0/1307369762 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c011630 con 0x7fc1140d0970 2023-10-06T02:17:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.071+0000 7fc113fff700 1 -- 172.21.15.6:0/1307369762 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c011790 con 0x7fc1140d0970 2023-10-06T02:17:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.071+0000 7fc113fff700 1 -- 172.21.15.6:0/1307369762 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c011b50 con 0x7fc1140d0970 2023-10-06T02:17:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.072+0000 7fc11b4fe700 1 -- 172.21.15.6:0/1307369762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1140d0970 msgr2=0x7fc114164070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.072+0000 7fc11b4fe700 1 --2- 172.21.15.6:0/1307369762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1140d0970 0x7fc114164070 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009910 tx=0x7fc10c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.072+0000 7fc11b4fe700 1 -- 172.21.15.6:0/1307369762 shutdown_connections 2023-10-06T02:17:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.072+0000 7fc11b4fe700 1 --2- 172.21.15.6:0/1307369762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1140d0970 0x7fc114164070 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.072+0000 7fc11b4fe700 1 -- 172.21.15.6:0/1307369762 >> 172.21.15.6:0/1307369762 conn(0x7fc1140690f0 msgr2=0x7fc11406a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.072+0000 7fc11b4fe700 1 -- 172.21.15.6:0/1307369762 shutdown_connections 2023-10-06T02:17:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.072+0000 7fc11b4fe700 1 -- 172.21.15.6:0/1307369762 wait complete. 2023-10-06T02:17:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.073+0000 7fc11b4fe700 1 Processor -- start 2023-10-06T02:17:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.073+0000 7fc11b4fe700 1 -- start start 2023-10-06T02:17:37.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.074+0000 7fc11b4fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1140cfa90 0x7fc1140c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:37.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.074+0000 7fc11b4fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1140d0970 0x7fc114169250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:37.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.074+0000 7fc11b4fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc114142df0 0x7fc1140c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:37.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.074+0000 7fc11b4fe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1140c6be0 con 0x7fc1140cfa90 2023-10-06T02:17:37.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.074+0000 7fc11b4fe700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1140c6900 con 0x7fc114142df0 2023-10-06T02:17:37.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.074+0000 7fc11b4fe700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1141551e0 con 0x7fc1140d0970 2023-10-06T02:17:37.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.074+0000 7fc11929a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1140cfa90 0x7fc1140c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:37.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.074+0000 7fc11929a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1140cfa90 0x7fc1140c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42344/0 (socket says 172.21.15.6:42344) 2023-10-06T02:17:37.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.074+0000 7fc11929a700 1 -- 172.21.15.6:0/3721252575 learned_addr learned my addr 172.21.15.6:0/3721252575 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:37.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.074+0000 7fc118a99700 1 --2- 172.21.15.6:0/3721252575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1140d0970 0x7fc114169250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:37.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.074+0000 7fc119a9b700 1 --2- 172.21.15.6:0/3721252575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc114142df0 0x7fc1140c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.074+0000 7fc11929a700 1 -- 172.21.15.6:0/3721252575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1140d0970 msgr2=0x7fc114169250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.074+0000 7fc11929a700 1 --2- 172.21.15.6:0/3721252575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1140d0970 0x7fc114169250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.074+0000 7fc11929a700 1 -- 172.21.15.6:0/3721252575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc114142df0 msgr2=0x7fc1140c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.074+0000 7fc11929a700 1 --2- 172.21.15.6:0/3721252575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc114142df0 0x7fc1140c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.074+0000 7fc11929a700 1 -- 172.21.15.6:0/3721252575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c009420 con 0x7fc1140cfa90 2023-10-06T02:17:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.075+0000 7fc11929a700 1 --2- 172.21.15.6:0/3721252575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1140cfa90 0x7fc1140c9b20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc10400bbb0 tx=0x7fc104009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.075+0000 7fc1117fa700 1 -- 172.21.15.6:0/3721252575 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1040092e0 con 0x7fc1140cfa90 2023-10-06T02:17:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.075+0000 7fc1117fa700 1 -- 172.21.15.6:0/3721252575 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10400c7a0 con 0x7fc1140cfa90 2023-10-06T02:17:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.075+0000 7fc11b4fe700 1 -- 172.21.15.6:0/3721252575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1141554c0 con 0x7fc1140cfa90 2023-10-06T02:17:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.075+0000 7fc1117fa700 1 -- 172.21.15.6:0/3721252575 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10400cb40 con 0x7fc1140cfa90 2023-10-06T02:17:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.075+0000 7fc11b4fe700 1 -- 172.21.15.6:0/3721252575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc114169790 con 0x7fc1140cfa90 2023-10-06T02:17:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.076+0000 7fc11b4fe700 1 -- 172.21.15.6:0/3721252575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc114088ad0 con 0x7fc1140cfa90 2023-10-06T02:17:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.076+0000 7fc1117fa700 1 -- 172.21.15.6:0/3721252575 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fc104012070 con 0x7fc1140cfa90 2023-10-06T02:17:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.077+0000 7fc1117fa700 1 --2- 172.21.15.6:0/3721252575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc100066ea0 0x7fc100069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.077+0000 7fc1117fa700 1 -- 172.21.15.6:0/3721252575 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5184+0+0 (secure 0 0 0) 0x7fc104083ee0 con 0x7fc1140cfa90 2023-10-06T02:17:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.077+0000 7fc118a99700 1 --2- 172.21.15.6:0/3721252575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc100066ea0 0x7fc100069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.077+0000 7fc118a99700 1 --2- 172.21.15.6:0/3721252575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc100066ea0 0x7fc100069350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1141596a0 tx=0x7fc108009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:37.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.081+0000 7fc1117fa700 1 -- 172.21.15.6:0/3721252575 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc104051440 con 0x7fc1140cfa90 2023-10-06T02:17:37.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.273+0000 7fc11b4fe700 1 -- 172.21.15.6:0/3721252575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc11415a3a0 con 0x7fc1140cfa90 2023-10-06T02:17:37.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.926+0000 7fc1117fa700 1 -- 172.21.15.6:0/3721252575 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc104054a60 con 0x7fc1140cfa90 2023-10-06T02:17:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.929+0000 7fc11b4fe700 1 -- 172.21.15.6:0/3721252575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc100066ea0 msgr2=0x7fc100069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.929+0000 7fc11b4fe700 1 --2- 172.21.15.6:0/3721252575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc100066ea0 0x7fc100069350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1141596a0 tx=0x7fc108009040 comp rx=0 tx=0).stop 2023-10-06T02:17:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.929+0000 7fc11b4fe700 1 -- 172.21.15.6:0/3721252575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1140cfa90 msgr2=0x7fc1140c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.929+0000 7fc11b4fe700 1 --2- 172.21.15.6:0/3721252575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1140cfa90 0x7fc1140c9b20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc10400bbb0 tx=0x7fc104009840 comp rx=0 tx=0).stop 2023-10-06T02:17:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.930+0000 7fc11b4fe700 1 -- 172.21.15.6:0/3721252575 shutdown_connections 2023-10-06T02:17:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.930+0000 7fc11b4fe700 1 --2- 172.21.15.6:0/3721252575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc114142df0 0x7fc1140c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.930+0000 7fc11b4fe700 1 --2- 172.21.15.6:0/3721252575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc100066ea0 0x7fc100069350 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1141596a0 tx=0x7fc108009040 comp rx=0 tx=0).stop 2023-10-06T02:17:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.930+0000 7fc11b4fe700 1 --2- 172.21.15.6:0/3721252575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1140cfa90 0x7fc1140c9b20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.930+0000 7fc11b4fe700 1 --2- 172.21.15.6:0/3721252575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1140d0970 0x7fc114169250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.930+0000 7fc11b4fe700 1 -- 172.21.15.6:0/3721252575 >> 172.21.15.6:0/3721252575 conn(0x7fc1140690f0 msgr2=0x7fc1140b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.930+0000 7fc11b4fe700 1 -- 172.21.15.6:0/3721252575 shutdown_connections 2023-10-06T02:17:37.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:37.932+0000 7fc11b4fe700 1 -- 172.21.15.6:0/3721252575 wait complete. 2023-10-06T02:17:37.933 INFO:teuthology.orchestra.run.smithi006.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T02:17:37.946 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T02:17:37.946 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:17:37.947 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:17:37.949 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:17:37.949 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:17:37.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:17:37.951 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:17:37.951 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:17:37.951 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:17:37.953 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:17:37.954 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:17:37.954 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:17:37.956 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:17:37.956 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T02:17:37.956 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:17:38.035 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-06T02:17:38.036 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:17:38.040 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-10-06T02:17:38.040 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-10-06T02:17:38.041 INFO:tasks.ceph.mds.d.smithi175.stderr:2023-10-06T02:17:38.040+0000 7fd761b92700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-06T02:17:38.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.097+0000 7f15f96bf700 1 Processor -- start 2023-10-06T02:17:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.097+0000 7f15f96bf700 1 -- start start 2023-10-06T02:17:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.097+0000 7f15f96bf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f414fda0 0x7f15f41569e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.097+0000 7f15f96bf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15f40b0f10 0x7f15f40c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.097+0000 7f15f96bf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f40c87a0 con 0x7f15f4150170 2023-10-06T02:17:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.097+0000 7f15f96bf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f40c89d0 con 0x7f15f40b0f10 2023-10-06T02:17:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.097+0000 7f15f96bf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f41594b0 con 0x7f15f414fda0 2023-10-06T02:17:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.097+0000 7f15f37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15f40b0f10 0x7f15f40c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.098+0000 7f15f27fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f15f4150170 0x7f15f40b0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34010/0 (socket says 172.21.15.6:34010) 2023-10-06T02:17:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.098+0000 7f15f27fc700 1 -- 172.21.15.6:0/2871161 learned_addr learned my addr 172.21.15.6:0/2871161 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.098+0000 7f15f37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15f40b0f10 0x7f15f40c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42380/0 (socket says 172.21.15.6:42380) 2023-10-06T02:17:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.098+0000 7f15f2ffd700 1 --2- 172.21.15.6:0/2871161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f414fda0 0x7f15f41569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.098+0000 7f15f37fe700 1 -- 172.21.15.6:0/2871161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f414fda0 msgr2=0x7f15f41569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.098+0000 7f15f37fe700 1 --2- 172.21.15.6:0/2871161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f414fda0 0x7f15f41569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.098+0000 7f15f37fe700 1 -- 172.21.15.6:0/2871161 >> v1:172.21.15.6:6789/0 conn(0x7f15f4150170 legacy=0x7f15f40b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.098+0000 7f15f37fe700 1 -- 172.21.15.6:0/2871161 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f41596c0 con 0x7f15f40b0f10 2023-10-06T02:17:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.098+0000 7f15f2ffd700 1 --2- 172.21.15.6:0/2871161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f414fda0 0x7f15f41569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.098+0000 7f15f1ffb700 1 -- 172.21.15.6:0/2871161 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402329295 0 0) 0x7f15f40c87a0 con 0x7f15f4150170 2023-10-06T02:17:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.098+0000 7f15f37fe700 1 --2- 172.21.15.6:0/2871161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f40b0f10 0x7f15f40c8260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00d0d0 tx=0x7f15ec00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00b373580810752 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.098+0000 7f15f1ffb700 1 -- 172.21.15.6:0/2871161 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec010070 con 0x7f15f40b0f10 2023-10-06T02:17:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.098+0000 7f15f1ffb700 1 -- 172.21.15.6:0/2871161 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec00dbe0 con 0x7f15f40b0f10 2023-10-06T02:17:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.098+0000 7f15f1ffb700 1 -- 172.21.15.6:0/2871161 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec016400 con 0x7f15f40b0f10 2023-10-06T02:17:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.099+0000 7f15f96bf700 1 -- 172.21.15.6:0/2871161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f40b0f10 msgr2=0x7f15f40c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.099+0000 7f15f96bf700 1 --2- 172.21.15.6:0/2871161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f40b0f10 0x7f15f40c8260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00d0d0 tx=0x7f15ec00b990 comp rx=0 tx=0).stop 2023-10-06T02:17:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.099+0000 7f15f96bf700 1 -- 172.21.15.6:0/2871161 shutdown_connections 2023-10-06T02:17:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.099+0000 7f15f96bf700 1 --2- 172.21.15.6:0/2871161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f40b0f10 0x7f15f40c8260 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.099+0000 7f15f96bf700 1 --2- 172.21.15.6:0/2871161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f414fda0 0x7f15f41569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.099+0000 7f15f96bf700 1 -- 172.21.15.6:0/2871161 >> 172.21.15.6:0/2871161 conn(0x7f15f4069100 msgr2=0x7f15f40ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.099+0000 7f15f96bf700 1 -- 172.21.15.6:0/2871161 shutdown_connections 2023-10-06T02:17:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.099+0000 7f15f96bf700 1 -- 172.21.15.6:0/2871161 wait complete. 2023-10-06T02:17:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.100+0000 7f15f96bf700 1 Processor -- start 2023-10-06T02:17:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.100+0000 7f15f96bf700 1 -- start start 2023-10-06T02:17:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.101+0000 7f15f96bf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f40b0f10 0x7f15f414b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.101+0000 7f15f96bf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f414fda0 0x7f15f40ab740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.101+0000 7f15f96bf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f4150170 0x7f15f41698f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.101+0000 7f15f96bf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40ca790 con 0x7f15f414fda0 2023-10-06T02:17:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.101+0000 7f15f96bf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40c9b80 con 0x7f15f40b0f10 2023-10-06T02:17:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.101+0000 7f15f96bf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40c9e60 con 0x7f15f4150170 2023-10-06T02:17:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.101+0000 7f15f27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f414fda0 0x7f15f40ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.101+0000 7f15f27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f414fda0 0x7f15f40ab740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42382/0 (socket says 172.21.15.6:42382) 2023-10-06T02:17:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.101+0000 7f15f27fc700 1 -- 172.21.15.6:0/1668323121 learned_addr learned my addr 172.21.15.6:0/1668323121 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.101+0000 7f15f2ffd700 1 --2- 172.21.15.6:0/1668323121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f40b0f10 0x7f15f414b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.101+0000 7f15f37fe700 1 --2- 172.21.15.6:0/1668323121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f4150170 0x7f15f41698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.101+0000 7f15f27fc700 1 -- 172.21.15.6:0/1668323121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f4150170 msgr2=0x7f15f41698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.101+0000 7f15f27fc700 1 --2- 172.21.15.6:0/1668323121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f4150170 0x7f15f41698f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.101+0000 7f15f27fc700 1 -- 172.21.15.6:0/1668323121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f40b0f10 msgr2=0x7f15f414b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.101+0000 7f15f27fc700 1 --2- 172.21.15.6:0/1668323121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f40b0f10 0x7f15f414b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.101+0000 7f15f27fc700 1 -- 172.21.15.6:0/1668323121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec00bc30 con 0x7f15f414fda0 2023-10-06T02:17:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.101+0000 7f15f27fc700 1 --2- 172.21.15.6:0/1668323121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f414fda0 0x7f15f40ab740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f15dc00c5b0 tx=0x7f15dc001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.102+0000 7f15eaffd700 1 -- 172.21.15.6:0/1668323121 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc005b30 con 0x7f15f414fda0 2023-10-06T02:17:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.102+0000 7f15eaffd700 1 -- 172.21.15.6:0/1668323121 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc005c90 con 0x7f15f414fda0 2023-10-06T02:17:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.102+0000 7f15f96bf700 1 -- 172.21.15.6:0/1668323121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f40ca140 con 0x7f15f414fda0 2023-10-06T02:17:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.102+0000 7f15eaffd700 1 -- 172.21.15.6:0/1668323121 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc007300 con 0x7f15f414fda0 2023-10-06T02:17:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.102+0000 7f15f96bf700 1 -- 172.21.15.6:0/1668323121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f40ab000 con 0x7f15f414fda0 2023-10-06T02:17:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.103+0000 7f15f96bf700 1 -- 172.21.15.6:0/1668323121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f40ca5e0 con 0x7f15f414fda0 2023-10-06T02:17:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.103+0000 7f15eaffd700 1 -- 172.21.15.6:0/1668323121 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f15dc01b3b0 con 0x7f15f414fda0 2023-10-06T02:17:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.103+0000 7f15eaffd700 1 --2- 172.21.15.6:0/1668323121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f15d4066ea0 0x7f15d4069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.104+0000 7f15eaffd700 1 -- 172.21.15.6:0/1668323121 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f15dc083650 con 0x7f15f414fda0 2023-10-06T02:17:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.104+0000 7f15f2ffd700 1 --2- 172.21.15.6:0/1668323121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f15d4066ea0 0x7f15d4069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.104+0000 7f15f2ffd700 1 --2- 172.21.15.6:0/1668323121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f15d4066ea0 0x7f15d4069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f15e4006f00 tx=0x7f15e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.108+0000 7f15eaffd700 1 -- 172.21.15.6:0/1668323121 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15dc050b90 con 0x7f15f414fda0 2023-10-06T02:17:38.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.312+0000 7f15f96bf700 1 -- 172.21.15.6:0/1668323121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15f40ca8d0 con 0x7f15f414fda0 2023-10-06T02:17:38.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.313+0000 7f15eaffd700 1 -- 172.21.15.6:0/1668323121 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13626 (secure 0 0 0) 0x7f15dc0541b0 con 0x7f15f414fda0 2023-10-06T02:17:38.314 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:38.314 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":16,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:37.920927+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:17:38.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.315+0000 7f15f96bf700 1 -- 172.21.15.6:0/1668323121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f15d4066ea0 msgr2=0x7f15d4069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.315+0000 7f15f96bf700 1 --2- 172.21.15.6:0/1668323121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f15d4066ea0 0x7f15d4069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f15e4006f00 tx=0x7f15e4008040 comp rx=0 tx=0).stop 2023-10-06T02:17:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.315+0000 7f15f96bf700 1 -- 172.21.15.6:0/1668323121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f414fda0 msgr2=0x7f15f40ab740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.315+0000 7f15f96bf700 1 --2- 172.21.15.6:0/1668323121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f414fda0 0x7f15f40ab740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f15dc00c5b0 tx=0x7f15dc001070 comp rx=0 tx=0).stop 2023-10-06T02:17:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.315+0000 7f15f96bf700 1 -- 172.21.15.6:0/1668323121 shutdown_connections 2023-10-06T02:17:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.315+0000 7f15f96bf700 1 --2- 172.21.15.6:0/1668323121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f4150170 0x7f15f41698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.315+0000 7f15f96bf700 1 --2- 172.21.15.6:0/1668323121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f40b0f10 0x7f15f414b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.315+0000 7f15f96bf700 1 --2- 172.21.15.6:0/1668323121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f15d4066ea0 0x7f15d4069350 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.315+0000 7f15f96bf700 1 --2- 172.21.15.6:0/1668323121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f414fda0 0x7f15f40ab740 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.315+0000 7f15f96bf700 1 -- 172.21.15.6:0/1668323121 >> 172.21.15.6:0/1668323121 conn(0x7f15f4069100 msgr2=0x7f15f40b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.315+0000 7f15f96bf700 1 -- 172.21.15.6:0/1668323121 shutdown_connections 2023-10-06T02:17:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.315+0000 7f15f96bf700 1 -- 172.21.15.6:0/1668323121 wait complete. 2023-10-06T02:17:38.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T02:17:38.329 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:17:38.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.451+0000 7f3c476be700 1 Processor -- start 2023-10-06T02:17:38.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.452+0000 7f3c476be700 1 -- start start 2023-10-06T02:17:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.452+0000 7f3c476be700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c401574b0 0x7f3c400b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.452+0000 7f3c476be700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c400b13f0 0x7f3c400c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.452+0000 7f3c476be700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3c400c4510 0x7f3c400cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.452+0000 7f3c476be700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c400c4990 con 0x7f3c400b13f0 2023-10-06T02:17:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.452+0000 7f3c476be700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c400c3b40 con 0x7f3c400c4510 2023-10-06T02:17:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.453+0000 7f3c476be700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c400c2f30 con 0x7f3c401574b0 2023-10-06T02:17:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.453+0000 7f3c44c59700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c400b13f0 0x7f3c400c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.453+0000 7f3c44c59700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c400b13f0 0x7f3c400c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42398/0 (socket says 172.21.15.6:42398) 2023-10-06T02:17:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.453+0000 7f3c44c59700 1 -- 172.21.15.6:0/395843959 learned_addr learned my addr 172.21.15.6:0/395843959 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.453+0000 7f3c4545a700 1 --2- 172.21.15.6:0/395843959 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c401574b0 0x7f3c400b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.453+0000 7f3c45c5b700 1 --2- 172.21.15.6:0/395843959 >> v2:172.21.15.175:3300/0 conn(0x7f3c400c4510 0x7f3c400cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.453+0000 7f3c44c59700 1 -- 172.21.15.6:0/395843959 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c401574b0 msgr2=0x7f3c400b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.453+0000 7f3c44c59700 1 --2- 172.21.15.6:0/395843959 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c401574b0 0x7f3c400b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.453+0000 7f3c44c59700 1 -- 172.21.15.6:0/395843959 >> v2:172.21.15.175:3300/0 conn(0x7f3c400c4510 msgr2=0x7f3c400cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.453+0000 7f3c44c59700 1 --2- 172.21.15.6:0/395843959 >> v2:172.21.15.175:3300/0 conn(0x7f3c400c4510 0x7f3c400cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.453+0000 7f3c44c59700 1 -- 172.21.15.6:0/395843959 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c400c3210 con 0x7f3c400b13f0 2023-10-06T02:17:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.453+0000 7f3c44c59700 1 --2- 172.21.15.6:0/395843959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c400b13f0 0x7f3c400c3fd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3c4006f7e0 tx=0x7f3c30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415877ada8d1aa47 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.453+0000 7f3c37fff700 1 -- 172.21.15.6:0/395843959 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3000b640 con 0x7f3c400b13f0 2023-10-06T02:17:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.453+0000 7f3c37fff700 1 -- 172.21.15.6:0/395843959 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3000b7a0 con 0x7f3c400b13f0 2023-10-06T02:17:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.453+0000 7f3c37fff700 1 -- 172.21.15.6:0/395843959 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3000bb60 con 0x7f3c400b13f0 2023-10-06T02:17:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.454+0000 7f3c476be700 1 -- 172.21.15.6:0/395843959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c400b13f0 msgr2=0x7f3c400c3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.454+0000 7f3c476be700 1 --2- 172.21.15.6:0/395843959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c400b13f0 0x7f3c400c3fd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3c4006f7e0 tx=0x7f3c30009250 comp rx=0 tx=0).stop 2023-10-06T02:17:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.454+0000 7f3c476be700 1 -- 172.21.15.6:0/395843959 shutdown_connections 2023-10-06T02:17:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.454+0000 7f3c476be700 1 --2- 172.21.15.6:0/395843959 >> v2:172.21.15.175:3300/0 conn(0x7f3c400c4510 0x7f3c400cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.454+0000 7f3c476be700 1 --2- 172.21.15.6:0/395843959 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c401574b0 0x7f3c400b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.454+0000 7f3c476be700 1 --2- 172.21.15.6:0/395843959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c400b13f0 0x7f3c400c3fd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.454+0000 7f3c476be700 1 -- 172.21.15.6:0/395843959 >> 172.21.15.6:0/395843959 conn(0x7f3c40067910 msgr2=0x7f3c400ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.454+0000 7f3c476be700 1 -- 172.21.15.6:0/395843959 shutdown_connections 2023-10-06T02:17:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.454+0000 7f3c476be700 1 -- 172.21.15.6:0/395843959 wait complete. 2023-10-06T02:17:38.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.455+0000 7f3c476be700 1 Processor -- start 2023-10-06T02:17:38.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.456+0000 7f3c476be700 1 -- start start 2023-10-06T02:17:38.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c476be700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c400b13f0 0x7f3c4015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c476be700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c400c4510 0x7f3c40157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c476be700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c401574b0 0x7f3c40151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c476be700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4016a2f0 con 0x7f3c400c4510 2023-10-06T02:17:38.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c476be700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c40157dc0 con 0x7f3c400b13f0 2023-10-06T02:17:38.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c476be700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c40169720 con 0x7f3c401574b0 2023-10-06T02:17:38.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c44c59700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c400c4510 0x7f3c40157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c44c59700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c400c4510 0x7f3c40157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42400/0 (socket says 172.21.15.6:42400) 2023-10-06T02:17:38.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c44c59700 1 -- 172.21.15.6:0/3008894998 learned_addr learned my addr 172.21.15.6:0/3008894998 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:38.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c4545a700 1 --2- 172.21.15.6:0/3008894998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c400b13f0 0x7f3c4015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c45c5b700 1 --2- 172.21.15.6:0/3008894998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c401574b0 0x7f3c40151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c44c59700 1 -- 172.21.15.6:0/3008894998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c401574b0 msgr2=0x7f3c40151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:38.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c44c59700 1 --2- 172.21.15.6:0/3008894998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c401574b0 0x7f3c40151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c44c59700 1 -- 172.21.15.6:0/3008894998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c400b13f0 msgr2=0x7f3c4015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:38.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c44c59700 1 --2- 172.21.15.6:0/3008894998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c400b13f0 0x7f3c4015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c44c59700 1 -- 172.21.15.6:0/3008894998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c300094f0 con 0x7f3c400c4510 2023-10-06T02:17:38.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c44c59700 1 --2- 172.21.15.6:0/3008894998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c400c4510 0x7f3c40157880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c4006f5e0 tx=0x7f3c30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:38.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.457+0000 7f3c357fa700 1 -- 172.21.15.6:0/3008894998 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3000b910 con 0x7f3c400c4510 2023-10-06T02:17:38.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.458+0000 7f3c357fa700 1 -- 172.21.15.6:0/3008894998 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3000ba70 con 0x7f3c400c4510 2023-10-06T02:17:38.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.458+0000 7f3c476be700 1 -- 172.21.15.6:0/3008894998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4016a7c0 con 0x7f3c400c4510 2023-10-06T02:17:38.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.458+0000 7f3c357fa700 1 -- 172.21.15.6:0/3008894998 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30011630 con 0x7f3c400c4510 2023-10-06T02:17:38.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.458+0000 7f3c476be700 1 -- 172.21.15.6:0/3008894998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c40169ca0 con 0x7f3c400c4510 2023-10-06T02:17:38.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.459+0000 7f3c476be700 1 -- 172.21.15.6:0/3008894998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4016a4a0 con 0x7f3c400c4510 2023-10-06T02:17:38.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.459+0000 7f3c357fa700 1 -- 172.21.15.6:0/3008894998 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f3c300119a0 con 0x7f3c400c4510 2023-10-06T02:17:38.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.460+0000 7f3c357fa700 1 --2- 172.21.15.6:0/3008894998 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c24066ea0 0x7f3c24069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.460+0000 7f3c357fa700 1 -- 172.21.15.6:0/3008894998 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3c30085960 con 0x7f3c400c4510 2023-10-06T02:17:38.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.460+0000 7f3c4545a700 1 --2- 172.21.15.6:0/3008894998 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c24066ea0 0x7f3c24069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.460+0000 7f3c4545a700 1 --2- 172.21.15.6:0/3008894998 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c24066ea0 0x7f3c24069350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3c4009bef0 tx=0x7f3c3c009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:38.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.464+0000 7f3c357fa700 1 -- 172.21.15.6:0/3008894998 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c4016a4a0 con 0x7f3c400c4510 2023-10-06T02:17:38.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.661+0000 7f3c476be700 1 -- 172.21.15.6:0/3008894998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3c400c3580 con 0x7f3c400c4510 2023-10-06T02:17:38.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.662+0000 7f3c357fa700 1 -- 172.21.15.6:0/3008894998 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3c30052ea0 con 0x7f3c400c4510 2023-10-06T02:17:38.662 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:17:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.664+0000 7f3c476be700 1 -- 172.21.15.6:0/3008894998 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c24066ea0 msgr2=0x7f3c24069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.664+0000 7f3c476be700 1 --2- 172.21.15.6:0/3008894998 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c24066ea0 0x7f3c24069350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3c4009bef0 tx=0x7f3c3c009120 comp rx=0 tx=0).stop 2023-10-06T02:17:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.664+0000 7f3c476be700 1 -- 172.21.15.6:0/3008894998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c400c4510 msgr2=0x7f3c40157880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.664+0000 7f3c476be700 1 --2- 172.21.15.6:0/3008894998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c400c4510 0x7f3c40157880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c4006f5e0 tx=0x7f3c30017000 comp rx=0 tx=0).stop 2023-10-06T02:17:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.664+0000 7f3c476be700 1 -- 172.21.15.6:0/3008894998 shutdown_connections 2023-10-06T02:17:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.664+0000 7f3c476be700 1 --2- 172.21.15.6:0/3008894998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c401574b0 0x7f3c40151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.664+0000 7f3c476be700 1 --2- 172.21.15.6:0/3008894998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c400b13f0 0x7f3c4015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.664+0000 7f3c476be700 1 --2- 172.21.15.6:0/3008894998 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c24066ea0 0x7f3c24069350 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.664+0000 7f3c476be700 1 --2- 172.21.15.6:0/3008894998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c400c4510 0x7f3c40157880 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.664+0000 7f3c476be700 1 -- 172.21.15.6:0/3008894998 >> 172.21.15.6:0/3008894998 conn(0x7f3c40067910 msgr2=0x7f3c40155ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.664+0000 7f3c476be700 1 -- 172.21.15.6:0/3008894998 shutdown_connections 2023-10-06T02:17:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.664+0000 7f3c476be700 1 -- 172.21.15.6:0/3008894998 wait complete. 2023-10-06T02:17:38.676 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:17:38.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.797+0000 7f91e27b1700 1 Processor -- start 2023-10-06T02:17:38.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.797+0000 7f91e27b1700 1 -- start start 2023-10-06T02:17:38.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.797+0000 7f91e27b1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91dc0d0400 0x7f91dc0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.798+0000 7f91e27b1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91dc0d07d0 0x7f91dc0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.798+0000 7f91e27b1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91dc0b6170 con 0x7f91dc0ccd40 2023-10-06T02:17:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.798+0000 7f91e27b1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc15dd40 con 0x7f91dc0d0400 2023-10-06T02:17:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.798+0000 7f91e27b1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc15e020 con 0x7f91dc0d07d0 2023-10-06T02:17:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.798+0000 7f91dbfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91dc0d0400 0x7f91dc0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.798+0000 7f91db7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f91dc0ccd40 0x7f91dc0cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55956/0 (socket says 172.21.15.6:55956) 2023-10-06T02:17:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.798+0000 7f91db7fe700 1 -- 172.21.15.6:0/1043492137 learned_addr learned my addr 172.21.15.6:0/1043492137 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.798+0000 7f91e0d4e700 1 --2- 172.21.15.6:0/1043492137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91dc0d07d0 0x7f91dc0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.798+0000 7f91dbfff700 1 -- 172.21.15.6:0/1043492137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91dc0d07d0 msgr2=0x7f91dc0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.798+0000 7f91dbfff700 1 --2- 172.21.15.6:0/1043492137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91dc0d07d0 0x7f91dc0b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.798+0000 7f91dbfff700 1 -- 172.21.15.6:0/1043492137 >> v1:172.21.15.6:6789/0 conn(0x7f91dc0ccd40 legacy=0x7f91dc0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.798+0000 7f91dbfff700 1 -- 172.21.15.6:0/1043492137 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc0ceaa0 con 0x7f91dc0d0400 2023-10-06T02:17:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.798+0000 7f91daffd700 1 -- 172.21.15.6:0/1043492137 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657364578 0 0) 0x7f91dc0b6170 con 0x7f91dc0ccd40 2023-10-06T02:17:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.798+0000 7f91dbfff700 1 --2- 172.21.15.6:0/1043492137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc0d0400 0x7f91dc0b5c30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f91d00098d0 tx=0x7f91d0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585874554d1ac26f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.798+0000 7f91daffd700 1 -- 172.21.15.6:0/1043492137 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0005c10 con 0x7f91dc0d0400 2023-10-06T02:17:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.798+0000 7f91daffd700 1 -- 172.21.15.6:0/1043492137 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d0005d70 con 0x7f91dc0d0400 2023-10-06T02:17:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.798+0000 7f91daffd700 1 -- 172.21.15.6:0/1043492137 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0006280 con 0x7f91dc0d0400 2023-10-06T02:17:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.799+0000 7f91e27b1700 1 -- 172.21.15.6:0/1043492137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc0d0400 msgr2=0x7f91dc0b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.799+0000 7f91e27b1700 1 --2- 172.21.15.6:0/1043492137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc0d0400 0x7f91dc0b5c30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f91d00098d0 tx=0x7f91d0009120 comp rx=0 tx=0).stop 2023-10-06T02:17:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.799+0000 7f91e27b1700 1 -- 172.21.15.6:0/1043492137 shutdown_connections 2023-10-06T02:17:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.799+0000 7f91e27b1700 1 --2- 172.21.15.6:0/1043492137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91dc0d07d0 0x7f91dc0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.799+0000 7f91e27b1700 1 --2- 172.21.15.6:0/1043492137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc0d0400 0x7f91dc0b5c30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.799+0000 7f91e27b1700 1 -- 172.21.15.6:0/1043492137 >> 172.21.15.6:0/1043492137 conn(0x7f91dc06a220 msgr2=0x7f91dc06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:38.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.799+0000 7f91e27b1700 1 -- 172.21.15.6:0/1043492137 shutdown_connections 2023-10-06T02:17:38.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.799+0000 7f91e27b1700 1 -- 172.21.15.6:0/1043492137 wait complete. 2023-10-06T02:17:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.800+0000 7f91e27b1700 1 Processor -- start 2023-10-06T02:17:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.800+0000 7f91e27b1700 1 -- start start 2023-10-06T02:17:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.801+0000 7f91e27b1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91dc0ccd40 0x7f91dc152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.801+0000 7f91e27b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc0d0400 0x7f91dc14ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.801+0000 7f91e27b1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91dc0d07d0 0x7f91dc16a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.801+0000 7f91e27b1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc1511c0 con 0x7f91dc0d0400 2023-10-06T02:17:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.801+0000 7f91e27b1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc1505b0 con 0x7f91dc0d07d0 2023-10-06T02:17:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.801+0000 7f91e27b1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc150890 con 0x7f91dc0ccd40 2023-10-06T02:17:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.801+0000 7f91db7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc0d0400 0x7f91dc14ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.801+0000 7f91db7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc0d0400 0x7f91dc14ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48346/0 (socket says 172.21.15.6:48346) 2023-10-06T02:17:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.801+0000 7f91db7fe700 1 -- 172.21.15.6:0/2354998223 learned_addr learned my addr 172.21.15.6:0/2354998223 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.801+0000 7f91dbfff700 1 --2- 172.21.15.6:0/2354998223 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91dc0ccd40 0x7f91dc152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.801+0000 7f91e0d4e700 1 --2- 172.21.15.6:0/2354998223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91dc0d07d0 0x7f91dc16a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.801+0000 7f91db7fe700 1 -- 172.21.15.6:0/2354998223 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91dc0ccd40 msgr2=0x7f91dc152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.801+0000 7f91db7fe700 1 --2- 172.21.15.6:0/2354998223 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91dc0ccd40 0x7f91dc152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.801+0000 7f91db7fe700 1 -- 172.21.15.6:0/2354998223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91dc0d07d0 msgr2=0x7f91dc16a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.801+0000 7f91db7fe700 1 --2- 172.21.15.6:0/2354998223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91dc0d07d0 0x7f91dc16a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.801+0000 7f91db7fe700 1 -- 172.21.15.6:0/2354998223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d00093c0 con 0x7f91dc0d0400 2023-10-06T02:17:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.801+0000 7f91db7fe700 1 --2- 172.21.15.6:0/2354998223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc0d0400 0x7f91dc14ec80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00c7e0 tx=0x7f91cc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.802+0000 7f91c3fff700 1 -- 172.21.15.6:0/2354998223 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc005b30 con 0x7f91dc0d0400 2023-10-06T02:17:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.802+0000 7f91c3fff700 1 -- 172.21.15.6:0/2354998223 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc005c90 con 0x7f91dc0d0400 2023-10-06T02:17:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.802+0000 7f91e27b1700 1 -- 172.21.15.6:0/2354998223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91dc150b70 con 0x7f91dc0d0400 2023-10-06T02:17:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.802+0000 7f91c3fff700 1 -- 172.21.15.6:0/2354998223 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc007300 con 0x7f91dc0d0400 2023-10-06T02:17:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.802+0000 7f91e27b1700 1 -- 172.21.15.6:0/2354998223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91dc153150 con 0x7f91dc0d0400 2023-10-06T02:17:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.803+0000 7f91e27b1700 1 -- 172.21.15.6:0/2354998223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91dc0d14a0 con 0x7f91dc0d0400 2023-10-06T02:17:38.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.803+0000 7f91c3fff700 1 -- 172.21.15.6:0/2354998223 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f91cc01b3b0 con 0x7f91dc0d0400 2023-10-06T02:17:38.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.803+0000 7f91c3fff700 1 --2- 172.21.15.6:0/2354998223 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f91c8066ea0 0x7f91c8069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:38.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.803+0000 7f91c3fff700 1 -- 172.21.15.6:0/2354998223 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f91cc083740 con 0x7f91dc0d0400 2023-10-06T02:17:38.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.804+0000 7f91dbfff700 1 --2- 172.21.15.6:0/2354998223 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f91c8066ea0 0x7f91c8069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:38.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.804+0000 7f91dbfff700 1 --2- 172.21.15.6:0/2354998223 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f91c8066ea0 0x7f91c8069350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009160 tx=0x7f91d0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:38.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:38.808+0000 7f91c3fff700 1 -- 172.21.15.6:0/2354998223 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91cc050c80 con 0x7f91dc0d0400 2023-10-06T02:17:39.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.004+0000 7f91e27b1700 1 -- 172.21.15.6:0/2354998223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f91dc151300 con 0x7f91dc0d0400 2023-10-06T02:17:39.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.005+0000 7f91c3fff700 1 -- 172.21.15.6:0/2354998223 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91cc0170a0 con 0x7f91dc0d0400 2023-10-06T02:17:39.005 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:17:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.007+0000 7f91e27b1700 1 -- 172.21.15.6:0/2354998223 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f91c8066ea0 msgr2=0x7f91c8069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.007+0000 7f91e27b1700 1 --2- 172.21.15.6:0/2354998223 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f91c8066ea0 0x7f91c8069350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009160 tx=0x7f91d0016000 comp rx=0 tx=0).stop 2023-10-06T02:17:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.007+0000 7f91e27b1700 1 -- 172.21.15.6:0/2354998223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc0d0400 msgr2=0x7f91dc14ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.007+0000 7f91e27b1700 1 --2- 172.21.15.6:0/2354998223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc0d0400 0x7f91dc14ec80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00c7e0 tx=0x7f91cc007df0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.007+0000 7f91e27b1700 1 -- 172.21.15.6:0/2354998223 shutdown_connections 2023-10-06T02:17:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.007+0000 7f91e27b1700 1 --2- 172.21.15.6:0/2354998223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91dc0d07d0 0x7f91dc16a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.007+0000 7f91e27b1700 1 --2- 172.21.15.6:0/2354998223 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91dc0ccd40 0x7f91dc152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.007+0000 7f91e27b1700 1 --2- 172.21.15.6:0/2354998223 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f91c8066ea0 0x7f91c8069350 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.007+0000 7f91e27b1700 1 --2- 172.21.15.6:0/2354998223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc0d0400 0x7f91dc14ec80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.007+0000 7f91e27b1700 1 -- 172.21.15.6:0/2354998223 >> 172.21.15.6:0/2354998223 conn(0x7f91dc06a220 msgr2=0x7f91dc0b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.007+0000 7f91e27b1700 1 -- 172.21.15.6:0/2354998223 shutdown_connections 2023-10-06T02:17:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.007+0000 7f91e27b1700 1 -- 172.21.15.6:0/2354998223 wait complete. 2023-10-06T02:17:39.019 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:17:39.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.141+0000 7f17950d1700 1 Processor -- start 2023-10-06T02:17:39.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.142+0000 7f17950d1700 1 -- start start 2023-10-06T02:17:39.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.142+0000 7f17950d1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17900af4e0 0x7f17900b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.142+0000 7f17950d1700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f179015db70 0x7f17900b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.142+0000 7f17950d1700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f179015e190 con 0x7f17900af8b0 2023-10-06T02:17:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.142+0000 7f17950d1700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17900b1910 con 0x7f179015db70 2023-10-06T02:17:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.142+0000 7f17950d1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179015dfb0 con 0x7f17900af4e0 2023-10-06T02:17:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.143+0000 7f178ed9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17900af4e0 0x7f17900b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.143+0000 7f178f59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f179015db70 0x7f17900b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.143+0000 7f178e59c700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f17900af8b0 0x7f179015d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:44848/0 (socket says 172.21.15.6:44848) 2023-10-06T02:17:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.143+0000 7f178ed9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17900af4e0 0x7f17900b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:46268/0 (socket says 172.21.15.6:46268) 2023-10-06T02:17:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.143+0000 7f178e59c700 1 -- 172.21.15.6:0/1492002849 learned_addr learned my addr 172.21.15.6:0/1492002849 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.143+0000 7f178f59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f179015db70 0x7f17900b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:53164/0 (socket says 172.21.15.6:53164) 2023-10-06T02:17:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.143+0000 7f178ed9d700 1 -- 172.21.15.6:0/1492002849 >> v2:172.21.15.175:3300/0 conn(0x7f179015db70 msgr2=0x7f17900b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.143+0000 7f178ed9d700 1 --2- 172.21.15.6:0/1492002849 >> v2:172.21.15.175:3300/0 conn(0x7f179015db70 0x7f17900b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.143+0000 7f178ed9d700 1 -- 172.21.15.6:0/1492002849 >> v1:172.21.15.175:6789/0 conn(0x7f17900af8b0 legacy=0x7f179015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.143+0000 7f178ed9d700 1 -- 172.21.15.6:0/1492002849 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17900cb650 con 0x7f17900af4e0 2023-10-06T02:17:39.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.143+0000 7f178f59e700 1 --2- 172.21.15.6:0/1492002849 >> v2:172.21.15.175:3300/0 conn(0x7f179015db70 0x7f17900b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:39.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.143+0000 7f178ed9d700 1 --2- 172.21.15.6:0/1492002849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17900af4e0 0x7f17900b20e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1780009e60 tx=0x7f1780009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdf9bac8b4c7a929 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:39.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.143+0000 7f178dd9b700 1 -- 172.21.15.6:0/1492002849 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178000e070 con 0x7f17900af4e0 2023-10-06T02:17:39.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.143+0000 7f178dd9b700 1 -- 172.21.15.6:0/1492002849 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178000bb60 con 0x7f17900af4e0 2023-10-06T02:17:39.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.143+0000 7f178dd9b700 1 -- 172.21.15.6:0/1492002849 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1780012430 con 0x7f17900af4e0 2023-10-06T02:17:39.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.144+0000 7f17950d1700 1 -- 172.21.15.6:0/1492002849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17900af4e0 msgr2=0x7f17900b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.144+0000 7f17950d1700 1 --2- 172.21.15.6:0/1492002849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17900af4e0 0x7f17900b20e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1780009e60 tx=0x7f1780009780 comp rx=0 tx=0).stop 2023-10-06T02:17:39.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.144+0000 7f17950d1700 1 -- 172.21.15.6:0/1492002849 shutdown_connections 2023-10-06T02:17:39.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.144+0000 7f17950d1700 1 --2- 172.21.15.6:0/1492002849 >> v2:172.21.15.175:3300/0 conn(0x7f179015db70 0x7f17900b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.144+0000 7f17950d1700 1 --2- 172.21.15.6:0/1492002849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17900af4e0 0x7f17900b20e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.144+0000 7f17950d1700 1 -- 172.21.15.6:0/1492002849 >> 172.21.15.6:0/1492002849 conn(0x7f1790068680 msgr2=0x7f1790068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:39.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.144+0000 7f17950d1700 1 -- 172.21.15.6:0/1492002849 shutdown_connections 2023-10-06T02:17:39.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.144+0000 7f17950d1700 1 -- 172.21.15.6:0/1492002849 wait complete. 2023-10-06T02:17:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.145+0000 7f17950d1700 1 Processor -- start 2023-10-06T02:17:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.145+0000 7f17950d1700 1 -- start start 2023-10-06T02:17:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.146+0000 7f17950d1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17900af4e0 0x7f179014ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.146+0000 7f17950d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17900af8b0 0x7f17900c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.146+0000 7f17950d1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179015db70 0x7f1790150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.146+0000 7f17950d1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17900b3610 con 0x7f17900af8b0 2023-10-06T02:17:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.146+0000 7f17950d1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17900b38f0 con 0x7f17900af4e0 2023-10-06T02:17:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.146+0000 7f17950d1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17900b3bd0 con 0x7f179015db70 2023-10-06T02:17:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.146+0000 7f178e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17900af8b0 0x7f17900c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.146+0000 7f178e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17900af8b0 0x7f17900c8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48358/0 (socket says 172.21.15.6:48358) 2023-10-06T02:17:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.146+0000 7f178e59c700 1 -- 172.21.15.6:0/215763433 learned_addr learned my addr 172.21.15.6:0/215763433 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.146+0000 7f178ed9d700 1 --2- 172.21.15.6:0/215763433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17900af4e0 0x7f179014ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.146+0000 7f178f59e700 1 --2- 172.21.15.6:0/215763433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179015db70 0x7f1790150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.146+0000 7f178e59c700 1 -- 172.21.15.6:0/215763433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179015db70 msgr2=0x7f1790150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.146+0000 7f178e59c700 1 --2- 172.21.15.6:0/215763433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179015db70 0x7f1790150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.146+0000 7f178e59c700 1 -- 172.21.15.6:0/215763433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17900af4e0 msgr2=0x7f179014ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.146+0000 7f178e59c700 1 --2- 172.21.15.6:0/215763433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17900af4e0 0x7f179014ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.146+0000 7f178e59c700 1 -- 172.21.15.6:0/215763433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1788009420 con 0x7f17900af8b0 2023-10-06T02:17:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.146+0000 7f178e59c700 1 --2- 172.21.15.6:0/215763433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17900af8b0 0x7f17900c8de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f177800c7c0 tx=0x7f1778007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.147+0000 7f1786ffd700 1 -- 172.21.15.6:0/215763433 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778005b30 con 0x7f17900af8b0 2023-10-06T02:17:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.147+0000 7f1786ffd700 1 -- 172.21.15.6:0/215763433 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1778005c90 con 0x7f17900af8b0 2023-10-06T02:17:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.147+0000 7f1786ffd700 1 -- 172.21.15.6:0/215763433 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778004a80 con 0x7f17900af8b0 2023-10-06T02:17:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.147+0000 7f17950d1700 1 -- 172.21.15.6:0/215763433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1780009a20 con 0x7f17900af8b0 2023-10-06T02:17:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.147+0000 7f17950d1700 1 -- 172.21.15.6:0/215763433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17901559d0 con 0x7f17900af8b0 2023-10-06T02:17:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.148+0000 7f17950d1700 1 -- 172.21.15.6:0/215763433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1790155bf0 con 0x7f17900af8b0 2023-10-06T02:17:39.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.148+0000 7f1786ffd700 1 -- 172.21.15.6:0/215763433 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f17780070d0 con 0x7f17900af8b0 2023-10-06T02:17:39.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.148+0000 7f1786ffd700 1 --2- 172.21.15.6:0/215763433 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1770066ea0 0x7f1770069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.149+0000 7f1786ffd700 1 -- 172.21.15.6:0/215763433 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1778083530 con 0x7f17900af8b0 2023-10-06T02:17:39.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.149+0000 7f178ed9d700 1 --2- 172.21.15.6:0/215763433 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1770066ea0 0x7f1770069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.149+0000 7f178ed9d700 1 --2- 172.21.15.6:0/215763433 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1770066ea0 0x7f1770069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f17800097c0 tx=0x7f1780019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.153+0000 7f1786ffd700 1 -- 172.21.15.6:0/215763433 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f177804b5a0 con 0x7f17900af8b0 2023-10-06T02:17:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.392+0000 7f17950d1700 1 -- 172.21.15.6:0/215763433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17900b0910 con 0x7f17900af8b0 2023-10-06T02:17:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.392+0000 7f1786ffd700 1 -- 172.21.15.6:0/215763433 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7f1778050b30 con 0x7f17900af8b0 2023-10-06T02:17:39.393 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:39.393 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3433510267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3433510267},{"type":"v1","addr":"172.21.15.175:6836","nonce":3433510267}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3290404467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3290404467},{"type":"v1","addr":"172.21.15.175:6837","nonce":3290404467}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/4132952009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4132952009},{"type":"v1","addr":"172.21.15.6:6834","nonce":4132952009}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/839986504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":839986504},{"type":"v1","addr":"172.21.15.6:6835","nonce":839986504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-06T02:17:39.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.394+0000 7f17950d1700 1 -- 172.21.15.6:0/215763433 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1770066ea0 msgr2=0x7f1770069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.394+0000 7f17950d1700 1 --2- 172.21.15.6:0/215763433 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1770066ea0 0x7f1770069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f17800097c0 tx=0x7f1780019000 comp rx=0 tx=0).stop 2023-10-06T02:17:39.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.394+0000 7f17950d1700 1 -- 172.21.15.6:0/215763433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17900af8b0 msgr2=0x7f17900c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.394+0000 7f17950d1700 1 --2- 172.21.15.6:0/215763433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17900af8b0 0x7f17900c8de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f177800c7c0 tx=0x7f1778007f70 comp rx=0 tx=0).stop 2023-10-06T02:17:39.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.394+0000 7f17950d1700 1 -- 172.21.15.6:0/215763433 shutdown_connections 2023-10-06T02:17:39.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.394+0000 7f17950d1700 1 --2- 172.21.15.6:0/215763433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179015db70 0x7f1790150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.394+0000 7f17950d1700 1 --2- 172.21.15.6:0/215763433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17900af4e0 0x7f179014ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.394+0000 7f17950d1700 1 --2- 172.21.15.6:0/215763433 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1770066ea0 0x7f1770069350 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.394+0000 7f17950d1700 1 --2- 172.21.15.6:0/215763433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17900af8b0 0x7f17900c8de0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.394+0000 7f17950d1700 1 -- 172.21.15.6:0/215763433 >> 172.21.15.6:0/215763433 conn(0x7f1790068680 msgr2=0x7f17900cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.395+0000 7f17950d1700 1 -- 172.21.15.6:0/215763433 shutdown_connections 2023-10-06T02:17:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.395+0000 7f17950d1700 1 -- 172.21.15.6:0/215763433 wait complete. 2023-10-06T02:17:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 3 2023-10-06T02:17:39.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:17:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.525+0000 7ff6dc127700 1 Processor -- start 2023-10-06T02:17:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.526+0000 7ff6dc127700 1 -- start start 2023-10-06T02:17:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.526+0000 7ff6dc127700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6d40c78d0 0x7ff6d40ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.526+0000 7ff6dc127700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff6d40c7ca0 0x7ff6d40cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.526+0000 7ff6dc127700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d40ca3e0 con 0x7ff6d413f930 2023-10-06T02:17:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.526+0000 7ff6dc127700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d40c95c0 con 0x7ff6d40c7ca0 2023-10-06T02:17:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.526+0000 7ff6dc127700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40c3140 con 0x7ff6d40c78d0 2023-10-06T02:17:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.526+0000 7ff6da6c4700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff6d413f930 0x7ff6d413fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55958/0 (socket says 172.21.15.6:55958) 2023-10-06T02:17:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.527+0000 7ff6da6c4700 1 -- 172.21.15.6:0/1268669760 learned_addr learned my addr 172.21.15.6:0/1268669760 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.527+0000 7ff6d96c2700 1 --2- 172.21.15.6:0/1268669760 >> v2:172.21.15.175:3300/0 conn(0x7ff6d40c7ca0 0x7ff6d40cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.527+0000 7ff6d9ec3700 1 --2- 172.21.15.6:0/1268669760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6d40c78d0 0x7ff6d40ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.527+0000 7ff6d8ec1700 1 -- 172.21.15.6:0/1268669760 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530106946 0 0) 0x7ff6d40ca3e0 con 0x7ff6d413f930 2023-10-06T02:17:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.527+0000 7ff6d8ec1700 1 -- 172.21.15.6:0/1268669760 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6bc003570 con 0x7ff6d413f930 2023-10-06T02:17:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.527+0000 7ff6d8ec1700 1 -- 172.21.15.6:0/1268669760 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2671502065 0 0) 0x7ff6bc003570 con 0x7ff6d413f930 2023-10-06T02:17:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.527+0000 7ff6d9ec3700 1 -- 172.21.15.6:0/1268669760 >> v2:172.21.15.175:3300/0 conn(0x7ff6d40c7ca0 msgr2=0x7ff6d40cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.527+0000 7ff6d9ec3700 1 --2- 172.21.15.6:0/1268669760 >> v2:172.21.15.175:3300/0 conn(0x7ff6d40c7ca0 0x7ff6d40cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.527+0000 7ff6d9ec3700 1 -- 172.21.15.6:0/1268669760 >> v1:172.21.15.6:6789/0 conn(0x7ff6d413f930 legacy=0x7ff6d413fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.527+0000 7ff6d9ec3700 1 -- 172.21.15.6:0/1268669760 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d40c97d0 con 0x7ff6d40c78d0 2023-10-06T02:17:39.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.527+0000 7ff6d96c2700 1 --2- 172.21.15.6:0/1268669760 >> v2:172.21.15.175:3300/0 conn(0x7ff6d40c7ca0 0x7ff6d40cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:39.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.527+0000 7ff6d9ec3700 1 --2- 172.21.15.6:0/1268669760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6d40c78d0 0x7ff6d40ccfd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0098e0 tx=0x7ff6cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8eceb92b10c22f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:39.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.527+0000 7ff6d8ec1700 1 -- 172.21.15.6:0/1268669760 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c40017f0 con 0x7ff6d40c78d0 2023-10-06T02:17:39.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.527+0000 7ff6d8ec1700 1 -- 172.21.15.6:0/1268669760 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc011420 con 0x7ff6d40c78d0 2023-10-06T02:17:39.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.527+0000 7ff6d8ec1700 1 -- 172.21.15.6:0/1268669760 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0117a0 con 0x7ff6d40c78d0 2023-10-06T02:17:39.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.528+0000 7ff6dc127700 1 -- 172.21.15.6:0/1268669760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6d40c78d0 msgr2=0x7ff6d40ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.528+0000 7ff6dc127700 1 --2- 172.21.15.6:0/1268669760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6d40c78d0 0x7ff6d40ccfd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0098e0 tx=0x7ff6cc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.528+0000 7ff6dc127700 1 -- 172.21.15.6:0/1268669760 shutdown_connections 2023-10-06T02:17:39.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.528+0000 7ff6dc127700 1 --2- 172.21.15.6:0/1268669760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6d40c78d0 0x7ff6d40ccfd0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.528+0000 7ff6dc127700 1 --2- 172.21.15.6:0/1268669760 >> v2:172.21.15.175:3300/0 conn(0x7ff6d40c7ca0 0x7ff6d40cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.528+0000 7ff6dc127700 1 -- 172.21.15.6:0/1268669760 >> 172.21.15.6:0/1268669760 conn(0x7ff6d4069790 msgr2=0x7ff6d4069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:39.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.528+0000 7ff6dc127700 1 -- 172.21.15.6:0/1268669760 shutdown_connections 2023-10-06T02:17:39.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.528+0000 7ff6dc127700 1 -- 172.21.15.6:0/1268669760 wait complete. 2023-10-06T02:17:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.529+0000 7ff6dc127700 1 Processor -- start 2023-10-06T02:17:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.529+0000 7ff6dc127700 1 -- start start 2023-10-06T02:17:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.530+0000 7ff6dc127700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6d40c78d0 0x7ff6d4158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.530+0000 7ff6dc127700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6d40c7ca0 0x7ff6d415b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.530+0000 7ff6dc127700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d413f930 0x7ff6d40c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.530+0000 7ff6dc127700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d4159430 con 0x7ff6d40c78d0 2023-10-06T02:17:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.530+0000 7ff6dc127700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d4158820 con 0x7ff6d413f930 2023-10-06T02:17:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.530+0000 7ff6dc127700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d4158b00 con 0x7ff6d40c7ca0 2023-10-06T02:17:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.530+0000 7ff6d9ec3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6d40c78d0 0x7ff6d4158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.530+0000 7ff6d9ec3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6d40c78d0 0x7ff6d4158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48368/0 (socket says 172.21.15.6:48368) 2023-10-06T02:17:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.530+0000 7ff6d9ec3700 1 -- 172.21.15.6:0/542636560 learned_addr learned my addr 172.21.15.6:0/542636560 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.530+0000 7ff6da6c4700 1 --2- 172.21.15.6:0/542636560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d413f930 0x7ff6d40c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.530+0000 7ff6d96c2700 1 --2- 172.21.15.6:0/542636560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6d40c7ca0 0x7ff6d415b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.530+0000 7ff6d9ec3700 1 -- 172.21.15.6:0/542636560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6d40c7ca0 msgr2=0x7ff6d415b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.530+0000 7ff6d9ec3700 1 --2- 172.21.15.6:0/542636560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6d40c7ca0 0x7ff6d415b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.530+0000 7ff6d9ec3700 1 -- 172.21.15.6:0/542636560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d413f930 msgr2=0x7ff6d40c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.530+0000 7ff6d9ec3700 1 --2- 172.21.15.6:0/542636560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d413f930 0x7ff6d40c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.530+0000 7ff6d9ec3700 1 -- 172.21.15.6:0/542636560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c8009420 con 0x7ff6d40c78d0 2023-10-06T02:17:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.530+0000 7ff6d9ec3700 1 --2- 172.21.15.6:0/542636560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6d40c78d0 0x7ff6d4158120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4067c70 tx=0x7ff6cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.531+0000 7ff6d1ffb700 1 -- 172.21.15.6:0/542636560 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc01caf0 con 0x7ff6d40c78d0 2023-10-06T02:17:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.531+0000 7ff6d1ffb700 1 -- 172.21.15.6:0/542636560 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc01cc70 con 0x7ff6d40c78d0 2023-10-06T02:17:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.531+0000 7ff6dc127700 1 -- 172.21.15.6:0/542636560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6cc009420 con 0x7ff6d40c78d0 2023-10-06T02:17:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.531+0000 7ff6d1ffb700 1 -- 172.21.15.6:0/542636560 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc01a450 con 0x7ff6d40c78d0 2023-10-06T02:17:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.531+0000 7ff6dc127700 1 -- 172.21.15.6:0/542636560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d41590c0 con 0x7ff6d40c78d0 2023-10-06T02:17:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.532+0000 7ff6dc127700 1 -- 172.21.15.6:0/542636560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d40cdf60 con 0x7ff6d40c78d0 2023-10-06T02:17:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.532+0000 7ff6d1ffb700 1 -- 172.21.15.6:0/542636560 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7ff6cc01a7e0 con 0x7ff6d40c78d0 2023-10-06T02:17:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.533+0000 7ff6d1ffb700 1 --2- 172.21.15.6:0/542636560 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff6c0066ea0 0x7ff6c0069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.533+0000 7ff6d1ffb700 1 -- 172.21.15.6:0/542636560 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff6cc085870 con 0x7ff6d40c78d0 2023-10-06T02:17:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.533+0000 7ff6d96c2700 1 --2- 172.21.15.6:0/542636560 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff6c0066ea0 0x7ff6c0069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.533+0000 7ff6d96c2700 1 --2- 172.21.15.6:0/542636560 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff6c0066ea0 0x7ff6c0069350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80093f0 tx=0x7ff6c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:39.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.537+0000 7ff6d1ffb700 1 -- 172.21.15.6:0/542636560 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6cc052dc0 con 0x7ff6d40c78d0 2023-10-06T02:17:39.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.587+0000 7ff6d1ffb700 1 -- 172.21.15.6:0/542636560 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6cc053190 con 0x7ff6d40c78d0 2023-10-06T02:17:39.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.732+0000 7ff6dc127700 1 -- 172.21.15.6:0/542636560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6d404bb80 con 0x7ff6d40c78d0 2023-10-06T02:17:39.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.733+0000 7ff6d1ffb700 1 -- 172.21.15.6:0/542636560 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13600 (secure 0 0 0) 0x7ff6cc056850 con 0x7ff6d40c78d0 2023-10-06T02:17:39.733 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:39.733 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:38.930974+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:17:39.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.735+0000 7ff6dc127700 1 -- 172.21.15.6:0/542636560 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff6c0066ea0 msgr2=0x7ff6c0069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.735+0000 7ff6dc127700 1 --2- 172.21.15.6:0/542636560 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff6c0066ea0 0x7ff6c0069350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80093f0 tx=0x7ff6c8008040 comp rx=0 tx=0).stop 2023-10-06T02:17:39.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.735+0000 7ff6dc127700 1 -- 172.21.15.6:0/542636560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6d40c78d0 msgr2=0x7ff6d4158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.735+0000 7ff6dc127700 1 --2- 172.21.15.6:0/542636560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6d40c78d0 0x7ff6d4158120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4067c70 tx=0x7ff6cc016000 comp rx=0 tx=0).stop 2023-10-06T02:17:39.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.735+0000 7ff6dc127700 1 -- 172.21.15.6:0/542636560 shutdown_connections 2023-10-06T02:17:39.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.735+0000 7ff6dc127700 1 --2- 172.21.15.6:0/542636560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d413f930 0x7ff6d40c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.735+0000 7ff6dc127700 1 --2- 172.21.15.6:0/542636560 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff6c0066ea0 0x7ff6c0069350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.735+0000 7ff6dc127700 1 --2- 172.21.15.6:0/542636560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6d40c78d0 0x7ff6d4158120 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.735+0000 7ff6dc127700 1 --2- 172.21.15.6:0/542636560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6d40c7ca0 0x7ff6d415b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.735+0000 7ff6dc127700 1 -- 172.21.15.6:0/542636560 >> 172.21.15.6:0/542636560 conn(0x7ff6d4069790 msgr2=0x7ff6d40cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:39.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.735+0000 7ff6dc127700 1 -- 172.21.15.6:0/542636560 shutdown_connections 2023-10-06T02:17:39.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.735+0000 7ff6dc127700 1 -- 172.21.15.6:0/542636560 wait complete. 2023-10-06T02:17:39.747 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T02:17:39.747 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:17:39.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.869+0000 7eff6193e700 1 Processor -- start 2023-10-06T02:17:39.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.869+0000 7eff6193e700 1 -- start start 2023-10-06T02:17:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.870+0000 7eff6193e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff5c069d80 0x7eff5c06a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.870+0000 7eff6193e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff5c0cdd60 0x7eff5c0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.870+0000 7eff6193e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5c06a730 con 0x7eff5c0cf7d0 2023-10-06T02:17:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.870+0000 7eff6193e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5c159c10 con 0x7eff5c0cdd60 2023-10-06T02:17:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.870+0000 7eff6193e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c15abd0 con 0x7eff5c069d80 2023-10-06T02:17:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.870+0000 7eff5b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff5c0cdd60 0x7eff5c0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.870+0000 7eff5b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff5c0cdd60 0x7eff5c0ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48382/0 (socket says 172.21.15.6:48382) 2023-10-06T02:17:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.870+0000 7eff5affd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7eff5c0cf7d0 0x7eff5c0cb1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55972/0 (socket says 172.21.15.6:55972) 2023-10-06T02:17:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.870+0000 7eff5b7fe700 1 -- 172.21.15.6:0/4233531675 learned_addr learned my addr 172.21.15.6:0/4233531675 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.870+0000 7eff5a7fc700 1 --2- 172.21.15.6:0/4233531675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff5c069d80 0x7eff5c06a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.870+0000 7eff5b7fe700 1 -- 172.21.15.6:0/4233531675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff5c069d80 msgr2=0x7eff5c06a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.870+0000 7eff5b7fe700 1 --2- 172.21.15.6:0/4233531675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff5c069d80 0x7eff5c06a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.870+0000 7eff5b7fe700 1 -- 172.21.15.6:0/4233531675 >> v1:172.21.15.6:6789/0 conn(0x7eff5c0cf7d0 legacy=0x7eff5c0cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.870+0000 7eff5b7fe700 1 -- 172.21.15.6:0/4233531675 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c0cbb80 con 0x7eff5c0cdd60 2023-10-06T02:17:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.870+0000 7eff59ffb700 1 -- 172.21.15.6:0/4233531675 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513187708 0 0) 0x7eff5c06a730 con 0x7eff5c0cf7d0 2023-10-06T02:17:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.870+0000 7eff5a7fc700 1 --2- 172.21.15.6:0/4233531675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff5c069d80 0x7eff5c06a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.870+0000 7eff5b7fe700 1 --2- 172.21.15.6:0/4233531675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff5c0cdd60 0x7eff5c0ce1c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009f50 tx=0x7eff4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e039ebf7f481942d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.871+0000 7eff59ffb700 1 -- 172.21.15.6:0/4233531675 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c00e070 con 0x7eff5c0cdd60 2023-10-06T02:17:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.871+0000 7eff59ffb700 1 -- 172.21.15.6:0/4233531675 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c00ba70 con 0x7eff5c0cdd60 2023-10-06T02:17:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.871+0000 7eff59ffb700 1 -- 172.21.15.6:0/4233531675 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c0092e0 con 0x7eff5c0cdd60 2023-10-06T02:17:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.871+0000 7eff6193e700 1 -- 172.21.15.6:0/4233531675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff5c0cdd60 msgr2=0x7eff5c0ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.871+0000 7eff6193e700 1 --2- 172.21.15.6:0/4233531675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff5c0cdd60 0x7eff5c0ce1c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009f50 tx=0x7eff4c009840 comp rx=0 tx=0).stop 2023-10-06T02:17:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.871+0000 7eff6193e700 1 -- 172.21.15.6:0/4233531675 shutdown_connections 2023-10-06T02:17:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.871+0000 7eff6193e700 1 --2- 172.21.15.6:0/4233531675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff5c0cdd60 0x7eff5c0ce1c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.871+0000 7eff6193e700 1 --2- 172.21.15.6:0/4233531675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff5c069d80 0x7eff5c06a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.871+0000 7eff6193e700 1 -- 172.21.15.6:0/4233531675 >> 172.21.15.6:0/4233531675 conn(0x7eff5c0d0c60 msgr2=0x7eff5c0ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.871+0000 7eff6193e700 1 -- 172.21.15.6:0/4233531675 shutdown_connections 2023-10-06T02:17:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.871+0000 7eff6193e700 1 -- 172.21.15.6:0/4233531675 wait complete. 2023-10-06T02:17:39.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.872+0000 7eff6193e700 1 Processor -- start 2023-10-06T02:17:39.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.872+0000 7eff6193e700 1 -- start start 2023-10-06T02:17:39.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.873+0000 7eff6193e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff5c069d80 0x7eff5c0ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.873+0000 7eff6193e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff5c0cdd60 0x7eff5c0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.873+0000 7eff6193e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff5c0cf7d0 0x7eff5c0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.873+0000 7eff6193e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0b45a0 con 0x7eff5c0cf7d0 2023-10-06T02:17:39.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.873+0000 7eff6193e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0ae7f0 con 0x7eff5c069d80 2023-10-06T02:17:39.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.873+0000 7eff6193e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0b3990 con 0x7eff5c0cdd60 2023-10-06T02:17:39.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.873+0000 7eff5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff5c0cf7d0 0x7eff5c0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.873+0000 7eff5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff5c0cf7d0 0x7eff5c0ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48394/0 (socket says 172.21.15.6:48394) 2023-10-06T02:17:39.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.873+0000 7eff5b7fe700 1 -- 172.21.15.6:0/2146614251 learned_addr learned my addr 172.21.15.6:0/2146614251 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:39.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.873+0000 7eff5affd700 1 --2- 172.21.15.6:0/2146614251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff5c069d80 0x7eff5c0ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.873+0000 7eff5a7fc700 1 --2- 172.21.15.6:0/2146614251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff5c0cdd60 0x7eff5c0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.874+0000 7eff5b7fe700 1 -- 172.21.15.6:0/2146614251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff5c0cdd60 msgr2=0x7eff5c0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.874+0000 7eff5b7fe700 1 --2- 172.21.15.6:0/2146614251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff5c0cdd60 0x7eff5c0c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.874+0000 7eff5b7fe700 1 -- 172.21.15.6:0/2146614251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff5c069d80 msgr2=0x7eff5c0ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:39.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.874+0000 7eff5b7fe700 1 --2- 172.21.15.6:0/2146614251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff5c069d80 0x7eff5c0ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:39.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.874+0000 7eff5b7fe700 1 -- 172.21.15.6:0/2146614251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c009ae0 con 0x7eff5c0cf7d0 2023-10-06T02:17:39.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.874+0000 7eff5affd700 1 --2- 172.21.15.6:0/2146614251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff5c069d80 0x7eff5c0ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:39.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.874+0000 7eff5b7fe700 1 --2- 172.21.15.6:0/2146614251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff5c0cf7d0 0x7eff5c0ce340 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7eff5c067b90 tx=0x7eff4c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:39.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.874+0000 7eff52ffd700 1 -- 172.21.15.6:0/2146614251 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c0032f0 con 0x7eff5c0cf7d0 2023-10-06T02:17:39.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.874+0000 7eff52ffd700 1 -- 172.21.15.6:0/2146614251 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c026460 con 0x7eff5c0cf7d0 2023-10-06T02:17:39.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.874+0000 7eff6193e700 1 -- 172.21.15.6:0/2146614251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5c0b3c70 con 0x7eff5c0cf7d0 2023-10-06T02:17:39.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.874+0000 7eff52ffd700 1 -- 172.21.15.6:0/2146614251 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c026820 con 0x7eff5c0cf7d0 2023-10-06T02:17:39.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.874+0000 7eff6193e700 1 -- 172.21.15.6:0/2146614251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5c0b4230 con 0x7eff5c0cf7d0 2023-10-06T02:17:39.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.875+0000 7eff6193e700 1 -- 172.21.15.6:0/2146614251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5c064f20 con 0x7eff5c0cf7d0 2023-10-06T02:17:39.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.875+0000 7eff52ffd700 1 -- 172.21.15.6:0/2146614251 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff4c003040 con 0x7eff5c0cf7d0 2023-10-06T02:17:39.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.876+0000 7eff52ffd700 1 --2- 172.21.15.6:0/2146614251 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff3c066f30 0x7eff3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:39.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.876+0000 7eff52ffd700 1 -- 172.21.15.6:0/2146614251 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7eff4c085dc0 con 0x7eff5c0cf7d0 2023-10-06T02:17:39.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.876+0000 7eff5affd700 1 --2- 172.21.15.6:0/2146614251 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff3c066f30 0x7eff3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:39.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.876+0000 7eff5affd700 1 --2- 172.21.15.6:0/2146614251 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff3c066f30 0x7eff3c0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff540011e0 tx=0x7eff54007c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:39.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:39.880+0000 7eff52ffd700 1 -- 172.21.15.6:0/2146614251 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff4c0532d0 con 0x7eff5c0cf7d0 2023-10-06T02:17:40.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.074+0000 7eff6193e700 1 -- 172.21.15.6:0/2146614251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7eff5c064aa0 con 0x7eff5c0cf7d0 2023-10-06T02:17:40.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.075+0000 7eff52ffd700 1 -- 172.21.15.6:0/2146614251 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7eff4c0568f0 con 0x7eff5c0cf7d0 2023-10-06T02:17:40.075 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:17:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.077+0000 7eff6193e700 1 -- 172.21.15.6:0/2146614251 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff3c066f30 msgr2=0x7eff3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.077+0000 7eff6193e700 1 --2- 172.21.15.6:0/2146614251 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff3c066f30 0x7eff3c0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff540011e0 tx=0x7eff54007c90 comp rx=0 tx=0).stop 2023-10-06T02:17:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.077+0000 7eff6193e700 1 -- 172.21.15.6:0/2146614251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff5c0cf7d0 msgr2=0x7eff5c0ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.077+0000 7eff6193e700 1 --2- 172.21.15.6:0/2146614251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff5c0cf7d0 0x7eff5c0ce340 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7eff5c067b90 tx=0x7eff4c018000 comp rx=0 tx=0).stop 2023-10-06T02:17:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.077+0000 7eff6193e700 1 -- 172.21.15.6:0/2146614251 shutdown_connections 2023-10-06T02:17:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.077+0000 7eff6193e700 1 --2- 172.21.15.6:0/2146614251 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff3c066f30 0x7eff3c0693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.077+0000 7eff6193e700 1 --2- 172.21.15.6:0/2146614251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff5c0cf7d0 0x7eff5c0ce340 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.077+0000 7eff6193e700 1 --2- 172.21.15.6:0/2146614251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff5c069d80 0x7eff5c0ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.077+0000 7eff6193e700 1 --2- 172.21.15.6:0/2146614251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff5c0cdd60 0x7eff5c0c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.077+0000 7eff6193e700 1 -- 172.21.15.6:0/2146614251 >> 172.21.15.6:0/2146614251 conn(0x7eff5c0d0c60 msgr2=0x7eff5c0ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.077+0000 7eff6193e700 1 -- 172.21.15.6:0/2146614251 shutdown_connections 2023-10-06T02:17:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.077+0000 7eff6193e700 1 -- 172.21.15.6:0/2146614251 wait complete. 2023-10-06T02:17:40.089 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:17:40.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.210+0000 7f9343d80700 1 Processor -- start 2023-10-06T02:17:40.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.210+0000 7f9343d80700 1 -- start start 2023-10-06T02:17:40.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f9343d80700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f933c0d0400 0x7f933c0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f9343d80700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f933c0ccd40 0x7f933c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f9343d80700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f933c0cf7e0 0x7f933c0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f9343d80700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933c0b6170 con 0x7f933c0d0400 2023-10-06T02:17:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f9343d80700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933c15dd40 con 0x7f933c0ccd40 2023-10-06T02:17:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f9343d80700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933c15e020 con 0x7f933c0cf7e0 2023-10-06T02:17:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f9341b1c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f933c0d0400 0x7f933c0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f9341b1c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f933c0d0400 0x7f933c0b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48402/0 (socket says 172.21.15.6:48402) 2023-10-06T02:17:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f9341b1c700 1 -- 172.21.15.6:0/2068557691 learned_addr learned my addr 172.21.15.6:0/2068557691 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f934131b700 1 --2- 172.21.15.6:0/2068557691 >> v2:172.21.15.175:3300/0 conn(0x7f933c0ccd40 0x7f933c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f9341b1c700 1 -- 172.21.15.6:0/2068557691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f933c0cf7e0 msgr2=0x7f933c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f934231d700 1 --2- 172.21.15.6:0/2068557691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f933c0cf7e0 0x7f933c0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f9341b1c700 1 --2- 172.21.15.6:0/2068557691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f933c0cf7e0 0x7f933c0b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f9341b1c700 1 -- 172.21.15.6:0/2068557691 >> v2:172.21.15.175:3300/0 conn(0x7f933c0ccd40 msgr2=0x7f933c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f9341b1c700 1 --2- 172.21.15.6:0/2068557691 >> v2:172.21.15.175:3300/0 conn(0x7f933c0ccd40 0x7f933c0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f9341b1c700 1 -- 172.21.15.6:0/2068557691 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c0ceaa0 con 0x7f933c0d0400 2023-10-06T02:17:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f934131b700 1 --2- 172.21.15.6:0/2068557691 >> v2:172.21.15.175:3300/0 conn(0x7f933c0ccd40 0x7f933c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:17:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f934231d700 1 --2- 172.21.15.6:0/2068557691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f933c0cf7e0 0x7f933c0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:17:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.211+0000 7f9341b1c700 1 --2- 172.21.15.6:0/2068557691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f933c0d0400 0x7f933c0b5c30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f933c0cd1c0 tx=0x7f932c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5a7e796ae16d71 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.212+0000 7f9340b1a700 1 -- 172.21.15.6:0/2068557691 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c00e070 con 0x7f933c0d0400 2023-10-06T02:17:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.212+0000 7f9340b1a700 1 -- 172.21.15.6:0/2068557691 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c00bad0 con 0x7f933c0d0400 2023-10-06T02:17:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.212+0000 7f9340b1a700 1 -- 172.21.15.6:0/2068557691 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c0092e0 con 0x7f933c0d0400 2023-10-06T02:17:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.212+0000 7f9343d80700 1 -- 172.21.15.6:0/2068557691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f933c0d0400 msgr2=0x7f933c0b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.212+0000 7f9343d80700 1 --2- 172.21.15.6:0/2068557691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f933c0d0400 0x7f933c0b5c30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f933c0cd1c0 tx=0x7f932c009840 comp rx=0 tx=0).stop 2023-10-06T02:17:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.212+0000 7f9343d80700 1 -- 172.21.15.6:0/2068557691 shutdown_connections 2023-10-06T02:17:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.212+0000 7f9343d80700 1 --2- 172.21.15.6:0/2068557691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f933c0cf7e0 0x7f933c0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.212+0000 7f9343d80700 1 --2- 172.21.15.6:0/2068557691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f933c0d0400 0x7f933c0b5c30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.212+0000 7f9343d80700 1 --2- 172.21.15.6:0/2068557691 >> v2:172.21.15.175:3300/0 conn(0x7f933c0ccd40 0x7f933c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.212+0000 7f9343d80700 1 -- 172.21.15.6:0/2068557691 >> 172.21.15.6:0/2068557691 conn(0x7f933c06a220 msgr2=0x7f933c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.212+0000 7f9343d80700 1 -- 172.21.15.6:0/2068557691 shutdown_connections 2023-10-06T02:17:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.212+0000 7f9343d80700 1 -- 172.21.15.6:0/2068557691 wait complete. 2023-10-06T02:17:40.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.213+0000 7f9343d80700 1 Processor -- start 2023-10-06T02:17:40.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.213+0000 7f9343d80700 1 -- start start 2023-10-06T02:17:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.214+0000 7f9343d80700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f933c0ccd40 0x7f933c146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.214+0000 7f9343d80700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f933c0cf7e0 0x7f933c0ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.214+0000 7f9343d80700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933c0d0400 0x7f933c0c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.214+0000 7f9343d80700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0cbc10 con 0x7f933c0ccd40 2023-10-06T02:17:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.214+0000 7f9343d80700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0cb000 con 0x7f933c0d0400 2023-10-06T02:17:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.214+0000 7f9343d80700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0cb2e0 con 0x7f933c0cf7e0 2023-10-06T02:17:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.214+0000 7f9341b1c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f933c0ccd40 0x7f933c146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.214+0000 7f9341b1c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f933c0ccd40 0x7f933c146ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48418/0 (socket says 172.21.15.6:48418) 2023-10-06T02:17:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.214+0000 7f9341b1c700 1 -- 172.21.15.6:0/18456497 learned_addr learned my addr 172.21.15.6:0/18456497 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.214+0000 7f934231d700 1 --2- 172.21.15.6:0/18456497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933c0d0400 0x7f933c0c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.214+0000 7f934131b700 1 --2- 172.21.15.6:0/18456497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f933c0cf7e0 0x7f933c0ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.214+0000 7f9341b1c700 1 -- 172.21.15.6:0/18456497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f933c0cf7e0 msgr2=0x7f933c0ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:40.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.214+0000 7f9341b1c700 1 --2- 172.21.15.6:0/18456497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f933c0cf7e0 0x7f933c0ca680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.214+0000 7f9341b1c700 1 -- 172.21.15.6:0/18456497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933c0d0400 msgr2=0x7f933c0c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:40.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.214+0000 7f9341b1c700 1 --2- 172.21.15.6:0/18456497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933c0d0400 0x7f933c0c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.214+0000 7f9341b1c700 1 -- 172.21.15.6:0/18456497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c009ae0 con 0x7f933c0ccd40 2023-10-06T02:17:40.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.214+0000 7f934231d700 1 --2- 172.21.15.6:0/18456497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933c0d0400 0x7f933c0c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:17:40.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.215+0000 7f9341b1c700 1 --2- 172.21.15.6:0/18456497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f933c0ccd40 0x7f933c146ed0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f932c009430 tx=0x7f932c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:40.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.215+0000 7f9339ffb700 1 -- 172.21.15.6:0/18456497 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c008bb0 con 0x7f933c0ccd40 2023-10-06T02:17:40.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.215+0000 7f9339ffb700 1 -- 172.21.15.6:0/18456497 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c008d50 con 0x7f933c0ccd40 2023-10-06T02:17:40.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.215+0000 7f9343d80700 1 -- 172.21.15.6:0/18456497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933c0cb5c0 con 0x7f933c0ccd40 2023-10-06T02:17:40.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.215+0000 7f9339ffb700 1 -- 172.21.15.6:0/18456497 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c0266b0 con 0x7f933c0ccd40 2023-10-06T02:17:40.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.215+0000 7f9343d80700 1 -- 172.21.15.6:0/18456497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f933c147410 con 0x7f933c0ccd40 2023-10-06T02:17:40.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.216+0000 7f9343d80700 1 -- 172.21.15.6:0/18456497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f933c088760 con 0x7f933c0ccd40 2023-10-06T02:17:40.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.216+0000 7f9339ffb700 1 -- 172.21.15.6:0/18456497 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f932c003040 con 0x7f933c0ccd40 2023-10-06T02:17:40.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.217+0000 7f9339ffb700 1 --2- 172.21.15.6:0/18456497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9328066f30 0x7f93280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.217+0000 7f9339ffb700 1 -- 172.21.15.6:0/18456497 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f932c0861e0 con 0x7f933c0ccd40 2023-10-06T02:17:40.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.217+0000 7f934131b700 1 --2- 172.21.15.6:0/18456497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9328066f30 0x7f93280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.217+0000 7f934131b700 1 --2- 172.21.15.6:0/18456497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9328066f30 0x7f93280693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9330006fd0 tx=0x7f9330008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:40.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.221+0000 7f9339ffb700 1 -- 172.21.15.6:0/18456497 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f932c053640 con 0x7f933c0ccd40 2023-10-06T02:17:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.416+0000 7f9343d80700 1 -- 172.21.15.6:0/18456497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f933c0ced80 con 0x7f933c0ccd40 2023-10-06T02:17:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.416+0000 7f9339ffb700 1 -- 172.21.15.6:0/18456497 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f932c056c60 con 0x7f933c0ccd40 2023-10-06T02:17:40.416 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:17:40.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.418+0000 7f9343d80700 1 -- 172.21.15.6:0/18456497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9328066f30 msgr2=0x7f93280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.418+0000 7f9343d80700 1 --2- 172.21.15.6:0/18456497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9328066f30 0x7f93280693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9330006fd0 tx=0x7f9330008040 comp rx=0 tx=0).stop 2023-10-06T02:17:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.418+0000 7f9343d80700 1 -- 172.21.15.6:0/18456497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f933c0ccd40 msgr2=0x7f933c146ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.418+0000 7f9343d80700 1 --2- 172.21.15.6:0/18456497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f933c0ccd40 0x7f933c146ed0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f932c009430 tx=0x7f932c018000 comp rx=0 tx=0).stop 2023-10-06T02:17:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.418+0000 7f9343d80700 1 -- 172.21.15.6:0/18456497 shutdown_connections 2023-10-06T02:17:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.418+0000 7f9343d80700 1 --2- 172.21.15.6:0/18456497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933c0d0400 0x7f933c0c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.418+0000 7f9343d80700 1 --2- 172.21.15.6:0/18456497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9328066f30 0x7f93280693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.418+0000 7f9343d80700 1 --2- 172.21.15.6:0/18456497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f933c0ccd40 0x7f933c146ed0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.418+0000 7f9343d80700 1 --2- 172.21.15.6:0/18456497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f933c0cf7e0 0x7f933c0ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.418+0000 7f9343d80700 1 -- 172.21.15.6:0/18456497 >> 172.21.15.6:0/18456497 conn(0x7f933c06a220 msgr2=0x7f933c0b2340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.418+0000 7f9343d80700 1 -- 172.21.15.6:0/18456497 shutdown_connections 2023-10-06T02:17:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.418+0000 7f9343d80700 1 -- 172.21.15.6:0/18456497 wait complete. 2023-10-06T02:17:40.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:17:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.549+0000 7f8ecdc93700 1 Processor -- start 2023-10-06T02:17:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.549+0000 7f8ecdc93700 1 -- start start 2023-10-06T02:17:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.549+0000 7f8ecdc93700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ec815b3c0 0x7f8ec8097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.549+0000 7f8ecdc93700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8ec80b3c50 0x7f8ec815b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.549+0000 7f8ecdc93700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec80afb90 con 0x7f8ec815bcd0 2023-10-06T02:17:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.549+0000 7f8ecdc93700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec80b2310 con 0x7f8ec815b3c0 2023-10-06T02:17:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.549+0000 7f8ecdc93700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec80b25f0 con 0x7f8ec80b3c50 2023-10-06T02:17:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.549+0000 7f8ec77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ec815b3c0 0x7f8ec8097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.550+0000 7f8ec77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ec815b3c0 0x7f8ec8097d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48424/0 (socket says 172.21.15.6:48424) 2023-10-06T02:17:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.550+0000 7f8ec77fe700 1 -- 172.21.15.6:0/2484607968 learned_addr learned my addr 172.21.15.6:0/2484607968 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.550+0000 7f8ec77fe700 1 -- 172.21.15.6:0/2484607968 >> v2:172.21.15.175:3300/0 conn(0x7f8ec80b3c50 msgr2=0x7f8ec815b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.550+0000 7f8ec77fe700 1 --2- 172.21.15.6:0/2484607968 >> v2:172.21.15.175:3300/0 conn(0x7f8ec80b3c50 0x7f8ec815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.550+0000 7f8ec77fe700 1 -- 172.21.15.6:0/2484607968 >> v1:172.21.15.175:6789/0 conn(0x7f8ec815bcd0 legacy=0x7f8ec815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.550+0000 7f8ec77fe700 1 -- 172.21.15.6:0/2484607968 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec80af820 con 0x7f8ec815b3c0 2023-10-06T02:17:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.550+0000 7f8ec77fe700 1 --2- 172.21.15.6:0/2484607968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ec815b3c0 0x7f8ec8097d70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8ec806f9c0 tx=0x7f8eb8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc065314d65b3540 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.550+0000 7f8ec67fc700 1 -- 172.21.15.6:0/2484607968 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8005c10 con 0x7f8ec815b3c0 2023-10-06T02:17:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.550+0000 7f8ec67fc700 1 -- 172.21.15.6:0/2484607968 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb8005d70 con 0x7f8ec815b3c0 2023-10-06T02:17:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.550+0000 7f8ec67fc700 1 -- 172.21.15.6:0/2484607968 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb800b860 con 0x7f8ec815b3c0 2023-10-06T02:17:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.551+0000 7f8ecdc93700 1 -- 172.21.15.6:0/2484607968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ec815b3c0 msgr2=0x7f8ec8097d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.551+0000 7f8ecdc93700 1 --2- 172.21.15.6:0/2484607968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ec815b3c0 0x7f8ec8097d70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8ec806f9c0 tx=0x7f8eb8009220 comp rx=0 tx=0).stop 2023-10-06T02:17:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.551+0000 7f8ecdc93700 1 -- 172.21.15.6:0/2484607968 shutdown_connections 2023-10-06T02:17:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.551+0000 7f8ecdc93700 1 --2- 172.21.15.6:0/2484607968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ec815b3c0 0x7f8ec8097d70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.551+0000 7f8ecdc93700 1 --2- 172.21.15.6:0/2484607968 >> v2:172.21.15.175:3300/0 conn(0x7f8ec80b3c50 0x7f8ec815b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.551+0000 7f8ecdc93700 1 -- 172.21.15.6:0/2484607968 >> 172.21.15.6:0/2484607968 conn(0x7f8ec8067910 msgr2=0x7f8ec80ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.551+0000 7f8ecdc93700 1 -- 172.21.15.6:0/2484607968 shutdown_connections 2023-10-06T02:17:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.551+0000 7f8ecdc93700 1 -- 172.21.15.6:0/2484607968 wait complete. 2023-10-06T02:17:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.552+0000 7f8ecdc93700 1 Processor -- start 2023-10-06T02:17:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.552+0000 7f8ecdc93700 1 -- start start 2023-10-06T02:17:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8ecdc93700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ec80b3c50 0x7f8ec80a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8ecdc93700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec815b3c0 0x7f8ec8168930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8ecdc93700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ec815bcd0 0x7f8ec8157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8ecdc93700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec80a9770 con 0x7f8ec815bcd0 2023-10-06T02:17:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8ecdc93700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec80c3b60 con 0x7f8ec80b3c50 2023-10-06T02:17:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8ecdc93700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec80a89b0 con 0x7f8ec815b3c0 2023-10-06T02:17:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8ec7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ec815bcd0 0x7f8ec8157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8ec7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ec815bcd0 0x7f8ec8157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48438/0 (socket says 172.21.15.6:48438) 2023-10-06T02:17:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8ec7fff700 1 -- 172.21.15.6:0/3361502620 learned_addr learned my addr 172.21.15.6:0/3361502620 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8ec77fe700 1 --2- 172.21.15.6:0/3361502620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ec80b3c50 0x7f8ec80a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8ec6ffd700 1 --2- 172.21.15.6:0/3361502620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec815b3c0 0x7f8ec8168930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8ec7fff700 1 -- 172.21.15.6:0/3361502620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec815b3c0 msgr2=0x7f8ec8168930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8ec7fff700 1 --2- 172.21.15.6:0/3361502620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec815b3c0 0x7f8ec8168930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8ec7fff700 1 -- 172.21.15.6:0/3361502620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ec80b3c50 msgr2=0x7f8ec80a9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8ec7fff700 1 --2- 172.21.15.6:0/3361502620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ec80b3c50 0x7f8ec80a9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8ec7fff700 1 -- 172.21.15.6:0/3361502620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb8009480 con 0x7f8ec815bcd0 2023-10-06T02:17:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8ec7fff700 1 --2- 172.21.15.6:0/3361502620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ec815bcd0 0x7f8ec8157550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000bbb0 tx=0x7f8ec0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.553+0000 7f8eaf7fe700 1 -- 172.21.15.6:0/3361502620 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec00092e0 con 0x7f8ec815bcd0 2023-10-06T02:17:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.554+0000 7f8eaf7fe700 1 -- 172.21.15.6:0/3361502620 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec000c630 con 0x7f8ec815bcd0 2023-10-06T02:17:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.554+0000 7f8ecdc93700 1 -- 172.21.15.6:0/3361502620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec80a9120 con 0x7f8ec815bcd0 2023-10-06T02:17:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.554+0000 7f8eaf7fe700 1 -- 172.21.15.6:0/3361502620 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000c9f0 con 0x7f8ec815bcd0 2023-10-06T02:17:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.554+0000 7f8ecdc93700 1 -- 172.21.15.6:0/3361502620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec8168e70 con 0x7f8ec815bcd0 2023-10-06T02:17:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.554+0000 7f8ecdc93700 1 -- 172.21.15.6:0/3361502620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec80a8f80 con 0x7f8ec815bcd0 2023-10-06T02:17:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.555+0000 7f8eaf7fe700 1 -- 172.21.15.6:0/3361502620 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ec0012070 con 0x7f8ec815bcd0 2023-10-06T02:17:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.555+0000 7f8eaf7fe700 1 --2- 172.21.15.6:0/3361502620 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8eb4066f30 0x7f8eb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.555+0000 7f8eaf7fe700 1 -- 172.21.15.6:0/3361502620 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8ec0083fe0 con 0x7f8ec815bcd0 2023-10-06T02:17:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.555+0000 7f8ec77fe700 1 --2- 172.21.15.6:0/3361502620 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8eb4066f30 0x7f8eb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.556+0000 7f8ec77fe700 1 --2- 172.21.15.6:0/3361502620 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8eb4066f30 0x7f8eb40693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8007fd0 tx=0x7f8eb8015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.560+0000 7f8eaf7fe700 1 -- 172.21.15.6:0/3361502620 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ec80a8f80 con 0x7f8ec815bcd0 2023-10-06T02:17:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.754+0000 7f8ecdc93700 1 -- 172.21.15.6:0/3361502620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8ec80a8f80 con 0x7f8ec815bcd0 2023-10-06T02:17:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.754+0000 7f8eaf7fe700 1 -- 172.21.15.6:0/3361502620 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8ec80a8f80 con 0x7f8ec815bcd0 2023-10-06T02:17:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:40.755 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-06T02:17:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:17:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-06T02:17:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-10-06T02:17:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:17:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:17:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-10-06T02:17:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-06T02:17:40.756 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:17:40.756 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-06T02:17:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.756+0000 7f8ecdc93700 1 -- 172.21.15.6:0/3361502620 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8eb4066f30 msgr2=0x7f8eb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.756+0000 7f8ecdc93700 1 --2- 172.21.15.6:0/3361502620 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8eb4066f30 0x7f8eb40693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8007fd0 tx=0x7f8eb8015000 comp rx=0 tx=0).stop 2023-10-06T02:17:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.756+0000 7f8ecdc93700 1 -- 172.21.15.6:0/3361502620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ec815bcd0 msgr2=0x7f8ec8157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.756+0000 7f8ecdc93700 1 --2- 172.21.15.6:0/3361502620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ec815bcd0 0x7f8ec8157550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000bbb0 tx=0x7f8ec0009840 comp rx=0 tx=0).stop 2023-10-06T02:17:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.756+0000 7f8ecdc93700 1 -- 172.21.15.6:0/3361502620 shutdown_connections 2023-10-06T02:17:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.756+0000 7f8ecdc93700 1 --2- 172.21.15.6:0/3361502620 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8eb4066f30 0x7f8eb40693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.756+0000 7f8ecdc93700 1 --2- 172.21.15.6:0/3361502620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ec815bcd0 0x7f8ec8157550 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.756+0000 7f8ecdc93700 1 --2- 172.21.15.6:0/3361502620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ec80b3c50 0x7f8ec80a9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.756+0000 7f8ecdc93700 1 --2- 172.21.15.6:0/3361502620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec815b3c0 0x7f8ec8168930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.756+0000 7f8ecdc93700 1 -- 172.21.15.6:0/3361502620 >> 172.21.15.6:0/3361502620 conn(0x7f8ec8067910 msgr2=0x7f8ec806d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:40.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.756+0000 7f8ecdc93700 1 -- 172.21.15.6:0/3361502620 shutdown_connections 2023-10-06T02:17:40.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.756+0000 7f8ecdc93700 1 -- 172.21.15.6:0/3361502620 wait complete. 2023-10-06T02:17:40.768 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:17:40.769 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:17:40.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.891+0000 7f2c68692700 1 Processor -- start 2023-10-06T02:17:40.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.891+0000 7f2c68692700 1 -- start start 2023-10-06T02:17:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.892+0000 7f2c68692700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2c600cfa90 0x7f2c600d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.892+0000 7f2c68692700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c600d07a0 0x7f2c60163060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.892+0000 7f2c68692700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6015a710 con 0x7f2c60142df0 2023-10-06T02:17:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.892+0000 7f2c68692700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c600d0c20 con 0x7f2c600cfa90 2023-10-06T02:17:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.892+0000 7f2c68692700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c60159b40 con 0x7f2c600d07a0 2023-10-06T02:17:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.892+0000 7f2c65c2d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2c600cfa90 0x7f2c600d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.892+0000 7f2c6642e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2c60142df0 0x7f2c600cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55982/0 (socket says 172.21.15.6:55982) 2023-10-06T02:17:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.892+0000 7f2c6642e700 1 -- 172.21.15.6:0/193522309 learned_addr learned my addr 172.21.15.6:0/193522309 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.892+0000 7f2c65c2d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2c600cfa90 0x7f2c600d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48442/0 (socket says 172.21.15.6:48442) 2023-10-06T02:17:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.892+0000 7f2c66c2f700 1 --2- 172.21.15.6:0/193522309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c600d07a0 0x7f2c60163060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.893+0000 7f2c65c2d700 1 -- 172.21.15.6:0/193522309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c600d07a0 msgr2=0x7f2c60163060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:40.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.893+0000 7f2c65c2d700 1 --2- 172.21.15.6:0/193522309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c600d07a0 0x7f2c60163060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.893+0000 7f2c65c2d700 1 -- 172.21.15.6:0/193522309 >> v1:172.21.15.6:6789/0 conn(0x7f2c60142df0 legacy=0x7f2c600cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:40.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.893+0000 7f2c6542c700 1 -- 172.21.15.6:0/193522309 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719548590 0 0) 0x7f2c6015a710 con 0x7f2c60142df0 2023-10-06T02:17:40.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.893+0000 7f2c65c2d700 1 -- 172.21.15.6:0/193522309 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c60159de0 con 0x7f2c600cfa90 2023-10-06T02:17:40.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.893+0000 7f2c65c2d700 1 --2- 172.21.15.6:0/193522309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c600cfa90 0x7f2c600d0260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009910 tx=0x7f2c540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38013ec2d3aefa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:40.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.893+0000 7f2c6542c700 1 -- 172.21.15.6:0/193522309 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5400b820 con 0x7f2c600cfa90 2023-10-06T02:17:40.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.893+0000 7f2c6542c700 1 -- 172.21.15.6:0/193522309 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5400b980 con 0x7f2c600cfa90 2023-10-06T02:17:40.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.893+0000 7f2c6542c700 1 -- 172.21.15.6:0/193522309 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5400bd20 con 0x7f2c600cfa90 2023-10-06T02:17:40.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.893+0000 7f2c68692700 1 -- 172.21.15.6:0/193522309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c600cfa90 msgr2=0x7f2c600d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:40.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.893+0000 7f2c68692700 1 --2- 172.21.15.6:0/193522309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c600cfa90 0x7f2c600d0260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009910 tx=0x7f2c540091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.894+0000 7f2c68692700 1 -- 172.21.15.6:0/193522309 shutdown_connections 2023-10-06T02:17:40.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.894+0000 7f2c68692700 1 --2- 172.21.15.6:0/193522309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c600d07a0 0x7f2c60163060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.894+0000 7f2c68692700 1 --2- 172.21.15.6:0/193522309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c600cfa90 0x7f2c600d0260 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.894+0000 7f2c68692700 1 -- 172.21.15.6:0/193522309 >> 172.21.15.6:0/193522309 conn(0x7f2c600690f0 msgr2=0x7f2c6006a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:40.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.894+0000 7f2c68692700 1 -- 172.21.15.6:0/193522309 shutdown_connections 2023-10-06T02:17:40.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.894+0000 7f2c68692700 1 -- 172.21.15.6:0/193522309 wait complete. 2023-10-06T02:17:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.895+0000 7f2c68692700 1 Processor -- start 2023-10-06T02:17:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.895+0000 7f2c68692700 1 -- start start 2023-10-06T02:17:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.895+0000 7f2c68692700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c600cfa90 0x7f2c60169bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.895+0000 7f2c68692700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c600d07a0 0x7f2c600b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.895+0000 7f2c68692700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c60142df0 0x7f2c600b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.895+0000 7f2c68692700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c60155510 con 0x7f2c600cfa90 2023-10-06T02:17:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.895+0000 7f2c68692700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c601557f0 con 0x7f2c60142df0 2023-10-06T02:17:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.895+0000 7f2c68692700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c60155ad0 con 0x7f2c600d07a0 2023-10-06T02:17:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.895+0000 7f2c6642e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c600cfa90 0x7f2c60169bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.895+0000 7f2c6642e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c600cfa90 0x7f2c60169bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48452/0 (socket says 172.21.15.6:48452) 2023-10-06T02:17:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.895+0000 7f2c6642e700 1 -- 172.21.15.6:0/2185236608 learned_addr learned my addr 172.21.15.6:0/2185236608 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.896+0000 7f2c65c2d700 1 --2- 172.21.15.6:0/2185236608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c600d07a0 0x7f2c600b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.896+0000 7f2c66c2f700 1 --2- 172.21.15.6:0/2185236608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c60142df0 0x7f2c600b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.896+0000 7f2c6642e700 1 -- 172.21.15.6:0/2185236608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c600d07a0 msgr2=0x7f2c600b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.896+0000 7f2c6642e700 1 --2- 172.21.15.6:0/2185236608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c600d07a0 0x7f2c600b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.896+0000 7f2c6642e700 1 -- 172.21.15.6:0/2185236608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c60142df0 msgr2=0x7f2c600b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.896+0000 7f2c6642e700 1 --2- 172.21.15.6:0/2185236608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c60142df0 0x7f2c600b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.896+0000 7f2c6642e700 1 -- 172.21.15.6:0/2185236608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c54009420 con 0x7f2c600cfa90 2023-10-06T02:17:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.896+0000 7f2c65c2d700 1 --2- 172.21.15.6:0/2185236608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c600d07a0 0x7f2c600b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.896+0000 7f2c6642e700 1 --2- 172.21.15.6:0/2185236608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c600cfa90 0x7f2c60169bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800c7e0 tx=0x7f2c58007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.896+0000 7f2c5e7fc700 1 -- 172.21.15.6:0/2185236608 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58005b30 con 0x7f2c600cfa90 2023-10-06T02:17:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.896+0000 7f2c5e7fc700 1 -- 172.21.15.6:0/2185236608 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c58005c90 con 0x7f2c600cfa90 2023-10-06T02:17:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.896+0000 7f2c68692700 1 -- 172.21.15.6:0/2185236608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c60155db0 con 0x7f2c600cfa90 2023-10-06T02:17:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.896+0000 7f2c5e7fc700 1 -- 172.21.15.6:0/2185236608 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58007300 con 0x7f2c600cfa90 2023-10-06T02:17:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.896+0000 7f2c68692700 1 -- 172.21.15.6:0/2185236608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6016a180 con 0x7f2c600cfa90 2023-10-06T02:17:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.897+0000 7f2c68692700 1 -- 172.21.15.6:0/2185236608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c601562d0 con 0x7f2c600cfa90 2023-10-06T02:17:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.897+0000 7f2c5e7fc700 1 -- 172.21.15.6:0/2185236608 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c5801b400 con 0x7f2c600cfa90 2023-10-06T02:17:40.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.898+0000 7f2c5e7fc700 1 --2- 172.21.15.6:0/2185236608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c4c066f30 0x7f2c4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:40.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.898+0000 7f2c5e7fc700 1 -- 172.21.15.6:0/2185236608 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2c58083e50 con 0x7f2c600cfa90 2023-10-06T02:17:40.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.898+0000 7f2c65c2d700 1 --2- 172.21.15.6:0/2185236608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c4c066f30 0x7f2c4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:40.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.898+0000 7f2c65c2d700 1 --2- 172.21.15.6:0/2185236608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c4c066f30 0x7f2c4c0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2c540098e0 tx=0x7f2c54017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:40.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:40.902+0000 7f2c5e7fc700 1 -- 172.21.15.6:0/2185236608 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c601562d0 con 0x7f2c600cfa90 2023-10-06T02:17:41.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:41.096+0000 7f2c68692700 1 -- 172.21.15.6:0/2185236608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2c601562d0 con 0x7f2c600cfa90 2023-10-06T02:17:41.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:41.988+0000 7f2c5e7fc700 1 -- 172.21.15.6:0/2185236608 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2c601562d0 con 0x7f2c600cfa90 2023-10-06T02:17:41.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:41.993+0000 7f2c68692700 1 -- 172.21.15.6:0/2185236608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c4c066f30 msgr2=0x7f2c4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:41.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:41.993+0000 7f2c68692700 1 --2- 172.21.15.6:0/2185236608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c4c066f30 0x7f2c4c0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2c540098e0 tx=0x7f2c54017000 comp rx=0 tx=0).stop 2023-10-06T02:17:41.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:41.993+0000 7f2c68692700 1 -- 172.21.15.6:0/2185236608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c600cfa90 msgr2=0x7f2c60169bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:41.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:41.993+0000 7f2c68692700 1 --2- 172.21.15.6:0/2185236608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c600cfa90 0x7f2c60169bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800c7e0 tx=0x7f2c58007df0 comp rx=0 tx=0).stop 2023-10-06T02:17:41.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:41.993+0000 7f2c68692700 1 -- 172.21.15.6:0/2185236608 shutdown_connections 2023-10-06T02:17:41.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:41.993+0000 7f2c68692700 1 --2- 172.21.15.6:0/2185236608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c60142df0 0x7f2c600b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:41.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:41.993+0000 7f2c68692700 1 --2- 172.21.15.6:0/2185236608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c4c066f30 0x7f2c4c0693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:41.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:41.993+0000 7f2c68692700 1 --2- 172.21.15.6:0/2185236608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c600cfa90 0x7f2c60169bc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:41.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:41.993+0000 7f2c68692700 1 --2- 172.21.15.6:0/2185236608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c600d07a0 0x7f2c600b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:41.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:41.993+0000 7f2c68692700 1 -- 172.21.15.6:0/2185236608 >> 172.21.15.6:0/2185236608 conn(0x7f2c600690f0 msgr2=0x7f2c60141fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:41.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:41.994+0000 7f2c68692700 1 -- 172.21.15.6:0/2185236608 shutdown_connections 2023-10-06T02:17:41.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:41.994+0000 7f2c68692700 1 -- 172.21.15.6:0/2185236608 wait complete. 2023-10-06T02:17:41.996 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-06T02:17:42.010 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-06T02:17:42.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.142+0000 7f0bf3ebb700 1 Processor -- start 2023-10-06T02:17:42.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.143+0000 7f0bf3ebb700 1 -- start start 2023-10-06T02:17:42.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.143+0000 7f0bf3ebb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0bec06eee0 0x7f0bec0c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:42.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.143+0000 7f0bf3ebb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bec0c2f80 0x7f0bec0ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:42.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.143+0000 7f0bf3ebb700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bec15a3b0 con 0x7f0bec0cbff0 2023-10-06T02:17:42.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.143+0000 7f0bf3ebb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bec069690 con 0x7f0bec06eee0 2023-10-06T02:17:42.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.143+0000 7f0bf3ebb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0c34b0 con 0x7f0bec0c2f80 2023-10-06T02:17:42.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.144+0000 7f0bf2458700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bec0c2f80 0x7f0bec0ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:42.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.144+0000 7f0bf1c57700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0bec06eee0 0x7f0bec0c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:42.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.144+0000 7f0bf1456700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f0bec0cbff0 0x7f0bec156a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:44868/0 (socket says 172.21.15.6:44868) 2023-10-06T02:17:42.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.144+0000 7f0bf1456700 1 -- 172.21.15.6:0/3865913919 learned_addr learned my addr 172.21.15.6:0/3865913919 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:42.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.144+0000 7f0bf1c57700 1 -- 172.21.15.6:0/3865913919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bec0c2f80 msgr2=0x7f0bec0ab2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:42.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.144+0000 7f0bf1c57700 1 --2- 172.21.15.6:0/3865913919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bec0c2f80 0x7f0bec0ab2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:42.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.144+0000 7f0bf1c57700 1 -- 172.21.15.6:0/3865913919 >> v1:172.21.15.175:6789/0 conn(0x7f0bec0cbff0 legacy=0x7f0bec156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:42.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.144+0000 7f0bf1c57700 1 -- 172.21.15.6:0/3865913919 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec159d60 con 0x7f0bec06eee0 2023-10-06T02:17:42.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.144+0000 7f0bf2458700 1 --2- 172.21.15.6:0/3865913919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bec0c2f80 0x7f0bec0ab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:42.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.144+0000 7f0bf1c57700 1 --2- 172.21.15.6:0/3865913919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bec06eee0 0x7f0bec0c2a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc009e60 tx=0x7f0bdc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1216eab774bc13c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:42.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.144+0000 7f0bf0c55700 1 -- 172.21.15.6:0/3865913919 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc00e070 con 0x7f0bec06eee0 2023-10-06T02:17:42.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.145+0000 7f0bf0c55700 1 -- 172.21.15.6:0/3865913919 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bdc00bb60 con 0x7f0bec06eee0 2023-10-06T02:17:42.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.145+0000 7f0bf0c55700 1 -- 172.21.15.6:0/3865913919 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc012430 con 0x7f0bec06eee0 2023-10-06T02:17:42.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.145+0000 7f0bf3ebb700 1 -- 172.21.15.6:0/3865913919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bec06eee0 msgr2=0x7f0bec0c2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:42.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.145+0000 7f0bf3ebb700 1 --2- 172.21.15.6:0/3865913919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bec06eee0 0x7f0bec0c2a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc009e60 tx=0x7f0bdc009780 comp rx=0 tx=0).stop 2023-10-06T02:17:42.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.145+0000 7f0bf3ebb700 1 -- 172.21.15.6:0/3865913919 shutdown_connections 2023-10-06T02:17:42.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.145+0000 7f0bf3ebb700 1 --2- 172.21.15.6:0/3865913919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bec0c2f80 0x7f0bec0ab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:42.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.145+0000 7f0bf3ebb700 1 --2- 172.21.15.6:0/3865913919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bec06eee0 0x7f0bec0c2a40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:42.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.145+0000 7f0bf3ebb700 1 -- 172.21.15.6:0/3865913919 >> 172.21.15.6:0/3865913919 conn(0x7f0bec0cc760 msgr2=0x7f0bec0ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:42.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.145+0000 7f0bf3ebb700 1 -- 172.21.15.6:0/3865913919 shutdown_connections 2023-10-06T02:17:42.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.145+0000 7f0bf3ebb700 1 -- 172.21.15.6:0/3865913919 wait complete. 2023-10-06T02:17:42.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.146+0000 7f0bf3ebb700 1 Processor -- start 2023-10-06T02:17:42.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.146+0000 7f0bf3ebb700 1 -- start start 2023-10-06T02:17:42.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.147+0000 7f0bf3ebb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bec06eee0 0x7f0bec0a92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:42.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.147+0000 7f0bf3ebb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bec0c2f80 0x7f0bec0c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:42.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.147+0000 7f0bf3ebb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bec0cbff0 0x7f0bec0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:42.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.147+0000 7f0bf3ebb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0c51c0 con 0x7f0bec0cbff0 2023-10-06T02:17:42.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.147+0000 7f0bf3ebb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0c4ca0 con 0x7f0bec0c2f80 2023-10-06T02:17:42.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.147+0000 7f0bf3ebb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0ad200 con 0x7f0bec06eee0 2023-10-06T02:17:42.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.147+0000 7f0bf2458700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bec0cbff0 0x7f0bec0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:42.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.147+0000 7f0bf2458700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bec0cbff0 0x7f0bec0c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48456/0 (socket says 172.21.15.6:48456) 2023-10-06T02:17:42.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.147+0000 7f0bf2458700 1 -- 172.21.15.6:0/3366854028 learned_addr learned my addr 172.21.15.6:0/3366854028 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:42.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.147+0000 7f0bf1c57700 1 --2- 172.21.15.6:0/3366854028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bec06eee0 0x7f0bec0a92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:42.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.147+0000 7f0bf1456700 1 --2- 172.21.15.6:0/3366854028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bec0c2f80 0x7f0bec0c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:42.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.147+0000 7f0bf2458700 1 -- 172.21.15.6:0/3366854028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bec06eee0 msgr2=0x7f0bec0a92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:42.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.147+0000 7f0bf2458700 1 --2- 172.21.15.6:0/3366854028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bec06eee0 0x7f0bec0a92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:42.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.147+0000 7f0bf2458700 1 -- 172.21.15.6:0/3366854028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bec0c2f80 msgr2=0x7f0bec0c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:42.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.147+0000 7f0bf2458700 1 --2- 172.21.15.6:0/3366854028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bec0c2f80 0x7f0bec0c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:42.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.148+0000 7f0bf2458700 1 -- 172.21.15.6:0/3366854028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be4009420 con 0x7f0bec0cbff0 2023-10-06T02:17:42.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.148+0000 7f0bf2458700 1 --2- 172.21.15.6:0/3366854028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bec0cbff0 0x7f0bec0c4760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0be400ec50 tx=0x7f0be40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:42.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.148+0000 7f0be9ffb700 1 -- 172.21.15.6:0/3366854028 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be400c7f0 con 0x7f0bec0cbff0 2023-10-06T02:17:42.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.148+0000 7f0be9ffb700 1 -- 172.21.15.6:0/3366854028 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be400c950 con 0x7f0bec0cbff0 2023-10-06T02:17:42.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.148+0000 7f0bf3ebb700 1 -- 172.21.15.6:0/3366854028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc009a20 con 0x7f0bec0cbff0 2023-10-06T02:17:42.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.148+0000 7f0be9ffb700 1 -- 172.21.15.6:0/3366854028 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be400ccd0 con 0x7f0bec0cbff0 2023-10-06T02:17:42.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.148+0000 7f0bf3ebb700 1 -- 172.21.15.6:0/3366854028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bec0c4ee0 con 0x7f0bec0cbff0 2023-10-06T02:17:42.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.149+0000 7f0bf3ebb700 1 -- 172.21.15.6:0/3366854028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bec0ad370 con 0x7f0bec0cbff0 2023-10-06T02:17:42.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.149+0000 7f0be9ffb700 1 -- 172.21.15.6:0/3366854028 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0be4013680 con 0x7f0bec0cbff0 2023-10-06T02:17:42.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.150+0000 7f0be9ffb700 1 --2- 172.21.15.6:0/3366854028 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bd8066f30 0x7f0bd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:42.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.150+0000 7f0be9ffb700 1 -- 172.21.15.6:0/3366854028 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f0be40846c0 con 0x7f0bec0cbff0 2023-10-06T02:17:42.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.150+0000 7f0bf1c57700 1 --2- 172.21.15.6:0/3366854028 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bd8066f30 0x7f0bd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:42.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.151+0000 7f0bf1c57700 1 --2- 172.21.15.6:0/3366854028 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bd8066f30 0x7f0bd80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0097c0 tx=0x7f0bdc019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:42.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.155+0000 7f0be9ffb700 1 -- 172.21.15.6:0/3366854028 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0be40519b0 con 0x7f0bec0cbff0 2023-10-06T02:17:42.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.348+0000 7f0bf3ebb700 1 -- 172.21.15.6:0/3366854028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f0bec068420 con 0x7f0bec0cbff0 2023-10-06T02:17:42.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:42.995+0000 7f0be9ffb700 1 -- 172.21.15.6:0/3366854028 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f0be4054fd0 con 0x7f0bec0cbff0 2023-10-06T02:17:43.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.008+0000 7f0bf3ebb700 1 -- 172.21.15.6:0/3366854028 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bd8066f30 msgr2=0x7f0bd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:43.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.008+0000 7f0bf3ebb700 1 --2- 172.21.15.6:0/3366854028 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bd8066f30 0x7f0bd80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0097c0 tx=0x7f0bdc019000 comp rx=0 tx=0).stop 2023-10-06T02:17:43.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.008+0000 7f0bf3ebb700 1 -- 172.21.15.6:0/3366854028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bec0cbff0 msgr2=0x7f0bec0c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:43.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.008+0000 7f0bf3ebb700 1 --2- 172.21.15.6:0/3366854028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bec0cbff0 0x7f0bec0c4760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0be400ec50 tx=0x7f0be40091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:43.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.009+0000 7f0bf3ebb700 1 -- 172.21.15.6:0/3366854028 shutdown_connections 2023-10-06T02:17:43.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.009+0000 7f0bf3ebb700 1 --2- 172.21.15.6:0/3366854028 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bd8066f30 0x7f0bd80693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:43.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.009+0000 7f0bf3ebb700 1 --2- 172.21.15.6:0/3366854028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bec0cbff0 0x7f0bec0c4760 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:43.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.009+0000 7f0bf3ebb700 1 --2- 172.21.15.6:0/3366854028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bec06eee0 0x7f0bec0a92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:43.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.009+0000 7f0bf3ebb700 1 --2- 172.21.15.6:0/3366854028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bec0c2f80 0x7f0bec0c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:43.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.009+0000 7f0bf3ebb700 1 -- 172.21.15.6:0/3366854028 >> 172.21.15.6:0/3366854028 conn(0x7f0bec0cc760 msgr2=0x7f0bec0ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:43.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.010+0000 7f0bf3ebb700 1 -- 172.21.15.6:0/3366854028 shutdown_connections 2023-10-06T02:17:43.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.010+0000 7f0bf3ebb700 1 -- 172.21.15.6:0/3366854028 wait complete. 2023-10-06T02:17:43.012 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-06T02:17:43.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:17:43.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.149+0000 7f317667c700 1 Processor -- start 2023-10-06T02:17:43.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.149+0000 7f317667c700 1 -- start start 2023-10-06T02:17:43.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.150+0000 7f317667c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31700cd400 0x7f31700b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:43.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.150+0000 7f317667c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31700cd7d0 0x7f31700b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:43.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.150+0000 7f317667c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f31700b0810 0x7f31700d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:43.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.150+0000 7f317667c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31700b29a0 con 0x7f31700cd7d0 2023-10-06T02:17:43.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.150+0000 7f317667c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31700af770 con 0x7f31700b0810 2023-10-06T02:17:43.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.150+0000 7f317667c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31700afa50 con 0x7f31700cd400 2023-10-06T02:17:43.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.150+0000 7f3174e79700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31700cd7d0 0x7f31700b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:43.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.150+0000 7f3174e79700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31700cd7d0 0x7f31700b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48462/0 (socket says 172.21.15.6:48462) 2023-10-06T02:17:43.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.150+0000 7f3174e79700 1 -- 172.21.15.6:0/2147011281 learned_addr learned my addr 172.21.15.6:0/2147011281 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:43.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.150+0000 7f3175e7b700 1 --2- 172.21.15.6:0/2147011281 >> v2:172.21.15.175:3300/0 conn(0x7f31700b0810 0x7f31700d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:43.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.150+0000 7f317567a700 1 --2- 172.21.15.6:0/2147011281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31700cd400 0x7f31700b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:43.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.151+0000 7f3174e79700 1 -- 172.21.15.6:0/2147011281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31700cd400 msgr2=0x7f31700b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:43.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.151+0000 7f3174e79700 1 --2- 172.21.15.6:0/2147011281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31700cd400 0x7f31700b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:43.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.151+0000 7f3174e79700 1 -- 172.21.15.6:0/2147011281 >> v2:172.21.15.175:3300/0 conn(0x7f31700b0810 msgr2=0x7f31700d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:43.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.151+0000 7f3174e79700 1 --2- 172.21.15.6:0/2147011281 >> v2:172.21.15.175:3300/0 conn(0x7f31700b0810 0x7f31700d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:43.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.151+0000 7f3174e79700 1 -- 172.21.15.6:0/2147011281 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31700afd30 con 0x7f31700cd7d0 2023-10-06T02:17:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.151+0000 7f317567a700 1 --2- 172.21.15.6:0/2147011281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31700cd400 0x7f31700b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.151+0000 7f3174e79700 1 --2- 172.21.15.6:0/2147011281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31700cd7d0 0x7f31700b2460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f31701572f0 tx=0x7f3164009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f97c17d2a0e9a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.151+0000 7f316ffff700 1 -- 172.21.15.6:0/2147011281 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3164009e70 con 0x7f31700cd7d0 2023-10-06T02:17:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.151+0000 7f316ffff700 1 -- 172.21.15.6:0/2147011281 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316400b860 con 0x7f31700cd7d0 2023-10-06T02:17:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.151+0000 7f316ffff700 1 -- 172.21.15.6:0/2147011281 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316400bc20 con 0x7f31700cd7d0 2023-10-06T02:17:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.151+0000 7f317667c700 1 -- 172.21.15.6:0/2147011281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31700cd7d0 msgr2=0x7f31700b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.151+0000 7f317667c700 1 --2- 172.21.15.6:0/2147011281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31700cd7d0 0x7f31700b2460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f31701572f0 tx=0x7f3164009250 comp rx=0 tx=0).stop 2023-10-06T02:17:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.151+0000 7f317667c700 1 -- 172.21.15.6:0/2147011281 shutdown_connections 2023-10-06T02:17:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.151+0000 7f317667c700 1 --2- 172.21.15.6:0/2147011281 >> v2:172.21.15.175:3300/0 conn(0x7f31700b0810 0x7f31700d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.151+0000 7f317667c700 1 --2- 172.21.15.6:0/2147011281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31700cd400 0x7f31700b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.151+0000 7f317667c700 1 --2- 172.21.15.6:0/2147011281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31700cd7d0 0x7f31700b2460 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.151+0000 7f317667c700 1 -- 172.21.15.6:0/2147011281 >> 172.21.15.6:0/2147011281 conn(0x7f317006a110 msgr2=0x7f317006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:43.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.152+0000 7f317667c700 1 -- 172.21.15.6:0/2147011281 shutdown_connections 2023-10-06T02:17:43.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.152+0000 7f317667c700 1 -- 172.21.15.6:0/2147011281 wait complete. 2023-10-06T02:17:43.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.153+0000 7f317667c700 1 Processor -- start 2023-10-06T02:17:43.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.153+0000 7f317667c700 1 -- start start 2023-10-06T02:17:43.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.153+0000 7f317667c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31700b0810 0x7f317014de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:43.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.153+0000 7f317667c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31700cd400 0x7f3170169fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:43.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.153+0000 7f317667c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f317015bd60 0x7f317015c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:43.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.153+0000 7f317667c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317014e3d0 con 0x7f317015bd60 2023-10-06T02:17:43.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.153+0000 7f317667c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317015a7b0 con 0x7f31700b0810 2023-10-06T02:17:43.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.153+0000 7f317667c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3170159ba0 con 0x7f31700cd400 2023-10-06T02:17:43.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.154+0000 7f3175e7b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f317015bd60 0x7f317015c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:43.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.154+0000 7f3175e7b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f317015bd60 0x7f317015c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48468/0 (socket says 172.21.15.6:48468) 2023-10-06T02:17:43.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.154+0000 7f3175e7b700 1 -- 172.21.15.6:0/1008372543 learned_addr learned my addr 172.21.15.6:0/1008372543 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:43.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.154+0000 7f317567a700 1 --2- 172.21.15.6:0/1008372543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31700b0810 0x7f317014de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:43.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.154+0000 7f3174e79700 1 --2- 172.21.15.6:0/1008372543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31700cd400 0x7f3170169fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:43.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.154+0000 7f3175e7b700 1 -- 172.21.15.6:0/1008372543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31700cd400 msgr2=0x7f3170169fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:43.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.154+0000 7f3175e7b700 1 --2- 172.21.15.6:0/1008372543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31700cd400 0x7f3170169fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:43.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.154+0000 7f3175e7b700 1 -- 172.21.15.6:0/1008372543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31700b0810 msgr2=0x7f317014de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:43.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.154+0000 7f3175e7b700 1 --2- 172.21.15.6:0/1008372543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31700b0810 0x7f317014de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:43.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.154+0000 7f3175e7b700 1 -- 172.21.15.6:0/1008372543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31640094f0 con 0x7f317015bd60 2023-10-06T02:17:43.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.154+0000 7f3174e79700 1 --2- 172.21.15.6:0/1008372543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31700cd400 0x7f3170169fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:43.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.154+0000 7f3175e7b700 1 --2- 172.21.15.6:0/1008372543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f317015bd60 0x7f317015c200 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3160009df0 tx=0x7f316000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:43.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.154+0000 7f316d7fa700 1 -- 172.21.15.6:0/1008372543 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316000cb50 con 0x7f317015bd60 2023-10-06T02:17:43.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.154+0000 7f316d7fa700 1 -- 172.21.15.6:0/1008372543 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316000f040 con 0x7f317015bd60 2023-10-06T02:17:43.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.154+0000 7f316d7fa700 1 -- 172.21.15.6:0/1008372543 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160014480 con 0x7f317015bd60 2023-10-06T02:17:43.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.154+0000 7f317667c700 1 -- 172.21.15.6:0/1008372543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3170159e80 con 0x7f317015bd60 2023-10-06T02:17:43.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.154+0000 7f317667c700 1 -- 172.21.15.6:0/1008372543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317015a440 con 0x7f317015bd60 2023-10-06T02:17:43.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.155+0000 7f317667c700 1 -- 172.21.15.6:0/1008372543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317015a920 con 0x7f317015bd60 2023-10-06T02:17:43.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.156+0000 7f316d7fa700 1 -- 172.21.15.6:0/1008372543 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3160014830 con 0x7f317015bd60 2023-10-06T02:17:43.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.156+0000 7f316d7fa700 1 --2- 172.21.15.6:0/1008372543 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f315c066f30 0x7f315c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:43.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.156+0000 7f316d7fa700 1 -- 172.21.15.6:0/1008372543 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f3160084ea0 con 0x7f317015bd60 2023-10-06T02:17:43.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.156+0000 7f317567a700 1 --2- 172.21.15.6:0/1008372543 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f315c066f30 0x7f315c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:43.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.157+0000 7f317567a700 1 --2- 172.21.15.6:0/1008372543 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f315c066f30 0x7f315c0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f31701523d0 tx=0x7f3168008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:43.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.160+0000 7f316d7fa700 1 -- 172.21.15.6:0/1008372543 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3160052010 con 0x7f317015bd60 2023-10-06T02:17:43.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.403+0000 7f317667c700 1 -- 172.21.15.6:0/1008372543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3170064aa0 con 0x7f317015bd60 2023-10-06T02:17:43.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:43.998+0000 7f316d7fa700 1 -- 172.21.15.6:0/1008372543 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3160055630 con 0x7f317015bd60 2023-10-06T02:17:44.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.003+0000 7f317667c700 1 -- 172.21.15.6:0/1008372543 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f315c066f30 msgr2=0x7f315c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:44.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.003+0000 7f317667c700 1 --2- 172.21.15.6:0/1008372543 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f315c066f30 0x7f315c0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f31701523d0 tx=0x7f3168008040 comp rx=0 tx=0).stop 2023-10-06T02:17:44.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.003+0000 7f317667c700 1 -- 172.21.15.6:0/1008372543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f317015bd60 msgr2=0x7f317015c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:44.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.003+0000 7f317667c700 1 --2- 172.21.15.6:0/1008372543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f317015bd60 0x7f317015c200 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3160009df0 tx=0x7f316000b040 comp rx=0 tx=0).stop 2023-10-06T02:17:44.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.006+0000 7f317667c700 1 -- 172.21.15.6:0/1008372543 shutdown_connections 2023-10-06T02:17:44.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.006+0000 7f317667c700 1 --2- 172.21.15.6:0/1008372543 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f315c066f30 0x7f315c0693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:44.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.006+0000 7f317667c700 1 --2- 172.21.15.6:0/1008372543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f317015bd60 0x7f317015c200 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:44.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.006+0000 7f317667c700 1 --2- 172.21.15.6:0/1008372543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31700b0810 0x7f317014de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:44.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.006+0000 7f317667c700 1 --2- 172.21.15.6:0/1008372543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31700cd400 0x7f3170169fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:44.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.006+0000 7f317667c700 1 -- 172.21.15.6:0/1008372543 >> 172.21.15.6:0/1008372543 conn(0x7f317006a110 msgr2=0x7f3170155f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.008+0000 7f317667c700 1 -- 172.21.15.6:0/1008372543 shutdown_connections 2023-10-06T02:17:44.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.009+0000 7f317667c700 1 -- 172.21.15.6:0/1008372543 wait complete. 2023-10-06T02:17:44.015 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T02:17:44.031 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-06T02:17:44.032 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-06T02:17:44.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.158+0000 7f5ddb55a700 1 Processor -- start 2023-10-06T02:17:44.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.158+0000 7f5ddb55a700 1 -- start start 2023-10-06T02:17:44.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.158+0000 7f5ddb55a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5dd4142df0 0x7f5dd40cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.159+0000 7f5ddb55a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5dd40d0970 0x7f5dd40cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.159+0000 7f5ddb55a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd415a710 con 0x7f5dd40cc890 2023-10-06T02:17:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.159+0000 7f5ddb55a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd4159b40 con 0x7f5dd4142df0 2023-10-06T02:17:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.159+0000 7f5ddb55a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd4159de0 con 0x7f5dd40d0970 2023-10-06T02:17:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.159+0000 7f5dd92f6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5dd4142df0 0x7f5dd40cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.159+0000 7f5dd92f6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5dd4142df0 0x7f5dd40cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48470/0 (socket says 172.21.15.6:48470) 2023-10-06T02:17:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.159+0000 7f5dd92f6700 1 -- 172.21.15.6:0/3798687869 learned_addr learned my addr 172.21.15.6:0/3798687869 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.159+0000 7f5dd9af7700 1 --2- 172.21.15.6:0/3798687869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5dd40d0970 0x7f5dd40cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.159+0000 7f5dd92f6700 1 -- 172.21.15.6:0/3798687869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5dd40d0970 msgr2=0x7f5dd40cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.159+0000 7f5dd92f6700 1 --2- 172.21.15.6:0/3798687869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5dd40d0970 0x7f5dd40cfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.159+0000 7f5dd92f6700 1 -- 172.21.15.6:0/3798687869 >> v1:172.21.15.175:6789/0 conn(0x7f5dd40cc890 legacy=0x7f5dd40d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.159+0000 7f5dd92f6700 1 -- 172.21.15.6:0/3798687869 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd415a0c0 con 0x7f5dd4142df0 2023-10-06T02:17:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.159+0000 7f5dd9af7700 1 --2- 172.21.15.6:0/3798687869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5dd40d0970 0x7f5dd40cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:17:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.159+0000 7f5dd92f6700 1 --2- 172.21.15.6:0/3798687869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dd4142df0 0x7f5dd40cc350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00099b0 tx=0x7f5dd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1411adbfd905cfbd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.159+0000 7f5dcbfff700 1 -- 172.21.15.6:0/3798687869 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000b860 con 0x7f5dd4142df0 2023-10-06T02:17:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.159+0000 7f5dcbfff700 1 -- 172.21.15.6:0/3798687869 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd000b9c0 con 0x7f5dd4142df0 2023-10-06T02:17:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.159+0000 7f5dcbfff700 1 -- 172.21.15.6:0/3798687869 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000bd60 con 0x7f5dd4142df0 2023-10-06T02:17:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.160+0000 7f5ddb55a700 1 -- 172.21.15.6:0/3798687869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dd4142df0 msgr2=0x7f5dd40cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.160+0000 7f5ddb55a700 1 --2- 172.21.15.6:0/3798687869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dd4142df0 0x7f5dd40cc350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00099b0 tx=0x7f5dd0009250 comp rx=0 tx=0).stop 2023-10-06T02:17:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.160+0000 7f5ddb55a700 1 -- 172.21.15.6:0/3798687869 shutdown_connections 2023-10-06T02:17:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.160+0000 7f5ddb55a700 1 --2- 172.21.15.6:0/3798687869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5dd40d0970 0x7f5dd40cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.160+0000 7f5ddb55a700 1 --2- 172.21.15.6:0/3798687869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dd4142df0 0x7f5dd40cc350 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.160+0000 7f5ddb55a700 1 -- 172.21.15.6:0/3798687869 >> 172.21.15.6:0/3798687869 conn(0x7f5dd40690f0 msgr2=0x7f5dd406a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.160+0000 7f5ddb55a700 1 -- 172.21.15.6:0/3798687869 shutdown_connections 2023-10-06T02:17:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.160+0000 7f5ddb55a700 1 -- 172.21.15.6:0/3798687869 wait complete. 2023-10-06T02:17:44.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.161+0000 7f5ddb55a700 1 Processor -- start 2023-10-06T02:17:44.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.161+0000 7f5ddb55a700 1 -- start start 2023-10-06T02:17:44.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.162+0000 7f5ddb55a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5dd40cc890 0x7f5dd413e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.162+0000 7f5ddb55a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5dd40d0970 0x7f5dd40b5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.162+0000 7f5ddb55a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dd4142df0 0x7f5dd4141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.162+0000 7f5ddb55a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd413f940 con 0x7f5dd4142df0 2023-10-06T02:17:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.162+0000 7f5ddb55a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd413ed30 con 0x7f5dd40cc890 2023-10-06T02:17:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.162+0000 7f5ddb55a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd413f010 con 0x7f5dd40d0970 2023-10-06T02:17:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.162+0000 7f5dd9af7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dd4142df0 0x7f5dd4141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.162+0000 7f5dd9af7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dd4142df0 0x7f5dd4141600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48484/0 (socket says 172.21.15.6:48484) 2023-10-06T02:17:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.162+0000 7f5dd9af7700 1 -- 172.21.15.6:0/1900247985 learned_addr learned my addr 172.21.15.6:0/1900247985 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.162+0000 7f5dd92f6700 1 --2- 172.21.15.6:0/1900247985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5dd40cc890 0x7f5dd413e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.162+0000 7f5dd8af5700 1 --2- 172.21.15.6:0/1900247985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5dd40d0970 0x7f5dd40b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.162+0000 7f5dd9af7700 1 -- 172.21.15.6:0/1900247985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5dd40d0970 msgr2=0x7f5dd40b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.162+0000 7f5dd9af7700 1 --2- 172.21.15.6:0/1900247985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5dd40d0970 0x7f5dd40b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.162+0000 7f5dd9af7700 1 -- 172.21.15.6:0/1900247985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5dd40cc890 msgr2=0x7f5dd413e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.162+0000 7f5dd9af7700 1 --2- 172.21.15.6:0/1900247985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5dd40cc890 0x7f5dd413e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.162+0000 7f5dd9af7700 1 -- 172.21.15.6:0/1900247985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd00094f0 con 0x7f5dd4142df0 2023-10-06T02:17:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.162+0000 7f5dd8af5700 1 --2- 172.21.15.6:0/1900247985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5dd40d0970 0x7f5dd40b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:17:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.163+0000 7f5dd9af7700 1 --2- 172.21.15.6:0/1900247985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dd4142df0 0x7f5dd4141600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00cfb0 tx=0x7f5dcc0078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.163+0000 7f5dc97fa700 1 -- 172.21.15.6:0/1900247985 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc015440 con 0x7f5dd4142df0 2023-10-06T02:17:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.163+0000 7f5dc97fa700 1 -- 172.21.15.6:0/1900247985 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc0155a0 con 0x7f5dd4142df0 2023-10-06T02:17:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.163+0000 7f5dc97fa700 1 -- 172.21.15.6:0/1900247985 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc015960 con 0x7f5dd4142df0 2023-10-06T02:17:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.163+0000 7f5ddb55a700 1 -- 172.21.15.6:0/1900247985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd413f2f0 con 0x7f5dd4142df0 2023-10-06T02:17:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.163+0000 7f5ddb55a700 1 -- 172.21.15.6:0/1900247985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd413e5a0 con 0x7f5dd4142df0 2023-10-06T02:17:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.164+0000 7f5ddb55a700 1 -- 172.21.15.6:0/1900247985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd413faf0 con 0x7f5dd4142df0 2023-10-06T02:17:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.164+0000 7f5dc97fa700 1 -- 172.21.15.6:0/1900247985 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5dcc003020 con 0x7f5dd4142df0 2023-10-06T02:17:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.164+0000 7f5dc97fa700 1 --2- 172.21.15.6:0/1900247985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5db8066f30 0x7f5db80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.164+0000 7f5dc97fa700 1 -- 172.21.15.6:0/1900247985 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5dcc084e50 con 0x7f5dd4142df0 2023-10-06T02:17:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.165+0000 7f5dd92f6700 1 --2- 172.21.15.6:0/1900247985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5db8066f30 0x7f5db80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.165+0000 7f5dd92f6700 1 --2- 172.21.15.6:0/1900247985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5db8066f30 0x7f5db80693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00099b0 tx=0x7f5dd0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.169+0000 7f5dc97fa700 1 -- 172.21.15.6:0/1900247985 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5dcc04d5a0 con 0x7f5dd4142df0 2023-10-06T02:17:44.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:44.372+0000 7f5ddb55a700 1 -- 172.21.15.6:0/1900247985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f5dd415a3a0 con 0x7f5dd4142df0 2023-10-06T02:17:45.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.018+0000 7f5dc97fa700 1 -- 172.21.15.6:0/1900247985 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f5dd413faf0 con 0x7f5dd4142df0 2023-10-06T02:17:45.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.021+0000 7f5ddb55a700 1 -- 172.21.15.6:0/1900247985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5db8066f30 msgr2=0x7f5db80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:45.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.021+0000 7f5ddb55a700 1 --2- 172.21.15.6:0/1900247985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5db8066f30 0x7f5db80693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00099b0 tx=0x7f5dd0017000 comp rx=0 tx=0).stop 2023-10-06T02:17:45.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.021+0000 7f5ddb55a700 1 -- 172.21.15.6:0/1900247985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dd4142df0 msgr2=0x7f5dd4141600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:45.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.021+0000 7f5ddb55a700 1 --2- 172.21.15.6:0/1900247985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dd4142df0 0x7f5dd4141600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00cfb0 tx=0x7f5dcc0078c0 comp rx=0 tx=0).stop 2023-10-06T02:17:45.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.021+0000 7f5ddb55a700 1 -- 172.21.15.6:0/1900247985 shutdown_connections 2023-10-06T02:17:45.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.021+0000 7f5ddb55a700 1 --2- 172.21.15.6:0/1900247985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5db8066f30 0x7f5db80693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:45.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.022+0000 7f5ddb55a700 1 --2- 172.21.15.6:0/1900247985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dd4142df0 0x7f5dd4141600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:45.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.022+0000 7f5ddb55a700 1 --2- 172.21.15.6:0/1900247985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5dd40cc890 0x7f5dd413e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:45.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.022+0000 7f5ddb55a700 1 --2- 172.21.15.6:0/1900247985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5dd40d0970 0x7f5dd40b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:45.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.022+0000 7f5ddb55a700 1 -- 172.21.15.6:0/1900247985 >> 172.21.15.6:0/1900247985 conn(0x7f5dd40690f0 msgr2=0x7f5dd4158290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:45.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.022+0000 7f5ddb55a700 1 -- 172.21.15.6:0/1900247985 shutdown_connections 2023-10-06T02:17:45.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.022+0000 7f5ddb55a700 1 -- 172.21.15.6:0/1900247985 wait complete. 2023-10-06T02:17:45.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:17:45.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.164+0000 7f0b18094700 1 Processor -- start 2023-10-06T02:17:45.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.165+0000 7f0b18094700 1 -- start start 2023-10-06T02:17:45.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.165+0000 7f0b18094700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0b10159290 0x7f0b100ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:45.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.165+0000 7f0b18094700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b10159660 0x7f0b100d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:45.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.165+0000 7f0b18094700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b100b3100 con 0x7f0b100d0690 2023-10-06T02:17:45.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.165+0000 7f0b18094700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b100d0ac0 con 0x7f0b10159290 2023-10-06T02:17:45.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.165+0000 7f0b18094700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100cf620 con 0x7f0b10159660 2023-10-06T02:17:45.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.165+0000 7f0b16631700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0b100d0690 0x7f0b1015cfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55998/0 (socket says 172.21.15.6:55998) 2023-10-06T02:17:45.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.165+0000 7f0b16631700 1 -- 172.21.15.6:0/3760177191 learned_addr learned my addr 172.21.15.6:0/3760177191 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:45.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b15e30700 1 --2- 172.21.15.6:0/3760177191 >> v2:172.21.15.175:3300/0 conn(0x7f0b10159290 0x7f0b100ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:45.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b1562f700 1 --2- 172.21.15.6:0/3760177191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b10159660 0x7f0b100d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:45.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b14e2e700 1 -- 172.21.15.6:0/3760177191 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961439290 0 0) 0x7f0b100b3100 con 0x7f0b100d0690 2023-10-06T02:17:45.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b14e2e700 1 -- 172.21.15.6:0/3760177191 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0af8003570 con 0x7f0b100d0690 2023-10-06T02:17:45.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b14e2e700 1 -- 172.21.15.6:0/3760177191 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4076867970 0 0) 0x7f0af8003570 con 0x7f0b100d0690 2023-10-06T02:17:45.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b14e2e700 1 -- 172.21.15.6:0/3760177191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b10159660 msgr2=0x7f0b100d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:45.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b14e2e700 1 --2- 172.21.15.6:0/3760177191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b10159660 0x7f0b100d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:45.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b14e2e700 1 -- 172.21.15.6:0/3760177191 >> v2:172.21.15.175:3300/0 conn(0x7f0b10159290 msgr2=0x7f0b100ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:45.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b14e2e700 1 --2- 172.21.15.6:0/3760177191 >> v2:172.21.15.175:3300/0 conn(0x7f0b10159290 0x7f0b100ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:45.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b14e2e700 1 -- 172.21.15.6:0/3760177191 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b100cf900 con 0x7f0b100d0690 2023-10-06T02:17:45.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b14e2e700 1 -- 172.21.15.6:0/3760177191 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f0b000017f0 con 0x7f0b100d0690 2023-10-06T02:17:45.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b14e2e700 1 -- 172.21.15.6:0/3760177191 >> v1:172.21.15.6:6789/0 conn(0x7f0b100d0690 legacy=0x7f0b1015cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:45.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b14e2e700 1 --2- 172.21.15.6:0/3760177191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0af8003a60 0x7f0af8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:45.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b14e2e700 1 --2- 172.21.15.6:0/3760177191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0af8004810 0x7f0af8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:45.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b14e2e700 1 --2- 172.21.15.6:0/3760177191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af80051c0 0x7f0af800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:45.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b14e2e700 1 -- 172.21.15.6:0/3760177191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100d0ac0 con 0x7f0af8004810 2023-10-06T02:17:45.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b14e2e700 1 -- 172.21.15.6:0/3760177191 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100cf620 con 0x7f0af8003a60 2023-10-06T02:17:45.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b14e2e700 1 -- 172.21.15.6:0/3760177191 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af8005670 con 0x7f0af80051c0 2023-10-06T02:17:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b1562f700 1 --2- 172.21.15.6:0/3760177191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0af8004810 0x7f0af8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b15e30700 1 --2- 172.21.15.6:0/3760177191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0af8003a60 0x7f0af8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b16631700 1 --2- 172.21.15.6:0/3760177191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af80051c0 0x7f0af800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b1562f700 1 -- 172.21.15.6:0/3760177191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af80051c0 msgr2=0x7f0af800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b1562f700 1 --2- 172.21.15.6:0/3760177191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af80051c0 0x7f0af800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b1562f700 1 -- 172.21.15.6:0/3760177191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0af8003a60 msgr2=0x7f0af8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b1562f700 1 --2- 172.21.15.6:0/3760177191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0af8003a60 0x7f0af8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.166+0000 7f0b1562f700 1 -- 172.21.15.6:0/3760177191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af8003570 con 0x7f0af8004810 2023-10-06T02:17:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.167+0000 7f0b1562f700 1 --2- 172.21.15.6:0/3760177191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0af8004810 0x7f0af8004c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0b100d1450 tx=0x7f0b040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80a96471df88f7e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.167+0000 7f0b14e2e700 1 -- 172.21.15.6:0/3760177191 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0400e710 con 0x7f0af8004810 2023-10-06T02:17:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.167+0000 7f0b14e2e700 1 -- 172.21.15.6:0/3760177191 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0400e870 con 0x7f0af8004810 2023-10-06T02:17:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.167+0000 7f0b14e2e700 1 -- 172.21.15.6:0/3760177191 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0400ec30 con 0x7f0af8004810 2023-10-06T02:17:45.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.167+0000 7f0b18094700 1 -- 172.21.15.6:0/3760177191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0af8004810 msgr2=0x7f0af8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:45.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.167+0000 7f0b18094700 1 --2- 172.21.15.6:0/3760177191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0af8004810 0x7f0af8004c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0b100d1450 tx=0x7f0b040091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:45.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.167+0000 7f0b16631700 1 -- 172.21.15.6:0/3760177191 reap_dead start 2023-10-06T02:17:45.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.167+0000 7f0b18094700 1 -- 172.21.15.6:0/3760177191 shutdown_connections 2023-10-06T02:17:45.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.167+0000 7f0b18094700 1 -- 172.21.15.6:0/3760177191 >> 172.21.15.6:0/3760177191 conn(0x7f0b1006acf0 msgr2=0x7f0b10068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:45.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.167+0000 7f0b18094700 1 -- 172.21.15.6:0/3760177191 shutdown_connections 2023-10-06T02:17:45.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.167+0000 7f0b18094700 1 -- 172.21.15.6:0/3760177191 wait complete. 2023-10-06T02:17:45.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.168+0000 7f0b18094700 1 Processor -- start 2023-10-06T02:17:45.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.168+0000 7f0b18094700 1 -- start start 2023-10-06T02:17:45.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.169+0000 7f0b18094700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af8004810 0x7f0b1015d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:45.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.169+0000 7f0b18094700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b100c5380 0x7f0b1015ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:45.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.169+0000 7f0b18094700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1015f490 0x7f0b100c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:45.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.169+0000 7f0b18094700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100c5880 con 0x7f0b1015f490 2023-10-06T02:17:45.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.169+0000 7f0b18094700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100c5b60 con 0x7f0b100c5380 2023-10-06T02:17:45.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.169+0000 7f0b18094700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100c5e40 con 0x7f0af8004810 2023-10-06T02:17:45.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.169+0000 7f0b16631700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1015f490 0x7f0b100c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:45.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.169+0000 7f0b16631700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1015f490 0x7f0b100c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48496/0 (socket says 172.21.15.6:48496) 2023-10-06T02:17:45.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.169+0000 7f0b16631700 1 -- 172.21.15.6:0/4018215536 learned_addr learned my addr 172.21.15.6:0/4018215536 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:45.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.169+0000 7f0b1562f700 1 --2- 172.21.15.6:0/4018215536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b100c5380 0x7f0b1015ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:45.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.169+0000 7f0b15e30700 1 --2- 172.21.15.6:0/4018215536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af8004810 0x7f0b1015d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:45.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.170+0000 7f0b16631700 1 -- 172.21.15.6:0/4018215536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af8004810 msgr2=0x7f0b1015d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:45.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.170+0000 7f0b16631700 1 --2- 172.21.15.6:0/4018215536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af8004810 0x7f0b1015d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:45.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.170+0000 7f0b16631700 1 -- 172.21.15.6:0/4018215536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b100c5380 msgr2=0x7f0b1015ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:45.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.170+0000 7f0b16631700 1 --2- 172.21.15.6:0/4018215536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b100c5380 0x7f0b1015ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:45.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.170+0000 7f0b16631700 1 -- 172.21.15.6:0/4018215536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b100c6120 con 0x7f0b1015f490 2023-10-06T02:17:45.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.170+0000 7f0b15e30700 1 --2- 172.21.15.6:0/4018215536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af8004810 0x7f0b1015d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:45.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.170+0000 7f0b16631700 1 --2- 172.21.15.6:0/4018215536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1015f490 0x7f0b100c6920 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0b100708e0 tx=0x7f0b00001860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:45.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.170+0000 7f0b0dffb700 1 -- 172.21.15.6:0/4018215536 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0000ebc0 con 0x7f0b1015f490 2023-10-06T02:17:45.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.170+0000 7f0b0dffb700 1 -- 172.21.15.6:0/4018215536 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0000ed60 con 0x7f0b1015f490 2023-10-06T02:17:45.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.170+0000 7f0b0dffb700 1 -- 172.21.15.6:0/4018215536 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b00013670 con 0x7f0b1015f490 2023-10-06T02:17:45.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.170+0000 7f0b18094700 1 -- 172.21.15.6:0/4018215536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b100c6400 con 0x7f0b1015f490 2023-10-06T02:17:45.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.170+0000 7f0b18094700 1 -- 172.21.15.6:0/4018215536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b100c6e60 con 0x7f0b1015f490 2023-10-06T02:17:45.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.171+0000 7f0b18094700 1 -- 172.21.15.6:0/4018215536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b100c65f0 con 0x7f0b1015f490 2023-10-06T02:17:45.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.171+0000 7f0b0dffb700 1 -- 172.21.15.6:0/4018215536 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b00013a20 con 0x7f0b1015f490 2023-10-06T02:17:45.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.172+0000 7f0b0dffb700 1 --2- 172.21.15.6:0/4018215536 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0afc066f30 0x7f0afc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:45.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.172+0000 7f0b0dffb700 1 -- 172.21.15.6:0/4018215536 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6284+0+0 (secure 0 0 0) 0x7f0b00084d70 con 0x7f0b1015f490 2023-10-06T02:17:45.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.172+0000 7f0b15e30700 1 --2- 172.21.15.6:0/4018215536 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0afc066f30 0x7f0afc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:45.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.172+0000 7f0b15e30700 1 --2- 172.21.15.6:0/4018215536 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0afc066f30 0x7f0afc0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0b08006f00 tx=0x7f0b08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:45.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.176+0000 7f0b0dffb700 1 -- 172.21.15.6:0/4018215536 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b00051da0 con 0x7f0b1015f490 2023-10-06T02:17:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:45.374+0000 7f0b18094700 1 -- 172.21.15.6:0/4018215536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0b100889e0 con 0x7f0b1015f490 2023-10-06T02:17:47.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.028+0000 7f0b0dffb700 1 -- 172.21.15.6:0/4018215536 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f0b000553c0 con 0x7f0b1015f490 2023-10-06T02:17:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.033+0000 7f0b18094700 1 -- 172.21.15.6:0/4018215536 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0afc066f30 msgr2=0x7f0afc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.033+0000 7f0b18094700 1 --2- 172.21.15.6:0/4018215536 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0afc066f30 0x7f0afc0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0b08006f00 tx=0x7f0b08008040 comp rx=0 tx=0).stop 2023-10-06T02:17:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.033+0000 7f0b18094700 1 -- 172.21.15.6:0/4018215536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1015f490 msgr2=0x7f0b100c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.033+0000 7f0b18094700 1 --2- 172.21.15.6:0/4018215536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1015f490 0x7f0b100c6920 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0b100708e0 tx=0x7f0b00001860 comp rx=0 tx=0).stop 2023-10-06T02:17:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.034+0000 7f0b18094700 1 -- 172.21.15.6:0/4018215536 shutdown_connections 2023-10-06T02:17:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.034+0000 7f0b18094700 1 --2- 172.21.15.6:0/4018215536 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0afc066f30 0x7f0afc0693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.034+0000 7f0b18094700 1 --2- 172.21.15.6:0/4018215536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1015f490 0x7f0b100c6920 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.034+0000 7f0b18094700 1 --2- 172.21.15.6:0/4018215536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af8004810 0x7f0b1015d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:47.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.034+0000 7f0b18094700 1 --2- 172.21.15.6:0/4018215536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b100c5380 0x7f0b1015ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:47.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.034+0000 7f0b18094700 1 -- 172.21.15.6:0/4018215536 >> 172.21.15.6:0/4018215536 conn(0x7f0b1006acf0 msgr2=0x7f0b100b5100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:47.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.038+0000 7f0b18094700 1 -- 172.21.15.6:0/4018215536 shutdown_connections 2023-10-06T02:17:47.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.038+0000 7f0b18094700 1 -- 172.21.15.6:0/4018215536 wait complete. 2023-10-06T02:17:47.040 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data_ec' created 2023-10-06T02:17:47.054 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-06T02:17:47.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.182+0000 7f82d2da2700 1 Processor -- start 2023-10-06T02:17:47.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.182+0000 7f82d2da2700 1 -- start start 2023-10-06T02:17:47.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.183+0000 7f82d2da2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f82cc06a9b0 0x7f82cc15b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:47.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.183+0000 7f82d2da2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f82cc15b770 0x7f82cc159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:47.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.183+0000 7f82d2da2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82cc0afa60 con 0x7f82cc1598b0 2023-10-06T02:17:47.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.183+0000 7f82d2da2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc15bbf0 con 0x7f82cc15b770 2023-10-06T02:17:47.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.183+0000 7f82d2da2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc0af440 con 0x7f82cc06a9b0 2023-10-06T02:17:47.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.183+0000 7f82d133f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f82cc15b770 0x7f82cc159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:47.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.183+0000 7f82d0b3e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f82cc1598b0 0x7f82cc0afef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56004/0 (socket says 172.21.15.6:56004) 2023-10-06T02:17:47.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.183+0000 7f82d0b3e700 1 -- 172.21.15.6:0/1900835672 learned_addr learned my addr 172.21.15.6:0/1900835672 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:47.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.183+0000 7f82cbfff700 1 --2- 172.21.15.6:0/1900835672 >> v2:172.21.15.175:3300/0 conn(0x7f82cc06a9b0 0x7f82cc15b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:47.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.183+0000 7f82d133f700 1 -- 172.21.15.6:0/1900835672 >> v2:172.21.15.175:3300/0 conn(0x7f82cc06a9b0 msgr2=0x7f82cc15b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:47.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.183+0000 7f82d133f700 1 --2- 172.21.15.6:0/1900835672 >> v2:172.21.15.175:3300/0 conn(0x7f82cc06a9b0 0x7f82cc15b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:47.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.183+0000 7f82d133f700 1 -- 172.21.15.6:0/1900835672 >> v1:172.21.15.6:6789/0 conn(0x7f82cc1598b0 legacy=0x7f82cc0afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:47.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.183+0000 7f82d133f700 1 -- 172.21.15.6:0/1900835672 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc15ab00 con 0x7f82cc15b770 2023-10-06T02:17:47.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.183+0000 7f82cb7fe700 1 -- 172.21.15.6:0/1900835672 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63265618 0 0) 0x7f82cc0afa60 con 0x7f82cc1598b0 2023-10-06T02:17:47.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.184+0000 7f82d133f700 1 --2- 172.21.15.6:0/1900835672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82cc15b770 0x7f82cc159c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82cc06f9d0 tx=0x7f82b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e97ea2af4e6c83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:47.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.184+0000 7f82cb7fe700 1 -- 172.21.15.6:0/1900835672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b4011630 con 0x7f82cc15b770 2023-10-06T02:17:47.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.184+0000 7f82cb7fe700 1 -- 172.21.15.6:0/1900835672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b4011790 con 0x7f82cc15b770 2023-10-06T02:17:47.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.184+0000 7f82cb7fe700 1 -- 172.21.15.6:0/1900835672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b4011b30 con 0x7f82cc15b770 2023-10-06T02:17:47.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.184+0000 7f82d2da2700 1 -- 172.21.15.6:0/1900835672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82cc15b770 msgr2=0x7f82cc159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:47.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.184+0000 7f82d2da2700 1 --2- 172.21.15.6:0/1900835672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82cc15b770 0x7f82cc159c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82cc06f9d0 tx=0x7f82b40091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:47.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.184+0000 7f82d2da2700 1 -- 172.21.15.6:0/1900835672 shutdown_connections 2023-10-06T02:17:47.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.184+0000 7f82d2da2700 1 --2- 172.21.15.6:0/1900835672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82cc15b770 0x7f82cc159c80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:47.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.184+0000 7f82d2da2700 1 --2- 172.21.15.6:0/1900835672 >> v2:172.21.15.175:3300/0 conn(0x7f82cc06a9b0 0x7f82cc15b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:47.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.184+0000 7f82d2da2700 1 -- 172.21.15.6:0/1900835672 >> 172.21.15.6:0/1900835672 conn(0x7f82cc067910 msgr2=0x7f82cc0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:47.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.184+0000 7f82d2da2700 1 -- 172.21.15.6:0/1900835672 shutdown_connections 2023-10-06T02:17:47.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.184+0000 7f82d2da2700 1 -- 172.21.15.6:0/1900835672 wait complete. 2023-10-06T02:17:47.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.185+0000 7f82d2da2700 1 Processor -- start 2023-10-06T02:17:47.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.186+0000 7f82d2da2700 1 -- start start 2023-10-06T02:17:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.186+0000 7f82d2da2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82cc06a9b0 0x7f82cc169050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.186+0000 7f82d2da2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82cc1598b0 0x7f82cc158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.186+0000 7f82d2da2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82cc15b770 0x7f82cc153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.186+0000 7f82d2da2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc169590 con 0x7f82cc06a9b0 2023-10-06T02:17:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.186+0000 7f82d2da2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc14dd10 con 0x7f82cc1598b0 2023-10-06T02:17:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.186+0000 7f82d2da2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc1574e0 con 0x7f82cc15b770 2023-10-06T02:17:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.187+0000 7f82d0b3e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82cc06a9b0 0x7f82cc169050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.187+0000 7f82d0b3e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82cc06a9b0 0x7f82cc169050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48524/0 (socket says 172.21.15.6:48524) 2023-10-06T02:17:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.187+0000 7f82d0b3e700 1 -- 172.21.15.6:0/197858936 learned_addr learned my addr 172.21.15.6:0/197858936 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.187+0000 7f82cbfff700 1 --2- 172.21.15.6:0/197858936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82cc1598b0 0x7f82cc158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.187+0000 7f82d133f700 1 --2- 172.21.15.6:0/197858936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82cc15b770 0x7f82cc153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:47.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.187+0000 7f82d0b3e700 1 -- 172.21.15.6:0/197858936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82cc15b770 msgr2=0x7f82cc153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:47.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.187+0000 7f82d0b3e700 1 --2- 172.21.15.6:0/197858936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82cc15b770 0x7f82cc153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:47.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.187+0000 7f82d0b3e700 1 -- 172.21.15.6:0/197858936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82cc1598b0 msgr2=0x7f82cc158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:47.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.187+0000 7f82d0b3e700 1 --2- 172.21.15.6:0/197858936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82cc1598b0 0x7f82cc158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:47.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.187+0000 7f82d0b3e700 1 -- 172.21.15.6:0/197858936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b4009420 con 0x7f82cc06a9b0 2023-10-06T02:17:47.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.187+0000 7f82d0b3e700 1 --2- 172.21.15.6:0/197858936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82cc06a9b0 0x7f82cc169050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f82c400c960 tx=0x7f82c40016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:47.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.187+0000 7f82c8ff9700 1 -- 172.21.15.6:0/197858936 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4005d80 con 0x7f82cc06a9b0 2023-10-06T02:17:47.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.187+0000 7f82c8ff9700 1 -- 172.21.15.6:0/197858936 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c40070f0 con 0x7f82cc06a9b0 2023-10-06T02:17:47.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.187+0000 7f82d2da2700 1 -- 172.21.15.6:0/197858936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82cc1577c0 con 0x7f82cc06a9b0 2023-10-06T02:17:47.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.187+0000 7f82c8ff9700 1 -- 172.21.15.6:0/197858936 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c40074b0 con 0x7f82cc06a9b0 2023-10-06T02:17:47.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.187+0000 7f82d2da2700 1 -- 172.21.15.6:0/197858936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82cc157d80 con 0x7f82cc06a9b0 2023-10-06T02:17:47.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.188+0000 7f82d2da2700 1 -- 172.21.15.6:0/197858936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82cc04bb80 con 0x7f82cc06a9b0 2023-10-06T02:17:47.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.189+0000 7f82c8ff9700 1 -- 172.21.15.6:0/197858936 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82c40078a0 con 0x7f82cc06a9b0 2023-10-06T02:17:47.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.189+0000 7f82c8ff9700 1 --2- 172.21.15.6:0/197858936 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f82ac066f30 0x7f82ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:47.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.189+0000 7f82c8ff9700 1 -- 172.21.15.6:0/197858936 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f82c40845b0 con 0x7f82cc06a9b0 2023-10-06T02:17:47.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.189+0000 7f82cbfff700 1 --2- 172.21.15.6:0/197858936 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f82ac066f30 0x7f82ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:47.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.190+0000 7f82cbfff700 1 --2- 172.21.15.6:0/197858936 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f82ac066f30 0x7f82ac0693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0a84d0 tx=0x7f82bc0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:47.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.194+0000 7f82c8ff9700 1 -- 172.21.15.6:0/197858936 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82c4051470 con 0x7f82cc06a9b0 2023-10-06T02:17:47.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:47.384+0000 7f82d2da2700 1 -- 172.21.15.6:0/197858936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f82cc0b0890 con 0x7f82cc06a9b0 2023-10-06T02:17:48.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.030+0000 7f82c8ff9700 1 -- 172.21.15.6:0/197858936 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f82c4054a90 con 0x7f82cc06a9b0 2023-10-06T02:17:48.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.043+0000 7f82d2da2700 1 -- 172.21.15.6:0/197858936 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f82ac066f30 msgr2=0x7f82ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:48.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.043+0000 7f82d2da2700 1 --2- 172.21.15.6:0/197858936 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f82ac066f30 0x7f82ac0693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0a84d0 tx=0x7f82bc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:48.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.043+0000 7f82d2da2700 1 -- 172.21.15.6:0/197858936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82cc06a9b0 msgr2=0x7f82cc169050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:48.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.043+0000 7f82d2da2700 1 --2- 172.21.15.6:0/197858936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82cc06a9b0 0x7f82cc169050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f82c400c960 tx=0x7f82c40016f0 comp rx=0 tx=0).stop 2023-10-06T02:17:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.053+0000 7f82d2da2700 1 -- 172.21.15.6:0/197858936 shutdown_connections 2023-10-06T02:17:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.053+0000 7f82d2da2700 1 --2- 172.21.15.6:0/197858936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82cc15b770 0x7f82cc153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.053+0000 7f82d2da2700 1 --2- 172.21.15.6:0/197858936 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f82ac066f30 0x7f82ac0693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.053+0000 7f82d2da2700 1 --2- 172.21.15.6:0/197858936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82cc06a9b0 0x7f82cc169050 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.053+0000 7f82d2da2700 1 --2- 172.21.15.6:0/197858936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82cc1598b0 0x7f82cc158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.053+0000 7f82d2da2700 1 -- 172.21.15.6:0/197858936 >> 172.21.15.6:0/197858936 conn(0x7f82cc067910 msgr2=0x7f82cc069790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.054+0000 7f82d2da2700 1 -- 172.21.15.6:0/197858936 shutdown_connections 2023-10-06T02:17:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.054+0000 7f82d2da2700 1 -- 172.21.15.6:0/197858936 wait complete. 2023-10-06T02:17:48.057 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:17:48.057+0000 7f09b317c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:17:48.062 INFO:teuthology.orchestra.run.smithi006.stderr:set pool 5 allow_ec_overwrites to true 2023-10-06T02:17:48.074 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-06T02:17:48.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.199+0000 7f8a59937700 1 Processor -- start 2023-10-06T02:17:48.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.199+0000 7f8a59937700 1 -- start start 2023-10-06T02:17:48.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.200+0000 7f8a59937700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a5415cae0 0x7f8a540c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:48.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.200+0000 7f8a59937700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a5406a1a0 con 0x7f8a540cc740 2023-10-06T02:17:48.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.200+0000 7f8a59937700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a5406a480 con 0x7f8a5406a910 2023-10-06T02:17:48.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.200+0000 7f8a59937700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540c3f40 con 0x7f8a5415cae0 2023-10-06T02:17:48.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.200+0000 7f8a537fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8a540cc740 0x7f8a540ccbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56016/0 (socket says 172.21.15.6:56016) 2023-10-06T02:17:48.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.200+0000 7f8a537fe700 1 -- 172.21.15.6:0/3872509879 learned_addr learned my addr 172.21.15.6:0/3872509879 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:48.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a52ffd700 1 --2- 172.21.15.6:0/3872509879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a5415cae0 0x7f8a540c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:48.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a51ffb700 1 -- 172.21.15.6:0/3872509879 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014125929 0 0) 0x7f8a5406a1a0 con 0x7f8a540cc740 2023-10-06T02:17:48.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a51ffb700 1 -- 172.21.15.6:0/3872509879 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a40003570 con 0x7f8a540cc740 2023-10-06T02:17:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a51ffb700 1 -- 172.21.15.6:0/3872509879 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3474730428 0 0) 0x7f8a40003570 con 0x7f8a540cc740 2023-10-06T02:17:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a51ffb700 1 -- 172.21.15.6:0/3872509879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a5415cae0 msgr2=0x7f8a540c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a51ffb700 1 --2- 172.21.15.6:0/3872509879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a5415cae0 0x7f8a540c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a51ffb700 1 -- 172.21.15.6:0/3872509879 >> v1:172.21.15.175:6789/0 conn(0x7f8a5406a910 legacy=0x7f8a5406ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a51ffb700 1 -- 172.21.15.6:0/3872509879 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a540c4220 con 0x7f8a540cc740 2023-10-06T02:17:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a51ffb700 1 -- 172.21.15.6:0/3872509879 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f8a440017f0 con 0x7f8a540cc740 2023-10-06T02:17:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a51ffb700 1 -- 172.21.15.6:0/3872509879 >> v1:172.21.15.6:6789/0 conn(0x7f8a540cc740 legacy=0x7f8a540ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a51ffb700 1 --2- 172.21.15.6:0/3872509879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a40003a90 0x7f8a40003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a51ffb700 1 --2- 172.21.15.6:0/3872509879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a5415cae0 0x7f8a40004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a51ffb700 1 --2- 172.21.15.6:0/3872509879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a40004d50 0x7f8a400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a51ffb700 1 -- 172.21.15.6:0/3872509879 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540c3f40 con 0x7f8a40003a90 2023-10-06T02:17:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a51ffb700 1 -- 172.21.15.6:0/3872509879 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4000bb70 con 0x7f8a40004d50 2023-10-06T02:17:48.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a51ffb700 1 -- 172.21.15.6:0/3872509879 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4000bd30 con 0x7f8a5415cae0 2023-10-06T02:17:48.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a52ffd700 1 --2- 172.21.15.6:0/3872509879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a40003a90 0x7f8a40003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:48.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a527fc700 1 --2- 172.21.15.6:0/3872509879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a5415cae0 0x7f8a40004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:48.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a537fe700 1 --2- 172.21.15.6:0/3872509879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a40004d50 0x7f8a400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:48.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a52ffd700 1 -- 172.21.15.6:0/3872509879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a5415cae0 msgr2=0x7f8a40004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:48.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a52ffd700 1 --2- 172.21.15.6:0/3872509879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a5415cae0 0x7f8a40004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:48.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a52ffd700 1 -- 172.21.15.6:0/3872509879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a40004d50 msgr2=0x7f8a400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:48.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a52ffd700 1 --2- 172.21.15.6:0/3872509879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a40004d50 0x7f8a400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:48.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a52ffd700 1 -- 172.21.15.6:0/3872509879 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a40003570 con 0x7f8a40003a90 2023-10-06T02:17:48.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a527fc700 1 --2- 172.21.15.6:0/3872509879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a5415cae0 0x7f8a40004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:48.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.201+0000 7f8a537fe700 1 --2- 172.21.15.6:0/3872509879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a40004d50 0x7f8a400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:48.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.202+0000 7f8a52ffd700 1 --2- 172.21.15.6:0/3872509879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a40003a90 0x7f8a40003ea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c009bf0 tx=0x7f8a4c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a956955a4176f4e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:48.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.202+0000 7f8a51ffb700 1 -- 172.21.15.6:0/3872509879 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c005a00 con 0x7f8a40003a90 2023-10-06T02:17:48.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.202+0000 7f8a51ffb700 1 -- 172.21.15.6:0/3872509879 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c005b60 con 0x7f8a40003a90 2023-10-06T02:17:48.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.202+0000 7f8a51ffb700 1 -- 172.21.15.6:0/3872509879 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c00e710 con 0x7f8a40003a90 2023-10-06T02:17:48.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.202+0000 7f8a59937700 1 -- 172.21.15.6:0/3872509879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a40003a90 msgr2=0x7f8a40003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:48.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.202+0000 7f8a59937700 1 --2- 172.21.15.6:0/3872509879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a40003a90 0x7f8a40003ea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c009bf0 tx=0x7f8a4c009120 comp rx=0 tx=0).stop 2023-10-06T02:17:48.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.202+0000 7f8a537fe700 1 -- 172.21.15.6:0/3872509879 reap_dead start 2023-10-06T02:17:48.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.202+0000 7f8a59937700 1 -- 172.21.15.6:0/3872509879 shutdown_connections 2023-10-06T02:17:48.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.202+0000 7f8a59937700 1 -- 172.21.15.6:0/3872509879 >> 172.21.15.6:0/3872509879 conn(0x7f8a54067910 msgr2=0x7f8a540ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:48.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.202+0000 7f8a59937700 1 -- 172.21.15.6:0/3872509879 shutdown_connections 2023-10-06T02:17:48.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.202+0000 7f8a59937700 1 -- 172.21.15.6:0/3872509879 wait complete. 2023-10-06T02:17:48.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.204+0000 7f8a59937700 1 Processor -- start 2023-10-06T02:17:48.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.204+0000 7f8a59937700 1 -- start start 2023-10-06T02:17:48.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.204+0000 7f8a59937700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a40003a90 0x7f8a5414eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:48.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.204+0000 7f8a59937700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a540b23d0 0x7f8a540b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:48.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.204+0000 7f8a59937700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a54157900 0x7f8a54157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:48.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.204+0000 7f8a59937700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5416d1b0 con 0x7f8a54157900 2023-10-06T02:17:48.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.204+0000 7f8a59937700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a54158290 con 0x7f8a540b23d0 2023-10-06T02:17:48.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.204+0000 7f8a59937700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5414f030 con 0x7f8a40003a90 2023-10-06T02:17:48.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.204+0000 7f8a537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a54157900 0x7f8a54157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:48.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.204+0000 7f8a537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a54157900 0x7f8a54157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48542/0 (socket says 172.21.15.6:48542) 2023-10-06T02:17:48.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.204+0000 7f8a537fe700 1 -- 172.21.15.6:0/3346699013 learned_addr learned my addr 172.21.15.6:0/3346699013 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:48.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.205+0000 7f8a52ffd700 1 --2- 172.21.15.6:0/3346699013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a40003a90 0x7f8a5414eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:48.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.205+0000 7f8a527fc700 1 --2- 172.21.15.6:0/3346699013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a540b23d0 0x7f8a540b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:48.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.205+0000 7f8a537fe700 1 -- 172.21.15.6:0/3346699013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a40003a90 msgr2=0x7f8a5414eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:48.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.205+0000 7f8a537fe700 1 --2- 172.21.15.6:0/3346699013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a40003a90 0x7f8a5414eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:48.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.205+0000 7f8a537fe700 1 -- 172.21.15.6:0/3346699013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a540b23d0 msgr2=0x7f8a540b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:48.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.205+0000 7f8a537fe700 1 --2- 172.21.15.6:0/3346699013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a540b23d0 0x7f8a540b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:48.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.205+0000 7f8a537fe700 1 -- 172.21.15.6:0/3346699013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5416d400 con 0x7f8a54157900 2023-10-06T02:17:48.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.205+0000 7f8a537fe700 1 --2- 172.21.15.6:0/3346699013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a54157900 0x7f8a54157d50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8a540873e0 tx=0x7f8a44002160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:48.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.205+0000 7f8a4affd700 1 -- 172.21.15.6:0/3346699013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44017070 con 0x7f8a54157900 2023-10-06T02:17:48.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.205+0000 7f8a4affd700 1 -- 172.21.15.6:0/3346699013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4400eb10 con 0x7f8a54157900 2023-10-06T02:17:48.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.205+0000 7f8a59937700 1 -- 172.21.15.6:0/3346699013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5416d6e0 con 0x7f8a54157900 2023-10-06T02:17:48.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.205+0000 7f8a4affd700 1 -- 172.21.15.6:0/3346699013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4400eeb0 con 0x7f8a54157900 2023-10-06T02:17:48.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.205+0000 7f8a59937700 1 -- 172.21.15.6:0/3346699013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5416dca0 con 0x7f8a54157900 2023-10-06T02:17:48.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.206+0000 7f8a59937700 1 -- 172.21.15.6:0/3346699013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a5416de90 con 0x7f8a54157900 2023-10-06T02:17:48.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.206+0000 7f8a4affd700 1 -- 172.21.15.6:0/3346699013 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a44013630 con 0x7f8a54157900 2023-10-06T02:17:48.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.207+0000 7f8a4affd700 1 --2- 172.21.15.6:0/3346699013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a34066f30 0x7f8a340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:48.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.207+0000 7f8a4affd700 1 -- 172.21.15.6:0/3346699013 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f8a44084800 con 0x7f8a54157900 2023-10-06T02:17:48.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.207+0000 7f8a52ffd700 1 --2- 172.21.15.6:0/3346699013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a34066f30 0x7f8a340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:48.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.207+0000 7f8a52ffd700 1 --2- 172.21.15.6:0/3346699013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a34066f30 0x7f8a340693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c009160 tx=0x7f8a4c019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:48.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.211+0000 7f8a4affd700 1 -- 172.21.15.6:0/3346699013 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a44051640 con 0x7f8a54157900 2023-10-06T02:17:48.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:48.452+0000 7f8a59937700 1 -- 172.21.15.6:0/3346699013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f8a5406e590 con 0x7f8a54157900 2023-10-06T02:17:48.893 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:17:48.896 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:17:49.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.045+0000 7f8a4affd700 1 -- 172.21.15.6:0/3346699013 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7f8a44054c60 con 0x7f8a54157900 2023-10-06T02:17:49.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.047+0000 7f8a59937700 1 -- 172.21.15.6:0/3346699013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a34066f30 msgr2=0x7f8a340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.047+0000 7f8a59937700 1 --2- 172.21.15.6:0/3346699013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a34066f30 0x7f8a340693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c009160 tx=0x7f8a4c019000 comp rx=0 tx=0).stop 2023-10-06T02:17:49.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.047+0000 7f8a59937700 1 -- 172.21.15.6:0/3346699013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a54157900 msgr2=0x7f8a54157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.047+0000 7f8a59937700 1 --2- 172.21.15.6:0/3346699013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a54157900 0x7f8a54157d50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8a540873e0 tx=0x7f8a44002160 comp rx=0 tx=0).stop 2023-10-06T02:17:49.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.047+0000 7f8a59937700 1 -- 172.21.15.6:0/3346699013 shutdown_connections 2023-10-06T02:17:49.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.047+0000 7f8a59937700 1 --2- 172.21.15.6:0/3346699013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a34066f30 0x7f8a340693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.047+0000 7f8a59937700 1 --2- 172.21.15.6:0/3346699013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a54157900 0x7f8a54157d50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.047+0000 7f8a59937700 1 --2- 172.21.15.6:0/3346699013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a40003a90 0x7f8a5414eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.047+0000 7f8a59937700 1 --2- 172.21.15.6:0/3346699013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a540b23d0 0x7f8a540b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.047+0000 7f8a59937700 1 -- 172.21.15.6:0/3346699013 >> 172.21.15.6:0/3346699013 conn(0x7f8a54067910 msgr2=0x7f8a54158ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:49.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.047+0000 7f8a59937700 1 -- 172.21.15.6:0/3346699013 shutdown_connections 2023-10-06T02:17:49.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.047+0000 7f8a59937700 1 -- 172.21.15.6:0/3346699013 wait complete. 2023-10-06T02:17:49.049 INFO:teuthology.orchestra.run.smithi006.stderr:added data pool 5 to fsmap 2023-10-06T02:17:49.061 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:17:49.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.222+0000 7f8e103e4700 1 Processor -- start 2023-10-06T02:17:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.222+0000 7f8e103e4700 1 -- start start 2023-10-06T02:17:49.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.223+0000 7f8e103e4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8e080af4e0 0x7f8e080b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.223+0000 7f8e103e4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0815e190 con 0x7f8e0815db70 2023-10-06T02:17:49.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.223+0000 7f8e103e4700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e080cb650 con 0x7f8e080af8b0 2023-10-06T02:17:49.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.223+0000 7f8e103e4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e080b1910 con 0x7f8e080af4e0 2023-10-06T02:17:49.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.223+0000 7f8e0e180700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8e080af4e0 0x7f8e080b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.223+0000 7f8e0e981700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8e0815db70 0x7f8e080cbae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41882/0 (socket says 172.21.15.6:41882) 2023-10-06T02:17:49.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.223+0000 7f8e0e981700 1 -- 172.21.15.6:0/2741908991 learned_addr learned my addr 172.21.15.6:0/2741908991 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:49.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.224+0000 7f8e0d17e700 1 -- 172.21.15.6:0/2741908991 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617060248 0 0) 0x7f8e0815e190 con 0x7f8e0815db70 2023-10-06T02:17:49.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.224+0000 7f8e0d17e700 1 -- 172.21.15.6:0/2741908991 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8df0003570 con 0x7f8e0815db70 2023-10-06T02:17:49.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.224+0000 7f8e0e180700 1 -- 172.21.15.6:0/2741908991 >> v1:172.21.15.175:6789/0 conn(0x7f8e080af8b0 legacy=0x7f8e0815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:49.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.224+0000 7f8e0e180700 1 -- 172.21.15.6:0/2741908991 >> v1:172.21.15.6:6789/0 conn(0x7f8e0815db70 legacy=0x7f8e080cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.224+0000 7f8e0e180700 1 -- 172.21.15.6:0/2741908991 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e080cad20 con 0x7f8e080af4e0 2023-10-06T02:17:49.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.224+0000 7f8e0e180700 1 --2- 172.21.15.6:0/2741908991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e080af4e0 0x7f8e080b20e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8e000098e0 tx=0x7f8e000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669c3eaa9d3d0e48 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:49.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.224+0000 7f8e0d17e700 1 -- 172.21.15.6:0/2741908991 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00011630 con 0x7f8e080af4e0 2023-10-06T02:17:49.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.224+0000 7f8e0d17e700 1 -- 172.21.15.6:0/2741908991 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e00011790 con 0x7f8e080af4e0 2023-10-06T02:17:49.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.224+0000 7f8e0d17e700 1 -- 172.21.15.6:0/2741908991 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00011b30 con 0x7f8e080af4e0 2023-10-06T02:17:49.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.225+0000 7f8e103e4700 1 -- 172.21.15.6:0/2741908991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e080af4e0 msgr2=0x7f8e080b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.225+0000 7f8e103e4700 1 --2- 172.21.15.6:0/2741908991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e080af4e0 0x7f8e080b20e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8e000098e0 tx=0x7f8e000091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.225+0000 7f8e103e4700 1 -- 172.21.15.6:0/2741908991 shutdown_connections 2023-10-06T02:17:49.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.225+0000 7f8e103e4700 1 --2- 172.21.15.6:0/2741908991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e080af4e0 0x7f8e080b20e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.225+0000 7f8e103e4700 1 -- 172.21.15.6:0/2741908991 >> 172.21.15.6:0/2741908991 conn(0x7f8e08068680 msgr2=0x7f8e08068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:49.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.225+0000 7f8e103e4700 1 -- 172.21.15.6:0/2741908991 shutdown_connections 2023-10-06T02:17:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.225+0000 7f8e103e4700 1 -- 172.21.15.6:0/2741908991 wait complete. 2023-10-06T02:17:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.226+0000 7f8e103e4700 1 Processor -- start 2023-10-06T02:17:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.226+0000 7f8e103e4700 1 -- start start 2023-10-06T02:17:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.226+0000 7f8e103e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e080af4e0 0x7f8e0816a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e103e4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e080af8b0 0x7f8e080c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e103e4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e0815db70 0x7f8e080c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e103e4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080c7630 con 0x7f8e080af4e0 2023-10-06T02:17:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e103e4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0816b410 con 0x7f8e080af8b0 2023-10-06T02:17:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e103e4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0816a790 con 0x7f8e0815db70 2023-10-06T02:17:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e0e180700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e080af4e0 0x7f8e0816a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e0e180700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e080af4e0 0x7f8e0816a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36178/0 (socket says 172.21.15.6:36178) 2023-10-06T02:17:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e0e180700 1 -- 172.21.15.6:0/2186052970 learned_addr learned my addr 172.21.15.6:0/2186052970 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e0d97f700 1 --2- 172.21.15.6:0/2186052970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e080af8b0 0x7f8e080c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e0e981700 1 --2- 172.21.15.6:0/2186052970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e0815db70 0x7f8e080c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e0e180700 1 -- 172.21.15.6:0/2186052970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e0815db70 msgr2=0x7f8e080c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e0e180700 1 --2- 172.21.15.6:0/2186052970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e0815db70 0x7f8e080c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e0e180700 1 -- 172.21.15.6:0/2186052970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e080af8b0 msgr2=0x7f8e080c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e0e180700 1 --2- 172.21.15.6:0/2186052970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e080af8b0 0x7f8e080c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e0e180700 1 -- 172.21.15.6:0/2186052970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e00009420 con 0x7f8e080af4e0 2023-10-06T02:17:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e0d97f700 1 --2- 172.21.15.6:0/2186052970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e080af8b0 0x7f8e080c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e0e180700 1 --2- 172.21.15.6:0/2186052970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e080af4e0 0x7f8e0816a1b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8e000030c0 tx=0x7f8e00016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e067fc700 1 -- 172.21.15.6:0/2186052970 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00000c40 con 0x7f8e080af4e0 2023-10-06T02:17:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e067fc700 1 -- 172.21.15.6:0/2186052970 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e00020070 con 0x7f8e080af4e0 2023-10-06T02:17:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e103e4700 1 -- 172.21.15.6:0/2186052970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0816aa70 con 0x7f8e080af4e0 2023-10-06T02:17:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e067fc700 1 -- 172.21.15.6:0/2186052970 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00027690 con 0x7f8e080af4e0 2023-10-06T02:17:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.227+0000 7f8e103e4700 1 -- 172.21.15.6:0/2186052970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0816b030 con 0x7f8e080af4e0 2023-10-06T02:17:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.228+0000 7f8e103e4700 1 -- 172.21.15.6:0/2186052970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e08088aa0 con 0x7f8e080af4e0 2023-10-06T02:17:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.229+0000 7f8e067fc700 1 -- 172.21.15.6:0/2186052970 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e0001c450 con 0x7f8e080af4e0 2023-10-06T02:17:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.229+0000 7f8e067fc700 1 --2- 172.21.15.6:0/2186052970 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8df4066f30 0x7f8df40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.229+0000 7f8e067fc700 1 -- 172.21.15.6:0/2186052970 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8e00022070 con 0x7f8e080af4e0 2023-10-06T02:17:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.229+0000 7f8e0d97f700 1 --2- 172.21.15.6:0/2186052970 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8df4066f30 0x7f8df40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.230+0000 7f8e0d97f700 1 --2- 172.21.15.6:0/2186052970 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8df4066f30 0x7f8df40693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc007fd0 tx=0x7f8dfc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.233+0000 7f8e067fc700 1 -- 172.21.15.6:0/2186052970 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e000538a0 con 0x7f8e080af4e0 2023-10-06T02:17:49.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.470+0000 7f8e103e4700 1 -- 172.21.15.6:0/2186052970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e080b0910 con 0x7f8e080af4e0 2023-10-06T02:17:49.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.471+0000 7f8e067fc700 1 -- 172.21.15.6:0/2186052970 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4590 (secure 0 0 0) 0x7f8e00056ec0 con 0x7f8e080af4e0 2023-10-06T02:17:49.472 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:49.472 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3433510267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3433510267},{"type":"v1","addr":"172.21.15.175:6836","nonce":3433510267}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3290404467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3290404467},{"type":"v1","addr":"172.21.15.175:6837","nonce":3290404467}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/4132952009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4132952009},{"type":"v1","addr":"172.21.15.6:6834","nonce":4132952009}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:17:43.404580+0000","modified":"2023-10-06T02:17:49.037176+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/839986504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":839986504},{"type":"v1","addr":"172.21.15.6:6835","nonce":839986504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T02:17:49.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.473+0000 7f8e103e4700 1 -- 172.21.15.6:0/2186052970 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8df4066f30 msgr2=0x7f8df40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.473+0000 7f8e103e4700 1 --2- 172.21.15.6:0/2186052970 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8df4066f30 0x7f8df40693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc007fd0 tx=0x7f8dfc009040 comp rx=0 tx=0).stop 2023-10-06T02:17:49.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.473+0000 7f8e103e4700 1 -- 172.21.15.6:0/2186052970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e080af4e0 msgr2=0x7f8e0816a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.473+0000 7f8e103e4700 1 --2- 172.21.15.6:0/2186052970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e080af4e0 0x7f8e0816a1b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8e000030c0 tx=0x7f8e00016000 comp rx=0 tx=0).stop 2023-10-06T02:17:49.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.473+0000 7f8e103e4700 1 -- 172.21.15.6:0/2186052970 shutdown_connections 2023-10-06T02:17:49.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.473+0000 7f8e103e4700 1 --2- 172.21.15.6:0/2186052970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e0815db70 0x7f8e080c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.473+0000 7f8e103e4700 1 --2- 172.21.15.6:0/2186052970 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8df4066f30 0x7f8df40693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.473+0000 7f8e103e4700 1 --2- 172.21.15.6:0/2186052970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e080af4e0 0x7f8e0816a1b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.473+0000 7f8e103e4700 1 --2- 172.21.15.6:0/2186052970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e080af8b0 0x7f8e080c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.473+0000 7f8e103e4700 1 -- 172.21.15.6:0/2186052970 >> 172.21.15.6:0/2186052970 conn(0x7f8e08068680 msgr2=0x7f8e080afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:49.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.473+0000 7f8e103e4700 1 -- 172.21.15.6:0/2186052970 shutdown_connections 2023-10-06T02:17:49.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.473+0000 7f8e103e4700 1 -- 172.21.15.6:0/2186052970 wait complete. 2023-10-06T02:17:49.477 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 6 2023-10-06T02:17:49.486 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:17:49.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.605+0000 7f657a38e700 1 Processor -- start 2023-10-06T02:17:49.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.605+0000 7f657a38e700 1 -- start start 2023-10-06T02:17:49.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.606+0000 7f657a38e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f65740d05d0 0x7f65741641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.606+0000 7f657a38e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65740b3560 con 0x7f6574159400 2023-10-06T02:17:49.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.606+0000 7f657a38e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65740cf6f0 con 0x7f65740cf1a0 2023-10-06T02:17:49.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.606+0000 7f657a38e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65740cf9d0 con 0x7f65740d05d0 2023-10-06T02:17:49.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.606+0000 7f6579b8d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f65740d05d0 0x7f65741641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.606+0000 7f657938c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6574159400 0x7f65740ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41896/0 (socket says 172.21.15.6:41896) 2023-10-06T02:17:49.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.606+0000 7f657938c700 1 -- 172.21.15.6:0/1169997333 learned_addr learned my addr 172.21.15.6:0/1169997333 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:49.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.606+0000 7f6579b8d700 1 -- 172.21.15.6:0/1169997333 >> v1:172.21.15.175:6789/0 conn(0x7f65740cf1a0 legacy=0x7f65740cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.606+0000 7f6579b8d700 1 -- 172.21.15.6:0/1169997333 >> v1:172.21.15.6:6789/0 conn(0x7f6574159400 legacy=0x7f65740ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.606+0000 7f6579b8d700 1 -- 172.21.15.6:0/1169997333 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65740b2f10 con 0x7f65740d05d0 2023-10-06T02:17:49.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.606+0000 7f656bfff700 1 -- 172.21.15.6:0/1169997333 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456233895 0 0) 0x7f65740b3560 con 0x7f6574159400 2023-10-06T02:17:49.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.606+0000 7f6579b8d700 1 --2- 172.21.15.6:0/1169997333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65740d05d0 0x7f65741641d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f656c009e60 tx=0x7f656c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3965262359fb1e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.606+0000 7f656bfff700 1 -- 172.21.15.6:0/1169997333 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c00e070 con 0x7f65740d05d0 2023-10-06T02:17:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.607+0000 7f656bfff700 1 -- 172.21.15.6:0/1169997333 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656c00bc30 con 0x7f65740d05d0 2023-10-06T02:17:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.607+0000 7f656bfff700 1 -- 172.21.15.6:0/1169997333 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c012430 con 0x7f65740d05d0 2023-10-06T02:17:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.607+0000 7f657a38e700 1 -- 172.21.15.6:0/1169997333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65740d05d0 msgr2=0x7f65741641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.607+0000 7f657a38e700 1 --2- 172.21.15.6:0/1169997333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65740d05d0 0x7f65741641d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f656c009e60 tx=0x7f656c009780 comp rx=0 tx=0).stop 2023-10-06T02:17:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.607+0000 7f657a38e700 1 -- 172.21.15.6:0/1169997333 shutdown_connections 2023-10-06T02:17:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.607+0000 7f657a38e700 1 --2- 172.21.15.6:0/1169997333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65740d05d0 0x7f65741641d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.607+0000 7f657a38e700 1 -- 172.21.15.6:0/1169997333 >> 172.21.15.6:0/1169997333 conn(0x7f657406ac10 msgr2=0x7f6574068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.607+0000 7f657a38e700 1 -- 172.21.15.6:0/1169997333 shutdown_connections 2023-10-06T02:17:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.607+0000 7f657a38e700 1 -- 172.21.15.6:0/1169997333 wait complete. 2023-10-06T02:17:49.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.608+0000 7f657a38e700 1 Processor -- start 2023-10-06T02:17:49.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.608+0000 7f657a38e700 1 -- start start 2023-10-06T02:17:49.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.609+0000 7f657a38e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65740cf1a0 0x7f65740b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.609+0000 7f657a38e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65740d05d0 0x7f657416df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.609+0000 7f657a38e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6574159400 0x7f65740b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.609+0000 7f657a38e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65740b26d0 con 0x7f65740d05d0 2023-10-06T02:17:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.609+0000 7f657a38e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657416e4a0 con 0x7f6574159400 2023-10-06T02:17:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.609+0000 7f657a38e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6574157f80 con 0x7f65740cf1a0 2023-10-06T02:17:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.609+0000 7f6578b8b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65740d05d0 0x7f657416df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.609+0000 7f6578b8b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65740d05d0 0x7f657416df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36196/0 (socket says 172.21.15.6:36196) 2023-10-06T02:17:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.609+0000 7f6578b8b700 1 -- 172.21.15.6:0/4200567624 learned_addr learned my addr 172.21.15.6:0/4200567624 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.609+0000 7f657938c700 1 --2- 172.21.15.6:0/4200567624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65740cf1a0 0x7f65740b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.609+0000 7f6579b8d700 1 --2- 172.21.15.6:0/4200567624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6574159400 0x7f65740b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.610+0000 7f6578b8b700 1 -- 172.21.15.6:0/4200567624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65740cf1a0 msgr2=0x7f65740b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.610+0000 7f6578b8b700 1 --2- 172.21.15.6:0/4200567624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65740cf1a0 0x7f65740b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.610+0000 7f6578b8b700 1 -- 172.21.15.6:0/4200567624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6574159400 msgr2=0x7f65740b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.610+0000 7f6578b8b700 1 --2- 172.21.15.6:0/4200567624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6574159400 0x7f65740b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.610+0000 7f6578b8b700 1 -- 172.21.15.6:0/4200567624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656c009a20 con 0x7f65740d05d0 2023-10-06T02:17:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.610+0000 7f6579b8d700 1 --2- 172.21.15.6:0/4200567624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6574159400 0x7f65740b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.610+0000 7f6578b8b700 1 --2- 172.21.15.6:0/4200567624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65740d05d0 0x7f657416df60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f656400c590 tx=0x7f656400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.610+0000 7f65697fa700 1 -- 172.21.15.6:0/4200567624 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6564011590 con 0x7f65740d05d0 2023-10-06T02:17:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.610+0000 7f65697fa700 1 -- 172.21.15.6:0/4200567624 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6564011710 con 0x7f65740d05d0 2023-10-06T02:17:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.610+0000 7f657a38e700 1 -- 172.21.15.6:0/4200567624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65740b16b0 con 0x7f65740d05d0 2023-10-06T02:17:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.610+0000 7f65697fa700 1 -- 172.21.15.6:0/4200567624 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6564011ad0 con 0x7f65740d05d0 2023-10-06T02:17:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.610+0000 7f657a38e700 1 -- 172.21.15.6:0/4200567624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65740b1c70 con 0x7f65740d05d0 2023-10-06T02:17:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.611+0000 7f657a38e700 1 -- 172.21.15.6:0/4200567624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65740b1510 con 0x7f65740d05d0 2023-10-06T02:17:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.611+0000 7f65697fa700 1 -- 172.21.15.6:0/4200567624 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f656401b3b0 con 0x7f65740d05d0 2023-10-06T02:17:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.612+0000 7f65697fa700 1 --2- 172.21.15.6:0/4200567624 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6558066f30 0x7f65580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.612+0000 7f65697fa700 1 -- 172.21.15.6:0/4200567624 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6564083ec0 con 0x7f65740d05d0 2023-10-06T02:17:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.612+0000 7f657938c700 1 --2- 172.21.15.6:0/4200567624 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6558066f30 0x7f65580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.612+0000 7f657938c700 1 --2- 172.21.15.6:0/4200567624 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6558066f30 0x7f65580693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6570002970 tx=0x7f6570009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.616+0000 7f65697fa700 1 -- 172.21.15.6:0/4200567624 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65740b1510 con 0x7f65740d05d0 2023-10-06T02:17:49.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.811+0000 7f657a38e700 1 -- 172.21.15.6:0/4200567624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65740b1510 con 0x7f65740d05d0 2023-10-06T02:17:49.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.812+0000 7f65697fa700 1 -- 172.21.15.6:0/4200567624 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f65740b1510 con 0x7f65740d05d0 2023-10-06T02:17:49.812 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:49.813 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:48.453046+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:17:49.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.814+0000 7f657a38e700 1 -- 172.21.15.6:0/4200567624 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6558066f30 msgr2=0x7f65580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.814+0000 7f657a38e700 1 --2- 172.21.15.6:0/4200567624 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6558066f30 0x7f65580693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6570002970 tx=0x7f6570009040 comp rx=0 tx=0).stop 2023-10-06T02:17:49.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.814+0000 7f657a38e700 1 -- 172.21.15.6:0/4200567624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65740d05d0 msgr2=0x7f657416df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.814+0000 7f657a38e700 1 --2- 172.21.15.6:0/4200567624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65740d05d0 0x7f657416df60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f656400c590 tx=0x7f656400c8a0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.814+0000 7f657a38e700 1 -- 172.21.15.6:0/4200567624 shutdown_connections 2023-10-06T02:17:49.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.814+0000 7f657a38e700 1 --2- 172.21.15.6:0/4200567624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6574159400 0x7f65740b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.814+0000 7f657a38e700 1 --2- 172.21.15.6:0/4200567624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65740cf1a0 0x7f65740b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.814+0000 7f657a38e700 1 --2- 172.21.15.6:0/4200567624 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6558066f30 0x7f65580693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.814+0000 7f657a38e700 1 --2- 172.21.15.6:0/4200567624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65740d05d0 0x7f657416df60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.814+0000 7f657a38e700 1 -- 172.21.15.6:0/4200567624 >> 172.21.15.6:0/4200567624 conn(0x7f657406ac10 msgr2=0x7f6574155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:49.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.814+0000 7f657a38e700 1 -- 172.21.15.6:0/4200567624 shutdown_connections 2023-10-06T02:17:49.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.814+0000 7f657a38e700 1 -- 172.21.15.6:0/4200567624 wait complete. 2023-10-06T02:17:49.827 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:17:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.945+0000 7f2f5ce35700 1 Processor -- start 2023-10-06T02:17:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.945+0000 7f2f5ce35700 1 -- start start 2023-10-06T02:17:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f5ce35700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2f580af8b0 0x7f2f5815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f5ce35700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5815e190 con 0x7f2f580af4e0 2023-10-06T02:17:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f5ce35700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f580cb650 con 0x7f2f580b27f0 2023-10-06T02:17:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f5ce35700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f580b1910 con 0x7f2f580af8b0 2023-10-06T02:17:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f5659c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2f580af4e0 0x7f2f580b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41898/0 (socket says 172.21.15.6:41898) 2023-10-06T02:17:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f5659c700 1 -- 172.21.15.6:0/1050947214 learned_addr learned my addr 172.21.15.6:0/1050947214 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f55d9b700 1 --2- 172.21.15.6:0/1050947214 >> v2:172.21.15.175:3300/0 conn(0x7f2f580af8b0 0x7f2f5815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f5559a700 1 -- 172.21.15.6:0/1050947214 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710482622 0 0) 0x7f2f5815e190 con 0x7f2f580af4e0 2023-10-06T02:17:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f5559a700 1 -- 172.21.15.6:0/1050947214 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f40003570 con 0x7f2f580af4e0 2023-10-06T02:17:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f5559a700 1 -- 172.21.15.6:0/1050947214 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483709550 0 0) 0x7f2f580cb650 con 0x7f2f580b27f0 2023-10-06T02:17:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f5559a700 1 -- 172.21.15.6:0/1050947214 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f5815e190 con 0x7f2f580b27f0 2023-10-06T02:17:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f5559a700 1 -- 172.21.15.6:0/1050947214 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3236787032 0 0) 0x7f2f40003570 con 0x7f2f580af4e0 2023-10-06T02:17:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f5559a700 1 -- 172.21.15.6:0/1050947214 >> v2:172.21.15.175:3300/0 conn(0x7f2f580af8b0 msgr2=0x7f2f5815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f5559a700 1 --2- 172.21.15.6:0/1050947214 >> v2:172.21.15.175:3300/0 conn(0x7f2f580af8b0 0x7f2f5815d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f5559a700 1 -- 172.21.15.6:0/1050947214 >> v1:172.21.15.175:6789/0 conn(0x7f2f580b27f0 legacy=0x7f2f5815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f5559a700 1 -- 172.21.15.6:0/1050947214 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f580ccaf0 con 0x7f2f580af4e0 2023-10-06T02:17:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f5559a700 1 -- 172.21.15.6:0/1050947214 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f2f48001470 con 0x7f2f580af4e0 2023-10-06T02:17:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f55d9b700 1 --2- 172.21.15.6:0/1050947214 >> v2:172.21.15.175:3300/0 conn(0x7f2f580af8b0 0x7f2f5815d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.946+0000 7f2f5559a700 1 -- 172.21.15.6:0/1050947214 >> v1:172.21.15.6:6789/0 conn(0x7f2f580af4e0 legacy=0x7f2f580b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f5559a700 1 --2- 172.21.15.6:0/1050947214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f40003bf0 0x7f2f40003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f5559a700 1 --2- 172.21.15.6:0/1050947214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f40004810 0x7f2f40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f5559a700 1 --2- 172.21.15.6:0/1050947214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400051c0 0x7f2f4000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f5559a700 1 -- 172.21.15.6:0/1050947214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580b1910 con 0x7f2f400051c0 2023-10-06T02:17:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f5559a700 1 -- 172.21.15.6:0/1050947214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4000c160 con 0x7f2f40003bf0 2023-10-06T02:17:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f5559a700 1 -- 172.21.15.6:0/1050947214 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4000c320 con 0x7f2f40004810 2023-10-06T02:17:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f56d9d700 1 --2- 172.21.15.6:0/1050947214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400051c0 0x7f2f4000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f5659c700 1 --2- 172.21.15.6:0/1050947214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f40003bf0 0x7f2f40003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f55d9b700 1 --2- 172.21.15.6:0/1050947214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f40004810 0x7f2f40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f56d9d700 1 -- 172.21.15.6:0/1050947214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f40004810 msgr2=0x7f2f40004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f56d9d700 1 --2- 172.21.15.6:0/1050947214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f40004810 0x7f2f40004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f56d9d700 1 -- 172.21.15.6:0/1050947214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f40003bf0 msgr2=0x7f2f40003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f56d9d700 1 --2- 172.21.15.6:0/1050947214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f40003bf0 0x7f2f40003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f56d9d700 1 -- 172.21.15.6:0/1050947214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f40003570 con 0x7f2f400051c0 2023-10-06T02:17:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f56d9d700 1 -- 172.21.15.6:0/1050947214 reap_dead start 2023-10-06T02:17:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f56d9d700 1 --2- 172.21.15.6:0/1050947214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400051c0 0x7f2f4000ba60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2f500020f0 tx=0x7f2f500017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d593b512525e3a6a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f5559a700 1 -- 172.21.15.6:0/1050947214 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50001ab0 con 0x7f2f400051c0 2023-10-06T02:17:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f5559a700 1 -- 172.21.15.6:0/1050947214 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5000c8b0 con 0x7f2f400051c0 2023-10-06T02:17:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.947+0000 7f2f5559a700 1 -- 172.21.15.6:0/1050947214 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5000cc50 con 0x7f2f400051c0 2023-10-06T02:17:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.948+0000 7f2f5ce35700 1 -- 172.21.15.6:0/1050947214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400051c0 msgr2=0x7f2f4000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.948+0000 7f2f5ce35700 1 --2- 172.21.15.6:0/1050947214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400051c0 0x7f2f4000ba60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2f500020f0 tx=0x7f2f500017a0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.948+0000 7f2f5ce35700 1 -- 172.21.15.6:0/1050947214 shutdown_connections 2023-10-06T02:17:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.948+0000 7f2f5ce35700 1 --2- 172.21.15.6:0/1050947214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400051c0 0x7f2f4000ba60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.948+0000 7f2f5ce35700 1 -- 172.21.15.6:0/1050947214 >> 172.21.15.6:0/1050947214 conn(0x7f2f58068680 msgr2=0x7f2f58068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.948+0000 7f2f5ce35700 1 -- 172.21.15.6:0/1050947214 shutdown_connections 2023-10-06T02:17:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.948+0000 7f2f5ce35700 1 -- 172.21.15.6:0/1050947214 wait complete. 2023-10-06T02:17:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.949+0000 7f2f5ce35700 1 Processor -- start 2023-10-06T02:17:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.949+0000 7f2f5ce35700 1 -- start start 2023-10-06T02:17:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f5ce35700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f400051c0 0x7f2f58169f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f5ce35700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f5816a4b0 0x7f2f580a8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f5ce35700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f5816d090 0x7f2f580a9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f5ce35700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580a9d10 con 0x7f2f5816d090 2023-10-06T02:17:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f5ce35700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5815a300 con 0x7f2f5816a4b0 2023-10-06T02:17:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f5ce35700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580c7540 con 0x7f2f400051c0 2023-10-06T02:17:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f56d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f5816d090 0x7f2f580a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f56d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f5816d090 0x7f2f580a9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36206/0 (socket says 172.21.15.6:36206) 2023-10-06T02:17:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f56d9d700 1 -- 172.21.15.6:0/1574603504 learned_addr learned my addr 172.21.15.6:0/1574603504 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f55d9b700 1 --2- 172.21.15.6:0/1574603504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f5816a4b0 0x7f2f580a8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f5659c700 1 --2- 172.21.15.6:0/1574603504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f400051c0 0x7f2f58169f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f56d9d700 1 -- 172.21.15.6:0/1574603504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f400051c0 msgr2=0x7f2f58169f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f56d9d700 1 --2- 172.21.15.6:0/1574603504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f400051c0 0x7f2f58169f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f56d9d700 1 -- 172.21.15.6:0/1574603504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f5816a4b0 msgr2=0x7f2f580a8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f56d9d700 1 --2- 172.21.15.6:0/1574603504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f5816a4b0 0x7f2f580a8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f56d9d700 1 -- 172.21.15.6:0/1574603504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f580c7790 con 0x7f2f5816d090 2023-10-06T02:17:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f56d9d700 1 --2- 172.21.15.6:0/1574603504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f5816d090 0x7f2f580a9350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2f580cdd20 tx=0x7f2f50016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f467fc700 1 -- 172.21.15.6:0/1574603504 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50012ea0 con 0x7f2f5816d090 2023-10-06T02:17:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f467fc700 1 -- 172.21.15.6:0/1574603504 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5000c6d0 con 0x7f2f5816d090 2023-10-06T02:17:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f467fc700 1 -- 172.21.15.6:0/1574603504 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5001e680 con 0x7f2f5816d090 2023-10-06T02:17:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f5ce35700 1 -- 172.21.15.6:0/1574603504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f580c7a70 con 0x7f2f5816d090 2023-10-06T02:17:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.950+0000 7f2f5ce35700 1 -- 172.21.15.6:0/1574603504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f580c8030 con 0x7f2f5816d090 2023-10-06T02:17:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.951+0000 7f2f5ce35700 1 -- 172.21.15.6:0/1574603504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f58088aa0 con 0x7f2f5816d090 2023-10-06T02:17:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.952+0000 7f2f467fc700 1 -- 172.21.15.6:0/1574603504 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f50003030 con 0x7f2f5816d090 2023-10-06T02:17:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.952+0000 7f2f467fc700 1 --2- 172.21.15.6:0/1574603504 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f38066f30 0x7f2f380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.952+0000 7f2f467fc700 1 -- 172.21.15.6:0/1574603504 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2f500866b0 con 0x7f2f5816d090 2023-10-06T02:17:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.952+0000 7f2f5659c700 1 --2- 172.21.15.6:0/1574603504 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f38066f30 0x7f2f380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.953+0000 7f2f5659c700 1 --2- 172.21.15.6:0/1574603504 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f38066f30 0x7f2f380693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f48001200 tx=0x7f2f580ccc80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:49.957+0000 7f2f467fc700 1 -- 172.21.15.6:0/1574603504 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f500534d0 con 0x7f2f5816d090 2023-10-06T02:17:50.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.154+0000 7f2f5ce35700 1 -- 172.21.15.6:0/1574603504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f58088aa0 con 0x7f2f5816d090 2023-10-06T02:17:50.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.155+0000 7f2f467fc700 1 -- 172.21.15.6:0/1574603504 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f2f50056af0 con 0x7f2f5816d090 2023-10-06T02:17:50.155 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:50.155 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:48.453046+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:17:50.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.157+0000 7f2f5ce35700 1 -- 172.21.15.6:0/1574603504 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f38066f30 msgr2=0x7f2f380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:50.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.157+0000 7f2f5ce35700 1 --2- 172.21.15.6:0/1574603504 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f38066f30 0x7f2f380693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f48001200 tx=0x7f2f580ccc80 comp rx=0 tx=0).stop 2023-10-06T02:17:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.157+0000 7f2f5ce35700 1 -- 172.21.15.6:0/1574603504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f5816d090 msgr2=0x7f2f580a9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.157+0000 7f2f5ce35700 1 --2- 172.21.15.6:0/1574603504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f5816d090 0x7f2f580a9350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2f580cdd20 tx=0x7f2f50016000 comp rx=0 tx=0).stop 2023-10-06T02:17:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.157+0000 7f2f5ce35700 1 -- 172.21.15.6:0/1574603504 shutdown_connections 2023-10-06T02:17:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.157+0000 7f2f5ce35700 1 --2- 172.21.15.6:0/1574603504 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f38066f30 0x7f2f380693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.157+0000 7f2f5ce35700 1 --2- 172.21.15.6:0/1574603504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f5816d090 0x7f2f580a9350 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.157+0000 7f2f5ce35700 1 --2- 172.21.15.6:0/1574603504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f400051c0 0x7f2f58169f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.157+0000 7f2f5ce35700 1 --2- 172.21.15.6:0/1574603504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f5816a4b0 0x7f2f580a8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.157+0000 7f2f5ce35700 1 -- 172.21.15.6:0/1574603504 >> 172.21.15.6:0/1574603504 conn(0x7f2f58068680 msgr2=0x7f2f580cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.157+0000 7f2f5ce35700 1 -- 172.21.15.6:0/1574603504 shutdown_connections 2023-10-06T02:17:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.157+0000 7f2f5ce35700 1 -- 172.21.15.6:0/1574603504 wait complete. 2023-10-06T02:17:50.183 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:17:50.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.302+0000 7f0a0a322700 1 Processor -- start 2023-10-06T02:17:50.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.302+0000 7f0a0a322700 1 -- start start 2023-10-06T02:17:50.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.303+0000 7f0a0a322700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a041593f0 0x7f0a0406de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:50.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.303+0000 7f0a0a322700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a04069950 con 0x7f0a041597c0 2023-10-06T02:17:50.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.303+0000 7f0a0a322700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0415dfd0 con 0x7f0a0406adf0 2023-10-06T02:17:50.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.303+0000 7f0a0a322700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a040b2850 con 0x7f0a041593f0 2023-10-06T02:17:50.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.303+0000 7f0a037fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0a041597c0 0x7f0a0415d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41910/0 (socket says 172.21.15.6:41910) 2023-10-06T02:17:50.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.303+0000 7f0a037fe700 1 -- 172.21.15.6:0/2005711126 learned_addr learned my addr 172.21.15.6:0/2005711126 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:50.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.303+0000 7f0a03fff700 1 --2- 172.21.15.6:0/2005711126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a041593f0 0x7f0a0406de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:50.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.303+0000 7f0a02ffd700 1 -- 172.21.15.6:0/2005711126 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300702541 0 0) 0x7f0a04069950 con 0x7f0a041597c0 2023-10-06T02:17:50.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.303+0000 7f0a02ffd700 1 -- 172.21.15.6:0/2005711126 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09f0003570 con 0x7f0a041597c0 2023-10-06T02:17:50.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.303+0000 7f0a02ffd700 1 -- 172.21.15.6:0/2005711126 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3712677726 0 0) 0x7f0a0415dfd0 con 0x7f0a0406adf0 2023-10-06T02:17:50.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.303+0000 7f0a02ffd700 1 -- 172.21.15.6:0/2005711126 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a04069950 con 0x7f0a0406adf0 2023-10-06T02:17:50.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.303+0000 7f0a03fff700 1 -- 172.21.15.6:0/2005711126 >> v1:172.21.15.175:6789/0 conn(0x7f0a0406adf0 legacy=0x7f0a0415d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:50.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.303+0000 7f0a03fff700 1 -- 172.21.15.6:0/2005711126 >> v1:172.21.15.6:6789/0 conn(0x7f0a041597c0 legacy=0x7f0a0415d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.303+0000 7f0a03fff700 1 -- 172.21.15.6:0/2005711126 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a040b1fb0 con 0x7f0a041593f0 2023-10-06T02:17:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.304+0000 7f0a03fff700 1 --2- 172.21.15.6:0/2005711126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a041593f0 0x7f0a0406de10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f09ec009910 tx=0x7f09ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5aad34ded84c615 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.304+0000 7f0a02ffd700 1 -- 172.21.15.6:0/2005711126 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec011630 con 0x7f0a041593f0 2023-10-06T02:17:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.304+0000 7f0a02ffd700 1 -- 172.21.15.6:0/2005711126 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec011790 con 0x7f0a041593f0 2023-10-06T02:17:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.304+0000 7f0a02ffd700 1 -- 172.21.15.6:0/2005711126 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec011b30 con 0x7f0a041593f0 2023-10-06T02:17:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.304+0000 7f0a0a322700 1 -- 172.21.15.6:0/2005711126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a041593f0 msgr2=0x7f0a0406de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.304+0000 7f0a0a322700 1 --2- 172.21.15.6:0/2005711126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a041593f0 0x7f0a0406de10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f09ec009910 tx=0x7f09ec0091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.304+0000 7f0a0a322700 1 -- 172.21.15.6:0/2005711126 shutdown_connections 2023-10-06T02:17:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.304+0000 7f0a0a322700 1 --2- 172.21.15.6:0/2005711126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a041593f0 0x7f0a0406de10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.304+0000 7f0a0a322700 1 -- 172.21.15.6:0/2005711126 >> 172.21.15.6:0/2005711126 conn(0x7f0a0406cff0 msgr2=0x7f0a040afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.304+0000 7f0a0a322700 1 -- 172.21.15.6:0/2005711126 shutdown_connections 2023-10-06T02:17:50.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.304+0000 7f0a0a322700 1 -- 172.21.15.6:0/2005711126 wait complete. 2023-10-06T02:17:50.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.305+0000 7f0a0a322700 1 Processor -- start 2023-10-06T02:17:50.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.306+0000 7f0a0a322700 1 -- start start 2023-10-06T02:17:50.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.306+0000 7f0a0a322700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0406adf0 0x7f0a040ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:50.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.306+0000 7f0a0a322700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a041593f0 0x7f0a0416a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:50.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.306+0000 7f0a0a322700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a041597c0 0x7f0a0416a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:50.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.306+0000 7f0a0a322700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a040a4f50 con 0x7f0a0406adf0 2023-10-06T02:17:50.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.306+0000 7f0a0a322700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a040cac90 con 0x7f0a041593f0 2023-10-06T02:17:50.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.306+0000 7f0a0a322700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a040caf70 con 0x7f0a041597c0 2023-10-06T02:17:50.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.306+0000 7f0a03fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0406adf0 0x7f0a040ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:50.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.306+0000 7f0a03fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0406adf0 0x7f0a040ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36220/0 (socket says 172.21.15.6:36220) 2023-10-06T02:17:50.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.306+0000 7f0a03fff700 1 -- 172.21.15.6:0/2271524363 learned_addr learned my addr 172.21.15.6:0/2271524363 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:50.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.307+0000 7f0a037fe700 1 --2- 172.21.15.6:0/2271524363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a041593f0 0x7f0a0416a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:50.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.307+0000 7f0a088bf700 1 --2- 172.21.15.6:0/2271524363 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a041597c0 0x7f0a0416a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.307+0000 7f0a03fff700 1 -- 172.21.15.6:0/2271524363 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a041597c0 msgr2=0x7f0a0416a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.307+0000 7f0a03fff700 1 --2- 172.21.15.6:0/2271524363 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a041597c0 0x7f0a0416a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.307+0000 7f0a03fff700 1 -- 172.21.15.6:0/2271524363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a041593f0 msgr2=0x7f0a0416a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.307+0000 7f0a03fff700 1 --2- 172.21.15.6:0/2271524363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a041593f0 0x7f0a0416a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.307+0000 7f0a03fff700 1 -- 172.21.15.6:0/2271524363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec009420 con 0x7f0a0406adf0 2023-10-06T02:17:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.307+0000 7f0a03fff700 1 --2- 172.21.15.6:0/2271524363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0406adf0 0x7f0a040ca260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f09ec009f00 tx=0x7f09ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.307+0000 7f09fbfff700 1 -- 172.21.15.6:0/2271524363 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec01f070 con 0x7f0a0406adf0 2023-10-06T02:17:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.307+0000 7f09fbfff700 1 -- 172.21.15.6:0/2271524363 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec002f70 con 0x7f0a0406adf0 2023-10-06T02:17:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.307+0000 7f09fbfff700 1 -- 172.21.15.6:0/2271524363 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec023410 con 0x7f0a0406adf0 2023-10-06T02:17:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.308+0000 7f0a0a322700 1 -- 172.21.15.6:0/2271524363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a040cb250 con 0x7f0a0406adf0 2023-10-06T02:17:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.308+0000 7f0a0a322700 1 -- 172.21.15.6:0/2271524363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a040cccb0 con 0x7f0a0406adf0 2023-10-06T02:17:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.309+0000 7f0a0a322700 1 -- 172.21.15.6:0/2271524363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0406d3f0 con 0x7f0a0406adf0 2023-10-06T02:17:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.311+0000 7f09fbfff700 1 -- 172.21.15.6:0/2271524363 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09ec0193b0 con 0x7f0a0406adf0 2023-10-06T02:17:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.312+0000 7f09fbfff700 1 --2- 172.21.15.6:0/2271524363 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f09e4066f30 0x7f09e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:50.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.312+0000 7f09fbfff700 1 -- 172.21.15.6:0/2271524363 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f09ec085fb0 con 0x7f0a0406adf0 2023-10-06T02:17:50.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.312+0000 7f0a037fe700 1 --2- 172.21.15.6:0/2271524363 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f09e4066f30 0x7f09e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:50.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.312+0000 7f0a037fe700 1 --2- 172.21.15.6:0/2271524363 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f09e4066f30 0x7f09e40693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0a040cd1f0 tx=0x7f09f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:50.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.315+0000 7f09fbfff700 1 -- 172.21.15.6:0/2271524363 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09ec052e90 con 0x7f0a0406adf0 2023-10-06T02:17:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.554+0000 7f0a0a322700 1 -- 172.21.15.6:0/2271524363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a040b2290 con 0x7f0a0406adf0 2023-10-06T02:17:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.555+0000 7f09fbfff700 1 -- 172.21.15.6:0/2271524363 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4590 (secure 0 0 0) 0x7f09ec028090 con 0x7f0a0406adf0 2023-10-06T02:17:50.555 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:50.555 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3433510267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3433510267},{"type":"v1","addr":"172.21.15.175:6836","nonce":3433510267}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3290404467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3290404467},{"type":"v1","addr":"172.21.15.175:6837","nonce":3290404467}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/4132952009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4132952009},{"type":"v1","addr":"172.21.15.6:6834","nonce":4132952009}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:17:43.404580+0000","modified":"2023-10-06T02:17:49.037176+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/839986504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":839986504},{"type":"v1","addr":"172.21.15.6:6835","nonce":839986504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T02:17:50.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.557+0000 7f0a0a322700 1 -- 172.21.15.6:0/2271524363 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f09e4066f30 msgr2=0x7f09e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:50.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.557+0000 7f0a0a322700 1 --2- 172.21.15.6:0/2271524363 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f09e4066f30 0x7f09e40693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0a040cd1f0 tx=0x7f09f4009040 comp rx=0 tx=0).stop 2023-10-06T02:17:50.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.557+0000 7f0a0a322700 1 -- 172.21.15.6:0/2271524363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0406adf0 msgr2=0x7f0a040ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.557+0000 7f0a0a322700 1 --2- 172.21.15.6:0/2271524363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0406adf0 0x7f0a040ca260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f09ec009f00 tx=0x7f09ec017000 comp rx=0 tx=0).stop 2023-10-06T02:17:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.557+0000 7f0a0a322700 1 -- 172.21.15.6:0/2271524363 shutdown_connections 2023-10-06T02:17:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.557+0000 7f0a0a322700 1 --2- 172.21.15.6:0/2271524363 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a041597c0 0x7f0a0416a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.557+0000 7f0a0a322700 1 --2- 172.21.15.6:0/2271524363 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f09e4066f30 0x7f09e40693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.557+0000 7f0a0a322700 1 --2- 172.21.15.6:0/2271524363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0406adf0 0x7f0a040ca260 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.557+0000 7f0a0a322700 1 --2- 172.21.15.6:0/2271524363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a041593f0 0x7f0a0416a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.557+0000 7f0a0a322700 1 -- 172.21.15.6:0/2271524363 >> 172.21.15.6:0/2271524363 conn(0x7f0a0406cff0 msgr2=0x7f0a041586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.557+0000 7f0a0a322700 1 -- 172.21.15.6:0/2271524363 shutdown_connections 2023-10-06T02:17:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.557+0000 7f0a0a322700 1 -- 172.21.15.6:0/2271524363 wait complete. 2023-10-06T02:17:50.559 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 6 2023-10-06T02:17:50.569 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:17:50.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.687+0000 7f59440f2700 1 Processor -- start 2023-10-06T02:17:50.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.687+0000 7f59440f2700 1 -- start start 2023-10-06T02:17:50.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.688+0000 7f59440f2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f593c15b3c0 0x7f593c097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:50.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.688+0000 7f59440f2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f593c0b3c50 0x7f593c15b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:50.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.688+0000 7f59440f2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593c0afb90 con 0x7f593c15bcd0 2023-10-06T02:17:50.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.688+0000 7f59440f2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c0b2310 con 0x7f593c15b3c0 2023-10-06T02:17:50.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.688+0000 7f59440f2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0b25f0 con 0x7f593c0b3c50 2023-10-06T02:17:50.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.688+0000 7f594268f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f593c15bcd0 0x7f593c15a590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41924/0 (socket says 172.21.15.6:41924) 2023-10-06T02:17:50.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.688+0000 7f594268f700 1 -- 172.21.15.6:0/1711739409 learned_addr learned my addr 172.21.15.6:0/1711739409 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:50.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f594168d700 1 --2- 172.21.15.6:0/1711739409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f593c0b3c50 0x7f593c15b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:50.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5941e8e700 1 --2- 172.21.15.6:0/1711739409 >> v2:172.21.15.175:3300/0 conn(0x7f593c15b3c0 0x7f593c097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:50.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5940e8c700 1 -- 172.21.15.6:0/1711739409 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321227742 0 0) 0x7f593c0afb90 con 0x7f593c15bcd0 2023-10-06T02:17:50.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5940e8c700 1 -- 172.21.15.6:0/1711739409 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5924003570 con 0x7f593c15bcd0 2023-10-06T02:17:50.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5940e8c700 1 -- 172.21.15.6:0/1711739409 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1827662317 0 0) 0x7f5924003570 con 0x7f593c15bcd0 2023-10-06T02:17:50.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5940e8c700 1 -- 172.21.15.6:0/1711739409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f593c0b3c50 msgr2=0x7f593c15b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:50.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5940e8c700 1 --2- 172.21.15.6:0/1711739409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f593c0b3c50 0x7f593c15b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5940e8c700 1 -- 172.21.15.6:0/1711739409 >> v2:172.21.15.175:3300/0 conn(0x7f593c15b3c0 msgr2=0x7f593c097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:50.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5940e8c700 1 --2- 172.21.15.6:0/1711739409 >> v2:172.21.15.175:3300/0 conn(0x7f593c15b3c0 0x7f593c097d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5940e8c700 1 -- 172.21.15.6:0/1711739409 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c0af820 con 0x7f593c15bcd0 2023-10-06T02:17:50.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5940e8c700 1 -- 172.21.15.6:0/1711739409 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f592c0017f0 con 0x7f593c15bcd0 2023-10-06T02:17:50.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5940e8c700 1 -- 172.21.15.6:0/1711739409 >> v1:172.21.15.6:6789/0 conn(0x7f593c15bcd0 legacy=0x7f593c15a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:50.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5940e8c700 1 --2- 172.21.15.6:0/1711739409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5924003a60 0x7f5924003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:50.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5940e8c700 1 --2- 172.21.15.6:0/1711739409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5924004810 0x7f5924004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:50.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5940e8c700 1 --2- 172.21.15.6:0/1711739409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f593c0b3c50 0x7f59240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:50.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5940e8c700 1 -- 172.21.15.6:0/1711739409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0b2310 con 0x7f5924004810 2023-10-06T02:17:50.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5940e8c700 1 -- 172.21.15.6:0/1711739409 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0b25f0 con 0x7f5924003a60 2023-10-06T02:17:50.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5940e8c700 1 -- 172.21.15.6:0/1711739409 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592400ba60 con 0x7f593c0b3c50 2023-10-06T02:17:50.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f594168d700 1 --2- 172.21.15.6:0/1711739409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5924004810 0x7f5924004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:50.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f5941e8e700 1 --2- 172.21.15.6:0/1711739409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5924003a60 0x7f5924003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:50.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f594268f700 1 --2- 172.21.15.6:0/1711739409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f593c0b3c50 0x7f59240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:50.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f594168d700 1 -- 172.21.15.6:0/1711739409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f593c0b3c50 msgr2=0x7f59240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:50.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f594168d700 1 --2- 172.21.15.6:0/1711739409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f593c0b3c50 0x7f59240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f594168d700 1 -- 172.21.15.6:0/1711739409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5924003a60 msgr2=0x7f5924003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:50.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f594168d700 1 --2- 172.21.15.6:0/1711739409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5924003a60 0x7f5924003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f594168d700 1 -- 172.21.15.6:0/1711739409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5924003570 con 0x7f5924004810 2023-10-06T02:17:50.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.689+0000 7f594168d700 1 --2- 172.21.15.6:0/1711739409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5924004810 0x7f5924004c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5930009c30 tx=0x7f59300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951635e6f6032e3e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:50.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.690+0000 7f5940e8c700 1 -- 172.21.15.6:0/1711739409 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593000e710 con 0x7f5924004810 2023-10-06T02:17:50.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.690+0000 7f5940e8c700 1 -- 172.21.15.6:0/1711739409 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593000e870 con 0x7f5924004810 2023-10-06T02:17:50.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.690+0000 7f5940e8c700 1 -- 172.21.15.6:0/1711739409 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593000ec30 con 0x7f5924004810 2023-10-06T02:17:50.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.690+0000 7f59440f2700 1 -- 172.21.15.6:0/1711739409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5924004810 msgr2=0x7f5924004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:50.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.690+0000 7f59440f2700 1 --2- 172.21.15.6:0/1711739409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5924004810 0x7f5924004c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5930009c30 tx=0x7f59300091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.690+0000 7f594268f700 1 -- 172.21.15.6:0/1711739409 reap_dead start 2023-10-06T02:17:50.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.690+0000 7f59440f2700 1 -- 172.21.15.6:0/1711739409 shutdown_connections 2023-10-06T02:17:50.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.690+0000 7f59440f2700 1 -- 172.21.15.6:0/1711739409 >> 172.21.15.6:0/1711739409 conn(0x7f593c067910 msgr2=0x7f593c0ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:50.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.690+0000 7f59440f2700 1 -- 172.21.15.6:0/1711739409 shutdown_connections 2023-10-06T02:17:50.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.690+0000 7f59440f2700 1 -- 172.21.15.6:0/1711739409 wait complete. 2023-10-06T02:17:50.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.691+0000 7f59440f2700 1 Processor -- start 2023-10-06T02:17:50.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.691+0000 7f59440f2700 1 -- start start 2023-10-06T02:17:50.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.692+0000 7f59440f2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5924004810 0x7f593c0a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:50.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.692+0000 7f59440f2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f593c14ff70 0x7f593c1656d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:50.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.692+0000 7f59440f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f593c0a9aa0 0x7f593c165c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:50.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.692+0000 7f59440f2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c069c40 con 0x7f593c0a9aa0 2023-10-06T02:17:50.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.692+0000 7f59440f2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c06ca20 con 0x7f593c14ff70 2023-10-06T02:17:50.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.692+0000 7f59440f2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0aa020 con 0x7f5924004810 2023-10-06T02:17:50.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.692+0000 7f594268f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f593c0a9aa0 0x7f593c165c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:50.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.692+0000 7f594268f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f593c0a9aa0 0x7f593c165c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36232/0 (socket says 172.21.15.6:36232) 2023-10-06T02:17:50.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.692+0000 7f594268f700 1 -- 172.21.15.6:0/2352197977 learned_addr learned my addr 172.21.15.6:0/2352197977 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:50.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.692+0000 7f594168d700 1 --2- 172.21.15.6:0/2352197977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f593c14ff70 0x7f593c1656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:50.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.692+0000 7f5941e8e700 1 --2- 172.21.15.6:0/2352197977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5924004810 0x7f593c0a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:50.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.692+0000 7f594268f700 1 -- 172.21.15.6:0/2352197977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5924004810 msgr2=0x7f593c0a9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:50.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.692+0000 7f594268f700 1 --2- 172.21.15.6:0/2352197977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5924004810 0x7f593c0a9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.692+0000 7f594268f700 1 -- 172.21.15.6:0/2352197977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f593c14ff70 msgr2=0x7f593c1656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:50.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.692+0000 7f594268f700 1 --2- 172.21.15.6:0/2352197977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f593c14ff70 0x7f593c1656d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.692+0000 7f594268f700 1 -- 172.21.15.6:0/2352197977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c0aa300 con 0x7f593c0a9aa0 2023-10-06T02:17:50.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.693+0000 7f594268f700 1 --2- 172.21.15.6:0/2352197977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f593c0a9aa0 0x7f593c165c10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f592c000f80 tx=0x7f592c002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:50.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.693+0000 7f5939ffb700 1 -- 172.21.15.6:0/2352197977 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c00ad80 con 0x7f593c0a9aa0 2023-10-06T02:17:50.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.693+0000 7f5939ffb700 1 -- 172.21.15.6:0/2352197977 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c0133f0 con 0x7f593c0a9aa0 2023-10-06T02:17:50.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.693+0000 7f59440f2700 1 -- 172.21.15.6:0/2352197977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c06c6b0 con 0x7f593c0a9aa0 2023-10-06T02:17:50.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.693+0000 7f5939ffb700 1 -- 172.21.15.6:0/2352197977 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c0137b0 con 0x7f593c0a9aa0 2023-10-06T02:17:50.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.693+0000 7f59440f2700 1 -- 172.21.15.6:0/2352197977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593c0aa5e0 con 0x7f593c0a9aa0 2023-10-06T02:17:50.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.694+0000 7f59440f2700 1 -- 172.21.15.6:0/2352197977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593c06e8d0 con 0x7f593c0a9aa0 2023-10-06T02:17:50.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.694+0000 7f5939ffb700 1 -- 172.21.15.6:0/2352197977 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f592c013b20 con 0x7f593c0a9aa0 2023-10-06T02:17:50.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.694+0000 7f5939ffb700 1 --2- 172.21.15.6:0/2352197977 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5928066f30 0x7f59280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:50.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.694+0000 7f5939ffb700 1 -- 172.21.15.6:0/2352197977 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f592c0854e0 con 0x7f593c0a9aa0 2023-10-06T02:17:50.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.695+0000 7f5941e8e700 1 --2- 172.21.15.6:0/2352197977 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5928066f30 0x7f59280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:50.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.695+0000 7f5941e8e700 1 --2- 172.21.15.6:0/2352197977 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5928066f30 0x7f59280693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5934009390 tx=0x7f5934008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:50.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.699+0000 7f5939ffb700 1 -- 172.21.15.6:0/2352197977 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f592c052300 con 0x7f593c0a9aa0 2023-10-06T02:17:50.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.892+0000 7f59440f2700 1 -- 172.21.15.6:0/2352197977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f593c0af4f0 con 0x7f593c0a9aa0 2023-10-06T02:17:50.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.893+0000 7f5939ffb700 1 -- 172.21.15.6:0/2352197977 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f592c055920 con 0x7f593c0a9aa0 2023-10-06T02:17:50.894 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:50.894 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:48.453046+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:17:50.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.895+0000 7f59440f2700 1 -- 172.21.15.6:0/2352197977 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5928066f30 msgr2=0x7f59280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:50.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.895+0000 7f59440f2700 1 --2- 172.21.15.6:0/2352197977 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5928066f30 0x7f59280693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5934009390 tx=0x7f5934008040 comp rx=0 tx=0).stop 2023-10-06T02:17:50.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.895+0000 7f59440f2700 1 -- 172.21.15.6:0/2352197977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f593c0a9aa0 msgr2=0x7f593c165c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:50.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.895+0000 7f59440f2700 1 --2- 172.21.15.6:0/2352197977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f593c0a9aa0 0x7f593c165c10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f592c000f80 tx=0x7f592c002210 comp rx=0 tx=0).stop 2023-10-06T02:17:50.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.895+0000 7f59440f2700 1 -- 172.21.15.6:0/2352197977 shutdown_connections 2023-10-06T02:17:50.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.895+0000 7f59440f2700 1 --2- 172.21.15.6:0/2352197977 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5928066f30 0x7f59280693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.895+0000 7f59440f2700 1 --2- 172.21.15.6:0/2352197977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f593c0a9aa0 0x7f593c165c10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.895+0000 7f59440f2700 1 --2- 172.21.15.6:0/2352197977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5924004810 0x7f593c0a9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.895+0000 7f59440f2700 1 --2- 172.21.15.6:0/2352197977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f593c14ff70 0x7f593c1656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:50.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.895+0000 7f59440f2700 1 -- 172.21.15.6:0/2352197977 >> 172.21.15.6:0/2352197977 conn(0x7f593c067910 msgr2=0x7f593c152db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:50.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.895+0000 7f59440f2700 1 -- 172.21.15.6:0/2352197977 shutdown_connections 2023-10-06T02:17:50.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:50.895+0000 7f59440f2700 1 -- 172.21.15.6:0/2352197977 wait complete. 2023-10-06T02:17:51.309 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:17:43.404580+0000', 'modified': '2023-10-06T02:17:49.037176+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/839986504', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 839986504}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 839986504}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-10-06T02:17:51.309 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:17:51.309 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:17:51.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.433+0000 7f67f1405700 1 Processor -- start 2023-10-06T02:17:51.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.433+0000 7f67f1405700 1 -- start start 2023-10-06T02:17:51.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.434+0000 7f67f1405700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67ec0cf1a0 0x7f67ec0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.434+0000 7f67f1405700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f67ec1597d0 0x7f67ec0d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.434+0000 7f67f1405700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67ec0b3560 con 0x7f67ec159400 2023-10-06T02:17:51.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.434+0000 7f67f1405700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ec0cf6f0 con 0x7f67ec0cf1a0 2023-10-06T02:17:51.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.434+0000 7f67f1405700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ec0cf9d0 con 0x7f67ec1597d0 2023-10-06T02:17:51.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.434+0000 7f67eb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67ec0cf1a0 0x7f67ec0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.434+0000 7f67eb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67ec0cf1a0 0x7f67ec0cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36236/0 (socket says 172.21.15.6:36236) 2023-10-06T02:17:51.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.434+0000 7f67eb7fe700 1 -- 172.21.15.6:0/294092984 learned_addr learned my addr 172.21.15.6:0/294092984 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:51.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.434+0000 7f67f0c04700 1 --2- 172.21.15.6:0/294092984 >> v2:172.21.15.175:3300/0 conn(0x7f67ec1597d0 0x7f67ec0d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.434+0000 7f67eb7fe700 1 -- 172.21.15.6:0/294092984 >> v2:172.21.15.175:3300/0 conn(0x7f67ec1597d0 msgr2=0x7f67ec0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:51.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.434+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/294092984 >> v2:172.21.15.175:3300/0 conn(0x7f67ec1597d0 0x7f67ec0d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.434+0000 7f67eb7fe700 1 -- 172.21.15.6:0/294092984 >> v1:172.21.15.175:6789/0 conn(0x7f67ec159400 legacy=0x7f67ec0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.434+0000 7f67eb7fe700 1 -- 172.21.15.6:0/294092984 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ec0b2f10 con 0x7f67ec0cf1a0 2023-10-06T02:17:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.434+0000 7f67f0c04700 1 --2- 172.21.15.6:0/294092984 >> v2:172.21.15.175:3300/0 conn(0x7f67ec1597d0 0x7f67ec0d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:17:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.434+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/294092984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec0cf1a0 0x7f67ec0cfec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f67ec069710 tx=0x7f67e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ef54369749fd59 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.435+0000 7f67eaffd700 1 -- 172.21.15.6:0/294092984 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e000b820 con 0x7f67ec0cf1a0 2023-10-06T02:17:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.435+0000 7f67eaffd700 1 -- 172.21.15.6:0/294092984 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e000b980 con 0x7f67ec0cf1a0 2023-10-06T02:17:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.435+0000 7f67eaffd700 1 -- 172.21.15.6:0/294092984 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e000bd20 con 0x7f67ec0cf1a0 2023-10-06T02:17:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.435+0000 7f67f1405700 1 -- 172.21.15.6:0/294092984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec0cf1a0 msgr2=0x7f67ec0cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.435+0000 7f67f1405700 1 --2- 172.21.15.6:0/294092984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec0cf1a0 0x7f67ec0cfec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f67ec069710 tx=0x7f67e0009250 comp rx=0 tx=0).stop 2023-10-06T02:17:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.435+0000 7f67f1405700 1 -- 172.21.15.6:0/294092984 shutdown_connections 2023-10-06T02:17:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.435+0000 7f67f1405700 1 --2- 172.21.15.6:0/294092984 >> v2:172.21.15.175:3300/0 conn(0x7f67ec1597d0 0x7f67ec0d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.435+0000 7f67f1405700 1 --2- 172.21.15.6:0/294092984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec0cf1a0 0x7f67ec0cfec0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.435+0000 7f67f1405700 1 -- 172.21.15.6:0/294092984 >> 172.21.15.6:0/294092984 conn(0x7f67ec06ac10 msgr2=0x7f67ec068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:51.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.435+0000 7f67f1405700 1 -- 172.21.15.6:0/294092984 shutdown_connections 2023-10-06T02:17:51.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.435+0000 7f67f1405700 1 -- 172.21.15.6:0/294092984 wait complete. 2023-10-06T02:17:51.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.436+0000 7f67f1405700 1 Processor -- start 2023-10-06T02:17:51.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.437+0000 7f67f1405700 1 -- start start 2023-10-06T02:17:51.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.437+0000 7f67f1405700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67ec0cf1a0 0x7f67ec16a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.437+0000 7f67f1405700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec159400 0x7f67ec0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.437+0000 7f67f1405700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67ec1597d0 0x7f67ec0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.437+0000 7f67f1405700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec0b1a00 con 0x7f67ec159400 2023-10-06T02:17:51.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.437+0000 7f67f1405700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec153130 con 0x7f67ec0cf1a0 2023-10-06T02:17:51.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.437+0000 7f67f1405700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec15c7d0 con 0x7f67ec1597d0 2023-10-06T02:17:51.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.437+0000 7f67eb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec159400 0x7f67ec0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.437+0000 7f67eb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec159400 0x7f67ec0b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36244/0 (socket says 172.21.15.6:36244) 2023-10-06T02:17:51.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.437+0000 7f67eb7fe700 1 -- 172.21.15.6:0/2378874074 learned_addr learned my addr 172.21.15.6:0/2378874074 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:51.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.437+0000 7f67f0c04700 1 --2- 172.21.15.6:0/2378874074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67ec1597d0 0x7f67ec0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.437+0000 7f67ebfff700 1 --2- 172.21.15.6:0/2378874074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67ec0cf1a0 0x7f67ec16a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.438+0000 7f67eb7fe700 1 -- 172.21.15.6:0/2378874074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67ec1597d0 msgr2=0x7f67ec0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:51.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.438+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/2378874074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67ec1597d0 0x7f67ec0b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.438+0000 7f67eb7fe700 1 -- 172.21.15.6:0/2378874074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67ec0cf1a0 msgr2=0x7f67ec16a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:51.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.438+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/2378874074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67ec0cf1a0 0x7f67ec16a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.438+0000 7f67eb7fe700 1 -- 172.21.15.6:0/2378874074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e00094f0 con 0x7f67ec159400 2023-10-06T02:17:51.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.438+0000 7f67ebfff700 1 --2- 172.21.15.6:0/2378874074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67ec0cf1a0 0x7f67ec16a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:51.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.438+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/2378874074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec159400 0x7f67ec0b39f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0b2b80 tx=0x7f67e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:51.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.438+0000 7f67d3fff700 1 -- 172.21.15.6:0/2378874074 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e0011e20 con 0x7f67ec159400 2023-10-06T02:17:51.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.438+0000 7f67d3fff700 1 -- 172.21.15.6:0/2378874074 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e0020070 con 0x7f67ec159400 2023-10-06T02:17:51.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.438+0000 7f67f1405700 1 -- 172.21.15.6:0/2378874074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ec16abd0 con 0x7f67ec159400 2023-10-06T02:17:51.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.438+0000 7f67d3fff700 1 -- 172.21.15.6:0/2378874074 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e001b6a0 con 0x7f67ec159400 2023-10-06T02:17:51.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.438+0000 7f67f1405700 1 -- 172.21.15.6:0/2378874074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ec15c180 con 0x7f67ec159400 2023-10-06T02:17:51.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.440+0000 7f67d3fff700 1 -- 172.21.15.6:0/2378874074 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f67e0022030 con 0x7f67ec159400 2023-10-06T02:17:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.440+0000 7f67d3fff700 1 --2- 172.21.15.6:0/2378874074 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f67d8066f30 0x7f67d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.440+0000 7f67d3fff700 1 -- 172.21.15.6:0/2378874074 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f67e0086900 con 0x7f67ec159400 2023-10-06T02:17:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.440+0000 7f67ebfff700 1 --2- 172.21.15.6:0/2378874074 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f67d8066f30 0x7f67d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.441+0000 7f67ebfff700 1 --2- 172.21.15.6:0/2378874074 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f67d8066f30 0x7f67d80693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67ec158d20 tx=0x7f67dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.442+0000 7f67fb95fb80 1 Processor -- start 2023-10-06T02:17:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.442+0000 7f67fb95fb80 1 -- start start 2023-10-06T02:17:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67fb95fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0edeb3e50 0x55e0ede8ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67fb95fb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0ede942c0 0x55e0ede8f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67fb95fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede95a10 0x55e0ede8f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67fb95fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0edde9a70 con 0x55e0edeb3e50 2023-10-06T02:17:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67fb95fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0edde7270 con 0x55e0ede95a10 2023-10-06T02:17:51.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67fb95fb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0edde3060 con 0x55e0ede942c0 2023-10-06T02:17:51.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0edeb3e50 0x55e0ede8ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0edeb3e50 0x55e0ede8ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36256/0 (socket says 172.21.15.6:36256) 2023-10-06T02:17:51.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67ebfff700 1 -- 172.21.15.6:0/1344417349 learned_addr learned my addr 172.21.15.6:0/1344417349 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:51.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/1344417349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0ede942c0 0x55e0ede8f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67f0c04700 1 --2- 172.21.15.6:0/1344417349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede95a10 0x55e0ede8f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67ebfff700 1 -- 172.21.15.6:0/1344417349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0ede942c0 msgr2=0x55e0ede8f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67ebfff700 1 --2- 172.21.15.6:0/1344417349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0ede942c0 0x55e0ede8f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67ebfff700 1 -- 172.21.15.6:0/1344417349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede95a10 msgr2=0x55e0ede8f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67ebfff700 1 --2- 172.21.15.6:0/1344417349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede95a10 0x55e0ede8f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67ebfff700 1 -- 172.21.15.6:0/1344417349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0edc7d270 con 0x55e0edeb3e50 2023-10-06T02:17:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67f0c04700 1 --2- 172.21.15.6:0/1344417349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede95a10 0x55e0ede8f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67ebfff700 1 --2- 172.21.15.6:0/1344417349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0edeb3e50 0x55e0ede8ecc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00e940 tx=0x7f67dc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e6e86b7bb0ec04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67d17fa700 1 -- 172.21.15.6:0/1344417349 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc0158c0 con 0x55e0edeb3e50 2023-10-06T02:17:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67d17fa700 1 -- 172.21.15.6:0/1344417349 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67dc015a20 con 0x55e0edeb3e50 2023-10-06T02:17:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.443+0000 7f67d17fa700 1 -- 172.21.15.6:0/1344417349 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc015da0 con 0x55e0edeb3e50 2023-10-06T02:17:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.444+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1344417349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0edeb3e50 msgr2=0x55e0ede8ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:51.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.444+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/1344417349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0edeb3e50 0x55e0ede8ecc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00e940 tx=0x7f67dc015000 comp rx=0 tx=0).stop 2023-10-06T02:17:51.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.444+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1344417349 shutdown_connections 2023-10-06T02:17:51.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.444+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/1344417349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede95a10 0x55e0ede8f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.444+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/1344417349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0edeb3e50 0x55e0ede8ecc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.444+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/1344417349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0ede942c0 0x55e0ede8f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.444+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1344417349 >> 172.21.15.6:0/1344417349 conn(0x55e0ede93e80 msgr2=0x55e0ede946b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:51.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.444+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1344417349 shutdown_connections 2023-10-06T02:17:51.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.444+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1344417349 wait complete. 2023-10-06T02:17:51.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.445+0000 7f67fb95fb80 1 -- start start 2023-10-06T02:17:51.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.445+0000 7f67fb95fb80 1 Processor -- start 2023-10-06T02:17:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.445+0000 7f67fb95fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede942c0 0x55e0ededa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.445+0000 7f67fb95fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0ede95a10 0x55e0edeb1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.445+0000 7f67fb95fb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0edeb3e50 0x55e0edeb4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67fb95fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0edd8e890 con 0x55e0ede95a10 2023-10-06T02:17:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67fb95fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0edda9ea0 con 0x55e0ede942c0 2023-10-06T02:17:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67fb95fb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0edc65e30 con 0x55e0edeb3e50 2023-10-06T02:17:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67fb95fb80 10 client.0 _ll_register_callbacks cb 0x55e0ede56020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:17:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67eb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0ede95a10 0x55e0edeb1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67eb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0ede95a10 0x55e0edeb1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36262/0 (socket says 172.21.15.6:36262) 2023-10-06T02:17:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67eb7fe700 1 -- 172.21.15.6:0/1239662694 learned_addr learned my addr 172.21.15.6:0/1239662694 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67ebfff700 1 --2- 172.21.15.6:0/1239662694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede942c0 0x55e0ededa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67f0c04700 1 --2- 172.21.15.6:0/1239662694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0edeb3e50 0x55e0edeb4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67eb7fe700 1 -- 172.21.15.6:0/1239662694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0edeb3e50 msgr2=0x55e0edeb4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/1239662694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0edeb3e50 0x55e0edeb4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67eb7fe700 1 -- 172.21.15.6:0/1239662694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede942c0 msgr2=0x55e0ededa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/1239662694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede942c0 0x55e0ededa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67eb7fe700 1 -- 172.21.15.6:0/1239662694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67dc00f040 con 0x55e0ede95a10 2023-10-06T02:17:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/1239662694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0ede95a10 0x55e0edeb1410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f67e00538e0 tx=0x7f67e0027040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fe945a2b81ed5f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67ca7fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:17:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67ca7fc700 1 -- 172.21.15.6:0/1239662694 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e005a630 con 0x55e0ede95a10 2023-10-06T02:17:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67ca7fc700 1 -- 172.21.15.6:0/1239662694 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f67e005e380 con 0x55e0ede95a10 2023-10-06T02:17:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1239662694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0ede87940 con 0x55e0ede95a10 2023-10-06T02:17:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67ca7fc700 1 -- 172.21.15.6:0/1239662694 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67e0053af0 con 0x55e0ede95a10 2023-10-06T02:17:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67fb95fb80 10 client.4434 fetch_fsmap learned FSMap version 6 2023-10-06T02:17:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1239662694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55e0edc1ffe0 con 0x55e0ede95a10 2023-10-06T02:17:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67ca7fc700 1 -- 172.21.15.6:0/1239662694 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0ede87940 con 0x55e0ede95a10 2023-10-06T02:17:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.446+0000 7f67ca7fc700 1 -- 172.21.15.6:0/1239662694 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 6) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f67e0057640 con 0x55e0ede95a10 2023-10-06T02:17:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.447+0000 7f67fb95fb80 10 client.4434 fetch_fsmap finished waiting for FSMap version 6 2023-10-06T02:17:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.447+0000 7f67fb95fb80 10 client.4434 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:17:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.447+0000 7f67fb95fb80 20 client.4434 populate_metadata read hostname 'smithi006' 2023-10-06T02:17:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.447+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/1239662694 >> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] conn(0x55e0edeec640 0x55e0edeeca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.447+0000 7f67fb95fb80 4 client.4434 mds_command: new command op to 4272 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:17:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.447+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1239662694 --> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0ede64870 con 0x55e0edeec640 2023-10-06T02:17:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.447+0000 7f67ebfff700 1 --2- 172.21.15.6:0/1239662694 >> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] conn(0x55e0edeec640 0x55e0edeeca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.447+0000 7f67ca7fc700 10 client.4434 ms_handle_connect on v2:172.21.15.6:6833/839986504 2023-10-06T02:17:51.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.447+0000 7f67ebfff700 1 --2- 172.21.15.6:0/1239662694 >> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] conn(0x55e0edeec640 0x55e0edeeca10 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fed18778e0edd17 server_cookie=e73258f0181444a9 in_seq=0 out_seq=0 2023-10-06T02:17:51.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.447+0000 7f67ca7fc700 1 -- 172.21.15.6:0/1239662694 <== mds.0 v2:172.21.15.6:6833/839986504 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e0ede64870 con 0x55e0edeec640 2023-10-06T02:17:51.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.447+0000 7f67ca7fc700 10 client.4434 handle_command_reply: tid=0 2023-10-06T02:17:51.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.447+0000 7f67fb95fb80 1 client.4434 shutdown 2023-10-06T02:17:51.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.448+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1239662694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0ede95a10 msgr2=0x55e0edeb1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:51.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.448+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/1239662694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0ede95a10 0x55e0edeb1410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f67e00538e0 tx=0x7f67e0027040 comp rx=0 tx=0).stop 2023-10-06T02:17:51.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.448+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1239662694 shutdown_connections 2023-10-06T02:17:51.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.448+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/1239662694 >> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] conn(0x55e0edeec640 0x55e0edeeca10 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.448+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/1239662694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0edeb3e50 0x55e0edeb4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.448+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/1239662694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede942c0 0x55e0ededa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.448+0000 7f67ca7fc700 0 client.4434 ms_handle_reset on v2:172.21.15.6:6833/839986504 2023-10-06T02:17:51.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.448+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/1239662694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0ede95a10 0x55e0edeb1410 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.448+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1239662694 >> 172.21.15.6:0/1239662694 conn(0x55e0ede93e80 msgr2=0x55e0ede92b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:51.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.448+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1239662694 shutdown_connections 2023-10-06T02:17:51.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.448+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1239662694 wait complete. 2023-10-06T02:17:51.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.448+0000 7f67fb95fb80 20 client.4434 trim_cache size 0 max 16384 2023-10-06T02:17:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.465+0000 7f67fb95fb80 1 Processor -- start 2023-10-06T02:17:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.465+0000 7f67fb95fb80 1 -- start start 2023-10-06T02:17:51.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.465+0000 7f67fb95fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede942c0 0x55e0ede895d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.465+0000 7f67fb95fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0ede95a10 0x55e0edf39410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.465+0000 7f67fb95fb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0edeb3e50 0x55e0edf39950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.465+0000 7f67fb95fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0ede968e0 con 0x55e0ede95a10 2023-10-06T02:17:51.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.465+0000 7f67fb95fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0ede92710 con 0x55e0ede942c0 2023-10-06T02:17:51.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.465+0000 7f67fb95fb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0ede722e0 con 0x55e0edeb3e50 2023-10-06T02:17:51.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.466+0000 7f67eb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0ede95a10 0x55e0edf39410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.466+0000 7f67eb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0ede95a10 0x55e0edf39410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36266/0 (socket says 172.21.15.6:36266) 2023-10-06T02:17:51.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.466+0000 7f67eb7fe700 1 -- 172.21.15.6:0/1625601458 learned_addr learned my addr 172.21.15.6:0/1625601458 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:51.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.466+0000 7f67ebfff700 1 --2- 172.21.15.6:0/1625601458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede942c0 0x55e0ede895d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.466+0000 7f67eb7fe700 1 -- 172.21.15.6:0/1625601458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0edeb3e50 msgr2=0x55e0edf39950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:51.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.466+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/1625601458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0edeb3e50 0x55e0edf39950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.466+0000 7f67eb7fe700 1 -- 172.21.15.6:0/1625601458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede942c0 msgr2=0x55e0ede895d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:51.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.466+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/1625601458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede942c0 0x55e0ede895d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.466+0000 7f67eb7fe700 1 -- 172.21.15.6:0/1625601458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0eddb1780 con 0x55e0ede95a10 2023-10-06T02:17:51.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.466+0000 7f67ebfff700 1 --2- 172.21.15.6:0/1625601458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede942c0 0x55e0ede895d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:17:51.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.466+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/1625601458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0ede95a10 0x55e0edf39410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f67e00575a0 tx=0x7f67e0008000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfd5db03e31d8aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:51.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.466+0000 7f67d1ffb700 1 -- 172.21.15.6:0/1625601458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e005e380 con 0x55e0ede95a10 2023-10-06T02:17:51.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.466+0000 7f67d1ffb700 1 -- 172.21.15.6:0/1625601458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e005a630 con 0x55e0ede95a10 2023-10-06T02:17:51.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.466+0000 7f67d1ffb700 1 -- 172.21.15.6:0/1625601458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e0057640 con 0x55e0ede95a10 2023-10-06T02:17:51.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.467+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1625601458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0ede95a10 msgr2=0x55e0edf39410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:51.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.467+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/1625601458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0ede95a10 0x55e0edf39410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f67e00575a0 tx=0x7f67e0008000 comp rx=0 tx=0).stop 2023-10-06T02:17:51.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.467+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1625601458 shutdown_connections 2023-10-06T02:17:51.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.467+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/1625601458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0edeb3e50 0x55e0edf39950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.467+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/1625601458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede942c0 0x55e0ede895d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.467+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/1625601458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0ede95a10 0x55e0edf39410 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.467+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1625601458 >> 172.21.15.6:0/1625601458 conn(0x55e0ede93e80 msgr2=0x55e0edeb4220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.467+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1625601458 shutdown_connections 2023-10-06T02:17:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.467+0000 7f67fb95fb80 1 -- 172.21.15.6:0/1625601458 wait complete. 2023-10-06T02:17:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.467+0000 7f67fb95fb80 1 -- start start 2023-10-06T02:17:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.467+0000 7f67fb95fb80 1 Processor -- start 2023-10-06T02:17:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.468+0000 7f67fb95fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede942c0 0x55e0edf27b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.468+0000 7f67fb95fb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0ede95a10 0x55e0edec12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.468+0000 7f67fb95fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0edeb3e50 0x55e0edec1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.468+0000 7f67fb95fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0edf26080 con 0x55e0edeb3e50 2023-10-06T02:17:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.468+0000 7f67fb95fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0edeb6890 con 0x55e0ede942c0 2023-10-06T02:17:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.468+0000 7f67fb95fb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0edeb76f0 con 0x55e0ede95a10 2023-10-06T02:17:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.468+0000 7f67fb95fb80 10 client.0 _ll_register_callbacks cb 0x55e0ede56020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:17:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.468+0000 7f67f0c04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0edeb3e50 0x55e0edec1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.468+0000 7f67f0c04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0edeb3e50 0x55e0edec1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36272/0 (socket says 172.21.15.6:36272) 2023-10-06T02:17:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.468+0000 7f67f0c04700 1 -- 172.21.15.6:0/3457312497 learned_addr learned my addr 172.21.15.6:0/3457312497 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.468+0000 7f67ebfff700 1 --2- 172.21.15.6:0/3457312497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede942c0 0x55e0edf27b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.468+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/3457312497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0ede95a10 0x55e0edec12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67f0c04700 1 -- 172.21.15.6:0/3457312497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0ede95a10 msgr2=0x55e0edec12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67f0c04700 1 --2- 172.21.15.6:0/3457312497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0ede95a10 0x55e0edec12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67f0c04700 1 -- 172.21.15.6:0/3457312497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede942c0 msgr2=0x55e0edf27b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67f0c04700 1 --2- 172.21.15.6:0/3457312497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede942c0 0x55e0edf27b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67f0c04700 1 -- 172.21.15.6:0/3457312497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ec15c180 con 0x55e0edeb3e50 2023-10-06T02:17:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67f0c04700 1 --2- 172.21.15.6:0/3457312497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0edeb3e50 0x55e0edec1800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f67e4010e10 tx=0x7f67e4007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e92706225d7f985 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67ca7fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:17:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67ca7fc700 1 -- 172.21.15.6:0/3457312497 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e4015070 con 0x55e0edeb3e50 2023-10-06T02:17:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67ca7fc700 1 -- 172.21.15.6:0/3457312497 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f67e400eb40 con 0x55e0edeb3e50 2023-10-06T02:17:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67fb95fb80 1 -- 172.21.15.6:0/3457312497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f67dc015a20 con 0x55e0edeb3e50 2023-10-06T02:17:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67ca7fc700 1 -- 172.21.15.6:0/3457312497 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67e4007e80 con 0x55e0edeb3e50 2023-10-06T02:17:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67fb95fb80 10 client.4440 fetch_fsmap learned FSMap version 6 2023-10-06T02:17:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67fb95fb80 1 -- 172.21.15.6:0/3457312497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55e0edd98470 con 0x55e0edeb3e50 2023-10-06T02:17:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67ca7fc700 1 -- 172.21.15.6:0/3457312497 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67dc015a20 con 0x55e0edeb3e50 2023-10-06T02:17:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67ca7fc700 1 -- 172.21.15.6:0/3457312497 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 6) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f67e401f250 con 0x55e0edeb3e50 2023-10-06T02:17:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67fb95fb80 10 client.4440 fetch_fsmap finished waiting for FSMap version 6 2023-10-06T02:17:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67fb95fb80 10 client.4440 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:17:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67fb95fb80 20 client.4440 populate_metadata read hostname 'smithi006' 2023-10-06T02:17:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/3457312497 >> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] conn(0x55e0edf251b0 0x55e0edf25580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67fb95fb80 4 client.4440 mds_command: new command op to 4272 tid=0[{"prefix": "status"}] 2023-10-06T02:17:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.469+0000 7f67fb95fb80 1 -- 172.21.15.6:0/3457312497 --> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e0edd85e00 con 0x55e0edf251b0 2023-10-06T02:17:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67ebfff700 1 --2- 172.21.15.6:0/3457312497 >> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] conn(0x55e0edf251b0 0x55e0edf25580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67ca7fc700 10 client.4440 ms_handle_connect on v2:172.21.15.6:6833/839986504 2023-10-06T02:17:51.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67ebfff700 1 --2- 172.21.15.6:0/3457312497 >> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] conn(0x55e0edf251b0 0x55e0edf25580 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3791712a7cf43215 server_cookie=a3a25efce38d5f86 in_seq=0 out_seq=0 2023-10-06T02:17:51.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67ca7fc700 1 -- 172.21.15.6:0/3457312497 <== mds.0 v2:172.21.15.6:6833/839986504 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55e0edd85e00 con 0x55e0edf251b0 2023-10-06T02:17:51.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67ca7fc700 10 client.4440 handle_command_reply: tid=0 2023-10-06T02:17:51.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67fb95fb80 1 client.4440 shutdown 2023-10-06T02:17:51.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67fb95fb80 1 -- 172.21.15.6:0/3457312497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0edeb3e50 msgr2=0x55e0edec1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:51.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/3457312497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0edeb3e50 0x55e0edec1800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f67e4010e10 tx=0x7f67e4007ad0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67fb95fb80 1 -- 172.21.15.6:0/3457312497 shutdown_connections 2023-10-06T02:17:51.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/3457312497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0edeb3e50 0x55e0edec1800 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/3457312497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0ede942c0 0x55e0edf27b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/3457312497 >> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] conn(0x55e0edf251b0 0x55e0edf25580 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67fb95fb80 1 --2- 172.21.15.6:0/3457312497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0ede95a10 0x55e0edec12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67ca7fc700 0 client.4440 ms_handle_reset on v2:172.21.15.6:6833/839986504 2023-10-06T02:17:51.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67fb95fb80 1 -- 172.21.15.6:0/3457312497 >> 172.21.15.6:0/3457312497 conn(0x55e0ede93e80 msgr2=0x55e0edeb1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:51.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67fb95fb80 1 -- 172.21.15.6:0/3457312497 shutdown_connections 2023-10-06T02:17:51.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67fb95fb80 1 -- 172.21.15.6:0/3457312497 wait complete. 2023-10-06T02:17:51.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.470+0000 7f67fb95fb80 20 client.4440 trim_cache size 0 max 16384 2023-10-06T02:17:51.478 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:17:51.478 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:17:51.478 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:17:51.478 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4272, 2023-10-06T02:17:51.479 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:17:51.479 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:17:51.479 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:17:51.479 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 7.4774543329999998, 2023-10-06T02:17:51.479 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 6, 2023-10-06T02:17:51.479 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 25, 2023-10-06T02:17:51.479 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 25, 2023-10-06T02:17:51.479 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 13.432689493 2023-10-06T02:17:51.479 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:17:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.471+0000 7f67f1405700 1 -- 172.21.15.6:0/2378874074 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f67d8066f30 msgr2=0x7f67d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.471+0000 7f67f1405700 1 --2- 172.21.15.6:0/2378874074 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f67d8066f30 0x7f67d80693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67ec158d20 tx=0x7f67dc009040 comp rx=0 tx=0).stop 2023-10-06T02:17:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.471+0000 7f67f1405700 1 -- 172.21.15.6:0/2378874074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec159400 msgr2=0x7f67ec0b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.471+0000 7f67f1405700 1 --2- 172.21.15.6:0/2378874074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec159400 0x7f67ec0b39f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0b2b80 tx=0x7f67e0016000 comp rx=0 tx=0).stop 2023-10-06T02:17:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.471+0000 7f67f1405700 1 -- 172.21.15.6:0/2378874074 shutdown_connections 2023-10-06T02:17:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.471+0000 7f67f1405700 1 --2- 172.21.15.6:0/2378874074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67ec1597d0 0x7f67ec0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.471+0000 7f67f1405700 1 --2- 172.21.15.6:0/2378874074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67ec0cf1a0 0x7f67ec16a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.471+0000 7f67f1405700 1 --2- 172.21.15.6:0/2378874074 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f67d8066f30 0x7f67d80693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.471+0000 7f67f1405700 1 --2- 172.21.15.6:0/2378874074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec159400 0x7f67ec0b39f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.471+0000 7f67f1405700 1 -- 172.21.15.6:0/2378874074 >> 172.21.15.6:0/2378874074 conn(0x7f67ec06ac10 msgr2=0x7f67ec156820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:51.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.471+0000 7f67f1405700 1 -- 172.21.15.6:0/2378874074 shutdown_connections 2023-10-06T02:17:51.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.471+0000 7f67f1405700 1 -- 172.21.15.6:0/2378874074 wait complete. 2023-10-06T02:17:51.483 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:17:51.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.601+0000 7f5242791700 1 Processor -- start 2023-10-06T02:17:51.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.601+0000 7f5242791700 1 -- start start 2023-10-06T02:17:51.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.602+0000 7f5242791700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f523c0cf1a0 0x7f523c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.602+0000 7f5242791700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f523c1597d0 0x7f523c0d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.602+0000 7f5242791700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523c0b3560 con 0x7f523c159400 2023-10-06T02:17:51.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.602+0000 7f5242791700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c0cf6f0 con 0x7f523c0cf1a0 2023-10-06T02:17:51.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.602+0000 7f5242791700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c0cf9d0 con 0x7f523c1597d0 2023-10-06T02:17:51.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.602+0000 7f524178f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f523c159400 0x7f523c0ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41932/0 (socket says 172.21.15.6:41932) 2023-10-06T02:17:51.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.602+0000 7f524178f700 1 -- 172.21.15.6:0/430863297 learned_addr learned my addr 172.21.15.6:0/430863297 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:51.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.602+0000 7f5240f8e700 1 --2- 172.21.15.6:0/430863297 >> v2:172.21.15.175:3300/0 conn(0x7f523c0cf1a0 0x7f523c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.602+0000 7f5241f90700 1 --2- 172.21.15.6:0/430863297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f523c1597d0 0x7f523c0d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.602+0000 7f523bfff700 1 -- 172.21.15.6:0/430863297 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543958471 0 0) 0x7f523c0b3560 con 0x7f523c159400 2023-10-06T02:17:51.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.602+0000 7f523bfff700 1 -- 172.21.15.6:0/430863297 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5224003570 con 0x7f523c159400 2023-10-06T02:17:51.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.603+0000 7f5240f8e700 1 -- 172.21.15.6:0/430863297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f523c1597d0 msgr2=0x7f523c0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:51.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.603+0000 7f5240f8e700 1 --2- 172.21.15.6:0/430863297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f523c1597d0 0x7f523c0d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.603+0000 7f5240f8e700 1 -- 172.21.15.6:0/430863297 >> v1:172.21.15.6:6789/0 conn(0x7f523c159400 legacy=0x7f523c0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:51.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.603+0000 7f5240f8e700 1 -- 172.21.15.6:0/430863297 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c0b2f10 con 0x7f523c0cf1a0 2023-10-06T02:17:51.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.603+0000 7f5240f8e700 1 --2- 172.21.15.6:0/430863297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f523c0cf1a0 0x7f523c0cfec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f52300098e0 tx=0x7f52300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed00b3155ddb89f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:51.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.603+0000 7f523bfff700 1 -- 172.21.15.6:0/430863297 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230011630 con 0x7f523c0cf1a0 2023-10-06T02:17:51.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.603+0000 7f523bfff700 1 -- 172.21.15.6:0/430863297 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5230011790 con 0x7f523c0cf1a0 2023-10-06T02:17:51.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.603+0000 7f523bfff700 1 -- 172.21.15.6:0/430863297 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230011b30 con 0x7f523c0cf1a0 2023-10-06T02:17:51.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.603+0000 7f5242791700 1 -- 172.21.15.6:0/430863297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f523c0cf1a0 msgr2=0x7f523c0cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:51.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.603+0000 7f5242791700 1 --2- 172.21.15.6:0/430863297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f523c0cf1a0 0x7f523c0cfec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f52300098e0 tx=0x7f52300091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.604+0000 7f5242791700 1 -- 172.21.15.6:0/430863297 shutdown_connections 2023-10-06T02:17:51.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.604+0000 7f5242791700 1 --2- 172.21.15.6:0/430863297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f523c1597d0 0x7f523c0d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.604+0000 7f5242791700 1 --2- 172.21.15.6:0/430863297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f523c0cf1a0 0x7f523c0cfec0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.604+0000 7f5242791700 1 -- 172.21.15.6:0/430863297 >> 172.21.15.6:0/430863297 conn(0x7f523c06ac10 msgr2=0x7f523c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:51.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.604+0000 7f5242791700 1 -- 172.21.15.6:0/430863297 shutdown_connections 2023-10-06T02:17:51.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.604+0000 7f5242791700 1 -- 172.21.15.6:0/430863297 wait complete. 2023-10-06T02:17:51.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.605+0000 7f5242791700 1 Processor -- start 2023-10-06T02:17:51.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.605+0000 7f5242791700 1 -- start start 2023-10-06T02:17:51.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f5242791700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f523c0cf1a0 0x7f523c169b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f5242791700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f523c159400 0x7f523c16a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f5242791700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f523c1597d0 0x7f523c15cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f5242791700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c15e2e0 con 0x7f523c159400 2023-10-06T02:17:51.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f5242791700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c15d450 con 0x7f523c1597d0 2023-10-06T02:17:51.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f5242791700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c15d6d0 con 0x7f523c0cf1a0 2023-10-06T02:17:51.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f5240f8e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f523c159400 0x7f523c16a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f5240f8e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f523c159400 0x7f523c16a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36282/0 (socket says 172.21.15.6:36282) 2023-10-06T02:17:51.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f5240f8e700 1 -- 172.21.15.6:0/1231952709 learned_addr learned my addr 172.21.15.6:0/1231952709 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:51.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f524178f700 1 --2- 172.21.15.6:0/1231952709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f523c0cf1a0 0x7f523c169b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f5241f90700 1 --2- 172.21.15.6:0/1231952709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f523c1597d0 0x7f523c15cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f5240f8e700 1 -- 172.21.15.6:0/1231952709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f523c0cf1a0 msgr2=0x7f523c169b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:51.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f5240f8e700 1 --2- 172.21.15.6:0/1231952709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f523c0cf1a0 0x7f523c169b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f5240f8e700 1 -- 172.21.15.6:0/1231952709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f523c1597d0 msgr2=0x7f523c15cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:51.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f5240f8e700 1 --2- 172.21.15.6:0/1231952709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f523c1597d0 0x7f523c15cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f5240f8e700 1 -- 172.21.15.6:0/1231952709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5230009420 con 0x7f523c159400 2023-10-06T02:17:51.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f5240f8e700 1 --2- 172.21.15.6:0/1231952709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f523c159400 0x7f523c16a6f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5230009ed0 tx=0x7f5230017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:51.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f52397fa700 1 -- 172.21.15.6:0/1231952709 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230011b10 con 0x7f523c159400 2023-10-06T02:17:51.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f52397fa700 1 -- 172.21.15.6:0/1231952709 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52300253f0 con 0x7f523c159400 2023-10-06T02:17:51.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.606+0000 7f5242791700 1 -- 172.21.15.6:0/1231952709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523c15d9b0 con 0x7f523c159400 2023-10-06T02:17:51.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.607+0000 7f52397fa700 1 -- 172.21.15.6:0/1231952709 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52300257b0 con 0x7f523c159400 2023-10-06T02:17:51.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.607+0000 7f5242791700 1 -- 172.21.15.6:0/1231952709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523c15df70 con 0x7f523c159400 2023-10-06T02:17:51.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.607+0000 7f5242791700 1 -- 172.21.15.6:0/1231952709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523c15e450 con 0x7f523c159400 2023-10-06T02:17:51.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.608+0000 7f52397fa700 1 -- 172.21.15.6:0/1231952709 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5230025ba0 con 0x7f523c159400 2023-10-06T02:17:51.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.608+0000 7f52397fa700 1 --2- 172.21.15.6:0/1231952709 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5228066f30 0x7f52280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:51.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.608+0000 7f52397fa700 1 -- 172.21.15.6:0/1231952709 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f52300862c0 con 0x7f523c159400 2023-10-06T02:17:51.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.609+0000 7f524178f700 1 --2- 172.21.15.6:0/1231952709 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5228066f30 0x7f52280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:51.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.609+0000 7f524178f700 1 --2- 172.21.15.6:0/1231952709 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5228066f30 0x7f52280693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5234007fd0 tx=0x7f5234009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:51.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.613+0000 7f52397fa700 1 -- 172.21.15.6:0/1231952709 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52300530e0 con 0x7f523c159400 2023-10-06T02:17:51.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.853+0000 7f5242791700 1 -- 172.21.15.6:0/1231952709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f523c0ccaf0 con 0x7f523c159400 2023-10-06T02:17:51.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.853+0000 7f52397fa700 1 -- 172.21.15.6:0/1231952709 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5230056700 con 0x7f523c159400 2023-10-06T02:17:51.854 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T02:17:51.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.855+0000 7f5242791700 1 -- 172.21.15.6:0/1231952709 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5228066f30 msgr2=0x7f52280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:51.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.855+0000 7f5242791700 1 --2- 172.21.15.6:0/1231952709 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5228066f30 0x7f52280693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5234007fd0 tx=0x7f5234009040 comp rx=0 tx=0).stop 2023-10-06T02:17:51.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.855+0000 7f5242791700 1 -- 172.21.15.6:0/1231952709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f523c159400 msgr2=0x7f523c16a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:51.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.855+0000 7f5242791700 1 --2- 172.21.15.6:0/1231952709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f523c159400 0x7f523c16a6f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5230009ed0 tx=0x7f5230017000 comp rx=0 tx=0).stop 2023-10-06T02:17:51.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.855+0000 7f5242791700 1 -- 172.21.15.6:0/1231952709 shutdown_connections 2023-10-06T02:17:51.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.855+0000 7f5242791700 1 --2- 172.21.15.6:0/1231952709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f523c1597d0 0x7f523c15cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.855+0000 7f5242791700 1 --2- 172.21.15.6:0/1231952709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f523c0cf1a0 0x7f523c169b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.855+0000 7f5242791700 1 --2- 172.21.15.6:0/1231952709 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5228066f30 0x7f52280693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.855+0000 7f5242791700 1 --2- 172.21.15.6:0/1231952709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f523c159400 0x7f523c16a6f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:51.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.855+0000 7f5242791700 1 -- 172.21.15.6:0/1231952709 >> 172.21.15.6:0/1231952709 conn(0x7f523c06ac10 msgr2=0x7f523c0b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:51.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.855+0000 7f5242791700 1 -- 172.21.15.6:0/1231952709 shutdown_connections 2023-10-06T02:17:51.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:51.856+0000 7f5242791700 1 -- 172.21.15.6:0/1231952709 wait complete. 2023-10-06T02:17:51.868 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:17:51.868 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:17:51.868 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:17:51.868 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-06T02:17:51.868 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-06T02:17:51.868 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:17:51.868 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:17:51.868 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:17:51.868 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T02:17:51.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:17:51.869 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:17:51.884 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:17:51.884 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:17:51.884 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:17:51.884 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:17:51.884 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:17:51.884 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:17:51.884 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:17:51.885 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:17:51.885 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:17:51.885 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:17:51.885 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:17:51.885 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:17:51.885 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:17:51.885 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:17:51.885 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:17:51.885 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:17:51.885 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42474sec preferred_lft 42474sec 2023-10-06T02:17:51.885 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:17:51.885 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:17:51.885 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:17:51.886 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:17:51.886 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:17:51.886 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T02:17:51.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:17:51.886 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:17:51.887 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:17:51.887 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2023-10-06T02:17:51.887 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2023-10-06T02:17:51.887 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2023-10-06T02:17:51.887 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T02:17:51.887 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:17:52.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:17:52.058 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:17:52.103 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:17:52.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:17:52.104 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:17:52.150 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:17:52.150 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:17:52.150 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:17:52.150 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:17:52.150 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:17:52.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:17:52.151 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:17:52.151 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:17:52.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:17:52.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:17:52.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:17:52.151 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:17:52.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:17:52.364 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:17:52.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:17:52.380 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2023-10-06T02:17:52.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:17:52.435 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:17:52.435 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:17:52.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T02:17:52.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-06T02:17:52.436 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:17:52.526 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-06T02:17:52.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:17:52.527 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:17:52.527 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:17:52.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-06T02:17:52.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T02:17:52.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-06T02:17:52.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-06T02:17:52.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-06T02:17:52.527 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:17:52.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:17:52.738 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:17:52.738 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:17:52.738 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:17:52.738 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T02:17:52.738 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:17:52.831 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-06T02:17:52.832 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:17:52.832 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-06T02:17:52.847 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T02:17:52.847 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:17:52.847 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-06T02:17:52.901 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:17:52.967 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:17:52.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:17:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:17:53.034 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:17:53.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:17:53.034 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:17:53.090 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:17:53.090 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-06T02:17:53.132 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:17:53.157 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:17:53.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:17:53.221 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:17:53.222 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:17:53.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:17:53.223 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:17:53.227 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:2023-10-06T02:17:53.226+0000 7fcf4aca8540 -1 init, newargv = 0x564df1e70150 newargc=15 2023-10-06T02:17:53.228 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[98769]: starting ceph client 2023-10-06T02:17:53.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[98769]: starting fuse 2023-10-06T02:17:53.243 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:17:53.243 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:17:53.243 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:17:53.244 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:17:53.244 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:17:53.244 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:17:53.244 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:17:53.244 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:17:53.244 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:17:53.244 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-06T02:17:53.244 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:17:53.244 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-06T02:17:53.245 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:17:53.245 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:17:53.245 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:17:53.245 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:17:53.245 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:17:53.245 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:17:53.245 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:17:53.245 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:17:53.245 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:17:53.245 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:17:53.245 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:17:53.245 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:17:53.245 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:17:53.245 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:17:53.246 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:17:53.246 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.admin")) 2023-10-06T02:17:53.246 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:17:53.365 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.admin.98769.asok 2023-10-06T02:17:53.547 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.98769.asok 2023-10-06T02:17:53.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:17:53.548 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.98769.asok status 2023-10-06T02:17:53.703 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:17:53.703 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:17:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:17:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:17:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "admin", 2023-10-06T02:17:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:17:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-06T02:17:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "98769", 2023-10-06T02:17:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:17:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:17:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:17:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:17:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4455, 2023-10-06T02:17:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:17:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:17:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:17:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 4455 2023-10-06T02:17:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:17:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:17:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:17:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:17:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 523042328 2023-10-06T02:17:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:17:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:17:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:17:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:17:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:17:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 523042328 2023-10-06T02:17:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:17:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.4455 192.168.0.1:0/523042328", 2023-10-06T02:17:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/523042328", 2023-10-06T02:17:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:17:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 6, 2023-10-06T02:17:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 25, 2023-10-06T02:17:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:17:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:17:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:17:53.707 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:17:53.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:17:53.713 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:17:53.713 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-06T02:17:53.729 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:17:53.729 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-06T02:17:53.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:17:53.729 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-06T02:17:53.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:17:53.795 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-06T02:17:53.900 INFO:teuthology.orchestra.run.smithi006.stdout:# file: . 2023-10-06T02:17:53.900 INFO:teuthology.orchestra.run.smithi006.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-06T02:17:53.900 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:53.901 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:17:53.901 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:17:53.901 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-06T02:17:53.936 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[98769]: fuse finished with error 0 and tester_r 0 2023-10-06T02:17:53.937 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:17:54.019 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:17:54.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:17:54.019 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-06T02:17:54.034 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:17:54.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.193+0000 7f07a2d17700 1 Processor -- start 2023-10-06T02:17:54.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.193+0000 7f07a2d17700 1 -- start start 2023-10-06T02:17:54.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.194+0000 7f07a2d17700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f079c0cfe90 0x7f079c0d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.194+0000 7f07a2d17700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f079c15abe0 0x7f079c15afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.194+0000 7f07a2d17700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079c0ceea0 con 0x7f079c153a10 2023-10-06T02:17:54.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.194+0000 7f07a2d17700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c069140 con 0x7f079c15abe0 2023-10-06T02:17:54.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.194+0000 7f07a2d17700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c0d0850 con 0x7f079c0cfe90 2023-10-06T02:17:54.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.194+0000 7f07a2516700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f079c15abe0 0x7f079c15afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.194+0000 7f07a2516700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f079c15abe0 0x7f079c15afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36294/0 (socket says 172.21.15.6:36294) 2023-10-06T02:17:54.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.194+0000 7f07a2516700 1 -- 172.21.15.6:0/241833652 learned_addr learned my addr 172.21.15.6:0/241833652 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:54.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.194+0000 7f07a1514700 1 --2- 172.21.15.6:0/241833652 >> v2:172.21.15.175:3300/0 conn(0x7f079c0cfe90 0x7f079c0d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.194+0000 7f07a2516700 1 -- 172.21.15.6:0/241833652 >> v2:172.21.15.175:3300/0 conn(0x7f079c0cfe90 msgr2=0x7f079c0d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:54.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.194+0000 7f07a2516700 1 --2- 172.21.15.6:0/241833652 >> v2:172.21.15.175:3300/0 conn(0x7f079c0cfe90 0x7f079c0d0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.194+0000 7f07a2516700 1 -- 172.21.15.6:0/241833652 >> v1:172.21.15.175:6789/0 conn(0x7f079c153a10 legacy=0x7f079c0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:54.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.194+0000 7f07a2516700 1 -- 172.21.15.6:0/241833652 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c15a690 con 0x7f079c15abe0 2023-10-06T02:17:54.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.195+0000 7f07a2516700 1 --2- 172.21.15.6:0/241833652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f079c15abe0 0x7f079c15afe0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f079c0b2b80 tx=0x7f078c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae782685ea8e19c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:54.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.195+0000 7f07a0d13700 1 -- 172.21.15.6:0/241833652 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c00e070 con 0x7f079c15abe0 2023-10-06T02:17:54.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.195+0000 7f07a0d13700 1 -- 172.21.15.6:0/241833652 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c00ba10 con 0x7f079c15abe0 2023-10-06T02:17:54.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.195+0000 7f07a0d13700 1 -- 172.21.15.6:0/241833652 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c0092e0 con 0x7f079c15abe0 2023-10-06T02:17:54.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.195+0000 7f07a2d17700 1 -- 172.21.15.6:0/241833652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f079c15abe0 msgr2=0x7f079c15afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:54.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.195+0000 7f07a2d17700 1 --2- 172.21.15.6:0/241833652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f079c15abe0 0x7f079c15afe0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f079c0b2b80 tx=0x7f078c009840 comp rx=0 tx=0).stop 2023-10-06T02:17:54.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.195+0000 7f07a2d17700 1 -- 172.21.15.6:0/241833652 shutdown_connections 2023-10-06T02:17:54.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.195+0000 7f07a2d17700 1 --2- 172.21.15.6:0/241833652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f079c15abe0 0x7f079c15afe0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.195+0000 7f07a2d17700 1 --2- 172.21.15.6:0/241833652 >> v2:172.21.15.175:3300/0 conn(0x7f079c0cfe90 0x7f079c0d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.195+0000 7f07a2d17700 1 -- 172.21.15.6:0/241833652 >> 172.21.15.6:0/241833652 conn(0x7f079c06ac00 msgr2=0x7f079c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:54.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.195+0000 7f07a2d17700 1 -- 172.21.15.6:0/241833652 shutdown_connections 2023-10-06T02:17:54.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.195+0000 7f07a2d17700 1 -- 172.21.15.6:0/241833652 wait complete. 2023-10-06T02:17:54.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.196+0000 7f07a2d17700 1 Processor -- start 2023-10-06T02:17:54.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.197+0000 7f07a2d17700 1 -- start start 2023-10-06T02:17:54.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.197+0000 7f07a2d17700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f079c0cfe90 0x7f079c169970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.197+0000 7f07a2d17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f079c153a10 0x7f079c16c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.197+0000 7f07a2d17700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f079c15abe0 0x7f079c159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.197+0000 7f07a2d17700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c169eb0 con 0x7f079c153a10 2023-10-06T02:17:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.197+0000 7f07a2d17700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c154db0 con 0x7f079c0cfe90 2023-10-06T02:17:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.197+0000 7f07a2d17700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c155650 con 0x7f079c15abe0 2023-10-06T02:17:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.197+0000 7f07a1514700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f079c153a10 0x7f079c16c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.197+0000 7f07a1514700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f079c153a10 0x7f079c16c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36300/0 (socket says 172.21.15.6:36300) 2023-10-06T02:17:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.197+0000 7f07a1514700 1 -- 172.21.15.6:0/1533716413 learned_addr learned my addr 172.21.15.6:0/1533716413 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.197+0000 7f07a2516700 1 --2- 172.21.15.6:0/1533716413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f079c15abe0 0x7f079c159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.197+0000 7f07a1d15700 1 --2- 172.21.15.6:0/1533716413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f079c0cfe90 0x7f079c169970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.198+0000 7f07a1514700 1 -- 172.21.15.6:0/1533716413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f079c15abe0 msgr2=0x7f079c159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.198+0000 7f07a1514700 1 --2- 172.21.15.6:0/1533716413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f079c15abe0 0x7f079c159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.198+0000 7f07a1514700 1 -- 172.21.15.6:0/1533716413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f079c0cfe90 msgr2=0x7f079c169970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.198+0000 7f07a1514700 1 --2- 172.21.15.6:0/1533716413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f079c0cfe90 0x7f079c169970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.198+0000 7f07a1514700 1 -- 172.21.15.6:0/1533716413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c009ae0 con 0x7f079c153a10 2023-10-06T02:17:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.198+0000 7f07a1d15700 1 --2- 172.21.15.6:0/1533716413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f079c0cfe90 0x7f079c169970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.198+0000 7f07a1514700 1 --2- 172.21.15.6:0/1533716413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f079c153a10 0x7f079c16c660 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f079000d890 tx=0x7f0790008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.198+0000 7f0799ffb700 1 -- 172.21.15.6:0/1533716413 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07900125f0 con 0x7f079c153a10 2023-10-06T02:17:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.198+0000 7f0799ffb700 1 -- 172.21.15.6:0/1533716413 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0790012770 con 0x7f079c153a10 2023-10-06T02:17:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.198+0000 7f07a2d17700 1 -- 172.21.15.6:0/1533716413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079c1577b0 con 0x7f079c153a10 2023-10-06T02:17:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.198+0000 7f0799ffb700 1 -- 172.21.15.6:0/1533716413 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790012b30 con 0x7f079c153a10 2023-10-06T02:17:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.198+0000 7f07a2d17700 1 -- 172.21.15.6:0/1533716413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079c1552e0 con 0x7f079c153a10 2023-10-06T02:17:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.199+0000 7f07a2d17700 1 -- 172.21.15.6:0/1533716413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079c155790 con 0x7f079c153a10 2023-10-06T02:17:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.199+0000 7f0799ffb700 1 -- 172.21.15.6:0/1533716413 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f079001e460 con 0x7f079c153a10 2023-10-06T02:17:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.200+0000 7f0799ffb700 1 --2- 172.21.15.6:0/1533716413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0788066f30 0x7f07880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.200+0000 7f0799ffb700 1 -- 172.21.15.6:0/1533716413 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0790085030 con 0x7f079c153a10 2023-10-06T02:17:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.200+0000 7f07a1d15700 1 --2- 172.21.15.6:0/1533716413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0788066f30 0x7f07880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.200+0000 7f07a1d15700 1 --2- 172.21.15.6:0/1533716413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0788066f30 0x7f07880693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0794007fd0 tx=0x7f0794009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:54.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.204+0000 7f0799ffb700 1 -- 172.21.15.6:0/1533716413 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0790051e50 con 0x7f079c153a10 2023-10-06T02:17:54.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.401+0000 7f07a2d17700 1 -- 172.21.15.6:0/1533716413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f079c0ce850 con 0x7f079c153a10 2023-10-06T02:17:54.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.402+0000 7f0799ffb700 1 -- 172.21.15.6:0/1533716413 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f0790055470 con 0x7f079c153a10 2023-10-06T02:17:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:54.403 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:48.453046+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:17:54.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.404+0000 7f07a2d17700 1 -- 172.21.15.6:0/1533716413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0788066f30 msgr2=0x7f07880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:54.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.404+0000 7f07a2d17700 1 --2- 172.21.15.6:0/1533716413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0788066f30 0x7f07880693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0794007fd0 tx=0x7f0794009040 comp rx=0 tx=0).stop 2023-10-06T02:17:54.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.404+0000 7f07a2d17700 1 -- 172.21.15.6:0/1533716413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f079c153a10 msgr2=0x7f079c16c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:54.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.404+0000 7f07a2d17700 1 --2- 172.21.15.6:0/1533716413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f079c153a10 0x7f079c16c660 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f079000d890 tx=0x7f0790008040 comp rx=0 tx=0).stop 2023-10-06T02:17:54.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.404+0000 7f07a2d17700 1 -- 172.21.15.6:0/1533716413 shutdown_connections 2023-10-06T02:17:54.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.404+0000 7f07a2d17700 1 --2- 172.21.15.6:0/1533716413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f079c15abe0 0x7f079c159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.404+0000 7f07a2d17700 1 --2- 172.21.15.6:0/1533716413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f079c0cfe90 0x7f079c169970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.404+0000 7f07a2d17700 1 --2- 172.21.15.6:0/1533716413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0788066f30 0x7f07880693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.404+0000 7f07a2d17700 1 --2- 172.21.15.6:0/1533716413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f079c153a10 0x7f079c16c660 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.404+0000 7f07a2d17700 1 -- 172.21.15.6:0/1533716413 >> 172.21.15.6:0/1533716413 conn(0x7f079c06ac00 msgr2=0x7f079c15c370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:54.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.404+0000 7f07a2d17700 1 -- 172.21.15.6:0/1533716413 shutdown_connections 2023-10-06T02:17:54.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.404+0000 7f07a2d17700 1 -- 172.21.15.6:0/1533716413 wait complete. 2023-10-06T02:17:54.417 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:17:54.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.536+0000 7f24c2ba8700 1 Processor -- start 2023-10-06T02:17:54.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.536+0000 7f24c2ba8700 1 -- start start 2023-10-06T02:17:54.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.536+0000 7f24c2ba8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24bc0b27f0 0x7f24bc15db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.536+0000 7f24c2ba8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24bc15e190 con 0x7f24bc0af4e0 2023-10-06T02:17:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.536+0000 7f24c2ba8700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24bc0cb650 con 0x7f24bc0af8b0 2023-10-06T02:17:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.536+0000 7f24c2ba8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc0b1910 con 0x7f24bc0b27f0 2023-10-06T02:17:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.536+0000 7f24c0944700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f24bc0af4e0 0x7f24bc0b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41948/0 (socket says 172.21.15.6:41948) 2023-10-06T02:17:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24c0944700 1 -- 172.21.15.6:0/598989712 learned_addr learned my addr 172.21.15.6:0/598989712 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24c1145700 1 --2- 172.21.15.6:0/598989712 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24bc0b27f0 0x7f24bc15db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24bb7fe700 1 -- 172.21.15.6:0/598989712 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396913874 0 0) 0x7f24bc15e190 con 0x7f24bc0af4e0 2023-10-06T02:17:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24bb7fe700 1 -- 172.21.15.6:0/598989712 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a8003570 con 0x7f24bc0af4e0 2023-10-06T02:17:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24bb7fe700 1 -- 172.21.15.6:0/598989712 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2731648344 0 0) 0x7f24a8003570 con 0x7f24bc0af4e0 2023-10-06T02:17:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24bb7fe700 1 -- 172.21.15.6:0/598989712 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24bc0b27f0 msgr2=0x7f24bc15db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24bb7fe700 1 --2- 172.21.15.6:0/598989712 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24bc0b27f0 0x7f24bc15db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24bb7fe700 1 -- 172.21.15.6:0/598989712 >> v1:172.21.15.175:6789/0 conn(0x7f24bc0af8b0 legacy=0x7f24bc15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24bb7fe700 1 -- 172.21.15.6:0/598989712 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc0ccaf0 con 0x7f24bc0af4e0 2023-10-06T02:17:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24bb7fe700 1 -- 172.21.15.6:0/598989712 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f24b40017f0 con 0x7f24bc0af4e0 2023-10-06T02:17:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24bb7fe700 1 -- 172.21.15.6:0/598989712 >> v1:172.21.15.6:6789/0 conn(0x7f24bc0af4e0 legacy=0x7f24bc0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24bb7fe700 1 --2- 172.21.15.6:0/598989712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24a8003a90 0x7f24a8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24bb7fe700 1 --2- 172.21.15.6:0/598989712 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24bc0b27f0 0x7f24a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24bb7fe700 1 --2- 172.21.15.6:0/598989712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24a8004d50 0x7f24a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24bb7fe700 1 -- 172.21.15.6:0/598989712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc0b1910 con 0x7f24a8003a90 2023-10-06T02:17:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24bb7fe700 1 -- 172.21.15.6:0/598989712 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a800bb10 con 0x7f24a8004d50 2023-10-06T02:17:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24bb7fe700 1 -- 172.21.15.6:0/598989712 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a800bcd0 con 0x7f24bc0b27f0 2023-10-06T02:17:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24c0944700 1 --2- 172.21.15.6:0/598989712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24a8003a90 0x7f24a8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24bbfff700 1 --2- 172.21.15.6:0/598989712 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24bc0b27f0 0x7f24a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.537+0000 7f24c1145700 1 --2- 172.21.15.6:0/598989712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24a8004d50 0x7f24a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.538+0000 7f24c0944700 1 -- 172.21.15.6:0/598989712 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24bc0b27f0 msgr2=0x7f24a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.538+0000 7f24c0944700 1 --2- 172.21.15.6:0/598989712 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24bc0b27f0 0x7f24a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.538+0000 7f24c0944700 1 -- 172.21.15.6:0/598989712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24a8004d50 msgr2=0x7f24a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.538+0000 7f24c0944700 1 --2- 172.21.15.6:0/598989712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24a8004d50 0x7f24a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.538+0000 7f24c0944700 1 -- 172.21.15.6:0/598989712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a8003570 con 0x7f24a8003a90 2023-10-06T02:17:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.538+0000 7f24c1145700 1 --2- 172.21.15.6:0/598989712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24a8004d50 0x7f24a80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.538+0000 7f24c0944700 1 --2- 172.21.15.6:0/598989712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24a8003a90 0x7f24a8003e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f24b400a940 tx=0x7f24bc0cb5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c94a7c0f4da2d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.538+0000 7f24bb7fe700 1 -- 172.21.15.6:0/598989712 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b40070d0 con 0x7f24a8003a90 2023-10-06T02:17:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.538+0000 7f24bb7fe700 1 -- 172.21.15.6:0/598989712 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b4007250 con 0x7f24a8003a90 2023-10-06T02:17:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.538+0000 7f24bb7fe700 1 -- 172.21.15.6:0/598989712 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b4007610 con 0x7f24a8003a90 2023-10-06T02:17:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.538+0000 7f24c2ba8700 1 -- 172.21.15.6:0/598989712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24a8003a90 msgr2=0x7f24a8003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.538+0000 7f24c2ba8700 1 --2- 172.21.15.6:0/598989712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24a8003a90 0x7f24a8003e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f24b400a940 tx=0x7f24bc0cb5c0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.538+0000 7f24c1145700 1 -- 172.21.15.6:0/598989712 reap_dead start 2023-10-06T02:17:54.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.538+0000 7f24c2ba8700 1 -- 172.21.15.6:0/598989712 shutdown_connections 2023-10-06T02:17:54.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.538+0000 7f24c2ba8700 1 -- 172.21.15.6:0/598989712 >> 172.21.15.6:0/598989712 conn(0x7f24bc068680 msgr2=0x7f24bc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:54.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.538+0000 7f24c2ba8700 1 -- 172.21.15.6:0/598989712 shutdown_connections 2023-10-06T02:17:54.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.538+0000 7f24c2ba8700 1 -- 172.21.15.6:0/598989712 wait complete. 2023-10-06T02:17:54.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.539+0000 7f24c2ba8700 1 Processor -- start 2023-10-06T02:17:54.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.540+0000 7f24c2ba8700 1 -- start start 2023-10-06T02:17:54.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.540+0000 7f24c2ba8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24a8003a90 0x7f24bc157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.540+0000 7f24c2ba8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24bc0ca0a0 0x7f24bc153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.540+0000 7f24c2ba8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24bc0b3fb0 0x7f24bc0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.540+0000 7f24c2ba8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc0b4990 con 0x7f24bc0ca0a0 2023-10-06T02:17:54.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.540+0000 7f24c2ba8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc0c7600 con 0x7f24a8003a90 2023-10-06T02:17:54.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.540+0000 7f24c2ba8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc158640 con 0x7f24bc0b3fb0 2023-10-06T02:17:54.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.540+0000 7f24bbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24bc0ca0a0 0x7f24bc153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.541+0000 7f24bbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24bc0ca0a0 0x7f24bc153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36314/0 (socket says 172.21.15.6:36314) 2023-10-06T02:17:54.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.541+0000 7f24bbfff700 1 -- 172.21.15.6:0/1704325122 learned_addr learned my addr 172.21.15.6:0/1704325122 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:54.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.541+0000 7f24c0944700 1 --2- 172.21.15.6:0/1704325122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24a8003a90 0x7f24bc157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.541+0000 7f24c1145700 1 --2- 172.21.15.6:0/1704325122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24bc0b3fb0 0x7f24bc0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.541+0000 7f24bbfff700 1 -- 172.21.15.6:0/1704325122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24bc0b3fb0 msgr2=0x7f24bc0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:54.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.541+0000 7f24bbfff700 1 --2- 172.21.15.6:0/1704325122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24bc0b3fb0 0x7f24bc0b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.541+0000 7f24bbfff700 1 -- 172.21.15.6:0/1704325122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24a8003a90 msgr2=0x7f24bc157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:54.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.541+0000 7f24bbfff700 1 --2- 172.21.15.6:0/1704325122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24a8003a90 0x7f24bc157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.541+0000 7f24bbfff700 1 -- 172.21.15.6:0/1704325122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc157da0 con 0x7f24bc0ca0a0 2023-10-06T02:17:54.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.541+0000 7f24bbfff700 1 --2- 172.21.15.6:0/1704325122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24bc0ca0a0 0x7f24bc153f30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f24ac002ab0 tx=0x7f24ac007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:54.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.541+0000 7f24b8ff9700 1 -- 172.21.15.6:0/1704325122 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac00f8d0 con 0x7f24bc0ca0a0 2023-10-06T02:17:54.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.541+0000 7f24b8ff9700 1 -- 172.21.15.6:0/1704325122 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac00fa30 con 0x7f24bc0ca0a0 2023-10-06T02:17:54.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.541+0000 7f24c2ba8700 1 -- 172.21.15.6:0/1704325122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24bc158080 con 0x7f24bc0ca0a0 2023-10-06T02:17:54.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.541+0000 7f24b8ff9700 1 -- 172.21.15.6:0/1704325122 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac00fdf0 con 0x7f24bc0ca0a0 2023-10-06T02:17:54.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.541+0000 7f24c2ba8700 1 -- 172.21.15.6:0/1704325122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24bc0ca510 con 0x7f24bc0ca0a0 2023-10-06T02:17:54.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.542+0000 7f24c2ba8700 1 -- 172.21.15.6:0/1704325122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24bc0c77b0 con 0x7f24bc0ca0a0 2023-10-06T02:17:54.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.543+0000 7f24b8ff9700 1 -- 172.21.15.6:0/1704325122 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f24ac013600 con 0x7f24bc0ca0a0 2023-10-06T02:17:54.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.543+0000 7f24b8ff9700 1 --2- 172.21.15.6:0/1704325122 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f249c066f30 0x7f249c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.543+0000 7f24b8ff9700 1 -- 172.21.15.6:0/1704325122 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f24ac084f50 con 0x7f24bc0ca0a0 2023-10-06T02:17:54.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.543+0000 7f24c0944700 1 --2- 172.21.15.6:0/1704325122 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f249c066f30 0x7f249c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.544+0000 7f24c0944700 1 --2- 172.21.15.6:0/1704325122 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f249c066f30 0x7f249c0693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f24b400a430 tx=0x7f24b4016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:54.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.547+0000 7f24b8ff9700 1 -- 172.21.15.6:0/1704325122 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24bc0c77b0 con 0x7f24bc0ca0a0 2023-10-06T02:17:54.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.745+0000 7f24c2ba8700 1 -- 172.21.15.6:0/1704325122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24bc0c7770 con 0x7f24bc0ca0a0 2023-10-06T02:17:54.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.746+0000 7f24b8ff9700 1 -- 172.21.15.6:0/1704325122 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f24ac017090 con 0x7f24bc0ca0a0 2023-10-06T02:17:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:54.748 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:48.453046+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:17:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.748+0000 7f24c2ba8700 1 -- 172.21.15.6:0/1704325122 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f249c066f30 msgr2=0x7f249c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.748+0000 7f24c2ba8700 1 --2- 172.21.15.6:0/1704325122 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f249c066f30 0x7f249c0693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f24b400a430 tx=0x7f24b4016000 comp rx=0 tx=0).stop 2023-10-06T02:17:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.748+0000 7f24c2ba8700 1 -- 172.21.15.6:0/1704325122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24bc0ca0a0 msgr2=0x7f24bc153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.748+0000 7f24c2ba8700 1 --2- 172.21.15.6:0/1704325122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24bc0ca0a0 0x7f24bc153f30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f24ac002ab0 tx=0x7f24ac007d10 comp rx=0 tx=0).stop 2023-10-06T02:17:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.748+0000 7f24c2ba8700 1 -- 172.21.15.6:0/1704325122 shutdown_connections 2023-10-06T02:17:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.748+0000 7f24c2ba8700 1 --2- 172.21.15.6:0/1704325122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24bc0b3fb0 0x7f24bc0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.748+0000 7f24c2ba8700 1 --2- 172.21.15.6:0/1704325122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24a8003a90 0x7f24bc157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.748+0000 7f24c2ba8700 1 --2- 172.21.15.6:0/1704325122 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f249c066f30 0x7f249c0693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.748+0000 7f24c2ba8700 1 --2- 172.21.15.6:0/1704325122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24bc0ca0a0 0x7f24bc153f30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.748+0000 7f24c2ba8700 1 -- 172.21.15.6:0/1704325122 >> 172.21.15.6:0/1704325122 conn(0x7f24bc068680 msgr2=0x7f24bc154d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:54.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.748+0000 7f24c2ba8700 1 -- 172.21.15.6:0/1704325122 shutdown_connections 2023-10-06T02:17:54.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.748+0000 7f24c2ba8700 1 -- 172.21.15.6:0/1704325122 wait complete. 2023-10-06T02:17:54.762 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:17:54.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.882+0000 7feab5a13700 1 Processor -- start 2023-10-06T02:17:54.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.882+0000 7feab5a13700 1 -- start start 2023-10-06T02:17:54.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.883+0000 7feab5a13700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feab01574b0 0x7feab00b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.883+0000 7feab5a13700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feab00c46e0 0x7feab00cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.883+0000 7feab5a13700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab00c3b40 con 0x7feab00b13f0 2023-10-06T02:17:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.883+0000 7feab5a13700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab00c2f30 con 0x7feab01574b0 2023-10-06T02:17:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.883+0000 7feab5a13700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab00c3210 con 0x7feab00c46e0 2023-10-06T02:17:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.883+0000 7feaaf7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feab00c46e0 0x7feab00cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.883+0000 7feaaeffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feab01574b0 0x7feab00b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.883+0000 7feaaf7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feab00c46e0 0x7feab00cbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:35210/0 (socket says 172.21.15.6:35210) 2023-10-06T02:17:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.883+0000 7feaaf7fe700 1 -- 172.21.15.6:0/2794394843 learned_addr learned my addr 172.21.15.6:0/2794394843 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.883+0000 7feaae7fc700 1 --1- 172.21.15.6:0/2794394843 >> v1:172.21.15.175:6789/0 conn(0x7feab00b13f0 0x7feab00c3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:47960/0 (socket says 172.21.15.6:47960) 2023-10-06T02:17:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.884+0000 7feaaf7fe700 1 -- 172.21.15.6:0/2794394843 >> v2:172.21.15.175:3300/0 conn(0x7feab01574b0 msgr2=0x7feab00b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.884+0000 7feaaf7fe700 1 --2- 172.21.15.6:0/2794394843 >> v2:172.21.15.175:3300/0 conn(0x7feab01574b0 0x7feab00b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.884+0000 7feaaf7fe700 1 -- 172.21.15.6:0/2794394843 >> v1:172.21.15.175:6789/0 conn(0x7feab00b13f0 legacy=0x7feab00c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.884+0000 7feaaf7fe700 1 -- 172.21.15.6:0/2794394843 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab00c34f0 con 0x7feab00c46e0 2023-10-06T02:17:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.884+0000 7feaaeffd700 1 --2- 172.21.15.6:0/2794394843 >> v2:172.21.15.175:3300/0 conn(0x7feab01574b0 0x7feab00b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.884+0000 7feaaf7fe700 1 --2- 172.21.15.6:0/2794394843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feab00c46e0 0x7feab00cbcc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009f20 tx=0x7feaa0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e3db36590a4d739 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.884+0000 7feaadffb700 1 -- 172.21.15.6:0/2794394843 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa000e070 con 0x7feab00c46e0 2023-10-06T02:17:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.884+0000 7feaadffb700 1 -- 172.21.15.6:0/2794394843 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa000b9d0 con 0x7feab00c46e0 2023-10-06T02:17:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.884+0000 7feaadffb700 1 -- 172.21.15.6:0/2794394843 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa00092e0 con 0x7feab00c46e0 2023-10-06T02:17:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.885+0000 7feab5a13700 1 -- 172.21.15.6:0/2794394843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feab00c46e0 msgr2=0x7feab00cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.885+0000 7feab5a13700 1 --2- 172.21.15.6:0/2794394843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feab00c46e0 0x7feab00cbcc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009f20 tx=0x7feaa0009840 comp rx=0 tx=0).stop 2023-10-06T02:17:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.885+0000 7feab5a13700 1 -- 172.21.15.6:0/2794394843 shutdown_connections 2023-10-06T02:17:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.885+0000 7feab5a13700 1 --2- 172.21.15.6:0/2794394843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feab00c46e0 0x7feab00cbcc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.885+0000 7feab5a13700 1 --2- 172.21.15.6:0/2794394843 >> v2:172.21.15.175:3300/0 conn(0x7feab01574b0 0x7feab00b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.885+0000 7feab5a13700 1 -- 172.21.15.6:0/2794394843 >> 172.21.15.6:0/2794394843 conn(0x7feab0067910 msgr2=0x7feab00ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:54.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.885+0000 7feab5a13700 1 -- 172.21.15.6:0/2794394843 shutdown_connections 2023-10-06T02:17:54.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.885+0000 7feab5a13700 1 -- 172.21.15.6:0/2794394843 wait complete. 2023-10-06T02:17:54.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.886+0000 7feab5a13700 1 Processor -- start 2023-10-06T02:17:54.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.886+0000 7feab5a13700 1 -- start start 2023-10-06T02:17:54.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.887+0000 7feab5a13700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feab00b13f0 0x7feab016b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.887+0000 7feab5a13700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feab00c46e0 0x7feab014bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.887+0000 7feab5a13700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feab01574b0 0x7feab015c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.887+0000 7feab5a13700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab016b3d0 con 0x7feab00b13f0 2023-10-06T02:17:54.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.887+0000 7feab5a13700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab00c6d80 con 0x7feab01574b0 2023-10-06T02:17:54.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.887+0000 7feab5a13700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab016ad50 con 0x7feab00c46e0 2023-10-06T02:17:54.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.887+0000 7feaaeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feab00b13f0 0x7feab016b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.887+0000 7feaaeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feab00b13f0 0x7feab016b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36316/0 (socket says 172.21.15.6:36316) 2023-10-06T02:17:54.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.887+0000 7feaaeffd700 1 -- 172.21.15.6:0/898374714 learned_addr learned my addr 172.21.15.6:0/898374714 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:54.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.887+0000 7feaae7fc700 1 --2- 172.21.15.6:0/898374714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feab00c46e0 0x7feab014bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.887+0000 7feaaf7fe700 1 --2- 172.21.15.6:0/898374714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feab01574b0 0x7feab015c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.887+0000 7feaaeffd700 1 -- 172.21.15.6:0/898374714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feab00c46e0 msgr2=0x7feab014bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:54.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.887+0000 7feaaeffd700 1 --2- 172.21.15.6:0/898374714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feab00c46e0 0x7feab014bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.887+0000 7feaaeffd700 1 -- 172.21.15.6:0/898374714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feab01574b0 msgr2=0x7feab015c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:54.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.887+0000 7feaaeffd700 1 --2- 172.21.15.6:0/898374714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feab01574b0 0x7feab015c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:54.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.887+0000 7feaaeffd700 1 -- 172.21.15.6:0/898374714 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa80093c0 con 0x7feab00b13f0 2023-10-06T02:17:54.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.888+0000 7feaaeffd700 1 --2- 172.21.15.6:0/898374714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feab00b13f0 0x7feab016b7f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feaa800ec80 tx=0x7feaa8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.888+0000 7feaa6ffd700 1 -- 172.21.15.6:0/898374714 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8005a00 con 0x7feab00b13f0 2023-10-06T02:17:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.888+0000 7feaa6ffd700 1 -- 172.21.15.6:0/898374714 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa8005b60 con 0x7feab00b13f0 2023-10-06T02:17:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.888+0000 7feab5a13700 1 -- 172.21.15.6:0/898374714 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa0009ae0 con 0x7feab00b13f0 2023-10-06T02:17:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.888+0000 7feaa6ffd700 1 -- 172.21.15.6:0/898374714 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa800c850 con 0x7feab00b13f0 2023-10-06T02:17:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.888+0000 7feab5a13700 1 -- 172.21.15.6:0/898374714 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab016aff0 con 0x7feab00b13f0 2023-10-06T02:17:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.889+0000 7feab5a13700 1 -- 172.21.15.6:0/898374714 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab016b640 con 0x7feab00b13f0 2023-10-06T02:17:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.889+0000 7feaa6ffd700 1 -- 172.21.15.6:0/898374714 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feaa800cbc0 con 0x7feab00b13f0 2023-10-06T02:17:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.890+0000 7feaa6ffd700 1 --2- 172.21.15.6:0/898374714 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fea90066f30 0x7fea900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.890+0000 7feaa6ffd700 1 -- 172.21.15.6:0/898374714 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7feaa8084e70 con 0x7feab00b13f0 2023-10-06T02:17:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.890+0000 7feaae7fc700 1 --2- 172.21.15.6:0/898374714 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fea90066f30 0x7fea900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:54.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.890+0000 7feaae7fc700 1 --2- 172.21.15.6:0/898374714 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fea90066f30 0x7fea900693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feab006d8a0 tx=0x7fea98007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:54.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:54.894+0000 7feaa6ffd700 1 -- 172.21.15.6:0/898374714 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feaa8051bf0 con 0x7feab00b13f0 2023-10-06T02:17:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.133+0000 7feab5a13700 1 -- 172.21.15.6:0/898374714 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7feab006e590 con 0x7feab00b13f0 2023-10-06T02:17:55.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.731+0000 7feaa6ffd700 1 -- 172.21.15.6:0/898374714 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7feaa8020020 con 0x7feab00b13f0 2023-10-06T02:17:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.734+0000 7feab5a13700 1 -- 172.21.15.6:0/898374714 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fea90066f30 msgr2=0x7fea900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.734+0000 7feab5a13700 1 --2- 172.21.15.6:0/898374714 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fea90066f30 0x7fea900693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feab006d8a0 tx=0x7fea98007eb0 comp rx=0 tx=0).stop 2023-10-06T02:17:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.734+0000 7feab5a13700 1 -- 172.21.15.6:0/898374714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feab00b13f0 msgr2=0x7feab016b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.734+0000 7feab5a13700 1 --2- 172.21.15.6:0/898374714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feab00b13f0 0x7feab016b7f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feaa800ec80 tx=0x7feaa8009120 comp rx=0 tx=0).stop 2023-10-06T02:17:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.735+0000 7feab5a13700 1 -- 172.21.15.6:0/898374714 shutdown_connections 2023-10-06T02:17:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.735+0000 7feab5a13700 1 --2- 172.21.15.6:0/898374714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feab01574b0 0x7feab015c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.735+0000 7feab5a13700 1 --2- 172.21.15.6:0/898374714 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fea90066f30 0x7fea900693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.735+0000 7feab5a13700 1 --2- 172.21.15.6:0/898374714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feab00b13f0 0x7feab016b7f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.735+0000 7feab5a13700 1 --2- 172.21.15.6:0/898374714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feab00c46e0 0x7feab014bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.735+0000 7feab5a13700 1 -- 172.21.15.6:0/898374714 >> 172.21.15.6:0/898374714 conn(0x7feab0067910 msgr2=0x7feab00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.735+0000 7feab5a13700 1 -- 172.21.15.6:0/898374714 shutdown_connections 2023-10-06T02:17:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.735+0000 7feab5a13700 1 -- 172.21.15.6:0/898374714 wait complete. 2023-10-06T02:17:55.751 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:17:55.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.878+0000 7f34a4c85700 1 Processor -- start 2023-10-06T02:17:55.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.878+0000 7f34a4c85700 1 -- start start 2023-10-06T02:17:55.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.879+0000 7f34a4c85700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a00d07d0 0x7f34a00b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:55.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.879+0000 7f34a4c85700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a015dd40 con 0x7f34a00d0400 2023-10-06T02:17:55.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.879+0000 7f34a4c85700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a015e020 con 0x7f34a00ccd40 2023-10-06T02:17:55.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.879+0000 7f34a4c85700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00ceaa0 con 0x7f34a00d07d0 2023-10-06T02:17:55.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.879+0000 7f349e59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f34a00d0400 0x7f34a00b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41956/0 (socket says 172.21.15.6:41956) 2023-10-06T02:17:55.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.879+0000 7f349e59c700 1 -- 172.21.15.6:0/1246352157 learned_addr learned my addr 172.21.15.6:0/1246352157 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:55.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.879+0000 7f349ed9d700 1 --2- 172.21.15.6:0/1246352157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a00d07d0 0x7f34a00b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:55.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349d59a700 1 -- 172.21.15.6:0/1246352157 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803590426 0 0) 0x7f34a015dd40 con 0x7f34a00d0400 2023-10-06T02:17:55.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349d59a700 1 -- 172.21.15.6:0/1246352157 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f348c003570 con 0x7f34a00d0400 2023-10-06T02:17:55.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349d59a700 1 -- 172.21.15.6:0/1246352157 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943130875 0 0) 0x7f34a015e020 con 0x7f34a00ccd40 2023-10-06T02:17:55.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349d59a700 1 -- 172.21.15.6:0/1246352157 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34a015dd40 con 0x7f34a00ccd40 2023-10-06T02:17:55.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349d59a700 1 -- 172.21.15.6:0/1246352157 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3662634488 0 0) 0x7f348c003570 con 0x7f34a00d0400 2023-10-06T02:17:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349d59a700 1 -- 172.21.15.6:0/1246352157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a00d07d0 msgr2=0x7f34a00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349d59a700 1 --2- 172.21.15.6:0/1246352157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a00d07d0 0x7f34a00b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349d59a700 1 -- 172.21.15.6:0/1246352157 >> v1:172.21.15.175:6789/0 conn(0x7f34a00ccd40 legacy=0x7f34a00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349d59a700 1 -- 172.21.15.6:0/1246352157 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a00ced80 con 0x7f34a00d0400 2023-10-06T02:17:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349d59a700 1 -- 172.21.15.6:0/1246352157 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f34980015f0 con 0x7f34a00d0400 2023-10-06T02:17:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349ed9d700 1 --2- 172.21.15.6:0/1246352157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a00d07d0 0x7f34a00b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349d59a700 1 -- 172.21.15.6:0/1246352157 >> v1:172.21.15.6:6789/0 conn(0x7f34a00d0400 legacy=0x7f34a00b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349d59a700 1 --2- 172.21.15.6:0/1246352157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c003c20 0x7f348c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349d59a700 1 --2- 172.21.15.6:0/1246352157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f348c004810 0x7f348c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349d59a700 1 --2- 172.21.15.6:0/1246352157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a00d07d0 0x7f348c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349d59a700 1 -- 172.21.15.6:0/1246352157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00ceaa0 con 0x7f348c003c20 2023-10-06T02:17:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349d59a700 1 -- 172.21.15.6:0/1246352157 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c00bbb0 con 0x7f348c004810 2023-10-06T02:17:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349d59a700 1 -- 172.21.15.6:0/1246352157 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348c00bd70 con 0x7f34a00d07d0 2023-10-06T02:17:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349e59c700 1 --2- 172.21.15.6:0/1246352157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c003c20 0x7f348c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349ed9d700 1 --2- 172.21.15.6:0/1246352157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a00d07d0 0x7f348c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349dd9b700 1 --2- 172.21.15.6:0/1246352157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f348c004810 0x7f348c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349e59c700 1 -- 172.21.15.6:0/1246352157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a00d07d0 msgr2=0x7f348c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349e59c700 1 --2- 172.21.15.6:0/1246352157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a00d07d0 0x7f348c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349e59c700 1 -- 172.21.15.6:0/1246352157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f348c004810 msgr2=0x7f348c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349e59c700 1 --2- 172.21.15.6:0/1246352157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f348c004810 0x7f348c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349e59c700 1 -- 172.21.15.6:0/1246352157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3490009a20 con 0x7f348c003c20 2023-10-06T02:17:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.880+0000 7f349dd9b700 1 --2- 172.21.15.6:0/1246352157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f348c004810 0x7f348c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.881+0000 7f349e59c700 1 --2- 172.21.15.6:0/1246352157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c003c20 0x7f348c004010 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f349800c210 tx=0x7f3498007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187e2ebb2663cf7a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.881+0000 7f349d59a700 1 -- 172.21.15.6:0/1246352157 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349800cb00 con 0x7f348c003c20 2023-10-06T02:17:55.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.881+0000 7f349d59a700 1 -- 172.21.15.6:0/1246352157 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349800cc80 con 0x7f348c003c20 2023-10-06T02:17:55.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.881+0000 7f349d59a700 1 -- 172.21.15.6:0/1246352157 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34980070d0 con 0x7f348c003c20 2023-10-06T02:17:55.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.881+0000 7f34a4c85700 1 -- 172.21.15.6:0/1246352157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c003c20 msgr2=0x7f348c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:55.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.881+0000 7f34a4c85700 1 --2- 172.21.15.6:0/1246352157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c003c20 0x7f348c004010 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f349800c210 tx=0x7f3498007810 comp rx=0 tx=0).stop 2023-10-06T02:17:55.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.881+0000 7f349ed9d700 1 -- 172.21.15.6:0/1246352157 reap_dead start 2023-10-06T02:17:55.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.881+0000 7f34a4c85700 1 -- 172.21.15.6:0/1246352157 shutdown_connections 2023-10-06T02:17:55.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.881+0000 7f34a4c85700 1 -- 172.21.15.6:0/1246352157 >> 172.21.15.6:0/1246352157 conn(0x7f34a006a220 msgr2=0x7f34a006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:55.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.881+0000 7f34a4c85700 1 -- 172.21.15.6:0/1246352157 shutdown_connections 2023-10-06T02:17:55.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.881+0000 7f34a4c85700 1 -- 172.21.15.6:0/1246352157 wait complete. 2023-10-06T02:17:55.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.882+0000 7f34a4c85700 1 Processor -- start 2023-10-06T02:17:55.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.883+0000 7f34a4c85700 1 -- start start 2023-10-06T02:17:55.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.883+0000 7f34a4c85700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f348c003c20 0x7f34a016a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:55.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.883+0000 7f34a4c85700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a015c800 0x7f34a01559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:55.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.883+0000 7f34a4c85700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a00c8440 0x7f34a00c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:55.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.883+0000 7f34a4c85700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a015d800 con 0x7f34a00c8440 2023-10-06T02:17:55.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.883+0000 7f34a4c85700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0155f10 con 0x7f34a015c800 2023-10-06T02:17:55.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.883+0000 7f34a4c85700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00c8e00 con 0x7f348c003c20 2023-10-06T02:17:55.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.883+0000 7f349ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a00c8440 0x7f34a00c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:55.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.883+0000 7f349ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a00c8440 0x7f34a00c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36332/0 (socket says 172.21.15.6:36332) 2023-10-06T02:17:55.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.883+0000 7f349ed9d700 1 -- 172.21.15.6:0/1341807292 learned_addr learned my addr 172.21.15.6:0/1341807292 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:55.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.883+0000 7f349e59c700 1 --2- 172.21.15.6:0/1341807292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f348c003c20 0x7f34a016a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:55.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.884+0000 7f349dd9b700 1 --2- 172.21.15.6:0/1341807292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a015c800 0x7f34a01559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:55.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.884+0000 7f349ed9d700 1 -- 172.21.15.6:0/1341807292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f348c003c20 msgr2=0x7f34a016a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:55.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.884+0000 7f349ed9d700 1 --2- 172.21.15.6:0/1341807292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f348c003c20 0x7f34a016a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:55.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.884+0000 7f349ed9d700 1 -- 172.21.15.6:0/1341807292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a015c800 msgr2=0x7f34a01559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:55.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.884+0000 7f349ed9d700 1 --2- 172.21.15.6:0/1341807292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a015c800 0x7f34a01559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:55.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.884+0000 7f349ed9d700 1 -- 172.21.15.6:0/1341807292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a00ca490 con 0x7f34a00c8440 2023-10-06T02:17:55.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.884+0000 7f349dd9b700 1 --2- 172.21.15.6:0/1341807292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a015c800 0x7f34a01559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:55.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.884+0000 7f349ed9d700 1 --2- 172.21.15.6:0/1341807292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a00c8440 0x7f34a00c88c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f34900094d0 tx=0x7f349000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:55.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.884+0000 7f34967fc700 1 -- 172.21.15.6:0/1341807292 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349000e040 con 0x7f34a00c8440 2023-10-06T02:17:55.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.884+0000 7f34967fc700 1 -- 172.21.15.6:0/1341807292 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349000f040 con 0x7f34a00c8440 2023-10-06T02:17:55.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.884+0000 7f34967fc700 1 -- 172.21.15.6:0/1341807292 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490015430 con 0x7f34a00c8440 2023-10-06T02:17:55.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.884+0000 7f34a4c85700 1 -- 172.21.15.6:0/1341807292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a015cf60 con 0x7f34a00c8440 2023-10-06T02:17:55.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.884+0000 7f34a4c85700 1 -- 172.21.15.6:0/1341807292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a015d520 con 0x7f34a00c8440 2023-10-06T02:17:55.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.885+0000 7f34a4c85700 1 -- 172.21.15.6:0/1341807292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a0088760 con 0x7f34a00c8440 2023-10-06T02:17:55.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.885+0000 7f34967fc700 1 -- 172.21.15.6:0/1341807292 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34900157e0 con 0x7f34a00c8440 2023-10-06T02:17:55.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.886+0000 7f34967fc700 1 --2- 172.21.15.6:0/1341807292 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3480066f30 0x7f34800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:55.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.886+0000 7f34967fc700 1 -- 172.21.15.6:0/1341807292 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3490085410 con 0x7f34a00c8440 2023-10-06T02:17:55.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.886+0000 7f349e59c700 1 --2- 172.21.15.6:0/1341807292 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3480066f30 0x7f34800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:55.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.887+0000 7f349e59c700 1 --2- 172.21.15.6:0/1341807292 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3480066f30 0x7f34800693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3498008fd0 tx=0x7f3498015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:55.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:55.890+0000 7f34967fc700 1 -- 172.21.15.6:0/1341807292 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3490052230 con 0x7f34a00c8440 2023-10-06T02:17:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.134+0000 7f34a4c85700 1 -- 172.21.15.6:0/1341807292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f34a00ce6c0 con 0x7f34a00c8440 2023-10-06T02:17:56.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.739+0000 7f34967fc700 1 -- 172.21.15.6:0/1341807292 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3490055850 con 0x7f34a00c8440 2023-10-06T02:17:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.741+0000 7f34a4c85700 1 -- 172.21.15.6:0/1341807292 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3480066f30 msgr2=0x7f34800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.741+0000 7f34a4c85700 1 --2- 172.21.15.6:0/1341807292 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3480066f30 0x7f34800693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3498008fd0 tx=0x7f3498015000 comp rx=0 tx=0).stop 2023-10-06T02:17:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.741+0000 7f34a4c85700 1 -- 172.21.15.6:0/1341807292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a00c8440 msgr2=0x7f34a00c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.741+0000 7f34a4c85700 1 --2- 172.21.15.6:0/1341807292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a00c8440 0x7f34a00c88c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f34900094d0 tx=0x7f349000b040 comp rx=0 tx=0).stop 2023-10-06T02:17:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.741+0000 7f34a4c85700 1 -- 172.21.15.6:0/1341807292 shutdown_connections 2023-10-06T02:17:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.741+0000 7f34a4c85700 1 --2- 172.21.15.6:0/1341807292 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3480066f30 0x7f34800693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.741+0000 7f34a4c85700 1 --2- 172.21.15.6:0/1341807292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a00c8440 0x7f34a00c88c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.741+0000 7f34a4c85700 1 --2- 172.21.15.6:0/1341807292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f348c003c20 0x7f34a016a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.741+0000 7f34a4c85700 1 --2- 172.21.15.6:0/1341807292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a015c800 0x7f34a01559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.741+0000 7f34a4c85700 1 -- 172.21.15.6:0/1341807292 >> 172.21.15.6:0/1341807292 conn(0x7f34a006a220 msgr2=0x7f34a006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.741+0000 7f34a4c85700 1 -- 172.21.15.6:0/1341807292 shutdown_connections 2023-10-06T02:17:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.741+0000 7f34a4c85700 1 -- 172.21.15.6:0/1341807292 wait complete. 2023-10-06T02:17:56.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:17:56.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.880+0000 7f98e2574700 1 Processor -- start 2023-10-06T02:17:56.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.880+0000 7f98e2574700 1 -- start start 2023-10-06T02:17:56.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.881+0000 7f98e2574700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f98dc0af8b0 0x7f98dc15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:56.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.881+0000 7f98e2574700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98dc0b27f0 0x7f98dc15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.881+0000 7f98e2574700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98dc15e190 con 0x7f98dc0af4e0 2023-10-06T02:17:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.881+0000 7f98e2574700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98dc0b1910 con 0x7f98dc0af8b0 2023-10-06T02:17:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.881+0000 7f98e2574700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0cb650 con 0x7f98dc0b27f0 2023-10-06T02:17:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.881+0000 7f98db7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f98dc0af8b0 0x7f98dc15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.881+0000 7f98db7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f98dc0af8b0 0x7f98dc15d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36340/0 (socket says 172.21.15.6:36340) 2023-10-06T02:17:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.881+0000 7f98db7fe700 1 -- 172.21.15.6:0/683844198 learned_addr learned my addr 172.21.15.6:0/683844198 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.881+0000 7f98e0b11700 1 --2- 172.21.15.6:0/683844198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98dc0b27f0 0x7f98dc15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.881+0000 7f98db7fe700 1 -- 172.21.15.6:0/683844198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98dc0b27f0 msgr2=0x7f98dc15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.881+0000 7f98db7fe700 1 --2- 172.21.15.6:0/683844198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98dc0b27f0 0x7f98dc15d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.881+0000 7f98db7fe700 1 -- 172.21.15.6:0/683844198 >> v1:172.21.15.175:6789/0 conn(0x7f98dc0af4e0 legacy=0x7f98dc0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.881+0000 7f98db7fe700 1 -- 172.21.15.6:0/683844198 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc0ccaf0 con 0x7f98dc0af8b0 2023-10-06T02:17:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.881+0000 7f98e0b11700 1 --2- 172.21.15.6:0/683844198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98dc0b27f0 0x7f98dc15d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.881+0000 7f98db7fe700 1 --2- 172.21.15.6:0/683844198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98dc0af8b0 0x7f98dc15d460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0099b0 tx=0x7f98cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8fa15545136e0cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.882+0000 7f98daffd700 1 -- 172.21.15.6:0/683844198 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc00b860 con 0x7f98dc0af8b0 2023-10-06T02:17:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.882+0000 7f98daffd700 1 -- 172.21.15.6:0/683844198 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc00b9c0 con 0x7f98dc0af8b0 2023-10-06T02:17:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.882+0000 7f98daffd700 1 -- 172.21.15.6:0/683844198 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc00bd60 con 0x7f98dc0af8b0 2023-10-06T02:17:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.882+0000 7f98e2574700 1 -- 172.21.15.6:0/683844198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98dc0af8b0 msgr2=0x7f98dc15d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.882+0000 7f98e2574700 1 --2- 172.21.15.6:0/683844198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98dc0af8b0 0x7f98dc15d460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0099b0 tx=0x7f98cc009250 comp rx=0 tx=0).stop 2023-10-06T02:17:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.882+0000 7f98e2574700 1 -- 172.21.15.6:0/683844198 shutdown_connections 2023-10-06T02:17:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.882+0000 7f98e2574700 1 --2- 172.21.15.6:0/683844198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98dc0b27f0 0x7f98dc15d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.882+0000 7f98e2574700 1 --2- 172.21.15.6:0/683844198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98dc0af8b0 0x7f98dc15d460 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.882+0000 7f98e2574700 1 -- 172.21.15.6:0/683844198 >> 172.21.15.6:0/683844198 conn(0x7f98dc068680 msgr2=0x7f98dc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.882+0000 7f98e2574700 1 -- 172.21.15.6:0/683844198 shutdown_connections 2023-10-06T02:17:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.882+0000 7f98e2574700 1 -- 172.21.15.6:0/683844198 wait complete. 2023-10-06T02:17:56.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.883+0000 7f98e2574700 1 Processor -- start 2023-10-06T02:17:56.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.884+0000 7f98e2574700 1 -- start start 2023-10-06T02:17:56.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.884+0000 7f98e2574700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98dc0af4e0 0x7f98dc1526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:56.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.884+0000 7f98e2574700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98dc0af8b0 0x7f98dc0d0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:56.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.884+0000 7f98e2574700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98dc0b27f0 0x7f98dc169830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:56.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.884+0000 7f98e2574700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc143870 con 0x7f98dc0af8b0 2023-10-06T02:17:56.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.884+0000 7f98e2574700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc1538b0 con 0x7f98dc0b27f0 2023-10-06T02:17:56.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.884+0000 7f98e2574700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc152ca0 con 0x7f98dc0af4e0 2023-10-06T02:17:56.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.884+0000 7f98db7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98dc0af8b0 0x7f98dc0d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:56.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.884+0000 7f98db7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98dc0af8b0 0x7f98dc0d0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36352/0 (socket says 172.21.15.6:36352) 2023-10-06T02:17:56.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.884+0000 7f98db7fe700 1 -- 172.21.15.6:0/1408820623 learned_addr learned my addr 172.21.15.6:0/1408820623 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:56.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.885+0000 7f98dbfff700 1 --2- 172.21.15.6:0/1408820623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98dc0af4e0 0x7f98dc1526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:56.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.885+0000 7f98e0b11700 1 --2- 172.21.15.6:0/1408820623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98dc0b27f0 0x7f98dc169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:56.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.885+0000 7f98db7fe700 1 -- 172.21.15.6:0/1408820623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98dc0af4e0 msgr2=0x7f98dc1526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:56.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.885+0000 7f98db7fe700 1 --2- 172.21.15.6:0/1408820623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98dc0af4e0 0x7f98dc1526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:56.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.885+0000 7f98db7fe700 1 -- 172.21.15.6:0/1408820623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98dc0b27f0 msgr2=0x7f98dc169830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:56.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.885+0000 7f98db7fe700 1 --2- 172.21.15.6:0/1408820623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98dc0b27f0 0x7f98dc169830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:56.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.885+0000 7f98db7fe700 1 -- 172.21.15.6:0/1408820623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc0094f0 con 0x7f98dc0af8b0 2023-10-06T02:17:56.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.885+0000 7f98db7fe700 1 --2- 172.21.15.6:0/1408820623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98dc0af8b0 0x7f98dc0d0730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0090b0 tx=0x7f98cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:56.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.885+0000 7f98d3fff700 1 -- 172.21.15.6:0/1408820623 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc01a450 con 0x7f98dc0af8b0 2023-10-06T02:17:56.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.885+0000 7f98d3fff700 1 -- 172.21.15.6:0/1408820623 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc01a5b0 con 0x7f98dc0af8b0 2023-10-06T02:17:56.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.885+0000 7f98e2574700 1 -- 172.21.15.6:0/1408820623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98dc152f80 con 0x7f98dc0af8b0 2023-10-06T02:17:56.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.885+0000 7f98d3fff700 1 -- 172.21.15.6:0/1408820623 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc01a970 con 0x7f98dc0af8b0 2023-10-06T02:17:56.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.885+0000 7f98e2574700 1 -- 172.21.15.6:0/1408820623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98dc153540 con 0x7f98dc0af8b0 2023-10-06T02:17:56.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.886+0000 7f98e2574700 1 -- 172.21.15.6:0/1408820623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98dc153a20 con 0x7f98dc0af8b0 2023-10-06T02:17:56.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.886+0000 7f98d3fff700 1 -- 172.21.15.6:0/1408820623 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98cc01ace0 con 0x7f98dc0af8b0 2023-10-06T02:17:56.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.887+0000 7f98d3fff700 1 --2- 172.21.15.6:0/1408820623 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f98bc066f30 0x7f98bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:56.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.887+0000 7f98d3fff700 1 -- 172.21.15.6:0/1408820623 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f98cc086040 con 0x7f98dc0af8b0 2023-10-06T02:17:56.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.887+0000 7f98dbfff700 1 --2- 172.21.15.6:0/1408820623 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f98bc066f30 0x7f98bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:56.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.887+0000 7f98dbfff700 1 --2- 172.21.15.6:0/1408820623 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f98bc066f30 0x7f98bc0693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f98c40037c0 tx=0x7f98c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:56.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:56.891+0000 7f98d3fff700 1 -- 172.21.15.6:0/1408820623 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98cc052e60 con 0x7f98dc0af8b0 2023-10-06T02:17:57.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.132+0000 7f98e2574700 1 -- 172.21.15.6:0/1408820623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98dc0b0910 con 0x7f98dc0af8b0 2023-10-06T02:17:57.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.133+0000 7f98d3fff700 1 -- 172.21.15.6:0/1408820623 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4590 (secure 0 0 0) 0x7f98cc026e60 con 0x7f98dc0af8b0 2023-10-06T02:17:57.134 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:57.134 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3433510267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3433510267},{"type":"v1","addr":"172.21.15.175:6836","nonce":3433510267}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3290404467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3290404467},{"type":"v1","addr":"172.21.15.175:6837","nonce":3290404467}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/4132952009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4132952009},{"type":"v1","addr":"172.21.15.6:6834","nonce":4132952009}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:17:43.404580+0000","modified":"2023-10-06T02:17:56.734938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/839986504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":839986504},{"type":"v1","addr":"172.21.15.6:6835","nonce":839986504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:17:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.135+0000 7f98e2574700 1 -- 172.21.15.6:0/1408820623 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f98bc066f30 msgr2=0x7f98bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.135+0000 7f98e2574700 1 --2- 172.21.15.6:0/1408820623 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f98bc066f30 0x7f98bc0693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f98c40037c0 tx=0x7f98c4009040 comp rx=0 tx=0).stop 2023-10-06T02:17:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.135+0000 7f98e2574700 1 -- 172.21.15.6:0/1408820623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98dc0af8b0 msgr2=0x7f98dc0d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.135+0000 7f98e2574700 1 --2- 172.21.15.6:0/1408820623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98dc0af8b0 0x7f98dc0d0730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0090b0 tx=0x7f98cc017000 comp rx=0 tx=0).stop 2023-10-06T02:17:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.135+0000 7f98e2574700 1 -- 172.21.15.6:0/1408820623 shutdown_connections 2023-10-06T02:17:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.135+0000 7f98e2574700 1 --2- 172.21.15.6:0/1408820623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98dc0b27f0 0x7f98dc169830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.135+0000 7f98e2574700 1 --2- 172.21.15.6:0/1408820623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98dc0af4e0 0x7f98dc1526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.135+0000 7f98e2574700 1 --2- 172.21.15.6:0/1408820623 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f98bc066f30 0x7f98bc0693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.135+0000 7f98e2574700 1 --2- 172.21.15.6:0/1408820623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98dc0af8b0 0x7f98dc0d0730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.135+0000 7f98e2574700 1 -- 172.21.15.6:0/1408820623 >> 172.21.15.6:0/1408820623 conn(0x7f98dc068680 msgr2=0x7f98dc0b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.135+0000 7f98e2574700 1 -- 172.21.15.6:0/1408820623 shutdown_connections 2023-10-06T02:17:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.135+0000 7f98e2574700 1 -- 172.21.15.6:0/1408820623 wait complete. 2023-10-06T02:17:57.138 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-10-06T02:17:57.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:17:57.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.265+0000 7f054334a700 1 Processor -- start 2023-10-06T02:17:57.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.266+0000 7f054334a700 1 -- start start 2023-10-06T02:17:57.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.266+0000 7f054334a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053c15b3c0 0x7f053c097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.266+0000 7f054334a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f053c15a590 0x7f053c15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.266+0000 7f054334a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f053c0afb90 con 0x7f053c0b3c50 2023-10-06T02:17:57.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.266+0000 7f054334a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f053c15aef0 con 0x7f053c15a590 2023-10-06T02:17:57.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.266+0000 7f054334a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0b2310 con 0x7f053c15b3c0 2023-10-06T02:17:57.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f05408e5700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f053c0b3c50 0x7f053c15b790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41958/0 (socket says 172.21.15.6:41958) 2023-10-06T02:17:57.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f05408e5700 1 -- 172.21.15.6:0/738624269 learned_addr learned my addr 172.21.15.6:0/738624269 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:57.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f05418e7700 1 --2- 172.21.15.6:0/738624269 >> v2:172.21.15.175:3300/0 conn(0x7f053c15a590 0x7f053c15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f05410e6700 1 --2- 172.21.15.6:0/738624269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053c15b3c0 0x7f053c097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f053bfff700 1 -- 172.21.15.6:0/738624269 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149716214 0 0) 0x7f053c0afb90 con 0x7f053c0b3c50 2023-10-06T02:17:57.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f053bfff700 1 -- 172.21.15.6:0/738624269 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0524003570 con 0x7f053c0b3c50 2023-10-06T02:17:57.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f053bfff700 1 -- 172.21.15.6:0/738624269 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4128595543 0 0) 0x7f0524003570 con 0x7f053c0b3c50 2023-10-06T02:17:57.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f053bfff700 1 -- 172.21.15.6:0/738624269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053c15b3c0 msgr2=0x7f053c097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:57.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f053bfff700 1 --2- 172.21.15.6:0/738624269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053c15b3c0 0x7f053c097d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f053bfff700 1 -- 172.21.15.6:0/738624269 >> v2:172.21.15.175:3300/0 conn(0x7f053c15a590 msgr2=0x7f053c15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f053bfff700 1 --2- 172.21.15.6:0/738624269 >> v2:172.21.15.175:3300/0 conn(0x7f053c15a590 0x7f053c15a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f053bfff700 1 -- 172.21.15.6:0/738624269 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c0b25f0 con 0x7f053c0b3c50 2023-10-06T02:17:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f053bfff700 1 -- 172.21.15.6:0/738624269 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f0530001470 con 0x7f053c0b3c50 2023-10-06T02:17:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f053bfff700 1 -- 172.21.15.6:0/738624269 >> v1:172.21.15.6:6789/0 conn(0x7f053c0b3c50 legacy=0x7f053c15b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f053bfff700 1 --2- 172.21.15.6:0/738624269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0524003a60 0x7f0524003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f053bfff700 1 --2- 172.21.15.6:0/738624269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053c15b3c0 0x7f0524004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f053bfff700 1 --2- 172.21.15.6:0/738624269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0524004d50 0x7f05240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f053bfff700 1 -- 172.21.15.6:0/738624269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c15aef0 con 0x7f0524004d50 2023-10-06T02:17:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f053bfff700 1 -- 172.21.15.6:0/738624269 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0b2310 con 0x7f0524003a60 2023-10-06T02:17:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f053bfff700 1 -- 172.21.15.6:0/738624269 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052400fe70 con 0x7f053c15b3c0 2023-10-06T02:17:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f05418e7700 1 --2- 172.21.15.6:0/738624269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0524004d50 0x7f05240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f05410e6700 1 --2- 172.21.15.6:0/738624269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0524003a60 0x7f0524003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.267+0000 7f05408e5700 1 --2- 172.21.15.6:0/738624269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053c15b3c0 0x7f0524004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.268+0000 7f05418e7700 1 -- 172.21.15.6:0/738624269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053c15b3c0 msgr2=0x7f0524004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.268+0000 7f05418e7700 1 --2- 172.21.15.6:0/738624269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053c15b3c0 0x7f0524004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.268+0000 7f05418e7700 1 -- 172.21.15.6:0/738624269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0524003a60 msgr2=0x7f0524003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.268+0000 7f05418e7700 1 --2- 172.21.15.6:0/738624269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0524003a60 0x7f0524003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.268+0000 7f05418e7700 1 -- 172.21.15.6:0/738624269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0524003570 con 0x7f0524004d50 2023-10-06T02:17:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.268+0000 7f05418e7700 1 --2- 172.21.15.6:0/738624269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0524004d50 0x7f05240051c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f052c00e210 tx=0x7f052c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89117c8591fe817 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.268+0000 7f053bfff700 1 -- 172.21.15.6:0/738624269 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00ea60 con 0x7f0524004d50 2023-10-06T02:17:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.268+0000 7f053bfff700 1 -- 172.21.15.6:0/738624269 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c00f040 con 0x7f0524004d50 2023-10-06T02:17:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.268+0000 7f053bfff700 1 -- 172.21.15.6:0/738624269 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00ee10 con 0x7f0524004d50 2023-10-06T02:17:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.268+0000 7f054334a700 1 -- 172.21.15.6:0/738624269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0524004d50 msgr2=0x7f05240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:57.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.268+0000 7f054334a700 1 --2- 172.21.15.6:0/738624269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0524004d50 0x7f05240051c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f052c00e210 tx=0x7f052c00b040 comp rx=0 tx=0).stop 2023-10-06T02:17:57.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.268+0000 7f05418e7700 1 -- 172.21.15.6:0/738624269 reap_dead start 2023-10-06T02:17:57.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.269+0000 7f054334a700 1 -- 172.21.15.6:0/738624269 shutdown_connections 2023-10-06T02:17:57.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.269+0000 7f054334a700 1 -- 172.21.15.6:0/738624269 >> 172.21.15.6:0/738624269 conn(0x7f053c067910 msgr2=0x7f053c0ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:57.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.269+0000 7f054334a700 1 -- 172.21.15.6:0/738624269 shutdown_connections 2023-10-06T02:17:57.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.269+0000 7f054334a700 1 -- 172.21.15.6:0/738624269 wait complete. 2023-10-06T02:17:57.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.270+0000 7f054334a700 1 Processor -- start 2023-10-06T02:17:57.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.270+0000 7f054334a700 1 -- start start 2023-10-06T02:17:57.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f054334a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f053c144670 0x7f053c152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f054334a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f053c06a6d0 0x7f053c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f054334a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053c0a92c0 0x7f053c0a9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f054334a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c06b080 con 0x7f053c06a6d0 2023-10-06T02:17:57.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f054334a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0aa030 con 0x7f053c144670 2023-10-06T02:17:57.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f054334a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053c1521e0 con 0x7f053c0a92c0 2023-10-06T02:17:57.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f05408e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f053c06a6d0 0x7f053c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f05408e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f053c06a6d0 0x7f053c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36382/0 (socket says 172.21.15.6:36382) 2023-10-06T02:17:57.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f05408e5700 1 -- 172.21.15.6:0/2679211872 learned_addr learned my addr 172.21.15.6:0/2679211872 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:57.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f05410e6700 1 --2- 172.21.15.6:0/2679211872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f053c144670 0x7f053c152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f05418e7700 1 --2- 172.21.15.6:0/2679211872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053c0a92c0 0x7f053c0a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f05408e5700 1 -- 172.21.15.6:0/2679211872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053c0a92c0 msgr2=0x7f053c0a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:57.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f05408e5700 1 --2- 172.21.15.6:0/2679211872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053c0a92c0 0x7f053c0a9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f05408e5700 1 -- 172.21.15.6:0/2679211872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f053c144670 msgr2=0x7f053c152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:57.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f05408e5700 1 --2- 172.21.15.6:0/2679211872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f053c144670 0x7f053c152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f05408e5700 1 -- 172.21.15.6:0/2679211872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c1518b0 con 0x7f053c06a6d0 2023-10-06T02:17:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f05418e7700 1 --2- 172.21.15.6:0/2679211872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053c0a92c0 0x7f053c0a9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f05408e5700 1 --2- 172.21.15.6:0/2679211872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f053c06a6d0 0x7f053c06ab40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0530007390 tx=0x7f0530001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f05397fa700 1 -- 172.21.15.6:0/2679211872 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0530018030 con 0x7f053c06a6d0 2023-10-06T02:17:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f05397fa700 1 -- 172.21.15.6:0/2679211872 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053000f8d0 con 0x7f053c06a6d0 2023-10-06T02:17:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f05397fa700 1 -- 172.21.15.6:0/2679211872 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053000fc70 con 0x7f053c06a6d0 2023-10-06T02:17:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f054334a700 1 -- 172.21.15.6:0/2679211872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053c151b90 con 0x7f053c06a6d0 2023-10-06T02:17:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.271+0000 7f054334a700 1 -- 172.21.15.6:0/2679211872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053c152bb0 con 0x7f053c06a6d0 2023-10-06T02:17:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.272+0000 7f054334a700 1 -- 172.21.15.6:0/2679211872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053c152030 con 0x7f053c06a6d0 2023-10-06T02:17:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.273+0000 7f05397fa700 1 -- 172.21.15.6:0/2679211872 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f053001b070 con 0x7f053c06a6d0 2023-10-06T02:17:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.273+0000 7f05397fa700 1 --2- 172.21.15.6:0/2679211872 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0528066f30 0x7f05280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.273+0000 7f05397fa700 1 -- 172.21.15.6:0/2679211872 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0530019070 con 0x7f053c06a6d0 2023-10-06T02:17:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.273+0000 7f05410e6700 1 --2- 172.21.15.6:0/2679211872 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0528066f30 0x7f05280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.274+0000 7f05410e6700 1 --2- 172.21.15.6:0/2679211872 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0528066f30 0x7f05280693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0534006e50 tx=0x7f0534009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.277+0000 7f05397fa700 1 -- 172.21.15.6:0/2679211872 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05300516a0 con 0x7f053c06a6d0 2023-10-06T02:17:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.473+0000 7f054334a700 1 -- 172.21.15.6:0/2679211872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f053c06e8d0 con 0x7f053c06a6d0 2023-10-06T02:17:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.474+0000 7f05397fa700 1 -- 172.21.15.6:0/2679211872 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f0530054cc0 con 0x7f053c06a6d0 2023-10-06T02:17:57.475 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:57.475 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:48.453046+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:17:57.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.476+0000 7f054334a700 1 -- 172.21.15.6:0/2679211872 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0528066f30 msgr2=0x7f05280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:57.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.476+0000 7f054334a700 1 --2- 172.21.15.6:0/2679211872 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0528066f30 0x7f05280693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0534006e50 tx=0x7f0534009120 comp rx=0 tx=0).stop 2023-10-06T02:17:57.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.476+0000 7f054334a700 1 -- 172.21.15.6:0/2679211872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f053c06a6d0 msgr2=0x7f053c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:57.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.476+0000 7f054334a700 1 --2- 172.21.15.6:0/2679211872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f053c06a6d0 0x7f053c06ab40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0530007390 tx=0x7f0530001e90 comp rx=0 tx=0).stop 2023-10-06T02:17:57.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.476+0000 7f054334a700 1 -- 172.21.15.6:0/2679211872 shutdown_connections 2023-10-06T02:17:57.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.476+0000 7f054334a700 1 --2- 172.21.15.6:0/2679211872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053c0a92c0 0x7f053c0a9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.476+0000 7f054334a700 1 --2- 172.21.15.6:0/2679211872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f053c144670 0x7f053c152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.476+0000 7f054334a700 1 --2- 172.21.15.6:0/2679211872 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0528066f30 0x7f05280693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.476+0000 7f054334a700 1 --2- 172.21.15.6:0/2679211872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f053c06a6d0 0x7f053c06ab40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.476+0000 7f054334a700 1 -- 172.21.15.6:0/2679211872 >> 172.21.15.6:0/2679211872 conn(0x7f053c067910 msgr2=0x7f053c1541c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:57.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.476+0000 7f054334a700 1 -- 172.21.15.6:0/2679211872 shutdown_connections 2023-10-06T02:17:57.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.476+0000 7f054334a700 1 -- 172.21.15.6:0/2679211872 wait complete. 2023-10-06T02:17:57.489 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:17:57.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:17:57.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.608+0000 7f020f59e700 1 Processor -- start 2023-10-06T02:17:57.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.608+0000 7f020f59e700 1 -- start start 2023-10-06T02:17:57.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.609+0000 7f020f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0210159400 0x7f02100ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.609+0000 7f020f59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f02100cd030 0x7f02100cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.609+0000 7f020f59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02100b3560 con 0x7f02100cf1a0 2023-10-06T02:17:57.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.609+0000 7f020f59e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02100cf6f0 con 0x7f02100cd030 2023-10-06T02:17:57.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.609+0000 7f020f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02100cf9d0 con 0x7f0210159400 2023-10-06T02:17:57.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.609+0000 7f020ed9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f02100cf1a0 0x7f02100b5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41968/0 (socket says 172.21.15.6:41968) 2023-10-06T02:17:57.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.609+0000 7f020ed9d700 1 -- 172.21.15.6:0/1496168109 learned_addr learned my addr 172.21.15.6:0/1496168109 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:57.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.609+0000 7f020dd9b700 1 --2- 172.21.15.6:0/1496168109 >> v2:172.21.15.175:3300/0 conn(0x7f02100cd030 0x7f02100cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.609+0000 7f020e59c700 1 --2- 172.21.15.6:0/1496168109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0210159400 0x7f02100ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.609+0000 7f020d59a700 1 -- 172.21.15.6:0/1496168109 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860614665 0 0) 0x7f02100b3560 con 0x7f02100cf1a0 2023-10-06T02:17:57.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.609+0000 7f020d59a700 1 -- 172.21.15.6:0/1496168109 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01fc003570 con 0x7f02100cf1a0 2023-10-06T02:17:57.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020d59a700 1 -- 172.21.15.6:0/1496168109 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1910806610 0 0) 0x7f01fc003570 con 0x7f02100cf1a0 2023-10-06T02:17:57.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020d59a700 1 -- 172.21.15.6:0/1496168109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0210159400 msgr2=0x7f02100ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:57.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020d59a700 1 --2- 172.21.15.6:0/1496168109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0210159400 0x7f02100ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020d59a700 1 -- 172.21.15.6:0/1496168109 >> v2:172.21.15.175:3300/0 conn(0x7f02100cd030 msgr2=0x7f02100cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:57.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020d59a700 1 --2- 172.21.15.6:0/1496168109 >> v2:172.21.15.175:3300/0 conn(0x7f02100cd030 0x7f02100cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020d59a700 1 -- 172.21.15.6:0/1496168109 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100b2f10 con 0x7f02100cf1a0 2023-10-06T02:17:57.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020d59a700 1 -- 172.21.15.6:0/1496168109 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f02000017f0 con 0x7f02100cf1a0 2023-10-06T02:17:57.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020d59a700 1 -- 172.21.15.6:0/1496168109 >> v1:172.21.15.6:6789/0 conn(0x7f02100cf1a0 legacy=0x7f02100b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:57.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020d59a700 1 --2- 172.21.15.6:0/1496168109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01fc003a60 0x7f01fc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020d59a700 1 --2- 172.21.15.6:0/1496168109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0210159400 0x7f01fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020d59a700 1 --2- 172.21.15.6:0/1496168109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01fc004d50 0x7f01fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020d59a700 1 -- 172.21.15.6:0/1496168109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02100cf6f0 con 0x7f01fc003a60 2023-10-06T02:17:57.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020d59a700 1 -- 172.21.15.6:0/1496168109 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02100cf9d0 con 0x7f01fc004d50 2023-10-06T02:17:57.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020d59a700 1 -- 172.21.15.6:0/1496168109 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc00ba60 con 0x7f0210159400 2023-10-06T02:17:57.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020e59c700 1 --2- 172.21.15.6:0/1496168109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01fc003a60 0x7f01fc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020ed9d700 1 --2- 172.21.15.6:0/1496168109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01fc004d50 0x7f01fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020dd9b700 1 --2- 172.21.15.6:0/1496168109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0210159400 0x7f01fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020e59c700 1 -- 172.21.15.6:0/1496168109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0210159400 msgr2=0x7f01fc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:57.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020e59c700 1 --2- 172.21.15.6:0/1496168109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0210159400 0x7f01fc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020e59c700 1 -- 172.21.15.6:0/1496168109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01fc004d50 msgr2=0x7f01fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:57.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020e59c700 1 --2- 172.21.15.6:0/1496168109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01fc004d50 0x7f01fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020e59c700 1 -- 172.21.15.6:0/1496168109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc003570 con 0x7f01fc003a60 2023-10-06T02:17:57.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020dd9b700 1 --2- 172.21.15.6:0/1496168109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0210159400 0x7f01fc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:57.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020e59c700 1 --2- 172.21.15.6:0/1496168109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01fc003a60 0x7f01fc003e70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0208009bf0 tx=0x7f0208009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100c710b0173ef3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:57.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020d59a700 1 -- 172.21.15.6:0/1496168109 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208005a00 con 0x7f01fc003a60 2023-10-06T02:17:57.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020d59a700 1 -- 172.21.15.6:0/1496168109 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0208005b60 con 0x7f01fc003a60 2023-10-06T02:17:57.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.610+0000 7f020d59a700 1 -- 172.21.15.6:0/1496168109 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020800e6b0 con 0x7f01fc003a60 2023-10-06T02:17:57.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.611+0000 7f020f59e700 1 -- 172.21.15.6:0/1496168109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01fc003a60 msgr2=0x7f01fc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.611+0000 7f020f59e700 1 --2- 172.21.15.6:0/1496168109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01fc003a60 0x7f01fc003e70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0208009bf0 tx=0x7f0208009120 comp rx=0 tx=0).stop 2023-10-06T02:17:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.611+0000 7f020ed9d700 1 -- 172.21.15.6:0/1496168109 reap_dead start 2023-10-06T02:17:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.611+0000 7f020f59e700 1 -- 172.21.15.6:0/1496168109 shutdown_connections 2023-10-06T02:17:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.611+0000 7f020f59e700 1 -- 172.21.15.6:0/1496168109 >> 172.21.15.6:0/1496168109 conn(0x7f021006ac10 msgr2=0x7f0210068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.611+0000 7f020f59e700 1 -- 172.21.15.6:0/1496168109 shutdown_connections 2023-10-06T02:17:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.611+0000 7f020f59e700 1 -- 172.21.15.6:0/1496168109 wait complete. 2023-10-06T02:17:57.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.612+0000 7f020f59e700 1 Processor -- start 2023-10-06T02:17:57.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.612+0000 7f020f59e700 1 -- start start 2023-10-06T02:17:57.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f020f59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01fc003a60 0x7f02100c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f020f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f021016aad0 0x7f02101570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f020f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f021016af40 0x7f0210157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f020f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02100c56c0 con 0x7f021016af40 2023-10-06T02:17:57.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f020f59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021016a6a0 con 0x7f01fc003a60 2023-10-06T02:17:57.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f020f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02100c5070 con 0x7f021016aad0 2023-10-06T02:17:57.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f020ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f021016af40 0x7f0210157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f020e59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01fc003a60 0x7f02100c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f020ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f021016af40 0x7f0210157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36402/0 (socket says 172.21.15.6:36402) 2023-10-06T02:17:57.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f020ed9d700 1 -- 172.21.15.6:0/1176107978 learned_addr learned my addr 172.21.15.6:0/1176107978 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f020dd9b700 1 --2- 172.21.15.6:0/1176107978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f021016aad0 0x7f02101570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f020ed9d700 1 -- 172.21.15.6:0/1176107978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f021016aad0 msgr2=0x7f02101570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f020ed9d700 1 --2- 172.21.15.6:0/1176107978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f021016aad0 0x7f02101570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f020ed9d700 1 -- 172.21.15.6:0/1176107978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01fc003a60 msgr2=0x7f02100c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f020ed9d700 1 --2- 172.21.15.6:0/1176107978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01fc003a60 0x7f02100c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f020ed9d700 1 -- 172.21.15.6:0/1176107978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100c5350 con 0x7f021016af40 2023-10-06T02:17:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f020ed9d700 1 --2- 172.21.15.6:0/1176107978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f021016af40 0x7f0210157610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0200000f80 tx=0x7f0200002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.613+0000 7f02067fc700 1 -- 172.21.15.6:0/1176107978 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020000ac70 con 0x7f021016af40 2023-10-06T02:17:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.614+0000 7f02067fc700 1 -- 172.21.15.6:0/1176107978 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020000adf0 con 0x7f021016af40 2023-10-06T02:17:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.614+0000 7f02067fc700 1 -- 172.21.15.6:0/1176107978 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200013640 con 0x7f021016af40 2023-10-06T02:17:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.614+0000 7f020f59e700 1 -- 172.21.15.6:0/1176107978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02100c7cf0 con 0x7f021016af40 2023-10-06T02:17:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.614+0000 7f020f59e700 1 -- 172.21.15.6:0/1176107978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02100c5d10 con 0x7f021016af40 2023-10-06T02:17:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.615+0000 7f020f59e700 1 -- 172.21.15.6:0/1176107978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02100b31f0 con 0x7f021016af40 2023-10-06T02:17:57.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.615+0000 7f02067fc700 1 -- 172.21.15.6:0/1176107978 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0200013a30 con 0x7f021016af40 2023-10-06T02:17:57.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.616+0000 7f02067fc700 1 --2- 172.21.15.6:0/1176107978 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f01f0066f30 0x7f01f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:57.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.616+0000 7f02067fc700 1 -- 172.21.15.6:0/1176107978 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0200085170 con 0x7f021016af40 2023-10-06T02:17:57.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.616+0000 7f020e59c700 1 --2- 172.21.15.6:0/1176107978 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f01f0066f30 0x7f01f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:57.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.617+0000 7f020e59c700 1 --2- 172.21.15.6:0/1176107978 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f01f0066f30 0x7f01f00693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0208009160 tx=0x7f0208019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:57.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.620+0000 7f02067fc700 1 -- 172.21.15.6:0/1176107978 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0200051f90 con 0x7f021016af40 2023-10-06T02:17:57.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.810+0000 7f020f59e700 1 -- 172.21.15.6:0/1176107978 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02100c4ef0 con 0x7f01f0066f30 2023-10-06T02:17:57.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.821+0000 7f02067fc700 1 -- 172.21.15.6:0/1176107978 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367534 (secure 0 0 0) 0x7f02080095a0 con 0x7f01f0066f30 2023-10-06T02:17:57.826 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:57.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.824+0000 7f020f59e700 1 -- 172.21.15.6:0/1176107978 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f01f0066f30 msgr2=0x7f01f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:57.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.824+0000 7f020f59e700 1 --2- 172.21.15.6:0/1176107978 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f01f0066f30 0x7f01f00693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0208009160 tx=0x7f0208019000 comp rx=0 tx=0).stop 2023-10-06T02:17:57.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.824+0000 7f020f59e700 1 -- 172.21.15.6:0/1176107978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f021016af40 msgr2=0x7f0210157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:57.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.824+0000 7f020f59e700 1 --2- 172.21.15.6:0/1176107978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f021016af40 0x7f0210157610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0200000f80 tx=0x7f0200002210 comp rx=0 tx=0).stop 2023-10-06T02:17:57.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.825+0000 7f020f59e700 1 -- 172.21.15.6:0/1176107978 shutdown_connections 2023-10-06T02:17:57.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.825+0000 7f020f59e700 1 --2- 172.21.15.6:0/1176107978 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f01f0066f30 0x7f01f00693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.825+0000 7f020f59e700 1 --2- 172.21.15.6:0/1176107978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f021016af40 0x7f0210157610 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.825+0000 7f020f59e700 1 --2- 172.21.15.6:0/1176107978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01fc003a60 0x7f02100c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.825+0000 7f020f59e700 1 --2- 172.21.15.6:0/1176107978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f021016aad0 0x7f02101570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:57.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.825+0000 7f020f59e700 1 -- 172.21.15.6:0/1176107978 >> 172.21.15.6:0/1176107978 conn(0x7f021006ac10 msgr2=0x7f0210158550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:57.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.825+0000 7f020f59e700 1 -- 172.21.15.6:0/1176107978 shutdown_connections 2023-10-06T02:17:57.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.825+0000 7f020f59e700 1 -- 172.21.15.6:0/1176107978 wait complete. 2023-10-06T02:17:57.830 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:17:57.838 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-10-06T02:17:56.560647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381596,"kb_used_data":3292,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593124,"statfs":{"total":773094113280,"available":770655358976,"internally_reserved":0,"allocated":3371008,"data_stored":2059621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.532060"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031087+0000","last_change":"2023-10-06T02:17:44.012575+0000","last_active":"2023-10-06T02:17:48.031087+0000","last_peered":"2023-10-06T02:17:48.031087+0000","last_clean":"2023-10-06T02:17:48.031087+0000","last_became_active":"2023-10-06T02:17:44.012270+0000","last_became_peered":"2023-10-06T02:17:44.012270+0000","last_unstale":"2023-10-06T02:17:48.031087+0000","last_undegraded":"2023-10-06T02:17:48.031087+0000","last_fullsized":"2023-10-06T02:17:48.031087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:16.254919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.041799+0000","last_change":"2023-10-06T02:17:44.021465+0000","last_active":"2023-10-06T02:17:48.041799+0000","last_peered":"2023-10-06T02:17:48.041799+0000","last_clean":"2023-10-06T02:17:48.041799+0000","last_became_active":"2023-10-06T02:17:44.021209+0000","last_became_peered":"2023-10-06T02:17:44.021209+0000","last_unstale":"2023-10-06T02:17:48.041799+0000","last_undegraded":"2023-10-06T02:17:48.041799+0000","last_fullsized":"2023-10-06T02:17:48.041799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:41.549349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038712+0000","last_change":"2023-10-06T02:17:44.027196+0000","last_active":"2023-10-06T02:17:48.038712+0000","last_peered":"2023-10-06T02:17:48.038712+0000","last_clean":"2023-10-06T02:17:48.038712+0000","last_became_active":"2023-10-06T02:17:44.026927+0000","last_became_peered":"2023-10-06T02:17:44.026927+0000","last_unstale":"2023-10-06T02:17:48.038712+0000","last_undegraded":"2023-10-06T02:17:48.038712+0000","last_fullsized":"2023-10-06T02:17:48.038712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:15.551522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039557+0000","last_change":"2023-10-06T02:17:44.027115+0000","last_active":"2023-10-06T02:17:48.039557+0000","last_peered":"2023-10-06T02:17:48.039557+0000","last_clean":"2023-10-06T02:17:48.039557+0000","last_became_active":"2023-10-06T02:17:44.026827+0000","last_became_peered":"2023-10-06T02:17:44.026827+0000","last_unstale":"2023-10-06T02:17:48.039557+0000","last_undegraded":"2023-10-06T02:17:48.039557+0000","last_fullsized":"2023-10-06T02:17:48.039557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:32.103483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.033725+0000","last_change":"2023-10-06T02:17:44.015656+0000","last_active":"2023-10-06T02:17:48.033725+0000","last_peered":"2023-10-06T02:17:48.033725+0000","last_clean":"2023-10-06T02:17:48.033725+0000","last_became_active":"2023-10-06T02:17:44.008744+0000","last_became_peered":"2023-10-06T02:17:44.008744+0000","last_unstale":"2023-10-06T02:17:48.033725+0000","last_undegraded":"2023-10-06T02:17:48.033725+0000","last_fullsized":"2023-10-06T02:17:48.033725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037659+0000","last_change":"2023-10-06T02:17:44.027345+0000","last_active":"2023-10-06T02:17:48.037659+0000","last_peered":"2023-10-06T02:17:48.037659+0000","last_clean":"2023-10-06T02:17:48.037659+0000","last_became_active":"2023-10-06T02:17:44.027000+0000","last_became_peered":"2023-10-06T02:17:44.027000+0000","last_unstale":"2023-10-06T02:17:48.037659+0000","last_undegraded":"2023-10-06T02:17:48.037659+0000","last_fullsized":"2023-10-06T02:17:48.037659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:54.531796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037439+0000","last_change":"2023-10-06T02:17:44.013835+0000","last_active":"2023-10-06T02:17:48.037439+0000","last_peered":"2023-10-06T02:17:48.037439+0000","last_clean":"2023-10-06T02:17:48.037439+0000","last_became_active":"2023-10-06T02:17:44.013543+0000","last_became_peered":"2023-10-06T02:17:44.013543+0000","last_unstale":"2023-10-06T02:17:48.037439+0000","last_undegraded":"2023-10-06T02:17:48.037439+0000","last_fullsized":"2023-10-06T02:17:48.037439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:03.459533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036293+0000","last_change":"2023-10-06T02:17:44.016297+0000","last_active":"2023-10-06T02:17:48.036293+0000","last_peered":"2023-10-06T02:17:48.036293+0000","last_clean":"2023-10-06T02:17:48.036293+0000","last_became_active":"2023-10-06T02:17:44.016019+0000","last_became_peered":"2023-10-06T02:17:44.016019+0000","last_unstale":"2023-10-06T02:17:48.036293+0000","last_undegraded":"2023-10-06T02:17:48.036293+0000","last_fullsized":"2023-10-06T02:17:48.036293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:04.413740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030759+0000","last_change":"2023-10-06T02:17:44.017824+0000","last_active":"2023-10-06T02:17:48.030759+0000","last_peered":"2023-10-06T02:17:48.030759+0000","last_clean":"2023-10-06T02:17:48.030759+0000","last_became_active":"2023-10-06T02:17:44.017300+0000","last_became_peered":"2023-10-06T02:17:44.017300+0000","last_unstale":"2023-10-06T02:17:48.030759+0000","last_undegraded":"2023-10-06T02:17:48.030759+0000","last_fullsized":"2023-10-06T02:17:48.030759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:12.939706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.041971+0000","last_change":"2023-10-06T02:17:44.015364+0000","last_active":"2023-10-06T02:17:48.041971+0000","last_peered":"2023-10-06T02:17:48.041971+0000","last_clean":"2023-10-06T02:17:48.041971+0000","last_became_active":"2023-10-06T02:17:44.009665+0000","last_became_peered":"2023-10-06T02:17:44.009665+0000","last_unstale":"2023-10-06T02:17:48.041971+0000","last_undegraded":"2023-10-06T02:17:48.041971+0000","last_fullsized":"2023-10-06T02:17:48.041971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:12.022239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038636+0000","last_change":"2023-10-06T02:17:44.015097+0000","last_active":"2023-10-06T02:17:48.038636+0000","last_peered":"2023-10-06T02:17:48.038636+0000","last_clean":"2023-10-06T02:17:48.038636+0000","last_became_active":"2023-10-06T02:17:44.014831+0000","last_became_peered":"2023-10-06T02:17:44.014831+0000","last_unstale":"2023-10-06T02:17:48.038636+0000","last_undegraded":"2023-10-06T02:17:48.038636+0000","last_fullsized":"2023-10-06T02:17:48.038636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:00.943603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031356+0000","last_change":"2023-10-06T02:17:44.015300+0000","last_active":"2023-10-06T02:17:48.031356+0000","last_peered":"2023-10-06T02:17:48.031356+0000","last_clean":"2023-10-06T02:17:48.031356+0000","last_became_active":"2023-10-06T02:17:44.015015+0000","last_became_peered":"2023-10-06T02:17:44.015015+0000","last_unstale":"2023-10-06T02:17:48.031356+0000","last_undegraded":"2023-10-06T02:17:48.031356+0000","last_fullsized":"2023-10-06T02:17:48.031356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:30.550259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030945+0000","last_change":"2023-10-06T02:17:44.009268+0000","last_active":"2023-10-06T02:17:48.030945+0000","last_peered":"2023-10-06T02:17:48.030945+0000","last_clean":"2023-10-06T02:17:48.030945+0000","last_became_active":"2023-10-06T02:17:44.008958+0000","last_became_peered":"2023-10-06T02:17:44.008958+0000","last_unstale":"2023-10-06T02:17:48.030945+0000","last_undegraded":"2023-10-06T02:17:48.030945+0000","last_fullsized":"2023-10-06T02:17:48.030945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:35.516151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037800+0000","last_change":"2023-10-06T02:17:44.015486+0000","last_active":"2023-10-06T02:17:48.037800+0000","last_peered":"2023-10-06T02:17:48.037800+0000","last_clean":"2023-10-06T02:17:48.037800+0000","last_became_active":"2023-10-06T02:17:44.009594+0000","last_became_peered":"2023-10-06T02:17:44.009594+0000","last_unstale":"2023-10-06T02:17:48.037800+0000","last_undegraded":"2023-10-06T02:17:48.037800+0000","last_fullsized":"2023-10-06T02:17:48.037800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:14.067335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.035580+0000","last_change":"2023-10-06T02:17:44.014327+0000","last_active":"2023-10-06T02:17:48.035580+0000","last_peered":"2023-10-06T02:17:48.035580+0000","last_clean":"2023-10-06T02:17:48.035580+0000","last_became_active":"2023-10-06T02:17:44.014076+0000","last_became_peered":"2023-10-06T02:17:44.014076+0000","last_unstale":"2023-10-06T02:17:48.035580+0000","last_undegraded":"2023-10-06T02:17:48.035580+0000","last_fullsized":"2023-10-06T02:17:48.035580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:41.549349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036877+0000","last_change":"2023-10-06T02:17:44.022392+0000","last_active":"2023-10-06T02:17:48.036877+0000","last_peered":"2023-10-06T02:17:48.036877+0000","last_clean":"2023-10-06T02:17:48.036877+0000","last_became_active":"2023-10-06T02:17:44.022145+0000","last_became_peered":"2023-10-06T02:17:44.022145+0000","last_unstale":"2023-10-06T02:17:48.036877+0000","last_undegraded":"2023-10-06T02:17:48.036877+0000","last_fullsized":"2023-10-06T02:17:48.036877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:29.729845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030860+0000","last_change":"2023-10-06T02:17:44.018022+0000","last_active":"2023-10-06T02:17:48.030860+0000","last_peered":"2023-10-06T02:17:48.030860+0000","last_clean":"2023-10-06T02:17:48.030860+0000","last_became_active":"2023-10-06T02:17:44.017617+0000","last_became_peered":"2023-10-06T02:17:44.017617+0000","last_unstale":"2023-10-06T02:17:48.030860+0000","last_undegraded":"2023-10-06T02:17:48.030860+0000","last_fullsized":"2023-10-06T02:17:48.030860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.500461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.044943+0000","last_change":"2023-10-06T02:17:44.014002+0000","last_active":"2023-10-06T02:17:48.044943+0000","last_peered":"2023-10-06T02:17:48.044943+0000","last_clean":"2023-10-06T02:17:48.044943+0000","last_became_active":"2023-10-06T02:17:44.013756+0000","last_became_peered":"2023-10-06T02:17:44.013756+0000","last_unstale":"2023-10-06T02:17:48.044943+0000","last_undegraded":"2023-10-06T02:17:48.044943+0000","last_fullsized":"2023-10-06T02:17:48.044943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:05.747241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031920+0000","last_change":"2023-10-06T02:17:44.013965+0000","last_active":"2023-10-06T02:17:48.031920+0000","last_peered":"2023-10-06T02:17:48.031920+0000","last_clean":"2023-10-06T02:17:48.031920+0000","last_became_active":"2023-10-06T02:17:44.013512+0000","last_became_peered":"2023-10-06T02:17:44.013512+0000","last_unstale":"2023-10-06T02:17:48.031920+0000","last_undegraded":"2023-10-06T02:17:48.031920+0000","last_fullsized":"2023-10-06T02:17:48.031920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:00.061174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040168+0000","last_change":"2023-10-06T02:17:44.021614+0000","last_active":"2023-10-06T02:17:48.040168+0000","last_peered":"2023-10-06T02:17:48.040168+0000","last_clean":"2023-10-06T02:17:48.040168+0000","last_became_active":"2023-10-06T02:17:44.021377+0000","last_became_peered":"2023-10-06T02:17:44.021377+0000","last_unstale":"2023-10-06T02:17:48.040168+0000","last_undegraded":"2023-10-06T02:17:48.040168+0000","last_fullsized":"2023-10-06T02:17:48.040168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:39.014780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040828+0000","last_change":"2023-10-06T02:17:44.018105+0000","last_active":"2023-10-06T02:17:48.040828+0000","last_peered":"2023-10-06T02:17:48.040828+0000","last_clean":"2023-10-06T02:17:48.040828+0000","last_became_active":"2023-10-06T02:17:44.017812+0000","last_became_peered":"2023-10-06T02:17:44.017812+0000","last_unstale":"2023-10-06T02:17:48.040828+0000","last_undegraded":"2023-10-06T02:17:48.040828+0000","last_fullsized":"2023-10-06T02:17:48.040828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030387+0000","last_change":"2023-10-06T02:17:44.016308+0000","last_active":"2023-10-06T02:17:48.030387+0000","last_peered":"2023-10-06T02:17:48.030387+0000","last_clean":"2023-10-06T02:17:48.030387+0000","last_became_active":"2023-10-06T02:17:44.016107+0000","last_became_peered":"2023-10-06T02:17:44.016107+0000","last_unstale":"2023-10-06T02:17:48.030387+0000","last_undegraded":"2023-10-06T02:17:48.030387+0000","last_fullsized":"2023-10-06T02:17:48.030387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:43.352906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.032262+0000","last_change":"2023-10-06T02:17:44.026872+0000","last_active":"2023-10-06T02:17:48.032262+0000","last_peered":"2023-10-06T02:17:48.032262+0000","last_clean":"2023-10-06T02:17:48.032262+0000","last_became_active":"2023-10-06T02:17:44.026595+0000","last_became_peered":"2023-10-06T02:17:44.026595+0000","last_unstale":"2023-10-06T02:17:48.032262+0000","last_undegraded":"2023-10-06T02:17:48.032262+0000","last_fullsized":"2023-10-06T02:17:48.032262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:54.531796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036348+0000","last_change":"2023-10-06T02:17:44.009432+0000","last_active":"2023-10-06T02:17:48.036348+0000","last_peered":"2023-10-06T02:17:48.036348+0000","last_clean":"2023-10-06T02:17:48.036348+0000","last_became_active":"2023-10-06T02:17:44.009157+0000","last_became_peered":"2023-10-06T02:17:44.009157+0000","last_unstale":"2023-10-06T02:17:48.036348+0000","last_undegraded":"2023-10-06T02:17:48.036348+0000","last_fullsized":"2023-10-06T02:17:48.036348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.500461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050398+0000","last_change":"2023-10-06T02:17:44.020561+0000","last_active":"2023-10-06T02:17:48.050398+0000","last_peered":"2023-10-06T02:17:48.050398+0000","last_clean":"2023-10-06T02:17:48.050398+0000","last_became_active":"2023-10-06T02:17:44.020324+0000","last_became_peered":"2023-10-06T02:17:44.020324+0000","last_unstale":"2023-10-06T02:17:48.050398+0000","last_undegraded":"2023-10-06T02:17:48.050398+0000","last_fullsized":"2023-10-06T02:17:48.050398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:03.459533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050774+0000","last_change":"2023-10-06T02:17:44.009977+0000","last_active":"2023-10-06T02:17:48.050774+0000","last_peered":"2023-10-06T02:17:48.050774+0000","last_clean":"2023-10-06T02:17:48.050774+0000","last_became_active":"2023-10-06T02:17:44.009383+0000","last_became_peered":"2023-10-06T02:17:44.009383+0000","last_unstale":"2023-10-06T02:17:48.050774+0000","last_undegraded":"2023-10-06T02:17:48.050774+0000","last_fullsized":"2023-10-06T02:17:48.050774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:14.067335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040285+0000","last_change":"2023-10-06T02:17:44.022518+0000","last_active":"2023-10-06T02:17:48.040285+0000","last_peered":"2023-10-06T02:17:48.040285+0000","last_clean":"2023-10-06T02:17:48.040285+0000","last_became_active":"2023-10-06T02:17:44.022094+0000","last_became_peered":"2023-10-06T02:17:44.022094+0000","last_unstale":"2023-10-06T02:17:48.040285+0000","last_undegraded":"2023-10-06T02:17:48.040285+0000","last_fullsized":"2023-10-06T02:17:48.040285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.500461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.063071+0000","last_change":"2023-10-06T02:17:48.060017+0000","last_active":"2023-10-06T02:17:48.063071+0000","last_peered":"2023-10-06T02:17:48.063071+0000","last_clean":"2023-10-06T02:17:48.063071+0000","last_became_active":"2023-10-06T02:17:48.059609+0000","last_became_peered":"2023-10-06T02:17:48.059609+0000","last_unstale":"2023-10-06T02:17:48.063071+0000","last_undegraded":"2023-10-06T02:17:48.063071+0000","last_fullsized":"2023-10-06T02:17:48.063071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:46.132017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037608+0000","last_change":"2023-10-06T02:17:43.010345+0000","last_active":"2023-10-06T02:17:48.037608+0000","last_peered":"2023-10-06T02:17:48.037608+0000","last_clean":"2023-10-06T02:17:48.037608+0000","last_became_active":"2023-10-06T02:17:43.006363+0000","last_became_peered":"2023-10-06T02:17:43.006363+0000","last_unstale":"2023-10-06T02:17:48.037608+0000","last_undegraded":"2023-10-06T02:17:48.037608+0000","last_fullsized":"2023-10-06T02:17:48.037608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030384+0000","last_change":"2023-10-06T02:17:44.017786+0000","last_active":"2023-10-06T02:17:48.030384+0000","last_peered":"2023-10-06T02:17:48.030384+0000","last_clean":"2023-10-06T02:17:48.030384+0000","last_became_active":"2023-10-06T02:17:44.016986+0000","last_became_peered":"2023-10-06T02:17:44.016986+0000","last_unstale":"2023-10-06T02:17:48.030384+0000","last_undegraded":"2023-10-06T02:17:48.030384+0000","last_fullsized":"2023-10-06T02:17:48.030384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:49.992736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.053196+0000","last_change":"2023-10-06T02:17:48.051657+0000","last_active":"2023-10-06T02:17:48.053196+0000","last_peered":"2023-10-06T02:17:48.053196+0000","last_clean":"2023-10-06T02:17:48.053196+0000","last_became_active":"2023-10-06T02:17:48.051307+0000","last_became_peered":"2023-10-06T02:17:48.051307+0000","last_unstale":"2023-10-06T02:17:48.053196+0000","last_undegraded":"2023-10-06T02:17:48.053196+0000","last_fullsized":"2023-10-06T02:17:48.053196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:09.781175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045264+0000","last_change":"2023-10-06T02:17:43.002992+0000","last_active":"2023-10-06T02:17:48.045264+0000","last_peered":"2023-10-06T02:17:48.045264+0000","last_clean":"2023-10-06T02:17:48.045264+0000","last_became_active":"2023-10-06T02:17:43.002502+0000","last_became_peered":"2023-10-06T02:17:43.002502+0000","last_unstale":"2023-10-06T02:17:48.045264+0000","last_undegraded":"2023-10-06T02:17:48.045264+0000","last_fullsized":"2023-10-06T02:17:48.045264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031835+0000","last_change":"2023-10-06T02:17:44.021171+0000","last_active":"2023-10-06T02:17:48.031835+0000","last_peered":"2023-10-06T02:17:48.031835+0000","last_clean":"2023-10-06T02:17:48.031835+0000","last_became_active":"2023-10-06T02:17:44.016443+0000","last_became_peered":"2023-10-06T02:17:44.016443+0000","last_unstale":"2023-10-06T02:17:48.031835+0000","last_undegraded":"2023-10-06T02:17:48.031835+0000","last_fullsized":"2023-10-06T02:17:48.031835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:49.992736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.059150+0000","last_change":"2023-10-06T02:17:48.053835+0000","last_active":"2023-10-06T02:17:48.059150+0000","last_peered":"2023-10-06T02:17:48.059150+0000","last_clean":"2023-10-06T02:17:48.059150+0000","last_became_active":"2023-10-06T02:17:48.053399+0000","last_became_peered":"2023-10-06T02:17:48.053399+0000","last_unstale":"2023-10-06T02:17:48.059150+0000","last_undegraded":"2023-10-06T02:17:48.059150+0000","last_fullsized":"2023-10-06T02:17:48.059150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:20.633926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031624+0000","last_change":"2023-10-06T02:17:43.005151+0000","last_active":"2023-10-06T02:17:48.031624+0000","last_peered":"2023-10-06T02:17:48.031624+0000","last_clean":"2023-10-06T02:17:48.031624+0000","last_became_active":"2023-10-06T02:17:43.004709+0000","last_became_peered":"2023-10-06T02:17:43.004709+0000","last_unstale":"2023-10-06T02:17:48.031624+0000","last_undegraded":"2023-10-06T02:17:48.031624+0000","last_fullsized":"2023-10-06T02:17:48.031624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:32.002499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039892+0000","last_change":"2023-10-06T02:17:44.025569+0000","last_active":"2023-10-06T02:17:48.039892+0000","last_peered":"2023-10-06T02:17:48.039892+0000","last_clean":"2023-10-06T02:17:48.039892+0000","last_became_active":"2023-10-06T02:17:44.025261+0000","last_became_peered":"2023-10-06T02:17:44.025261+0000","last_unstale":"2023-10-06T02:17:48.039892+0000","last_undegraded":"2023-10-06T02:17:48.039892+0000","last_fullsized":"2023-10-06T02:17:48.039892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:47.847314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.053261+0000","last_change":"2023-10-06T02:17:48.052637+0000","last_active":"2023-10-06T02:17:48.053261+0000","last_peered":"2023-10-06T02:17:48.053261+0000","last_clean":"2023-10-06T02:17:48.053261+0000","last_became_active":"2023-10-06T02:17:48.052223+0000","last_became_peered":"2023-10-06T02:17:48.052223+0000","last_unstale":"2023-10-06T02:17:48.053261+0000","last_undegraded":"2023-10-06T02:17:48.053261+0000","last_fullsized":"2023-10-06T02:17:48.053261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:33.763779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030951+0000","last_change":"2023-10-06T02:17:43.013718+0000","last_active":"2023-10-06T02:17:48.030951+0000","last_peered":"2023-10-06T02:17:48.030951+0000","last_clean":"2023-10-06T02:17:48.030951+0000","last_became_active":"2023-10-06T02:17:43.013415+0000","last_became_peered":"2023-10-06T02:17:43.013415+0000","last_unstale":"2023-10-06T02:17:48.030951+0000","last_undegraded":"2023-10-06T02:17:48.030951+0000","last_fullsized":"2023-10-06T02:17:48.030951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:59.054001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031512+0000","last_change":"2023-10-06T02:17:44.011855+0000","last_active":"2023-10-06T02:17:48.031512+0000","last_peered":"2023-10-06T02:17:48.031512+0000","last_clean":"2023-10-06T02:17:48.031512+0000","last_became_active":"2023-10-06T02:17:44.011583+0000","last_became_peered":"2023-10-06T02:17:44.011583+0000","last_unstale":"2023-10-06T02:17:48.031512+0000","last_undegraded":"2023-10-06T02:17:48.031512+0000","last_fullsized":"2023-10-06T02:17:48.031512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:01.914117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060333+0000","last_change":"2023-10-06T02:17:48.057256+0000","last_active":"2023-10-06T02:17:48.060333+0000","last_peered":"2023-10-06T02:17:48.060333+0000","last_clean":"2023-10-06T02:17:48.060333+0000","last_became_active":"2023-10-06T02:17:48.056749+0000","last_became_peered":"2023-10-06T02:17:48.056749+0000","last_unstale":"2023-10-06T02:17:48.060333+0000","last_undegraded":"2023-10-06T02:17:48.060333+0000","last_fullsized":"2023-10-06T02:17:48.060333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:29.446681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.041892+0000","last_change":"2023-10-06T02:17:43.013316+0000","last_active":"2023-10-06T02:17:48.041892+0000","last_peered":"2023-10-06T02:17:48.041892+0000","last_clean":"2023-10-06T02:17:48.041892+0000","last_became_active":"2023-10-06T02:17:43.013020+0000","last_became_peered":"2023-10-06T02:17:43.013020+0000","last_unstale":"2023-10-06T02:17:48.041892+0000","last_undegraded":"2023-10-06T02:17:48.041892+0000","last_fullsized":"2023-10-06T02:17:48.041892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:55.863203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030030+0000","last_change":"2023-10-06T02:17:44.017554+0000","last_active":"2023-10-06T02:17:48.030030+0000","last_peered":"2023-10-06T02:17:48.030030+0000","last_clean":"2023-10-06T02:17:48.030030+0000","last_became_active":"2023-10-06T02:17:44.017288+0000","last_became_peered":"2023-10-06T02:17:44.017288+0000","last_unstale":"2023-10-06T02:17:48.030030+0000","last_undegraded":"2023-10-06T02:17:48.030030+0000","last_fullsized":"2023-10-06T02:17:48.030030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:12.939706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050983+0000","last_change":"2023-10-06T02:17:48.049234+0000","last_active":"2023-10-06T02:17:48.050983+0000","last_peered":"2023-10-06T02:17:48.050983+0000","last_clean":"2023-10-06T02:17:48.050983+0000","last_became_active":"2023-10-06T02:17:48.048823+0000","last_became_peered":"2023-10-06T02:17:48.048823+0000","last_unstale":"2023-10-06T02:17:48.050983+0000","last_undegraded":"2023-10-06T02:17:48.050983+0000","last_fullsized":"2023-10-06T02:17:48.050983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:23.461660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036812+0000","last_change":"2023-10-06T02:17:43.012321+0000","last_active":"2023-10-06T02:17:48.036812+0000","last_peered":"2023-10-06T02:17:48.036812+0000","last_clean":"2023-10-06T02:17:48.036812+0000","last_became_active":"2023-10-06T02:17:43.012039+0000","last_became_peered":"2023-10-06T02:17:43.012039+0000","last_unstale":"2023-10-06T02:17:48.036812+0000","last_undegraded":"2023-10-06T02:17:48.036812+0000","last_fullsized":"2023-10-06T02:17:48.036812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:56.588125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.046506+0000","last_change":"2023-10-06T02:17:44.019691+0000","last_active":"2023-10-06T02:17:48.046506+0000","last_peered":"2023-10-06T02:17:48.046506+0000","last_clean":"2023-10-06T02:17:48.046506+0000","last_became_active":"2023-10-06T02:17:44.018879+0000","last_became_peered":"2023-10-06T02:17:44.018879+0000","last_unstale":"2023-10-06T02:17:48.046506+0000","last_undegraded":"2023-10-06T02:17:48.046506+0000","last_fullsized":"2023-10-06T02:17:48.046506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:22.411698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.061948+0000","last_change":"2023-10-06T02:17:48.060182+0000","last_active":"2023-10-06T02:17:48.061948+0000","last_peered":"2023-10-06T02:17:48.061948+0000","last_clean":"2023-10-06T02:17:48.061948+0000","last_became_active":"2023-10-06T02:17:48.058134+0000","last_became_peered":"2023-10-06T02:17:48.058134+0000","last_unstale":"2023-10-06T02:17:48.061948+0000","last_undegraded":"2023-10-06T02:17:48.061948+0000","last_fullsized":"2023-10-06T02:17:48.061948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:40.330578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T02:17:53.898409+0000","last_change":"2023-10-06T02:17:43.011660+0000","last_active":"2023-10-06T02:17:53.898409+0000","last_peered":"2023-10-06T02:17:53.898409+0000","last_clean":"2023-10-06T02:17:53.898409+0000","last_became_active":"2023-10-06T02:17:43.011360+0000","last_became_peered":"2023-10-06T02:17:43.011360+0000","last_unstale":"2023-10-06T02:17:53.898409+0000","last_undegraded":"2023-10-06T02:17:53.898409+0000","last_fullsized":"2023-10-06T02:17:53.898409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:34.508977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039053+0000","last_change":"2023-10-06T02:17:44.019835+0000","last_active":"2023-10-06T02:17:48.039053+0000","last_peered":"2023-10-06T02:17:48.039053+0000","last_clean":"2023-10-06T02:17:48.039053+0000","last_became_active":"2023-10-06T02:17:44.019567+0000","last_became_peered":"2023-10-06T02:17:44.019567+0000","last_unstale":"2023-10-06T02:17:48.039053+0000","last_undegraded":"2023-10-06T02:17:48.039053+0000","last_fullsized":"2023-10-06T02:17:48.039053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:36.296644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060685+0000","last_change":"2023-10-06T02:17:48.058253+0000","last_active":"2023-10-06T02:17:48.060685+0000","last_peered":"2023-10-06T02:17:48.060685+0000","last_clean":"2023-10-06T02:17:48.060685+0000","last_became_active":"2023-10-06T02:17:48.057801+0000","last_became_peered":"2023-10-06T02:17:48.057801+0000","last_unstale":"2023-10-06T02:17:48.060685+0000","last_undegraded":"2023-10-06T02:17:48.060685+0000","last_fullsized":"2023-10-06T02:17:48.060685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:34.306615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036359+0000","last_change":"2023-10-06T02:17:43.014116+0000","last_active":"2023-10-06T02:17:48.036359+0000","last_peered":"2023-10-06T02:17:48.036359+0000","last_clean":"2023-10-06T02:17:48.036359+0000","last_became_active":"2023-10-06T02:17:43.013686+0000","last_became_peered":"2023-10-06T02:17:43.013686+0000","last_unstale":"2023-10-06T02:17:48.036359+0000","last_undegraded":"2023-10-06T02:17:48.036359+0000","last_fullsized":"2023-10-06T02:17:48.036359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:42.345733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030529+0000","last_change":"2023-10-06T02:17:44.023536+0000","last_active":"2023-10-06T02:17:48.030529+0000","last_peered":"2023-10-06T02:17:48.030529+0000","last_clean":"2023-10-06T02:17:48.030529+0000","last_became_active":"2023-10-06T02:17:44.023272+0000","last_became_peered":"2023-10-06T02:17:44.023272+0000","last_unstale":"2023-10-06T02:17:48.030529+0000","last_undegraded":"2023-10-06T02:17:48.030529+0000","last_fullsized":"2023-10-06T02:17:48.030529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:47.126256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.052236+0000","last_change":"2023-10-06T02:17:48.049593+0000","last_active":"2023-10-06T02:17:48.052236+0000","last_peered":"2023-10-06T02:17:48.052236+0000","last_clean":"2023-10-06T02:17:48.052236+0000","last_became_active":"2023-10-06T02:17:48.048578+0000","last_became_peered":"2023-10-06T02:17:48.048578+0000","last_unstale":"2023-10-06T02:17:48.052236+0000","last_undegraded":"2023-10-06T02:17:48.052236+0000","last_fullsized":"2023-10-06T02:17:48.052236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:56.628094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030542+0000","last_change":"2023-10-06T02:17:43.010082+0000","last_active":"2023-10-06T02:17:48.030542+0000","last_peered":"2023-10-06T02:17:48.030542+0000","last_clean":"2023-10-06T02:17:48.030542+0000","last_became_active":"2023-10-06T02:17:43.009750+0000","last_became_peered":"2023-10-06T02:17:43.009750+0000","last_unstale":"2023-10-06T02:17:48.030542+0000","last_undegraded":"2023-10-06T02:17:48.030542+0000","last_fullsized":"2023-10-06T02:17:48.030542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040202+0000","last_change":"2023-10-06T02:17:44.022344+0000","last_active":"2023-10-06T02:17:48.040202+0000","last_peered":"2023-10-06T02:17:48.040202+0000","last_clean":"2023-10-06T02:17:48.040202+0000","last_became_active":"2023-10-06T02:17:44.021817+0000","last_became_peered":"2023-10-06T02:17:44.021817+0000","last_unstale":"2023-10-06T02:17:48.040202+0000","last_undegraded":"2023-10-06T02:17:48.040202+0000","last_fullsized":"2023-10-06T02:17:48.040202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.051438+0000","last_change":"2023-10-06T02:17:48.050036+0000","last_active":"2023-10-06T02:17:48.051438+0000","last_peered":"2023-10-06T02:17:48.051438+0000","last_clean":"2023-10-06T02:17:48.051438+0000","last_became_active":"2023-10-06T02:17:48.049595+0000","last_became_peered":"2023-10-06T02:17:48.049595+0000","last_unstale":"2023-10-06T02:17:48.051438+0000","last_undegraded":"2023-10-06T02:17:48.051438+0000","last_fullsized":"2023-10-06T02:17:48.051438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:09:38.509689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037346+0000","last_change":"2023-10-06T02:17:43.014038+0000","last_active":"2023-10-06T02:17:48.037346+0000","last_peered":"2023-10-06T02:17:48.037346+0000","last_clean":"2023-10-06T02:17:48.037346+0000","last_became_active":"2023-10-06T02:17:43.013419+0000","last_became_peered":"2023-10-06T02:17:43.013419+0000","last_unstale":"2023-10-06T02:17:48.037346+0000","last_undegraded":"2023-10-06T02:17:48.037346+0000","last_fullsized":"2023-10-06T02:17:48.037346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:46.840141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.032077+0000","last_change":"2023-10-06T02:17:44.015494+0000","last_active":"2023-10-06T02:17:48.032077+0000","last_peered":"2023-10-06T02:17:48.032077+0000","last_clean":"2023-10-06T02:17:48.032077+0000","last_became_active":"2023-10-06T02:17:44.012435+0000","last_became_peered":"2023-10-06T02:17:44.012435+0000","last_unstale":"2023-10-06T02:17:48.032077+0000","last_undegraded":"2023-10-06T02:17:48.032077+0000","last_fullsized":"2023-10-06T02:17:48.032077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:03.459533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060832+0000","last_change":"2023-10-06T02:17:48.056039+0000","last_active":"2023-10-06T02:17:48.060832+0000","last_peered":"2023-10-06T02:17:48.060832+0000","last_clean":"2023-10-06T02:17:48.060832+0000","last_became_active":"2023-10-06T02:17:48.055610+0000","last_became_peered":"2023-10-06T02:17:48.055610+0000","last_unstale":"2023-10-06T02:17:48.060832+0000","last_undegraded":"2023-10-06T02:17:48.060832+0000","last_fullsized":"2023-10-06T02:17:48.060832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:05.386590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039054+0000","last_change":"2023-10-06T02:17:43.009311+0000","last_active":"2023-10-06T02:17:48.039054+0000","last_peered":"2023-10-06T02:17:48.039054+0000","last_clean":"2023-10-06T02:17:48.039054+0000","last_became_active":"2023-10-06T02:17:43.009019+0000","last_became_peered":"2023-10-06T02:17:43.009019+0000","last_unstale":"2023-10-06T02:17:48.039054+0000","last_undegraded":"2023-10-06T02:17:48.039054+0000","last_fullsized":"2023-10-06T02:17:48.039054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:34.508977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031131+0000","last_change":"2023-10-06T02:17:44.022053+0000","last_active":"2023-10-06T02:17:48.031131+0000","last_peered":"2023-10-06T02:17:48.031131+0000","last_clean":"2023-10-06T02:17:48.031131+0000","last_became_active":"2023-10-06T02:17:44.021420+0000","last_became_peered":"2023-10-06T02:17:44.021420+0000","last_unstale":"2023-10-06T02:17:48.031131+0000","last_undegraded":"2023-10-06T02:17:48.031131+0000","last_fullsized":"2023-10-06T02:17:48.031131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:03.459533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060798+0000","last_change":"2023-10-06T02:17:48.058632+0000","last_active":"2023-10-06T02:17:48.060798+0000","last_peered":"2023-10-06T02:17:48.060798+0000","last_clean":"2023-10-06T02:17:48.060798+0000","last_became_active":"2023-10-06T02:17:48.056462+0000","last_became_peered":"2023-10-06T02:17:48.056462+0000","last_unstale":"2023-10-06T02:17:48.060798+0000","last_undegraded":"2023-10-06T02:17:48.060798+0000","last_fullsized":"2023-10-06T02:17:48.060798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:19.585456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037962+0000","last_change":"2023-10-06T02:17:43.014971+0000","last_active":"2023-10-06T02:17:48.037962+0000","last_peered":"2023-10-06T02:17:48.037962+0000","last_clean":"2023-10-06T02:17:48.037962+0000","last_became_active":"2023-10-06T02:17:43.014645+0000","last_became_peered":"2023-10-06T02:17:43.014645+0000","last_unstale":"2023-10-06T02:17:48.037962+0000","last_undegraded":"2023-10-06T02:17:48.037962+0000","last_fullsized":"2023-10-06T02:17:48.037962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:31.096309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036178+0000","last_change":"2023-10-06T02:17:44.017176+0000","last_active":"2023-10-06T02:17:48.036178+0000","last_peered":"2023-10-06T02:17:48.036178+0000","last_clean":"2023-10-06T02:17:48.036178+0000","last_became_active":"2023-10-06T02:17:44.016900+0000","last_became_peered":"2023-10-06T02:17:44.016900+0000","last_unstale":"2023-10-06T02:17:48.036178+0000","last_undegraded":"2023-10-06T02:17:48.036178+0000","last_fullsized":"2023-10-06T02:17:48.036178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:21.073260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.058961+0000","last_change":"2023-10-06T02:17:48.056709+0000","last_active":"2023-10-06T02:17:48.058961+0000","last_peered":"2023-10-06T02:17:48.058961+0000","last_clean":"2023-10-06T02:17:48.058961+0000","last_became_active":"2023-10-06T02:17:48.056245+0000","last_became_peered":"2023-10-06T02:17:48.056245+0000","last_unstale":"2023-10-06T02:17:48.058961+0000","last_undegraded":"2023-10-06T02:17:48.058961+0000","last_fullsized":"2023-10-06T02:17:48.058961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:58.565730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038561+0000","last_change":"2023-10-06T02:17:43.015636+0000","last_active":"2023-10-06T02:17:48.038561+0000","last_peered":"2023-10-06T02:17:48.038561+0000","last_clean":"2023-10-06T02:17:48.038561+0000","last_became_active":"2023-10-06T02:17:43.013756+0000","last_became_peered":"2023-10-06T02:17:43.013756+0000","last_unstale":"2023-10-06T02:17:48.038561+0000","last_undegraded":"2023-10-06T02:17:48.038561+0000","last_fullsized":"2023-10-06T02:17:48.038561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:21.985046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045110+0000","last_change":"2023-10-06T02:17:44.019216+0000","last_active":"2023-10-06T02:17:48.045110+0000","last_peered":"2023-10-06T02:17:48.045110+0000","last_clean":"2023-10-06T02:17:48.045110+0000","last_became_active":"2023-10-06T02:17:44.018743+0000","last_became_peered":"2023-10-06T02:17:44.018743+0000","last_unstale":"2023-10-06T02:17:48.045110+0000","last_undegraded":"2023-10-06T02:17:48.045110+0000","last_fullsized":"2023-10-06T02:17:48.045110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:47.126256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.049041+0000","last_change":"2023-10-06T02:17:48.047120+0000","last_active":"2023-10-06T02:17:48.049041+0000","last_peered":"2023-10-06T02:17:48.049041+0000","last_clean":"2023-10-06T02:17:48.049041+0000","last_became_active":"2023-10-06T02:17:48.046716+0000","last_became_peered":"2023-10-06T02:17:48.046716+0000","last_unstale":"2023-10-06T02:17:48.049041+0000","last_undegraded":"2023-10-06T02:17:48.049041+0000","last_fullsized":"2023-10-06T02:17:48.049041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:01.000290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036700+0000","last_change":"2023-10-06T02:17:43.014454+0000","last_active":"2023-10-06T02:17:48.036700+0000","last_peered":"2023-10-06T02:17:48.036700+0000","last_clean":"2023-10-06T02:17:48.036700+0000","last_became_active":"2023-10-06T02:17:43.014185+0000","last_became_peered":"2023-10-06T02:17:43.014185+0000","last_unstale":"2023-10-06T02:17:48.036700+0000","last_undegraded":"2023-10-06T02:17:48.036700+0000","last_fullsized":"2023-10-06T02:17:48.036700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:32.002499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037390+0000","last_change":"2023-10-06T02:17:44.021996+0000","last_active":"2023-10-06T02:17:48.037390+0000","last_peered":"2023-10-06T02:17:48.037390+0000","last_clean":"2023-10-06T02:17:48.037390+0000","last_became_active":"2023-10-06T02:17:44.020844+0000","last_became_peered":"2023-10-06T02:17:44.020844+0000","last_unstale":"2023-10-06T02:17:48.037390+0000","last_undegraded":"2023-10-06T02:17:48.037390+0000","last_fullsized":"2023-10-06T02:17:48.037390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:04.413740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.059287+0000","last_change":"2023-10-06T02:17:48.052318+0000","last_active":"2023-10-06T02:17:48.059287+0000","last_peered":"2023-10-06T02:17:48.059287+0000","last_clean":"2023-10-06T02:17:48.059287+0000","last_became_active":"2023-10-06T02:17:48.051887+0000","last_became_peered":"2023-10-06T02:17:48.051887+0000","last_unstale":"2023-10-06T02:17:48.059287+0000","last_undegraded":"2023-10-06T02:17:48.059287+0000","last_fullsized":"2023-10-06T02:17:48.059287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:54.026670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039797+0000","last_change":"2023-10-06T02:17:43.017227+0000","last_active":"2023-10-06T02:17:48.039797+0000","last_peered":"2023-10-06T02:17:48.039797+0000","last_clean":"2023-10-06T02:17:48.039797+0000","last_became_active":"2023-10-06T02:17:43.016966+0000","last_became_peered":"2023-10-06T02:17:43.016966+0000","last_unstale":"2023-10-06T02:17:48.039797+0000","last_undegraded":"2023-10-06T02:17:48.039797+0000","last_fullsized":"2023-10-06T02:17:48.039797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.033379+0000","last_change":"2023-10-06T02:17:44.003483+0000","last_active":"2023-10-06T02:17:48.033379+0000","last_peered":"2023-10-06T02:17:48.033379+0000","last_clean":"2023-10-06T02:17:48.033379+0000","last_became_active":"2023-10-06T02:17:44.003206+0000","last_became_peered":"2023-10-06T02:17:44.003206+0000","last_unstale":"2023-10-06T02:17:48.033379+0000","last_undegraded":"2023-10-06T02:17:48.033379+0000","last_fullsized":"2023-10-06T02:17:48.033379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:41.549349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.053844+0000","last_change":"2023-10-06T02:17:48.048415+0000","last_active":"2023-10-06T02:17:48.053844+0000","last_peered":"2023-10-06T02:17:48.053844+0000","last_clean":"2023-10-06T02:17:48.053844+0000","last_became_active":"2023-10-06T02:17:48.048056+0000","last_became_peered":"2023-10-06T02:17:48.048056+0000","last_unstale":"2023-10-06T02:17:48.053844+0000","last_undegraded":"2023-10-06T02:17:48.053844+0000","last_fullsized":"2023-10-06T02:17:48.053844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:09.781175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030566+0000","last_change":"2023-10-06T02:17:43.012134+0000","last_active":"2023-10-06T02:17:48.030566+0000","last_peered":"2023-10-06T02:17:48.030566+0000","last_clean":"2023-10-06T02:17:48.030566+0000","last_became_active":"2023-10-06T02:17:43.011834+0000","last_became_peered":"2023-10-06T02:17:43.011834+0000","last_unstale":"2023-10-06T02:17:48.030566+0000","last_undegraded":"2023-10-06T02:17:48.030566+0000","last_fullsized":"2023-10-06T02:17:48.030566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.543085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039990+0000","last_change":"2023-10-06T02:17:44.024658+0000","last_active":"2023-10-06T02:17:48.039990+0000","last_peered":"2023-10-06T02:17:48.039990+0000","last_clean":"2023-10-06T02:17:48.039990+0000","last_became_active":"2023-10-06T02:17:44.023854+0000","last_became_peered":"2023-10-06T02:17:44.023854+0000","last_unstale":"2023-10-06T02:17:48.039990+0000","last_undegraded":"2023-10-06T02:17:48.039990+0000","last_fullsized":"2023-10-06T02:17:48.039990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:49.992736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.056354+0000","last_change":"2023-10-06T02:17:48.054318+0000","last_active":"2023-10-06T02:17:48.056354+0000","last_peered":"2023-10-06T02:17:48.056354+0000","last_clean":"2023-10-06T02:17:48.056354+0000","last_became_active":"2023-10-06T02:17:48.053924+0000","last_became_peered":"2023-10-06T02:17:48.053924+0000","last_unstale":"2023-10-06T02:17:48.056354+0000","last_undegraded":"2023-10-06T02:17:48.056354+0000","last_fullsized":"2023-10-06T02:17:48.056354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:29.446681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037465+0000","last_change":"2023-10-06T02:17:43.017268+0000","last_active":"2023-10-06T02:17:48.037465+0000","last_peered":"2023-10-06T02:17:48.037465+0000","last_clean":"2023-10-06T02:17:48.037465+0000","last_became_active":"2023-10-06T02:17:43.016981+0000","last_became_peered":"2023-10-06T02:17:43.016981+0000","last_unstale":"2023-10-06T02:17:48.037465+0000","last_undegraded":"2023-10-06T02:17:48.037465+0000","last_fullsized":"2023-10-06T02:17:48.037465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038414+0000","last_change":"2023-10-06T02:17:44.023712+0000","last_active":"2023-10-06T02:17:48.038414+0000","last_peered":"2023-10-06T02:17:48.038414+0000","last_clean":"2023-10-06T02:17:48.038414+0000","last_became_active":"2023-10-06T02:17:44.023412+0000","last_became_peered":"2023-10-06T02:17:44.023412+0000","last_unstale":"2023-10-06T02:17:48.038414+0000","last_undegraded":"2023-10-06T02:17:48.038414+0000","last_fullsized":"2023-10-06T02:17:48.038414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:26.577679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060912+0000","last_change":"2023-10-06T02:17:48.054660+0000","last_active":"2023-10-06T02:17:48.060912+0000","last_peered":"2023-10-06T02:17:48.060912+0000","last_clean":"2023-10-06T02:17:48.060912+0000","last_became_active":"2023-10-06T02:17:48.054270+0000","last_became_peered":"2023-10-06T02:17:48.054270+0000","last_unstale":"2023-10-06T02:17:48.060912+0000","last_undegraded":"2023-10-06T02:17:48.060912+0000","last_fullsized":"2023-10-06T02:17:48.060912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:59.085352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.044929+0000","last_change":"2023-10-06T02:17:43.013434+0000","last_active":"2023-10-06T02:17:48.044929+0000","last_peered":"2023-10-06T02:17:48.044929+0000","last_clean":"2023-10-06T02:17:48.044929+0000","last_became_active":"2023-10-06T02:17:43.013144+0000","last_became_peered":"2023-10-06T02:17:43.013144+0000","last_unstale":"2023-10-06T02:17:48.044929+0000","last_undegraded":"2023-10-06T02:17:48.044929+0000","last_fullsized":"2023-10-06T02:17:48.044929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:59.054001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045040+0000","last_change":"2023-10-06T02:17:44.020588+0000","last_active":"2023-10-06T02:17:48.045040+0000","last_peered":"2023-10-06T02:17:48.045040+0000","last_clean":"2023-10-06T02:17:48.045040+0000","last_became_active":"2023-10-06T02:17:44.020305+0000","last_became_peered":"2023-10-06T02:17:44.020305+0000","last_unstale":"2023-10-06T02:17:48.045040+0000","last_undegraded":"2023-10-06T02:17:48.045040+0000","last_fullsized":"2023-10-06T02:17:48.045040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:51.564963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.063145+0000","last_change":"2023-10-06T02:17:48.061567+0000","last_active":"2023-10-06T02:17:48.063145+0000","last_peered":"2023-10-06T02:17:48.063145+0000","last_clean":"2023-10-06T02:17:48.063145+0000","last_became_active":"2023-10-06T02:17:48.061209+0000","last_became_peered":"2023-10-06T02:17:48.061209+0000","last_unstale":"2023-10-06T02:17:48.063145+0000","last_undegraded":"2023-10-06T02:17:48.063145+0000","last_fullsized":"2023-10-06T02:17:48.063145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:05.058794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031418+0000","last_change":"2023-10-06T02:17:43.009617+0000","last_active":"2023-10-06T02:17:48.031418+0000","last_peered":"2023-10-06T02:17:48.031418+0000","last_clean":"2023-10-06T02:17:48.031418+0000","last_became_active":"2023-10-06T02:17:43.009347+0000","last_became_peered":"2023-10-06T02:17:43.009347+0000","last_unstale":"2023-10-06T02:17:48.031418+0000","last_undegraded":"2023-10-06T02:17:48.031418+0000","last_fullsized":"2023-10-06T02:17:48.031418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:59.054001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050566+0000","last_change":"2023-10-06T02:17:44.013663+0000","last_active":"2023-10-06T02:17:48.050566+0000","last_peered":"2023-10-06T02:17:48.050566+0000","last_clean":"2023-10-06T02:17:48.050566+0000","last_became_active":"2023-10-06T02:17:44.013346+0000","last_became_peered":"2023-10-06T02:17:44.013346+0000","last_unstale":"2023-10-06T02:17:48.050566+0000","last_undegraded":"2023-10-06T02:17:48.050566+0000","last_fullsized":"2023-10-06T02:17:48.050566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:21.073260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060535+0000","last_change":"2023-10-06T02:17:48.055404+0000","last_active":"2023-10-06T02:17:48.060535+0000","last_peered":"2023-10-06T02:17:48.060535+0000","last_clean":"2023-10-06T02:17:48.060535+0000","last_became_active":"2023-10-06T02:17:48.055037+0000","last_became_peered":"2023-10-06T02:17:48.055037+0000","last_unstale":"2023-10-06T02:17:48.060535+0000","last_undegraded":"2023-10-06T02:17:48.060535+0000","last_fullsized":"2023-10-06T02:17:48.060535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:39.126641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030793+0000","last_change":"2023-10-06T02:17:43.012193+0000","last_active":"2023-10-06T02:17:48.030793+0000","last_peered":"2023-10-06T02:17:48.030793+0000","last_clean":"2023-10-06T02:17:48.030793+0000","last_became_active":"2023-10-06T02:17:43.011988+0000","last_became_peered":"2023-10-06T02:17:43.011988+0000","last_unstale":"2023-10-06T02:17:48.030793+0000","last_undegraded":"2023-10-06T02:17:48.030793+0000","last_fullsized":"2023-10-06T02:17:48.030793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:56.588125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038558+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:17:48.038558+0000","last_peered":"2023-10-06T02:17:48.038558+0000","last_clean":"2023-10-06T02:17:48.038558+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:17:48.038558+0000","last_undegraded":"2023-10-06T02:17:48.038558+0000","last_fullsized":"2023-10-06T02:17:48.038558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031321+0000","last_change":"2023-10-06T02:17:44.017661+0000","last_active":"2023-10-06T02:17:48.031321+0000","last_peered":"2023-10-06T02:17:48.031321+0000","last_clean":"2023-10-06T02:17:48.031321+0000","last_became_active":"2023-10-06T02:17:44.017396+0000","last_became_peered":"2023-10-06T02:17:44.017396+0000","last_unstale":"2023-10-06T02:17:48.031321+0000","last_undegraded":"2023-10-06T02:17:48.031321+0000","last_fullsized":"2023-10-06T02:17:48.031321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.055474+0000","last_change":"2023-10-06T02:17:48.051546+0000","last_active":"2023-10-06T02:17:48.055474+0000","last_peered":"2023-10-06T02:17:48.055474+0000","last_clean":"2023-10-06T02:17:48.055474+0000","last_became_active":"2023-10-06T02:17:48.051146+0000","last_became_peered":"2023-10-06T02:17:48.051146+0000","last_unstale":"2023-10-06T02:17:48.055474+0000","last_undegraded":"2023-10-06T02:17:48.055474+0000","last_fullsized":"2023-10-06T02:17:48.055474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:03.948559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030433+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:17:48.030433+0000","last_peered":"2023-10-06T02:17:48.030433+0000","last_clean":"2023-10-06T02:17:48.030433+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:17:48.030433+0000","last_undegraded":"2023-10-06T02:17:48.030433+0000","last_fullsized":"2023-10-06T02:17:48.030433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.057902+0000","last_change":"2023-10-06T02:17:43.001598+0000","last_active":"2023-10-06T02:17:48.057902+0000","last_peered":"2023-10-06T02:17:48.057902+0000","last_clean":"2023-10-06T02:17:48.057902+0000","last_became_active":"2023-10-06T02:17:43.000830+0000","last_became_peered":"2023-10-06T02:17:43.000830+0000","last_unstale":"2023-10-06T02:17:48.057902+0000","last_undegraded":"2023-10-06T02:17:48.057902+0000","last_fullsized":"2023-10-06T02:17:48.057902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:31.631012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045023+0000","last_change":"2023-10-06T02:17:44.022761+0000","last_active":"2023-10-06T02:17:48.045023+0000","last_peered":"2023-10-06T02:17:48.045023+0000","last_clean":"2023-10-06T02:17:48.045023+0000","last_became_active":"2023-10-06T02:17:44.022519+0000","last_became_peered":"2023-10-06T02:17:44.022519+0000","last_unstale":"2023-10-06T02:17:48.045023+0000","last_undegraded":"2023-10-06T02:17:48.045023+0000","last_fullsized":"2023-10-06T02:17:48.045023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:01.914117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060933+0000","last_change":"2023-10-06T02:17:48.057692+0000","last_active":"2023-10-06T02:17:48.060933+0000","last_peered":"2023-10-06T02:17:48.060933+0000","last_clean":"2023-10-06T02:17:48.060933+0000","last_became_active":"2023-10-06T02:17:48.057291+0000","last_became_peered":"2023-10-06T02:17:48.057291+0000","last_unstale":"2023-10-06T02:17:48.060933+0000","last_undegraded":"2023-10-06T02:17:48.060933+0000","last_fullsized":"2023-10-06T02:17:48.060933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:50.051594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045953+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:17:48.045953+0000","last_peered":"2023-10-06T02:17:48.045953+0000","last_clean":"2023-10-06T02:17:48.045953+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:17:48.045953+0000","last_undegraded":"2023-10-06T02:17:48.045953+0000","last_fullsized":"2023-10-06T02:17:48.045953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037402+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:17:48.037402+0000","last_peered":"2023-10-06T02:17:48.037402+0000","last_clean":"2023-10-06T02:17:48.037402+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:17:48.037402+0000","last_undegraded":"2023-10-06T02:17:48.037402+0000","last_fullsized":"2023-10-06T02:17:48.037402+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030986+0000","last_change":"2023-10-06T02:17:43.008254+0000","last_active":"2023-10-06T02:17:48.030986+0000","last_peered":"2023-10-06T02:17:48.030986+0000","last_clean":"2023-10-06T02:17:48.030986+0000","last_became_active":"2023-10-06T02:17:43.008031+0000","last_became_peered":"2023-10-06T02:17:43.008031+0000","last_unstale":"2023-10-06T02:17:48.030986+0000","last_undegraded":"2023-10-06T02:17:48.030986+0000","last_fullsized":"2023-10-06T02:17:48.030986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.543085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031988+0000","last_change":"2023-10-06T02:17:44.015903+0000","last_active":"2023-10-06T02:17:48.031988+0000","last_peered":"2023-10-06T02:17:48.031988+0000","last_clean":"2023-10-06T02:17:48.031988+0000","last_became_active":"2023-10-06T02:17:44.012940+0000","last_became_peered":"2023-10-06T02:17:44.012940+0000","last_unstale":"2023-10-06T02:17:48.031988+0000","last_undegraded":"2023-10-06T02:17:48.031988+0000","last_fullsized":"2023-10-06T02:17:48.031988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:11.590274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.058344+0000","last_change":"2023-10-06T02:17:48.054067+0000","last_active":"2023-10-06T02:17:48.058344+0000","last_peered":"2023-10-06T02:17:48.058344+0000","last_clean":"2023-10-06T02:17:48.058344+0000","last_became_active":"2023-10-06T02:17:48.053658+0000","last_became_peered":"2023-10-06T02:17:48.053658+0000","last_unstale":"2023-10-06T02:17:48.058344+0000","last_undegraded":"2023-10-06T02:17:48.058344+0000","last_fullsized":"2023-10-06T02:17:48.058344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:05.948051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036157+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:17:48.036157+0000","last_peered":"2023-10-06T02:17:48.036157+0000","last_clean":"2023-10-06T02:17:48.036157+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:17:48.036157+0000","last_undegraded":"2023-10-06T02:17:48.036157+0000","last_fullsized":"2023-10-06T02:17:48.036157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045745+0000","last_change":"2023-10-06T02:17:43.007395+0000","last_active":"2023-10-06T02:17:48.045745+0000","last_peered":"2023-10-06T02:17:48.045745+0000","last_clean":"2023-10-06T02:17:48.045745+0000","last_became_active":"2023-10-06T02:17:43.007096+0000","last_became_peered":"2023-10-06T02:17:43.007096+0000","last_unstale":"2023-10-06T02:17:48.045745+0000","last_undegraded":"2023-10-06T02:17:48.045745+0000","last_fullsized":"2023-10-06T02:17:48.045745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:31.631012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050492+0000","last_change":"2023-10-06T02:17:44.024048+0000","last_active":"2023-10-06T02:17:48.050492+0000","last_peered":"2023-10-06T02:17:48.050492+0000","last_clean":"2023-10-06T02:17:48.050492+0000","last_became_active":"2023-10-06T02:17:44.023785+0000","last_became_peered":"2023-10-06T02:17:44.023785+0000","last_unstale":"2023-10-06T02:17:48.050492+0000","last_undegraded":"2023-10-06T02:17:48.050492+0000","last_fullsized":"2023-10-06T02:17:48.050492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.051840+0000","last_change":"2023-10-06T02:17:48.049159+0000","last_active":"2023-10-06T02:17:48.051840+0000","last_peered":"2023-10-06T02:17:48.051840+0000","last_clean":"2023-10-06T02:17:48.051840+0000","last_became_active":"2023-10-06T02:17:48.048030+0000","last_became_peered":"2023-10-06T02:17:48.048030+0000","last_unstale":"2023-10-06T02:17:48.051840+0000","last_undegraded":"2023-10-06T02:17:48.051840+0000","last_fullsized":"2023-10-06T02:17:48.051840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:59.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036269+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:17:48.036269+0000","last_peered":"2023-10-06T02:17:48.036269+0000","last_clean":"2023-10-06T02:17:48.036269+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:17:48.036269+0000","last_undegraded":"2023-10-06T02:17:48.036269+0000","last_fullsized":"2023-10-06T02:17:48.036269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030334+0000","last_change":"2023-10-06T02:17:43.012903+0000","last_active":"2023-10-06T02:17:48.030334+0000","last_peered":"2023-10-06T02:17:48.030334+0000","last_clean":"2023-10-06T02:17:48.030334+0000","last_became_active":"2023-10-06T02:17:43.012602+0000","last_became_peered":"2023-10-06T02:17:43.012602+0000","last_unstale":"2023-10-06T02:17:48.030334+0000","last_undegraded":"2023-10-06T02:17:48.030334+0000","last_fullsized":"2023-10-06T02:17:48.030334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:09.638074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040168+0000","last_change":"2023-10-06T02:17:44.017466+0000","last_active":"2023-10-06T02:17:48.040168+0000","last_peered":"2023-10-06T02:17:48.040168+0000","last_clean":"2023-10-06T02:17:48.040168+0000","last_became_active":"2023-10-06T02:17:44.017213+0000","last_became_peered":"2023-10-06T02:17:44.017213+0000","last_unstale":"2023-10-06T02:17:48.040168+0000","last_undegraded":"2023-10-06T02:17:48.040168+0000","last_fullsized":"2023-10-06T02:17:48.040168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:43.352906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.059484+0000","last_change":"2023-10-06T02:17:48.053794+0000","last_active":"2023-10-06T02:17:48.059484+0000","last_peered":"2023-10-06T02:17:48.059484+0000","last_clean":"2023-10-06T02:17:48.059484+0000","last_became_active":"2023-10-06T02:17:48.053274+0000","last_became_peered":"2023-10-06T02:17:48.053274+0000","last_unstale":"2023-10-06T02:17:48.059484+0000","last_undegraded":"2023-10-06T02:17:48.059484+0000","last_fullsized":"2023-10-06T02:17:48.059484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:29.446681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037498+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:17:48.037498+0000","last_peered":"2023-10-06T02:17:48.037498+0000","last_clean":"2023-10-06T02:17:48.037498+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:17:48.037498+0000","last_undegraded":"2023-10-06T02:17:48.037498+0000","last_fullsized":"2023-10-06T02:17:48.037498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039136+0000","last_change":"2023-10-06T02:17:43.013138+0000","last_active":"2023-10-06T02:17:48.039136+0000","last_peered":"2023-10-06T02:17:48.039136+0000","last_clean":"2023-10-06T02:17:48.039136+0000","last_became_active":"2023-10-06T02:17:43.012841+0000","last_became_peered":"2023-10-06T02:17:43.012841+0000","last_unstale":"2023-10-06T02:17:48.039136+0000","last_undegraded":"2023-10-06T02:17:48.039136+0000","last_fullsized":"2023-10-06T02:17:48.039136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:55.863203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.047850+0000","last_change":"2023-10-06T02:17:44.011211+0000","last_active":"2023-10-06T02:17:48.047850+0000","last_peered":"2023-10-06T02:17:48.047850+0000","last_clean":"2023-10-06T02:17:48.047850+0000","last_became_active":"2023-10-06T02:17:44.010694+0000","last_became_peered":"2023-10-06T02:17:44.010694+0000","last_unstale":"2023-10-06T02:17:48.047850+0000","last_undegraded":"2023-10-06T02:17:48.047850+0000","last_fullsized":"2023-10-06T02:17:48.047850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:12.022239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.052188+0000","last_change":"2023-10-06T02:17:48.049434+0000","last_active":"2023-10-06T02:17:48.052188+0000","last_peered":"2023-10-06T02:17:48.052188+0000","last_clean":"2023-10-06T02:17:48.052188+0000","last_became_active":"2023-10-06T02:17:48.049050+0000","last_became_peered":"2023-10-06T02:17:48.049050+0000","last_unstale":"2023-10-06T02:17:48.052188+0000","last_undegraded":"2023-10-06T02:17:48.052188+0000","last_fullsized":"2023-10-06T02:17:48.052188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:58.565730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039175+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:17:48.039175+0000","last_peered":"2023-10-06T02:17:48.039175+0000","last_clean":"2023-10-06T02:17:48.039175+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:17:48.039175+0000","last_undegraded":"2023-10-06T02:17:48.039175+0000","last_fullsized":"2023-10-06T02:17:48.039175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.048170+0000","last_change":"2023-10-06T02:17:43.009389+0000","last_active":"2023-10-06T02:17:48.048170+0000","last_peered":"2023-10-06T02:17:48.048170+0000","last_clean":"2023-10-06T02:17:48.048170+0000","last_became_active":"2023-10-06T02:17:43.009070+0000","last_became_peered":"2023-10-06T02:17:43.009070+0000","last_unstale":"2023-10-06T02:17:48.048170+0000","last_undegraded":"2023-10-06T02:17:48.048170+0000","last_fullsized":"2023-10-06T02:17:48.048170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:34.508977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.033624+0000","last_change":"2023-10-06T02:17:44.022296+0000","last_active":"2023-10-06T02:17:48.033624+0000","last_peered":"2023-10-06T02:17:48.033624+0000","last_clean":"2023-10-06T02:17:48.033624+0000","last_became_active":"2023-10-06T02:17:44.022032+0000","last_became_peered":"2023-10-06T02:17:44.022032+0000","last_unstale":"2023-10-06T02:17:48.033624+0000","last_undegraded":"2023-10-06T02:17:48.033624+0000","last_fullsized":"2023-10-06T02:17:48.033624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:56.966356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.058436+0000","last_change":"2023-10-06T02:17:48.049537+0000","last_active":"2023-10-06T02:17:48.058436+0000","last_peered":"2023-10-06T02:17:48.058436+0000","last_clean":"2023-10-06T02:17:48.058436+0000","last_became_active":"2023-10-06T02:17:48.049150+0000","last_became_peered":"2023-10-06T02:17:48.049150+0000","last_unstale":"2023-10-06T02:17:48.058436+0000","last_undegraded":"2023-10-06T02:17:48.058436+0000","last_fullsized":"2023-10-06T02:17:48.058436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:20.999472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039792+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:17:48.039792+0000","last_peered":"2023-10-06T02:17:48.039792+0000","last_clean":"2023-10-06T02:17:48.039792+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:17:48.039792+0000","last_undegraded":"2023-10-06T02:17:48.039792+0000","last_fullsized":"2023-10-06T02:17:48.039792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040044+0000","last_change":"2023-10-06T02:17:43.017470+0000","last_active":"2023-10-06T02:17:48.040044+0000","last_peered":"2023-10-06T02:17:48.040044+0000","last_clean":"2023-10-06T02:17:48.040044+0000","last_became_active":"2023-10-06T02:17:43.017001+0000","last_became_peered":"2023-10-06T02:17:43.017001+0000","last_unstale":"2023-10-06T02:17:48.040044+0000","last_undegraded":"2023-10-06T02:17:48.040044+0000","last_fullsized":"2023-10-06T02:17:48.040044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:59.054001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045239+0000","last_change":"2023-10-06T02:17:44.019859+0000","last_active":"2023-10-06T02:17:48.045239+0000","last_peered":"2023-10-06T02:17:48.045239+0000","last_clean":"2023-10-06T02:17:48.045239+0000","last_became_active":"2023-10-06T02:17:44.019178+0000","last_became_peered":"2023-10-06T02:17:44.019178+0000","last_unstale":"2023-10-06T02:17:48.045239+0000","last_undegraded":"2023-10-06T02:17:48.045239+0000","last_fullsized":"2023-10-06T02:17:48.045239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:41.549349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.059488+0000","last_change":"2023-10-06T02:17:48.056833+0000","last_active":"2023-10-06T02:17:48.059488+0000","last_peered":"2023-10-06T02:17:48.059488+0000","last_clean":"2023-10-06T02:17:48.059488+0000","last_became_active":"2023-10-06T02:17:48.056428+0000","last_became_peered":"2023-10-06T02:17:48.056428+0000","last_unstale":"2023-10-06T02:17:48.059488+0000","last_undegraded":"2023-10-06T02:17:48.059488+0000","last_fullsized":"2023-10-06T02:17:48.059488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:04.977537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.033524+0000","last_change":"2023-10-06T02:17:43.016304+0000","last_active":"2023-10-06T02:17:48.033524+0000","last_peered":"2023-10-06T02:17:48.033524+0000","last_clean":"2023-10-06T02:17:48.033524+0000","last_became_active":"2023-10-06T02:17:43.015998+0000","last_became_peered":"2023-10-06T02:17:43.015998+0000","last_unstale":"2023-10-06T02:17:48.033524+0000","last_undegraded":"2023-10-06T02:17:48.033524+0000","last_fullsized":"2023-10-06T02:17:48.033524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:09.638074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031489+0000","last_change":"2023-10-06T02:17:44.012571+0000","last_active":"2023-10-06T02:17:48.031489+0000","last_peered":"2023-10-06T02:17:48.031489+0000","last_clean":"2023-10-06T02:17:48.031489+0000","last_became_active":"2023-10-06T02:17:44.012245+0000","last_became_peered":"2023-10-06T02:17:44.012245+0000","last_unstale":"2023-10-06T02:17:48.031489+0000","last_undegraded":"2023-10-06T02:17:48.031489+0000","last_fullsized":"2023-10-06T02:17:48.031489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:56.870377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.061274+0000","last_change":"2023-10-06T02:17:48.057885+0000","last_active":"2023-10-06T02:17:48.061274+0000","last_peered":"2023-10-06T02:17:48.061274+0000","last_clean":"2023-10-06T02:17:48.061274+0000","last_became_active":"2023-10-06T02:17:48.057470+0000","last_became_peered":"2023-10-06T02:17:48.057470+0000","last_unstale":"2023-10-06T02:17:48.061274+0000","last_undegraded":"2023-10-06T02:17:48.061274+0000","last_fullsized":"2023-10-06T02:17:48.061274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:34.306615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039047+0000","last_change":"2023-10-06T02:17:43.014240+0000","last_active":"2023-10-06T02:17:48.039047+0000","last_peered":"2023-10-06T02:17:48.039047+0000","last_clean":"2023-10-06T02:17:48.039047+0000","last_became_active":"2023-10-06T02:17:43.013995+0000","last_became_peered":"2023-10-06T02:17:43.013995+0000","last_unstale":"2023-10-06T02:17:48.039047+0000","last_undegraded":"2023-10-06T02:17:48.039047+0000","last_fullsized":"2023-10-06T02:17:48.039047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:09.638074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039278+0000","last_change":"2023-10-06T02:17:44.012631+0000","last_active":"2023-10-06T02:17:48.039278+0000","last_peered":"2023-10-06T02:17:48.039278+0000","last_clean":"2023-10-06T02:17:48.039278+0000","last_became_active":"2023-10-06T02:17:44.012366+0000","last_became_peered":"2023-10-06T02:17:44.012366+0000","last_unstale":"2023-10-06T02:17:48.039278+0000","last_undegraded":"2023-10-06T02:17:48.039278+0000","last_fullsized":"2023-10-06T02:17:48.039278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:11.590274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060285+0000","last_change":"2023-10-06T02:17:48.054598+0000","last_active":"2023-10-06T02:17:48.060285+0000","last_peered":"2023-10-06T02:17:48.060285+0000","last_clean":"2023-10-06T02:17:48.060285+0000","last_became_active":"2023-10-06T02:17:48.054196+0000","last_became_peered":"2023-10-06T02:17:48.054196+0000","last_unstale":"2023-10-06T02:17:48.060285+0000","last_undegraded":"2023-10-06T02:17:48.060285+0000","last_fullsized":"2023-10-06T02:17:48.060285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:59.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039960+0000","last_change":"2023-10-06T02:17:43.015890+0000","last_active":"2023-10-06T02:17:48.039960+0000","last_peered":"2023-10-06T02:17:48.039960+0000","last_clean":"2023-10-06T02:17:48.039960+0000","last_became_active":"2023-10-06T02:17:43.015544+0000","last_became_peered":"2023-10-06T02:17:43.015544+0000","last_unstale":"2023-10-06T02:17:48.039960+0000","last_undegraded":"2023-10-06T02:17:48.039960+0000","last_fullsized":"2023-10-06T02:17:48.039960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.543085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037516+0000","last_change":"2023-10-06T02:17:44.027369+0000","last_active":"2023-10-06T02:17:48.037516+0000","last_peered":"2023-10-06T02:17:48.037516+0000","last_clean":"2023-10-06T02:17:48.037516+0000","last_became_active":"2023-10-06T02:17:44.026967+0000","last_became_peered":"2023-10-06T02:17:44.026967+0000","last_unstale":"2023-10-06T02:17:48.037516+0000","last_undegraded":"2023-10-06T02:17:48.037516+0000","last_fullsized":"2023-10-06T02:17:48.037516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:56.966356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.063103+0000","last_change":"2023-10-06T02:17:48.060867+0000","last_active":"2023-10-06T02:17:48.063103+0000","last_peered":"2023-10-06T02:17:48.063103+0000","last_clean":"2023-10-06T02:17:48.063103+0000","last_became_active":"2023-10-06T02:17:48.060507+0000","last_became_peered":"2023-10-06T02:17:48.060507+0000","last_unstale":"2023-10-06T02:17:48.063103+0000","last_undegraded":"2023-10-06T02:17:48.063103+0000","last_fullsized":"2023-10-06T02:17:48.063103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:41.579573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031205+0000","last_change":"2023-10-06T02:17:43.010564+0000","last_active":"2023-10-06T02:17:48.031205+0000","last_peered":"2023-10-06T02:17:48.031205+0000","last_clean":"2023-10-06T02:17:48.031205+0000","last_became_active":"2023-10-06T02:17:43.008507+0000","last_became_peered":"2023-10-06T02:17:43.008507+0000","last_unstale":"2023-10-06T02:17:48.031205+0000","last_undegraded":"2023-10-06T02:17:48.031205+0000","last_fullsized":"2023-10-06T02:17:48.031205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:55.863203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030181+0000","last_change":"2023-10-06T02:17:44.023457+0000","last_active":"2023-10-06T02:17:48.030181+0000","last_peered":"2023-10-06T02:17:48.030181+0000","last_clean":"2023-10-06T02:17:48.030181+0000","last_became_active":"2023-10-06T02:17:44.022723+0000","last_became_peered":"2023-10-06T02:17:44.022723+0000","last_unstale":"2023-10-06T02:17:48.030181+0000","last_undegraded":"2023-10-06T02:17:48.030181+0000","last_fullsized":"2023-10-06T02:17:48.030181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:56.966356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060390+0000","last_change":"2023-10-06T02:17:48.058509+0000","last_active":"2023-10-06T02:17:48.060390+0000","last_peered":"2023-10-06T02:17:48.060390+0000","last_clean":"2023-10-06T02:17:48.060390+0000","last_became_active":"2023-10-06T02:17:48.058112+0000","last_became_peered":"2023-10-06T02:17:48.058112+0000","last_unstale":"2023-10-06T02:17:48.060390+0000","last_undegraded":"2023-10-06T02:17:48.060390+0000","last_fullsized":"2023-10-06T02:17:48.060390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:59.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031046+0000","last_change":"2023-10-06T02:17:43.013591+0000","last_active":"2023-10-06T02:17:48.031046+0000","last_peered":"2023-10-06T02:17:48.031046+0000","last_clean":"2023-10-06T02:17:48.031046+0000","last_became_active":"2023-10-06T02:17:43.013150+0000","last_became_peered":"2023-10-06T02:17:43.013150+0000","last_unstale":"2023-10-06T02:17:48.031046+0000","last_undegraded":"2023-10-06T02:17:48.031046+0000","last_fullsized":"2023-10-06T02:17:48.031046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:55.863203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036796+0000","last_change":"2023-10-06T02:17:44.021121+0000","last_active":"2023-10-06T02:17:48.036796+0000","last_peered":"2023-10-06T02:17:48.036796+0000","last_clean":"2023-10-06T02:17:48.036796+0000","last_became_active":"2023-10-06T02:17:44.020849+0000","last_became_peered":"2023-10-06T02:17:44.020849+0000","last_unstale":"2023-10-06T02:17:48.036796+0000","last_undegraded":"2023-10-06T02:17:48.036796+0000","last_fullsized":"2023-10-06T02:17:48.036796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.060566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039127+0000","last_change":"2023-10-06T02:17:44.025857+0000","last_active":"2023-10-06T02:17:48.039127+0000","last_peered":"2023-10-06T02:17:48.039127+0000","last_clean":"2023-10-06T02:17:48.039127+0000","last_became_active":"2023-10-06T02:17:44.025639+0000","last_became_peered":"2023-10-06T02:17:44.025639+0000","last_unstale":"2023-10-06T02:17:48.039127+0000","last_undegraded":"2023-10-06T02:17:48.039127+0000","last_fullsized":"2023-10-06T02:17:48.039127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:22.992220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030199+0000","last_change":"2023-10-06T02:17:44.021795+0000","last_active":"2023-10-06T02:17:48.030199+0000","last_peered":"2023-10-06T02:17:48.030199+0000","last_clean":"2023-10-06T02:17:48.030199+0000","last_became_active":"2023-10-06T02:17:44.021519+0000","last_became_peered":"2023-10-06T02:17:44.021519+0000","last_unstale":"2023-10-06T02:17:48.030199+0000","last_undegraded":"2023-10-06T02:17:48.030199+0000","last_fullsized":"2023-10-06T02:17:48.030199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:29.729845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037699+0000","last_change":"2023-10-06T02:17:44.020596+0000","last_active":"2023-10-06T02:17:48.037699+0000","last_peered":"2023-10-06T02:17:48.037699+0000","last_clean":"2023-10-06T02:17:48.037699+0000","last_became_active":"2023-10-06T02:17:44.020327+0000","last_became_peered":"2023-10-06T02:17:44.020327+0000","last_unstale":"2023-10-06T02:17:48.037699+0000","last_undegraded":"2023-10-06T02:17:48.037699+0000","last_fullsized":"2023-10-06T02:17:48.037699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:08.638757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031988+0000","last_change":"2023-10-06T02:17:44.023963+0000","last_active":"2023-10-06T02:17:48.031988+0000","last_peered":"2023-10-06T02:17:48.031988+0000","last_clean":"2023-10-06T02:17:48.031988+0000","last_became_active":"2023-10-06T02:17:44.023520+0000","last_became_peered":"2023-10-06T02:17:44.023520+0000","last_unstale":"2023-10-06T02:17:48.031988+0000","last_undegraded":"2023-10-06T02:17:48.031988+0000","last_fullsized":"2023-10-06T02:17:48.031988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:05.747241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.048071+0000","last_change":"2023-10-06T02:17:44.014573+0000","last_active":"2023-10-06T02:17:48.048071+0000","last_peered":"2023-10-06T02:17:48.048071+0000","last_clean":"2023-10-06T02:17:48.048071+0000","last_became_active":"2023-10-06T02:17:44.014301+0000","last_became_peered":"2023-10-06T02:17:44.014301+0000","last_unstale":"2023-10-06T02:17:48.048071+0000","last_undegraded":"2023-10-06T02:17:48.048071+0000","last_fullsized":"2023-10-06T02:17:48.048071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:04.413740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":703395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":108144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298124,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073716,"statfs":{"total":96636764160,"available":96331485184,"internally_reserved":0,"allocated":856064,"data_stored":698512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.138}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":108144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":112867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":109721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:17:57.850 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:17:57.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.996+0000 7f40b59ce700 1 Processor -- start 2023-10-06T02:17:57.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.996+0000 7f40b59ce700 1 -- start start 2023-10-06T02:17:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.997+0000 7f40b59ce700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40b015a590 0x7f40b015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.997+0000 7f40b59ce700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b00afb90 con 0x7f40b00b3c50 2023-10-06T02:17:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.997+0000 7f40b59ce700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b015aef0 con 0x7f40b015b3c0 2023-10-06T02:17:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.997+0000 7f40b59ce700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b00b2310 con 0x7f40b015a590 2023-10-06T02:17:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.997+0000 7f40ae7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f40b00b3c50 0x7f40b015b790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41978/0 (socket says 172.21.15.6:41978) 2023-10-06T02:17:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.997+0000 7f40ae7fc700 1 -- 172.21.15.6:0/3105031266 learned_addr learned my addr 172.21.15.6:0/3105031266 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40af7fe700 1 --2- 172.21.15.6:0/3105031266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40b015a590 0x7f40b015a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40adffb700 1 -- 172.21.15.6:0/3105031266 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679845671 0 0) 0x7f40b00afb90 con 0x7f40b00b3c50 2023-10-06T02:17:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40adffb700 1 -- 172.21.15.6:0/3105031266 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f409c003570 con 0x7f40b00b3c50 2023-10-06T02:17:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40adffb700 1 -- 172.21.15.6:0/3105031266 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3749969008 0 0) 0x7f409c003570 con 0x7f40b00b3c50 2023-10-06T02:17:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40adffb700 1 -- 172.21.15.6:0/3105031266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40b015a590 msgr2=0x7f40b015a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40adffb700 1 --2- 172.21.15.6:0/3105031266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40b015a590 0x7f40b015a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40adffb700 1 -- 172.21.15.6:0/3105031266 >> v1:172.21.15.175:6789/0 conn(0x7f40b015b3c0 legacy=0x7f40b0097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40adffb700 1 -- 172.21.15.6:0/3105031266 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b00b25f0 con 0x7f40b00b3c50 2023-10-06T02:17:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40adffb700 1 -- 172.21.15.6:0/3105031266 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f4098001470 con 0x7f40b00b3c50 2023-10-06T02:17:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40adffb700 1 -- 172.21.15.6:0/3105031266 >> v1:172.21.15.6:6789/0 conn(0x7f40b00b3c50 legacy=0x7f40b015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40adffb700 1 --2- 172.21.15.6:0/3105031266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40b015a590 0x7f409c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40adffb700 1 --2- 172.21.15.6:0/3105031266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f409c003fd0 0x7f409c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40adffb700 1 --2- 172.21.15.6:0/3105031266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f409c004d50 0x7f409c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40adffb700 1 -- 172.21.15.6:0/3105031266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b00b2310 con 0x7f409c003fd0 2023-10-06T02:17:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40adffb700 1 -- 172.21.15.6:0/3105031266 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409c00bbf0 con 0x7f409c004d50 2023-10-06T02:17:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40adffb700 1 -- 172.21.15.6:0/3105031266 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409c00bdb0 con 0x7f40b015a590 2023-10-06T02:17:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40ae7fc700 1 --2- 172.21.15.6:0/3105031266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f409c003fd0 0x7f409c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40aeffd700 1 --2- 172.21.15.6:0/3105031266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40b015a590 0x7f409c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40af7fe700 1 --2- 172.21.15.6:0/3105031266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f409c004d50 0x7f409c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40ae7fc700 1 -- 172.21.15.6:0/3105031266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40b015a590 msgr2=0x7f409c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40ae7fc700 1 --2- 172.21.15.6:0/3105031266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40b015a590 0x7f409c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40ae7fc700 1 -- 172.21.15.6:0/3105031266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f409c004d50 msgr2=0x7f409c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40ae7fc700 1 --2- 172.21.15.6:0/3105031266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f409c004d50 0x7f409c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40ae7fc700 1 -- 172.21.15.6:0/3105031266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c003570 con 0x7f409c003fd0 2023-10-06T02:17:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.998+0000 7f40ae7fc700 1 --2- 172.21.15.6:0/3105031266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f409c003fd0 0x7f409c004810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f409800c3c0 tx=0x7f4098001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e3db92e13b01d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.999+0000 7f40adffb700 1 -- 172.21.15.6:0/3105031266 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409800cc90 con 0x7f409c003fd0 2023-10-06T02:17:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.999+0000 7f40adffb700 1 -- 172.21.15.6:0/3105031266 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409800cdf0 con 0x7f409c003fd0 2023-10-06T02:17:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.999+0000 7f40adffb700 1 -- 172.21.15.6:0/3105031266 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098005b70 con 0x7f409c003fd0 2023-10-06T02:17:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.999+0000 7f40b59ce700 1 -- 172.21.15.6:0/3105031266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f409c003fd0 msgr2=0x7f409c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.999+0000 7f40b59ce700 1 --2- 172.21.15.6:0/3105031266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f409c003fd0 0x7f409c004810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f409800c3c0 tx=0x7f4098001e70 comp rx=0 tx=0).stop 2023-10-06T02:17:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.999+0000 7f40af7fe700 1 -- 172.21.15.6:0/3105031266 reap_dead start 2023-10-06T02:17:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.999+0000 7f40b59ce700 1 -- 172.21.15.6:0/3105031266 shutdown_connections 2023-10-06T02:17:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.999+0000 7f40b59ce700 1 -- 172.21.15.6:0/3105031266 >> 172.21.15.6:0/3105031266 conn(0x7f40b0067910 msgr2=0x7f40b00ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.999+0000 7f40b59ce700 1 -- 172.21.15.6:0/3105031266 shutdown_connections 2023-10-06T02:17:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:57.999+0000 7f40b59ce700 1 -- 172.21.15.6:0/3105031266 wait complete. 2023-10-06T02:17:58.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.000+0000 7f40b59ce700 1 Processor -- start 2023-10-06T02:17:58.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.001+0000 7f40b59ce700 1 -- start start 2023-10-06T02:17:58.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.001+0000 7f40b59ce700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f409c003fd0 0x7f40b0148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.001+0000 7f40b59ce700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b00a9990 0x7f40b0168bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.001+0000 7f40b59ce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b0169100 0x7f40b00aa770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.001+0000 7f40b59ce700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b00a8f40 con 0x7f40b0169100 2023-10-06T02:17:58.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.001+0000 7f40b59ce700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b00a9500 con 0x7f40b00a9990 2023-10-06T02:17:58.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.001+0000 7f40b59ce700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b00acc70 con 0x7f409c003fd0 2023-10-06T02:17:58.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.001+0000 7f40af7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b0169100 0x7f40b00aa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.001+0000 7f40af7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b0169100 0x7f40b00aa770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36428/0 (socket says 172.21.15.6:36428) 2023-10-06T02:17:58.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.001+0000 7f40af7fe700 1 -- 172.21.15.6:0/272170679 learned_addr learned my addr 172.21.15.6:0/272170679 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:58.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.002+0000 7f40aeffd700 1 --2- 172.21.15.6:0/272170679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f409c003fd0 0x7f40b0148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.002+0000 7f40ae7fc700 1 --2- 172.21.15.6:0/272170679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b00a9990 0x7f40b0168bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.002+0000 7f40af7fe700 1 -- 172.21.15.6:0/272170679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f409c003fd0 msgr2=0x7f40b0148540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.002+0000 7f40af7fe700 1 --2- 172.21.15.6:0/272170679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f409c003fd0 0x7f40b0148540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.002+0000 7f40af7fe700 1 -- 172.21.15.6:0/272170679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b00a9990 msgr2=0x7f40b0168bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.002+0000 7f40af7fe700 1 --2- 172.21.15.6:0/272170679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b00a9990 0x7f40b0168bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.002+0000 7f40af7fe700 1 -- 172.21.15.6:0/272170679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b0169680 con 0x7f40b0169100 2023-10-06T02:17:58.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.002+0000 7f40aeffd700 1 --2- 172.21.15.6:0/272170679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f409c003fd0 0x7f40b0148540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:58.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.002+0000 7f40ae7fc700 1 --2- 172.21.15.6:0/272170679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b00a9990 0x7f40b0168bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:58.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.002+0000 7f40af7fe700 1 --2- 172.21.15.6:0/272170679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b0169100 0x7f40b00aa770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f40a00094d0 tx=0x7f40a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:58.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.002+0000 7f40a6ffd700 1 -- 172.21.15.6:0/272170679 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a000e040 con 0x7f40b0169100 2023-10-06T02:17:58.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.002+0000 7f40a6ffd700 1 -- 172.21.15.6:0/272170679 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a000f040 con 0x7f40b0169100 2023-10-06T02:17:58.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.002+0000 7f40b59ce700 1 -- 172.21.15.6:0/272170679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b0169960 con 0x7f40b0169100 2023-10-06T02:17:58.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.002+0000 7f40a6ffd700 1 -- 172.21.15.6:0/272170679 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a000fde0 con 0x7f40b0169100 2023-10-06T02:17:58.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.002+0000 7f40b59ce700 1 -- 172.21.15.6:0/272170679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b0148a80 con 0x7f40b0169100 2023-10-06T02:17:58.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.003+0000 7f40b59ce700 1 -- 172.21.15.6:0/272170679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b00a9350 con 0x7f40b0169100 2023-10-06T02:17:58.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.004+0000 7f40a6ffd700 1 -- 172.21.15.6:0/272170679 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40a0015640 con 0x7f40b0169100 2023-10-06T02:17:58.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.004+0000 7f40a6ffd700 1 --2- 172.21.15.6:0/272170679 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4090066f30 0x7f40900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.004+0000 7f40a6ffd700 1 -- 172.21.15.6:0/272170679 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f40a0085230 con 0x7f40b0169100 2023-10-06T02:17:58.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.004+0000 7f40aeffd700 1 --2- 172.21.15.6:0/272170679 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4090066f30 0x7f40900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.005+0000 7f40aeffd700 1 --2- 172.21.15.6:0/272170679 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4090066f30 0x7f40900693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f40b0158bc0 tx=0x7f40a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:58.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.008+0000 7f40a6ffd700 1 -- 172.21.15.6:0/272170679 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40a0052050 con 0x7f40b0169100 2023-10-06T02:17:58.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.196+0000 7f40b59ce700 1 -- 172.21.15.6:0/272170679 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40b006e8d0 con 0x7f4090066f30 2023-10-06T02:17:58.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.207+0000 7f40a6ffd700 1 -- 172.21.15.6:0/272170679 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367534 (secure 0 0 0) 0x7f40b006e8d0 con 0x7f4090066f30 2023-10-06T02:17:58.212 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:58.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.210+0000 7f40b59ce700 1 -- 172.21.15.6:0/272170679 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4090066f30 msgr2=0x7f40900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.210+0000 7f40b59ce700 1 --2- 172.21.15.6:0/272170679 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4090066f30 0x7f40900693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f40b0158bc0 tx=0x7f40a8009040 comp rx=0 tx=0).stop 2023-10-06T02:17:58.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.210+0000 7f40b59ce700 1 -- 172.21.15.6:0/272170679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b0169100 msgr2=0x7f40b00aa770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.210+0000 7f40b59ce700 1 --2- 172.21.15.6:0/272170679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b0169100 0x7f40b00aa770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f40a00094d0 tx=0x7f40a000b040 comp rx=0 tx=0).stop 2023-10-06T02:17:58.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.210+0000 7f40b59ce700 1 -- 172.21.15.6:0/272170679 shutdown_connections 2023-10-06T02:17:58.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.210+0000 7f40b59ce700 1 --2- 172.21.15.6:0/272170679 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4090066f30 0x7f40900693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.210+0000 7f40b59ce700 1 --2- 172.21.15.6:0/272170679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b0169100 0x7f40b00aa770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.210+0000 7f40b59ce700 1 --2- 172.21.15.6:0/272170679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f409c003fd0 0x7f40b0148540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.210+0000 7f40b59ce700 1 --2- 172.21.15.6:0/272170679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40b00a9990 0x7f40b0168bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.210+0000 7f40b59ce700 1 -- 172.21.15.6:0/272170679 >> 172.21.15.6:0/272170679 conn(0x7f40b0067910 msgr2=0x7f40b006d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:58.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.210+0000 7f40b59ce700 1 -- 172.21.15.6:0/272170679 shutdown_connections 2023-10-06T02:17:58.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.210+0000 7f40b59ce700 1 -- 172.21.15.6:0/272170679 wait complete. 2023-10-06T02:17:58.216 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:17:58.223 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-10-06T02:17:56.560647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381596,"kb_used_data":3292,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593124,"statfs":{"total":773094113280,"available":770655358976,"internally_reserved":0,"allocated":3371008,"data_stored":2059621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.532060"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031087+0000","last_change":"2023-10-06T02:17:44.012575+0000","last_active":"2023-10-06T02:17:48.031087+0000","last_peered":"2023-10-06T02:17:48.031087+0000","last_clean":"2023-10-06T02:17:48.031087+0000","last_became_active":"2023-10-06T02:17:44.012270+0000","last_became_peered":"2023-10-06T02:17:44.012270+0000","last_unstale":"2023-10-06T02:17:48.031087+0000","last_undegraded":"2023-10-06T02:17:48.031087+0000","last_fullsized":"2023-10-06T02:17:48.031087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:16.254919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.041799+0000","last_change":"2023-10-06T02:17:44.021465+0000","last_active":"2023-10-06T02:17:48.041799+0000","last_peered":"2023-10-06T02:17:48.041799+0000","last_clean":"2023-10-06T02:17:48.041799+0000","last_became_active":"2023-10-06T02:17:44.021209+0000","last_became_peered":"2023-10-06T02:17:44.021209+0000","last_unstale":"2023-10-06T02:17:48.041799+0000","last_undegraded":"2023-10-06T02:17:48.041799+0000","last_fullsized":"2023-10-06T02:17:48.041799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:41.549349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038712+0000","last_change":"2023-10-06T02:17:44.027196+0000","last_active":"2023-10-06T02:17:48.038712+0000","last_peered":"2023-10-06T02:17:48.038712+0000","last_clean":"2023-10-06T02:17:48.038712+0000","last_became_active":"2023-10-06T02:17:44.026927+0000","last_became_peered":"2023-10-06T02:17:44.026927+0000","last_unstale":"2023-10-06T02:17:48.038712+0000","last_undegraded":"2023-10-06T02:17:48.038712+0000","last_fullsized":"2023-10-06T02:17:48.038712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:15.551522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039557+0000","last_change":"2023-10-06T02:17:44.027115+0000","last_active":"2023-10-06T02:17:48.039557+0000","last_peered":"2023-10-06T02:17:48.039557+0000","last_clean":"2023-10-06T02:17:48.039557+0000","last_became_active":"2023-10-06T02:17:44.026827+0000","last_became_peered":"2023-10-06T02:17:44.026827+0000","last_unstale":"2023-10-06T02:17:48.039557+0000","last_undegraded":"2023-10-06T02:17:48.039557+0000","last_fullsized":"2023-10-06T02:17:48.039557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:32.103483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.033725+0000","last_change":"2023-10-06T02:17:44.015656+0000","last_active":"2023-10-06T02:17:48.033725+0000","last_peered":"2023-10-06T02:17:48.033725+0000","last_clean":"2023-10-06T02:17:48.033725+0000","last_became_active":"2023-10-06T02:17:44.008744+0000","last_became_peered":"2023-10-06T02:17:44.008744+0000","last_unstale":"2023-10-06T02:17:48.033725+0000","last_undegraded":"2023-10-06T02:17:48.033725+0000","last_fullsized":"2023-10-06T02:17:48.033725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037659+0000","last_change":"2023-10-06T02:17:44.027345+0000","last_active":"2023-10-06T02:17:48.037659+0000","last_peered":"2023-10-06T02:17:48.037659+0000","last_clean":"2023-10-06T02:17:48.037659+0000","last_became_active":"2023-10-06T02:17:44.027000+0000","last_became_peered":"2023-10-06T02:17:44.027000+0000","last_unstale":"2023-10-06T02:17:48.037659+0000","last_undegraded":"2023-10-06T02:17:48.037659+0000","last_fullsized":"2023-10-06T02:17:48.037659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:54.531796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037439+0000","last_change":"2023-10-06T02:17:44.013835+0000","last_active":"2023-10-06T02:17:48.037439+0000","last_peered":"2023-10-06T02:17:48.037439+0000","last_clean":"2023-10-06T02:17:48.037439+0000","last_became_active":"2023-10-06T02:17:44.013543+0000","last_became_peered":"2023-10-06T02:17:44.013543+0000","last_unstale":"2023-10-06T02:17:48.037439+0000","last_undegraded":"2023-10-06T02:17:48.037439+0000","last_fullsized":"2023-10-06T02:17:48.037439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:03.459533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036293+0000","last_change":"2023-10-06T02:17:44.016297+0000","last_active":"2023-10-06T02:17:48.036293+0000","last_peered":"2023-10-06T02:17:48.036293+0000","last_clean":"2023-10-06T02:17:48.036293+0000","last_became_active":"2023-10-06T02:17:44.016019+0000","last_became_peered":"2023-10-06T02:17:44.016019+0000","last_unstale":"2023-10-06T02:17:48.036293+0000","last_undegraded":"2023-10-06T02:17:48.036293+0000","last_fullsized":"2023-10-06T02:17:48.036293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:04.413740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030759+0000","last_change":"2023-10-06T02:17:44.017824+0000","last_active":"2023-10-06T02:17:48.030759+0000","last_peered":"2023-10-06T02:17:48.030759+0000","last_clean":"2023-10-06T02:17:48.030759+0000","last_became_active":"2023-10-06T02:17:44.017300+0000","last_became_peered":"2023-10-06T02:17:44.017300+0000","last_unstale":"2023-10-06T02:17:48.030759+0000","last_undegraded":"2023-10-06T02:17:48.030759+0000","last_fullsized":"2023-10-06T02:17:48.030759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:12.939706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.041971+0000","last_change":"2023-10-06T02:17:44.015364+0000","last_active":"2023-10-06T02:17:48.041971+0000","last_peered":"2023-10-06T02:17:48.041971+0000","last_clean":"2023-10-06T02:17:48.041971+0000","last_became_active":"2023-10-06T02:17:44.009665+0000","last_became_peered":"2023-10-06T02:17:44.009665+0000","last_unstale":"2023-10-06T02:17:48.041971+0000","last_undegraded":"2023-10-06T02:17:48.041971+0000","last_fullsized":"2023-10-06T02:17:48.041971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:12.022239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038636+0000","last_change":"2023-10-06T02:17:44.015097+0000","last_active":"2023-10-06T02:17:48.038636+0000","last_peered":"2023-10-06T02:17:48.038636+0000","last_clean":"2023-10-06T02:17:48.038636+0000","last_became_active":"2023-10-06T02:17:44.014831+0000","last_became_peered":"2023-10-06T02:17:44.014831+0000","last_unstale":"2023-10-06T02:17:48.038636+0000","last_undegraded":"2023-10-06T02:17:48.038636+0000","last_fullsized":"2023-10-06T02:17:48.038636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:00.943603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031356+0000","last_change":"2023-10-06T02:17:44.015300+0000","last_active":"2023-10-06T02:17:48.031356+0000","last_peered":"2023-10-06T02:17:48.031356+0000","last_clean":"2023-10-06T02:17:48.031356+0000","last_became_active":"2023-10-06T02:17:44.015015+0000","last_became_peered":"2023-10-06T02:17:44.015015+0000","last_unstale":"2023-10-06T02:17:48.031356+0000","last_undegraded":"2023-10-06T02:17:48.031356+0000","last_fullsized":"2023-10-06T02:17:48.031356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:30.550259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030945+0000","last_change":"2023-10-06T02:17:44.009268+0000","last_active":"2023-10-06T02:17:48.030945+0000","last_peered":"2023-10-06T02:17:48.030945+0000","last_clean":"2023-10-06T02:17:48.030945+0000","last_became_active":"2023-10-06T02:17:44.008958+0000","last_became_peered":"2023-10-06T02:17:44.008958+0000","last_unstale":"2023-10-06T02:17:48.030945+0000","last_undegraded":"2023-10-06T02:17:48.030945+0000","last_fullsized":"2023-10-06T02:17:48.030945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:35.516151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037800+0000","last_change":"2023-10-06T02:17:44.015486+0000","last_active":"2023-10-06T02:17:48.037800+0000","last_peered":"2023-10-06T02:17:48.037800+0000","last_clean":"2023-10-06T02:17:48.037800+0000","last_became_active":"2023-10-06T02:17:44.009594+0000","last_became_peered":"2023-10-06T02:17:44.009594+0000","last_unstale":"2023-10-06T02:17:48.037800+0000","last_undegraded":"2023-10-06T02:17:48.037800+0000","last_fullsized":"2023-10-06T02:17:48.037800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:14.067335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.035580+0000","last_change":"2023-10-06T02:17:44.014327+0000","last_active":"2023-10-06T02:17:48.035580+0000","last_peered":"2023-10-06T02:17:48.035580+0000","last_clean":"2023-10-06T02:17:48.035580+0000","last_became_active":"2023-10-06T02:17:44.014076+0000","last_became_peered":"2023-10-06T02:17:44.014076+0000","last_unstale":"2023-10-06T02:17:48.035580+0000","last_undegraded":"2023-10-06T02:17:48.035580+0000","last_fullsized":"2023-10-06T02:17:48.035580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:41.549349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036877+0000","last_change":"2023-10-06T02:17:44.022392+0000","last_active":"2023-10-06T02:17:48.036877+0000","last_peered":"2023-10-06T02:17:48.036877+0000","last_clean":"2023-10-06T02:17:48.036877+0000","last_became_active":"2023-10-06T02:17:44.022145+0000","last_became_peered":"2023-10-06T02:17:44.022145+0000","last_unstale":"2023-10-06T02:17:48.036877+0000","last_undegraded":"2023-10-06T02:17:48.036877+0000","last_fullsized":"2023-10-06T02:17:48.036877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:29.729845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030860+0000","last_change":"2023-10-06T02:17:44.018022+0000","last_active":"2023-10-06T02:17:48.030860+0000","last_peered":"2023-10-06T02:17:48.030860+0000","last_clean":"2023-10-06T02:17:48.030860+0000","last_became_active":"2023-10-06T02:17:44.017617+0000","last_became_peered":"2023-10-06T02:17:44.017617+0000","last_unstale":"2023-10-06T02:17:48.030860+0000","last_undegraded":"2023-10-06T02:17:48.030860+0000","last_fullsized":"2023-10-06T02:17:48.030860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.500461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.044943+0000","last_change":"2023-10-06T02:17:44.014002+0000","last_active":"2023-10-06T02:17:48.044943+0000","last_peered":"2023-10-06T02:17:48.044943+0000","last_clean":"2023-10-06T02:17:48.044943+0000","last_became_active":"2023-10-06T02:17:44.013756+0000","last_became_peered":"2023-10-06T02:17:44.013756+0000","last_unstale":"2023-10-06T02:17:48.044943+0000","last_undegraded":"2023-10-06T02:17:48.044943+0000","last_fullsized":"2023-10-06T02:17:48.044943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:05.747241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031920+0000","last_change":"2023-10-06T02:17:44.013965+0000","last_active":"2023-10-06T02:17:48.031920+0000","last_peered":"2023-10-06T02:17:48.031920+0000","last_clean":"2023-10-06T02:17:48.031920+0000","last_became_active":"2023-10-06T02:17:44.013512+0000","last_became_peered":"2023-10-06T02:17:44.013512+0000","last_unstale":"2023-10-06T02:17:48.031920+0000","last_undegraded":"2023-10-06T02:17:48.031920+0000","last_fullsized":"2023-10-06T02:17:48.031920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:00.061174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040168+0000","last_change":"2023-10-06T02:17:44.021614+0000","last_active":"2023-10-06T02:17:48.040168+0000","last_peered":"2023-10-06T02:17:48.040168+0000","last_clean":"2023-10-06T02:17:48.040168+0000","last_became_active":"2023-10-06T02:17:44.021377+0000","last_became_peered":"2023-10-06T02:17:44.021377+0000","last_unstale":"2023-10-06T02:17:48.040168+0000","last_undegraded":"2023-10-06T02:17:48.040168+0000","last_fullsized":"2023-10-06T02:17:48.040168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:39.014780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040828+0000","last_change":"2023-10-06T02:17:44.018105+0000","last_active":"2023-10-06T02:17:48.040828+0000","last_peered":"2023-10-06T02:17:48.040828+0000","last_clean":"2023-10-06T02:17:48.040828+0000","last_became_active":"2023-10-06T02:17:44.017812+0000","last_became_peered":"2023-10-06T02:17:44.017812+0000","last_unstale":"2023-10-06T02:17:48.040828+0000","last_undegraded":"2023-10-06T02:17:48.040828+0000","last_fullsized":"2023-10-06T02:17:48.040828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030387+0000","last_change":"2023-10-06T02:17:44.016308+0000","last_active":"2023-10-06T02:17:48.030387+0000","last_peered":"2023-10-06T02:17:48.030387+0000","last_clean":"2023-10-06T02:17:48.030387+0000","last_became_active":"2023-10-06T02:17:44.016107+0000","last_became_peered":"2023-10-06T02:17:44.016107+0000","last_unstale":"2023-10-06T02:17:48.030387+0000","last_undegraded":"2023-10-06T02:17:48.030387+0000","last_fullsized":"2023-10-06T02:17:48.030387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:43.352906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.032262+0000","last_change":"2023-10-06T02:17:44.026872+0000","last_active":"2023-10-06T02:17:48.032262+0000","last_peered":"2023-10-06T02:17:48.032262+0000","last_clean":"2023-10-06T02:17:48.032262+0000","last_became_active":"2023-10-06T02:17:44.026595+0000","last_became_peered":"2023-10-06T02:17:44.026595+0000","last_unstale":"2023-10-06T02:17:48.032262+0000","last_undegraded":"2023-10-06T02:17:48.032262+0000","last_fullsized":"2023-10-06T02:17:48.032262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:54.531796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036348+0000","last_change":"2023-10-06T02:17:44.009432+0000","last_active":"2023-10-06T02:17:48.036348+0000","last_peered":"2023-10-06T02:17:48.036348+0000","last_clean":"2023-10-06T02:17:48.036348+0000","last_became_active":"2023-10-06T02:17:44.009157+0000","last_became_peered":"2023-10-06T02:17:44.009157+0000","last_unstale":"2023-10-06T02:17:48.036348+0000","last_undegraded":"2023-10-06T02:17:48.036348+0000","last_fullsized":"2023-10-06T02:17:48.036348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.500461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050398+0000","last_change":"2023-10-06T02:17:44.020561+0000","last_active":"2023-10-06T02:17:48.050398+0000","last_peered":"2023-10-06T02:17:48.050398+0000","last_clean":"2023-10-06T02:17:48.050398+0000","last_became_active":"2023-10-06T02:17:44.020324+0000","last_became_peered":"2023-10-06T02:17:44.020324+0000","last_unstale":"2023-10-06T02:17:48.050398+0000","last_undegraded":"2023-10-06T02:17:48.050398+0000","last_fullsized":"2023-10-06T02:17:48.050398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:03.459533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050774+0000","last_change":"2023-10-06T02:17:44.009977+0000","last_active":"2023-10-06T02:17:48.050774+0000","last_peered":"2023-10-06T02:17:48.050774+0000","last_clean":"2023-10-06T02:17:48.050774+0000","last_became_active":"2023-10-06T02:17:44.009383+0000","last_became_peered":"2023-10-06T02:17:44.009383+0000","last_unstale":"2023-10-06T02:17:48.050774+0000","last_undegraded":"2023-10-06T02:17:48.050774+0000","last_fullsized":"2023-10-06T02:17:48.050774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:14.067335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040285+0000","last_change":"2023-10-06T02:17:44.022518+0000","last_active":"2023-10-06T02:17:48.040285+0000","last_peered":"2023-10-06T02:17:48.040285+0000","last_clean":"2023-10-06T02:17:48.040285+0000","last_became_active":"2023-10-06T02:17:44.022094+0000","last_became_peered":"2023-10-06T02:17:44.022094+0000","last_unstale":"2023-10-06T02:17:48.040285+0000","last_undegraded":"2023-10-06T02:17:48.040285+0000","last_fullsized":"2023-10-06T02:17:48.040285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.500461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.063071+0000","last_change":"2023-10-06T02:17:48.060017+0000","last_active":"2023-10-06T02:17:48.063071+0000","last_peered":"2023-10-06T02:17:48.063071+0000","last_clean":"2023-10-06T02:17:48.063071+0000","last_became_active":"2023-10-06T02:17:48.059609+0000","last_became_peered":"2023-10-06T02:17:48.059609+0000","last_unstale":"2023-10-06T02:17:48.063071+0000","last_undegraded":"2023-10-06T02:17:48.063071+0000","last_fullsized":"2023-10-06T02:17:48.063071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:46.132017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037608+0000","last_change":"2023-10-06T02:17:43.010345+0000","last_active":"2023-10-06T02:17:48.037608+0000","last_peered":"2023-10-06T02:17:48.037608+0000","last_clean":"2023-10-06T02:17:48.037608+0000","last_became_active":"2023-10-06T02:17:43.006363+0000","last_became_peered":"2023-10-06T02:17:43.006363+0000","last_unstale":"2023-10-06T02:17:48.037608+0000","last_undegraded":"2023-10-06T02:17:48.037608+0000","last_fullsized":"2023-10-06T02:17:48.037608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030384+0000","last_change":"2023-10-06T02:17:44.017786+0000","last_active":"2023-10-06T02:17:48.030384+0000","last_peered":"2023-10-06T02:17:48.030384+0000","last_clean":"2023-10-06T02:17:48.030384+0000","last_became_active":"2023-10-06T02:17:44.016986+0000","last_became_peered":"2023-10-06T02:17:44.016986+0000","last_unstale":"2023-10-06T02:17:48.030384+0000","last_undegraded":"2023-10-06T02:17:48.030384+0000","last_fullsized":"2023-10-06T02:17:48.030384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:49.992736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.053196+0000","last_change":"2023-10-06T02:17:48.051657+0000","last_active":"2023-10-06T02:17:48.053196+0000","last_peered":"2023-10-06T02:17:48.053196+0000","last_clean":"2023-10-06T02:17:48.053196+0000","last_became_active":"2023-10-06T02:17:48.051307+0000","last_became_peered":"2023-10-06T02:17:48.051307+0000","last_unstale":"2023-10-06T02:17:48.053196+0000","last_undegraded":"2023-10-06T02:17:48.053196+0000","last_fullsized":"2023-10-06T02:17:48.053196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:09.781175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045264+0000","last_change":"2023-10-06T02:17:43.002992+0000","last_active":"2023-10-06T02:17:48.045264+0000","last_peered":"2023-10-06T02:17:48.045264+0000","last_clean":"2023-10-06T02:17:48.045264+0000","last_became_active":"2023-10-06T02:17:43.002502+0000","last_became_peered":"2023-10-06T02:17:43.002502+0000","last_unstale":"2023-10-06T02:17:48.045264+0000","last_undegraded":"2023-10-06T02:17:48.045264+0000","last_fullsized":"2023-10-06T02:17:48.045264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031835+0000","last_change":"2023-10-06T02:17:44.021171+0000","last_active":"2023-10-06T02:17:48.031835+0000","last_peered":"2023-10-06T02:17:48.031835+0000","last_clean":"2023-10-06T02:17:48.031835+0000","last_became_active":"2023-10-06T02:17:44.016443+0000","last_became_peered":"2023-10-06T02:17:44.016443+0000","last_unstale":"2023-10-06T02:17:48.031835+0000","last_undegraded":"2023-10-06T02:17:48.031835+0000","last_fullsized":"2023-10-06T02:17:48.031835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:49.992736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.059150+0000","last_change":"2023-10-06T02:17:48.053835+0000","last_active":"2023-10-06T02:17:48.059150+0000","last_peered":"2023-10-06T02:17:48.059150+0000","last_clean":"2023-10-06T02:17:48.059150+0000","last_became_active":"2023-10-06T02:17:48.053399+0000","last_became_peered":"2023-10-06T02:17:48.053399+0000","last_unstale":"2023-10-06T02:17:48.059150+0000","last_undegraded":"2023-10-06T02:17:48.059150+0000","last_fullsized":"2023-10-06T02:17:48.059150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:20.633926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031624+0000","last_change":"2023-10-06T02:17:43.005151+0000","last_active":"2023-10-06T02:17:48.031624+0000","last_peered":"2023-10-06T02:17:48.031624+0000","last_clean":"2023-10-06T02:17:48.031624+0000","last_became_active":"2023-10-06T02:17:43.004709+0000","last_became_peered":"2023-10-06T02:17:43.004709+0000","last_unstale":"2023-10-06T02:17:48.031624+0000","last_undegraded":"2023-10-06T02:17:48.031624+0000","last_fullsized":"2023-10-06T02:17:48.031624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:32.002499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039892+0000","last_change":"2023-10-06T02:17:44.025569+0000","last_active":"2023-10-06T02:17:48.039892+0000","last_peered":"2023-10-06T02:17:48.039892+0000","last_clean":"2023-10-06T02:17:48.039892+0000","last_became_active":"2023-10-06T02:17:44.025261+0000","last_became_peered":"2023-10-06T02:17:44.025261+0000","last_unstale":"2023-10-06T02:17:48.039892+0000","last_undegraded":"2023-10-06T02:17:48.039892+0000","last_fullsized":"2023-10-06T02:17:48.039892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:47.847314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.053261+0000","last_change":"2023-10-06T02:17:48.052637+0000","last_active":"2023-10-06T02:17:48.053261+0000","last_peered":"2023-10-06T02:17:48.053261+0000","last_clean":"2023-10-06T02:17:48.053261+0000","last_became_active":"2023-10-06T02:17:48.052223+0000","last_became_peered":"2023-10-06T02:17:48.052223+0000","last_unstale":"2023-10-06T02:17:48.053261+0000","last_undegraded":"2023-10-06T02:17:48.053261+0000","last_fullsized":"2023-10-06T02:17:48.053261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:33.763779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030951+0000","last_change":"2023-10-06T02:17:43.013718+0000","last_active":"2023-10-06T02:17:48.030951+0000","last_peered":"2023-10-06T02:17:48.030951+0000","last_clean":"2023-10-06T02:17:48.030951+0000","last_became_active":"2023-10-06T02:17:43.013415+0000","last_became_peered":"2023-10-06T02:17:43.013415+0000","last_unstale":"2023-10-06T02:17:48.030951+0000","last_undegraded":"2023-10-06T02:17:48.030951+0000","last_fullsized":"2023-10-06T02:17:48.030951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:59.054001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031512+0000","last_change":"2023-10-06T02:17:44.011855+0000","last_active":"2023-10-06T02:17:48.031512+0000","last_peered":"2023-10-06T02:17:48.031512+0000","last_clean":"2023-10-06T02:17:48.031512+0000","last_became_active":"2023-10-06T02:17:44.011583+0000","last_became_peered":"2023-10-06T02:17:44.011583+0000","last_unstale":"2023-10-06T02:17:48.031512+0000","last_undegraded":"2023-10-06T02:17:48.031512+0000","last_fullsized":"2023-10-06T02:17:48.031512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:01.914117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060333+0000","last_change":"2023-10-06T02:17:48.057256+0000","last_active":"2023-10-06T02:17:48.060333+0000","last_peered":"2023-10-06T02:17:48.060333+0000","last_clean":"2023-10-06T02:17:48.060333+0000","last_became_active":"2023-10-06T02:17:48.056749+0000","last_became_peered":"2023-10-06T02:17:48.056749+0000","last_unstale":"2023-10-06T02:17:48.060333+0000","last_undegraded":"2023-10-06T02:17:48.060333+0000","last_fullsized":"2023-10-06T02:17:48.060333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:29.446681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.041892+0000","last_change":"2023-10-06T02:17:43.013316+0000","last_active":"2023-10-06T02:17:48.041892+0000","last_peered":"2023-10-06T02:17:48.041892+0000","last_clean":"2023-10-06T02:17:48.041892+0000","last_became_active":"2023-10-06T02:17:43.013020+0000","last_became_peered":"2023-10-06T02:17:43.013020+0000","last_unstale":"2023-10-06T02:17:48.041892+0000","last_undegraded":"2023-10-06T02:17:48.041892+0000","last_fullsized":"2023-10-06T02:17:48.041892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:55.863203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030030+0000","last_change":"2023-10-06T02:17:44.017554+0000","last_active":"2023-10-06T02:17:48.030030+0000","last_peered":"2023-10-06T02:17:48.030030+0000","last_clean":"2023-10-06T02:17:48.030030+0000","last_became_active":"2023-10-06T02:17:44.017288+0000","last_became_peered":"2023-10-06T02:17:44.017288+0000","last_unstale":"2023-10-06T02:17:48.030030+0000","last_undegraded":"2023-10-06T02:17:48.030030+0000","last_fullsized":"2023-10-06T02:17:48.030030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:12.939706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050983+0000","last_change":"2023-10-06T02:17:48.049234+0000","last_active":"2023-10-06T02:17:48.050983+0000","last_peered":"2023-10-06T02:17:48.050983+0000","last_clean":"2023-10-06T02:17:48.050983+0000","last_became_active":"2023-10-06T02:17:48.048823+0000","last_became_peered":"2023-10-06T02:17:48.048823+0000","last_unstale":"2023-10-06T02:17:48.050983+0000","last_undegraded":"2023-10-06T02:17:48.050983+0000","last_fullsized":"2023-10-06T02:17:48.050983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:23.461660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036812+0000","last_change":"2023-10-06T02:17:43.012321+0000","last_active":"2023-10-06T02:17:48.036812+0000","last_peered":"2023-10-06T02:17:48.036812+0000","last_clean":"2023-10-06T02:17:48.036812+0000","last_became_active":"2023-10-06T02:17:43.012039+0000","last_became_peered":"2023-10-06T02:17:43.012039+0000","last_unstale":"2023-10-06T02:17:48.036812+0000","last_undegraded":"2023-10-06T02:17:48.036812+0000","last_fullsized":"2023-10-06T02:17:48.036812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:56.588125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.046506+0000","last_change":"2023-10-06T02:17:44.019691+0000","last_active":"2023-10-06T02:17:48.046506+0000","last_peered":"2023-10-06T02:17:48.046506+0000","last_clean":"2023-10-06T02:17:48.046506+0000","last_became_active":"2023-10-06T02:17:44.018879+0000","last_became_peered":"2023-10-06T02:17:44.018879+0000","last_unstale":"2023-10-06T02:17:48.046506+0000","last_undegraded":"2023-10-06T02:17:48.046506+0000","last_fullsized":"2023-10-06T02:17:48.046506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:22.411698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.061948+0000","last_change":"2023-10-06T02:17:48.060182+0000","last_active":"2023-10-06T02:17:48.061948+0000","last_peered":"2023-10-06T02:17:48.061948+0000","last_clean":"2023-10-06T02:17:48.061948+0000","last_became_active":"2023-10-06T02:17:48.058134+0000","last_became_peered":"2023-10-06T02:17:48.058134+0000","last_unstale":"2023-10-06T02:17:48.061948+0000","last_undegraded":"2023-10-06T02:17:48.061948+0000","last_fullsized":"2023-10-06T02:17:48.061948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:40.330578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T02:17:53.898409+0000","last_change":"2023-10-06T02:17:43.011660+0000","last_active":"2023-10-06T02:17:53.898409+0000","last_peered":"2023-10-06T02:17:53.898409+0000","last_clean":"2023-10-06T02:17:53.898409+0000","last_became_active":"2023-10-06T02:17:43.011360+0000","last_became_peered":"2023-10-06T02:17:43.011360+0000","last_unstale":"2023-10-06T02:17:53.898409+0000","last_undegraded":"2023-10-06T02:17:53.898409+0000","last_fullsized":"2023-10-06T02:17:53.898409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:34.508977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039053+0000","last_change":"2023-10-06T02:17:44.019835+0000","last_active":"2023-10-06T02:17:48.039053+0000","last_peered":"2023-10-06T02:17:48.039053+0000","last_clean":"2023-10-06T02:17:48.039053+0000","last_became_active":"2023-10-06T02:17:44.019567+0000","last_became_peered":"2023-10-06T02:17:44.019567+0000","last_unstale":"2023-10-06T02:17:48.039053+0000","last_undegraded":"2023-10-06T02:17:48.039053+0000","last_fullsized":"2023-10-06T02:17:48.039053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:36.296644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060685+0000","last_change":"2023-10-06T02:17:48.058253+0000","last_active":"2023-10-06T02:17:48.060685+0000","last_peered":"2023-10-06T02:17:48.060685+0000","last_clean":"2023-10-06T02:17:48.060685+0000","last_became_active":"2023-10-06T02:17:48.057801+0000","last_became_peered":"2023-10-06T02:17:48.057801+0000","last_unstale":"2023-10-06T02:17:48.060685+0000","last_undegraded":"2023-10-06T02:17:48.060685+0000","last_fullsized":"2023-10-06T02:17:48.060685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:34.306615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036359+0000","last_change":"2023-10-06T02:17:43.014116+0000","last_active":"2023-10-06T02:17:48.036359+0000","last_peered":"2023-10-06T02:17:48.036359+0000","last_clean":"2023-10-06T02:17:48.036359+0000","last_became_active":"2023-10-06T02:17:43.013686+0000","last_became_peered":"2023-10-06T02:17:43.013686+0000","last_unstale":"2023-10-06T02:17:48.036359+0000","last_undegraded":"2023-10-06T02:17:48.036359+0000","last_fullsized":"2023-10-06T02:17:48.036359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:42.345733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030529+0000","last_change":"2023-10-06T02:17:44.023536+0000","last_active":"2023-10-06T02:17:48.030529+0000","last_peered":"2023-10-06T02:17:48.030529+0000","last_clean":"2023-10-06T02:17:48.030529+0000","last_became_active":"2023-10-06T02:17:44.023272+0000","last_became_peered":"2023-10-06T02:17:44.023272+0000","last_unstale":"2023-10-06T02:17:48.030529+0000","last_undegraded":"2023-10-06T02:17:48.030529+0000","last_fullsized":"2023-10-06T02:17:48.030529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:47.126256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.052236+0000","last_change":"2023-10-06T02:17:48.049593+0000","last_active":"2023-10-06T02:17:48.052236+0000","last_peered":"2023-10-06T02:17:48.052236+0000","last_clean":"2023-10-06T02:17:48.052236+0000","last_became_active":"2023-10-06T02:17:48.048578+0000","last_became_peered":"2023-10-06T02:17:48.048578+0000","last_unstale":"2023-10-06T02:17:48.052236+0000","last_undegraded":"2023-10-06T02:17:48.052236+0000","last_fullsized":"2023-10-06T02:17:48.052236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:56.628094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030542+0000","last_change":"2023-10-06T02:17:43.010082+0000","last_active":"2023-10-06T02:17:48.030542+0000","last_peered":"2023-10-06T02:17:48.030542+0000","last_clean":"2023-10-06T02:17:48.030542+0000","last_became_active":"2023-10-06T02:17:43.009750+0000","last_became_peered":"2023-10-06T02:17:43.009750+0000","last_unstale":"2023-10-06T02:17:48.030542+0000","last_undegraded":"2023-10-06T02:17:48.030542+0000","last_fullsized":"2023-10-06T02:17:48.030542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040202+0000","last_change":"2023-10-06T02:17:44.022344+0000","last_active":"2023-10-06T02:17:48.040202+0000","last_peered":"2023-10-06T02:17:48.040202+0000","last_clean":"2023-10-06T02:17:48.040202+0000","last_became_active":"2023-10-06T02:17:44.021817+0000","last_became_peered":"2023-10-06T02:17:44.021817+0000","last_unstale":"2023-10-06T02:17:48.040202+0000","last_undegraded":"2023-10-06T02:17:48.040202+0000","last_fullsized":"2023-10-06T02:17:48.040202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.051438+0000","last_change":"2023-10-06T02:17:48.050036+0000","last_active":"2023-10-06T02:17:48.051438+0000","last_peered":"2023-10-06T02:17:48.051438+0000","last_clean":"2023-10-06T02:17:48.051438+0000","last_became_active":"2023-10-06T02:17:48.049595+0000","last_became_peered":"2023-10-06T02:17:48.049595+0000","last_unstale":"2023-10-06T02:17:48.051438+0000","last_undegraded":"2023-10-06T02:17:48.051438+0000","last_fullsized":"2023-10-06T02:17:48.051438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:09:38.509689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037346+0000","last_change":"2023-10-06T02:17:43.014038+0000","last_active":"2023-10-06T02:17:48.037346+0000","last_peered":"2023-10-06T02:17:48.037346+0000","last_clean":"2023-10-06T02:17:48.037346+0000","last_became_active":"2023-10-06T02:17:43.013419+0000","last_became_peered":"2023-10-06T02:17:43.013419+0000","last_unstale":"2023-10-06T02:17:48.037346+0000","last_undegraded":"2023-10-06T02:17:48.037346+0000","last_fullsized":"2023-10-06T02:17:48.037346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:46.840141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.032077+0000","last_change":"2023-10-06T02:17:44.015494+0000","last_active":"2023-10-06T02:17:48.032077+0000","last_peered":"2023-10-06T02:17:48.032077+0000","last_clean":"2023-10-06T02:17:48.032077+0000","last_became_active":"2023-10-06T02:17:44.012435+0000","last_became_peered":"2023-10-06T02:17:44.012435+0000","last_unstale":"2023-10-06T02:17:48.032077+0000","last_undegraded":"2023-10-06T02:17:48.032077+0000","last_fullsized":"2023-10-06T02:17:48.032077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:03.459533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060832+0000","last_change":"2023-10-06T02:17:48.056039+0000","last_active":"2023-10-06T02:17:48.060832+0000","last_peered":"2023-10-06T02:17:48.060832+0000","last_clean":"2023-10-06T02:17:48.060832+0000","last_became_active":"2023-10-06T02:17:48.055610+0000","last_became_peered":"2023-10-06T02:17:48.055610+0000","last_unstale":"2023-10-06T02:17:48.060832+0000","last_undegraded":"2023-10-06T02:17:48.060832+0000","last_fullsized":"2023-10-06T02:17:48.060832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:05.386590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039054+0000","last_change":"2023-10-06T02:17:43.009311+0000","last_active":"2023-10-06T02:17:48.039054+0000","last_peered":"2023-10-06T02:17:48.039054+0000","last_clean":"2023-10-06T02:17:48.039054+0000","last_became_active":"2023-10-06T02:17:43.009019+0000","last_became_peered":"2023-10-06T02:17:43.009019+0000","last_unstale":"2023-10-06T02:17:48.039054+0000","last_undegraded":"2023-10-06T02:17:48.039054+0000","last_fullsized":"2023-10-06T02:17:48.039054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:34.508977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031131+0000","last_change":"2023-10-06T02:17:44.022053+0000","last_active":"2023-10-06T02:17:48.031131+0000","last_peered":"2023-10-06T02:17:48.031131+0000","last_clean":"2023-10-06T02:17:48.031131+0000","last_became_active":"2023-10-06T02:17:44.021420+0000","last_became_peered":"2023-10-06T02:17:44.021420+0000","last_unstale":"2023-10-06T02:17:48.031131+0000","last_undegraded":"2023-10-06T02:17:48.031131+0000","last_fullsized":"2023-10-06T02:17:48.031131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:03.459533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060798+0000","last_change":"2023-10-06T02:17:48.058632+0000","last_active":"2023-10-06T02:17:48.060798+0000","last_peered":"2023-10-06T02:17:48.060798+0000","last_clean":"2023-10-06T02:17:48.060798+0000","last_became_active":"2023-10-06T02:17:48.056462+0000","last_became_peered":"2023-10-06T02:17:48.056462+0000","last_unstale":"2023-10-06T02:17:48.060798+0000","last_undegraded":"2023-10-06T02:17:48.060798+0000","last_fullsized":"2023-10-06T02:17:48.060798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:19.585456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037962+0000","last_change":"2023-10-06T02:17:43.014971+0000","last_active":"2023-10-06T02:17:48.037962+0000","last_peered":"2023-10-06T02:17:48.037962+0000","last_clean":"2023-10-06T02:17:48.037962+0000","last_became_active":"2023-10-06T02:17:43.014645+0000","last_became_peered":"2023-10-06T02:17:43.014645+0000","last_unstale":"2023-10-06T02:17:48.037962+0000","last_undegraded":"2023-10-06T02:17:48.037962+0000","last_fullsized":"2023-10-06T02:17:48.037962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:31.096309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036178+0000","last_change":"2023-10-06T02:17:44.017176+0000","last_active":"2023-10-06T02:17:48.036178+0000","last_peered":"2023-10-06T02:17:48.036178+0000","last_clean":"2023-10-06T02:17:48.036178+0000","last_became_active":"2023-10-06T02:17:44.016900+0000","last_became_peered":"2023-10-06T02:17:44.016900+0000","last_unstale":"2023-10-06T02:17:48.036178+0000","last_undegraded":"2023-10-06T02:17:48.036178+0000","last_fullsized":"2023-10-06T02:17:48.036178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:21.073260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.058961+0000","last_change":"2023-10-06T02:17:48.056709+0000","last_active":"2023-10-06T02:17:48.058961+0000","last_peered":"2023-10-06T02:17:48.058961+0000","last_clean":"2023-10-06T02:17:48.058961+0000","last_became_active":"2023-10-06T02:17:48.056245+0000","last_became_peered":"2023-10-06T02:17:48.056245+0000","last_unstale":"2023-10-06T02:17:48.058961+0000","last_undegraded":"2023-10-06T02:17:48.058961+0000","last_fullsized":"2023-10-06T02:17:48.058961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:58.565730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038561+0000","last_change":"2023-10-06T02:17:43.015636+0000","last_active":"2023-10-06T02:17:48.038561+0000","last_peered":"2023-10-06T02:17:48.038561+0000","last_clean":"2023-10-06T02:17:48.038561+0000","last_became_active":"2023-10-06T02:17:43.013756+0000","last_became_peered":"2023-10-06T02:17:43.013756+0000","last_unstale":"2023-10-06T02:17:48.038561+0000","last_undegraded":"2023-10-06T02:17:48.038561+0000","last_fullsized":"2023-10-06T02:17:48.038561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:21.985046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045110+0000","last_change":"2023-10-06T02:17:44.019216+0000","last_active":"2023-10-06T02:17:48.045110+0000","last_peered":"2023-10-06T02:17:48.045110+0000","last_clean":"2023-10-06T02:17:48.045110+0000","last_became_active":"2023-10-06T02:17:44.018743+0000","last_became_peered":"2023-10-06T02:17:44.018743+0000","last_unstale":"2023-10-06T02:17:48.045110+0000","last_undegraded":"2023-10-06T02:17:48.045110+0000","last_fullsized":"2023-10-06T02:17:48.045110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:47.126256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.049041+0000","last_change":"2023-10-06T02:17:48.047120+0000","last_active":"2023-10-06T02:17:48.049041+0000","last_peered":"2023-10-06T02:17:48.049041+0000","last_clean":"2023-10-06T02:17:48.049041+0000","last_became_active":"2023-10-06T02:17:48.046716+0000","last_became_peered":"2023-10-06T02:17:48.046716+0000","last_unstale":"2023-10-06T02:17:48.049041+0000","last_undegraded":"2023-10-06T02:17:48.049041+0000","last_fullsized":"2023-10-06T02:17:48.049041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:01.000290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036700+0000","last_change":"2023-10-06T02:17:43.014454+0000","last_active":"2023-10-06T02:17:48.036700+0000","last_peered":"2023-10-06T02:17:48.036700+0000","last_clean":"2023-10-06T02:17:48.036700+0000","last_became_active":"2023-10-06T02:17:43.014185+0000","last_became_peered":"2023-10-06T02:17:43.014185+0000","last_unstale":"2023-10-06T02:17:48.036700+0000","last_undegraded":"2023-10-06T02:17:48.036700+0000","last_fullsized":"2023-10-06T02:17:48.036700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:32.002499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037390+0000","last_change":"2023-10-06T02:17:44.021996+0000","last_active":"2023-10-06T02:17:48.037390+0000","last_peered":"2023-10-06T02:17:48.037390+0000","last_clean":"2023-10-06T02:17:48.037390+0000","last_became_active":"2023-10-06T02:17:44.020844+0000","last_became_peered":"2023-10-06T02:17:44.020844+0000","last_unstale":"2023-10-06T02:17:48.037390+0000","last_undegraded":"2023-10-06T02:17:48.037390+0000","last_fullsized":"2023-10-06T02:17:48.037390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:04.413740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.059287+0000","last_change":"2023-10-06T02:17:48.052318+0000","last_active":"2023-10-06T02:17:48.059287+0000","last_peered":"2023-10-06T02:17:48.059287+0000","last_clean":"2023-10-06T02:17:48.059287+0000","last_became_active":"2023-10-06T02:17:48.051887+0000","last_became_peered":"2023-10-06T02:17:48.051887+0000","last_unstale":"2023-10-06T02:17:48.059287+0000","last_undegraded":"2023-10-06T02:17:48.059287+0000","last_fullsized":"2023-10-06T02:17:48.059287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:54.026670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039797+0000","last_change":"2023-10-06T02:17:43.017227+0000","last_active":"2023-10-06T02:17:48.039797+0000","last_peered":"2023-10-06T02:17:48.039797+0000","last_clean":"2023-10-06T02:17:48.039797+0000","last_became_active":"2023-10-06T02:17:43.016966+0000","last_became_peered":"2023-10-06T02:17:43.016966+0000","last_unstale":"2023-10-06T02:17:48.039797+0000","last_undegraded":"2023-10-06T02:17:48.039797+0000","last_fullsized":"2023-10-06T02:17:48.039797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.033379+0000","last_change":"2023-10-06T02:17:44.003483+0000","last_active":"2023-10-06T02:17:48.033379+0000","last_peered":"2023-10-06T02:17:48.033379+0000","last_clean":"2023-10-06T02:17:48.033379+0000","last_became_active":"2023-10-06T02:17:44.003206+0000","last_became_peered":"2023-10-06T02:17:44.003206+0000","last_unstale":"2023-10-06T02:17:48.033379+0000","last_undegraded":"2023-10-06T02:17:48.033379+0000","last_fullsized":"2023-10-06T02:17:48.033379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:41.549349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.053844+0000","last_change":"2023-10-06T02:17:48.048415+0000","last_active":"2023-10-06T02:17:48.053844+0000","last_peered":"2023-10-06T02:17:48.053844+0000","last_clean":"2023-10-06T02:17:48.053844+0000","last_became_active":"2023-10-06T02:17:48.048056+0000","last_became_peered":"2023-10-06T02:17:48.048056+0000","last_unstale":"2023-10-06T02:17:48.053844+0000","last_undegraded":"2023-10-06T02:17:48.053844+0000","last_fullsized":"2023-10-06T02:17:48.053844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:09.781175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030566+0000","last_change":"2023-10-06T02:17:43.012134+0000","last_active":"2023-10-06T02:17:48.030566+0000","last_peered":"2023-10-06T02:17:48.030566+0000","last_clean":"2023-10-06T02:17:48.030566+0000","last_became_active":"2023-10-06T02:17:43.011834+0000","last_became_peered":"2023-10-06T02:17:43.011834+0000","last_unstale":"2023-10-06T02:17:48.030566+0000","last_undegraded":"2023-10-06T02:17:48.030566+0000","last_fullsized":"2023-10-06T02:17:48.030566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.543085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039990+0000","last_change":"2023-10-06T02:17:44.024658+0000","last_active":"2023-10-06T02:17:48.039990+0000","last_peered":"2023-10-06T02:17:48.039990+0000","last_clean":"2023-10-06T02:17:48.039990+0000","last_became_active":"2023-10-06T02:17:44.023854+0000","last_became_peered":"2023-10-06T02:17:44.023854+0000","last_unstale":"2023-10-06T02:17:48.039990+0000","last_undegraded":"2023-10-06T02:17:48.039990+0000","last_fullsized":"2023-10-06T02:17:48.039990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:49.992736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.056354+0000","last_change":"2023-10-06T02:17:48.054318+0000","last_active":"2023-10-06T02:17:48.056354+0000","last_peered":"2023-10-06T02:17:48.056354+0000","last_clean":"2023-10-06T02:17:48.056354+0000","last_became_active":"2023-10-06T02:17:48.053924+0000","last_became_peered":"2023-10-06T02:17:48.053924+0000","last_unstale":"2023-10-06T02:17:48.056354+0000","last_undegraded":"2023-10-06T02:17:48.056354+0000","last_fullsized":"2023-10-06T02:17:48.056354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:29.446681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037465+0000","last_change":"2023-10-06T02:17:43.017268+0000","last_active":"2023-10-06T02:17:48.037465+0000","last_peered":"2023-10-06T02:17:48.037465+0000","last_clean":"2023-10-06T02:17:48.037465+0000","last_became_active":"2023-10-06T02:17:43.016981+0000","last_became_peered":"2023-10-06T02:17:43.016981+0000","last_unstale":"2023-10-06T02:17:48.037465+0000","last_undegraded":"2023-10-06T02:17:48.037465+0000","last_fullsized":"2023-10-06T02:17:48.037465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038414+0000","last_change":"2023-10-06T02:17:44.023712+0000","last_active":"2023-10-06T02:17:48.038414+0000","last_peered":"2023-10-06T02:17:48.038414+0000","last_clean":"2023-10-06T02:17:48.038414+0000","last_became_active":"2023-10-06T02:17:44.023412+0000","last_became_peered":"2023-10-06T02:17:44.023412+0000","last_unstale":"2023-10-06T02:17:48.038414+0000","last_undegraded":"2023-10-06T02:17:48.038414+0000","last_fullsized":"2023-10-06T02:17:48.038414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:26.577679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060912+0000","last_change":"2023-10-06T02:17:48.054660+0000","last_active":"2023-10-06T02:17:48.060912+0000","last_peered":"2023-10-06T02:17:48.060912+0000","last_clean":"2023-10-06T02:17:48.060912+0000","last_became_active":"2023-10-06T02:17:48.054270+0000","last_became_peered":"2023-10-06T02:17:48.054270+0000","last_unstale":"2023-10-06T02:17:48.060912+0000","last_undegraded":"2023-10-06T02:17:48.060912+0000","last_fullsized":"2023-10-06T02:17:48.060912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:59.085352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.044929+0000","last_change":"2023-10-06T02:17:43.013434+0000","last_active":"2023-10-06T02:17:48.044929+0000","last_peered":"2023-10-06T02:17:48.044929+0000","last_clean":"2023-10-06T02:17:48.044929+0000","last_became_active":"2023-10-06T02:17:43.013144+0000","last_became_peered":"2023-10-06T02:17:43.013144+0000","last_unstale":"2023-10-06T02:17:48.044929+0000","last_undegraded":"2023-10-06T02:17:48.044929+0000","last_fullsized":"2023-10-06T02:17:48.044929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:59.054001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045040+0000","last_change":"2023-10-06T02:17:44.020588+0000","last_active":"2023-10-06T02:17:48.045040+0000","last_peered":"2023-10-06T02:17:48.045040+0000","last_clean":"2023-10-06T02:17:48.045040+0000","last_became_active":"2023-10-06T02:17:44.020305+0000","last_became_peered":"2023-10-06T02:17:44.020305+0000","last_unstale":"2023-10-06T02:17:48.045040+0000","last_undegraded":"2023-10-06T02:17:48.045040+0000","last_fullsized":"2023-10-06T02:17:48.045040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:51.564963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.063145+0000","last_change":"2023-10-06T02:17:48.061567+0000","last_active":"2023-10-06T02:17:48.063145+0000","last_peered":"2023-10-06T02:17:48.063145+0000","last_clean":"2023-10-06T02:17:48.063145+0000","last_became_active":"2023-10-06T02:17:48.061209+0000","last_became_peered":"2023-10-06T02:17:48.061209+0000","last_unstale":"2023-10-06T02:17:48.063145+0000","last_undegraded":"2023-10-06T02:17:48.063145+0000","last_fullsized":"2023-10-06T02:17:48.063145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:05.058794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031418+0000","last_change":"2023-10-06T02:17:43.009617+0000","last_active":"2023-10-06T02:17:48.031418+0000","last_peered":"2023-10-06T02:17:48.031418+0000","last_clean":"2023-10-06T02:17:48.031418+0000","last_became_active":"2023-10-06T02:17:43.009347+0000","last_became_peered":"2023-10-06T02:17:43.009347+0000","last_unstale":"2023-10-06T02:17:48.031418+0000","last_undegraded":"2023-10-06T02:17:48.031418+0000","last_fullsized":"2023-10-06T02:17:48.031418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:59.054001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050566+0000","last_change":"2023-10-06T02:17:44.013663+0000","last_active":"2023-10-06T02:17:48.050566+0000","last_peered":"2023-10-06T02:17:48.050566+0000","last_clean":"2023-10-06T02:17:48.050566+0000","last_became_active":"2023-10-06T02:17:44.013346+0000","last_became_peered":"2023-10-06T02:17:44.013346+0000","last_unstale":"2023-10-06T02:17:48.050566+0000","last_undegraded":"2023-10-06T02:17:48.050566+0000","last_fullsized":"2023-10-06T02:17:48.050566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:21.073260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060535+0000","last_change":"2023-10-06T02:17:48.055404+0000","last_active":"2023-10-06T02:17:48.060535+0000","last_peered":"2023-10-06T02:17:48.060535+0000","last_clean":"2023-10-06T02:17:48.060535+0000","last_became_active":"2023-10-06T02:17:48.055037+0000","last_became_peered":"2023-10-06T02:17:48.055037+0000","last_unstale":"2023-10-06T02:17:48.060535+0000","last_undegraded":"2023-10-06T02:17:48.060535+0000","last_fullsized":"2023-10-06T02:17:48.060535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:39.126641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030793+0000","last_change":"2023-10-06T02:17:43.012193+0000","last_active":"2023-10-06T02:17:48.030793+0000","last_peered":"2023-10-06T02:17:48.030793+0000","last_clean":"2023-10-06T02:17:48.030793+0000","last_became_active":"2023-10-06T02:17:43.011988+0000","last_became_peered":"2023-10-06T02:17:43.011988+0000","last_unstale":"2023-10-06T02:17:48.030793+0000","last_undegraded":"2023-10-06T02:17:48.030793+0000","last_fullsized":"2023-10-06T02:17:48.030793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:56.588125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038558+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:17:48.038558+0000","last_peered":"2023-10-06T02:17:48.038558+0000","last_clean":"2023-10-06T02:17:48.038558+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:17:48.038558+0000","last_undegraded":"2023-10-06T02:17:48.038558+0000","last_fullsized":"2023-10-06T02:17:48.038558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031321+0000","last_change":"2023-10-06T02:17:44.017661+0000","last_active":"2023-10-06T02:17:48.031321+0000","last_peered":"2023-10-06T02:17:48.031321+0000","last_clean":"2023-10-06T02:17:48.031321+0000","last_became_active":"2023-10-06T02:17:44.017396+0000","last_became_peered":"2023-10-06T02:17:44.017396+0000","last_unstale":"2023-10-06T02:17:48.031321+0000","last_undegraded":"2023-10-06T02:17:48.031321+0000","last_fullsized":"2023-10-06T02:17:48.031321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.055474+0000","last_change":"2023-10-06T02:17:48.051546+0000","last_active":"2023-10-06T02:17:48.055474+0000","last_peered":"2023-10-06T02:17:48.055474+0000","last_clean":"2023-10-06T02:17:48.055474+0000","last_became_active":"2023-10-06T02:17:48.051146+0000","last_became_peered":"2023-10-06T02:17:48.051146+0000","last_unstale":"2023-10-06T02:17:48.055474+0000","last_undegraded":"2023-10-06T02:17:48.055474+0000","last_fullsized":"2023-10-06T02:17:48.055474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:03.948559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030433+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:17:48.030433+0000","last_peered":"2023-10-06T02:17:48.030433+0000","last_clean":"2023-10-06T02:17:48.030433+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:17:48.030433+0000","last_undegraded":"2023-10-06T02:17:48.030433+0000","last_fullsized":"2023-10-06T02:17:48.030433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.057902+0000","last_change":"2023-10-06T02:17:43.001598+0000","last_active":"2023-10-06T02:17:48.057902+0000","last_peered":"2023-10-06T02:17:48.057902+0000","last_clean":"2023-10-06T02:17:48.057902+0000","last_became_active":"2023-10-06T02:17:43.000830+0000","last_became_peered":"2023-10-06T02:17:43.000830+0000","last_unstale":"2023-10-06T02:17:48.057902+0000","last_undegraded":"2023-10-06T02:17:48.057902+0000","last_fullsized":"2023-10-06T02:17:48.057902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:31.631012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045023+0000","last_change":"2023-10-06T02:17:44.022761+0000","last_active":"2023-10-06T02:17:48.045023+0000","last_peered":"2023-10-06T02:17:48.045023+0000","last_clean":"2023-10-06T02:17:48.045023+0000","last_became_active":"2023-10-06T02:17:44.022519+0000","last_became_peered":"2023-10-06T02:17:44.022519+0000","last_unstale":"2023-10-06T02:17:48.045023+0000","last_undegraded":"2023-10-06T02:17:48.045023+0000","last_fullsized":"2023-10-06T02:17:48.045023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:01.914117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060933+0000","last_change":"2023-10-06T02:17:48.057692+0000","last_active":"2023-10-06T02:17:48.060933+0000","last_peered":"2023-10-06T02:17:48.060933+0000","last_clean":"2023-10-06T02:17:48.060933+0000","last_became_active":"2023-10-06T02:17:48.057291+0000","last_became_peered":"2023-10-06T02:17:48.057291+0000","last_unstale":"2023-10-06T02:17:48.060933+0000","last_undegraded":"2023-10-06T02:17:48.060933+0000","last_fullsized":"2023-10-06T02:17:48.060933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:50.051594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045953+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:17:48.045953+0000","last_peered":"2023-10-06T02:17:48.045953+0000","last_clean":"2023-10-06T02:17:48.045953+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:17:48.045953+0000","last_undegraded":"2023-10-06T02:17:48.045953+0000","last_fullsized":"2023-10-06T02:17:48.045953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037402+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:17:48.037402+0000","last_peered":"2023-10-06T02:17:48.037402+0000","last_clean":"2023-10-06T02:17:48.037402+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:17:48.037402+0000","last_undegraded":"2023-10-06T02:17:48.037402+0000","last_fullsized":"2023-10-06T02:17:48.037402+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030986+0000","last_change":"2023-10-06T02:17:43.008254+0000","last_active":"2023-10-06T02:17:48.030986+0000","last_peered":"2023-10-06T02:17:48.030986+0000","last_clean":"2023-10-06T02:17:48.030986+0000","last_became_active":"2023-10-06T02:17:43.008031+0000","last_became_peered":"2023-10-06T02:17:43.008031+0000","last_unstale":"2023-10-06T02:17:48.030986+0000","last_undegraded":"2023-10-06T02:17:48.030986+0000","last_fullsized":"2023-10-06T02:17:48.030986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.543085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031988+0000","last_change":"2023-10-06T02:17:44.015903+0000","last_active":"2023-10-06T02:17:48.031988+0000","last_peered":"2023-10-06T02:17:48.031988+0000","last_clean":"2023-10-06T02:17:48.031988+0000","last_became_active":"2023-10-06T02:17:44.012940+0000","last_became_peered":"2023-10-06T02:17:44.012940+0000","last_unstale":"2023-10-06T02:17:48.031988+0000","last_undegraded":"2023-10-06T02:17:48.031988+0000","last_fullsized":"2023-10-06T02:17:48.031988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:11.590274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.058344+0000","last_change":"2023-10-06T02:17:48.054067+0000","last_active":"2023-10-06T02:17:48.058344+0000","last_peered":"2023-10-06T02:17:48.058344+0000","last_clean":"2023-10-06T02:17:48.058344+0000","last_became_active":"2023-10-06T02:17:48.053658+0000","last_became_peered":"2023-10-06T02:17:48.053658+0000","last_unstale":"2023-10-06T02:17:48.058344+0000","last_undegraded":"2023-10-06T02:17:48.058344+0000","last_fullsized":"2023-10-06T02:17:48.058344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:05.948051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036157+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:17:48.036157+0000","last_peered":"2023-10-06T02:17:48.036157+0000","last_clean":"2023-10-06T02:17:48.036157+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:17:48.036157+0000","last_undegraded":"2023-10-06T02:17:48.036157+0000","last_fullsized":"2023-10-06T02:17:48.036157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045745+0000","last_change":"2023-10-06T02:17:43.007395+0000","last_active":"2023-10-06T02:17:48.045745+0000","last_peered":"2023-10-06T02:17:48.045745+0000","last_clean":"2023-10-06T02:17:48.045745+0000","last_became_active":"2023-10-06T02:17:43.007096+0000","last_became_peered":"2023-10-06T02:17:43.007096+0000","last_unstale":"2023-10-06T02:17:48.045745+0000","last_undegraded":"2023-10-06T02:17:48.045745+0000","last_fullsized":"2023-10-06T02:17:48.045745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:31.631012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050492+0000","last_change":"2023-10-06T02:17:44.024048+0000","last_active":"2023-10-06T02:17:48.050492+0000","last_peered":"2023-10-06T02:17:48.050492+0000","last_clean":"2023-10-06T02:17:48.050492+0000","last_became_active":"2023-10-06T02:17:44.023785+0000","last_became_peered":"2023-10-06T02:17:44.023785+0000","last_unstale":"2023-10-06T02:17:48.050492+0000","last_undegraded":"2023-10-06T02:17:48.050492+0000","last_fullsized":"2023-10-06T02:17:48.050492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.051840+0000","last_change":"2023-10-06T02:17:48.049159+0000","last_active":"2023-10-06T02:17:48.051840+0000","last_peered":"2023-10-06T02:17:48.051840+0000","last_clean":"2023-10-06T02:17:48.051840+0000","last_became_active":"2023-10-06T02:17:48.048030+0000","last_became_peered":"2023-10-06T02:17:48.048030+0000","last_unstale":"2023-10-06T02:17:48.051840+0000","last_undegraded":"2023-10-06T02:17:48.051840+0000","last_fullsized":"2023-10-06T02:17:48.051840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:59.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036269+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:17:48.036269+0000","last_peered":"2023-10-06T02:17:48.036269+0000","last_clean":"2023-10-06T02:17:48.036269+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:17:48.036269+0000","last_undegraded":"2023-10-06T02:17:48.036269+0000","last_fullsized":"2023-10-06T02:17:48.036269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030334+0000","last_change":"2023-10-06T02:17:43.012903+0000","last_active":"2023-10-06T02:17:48.030334+0000","last_peered":"2023-10-06T02:17:48.030334+0000","last_clean":"2023-10-06T02:17:48.030334+0000","last_became_active":"2023-10-06T02:17:43.012602+0000","last_became_peered":"2023-10-06T02:17:43.012602+0000","last_unstale":"2023-10-06T02:17:48.030334+0000","last_undegraded":"2023-10-06T02:17:48.030334+0000","last_fullsized":"2023-10-06T02:17:48.030334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:09.638074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040168+0000","last_change":"2023-10-06T02:17:44.017466+0000","last_active":"2023-10-06T02:17:48.040168+0000","last_peered":"2023-10-06T02:17:48.040168+0000","last_clean":"2023-10-06T02:17:48.040168+0000","last_became_active":"2023-10-06T02:17:44.017213+0000","last_became_peered":"2023-10-06T02:17:44.017213+0000","last_unstale":"2023-10-06T02:17:48.040168+0000","last_undegraded":"2023-10-06T02:17:48.040168+0000","last_fullsized":"2023-10-06T02:17:48.040168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:43.352906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.059484+0000","last_change":"2023-10-06T02:17:48.053794+0000","last_active":"2023-10-06T02:17:48.059484+0000","last_peered":"2023-10-06T02:17:48.059484+0000","last_clean":"2023-10-06T02:17:48.059484+0000","last_became_active":"2023-10-06T02:17:48.053274+0000","last_became_peered":"2023-10-06T02:17:48.053274+0000","last_unstale":"2023-10-06T02:17:48.059484+0000","last_undegraded":"2023-10-06T02:17:48.059484+0000","last_fullsized":"2023-10-06T02:17:48.059484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:29.446681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037498+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:17:48.037498+0000","last_peered":"2023-10-06T02:17:48.037498+0000","last_clean":"2023-10-06T02:17:48.037498+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:17:48.037498+0000","last_undegraded":"2023-10-06T02:17:48.037498+0000","last_fullsized":"2023-10-06T02:17:48.037498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039136+0000","last_change":"2023-10-06T02:17:43.013138+0000","last_active":"2023-10-06T02:17:48.039136+0000","last_peered":"2023-10-06T02:17:48.039136+0000","last_clean":"2023-10-06T02:17:48.039136+0000","last_became_active":"2023-10-06T02:17:43.012841+0000","last_became_peered":"2023-10-06T02:17:43.012841+0000","last_unstale":"2023-10-06T02:17:48.039136+0000","last_undegraded":"2023-10-06T02:17:48.039136+0000","last_fullsized":"2023-10-06T02:17:48.039136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:55.863203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.047850+0000","last_change":"2023-10-06T02:17:44.011211+0000","last_active":"2023-10-06T02:17:48.047850+0000","last_peered":"2023-10-06T02:17:48.047850+0000","last_clean":"2023-10-06T02:17:48.047850+0000","last_became_active":"2023-10-06T02:17:44.010694+0000","last_became_peered":"2023-10-06T02:17:44.010694+0000","last_unstale":"2023-10-06T02:17:48.047850+0000","last_undegraded":"2023-10-06T02:17:48.047850+0000","last_fullsized":"2023-10-06T02:17:48.047850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:12.022239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.052188+0000","last_change":"2023-10-06T02:17:48.049434+0000","last_active":"2023-10-06T02:17:48.052188+0000","last_peered":"2023-10-06T02:17:48.052188+0000","last_clean":"2023-10-06T02:17:48.052188+0000","last_became_active":"2023-10-06T02:17:48.049050+0000","last_became_peered":"2023-10-06T02:17:48.049050+0000","last_unstale":"2023-10-06T02:17:48.052188+0000","last_undegraded":"2023-10-06T02:17:48.052188+0000","last_fullsized":"2023-10-06T02:17:48.052188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:58.565730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039175+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:17:48.039175+0000","last_peered":"2023-10-06T02:17:48.039175+0000","last_clean":"2023-10-06T02:17:48.039175+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:17:48.039175+0000","last_undegraded":"2023-10-06T02:17:48.039175+0000","last_fullsized":"2023-10-06T02:17:48.039175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.048170+0000","last_change":"2023-10-06T02:17:43.009389+0000","last_active":"2023-10-06T02:17:48.048170+0000","last_peered":"2023-10-06T02:17:48.048170+0000","last_clean":"2023-10-06T02:17:48.048170+0000","last_became_active":"2023-10-06T02:17:43.009070+0000","last_became_peered":"2023-10-06T02:17:43.009070+0000","last_unstale":"2023-10-06T02:17:48.048170+0000","last_undegraded":"2023-10-06T02:17:48.048170+0000","last_fullsized":"2023-10-06T02:17:48.048170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:34.508977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.033624+0000","last_change":"2023-10-06T02:17:44.022296+0000","last_active":"2023-10-06T02:17:48.033624+0000","last_peered":"2023-10-06T02:17:48.033624+0000","last_clean":"2023-10-06T02:17:48.033624+0000","last_became_active":"2023-10-06T02:17:44.022032+0000","last_became_peered":"2023-10-06T02:17:44.022032+0000","last_unstale":"2023-10-06T02:17:48.033624+0000","last_undegraded":"2023-10-06T02:17:48.033624+0000","last_fullsized":"2023-10-06T02:17:48.033624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:56.966356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.058436+0000","last_change":"2023-10-06T02:17:48.049537+0000","last_active":"2023-10-06T02:17:48.058436+0000","last_peered":"2023-10-06T02:17:48.058436+0000","last_clean":"2023-10-06T02:17:48.058436+0000","last_became_active":"2023-10-06T02:17:48.049150+0000","last_became_peered":"2023-10-06T02:17:48.049150+0000","last_unstale":"2023-10-06T02:17:48.058436+0000","last_undegraded":"2023-10-06T02:17:48.058436+0000","last_fullsized":"2023-10-06T02:17:48.058436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:20.999472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039792+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:17:48.039792+0000","last_peered":"2023-10-06T02:17:48.039792+0000","last_clean":"2023-10-06T02:17:48.039792+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:17:48.039792+0000","last_undegraded":"2023-10-06T02:17:48.039792+0000","last_fullsized":"2023-10-06T02:17:48.039792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040044+0000","last_change":"2023-10-06T02:17:43.017470+0000","last_active":"2023-10-06T02:17:48.040044+0000","last_peered":"2023-10-06T02:17:48.040044+0000","last_clean":"2023-10-06T02:17:48.040044+0000","last_became_active":"2023-10-06T02:17:43.017001+0000","last_became_peered":"2023-10-06T02:17:43.017001+0000","last_unstale":"2023-10-06T02:17:48.040044+0000","last_undegraded":"2023-10-06T02:17:48.040044+0000","last_fullsized":"2023-10-06T02:17:48.040044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:59.054001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045239+0000","last_change":"2023-10-06T02:17:44.019859+0000","last_active":"2023-10-06T02:17:48.045239+0000","last_peered":"2023-10-06T02:17:48.045239+0000","last_clean":"2023-10-06T02:17:48.045239+0000","last_became_active":"2023-10-06T02:17:44.019178+0000","last_became_peered":"2023-10-06T02:17:44.019178+0000","last_unstale":"2023-10-06T02:17:48.045239+0000","last_undegraded":"2023-10-06T02:17:48.045239+0000","last_fullsized":"2023-10-06T02:17:48.045239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:41.549349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.059488+0000","last_change":"2023-10-06T02:17:48.056833+0000","last_active":"2023-10-06T02:17:48.059488+0000","last_peered":"2023-10-06T02:17:48.059488+0000","last_clean":"2023-10-06T02:17:48.059488+0000","last_became_active":"2023-10-06T02:17:48.056428+0000","last_became_peered":"2023-10-06T02:17:48.056428+0000","last_unstale":"2023-10-06T02:17:48.059488+0000","last_undegraded":"2023-10-06T02:17:48.059488+0000","last_fullsized":"2023-10-06T02:17:48.059488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:04.977537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.033524+0000","last_change":"2023-10-06T02:17:43.016304+0000","last_active":"2023-10-06T02:17:48.033524+0000","last_peered":"2023-10-06T02:17:48.033524+0000","last_clean":"2023-10-06T02:17:48.033524+0000","last_became_active":"2023-10-06T02:17:43.015998+0000","last_became_peered":"2023-10-06T02:17:43.015998+0000","last_unstale":"2023-10-06T02:17:48.033524+0000","last_undegraded":"2023-10-06T02:17:48.033524+0000","last_fullsized":"2023-10-06T02:17:48.033524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:09.638074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031489+0000","last_change":"2023-10-06T02:17:44.012571+0000","last_active":"2023-10-06T02:17:48.031489+0000","last_peered":"2023-10-06T02:17:48.031489+0000","last_clean":"2023-10-06T02:17:48.031489+0000","last_became_active":"2023-10-06T02:17:44.012245+0000","last_became_peered":"2023-10-06T02:17:44.012245+0000","last_unstale":"2023-10-06T02:17:48.031489+0000","last_undegraded":"2023-10-06T02:17:48.031489+0000","last_fullsized":"2023-10-06T02:17:48.031489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:56.870377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.061274+0000","last_change":"2023-10-06T02:17:48.057885+0000","last_active":"2023-10-06T02:17:48.061274+0000","last_peered":"2023-10-06T02:17:48.061274+0000","last_clean":"2023-10-06T02:17:48.061274+0000","last_became_active":"2023-10-06T02:17:48.057470+0000","last_became_peered":"2023-10-06T02:17:48.057470+0000","last_unstale":"2023-10-06T02:17:48.061274+0000","last_undegraded":"2023-10-06T02:17:48.061274+0000","last_fullsized":"2023-10-06T02:17:48.061274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:34.306615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039047+0000","last_change":"2023-10-06T02:17:43.014240+0000","last_active":"2023-10-06T02:17:48.039047+0000","last_peered":"2023-10-06T02:17:48.039047+0000","last_clean":"2023-10-06T02:17:48.039047+0000","last_became_active":"2023-10-06T02:17:43.013995+0000","last_became_peered":"2023-10-06T02:17:43.013995+0000","last_unstale":"2023-10-06T02:17:48.039047+0000","last_undegraded":"2023-10-06T02:17:48.039047+0000","last_fullsized":"2023-10-06T02:17:48.039047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:09.638074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039278+0000","last_change":"2023-10-06T02:17:44.012631+0000","last_active":"2023-10-06T02:17:48.039278+0000","last_peered":"2023-10-06T02:17:48.039278+0000","last_clean":"2023-10-06T02:17:48.039278+0000","last_became_active":"2023-10-06T02:17:44.012366+0000","last_became_peered":"2023-10-06T02:17:44.012366+0000","last_unstale":"2023-10-06T02:17:48.039278+0000","last_undegraded":"2023-10-06T02:17:48.039278+0000","last_fullsized":"2023-10-06T02:17:48.039278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:11.590274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060285+0000","last_change":"2023-10-06T02:17:48.054598+0000","last_active":"2023-10-06T02:17:48.060285+0000","last_peered":"2023-10-06T02:17:48.060285+0000","last_clean":"2023-10-06T02:17:48.060285+0000","last_became_active":"2023-10-06T02:17:48.054196+0000","last_became_peered":"2023-10-06T02:17:48.054196+0000","last_unstale":"2023-10-06T02:17:48.060285+0000","last_undegraded":"2023-10-06T02:17:48.060285+0000","last_fullsized":"2023-10-06T02:17:48.060285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:59.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039960+0000","last_change":"2023-10-06T02:17:43.015890+0000","last_active":"2023-10-06T02:17:48.039960+0000","last_peered":"2023-10-06T02:17:48.039960+0000","last_clean":"2023-10-06T02:17:48.039960+0000","last_became_active":"2023-10-06T02:17:43.015544+0000","last_became_peered":"2023-10-06T02:17:43.015544+0000","last_unstale":"2023-10-06T02:17:48.039960+0000","last_undegraded":"2023-10-06T02:17:48.039960+0000","last_fullsized":"2023-10-06T02:17:48.039960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.543085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037516+0000","last_change":"2023-10-06T02:17:44.027369+0000","last_active":"2023-10-06T02:17:48.037516+0000","last_peered":"2023-10-06T02:17:48.037516+0000","last_clean":"2023-10-06T02:17:48.037516+0000","last_became_active":"2023-10-06T02:17:44.026967+0000","last_became_peered":"2023-10-06T02:17:44.026967+0000","last_unstale":"2023-10-06T02:17:48.037516+0000","last_undegraded":"2023-10-06T02:17:48.037516+0000","last_fullsized":"2023-10-06T02:17:48.037516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:56.966356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.063103+0000","last_change":"2023-10-06T02:17:48.060867+0000","last_active":"2023-10-06T02:17:48.063103+0000","last_peered":"2023-10-06T02:17:48.063103+0000","last_clean":"2023-10-06T02:17:48.063103+0000","last_became_active":"2023-10-06T02:17:48.060507+0000","last_became_peered":"2023-10-06T02:17:48.060507+0000","last_unstale":"2023-10-06T02:17:48.063103+0000","last_undegraded":"2023-10-06T02:17:48.063103+0000","last_fullsized":"2023-10-06T02:17:48.063103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:41.579573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031205+0000","last_change":"2023-10-06T02:17:43.010564+0000","last_active":"2023-10-06T02:17:48.031205+0000","last_peered":"2023-10-06T02:17:48.031205+0000","last_clean":"2023-10-06T02:17:48.031205+0000","last_became_active":"2023-10-06T02:17:43.008507+0000","last_became_peered":"2023-10-06T02:17:43.008507+0000","last_unstale":"2023-10-06T02:17:48.031205+0000","last_undegraded":"2023-10-06T02:17:48.031205+0000","last_fullsized":"2023-10-06T02:17:48.031205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:55.863203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030181+0000","last_change":"2023-10-06T02:17:44.023457+0000","last_active":"2023-10-06T02:17:48.030181+0000","last_peered":"2023-10-06T02:17:48.030181+0000","last_clean":"2023-10-06T02:17:48.030181+0000","last_became_active":"2023-10-06T02:17:44.022723+0000","last_became_peered":"2023-10-06T02:17:44.022723+0000","last_unstale":"2023-10-06T02:17:48.030181+0000","last_undegraded":"2023-10-06T02:17:48.030181+0000","last_fullsized":"2023-10-06T02:17:48.030181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:56.966356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060390+0000","last_change":"2023-10-06T02:17:48.058509+0000","last_active":"2023-10-06T02:17:48.060390+0000","last_peered":"2023-10-06T02:17:48.060390+0000","last_clean":"2023-10-06T02:17:48.060390+0000","last_became_active":"2023-10-06T02:17:48.058112+0000","last_became_peered":"2023-10-06T02:17:48.058112+0000","last_unstale":"2023-10-06T02:17:48.060390+0000","last_undegraded":"2023-10-06T02:17:48.060390+0000","last_fullsized":"2023-10-06T02:17:48.060390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:59.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031046+0000","last_change":"2023-10-06T02:17:43.013591+0000","last_active":"2023-10-06T02:17:48.031046+0000","last_peered":"2023-10-06T02:17:48.031046+0000","last_clean":"2023-10-06T02:17:48.031046+0000","last_became_active":"2023-10-06T02:17:43.013150+0000","last_became_peered":"2023-10-06T02:17:43.013150+0000","last_unstale":"2023-10-06T02:17:48.031046+0000","last_undegraded":"2023-10-06T02:17:48.031046+0000","last_fullsized":"2023-10-06T02:17:48.031046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:55.863203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036796+0000","last_change":"2023-10-06T02:17:44.021121+0000","last_active":"2023-10-06T02:17:48.036796+0000","last_peered":"2023-10-06T02:17:48.036796+0000","last_clean":"2023-10-06T02:17:48.036796+0000","last_became_active":"2023-10-06T02:17:44.020849+0000","last_became_peered":"2023-10-06T02:17:44.020849+0000","last_unstale":"2023-10-06T02:17:48.036796+0000","last_undegraded":"2023-10-06T02:17:48.036796+0000","last_fullsized":"2023-10-06T02:17:48.036796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.060566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039127+0000","last_change":"2023-10-06T02:17:44.025857+0000","last_active":"2023-10-06T02:17:48.039127+0000","last_peered":"2023-10-06T02:17:48.039127+0000","last_clean":"2023-10-06T02:17:48.039127+0000","last_became_active":"2023-10-06T02:17:44.025639+0000","last_became_peered":"2023-10-06T02:17:44.025639+0000","last_unstale":"2023-10-06T02:17:48.039127+0000","last_undegraded":"2023-10-06T02:17:48.039127+0000","last_fullsized":"2023-10-06T02:17:48.039127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:22.992220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030199+0000","last_change":"2023-10-06T02:17:44.021795+0000","last_active":"2023-10-06T02:17:48.030199+0000","last_peered":"2023-10-06T02:17:48.030199+0000","last_clean":"2023-10-06T02:17:48.030199+0000","last_became_active":"2023-10-06T02:17:44.021519+0000","last_became_peered":"2023-10-06T02:17:44.021519+0000","last_unstale":"2023-10-06T02:17:48.030199+0000","last_undegraded":"2023-10-06T02:17:48.030199+0000","last_fullsized":"2023-10-06T02:17:48.030199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:29.729845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037699+0000","last_change":"2023-10-06T02:17:44.020596+0000","last_active":"2023-10-06T02:17:48.037699+0000","last_peered":"2023-10-06T02:17:48.037699+0000","last_clean":"2023-10-06T02:17:48.037699+0000","last_became_active":"2023-10-06T02:17:44.020327+0000","last_became_peered":"2023-10-06T02:17:44.020327+0000","last_unstale":"2023-10-06T02:17:48.037699+0000","last_undegraded":"2023-10-06T02:17:48.037699+0000","last_fullsized":"2023-10-06T02:17:48.037699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:08.638757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031988+0000","last_change":"2023-10-06T02:17:44.023963+0000","last_active":"2023-10-06T02:17:48.031988+0000","last_peered":"2023-10-06T02:17:48.031988+0000","last_clean":"2023-10-06T02:17:48.031988+0000","last_became_active":"2023-10-06T02:17:44.023520+0000","last_became_peered":"2023-10-06T02:17:44.023520+0000","last_unstale":"2023-10-06T02:17:48.031988+0000","last_undegraded":"2023-10-06T02:17:48.031988+0000","last_fullsized":"2023-10-06T02:17:48.031988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:05.747241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.048071+0000","last_change":"2023-10-06T02:17:44.014573+0000","last_active":"2023-10-06T02:17:48.048071+0000","last_peered":"2023-10-06T02:17:48.048071+0000","last_clean":"2023-10-06T02:17:48.048071+0000","last_became_active":"2023-10-06T02:17:44.014301+0000","last_became_peered":"2023-10-06T02:17:44.014301+0000","last_unstale":"2023-10-06T02:17:48.048071+0000","last_undegraded":"2023-10-06T02:17:48.048071+0000","last_fullsized":"2023-10-06T02:17:48.048071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:04.413740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":703395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":108144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298124,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073716,"statfs":{"total":96636764160,"available":96331485184,"internally_reserved":0,"allocated":856064,"data_stored":698512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.138}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":108144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":112867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":109721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:17:58.232 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:17:58.232 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T02:17:58.232 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T02:17:58.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T02:17:58.232 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T02:17:58.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.382+0000 7f0d35b5c700 1 Processor -- start 2023-10-06T02:17:58.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.382+0000 7f0d35b5c700 1 -- start start 2023-10-06T02:17:58.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.383+0000 7f0d35b5c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d300af4e0 0x7f0d300b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.383+0000 7f0d35b5c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0d300af8b0 0x7f0d300b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.383+0000 7f0d35b5c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d3015e190 con 0x7f0d3015d460 2023-10-06T02:17:58.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.383+0000 7f0d35b5c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d300b1910 con 0x7f0d300af4e0 2023-10-06T02:17:58.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.383+0000 7f0d35b5c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3015dfa0 con 0x7f0d300af8b0 2023-10-06T02:17:58.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.383+0000 7f0d2f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d300af4e0 0x7f0d300b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.383+0000 7f0d2f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d300af4e0 0x7f0d300b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36436/0 (socket says 172.21.15.6:36436) 2023-10-06T02:17:58.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.383+0000 7f0d2f7fe700 1 -- 172.21.15.6:0/4159413378 learned_addr learned my addr 172.21.15.6:0/4159413378 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:58.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.383+0000 7f0d2effd700 1 --2- 172.21.15.6:0/4159413378 >> v2:172.21.15.175:3300/0 conn(0x7f0d300af8b0 0x7f0d300b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.383+0000 7f0d2f7fe700 1 -- 172.21.15.6:0/4159413378 >> v2:172.21.15.175:3300/0 conn(0x7f0d300af8b0 msgr2=0x7f0d300b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:58.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.383+0000 7f0d2f7fe700 1 --2- 172.21.15.6:0/4159413378 >> v2:172.21.15.175:3300/0 conn(0x7f0d300af8b0 0x7f0d300b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.383+0000 7f0d2f7fe700 1 -- 172.21.15.6:0/4159413378 >> v1:172.21.15.175:6789/0 conn(0x7f0d3015d460 legacy=0x7f0d3015d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.383+0000 7f0d2f7fe700 1 -- 172.21.15.6:0/4159413378 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d300cb650 con 0x7f0d300af4e0 2023-10-06T02:17:58.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.383+0000 7f0d2e7fc700 1 -- 172.21.15.6:0/4159413378 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472026052 0 0) 0x7f0d3015e190 con 0x7f0d3015d460 2023-10-06T02:17:58.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.383+0000 7f0d2f7fe700 1 --2- 172.21.15.6:0/4159413378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d300af4e0 0x7f0d300b20e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0d300cdd50 tx=0x7f0d20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c503272f928724 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:58.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.384+0000 7f0d2e7fc700 1 -- 172.21.15.6:0/4159413378 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d20009e70 con 0x7f0d300af4e0 2023-10-06T02:17:58.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.384+0000 7f0d2e7fc700 1 -- 172.21.15.6:0/4159413378 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2000b860 con 0x7f0d300af4e0 2023-10-06T02:17:58.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.384+0000 7f0d2e7fc700 1 -- 172.21.15.6:0/4159413378 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2000bc00 con 0x7f0d300af4e0 2023-10-06T02:17:58.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.384+0000 7f0d35b5c700 1 -- 172.21.15.6:0/4159413378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d300af4e0 msgr2=0x7f0d300b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.384+0000 7f0d35b5c700 1 --2- 172.21.15.6:0/4159413378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d300af4e0 0x7f0d300b20e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0d300cdd50 tx=0x7f0d20009250 comp rx=0 tx=0).stop 2023-10-06T02:17:58.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.384+0000 7f0d35b5c700 1 -- 172.21.15.6:0/4159413378 shutdown_connections 2023-10-06T02:17:58.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.384+0000 7f0d35b5c700 1 --2- 172.21.15.6:0/4159413378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d300af4e0 0x7f0d300b20e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.384+0000 7f0d35b5c700 1 --2- 172.21.15.6:0/4159413378 >> v2:172.21.15.175:3300/0 conn(0x7f0d300af8b0 0x7f0d300b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.384+0000 7f0d35b5c700 1 -- 172.21.15.6:0/4159413378 >> 172.21.15.6:0/4159413378 conn(0x7f0d30068680 msgr2=0x7f0d30068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:58.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.384+0000 7f0d35b5c700 1 -- 172.21.15.6:0/4159413378 shutdown_connections 2023-10-06T02:17:58.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.384+0000 7f0d35b5c700 1 -- 172.21.15.6:0/4159413378 wait complete. 2023-10-06T02:17:58.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.385+0000 7f0d35b5c700 1 Processor -- start 2023-10-06T02:17:58.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.385+0000 7f0d35b5c700 1 -- start start 2023-10-06T02:17:58.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.386+0000 7f0d35b5c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d300af4e0 0x7f0d300c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.386+0000 7f0d35b5c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d300af8b0 0x7f0d30150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.386+0000 7f0d35b5c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d3015d460 0x7f0d300cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.386+0000 7f0d35b5c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d301522c0 con 0x7f0d300af8b0 2023-10-06T02:17:58.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.386+0000 7f0d35b5c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d301542f0 con 0x7f0d3015d460 2023-10-06T02:17:58.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.386+0000 7f0d35b5c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d300c7d00 con 0x7f0d300af4e0 2023-10-06T02:17:58.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.386+0000 7f0d2effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d300af8b0 0x7f0d30150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.386+0000 7f0d2effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d300af8b0 0x7f0d30150c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36440/0 (socket says 172.21.15.6:36440) 2023-10-06T02:17:58.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.386+0000 7f0d2effd700 1 -- 172.21.15.6:0/1119289551 learned_addr learned my addr 172.21.15.6:0/1119289551 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:58.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.386+0000 7f0d2f7fe700 1 --2- 172.21.15.6:0/1119289551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d300af4e0 0x7f0d300c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.386+0000 7f0d2ffff700 1 --2- 172.21.15.6:0/1119289551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d3015d460 0x7f0d300cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.387+0000 7f0d2effd700 1 -- 172.21.15.6:0/1119289551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d300af4e0 msgr2=0x7f0d300c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.387+0000 7f0d2effd700 1 --2- 172.21.15.6:0/1119289551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d300af4e0 0x7f0d300c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.387+0000 7f0d2effd700 1 -- 172.21.15.6:0/1119289551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d3015d460 msgr2=0x7f0d300cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.387+0000 7f0d2effd700 1 --2- 172.21.15.6:0/1119289551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d3015d460 0x7f0d300cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.387+0000 7f0d2effd700 1 -- 172.21.15.6:0/1119289551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d200094f0 con 0x7f0d300af8b0 2023-10-06T02:17:58.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.387+0000 7f0d2f7fe700 1 --2- 172.21.15.6:0/1119289551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d300af4e0 0x7f0d300c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:58.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.387+0000 7f0d2ffff700 1 --2- 172.21.15.6:0/1119289551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d3015d460 0x7f0d300cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:58.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.387+0000 7f0d2effd700 1 --2- 172.21.15.6:0/1119289551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d300af8b0 0x7f0d30150c40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400ec50 tx=0x7f0d240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:58.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.387+0000 7f0d177fe700 1 -- 172.21.15.6:0/1119289551 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400c9d0 con 0x7f0d300af8b0 2023-10-06T02:17:58.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.387+0000 7f0d177fe700 1 -- 172.21.15.6:0/1119289551 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2400cb30 con 0x7f0d300af8b0 2023-10-06T02:17:58.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.387+0000 7f0d177fe700 1 -- 172.21.15.6:0/1119289551 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24013470 con 0x7f0d300af8b0 2023-10-06T02:17:58.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.387+0000 7f0d35b5c700 1 -- 172.21.15.6:0/1119289551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d30153ca0 con 0x7f0d300af8b0 2023-10-06T02:17:58.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.387+0000 7f0d35b5c700 1 -- 172.21.15.6:0/1119289551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d300c8fa0 con 0x7f0d300af8b0 2023-10-06T02:17:58.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.388+0000 7f0d35b5c700 1 -- 172.21.15.6:0/1119289551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d30154460 con 0x7f0d300af8b0 2023-10-06T02:17:58.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.388+0000 7f0d177fe700 1 -- 172.21.15.6:0/1119289551 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d240138a0 con 0x7f0d300af8b0 2023-10-06T02:17:58.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.389+0000 7f0d177fe700 1 --2- 172.21.15.6:0/1119289551 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0d1c066f30 0x7f0d1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.389+0000 7f0d177fe700 1 -- 172.21.15.6:0/1119289551 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0d24084ce0 con 0x7f0d300af8b0 2023-10-06T02:17:58.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.389+0000 7f0d2f7fe700 1 --2- 172.21.15.6:0/1119289551 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0d1c066f30 0x7f0d1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.389+0000 7f0d2f7fe700 1 --2- 172.21.15.6:0/1119289551 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0d1c066f30 0x7f0d1c0693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0d300cdd50 tx=0x7f0d20017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:58.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.393+0000 7f0d177fe700 1 -- 172.21.15.6:0/1119289551 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d24051b00 con 0x7f0d300af8b0 2023-10-06T02:17:58.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.641+0000 7f0d35b5c700 1 -- 172.21.15.6:0/1119289551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0d300b0910 con 0x7f0d300af8b0 2023-10-06T02:17:58.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.644+0000 7f0d177fe700 1 -- 172.21.15.6:0/1119289551 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163705 (secure 0 0 0) 0x7f0d24017090 con 0x7f0d300af8b0 2023-10-06T02:17:58.647 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.646+0000 7f0d35b5c700 1 -- 172.21.15.6:0/1119289551 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0d1c066f30 msgr2=0x7f0d1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.646+0000 7f0d35b5c700 1 --2- 172.21.15.6:0/1119289551 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0d1c066f30 0x7f0d1c0693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0d300cdd50 tx=0x7f0d20017000 comp rx=0 tx=0).stop 2023-10-06T02:17:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.646+0000 7f0d35b5c700 1 -- 172.21.15.6:0/1119289551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d300af8b0 msgr2=0x7f0d30150c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.646+0000 7f0d35b5c700 1 --2- 172.21.15.6:0/1119289551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d300af8b0 0x7f0d30150c40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400ec50 tx=0x7f0d240091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.646+0000 7f0d35b5c700 1 -- 172.21.15.6:0/1119289551 shutdown_connections 2023-10-06T02:17:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.646+0000 7f0d35b5c700 1 --2- 172.21.15.6:0/1119289551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d3015d460 0x7f0d300cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.646+0000 7f0d35b5c700 1 --2- 172.21.15.6:0/1119289551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d300af4e0 0x7f0d300c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.646+0000 7f0d35b5c700 1 --2- 172.21.15.6:0/1119289551 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0d1c066f30 0x7f0d1c0693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.646+0000 7f0d35b5c700 1 --2- 172.21.15.6:0/1119289551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d300af8b0 0x7f0d30150c40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.646+0000 7f0d35b5c700 1 -- 172.21.15.6:0/1119289551 >> 172.21.15.6:0/1119289551 conn(0x7f0d30068680 msgr2=0x7f0d30068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.646+0000 7f0d35b5c700 1 -- 172.21.15.6:0/1119289551 shutdown_connections 2023-10-06T02:17:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.646+0000 7f0d35b5c700 1 -- 172.21.15.6:0/1119289551 wait complete. 2023-10-06T02:17:58.659 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":90280},{"type":"v1","addr":"172.21.15.175:6833","nonce":90280}]},"active_addr":"172.21.15.175:6833/90280","active_change":"2023-10-06T02:17:30.548294+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":926812503}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":3549343290}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":1936236704}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":1799317432}]}]} 2023-10-06T02:17:58.665 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T02:17:58.665 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T02:17:58.666 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:17:58.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.784+0000 7fba7fe83700 1 Processor -- start 2023-10-06T02:17:58.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.784+0000 7fba7fe83700 1 -- start start 2023-10-06T02:17:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.785+0000 7fba7fe83700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fba780af4e0 0x7fba780b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.785+0000 7fba7fe83700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba7815db70 0x7fba780b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.785+0000 7fba7fe83700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7815e190 con 0x7fba780af8b0 2023-10-06T02:17:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.785+0000 7fba7fe83700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba780b1910 con 0x7fba780af4e0 2023-10-06T02:17:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.785+0000 7fba7fe83700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7815dfa0 con 0x7fba7815db70 2023-10-06T02:17:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.785+0000 7fba7dc1f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fba780af4e0 0x7fba780b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.785+0000 7fba7e420700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba7815db70 0x7fba780b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.785+0000 7fba7d41e700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fba780af8b0 0x7fba7815d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:48476/0 (socket says 172.21.15.6:48476) 2023-10-06T02:17:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.785+0000 7fba7d41e700 1 -- 172.21.15.6:0/514517150 learned_addr learned my addr 172.21.15.6:0/514517150 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.786+0000 7fba7dc1f700 1 -- 172.21.15.6:0/514517150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba7815db70 msgr2=0x7fba780b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.786+0000 7fba7dc1f700 1 --2- 172.21.15.6:0/514517150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba7815db70 0x7fba780b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.786+0000 7fba7dc1f700 1 -- 172.21.15.6:0/514517150 >> v1:172.21.15.175:6789/0 conn(0x7fba780af8b0 legacy=0x7fba7815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.786+0000 7fba7dc1f700 1 -- 172.21.15.6:0/514517150 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba780cb650 con 0x7fba780af4e0 2023-10-06T02:17:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.786+0000 7fba7cc1d700 1 -- 172.21.15.6:0/514517150 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686650035 0 0) 0x7fba7815e190 con 0x7fba780af8b0 2023-10-06T02:17:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.786+0000 7fba7e420700 1 --2- 172.21.15.6:0/514517150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba7815db70 0x7fba780b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.786+0000 7fba7dc1f700 1 --2- 172.21.15.6:0/514517150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba780af4e0 0x7fba780b20e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba700098e0 tx=0x7fba700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9344428b7fcb016d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.786+0000 7fba7cc1d700 1 -- 172.21.15.6:0/514517150 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7000b640 con 0x7fba780af4e0 2023-10-06T02:17:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.786+0000 7fba7cc1d700 1 -- 172.21.15.6:0/514517150 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7000b7a0 con 0x7fba780af4e0 2023-10-06T02:17:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.786+0000 7fba7cc1d700 1 -- 172.21.15.6:0/514517150 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7000bb40 con 0x7fba780af4e0 2023-10-06T02:17:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.786+0000 7fba7fe83700 1 -- 172.21.15.6:0/514517150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba780af4e0 msgr2=0x7fba780b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.787+0000 7fba7fe83700 1 --2- 172.21.15.6:0/514517150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba780af4e0 0x7fba780b20e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba700098e0 tx=0x7fba700091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.787+0000 7fba7fe83700 1 -- 172.21.15.6:0/514517150 shutdown_connections 2023-10-06T02:17:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.787+0000 7fba7fe83700 1 --2- 172.21.15.6:0/514517150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba7815db70 0x7fba780b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.787+0000 7fba7fe83700 1 --2- 172.21.15.6:0/514517150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba780af4e0 0x7fba780b20e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.787+0000 7fba7fe83700 1 -- 172.21.15.6:0/514517150 >> 172.21.15.6:0/514517150 conn(0x7fba78068680 msgr2=0x7fba78068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.787+0000 7fba7fe83700 1 -- 172.21.15.6:0/514517150 shutdown_connections 2023-10-06T02:17:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.787+0000 7fba7fe83700 1 -- 172.21.15.6:0/514517150 wait complete. 2023-10-06T02:17:58.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.788+0000 7fba7fe83700 1 Processor -- start 2023-10-06T02:17:58.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.788+0000 7fba7fe83700 1 -- start start 2023-10-06T02:17:58.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7fe83700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba780af4e0 0x7fba780ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7fe83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba780af8b0 0x7fba780c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7fe83700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba7815db70 0x7fba78159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7fe83700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba780ae3c0 con 0x7fba780af8b0 2023-10-06T02:17:58.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7fe83700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba780a6e50 con 0x7fba780af4e0 2023-10-06T02:17:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7fe83700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba780c7940 con 0x7fba7815db70 2023-10-06T02:17:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7d41e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba780af8b0 0x7fba780c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7d41e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba780af8b0 0x7fba780c7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54110/0 (socket says 172.21.15.6:54110) 2023-10-06T02:17:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7d41e700 1 -- 172.21.15.6:0/836250749 learned_addr learned my addr 172.21.15.6:0/836250749 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7dc1f700 1 --2- 172.21.15.6:0/836250749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba780af4e0 0x7fba780ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7e420700 1 --2- 172.21.15.6:0/836250749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba7815db70 0x7fba78159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7d41e700 1 -- 172.21.15.6:0/836250749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba7815db70 msgr2=0x7fba78159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7d41e700 1 --2- 172.21.15.6:0/836250749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba7815db70 0x7fba78159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7d41e700 1 -- 172.21.15.6:0/836250749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba780af4e0 msgr2=0x7fba780ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7d41e700 1 --2- 172.21.15.6:0/836250749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba780af4e0 0x7fba780ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7d41e700 1 -- 172.21.15.6:0/836250749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba68009a20 con 0x7fba780af8b0 2023-10-06T02:17:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7d41e700 1 --2- 172.21.15.6:0/836250749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba780af8b0 0x7fba780c7400 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00c840 tx=0x7fba6c007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba75ffb700 1 -- 172.21.15.6:0/836250749 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c005c00 con 0x7fba780af8b0 2023-10-06T02:17:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba75ffb700 1 -- 172.21.15.6:0/836250749 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c005d60 con 0x7fba780af8b0 2023-10-06T02:17:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba7fe83700 1 -- 172.21.15.6:0/836250749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba70009420 con 0x7fba780af8b0 2023-10-06T02:17:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.789+0000 7fba75ffb700 1 -- 172.21.15.6:0/836250749 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c0072e0 con 0x7fba780af8b0 2023-10-06T02:17:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.790+0000 7fba7fe83700 1 -- 172.21.15.6:0/836250749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7816d8d0 con 0x7fba780af8b0 2023-10-06T02:17:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.791+0000 7fba7fe83700 1 -- 172.21.15.6:0/836250749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba780a7000 con 0x7fba780af8b0 2023-10-06T02:17:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.791+0000 7fba75ffb700 1 -- 172.21.15.6:0/836250749 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba6c01b3b0 con 0x7fba780af8b0 2023-10-06T02:17:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.791+0000 7fba75ffb700 1 --2- 172.21.15.6:0/836250749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba64066f30 0x7fba640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.791+0000 7fba75ffb700 1 -- 172.21.15.6:0/836250749 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fba6c083cd0 con 0x7fba780af8b0 2023-10-06T02:17:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.791+0000 7fba7dc1f700 1 --2- 172.21.15.6:0/836250749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba64066f30 0x7fba640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.792+0000 7fba7dc1f700 1 --2- 172.21.15.6:0/836250749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba64066f30 0x7fba640693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fba700093f0 tx=0x7fba70017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.795+0000 7fba75ffb700 1 -- 172.21.15.6:0/836250749 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba6c04b5a0 con 0x7fba780af8b0 2023-10-06T02:17:58.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.990+0000 7fba7fe83700 1 -- 172.21.15.6:0/836250749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba780b0910 con 0x7fba780af8b0 2023-10-06T02:17:58.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.991+0000 7fba75ffb700 1 -- 172.21.15.6:0/836250749 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fba6c017020 con 0x7fba780af8b0 2023-10-06T02:17:58.992 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:58.992 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:48.453046+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:17:58.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.993+0000 7fba7fe83700 1 -- 172.21.15.6:0/836250749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba64066f30 msgr2=0x7fba640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.993+0000 7fba7fe83700 1 --2- 172.21.15.6:0/836250749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba64066f30 0x7fba640693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fba700093f0 tx=0x7fba70017000 comp rx=0 tx=0).stop 2023-10-06T02:17:58.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.993+0000 7fba7fe83700 1 -- 172.21.15.6:0/836250749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba780af8b0 msgr2=0x7fba780c7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:58.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.993+0000 7fba7fe83700 1 --2- 172.21.15.6:0/836250749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba780af8b0 0x7fba780c7400 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00c840 tx=0x7fba6c007db0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.993+0000 7fba7fe83700 1 -- 172.21.15.6:0/836250749 shutdown_connections 2023-10-06T02:17:58.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.993+0000 7fba7fe83700 1 --2- 172.21.15.6:0/836250749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba7815db70 0x7fba78159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.993+0000 7fba7fe83700 1 --2- 172.21.15.6:0/836250749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba780af4e0 0x7fba780ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.993+0000 7fba7fe83700 1 --2- 172.21.15.6:0/836250749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba64066f30 0x7fba640693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.993+0000 7fba7fe83700 1 --2- 172.21.15.6:0/836250749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba780af8b0 0x7fba780c7400 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:58.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.993+0000 7fba7fe83700 1 -- 172.21.15.6:0/836250749 >> 172.21.15.6:0/836250749 conn(0x7fba78068680 msgr2=0x7fba7815a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:58.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.993+0000 7fba7fe83700 1 -- 172.21.15.6:0/836250749 shutdown_connections 2023-10-06T02:17:58.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:58.993+0000 7fba7fe83700 1 -- 172.21.15.6:0/836250749 wait complete. 2023-10-06T02:17:59.007 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T02:17:59.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:17:59.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.125+0000 7fa9eee32700 1 Processor -- start 2023-10-06T02:17:59.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.125+0000 7fa9eee32700 1 -- start start 2023-10-06T02:17:59.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.126+0000 7fa9eee32700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9e80af4e0 0x7fa9e80b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.126+0000 7fa9eee32700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa9e815db70 0x7fa9e80b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.126+0000 7fa9eee32700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e815e190 con 0x7fa9e80af8b0 2023-10-06T02:17:59.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.126+0000 7fa9eee32700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e80b1910 con 0x7fa9e80af4e0 2023-10-06T02:17:59.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.126+0000 7fa9eee32700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e815dfa0 con 0x7fa9e815db70 2023-10-06T02:17:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.126+0000 7fa9ecbce700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9e80af4e0 0x7fa9e80b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.126+0000 7fa9ecbce700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9e80af4e0 0x7fa9e80b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54112/0 (socket says 172.21.15.6:54112) 2023-10-06T02:17:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.126+0000 7fa9ecbce700 1 -- 172.21.15.6:0/2390452794 learned_addr learned my addr 172.21.15.6:0/2390452794 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.126+0000 7fa9e7fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa9e80af8b0 0x7fa9e815d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36000/0 (socket says 172.21.15.6:36000) 2023-10-06T02:17:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.126+0000 7fa9ed3cf700 1 --2- 172.21.15.6:0/2390452794 >> v2:172.21.15.175:3300/0 conn(0x7fa9e815db70 0x7fa9e80b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.126+0000 7fa9ecbce700 1 -- 172.21.15.6:0/2390452794 >> v2:172.21.15.175:3300/0 conn(0x7fa9e815db70 msgr2=0x7fa9e80b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.126+0000 7fa9ecbce700 1 --2- 172.21.15.6:0/2390452794 >> v2:172.21.15.175:3300/0 conn(0x7fa9e815db70 0x7fa9e80b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.126+0000 7fa9ecbce700 1 -- 172.21.15.6:0/2390452794 >> v1:172.21.15.6:6789/0 conn(0x7fa9e80af8b0 legacy=0x7fa9e815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.126+0000 7fa9ecbce700 1 -- 172.21.15.6:0/2390452794 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e80cb650 con 0x7fa9e80af4e0 2023-10-06T02:17:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.126+0000 7fa9e77fe700 1 -- 172.21.15.6:0/2390452794 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581202361 0 0) 0x7fa9e815e190 con 0x7fa9e80af8b0 2023-10-06T02:17:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.126+0000 7fa9ecbce700 1 --2- 172.21.15.6:0/2390452794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9e80af4e0 0x7fa9e80b20e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80c7280 tx=0x7fa9e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8771ab9f51b04f6f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.126+0000 7fa9e77fe700 1 -- 172.21.15.6:0/2390452794 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e000b860 con 0x7fa9e80af4e0 2023-10-06T02:17:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.127+0000 7fa9e77fe700 1 -- 172.21.15.6:0/2390452794 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e000b9c0 con 0x7fa9e80af4e0 2023-10-06T02:17:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.127+0000 7fa9e77fe700 1 -- 172.21.15.6:0/2390452794 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e000bd60 con 0x7fa9e80af4e0 2023-10-06T02:17:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.127+0000 7fa9eee32700 1 -- 172.21.15.6:0/2390452794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9e80af4e0 msgr2=0x7fa9e80b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.127+0000 7fa9eee32700 1 --2- 172.21.15.6:0/2390452794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9e80af4e0 0x7fa9e80b20e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80c7280 tx=0x7fa9e0009250 comp rx=0 tx=0).stop 2023-10-06T02:17:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.127+0000 7fa9eee32700 1 -- 172.21.15.6:0/2390452794 shutdown_connections 2023-10-06T02:17:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.127+0000 7fa9eee32700 1 --2- 172.21.15.6:0/2390452794 >> v2:172.21.15.175:3300/0 conn(0x7fa9e815db70 0x7fa9e80b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.127+0000 7fa9eee32700 1 --2- 172.21.15.6:0/2390452794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9e80af4e0 0x7fa9e80b20e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.127+0000 7fa9eee32700 1 -- 172.21.15.6:0/2390452794 >> 172.21.15.6:0/2390452794 conn(0x7fa9e8068680 msgr2=0x7fa9e8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.127+0000 7fa9eee32700 1 -- 172.21.15.6:0/2390452794 shutdown_connections 2023-10-06T02:17:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.127+0000 7fa9eee32700 1 -- 172.21.15.6:0/2390452794 wait complete. 2023-10-06T02:17:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.128+0000 7fa9eee32700 1 Processor -- start 2023-10-06T02:17:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.128+0000 7fa9eee32700 1 -- start start 2023-10-06T02:17:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.129+0000 7fa9eee32700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9e80af4e0 0x7fa9e80cf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.129+0000 7fa9eee32700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9e80af8b0 0x7fa9e816b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.129+0000 7fa9eee32700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9e815db70 0x7fa9e816b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.129+0000 7fa9eee32700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80cf3a0 con 0x7fa9e80af4e0 2023-10-06T02:17:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.129+0000 7fa9eee32700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80ce790 con 0x7fa9e80af8b0 2023-10-06T02:17:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.129+0000 7fa9eee32700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80cea70 con 0x7fa9e815db70 2023-10-06T02:17:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.129+0000 7fa9ecbce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9e80af4e0 0x7fa9e80cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.129+0000 7fa9ecbce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9e80af4e0 0x7fa9e80cf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54114/0 (socket says 172.21.15.6:54114) 2023-10-06T02:17:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.129+0000 7fa9ecbce700 1 -- 172.21.15.6:0/2198836176 learned_addr learned my addr 172.21.15.6:0/2198836176 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.129+0000 7fa9e7fff700 1 --2- 172.21.15.6:0/2198836176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9e80af8b0 0x7fa9e816b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.129+0000 7fa9ed3cf700 1 --2- 172.21.15.6:0/2198836176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9e815db70 0x7fa9e816b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.129+0000 7fa9ecbce700 1 -- 172.21.15.6:0/2198836176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9e815db70 msgr2=0x7fa9e816b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.129+0000 7fa9ecbce700 1 --2- 172.21.15.6:0/2198836176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9e815db70 0x7fa9e816b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.129+0000 7fa9ecbce700 1 -- 172.21.15.6:0/2198836176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9e80af8b0 msgr2=0x7fa9e816b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.129+0000 7fa9ecbce700 1 --2- 172.21.15.6:0/2198836176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9e80af8b0 0x7fa9e816b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.129+0000 7fa9ecbce700 1 -- 172.21.15.6:0/2198836176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e00094f0 con 0x7fa9e80af4e0 2023-10-06T02:17:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.129+0000 7fa9ed3cf700 1 --2- 172.21.15.6:0/2198836176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9e815db70 0x7fa9e816b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.130+0000 7fa9ecbce700 1 --2- 172.21.15.6:0/2198836176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9e80af4e0 0x7fa9e80cf830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8089520 tx=0x7fa9e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.130+0000 7fa9e4ff9700 1 -- 172.21.15.6:0/2198836176 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0024440 con 0x7fa9e80af4e0 2023-10-06T02:17:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.130+0000 7fa9e4ff9700 1 -- 172.21.15.6:0/2198836176 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e00245c0 con 0x7fa9e80af4e0 2023-10-06T02:17:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.130+0000 7fa9eee32700 1 -- 172.21.15.6:0/2198836176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e80ced50 con 0x7fa9e80af4e0 2023-10-06T02:17:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.130+0000 7fa9e4ff9700 1 -- 172.21.15.6:0/2198836176 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0024980 con 0x7fa9e80af4e0 2023-10-06T02:17:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.130+0000 7fa9eee32700 1 -- 172.21.15.6:0/2198836176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e80cfd70 con 0x7fa9e80af4e0 2023-10-06T02:17:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.131+0000 7fa9eee32700 1 -- 172.21.15.6:0/2198836176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e8088aa0 con 0x7fa9e80af4e0 2023-10-06T02:17:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.131+0000 7fa9e4ff9700 1 -- 172.21.15.6:0/2198836176 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9e001a420 con 0x7fa9e80af4e0 2023-10-06T02:17:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.131+0000 7fa9e4ff9700 1 --2- 172.21.15.6:0/2198836176 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9c8066f30 0x7fa9c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.132+0000 7fa9e4ff9700 1 -- 172.21.15.6:0/2198836176 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa9e00866f0 con 0x7fa9e80af4e0 2023-10-06T02:17:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.132+0000 7fa9e7fff700 1 --2- 172.21.15.6:0/2198836176 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9c8066f30 0x7fa9c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.132+0000 7fa9e7fff700 1 --2- 172.21.15.6:0/2198836176 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9c8066f30 0x7fa9c80693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80c76d0 tx=0x7fa9d8001b00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.136+0000 7fa9e4ff9700 1 -- 172.21.15.6:0/2198836176 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9e0053590 con 0x7fa9e80af4e0 2023-10-06T02:17:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.330+0000 7fa9eee32700 1 -- 172.21.15.6:0/2198836176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9e80b54d0 con 0x7fa9e80af4e0 2023-10-06T02:17:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.331+0000 7fa9e4ff9700 1 -- 172.21.15.6:0/2198836176 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fa9e0056bb0 con 0x7fa9e80af4e0 2023-10-06T02:17:59.333 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:17:59.333 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:48.453046+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:17:59.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.333+0000 7fa9eee32700 1 -- 172.21.15.6:0/2198836176 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9c8066f30 msgr2=0x7fa9c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.333+0000 7fa9eee32700 1 --2- 172.21.15.6:0/2198836176 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9c8066f30 0x7fa9c80693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80c76d0 tx=0x7fa9d8001b00 comp rx=0 tx=0).stop 2023-10-06T02:17:59.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.333+0000 7fa9eee32700 1 -- 172.21.15.6:0/2198836176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9e80af4e0 msgr2=0x7fa9e80cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.333+0000 7fa9eee32700 1 --2- 172.21.15.6:0/2198836176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9e80af4e0 0x7fa9e80cf830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8089520 tx=0x7fa9e0017000 comp rx=0 tx=0).stop 2023-10-06T02:17:59.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.333+0000 7fa9eee32700 1 -- 172.21.15.6:0/2198836176 shutdown_connections 2023-10-06T02:17:59.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.333+0000 7fa9eee32700 1 --2- 172.21.15.6:0/2198836176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9e815db70 0x7fa9e816b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.333+0000 7fa9eee32700 1 --2- 172.21.15.6:0/2198836176 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9c8066f30 0x7fa9c80693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.333+0000 7fa9eee32700 1 --2- 172.21.15.6:0/2198836176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9e80af4e0 0x7fa9e80cf830 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.333+0000 7fa9eee32700 1 --2- 172.21.15.6:0/2198836176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9e80af8b0 0x7fa9e816b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.333+0000 7fa9eee32700 1 -- 172.21.15.6:0/2198836176 >> 172.21.15.6:0/2198836176 conn(0x7fa9e8068680 msgr2=0x7fa9e8154df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.333+0000 7fa9eee32700 1 -- 172.21.15.6:0/2198836176 shutdown_connections 2023-10-06T02:17:59.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.333+0000 7fa9eee32700 1 -- 172.21.15.6:0/2198836176 wait complete. 2023-10-06T02:17:59.347 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T02:17:59.347 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T02:17:59.348 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T02:17:59.349 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T02:17:59.349 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T02:17:59.350 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T02:17:59.350 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T02:17:59.351 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T02:17:59.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.548+0000 7ff6a29c8700 1 Processor -- start 2023-10-06T02:17:59.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.548+0000 7ff6a29c8700 1 -- start start 2023-10-06T02:17:59.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.549+0000 7ff6a29c8700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff69c1666e0 0x7ff69c0acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.549+0000 7ff6a29c8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff69c0ad080 0x7ff69c0c8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.549+0000 7ff6a29c8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69c0ad4b0 con 0x7ff69c166310 2023-10-06T02:17:59.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.549+0000 7ff6a29c8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69c0af030 con 0x7ff69c0ad080 2023-10-06T02:17:59.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.549+0000 7ff6a29c8700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69c06f2c0 con 0x7ff69c1666e0 2023-10-06T02:17:59.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.550+0000 7ff69bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff69c166310 0x7ff69c06e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36016/0 (socket says 172.21.15.6:36016) 2023-10-06T02:17:59.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.550+0000 7ff69bfff700 1 -- 172.21.15.6:0/3995064353 learned_addr learned my addr 172.21.15.6:0/3995064353 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:59.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.550+0000 7ff69b7fe700 1 --2- 172.21.15.6:0/3995064353 >> v2:172.21.15.175:3300/0 conn(0x7ff69c1666e0 0x7ff69c0acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.550+0000 7ff69b7fe700 1 -- 172.21.15.6:0/3995064353 >> v2:172.21.15.6:3300/0 conn(0x7ff69c0ad080 msgr2=0x7ff69c0c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.550+0000 7ff69b7fe700 1 --2- 172.21.15.6:0/3995064353 >> v2:172.21.15.6:3300/0 conn(0x7ff69c0ad080 0x7ff69c0c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.550+0000 7ff69b7fe700 1 -- 172.21.15.6:0/3995064353 >> v1:172.21.15.6:6789/0 conn(0x7ff69c166310 legacy=0x7ff69c06e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.550+0000 7ff69b7fe700 1 -- 172.21.15.6:0/3995064353 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c06ed00 con 0x7ff69c1666e0 2023-10-06T02:17:59.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.550+0000 7ff69b7fe700 1 --2- 172.21.15.6:0/3995064353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff69c1666e0 0x7ff69c0acb40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff69c06dd60 tx=0x7ff68c00b420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42bca48a52bb78f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.550+0000 7ff69affd700 1 -- 172.21.15.6:0/3995064353 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c00db50 con 0x7ff69c1666e0 2023-10-06T02:17:59.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.550+0000 7ff69affd700 1 -- 172.21.15.6:0/3995064353 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c00dcb0 con 0x7ff69c1666e0 2023-10-06T02:17:59.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.550+0000 7ff69affd700 1 -- 172.21.15.6:0/3995064353 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0106b0 con 0x7ff69c1666e0 2023-10-06T02:17:59.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.551+0000 7ff6a29c8700 1 -- 172.21.15.6:0/3995064353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff69c1666e0 msgr2=0x7ff69c0acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.551+0000 7ff6a29c8700 1 --2- 172.21.15.6:0/3995064353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff69c1666e0 0x7ff69c0acb40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff69c06dd60 tx=0x7ff68c00b420 comp rx=0 tx=0).stop 2023-10-06T02:17:59.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.551+0000 7ff6a29c8700 1 -- 172.21.15.6:0/3995064353 shutdown_connections 2023-10-06T02:17:59.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.551+0000 7ff6a29c8700 1 --2- 172.21.15.6:0/3995064353 >> v2:172.21.15.6:3300/0 conn(0x7ff69c0ad080 0x7ff69c0c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.551+0000 7ff6a29c8700 1 --2- 172.21.15.6:0/3995064353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff69c1666e0 0x7ff69c0acb40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.551+0000 7ff6a29c8700 1 -- 172.21.15.6:0/3995064353 >> 172.21.15.6:0/3995064353 conn(0x7ff69c069110 msgr2=0x7ff69c0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.553+0000 7ff6a29c8700 1 -- 172.21.15.6:0/3995064353 shutdown_connections 2023-10-06T02:17:59.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.555+0000 7fcfba2c0700 1 Processor -- start 2023-10-06T02:17:59.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.555+0000 7fcfba2c0700 1 -- start start 2023-10-06T02:17:59.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.556+0000 7f76faed3700 1 Processor -- start 2023-10-06T02:17:59.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.556+0000 7f76faed3700 1 -- start start 2023-10-06T02:17:59.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.556+0000 7fcfba2c0700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcfb406b7e0 0x7fcfb40cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.556+0000 7fcfba2c0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcfb406bbb0 0x7fcfb406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.556+0000 7fcfba2c0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfb406cff0 0x7fcfb406d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.556+0000 7fcfba2c0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb40c90d0 con 0x7fcfb406bbb0 2023-10-06T02:17:59.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.556+0000 7fcfba2c0700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb40c7c60 con 0x7fcfb406b7e0 2023-10-06T02:17:59.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.556+0000 7fcfba2c0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40c7980 con 0x7fcfb406cff0 2023-10-06T02:17:59.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.556+0000 7ff6a29c8700 1 -- 172.21.15.6:0/3995064353 wait complete. 2023-10-06T02:17:59.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.556+0000 7fcfb37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcfb406bbb0 0x7fcfb406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.556+0000 7fcfb3fff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcfb406b7e0 0x7fcfb40cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.556+0000 7fcfb37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcfb406bbb0 0x7fcfb406cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54138/0 (socket says 172.21.15.6:54138) 2023-10-06T02:17:59.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.556+0000 7fcfb37fe700 1 -- 172.21.15.6:0/981615671 learned_addr learned my addr 172.21.15.6:0/981615671 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.557+0000 7fcfb3fff700 1 -- 172.21.15.6:0/981615671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfb406cff0 msgr2=0x7fcfb406d450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:17:59.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.557+0000 7fcfb3fff700 1 --2- 172.21.15.6:0/981615671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfb406cff0 0x7fcfb406d450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.557+0000 7fcfb3fff700 1 -- 172.21.15.6:0/981615671 >> v2:172.21.15.6:3300/0 conn(0x7fcfb406bbb0 msgr2=0x7fcfb406cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.557+0000 7fcfb3fff700 1 --2- 172.21.15.6:0/981615671 >> v2:172.21.15.6:3300/0 conn(0x7fcfb406bbb0 0x7fcfb406cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.557+0000 7fcfb3fff700 1 -- 172.21.15.6:0/981615671 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb40c9350 con 0x7fcfb406b7e0 2023-10-06T02:17:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.557+0000 7f76faed3700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f76f40af030 0x7f76f406ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.557+0000 7f76faed3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f40acbf0 0x7f76f4166440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.557+0000 7f76faed3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f40c7fc0 con 0x7f76f4166980 2023-10-06T02:17:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.557+0000 7f76faed3700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f40c8860 con 0x7f76f40af030 2023-10-06T02:17:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.557+0000 7f76faed3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f40af400 con 0x7f76f40acbf0 2023-10-06T02:17:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.557+0000 7f76f8c6f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f76f40af030 0x7f76f406ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.557+0000 7f76f8c6f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f76f40af030 0x7f76f406ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:52100/0 (socket says 172.21.15.6:52100) 2023-10-06T02:17:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.557+0000 7f76f8c6f700 1 -- 172.21.15.6:0/1310116656 learned_addr learned my addr 172.21.15.6:0/1310116656 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.557+0000 7fcfb3fff700 1 --2- 172.21.15.6:0/981615671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfb406b7e0 0x7fcfb40cac00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcfb406eed0 tx=0x7fcfa80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86fb01b3f66ff008 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.557+0000 7f76f3fff700 1 --2- 172.21.15.6:0/1310116656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f40acbf0 0x7f76f4166440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.557+0000 7fcfb2ffd700 1 -- 172.21.15.6:0/981615671 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8011630 con 0x7fcfb406b7e0 2023-10-06T02:17:59.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.558+0000 7fcfb2ffd700 1 -- 172.21.15.6:0/981615671 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa80117b0 con 0x7fcfb406b7e0 2023-10-06T02:17:59.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.558+0000 7fcfb2ffd700 1 -- 172.21.15.6:0/981615671 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8011b70 con 0x7fcfb406b7e0 2023-10-06T02:17:59.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.558+0000 7f1aac38b700 1 Processor -- start 2023-10-06T02:17:59.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.558+0000 7ff6a29c8700 1 Processor -- start 2023-10-06T02:17:59.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.558+0000 7ff6a29c8700 1 -- start start 2023-10-06T02:17:59.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.559+0000 7fcfba2c0700 1 -- 172.21.15.6:0/981615671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfb406b7e0 msgr2=0x7fcfb40cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.559+0000 7fcfba2c0700 1 --2- 172.21.15.6:0/981615671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfb406b7e0 0x7fcfb40cac00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcfb406eed0 tx=0x7fcfa80091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.558+0000 7f76f8c6f700 1 -- 172.21.15.6:0/1310116656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f40acbf0 msgr2=0x7f76f4166440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.558+0000 7f76f8c6f700 1 --2- 172.21.15.6:0/1310116656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f40acbf0 0x7f76f4166440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.558+0000 7f76f8c6f700 1 -- 172.21.15.6:0/1310116656 >> v1:172.21.15.175:6789/0 conn(0x7f76f4166980 legacy=0x7f76f416a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.558+0000 7f76f8c6f700 1 -- 172.21.15.6:0/1310116656 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f40c8210 con 0x7f76f40af030 2023-10-06T02:17:59.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.558+0000 7f76f8c6f700 1 --2- 172.21.15.6:0/1310116656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f40af030 0x7f76f406ec70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f76e80099b0 tx=0x7f76e8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c04bcb985f2df1b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.559+0000 7ff6a29c8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff69c0ad080 0x7ff69c15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.559+0000 7ff6a29c8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff69c1666e0 0x7ff69c168230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.559+0000 7ff6a29c8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff69c0a88d0 0x7ff69c0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.559+0000 7ff6a29c8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c167ee0 con 0x7ff69c1666e0 2023-10-06T02:17:59.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.559+0000 7ff6a29c8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0a8dd0 con 0x7ff69c0ad080 2023-10-06T02:17:59.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.559+0000 7ff6a29c8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0a90b0 con 0x7ff69c0a88d0 2023-10-06T02:17:59.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.559+0000 7f76f37fe700 1 -- 172.21.15.6:0/1310116656 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8009ea0 con 0x7f76f40af030 2023-10-06T02:17:59.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.559+0000 7f76f37fe700 1 -- 172.21.15.6:0/1310116656 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e800b860 con 0x7f76f40af030 2023-10-06T02:17:59.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.559+0000 7f76f37fe700 1 -- 172.21.15.6:0/1310116656 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e800bc00 con 0x7f76f40af030 2023-10-06T02:17:59.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.558+0000 7f1aac38b700 1 -- start start 2023-10-06T02:17:59.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.559+0000 7f1aac38b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1aa4158da0 0x7f1aa406ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.559+0000 7f1aac38b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa40b00c0 con 0x7f1aa40c8900 2023-10-06T02:17:59.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.559+0000 7f1aac38b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa40af790 con 0x7f1aa40c9480 2023-10-06T02:17:59.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.559+0000 7f1aac38b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa40afa70 con 0x7f1aa4158da0 2023-10-06T02:17:59.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.559+0000 7ff6a0f65700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff69c0a88d0 0x7ff69c0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7ff69b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff69c1666e0 0x7ff69c168230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7ff69b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff69c1666e0 0x7ff69c168230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54144/0 (socket says 172.21.15.6:54144) 2023-10-06T02:17:59.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7ff69b7fe700 1 -- 172.21.15.6:0/1322926540 learned_addr learned my addr 172.21.15.6:0/1322926540 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7fcfba2c0700 1 -- 172.21.15.6:0/981615671 shutdown_connections 2023-10-06T02:17:59.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7fcfba2c0700 1 --2- 172.21.15.6:0/981615671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfb406cff0 0x7fcfb406d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7fcfba2c0700 1 --2- 172.21.15.6:0/981615671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfb406b7e0 0x7fcfb40cac00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7fcfba2c0700 1 --2- 172.21.15.6:0/981615671 >> v2:172.21.15.6:3300/0 conn(0x7fcfb406bbb0 0x7fcfb406cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7fcfba2c0700 1 -- 172.21.15.6:0/981615671 >> 172.21.15.6:0/981615671 conn(0x7fcfb406a260 msgr2=0x7fcfb40cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7f1aa9926700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1aa40c8900 0x7f1aa40c8d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36018/0 (socket says 172.21.15.6:36018) 2023-10-06T02:17:59.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7f1aa9926700 1 -- 172.21.15.6:0/4041977867 learned_addr learned my addr 172.21.15.6:0/4041977867 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:59.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7ff69b7fe700 1 -- 172.21.15.6:0/1322926540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff69c0a88d0 msgr2=0x7ff69c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7ff69b7fe700 1 --2- 172.21.15.6:0/1322926540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff69c0a88d0 0x7ff69c0b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7ff69b7fe700 1 -- 172.21.15.6:0/1322926540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff69c0ad080 msgr2=0x7ff69c15ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:17:59.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7ff69b7fe700 1 --2- 172.21.15.6:0/1322926540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff69c0ad080 0x7ff69c15ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7ff69b7fe700 1 -- 172.21.15.6:0/1322926540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c00b6c0 con 0x7ff69c1666e0 2023-10-06T02:17:59.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7f76faed3700 1 -- 172.21.15.6:0/1310116656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f40af030 msgr2=0x7f76f406ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7f76faed3700 1 --2- 172.21.15.6:0/1310116656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f40af030 0x7f76f406ec70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f76e80099b0 tx=0x7f76e8009250 comp rx=0 tx=0).stop 2023-10-06T02:17:59.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7f1aaa127700 1 --2- 172.21.15.6:0/4041977867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1aa4158da0 0x7f1aa406ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.560+0000 7ff69b7fe700 1 --2- 172.21.15.6:0/1322926540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff69c1666e0 0x7ff69c168230 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0af170 tx=0x7ff68c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.561+0000 7f1aaa127700 1 -- 172.21.15.6:0/4041977867 >> v1:172.21.15.175:6789/0 conn(0x7f1aa40c9480 legacy=0x7f1aa40b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.561+0000 7f1aaa127700 1 -- 172.21.15.6:0/4041977867 >> v1:172.21.15.6:6789/0 conn(0x7f1aa40c8900 legacy=0x7f1aa40c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.561+0000 7f1aaa127700 1 -- 172.21.15.6:0/4041977867 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa40afd50 con 0x7f1aa4158da0 2023-10-06T02:17:59.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.561+0000 7fcfba2c0700 1 -- 172.21.15.6:0/981615671 shutdown_connections 2023-10-06T02:17:59.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.561+0000 7ff683fff700 1 -- 172.21.15.6:0/1322926540 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c01b7f0 con 0x7ff69c1666e0 2023-10-06T02:17:59.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.561+0000 7ff683fff700 1 -- 172.21.15.6:0/1322926540 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c01b950 con 0x7ff69c1666e0 2023-10-06T02:17:59.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.561+0000 7ff683fff700 1 -- 172.21.15.6:0/1322926540 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c01bcf0 con 0x7ff69c1666e0 2023-10-06T02:17:59.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.561+0000 7fcfba2c0700 1 -- 172.21.15.6:0/981615671 wait complete. 2023-10-06T02:17:59.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.561+0000 7f1aaa127700 1 --2- 172.21.15.6:0/4041977867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1aa4158da0 0x7f1aa406ec70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009e90 tx=0x7f1a9c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de1fb5f66f4b3116 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.561+0000 7f76faed3700 1 -- 172.21.15.6:0/1310116656 shutdown_connections 2023-10-06T02:17:59.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.561+0000 7f76faed3700 1 --2- 172.21.15.6:0/1310116656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f40af030 0x7f76f406ec70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.561+0000 7f76faed3700 1 --2- 172.21.15.6:0/1310116656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f40acbf0 0x7f76f4166440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.561+0000 7f76faed3700 1 -- 172.21.15.6:0/1310116656 >> 172.21.15.6:0/1310116656 conn(0x7f76f4069110 msgr2=0x7f76f40cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.561+0000 7f76faed3700 1 -- 172.21.15.6:0/1310116656 shutdown_connections 2023-10-06T02:17:59.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.562+0000 7f1aa9125700 1 -- 172.21.15.6:0/4041977867 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c00e070 con 0x7f1aa4158da0 2023-10-06T02:17:59.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.562+0000 7f1aa9125700 1 -- 172.21.15.6:0/4041977867 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9c00bb30 con 0x7f1aa4158da0 2023-10-06T02:17:59.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.562+0000 7f1aa9125700 1 -- 172.21.15.6:0/4041977867 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c012450 con 0x7f1aa4158da0 2023-10-06T02:17:59.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.562+0000 7fc88d97e700 1 Processor -- start 2023-10-06T02:17:59.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.562+0000 7fc88d97e700 1 -- start start 2023-10-06T02:17:59.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.562+0000 7f514a3b0700 1 Processor -- start 2023-10-06T02:17:59.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.563+0000 7f514a3b0700 1 -- start start 2023-10-06T02:17:59.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.563+0000 7fcfba2c0700 1 Processor -- start 2023-10-06T02:17:59.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.563+0000 7f1aac38b700 1 -- 172.21.15.6:0/4041977867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1aa4158da0 msgr2=0x7f1aa406ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.563+0000 7f1aac38b700 1 --2- 172.21.15.6:0/4041977867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1aa4158da0 0x7f1aa406ec70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009e90 tx=0x7f1a9c009780 comp rx=0 tx=0).stop 2023-10-06T02:17:59.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.563+0000 7fc88d97e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc88815dbc0 0x7fc8880acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.563+0000 7fc88d97e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc88806f1f0 con 0x7fc8880c9180 2023-10-06T02:17:59.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.563+0000 7fc88d97e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8880af030 con 0x7fc8880c95d0 2023-10-06T02:17:59.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.563+0000 7fc88d97e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc888162750 con 0x7fc88815dbc0 2023-10-06T02:17:59.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.561+0000 7f76faed3700 1 -- 172.21.15.6:0/1310116656 wait complete. 2023-10-06T02:17:59.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.563+0000 7f76faed3700 1 Processor -- start 2023-10-06T02:17:59.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.563+0000 7fc8877fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc8880c9180 0x7fc888162040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36024/0 (socket says 172.21.15.6:36024) 2023-10-06T02:17:59.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.563+0000 7fc8877fe700 1 -- 172.21.15.6:0/795270828 learned_addr learned my addr 172.21.15.6:0/795270828 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:59.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.563+0000 7f76faed3700 1 -- start start 2023-10-06T02:17:59.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.563+0000 7fc886ffd700 1 --2- 172.21.15.6:0/795270828 >> v2:172.21.15.6:3300/0 conn(0x7fc88815dbc0 0x7fc8880acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7fc885ffb700 1 -- 172.21.15.6:0/795270828 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126510282 0 0) 0x7fc88806f1f0 con 0x7fc8880c9180 2023-10-06T02:17:59.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7fc885ffb700 1 -- 172.21.15.6:0/795270828 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc870003570 con 0x7fc8880c9180 2023-10-06T02:17:59.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7fc886ffd700 1 -- 172.21.15.6:0/795270828 >> v1:172.21.15.175:6789/0 conn(0x7fc8880c95d0 legacy=0x7fc888161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7fc886ffd700 1 -- 172.21.15.6:0/795270828 >> v1:172.21.15.6:6789/0 conn(0x7fc8880c9180 legacy=0x7fc888162040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7fc886ffd700 1 -- 172.21.15.6:0/795270828 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88806e5e0 con 0x7fc88815dbc0 2023-10-06T02:17:59.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7f514a3b0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51440b28c0 0x7f5144087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7f514a3b0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51440afc50 con 0x7f5144086ff0 2023-10-06T02:17:59.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7f514a3b0700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51440aff30 con 0x7f514415a030 2023-10-06T02:17:59.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7f514a3b0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51440b0cf0 con 0x7f51440b28c0 2023-10-06T02:17:59.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7fc886ffd700 1 --2- 172.21.15.6:0/795270828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc88815dbc0 0x7fc8880acb40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0098e0 tx=0x7fc87c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd016f2b1e50d843 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7f514894d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51440b28c0 0x7f5144087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7f514894d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51440b28c0 0x7f5144087470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54158/0 (socket says 172.21.15.6:54158) 2023-10-06T02:17:59.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7f514894d700 1 -- 172.21.15.6:0/858607616 learned_addr learned my addr 172.21.15.6:0/858607616 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.563+0000 7fcfba2c0700 1 -- start start 2023-10-06T02:17:59.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7fcfba2c0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfb406b7e0 0x7fcfb41449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7fcfba2c0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfb406bbb0 0x7fcfb41436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7fcfba2c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfb406cff0 0x7fcfb4141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7fcfba2c0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb413a950 con 0x7fcfb406cff0 2023-10-06T02:17:59.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7fcfba2c0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40ac750 con 0x7fcfb406bbb0 2023-10-06T02:17:59.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7fcfba2c0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40aca30 con 0x7fcfb406b7e0 2023-10-06T02:17:59.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7f76faed3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f40acbf0 0x7f76f4086600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7f76faed3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76f40af030 0x7f76f4188e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7f76faed3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f4166980 0x7f76f40a6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7f76faed3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f40a6730 con 0x7f76f40af030 2023-10-06T02:17:59.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7f76faed3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f40a57d0 con 0x7f76f4166980 2023-10-06T02:17:59.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7f76faed3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f4086b40 con 0x7f76f40acbf0 2023-10-06T02:17:59.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7fcfb3fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfb406b7e0 0x7fcfb41449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7fcfb885d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfb406cff0 0x7fcfb4141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7fcfb37fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfb406bbb0 0x7fcfb41436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7fcfb885d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfb406cff0 0x7fcfb4141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54162/0 (socket says 172.21.15.6:54162) 2023-10-06T02:17:59.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.564+0000 7fcfb885d700 1 -- 172.21.15.6:0/1721413260 learned_addr learned my addr 172.21.15.6:0/1721413260 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f1aac38b700 1 -- 172.21.15.6:0/4041977867 shutdown_connections 2023-10-06T02:17:59.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f1aac38b700 1 --2- 172.21.15.6:0/4041977867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1aa4158da0 0x7f1aa406ec70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f1aac38b700 1 -- 172.21.15.6:0/4041977867 >> 172.21.15.6:0/4041977867 conn(0x7f1aa4069110 msgr2=0x7f1aa40cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7fc885ffb700 1 -- 172.21.15.6:0/795270828 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c00b640 con 0x7fc88815dbc0 2023-10-06T02:17:59.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7fc885ffb700 1 -- 172.21.15.6:0/795270828 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87c00b7a0 con 0x7fc88815dbc0 2023-10-06T02:17:59.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7fc885ffb700 1 -- 172.21.15.6:0/795270828 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c00bb40 con 0x7fc88815dbc0 2023-10-06T02:17:59.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7fcfb37fe700 1 -- 172.21.15.6:0/1721413260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfb406b7e0 msgr2=0x7fcfb41449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7fcfb37fe700 1 --2- 172.21.15.6:0/1721413260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfb406b7e0 0x7fcfb41449f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7fcfb37fe700 1 -- 172.21.15.6:0/1721413260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfb406cff0 msgr2=0x7fcfb4141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7fcfb37fe700 1 --2- 172.21.15.6:0/1721413260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfb406cff0 0x7fcfb4141e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7fcfb37fe700 1 -- 172.21.15.6:0/1721413260 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa8009420 con 0x7fcfb406bbb0 2023-10-06T02:17:59.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f76f9470700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f4166980 0x7f76f40a6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f76f3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76f40af030 0x7f76f4188e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f76f9470700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f4166980 0x7f76f40a6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:52128/0 (socket says 172.21.15.6:52128) 2023-10-06T02:17:59.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f76f9470700 1 -- 172.21.15.6:0/1365541213 learned_addr learned my addr 172.21.15.6:0/1365541213 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f76f3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76f40af030 0x7f76f4188e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54166/0 (socket says 172.21.15.6:54166) 2023-10-06T02:17:59.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f514894d700 1 -- 172.21.15.6:0/858607616 >> v1:172.21.15.175:6789/0 conn(0x7f514415a030 legacy=0x7f514415a400 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:17:59.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f514894d700 1 -- 172.21.15.6:0/858607616 >> v1:172.21.15.6:6789/0 conn(0x7f5144086ff0 legacy=0x7f51440b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f514894d700 1 -- 172.21.15.6:0/858607616 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51440b0210 con 0x7f51440b28c0 2023-10-06T02:17:59.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f514894d700 1 --2- 172.21.15.6:0/858607616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51440b28c0 0x7f5144087470 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f513c009f20 tx=0x7f513c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4b72355d40c4b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7fcfb37fe700 1 --2- 172.21.15.6:0/1721413260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfb406bbb0 0x7fcfb41436d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400e8d0 tx=0x7fcfa4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f76f9470700 1 -- 172.21.15.6:0/1365541213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f40acbf0 msgr2=0x7f76f4086600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:17:59.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f76f9470700 1 --2- 172.21.15.6:0/1365541213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f40acbf0 0x7f76f4086600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f76f9470700 1 -- 172.21.15.6:0/1365541213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76f40af030 msgr2=0x7f76f4188e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f76f9470700 1 --2- 172.21.15.6:0/1365541213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76f40af030 0x7f76f4188e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f76f9470700 1 -- 172.21.15.6:0/1365541213 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e80094f0 con 0x7f76f4166980 2023-10-06T02:17:59.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.561+0000 7ff6a29c8700 1 -- 172.21.15.6:0/1322926540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69c0a9390 con 0x7ff69c1666e0 2023-10-06T02:17:59.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.561+0000 7ff6a29c8700 1 -- 172.21.15.6:0/1322926540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69c168770 con 0x7ff69c1666e0 2023-10-06T02:17:59.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7f76f3fff700 1 --2- 172.21.15.6:0/1365541213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76f40af030 0x7f76f4188e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:59.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7fc88d97e700 1 -- 172.21.15.6:0/795270828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc88815dbc0 msgr2=0x7fc8880acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7fc88d97e700 1 --2- 172.21.15.6:0/795270828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc88815dbc0 0x7fc8880acb40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0098e0 tx=0x7fc87c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.565+0000 7f5142ffd700 1 -- 172.21.15.6:0/858607616 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c00e070 con 0x7f51440b28c0 2023-10-06T02:17:59.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7f5142ffd700 1 -- 172.21.15.6:0/858607616 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c00ba40 con 0x7f51440b28c0 2023-10-06T02:17:59.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7f5142ffd700 1 -- 172.21.15.6:0/858607616 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c0092e0 con 0x7f51440b28c0 2023-10-06T02:17:59.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7fcf9bfff700 1 -- 172.21.15.6:0/1721413260 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4013680 con 0x7fcfb406bbb0 2023-10-06T02:17:59.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7fcf9bfff700 1 -- 172.21.15.6:0/1721413260 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa40137e0 con 0x7fcfb406bbb0 2023-10-06T02:17:59.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7fcf9bfff700 1 -- 172.21.15.6:0/1721413260 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4013b60 con 0x7fcfb406bbb0 2023-10-06T02:17:59.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7f76f9470700 1 --2- 172.21.15.6:0/1365541213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f4166980 0x7f76f40a6a60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00c820 tx=0x7f76ec0015f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7f76f0ff9700 1 -- 172.21.15.6:0/1365541213 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec012630 con 0x7f76f4166980 2023-10-06T02:17:59.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7f76f0ff9700 1 -- 172.21.15.6:0/1365541213 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec0127b0 con 0x7f76f4166980 2023-10-06T02:17:59.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7f76faed3700 1 -- 172.21.15.6:0/1365541213 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f4189380 con 0x7f76f4166980 2023-10-06T02:17:59.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7fc88d97e700 1 -- 172.21.15.6:0/795270828 shutdown_connections 2023-10-06T02:17:59.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7fc88d97e700 1 --2- 172.21.15.6:0/795270828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc88815dbc0 0x7fc8880acb40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7fc88d97e700 1 -- 172.21.15.6:0/795270828 >> 172.21.15.6:0/795270828 conn(0x7fc888069110 msgr2=0x7fc8880cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7f76f0ff9700 1 -- 172.21.15.6:0/1365541213 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec012b70 con 0x7f76f4166980 2023-10-06T02:17:59.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7f76faed3700 1 -- 172.21.15.6:0/1365541213 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f40a4ea0 con 0x7f76f4166980 2023-10-06T02:17:59.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7fcfba2c0700 1 -- 172.21.15.6:0/1721413260 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb40acd10 con 0x7fcfb406bbb0 2023-10-06T02:17:59.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.566+0000 7fcfba2c0700 1 -- 172.21.15.6:0/1721413260 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb40ad2d0 con 0x7fcfb406bbb0 2023-10-06T02:17:59.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.567+0000 7f514a3b0700 1 -- 172.21.15.6:0/858607616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51440b28c0 msgr2=0x7f5144087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.567+0000 7f514a3b0700 1 --2- 172.21.15.6:0/858607616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51440b28c0 0x7f5144087470 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f513c009f20 tx=0x7f513c009840 comp rx=0 tx=0).stop 2023-10-06T02:17:59.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.567+0000 7f76faed3700 1 -- 172.21.15.6:0/1365541213 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76f406fcb0 con 0x7f76f4166980 2023-10-06T02:17:59.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.567+0000 7f514a3b0700 1 -- 172.21.15.6:0/858607616 shutdown_connections 2023-10-06T02:17:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.567+0000 7f514a3b0700 1 --2- 172.21.15.6:0/858607616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51440b28c0 0x7f5144087470 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.567+0000 7f514a3b0700 1 -- 172.21.15.6:0/858607616 >> 172.21.15.6:0/858607616 conn(0x7f5144068680 msgr2=0x7f5144068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.567+0000 7fc88d97e700 1 -- 172.21.15.6:0/795270828 shutdown_connections 2023-10-06T02:17:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.567+0000 7fcfba2c0700 1 -- 172.21.15.6:0/1721413260 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfb406e700 con 0x7fcfb406bbb0 2023-10-06T02:17:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.567+0000 7ff681ffb700 1 -- 172.21.15.6:0/1322926540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff69c06fcb0 con 0x7ff69c1666e0 2023-10-06T02:17:59.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.567+0000 7f1aac38b700 1 -- 172.21.15.6:0/4041977867 shutdown_connections 2023-10-06T02:17:59.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.567+0000 7f1aac38b700 1 -- 172.21.15.6:0/4041977867 wait complete. 2023-10-06T02:17:59.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.567+0000 7fc88d97e700 1 -- 172.21.15.6:0/795270828 wait complete. 2023-10-06T02:17:59.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.568+0000 7ff683fff700 1 -- 172.21.15.6:0/1322926540 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff68c0225e0 con 0x7ff69c1666e0 2023-10-06T02:17:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.568+0000 7ff683fff700 1 --2- 172.21.15.6:0/1322926540 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff688067000 0x7ff6880694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.568+0000 7ff683fff700 1 -- 172.21.15.6:0/1322926540 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff68c01f070 con 0x7ff69c1666e0 2023-10-06T02:17:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.568+0000 7ff683fff700 1 --2- 172.21.15.6:0/1322926540 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7ff688070cd0 0x7ff688073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.569+0000 7ff683fff700 1 -- 172.21.15.6:0/1322926540 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6880737d0 con 0x7ff688070cd0 2023-10-06T02:17:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.569+0000 7ff683fff700 1 -- 172.21.15.6:0/1322926540 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff68c08a240 con 0x7ff69c1666e0 2023-10-06T02:17:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.568+0000 7f514a3b0700 1 -- 172.21.15.6:0/858607616 shutdown_connections 2023-10-06T02:17:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.569+0000 7fc88d97e700 1 Processor -- start 2023-10-06T02:17:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.569+0000 7ff6a0f65700 1 --2- 172.21.15.6:0/1322926540 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7ff688070cd0 0x7ff688073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.569+0000 7f1aac38b700 1 Processor -- start 2023-10-06T02:17:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.568+0000 7f514a3b0700 1 -- 172.21.15.6:0/858607616 wait complete. 2023-10-06T02:17:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.569+0000 7f514a3b0700 1 Processor -- start 2023-10-06T02:17:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.569+0000 7fcf9bfff700 1 -- 172.21.15.6:0/1721413260 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcfa4025420 con 0x7fcfb406bbb0 2023-10-06T02:17:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.569+0000 7fcf9bfff700 1 --2- 172.21.15.6:0/1721413260 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcfa0067000 0x7fcfa00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.569+0000 7fcf9bfff700 1 -- 172.21.15.6:0/1721413260 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcfa4084cb0 con 0x7fcfb406bbb0 2023-10-06T02:17:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7fcf9bfff700 1 --2- 172.21.15.6:0/1721413260 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7fcfa0070cd0 0x7fcfa0073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7fcf9bfff700 1 -- 172.21.15.6:0/1721413260 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcfa00737d0 con 0x7fcfa0070cd0 2023-10-06T02:17:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7fcf9bfff700 1 -- 172.21.15.6:0/1721413260 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfa4085080 con 0x7fcfb406bbb0 2023-10-06T02:17:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7ff6a0f65700 1 --2- 172.21.15.6:0/1322926540 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7ff688070cd0 0x7ff688073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7ff69bfff700 1 --2- 172.21.15.6:0/1322926540 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff688067000 0x7ff6880694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7f76f0ff9700 1 -- 172.21.15.6:0/1365541213 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f76ec003030 con 0x7f76f4166980 2023-10-06T02:17:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.569+0000 7fc88d97e700 1 -- start start 2023-10-06T02:17:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7fc88d97e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8880c95d0 0x7fc8881514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7fc88d97e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc88815dbc0 0x7fc888153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7fc88d97e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc88815af40 0x7fc88815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7fc88d97e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88815b900 con 0x7fc8880c95d0 2023-10-06T02:17:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7fc88d97e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc888154fb0 con 0x7fc88815dbc0 2023-10-06T02:17:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7fc88d97e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88815a8c0 con 0x7fc88815af40 2023-10-06T02:17:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7f76f0ff9700 1 --2- 172.21.15.6:0/1365541213 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f76d8066f80 0x7f76d8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7fcfb885d700 1 --2- 172.21.15.6:0/1721413260 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7fcfa0070cd0 0x7fcfa0073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7ff69bfff700 1 --2- 172.21.15.6:0/1322926540 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff688067000 0x7ff6880694b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff694004fb0 tx=0x7ff6940070b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7f76f0ff9700 1 -- 172.21.15.6:0/1365541213 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f76ec084fd0 con 0x7f76f4166980 2023-10-06T02:17:59.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7f76f0ff9700 1 --2- 172.21.15.6:0/1365541213 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7f76d8070c50 0x7f76d8073080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7f76f0ff9700 1 -- 172.21.15.6:0/1365541213 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76d8073750 con 0x7f76d8070c50 2023-10-06T02:17:59.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7f76f0ff9700 1 -- 172.21.15.6:0/1365541213 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76ec085300 con 0x7f76f4166980 2023-10-06T02:17:59.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7f76f3fff700 1 --2- 172.21.15.6:0/1365541213 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7f76d8070c50 0x7f76d8073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7f76f8c6f700 1 --2- 172.21.15.6:0/1365541213 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f76d8066f80 0x7f76d8069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7f9bf46ed700 1 Processor -- start 2023-10-06T02:17:59.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7f514a3b0700 1 -- start start 2023-10-06T02:17:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7fcfb885d700 1 --2- 172.21.15.6:0/1721413260 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7fcfa0070cd0 0x7fcfa0073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7f9bf46ed700 1 -- start start 2023-10-06T02:17:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7fcfb3fff700 1 --2- 172.21.15.6:0/1721413260 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcfa0067000 0x7fcfa00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7fc8867fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc88815dbc0 0x7fc888153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7fc8867fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc88815dbc0 0x7fc888153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:52134/0 (socket says 172.21.15.6:52134) 2023-10-06T02:17:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7fc8867fc700 1 -- 172.21.15.6:0/3628429012 learned_addr learned my addr 172.21.15.6:0/3628429012 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7f514a3b0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5144086ff0 0x7f51440c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7f514a3b0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51440b28c0 0x7f514415b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7f514a3b0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51440c4ac0 0x7f514415baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7f514a3b0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51440c7700 con 0x7f51440c4ac0 2023-10-06T02:17:59.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7f514a3b0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51440c4f40 con 0x7f51440b28c0 2023-10-06T02:17:59.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7f514a3b0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51440c5220 con 0x7f5144086ff0 2023-10-06T02:17:59.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7ff683fff700 1 -- 172.21.15.6:0/1322926540 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff6880737d0 con 0x7ff688070cd0 2023-10-06T02:17:59.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7fc8877fe700 1 --2- 172.21.15.6:0/3628429012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc88815af40 0x7fc88815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f5143fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5144086ff0 0x7f51440c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f5143fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5144086ff0 0x7f51440c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:60672/0 (socket says 172.21.15.6:60672) 2023-10-06T02:17:59.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f5143fff700 1 -- 172.21.15.6:0/2276275552 learned_addr learned my addr 172.21.15.6:0/2276275552 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f514894d700 1 --2- 172.21.15.6:0/2276275552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51440c4ac0 0x7f514415baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.569+0000 7f1aac38b700 1 -- start start 2023-10-06T02:17:59.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7fcfb3fff700 1 --2- 172.21.15.6:0/1721413260 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcfa0067000 0x7fcfa00694b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcfb406eed0 tx=0x7fcfa8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7f1aac38b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1aa40c8900 0x7f1aa4148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7f1aac38b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa40c9480 0x7f1aa4148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7f1aac38b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa4158da0 0x7f1aa416f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7f1aac38b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa41474f0 con 0x7f1aa4158da0 2023-10-06T02:17:59.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7f1aac38b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa41468e0 con 0x7f1aa40c9480 2023-10-06T02:17:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.570+0000 7f1aac38b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4146bc0 con 0x7f1aa40c8900 2023-10-06T02:17:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7f1aa9926700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa40c9480 0x7f1aa4148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7f1aa9926700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa40c9480 0x7f1aa4148950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:52148/0 (socket says 172.21.15.6:52148) 2023-10-06T02:17:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7f1aa9926700 1 -- 172.21.15.6:0/452025789 learned_addr learned my addr 172.21.15.6:0/452025789 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.571+0000 7f1aa9926700 1 -- 172.21.15.6:0/452025789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1aa40c8900 msgr2=0x7f1aa4148410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T02:17:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f1aa9926700 1 --2- 172.21.15.6:0/452025789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1aa40c8900 0x7f1aa4148410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f1aa9926700 1 -- 172.21.15.6:0/452025789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa4158da0 msgr2=0x7f1aa416f000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T02:17:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f1aa9926700 1 --2- 172.21.15.6:0/452025789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa4158da0 0x7f1aa416f000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f1aa9926700 1 -- 172.21.15.6:0/452025789 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c009a20 con 0x7f1aa40c9480 2023-10-06T02:17:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f76f8c6f700 1 --2- 172.21.15.6:0/1365541213 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f76d8066f80 0x7f76d8069430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f76e80099b0 tx=0x7f76e8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7fc8867fc700 1 -- 172.21.15.6:0/3628429012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc88815af40 msgr2=0x7fc88815b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7fc8867fc700 1 --2- 172.21.15.6:0/3628429012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc88815af40 0x7fc88815b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7fc8867fc700 1 -- 172.21.15.6:0/3628429012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8880c95d0 msgr2=0x7fc8881514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7fc8867fc700 1 --2- 172.21.15.6:0/3628429012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8880c95d0 0x7fc8881514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7fc8867fc700 1 -- 172.21.15.6:0/3628429012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c009420 con 0x7fc88815dbc0 2023-10-06T02:17:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7fc8877fe700 1 --2- 172.21.15.6:0/3628429012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc88815af40 0x7fc88815b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:17:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f51437fe700 1 --2- 172.21.15.6:0/2276275552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51440b28c0 0x7f514415b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f1aa9926700 1 --2- 172.21.15.6:0/452025789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa40c9480 0x7f1aa4148950 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1a94001640 tx=0x7f1a94005fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7fcf9bfff700 1 -- 172.21.15.6:0/1721413260 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fcfa00737d0 con 0x7fcfa0070cd0 2023-10-06T02:17:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f5143fff700 1 -- 172.21.15.6:0/2276275552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51440b28c0 msgr2=0x7f514415b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f5143fff700 1 --2- 172.21.15.6:0/2276275552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51440b28c0 0x7f514415b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f5143fff700 1 -- 172.21.15.6:0/2276275552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51440c4ac0 msgr2=0x7f514415baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f5143fff700 1 --2- 172.21.15.6:0/2276275552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51440c4ac0 0x7f514415baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f5143fff700 1 -- 172.21.15.6:0/2276275552 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c009ae0 con 0x7f5144086ff0 2023-10-06T02:17:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f76f3fff700 1 --2- 172.21.15.6:0/1365541213 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7f76d8070c50 0x7f76d8073080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7fc8867fc700 1 --2- 172.21.15.6:0/3628429012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc88815dbc0 0x7fc888153fa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc87800b630 tx=0x7fc8780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f1a9a7fc700 1 -- 172.21.15.6:0/452025789 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9400b7d0 con 0x7f1aa40c9480 2023-10-06T02:17:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.573+0000 7f5143fff700 1 --2- 172.21.15.6:0/2276275552 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5144086ff0 0x7f51440c4580 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f513400b5e0 tx=0x7f5134009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f1a9a7fc700 1 -- 172.21.15.6:0/452025789 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9400b930 con 0x7f1aa40c9480 2023-10-06T02:17:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f1a9a7fc700 1 -- 172.21.15.6:0/452025789 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9400bcf0 con 0x7f1aa40c9480 2023-10-06T02:17:59.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f9bf46ed700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bec0a9dd0 0x7f9bec06e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.572+0000 7f9bf46ed700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9bec0aa1a0 0x7f9bec1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.573+0000 7f9bf46ed700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bec06e890 con 0x7f9bec15d4c0 2023-10-06T02:17:59.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.573+0000 7f9bf46ed700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bec0c8250 con 0x7f9bec0aa1a0 2023-10-06T02:17:59.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.573+0000 7f9bf46ed700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec06eb70 con 0x7f9bec0a9dd0 2023-10-06T02:17:59.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.573+0000 7f9bf2c8a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9bec0aa1a0 0x7f9bec1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.573+0000 7f9bf2c8a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9bec0aa1a0 0x7f9bec1599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54202/0 (socket says 172.21.15.6:54202) 2023-10-06T02:17:59.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.573+0000 7f9bf2c8a700 1 -- 172.21.15.6:0/2124625367 learned_addr learned my addr 172.21.15.6:0/2124625367 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.573+0000 7f9bf2c8a700 1 -- 172.21.15.6:0/2124625367 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bec0a9dd0 msgr2=0x7f9bec06e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.573+0000 7f9bf2c8a700 1 --2- 172.21.15.6:0/2124625367 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bec0a9dd0 0x7f9bec06e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.573+0000 7f9bf2c8a700 1 -- 172.21.15.6:0/2124625367 >> v1:172.21.15.6:6789/0 conn(0x7f9bec15d4c0 legacy=0x7f9bec1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.573+0000 7f9bf2c8a700 1 -- 172.21.15.6:0/2124625367 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec06ee50 con 0x7f9bec0aa1a0 2023-10-06T02:17:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.573+0000 7f1aac38b700 1 -- 172.21.15.6:0/452025789 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa4146ea0 con 0x7f1aa40c9480 2023-10-06T02:17:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.573+0000 7f1aac38b700 1 -- 172.21.15.6:0/452025789 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa4146320 con 0x7f1aa40c9480 2023-10-06T02:17:59.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.573+0000 7f512bfff700 1 -- 172.21.15.6:0/2276275552 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513400f510 con 0x7f5144086ff0 2023-10-06T02:17:59.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.573+0000 7f512bfff700 1 -- 172.21.15.6:0/2276275552 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513400f690 con 0x7f5144086ff0 2023-10-06T02:17:59.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.573+0000 7f512bfff700 1 -- 172.21.15.6:0/2276275552 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513400fa50 con 0x7f5144086ff0 2023-10-06T02:17:59.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.574+0000 7f514a3b0700 1 -- 172.21.15.6:0/2276275552 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51440c5500 con 0x7f5144086ff0 2023-10-06T02:17:59.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.574+0000 7f514a3b0700 1 -- 172.21.15.6:0/2276275552 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514416deb0 con 0x7f5144086ff0 2023-10-06T02:17:59.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.574+0000 7f76f0ff9700 1 -- 172.21.15.6:0/1365541213 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f76d8073750 con 0x7f76d8070c50 2023-10-06T02:17:59.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.574+0000 7f9bf2c8a700 1 --2- 172.21.15.6:0/2124625367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec0aa1a0 0x7f9bec1599e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009f20 tx=0x7f9be4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3418806a18cc1560 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.574+0000 7fc86effd700 1 -- 172.21.15.6:0/3628429012 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87800f510 con 0x7fc88815dbc0 2023-10-06T02:17:59.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.574+0000 7f9bf1487700 1 -- 172.21.15.6:0/2124625367 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400e070 con 0x7f9bec0aa1a0 2023-10-06T02:17:59.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.574+0000 7fc86effd700 1 -- 172.21.15.6:0/3628429012 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87800f690 con 0x7fc88815dbc0 2023-10-06T02:17:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.574+0000 7fc86effd700 1 -- 172.21.15.6:0/3628429012 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87800fa50 con 0x7fc88815dbc0 2023-10-06T02:17:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.574+0000 7fc88d97e700 1 -- 172.21.15.6:0/3628429012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc888151a00 con 0x7fc88815dbc0 2023-10-06T02:17:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.575+0000 7fc88d97e700 1 -- 172.21.15.6:0/3628429012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc888154cd0 con 0x7fc88815dbc0 2023-10-06T02:17:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.575+0000 7f514a3b0700 1 -- 172.21.15.6:0/2276275552 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5144088700 con 0x7f5144086ff0 2023-10-06T02:17:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.575+0000 7f9bf1487700 1 -- 172.21.15.6:0/2124625367 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be400ba40 con 0x7f9bec0aa1a0 2023-10-06T02:17:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.575+0000 7f9bf1487700 1 -- 172.21.15.6:0/2124625367 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be40092e0 con 0x7f9bec0aa1a0 2023-10-06T02:17:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.576+0000 7f9bf46ed700 1 -- 172.21.15.6:0/2124625367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec0aa1a0 msgr2=0x7f9bec1599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.576+0000 7f9bf46ed700 1 --2- 172.21.15.6:0/2124625367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec0aa1a0 0x7f9bec1599e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009f20 tx=0x7f9be4009840 comp rx=0 tx=0).stop 2023-10-06T02:17:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.575+0000 7f512bfff700 1 -- 172.21.15.6:0/2276275552 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f513401a400 con 0x7f5144086ff0 2023-10-06T02:17:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.576+0000 7f512bfff700 1 --2- 172.21.15.6:0/2276275552 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5130067000 0x7f51300694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.576+0000 7f512bfff700 1 -- 172.21.15.6:0/2276275552 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5134084190 con 0x7f5144086ff0 2023-10-06T02:17:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.576+0000 7f51437fe700 1 --2- 172.21.15.6:0/2276275552 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5130067000 0x7f51300694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.576+0000 7f512bfff700 1 --2- 172.21.15.6:0/2276275552 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7f5130070cd0 0x7f5130073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.576+0000 7f512bfff700 1 -- 172.21.15.6:0/2276275552 --> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51300737d0 con 0x7f5130070cd0 2023-10-06T02:17:59.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.576+0000 7f512bfff700 1 -- 172.21.15.6:0/2276275552 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5134086820 con 0x7f5144086ff0 2023-10-06T02:17:59.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.576+0000 7f514894d700 1 --2- 172.21.15.6:0/2276275552 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7f5130070cd0 0x7f5130073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.576+0000 7f9bf46ed700 1 -- 172.21.15.6:0/2124625367 shutdown_connections 2023-10-06T02:17:59.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.576+0000 7f9bf46ed700 1 --2- 172.21.15.6:0/2124625367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec0aa1a0 0x7f9bec1599e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.576+0000 7f9bf46ed700 1 --2- 172.21.15.6:0/2124625367 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bec0a9dd0 0x7f9bec06e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.576+0000 7f9bf46ed700 1 -- 172.21.15.6:0/2124625367 >> 172.21.15.6:0/2124625367 conn(0x7f9bec069110 msgr2=0x7f9bec0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.577+0000 7f514894d700 1 --2- 172.21.15.6:0/2276275552 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7f5130070cd0 0x7f5130073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.577+0000 7f51437fe700 1 --2- 172.21.15.6:0/2276275552 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5130067000 0x7f51300694b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f51440af7c0 tx=0x7f5138007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.577+0000 7fc86effd700 1 -- 172.21.15.6:0/3628429012 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc87801a400 con 0x7fc88815dbc0 2023-10-06T02:17:59.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.577+0000 7fc88d97e700 1 -- 172.21.15.6:0/3628429012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc88806fcb0 con 0x7fc88815dbc0 2023-10-06T02:17:59.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.578+0000 7fc86effd700 1 --2- 172.21.15.6:0/3628429012 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc874066f30 0x7fc8740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.574+0000 7f1aac38b700 1 -- 172.21.15.6:0/452025789 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1aa406fcb0 con 0x7f1aa40c9480 2023-10-06T02:17:59.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.578+0000 7fc86effd700 1 -- 172.21.15.6:0/3628429012 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc878084490 con 0x7fc88815dbc0 2023-10-06T02:17:59.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.578+0000 7fc86effd700 1 --2- 172.21.15.6:0/3628429012 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x7fc874070c00 0x7fc874073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.578+0000 7fc86effd700 1 -- 172.21.15.6:0/3628429012 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc874073700 con 0x7fc874070c00 2023-10-06T02:17:59.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.578+0000 7fc86effd700 1 -- 172.21.15.6:0/3628429012 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc878086ad0 con 0x7fc88815dbc0 2023-10-06T02:17:59.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.578+0000 7f512bfff700 1 -- 172.21.15.6:0/2276275552 <== osd.3 v2:172.21.15.6:6824/90683 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f51300737d0 con 0x7f5130070cd0 2023-10-06T02:17:59.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.579+0000 7fc8877fe700 1 --2- 172.21.15.6:0/3628429012 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x7fc874070c00 0x7fc874073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.579+0000 7fc886ffd700 1 --2- 172.21.15.6:0/3628429012 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc874066f30 0x7fc8740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.579+0000 7fc8877fe700 1 --2- 172.21.15.6:0/3628429012 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x7fc874070c00 0x7fc874073030 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.579+0000 7f1a9a7fc700 1 -- 172.21.15.6:0/452025789 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a94010670 con 0x7f1aa40c9480 2023-10-06T02:17:59.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.579+0000 7f45126b5700 1 Processor -- start 2023-10-06T02:17:59.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.579+0000 7f45126b5700 1 -- start start 2023-10-06T02:17:59.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.580+0000 7fc86effd700 1 -- 172.21.15.6:0/3628429012 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc874073700 con 0x7fc874070c00 2023-10-06T02:17:59.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.581+0000 7f45126b5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f450c1574b0 0x7f450c0b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.581+0000 7f45126b5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f450c0b13f0 0x7f450c0c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.579+0000 7f1a9a7fc700 1 --2- 172.21.15.6:0/452025789 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1a88067000 0x7f1a880694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.580+0000 7f1a9a7fc700 1 -- 172.21.15.6:0/452025789 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1a940855b0 con 0x7f1aa40c9480 2023-10-06T02:17:59.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.580+0000 7f1aaa127700 1 --2- 172.21.15.6:0/452025789 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1a88067000 0x7f1a880694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.580+0000 7f1a9a7fc700 1 --2- 172.21.15.6:0/452025789 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7f1a88070cd0 0x7f1a88073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.580+0000 7f1a9a7fc700 1 -- 172.21.15.6:0/452025789 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a880737d0 con 0x7f1a88070cd0 2023-10-06T02:17:59.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.580+0000 7f1a9a7fc700 1 -- 172.21.15.6:0/452025789 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a94087b10 con 0x7f1aa40c9480 2023-10-06T02:17:59.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.580+0000 7f1aaa928700 1 --2- 172.21.15.6:0/452025789 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7f1a88070cd0 0x7f1a88073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.580+0000 7f1aaa127700 1 --2- 172.21.15.6:0/452025789 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1a88067000 0x7f1a880694b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009e90 tx=0x7f1a9c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.580+0000 7f1aaa928700 1 --2- 172.21.15.6:0/452025789 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7f1a88070cd0 0x7f1a88073100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.581+0000 7f45126b5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450c0c3b40 con 0x7f450c0c4510 2023-10-06T02:17:59.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.581+0000 7f45126b5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450c0c4990 con 0x7f450c0b13f0 2023-10-06T02:17:59.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.581+0000 7f45126b5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450c0c2f30 con 0x7f450c1574b0 2023-10-06T02:17:59.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.581+0000 7f450bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f450c1574b0 0x7f450c0b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.581+0000 7f450bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f450c1574b0 0x7f450c0b0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:60676/0 (socket says 172.21.15.6:60676) 2023-10-06T02:17:59.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.581+0000 7f450bfff700 1 -- 172.21.15.6:0/1002807509 learned_addr learned my addr 172.21.15.6:0/1002807509 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.581+0000 7fc886ffd700 1 --2- 172.21.15.6:0/3628429012 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc874066f30 0x7fc8740693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0091e0 tx=0x7fc87c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.581+0000 7f450b7fe700 1 --2- 172.21.15.6:0/1002807509 >> v2:172.21.15.175:3300/0 conn(0x7f450c0b13f0 0x7f450c0c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.581+0000 7f1a9a7fc700 1 -- 172.21.15.6:0/452025789 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1a880737d0 con 0x7f1a88070cd0 2023-10-06T02:17:59.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.581+0000 7f450bfff700 1 -- 172.21.15.6:0/1002807509 >> v2:172.21.15.175:3300/0 conn(0x7f450c0b13f0 msgr2=0x7f450c0c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.581+0000 7f450bfff700 1 --2- 172.21.15.6:0/1002807509 >> v2:172.21.15.175:3300/0 conn(0x7f450c0b13f0 0x7f450c0c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.581+0000 7f450bfff700 1 -- 172.21.15.6:0/1002807509 >> v1:172.21.15.6:6789/0 conn(0x7f450c0c4510 legacy=0x7f450c0cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.581+0000 7f450bfff700 1 -- 172.21.15.6:0/1002807509 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c0c3210 con 0x7f450c1574b0 2023-10-06T02:17:59.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.582+0000 7f450bfff700 1 --2- 172.21.15.6:0/1002807509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f450c1574b0 0x7f450c0b0eb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4504010420 tx=0x7f450400b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e767ded50b2463c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.582+0000 7f450affd700 1 -- 172.21.15.6:0/1002807509 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504013660 con 0x7f450c1574b0 2023-10-06T02:17:59.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.582+0000 7f450affd700 1 -- 172.21.15.6:0/1002807509 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45040137c0 con 0x7f450c1574b0 2023-10-06T02:17:59.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.582+0000 7f450affd700 1 -- 172.21.15.6:0/1002807509 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504013950 con 0x7f450c1574b0 2023-10-06T02:17:59.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.583+0000 7f45126b5700 1 -- 172.21.15.6:0/1002807509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f450c1574b0 msgr2=0x7f450c0b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.583+0000 7f45126b5700 1 --2- 172.21.15.6:0/1002807509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f450c1574b0 0x7f450c0b0eb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4504010420 tx=0x7f450400b9a0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.583+0000 7f45126b5700 1 -- 172.21.15.6:0/1002807509 shutdown_connections 2023-10-06T02:17:59.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.583+0000 7f45126b5700 1 --2- 172.21.15.6:0/1002807509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f450c1574b0 0x7f450c0b0eb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.583+0000 7f45126b5700 1 --2- 172.21.15.6:0/1002807509 >> v2:172.21.15.175:3300/0 conn(0x7f450c0b13f0 0x7f450c0c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.583+0000 7f45126b5700 1 -- 172.21.15.6:0/1002807509 >> 172.21.15.6:0/1002807509 conn(0x7f450c067910 msgr2=0x7f450c0ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.586+0000 7f45126b5700 1 -- 172.21.15.6:0/1002807509 shutdown_connections 2023-10-06T02:17:59.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.586+0000 7f45126b5700 1 -- 172.21.15.6:0/1002807509 wait complete. 2023-10-06T02:17:59.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.588+0000 7f45126b5700 1 Processor -- start 2023-10-06T02:17:59.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.588+0000 7f45126b5700 1 -- start start 2023-10-06T02:17:59.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.589+0000 7f45126b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450c0b13f0 0x7f450c144590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.589+0000 7f45126b5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f450c0c4510 0x7f450c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.589+0000 7f45126b5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f450c1574b0 0x7f450c06d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.589+0000 7f45126b5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c157c40 con 0x7f450c0b13f0 2023-10-06T02:17:59.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.589+0000 7f45126b5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c15ab70 con 0x7f450c1574b0 2023-10-06T02:17:59.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.589+0000 7f45126b5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450c159f60 con 0x7f450c0c4510 2023-10-06T02:17:59.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.589+0000 7f450bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450c0b13f0 0x7f450c144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.589+0000 7f450bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450c0b13f0 0x7f450c144590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54212/0 (socket says 172.21.15.6:54212) 2023-10-06T02:17:59.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.589+0000 7f450bfff700 1 -- 172.21.15.6:0/4139196740 learned_addr learned my addr 172.21.15.6:0/4139196740 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.589+0000 7f450b7fe700 1 --2- 172.21.15.6:0/4139196740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f450c0c4510 0x7f450c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.590+0000 7f4510c52700 1 --2- 172.21.15.6:0/4139196740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f450c1574b0 0x7f450c06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.590+0000 7f450bfff700 1 -- 172.21.15.6:0/4139196740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f450c0c4510 msgr2=0x7f450c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.590+0000 7f450bfff700 1 --2- 172.21.15.6:0/4139196740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f450c0c4510 0x7f450c06d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.590+0000 7f450bfff700 1 -- 172.21.15.6:0/4139196740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f450c1574b0 msgr2=0x7f450c06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.590+0000 7f450bfff700 1 --2- 172.21.15.6:0/4139196740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f450c1574b0 0x7f450c06d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.590+0000 7f450bfff700 1 -- 172.21.15.6:0/4139196740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450400bc40 con 0x7f450c0b13f0 2023-10-06T02:17:59.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.590+0000 7f450bfff700 1 --2- 172.21.15.6:0/4139196740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450c0b13f0 0x7f450c144590 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f450c0c3070 tx=0x7f450401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.591+0000 7f44f3fff700 1 -- 172.21.15.6:0/4139196740 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504013930 con 0x7f450c0b13f0 2023-10-06T02:17:59.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.591+0000 7f44f3fff700 1 -- 172.21.15.6:0/4139196740 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450400b640 con 0x7f450c0b13f0 2023-10-06T02:17:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.591+0000 7f44f3fff700 1 -- 172.21.15.6:0/4139196740 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450401d450 con 0x7f450c0b13f0 2023-10-06T02:17:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.591+0000 7f45126b5700 1 -- 172.21.15.6:0/4139196740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450c15a240 con 0x7f450c0b13f0 2023-10-06T02:17:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.591+0000 7f45126b5700 1 -- 172.21.15.6:0/4139196740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450c15a800 con 0x7f450c0b13f0 2023-10-06T02:17:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.594+0000 7f44f3fff700 1 -- 172.21.15.6:0/4139196740 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f450401d7c0 con 0x7f450c0b13f0 2023-10-06T02:17:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.594+0000 7f44f3fff700 1 --2- 172.21.15.6:0/4139196740 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44f8066f30 0x7f44f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.594+0000 7f44f3fff700 1 -- 172.21.15.6:0/4139196740 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4504017020 con 0x7f450c0b13f0 2023-10-06T02:17:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.595+0000 7f450b7fe700 1 --2- 172.21.15.6:0/4139196740 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44f8066f30 0x7f44f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.595+0000 7f450b7fe700 1 --2- 172.21.15.6:0/4139196740 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44f8066f30 0x7f44f80693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f450c1557d0 tx=0x7f4500008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.595+0000 7f9bf46ed700 1 -- 172.21.15.6:0/2124625367 shutdown_connections 2023-10-06T02:17:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.597+0000 7f9bf46ed700 1 -- 172.21.15.6:0/2124625367 wait complete. 2023-10-06T02:17:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.598+0000 7f9bf46ed700 1 Processor -- start 2023-10-06T02:17:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.598+0000 7f9bf46ed700 1 -- start start 2023-10-06T02:17:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.598+0000 7f9bf46ed700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bec0a9dd0 0x7f9bec147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.598+0000 7f9bf46ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec0aa1a0 0x7f9bec15cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.598+0000 7f9bf46ed700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bec15d4c0 0x7f9bec159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.599+0000 7f9bf46ed700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec15bbc0 con 0x7f9bec0aa1a0 2023-10-06T02:17:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.599+0000 7f9bf46ed700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec15bdf0 con 0x7f9bec0a9dd0 2023-10-06T02:17:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.599+0000 7f9bf46ed700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec16acb0 con 0x7f9bec15d4c0 2023-10-06T02:17:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.599+0000 7f9bf1c88700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec0aa1a0 0x7f9bec15cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.599+0000 7f9bf1c88700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec0aa1a0 0x7f9bec15cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54226/0 (socket says 172.21.15.6:54226) 2023-10-06T02:17:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.599+0000 7f9bf1c88700 1 -- 172.21.15.6:0/3573664428 learned_addr learned my addr 172.21.15.6:0/3573664428 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.599+0000 7f9bf2489700 1 --2- 172.21.15.6:0/3573664428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bec0a9dd0 0x7f9bec147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.599+0000 7f9bf1c88700 1 -- 172.21.15.6:0/3573664428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bec15d4c0 msgr2=0x7f9bec159ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:17:59.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.599+0000 7f9bf1c88700 1 --2- 172.21.15.6:0/3573664428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bec15d4c0 0x7f9bec159ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.599+0000 7f9bf1c88700 1 -- 172.21.15.6:0/3573664428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bec0a9dd0 msgr2=0x7f9bec147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.599+0000 7f9bf1c88700 1 --2- 172.21.15.6:0/3573664428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bec0a9dd0 0x7f9bec147960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.599+0000 7f9bf1c88700 1 -- 172.21.15.6:0/3573664428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4009ae0 con 0x7f9bec0aa1a0 2023-10-06T02:17:59.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.599+0000 7f9bf1c88700 1 --2- 172.21.15.6:0/3573664428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec0aa1a0 0x7f9bec15cb70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9be000b600 tx=0x7f9be00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.600+0000 7f76faed3700 1 -- 172.21.15.6:0/1365541213 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f76f40ad060 con 0x7f76d8070c50 2023-10-06T02:17:59.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.600+0000 7f76f0ff9700 1 -- 172.21.15.6:0/1365541213 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f76f40ad060 con 0x7f76d8070c50 2023-10-06T02:17:59.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.600+0000 7f76faed3700 1 -- 172.21.15.6:0/1365541213 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7f76d8070c50 msgr2=0x7f76d8073080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.600+0000 7f76faed3700 1 --2- 172.21.15.6:0/1365541213 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7f76d8070c50 0x7f76d8073080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.604+0000 7ff681ffb700 1 -- 172.21.15.6:0/1322926540 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff69c0c8340 con 0x7ff688070cd0 2023-10-06T02:17:59.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.604+0000 7fc88d97e700 1 -- 172.21.15.6:0/3628429012 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc8880ad840 con 0x7fc874070c00 2023-10-06T02:17:59.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.604+0000 7f76faed3700 1 -- 172.21.15.6:0/1365541213 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f76d8066f80 msgr2=0x7f76d8069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.604+0000 7f76faed3700 1 --2- 172.21.15.6:0/1365541213 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f76d8066f80 0x7f76d8069430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f76e80099b0 tx=0x7f76e8017000 comp rx=0 tx=0).stop 2023-10-06T02:17:59.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.604+0000 7f76faed3700 1 -- 172.21.15.6:0/1365541213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f4166980 msgr2=0x7f76f40a6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.604+0000 7f76faed3700 1 --2- 172.21.15.6:0/1365541213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f4166980 0x7f76f40a6a60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00c820 tx=0x7f76ec0015f0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.604+0000 7f45126b5700 1 --2- 172.21.15.6:0/4139196740 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7f450c154130 0x7f450c1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.604+0000 7f45126b5700 1 -- 172.21.15.6:0/4139196740 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f450c0c34f0 con 0x7f450c154130 2023-10-06T02:17:59.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.605+0000 7f76f9470700 1 -- 172.21.15.6:0/1365541213 reap_dead start 2023-10-06T02:17:59.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.604+0000 7f9bde7fc700 1 -- 172.21.15.6:0/3573664428 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be000f510 con 0x7f9bec0aa1a0 2023-10-06T02:17:59.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.604+0000 7f9bde7fc700 1 -- 172.21.15.6:0/3573664428 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be000f690 con 0x7f9bec0aa1a0 2023-10-06T02:17:59.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.604+0000 7f9bde7fc700 1 -- 172.21.15.6:0/3573664428 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be000fa50 con 0x7f9bec0aa1a0 2023-10-06T02:17:59.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.604+0000 7f9bf46ed700 1 -- 172.21.15.6:0/3573664428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec15c090 con 0x7f9bec0aa1a0 2023-10-06T02:17:59.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.604+0000 7f9bf46ed700 1 -- 172.21.15.6:0/3573664428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec15c6d0 con 0x7f9bec0aa1a0 2023-10-06T02:17:59.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.604+0000 7fcfba2c0700 1 -- 172.21.15.6:0/1721413260 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcfb406de00 con 0x7fcfa0070cd0 2023-10-06T02:17:59.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.605+0000 7f76faed3700 1 -- 172.21.15.6:0/1365541213 shutdown_connections 2023-10-06T02:17:59.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.605+0000 7f76faed3700 1 -- 172.21.15.6:0/1365541213 >> 172.21.15.6:0/1365541213 conn(0x7f76f4069110 msgr2=0x7f76f416aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.605+0000 7f4510c52700 1 --2- 172.21.15.6:0/4139196740 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7f450c154130 0x7f450c1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.605+0000 7ff683fff700 1 -- 172.21.15.6:0/1322926540 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff69c0c8340 con 0x7ff688070cd0 2023-10-06T02:17:59.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.605+0000 7f76faed3700 1 -- 172.21.15.6:0/1365541213 shutdown_connections 2023-10-06T02:17:59.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.605+0000 7f76faed3700 1 -- 172.21.15.6:0/1365541213 wait complete. 2023-10-06T02:17:59.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.605+0000 7f4510c52700 1 --2- 172.21.15.6:0/4139196740 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7f450c154130 0x7f450c1591e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.606+0000 7f9bf46ed700 1 -- 172.21.15.6:0/3573664428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9bec147f60 con 0x7f9bec0aa1a0 2023-10-06T02:17:59.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.606+0000 7fc86effd700 1 -- 172.21.15.6:0/3628429012 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc8880ad840 con 0x7fc874070c00 2023-10-06T02:17:59.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.606+0000 7ff681ffb700 1 -- 172.21.15.6:0/1322926540 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7ff688070cd0 msgr2=0x7ff688073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.606+0000 7ff681ffb700 1 --2- 172.21.15.6:0/1322926540 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7ff688070cd0 0x7ff688073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.606+0000 7ff681ffb700 1 -- 172.21.15.6:0/1322926540 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff688067000 msgr2=0x7ff6880694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.606+0000 7ff681ffb700 1 --2- 172.21.15.6:0/1322926540 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff688067000 0x7ff6880694b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff694004fb0 tx=0x7ff6940070b0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.606+0000 7ff681ffb700 1 -- 172.21.15.6:0/1322926540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff69c1666e0 msgr2=0x7ff69c168230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.606+0000 7ff681ffb700 1 --2- 172.21.15.6:0/1322926540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff69c1666e0 0x7ff69c168230 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0af170 tx=0x7ff68c01c000 comp rx=0 tx=0).stop 2023-10-06T02:17:59.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.606+0000 7ff6a0f65700 1 -- 172.21.15.6:0/1322926540 reap_dead start 2023-10-06T02:17:59.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.606+0000 7ff681ffb700 1 -- 172.21.15.6:0/1322926540 shutdown_connections 2023-10-06T02:17:59.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.606+0000 7ff681ffb700 1 -- 172.21.15.6:0/1322926540 >> 172.21.15.6:0/1322926540 conn(0x7ff69c069110 msgr2=0x7ff69c0caaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.606+0000 7fc88d97e700 1 -- 172.21.15.6:0/3628429012 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x7fc874070c00 msgr2=0x7fc874073030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.606+0000 7fc88d97e700 1 --2- 172.21.15.6:0/3628429012 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x7fc874070c00 0x7fc874073030 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.606+0000 7f9bde7fc700 1 -- 172.21.15.6:0/3573664428 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9be001a400 con 0x7f9bec0aa1a0 2023-10-06T02:17:59.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.606+0000 7ff681ffb700 1 -- 172.21.15.6:0/1322926540 shutdown_connections 2023-10-06T02:17:59.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.607+0000 7f9bde7fc700 1 --2- 172.21.15.6:0/3573664428 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9bd0067000 0x7f9bd00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.607+0000 7f9bde7fc700 1 -- 172.21.15.6:0/3573664428 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9be0084270 con 0x7f9bec0aa1a0 2023-10-06T02:17:59.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.607+0000 7f9bf2489700 1 --2- 172.21.15.6:0/3573664428 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9bd0067000 0x7f9bd00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.607+0000 7f9bde7fc700 1 --2- 172.21.15.6:0/3573664428 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7f9bd0070cd0 0x7f9bd0073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.607+0000 7f9bde7fc700 1 -- 172.21.15.6:0/3573664428 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9bd00737d0 con 0x7f9bd0070cd0 2023-10-06T02:17:59.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.607+0000 7f9bde7fc700 1 -- 172.21.15.6:0/3573664428 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9be0086900 con 0x7f9bec0aa1a0 2023-10-06T02:17:59.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.607+0000 7ff681ffb700 1 -- 172.21.15.6:0/1322926540 wait complete. 2023-10-06T02:17:59.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.607+0000 7f9bf2c8a700 1 --2- 172.21.15.6:0/3573664428 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7f9bd0070cd0 0x7f9bd0073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.607+0000 7f9bf2489700 1 --2- 172.21.15.6:0/3573664428 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9bd0067000 0x7f9bd00694b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9bec158b50 tx=0x7f9be80090f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.608+0000 7f44f3fff700 1 -- 172.21.15.6:0/4139196740 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f450c0c34f0 con 0x7f450c154130 2023-10-06T02:17:59.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.608+0000 7f9bf2c8a700 1 --2- 172.21.15.6:0/3573664428 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7f9bd0070cd0 0x7f9bd0073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.608+0000 7f9bde7fc700 1 -- 172.21.15.6:0/3573664428 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9bd00737d0 con 0x7f9bd0070cd0 2023-10-06T02:17:59.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7fcf9bfff700 1 -- 172.21.15.6:0/1721413260 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcfb406de00 con 0x7fcfa0070cd0 2023-10-06T02:17:59.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7f514a3b0700 1 -- 172.21.15.6:0/2276275552 --> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f51440c5360 con 0x7f5130070cd0 2023-10-06T02:17:59.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7fc88d97e700 1 -- 172.21.15.6:0/3628429012 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc874066f30 msgr2=0x7fc8740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7fc88d97e700 1 --2- 172.21.15.6:0/3628429012 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc874066f30 0x7fc8740693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0091e0 tx=0x7fc87c016000 comp rx=0 tx=0).stop 2023-10-06T02:17:59.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7fc88d97e700 1 -- 172.21.15.6:0/3628429012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc88815dbc0 msgr2=0x7fc888153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7fc88d97e700 1 --2- 172.21.15.6:0/3628429012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc88815dbc0 0x7fc888153fa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc87800b630 tx=0x7fc8780091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7fc8877fe700 1 -- 172.21.15.6:0/3628429012 reap_dead start 2023-10-06T02:17:59.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7fc88d97e700 1 -- 172.21.15.6:0/3628429012 shutdown_connections 2023-10-06T02:17:59.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7fc88d97e700 1 -- 172.21.15.6:0/3628429012 >> 172.21.15.6:0/3628429012 conn(0x7fc888069110 msgr2=0x7fc8881585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7fcfba2c0700 1 -- 172.21.15.6:0/1721413260 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7fcfa0070cd0 msgr2=0x7fcfa0073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7fcfba2c0700 1 --2- 172.21.15.6:0/1721413260 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7fcfa0070cd0 0x7fcfa0073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7fcfba2c0700 1 -- 172.21.15.6:0/1721413260 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcfa0067000 msgr2=0x7fcfa00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7fcfba2c0700 1 --2- 172.21.15.6:0/1721413260 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcfa0067000 0x7fcfa00694b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcfb406eed0 tx=0x7fcfa8017000 comp rx=0 tx=0).stop 2023-10-06T02:17:59.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7fcfba2c0700 1 -- 172.21.15.6:0/1721413260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfb406bbb0 msgr2=0x7fcfb41436d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7fcfba2c0700 1 --2- 172.21.15.6:0/1721413260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfb406bbb0 0x7fcfb41436d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400e8d0 tx=0x7fcfa4009250 comp rx=0 tx=0).stop 2023-10-06T02:17:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7fcfb885d700 1 -- 172.21.15.6:0/1721413260 reap_dead start 2023-10-06T02:17:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7fcfba2c0700 1 -- 172.21.15.6:0/1721413260 shutdown_connections 2023-10-06T02:17:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.609+0000 7fcfba2c0700 1 -- 172.21.15.6:0/1721413260 >> 172.21.15.6:0/1721413260 conn(0x7fcfb406a260 msgr2=0x7fcfb40caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.610+0000 7fc88d97e700 1 -- 172.21.15.6:0/3628429012 shutdown_connections 2023-10-06T02:17:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.610+0000 7fcfba2c0700 1 -- 172.21.15.6:0/1721413260 shutdown_connections 2023-10-06T02:17:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.610+0000 7fcfba2c0700 1 -- 172.21.15.6:0/1721413260 wait complete. 2023-10-06T02:17:59.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.610+0000 7fc88d97e700 1 -- 172.21.15.6:0/3628429012 wait complete. 2023-10-06T02:17:59.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.611+0000 7f512bfff700 1 -- 172.21.15.6:0/2276275552 <== osd.3 v2:172.21.15.6:6824/90683 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f51440c5360 con 0x7f5130070cd0 2023-10-06T02:17:59.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.613+0000 7f1aac38b700 1 -- 172.21.15.6:0/452025789 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1aa4068420 con 0x7f1a88070cd0 2023-10-06T02:17:59.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.613+0000 7f1a9a7fc700 1 -- 172.21.15.6:0/452025789 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1aa4068420 con 0x7f1a88070cd0 2023-10-06T02:17:59.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.614+0000 7f1aac38b700 1 -- 172.21.15.6:0/452025789 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7f1a88070cd0 msgr2=0x7f1a88073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.614+0000 7f1aac38b700 1 --2- 172.21.15.6:0/452025789 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7f1a88070cd0 0x7f1a88073100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.614+0000 7f1aac38b700 1 -- 172.21.15.6:0/452025789 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1a88067000 msgr2=0x7f1a880694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.614+0000 7f1aac38b700 1 --2- 172.21.15.6:0/452025789 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1a88067000 0x7f1a880694b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009e90 tx=0x7f1a9c017000 comp rx=0 tx=0).stop 2023-10-06T02:17:59.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.614+0000 7f1aac38b700 1 -- 172.21.15.6:0/452025789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa40c9480 msgr2=0x7f1aa4148950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.614+0000 7f1aac38b700 1 --2- 172.21.15.6:0/452025789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa40c9480 0x7f1aa4148950 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1a94001640 tx=0x7f1a94005fc0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.614+0000 7f1aaa928700 1 -- 172.21.15.6:0/452025789 reap_dead start 2023-10-06T02:17:59.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.615+0000 7f1aac38b700 1 -- 172.21.15.6:0/452025789 shutdown_connections 2023-10-06T02:17:59.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.615+0000 7f1aac38b700 1 -- 172.21.15.6:0/452025789 >> 172.21.15.6:0/452025789 conn(0x7f1aa4069110 msgr2=0x7f1aa40b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.615+0000 7f514a3b0700 1 -- 172.21.15.6:0/2276275552 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7f5130070cd0 msgr2=0x7f5130073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.615+0000 7f514a3b0700 1 --2- 172.21.15.6:0/2276275552 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7f5130070cd0 0x7f5130073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.617+0000 7f514a3b0700 1 -- 172.21.15.6:0/2276275552 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5130067000 msgr2=0x7f51300694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.617+0000 7f514a3b0700 1 --2- 172.21.15.6:0/2276275552 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5130067000 0x7f51300694b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f51440af7c0 tx=0x7f5138007ec0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.617+0000 7f514a3b0700 1 -- 172.21.15.6:0/2276275552 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5144086ff0 msgr2=0x7f51440c4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.617+0000 7f514a3b0700 1 --2- 172.21.15.6:0/2276275552 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5144086ff0 0x7f51440c4580 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f513400b5e0 tx=0x7f5134009120 comp rx=0 tx=0).stop 2023-10-06T02:17:59.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.617+0000 7f514894d700 1 -- 172.21.15.6:0/2276275552 reap_dead start 2023-10-06T02:17:59.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.618+0000 7f514a3b0700 1 -- 172.21.15.6:0/2276275552 shutdown_connections 2023-10-06T02:17:59.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.618+0000 7f514a3b0700 1 -- 172.21.15.6:0/2276275552 >> 172.21.15.6:0/2276275552 conn(0x7f5144068680 msgr2=0x7f51440b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.619+0000 7f1aac38b700 1 -- 172.21.15.6:0/452025789 shutdown_connections 2023-10-06T02:17:59.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.619+0000 7f1aac38b700 1 -- 172.21.15.6:0/452025789 wait complete. 2023-10-06T02:17:59.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.622+0000 7f514a3b0700 1 -- 172.21.15.6:0/2276275552 shutdown_connections 2023-10-06T02:17:59.654 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-10-06T02:17:59.654 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T02:17:59.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.625+0000 7f514a3b0700 1 -- 172.21.15.6:0/2276275552 wait complete. 2023-10-06T02:17:59.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.628+0000 7f9bf46ed700 1 -- 172.21.15.6:0/3573664428 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9bec06fcb0 con 0x7f9bd0070cd0 2023-10-06T02:17:59.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.628+0000 7f9bde7fc700 1 -- 172.21.15.6:0/3573664428 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9bec06fcb0 con 0x7f9bd0070cd0 2023-10-06T02:17:59.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.629+0000 7f9bf46ed700 1 -- 172.21.15.6:0/3573664428 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7f9bd0070cd0 msgr2=0x7f9bd0073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.629+0000 7f9bf46ed700 1 --2- 172.21.15.6:0/3573664428 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7f9bd0070cd0 0x7f9bd0073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.629+0000 7f9bf46ed700 1 -- 172.21.15.6:0/3573664428 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9bd0067000 msgr2=0x7f9bd00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.629+0000 7f9bf46ed700 1 --2- 172.21.15.6:0/3573664428 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9bd0067000 0x7f9bd00694b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9bec158b50 tx=0x7f9be80090f0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.629+0000 7f9bf46ed700 1 -- 172.21.15.6:0/3573664428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec0aa1a0 msgr2=0x7f9bec15cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.629+0000 7f9bf46ed700 1 --2- 172.21.15.6:0/3573664428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec0aa1a0 0x7f9bec15cb70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9be000b600 tx=0x7f9be00091a0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.630+0000 7f9bf2c8a700 1 -- 172.21.15.6:0/3573664428 reap_dead start 2023-10-06T02:17:59.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.630+0000 7f9bf46ed700 1 -- 172.21.15.6:0/3573664428 shutdown_connections 2023-10-06T02:17:59.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.630+0000 7f9bf46ed700 1 -- 172.21.15.6:0/3573664428 >> 172.21.15.6:0/3573664428 conn(0x7f9bec069110 msgr2=0x7f9bec0aca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.630+0000 7f9bf46ed700 1 -- 172.21.15.6:0/3573664428 shutdown_connections 2023-10-06T02:17:59.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.630+0000 7f9bf46ed700 1 -- 172.21.15.6:0/3573664428 wait complete. 2023-10-06T02:17:59.657 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-10-06T02:17:59.658 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T02:17:59.658 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-06T02:17:59.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T02:17:59.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.634+0000 7f45126b5700 1 -- 172.21.15.6:0/4139196740 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f450c068420 con 0x7f450c154130 2023-10-06T02:17:59.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.635+0000 7f44f3fff700 1 -- 172.21.15.6:0/4139196740 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f450c068420 con 0x7f450c154130 2023-10-06T02:17:59.660 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-10-06T02:17:59.660 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T02:17:59.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.637+0000 7f45126b5700 1 -- 172.21.15.6:0/4139196740 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7f450c154130 msgr2=0x7f450c1591e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.637+0000 7f45126b5700 1 --2- 172.21.15.6:0/4139196740 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7f450c154130 0x7f450c1591e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.637+0000 7f45126b5700 1 -- 172.21.15.6:0/4139196740 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44f8066f30 msgr2=0x7f44f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.637+0000 7f45126b5700 1 --2- 172.21.15.6:0/4139196740 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44f8066f30 0x7f44f80693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f450c1557d0 tx=0x7f4500008040 comp rx=0 tx=0).stop 2023-10-06T02:17:59.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.637+0000 7f45126b5700 1 -- 172.21.15.6:0/4139196740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450c0b13f0 msgr2=0x7f450c144590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.637+0000 7f45126b5700 1 --2- 172.21.15.6:0/4139196740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450c0b13f0 0x7f450c144590 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f450c0c3070 tx=0x7f450401b000 comp rx=0 tx=0).stop 2023-10-06T02:17:59.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.637+0000 7f4510c52700 1 -- 172.21.15.6:0/4139196740 reap_dead start 2023-10-06T02:17:59.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.638+0000 7f45126b5700 1 -- 172.21.15.6:0/4139196740 shutdown_connections 2023-10-06T02:17:59.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.638+0000 7f45126b5700 1 -- 172.21.15.6:0/4139196740 >> 172.21.15.6:0/4139196740 conn(0x7f450c067910 msgr2=0x7f450c150be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.638+0000 7f45126b5700 1 -- 172.21.15.6:0/4139196740 shutdown_connections 2023-10-06T02:17:59.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.638+0000 7f45126b5700 1 -- 172.21.15.6:0/4139196740 wait complete. 2023-10-06T02:17:59.663 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-10-06T02:17:59.663 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T02:17:59.664 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-10-06T02:17:59.664 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T02:17:59.665 INFO:teuthology.orchestra.run.smithi006.stdout:55834574856 2023-10-06T02:17:59.665 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T02:17:59.666 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-10-06T02:17:59.666 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T02:17:59.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.898+0000 7fd003824700 1 Processor -- start 2023-10-06T02:17:59.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.900+0000 7fd003824700 1 -- start start 2023-10-06T02:17:59.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.901+0000 7fd003824700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcffc152d80 0x7fcffc0afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.901+0000 7fd003824700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcffc1559d0 0x7fcffc06e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.901+0000 7fd003824700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcffc153150 0x7fcffc0b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.901+0000 7fd003824700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcffc0b0030 con 0x7fcffc152d80 2023-10-06T02:17:59.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.901+0000 7fd003824700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcffc0aea50 con 0x7fcffc153150 2023-10-06T02:17:59.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.901+0000 7fd003824700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc155ef0 con 0x7fcffc1559d0 2023-10-06T02:17:59.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.901+0000 7fd000dbf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcffc1559d0 0x7fcffc06e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.901+0000 7fd000dbf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcffc1559d0 0x7fcffc06e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:60696/0 (socket says 172.21.15.6:60696) 2023-10-06T02:17:59.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.901+0000 7fd000dbf700 1 -- 172.21.15.6:0/1784043807 learned_addr learned my addr 172.21.15.6:0/1784043807 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.902+0000 7fd001dc1700 1 --2- 172.21.15.6:0/1784043807 >> v2:172.21.15.175:3300/0 conn(0x7fcffc153150 0x7fcffc0b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.902+0000 7fd0015c0700 1 --2- 172.21.15.6:0/1784043807 >> v2:172.21.15.6:3300/0 conn(0x7fcffc152d80 0x7fcffc0afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.902+0000 7fd000dbf700 1 -- 172.21.15.6:0/1784043807 >> v2:172.21.15.175:3300/0 conn(0x7fcffc153150 msgr2=0x7fcffc0b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.902+0000 7fd000dbf700 1 --2- 172.21.15.6:0/1784043807 >> v2:172.21.15.175:3300/0 conn(0x7fcffc153150 0x7fcffc0b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.902+0000 7fd000dbf700 1 -- 172.21.15.6:0/1784043807 >> v2:172.21.15.6:3300/0 conn(0x7fcffc152d80 msgr2=0x7fcffc0afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.902+0000 7fd000dbf700 1 --2- 172.21.15.6:0/1784043807 >> v2:172.21.15.6:3300/0 conn(0x7fcffc152d80 0x7fcffc0afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.902+0000 7fd000dbf700 1 -- 172.21.15.6:0/1784043807 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc1561d0 con 0x7fcffc1559d0 2023-10-06T02:17:59.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.902+0000 7fd000dbf700 1 --2- 172.21.15.6:0/1784043807 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcffc1559d0 0x7fcffc06e6d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0b20d0 tx=0x7fcfec00d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b32b76f608730a15 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.902+0000 7fcff3fff700 1 -- 172.21.15.6:0/1784043807 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec020070 con 0x7fcffc1559d0 2023-10-06T02:17:59.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.903+0000 7fcff3fff700 1 -- 172.21.15.6:0/1784043807 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfec00ab80 con 0x7fcffc1559d0 2023-10-06T02:17:59.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.903+0000 7fcff3fff700 1 -- 172.21.15.6:0/1784043807 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec00c890 con 0x7fcffc1559d0 2023-10-06T02:17:59.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.903+0000 7fd003824700 1 -- 172.21.15.6:0/1784043807 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcffc1559d0 msgr2=0x7fcffc06e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.903+0000 7fd003824700 1 --2- 172.21.15.6:0/1784043807 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcffc1559d0 0x7fcffc06e6d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0b20d0 tx=0x7fcfec00d040 comp rx=0 tx=0).stop 2023-10-06T02:17:59.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.904+0000 7fd003824700 1 -- 172.21.15.6:0/1784043807 shutdown_connections 2023-10-06T02:17:59.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.904+0000 7fd003824700 1 --2- 172.21.15.6:0/1784043807 >> v2:172.21.15.175:3300/0 conn(0x7fcffc153150 0x7fcffc0b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.904+0000 7fd003824700 1 --2- 172.21.15.6:0/1784043807 >> v2:172.21.15.6:3300/0 conn(0x7fcffc152d80 0x7fcffc0afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.904+0000 7fd003824700 1 --2- 172.21.15.6:0/1784043807 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcffc1559d0 0x7fcffc06e6d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.904+0000 7f7d5f580700 1 Processor -- start 2023-10-06T02:17:59.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.904+0000 7fd003824700 1 -- 172.21.15.6:0/1784043807 >> 172.21.15.6:0/1784043807 conn(0x7fcffc06b230 msgr2=0x7fcffc0adcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.904+0000 7f2422399700 1 Processor -- start 2023-10-06T02:17:59.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.904+0000 7f2422399700 1 -- start start 2023-10-06T02:17:59.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.904+0000 7fd003824700 1 -- 172.21.15.6:0/1784043807 shutdown_connections 2023-10-06T02:17:59.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.904+0000 7f7d5f580700 1 -- start start 2023-10-06T02:17:59.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.905+0000 7f34ae8ab700 1 Processor -- start 2023-10-06T02:17:59.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.905+0000 7f34ae8ab700 1 -- start start 2023-10-06T02:17:59.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.905+0000 7f2422399700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f241c0a9dd0 0x7f241c06e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.905+0000 7f2422399700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f241c0aa1a0 0x7f241c1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.905+0000 7f2422399700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241c06e890 con 0x7f241c15d4c0 2023-10-06T02:17:59.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.905+0000 7f2422399700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f241c0c8250 con 0x7f241c0a9dd0 2023-10-06T02:17:59.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.905+0000 7f2422399700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f241c06eb70 con 0x7f241c0aa1a0 2023-10-06T02:17:59.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.905+0000 7f7d5f580700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7d580af3f0 0x7f7d5815a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.905+0000 7f7d5f580700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d58159960 0x7f7d58068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.905+0000 7f7d5f580700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5815a170 con 0x7f7d580af7c0 2023-10-06T02:17:59.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.905+0000 7f7d5f580700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d580caeb0 con 0x7f7d580af3f0 2023-10-06T02:17:59.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.905+0000 7f7d5f580700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5815db80 con 0x7f7d58159960 2023-10-06T02:17:59.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.905+0000 7fd003824700 1 -- 172.21.15.6:0/1784043807 wait complete. 2023-10-06T02:17:59.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f2420936700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f241c0aa1a0 0x7f241c1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f2420936700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f241c0aa1a0 0x7f241c1599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:52202/0 (socket says 172.21.15.6:52202) 2023-10-06T02:17:59.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f2420936700 1 -- 172.21.15.6:0/2002227972 learned_addr learned my addr 172.21.15.6:0/2002227972 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f7d5db1d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d58159960 0x7f7d58068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f7d5d31c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7d580af3f0 0x7f7d5815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f7d5db1d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d58159960 0x7f7d58068680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:60710/0 (socket says 172.21.15.6:60710) 2023-10-06T02:17:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f7d5db1d700 1 -- 172.21.15.6:0/2870481916 learned_addr learned my addr 172.21.15.6:0/2870481916 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f7d5d31c700 1 -- 172.21.15.6:0/2870481916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d58159960 msgr2=0x7f7d58068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f7d5d31c700 1 --2- 172.21.15.6:0/2870481916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d58159960 0x7f7d58068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f7d5d31c700 1 -- 172.21.15.6:0/2870481916 >> v1:172.21.15.6:6789/0 conn(0x7f7d580af7c0 legacy=0x7f7d5815d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f7d5d31c700 1 -- 172.21.15.6:0/2870481916 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5815de60 con 0x7f7d580af3f0 2023-10-06T02:17:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7ff0dc6e2700 1 Processor -- start 2023-10-06T02:17:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f34ae8ab700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a80c7840 0x7f34a8159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f34ae8ab700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f34a806c830 0x7f34a815da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f34ae8ab700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a80c7cb0 con 0x7f34a806c460 2023-10-06T02:17:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f34ae8ab700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a815dfc0 con 0x7f34a806c830 2023-10-06T02:17:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f34ae8ab700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80c7f90 con 0x7f34a80c7840 2023-10-06T02:17:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f241bfff700 1 --2- 172.21.15.6:0/2002227972 >> v2:172.21.15.6:3300/0 conn(0x7f241c0a9dd0 0x7f241c06e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f241affd700 1 -- 172.21.15.6:0/2002227972 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514432973 0 0) 0x7f241c06e890 con 0x7f241c15d4c0 2023-10-06T02:17:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f241affd700 1 -- 172.21.15.6:0/2002227972 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2404003570 con 0x7f241c15d4c0 2023-10-06T02:17:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f7d5d31c700 1 --2- 172.21.15.6:0/2870481916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d580af3f0 0x7f7d5815a600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7d50009e60 tx=0x7f7d50009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a922ef53c493a351 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.906+0000 7f34ace48700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f34a806c830 0x7f34a815da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7f34ace48700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f34a806c830 0x7f34a815da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54248/0 (socket says 172.21.15.6:54248) 2023-10-06T02:17:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7f34ace48700 1 -- 172.21.15.6:0/1400933357 learned_addr learned my addr 172.21.15.6:0/1400933357 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7f34ace48700 1 -- 172.21.15.6:0/1400933357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a80c7840 msgr2=0x7f34a8159670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:17:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7f34ace48700 1 --2- 172.21.15.6:0/1400933357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a80c7840 0x7f34a8159670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7f34ace48700 1 -- 172.21.15.6:0/1400933357 >> v1:172.21.15.6:6789/0 conn(0x7f34a806c460 legacy=0x7f34a8158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7f34ace48700 1 -- 172.21.15.6:0/1400933357 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a80c8270 con 0x7f34a806c830 2023-10-06T02:17:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7fd003824700 1 Processor -- start 2023-10-06T02:17:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7f34ace48700 1 --2- 172.21.15.6:0/1400933357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a806c830 0x7f34a815da80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009f20 tx=0x7f34a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20829ecfbd06bb20 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7f34a6ffd700 1 -- 172.21.15.6:0/1400933357 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a000e070 con 0x7f34a806c830 2023-10-06T02:17:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7f34a6ffd700 1 -- 172.21.15.6:0/1400933357 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a000ba40 con 0x7f34a806c830 2023-10-06T02:17:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7f34a6ffd700 1 -- 172.21.15.6:0/1400933357 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a00092e0 con 0x7f34a806c830 2023-10-06T02:17:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7fd003824700 1 -- start start 2023-10-06T02:17:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7f7d4ffff700 1 -- 172.21.15.6:0/2870481916 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5000e070 con 0x7f7d580af3f0 2023-10-06T02:17:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7f7d4ffff700 1 -- 172.21.15.6:0/2870481916 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5000bbf0 con 0x7f7d580af3f0 2023-10-06T02:17:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7f7d4ffff700 1 -- 172.21.15.6:0/2870481916 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d50012430 con 0x7f7d580af3f0 2023-10-06T02:17:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7f7d5f580700 1 -- 172.21.15.6:0/2870481916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d580af3f0 msgr2=0x7f7d5815a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7f7d5f580700 1 --2- 172.21.15.6:0/2870481916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d580af3f0 0x7f7d5815a600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7d50009e60 tx=0x7f7d50009780 comp rx=0 tx=0).stop 2023-10-06T02:17:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7f241bfff700 1 -- 172.21.15.6:0/2002227972 >> v2:172.21.15.175:3300/0 conn(0x7f241c0aa1a0 msgr2=0x7f241c1599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7f241bfff700 1 --2- 172.21.15.6:0/2002227972 >> v2:172.21.15.175:3300/0 conn(0x7f241c0aa1a0 0x7f241c1599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7f241bfff700 1 -- 172.21.15.6:0/2002227972 >> v1:172.21.15.6:6789/0 conn(0x7f241c15d4c0 legacy=0x7f241c1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7f241bfff700 1 -- 172.21.15.6:0/2002227972 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c06ee50 con 0x7f241c0a9dd0 2023-10-06T02:17:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7f2420936700 1 --2- 172.21.15.6:0/2002227972 >> v2:172.21.15.175:3300/0 conn(0x7f241c0aa1a0 0x7f241c1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:17:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7f241bfff700 1 --2- 172.21.15.6:0/2002227972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f241c0a9dd0 0x7f241c06e2b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f241c06e080 tx=0x7f2414009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc58951106187f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7f241affd700 1 -- 172.21.15.6:0/2002227972 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241400e070 con 0x7f241c0a9dd0 2023-10-06T02:17:59.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7f241affd700 1 -- 172.21.15.6:0/2002227972 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241400bb60 con 0x7f241c0a9dd0 2023-10-06T02:17:59.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7f241affd700 1 -- 172.21.15.6:0/2002227972 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414012430 con 0x7f241c0a9dd0 2023-10-06T02:17:59.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.907+0000 7ff0dc6e2700 1 -- start start 2023-10-06T02:17:59.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7ff0dc6e2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d415a110 0x7ff0d41608d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7ff0dc6e2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d40b00c0 con 0x7ff0d4158da0 2023-10-06T02:17:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7ff0dc6e2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d40af790 con 0x7ff0d4159590 2023-10-06T02:17:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7ff0dc6e2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40afa70 con 0x7ff0d415a110 2023-10-06T02:17:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7ff0d9c7d700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff0d4159590 0x7ff0d4159a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:48528/0 (socket says 172.21.15.6:48528) 2023-10-06T02:17:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7ff0d9c7d700 1 -- 172.21.15.6:0/3999494573 learned_addr learned my addr 172.21.15.6:0/3999494573 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7f34ae8ab700 1 -- 172.21.15.6:0/1400933357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a806c830 msgr2=0x7f34a815da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7f34ae8ab700 1 --2- 172.21.15.6:0/1400933357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a806c830 0x7f34a815da80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009f20 tx=0x7f34a0009840 comp rx=0 tx=0).stop 2023-10-06T02:17:59.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7ff0d947c700 1 -- 172.21.15.6:0/3999494573 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299213217 0 0) 0x7ff0d40af790 con 0x7ff0d4159590 2023-10-06T02:17:59.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7ff0d947c700 1 -- 172.21.15.6:0/3999494573 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0c0003570 con 0x7ff0d4159590 2023-10-06T02:17:59.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7fd003824700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcffc152d80 0x7fcffc0cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7fd003824700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcffc153150 0x7fcffc14b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7fd003824700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcffc1559d0 0x7fcffc15b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7fd003824700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc150e60 con 0x7fcffc1559d0 2023-10-06T02:17:59.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7fd003824700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc169010 con 0x7fcffc153150 2023-10-06T02:17:59.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.908+0000 7fd003824700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc169260 con 0x7fcffc152d80 2023-10-06T02:17:59.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7fd0015c0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcffc152d80 0x7fcffc0cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7fd001dc1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcffc1559d0 0x7fcffc15b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7fd0015c0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcffc152d80 0x7fcffc0cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:60724/0 (socket says 172.21.15.6:60724) 2023-10-06T02:17:59.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7fd0015c0700 1 -- 172.21.15.6:0/2714867830 learned_addr learned my addr 172.21.15.6:0/2714867830 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7fd000dbf700 1 --2- 172.21.15.6:0/2714867830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcffc153150 0x7fcffc14b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7f2422399700 1 -- 172.21.15.6:0/2002227972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f241c0a9dd0 msgr2=0x7f241c06e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7f2422399700 1 --2- 172.21.15.6:0/2002227972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f241c0a9dd0 0x7f241c06e2b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f241c06e080 tx=0x7f2414009780 comp rx=0 tx=0).stop 2023-10-06T02:17:59.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7fd001dc1700 1 -- 172.21.15.6:0/2714867830 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcffc152d80 msgr2=0x7fcffc0cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7fd001dc1700 1 --2- 172.21.15.6:0/2714867830 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcffc152d80 0x7fcffc0cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7fd001dc1700 1 -- 172.21.15.6:0/2714867830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcffc153150 msgr2=0x7fcffc14b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7fd001dc1700 1 --2- 172.21.15.6:0/2714867830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcffc153150 0x7fcffc14b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7fd001dc1700 1 -- 172.21.15.6:0/2714867830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec00a590 con 0x7fcffc1559d0 2023-10-06T02:17:59.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7f34ae8ab700 1 -- 172.21.15.6:0/1400933357 shutdown_connections 2023-10-06T02:17:59.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7f34ae8ab700 1 --2- 172.21.15.6:0/1400933357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a806c830 0x7f34a815da80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7f34ae8ab700 1 --2- 172.21.15.6:0/1400933357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a80c7840 0x7f34a8159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7f34ae8ab700 1 -- 172.21.15.6:0/1400933357 >> 172.21.15.6:0/1400933357 conn(0x7f34a80c9cc0 msgr2=0x7f34a806acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7f7d5f580700 1 -- 172.21.15.6:0/2870481916 shutdown_connections 2023-10-06T02:17:59.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7f7d5f580700 1 --2- 172.21.15.6:0/2870481916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d58159960 0x7f7d58068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7f7d5f580700 1 --2- 172.21.15.6:0/2870481916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d580af3f0 0x7f7d5815a600 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.909+0000 7f7d5f580700 1 -- 172.21.15.6:0/2870481916 >> 172.21.15.6:0/2870481916 conn(0x7f7d5806a260 msgr2=0x7f7d580cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7f7d5f580700 1 -- 172.21.15.6:0/2870481916 shutdown_connections 2023-10-06T02:17:59.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7fd001dc1700 1 --2- 172.21.15.6:0/2714867830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcffc1559d0 0x7fcffc15b440 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcff4008620 tx=0x7fcff400f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7ff0d947c700 1 -- 172.21.15.6:0/3999494573 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565958449 0 0) 0x7ff0d40b00c0 con 0x7ff0d4158da0 2023-10-06T02:17:59.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7ff0d947c700 1 -- 172.21.15.6:0/3999494573 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d40af790 con 0x7ff0d4158da0 2023-10-06T02:17:59.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7ff0d947c700 1 -- 172.21.15.6:0/3999494573 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2404040965 0 0) 0x7ff0d40af790 con 0x7ff0d4158da0 2023-10-06T02:17:59.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7ff0d947c700 1 -- 172.21.15.6:0/3999494573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d415a110 msgr2=0x7ff0d41608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7ff0d947c700 1 --2- 172.21.15.6:0/3999494573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d415a110 0x7ff0d41608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7ff0d947c700 1 -- 172.21.15.6:0/3999494573 >> v1:172.21.15.175:6789/0 conn(0x7ff0d4159590 legacy=0x7ff0d4159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7ff0d947c700 1 -- 172.21.15.6:0/3999494573 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d40afd50 con 0x7ff0d4158da0 2023-10-06T02:17:59.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7ff0d947c700 1 -- 172.21.15.6:0/3999494573 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7ff0cc0017f0 con 0x7ff0d4158da0 2023-10-06T02:17:59.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7ff0d947c700 1 -- 172.21.15.6:0/3999494573 >> v1:172.21.15.6:6789/0 conn(0x7ff0d4158da0 legacy=0x7ff0d406ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7ff0d947c700 1 --2- 172.21.15.6:0/3999494573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0c0003c20 0x7ff0c0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7ff0d947c700 1 --2- 172.21.15.6:0/3999494573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0c0004810 0x7ff0c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7ff0d947c700 1 --2- 172.21.15.6:0/3999494573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0c0005290 0x7ff0c000fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7ff0d947c700 1 -- 172.21.15.6:0/3999494573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40afa70 con 0x7ff0c0005290 2023-10-06T02:17:59.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7ff0d947c700 1 -- 172.21.15.6:0/3999494573 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c0010610 con 0x7ff0c0003c20 2023-10-06T02:17:59.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7ff0d947c700 1 -- 172.21.15.6:0/3999494573 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c00107d0 con 0x7ff0c0004810 2023-10-06T02:17:59.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7fcff17fa700 1 -- 172.21.15.6:0/2714867830 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff400d110 con 0x7fcffc1559d0 2023-10-06T02:17:59.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7fcff17fa700 1 -- 172.21.15.6:0/2714867830 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff400d270 con 0x7fcffc1559d0 2023-10-06T02:17:59.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7fcff17fa700 1 -- 172.21.15.6:0/2714867830 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff400b750 con 0x7fcffc1559d0 2023-10-06T02:17:59.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7fd003824700 1 -- 172.21.15.6:0/2714867830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcffc169540 con 0x7fcffc1559d0 2023-10-06T02:17:59.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7fd003824700 1 -- 172.21.15.6:0/2714867830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcffc169de0 con 0x7fcffc1559d0 2023-10-06T02:17:59.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.911+0000 7fd003824700 1 -- 172.21.15.6:0/2714867830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfdc0052b0 con 0x7fcffc1559d0 2023-10-06T02:17:59.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.910+0000 7f7d5f580700 1 -- 172.21.15.6:0/2870481916 wait complete. 2023-10-06T02:17:59.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.911+0000 7ff0da47e700 1 --2- 172.21.15.6:0/3999494573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0c0003c20 0x7ff0c0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.911+0000 7f7d5f580700 1 Processor -- start 2023-10-06T02:17:59.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.911+0000 7f7d5f580700 1 -- start start 2023-10-06T02:17:59.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.912+0000 7ff0da47e700 1 -- 172.21.15.6:0/3999494573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0c0004810 msgr2=0x7ff0c0004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:17:59.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.912+0000 7ff0da47e700 1 --2- 172.21.15.6:0/3999494573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0c0004810 0x7ff0c0004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.912+0000 7ff0da47e700 1 -- 172.21.15.6:0/3999494573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0c0005290 msgr2=0x7ff0c000fe70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:17:59.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.912+0000 7ff0da47e700 1 --2- 172.21.15.6:0/3999494573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0c0005290 0x7ff0c000fe70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.912+0000 7ff0da47e700 1 -- 172.21.15.6:0/3999494573 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d40afd50 con 0x7ff0c0003c20 2023-10-06T02:17:59.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.912+0000 7fcff17fa700 1 -- 172.21.15.6:0/2714867830 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcff400a040 con 0x7fcffc1559d0 2023-10-06T02:17:59.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.912+0000 7ff0da47e700 1 --2- 172.21.15.6:0/3999494573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0c0003c20 0x7ff0c0004010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00c6f0 tx=0x7ff0cc002ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67b2436032034c5c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.912+0000 7ff0d947c700 1 -- 172.21.15.6:0/3999494573 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc006ba0 con 0x7ff0c0003c20 2023-10-06T02:17:59.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.912+0000 7ff0d947c700 1 -- 172.21.15.6:0/3999494573 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc006d00 con 0x7ff0c0003c20 2023-10-06T02:17:59.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.912+0000 7ff0d947c700 1 -- 172.21.15.6:0/3999494573 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc007270 con 0x7ff0c0003c20 2023-10-06T02:17:59.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.913+0000 7fcff17fa700 1 --2- 172.21.15.6:0/2714867830 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcfe0067000 0x7fcfe00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.913+0000 7fcff17fa700 1 -- 172.21.15.6:0/2714867830 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcff40851d0 con 0x7fcffc1559d0 2023-10-06T02:17:59.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.913+0000 7f7d5f580700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d580af3f0 0x7f7d58156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.913+0000 7f7d5f580700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d58159960 0x7f7d580b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.913+0000 7f7d5f580700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d581768a0 0x7f7d5815bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.913+0000 7f7d5f580700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5815b8f0 con 0x7f7d58159960 2023-10-06T02:17:59.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.913+0000 7f7d5f580700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d58157150 con 0x7f7d581768a0 2023-10-06T02:17:59.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.913+0000 7f7d5f580700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d580c6de0 con 0x7f7d580af3f0 2023-10-06T02:17:59.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.913+0000 7fd0015c0700 1 --2- 172.21.15.6:0/2714867830 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcfe0067000 0x7fcfe00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.913+0000 7f7d5cb1b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d58159960 0x7f7d580b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.913+0000 7f7d5d31c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d580af3f0 0x7f7d58156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.913+0000 7f7d5db1d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d581768a0 0x7f7d5815bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.913+0000 7f7d5cb1b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d58159960 0x7f7d580b2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54266/0 (socket says 172.21.15.6:54266) 2023-10-06T02:17:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.913+0000 7f7d5cb1b700 1 -- 172.21.15.6:0/939313281 learned_addr learned my addr 172.21.15.6:0/939313281 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.913+0000 7f7d5cb1b700 1 -- 172.21.15.6:0/939313281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d580af3f0 msgr2=0x7f7d58156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.914+0000 7f7d5cb1b700 1 --2- 172.21.15.6:0/939313281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d580af3f0 0x7f7d58156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.914+0000 7f7d5cb1b700 1 -- 172.21.15.6:0/939313281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d581768a0 msgr2=0x7f7d5815bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.914+0000 7f7d5cb1b700 1 --2- 172.21.15.6:0/939313281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d581768a0 0x7f7d5815bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.914+0000 7f7d5cb1b700 1 -- 172.21.15.6:0/939313281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d50009a20 con 0x7f7d58159960 2023-10-06T02:17:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.914+0000 7fd0015c0700 1 --2- 172.21.15.6:0/2714867830 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcfe0067000 0x7fcfe00694b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009e70 tx=0x7fcff80091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.914+0000 7f7d5db1d700 1 --2- 172.21.15.6:0/939313281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d581768a0 0x7f7d5815bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:17:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.914+0000 7f7d5cb1b700 1 --2- 172.21.15.6:0/939313281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d58159960 0x7f7d580b2690 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800b7e0 tx=0x7f7d480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.914+0000 7fa8119b2700 1 Processor -- start 2023-10-06T02:17:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.914+0000 7fa8119b2700 1 -- start start 2023-10-06T02:17:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.915+0000 7f2422399700 1 -- 172.21.15.6:0/2002227972 shutdown_connections 2023-10-06T02:17:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.915+0000 7f2422399700 1 --2- 172.21.15.6:0/2002227972 >> v2:172.21.15.175:3300/0 conn(0x7f241c0aa1a0 0x7f241c1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.915+0000 7f2422399700 1 --2- 172.21.15.6:0/2002227972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f241c0a9dd0 0x7f241c06e2b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.915+0000 7f2422399700 1 -- 172.21.15.6:0/2002227972 >> 172.21.15.6:0/2002227972 conn(0x7f241c069110 msgr2=0x7f241c0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.915+0000 7f34ae8ab700 1 -- 172.21.15.6:0/1400933357 shutdown_connections 2023-10-06T02:17:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.915+0000 7f34ae8ab700 1 -- 172.21.15.6:0/1400933357 wait complete. 2023-10-06T02:17:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.915+0000 7fa8119b2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa80c06a8b0 0x7fa80c0cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.915+0000 7fa8119b2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa80c0ce5e0 0x7fa80c15d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.915+0000 7fa8119b2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80c0cf6d0 con 0x7fa80c0af510 2023-10-06T02:17:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.915+0000 7fa8119b2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80c15de60 con 0x7fa80c0ce5e0 2023-10-06T02:17:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.915+0000 7fa8119b2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0cb360 con 0x7fa80c06a8b0 2023-10-06T02:17:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7fa80b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa80c0ce5e0 0x7fa80c15d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7fa80b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa80c0ce5e0 0x7fa80c15d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54274/0 (socket says 172.21.15.6:54274) 2023-10-06T02:17:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7fa80b7fe700 1 -- 172.21.15.6:0/1438823346 learned_addr learned my addr 172.21.15.6:0/1438823346 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7fa80a7fc700 1 --2- 172.21.15.6:0/1438823346 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa80c06a8b0 0x7fa80c0cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7fa80b7fe700 1 -- 172.21.15.6:0/1438823346 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa80c06a8b0 msgr2=0x7fa80c0cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7fa80b7fe700 1 --2- 172.21.15.6:0/1438823346 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa80c06a8b0 0x7fa80c0cfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7fa80b7fe700 1 -- 172.21.15.6:0/1438823346 >> v1:172.21.15.6:6789/0 conn(0x7fa80c0af510 legacy=0x7fa80c06a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7fa80b7fe700 1 -- 172.21.15.6:0/1438823346 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c0ceac0 con 0x7fa80c0ce5e0 2023-10-06T02:17:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7ff0dc6e2700 1 -- 172.21.15.6:0/3999494573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0c0003c20 msgr2=0x7ff0c0004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7ff0dc6e2700 1 --2- 172.21.15.6:0/3999494573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0c0003c20 0x7ff0c0004010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00c6f0 tx=0x7ff0cc002ef0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7ff0dac7f700 1 -- 172.21.15.6:0/3999494573 reap_dead start 2023-10-06T02:17:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7fa80b7fe700 1 --2- 172.21.15.6:0/1438823346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa80c0ce5e0 0x7fa80c15d920 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa804009f20 tx=0x7fa804009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2591dcb8001c9f06 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7f34ae8ab700 1 Processor -- start 2023-10-06T02:17:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7ff0dc6e2700 1 -- 172.21.15.6:0/3999494573 shutdown_connections 2023-10-06T02:17:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7ff0dc6e2700 1 -- 172.21.15.6:0/3999494573 >> 172.21.15.6:0/3999494573 conn(0x7ff0d4069110 msgr2=0x7ff0d40cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7ff0dc6e2700 1 -- 172.21.15.6:0/3999494573 shutdown_connections 2023-10-06T02:17:59.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7ff0dc6e2700 1 -- 172.21.15.6:0/3999494573 wait complete. 2023-10-06T02:17:59.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.916+0000 7f34ae8ab700 1 -- start start 2023-10-06T02:17:59.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.917+0000 7f2422399700 1 -- 172.21.15.6:0/2002227972 shutdown_connections 2023-10-06T02:17:59.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.917+0000 7f34ae8ab700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a806c460 0x7f34a80ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.917+0000 7f34ae8ab700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a806c830 0x7f34a80c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.917+0000 7f34ae8ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a80c6390 0x7f34a815a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.917+0000 7f34ae8ab700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a815cbd0 con 0x7f34a80c6390 2023-10-06T02:17:59.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.917+0000 7f34ae8ab700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80c3960 con 0x7f34a806c830 2023-10-06T02:17:59.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.917+0000 7f34ae8ab700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a815a2c0 con 0x7f34a806c460 2023-10-06T02:17:59.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.917+0000 7f34ace48700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a80c6390 0x7f34a815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.917+0000 7f34a7fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a806c460 0x7f34a80ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.917+0000 7f34ace48700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a80c6390 0x7f34a815a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54284/0 (socket says 172.21.15.6:54284) 2023-10-06T02:17:59.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.917+0000 7f34ace48700 1 -- 172.21.15.6:0/72372961 learned_addr learned my addr 172.21.15.6:0/72372961 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.918+0000 7f34a77fe700 1 --2- 172.21.15.6:0/72372961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a806c830 0x7f34a80c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.918+0000 7f34a7fff700 1 -- 172.21.15.6:0/72372961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a806c830 msgr2=0x7f34a80c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.918+0000 7f34a7fff700 1 --2- 172.21.15.6:0/72372961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a806c830 0x7f34a80c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.918+0000 7f34a7fff700 1 -- 172.21.15.6:0/72372961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a80c6390 msgr2=0x7f34a815a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.918+0000 7f34a7fff700 1 --2- 172.21.15.6:0/72372961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a80c6390 0x7f34a815a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.918+0000 7f34a7fff700 1 -- 172.21.15.6:0/72372961 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0009ae0 con 0x7f34a806c460 2023-10-06T02:17:59.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.917+0000 7f2422399700 1 -- 172.21.15.6:0/2002227972 wait complete. 2023-10-06T02:17:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.918+0000 7f74bf18a700 1 Processor -- start 2023-10-06T02:17:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.918+0000 7f74bf18a700 1 -- start start 2023-10-06T02:17:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.918+0000 7ff0dc6e2700 1 Processor -- start 2023-10-06T02:17:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.918+0000 7ff0dc6e2700 1 -- start start 2023-10-06T02:17:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.918+0000 7f34a7fff700 1 --2- 172.21.15.6:0/72372961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a806c460 0x7f34a80ae060 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f349c00c4e0 tx=0x7f349c007ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.918+0000 7f348ffff700 1 -- 172.21.15.6:0/72372961 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c011590 con 0x7f34a806c460 2023-10-06T02:17:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.918+0000 7f348ffff700 1 -- 172.21.15.6:0/72372961 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c011710 con 0x7f34a806c460 2023-10-06T02:17:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.918+0000 7f348ffff700 1 -- 172.21.15.6:0/72372961 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c011ad0 con 0x7f34a806c460 2023-10-06T02:17:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7fcff17fa700 1 -- 172.21.15.6:0/2714867830 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcff4052070 con 0x7fcffc1559d0 2023-10-06T02:17:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7f34ae8ab700 1 -- 172.21.15.6:0/72372961 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a8159740 con 0x7f34a806c460 2023-10-06T02:17:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7f34ae8ab700 1 -- 172.21.15.6:0/72372961 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a8159d00 con 0x7f34a806c460 2023-10-06T02:17:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7f348ffff700 1 -- 172.21.15.6:0/72372961 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f349c01c460 con 0x7f34a806c460 2023-10-06T02:17:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.922+0000 7f348ffff700 1 --2- 172.21.15.6:0/72372961 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3494066f30 0x7f34940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.922+0000 7f348ffff700 1 -- 172.21.15.6:0/72372961 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f349c084590 con 0x7f34a806c460 2023-10-06T02:17:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.922+0000 7f34a77fe700 1 --2- 172.21.15.6:0/72372961 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3494066f30 0x7f34940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7f2422399700 1 Processor -- start 2023-10-06T02:17:59.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f2422399700 1 -- start start 2023-10-06T02:17:59.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f2422399700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f241c0a9dd0 0x7f241c152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7f2422399700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f241c0aa1a0 0x7f241c0af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7f2422399700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f241c15d4c0 0x7f241c0b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7f2422399700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c159470 con 0x7f241c0a9dd0 2023-10-06T02:17:59.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7f2422399700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c159140 con 0x7f241c0aa1a0 2023-10-06T02:17:59.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7f2422399700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c0b0040 con 0x7f241c15d4c0 2023-10-06T02:17:59.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7f2420936700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f241c15d4c0 0x7f241c0b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7f2420936700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f241c15d4c0 0x7f241c0b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:60780/0 (socket says 172.21.15.6:60780) 2023-10-06T02:17:59.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7f2420936700 1 -- 172.21.15.6:0/1292206864 learned_addr learned my addr 172.21.15.6:0/1292206864 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7f241b7fe700 1 --2- 172.21.15.6:0/1292206864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f241c0aa1a0 0x7f241c0af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7f241b7fe700 1 -- 172.21.15.6:0/1292206864 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f241c15d4c0 msgr2=0x7f241c0b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7f241b7fe700 1 --2- 172.21.15.6:0/1292206864 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f241c15d4c0 0x7f241c0b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7f241b7fe700 1 -- 172.21.15.6:0/1292206864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f241c0a9dd0 msgr2=0x7f241c152f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T02:17:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7f241b7fe700 1 --2- 172.21.15.6:0/1292206864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f241c0a9dd0 0x7f241c152f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7f241b7fe700 1 -- 172.21.15.6:0/1292206864 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2414009a20 con 0x7f241c0aa1a0 2023-10-06T02:17:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7f241b7fe700 1 --2- 172.21.15.6:0/1292206864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f241c0aa1a0 0x7f241c0af6d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f241000c4b0 tx=0x7f2410007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.922+0000 7f2403fff700 1 -- 172.21.15.6:0/1292206864 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410011590 con 0x7f241c0aa1a0 2023-10-06T02:17:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.922+0000 7f2403fff700 1 -- 172.21.15.6:0/1292206864 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24100116f0 con 0x7f241c0aa1a0 2023-10-06T02:17:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.922+0000 7f2403fff700 1 -- 172.21.15.6:0/1292206864 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410011ab0 con 0x7f241c0aa1a0 2023-10-06T02:17:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7f7d4d7fa700 1 -- 172.21.15.6:0/939313281 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4800f510 con 0x7f7d58159960 2023-10-06T02:17:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7f7d4d7fa700 1 -- 172.21.15.6:0/939313281 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4800f670 con 0x7f7d58159960 2023-10-06T02:17:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7f7d4d7fa700 1 -- 172.21.15.6:0/939313281 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4800fa10 con 0x7f7d58159960 2023-10-06T02:17:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7f7d5f580700 1 -- 172.21.15.6:0/939313281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d580c4260 con 0x7f7d58159960 2023-10-06T02:17:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7f7d5f580700 1 -- 172.21.15.6:0/939313281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d580b2bd0 con 0x7f7d58159960 2023-10-06T02:17:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7f7d5f580700 1 -- 172.21.15.6:0/939313281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d380052b0 con 0x7f7d58159960 2023-10-06T02:17:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7ff0dc6e2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0c0003c20 0x7ff0d4140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7ff0dc6e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0d40c62a0 0x7ff0d40c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7ff0dc6e2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d40c18b0 0x7ff0d40c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7ff0dc6e2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40c4390 con 0x7ff0d40c62a0 2023-10-06T02:17:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7ff0dc6e2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40c6c50 con 0x7ff0c0003c20 2023-10-06T02:17:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7ff0dc6e2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40c3a60 con 0x7ff0d40c18b0 2023-10-06T02:17:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7ff0dac7f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d40c18b0 0x7ff0d40c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7ff0dac7f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d40c18b0 0x7ff0d40c1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:60758/0 (socket says 172.21.15.6:60758) 2023-10-06T02:17:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7ff0dac7f700 1 -- 172.21.15.6:0/1226437392 learned_addr learned my addr 172.21.15.6:0/1226437392 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7ff0da47e700 1 --2- 172.21.15.6:0/1226437392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0c0003c20 0x7ff0d4140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7fa809ffb700 1 -- 172.21.15.6:0/1438823346 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80400e070 con 0x7fa80c0ce5e0 2023-10-06T02:17:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7fa809ffb700 1 -- 172.21.15.6:0/1438823346 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80400b990 con 0x7fa80c0ce5e0 2023-10-06T02:17:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7fa809ffb700 1 -- 172.21.15.6:0/1438823346 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8040092e0 con 0x7fa80c0ce5e0 2023-10-06T02:17:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7fa8119b2700 1 -- 172.21.15.6:0/1438823346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa80c0ce5e0 msgr2=0x7fa80c15d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7fa8119b2700 1 --2- 172.21.15.6:0/1438823346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa80c0ce5e0 0x7fa80c15d920 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa804009f20 tx=0x7fa804009840 comp rx=0 tx=0).stop 2023-10-06T02:17:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7fa8119b2700 1 -- 172.21.15.6:0/1438823346 shutdown_connections 2023-10-06T02:17:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7fa8119b2700 1 --2- 172.21.15.6:0/1438823346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa80c0ce5e0 0x7fa80c15d920 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7fa8119b2700 1 --2- 172.21.15.6:0/1438823346 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa80c06a8b0 0x7fa80c0cfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7fa8119b2700 1 -- 172.21.15.6:0/1438823346 >> 172.21.15.6:0/1438823346 conn(0x7fa80c0d0250 msgr2=0x7fa80c0d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7fa8119b2700 1 -- 172.21.15.6:0/1438823346 shutdown_connections 2023-10-06T02:17:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.921+0000 7fa8119b2700 1 -- 172.21.15.6:0/1438823346 wait complete. 2023-10-06T02:17:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.922+0000 7fa8119b2700 1 Processor -- start 2023-10-06T02:17:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.923+0000 7fa8119b2700 1 -- start start 2023-10-06T02:17:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7f74bf18a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74b80ae240 0x7f74b80cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7f74bf18a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b80b1d20 con 0x7f74b80af710 2023-10-06T02:17:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7f74bf18a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b806f4e0 con 0x7f74b81576a0 2023-10-06T02:17:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7f74bf18a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b80ccd60 con 0x7f74b80ae240 2023-10-06T02:17:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7f74bcf26700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f74b81576a0 0x7f74b80adb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:48532/0 (socket says 172.21.15.6:48532) 2023-10-06T02:17:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.919+0000 7f74bcf26700 1 -- 172.21.15.6:0/1198394545 learned_addr learned my addr 172.21.15.6:0/1198394545 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:17:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f74b77fe700 1 -- 172.21.15.6:0/1198394545 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947554088 0 0) 0x7f74b806f4e0 con 0x7f74b81576a0 2023-10-06T02:17:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f74b77fe700 1 -- 172.21.15.6:0/1198394545 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74a8003570 con 0x7f74b81576a0 2023-10-06T02:17:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f74b77fe700 1 -- 172.21.15.6:0/1198394545 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 650534960 0 0) 0x7f74a8003570 con 0x7f74b81576a0 2023-10-06T02:17:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f74b77fe700 1 -- 172.21.15.6:0/1198394545 >> v2:172.21.15.6:3300/0 conn(0x7f74b80ae240 msgr2=0x7f74b80cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f74b77fe700 1 --2- 172.21.15.6:0/1198394545 >> v2:172.21.15.6:3300/0 conn(0x7f74b80ae240 0x7f74b80cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f74b77fe700 1 -- 172.21.15.6:0/1198394545 >> v1:172.21.15.6:6789/0 conn(0x7f74b80af710 legacy=0x7f74b8157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f74b77fe700 1 -- 172.21.15.6:0/1198394545 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b80afc60 con 0x7f74b81576a0 2023-10-06T02:17:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f74b77fe700 1 -- 172.21.15.6:0/1198394545 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f74ac001470 con 0x7f74b81576a0 2023-10-06T02:17:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f74b77fe700 1 -- 172.21.15.6:0/1198394545 >> v1:172.21.15.175:6789/0 conn(0x7f74b81576a0 legacy=0x7f74b80adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f74b77fe700 1 --2- 172.21.15.6:0/1198394545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74a8003a60 0x7f74a8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f74b77fe700 1 --2- 172.21.15.6:0/1198394545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74a8004810 0x7f74a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f74b77fe700 1 --2- 172.21.15.6:0/1198394545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74a8005310 0x7f74a800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f74b77fe700 1 -- 172.21.15.6:0/1198394545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b80ccd60 con 0x7f74a8005310 2023-10-06T02:17:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f74b77fe700 1 -- 172.21.15.6:0/1198394545 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a800c2d0 con 0x7f74a8003a60 2023-10-06T02:17:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f74b77fe700 1 -- 172.21.15.6:0/1198394545 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a800c490 con 0x7f74a8004810 2023-10-06T02:17:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.920+0000 7f74b7fff700 1 --2- 172.21.15.6:0/1198394545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74a8004810 0x7f74a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.923+0000 7f34a77fe700 1 --2- 172.21.15.6:0/72372961 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3494066f30 0x7f34940693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f34a806b7a0 tx=0x7f34980090f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.923+0000 7f74bd727700 1 --2- 172.21.15.6:0/1198394545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74a8005310 0x7f74a800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.923+0000 7ff0d9c7d700 1 --2- 172.21.15.6:0/1226437392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0d40c62a0 0x7ff0d40c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.923+0000 7f74bd727700 1 -- 172.21.15.6:0/1198394545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74a8004810 msgr2=0x7f74a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.923+0000 7f74bd727700 1 --2- 172.21.15.6:0/1198394545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74a8004810 0x7f74a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.923+0000 7f74bd727700 1 -- 172.21.15.6:0/1198394545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74a8003a60 msgr2=0x7f74a8003e50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:17:59.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.923+0000 7f74bd727700 1 --2- 172.21.15.6:0/1198394545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74a8003a60 0x7f74a8003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.923+0000 7f74bd727700 1 -- 172.21.15.6:0/1198394545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8003570 con 0x7f74a8005310 2023-10-06T02:17:59.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7f74bd727700 1 -- 172.21.15.6:0/1198394545 reap_dead start 2023-10-06T02:17:59.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7fa8119b2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa80c06a8b0 0x7fa80c150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7fa8119b2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa80c0af510 0x7fa80c0b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7fa8119b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa80c0ce5e0 0x7fa80c0c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7fa8119b2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c150ab0 con 0x7fa80c0ce5e0 2023-10-06T02:17:59.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7fa8119b2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0b4690 con 0x7fa80c0af510 2023-10-06T02:17:59.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7fa8119b2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0b4970 con 0x7fa80c06a8b0 2023-10-06T02:17:59.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7f7d4d7fa700 1 -- 172.21.15.6:0/939313281 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d48024430 con 0x7f7d58159960 2023-10-06T02:17:59.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7fa80b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa80c0ce5e0 0x7fa80c0c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7f2422399700 1 -- 172.21.15.6:0/1292206864 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241c0b0320 con 0x7f241c0aa1a0 2023-10-06T02:17:59.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7f2422399700 1 -- 172.21.15.6:0/1292206864 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241c1534a0 con 0x7f241c0aa1a0 2023-10-06T02:17:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7fa80b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa80c0ce5e0 0x7fa80c0c9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54310/0 (socket says 172.21.15.6:54310) 2023-10-06T02:17:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7fa80b7fe700 1 -- 172.21.15.6:0/3536537321 learned_addr learned my addr 172.21.15.6:0/3536537321 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7fa80a7fc700 1 --2- 172.21.15.6:0/3536537321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa80c0af510 0x7fa80c0b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7ff0d9c7d700 1 -- 172.21.15.6:0/1226437392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d40c18b0 msgr2=0x7ff0d40c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7ff0d9c7d700 1 --2- 172.21.15.6:0/1226437392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d40c18b0 0x7ff0d40c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7ff0d9c7d700 1 -- 172.21.15.6:0/1226437392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0c0003c20 msgr2=0x7ff0d4140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7ff0d9c7d700 1 --2- 172.21.15.6:0/1226437392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0c0003c20 0x7ff0d4140090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7ff0d9c7d700 1 -- 172.21.15.6:0/1226437392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d40c3d40 con 0x7ff0d40c62a0 2023-10-06T02:17:59.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7fa80affd700 1 --2- 172.21.15.6:0/3536537321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa80c06a8b0 0x7fa80c150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7f7d4d7fa700 1 --2- 172.21.15.6:0/939313281 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d44067160 0x7f7d44069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7fa80b7fe700 1 -- 172.21.15.6:0/3536537321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa80c06a8b0 msgr2=0x7fa80c150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7fa80b7fe700 1 --2- 172.21.15.6:0/3536537321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa80c06a8b0 0x7fa80c150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7fa80b7fe700 1 -- 172.21.15.6:0/3536537321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa80c0af510 msgr2=0x7fa80c0b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7fa80b7fe700 1 --2- 172.21.15.6:0/3536537321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa80c0af510 0x7fa80c0b2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7fa80b7fe700 1 -- 172.21.15.6:0/3536537321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa804009ae0 con 0x7fa80c0ce5e0 2023-10-06T02:17:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7f7d4d7fa700 1 -- 172.21.15.6:0/939313281 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7d48084da0 con 0x7f7d58159960 2023-10-06T02:17:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.924+0000 7ff0d9c7d700 1 --2- 172.21.15.6:0/1226437392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0d40c62a0 0x7ff0d40c6710 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0001ed0 tx=0x7ff0d0007cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.925+0000 7f74bd727700 1 --2- 172.21.15.6:0/1198394545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74a8005310 0x7f74a800ba60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f74b0001ec0 tx=0x7f74b00014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f91287c67aed21d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.925+0000 7f2422399700 1 -- 172.21.15.6:0/1292206864 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241c06fcb0 con 0x7f241c0aa1a0 2023-10-06T02:17:59.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.926+0000 7f34ae8ab700 1 -- 172.21.15.6:0/72372961 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a806e140 con 0x7f34a806c460 2023-10-06T02:17:59.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.926+0000 7f2403fff700 1 -- 172.21.15.6:0/1292206864 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f241001c460 con 0x7f241c0aa1a0 2023-10-06T02:17:59.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.927+0000 7f2403fff700 1 --2- 172.21.15.6:0/1292206864 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2408066f30 0x7f24080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.927+0000 7f2403fff700 1 -- 172.21.15.6:0/1292206864 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f24100846e0 con 0x7f241c0aa1a0 2023-10-06T02:17:59.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.927+0000 7f241bfff700 1 --2- 172.21.15.6:0/1292206864 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2408066f30 0x7f24080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.927+0000 7f241bfff700 1 --2- 172.21.15.6:0/1292206864 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2408066f30 0x7f24080693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f24140097c0 tx=0x7f2414019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.925+0000 7fa80b7fe700 1 --2- 172.21.15.6:0/3536537321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa80c0ce5e0 0x7fa80c0c9450 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0c7190 tx=0x7fa804017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.928+0000 7f7d5d31c700 1 --2- 172.21.15.6:0/939313281 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d44067160 0x7f7d44069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.928+0000 7fa7f2ffd700 1 -- 172.21.15.6:0/3536537321 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8040032f0 con 0x7fa80c0ce5e0 2023-10-06T02:17:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.928+0000 7fa8119b2700 1 -- 172.21.15.6:0/3536537321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80c16e100 con 0x7fa80c0ce5e0 2023-10-06T02:17:59.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.928+0000 7f7d4d7fa700 1 -- 172.21.15.6:0/939313281 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d48051ca0 con 0x7f7d58159960 2023-10-06T02:17:59.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.928+0000 7fa8119b2700 1 -- 172.21.15.6:0/3536537321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80c0b3bd0 con 0x7fa80c0ce5e0 2023-10-06T02:17:59.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.928+0000 7fa7f2ffd700 1 -- 172.21.15.6:0/3536537321 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa804012af0 con 0x7fa80c0ce5e0 2023-10-06T02:17:59.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.928+0000 7fa7f2ffd700 1 -- 172.21.15.6:0/3536537321 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804012e90 con 0x7fa80c0ce5e0 2023-10-06T02:17:59.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.929+0000 7f47289c6700 1 Processor -- start 2023-10-06T02:17:59.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.929+0000 7f47289c6700 1 -- start start 2023-10-06T02:17:59.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.929+0000 7ff0ca7fc700 1 -- 172.21.15.6:0/1226437392 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0005b30 con 0x7ff0d40c62a0 2023-10-06T02:17:59.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.929+0000 7ff0ca7fc700 1 -- 172.21.15.6:0/1226437392 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d0005c90 con 0x7ff0d40c62a0 2023-10-06T02:17:59.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.929+0000 7ff0ca7fc700 1 -- 172.21.15.6:0/1226437392 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00072e0 con 0x7ff0d40c62a0 2023-10-06T02:17:59.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.929+0000 7f74b77fe700 1 -- 172.21.15.6:0/1198394545 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b0001800 con 0x7f74a8005310 2023-10-06T02:17:59.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.929+0000 7f74b77fe700 1 -- 172.21.15.6:0/1198394545 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b0006b80 con 0x7f74a8005310 2023-10-06T02:17:59.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.929+0000 7f74b77fe700 1 -- 172.21.15.6:0/1198394545 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b000c6a0 con 0x7f74a8005310 2023-10-06T02:17:59.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.929+0000 7ff0dc6e2700 1 -- 172.21.15.6:0/1226437392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d40c4020 con 0x7ff0d40c62a0 2023-10-06T02:17:59.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.929+0000 7ff0dc6e2700 1 -- 172.21.15.6:0/1226437392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d40c2270 con 0x7ff0d40c62a0 2023-10-06T02:17:59.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.930+0000 7fa8119b2700 1 -- 172.21.15.6:0/3536537321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ec0052b0 con 0x7fa80c0ce5e0 2023-10-06T02:17:59.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.930+0000 7f74bf18a700 1 -- 172.21.15.6:0/1198394545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74a8005310 msgr2=0x7f74a800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.930+0000 7f74bf18a700 1 --2- 172.21.15.6:0/1198394545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74a8005310 0x7f74a800ba60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f74b0001ec0 tx=0x7f74b00014d0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.930+0000 7fa7f2ffd700 1 -- 172.21.15.6:0/3536537321 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa80401d630 con 0x7fa80c0ce5e0 2023-10-06T02:17:59.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.930+0000 7f47289c6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4724155550 0x7f47240c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.930+0000 7f47289c6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4724155920 0x7f47240c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.930+0000 7f47289c6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47240c14c0 con 0x7f47240c9920 2023-10-06T02:17:59.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.930+0000 7f47289c6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47240c2960 con 0x7f4724155920 2023-10-06T02:17:59.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.930+0000 7f47289c6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47240c8570 con 0x7f4724155550 2023-10-06T02:17:59.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.930+0000 7f4722d9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4724155550 0x7f47240c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.931+0000 7f4722d9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4724155550 0x7f47240c7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:60794/0 (socket says 172.21.15.6:60794) 2023-10-06T02:17:59.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.931+0000 7f4722d9d700 1 -- 172.21.15.6:0/1487409162 learned_addr learned my addr 172.21.15.6:0/1487409162 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.931+0000 7fa7f2ffd700 1 --2- 172.21.15.6:0/3536537321 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7f8066fb0 0x7fa7f8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.931+0000 7f4722d9d700 1 -- 172.21.15.6:0/1487409162 >> v2:172.21.15.6:3300/0 conn(0x7f4724155920 msgr2=0x7f47240c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.931+0000 7f4722d9d700 1 --2- 172.21.15.6:0/1487409162 >> v2:172.21.15.6:3300/0 conn(0x7f4724155920 0x7f47240c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.931+0000 7f4722d9d700 1 -- 172.21.15.6:0/1487409162 >> v1:172.21.15.6:6789/0 conn(0x7f47240c9920 legacy=0x7f47240c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:17:59.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.931+0000 7f4722d9d700 1 -- 172.21.15.6:0/1487409162 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47240c0b90 con 0x7f4724155550 2023-10-06T02:17:59.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.931+0000 7fa7f2ffd700 1 -- 172.21.15.6:0/3536537321 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa8040860e0 con 0x7fa80c0ce5e0 2023-10-06T02:17:59.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.931+0000 7f7d5d31c700 1 --2- 172.21.15.6:0/939313281 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d44067160 0x7f7d44069610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7d500097c0 tx=0x7f7d50018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.931+0000 7f348ffff700 1 -- 172.21.15.6:0/72372961 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f349c0513b0 con 0x7f34a806c460 2023-10-06T02:17:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.931+0000 7f4722d9d700 1 --2- 172.21.15.6:0/1487409162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4724155550 0x7f47240c7800 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f47140099b0 tx=0x7f4714009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79c79a87d7c80879 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.931+0000 7ff0dc6e2700 1 -- 172.21.15.6:0/1226437392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0bc0052b0 con 0x7ff0d40c62a0 2023-10-06T02:17:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.931+0000 7f4721d9b700 1 -- 172.21.15.6:0/1487409162 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471400b820 con 0x7f4724155550 2023-10-06T02:17:59.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.932+0000 7f4721d9b700 1 -- 172.21.15.6:0/1487409162 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471400b980 con 0x7f4724155550 2023-10-06T02:17:59.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.932+0000 7f4721d9b700 1 -- 172.21.15.6:0/1487409162 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471400bd20 con 0x7f4724155550 2023-10-06T02:17:59.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.932+0000 7f74bf18a700 1 -- 172.21.15.6:0/1198394545 shutdown_connections 2023-10-06T02:17:59.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.932+0000 7f74bf18a700 1 --2- 172.21.15.6:0/1198394545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74a8005310 0x7f74a800ba60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.932+0000 7f74bf18a700 1 -- 172.21.15.6:0/1198394545 >> 172.21.15.6:0/1198394545 conn(0x7f74b8069110 msgr2=0x7f74b80cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.932+0000 7f74bf18a700 1 -- 172.21.15.6:0/1198394545 shutdown_connections 2023-10-06T02:17:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.932+0000 7f74bf18a700 1 -- 172.21.15.6:0/1198394545 wait complete. 2023-10-06T02:17:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.932+0000 7f47289c6700 1 -- 172.21.15.6:0/1487409162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4724155550 msgr2=0x7f47240c7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.932+0000 7f47289c6700 1 --2- 172.21.15.6:0/1487409162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4724155550 0x7f47240c7800 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f47140099b0 tx=0x7f4714009250 comp rx=0 tx=0).stop 2023-10-06T02:17:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.932+0000 7f47289c6700 1 -- 172.21.15.6:0/1487409162 shutdown_connections 2023-10-06T02:17:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.932+0000 7f47289c6700 1 --2- 172.21.15.6:0/1487409162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4724155550 0x7f47240c7800 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.932+0000 7f47289c6700 1 --2- 172.21.15.6:0/1487409162 >> v2:172.21.15.6:3300/0 conn(0x7f4724155920 0x7f47240c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.932+0000 7f47289c6700 1 -- 172.21.15.6:0/1487409162 >> 172.21.15.6:0/1487409162 conn(0x7f47240cbd50 msgr2=0x7f47240cc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:17:59.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.933+0000 7ff0ca7fc700 1 -- 172.21.15.6:0/1226437392 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0d001b3b0 con 0x7ff0d40c62a0 2023-10-06T02:17:59.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.933+0000 7ff0ca7fc700 1 --2- 172.21.15.6:0/1226437392 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff0b8066fb0 0x7ff0b8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.933+0000 7ff0ca7fc700 1 -- 172.21.15.6:0/1226437392 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff0d0083e90 con 0x7ff0d40c62a0 2023-10-06T02:17:59.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.934+0000 7ff0da47e700 1 --2- 172.21.15.6:0/1226437392 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff0b8066fb0 0x7ff0b8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.934+0000 7f74bf18a700 1 Processor -- start 2023-10-06T02:17:59.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.934+0000 7f74bf18a700 1 -- start start 2023-10-06T02:17:59.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.934+0000 7ff0da47e700 1 --2- 172.21.15.6:0/1226437392 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff0b8066fb0 0x7ff0b8069460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00c6f0 tx=0x7ff0cc015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.935+0000 7f74bf18a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74a8005310 0x7f74b8149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.935+0000 7f74bf18a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74b8158f40 0x7f74b81593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.935+0000 7f74bf18a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b815a000 0x7f74b815a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.935+0000 7f74bf18a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b8148e40 con 0x7f74b815a000 2023-10-06T02:17:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.935+0000 7f74bf18a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b81461d0 con 0x7f74a8005310 2023-10-06T02:17:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.935+0000 7f74bf18a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b8148b60 con 0x7f74b8158f40 2023-10-06T02:17:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.936+0000 7f47289c6700 1 -- 172.21.15.6:0/1487409162 shutdown_connections 2023-10-06T02:17:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.936+0000 7f74bcf26700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74a8005310 0x7f74b8149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.936+0000 7f74bd727700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b815a000 0x7f74b815a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.936+0000 7f74b7fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74b8158f40 0x7f74b81593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.936+0000 7f74bcf26700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74a8005310 0x7f74b8149000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:52288/0 (socket says 172.21.15.6:52288) 2023-10-06T02:17:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.936+0000 7f74bcf26700 1 -- 172.21.15.6:0/3678684022 learned_addr learned my addr 172.21.15.6:0/3678684022 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.936+0000 7f74b7fff700 1 -- 172.21.15.6:0/3678684022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74a8005310 msgr2=0x7f74b8149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.936+0000 7f74b7fff700 1 --2- 172.21.15.6:0/3678684022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74a8005310 0x7f74b8149000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.936+0000 7f74b7fff700 1 -- 172.21.15.6:0/3678684022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b815a000 msgr2=0x7f74b815a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.936+0000 7f74b7fff700 1 --2- 172.21.15.6:0/3678684022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b815a000 0x7f74b815a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.936+0000 7f74b7fff700 1 -- 172.21.15.6:0/3678684022 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b8145c10 con 0x7f74b8158f40 2023-10-06T02:17:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.936+0000 7f74b7fff700 1 --2- 172.21.15.6:0/3678684022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74b8158f40 0x7f74b81593b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f74b805f200 tx=0x7f74a4009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.936+0000 7f74b4ff9700 1 -- 172.21.15.6:0/3678684022 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4012600 con 0x7f74b8158f40 2023-10-06T02:17:59.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.937+0000 7f74b4ff9700 1 -- 172.21.15.6:0/3678684022 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a4012780 con 0x7f74b8158f40 2023-10-06T02:17:59.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.937+0000 7f74b4ff9700 1 -- 172.21.15.6:0/3678684022 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4012b40 con 0x7f74b8158f40 2023-10-06T02:17:59.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.937+0000 7f74bf18a700 1 -- 172.21.15.6:0/3678684022 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b8145ef0 con 0x7f74b8158f40 2023-10-06T02:17:59.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.937+0000 7f74bf18a700 1 -- 172.21.15.6:0/3678684022 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b8142040 con 0x7f74b8158f40 2023-10-06T02:17:59.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.936+0000 7f47289c6700 1 -- 172.21.15.6:0/1487409162 wait complete. 2023-10-06T02:17:59.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.938+0000 7f47289c6700 1 Processor -- start 2023-10-06T02:17:59.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.938+0000 7fa7f2ffd700 1 -- 172.21.15.6:0/3536537321 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa804052e60 con 0x7fa80c0ce5e0 2023-10-06T02:17:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.938+0000 7f47289c6700 1 -- start start 2023-10-06T02:17:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.939+0000 7f47289c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47240c9920 0x7f47240c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.939+0000 7f47289c6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4724155550 0x7f47240c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.939+0000 7f47289c6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4724155920 0x7f47240af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.939+0000 7f47289c6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47240c3d50 con 0x7f47240c9920 2023-10-06T02:17:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.939+0000 7f47289c6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47240c4240 con 0x7f4724155920 2023-10-06T02:17:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.939+0000 7f47289c6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4724148560 con 0x7f4724155550 2023-10-06T02:17:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.939+0000 7f472259c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4724155550 0x7f47240c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.939+0000 7f472259c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4724155550 0x7f47240c3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:60808/0 (socket says 172.21.15.6:60808) 2023-10-06T02:17:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.939+0000 7f472259c700 1 -- 172.21.15.6:0/1240480472 learned_addr learned my addr 172.21.15.6:0/1240480472 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:17:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.940+0000 7f472259c700 1 -- 172.21.15.6:0/1240480472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4724155920 msgr2=0x7f47240af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.940+0000 7f472259c700 1 --2- 172.21.15.6:0/1240480472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4724155920 0x7f47240af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.940+0000 7f472259c700 1 -- 172.21.15.6:0/1240480472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47240c9920 msgr2=0x7f47240c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:17:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.940+0000 7f472259c700 1 --2- 172.21.15.6:0/1240480472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47240c9920 0x7f47240c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:17:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.940+0000 7f472259c700 1 -- 172.21.15.6:0/1240480472 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47140094f0 con 0x7f4724155550 2023-10-06T02:17:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.940+0000 7f472259c700 1 --2- 172.21.15.6:0/1240480472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4724155550 0x7f47240c3810 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f471800b810 tx=0x7f47180091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.940+0000 7f470affd700 1 -- 172.21.15.6:0/1240480472 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471800f570 con 0x7f4724155550 2023-10-06T02:17:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.940+0000 7f470affd700 1 -- 172.21.15.6:0/1240480472 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471800f6d0 con 0x7f4724155550 2023-10-06T02:17:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.940+0000 7f470affd700 1 -- 172.21.15.6:0/1240480472 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471800fa90 con 0x7f4724155550 2023-10-06T02:17:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.940+0000 7f47289c6700 1 -- 172.21.15.6:0/1240480472 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47240c3f60 con 0x7f4724155550 2023-10-06T02:17:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.940+0000 7f47289c6700 1 -- 172.21.15.6:0/1240480472 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47241481f0 con 0x7f4724155550 2023-10-06T02:17:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.942+0000 7f470affd700 1 -- 172.21.15.6:0/1240480472 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f471801a460 con 0x7f4724155550 2023-10-06T02:17:59.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.942+0000 7f2403fff700 1 -- 172.21.15.6:0/1292206864 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2410051460 con 0x7f241c0aa1a0 2023-10-06T02:17:59.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.943+0000 7f470affd700 1 --2- 172.21.15.6:0/1240480472 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4710066f30 0x7f47100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.943+0000 7f470affd700 1 -- 172.21.15.6:0/1240480472 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4718084680 con 0x7f4724155550 2023-10-06T02:17:59.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.943+0000 7f4722d9d700 1 --2- 172.21.15.6:0/1240480472 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4710066f30 0x7f47100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.943+0000 7f4722d9d700 1 --2- 172.21.15.6:0/1240480472 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4710066f30 0x7f47100693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f47140099b0 tx=0x7f4714016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.944+0000 7ff0ca7fc700 1 -- 172.21.15.6:0/1226437392 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0d0050b80 con 0x7ff0d40c62a0 2023-10-06T02:17:59.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.944+0000 7f47289c6700 1 -- 172.21.15.6:0/1240480472 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47040052b0 con 0x7f4724155550 2023-10-06T02:17:59.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.939+0000 7fa80affd700 1 --2- 172.21.15.6:0/3536537321 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7f8066fb0 0x7fa7f8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.942+0000 7fa80affd700 1 --2- 172.21.15.6:0/3536537321 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7f8066fb0 0x7fa7f8069460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc006fd0 tx=0x7fa7fc0090f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.941+0000 7f74bf18a700 1 -- 172.21.15.6:0/3678684022 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b8145a70 con 0x7f74b8158f40 2023-10-06T02:17:59.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.945+0000 7f74b4ff9700 1 -- 172.21.15.6:0/3678684022 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74a401a3b0 con 0x7f74b8158f40 2023-10-06T02:17:59.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.945+0000 7f74b4ff9700 1 --2- 172.21.15.6:0/3678684022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f749c066fb0 0x7f749c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:17:59.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.945+0000 7f74b4ff9700 1 -- 172.21.15.6:0/3678684022 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f74a4084340 con 0x7f74b8158f40 2023-10-06T02:17:59.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.946+0000 7f74bcf26700 1 --2- 172.21.15.6:0/3678684022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f749c066fb0 0x7f749c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:17:59.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.946+0000 7f74bcf26700 1 --2- 172.21.15.6:0/3678684022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f749c066fb0 0x7f749c069460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f74ac000c00 tx=0x7f74ac001c40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:17:59.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.947+0000 7f74b4ff9700 1 -- 172.21.15.6:0/3678684022 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74b8145a70 con 0x7f74b8158f40 2023-10-06T02:17:59.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:17:59.951+0000 7f470affd700 1 -- 172.21.15.6:0/1240480472 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4718054f10 con 0x7f4724155550 2023-10-06T02:18:00.332 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-06T02:18:00.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.329+0000 7fd003824700 1 -- 172.21.15.6:0/2714867830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcfdc005830 con 0x7fcffc1559d0 2023-10-06T02:18:00.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.329+0000 7fcff17fa700 1 -- 172.21.15.6:0/2714867830 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcff4055690 con 0x7fcffc1559d0 2023-10-06T02:18:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.331+0000 7f7d5f580700 1 -- 172.21.15.6:0/939313281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7d38005830 con 0x7f7d58159960 2023-10-06T02:18:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.332+0000 7f34ae8ab700 1 -- 172.21.15.6:0/72372961 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f34a80c8550 con 0x7f34a806c460 2023-10-06T02:18:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.332+0000 7f7d4d7fa700 1 -- 172.21.15.6:0/939313281 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d480552c0 con 0x7f7d58159960 2023-10-06T02:18:00.333 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2023-10-06T02:18:00.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.332+0000 7f348ffff700 1 -- 172.21.15.6:0/72372961 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f349c0549d0 con 0x7f34a806c460 2023-10-06T02:18:00.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.333+0000 7fd003824700 1 -- 172.21.15.6:0/2714867830 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcfe0067000 msgr2=0x7fcfe00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:00.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.333+0000 7fd003824700 1 --2- 172.21.15.6:0/2714867830 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcfe0067000 0x7fcfe00694b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009e70 tx=0x7fcff80091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.333+0000 7fd003824700 1 -- 172.21.15.6:0/2714867830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcffc1559d0 msgr2=0x7fcffc15b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:00.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.333+0000 7fd003824700 1 --2- 172.21.15.6:0/2714867830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcffc1559d0 0x7fcffc15b440 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcff4008620 tx=0x7fcff400f040 comp rx=0 tx=0).stop 2023-10-06T02:18:00.335 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-06T02:18:00.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.335+0000 7fd003824700 1 -- 172.21.15.6:0/2714867830 shutdown_connections 2023-10-06T02:18:00.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.335+0000 7fd003824700 1 --2- 172.21.15.6:0/2714867830 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcfe0067000 0x7fcfe00694b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.335+0000 7fd003824700 1 --2- 172.21.15.6:0/2714867830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcffc1559d0 0x7fcffc15b440 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.335+0000 7fd003824700 1 --2- 172.21.15.6:0/2714867830 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcffc152d80 0x7fcffc0cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.335+0000 7fd003824700 1 --2- 172.21.15.6:0/2714867830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcffc153150 0x7fcffc14b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.335+0000 7fd003824700 1 -- 172.21.15.6:0/2714867830 >> 172.21.15.6:0/2714867830 conn(0x7fcffc06b230 msgr2=0x7fcffc151440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:00.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.335+0000 7fa8119b2700 1 -- 172.21.15.6:0/3536537321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa7ec005560 con 0x7fa80c0ce5e0 2023-10-06T02:18:00.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.335+0000 7fd003824700 1 -- 172.21.15.6:0/2714867830 shutdown_connections 2023-10-06T02:18:00.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.335+0000 7fa7f2ffd700 1 -- 172.21.15.6:0/3536537321 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa804056480 con 0x7fa80c0ce5e0 2023-10-06T02:18:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.335+0000 7fd003824700 1 -- 172.21.15.6:0/2714867830 wait complete. 2023-10-06T02:18:00.339 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-06T02:18:00.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.337+0000 7f34ae8ab700 1 -- 172.21.15.6:0/72372961 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3494066f30 msgr2=0x7f34940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:00.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.337+0000 7f34ae8ab700 1 --2- 172.21.15.6:0/72372961 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3494066f30 0x7f34940693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f34a806b7a0 tx=0x7f34980090f0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.337+0000 7f34ae8ab700 1 -- 172.21.15.6:0/72372961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a806c460 msgr2=0x7f34a80ae060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:00.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.337+0000 7f34ae8ab700 1 --2- 172.21.15.6:0/72372961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a806c460 0x7f34a80ae060 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f349c00c4e0 tx=0x7f349c007ea0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.337+0000 7f34ae8ab700 1 -- 172.21.15.6:0/72372961 shutdown_connections 2023-10-06T02:18:00.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.337+0000 7f34ae8ab700 1 --2- 172.21.15.6:0/72372961 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3494066f30 0x7f34940693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.337+0000 7f34ae8ab700 1 --2- 172.21.15.6:0/72372961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a80c6390 0x7f34a815a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.337+0000 7f34ae8ab700 1 --2- 172.21.15.6:0/72372961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34a806c460 0x7f34a80ae060 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.337+0000 7f34ae8ab700 1 --2- 172.21.15.6:0/72372961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a806c830 0x7f34a80c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.337+0000 7f34ae8ab700 1 -- 172.21.15.6:0/72372961 >> 172.21.15.6:0/72372961 conn(0x7f34a80c9cc0 msgr2=0x7f34a80c1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:00.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.337+0000 7f34ae8ab700 1 -- 172.21.15.6:0/72372961 shutdown_connections 2023-10-06T02:18:00.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.337+0000 7f34ae8ab700 1 -- 172.21.15.6:0/72372961 wait complete. 2023-10-06T02:18:00.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.337+0000 7f7d5f580700 1 -- 172.21.15.6:0/939313281 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d44067160 msgr2=0x7f7d44069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:00.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.337+0000 7f7d5f580700 1 --2- 172.21.15.6:0/939313281 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d44067160 0x7f7d44069610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7d500097c0 tx=0x7f7d50018000 comp rx=0 tx=0).stop 2023-10-06T02:18:00.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.337+0000 7f7d5f580700 1 -- 172.21.15.6:0/939313281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d58159960 msgr2=0x7f7d580b2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:00.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.337+0000 7f7d5f580700 1 --2- 172.21.15.6:0/939313281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d58159960 0x7f7d580b2690 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800b7e0 tx=0x7f7d480091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.338+0000 7f7d5f580700 1 -- 172.21.15.6:0/939313281 shutdown_connections 2023-10-06T02:18:00.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.338+0000 7f7d5f580700 1 --2- 172.21.15.6:0/939313281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d581768a0 0x7f7d5815bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.338+0000 7f7d5f580700 1 --2- 172.21.15.6:0/939313281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d580af3f0 0x7f7d58156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.338+0000 7f7d5f580700 1 --2- 172.21.15.6:0/939313281 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d44067160 0x7f7d44069610 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.338+0000 7f7d5f580700 1 --2- 172.21.15.6:0/939313281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d58159960 0x7f7d580b2690 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.338+0000 7f7d5f580700 1 -- 172.21.15.6:0/939313281 >> 172.21.15.6:0/939313281 conn(0x7f7d5806a260 msgr2=0x7f7d5806cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:00.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.338+0000 7f7d5f580700 1 -- 172.21.15.6:0/939313281 shutdown_connections 2023-10-06T02:18:00.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.338+0000 7f7d5f580700 1 -- 172.21.15.6:0/939313281 wait complete. 2023-10-06T02:18:00.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.339+0000 7fa8119b2700 1 -- 172.21.15.6:0/3536537321 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7f8066fb0 msgr2=0x7fa7f8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:00.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.339+0000 7fa8119b2700 1 --2- 172.21.15.6:0/3536537321 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7f8066fb0 0x7fa7f8069460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc006fd0 tx=0x7fa7fc0090f0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.339+0000 7fa8119b2700 1 -- 172.21.15.6:0/3536537321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa80c0ce5e0 msgr2=0x7fa80c0c9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:00.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.339+0000 7fa8119b2700 1 --2- 172.21.15.6:0/3536537321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa80c0ce5e0 0x7fa80c0c9450 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0c7190 tx=0x7fa804017000 comp rx=0 tx=0).stop 2023-10-06T02:18:00.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.339+0000 7fa8119b2700 1 -- 172.21.15.6:0/3536537321 shutdown_connections 2023-10-06T02:18:00.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.339+0000 7fa8119b2700 1 --2- 172.21.15.6:0/3536537321 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7f8066fb0 0x7fa7f8069460 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.339+0000 7fa8119b2700 1 --2- 172.21.15.6:0/3536537321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa80c0ce5e0 0x7fa80c0c9450 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.339+0000 7fa8119b2700 1 --2- 172.21.15.6:0/3536537321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa80c06a8b0 0x7fa80c150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.339+0000 7fa8119b2700 1 --2- 172.21.15.6:0/3536537321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa80c0af510 0x7fa80c0b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.339+0000 7fa8119b2700 1 -- 172.21.15.6:0/3536537321 >> 172.21.15.6:0/3536537321 conn(0x7fa80c0d0250 msgr2=0x7fa80c0ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:00.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.339+0000 7fa8119b2700 1 -- 172.21.15.6:0/3536537321 shutdown_connections 2023-10-06T02:18:00.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.339+0000 7fa8119b2700 1 -- 172.21.15.6:0/3536537321 wait complete. 2023-10-06T02:18:00.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.351+0000 7ff0dc6e2700 1 -- 172.21.15.6:0/1226437392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff0bc005560 con 0x7ff0d40c62a0 2023-10-06T02:18:00.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.351+0000 7f74bf18a700 1 -- 172.21.15.6:0/3678684022 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f74b8145a70 con 0x7f74b8158f40 2023-10-06T02:18:00.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.352+0000 7f74b4ff9700 1 -- 172.21.15.6:0/3678684022 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74b8145a70 con 0x7f74b8158f40 2023-10-06T02:18:00.354 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-06T02:18:00.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.352+0000 7ff0ca7fc700 1 -- 172.21.15.6:0/1226437392 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff0d0017020 con 0x7ff0d40c62a0 2023-10-06T02:18:00.356 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-06T02:18:00.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.353+0000 7f2422399700 1 -- 172.21.15.6:0/1292206864 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f241c0cc830 con 0x7f241c0aa1a0 2023-10-06T02:18:00.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.353+0000 7f2403fff700 1 -- 172.21.15.6:0/1292206864 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2410054a80 con 0x7f241c0aa1a0 2023-10-06T02:18:00.357 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-06T02:18:00.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.356+0000 7f74bf18a700 1 -- 172.21.15.6:0/3678684022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f749c066fb0 msgr2=0x7f749c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:00.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.356+0000 7f74bf18a700 1 --2- 172.21.15.6:0/3678684022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f749c066fb0 0x7f749c069460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f74ac000c00 tx=0x7f74ac001c40 comp rx=0 tx=0).stop 2023-10-06T02:18:00.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.356+0000 7f74bf18a700 1 -- 172.21.15.6:0/3678684022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74b8158f40 msgr2=0x7f74b81593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:00.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.356+0000 7f74bf18a700 1 --2- 172.21.15.6:0/3678684022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74b8158f40 0x7f74b81593b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f74b805f200 tx=0x7f74a4009060 comp rx=0 tx=0).stop 2023-10-06T02:18:00.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.357+0000 7ff0dc6e2700 1 -- 172.21.15.6:0/1226437392 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff0b8066fb0 msgr2=0x7ff0b8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:00.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.357+0000 7ff0dc6e2700 1 --2- 172.21.15.6:0/1226437392 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff0b8066fb0 0x7ff0b8069460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00c6f0 tx=0x7ff0cc015000 comp rx=0 tx=0).stop 2023-10-06T02:18:00.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.357+0000 7ff0dc6e2700 1 -- 172.21.15.6:0/1226437392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0d40c62a0 msgr2=0x7ff0d40c6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:00.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.357+0000 7ff0dc6e2700 1 --2- 172.21.15.6:0/1226437392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0d40c62a0 0x7ff0d40c6710 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0001ed0 tx=0x7ff0d0007cf0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.359+0000 7f74bf18a700 1 -- 172.21.15.6:0/3678684022 shutdown_connections 2023-10-06T02:18:00.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.359+0000 7f74bf18a700 1 --2- 172.21.15.6:0/3678684022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f749c066fb0 0x7f749c069460 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.359+0000 7f74bf18a700 1 --2- 172.21.15.6:0/3678684022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b815a000 0x7f74b815a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.359+0000 7f74bf18a700 1 --2- 172.21.15.6:0/3678684022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74a8005310 0x7f74b8149000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.359+0000 7f74bf18a700 1 --2- 172.21.15.6:0/3678684022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74b8158f40 0x7f74b81593b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.359+0000 7f74bf18a700 1 -- 172.21.15.6:0/3678684022 >> 172.21.15.6:0/3678684022 conn(0x7f74b8069110 msgr2=0x7f74b814e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:00.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.359+0000 7f74bf18a700 1 -- 172.21.15.6:0/3678684022 shutdown_connections 2023-10-06T02:18:00.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.359+0000 7f74bf18a700 1 -- 172.21.15.6:0/3678684022 wait complete. 2023-10-06T02:18:00.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-10-06T02:18:00.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.359+0000 7f47289c6700 1 -- 172.21.15.6:0/1240480472 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4704005560 con 0x7f4724155550 2023-10-06T02:18:00.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.359+0000 7f470affd700 1 -- 172.21.15.6:0/1240480472 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4718054aa0 con 0x7f4724155550 2023-10-06T02:18:00.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7f2422399700 1 -- 172.21.15.6:0/1292206864 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2408066f30 msgr2=0x7f24080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:00.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7f2422399700 1 --2- 172.21.15.6:0/1292206864 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2408066f30 0x7f24080693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f24140097c0 tx=0x7f2414019000 comp rx=0 tx=0).stop 2023-10-06T02:18:00.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7f2422399700 1 -- 172.21.15.6:0/1292206864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f241c0aa1a0 msgr2=0x7f241c0af6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:00.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7f2422399700 1 --2- 172.21.15.6:0/1292206864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f241c0aa1a0 0x7f241c0af6d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f241000c4b0 tx=0x7f2410007d50 comp rx=0 tx=0).stop 2023-10-06T02:18:00.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7f2422399700 1 -- 172.21.15.6:0/1292206864 shutdown_connections 2023-10-06T02:18:00.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7f2422399700 1 --2- 172.21.15.6:0/1292206864 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f241c15d4c0 0x7f241c0b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7f2422399700 1 --2- 172.21.15.6:0/1292206864 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2408066f30 0x7f24080693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7f2422399700 1 --2- 172.21.15.6:0/1292206864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f241c0a9dd0 0x7f241c152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7f2422399700 1 --2- 172.21.15.6:0/1292206864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f241c0aa1a0 0x7f241c0af6d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7f2422399700 1 -- 172.21.15.6:0/1292206864 >> 172.21.15.6:0/1292206864 conn(0x7f241c069110 msgr2=0x7f241c153eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:00.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7f2422399700 1 -- 172.21.15.6:0/1292206864 shutdown_connections 2023-10-06T02:18:00.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7f2422399700 1 -- 172.21.15.6:0/1292206864 wait complete. 2023-10-06T02:18:00.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2023-10-06T02:18:00.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7ff0dc6e2700 1 -- 172.21.15.6:0/1226437392 shutdown_connections 2023-10-06T02:18:00.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7ff0dc6e2700 1 --2- 172.21.15.6:0/1226437392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0d40c18b0 0x7ff0d40c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7ff0dc6e2700 1 --2- 172.21.15.6:0/1226437392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0c0003c20 0x7ff0d4140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7ff0dc6e2700 1 --2- 172.21.15.6:0/1226437392 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff0b8066fb0 0x7ff0b8069460 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7ff0dc6e2700 1 --2- 172.21.15.6:0/1226437392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0d40c62a0 0x7ff0d40c6710 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7ff0dc6e2700 1 -- 172.21.15.6:0/1226437392 >> 172.21.15.6:0/1226437392 conn(0x7ff0d4069110 msgr2=0x7ff0d4157a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:00.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7ff0dc6e2700 1 -- 172.21.15.6:0/1226437392 shutdown_connections 2023-10-06T02:18:00.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.360+0000 7ff0dc6e2700 1 -- 172.21.15.6:0/1226437392 wait complete. 2023-10-06T02:18:00.367 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-10-06T02:18:00.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-06T02:18:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.363+0000 7f47289c6700 1 -- 172.21.15.6:0/1240480472 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4710066f30 msgr2=0x7f47100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.363+0000 7f47289c6700 1 --2- 172.21.15.6:0/1240480472 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4710066f30 0x7f47100693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f47140099b0 tx=0x7f4714016000 comp rx=0 tx=0).stop 2023-10-06T02:18:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.363+0000 7f47289c6700 1 -- 172.21.15.6:0/1240480472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4724155550 msgr2=0x7f47240c3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.363+0000 7f47289c6700 1 --2- 172.21.15.6:0/1240480472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4724155550 0x7f47240c3810 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f471800b810 tx=0x7f47180091d0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.363+0000 7f47289c6700 1 -- 172.21.15.6:0/1240480472 shutdown_connections 2023-10-06T02:18:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.363+0000 7f47289c6700 1 --2- 172.21.15.6:0/1240480472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4724155920 0x7f47240af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.363+0000 7f47289c6700 1 --2- 172.21.15.6:0/1240480472 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4710066f30 0x7f47100693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.363+0000 7f47289c6700 1 --2- 172.21.15.6:0/1240480472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47240c9920 0x7f47240c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.363+0000 7f47289c6700 1 --2- 172.21.15.6:0/1240480472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4724155550 0x7f47240c3810 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:00.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.363+0000 7f47289c6700 1 -- 172.21.15.6:0/1240480472 >> 172.21.15.6:0/1240480472 conn(0x7f47240cbd50 msgr2=0x7f472406e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:00.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.363+0000 7f47289c6700 1 -- 172.21.15.6:0/1240480472 shutdown_connections 2023-10-06T02:18:00.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:00.363+0000 7f47289c6700 1 -- 172.21.15.6:0/1240480472 wait complete. 2023-10-06T02:18:00.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-10-06T02:18:00.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-10-06T02:18:00.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-10-06T02:18:00.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-10-06T02:18:00.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2023-10-06T02:18:01.363 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T02:18:01.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T02:18:01.367 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T02:18:01.370 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T02:18:01.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T02:18:01.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T02:18:01.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T02:18:01.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T02:18:01.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.555+0000 7ff2318bd700 1 Processor -- start 2023-10-06T02:18:01.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.555+0000 7ff2318bd700 1 -- start start 2023-10-06T02:18:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.556+0000 7ff2318bd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff22c158da0 0x7ff22c06ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.556+0000 7ff2318bd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22c0b00c0 con 0x7ff22c0c9480 2023-10-06T02:18:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.556+0000 7ff2318bd700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22c0af790 con 0x7ff22c0c8900 2023-10-06T02:18:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.556+0000 7ff2318bd700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22c0afa70 con 0x7ff22c158da0 2023-10-06T02:18:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.557+0000 7ff22b7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff22c0c9480 0x7ff22c0b0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36100/0 (socket says 172.21.15.6:36100) 2023-10-06T02:18:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.557+0000 7ff22b7fe700 1 -- 172.21.15.6:0/2317967178 learned_addr learned my addr 172.21.15.6:0/2317967178 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.558+0000 7ff22affd700 1 --2- 172.21.15.6:0/2317967178 >> v2:172.21.15.175:3300/0 conn(0x7ff22c158da0 0x7ff22c06ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.558+0000 7ff22affd700 1 -- 172.21.15.6:0/2317967178 >> v1:172.21.15.175:6789/0 conn(0x7ff22c0c8900 legacy=0x7ff22c0c8d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:18:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.558+0000 7ff22affd700 1 -- 172.21.15.6:0/2317967178 >> v1:172.21.15.6:6789/0 conn(0x7ff22c0c9480 legacy=0x7ff22c0b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.558+0000 7ff22affd700 1 -- 172.21.15.6:0/2317967178 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c0afd50 con 0x7ff22c158da0 2023-10-06T02:18:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.559+0000 7ff22affd700 1 --2- 172.21.15.6:0/2317967178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff22c158da0 0x7ff22c06ec70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00aa90 tx=0x7ff21c00a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e148a5fb4c18d72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.559+0000 7ff229ffb700 1 -- 172.21.15.6:0/2317967178 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c00c930 con 0x7ff22c158da0 2023-10-06T02:18:01.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.561+0000 7ff229ffb700 1 -- 172.21.15.6:0/2317967178 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c00ca90 con 0x7ff22c158da0 2023-10-06T02:18:01.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.561+0000 7ff229ffb700 1 -- 172.21.15.6:0/2317967178 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c00ce30 con 0x7ff22c158da0 2023-10-06T02:18:01.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.562+0000 7ff2318bd700 1 -- 172.21.15.6:0/2317967178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff22c158da0 msgr2=0x7ff22c06ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.562+0000 7ff2318bd700 1 --2- 172.21.15.6:0/2317967178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff22c158da0 0x7ff22c06ec70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00aa90 tx=0x7ff21c00a330 comp rx=0 tx=0).stop 2023-10-06T02:18:01.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.562+0000 7ff2318bd700 1 -- 172.21.15.6:0/2317967178 shutdown_connections 2023-10-06T02:18:01.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.562+0000 7ff2318bd700 1 --2- 172.21.15.6:0/2317967178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff22c158da0 0x7ff22c06ec70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.562+0000 7ff2318bd700 1 -- 172.21.15.6:0/2317967178 >> 172.21.15.6:0/2317967178 conn(0x7ff22c069110 msgr2=0x7ff22c0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:01.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.563+0000 7ff2318bd700 1 -- 172.21.15.6:0/2317967178 shutdown_connections 2023-10-06T02:18:01.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.564+0000 7f1622d5d700 1 Processor -- start 2023-10-06T02:18:01.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.564+0000 7f1622d5d700 1 -- start start 2023-10-06T02:18:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.563+0000 7ff2318bd700 1 -- 172.21.15.6:0/2317967178 wait complete. 2023-10-06T02:18:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.564+0000 7f4418dfd700 1 Processor -- start 2023-10-06T02:18:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.565+0000 7ff2318bd700 1 Processor -- start 2023-10-06T02:18:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.565+0000 7f1622d5d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f161c15b930 0x7f161c0acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.565+0000 7f1622d5d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161c0ad4f0 con 0x7f161c0ad080 2023-10-06T02:18:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.565+0000 7f1622d5d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161c0c8530 con 0x7f161c06e9c0 2023-10-06T02:18:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.565+0000 7f1622d5d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161c15e660 con 0x7f161c15b930 2023-10-06T02:18:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.565+0000 7f161bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f161c0ad080 0x7f161c06e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36102/0 (socket says 172.21.15.6:36102) 2023-10-06T02:18:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.565+0000 7f161bfff700 1 -- 172.21.15.6:0/685054629 learned_addr learned my addr 172.21.15.6:0/685054629 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.566+0000 7f1620af9700 1 --2- 172.21.15.6:0/685054629 >> v2:172.21.15.175:3300/0 conn(0x7f161c15b930 0x7f161c0acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.564+0000 7f4418dfd700 1 -- start start 2023-10-06T02:18:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.566+0000 7f4418dfd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4414152d80 0x7f44140afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.566+0000 7f4418dfd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4414153150 0x7f44140b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.566+0000 7f4418dfd700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44140b0030 con 0x7f44141559d0 2023-10-06T02:18:01.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.566+0000 7f4418dfd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44140aea50 con 0x7f4414153150 2023-10-06T02:18:01.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.566+0000 7f4418dfd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4414155ef0 con 0x7f4414152d80 2023-10-06T02:18:01.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.566+0000 7f161b7fe700 1 -- 172.21.15.6:0/685054629 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433396665 0 0) 0x7f161c0ad4f0 con 0x7f161c0ad080 2023-10-06T02:18:01.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7f161b7fe700 1 -- 172.21.15.6:0/685054629 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1604003570 con 0x7f161c0ad080 2023-10-06T02:18:01.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.566+0000 7f441259c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4414152d80 0x7f44140afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7f441259c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4414152d80 0x7f44140afaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:60818/0 (socket says 172.21.15.6:60818) 2023-10-06T02:18:01.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7f441259c700 1 -- 172.21.15.6:0/3914899984 learned_addr learned my addr 172.21.15.6:0/3914899984 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:01.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.565+0000 7ff2318bd700 1 -- start start 2023-10-06T02:18:01.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.566+0000 7ff2318bd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff22c0c8900 0x7ff22c14abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.566+0000 7ff2318bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff22c0c9480 0x7ff22c14a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.566+0000 7ff2318bd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff22c158da0 0x7ff22c1506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.566+0000 7ff2318bd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c14d030 con 0x7ff22c0c9480 2023-10-06T02:18:01.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.566+0000 7ff2318bd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c14dd60 con 0x7ff22c158da0 2023-10-06T02:18:01.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.566+0000 7ff2318bd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c14b130 con 0x7ff22c0c8900 2023-10-06T02:18:01.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7f4412d9d700 1 --2- 172.21.15.6:0/3914899984 >> v2:172.21.15.6:3300/0 conn(0x7f4414153150 0x7f44140b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7f161b7fe700 1 -- 172.21.15.6:0/685054629 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562754597 0 0) 0x7f161c0c8530 con 0x7f161c06e9c0 2023-10-06T02:18:01.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7f161b7fe700 1 -- 172.21.15.6:0/685054629 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f161c0ad4f0 con 0x7f161c06e9c0 2023-10-06T02:18:01.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7ff22b7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff22c158da0 0x7ff22c1506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7ff22affd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff22c0c8900 0x7ff22c14abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7ff22a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff22c0c9480 0x7ff22c14a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7ff22a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff22c0c9480 0x7ff22c14a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54366/0 (socket says 172.21.15.6:54366) 2023-10-06T02:18:01.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7ff22a7fc700 1 -- 172.21.15.6:0/2656094115 learned_addr learned my addr 172.21.15.6:0/2656094115 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:01.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7f1620af9700 1 -- 172.21.15.6:0/685054629 >> v1:172.21.15.175:6789/0 conn(0x7f161c06e9c0 legacy=0x7f161c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7f1620af9700 1 -- 172.21.15.6:0/685054629 >> v1:172.21.15.6:6789/0 conn(0x7f161c0ad080 legacy=0x7f161c06e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7f1620af9700 1 -- 172.21.15.6:0/685054629 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c15bd00 con 0x7f161c15b930 2023-10-06T02:18:01.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7f441259c700 1 -- 172.21.15.6:0/3914899984 >> v2:172.21.15.6:3300/0 conn(0x7f4414153150 msgr2=0x7f44140b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:01.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7f441259c700 1 --2- 172.21.15.6:0/3914899984 >> v2:172.21.15.6:3300/0 conn(0x7f4414153150 0x7f44140b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7f441259c700 1 -- 172.21.15.6:0/3914899984 >> v1:172.21.15.175:6789/0 conn(0x7f44141559d0 legacy=0x7f441406e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:01.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7f441259c700 1 -- 172.21.15.6:0/3914899984 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44141561d0 con 0x7f4414152d80 2023-10-06T02:18:01.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.567+0000 7f441259c700 1 --2- 172.21.15.6:0/3914899984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4414152d80 0x7f44140afaf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f440c00d1a0 tx=0x7f440c007690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9012053ddde69d3f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.568+0000 7f1620af9700 1 --2- 172.21.15.6:0/685054629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f161c15b930 0x7f161c0acb40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f160c0098e0 tx=0x7f160c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d5d4696f817757c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.568+0000 7ff22affd700 1 -- 172.21.15.6:0/2656094115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff22c158da0 msgr2=0x7ff22c1506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.568+0000 7ff22affd700 1 --2- 172.21.15.6:0/2656094115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff22c158da0 0x7ff22c1506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.568+0000 7ff22affd700 1 -- 172.21.15.6:0/2656094115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff22c0c9480 msgr2=0x7ff22c14a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.568+0000 7ff22affd700 1 --2- 172.21.15.6:0/2656094115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff22c0c9480 0x7ff22c14a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.568+0000 7ff22affd700 1 -- 172.21.15.6:0/2656094115 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c00a5d0 con 0x7ff22c0c8900 2023-10-06T02:18:01.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.568+0000 7ff22affd700 1 --2- 172.21.15.6:0/2656094115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff22c0c8900 0x7ff22c14abf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff21c017000 tx=0x7ff21c018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.568+0000 7f161b7fe700 1 -- 172.21.15.6:0/685054629 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c011630 con 0x7f161c15b930 2023-10-06T02:18:01.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.568+0000 7f161b7fe700 1 -- 172.21.15.6:0/685054629 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160c011790 con 0x7f161c15b930 2023-10-06T02:18:01.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.568+0000 7f161b7fe700 1 -- 172.21.15.6:0/685054629 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c011b30 con 0x7f161c15b930 2023-10-06T02:18:01.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.568+0000 7ff212ffd700 1 -- 172.21.15.6:0/2656094115 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c021430 con 0x7ff22c0c8900 2023-10-06T02:18:01.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.568+0000 7ff212ffd700 1 -- 172.21.15.6:0/2656094115 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c021590 con 0x7ff22c0c8900 2023-10-06T02:18:01.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.568+0000 7ff212ffd700 1 -- 172.21.15.6:0/2656094115 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c021910 con 0x7ff22c0c8900 2023-10-06T02:18:01.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.569+0000 7f1622d5d700 1 -- 172.21.15.6:0/685054629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f161c15b930 msgr2=0x7f161c0acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.569+0000 7f1622d5d700 1 --2- 172.21.15.6:0/685054629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f161c15b930 0x7f161c0acb40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f160c0098e0 tx=0x7f160c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.569+0000 7ff2318bd700 1 -- 172.21.15.6:0/2656094115 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22c14e000 con 0x7ff22c0c8900 2023-10-06T02:18:01.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.569+0000 7ff2318bd700 1 -- 172.21.15.6:0/2656094115 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22c14e5c0 con 0x7ff22c0c8900 2023-10-06T02:18:01.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.571+0000 7ff2318bd700 1 -- 172.21.15.6:0/2656094115 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22c06fcb0 con 0x7ff22c0c8900 2023-10-06T02:18:01.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.571+0000 7ff212ffd700 1 -- 172.21.15.6:0/2656094115 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff21c021c80 con 0x7ff22c0c8900 2023-10-06T02:18:01.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.571+0000 7f441159a700 1 -- 172.21.15.6:0/3914899984 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c010070 con 0x7f4414152d80 2023-10-06T02:18:01.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.572+0000 7f441159a700 1 -- 172.21.15.6:0/3914899984 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c00dc70 con 0x7f4414152d80 2023-10-06T02:18:01.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.572+0000 7f441159a700 1 -- 172.21.15.6:0/3914899984 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c007b40 con 0x7f4414152d80 2023-10-06T02:18:01.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.572+0000 7ff212ffd700 1 --2- 172.21.15.6:0/2656094115 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff218066f30 0x7ff2180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.572+0000 7ff212ffd700 1 -- 172.21.15.6:0/2656094115 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff21c013070 con 0x7ff22c0c8900 2023-10-06T02:18:01.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.573+0000 7ff22a7fc700 1 --2- 172.21.15.6:0/2656094115 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff218066f30 0x7ff2180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.573+0000 7f4418dfd700 1 -- 172.21.15.6:0/3914899984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4414152d80 msgr2=0x7f44140afaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.573+0000 7f4418dfd700 1 --2- 172.21.15.6:0/3914899984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4414152d80 0x7f44140afaf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f440c00d1a0 tx=0x7f440c007690 comp rx=0 tx=0).stop 2023-10-06T02:18:01.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.573+0000 7f4418dfd700 1 -- 172.21.15.6:0/3914899984 shutdown_connections 2023-10-06T02:18:01.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.573+0000 7f4418dfd700 1 --2- 172.21.15.6:0/3914899984 >> v2:172.21.15.6:3300/0 conn(0x7f4414153150 0x7f44140b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.573+0000 7f4418dfd700 1 --2- 172.21.15.6:0/3914899984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4414152d80 0x7f44140afaf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.573+0000 7f4418dfd700 1 -- 172.21.15.6:0/3914899984 >> 172.21.15.6:0/3914899984 conn(0x7f441406b230 msgr2=0x7f44140adcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:01.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.573+0000 7f1622d5d700 1 -- 172.21.15.6:0/685054629 shutdown_connections 2023-10-06T02:18:01.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.573+0000 7f1622d5d700 1 --2- 172.21.15.6:0/685054629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f161c15b930 0x7f161c0acb40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.573+0000 7f1622d5d700 1 -- 172.21.15.6:0/685054629 >> 172.21.15.6:0/685054629 conn(0x7f161c069110 msgr2=0x7f161c0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:01.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.573+0000 7f1622d5d700 1 -- 172.21.15.6:0/685054629 shutdown_connections 2023-10-06T02:18:01.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.573+0000 7f1622d5d700 1 -- 172.21.15.6:0/685054629 wait complete. 2023-10-06T02:18:01.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.573+0000 7f4418dfd700 1 -- 172.21.15.6:0/3914899984 shutdown_connections 2023-10-06T02:18:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.573+0000 7f4418dfd700 1 -- 172.21.15.6:0/3914899984 wait complete. 2023-10-06T02:18:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.575+0000 7f4418dfd700 1 Processor -- start 2023-10-06T02:18:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.575+0000 7ff22a7fc700 1 --2- 172.21.15.6:0/2656094115 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff218066f30 0x7ff2180693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff220009c10 tx=0x7ff220000f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.575+0000 7f1622d5d700 1 Processor -- start 2023-10-06T02:18:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.575+0000 7f1622d5d700 1 -- start start 2023-10-06T02:18:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.576+0000 7f1622d5d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f161c06e9c0 0x7f161c177c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.576+0000 7f1622d5d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f161c0ad080 0x7f161c177310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.576+0000 7f1622d5d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f161c15b930 0x7f161c15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.576+0000 7f1622d5d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c162150 con 0x7f161c06e9c0 2023-10-06T02:18:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.576+0000 7f1622d5d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c15f110 con 0x7f161c15b930 2023-10-06T02:18:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.576+0000 7f1622d5d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c15f3f0 con 0x7f161c0ad080 2023-10-06T02:18:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.577+0000 7f161bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f161c0ad080 0x7f161c177310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.577+0000 7f161bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f161c0ad080 0x7f161c177310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:60850/0 (socket says 172.21.15.6:60850) 2023-10-06T02:18:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.577+0000 7f161bfff700 1 -- 172.21.15.6:0/1908505965 learned_addr learned my addr 172.21.15.6:0/1908505965 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.577+0000 7ff212ffd700 1 -- 172.21.15.6:0/2656094115 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff21c08b060 con 0x7ff22c0c8900 2023-10-06T02:18:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.575+0000 7f4418dfd700 1 -- start start 2023-10-06T02:18:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.576+0000 7f4418dfd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4414152d80 0x7f441414fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.576+0000 7f4418dfd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4414153150 0x7f44140c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.576+0000 7f4418dfd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44141559d0 0x7f4414171a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.576+0000 7f4418dfd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44140cbbd0 con 0x7f4414152d80 2023-10-06T02:18:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.576+0000 7f4418dfd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44140cbeb0 con 0x7f44141559d0 2023-10-06T02:18:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.576+0000 7f4418dfd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441414f600 con 0x7f4414153150 2023-10-06T02:18:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.577+0000 7f16212fa700 1 --2- 172.21.15.6:0/1908505965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f161c15b930 0x7f161c15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.577+0000 7f1620af9700 1 --2- 172.21.15.6:0/1908505965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f161c06e9c0 0x7f161c177c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.578+0000 7f161bfff700 1 -- 172.21.15.6:0/1908505965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f161c15b930 msgr2=0x7f161c15e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.578+0000 7f161bfff700 1 --2- 172.21.15.6:0/1908505965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f161c15b930 0x7f161c15e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.578+0000 7f161bfff700 1 -- 172.21.15.6:0/1908505965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f161c06e9c0 msgr2=0x7f161c177c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.578+0000 7f161bfff700 1 --2- 172.21.15.6:0/1908505965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f161c06e9c0 0x7f161c177c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.578+0000 7f161bfff700 1 -- 172.21.15.6:0/1908505965 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c009420 con 0x7f161c0ad080 2023-10-06T02:18:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.577+0000 7f441259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4414152d80 0x7f441414fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.577+0000 7f441259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4414152d80 0x7f441414fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54376/0 (socket says 172.21.15.6:54376) 2023-10-06T02:18:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.577+0000 7f441259c700 1 -- 172.21.15.6:0/3611992918 learned_addr learned my addr 172.21.15.6:0/3611992918 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.578+0000 7f4411d9b700 1 --2- 172.21.15.6:0/3611992918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4414153150 0x7f44140c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.578+0000 7f4412d9d700 1 --2- 172.21.15.6:0/3611992918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44141559d0 0x7f4414171a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.578+0000 7f1620af9700 1 --2- 172.21.15.6:0/1908505965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f161c06e9c0 0x7f161c177c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.578+0000 7f161bfff700 1 --2- 172.21.15.6:0/1908505965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f161c0ad080 0x7f161c177310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f161000c790 tx=0x7f1610007ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.578+0000 7f441259c700 1 -- 172.21.15.6:0/3611992918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4414153150 msgr2=0x7f44140c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.578+0000 7f441259c700 1 --2- 172.21.15.6:0/3611992918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4414153150 0x7f44140c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.578+0000 7f441259c700 1 -- 172.21.15.6:0/3611992918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44141559d0 msgr2=0x7f4414171a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.578+0000 7f441259c700 1 --2- 172.21.15.6:0/3611992918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44141559d0 0x7f4414171a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.578+0000 7f441259c700 1 -- 172.21.15.6:0/3611992918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440c00be70 con 0x7f4414152d80 2023-10-06T02:18:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.578+0000 7f441259c700 1 --2- 172.21.15.6:0/3611992918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4414152d80 0x7f441414fe00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f440c007260 tx=0x7f440c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.580+0000 7f44027fc700 1 -- 172.21.15.6:0/3611992918 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c01d040 con 0x7f4414152d80 2023-10-06T02:18:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.580+0000 7f44027fc700 1 -- 172.21.15.6:0/3611992918 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c00de60 con 0x7f4414152d80 2023-10-06T02:18:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.580+0000 7f4418dfd700 1 -- 172.21.15.6:0/3611992918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441414f8e0 con 0x7f4414152d80 2023-10-06T02:18:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.580+0000 7f4418dfd700 1 -- 172.21.15.6:0/3611992918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44140c9590 con 0x7f4414152d80 2023-10-06T02:18:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.582+0000 7f44027fc700 1 -- 172.21.15.6:0/3611992918 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c018280 con 0x7f4414152d80 2023-10-06T02:18:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.582+0000 7f44027fc700 1 -- 172.21.15.6:0/3611992918 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f440c021630 con 0x7f4414152d80 2023-10-06T02:18:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.583+0000 7f44027fc700 1 --2- 172.21.15.6:0/3611992918 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f43f4078090 0x7f43f407a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.583+0000 7f4411d9b700 1 --2- 172.21.15.6:0/3611992918 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f43f4078090 0x7f43f407a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.584+0000 7f44027fc700 1 -- 172.21.15.6:0/3611992918 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f440c056cf0 con 0x7f4414152d80 2023-10-06T02:18:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.584+0000 7f4411d9b700 1 --2- 172.21.15.6:0/3611992918 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f43f4078090 0x7f43f407a540 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4414155e20 tx=0x7f4408009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.587+0000 7f1618ff9700 1 -- 172.21.15.6:0/1908505965 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610005b30 con 0x7f161c0ad080 2023-10-06T02:18:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.587+0000 7f1618ff9700 1 -- 172.21.15.6:0/1908505965 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1610005c90 con 0x7f161c0ad080 2023-10-06T02:18:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.587+0000 7f1618ff9700 1 -- 172.21.15.6:0/1908505965 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610007300 con 0x7f161c0ad080 2023-10-06T02:18:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.588+0000 7f1622d5d700 1 -- 172.21.15.6:0/1908505965 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161c15f6d0 con 0x7f161c0ad080 2023-10-06T02:18:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.588+0000 7f1622d5d700 1 -- 172.21.15.6:0/1908505965 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f161c178190 con 0x7f161c0ad080 2023-10-06T02:18:01.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.589+0000 7f1622d5d700 1 -- 172.21.15.6:0/1908505965 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f161c06fcb0 con 0x7f161c0ad080 2023-10-06T02:18:01.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.591+0000 7f4418dfd700 1 -- 172.21.15.6:0/3611992918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f80052b0 con 0x7f4414152d80 2023-10-06T02:18:01.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.591+0000 7f1618ff9700 1 -- 172.21.15.6:0/1908505965 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f161001b3b0 con 0x7f161c0ad080 2023-10-06T02:18:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.591+0000 7f1618ff9700 1 --2- 172.21.15.6:0/1908505965 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1608067080 0x7f1608069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.591+0000 7f1618ff9700 1 -- 172.21.15.6:0/1908505965 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1610083fb0 con 0x7f161c0ad080 2023-10-06T02:18:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.592+0000 7f1620af9700 1 --2- 172.21.15.6:0/1908505965 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1608067080 0x7f1608069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.600+0000 7f44027fc700 1 -- 172.21.15.6:0/3611992918 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f440c026080 con 0x7f4414152d80 2023-10-06T02:18:01.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.600+0000 7f1618ff9700 1 -- 172.21.15.6:0/1908505965 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1610054840 con 0x7f161c0ad080 2023-10-06T02:18:01.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.601+0000 7f1620af9700 1 --2- 172.21.15.6:0/1908505965 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1608067080 0x7f1608069530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f160c0093f0 tx=0x7f160c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.621+0000 7f7d7e94b700 1 Processor -- start 2023-10-06T02:18:01.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.621+0000 7f7d7e94b700 1 -- start start 2023-10-06T02:18:01.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.622+0000 7f7d7e94b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d78159590 0x7f7d78159a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.622+0000 7f7d7e94b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d780b00c0 con 0x7f7d78158da0 2023-10-06T02:18:01.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.622+0000 7f7d7e94b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7815a3c0 con 0x7f7d78159f40 2023-10-06T02:18:01.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.622+0000 7f7d7e94b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780af790 con 0x7f7d78159590 2023-10-06T02:18:01.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.623+0000 7f7d77fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7d78158da0 0x7f7d7806ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36110/0 (socket says 172.21.15.6:36110) 2023-10-06T02:18:01.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.623+0000 7f7d77fff700 1 -- 172.21.15.6:0/3081335196 learned_addr learned my addr 172.21.15.6:0/3081335196 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:01.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.624+0000 7f7d76ffd700 1 -- 172.21.15.6:0/3081335196 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027993614 0 0) 0x7f7d7815a3c0 con 0x7f7d78159f40 2023-10-06T02:18:01.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.624+0000 7f7d76ffd700 1 -- 172.21.15.6:0/3081335196 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d60003550 con 0x7f7d78159f40 2023-10-06T02:18:01.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.624+0000 7f7d76ffd700 1 -- 172.21.15.6:0/3081335196 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4291932241 0 0) 0x7f7d60003550 con 0x7f7d78159f40 2023-10-06T02:18:01.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.624+0000 7f7d76ffd700 1 -- 172.21.15.6:0/3081335196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d78159590 msgr2=0x7f7d78159a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:18:01.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.624+0000 7f7d76ffd700 1 --2- 172.21.15.6:0/3081335196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d78159590 0x7f7d78159a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.624+0000 7f7d76ffd700 1 -- 172.21.15.6:0/3081335196 >> v1:172.21.15.6:6789/0 conn(0x7f7d78158da0 legacy=0x7f7d7806ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.624+0000 7f7d76ffd700 1 -- 172.21.15.6:0/3081335196 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d780afa70 con 0x7f7d78159f40 2023-10-06T02:18:01.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.624+0000 7f7d76ffd700 1 -- 172.21.15.6:0/3081335196 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f7d6c001470 con 0x7f7d78159f40 2023-10-06T02:18:01.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.624+0000 7f7d76ffd700 1 -- 172.21.15.6:0/3081335196 >> v1:172.21.15.175:6789/0 conn(0x7f7d78159f40 legacy=0x7f7d780b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.624+0000 7f7d76ffd700 1 --2- 172.21.15.6:0/3081335196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d60003ca0 0x7f7d600065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.624+0000 7f7d76ffd700 1 --2- 172.21.15.6:0/3081335196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d60006af0 0x7f7d60008f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.624+0000 7f7d76ffd700 1 --2- 172.21.15.6:0/3081335196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d60009500 0x7f7d60009970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.624+0000 7f7d76ffd700 1 -- 172.21.15.6:0/3081335196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780af790 con 0x7f7d60009500 2023-10-06T02:18:01.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.624+0000 7f7d76ffd700 1 -- 172.21.15.6:0/3081335196 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6000a250 con 0x7f7d60006af0 2023-10-06T02:18:01.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.624+0000 7f7d76ffd700 1 -- 172.21.15.6:0/3081335196 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6000a410 con 0x7f7d60003ca0 2023-10-06T02:18:01.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.625+0000 7f7d77fff700 1 --2- 172.21.15.6:0/3081335196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d60003ca0 0x7f7d600065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.628+0000 7f7d77fff700 1 -- 172.21.15.6:0/3081335196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d60006af0 msgr2=0x7f7d60008f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:18:01.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.628+0000 7f7d77fff700 1 --2- 172.21.15.6:0/3081335196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d60006af0 0x7f7d60008f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.628+0000 7f7d77fff700 1 -- 172.21.15.6:0/3081335196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d60009500 msgr2=0x7f7d60009970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:01.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.628+0000 7f7d77fff700 1 --2- 172.21.15.6:0/3081335196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d60009500 0x7f7d60009970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.628+0000 7f7d77fff700 1 -- 172.21.15.6:0/3081335196 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d780afa70 con 0x7f7d60003ca0 2023-10-06T02:18:01.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.628+0000 7f7d77fff700 1 --2- 172.21.15.6:0/3081335196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d60003ca0 0x7f7d600065b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800ba60 tx=0x7f7d68004fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=353a56df3d523501 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.628+0000 7f7d76ffd700 1 -- 172.21.15.6:0/3081335196 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800bea0 con 0x7f7d60003ca0 2023-10-06T02:18:01.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.628+0000 7f7d76ffd700 1 -- 172.21.15.6:0/3081335196 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6800d7d0 con 0x7f7d60003ca0 2023-10-06T02:18:01.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.628+0000 7f7d76ffd700 1 -- 172.21.15.6:0/3081335196 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800db70 con 0x7f7d60003ca0 2023-10-06T02:18:01.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.627+0000 7f9c81469700 1 Processor -- start 2023-10-06T02:18:01.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.627+0000 7f9c81469700 1 -- start start 2023-10-06T02:18:01.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.628+0000 7f9c81469700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9c7c166310 0x7f9c7c1666e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.628+0000 7f9c81469700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c7c0ad250 0x7f9c7c06e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.628+0000 7f9c81469700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7c06f2c0 con 0x7f9c7c06e2b0 2023-10-06T02:18:01.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.628+0000 7f9c81469700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7c0af030 con 0x7f9c7c0ad250 2023-10-06T02:18:01.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.628+0000 7f9c81469700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7c166c20 con 0x7f9c7c166310 2023-10-06T02:18:01.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.628+0000 7f9c7affd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9c7c166310 0x7f9c7c1666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.629+0000 7f7d7e94b700 1 -- 172.21.15.6:0/3081335196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d60003ca0 msgr2=0x7f7d600065b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.629+0000 7f7d7e94b700 1 --2- 172.21.15.6:0/3081335196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d60003ca0 0x7f7d600065b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800ba60 tx=0x7f7d68004fb0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.629+0000 7f7d7cee8700 1 -- 172.21.15.6:0/3081335196 reap_dead start 2023-10-06T02:18:01.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.629+0000 7f7d7e94b700 1 -- 172.21.15.6:0/3081335196 shutdown_connections 2023-10-06T02:18:01.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.629+0000 7f7d7e94b700 1 -- 172.21.15.6:0/3081335196 >> 172.21.15.6:0/3081335196 conn(0x7f7d78069110 msgr2=0x7f7d780cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:01.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.629+0000 7f9c7affd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9c7c166310 0x7f9c7c1666e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:52390/0 (socket says 172.21.15.6:52390) 2023-10-06T02:18:01.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.629+0000 7f9c7affd700 1 -- 172.21.15.6:0/33532355 learned_addr learned my addr 172.21.15.6:0/33532355 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:01.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.629+0000 7f7d7e94b700 1 -- 172.21.15.6:0/3081335196 shutdown_connections 2023-10-06T02:18:01.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.629+0000 7f7d7e94b700 1 -- 172.21.15.6:0/3081335196 wait complete. 2023-10-06T02:18:01.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.630+0000 7f9c7b7fe700 1 --2- 172.21.15.6:0/33532355 >> v2:172.21.15.6:3300/0 conn(0x7f9c7c0ad250 0x7f9c7c06e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.630+0000 7f9c7b7fe700 1 -- 172.21.15.6:0/33532355 >> v2:172.21.15.175:3300/0 conn(0x7f9c7c166310 msgr2=0x7f9c7c1666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:01.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.630+0000 7f9c7b7fe700 1 --2- 172.21.15.6:0/33532355 >> v2:172.21.15.175:3300/0 conn(0x7f9c7c166310 0x7f9c7c1666e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.630+0000 7f9c7b7fe700 1 -- 172.21.15.6:0/33532355 >> v1:172.21.15.6:6789/0 conn(0x7f9c7c06e2b0 legacy=0x7f9c7c0acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.630+0000 7f9c7b7fe700 1 -- 172.21.15.6:0/33532355 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c06ed00 con 0x7f9c7c0ad250 2023-10-06T02:18:01.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.630+0000 7f9c7b7fe700 1 --2- 172.21.15.6:0/33532355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c0ad250 0x7f9c7c06e720 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c06d700 tx=0x7f9c7400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17397e69225a2a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.631+0000 7f7d7e94b700 1 Processor -- start 2023-10-06T02:18:01.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.631+0000 7f9c79ffb700 1 -- 172.21.15.6:0/33532355 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74010070 con 0x7f9c7c0ad250 2023-10-06T02:18:01.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.631+0000 7f9c79ffb700 1 -- 172.21.15.6:0/33532355 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7400da00 con 0x7f9c7c0ad250 2023-10-06T02:18:01.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.631+0000 7f9c79ffb700 1 -- 172.21.15.6:0/33532355 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400dda0 con 0x7f9c7c0ad250 2023-10-06T02:18:01.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.631+0000 7f7d7e94b700 1 -- start start 2023-10-06T02:18:01.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.632+0000 7f2bd02a9700 1 Processor -- start 2023-10-06T02:18:01.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.632+0000 7f2bd02a9700 1 -- start start 2023-10-06T02:18:01.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.632+0000 7f9c81469700 1 -- 172.21.15.6:0/33532355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c0ad250 msgr2=0x7f9c7c06e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.632+0000 7f9c81469700 1 --2- 172.21.15.6:0/33532355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c0ad250 0x7f9c7c06e720 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c06d700 tx=0x7f9c7400b990 comp rx=0 tx=0).stop 2023-10-06T02:18:01.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.632+0000 7f7d7e94b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d60003ca0 0x7f7d781418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.632+0000 7f7d7e94b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d780c5ed0 0x7f7d78157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.633+0000 7f7d7e94b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d78157bb0 0x7f7d780c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.633+0000 7f7d7e94b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78158050 con 0x7f7d78157bb0 2023-10-06T02:18:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.633+0000 7f7d7e94b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780c1530 con 0x7f7d780c5ed0 2023-10-06T02:18:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.633+0000 7f7d7e94b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780c2390 con 0x7f7d60003ca0 2023-10-06T02:18:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.634+0000 7f7d777fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d780c5ed0 0x7f7d78157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.634+0000 7f7d7cee8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d78157bb0 0x7f7d780c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.634+0000 7f7d7cee8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d78157bb0 0x7f7d780c3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54418/0 (socket says 172.21.15.6:54418) 2023-10-06T02:18:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.634+0000 7f7d7cee8700 1 -- 172.21.15.6:0/3969130697 learned_addr learned my addr 172.21.15.6:0/3969130697 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.634+0000 7f7d77fff700 1 --2- 172.21.15.6:0/3969130697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d60003ca0 0x7f7d781418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.632+0000 7f9c81469700 1 -- 172.21.15.6:0/33532355 shutdown_connections 2023-10-06T02:18:01.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.632+0000 7f9c81469700 1 --2- 172.21.15.6:0/33532355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c0ad250 0x7f9c7c06e720 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.632+0000 7f9c81469700 1 --2- 172.21.15.6:0/33532355 >> v2:172.21.15.175:3300/0 conn(0x7f9c7c166310 0x7f9c7c1666e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.632+0000 7f9c81469700 1 -- 172.21.15.6:0/33532355 >> 172.21.15.6:0/33532355 conn(0x7f9c7c069110 msgr2=0x7f9c7c0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:01.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.633+0000 7f9c81469700 1 -- 172.21.15.6:0/33532355 shutdown_connections 2023-10-06T02:18:01.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.633+0000 7f9c81469700 1 -- 172.21.15.6:0/33532355 wait complete. 2023-10-06T02:18:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.633+0000 7f2bd02a9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc80aa1a0 0x7f2bc806e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.633+0000 7f2bd02a9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc806e890 con 0x7f2bc815d4c0 2023-10-06T02:18:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.633+0000 7f2bd02a9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc806eb70 con 0x7f2bc80a9dd0 2023-10-06T02:18:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.633+0000 7f2bd02a9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc80c8250 con 0x7f2bc80aa1a0 2023-10-06T02:18:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.633+0000 7f2bcd844700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2bc815d4c0 0x7f2bc80c86a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36120/0 (socket says 172.21.15.6:36120) 2023-10-06T02:18:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.633+0000 7f2bcd844700 1 -- 172.21.15.6:0/4175945837 learned_addr learned my addr 172.21.15.6:0/4175945837 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.634+0000 7f2bce846700 1 --2- 172.21.15.6:0/4175945837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc80aa1a0 0x7f2bc806e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.634+0000 7f2bce846700 1 -- 172.21.15.6:0/4175945837 >> v1:172.21.15.175:6789/0 conn(0x7f2bc80a9dd0 legacy=0x7f2bc81592d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:18:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.634+0000 7f2bce846700 1 -- 172.21.15.6:0/4175945837 >> v1:172.21.15.6:6789/0 conn(0x7f2bc815d4c0 legacy=0x7f2bc80c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.634+0000 7f2bce846700 1 -- 172.21.15.6:0/4175945837 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc806ee50 con 0x7f2bc80aa1a0 2023-10-06T02:18:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f2bce846700 1 --2- 172.21.15.6:0/4175945837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc80aa1a0 0x7f2bc806e2b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0009e90 tx=0x7f2bc0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50bbd71c75611d26 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f7d7cee8700 1 -- 172.21.15.6:0/3969130697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d60003ca0 msgr2=0x7f7d781418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f7d7cee8700 1 --2- 172.21.15.6:0/3969130697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d60003ca0 0x7f7d781418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f7d7cee8700 1 -- 172.21.15.6:0/3969130697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d780c5ed0 msgr2=0x7f7d78157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f7d7cee8700 1 --2- 172.21.15.6:0/3969130697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d780c5ed0 0x7f7d78157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f7d7cee8700 1 -- 172.21.15.6:0/3969130697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d780c1780 con 0x7f7d78157bb0 2023-10-06T02:18:01.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f7d77fff700 1 --2- 172.21.15.6:0/3969130697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d60003ca0 0x7f7d781418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:01.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f7d7cee8700 1 --2- 172.21.15.6:0/3969130697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d78157bb0 0x7f7d780c3ee0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7d7815a310 tx=0x7f7d6c002c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f7d5ffff700 1 -- 172.21.15.6:0/3969130697 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c007360 con 0x7f7d78157bb0 2023-10-06T02:18:01.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f7d5ffff700 1 -- 172.21.15.6:0/3969130697 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c0074c0 con 0x7f7d78157bb0 2023-10-06T02:18:01.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f7d5ffff700 1 -- 172.21.15.6:0/3969130697 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c0048e0 con 0x7f7d78157bb0 2023-10-06T02:18:01.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f7d7e94b700 1 -- 172.21.15.6:0/3969130697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d780c1a60 con 0x7f7d78157bb0 2023-10-06T02:18:01.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.636+0000 7f7d7e94b700 1 -- 172.21.15.6:0/3969130697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d780c2020 con 0x7f7d78157bb0 2023-10-06T02:18:01.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.636+0000 7f2bcd043700 1 -- 172.21.15.6:0/4175945837 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc000e070 con 0x7f2bc80aa1a0 2023-10-06T02:18:01.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.637+0000 7f7d7e94b700 1 -- 172.21.15.6:0/3969130697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d78067f20 con 0x7f7d78157bb0 2023-10-06T02:18:01.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.636+0000 7f2bcd043700 1 -- 172.21.15.6:0/4175945837 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc000bb30 con 0x7f2bc80aa1a0 2023-10-06T02:18:01.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.636+0000 7f2bcd043700 1 -- 172.21.15.6:0/4175945837 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0012450 con 0x7f2bc80aa1a0 2023-10-06T02:18:01.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f9c81469700 1 Processor -- start 2023-10-06T02:18:01.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f9c81469700 1 -- start start 2023-10-06T02:18:01.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.637+0000 7f2bd02a9700 1 -- 172.21.15.6:0/4175945837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc80aa1a0 msgr2=0x7f2bc806e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.637+0000 7f2bd02a9700 1 --2- 172.21.15.6:0/4175945837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc80aa1a0 0x7f2bc806e2b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0009e90 tx=0x7f2bc0009780 comp rx=0 tx=0).stop 2023-10-06T02:18:01.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.636+0000 7f9c81469700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c7c06e2b0 0x7f9c7c157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.636+0000 7f9c81469700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c7c0ad250 0x7f9c7c1691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.636+0000 7f9c81469700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c166310 0x7f9c7c0a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.636+0000 7f9c81469700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c1581b0 con 0x7f9c7c166310 2023-10-06T02:18:01.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.636+0000 7f9c81469700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c1551e0 con 0x7f9c7c0ad250 2023-10-06T02:18:01.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.636+0000 7f9c81469700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c1671a0 con 0x7f9c7c06e2b0 2023-10-06T02:18:01.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.636+0000 7f9c7b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c166310 0x7f9c7c0a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.636+0000 7f9c7b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c166310 0x7f9c7c0a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54436/0 (socket says 172.21.15.6:54436) 2023-10-06T02:18:01.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.636+0000 7f9c7b7fe700 1 -- 172.21.15.6:0/2465585917 learned_addr learned my addr 172.21.15.6:0/2465585917 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:01.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.636+0000 7f9c7a7fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c7c0ad250 0x7f9c7c1691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.637+0000 7f9c7a7fc700 1 -- 172.21.15.6:0/2465585917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c7c06e2b0 msgr2=0x7f9c7c157c70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:18:01.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.637+0000 7f9c7a7fc700 1 --2- 172.21.15.6:0/2465585917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c7c06e2b0 0x7f9c7c157c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.637+0000 7f9c7a7fc700 1 -- 172.21.15.6:0/2465585917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c166310 msgr2=0x7f9c7c0a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.637+0000 7f9c7a7fc700 1 --2- 172.21.15.6:0/2465585917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c166310 0x7f9c7c0a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.637+0000 7f9c7a7fc700 1 -- 172.21.15.6:0/2465585917 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7400bc30 con 0x7f9c7c0ad250 2023-10-06T02:18:01.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.637+0000 7f9c7a7fc700 1 --2- 172.21.15.6:0/2465585917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c7c0ad250 0x7f9c7c1691b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c00c5c0 tx=0x7f9c6c007e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.637+0000 7f9c62ffd700 1 -- 172.21.15.6:0/2465585917 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c011590 con 0x7f9c7c0ad250 2023-10-06T02:18:01.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.637+0000 7f9c62ffd700 1 -- 172.21.15.6:0/2465585917 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c011710 con 0x7f9c7c0ad250 2023-10-06T02:18:01.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.637+0000 7f9c62ffd700 1 -- 172.21.15.6:0/2465585917 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c011ad0 con 0x7f9c7c0ad250 2023-10-06T02:18:01.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.637+0000 7f9c81469700 1 -- 172.21.15.6:0/2465585917 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7c0a5770 con 0x7f9c7c0ad250 2023-10-06T02:18:01.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.637+0000 7f9c81469700 1 -- 172.21.15.6:0/2465585917 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7c0a5490 con 0x7f9c7c0ad250 2023-10-06T02:18:01.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.632+0000 7f6e7ffc2700 1 Processor -- start 2023-10-06T02:18:01.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.633+0000 7f6e7ffc2700 1 -- start start 2023-10-06T02:18:01.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.634+0000 7f6e7ffc2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6e781666e0 0x7f6e780acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.634+0000 7f6e7ffc2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6e780ad080 0x7f6e780c8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.634+0000 7f6e7ffc2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e780ad4b0 con 0x7f6e78166310 2023-10-06T02:18:01.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.634+0000 7f6e7ffc2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e780af030 con 0x7f6e781666e0 2023-10-06T02:18:01.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.634+0000 7f6e7ffc2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e7806f2c0 con 0x7f6e780ad080 2023-10-06T02:18:01.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.634+0000 7f6e7d55d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6e781666e0 0x7f6e780acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f6e7d55d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6e781666e0 0x7f6e780acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54428/0 (socket says 172.21.15.6:54428) 2023-10-06T02:18:01.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f6e7d55d700 1 -- 172.21.15.6:0/1335651036 learned_addr learned my addr 172.21.15.6:0/1335651036 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:01.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f6e7cd5c700 1 -- 172.21.15.6:0/1335651036 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323719970 0 0) 0x7f6e780ad4b0 con 0x7f6e78166310 2023-10-06T02:18:01.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.638+0000 7f6e7cd5c700 1 -- 172.21.15.6:0/1335651036 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e68003490 con 0x7f6e78166310 2023-10-06T02:18:01.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.638+0000 7f2bd02a9700 1 -- 172.21.15.6:0/4175945837 shutdown_connections 2023-10-06T02:18:01.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.638+0000 7f2bd02a9700 1 --2- 172.21.15.6:0/4175945837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc80aa1a0 0x7f2bc806e2b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.638+0000 7f2bd02a9700 1 -- 172.21.15.6:0/4175945837 >> 172.21.15.6:0/4175945837 conn(0x7f2bc8069110 msgr2=0x7f2bc80cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.639+0000 7f7d5ffff700 1 -- 172.21.15.6:0/3969130697 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d6c004c90 con 0x7f7d78157bb0 2023-10-06T02:18:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.639+0000 7f2bd02a9700 1 -- 172.21.15.6:0/4175945837 shutdown_connections 2023-10-06T02:18:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.639+0000 7f7d5ffff700 1 --2- 172.21.15.6:0/3969130697 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d60079ae0 0x7f7d6007bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.639+0000 7f9c62ffd700 1 -- 172.21.15.6:0/2465585917 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c6c01b3b0 con 0x7f9c7c0ad250 2023-10-06T02:18:01.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.640+0000 7ff4fbd66700 1 Processor -- start 2023-10-06T02:18:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.639+0000 7f7d5ffff700 1 -- 172.21.15.6:0/3969130697 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7d6c083ee0 con 0x7f7d78157bb0 2023-10-06T02:18:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.640+0000 7f7d77fff700 1 --2- 172.21.15.6:0/3969130697 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d60079ae0 0x7f7d6007bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.640+0000 7f9c62ffd700 1 --2- 172.21.15.6:0/2465585917 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c68066f30 0x7f9c680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.640+0000 7f9c62ffd700 1 -- 172.21.15.6:0/2465585917 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9c6c083db0 con 0x7f9c7c0ad250 2023-10-06T02:18:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.640+0000 7f7d77fff700 1 --2- 172.21.15.6:0/3969130697 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d60079ae0 0x7f7d6007bf90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7d68004ff0 tx=0x7f7d68019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.635+0000 7f6e7e55f700 1 --2- 172.21.15.6:0/1335651036 >> v2:172.21.15.175:3300/0 conn(0x7f6e780ad080 0x7f6e780c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.641+0000 7f6e7d55d700 1 -- 172.21.15.6:0/1335651036 >> v2:172.21.15.175:3300/0 conn(0x7f6e780ad080 msgr2=0x7f6e780c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.641+0000 7f6e7d55d700 1 --2- 172.21.15.6:0/1335651036 >> v2:172.21.15.175:3300/0 conn(0x7f6e780ad080 0x7f6e780c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.641+0000 7f6e7d55d700 1 -- 172.21.15.6:0/1335651036 >> v1:172.21.15.6:6789/0 conn(0x7f6e78166310 legacy=0x7f6e7806e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.641+0000 7f6e7d55d700 1 -- 172.21.15.6:0/1335651036 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7806ed00 con 0x7f6e781666e0 2023-10-06T02:18:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.641+0000 7f6e7e55f700 1 --2- 172.21.15.6:0/1335651036 >> v2:172.21.15.175:3300/0 conn(0x7f6e780ad080 0x7f6e780c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.641+0000 7f6e7d55d700 1 --2- 172.21.15.6:0/1335651036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e781666e0 0x7f6e780acb40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6e78069550 tx=0x7f6e64007230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267b1fd120dfd02f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.640+0000 7ff4fbd66700 1 -- start start 2023-10-06T02:18:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.641+0000 7ff4fbd66700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4f4158da0 0x7ff4f406ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.641+0000 7ff4fbd66700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f40b00c0 con 0x7ff4f40c9480 2023-10-06T02:18:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.641+0000 7ff4fbd66700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f40af790 con 0x7ff4f40c8900 2023-10-06T02:18:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.641+0000 7ff4fbd66700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40afa70 con 0x7ff4f4158da0 2023-10-06T02:18:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.641+0000 7ff4fa303700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff4f40c9480 0x7ff4f40b0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36142/0 (socket says 172.21.15.6:36142) 2023-10-06T02:18:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.641+0000 7ff4fa303700 1 -- 172.21.15.6:0/2753272583 learned_addr learned my addr 172.21.15.6:0/2753272583 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.641+0000 7ff4f9b02700 1 --2- 172.21.15.6:0/2753272583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4f4158da0 0x7ff4f406ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.640+0000 7f2bd02a9700 1 -- 172.21.15.6:0/4175945837 wait complete. 2023-10-06T02:18:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.641+0000 7f2bd02a9700 1 Processor -- start 2023-10-06T02:18:01.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.642+0000 7f9c7affd700 1 --2- 172.21.15.6:0/2465585917 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c68066f30 0x7f9c680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.642+0000 7ff4f9b02700 1 -- 172.21.15.6:0/2753272583 >> v1:172.21.15.175:6789/0 conn(0x7ff4f40c8900 legacy=0x7ff4f40c8d70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:18:01.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.642+0000 7ff4f9b02700 1 -- 172.21.15.6:0/2753272583 >> v1:172.21.15.6:6789/0 conn(0x7ff4f40c9480 legacy=0x7ff4f40b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.642+0000 7ff4f9b02700 1 -- 172.21.15.6:0/2753272583 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f40afd50 con 0x7ff4f4158da0 2023-10-06T02:18:01.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.642+0000 7ff4f9b02700 1 --2- 172.21.15.6:0/2753272583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4f4158da0 0x7ff4f406ec70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009f60 tx=0x7ff4f0009a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e855a5b8fcba0be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.642+0000 7f9c7affd700 1 --2- 172.21.15.6:0/2465585917 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c68066f30 0x7f9c680693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0cae00 tx=0x7f9c7000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.642+0000 7ff4f8b00700 1 -- 172.21.15.6:0/2753272583 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f000f750 con 0x7ff4f4158da0 2023-10-06T02:18:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.642+0000 7ff4f8b00700 1 -- 172.21.15.6:0/2753272583 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f000f8b0 con 0x7ff4f4158da0 2023-10-06T02:18:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.642+0000 7ff4f8b00700 1 -- 172.21.15.6:0/2753272583 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f000fc50 con 0x7ff4f4158da0 2023-10-06T02:18:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.642+0000 7f2bd02a9700 1 -- start start 2023-10-06T02:18:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.643+0000 7f2bd02a9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bc80a9dd0 0x7f2bc81771f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.643+0000 7f2bd02a9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc80aa1a0 0x7f2bc8178320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.643+0000 7f2bd02a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc815d4c0 0x7f2bc81513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.643+0000 7f2bd02a9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc80caa10 con 0x7f2bc815d4c0 2023-10-06T02:18:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.643+0000 7ff4fbd66700 1 -- 172.21.15.6:0/2753272583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4f4158da0 msgr2=0x7ff4f406ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.643+0000 7ff4fbd66700 1 --2- 172.21.15.6:0/2753272583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4f4158da0 0x7ff4f406ec70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009f60 tx=0x7ff4f0009a30 comp rx=0 tx=0).stop 2023-10-06T02:18:01.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.643+0000 7f2bd02a9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc8177730 con 0x7f2bc80a9dd0 2023-10-06T02:18:01.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.643+0000 7f2bd02a9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc80c9e00 con 0x7f2bc80aa1a0 2023-10-06T02:18:01.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.643+0000 7ff4fbd66700 1 -- 172.21.15.6:0/2753272583 shutdown_connections 2023-10-06T02:18:01.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.643+0000 7ff4fbd66700 1 --2- 172.21.15.6:0/2753272583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4f4158da0 0x7ff4f406ec70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.643+0000 7ff4fbd66700 1 -- 172.21.15.6:0/2753272583 >> 172.21.15.6:0/2753272583 conn(0x7ff4f4069110 msgr2=0x7ff4f40cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:01.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.643+0000 7f2bce846700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc815d4c0 0x7f2bc81513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.643+0000 7f2bce846700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc815d4c0 0x7f2bc81513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54444/0 (socket says 172.21.15.6:54444) 2023-10-06T02:18:01.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.643+0000 7f2bce846700 1 -- 172.21.15.6:0/3367531057 learned_addr learned my addr 172.21.15.6:0/3367531057 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:01.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.643+0000 7f2bce045700 1 --2- 172.21.15.6:0/3367531057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bc80a9dd0 0x7f2bc81771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.643+0000 7f2bcd844700 1 --2- 172.21.15.6:0/3367531057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc80aa1a0 0x7f2bc8178320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.644+0000 7f2bcd844700 1 -- 172.21.15.6:0/3367531057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bc80a9dd0 msgr2=0x7f2bc81771f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.644+0000 7f2bcd844700 1 --2- 172.21.15.6:0/3367531057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bc80a9dd0 0x7f2bc81771f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.644+0000 7f2bcd844700 1 -- 172.21.15.6:0/3367531057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc815d4c0 msgr2=0x7f2bc81513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.644+0000 7f2bcd844700 1 --2- 172.21.15.6:0/3367531057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc815d4c0 0x7f2bc81513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.644+0000 7f2bcd844700 1 -- 172.21.15.6:0/3367531057 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc0009a20 con 0x7f2bc80aa1a0 2023-10-06T02:18:01.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.644+0000 7f2bce045700 1 --2- 172.21.15.6:0/3367531057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bc80a9dd0 0x7f2bc81771f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:01.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.644+0000 7f2bce846700 1 --2- 172.21.15.6:0/3367531057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc815d4c0 0x7f2bc81513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:01.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.644+0000 7f2bcd844700 1 --2- 172.21.15.6:0/3367531057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc80aa1a0 0x7f2bc8178320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400c5b0 tx=0x7f2bc4007e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.644+0000 7f2bbe7fc700 1 -- 172.21.15.6:0/3367531057 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc400f040 con 0x7f2bc80aa1a0 2023-10-06T02:18:01.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.644+0000 7f2bbe7fc700 1 -- 172.21.15.6:0/3367531057 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc4007360 con 0x7f2bc80aa1a0 2023-10-06T02:18:01.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.644+0000 7f2bd02a9700 1 -- 172.21.15.6:0/3367531057 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc80ca0e0 con 0x7f2bc80aa1a0 2023-10-06T02:18:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.644+0000 7f2bd02a9700 1 -- 172.21.15.6:0/3367531057 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc80ca6a0 con 0x7f2bc80aa1a0 2023-10-06T02:18:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.644+0000 7f2bbe7fc700 1 -- 172.21.15.6:0/3367531057 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4007700 con 0x7f2bc80aa1a0 2023-10-06T02:18:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.645+0000 7f9c81469700 1 -- 172.21.15.6:0/2465585917 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7c06fcb0 con 0x7f9c7c0ad250 2023-10-06T02:18:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.646+0000 7f2bd02a9700 1 -- 172.21.15.6:0/3367531057 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb00052b0 con 0x7f2bc80aa1a0 2023-10-06T02:18:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.646+0000 7f2bbe7fc700 1 -- 172.21.15.6:0/3367531057 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2bc4004a40 con 0x7f2bc80aa1a0 2023-10-06T02:18:01.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.646+0000 7f6e7cd5c700 1 -- 172.21.15.6:0/1335651036 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64009030 con 0x7f6e781666e0 2023-10-06T02:18:01.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.646+0000 7f6e7cd5c700 1 -- 172.21.15.6:0/1335651036 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e64009190 con 0x7f6e781666e0 2023-10-06T02:18:01.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.646+0000 7f6e7cd5c700 1 -- 172.21.15.6:0/1335651036 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6400ba00 con 0x7f6e781666e0 2023-10-06T02:18:01.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.646+0000 7f2bbe7fc700 1 --2- 172.21.15.6:0/3367531057 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2bac066f30 0x7f2bac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.647+0000 7f7d5ffff700 1 -- 172.21.15.6:0/3969130697 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d6c050e60 con 0x7f7d78157bb0 2023-10-06T02:18:01.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.647+0000 7f2bbe7fc700 1 -- 172.21.15.6:0/3367531057 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2bc4084130 con 0x7f2bc80aa1a0 2023-10-06T02:18:01.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.647+0000 7f2bce045700 1 --2- 172.21.15.6:0/3367531057 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2bac066f30 0x7f2bac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.647+0000 7ff4fbd66700 1 -- 172.21.15.6:0/2753272583 shutdown_connections 2023-10-06T02:18:01.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.647+0000 7f6e7ffc2700 1 -- 172.21.15.6:0/1335651036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e781666e0 msgr2=0x7f6e780acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.647+0000 7f6e7ffc2700 1 --2- 172.21.15.6:0/1335651036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e781666e0 0x7f6e780acb40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6e78069550 tx=0x7f6e64007230 comp rx=0 tx=0).stop 2023-10-06T02:18:01.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.647+0000 7f6e7ffc2700 1 -- 172.21.15.6:0/1335651036 shutdown_connections 2023-10-06T02:18:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.647+0000 7f6e7ffc2700 1 --2- 172.21.15.6:0/1335651036 >> v2:172.21.15.175:3300/0 conn(0x7f6e780ad080 0x7f6e780c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.647+0000 7f6e7ffc2700 1 --2- 172.21.15.6:0/1335651036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e781666e0 0x7f6e780acb40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.647+0000 7f6e7ffc2700 1 -- 172.21.15.6:0/1335651036 >> 172.21.15.6:0/1335651036 conn(0x7f6e78069110 msgr2=0x7f6e780cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.647+0000 7ff4fbd66700 1 -- 172.21.15.6:0/2753272583 wait complete. 2023-10-06T02:18:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.649+0000 7f2bce045700 1 --2- 172.21.15.6:0/3367531057 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2bac066f30 0x7f2bac0693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8006fd0 tx=0x7f2bb80090f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.649+0000 7ff4fbd66700 1 Processor -- start 2023-10-06T02:18:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.649+0000 7ff4fbd66700 1 -- start start 2023-10-06T02:18:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.650+0000 7ff4fbd66700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f40c9480 0x7ff4f4157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.650+0000 7ff4fbd66700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4f4158da0 0x7ff4f414aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.650+0000 7ff4fbd66700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4f414af70 0x7ff4f4176300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.650+0000 7ff4fbd66700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f4156eb0 con 0x7ff4f40c9480 2023-10-06T02:18:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.650+0000 7ff4fbd66700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f414b3f0 con 0x7ff4f414af70 2023-10-06T02:18:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.650+0000 7ff4fbd66700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f4146420 con 0x7ff4f4158da0 2023-10-06T02:18:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.650+0000 7ff4f9b02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f40c9480 0x7ff4f4157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.651+0000 7ff4f9b02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f40c9480 0x7ff4f4157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54460/0 (socket says 172.21.15.6:54460) 2023-10-06T02:18:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.651+0000 7ff4f9b02700 1 -- 172.21.15.6:0/169181371 learned_addr learned my addr 172.21.15.6:0/169181371 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:01.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.651+0000 7f9c62ffd700 1 -- 172.21.15.6:0/2465585917 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c6c017020 con 0x7f9c7c0ad250 2023-10-06T02:18:01.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.651+0000 7ff4fa303700 1 --2- 172.21.15.6:0/169181371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4f414af70 0x7ff4f4176300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.651+0000 7f2bbe7fc700 1 -- 172.21.15.6:0/3367531057 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2bc4050fb0 con 0x7f2bc80aa1a0 2023-10-06T02:18:01.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.652+0000 7f6e7ffc2700 1 -- 172.21.15.6:0/1335651036 shutdown_connections 2023-10-06T02:18:01.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.657+0000 7f6e7ffc2700 1 -- 172.21.15.6:0/1335651036 wait complete. 2023-10-06T02:18:01.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.658+0000 7f6e7ffc2700 1 Processor -- start 2023-10-06T02:18:01.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.651+0000 7ff4f9b02700 1 -- 172.21.15.6:0/169181371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4f4158da0 msgr2=0x7ff4f414aa30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:18:01.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.651+0000 7ff4f9b02700 1 --2- 172.21.15.6:0/169181371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4f4158da0 0x7ff4f414aa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.651+0000 7ff4f9b02700 1 -- 172.21.15.6:0/169181371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4f414af70 msgr2=0x7ff4f4176300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.651+0000 7ff4f9b02700 1 --2- 172.21.15.6:0/169181371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4f414af70 0x7ff4f4176300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.651+0000 7ff4f9b02700 1 -- 172.21.15.6:0/169181371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0009cb0 con 0x7ff4f40c9480 2023-10-06T02:18:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.651+0000 7ff4f9b02700 1 --2- 172.21.15.6:0/169181371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f40c9480 0x7ff4f4157650 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00030c0 tx=0x7ff4f0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.651+0000 7ff4e9ffb700 1 -- 172.21.15.6:0/169181371 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f001f410 con 0x7ff4f40c9480 2023-10-06T02:18:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.652+0000 7ff4e9ffb700 1 -- 172.21.15.6:0/169181371 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f001f570 con 0x7ff4f40c9480 2023-10-06T02:18:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.652+0000 7ff4e9ffb700 1 -- 172.21.15.6:0/169181371 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f001f930 con 0x7ff4f40c9480 2023-10-06T02:18:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.652+0000 7ff4fbd66700 1 -- 172.21.15.6:0/169181371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f41469e0 con 0x7ff4f40c9480 2023-10-06T02:18:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.652+0000 7ff4fbd66700 1 -- 172.21.15.6:0/169181371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f414b8f0 con 0x7ff4f40c9480 2023-10-06T02:18:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.654+0000 7ff4e9ffb700 1 -- 172.21.15.6:0/169181371 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4f001fd20 con 0x7ff4f40c9480 2023-10-06T02:18:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.654+0000 7ff4e9ffb700 1 --2- 172.21.15.6:0/169181371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff4d8066f30 0x7ff4d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.654+0000 7ff4e9ffb700 1 -- 172.21.15.6:0/169181371 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff4f0013070 con 0x7ff4f40c9480 2023-10-06T02:18:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.655+0000 7ff4fbd66700 1 -- 172.21.15.6:0/169181371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f406fcb0 con 0x7ff4f40c9480 2023-10-06T02:18:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.655+0000 7ff4f9301700 1 --2- 172.21.15.6:0/169181371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff4d8066f30 0x7ff4d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.655+0000 7ff4f9301700 1 --2- 172.21.15.6:0/169181371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff4d8066f30 0x7ff4d80693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff4f417a420 tx=0x7ff4e4006c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.659+0000 7f6e7ffc2700 1 -- start start 2023-10-06T02:18:01.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.660+0000 7f6e7ffc2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e780ad080 0x7f6e7817faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.660+0000 7f6e7ffc2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e78166310 0x7f6e7815e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.660+0000 7f6e7ffc2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e781666e0 0x7f6e780cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.660+0000 7f6e7ffc2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e781800b0 con 0x7f6e781666e0 2023-10-06T02:18:01.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.660+0000 7f6e7ffc2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78180390 con 0x7f6e780ad080 2023-10-06T02:18:01.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.660+0000 7f6e7ffc2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78180670 con 0x7f6e78166310 2023-10-06T02:18:01.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.660+0000 7f6e7dd5e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e780ad080 0x7f6e7817faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.660+0000 7f6e7dd5e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e780ad080 0x7f6e7817faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:52444/0 (socket says 172.21.15.6:52444) 2023-10-06T02:18:01.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.660+0000 7f6e7dd5e700 1 -- 172.21.15.6:0/134926602 learned_addr learned my addr 172.21.15.6:0/134926602 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:01.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.661+0000 7f6e7d55d700 1 --2- 172.21.15.6:0/134926602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e78166310 0x7f6e7815e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.661+0000 7f6e7d55d700 1 -- 172.21.15.6:0/134926602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e780ad080 msgr2=0x7f6e7817faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.661+0000 7f6e7d55d700 1 --2- 172.21.15.6:0/134926602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e780ad080 0x7f6e7817faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.661+0000 7f6e7d55d700 1 -- 172.21.15.6:0/134926602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e781666e0 msgr2=0x7f6e780cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.661+0000 7f6e7d55d700 1 --2- 172.21.15.6:0/134926602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e781666e0 0x7f6e780cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.661+0000 7f6e7d55d700 1 -- 172.21.15.6:0/134926602 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e64009580 con 0x7f6e78166310 2023-10-06T02:18:01.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.661+0000 7ff4e9ffb700 1 -- 172.21.15.6:0/169181371 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4f0053300 con 0x7ff4f40c9480 2023-10-06T02:18:01.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.667+0000 7f6e7d55d700 1 --2- 172.21.15.6:0/134926602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e78166310 0x7f6e7815e1c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e7806d700 tx=0x7f6e64018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.667+0000 7f6e75ffb700 1 -- 172.21.15.6:0/134926602 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64000bc0 con 0x7f6e78166310 2023-10-06T02:18:01.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.667+0000 7f6e75ffb700 1 -- 172.21.15.6:0/134926602 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6400b7d0 con 0x7f6e78166310 2023-10-06T02:18:01.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.667+0000 7f6e75ffb700 1 -- 172.21.15.6:0/134926602 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64025470 con 0x7f6e78166310 2023-10-06T02:18:01.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.667+0000 7f6e7ffc2700 1 -- 172.21.15.6:0/134926602 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e78180950 con 0x7f6e78166310 2023-10-06T02:18:01.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.667+0000 7f6e7ffc2700 1 -- 172.21.15.6:0/134926602 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7815e700 con 0x7f6e78166310 2023-10-06T02:18:01.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.670+0000 7f6e75ffb700 1 -- 172.21.15.6:0/134926602 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e64022070 con 0x7f6e78166310 2023-10-06T02:18:01.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.670+0000 7f6e75ffb700 1 --2- 172.21.15.6:0/134926602 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e5c067080 0x7f6e5c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:01.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.671+0000 7f6e75ffb700 1 -- 172.21.15.6:0/134926602 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6e64086ae0 con 0x7f6e78166310 2023-10-06T02:18:01.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.671+0000 7f6e7dd5e700 1 --2- 172.21.15.6:0/134926602 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e5c067080 0x7f6e5c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:01.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.671+0000 7f6e7dd5e700 1 --2- 172.21.15.6:0/134926602 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e5c067080 0x7f6e5c069530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c007fd0 tx=0x7f6e6c002780 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:01.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.687+0000 7f6e7ffc2700 1 -- 172.21.15.6:0/134926602 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e580052b0 con 0x7f6e78166310 2023-10-06T02:18:01.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.692+0000 7f6e75ffb700 1 -- 172.21.15.6:0/134926602 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e640539a0 con 0x7f6e78166310 2023-10-06T02:18:01.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.952+0000 7ff2318bd700 1 -- 172.21.15.6:0/2656094115 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff22c0af460 con 0x7ff22c0c8900 2023-10-06T02:18:01.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.953+0000 7ff212ffd700 1 -- 172.21.15.6:0/2656094115 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff21c052e40 con 0x7ff22c0c8900 2023-10-06T02:18:01.959 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-10-06T02:18:01.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.960+0000 7ff2318bd700 1 -- 172.21.15.6:0/2656094115 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff218066f30 msgr2=0x7ff2180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.961+0000 7ff2318bd700 1 --2- 172.21.15.6:0/2656094115 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff218066f30 0x7ff2180693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff220009c10 tx=0x7ff220000f90 comp rx=0 tx=0).stop 2023-10-06T02:18:01.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.961+0000 7ff2318bd700 1 -- 172.21.15.6:0/2656094115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff22c0c8900 msgr2=0x7ff22c14abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:01.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.961+0000 7ff2318bd700 1 --2- 172.21.15.6:0/2656094115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff22c0c8900 0x7ff22c14abf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff21c017000 tx=0x7ff21c018000 comp rx=0 tx=0).stop 2023-10-06T02:18:01.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.968+0000 7ff2318bd700 1 -- 172.21.15.6:0/2656094115 shutdown_connections 2023-10-06T02:18:01.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.968+0000 7ff2318bd700 1 --2- 172.21.15.6:0/2656094115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff22c158da0 0x7ff22c1506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.968+0000 7ff2318bd700 1 --2- 172.21.15.6:0/2656094115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff22c0c8900 0x7ff22c14abf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.968+0000 7ff2318bd700 1 --2- 172.21.15.6:0/2656094115 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff218066f30 0x7ff2180693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.968+0000 7ff2318bd700 1 --2- 172.21.15.6:0/2656094115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff22c0c9480 0x7ff22c14a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.968+0000 7ff2318bd700 1 -- 172.21.15.6:0/2656094115 >> 172.21.15.6:0/2656094115 conn(0x7ff22c069110 msgr2=0x7ff22c06ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.968+0000 7ff2318bd700 1 -- 172.21.15.6:0/2656094115 shutdown_connections 2023-10-06T02:18:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.968+0000 7ff2318bd700 1 -- 172.21.15.6:0/2656094115 wait complete. 2023-10-06T02:18:01.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-10-06T02:18:01.988 DEBUG:teuthology.parallel:result is None 2023-10-06T02:18:01.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.995+0000 7f1622d5d700 1 -- 172.21.15.6:0/1908505965 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f161c15f530 con 0x7f161c0ad080 2023-10-06T02:18:01.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.995+0000 7f1618ff9700 1 -- 172.21.15.6:0/1908505965 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f161c15f530 con 0x7f161c0ad080 2023-10-06T02:18:01.997 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-10-06T02:18:02.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.998+0000 7f1622d5d700 1 -- 172.21.15.6:0/1908505965 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1608067080 msgr2=0x7f1608069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.998+0000 7f1622d5d700 1 --2- 172.21.15.6:0/1908505965 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1608067080 0x7f1608069530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f160c0093f0 tx=0x7f160c017000 comp rx=0 tx=0).stop 2023-10-06T02:18:02.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.998+0000 7f1622d5d700 1 -- 172.21.15.6:0/1908505965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f161c0ad080 msgr2=0x7f161c177310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.998+0000 7f1622d5d700 1 --2- 172.21.15.6:0/1908505965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f161c0ad080 0x7f161c177310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f161000c790 tx=0x7f1610007ea0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.998+0000 7f1622d5d700 1 -- 172.21.15.6:0/1908505965 shutdown_connections 2023-10-06T02:18:02.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.998+0000 7f1622d5d700 1 --2- 172.21.15.6:0/1908505965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f161c15b930 0x7f161c15e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.998+0000 7f1622d5d700 1 --2- 172.21.15.6:0/1908505965 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1608067080 0x7f1608069530 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.998+0000 7f1622d5d700 1 --2- 172.21.15.6:0/1908505965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f161c06e9c0 0x7f161c177c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.998+0000 7f1622d5d700 1 --2- 172.21.15.6:0/1908505965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f161c0ad080 0x7f161c177310 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.998+0000 7f1622d5d700 1 -- 172.21.15.6:0/1908505965 >> 172.21.15.6:0/1908505965 conn(0x7f161c069110 msgr2=0x7f161c0cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:02.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.999+0000 7f1622d5d700 1 -- 172.21.15.6:0/1908505965 shutdown_connections 2023-10-06T02:18:02.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:01.999+0000 7f1622d5d700 1 -- 172.21.15.6:0/1908505965 wait complete. 2023-10-06T02:18:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.000+0000 7f4418dfd700 1 -- 172.21.15.6:0/3611992918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f43f8005830 con 0x7f4414152d80 2023-10-06T02:18:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.001+0000 7f44027fc700 1 -- 172.21.15.6:0/3611992918 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f440c052930 con 0x7f4414152d80 2023-10-06T02:18:02.003 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-06T02:18:02.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.005+0000 7f4418dfd700 1 -- 172.21.15.6:0/3611992918 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f43f4078090 msgr2=0x7f43f407a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.005+0000 7f4418dfd700 1 --2- 172.21.15.6:0/3611992918 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f43f4078090 0x7f43f407a540 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4414155e20 tx=0x7f4408009060 comp rx=0 tx=0).stop 2023-10-06T02:18:02.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.005+0000 7f4418dfd700 1 -- 172.21.15.6:0/3611992918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4414152d80 msgr2=0x7f441414fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.005+0000 7f4418dfd700 1 --2- 172.21.15.6:0/3611992918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4414152d80 0x7f441414fe00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f440c007260 tx=0x7f440c01b000 comp rx=0 tx=0).stop 2023-10-06T02:18:02.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.013+0000 7f4418dfd700 1 -- 172.21.15.6:0/3611992918 shutdown_connections 2023-10-06T02:18:02.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.014+0000 7f4418dfd700 1 --2- 172.21.15.6:0/3611992918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44141559d0 0x7f4414171a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.014+0000 7f4418dfd700 1 --2- 172.21.15.6:0/3611992918 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f43f4078090 0x7f43f407a540 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.014+0000 7f4418dfd700 1 --2- 172.21.15.6:0/3611992918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4414152d80 0x7f441414fe00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.014+0000 7f4418dfd700 1 --2- 172.21.15.6:0/3611992918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4414153150 0x7f44140c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.014+0000 7f4418dfd700 1 -- 172.21.15.6:0/3611992918 >> 172.21.15.6:0/3611992918 conn(0x7f441406b230 msgr2=0x7f44140b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:02.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.014+0000 7f4418dfd700 1 -- 172.21.15.6:0/3611992918 shutdown_connections 2023-10-06T02:18:02.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.014+0000 7f4418dfd700 1 -- 172.21.15.6:0/3611992918 wait complete. 2023-10-06T02:18:02.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2023-10-06T02:18:02.019 DEBUG:teuthology.parallel:result is None 2023-10-06T02:18:02.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-06T02:18:02.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.032+0000 7f7d7e94b700 1 -- 172.21.15.6:0/3969130697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7d58005160 con 0x7f7d78157bb0 2023-10-06T02:18:02.033 DEBUG:teuthology.parallel:result is None 2023-10-06T02:18:02.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.032+0000 7f7d5ffff700 1 -- 172.21.15.6:0/3969130697 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d6c083070 con 0x7f7d78157bb0 2023-10-06T02:18:02.034 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-10-06T02:18:02.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.034+0000 7f7d7e94b700 1 -- 172.21.15.6:0/3969130697 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d60079ae0 msgr2=0x7f7d6007bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.034+0000 7f7d7e94b700 1 --2- 172.21.15.6:0/3969130697 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d60079ae0 0x7f7d6007bf90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7d68004ff0 tx=0x7f7d68019000 comp rx=0 tx=0).stop 2023-10-06T02:18:02.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.034+0000 7f7d7e94b700 1 -- 172.21.15.6:0/3969130697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d78157bb0 msgr2=0x7f7d780c3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.034+0000 7f7d7e94b700 1 --2- 172.21.15.6:0/3969130697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d78157bb0 0x7f7d780c3ee0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7d7815a310 tx=0x7f7d6c002c00 comp rx=0 tx=0).stop 2023-10-06T02:18:02.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.035+0000 7f7d7e94b700 1 -- 172.21.15.6:0/3969130697 shutdown_connections 2023-10-06T02:18:02.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.035+0000 7f7d7e94b700 1 --2- 172.21.15.6:0/3969130697 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d60079ae0 0x7f7d6007bf90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.035+0000 7f7d7e94b700 1 --2- 172.21.15.6:0/3969130697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d78157bb0 0x7f7d780c3ee0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.035+0000 7f7d7e94b700 1 --2- 172.21.15.6:0/3969130697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d60003ca0 0x7f7d781418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.035+0000 7f7d7e94b700 1 --2- 172.21.15.6:0/3969130697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d780c5ed0 0x7f7d78157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.035+0000 7f7d7e94b700 1 -- 172.21.15.6:0/3969130697 >> 172.21.15.6:0/3969130697 conn(0x7f7d78069110 msgr2=0x7f7d780cb950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:02.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.035+0000 7f7d7e94b700 1 -- 172.21.15.6:0/3969130697 shutdown_connections 2023-10-06T02:18:02.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.035+0000 7f7d7e94b700 1 -- 172.21.15.6:0/3969130697 wait complete. 2023-10-06T02:18:02.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.041+0000 7f9c81469700 1 -- 172.21.15.6:0/2465585917 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9c7c167310 con 0x7f9c7c0ad250 2023-10-06T02:18:02.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.042+0000 7f9c62ffd700 1 -- 172.21.15.6:0/2465585917 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c6c050bd0 con 0x7f9c7c0ad250 2023-10-06T02:18:02.043 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-10-06T02:18:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.045+0000 7f9c81469700 1 -- 172.21.15.6:0/2465585917 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c68066f30 msgr2=0x7f9c680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.045+0000 7f9c81469700 1 --2- 172.21.15.6:0/2465585917 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c68066f30 0x7f9c680693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0cae00 tx=0x7f9c7000b040 comp rx=0 tx=0).stop 2023-10-06T02:18:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.045+0000 7f9c81469700 1 -- 172.21.15.6:0/2465585917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c7c0ad250 msgr2=0x7f9c7c1691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.045+0000 7f9c81469700 1 --2- 172.21.15.6:0/2465585917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c7c0ad250 0x7f9c7c1691b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c00c5c0 tx=0x7f9c6c007e20 comp rx=0 tx=0).stop 2023-10-06T02:18:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.045+0000 7f9c81469700 1 -- 172.21.15.6:0/2465585917 shutdown_connections 2023-10-06T02:18:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.045+0000 7f9c81469700 1 --2- 172.21.15.6:0/2465585917 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c68066f30 0x7f9c680693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.045+0000 7f9c81469700 1 --2- 172.21.15.6:0/2465585917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c166310 0x7f9c7c0a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.045+0000 7f9c81469700 1 --2- 172.21.15.6:0/2465585917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c7c06e2b0 0x7f9c7c157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.045+0000 7f9c81469700 1 --2- 172.21.15.6:0/2465585917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c7c0ad250 0x7f9c7c1691b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.046+0000 7f9c81469700 1 -- 172.21.15.6:0/2465585917 >> 172.21.15.6:0/2465585917 conn(0x7f9c7c069110 msgr2=0x7f9c7c0c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.046+0000 7f9c81469700 1 -- 172.21.15.6:0/2465585917 shutdown_connections 2023-10-06T02:18:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.046+0000 7f9c81469700 1 -- 172.21.15.6:0/2465585917 wait complete. 2023-10-06T02:18:02.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-10-06T02:18:02.053 DEBUG:teuthology.parallel:result is None 2023-10-06T02:18:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.058+0000 7f6e7ffc2700 1 -- 172.21.15.6:0/134926602 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6e58005560 con 0x7f6e78166310 2023-10-06T02:18:02.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-10-06T02:18:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.059+0000 7f6e75ffb700 1 -- 172.21.15.6:0/134926602 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e64056fc0 con 0x7f6e78166310 2023-10-06T02:18:02.062 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-10-06T02:18:02.062 DEBUG:teuthology.parallel:result is None 2023-10-06T02:18:02.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.061+0000 7f6e7ffc2700 1 -- 172.21.15.6:0/134926602 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e5c067080 msgr2=0x7f6e5c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.061+0000 7f6e7ffc2700 1 --2- 172.21.15.6:0/134926602 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e5c067080 0x7f6e5c069530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c007fd0 tx=0x7f6e6c002780 comp rx=0 tx=0).stop 2023-10-06T02:18:02.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.061+0000 7f6e7ffc2700 1 -- 172.21.15.6:0/134926602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e78166310 msgr2=0x7f6e7815e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.061+0000 7f6e7ffc2700 1 --2- 172.21.15.6:0/134926602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e78166310 0x7f6e7815e1c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e7806d700 tx=0x7f6e64018000 comp rx=0 tx=0).stop 2023-10-06T02:18:02.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.061+0000 7f6e7ffc2700 1 -- 172.21.15.6:0/134926602 shutdown_connections 2023-10-06T02:18:02.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.061+0000 7f6e7ffc2700 1 --2- 172.21.15.6:0/134926602 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e5c067080 0x7f6e5c069530 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.061+0000 7f6e7ffc2700 1 --2- 172.21.15.6:0/134926602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e781666e0 0x7f6e780cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.061+0000 7f6e7ffc2700 1 --2- 172.21.15.6:0/134926602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e780ad080 0x7f6e7817faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.061+0000 7f6e7ffc2700 1 --2- 172.21.15.6:0/134926602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e78166310 0x7f6e7815e1c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.061+0000 7f6e7ffc2700 1 -- 172.21.15.6:0/134926602 >> 172.21.15.6:0/134926602 conn(0x7f6e78069110 msgr2=0x7f6e780afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:02.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.061+0000 7f6e7ffc2700 1 -- 172.21.15.6:0/134926602 shutdown_connections 2023-10-06T02:18:02.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.061+0000 7f6e7ffc2700 1 -- 172.21.15.6:0/134926602 wait complete. 2023-10-06T02:18:02.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.064+0000 7ff4fbd66700 1 -- 172.21.15.6:0/169181371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff4f406fcb0 con 0x7ff4f40c9480 2023-10-06T02:18:02.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.064+0000 7f2bd02a9700 1 -- 172.21.15.6:0/3367531057 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2bb0005830 con 0x7f2bc80aa1a0 2023-10-06T02:18:02.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.064+0000 7ff4e9ffb700 1 -- 172.21.15.6:0/169181371 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4f0056920 con 0x7ff4f40c9480 2023-10-06T02:18:02.066 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-10-06T02:18:02.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.064+0000 7f2bbe7fc700 1 -- 172.21.15.6:0/3367531057 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2bc40545d0 con 0x7f2bc80aa1a0 2023-10-06T02:18:02.067 INFO:teuthology.orchestra.run.smithi006.stdout:55834574856 2023-10-06T02:18:02.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7ff4fbd66700 1 -- 172.21.15.6:0/169181371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff4d8066f30 msgr2=0x7ff4d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7ff4fbd66700 1 --2- 172.21.15.6:0/169181371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff4d8066f30 0x7ff4d80693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff4f417a420 tx=0x7ff4e4006c60 comp rx=0 tx=0).stop 2023-10-06T02:18:02.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7ff4fbd66700 1 -- 172.21.15.6:0/169181371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f40c9480 msgr2=0x7ff4f4157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7ff4fbd66700 1 --2- 172.21.15.6:0/169181371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f40c9480 0x7ff4f4157650 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00030c0 tx=0x7ff4f0015000 comp rx=0 tx=0).stop 2023-10-06T02:18:02.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7ff4fbd66700 1 -- 172.21.15.6:0/169181371 shutdown_connections 2023-10-06T02:18:02.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7ff4fbd66700 1 --2- 172.21.15.6:0/169181371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4f414af70 0x7ff4f4176300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7ff4fbd66700 1 --2- 172.21.15.6:0/169181371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff4d8066f30 0x7ff4d80693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7ff4fbd66700 1 --2- 172.21.15.6:0/169181371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f40c9480 0x7ff4f4157650 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7ff4fbd66700 1 --2- 172.21.15.6:0/169181371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4f4158da0 0x7ff4f414aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7ff4fbd66700 1 -- 172.21.15.6:0/169181371 >> 172.21.15.6:0/169181371 conn(0x7ff4f4069110 msgr2=0x7ff4f414be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:02.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7ff4fbd66700 1 -- 172.21.15.6:0/169181371 shutdown_connections 2023-10-06T02:18:02.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7ff4fbd66700 1 -- 172.21.15.6:0/169181371 wait complete. 2023-10-06T02:18:02.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7f2bd02a9700 1 -- 172.21.15.6:0/3367531057 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2bac066f30 msgr2=0x7f2bac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7f2bd02a9700 1 --2- 172.21.15.6:0/3367531057 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2bac066f30 0x7f2bac0693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8006fd0 tx=0x7f2bb80090f0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7f2bd02a9700 1 -- 172.21.15.6:0/3367531057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc80aa1a0 msgr2=0x7f2bc8178320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7f2bd02a9700 1 --2- 172.21.15.6:0/3367531057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc80aa1a0 0x7f2bc8178320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400c5b0 tx=0x7f2bc4007e10 comp rx=0 tx=0).stop 2023-10-06T02:18:02.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7f2bd02a9700 1 -- 172.21.15.6:0/3367531057 shutdown_connections 2023-10-06T02:18:02.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7f2bd02a9700 1 --2- 172.21.15.6:0/3367531057 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2bac066f30 0x7f2bac0693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7f2bd02a9700 1 --2- 172.21.15.6:0/3367531057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc815d4c0 0x7f2bc81513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7f2bd02a9700 1 --2- 172.21.15.6:0/3367531057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bc80a9dd0 0x7f2bc81771f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7f2bd02a9700 1 --2- 172.21.15.6:0/3367531057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc80aa1a0 0x7f2bc8178320 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.067+0000 7f2bd02a9700 1 -- 172.21.15.6:0/3367531057 >> 172.21.15.6:0/3367531057 conn(0x7f2bc8069110 msgr2=0x7f2bc80c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:02.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.068+0000 7f2bd02a9700 1 -- 172.21.15.6:0/3367531057 shutdown_connections 2023-10-06T02:18:02.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.068+0000 7f2bd02a9700 1 -- 172.21.15.6:0/3367531057 wait complete. 2023-10-06T02:18:02.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-10-06T02:18:02.078 DEBUG:teuthology.parallel:result is None 2023-10-06T02:18:02.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-10-06T02:18:02.084 DEBUG:teuthology.parallel:result is None 2023-10-06T02:18:02.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-10-06T02:18:02.084 DEBUG:teuthology.parallel:result is None 2023-10-06T02:18:02.084 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T02:18:02.085 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:18:02.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.242+0000 7fe37f59e700 1 Processor -- start 2023-10-06T02:18:02.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.242+0000 7fe37f59e700 1 -- start start 2023-10-06T02:18:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.243+0000 7fe37f59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe380159400 0x7fe3800ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.243+0000 7fe37f59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3800b3560 con 0x7fe3800cd030 2023-10-06T02:18:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.243+0000 7fe37f59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3800cf6f0 con 0x7fe3800d05d0 2023-10-06T02:18:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.243+0000 7fe37f59e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3800cf9d0 con 0x7fe380159400 2023-10-06T02:18:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.243+0000 7fe37dd9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe3800cd030 0x7fe3800cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36152/0 (socket says 172.21.15.6:36152) 2023-10-06T02:18:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.243+0000 7fe37dd9b700 1 -- 172.21.15.6:0/1703250008 learned_addr learned my addr 172.21.15.6:0/1703250008 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.243+0000 7fe37e59c700 1 --2- 172.21.15.6:0/1703250008 >> v2:172.21.15.175:3300/0 conn(0x7fe380159400 0x7fe3800ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.243+0000 7fe37d59a700 1 -- 172.21.15.6:0/1703250008 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598179577 0 0) 0x7fe3800b3560 con 0x7fe3800cd030 2023-10-06T02:18:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.243+0000 7fe37d59a700 1 -- 172.21.15.6:0/1703250008 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe36c003570 con 0x7fe3800cd030 2023-10-06T02:18:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.243+0000 7fe37d59a700 1 -- 172.21.15.6:0/1703250008 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333422634 0 0) 0x7fe3800cf6f0 con 0x7fe3800d05d0 2023-10-06T02:18:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.243+0000 7fe37d59a700 1 -- 172.21.15.6:0/1703250008 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3800b3560 con 0x7fe3800d05d0 2023-10-06T02:18:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.243+0000 7fe37d59a700 1 -- 172.21.15.6:0/1703250008 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 656960852 0 0) 0x7fe36c003570 con 0x7fe3800cd030 2023-10-06T02:18:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.243+0000 7fe37d59a700 1 -- 172.21.15.6:0/1703250008 >> v2:172.21.15.175:3300/0 conn(0x7fe380159400 msgr2=0x7fe3800ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.243+0000 7fe37d59a700 1 --2- 172.21.15.6:0/1703250008 >> v2:172.21.15.175:3300/0 conn(0x7fe380159400 0x7fe3800ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37d59a700 1 -- 172.21.15.6:0/1703250008 >> v1:172.21.15.175:6789/0 conn(0x7fe3800d05d0 legacy=0x7fe3800b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37d59a700 1 -- 172.21.15.6:0/1703250008 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3800b2f10 con 0x7fe3800cd030 2023-10-06T02:18:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37d59a700 1 -- 172.21.15.6:0/1703250008 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fe368001470 con 0x7fe3800cd030 2023-10-06T02:18:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37d59a700 1 -- 172.21.15.6:0/1703250008 >> v1:172.21.15.6:6789/0 conn(0x7fe3800cd030 legacy=0x7fe3800cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37d59a700 1 --2- 172.21.15.6:0/1703250008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe36c003bf0 0x7fe36c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37d59a700 1 --2- 172.21.15.6:0/1703250008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36c004810 0x7fe36c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37d59a700 1 --2- 172.21.15.6:0/1703250008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe36c0051c0 0x7fe36c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37d59a700 1 -- 172.21.15.6:0/1703250008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800cf9d0 con 0x7fe36c004810 2023-10-06T02:18:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37d59a700 1 -- 172.21.15.6:0/1703250008 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c00c0b0 con 0x7fe36c0051c0 2023-10-06T02:18:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37d59a700 1 -- 172.21.15.6:0/1703250008 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c00c270 con 0x7fe36c003bf0 2023-10-06T02:18:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37dd9b700 1 --2- 172.21.15.6:0/1703250008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36c004810 0x7fe36c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37e59c700 1 --2- 172.21.15.6:0/1703250008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe36c003bf0 0x7fe36c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37ed9d700 1 --2- 172.21.15.6:0/1703250008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe36c0051c0 0x7fe36c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37dd9b700 1 -- 172.21.15.6:0/1703250008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe36c003bf0 msgr2=0x7fe36c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37dd9b700 1 --2- 172.21.15.6:0/1703250008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe36c003bf0 0x7fe36c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37dd9b700 1 -- 172.21.15.6:0/1703250008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe36c0051c0 msgr2=0x7fe36c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37dd9b700 1 --2- 172.21.15.6:0/1703250008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe36c0051c0 0x7fe36c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37dd9b700 1 -- 172.21.15.6:0/1703250008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c003570 con 0x7fe36c004810 2023-10-06T02:18:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37ed9d700 1 -- 172.21.15.6:0/1703250008 reap_dead start 2023-10-06T02:18:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37dd9b700 1 --2- 172.21.15.6:0/1703250008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36c004810 0x7fe36c004c80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe36800c2d0 tx=0x7fe368001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b563525ec1df33b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37d59a700 1 -- 172.21.15.6:0/1703250008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36800cbc0 con 0x7fe36c004810 2023-10-06T02:18:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37d59a700 1 -- 172.21.15.6:0/1703250008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36800cd20 con 0x7fe36c004810 2023-10-06T02:18:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.244+0000 7fe37d59a700 1 -- 172.21.15.6:0/1703250008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe368005b70 con 0x7fe36c004810 2023-10-06T02:18:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.245+0000 7fe37f59e700 1 -- 172.21.15.6:0/1703250008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36c004810 msgr2=0x7fe36c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.245+0000 7fe37f59e700 1 --2- 172.21.15.6:0/1703250008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36c004810 0x7fe36c004c80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe36800c2d0 tx=0x7fe368001e10 comp rx=0 tx=0).stop 2023-10-06T02:18:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.245+0000 7fe37f59e700 1 -- 172.21.15.6:0/1703250008 shutdown_connections 2023-10-06T02:18:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.245+0000 7fe37f59e700 1 --2- 172.21.15.6:0/1703250008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36c004810 0x7fe36c004c80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.245+0000 7fe37f59e700 1 -- 172.21.15.6:0/1703250008 >> 172.21.15.6:0/1703250008 conn(0x7fe38006ac10 msgr2=0x7fe380068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.245+0000 7fe37f59e700 1 -- 172.21.15.6:0/1703250008 shutdown_connections 2023-10-06T02:18:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.245+0000 7fe37f59e700 1 -- 172.21.15.6:0/1703250008 wait complete. 2023-10-06T02:18:02.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.246+0000 7fe37f59e700 1 Processor -- start 2023-10-06T02:18:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.246+0000 7fe37f59e700 1 -- start start 2023-10-06T02:18:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.247+0000 7fe37f59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe36c004810 0x7fe3801524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.247+0000 7fe37f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe38016cf60 0x7fe380169960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.247+0000 7fe37f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3800b1c50 0x7fe38016c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.247+0000 7fe37f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800c5240 con 0x7fe38016cf60 2023-10-06T02:18:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.247+0000 7fe37f59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe380169ea0 con 0x7fe36c004810 2023-10-06T02:18:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.247+0000 7fe37f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800c4ef0 con 0x7fe3800b1c50 2023-10-06T02:18:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.247+0000 7fe37dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe38016cf60 0x7fe380169960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.247+0000 7fe37dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe38016cf60 0x7fe380169960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54480/0 (socket says 172.21.15.6:54480) 2023-10-06T02:18:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.247+0000 7fe37dd9b700 1 -- 172.21.15.6:0/3835649350 learned_addr learned my addr 172.21.15.6:0/3835649350 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.247+0000 7fe37e59c700 1 --2- 172.21.15.6:0/3835649350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe36c004810 0x7fe3801524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.247+0000 7fe37ed9d700 1 --2- 172.21.15.6:0/3835649350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3800b1c50 0x7fe38016c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:02.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.247+0000 7fe37dd9b700 1 -- 172.21.15.6:0/3835649350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3800b1c50 msgr2=0x7fe38016c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.247+0000 7fe37dd9b700 1 --2- 172.21.15.6:0/3835649350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3800b1c50 0x7fe38016c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.247+0000 7fe37dd9b700 1 -- 172.21.15.6:0/3835649350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe36c004810 msgr2=0x7fe3801524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.247+0000 7fe37dd9b700 1 --2- 172.21.15.6:0/3835649350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe36c004810 0x7fe3801524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.247+0000 7fe37dd9b700 1 -- 172.21.15.6:0/3835649350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38016d6d0 con 0x7fe38016cf60 2023-10-06T02:18:02.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.247+0000 7fe37dd9b700 1 --2- 172.21.15.6:0/3835649350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe38016cf60 0x7fe380169960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00c080 tx=0x7fe368015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:02.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.248+0000 7fe3767fc700 1 -- 172.21.15.6:0/3835649350 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe368001b30 con 0x7fe38016cf60 2023-10-06T02:18:02.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.248+0000 7fe3767fc700 1 -- 172.21.15.6:0/3835649350 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe368000c30 con 0x7fe38016cf60 2023-10-06T02:18:02.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.248+0000 7fe37f59e700 1 -- 172.21.15.6:0/3835649350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38016d9b0 con 0x7fe38016cf60 2023-10-06T02:18:02.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.248+0000 7fe3767fc700 1 -- 172.21.15.6:0/3835649350 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3680070d0 con 0x7fe38016cf60 2023-10-06T02:18:02.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.248+0000 7fe37f59e700 1 -- 172.21.15.6:0/3835649350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38016d3d0 con 0x7fe38016cf60 2023-10-06T02:18:02.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.249+0000 7fe37f59e700 1 -- 172.21.15.6:0/3835649350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3800c5380 con 0x7fe38016cf60 2023-10-06T02:18:02.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.249+0000 7fe3767fc700 1 -- 172.21.15.6:0/3835649350 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3680074a0 con 0x7fe38016cf60 2023-10-06T02:18:02.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.249+0000 7fe3767fc700 1 --2- 172.21.15.6:0/3835649350 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe360066f30 0x7fe3600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:02.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.249+0000 7fe3767fc700 1 -- 172.21.15.6:0/3835649350 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe368085d90 con 0x7fe38016cf60 2023-10-06T02:18:02.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.250+0000 7fe37e59c700 1 --2- 172.21.15.6:0/3835649350 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe360066f30 0x7fe3600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:02.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.250+0000 7fe37e59c700 1 --2- 172.21.15.6:0/3835649350 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe360066f30 0x7fe3600693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe380151cc0 tx=0x7fe37800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:02.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.254+0000 7fe3767fc700 1 -- 172.21.15.6:0/3835649350 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3800c5380 con 0x7fe38016cf60 2023-10-06T02:18:02.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.443+0000 7fe37f59e700 1 -- 172.21.15.6:0/3835649350 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3800c5380 con 0x7fe360066f30 2023-10-06T02:18:02.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.454+0000 7fe3767fc700 1 -- 172.21.15.6:0/3835649350 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367551 (secure 0 0 0) 0x7fe3800c5380 con 0x7fe360066f30 2023-10-06T02:18:02.459 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:02.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.457+0000 7fe37f59e700 1 -- 172.21.15.6:0/3835649350 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe360066f30 msgr2=0x7fe3600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.457+0000 7fe37f59e700 1 --2- 172.21.15.6:0/3835649350 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe360066f30 0x7fe3600693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe380151cc0 tx=0x7fe37800b040 comp rx=0 tx=0).stop 2023-10-06T02:18:02.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.457+0000 7fe37f59e700 1 -- 172.21.15.6:0/3835649350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe38016cf60 msgr2=0x7fe380169960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.457+0000 7fe37f59e700 1 --2- 172.21.15.6:0/3835649350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe38016cf60 0x7fe380169960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00c080 tx=0x7fe368015000 comp rx=0 tx=0).stop 2023-10-06T02:18:02.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.457+0000 7fe37f59e700 1 -- 172.21.15.6:0/3835649350 shutdown_connections 2023-10-06T02:18:02.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.458+0000 7fe37f59e700 1 --2- 172.21.15.6:0/3835649350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3800b1c50 0x7fe38016c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.458+0000 7fe37f59e700 1 --2- 172.21.15.6:0/3835649350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe36c004810 0x7fe3801524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.458+0000 7fe37f59e700 1 --2- 172.21.15.6:0/3835649350 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe360066f30 0x7fe3600693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.458+0000 7fe37f59e700 1 --2- 172.21.15.6:0/3835649350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe38016cf60 0x7fe380169960 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.458+0000 7fe37f59e700 1 -- 172.21.15.6:0/3835649350 >> 172.21.15.6:0/3835649350 conn(0x7fe38006ac10 msgr2=0x7fe380157c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:02.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.458+0000 7fe37f59e700 1 -- 172.21.15.6:0/3835649350 shutdown_connections 2023-10-06T02:18:02.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.458+0000 7fe37f59e700 1 -- 172.21.15.6:0/3835649350 wait complete. 2023-10-06T02:18:02.463 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:18:02.471 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2023-10-06T02:18:00.562079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381596,"kb_used_data":3292,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593124,"statfs":{"total":773094113280,"available":770655358976,"internally_reserved":0,"allocated":3371008,"data_stored":2059621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.523141"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031087+0000","last_change":"2023-10-06T02:17:44.012575+0000","last_active":"2023-10-06T02:17:48.031087+0000","last_peered":"2023-10-06T02:17:48.031087+0000","last_clean":"2023-10-06T02:17:48.031087+0000","last_became_active":"2023-10-06T02:17:44.012270+0000","last_became_peered":"2023-10-06T02:17:44.012270+0000","last_unstale":"2023-10-06T02:17:48.031087+0000","last_undegraded":"2023-10-06T02:17:48.031087+0000","last_fullsized":"2023-10-06T02:17:48.031087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:16.254919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.041799+0000","last_change":"2023-10-06T02:17:44.021465+0000","last_active":"2023-10-06T02:17:48.041799+0000","last_peered":"2023-10-06T02:17:48.041799+0000","last_clean":"2023-10-06T02:17:48.041799+0000","last_became_active":"2023-10-06T02:17:44.021209+0000","last_became_peered":"2023-10-06T02:17:44.021209+0000","last_unstale":"2023-10-06T02:17:48.041799+0000","last_undegraded":"2023-10-06T02:17:48.041799+0000","last_fullsized":"2023-10-06T02:17:48.041799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:41.549349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038712+0000","last_change":"2023-10-06T02:17:44.027196+0000","last_active":"2023-10-06T02:17:48.038712+0000","last_peered":"2023-10-06T02:17:48.038712+0000","last_clean":"2023-10-06T02:17:48.038712+0000","last_became_active":"2023-10-06T02:17:44.026927+0000","last_became_peered":"2023-10-06T02:17:44.026927+0000","last_unstale":"2023-10-06T02:17:48.038712+0000","last_undegraded":"2023-10-06T02:17:48.038712+0000","last_fullsized":"2023-10-06T02:17:48.038712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:15.551522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039557+0000","last_change":"2023-10-06T02:17:44.027115+0000","last_active":"2023-10-06T02:17:48.039557+0000","last_peered":"2023-10-06T02:17:48.039557+0000","last_clean":"2023-10-06T02:17:48.039557+0000","last_became_active":"2023-10-06T02:17:44.026827+0000","last_became_peered":"2023-10-06T02:17:44.026827+0000","last_unstale":"2023-10-06T02:17:48.039557+0000","last_undegraded":"2023-10-06T02:17:48.039557+0000","last_fullsized":"2023-10-06T02:17:48.039557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:32.103483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.033725+0000","last_change":"2023-10-06T02:17:44.015656+0000","last_active":"2023-10-06T02:17:48.033725+0000","last_peered":"2023-10-06T02:17:48.033725+0000","last_clean":"2023-10-06T02:17:48.033725+0000","last_became_active":"2023-10-06T02:17:44.008744+0000","last_became_peered":"2023-10-06T02:17:44.008744+0000","last_unstale":"2023-10-06T02:17:48.033725+0000","last_undegraded":"2023-10-06T02:17:48.033725+0000","last_fullsized":"2023-10-06T02:17:48.033725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037659+0000","last_change":"2023-10-06T02:17:44.027345+0000","last_active":"2023-10-06T02:17:48.037659+0000","last_peered":"2023-10-06T02:17:48.037659+0000","last_clean":"2023-10-06T02:17:48.037659+0000","last_became_active":"2023-10-06T02:17:44.027000+0000","last_became_peered":"2023-10-06T02:17:44.027000+0000","last_unstale":"2023-10-06T02:17:48.037659+0000","last_undegraded":"2023-10-06T02:17:48.037659+0000","last_fullsized":"2023-10-06T02:17:48.037659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:54.531796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037439+0000","last_change":"2023-10-06T02:17:44.013835+0000","last_active":"2023-10-06T02:17:48.037439+0000","last_peered":"2023-10-06T02:17:48.037439+0000","last_clean":"2023-10-06T02:17:48.037439+0000","last_became_active":"2023-10-06T02:17:44.013543+0000","last_became_peered":"2023-10-06T02:17:44.013543+0000","last_unstale":"2023-10-06T02:17:48.037439+0000","last_undegraded":"2023-10-06T02:17:48.037439+0000","last_fullsized":"2023-10-06T02:17:48.037439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:03.459533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036293+0000","last_change":"2023-10-06T02:17:44.016297+0000","last_active":"2023-10-06T02:17:48.036293+0000","last_peered":"2023-10-06T02:17:48.036293+0000","last_clean":"2023-10-06T02:17:48.036293+0000","last_became_active":"2023-10-06T02:17:44.016019+0000","last_became_peered":"2023-10-06T02:17:44.016019+0000","last_unstale":"2023-10-06T02:17:48.036293+0000","last_undegraded":"2023-10-06T02:17:48.036293+0000","last_fullsized":"2023-10-06T02:17:48.036293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:04.413740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030759+0000","last_change":"2023-10-06T02:17:44.017824+0000","last_active":"2023-10-06T02:17:48.030759+0000","last_peered":"2023-10-06T02:17:48.030759+0000","last_clean":"2023-10-06T02:17:48.030759+0000","last_became_active":"2023-10-06T02:17:44.017300+0000","last_became_peered":"2023-10-06T02:17:44.017300+0000","last_unstale":"2023-10-06T02:17:48.030759+0000","last_undegraded":"2023-10-06T02:17:48.030759+0000","last_fullsized":"2023-10-06T02:17:48.030759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:12.939706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.041971+0000","last_change":"2023-10-06T02:17:44.015364+0000","last_active":"2023-10-06T02:17:48.041971+0000","last_peered":"2023-10-06T02:17:48.041971+0000","last_clean":"2023-10-06T02:17:48.041971+0000","last_became_active":"2023-10-06T02:17:44.009665+0000","last_became_peered":"2023-10-06T02:17:44.009665+0000","last_unstale":"2023-10-06T02:17:48.041971+0000","last_undegraded":"2023-10-06T02:17:48.041971+0000","last_fullsized":"2023-10-06T02:17:48.041971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:12.022239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038636+0000","last_change":"2023-10-06T02:17:44.015097+0000","last_active":"2023-10-06T02:17:48.038636+0000","last_peered":"2023-10-06T02:17:48.038636+0000","last_clean":"2023-10-06T02:17:48.038636+0000","last_became_active":"2023-10-06T02:17:44.014831+0000","last_became_peered":"2023-10-06T02:17:44.014831+0000","last_unstale":"2023-10-06T02:17:48.038636+0000","last_undegraded":"2023-10-06T02:17:48.038636+0000","last_fullsized":"2023-10-06T02:17:48.038636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:00.943603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031356+0000","last_change":"2023-10-06T02:17:44.015300+0000","last_active":"2023-10-06T02:17:48.031356+0000","last_peered":"2023-10-06T02:17:48.031356+0000","last_clean":"2023-10-06T02:17:48.031356+0000","last_became_active":"2023-10-06T02:17:44.015015+0000","last_became_peered":"2023-10-06T02:17:44.015015+0000","last_unstale":"2023-10-06T02:17:48.031356+0000","last_undegraded":"2023-10-06T02:17:48.031356+0000","last_fullsized":"2023-10-06T02:17:48.031356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:30.550259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030945+0000","last_change":"2023-10-06T02:17:44.009268+0000","last_active":"2023-10-06T02:17:48.030945+0000","last_peered":"2023-10-06T02:17:48.030945+0000","last_clean":"2023-10-06T02:17:48.030945+0000","last_became_active":"2023-10-06T02:17:44.008958+0000","last_became_peered":"2023-10-06T02:17:44.008958+0000","last_unstale":"2023-10-06T02:17:48.030945+0000","last_undegraded":"2023-10-06T02:17:48.030945+0000","last_fullsized":"2023-10-06T02:17:48.030945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:35.516151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037800+0000","last_change":"2023-10-06T02:17:44.015486+0000","last_active":"2023-10-06T02:17:48.037800+0000","last_peered":"2023-10-06T02:17:48.037800+0000","last_clean":"2023-10-06T02:17:48.037800+0000","last_became_active":"2023-10-06T02:17:44.009594+0000","last_became_peered":"2023-10-06T02:17:44.009594+0000","last_unstale":"2023-10-06T02:17:48.037800+0000","last_undegraded":"2023-10-06T02:17:48.037800+0000","last_fullsized":"2023-10-06T02:17:48.037800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:14.067335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.035580+0000","last_change":"2023-10-06T02:17:44.014327+0000","last_active":"2023-10-06T02:17:48.035580+0000","last_peered":"2023-10-06T02:17:48.035580+0000","last_clean":"2023-10-06T02:17:48.035580+0000","last_became_active":"2023-10-06T02:17:44.014076+0000","last_became_peered":"2023-10-06T02:17:44.014076+0000","last_unstale":"2023-10-06T02:17:48.035580+0000","last_undegraded":"2023-10-06T02:17:48.035580+0000","last_fullsized":"2023-10-06T02:17:48.035580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:41.549349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036877+0000","last_change":"2023-10-06T02:17:44.022392+0000","last_active":"2023-10-06T02:17:48.036877+0000","last_peered":"2023-10-06T02:17:48.036877+0000","last_clean":"2023-10-06T02:17:48.036877+0000","last_became_active":"2023-10-06T02:17:44.022145+0000","last_became_peered":"2023-10-06T02:17:44.022145+0000","last_unstale":"2023-10-06T02:17:48.036877+0000","last_undegraded":"2023-10-06T02:17:48.036877+0000","last_fullsized":"2023-10-06T02:17:48.036877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:29.729845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030860+0000","last_change":"2023-10-06T02:17:44.018022+0000","last_active":"2023-10-06T02:17:48.030860+0000","last_peered":"2023-10-06T02:17:48.030860+0000","last_clean":"2023-10-06T02:17:48.030860+0000","last_became_active":"2023-10-06T02:17:44.017617+0000","last_became_peered":"2023-10-06T02:17:44.017617+0000","last_unstale":"2023-10-06T02:17:48.030860+0000","last_undegraded":"2023-10-06T02:17:48.030860+0000","last_fullsized":"2023-10-06T02:17:48.030860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.500461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.044943+0000","last_change":"2023-10-06T02:17:44.014002+0000","last_active":"2023-10-06T02:17:48.044943+0000","last_peered":"2023-10-06T02:17:48.044943+0000","last_clean":"2023-10-06T02:17:48.044943+0000","last_became_active":"2023-10-06T02:17:44.013756+0000","last_became_peered":"2023-10-06T02:17:44.013756+0000","last_unstale":"2023-10-06T02:17:48.044943+0000","last_undegraded":"2023-10-06T02:17:48.044943+0000","last_fullsized":"2023-10-06T02:17:48.044943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:05.747241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031920+0000","last_change":"2023-10-06T02:17:44.013965+0000","last_active":"2023-10-06T02:17:48.031920+0000","last_peered":"2023-10-06T02:17:48.031920+0000","last_clean":"2023-10-06T02:17:48.031920+0000","last_became_active":"2023-10-06T02:17:44.013512+0000","last_became_peered":"2023-10-06T02:17:44.013512+0000","last_unstale":"2023-10-06T02:17:48.031920+0000","last_undegraded":"2023-10-06T02:17:48.031920+0000","last_fullsized":"2023-10-06T02:17:48.031920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:00.061174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040168+0000","last_change":"2023-10-06T02:17:44.021614+0000","last_active":"2023-10-06T02:17:48.040168+0000","last_peered":"2023-10-06T02:17:48.040168+0000","last_clean":"2023-10-06T02:17:48.040168+0000","last_became_active":"2023-10-06T02:17:44.021377+0000","last_became_peered":"2023-10-06T02:17:44.021377+0000","last_unstale":"2023-10-06T02:17:48.040168+0000","last_undegraded":"2023-10-06T02:17:48.040168+0000","last_fullsized":"2023-10-06T02:17:48.040168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:39.014780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040828+0000","last_change":"2023-10-06T02:17:44.018105+0000","last_active":"2023-10-06T02:17:48.040828+0000","last_peered":"2023-10-06T02:17:48.040828+0000","last_clean":"2023-10-06T02:17:48.040828+0000","last_became_active":"2023-10-06T02:17:44.017812+0000","last_became_peered":"2023-10-06T02:17:44.017812+0000","last_unstale":"2023-10-06T02:17:48.040828+0000","last_undegraded":"2023-10-06T02:17:48.040828+0000","last_fullsized":"2023-10-06T02:17:48.040828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030387+0000","last_change":"2023-10-06T02:17:44.016308+0000","last_active":"2023-10-06T02:17:48.030387+0000","last_peered":"2023-10-06T02:17:48.030387+0000","last_clean":"2023-10-06T02:17:48.030387+0000","last_became_active":"2023-10-06T02:17:44.016107+0000","last_became_peered":"2023-10-06T02:17:44.016107+0000","last_unstale":"2023-10-06T02:17:48.030387+0000","last_undegraded":"2023-10-06T02:17:48.030387+0000","last_fullsized":"2023-10-06T02:17:48.030387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:43.352906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.032262+0000","last_change":"2023-10-06T02:17:44.026872+0000","last_active":"2023-10-06T02:17:48.032262+0000","last_peered":"2023-10-06T02:17:48.032262+0000","last_clean":"2023-10-06T02:17:48.032262+0000","last_became_active":"2023-10-06T02:17:44.026595+0000","last_became_peered":"2023-10-06T02:17:44.026595+0000","last_unstale":"2023-10-06T02:17:48.032262+0000","last_undegraded":"2023-10-06T02:17:48.032262+0000","last_fullsized":"2023-10-06T02:17:48.032262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:54.531796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036348+0000","last_change":"2023-10-06T02:17:44.009432+0000","last_active":"2023-10-06T02:17:48.036348+0000","last_peered":"2023-10-06T02:17:48.036348+0000","last_clean":"2023-10-06T02:17:48.036348+0000","last_became_active":"2023-10-06T02:17:44.009157+0000","last_became_peered":"2023-10-06T02:17:44.009157+0000","last_unstale":"2023-10-06T02:17:48.036348+0000","last_undegraded":"2023-10-06T02:17:48.036348+0000","last_fullsized":"2023-10-06T02:17:48.036348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.500461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050398+0000","last_change":"2023-10-06T02:17:44.020561+0000","last_active":"2023-10-06T02:17:48.050398+0000","last_peered":"2023-10-06T02:17:48.050398+0000","last_clean":"2023-10-06T02:17:48.050398+0000","last_became_active":"2023-10-06T02:17:44.020324+0000","last_became_peered":"2023-10-06T02:17:44.020324+0000","last_unstale":"2023-10-06T02:17:48.050398+0000","last_undegraded":"2023-10-06T02:17:48.050398+0000","last_fullsized":"2023-10-06T02:17:48.050398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:03.459533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050774+0000","last_change":"2023-10-06T02:17:44.009977+0000","last_active":"2023-10-06T02:17:48.050774+0000","last_peered":"2023-10-06T02:17:48.050774+0000","last_clean":"2023-10-06T02:17:48.050774+0000","last_became_active":"2023-10-06T02:17:44.009383+0000","last_became_peered":"2023-10-06T02:17:44.009383+0000","last_unstale":"2023-10-06T02:17:48.050774+0000","last_undegraded":"2023-10-06T02:17:48.050774+0000","last_fullsized":"2023-10-06T02:17:48.050774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:14.067335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040285+0000","last_change":"2023-10-06T02:17:44.022518+0000","last_active":"2023-10-06T02:17:48.040285+0000","last_peered":"2023-10-06T02:17:48.040285+0000","last_clean":"2023-10-06T02:17:48.040285+0000","last_became_active":"2023-10-06T02:17:44.022094+0000","last_became_peered":"2023-10-06T02:17:44.022094+0000","last_unstale":"2023-10-06T02:17:48.040285+0000","last_undegraded":"2023-10-06T02:17:48.040285+0000","last_fullsized":"2023-10-06T02:17:48.040285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.500461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.063071+0000","last_change":"2023-10-06T02:17:48.060017+0000","last_active":"2023-10-06T02:17:48.063071+0000","last_peered":"2023-10-06T02:17:48.063071+0000","last_clean":"2023-10-06T02:17:48.063071+0000","last_became_active":"2023-10-06T02:17:48.059609+0000","last_became_peered":"2023-10-06T02:17:48.059609+0000","last_unstale":"2023-10-06T02:17:48.063071+0000","last_undegraded":"2023-10-06T02:17:48.063071+0000","last_fullsized":"2023-10-06T02:17:48.063071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:46.132017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037608+0000","last_change":"2023-10-06T02:17:43.010345+0000","last_active":"2023-10-06T02:17:48.037608+0000","last_peered":"2023-10-06T02:17:48.037608+0000","last_clean":"2023-10-06T02:17:48.037608+0000","last_became_active":"2023-10-06T02:17:43.006363+0000","last_became_peered":"2023-10-06T02:17:43.006363+0000","last_unstale":"2023-10-06T02:17:48.037608+0000","last_undegraded":"2023-10-06T02:17:48.037608+0000","last_fullsized":"2023-10-06T02:17:48.037608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030384+0000","last_change":"2023-10-06T02:17:44.017786+0000","last_active":"2023-10-06T02:17:48.030384+0000","last_peered":"2023-10-06T02:17:48.030384+0000","last_clean":"2023-10-06T02:17:48.030384+0000","last_became_active":"2023-10-06T02:17:44.016986+0000","last_became_peered":"2023-10-06T02:17:44.016986+0000","last_unstale":"2023-10-06T02:17:48.030384+0000","last_undegraded":"2023-10-06T02:17:48.030384+0000","last_fullsized":"2023-10-06T02:17:48.030384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:49.992736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.053196+0000","last_change":"2023-10-06T02:17:48.051657+0000","last_active":"2023-10-06T02:17:48.053196+0000","last_peered":"2023-10-06T02:17:48.053196+0000","last_clean":"2023-10-06T02:17:48.053196+0000","last_became_active":"2023-10-06T02:17:48.051307+0000","last_became_peered":"2023-10-06T02:17:48.051307+0000","last_unstale":"2023-10-06T02:17:48.053196+0000","last_undegraded":"2023-10-06T02:17:48.053196+0000","last_fullsized":"2023-10-06T02:17:48.053196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:09.781175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045264+0000","last_change":"2023-10-06T02:17:43.002992+0000","last_active":"2023-10-06T02:17:48.045264+0000","last_peered":"2023-10-06T02:17:48.045264+0000","last_clean":"2023-10-06T02:17:48.045264+0000","last_became_active":"2023-10-06T02:17:43.002502+0000","last_became_peered":"2023-10-06T02:17:43.002502+0000","last_unstale":"2023-10-06T02:17:48.045264+0000","last_undegraded":"2023-10-06T02:17:48.045264+0000","last_fullsized":"2023-10-06T02:17:48.045264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031835+0000","last_change":"2023-10-06T02:17:44.021171+0000","last_active":"2023-10-06T02:17:48.031835+0000","last_peered":"2023-10-06T02:17:48.031835+0000","last_clean":"2023-10-06T02:17:48.031835+0000","last_became_active":"2023-10-06T02:17:44.016443+0000","last_became_peered":"2023-10-06T02:17:44.016443+0000","last_unstale":"2023-10-06T02:17:48.031835+0000","last_undegraded":"2023-10-06T02:17:48.031835+0000","last_fullsized":"2023-10-06T02:17:48.031835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:49.992736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.059150+0000","last_change":"2023-10-06T02:17:48.053835+0000","last_active":"2023-10-06T02:17:48.059150+0000","last_peered":"2023-10-06T02:17:48.059150+0000","last_clean":"2023-10-06T02:17:48.059150+0000","last_became_active":"2023-10-06T02:17:48.053399+0000","last_became_peered":"2023-10-06T02:17:48.053399+0000","last_unstale":"2023-10-06T02:17:48.059150+0000","last_undegraded":"2023-10-06T02:17:48.059150+0000","last_fullsized":"2023-10-06T02:17:48.059150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:20.633926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031624+0000","last_change":"2023-10-06T02:17:43.005151+0000","last_active":"2023-10-06T02:17:48.031624+0000","last_peered":"2023-10-06T02:17:48.031624+0000","last_clean":"2023-10-06T02:17:48.031624+0000","last_became_active":"2023-10-06T02:17:43.004709+0000","last_became_peered":"2023-10-06T02:17:43.004709+0000","last_unstale":"2023-10-06T02:17:48.031624+0000","last_undegraded":"2023-10-06T02:17:48.031624+0000","last_fullsized":"2023-10-06T02:17:48.031624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:32.002499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039892+0000","last_change":"2023-10-06T02:17:44.025569+0000","last_active":"2023-10-06T02:17:48.039892+0000","last_peered":"2023-10-06T02:17:48.039892+0000","last_clean":"2023-10-06T02:17:48.039892+0000","last_became_active":"2023-10-06T02:17:44.025261+0000","last_became_peered":"2023-10-06T02:17:44.025261+0000","last_unstale":"2023-10-06T02:17:48.039892+0000","last_undegraded":"2023-10-06T02:17:48.039892+0000","last_fullsized":"2023-10-06T02:17:48.039892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:47.847314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.053261+0000","last_change":"2023-10-06T02:17:48.052637+0000","last_active":"2023-10-06T02:17:48.053261+0000","last_peered":"2023-10-06T02:17:48.053261+0000","last_clean":"2023-10-06T02:17:48.053261+0000","last_became_active":"2023-10-06T02:17:48.052223+0000","last_became_peered":"2023-10-06T02:17:48.052223+0000","last_unstale":"2023-10-06T02:17:48.053261+0000","last_undegraded":"2023-10-06T02:17:48.053261+0000","last_fullsized":"2023-10-06T02:17:48.053261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:33.763779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030951+0000","last_change":"2023-10-06T02:17:43.013718+0000","last_active":"2023-10-06T02:17:48.030951+0000","last_peered":"2023-10-06T02:17:48.030951+0000","last_clean":"2023-10-06T02:17:48.030951+0000","last_became_active":"2023-10-06T02:17:43.013415+0000","last_became_peered":"2023-10-06T02:17:43.013415+0000","last_unstale":"2023-10-06T02:17:48.030951+0000","last_undegraded":"2023-10-06T02:17:48.030951+0000","last_fullsized":"2023-10-06T02:17:48.030951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:59.054001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031512+0000","last_change":"2023-10-06T02:17:44.011855+0000","last_active":"2023-10-06T02:17:48.031512+0000","last_peered":"2023-10-06T02:17:48.031512+0000","last_clean":"2023-10-06T02:17:48.031512+0000","last_became_active":"2023-10-06T02:17:44.011583+0000","last_became_peered":"2023-10-06T02:17:44.011583+0000","last_unstale":"2023-10-06T02:17:48.031512+0000","last_undegraded":"2023-10-06T02:17:48.031512+0000","last_fullsized":"2023-10-06T02:17:48.031512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:01.914117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060333+0000","last_change":"2023-10-06T02:17:48.057256+0000","last_active":"2023-10-06T02:17:48.060333+0000","last_peered":"2023-10-06T02:17:48.060333+0000","last_clean":"2023-10-06T02:17:48.060333+0000","last_became_active":"2023-10-06T02:17:48.056749+0000","last_became_peered":"2023-10-06T02:17:48.056749+0000","last_unstale":"2023-10-06T02:17:48.060333+0000","last_undegraded":"2023-10-06T02:17:48.060333+0000","last_fullsized":"2023-10-06T02:17:48.060333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:29.446681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.041892+0000","last_change":"2023-10-06T02:17:43.013316+0000","last_active":"2023-10-06T02:17:48.041892+0000","last_peered":"2023-10-06T02:17:48.041892+0000","last_clean":"2023-10-06T02:17:48.041892+0000","last_became_active":"2023-10-06T02:17:43.013020+0000","last_became_peered":"2023-10-06T02:17:43.013020+0000","last_unstale":"2023-10-06T02:17:48.041892+0000","last_undegraded":"2023-10-06T02:17:48.041892+0000","last_fullsized":"2023-10-06T02:17:48.041892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:55.863203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030030+0000","last_change":"2023-10-06T02:17:44.017554+0000","last_active":"2023-10-06T02:17:48.030030+0000","last_peered":"2023-10-06T02:17:48.030030+0000","last_clean":"2023-10-06T02:17:48.030030+0000","last_became_active":"2023-10-06T02:17:44.017288+0000","last_became_peered":"2023-10-06T02:17:44.017288+0000","last_unstale":"2023-10-06T02:17:48.030030+0000","last_undegraded":"2023-10-06T02:17:48.030030+0000","last_fullsized":"2023-10-06T02:17:48.030030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:12.939706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050983+0000","last_change":"2023-10-06T02:17:48.049234+0000","last_active":"2023-10-06T02:17:48.050983+0000","last_peered":"2023-10-06T02:17:48.050983+0000","last_clean":"2023-10-06T02:17:48.050983+0000","last_became_active":"2023-10-06T02:17:48.048823+0000","last_became_peered":"2023-10-06T02:17:48.048823+0000","last_unstale":"2023-10-06T02:17:48.050983+0000","last_undegraded":"2023-10-06T02:17:48.050983+0000","last_fullsized":"2023-10-06T02:17:48.050983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:23.461660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036812+0000","last_change":"2023-10-06T02:17:43.012321+0000","last_active":"2023-10-06T02:17:48.036812+0000","last_peered":"2023-10-06T02:17:48.036812+0000","last_clean":"2023-10-06T02:17:48.036812+0000","last_became_active":"2023-10-06T02:17:43.012039+0000","last_became_peered":"2023-10-06T02:17:43.012039+0000","last_unstale":"2023-10-06T02:17:48.036812+0000","last_undegraded":"2023-10-06T02:17:48.036812+0000","last_fullsized":"2023-10-06T02:17:48.036812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:56.588125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.046506+0000","last_change":"2023-10-06T02:17:44.019691+0000","last_active":"2023-10-06T02:17:48.046506+0000","last_peered":"2023-10-06T02:17:48.046506+0000","last_clean":"2023-10-06T02:17:48.046506+0000","last_became_active":"2023-10-06T02:17:44.018879+0000","last_became_peered":"2023-10-06T02:17:44.018879+0000","last_unstale":"2023-10-06T02:17:48.046506+0000","last_undegraded":"2023-10-06T02:17:48.046506+0000","last_fullsized":"2023-10-06T02:17:48.046506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:22.411698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.061948+0000","last_change":"2023-10-06T02:17:48.060182+0000","last_active":"2023-10-06T02:17:48.061948+0000","last_peered":"2023-10-06T02:17:48.061948+0000","last_clean":"2023-10-06T02:17:48.061948+0000","last_became_active":"2023-10-06T02:17:48.058134+0000","last_became_peered":"2023-10-06T02:17:48.058134+0000","last_unstale":"2023-10-06T02:17:48.061948+0000","last_undegraded":"2023-10-06T02:17:48.061948+0000","last_fullsized":"2023-10-06T02:17:48.061948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:40.330578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T02:17:53.898409+0000","last_change":"2023-10-06T02:17:43.011660+0000","last_active":"2023-10-06T02:17:53.898409+0000","last_peered":"2023-10-06T02:17:53.898409+0000","last_clean":"2023-10-06T02:17:53.898409+0000","last_became_active":"2023-10-06T02:17:43.011360+0000","last_became_peered":"2023-10-06T02:17:43.011360+0000","last_unstale":"2023-10-06T02:17:53.898409+0000","last_undegraded":"2023-10-06T02:17:53.898409+0000","last_fullsized":"2023-10-06T02:17:53.898409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:34.508977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039053+0000","last_change":"2023-10-06T02:17:44.019835+0000","last_active":"2023-10-06T02:17:48.039053+0000","last_peered":"2023-10-06T02:17:48.039053+0000","last_clean":"2023-10-06T02:17:48.039053+0000","last_became_active":"2023-10-06T02:17:44.019567+0000","last_became_peered":"2023-10-06T02:17:44.019567+0000","last_unstale":"2023-10-06T02:17:48.039053+0000","last_undegraded":"2023-10-06T02:17:48.039053+0000","last_fullsized":"2023-10-06T02:17:48.039053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:36.296644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060685+0000","last_change":"2023-10-06T02:17:48.058253+0000","last_active":"2023-10-06T02:17:48.060685+0000","last_peered":"2023-10-06T02:17:48.060685+0000","last_clean":"2023-10-06T02:17:48.060685+0000","last_became_active":"2023-10-06T02:17:48.057801+0000","last_became_peered":"2023-10-06T02:17:48.057801+0000","last_unstale":"2023-10-06T02:17:48.060685+0000","last_undegraded":"2023-10-06T02:17:48.060685+0000","last_fullsized":"2023-10-06T02:17:48.060685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:34.306615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036359+0000","last_change":"2023-10-06T02:17:43.014116+0000","last_active":"2023-10-06T02:17:48.036359+0000","last_peered":"2023-10-06T02:17:48.036359+0000","last_clean":"2023-10-06T02:17:48.036359+0000","last_became_active":"2023-10-06T02:17:43.013686+0000","last_became_peered":"2023-10-06T02:17:43.013686+0000","last_unstale":"2023-10-06T02:17:48.036359+0000","last_undegraded":"2023-10-06T02:17:48.036359+0000","last_fullsized":"2023-10-06T02:17:48.036359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:42.345733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030529+0000","last_change":"2023-10-06T02:17:44.023536+0000","last_active":"2023-10-06T02:17:48.030529+0000","last_peered":"2023-10-06T02:17:48.030529+0000","last_clean":"2023-10-06T02:17:48.030529+0000","last_became_active":"2023-10-06T02:17:44.023272+0000","last_became_peered":"2023-10-06T02:17:44.023272+0000","last_unstale":"2023-10-06T02:17:48.030529+0000","last_undegraded":"2023-10-06T02:17:48.030529+0000","last_fullsized":"2023-10-06T02:17:48.030529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:47.126256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.052236+0000","last_change":"2023-10-06T02:17:48.049593+0000","last_active":"2023-10-06T02:17:48.052236+0000","last_peered":"2023-10-06T02:17:48.052236+0000","last_clean":"2023-10-06T02:17:48.052236+0000","last_became_active":"2023-10-06T02:17:48.048578+0000","last_became_peered":"2023-10-06T02:17:48.048578+0000","last_unstale":"2023-10-06T02:17:48.052236+0000","last_undegraded":"2023-10-06T02:17:48.052236+0000","last_fullsized":"2023-10-06T02:17:48.052236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:56.628094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030542+0000","last_change":"2023-10-06T02:17:43.010082+0000","last_active":"2023-10-06T02:17:48.030542+0000","last_peered":"2023-10-06T02:17:48.030542+0000","last_clean":"2023-10-06T02:17:48.030542+0000","last_became_active":"2023-10-06T02:17:43.009750+0000","last_became_peered":"2023-10-06T02:17:43.009750+0000","last_unstale":"2023-10-06T02:17:48.030542+0000","last_undegraded":"2023-10-06T02:17:48.030542+0000","last_fullsized":"2023-10-06T02:17:48.030542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040202+0000","last_change":"2023-10-06T02:17:44.022344+0000","last_active":"2023-10-06T02:17:48.040202+0000","last_peered":"2023-10-06T02:17:48.040202+0000","last_clean":"2023-10-06T02:17:48.040202+0000","last_became_active":"2023-10-06T02:17:44.021817+0000","last_became_peered":"2023-10-06T02:17:44.021817+0000","last_unstale":"2023-10-06T02:17:48.040202+0000","last_undegraded":"2023-10-06T02:17:48.040202+0000","last_fullsized":"2023-10-06T02:17:48.040202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.051438+0000","last_change":"2023-10-06T02:17:48.050036+0000","last_active":"2023-10-06T02:17:48.051438+0000","last_peered":"2023-10-06T02:17:48.051438+0000","last_clean":"2023-10-06T02:17:48.051438+0000","last_became_active":"2023-10-06T02:17:48.049595+0000","last_became_peered":"2023-10-06T02:17:48.049595+0000","last_unstale":"2023-10-06T02:17:48.051438+0000","last_undegraded":"2023-10-06T02:17:48.051438+0000","last_fullsized":"2023-10-06T02:17:48.051438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:09:38.509689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037346+0000","last_change":"2023-10-06T02:17:43.014038+0000","last_active":"2023-10-06T02:17:48.037346+0000","last_peered":"2023-10-06T02:17:48.037346+0000","last_clean":"2023-10-06T02:17:48.037346+0000","last_became_active":"2023-10-06T02:17:43.013419+0000","last_became_peered":"2023-10-06T02:17:43.013419+0000","last_unstale":"2023-10-06T02:17:48.037346+0000","last_undegraded":"2023-10-06T02:17:48.037346+0000","last_fullsized":"2023-10-06T02:17:48.037346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:46.840141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.032077+0000","last_change":"2023-10-06T02:17:44.015494+0000","last_active":"2023-10-06T02:17:48.032077+0000","last_peered":"2023-10-06T02:17:48.032077+0000","last_clean":"2023-10-06T02:17:48.032077+0000","last_became_active":"2023-10-06T02:17:44.012435+0000","last_became_peered":"2023-10-06T02:17:44.012435+0000","last_unstale":"2023-10-06T02:17:48.032077+0000","last_undegraded":"2023-10-06T02:17:48.032077+0000","last_fullsized":"2023-10-06T02:17:48.032077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:03.459533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060832+0000","last_change":"2023-10-06T02:17:48.056039+0000","last_active":"2023-10-06T02:17:48.060832+0000","last_peered":"2023-10-06T02:17:48.060832+0000","last_clean":"2023-10-06T02:17:48.060832+0000","last_became_active":"2023-10-06T02:17:48.055610+0000","last_became_peered":"2023-10-06T02:17:48.055610+0000","last_unstale":"2023-10-06T02:17:48.060832+0000","last_undegraded":"2023-10-06T02:17:48.060832+0000","last_fullsized":"2023-10-06T02:17:48.060832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:05.386590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039054+0000","last_change":"2023-10-06T02:17:43.009311+0000","last_active":"2023-10-06T02:17:48.039054+0000","last_peered":"2023-10-06T02:17:48.039054+0000","last_clean":"2023-10-06T02:17:48.039054+0000","last_became_active":"2023-10-06T02:17:43.009019+0000","last_became_peered":"2023-10-06T02:17:43.009019+0000","last_unstale":"2023-10-06T02:17:48.039054+0000","last_undegraded":"2023-10-06T02:17:48.039054+0000","last_fullsized":"2023-10-06T02:17:48.039054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:34.508977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031131+0000","last_change":"2023-10-06T02:17:44.022053+0000","last_active":"2023-10-06T02:17:48.031131+0000","last_peered":"2023-10-06T02:17:48.031131+0000","last_clean":"2023-10-06T02:17:48.031131+0000","last_became_active":"2023-10-06T02:17:44.021420+0000","last_became_peered":"2023-10-06T02:17:44.021420+0000","last_unstale":"2023-10-06T02:17:48.031131+0000","last_undegraded":"2023-10-06T02:17:48.031131+0000","last_fullsized":"2023-10-06T02:17:48.031131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:03.459533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060798+0000","last_change":"2023-10-06T02:17:48.058632+0000","last_active":"2023-10-06T02:17:48.060798+0000","last_peered":"2023-10-06T02:17:48.060798+0000","last_clean":"2023-10-06T02:17:48.060798+0000","last_became_active":"2023-10-06T02:17:48.056462+0000","last_became_peered":"2023-10-06T02:17:48.056462+0000","last_unstale":"2023-10-06T02:17:48.060798+0000","last_undegraded":"2023-10-06T02:17:48.060798+0000","last_fullsized":"2023-10-06T02:17:48.060798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:19.585456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037962+0000","last_change":"2023-10-06T02:17:43.014971+0000","last_active":"2023-10-06T02:17:48.037962+0000","last_peered":"2023-10-06T02:17:48.037962+0000","last_clean":"2023-10-06T02:17:48.037962+0000","last_became_active":"2023-10-06T02:17:43.014645+0000","last_became_peered":"2023-10-06T02:17:43.014645+0000","last_unstale":"2023-10-06T02:17:48.037962+0000","last_undegraded":"2023-10-06T02:17:48.037962+0000","last_fullsized":"2023-10-06T02:17:48.037962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:31.096309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036178+0000","last_change":"2023-10-06T02:17:44.017176+0000","last_active":"2023-10-06T02:17:48.036178+0000","last_peered":"2023-10-06T02:17:48.036178+0000","last_clean":"2023-10-06T02:17:48.036178+0000","last_became_active":"2023-10-06T02:17:44.016900+0000","last_became_peered":"2023-10-06T02:17:44.016900+0000","last_unstale":"2023-10-06T02:17:48.036178+0000","last_undegraded":"2023-10-06T02:17:48.036178+0000","last_fullsized":"2023-10-06T02:17:48.036178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:21.073260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.058961+0000","last_change":"2023-10-06T02:17:48.056709+0000","last_active":"2023-10-06T02:17:48.058961+0000","last_peered":"2023-10-06T02:17:48.058961+0000","last_clean":"2023-10-06T02:17:48.058961+0000","last_became_active":"2023-10-06T02:17:48.056245+0000","last_became_peered":"2023-10-06T02:17:48.056245+0000","last_unstale":"2023-10-06T02:17:48.058961+0000","last_undegraded":"2023-10-06T02:17:48.058961+0000","last_fullsized":"2023-10-06T02:17:48.058961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:58.565730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038561+0000","last_change":"2023-10-06T02:17:43.015636+0000","last_active":"2023-10-06T02:17:48.038561+0000","last_peered":"2023-10-06T02:17:48.038561+0000","last_clean":"2023-10-06T02:17:48.038561+0000","last_became_active":"2023-10-06T02:17:43.013756+0000","last_became_peered":"2023-10-06T02:17:43.013756+0000","last_unstale":"2023-10-06T02:17:48.038561+0000","last_undegraded":"2023-10-06T02:17:48.038561+0000","last_fullsized":"2023-10-06T02:17:48.038561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:21.985046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045110+0000","last_change":"2023-10-06T02:17:44.019216+0000","last_active":"2023-10-06T02:17:48.045110+0000","last_peered":"2023-10-06T02:17:48.045110+0000","last_clean":"2023-10-06T02:17:48.045110+0000","last_became_active":"2023-10-06T02:17:44.018743+0000","last_became_peered":"2023-10-06T02:17:44.018743+0000","last_unstale":"2023-10-06T02:17:48.045110+0000","last_undegraded":"2023-10-06T02:17:48.045110+0000","last_fullsized":"2023-10-06T02:17:48.045110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:47.126256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.049041+0000","last_change":"2023-10-06T02:17:48.047120+0000","last_active":"2023-10-06T02:17:48.049041+0000","last_peered":"2023-10-06T02:17:48.049041+0000","last_clean":"2023-10-06T02:17:48.049041+0000","last_became_active":"2023-10-06T02:17:48.046716+0000","last_became_peered":"2023-10-06T02:17:48.046716+0000","last_unstale":"2023-10-06T02:17:48.049041+0000","last_undegraded":"2023-10-06T02:17:48.049041+0000","last_fullsized":"2023-10-06T02:17:48.049041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:01.000290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036700+0000","last_change":"2023-10-06T02:17:43.014454+0000","last_active":"2023-10-06T02:17:48.036700+0000","last_peered":"2023-10-06T02:17:48.036700+0000","last_clean":"2023-10-06T02:17:48.036700+0000","last_became_active":"2023-10-06T02:17:43.014185+0000","last_became_peered":"2023-10-06T02:17:43.014185+0000","last_unstale":"2023-10-06T02:17:48.036700+0000","last_undegraded":"2023-10-06T02:17:48.036700+0000","last_fullsized":"2023-10-06T02:17:48.036700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:32.002499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037390+0000","last_change":"2023-10-06T02:17:44.021996+0000","last_active":"2023-10-06T02:17:48.037390+0000","last_peered":"2023-10-06T02:17:48.037390+0000","last_clean":"2023-10-06T02:17:48.037390+0000","last_became_active":"2023-10-06T02:17:44.020844+0000","last_became_peered":"2023-10-06T02:17:44.020844+0000","last_unstale":"2023-10-06T02:17:48.037390+0000","last_undegraded":"2023-10-06T02:17:48.037390+0000","last_fullsized":"2023-10-06T02:17:48.037390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:04.413740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.059287+0000","last_change":"2023-10-06T02:17:48.052318+0000","last_active":"2023-10-06T02:17:48.059287+0000","last_peered":"2023-10-06T02:17:48.059287+0000","last_clean":"2023-10-06T02:17:48.059287+0000","last_became_active":"2023-10-06T02:17:48.051887+0000","last_became_peered":"2023-10-06T02:17:48.051887+0000","last_unstale":"2023-10-06T02:17:48.059287+0000","last_undegraded":"2023-10-06T02:17:48.059287+0000","last_fullsized":"2023-10-06T02:17:48.059287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:54.026670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039797+0000","last_change":"2023-10-06T02:17:43.017227+0000","last_active":"2023-10-06T02:17:48.039797+0000","last_peered":"2023-10-06T02:17:48.039797+0000","last_clean":"2023-10-06T02:17:48.039797+0000","last_became_active":"2023-10-06T02:17:43.016966+0000","last_became_peered":"2023-10-06T02:17:43.016966+0000","last_unstale":"2023-10-06T02:17:48.039797+0000","last_undegraded":"2023-10-06T02:17:48.039797+0000","last_fullsized":"2023-10-06T02:17:48.039797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.033379+0000","last_change":"2023-10-06T02:17:44.003483+0000","last_active":"2023-10-06T02:17:48.033379+0000","last_peered":"2023-10-06T02:17:48.033379+0000","last_clean":"2023-10-06T02:17:48.033379+0000","last_became_active":"2023-10-06T02:17:44.003206+0000","last_became_peered":"2023-10-06T02:17:44.003206+0000","last_unstale":"2023-10-06T02:17:48.033379+0000","last_undegraded":"2023-10-06T02:17:48.033379+0000","last_fullsized":"2023-10-06T02:17:48.033379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:41.549349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.053844+0000","last_change":"2023-10-06T02:17:48.048415+0000","last_active":"2023-10-06T02:17:48.053844+0000","last_peered":"2023-10-06T02:17:48.053844+0000","last_clean":"2023-10-06T02:17:48.053844+0000","last_became_active":"2023-10-06T02:17:48.048056+0000","last_became_peered":"2023-10-06T02:17:48.048056+0000","last_unstale":"2023-10-06T02:17:48.053844+0000","last_undegraded":"2023-10-06T02:17:48.053844+0000","last_fullsized":"2023-10-06T02:17:48.053844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:09.781175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030566+0000","last_change":"2023-10-06T02:17:43.012134+0000","last_active":"2023-10-06T02:17:48.030566+0000","last_peered":"2023-10-06T02:17:48.030566+0000","last_clean":"2023-10-06T02:17:48.030566+0000","last_became_active":"2023-10-06T02:17:43.011834+0000","last_became_peered":"2023-10-06T02:17:43.011834+0000","last_unstale":"2023-10-06T02:17:48.030566+0000","last_undegraded":"2023-10-06T02:17:48.030566+0000","last_fullsized":"2023-10-06T02:17:48.030566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.543085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039990+0000","last_change":"2023-10-06T02:17:44.024658+0000","last_active":"2023-10-06T02:17:48.039990+0000","last_peered":"2023-10-06T02:17:48.039990+0000","last_clean":"2023-10-06T02:17:48.039990+0000","last_became_active":"2023-10-06T02:17:44.023854+0000","last_became_peered":"2023-10-06T02:17:44.023854+0000","last_unstale":"2023-10-06T02:17:48.039990+0000","last_undegraded":"2023-10-06T02:17:48.039990+0000","last_fullsized":"2023-10-06T02:17:48.039990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:49.992736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.056354+0000","last_change":"2023-10-06T02:17:48.054318+0000","last_active":"2023-10-06T02:17:48.056354+0000","last_peered":"2023-10-06T02:17:48.056354+0000","last_clean":"2023-10-06T02:17:48.056354+0000","last_became_active":"2023-10-06T02:17:48.053924+0000","last_became_peered":"2023-10-06T02:17:48.053924+0000","last_unstale":"2023-10-06T02:17:48.056354+0000","last_undegraded":"2023-10-06T02:17:48.056354+0000","last_fullsized":"2023-10-06T02:17:48.056354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:29.446681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037465+0000","last_change":"2023-10-06T02:17:43.017268+0000","last_active":"2023-10-06T02:17:48.037465+0000","last_peered":"2023-10-06T02:17:48.037465+0000","last_clean":"2023-10-06T02:17:48.037465+0000","last_became_active":"2023-10-06T02:17:43.016981+0000","last_became_peered":"2023-10-06T02:17:43.016981+0000","last_unstale":"2023-10-06T02:17:48.037465+0000","last_undegraded":"2023-10-06T02:17:48.037465+0000","last_fullsized":"2023-10-06T02:17:48.037465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038414+0000","last_change":"2023-10-06T02:17:44.023712+0000","last_active":"2023-10-06T02:17:48.038414+0000","last_peered":"2023-10-06T02:17:48.038414+0000","last_clean":"2023-10-06T02:17:48.038414+0000","last_became_active":"2023-10-06T02:17:44.023412+0000","last_became_peered":"2023-10-06T02:17:44.023412+0000","last_unstale":"2023-10-06T02:17:48.038414+0000","last_undegraded":"2023-10-06T02:17:48.038414+0000","last_fullsized":"2023-10-06T02:17:48.038414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:26.577679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060912+0000","last_change":"2023-10-06T02:17:48.054660+0000","last_active":"2023-10-06T02:17:48.060912+0000","last_peered":"2023-10-06T02:17:48.060912+0000","last_clean":"2023-10-06T02:17:48.060912+0000","last_became_active":"2023-10-06T02:17:48.054270+0000","last_became_peered":"2023-10-06T02:17:48.054270+0000","last_unstale":"2023-10-06T02:17:48.060912+0000","last_undegraded":"2023-10-06T02:17:48.060912+0000","last_fullsized":"2023-10-06T02:17:48.060912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:59.085352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.044929+0000","last_change":"2023-10-06T02:17:43.013434+0000","last_active":"2023-10-06T02:17:48.044929+0000","last_peered":"2023-10-06T02:17:48.044929+0000","last_clean":"2023-10-06T02:17:48.044929+0000","last_became_active":"2023-10-06T02:17:43.013144+0000","last_became_peered":"2023-10-06T02:17:43.013144+0000","last_unstale":"2023-10-06T02:17:48.044929+0000","last_undegraded":"2023-10-06T02:17:48.044929+0000","last_fullsized":"2023-10-06T02:17:48.044929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:59.054001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045040+0000","last_change":"2023-10-06T02:17:44.020588+0000","last_active":"2023-10-06T02:17:48.045040+0000","last_peered":"2023-10-06T02:17:48.045040+0000","last_clean":"2023-10-06T02:17:48.045040+0000","last_became_active":"2023-10-06T02:17:44.020305+0000","last_became_peered":"2023-10-06T02:17:44.020305+0000","last_unstale":"2023-10-06T02:17:48.045040+0000","last_undegraded":"2023-10-06T02:17:48.045040+0000","last_fullsized":"2023-10-06T02:17:48.045040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:51.564963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.063145+0000","last_change":"2023-10-06T02:17:48.061567+0000","last_active":"2023-10-06T02:17:48.063145+0000","last_peered":"2023-10-06T02:17:48.063145+0000","last_clean":"2023-10-06T02:17:48.063145+0000","last_became_active":"2023-10-06T02:17:48.061209+0000","last_became_peered":"2023-10-06T02:17:48.061209+0000","last_unstale":"2023-10-06T02:17:48.063145+0000","last_undegraded":"2023-10-06T02:17:48.063145+0000","last_fullsized":"2023-10-06T02:17:48.063145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:05.058794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031418+0000","last_change":"2023-10-06T02:17:43.009617+0000","last_active":"2023-10-06T02:17:48.031418+0000","last_peered":"2023-10-06T02:17:48.031418+0000","last_clean":"2023-10-06T02:17:48.031418+0000","last_became_active":"2023-10-06T02:17:43.009347+0000","last_became_peered":"2023-10-06T02:17:43.009347+0000","last_unstale":"2023-10-06T02:17:48.031418+0000","last_undegraded":"2023-10-06T02:17:48.031418+0000","last_fullsized":"2023-10-06T02:17:48.031418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:59.054001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050566+0000","last_change":"2023-10-06T02:17:44.013663+0000","last_active":"2023-10-06T02:17:48.050566+0000","last_peered":"2023-10-06T02:17:48.050566+0000","last_clean":"2023-10-06T02:17:48.050566+0000","last_became_active":"2023-10-06T02:17:44.013346+0000","last_became_peered":"2023-10-06T02:17:44.013346+0000","last_unstale":"2023-10-06T02:17:48.050566+0000","last_undegraded":"2023-10-06T02:17:48.050566+0000","last_fullsized":"2023-10-06T02:17:48.050566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:21.073260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060535+0000","last_change":"2023-10-06T02:17:48.055404+0000","last_active":"2023-10-06T02:17:48.060535+0000","last_peered":"2023-10-06T02:17:48.060535+0000","last_clean":"2023-10-06T02:17:48.060535+0000","last_became_active":"2023-10-06T02:17:48.055037+0000","last_became_peered":"2023-10-06T02:17:48.055037+0000","last_unstale":"2023-10-06T02:17:48.060535+0000","last_undegraded":"2023-10-06T02:17:48.060535+0000","last_fullsized":"2023-10-06T02:17:48.060535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:39.126641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030793+0000","last_change":"2023-10-06T02:17:43.012193+0000","last_active":"2023-10-06T02:17:48.030793+0000","last_peered":"2023-10-06T02:17:48.030793+0000","last_clean":"2023-10-06T02:17:48.030793+0000","last_became_active":"2023-10-06T02:17:43.011988+0000","last_became_peered":"2023-10-06T02:17:43.011988+0000","last_unstale":"2023-10-06T02:17:48.030793+0000","last_undegraded":"2023-10-06T02:17:48.030793+0000","last_fullsized":"2023-10-06T02:17:48.030793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:56.588125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038558+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:17:48.038558+0000","last_peered":"2023-10-06T02:17:48.038558+0000","last_clean":"2023-10-06T02:17:48.038558+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:17:48.038558+0000","last_undegraded":"2023-10-06T02:17:48.038558+0000","last_fullsized":"2023-10-06T02:17:48.038558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031321+0000","last_change":"2023-10-06T02:17:44.017661+0000","last_active":"2023-10-06T02:17:48.031321+0000","last_peered":"2023-10-06T02:17:48.031321+0000","last_clean":"2023-10-06T02:17:48.031321+0000","last_became_active":"2023-10-06T02:17:44.017396+0000","last_became_peered":"2023-10-06T02:17:44.017396+0000","last_unstale":"2023-10-06T02:17:48.031321+0000","last_undegraded":"2023-10-06T02:17:48.031321+0000","last_fullsized":"2023-10-06T02:17:48.031321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.055474+0000","last_change":"2023-10-06T02:17:48.051546+0000","last_active":"2023-10-06T02:17:48.055474+0000","last_peered":"2023-10-06T02:17:48.055474+0000","last_clean":"2023-10-06T02:17:48.055474+0000","last_became_active":"2023-10-06T02:17:48.051146+0000","last_became_peered":"2023-10-06T02:17:48.051146+0000","last_unstale":"2023-10-06T02:17:48.055474+0000","last_undegraded":"2023-10-06T02:17:48.055474+0000","last_fullsized":"2023-10-06T02:17:48.055474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:03.948559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030433+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:17:48.030433+0000","last_peered":"2023-10-06T02:17:48.030433+0000","last_clean":"2023-10-06T02:17:48.030433+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:17:48.030433+0000","last_undegraded":"2023-10-06T02:17:48.030433+0000","last_fullsized":"2023-10-06T02:17:48.030433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.057902+0000","last_change":"2023-10-06T02:17:43.001598+0000","last_active":"2023-10-06T02:17:48.057902+0000","last_peered":"2023-10-06T02:17:48.057902+0000","last_clean":"2023-10-06T02:17:48.057902+0000","last_became_active":"2023-10-06T02:17:43.000830+0000","last_became_peered":"2023-10-06T02:17:43.000830+0000","last_unstale":"2023-10-06T02:17:48.057902+0000","last_undegraded":"2023-10-06T02:17:48.057902+0000","last_fullsized":"2023-10-06T02:17:48.057902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:31.631012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045023+0000","last_change":"2023-10-06T02:17:44.022761+0000","last_active":"2023-10-06T02:17:48.045023+0000","last_peered":"2023-10-06T02:17:48.045023+0000","last_clean":"2023-10-06T02:17:48.045023+0000","last_became_active":"2023-10-06T02:17:44.022519+0000","last_became_peered":"2023-10-06T02:17:44.022519+0000","last_unstale":"2023-10-06T02:17:48.045023+0000","last_undegraded":"2023-10-06T02:17:48.045023+0000","last_fullsized":"2023-10-06T02:17:48.045023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:01.914117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060933+0000","last_change":"2023-10-06T02:17:48.057692+0000","last_active":"2023-10-06T02:17:48.060933+0000","last_peered":"2023-10-06T02:17:48.060933+0000","last_clean":"2023-10-06T02:17:48.060933+0000","last_became_active":"2023-10-06T02:17:48.057291+0000","last_became_peered":"2023-10-06T02:17:48.057291+0000","last_unstale":"2023-10-06T02:17:48.060933+0000","last_undegraded":"2023-10-06T02:17:48.060933+0000","last_fullsized":"2023-10-06T02:17:48.060933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:50.051594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045953+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:17:48.045953+0000","last_peered":"2023-10-06T02:17:48.045953+0000","last_clean":"2023-10-06T02:17:48.045953+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:17:48.045953+0000","last_undegraded":"2023-10-06T02:17:48.045953+0000","last_fullsized":"2023-10-06T02:17:48.045953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037402+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:17:48.037402+0000","last_peered":"2023-10-06T02:17:48.037402+0000","last_clean":"2023-10-06T02:17:48.037402+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:17:48.037402+0000","last_undegraded":"2023-10-06T02:17:48.037402+0000","last_fullsized":"2023-10-06T02:17:48.037402+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030986+0000","last_change":"2023-10-06T02:17:43.008254+0000","last_active":"2023-10-06T02:17:48.030986+0000","last_peered":"2023-10-06T02:17:48.030986+0000","last_clean":"2023-10-06T02:17:48.030986+0000","last_became_active":"2023-10-06T02:17:43.008031+0000","last_became_peered":"2023-10-06T02:17:43.008031+0000","last_unstale":"2023-10-06T02:17:48.030986+0000","last_undegraded":"2023-10-06T02:17:48.030986+0000","last_fullsized":"2023-10-06T02:17:48.030986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.543085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031988+0000","last_change":"2023-10-06T02:17:44.015903+0000","last_active":"2023-10-06T02:17:48.031988+0000","last_peered":"2023-10-06T02:17:48.031988+0000","last_clean":"2023-10-06T02:17:48.031988+0000","last_became_active":"2023-10-06T02:17:44.012940+0000","last_became_peered":"2023-10-06T02:17:44.012940+0000","last_unstale":"2023-10-06T02:17:48.031988+0000","last_undegraded":"2023-10-06T02:17:48.031988+0000","last_fullsized":"2023-10-06T02:17:48.031988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:11.590274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.058344+0000","last_change":"2023-10-06T02:17:48.054067+0000","last_active":"2023-10-06T02:17:48.058344+0000","last_peered":"2023-10-06T02:17:48.058344+0000","last_clean":"2023-10-06T02:17:48.058344+0000","last_became_active":"2023-10-06T02:17:48.053658+0000","last_became_peered":"2023-10-06T02:17:48.053658+0000","last_unstale":"2023-10-06T02:17:48.058344+0000","last_undegraded":"2023-10-06T02:17:48.058344+0000","last_fullsized":"2023-10-06T02:17:48.058344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:05.948051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036157+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:17:48.036157+0000","last_peered":"2023-10-06T02:17:48.036157+0000","last_clean":"2023-10-06T02:17:48.036157+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:17:48.036157+0000","last_undegraded":"2023-10-06T02:17:48.036157+0000","last_fullsized":"2023-10-06T02:17:48.036157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045745+0000","last_change":"2023-10-06T02:17:43.007395+0000","last_active":"2023-10-06T02:17:48.045745+0000","last_peered":"2023-10-06T02:17:48.045745+0000","last_clean":"2023-10-06T02:17:48.045745+0000","last_became_active":"2023-10-06T02:17:43.007096+0000","last_became_peered":"2023-10-06T02:17:43.007096+0000","last_unstale":"2023-10-06T02:17:48.045745+0000","last_undegraded":"2023-10-06T02:17:48.045745+0000","last_fullsized":"2023-10-06T02:17:48.045745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:31.631012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050492+0000","last_change":"2023-10-06T02:17:44.024048+0000","last_active":"2023-10-06T02:17:48.050492+0000","last_peered":"2023-10-06T02:17:48.050492+0000","last_clean":"2023-10-06T02:17:48.050492+0000","last_became_active":"2023-10-06T02:17:44.023785+0000","last_became_peered":"2023-10-06T02:17:44.023785+0000","last_unstale":"2023-10-06T02:17:48.050492+0000","last_undegraded":"2023-10-06T02:17:48.050492+0000","last_fullsized":"2023-10-06T02:17:48.050492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.051840+0000","last_change":"2023-10-06T02:17:48.049159+0000","last_active":"2023-10-06T02:17:48.051840+0000","last_peered":"2023-10-06T02:17:48.051840+0000","last_clean":"2023-10-06T02:17:48.051840+0000","last_became_active":"2023-10-06T02:17:48.048030+0000","last_became_peered":"2023-10-06T02:17:48.048030+0000","last_unstale":"2023-10-06T02:17:48.051840+0000","last_undegraded":"2023-10-06T02:17:48.051840+0000","last_fullsized":"2023-10-06T02:17:48.051840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:59.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036269+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:17:48.036269+0000","last_peered":"2023-10-06T02:17:48.036269+0000","last_clean":"2023-10-06T02:17:48.036269+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:17:48.036269+0000","last_undegraded":"2023-10-06T02:17:48.036269+0000","last_fullsized":"2023-10-06T02:17:48.036269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030334+0000","last_change":"2023-10-06T02:17:43.012903+0000","last_active":"2023-10-06T02:17:48.030334+0000","last_peered":"2023-10-06T02:17:48.030334+0000","last_clean":"2023-10-06T02:17:48.030334+0000","last_became_active":"2023-10-06T02:17:43.012602+0000","last_became_peered":"2023-10-06T02:17:43.012602+0000","last_unstale":"2023-10-06T02:17:48.030334+0000","last_undegraded":"2023-10-06T02:17:48.030334+0000","last_fullsized":"2023-10-06T02:17:48.030334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:09.638074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040168+0000","last_change":"2023-10-06T02:17:44.017466+0000","last_active":"2023-10-06T02:17:48.040168+0000","last_peered":"2023-10-06T02:17:48.040168+0000","last_clean":"2023-10-06T02:17:48.040168+0000","last_became_active":"2023-10-06T02:17:44.017213+0000","last_became_peered":"2023-10-06T02:17:44.017213+0000","last_unstale":"2023-10-06T02:17:48.040168+0000","last_undegraded":"2023-10-06T02:17:48.040168+0000","last_fullsized":"2023-10-06T02:17:48.040168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:43.352906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.059484+0000","last_change":"2023-10-06T02:17:48.053794+0000","last_active":"2023-10-06T02:17:48.059484+0000","last_peered":"2023-10-06T02:17:48.059484+0000","last_clean":"2023-10-06T02:17:48.059484+0000","last_became_active":"2023-10-06T02:17:48.053274+0000","last_became_peered":"2023-10-06T02:17:48.053274+0000","last_unstale":"2023-10-06T02:17:48.059484+0000","last_undegraded":"2023-10-06T02:17:48.059484+0000","last_fullsized":"2023-10-06T02:17:48.059484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:29.446681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037498+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:17:48.037498+0000","last_peered":"2023-10-06T02:17:48.037498+0000","last_clean":"2023-10-06T02:17:48.037498+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:17:48.037498+0000","last_undegraded":"2023-10-06T02:17:48.037498+0000","last_fullsized":"2023-10-06T02:17:48.037498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039136+0000","last_change":"2023-10-06T02:17:43.013138+0000","last_active":"2023-10-06T02:17:48.039136+0000","last_peered":"2023-10-06T02:17:48.039136+0000","last_clean":"2023-10-06T02:17:48.039136+0000","last_became_active":"2023-10-06T02:17:43.012841+0000","last_became_peered":"2023-10-06T02:17:43.012841+0000","last_unstale":"2023-10-06T02:17:48.039136+0000","last_undegraded":"2023-10-06T02:17:48.039136+0000","last_fullsized":"2023-10-06T02:17:48.039136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:55.863203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.047850+0000","last_change":"2023-10-06T02:17:44.011211+0000","last_active":"2023-10-06T02:17:48.047850+0000","last_peered":"2023-10-06T02:17:48.047850+0000","last_clean":"2023-10-06T02:17:48.047850+0000","last_became_active":"2023-10-06T02:17:44.010694+0000","last_became_peered":"2023-10-06T02:17:44.010694+0000","last_unstale":"2023-10-06T02:17:48.047850+0000","last_undegraded":"2023-10-06T02:17:48.047850+0000","last_fullsized":"2023-10-06T02:17:48.047850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:12.022239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.052188+0000","last_change":"2023-10-06T02:17:48.049434+0000","last_active":"2023-10-06T02:17:48.052188+0000","last_peered":"2023-10-06T02:17:48.052188+0000","last_clean":"2023-10-06T02:17:48.052188+0000","last_became_active":"2023-10-06T02:17:48.049050+0000","last_became_peered":"2023-10-06T02:17:48.049050+0000","last_unstale":"2023-10-06T02:17:48.052188+0000","last_undegraded":"2023-10-06T02:17:48.052188+0000","last_fullsized":"2023-10-06T02:17:48.052188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:58.565730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039175+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:17:48.039175+0000","last_peered":"2023-10-06T02:17:48.039175+0000","last_clean":"2023-10-06T02:17:48.039175+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:17:48.039175+0000","last_undegraded":"2023-10-06T02:17:48.039175+0000","last_fullsized":"2023-10-06T02:17:48.039175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.048170+0000","last_change":"2023-10-06T02:17:43.009389+0000","last_active":"2023-10-06T02:17:48.048170+0000","last_peered":"2023-10-06T02:17:48.048170+0000","last_clean":"2023-10-06T02:17:48.048170+0000","last_became_active":"2023-10-06T02:17:43.009070+0000","last_became_peered":"2023-10-06T02:17:43.009070+0000","last_unstale":"2023-10-06T02:17:48.048170+0000","last_undegraded":"2023-10-06T02:17:48.048170+0000","last_fullsized":"2023-10-06T02:17:48.048170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:34.508977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.033624+0000","last_change":"2023-10-06T02:17:44.022296+0000","last_active":"2023-10-06T02:17:48.033624+0000","last_peered":"2023-10-06T02:17:48.033624+0000","last_clean":"2023-10-06T02:17:48.033624+0000","last_became_active":"2023-10-06T02:17:44.022032+0000","last_became_peered":"2023-10-06T02:17:44.022032+0000","last_unstale":"2023-10-06T02:17:48.033624+0000","last_undegraded":"2023-10-06T02:17:48.033624+0000","last_fullsized":"2023-10-06T02:17:48.033624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:56.966356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.058436+0000","last_change":"2023-10-06T02:17:48.049537+0000","last_active":"2023-10-06T02:17:48.058436+0000","last_peered":"2023-10-06T02:17:48.058436+0000","last_clean":"2023-10-06T02:17:48.058436+0000","last_became_active":"2023-10-06T02:17:48.049150+0000","last_became_peered":"2023-10-06T02:17:48.049150+0000","last_unstale":"2023-10-06T02:17:48.058436+0000","last_undegraded":"2023-10-06T02:17:48.058436+0000","last_fullsized":"2023-10-06T02:17:48.058436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:20.999472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039792+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:17:48.039792+0000","last_peered":"2023-10-06T02:17:48.039792+0000","last_clean":"2023-10-06T02:17:48.039792+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:17:48.039792+0000","last_undegraded":"2023-10-06T02:17:48.039792+0000","last_fullsized":"2023-10-06T02:17:48.039792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040044+0000","last_change":"2023-10-06T02:17:43.017470+0000","last_active":"2023-10-06T02:17:48.040044+0000","last_peered":"2023-10-06T02:17:48.040044+0000","last_clean":"2023-10-06T02:17:48.040044+0000","last_became_active":"2023-10-06T02:17:43.017001+0000","last_became_peered":"2023-10-06T02:17:43.017001+0000","last_unstale":"2023-10-06T02:17:48.040044+0000","last_undegraded":"2023-10-06T02:17:48.040044+0000","last_fullsized":"2023-10-06T02:17:48.040044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:59.054001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045239+0000","last_change":"2023-10-06T02:17:44.019859+0000","last_active":"2023-10-06T02:17:48.045239+0000","last_peered":"2023-10-06T02:17:48.045239+0000","last_clean":"2023-10-06T02:17:48.045239+0000","last_became_active":"2023-10-06T02:17:44.019178+0000","last_became_peered":"2023-10-06T02:17:44.019178+0000","last_unstale":"2023-10-06T02:17:48.045239+0000","last_undegraded":"2023-10-06T02:17:48.045239+0000","last_fullsized":"2023-10-06T02:17:48.045239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:41.549349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.059488+0000","last_change":"2023-10-06T02:17:48.056833+0000","last_active":"2023-10-06T02:17:48.059488+0000","last_peered":"2023-10-06T02:17:48.059488+0000","last_clean":"2023-10-06T02:17:48.059488+0000","last_became_active":"2023-10-06T02:17:48.056428+0000","last_became_peered":"2023-10-06T02:17:48.056428+0000","last_unstale":"2023-10-06T02:17:48.059488+0000","last_undegraded":"2023-10-06T02:17:48.059488+0000","last_fullsized":"2023-10-06T02:17:48.059488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:04.977537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.033524+0000","last_change":"2023-10-06T02:17:43.016304+0000","last_active":"2023-10-06T02:17:48.033524+0000","last_peered":"2023-10-06T02:17:48.033524+0000","last_clean":"2023-10-06T02:17:48.033524+0000","last_became_active":"2023-10-06T02:17:43.015998+0000","last_became_peered":"2023-10-06T02:17:43.015998+0000","last_unstale":"2023-10-06T02:17:48.033524+0000","last_undegraded":"2023-10-06T02:17:48.033524+0000","last_fullsized":"2023-10-06T02:17:48.033524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:09.638074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031489+0000","last_change":"2023-10-06T02:17:44.012571+0000","last_active":"2023-10-06T02:17:48.031489+0000","last_peered":"2023-10-06T02:17:48.031489+0000","last_clean":"2023-10-06T02:17:48.031489+0000","last_became_active":"2023-10-06T02:17:44.012245+0000","last_became_peered":"2023-10-06T02:17:44.012245+0000","last_unstale":"2023-10-06T02:17:48.031489+0000","last_undegraded":"2023-10-06T02:17:48.031489+0000","last_fullsized":"2023-10-06T02:17:48.031489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:56.870377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.061274+0000","last_change":"2023-10-06T02:17:48.057885+0000","last_active":"2023-10-06T02:17:48.061274+0000","last_peered":"2023-10-06T02:17:48.061274+0000","last_clean":"2023-10-06T02:17:48.061274+0000","last_became_active":"2023-10-06T02:17:48.057470+0000","last_became_peered":"2023-10-06T02:17:48.057470+0000","last_unstale":"2023-10-06T02:17:48.061274+0000","last_undegraded":"2023-10-06T02:17:48.061274+0000","last_fullsized":"2023-10-06T02:17:48.061274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:34.306615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039047+0000","last_change":"2023-10-06T02:17:43.014240+0000","last_active":"2023-10-06T02:17:48.039047+0000","last_peered":"2023-10-06T02:17:48.039047+0000","last_clean":"2023-10-06T02:17:48.039047+0000","last_became_active":"2023-10-06T02:17:43.013995+0000","last_became_peered":"2023-10-06T02:17:43.013995+0000","last_unstale":"2023-10-06T02:17:48.039047+0000","last_undegraded":"2023-10-06T02:17:48.039047+0000","last_fullsized":"2023-10-06T02:17:48.039047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:09.638074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039278+0000","last_change":"2023-10-06T02:17:44.012631+0000","last_active":"2023-10-06T02:17:48.039278+0000","last_peered":"2023-10-06T02:17:48.039278+0000","last_clean":"2023-10-06T02:17:48.039278+0000","last_became_active":"2023-10-06T02:17:44.012366+0000","last_became_peered":"2023-10-06T02:17:44.012366+0000","last_unstale":"2023-10-06T02:17:48.039278+0000","last_undegraded":"2023-10-06T02:17:48.039278+0000","last_fullsized":"2023-10-06T02:17:48.039278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:11.590274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060285+0000","last_change":"2023-10-06T02:17:48.054598+0000","last_active":"2023-10-06T02:17:48.060285+0000","last_peered":"2023-10-06T02:17:48.060285+0000","last_clean":"2023-10-06T02:17:48.060285+0000","last_became_active":"2023-10-06T02:17:48.054196+0000","last_became_peered":"2023-10-06T02:17:48.054196+0000","last_unstale":"2023-10-06T02:17:48.060285+0000","last_undegraded":"2023-10-06T02:17:48.060285+0000","last_fullsized":"2023-10-06T02:17:48.060285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:59.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039960+0000","last_change":"2023-10-06T02:17:43.015890+0000","last_active":"2023-10-06T02:17:48.039960+0000","last_peered":"2023-10-06T02:17:48.039960+0000","last_clean":"2023-10-06T02:17:48.039960+0000","last_became_active":"2023-10-06T02:17:43.015544+0000","last_became_peered":"2023-10-06T02:17:43.015544+0000","last_unstale":"2023-10-06T02:17:48.039960+0000","last_undegraded":"2023-10-06T02:17:48.039960+0000","last_fullsized":"2023-10-06T02:17:48.039960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.543085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037516+0000","last_change":"2023-10-06T02:17:44.027369+0000","last_active":"2023-10-06T02:17:48.037516+0000","last_peered":"2023-10-06T02:17:48.037516+0000","last_clean":"2023-10-06T02:17:48.037516+0000","last_became_active":"2023-10-06T02:17:44.026967+0000","last_became_peered":"2023-10-06T02:17:44.026967+0000","last_unstale":"2023-10-06T02:17:48.037516+0000","last_undegraded":"2023-10-06T02:17:48.037516+0000","last_fullsized":"2023-10-06T02:17:48.037516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:56.966356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.063103+0000","last_change":"2023-10-06T02:17:48.060867+0000","last_active":"2023-10-06T02:17:48.063103+0000","last_peered":"2023-10-06T02:17:48.063103+0000","last_clean":"2023-10-06T02:17:48.063103+0000","last_became_active":"2023-10-06T02:17:48.060507+0000","last_became_peered":"2023-10-06T02:17:48.060507+0000","last_unstale":"2023-10-06T02:17:48.063103+0000","last_undegraded":"2023-10-06T02:17:48.063103+0000","last_fullsized":"2023-10-06T02:17:48.063103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:41.579573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031205+0000","last_change":"2023-10-06T02:17:43.010564+0000","last_active":"2023-10-06T02:17:48.031205+0000","last_peered":"2023-10-06T02:17:48.031205+0000","last_clean":"2023-10-06T02:17:48.031205+0000","last_became_active":"2023-10-06T02:17:43.008507+0000","last_became_peered":"2023-10-06T02:17:43.008507+0000","last_unstale":"2023-10-06T02:17:48.031205+0000","last_undegraded":"2023-10-06T02:17:48.031205+0000","last_fullsized":"2023-10-06T02:17:48.031205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:55.863203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030181+0000","last_change":"2023-10-06T02:17:44.023457+0000","last_active":"2023-10-06T02:17:48.030181+0000","last_peered":"2023-10-06T02:17:48.030181+0000","last_clean":"2023-10-06T02:17:48.030181+0000","last_became_active":"2023-10-06T02:17:44.022723+0000","last_became_peered":"2023-10-06T02:17:44.022723+0000","last_unstale":"2023-10-06T02:17:48.030181+0000","last_undegraded":"2023-10-06T02:17:48.030181+0000","last_fullsized":"2023-10-06T02:17:48.030181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:56.966356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060390+0000","last_change":"2023-10-06T02:17:48.058509+0000","last_active":"2023-10-06T02:17:48.060390+0000","last_peered":"2023-10-06T02:17:48.060390+0000","last_clean":"2023-10-06T02:17:48.060390+0000","last_became_active":"2023-10-06T02:17:48.058112+0000","last_became_peered":"2023-10-06T02:17:48.058112+0000","last_unstale":"2023-10-06T02:17:48.060390+0000","last_undegraded":"2023-10-06T02:17:48.060390+0000","last_fullsized":"2023-10-06T02:17:48.060390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:59.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031046+0000","last_change":"2023-10-06T02:17:43.013591+0000","last_active":"2023-10-06T02:17:48.031046+0000","last_peered":"2023-10-06T02:17:48.031046+0000","last_clean":"2023-10-06T02:17:48.031046+0000","last_became_active":"2023-10-06T02:17:43.013150+0000","last_became_peered":"2023-10-06T02:17:43.013150+0000","last_unstale":"2023-10-06T02:17:48.031046+0000","last_undegraded":"2023-10-06T02:17:48.031046+0000","last_fullsized":"2023-10-06T02:17:48.031046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:55.863203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036796+0000","last_change":"2023-10-06T02:17:44.021121+0000","last_active":"2023-10-06T02:17:48.036796+0000","last_peered":"2023-10-06T02:17:48.036796+0000","last_clean":"2023-10-06T02:17:48.036796+0000","last_became_active":"2023-10-06T02:17:44.020849+0000","last_became_peered":"2023-10-06T02:17:44.020849+0000","last_unstale":"2023-10-06T02:17:48.036796+0000","last_undegraded":"2023-10-06T02:17:48.036796+0000","last_fullsized":"2023-10-06T02:17:48.036796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.060566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039127+0000","last_change":"2023-10-06T02:17:44.025857+0000","last_active":"2023-10-06T02:17:48.039127+0000","last_peered":"2023-10-06T02:17:48.039127+0000","last_clean":"2023-10-06T02:17:48.039127+0000","last_became_active":"2023-10-06T02:17:44.025639+0000","last_became_peered":"2023-10-06T02:17:44.025639+0000","last_unstale":"2023-10-06T02:17:48.039127+0000","last_undegraded":"2023-10-06T02:17:48.039127+0000","last_fullsized":"2023-10-06T02:17:48.039127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:22.992220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030199+0000","last_change":"2023-10-06T02:17:44.021795+0000","last_active":"2023-10-06T02:17:48.030199+0000","last_peered":"2023-10-06T02:17:48.030199+0000","last_clean":"2023-10-06T02:17:48.030199+0000","last_became_active":"2023-10-06T02:17:44.021519+0000","last_became_peered":"2023-10-06T02:17:44.021519+0000","last_unstale":"2023-10-06T02:17:48.030199+0000","last_undegraded":"2023-10-06T02:17:48.030199+0000","last_fullsized":"2023-10-06T02:17:48.030199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:29.729845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037699+0000","last_change":"2023-10-06T02:17:44.020596+0000","last_active":"2023-10-06T02:17:48.037699+0000","last_peered":"2023-10-06T02:17:48.037699+0000","last_clean":"2023-10-06T02:17:48.037699+0000","last_became_active":"2023-10-06T02:17:44.020327+0000","last_became_peered":"2023-10-06T02:17:44.020327+0000","last_unstale":"2023-10-06T02:17:48.037699+0000","last_undegraded":"2023-10-06T02:17:48.037699+0000","last_fullsized":"2023-10-06T02:17:48.037699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:08.638757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031988+0000","last_change":"2023-10-06T02:17:44.023963+0000","last_active":"2023-10-06T02:17:48.031988+0000","last_peered":"2023-10-06T02:17:48.031988+0000","last_clean":"2023-10-06T02:17:48.031988+0000","last_became_active":"2023-10-06T02:17:44.023520+0000","last_became_peered":"2023-10-06T02:17:44.023520+0000","last_unstale":"2023-10-06T02:17:48.031988+0000","last_undegraded":"2023-10-06T02:17:48.031988+0000","last_fullsized":"2023-10-06T02:17:48.031988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:05.747241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.048071+0000","last_change":"2023-10-06T02:17:44.014573+0000","last_active":"2023-10-06T02:17:48.048071+0000","last_peered":"2023-10-06T02:17:48.048071+0000","last_clean":"2023-10-06T02:17:48.048071+0000","last_became_active":"2023-10-06T02:17:44.014301+0000","last_became_peered":"2023-10-06T02:17:44.014301+0000","last_unstale":"2023-10-06T02:17:48.048071+0000","last_undegraded":"2023-10-06T02:17:48.048071+0000","last_fullsized":"2023-10-06T02:17:48.048071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:04.413740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":703395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":108144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298124,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073716,"statfs":{"total":96636764160,"available":96331485184,"internally_reserved":0,"allocated":856064,"data_stored":698512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":108144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":112867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":109721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:18:02.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:18:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.629+0000 7ffbcb19f700 1 Processor -- start 2023-10-06T02:18:02.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.629+0000 7ffbcb19f700 1 -- start start 2023-10-06T02:18:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.630+0000 7ffbcb19f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbc40af8b0 0x7ffbc415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.630+0000 7ffbcb19f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffbc40b27f0 0x7ffbc415d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.630+0000 7ffbcb19f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc415e190 con 0x7ffbc40af4e0 2023-10-06T02:18:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.630+0000 7ffbcb19f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc40b1910 con 0x7ffbc40b27f0 2023-10-06T02:18:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.630+0000 7ffbcb19f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc40cb650 con 0x7ffbc40af8b0 2023-10-06T02:18:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.630+0000 7ffbc8f3b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ffbc40af4e0 0x7ffbc40b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36166/0 (socket says 172.21.15.6:36166) 2023-10-06T02:18:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.630+0000 7ffbc8f3b700 1 -- 172.21.15.6:0/659747183 learned_addr learned my addr 172.21.15.6:0/659747183 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.630+0000 7ffbc973c700 1 --2- 172.21.15.6:0/659747183 >> v2:172.21.15.6:3300/0 conn(0x7ffbc40b27f0 0x7ffbc415d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.630+0000 7ffbc3fff700 1 --2- 172.21.15.6:0/659747183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbc40af8b0 0x7ffbc415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.630+0000 7ffbc973c700 1 -- 172.21.15.6:0/659747183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbc40af8b0 msgr2=0x7ffbc415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.630+0000 7ffbc973c700 1 --2- 172.21.15.6:0/659747183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbc40af8b0 0x7ffbc415d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.630+0000 7ffbc973c700 1 -- 172.21.15.6:0/659747183 >> v1:172.21.15.6:6789/0 conn(0x7ffbc40af4e0 legacy=0x7ffbc40b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.630+0000 7ffbc37fe700 1 -- 172.21.15.6:0/659747183 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351088714 0 0) 0x7ffbc415e190 con 0x7ffbc40af4e0 2023-10-06T02:18:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.630+0000 7ffbc973c700 1 -- 172.21.15.6:0/659747183 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc40ccaf0 con 0x7ffbc40b27f0 2023-10-06T02:18:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.631+0000 7ffbc973c700 1 --2- 172.21.15.6:0/659747183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc40b27f0 0x7ffbc415d9a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffbac0098e0 tx=0x7ffbac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387de240bf2e7ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.631+0000 7ffbc37fe700 1 -- 172.21.15.6:0/659747183 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac009e80 con 0x7ffbc40b27f0 2023-10-06T02:18:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.631+0000 7ffbc37fe700 1 -- 172.21.15.6:0/659747183 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbac00b860 con 0x7ffbc40b27f0 2023-10-06T02:18:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.631+0000 7ffbc37fe700 1 -- 172.21.15.6:0/659747183 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac00bbe0 con 0x7ffbc40b27f0 2023-10-06T02:18:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.631+0000 7ffbcb19f700 1 -- 172.21.15.6:0/659747183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc40b27f0 msgr2=0x7ffbc415d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.631+0000 7ffbcb19f700 1 --2- 172.21.15.6:0/659747183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc40b27f0 0x7ffbc415d9a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffbac0098e0 tx=0x7ffbac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.631+0000 7ffbcb19f700 1 -- 172.21.15.6:0/659747183 shutdown_connections 2023-10-06T02:18:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.631+0000 7ffbcb19f700 1 --2- 172.21.15.6:0/659747183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc40b27f0 0x7ffbc415d9a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.631+0000 7ffbcb19f700 1 --2- 172.21.15.6:0/659747183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbc40af8b0 0x7ffbc415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.631+0000 7ffbcb19f700 1 -- 172.21.15.6:0/659747183 >> 172.21.15.6:0/659747183 conn(0x7ffbc4068680 msgr2=0x7ffbc4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.631+0000 7ffbcb19f700 1 -- 172.21.15.6:0/659747183 shutdown_connections 2023-10-06T02:18:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.631+0000 7ffbcb19f700 1 -- 172.21.15.6:0/659747183 wait complete. 2023-10-06T02:18:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.632+0000 7ffbcb19f700 1 Processor -- start 2023-10-06T02:18:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.633+0000 7ffbcb19f700 1 -- start start 2023-10-06T02:18:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.633+0000 7ffbcb19f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbc40af4e0 0x7ffbc40d0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.633+0000 7ffbcb19f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc40af8b0 0x7ffbc40cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.633+0000 7ffbcb19f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbc40b27f0 0x7ffbc40c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.633+0000 7ffbcb19f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc41570f0 con 0x7ffbc40af8b0 2023-10-06T02:18:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.633+0000 7ffbcb19f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc41573b0 con 0x7ffbc40af4e0 2023-10-06T02:18:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.633+0000 7ffbcb19f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc4157690 con 0x7ffbc40b27f0 2023-10-06T02:18:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.633+0000 7ffbc3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc40af8b0 0x7ffbc40cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.633+0000 7ffbc3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc40af8b0 0x7ffbc40cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54490/0 (socket says 172.21.15.6:54490) 2023-10-06T02:18:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.634+0000 7ffbc3fff700 1 -- 172.21.15.6:0/524734665 learned_addr learned my addr 172.21.15.6:0/524734665 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.634+0000 7ffbc8f3b700 1 --2- 172.21.15.6:0/524734665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbc40af4e0 0x7ffbc40d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.634+0000 7ffbc973c700 1 --2- 172.21.15.6:0/524734665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbc40b27f0 0x7ffbc40c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.634+0000 7ffbc3fff700 1 -- 172.21.15.6:0/524734665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbc40b27f0 msgr2=0x7ffbc40c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.634+0000 7ffbc3fff700 1 --2- 172.21.15.6:0/524734665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbc40b27f0 0x7ffbc40c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.634+0000 7ffbc3fff700 1 -- 172.21.15.6:0/524734665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbc40af4e0 msgr2=0x7ffbc40d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.634+0000 7ffbc3fff700 1 --2- 172.21.15.6:0/524734665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbc40af4e0 0x7ffbc40d0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.634+0000 7ffbc3fff700 1 -- 172.21.15.6:0/524734665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbac009420 con 0x7ffbc40af8b0 2023-10-06T02:18:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.634+0000 7ffbc973c700 1 --2- 172.21.15.6:0/524734665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbc40b27f0 0x7ffbc40c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.634+0000 7ffbc8f3b700 1 --2- 172.21.15.6:0/524734665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbc40af4e0 0x7ffbc40d0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.634+0000 7ffbc3fff700 1 --2- 172.21.15.6:0/524734665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc40af8b0 0x7ffbc40cde20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400cfc0 tx=0x7ffbb4007890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.634+0000 7ffbc0ff9700 1 -- 172.21.15.6:0/524734665 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4016430 con 0x7ffbc40af8b0 2023-10-06T02:18:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.634+0000 7ffbc0ff9700 1 -- 172.21.15.6:0/524734665 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb40165d0 con 0x7ffbc40af8b0 2023-10-06T02:18:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.634+0000 7ffbcb19f700 1 -- 172.21.15.6:0/524734665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc4155790 con 0x7ffbc40af8b0 2023-10-06T02:18:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.634+0000 7ffbc0ff9700 1 -- 172.21.15.6:0/524734665 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4016990 con 0x7ffbc40af8b0 2023-10-06T02:18:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.634+0000 7ffbcb19f700 1 -- 172.21.15.6:0/524734665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc40ce360 con 0x7ffbc40af8b0 2023-10-06T02:18:02.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.635+0000 7ffbcb19f700 1 -- 172.21.15.6:0/524734665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc41559b0 con 0x7ffbc40af8b0 2023-10-06T02:18:02.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.636+0000 7ffbc0ff9700 1 -- 172.21.15.6:0/524734665 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffbb4003020 con 0x7ffbc40af8b0 2023-10-06T02:18:02.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.636+0000 7ffbc0ff9700 1 --2- 172.21.15.6:0/524734665 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffba4066f30 0x7ffba40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:02.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.636+0000 7ffbc0ff9700 1 -- 172.21.15.6:0/524734665 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ffbb4012070 con 0x7ffbc40af8b0 2023-10-06T02:18:02.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.636+0000 7ffbc8f3b700 1 --2- 172.21.15.6:0/524734665 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffba4066f30 0x7ffba40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:02.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.637+0000 7ffbc8f3b700 1 --2- 172.21.15.6:0/524734665 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffba4066f30 0x7ffba40693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc0018d0 tx=0x7ffbbc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:02.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.640+0000 7ffbc0ff9700 1 -- 172.21.15.6:0/524734665 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffbb4052890 con 0x7ffbc40af8b0 2023-10-06T02:18:02.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.833+0000 7ffbcb19f700 1 -- 172.21.15.6:0/524734665 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffbc415c110 con 0x7ffba4066f30 2023-10-06T02:18:02.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.844+0000 7ffbc0ff9700 1 -- 172.21.15.6:0/524734665 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367579 (secure 0 0 0) 0x7ffbc415c110 con 0x7ffba4066f30 2023-10-06T02:18:02.850 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:02.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.847+0000 7ffbcb19f700 1 -- 172.21.15.6:0/524734665 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffba4066f30 msgr2=0x7ffba40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.847+0000 7ffbcb19f700 1 --2- 172.21.15.6:0/524734665 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffba4066f30 0x7ffba40693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc0018d0 tx=0x7ffbbc009040 comp rx=0 tx=0).stop 2023-10-06T02:18:02.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.847+0000 7ffbcb19f700 1 -- 172.21.15.6:0/524734665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc40af8b0 msgr2=0x7ffbc40cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:02.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.847+0000 7ffbcb19f700 1 --2- 172.21.15.6:0/524734665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc40af8b0 0x7ffbc40cde20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400cfc0 tx=0x7ffbb4007890 comp rx=0 tx=0).stop 2023-10-06T02:18:02.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.847+0000 7ffbcb19f700 1 -- 172.21.15.6:0/524734665 shutdown_connections 2023-10-06T02:18:02.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.847+0000 7ffbcb19f700 1 --2- 172.21.15.6:0/524734665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbc40b27f0 0x7ffbc40c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.847+0000 7ffbcb19f700 1 --2- 172.21.15.6:0/524734665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbc40af4e0 0x7ffbc40d0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.847+0000 7ffbcb19f700 1 --2- 172.21.15.6:0/524734665 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffba4066f30 0x7ffba40693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.847+0000 7ffbcb19f700 1 --2- 172.21.15.6:0/524734665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc40af8b0 0x7ffbc40cde20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:02.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.847+0000 7ffbcb19f700 1 -- 172.21.15.6:0/524734665 >> 172.21.15.6:0/524734665 conn(0x7ffbc4068680 msgr2=0x7ffbc415a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:02.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.847+0000 7ffbcb19f700 1 -- 172.21.15.6:0/524734665 shutdown_connections 2023-10-06T02:18:02.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:02.847+0000 7ffbcb19f700 1 -- 172.21.15.6:0/524734665 wait complete. 2023-10-06T02:18:02.857 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:18:02.861 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-10-06T02:18:02.562798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381596,"kb_used_data":3292,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593124,"statfs":{"total":773094113280,"available":770655358976,"internally_reserved":0,"allocated":3371008,"data_stored":2059621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003819"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031087+0000","last_change":"2023-10-06T02:17:44.012575+0000","last_active":"2023-10-06T02:17:48.031087+0000","last_peered":"2023-10-06T02:17:48.031087+0000","last_clean":"2023-10-06T02:17:48.031087+0000","last_became_active":"2023-10-06T02:17:44.012270+0000","last_became_peered":"2023-10-06T02:17:44.012270+0000","last_unstale":"2023-10-06T02:17:48.031087+0000","last_undegraded":"2023-10-06T02:17:48.031087+0000","last_fullsized":"2023-10-06T02:17:48.031087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:16.254919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.041799+0000","last_change":"2023-10-06T02:17:44.021465+0000","last_active":"2023-10-06T02:17:48.041799+0000","last_peered":"2023-10-06T02:17:48.041799+0000","last_clean":"2023-10-06T02:17:48.041799+0000","last_became_active":"2023-10-06T02:17:44.021209+0000","last_became_peered":"2023-10-06T02:17:44.021209+0000","last_unstale":"2023-10-06T02:17:48.041799+0000","last_undegraded":"2023-10-06T02:17:48.041799+0000","last_fullsized":"2023-10-06T02:17:48.041799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:41.549349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038712+0000","last_change":"2023-10-06T02:17:44.027196+0000","last_active":"2023-10-06T02:17:48.038712+0000","last_peered":"2023-10-06T02:17:48.038712+0000","last_clean":"2023-10-06T02:17:48.038712+0000","last_became_active":"2023-10-06T02:17:44.026927+0000","last_became_peered":"2023-10-06T02:17:44.026927+0000","last_unstale":"2023-10-06T02:17:48.038712+0000","last_undegraded":"2023-10-06T02:17:48.038712+0000","last_fullsized":"2023-10-06T02:17:48.038712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:15.551522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039557+0000","last_change":"2023-10-06T02:17:44.027115+0000","last_active":"2023-10-06T02:17:48.039557+0000","last_peered":"2023-10-06T02:17:48.039557+0000","last_clean":"2023-10-06T02:17:48.039557+0000","last_became_active":"2023-10-06T02:17:44.026827+0000","last_became_peered":"2023-10-06T02:17:44.026827+0000","last_unstale":"2023-10-06T02:17:48.039557+0000","last_undegraded":"2023-10-06T02:17:48.039557+0000","last_fullsized":"2023-10-06T02:17:48.039557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:32.103483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.033725+0000","last_change":"2023-10-06T02:17:44.015656+0000","last_active":"2023-10-06T02:17:48.033725+0000","last_peered":"2023-10-06T02:17:48.033725+0000","last_clean":"2023-10-06T02:17:48.033725+0000","last_became_active":"2023-10-06T02:17:44.008744+0000","last_became_peered":"2023-10-06T02:17:44.008744+0000","last_unstale":"2023-10-06T02:17:48.033725+0000","last_undegraded":"2023-10-06T02:17:48.033725+0000","last_fullsized":"2023-10-06T02:17:48.033725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037659+0000","last_change":"2023-10-06T02:17:44.027345+0000","last_active":"2023-10-06T02:17:48.037659+0000","last_peered":"2023-10-06T02:17:48.037659+0000","last_clean":"2023-10-06T02:17:48.037659+0000","last_became_active":"2023-10-06T02:17:44.027000+0000","last_became_peered":"2023-10-06T02:17:44.027000+0000","last_unstale":"2023-10-06T02:17:48.037659+0000","last_undegraded":"2023-10-06T02:17:48.037659+0000","last_fullsized":"2023-10-06T02:17:48.037659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:54.531796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037439+0000","last_change":"2023-10-06T02:17:44.013835+0000","last_active":"2023-10-06T02:17:48.037439+0000","last_peered":"2023-10-06T02:17:48.037439+0000","last_clean":"2023-10-06T02:17:48.037439+0000","last_became_active":"2023-10-06T02:17:44.013543+0000","last_became_peered":"2023-10-06T02:17:44.013543+0000","last_unstale":"2023-10-06T02:17:48.037439+0000","last_undegraded":"2023-10-06T02:17:48.037439+0000","last_fullsized":"2023-10-06T02:17:48.037439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:03.459533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036293+0000","last_change":"2023-10-06T02:17:44.016297+0000","last_active":"2023-10-06T02:17:48.036293+0000","last_peered":"2023-10-06T02:17:48.036293+0000","last_clean":"2023-10-06T02:17:48.036293+0000","last_became_active":"2023-10-06T02:17:44.016019+0000","last_became_peered":"2023-10-06T02:17:44.016019+0000","last_unstale":"2023-10-06T02:17:48.036293+0000","last_undegraded":"2023-10-06T02:17:48.036293+0000","last_fullsized":"2023-10-06T02:17:48.036293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:04.413740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030759+0000","last_change":"2023-10-06T02:17:44.017824+0000","last_active":"2023-10-06T02:17:48.030759+0000","last_peered":"2023-10-06T02:17:48.030759+0000","last_clean":"2023-10-06T02:17:48.030759+0000","last_became_active":"2023-10-06T02:17:44.017300+0000","last_became_peered":"2023-10-06T02:17:44.017300+0000","last_unstale":"2023-10-06T02:17:48.030759+0000","last_undegraded":"2023-10-06T02:17:48.030759+0000","last_fullsized":"2023-10-06T02:17:48.030759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:12.939706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.041971+0000","last_change":"2023-10-06T02:17:44.015364+0000","last_active":"2023-10-06T02:17:48.041971+0000","last_peered":"2023-10-06T02:17:48.041971+0000","last_clean":"2023-10-06T02:17:48.041971+0000","last_became_active":"2023-10-06T02:17:44.009665+0000","last_became_peered":"2023-10-06T02:17:44.009665+0000","last_unstale":"2023-10-06T02:17:48.041971+0000","last_undegraded":"2023-10-06T02:17:48.041971+0000","last_fullsized":"2023-10-06T02:17:48.041971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:12.022239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038636+0000","last_change":"2023-10-06T02:17:44.015097+0000","last_active":"2023-10-06T02:17:48.038636+0000","last_peered":"2023-10-06T02:17:48.038636+0000","last_clean":"2023-10-06T02:17:48.038636+0000","last_became_active":"2023-10-06T02:17:44.014831+0000","last_became_peered":"2023-10-06T02:17:44.014831+0000","last_unstale":"2023-10-06T02:17:48.038636+0000","last_undegraded":"2023-10-06T02:17:48.038636+0000","last_fullsized":"2023-10-06T02:17:48.038636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:00.943603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031356+0000","last_change":"2023-10-06T02:17:44.015300+0000","last_active":"2023-10-06T02:17:48.031356+0000","last_peered":"2023-10-06T02:17:48.031356+0000","last_clean":"2023-10-06T02:17:48.031356+0000","last_became_active":"2023-10-06T02:17:44.015015+0000","last_became_peered":"2023-10-06T02:17:44.015015+0000","last_unstale":"2023-10-06T02:17:48.031356+0000","last_undegraded":"2023-10-06T02:17:48.031356+0000","last_fullsized":"2023-10-06T02:17:48.031356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:30.550259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030945+0000","last_change":"2023-10-06T02:17:44.009268+0000","last_active":"2023-10-06T02:17:48.030945+0000","last_peered":"2023-10-06T02:17:48.030945+0000","last_clean":"2023-10-06T02:17:48.030945+0000","last_became_active":"2023-10-06T02:17:44.008958+0000","last_became_peered":"2023-10-06T02:17:44.008958+0000","last_unstale":"2023-10-06T02:17:48.030945+0000","last_undegraded":"2023-10-06T02:17:48.030945+0000","last_fullsized":"2023-10-06T02:17:48.030945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:35.516151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037800+0000","last_change":"2023-10-06T02:17:44.015486+0000","last_active":"2023-10-06T02:17:48.037800+0000","last_peered":"2023-10-06T02:17:48.037800+0000","last_clean":"2023-10-06T02:17:48.037800+0000","last_became_active":"2023-10-06T02:17:44.009594+0000","last_became_peered":"2023-10-06T02:17:44.009594+0000","last_unstale":"2023-10-06T02:17:48.037800+0000","last_undegraded":"2023-10-06T02:17:48.037800+0000","last_fullsized":"2023-10-06T02:17:48.037800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:14.067335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.035580+0000","last_change":"2023-10-06T02:17:44.014327+0000","last_active":"2023-10-06T02:17:48.035580+0000","last_peered":"2023-10-06T02:17:48.035580+0000","last_clean":"2023-10-06T02:17:48.035580+0000","last_became_active":"2023-10-06T02:17:44.014076+0000","last_became_peered":"2023-10-06T02:17:44.014076+0000","last_unstale":"2023-10-06T02:17:48.035580+0000","last_undegraded":"2023-10-06T02:17:48.035580+0000","last_fullsized":"2023-10-06T02:17:48.035580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:41.549349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036877+0000","last_change":"2023-10-06T02:17:44.022392+0000","last_active":"2023-10-06T02:17:48.036877+0000","last_peered":"2023-10-06T02:17:48.036877+0000","last_clean":"2023-10-06T02:17:48.036877+0000","last_became_active":"2023-10-06T02:17:44.022145+0000","last_became_peered":"2023-10-06T02:17:44.022145+0000","last_unstale":"2023-10-06T02:17:48.036877+0000","last_undegraded":"2023-10-06T02:17:48.036877+0000","last_fullsized":"2023-10-06T02:17:48.036877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:29.729845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030860+0000","last_change":"2023-10-06T02:17:44.018022+0000","last_active":"2023-10-06T02:17:48.030860+0000","last_peered":"2023-10-06T02:17:48.030860+0000","last_clean":"2023-10-06T02:17:48.030860+0000","last_became_active":"2023-10-06T02:17:44.017617+0000","last_became_peered":"2023-10-06T02:17:44.017617+0000","last_unstale":"2023-10-06T02:17:48.030860+0000","last_undegraded":"2023-10-06T02:17:48.030860+0000","last_fullsized":"2023-10-06T02:17:48.030860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.500461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.044943+0000","last_change":"2023-10-06T02:17:44.014002+0000","last_active":"2023-10-06T02:17:48.044943+0000","last_peered":"2023-10-06T02:17:48.044943+0000","last_clean":"2023-10-06T02:17:48.044943+0000","last_became_active":"2023-10-06T02:17:44.013756+0000","last_became_peered":"2023-10-06T02:17:44.013756+0000","last_unstale":"2023-10-06T02:17:48.044943+0000","last_undegraded":"2023-10-06T02:17:48.044943+0000","last_fullsized":"2023-10-06T02:17:48.044943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:05.747241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031920+0000","last_change":"2023-10-06T02:17:44.013965+0000","last_active":"2023-10-06T02:17:48.031920+0000","last_peered":"2023-10-06T02:17:48.031920+0000","last_clean":"2023-10-06T02:17:48.031920+0000","last_became_active":"2023-10-06T02:17:44.013512+0000","last_became_peered":"2023-10-06T02:17:44.013512+0000","last_unstale":"2023-10-06T02:17:48.031920+0000","last_undegraded":"2023-10-06T02:17:48.031920+0000","last_fullsized":"2023-10-06T02:17:48.031920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:00.061174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040168+0000","last_change":"2023-10-06T02:17:44.021614+0000","last_active":"2023-10-06T02:17:48.040168+0000","last_peered":"2023-10-06T02:17:48.040168+0000","last_clean":"2023-10-06T02:17:48.040168+0000","last_became_active":"2023-10-06T02:17:44.021377+0000","last_became_peered":"2023-10-06T02:17:44.021377+0000","last_unstale":"2023-10-06T02:17:48.040168+0000","last_undegraded":"2023-10-06T02:17:48.040168+0000","last_fullsized":"2023-10-06T02:17:48.040168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:39.014780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040828+0000","last_change":"2023-10-06T02:17:44.018105+0000","last_active":"2023-10-06T02:17:48.040828+0000","last_peered":"2023-10-06T02:17:48.040828+0000","last_clean":"2023-10-06T02:17:48.040828+0000","last_became_active":"2023-10-06T02:17:44.017812+0000","last_became_peered":"2023-10-06T02:17:44.017812+0000","last_unstale":"2023-10-06T02:17:48.040828+0000","last_undegraded":"2023-10-06T02:17:48.040828+0000","last_fullsized":"2023-10-06T02:17:48.040828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030387+0000","last_change":"2023-10-06T02:17:44.016308+0000","last_active":"2023-10-06T02:17:48.030387+0000","last_peered":"2023-10-06T02:17:48.030387+0000","last_clean":"2023-10-06T02:17:48.030387+0000","last_became_active":"2023-10-06T02:17:44.016107+0000","last_became_peered":"2023-10-06T02:17:44.016107+0000","last_unstale":"2023-10-06T02:17:48.030387+0000","last_undegraded":"2023-10-06T02:17:48.030387+0000","last_fullsized":"2023-10-06T02:17:48.030387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:43.352906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.032262+0000","last_change":"2023-10-06T02:17:44.026872+0000","last_active":"2023-10-06T02:17:48.032262+0000","last_peered":"2023-10-06T02:17:48.032262+0000","last_clean":"2023-10-06T02:17:48.032262+0000","last_became_active":"2023-10-06T02:17:44.026595+0000","last_became_peered":"2023-10-06T02:17:44.026595+0000","last_unstale":"2023-10-06T02:17:48.032262+0000","last_undegraded":"2023-10-06T02:17:48.032262+0000","last_fullsized":"2023-10-06T02:17:48.032262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:54.531796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036348+0000","last_change":"2023-10-06T02:17:44.009432+0000","last_active":"2023-10-06T02:17:48.036348+0000","last_peered":"2023-10-06T02:17:48.036348+0000","last_clean":"2023-10-06T02:17:48.036348+0000","last_became_active":"2023-10-06T02:17:44.009157+0000","last_became_peered":"2023-10-06T02:17:44.009157+0000","last_unstale":"2023-10-06T02:17:48.036348+0000","last_undegraded":"2023-10-06T02:17:48.036348+0000","last_fullsized":"2023-10-06T02:17:48.036348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.500461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050398+0000","last_change":"2023-10-06T02:17:44.020561+0000","last_active":"2023-10-06T02:17:48.050398+0000","last_peered":"2023-10-06T02:17:48.050398+0000","last_clean":"2023-10-06T02:17:48.050398+0000","last_became_active":"2023-10-06T02:17:44.020324+0000","last_became_peered":"2023-10-06T02:17:44.020324+0000","last_unstale":"2023-10-06T02:17:48.050398+0000","last_undegraded":"2023-10-06T02:17:48.050398+0000","last_fullsized":"2023-10-06T02:17:48.050398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:03.459533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050774+0000","last_change":"2023-10-06T02:17:44.009977+0000","last_active":"2023-10-06T02:17:48.050774+0000","last_peered":"2023-10-06T02:17:48.050774+0000","last_clean":"2023-10-06T02:17:48.050774+0000","last_became_active":"2023-10-06T02:17:44.009383+0000","last_became_peered":"2023-10-06T02:17:44.009383+0000","last_unstale":"2023-10-06T02:17:48.050774+0000","last_undegraded":"2023-10-06T02:17:48.050774+0000","last_fullsized":"2023-10-06T02:17:48.050774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:14.067335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040285+0000","last_change":"2023-10-06T02:17:44.022518+0000","last_active":"2023-10-06T02:17:48.040285+0000","last_peered":"2023-10-06T02:17:48.040285+0000","last_clean":"2023-10-06T02:17:48.040285+0000","last_became_active":"2023-10-06T02:17:44.022094+0000","last_became_peered":"2023-10-06T02:17:44.022094+0000","last_unstale":"2023-10-06T02:17:48.040285+0000","last_undegraded":"2023-10-06T02:17:48.040285+0000","last_fullsized":"2023-10-06T02:17:48.040285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.500461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.063071+0000","last_change":"2023-10-06T02:17:48.060017+0000","last_active":"2023-10-06T02:17:48.063071+0000","last_peered":"2023-10-06T02:17:48.063071+0000","last_clean":"2023-10-06T02:17:48.063071+0000","last_became_active":"2023-10-06T02:17:48.059609+0000","last_became_peered":"2023-10-06T02:17:48.059609+0000","last_unstale":"2023-10-06T02:17:48.063071+0000","last_undegraded":"2023-10-06T02:17:48.063071+0000","last_fullsized":"2023-10-06T02:17:48.063071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:46.132017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037608+0000","last_change":"2023-10-06T02:17:43.010345+0000","last_active":"2023-10-06T02:17:48.037608+0000","last_peered":"2023-10-06T02:17:48.037608+0000","last_clean":"2023-10-06T02:17:48.037608+0000","last_became_active":"2023-10-06T02:17:43.006363+0000","last_became_peered":"2023-10-06T02:17:43.006363+0000","last_unstale":"2023-10-06T02:17:48.037608+0000","last_undegraded":"2023-10-06T02:17:48.037608+0000","last_fullsized":"2023-10-06T02:17:48.037608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030384+0000","last_change":"2023-10-06T02:17:44.017786+0000","last_active":"2023-10-06T02:17:48.030384+0000","last_peered":"2023-10-06T02:17:48.030384+0000","last_clean":"2023-10-06T02:17:48.030384+0000","last_became_active":"2023-10-06T02:17:44.016986+0000","last_became_peered":"2023-10-06T02:17:44.016986+0000","last_unstale":"2023-10-06T02:17:48.030384+0000","last_undegraded":"2023-10-06T02:17:48.030384+0000","last_fullsized":"2023-10-06T02:17:48.030384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:49.992736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.053196+0000","last_change":"2023-10-06T02:17:48.051657+0000","last_active":"2023-10-06T02:17:48.053196+0000","last_peered":"2023-10-06T02:17:48.053196+0000","last_clean":"2023-10-06T02:17:48.053196+0000","last_became_active":"2023-10-06T02:17:48.051307+0000","last_became_peered":"2023-10-06T02:17:48.051307+0000","last_unstale":"2023-10-06T02:17:48.053196+0000","last_undegraded":"2023-10-06T02:17:48.053196+0000","last_fullsized":"2023-10-06T02:17:48.053196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:09.781175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045264+0000","last_change":"2023-10-06T02:17:43.002992+0000","last_active":"2023-10-06T02:17:48.045264+0000","last_peered":"2023-10-06T02:17:48.045264+0000","last_clean":"2023-10-06T02:17:48.045264+0000","last_became_active":"2023-10-06T02:17:43.002502+0000","last_became_peered":"2023-10-06T02:17:43.002502+0000","last_unstale":"2023-10-06T02:17:48.045264+0000","last_undegraded":"2023-10-06T02:17:48.045264+0000","last_fullsized":"2023-10-06T02:17:48.045264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031835+0000","last_change":"2023-10-06T02:17:44.021171+0000","last_active":"2023-10-06T02:17:48.031835+0000","last_peered":"2023-10-06T02:17:48.031835+0000","last_clean":"2023-10-06T02:17:48.031835+0000","last_became_active":"2023-10-06T02:17:44.016443+0000","last_became_peered":"2023-10-06T02:17:44.016443+0000","last_unstale":"2023-10-06T02:17:48.031835+0000","last_undegraded":"2023-10-06T02:17:48.031835+0000","last_fullsized":"2023-10-06T02:17:48.031835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:49.992736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.059150+0000","last_change":"2023-10-06T02:17:48.053835+0000","last_active":"2023-10-06T02:17:48.059150+0000","last_peered":"2023-10-06T02:17:48.059150+0000","last_clean":"2023-10-06T02:17:48.059150+0000","last_became_active":"2023-10-06T02:17:48.053399+0000","last_became_peered":"2023-10-06T02:17:48.053399+0000","last_unstale":"2023-10-06T02:17:48.059150+0000","last_undegraded":"2023-10-06T02:17:48.059150+0000","last_fullsized":"2023-10-06T02:17:48.059150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:20.633926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031624+0000","last_change":"2023-10-06T02:17:43.005151+0000","last_active":"2023-10-06T02:17:48.031624+0000","last_peered":"2023-10-06T02:17:48.031624+0000","last_clean":"2023-10-06T02:17:48.031624+0000","last_became_active":"2023-10-06T02:17:43.004709+0000","last_became_peered":"2023-10-06T02:17:43.004709+0000","last_unstale":"2023-10-06T02:17:48.031624+0000","last_undegraded":"2023-10-06T02:17:48.031624+0000","last_fullsized":"2023-10-06T02:17:48.031624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:32.002499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039892+0000","last_change":"2023-10-06T02:17:44.025569+0000","last_active":"2023-10-06T02:17:48.039892+0000","last_peered":"2023-10-06T02:17:48.039892+0000","last_clean":"2023-10-06T02:17:48.039892+0000","last_became_active":"2023-10-06T02:17:44.025261+0000","last_became_peered":"2023-10-06T02:17:44.025261+0000","last_unstale":"2023-10-06T02:17:48.039892+0000","last_undegraded":"2023-10-06T02:17:48.039892+0000","last_fullsized":"2023-10-06T02:17:48.039892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:47.847314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.053261+0000","last_change":"2023-10-06T02:17:48.052637+0000","last_active":"2023-10-06T02:17:48.053261+0000","last_peered":"2023-10-06T02:17:48.053261+0000","last_clean":"2023-10-06T02:17:48.053261+0000","last_became_active":"2023-10-06T02:17:48.052223+0000","last_became_peered":"2023-10-06T02:17:48.052223+0000","last_unstale":"2023-10-06T02:17:48.053261+0000","last_undegraded":"2023-10-06T02:17:48.053261+0000","last_fullsized":"2023-10-06T02:17:48.053261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:33.763779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030951+0000","last_change":"2023-10-06T02:17:43.013718+0000","last_active":"2023-10-06T02:17:48.030951+0000","last_peered":"2023-10-06T02:17:48.030951+0000","last_clean":"2023-10-06T02:17:48.030951+0000","last_became_active":"2023-10-06T02:17:43.013415+0000","last_became_peered":"2023-10-06T02:17:43.013415+0000","last_unstale":"2023-10-06T02:17:48.030951+0000","last_undegraded":"2023-10-06T02:17:48.030951+0000","last_fullsized":"2023-10-06T02:17:48.030951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:59.054001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031512+0000","last_change":"2023-10-06T02:17:44.011855+0000","last_active":"2023-10-06T02:17:48.031512+0000","last_peered":"2023-10-06T02:17:48.031512+0000","last_clean":"2023-10-06T02:17:48.031512+0000","last_became_active":"2023-10-06T02:17:44.011583+0000","last_became_peered":"2023-10-06T02:17:44.011583+0000","last_unstale":"2023-10-06T02:17:48.031512+0000","last_undegraded":"2023-10-06T02:17:48.031512+0000","last_fullsized":"2023-10-06T02:17:48.031512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:01.914117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060333+0000","last_change":"2023-10-06T02:17:48.057256+0000","last_active":"2023-10-06T02:17:48.060333+0000","last_peered":"2023-10-06T02:17:48.060333+0000","last_clean":"2023-10-06T02:17:48.060333+0000","last_became_active":"2023-10-06T02:17:48.056749+0000","last_became_peered":"2023-10-06T02:17:48.056749+0000","last_unstale":"2023-10-06T02:17:48.060333+0000","last_undegraded":"2023-10-06T02:17:48.060333+0000","last_fullsized":"2023-10-06T02:17:48.060333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:29.446681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.041892+0000","last_change":"2023-10-06T02:17:43.013316+0000","last_active":"2023-10-06T02:17:48.041892+0000","last_peered":"2023-10-06T02:17:48.041892+0000","last_clean":"2023-10-06T02:17:48.041892+0000","last_became_active":"2023-10-06T02:17:43.013020+0000","last_became_peered":"2023-10-06T02:17:43.013020+0000","last_unstale":"2023-10-06T02:17:48.041892+0000","last_undegraded":"2023-10-06T02:17:48.041892+0000","last_fullsized":"2023-10-06T02:17:48.041892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:55.863203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030030+0000","last_change":"2023-10-06T02:17:44.017554+0000","last_active":"2023-10-06T02:17:48.030030+0000","last_peered":"2023-10-06T02:17:48.030030+0000","last_clean":"2023-10-06T02:17:48.030030+0000","last_became_active":"2023-10-06T02:17:44.017288+0000","last_became_peered":"2023-10-06T02:17:44.017288+0000","last_unstale":"2023-10-06T02:17:48.030030+0000","last_undegraded":"2023-10-06T02:17:48.030030+0000","last_fullsized":"2023-10-06T02:17:48.030030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:12.939706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050983+0000","last_change":"2023-10-06T02:17:48.049234+0000","last_active":"2023-10-06T02:17:48.050983+0000","last_peered":"2023-10-06T02:17:48.050983+0000","last_clean":"2023-10-06T02:17:48.050983+0000","last_became_active":"2023-10-06T02:17:48.048823+0000","last_became_peered":"2023-10-06T02:17:48.048823+0000","last_unstale":"2023-10-06T02:17:48.050983+0000","last_undegraded":"2023-10-06T02:17:48.050983+0000","last_fullsized":"2023-10-06T02:17:48.050983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:23.461660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036812+0000","last_change":"2023-10-06T02:17:43.012321+0000","last_active":"2023-10-06T02:17:48.036812+0000","last_peered":"2023-10-06T02:17:48.036812+0000","last_clean":"2023-10-06T02:17:48.036812+0000","last_became_active":"2023-10-06T02:17:43.012039+0000","last_became_peered":"2023-10-06T02:17:43.012039+0000","last_unstale":"2023-10-06T02:17:48.036812+0000","last_undegraded":"2023-10-06T02:17:48.036812+0000","last_fullsized":"2023-10-06T02:17:48.036812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:56.588125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.046506+0000","last_change":"2023-10-06T02:17:44.019691+0000","last_active":"2023-10-06T02:17:48.046506+0000","last_peered":"2023-10-06T02:17:48.046506+0000","last_clean":"2023-10-06T02:17:48.046506+0000","last_became_active":"2023-10-06T02:17:44.018879+0000","last_became_peered":"2023-10-06T02:17:44.018879+0000","last_unstale":"2023-10-06T02:17:48.046506+0000","last_undegraded":"2023-10-06T02:17:48.046506+0000","last_fullsized":"2023-10-06T02:17:48.046506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:22.411698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.061948+0000","last_change":"2023-10-06T02:17:48.060182+0000","last_active":"2023-10-06T02:17:48.061948+0000","last_peered":"2023-10-06T02:17:48.061948+0000","last_clean":"2023-10-06T02:17:48.061948+0000","last_became_active":"2023-10-06T02:17:48.058134+0000","last_became_peered":"2023-10-06T02:17:48.058134+0000","last_unstale":"2023-10-06T02:17:48.061948+0000","last_undegraded":"2023-10-06T02:17:48.061948+0000","last_fullsized":"2023-10-06T02:17:48.061948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:40.330578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T02:17:53.898409+0000","last_change":"2023-10-06T02:17:43.011660+0000","last_active":"2023-10-06T02:17:53.898409+0000","last_peered":"2023-10-06T02:17:53.898409+0000","last_clean":"2023-10-06T02:17:53.898409+0000","last_became_active":"2023-10-06T02:17:43.011360+0000","last_became_peered":"2023-10-06T02:17:43.011360+0000","last_unstale":"2023-10-06T02:17:53.898409+0000","last_undegraded":"2023-10-06T02:17:53.898409+0000","last_fullsized":"2023-10-06T02:17:53.898409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:34.508977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039053+0000","last_change":"2023-10-06T02:17:44.019835+0000","last_active":"2023-10-06T02:17:48.039053+0000","last_peered":"2023-10-06T02:17:48.039053+0000","last_clean":"2023-10-06T02:17:48.039053+0000","last_became_active":"2023-10-06T02:17:44.019567+0000","last_became_peered":"2023-10-06T02:17:44.019567+0000","last_unstale":"2023-10-06T02:17:48.039053+0000","last_undegraded":"2023-10-06T02:17:48.039053+0000","last_fullsized":"2023-10-06T02:17:48.039053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:36.296644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060685+0000","last_change":"2023-10-06T02:17:48.058253+0000","last_active":"2023-10-06T02:17:48.060685+0000","last_peered":"2023-10-06T02:17:48.060685+0000","last_clean":"2023-10-06T02:17:48.060685+0000","last_became_active":"2023-10-06T02:17:48.057801+0000","last_became_peered":"2023-10-06T02:17:48.057801+0000","last_unstale":"2023-10-06T02:17:48.060685+0000","last_undegraded":"2023-10-06T02:17:48.060685+0000","last_fullsized":"2023-10-06T02:17:48.060685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:34.306615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036359+0000","last_change":"2023-10-06T02:17:43.014116+0000","last_active":"2023-10-06T02:17:48.036359+0000","last_peered":"2023-10-06T02:17:48.036359+0000","last_clean":"2023-10-06T02:17:48.036359+0000","last_became_active":"2023-10-06T02:17:43.013686+0000","last_became_peered":"2023-10-06T02:17:43.013686+0000","last_unstale":"2023-10-06T02:17:48.036359+0000","last_undegraded":"2023-10-06T02:17:48.036359+0000","last_fullsized":"2023-10-06T02:17:48.036359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:42.345733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030529+0000","last_change":"2023-10-06T02:17:44.023536+0000","last_active":"2023-10-06T02:17:48.030529+0000","last_peered":"2023-10-06T02:17:48.030529+0000","last_clean":"2023-10-06T02:17:48.030529+0000","last_became_active":"2023-10-06T02:17:44.023272+0000","last_became_peered":"2023-10-06T02:17:44.023272+0000","last_unstale":"2023-10-06T02:17:48.030529+0000","last_undegraded":"2023-10-06T02:17:48.030529+0000","last_fullsized":"2023-10-06T02:17:48.030529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:47.126256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.052236+0000","last_change":"2023-10-06T02:17:48.049593+0000","last_active":"2023-10-06T02:17:48.052236+0000","last_peered":"2023-10-06T02:17:48.052236+0000","last_clean":"2023-10-06T02:17:48.052236+0000","last_became_active":"2023-10-06T02:17:48.048578+0000","last_became_peered":"2023-10-06T02:17:48.048578+0000","last_unstale":"2023-10-06T02:17:48.052236+0000","last_undegraded":"2023-10-06T02:17:48.052236+0000","last_fullsized":"2023-10-06T02:17:48.052236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:56.628094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030542+0000","last_change":"2023-10-06T02:17:43.010082+0000","last_active":"2023-10-06T02:17:48.030542+0000","last_peered":"2023-10-06T02:17:48.030542+0000","last_clean":"2023-10-06T02:17:48.030542+0000","last_became_active":"2023-10-06T02:17:43.009750+0000","last_became_peered":"2023-10-06T02:17:43.009750+0000","last_unstale":"2023-10-06T02:17:48.030542+0000","last_undegraded":"2023-10-06T02:17:48.030542+0000","last_fullsized":"2023-10-06T02:17:48.030542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040202+0000","last_change":"2023-10-06T02:17:44.022344+0000","last_active":"2023-10-06T02:17:48.040202+0000","last_peered":"2023-10-06T02:17:48.040202+0000","last_clean":"2023-10-06T02:17:48.040202+0000","last_became_active":"2023-10-06T02:17:44.021817+0000","last_became_peered":"2023-10-06T02:17:44.021817+0000","last_unstale":"2023-10-06T02:17:48.040202+0000","last_undegraded":"2023-10-06T02:17:48.040202+0000","last_fullsized":"2023-10-06T02:17:48.040202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.051438+0000","last_change":"2023-10-06T02:17:48.050036+0000","last_active":"2023-10-06T02:17:48.051438+0000","last_peered":"2023-10-06T02:17:48.051438+0000","last_clean":"2023-10-06T02:17:48.051438+0000","last_became_active":"2023-10-06T02:17:48.049595+0000","last_became_peered":"2023-10-06T02:17:48.049595+0000","last_unstale":"2023-10-06T02:17:48.051438+0000","last_undegraded":"2023-10-06T02:17:48.051438+0000","last_fullsized":"2023-10-06T02:17:48.051438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:09:38.509689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037346+0000","last_change":"2023-10-06T02:17:43.014038+0000","last_active":"2023-10-06T02:17:48.037346+0000","last_peered":"2023-10-06T02:17:48.037346+0000","last_clean":"2023-10-06T02:17:48.037346+0000","last_became_active":"2023-10-06T02:17:43.013419+0000","last_became_peered":"2023-10-06T02:17:43.013419+0000","last_unstale":"2023-10-06T02:17:48.037346+0000","last_undegraded":"2023-10-06T02:17:48.037346+0000","last_fullsized":"2023-10-06T02:17:48.037346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:46.840141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.032077+0000","last_change":"2023-10-06T02:17:44.015494+0000","last_active":"2023-10-06T02:17:48.032077+0000","last_peered":"2023-10-06T02:17:48.032077+0000","last_clean":"2023-10-06T02:17:48.032077+0000","last_became_active":"2023-10-06T02:17:44.012435+0000","last_became_peered":"2023-10-06T02:17:44.012435+0000","last_unstale":"2023-10-06T02:17:48.032077+0000","last_undegraded":"2023-10-06T02:17:48.032077+0000","last_fullsized":"2023-10-06T02:17:48.032077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:03.459533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060832+0000","last_change":"2023-10-06T02:17:48.056039+0000","last_active":"2023-10-06T02:17:48.060832+0000","last_peered":"2023-10-06T02:17:48.060832+0000","last_clean":"2023-10-06T02:17:48.060832+0000","last_became_active":"2023-10-06T02:17:48.055610+0000","last_became_peered":"2023-10-06T02:17:48.055610+0000","last_unstale":"2023-10-06T02:17:48.060832+0000","last_undegraded":"2023-10-06T02:17:48.060832+0000","last_fullsized":"2023-10-06T02:17:48.060832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:05.386590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039054+0000","last_change":"2023-10-06T02:17:43.009311+0000","last_active":"2023-10-06T02:17:48.039054+0000","last_peered":"2023-10-06T02:17:48.039054+0000","last_clean":"2023-10-06T02:17:48.039054+0000","last_became_active":"2023-10-06T02:17:43.009019+0000","last_became_peered":"2023-10-06T02:17:43.009019+0000","last_unstale":"2023-10-06T02:17:48.039054+0000","last_undegraded":"2023-10-06T02:17:48.039054+0000","last_fullsized":"2023-10-06T02:17:48.039054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:34.508977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031131+0000","last_change":"2023-10-06T02:17:44.022053+0000","last_active":"2023-10-06T02:17:48.031131+0000","last_peered":"2023-10-06T02:17:48.031131+0000","last_clean":"2023-10-06T02:17:48.031131+0000","last_became_active":"2023-10-06T02:17:44.021420+0000","last_became_peered":"2023-10-06T02:17:44.021420+0000","last_unstale":"2023-10-06T02:17:48.031131+0000","last_undegraded":"2023-10-06T02:17:48.031131+0000","last_fullsized":"2023-10-06T02:17:48.031131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:03.459533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060798+0000","last_change":"2023-10-06T02:17:48.058632+0000","last_active":"2023-10-06T02:17:48.060798+0000","last_peered":"2023-10-06T02:17:48.060798+0000","last_clean":"2023-10-06T02:17:48.060798+0000","last_became_active":"2023-10-06T02:17:48.056462+0000","last_became_peered":"2023-10-06T02:17:48.056462+0000","last_unstale":"2023-10-06T02:17:48.060798+0000","last_undegraded":"2023-10-06T02:17:48.060798+0000","last_fullsized":"2023-10-06T02:17:48.060798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:19.585456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037962+0000","last_change":"2023-10-06T02:17:43.014971+0000","last_active":"2023-10-06T02:17:48.037962+0000","last_peered":"2023-10-06T02:17:48.037962+0000","last_clean":"2023-10-06T02:17:48.037962+0000","last_became_active":"2023-10-06T02:17:43.014645+0000","last_became_peered":"2023-10-06T02:17:43.014645+0000","last_unstale":"2023-10-06T02:17:48.037962+0000","last_undegraded":"2023-10-06T02:17:48.037962+0000","last_fullsized":"2023-10-06T02:17:48.037962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:31.096309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036178+0000","last_change":"2023-10-06T02:17:44.017176+0000","last_active":"2023-10-06T02:17:48.036178+0000","last_peered":"2023-10-06T02:17:48.036178+0000","last_clean":"2023-10-06T02:17:48.036178+0000","last_became_active":"2023-10-06T02:17:44.016900+0000","last_became_peered":"2023-10-06T02:17:44.016900+0000","last_unstale":"2023-10-06T02:17:48.036178+0000","last_undegraded":"2023-10-06T02:17:48.036178+0000","last_fullsized":"2023-10-06T02:17:48.036178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:21.073260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.058961+0000","last_change":"2023-10-06T02:17:48.056709+0000","last_active":"2023-10-06T02:17:48.058961+0000","last_peered":"2023-10-06T02:17:48.058961+0000","last_clean":"2023-10-06T02:17:48.058961+0000","last_became_active":"2023-10-06T02:17:48.056245+0000","last_became_peered":"2023-10-06T02:17:48.056245+0000","last_unstale":"2023-10-06T02:17:48.058961+0000","last_undegraded":"2023-10-06T02:17:48.058961+0000","last_fullsized":"2023-10-06T02:17:48.058961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:58.565730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038561+0000","last_change":"2023-10-06T02:17:43.015636+0000","last_active":"2023-10-06T02:17:48.038561+0000","last_peered":"2023-10-06T02:17:48.038561+0000","last_clean":"2023-10-06T02:17:48.038561+0000","last_became_active":"2023-10-06T02:17:43.013756+0000","last_became_peered":"2023-10-06T02:17:43.013756+0000","last_unstale":"2023-10-06T02:17:48.038561+0000","last_undegraded":"2023-10-06T02:17:48.038561+0000","last_fullsized":"2023-10-06T02:17:48.038561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:21.985046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045110+0000","last_change":"2023-10-06T02:17:44.019216+0000","last_active":"2023-10-06T02:17:48.045110+0000","last_peered":"2023-10-06T02:17:48.045110+0000","last_clean":"2023-10-06T02:17:48.045110+0000","last_became_active":"2023-10-06T02:17:44.018743+0000","last_became_peered":"2023-10-06T02:17:44.018743+0000","last_unstale":"2023-10-06T02:17:48.045110+0000","last_undegraded":"2023-10-06T02:17:48.045110+0000","last_fullsized":"2023-10-06T02:17:48.045110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:47.126256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.049041+0000","last_change":"2023-10-06T02:17:48.047120+0000","last_active":"2023-10-06T02:17:48.049041+0000","last_peered":"2023-10-06T02:17:48.049041+0000","last_clean":"2023-10-06T02:17:48.049041+0000","last_became_active":"2023-10-06T02:17:48.046716+0000","last_became_peered":"2023-10-06T02:17:48.046716+0000","last_unstale":"2023-10-06T02:17:48.049041+0000","last_undegraded":"2023-10-06T02:17:48.049041+0000","last_fullsized":"2023-10-06T02:17:48.049041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:01.000290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036700+0000","last_change":"2023-10-06T02:17:43.014454+0000","last_active":"2023-10-06T02:17:48.036700+0000","last_peered":"2023-10-06T02:17:48.036700+0000","last_clean":"2023-10-06T02:17:48.036700+0000","last_became_active":"2023-10-06T02:17:43.014185+0000","last_became_peered":"2023-10-06T02:17:43.014185+0000","last_unstale":"2023-10-06T02:17:48.036700+0000","last_undegraded":"2023-10-06T02:17:48.036700+0000","last_fullsized":"2023-10-06T02:17:48.036700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:32.002499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037390+0000","last_change":"2023-10-06T02:17:44.021996+0000","last_active":"2023-10-06T02:17:48.037390+0000","last_peered":"2023-10-06T02:17:48.037390+0000","last_clean":"2023-10-06T02:17:48.037390+0000","last_became_active":"2023-10-06T02:17:44.020844+0000","last_became_peered":"2023-10-06T02:17:44.020844+0000","last_unstale":"2023-10-06T02:17:48.037390+0000","last_undegraded":"2023-10-06T02:17:48.037390+0000","last_fullsized":"2023-10-06T02:17:48.037390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:04.413740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.059287+0000","last_change":"2023-10-06T02:17:48.052318+0000","last_active":"2023-10-06T02:17:48.059287+0000","last_peered":"2023-10-06T02:17:48.059287+0000","last_clean":"2023-10-06T02:17:48.059287+0000","last_became_active":"2023-10-06T02:17:48.051887+0000","last_became_peered":"2023-10-06T02:17:48.051887+0000","last_unstale":"2023-10-06T02:17:48.059287+0000","last_undegraded":"2023-10-06T02:17:48.059287+0000","last_fullsized":"2023-10-06T02:17:48.059287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:54.026670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039797+0000","last_change":"2023-10-06T02:17:43.017227+0000","last_active":"2023-10-06T02:17:48.039797+0000","last_peered":"2023-10-06T02:17:48.039797+0000","last_clean":"2023-10-06T02:17:48.039797+0000","last_became_active":"2023-10-06T02:17:43.016966+0000","last_became_peered":"2023-10-06T02:17:43.016966+0000","last_unstale":"2023-10-06T02:17:48.039797+0000","last_undegraded":"2023-10-06T02:17:48.039797+0000","last_fullsized":"2023-10-06T02:17:48.039797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.033379+0000","last_change":"2023-10-06T02:17:44.003483+0000","last_active":"2023-10-06T02:17:48.033379+0000","last_peered":"2023-10-06T02:17:48.033379+0000","last_clean":"2023-10-06T02:17:48.033379+0000","last_became_active":"2023-10-06T02:17:44.003206+0000","last_became_peered":"2023-10-06T02:17:44.003206+0000","last_unstale":"2023-10-06T02:17:48.033379+0000","last_undegraded":"2023-10-06T02:17:48.033379+0000","last_fullsized":"2023-10-06T02:17:48.033379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:41.549349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.053844+0000","last_change":"2023-10-06T02:17:48.048415+0000","last_active":"2023-10-06T02:17:48.053844+0000","last_peered":"2023-10-06T02:17:48.053844+0000","last_clean":"2023-10-06T02:17:48.053844+0000","last_became_active":"2023-10-06T02:17:48.048056+0000","last_became_peered":"2023-10-06T02:17:48.048056+0000","last_unstale":"2023-10-06T02:17:48.053844+0000","last_undegraded":"2023-10-06T02:17:48.053844+0000","last_fullsized":"2023-10-06T02:17:48.053844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:09.781175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030566+0000","last_change":"2023-10-06T02:17:43.012134+0000","last_active":"2023-10-06T02:17:48.030566+0000","last_peered":"2023-10-06T02:17:48.030566+0000","last_clean":"2023-10-06T02:17:48.030566+0000","last_became_active":"2023-10-06T02:17:43.011834+0000","last_became_peered":"2023-10-06T02:17:43.011834+0000","last_unstale":"2023-10-06T02:17:48.030566+0000","last_undegraded":"2023-10-06T02:17:48.030566+0000","last_fullsized":"2023-10-06T02:17:48.030566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.543085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039990+0000","last_change":"2023-10-06T02:17:44.024658+0000","last_active":"2023-10-06T02:17:48.039990+0000","last_peered":"2023-10-06T02:17:48.039990+0000","last_clean":"2023-10-06T02:17:48.039990+0000","last_became_active":"2023-10-06T02:17:44.023854+0000","last_became_peered":"2023-10-06T02:17:44.023854+0000","last_unstale":"2023-10-06T02:17:48.039990+0000","last_undegraded":"2023-10-06T02:17:48.039990+0000","last_fullsized":"2023-10-06T02:17:48.039990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:49.992736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.056354+0000","last_change":"2023-10-06T02:17:48.054318+0000","last_active":"2023-10-06T02:17:48.056354+0000","last_peered":"2023-10-06T02:17:48.056354+0000","last_clean":"2023-10-06T02:17:48.056354+0000","last_became_active":"2023-10-06T02:17:48.053924+0000","last_became_peered":"2023-10-06T02:17:48.053924+0000","last_unstale":"2023-10-06T02:17:48.056354+0000","last_undegraded":"2023-10-06T02:17:48.056354+0000","last_fullsized":"2023-10-06T02:17:48.056354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:29.446681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037465+0000","last_change":"2023-10-06T02:17:43.017268+0000","last_active":"2023-10-06T02:17:48.037465+0000","last_peered":"2023-10-06T02:17:48.037465+0000","last_clean":"2023-10-06T02:17:48.037465+0000","last_became_active":"2023-10-06T02:17:43.016981+0000","last_became_peered":"2023-10-06T02:17:43.016981+0000","last_unstale":"2023-10-06T02:17:48.037465+0000","last_undegraded":"2023-10-06T02:17:48.037465+0000","last_fullsized":"2023-10-06T02:17:48.037465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:15.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038414+0000","last_change":"2023-10-06T02:17:44.023712+0000","last_active":"2023-10-06T02:17:48.038414+0000","last_peered":"2023-10-06T02:17:48.038414+0000","last_clean":"2023-10-06T02:17:48.038414+0000","last_became_active":"2023-10-06T02:17:44.023412+0000","last_became_peered":"2023-10-06T02:17:44.023412+0000","last_unstale":"2023-10-06T02:17:48.038414+0000","last_undegraded":"2023-10-06T02:17:48.038414+0000","last_fullsized":"2023-10-06T02:17:48.038414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:26.577679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060912+0000","last_change":"2023-10-06T02:17:48.054660+0000","last_active":"2023-10-06T02:17:48.060912+0000","last_peered":"2023-10-06T02:17:48.060912+0000","last_clean":"2023-10-06T02:17:48.060912+0000","last_became_active":"2023-10-06T02:17:48.054270+0000","last_became_peered":"2023-10-06T02:17:48.054270+0000","last_unstale":"2023-10-06T02:17:48.060912+0000","last_undegraded":"2023-10-06T02:17:48.060912+0000","last_fullsized":"2023-10-06T02:17:48.060912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:59.085352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.044929+0000","last_change":"2023-10-06T02:17:43.013434+0000","last_active":"2023-10-06T02:17:48.044929+0000","last_peered":"2023-10-06T02:17:48.044929+0000","last_clean":"2023-10-06T02:17:48.044929+0000","last_became_active":"2023-10-06T02:17:43.013144+0000","last_became_peered":"2023-10-06T02:17:43.013144+0000","last_unstale":"2023-10-06T02:17:48.044929+0000","last_undegraded":"2023-10-06T02:17:48.044929+0000","last_fullsized":"2023-10-06T02:17:48.044929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:59.054001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045040+0000","last_change":"2023-10-06T02:17:44.020588+0000","last_active":"2023-10-06T02:17:48.045040+0000","last_peered":"2023-10-06T02:17:48.045040+0000","last_clean":"2023-10-06T02:17:48.045040+0000","last_became_active":"2023-10-06T02:17:44.020305+0000","last_became_peered":"2023-10-06T02:17:44.020305+0000","last_unstale":"2023-10-06T02:17:48.045040+0000","last_undegraded":"2023-10-06T02:17:48.045040+0000","last_fullsized":"2023-10-06T02:17:48.045040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:51.564963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.063145+0000","last_change":"2023-10-06T02:17:48.061567+0000","last_active":"2023-10-06T02:17:48.063145+0000","last_peered":"2023-10-06T02:17:48.063145+0000","last_clean":"2023-10-06T02:17:48.063145+0000","last_became_active":"2023-10-06T02:17:48.061209+0000","last_became_peered":"2023-10-06T02:17:48.061209+0000","last_unstale":"2023-10-06T02:17:48.063145+0000","last_undegraded":"2023-10-06T02:17:48.063145+0000","last_fullsized":"2023-10-06T02:17:48.063145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:05.058794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031418+0000","last_change":"2023-10-06T02:17:43.009617+0000","last_active":"2023-10-06T02:17:48.031418+0000","last_peered":"2023-10-06T02:17:48.031418+0000","last_clean":"2023-10-06T02:17:48.031418+0000","last_became_active":"2023-10-06T02:17:43.009347+0000","last_became_peered":"2023-10-06T02:17:43.009347+0000","last_unstale":"2023-10-06T02:17:48.031418+0000","last_undegraded":"2023-10-06T02:17:48.031418+0000","last_fullsized":"2023-10-06T02:17:48.031418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:59.054001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050566+0000","last_change":"2023-10-06T02:17:44.013663+0000","last_active":"2023-10-06T02:17:48.050566+0000","last_peered":"2023-10-06T02:17:48.050566+0000","last_clean":"2023-10-06T02:17:48.050566+0000","last_became_active":"2023-10-06T02:17:44.013346+0000","last_became_peered":"2023-10-06T02:17:44.013346+0000","last_unstale":"2023-10-06T02:17:48.050566+0000","last_undegraded":"2023-10-06T02:17:48.050566+0000","last_fullsized":"2023-10-06T02:17:48.050566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:21.073260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060535+0000","last_change":"2023-10-06T02:17:48.055404+0000","last_active":"2023-10-06T02:17:48.060535+0000","last_peered":"2023-10-06T02:17:48.060535+0000","last_clean":"2023-10-06T02:17:48.060535+0000","last_became_active":"2023-10-06T02:17:48.055037+0000","last_became_peered":"2023-10-06T02:17:48.055037+0000","last_unstale":"2023-10-06T02:17:48.060535+0000","last_undegraded":"2023-10-06T02:17:48.060535+0000","last_fullsized":"2023-10-06T02:17:48.060535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:39.126641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030793+0000","last_change":"2023-10-06T02:17:43.012193+0000","last_active":"2023-10-06T02:17:48.030793+0000","last_peered":"2023-10-06T02:17:48.030793+0000","last_clean":"2023-10-06T02:17:48.030793+0000","last_became_active":"2023-10-06T02:17:43.011988+0000","last_became_peered":"2023-10-06T02:17:43.011988+0000","last_unstale":"2023-10-06T02:17:48.030793+0000","last_undegraded":"2023-10-06T02:17:48.030793+0000","last_fullsized":"2023-10-06T02:17:48.030793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:56.588125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.038558+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:17:48.038558+0000","last_peered":"2023-10-06T02:17:48.038558+0000","last_clean":"2023-10-06T02:17:48.038558+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:17:48.038558+0000","last_undegraded":"2023-10-06T02:17:48.038558+0000","last_fullsized":"2023-10-06T02:17:48.038558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031321+0000","last_change":"2023-10-06T02:17:44.017661+0000","last_active":"2023-10-06T02:17:48.031321+0000","last_peered":"2023-10-06T02:17:48.031321+0000","last_clean":"2023-10-06T02:17:48.031321+0000","last_became_active":"2023-10-06T02:17:44.017396+0000","last_became_peered":"2023-10-06T02:17:44.017396+0000","last_unstale":"2023-10-06T02:17:48.031321+0000","last_undegraded":"2023-10-06T02:17:48.031321+0000","last_fullsized":"2023-10-06T02:17:48.031321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.055474+0000","last_change":"2023-10-06T02:17:48.051546+0000","last_active":"2023-10-06T02:17:48.055474+0000","last_peered":"2023-10-06T02:17:48.055474+0000","last_clean":"2023-10-06T02:17:48.055474+0000","last_became_active":"2023-10-06T02:17:48.051146+0000","last_became_peered":"2023-10-06T02:17:48.051146+0000","last_unstale":"2023-10-06T02:17:48.055474+0000","last_undegraded":"2023-10-06T02:17:48.055474+0000","last_fullsized":"2023-10-06T02:17:48.055474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:03.948559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030433+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:17:48.030433+0000","last_peered":"2023-10-06T02:17:48.030433+0000","last_clean":"2023-10-06T02:17:48.030433+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:17:48.030433+0000","last_undegraded":"2023-10-06T02:17:48.030433+0000","last_fullsized":"2023-10-06T02:17:48.030433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.057902+0000","last_change":"2023-10-06T02:17:43.001598+0000","last_active":"2023-10-06T02:17:48.057902+0000","last_peered":"2023-10-06T02:17:48.057902+0000","last_clean":"2023-10-06T02:17:48.057902+0000","last_became_active":"2023-10-06T02:17:43.000830+0000","last_became_peered":"2023-10-06T02:17:43.000830+0000","last_unstale":"2023-10-06T02:17:48.057902+0000","last_undegraded":"2023-10-06T02:17:48.057902+0000","last_fullsized":"2023-10-06T02:17:48.057902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:31.631012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045023+0000","last_change":"2023-10-06T02:17:44.022761+0000","last_active":"2023-10-06T02:17:48.045023+0000","last_peered":"2023-10-06T02:17:48.045023+0000","last_clean":"2023-10-06T02:17:48.045023+0000","last_became_active":"2023-10-06T02:17:44.022519+0000","last_became_peered":"2023-10-06T02:17:44.022519+0000","last_unstale":"2023-10-06T02:17:48.045023+0000","last_undegraded":"2023-10-06T02:17:48.045023+0000","last_fullsized":"2023-10-06T02:17:48.045023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:01.914117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060933+0000","last_change":"2023-10-06T02:17:48.057692+0000","last_active":"2023-10-06T02:17:48.060933+0000","last_peered":"2023-10-06T02:17:48.060933+0000","last_clean":"2023-10-06T02:17:48.060933+0000","last_became_active":"2023-10-06T02:17:48.057291+0000","last_became_peered":"2023-10-06T02:17:48.057291+0000","last_unstale":"2023-10-06T02:17:48.060933+0000","last_undegraded":"2023-10-06T02:17:48.060933+0000","last_fullsized":"2023-10-06T02:17:48.060933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:50.051594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045953+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:17:48.045953+0000","last_peered":"2023-10-06T02:17:48.045953+0000","last_clean":"2023-10-06T02:17:48.045953+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:17:48.045953+0000","last_undegraded":"2023-10-06T02:17:48.045953+0000","last_fullsized":"2023-10-06T02:17:48.045953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037402+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:17:48.037402+0000","last_peered":"2023-10-06T02:17:48.037402+0000","last_clean":"2023-10-06T02:17:48.037402+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:17:48.037402+0000","last_undegraded":"2023-10-06T02:17:48.037402+0000","last_fullsized":"2023-10-06T02:17:48.037402+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030986+0000","last_change":"2023-10-06T02:17:43.008254+0000","last_active":"2023-10-06T02:17:48.030986+0000","last_peered":"2023-10-06T02:17:48.030986+0000","last_clean":"2023-10-06T02:17:48.030986+0000","last_became_active":"2023-10-06T02:17:43.008031+0000","last_became_peered":"2023-10-06T02:17:43.008031+0000","last_unstale":"2023-10-06T02:17:48.030986+0000","last_undegraded":"2023-10-06T02:17:48.030986+0000","last_fullsized":"2023-10-06T02:17:48.030986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.543085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031988+0000","last_change":"2023-10-06T02:17:44.015903+0000","last_active":"2023-10-06T02:17:48.031988+0000","last_peered":"2023-10-06T02:17:48.031988+0000","last_clean":"2023-10-06T02:17:48.031988+0000","last_became_active":"2023-10-06T02:17:44.012940+0000","last_became_peered":"2023-10-06T02:17:44.012940+0000","last_unstale":"2023-10-06T02:17:48.031988+0000","last_undegraded":"2023-10-06T02:17:48.031988+0000","last_fullsized":"2023-10-06T02:17:48.031988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:11.590274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.058344+0000","last_change":"2023-10-06T02:17:48.054067+0000","last_active":"2023-10-06T02:17:48.058344+0000","last_peered":"2023-10-06T02:17:48.058344+0000","last_clean":"2023-10-06T02:17:48.058344+0000","last_became_active":"2023-10-06T02:17:48.053658+0000","last_became_peered":"2023-10-06T02:17:48.053658+0000","last_unstale":"2023-10-06T02:17:48.058344+0000","last_undegraded":"2023-10-06T02:17:48.058344+0000","last_fullsized":"2023-10-06T02:17:48.058344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:05.948051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036157+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:17:48.036157+0000","last_peered":"2023-10-06T02:17:48.036157+0000","last_clean":"2023-10-06T02:17:48.036157+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:17:48.036157+0000","last_undegraded":"2023-10-06T02:17:48.036157+0000","last_fullsized":"2023-10-06T02:17:48.036157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045745+0000","last_change":"2023-10-06T02:17:43.007395+0000","last_active":"2023-10-06T02:17:48.045745+0000","last_peered":"2023-10-06T02:17:48.045745+0000","last_clean":"2023-10-06T02:17:48.045745+0000","last_became_active":"2023-10-06T02:17:43.007096+0000","last_became_peered":"2023-10-06T02:17:43.007096+0000","last_unstale":"2023-10-06T02:17:48.045745+0000","last_undegraded":"2023-10-06T02:17:48.045745+0000","last_fullsized":"2023-10-06T02:17:48.045745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:31.631012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.050492+0000","last_change":"2023-10-06T02:17:44.024048+0000","last_active":"2023-10-06T02:17:48.050492+0000","last_peered":"2023-10-06T02:17:48.050492+0000","last_clean":"2023-10-06T02:17:48.050492+0000","last_became_active":"2023-10-06T02:17:44.023785+0000","last_became_peered":"2023-10-06T02:17:44.023785+0000","last_unstale":"2023-10-06T02:17:48.050492+0000","last_undegraded":"2023-10-06T02:17:48.050492+0000","last_fullsized":"2023-10-06T02:17:48.050492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:01.105765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.051840+0000","last_change":"2023-10-06T02:17:48.049159+0000","last_active":"2023-10-06T02:17:48.051840+0000","last_peered":"2023-10-06T02:17:48.051840+0000","last_clean":"2023-10-06T02:17:48.051840+0000","last_became_active":"2023-10-06T02:17:48.048030+0000","last_became_peered":"2023-10-06T02:17:48.048030+0000","last_unstale":"2023-10-06T02:17:48.051840+0000","last_undegraded":"2023-10-06T02:17:48.051840+0000","last_fullsized":"2023-10-06T02:17:48.051840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:59.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036269+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:17:48.036269+0000","last_peered":"2023-10-06T02:17:48.036269+0000","last_clean":"2023-10-06T02:17:48.036269+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:17:48.036269+0000","last_undegraded":"2023-10-06T02:17:48.036269+0000","last_fullsized":"2023-10-06T02:17:48.036269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030334+0000","last_change":"2023-10-06T02:17:43.012903+0000","last_active":"2023-10-06T02:17:48.030334+0000","last_peered":"2023-10-06T02:17:48.030334+0000","last_clean":"2023-10-06T02:17:48.030334+0000","last_became_active":"2023-10-06T02:17:43.012602+0000","last_became_peered":"2023-10-06T02:17:43.012602+0000","last_unstale":"2023-10-06T02:17:48.030334+0000","last_undegraded":"2023-10-06T02:17:48.030334+0000","last_fullsized":"2023-10-06T02:17:48.030334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:09.638074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040168+0000","last_change":"2023-10-06T02:17:44.017466+0000","last_active":"2023-10-06T02:17:48.040168+0000","last_peered":"2023-10-06T02:17:48.040168+0000","last_clean":"2023-10-06T02:17:48.040168+0000","last_became_active":"2023-10-06T02:17:44.017213+0000","last_became_peered":"2023-10-06T02:17:44.017213+0000","last_unstale":"2023-10-06T02:17:48.040168+0000","last_undegraded":"2023-10-06T02:17:48.040168+0000","last_fullsized":"2023-10-06T02:17:48.040168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:43.352906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.059484+0000","last_change":"2023-10-06T02:17:48.053794+0000","last_active":"2023-10-06T02:17:48.059484+0000","last_peered":"2023-10-06T02:17:48.059484+0000","last_clean":"2023-10-06T02:17:48.059484+0000","last_became_active":"2023-10-06T02:17:48.053274+0000","last_became_peered":"2023-10-06T02:17:48.053274+0000","last_unstale":"2023-10-06T02:17:48.059484+0000","last_undegraded":"2023-10-06T02:17:48.059484+0000","last_fullsized":"2023-10-06T02:17:48.059484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:29.446681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037498+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:17:48.037498+0000","last_peered":"2023-10-06T02:17:48.037498+0000","last_clean":"2023-10-06T02:17:48.037498+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:17:48.037498+0000","last_undegraded":"2023-10-06T02:17:48.037498+0000","last_fullsized":"2023-10-06T02:17:48.037498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039136+0000","last_change":"2023-10-06T02:17:43.013138+0000","last_active":"2023-10-06T02:17:48.039136+0000","last_peered":"2023-10-06T02:17:48.039136+0000","last_clean":"2023-10-06T02:17:48.039136+0000","last_became_active":"2023-10-06T02:17:43.012841+0000","last_became_peered":"2023-10-06T02:17:43.012841+0000","last_unstale":"2023-10-06T02:17:48.039136+0000","last_undegraded":"2023-10-06T02:17:48.039136+0000","last_fullsized":"2023-10-06T02:17:48.039136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:55.863203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.047850+0000","last_change":"2023-10-06T02:17:44.011211+0000","last_active":"2023-10-06T02:17:48.047850+0000","last_peered":"2023-10-06T02:17:48.047850+0000","last_clean":"2023-10-06T02:17:48.047850+0000","last_became_active":"2023-10-06T02:17:44.010694+0000","last_became_peered":"2023-10-06T02:17:44.010694+0000","last_unstale":"2023-10-06T02:17:48.047850+0000","last_undegraded":"2023-10-06T02:17:48.047850+0000","last_fullsized":"2023-10-06T02:17:48.047850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:12.022239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.052188+0000","last_change":"2023-10-06T02:17:48.049434+0000","last_active":"2023-10-06T02:17:48.052188+0000","last_peered":"2023-10-06T02:17:48.052188+0000","last_clean":"2023-10-06T02:17:48.052188+0000","last_became_active":"2023-10-06T02:17:48.049050+0000","last_became_peered":"2023-10-06T02:17:48.049050+0000","last_unstale":"2023-10-06T02:17:48.052188+0000","last_undegraded":"2023-10-06T02:17:48.052188+0000","last_fullsized":"2023-10-06T02:17:48.052188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:58.565730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039175+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:17:48.039175+0000","last_peered":"2023-10-06T02:17:48.039175+0000","last_clean":"2023-10-06T02:17:48.039175+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:17:48.039175+0000","last_undegraded":"2023-10-06T02:17:48.039175+0000","last_fullsized":"2023-10-06T02:17:48.039175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.048170+0000","last_change":"2023-10-06T02:17:43.009389+0000","last_active":"2023-10-06T02:17:48.048170+0000","last_peered":"2023-10-06T02:17:48.048170+0000","last_clean":"2023-10-06T02:17:48.048170+0000","last_became_active":"2023-10-06T02:17:43.009070+0000","last_became_peered":"2023-10-06T02:17:43.009070+0000","last_unstale":"2023-10-06T02:17:48.048170+0000","last_undegraded":"2023-10-06T02:17:48.048170+0000","last_fullsized":"2023-10-06T02:17:48.048170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:34.508977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.033624+0000","last_change":"2023-10-06T02:17:44.022296+0000","last_active":"2023-10-06T02:17:48.033624+0000","last_peered":"2023-10-06T02:17:48.033624+0000","last_clean":"2023-10-06T02:17:48.033624+0000","last_became_active":"2023-10-06T02:17:44.022032+0000","last_became_peered":"2023-10-06T02:17:44.022032+0000","last_unstale":"2023-10-06T02:17:48.033624+0000","last_undegraded":"2023-10-06T02:17:48.033624+0000","last_fullsized":"2023-10-06T02:17:48.033624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:56.966356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.058436+0000","last_change":"2023-10-06T02:17:48.049537+0000","last_active":"2023-10-06T02:17:48.058436+0000","last_peered":"2023-10-06T02:17:48.058436+0000","last_clean":"2023-10-06T02:17:48.058436+0000","last_became_active":"2023-10-06T02:17:48.049150+0000","last_became_peered":"2023-10-06T02:17:48.049150+0000","last_unstale":"2023-10-06T02:17:48.058436+0000","last_undegraded":"2023-10-06T02:17:48.058436+0000","last_fullsized":"2023-10-06T02:17:48.058436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:20.999472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039792+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:17:48.039792+0000","last_peered":"2023-10-06T02:17:48.039792+0000","last_clean":"2023-10-06T02:17:48.039792+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:17:48.039792+0000","last_undegraded":"2023-10-06T02:17:48.039792+0000","last_fullsized":"2023-10-06T02:17:48.039792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.040044+0000","last_change":"2023-10-06T02:17:43.017470+0000","last_active":"2023-10-06T02:17:48.040044+0000","last_peered":"2023-10-06T02:17:48.040044+0000","last_clean":"2023-10-06T02:17:48.040044+0000","last_became_active":"2023-10-06T02:17:43.017001+0000","last_became_peered":"2023-10-06T02:17:43.017001+0000","last_unstale":"2023-10-06T02:17:48.040044+0000","last_undegraded":"2023-10-06T02:17:48.040044+0000","last_fullsized":"2023-10-06T02:17:48.040044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:59.054001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.045239+0000","last_change":"2023-10-06T02:17:44.019859+0000","last_active":"2023-10-06T02:17:48.045239+0000","last_peered":"2023-10-06T02:17:48.045239+0000","last_clean":"2023-10-06T02:17:48.045239+0000","last_became_active":"2023-10-06T02:17:44.019178+0000","last_became_peered":"2023-10-06T02:17:44.019178+0000","last_unstale":"2023-10-06T02:17:48.045239+0000","last_undegraded":"2023-10-06T02:17:48.045239+0000","last_fullsized":"2023-10-06T02:17:48.045239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:41.549349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.059488+0000","last_change":"2023-10-06T02:17:48.056833+0000","last_active":"2023-10-06T02:17:48.059488+0000","last_peered":"2023-10-06T02:17:48.059488+0000","last_clean":"2023-10-06T02:17:48.059488+0000","last_became_active":"2023-10-06T02:17:48.056428+0000","last_became_peered":"2023-10-06T02:17:48.056428+0000","last_unstale":"2023-10-06T02:17:48.059488+0000","last_undegraded":"2023-10-06T02:17:48.059488+0000","last_fullsized":"2023-10-06T02:17:48.059488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:04.977537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.033524+0000","last_change":"2023-10-06T02:17:43.016304+0000","last_active":"2023-10-06T02:17:48.033524+0000","last_peered":"2023-10-06T02:17:48.033524+0000","last_clean":"2023-10-06T02:17:48.033524+0000","last_became_active":"2023-10-06T02:17:43.015998+0000","last_became_peered":"2023-10-06T02:17:43.015998+0000","last_unstale":"2023-10-06T02:17:48.033524+0000","last_undegraded":"2023-10-06T02:17:48.033524+0000","last_fullsized":"2023-10-06T02:17:48.033524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:09.638074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031489+0000","last_change":"2023-10-06T02:17:44.012571+0000","last_active":"2023-10-06T02:17:48.031489+0000","last_peered":"2023-10-06T02:17:48.031489+0000","last_clean":"2023-10-06T02:17:48.031489+0000","last_became_active":"2023-10-06T02:17:44.012245+0000","last_became_peered":"2023-10-06T02:17:44.012245+0000","last_unstale":"2023-10-06T02:17:48.031489+0000","last_undegraded":"2023-10-06T02:17:48.031489+0000","last_fullsized":"2023-10-06T02:17:48.031489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:56.870377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.061274+0000","last_change":"2023-10-06T02:17:48.057885+0000","last_active":"2023-10-06T02:17:48.061274+0000","last_peered":"2023-10-06T02:17:48.061274+0000","last_clean":"2023-10-06T02:17:48.061274+0000","last_became_active":"2023-10-06T02:17:48.057470+0000","last_became_peered":"2023-10-06T02:17:48.057470+0000","last_unstale":"2023-10-06T02:17:48.061274+0000","last_undegraded":"2023-10-06T02:17:48.061274+0000","last_fullsized":"2023-10-06T02:17:48.061274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:34.306615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039047+0000","last_change":"2023-10-06T02:17:43.014240+0000","last_active":"2023-10-06T02:17:48.039047+0000","last_peered":"2023-10-06T02:17:48.039047+0000","last_clean":"2023-10-06T02:17:48.039047+0000","last_became_active":"2023-10-06T02:17:43.013995+0000","last_became_peered":"2023-10-06T02:17:43.013995+0000","last_unstale":"2023-10-06T02:17:48.039047+0000","last_undegraded":"2023-10-06T02:17:48.039047+0000","last_fullsized":"2023-10-06T02:17:48.039047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:09.638074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039278+0000","last_change":"2023-10-06T02:17:44.012631+0000","last_active":"2023-10-06T02:17:48.039278+0000","last_peered":"2023-10-06T02:17:48.039278+0000","last_clean":"2023-10-06T02:17:48.039278+0000","last_became_active":"2023-10-06T02:17:44.012366+0000","last_became_peered":"2023-10-06T02:17:44.012366+0000","last_unstale":"2023-10-06T02:17:48.039278+0000","last_undegraded":"2023-10-06T02:17:48.039278+0000","last_fullsized":"2023-10-06T02:17:48.039278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:11.590274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060285+0000","last_change":"2023-10-06T02:17:48.054598+0000","last_active":"2023-10-06T02:17:48.060285+0000","last_peered":"2023-10-06T02:17:48.060285+0000","last_clean":"2023-10-06T02:17:48.060285+0000","last_became_active":"2023-10-06T02:17:48.054196+0000","last_became_peered":"2023-10-06T02:17:48.054196+0000","last_unstale":"2023-10-06T02:17:48.060285+0000","last_undegraded":"2023-10-06T02:17:48.060285+0000","last_fullsized":"2023-10-06T02:17:48.060285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:59.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039960+0000","last_change":"2023-10-06T02:17:43.015890+0000","last_active":"2023-10-06T02:17:48.039960+0000","last_peered":"2023-10-06T02:17:48.039960+0000","last_clean":"2023-10-06T02:17:48.039960+0000","last_became_active":"2023-10-06T02:17:43.015544+0000","last_became_peered":"2023-10-06T02:17:43.015544+0000","last_unstale":"2023-10-06T02:17:48.039960+0000","last_undegraded":"2023-10-06T02:17:48.039960+0000","last_fullsized":"2023-10-06T02:17:48.039960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.543085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037516+0000","last_change":"2023-10-06T02:17:44.027369+0000","last_active":"2023-10-06T02:17:48.037516+0000","last_peered":"2023-10-06T02:17:48.037516+0000","last_clean":"2023-10-06T02:17:48.037516+0000","last_became_active":"2023-10-06T02:17:44.026967+0000","last_became_peered":"2023-10-06T02:17:44.026967+0000","last_unstale":"2023-10-06T02:17:48.037516+0000","last_undegraded":"2023-10-06T02:17:48.037516+0000","last_fullsized":"2023-10-06T02:17:48.037516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:56.966356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.063103+0000","last_change":"2023-10-06T02:17:48.060867+0000","last_active":"2023-10-06T02:17:48.063103+0000","last_peered":"2023-10-06T02:17:48.063103+0000","last_clean":"2023-10-06T02:17:48.063103+0000","last_became_active":"2023-10-06T02:17:48.060507+0000","last_became_peered":"2023-10-06T02:17:48.060507+0000","last_unstale":"2023-10-06T02:17:48.063103+0000","last_undegraded":"2023-10-06T02:17:48.063103+0000","last_fullsized":"2023-10-06T02:17:48.063103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:41.579573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031205+0000","last_change":"2023-10-06T02:17:43.010564+0000","last_active":"2023-10-06T02:17:48.031205+0000","last_peered":"2023-10-06T02:17:48.031205+0000","last_clean":"2023-10-06T02:17:48.031205+0000","last_became_active":"2023-10-06T02:17:43.008507+0000","last_became_peered":"2023-10-06T02:17:43.008507+0000","last_unstale":"2023-10-06T02:17:48.031205+0000","last_undegraded":"2023-10-06T02:17:48.031205+0000","last_fullsized":"2023-10-06T02:17:48.031205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:55.863203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030181+0000","last_change":"2023-10-06T02:17:44.023457+0000","last_active":"2023-10-06T02:17:48.030181+0000","last_peered":"2023-10-06T02:17:48.030181+0000","last_clean":"2023-10-06T02:17:48.030181+0000","last_became_active":"2023-10-06T02:17:44.022723+0000","last_became_peered":"2023-10-06T02:17:44.022723+0000","last_unstale":"2023-10-06T02:17:48.030181+0000","last_undegraded":"2023-10-06T02:17:48.030181+0000","last_fullsized":"2023-10-06T02:17:48.030181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:56.966356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.060390+0000","last_change":"2023-10-06T02:17:48.058509+0000","last_active":"2023-10-06T02:17:48.060390+0000","last_peered":"2023-10-06T02:17:48.060390+0000","last_clean":"2023-10-06T02:17:48.060390+0000","last_became_active":"2023-10-06T02:17:48.058112+0000","last_became_peered":"2023-10-06T02:17:48.058112+0000","last_unstale":"2023-10-06T02:17:48.060390+0000","last_undegraded":"2023-10-06T02:17:48.060390+0000","last_fullsized":"2023-10-06T02:17:48.060390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:47.021294+0000","last_clean_scrub_stamp":"2023-10-06T02:17:47.021294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:59.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031046+0000","last_change":"2023-10-06T02:17:43.013591+0000","last_active":"2023-10-06T02:17:48.031046+0000","last_peered":"2023-10-06T02:17:48.031046+0000","last_clean":"2023-10-06T02:17:48.031046+0000","last_became_active":"2023-10-06T02:17:43.013150+0000","last_became_peered":"2023-10-06T02:17:43.013150+0000","last_unstale":"2023-10-06T02:17:48.031046+0000","last_undegraded":"2023-10-06T02:17:48.031046+0000","last_fullsized":"2023-10-06T02:17:48.031046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:41.980186+0000","last_clean_scrub_stamp":"2023-10-06T02:17:41.980186+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:55.863203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.036796+0000","last_change":"2023-10-06T02:17:44.021121+0000","last_active":"2023-10-06T02:17:48.036796+0000","last_peered":"2023-10-06T02:17:48.036796+0000","last_clean":"2023-10-06T02:17:48.036796+0000","last_became_active":"2023-10-06T02:17:44.020849+0000","last_became_peered":"2023-10-06T02:17:44.020849+0000","last_unstale":"2023-10-06T02:17:48.036796+0000","last_undegraded":"2023-10-06T02:17:48.036796+0000","last_fullsized":"2023-10-06T02:17:48.036796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.060566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.039127+0000","last_change":"2023-10-06T02:17:44.025857+0000","last_active":"2023-10-06T02:17:48.039127+0000","last_peered":"2023-10-06T02:17:48.039127+0000","last_clean":"2023-10-06T02:17:48.039127+0000","last_became_active":"2023-10-06T02:17:44.025639+0000","last_became_peered":"2023-10-06T02:17:44.025639+0000","last_unstale":"2023-10-06T02:17:48.039127+0000","last_undegraded":"2023-10-06T02:17:48.039127+0000","last_fullsized":"2023-10-06T02:17:48.039127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:22.992220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.030199+0000","last_change":"2023-10-06T02:17:44.021795+0000","last_active":"2023-10-06T02:17:48.030199+0000","last_peered":"2023-10-06T02:17:48.030199+0000","last_clean":"2023-10-06T02:17:48.030199+0000","last_became_active":"2023-10-06T02:17:44.021519+0000","last_became_peered":"2023-10-06T02:17:44.021519+0000","last_unstale":"2023-10-06T02:17:48.030199+0000","last_undegraded":"2023-10-06T02:17:48.030199+0000","last_fullsized":"2023-10-06T02:17:48.030199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:29.729845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.037699+0000","last_change":"2023-10-06T02:17:44.020596+0000","last_active":"2023-10-06T02:17:48.037699+0000","last_peered":"2023-10-06T02:17:48.037699+0000","last_clean":"2023-10-06T02:17:48.037699+0000","last_became_active":"2023-10-06T02:17:44.020327+0000","last_became_peered":"2023-10-06T02:17:44.020327+0000","last_unstale":"2023-10-06T02:17:48.037699+0000","last_undegraded":"2023-10-06T02:17:48.037699+0000","last_fullsized":"2023-10-06T02:17:48.037699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:08.638757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.031988+0000","last_change":"2023-10-06T02:17:44.023963+0000","last_active":"2023-10-06T02:17:48.031988+0000","last_peered":"2023-10-06T02:17:48.031988+0000","last_clean":"2023-10-06T02:17:48.031988+0000","last_became_active":"2023-10-06T02:17:44.023520+0000","last_became_peered":"2023-10-06T02:17:44.023520+0000","last_unstale":"2023-10-06T02:17:48.031988+0000","last_undegraded":"2023-10-06T02:17:48.031988+0000","last_fullsized":"2023-10-06T02:17:48.031988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:05.747241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T02:17:48.048071+0000","last_change":"2023-10-06T02:17:44.014573+0000","last_active":"2023-10-06T02:17:48.048071+0000","last_peered":"2023-10-06T02:17:48.048071+0000","last_clean":"2023-10-06T02:17:48.048071+0000","last_became_active":"2023-10-06T02:17:44.014301+0000","last_became_peered":"2023-10-06T02:17:44.014301+0000","last_unstale":"2023-10-06T02:17:48.048071+0000","last_undegraded":"2023-10-06T02:17:48.048071+0000","last_fullsized":"2023-10-06T02:17:48.048071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:42.987360+0000","last_clean_scrub_stamp":"2023-10-06T02:17:42.987360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:04.413740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":703395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":108144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298124,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073716,"statfs":{"total":96636764160,"available":96331485184,"internally_reserved":0,"allocated":856064,"data_stored":698512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":108144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":112867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":109721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:18:02.870 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T02:18:02.870 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T02:18:02.870 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T02:18:02.870 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T02:18:03.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.017+0000 7fec8c913700 1 Processor -- start 2023-10-06T02:18:03.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.017+0000 7fec8c913700 1 -- start start 2023-10-06T02:18:03.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.018+0000 7fec8c913700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec880adbc0 0x7fec880a6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.018+0000 7fec8c913700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec880accc0 con 0x7fec88155c30 2023-10-06T02:18:03.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.018+0000 7fec8c913700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec880ac0f0 con 0x7fec88155860 2023-10-06T02:18:03.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.018+0000 7fec8c913700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec880ad150 con 0x7fec880adbc0 2023-10-06T02:18:03.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.018+0000 7fec85d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fec88155c30 0x7fec880ad4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36182/0 (socket says 172.21.15.6:36182) 2023-10-06T02:18:03.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.018+0000 7fec85d9b700 1 -- 172.21.15.6:0/3979668044 learned_addr learned my addr 172.21.15.6:0/3979668044 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:03.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec8559a700 1 -- 172.21.15.6:0/3979668044 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593354743 0 0) 0x7fec880accc0 con 0x7fec88155c30 2023-10-06T02:18:03.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec8559a700 1 -- 172.21.15.6:0/3979668044 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec74003570 con 0x7fec88155c30 2023-10-06T02:18:03.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec86d9d700 1 --2- 172.21.15.6:0/3979668044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec880adbc0 0x7fec880a6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec8559a700 1 -- 172.21.15.6:0/3979668044 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4114416500 0 0) 0x7fec74003570 con 0x7fec88155c30 2023-10-06T02:18:03.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec8559a700 1 -- 172.21.15.6:0/3979668044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec880adbc0 msgr2=0x7fec880a6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:03.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec8559a700 1 --2- 172.21.15.6:0/3979668044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec880adbc0 0x7fec880a6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec8559a700 1 -- 172.21.15.6:0/3979668044 >> v1:172.21.15.175:6789/0 conn(0x7fec88155860 legacy=0x7fec880cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec8559a700 1 -- 172.21.15.6:0/3979668044 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec880ac390 con 0x7fec88155c30 2023-10-06T02:18:03.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec8559a700 1 -- 172.21.15.6:0/3979668044 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fec70001470 con 0x7fec88155c30 2023-10-06T02:18:03.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec8559a700 1 -- 172.21.15.6:0/3979668044 >> v1:172.21.15.6:6789/0 conn(0x7fec88155c30 legacy=0x7fec880ad4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec8559a700 1 --2- 172.21.15.6:0/3979668044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec74003a90 0x7fec74003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec8559a700 1 --2- 172.21.15.6:0/3979668044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec880adbc0 0x7fec74004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec8559a700 1 --2- 172.21.15.6:0/3979668044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec74004d50 0x7fec740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec8559a700 1 -- 172.21.15.6:0/3979668044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7400bb10 con 0x7fec74003a90 2023-10-06T02:18:03.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec8559a700 1 -- 172.21.15.6:0/3979668044 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7400bc50 con 0x7fec74004d50 2023-10-06T02:18:03.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec8559a700 1 -- 172.21.15.6:0/3979668044 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7400be10 con 0x7fec880adbc0 2023-10-06T02:18:03.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec8659c700 1 --2- 172.21.15.6:0/3979668044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec74003a90 0x7fec74003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec86d9d700 1 --2- 172.21.15.6:0/3979668044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec74004d50 0x7fec740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.019+0000 7fec85d9b700 1 --2- 172.21.15.6:0/3979668044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec880adbc0 0x7fec74004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.020+0000 7fec8659c700 1 -- 172.21.15.6:0/3979668044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec880adbc0 msgr2=0x7fec74004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:03.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.020+0000 7fec8659c700 1 --2- 172.21.15.6:0/3979668044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec880adbc0 0x7fec74004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.020+0000 7fec8659c700 1 -- 172.21.15.6:0/3979668044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec74004d50 msgr2=0x7fec740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:03.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.020+0000 7fec8659c700 1 --2- 172.21.15.6:0/3979668044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec74004d50 0x7fec740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.020+0000 7fec8659c700 1 -- 172.21.15.6:0/3979668044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec74003570 con 0x7fec74003a90 2023-10-06T02:18:03.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.020+0000 7fec86d9d700 1 --2- 172.21.15.6:0/3979668044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec74004d50 0x7fec740051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:03.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.020+0000 7fec8659c700 1 --2- 172.21.15.6:0/3979668044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec74003a90 0x7fec74003e60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fec80002170 tx=0x7fec800017d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93322db73a1d53b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:03.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.020+0000 7fec8559a700 1 -- 172.21.15.6:0/3979668044 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec80001ae0 con 0x7fec74003a90 2023-10-06T02:18:03.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.020+0000 7fec8559a700 1 -- 172.21.15.6:0/3979668044 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8000c940 con 0x7fec74003a90 2023-10-06T02:18:03.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.020+0000 7fec8559a700 1 -- 172.21.15.6:0/3979668044 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8000cce0 con 0x7fec74003a90 2023-10-06T02:18:03.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.020+0000 7fec8c913700 1 -- 172.21.15.6:0/3979668044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec74003a90 msgr2=0x7fec74003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.020+0000 7fec8c913700 1 --2- 172.21.15.6:0/3979668044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec74003a90 0x7fec74003e60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fec80002170 tx=0x7fec800017d0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.020+0000 7fec86d9d700 1 -- 172.21.15.6:0/3979668044 reap_dead start 2023-10-06T02:18:03.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.020+0000 7fec8c913700 1 -- 172.21.15.6:0/3979668044 shutdown_connections 2023-10-06T02:18:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.020+0000 7fec8c913700 1 -- 172.21.15.6:0/3979668044 >> 172.21.15.6:0/3979668044 conn(0x7fec880cc790 msgr2=0x7fec880ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.020+0000 7fec8c913700 1 -- 172.21.15.6:0/3979668044 shutdown_connections 2023-10-06T02:18:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.020+0000 7fec8c913700 1 -- 172.21.15.6:0/3979668044 wait complete. 2023-10-06T02:18:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.022+0000 7fec8c913700 1 Processor -- start 2023-10-06T02:18:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.022+0000 7fec8c913700 1 -- start start 2023-10-06T02:18:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.022+0000 7fec8c913700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec74003a90 0x7fec880c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.022+0000 7fec8c913700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec880c1530 0x7fec88169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.022+0000 7fec8c913700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec880c52e0 0x7fec880c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.022+0000 7fec8c913700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8816a410 con 0x7fec74003a90 2023-10-06T02:18:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.022+0000 7fec8c913700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec880c2820 con 0x7fec880c52e0 2023-10-06T02:18:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.022+0000 7fec8c913700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec880c19a0 con 0x7fec880c1530 2023-10-06T02:18:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.022+0000 7fec8659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec74003a90 0x7fec880c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.022+0000 7fec8659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec74003a90 0x7fec880c2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54514/0 (socket says 172.21.15.6:54514) 2023-10-06T02:18:03.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.022+0000 7fec8659c700 1 -- 172.21.15.6:0/3495808201 learned_addr learned my addr 172.21.15.6:0/3495808201 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:03.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.022+0000 7fec85d9b700 1 --2- 172.21.15.6:0/3495808201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec880c1530 0x7fec88169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.022+0000 7fec86d9d700 1 --2- 172.21.15.6:0/3495808201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec880c52e0 0x7fec880c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.023+0000 7fec8659c700 1 -- 172.21.15.6:0/3495808201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec880c1530 msgr2=0x7fec88169ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.023+0000 7fec8659c700 1 --2- 172.21.15.6:0/3495808201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec880c1530 0x7fec88169ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.023+0000 7fec8659c700 1 -- 172.21.15.6:0/3495808201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec880c52e0 msgr2=0x7fec880c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.023+0000 7fec8659c700 1 --2- 172.21.15.6:0/3495808201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec880c52e0 0x7fec880c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.023+0000 7fec8659c700 1 -- 172.21.15.6:0/3495808201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec880c1c10 con 0x7fec74003a90 2023-10-06T02:18:03.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.023+0000 7fec8659c700 1 --2- 172.21.15.6:0/3495808201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec74003a90 0x7fec880c2cb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fec80012cc0 tx=0x7fec80016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:03.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.023+0000 7fec7e7fc700 1 -- 172.21.15.6:0/3495808201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec80001ae0 con 0x7fec74003a90 2023-10-06T02:18:03.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.023+0000 7fec7e7fc700 1 -- 172.21.15.6:0/3495808201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8001e640 con 0x7fec74003a90 2023-10-06T02:18:03.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.023+0000 7fec8c913700 1 -- 172.21.15.6:0/3495808201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec880c1ef0 con 0x7fec74003a90 2023-10-06T02:18:03.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.023+0000 7fec7e7fc700 1 -- 172.21.15.6:0/3495808201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec80012ea0 con 0x7fec74003a90 2023-10-06T02:18:03.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.023+0000 7fec8c913700 1 -- 172.21.15.6:0/3495808201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec880c24b0 con 0x7fec74003a90 2023-10-06T02:18:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.024+0000 7fec8c913700 1 -- 172.21.15.6:0/3495808201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec8806e1b0 con 0x7fec74003a90 2023-10-06T02:18:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.025+0000 7fec7e7fc700 1 -- 172.21.15.6:0/3495808201 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec80024070 con 0x7fec74003a90 2023-10-06T02:18:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.025+0000 7fec7e7fc700 1 --2- 172.21.15.6:0/3495808201 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec68066f30 0x7fec680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.025+0000 7fec7e7fc700 1 -- 172.21.15.6:0/3495808201 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fec80086e30 con 0x7fec74003a90 2023-10-06T02:18:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.025+0000 7fec85d9b700 1 --2- 172.21.15.6:0/3495808201 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec68066f30 0x7fec680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.026+0000 7fec85d9b700 1 --2- 172.21.15.6:0/3495808201 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec68066f30 0x7fec680693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fec70001200 tx=0x7fec70001df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.029+0000 7fec7e7fc700 1 -- 172.21.15.6:0/3495808201 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec80053c50 con 0x7fec74003a90 2023-10-06T02:18:03.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.266+0000 7fec8c913700 1 -- 172.21.15.6:0/3495808201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fec880ac670 con 0x7fec74003a90 2023-10-06T02:18:03.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.266+0000 7fec7e7fc700 1 -- 172.21.15.6:0/3495808201 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fec8002c020 con 0x7fec74003a90 2023-10-06T02:18:03.267 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:03.268 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T02:18:03.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.268+0000 7fec8c913700 1 -- 172.21.15.6:0/3495808201 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec68066f30 msgr2=0x7fec680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.268+0000 7fec8c913700 1 --2- 172.21.15.6:0/3495808201 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec68066f30 0x7fec680693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fec70001200 tx=0x7fec70001df0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.268+0000 7fec8c913700 1 -- 172.21.15.6:0/3495808201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec74003a90 msgr2=0x7fec880c2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.268+0000 7fec8c913700 1 --2- 172.21.15.6:0/3495808201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec74003a90 0x7fec880c2cb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fec80012cc0 tx=0x7fec80016000 comp rx=0 tx=0).stop 2023-10-06T02:18:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.268+0000 7fec8c913700 1 -- 172.21.15.6:0/3495808201 shutdown_connections 2023-10-06T02:18:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.268+0000 7fec8c913700 1 --2- 172.21.15.6:0/3495808201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec880c52e0 0x7fec880c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.268+0000 7fec8c913700 1 --2- 172.21.15.6:0/3495808201 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec68066f30 0x7fec680693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.268+0000 7fec8c913700 1 --2- 172.21.15.6:0/3495808201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec74003a90 0x7fec880c2cb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.268+0000 7fec8c913700 1 --2- 172.21.15.6:0/3495808201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec880c1530 0x7fec88169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.268+0000 7fec8c913700 1 -- 172.21.15.6:0/3495808201 >> 172.21.15.6:0/3495808201 conn(0x7fec880cc790 msgr2=0x7fec88156020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.268+0000 7fec8c913700 1 -- 172.21.15.6:0/3495808201 shutdown_connections 2023-10-06T02:18:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.268+0000 7fec8c913700 1 -- 172.21.15.6:0/3495808201 wait complete. 2023-10-06T02:18:03.281 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T02:18:03.282 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:18:03.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.399+0000 7fdc86888700 1 Processor -- start 2023-10-06T02:18:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.399+0000 7fdc86888700 1 -- start start 2023-10-06T02:18:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.400+0000 7fdc86888700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc800af4e0 0x7fdc800b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.400+0000 7fdc86888700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc800af8b0 0x7fdc800b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.400+0000 7fdc86888700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8015e190 con 0x7fdc8015d460 2023-10-06T02:18:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.400+0000 7fdc86888700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc800b1910 con 0x7fdc800af8b0 2023-10-06T02:18:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.400+0000 7fdc86888700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8015dfb0 con 0x7fdc800af4e0 2023-10-06T02:18:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.400+0000 7fdc7f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc800af8b0 0x7fdc800b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.400+0000 7fdc84e25700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdc8015d460 0x7fdc8015d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36190/0 (socket says 172.21.15.6:36190) 2023-10-06T02:18:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.400+0000 7fdc84e25700 1 -- 172.21.15.6:0/1178366572 learned_addr learned my addr 172.21.15.6:0/1178366572 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.400+0000 7fdc7f7fe700 1 --2- 172.21.15.6:0/1178366572 >> v2:172.21.15.6:3300/0 conn(0x7fdc800af8b0 0x7fdc800b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54518/0 (socket says 172.21.15.6:54518) 2023-10-06T02:18:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.401+0000 7fdc7ffff700 1 --2- 172.21.15.6:0/1178366572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc800af4e0 0x7fdc800b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.401+0000 7fdc7f7fe700 1 -- 172.21.15.6:0/1178366572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc800af4e0 msgr2=0x7fdc800b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.401+0000 7fdc7f7fe700 1 --2- 172.21.15.6:0/1178366572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc800af4e0 0x7fdc800b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.401+0000 7fdc7f7fe700 1 -- 172.21.15.6:0/1178366572 >> v1:172.21.15.6:6789/0 conn(0x7fdc8015d460 legacy=0x7fdc8015d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.401+0000 7fdc7effd700 1 -- 172.21.15.6:0/1178366572 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386589192 0 0) 0x7fdc8015e190 con 0x7fdc8015d460 2023-10-06T02:18:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.401+0000 7fdc7f7fe700 1 -- 172.21.15.6:0/1178366572 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc800cb650 con 0x7fdc800af8b0 2023-10-06T02:18:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.401+0000 7fdc7f7fe700 1 --2- 172.21.15.6:0/1178366572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc800af8b0 0x7fdc800b2620 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdc740098e0 tx=0x7fdc740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af52f1521f7a7f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.401+0000 7fdc7effd700 1 -- 172.21.15.6:0/1178366572 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400b640 con 0x7fdc800af8b0 2023-10-06T02:18:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.401+0000 7fdc7effd700 1 -- 172.21.15.6:0/1178366572 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7400b7a0 con 0x7fdc800af8b0 2023-10-06T02:18:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.401+0000 7fdc7effd700 1 -- 172.21.15.6:0/1178366572 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400bb40 con 0x7fdc800af8b0 2023-10-06T02:18:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.401+0000 7fdc86888700 1 -- 172.21.15.6:0/1178366572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc800af8b0 msgr2=0x7fdc800b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.401+0000 7fdc86888700 1 --2- 172.21.15.6:0/1178366572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc800af8b0 0x7fdc800b2620 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdc740098e0 tx=0x7fdc740091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.402+0000 7fdc86888700 1 -- 172.21.15.6:0/1178366572 shutdown_connections 2023-10-06T02:18:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.402+0000 7fdc86888700 1 --2- 172.21.15.6:0/1178366572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc800af4e0 0x7fdc800b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.402+0000 7fdc86888700 1 --2- 172.21.15.6:0/1178366572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc800af8b0 0x7fdc800b2620 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.402+0000 7fdc86888700 1 -- 172.21.15.6:0/1178366572 >> 172.21.15.6:0/1178366572 conn(0x7fdc80068680 msgr2=0x7fdc80068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.402+0000 7fdc86888700 1 -- 172.21.15.6:0/1178366572 shutdown_connections 2023-10-06T02:18:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.402+0000 7fdc86888700 1 -- 172.21.15.6:0/1178366572 wait complete. 2023-10-06T02:18:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.403+0000 7fdc86888700 1 Processor -- start 2023-10-06T02:18:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.403+0000 7fdc86888700 1 -- start start 2023-10-06T02:18:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc86888700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc800af4e0 0x7fdc800c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc86888700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc800af8b0 0x7fdc8016b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc86888700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc8015d460 0x7fdc8016b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc86888700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc800c8f80 con 0x7fdc8015d460 2023-10-06T02:18:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc86888700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc800c8370 con 0x7fdc800af8b0 2023-10-06T02:18:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc86888700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc800c8650 con 0x7fdc800af4e0 2023-10-06T02:18:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc84e25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc8015d460 0x7fdc8016b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc84e25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc8015d460 0x7fdc8016b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54532/0 (socket says 172.21.15.6:54532) 2023-10-06T02:18:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc84e25700 1 -- 172.21.15.6:0/1024451996 learned_addr learned my addr 172.21.15.6:0/1024451996 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:03.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc7ffff700 1 --2- 172.21.15.6:0/1024451996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc800af4e0 0x7fdc800c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc7f7fe700 1 --2- 172.21.15.6:0/1024451996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc800af8b0 0x7fdc8016b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc84e25700 1 -- 172.21.15.6:0/1024451996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc800af4e0 msgr2=0x7fdc800c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc84e25700 1 --2- 172.21.15.6:0/1024451996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc800af4e0 0x7fdc800c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc84e25700 1 -- 172.21.15.6:0/1024451996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc800af8b0 msgr2=0x7fdc8016b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc84e25700 1 --2- 172.21.15.6:0/1024451996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc800af8b0 0x7fdc8016b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc84e25700 1 -- 172.21.15.6:0/1024451996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc74009420 con 0x7fdc8015d460 2023-10-06T02:18:03.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc84e25700 1 --2- 172.21.15.6:0/1024451996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc8015d460 0x7fdc8016b630 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800cc90 tx=0x7fdc78001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:03.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc67fff700 1 -- 172.21.15.6:0/1024451996 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7800a8b0 con 0x7fdc8015d460 2023-10-06T02:18:03.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc67fff700 1 -- 172.21.15.6:0/1024451996 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7800aa10 con 0x7fdc8015d460 2023-10-06T02:18:03.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc86888700 1 -- 172.21.15.6:0/1024451996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc800c8930 con 0x7fdc8015d460 2023-10-06T02:18:03.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc67fff700 1 -- 172.21.15.6:0/1024451996 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7800add0 con 0x7fdc8015d460 2023-10-06T02:18:03.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.404+0000 7fdc86888700 1 -- 172.21.15.6:0/1024451996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc800c9950 con 0x7fdc8015d460 2023-10-06T02:18:03.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.405+0000 7fdc86888700 1 -- 172.21.15.6:0/1024451996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc800c90f0 con 0x7fdc8015d460 2023-10-06T02:18:03.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.406+0000 7fdc67fff700 1 -- 172.21.15.6:0/1024451996 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc78007300 con 0x7fdc8015d460 2023-10-06T02:18:03.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.406+0000 7fdc67fff700 1 --2- 172.21.15.6:0/1024451996 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc6c066f30 0x7fdc6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.406+0000 7fdc67fff700 1 -- 172.21.15.6:0/1024451996 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdc78084ca0 con 0x7fdc8015d460 2023-10-06T02:18:03.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.407+0000 7fdc7ffff700 1 --2- 172.21.15.6:0/1024451996 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc6c066f30 0x7fdc6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.407+0000 7fdc7ffff700 1 --2- 172.21.15.6:0/1024451996 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc6c066f30 0x7fdc6c0693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009d10 tx=0x7fdc700091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:03.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.411+0000 7fdc67fff700 1 -- 172.21.15.6:0/1024451996 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc78051b40 con 0x7fdc8015d460 2023-10-06T02:18:03.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.604+0000 7fdc86888700 1 -- 172.21.15.6:0/1024451996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc800b0910 con 0x7fdc8015d460 2023-10-06T02:18:03.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.605+0000 7fdc67fff700 1 -- 172.21.15.6:0/1024451996 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fdc78055160 con 0x7fdc8015d460 2023-10-06T02:18:03.607 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:03.607 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:48.453046+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:18:03.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.608+0000 7fdc86888700 1 -- 172.21.15.6:0/1024451996 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc6c066f30 msgr2=0x7fdc6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.608+0000 7fdc86888700 1 --2- 172.21.15.6:0/1024451996 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc6c066f30 0x7fdc6c0693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009d10 tx=0x7fdc700091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.608+0000 7fdc86888700 1 -- 172.21.15.6:0/1024451996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc8015d460 msgr2=0x7fdc8016b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.608+0000 7fdc86888700 1 --2- 172.21.15.6:0/1024451996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc8015d460 0x7fdc8016b630 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800cc90 tx=0x7fdc78001a80 comp rx=0 tx=0).stop 2023-10-06T02:18:03.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.608+0000 7fdc86888700 1 -- 172.21.15.6:0/1024451996 shutdown_connections 2023-10-06T02:18:03.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.608+0000 7fdc86888700 1 --2- 172.21.15.6:0/1024451996 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc6c066f30 0x7fdc6c0693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.608+0000 7fdc86888700 1 --2- 172.21.15.6:0/1024451996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc8015d460 0x7fdc8016b630 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.608+0000 7fdc86888700 1 --2- 172.21.15.6:0/1024451996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc800af4e0 0x7fdc800c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.608+0000 7fdc86888700 1 --2- 172.21.15.6:0/1024451996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc800af8b0 0x7fdc8016b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.608+0000 7fdc86888700 1 -- 172.21.15.6:0/1024451996 >> 172.21.15.6:0/1024451996 conn(0x7fdc80068680 msgr2=0x7fdc800ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:03.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.608+0000 7fdc86888700 1 -- 172.21.15.6:0/1024451996 shutdown_connections 2023-10-06T02:18:03.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.608+0000 7fdc86888700 1 -- 172.21.15.6:0/1024451996 wait complete. 2023-10-06T02:18:03.621 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:17:41.126402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:17:42.378468+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T02:17:46.053654+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:18:03.622 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:18:03.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.743+0000 7f348a429700 1 Processor -- start 2023-10-06T02:18:03.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.743+0000 7f348a429700 1 -- start start 2023-10-06T02:18:03.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.744+0000 7f348a429700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f34840cd400 0x7f34840b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.744+0000 7f348a429700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34840cd7d0 0x7f34840b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.744+0000 7f348a429700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34840b29a0 con 0x7f34840b0810 2023-10-06T02:18:03.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.744+0000 7f348a429700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34840af770 con 0x7f34840cd400 2023-10-06T02:18:03.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.744+0000 7f348a429700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34840afa50 con 0x7f34840cd7d0 2023-10-06T02:18:03.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.744+0000 7f3488c26700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34840cd7d0 0x7f34840b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.744+0000 7f3489427700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f34840cd400 0x7f34840b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.744+0000 7f3488c26700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34840cd7d0 0x7f34840b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:32782/0 (socket says 172.21.15.6:32782) 2023-10-06T02:18:03.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.744+0000 7f3488c26700 1 -- 172.21.15.6:0/2213966662 learned_addr learned my addr 172.21.15.6:0/2213966662 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:03.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.745+0000 7f3488c26700 1 -- 172.21.15.6:0/2213966662 >> v2:172.21.15.175:3300/0 conn(0x7f34840cd400 msgr2=0x7f34840b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:03.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.745+0000 7f3488c26700 1 --2- 172.21.15.6:0/2213966662 >> v2:172.21.15.175:3300/0 conn(0x7f34840cd400 0x7f34840b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.745+0000 7f3488c26700 1 -- 172.21.15.6:0/2213966662 >> v1:172.21.15.175:6789/0 conn(0x7f34840b0810 legacy=0x7f34840d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.745+0000 7f3488c26700 1 -- 172.21.15.6:0/2213966662 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840afd30 con 0x7f34840cd7d0 2023-10-06T02:18:03.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.745+0000 7f3483fff700 1 -- 172.21.15.6:0/2213966662 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041874924 0 0) 0x7f3474001490 con 0x7f34840b0810 2023-10-06T02:18:03.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.745+0000 7f3488c26700 1 --2- 172.21.15.6:0/2213966662 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34840cd7d0 0x7f34840b2460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f34780099b0 tx=0x7f3478009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=778a4c7e5324321 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:03.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.745+0000 7f3483fff700 1 -- 172.21.15.6:0/2213966662 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3478009ea0 con 0x7f34840cd7d0 2023-10-06T02:18:03.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.745+0000 7f3483fff700 1 -- 172.21.15.6:0/2213966662 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347800b860 con 0x7f34840cd7d0 2023-10-06T02:18:03.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.745+0000 7f3483fff700 1 -- 172.21.15.6:0/2213966662 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347800bc20 con 0x7f34840cd7d0 2023-10-06T02:18:03.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.746+0000 7f348a429700 1 -- 172.21.15.6:0/2213966662 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34840cd7d0 msgr2=0x7f34840b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.746+0000 7f348a429700 1 --2- 172.21.15.6:0/2213966662 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34840cd7d0 0x7f34840b2460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f34780099b0 tx=0x7f3478009250 comp rx=0 tx=0).stop 2023-10-06T02:18:03.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.746+0000 7f348a429700 1 -- 172.21.15.6:0/2213966662 shutdown_connections 2023-10-06T02:18:03.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.746+0000 7f348a429700 1 --2- 172.21.15.6:0/2213966662 >> v2:172.21.15.175:3300/0 conn(0x7f34840cd400 0x7f34840b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.746+0000 7f348a429700 1 --2- 172.21.15.6:0/2213966662 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34840cd7d0 0x7f34840b2460 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.746+0000 7f348a429700 1 -- 172.21.15.6:0/2213966662 >> 172.21.15.6:0/2213966662 conn(0x7f348406a110 msgr2=0x7f348406a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:03.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.746+0000 7f348a429700 1 -- 172.21.15.6:0/2213966662 shutdown_connections 2023-10-06T02:18:03.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.746+0000 7f348a429700 1 -- 172.21.15.6:0/2213966662 wait complete. 2023-10-06T02:18:03.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.747+0000 7f348a429700 1 Processor -- start 2023-10-06T02:18:03.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.747+0000 7f348a429700 1 -- start start 2023-10-06T02:18:03.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.748+0000 7f348a429700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34840b0810 0x7f34840c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.748+0000 7f348a429700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34840cd400 0x7f3484153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.748+0000 7f348a429700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348415a960 0x7f34840c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.748+0000 7f348a429700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34840c55a0 con 0x7f348415a960 2023-10-06T02:18:03.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.748+0000 7f348a429700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348415b120 con 0x7f34840b0810 2023-10-06T02:18:03.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.748+0000 7f348a429700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34840c6100 con 0x7f34840cd400 2023-10-06T02:18:03.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.748+0000 7f3489c28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348415a960 0x7f34840c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.748+0000 7f3489c28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348415a960 0x7f34840c6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54534/0 (socket says 172.21.15.6:54534) 2023-10-06T02:18:03.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.748+0000 7f3489c28700 1 -- 172.21.15.6:0/1364709535 learned_addr learned my addr 172.21.15.6:0/1364709535 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:03.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.748+0000 7f3489427700 1 --2- 172.21.15.6:0/1364709535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34840b0810 0x7f34840c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.748+0000 7f3488c26700 1 --2- 172.21.15.6:0/1364709535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34840cd400 0x7f3484153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.748+0000 7f3489c28700 1 -- 172.21.15.6:0/1364709535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34840cd400 msgr2=0x7f3484153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.748+0000 7f3489c28700 1 --2- 172.21.15.6:0/1364709535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34840cd400 0x7f3484153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.748+0000 7f3489c28700 1 -- 172.21.15.6:0/1364709535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34840b0810 msgr2=0x7f34840c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.748+0000 7f3489c28700 1 --2- 172.21.15.6:0/1364709535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34840b0810 0x7f34840c3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.748+0000 7f3489c28700 1 -- 172.21.15.6:0/1364709535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34780094f0 con 0x7f348415a960 2023-10-06T02:18:03.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.748+0000 7f3489c28700 1 --2- 172.21.15.6:0/1364709535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348415a960 0x7f34840c6590 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f347400c8c0 tx=0x7f3474001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:03.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.749+0000 7f34817fa700 1 -- 172.21.15.6:0/1364709535 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3474012630 con 0x7f348415a960 2023-10-06T02:18:03.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.749+0000 7f34817fa700 1 -- 172.21.15.6:0/1364709535 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3474012790 con 0x7f348415a960 2023-10-06T02:18:03.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.749+0000 7f348a429700 1 -- 172.21.15.6:0/1364709535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34840c6ad0 con 0x7f348415a960 2023-10-06T02:18:03.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.749+0000 7f34817fa700 1 -- 172.21.15.6:0/1364709535 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3474012b50 con 0x7f348415a960 2023-10-06T02:18:03.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.749+0000 7f348a429700 1 -- 172.21.15.6:0/1364709535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34840c5ab0 con 0x7f348415a960 2023-10-06T02:18:03.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.750+0000 7f348a429700 1 -- 172.21.15.6:0/1364709535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3484064aa0 con 0x7f348415a960 2023-10-06T02:18:03.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.750+0000 7f34817fa700 1 -- 172.21.15.6:0/1364709535 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3474003030 con 0x7f348415a960 2023-10-06T02:18:03.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.750+0000 7f34817fa700 1 --2- 172.21.15.6:0/1364709535 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3470066f30 0x7f34700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:03.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.750+0000 7f34817fa700 1 -- 172.21.15.6:0/1364709535 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f34740846f0 con 0x7f348415a960 2023-10-06T02:18:03.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.751+0000 7f3489427700 1 --2- 172.21.15.6:0/1364709535 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3470066f30 0x7f34700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:03.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.751+0000 7f3489427700 1 --2- 172.21.15.6:0/1364709535 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3470066f30 0x7f34700693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f347c009da0 tx=0x7f347c009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:03.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.755+0000 7f34817fa700 1 -- 172.21.15.6:0/1364709535 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3474051510 con 0x7f348415a960 2023-10-06T02:18:03.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.949+0000 7f348a429700 1 -- 172.21.15.6:0/1364709535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f34840b29a0 con 0x7f348415a960 2023-10-06T02:18:03.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.949+0000 7f34817fa700 1 -- 172.21.15.6:0/1364709535 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f34840b29a0 con 0x7f348415a960 2023-10-06T02:18:03.951 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:18:03.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.951+0000 7f348a429700 1 -- 172.21.15.6:0/1364709535 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3470066f30 msgr2=0x7f34700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.951+0000 7f348a429700 1 --2- 172.21.15.6:0/1364709535 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3470066f30 0x7f34700693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f347c009da0 tx=0x7f347c009120 comp rx=0 tx=0).stop 2023-10-06T02:18:03.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.951+0000 7f348a429700 1 -- 172.21.15.6:0/1364709535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348415a960 msgr2=0x7f34840c6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:03.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.951+0000 7f348a429700 1 --2- 172.21.15.6:0/1364709535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348415a960 0x7f34840c6590 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f347400c8c0 tx=0x7f3474001630 comp rx=0 tx=0).stop 2023-10-06T02:18:03.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.952+0000 7f348a429700 1 -- 172.21.15.6:0/1364709535 shutdown_connections 2023-10-06T02:18:03.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.952+0000 7f348a429700 1 --2- 172.21.15.6:0/1364709535 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3470066f30 0x7f34700693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.952+0000 7f348a429700 1 --2- 172.21.15.6:0/1364709535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348415a960 0x7f34840c6590 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.952+0000 7f348a429700 1 --2- 172.21.15.6:0/1364709535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34840b0810 0x7f34840c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.952+0000 7f348a429700 1 --2- 172.21.15.6:0/1364709535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34840cd400 0x7f3484153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:03.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.952+0000 7f348a429700 1 -- 172.21.15.6:0/1364709535 >> 172.21.15.6:0/1364709535 conn(0x7f348406a110 msgr2=0x7f34841543c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:03.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.952+0000 7f348a429700 1 -- 172.21.15.6:0/1364709535 shutdown_connections 2023-10-06T02:18:03.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:03.952+0000 7f348a429700 1 -- 172.21.15.6:0/1364709535 wait complete. 2023-10-06T02:18:03.965 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:18:04.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.088+0000 7f59d81a1700 1 Processor -- start 2023-10-06T02:18:04.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.088+0000 7f59d81a1700 1 -- start start 2023-10-06T02:18:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.089+0000 7f59d81a1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d00ccd40 0x7f59d00cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.089+0000 7f59d81a1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d015dd40 con 0x7f59d00cf7e0 2023-10-06T02:18:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.089+0000 7f59d81a1700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d015e020 con 0x7f59d00d0400 2023-10-06T02:18:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.089+0000 7f59d81a1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d00ceaa0 con 0x7f59d00ccd40 2023-10-06T02:18:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.089+0000 7f59d673e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f59d00cf7e0 0x7f59d00b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36204/0 (socket says 172.21.15.6:36204) 2023-10-06T02:18:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.089+0000 7f59d673e700 1 -- 172.21.15.6:0/848480667 learned_addr learned my addr 172.21.15.6:0/848480667 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.089+0000 7f59d573c700 1 --2- 172.21.15.6:0/848480667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d00ccd40 0x7f59d00cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.089+0000 7f59d4f3b700 1 -- 172.21.15.6:0/848480667 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954569253 0 0) 0x7f59d015dd40 con 0x7f59d00cf7e0 2023-10-06T02:18:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.089+0000 7f59d4f3b700 1 -- 172.21.15.6:0/848480667 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59b8003570 con 0x7f59d00cf7e0 2023-10-06T02:18:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.090+0000 7f59d4f3b700 1 -- 172.21.15.6:0/848480667 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682608156 0 0) 0x7f59d015e020 con 0x7f59d00d0400 2023-10-06T02:18:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.090+0000 7f59d4f3b700 1 -- 172.21.15.6:0/848480667 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d015dd40 con 0x7f59d00d0400 2023-10-06T02:18:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.090+0000 7f59d573c700 1 -- 172.21.15.6:0/848480667 >> v1:172.21.15.175:6789/0 conn(0x7f59d00d0400 legacy=0x7f59d00b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.090+0000 7f59d573c700 1 -- 172.21.15.6:0/848480667 >> v1:172.21.15.6:6789/0 conn(0x7f59d00cf7e0 legacy=0x7f59d00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.090+0000 7f59d573c700 1 -- 172.21.15.6:0/848480667 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d00ced80 con 0x7f59d00ccd40 2023-10-06T02:18:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.090+0000 7f59d573c700 1 --2- 172.21.15.6:0/848480667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d00ccd40 0x7f59d00cf2a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009910 tx=0x7f59c40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a597c0cf858aa187 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.090+0000 7f59d4f3b700 1 -- 172.21.15.6:0/848480667 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4011630 con 0x7f59d00ccd40 2023-10-06T02:18:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.090+0000 7f59d4f3b700 1 -- 172.21.15.6:0/848480667 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c4011790 con 0x7f59d00ccd40 2023-10-06T02:18:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.090+0000 7f59d4f3b700 1 -- 172.21.15.6:0/848480667 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4011b10 con 0x7f59d00ccd40 2023-10-06T02:18:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.091+0000 7f59d81a1700 1 -- 172.21.15.6:0/848480667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d00ccd40 msgr2=0x7f59d00cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.091+0000 7f59d81a1700 1 --2- 172.21.15.6:0/848480667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d00ccd40 0x7f59d00cf2a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009910 tx=0x7f59c40091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.091+0000 7f59d81a1700 1 -- 172.21.15.6:0/848480667 shutdown_connections 2023-10-06T02:18:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.091+0000 7f59d81a1700 1 --2- 172.21.15.6:0/848480667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d00ccd40 0x7f59d00cf2a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.091+0000 7f59d81a1700 1 -- 172.21.15.6:0/848480667 >> 172.21.15.6:0/848480667 conn(0x7f59d006a220 msgr2=0x7f59d006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.091+0000 7f59d81a1700 1 -- 172.21.15.6:0/848480667 shutdown_connections 2023-10-06T02:18:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.091+0000 7f59d81a1700 1 -- 172.21.15.6:0/848480667 wait complete. 2023-10-06T02:18:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.092+0000 7f59d81a1700 1 Processor -- start 2023-10-06T02:18:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.092+0000 7f59d81a1700 1 -- start start 2023-10-06T02:18:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.092+0000 7f59d81a1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59d00ccd40 0x7f59d01557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:04.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.092+0000 7f59d81a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59d00cf7e0 0x7f59d0169ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:04.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59d81a1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d00d0400 0x7f59d00ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:04.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59d81a1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d016a9a0 con 0x7f59d00cf7e0 2023-10-06T02:18:04.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59d81a1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d016ac80 con 0x7f59d00ccd40 2023-10-06T02:18:04.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59d81a1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d00c6510 con 0x7f59d00d0400 2023-10-06T02:18:04.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59d573c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59d00cf7e0 0x7f59d0169ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:04.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59d573c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59d00cf7e0 0x7f59d0169ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54548/0 (socket says 172.21.15.6:54548) 2023-10-06T02:18:04.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59d573c700 1 -- 172.21.15.6:0/4266545544 learned_addr learned my addr 172.21.15.6:0/4266545544 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59d5f3d700 1 --2- 172.21.15.6:0/4266545544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59d00ccd40 0x7f59d01557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59d673e700 1 --2- 172.21.15.6:0/4266545544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d00d0400 0x7f59d00ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59d573c700 1 -- 172.21.15.6:0/4266545544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d00d0400 msgr2=0x7f59d00ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59d573c700 1 --2- 172.21.15.6:0/4266545544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d00d0400 0x7f59d00ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59d573c700 1 -- 172.21.15.6:0/4266545544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59d00ccd40 msgr2=0x7f59d01557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59d573c700 1 --2- 172.21.15.6:0/4266545544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59d00ccd40 0x7f59d01557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59d573c700 1 -- 172.21.15.6:0/4266545544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c4009420 con 0x7f59d00cf7e0 2023-10-06T02:18:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59d573c700 1 --2- 172.21.15.6:0/4266545544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59d00cf7e0 0x7f59d0169ee0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f59d00883f0 tx=0x7f59c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59cdffb700 1 -- 172.21.15.6:0/4266545544 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4011900 con 0x7f59d00cf7e0 2023-10-06T02:18:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59cdffb700 1 -- 172.21.15.6:0/4266545544 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c4011a60 con 0x7f59d00cf7e0 2023-10-06T02:18:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59d81a1700 1 -- 172.21.15.6:0/4266545544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d00c67f0 con 0x7f59d00cf7e0 2023-10-06T02:18:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.093+0000 7f59cdffb700 1 -- 172.21.15.6:0/4266545544 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4025640 con 0x7f59d00cf7e0 2023-10-06T02:18:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.094+0000 7f59d81a1700 1 -- 172.21.15.6:0/4266545544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d00c5ba0 con 0x7f59d00cf7e0 2023-10-06T02:18:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.094+0000 7f59d81a1700 1 -- 172.21.15.6:0/4266545544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d00cc800 con 0x7f59d00cf7e0 2023-10-06T02:18:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.095+0000 7f59cdffb700 1 -- 172.21.15.6:0/4266545544 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59c4025a30 con 0x7f59d00cf7e0 2023-10-06T02:18:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.095+0000 7f59cdffb700 1 --2- 172.21.15.6:0/4266545544 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59bc066f30 0x7f59bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.095+0000 7f59cdffb700 1 -- 172.21.15.6:0/4266545544 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f59c40861f0 con 0x7f59d00cf7e0 2023-10-06T02:18:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.096+0000 7f59d5f3d700 1 --2- 172.21.15.6:0/4266545544 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59bc066f30 0x7f59bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:04.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.096+0000 7f59d5f3d700 1 --2- 172.21.15.6:0/4266545544 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59bc066f30 0x7f59bc0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f59c0000f80 tx=0x7f59c0002ab0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:04.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.100+0000 7f59cdffb700 1 -- 172.21.15.6:0/4266545544 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59c4052f70 con 0x7f59d00cf7e0 2023-10-06T02:18:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.294+0000 7f59d81a1700 1 -- 172.21.15.6:0/4266545544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59d00ce6c0 con 0x7f59d00cf7e0 2023-10-06T02:18:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.294+0000 7f59cdffb700 1 -- 172.21.15.6:0/4266545544 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59c4056590 con 0x7f59d00cf7e0 2023-10-06T02:18:04.296 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:18:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.296+0000 7f59d81a1700 1 -- 172.21.15.6:0/4266545544 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59bc066f30 msgr2=0x7f59bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.296+0000 7f59d81a1700 1 --2- 172.21.15.6:0/4266545544 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59bc066f30 0x7f59bc0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f59c0000f80 tx=0x7f59c0002ab0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.296+0000 7f59d81a1700 1 -- 172.21.15.6:0/4266545544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59d00cf7e0 msgr2=0x7f59d0169ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.296+0000 7f59d81a1700 1 --2- 172.21.15.6:0/4266545544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59d00cf7e0 0x7f59d0169ee0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f59d00883f0 tx=0x7f59c4017000 comp rx=0 tx=0).stop 2023-10-06T02:18:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.296+0000 7f59d81a1700 1 -- 172.21.15.6:0/4266545544 shutdown_connections 2023-10-06T02:18:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.296+0000 7f59d81a1700 1 --2- 172.21.15.6:0/4266545544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d00d0400 0x7f59d00ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.296+0000 7f59d81a1700 1 --2- 172.21.15.6:0/4266545544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59d00ccd40 0x7f59d01557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.296+0000 7f59d81a1700 1 --2- 172.21.15.6:0/4266545544 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59bc066f30 0x7f59bc0693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.296+0000 7f59d81a1700 1 --2- 172.21.15.6:0/4266545544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59d00cf7e0 0x7f59d0169ee0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.297+0000 7f59d81a1700 1 -- 172.21.15.6:0/4266545544 >> 172.21.15.6:0/4266545544 conn(0x7f59d006a220 msgr2=0x7f59d00b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.297+0000 7f59d81a1700 1 -- 172.21.15.6:0/4266545544 shutdown_connections 2023-10-06T02:18:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.297+0000 7f59d81a1700 1 -- 172.21.15.6:0/4266545544 wait complete. 2023-10-06T02:18:04.310 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:18:04.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.430+0000 7fab9f593700 1 Processor -- start 2023-10-06T02:18:04.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.430+0000 7fab9f593700 1 -- start start 2023-10-06T02:18:04.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.431+0000 7fab9f593700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fab980b0810 0x7fab98164160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:04.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.431+0000 7fab9f593700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab980af770 con 0x7fab980cd400 2023-10-06T02:18:04.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.431+0000 7fab9f593700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab980afa50 con 0x7fab980cd7d0 2023-10-06T02:18:04.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.431+0000 7fab9f593700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab980afd30 con 0x7fab980b0810 2023-10-06T02:18:04.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.431+0000 7fab9e591700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fab980cd400 0x7fab980b1f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36206/0 (socket says 172.21.15.6:36206) 2023-10-06T02:18:04.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.431+0000 7fab9e591700 1 -- 172.21.15.6:0/2414652140 learned_addr learned my addr 172.21.15.6:0/2414652140 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:04.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.431+0000 7fab9ed92700 1 --2- 172.21.15.6:0/2414652140 >> v2:172.21.15.175:3300/0 conn(0x7fab980b0810 0x7fab98164160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:04.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.431+0000 7fab9d58f700 1 -- 172.21.15.6:0/2414652140 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598837660 0 0) 0x7fab980af770 con 0x7fab980cd400 2023-10-06T02:18:04.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.431+0000 7fab9d58f700 1 -- 172.21.15.6:0/2414652140 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab80003570 con 0x7fab980cd400 2023-10-06T02:18:04.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.431+0000 7fab9d58f700 1 -- 172.21.15.6:0/2414652140 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278184881 0 0) 0x7fab980afa50 con 0x7fab980cd7d0 2023-10-06T02:18:04.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.431+0000 7fab9d58f700 1 -- 172.21.15.6:0/2414652140 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab980af770 con 0x7fab980cd7d0 2023-10-06T02:18:04.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.431+0000 7fab9ed92700 1 -- 172.21.15.6:0/2414652140 >> v1:172.21.15.175:6789/0 conn(0x7fab980cd7d0 legacy=0x7fab980d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.431+0000 7fab9ed92700 1 -- 172.21.15.6:0/2414652140 >> v1:172.21.15.6:6789/0 conn(0x7fab980cd400 legacy=0x7fab980b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.432+0000 7fab9d58f700 1 -- 172.21.15.6:0/2414652140 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 234856108 0 0) 0x7fab80003570 con 0x7fab980cd400 2023-10-06T02:18:04.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.432+0000 7fab9ed92700 1 -- 172.21.15.6:0/2414652140 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab980b0010 con 0x7fab980b0810 2023-10-06T02:18:04.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.432+0000 7fab9ed92700 1 --2- 172.21.15.6:0/2414652140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab980b0810 0x7fab98164160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fab88009e90 tx=0x7fab88009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca0e29e1a789df6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:04.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.432+0000 7fab9d58f700 1 -- 172.21.15.6:0/2414652140 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8800e070 con 0x7fab980b0810 2023-10-06T02:18:04.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.432+0000 7fab9d58f700 1 -- 172.21.15.6:0/2414652140 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8800b870 con 0x7fab980b0810 2023-10-06T02:18:04.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.432+0000 7fab9d58f700 1 -- 172.21.15.6:0/2414652140 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab900015f0 con 0x7fab980b0810 2023-10-06T02:18:04.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.432+0000 7fab9f593700 1 -- 172.21.15.6:0/2414652140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab980b0810 msgr2=0x7fab98164160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.432+0000 7fab9f593700 1 --2- 172.21.15.6:0/2414652140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab980b0810 0x7fab98164160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fab88009e90 tx=0x7fab88009780 comp rx=0 tx=0).stop 2023-10-06T02:18:04.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.432+0000 7fab9f593700 1 -- 172.21.15.6:0/2414652140 shutdown_connections 2023-10-06T02:18:04.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.432+0000 7fab9f593700 1 --2- 172.21.15.6:0/2414652140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab980b0810 0x7fab98164160 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.432+0000 7fab9f593700 1 -- 172.21.15.6:0/2414652140 >> 172.21.15.6:0/2414652140 conn(0x7fab9806a110 msgr2=0x7fab9806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:04.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.433+0000 7fab9f593700 1 -- 172.21.15.6:0/2414652140 shutdown_connections 2023-10-06T02:18:04.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.433+0000 7fab9f593700 1 -- 172.21.15.6:0/2414652140 wait complete. 2023-10-06T02:18:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.434+0000 7fab9f593700 1 Processor -- start 2023-10-06T02:18:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.434+0000 7fab9f593700 1 -- start start 2023-10-06T02:18:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.434+0000 7fab9f593700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab980b0810 0x7fab98154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.434+0000 7fab9f593700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab980cd400 0x7fab980ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.434+0000 7fab9f593700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980cf400 0x7fab9816d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.434+0000 7fab9f593700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab980cfb50 con 0x7fab980cf400 2023-10-06T02:18:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.434+0000 7fab9f593700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab98154990 con 0x7fab980b0810 2023-10-06T02:18:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.434+0000 7fab9f593700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab980cf870 con 0x7fab980cd400 2023-10-06T02:18:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.434+0000 7fab9ed92700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980cf400 0x7fab9816d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:04.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.434+0000 7fab9ed92700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980cf400 0x7fab9816d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54554/0 (socket says 172.21.15.6:54554) 2023-10-06T02:18:04.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.434+0000 7fab9ed92700 1 -- 172.21.15.6:0/3554411798 learned_addr learned my addr 172.21.15.6:0/3554411798 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:04.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.435+0000 7fab9e591700 1 --2- 172.21.15.6:0/3554411798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab980b0810 0x7fab98154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:04.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.435+0000 7fab9dd90700 1 --2- 172.21.15.6:0/3554411798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab980cd400 0x7fab980ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:04.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.435+0000 7fab9ed92700 1 -- 172.21.15.6:0/3554411798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab980cd400 msgr2=0x7fab980ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.435+0000 7fab9ed92700 1 --2- 172.21.15.6:0/3554411798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab980cd400 0x7fab980ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.435+0000 7fab9ed92700 1 -- 172.21.15.6:0/3554411798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab980b0810 msgr2=0x7fab98154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.435+0000 7fab9ed92700 1 --2- 172.21.15.6:0/3554411798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab980b0810 0x7fab98154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.435+0000 7fab9ed92700 1 -- 172.21.15.6:0/3554411798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab88009a20 con 0x7fab980cf400 2023-10-06T02:18:04.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.435+0000 7fab9e591700 1 --2- 172.21.15.6:0/3554411798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab980b0810 0x7fab98154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:04.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.435+0000 7fab9dd90700 1 --2- 172.21.15.6:0/3554411798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab980cd400 0x7fab980ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:04.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.435+0000 7fab9ed92700 1 --2- 172.21.15.6:0/3554411798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980cf400 0x7fab9816d170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fab88003000 tx=0x7fab88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:04.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.435+0000 7fab967fc700 1 -- 172.21.15.6:0/3554411798 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88012cb0 con 0x7fab980cf400 2023-10-06T02:18:04.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.435+0000 7fab967fc700 1 -- 172.21.15.6:0/3554411798 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab88012e10 con 0x7fab980cf400 2023-10-06T02:18:04.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.435+0000 7fab9f593700 1 -- 172.21.15.6:0/3554411798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab980c59d0 con 0x7fab980cf400 2023-10-06T02:18:04.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.435+0000 7fab967fc700 1 -- 172.21.15.6:0/3554411798 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab880266b0 con 0x7fab980cf400 2023-10-06T02:18:04.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.435+0000 7fab9f593700 1 -- 172.21.15.6:0/3554411798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab980c5f90 con 0x7fab980cf400 2023-10-06T02:18:04.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.436+0000 7fab9f593700 1 -- 172.21.15.6:0/3554411798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab980c5800 con 0x7fab980cf400 2023-10-06T02:18:04.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.437+0000 7fab967fc700 1 -- 172.21.15.6:0/3554411798 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab8801d440 con 0x7fab980cf400 2023-10-06T02:18:04.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.437+0000 7fab967fc700 1 --2- 172.21.15.6:0/3554411798 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fab84066f30 0x7fab840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:04.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.437+0000 7fab967fc700 1 -- 172.21.15.6:0/3554411798 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fab88086bd0 con 0x7fab980cf400 2023-10-06T02:18:04.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.437+0000 7fab9e591700 1 --2- 172.21.15.6:0/3554411798 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fab84066f30 0x7fab840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:04.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.438+0000 7fab9e591700 1 --2- 172.21.15.6:0/3554411798 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fab84066f30 0x7fab840693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fab90001170 tx=0x7fab90009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:04.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.441+0000 7fab967fc700 1 -- 172.21.15.6:0/3554411798 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab880539f0 con 0x7fab980cf400 2023-10-06T02:18:04.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.633+0000 7fab9f593700 1 -- 172.21.15.6:0/3554411798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab980c6180 con 0x7fab980cf400 2023-10-06T02:18:04.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.633+0000 7fab967fc700 1 -- 172.21.15.6:0/3554411798 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fab88057010 con 0x7fab980cf400 2023-10-06T02:18:04.635 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:18:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.635+0000 7fab9f593700 1 -- 172.21.15.6:0/3554411798 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fab84066f30 msgr2=0x7fab840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.635+0000 7fab9f593700 1 --2- 172.21.15.6:0/3554411798 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fab84066f30 0x7fab840693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fab90001170 tx=0x7fab90009040 comp rx=0 tx=0).stop 2023-10-06T02:18:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.635+0000 7fab9f593700 1 -- 172.21.15.6:0/3554411798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980cf400 msgr2=0x7fab9816d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.635+0000 7fab9f593700 1 --2- 172.21.15.6:0/3554411798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980cf400 0x7fab9816d170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fab88003000 tx=0x7fab88017000 comp rx=0 tx=0).stop 2023-10-06T02:18:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.635+0000 7fab9f593700 1 -- 172.21.15.6:0/3554411798 shutdown_connections 2023-10-06T02:18:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.635+0000 7fab9f593700 1 --2- 172.21.15.6:0/3554411798 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fab84066f30 0x7fab840693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.635+0000 7fab9f593700 1 --2- 172.21.15.6:0/3554411798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab980cf400 0x7fab9816d170 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.635+0000 7fab9f593700 1 --2- 172.21.15.6:0/3554411798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab980b0810 0x7fab98154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.635+0000 7fab9f593700 1 --2- 172.21.15.6:0/3554411798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab980cd400 0x7fab980ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.635+0000 7fab9f593700 1 -- 172.21.15.6:0/3554411798 >> 172.21.15.6:0/3554411798 conn(0x7fab9806a110 msgr2=0x7fab981597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.635+0000 7fab9f593700 1 -- 172.21.15.6:0/3554411798 shutdown_connections 2023-10-06T02:18:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.635+0000 7fab9f593700 1 -- 172.21.15.6:0/3554411798 wait complete. 2023-10-06T02:18:04.648 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:18:04.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.769+0000 7fad1c178700 1 Processor -- start 2023-10-06T02:18:04.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.769+0000 7fad1c178700 1 -- start start 2023-10-06T02:18:04.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.770+0000 7fad1c178700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fad140d0400 0x7fad140b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.770+0000 7fad1c178700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad140ccd40 0x7fad140cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.770+0000 7fad1c178700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad140b6170 con 0x7fad140cf7e0 2023-10-06T02:18:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.770+0000 7fad1c178700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1415dd40 con 0x7fad140d0400 2023-10-06T02:18:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.770+0000 7fad1c178700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1415e020 con 0x7fad140ccd40 2023-10-06T02:18:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.770+0000 7fad19f14700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fad140d0400 0x7fad140b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.770+0000 7fad1a715700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fad140cf7e0 0x7fad140b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36218/0 (socket says 172.21.15.6:36218) 2023-10-06T02:18:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.770+0000 7fad19f14700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fad140d0400 0x7fad140b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54566/0 (socket says 172.21.15.6:54566) 2023-10-06T02:18:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.770+0000 7fad1a715700 1 -- 172.21.15.6:0/3013770422 learned_addr learned my addr 172.21.15.6:0/3013770422 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.770+0000 7fad19713700 1 --2- 172.21.15.6:0/3013770422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad140ccd40 0x7fad140cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.770+0000 7fad19f14700 1 -- 172.21.15.6:0/3013770422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad140ccd40 msgr2=0x7fad140cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.770+0000 7fad19f14700 1 --2- 172.21.15.6:0/3013770422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad140ccd40 0x7fad140cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.770+0000 7fad19f14700 1 -- 172.21.15.6:0/3013770422 >> v1:172.21.15.6:6789/0 conn(0x7fad140cf7e0 legacy=0x7fad140b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.770+0000 7fad19f14700 1 -- 172.21.15.6:0/3013770422 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad140ceaa0 con 0x7fad140d0400 2023-10-06T02:18:04.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.770+0000 7fad18f12700 1 -- 172.21.15.6:0/3013770422 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002536286 0 0) 0x7fad140b6170 con 0x7fad140cf7e0 2023-10-06T02:18:04.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.770+0000 7fad19f14700 1 --2- 172.21.15.6:0/3013770422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad140d0400 0x7fad140b5c30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fad04009eb0 tx=0x7fad04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13fd379c5aa77ee5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:04.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.771+0000 7fad18f12700 1 -- 172.21.15.6:0/3013770422 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0400e070 con 0x7fad140d0400 2023-10-06T02:18:04.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.771+0000 7fad18f12700 1 -- 172.21.15.6:0/3013770422 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0400bc30 con 0x7fad140d0400 2023-10-06T02:18:04.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.771+0000 7fad18f12700 1 -- 172.21.15.6:0/3013770422 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad04012430 con 0x7fad140d0400 2023-10-06T02:18:04.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.771+0000 7fad1c178700 1 -- 172.21.15.6:0/3013770422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad140d0400 msgr2=0x7fad140b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.771+0000 7fad1c178700 1 --2- 172.21.15.6:0/3013770422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad140d0400 0x7fad140b5c30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fad04009eb0 tx=0x7fad04009780 comp rx=0 tx=0).stop 2023-10-06T02:18:04.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.771+0000 7fad1c178700 1 -- 172.21.15.6:0/3013770422 shutdown_connections 2023-10-06T02:18:04.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.771+0000 7fad1c178700 1 --2- 172.21.15.6:0/3013770422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad140d0400 0x7fad140b5c30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.771+0000 7fad1c178700 1 --2- 172.21.15.6:0/3013770422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad140ccd40 0x7fad140cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.771+0000 7fad1c178700 1 -- 172.21.15.6:0/3013770422 >> 172.21.15.6:0/3013770422 conn(0x7fad1406a220 msgr2=0x7fad1406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:04.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.771+0000 7fad1c178700 1 -- 172.21.15.6:0/3013770422 shutdown_connections 2023-10-06T02:18:04.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.771+0000 7fad1c178700 1 -- 172.21.15.6:0/3013770422 wait complete. 2023-10-06T02:18:04.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.772+0000 7fad1c178700 1 Processor -- start 2023-10-06T02:18:04.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.772+0000 7fad1c178700 1 -- start start 2023-10-06T02:18:04.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.773+0000 7fad1c178700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad140ccd40 0x7fad140cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:04.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.773+0000 7fad1c178700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad140cf7e0 0x7fad1415af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:04.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.773+0000 7fad1c178700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad140d0400 0x7fad140c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:04.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.773+0000 7fad1c178700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1415c430 con 0x7fad140ccd40 2023-10-06T02:18:04.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.773+0000 7fad1c178700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1415b820 con 0x7fad140d0400 2023-10-06T02:18:04.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.773+0000 7fad1c178700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1415bb00 con 0x7fad140cf7e0 2023-10-06T02:18:04.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.773+0000 7fad19f14700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad140ccd40 0x7fad140cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:04.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.773+0000 7fad19f14700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad140ccd40 0x7fad140cb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54574/0 (socket says 172.21.15.6:54574) 2023-10-06T02:18:04.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.773+0000 7fad19f14700 1 -- 172.21.15.6:0/1486764523 learned_addr learned my addr 172.21.15.6:0/1486764523 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:04.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.773+0000 7fad19713700 1 --2- 172.21.15.6:0/1486764523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad140cf7e0 0x7fad1415af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:04.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.773+0000 7fad1a715700 1 --2- 172.21.15.6:0/1486764523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad140d0400 0x7fad140c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:04.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.773+0000 7fad19f14700 1 -- 172.21.15.6:0/1486764523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad140cf7e0 msgr2=0x7fad1415af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.773+0000 7fad19f14700 1 --2- 172.21.15.6:0/1486764523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad140cf7e0 0x7fad1415af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.773+0000 7fad19f14700 1 -- 172.21.15.6:0/1486764523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad140d0400 msgr2=0x7fad140c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.773+0000 7fad19f14700 1 --2- 172.21.15.6:0/1486764523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad140d0400 0x7fad140c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.773+0000 7fad19f14700 1 -- 172.21.15.6:0/1486764523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad04009a20 con 0x7fad140ccd40 2023-10-06T02:18:04.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.773+0000 7fad1a715700 1 --2- 172.21.15.6:0/1486764523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad140d0400 0x7fad140c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:04.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.774+0000 7fad19f14700 1 --2- 172.21.15.6:0/1486764523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad140ccd40 0x7fad140cb880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fad040097c0 tx=0x7fad04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:04.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.774+0000 7fad11ffb700 1 -- 172.21.15.6:0/1486764523 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad04027470 con 0x7fad140ccd40 2023-10-06T02:18:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.774+0000 7fad11ffb700 1 -- 172.21.15.6:0/1486764523 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad040275d0 con 0x7fad140ccd40 2023-10-06T02:18:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.774+0000 7fad11ffb700 1 -- 172.21.15.6:0/1486764523 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad04027990 con 0x7fad140ccd40 2023-10-06T02:18:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.774+0000 7fad1c178700 1 -- 172.21.15.6:0/1486764523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1415bde0 con 0x7fad140ccd40 2023-10-06T02:18:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.774+0000 7fad1c178700 1 -- 172.21.15.6:0/1486764523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1415c8c0 con 0x7fad140ccd40 2023-10-06T02:18:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.775+0000 7fad1c178700 1 -- 172.21.15.6:0/1486764523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1415c710 con 0x7fad140ccd40 2023-10-06T02:18:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.775+0000 7fad11ffb700 1 -- 172.21.15.6:0/1486764523 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad04024070 con 0x7fad140ccd40 2023-10-06T02:18:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.776+0000 7fad11ffb700 1 --2- 172.21.15.6:0/1486764523 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad00066f30 0x7fad000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.776+0000 7fad11ffb700 1 -- 172.21.15.6:0/1486764523 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fad04087410 con 0x7fad140ccd40 2023-10-06T02:18:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.776+0000 7fad19713700 1 --2- 172.21.15.6:0/1486764523 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad00066f30 0x7fad000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.776+0000 7fad19713700 1 --2- 172.21.15.6:0/1486764523 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad00066f30 0x7fad000693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fad14155f50 tx=0x7fad08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.780+0000 7fad11ffb700 1 -- 172.21.15.6:0/1486764523 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad04054230 con 0x7fad140ccd40 2023-10-06T02:18:04.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.974+0000 7fad1c178700 1 -- 172.21.15.6:0/1486764523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fad140ced80 con 0x7fad140ccd40 2023-10-06T02:18:04.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.974+0000 7fad11ffb700 1 -- 172.21.15.6:0/1486764523 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad04057850 con 0x7fad140ccd40 2023-10-06T02:18:04.976 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-06T02:18:04.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.976+0000 7fad1c178700 1 -- 172.21.15.6:0/1486764523 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad00066f30 msgr2=0x7fad000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.976+0000 7fad1c178700 1 --2- 172.21.15.6:0/1486764523 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad00066f30 0x7fad000693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fad14155f50 tx=0x7fad08008040 comp rx=0 tx=0).stop 2023-10-06T02:18:04.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.976+0000 7fad1c178700 1 -- 172.21.15.6:0/1486764523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad140ccd40 msgr2=0x7fad140cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:04.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.976+0000 7fad1c178700 1 --2- 172.21.15.6:0/1486764523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad140ccd40 0x7fad140cb880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fad040097c0 tx=0x7fad04017000 comp rx=0 tx=0).stop 2023-10-06T02:18:04.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.976+0000 7fad1c178700 1 -- 172.21.15.6:0/1486764523 shutdown_connections 2023-10-06T02:18:04.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.976+0000 7fad1c178700 1 --2- 172.21.15.6:0/1486764523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad140d0400 0x7fad140c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.976+0000 7fad1c178700 1 --2- 172.21.15.6:0/1486764523 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad00066f30 0x7fad000693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.976+0000 7fad1c178700 1 --2- 172.21.15.6:0/1486764523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad140ccd40 0x7fad140cb880 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.976+0000 7fad1c178700 1 --2- 172.21.15.6:0/1486764523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad140cf7e0 0x7fad1415af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:04.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.976+0000 7fad1c178700 1 -- 172.21.15.6:0/1486764523 >> 172.21.15.6:0/1486764523 conn(0x7fad1406a220 msgr2=0x7fad14157860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:04.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.976+0000 7fad1c178700 1 -- 172.21.15.6:0/1486764523 shutdown_connections 2023-10-06T02:18:04.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:04.976+0000 7fad1c178700 1 -- 172.21.15.6:0/1486764523 wait complete. 2023-10-06T02:18:04.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T02:18:05.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.110+0000 7fbc82b18700 1 Processor -- start 2023-10-06T02:18:05.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.110+0000 7fbc82b18700 1 -- start start 2023-10-06T02:18:05.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.111+0000 7fbc82b18700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc7c0d0400 0x7fbc7c0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.111+0000 7fbc82b18700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7c0b6170 con 0x7fbc7c0ccd40 2023-10-06T02:18:05.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.111+0000 7fbc82b18700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7c15dd40 con 0x7fbc7c0d07d0 2023-10-06T02:18:05.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.111+0000 7fbc82b18700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c15e020 con 0x7fbc7c0d0400 2023-10-06T02:18:05.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.111+0000 7fbc7bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbc7c0ccd40 0x7fbc7c0cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36232/0 (socket says 172.21.15.6:36232) 2023-10-06T02:18:05.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.111+0000 7fbc7bfff700 1 -- 172.21.15.6:0/1836022123 learned_addr learned my addr 172.21.15.6:0/1836022123 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:05.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.111+0000 7fbc808b4700 1 --2- 172.21.15.6:0/1836022123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc7c0d0400 0x7fbc7c0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.111+0000 7fbc7b7fe700 1 -- 172.21.15.6:0/1836022123 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008177384 0 0) 0x7fbc7c0b6170 con 0x7fbc7c0ccd40 2023-10-06T02:18:05.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.111+0000 7fbc7b7fe700 1 -- 172.21.15.6:0/1836022123 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc68003570 con 0x7fbc7c0ccd40 2023-10-06T02:18:05.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc7b7fe700 1 -- 172.21.15.6:0/1836022123 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3539032213 0 0) 0x7fbc68003570 con 0x7fbc7c0ccd40 2023-10-06T02:18:05.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc7b7fe700 1 -- 172.21.15.6:0/1836022123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc7c0d0400 msgr2=0x7fbc7c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:05.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc7b7fe700 1 --2- 172.21.15.6:0/1836022123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc7c0d0400 0x7fbc7c0b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc7b7fe700 1 -- 172.21.15.6:0/1836022123 >> v1:172.21.15.175:6789/0 conn(0x7fbc7c0d07d0 legacy=0x7fbc7c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:05.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc7b7fe700 1 -- 172.21.15.6:0/1836022123 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c0ceaa0 con 0x7fbc7c0ccd40 2023-10-06T02:18:05.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc7b7fe700 1 -- 172.21.15.6:0/1836022123 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fbc6c001470 con 0x7fbc7c0ccd40 2023-10-06T02:18:05.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc7b7fe700 1 -- 172.21.15.6:0/1836022123 >> v1:172.21.15.6:6789/0 conn(0x7fbc7c0ccd40 legacy=0x7fbc7c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:05.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc7b7fe700 1 --2- 172.21.15.6:0/1836022123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68003a90 0x7fbc68003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc7b7fe700 1 --2- 172.21.15.6:0/1836022123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc7c0d0400 0x7fbc68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc7b7fe700 1 --2- 172.21.15.6:0/1836022123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc68004d50 0x7fbc680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc7b7fe700 1 -- 172.21.15.6:0/1836022123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c15e020 con 0x7fbc68003a90 2023-10-06T02:18:05.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc7b7fe700 1 -- 172.21.15.6:0/1836022123 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6800bb10 con 0x7fbc68004d50 2023-10-06T02:18:05.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc7b7fe700 1 -- 172.21.15.6:0/1836022123 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6800bcd0 con 0x7fbc7c0d0400 2023-10-06T02:18:05.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc808b4700 1 --2- 172.21.15.6:0/1836022123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68003a90 0x7fbc68003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc7bfff700 1 --2- 172.21.15.6:0/1836022123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc7c0d0400 0x7fbc68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc810b5700 1 --2- 172.21.15.6:0/1836022123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc68004d50 0x7fbc680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc808b4700 1 -- 172.21.15.6:0/1836022123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc7c0d0400 msgr2=0x7fbc68004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:05.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc808b4700 1 --2- 172.21.15.6:0/1836022123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc7c0d0400 0x7fbc68004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc808b4700 1 -- 172.21.15.6:0/1836022123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc68004d50 msgr2=0x7fbc680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:05.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc808b4700 1 --2- 172.21.15.6:0/1836022123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc68004d50 0x7fbc680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.112+0000 7fbc808b4700 1 -- 172.21.15.6:0/1836022123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc68003570 con 0x7fbc68003a90 2023-10-06T02:18:05.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.113+0000 7fbc808b4700 1 --2- 172.21.15.6:0/1836022123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68003a90 0x7fbc68003e60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400e2d0 tx=0x7fbc7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2e01a3f024266f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:05.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.113+0000 7fbc7b7fe700 1 -- 172.21.15.6:0/1836022123 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400eb20 con 0x7fbc68003a90 2023-10-06T02:18:05.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.113+0000 7fbc7b7fe700 1 -- 172.21.15.6:0/1836022123 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7400f040 con 0x7fbc68003a90 2023-10-06T02:18:05.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.113+0000 7fbc7b7fe700 1 -- 172.21.15.6:0/1836022123 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400eed0 con 0x7fbc68003a90 2023-10-06T02:18:05.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.113+0000 7fbc82b18700 1 -- 172.21.15.6:0/1836022123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68003a90 msgr2=0x7fbc68003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:05.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.113+0000 7fbc82b18700 1 --2- 172.21.15.6:0/1836022123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68003a90 0x7fbc68003e60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400e2d0 tx=0x7fbc7400b040 comp rx=0 tx=0).stop 2023-10-06T02:18:05.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.113+0000 7fbc810b5700 1 -- 172.21.15.6:0/1836022123 reap_dead start 2023-10-06T02:18:05.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.113+0000 7fbc82b18700 1 -- 172.21.15.6:0/1836022123 shutdown_connections 2023-10-06T02:18:05.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.113+0000 7fbc82b18700 1 -- 172.21.15.6:0/1836022123 >> 172.21.15.6:0/1836022123 conn(0x7fbc7c06a220 msgr2=0x7fbc7c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:05.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.113+0000 7fbc82b18700 1 -- 172.21.15.6:0/1836022123 shutdown_connections 2023-10-06T02:18:05.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.113+0000 7fbc82b18700 1 -- 172.21.15.6:0/1836022123 wait complete. 2023-10-06T02:18:05.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.114+0000 7fbc82b18700 1 Processor -- start 2023-10-06T02:18:05.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.114+0000 7fbc82b18700 1 -- start start 2023-10-06T02:18:05.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.115+0000 7fbc82b18700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc68003a90 0x7fbc7c0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.115+0000 7fbc82b18700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc7c0c59b0 0x7fbc7c0c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.115+0000 7fbc82b18700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc7c16d540 0x7fbc7c155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.115+0000 7fbc82b18700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c15a880 con 0x7fbc7c0c59b0 2023-10-06T02:18:05.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.115+0000 7fbc82b18700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0c8ad0 con 0x7fbc7c16d540 2023-10-06T02:18:05.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.115+0000 7fbc82b18700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c15ab20 con 0x7fbc68003a90 2023-10-06T02:18:05.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.115+0000 7fbc7bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc7c0c59b0 0x7fbc7c0c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.115+0000 7fbc7bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc7c0c59b0 0x7fbc7c0c9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54590/0 (socket says 172.21.15.6:54590) 2023-10-06T02:18:05.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.115+0000 7fbc7bfff700 1 -- 172.21.15.6:0/3162264369 learned_addr learned my addr 172.21.15.6:0/3162264369 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:05.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.115+0000 7fbc808b4700 1 --2- 172.21.15.6:0/3162264369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc68003a90 0x7fbc7c0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.116+0000 7fbc810b5700 1 --2- 172.21.15.6:0/3162264369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc7c16d540 0x7fbc7c155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.116+0000 7fbc7bfff700 1 -- 172.21.15.6:0/3162264369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc68003a90 msgr2=0x7fbc7c0c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.116+0000 7fbc7bfff700 1 --2- 172.21.15.6:0/3162264369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc68003a90 0x7fbc7c0c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.116+0000 7fbc7bfff700 1 -- 172.21.15.6:0/3162264369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc7c16d540 msgr2=0x7fbc7c155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.116+0000 7fbc7bfff700 1 --2- 172.21.15.6:0/3162264369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc7c16d540 0x7fbc7c155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.116+0000 7fbc7bfff700 1 -- 172.21.15.6:0/3162264369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c15ae00 con 0x7fbc7c0c59b0 2023-10-06T02:18:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.116+0000 7fbc7bfff700 1 --2- 172.21.15.6:0/3162264369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc7c0c59b0 0x7fbc7c0c9f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c001c20 tx=0x7fbc7c0cdf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.116+0000 7fbc78ff9700 1 -- 172.21.15.6:0/3162264369 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c018030 con 0x7fbc7c0c59b0 2023-10-06T02:18:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.116+0000 7fbc78ff9700 1 -- 172.21.15.6:0/3162264369 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c00f8d0 con 0x7fbc7c0c59b0 2023-10-06T02:18:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.116+0000 7fbc82b18700 1 -- 172.21.15.6:0/3162264369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7c15b0e0 con 0x7fbc7c0c59b0 2023-10-06T02:18:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.116+0000 7fbc78ff9700 1 -- 172.21.15.6:0/3162264369 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00fc70 con 0x7fbc7c0c59b0 2023-10-06T02:18:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.116+0000 7fbc82b18700 1 -- 172.21.15.6:0/3162264369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7c0ca4b0 con 0x7fbc7c0c59b0 2023-10-06T02:18:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.117+0000 7fbc82b18700 1 -- 172.21.15.6:0/3162264369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7c15b320 con 0x7fbc7c0c59b0 2023-10-06T02:18:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.117+0000 7fbc78ff9700 1 -- 172.21.15.6:0/3162264369 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc6c01b070 con 0x7fbc7c0c59b0 2023-10-06T02:18:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.118+0000 7fbc78ff9700 1 --2- 172.21.15.6:0/3162264369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc5c066f30 0x7fbc5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.118+0000 7fbc78ff9700 1 -- 172.21.15.6:0/3162264369 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbc6c019070 con 0x7fbc7c0c59b0 2023-10-06T02:18:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.118+0000 7fbc808b4700 1 --2- 172.21.15.6:0/3162264369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc5c066f30 0x7fbc5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.118+0000 7fbc808b4700 1 --2- 172.21.15.6:0/3162264369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc5c066f30 0x7fbc5c0693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbc740094a0 tx=0x7fbc7401a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.122+0000 7fbc78ff9700 1 -- 172.21.15.6:0/3162264369 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc7c15b320 con 0x7fbc7c0c59b0 2023-10-06T02:18:05.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.316+0000 7fbc82b18700 1 -- 172.21.15.6:0/3162264369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbc7c15b320 con 0x7fbc7c0c59b0 2023-10-06T02:18:05.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.316+0000 7fbc78ff9700 1 -- 172.21.15.6:0/3162264369 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbc7c15b320 con 0x7fbc7c0c59b0 2023-10-06T02:18:05.317 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:18:05.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.318+0000 7fbc82b18700 1 -- 172.21.15.6:0/3162264369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc5c066f30 msgr2=0x7fbc5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:05.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.318+0000 7fbc82b18700 1 --2- 172.21.15.6:0/3162264369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc5c066f30 0x7fbc5c0693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbc740094a0 tx=0x7fbc7401a000 comp rx=0 tx=0).stop 2023-10-06T02:18:05.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.318+0000 7fbc82b18700 1 -- 172.21.15.6:0/3162264369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc7c0c59b0 msgr2=0x7fbc7c0c9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:05.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.318+0000 7fbc82b18700 1 --2- 172.21.15.6:0/3162264369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc7c0c59b0 0x7fbc7c0c9f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c001c20 tx=0x7fbc7c0cdf50 comp rx=0 tx=0).stop 2023-10-06T02:18:05.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.318+0000 7fbc82b18700 1 -- 172.21.15.6:0/3162264369 shutdown_connections 2023-10-06T02:18:05.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.318+0000 7fbc82b18700 1 --2- 172.21.15.6:0/3162264369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc7c16d540 0x7fbc7c155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.318+0000 7fbc82b18700 1 --2- 172.21.15.6:0/3162264369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc68003a90 0x7fbc7c0c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.318+0000 7fbc82b18700 1 --2- 172.21.15.6:0/3162264369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc5c066f30 0x7fbc5c0693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.318+0000 7fbc82b18700 1 --2- 172.21.15.6:0/3162264369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc7c0c59b0 0x7fbc7c0c9f70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.318+0000 7fbc82b18700 1 -- 172.21.15.6:0/3162264369 >> 172.21.15.6:0/3162264369 conn(0x7fbc7c06a220 msgr2=0x7fbc7c156240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:05.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.318+0000 7fbc82b18700 1 -- 172.21.15.6:0/3162264369 shutdown_connections 2023-10-06T02:18:05.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.318+0000 7fbc82b18700 1 -- 172.21.15.6:0/3162264369 wait complete. 2023-10-06T02:18:05.332 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:18:05.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.448+0000 7f77ee3b1700 1 Processor -- start 2023-10-06T02:18:05.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.448+0000 7f77ee3b1700 1 -- start start 2023-10-06T02:18:05.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.449+0000 7f77ee3b1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f77e8159150 0x7f77e815de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.449+0000 7f77ee3b1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77e80b08f0 0x7f77e8159520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.449+0000 7f77ee3b1700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e80afbc0 con 0x7f77e80cccf0 2023-10-06T02:18:05.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.449+0000 7f77ee3b1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e8159a60 con 0x7f77e8159150 2023-10-06T02:18:05.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.449+0000 7f77ee3b1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e80cd620 con 0x7f77e80b08f0 2023-10-06T02:18:05.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.449+0000 7f77e7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f77e8159150 0x7f77e815de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.449+0000 7f77e7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f77e8159150 0x7f77e815de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54596/0 (socket says 172.21.15.6:54596) 2023-10-06T02:18:05.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.449+0000 7f77e7fff700 1 -- 172.21.15.6:0/4025882610 learned_addr learned my addr 172.21.15.6:0/4025882610 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:05.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.450+0000 7f77e77fe700 1 --2- 172.21.15.6:0/4025882610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77e80b08f0 0x7f77e8159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.450+0000 7f77e7fff700 1 -- 172.21.15.6:0/4025882610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77e80b08f0 msgr2=0x7f77e8159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:05.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.450+0000 7f77e7fff700 1 --2- 172.21.15.6:0/4025882610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77e80b08f0 0x7f77e8159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.450+0000 7f77e7fff700 1 -- 172.21.15.6:0/4025882610 >> v1:172.21.15.175:6789/0 conn(0x7f77e80cccf0 legacy=0x7f77e80b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.450+0000 7f77e7fff700 1 -- 172.21.15.6:0/4025882610 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e80afe10 con 0x7f77e8159150 2023-10-06T02:18:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.450+0000 7f77e7fff700 1 --2- 172.21.15.6:0/4025882610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77e8159150 0x7f77e815de30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f77d00099b0 tx=0x7f77d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb66383c1a6c644 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.450+0000 7f77e6ffd700 1 -- 172.21.15.6:0/4025882610 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d000b860 con 0x7f77e8159150 2023-10-06T02:18:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.450+0000 7f77e6ffd700 1 -- 172.21.15.6:0/4025882610 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d000b9c0 con 0x7f77e8159150 2023-10-06T02:18:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.450+0000 7f77e6ffd700 1 -- 172.21.15.6:0/4025882610 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d000bd60 con 0x7f77e8159150 2023-10-06T02:18:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.451+0000 7f77ee3b1700 1 -- 172.21.15.6:0/4025882610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77e8159150 msgr2=0x7f77e815de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.451+0000 7f77ee3b1700 1 --2- 172.21.15.6:0/4025882610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77e8159150 0x7f77e815de30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f77d00099b0 tx=0x7f77d0009250 comp rx=0 tx=0).stop 2023-10-06T02:18:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.451+0000 7f77ee3b1700 1 -- 172.21.15.6:0/4025882610 shutdown_connections 2023-10-06T02:18:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.451+0000 7f77ee3b1700 1 --2- 172.21.15.6:0/4025882610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77e8159150 0x7f77e815de30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.451+0000 7f77ee3b1700 1 --2- 172.21.15.6:0/4025882610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77e80b08f0 0x7f77e8159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.451+0000 7f77ee3b1700 1 -- 172.21.15.6:0/4025882610 >> 172.21.15.6:0/4025882610 conn(0x7f77e8068680 msgr2=0x7f77e8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.451+0000 7f77ee3b1700 1 -- 172.21.15.6:0/4025882610 shutdown_connections 2023-10-06T02:18:05.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.451+0000 7f77ee3b1700 1 -- 172.21.15.6:0/4025882610 wait complete. 2023-10-06T02:18:05.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.452+0000 7f77ee3b1700 1 Processor -- start 2023-10-06T02:18:05.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.452+0000 7f77ee3b1700 1 -- start start 2023-10-06T02:18:05.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77ee3b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77e80b08f0 0x7f77e816b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77ee3b1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77e80cccf0 0x7f77e81674b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77ee3b1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e8159150 0x7f77e8159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77ee3b1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e815d0a0 con 0x7f77e80b08f0 2023-10-06T02:18:05.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77ee3b1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e80c53e0 con 0x7f77e8159150 2023-10-06T02:18:05.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77ee3b1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e80c4dd0 con 0x7f77e80cccf0 2023-10-06T02:18:05.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77e80b08f0 0x7f77e816b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77e80b08f0 0x7f77e816b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54606/0 (socket says 172.21.15.6:54606) 2023-10-06T02:18:05.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77e7fff700 1 -- 172.21.15.6:0/2822548291 learned_addr learned my addr 172.21.15.6:0/2822548291 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:05.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77e77fe700 1 --2- 172.21.15.6:0/2822548291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77e80cccf0 0x7f77e81674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77ec94e700 1 --2- 172.21.15.6:0/2822548291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e8159150 0x7f77e8159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77e7fff700 1 -- 172.21.15.6:0/2822548291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77e80cccf0 msgr2=0x7f77e81674b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:05.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77e7fff700 1 --2- 172.21.15.6:0/2822548291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77e80cccf0 0x7f77e81674b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77e7fff700 1 -- 172.21.15.6:0/2822548291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e8159150 msgr2=0x7f77e8159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:05.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77e7fff700 1 --2- 172.21.15.6:0/2822548291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e8159150 0x7f77e8159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77e7fff700 1 -- 172.21.15.6:0/2822548291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d00094f0 con 0x7f77e80b08f0 2023-10-06T02:18:05.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77e7fff700 1 --2- 172.21.15.6:0/2822548291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77e80b08f0 0x7f77e816b270 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f77e8067bc0 tx=0x7f77d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:05.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77dffff700 1 -- 172.21.15.6:0/2822548291 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0024440 con 0x7f77e80b08f0 2023-10-06T02:18:05.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77dffff700 1 -- 172.21.15.6:0/2822548291 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d00245c0 con 0x7f77e80b08f0 2023-10-06T02:18:05.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77ee3b1700 1 -- 172.21.15.6:0/2822548291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e815cdc0 con 0x7f77e80b08f0 2023-10-06T02:18:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.453+0000 7f77dffff700 1 -- 172.21.15.6:0/2822548291 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0024980 con 0x7f77e80b08f0 2023-10-06T02:18:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.454+0000 7f77ee3b1700 1 -- 172.21.15.6:0/2822548291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e81679f0 con 0x7f77e80b08f0 2023-10-06T02:18:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.454+0000 7f77ee3b1700 1 -- 172.21.15.6:0/2822548291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e80c4c30 con 0x7f77e80b08f0 2023-10-06T02:18:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.455+0000 7f77dffff700 1 -- 172.21.15.6:0/2822548291 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77d001a420 con 0x7f77e80b08f0 2023-10-06T02:18:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.455+0000 7f77dffff700 1 --2- 172.21.15.6:0/2822548291 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f77c8066f30 0x7f77c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.455+0000 7f77dffff700 1 -- 172.21.15.6:0/2822548291 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f77d00868b0 con 0x7f77e80b08f0 2023-10-06T02:18:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.455+0000 7f77e77fe700 1 --2- 172.21.15.6:0/2822548291 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f77c8066f30 0x7f77c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.456+0000 7f77e77fe700 1 --2- 172.21.15.6:0/2822548291 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f77c8066f30 0x7f77c80693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f77e806b360 tx=0x7f77d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.460+0000 7f77dffff700 1 -- 172.21.15.6:0/2822548291 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77e80c4c30 con 0x7f77e80b08f0 2023-10-06T02:18:05.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.697+0000 7f77ee3b1700 1 -- 172.21.15.6:0/2822548291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77e80c4c30 con 0x7f77e80b08f0 2023-10-06T02:18:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.698+0000 7f77dffff700 1 -- 172.21.15.6:0/2822548291 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4590 (secure 0 0 0) 0x7f77e80c4c30 con 0x7f77e80b08f0 2023-10-06T02:18:05.699 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:05.699 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3433510267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3433510267},{"type":"v1","addr":"172.21.15.175:6836","nonce":3433510267}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3290404467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3290404467},{"type":"v1","addr":"172.21.15.175:6837","nonce":3290404467}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/4132952009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4132952009},{"type":"v1","addr":"172.21.15.6:6834","nonce":4132952009}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:17:43.404580+0000","modified":"2023-10-06T02:17:56.734938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/839986504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":839986504},{"type":"v1","addr":"172.21.15.6:6835","nonce":839986504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:18:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.700+0000 7f77ee3b1700 1 -- 172.21.15.6:0/2822548291 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f77c8066f30 msgr2=0x7f77c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.700+0000 7f77ee3b1700 1 --2- 172.21.15.6:0/2822548291 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f77c8066f30 0x7f77c80693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f77e806b360 tx=0x7f77d8008040 comp rx=0 tx=0).stop 2023-10-06T02:18:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.700+0000 7f77ee3b1700 1 -- 172.21.15.6:0/2822548291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77e80b08f0 msgr2=0x7f77e816b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.700+0000 7f77ee3b1700 1 --2- 172.21.15.6:0/2822548291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77e80b08f0 0x7f77e816b270 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f77e8067bc0 tx=0x7f77d0017000 comp rx=0 tx=0).stop 2023-10-06T02:18:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.700+0000 7f77ee3b1700 1 -- 172.21.15.6:0/2822548291 shutdown_connections 2023-10-06T02:18:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.700+0000 7f77ee3b1700 1 --2- 172.21.15.6:0/2822548291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e8159150 0x7f77e8159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.700+0000 7f77ee3b1700 1 --2- 172.21.15.6:0/2822548291 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f77c8066f30 0x7f77c80693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.700+0000 7f77ee3b1700 1 --2- 172.21.15.6:0/2822548291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77e80b08f0 0x7f77e816b270 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.700+0000 7f77ee3b1700 1 --2- 172.21.15.6:0/2822548291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77e80cccf0 0x7f77e81674b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.700+0000 7f77ee3b1700 1 -- 172.21.15.6:0/2822548291 >> 172.21.15.6:0/2822548291 conn(0x7f77e8068680 msgr2=0x7f77e80cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.700+0000 7f77ee3b1700 1 -- 172.21.15.6:0/2822548291 shutdown_connections 2023-10-06T02:18:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.700+0000 7f77ee3b1700 1 -- 172.21.15.6:0/2822548291 wait complete. 2023-10-06T02:18:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-10-06T02:18:05.713 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:18:05.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.831+0000 7fd4b6fec700 1 Processor -- start 2023-10-06T02:18:05.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.831+0000 7fd4b6fec700 1 -- start start 2023-10-06T02:18:05.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.832+0000 7fd4b6fec700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd4b0159420 0x7fd4b00aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.832+0000 7fd4b6fec700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4b01597f0 0x7fd4b00ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.832+0000 7fd4b6fec700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b00cc430 con 0x7fd4b00aca00 2023-10-06T02:18:05.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.832+0000 7fd4b6fec700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b00b0920 con 0x7fd4b01597f0 2023-10-06T02:18:05.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.832+0000 7fd4b6fec700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b00af180 con 0x7fd4b0159420 2023-10-06T02:18:05.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.832+0000 7fd4affff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4b01597f0 0x7fd4b00ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.832+0000 7fd4b5589700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd4b00aca00 0x7fd4b00ace30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36236/0 (socket says 172.21.15.6:36236) 2023-10-06T02:18:05.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.832+0000 7fd4b5589700 1 -- 172.21.15.6:0/1279934807 learned_addr learned my addr 172.21.15.6:0/1279934807 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:05.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.832+0000 7fd4affff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4b01597f0 0x7fd4b00ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54618/0 (socket says 172.21.15.6:54618) 2023-10-06T02:18:05.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.832+0000 7fd4b4d88700 1 --2- 172.21.15.6:0/1279934807 >> v2:172.21.15.175:3300/0 conn(0x7fd4b0159420 0x7fd4b00aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.833+0000 7fd4affff700 1 -- 172.21.15.6:0/1279934807 >> v2:172.21.15.175:3300/0 conn(0x7fd4b0159420 msgr2=0x7fd4b00aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:05.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.833+0000 7fd4affff700 1 --2- 172.21.15.6:0/1279934807 >> v2:172.21.15.175:3300/0 conn(0x7fd4b0159420 0x7fd4b00aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.833+0000 7fd4affff700 1 -- 172.21.15.6:0/1279934807 >> v1:172.21.15.6:6789/0 conn(0x7fd4b00aca00 legacy=0x7fd4b00ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:05.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.833+0000 7fd4affff700 1 -- 172.21.15.6:0/1279934807 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b00b1400 con 0x7fd4b01597f0 2023-10-06T02:18:05.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.833+0000 7fd4af7fe700 1 -- 172.21.15.6:0/1279934807 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954688694 0 0) 0x7fd4b00cc430 con 0x7fd4b00aca00 2023-10-06T02:18:05.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.833+0000 7fd4affff700 1 --2- 172.21.15.6:0/1279934807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b01597f0 0x7fd4b00ac050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd4b006a700 tx=0x7fd4a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509b138227d082db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:05.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.833+0000 7fd4af7fe700 1 -- 172.21.15.6:0/1279934807 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4011630 con 0x7fd4b01597f0 2023-10-06T02:18:05.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.833+0000 7fd4af7fe700 1 -- 172.21.15.6:0/1279934807 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a4011790 con 0x7fd4b01597f0 2023-10-06T02:18:05.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.833+0000 7fd4af7fe700 1 -- 172.21.15.6:0/1279934807 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4011b30 con 0x7fd4b01597f0 2023-10-06T02:18:05.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.834+0000 7fd4b6fec700 1 -- 172.21.15.6:0/1279934807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b01597f0 msgr2=0x7fd4b00ac050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:05.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.834+0000 7fd4b6fec700 1 --2- 172.21.15.6:0/1279934807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b01597f0 0x7fd4b00ac050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd4b006a700 tx=0x7fd4a40091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.834+0000 7fd4b6fec700 1 -- 172.21.15.6:0/1279934807 shutdown_connections 2023-10-06T02:18:05.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.834+0000 7fd4b6fec700 1 --2- 172.21.15.6:0/1279934807 >> v2:172.21.15.175:3300/0 conn(0x7fd4b0159420 0x7fd4b00aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.834+0000 7fd4b6fec700 1 --2- 172.21.15.6:0/1279934807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b01597f0 0x7fd4b00ac050 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.834+0000 7fd4b6fec700 1 -- 172.21.15.6:0/1279934807 >> 172.21.15.6:0/1279934807 conn(0x7fd4b00cc790 msgr2=0x7fd4b00ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:05.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.834+0000 7fd4b6fec700 1 -- 172.21.15.6:0/1279934807 shutdown_connections 2023-10-06T02:18:05.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.834+0000 7fd4b6fec700 1 -- 172.21.15.6:0/1279934807 wait complete. 2023-10-06T02:18:05.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.835+0000 7fd4b6fec700 1 Processor -- start 2023-10-06T02:18:05.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.835+0000 7fd4b6fec700 1 -- start start 2023-10-06T02:18:05.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4b6fec700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b00aca00 0x7fd4b015c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4b6fec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b0159420 0x7fd4b016d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4b6fec700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4b01597f0 0x7fd4b0150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4b6fec700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b01539a0 con 0x7fd4b0159420 2023-10-06T02:18:05.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4b6fec700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b0153c40 con 0x7fd4b00aca00 2023-10-06T02:18:05.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4b6fec700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b0153f20 con 0x7fd4b01597f0 2023-10-06T02:18:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4affff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b0159420 0x7fd4b016d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4affff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b0159420 0x7fd4b016d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54632/0 (socket says 172.21.15.6:54632) 2023-10-06T02:18:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4affff700 1 -- 172.21.15.6:0/1277250871 learned_addr learned my addr 172.21.15.6:0/1277250871 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4b4d88700 1 --2- 172.21.15.6:0/1277250871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b00aca00 0x7fd4b015c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4affff700 1 -- 172.21.15.6:0/1277250871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4b01597f0 msgr2=0x7fd4b0150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4b5589700 1 --2- 172.21.15.6:0/1277250871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4b01597f0 0x7fd4b0150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4affff700 1 --2- 172.21.15.6:0/1277250871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4b01597f0 0x7fd4b0150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4affff700 1 -- 172.21.15.6:0/1277250871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b00aca00 msgr2=0x7fd4b015c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4affff700 1 --2- 172.21.15.6:0/1277250871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b00aca00 0x7fd4b015c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4affff700 1 -- 172.21.15.6:0/1277250871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a4009420 con 0x7fd4b0159420 2023-10-06T02:18:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4b4d88700 1 --2- 172.21.15.6:0/1277250871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b00aca00 0x7fd4b015c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4affff700 1 --2- 172.21.15.6:0/1277250871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b0159420 0x7fd4b016d0b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd4a40091e0 tx=0x7fd4a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4acff9700 1 -- 172.21.15.6:0/1277250871 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4011900 con 0x7fd4b0159420 2023-10-06T02:18:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4acff9700 1 -- 172.21.15.6:0/1277250871 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a4011a80 con 0x7fd4b0159420 2023-10-06T02:18:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4b6fec700 1 -- 172.21.15.6:0/1277250871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b0154200 con 0x7fd4b0159420 2023-10-06T02:18:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4acff9700 1 -- 172.21.15.6:0/1277250871 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4025670 con 0x7fd4b0159420 2023-10-06T02:18:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.836+0000 7fd4b6fec700 1 -- 172.21.15.6:0/1277250871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b015c920 con 0x7fd4b0159420 2023-10-06T02:18:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.837+0000 7fd4b6fec700 1 -- 172.21.15.6:0/1277250871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b0169b20 con 0x7fd4b0159420 2023-10-06T02:18:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.838+0000 7fd4acff9700 1 -- 172.21.15.6:0/1277250871 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4a4023070 con 0x7fd4b0159420 2023-10-06T02:18:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.838+0000 7fd4acff9700 1 --2- 172.21.15.6:0/1277250871 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd49c066f30 0x7fd49c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.838+0000 7fd4acff9700 1 -- 172.21.15.6:0/1277250871 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd4a4085ed0 con 0x7fd4b0159420 2023-10-06T02:18:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.838+0000 7fd4b4d88700 1 --2- 172.21.15.6:0/1277250871 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd49c066f30 0x7fd49c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.839+0000 7fd4b4d88700 1 --2- 172.21.15.6:0/1277250871 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd49c066f30 0x7fd49c0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80076c0 tx=0x7fd4a800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:05.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:05.842+0000 7fd4acff9700 1 -- 172.21.15.6:0/1277250871 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4a4052cf0 con 0x7fd4b0159420 2023-10-06T02:18:06.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.037+0000 7fd4b6fec700 1 -- 172.21.15.6:0/1277250871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4b004bb80 con 0x7fd4b0159420 2023-10-06T02:18:06.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.038+0000 7fd4acff9700 1 -- 172.21.15.6:0/1277250871 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fd4a4015090 con 0x7fd4b0159420 2023-10-06T02:18:06.040 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:06.040 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:48.453046+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:18:06.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.040+0000 7fd4b6fec700 1 -- 172.21.15.6:0/1277250871 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd49c066f30 msgr2=0x7fd49c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.040+0000 7fd4b6fec700 1 --2- 172.21.15.6:0/1277250871 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd49c066f30 0x7fd49c0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80076c0 tx=0x7fd4a800b040 comp rx=0 tx=0).stop 2023-10-06T02:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.040+0000 7fd4b6fec700 1 -- 172.21.15.6:0/1277250871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b0159420 msgr2=0x7fd4b016d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.040+0000 7fd4b6fec700 1 --2- 172.21.15.6:0/1277250871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b0159420 0x7fd4b016d0b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd4a40091e0 tx=0x7fd4a4017000 comp rx=0 tx=0).stop 2023-10-06T02:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.040+0000 7fd4b6fec700 1 -- 172.21.15.6:0/1277250871 shutdown_connections 2023-10-06T02:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.040+0000 7fd4b6fec700 1 --2- 172.21.15.6:0/1277250871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4b01597f0 0x7fd4b0150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.040+0000 7fd4b6fec700 1 --2- 172.21.15.6:0/1277250871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b00aca00 0x7fd4b015c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.040+0000 7fd4b6fec700 1 --2- 172.21.15.6:0/1277250871 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd49c066f30 0x7fd49c0693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.040+0000 7fd4b6fec700 1 --2- 172.21.15.6:0/1277250871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b0159420 0x7fd4b016d0b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.040+0000 7fd4b6fec700 1 -- 172.21.15.6:0/1277250871 >> 172.21.15.6:0/1277250871 conn(0x7fd4b00cc790 msgr2=0x7fd4b014d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.040+0000 7fd4b6fec700 1 -- 172.21.15.6:0/1277250871 shutdown_connections 2023-10-06T02:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.040+0000 7fd4b6fec700 1 -- 172.21.15.6:0/1277250871 wait complete. 2023-10-06T02:18:06.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:17:41.126402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:17:42.378468+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T02:17:46.053654+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:18:06.054 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:18:06.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.175+0000 7f529ac09700 1 Processor -- start 2023-10-06T02:18:06.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.175+0000 7f529ac09700 1 -- start start 2023-10-06T02:18:06.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.176+0000 7f529ac09700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f529406c460 0x7f529415da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.176+0000 7f529ac09700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52940c7cb0 con 0x7f529406c830 2023-10-06T02:18:06.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.176+0000 7f529ac09700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52940c7f90 con 0x7f52940c7840 2023-10-06T02:18:06.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.176+0000 7f529ac09700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529415dfc0 con 0x7f529406c460 2023-10-06T02:18:06.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.176+0000 7f52991a6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f529406c830 0x7f52940ca350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36240/0 (socket says 172.21.15.6:36240) 2023-10-06T02:18:06.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.176+0000 7f52991a6700 1 -- 172.21.15.6:0/4209971339 learned_addr learned my addr 172.21.15.6:0/4209971339 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:06.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.176+0000 7f52989a5700 1 --2- 172.21.15.6:0/4209971339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f529406c460 0x7f529415da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.176+0000 7f52937fe700 1 -- 172.21.15.6:0/4209971339 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284857745 0 0) 0x7f52940c7cb0 con 0x7f529406c830 2023-10-06T02:18:06.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.176+0000 7f52937fe700 1 -- 172.21.15.6:0/4209971339 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5284003570 con 0x7f529406c830 2023-10-06T02:18:06.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.176+0000 7f52937fe700 1 -- 172.21.15.6:0/4209971339 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147730407 0 0) 0x7f52940c7f90 con 0x7f52940c7840 2023-10-06T02:18:06.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.176+0000 7f52937fe700 1 -- 172.21.15.6:0/4209971339 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52940c7cb0 con 0x7f52940c7840 2023-10-06T02:18:06.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.176+0000 7f52937fe700 1 -- 172.21.15.6:0/4209971339 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3455409453 0 0) 0x7f5284003570 con 0x7f529406c830 2023-10-06T02:18:06.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.176+0000 7f52989a5700 1 -- 172.21.15.6:0/4209971339 >> v1:172.21.15.175:6789/0 conn(0x7f52940c7840 legacy=0x7f5294158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.176+0000 7f52989a5700 1 -- 172.21.15.6:0/4209971339 >> v1:172.21.15.6:6789/0 conn(0x7f529406c830 legacy=0x7f52940ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.176+0000 7f52989a5700 1 -- 172.21.15.6:0/4209971339 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52940c8270 con 0x7f529406c460 2023-10-06T02:18:06.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.177+0000 7f52989a5700 1 --2- 172.21.15.6:0/4209971339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f529406c460 0x7f529415da80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5288009910 tx=0x7f52880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a678bf42e8c94a51 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:06.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.177+0000 7f52937fe700 1 -- 172.21.15.6:0/4209971339 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0017f0 con 0x7f529406c460 2023-10-06T02:18:06.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.177+0000 7f52937fe700 1 -- 172.21.15.6:0/4209971339 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5288011420 con 0x7f529406c460 2023-10-06T02:18:06.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.177+0000 7f52937fe700 1 -- 172.21.15.6:0/4209971339 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52880117c0 con 0x7f529406c460 2023-10-06T02:18:06.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.177+0000 7f529ac09700 1 -- 172.21.15.6:0/4209971339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f529406c460 msgr2=0x7f529415da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.177+0000 7f529ac09700 1 --2- 172.21.15.6:0/4209971339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f529406c460 0x7f529415da80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5288009910 tx=0x7f52880091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.177+0000 7f529ac09700 1 -- 172.21.15.6:0/4209971339 shutdown_connections 2023-10-06T02:18:06.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.177+0000 7f529ac09700 1 --2- 172.21.15.6:0/4209971339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f529406c460 0x7f529415da80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.177+0000 7f529ac09700 1 -- 172.21.15.6:0/4209971339 >> 172.21.15.6:0/4209971339 conn(0x7f52940c9cc0 msgr2=0x7f529406acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:06.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.177+0000 7f529ac09700 1 -- 172.21.15.6:0/4209971339 shutdown_connections 2023-10-06T02:18:06.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.177+0000 7f529ac09700 1 -- 172.21.15.6:0/4209971339 wait complete. 2023-10-06T02:18:06.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.178+0000 7f529ac09700 1 Processor -- start 2023-10-06T02:18:06.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.179+0000 7f529ac09700 1 -- start start 2023-10-06T02:18:06.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.179+0000 7f529ac09700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f529406c460 0x7f52940ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.179+0000 7f529ac09700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f529406c830 0x7f5294155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.179+0000 7f529ac09700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52940c7840 0x7f529415aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.179+0000 7f529ac09700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52940c5130 con 0x7f529406c830 2023-10-06T02:18:06.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.179+0000 7f529ac09700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52940aea50 con 0x7f529406c460 2023-10-06T02:18:06.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.179+0000 7f529ac09700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52940c4240 con 0x7f52940c7840 2023-10-06T02:18:06.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.179+0000 7f5293fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f529406c830 0x7f5294155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.180+0000 7f5293fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f529406c830 0x7f5294155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54644/0 (socket says 172.21.15.6:54644) 2023-10-06T02:18:06.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.180+0000 7f5293fff700 1 -- 172.21.15.6:0/287913753 learned_addr learned my addr 172.21.15.6:0/287913753 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:06.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.180+0000 7f52989a5700 1 --2- 172.21.15.6:0/287913753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f529406c460 0x7f52940ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.180+0000 7f52991a6700 1 --2- 172.21.15.6:0/287913753 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52940c7840 0x7f529415aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.180+0000 7f5293fff700 1 -- 172.21.15.6:0/287913753 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52940c7840 msgr2=0x7f529415aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.180+0000 7f5293fff700 1 --2- 172.21.15.6:0/287913753 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52940c7840 0x7f529415aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.180+0000 7f5293fff700 1 -- 172.21.15.6:0/287913753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f529406c460 msgr2=0x7f52940ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.180+0000 7f5293fff700 1 --2- 172.21.15.6:0/287913753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f529406c460 0x7f52940ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.180+0000 7f5293fff700 1 -- 172.21.15.6:0/287913753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5288009420 con 0x7f529406c830 2023-10-06T02:18:06.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.180+0000 7f5293fff700 1 --2- 172.21.15.6:0/287913753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f529406c830 0x7f5294155460 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f528000c580 tx=0x7f5280007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:06.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.180+0000 7f5290ff9700 1 -- 172.21.15.6:0/287913753 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5280010510 con 0x7f529406c830 2023-10-06T02:18:06.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.180+0000 7f5290ff9700 1 -- 172.21.15.6:0/287913753 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5280010670 con 0x7f529406c830 2023-10-06T02:18:06.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.180+0000 7f529ac09700 1 -- 172.21.15.6:0/287913753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52940c4520 con 0x7f529406c830 2023-10-06T02:18:06.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.180+0000 7f5290ff9700 1 -- 172.21.15.6:0/287913753 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5280010a30 con 0x7f529406c830 2023-10-06T02:18:06.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.180+0000 7f529ac09700 1 -- 172.21.15.6:0/287913753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52940c4ae0 con 0x7f529406c830 2023-10-06T02:18:06.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.181+0000 7f529ac09700 1 -- 172.21.15.6:0/287913753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529406e140 con 0x7f529406c830 2023-10-06T02:18:06.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.182+0000 7f5290ff9700 1 -- 172.21.15.6:0/287913753 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f528001b400 con 0x7f529406c830 2023-10-06T02:18:06.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.182+0000 7f5290ff9700 1 --2- 172.21.15.6:0/287913753 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5278066f30 0x7f52780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.182+0000 7f5290ff9700 1 -- 172.21.15.6:0/287913753 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5280084470 con 0x7f529406c830 2023-10-06T02:18:06.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.182+0000 7f52989a5700 1 --2- 172.21.15.6:0/287913753 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5278066f30 0x7f52780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.183+0000 7f52989a5700 1 --2- 172.21.15.6:0/287913753 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5278066f30 0x7f52780693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f52880030c0 tx=0x7f5288016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:06.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.186+0000 7f5290ff9700 1 -- 172.21.15.6:0/287913753 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5280051290 con 0x7f529406c830 2023-10-06T02:18:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.378+0000 7f529ac09700 1 -- 172.21.15.6:0/287913753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f52940c8550 con 0x7f529406c830 2023-10-06T02:18:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.378+0000 7f5290ff9700 1 -- 172.21.15.6:0/287913753 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f52800548b0 con 0x7f529406c830 2023-10-06T02:18:06.380 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:18:06.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.380+0000 7f529ac09700 1 -- 172.21.15.6:0/287913753 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5278066f30 msgr2=0x7f52780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.380+0000 7f529ac09700 1 --2- 172.21.15.6:0/287913753 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5278066f30 0x7f52780693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f52880030c0 tx=0x7f5288016000 comp rx=0 tx=0).stop 2023-10-06T02:18:06.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.380+0000 7f529ac09700 1 -- 172.21.15.6:0/287913753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f529406c830 msgr2=0x7f5294155460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.380+0000 7f529ac09700 1 --2- 172.21.15.6:0/287913753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f529406c830 0x7f5294155460 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f528000c580 tx=0x7f5280007e10 comp rx=0 tx=0).stop 2023-10-06T02:18:06.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.380+0000 7f529ac09700 1 -- 172.21.15.6:0/287913753 shutdown_connections 2023-10-06T02:18:06.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.380+0000 7f529ac09700 1 --2- 172.21.15.6:0/287913753 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52940c7840 0x7f529415aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.380+0000 7f529ac09700 1 --2- 172.21.15.6:0/287913753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f529406c460 0x7f52940ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.380+0000 7f529ac09700 1 --2- 172.21.15.6:0/287913753 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5278066f30 0x7f52780693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.380+0000 7f529ac09700 1 --2- 172.21.15.6:0/287913753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f529406c830 0x7f5294155460 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.380+0000 7f529ac09700 1 -- 172.21.15.6:0/287913753 >> 172.21.15.6:0/287913753 conn(0x7f52940c9cc0 msgr2=0x7f52940c1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:06.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.380+0000 7f529ac09700 1 -- 172.21.15.6:0/287913753 shutdown_connections 2023-10-06T02:18:06.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.380+0000 7f529ac09700 1 -- 172.21.15.6:0/287913753 wait complete. 2023-10-06T02:18:06.394 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:18:06.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.514+0000 7f6338329700 1 Processor -- start 2023-10-06T02:18:06.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.514+0000 7f6338329700 1 -- start start 2023-10-06T02:18:06.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.515+0000 7f6338329700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63301570b0 0x7f63300ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.515+0000 7f6338329700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f633006c210 0x7f633006c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.515+0000 7f6338329700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63300acf20 con 0x7f6330157480 2023-10-06T02:18:06.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.515+0000 7f6338329700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63300c6dc0 con 0x7f633006c210 2023-10-06T02:18:06.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.515+0000 7f6338329700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63300c7380 con 0x7f63301570b0 2023-10-06T02:18:06.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.515+0000 7f63368c6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f633006c210 0x7f633006c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.515+0000 7f63358c4700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6330157480 0x7f633015ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36256/0 (socket says 172.21.15.6:36256) 2023-10-06T02:18:06.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.515+0000 7f63368c6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f633006c210 0x7f633006c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54654/0 (socket says 172.21.15.6:54654) 2023-10-06T02:18:06.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.515+0000 7f63358c4700 1 -- 172.21.15.6:0/2786016020 learned_addr learned my addr 172.21.15.6:0/2786016020 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:06.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.516+0000 7f63360c5700 1 --2- 172.21.15.6:0/2786016020 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63301570b0 0x7f63300ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.516+0000 7f63368c6700 1 -- 172.21.15.6:0/2786016020 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63301570b0 msgr2=0x7f63300ac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:06.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.516+0000 7f63368c6700 1 --2- 172.21.15.6:0/2786016020 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63301570b0 0x7f63300ac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.516+0000 7f63368c6700 1 -- 172.21.15.6:0/2786016020 >> v1:172.21.15.6:6789/0 conn(0x7f6330157480 legacy=0x7f633015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.516+0000 7f63368c6700 1 -- 172.21.15.6:0/2786016020 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633006cba0 con 0x7f633006c210 2023-10-06T02:18:06.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.516+0000 7f63350c3700 1 -- 172.21.15.6:0/2786016020 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879863417 0 0) 0x7f63300acf20 con 0x7f6330157480 2023-10-06T02:18:06.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.516+0000 7f63360c5700 1 --2- 172.21.15.6:0/2786016020 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63301570b0 0x7f63300ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.516+0000 7f63368c6700 1 --2- 172.21.15.6:0/2786016020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f633006c210 0x7f633006c660 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6328009e60 tx=0x7f6328009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb500a75fa812b9e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.516+0000 7f63350c3700 1 -- 172.21.15.6:0/2786016020 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632800e070 con 0x7f633006c210 2023-10-06T02:18:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.516+0000 7f63350c3700 1 -- 172.21.15.6:0/2786016020 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632800bc30 con 0x7f633006c210 2023-10-06T02:18:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.516+0000 7f63350c3700 1 -- 172.21.15.6:0/2786016020 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6328012430 con 0x7f633006c210 2023-10-06T02:18:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.516+0000 7f6338329700 1 -- 172.21.15.6:0/2786016020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f633006c210 msgr2=0x7f633006c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.516+0000 7f6338329700 1 --2- 172.21.15.6:0/2786016020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f633006c210 0x7f633006c660 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6328009e60 tx=0x7f6328009780 comp rx=0 tx=0).stop 2023-10-06T02:18:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.517+0000 7f6338329700 1 -- 172.21.15.6:0/2786016020 shutdown_connections 2023-10-06T02:18:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.517+0000 7f6338329700 1 --2- 172.21.15.6:0/2786016020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f633006c210 0x7f633006c660 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.517+0000 7f6338329700 1 --2- 172.21.15.6:0/2786016020 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63301570b0 0x7f63300ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.517+0000 7f6338329700 1 -- 172.21.15.6:0/2786016020 >> 172.21.15.6:0/2786016020 conn(0x7f63300c9cc0 msgr2=0x7f633006acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.517+0000 7f6338329700 1 -- 172.21.15.6:0/2786016020 shutdown_connections 2023-10-06T02:18:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.517+0000 7f6338329700 1 -- 172.21.15.6:0/2786016020 wait complete. 2023-10-06T02:18:06.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.518+0000 7f6338329700 1 Processor -- start 2023-10-06T02:18:06.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.518+0000 7f6338329700 1 -- start start 2023-10-06T02:18:06.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.518+0000 7f6338329700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f633006c210 0x7f633014a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.518+0000 7f6338329700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63301570b0 0x7f63300ab050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.518+0000 7f6338329700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6330157480 0x7f6330155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.518+0000 7f6338329700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63300cbac0 con 0x7f63301570b0 2023-10-06T02:18:06.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.518+0000 7f6338329700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63300caeb0 con 0x7f6330157480 2023-10-06T02:18:06.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.518+0000 7f6338329700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63300cb190 con 0x7f633006c210 2023-10-06T02:18:06.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.519+0000 7f63358c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63301570b0 0x7f63300ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.519+0000 7f63358c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63301570b0 0x7f63300ab050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54666/0 (socket says 172.21.15.6:54666) 2023-10-06T02:18:06.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.519+0000 7f63358c4700 1 -- 172.21.15.6:0/2782950523 learned_addr learned my addr 172.21.15.6:0/2782950523 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:06.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.519+0000 7f63360c5700 1 --2- 172.21.15.6:0/2782950523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f633006c210 0x7f633014a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.519+0000 7f63368c6700 1 --2- 172.21.15.6:0/2782950523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6330157480 0x7f6330155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.519+0000 7f63358c4700 1 -- 172.21.15.6:0/2782950523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f633006c210 msgr2=0x7f633014a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.519+0000 7f63358c4700 1 --2- 172.21.15.6:0/2782950523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f633006c210 0x7f633014a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.519+0000 7f63358c4700 1 -- 172.21.15.6:0/2782950523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6330157480 msgr2=0x7f6330155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.519+0000 7f63358c4700 1 --2- 172.21.15.6:0/2782950523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6330157480 0x7f6330155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.519+0000 7f63358c4700 1 -- 172.21.15.6:0/2782950523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6328009a20 con 0x7f63301570b0 2023-10-06T02:18:06.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.519+0000 7f63368c6700 1 --2- 172.21.15.6:0/2782950523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6330157480 0x7f6330155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:06.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.519+0000 7f63358c4700 1 --2- 172.21.15.6:0/2782950523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63301570b0 0x7f63300ab050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f632000c5e0 tx=0x7f6320000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:06.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.519+0000 7f63267fc700 1 -- 172.21.15.6:0/2782950523 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320005b30 con 0x7f63301570b0 2023-10-06T02:18:06.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.519+0000 7f63267fc700 1 -- 172.21.15.6:0/2782950523 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6320005c90 con 0x7f63301570b0 2023-10-06T02:18:06.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.519+0000 7f6338329700 1 -- 172.21.15.6:0/2782950523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63300cb470 con 0x7f63301570b0 2023-10-06T02:18:06.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.519+0000 7f63267fc700 1 -- 172.21.15.6:0/2782950523 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63200072e0 con 0x7f63301570b0 2023-10-06T02:18:06.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.519+0000 7f6338329700 1 -- 172.21.15.6:0/2782950523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633014a690 con 0x7f63301570b0 2023-10-06T02:18:06.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.520+0000 7f6338329700 1 -- 172.21.15.6:0/2782950523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63300cbc70 con 0x7f63301570b0 2023-10-06T02:18:06.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.521+0000 7f63267fc700 1 -- 172.21.15.6:0/2782950523 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f632001b3b0 con 0x7f63301570b0 2023-10-06T02:18:06.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.521+0000 7f63267fc700 1 --2- 172.21.15.6:0/2782950523 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6314066f30 0x7f63140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.521+0000 7f63267fc700 1 -- 172.21.15.6:0/2782950523 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6320083cb0 con 0x7f63301570b0 2023-10-06T02:18:06.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.521+0000 7f63360c5700 1 --2- 172.21.15.6:0/2782950523 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6314066f30 0x7f63140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.522+0000 7f63360c5700 1 --2- 172.21.15.6:0/2782950523 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6314066f30 0x7f63140693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f632c006f00 tx=0x7f632c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:06.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.526+0000 7f63267fc700 1 -- 172.21.15.6:0/2782950523 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f632004b5a0 con 0x7f63301570b0 2023-10-06T02:18:06.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.723+0000 7f6338329700 1 -- 172.21.15.6:0/2782950523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6330068420 con 0x7f63301570b0 2023-10-06T02:18:06.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.723+0000 7f63267fc700 1 -- 172.21.15.6:0/2782950523 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f63200170a0 con 0x7f63301570b0 2023-10-06T02:18:06.725 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:18:06.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.725+0000 7f6338329700 1 -- 172.21.15.6:0/2782950523 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6314066f30 msgr2=0x7f63140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.725+0000 7f6338329700 1 --2- 172.21.15.6:0/2782950523 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6314066f30 0x7f63140693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f632c006f00 tx=0x7f632c008040 comp rx=0 tx=0).stop 2023-10-06T02:18:06.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.725+0000 7f6338329700 1 -- 172.21.15.6:0/2782950523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63301570b0 msgr2=0x7f63300ab050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.725+0000 7f6338329700 1 --2- 172.21.15.6:0/2782950523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63301570b0 0x7f63300ab050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f632000c5e0 tx=0x7f6320000fe0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.725+0000 7f6338329700 1 -- 172.21.15.6:0/2782950523 shutdown_connections 2023-10-06T02:18:06.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.725+0000 7f6338329700 1 --2- 172.21.15.6:0/2782950523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6330157480 0x7f6330155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.725+0000 7f6338329700 1 --2- 172.21.15.6:0/2782950523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f633006c210 0x7f633014a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.725+0000 7f6338329700 1 --2- 172.21.15.6:0/2782950523 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6314066f30 0x7f63140693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.725+0000 7f6338329700 1 --2- 172.21.15.6:0/2782950523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63301570b0 0x7f63300ab050 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.726+0000 7f6338329700 1 -- 172.21.15.6:0/2782950523 >> 172.21.15.6:0/2782950523 conn(0x7f63300c9cc0 msgr2=0x7f6330153e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:06.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.726+0000 7f6338329700 1 -- 172.21.15.6:0/2782950523 shutdown_connections 2023-10-06T02:18:06.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.726+0000 7f6338329700 1 -- 172.21.15.6:0/2782950523 wait complete. 2023-10-06T02:18:06.739 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:18:06.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.860+0000 7f97d0586700 1 Processor -- start 2023-10-06T02:18:06.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.860+0000 7f97d0586700 1 -- start start 2023-10-06T02:18:06.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97d0586700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97c8086ff0 0x7f97c8087440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97d0586700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c8087980 con 0x7f97c815a030 2023-10-06T02:18:06.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97d0586700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c80afc50 con 0x7f97c80b21b0 2023-10-06T02:18:06.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97d0586700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c80b0cf0 con 0x7f97c8086ff0 2023-10-06T02:18:06.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97ce322700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f97c815a030 0x7f97c815a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36258/0 (socket says 172.21.15.6:36258) 2023-10-06T02:18:06.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97ce322700 1 -- 172.21.15.6:0/4082302953 learned_addr learned my addr 172.21.15.6:0/4082302953 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:06.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97cdb21700 1 --2- 172.21.15.6:0/4082302953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97c8086ff0 0x7f97c8087440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97cd320700 1 -- 172.21.15.6:0/4082302953 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049167200 0 0) 0x7f97c8087980 con 0x7f97c815a030 2023-10-06T02:18:06.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97cd320700 1 -- 172.21.15.6:0/4082302953 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97b0003570 con 0x7f97c815a030 2023-10-06T02:18:06.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97cd320700 1 -- 172.21.15.6:0/4082302953 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1169792909 0 0) 0x7f97b0003570 con 0x7f97c815a030 2023-10-06T02:18:06.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97cd320700 1 -- 172.21.15.6:0/4082302953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97c8086ff0 msgr2=0x7f97c8087440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97cd320700 1 --2- 172.21.15.6:0/4082302953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97c8086ff0 0x7f97c8087440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97cd320700 1 -- 172.21.15.6:0/4082302953 >> v1:172.21.15.175:6789/0 conn(0x7f97c80b21b0 legacy=0x7f97c80b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97cd320700 1 -- 172.21.15.6:0/4082302953 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c80aff30 con 0x7f97c815a030 2023-10-06T02:18:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97cd320700 1 -- 172.21.15.6:0/4082302953 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f97b8001470 con 0x7f97c815a030 2023-10-06T02:18:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97cd320700 1 -- 172.21.15.6:0/4082302953 >> v1:172.21.15.6:6789/0 conn(0x7f97c815a030 legacy=0x7f97c815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97cd320700 1 --2- 172.21.15.6:0/4082302953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b0003a90 0x7f97b0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97cd320700 1 --2- 172.21.15.6:0/4082302953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97c8086ff0 0x7f97b0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97cd320700 1 --2- 172.21.15.6:0/4082302953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97b0004d50 0x7f97b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97cd320700 1 -- 172.21.15.6:0/4082302953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c80b0cf0 con 0x7f97b0003a90 2023-10-06T02:18:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97cd320700 1 -- 172.21.15.6:0/4082302953 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b000bb10 con 0x7f97b0004d50 2023-10-06T02:18:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.861+0000 7f97cd320700 1 -- 172.21.15.6:0/4082302953 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b000bcd0 con 0x7f97c8086ff0 2023-10-06T02:18:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.862+0000 7f97ce322700 1 --2- 172.21.15.6:0/4082302953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b0003a90 0x7f97b0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.862+0000 7f97cdb21700 1 --2- 172.21.15.6:0/4082302953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97c8086ff0 0x7f97b0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.862+0000 7f97ceb23700 1 --2- 172.21.15.6:0/4082302953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97b0004d50 0x7f97b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.862+0000 7f97ce322700 1 -- 172.21.15.6:0/4082302953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97c8086ff0 msgr2=0x7f97b0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:06.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.862+0000 7f97ce322700 1 --2- 172.21.15.6:0/4082302953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97c8086ff0 0x7f97b0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.862+0000 7f97ce322700 1 -- 172.21.15.6:0/4082302953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97b0004d50 msgr2=0x7f97b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:06.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.862+0000 7f97ce322700 1 --2- 172.21.15.6:0/4082302953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97b0004d50 0x7f97b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.862+0000 7f97ce322700 1 -- 172.21.15.6:0/4082302953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b0003570 con 0x7f97b0003a90 2023-10-06T02:18:06.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.862+0000 7f97ce322700 1 --2- 172.21.15.6:0/4082302953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b0003a90 0x7f97b0003e60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f97b800c3c0 tx=0x7f97b8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413098cdb63e9d5e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:06.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.862+0000 7f97cd320700 1 -- 172.21.15.6:0/4082302953 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b800cc90 con 0x7f97b0003a90 2023-10-06T02:18:06.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.862+0000 7f97cd320700 1 -- 172.21.15.6:0/4082302953 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b800ce10 con 0x7f97b0003a90 2023-10-06T02:18:06.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.862+0000 7f97cd320700 1 -- 172.21.15.6:0/4082302953 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8005b70 con 0x7f97b0003a90 2023-10-06T02:18:06.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.863+0000 7f97d0586700 1 -- 172.21.15.6:0/4082302953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b0003a90 msgr2=0x7f97b0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.863+0000 7f97d0586700 1 --2- 172.21.15.6:0/4082302953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b0003a90 0x7f97b0003e60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f97b800c3c0 tx=0x7f97b8001e70 comp rx=0 tx=0).stop 2023-10-06T02:18:06.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.863+0000 7f97ceb23700 1 -- 172.21.15.6:0/4082302953 reap_dead start 2023-10-06T02:18:06.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.863+0000 7f97d0586700 1 -- 172.21.15.6:0/4082302953 shutdown_connections 2023-10-06T02:18:06.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.863+0000 7f97d0586700 1 -- 172.21.15.6:0/4082302953 >> 172.21.15.6:0/4082302953 conn(0x7f97c8068680 msgr2=0x7f97c8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:06.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.863+0000 7f97d0586700 1 -- 172.21.15.6:0/4082302953 shutdown_connections 2023-10-06T02:18:06.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.863+0000 7f97d0586700 1 -- 172.21.15.6:0/4082302953 wait complete. 2023-10-06T02:18:06.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.864+0000 7f97d0586700 1 Processor -- start 2023-10-06T02:18:06.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.864+0000 7f97d0586700 1 -- start start 2023-10-06T02:18:06.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97d0586700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b0003a90 0x7f97c80c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97d0586700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97c80c9ec0 0x7f97c815b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97d0586700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97c8155e20 0x7f97c80aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97d0586700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c815b760 con 0x7f97b0003a90 2023-10-06T02:18:06.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97d0586700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c815ad90 con 0x7f97c80c9ec0 2023-10-06T02:18:06.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97d0586700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c80ca330 con 0x7f97c8155e20 2023-10-06T02:18:06.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97ce322700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b0003a90 0x7f97c80c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97ce322700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b0003a90 0x7f97c80c5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54672/0 (socket says 172.21.15.6:54672) 2023-10-06T02:18:06.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97ce322700 1 -- 172.21.15.6:0/3045736424 learned_addr learned my addr 172.21.15.6:0/3045736424 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:06.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97cdb21700 1 --2- 172.21.15.6:0/3045736424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97c80c9ec0 0x7f97c815b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97ceb23700 1 --2- 172.21.15.6:0/3045736424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97c8155e20 0x7f97c80aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97ce322700 1 -- 172.21.15.6:0/3045736424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97c8155e20 msgr2=0x7f97c80aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97ce322700 1 --2- 172.21.15.6:0/3045736424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97c8155e20 0x7f97c80aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97ce322700 1 -- 172.21.15.6:0/3045736424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97c80c9ec0 msgr2=0x7f97c815b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:06.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97ce322700 1 --2- 172.21.15.6:0/3045736424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97c80c9ec0 0x7f97c815b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:06.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97ce322700 1 -- 172.21.15.6:0/3045736424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c815a4a0 con 0x7f97b0003a90 2023-10-06T02:18:06.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97ce322700 1 --2- 172.21.15.6:0/3045736424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b0003a90 0x7f97c80c5dd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f97b0004770 tx=0x7f97b8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.865+0000 7f97c67fc700 1 -- 172.21.15.6:0/3045736424 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b800cc90 con 0x7f97b0003a90 2023-10-06T02:18:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.866+0000 7f97c67fc700 1 -- 172.21.15.6:0/3045736424 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b80070d0 con 0x7f97b0003a90 2023-10-06T02:18:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.866+0000 7f97d0586700 1 -- 172.21.15.6:0/3045736424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c815a740 con 0x7f97b0003a90 2023-10-06T02:18:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.866+0000 7f97c67fc700 1 -- 172.21.15.6:0/3045736424 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8007470 con 0x7f97b0003a90 2023-10-06T02:18:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.866+0000 7f97d0586700 1 -- 172.21.15.6:0/3045736424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c80ca5c0 con 0x7f97b0003a90 2023-10-06T02:18:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.866+0000 7f97d0586700 1 -- 172.21.15.6:0/3045736424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c815b070 con 0x7f97b0003a90 2023-10-06T02:18:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.867+0000 7f97c67fc700 1 -- 172.21.15.6:0/3045736424 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97b8019030 con 0x7f97b0003a90 2023-10-06T02:18:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.867+0000 7f97c67fc700 1 --2- 172.21.15.6:0/3045736424 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f97b4066f60 0x7f97b4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.867+0000 7f97c67fc700 1 -- 172.21.15.6:0/3045736424 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f97b8085720 con 0x7f97b0003a90 2023-10-06T02:18:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.867+0000 7f97cdb21700 1 --2- 172.21.15.6:0/3045736424 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f97b4066f60 0x7f97b4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.868+0000 7f97cdb21700 1 --2- 172.21.15.6:0/3045736424 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f97b4066f60 0x7f97b4069410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f97c816cfc0 tx=0x7f97bc0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:06.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:06.872+0000 7f97c67fc700 1 -- 172.21.15.6:0/3045736424 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97b8052540 con 0x7f97b0003a90 2023-10-06T02:18:07.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.066+0000 7f97d0586700 1 -- 172.21.15.6:0/3045736424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97c80b0210 con 0x7f97b0003a90 2023-10-06T02:18:07.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.066+0000 7f97c67fc700 1 -- 172.21.15.6:0/3045736424 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f97b8055b60 con 0x7f97b0003a90 2023-10-06T02:18:07.068 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:18:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.069+0000 7f97d0586700 1 -- 172.21.15.6:0/3045736424 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f97b4066f60 msgr2=0x7f97b4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.069+0000 7f97d0586700 1 --2- 172.21.15.6:0/3045736424 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f97b4066f60 0x7f97b4069410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f97c816cfc0 tx=0x7f97bc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.069+0000 7f97d0586700 1 -- 172.21.15.6:0/3045736424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b0003a90 msgr2=0x7f97c80c5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.069+0000 7f97d0586700 1 --2- 172.21.15.6:0/3045736424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b0003a90 0x7f97c80c5dd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f97b0004770 tx=0x7f97b8015000 comp rx=0 tx=0).stop 2023-10-06T02:18:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.069+0000 7f97d0586700 1 -- 172.21.15.6:0/3045736424 shutdown_connections 2023-10-06T02:18:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.069+0000 7f97d0586700 1 --2- 172.21.15.6:0/3045736424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97c8155e20 0x7f97c80aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.069+0000 7f97d0586700 1 --2- 172.21.15.6:0/3045736424 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f97b4066f60 0x7f97b4069410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.069+0000 7f97d0586700 1 --2- 172.21.15.6:0/3045736424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b0003a90 0x7f97c80c5dd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.069+0000 7f97d0586700 1 --2- 172.21.15.6:0/3045736424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97c80c9ec0 0x7f97c815b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.069+0000 7f97d0586700 1 -- 172.21.15.6:0/3045736424 >> 172.21.15.6:0/3045736424 conn(0x7f97c8068680 msgr2=0x7f97c8158850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.069+0000 7f97d0586700 1 -- 172.21.15.6:0/3045736424 shutdown_connections 2023-10-06T02:18:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.069+0000 7f97d0586700 1 -- 172.21.15.6:0/3045736424 wait complete. 2023-10-06T02:18:07.082 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:18:07.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.203+0000 7f1d39cee700 1 Processor -- start 2023-10-06T02:18:07.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.203+0000 7f1d39cee700 1 -- start start 2023-10-06T02:18:07.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.203+0000 7f1d39cee700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d340d0400 0x7f1d340b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d39cee700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d340ccd40 0x7f1d340cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d39cee700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d340b6170 con 0x7f1d340cf7e0 2023-10-06T02:18:07.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d39cee700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3415dd40 con 0x7f1d340d0400 2023-10-06T02:18:07.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d39cee700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3415e020 con 0x7f1d340ccd40 2023-10-06T02:18:07.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d33fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1d340cf7e0 0x7f1d340b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36270/0 (socket says 172.21.15.6:36270) 2023-10-06T02:18:07.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d33fff700 1 -- 172.21.15.6:0/959666919 learned_addr learned my addr 172.21.15.6:0/959666919 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:07.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d337fe700 1 --2- 172.21.15.6:0/959666919 >> v2:172.21.15.175:3300/0 conn(0x7f1d340d0400 0x7f1d340b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d32ffd700 1 --2- 172.21.15.6:0/959666919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d340ccd40 0x7f1d340cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d327fc700 1 -- 172.21.15.6:0/959666919 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193626361 0 0) 0x7f1d340b6170 con 0x7f1d340cf7e0 2023-10-06T02:18:07.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d327fc700 1 -- 172.21.15.6:0/959666919 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d1c003570 con 0x7f1d340cf7e0 2023-10-06T02:18:07.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d327fc700 1 -- 172.21.15.6:0/959666919 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1578214702 0 0) 0x7f1d1c003570 con 0x7f1d340cf7e0 2023-10-06T02:18:07.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d327fc700 1 -- 172.21.15.6:0/959666919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d340ccd40 msgr2=0x7f1d340cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:07.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d327fc700 1 --2- 172.21.15.6:0/959666919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d340ccd40 0x7f1d340cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d327fc700 1 -- 172.21.15.6:0/959666919 >> v2:172.21.15.175:3300/0 conn(0x7f1d340d0400 msgr2=0x7f1d340b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:07.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d327fc700 1 --2- 172.21.15.6:0/959666919 >> v2:172.21.15.175:3300/0 conn(0x7f1d340d0400 0x7f1d340b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d327fc700 1 -- 172.21.15.6:0/959666919 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d340ceaa0 con 0x7f1d340cf7e0 2023-10-06T02:18:07.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d327fc700 1 -- 172.21.15.6:0/959666919 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f1d2c0017f0 con 0x7f1d340cf7e0 2023-10-06T02:18:07.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d327fc700 1 -- 172.21.15.6:0/959666919 >> v1:172.21.15.6:6789/0 conn(0x7f1d340cf7e0 legacy=0x7f1d340b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d327fc700 1 --2- 172.21.15.6:0/959666919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d1c003a60 0x7f1d1c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d327fc700 1 --2- 172.21.15.6:0/959666919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d340ccd40 0x7f1d1c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d327fc700 1 --2- 172.21.15.6:0/959666919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d1c004d50 0x7f1d1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d327fc700 1 -- 172.21.15.6:0/959666919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3415dd40 con 0x7f1d1c004d50 2023-10-06T02:18:07.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d327fc700 1 -- 172.21.15.6:0/959666919 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3415e020 con 0x7f1d1c003a60 2023-10-06T02:18:07.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d327fc700 1 -- 172.21.15.6:0/959666919 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c00ba90 con 0x7f1d340ccd40 2023-10-06T02:18:07.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.204+0000 7f1d33fff700 1 --2- 172.21.15.6:0/959666919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d1c004d50 0x7f1d1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.205+0000 7f1d32ffd700 1 --2- 172.21.15.6:0/959666919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d340ccd40 0x7f1d1c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.205+0000 7f1d337fe700 1 --2- 172.21.15.6:0/959666919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d1c003a60 0x7f1d1c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.205+0000 7f1d33fff700 1 -- 172.21.15.6:0/959666919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d340ccd40 msgr2=0x7f1d1c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:07.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.205+0000 7f1d33fff700 1 --2- 172.21.15.6:0/959666919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d340ccd40 0x7f1d1c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.205+0000 7f1d33fff700 1 -- 172.21.15.6:0/959666919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d1c003a60 msgr2=0x7f1d1c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:07.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.205+0000 7f1d33fff700 1 --2- 172.21.15.6:0/959666919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d1c003a60 0x7f1d1c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.205+0000 7f1d33fff700 1 -- 172.21.15.6:0/959666919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c003570 con 0x7f1d1c004d50 2023-10-06T02:18:07.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.205+0000 7f1d33fff700 1 --2- 172.21.15.6:0/959666919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d1c004d50 0x7f1d1c0051c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00a970 tx=0x7f1d2c002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd755713cf7d374f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:07.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.205+0000 7f1d327fc700 1 -- 172.21.15.6:0/959666919 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c012440 con 0x7f1d1c004d50 2023-10-06T02:18:07.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.205+0000 7f1d327fc700 1 -- 172.21.15.6:0/959666919 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c0125c0 con 0x7f1d1c004d50 2023-10-06T02:18:07.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.205+0000 7f1d327fc700 1 -- 172.21.15.6:0/959666919 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c012980 con 0x7f1d1c004d50 2023-10-06T02:18:07.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.206+0000 7f1d39cee700 1 -- 172.21.15.6:0/959666919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d1c004d50 msgr2=0x7f1d1c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.206+0000 7f1d39cee700 1 --2- 172.21.15.6:0/959666919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d1c004d50 0x7f1d1c0051c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00a970 tx=0x7f1d2c002210 comp rx=0 tx=0).stop 2023-10-06T02:18:07.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.206+0000 7f1d33fff700 1 -- 172.21.15.6:0/959666919 reap_dead start 2023-10-06T02:18:07.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.206+0000 7f1d39cee700 1 -- 172.21.15.6:0/959666919 shutdown_connections 2023-10-06T02:18:07.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.206+0000 7f1d39cee700 1 -- 172.21.15.6:0/959666919 >> 172.21.15.6:0/959666919 conn(0x7f1d3406a220 msgr2=0x7f1d3406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:07.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.206+0000 7f1d39cee700 1 -- 172.21.15.6:0/959666919 shutdown_connections 2023-10-06T02:18:07.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.206+0000 7f1d39cee700 1 -- 172.21.15.6:0/959666919 wait complete. 2023-10-06T02:18:07.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.207+0000 7f1d39cee700 1 Processor -- start 2023-10-06T02:18:07.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.207+0000 7f1d39cee700 1 -- start start 2023-10-06T02:18:07.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d39cee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d340b4fe0 0x7f1d3415a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d39cee700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d340c5100 0x7f1d34152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d39cee700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d340b53b0 0x7f1d34153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d39cee700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d34153880 con 0x7f1d340b4fe0 2023-10-06T02:18:07.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d39cee700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3415ad60 con 0x7f1d340b53b0 2023-10-06T02:18:07.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d39cee700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d340c6710 con 0x7f1d340c5100 2023-10-06T02:18:07.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d340b4fe0 0x7f1d3415a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d340b4fe0 0x7f1d3415a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54696/0 (socket says 172.21.15.6:54696) 2023-10-06T02:18:07.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d337fe700 1 -- 172.21.15.6:0/1520505753 learned_addr learned my addr 172.21.15.6:0/1520505753 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:07.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d33fff700 1 --2- 172.21.15.6:0/1520505753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d340b53b0 0x7f1d34153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d32ffd700 1 --2- 172.21.15.6:0/1520505753 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d340c5100 0x7f1d34152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d337fe700 1 -- 172.21.15.6:0/1520505753 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d340c5100 msgr2=0x7f1d34152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d337fe700 1 --2- 172.21.15.6:0/1520505753 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d340c5100 0x7f1d34152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d337fe700 1 -- 172.21.15.6:0/1520505753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d340b53b0 msgr2=0x7f1d34153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d337fe700 1 --2- 172.21.15.6:0/1520505753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d340b53b0 0x7f1d34153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d337fe700 1 -- 172.21.15.6:0/1520505753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d340c5670 con 0x7f1d340b4fe0 2023-10-06T02:18:07.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d337fe700 1 --2- 172.21.15.6:0/1520505753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d340b4fe0 0x7f1d3415a820 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1d24011730 tx=0x7f1d24008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:07.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d1b7fe700 1 -- 172.21.15.6:0/1520505753 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24015670 con 0x7f1d340b4fe0 2023-10-06T02:18:07.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d1b7fe700 1 -- 172.21.15.6:0/1520505753 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d240157d0 con 0x7f1d340b4fe0 2023-10-06T02:18:07.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d1b7fe700 1 -- 172.21.15.6:0/1520505753 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24015b50 con 0x7f1d340b4fe0 2023-10-06T02:18:07.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d39cee700 1 -- 172.21.15.6:0/1520505753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d340c5950 con 0x7f1d340b4fe0 2023-10-06T02:18:07.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.208+0000 7f1d39cee700 1 -- 172.21.15.6:0/1520505753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d340c5f10 con 0x7f1d340b4fe0 2023-10-06T02:18:07.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.209+0000 7f1d39cee700 1 -- 172.21.15.6:0/1520505753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d34088760 con 0x7f1d340b4fe0 2023-10-06T02:18:07.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.210+0000 7f1d1b7fe700 1 -- 172.21.15.6:0/1520505753 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d24013410 con 0x7f1d340b4fe0 2023-10-06T02:18:07.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.210+0000 7f1d1b7fe700 1 --2- 172.21.15.6:0/1520505753 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d20066f30 0x7f1d200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.210+0000 7f1d1b7fe700 1 -- 172.21.15.6:0/1520505753 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1d24085000 con 0x7f1d340b4fe0 2023-10-06T02:18:07.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.210+0000 7f1d32ffd700 1 --2- 172.21.15.6:0/1520505753 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d20066f30 0x7f1d200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.211+0000 7f1d32ffd700 1 --2- 172.21.15.6:0/1520505753 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d20066f30 0x7f1d200693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1d28006f00 tx=0x7f1d280091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:07.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.214+0000 7f1d1b7fe700 1 -- 172.21.15.6:0/1520505753 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d24051e20 con 0x7f1d340b4fe0 2023-10-06T02:18:07.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.407+0000 7f1d39cee700 1 -- 172.21.15.6:0/1520505753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d340ced80 con 0x7f1d340b4fe0 2023-10-06T02:18:07.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.407+0000 7f1d1b7fe700 1 -- 172.21.15.6:0/1520505753 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1d24019020 con 0x7f1d340b4fe0 2023-10-06T02:18:07.408 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-06T02:18:07.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.409+0000 7f1d39cee700 1 -- 172.21.15.6:0/1520505753 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d20066f30 msgr2=0x7f1d200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.409+0000 7f1d39cee700 1 --2- 172.21.15.6:0/1520505753 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d20066f30 0x7f1d200693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1d28006f00 tx=0x7f1d280091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.409+0000 7f1d39cee700 1 -- 172.21.15.6:0/1520505753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d340b4fe0 msgr2=0x7f1d3415a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.409+0000 7f1d39cee700 1 --2- 172.21.15.6:0/1520505753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d340b4fe0 0x7f1d3415a820 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1d24011730 tx=0x7f1d24008040 comp rx=0 tx=0).stop 2023-10-06T02:18:07.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.409+0000 7f1d39cee700 1 -- 172.21.15.6:0/1520505753 shutdown_connections 2023-10-06T02:18:07.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.409+0000 7f1d39cee700 1 --2- 172.21.15.6:0/1520505753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d340b53b0 0x7f1d34153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.409+0000 7f1d39cee700 1 --2- 172.21.15.6:0/1520505753 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d20066f30 0x7f1d200693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.409+0000 7f1d39cee700 1 --2- 172.21.15.6:0/1520505753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d340b4fe0 0x7f1d3415a820 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.409+0000 7f1d39cee700 1 --2- 172.21.15.6:0/1520505753 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d340c5100 0x7f1d34152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.409+0000 7f1d39cee700 1 -- 172.21.15.6:0/1520505753 >> 172.21.15.6:0/1520505753 conn(0x7f1d3406a220 msgr2=0x7f1d340b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:07.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.409+0000 7f1d39cee700 1 -- 172.21.15.6:0/1520505753 shutdown_connections 2023-10-06T02:18:07.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.409+0000 7f1d39cee700 1 -- 172.21.15.6:0/1520505753 wait complete. 2023-10-06T02:18:07.422 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T02:18:07.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.543+0000 7fdc6359e700 1 Processor -- start 2023-10-06T02:18:07.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.543+0000 7fdc6359e700 1 -- start start 2023-10-06T02:18:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.544+0000 7fdc6359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc640cd400 0x7fdc640b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.544+0000 7fdc6359e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdc640cd7d0 0x7fdc640b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.544+0000 7fdc6359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc640b29a0 con 0x7fdc640b0810 2023-10-06T02:18:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.544+0000 7fdc6359e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc640af770 con 0x7fdc640cd7d0 2023-10-06T02:18:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.544+0000 7fdc6359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640afa50 con 0x7fdc640cd400 2023-10-06T02:18:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.544+0000 7fdc62d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdc640b0810 0x7fdc640d01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36280/0 (socket says 172.21.15.6:36280) 2023-10-06T02:18:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.544+0000 7fdc62d9d700 1 -- 172.21.15.6:0/3239262162 learned_addr learned my addr 172.21.15.6:0/3239262162 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.544+0000 7fdc61d9b700 1 --2- 172.21.15.6:0/3239262162 >> v2:172.21.15.175:3300/0 conn(0x7fdc640cd7d0 0x7fdc640b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.544+0000 7fdc6259c700 1 --2- 172.21.15.6:0/3239262162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc640cd400 0x7fdc640b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.544+0000 7fdc6159a700 1 -- 172.21.15.6:0/3239262162 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588491013 0 0) 0x7fdc54001490 con 0x7fdc640b0810 2023-10-06T02:18:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.545+0000 7fdc6159a700 1 -- 172.21.15.6:0/3239262162 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc50003570 con 0x7fdc640b0810 2023-10-06T02:18:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.545+0000 7fdc61d9b700 1 -- 172.21.15.6:0/3239262162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc640cd400 msgr2=0x7fdc640b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.545+0000 7fdc61d9b700 1 --2- 172.21.15.6:0/3239262162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc640cd400 0x7fdc640b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.545+0000 7fdc61d9b700 1 -- 172.21.15.6:0/3239262162 >> v1:172.21.15.6:6789/0 conn(0x7fdc640b0810 legacy=0x7fdc640d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.545+0000 7fdc61d9b700 1 -- 172.21.15.6:0/3239262162 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc640afd30 con 0x7fdc640cd7d0 2023-10-06T02:18:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.545+0000 7fdc6259c700 1 --2- 172.21.15.6:0/3239262162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc640cd400 0x7fdc640b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.545+0000 7fdc61d9b700 1 --2- 172.21.15.6:0/3239262162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc640cd7d0 0x7fdc640b2460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0098e0 tx=0x7fdc4c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfb5187615e08797 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.545+0000 7fdc6159a700 1 -- 172.21.15.6:0/3239262162 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c011630 con 0x7fdc640cd7d0 2023-10-06T02:18:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.545+0000 7fdc6159a700 1 -- 172.21.15.6:0/3239262162 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c011790 con 0x7fdc640cd7d0 2023-10-06T02:18:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.545+0000 7fdc6159a700 1 -- 172.21.15.6:0/3239262162 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c011b10 con 0x7fdc640cd7d0 2023-10-06T02:18:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.546+0000 7fdc6359e700 1 -- 172.21.15.6:0/3239262162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc640cd7d0 msgr2=0x7fdc640b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.546+0000 7fdc6359e700 1 --2- 172.21.15.6:0/3239262162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc640cd7d0 0x7fdc640b2460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0098e0 tx=0x7fdc4c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.546+0000 7fdc6359e700 1 -- 172.21.15.6:0/3239262162 shutdown_connections 2023-10-06T02:18:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.546+0000 7fdc6359e700 1 --2- 172.21.15.6:0/3239262162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc640cd400 0x7fdc640b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.546+0000 7fdc6359e700 1 --2- 172.21.15.6:0/3239262162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc640cd7d0 0x7fdc640b2460 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.546+0000 7fdc6359e700 1 -- 172.21.15.6:0/3239262162 >> 172.21.15.6:0/3239262162 conn(0x7fdc6406a110 msgr2=0x7fdc6406a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.546+0000 7fdc6359e700 1 -- 172.21.15.6:0/3239262162 shutdown_connections 2023-10-06T02:18:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.546+0000 7fdc6359e700 1 -- 172.21.15.6:0/3239262162 wait complete. 2023-10-06T02:18:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.547+0000 7fdc6359e700 1 Processor -- start 2023-10-06T02:18:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.547+0000 7fdc6359e700 1 -- start start 2023-10-06T02:18:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc6359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc640b0810 0x7fdc640c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc6359e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc640cd400 0x7fdc640ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc6359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc640b42b0 0x7fdc64154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc6359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640c4c10 con 0x7fdc640b0810 2023-10-06T02:18:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc6359e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc64169d50 con 0x7fdc640cd400 2023-10-06T02:18:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc6359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6416a030 con 0x7fdc640b42b0 2023-10-06T02:18:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc6259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc640b0810 0x7fdc640c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc6259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc640b0810 0x7fdc640c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54698/0 (socket says 172.21.15.6:54698) 2023-10-06T02:18:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc6259c700 1 -- 172.21.15.6:0/2749920189 learned_addr learned my addr 172.21.15.6:0/2749920189 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc61d9b700 1 --2- 172.21.15.6:0/2749920189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc640cd400 0x7fdc640ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc62d9d700 1 --2- 172.21.15.6:0/2749920189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc640b42b0 0x7fdc64154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc6259c700 1 -- 172.21.15.6:0/2749920189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc640b42b0 msgr2=0x7fdc64154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc6259c700 1 --2- 172.21.15.6:0/2749920189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc640b42b0 0x7fdc64154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc6259c700 1 -- 172.21.15.6:0/2749920189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc640cd400 msgr2=0x7fdc640ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc6259c700 1 --2- 172.21.15.6:0/2749920189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc640cd400 0x7fdc640ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc6259c700 1 -- 172.21.15.6:0/2749920189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c0093c0 con 0x7fdc640b0810 2023-10-06T02:18:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc6259c700 1 --2- 172.21.15.6:0/2749920189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc640b0810 0x7fdc640c4580 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00ec80 tx=0x7fdc5c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc5a7fc700 1 -- 172.21.15.6:0/2749920189 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c005a00 con 0x7fdc640b0810 2023-10-06T02:18:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc5a7fc700 1 -- 172.21.15.6:0/2749920189 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c005b60 con 0x7fdc640b0810 2023-10-06T02:18:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc5a7fc700 1 -- 172.21.15.6:0/2749920189 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c00c850 con 0x7fdc640b0810 2023-10-06T02:18:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.548+0000 7fdc6359e700 1 -- 172.21.15.6:0/2749920189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4c009420 con 0x7fdc640b0810 2023-10-06T02:18:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.549+0000 7fdc6359e700 1 -- 172.21.15.6:0/2749920189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc641699d0 con 0x7fdc640b0810 2023-10-06T02:18:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.549+0000 7fdc6359e700 1 -- 172.21.15.6:0/2749920189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6416a680 con 0x7fdc640b0810 2023-10-06T02:18:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.550+0000 7fdc5a7fc700 1 -- 172.21.15.6:0/2749920189 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc5c00cbc0 con 0x7fdc640b0810 2023-10-06T02:18:07.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.550+0000 7fdc5a7fc700 1 --2- 172.21.15.6:0/2749920189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc44066f30 0x7fdc440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.550+0000 7fdc5a7fc700 1 -- 172.21.15.6:0/2749920189 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdc5c084dd0 con 0x7fdc640b0810 2023-10-06T02:18:07.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.551+0000 7fdc61d9b700 1 --2- 172.21.15.6:0/2749920189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc44066f30 0x7fdc440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.551+0000 7fdc61d9b700 1 --2- 172.21.15.6:0/2749920189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc44066f30 0x7fdc440693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdc640c6db0 tx=0x7fdc4c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:07.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.555+0000 7fdc5a7fc700 1 -- 172.21.15.6:0/2749920189 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc5c055680 con 0x7fdc640b0810 2023-10-06T02:18:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.750+0000 7fdc6359e700 1 -- 172.21.15.6:0/2749920189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdc64064aa0 con 0x7fdc640b0810 2023-10-06T02:18:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.750+0000 7fdc5a7fc700 1 -- 172.21.15.6:0/2749920189 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdc5c055210 con 0x7fdc640b0810 2023-10-06T02:18:07.752 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:18:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.752+0000 7fdc6359e700 1 -- 172.21.15.6:0/2749920189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc44066f30 msgr2=0x7fdc440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.752+0000 7fdc6359e700 1 --2- 172.21.15.6:0/2749920189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc44066f30 0x7fdc440693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdc640c6db0 tx=0x7fdc4c017000 comp rx=0 tx=0).stop 2023-10-06T02:18:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.752+0000 7fdc6359e700 1 -- 172.21.15.6:0/2749920189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc640b0810 msgr2=0x7fdc640c4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.752+0000 7fdc6359e700 1 --2- 172.21.15.6:0/2749920189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc640b0810 0x7fdc640c4580 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00ec80 tx=0x7fdc5c009120 comp rx=0 tx=0).stop 2023-10-06T02:18:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.752+0000 7fdc6359e700 1 -- 172.21.15.6:0/2749920189 shutdown_connections 2023-10-06T02:18:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.752+0000 7fdc6359e700 1 --2- 172.21.15.6:0/2749920189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc640b42b0 0x7fdc64154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.752+0000 7fdc6359e700 1 --2- 172.21.15.6:0/2749920189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc44066f30 0x7fdc440693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.752+0000 7fdc6359e700 1 --2- 172.21.15.6:0/2749920189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc640b0810 0x7fdc640c4580 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.752+0000 7fdc6359e700 1 --2- 172.21.15.6:0/2749920189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc640cd400 0x7fdc640ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.752+0000 7fdc6359e700 1 -- 172.21.15.6:0/2749920189 >> 172.21.15.6:0/2749920189 conn(0x7fdc6406a110 msgr2=0x7fdc64155800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:07.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.752+0000 7fdc6359e700 1 -- 172.21.15.6:0/2749920189 shutdown_connections 2023-10-06T02:18:07.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.752+0000 7fdc6359e700 1 -- 172.21.15.6:0/2749920189 wait complete. 2023-10-06T02:18:07.766 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:18:07.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.885+0000 7f1ff0e73700 1 Processor -- start 2023-10-06T02:18:07.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.885+0000 7f1ff0e73700 1 -- start start 2023-10-06T02:18:07.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1ff0e73700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0b27f0 0x7f1fec15db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1ff0e73700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec15e190 con 0x7f1fec0af4e0 2023-10-06T02:18:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1ff0e73700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec0cb650 con 0x7f1fec0af8b0 2023-10-06T02:18:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1ff0e73700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0b1910 con 0x7f1fec0b27f0 2023-10-06T02:18:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fea59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1fec0af4e0 0x7f1fec0b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36294/0 (socket says 172.21.15.6:36294) 2023-10-06T02:18:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fea59c700 1 -- 172.21.15.6:0/2776098578 learned_addr learned my addr 172.21.15.6:0/2776098578 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fe959a700 1 -- 172.21.15.6:0/2776098578 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994931643 0 0) 0x7f1fec15e190 con 0x7f1fec0af4e0 2023-10-06T02:18:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fead9d700 1 --2- 172.21.15.6:0/2776098578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0b27f0 0x7f1fec15db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fe959a700 1 -- 172.21.15.6:0/2776098578 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fd8003570 con 0x7f1fec0af4e0 2023-10-06T02:18:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fe959a700 1 -- 172.21.15.6:0/2776098578 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2972216033 0 0) 0x7f1fd8003570 con 0x7f1fec0af4e0 2023-10-06T02:18:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fe959a700 1 -- 172.21.15.6:0/2776098578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0b27f0 msgr2=0x7f1fec15db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fe959a700 1 --2- 172.21.15.6:0/2776098578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0b27f0 0x7f1fec15db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fe959a700 1 -- 172.21.15.6:0/2776098578 >> v1:172.21.15.175:6789/0 conn(0x7f1fec0af8b0 legacy=0x7f1fec15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fe959a700 1 -- 172.21.15.6:0/2776098578 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec0ccaf0 con 0x7f1fec0af4e0 2023-10-06T02:18:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fe959a700 1 -- 172.21.15.6:0/2776098578 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f1fe4001470 con 0x7f1fec0af4e0 2023-10-06T02:18:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fe959a700 1 -- 172.21.15.6:0/2776098578 >> v1:172.21.15.6:6789/0 conn(0x7f1fec0af4e0 legacy=0x7f1fec0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fe959a700 1 --2- 172.21.15.6:0/2776098578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0b27f0 0x7f1fd8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fe959a700 1 --2- 172.21.15.6:0/2776098578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd8003fd0 0x7f1fd8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fe959a700 1 --2- 172.21.15.6:0/2776098578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fd8004d50 0x7f1fd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fe959a700 1 -- 172.21.15.6:0/2776098578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0b1910 con 0x7f1fd8003fd0 2023-10-06T02:18:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fe959a700 1 -- 172.21.15.6:0/2776098578 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd800bb40 con 0x7f1fd8004d50 2023-10-06T02:18:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fe959a700 1 -- 172.21.15.6:0/2776098578 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd800bd00 con 0x7f1fec0b27f0 2023-10-06T02:18:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.886+0000 7f1fe9d9b700 1 --2- 172.21.15.6:0/2776098578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd8003fd0 0x7f1fd8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.887+0000 7f1fea59c700 1 --2- 172.21.15.6:0/2776098578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0b27f0 0x7f1fd8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.887+0000 7f1fead9d700 1 --2- 172.21.15.6:0/2776098578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fd8004d50 0x7f1fd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.887+0000 7f1fe9d9b700 1 -- 172.21.15.6:0/2776098578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0b27f0 msgr2=0x7f1fd8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:07.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.887+0000 7f1fe9d9b700 1 --2- 172.21.15.6:0/2776098578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0b27f0 0x7f1fd8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.887+0000 7f1fe9d9b700 1 -- 172.21.15.6:0/2776098578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fd8004d50 msgr2=0x7f1fd80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:07.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.887+0000 7f1fe9d9b700 1 --2- 172.21.15.6:0/2776098578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fd8004d50 0x7f1fd80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.887+0000 7f1fe9d9b700 1 -- 172.21.15.6:0/2776098578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd8003570 con 0x7f1fd8003fd0 2023-10-06T02:18:07.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.887+0000 7f1fead9d700 1 --2- 172.21.15.6:0/2776098578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fd8004d50 0x7f1fd80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:07.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.887+0000 7f1fe9d9b700 1 --2- 172.21.15.6:0/2776098578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd8003fd0 0x7f1fd8004810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4001970 tx=0x7f1fd4007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2c071ef65f4b89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:07.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.887+0000 7f1fe959a700 1 -- 172.21.15.6:0/2776098578 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd400c5d0 con 0x7f1fd8003fd0 2023-10-06T02:18:07.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.887+0000 7f1fe959a700 1 -- 172.21.15.6:0/2776098578 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd400c750 con 0x7f1fd8003fd0 2023-10-06T02:18:07.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.887+0000 7f1fe959a700 1 -- 172.21.15.6:0/2776098578 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd400cb10 con 0x7f1fd8003fd0 2023-10-06T02:18:07.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.888+0000 7f1ff0e73700 1 -- 172.21.15.6:0/2776098578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd8003fd0 msgr2=0x7f1fd8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.888+0000 7f1ff0e73700 1 --2- 172.21.15.6:0/2776098578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd8003fd0 0x7f1fd8004810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4001970 tx=0x7f1fd4007d10 comp rx=0 tx=0).stop 2023-10-06T02:18:07.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.888+0000 7f1fead9d700 1 -- 172.21.15.6:0/2776098578 reap_dead start 2023-10-06T02:18:07.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.888+0000 7f1ff0e73700 1 -- 172.21.15.6:0/2776098578 shutdown_connections 2023-10-06T02:18:07.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.888+0000 7f1ff0e73700 1 -- 172.21.15.6:0/2776098578 >> 172.21.15.6:0/2776098578 conn(0x7f1fec068680 msgr2=0x7f1fec068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:07.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.888+0000 7f1ff0e73700 1 -- 172.21.15.6:0/2776098578 shutdown_connections 2023-10-06T02:18:07.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.888+0000 7f1ff0e73700 1 -- 172.21.15.6:0/2776098578 wait complete. 2023-10-06T02:18:07.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.889+0000 7f1ff0e73700 1 Processor -- start 2023-10-06T02:18:07.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.889+0000 7f1ff0e73700 1 -- start start 2023-10-06T02:18:07.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1ff0e73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd8003fd0 0x7f1fec1555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1ff0e73700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fec16e090 0x7f1fec16d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1ff0e73700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec169a80 0x7f1fec16da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1ff0e73700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec158590 con 0x7f1fd8003fd0 2023-10-06T02:18:07.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1ff0e73700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec157cf0 con 0x7f1fec16e090 2023-10-06T02:18:07.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1ff0e73700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec157fd0 con 0x7f1fec169a80 2023-10-06T02:18:07.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1fea59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd8003fd0 0x7f1fec1555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1fea59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd8003fd0 0x7f1fec1555e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54710/0 (socket says 172.21.15.6:54710) 2023-10-06T02:18:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1fea59c700 1 -- 172.21.15.6:0/4168763230 learned_addr learned my addr 172.21.15.6:0/4168763230 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1fead9d700 1 --2- 172.21.15.6:0/4168763230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec169a80 0x7f1fec16da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1fe9d9b700 1 --2- 172.21.15.6:0/4168763230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fec16e090 0x7f1fec16d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1fea59c700 1 -- 172.21.15.6:0/4168763230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec169a80 msgr2=0x7f1fec16da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1fea59c700 1 --2- 172.21.15.6:0/4168763230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec169a80 0x7f1fec16da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1fea59c700 1 -- 172.21.15.6:0/4168763230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fec16e090 msgr2=0x7f1fec16d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1fea59c700 1 --2- 172.21.15.6:0/4168763230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fec16e090 0x7f1fec16d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1fea59c700 1 -- 172.21.15.6:0/4168763230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec1582b0 con 0x7f1fd8003fd0 2023-10-06T02:18:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1fea59c700 1 --2- 172.21.15.6:0/4168763230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd8003fd0 0x7f1fec1555e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4007310 tx=0x7f1fec0cb5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1fe27fc700 1 -- 172.21.15.6:0/4168763230 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4018030 con 0x7f1fd8003fd0 2023-10-06T02:18:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1fe27fc700 1 -- 172.21.15.6:0/4168763230 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe400f620 con 0x7f1fd8003fd0 2023-10-06T02:18:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.890+0000 7f1ff0e73700 1 -- 172.21.15.6:0/4168763230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fec0ce340 con 0x7f1fd8003fd0 2023-10-06T02:18:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.891+0000 7f1fe27fc700 1 -- 172.21.15.6:0/4168763230 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400f9c0 con 0x7f1fd8003fd0 2023-10-06T02:18:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.891+0000 7f1ff0e73700 1 -- 172.21.15.6:0/4168763230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec150ea0 con 0x7f1fd8003fd0 2023-10-06T02:18:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.892+0000 7f1fe27fc700 1 -- 172.21.15.6:0/4168763230 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fe401b070 con 0x7f1fd8003fd0 2023-10-06T02:18:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.892+0000 7f1ff0e73700 1 -- 172.21.15.6:0/4168763230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fec088aa0 con 0x7f1fd8003fd0 2023-10-06T02:18:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.892+0000 7f1fe27fc700 1 --2- 172.21.15.6:0/4168763230 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1fcc066f30 0x7f1fcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.893+0000 7f1fe27fc700 1 -- 172.21.15.6:0/4168763230 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1fe4019070 con 0x7f1fd8003fd0 2023-10-06T02:18:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.893+0000 7f1fe9d9b700 1 --2- 172.21.15.6:0/4168763230 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1fcc066f30 0x7f1fcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.893+0000 7f1fe9d9b700 1 --2- 172.21.15.6:0/4168763230 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1fcc066f30 0x7f1fcc0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0c74d0 tx=0x7f1fd4015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:07.897+0000 7f1fe27fc700 1 -- 172.21.15.6:0/4168763230 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fe40514e0 con 0x7f1fd8003fd0 2023-10-06T02:18:08.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.139+0000 7f1ff0e73700 1 -- 172.21.15.6:0/4168763230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1fec0cad20 con 0x7f1fd8003fd0 2023-10-06T02:18:08.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.139+0000 7f1fe27fc700 1 -- 172.21.15.6:0/4168763230 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4590 (secure 0 0 0) 0x7f1fe4054b00 con 0x7f1fd8003fd0 2023-10-06T02:18:08.141 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:08.141 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3433510267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3433510267},{"type":"v1","addr":"172.21.15.175:6836","nonce":3433510267}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3290404467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3290404467},{"type":"v1","addr":"172.21.15.175:6837","nonce":3290404467}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/4132952009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4132952009},{"type":"v1","addr":"172.21.15.6:6834","nonce":4132952009}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:17:43.404580+0000","modified":"2023-10-06T02:17:56.734938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/839986504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":839986504},{"type":"v1","addr":"172.21.15.6:6835","nonce":839986504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:18:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.141+0000 7f1ff0e73700 1 -- 172.21.15.6:0/4168763230 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1fcc066f30 msgr2=0x7f1fcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.141+0000 7f1ff0e73700 1 --2- 172.21.15.6:0/4168763230 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1fcc066f30 0x7f1fcc0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0c74d0 tx=0x7f1fd4015000 comp rx=0 tx=0).stop 2023-10-06T02:18:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.141+0000 7f1ff0e73700 1 -- 172.21.15.6:0/4168763230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd8003fd0 msgr2=0x7f1fec1555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.141+0000 7f1ff0e73700 1 --2- 172.21.15.6:0/4168763230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd8003fd0 0x7f1fec1555e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4007310 tx=0x7f1fec0cb5c0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.141+0000 7f1ff0e73700 1 -- 172.21.15.6:0/4168763230 shutdown_connections 2023-10-06T02:18:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.141+0000 7f1ff0e73700 1 --2- 172.21.15.6:0/4168763230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec169a80 0x7f1fec16da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.141+0000 7f1ff0e73700 1 --2- 172.21.15.6:0/4168763230 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1fcc066f30 0x7f1fcc0693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.141+0000 7f1ff0e73700 1 --2- 172.21.15.6:0/4168763230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd8003fd0 0x7f1fec1555e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.141+0000 7f1ff0e73700 1 --2- 172.21.15.6:0/4168763230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fec16e090 0x7f1fec16d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.141+0000 7f1ff0e73700 1 -- 172.21.15.6:0/4168763230 >> 172.21.15.6:0/4168763230 conn(0x7f1fec068680 msgr2=0x7f1fec0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.141+0000 7f1ff0e73700 1 -- 172.21.15.6:0/4168763230 shutdown_connections 2023-10-06T02:18:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.141+0000 7f1ff0e73700 1 -- 172.21.15.6:0/4168763230 wait complete. 2023-10-06T02:18:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-10-06T02:18:08.155 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:18:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.272+0000 7f698cd9d700 1 Processor -- start 2023-10-06T02:18:08.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.272+0000 7f698cd9d700 1 -- start start 2023-10-06T02:18:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.273+0000 7f698cd9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f698815de30 0x7f69880b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.273+0000 7f698cd9d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69880afbc0 con 0x7f6988159150 2023-10-06T02:18:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.273+0000 7f698cd9d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69880cd620 con 0x7f69880b08f0 2023-10-06T02:18:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.273+0000 7f698cd9d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69880cd400 con 0x7f698815de30 2023-10-06T02:18:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.273+0000 7f698659c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6988159150 0x7f6988159520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36302/0 (socket says 172.21.15.6:36302) 2023-10-06T02:18:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.273+0000 7f698659c700 1 -- 172.21.15.6:0/4236434418 learned_addr learned my addr 172.21.15.6:0/4236434418 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f6986d9d700 1 --2- 172.21.15.6:0/4236434418 >> v2:172.21.15.175:3300/0 conn(0x7f698815de30 0x7f69880b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698559a700 1 -- 172.21.15.6:0/4236434418 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472891251 0 0) 0x7f69880afbc0 con 0x7f6988159150 2023-10-06T02:18:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698559a700 1 -- 172.21.15.6:0/4236434418 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6974003570 con 0x7f6988159150 2023-10-06T02:18:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698559a700 1 -- 172.21.15.6:0/4236434418 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4248832591 0 0) 0x7f6974003570 con 0x7f6988159150 2023-10-06T02:18:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698559a700 1 -- 172.21.15.6:0/4236434418 >> v2:172.21.15.175:3300/0 conn(0x7f698815de30 msgr2=0x7f69880b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698559a700 1 --2- 172.21.15.6:0/4236434418 >> v2:172.21.15.175:3300/0 conn(0x7f698815de30 0x7f69880b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698559a700 1 -- 172.21.15.6:0/4236434418 >> v1:172.21.15.175:6789/0 conn(0x7f69880b08f0 legacy=0x7f69880cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698559a700 1 -- 172.21.15.6:0/4236434418 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69880afe10 con 0x7f6988159150 2023-10-06T02:18:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698559a700 1 -- 172.21.15.6:0/4236434418 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f69800017f0 con 0x7f6988159150 2023-10-06T02:18:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698559a700 1 -- 172.21.15.6:0/4236434418 >> v1:172.21.15.6:6789/0 conn(0x7f6988159150 legacy=0x7f6988159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698559a700 1 --2- 172.21.15.6:0/4236434418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6974003a60 0x7f6974003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698559a700 1 --2- 172.21.15.6:0/4236434418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6974004810 0x7f6974004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698559a700 1 --2- 172.21.15.6:0/4236434418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69740051c0 0x7f697400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698559a700 1 -- 172.21.15.6:0/4236434418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69880cd400 con 0x7f6974003a60 2023-10-06T02:18:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698559a700 1 -- 172.21.15.6:0/4236434418 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697400c0e0 con 0x7f69740051c0 2023-10-06T02:18:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698559a700 1 -- 172.21.15.6:0/4236434418 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697400c2a0 con 0x7f6974004810 2023-10-06T02:18:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698659c700 1 --2- 172.21.15.6:0/4236434418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6974003a60 0x7f6974003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f6986d9d700 1 --2- 172.21.15.6:0/4236434418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69740051c0 0x7f697400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f6985d9b700 1 --2- 172.21.15.6:0/4236434418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6974004810 0x7f6974004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698659c700 1 -- 172.21.15.6:0/4236434418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6974004810 msgr2=0x7f6974004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698659c700 1 --2- 172.21.15.6:0/4236434418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6974004810 0x7f6974004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698659c700 1 -- 172.21.15.6:0/4236434418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69740051c0 msgr2=0x7f697400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698659c700 1 --2- 172.21.15.6:0/4236434418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69740051c0 0x7f697400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f698659c700 1 -- 172.21.15.6:0/4236434418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6974003570 con 0x7f6974003a60 2023-10-06T02:18:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f6986d9d700 1 -- 172.21.15.6:0/4236434418 reap_dead start 2023-10-06T02:18:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.274+0000 7f6985d9b700 1 --2- 172.21.15.6:0/4236434418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6974004810 0x7f6974004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.275+0000 7f698659c700 1 --2- 172.21.15.6:0/4236434418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6974003a60 0x7f6974003e30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f698000a950 tx=0x7f69800021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc85eca7070a94 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.275+0000 7f698559a700 1 -- 172.21.15.6:0/4236434418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69800070d0 con 0x7f6974003a60 2023-10-06T02:18:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.275+0000 7f698559a700 1 -- 172.21.15.6:0/4236434418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6980007250 con 0x7f6974003a60 2023-10-06T02:18:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.275+0000 7f698559a700 1 -- 172.21.15.6:0/4236434418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6980007610 con 0x7f6974003a60 2023-10-06T02:18:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.275+0000 7f698cd9d700 1 -- 172.21.15.6:0/4236434418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6974003a60 msgr2=0x7f6974003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.275+0000 7f698cd9d700 1 --2- 172.21.15.6:0/4236434418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6974003a60 0x7f6974003e30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f698000a950 tx=0x7f69800021f0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.275+0000 7f698cd9d700 1 -- 172.21.15.6:0/4236434418 shutdown_connections 2023-10-06T02:18:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.275+0000 7f698cd9d700 1 --2- 172.21.15.6:0/4236434418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6974003a60 0x7f6974003e30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.275+0000 7f698cd9d700 1 -- 172.21.15.6:0/4236434418 >> 172.21.15.6:0/4236434418 conn(0x7f6988068680 msgr2=0x7f6988068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.275+0000 7f698cd9d700 1 -- 172.21.15.6:0/4236434418 shutdown_connections 2023-10-06T02:18:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.275+0000 7f698cd9d700 1 -- 172.21.15.6:0/4236434418 wait complete. 2023-10-06T02:18:08.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.276+0000 7f698cd9d700 1 Processor -- start 2023-10-06T02:18:08.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.276+0000 7f698cd9d700 1 -- start start 2023-10-06T02:18:08.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.277+0000 7f698cd9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6974003a60 0x7f698814aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:08.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.277+0000 7f698cd9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69880c55e0 0x7f69880c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:08.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.277+0000 7f698cd9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69880cb900 0x7f69880cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:08.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.277+0000 7f698cd9d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69880cc2b0 con 0x7f69880cb900 2023-10-06T02:18:08.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.277+0000 7f698cd9d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69880c5ba0 con 0x7f6974003a60 2023-10-06T02:18:08.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.277+0000 7f698cd9d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69880c5e80 con 0x7f69880c55e0 2023-10-06T02:18:08.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.277+0000 7f6986d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69880cb900 0x7f69880cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:08.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.277+0000 7f6986d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69880cb900 0x7f69880cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54738/0 (socket says 172.21.15.6:54738) 2023-10-06T02:18:08.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.277+0000 7f6986d9d700 1 -- 172.21.15.6:0/604157844 learned_addr learned my addr 172.21.15.6:0/604157844 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:08.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.277+0000 7f6985d9b700 1 --2- 172.21.15.6:0/604157844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69880c55e0 0x7f69880c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:08.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.277+0000 7f698659c700 1 --2- 172.21.15.6:0/604157844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6974003a60 0x7f698814aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:08.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.278+0000 7f6986d9d700 1 -- 172.21.15.6:0/604157844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69880c55e0 msgr2=0x7f69880c73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:08.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.278+0000 7f6986d9d700 1 --2- 172.21.15.6:0/604157844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69880c55e0 0x7f69880c73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.278+0000 7f6986d9d700 1 -- 172.21.15.6:0/604157844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6974003a60 msgr2=0x7f698814aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.278+0000 7f6986d9d700 1 --2- 172.21.15.6:0/604157844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6974003a60 0x7f698814aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.278+0000 7f6986d9d700 1 -- 172.21.15.6:0/604157844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69880c6160 con 0x7f69880cb900 2023-10-06T02:18:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.278+0000 7f698659c700 1 --2- 172.21.15.6:0/604157844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6974003a60 0x7f698814aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.278+0000 7f6986d9d700 1 --2- 172.21.15.6:0/604157844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69880cb900 0x7f69880cbd70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6988089660 tx=0x7f69780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.278+0000 7f697e7fc700 1 -- 172.21.15.6:0/604157844 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697800f910 con 0x7f69880cb900 2023-10-06T02:18:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.278+0000 7f697e7fc700 1 -- 172.21.15.6:0/604157844 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697800fa70 con 0x7f69880cb900 2023-10-06T02:18:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.278+0000 7f698cd9d700 1 -- 172.21.15.6:0/604157844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69880c6440 con 0x7f69880cb900 2023-10-06T02:18:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.278+0000 7f697e7fc700 1 -- 172.21.15.6:0/604157844 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697800fe10 con 0x7f69880cb900 2023-10-06T02:18:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.278+0000 7f698cd9d700 1 -- 172.21.15.6:0/604157844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698814af80 con 0x7f69880cb900 2023-10-06T02:18:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.279+0000 7f698cd9d700 1 -- 172.21.15.6:0/604157844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69880c6960 con 0x7f69880cb900 2023-10-06T02:18:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.279+0000 7f697e7fc700 1 -- 172.21.15.6:0/604157844 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6978014650 con 0x7f69880cb900 2023-10-06T02:18:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.280+0000 7f697e7fc700 1 --2- 172.21.15.6:0/604157844 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6968066f30 0x7f69680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:08.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.280+0000 7f697e7fc700 1 -- 172.21.15.6:0/604157844 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6978084f30 con 0x7f69880cb900 2023-10-06T02:18:08.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.280+0000 7f698659c700 1 --2- 172.21.15.6:0/604157844 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6968066f30 0x7f69680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:08.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.280+0000 7f698659c700 1 --2- 172.21.15.6:0/604157844 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6968066f30 0x7f69680693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6980002250 tx=0x7f6980015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:08.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.284+0000 7f697e7fc700 1 -- 172.21.15.6:0/604157844 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69880c6960 con 0x7f69880cb900 2023-10-06T02:18:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.477+0000 7f698cd9d700 1 -- 172.21.15.6:0/604157844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69880c6960 con 0x7f69880cb900 2023-10-06T02:18:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.478+0000 7f697e7fc700 1 -- 172.21.15.6:0/604157844 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f69880c6960 con 0x7f69880cb900 2023-10-06T02:18:08.480 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:08.480 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:48.453046+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:18:08.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.480+0000 7f698cd9d700 1 -- 172.21.15.6:0/604157844 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6968066f30 msgr2=0x7f69680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.480+0000 7f698cd9d700 1 --2- 172.21.15.6:0/604157844 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6968066f30 0x7f69680693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6980002250 tx=0x7f6980015000 comp rx=0 tx=0).stop 2023-10-06T02:18:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.480+0000 7f698cd9d700 1 -- 172.21.15.6:0/604157844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69880cb900 msgr2=0x7f69880cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.480+0000 7f698cd9d700 1 --2- 172.21.15.6:0/604157844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69880cb900 0x7f69880cbd70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6988089660 tx=0x7f69780091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.480+0000 7f698cd9d700 1 -- 172.21.15.6:0/604157844 shutdown_connections 2023-10-06T02:18:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.480+0000 7f698cd9d700 1 --2- 172.21.15.6:0/604157844 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6968066f30 0x7f69680693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.480+0000 7f698cd9d700 1 --2- 172.21.15.6:0/604157844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69880cb900 0x7f69880cbd70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.480+0000 7f698cd9d700 1 --2- 172.21.15.6:0/604157844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6974003a60 0x7f698814aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.480+0000 7f698cd9d700 1 --2- 172.21.15.6:0/604157844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69880c55e0 0x7f69880c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.480+0000 7f698cd9d700 1 -- 172.21.15.6:0/604157844 >> 172.21.15.6:0/604157844 conn(0x7f6988068680 msgr2=0x7f69880af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.480+0000 7f698cd9d700 1 -- 172.21.15.6:0/604157844 shutdown_connections 2023-10-06T02:18:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.480+0000 7f698cd9d700 1 -- 172.21.15.6:0/604157844 wait complete. 2023-10-06T02:18:08.494 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:18:08.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.611+0000 7f0f7073f700 1 Processor -- start 2023-10-06T02:18:08.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.611+0000 7f0f7073f700 1 -- start start 2023-10-06T02:18:08.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.612+0000 7f0f7073f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f680cd6e0 0x7f0f6813f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:08.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.612+0000 7f0f7073f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f680c7ca0 0x7f0f6813fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:08.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.612+0000 7f0f7073f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f680ca3e0 con 0x7f0f680c78d0 2023-10-06T02:18:08.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.612+0000 7f0f7073f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f680c95c0 con 0x7f0f680cd6e0 2023-10-06T02:18:08.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.612+0000 7f0f7073f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680c3140 con 0x7f0f680c7ca0 2023-10-06T02:18:08.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.612+0000 7f0f6e4db700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0f680c78d0 0x7f0f680ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36304/0 (socket says 172.21.15.6:36304) 2023-10-06T02:18:08.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6e4db700 1 -- 172.21.15.6:0/48935265 learned_addr learned my addr 172.21.15.6:0/48935265 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:08.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6dcda700 1 --2- 172.21.15.6:0/48935265 >> v2:172.21.15.175:3300/0 conn(0x7f0f680cd6e0 0x7f0f6813f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:08.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6ecdc700 1 --2- 172.21.15.6:0/48935265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f680c7ca0 0x7f0f6813fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:08.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6d4d9700 1 -- 172.21.15.6:0/48935265 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 801443874 0 0) 0x7f0f680ca3e0 con 0x7f0f680c78d0 2023-10-06T02:18:08.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6d4d9700 1 -- 172.21.15.6:0/48935265 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f50003570 con 0x7f0f680c78d0 2023-10-06T02:18:08.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6d4d9700 1 -- 172.21.15.6:0/48935265 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3926454851 0 0) 0x7f0f50003570 con 0x7f0f680c78d0 2023-10-06T02:18:08.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6d4d9700 1 -- 172.21.15.6:0/48935265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f680c7ca0 msgr2=0x7f0f6813fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:08.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6d4d9700 1 --2- 172.21.15.6:0/48935265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f680c7ca0 0x7f0f6813fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6d4d9700 1 -- 172.21.15.6:0/48935265 >> v2:172.21.15.175:3300/0 conn(0x7f0f680cd6e0 msgr2=0x7f0f6813f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:08.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6d4d9700 1 --2- 172.21.15.6:0/48935265 >> v2:172.21.15.175:3300/0 conn(0x7f0f680cd6e0 0x7f0f6813f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6d4d9700 1 -- 172.21.15.6:0/48935265 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f680c97d0 con 0x7f0f680c78d0 2023-10-06T02:18:08.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6d4d9700 1 -- 172.21.15.6:0/48935265 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f0f60001470 con 0x7f0f680c78d0 2023-10-06T02:18:08.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6dcda700 1 --2- 172.21.15.6:0/48935265 >> v2:172.21.15.175:3300/0 conn(0x7f0f680cd6e0 0x7f0f6813f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:08.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6ecdc700 1 --2- 172.21.15.6:0/48935265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f680c7ca0 0x7f0f6813fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:08.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6d4d9700 1 -- 172.21.15.6:0/48935265 >> v1:172.21.15.6:6789/0 conn(0x7f0f680c78d0 legacy=0x7f0f680ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:08.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6d4d9700 1 --2- 172.21.15.6:0/48935265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f680c7ca0 0x7f0f50003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:08.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6d4d9700 1 --2- 172.21.15.6:0/48935265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f50003fa0 0x7f0f50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:08.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6d4d9700 1 --2- 172.21.15.6:0/48935265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f50004d50 0x7f0f500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:08.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6d4d9700 1 -- 172.21.15.6:0/48935265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680c95c0 con 0x7f0f50003fa0 2023-10-06T02:18:08.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6d4d9700 1 -- 172.21.15.6:0/48935265 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680c3140 con 0x7f0f50004d50 2023-10-06T02:18:08.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6d4d9700 1 -- 172.21.15.6:0/48935265 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5000ba60 con 0x7f0f680c7ca0 2023-10-06T02:18:08.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6dcda700 1 --2- 172.21.15.6:0/48935265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f50003fa0 0x7f0f50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:08.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6e4db700 1 --2- 172.21.15.6:0/48935265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f680c7ca0 0x7f0f50003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:08.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.613+0000 7f0f6ecdc700 1 --2- 172.21.15.6:0/48935265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f50004d50 0x7f0f500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:08.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.614+0000 7f0f6dcda700 1 -- 172.21.15.6:0/48935265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f680c7ca0 msgr2=0x7f0f50003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:08.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.614+0000 7f0f6dcda700 1 --2- 172.21.15.6:0/48935265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f680c7ca0 0x7f0f50003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.614+0000 7f0f6dcda700 1 -- 172.21.15.6:0/48935265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f50004d50 msgr2=0x7f0f500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:08.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.614+0000 7f0f6dcda700 1 --2- 172.21.15.6:0/48935265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f50004d50 0x7f0f500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.614+0000 7f0f6dcda700 1 -- 172.21.15.6:0/48935265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f58009a20 con 0x7f0f50003fa0 2023-10-06T02:18:08.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.614+0000 7f0f6dcda700 1 --2- 172.21.15.6:0/48935265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f50003fa0 0x7f0f50004810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009df0 tx=0x7f0f5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70317a50bfe689be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:08.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.614+0000 7f0f6d4d9700 1 -- 172.21.15.6:0/48935265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00e920 con 0x7f0f50003fa0 2023-10-06T02:18:08.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.614+0000 7f0f6d4d9700 1 -- 172.21.15.6:0/48935265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c00ea80 con 0x7f0f50003fa0 2023-10-06T02:18:08.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.614+0000 7f0f6d4d9700 1 -- 172.21.15.6:0/48935265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00ee20 con 0x7f0f50003fa0 2023-10-06T02:18:08.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.614+0000 7f0f7073f700 1 -- 172.21.15.6:0/48935265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f50003fa0 msgr2=0x7f0f50004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:08.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.614+0000 7f0f7073f700 1 --2- 172.21.15.6:0/48935265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f50003fa0 0x7f0f50004810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009df0 tx=0x7f0f5c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.614+0000 7f0f6ecdc700 1 -- 172.21.15.6:0/48935265 reap_dead start 2023-10-06T02:18:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.614+0000 7f0f7073f700 1 -- 172.21.15.6:0/48935265 shutdown_connections 2023-10-06T02:18:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.614+0000 7f0f7073f700 1 -- 172.21.15.6:0/48935265 >> 172.21.15.6:0/48935265 conn(0x7f0f68069790 msgr2=0x7f0f68069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.614+0000 7f0f7073f700 1 -- 172.21.15.6:0/48935265 shutdown_connections 2023-10-06T02:18:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.614+0000 7f0f7073f700 1 -- 172.21.15.6:0/48935265 wait complete. 2023-10-06T02:18:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.616+0000 7f0f7073f700 1 Processor -- start 2023-10-06T02:18:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.616+0000 7f0f7073f700 1 -- start start 2023-10-06T02:18:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.616+0000 7f0f7073f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f50003fa0 0x7f0f6813b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.616+0000 7f0f7073f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f680b0db0 0x7f0f680b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.616+0000 7f0f7073f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f68167130 0x7f0f681675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.616+0000 7f0f7073f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f68166e20 con 0x7f0f50003fa0 2023-10-06T02:18:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.616+0000 7f0f7073f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680b1760 con 0x7f0f68167130 2023-10-06T02:18:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.616+0000 7f0f7073f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6813bd40 con 0x7f0f680b0db0 2023-10-06T02:18:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.616+0000 7f0f6e4db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f50003fa0 0x7f0f6813b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.616+0000 7f0f6e4db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f50003fa0 0x7f0f6813b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54750/0 (socket says 172.21.15.6:54750) 2023-10-06T02:18:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.616+0000 7f0f6e4db700 1 -- 172.21.15.6:0/4126215915 learned_addr learned my addr 172.21.15.6:0/4126215915 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.617+0000 7f0f6ecdc700 1 --2- 172.21.15.6:0/4126215915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f68167130 0x7f0f681675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.617+0000 7f0f6dcda700 1 --2- 172.21.15.6:0/4126215915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f680b0db0 0x7f0f680b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.617+0000 7f0f6e4db700 1 -- 172.21.15.6:0/4126215915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f680b0db0 msgr2=0x7f0f680b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.617+0000 7f0f6e4db700 1 --2- 172.21.15.6:0/4126215915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f680b0db0 0x7f0f680b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.617+0000 7f0f6e4db700 1 -- 172.21.15.6:0/4126215915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f68167130 msgr2=0x7f0f681675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.617+0000 7f0f6e4db700 1 --2- 172.21.15.6:0/4126215915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f68167130 0x7f0f681675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.617+0000 7f0f6e4db700 1 -- 172.21.15.6:0/4126215915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f68167e60 con 0x7f0f50003fa0 2023-10-06T02:18:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.617+0000 7f0f6e4db700 1 --2- 172.21.15.6:0/4126215915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f50003fa0 0x7f0f6813b800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0f60007390 tx=0x7f0f60001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:08.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.617+0000 7f0f667fc700 1 -- 172.21.15.6:0/4126215915 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f60018030 con 0x7f0f50003fa0 2023-10-06T02:18:08.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.617+0000 7f0f667fc700 1 -- 172.21.15.6:0/4126215915 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6000f850 con 0x7f0f50003fa0 2023-10-06T02:18:08.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.617+0000 7f0f667fc700 1 -- 172.21.15.6:0/4126215915 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6000fc10 con 0x7f0f50003fa0 2023-10-06T02:18:08.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.617+0000 7f0f7073f700 1 -- 172.21.15.6:0/4126215915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f68157ec0 con 0x7f0f50003fa0 2023-10-06T02:18:08.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.617+0000 7f0f7073f700 1 -- 172.21.15.6:0/4126215915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f68158480 con 0x7f0f50003fa0 2023-10-06T02:18:08.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.618+0000 7f0f7073f700 1 -- 172.21.15.6:0/4126215915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f680c7400 con 0x7f0f50003fa0 2023-10-06T02:18:08.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.618+0000 7f0f667fc700 1 -- 172.21.15.6:0/4126215915 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f6001b070 con 0x7f0f50003fa0 2023-10-06T02:18:08.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.619+0000 7f0f667fc700 1 --2- 172.21.15.6:0/4126215915 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f54066f30 0x7f0f540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:08.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.619+0000 7f0f667fc700 1 -- 172.21.15.6:0/4126215915 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0f60019070 con 0x7f0f50003fa0 2023-10-06T02:18:08.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.619+0000 7f0f6dcda700 1 --2- 172.21.15.6:0/4126215915 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f54066f30 0x7f0f540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:08.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.619+0000 7f0f6dcda700 1 --2- 172.21.15.6:0/4126215915 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f54066f30 0x7f0f540693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0091e0 tx=0x7f0f5c01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:08.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.623+0000 7f0f667fc700 1 -- 172.21.15.6:0/4126215915 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f60051660 con 0x7f0f50003fa0 2023-10-06T02:18:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.862+0000 7f0f7073f700 1 -- 172.21.15.6:0/4126215915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f680ccd40 con 0x7f0f50003fa0 2023-10-06T02:18:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.862+0000 7f0f667fc700 1 -- 172.21.15.6:0/4126215915 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4590 (secure 0 0 0) 0x7f0f60054c80 con 0x7f0f50003fa0 2023-10-06T02:18:08.864 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:08.864 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3433510267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3433510267},{"type":"v1","addr":"172.21.15.175:6836","nonce":3433510267}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3290404467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3290404467},{"type":"v1","addr":"172.21.15.175:6837","nonce":3290404467}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/4132952009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4132952009},{"type":"v1","addr":"172.21.15.6:6834","nonce":4132952009}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:17:43.404580+0000","modified":"2023-10-06T02:17:56.734938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/839986504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":839986504},{"type":"v1","addr":"172.21.15.6:6835","nonce":839986504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:18:08.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.864+0000 7f0f7073f700 1 -- 172.21.15.6:0/4126215915 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f54066f30 msgr2=0x7f0f540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:08.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.864+0000 7f0f7073f700 1 --2- 172.21.15.6:0/4126215915 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f54066f30 0x7f0f540693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0091e0 tx=0x7f0f5c01a000 comp rx=0 tx=0).stop 2023-10-06T02:18:08.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.864+0000 7f0f7073f700 1 -- 172.21.15.6:0/4126215915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f50003fa0 msgr2=0x7f0f6813b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:08.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.864+0000 7f0f7073f700 1 --2- 172.21.15.6:0/4126215915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f50003fa0 0x7f0f6813b800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0f60007390 tx=0x7f0f60001e90 comp rx=0 tx=0).stop 2023-10-06T02:18:08.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.864+0000 7f0f7073f700 1 -- 172.21.15.6:0/4126215915 shutdown_connections 2023-10-06T02:18:08.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.864+0000 7f0f7073f700 1 --2- 172.21.15.6:0/4126215915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f68167130 0x7f0f681675b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.864+0000 7f0f7073f700 1 --2- 172.21.15.6:0/4126215915 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f54066f30 0x7f0f540693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.864+0000 7f0f7073f700 1 --2- 172.21.15.6:0/4126215915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f50003fa0 0x7f0f6813b800 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.864+0000 7f0f7073f700 1 --2- 172.21.15.6:0/4126215915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f680b0db0 0x7f0f680b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:08.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.864+0000 7f0f7073f700 1 -- 172.21.15.6:0/4126215915 >> 172.21.15.6:0/4126215915 conn(0x7f0f68069790 msgr2=0x7f0f680b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:08.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.864+0000 7f0f7073f700 1 -- 172.21.15.6:0/4126215915 shutdown_connections 2023-10-06T02:18:08.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:08.864+0000 7f0f7073f700 1 -- 172.21.15.6:0/4126215915 wait complete. 2023-10-06T02:18:08.868 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-10-06T02:18:09.280 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:17:43.404580+0000', 'modified': '2023-10-06T02:17:56.734938+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/839986504', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 839986504}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 839986504}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:18:09.280 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:18:09.280 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:18:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.402+0000 7fdf918c6700 1 Processor -- start 2023-10-06T02:18:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.402+0000 7fdf918c6700 1 -- start start 2023-10-06T02:18:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.403+0000 7fdf918c6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf8c159400 0x7fdf8c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.403+0000 7fdf918c6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdf8c0cd030 0x7fdf8c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.403+0000 7fdf918c6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c0b3560 con 0x7fdf8c0cf1a0 2023-10-06T02:18:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.403+0000 7fdf918c6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c0cf6f0 con 0x7fdf8c159400 2023-10-06T02:18:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.403+0000 7fdf918c6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c0cf9d0 con 0x7fdf8c0cd030 2023-10-06T02:18:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.403+0000 7fdf908c4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf8c159400 0x7fdf8c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.403+0000 7fdf908c4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf8c159400 0x7fdf8c0ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40450/0 (socket says 172.21.15.6:40450) 2023-10-06T02:18:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.403+0000 7fdf910c5700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdf8c0cf1a0 0x7fdf8c0b5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35096/0 (socket says 172.21.15.6:35096) 2023-10-06T02:18:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.403+0000 7fdf908c4700 1 -- 172.21.15.6:0/883383499 learned_addr learned my addr 172.21.15.6:0/883383499 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.403+0000 7fdf8bfff700 1 --2- 172.21.15.6:0/883383499 >> v2:172.21.15.175:3300/0 conn(0x7fdf8c0cd030 0x7fdf8c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.403+0000 7fdf908c4700 1 -- 172.21.15.6:0/883383499 >> v2:172.21.15.175:3300/0 conn(0x7fdf8c0cd030 msgr2=0x7fdf8c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.403+0000 7fdf908c4700 1 --2- 172.21.15.6:0/883383499 >> v2:172.21.15.175:3300/0 conn(0x7fdf8c0cd030 0x7fdf8c0cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.403+0000 7fdf908c4700 1 -- 172.21.15.6:0/883383499 >> v1:172.21.15.6:6789/0 conn(0x7fdf8c0cf1a0 legacy=0x7fdf8c0b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.403+0000 7fdf908c4700 1 -- 172.21.15.6:0/883383499 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c0b2f10 con 0x7fdf8c159400 2023-10-06T02:18:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.403+0000 7fdf8b7fe700 1 -- 172.21.15.6:0/883383499 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573485150 0 0) 0x7fdf8c0b3560 con 0x7fdf8c0cf1a0 2023-10-06T02:18:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.403+0000 7fdf8bfff700 1 --2- 172.21.15.6:0/883383499 >> v2:172.21.15.175:3300/0 conn(0x7fdf8c0cd030 0x7fdf8c0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.404+0000 7fdf908c4700 1 --2- 172.21.15.6:0/883383499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c159400 0x7fdf8c0ccaf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c15d0f0 tx=0x7fdf80009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4fe64ffff3af8d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.404+0000 7fdf8b7fe700 1 -- 172.21.15.6:0/883383499 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80005c10 con 0x7fdf8c159400 2023-10-06T02:18:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.404+0000 7fdf8b7fe700 1 -- 172.21.15.6:0/883383499 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf80005d70 con 0x7fdf8c159400 2023-10-06T02:18:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.404+0000 7fdf8b7fe700 1 -- 172.21.15.6:0/883383499 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8000b880 con 0x7fdf8c159400 2023-10-06T02:18:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.404+0000 7fdf918c6700 1 -- 172.21.15.6:0/883383499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c159400 msgr2=0x7fdf8c0ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.404+0000 7fdf918c6700 1 --2- 172.21.15.6:0/883383499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c159400 0x7fdf8c0ccaf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c15d0f0 tx=0x7fdf80009220 comp rx=0 tx=0).stop 2023-10-06T02:18:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.404+0000 7fdf918c6700 1 -- 172.21.15.6:0/883383499 shutdown_connections 2023-10-06T02:18:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.404+0000 7fdf918c6700 1 --2- 172.21.15.6:0/883383499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c159400 0x7fdf8c0ccaf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.404+0000 7fdf918c6700 1 --2- 172.21.15.6:0/883383499 >> v2:172.21.15.175:3300/0 conn(0x7fdf8c0cd030 0x7fdf8c0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.404+0000 7fdf918c6700 1 -- 172.21.15.6:0/883383499 >> 172.21.15.6:0/883383499 conn(0x7fdf8c06ac10 msgr2=0x7fdf8c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.404+0000 7fdf918c6700 1 -- 172.21.15.6:0/883383499 shutdown_connections 2023-10-06T02:18:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.404+0000 7fdf918c6700 1 -- 172.21.15.6:0/883383499 wait complete. 2023-10-06T02:18:09.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.405+0000 7fdf918c6700 1 Processor -- start 2023-10-06T02:18:09.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.406+0000 7fdf918c6700 1 -- start start 2023-10-06T02:18:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.406+0000 7fdf918c6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf8c0cd030 0x7fdf8c145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.406+0000 7fdf918c6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf8c0cf1a0 0x7fdf8c16d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.406+0000 7fdf918c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c159400 0x7fdf8c0b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.406+0000 7fdf918c6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c16de40 con 0x7fdf8c159400 2023-10-06T02:18:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.406+0000 7fdf918c6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c0b1830 con 0x7fdf8c0cf1a0 2023-10-06T02:18:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.406+0000 7fdf918c6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c16cef0 con 0x7fdf8c0cd030 2023-10-06T02:18:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.406+0000 7fdf910c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c159400 0x7fdf8c0b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.406+0000 7fdf910c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c159400 0x7fdf8c0b21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40456/0 (socket says 172.21.15.6:40456) 2023-10-06T02:18:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.406+0000 7fdf910c5700 1 -- 172.21.15.6:0/3924778895 learned_addr learned my addr 172.21.15.6:0/3924778895 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.406+0000 7fdf8bfff700 1 --2- 172.21.15.6:0/3924778895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf8c0cf1a0 0x7fdf8c16d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.407+0000 7fdf908c4700 1 --2- 172.21.15.6:0/3924778895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf8c0cd030 0x7fdf8c145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.407+0000 7fdf910c5700 1 -- 172.21.15.6:0/3924778895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf8c0cd030 msgr2=0x7fdf8c145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.407+0000 7fdf910c5700 1 --2- 172.21.15.6:0/3924778895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf8c0cd030 0x7fdf8c145c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.407+0000 7fdf910c5700 1 -- 172.21.15.6:0/3924778895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf8c0cf1a0 msgr2=0x7fdf8c16d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.407+0000 7fdf910c5700 1 --2- 172.21.15.6:0/3924778895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf8c0cf1a0 0x7fdf8c16d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.407+0000 7fdf910c5700 1 -- 172.21.15.6:0/3924778895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf80009480 con 0x7fdf8c159400 2023-10-06T02:18:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.407+0000 7fdf910c5700 1 --2- 172.21.15.6:0/3924778895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c159400 0x7fdf8c0b21c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400cd50 tx=0x7fdf84001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.407+0000 7fdf88ff9700 1 -- 172.21.15.6:0/3924778895 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84005df0 con 0x7fdf8c159400 2023-10-06T02:18:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.407+0000 7fdf88ff9700 1 -- 172.21.15.6:0/3924778895 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8400a960 con 0x7fdf8c159400 2023-10-06T02:18:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.407+0000 7fdf918c6700 1 -- 172.21.15.6:0/3924778895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c16d470 con 0x7fdf8c159400 2023-10-06T02:18:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.407+0000 7fdf88ff9700 1 -- 172.21.15.6:0/3924778895 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8400ad20 con 0x7fdf8c159400 2023-10-06T02:18:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.407+0000 7fdf918c6700 1 -- 172.21.15.6:0/3924778895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c0b1d20 con 0x7fdf8c159400 2023-10-06T02:18:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.408+0000 7fdf88ff9700 1 -- 172.21.15.6:0/3924778895 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf84007300 con 0x7fdf8c159400 2023-10-06T02:18:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.409+0000 7fdf88ff9700 1 --2- 172.21.15.6:0/3924778895 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdf70066f30 0x7fdf700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.409+0000 7fdf88ff9700 1 -- 172.21.15.6:0/3924778895 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdf84084b50 con 0x7fdf8c159400 2023-10-06T02:18:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.409+0000 7fdf908c4700 1 --2- 172.21.15.6:0/3924778895 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdf70066f30 0x7fdf700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.409+0000 7fdf908c4700 1 --2- 172.21.15.6:0/3924778895 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdf70066f30 0x7fdf700693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009260 tx=0x7fdf80016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:09.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.411+0000 7fdf9be20b80 1 Processor -- start 2023-10-06T02:18:09.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.411+0000 7fdf9be20b80 1 -- start start 2023-10-06T02:18:09.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.411+0000 7fdf9be20b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a7bce50 0x56496a797cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.411+0000 7fdf9be20b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a79d2c0 0x56496a798200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.411+0000 7fdf9be20b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a79ea10 0x56496a798740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.411+0000 7fdf9be20b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56496a6f2a70 con 0x56496a79ea10 2023-10-06T02:18:09.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.411+0000 7fdf9be20b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56496a6f0270 con 0x56496a7bce50 2023-10-06T02:18:09.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.411+0000 7fdf9be20b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56496a6ec060 con 0x56496a79d2c0 2023-10-06T02:18:09.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.412+0000 7fdf910c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a79ea10 0x56496a798740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.412+0000 7fdf910c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a79ea10 0x56496a798740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40462/0 (socket says 172.21.15.6:40462) 2023-10-06T02:18:09.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.412+0000 7fdf910c5700 1 -- 172.21.15.6:0/288410637 learned_addr learned my addr 172.21.15.6:0/288410637 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.412+0000 7fdf908c4700 1 --2- 172.21.15.6:0/288410637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a7bce50 0x56496a797cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.412+0000 7fdf8bfff700 1 --2- 172.21.15.6:0/288410637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a79d2c0 0x56496a798200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.412+0000 7fdf910c5700 1 -- 172.21.15.6:0/288410637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a79d2c0 msgr2=0x56496a798200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.412+0000 7fdf910c5700 1 --2- 172.21.15.6:0/288410637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a79d2c0 0x56496a798200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.412+0000 7fdf910c5700 1 -- 172.21.15.6:0/288410637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a7bce50 msgr2=0x56496a797cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.412+0000 7fdf910c5700 1 --2- 172.21.15.6:0/288410637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a7bce50 0x56496a797cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.412+0000 7fdf910c5700 1 -- 172.21.15.6:0/288410637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56496a586270 con 0x56496a79ea10 2023-10-06T02:18:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.412+0000 7fdf910c5700 1 --2- 172.21.15.6:0/288410637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a79ea10 0x56496a798740 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdf84051bb0 tx=0x7fdf84082b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d70192cbf4b68fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.412+0000 7fdf75ffb700 1 -- 172.21.15.6:0/288410637 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84055e10 con 0x56496a79ea10 2023-10-06T02:18:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.412+0000 7fdf75ffb700 1 -- 172.21.15.6:0/288410637 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf840556b0 con 0x56496a79ea10 2023-10-06T02:18:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.412+0000 7fdf75ffb700 1 -- 172.21.15.6:0/288410637 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84058900 con 0x56496a79ea10 2023-10-06T02:18:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.413+0000 7fdf9be20b80 1 -- 172.21.15.6:0/288410637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a79ea10 msgr2=0x56496a798740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.413+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/288410637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a79ea10 0x56496a798740 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdf84051bb0 tx=0x7fdf84082b80 comp rx=0 tx=0).stop 2023-10-06T02:18:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.413+0000 7fdf9be20b80 1 -- 172.21.15.6:0/288410637 shutdown_connections 2023-10-06T02:18:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.413+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/288410637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a79ea10 0x56496a798740 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.413+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/288410637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a7bce50 0x56496a797cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.413+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/288410637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a79d2c0 0x56496a798200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.413+0000 7fdf9be20b80 1 -- 172.21.15.6:0/288410637 >> 172.21.15.6:0/288410637 conn(0x56496a79ce80 msgr2=0x56496a79d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.413+0000 7fdf9be20b80 1 -- 172.21.15.6:0/288410637 shutdown_connections 2023-10-06T02:18:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.413+0000 7fdf9be20b80 1 -- 172.21.15.6:0/288410637 wait complete. 2023-10-06T02:18:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.413+0000 7fdf9be20b80 1 -- start start 2023-10-06T02:18:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.414+0000 7fdf9be20b80 1 Processor -- start 2023-10-06T02:18:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.414+0000 7fdf9be20b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a79d2c0 0x56496a7bdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.414+0000 7fdf9be20b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a79ea10 0x56496a7e4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.414+0000 7fdf9be20b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a7bce50 0x56496a7ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.414+0000 7fdf9be20b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56496a697890 con 0x56496a79ea10 2023-10-06T02:18:09.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.414+0000 7fdf9be20b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56496a6b2ea0 con 0x56496a79d2c0 2023-10-06T02:18:09.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.414+0000 7fdf9be20b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56496a56ee30 con 0x56496a7bce50 2023-10-06T02:18:09.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.414+0000 7fdf8bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a79ea10 0x56496a7e4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.414+0000 7fdf9be20b80 10 client.0 _ll_register_callbacks cb 0x56496a75f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:18:09.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.414+0000 7fdf8bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a79ea10 0x56496a7e4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40472/0 (socket says 172.21.15.6:40472) 2023-10-06T02:18:09.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.414+0000 7fdf8bfff700 1 -- 172.21.15.6:0/1061741415 learned_addr learned my addr 172.21.15.6:0/1061741415 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:09.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.415+0000 7fdf908c4700 1 --2- 172.21.15.6:0/1061741415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a79d2c0 0x56496a7bdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.415+0000 7fdf910c5700 1 --2- 172.21.15.6:0/1061741415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a7bce50 0x56496a7ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.415+0000 7fdf8bfff700 1 -- 172.21.15.6:0/1061741415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a7bce50 msgr2=0x56496a7ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:09.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.415+0000 7fdf8bfff700 1 --2- 172.21.15.6:0/1061741415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a7bce50 0x56496a7ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.415+0000 7fdf8bfff700 1 -- 172.21.15.6:0/1061741415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a79d2c0 msgr2=0x56496a7bdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:09.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.415+0000 7fdf8bfff700 1 --2- 172.21.15.6:0/1061741415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a79d2c0 0x56496a7bdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.415+0000 7fdf8bfff700 1 -- 172.21.15.6:0/1061741415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c0b1d20 con 0x56496a79ea10 2023-10-06T02:18:09.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.415+0000 7fdf8bfff700 1 --2- 172.21.15.6:0/1061741415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a79ea10 0x56496a7e4b70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0c51a0 tx=0x7fdf78008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d697625f7f1cbab6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:09.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.415+0000 7fdf6affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:18:09.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.415+0000 7fdf6affd700 1 -- 172.21.15.6:0/1061741415 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf78013d90 con 0x56496a79ea10 2023-10-06T02:18:09.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.415+0000 7fdf6affd700 1 -- 172.21.15.6:0/1061741415 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdf78016460 con 0x56496a79ea10 2023-10-06T02:18:09.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.415+0000 7fdf9be20b80 1 -- 172.21.15.6:0/1061741415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56496a790940 con 0x56496a79ea10 2023-10-06T02:18:09.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.415+0000 7fdf6affd700 1 -- 172.21.15.6:0/1061741415 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf78016830 con 0x56496a79ea10 2023-10-06T02:18:09.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.415+0000 7fdf9be20b80 10 client.4779 fetch_fsmap learned FSMap version 8 2023-10-06T02:18:09.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.415+0000 7fdf9be20b80 1 -- 172.21.15.6:0/1061741415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x56496a528fe0 con 0x56496a79ea10 2023-10-06T02:18:09.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.415+0000 7fdf6affd700 1 -- 172.21.15.6:0/1061741415 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56496a790940 con 0x56496a79ea10 2023-10-06T02:18:09.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.415+0000 7fdf6affd700 1 -- 172.21.15.6:0/1061741415 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 8) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fdf78016990 con 0x56496a79ea10 2023-10-06T02:18:09.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.416+0000 7fdf9be20b80 10 client.4779 fetch_fsmap finished waiting for FSMap version 8 2023-10-06T02:18:09.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.416+0000 7fdf9be20b80 10 client.4779 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:18:09.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.416+0000 7fdf9be20b80 20 client.4779 populate_metadata read hostname 'smithi006' 2023-10-06T02:18:09.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.416+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/1061741415 >> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] conn(0x56496a7e2f60 0x56496a7e3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.416+0000 7fdf9be20b80 4 client.4779 mds_command: new command op to 4272 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:18:09.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.416+0000 7fdf9be20b80 1 -- 172.21.15.6:0/1061741415 --> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56496a76d870 con 0x56496a7e2f60 2023-10-06T02:18:09.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.416+0000 7fdf908c4700 1 --2- 172.21.15.6:0/1061741415 >> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] conn(0x56496a7e2f60 0x56496a7e3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.416+0000 7fdf908c4700 1 --2- 172.21.15.6:0/1061741415 >> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] conn(0x56496a7e2f60 0x56496a7e3330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bac7b084ad0fe23a server_cookie=4797ed76706f97ca in_seq=0 out_seq=0 2023-10-06T02:18:09.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.416+0000 7fdf6affd700 10 client.4779 ms_handle_connect on v2:172.21.15.6:6833/839986504 2023-10-06T02:18:09.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.416+0000 7fdf6affd700 1 -- 172.21.15.6:0/1061741415 <== mds.0 v2:172.21.15.6:6833/839986504 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56496a76d870 con 0x56496a7e2f60 2023-10-06T02:18:09.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.416+0000 7fdf6affd700 10 client.4779 handle_command_reply: tid=0 2023-10-06T02:18:09.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.416+0000 7fdf9be20b80 1 client.4779 shutdown 2023-10-06T02:18:09.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.417+0000 7fdf9be20b80 1 -- 172.21.15.6:0/1061741415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a79ea10 msgr2=0x56496a7e4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:09.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.417+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/1061741415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a79ea10 0x56496a7e4b70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0c51a0 tx=0x7fdf78008040 comp rx=0 tx=0).stop 2023-10-06T02:18:09.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.417+0000 7fdf9be20b80 1 -- 172.21.15.6:0/1061741415 shutdown_connections 2023-10-06T02:18:09.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.417+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/1061741415 >> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] conn(0x56496a7e2f60 0x56496a7e3330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.417+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/1061741415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a7bce50 0x56496a7ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.417+0000 7fdf6affd700 0 client.4779 ms_handle_reset on v2:172.21.15.6:6833/839986504 2023-10-06T02:18:09.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.417+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/1061741415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a79d2c0 0x56496a7bdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.417+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/1061741415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a79ea10 0x56496a7e4b70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.417+0000 7fdf9be20b80 1 -- 172.21.15.6:0/1061741415 >> 172.21.15.6:0/1061741415 conn(0x56496a79ce80 msgr2=0x56496a79dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:09.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.417+0000 7fdf9be20b80 1 -- 172.21.15.6:0/1061741415 shutdown_connections 2023-10-06T02:18:09.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.417+0000 7fdf9be20b80 1 -- 172.21.15.6:0/1061741415 wait complete. 2023-10-06T02:18:09.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.417+0000 7fdf9be20b80 20 client.4779 trim_cache size 0 max 16384 2023-10-06T02:18:09.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.434+0000 7fdf9be20b80 1 Processor -- start 2023-10-06T02:18:09.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.434+0000 7fdf9be20b80 1 -- start start 2023-10-06T02:18:09.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf9be20b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a79d2c0 0x56496a7ba670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf9be20b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a79ea10 0x56496a792400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf9be20b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a7bce50 0x56496a792940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf9be20b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56496a799b80 con 0x56496a7bce50 2023-10-06T02:18:09.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf9be20b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56496a799020 con 0x56496a79d2c0 2023-10-06T02:18:09.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf9be20b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56496a798e40 con 0x56496a79ea10 2023-10-06T02:18:09.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf910c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a7bce50 0x56496a792940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf910c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a7bce50 0x56496a792940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40478/0 (socket says 172.21.15.6:40478) 2023-10-06T02:18:09.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf910c5700 1 -- 172.21.15.6:0/934699894 learned_addr learned my addr 172.21.15.6:0/934699894 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:09.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf8bfff700 1 --2- 172.21.15.6:0/934699894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a79ea10 0x56496a792400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf908c4700 1 --2- 172.21.15.6:0/934699894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a79d2c0 0x56496a7ba670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf910c5700 1 -- 172.21.15.6:0/934699894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a79ea10 msgr2=0x56496a792400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:09.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf910c5700 1 --2- 172.21.15.6:0/934699894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a79ea10 0x56496a792400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf910c5700 1 -- 172.21.15.6:0/934699894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a79d2c0 msgr2=0x56496a7ba670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:09.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf910c5700 1 --2- 172.21.15.6:0/934699894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a79d2c0 0x56496a7ba670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf910c5700 1 -- 172.21.15.6:0/934699894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56496a6ba780 con 0x56496a7bce50 2023-10-06T02:18:09.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf8bfff700 1 --2- 172.21.15.6:0/934699894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a79ea10 0x56496a792400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:09.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf908c4700 1 --2- 172.21.15.6:0/934699894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a79d2c0 0x56496a7ba670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:09.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf910c5700 1 --2- 172.21.15.6:0/934699894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a7bce50 0x56496a792940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdf84082d00 tx=0x7fdf8407e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419a6f837db5d067 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:09.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.435+0000 7fdf767fc700 1 -- 172.21.15.6:0/934699894 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84055e10 con 0x56496a7bce50 2023-10-06T02:18:09.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.436+0000 7fdf767fc700 1 -- 172.21.15.6:0/934699894 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf840519f0 con 0x56496a7bce50 2023-10-06T02:18:09.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.436+0000 7fdf767fc700 1 -- 172.21.15.6:0/934699894 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8405c650 con 0x56496a7bce50 2023-10-06T02:18:09.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.436+0000 7fdf9be20b80 1 -- 172.21.15.6:0/934699894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a7bce50 msgr2=0x56496a792940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:09.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.436+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/934699894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a7bce50 0x56496a792940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdf84082d00 tx=0x7fdf8407e000 comp rx=0 tx=0).stop 2023-10-06T02:18:09.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.436+0000 7fdf9be20b80 1 -- 172.21.15.6:0/934699894 shutdown_connections 2023-10-06T02:18:09.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.436+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/934699894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a7bce50 0x56496a792940 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.436+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/934699894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a79d2c0 0x56496a7ba670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.436+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/934699894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a79ea10 0x56496a792400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.436+0000 7fdf9be20b80 1 -- 172.21.15.6:0/934699894 >> 172.21.15.6:0/934699894 conn(0x56496a79ce80 msgr2=0x56496a7e6800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:09.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.436+0000 7fdf9be20b80 1 -- 172.21.15.6:0/934699894 shutdown_connections 2023-10-06T02:18:09.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.436+0000 7fdf9be20b80 1 -- 172.21.15.6:0/934699894 wait complete. 2023-10-06T02:18:09.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.437+0000 7fdf9be20b80 1 -- start start 2023-10-06T02:18:09.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.437+0000 7fdf9be20b80 1 Processor -- start 2023-10-06T02:18:09.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.437+0000 7fdf9be20b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a79d2c0 0x56496a83e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf9be20b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a79ea10 0x56496a7ba290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf9be20b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a7bce50 0x56496a7ba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf9be20b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56496a83ee60 con 0x56496a7bce50 2023-10-06T02:18:09.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf9be20b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56496a84b5d0 con 0x56496a79d2c0 2023-10-06T02:18:09.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf9be20b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56496a804320 con 0x56496a79ea10 2023-10-06T02:18:09.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf9be20b80 10 client.0 _ll_register_callbacks cb 0x56496a75f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:18:09.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf910c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a7bce50 0x56496a7ba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf910c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a7bce50 0x56496a7ba7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40488/0 (socket says 172.21.15.6:40488) 2023-10-06T02:18:09.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf910c5700 1 -- 172.21.15.6:0/11768617 learned_addr learned my addr 172.21.15.6:0/11768617 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:09.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf908c4700 1 --2- 172.21.15.6:0/11768617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a79d2c0 0x56496a83e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf8bfff700 1 --2- 172.21.15.6:0/11768617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a79ea10 0x56496a7ba290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf910c5700 1 -- 172.21.15.6:0/11768617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a79ea10 msgr2=0x56496a7ba290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:09.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf910c5700 1 --2- 172.21.15.6:0/11768617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a79ea10 0x56496a7ba290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf910c5700 1 -- 172.21.15.6:0/11768617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a79d2c0 msgr2=0x56496a83e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:09.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf910c5700 1 --2- 172.21.15.6:0/11768617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a79d2c0 0x56496a83e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf910c5700 1 -- 172.21.15.6:0/11768617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56496a586270 con 0x56496a7bce50 2023-10-06T02:18:09.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf910c5700 1 --2- 172.21.15.6:0/11768617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a7bce50 0x56496a7ba7d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdf84051b60 tx=0x7fdf8405e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91d1b0987430c07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:09.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf6affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:18:09.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf6affd700 1 -- 172.21.15.6:0/11768617 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8405c650 con 0x56496a7bce50 2023-10-06T02:18:09.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf6affd700 1 -- 172.21.15.6:0/11768617 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdf84082d00 con 0x56496a7bce50 2023-10-06T02:18:09.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf9be20b80 1 -- 172.21.15.6:0/11768617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56496a7cbf60 con 0x56496a7bce50 2023-10-06T02:18:09.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf6affd700 1 -- 172.21.15.6:0/11768617 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf8405c3d0 con 0x56496a7bce50 2023-10-06T02:18:09.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf9be20b80 10 client.4785 fetch_fsmap learned FSMap version 8 2023-10-06T02:18:09.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.438+0000 7fdf9be20b80 1 -- 172.21.15.6:0/11768617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x56496a6a1470 con 0x56496a7bce50 2023-10-06T02:18:09.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf6affd700 1 -- 172.21.15.6:0/11768617 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56496a7cbf60 con 0x56496a7bce50 2023-10-06T02:18:09.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf6affd700 1 -- 172.21.15.6:0/11768617 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 8) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fdf84004bb0 con 0x56496a7bce50 2023-10-06T02:18:09.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf9be20b80 10 client.4785 fetch_fsmap finished waiting for FSMap version 8 2023-10-06T02:18:09.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf9be20b80 10 client.4785 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:18:09.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf9be20b80 20 client.4785 populate_metadata read hostname 'smithi006' 2023-10-06T02:18:09.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/11768617 >> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] conn(0x56496a7f3630 0x56496a7f3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf9be20b80 4 client.4785 mds_command: new command op to 4272 tid=0[{"prefix": "status"}] 2023-10-06T02:18:09.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf9be20b80 1 -- 172.21.15.6:0/11768617 --> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fdf840556b0 con 0x56496a7f3630 2023-10-06T02:18:09.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf908c4700 1 --2- 172.21.15.6:0/11768617 >> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] conn(0x56496a7f3630 0x56496a7f3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf908c4700 1 --2- 172.21.15.6:0/11768617 >> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] conn(0x56496a7f3630 0x56496a7f3a00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c072443c19f5c33c server_cookie=aa916f1d39e8b188 in_seq=0 out_seq=0 2023-10-06T02:18:09.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf6affd700 10 client.4785 ms_handle_connect on v2:172.21.15.6:6833/839986504 2023-10-06T02:18:09.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf6affd700 1 -- 172.21.15.6:0/11768617 <== mds.0 v2:172.21.15.6:6833/839986504 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x7fdf840556b0 con 0x56496a7f3630 2023-10-06T02:18:09.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf6affd700 10 client.4785 handle_command_reply: tid=0 2023-10-06T02:18:09.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf9be20b80 1 client.4785 shutdown 2023-10-06T02:18:09.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf9be20b80 1 -- 172.21.15.6:0/11768617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a7bce50 msgr2=0x56496a7ba7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:09.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/11768617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a7bce50 0x56496a7ba7d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdf84051b60 tx=0x7fdf8405e040 comp rx=0 tx=0).stop 2023-10-06T02:18:09.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf9be20b80 1 -- 172.21.15.6:0/11768617 shutdown_connections 2023-10-06T02:18:09.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/11768617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56496a7bce50 0x56496a7ba7d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/11768617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56496a79d2c0 0x56496a83e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/11768617 >> [v2:172.21.15.6:6833/839986504,v1:172.21.15.6:6835/839986504] conn(0x56496a7f3630 0x56496a7f3a00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf9be20b80 1 --2- 172.21.15.6:0/11768617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56496a79ea10 0x56496a7ba290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.439+0000 7fdf6affd700 0 client.4785 ms_handle_reset on v2:172.21.15.6:6833/839986504 2023-10-06T02:18:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.440+0000 7fdf9be20b80 1 -- 172.21.15.6:0/11768617 >> 172.21.15.6:0/11768617 conn(0x56496a79ce80 msgr2=0x56496a792400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.440+0000 7fdf9be20b80 1 -- 172.21.15.6:0/11768617 shutdown_connections 2023-10-06T02:18:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.440+0000 7fdf9be20b80 1 -- 172.21.15.6:0/11768617 wait complete. 2023-10-06T02:18:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.440+0000 7fdf9be20b80 20 client.4785 trim_cache size 0 max 16384 2023-10-06T02:18:09.455 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:18:09.455 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:18:09.455 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:18:09.455 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4272, 2023-10-06T02:18:09.456 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:18:09.456 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:18:09.456 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:18:09.456 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 25.447712455000001, 2023-10-06T02:18:09.456 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 8, 2023-10-06T02:18:09.456 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 25, 2023-10-06T02:18:09.456 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 25, 2023-10-06T02:18:09.456 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 31.402948333000001 2023-10-06T02:18:09.456 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:18:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.440+0000 7fdf918c6700 1 -- 172.21.15.6:0/3924778895 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdf70066f30 msgr2=0x7fdf700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.440+0000 7fdf918c6700 1 --2- 172.21.15.6:0/3924778895 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdf70066f30 0x7fdf700693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009260 tx=0x7fdf80016000 comp rx=0 tx=0).stop 2023-10-06T02:18:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.440+0000 7fdf918c6700 1 -- 172.21.15.6:0/3924778895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c159400 msgr2=0x7fdf8c0b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.440+0000 7fdf918c6700 1 --2- 172.21.15.6:0/3924778895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c159400 0x7fdf8c0b21c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400cd50 tx=0x7fdf84001b10 comp rx=0 tx=0).stop 2023-10-06T02:18:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.440+0000 7fdf918c6700 1 -- 172.21.15.6:0/3924778895 shutdown_connections 2023-10-06T02:18:09.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.440+0000 7fdf918c6700 1 --2- 172.21.15.6:0/3924778895 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdf70066f30 0x7fdf700693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.440+0000 7fdf918c6700 1 --2- 172.21.15.6:0/3924778895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c159400 0x7fdf8c0b21c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.440+0000 7fdf918c6700 1 --2- 172.21.15.6:0/3924778895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf8c0cd030 0x7fdf8c145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.440+0000 7fdf918c6700 1 --2- 172.21.15.6:0/3924778895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf8c0cf1a0 0x7fdf8c16d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.440+0000 7fdf918c6700 1 -- 172.21.15.6:0/3924778895 >> 172.21.15.6:0/3924778895 conn(0x7fdf8c06ac10 msgr2=0x7fdf8c157500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:09.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.440+0000 7fdf918c6700 1 -- 172.21.15.6:0/3924778895 shutdown_connections 2023-10-06T02:18:09.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.440+0000 7fdf918c6700 1 -- 172.21.15.6:0/3924778895 wait complete. 2023-10-06T02:18:09.460 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-06T02:18:09.474 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-06T02:18:09.474 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T02:18:09.475 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-06T02:18:09.475 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-06T02:18:09.475 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-06T02:18:09.475 INFO:tasks.ceph_fuse:client.3 config is {} 2023-10-06T02:18:09.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:09.475 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-10-06T02:18:09.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:09.495 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2023-10-06T02:18:09.565 INFO:teuthology.orchestra.run.smithi175.stderr:Cannot find device "ceph-brx" 2023-10-06T02:18:09.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:18:09.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:09.567 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:18:09.582 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-06T02:18:09.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:09.583 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T02:18:09.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:09.665 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-10-06T02:18:09.764 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-06T02:18:09.764 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:18:09.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.883+0000 7fd6e02c3700 1 Processor -- start 2023-10-06T02:18:09.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.884+0000 7fd6e02c3700 1 -- start start 2023-10-06T02:18:09.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.884+0000 7fd6e02c3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6d815a9a0 0x7fd6d80c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.884+0000 7fd6e02c3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d806eb30 con 0x7fd6d80b1750 2023-10-06T02:18:09.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.884+0000 7fd6e02c3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d80c9760 con 0x7fd6d815a5d0 2023-10-06T02:18:09.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.884+0000 7fd6e02c3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d80c9480 con 0x7fd6d815a9a0 2023-10-06T02:18:09.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.885+0000 7fd6de860700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6d815a9a0 0x7fd6d80c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.885+0000 7fd6dd85e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd6d80b1750 0x7fd6d80c8770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35102/0 (socket says 172.21.15.6:35102) 2023-10-06T02:18:09.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.885+0000 7fd6dd85e700 1 -- 172.21.15.6:0/3206617482 learned_addr learned my addr 172.21.15.6:0/3206617482 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:09.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.885+0000 7fd6de860700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6d815a9a0 0x7fd6d80c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40502/0 (socket says 172.21.15.6:40502) 2023-10-06T02:18:09.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.885+0000 7fd6de860700 1 -- 172.21.15.6:0/3206617482 >> v1:172.21.15.175:6789/0 conn(0x7fd6d815a5d0 legacy=0x7fd6d80b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:09.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.885+0000 7fd6de860700 1 -- 172.21.15.6:0/3206617482 >> v1:172.21.15.6:6789/0 conn(0x7fd6d80b1750 legacy=0x7fd6d80c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:09.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.885+0000 7fd6de860700 1 -- 172.21.15.6:0/3206617482 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d806e4e0 con 0x7fd6d815a9a0 2023-10-06T02:18:09.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.885+0000 7fd6de860700 1 --2- 172.21.15.6:0/3206617482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d815a9a0 0x7fd6d80c8e80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009e60 tx=0x7fd6d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468c70e9c2616ef5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:09.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.885+0000 7fd6dd05d700 1 -- 172.21.15.6:0/3206617482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d000e070 con 0x7fd6d815a9a0 2023-10-06T02:18:09.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.885+0000 7fd6dd05d700 1 -- 172.21.15.6:0/3206617482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d000bbf0 con 0x7fd6d815a9a0 2023-10-06T02:18:09.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.885+0000 7fd6dd05d700 1 -- 172.21.15.6:0/3206617482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0012430 con 0x7fd6d815a9a0 2023-10-06T02:18:09.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.886+0000 7fd6e02c3700 1 -- 172.21.15.6:0/3206617482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d815a9a0 msgr2=0x7fd6d80c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:09.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.886+0000 7fd6e02c3700 1 --2- 172.21.15.6:0/3206617482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d815a9a0 0x7fd6d80c8e80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009e60 tx=0x7fd6d0009780 comp rx=0 tx=0).stop 2023-10-06T02:18:09.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.886+0000 7fd6e02c3700 1 -- 172.21.15.6:0/3206617482 shutdown_connections 2023-10-06T02:18:09.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.886+0000 7fd6e02c3700 1 --2- 172.21.15.6:0/3206617482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d815a9a0 0x7fd6d80c8e80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.886+0000 7fd6e02c3700 1 -- 172.21.15.6:0/3206617482 >> 172.21.15.6:0/3206617482 conn(0x7fd6d8069100 msgr2=0x7fd6d80ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:09.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.886+0000 7fd6e02c3700 1 -- 172.21.15.6:0/3206617482 shutdown_connections 2023-10-06T02:18:09.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.886+0000 7fd6e02c3700 1 -- 172.21.15.6:0/3206617482 wait complete. 2023-10-06T02:18:09.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.887+0000 7fd6e02c3700 1 Processor -- start 2023-10-06T02:18:09.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.887+0000 7fd6e02c3700 1 -- start start 2023-10-06T02:18:09.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6e02c3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6d80b1750 0x7fd6d80a8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6e02c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d815a5d0 0x7fd6d80a72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6e02c3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6d815a9a0 0x7fd6d8167ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6e02c3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80a7c80 con 0x7fd6d815a5d0 2023-10-06T02:18:09.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6e02c3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80a7f60 con 0x7fd6d815a9a0 2023-10-06T02:18:09.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6e02c3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80a8240 con 0x7fd6d80b1750 2023-10-06T02:18:09.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6dd85e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d815a5d0 0x7fd6d80a72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6dd85e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d815a5d0 0x7fd6d80a72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40516/0 (socket says 172.21.15.6:40516) 2023-10-06T02:18:09.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6dd85e700 1 -- 172.21.15.6:0/1274178502 learned_addr learned my addr 172.21.15.6:0/1274178502 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:09.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6de860700 1 --2- 172.21.15.6:0/1274178502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6d815a9a0 0x7fd6d8167ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6de05f700 1 --2- 172.21.15.6:0/1274178502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6d80b1750 0x7fd6d80a8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6dd85e700 1 -- 172.21.15.6:0/1274178502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6d80b1750 msgr2=0x7fd6d80a8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:09.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6dd85e700 1 --2- 172.21.15.6:0/1274178502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6d80b1750 0x7fd6d80a8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6dd85e700 1 -- 172.21.15.6:0/1274178502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6d815a9a0 msgr2=0x7fd6d8167ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:09.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6dd85e700 1 --2- 172.21.15.6:0/1274178502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6d815a9a0 0x7fd6d8167ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:09.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6dd85e700 1 -- 172.21.15.6:0/1274178502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d0009a20 con 0x7fd6d815a5d0 2023-10-06T02:18:09.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6de860700 1 --2- 172.21.15.6:0/1274178502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6d815a9a0 0x7fd6d8167ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:09.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6dd85e700 1 --2- 172.21.15.6:0/1274178502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d815a5d0 0x7fd6d80a72c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800c790 tx=0x7fd6c8007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:09.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6ce7fc700 1 -- 172.21.15.6:0/1274178502 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8005b30 con 0x7fd6d815a5d0 2023-10-06T02:18:09.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6ce7fc700 1 -- 172.21.15.6:0/1274178502 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c8005cb0 con 0x7fd6d815a5d0 2023-10-06T02:18:09.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.888+0000 7fd6e02c3700 1 -- 172.21.15.6:0/1274178502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d80a8520 con 0x7fd6d815a5d0 2023-10-06T02:18:09.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.889+0000 7fd6ce7fc700 1 -- 172.21.15.6:0/1274178502 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8004a80 con 0x7fd6d815a5d0 2023-10-06T02:18:09.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.889+0000 7fd6e02c3700 1 -- 172.21.15.6:0/1274178502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d80aa1f0 con 0x7fd6d815a5d0 2023-10-06T02:18:09.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.889+0000 7fd6e02c3700 1 -- 172.21.15.6:0/1274178502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d80aa410 con 0x7fd6d815a5d0 2023-10-06T02:18:09.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.890+0000 7fd6ce7fc700 1 -- 172.21.15.6:0/1274178502 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6c8005030 con 0x7fd6d815a5d0 2023-10-06T02:18:09.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.890+0000 7fd6ce7fc700 1 --2- 172.21.15.6:0/1274178502 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6bc066f30 0x7fd6bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:09.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.890+0000 7fd6ce7fc700 1 -- 172.21.15.6:0/1274178502 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd6c8084330 con 0x7fd6d815a5d0 2023-10-06T02:18:09.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.890+0000 7fd6de05f700 1 --2- 172.21.15.6:0/1274178502 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6bc066f30 0x7fd6bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:09.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.891+0000 7fd6de05f700 1 --2- 172.21.15.6:0/1274178502 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6bc066f30 0x7fd6bc0693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4003870 tx=0x7fd6d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:09.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:09.894+0000 7fd6ce7fc700 1 -- 172.21.15.6:0/1274178502 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6c8051150 con 0x7fd6d815a5d0 2023-10-06T02:18:10.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:10.133+0000 7fd6e02c3700 1 -- 172.21.15.6:0/1274178502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd6d80a89c0 con 0x7fd6d815a5d0 2023-10-06T02:18:10.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:10.134+0000 7fd6ce7fc700 1 -- 172.21.15.6:0/1274178502 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd6c8054770 con 0x7fd6d815a5d0 2023-10-06T02:18:10.135 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T02:18:10.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:10.135+0000 7fd6e02c3700 1 -- 172.21.15.6:0/1274178502 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6bc066f30 msgr2=0x7fd6bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:10.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:10.135+0000 7fd6e02c3700 1 --2- 172.21.15.6:0/1274178502 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6bc066f30 0x7fd6bc0693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4003870 tx=0x7fd6d4009040 comp rx=0 tx=0).stop 2023-10-06T02:18:10.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:10.136+0000 7fd6e02c3700 1 -- 172.21.15.6:0/1274178502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d815a5d0 msgr2=0x7fd6d80a72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:10.136+0000 7fd6e02c3700 1 --2- 172.21.15.6:0/1274178502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d815a5d0 0x7fd6d80a72c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800c790 tx=0x7fd6c8007f40 comp rx=0 tx=0).stop 2023-10-06T02:18:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:10.136+0000 7fd6e02c3700 1 -- 172.21.15.6:0/1274178502 shutdown_connections 2023-10-06T02:18:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:10.136+0000 7fd6e02c3700 1 --2- 172.21.15.6:0/1274178502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6d815a9a0 0x7fd6d8167ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:10.136+0000 7fd6e02c3700 1 --2- 172.21.15.6:0/1274178502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6d80b1750 0x7fd6d80a8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:10.136+0000 7fd6e02c3700 1 --2- 172.21.15.6:0/1274178502 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6bc066f30 0x7fd6bc0693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:10.136+0000 7fd6e02c3700 1 --2- 172.21.15.6:0/1274178502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d815a5d0 0x7fd6d80a72c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:10.136+0000 7fd6e02c3700 1 -- 172.21.15.6:0/1274178502 >> 172.21.15.6:0/1274178502 conn(0x7fd6d8069100 msgr2=0x7fd6d81551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:10.136+0000 7fd6e02c3700 1 -- 172.21.15.6:0/1274178502 shutdown_connections 2023-10-06T02:18:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:10.136+0000 7fd6e02c3700 1 -- 172.21.15.6:0/1274178502 wait complete. 2023-10-06T02:18:10.149 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:18:10.149 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:18:10.149 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:18:10.149 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:18:10.149 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:18:10.149 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:18:10.149 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:18:10.150 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:18:10.150 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:18:10.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:10.150 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:18:10.165 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:18:10.165 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:18:10.165 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:18:10.165 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:18:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:10.166 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:18:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:18:10.166 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:18:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:18:10.166 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:18:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:18:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:18:10.167 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42456sec preferred_lft 42456sec 2023-10-06T02:18:10.167 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:18:10.167 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:10.167 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:18:10.167 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:10.167 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:18:10.167 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T02:18:10.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:10.168 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:18:10.168 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:18:10.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2023-10-06T02:18:10.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2023-10-06T02:18:10.170 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2023-10-06T02:18:10.170 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T02:18:10.170 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:18:10.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:10.279 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:18:10.303 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:18:10.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:10.305 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:18:10.362 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:18:10.362 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:18:10.362 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:18:10.362 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:18:10.362 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:18:10.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:10.363 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:18:10.363 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:18:10.363 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:18:10.363 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:18:10.363 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:18:10.363 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:18:10.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:10.466 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:18:10.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:10.481 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2023-10-06T02:18:10.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:10.536 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:18:10.536 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:18:10.536 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:18:10.536 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T02:18:10.536 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:18:10.627 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T02:18:10.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:10.628 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:18:10.628 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:18:10.628 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T02:18:10.628 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T02:18:10.628 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T02:18:10.628 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T02:18:10.628 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T02:18:10.628 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:18:10.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:10.812 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:18:10.812 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:18:10.812 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:18:10.812 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T02:18:10.812 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:18:10.906 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:18:10.906 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:18:10.906 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:18:10.921 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:18:10.921 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:18:10.921 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:18:10.976 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:18:11.041 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:18:11.041 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:18:11.106 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:18:11.107 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:18:11.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:11.108 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:18:11.163 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:18:11.163 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:18:11.205 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:18:11.229 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:18:11.230 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:18:11.288 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:18:11.287+0000 7fd613a76540 -1 init, newargv = 0x5583d727d7e0 newargc=15 2023-10-06T02:18:11.289 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[101809]: starting ceph client 2023-10-06T02:18:11.293 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[101809]: starting fuse 2023-10-06T02:18:11.296 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:18:11.297 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:18:11.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:11.298 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:18:11.353 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:18:11.353 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:18:11.353 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:18:11.353 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:18:11.353 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:18:11.354 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:18:11.354 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:18:11.354 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:18:11.354 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:18:11.354 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:18:11.354 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:18:11.354 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:18:11.354 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:18:11.354 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:18:11.354 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:18:11.354 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:18:11.354 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:18:11.355 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:18:11.355 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:18:11.355 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:18:11.355 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:18:11.355 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:18:11.355 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:18:11.355 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:18:11.355 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:18:11.355 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:18:11.355 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:18:11.355 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:18:11.355 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:18:11.476 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.101809.asok 2023-10-06T02:18:11.657 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.101809.asok 2023-10-06T02:18:11.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:11.658 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.101809.asok status 2023-10-06T02:18:11.814 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:18:11.814 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:18:11.815 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:18:11.815 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:18:11.815 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:18:11.815 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:18:11.815 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:18:11.815 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "101809", 2023-10-06T02:18:11.816 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:18:11.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:11.816 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:18:11.816 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:18:11.816 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4800, 2023-10-06T02:18:11.816 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:18:11.817 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:18:11.817 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:18:11.817 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 4800 2023-10-06T02:18:11.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:11.817 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:18:11.817 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:18:11.818 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:18:11.818 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3549348835 2023-10-06T02:18:11.818 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:11.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:11.818 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:18:11.818 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:18:11.819 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:18:11.819 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3549348835 2023-10-06T02:18:11.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:11.820 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.4800 192.168.0.1:0/3549348835", 2023-10-06T02:18:11.820 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/3549348835", 2023-10-06T02:18:11.820 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:18:11.820 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 8, 2023-10-06T02:18:11.820 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 25, 2023-10-06T02:18:11.821 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:18:11.821 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:18:11.821 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:18:11.821 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:18:11.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:18:11.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.942+0000 7f9c752bf700 1 Processor -- start 2023-10-06T02:18:11.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.942+0000 7f9c752bf700 1 -- start start 2023-10-06T02:18:11.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.943+0000 7f9c752bf700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9c700af4e0 0x7f9c700b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:11.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.943+0000 7f9c752bf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7015e190 con 0x7f9c7015db70 2023-10-06T02:18:11.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.943+0000 7f9c752bf700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c700cb650 con 0x7f9c700af8b0 2023-10-06T02:18:11.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.943+0000 7f9c752bf700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c700b1910 con 0x7f9c700af4e0 2023-10-06T02:18:11.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.943+0000 7f9c6f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9c7015db70 0x7f9c700cbae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35108/0 (socket says 172.21.15.6:35108) 2023-10-06T02:18:11.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.943+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/4105598437 learned_addr learned my addr 172.21.15.6:0/4105598437 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:11.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.943+0000 7f9c6effd700 1 --2- 172.21.15.6:0/4105598437 >> v2:172.21.15.175:3300/0 conn(0x7f9c700af4e0 0x7f9c700b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:11.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6dffb700 1 -- 172.21.15.6:0/4105598437 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937634858 0 0) 0x7f9c7015e190 con 0x7f9c7015db70 2023-10-06T02:18:11.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6dffb700 1 -- 172.21.15.6:0/4105598437 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c5c003570 con 0x7f9c7015db70 2023-10-06T02:18:11.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6dffb700 1 -- 172.21.15.6:0/4105598437 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833299909 0 0) 0x7f9c700cb650 con 0x7f9c700af8b0 2023-10-06T02:18:11.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6dffb700 1 -- 172.21.15.6:0/4105598437 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c7015e190 con 0x7f9c700af8b0 2023-10-06T02:18:11.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6dffb700 1 -- 172.21.15.6:0/4105598437 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 298008863 0 0) 0x7f9c5c003570 con 0x7f9c7015db70 2023-10-06T02:18:11.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6dffb700 1 -- 172.21.15.6:0/4105598437 >> v2:172.21.15.175:3300/0 conn(0x7f9c700af4e0 msgr2=0x7f9c700b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:11.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6dffb700 1 --2- 172.21.15.6:0/4105598437 >> v2:172.21.15.175:3300/0 conn(0x7f9c700af4e0 0x7f9c700b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:11.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6dffb700 1 -- 172.21.15.6:0/4105598437 >> v1:172.21.15.175:6789/0 conn(0x7f9c700af8b0 legacy=0x7f9c7015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:11.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6dffb700 1 -- 172.21.15.6:0/4105598437 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c700cad20 con 0x7f9c7015db70 2023-10-06T02:18:11.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6dffb700 1 -- 172.21.15.6:0/4105598437 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f9c600017f0 con 0x7f9c7015db70 2023-10-06T02:18:11.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6dffb700 1 -- 172.21.15.6:0/4105598437 >> v1:172.21.15.6:6789/0 conn(0x7f9c7015db70 legacy=0x7f9c700cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:11.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6dffb700 1 --2- 172.21.15.6:0/4105598437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c5c003bf0 0x7f9c5c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:11.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6dffb700 1 --2- 172.21.15.6:0/4105598437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c5c004810 0x7f9c5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:11.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6dffb700 1 --2- 172.21.15.6:0/4105598437 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c5c0051c0 0x7f9c5c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:11.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6dffb700 1 -- 172.21.15.6:0/4105598437 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c700b1910 con 0x7f9c5c003bf0 2023-10-06T02:18:11.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6dffb700 1 -- 172.21.15.6:0/4105598437 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c00c160 con 0x7f9c5c004810 2023-10-06T02:18:11.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6dffb700 1 -- 172.21.15.6:0/4105598437 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c00c320 con 0x7f9c5c0051c0 2023-10-06T02:18:11.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6effd700 1 --2- 172.21.15.6:0/4105598437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c5c003bf0 0x7f9c5c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6e7fc700 1 --2- 172.21.15.6:0/4105598437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c5c004810 0x7f9c5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6f7fe700 1 --2- 172.21.15.6:0/4105598437 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c5c0051c0 0x7f9c5c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6effd700 1 -- 172.21.15.6:0/4105598437 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c5c0051c0 msgr2=0x7f9c5c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6effd700 1 --2- 172.21.15.6:0/4105598437 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c5c0051c0 0x7f9c5c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6effd700 1 -- 172.21.15.6:0/4105598437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c5c004810 msgr2=0x7f9c5c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6effd700 1 --2- 172.21.15.6:0/4105598437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c5c004810 0x7f9c5c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/4105598437 reap_dead start 2023-10-06T02:18:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.944+0000 7f9c6effd700 1 -- 172.21.15.6:0/4105598437 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c003570 con 0x7f9c5c003bf0 2023-10-06T02:18:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.945+0000 7f9c6effd700 1 --2- 172.21.15.6:0/4105598437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c5c003bf0 0x7f9c5c003fe0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9c68006f00 tx=0x7f9c680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4762c2e62c49584e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.945+0000 7f9c6dffb700 1 -- 172.21.15.6:0/4105598437 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6800e710 con 0x7f9c5c003bf0 2023-10-06T02:18:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.945+0000 7f9c6dffb700 1 -- 172.21.15.6:0/4105598437 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6800e870 con 0x7f9c5c003bf0 2023-10-06T02:18:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.945+0000 7f9c6dffb700 1 -- 172.21.15.6:0/4105598437 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6800ec30 con 0x7f9c5c003bf0 2023-10-06T02:18:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.945+0000 7f9c752bf700 1 -- 172.21.15.6:0/4105598437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c5c003bf0 msgr2=0x7f9c5c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.945+0000 7f9c752bf700 1 --2- 172.21.15.6:0/4105598437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c5c003bf0 0x7f9c5c003fe0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9c68006f00 tx=0x7f9c680091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.945+0000 7f9c752bf700 1 -- 172.21.15.6:0/4105598437 shutdown_connections 2023-10-06T02:18:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.945+0000 7f9c752bf700 1 --2- 172.21.15.6:0/4105598437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c5c003bf0 0x7f9c5c003fe0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.945+0000 7f9c752bf700 1 -- 172.21.15.6:0/4105598437 >> 172.21.15.6:0/4105598437 conn(0x7f9c70068680 msgr2=0x7f9c70068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.945+0000 7f9c752bf700 1 -- 172.21.15.6:0/4105598437 shutdown_connections 2023-10-06T02:18:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.945+0000 7f9c752bf700 1 -- 172.21.15.6:0/4105598437 wait complete. 2023-10-06T02:18:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.946+0000 7f9c752bf700 1 Processor -- start 2023-10-06T02:18:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.947+0000 7f9c752bf700 1 -- start start 2023-10-06T02:18:11.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.947+0000 7f9c752bf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c5c003bf0 0x7f9c7016a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:11.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.947+0000 7f9c752bf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c701433b0 0x7f9c700b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:11.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.947+0000 7f9c752bf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c700b59a0 0x7f9c7015c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:11.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.947+0000 7f9c752bf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7016ade0 con 0x7f9c700b59a0 2023-10-06T02:18:11.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.947+0000 7f9c752bf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c700b30a0 con 0x7f9c701433b0 2023-10-06T02:18:11.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.947+0000 7f9c752bf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c700b3340 con 0x7f9c5c003bf0 2023-10-06T02:18:11.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.947+0000 7f9c6f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c700b59a0 0x7f9c7015c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:11.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.947+0000 7f9c6f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c700b59a0 0x7f9c7015c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40530/0 (socket says 172.21.15.6:40530) 2023-10-06T02:18:11.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.947+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/1301177882 learned_addr learned my addr 172.21.15.6:0/1301177882 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:11.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.948+0000 7f9c6e7fc700 1 --2- 172.21.15.6:0/1301177882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c701433b0 0x7f9c700b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:11.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.948+0000 7f9c6effd700 1 --2- 172.21.15.6:0/1301177882 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c5c003bf0 0x7f9c7016a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:11.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.948+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/1301177882 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c5c003bf0 msgr2=0x7f9c7016a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:11.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.948+0000 7f9c6f7fe700 1 --2- 172.21.15.6:0/1301177882 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c5c003bf0 0x7f9c7016a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:11.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.948+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/1301177882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c701433b0 msgr2=0x7f9c700b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:11.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.948+0000 7f9c6f7fe700 1 --2- 172.21.15.6:0/1301177882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c701433b0 0x7f9c700b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:11.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.948+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/1301177882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c700b3620 con 0x7f9c700b59a0 2023-10-06T02:18:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.948+0000 7f9c6e7fc700 1 --2- 172.21.15.6:0/1301177882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c701433b0 0x7f9c700b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.948+0000 7f9c6f7fe700 1 --2- 172.21.15.6:0/1301177882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c700b59a0 0x7f9c7015c5c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9c60001350 tx=0x7f9c60001450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.948+0000 7f9c66ffd700 1 -- 172.21.15.6:0/1301177882 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6000eb60 con 0x7f9c700b59a0 2023-10-06T02:18:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.948+0000 7f9c66ffd700 1 -- 172.21.15.6:0/1301177882 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6000ecc0 con 0x7f9c700b59a0 2023-10-06T02:18:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.948+0000 7f9c752bf700 1 -- 172.21.15.6:0/1301177882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c700b3900 con 0x7f9c700b59a0 2023-10-06T02:18:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.948+0000 7f9c66ffd700 1 -- 172.21.15.6:0/1301177882 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c60013670 con 0x7f9c700b59a0 2023-10-06T02:18:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.948+0000 7f9c752bf700 1 -- 172.21.15.6:0/1301177882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c70169db0 con 0x7f9c700b59a0 2023-10-06T02:18:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.949+0000 7f9c752bf700 1 -- 172.21.15.6:0/1301177882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c700b3e20 con 0x7f9c700b59a0 2023-10-06T02:18:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.949+0000 7f9c66ffd700 1 -- 172.21.15.6:0/1301177882 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c60013aa0 con 0x7f9c700b59a0 2023-10-06T02:18:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.950+0000 7f9c66ffd700 1 --2- 172.21.15.6:0/1301177882 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c50066f30 0x7f9c500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.950+0000 7f9c66ffd700 1 -- 172.21.15.6:0/1301177882 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9c60084f20 con 0x7f9c700b59a0 2023-10-06T02:18:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.950+0000 7f9c6effd700 1 --2- 172.21.15.6:0/1301177882 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c50066f30 0x7f9c500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:11.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.950+0000 7f9c6effd700 1 --2- 172.21.15.6:0/1301177882 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c50066f30 0x7f9c500693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9c68006ed0 tx=0x7f9c6801a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:11.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:11.954+0000 7f9c66ffd700 1 -- 172.21.15.6:0/1301177882 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c700b3e20 con 0x7f9c700b59a0 2023-10-06T02:18:12.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:12.198+0000 7f9c752bf700 1 -- 172.21.15.6:0/1301177882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9c700b3e20 con 0x7f9c700b59a0 2023-10-06T02:18:12.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:12.198+0000 7f9c66ffd700 1 -- 172.21.15.6:0/1301177882 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9c700b3e20 con 0x7f9c700b59a0 2023-10-06T02:18:12.200 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T02:18:12.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:12.200+0000 7f9c752bf700 1 -- 172.21.15.6:0/1301177882 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c50066f30 msgr2=0x7f9c500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:12.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:12.200+0000 7f9c752bf700 1 --2- 172.21.15.6:0/1301177882 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c50066f30 0x7f9c500693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9c68006ed0 tx=0x7f9c6801a000 comp rx=0 tx=0).stop 2023-10-06T02:18:12.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:12.200+0000 7f9c752bf700 1 -- 172.21.15.6:0/1301177882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c700b59a0 msgr2=0x7f9c7015c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:12.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:12.200+0000 7f9c752bf700 1 --2- 172.21.15.6:0/1301177882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c700b59a0 0x7f9c7015c5c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9c60001350 tx=0x7f9c60001450 comp rx=0 tx=0).stop 2023-10-06T02:18:12.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:12.200+0000 7f9c752bf700 1 -- 172.21.15.6:0/1301177882 shutdown_connections 2023-10-06T02:18:12.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:12.200+0000 7f9c752bf700 1 --2- 172.21.15.6:0/1301177882 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c50066f30 0x7f9c500693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:12.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:12.200+0000 7f9c752bf700 1 --2- 172.21.15.6:0/1301177882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c700b59a0 0x7f9c7015c5c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:12.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:12.200+0000 7f9c752bf700 1 --2- 172.21.15.6:0/1301177882 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c5c003bf0 0x7f9c7016a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:12.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:12.200+0000 7f9c752bf700 1 --2- 172.21.15.6:0/1301177882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c701433b0 0x7f9c700b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:12.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:12.200+0000 7f9c752bf700 1 -- 172.21.15.6:0/1301177882 >> 172.21.15.6:0/1301177882 conn(0x7f9c70068680 msgr2=0x7f9c7015af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:12.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:12.200+0000 7f9c752bf700 1 -- 172.21.15.6:0/1301177882 shutdown_connections 2023-10-06T02:18:12.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:12.200+0000 7f9c752bf700 1 -- 172.21.15.6:0/1301177882 wait complete. 2023-10-06T02:18:12.213 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:18:12.213 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:18:12.214 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:18:12.214 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T02:18:12.214 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T02:18:12.214 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:18:12.214 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:18:12.214 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:18:12.215 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T02:18:12.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:12.215 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:18:12.231 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:18:12.231 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:18:12.231 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:18:12.231 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:12.231 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:18:12.231 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:12.232 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:18:12.232 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:12.232 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:18:12.232 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:18:12.232 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:12.232 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:18:12.232 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:18:12.232 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:12.232 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:18:12.232 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:18:12.232 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42454sec preferred_lft 42454sec 2023-10-06T02:18:12.232 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:18:12.232 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:12.233 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:18:12.233 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:12.233 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:18:12.233 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:18:12.233 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:12.233 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:18:12.233 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:12.233 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:18:12.233 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:12.233 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:18:12.233 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:18:12.233 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link tentative 2023-10-06T02:18:12.234 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:12.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:12.234 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:18:12.295 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:18:12.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:12.296 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:18:12.352 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:18:12.353 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:18:12.353 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:18:12.353 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:18:12.353 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:18:12.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:12.353 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:18:12.353 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:18:12.353 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:18:12.354 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:18:12.354 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:18:12.354 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:18:12.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:12.455 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:18:12.469 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:18:12.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:12.470 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2023-10-06T02:18:12.525 INFO:teuthology.orchestra.run.smithi006.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T02:18:12.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:12.525 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:18:12.526 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:18:12.526 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:18:12.526 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T02:18:12.526 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:18:12.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:12.616 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T02:18:12.649 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:18:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:18:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:18:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:18:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:12.649 INFO:teuthology.orchestra.run.smithi006.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:18:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 56:d7:df:b0:cd:fe brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T02:18:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T02:18:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::54d7:dfff:feb0:cdfe/64 scope link 2023-10-06T02:18:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:12.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:12.664 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T02:18:12.741 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:18:12.741 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:18:12.741 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:18:12.741 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:12.741 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:18:12.742 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:12.742 INFO:teuthology.orchestra.run.smithi006.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:18:12.742 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 56:d7:df:b0:cd:fe brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T02:18:12.742 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T02:18:12.742 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:12.742 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::54d7:dfff:feb0:cdfe/64 scope link 2023-10-06T02:18:12.742 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:12.756 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T02:18:12.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:12.757 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:18:12.757 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:18:12.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T02:18:12.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T02:18:12.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T02:18:12.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T02:18:12.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T02:18:12.757 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:18:12.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:12.996 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:18:12.996 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:18:12.996 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.1 up 2023-10-06T02:18:12.996 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T02:18:12.996 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:18:13.090 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-06T02:18:13.090 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:18:13.091 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T02:18:13.105 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T02:18:13.105 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:18:13.106 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T02:18:13.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:18:13.227 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:18:13.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:18:13.291 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:18:13.292 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:18:13.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:13.293 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:18:13.348 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:18:13.348 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2023-10-06T02:18:13.348 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-06T02:18:13.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:18:13.415 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:18:13.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:18:13.475 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi006.stderr:2023-10-06T02:18:13.473+0000 7f74d7d38540 -1 init, newargv = 0x55b66d2b57e0 newargc=15 2023-10-06T02:18:13.475 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi006.stderr:ceph-fuse[102355]: starting ceph client 2023-10-06T02:18:13.479 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi006.stderr:ceph-fuse[102355]: starting fuse 2023-10-06T02:18:13.484 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:18:13.485 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:18:13.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:13.485 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:18:13.541 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:18:13.541 INFO:teuthology.orchestra.run.smithi006.stdout:48 2023-10-06T02:18:13.541 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 48] 2023-10-06T02:18:13.541 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:18:13.542 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:18:13.542 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:18:13.542 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:18:13.542 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:18:13.542 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:18:13.542 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:18:13.542 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-06T02:18:13.542 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:18:13.542 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-06T02:18:13.542 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:18:13.542 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:18:13.542 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:18:13.542 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:18:13.543 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:18:13.543 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:18:13.543 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:18:13.543 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:18:13.543 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:18:13.543 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:18:13.543 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:18:13.543 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:18:13.543 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:18:13.543 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:18:13.543 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:18:13.543 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.2")) 2023-10-06T02:18:13.543 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:18:13.664 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.2.102355.asok 2023-10-06T02:18:13.846 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.102355.asok 2023-10-06T02:18:13.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:13.847 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.102355.asok status 2023-10-06T02:18:13.999 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:18:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:18:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:18:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:18:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "2", 2023-10-06T02:18:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:18:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-06T02:18:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "102355", 2023-10-06T02:18:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:18:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:18:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:18:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4812, 2023-10-06T02:18:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:18:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:18:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:18:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 4812 2023-10-06T02:18:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:18:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:18:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.2:0", 2023-10-06T02:18:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 767910823 2023-10-06T02:18:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:18:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:18:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.2:0", 2023-10-06T02:18:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 767910823 2023-10-06T02:18:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.4812 192.168.0.2:0/767910823", 2023-10-06T02:18:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.2:0/767910823", 2023-10-06T02:18:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:18:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 8, 2023-10-06T02:18:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 25, 2023-10-06T02:18:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:18:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:18:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:18:14.003 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:18:14.009 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:18:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.127+0000 7f00874df700 1 Processor -- start 2023-10-06T02:18:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.127+0000 7f00874df700 1 -- start start 2023-10-06T02:18:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f00874df700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f008015b3c0 0x7f0080097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f00874df700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00800b3c50 0x7f008015b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f00874df700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f008015bcd0 0x7f008015a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f00874df700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00800afb90 con 0x7f008015b3c0 2023-10-06T02:18:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f00874df700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00800b2310 con 0x7f008015bcd0 2023-10-06T02:18:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f00874df700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00800b25f0 con 0x7f00800b3c50 2023-10-06T02:18:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f008527b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f008015b3c0 0x7f0080097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f008527b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f008015b3c0 0x7f0080097d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40532/0 (socket says 172.21.15.6:40532) 2023-10-06T02:18:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f008527b700 1 -- 172.21.15.6:0/2059959467 learned_addr learned my addr 172.21.15.6:0/2059959467 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f0084a7a700 1 --2- 172.21.15.6:0/2059959467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00800b3c50 0x7f008015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f0085a7c700 1 --2- 172.21.15.6:0/2059959467 >> v2:172.21.15.175:3300/0 conn(0x7f008015bcd0 0x7f008015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f008527b700 1 -- 172.21.15.6:0/2059959467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00800b3c50 msgr2=0x7f008015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f008527b700 1 --2- 172.21.15.6:0/2059959467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00800b3c50 0x7f008015b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f008527b700 1 -- 172.21.15.6:0/2059959467 >> v2:172.21.15.175:3300/0 conn(0x7f008015bcd0 msgr2=0x7f008015a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f008527b700 1 --2- 172.21.15.6:0/2059959467 >> v2:172.21.15.175:3300/0 conn(0x7f008015bcd0 0x7f008015a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f008527b700 1 -- 172.21.15.6:0/2059959467 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00800af820 con 0x7f008015b3c0 2023-10-06T02:18:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f008527b700 1 --2- 172.21.15.6:0/2059959467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008015b3c0 0x7f0080097d70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0080087110 tx=0x7f0070009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11159860fd73c25 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f007ffff700 1 -- 172.21.15.6:0/2059959467 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0070005c10 con 0x7f008015b3c0 2023-10-06T02:18:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f007ffff700 1 -- 172.21.15.6:0/2059959467 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0070005d70 con 0x7f008015b3c0 2023-10-06T02:18:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.128+0000 7f007ffff700 1 -- 172.21.15.6:0/2059959467 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0070006260 con 0x7f008015b3c0 2023-10-06T02:18:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.129+0000 7f00874df700 1 -- 172.21.15.6:0/2059959467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008015b3c0 msgr2=0x7f0080097d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.129+0000 7f00874df700 1 --2- 172.21.15.6:0/2059959467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008015b3c0 0x7f0080097d70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0080087110 tx=0x7f0070009220 comp rx=0 tx=0).stop 2023-10-06T02:18:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.129+0000 7f00874df700 1 -- 172.21.15.6:0/2059959467 shutdown_connections 2023-10-06T02:18:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.129+0000 7f00874df700 1 --2- 172.21.15.6:0/2059959467 >> v2:172.21.15.175:3300/0 conn(0x7f008015bcd0 0x7f008015a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.129+0000 7f00874df700 1 --2- 172.21.15.6:0/2059959467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008015b3c0 0x7f0080097d70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.129+0000 7f00874df700 1 --2- 172.21.15.6:0/2059959467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00800b3c50 0x7f008015b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.129+0000 7f00874df700 1 -- 172.21.15.6:0/2059959467 >> 172.21.15.6:0/2059959467 conn(0x7f0080067910 msgr2=0x7f00800ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.129+0000 7f00874df700 1 -- 172.21.15.6:0/2059959467 shutdown_connections 2023-10-06T02:18:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.129+0000 7f00874df700 1 -- 172.21.15.6:0/2059959467 wait complete. 2023-10-06T02:18:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.130+0000 7f00874df700 1 Processor -- start 2023-10-06T02:18:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.130+0000 7f00874df700 1 -- start start 2023-10-06T02:18:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.131+0000 7f00874df700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00800b3c50 0x7f00800ce820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.131+0000 7f00874df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008015b3c0 0x7f0080146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.131+0000 7f00874df700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f008015bcd0 0x7f008015a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.131+0000 7f00874df700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0080148550 con 0x7f008015b3c0 2023-10-06T02:18:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.131+0000 7f00874df700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0080147940 con 0x7f008015bcd0 2023-10-06T02:18:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.131+0000 7f00874df700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0080147c20 con 0x7f00800b3c50 2023-10-06T02:18:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.131+0000 7f0084a7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008015b3c0 0x7f0080146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.131+0000 7f0084a7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008015b3c0 0x7f0080146ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40536/0 (socket says 172.21.15.6:40536) 2023-10-06T02:18:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.131+0000 7f0084a7a700 1 -- 172.21.15.6:0/938802727 learned_addr learned my addr 172.21.15.6:0/938802727 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.131+0000 7f008527b700 1 --2- 172.21.15.6:0/938802727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00800b3c50 0x7f00800ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.131+0000 7f0085a7c700 1 --2- 172.21.15.6:0/938802727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f008015bcd0 0x7f008015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.131+0000 7f0084a7a700 1 -- 172.21.15.6:0/938802727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00800b3c50 msgr2=0x7f00800ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.131+0000 7f0084a7a700 1 --2- 172.21.15.6:0/938802727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00800b3c50 0x7f00800ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.131+0000 7f0084a7a700 1 -- 172.21.15.6:0/938802727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f008015bcd0 msgr2=0x7f008015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.131+0000 7f0084a7a700 1 --2- 172.21.15.6:0/938802727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f008015bcd0 0x7f008015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.131+0000 7f0084a7a700 1 -- 172.21.15.6:0/938802727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0070009480 con 0x7f008015b3c0 2023-10-06T02:18:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.132+0000 7f0084a7a700 1 --2- 172.21.15.6:0/938802727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008015b3c0 0x7f0080146ec0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f007400e930 tx=0x7f00740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.132+0000 7f007d7fa700 1 -- 172.21.15.6:0/938802727 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0074013680 con 0x7f008015b3c0 2023-10-06T02:18:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.132+0000 7f007d7fa700 1 -- 172.21.15.6:0/938802727 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00740137e0 con 0x7f008015b3c0 2023-10-06T02:18:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.132+0000 7f00874df700 1 -- 172.21.15.6:0/938802727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0080147f00 con 0x7f008015b3c0 2023-10-06T02:18:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.132+0000 7f007d7fa700 1 -- 172.21.15.6:0/938802727 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0074013b80 con 0x7f008015b3c0 2023-10-06T02:18:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.132+0000 7f00874df700 1 -- 172.21.15.6:0/938802727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0080154d40 con 0x7f008015b3c0 2023-10-06T02:18:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.133+0000 7f00874df700 1 -- 172.21.15.6:0/938802727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0080148700 con 0x7f008015b3c0 2023-10-06T02:18:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.133+0000 7f007d7fa700 1 -- 172.21.15.6:0/938802727 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f007400c3e0 con 0x7f008015b3c0 2023-10-06T02:18:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.134+0000 7f007d7fa700 1 --2- 172.21.15.6:0/938802727 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f006c066f30 0x7f006c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.134+0000 7f007d7fa700 1 -- 172.21.15.6:0/938802727 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0074084a00 con 0x7f008015b3c0 2023-10-06T02:18:14.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.134+0000 7f008527b700 1 --2- 172.21.15.6:0/938802727 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f006c066f30 0x7f006c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:14.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.134+0000 7f008527b700 1 --2- 172.21.15.6:0/938802727 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f006c066f30 0x7f006c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0080159120 tx=0x7f0070016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.138+0000 7f007d7fa700 1 -- 172.21.15.6:0/938802727 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0080148700 con 0x7f008015b3c0 2023-10-06T02:18:14.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.376+0000 7f00874df700 1 -- 172.21.15.6:0/938802727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0080155a50 con 0x7f008015b3c0 2023-10-06T02:18:14.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.377+0000 7f007d7fa700 1 -- 172.21.15.6:0/938802727 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0074051820 con 0x7f008015b3c0 2023-10-06T02:18:14.378 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T02:18:14.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.379+0000 7f00874df700 1 -- 172.21.15.6:0/938802727 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f006c066f30 msgr2=0x7f006c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:14.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.379+0000 7f00874df700 1 --2- 172.21.15.6:0/938802727 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f006c066f30 0x7f006c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0080159120 tx=0x7f0070016000 comp rx=0 tx=0).stop 2023-10-06T02:18:14.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.379+0000 7f00874df700 1 -- 172.21.15.6:0/938802727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008015b3c0 msgr2=0x7f0080146ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.379+0000 7f00874df700 1 --2- 172.21.15.6:0/938802727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008015b3c0 0x7f0080146ec0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f007400e930 tx=0x7f00740091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.379+0000 7f00874df700 1 -- 172.21.15.6:0/938802727 shutdown_connections 2023-10-06T02:18:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.379+0000 7f00874df700 1 --2- 172.21.15.6:0/938802727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f008015bcd0 0x7f008015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.379+0000 7f00874df700 1 --2- 172.21.15.6:0/938802727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00800b3c50 0x7f00800ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.379+0000 7f00874df700 1 --2- 172.21.15.6:0/938802727 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f006c066f30 0x7f006c0693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.379+0000 7f00874df700 1 --2- 172.21.15.6:0/938802727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008015b3c0 0x7f0080146ec0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.379+0000 7f00874df700 1 -- 172.21.15.6:0/938802727 >> 172.21.15.6:0/938802727 conn(0x7f0080067910 msgr2=0x7f00801588d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.379+0000 7f00874df700 1 -- 172.21.15.6:0/938802727 shutdown_connections 2023-10-06T02:18:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:14.379+0000 7f00874df700 1 -- 172.21.15.6:0/938802727 wait complete. 2023-10-06T02:18:14.392 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:18:14.392 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:18:14.392 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2023-10-06T02:18:14.392 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T02:18:14.392 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T02:18:14.392 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:18:14.392 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:18:14.392 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:18:14.393 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:18:14.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:14.393 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2023-10-06T02:18:14.412 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:18:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:18:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:18:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-10-06T02:18:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:14.412 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:18:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2023-10-06T02:18:14.413 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:18:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2023-10-06T02:18:14.413 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:18:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:14.413 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:18:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:18:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42450sec preferred_lft 42450sec 2023-10-06T02:18:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2023-10-06T02:18:14.414 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:14.414 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T02:18:14.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:14.414 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-10-06T02:18:14.414 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-10-06T02:18:14.414 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add name ceph-brx type bridge 2023-10-06T02:18:14.414 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr flush dev ceph-brx 2023-10-06T02:18:14.415 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set ceph-brx up 2023-10-06T02:18:14.415 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T02:18:14.415 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-10-06T02:18:14.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:14.621 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:18:14.665 INFO:teuthology.orchestra.run.smithi175.stdout:1 2023-10-06T02:18:14.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:14.666 DEBUG:teuthology.orchestra.run.smithi175:> route 2023-10-06T02:18:14.860 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2023-10-06T02:18:14.860 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:18:14.861 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:18:14.861 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:18:14.861 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:18:14.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:14.861 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-10-06T02:18:14.861 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-10-06T02:18:14.861 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:18:14.862 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:18:14.862 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:18:14.862 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-10-06T02:18:15.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:15.138 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-10-06T02:18:15.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:15.153 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list-id 2023-10-06T02:18:15.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:15.208 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-10-06T02:18:15.208 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-10-06T02:18:15.208 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:18:15.208 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T02:18:15.208 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-10-06T02:18:15.298 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T02:18:15.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:15.298 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-10-06T02:18:15.298 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-10-06T02:18:15.298 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T02:18:15.299 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T02:18:15.299 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T02:18:15.299 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T02:18:15.299 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T02:18:15.299 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-10-06T02:18:15.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:15.500 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-10-06T02:18:15.500 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-10-06T02:18:15.500 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2023-10-06T02:18:15.500 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T02:18:15.500 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-10-06T02:18:15.591 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-06T02:18:15.592 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:18:15.592 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T02:18:15.606 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:18:15.606 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:18:15.607 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:18:15.661 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-10-06T02:18:15.726 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:18:15.726 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:18:15.791 INFO:teuthology.orchestra.run.smithi175.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:18:15.792 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:18:15.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:15.792 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-10-06T02:18:15.847 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:18:15.848 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-06T02:18:15.890 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-10-06T02:18:15.913 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:18:15.913 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:18:15.977 INFO:teuthology.orchestra.run.smithi175.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:18:15.978 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:18:15.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:15.978 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-10-06T02:18:15.991 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:2023-10-06T02:18:15.990+0000 7fd6efd8d540 -1 init, newargv = 0x55f68e07db40 newargc=15 2023-10-06T02:18:15.991 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[97498]: starting ceph client 2023-10-06T02:18:15.995 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[97498]: starting fuse 2023-10-06T02:18:16.005 INFO:teuthology.orchestra.run.smithi175.stdout:46 2023-10-06T02:18:16.005 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T02:18:16.005 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:18:16.006 DEBUG:teuthology.orchestra.run.smithi175:> import glob 2023-10-06T02:18:16.006 DEBUG:teuthology.orchestra.run.smithi175:> import re 2023-10-06T02:18:16.006 DEBUG:teuthology.orchestra.run.smithi175:> import os 2023-10-06T02:18:16.006 DEBUG:teuthology.orchestra.run.smithi175:> import subprocess 2023-10-06T02:18:16.006 DEBUG:teuthology.orchestra.run.smithi175:> 2023-10-06T02:18:16.006 DEBUG:teuthology.orchestra.run.smithi175:> def _find_admin_socket(client_name): 2023-10-06T02:18:16.006 DEBUG:teuthology.orchestra.run.smithi175:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-06T02:18:16.006 DEBUG:teuthology.orchestra.run.smithi175:> files = glob.glob(asok_path) 2023-10-06T02:18:16.006 DEBUG:teuthology.orchestra.run.smithi175:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-06T02:18:16.006 DEBUG:teuthology.orchestra.run.smithi175:> 2023-10-06T02:18:16.006 DEBUG:teuthology.orchestra.run.smithi175:> # Given a non-glob path, it better be there 2023-10-06T02:18:16.006 DEBUG:teuthology.orchestra.run.smithi175:> if "*" not in asok_path: 2023-10-06T02:18:16.006 DEBUG:teuthology.orchestra.run.smithi175:> assert(len(files) == 1) 2023-10-06T02:18:16.007 DEBUG:teuthology.orchestra.run.smithi175:> return files[0] 2023-10-06T02:18:16.007 DEBUG:teuthology.orchestra.run.smithi175:> 2023-10-06T02:18:16.007 DEBUG:teuthology.orchestra.run.smithi175:> for f in files: 2023-10-06T02:18:16.007 DEBUG:teuthology.orchestra.run.smithi175:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:18:16.007 DEBUG:teuthology.orchestra.run.smithi175:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:18:16.007 DEBUG:teuthology.orchestra.run.smithi175:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:18:16.007 DEBUG:teuthology.orchestra.run.smithi175:> contents = proc_f.read() 2023-10-06T02:18:16.007 DEBUG:teuthology.orchestra.run.smithi175:> if mountpoint in contents: 2023-10-06T02:18:16.007 DEBUG:teuthology.orchestra.run.smithi175:> return f 2023-10-06T02:18:16.007 DEBUG:teuthology.orchestra.run.smithi175:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:18:16.007 DEBUG:teuthology.orchestra.run.smithi175:> 2023-10-06T02:18:16.007 DEBUG:teuthology.orchestra.run.smithi175:> print(_find_admin_socket("client.1")) 2023-10-06T02:18:16.007 DEBUG:teuthology.orchestra.run.smithi175:> ' 2023-10-06T02:18:16.126 INFO:teuthology.orchestra.run.smithi175.stdout:/var/run/ceph/ceph-client.1.97498.asok 2023-10-06T02:18:16.308 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.97498.asok 2023-10-06T02:18:16.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:16.308 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.97498.asok status 2023-10-06T02:18:16.458 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2023-10-06T02:18:16.459 INFO:teuthology.orchestra.run.smithi175.stdout: "metadata": { 2023-10-06T02:18:16.459 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:18:16.459 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:18:16.459 INFO:teuthology.orchestra.run.smithi175.stdout: "entity_id": "1", 2023-10-06T02:18:16.459 INFO:teuthology.orchestra.run.smithi175.stdout: "hostname": "smithi175", 2023-10-06T02:18:16.459 INFO:teuthology.orchestra.run.smithi175.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-06T02:18:16.459 INFO:teuthology.orchestra.run.smithi175.stdout: "pid": "97498", 2023-10-06T02:18:16.459 INFO:teuthology.orchestra.run.smithi175.stdout: "root": "/" 2023-10-06T02:18:16.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-06T02:18:16.459 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_count": 0, 2023-10-06T02:18:16.460 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_pinned_count": 0, 2023-10-06T02:18:16.460 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 4762, 2023-10-06T02:18:16.460 INFO:teuthology.orchestra.run.smithi175.stdout: "inst": { 2023-10-06T02:18:16.460 INFO:teuthology.orchestra.run.smithi175.stdout: "name": { 2023-10-06T02:18:16.460 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "client", 2023-10-06T02:18:16.460 INFO:teuthology.orchestra.run.smithi175.stdout: "num": 4762 2023-10-06T02:18:16.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-06T02:18:16.460 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-10-06T02:18:16.460 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-10-06T02:18:16.460 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:18:16.461 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 689905150 2023-10-06T02:18:16.461 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-06T02:18:16.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-06T02:18:16.461 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-10-06T02:18:16.461 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-10-06T02:18:16.461 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:18:16.461 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 689905150 2023-10-06T02:18:16.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-06T02:18:16.461 INFO:teuthology.orchestra.run.smithi175.stdout: "inst_str": "client.4762 192.168.0.1:0/689905150", 2023-10-06T02:18:16.461 INFO:teuthology.orchestra.run.smithi175.stdout: "addr_str": "192.168.0.1:0/689905150", 2023-10-06T02:18:16.462 INFO:teuthology.orchestra.run.smithi175.stdout: "inode_count": 1, 2023-10-06T02:18:16.462 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_epoch": 8, 2023-10-06T02:18:16.462 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch": 25, 2023-10-06T02:18:16.462 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:18:16.462 INFO:teuthology.orchestra.run.smithi175.stdout: "blocklisted": false, 2023-10-06T02:18:16.462 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs" 2023-10-06T02:18:16.462 INFO:teuthology.orchestra.run.smithi175.stdout:} 2023-10-06T02:18:16.469 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:18:16.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.601+0000 7f635eab8700 1 Processor -- start 2023-10-06T02:18:16.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.601+0000 7f635eab8700 1 -- start start 2023-10-06T02:18:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.602+0000 7f635eab8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6358068d90 0x7f63580b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.602+0000 7f635eab8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63580ce640 con 0x7f63580d0530 2023-10-06T02:18:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.602+0000 7f635eab8700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f635815a440 con 0x7f635815c900 2023-10-06T02:18:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.602+0000 7f635eab8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635815a9c0 con 0x7f6358068d90 2023-10-06T02:18:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.602+0000 7f635d2b5700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f63580d0530 0x7f63580ced90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35116/0 (socket says 172.21.15.6:35116) 2023-10-06T02:18:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.602+0000 7f635d2b5700 1 -- 172.21.15.6:0/2039285779 learned_addr learned my addr 172.21.15.6:0/2039285779 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.602+0000 7f635e2b7700 1 --2- 172.21.15.6:0/2039285779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6358068d90 0x7f63580b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.602+0000 7f635cab4700 1 -- 172.21.15.6:0/2039285779 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494819924 0 0) 0x7f63580ce640 con 0x7f63580d0530 2023-10-06T02:18:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.603+0000 7f635cab4700 1 -- 172.21.15.6:0/2039285779 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6340003570 con 0x7f63580d0530 2023-10-06T02:18:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.603+0000 7f635cab4700 1 -- 172.21.15.6:0/2039285779 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786471212 0 0) 0x7f635815a440 con 0x7f635815c900 2023-10-06T02:18:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.603+0000 7f635cab4700 1 -- 172.21.15.6:0/2039285779 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63580ce640 con 0x7f635815c900 2023-10-06T02:18:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.603+0000 7f635cab4700 1 -- 172.21.15.6:0/2039285779 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2918758834 0 0) 0x7f6340003570 con 0x7f63580d0530 2023-10-06T02:18:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.603+0000 7f635e2b7700 1 -- 172.21.15.6:0/2039285779 >> v1:172.21.15.175:6789/0 conn(0x7f635815c900 legacy=0x7f63580cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.603+0000 7f635e2b7700 1 -- 172.21.15.6:0/2039285779 >> v1:172.21.15.6:6789/0 conn(0x7f63580d0530 legacy=0x7f63580ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.603+0000 7f635e2b7700 1 -- 172.21.15.6:0/2039285779 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63580cccf0 con 0x7f6358068d90 2023-10-06T02:18:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.603+0000 7f635e2b7700 1 --2- 172.21.15.6:0/2039285779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6358068d90 0x7f63580b5c00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6348009e90 tx=0x7f6348009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f12415e72bbfafe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.603+0000 7f635cab4700 1 -- 172.21.15.6:0/2039285779 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634800e070 con 0x7f6358068d90 2023-10-06T02:18:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.603+0000 7f635cab4700 1 -- 172.21.15.6:0/2039285779 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634800b870 con 0x7f6358068d90 2023-10-06T02:18:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.603+0000 7f635cab4700 1 -- 172.21.15.6:0/2039285779 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634c001470 con 0x7f6358068d90 2023-10-06T02:18:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.604+0000 7f635eab8700 1 -- 172.21.15.6:0/2039285779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6358068d90 msgr2=0x7f63580b5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.604+0000 7f635eab8700 1 --2- 172.21.15.6:0/2039285779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6358068d90 0x7f63580b5c00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6348009e90 tx=0x7f6348009780 comp rx=0 tx=0).stop 2023-10-06T02:18:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.604+0000 7f635eab8700 1 -- 172.21.15.6:0/2039285779 shutdown_connections 2023-10-06T02:18:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.604+0000 7f635eab8700 1 --2- 172.21.15.6:0/2039285779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6358068d90 0x7f63580b5c00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.604+0000 7f635eab8700 1 -- 172.21.15.6:0/2039285779 >> 172.21.15.6:0/2039285779 conn(0x7f635806ac00 msgr2=0x7f6358068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.604+0000 7f635eab8700 1 -- 172.21.15.6:0/2039285779 shutdown_connections 2023-10-06T02:18:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.604+0000 7f635eab8700 1 -- 172.21.15.6:0/2039285779 wait complete. 2023-10-06T02:18:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.605+0000 7f635eab8700 1 Processor -- start 2023-10-06T02:18:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.605+0000 7f635eab8700 1 -- start start 2023-10-06T02:18:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635eab8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6358068d90 0x7f63580c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635eab8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63580d0530 0x7f63580c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635eab8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f635815c900 0x7f6358154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635eab8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63580c8e30 con 0x7f6358068d90 2023-10-06T02:18:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635eab8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63580b16d0 con 0x7f635815c900 2023-10-06T02:18:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635eab8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63580c8b60 con 0x7f63580d0530 2023-10-06T02:18:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635dab6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6358068d90 0x7f63580c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635dab6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6358068d90 0x7f63580c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40548/0 (socket says 172.21.15.6:40548) 2023-10-06T02:18:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635dab6700 1 -- 172.21.15.6:0/3913205611 learned_addr learned my addr 172.21.15.6:0/3913205611 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635e2b7700 1 --2- 172.21.15.6:0/3913205611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f635815c900 0x7f6358154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635d2b5700 1 --2- 172.21.15.6:0/3913205611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63580d0530 0x7f63580c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635dab6700 1 -- 172.21.15.6:0/3913205611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63580d0530 msgr2=0x7f63580c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635dab6700 1 --2- 172.21.15.6:0/3913205611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63580d0530 0x7f63580c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635dab6700 1 -- 172.21.15.6:0/3913205611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f635815c900 msgr2=0x7f6358154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635dab6700 1 --2- 172.21.15.6:0/3913205611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f635815c900 0x7f6358154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635dab6700 1 -- 172.21.15.6:0/3913205611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6348009a20 con 0x7f6358068d90 2023-10-06T02:18:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635dab6700 1 --2- 172.21.15.6:0/3913205611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6358068d90 0x7f63580c5c60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f635000c590 tx=0x7f6350007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f6355ffb700 1 -- 172.21.15.6:0/3913205611 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6350010510 con 0x7f6358068d90 2023-10-06T02:18:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f6355ffb700 1 -- 172.21.15.6:0/3913205611 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6350010690 con 0x7f6358068d90 2023-10-06T02:18:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f635eab8700 1 -- 172.21.15.6:0/3913205611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63580b0da0 con 0x7f6358068d90 2023-10-06T02:18:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.606+0000 7f6355ffb700 1 -- 172.21.15.6:0/3913205611 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6350010a50 con 0x7f6358068d90 2023-10-06T02:18:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.607+0000 7f635eab8700 1 -- 172.21.15.6:0/3913205611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63580b1360 con 0x7f6358068d90 2023-10-06T02:18:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.608+0000 7f635eab8700 1 -- 172.21.15.6:0/3913205611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63580cab30 con 0x7f6358068d90 2023-10-06T02:18:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.608+0000 7f6355ffb700 1 -- 172.21.15.6:0/3913205611 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f635001b400 con 0x7f6358068d90 2023-10-06T02:18:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.609+0000 7f6355ffb700 1 --2- 172.21.15.6:0/3913205611 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6344066f30 0x7f63440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.609+0000 7f6355ffb700 1 -- 172.21.15.6:0/3913205611 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f63500845a0 con 0x7f6358068d90 2023-10-06T02:18:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.609+0000 7f635d2b5700 1 --2- 172.21.15.6:0/3913205611 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6344066f30 0x7f63440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.609+0000 7f635d2b5700 1 --2- 172.21.15.6:0/3913205611 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6344066f30 0x7f63440693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f63580c52c0 tx=0x7f634c001a20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:16.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.613+0000 7f6355ffb700 1 -- 172.21.15.6:0/3913205611 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63580cab30 con 0x7f6358068d90 2023-10-06T02:18:16.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.853+0000 7f635eab8700 1 -- 172.21.15.6:0/3913205611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f63580cab30 con 0x7f6358068d90 2023-10-06T02:18:16.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.854+0000 7f6355ffb700 1 -- 172.21.15.6:0/3913205611 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f63580cab30 con 0x7f6358068d90 2023-10-06T02:18:16.855 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T02:18:16.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.856+0000 7f635eab8700 1 -- 172.21.15.6:0/3913205611 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6344066f30 msgr2=0x7f63440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:16.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.856+0000 7f635eab8700 1 --2- 172.21.15.6:0/3913205611 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6344066f30 0x7f63440693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f63580c52c0 tx=0x7f634c001a20 comp rx=0 tx=0).stop 2023-10-06T02:18:16.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.856+0000 7f635eab8700 1 -- 172.21.15.6:0/3913205611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6358068d90 msgr2=0x7f63580c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:16.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.856+0000 7f635eab8700 1 --2- 172.21.15.6:0/3913205611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6358068d90 0x7f63580c5c60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f635000c590 tx=0x7f6350007dd0 comp rx=0 tx=0).stop 2023-10-06T02:18:16.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.856+0000 7f635eab8700 1 -- 172.21.15.6:0/3913205611 shutdown_connections 2023-10-06T02:18:16.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.856+0000 7f635eab8700 1 --2- 172.21.15.6:0/3913205611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f635815c900 0x7f6358154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:16.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.856+0000 7f635eab8700 1 --2- 172.21.15.6:0/3913205611 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6344066f30 0x7f63440693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:16.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.856+0000 7f635eab8700 1 --2- 172.21.15.6:0/3913205611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6358068d90 0x7f63580c5c60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:16.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.856+0000 7f635eab8700 1 --2- 172.21.15.6:0/3913205611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63580d0530 0x7f63580c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:16.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.856+0000 7f635eab8700 1 -- 172.21.15.6:0/3913205611 >> 172.21.15.6:0/3913205611 conn(0x7f635806ac00 msgr2=0x7f6358155d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:16.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.856+0000 7f635eab8700 1 -- 172.21.15.6:0/3913205611 shutdown_connections 2023-10-06T02:18:16.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:16.856+0000 7f635eab8700 1 -- 172.21.15.6:0/3913205611 wait complete. 2023-10-06T02:18:16.869 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:18:16.869 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:18:16.869 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2023-10-06T02:18:16.869 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T02:18:16.869 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T02:18:16.869 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:18:16.869 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:18:16.869 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:18:16.869 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T02:18:16.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:16.870 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2023-10-06T02:18:16.885 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:18:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:18:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:18:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-10-06T02:18:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:16.886 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:18:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2023-10-06T02:18:16.886 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:18:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2023-10-06T02:18:16.886 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:18:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:16.887 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:18:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:18:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42447sec preferred_lft 42447sec 2023-10-06T02:18:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2023-10-06T02:18:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:16.887 INFO:teuthology.orchestra.run.smithi175.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:18:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:c8:eb:5d:c5:dd brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:18:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::43d:44ff:fea8:bea8/64 scope link 2023-10-06T02:18:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:16.888 INFO:teuthology.orchestra.run.smithi175.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:18:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:c8:eb:5d:c5:dd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:18:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5cc8:ebff:fe5d:c5dd/64 scope link tentative 2023-10-06T02:18:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:16.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:16.888 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:18:16.948 INFO:teuthology.orchestra.run.smithi175.stdout:1 2023-10-06T02:18:16.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:16.949 DEBUG:teuthology.orchestra.run.smithi175:> route 2023-10-06T02:18:17.005 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2023-10-06T02:18:17.005 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:18:17.005 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:18:17.005 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:18:17.005 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:18:17.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:17.006 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-10-06T02:18:17.006 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-10-06T02:18:17.006 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:18:17.006 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:18:17.006 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:18:17.006 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-10-06T02:18:17.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:17.105 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-10-06T02:18:17.119 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T02:18:17.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:17.120 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list-id 2023-10-06T02:18:17.173 INFO:teuthology.orchestra.run.smithi175.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T02:18:17.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:17.174 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-10-06T02:18:17.174 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-10-06T02:18:17.174 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T02:18:17.174 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T02:18:17.174 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-10-06T02:18:17.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:17.263 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T02:18:17.299 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:18:17.299 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:18:17.299 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:18:17.299 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:17.299 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-10-06T02:18:17.299 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:17.299 INFO:teuthology.orchestra.run.smithi175.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:18:17.300 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:0b:e5:b9:32:9c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T02:18:17.300 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T02:18:17.300 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:17.300 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c40b:e5ff:feb9:329c/64 scope link tentative 2023-10-06T02:18:17.300 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:17.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:17.311 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T02:18:17.385 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:18:17.385 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:18:17.385 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:18:17.385 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:17.385 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-10-06T02:18:17.385 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:17.386 INFO:teuthology.orchestra.run.smithi175.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:18:17.386 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:0b:e5:b9:32:9c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T02:18:17.386 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T02:18:17.386 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:17.386 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c40b:e5ff:feb9:329c/64 scope link tentative 2023-10-06T02:18:17.386 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:17.399 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T02:18:17.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:17.400 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-10-06T02:18:17.400 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-10-06T02:18:17.400 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T02:18:17.400 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T02:18:17.400 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T02:18:17.400 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T02:18:17.400 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T02:18:17.400 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-10-06T02:18:17.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:17.613 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-10-06T02:18:17.614 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-10-06T02:18:17.614 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.1 up 2023-10-06T02:18:17.614 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T02:18:17.614 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-10-06T02:18:17.706 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-10-06T02:18:17.706 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:18:17.706 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T02:18:17.721 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T02:18:17.721 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:18:17.721 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T02:18:17.775 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-10-06T02:18:17.840 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:18:17.841 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:18:17.905 INFO:teuthology.orchestra.run.smithi175.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:18:17.906 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:18:17.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:17.906 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-10-06T02:18:17.963 INFO:teuthology.orchestra.run.smithi175.stdout:46 2023-10-06T02:18:17.963 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-10-06T02:18:17.963 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-10-06T02:18:18.005 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-10-06T02:18:18.029 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:18:18.030 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:18:18.087 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi175.stderr:2023-10-06T02:18:18.086+0000 7f5d91412540 -1 init, newargv = 0x55940ac05cd0 newargc=15 2023-10-06T02:18:18.087 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi175.stderr:ceph-fuse[97986]: starting ceph client 2023-10-06T02:18:18.092 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi175.stderr:ceph-fuse[97986]: starting fuse 2023-10-06T02:18:18.096 INFO:teuthology.orchestra.run.smithi175.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:18:18.097 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:18:18.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:18.098 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-10-06T02:18:18.153 INFO:teuthology.orchestra.run.smithi175.stdout:46 2023-10-06T02:18:18.154 INFO:teuthology.orchestra.run.smithi175.stdout:48 2023-10-06T02:18:18.154 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-10-06T02:18:18.154 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:18:18.154 DEBUG:teuthology.orchestra.run.smithi175:> import glob 2023-10-06T02:18:18.154 DEBUG:teuthology.orchestra.run.smithi175:> import re 2023-10-06T02:18:18.154 DEBUG:teuthology.orchestra.run.smithi175:> import os 2023-10-06T02:18:18.155 DEBUG:teuthology.orchestra.run.smithi175:> import subprocess 2023-10-06T02:18:18.155 DEBUG:teuthology.orchestra.run.smithi175:> 2023-10-06T02:18:18.155 DEBUG:teuthology.orchestra.run.smithi175:> def _find_admin_socket(client_name): 2023-10-06T02:18:18.155 DEBUG:teuthology.orchestra.run.smithi175:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-10-06T02:18:18.155 DEBUG:teuthology.orchestra.run.smithi175:> files = glob.glob(asok_path) 2023-10-06T02:18:18.155 DEBUG:teuthology.orchestra.run.smithi175:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-10-06T02:18:18.155 DEBUG:teuthology.orchestra.run.smithi175:> 2023-10-06T02:18:18.156 DEBUG:teuthology.orchestra.run.smithi175:> # Given a non-glob path, it better be there 2023-10-06T02:18:18.156 DEBUG:teuthology.orchestra.run.smithi175:> if "*" not in asok_path: 2023-10-06T02:18:18.156 DEBUG:teuthology.orchestra.run.smithi175:> assert(len(files) == 1) 2023-10-06T02:18:18.156 DEBUG:teuthology.orchestra.run.smithi175:> return files[0] 2023-10-06T02:18:18.156 DEBUG:teuthology.orchestra.run.smithi175:> 2023-10-06T02:18:18.156 DEBUG:teuthology.orchestra.run.smithi175:> for f in files: 2023-10-06T02:18:18.156 DEBUG:teuthology.orchestra.run.smithi175:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:18:18.156 DEBUG:teuthology.orchestra.run.smithi175:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:18:18.156 DEBUG:teuthology.orchestra.run.smithi175:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:18:18.156 DEBUG:teuthology.orchestra.run.smithi175:> contents = proc_f.read() 2023-10-06T02:18:18.156 DEBUG:teuthology.orchestra.run.smithi175:> if mountpoint in contents: 2023-10-06T02:18:18.156 DEBUG:teuthology.orchestra.run.smithi175:> return f 2023-10-06T02:18:18.156 DEBUG:teuthology.orchestra.run.smithi175:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:18:18.157 DEBUG:teuthology.orchestra.run.smithi175:> 2023-10-06T02:18:18.157 DEBUG:teuthology.orchestra.run.smithi175:> print(_find_admin_socket("client.3")) 2023-10-06T02:18:18.157 DEBUG:teuthology.orchestra.run.smithi175:> ' 2023-10-06T02:18:18.273 INFO:teuthology.orchestra.run.smithi175.stdout:/var/run/ceph/ceph-client.3.97986.asok 2023-10-06T02:18:18.456 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.97986.asok 2023-10-06T02:18:18.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:18.456 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.97986.asok status 2023-10-06T02:18:18.607 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2023-10-06T02:18:18.607 INFO:teuthology.orchestra.run.smithi175.stdout: "metadata": { 2023-10-06T02:18:18.607 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:18:18.607 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:18:18.607 INFO:teuthology.orchestra.run.smithi175.stdout: "entity_id": "3", 2023-10-06T02:18:18.607 INFO:teuthology.orchestra.run.smithi175.stdout: "hostname": "smithi175", 2023-10-06T02:18:18.607 INFO:teuthology.orchestra.run.smithi175.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-10-06T02:18:18.607 INFO:teuthology.orchestra.run.smithi175.stdout: "pid": "97986", 2023-10-06T02:18:18.607 INFO:teuthology.orchestra.run.smithi175.stdout: "root": "/" 2023-10-06T02:18:18.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-06T02:18:18.608 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_count": 0, 2023-10-06T02:18:18.608 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_pinned_count": 0, 2023-10-06T02:18:18.608 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 4774, 2023-10-06T02:18:18.608 INFO:teuthology.orchestra.run.smithi175.stdout: "inst": { 2023-10-06T02:18:18.608 INFO:teuthology.orchestra.run.smithi175.stdout: "name": { 2023-10-06T02:18:18.608 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "client", 2023-10-06T02:18:18.608 INFO:teuthology.orchestra.run.smithi175.stdout: "num": 4774 2023-10-06T02:18:18.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-06T02:18:18.608 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-10-06T02:18:18.608 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-10-06T02:18:18.608 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.2:0", 2023-10-06T02:18:18.608 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 4112582202 2023-10-06T02:18:18.609 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-06T02:18:18.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-06T02:18:18.609 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-10-06T02:18:18.609 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-10-06T02:18:18.609 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.2:0", 2023-10-06T02:18:18.609 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 4112582202 2023-10-06T02:18:18.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-06T02:18:18.609 INFO:teuthology.orchestra.run.smithi175.stdout: "inst_str": "client.4774 192.168.0.2:0/4112582202", 2023-10-06T02:18:18.609 INFO:teuthology.orchestra.run.smithi175.stdout: "addr_str": "192.168.0.2:0/4112582202", 2023-10-06T02:18:18.609 INFO:teuthology.orchestra.run.smithi175.stdout: "inode_count": 1, 2023-10-06T02:18:18.609 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_epoch": 8, 2023-10-06T02:18:18.609 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch": 25, 2023-10-06T02:18:18.610 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:18:18.610 INFO:teuthology.orchestra.run.smithi175.stdout: "blocklisted": false, 2023-10-06T02:18:18.610 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs" 2023-10-06T02:18:18.610 INFO:teuthology.orchestra.run.smithi175.stdout:} 2023-10-06T02:18:18.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:18.617 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:18:18.617 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:18:18.635 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:18:18.636 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:18:18.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:18.636 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:18:18.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:18.707 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:18:18.707 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-06T02:18:18.766 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:18:18.767 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-06T02:18:18.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:18.767 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T02:18:18.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:18.837 DEBUG:teuthology.orchestra.run.smithi175:> stat --file-system '--printf=%T 2023-10-06T02:18:18.837 DEBUG:teuthology.orchestra.run.smithi175:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-06T02:18:18.853 INFO:teuthology.orchestra.run.smithi175.stdout:fuseblk 2023-10-06T02:18:18.853 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-06T02:18:18.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:18.853 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:18:18.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:18.918 DEBUG:teuthology.orchestra.run.smithi175:> stat --file-system '--printf=%T 2023-10-06T02:18:18.918 DEBUG:teuthology.orchestra.run.smithi175:> ' -- /home/ubuntu/cephtest/mnt.3 2023-10-06T02:18:18.973 INFO:teuthology.orchestra.run.smithi175.stdout:fuseblk 2023-10-06T02:18:18.973 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-10-06T02:18:18.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:18.974 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T02:18:19.021 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:18:19.023 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:18:19.038 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T02:18:19.057 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:18:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.188+0000 7fdfbc4b4700 1 Processor -- start 2023-10-06T02:18:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.188+0000 7fdfbc4b4700 1 -- start start 2023-10-06T02:18:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.189+0000 7fdfbc4b4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdfb40af4e0 0x7fdfb40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.189+0000 7fdfbc4b4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfb40af8b0 0x7fdfb40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.189+0000 7fdfbc4b4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdfb415d460 0x7fdfb415d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.189+0000 7fdfbc4b4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb40b1910 con 0x7fdfb40af4e0 2023-10-06T02:18:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.189+0000 7fdfbc4b4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb415e190 con 0x7fdfb415d460 2023-10-06T02:18:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.189+0000 7fdfbc4b4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40cb650 con 0x7fdfb40af8b0 2023-10-06T02:18:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.189+0000 7fdfba250700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdfb40af4e0 0x7fdfb40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.189+0000 7fdfba250700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdfb40af4e0 0x7fdfb40b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55784/0 (socket says 172.21.15.6:55784) 2023-10-06T02:18:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.189+0000 7fdfba250700 1 -- 172.21.15.6:0/1956312801 learned_addr learned my addr 172.21.15.6:0/1956312801 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.190+0000 7fdfb9a4f700 1 --2- 172.21.15.6:0/1956312801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfb40af8b0 0x7fdfb40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.190+0000 7fdfbaa51700 1 --2- 172.21.15.6:0/1956312801 >> v2:172.21.15.175:3300/0 conn(0x7fdfb415d460 0x7fdfb415d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.190+0000 7fdfba250700 1 -- 172.21.15.6:0/1956312801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfb40af8b0 msgr2=0x7fdfb40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.190+0000 7fdfba250700 1 --2- 172.21.15.6:0/1956312801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfb40af8b0 0x7fdfb40b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.190+0000 7fdfba250700 1 -- 172.21.15.6:0/1956312801 >> v2:172.21.15.175:3300/0 conn(0x7fdfb415d460 msgr2=0x7fdfb415d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.190+0000 7fdfba250700 1 --2- 172.21.15.6:0/1956312801 >> v2:172.21.15.175:3300/0 conn(0x7fdfb415d460 0x7fdfb415d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.190+0000 7fdfba250700 1 -- 172.21.15.6:0/1956312801 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb40b2b60 con 0x7fdfb40af4e0 2023-10-06T02:18:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.190+0000 7fdfba250700 1 --2- 172.21.15.6:0/1956312801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb40af4e0 0x7fdfb40b20e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40b63b0 tx=0x7fdfac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273ead156ab0b445 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.190+0000 7fdfb924e700 1 -- 172.21.15.6:0/1956312801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac00b860 con 0x7fdfb40af4e0 2023-10-06T02:18:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.190+0000 7fdfb924e700 1 -- 172.21.15.6:0/1956312801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac00b9c0 con 0x7fdfb40af4e0 2023-10-06T02:18:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.190+0000 7fdfb924e700 1 -- 172.21.15.6:0/1956312801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac00bd60 con 0x7fdfb40af4e0 2023-10-06T02:18:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.191+0000 7fdfbc4b4700 1 -- 172.21.15.6:0/1956312801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb40af4e0 msgr2=0x7fdfb40b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.191+0000 7fdfbc4b4700 1 --2- 172.21.15.6:0/1956312801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb40af4e0 0x7fdfb40b20e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40b63b0 tx=0x7fdfac009250 comp rx=0 tx=0).stop 2023-10-06T02:18:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.191+0000 7fdfbc4b4700 1 -- 172.21.15.6:0/1956312801 shutdown_connections 2023-10-06T02:18:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.191+0000 7fdfbc4b4700 1 --2- 172.21.15.6:0/1956312801 >> v2:172.21.15.175:3300/0 conn(0x7fdfb415d460 0x7fdfb415d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.191+0000 7fdfbc4b4700 1 --2- 172.21.15.6:0/1956312801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb40af4e0 0x7fdfb40b20e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.191+0000 7fdfbc4b4700 1 --2- 172.21.15.6:0/1956312801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfb40af8b0 0x7fdfb40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.191+0000 7fdfbc4b4700 1 -- 172.21.15.6:0/1956312801 >> 172.21.15.6:0/1956312801 conn(0x7fdfb4068680 msgr2=0x7fdfb4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.191+0000 7fdfbc4b4700 1 -- 172.21.15.6:0/1956312801 shutdown_connections 2023-10-06T02:18:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.191+0000 7fdfbc4b4700 1 -- 172.21.15.6:0/1956312801 wait complete. 2023-10-06T02:18:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.192+0000 7fdfbc4b4700 1 Processor -- start 2023-10-06T02:18:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.192+0000 7fdfbc4b4700 1 -- start start 2023-10-06T02:18:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfbc4b4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfb40af4e0 0x7fdfb40a8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfbc4b4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfb40af8b0 0x7fdfb40a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfbc4b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb415d460 0x7fdfb414b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfbc4b4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40c7300 con 0x7fdfb415d460 2023-10-06T02:18:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfbc4b4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb415a1b0 con 0x7fdfb40af8b0 2023-10-06T02:18:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfbc4b4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40a77e0 con 0x7fdfb40af4e0 2023-10-06T02:18:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfbaa51700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb415d460 0x7fdfb414b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfbaa51700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb415d460 0x7fdfb414b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55786/0 (socket says 172.21.15.6:55786) 2023-10-06T02:18:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfbaa51700 1 -- 172.21.15.6:0/4755339 learned_addr learned my addr 172.21.15.6:0/4755339 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfba250700 1 --2- 172.21.15.6:0/4755339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfb40af4e0 0x7fdfb40a8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfb9a4f700 1 --2- 172.21.15.6:0/4755339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfb40af8b0 0x7fdfb40a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfbaa51700 1 -- 172.21.15.6:0/4755339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfb40af4e0 msgr2=0x7fdfb40a8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfbaa51700 1 --2- 172.21.15.6:0/4755339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfb40af4e0 0x7fdfb40a8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfbaa51700 1 -- 172.21.15.6:0/4755339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfb40af8b0 msgr2=0x7fdfb40a6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfbaa51700 1 --2- 172.21.15.6:0/4755339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfb40af8b0 0x7fdfb40a6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfbaa51700 1 -- 172.21.15.6:0/4755339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac0094f0 con 0x7fdfb415d460 2023-10-06T02:18:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfbaa51700 1 --2- 172.21.15.6:0/4755339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb415d460 0x7fdfb414b450 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4007f20 tx=0x7fdfa4009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfb27fc700 1 -- 172.21.15.6:0/4755339 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa400eb90 con 0x7fdfb415d460 2023-10-06T02:18:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfb27fc700 1 -- 172.21.15.6:0/4755339 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa400ed10 con 0x7fdfb415d460 2023-10-06T02:18:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfbc4b4700 1 -- 172.21.15.6:0/4755339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb40a7ac0 con 0x7fdfb415d460 2023-10-06T02:18:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfb27fc700 1 -- 172.21.15.6:0/4755339 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4014670 con 0x7fdfb415d460 2023-10-06T02:18:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.193+0000 7fdfbc4b4700 1 -- 172.21.15.6:0/4755339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb40a8080 con 0x7fdfb415d460 2023-10-06T02:18:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.194+0000 7fdfbc4b4700 1 -- 172.21.15.6:0/4755339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb40c74b0 con 0x7fdfb415d460 2023-10-06T02:18:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.195+0000 7fdfb27fc700 1 -- 172.21.15.6:0/4755339 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfa40149e0 con 0x7fdfb415d460 2023-10-06T02:18:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.195+0000 7fdfb27fc700 1 --2- 172.21.15.6:0/4755339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdfa0066f30 0x7fdfa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.195+0000 7fdfb27fc700 1 -- 172.21.15.6:0/4755339 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdfa4084f00 con 0x7fdfb415d460 2023-10-06T02:18:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.195+0000 7fdfba250700 1 --2- 172.21.15.6:0/4755339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdfa0066f30 0x7fdfa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.196+0000 7fdfba250700 1 --2- 172.21.15.6:0/4755339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdfa0066f30 0x7fdfa00693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40b63b0 tx=0x7fdfac017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.199+0000 7fdfb27fc700 1 -- 172.21.15.6:0/4755339 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfb40c74b0 con 0x7fdfb415d460 2023-10-06T02:18:19.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.395+0000 7fdfbc4b4700 1 -- 172.21.15.6:0/4755339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfb40c74b0 con 0x7fdfb415d460 2023-10-06T02:18:19.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.396+0000 7fdfb27fc700 1 -- 172.21.15.6:0/4755339 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fdfb40c74b0 con 0x7fdfb415d460 2023-10-06T02:18:19.397 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:19.397 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:48.453046+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:18:19.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.398+0000 7fdfbc4b4700 1 -- 172.21.15.6:0/4755339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdfa0066f30 msgr2=0x7fdfa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:19.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.398+0000 7fdfbc4b4700 1 --2- 172.21.15.6:0/4755339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdfa0066f30 0x7fdfa00693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40b63b0 tx=0x7fdfac017000 comp rx=0 tx=0).stop 2023-10-06T02:18:19.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.398+0000 7fdfbc4b4700 1 -- 172.21.15.6:0/4755339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb415d460 msgr2=0x7fdfb414b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:19.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.398+0000 7fdfbc4b4700 1 --2- 172.21.15.6:0/4755339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb415d460 0x7fdfb414b450 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4007f20 tx=0x7fdfa4009860 comp rx=0 tx=0).stop 2023-10-06T02:18:19.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.398+0000 7fdfbc4b4700 1 -- 172.21.15.6:0/4755339 shutdown_connections 2023-10-06T02:18:19.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.398+0000 7fdfbc4b4700 1 --2- 172.21.15.6:0/4755339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdfa0066f30 0x7fdfa00693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.398+0000 7fdfbc4b4700 1 --2- 172.21.15.6:0/4755339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb415d460 0x7fdfb414b450 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.398+0000 7fdfbc4b4700 1 --2- 172.21.15.6:0/4755339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfb40af4e0 0x7fdfb40a8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.398+0000 7fdfbc4b4700 1 --2- 172.21.15.6:0/4755339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfb40af8b0 0x7fdfb40a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.398+0000 7fdfbc4b4700 1 -- 172.21.15.6:0/4755339 >> 172.21.15.6:0/4755339 conn(0x7fdfb4068680 msgr2=0x7fdfb40b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:19.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.398+0000 7fdfbc4b4700 1 -- 172.21.15.6:0/4755339 shutdown_connections 2023-10-06T02:18:19.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.398+0000 7fdfbc4b4700 1 -- 172.21.15.6:0/4755339 wait complete. 2023-10-06T02:18:19.411 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:17:41.126402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:17:42.378468+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T02:17:46.053654+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:18:19.412 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:18:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.532+0000 7f1b40e27700 1 Processor -- start 2023-10-06T02:18:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.532+0000 7f1b40e27700 1 -- start start 2023-10-06T02:18:19.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.533+0000 7f1b40e27700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1b3c06a380 0x7f1b3c0cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.533+0000 7f1b40e27700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1b3c06a750 0x7f1b3c15d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.533+0000 7f1b40e27700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c0cae80 con 0x7f1b3c15d770 2023-10-06T02:18:19.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.533+0000 7f1b40e27700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3c0cc3d0 con 0x7f1b3c06a380 2023-10-06T02:18:19.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.533+0000 7f1b40e27700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3c15dcd0 con 0x7f1b3c06a750 2023-10-06T02:18:19.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.534+0000 7f1b3a59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1b3c06a380 0x7f1b3c0cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.534+0000 7f1b3ad9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1b3c15d770 0x7f1b3c159170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45668/0 (socket says 172.21.15.6:45668) 2023-10-06T02:18:19.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.534+0000 7f1b3ad9d700 1 -- 172.21.15.6:0/740257580 learned_addr learned my addr 172.21.15.6:0/740257580 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:19.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.534+0000 7f1b39d9b700 1 --2- 172.21.15.6:0/740257580 >> v2:172.21.15.175:3300/0 conn(0x7f1b3c06a750 0x7f1b3c15d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.534+0000 7f1b3a59c700 1 -- 172.21.15.6:0/740257580 >> v2:172.21.15.175:3300/0 conn(0x7f1b3c06a750 msgr2=0x7f1b3c15d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:19.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.534+0000 7f1b3a59c700 1 --2- 172.21.15.6:0/740257580 >> v2:172.21.15.175:3300/0 conn(0x7f1b3c06a750 0x7f1b3c15d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.534+0000 7f1b3a59c700 1 -- 172.21.15.6:0/740257580 >> v1:172.21.15.6:6789/0 conn(0x7f1b3c15d770 legacy=0x7f1b3c159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:19.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.534+0000 7f1b3a59c700 1 -- 172.21.15.6:0/740257580 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c15dfb0 con 0x7f1b3c06a380 2023-10-06T02:18:19.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.534+0000 7f1b3959a700 1 -- 172.21.15.6:0/740257580 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1552492707 0 0) 0x7f1b3c0cae80 con 0x7f1b3c15d770 2023-10-06T02:18:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.534+0000 7f1b39d9b700 1 --2- 172.21.15.6:0/740257580 >> v2:172.21.15.175:3300/0 conn(0x7f1b3c06a750 0x7f1b3c15d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.534+0000 7f1b3a59c700 1 --2- 172.21.15.6:0/740257580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c06a380 0x7f1b3c0cb310 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c06b670 tx=0x7f1b340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32705589103e8ba3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.534+0000 7f1b3959a700 1 -- 172.21.15.6:0/740257580 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3400b6b0 con 0x7f1b3c06a380 2023-10-06T02:18:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.534+0000 7f1b3959a700 1 -- 172.21.15.6:0/740257580 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3400b810 con 0x7f1b3c06a380 2023-10-06T02:18:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.534+0000 7f1b3959a700 1 -- 172.21.15.6:0/740257580 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3400bbb0 con 0x7f1b3c06a380 2023-10-06T02:18:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.535+0000 7f1b40e27700 1 -- 172.21.15.6:0/740257580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c06a380 msgr2=0x7f1b3c0cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.535+0000 7f1b40e27700 1 --2- 172.21.15.6:0/740257580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c06a380 0x7f1b3c0cb310 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c06b670 tx=0x7f1b340091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.535+0000 7f1b40e27700 1 -- 172.21.15.6:0/740257580 shutdown_connections 2023-10-06T02:18:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.535+0000 7f1b40e27700 1 --2- 172.21.15.6:0/740257580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c06a380 0x7f1b3c0cb310 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.535+0000 7f1b40e27700 1 --2- 172.21.15.6:0/740257580 >> v2:172.21.15.175:3300/0 conn(0x7f1b3c06a750 0x7f1b3c15d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.535+0000 7f1b40e27700 1 -- 172.21.15.6:0/740257580 >> 172.21.15.6:0/740257580 conn(0x7f1b3c0d0350 msgr2=0x7f1b3c0d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.535+0000 7f1b40e27700 1 -- 172.21.15.6:0/740257580 shutdown_connections 2023-10-06T02:18:19.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.535+0000 7f1b40e27700 1 -- 172.21.15.6:0/740257580 wait complete. 2023-10-06T02:18:19.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.536+0000 7f1b40e27700 1 Processor -- start 2023-10-06T02:18:19.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.536+0000 7f1b40e27700 1 -- start start 2023-10-06T02:18:19.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b40e27700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c06a380 0x7f1b3c0b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b40e27700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1b3c06a750 0x7f1b3c15a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b40e27700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c15d770 0x7f1b3c15a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b40e27700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0b3da0 con 0x7f1b3c15d770 2023-10-06T02:18:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b40e27700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0b3190 con 0x7f1b3c06a380 2023-10-06T02:18:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b40e27700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0b3470 con 0x7f1b3c06a750 2023-10-06T02:18:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b3ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c15d770 0x7f1b3c15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b3ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c15d770 0x7f1b3c15a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55814/0 (socket says 172.21.15.6:55814) 2023-10-06T02:18:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b3ad9d700 1 -- 172.21.15.6:0/3623153600 learned_addr learned my addr 172.21.15.6:0/3623153600 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b39d9b700 1 --2- 172.21.15.6:0/3623153600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1b3c06a750 0x7f1b3c15a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b3a59c700 1 --2- 172.21.15.6:0/3623153600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c06a380 0x7f1b3c0b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b3ad9d700 1 -- 172.21.15.6:0/3623153600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1b3c06a750 msgr2=0x7f1b3c15a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b3ad9d700 1 --2- 172.21.15.6:0/3623153600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1b3c06a750 0x7f1b3c15a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b3ad9d700 1 -- 172.21.15.6:0/3623153600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c06a380 msgr2=0x7f1b3c0b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b3ad9d700 1 --2- 172.21.15.6:0/3623153600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c06a380 0x7f1b3c0b4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b3ad9d700 1 -- 172.21.15.6:0/3623153600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b34009420 con 0x7f1b3c15d770 2023-10-06T02:18:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b39d9b700 1 --2- 172.21.15.6:0/3623153600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1b3c06a750 0x7f1b3c15a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b3ad9d700 1 --2- 172.21.15.6:0/3623153600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c15d770 0x7f1b3c15a810 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00cbf0 tx=0x7f1b2c0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b327fc700 1 -- 172.21.15.6:0/3623153600 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c00a9c0 con 0x7f1b3c15d770 2023-10-06T02:18:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b327fc700 1 -- 172.21.15.6:0/3623153600 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c00ab20 con 0x7f1b3c15d770 2023-10-06T02:18:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b40e27700 1 -- 172.21.15.6:0/3623153600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c0b3750 con 0x7f1b3c15d770 2023-10-06T02:18:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b327fc700 1 -- 172.21.15.6:0/3623153600 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0070f0 con 0x7f1b3c15d770 2023-10-06T02:18:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.537+0000 7f1b40e27700 1 -- 172.21.15.6:0/3623153600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3c1544f0 con 0x7f1b3c15d770 2023-10-06T02:18:19.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.538+0000 7f1b40e27700 1 -- 172.21.15.6:0/3623153600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3c088a40 con 0x7f1b3c15d770 2023-10-06T02:18:19.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.539+0000 7f1b327fc700 1 -- 172.21.15.6:0/3623153600 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b2c007520 con 0x7f1b3c15d770 2023-10-06T02:18:19.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.539+0000 7f1b327fc700 1 --2- 172.21.15.6:0/3623153600 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1b1c066f30 0x7f1b1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.539+0000 7f1b327fc700 1 -- 172.21.15.6:0/3623153600 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1b2c084dd0 con 0x7f1b3c15d770 2023-10-06T02:18:19.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.539+0000 7f1b3a59c700 1 --2- 172.21.15.6:0/3623153600 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1b1c066f30 0x7f1b1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.540+0000 7f1b3a59c700 1 --2- 172.21.15.6:0/3623153600 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1b1c066f30 0x7f1b1c0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1b34003080 tx=0x7f1b34017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:19.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.543+0000 7f1b327fc700 1 -- 172.21.15.6:0/3623153600 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b2c051c70 con 0x7f1b3c15d770 2023-10-06T02:18:19.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.738+0000 7f1b40e27700 1 -- 172.21.15.6:0/3623153600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1b3c0b3ee0 con 0x7f1b3c15d770 2023-10-06T02:18:19.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.738+0000 7f1b327fc700 1 -- 172.21.15.6:0/3623153600 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1b2c086020 con 0x7f1b3c15d770 2023-10-06T02:18:19.740 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:18:19.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.740+0000 7f1b40e27700 1 -- 172.21.15.6:0/3623153600 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1b1c066f30 msgr2=0x7f1b1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:19.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.740+0000 7f1b40e27700 1 --2- 172.21.15.6:0/3623153600 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1b1c066f30 0x7f1b1c0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1b34003080 tx=0x7f1b34017000 comp rx=0 tx=0).stop 2023-10-06T02:18:19.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.740+0000 7f1b40e27700 1 -- 172.21.15.6:0/3623153600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c15d770 msgr2=0x7f1b3c15a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:19.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.740+0000 7f1b40e27700 1 --2- 172.21.15.6:0/3623153600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c15d770 0x7f1b3c15a810 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00cbf0 tx=0x7f1b2c0019b0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.740+0000 7f1b40e27700 1 -- 172.21.15.6:0/3623153600 shutdown_connections 2023-10-06T02:18:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.740+0000 7f1b40e27700 1 --2- 172.21.15.6:0/3623153600 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1b1c066f30 0x7f1b1c0693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.740+0000 7f1b40e27700 1 --2- 172.21.15.6:0/3623153600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c15d770 0x7f1b3c15a810 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.740+0000 7f1b40e27700 1 --2- 172.21.15.6:0/3623153600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c06a380 0x7f1b3c0b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.740+0000 7f1b40e27700 1 --2- 172.21.15.6:0/3623153600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1b3c06a750 0x7f1b3c15a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.740+0000 7f1b40e27700 1 -- 172.21.15.6:0/3623153600 >> 172.21.15.6:0/3623153600 conn(0x7f1b3c0d0350 msgr2=0x7f1b3c1560e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.740+0000 7f1b40e27700 1 -- 172.21.15.6:0/3623153600 shutdown_connections 2023-10-06T02:18:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.740+0000 7f1b40e27700 1 -- 172.21.15.6:0/3623153600 wait complete. 2023-10-06T02:18:19.753 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:18:19.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.874+0000 7fd2c4ca8700 1 Processor -- start 2023-10-06T02:18:19.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.874+0000 7fd2c4ca8700 1 -- start start 2023-10-06T02:18:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.875+0000 7fd2c4ca8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2c00cd7d0 0x7fd2c00d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.875+0000 7fd2c4ca8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2c00b0810 0x7fd2c00d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.875+0000 7fd2c4ca8700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c00d0c20 con 0x7fd2c00cd400 2023-10-06T02:18:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.875+0000 7fd2c4ca8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c00af770 con 0x7fd2c00b0810 2023-10-06T02:18:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.875+0000 7fd2c4ca8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c00afa50 con 0x7fd2c00cd7d0 2023-10-06T02:18:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.875+0000 7fd2bffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2c00b0810 0x7fd2c00d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.875+0000 7fd2bffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2c00b0810 0x7fd2c00d06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55826/0 (socket says 172.21.15.6:55826) 2023-10-06T02:18:19.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.875+0000 7fd2bffff700 1 -- 172.21.15.6:0/1472346014 learned_addr learned my addr 172.21.15.6:0/1472346014 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:19.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.876+0000 7fd2beffd700 1 --2- 172.21.15.6:0/1472346014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2c00cd7d0 0x7fd2c00d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.876+0000 7fd2bffff700 1 -- 172.21.15.6:0/1472346014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2c00cd7d0 msgr2=0x7fd2c00d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:19.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.876+0000 7fd2bffff700 1 --2- 172.21.15.6:0/1472346014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2c00cd7d0 0x7fd2c00d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.876+0000 7fd2bffff700 1 -- 172.21.15.6:0/1472346014 >> v1:172.21.15.175:6789/0 conn(0x7fd2c00cd400 legacy=0x7fd2c00b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:19.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.876+0000 7fd2bffff700 1 -- 172.21.15.6:0/1472346014 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c00afd30 con 0x7fd2c00b0810 2023-10-06T02:18:19.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.876+0000 7fd2bffff700 1 --2- 172.21.15.6:0/1472346014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2c00b0810 0x7fd2c00d06e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8009f20 tx=0x7fd2b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943d9276dbc19f00 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:19.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.876+0000 7fd2be7fc700 1 -- 172.21.15.6:0/1472346014 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b800e070 con 0x7fd2c00b0810 2023-10-06T02:18:19.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.876+0000 7fd2be7fc700 1 -- 172.21.15.6:0/1472346014 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b800ba80 con 0x7fd2c00b0810 2023-10-06T02:18:19.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.876+0000 7fd2be7fc700 1 -- 172.21.15.6:0/1472346014 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b80092e0 con 0x7fd2c00b0810 2023-10-06T02:18:19.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.877+0000 7fd2c4ca8700 1 -- 172.21.15.6:0/1472346014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2c00b0810 msgr2=0x7fd2c00d06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:19.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.877+0000 7fd2c4ca8700 1 --2- 172.21.15.6:0/1472346014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2c00b0810 0x7fd2c00d06e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8009f20 tx=0x7fd2b8009840 comp rx=0 tx=0).stop 2023-10-06T02:18:19.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.877+0000 7fd2c4ca8700 1 -- 172.21.15.6:0/1472346014 shutdown_connections 2023-10-06T02:18:19.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.877+0000 7fd2c4ca8700 1 --2- 172.21.15.6:0/1472346014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2c00b0810 0x7fd2c00d06e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.877+0000 7fd2c4ca8700 1 --2- 172.21.15.6:0/1472346014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2c00cd7d0 0x7fd2c00d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.877+0000 7fd2c4ca8700 1 -- 172.21.15.6:0/1472346014 >> 172.21.15.6:0/1472346014 conn(0x7fd2c006a110 msgr2=0x7fd2c006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:19.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.877+0000 7fd2c4ca8700 1 -- 172.21.15.6:0/1472346014 shutdown_connections 2023-10-06T02:18:19.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.877+0000 7fd2c4ca8700 1 -- 172.21.15.6:0/1472346014 wait complete. 2023-10-06T02:18:19.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.878+0000 7fd2c4ca8700 1 Processor -- start 2023-10-06T02:18:19.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.878+0000 7fd2c4ca8700 1 -- start start 2023-10-06T02:18:19.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2c4ca8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2c00b0810 0x7fd2c00cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2c4ca8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2c00cd400 0x7fd2c00c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2c4ca8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c00cc580 0x7fd2c0148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2c4ca8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c0159830 con 0x7fd2c00b0810 2023-10-06T02:18:19.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2c4ca8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c0148a90 con 0x7fd2c00cc580 2023-10-06T02:18:19.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2c4ca8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c00cb3d0 con 0x7fd2c00cd400 2023-10-06T02:18:19.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2bf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2c00b0810 0x7fd2c00cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2bf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2c00b0810 0x7fd2c00cadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55836/0 (socket says 172.21.15.6:55836) 2023-10-06T02:18:19.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2bf7fe700 1 -- 172.21.15.6:0/1626527685 learned_addr learned my addr 172.21.15.6:0/1626527685 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:19.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2bffff700 1 --2- 172.21.15.6:0/1626527685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c00cc580 0x7fd2c0148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2beffd700 1 --2- 172.21.15.6:0/1626527685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2c00cd400 0x7fd2c00c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2bf7fe700 1 -- 172.21.15.6:0/1626527685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2c00cd400 msgr2=0x7fd2c00c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:19.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2bf7fe700 1 --2- 172.21.15.6:0/1626527685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2c00cd400 0x7fd2c00c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2bf7fe700 1 -- 172.21.15.6:0/1626527685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c00cc580 msgr2=0x7fd2c0148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:19.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2bf7fe700 1 --2- 172.21.15.6:0/1626527685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c00cc580 0x7fd2c0148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:19.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2bf7fe700 1 -- 172.21.15.6:0/1626527685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b8009ae0 con 0x7fd2c00b0810 2023-10-06T02:18:19.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2bf7fe700 1 --2- 172.21.15.6:0/1626527685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2c00b0810 0x7fd2c00cadf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000c7c0 tx=0x7fd2b0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:19.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2a77fe700 1 -- 172.21.15.6:0/1626527685 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0011590 con 0x7fd2c00b0810 2023-10-06T02:18:19.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2a77fe700 1 -- 172.21.15.6:0/1626527685 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b00116f0 con 0x7fd2c00b0810 2023-10-06T02:18:19.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2c4ca8700 1 -- 172.21.15.6:0/1626527685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c00cb6b0 con 0x7fd2c00b0810 2023-10-06T02:18:19.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2a77fe700 1 -- 172.21.15.6:0/1626527685 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0011ab0 con 0x7fd2c00b0810 2023-10-06T02:18:19.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.879+0000 7fd2c4ca8700 1 -- 172.21.15.6:0/1626527685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c00cbc70 con 0x7fd2c00b0810 2023-10-06T02:18:19.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.880+0000 7fd2c4ca8700 1 -- 172.21.15.6:0/1626527685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c0064aa0 con 0x7fd2c00b0810 2023-10-06T02:18:19.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.881+0000 7fd2a77fe700 1 -- 172.21.15.6:0/1626527685 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2b001b3b0 con 0x7fd2c00b0810 2023-10-06T02:18:19.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.881+0000 7fd2a77fe700 1 --2- 172.21.15.6:0/1626527685 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd2ac066f30 0x7fd2ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:19.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.881+0000 7fd2a77fe700 1 -- 172.21.15.6:0/1626527685 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd2b0083d40 con 0x7fd2c00b0810 2023-10-06T02:18:19.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.881+0000 7fd2beffd700 1 --2- 172.21.15.6:0/1626527685 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd2ac066f30 0x7fd2ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:19.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.882+0000 7fd2beffd700 1 --2- 172.21.15.6:0/1626527685 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd2ac066f30 0x7fd2ac0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd2c016c9e0 tx=0x7fd2b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:19.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:19.886+0000 7fd2a77fe700 1 -- 172.21.15.6:0/1626527685 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2b0050c10 con 0x7fd2c00b0810 2023-10-06T02:18:20.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.085+0000 7fd2c4ca8700 1 -- 172.21.15.6:0/1626527685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2c00b0010 con 0x7fd2c00b0810 2023-10-06T02:18:20.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.085+0000 7fd2a77fe700 1 -- 172.21.15.6:0/1626527685 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2b0017070 con 0x7fd2c00b0810 2023-10-06T02:18:20.087 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:18:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.087+0000 7fd2c4ca8700 1 -- 172.21.15.6:0/1626527685 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd2ac066f30 msgr2=0x7fd2ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.087+0000 7fd2c4ca8700 1 --2- 172.21.15.6:0/1626527685 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd2ac066f30 0x7fd2ac0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd2c016c9e0 tx=0x7fd2b4008040 comp rx=0 tx=0).stop 2023-10-06T02:18:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.087+0000 7fd2c4ca8700 1 -- 172.21.15.6:0/1626527685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2c00b0810 msgr2=0x7fd2c00cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.087+0000 7fd2c4ca8700 1 --2- 172.21.15.6:0/1626527685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2c00b0810 0x7fd2c00cadf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000c7c0 tx=0x7fd2b0007f70 comp rx=0 tx=0).stop 2023-10-06T02:18:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.087+0000 7fd2c4ca8700 1 -- 172.21.15.6:0/1626527685 shutdown_connections 2023-10-06T02:18:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.087+0000 7fd2c4ca8700 1 --2- 172.21.15.6:0/1626527685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c00cc580 0x7fd2c0148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.087+0000 7fd2c4ca8700 1 --2- 172.21.15.6:0/1626527685 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd2ac066f30 0x7fd2ac0693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.087+0000 7fd2c4ca8700 1 --2- 172.21.15.6:0/1626527685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2c00b0810 0x7fd2c00cadf0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.087+0000 7fd2c4ca8700 1 --2- 172.21.15.6:0/1626527685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2c00cd400 0x7fd2c00c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.087+0000 7fd2c4ca8700 1 -- 172.21.15.6:0/1626527685 >> 172.21.15.6:0/1626527685 conn(0x7fd2c006a110 msgr2=0x7fd2c00b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:20.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.087+0000 7fd2c4ca8700 1 -- 172.21.15.6:0/1626527685 shutdown_connections 2023-10-06T02:18:20.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.087+0000 7fd2c4ca8700 1 -- 172.21.15.6:0/1626527685 wait complete. 2023-10-06T02:18:20.100 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:18:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.221+0000 7ff7f61a7700 1 Processor -- start 2023-10-06T02:18:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.221+0000 7ff7f61a7700 1 -- start start 2023-10-06T02:18:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.222+0000 7ff7f61a7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7f01592b0 0x7ff7f00afc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.222+0000 7ff7f61a7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7f0068680 0x7ff7f0068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.222+0000 7ff7f61a7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f00ada50 con 0x7ff7f00af390 2023-10-06T02:18:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.222+0000 7ff7f61a7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f00b2cc0 con 0x7ff7f01592b0 2023-10-06T02:18:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.222+0000 7ff7f61a7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f0069040 con 0x7ff7f0068680 2023-10-06T02:18:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.222+0000 7ff7f51a5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7f01592b0 0x7ff7f00afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.222+0000 7ff7f51a5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7f01592b0 0x7ff7f00afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55852/0 (socket says 172.21.15.6:55852) 2023-10-06T02:18:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.222+0000 7ff7f51a5700 1 -- 172.21.15.6:0/3158350079 learned_addr learned my addr 172.21.15.6:0/3158350079 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.223+0000 7ff7f59a6700 1 --2- 172.21.15.6:0/3158350079 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7f0068680 0x7ff7f0068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.223+0000 7ff7f51a5700 1 -- 172.21.15.6:0/3158350079 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7f0068680 msgr2=0x7ff7f0068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.223+0000 7ff7f51a5700 1 --2- 172.21.15.6:0/3158350079 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7f0068680 0x7ff7f0068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.223+0000 7ff7f51a5700 1 -- 172.21.15.6:0/3158350079 >> v1:172.21.15.175:6789/0 conn(0x7ff7f00af390 legacy=0x7ff7f0159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:20.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.223+0000 7ff7f51a5700 1 -- 172.21.15.6:0/3158350079 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f00af800 con 0x7ff7f01592b0 2023-10-06T02:18:20.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.223+0000 7ff7f51a5700 1 --2- 172.21.15.6:0/3158350079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f01592b0 0x7ff7f00afc10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009f50 tx=0x7ff7e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29502f0af940e7db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:20.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.223+0000 7ff7effff700 1 -- 172.21.15.6:0/3158350079 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e000e070 con 0x7ff7f01592b0 2023-10-06T02:18:20.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.223+0000 7ff7effff700 1 -- 172.21.15.6:0/3158350079 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e000ba70 con 0x7ff7f01592b0 2023-10-06T02:18:20.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.223+0000 7ff7effff700 1 -- 172.21.15.6:0/3158350079 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00092e0 con 0x7ff7f01592b0 2023-10-06T02:18:20.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.223+0000 7ff7f61a7700 1 -- 172.21.15.6:0/3158350079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f01592b0 msgr2=0x7ff7f00afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:20.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.223+0000 7ff7f61a7700 1 --2- 172.21.15.6:0/3158350079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f01592b0 0x7ff7f00afc10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009f50 tx=0x7ff7e0009840 comp rx=0 tx=0).stop 2023-10-06T02:18:20.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.224+0000 7ff7f61a7700 1 -- 172.21.15.6:0/3158350079 shutdown_connections 2023-10-06T02:18:20.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.224+0000 7ff7f61a7700 1 --2- 172.21.15.6:0/3158350079 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7f0068680 0x7ff7f0068b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.224+0000 7ff7f61a7700 1 --2- 172.21.15.6:0/3158350079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f01592b0 0x7ff7f00afc10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.224+0000 7ff7f61a7700 1 -- 172.21.15.6:0/3158350079 >> 172.21.15.6:0/3158350079 conn(0x7ff7f0096200 msgr2=0x7ff7f0069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.224+0000 7ff7f61a7700 1 -- 172.21.15.6:0/3158350079 shutdown_connections 2023-10-06T02:18:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.224+0000 7ff7f61a7700 1 -- 172.21.15.6:0/3158350079 wait complete. 2023-10-06T02:18:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.225+0000 7ff7f61a7700 1 Processor -- start 2023-10-06T02:18:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.225+0000 7ff7f61a7700 1 -- start start 2023-10-06T02:18:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f61a7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f0068680 0x7ff7f00c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f61a7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f00af390 0x7ff7f0155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f61a7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7f01592b0 0x7ff7f0098bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f61a7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f016a290 con 0x7ff7f00af390 2023-10-06T02:18:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f61a7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00c4920 con 0x7ff7f0068680 2023-10-06T02:18:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f61a7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f016a480 con 0x7ff7f01592b0 2023-10-06T02:18:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f49a4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f00af390 0x7ff7f0155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f49a4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f00af390 0x7ff7f0155f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55856/0 (socket says 172.21.15.6:55856) 2023-10-06T02:18:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f49a4700 1 -- 172.21.15.6:0/3679549632 learned_addr learned my addr 172.21.15.6:0/3679549632 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f51a5700 1 --2- 172.21.15.6:0/3679549632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f0068680 0x7ff7f00c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f59a6700 1 --2- 172.21.15.6:0/3679549632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7f01592b0 0x7ff7f0098bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f49a4700 1 -- 172.21.15.6:0/3679549632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7f01592b0 msgr2=0x7ff7f0098bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f49a4700 1 --2- 172.21.15.6:0/3679549632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7f01592b0 0x7ff7f0098bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f49a4700 1 -- 172.21.15.6:0/3679549632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f0068680 msgr2=0x7ff7f00c2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f49a4700 1 --2- 172.21.15.6:0/3679549632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f0068680 0x7ff7f00c2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f49a4700 1 -- 172.21.15.6:0/3679549632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e0009ae0 con 0x7ff7f00af390 2023-10-06T02:18:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f49a4700 1 --2- 172.21.15.6:0/3679549632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f00af390 0x7ff7f0155f30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c5c0 tx=0x7ff7e400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7ed7fa700 1 -- 172.21.15.6:0/3679549632 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4011590 con 0x7ff7f00af390 2023-10-06T02:18:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7ed7fa700 1 -- 172.21.15.6:0/3679549632 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e4011710 con 0x7ff7f00af390 2023-10-06T02:18:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f61a7700 1 -- 172.21.15.6:0/3679549632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f00c4b90 con 0x7ff7f00af390 2023-10-06T02:18:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7ed7fa700 1 -- 172.21.15.6:0/3679549632 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4011ad0 con 0x7ff7f00af390 2023-10-06T02:18:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.226+0000 7ff7f61a7700 1 -- 172.21.15.6:0/3679549632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f0156470 con 0x7ff7f00af390 2023-10-06T02:18:20.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.227+0000 7ff7f61a7700 1 -- 172.21.15.6:0/3679549632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f00c50b0 con 0x7ff7f00af390 2023-10-06T02:18:20.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.228+0000 7ff7ed7fa700 1 -- 172.21.15.6:0/3679549632 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7e401b3b0 con 0x7ff7f00af390 2023-10-06T02:18:20.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.228+0000 7ff7ed7fa700 1 --2- 172.21.15.6:0/3679549632 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff7dc066f30 0x7ff7dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.228+0000 7ff7ed7fa700 1 -- 172.21.15.6:0/3679549632 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff7e4083dd0 con 0x7ff7f00af390 2023-10-06T02:18:20.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.228+0000 7ff7f51a5700 1 --2- 172.21.15.6:0/3679549632 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff7dc066f30 0x7ff7dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.229+0000 7ff7f51a5700 1 --2- 172.21.15.6:0/3679549632 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff7dc066f30 0x7ff7dc0693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009ea0 tx=0x7ff7e0018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.232+0000 7ff7ed7fa700 1 -- 172.21.15.6:0/3679549632 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7f00c50b0 con 0x7ff7f00af390 2023-10-06T02:18:20.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.425+0000 7ff7f61a7700 1 -- 172.21.15.6:0/3679549632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7f00c50b0 con 0x7ff7f00af390 2023-10-06T02:18:20.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.426+0000 7ff7ed7fa700 1 -- 172.21.15.6:0/3679549632 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff7f00c50b0 con 0x7ff7f00af390 2023-10-06T02:18:20.427 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:18:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.428+0000 7ff7f61a7700 1 -- 172.21.15.6:0/3679549632 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff7dc066f30 msgr2=0x7ff7dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.428+0000 7ff7f61a7700 1 --2- 172.21.15.6:0/3679549632 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff7dc066f30 0x7ff7dc0693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009ea0 tx=0x7ff7e0018000 comp rx=0 tx=0).stop 2023-10-06T02:18:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.428+0000 7ff7f61a7700 1 -- 172.21.15.6:0/3679549632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f00af390 msgr2=0x7ff7f0155f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.428+0000 7ff7f61a7700 1 --2- 172.21.15.6:0/3679549632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f00af390 0x7ff7f0155f30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c5c0 tx=0x7ff7e400c8d0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.428+0000 7ff7f61a7700 1 -- 172.21.15.6:0/3679549632 shutdown_connections 2023-10-06T02:18:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.428+0000 7ff7f61a7700 1 --2- 172.21.15.6:0/3679549632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7f01592b0 0x7ff7f0098bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.428+0000 7ff7f61a7700 1 --2- 172.21.15.6:0/3679549632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f0068680 0x7ff7f00c2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.428+0000 7ff7f61a7700 1 --2- 172.21.15.6:0/3679549632 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff7dc066f30 0x7ff7dc0693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.428+0000 7ff7f61a7700 1 --2- 172.21.15.6:0/3679549632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f00af390 0x7ff7f0155f30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.428+0000 7ff7f61a7700 1 -- 172.21.15.6:0/3679549632 >> 172.21.15.6:0/3679549632 conn(0x7ff7f0096200 msgr2=0x7ff7f0156fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.428+0000 7ff7f61a7700 1 -- 172.21.15.6:0/3679549632 shutdown_connections 2023-10-06T02:18:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.428+0000 7ff7f61a7700 1 -- 172.21.15.6:0/3679549632 wait complete. 2023-10-06T02:18:20.442 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:18:20.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.563+0000 7fc8dfca8700 1 Processor -- start 2023-10-06T02:18:20.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.564+0000 7fc8dfca8700 1 -- start start 2023-10-06T02:18:20.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.564+0000 7fc8dfca8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d80c7840 0x7fc8d8159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.564+0000 7fc8dfca8700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc8d806c830 0x7fc8d815da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.564+0000 7fc8dfca8700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d80c7cb0 con 0x7fc8d806c460 2023-10-06T02:18:20.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.564+0000 7fc8dfca8700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d815dfc0 con 0x7fc8d806c830 2023-10-06T02:18:20.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.564+0000 7fc8dfca8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80c7f90 con 0x7fc8d80c7840 2023-10-06T02:18:20.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.565+0000 7fc8dd243700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d80c7840 0x7fc8d8159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.565+0000 7fc8de245700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc8d806c830 0x7fc8d815da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.565+0000 7fc8dd243700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d80c7840 0x7fc8d8159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:46432/0 (socket says 172.21.15.6:46432) 2023-10-06T02:18:20.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.565+0000 7fc8dd243700 1 -- 172.21.15.6:0/957582272 learned_addr learned my addr 172.21.15.6:0/957582272 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:20.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.565+0000 7fc8dda44700 1 --1- 172.21.15.6:0/957582272 >> v1:172.21.15.175:6789/0 conn(0x7fc8d806c460 0x7fc8d8158f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:55842/0 (socket says 172.21.15.6:55842) 2023-10-06T02:18:20.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.565+0000 7fc8de245700 1 -- 172.21.15.6:0/957582272 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d80c7840 msgr2=0x7fc8d8159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:20.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.565+0000 7fc8de245700 1 --2- 172.21.15.6:0/957582272 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d80c7840 0x7fc8d8159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.565+0000 7fc8de245700 1 -- 172.21.15.6:0/957582272 >> v1:172.21.15.175:6789/0 conn(0x7fc8d806c460 legacy=0x7fc8d8158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.565+0000 7fc8de245700 1 -- 172.21.15.6:0/957582272 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d80c8270 con 0x7fc8d806c830 2023-10-06T02:18:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.565+0000 7fc8dca42700 1 -- 172.21.15.6:0/957582272 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166083211 0 0) 0x7fc8d80c7cb0 con 0x7fc8d806c460 2023-10-06T02:18:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.565+0000 7fc8de245700 1 --2- 172.21.15.6:0/957582272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d806c830 0x7fc8d815da80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8009e60 tx=0x7fc8c8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b119a2ed4ff0931 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.565+0000 7fc8dca42700 1 -- 172.21.15.6:0/957582272 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c800e070 con 0x7fc8d806c830 2023-10-06T02:18:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.565+0000 7fc8dca42700 1 -- 172.21.15.6:0/957582272 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c800bb60 con 0x7fc8d806c830 2023-10-06T02:18:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.565+0000 7fc8dca42700 1 -- 172.21.15.6:0/957582272 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8012430 con 0x7fc8d806c830 2023-10-06T02:18:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.566+0000 7fc8dfca8700 1 -- 172.21.15.6:0/957582272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d806c830 msgr2=0x7fc8d815da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.566+0000 7fc8dfca8700 1 --2- 172.21.15.6:0/957582272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d806c830 0x7fc8d815da80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8009e60 tx=0x7fc8c8009780 comp rx=0 tx=0).stop 2023-10-06T02:18:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.566+0000 7fc8dfca8700 1 -- 172.21.15.6:0/957582272 shutdown_connections 2023-10-06T02:18:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.566+0000 7fc8dfca8700 1 --2- 172.21.15.6:0/957582272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d806c830 0x7fc8d815da80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.566+0000 7fc8dfca8700 1 --2- 172.21.15.6:0/957582272 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d80c7840 0x7fc8d8159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.566+0000 7fc8dfca8700 1 -- 172.21.15.6:0/957582272 >> 172.21.15.6:0/957582272 conn(0x7fc8d80c9cc0 msgr2=0x7fc8d806acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.566+0000 7fc8dfca8700 1 -- 172.21.15.6:0/957582272 shutdown_connections 2023-10-06T02:18:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.566+0000 7fc8dfca8700 1 -- 172.21.15.6:0/957582272 wait complete. 2023-10-06T02:18:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.567+0000 7fc8dfca8700 1 Processor -- start 2023-10-06T02:18:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.567+0000 7fc8dfca8700 1 -- start start 2023-10-06T02:18:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.568+0000 7fc8dfca8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d806c460 0x7fc8d815b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.568+0000 7fc8dfca8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8d806c830 0x7fc8d8149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.568+0000 7fc8dfca8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d80c7840 0x7fc8d80b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.568+0000 7fc8dfca8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d815c550 con 0x7fc8d806c830 2023-10-06T02:18:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.568+0000 7fc8dfca8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d815b940 con 0x7fc8d80c7840 2023-10-06T02:18:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.568+0000 7fc8dfca8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d815bc20 con 0x7fc8d806c460 2023-10-06T02:18:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.568+0000 7fc8dd243700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8d806c830 0x7fc8d8149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.568+0000 7fc8dd243700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8d806c830 0x7fc8d8149140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55862/0 (socket says 172.21.15.6:55862) 2023-10-06T02:18:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.568+0000 7fc8dd243700 1 -- 172.21.15.6:0/2554575856 learned_addr learned my addr 172.21.15.6:0/2554575856 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.568+0000 7fc8dda44700 1 --2- 172.21.15.6:0/2554575856 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d806c460 0x7fc8d815b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.568+0000 7fc8de245700 1 --2- 172.21.15.6:0/2554575856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d80c7840 0x7fc8d80b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.568+0000 7fc8dd243700 1 -- 172.21.15.6:0/2554575856 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d806c460 msgr2=0x7fc8d815b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.568+0000 7fc8dd243700 1 --2- 172.21.15.6:0/2554575856 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d806c460 0x7fc8d815b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.568+0000 7fc8dd243700 1 -- 172.21.15.6:0/2554575856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d80c7840 msgr2=0x7fc8d80b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.568+0000 7fc8dd243700 1 --2- 172.21.15.6:0/2554575856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d80c7840 0x7fc8d80b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.568+0000 7fc8dd243700 1 -- 172.21.15.6:0/2554575856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c8009a20 con 0x7fc8d806c830 2023-10-06T02:18:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.569+0000 7fc8dd243700 1 --2- 172.21.15.6:0/2554575856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8d806c830 0x7fc8d8149140 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00e980 tx=0x7fc8cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.569+0000 7fc8d5ffb700 1 -- 172.21.15.6:0/2554575856 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc013680 con 0x7fc8d806c830 2023-10-06T02:18:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.569+0000 7fc8d5ffb700 1 -- 172.21.15.6:0/2554575856 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8cc0137e0 con 0x7fc8d806c830 2023-10-06T02:18:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.569+0000 7fc8d5ffb700 1 -- 172.21.15.6:0/2554575856 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc013b60 con 0x7fc8d806c830 2023-10-06T02:18:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.569+0000 7fc8dfca8700 1 -- 172.21.15.6:0/2554575856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d815bf00 con 0x7fc8d806c830 2023-10-06T02:18:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.569+0000 7fc8dfca8700 1 -- 172.21.15.6:0/2554575856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d80b1cb0 con 0x7fc8d806c830 2023-10-06T02:18:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.570+0000 7fc8dfca8700 1 -- 172.21.15.6:0/2554575856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d806e140 con 0x7fc8d806c830 2023-10-06T02:18:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.570+0000 7fc8d5ffb700 1 -- 172.21.15.6:0/2554575856 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8cc00c400 con 0x7fc8d806c830 2023-10-06T02:18:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.571+0000 7fc8d5ffb700 1 --2- 172.21.15.6:0/2554575856 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc8c4066f30 0x7fc8c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.571+0000 7fc8d5ffb700 1 -- 172.21.15.6:0/2554575856 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc8cc084b10 con 0x7fc8d806c830 2023-10-06T02:18:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.571+0000 7fc8dda44700 1 --2- 172.21.15.6:0/2554575856 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc8c4066f30 0x7fc8c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.571+0000 7fc8dda44700 1 --2- 172.21.15.6:0/2554575856 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc8c4066f30 0x7fc8c40693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0007fd0 tx=0x7fc8d0007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:20.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.575+0000 7fc8d5ffb700 1 -- 172.21.15.6:0/2554575856 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8cc051890 con 0x7fc8d806c830 2023-10-06T02:18:20.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.765+0000 7fc8dfca8700 1 -- 172.21.15.6:0/2554575856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc8d815c690 con 0x7fc8d806c830 2023-10-06T02:18:20.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.766+0000 7fc8d5ffb700 1 -- 172.21.15.6:0/2554575856 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc8cc054eb0 con 0x7fc8d806c830 2023-10-06T02:18:20.767 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-06T02:18:20.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.768+0000 7fc8dfca8700 1 -- 172.21.15.6:0/2554575856 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc8c4066f30 msgr2=0x7fc8c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:20.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.768+0000 7fc8dfca8700 1 --2- 172.21.15.6:0/2554575856 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc8c4066f30 0x7fc8c40693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0007fd0 tx=0x7fc8d0007d50 comp rx=0 tx=0).stop 2023-10-06T02:18:20.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.768+0000 7fc8dfca8700 1 -- 172.21.15.6:0/2554575856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8d806c830 msgr2=0x7fc8d8149140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:20.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.768+0000 7fc8dfca8700 1 --2- 172.21.15.6:0/2554575856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8d806c830 0x7fc8d8149140 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00e980 tx=0x7fc8cc009250 comp rx=0 tx=0).stop 2023-10-06T02:18:20.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.768+0000 7fc8dfca8700 1 -- 172.21.15.6:0/2554575856 shutdown_connections 2023-10-06T02:18:20.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.768+0000 7fc8dfca8700 1 --2- 172.21.15.6:0/2554575856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d80c7840 0x7fc8d80b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.768+0000 7fc8dfca8700 1 --2- 172.21.15.6:0/2554575856 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d806c460 0x7fc8d815b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.768+0000 7fc8dfca8700 1 --2- 172.21.15.6:0/2554575856 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc8c4066f30 0x7fc8c40693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.768+0000 7fc8dfca8700 1 --2- 172.21.15.6:0/2554575856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8d806c830 0x7fc8d8149140 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.768+0000 7fc8dfca8700 1 -- 172.21.15.6:0/2554575856 >> 172.21.15.6:0/2554575856 conn(0x7fc8d80c9cc0 msgr2=0x7fc8d8155b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:20.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.768+0000 7fc8dfca8700 1 -- 172.21.15.6:0/2554575856 shutdown_connections 2023-10-06T02:18:20.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.768+0000 7fc8dfca8700 1 -- 172.21.15.6:0/2554575856 wait complete. 2023-10-06T02:18:20.781 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T02:18:20.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.903+0000 7fea19da1700 1 Processor -- start 2023-10-06T02:18:20.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.903+0000 7fea19da1700 1 -- start start 2023-10-06T02:18:20.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.903+0000 7fea19da1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea140af400 0x7fea140b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.903+0000 7fea19da1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea140b0b40 0x7fea1415a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.903+0000 7fea19da1700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fea14069d10 0x7fea1406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.903+0000 7fea19da1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1406a6d0 con 0x7fea140b0b40 2023-10-06T02:18:20.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.903+0000 7fea19da1700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea140b06b0 con 0x7fea14069d10 2023-10-06T02:18:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.903+0000 7fea19da1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1415aaf0 con 0x7fea140af400 2023-10-06T02:18:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.904+0000 7fea13fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea140b0b40 0x7fea1415a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.904+0000 7fea13fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea140b0b40 0x7fea1415a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55878/0 (socket says 172.21.15.6:55878) 2023-10-06T02:18:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.904+0000 7fea13fff700 1 -- 172.21.15.6:0/2425806395 learned_addr learned my addr 172.21.15.6:0/2425806395 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.904+0000 7fea18d9f700 1 --2- 172.21.15.6:0/2425806395 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea140af400 0x7fea140b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.904+0000 7fea195a0700 1 --2- 172.21.15.6:0/2425806395 >> v2:172.21.15.175:3300/0 conn(0x7fea14069d10 0x7fea1406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.904+0000 7fea13fff700 1 -- 172.21.15.6:0/2425806395 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea140af400 msgr2=0x7fea140b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.904+0000 7fea13fff700 1 --2- 172.21.15.6:0/2425806395 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea140af400 0x7fea140b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.904+0000 7fea13fff700 1 -- 172.21.15.6:0/2425806395 >> v2:172.21.15.175:3300/0 conn(0x7fea14069d10 msgr2=0x7fea1406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.904+0000 7fea13fff700 1 --2- 172.21.15.6:0/2425806395 >> v2:172.21.15.175:3300/0 conn(0x7fea14069d10 0x7fea1406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.904+0000 7fea13fff700 1 -- 172.21.15.6:0/2425806395 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea140b2970 con 0x7fea140b0b40 2023-10-06T02:18:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.904+0000 7fea13fff700 1 --2- 172.21.15.6:0/2425806395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea140b0b40 0x7fea1415a5b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fea140cdb80 tx=0x7fea08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ddc681c8afe66ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.904+0000 7fea137fe700 1 -- 172.21.15.6:0/2425806395 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800b640 con 0x7fea140b0b40 2023-10-06T02:18:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.904+0000 7fea137fe700 1 -- 172.21.15.6:0/2425806395 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0800b7a0 con 0x7fea140b0b40 2023-10-06T02:18:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.904+0000 7fea137fe700 1 -- 172.21.15.6:0/2425806395 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800bb60 con 0x7fea140b0b40 2023-10-06T02:18:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.905+0000 7fea19da1700 1 -- 172.21.15.6:0/2425806395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea140b0b40 msgr2=0x7fea1415a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.905+0000 7fea19da1700 1 --2- 172.21.15.6:0/2425806395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea140b0b40 0x7fea1415a5b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fea140cdb80 tx=0x7fea08009250 comp rx=0 tx=0).stop 2023-10-06T02:18:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.905+0000 7fea19da1700 1 -- 172.21.15.6:0/2425806395 shutdown_connections 2023-10-06T02:18:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.905+0000 7fea19da1700 1 --2- 172.21.15.6:0/2425806395 >> v2:172.21.15.175:3300/0 conn(0x7fea14069d10 0x7fea1406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.905+0000 7fea19da1700 1 --2- 172.21.15.6:0/2425806395 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea140af400 0x7fea140b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.905+0000 7fea19da1700 1 --2- 172.21.15.6:0/2425806395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea140b0b40 0x7fea1415a5b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.905+0000 7fea19da1700 1 -- 172.21.15.6:0/2425806395 >> 172.21.15.6:0/2425806395 conn(0x7fea140d0c10 msgr2=0x7fea140ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.905+0000 7fea19da1700 1 -- 172.21.15.6:0/2425806395 shutdown_connections 2023-10-06T02:18:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.905+0000 7fea19da1700 1 -- 172.21.15.6:0/2425806395 wait complete. 2023-10-06T02:18:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.906+0000 7fea19da1700 1 Processor -- start 2023-10-06T02:18:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.906+0000 7fea19da1700 1 -- start start 2023-10-06T02:18:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.907+0000 7fea19da1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea14069d10 0x7fea140c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.907+0000 7fea19da1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea140af400 0x7fea1415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.907+0000 7fea19da1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea140b0b40 0x7fea140caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.907+0000 7fea19da1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea140c82b0 con 0x7fea140b0b40 2023-10-06T02:18:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.907+0000 7fea19da1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea140c7a10 con 0x7fea14069d10 2023-10-06T02:18:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.907+0000 7fea19da1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea140c7cf0 con 0x7fea140af400 2023-10-06T02:18:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.907+0000 7fea195a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea140b0b40 0x7fea140caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.907+0000 7fea195a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea140b0b40 0x7fea140caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55890/0 (socket says 172.21.15.6:55890) 2023-10-06T02:18:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.907+0000 7fea195a0700 1 -- 172.21.15.6:0/2979654583 learned_addr learned my addr 172.21.15.6:0/2979654583 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.907+0000 7fea18d9f700 1 --2- 172.21.15.6:0/2979654583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea14069d10 0x7fea140c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.907+0000 7fea13fff700 1 --2- 172.21.15.6:0/2979654583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea140af400 0x7fea1415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.907+0000 7fea195a0700 1 -- 172.21.15.6:0/2979654583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea140af400 msgr2=0x7fea1415c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.907+0000 7fea195a0700 1 --2- 172.21.15.6:0/2979654583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea140af400 0x7fea1415c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.907+0000 7fea195a0700 1 -- 172.21.15.6:0/2979654583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea14069d10 msgr2=0x7fea140c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.907+0000 7fea195a0700 1 --2- 172.21.15.6:0/2979654583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea14069d10 0x7fea140c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.907+0000 7fea195a0700 1 -- 172.21.15.6:0/2979654583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea080094f0 con 0x7fea140b0b40 2023-10-06T02:18:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.908+0000 7fea195a0700 1 --2- 172.21.15.6:0/2979654583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea140b0b40 0x7fea140caef0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fea0400e8d0 tx=0x7fea040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.908+0000 7fea10ff9700 1 -- 172.21.15.6:0/2979654583 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea04013680 con 0x7fea140b0b40 2023-10-06T02:18:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.908+0000 7fea10ff9700 1 -- 172.21.15.6:0/2979654583 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea040137e0 con 0x7fea140b0b40 2023-10-06T02:18:20.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.908+0000 7fea10ff9700 1 -- 172.21.15.6:0/2979654583 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea04013ba0 con 0x7fea140b0b40 2023-10-06T02:18:20.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.908+0000 7fea19da1700 1 -- 172.21.15.6:0/2979654583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea140c7fd0 con 0x7fea140b0b40 2023-10-06T02:18:20.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.908+0000 7fea19da1700 1 -- 172.21.15.6:0/2979654583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea140c7650 con 0x7fea140b0b40 2023-10-06T02:18:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.909+0000 7fea19da1700 1 -- 172.21.15.6:0/2979654583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1416b670 con 0x7fea140b0b40 2023-10-06T02:18:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.909+0000 7fea10ff9700 1 -- 172.21.15.6:0/2979654583 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea040123d0 con 0x7fea140b0b40 2023-10-06T02:18:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.910+0000 7fea10ff9700 1 --2- 172.21.15.6:0/2979654583 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fea00066f30 0x7fea000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.910+0000 7fea10ff9700 1 -- 172.21.15.6:0/2979654583 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fea04084e00 con 0x7fea140b0b40 2023-10-06T02:18:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.910+0000 7fea18d9f700 1 --2- 172.21.15.6:0/2979654583 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fea00066f30 0x7fea000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.910+0000 7fea18d9f700 1 --2- 172.21.15.6:0/2979654583 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fea00066f30 0x7fea000693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009fd0 tx=0x7fea0c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:20.914+0000 7fea10ff9700 1 -- 172.21.15.6:0/2979654583 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea1416b670 con 0x7fea140b0b40 2023-10-06T02:18:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.104+0000 7fea19da1700 1 -- 172.21.15.6:0/2979654583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fea1416b670 con 0x7fea140b0b40 2023-10-06T02:18:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.105+0000 7fea10ff9700 1 -- 172.21.15.6:0/2979654583 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fea1416b670 con 0x7fea140b0b40 2023-10-06T02:18:21.107 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:18:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.107+0000 7fea19da1700 1 -- 172.21.15.6:0/2979654583 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fea00066f30 msgr2=0x7fea000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.107+0000 7fea19da1700 1 --2- 172.21.15.6:0/2979654583 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fea00066f30 0x7fea000693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009fd0 tx=0x7fea0c00b040 comp rx=0 tx=0).stop 2023-10-06T02:18:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.107+0000 7fea19da1700 1 -- 172.21.15.6:0/2979654583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea140b0b40 msgr2=0x7fea140caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.107+0000 7fea19da1700 1 --2- 172.21.15.6:0/2979654583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea140b0b40 0x7fea140caef0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fea0400e8d0 tx=0x7fea040091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.107+0000 7fea19da1700 1 -- 172.21.15.6:0/2979654583 shutdown_connections 2023-10-06T02:18:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.107+0000 7fea19da1700 1 --2- 172.21.15.6:0/2979654583 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fea00066f30 0x7fea000693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.107+0000 7fea19da1700 1 --2- 172.21.15.6:0/2979654583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea140b0b40 0x7fea140caef0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.107+0000 7fea19da1700 1 --2- 172.21.15.6:0/2979654583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea14069d10 0x7fea140c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.107+0000 7fea19da1700 1 --2- 172.21.15.6:0/2979654583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea140af400 0x7fea1415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.107+0000 7fea19da1700 1 -- 172.21.15.6:0/2979654583 >> 172.21.15.6:0/2979654583 conn(0x7fea140d0c10 msgr2=0x7fea141596f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:21.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.107+0000 7fea19da1700 1 -- 172.21.15.6:0/2979654583 shutdown_connections 2023-10-06T02:18:21.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.107+0000 7fea19da1700 1 -- 172.21.15.6:0/2979654583 wait complete. 2023-10-06T02:18:21.121 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:18:21.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.240+0000 7fb2fefbb700 1 Processor -- start 2023-10-06T02:18:21.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.240+0000 7fb2fefbb700 1 -- start start 2023-10-06T02:18:21.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.241+0000 7fb2fefbb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb2f80b27f0 0x7fb2f8159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.241+0000 7fb2fefbb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f80ccb60 con 0x7fb2f815d4d0 2023-10-06T02:18:21.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.241+0000 7fb2fefbb700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f80cb6c0 con 0x7fb2f8159380 2023-10-06T02:18:21.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.241+0000 7fb2fefbb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f815e200 con 0x7fb2f80b27f0 2023-10-06T02:18:21.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.241+0000 7fb2fd558700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb2f815d4d0 0x7fb2f815d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45672/0 (socket says 172.21.15.6:45672) 2023-10-06T02:18:21.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.241+0000 7fb2f7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb2f80b27f0 0x7fb2f8159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.241+0000 7fb2fd558700 1 -- 172.21.15.6:0/2934650785 learned_addr learned my addr 172.21.15.6:0/2934650785 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:21.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.241+0000 7fb2f7fff700 1 -- 172.21.15.6:0/2934650785 >> v1:172.21.15.175:6789/0 conn(0x7fb2f8159380 legacy=0x7fb2f80b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.241+0000 7fb2f7fff700 1 -- 172.21.15.6:0/2934650785 >> v1:172.21.15.6:6789/0 conn(0x7fb2f815d4d0 legacy=0x7fb2f815d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.241+0000 7fb2f7fff700 1 -- 172.21.15.6:0/2934650785 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f80c3ef0 con 0x7fb2f80b27f0 2023-10-06T02:18:21.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.241+0000 7fb2f7fff700 1 --2- 172.21.15.6:0/2934650785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f80b27f0 0x7fb2f8159750 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40098e0 tx=0x7fb2e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb7671ca6c90b16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:21.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.241+0000 7fb2f77fe700 1 -- 172.21.15.6:0/2934650785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4009e80 con 0x7fb2f80b27f0 2023-10-06T02:18:21.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.242+0000 7fb2f77fe700 1 -- 172.21.15.6:0/2934650785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e400b860 con 0x7fb2f80b27f0 2023-10-06T02:18:21.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.242+0000 7fb2f77fe700 1 -- 172.21.15.6:0/2934650785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e400bbe0 con 0x7fb2f80b27f0 2023-10-06T02:18:21.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.242+0000 7fb2fefbb700 1 -- 172.21.15.6:0/2934650785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f80b27f0 msgr2=0x7fb2f8159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.242+0000 7fb2fefbb700 1 --2- 172.21.15.6:0/2934650785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f80b27f0 0x7fb2f8159750 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40098e0 tx=0x7fb2e40091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.242+0000 7fb2fefbb700 1 -- 172.21.15.6:0/2934650785 shutdown_connections 2023-10-06T02:18:21.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.242+0000 7fb2fefbb700 1 --2- 172.21.15.6:0/2934650785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f80b27f0 0x7fb2f8159750 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.242+0000 7fb2fefbb700 1 -- 172.21.15.6:0/2934650785 >> 172.21.15.6:0/2934650785 conn(0x7fb2f8068680 msgr2=0x7fb2f8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:21.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.242+0000 7fb2fefbb700 1 -- 172.21.15.6:0/2934650785 shutdown_connections 2023-10-06T02:18:21.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.242+0000 7fb2fefbb700 1 -- 172.21.15.6:0/2934650785 wait complete. 2023-10-06T02:18:21.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.243+0000 7fb2fefbb700 1 Processor -- start 2023-10-06T02:18:21.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.243+0000 7fb2fefbb700 1 -- start start 2023-10-06T02:18:21.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.244+0000 7fb2fefbb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2f80b27f0 0x7fb2f80b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.244+0000 7fb2fefbb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2f8159380 0x7fb2f80cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.244+0000 7fb2fefbb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f815d4d0 0x7fb2f8169fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.244+0000 7fb2fefbb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f80c82d0 con 0x7fb2f815d4d0 2023-10-06T02:18:21.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.244+0000 7fb2fefbb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f80c85b0 con 0x7fb2f8159380 2023-10-06T02:18:21.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.244+0000 7fb2fefbb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f80d06e0 con 0x7fb2f80b27f0 2023-10-06T02:18:21.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.244+0000 7fb2fd558700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f815d4d0 0x7fb2f8169fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.244+0000 7fb2fd558700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f815d4d0 0x7fb2f8169fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55912/0 (socket says 172.21.15.6:55912) 2023-10-06T02:18:21.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.244+0000 7fb2fd558700 1 -- 172.21.15.6:0/1900500713 learned_addr learned my addr 172.21.15.6:0/1900500713 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:21.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.244+0000 7fb2f7fff700 1 --2- 172.21.15.6:0/1900500713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2f8159380 0x7fb2f80cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.244+0000 7fb2fcd57700 1 --2- 172.21.15.6:0/1900500713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2f80b27f0 0x7fb2f80b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.244+0000 7fb2fd558700 1 -- 172.21.15.6:0/1900500713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2f80b27f0 msgr2=0x7fb2f80b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.245+0000 7fb2fd558700 1 --2- 172.21.15.6:0/1900500713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2f80b27f0 0x7fb2f80b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.245+0000 7fb2fd558700 1 -- 172.21.15.6:0/1900500713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2f8159380 msgr2=0x7fb2f80cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.245+0000 7fb2fd558700 1 --2- 172.21.15.6:0/1900500713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2f8159380 0x7fb2f80cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.245+0000 7fb2fd558700 1 -- 172.21.15.6:0/1900500713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e4009420 con 0x7fb2f815d4d0 2023-10-06T02:18:21.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.245+0000 7fb2fd558700 1 --2- 172.21.15.6:0/1900500713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f815d4d0 0x7fb2f8169fc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000cbc0 tx=0x7fb2f00019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:21.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.245+0000 7fb2f4ff9700 1 -- 172.21.15.6:0/1900500713 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000a940 con 0x7fb2f815d4d0 2023-10-06T02:18:21.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.245+0000 7fb2f4ff9700 1 -- 172.21.15.6:0/1900500713 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f000aaa0 con 0x7fb2f815d4d0 2023-10-06T02:18:21.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.245+0000 7fb2fefbb700 1 -- 172.21.15.6:0/1900500713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f80d09c0 con 0x7fb2f815d4d0 2023-10-06T02:18:21.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.245+0000 7fb2f4ff9700 1 -- 172.21.15.6:0/1900500713 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000ae20 con 0x7fb2f815d4d0 2023-10-06T02:18:21.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.245+0000 7fb2fefbb700 1 -- 172.21.15.6:0/1900500713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f816acc0 con 0x7fb2f815d4d0 2023-10-06T02:18:21.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.246+0000 7fb2fefbb700 1 -- 172.21.15.6:0/1900500713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f8088aa0 con 0x7fb2f815d4d0 2023-10-06T02:18:21.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.246+0000 7fb2f4ff9700 1 -- 172.21.15.6:0/1900500713 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2f0007300 con 0x7fb2f815d4d0 2023-10-06T02:18:21.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.247+0000 7fb2f4ff9700 1 --2- 172.21.15.6:0/1900500713 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb2dc066f30 0x7fb2dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.247+0000 7fb2f4ff9700 1 -- 172.21.15.6:0/1900500713 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb2f0084cf0 con 0x7fb2f815d4d0 2023-10-06T02:18:21.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.247+0000 7fb2fcd57700 1 --2- 172.21.15.6:0/1900500713 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb2dc066f30 0x7fb2dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.247+0000 7fb2fcd57700 1 --2- 172.21.15.6:0/1900500713 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb2dc066f30 0x7fb2dc0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80ca300 tx=0x7fb2ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:21.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.251+0000 7fb2f4ff9700 1 -- 172.21.15.6:0/1900500713 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2f0089070 con 0x7fb2f815d4d0 2023-10-06T02:18:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.444+0000 7fb2fefbb700 1 -- 172.21.15.6:0/1900500713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2f80d1010 con 0x7fb2f815d4d0 2023-10-06T02:18:21.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.445+0000 7fb2f4ff9700 1 -- 172.21.15.6:0/1900500713 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fb2f0051b90 con 0x7fb2f815d4d0 2023-10-06T02:18:21.447 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:21.447 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:48.453046+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:18:21.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.448+0000 7fb2fefbb700 1 -- 172.21.15.6:0/1900500713 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb2dc066f30 msgr2=0x7fb2dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.448+0000 7fb2fefbb700 1 --2- 172.21.15.6:0/1900500713 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb2dc066f30 0x7fb2dc0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80ca300 tx=0x7fb2ec009040 comp rx=0 tx=0).stop 2023-10-06T02:18:21.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.448+0000 7fb2fefbb700 1 -- 172.21.15.6:0/1900500713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f815d4d0 msgr2=0x7fb2f8169fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.448+0000 7fb2fefbb700 1 --2- 172.21.15.6:0/1900500713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f815d4d0 0x7fb2f8169fc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000cbc0 tx=0x7fb2f00019c0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.448+0000 7fb2fefbb700 1 -- 172.21.15.6:0/1900500713 shutdown_connections 2023-10-06T02:18:21.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.448+0000 7fb2fefbb700 1 --2- 172.21.15.6:0/1900500713 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb2dc066f30 0x7fb2dc0693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.448+0000 7fb2fefbb700 1 --2- 172.21.15.6:0/1900500713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f815d4d0 0x7fb2f8169fc0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.448+0000 7fb2fefbb700 1 --2- 172.21.15.6:0/1900500713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2f80b27f0 0x7fb2f80b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.448+0000 7fb2fefbb700 1 --2- 172.21.15.6:0/1900500713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2f8159380 0x7fb2f80cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.448+0000 7fb2fefbb700 1 -- 172.21.15.6:0/1900500713 >> 172.21.15.6:0/1900500713 conn(0x7fb2f8068680 msgr2=0x7fb2f8159ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:21.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.448+0000 7fb2fefbb700 1 -- 172.21.15.6:0/1900500713 shutdown_connections 2023-10-06T02:18:21.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.448+0000 7fb2fefbb700 1 -- 172.21.15.6:0/1900500713 wait complete. 2023-10-06T02:18:21.462 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:17:41.126402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:17:42.378468+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T02:17:46.053654+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:18:21.462 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:18:21.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.583+0000 7f5c2b4b7700 1 Processor -- start 2023-10-06T02:18:21.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.583+0000 7f5c2b4b7700 1 -- start start 2023-10-06T02:18:21.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.584+0000 7f5c2b4b7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5c240cd7d0 0x7f5c240d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.584+0000 7f5c2b4b7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c240b0810 0x7f5c240d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.584+0000 7f5c2b4b7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c240d0c20 con 0x7f5c240cd400 2023-10-06T02:18:21.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.584+0000 7f5c2b4b7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c240af770 con 0x7f5c240cd7d0 2023-10-06T02:18:21.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.584+0000 7f5c2b4b7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c240afa50 con 0x7f5c240b0810 2023-10-06T02:18:21.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.584+0000 7f5c2a4b5700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5c240cd400 0x7f5c240b1f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45688/0 (socket says 172.21.15.6:45688) 2023-10-06T02:18:21.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.584+0000 7f5c2a4b5700 1 -- 172.21.15.6:0/1826102845 learned_addr learned my addr 172.21.15.6:0/1826102845 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:21.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.584+0000 7f5c2acb6700 1 --2- 172.21.15.6:0/1826102845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c240b0810 0x7f5c240d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.584+0000 7f5c29cb4700 1 --2- 172.21.15.6:0/1826102845 >> v2:172.21.15.175:3300/0 conn(0x7f5c240cd7d0 0x7f5c240d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.584+0000 7f5c294b3700 1 -- 172.21.15.6:0/1826102845 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874458131 0 0) 0x7f5c240d0c20 con 0x7f5c240cd400 2023-10-06T02:18:21.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.584+0000 7f5c294b3700 1 -- 172.21.15.6:0/1826102845 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c10003570 con 0x7f5c240cd400 2023-10-06T02:18:21.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.584+0000 7f5c2acb6700 1 -- 172.21.15.6:0/1826102845 >> v2:172.21.15.175:3300/0 conn(0x7f5c240cd7d0 msgr2=0x7f5c240d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:21.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.584+0000 7f5c2acb6700 1 --2- 172.21.15.6:0/1826102845 >> v2:172.21.15.175:3300/0 conn(0x7f5c240cd7d0 0x7f5c240d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.584+0000 7f5c2acb6700 1 -- 172.21.15.6:0/1826102845 >> v1:172.21.15.6:6789/0 conn(0x7f5c240cd400 legacy=0x7f5c240b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.584+0000 7f5c2acb6700 1 -- 172.21.15.6:0/1826102845 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c240afd30 con 0x7f5c240b0810 2023-10-06T02:18:21.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.585+0000 7f5c2acb6700 1 --2- 172.21.15.6:0/1826102845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c240b0810 0x7f5c240d06e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009e90 tx=0x7f5c1c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d57a2f6d3bae6be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:21.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.585+0000 7f5c294b3700 1 -- 172.21.15.6:0/1826102845 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c00e070 con 0x7f5c240b0810 2023-10-06T02:18:21.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.585+0000 7f5c294b3700 1 -- 172.21.15.6:0/1826102845 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1c00bb40 con 0x7f5c240b0810 2023-10-06T02:18:21.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.585+0000 7f5c294b3700 1 -- 172.21.15.6:0/1826102845 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c012430 con 0x7f5c240b0810 2023-10-06T02:18:21.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.585+0000 7f5c2b4b7700 1 -- 172.21.15.6:0/1826102845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c240b0810 msgr2=0x7f5c240d06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.585+0000 7f5c2b4b7700 1 --2- 172.21.15.6:0/1826102845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c240b0810 0x7f5c240d06e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009e90 tx=0x7f5c1c009780 comp rx=0 tx=0).stop 2023-10-06T02:18:21.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.585+0000 7f5c2b4b7700 1 -- 172.21.15.6:0/1826102845 shutdown_connections 2023-10-06T02:18:21.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.585+0000 7f5c2b4b7700 1 --2- 172.21.15.6:0/1826102845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c240b0810 0x7f5c240d06e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.585+0000 7f5c2b4b7700 1 --2- 172.21.15.6:0/1826102845 >> v2:172.21.15.175:3300/0 conn(0x7f5c240cd7d0 0x7f5c240d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.585+0000 7f5c2b4b7700 1 -- 172.21.15.6:0/1826102845 >> 172.21.15.6:0/1826102845 conn(0x7f5c2406a110 msgr2=0x7f5c2406a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:21.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.586+0000 7f5c2b4b7700 1 -- 172.21.15.6:0/1826102845 shutdown_connections 2023-10-06T02:18:21.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.586+0000 7f5c2b4b7700 1 -- 172.21.15.6:0/1826102845 wait complete. 2023-10-06T02:18:21.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.587+0000 7f5c2b4b7700 1 Processor -- start 2023-10-06T02:18:21.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.587+0000 7f5c2b4b7700 1 -- start start 2023-10-06T02:18:21.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.587+0000 7f5c2b4b7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c240b0810 0x7f5c24157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.587+0000 7f5c2b4b7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c240cd400 0x7f5c240c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.587+0000 7f5c2b4b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c240c88f0 0x7f5c24152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.587+0000 7f5c2b4b7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2415cbf0 con 0x7f5c240c88f0 2023-10-06T02:18:21.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.587+0000 7f5c2b4b7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2415d1b0 con 0x7f5c240b0810 2023-10-06T02:18:21.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.587+0000 7f5c2b4b7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2416e140 con 0x7f5c240cd400 2023-10-06T02:18:21.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c2acb6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c240c88f0 0x7f5c24152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c2acb6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c240c88f0 0x7f5c24152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55922/0 (socket says 172.21.15.6:55922) 2023-10-06T02:18:21.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c2acb6700 1 -- 172.21.15.6:0/527922952 learned_addr learned my addr 172.21.15.6:0/527922952 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:21.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c2acb6700 1 -- 172.21.15.6:0/527922952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c240cd400 msgr2=0x7f5c240c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c29cb4700 1 --2- 172.21.15.6:0/527922952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c240cd400 0x7f5c240c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c2a4b5700 1 --2- 172.21.15.6:0/527922952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c240b0810 0x7f5c24157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c2acb6700 1 --2- 172.21.15.6:0/527922952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c240cd400 0x7f5c240c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c2acb6700 1 -- 172.21.15.6:0/527922952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c240b0810 msgr2=0x7f5c24157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c2acb6700 1 --2- 172.21.15.6:0/527922952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c240b0810 0x7f5c24157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c2acb6700 1 -- 172.21.15.6:0/527922952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1c009a20 con 0x7f5c240c88f0 2023-10-06T02:18:21.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c2a4b5700 1 --2- 172.21.15.6:0/527922952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c240b0810 0x7f5c24157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:21.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c29cb4700 1 --2- 172.21.15.6:0/527922952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c240cd400 0x7f5c240c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:21.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c2acb6700 1 --2- 172.21.15.6:0/527922952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c240c88f0 0x7f5c24152ff0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5c240d0db0 tx=0x7f5c1c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:21.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c1a7fc700 1 -- 172.21.15.6:0/527922952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c007060 con 0x7f5c240c88f0 2023-10-06T02:18:21.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c1a7fc700 1 -- 172.21.15.6:0/527922952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1c012e30 con 0x7f5c240c88f0 2023-10-06T02:18:21.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c2b4b7700 1 -- 172.21.15.6:0/527922952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c24158e80 con 0x7f5c240c88f0 2023-10-06T02:18:21.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c1a7fc700 1 -- 172.21.15.6:0/527922952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c01b830 con 0x7f5c240c88f0 2023-10-06T02:18:21.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.588+0000 7f5c2b4b7700 1 -- 172.21.15.6:0/527922952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c24159440 con 0x7f5c240c88f0 2023-10-06T02:18:21.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.589+0000 7f5c2b4b7700 1 -- 172.21.15.6:0/527922952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c240b5340 con 0x7f5c240c88f0 2023-10-06T02:18:21.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.590+0000 7f5c1a7fc700 1 -- 172.21.15.6:0/527922952 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c1c003050 con 0x7f5c240c88f0 2023-10-06T02:18:21.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.590+0000 7f5c1a7fc700 1 --2- 172.21.15.6:0/527922952 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c08066f30 0x7f5c080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.590+0000 7f5c1a7fc700 1 -- 172.21.15.6:0/527922952 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5c1c086580 con 0x7f5c240c88f0 2023-10-06T02:18:21.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.590+0000 7f5c2a4b5700 1 --2- 172.21.15.6:0/527922952 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c08066f30 0x7f5c080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.591+0000 7f5c2a4b5700 1 --2- 172.21.15.6:0/527922952 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c08066f30 0x7f5c080693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5c20001360 tx=0x7f5c20009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:21.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.594+0000 7f5c1a7fc700 1 -- 172.21.15.6:0/527922952 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c1c0533a0 con 0x7f5c240c88f0 2023-10-06T02:18:21.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.785+0000 7f5c2b4b7700 1 -- 172.21.15.6:0/527922952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5c24064aa0 con 0x7f5c240c88f0 2023-10-06T02:18:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.786+0000 7f5c1a7fc700 1 -- 172.21.15.6:0/527922952 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5c1c0569c0 con 0x7f5c240c88f0 2023-10-06T02:18:21.787 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:18:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.788+0000 7f5c2b4b7700 1 -- 172.21.15.6:0/527922952 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c08066f30 msgr2=0x7f5c080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.788+0000 7f5c2b4b7700 1 --2- 172.21.15.6:0/527922952 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c08066f30 0x7f5c080693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5c20001360 tx=0x7f5c20009040 comp rx=0 tx=0).stop 2023-10-06T02:18:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.788+0000 7f5c2b4b7700 1 -- 172.21.15.6:0/527922952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c240c88f0 msgr2=0x7f5c24152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.788+0000 7f5c2b4b7700 1 --2- 172.21.15.6:0/527922952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c240c88f0 0x7f5c24152ff0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5c240d0db0 tx=0x7f5c1c019000 comp rx=0 tx=0).stop 2023-10-06T02:18:21.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.788+0000 7f5c2b4b7700 1 -- 172.21.15.6:0/527922952 shutdown_connections 2023-10-06T02:18:21.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.788+0000 7f5c2b4b7700 1 --2- 172.21.15.6:0/527922952 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c08066f30 0x7f5c080693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.788+0000 7f5c2b4b7700 1 --2- 172.21.15.6:0/527922952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c240c88f0 0x7f5c24152ff0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.788+0000 7f5c2b4b7700 1 --2- 172.21.15.6:0/527922952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c240b0810 0x7f5c24157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.788+0000 7f5c2b4b7700 1 --2- 172.21.15.6:0/527922952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c240cd400 0x7f5c240c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.788+0000 7f5c2b4b7700 1 -- 172.21.15.6:0/527922952 >> 172.21.15.6:0/527922952 conn(0x7f5c2406a110 msgr2=0x7f5c241552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.788+0000 7f5c2b4b7700 1 -- 172.21.15.6:0/527922952 shutdown_connections 2023-10-06T02:18:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.788+0000 7f5c2b4b7700 1 -- 172.21.15.6:0/527922952 wait complete. 2023-10-06T02:18:21.801 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:18:21.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.922+0000 7f3c69568700 1 Processor -- start 2023-10-06T02:18:21.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.922+0000 7f3c69568700 1 -- start start 2023-10-06T02:18:21.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.923+0000 7f3c69568700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c640cf7d0 0x7f3c640cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.923+0000 7f3c69568700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c640cbb80 con 0x7f3c6406a490 2023-10-06T02:18:21.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.923+0000 7f3c69568700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6415a740 con 0x7f3c640cb6e0 2023-10-06T02:18:21.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.923+0000 7f3c69568700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c64159c10 con 0x7f3c640cf7d0 2023-10-06T02:18:21.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.923+0000 7f3c637fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3c6406a490 0x7f3c640cdd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45698/0 (socket says 172.21.15.6:45698) 2023-10-06T02:18:21.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.923+0000 7f3c637fe700 1 -- 172.21.15.6:0/3151664950 learned_addr learned my addr 172.21.15.6:0/3151664950 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:21.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.923+0000 7f3c62ffd700 1 --2- 172.21.15.6:0/3151664950 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c640cf7d0 0x7f3c640cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.923+0000 7f3c61ffb700 1 -- 172.21.15.6:0/3151664950 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820558760 0 0) 0x7f3c640cbb80 con 0x7f3c6406a490 2023-10-06T02:18:21.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.923+0000 7f3c61ffb700 1 -- 172.21.15.6:0/3151664950 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c50003570 con 0x7f3c6406a490 2023-10-06T02:18:21.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c61ffb700 1 -- 172.21.15.6:0/3151664950 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3078368001 0 0) 0x7f3c50003570 con 0x7f3c6406a490 2023-10-06T02:18:21.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c61ffb700 1 -- 172.21.15.6:0/3151664950 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c640cf7d0 msgr2=0x7f3c640cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:21.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c61ffb700 1 --2- 172.21.15.6:0/3151664950 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c640cf7d0 0x7f3c640cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c61ffb700 1 -- 172.21.15.6:0/3151664950 >> v1:172.21.15.175:6789/0 conn(0x7f3c640cb6e0 legacy=0x7f3c64069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c61ffb700 1 -- 172.21.15.6:0/3151664950 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c64159e10 con 0x7f3c6406a490 2023-10-06T02:18:21.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c61ffb700 1 -- 172.21.15.6:0/3151664950 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f3c540017f0 con 0x7f3c6406a490 2023-10-06T02:18:21.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c61ffb700 1 -- 172.21.15.6:0/3151664950 >> v1:172.21.15.6:6789/0 conn(0x7f3c6406a490 legacy=0x7f3c640cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c61ffb700 1 --2- 172.21.15.6:0/3151664950 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c640cf7d0 0x7f3c50003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c61ffb700 1 --2- 172.21.15.6:0/3151664950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c50004010 0x7f3c50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c61ffb700 1 --2- 172.21.15.6:0/3151664950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c50004d50 0x7f3c500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c61ffb700 1 -- 172.21.15.6:0/3151664950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c64159c10 con 0x7f3c50004d50 2023-10-06T02:18:21.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c61ffb700 1 -- 172.21.15.6:0/3151664950 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5000bbf0 con 0x7f3c50004010 2023-10-06T02:18:21.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c61ffb700 1 -- 172.21.15.6:0/3151664950 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5000bdb0 con 0x7f3c640cf7d0 2023-10-06T02:18:21.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c637fe700 1 --2- 172.21.15.6:0/3151664950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c50004d50 0x7f3c500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c62ffd700 1 --2- 172.21.15.6:0/3151664950 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c640cf7d0 0x7f3c50003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c627fc700 1 --2- 172.21.15.6:0/3151664950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c50004010 0x7f3c50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c637fe700 1 -- 172.21.15.6:0/3151664950 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c640cf7d0 msgr2=0x7f3c50003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:21.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c637fe700 1 --2- 172.21.15.6:0/3151664950 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c640cf7d0 0x7f3c50003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c637fe700 1 -- 172.21.15.6:0/3151664950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c50004010 msgr2=0x7f3c50004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c637fe700 1 --2- 172.21.15.6:0/3151664950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c50004010 0x7f3c50004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c637fe700 1 -- 172.21.15.6:0/3151664950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c50003570 con 0x7f3c50004d50 2023-10-06T02:18:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c627fc700 1 --2- 172.21.15.6:0/3151664950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c50004010 0x7f3c50004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c637fe700 1 --2- 172.21.15.6:0/3151664950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c50004d50 0x7f3c500051c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3c6406b070 tx=0x7f3c540021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e9987116892ddf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c61ffb700 1 -- 172.21.15.6:0/3151664950 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c540070d0 con 0x7f3c50004d50 2023-10-06T02:18:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c61ffb700 1 -- 172.21.15.6:0/3151664950 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c54007230 con 0x7f3c50004d50 2023-10-06T02:18:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.924+0000 7f3c61ffb700 1 -- 172.21.15.6:0/3151664950 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c540075f0 con 0x7f3c50004d50 2023-10-06T02:18:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.925+0000 7f3c69568700 1 -- 172.21.15.6:0/3151664950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c50004d50 msgr2=0x7f3c500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.925+0000 7f3c69568700 1 --2- 172.21.15.6:0/3151664950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c50004d50 0x7f3c500051c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3c6406b070 tx=0x7f3c540021d0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.925+0000 7f3c637fe700 1 -- 172.21.15.6:0/3151664950 reap_dead start 2023-10-06T02:18:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.925+0000 7f3c69568700 1 -- 172.21.15.6:0/3151664950 shutdown_connections 2023-10-06T02:18:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.925+0000 7f3c69568700 1 -- 172.21.15.6:0/3151664950 >> 172.21.15.6:0/3151664950 conn(0x7f3c640d0c60 msgr2=0x7f3c640ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.925+0000 7f3c69568700 1 -- 172.21.15.6:0/3151664950 shutdown_connections 2023-10-06T02:18:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.925+0000 7f3c69568700 1 -- 172.21.15.6:0/3151664950 wait complete. 2023-10-06T02:18:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.926+0000 7f3c69568700 1 Processor -- start 2023-10-06T02:18:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.926+0000 7f3c69568700 1 -- start start 2023-10-06T02:18:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.927+0000 7f3c69568700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c50004d50 0x7f3c64169dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.927+0000 7f3c69568700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c6415c5f0 0x7f3c640b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.927+0000 7f3c69568700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c64150970 0x7f3c64150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.927+0000 7f3c69568700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6416af90 con 0x7f3c50004d50 2023-10-06T02:18:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.927+0000 7f3c69568700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6416a680 con 0x7f3c64150970 2023-10-06T02:18:21.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.927+0000 7f3c69568700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6416a960 con 0x7f3c6415c5f0 2023-10-06T02:18:21.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.927+0000 7f3c62ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c50004d50 0x7f3c64169dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.927+0000 7f3c62ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c50004d50 0x7f3c64169dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55942/0 (socket says 172.21.15.6:55942) 2023-10-06T02:18:21.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.927+0000 7f3c62ffd700 1 -- 172.21.15.6:0/3664264305 learned_addr learned my addr 172.21.15.6:0/3664264305 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:21.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.927+0000 7f3c627fc700 1 --2- 172.21.15.6:0/3664264305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c6415c5f0 0x7f3c640b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.927+0000 7f3c637fe700 1 --2- 172.21.15.6:0/3664264305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c64150970 0x7f3c64150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.927+0000 7f3c62ffd700 1 -- 172.21.15.6:0/3664264305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c6415c5f0 msgr2=0x7f3c640b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.927+0000 7f3c62ffd700 1 --2- 172.21.15.6:0/3664264305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c6415c5f0 0x7f3c640b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.927+0000 7f3c62ffd700 1 -- 172.21.15.6:0/3664264305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c64150970 msgr2=0x7f3c64150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:21.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.927+0000 7f3c62ffd700 1 --2- 172.21.15.6:0/3664264305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c64150970 0x7f3c64150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:21.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.927+0000 7f3c62ffd700 1 -- 172.21.15.6:0/3664264305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6416ac40 con 0x7f3c50004d50 2023-10-06T02:18:21.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.928+0000 7f3c62ffd700 1 --2- 172.21.15.6:0/3664264305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c50004d50 0x7f3c64169dc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c006ac0 tx=0x7f3c5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:21.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.928+0000 7f3c5affd700 1 -- 172.21.15.6:0/3664264305 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c00fa10 con 0x7f3c50004d50 2023-10-06T02:18:21.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.928+0000 7f3c5affd700 1 -- 172.21.15.6:0/3664264305 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c00fb70 con 0x7f3c50004d50 2023-10-06T02:18:21.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.928+0000 7f3c69568700 1 -- 172.21.15.6:0/3664264305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c640b2f30 con 0x7f3c50004d50 2023-10-06T02:18:21.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.928+0000 7f3c5affd700 1 -- 172.21.15.6:0/3664264305 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c014440 con 0x7f3c50004d50 2023-10-06T02:18:21.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.928+0000 7f3c69568700 1 -- 172.21.15.6:0/3664264305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c64151350 con 0x7f3c50004d50 2023-10-06T02:18:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.929+0000 7f3c69568700 1 -- 172.21.15.6:0/3664264305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c64064f20 con 0x7f3c50004d50 2023-10-06T02:18:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.929+0000 7f3c5affd700 1 -- 172.21.15.6:0/3664264305 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c5c014870 con 0x7f3c50004d50 2023-10-06T02:18:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.930+0000 7f3c5affd700 1 --2- 172.21.15.6:0/3664264305 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c44066f30 0x7f3c440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.930+0000 7f3c5affd700 1 -- 172.21.15.6:0/3664264305 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3c5c018030 con 0x7f3c50004d50 2023-10-06T02:18:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.930+0000 7f3c627fc700 1 --2- 172.21.15.6:0/3664264305 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c44066f30 0x7f3c440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.930+0000 7f3c627fc700 1 --2- 172.21.15.6:0/3664264305 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c44066f30 0x7f3c440693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c640cdc00 tx=0x7f3c4c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:21.934+0000 7f3c5affd700 1 -- 172.21.15.6:0/3664264305 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c5c0522a0 con 0x7f3c50004d50 2023-10-06T02:18:22.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.126+0000 7f3c69568700 1 -- 172.21.15.6:0/3664264305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c64064aa0 con 0x7f3c50004d50 2023-10-06T02:18:22.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.126+0000 7f3c5affd700 1 -- 172.21.15.6:0/3664264305 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c5c0558c0 con 0x7f3c50004d50 2023-10-06T02:18:22.128 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:18:22.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.128+0000 7f3c69568700 1 -- 172.21.15.6:0/3664264305 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c44066f30 msgr2=0x7f3c440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.128+0000 7f3c69568700 1 --2- 172.21.15.6:0/3664264305 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c44066f30 0x7f3c440693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c640cdc00 tx=0x7f3c4c009040 comp rx=0 tx=0).stop 2023-10-06T02:18:22.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.128+0000 7f3c69568700 1 -- 172.21.15.6:0/3664264305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c50004d50 msgr2=0x7f3c64169dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.128+0000 7f3c69568700 1 --2- 172.21.15.6:0/3664264305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c50004d50 0x7f3c64169dc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c006ac0 tx=0x7f3c5c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.128+0000 7f3c69568700 1 -- 172.21.15.6:0/3664264305 shutdown_connections 2023-10-06T02:18:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.128+0000 7f3c69568700 1 --2- 172.21.15.6:0/3664264305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c64150970 0x7f3c64150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.128+0000 7f3c69568700 1 --2- 172.21.15.6:0/3664264305 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c44066f30 0x7f3c440693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.128+0000 7f3c69568700 1 --2- 172.21.15.6:0/3664264305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c50004d50 0x7f3c64169dc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.128+0000 7f3c69568700 1 --2- 172.21.15.6:0/3664264305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c6415c5f0 0x7f3c640b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.128+0000 7f3c69568700 1 -- 172.21.15.6:0/3664264305 >> 172.21.15.6:0/3664264305 conn(0x7f3c640d0c60 msgr2=0x7f3c640c6630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:22.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.128+0000 7f3c69568700 1 -- 172.21.15.6:0/3664264305 shutdown_connections 2023-10-06T02:18:22.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.128+0000 7f3c69568700 1 -- 172.21.15.6:0/3664264305 wait complete. 2023-10-06T02:18:22.141 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:18:22.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.262+0000 7fabedefb700 1 Processor -- start 2023-10-06T02:18:22.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.262+0000 7fabedefb700 1 -- start start 2023-10-06T02:18:22.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.262+0000 7fabedefb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fabe80ccd40 0x7fabe80cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.263+0000 7fabedefb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fabe80cf7e0 0x7fabe80b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.263+0000 7fabedefb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe815dd40 con 0x7fabe80d0400 2023-10-06T02:18:22.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.263+0000 7fabedefb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe815e020 con 0x7fabe80ccd40 2023-10-06T02:18:22.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.263+0000 7fabedefb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe80ceaa0 con 0x7fabe80cf7e0 2023-10-06T02:18:22.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.263+0000 7fabe6ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fabe80ccd40 0x7fabe80cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.263+0000 7fabe77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fabe80d0400 0x7fabe80b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45712/0 (socket says 172.21.15.6:45712) 2023-10-06T02:18:22.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.263+0000 7fabe77fe700 1 -- 172.21.15.6:0/3568215711 learned_addr learned my addr 172.21.15.6:0/3568215711 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.263+0000 7fabe7fff700 1 --2- 172.21.15.6:0/3568215711 >> v2:172.21.15.175:3300/0 conn(0x7fabe80cf7e0 0x7fabe80b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.263+0000 7fabe6ffd700 1 -- 172.21.15.6:0/3568215711 >> v2:172.21.15.175:3300/0 conn(0x7fabe80cf7e0 msgr2=0x7fabe80b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.263+0000 7fabe6ffd700 1 --2- 172.21.15.6:0/3568215711 >> v2:172.21.15.175:3300/0 conn(0x7fabe80cf7e0 0x7fabe80b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.263+0000 7fabe6ffd700 1 -- 172.21.15.6:0/3568215711 >> v1:172.21.15.6:6789/0 conn(0x7fabe80d0400 legacy=0x7fabe80b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.263+0000 7fabe6ffd700 1 -- 172.21.15.6:0/3568215711 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe80ced80 con 0x7fabe80ccd40 2023-10-06T02:18:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.263+0000 7fabe67fc700 1 -- 172.21.15.6:0/3568215711 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156484327 0 0) 0x7fabe815dd40 con 0x7fabe80d0400 2023-10-06T02:18:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.263+0000 7fabe6ffd700 1 --2- 172.21.15.6:0/3568215711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabe80ccd40 0x7fabe80cf2a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fabe80cdf50 tx=0x7fabd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6346fe9406cd00dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.263+0000 7fabe67fc700 1 -- 172.21.15.6:0/3568215711 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd000b6b0 con 0x7fabe80ccd40 2023-10-06T02:18:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.263+0000 7fabe67fc700 1 -- 172.21.15.6:0/3568215711 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd000b810 con 0x7fabe80ccd40 2023-10-06T02:18:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.263+0000 7fabe67fc700 1 -- 172.21.15.6:0/3568215711 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd000bbb0 con 0x7fabe80ccd40 2023-10-06T02:18:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.264+0000 7fabedefb700 1 -- 172.21.15.6:0/3568215711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabe80ccd40 msgr2=0x7fabe80cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.264+0000 7fabedefb700 1 --2- 172.21.15.6:0/3568215711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabe80ccd40 0x7fabe80cf2a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fabe80cdf50 tx=0x7fabd00091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.264+0000 7fabedefb700 1 -- 172.21.15.6:0/3568215711 shutdown_connections 2023-10-06T02:18:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.264+0000 7fabedefb700 1 --2- 172.21.15.6:0/3568215711 >> v2:172.21.15.175:3300/0 conn(0x7fabe80cf7e0 0x7fabe80b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.264+0000 7fabedefb700 1 --2- 172.21.15.6:0/3568215711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabe80ccd40 0x7fabe80cf2a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.264+0000 7fabedefb700 1 -- 172.21.15.6:0/3568215711 >> 172.21.15.6:0/3568215711 conn(0x7fabe806a220 msgr2=0x7fabe806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.264+0000 7fabedefb700 1 -- 172.21.15.6:0/3568215711 shutdown_connections 2023-10-06T02:18:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.264+0000 7fabedefb700 1 -- 172.21.15.6:0/3568215711 wait complete. 2023-10-06T02:18:22.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.265+0000 7fabedefb700 1 Processor -- start 2023-10-06T02:18:22.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.265+0000 7fabedefb700 1 -- start start 2023-10-06T02:18:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.266+0000 7fabedefb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabe80ccd40 0x7fabe814d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.266+0000 7fabedefb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabe80cf7e0 0x7fabe814ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.266+0000 7fabedefb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabe80d0400 0x7fabe8150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.266+0000 7fabedefb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe814ef40 con 0x7fabe80d0400 2023-10-06T02:18:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.266+0000 7fabedefb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe814f220 con 0x7fabe80ccd40 2023-10-06T02:18:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.266+0000 7fabedefb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe814f500 con 0x7fabe80cf7e0 2023-10-06T02:18:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.266+0000 7fabe7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabe80d0400 0x7fabe8150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.266+0000 7fabe7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabe80d0400 0x7fabe8150520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55956/0 (socket says 172.21.15.6:55956) 2023-10-06T02:18:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.266+0000 7fabe7fff700 1 -- 172.21.15.6:0/4041240842 learned_addr learned my addr 172.21.15.6:0/4041240842 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.266+0000 7fabe77fe700 1 --2- 172.21.15.6:0/4041240842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabe80ccd40 0x7fabe814d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.266+0000 7fabe6ffd700 1 --2- 172.21.15.6:0/4041240842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabe80cf7e0 0x7fabe814ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.266+0000 7fabe7fff700 1 -- 172.21.15.6:0/4041240842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabe80cf7e0 msgr2=0x7fabe814ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.266+0000 7fabe7fff700 1 --2- 172.21.15.6:0/4041240842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabe80cf7e0 0x7fabe814ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.266+0000 7fabe7fff700 1 -- 172.21.15.6:0/4041240842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabe80ccd40 msgr2=0x7fabe814d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.266+0000 7fabe7fff700 1 --2- 172.21.15.6:0/4041240842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabe80ccd40 0x7fabe814d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.266+0000 7fabe7fff700 1 -- 172.21.15.6:0/4041240842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd0009420 con 0x7fabe80d0400 2023-10-06T02:18:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.266+0000 7fabe7fff700 1 --2- 172.21.15.6:0/4041240842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabe80d0400 0x7fabe8150520 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fabe000d890 tx=0x7fabe0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.267+0000 7fabdf7fe700 1 -- 172.21.15.6:0/4041240842 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe00125f0 con 0x7fabe80d0400 2023-10-06T02:18:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.267+0000 7fabdf7fe700 1 -- 172.21.15.6:0/4041240842 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe0012770 con 0x7fabe80d0400 2023-10-06T02:18:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.267+0000 7fabedefb700 1 -- 172.21.15.6:0/4041240842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe814f7e0 con 0x7fabe80d0400 2023-10-06T02:18:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.267+0000 7fabdf7fe700 1 -- 172.21.15.6:0/4041240842 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe0012b30 con 0x7fabe80d0400 2023-10-06T02:18:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.267+0000 7fabedefb700 1 -- 172.21.15.6:0/4041240842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe814df30 con 0x7fabe80d0400 2023-10-06T02:18:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.268+0000 7fabedefb700 1 -- 172.21.15.6:0/4041240842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe814e120 con 0x7fabe80d0400 2023-10-06T02:18:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.268+0000 7fabdf7fe700 1 -- 172.21.15.6:0/4041240842 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fabe001e460 con 0x7fabe80d0400 2023-10-06T02:18:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.268+0000 7fabdf7fe700 1 --2- 172.21.15.6:0/4041240842 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fabc8066f30 0x7fabc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.269+0000 7fabdf7fe700 1 -- 172.21.15.6:0/4041240842 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fabe0084e40 con 0x7fabe80d0400 2023-10-06T02:18:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.269+0000 7fabe77fe700 1 --2- 172.21.15.6:0/4041240842 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fabc8066f30 0x7fabc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.269+0000 7fabe77fe700 1 --2- 172.21.15.6:0/4041240842 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fabc8066f30 0x7fabc80693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fabd8003070 tx=0x7fabd8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.273+0000 7fabdf7fe700 1 -- 172.21.15.6:0/4041240842 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabe0051c60 con 0x7fabe80d0400 2023-10-06T02:18:22.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.463+0000 7fabedefb700 1 -- 172.21.15.6:0/4041240842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fabe80ce6c0 con 0x7fabe80d0400 2023-10-06T02:18:22.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.464+0000 7fabdf7fe700 1 -- 172.21.15.6:0/4041240842 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fabe0055280 con 0x7fabe80d0400 2023-10-06T02:18:22.465 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:18:22.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.466+0000 7fabedefb700 1 -- 172.21.15.6:0/4041240842 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fabc8066f30 msgr2=0x7fabc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.466+0000 7fabedefb700 1 --2- 172.21.15.6:0/4041240842 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fabc8066f30 0x7fabc80693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fabd8003070 tx=0x7fabd8009040 comp rx=0 tx=0).stop 2023-10-06T02:18:22.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.466+0000 7fabedefb700 1 -- 172.21.15.6:0/4041240842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabe80d0400 msgr2=0x7fabe8150520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.466+0000 7fabedefb700 1 --2- 172.21.15.6:0/4041240842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabe80d0400 0x7fabe8150520 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fabe000d890 tx=0x7fabe0008040 comp rx=0 tx=0).stop 2023-10-06T02:18:22.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.466+0000 7fabedefb700 1 -- 172.21.15.6:0/4041240842 shutdown_connections 2023-10-06T02:18:22.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.466+0000 7fabedefb700 1 --2- 172.21.15.6:0/4041240842 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fabc8066f30 0x7fabc80693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.466+0000 7fabedefb700 1 --2- 172.21.15.6:0/4041240842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabe80d0400 0x7fabe8150520 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.466+0000 7fabedefb700 1 --2- 172.21.15.6:0/4041240842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabe80ccd40 0x7fabe814d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.466+0000 7fabedefb700 1 --2- 172.21.15.6:0/4041240842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabe80cf7e0 0x7fabe814ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.466+0000 7fabedefb700 1 -- 172.21.15.6:0/4041240842 >> 172.21.15.6:0/4041240842 conn(0x7fabe806a220 msgr2=0x7fabe80b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:22.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.466+0000 7fabedefb700 1 -- 172.21.15.6:0/4041240842 shutdown_connections 2023-10-06T02:18:22.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.466+0000 7fabedefb700 1 -- 172.21.15.6:0/4041240842 wait complete. 2023-10-06T02:18:22.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:18:22.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.599+0000 7f085a973700 1 Processor -- start 2023-10-06T02:18:22.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.599+0000 7f085a973700 1 -- start start 2023-10-06T02:18:22.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.600+0000 7f085a973700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f085406a380 0x7f08540cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.600+0000 7f085a973700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08540cae80 con 0x7f0854159170 2023-10-06T02:18:22.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.600+0000 7f085a973700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085415dcd0 con 0x7f085406a750 2023-10-06T02:18:22.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.600+0000 7f085a973700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08540cc3d0 con 0x7f085406a380 2023-10-06T02:18:22.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.600+0000 7f0858f10700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0854159170 0x7f08541595d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45720/0 (socket says 172.21.15.6:45720) 2023-10-06T02:18:22.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.600+0000 7f0858f10700 1 -- 172.21.15.6:0/2538691925 learned_addr learned my addr 172.21.15.6:0/2538691925 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:22.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.600+0000 7f0853fff700 1 --2- 172.21.15.6:0/2538691925 >> v2:172.21.15.175:3300/0 conn(0x7f085406a380 0x7f08540cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.601+0000 7f0852ffd700 1 -- 172.21.15.6:0/2538691925 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168351447 0 0) 0x7f08540cae80 con 0x7f0854159170 2023-10-06T02:18:22.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.601+0000 7f0852ffd700 1 -- 172.21.15.6:0/2538691925 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f083c003570 con 0x7f0854159170 2023-10-06T02:18:22.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.601+0000 7f0852ffd700 1 -- 172.21.15.6:0/2538691925 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682513168 0 0) 0x7f085415dcd0 con 0x7f085406a750 2023-10-06T02:18:22.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.601+0000 7f0852ffd700 1 -- 172.21.15.6:0/2538691925 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08540cae80 con 0x7f085406a750 2023-10-06T02:18:22.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.601+0000 7f0853fff700 1 -- 172.21.15.6:0/2538691925 >> v1:172.21.15.175:6789/0 conn(0x7f085406a750 legacy=0x7f085415d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.601+0000 7f0853fff700 1 -- 172.21.15.6:0/2538691925 >> v1:172.21.15.6:6789/0 conn(0x7f0854159170 legacy=0x7f08541595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.601+0000 7f0853fff700 1 -- 172.21.15.6:0/2538691925 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085415dfb0 con 0x7f085406a380 2023-10-06T02:18:22.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.601+0000 7f0853fff700 1 --2- 172.21.15.6:0/2538691925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085406a380 0x7f08540cb310 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f08480098e0 tx=0x7f08480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dd66209d425e256 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:22.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.601+0000 7f0852ffd700 1 -- 172.21.15.6:0/2538691925 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848011630 con 0x7f085406a380 2023-10-06T02:18:22.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.601+0000 7f0852ffd700 1 -- 172.21.15.6:0/2538691925 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0848011790 con 0x7f085406a380 2023-10-06T02:18:22.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.601+0000 7f0852ffd700 1 -- 172.21.15.6:0/2538691925 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848011b30 con 0x7f085406a380 2023-10-06T02:18:22.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.602+0000 7f085a973700 1 -- 172.21.15.6:0/2538691925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085406a380 msgr2=0x7f08540cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.602+0000 7f085a973700 1 --2- 172.21.15.6:0/2538691925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085406a380 0x7f08540cb310 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f08480098e0 tx=0x7f08480091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.602+0000 7f085a973700 1 -- 172.21.15.6:0/2538691925 shutdown_connections 2023-10-06T02:18:22.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.602+0000 7f085a973700 1 --2- 172.21.15.6:0/2538691925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085406a380 0x7f08540cb310 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.602+0000 7f085a973700 1 -- 172.21.15.6:0/2538691925 >> 172.21.15.6:0/2538691925 conn(0x7f08540d0350 msgr2=0x7f08540d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:22.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.602+0000 7f085a973700 1 -- 172.21.15.6:0/2538691925 shutdown_connections 2023-10-06T02:18:22.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.602+0000 7f085a973700 1 -- 172.21.15.6:0/2538691925 wait complete. 2023-10-06T02:18:22.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.603+0000 7f085a973700 1 Processor -- start 2023-10-06T02:18:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.603+0000 7f085a973700 1 -- start start 2023-10-06T02:18:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.604+0000 7f085a973700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f085406a380 0x7f0854144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.604+0000 7f085a973700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085406a750 0x7f085415c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.604+0000 7f085a973700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0854159170 0x7f085415c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.604+0000 7f085a973700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085416b1b0 con 0x7f0854159170 2023-10-06T02:18:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.604+0000 7f085a973700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085415cb50 con 0x7f085406a750 2023-10-06T02:18:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.604+0000 7f085a973700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08540b1eb0 con 0x7f085406a380 2023-10-06T02:18:22.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.604+0000 7f0858f10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0854159170 0x7f085415c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.604+0000 7f0858f10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0854159170 0x7f085415c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55962/0 (socket says 172.21.15.6:55962) 2023-10-06T02:18:22.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.604+0000 7f0858f10700 1 -- 172.21.15.6:0/1356985442 learned_addr learned my addr 172.21.15.6:0/1356985442 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:22.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.604+0000 7f0853fff700 1 --2- 172.21.15.6:0/1356985442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f085406a380 0x7f0854144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.604+0000 7f08537fe700 1 --2- 172.21.15.6:0/1356985442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085406a750 0x7f085415c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.604+0000 7f0858f10700 1 -- 172.21.15.6:0/1356985442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f085406a380 msgr2=0x7f0854144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.604+0000 7f0858f10700 1 --2- 172.21.15.6:0/1356985442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f085406a380 0x7f0854144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.604+0000 7f0858f10700 1 -- 172.21.15.6:0/1356985442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085406a750 msgr2=0x7f085415c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.604+0000 7f0858f10700 1 --2- 172.21.15.6:0/1356985442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085406a750 0x7f085415c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.604+0000 7f0858f10700 1 -- 172.21.15.6:0/1356985442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0848009420 con 0x7f0854159170 2023-10-06T02:18:22.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.604+0000 7f0858f10700 1 --2- 172.21.15.6:0/1356985442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0854159170 0x7f085415c610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f084c00cd00 tx=0x7f084c001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:22.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.605+0000 7f083bfff700 1 -- 172.21.15.6:0/1356985442 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c00ce00 con 0x7f0854159170 2023-10-06T02:18:22.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.605+0000 7f083bfff700 1 -- 172.21.15.6:0/1356985442 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084c00aac0 con 0x7f0854159170 2023-10-06T02:18:22.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.605+0000 7f085a973700 1 -- 172.21.15.6:0/1356985442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08540b2190 con 0x7f0854159170 2023-10-06T02:18:22.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.605+0000 7f083bfff700 1 -- 172.21.15.6:0/1356985442 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c00ae80 con 0x7f0854159170 2023-10-06T02:18:22.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.605+0000 7f085a973700 1 -- 172.21.15.6:0/1356985442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08540b2750 con 0x7f0854159170 2023-10-06T02:18:22.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.606+0000 7f085a973700 1 -- 172.21.15.6:0/1356985442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085416b360 con 0x7f0854159170 2023-10-06T02:18:22.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.606+0000 7f083bfff700 1 -- 172.21.15.6:0/1356985442 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f084c007300 con 0x7f0854159170 2023-10-06T02:18:22.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.606+0000 7f083bfff700 1 --2- 172.21.15.6:0/1356985442 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0840066f30 0x7f08400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.607+0000 7f083bfff700 1 -- 172.21.15.6:0/1356985442 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f084c084cb0 con 0x7f0854159170 2023-10-06T02:18:22.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.607+0000 7f0853fff700 1 --2- 172.21.15.6:0/1356985442 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0840066f30 0x7f08400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.607+0000 7f0853fff700 1 --2- 172.21.15.6:0/1356985442 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0840066f30 0x7f08400693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08480093f0 tx=0x7f0848017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:22.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.611+0000 7f083bfff700 1 -- 172.21.15.6:0/1356985442 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f085416b360 con 0x7f0854159170 2023-10-06T02:18:22.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.805+0000 7f085a973700 1 -- 172.21.15.6:0/1356985442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f085416b2f0 con 0x7f0854159170 2023-10-06T02:18:22.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.805+0000 7f083bfff700 1 -- 172.21.15.6:0/1356985442 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f084c051b50 con 0x7f0854159170 2023-10-06T02:18:22.807 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-06T02:18:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.808+0000 7f085a973700 1 -- 172.21.15.6:0/1356985442 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0840066f30 msgr2=0x7f08400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.808+0000 7f085a973700 1 --2- 172.21.15.6:0/1356985442 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0840066f30 0x7f08400693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08480093f0 tx=0x7f0848017000 comp rx=0 tx=0).stop 2023-10-06T02:18:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.808+0000 7f085a973700 1 -- 172.21.15.6:0/1356985442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0854159170 msgr2=0x7f085415c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.808+0000 7f085a973700 1 --2- 172.21.15.6:0/1356985442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0854159170 0x7f085415c610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f084c00cd00 tx=0x7f084c001ac0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.808+0000 7f085a973700 1 -- 172.21.15.6:0/1356985442 shutdown_connections 2023-10-06T02:18:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.808+0000 7f085a973700 1 --2- 172.21.15.6:0/1356985442 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0840066f30 0x7f08400693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.808+0000 7f085a973700 1 --2- 172.21.15.6:0/1356985442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0854159170 0x7f085415c610 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.808+0000 7f085a973700 1 --2- 172.21.15.6:0/1356985442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f085406a380 0x7f0854144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.808+0000 7f085a973700 1 --2- 172.21.15.6:0/1356985442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f085406a750 0x7f085415c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.808+0000 7f085a973700 1 -- 172.21.15.6:0/1356985442 >> 172.21.15.6:0/1356985442 conn(0x7f08540d0350 msgr2=0x7f0854157370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.808+0000 7f085a973700 1 -- 172.21.15.6:0/1356985442 shutdown_connections 2023-10-06T02:18:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.808+0000 7f085a973700 1 -- 172.21.15.6:0/1356985442 wait complete. 2023-10-06T02:18:22.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T02:18:22.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.942+0000 7fda6c993700 1 Processor -- start 2023-10-06T02:18:22.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.942+0000 7fda6c993700 1 -- start start 2023-10-06T02:18:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.943+0000 7fda6c993700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda680cd400 0x7fda680b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.943+0000 7fda6c993700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda680cd7d0 0x7fda680b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.943+0000 7fda6c993700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fda680b0810 0x7fda680d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.943+0000 7fda6c993700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda680b29a0 con 0x7fda680cd7d0 2023-10-06T02:18:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.943+0000 7fda6c993700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda680af770 con 0x7fda680b0810 2023-10-06T02:18:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.943+0000 7fda6c993700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda680afa50 con 0x7fda680cd400 2023-10-06T02:18:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.943+0000 7fda66ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda680cd7d0 0x7fda680b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.943+0000 7fda66ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda680cd7d0 0x7fda680b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55966/0 (socket says 172.21.15.6:55966) 2023-10-06T02:18:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.943+0000 7fda66ffd700 1 -- 172.21.15.6:0/711804520 learned_addr learned my addr 172.21.15.6:0/711804520 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.943+0000 7fda66ffd700 1 -- 172.21.15.6:0/711804520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda680cd400 msgr2=0x7fda680b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.943+0000 7fda677fe700 1 --2- 172.21.15.6:0/711804520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda680cd400 0x7fda680b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.943+0000 7fda66ffd700 1 --2- 172.21.15.6:0/711804520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda680cd400 0x7fda680b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.943+0000 7fda66ffd700 1 -- 172.21.15.6:0/711804520 >> v2:172.21.15.175:3300/0 conn(0x7fda680b0810 msgr2=0x7fda680d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.943+0000 7fda67fff700 1 --2- 172.21.15.6:0/711804520 >> v2:172.21.15.175:3300/0 conn(0x7fda680b0810 0x7fda680d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.943+0000 7fda66ffd700 1 --2- 172.21.15.6:0/711804520 >> v2:172.21.15.175:3300/0 conn(0x7fda680b0810 0x7fda680d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.943+0000 7fda66ffd700 1 -- 172.21.15.6:0/711804520 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda680afd30 con 0x7fda680cd7d0 2023-10-06T02:18:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.943+0000 7fda67fff700 1 --2- 172.21.15.6:0/711804520 >> v2:172.21.15.175:3300/0 conn(0x7fda680b0810 0x7fda680d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.944+0000 7fda66ffd700 1 --2- 172.21.15.6:0/711804520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680cd7d0 0x7fda680b2460 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fda681572f0 tx=0x7fda5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8949358c294cad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.944+0000 7fda667fc700 1 -- 172.21.15.6:0/711804520 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c00b860 con 0x7fda680cd7d0 2023-10-06T02:18:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.944+0000 7fda667fc700 1 -- 172.21.15.6:0/711804520 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c00b9c0 con 0x7fda680cd7d0 2023-10-06T02:18:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.944+0000 7fda667fc700 1 -- 172.21.15.6:0/711804520 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c00bd80 con 0x7fda680cd7d0 2023-10-06T02:18:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.944+0000 7fda6c993700 1 -- 172.21.15.6:0/711804520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680cd7d0 msgr2=0x7fda680b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.944+0000 7fda6c993700 1 --2- 172.21.15.6:0/711804520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680cd7d0 0x7fda680b2460 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fda681572f0 tx=0x7fda5c009250 comp rx=0 tx=0).stop 2023-10-06T02:18:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.944+0000 7fda6c993700 1 -- 172.21.15.6:0/711804520 shutdown_connections 2023-10-06T02:18:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.944+0000 7fda6c993700 1 --2- 172.21.15.6:0/711804520 >> v2:172.21.15.175:3300/0 conn(0x7fda680b0810 0x7fda680d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.944+0000 7fda6c993700 1 --2- 172.21.15.6:0/711804520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda680cd400 0x7fda680b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.944+0000 7fda6c993700 1 --2- 172.21.15.6:0/711804520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680cd7d0 0x7fda680b2460 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.944+0000 7fda6c993700 1 -- 172.21.15.6:0/711804520 >> 172.21.15.6:0/711804520 conn(0x7fda6806a110 msgr2=0x7fda6806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.944+0000 7fda6c993700 1 -- 172.21.15.6:0/711804520 shutdown_connections 2023-10-06T02:18:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.944+0000 7fda6c993700 1 -- 172.21.15.6:0/711804520 wait complete. 2023-10-06T02:18:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.946+0000 7fda6c993700 1 Processor -- start 2023-10-06T02:18:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.946+0000 7fda6c993700 1 -- start start 2023-10-06T02:18:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.946+0000 7fda6c993700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680b0810 0x7fda6816abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.946+0000 7fda6c993700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda680cd400 0x7fda68169680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.946+0000 7fda6c993700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda68169bc0 0x7fda680b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.946+0000 7fda6c993700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6816a730 con 0x7fda680b0810 2023-10-06T02:18:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.946+0000 7fda6c993700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda680c4a30 con 0x7fda680cd400 2023-10-06T02:18:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.946+0000 7fda6c993700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6816a0e0 con 0x7fda68169bc0 2023-10-06T02:18:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.946+0000 7fda677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680b0810 0x7fda6816abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.946+0000 7fda677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680b0810 0x7fda6816abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55974/0 (socket says 172.21.15.6:55974) 2023-10-06T02:18:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.946+0000 7fda677fe700 1 -- 172.21.15.6:0/2220624737 learned_addr learned my addr 172.21.15.6:0/2220624737 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.947+0000 7fda66ffd700 1 --2- 172.21.15.6:0/2220624737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda680cd400 0x7fda68169680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.947+0000 7fda67fff700 1 --2- 172.21.15.6:0/2220624737 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda68169bc0 0x7fda680b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.947+0000 7fda677fe700 1 -- 172.21.15.6:0/2220624737 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda68169bc0 msgr2=0x7fda680b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.947+0000 7fda677fe700 1 --2- 172.21.15.6:0/2220624737 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda68169bc0 0x7fda680b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.947+0000 7fda677fe700 1 -- 172.21.15.6:0/2220624737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda680cd400 msgr2=0x7fda68169680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.947+0000 7fda677fe700 1 --2- 172.21.15.6:0/2220624737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda680cd400 0x7fda68169680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.947+0000 7fda677fe700 1 -- 172.21.15.6:0/2220624737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c0094f0 con 0x7fda680b0810 2023-10-06T02:18:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.947+0000 7fda67fff700 1 --2- 172.21.15.6:0/2220624737 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda68169bc0 0x7fda680b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.947+0000 7fda66ffd700 1 --2- 172.21.15.6:0/2220624737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda680cd400 0x7fda68169680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.947+0000 7fda677fe700 1 --2- 172.21.15.6:0/2220624737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680b0810 0x7fda6816abc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fda5800c850 tx=0x7fda58008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.947+0000 7fda4f7fe700 1 -- 172.21.15.6:0/2220624737 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58011600 con 0x7fda680b0810 2023-10-06T02:18:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.947+0000 7fda4f7fe700 1 -- 172.21.15.6:0/2220624737 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda58011780 con 0x7fda680b0810 2023-10-06T02:18:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.947+0000 7fda6c993700 1 -- 172.21.15.6:0/2220624737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6816a3c0 con 0x7fda680b0810 2023-10-06T02:18:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.947+0000 7fda4f7fe700 1 -- 172.21.15.6:0/2220624737 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58011b40 con 0x7fda680b0810 2023-10-06T02:18:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.947+0000 7fda6c993700 1 -- 172.21.15.6:0/2220624737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda680b4760 con 0x7fda680b0810 2023-10-06T02:18:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.948+0000 7fda6c993700 1 -- 172.21.15.6:0/2220624737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda68071540 con 0x7fda680b0810 2023-10-06T02:18:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.948+0000 7fda4f7fe700 1 -- 172.21.15.6:0/2220624737 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda580073b0 con 0x7fda680b0810 2023-10-06T02:18:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.949+0000 7fda4f7fe700 1 --2- 172.21.15.6:0/2220624737 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda54066f30 0x7fda540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.949+0000 7fda4f7fe700 1 -- 172.21.15.6:0/2220624737 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fda580847a0 con 0x7fda680b0810 2023-10-06T02:18:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.949+0000 7fda66ffd700 1 --2- 172.21.15.6:0/2220624737 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda54066f30 0x7fda540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.950+0000 7fda66ffd700 1 --2- 172.21.15.6:0/2220624737 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda54066f30 0x7fda540693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fda681572f0 tx=0x7fda5c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:22.953+0000 7fda4f7fe700 1 -- 172.21.15.6:0/2220624737 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda580515c0 con 0x7fda680b0810 2023-10-06T02:18:23.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.146+0000 7fda6c993700 1 -- 172.21.15.6:0/2220624737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fda680cc010 con 0x7fda680b0810 2023-10-06T02:18:23.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.146+0000 7fda4f7fe700 1 -- 172.21.15.6:0/2220624737 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fda58054be0 con 0x7fda680b0810 2023-10-06T02:18:23.148 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:18:23.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.148+0000 7fda6c993700 1 -- 172.21.15.6:0/2220624737 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda54066f30 msgr2=0x7fda540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:23.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.148+0000 7fda6c993700 1 --2- 172.21.15.6:0/2220624737 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda54066f30 0x7fda540693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fda681572f0 tx=0x7fda5c017000 comp rx=0 tx=0).stop 2023-10-06T02:18:23.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.148+0000 7fda6c993700 1 -- 172.21.15.6:0/2220624737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680b0810 msgr2=0x7fda6816abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:23.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.148+0000 7fda6c993700 1 --2- 172.21.15.6:0/2220624737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680b0810 0x7fda6816abc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fda5800c850 tx=0x7fda58008040 comp rx=0 tx=0).stop 2023-10-06T02:18:23.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.148+0000 7fda6c993700 1 -- 172.21.15.6:0/2220624737 shutdown_connections 2023-10-06T02:18:23.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.148+0000 7fda6c993700 1 --2- 172.21.15.6:0/2220624737 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda68169bc0 0x7fda680b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.148+0000 7fda6c993700 1 --2- 172.21.15.6:0/2220624737 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda54066f30 0x7fda540693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.148+0000 7fda6c993700 1 --2- 172.21.15.6:0/2220624737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680b0810 0x7fda6816abc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.148+0000 7fda6c993700 1 --2- 172.21.15.6:0/2220624737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda680cd400 0x7fda68169680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.148+0000 7fda6c993700 1 -- 172.21.15.6:0/2220624737 >> 172.21.15.6:0/2220624737 conn(0x7fda6806a110 msgr2=0x7fda68155670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:23.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.148+0000 7fda6c993700 1 -- 172.21.15.6:0/2220624737 shutdown_connections 2023-10-06T02:18:23.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.148+0000 7fda6c993700 1 -- 172.21.15.6:0/2220624737 wait complete. 2023-10-06T02:18:23.161 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:18:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.279+0000 7fc3e1a07700 1 Processor -- start 2023-10-06T02:18:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.279+0000 7fc3e1a07700 1 -- start start 2023-10-06T02:18:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.280+0000 7fc3e1a07700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc3dc0b3c50 0x7fc3dc15b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.280+0000 7fc3e1a07700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3dc15bcd0 0x7fc3dc15a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.280+0000 7fc3e1a07700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3dc0afb90 con 0x7fc3dc15b3c0 2023-10-06T02:18:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.280+0000 7fc3e1a07700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3dc0b2310 con 0x7fc3dc15bcd0 2023-10-06T02:18:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.280+0000 7fc3e1a07700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3dc0b25f0 con 0x7fc3dc0b3c50 2023-10-06T02:18:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.280+0000 7fc3db7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3dc15bcd0 0x7fc3dc15a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.280+0000 7fc3daffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc3dc15b3c0 0x7fc3dc097d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45730/0 (socket says 172.21.15.6:45730) 2023-10-06T02:18:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.280+0000 7fc3daffd700 1 -- 172.21.15.6:0/695968106 learned_addr learned my addr 172.21.15.6:0/695968106 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.280+0000 7fc3d27fc700 1 --2- 172.21.15.6:0/695968106 >> v2:172.21.15.175:3300/0 conn(0x7fc3dc0b3c50 0x7fc3dc15b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.280+0000 7fc3db7fe700 1 -- 172.21.15.6:0/695968106 >> v2:172.21.15.175:3300/0 conn(0x7fc3dc0b3c50 msgr2=0x7fc3dc15b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.280+0000 7fc3db7fe700 1 --2- 172.21.15.6:0/695968106 >> v2:172.21.15.175:3300/0 conn(0x7fc3dc0b3c50 0x7fc3dc15b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.280+0000 7fc3db7fe700 1 -- 172.21.15.6:0/695968106 >> v1:172.21.15.6:6789/0 conn(0x7fc3dc15b3c0 legacy=0x7fc3dc097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.280+0000 7fc3db7fe700 1 -- 172.21.15.6:0/695968106 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc0af820 con 0x7fc3dc15bcd0 2023-10-06T02:18:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.280+0000 7fc3da7fc700 1 -- 172.21.15.6:0/695968106 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622506420 0 0) 0x7fc3dc0afb90 con 0x7fc3dc15b3c0 2023-10-06T02:18:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.281+0000 7fc3db7fe700 1 --2- 172.21.15.6:0/695968106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3dc15bcd0 0x7fc3dc15a590 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc06f9c0 tx=0x7fc3d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218598c98dcdec6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.281+0000 7fc3da7fc700 1 -- 172.21.15.6:0/695968106 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d400e070 con 0x7fc3dc15bcd0 2023-10-06T02:18:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.281+0000 7fc3da7fc700 1 -- 172.21.15.6:0/695968106 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d400bc30 con 0x7fc3dc15bcd0 2023-10-06T02:18:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.281+0000 7fc3da7fc700 1 -- 172.21.15.6:0/695968106 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4012430 con 0x7fc3dc15bcd0 2023-10-06T02:18:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.281+0000 7fc3e1a07700 1 -- 172.21.15.6:0/695968106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3dc15bcd0 msgr2=0x7fc3dc15a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.281+0000 7fc3e1a07700 1 --2- 172.21.15.6:0/695968106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3dc15bcd0 0x7fc3dc15a590 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc06f9c0 tx=0x7fc3d4009780 comp rx=0 tx=0).stop 2023-10-06T02:18:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.281+0000 7fc3e1a07700 1 -- 172.21.15.6:0/695968106 shutdown_connections 2023-10-06T02:18:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.281+0000 7fc3e1a07700 1 --2- 172.21.15.6:0/695968106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3dc15bcd0 0x7fc3dc15a590 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.281+0000 7fc3e1a07700 1 --2- 172.21.15.6:0/695968106 >> v2:172.21.15.175:3300/0 conn(0x7fc3dc0b3c50 0x7fc3dc15b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.281+0000 7fc3e1a07700 1 -- 172.21.15.6:0/695968106 >> 172.21.15.6:0/695968106 conn(0x7fc3dc067910 msgr2=0x7fc3dc0ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.281+0000 7fc3e1a07700 1 -- 172.21.15.6:0/695968106 shutdown_connections 2023-10-06T02:18:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.281+0000 7fc3e1a07700 1 -- 172.21.15.6:0/695968106 wait complete. 2023-10-06T02:18:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.283+0000 7fc3e1a07700 1 Processor -- start 2023-10-06T02:18:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.283+0000 7fc3e1a07700 1 -- start start 2023-10-06T02:18:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.283+0000 7fc3e1a07700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3dc0b3c50 0x7fc3dc0ce640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.283+0000 7fc3e1a07700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3dc15b3c0 0x7fc3dc157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.283+0000 7fc3e1a07700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc15bcd0 0x7fc3dc0aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.283+0000 7fc3e1a07700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc09b010 con 0x7fc3dc0b3c50 2023-10-06T02:18:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.283+0000 7fc3e1a07700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc09bc50 con 0x7fc3dc15b3c0 2023-10-06T02:18:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.283+0000 7fc3e1a07700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc16b700 con 0x7fc3dc15bcd0 2023-10-06T02:18:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.283+0000 7fc3daffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3dc0b3c50 0x7fc3dc0ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.283+0000 7fc3daffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3dc0b3c50 0x7fc3dc0ce640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55984/0 (socket says 172.21.15.6:55984) 2023-10-06T02:18:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.283+0000 7fc3daffd700 1 -- 172.21.15.6:0/3088006555 learned_addr learned my addr 172.21.15.6:0/3088006555 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.284+0000 7fc3d27fc700 1 --2- 172.21.15.6:0/3088006555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3dc15b3c0 0x7fc3dc157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.284+0000 7fc3daffd700 1 -- 172.21.15.6:0/3088006555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc15bcd0 msgr2=0x7fc3dc0aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.284+0000 7fc3db7fe700 1 --2- 172.21.15.6:0/3088006555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc15bcd0 0x7fc3dc0aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.284+0000 7fc3daffd700 1 --2- 172.21.15.6:0/3088006555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc15bcd0 0x7fc3dc0aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.284+0000 7fc3daffd700 1 -- 172.21.15.6:0/3088006555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3dc15b3c0 msgr2=0x7fc3dc157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.284+0000 7fc3daffd700 1 --2- 172.21.15.6:0/3088006555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3dc15b3c0 0x7fc3dc157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.284+0000 7fc3daffd700 1 -- 172.21.15.6:0/3088006555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d4009a20 con 0x7fc3dc0b3c50 2023-10-06T02:18:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.284+0000 7fc3d27fc700 1 --2- 172.21.15.6:0/3088006555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3dc15b3c0 0x7fc3dc157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.284+0000 7fc3db7fe700 1 --2- 172.21.15.6:0/3088006555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc15bcd0 0x7fc3dc0aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.284+0000 7fc3daffd700 1 --2- 172.21.15.6:0/3088006555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3dc0b3c50 0x7fc3dc0ce640 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00c5e0 tx=0x7fc3cc007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.284+0000 7fc3d37fe700 1 -- 172.21.15.6:0/3088006555 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc0072e0 con 0x7fc3dc0b3c50 2023-10-06T02:18:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.284+0000 7fc3d37fe700 1 -- 172.21.15.6:0/3088006555 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc007440 con 0x7fc3dc0b3c50 2023-10-06T02:18:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.284+0000 7fc3e1a07700 1 -- 172.21.15.6:0/3088006555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3dc09a6e0 con 0x7fc3dc0b3c50 2023-10-06T02:18:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.284+0000 7fc3d37fe700 1 -- 172.21.15.6:0/3088006555 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc0057f0 con 0x7fc3dc0b3c50 2023-10-06T02:18:23.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.284+0000 7fc3e1a07700 1 -- 172.21.15.6:0/3088006555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3dc09aca0 con 0x7fc3dc0b3c50 2023-10-06T02:18:23.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.285+0000 7fc3e1a07700 1 -- 172.21.15.6:0/3088006555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3dc06e8d0 con 0x7fc3dc0b3c50 2023-10-06T02:18:23.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.286+0000 7fc3d37fe700 1 -- 172.21.15.6:0/3088006555 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc3cc005c00 con 0x7fc3dc0b3c50 2023-10-06T02:18:23.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.286+0000 7fc3d37fe700 1 --2- 172.21.15.6:0/3088006555 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3bc066f30 0x7fc3bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.286+0000 7fc3d37fe700 1 -- 172.21.15.6:0/3088006555 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc3cc083f10 con 0x7fc3dc0b3c50 2023-10-06T02:18:23.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.286+0000 7fc3d27fc700 1 --2- 172.21.15.6:0/3088006555 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3bc066f30 0x7fc3bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.287+0000 7fc3d27fc700 1 --2- 172.21.15.6:0/3088006555 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3bc066f30 0x7fc3bc0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0b21c0 tx=0x7fc3c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:23.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.290+0000 7fc3d37fe700 1 -- 172.21.15.6:0/3088006555 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3cc050d30 con 0x7fc3dc0b3c50 2023-10-06T02:18:23.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.487+0000 7fc3e1a07700 1 -- 172.21.15.6:0/3088006555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3dc04bb80 con 0x7fc3dc0b3c50 2023-10-06T02:18:23.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.488+0000 7fc3d37fe700 1 -- 172.21.15.6:0/3088006555 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fc3cc017070 con 0x7fc3dc0b3c50 2023-10-06T02:18:23.489 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:23.490 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:48.453046+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:18:23.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.490+0000 7fc3e1a07700 1 -- 172.21.15.6:0/3088006555 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3bc066f30 msgr2=0x7fc3bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:23.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.490+0000 7fc3e1a07700 1 --2- 172.21.15.6:0/3088006555 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3bc066f30 0x7fc3bc0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0b21c0 tx=0x7fc3c4008040 comp rx=0 tx=0).stop 2023-10-06T02:18:23.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.490+0000 7fc3e1a07700 1 -- 172.21.15.6:0/3088006555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3dc0b3c50 msgr2=0x7fc3dc0ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:23.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.490+0000 7fc3e1a07700 1 --2- 172.21.15.6:0/3088006555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3dc0b3c50 0x7fc3dc0ce640 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00c5e0 tx=0x7fc3cc007e80 comp rx=0 tx=0).stop 2023-10-06T02:18:23.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.490+0000 7fc3e1a07700 1 -- 172.21.15.6:0/3088006555 shutdown_connections 2023-10-06T02:18:23.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.490+0000 7fc3e1a07700 1 --2- 172.21.15.6:0/3088006555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc15bcd0 0x7fc3dc0aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.490+0000 7fc3e1a07700 1 --2- 172.21.15.6:0/3088006555 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3bc066f30 0x7fc3bc0693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.490+0000 7fc3e1a07700 1 --2- 172.21.15.6:0/3088006555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3dc0b3c50 0x7fc3dc0ce640 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.490+0000 7fc3e1a07700 1 --2- 172.21.15.6:0/3088006555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3dc15b3c0 0x7fc3dc157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.490+0000 7fc3e1a07700 1 -- 172.21.15.6:0/3088006555 >> 172.21.15.6:0/3088006555 conn(0x7fc3dc067910 msgr2=0x7fc3dc06cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:23.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.490+0000 7fc3e1a07700 1 -- 172.21.15.6:0/3088006555 shutdown_connections 2023-10-06T02:18:23.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.490+0000 7fc3e1a07700 1 -- 172.21.15.6:0/3088006555 wait complete. 2023-10-06T02:18:23.504 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:17:41.126402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:17:42.378468+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T02:17:46.053654+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:18:23.504 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:18:23.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.625+0000 7f6f42276700 1 Processor -- start 2023-10-06T02:18:23.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.625+0000 7f6f42276700 1 -- start start 2023-10-06T02:18:23.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.626+0000 7f6f42276700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f3c0ccd40 0x7f6f3c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.626+0000 7f6f42276700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6f3c0cf7e0 0x7f6f3c0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.626+0000 7f6f42276700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c15dd40 con 0x7f6f3c0d0400 2023-10-06T02:18:23.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.626+0000 7f6f42276700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c15e020 con 0x7f6f3c0ccd40 2023-10-06T02:18:23.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.626+0000 7f6f42276700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c0ceaa0 con 0x7f6f3c0cf7e0 2023-10-06T02:18:23.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.626+0000 7f6f3b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f3c0ccd40 0x7f6f3c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.626+0000 7f6f3b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f3c0ccd40 0x7f6f3c0cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55992/0 (socket says 172.21.15.6:55992) 2023-10-06T02:18:23.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.626+0000 7f6f3b7fe700 1 -- 172.21.15.6:0/2156398198 learned_addr learned my addr 172.21.15.6:0/2156398198 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:23.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.627+0000 7f6f40813700 1 --2- 172.21.15.6:0/2156398198 >> v2:172.21.15.175:3300/0 conn(0x7f6f3c0cf7e0 0x7f6f3c0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.627+0000 7f6f3b7fe700 1 -- 172.21.15.6:0/2156398198 >> v2:172.21.15.175:3300/0 conn(0x7f6f3c0cf7e0 msgr2=0x7f6f3c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:23.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.627+0000 7f6f3b7fe700 1 --2- 172.21.15.6:0/2156398198 >> v2:172.21.15.175:3300/0 conn(0x7f6f3c0cf7e0 0x7f6f3c0b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.627+0000 7f6f3b7fe700 1 -- 172.21.15.6:0/2156398198 >> v1:172.21.15.175:6789/0 conn(0x7f6f3c0d0400 legacy=0x7f6f3c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:23.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.627+0000 7f6f3b7fe700 1 -- 172.21.15.6:0/2156398198 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c0ced80 con 0x7f6f3c0ccd40 2023-10-06T02:18:23.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.627+0000 7f6f40813700 1 --2- 172.21.15.6:0/2156398198 >> v2:172.21.15.175:3300/0 conn(0x7f6f3c0cf7e0 0x7f6f3c0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:23.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.627+0000 7f6f3b7fe700 1 --2- 172.21.15.6:0/2156398198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f3c0ccd40 0x7f6f3c0cf2a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0cdf50 tx=0x7f6f24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a30dcee532ea76e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:23.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.627+0000 7f6f3affd700 1 -- 172.21.15.6:0/2156398198 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2400b820 con 0x7f6f3c0ccd40 2023-10-06T02:18:23.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.627+0000 7f6f3affd700 1 -- 172.21.15.6:0/2156398198 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2400b980 con 0x7f6f3c0ccd40 2023-10-06T02:18:23.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.627+0000 7f6f3affd700 1 -- 172.21.15.6:0/2156398198 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2400bd20 con 0x7f6f3c0ccd40 2023-10-06T02:18:23.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.627+0000 7f6f42276700 1 -- 172.21.15.6:0/2156398198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f3c0ccd40 msgr2=0x7f6f3c0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:23.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.627+0000 7f6f42276700 1 --2- 172.21.15.6:0/2156398198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f3c0ccd40 0x7f6f3c0cf2a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0cdf50 tx=0x7f6f24009250 comp rx=0 tx=0).stop 2023-10-06T02:18:23.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.627+0000 7f6f42276700 1 -- 172.21.15.6:0/2156398198 shutdown_connections 2023-10-06T02:18:23.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.627+0000 7f6f42276700 1 --2- 172.21.15.6:0/2156398198 >> v2:172.21.15.175:3300/0 conn(0x7f6f3c0cf7e0 0x7f6f3c0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.627+0000 7f6f42276700 1 --2- 172.21.15.6:0/2156398198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f3c0ccd40 0x7f6f3c0cf2a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.627+0000 7f6f42276700 1 -- 172.21.15.6:0/2156398198 >> 172.21.15.6:0/2156398198 conn(0x7f6f3c06a220 msgr2=0x7f6f3c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:23.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.628+0000 7f6f42276700 1 -- 172.21.15.6:0/2156398198 shutdown_connections 2023-10-06T02:18:23.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.628+0000 7f6f42276700 1 -- 172.21.15.6:0/2156398198 wait complete. 2023-10-06T02:18:23.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.629+0000 7f6f42276700 1 Processor -- start 2023-10-06T02:18:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.629+0000 7f6f42276700 1 -- start start 2023-10-06T02:18:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.629+0000 7f6f42276700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f3c0ccd40 0x7f6f3c1699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.629+0000 7f6f42276700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f3c0cf7e0 0x7f6f3c1537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.629+0000 7f6f42276700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f3c0d0400 0x7f6f3c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.629+0000 7f6f42276700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c0c6be0 con 0x7f6f3c0cf7e0 2023-10-06T02:18:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.629+0000 7f6f42276700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c15cd70 con 0x7f6f3c0d0400 2023-10-06T02:18:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.629+0000 7f6f42276700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c159630 con 0x7f6f3c0ccd40 2023-10-06T02:18:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.630+0000 7f6f3b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f3c0cf7e0 0x7f6f3c1537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.630+0000 7f6f3b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f3c0cf7e0 0x7f6f3c1537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55998/0 (socket says 172.21.15.6:55998) 2023-10-06T02:18:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.630+0000 7f6f3b7fe700 1 -- 172.21.15.6:0/3440493314 learned_addr learned my addr 172.21.15.6:0/3440493314 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.630+0000 7f6f40813700 1 --2- 172.21.15.6:0/3440493314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f3c0d0400 0x7f6f3c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.630+0000 7f6f3bfff700 1 --2- 172.21.15.6:0/3440493314 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f3c0ccd40 0x7f6f3c1699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.630+0000 7f6f3b7fe700 1 -- 172.21.15.6:0/3440493314 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f3c0ccd40 msgr2=0x7f6f3c1699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.630+0000 7f6f3b7fe700 1 --2- 172.21.15.6:0/3440493314 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f3c0ccd40 0x7f6f3c1699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.630+0000 7f6f3b7fe700 1 -- 172.21.15.6:0/3440493314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f3c0d0400 msgr2=0x7f6f3c15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.630+0000 7f6f3b7fe700 1 --2- 172.21.15.6:0/3440493314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f3c0d0400 0x7f6f3c15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.630+0000 7f6f3b7fe700 1 -- 172.21.15.6:0/3440493314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f240094f0 con 0x7f6f3c0cf7e0 2023-10-06T02:18:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.630+0000 7f6f3b7fe700 1 --2- 172.21.15.6:0/3440493314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f3c0cf7e0 0x7f6f3c1537f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6f240030c0 tx=0x7f6f24016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.630+0000 7f6f33fff700 1 -- 172.21.15.6:0/3440493314 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2400bbc0 con 0x7f6f3c0cf7e0 2023-10-06T02:18:23.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.630+0000 7f6f33fff700 1 -- 172.21.15.6:0/3440493314 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f24020070 con 0x7f6f3c0cf7e0 2023-10-06T02:18:23.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.630+0000 7f6f42276700 1 -- 172.21.15.6:0/3440493314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3c153d30 con 0x7f6f3c0cf7e0 2023-10-06T02:18:23.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.630+0000 7f6f33fff700 1 -- 172.21.15.6:0/3440493314 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2401b6a0 con 0x7f6f3c0cf7e0 2023-10-06T02:18:23.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.630+0000 7f6f42276700 1 -- 172.21.15.6:0/3440493314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3c158fe0 con 0x7f6f3c0cf7e0 2023-10-06T02:18:23.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.631+0000 7f6f42276700 1 -- 172.21.15.6:0/3440493314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3c1597a0 con 0x7f6f3c0cf7e0 2023-10-06T02:18:23.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.632+0000 7f6f33fff700 1 -- 172.21.15.6:0/3440493314 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f24022030 con 0x7f6f3c0cf7e0 2023-10-06T02:18:23.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.632+0000 7f6f33fff700 1 --2- 172.21.15.6:0/3440493314 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6f1c066f30 0x7f6f1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.632+0000 7f6f33fff700 1 -- 172.21.15.6:0/3440493314 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6f24086860 con 0x7f6f3c0cf7e0 2023-10-06T02:18:23.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.632+0000 7f6f3bfff700 1 --2- 172.21.15.6:0/3440493314 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6f1c066f30 0x7f6f1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.633+0000 7f6f3bfff700 1 --2- 172.21.15.6:0/3440493314 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6f1c066f30 0x7f6f1c0693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c155be0 tx=0x7f6f2c009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:23.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.637+0000 7f6f33fff700 1 -- 172.21.15.6:0/3440493314 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f24053680 con 0x7f6f3c0cf7e0 2023-10-06T02:18:23.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.828+0000 7f6f42276700 1 -- 172.21.15.6:0/3440493314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6f3c1597a0 con 0x7f6f3c0cf7e0 2023-10-06T02:18:23.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.829+0000 7f6f33fff700 1 -- 172.21.15.6:0/3440493314 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6f24056ca0 con 0x7f6f3c0cf7e0 2023-10-06T02:18:23.830 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:18:23.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.831+0000 7f6f42276700 1 -- 172.21.15.6:0/3440493314 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6f1c066f30 msgr2=0x7f6f1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:23.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.831+0000 7f6f42276700 1 --2- 172.21.15.6:0/3440493314 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6f1c066f30 0x7f6f1c0693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c155be0 tx=0x7f6f2c009060 comp rx=0 tx=0).stop 2023-10-06T02:18:23.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.831+0000 7f6f42276700 1 -- 172.21.15.6:0/3440493314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f3c0cf7e0 msgr2=0x7f6f3c1537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:23.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.831+0000 7f6f42276700 1 --2- 172.21.15.6:0/3440493314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f3c0cf7e0 0x7f6f3c1537f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6f240030c0 tx=0x7f6f24016000 comp rx=0 tx=0).stop 2023-10-06T02:18:23.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.831+0000 7f6f42276700 1 -- 172.21.15.6:0/3440493314 shutdown_connections 2023-10-06T02:18:23.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.831+0000 7f6f42276700 1 --2- 172.21.15.6:0/3440493314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f3c0d0400 0x7f6f3c15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.831+0000 7f6f42276700 1 --2- 172.21.15.6:0/3440493314 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f3c0ccd40 0x7f6f3c1699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.831+0000 7f6f42276700 1 --2- 172.21.15.6:0/3440493314 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6f1c066f30 0x7f6f1c0693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.831+0000 7f6f42276700 1 --2- 172.21.15.6:0/3440493314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f3c0cf7e0 0x7f6f3c1537f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.831+0000 7f6f42276700 1 -- 172.21.15.6:0/3440493314 >> 172.21.15.6:0/3440493314 conn(0x7f6f3c06a220 msgr2=0x7f6f3c0b47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:23.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.831+0000 7f6f42276700 1 -- 172.21.15.6:0/3440493314 shutdown_connections 2023-10-06T02:18:23.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.831+0000 7f6f42276700 1 -- 172.21.15.6:0/3440493314 wait complete. 2023-10-06T02:18:23.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:18:23.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.965+0000 7ff1ce08e700 1 Processor -- start 2023-10-06T02:18:23.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.965+0000 7ff1ce08e700 1 -- start start 2023-10-06T02:18:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.966+0000 7ff1ce08e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1c80a8d90 0x7ff1c80af200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.966+0000 7ff1ce08e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff1c80b3820 0x7ff1c8069790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.966+0000 7ff1ce08e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c806b030 con 0x7ff1c80a89c0 2023-10-06T02:18:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.966+0000 7ff1ce08e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c80b1ab0 con 0x7ff1c80b3820 2023-10-06T02:18:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.966+0000 7ff1ce08e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c806ad50 con 0x7ff1c80a8d90 2023-10-06T02:18:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.966+0000 7ff1c77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff1c80a89c0 0x7ff1c80aeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45746/0 (socket says 172.21.15.6:45746) 2023-10-06T02:18:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.966+0000 7ff1c77fe700 1 -- 172.21.15.6:0/2327518476 learned_addr learned my addr 172.21.15.6:0/2327518476 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.966+0000 7ff1c7fff700 1 --2- 172.21.15.6:0/2327518476 >> v2:172.21.15.175:3300/0 conn(0x7ff1c80b3820 0x7ff1c8069790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.966+0000 7ff1c6ffd700 1 --2- 172.21.15.6:0/2327518476 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1c80a8d90 0x7ff1c80af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.966+0000 7ff1c67fc700 1 -- 172.21.15.6:0/2327518476 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818185319 0 0) 0x7ff1c806b030 con 0x7ff1c80a89c0 2023-10-06T02:18:23.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.966+0000 7ff1c67fc700 1 -- 172.21.15.6:0/2327518476 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1b4003570 con 0x7ff1c80a89c0 2023-10-06T02:18:23.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.966+0000 7ff1c7fff700 1 -- 172.21.15.6:0/2327518476 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1c80a8d90 msgr2=0x7ff1c80af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:23.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.966+0000 7ff1c7fff700 1 --2- 172.21.15.6:0/2327518476 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1c80a8d90 0x7ff1c80af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.966+0000 7ff1c7fff700 1 -- 172.21.15.6:0/2327518476 >> v1:172.21.15.6:6789/0 conn(0x7ff1c80a89c0 legacy=0x7ff1c80aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:23.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.966+0000 7ff1c7fff700 1 -- 172.21.15.6:0/2327518476 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c80b1d30 con 0x7ff1c80b3820 2023-10-06T02:18:23.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.966+0000 7ff1c6ffd700 1 --2- 172.21.15.6:0/2327518476 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1c80a8d90 0x7ff1c80af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:23.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.967+0000 7ff1c7fff700 1 --2- 172.21.15.6:0/2327518476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1c80b3820 0x7ff1c8069790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009e60 tx=0x7ff1c0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df3c149bc5ed3e91 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:23.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.967+0000 7ff1c67fc700 1 -- 172.21.15.6:0/2327518476 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000e070 con 0x7ff1c80b3820 2023-10-06T02:18:23.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.967+0000 7ff1c67fc700 1 -- 172.21.15.6:0/2327518476 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c000bab0 con 0x7ff1c80b3820 2023-10-06T02:18:23.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.967+0000 7ff1c67fc700 1 -- 172.21.15.6:0/2327518476 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000be30 con 0x7ff1c80b3820 2023-10-06T02:18:23.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.967+0000 7ff1ce08e700 1 -- 172.21.15.6:0/2327518476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1c80b3820 msgr2=0x7ff1c8069790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:23.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.967+0000 7ff1ce08e700 1 --2- 172.21.15.6:0/2327518476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1c80b3820 0x7ff1c8069790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009e60 tx=0x7ff1c0009780 comp rx=0 tx=0).stop 2023-10-06T02:18:23.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.967+0000 7ff1ce08e700 1 -- 172.21.15.6:0/2327518476 shutdown_connections 2023-10-06T02:18:23.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.967+0000 7ff1ce08e700 1 --2- 172.21.15.6:0/2327518476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1c80b3820 0x7ff1c8069790 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.967+0000 7ff1ce08e700 1 --2- 172.21.15.6:0/2327518476 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1c80a8d90 0x7ff1c80af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.967+0000 7ff1ce08e700 1 -- 172.21.15.6:0/2327518476 >> 172.21.15.6:0/2327518476 conn(0x7ff1c8067910 msgr2=0x7ff1c80ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:23.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.967+0000 7ff1ce08e700 1 -- 172.21.15.6:0/2327518476 shutdown_connections 2023-10-06T02:18:23.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.967+0000 7ff1ce08e700 1 -- 172.21.15.6:0/2327518476 wait complete. 2023-10-06T02:18:23.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.969+0000 7ff1ce08e700 1 Processor -- start 2023-10-06T02:18:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.969+0000 7ff1ce08e700 1 -- start start 2023-10-06T02:18:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.969+0000 7ff1ce08e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1c80a89c0 0x7ff1c8155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.969+0000 7ff1ce08e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1c80a8d90 0x7ff1c809b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.969+0000 7ff1ce08e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c80b3820 0x7ff1c8169e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.969+0000 7ff1ce08e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c8097f90 con 0x7ff1c80b3820 2023-10-06T02:18:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.969+0000 7ff1ce08e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c8098200 con 0x7ff1c80a8d90 2023-10-06T02:18:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.969+0000 7ff1ce08e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80984e0 con 0x7ff1c80a89c0 2023-10-06T02:18:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.969+0000 7ff1c7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c80b3820 0x7ff1c8169e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.969+0000 7ff1c7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c80b3820 0x7ff1c8169e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56006/0 (socket says 172.21.15.6:56006) 2023-10-06T02:18:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.969+0000 7ff1c7fff700 1 -- 172.21.15.6:0/3090746039 learned_addr learned my addr 172.21.15.6:0/3090746039 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.970+0000 7ff1c7fff700 1 -- 172.21.15.6:0/3090746039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1c80a89c0 msgr2=0x7ff1c8155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.970+0000 7ff1c6ffd700 1 --2- 172.21.15.6:0/3090746039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1c80a8d90 0x7ff1c809b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.970+0000 7ff1c77fe700 1 --2- 172.21.15.6:0/3090746039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1c80a89c0 0x7ff1c8155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.970+0000 7ff1c7fff700 1 --2- 172.21.15.6:0/3090746039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1c80a89c0 0x7ff1c8155f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.970+0000 7ff1c7fff700 1 -- 172.21.15.6:0/3090746039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1c80a8d90 msgr2=0x7ff1c809b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.970+0000 7ff1c7fff700 1 --2- 172.21.15.6:0/3090746039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1c80a8d90 0x7ff1c809b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.970+0000 7ff1c7fff700 1 -- 172.21.15.6:0/3090746039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b8009420 con 0x7ff1c80b3820 2023-10-06T02:18:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.970+0000 7ff1c7fff700 1 --2- 172.21.15.6:0/3090746039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c80b3820 0x7ff1c8169e60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff1c806b1c0 tx=0x7ff1c0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.970+0000 7ff1bf7fe700 1 -- 172.21.15.6:0/3090746039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0012d60 con 0x7ff1c80b3820 2023-10-06T02:18:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.970+0000 7ff1bf7fe700 1 -- 172.21.15.6:0/3090746039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c0021070 con 0x7ff1c80b3820 2023-10-06T02:18:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.970+0000 7ff1ce08e700 1 -- 172.21.15.6:0/3090746039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c0009a20 con 0x7ff1c80b3820 2023-10-06T02:18:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.970+0000 7ff1bf7fe700 1 -- 172.21.15.6:0/3090746039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0026680 con 0x7ff1c80b3820 2023-10-06T02:18:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.970+0000 7ff1ce08e700 1 -- 172.21.15.6:0/3090746039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c8098b20 con 0x7ff1c80b3820 2023-10-06T02:18:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.971+0000 7ff1ce08e700 1 -- 172.21.15.6:0/3090746039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c8087170 con 0x7ff1c80b3820 2023-10-06T02:18:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.972+0000 7ff1bf7fe700 1 -- 172.21.15.6:0/3090746039 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1c0023030 con 0x7ff1c80b3820 2023-10-06T02:18:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.972+0000 7ff1bf7fe700 1 --2- 172.21.15.6:0/3090746039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff1a8066f30 0x7ff1a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.972+0000 7ff1bf7fe700 1 -- 172.21.15.6:0/3090746039 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff1c0086ae0 con 0x7ff1c80b3820 2023-10-06T02:18:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.972+0000 7ff1c77fe700 1 --2- 172.21.15.6:0/3090746039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff1a8066f30 0x7ff1a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.973+0000 7ff1c77fe700 1 --2- 172.21.15.6:0/3090746039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff1a8066f30 0x7ff1a80693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0007fd0 tx=0x7ff1b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:23.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:23.976+0000 7ff1bf7fe700 1 -- 172.21.15.6:0/3090746039 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1c0053900 con 0x7ff1c80b3820 2023-10-06T02:18:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.174+0000 7ff1ce08e700 1 -- 172.21.15.6:0/3090746039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1c806e5d0 con 0x7ff1c80b3820 2023-10-06T02:18:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.175+0000 7ff1bf7fe700 1 -- 172.21.15.6:0/3090746039 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1c0056f20 con 0x7ff1c80b3820 2023-10-06T02:18:24.176 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:18:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.177+0000 7ff1ce08e700 1 -- 172.21.15.6:0/3090746039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff1a8066f30 msgr2=0x7ff1a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.177+0000 7ff1ce08e700 1 --2- 172.21.15.6:0/3090746039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff1a8066f30 0x7ff1a80693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0007fd0 tx=0x7ff1b0009040 comp rx=0 tx=0).stop 2023-10-06T02:18:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.177+0000 7ff1ce08e700 1 -- 172.21.15.6:0/3090746039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c80b3820 msgr2=0x7ff1c8169e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.177+0000 7ff1ce08e700 1 --2- 172.21.15.6:0/3090746039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c80b3820 0x7ff1c8169e60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff1c806b1c0 tx=0x7ff1c0019000 comp rx=0 tx=0).stop 2023-10-06T02:18:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.177+0000 7ff1ce08e700 1 -- 172.21.15.6:0/3090746039 shutdown_connections 2023-10-06T02:18:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.177+0000 7ff1ce08e700 1 --2- 172.21.15.6:0/3090746039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff1a8066f30 0x7ff1a80693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.177+0000 7ff1ce08e700 1 --2- 172.21.15.6:0/3090746039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c80b3820 0x7ff1c8169e60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.177+0000 7ff1ce08e700 1 --2- 172.21.15.6:0/3090746039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1c80a89c0 0x7ff1c8155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.177+0000 7ff1ce08e700 1 --2- 172.21.15.6:0/3090746039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1c80a8d90 0x7ff1c809b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.177+0000 7ff1ce08e700 1 -- 172.21.15.6:0/3090746039 >> 172.21.15.6:0/3090746039 conn(0x7ff1c8067910 msgr2=0x7ff1c80ae060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.177+0000 7ff1ce08e700 1 -- 172.21.15.6:0/3090746039 shutdown_connections 2023-10-06T02:18:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.177+0000 7ff1ce08e700 1 -- 172.21.15.6:0/3090746039 wait complete. 2023-10-06T02:18:24.190 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:18:24.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.311+0000 7f7d7002c700 1 Processor -- start 2023-10-06T02:18:24.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.311+0000 7f7d7002c700 1 -- start start 2023-10-06T02:18:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.312+0000 7f7d7002c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d6815a030 0x7f7d6815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.312+0000 7f7d7002c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7d6815a940 0x7f7d68086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.312+0000 7f7d7002c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d68087530 0x7f7d680b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.312+0000 7f7d7002c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d680879d0 con 0x7f7d6815a030 2023-10-06T02:18:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.312+0000 7f7d7002c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d680b0cf0 con 0x7f7d6815a940 2023-10-06T02:18:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.312+0000 7f7d7002c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d680afc50 con 0x7f7d68087530 2023-10-06T02:18:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.312+0000 7f7d6ddc8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d6815a030 0x7f7d6815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.312+0000 7f7d6ddc8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d6815a030 0x7f7d6815a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56014/0 (socket says 172.21.15.6:56014) 2023-10-06T02:18:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.312+0000 7f7d6ddc8700 1 -- 172.21.15.6:0/1916130158 learned_addr learned my addr 172.21.15.6:0/1916130158 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.312+0000 7f7d6d5c7700 1 --2- 172.21.15.6:0/1916130158 >> v2:172.21.15.175:3300/0 conn(0x7f7d6815a940 0x7f7d68086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.312+0000 7f7d6e5c9700 1 --2- 172.21.15.6:0/1916130158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d68087530 0x7f7d680b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.312+0000 7f7d6ddc8700 1 -- 172.21.15.6:0/1916130158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d68087530 msgr2=0x7f7d680b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.312+0000 7f7d6ddc8700 1 --2- 172.21.15.6:0/1916130158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d68087530 0x7f7d680b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.312+0000 7f7d6ddc8700 1 -- 172.21.15.6:0/1916130158 >> v2:172.21.15.175:3300/0 conn(0x7f7d6815a940 msgr2=0x7f7d68086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.312+0000 7f7d6ddc8700 1 --2- 172.21.15.6:0/1916130158 >> v2:172.21.15.175:3300/0 conn(0x7f7d6815a940 0x7f7d68086ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.312+0000 7f7d6ddc8700 1 -- 172.21.15.6:0/1916130158 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d680aff30 con 0x7f7d6815a030 2023-10-06T02:18:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.312+0000 7f7d6e5c9700 1 --2- 172.21.15.6:0/1916130158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d68087530 0x7f7d680b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.313+0000 7f7d6ddc8700 1 --2- 172.21.15.6:0/1916130158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6815a030 0x7f7d6815a400 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7d68157800 tx=0x7f7d60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e41a143b4808579 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.313+0000 7f7d6cdc6700 1 -- 172.21.15.6:0/1916130158 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000b820 con 0x7f7d6815a030 2023-10-06T02:18:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.313+0000 7f7d6cdc6700 1 -- 172.21.15.6:0/1916130158 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6000b980 con 0x7f7d6815a030 2023-10-06T02:18:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.313+0000 7f7d6cdc6700 1 -- 172.21.15.6:0/1916130158 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000bd20 con 0x7f7d6815a030 2023-10-06T02:18:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.313+0000 7f7d7002c700 1 -- 172.21.15.6:0/1916130158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6815a030 msgr2=0x7f7d6815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.313+0000 7f7d7002c700 1 --2- 172.21.15.6:0/1916130158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6815a030 0x7f7d6815a400 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7d68157800 tx=0x7f7d60009250 comp rx=0 tx=0).stop 2023-10-06T02:18:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.313+0000 7f7d7002c700 1 -- 172.21.15.6:0/1916130158 shutdown_connections 2023-10-06T02:18:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.313+0000 7f7d7002c700 1 --2- 172.21.15.6:0/1916130158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d68087530 0x7f7d680b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.313+0000 7f7d7002c700 1 --2- 172.21.15.6:0/1916130158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6815a030 0x7f7d6815a400 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.313+0000 7f7d7002c700 1 --2- 172.21.15.6:0/1916130158 >> v2:172.21.15.175:3300/0 conn(0x7f7d6815a940 0x7f7d68086ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.313+0000 7f7d7002c700 1 -- 172.21.15.6:0/1916130158 >> 172.21.15.6:0/1916130158 conn(0x7f7d68068680 msgr2=0x7f7d68068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.313+0000 7f7d7002c700 1 -- 172.21.15.6:0/1916130158 shutdown_connections 2023-10-06T02:18:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.313+0000 7f7d7002c700 1 -- 172.21.15.6:0/1916130158 wait complete. 2023-10-06T02:18:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.314+0000 7f7d7002c700 1 Processor -- start 2023-10-06T02:18:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.314+0000 7f7d7002c700 1 -- start start 2023-10-06T02:18:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.315+0000 7f7d7002c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d68087530 0x7f7d680c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.315+0000 7f7d7002c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d6815a030 0x7f7d680c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.315+0000 7f7d7002c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6815a940 0x7f7d6815ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.315+0000 7f7d7002c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6815dba0 con 0x7f7d6815a940 2023-10-06T02:18:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.315+0000 7f7d7002c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6815ad60 con 0x7f7d6815a030 2023-10-06T02:18:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.315+0000 7f7d7002c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6815d3b0 con 0x7f7d68087530 2023-10-06T02:18:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.315+0000 7f7d6e5c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6815a940 0x7f7d6815ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.315+0000 7f7d6e5c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6815a940 0x7f7d6815ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56016/0 (socket says 172.21.15.6:56016) 2023-10-06T02:18:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.315+0000 7f7d6e5c9700 1 -- 172.21.15.6:0/1819255171 learned_addr learned my addr 172.21.15.6:0/1819255171 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.316+0000 7f7d6d5c7700 1 --2- 172.21.15.6:0/1819255171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d6815a030 0x7f7d680c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.316+0000 7f7d6ddc8700 1 --2- 172.21.15.6:0/1819255171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d68087530 0x7f7d680c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.316+0000 7f7d6e5c9700 1 -- 172.21.15.6:0/1819255171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d68087530 msgr2=0x7f7d680c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.316+0000 7f7d6e5c9700 1 --2- 172.21.15.6:0/1819255171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d68087530 0x7f7d680c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.316+0000 7f7d6e5c9700 1 -- 172.21.15.6:0/1819255171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d6815a030 msgr2=0x7f7d680c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:24.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.316+0000 7f7d6e5c9700 1 --2- 172.21.15.6:0/1819255171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d6815a030 0x7f7d680c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.316+0000 7f7d6e5c9700 1 -- 172.21.15.6:0/1819255171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d600094f0 con 0x7f7d6815a940 2023-10-06T02:18:24.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.316+0000 7f7d6ddc8700 1 --2- 172.21.15.6:0/1819255171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d68087530 0x7f7d680c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:24.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.316+0000 7f7d6e5c9700 1 --2- 172.21.15.6:0/1819255171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6815a940 0x7f7d6815ce70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800a380 tx=0x7f7d58007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:24.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.316+0000 7f7d65ffb700 1 -- 172.21.15.6:0/1819255171 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d58015440 con 0x7f7d6815a940 2023-10-06T02:18:24.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.316+0000 7f7d65ffb700 1 -- 172.21.15.6:0/1819255171 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d580155a0 con 0x7f7d6815a940 2023-10-06T02:18:24.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.316+0000 7f7d7002c700 1 -- 172.21.15.6:0/1819255171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6815b2e0 con 0x7f7d6815a940 2023-10-06T02:18:24.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.316+0000 7f7d65ffb700 1 -- 172.21.15.6:0/1819255171 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d58015960 con 0x7f7d6815a940 2023-10-06T02:18:24.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.316+0000 7f7d7002c700 1 -- 172.21.15.6:0/1819255171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6815d8c0 con 0x7f7d6815a940 2023-10-06T02:18:24.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.317+0000 7f7d7002c700 1 -- 172.21.15.6:0/1819255171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d6815b470 con 0x7f7d6815a940 2023-10-06T02:18:24.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.318+0000 7f7d65ffb700 1 -- 172.21.15.6:0/1819255171 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d5800d440 con 0x7f7d6815a940 2023-10-06T02:18:24.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.318+0000 7f7d65ffb700 1 --2- 172.21.15.6:0/1819255171 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d54066f30 0x7f7d540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:24.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.318+0000 7f7d65ffb700 1 -- 172.21.15.6:0/1819255171 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7d58085530 con 0x7f7d6815a940 2023-10-06T02:18:24.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.318+0000 7f7d6ddc8700 1 --2- 172.21.15.6:0/1819255171 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d54066f30 0x7f7d540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:24.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.319+0000 7f7d6ddc8700 1 --2- 172.21.15.6:0/1819255171 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d54066f30 0x7f7d540693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7d68157800 tx=0x7f7d60017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:24.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.322+0000 7f7d65ffb700 1 -- 172.21.15.6:0/1819255171 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d58052350 con 0x7f7d6815a940 2023-10-06T02:18:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.513+0000 7f7d7002c700 1 -- 172.21.15.6:0/1819255171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7d6815b030 con 0x7f7d6815a940 2023-10-06T02:18:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.513+0000 7f7d65ffb700 1 -- 172.21.15.6:0/1819255171 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7d58055970 con 0x7f7d6815a940 2023-10-06T02:18:24.514 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:18:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.515+0000 7f7d7002c700 1 -- 172.21.15.6:0/1819255171 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d54066f30 msgr2=0x7f7d540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.515+0000 7f7d7002c700 1 --2- 172.21.15.6:0/1819255171 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d54066f30 0x7f7d540693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7d68157800 tx=0x7f7d60017000 comp rx=0 tx=0).stop 2023-10-06T02:18:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.515+0000 7f7d7002c700 1 -- 172.21.15.6:0/1819255171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6815a940 msgr2=0x7f7d6815ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.515+0000 7f7d7002c700 1 --2- 172.21.15.6:0/1819255171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6815a940 0x7f7d6815ce70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800a380 tx=0x7f7d58007900 comp rx=0 tx=0).stop 2023-10-06T02:18:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.515+0000 7f7d7002c700 1 -- 172.21.15.6:0/1819255171 shutdown_connections 2023-10-06T02:18:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.515+0000 7f7d7002c700 1 --2- 172.21.15.6:0/1819255171 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d54066f30 0x7f7d540693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.515+0000 7f7d7002c700 1 --2- 172.21.15.6:0/1819255171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6815a940 0x7f7d6815ce70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.515+0000 7f7d7002c700 1 --2- 172.21.15.6:0/1819255171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d68087530 0x7f7d680c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.515+0000 7f7d7002c700 1 --2- 172.21.15.6:0/1819255171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d6815a030 0x7f7d680c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.515+0000 7f7d7002c700 1 -- 172.21.15.6:0/1819255171 >> 172.21.15.6:0/1819255171 conn(0x7f7d68068680 msgr2=0x7f7d680cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.515+0000 7f7d7002c700 1 -- 172.21.15.6:0/1819255171 shutdown_connections 2023-10-06T02:18:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.515+0000 7f7d7002c700 1 -- 172.21.15.6:0/1819255171 wait complete. 2023-10-06T02:18:24.528 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:18:24.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.649+0000 7f500582a700 1 Processor -- start 2023-10-06T02:18:24.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.649+0000 7f500582a700 1 -- start start 2023-10-06T02:18:24.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.649+0000 7f500582a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f50000af460 0x7f5000159990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:24.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.649+0000 7f500582a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50000cd180 0x7f500015d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:24.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.649+0000 7f500582a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50000ce870 con 0x7f50000af830 2023-10-06T02:18:24.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.649+0000 7f500582a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500015dec0 con 0x7f50000af460 2023-10-06T02:18:24.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.649+0000 7f500582a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50000cfd10 con 0x7f50000cd180 2023-10-06T02:18:24.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.650+0000 7f4ffeffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f50000af460 0x7f5000159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:24.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.650+0000 7f4fff7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50000cd180 0x7f500015d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:24.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.650+0000 7f4ffeffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f50000af460 0x7f5000159990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:59074/0 (socket says 172.21.15.6:59074) 2023-10-06T02:18:24.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.650+0000 7f4fff7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50000cd180 0x7f500015d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:46586/0 (socket says 172.21.15.6:46586) 2023-10-06T02:18:24.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.650+0000 7f4ffeffd700 1 -- 172.21.15.6:0/3285645043 learned_addr learned my addr 172.21.15.6:0/3285645043 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:24.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.650+0000 7f4ffe7fc700 1 --1- 172.21.15.6:0/3285645043 >> v1:172.21.15.175:6789/0 conn(0x7f50000af830 0x7f50000cca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:55896/0 (socket says 172.21.15.6:55896) 2023-10-06T02:18:24.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.650+0000 7f4fff7fe700 1 -- 172.21.15.6:0/3285645043 >> v2:172.21.15.175:3300/0 conn(0x7f50000af460 msgr2=0x7f5000159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:24.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.650+0000 7f4fff7fe700 1 --2- 172.21.15.6:0/3285645043 >> v2:172.21.15.175:3300/0 conn(0x7f50000af460 0x7f5000159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.650+0000 7f4fff7fe700 1 -- 172.21.15.6:0/3285645043 >> v1:172.21.15.175:6789/0 conn(0x7f50000af830 legacy=0x7f50000cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:24.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.650+0000 7f4fff7fe700 1 -- 172.21.15.6:0/3285645043 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50000cffb0 con 0x7f50000cd180 2023-10-06T02:18:24.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.650+0000 7f4ffeffd700 1 --2- 172.21.15.6:0/3285645043 >> v2:172.21.15.175:3300/0 conn(0x7f50000af460 0x7f5000159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:24.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.650+0000 7f4fff7fe700 1 --2- 172.21.15.6:0/3285645043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50000cd180 0x7f500015d980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80098e0 tx=0x7f4ff80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8b860795ead6e00 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:24.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.651+0000 7f4ffdffb700 1 -- 172.21.15.6:0/3285645043 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800b640 con 0x7f50000cd180 2023-10-06T02:18:24.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.651+0000 7f4ffdffb700 1 -- 172.21.15.6:0/3285645043 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff800b7a0 con 0x7f50000cd180 2023-10-06T02:18:24.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.651+0000 7f4ffdffb700 1 -- 172.21.15.6:0/3285645043 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800bb40 con 0x7f50000cd180 2023-10-06T02:18:24.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.651+0000 7f500582a700 1 -- 172.21.15.6:0/3285645043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50000cd180 msgr2=0x7f500015d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:24.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.651+0000 7f500582a700 1 --2- 172.21.15.6:0/3285645043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50000cd180 0x7f500015d980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80098e0 tx=0x7f4ff80091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.651+0000 7f500582a700 1 -- 172.21.15.6:0/3285645043 shutdown_connections 2023-10-06T02:18:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.651+0000 7f500582a700 1 --2- 172.21.15.6:0/3285645043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50000cd180 0x7f500015d980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.651+0000 7f500582a700 1 --2- 172.21.15.6:0/3285645043 >> v2:172.21.15.175:3300/0 conn(0x7f50000af460 0x7f5000159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.651+0000 7f500582a700 1 -- 172.21.15.6:0/3285645043 >> 172.21.15.6:0/3285645043 conn(0x7f5000068680 msgr2=0x7f5000068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.651+0000 7f500582a700 1 -- 172.21.15.6:0/3285645043 shutdown_connections 2023-10-06T02:18:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.651+0000 7f500582a700 1 -- 172.21.15.6:0/3285645043 wait complete. 2023-10-06T02:18:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.653+0000 7f500582a700 1 Processor -- start 2023-10-06T02:18:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.653+0000 7f500582a700 1 -- start start 2023-10-06T02:18:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.653+0000 7f500582a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50000af460 0x7f50000b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.653+0000 7f500582a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50000af830 0x7f50000ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.653+0000 7f500582a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50000cd180 0x7f50000c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.653+0000 7f500582a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50000b6100 con 0x7f50000af830 2023-10-06T02:18:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.653+0000 7f500582a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50000b3320 con 0x7f50000cd180 2023-10-06T02:18:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.653+0000 7f500582a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50000aeac0 con 0x7f50000af460 2023-10-06T02:18:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.654+0000 7f4ffe7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50000af830 0x7f50000ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.654+0000 7f4ffe7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50000af830 0x7f50000ae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56018/0 (socket says 172.21.15.6:56018) 2023-10-06T02:18:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.654+0000 7f4ffe7fc700 1 -- 172.21.15.6:0/2148447804 learned_addr learned my addr 172.21.15.6:0/2148447804 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.654+0000 7f4ffeffd700 1 --2- 172.21.15.6:0/2148447804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50000af460 0x7f50000b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.654+0000 7f4fff7fe700 1 --2- 172.21.15.6:0/2148447804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50000cd180 0x7f50000c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.654+0000 7f4ffe7fc700 1 -- 172.21.15.6:0/2148447804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50000af460 msgr2=0x7f50000b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.654+0000 7f4ffe7fc700 1 --2- 172.21.15.6:0/2148447804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50000af460 0x7f50000b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.654+0000 7f4ffe7fc700 1 -- 172.21.15.6:0/2148447804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50000cd180 msgr2=0x7f50000c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.654+0000 7f4ffe7fc700 1 --2- 172.21.15.6:0/2148447804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50000cd180 0x7f50000c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.654+0000 7f4ffe7fc700 1 -- 172.21.15.6:0/2148447804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff0009ae0 con 0x7f50000af830 2023-10-06T02:18:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.654+0000 7f4fff7fe700 1 --2- 172.21.15.6:0/2148447804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50000cd180 0x7f50000c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.654+0000 7f4ffe7fc700 1 --2- 172.21.15.6:0/2148447804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50000af830 0x7f50000ae580 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800c7c0 tx=0x7f4fe8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:24.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.654+0000 7f4ff6ffd700 1 -- 172.21.15.6:0/2148447804 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8005a70 con 0x7f50000af830 2023-10-06T02:18:24.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.654+0000 7f4ff6ffd700 1 -- 172.21.15.6:0/2148447804 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe8005bd0 con 0x7f50000af830 2023-10-06T02:18:24.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.654+0000 7f4ff6ffd700 1 -- 172.21.15.6:0/2148447804 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe80070d0 con 0x7f50000af830 2023-10-06T02:18:24.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.654+0000 7f500582a700 1 -- 172.21.15.6:0/2148447804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff8009420 con 0x7f50000af830 2023-10-06T02:18:24.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.654+0000 7f500582a700 1 -- 172.21.15.6:0/2148447804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50000ca180 con 0x7f50000af830 2023-10-06T02:18:24.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.655+0000 7f500582a700 1 -- 172.21.15.6:0/2148447804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50000b3490 con 0x7f50000af830 2023-10-06T02:18:24.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.656+0000 7f4ff6ffd700 1 -- 172.21.15.6:0/2148447804 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fe8007480 con 0x7f50000af830 2023-10-06T02:18:24.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.656+0000 7f4ff6ffd700 1 --2- 172.21.15.6:0/2148447804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4fe0066f30 0x7f4fe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:24.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.656+0000 7f4ff6ffd700 1 -- 172.21.15.6:0/2148447804 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4fe8083e40 con 0x7f50000af830 2023-10-06T02:18:24.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.656+0000 7f4ffeffd700 1 --2- 172.21.15.6:0/2148447804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4fe0066f30 0x7f4fe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:24.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.657+0000 7f4ffeffd700 1 --2- 172.21.15.6:0/2148447804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4fe0066f30 0x7f4fe00693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00072d0 tx=0x7f4ff000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:24.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.661+0000 7f4ff6ffd700 1 -- 172.21.15.6:0/2148447804 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fe8050c60 con 0x7f50000af830 2023-10-06T02:18:24.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.855+0000 7f500582a700 1 -- 172.21.15.6:0/2148447804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f500015a010 con 0x7f50000af830 2023-10-06T02:18:24.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.857+0000 7f4ff6ffd700 1 -- 172.21.15.6:0/2148447804 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4fe8017020 con 0x7f50000af830 2023-10-06T02:18:24.858 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-06T02:18:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.859+0000 7f500582a700 1 -- 172.21.15.6:0/2148447804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4fe0066f30 msgr2=0x7f4fe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.859+0000 7f500582a700 1 --2- 172.21.15.6:0/2148447804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4fe0066f30 0x7f4fe00693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00072d0 tx=0x7f4ff000b040 comp rx=0 tx=0).stop 2023-10-06T02:18:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.859+0000 7f500582a700 1 -- 172.21.15.6:0/2148447804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50000af830 msgr2=0x7f50000ae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.859+0000 7f500582a700 1 --2- 172.21.15.6:0/2148447804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50000af830 0x7f50000ae580 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800c7c0 tx=0x7f4fe8007f70 comp rx=0 tx=0).stop 2023-10-06T02:18:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.859+0000 7f500582a700 1 -- 172.21.15.6:0/2148447804 shutdown_connections 2023-10-06T02:18:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.859+0000 7f500582a700 1 --2- 172.21.15.6:0/2148447804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50000cd180 0x7f50000c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.859+0000 7f500582a700 1 --2- 172.21.15.6:0/2148447804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50000af460 0x7f50000b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.859+0000 7f500582a700 1 --2- 172.21.15.6:0/2148447804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4fe0066f30 0x7f4fe00693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.859+0000 7f500582a700 1 --2- 172.21.15.6:0/2148447804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50000af830 0x7f50000ae580 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.859+0000 7f500582a700 1 -- 172.21.15.6:0/2148447804 >> 172.21.15.6:0/2148447804 conn(0x7f5000068680 msgr2=0x7f5000068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:24.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.859+0000 7f500582a700 1 -- 172.21.15.6:0/2148447804 shutdown_connections 2023-10-06T02:18:24.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.859+0000 7f500582a700 1 -- 172.21.15.6:0/2148447804 wait complete. 2023-10-06T02:18:24.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T02:18:24.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.993+0000 7f7c0b96e700 1 Processor -- start 2023-10-06T02:18:24.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.993+0000 7f7c0b96e700 1 -- start start 2023-10-06T02:18:24.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.994+0000 7f7c0b96e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c040c7e20 0x7f7c0406c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:24.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.994+0000 7f7c0b96e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0415a0c0 con 0x7f7c040cd180 2023-10-06T02:18:24.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.994+0000 7f7c0b96e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c040c8900 con 0x7f7c040c8480 2023-10-06T02:18:24.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.994+0000 7f7c0b96e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c040c9150 con 0x7f7c040c7e20 2023-10-06T02:18:24.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.994+0000 7f7c0970a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c040c7e20 0x7f7c0406c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:24.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.994+0000 7f7c09f0b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7c040cd180 0x7f7c040c98d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45760/0 (socket says 172.21.15.6:45760) 2023-10-06T02:18:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.994+0000 7f7c09f0b700 1 -- 172.21.15.6:0/395262470 learned_addr learned my addr 172.21.15.6:0/395262470 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.994+0000 7f7c0970a700 1 -- 172.21.15.6:0/395262470 >> v1:172.21.15.175:6789/0 conn(0x7f7c040c8480 legacy=0x7f7c0415a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.994+0000 7f7c0970a700 1 -- 172.21.15.6:0/395262470 >> v1:172.21.15.6:6789/0 conn(0x7f7c040cd180 legacy=0x7f7c040c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.994+0000 7f7c0970a700 1 -- 172.21.15.6:0/395262470 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c040c8b90 con 0x7f7c040c7e20 2023-10-06T02:18:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.994+0000 7f7c03fff700 1 -- 172.21.15.6:0/395262470 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357749946 0 0) 0x7f7c0415a0c0 con 0x7f7c040cd180 2023-10-06T02:18:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.994+0000 7f7c0970a700 1 --2- 172.21.15.6:0/395262470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c040c7e20 0x7f7c0406c350 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0098e0 tx=0x7f7bfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99ce7cf91fd8fc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.995+0000 7f7c03fff700 1 -- 172.21.15.6:0/395262470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc009e80 con 0x7f7c040c7e20 2023-10-06T02:18:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.995+0000 7f7c03fff700 1 -- 172.21.15.6:0/395262470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc00b820 con 0x7f7c040c7e20 2023-10-06T02:18:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.995+0000 7f7c03fff700 1 -- 172.21.15.6:0/395262470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00bba0 con 0x7f7c040c7e20 2023-10-06T02:18:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.995+0000 7f7c0b96e700 1 -- 172.21.15.6:0/395262470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c040c7e20 msgr2=0x7f7c0406c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.995+0000 7f7c0b96e700 1 --2- 172.21.15.6:0/395262470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c040c7e20 0x7f7c0406c350 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0098e0 tx=0x7f7bfc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.995+0000 7f7c0b96e700 1 -- 172.21.15.6:0/395262470 shutdown_connections 2023-10-06T02:18:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.995+0000 7f7c0b96e700 1 --2- 172.21.15.6:0/395262470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c040c7e20 0x7f7c0406c350 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.995+0000 7f7c0b96e700 1 -- 172.21.15.6:0/395262470 >> 172.21.15.6:0/395262470 conn(0x7f7c04067130 msgr2=0x7f7c04067530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.995+0000 7f7c0b96e700 1 -- 172.21.15.6:0/395262470 shutdown_connections 2023-10-06T02:18:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.995+0000 7f7c0b96e700 1 -- 172.21.15.6:0/395262470 wait complete. 2023-10-06T02:18:25.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.996+0000 7f7c0b96e700 1 Processor -- start 2023-10-06T02:18:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.996+0000 7f7c0b96e700 1 -- start start 2023-10-06T02:18:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.997+0000 7f7c0b96e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c040c7e20 0x7f7c04153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.997+0000 7f7c0b96e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c040c8480 0x7f7c040c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.997+0000 7f7c0b96e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c040cd180 0x7f7c040c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.997+0000 7f7c0b96e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040a8bc0 con 0x7f7c040c8480 2023-10-06T02:18:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.997+0000 7f7c0b96e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040abb90 con 0x7f7c040cd180 2023-10-06T02:18:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.997+0000 7f7c0b96e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040abe70 con 0x7f7c040c7e20 2023-10-06T02:18:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.997+0000 7f7c08f09700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c040c8480 0x7f7c040c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.997+0000 7f7c08f09700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c040c8480 0x7f7c040c9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56032/0 (socket says 172.21.15.6:56032) 2023-10-06T02:18:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.997+0000 7f7c08f09700 1 -- 172.21.15.6:0/516146271 learned_addr learned my addr 172.21.15.6:0/516146271 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.998+0000 7f7c09f0b700 1 --2- 172.21.15.6:0/516146271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c040cd180 0x7f7c040c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.998+0000 7f7c0970a700 1 --2- 172.21.15.6:0/516146271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c040c7e20 0x7f7c04153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.998+0000 7f7c08f09700 1 -- 172.21.15.6:0/516146271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c040c7e20 msgr2=0x7f7c04153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.998+0000 7f7c08f09700 1 --2- 172.21.15.6:0/516146271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c040c7e20 0x7f7c04153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.998+0000 7f7c08f09700 1 -- 172.21.15.6:0/516146271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c040cd180 msgr2=0x7f7c040c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.998+0000 7f7c08f09700 1 --2- 172.21.15.6:0/516146271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c040cd180 0x7f7c040c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.998+0000 7f7c08f09700 1 -- 172.21.15.6:0/516146271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bfc009420 con 0x7f7c040c8480 2023-10-06T02:18:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.998+0000 7f7c09f0b700 1 --2- 172.21.15.6:0/516146271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c040cd180 0x7f7c040c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.998+0000 7f7c0970a700 1 --2- 172.21.15.6:0/516146271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c040c7e20 0x7f7c04153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.998+0000 7f7c08f09700 1 --2- 172.21.15.6:0/516146271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c040c8480 0x7f7c040c9690 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800b5e0 tx=0x7f7bf8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.998+0000 7f7c017fa700 1 -- 172.21.15.6:0/516146271 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf800f510 con 0x7f7c040c8480 2023-10-06T02:18:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.998+0000 7f7c017fa700 1 -- 172.21.15.6:0/516146271 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf800f690 con 0x7f7c040c8480 2023-10-06T02:18:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.998+0000 7f7c0b96e700 1 -- 172.21.15.6:0/516146271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c040ac150 con 0x7f7c040c8480 2023-10-06T02:18:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.998+0000 7f7c017fa700 1 -- 172.21.15.6:0/516146271 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf800fa50 con 0x7f7c040c8480 2023-10-06T02:18:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.998+0000 7f7c0b96e700 1 -- 172.21.15.6:0/516146271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c04153ba0 con 0x7f7c040c8480 2023-10-06T02:18:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.999+0000 7f7c0b96e700 1 -- 172.21.15.6:0/516146271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c040c53e0 con 0x7f7c040c8480 2023-10-06T02:18:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:24.999+0000 7f7c017fa700 1 -- 172.21.15.6:0/516146271 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bf801a400 con 0x7f7c040c8480 2023-10-06T02:18:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.000+0000 7f7c017fa700 1 --2- 172.21.15.6:0/516146271 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f30 0x7f7bf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.000+0000 7f7c017fa700 1 -- 172.21.15.6:0/516146271 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7bf8084550 con 0x7f7c040c8480 2023-10-06T02:18:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.000+0000 7f7c0970a700 1 --2- 172.21.15.6:0/516146271 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f30 0x7f7bf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.001+0000 7f7c0970a700 1 --2- 172.21.15.6:0/516146271 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f30 0x7f7bf00693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0098e0 tx=0x7f7bfc016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.005+0000 7f7c017fa700 1 -- 172.21.15.6:0/516146271 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c040c53e0 con 0x7f7c040c8480 2023-10-06T02:18:25.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.198+0000 7f7c0b96e700 1 -- 172.21.15.6:0/516146271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7c040c53e0 con 0x7f7c040c8480 2023-10-06T02:18:25.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.199+0000 7f7c017fa700 1 -- 172.21.15.6:0/516146271 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7c040c53e0 con 0x7f7c040c8480 2023-10-06T02:18:25.200 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:18:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.201+0000 7f7c0b96e700 1 -- 172.21.15.6:0/516146271 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f30 msgr2=0x7f7bf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.201+0000 7f7c0b96e700 1 --2- 172.21.15.6:0/516146271 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f30 0x7f7bf00693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0098e0 tx=0x7f7bfc016000 comp rx=0 tx=0).stop 2023-10-06T02:18:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.201+0000 7f7c0b96e700 1 -- 172.21.15.6:0/516146271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c040c8480 msgr2=0x7f7c040c9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.201+0000 7f7c0b96e700 1 --2- 172.21.15.6:0/516146271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c040c8480 0x7f7c040c9690 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800b5e0 tx=0x7f7bf8009120 comp rx=0 tx=0).stop 2023-10-06T02:18:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.201+0000 7f7c0b96e700 1 -- 172.21.15.6:0/516146271 shutdown_connections 2023-10-06T02:18:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.201+0000 7f7c0b96e700 1 --2- 172.21.15.6:0/516146271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c040cd180 0x7f7c040c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.201+0000 7f7c0b96e700 1 --2- 172.21.15.6:0/516146271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c040c7e20 0x7f7c04153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.201+0000 7f7c0b96e700 1 --2- 172.21.15.6:0/516146271 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f30 0x7f7bf00693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.201+0000 7f7c0b96e700 1 --2- 172.21.15.6:0/516146271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c040c8480 0x7f7c040c9690 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.201+0000 7f7c0b96e700 1 -- 172.21.15.6:0/516146271 >> 172.21.15.6:0/516146271 conn(0x7f7c04067130 msgr2=0x7f7c040ca260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.201+0000 7f7c0b96e700 1 -- 172.21.15.6:0/516146271 shutdown_connections 2023-10-06T02:18:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.201+0000 7f7c0b96e700 1 -- 172.21.15.6:0/516146271 wait complete. 2023-10-06T02:18:25.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:18:25.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.332+0000 7f5f6d489700 1 Processor -- start 2023-10-06T02:18:25.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.332+0000 7f5f6d489700 1 -- start start 2023-10-06T02:18:25.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.333+0000 7f5f6d489700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5f6815b3c0 0x7f5f68097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.333+0000 7f5f6d489700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f680b3c50 0x7f5f6815b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.333+0000 7f5f6d489700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f6815bcd0 0x7f5f6815a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.333+0000 7f5f6d489700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f680afb90 con 0x7f5f680b3c50 2023-10-06T02:18:25.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.333+0000 7f5f6d489700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f680b2310 con 0x7f5f6815b3c0 2023-10-06T02:18:25.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.333+0000 7f5f6d489700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680b25f0 con 0x7f5f6815bcd0 2023-10-06T02:18:25.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.333+0000 7f5f667fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f680b3c50 0x7f5f6815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.333+0000 7f5f667fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f680b3c50 0x7f5f6815b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56036/0 (socket says 172.21.15.6:56036) 2023-10-06T02:18:25.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.333+0000 7f5f667fc700 1 -- 172.21.15.6:0/128687335 learned_addr learned my addr 172.21.15.6:0/128687335 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:25.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.333+0000 7f5f66ffd700 1 --2- 172.21.15.6:0/128687335 >> v2:172.21.15.175:3300/0 conn(0x7f5f6815b3c0 0x7f5f68097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.334+0000 7f5f677fe700 1 --2- 172.21.15.6:0/128687335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f6815bcd0 0x7f5f6815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.334+0000 7f5f667fc700 1 -- 172.21.15.6:0/128687335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f6815bcd0 msgr2=0x7f5f6815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:25.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.334+0000 7f5f667fc700 1 --2- 172.21.15.6:0/128687335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f6815bcd0 0x7f5f6815a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.334+0000 7f5f667fc700 1 -- 172.21.15.6:0/128687335 >> v2:172.21.15.175:3300/0 conn(0x7f5f6815b3c0 msgr2=0x7f5f68097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:25.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.334+0000 7f5f667fc700 1 --2- 172.21.15.6:0/128687335 >> v2:172.21.15.175:3300/0 conn(0x7f5f6815b3c0 0x7f5f68097d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.334+0000 7f5f667fc700 1 -- 172.21.15.6:0/128687335 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f680af820 con 0x7f5f680b3c50 2023-10-06T02:18:25.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.334+0000 7f5f66ffd700 1 --2- 172.21.15.6:0/128687335 >> v2:172.21.15.175:3300/0 conn(0x7f5f6815b3c0 0x7f5f68097d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:25.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.334+0000 7f5f667fc700 1 --2- 172.21.15.6:0/128687335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f680b3c50 0x7f5f6815b790 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5f680874b0 tx=0x7f5f5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa508cf7939195e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:25.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.334+0000 7f5f65ffb700 1 -- 172.21.15.6:0/128687335 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c00b860 con 0x7f5f680b3c50 2023-10-06T02:18:25.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.334+0000 7f5f65ffb700 1 -- 172.21.15.6:0/128687335 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c00b9c0 con 0x7f5f680b3c50 2023-10-06T02:18:25.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.334+0000 7f5f65ffb700 1 -- 172.21.15.6:0/128687335 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c00bd80 con 0x7f5f680b3c50 2023-10-06T02:18:25.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.334+0000 7f5f6d489700 1 -- 172.21.15.6:0/128687335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f680b3c50 msgr2=0x7f5f6815b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:25.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.334+0000 7f5f6d489700 1 --2- 172.21.15.6:0/128687335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f680b3c50 0x7f5f6815b790 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5f680874b0 tx=0x7f5f5c009250 comp rx=0 tx=0).stop 2023-10-06T02:18:25.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.335+0000 7f5f6d489700 1 -- 172.21.15.6:0/128687335 shutdown_connections 2023-10-06T02:18:25.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.335+0000 7f5f6d489700 1 --2- 172.21.15.6:0/128687335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f6815bcd0 0x7f5f6815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.335+0000 7f5f6d489700 1 --2- 172.21.15.6:0/128687335 >> v2:172.21.15.175:3300/0 conn(0x7f5f6815b3c0 0x7f5f68097d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.335+0000 7f5f6d489700 1 --2- 172.21.15.6:0/128687335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f680b3c50 0x7f5f6815b790 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.335+0000 7f5f6d489700 1 -- 172.21.15.6:0/128687335 >> 172.21.15.6:0/128687335 conn(0x7f5f68067910 msgr2=0x7f5f680ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:25.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.335+0000 7f5f6d489700 1 -- 172.21.15.6:0/128687335 shutdown_connections 2023-10-06T02:18:25.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.335+0000 7f5f6d489700 1 -- 172.21.15.6:0/128687335 wait complete. 2023-10-06T02:18:25.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.336+0000 7f5f6d489700 1 Processor -- start 2023-10-06T02:18:25.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.336+0000 7f5f6d489700 1 -- start start 2023-10-06T02:18:25.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f6d489700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f680b3c50 0x7f5f68155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f6d489700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6815b3c0 0x7f5f680abe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f6d489700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6815bcd0 0x7f5f68148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f6d489700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680ad0a0 con 0x7f5f6815bcd0 2023-10-06T02:18:25.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f6d489700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680ac490 con 0x7f5f6815b3c0 2023-10-06T02:18:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f6d489700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680ac770 con 0x7f5f680b3c50 2023-10-06T02:18:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6815bcd0 0x7f5f68148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6815bcd0 0x7f5f68148720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56046/0 (socket says 172.21.15.6:56046) 2023-10-06T02:18:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f677fe700 1 -- 172.21.15.6:0/1916306787 learned_addr learned my addr 172.21.15.6:0/1916306787 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f667fc700 1 --2- 172.21.15.6:0/1916306787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6815b3c0 0x7f5f680abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f66ffd700 1 --2- 172.21.15.6:0/1916306787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f680b3c50 0x7f5f68155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f677fe700 1 -- 172.21.15.6:0/1916306787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f680b3c50 msgr2=0x7f5f68155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f677fe700 1 --2- 172.21.15.6:0/1916306787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f680b3c50 0x7f5f68155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f677fe700 1 -- 172.21.15.6:0/1916306787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6815b3c0 msgr2=0x7f5f680abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f677fe700 1 --2- 172.21.15.6:0/1916306787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6815b3c0 0x7f5f680abe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f677fe700 1 -- 172.21.15.6:0/1916306787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c0094f0 con 0x7f5f6815bcd0 2023-10-06T02:18:25.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f667fc700 1 --2- 172.21.15.6:0/1916306787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6815b3c0 0x7f5f680abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:25.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f677fe700 1 --2- 172.21.15.6:0/1916306787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6815bcd0 0x7f5f68148720 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000cdb0 tx=0x7f5f600077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:25.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f4effd700 1 -- 172.21.15.6:0/1916306787 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6000aa80 con 0x7f5f6815bcd0 2023-10-06T02:18:25.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f4effd700 1 -- 172.21.15.6:0/1916306787 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6000abe0 con 0x7f5f6815bcd0 2023-10-06T02:18:25.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f6d489700 1 -- 172.21.15.6:0/1916306787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f680aca50 con 0x7f5f6815bcd0 2023-10-06T02:18:25.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f4effd700 1 -- 172.21.15.6:0/1916306787 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f60017430 con 0x7f5f6815bcd0 2023-10-06T02:18:25.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.337+0000 7f5f6d489700 1 -- 172.21.15.6:0/1916306787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f68155a40 con 0x7f5f6815bcd0 2023-10-06T02:18:25.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.338+0000 7f5f6d489700 1 -- 172.21.15.6:0/1916306787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f680acef0 con 0x7f5f6815bcd0 2023-10-06T02:18:25.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.339+0000 7f5f4effd700 1 -- 172.21.15.6:0/1916306787 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f60003020 con 0x7f5f6815bcd0 2023-10-06T02:18:25.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.339+0000 7f5f4effd700 1 --2- 172.21.15.6:0/1916306787 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f54066f30 0x7f5f540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.339+0000 7f5f4effd700 1 -- 172.21.15.6:0/1916306787 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5f60013070 con 0x7f5f6815bcd0 2023-10-06T02:18:25.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.339+0000 7f5f66ffd700 1 --2- 172.21.15.6:0/1916306787 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f54066f30 0x7f5f540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.340+0000 7f5f66ffd700 1 --2- 172.21.15.6:0/1916306787 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f54066f30 0x7f5f540693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5f680ad340 tx=0x7f5f58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:25.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.344+0000 7f5f4effd700 1 -- 172.21.15.6:0/1916306787 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f60051c80 con 0x7f5f6815bcd0 2023-10-06T02:18:25.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.537+0000 7f5f6d489700 1 -- 172.21.15.6:0/1916306787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f6806e8d0 con 0x7f5f6815bcd0 2023-10-06T02:18:25.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.537+0000 7f5f4effd700 1 -- 172.21.15.6:0/1916306787 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f5f600552a0 con 0x7f5f6815bcd0 2023-10-06T02:18:25.539 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:25.539 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:48.453046+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:18:25.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.539+0000 7f5f6d489700 1 -- 172.21.15.6:0/1916306787 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f54066f30 msgr2=0x7f5f540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:25.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.539+0000 7f5f6d489700 1 --2- 172.21.15.6:0/1916306787 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f54066f30 0x7f5f540693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5f680ad340 tx=0x7f5f58008040 comp rx=0 tx=0).stop 2023-10-06T02:18:25.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.539+0000 7f5f6d489700 1 -- 172.21.15.6:0/1916306787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6815bcd0 msgr2=0x7f5f68148720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:25.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.539+0000 7f5f6d489700 1 --2- 172.21.15.6:0/1916306787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6815bcd0 0x7f5f68148720 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000cdb0 tx=0x7f5f600077d0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.539+0000 7f5f6d489700 1 -- 172.21.15.6:0/1916306787 shutdown_connections 2023-10-06T02:18:25.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.539+0000 7f5f6d489700 1 --2- 172.21.15.6:0/1916306787 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f54066f30 0x7f5f540693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.539+0000 7f5f6d489700 1 --2- 172.21.15.6:0/1916306787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6815bcd0 0x7f5f68148720 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.539+0000 7f5f6d489700 1 --2- 172.21.15.6:0/1916306787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f680b3c50 0x7f5f68155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.539+0000 7f5f6d489700 1 --2- 172.21.15.6:0/1916306787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6815b3c0 0x7f5f680abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.539+0000 7f5f6d489700 1 -- 172.21.15.6:0/1916306787 >> 172.21.15.6:0/1916306787 conn(0x7f5f68067910 msgr2=0x7f5f6809b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:25.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.540+0000 7f5f6d489700 1 -- 172.21.15.6:0/1916306787 shutdown_connections 2023-10-06T02:18:25.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.540+0000 7f5f6d489700 1 -- 172.21.15.6:0/1916306787 wait complete. 2023-10-06T02:18:25.553 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:17:41.126402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:17:42.378468+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T02:17:46.053654+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:18:25.553 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:18:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.674+0000 7f5f63721700 1 Processor -- start 2023-10-06T02:18:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.674+0000 7f5f63721700 1 -- start start 2023-10-06T02:18:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f63721700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f5c067570 0x7f5f5c0cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f63721700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5c0caf30 con 0x7f5f5c0cb900 2023-10-06T02:18:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f63721700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5c0cd340 con 0x7f5f5c159590 2023-10-06T02:18:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f63721700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c0ca600 con 0x7f5f5c067570 2023-10-06T02:18:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f61cbe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5f5c0cb900 0x7f5f5c068680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45762/0 (socket says 172.21.15.6:45762) 2023-10-06T02:18:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f61cbe700 1 -- 172.21.15.6:0/3544115543 learned_addr learned my addr 172.21.15.6:0/3544115543 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f60cbc700 1 --2- 172.21.15.6:0/3544115543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f5c067570 0x7f5f5c0cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f53fff700 1 -- 172.21.15.6:0/3544115543 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052000324 0 0) 0x7f5f5c0caf30 con 0x7f5f5c0cb900 2023-10-06T02:18:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f53fff700 1 -- 172.21.15.6:0/3544115543 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f48003570 con 0x7f5f5c0cb900 2023-10-06T02:18:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f53fff700 1 -- 172.21.15.6:0/3544115543 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085660570 0 0) 0x7f5f5c0cd340 con 0x7f5f5c159590 2023-10-06T02:18:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f53fff700 1 -- 172.21.15.6:0/3544115543 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f5c0caf30 con 0x7f5f5c159590 2023-10-06T02:18:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f53fff700 1 -- 172.21.15.6:0/3544115543 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2314929600 0 0) 0x7f5f48003570 con 0x7f5f5c0cb900 2023-10-06T02:18:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f53fff700 1 -- 172.21.15.6:0/3544115543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f5c067570 msgr2=0x7f5f5c0cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f53fff700 1 --2- 172.21.15.6:0/3544115543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f5c067570 0x7f5f5c0cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f53fff700 1 -- 172.21.15.6:0/3544115543 >> v1:172.21.15.175:6789/0 conn(0x7f5f5c159590 legacy=0x7f5f5c0cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f53fff700 1 -- 172.21.15.6:0/3544115543 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c0ca8e0 con 0x7f5f5c0cb900 2023-10-06T02:18:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f53fff700 1 -- 172.21.15.6:0/3544115543 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f5f540017f0 con 0x7f5f5c0cb900 2023-10-06T02:18:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f53fff700 1 -- 172.21.15.6:0/3544115543 >> v1:172.21.15.6:6789/0 conn(0x7f5f5c0cb900 legacy=0x7f5f5c068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f53fff700 1 --2- 172.21.15.6:0/3544115543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f48003c20 0x7f5f48004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f53fff700 1 --2- 172.21.15.6:0/3544115543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f5c067570 0x7f5f48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f53fff700 1 --2- 172.21.15.6:0/3544115543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f48004d50 0x7f5f480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f53fff700 1 -- 172.21.15.6:0/3544115543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c0ca600 con 0x7f5f48004d50 2023-10-06T02:18:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f53fff700 1 -- 172.21.15.6:0/3544115543 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4800bbf0 con 0x7f5f48003c20 2023-10-06T02:18:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.675+0000 7f5f53fff700 1 -- 172.21.15.6:0/3544115543 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4800bd60 con 0x7f5f5c067570 2023-10-06T02:18:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.676+0000 7f5f61cbe700 1 --2- 172.21.15.6:0/3544115543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f48004d50 0x7f5f480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.676+0000 7f5f60cbc700 1 --2- 172.21.15.6:0/3544115543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f5c067570 0x7f5f48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.676+0000 7f5f614bd700 1 --2- 172.21.15.6:0/3544115543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f48003c20 0x7f5f48004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.676+0000 7f5f61cbe700 1 -- 172.21.15.6:0/3544115543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f5c067570 msgr2=0x7f5f48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.676+0000 7f5f61cbe700 1 --2- 172.21.15.6:0/3544115543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f5c067570 0x7f5f48004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.676+0000 7f5f61cbe700 1 -- 172.21.15.6:0/3544115543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f48003c20 msgr2=0x7f5f48004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.676+0000 7f5f61cbe700 1 --2- 172.21.15.6:0/3544115543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f48003c20 0x7f5f48004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.676+0000 7f5f61cbe700 1 -- 172.21.15.6:0/3544115543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48003570 con 0x7f5f48004d50 2023-10-06T02:18:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.676+0000 7f5f61cbe700 1 --2- 172.21.15.6:0/3544115543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f48004d50 0x7f5f480051c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c06fd70 tx=0x7f5f540020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36b070c018de249 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.676+0000 7f5f53fff700 1 -- 172.21.15.6:0/3544115543 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f540070d0 con 0x7f5f48004d50 2023-10-06T02:18:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.676+0000 7f5f53fff700 1 -- 172.21.15.6:0/3544115543 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f54007250 con 0x7f5f48004d50 2023-10-06T02:18:25.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.676+0000 7f5f53fff700 1 -- 172.21.15.6:0/3544115543 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54007610 con 0x7f5f48004d50 2023-10-06T02:18:25.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.677+0000 7f5f63721700 1 -- 172.21.15.6:0/3544115543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f48004d50 msgr2=0x7f5f480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:25.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.677+0000 7f5f63721700 1 --2- 172.21.15.6:0/3544115543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f48004d50 0x7f5f480051c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c06fd70 tx=0x7f5f540020c0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.677+0000 7f5f61cbe700 1 -- 172.21.15.6:0/3544115543 reap_dead start 2023-10-06T02:18:25.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.677+0000 7f5f63721700 1 -- 172.21.15.6:0/3544115543 shutdown_connections 2023-10-06T02:18:25.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.677+0000 7f5f63721700 1 -- 172.21.15.6:0/3544115543 >> 172.21.15.6:0/3544115543 conn(0x7f5f5c095d00 msgr2=0x7f5f5c0af850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:25.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.677+0000 7f5f63721700 1 -- 172.21.15.6:0/3544115543 shutdown_connections 2023-10-06T02:18:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.677+0000 7f5f63721700 1 -- 172.21.15.6:0/3544115543 wait complete. 2023-10-06T02:18:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.678+0000 7f5f63721700 1 Processor -- start 2023-10-06T02:18:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.678+0000 7f5f63721700 1 -- start start 2023-10-06T02:18:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f63721700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f5c167be0 0x7f5f5c16afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f63721700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f5c0c8f70 0x7f5f5c0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f63721700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f5c16dbc0 0x7f5f5c16e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f63721700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c0c8010 con 0x7f5f5c167be0 2023-10-06T02:18:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f63721700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c0c9920 con 0x7f5f5c0c8f70 2023-10-06T02:18:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f63721700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c0c62f0 con 0x7f5f5c16dbc0 2023-10-06T02:18:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f614bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f5c167be0 0x7f5f5c16afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f614bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f5c167be0 0x7f5f5c16afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56074/0 (socket says 172.21.15.6:56074) 2023-10-06T02:18:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f614bd700 1 -- 172.21.15.6:0/3217197162 learned_addr learned my addr 172.21.15.6:0/3217197162 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:25.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f60cbc700 1 --2- 172.21.15.6:0/3217197162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f5c0c8f70 0x7f5f5c0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f61cbe700 1 --2- 172.21.15.6:0/3217197162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f5c16dbc0 0x7f5f5c16e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f614bd700 1 -- 172.21.15.6:0/3217197162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f5c16dbc0 msgr2=0x7f5f5c16e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:25.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f614bd700 1 --2- 172.21.15.6:0/3217197162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f5c16dbc0 0x7f5f5c16e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f614bd700 1 -- 172.21.15.6:0/3217197162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f5c0c8f70 msgr2=0x7f5f5c0c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:25.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f614bd700 1 --2- 172.21.15.6:0/3217197162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f5c0c8f70 0x7f5f5c0c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f614bd700 1 -- 172.21.15.6:0/3217197162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c16b520 con 0x7f5f5c167be0 2023-10-06T02:18:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f61cbe700 1 --2- 172.21.15.6:0/3217197162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f5c16dbc0 0x7f5f5c16e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f614bd700 1 --2- 172.21.15.6:0/3217197162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f5c167be0 0x7f5f5c16afe0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5f58002b80 tx=0x7f5f58007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f517fa700 1 -- 172.21.15.6:0/3217197162 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800f9a0 con 0x7f5f5c167be0 2023-10-06T02:18:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f517fa700 1 -- 172.21.15.6:0/3217197162 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5800fb20 con 0x7f5f5c167be0 2023-10-06T02:18:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f63721700 1 -- 172.21.15.6:0/3217197162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5c167fb0 con 0x7f5f5c167be0 2023-10-06T02:18:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.679+0000 7f5f517fa700 1 -- 172.21.15.6:0/3217197162 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800fee0 con 0x7f5f5c167be0 2023-10-06T02:18:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.680+0000 7f5f63721700 1 -- 172.21.15.6:0/3217197162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5c0c7670 con 0x7f5f5c167be0 2023-10-06T02:18:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.680+0000 7f5f63721700 1 -- 172.21.15.6:0/3217197162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f5c06d070 con 0x7f5f5c167be0 2023-10-06T02:18:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.681+0000 7f5f517fa700 1 -- 172.21.15.6:0/3217197162 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f58006a30 con 0x7f5f5c167be0 2023-10-06T02:18:25.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.681+0000 7f5f517fa700 1 --2- 172.21.15.6:0/3217197162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f40066f30 0x7f5f400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:25.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.681+0000 7f5f517fa700 1 -- 172.21.15.6:0/3217197162 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5f58084e10 con 0x7f5f5c167be0 2023-10-06T02:18:25.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.681+0000 7f5f60cbc700 1 --2- 172.21.15.6:0/3217197162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f40066f30 0x7f5f400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:25.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.682+0000 7f5f60cbc700 1 --2- 172.21.15.6:0/3217197162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f40066f30 0x7f5f400693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c006f00 tx=0x7f5f4c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:25.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.685+0000 7f5f517fa700 1 -- 172.21.15.6:0/3217197162 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f58088030 con 0x7f5f5c167be0 2023-10-06T02:18:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.875+0000 7f5f63721700 1 -- 172.21.15.6:0/3217197162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5f5c0cc050 con 0x7f5f5c167be0 2023-10-06T02:18:25.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.875+0000 7f5f517fa700 1 -- 172.21.15.6:0/3217197162 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5f58051b90 con 0x7f5f5c167be0 2023-10-06T02:18:25.877 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:18:25.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.878+0000 7f5f63721700 1 -- 172.21.15.6:0/3217197162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f40066f30 msgr2=0x7f5f400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:25.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.878+0000 7f5f63721700 1 --2- 172.21.15.6:0/3217197162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f40066f30 0x7f5f400693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c006f00 tx=0x7f5f4c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.878+0000 7f5f63721700 1 -- 172.21.15.6:0/3217197162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f5c167be0 msgr2=0x7f5f5c16afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:25.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.878+0000 7f5f63721700 1 --2- 172.21.15.6:0/3217197162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f5c167be0 0x7f5f5c16afe0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5f58002b80 tx=0x7f5f58007d30 comp rx=0 tx=0).stop 2023-10-06T02:18:25.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.878+0000 7f5f63721700 1 -- 172.21.15.6:0/3217197162 shutdown_connections 2023-10-06T02:18:25.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.878+0000 7f5f63721700 1 --2- 172.21.15.6:0/3217197162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f5c16dbc0 0x7f5f5c16e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.878+0000 7f5f63721700 1 --2- 172.21.15.6:0/3217197162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f40066f30 0x7f5f400693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.878+0000 7f5f63721700 1 --2- 172.21.15.6:0/3217197162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f5c167be0 0x7f5f5c16afe0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.878+0000 7f5f63721700 1 --2- 172.21.15.6:0/3217197162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f5c0c8f70 0x7f5f5c0c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:25.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.878+0000 7f5f63721700 1 -- 172.21.15.6:0/3217197162 >> 172.21.15.6:0/3217197162 conn(0x7f5f5c095d00 msgr2=0x7f5f5c1585f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:25.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.878+0000 7f5f63721700 1 -- 172.21.15.6:0/3217197162 shutdown_connections 2023-10-06T02:18:25.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:25.878+0000 7f5f63721700 1 -- 172.21.15.6:0/3217197162 wait complete. 2023-10-06T02:18:25.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:18:26.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.012+0000 7f38d97a0700 1 Processor -- start 2023-10-06T02:18:26.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.013+0000 7f38d97a0700 1 -- start start 2023-10-06T02:18:26.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.013+0000 7f38d97a0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38d40d0400 0x7f38d40b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.013+0000 7f38d97a0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d40b6170 con 0x7f38d40ccd40 2023-10-06T02:18:26.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.013+0000 7f38d97a0700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d415dd40 con 0x7f38d40d07d0 2023-10-06T02:18:26.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.013+0000 7f38d97a0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d415e020 con 0x7f38d40d0400 2023-10-06T02:18:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.013+0000 7f38d27fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f38d40ccd40 0x7f38d40cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45766/0 (socket says 172.21.15.6:45766) 2023-10-06T02:18:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d27fc700 1 -- 172.21.15.6:0/3625656797 learned_addr learned my addr 172.21.15.6:0/3625656797 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d1ffb700 1 -- 172.21.15.6:0/3625656797 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839543400 0 0) 0x7f38d40b6170 con 0x7f38d40ccd40 2023-10-06T02:18:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d1ffb700 1 -- 172.21.15.6:0/3625656797 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38c0003570 con 0x7f38d40ccd40 2023-10-06T02:18:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d2ffd700 1 --2- 172.21.15.6:0/3625656797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38d40d0400 0x7f38d40b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d1ffb700 1 -- 172.21.15.6:0/3625656797 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3389783787 0 0) 0x7f38c0003570 con 0x7f38d40ccd40 2023-10-06T02:18:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d1ffb700 1 -- 172.21.15.6:0/3625656797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38d40d0400 msgr2=0x7f38d40b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d1ffb700 1 --2- 172.21.15.6:0/3625656797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38d40d0400 0x7f38d40b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d1ffb700 1 -- 172.21.15.6:0/3625656797 >> v1:172.21.15.175:6789/0 conn(0x7f38d40d07d0 legacy=0x7f38d40b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d1ffb700 1 -- 172.21.15.6:0/3625656797 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d40ceaa0 con 0x7f38d40ccd40 2023-10-06T02:18:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d1ffb700 1 -- 172.21.15.6:0/3625656797 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f38bc001470 con 0x7f38d40ccd40 2023-10-06T02:18:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d1ffb700 1 -- 172.21.15.6:0/3625656797 >> v1:172.21.15.6:6789/0 conn(0x7f38d40ccd40 legacy=0x7f38d40cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d1ffb700 1 --2- 172.21.15.6:0/3625656797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38c0003a90 0x7f38c0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d1ffb700 1 --2- 172.21.15.6:0/3625656797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38c0004810 0x7f38c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d1ffb700 1 --2- 172.21.15.6:0/3625656797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38d40d0400 0x7f38c0005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d1ffb700 1 -- 172.21.15.6:0/3625656797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d415e020 con 0x7f38c0004810 2023-10-06T02:18:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d1ffb700 1 -- 172.21.15.6:0/3625656797 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c000bc20 con 0x7f38c0003a90 2023-10-06T02:18:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d1ffb700 1 -- 172.21.15.6:0/3625656797 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c000bde0 con 0x7f38d40d0400 2023-10-06T02:18:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d27fc700 1 --2- 172.21.15.6:0/3625656797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38c0004810 0x7f38c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d2ffd700 1 --2- 172.21.15.6:0/3625656797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38c0003a90 0x7f38c0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.014+0000 7f38d37fe700 1 --2- 172.21.15.6:0/3625656797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38d40d0400 0x7f38c0005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.015+0000 7f38d27fc700 1 -- 172.21.15.6:0/3625656797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38d40d0400 msgr2=0x7f38c0005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.015+0000 7f38d27fc700 1 --2- 172.21.15.6:0/3625656797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38d40d0400 0x7f38c0005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.015+0000 7f38d27fc700 1 -- 172.21.15.6:0/3625656797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38c0003a90 msgr2=0x7f38c0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.015+0000 7f38d27fc700 1 --2- 172.21.15.6:0/3625656797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38c0003a90 0x7f38c0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.015+0000 7f38d27fc700 1 -- 172.21.15.6:0/3625656797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0003570 con 0x7f38c0004810 2023-10-06T02:18:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.015+0000 7f38d27fc700 1 --2- 172.21.15.6:0/3625656797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38c0004810 0x7f38c0004c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f38bc001ed0 tx=0x7f38d40cdf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707c60852959b112 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.015+0000 7f38d1ffb700 1 -- 172.21.15.6:0/3625656797 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00cc30 con 0x7f38c0004810 2023-10-06T02:18:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.015+0000 7f38d1ffb700 1 -- 172.21.15.6:0/3625656797 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc00cd90 con 0x7f38c0004810 2023-10-06T02:18:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.015+0000 7f38d1ffb700 1 -- 172.21.15.6:0/3625656797 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc005b70 con 0x7f38c0004810 2023-10-06T02:18:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.015+0000 7f38d97a0700 1 -- 172.21.15.6:0/3625656797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38c0004810 msgr2=0x7f38c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.015+0000 7f38d97a0700 1 --2- 172.21.15.6:0/3625656797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38c0004810 0x7f38c0004c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f38bc001ed0 tx=0x7f38d40cdf50 comp rx=0 tx=0).stop 2023-10-06T02:18:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.015+0000 7f38d37fe700 1 -- 172.21.15.6:0/3625656797 reap_dead start 2023-10-06T02:18:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.015+0000 7f38d97a0700 1 -- 172.21.15.6:0/3625656797 shutdown_connections 2023-10-06T02:18:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.015+0000 7f38d97a0700 1 -- 172.21.15.6:0/3625656797 >> 172.21.15.6:0/3625656797 conn(0x7f38d406a220 msgr2=0x7f38d406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.016+0000 7f38d97a0700 1 -- 172.21.15.6:0/3625656797 shutdown_connections 2023-10-06T02:18:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.016+0000 7f38d97a0700 1 -- 172.21.15.6:0/3625656797 wait complete. 2023-10-06T02:18:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.017+0000 7f38d97a0700 1 Processor -- start 2023-10-06T02:18:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.017+0000 7f38d97a0700 1 -- start start 2023-10-06T02:18:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.017+0000 7f38d97a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38c0004810 0x7f38d415ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.017+0000 7f38d97a0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38d416a9a0 0x7f38d4142250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.017+0000 7f38d97a0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38d416ae10 0x7f38d40c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.017+0000 7f38d97a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d415b9a0 con 0x7f38c0004810 2023-10-06T02:18:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.017+0000 7f38d97a0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d415bc80 con 0x7f38d416ae10 2023-10-06T02:18:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.017+0000 7f38d97a0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d415bf60 con 0x7f38d416a9a0 2023-10-06T02:18:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.018+0000 7f38d2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38c0004810 0x7f38d415ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.018+0000 7f38d2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38c0004810 0x7f38d415ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56096/0 (socket says 172.21.15.6:56096) 2023-10-06T02:18:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.018+0000 7f38d2ffd700 1 -- 172.21.15.6:0/474496408 learned_addr learned my addr 172.21.15.6:0/474496408 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.018+0000 7f38d27fc700 1 --2- 172.21.15.6:0/474496408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38d416a9a0 0x7f38d4142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.018+0000 7f38d37fe700 1 --2- 172.21.15.6:0/474496408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38d416ae10 0x7f38d40c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.018+0000 7f38d2ffd700 1 -- 172.21.15.6:0/474496408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38d416a9a0 msgr2=0x7f38d4142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.018+0000 7f38d2ffd700 1 --2- 172.21.15.6:0/474496408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38d416a9a0 0x7f38d4142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.018+0000 7f38d2ffd700 1 -- 172.21.15.6:0/474496408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38d416ae10 msgr2=0x7f38d40c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.018+0000 7f38d2ffd700 1 --2- 172.21.15.6:0/474496408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38d416ae10 0x7f38d40c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.018+0000 7f38d2ffd700 1 -- 172.21.15.6:0/474496408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d415c240 con 0x7f38c0004810 2023-10-06T02:18:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.018+0000 7f38d37fe700 1 --2- 172.21.15.6:0/474496408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38d416ae10 0x7f38d40c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.018+0000 7f38d2ffd700 1 --2- 172.21.15.6:0/474496408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38c0004810 0x7f38d415ca40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00bbd0 tx=0x7f38cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:26.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.018+0000 7f38caffd700 1 -- 172.21.15.6:0/474496408 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc010950 con 0x7f38c0004810 2023-10-06T02:18:26.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.018+0000 7f38caffd700 1 -- 172.21.15.6:0/474496408 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc010ab0 con 0x7f38c0004810 2023-10-06T02:18:26.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.018+0000 7f38d97a0700 1 -- 172.21.15.6:0/474496408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d415c520 con 0x7f38c0004810 2023-10-06T02:18:26.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.018+0000 7f38caffd700 1 -- 172.21.15.6:0/474496408 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc010e70 con 0x7f38c0004810 2023-10-06T02:18:26.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.018+0000 7f38d97a0700 1 -- 172.21.15.6:0/474496408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d4142790 con 0x7f38c0004810 2023-10-06T02:18:26.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.019+0000 7f38d97a0700 1 -- 172.21.15.6:0/474496408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d4088760 con 0x7f38c0004810 2023-10-06T02:18:26.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.020+0000 7f38caffd700 1 -- 172.21.15.6:0/474496408 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f38cc014640 con 0x7f38c0004810 2023-10-06T02:18:26.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.020+0000 7f38caffd700 1 --2- 172.21.15.6:0/474496408 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38b4066f30 0x7f38b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.020+0000 7f38caffd700 1 -- 172.21.15.6:0/474496408 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f38cc0851b0 con 0x7f38c0004810 2023-10-06T02:18:26.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.020+0000 7f38d27fc700 1 --2- 172.21.15.6:0/474496408 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38b4066f30 0x7f38b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.021+0000 7f38d27fc700 1 --2- 172.21.15.6:0/474496408 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38b4066f30 0x7f38b40693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f38d40b14b0 tx=0x7f38bc015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:26.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.024+0000 7f38caffd700 1 -- 172.21.15.6:0/474496408 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38cc051fd0 con 0x7f38c0004810 2023-10-06T02:18:26.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.218+0000 7f38d97a0700 1 -- 172.21.15.6:0/474496408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38d40ced80 con 0x7f38c0004810 2023-10-06T02:18:26.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.219+0000 7f38caffd700 1 -- 172.21.15.6:0/474496408 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38cc0555f0 con 0x7f38c0004810 2023-10-06T02:18:26.220 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:18:26.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.221+0000 7f38d97a0700 1 -- 172.21.15.6:0/474496408 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38b4066f30 msgr2=0x7f38b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.221+0000 7f38d97a0700 1 --2- 172.21.15.6:0/474496408 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38b4066f30 0x7f38b40693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f38d40b14b0 tx=0x7f38bc015000 comp rx=0 tx=0).stop 2023-10-06T02:18:26.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.221+0000 7f38d97a0700 1 -- 172.21.15.6:0/474496408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38c0004810 msgr2=0x7f38d415ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.221+0000 7f38d97a0700 1 --2- 172.21.15.6:0/474496408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38c0004810 0x7f38d415ca40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00bbd0 tx=0x7f38cc008040 comp rx=0 tx=0).stop 2023-10-06T02:18:26.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.221+0000 7f38d97a0700 1 -- 172.21.15.6:0/474496408 shutdown_connections 2023-10-06T02:18:26.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.221+0000 7f38d97a0700 1 --2- 172.21.15.6:0/474496408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38d416ae10 0x7f38d40c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.221+0000 7f38d97a0700 1 --2- 172.21.15.6:0/474496408 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38b4066f30 0x7f38b40693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.221+0000 7f38d97a0700 1 --2- 172.21.15.6:0/474496408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38c0004810 0x7f38d415ca40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.221+0000 7f38d97a0700 1 --2- 172.21.15.6:0/474496408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38d416a9a0 0x7f38d4142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.221+0000 7f38d97a0700 1 -- 172.21.15.6:0/474496408 >> 172.21.15.6:0/474496408 conn(0x7f38d406a220 msgr2=0x7f38d40b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:26.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.221+0000 7f38d97a0700 1 -- 172.21.15.6:0/474496408 shutdown_connections 2023-10-06T02:18:26.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.221+0000 7f38d97a0700 1 -- 172.21.15.6:0/474496408 wait complete. 2023-10-06T02:18:26.234 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:18:26.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.354+0000 7f2f53fa6700 1 Processor -- start 2023-10-06T02:18:26.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.354+0000 7f2f53fa6700 1 -- start start 2023-10-06T02:18:26.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.355+0000 7f2f53fa6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2f4c0d0400 0x7f2f4c0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.355+0000 7f2f53fa6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f4c0d07d0 0x7f2f4c0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.355+0000 7f2f53fa6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4c0b6170 con 0x7f2f4c0ccd40 2023-10-06T02:18:26.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.355+0000 7f2f53fa6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4c15dd40 con 0x7f2f4c0d0400 2023-10-06T02:18:26.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.355+0000 7f2f53fa6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c15e020 con 0x7f2f4c0d07d0 2023-10-06T02:18:26.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.355+0000 7f2f51d42700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2f4c0d0400 0x7f2f4c0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.355+0000 7f2f51541700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2f4c0ccd40 0x7f2f4c0cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45780/0 (socket says 172.21.15.6:45780) 2023-10-06T02:18:26.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.355+0000 7f2f51541700 1 -- 172.21.15.6:0/1365323308 learned_addr learned my addr 172.21.15.6:0/1365323308 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:26.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.355+0000 7f2f52543700 1 --2- 172.21.15.6:0/1365323308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f4c0d07d0 0x7f2f4c0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.356+0000 7f2f51d42700 1 -- 172.21.15.6:0/1365323308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f4c0d07d0 msgr2=0x7f2f4c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:26.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.356+0000 7f2f51d42700 1 --2- 172.21.15.6:0/1365323308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f4c0d07d0 0x7f2f4c0b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.356+0000 7f2f51d42700 1 -- 172.21.15.6:0/1365323308 >> v1:172.21.15.6:6789/0 conn(0x7f2f4c0ccd40 legacy=0x7f2f4c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.356+0000 7f2f51d42700 1 -- 172.21.15.6:0/1365323308 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c0ceaa0 con 0x7f2f4c0d0400 2023-10-06T02:18:26.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.356+0000 7f2f50d40700 1 -- 172.21.15.6:0/1365323308 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390460054 0 0) 0x7f2f4c0b6170 con 0x7f2f4c0ccd40 2023-10-06T02:18:26.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.356+0000 7f2f51d42700 1 --2- 172.21.15.6:0/1365323308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f4c0d0400 0x7f2f4c0b5c30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009eb0 tx=0x7f2f44009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a7d0a702491352 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:26.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.356+0000 7f2f50d40700 1 -- 172.21.15.6:0/1365323308 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4400e070 con 0x7f2f4c0d0400 2023-10-06T02:18:26.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.356+0000 7f2f50d40700 1 -- 172.21.15.6:0/1365323308 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4400bc30 con 0x7f2f4c0d0400 2023-10-06T02:18:26.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.356+0000 7f2f50d40700 1 -- 172.21.15.6:0/1365323308 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f44012430 con 0x7f2f4c0d0400 2023-10-06T02:18:26.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.356+0000 7f2f53fa6700 1 -- 172.21.15.6:0/1365323308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f4c0d0400 msgr2=0x7f2f4c0b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.356+0000 7f2f53fa6700 1 --2- 172.21.15.6:0/1365323308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f4c0d0400 0x7f2f4c0b5c30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009eb0 tx=0x7f2f44009780 comp rx=0 tx=0).stop 2023-10-06T02:18:26.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.356+0000 7f2f53fa6700 1 -- 172.21.15.6:0/1365323308 shutdown_connections 2023-10-06T02:18:26.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.356+0000 7f2f53fa6700 1 --2- 172.21.15.6:0/1365323308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f4c0d07d0 0x7f2f4c0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.356+0000 7f2f53fa6700 1 --2- 172.21.15.6:0/1365323308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f4c0d0400 0x7f2f4c0b5c30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.356+0000 7f2f53fa6700 1 -- 172.21.15.6:0/1365323308 >> 172.21.15.6:0/1365323308 conn(0x7f2f4c06a220 msgr2=0x7f2f4c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:26.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.357+0000 7f2f53fa6700 1 -- 172.21.15.6:0/1365323308 shutdown_connections 2023-10-06T02:18:26.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.357+0000 7f2f53fa6700 1 -- 172.21.15.6:0/1365323308 wait complete. 2023-10-06T02:18:26.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.358+0000 7f2f53fa6700 1 Processor -- start 2023-10-06T02:18:26.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.358+0000 7f2f53fa6700 1 -- start start 2023-10-06T02:18:26.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.358+0000 7f2f53fa6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f4c0ccd40 0x7f2f4c152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.358+0000 7f2f53fa6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f4c0d0400 0x7f2f4c14ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.358+0000 7f2f53fa6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f4c0d07d0 0x7f2f4c16a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.358+0000 7f2f53fa6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c1511c0 con 0x7f2f4c0d07d0 2023-10-06T02:18:26.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.358+0000 7f2f53fa6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c1505b0 con 0x7f2f4c0d0400 2023-10-06T02:18:26.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.358+0000 7f2f53fa6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c150890 con 0x7f2f4c0ccd40 2023-10-06T02:18:26.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.358+0000 7f2f52543700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f4c0d07d0 0x7f2f4c16a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.358+0000 7f2f52543700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f4c0d07d0 0x7f2f4c16a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56112/0 (socket says 172.21.15.6:56112) 2023-10-06T02:18:26.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.358+0000 7f2f52543700 1 -- 172.21.15.6:0/994830562 learned_addr learned my addr 172.21.15.6:0/994830562 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:26.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.359+0000 7f2f51541700 1 --2- 172.21.15.6:0/994830562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f4c0d0400 0x7f2f4c14ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.359+0000 7f2f52543700 1 -- 172.21.15.6:0/994830562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f4c0ccd40 msgr2=0x7f2f4c152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.359+0000 7f2f51d42700 1 --2- 172.21.15.6:0/994830562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f4c0ccd40 0x7f2f4c152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.359+0000 7f2f52543700 1 --2- 172.21.15.6:0/994830562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f4c0ccd40 0x7f2f4c152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.359+0000 7f2f52543700 1 -- 172.21.15.6:0/994830562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f4c0d0400 msgr2=0x7f2f4c14ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.359+0000 7f2f52543700 1 --2- 172.21.15.6:0/994830562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f4c0d0400 0x7f2f4c14ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.359+0000 7f2f52543700 1 -- 172.21.15.6:0/994830562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f44009a20 con 0x7f2f4c0d07d0 2023-10-06T02:18:26.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.359+0000 7f2f51d42700 1 --2- 172.21.15.6:0/994830562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f4c0ccd40 0x7f2f4c152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:26.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.359+0000 7f2f51541700 1 --2- 172.21.15.6:0/994830562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f4c0d0400 0x7f2f4c14ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:26.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.359+0000 7f2f52543700 1 --2- 172.21.15.6:0/994830562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f4c0d07d0 0x7f2f4c16a0c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00d860 tx=0x7f2f3c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:26.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.359+0000 7f2f49ffb700 1 -- 172.21.15.6:0/994830562 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c0125f0 con 0x7f2f4c0d07d0 2023-10-06T02:18:26.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.359+0000 7f2f49ffb700 1 -- 172.21.15.6:0/994830562 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c012750 con 0x7f2f4c0d07d0 2023-10-06T02:18:26.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.359+0000 7f2f53fa6700 1 -- 172.21.15.6:0/994830562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4c150b70 con 0x7f2f4c0d07d0 2023-10-06T02:18:26.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.359+0000 7f2f49ffb700 1 -- 172.21.15.6:0/994830562 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c012b10 con 0x7f2f4c0d07d0 2023-10-06T02:18:26.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.359+0000 7f2f53fa6700 1 -- 172.21.15.6:0/994830562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4c153150 con 0x7f2f4c0d07d0 2023-10-06T02:18:26.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.360+0000 7f2f53fa6700 1 -- 172.21.15.6:0/994830562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4c0d14a0 con 0x7f2f4c0d07d0 2023-10-06T02:18:26.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.361+0000 7f2f49ffb700 1 -- 172.21.15.6:0/994830562 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f3c01e460 con 0x7f2f4c0d07d0 2023-10-06T02:18:26.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.361+0000 7f2f49ffb700 1 --2- 172.21.15.6:0/994830562 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f38066f30 0x7f2f380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.361+0000 7f2f49ffb700 1 -- 172.21.15.6:0/994830562 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2f3c084f70 con 0x7f2f4c0d07d0 2023-10-06T02:18:26.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.361+0000 7f2f51d42700 1 --2- 172.21.15.6:0/994830562 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f38066f30 0x7f2f380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.362+0000 7f2f51d42700 1 --2- 172.21.15.6:0/994830562 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f38066f30 0x7f2f380693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009eb0 tx=0x7f2f44017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:26.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.366+0000 7f2f49ffb700 1 -- 172.21.15.6:0/994830562 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f3c055820 con 0x7f2f4c0d07d0 2023-10-06T02:18:26.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.559+0000 7f2f53fa6700 1 -- 172.21.15.6:0/994830562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2f4c0ced80 con 0x7f2f4c0d07d0 2023-10-06T02:18:26.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.559+0000 7f2f49ffb700 1 -- 172.21.15.6:0/994830562 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2f3c0553b0 con 0x7f2f4c0d07d0 2023-10-06T02:18:26.559 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:18:26.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.561+0000 7f2f53fa6700 1 -- 172.21.15.6:0/994830562 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f38066f30 msgr2=0x7f2f380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.561+0000 7f2f53fa6700 1 --2- 172.21.15.6:0/994830562 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f38066f30 0x7f2f380693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009eb0 tx=0x7f2f44017000 comp rx=0 tx=0).stop 2023-10-06T02:18:26.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.561+0000 7f2f53fa6700 1 -- 172.21.15.6:0/994830562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f4c0d07d0 msgr2=0x7f2f4c16a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.561+0000 7f2f53fa6700 1 --2- 172.21.15.6:0/994830562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f4c0d07d0 0x7f2f4c16a0c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00d860 tx=0x7f2f3c008040 comp rx=0 tx=0).stop 2023-10-06T02:18:26.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.561+0000 7f2f53fa6700 1 -- 172.21.15.6:0/994830562 shutdown_connections 2023-10-06T02:18:26.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.561+0000 7f2f53fa6700 1 --2- 172.21.15.6:0/994830562 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f38066f30 0x7f2f380693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.561+0000 7f2f53fa6700 1 --2- 172.21.15.6:0/994830562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f4c0d07d0 0x7f2f4c16a0c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.561+0000 7f2f53fa6700 1 --2- 172.21.15.6:0/994830562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f4c0ccd40 0x7f2f4c152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.561+0000 7f2f53fa6700 1 --2- 172.21.15.6:0/994830562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f4c0d0400 0x7f2f4c14ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.561+0000 7f2f53fa6700 1 -- 172.21.15.6:0/994830562 >> 172.21.15.6:0/994830562 conn(0x7f2f4c06a220 msgr2=0x7f2f4c0b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:26.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.561+0000 7f2f53fa6700 1 -- 172.21.15.6:0/994830562 shutdown_connections 2023-10-06T02:18:26.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.561+0000 7f2f53fa6700 1 -- 172.21.15.6:0/994830562 wait complete. 2023-10-06T02:18:26.573 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:18:26.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.695+0000 7f4b14585700 1 Processor -- start 2023-10-06T02:18:26.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.695+0000 7f4b14585700 1 -- start start 2023-10-06T02:18:26.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.696+0000 7f4b14585700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b0c0d0400 0x7f4b0c0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.696+0000 7f4b14585700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b0c0ccd40 0x7f4b0c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.696+0000 7f4b14585700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4b0c0cf7e0 0x7f4b0c0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.696+0000 7f4b14585700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c0b6170 con 0x7f4b0c0d0400 2023-10-06T02:18:26.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.696+0000 7f4b14585700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c15dd40 con 0x7f4b0c0cf7e0 2023-10-06T02:18:26.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.696+0000 7f4b14585700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c15e020 con 0x7f4b0c0ccd40 2023-10-06T02:18:26.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.696+0000 7f4b12321700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b0c0d0400 0x7f4b0c0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.696+0000 7f4b12321700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b0c0d0400 0x7f4b0c0b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56124/0 (socket says 172.21.15.6:56124) 2023-10-06T02:18:26.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.696+0000 7f4b12321700 1 -- 172.21.15.6:0/272289427 learned_addr learned my addr 172.21.15.6:0/272289427 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:26.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.696+0000 7f4b12b22700 1 --2- 172.21.15.6:0/272289427 >> v2:172.21.15.175:3300/0 conn(0x7f4b0c0cf7e0 0x7f4b0c0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.696+0000 7f4b11b20700 1 --2- 172.21.15.6:0/272289427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b0c0ccd40 0x7f4b0c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.697+0000 7f4b12321700 1 -- 172.21.15.6:0/272289427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b0c0ccd40 msgr2=0x7f4b0c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:26.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.697+0000 7f4b12321700 1 --2- 172.21.15.6:0/272289427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b0c0ccd40 0x7f4b0c0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.697+0000 7f4b12321700 1 -- 172.21.15.6:0/272289427 >> v2:172.21.15.175:3300/0 conn(0x7f4b0c0cf7e0 msgr2=0x7f4b0c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:26.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.697+0000 7f4b12321700 1 --2- 172.21.15.6:0/272289427 >> v2:172.21.15.175:3300/0 conn(0x7f4b0c0cf7e0 0x7f4b0c0b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.697+0000 7f4b12321700 1 -- 172.21.15.6:0/272289427 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c0ceaa0 con 0x7f4b0c0d0400 2023-10-06T02:18:26.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.697+0000 7f4b12b22700 1 --2- 172.21.15.6:0/272289427 >> v2:172.21.15.175:3300/0 conn(0x7f4b0c0cf7e0 0x7f4b0c0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:26.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.697+0000 7f4b12321700 1 --2- 172.21.15.6:0/272289427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0c0d0400 0x7f4b0c0b5c30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0b3830 tx=0x7f4b04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8a67a1690b4fbd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:26.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.697+0000 7f4b1131f700 1 -- 172.21.15.6:0/272289427 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0400e070 con 0x7f4b0c0d0400 2023-10-06T02:18:26.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.697+0000 7f4b1131f700 1 -- 172.21.15.6:0/272289427 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0400bad0 con 0x7f4b0c0d0400 2023-10-06T02:18:26.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.697+0000 7f4b1131f700 1 -- 172.21.15.6:0/272289427 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b040092e0 con 0x7f4b0c0d0400 2023-10-06T02:18:26.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.697+0000 7f4b14585700 1 -- 172.21.15.6:0/272289427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0c0d0400 msgr2=0x7f4b0c0b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.697+0000 7f4b14585700 1 --2- 172.21.15.6:0/272289427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0c0d0400 0x7f4b0c0b5c30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0b3830 tx=0x7f4b04009840 comp rx=0 tx=0).stop 2023-10-06T02:18:26.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.698+0000 7f4b14585700 1 -- 172.21.15.6:0/272289427 shutdown_connections 2023-10-06T02:18:26.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.698+0000 7f4b14585700 1 --2- 172.21.15.6:0/272289427 >> v2:172.21.15.175:3300/0 conn(0x7f4b0c0cf7e0 0x7f4b0c0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.698+0000 7f4b14585700 1 --2- 172.21.15.6:0/272289427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0c0d0400 0x7f4b0c0b5c30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.698+0000 7f4b14585700 1 --2- 172.21.15.6:0/272289427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b0c0ccd40 0x7f4b0c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.698+0000 7f4b14585700 1 -- 172.21.15.6:0/272289427 >> 172.21.15.6:0/272289427 conn(0x7f4b0c06a220 msgr2=0x7f4b0c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:26.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.698+0000 7f4b14585700 1 -- 172.21.15.6:0/272289427 shutdown_connections 2023-10-06T02:18:26.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.698+0000 7f4b14585700 1 -- 172.21.15.6:0/272289427 wait complete. 2023-10-06T02:18:26.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.699+0000 7f4b14585700 1 Processor -- start 2023-10-06T02:18:26.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.699+0000 7f4b14585700 1 -- start start 2023-10-06T02:18:26.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.699+0000 7f4b14585700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b0c0ccd40 0x7f4b0c14d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.699+0000 7f4b14585700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0c0cf7e0 0x7f4b0c1696d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.699+0000 7f4b14585700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b0c0d0400 0x7f4b0c153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.699+0000 7f4b14585700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c14db80 con 0x7f4b0c0cf7e0 2023-10-06T02:18:26.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.699+0000 7f4b14585700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c14d610 con 0x7f4b0c0d0400 2023-10-06T02:18:26.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.699+0000 7f4b14585700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c14ddd0 con 0x7f4b0c0ccd40 2023-10-06T02:18:26.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.700+0000 7f4b11b20700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0c0cf7e0 0x7f4b0c1696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.700+0000 7f4b11b20700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0c0cf7e0 0x7f4b0c1696d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56126/0 (socket says 172.21.15.6:56126) 2023-10-06T02:18:26.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.700+0000 7f4b11b20700 1 -- 172.21.15.6:0/1519184342 learned_addr learned my addr 172.21.15.6:0/1519184342 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:26.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.700+0000 7f4b12321700 1 --2- 172.21.15.6:0/1519184342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b0c0ccd40 0x7f4b0c14d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.700+0000 7f4b12b22700 1 --2- 172.21.15.6:0/1519184342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b0c0d0400 0x7f4b0c153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.700+0000 7f4b11b20700 1 -- 172.21.15.6:0/1519184342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b0c0ccd40 msgr2=0x7f4b0c14d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.700+0000 7f4b11b20700 1 --2- 172.21.15.6:0/1519184342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b0c0ccd40 0x7f4b0c14d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.700+0000 7f4b11b20700 1 -- 172.21.15.6:0/1519184342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b0c0d0400 msgr2=0x7f4b0c153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.700+0000 7f4b11b20700 1 --2- 172.21.15.6:0/1519184342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b0c0d0400 0x7f4b0c153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.700+0000 7f4b11b20700 1 -- 172.21.15.6:0/1519184342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04009ae0 con 0x7f4b0c0cf7e0 2023-10-06T02:18:26.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.700+0000 7f4b11b20700 1 --2- 172.21.15.6:0/1519184342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0c0cf7e0 0x7f4b0c1696d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000d890 tx=0x7f4b00008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:26.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.700+0000 7f4b0a7fc700 1 -- 172.21.15.6:0/1519184342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b000125f0 con 0x7f4b0c0cf7e0 2023-10-06T02:18:26.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.700+0000 7f4b0a7fc700 1 -- 172.21.15.6:0/1519184342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b00012770 con 0x7f4b0c0cf7e0 2023-10-06T02:18:26.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.700+0000 7f4b14585700 1 -- 172.21.15.6:0/1519184342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0c14e0b0 con 0x7f4b0c0cf7e0 2023-10-06T02:18:26.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.700+0000 7f4b0a7fc700 1 -- 172.21.15.6:0/1519184342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00012b30 con 0x7f4b0c0cf7e0 2023-10-06T02:18:26.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.700+0000 7f4b14585700 1 -- 172.21.15.6:0/1519184342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0c14e670 con 0x7f4b0c0cf7e0 2023-10-06T02:18:26.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.701+0000 7f4b14585700 1 -- 172.21.15.6:0/1519184342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0c14e890 con 0x7f4b0c0cf7e0 2023-10-06T02:18:26.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.702+0000 7f4b0a7fc700 1 -- 172.21.15.6:0/1519184342 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b0001e460 con 0x7f4b0c0cf7e0 2023-10-06T02:18:26.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.702+0000 7f4b0a7fc700 1 --2- 172.21.15.6:0/1519184342 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4af8066f30 0x7f4af80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:26.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.702+0000 7f4b0a7fc700 1 -- 172.21.15.6:0/1519184342 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4b00084f50 con 0x7f4b0c0cf7e0 2023-10-06T02:18:26.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.702+0000 7f4b12321700 1 --2- 172.21.15.6:0/1519184342 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4af8066f30 0x7f4af80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:26.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.703+0000 7f4b12321700 1 --2- 172.21.15.6:0/1519184342 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4af8066f30 0x7f4af80693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009fd0 tx=0x7f4b04018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:26.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.706+0000 7f4b0a7fc700 1 -- 172.21.15.6:0/1519184342 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b00051d70 con 0x7f4b0c0cf7e0 2023-10-06T02:18:26.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.899+0000 7f4b14585700 1 -- 172.21.15.6:0/1519184342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b0c0ced80 con 0x7f4b0c0cf7e0 2023-10-06T02:18:26.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.900+0000 7f4b0a7fc700 1 -- 172.21.15.6:0/1519184342 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b00055390 con 0x7f4b0c0cf7e0 2023-10-06T02:18:26.900 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-06T02:18:26.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.902+0000 7f4b14585700 1 -- 172.21.15.6:0/1519184342 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4af8066f30 msgr2=0x7f4af80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.902+0000 7f4b14585700 1 --2- 172.21.15.6:0/1519184342 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4af8066f30 0x7f4af80693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009fd0 tx=0x7f4b04018000 comp rx=0 tx=0).stop 2023-10-06T02:18:26.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.902+0000 7f4b14585700 1 -- 172.21.15.6:0/1519184342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0c0cf7e0 msgr2=0x7f4b0c1696d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:26.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.902+0000 7f4b14585700 1 --2- 172.21.15.6:0/1519184342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0c0cf7e0 0x7f4b0c1696d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000d890 tx=0x7f4b00008040 comp rx=0 tx=0).stop 2023-10-06T02:18:26.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.902+0000 7f4b14585700 1 -- 172.21.15.6:0/1519184342 shutdown_connections 2023-10-06T02:18:26.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.902+0000 7f4b14585700 1 --2- 172.21.15.6:0/1519184342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b0c0d0400 0x7f4b0c153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.902+0000 7f4b14585700 1 --2- 172.21.15.6:0/1519184342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b0c0ccd40 0x7f4b0c14d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.902+0000 7f4b14585700 1 --2- 172.21.15.6:0/1519184342 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4af8066f30 0x7f4af80693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.902+0000 7f4b14585700 1 --2- 172.21.15.6:0/1519184342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0c0cf7e0 0x7f4b0c1696d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:26.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.902+0000 7f4b14585700 1 -- 172.21.15.6:0/1519184342 >> 172.21.15.6:0/1519184342 conn(0x7f4b0c06a220 msgr2=0x7f4b0c0b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:26.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.902+0000 7f4b14585700 1 -- 172.21.15.6:0/1519184342 shutdown_connections 2023-10-06T02:18:26.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:26.902+0000 7f4b14585700 1 -- 172.21.15.6:0/1519184342 wait complete. 2023-10-06T02:18:26.914 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T02:18:27.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.036+0000 7f4f2e4c9700 1 Processor -- start 2023-10-06T02:18:27.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.036+0000 7f4f2e4c9700 1 -- start start 2023-10-06T02:18:27.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.037+0000 7f4f2e4c9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f280d0400 0x7f4f280b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:27.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.037+0000 7f4f2e4c9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4f280ccd40 0x7f4f280cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:27.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.037+0000 7f4f2e4c9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f280b6170 con 0x7f4f280cf7e0 2023-10-06T02:18:27.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.037+0000 7f4f2e4c9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f2815dd40 con 0x7f4f280d0400 2023-10-06T02:18:27.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.037+0000 7f4f2e4c9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f2815e020 con 0x7f4f280ccd40 2023-10-06T02:18:27.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.037+0000 7f4f27fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f280d0400 0x7f4f280b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:27.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.037+0000 7f4f27fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f280d0400 0x7f4f280b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56136/0 (socket says 172.21.15.6:56136) 2023-10-06T02:18:27.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.037+0000 7f4f27fff700 1 -- 172.21.15.6:0/811095477 learned_addr learned my addr 172.21.15.6:0/811095477 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:27.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.037+0000 7f4f277fe700 1 --2- 172.21.15.6:0/811095477 >> v2:172.21.15.175:3300/0 conn(0x7f4f280ccd40 0x7f4f280cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:27.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.037+0000 7f4f27fff700 1 -- 172.21.15.6:0/811095477 >> v2:172.21.15.175:3300/0 conn(0x7f4f280ccd40 msgr2=0x7f4f280cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:27.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.037+0000 7f4f27fff700 1 --2- 172.21.15.6:0/811095477 >> v2:172.21.15.175:3300/0 conn(0x7f4f280ccd40 0x7f4f280cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.037+0000 7f4f27fff700 1 -- 172.21.15.6:0/811095477 >> v1:172.21.15.175:6789/0 conn(0x7f4f280cf7e0 legacy=0x7f4f280b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:27.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.037+0000 7f4f27fff700 1 -- 172.21.15.6:0/811095477 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f280ceaa0 con 0x7f4f280d0400 2023-10-06T02:18:27.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.037+0000 7f4f27fff700 1 --2- 172.21.15.6:0/811095477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280d0400 0x7f4f280b5c30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4f280cd1c0 tx=0x7f4f18009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a825dc21fc8a39 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:27.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.037+0000 7f4f26ffd700 1 -- 172.21.15.6:0/811095477 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18005c10 con 0x7f4f280d0400 2023-10-06T02:18:27.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.038+0000 7f4f26ffd700 1 -- 172.21.15.6:0/811095477 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f18005d70 con 0x7f4f280d0400 2023-10-06T02:18:27.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.038+0000 7f4f26ffd700 1 -- 172.21.15.6:0/811095477 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1800b880 con 0x7f4f280d0400 2023-10-06T02:18:27.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.038+0000 7f4f2e4c9700 1 -- 172.21.15.6:0/811095477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280d0400 msgr2=0x7f4f280b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:27.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.038+0000 7f4f2e4c9700 1 --2- 172.21.15.6:0/811095477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280d0400 0x7f4f280b5c30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4f280cd1c0 tx=0x7f4f18009220 comp rx=0 tx=0).stop 2023-10-06T02:18:27.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.038+0000 7f4f2e4c9700 1 -- 172.21.15.6:0/811095477 shutdown_connections 2023-10-06T02:18:27.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.038+0000 7f4f2e4c9700 1 --2- 172.21.15.6:0/811095477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280d0400 0x7f4f280b5c30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.038+0000 7f4f2e4c9700 1 --2- 172.21.15.6:0/811095477 >> v2:172.21.15.175:3300/0 conn(0x7f4f280ccd40 0x7f4f280cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.038+0000 7f4f2e4c9700 1 -- 172.21.15.6:0/811095477 >> 172.21.15.6:0/811095477 conn(0x7f4f2806a220 msgr2=0x7f4f2806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:27.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.038+0000 7f4f2e4c9700 1 -- 172.21.15.6:0/811095477 shutdown_connections 2023-10-06T02:18:27.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.038+0000 7f4f2e4c9700 1 -- 172.21.15.6:0/811095477 wait complete. 2023-10-06T02:18:27.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.039+0000 7f4f2e4c9700 1 Processor -- start 2023-10-06T02:18:27.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.039+0000 7f4f2e4c9700 1 -- start start 2023-10-06T02:18:27.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.040+0000 7f4f2e4c9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f280ccd40 0x7f4f28155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:27.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.040+0000 7f4f2e4c9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f280cf7e0 0x7f4f2815bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:27.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.040+0000 7f4f2e4c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280d0400 0x7f4f280c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:27.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.040+0000 7f4f2e4c9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2815c9b0 con 0x7f4f280d0400 2023-10-06T02:18:27.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.040+0000 7f4f2e4c9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2815cc90 con 0x7f4f280ccd40 2023-10-06T02:18:27.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.040+0000 7f4f2e4c9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2815cf70 con 0x7f4f280cf7e0 2023-10-06T02:18:27.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.040+0000 7f4f2ca66700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280d0400 0x7f4f280c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:27.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.040+0000 7f4f2ca66700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280d0400 0x7f4f280c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56146/0 (socket says 172.21.15.6:56146) 2023-10-06T02:18:27.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.040+0000 7f4f2ca66700 1 -- 172.21.15.6:0/1398107745 learned_addr learned my addr 172.21.15.6:0/1398107745 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:27.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.040+0000 7f4f277fe700 1 --2- 172.21.15.6:0/1398107745 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f280cf7e0 0x7f4f2815bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:27.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.040+0000 7f4f27fff700 1 --2- 172.21.15.6:0/1398107745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f280ccd40 0x7f4f28155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:27.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.040+0000 7f4f2ca66700 1 -- 172.21.15.6:0/1398107745 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f280cf7e0 msgr2=0x7f4f2815bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:27.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.040+0000 7f4f2ca66700 1 --2- 172.21.15.6:0/1398107745 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f280cf7e0 0x7f4f2815bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.040+0000 7f4f2ca66700 1 -- 172.21.15.6:0/1398107745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f280ccd40 msgr2=0x7f4f28155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.040+0000 7f4f2ca66700 1 --2- 172.21.15.6:0/1398107745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f280ccd40 0x7f4f28155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.040+0000 7f4f2ca66700 1 -- 172.21.15.6:0/1398107745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f18009480 con 0x7f4f280d0400 2023-10-06T02:18:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.041+0000 7f4f2ca66700 1 --2- 172.21.15.6:0/1398107745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280d0400 0x7f4f280c8130 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000c8e0 tx=0x7f4f20001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.041+0000 7f4f0ffff700 1 -- 172.21.15.6:0/1398107745 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20012630 con 0x7f4f280d0400 2023-10-06T02:18:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.041+0000 7f4f0ffff700 1 -- 172.21.15.6:0/1398107745 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f20012790 con 0x7f4f280d0400 2023-10-06T02:18:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.041+0000 7f4f2e4c9700 1 -- 172.21.15.6:0/1398107745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2815d250 con 0x7f4f280d0400 2023-10-06T02:18:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.041+0000 7f4f0ffff700 1 -- 172.21.15.6:0/1398107745 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20012b50 con 0x7f4f280d0400 2023-10-06T02:18:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.041+0000 7f4f2e4c9700 1 -- 172.21.15.6:0/1398107745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f28169c60 con 0x7f4f280d0400 2023-10-06T02:18:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.042+0000 7f4f2e4c9700 1 -- 172.21.15.6:0/1398107745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2815d770 con 0x7f4f280d0400 2023-10-06T02:18:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.042+0000 7f4f0ffff700 1 -- 172.21.15.6:0/1398107745 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f2001a3a0 con 0x7f4f280d0400 2023-10-06T02:18:27.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.042+0000 7f4f0ffff700 1 --2- 172.21.15.6:0/1398107745 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f14066f30 0x7f4f140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:27.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.043+0000 7f4f0ffff700 1 -- 172.21.15.6:0/1398107745 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4f20084af0 con 0x7f4f280d0400 2023-10-06T02:18:27.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.043+0000 7f4f27fff700 1 --2- 172.21.15.6:0/1398107745 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f14066f30 0x7f4f140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:27.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.043+0000 7f4f27fff700 1 --2- 172.21.15.6:0/1398107745 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f14066f30 0x7f4f140693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009260 tx=0x7f4f18016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:27.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.047+0000 7f4f0ffff700 1 -- 172.21.15.6:0/1398107745 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f2815d770 con 0x7f4f280d0400 2023-10-06T02:18:27.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.240+0000 7f4f2e4c9700 1 -- 172.21.15.6:0/1398107745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4f2815d770 con 0x7f4f280d0400 2023-10-06T02:18:27.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.240+0000 7f4f0ffff700 1 -- 172.21.15.6:0/1398107745 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4f2815d770 con 0x7f4f280d0400 2023-10-06T02:18:27.241 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:18:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.242+0000 7f4f2e4c9700 1 -- 172.21.15.6:0/1398107745 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f14066f30 msgr2=0x7f4f140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.242+0000 7f4f2e4c9700 1 --2- 172.21.15.6:0/1398107745 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f14066f30 0x7f4f140693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009260 tx=0x7f4f18016000 comp rx=0 tx=0).stop 2023-10-06T02:18:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.242+0000 7f4f2e4c9700 1 -- 172.21.15.6:0/1398107745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280d0400 msgr2=0x7f4f280c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.242+0000 7f4f2e4c9700 1 --2- 172.21.15.6:0/1398107745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280d0400 0x7f4f280c8130 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000c8e0 tx=0x7f4f20001710 comp rx=0 tx=0).stop 2023-10-06T02:18:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.242+0000 7f4f2e4c9700 1 -- 172.21.15.6:0/1398107745 shutdown_connections 2023-10-06T02:18:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.242+0000 7f4f2e4c9700 1 --2- 172.21.15.6:0/1398107745 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f14066f30 0x7f4f140693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.242+0000 7f4f2e4c9700 1 --2- 172.21.15.6:0/1398107745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280d0400 0x7f4f280c8130 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.242+0000 7f4f2e4c9700 1 --2- 172.21.15.6:0/1398107745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f280ccd40 0x7f4f28155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.242+0000 7f4f2e4c9700 1 --2- 172.21.15.6:0/1398107745 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f280cf7e0 0x7f4f2815bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.242+0000 7f4f2e4c9700 1 -- 172.21.15.6:0/1398107745 >> 172.21.15.6:0/1398107745 conn(0x7f4f2806a220 msgr2=0x7f4f280afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:27.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.242+0000 7f4f2e4c9700 1 -- 172.21.15.6:0/1398107745 shutdown_connections 2023-10-06T02:18:27.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.242+0000 7f4f2e4c9700 1 -- 172.21.15.6:0/1398107745 wait complete. 2023-10-06T02:18:27.296 INFO:tasks.cephfs_test_runner:Starting test: test_damaged_dentry (tasks.cephfs.test_damage.TestDamage) 2023-10-06T02:18:27.296 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry' 2023-10-06T02:18:27.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.416+0000 7f1531694700 1 Processor -- start 2023-10-06T02:18:27.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.417+0000 7f1531694700 1 -- start start 2023-10-06T02:18:27.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.417+0000 7f1531694700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f152c0af4e0 0x7f152c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:27.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.417+0000 7f1531694700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0af8b0 0x7f152c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.417+0000 7f1531694700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152c15e190 con 0x7f152c15d460 2023-10-06T02:18:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.417+0000 7f1531694700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152c0b1910 con 0x7f152c0af4e0 2023-10-06T02:18:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.417+0000 7f1531694700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c15dfb0 con 0x7f152c0af8b0 2023-10-06T02:18:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.417+0000 7f152b7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f152c15d460 0x7f152c15d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45794/0 (socket says 172.21.15.6:45794) 2023-10-06T02:18:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.418+0000 7f152b7fe700 1 -- 172.21.15.6:0/4156903624 learned_addr learned my addr 172.21.15.6:0/4156903624 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.418+0000 7f152a7fc700 1 --2- 172.21.15.6:0/4156903624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0af8b0 0x7f152c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.418+0000 7f152affd700 1 --2- 172.21.15.6:0/4156903624 >> v2:172.21.15.175:3300/0 conn(0x7f152c0af4e0 0x7f152c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.418+0000 7f1529ffb700 1 -- 172.21.15.6:0/4156903624 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255828069 0 0) 0x7f152c15e190 con 0x7f152c15d460 2023-10-06T02:18:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.418+0000 7f1529ffb700 1 -- 172.21.15.6:0/4156903624 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1518003570 con 0x7f152c15d460 2023-10-06T02:18:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.418+0000 7f152a7fc700 1 -- 172.21.15.6:0/4156903624 >> v2:172.21.15.175:3300/0 conn(0x7f152c0af4e0 msgr2=0x7f152c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.418+0000 7f152a7fc700 1 --2- 172.21.15.6:0/4156903624 >> v2:172.21.15.175:3300/0 conn(0x7f152c0af4e0 0x7f152c0b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.418+0000 7f152a7fc700 1 -- 172.21.15.6:0/4156903624 >> v1:172.21.15.6:6789/0 conn(0x7f152c15d460 legacy=0x7f152c15d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.418+0000 7f152a7fc700 1 -- 172.21.15.6:0/4156903624 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c0cb650 con 0x7f152c0af8b0 2023-10-06T02:18:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.418+0000 7f152a7fc700 1 --2- 172.21.15.6:0/4156903624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0af8b0 0x7f152c0b2620 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f15140098e0 tx=0x7f15140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec217c97e4739049 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.418+0000 7f1529ffb700 1 -- 172.21.15.6:0/4156903624 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514011630 con 0x7f152c0af8b0 2023-10-06T02:18:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.418+0000 7f1529ffb700 1 -- 172.21.15.6:0/4156903624 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1514011790 con 0x7f152c0af8b0 2023-10-06T02:18:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.418+0000 7f1529ffb700 1 -- 172.21.15.6:0/4156903624 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514011b30 con 0x7f152c0af8b0 2023-10-06T02:18:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.419+0000 7f1531694700 1 -- 172.21.15.6:0/4156903624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0af8b0 msgr2=0x7f152c0b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.419+0000 7f1531694700 1 --2- 172.21.15.6:0/4156903624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0af8b0 0x7f152c0b2620 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f15140098e0 tx=0x7f15140091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.419+0000 7f1531694700 1 -- 172.21.15.6:0/4156903624 shutdown_connections 2023-10-06T02:18:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.419+0000 7f1531694700 1 --2- 172.21.15.6:0/4156903624 >> v2:172.21.15.175:3300/0 conn(0x7f152c0af4e0 0x7f152c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.419+0000 7f1531694700 1 --2- 172.21.15.6:0/4156903624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0af8b0 0x7f152c0b2620 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.419+0000 7f1531694700 1 -- 172.21.15.6:0/4156903624 >> 172.21.15.6:0/4156903624 conn(0x7f152c068680 msgr2=0x7f152c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.419+0000 7f1531694700 1 -- 172.21.15.6:0/4156903624 shutdown_connections 2023-10-06T02:18:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.419+0000 7f1531694700 1 -- 172.21.15.6:0/4156903624 wait complete. 2023-10-06T02:18:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.420+0000 7f1531694700 1 Processor -- start 2023-10-06T02:18:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.420+0000 7f1531694700 1 -- start start 2023-10-06T02:18:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.421+0000 7f1531694700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0af4e0 0x7f152c0cf110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.421+0000 7f1531694700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f152c0af8b0 0x7f152c150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.421+0000 7f1531694700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f152c15d460 0x7f152c14e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.421+0000 7f1531694700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0cf650 con 0x7f152c15d460 2023-10-06T02:18:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.421+0000 7f1531694700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0ce3e0 con 0x7f152c0af8b0 2023-10-06T02:18:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.421+0000 7f1531694700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c16e310 con 0x7f152c0af4e0 2023-10-06T02:18:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.421+0000 7f152b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f152c15d460 0x7f152c14e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.421+0000 7f152b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f152c15d460 0x7f152c14e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56156/0 (socket says 172.21.15.6:56156) 2023-10-06T02:18:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.421+0000 7f152b7fe700 1 -- 172.21.15.6:0/2317043366 learned_addr learned my addr 172.21.15.6:0/2317043366 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.421+0000 7f152affd700 1 --2- 172.21.15.6:0/2317043366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0af4e0 0x7f152c0cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.421+0000 7f152a7fc700 1 --2- 172.21.15.6:0/2317043366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f152c0af8b0 0x7f152c150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.422+0000 7f152b7fe700 1 -- 172.21.15.6:0/2317043366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0af4e0 msgr2=0x7f152c0cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.422+0000 7f152b7fe700 1 --2- 172.21.15.6:0/2317043366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0af4e0 0x7f152c0cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.422+0000 7f152b7fe700 1 -- 172.21.15.6:0/2317043366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f152c0af8b0 msgr2=0x7f152c150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.422+0000 7f152b7fe700 1 --2- 172.21.15.6:0/2317043366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f152c0af8b0 0x7f152c150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.422+0000 7f152b7fe700 1 -- 172.21.15.6:0/2317043366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1514009420 con 0x7f152c15d460 2023-10-06T02:18:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.422+0000 7f152b7fe700 1 --2- 172.21.15.6:0/2317043366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f152c15d460 0x7f152c14e590 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f151c001460 tx=0x7f151c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.422+0000 7f1522ffd700 1 -- 172.21.15.6:0/2317043366 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00a870 con 0x7f152c15d460 2023-10-06T02:18:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.422+0000 7f1522ffd700 1 -- 172.21.15.6:0/2317043366 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c00a9d0 con 0x7f152c15d460 2023-10-06T02:18:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.422+0000 7f1531694700 1 -- 172.21.15.6:0/2317043366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f152c0ce630 con 0x7f152c15d460 2023-10-06T02:18:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.422+0000 7f1522ffd700 1 -- 172.21.15.6:0/2317043366 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00ad50 con 0x7f152c15d460 2023-10-06T02:18:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.422+0000 7f1531694700 1 -- 172.21.15.6:0/2317043366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152c150940 con 0x7f152c15d460 2023-10-06T02:18:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.423+0000 7f1531694700 1 -- 172.21.15.6:0/2317043366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152c0cee30 con 0x7f152c15d460 2023-10-06T02:18:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.423+0000 7f1522ffd700 1 -- 172.21.15.6:0/2317043366 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f151c007300 con 0x7f152c15d460 2023-10-06T02:18:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.424+0000 7f1522ffd700 1 --2- 172.21.15.6:0/2317043366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f150c066f60 0x7f150c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.424+0000 7f1522ffd700 1 -- 172.21.15.6:0/2317043366 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f151c084bd0 con 0x7f152c15d460 2023-10-06T02:18:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.424+0000 7f152affd700 1 --2- 172.21.15.6:0/2317043366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f150c066f60 0x7f150c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.424+0000 7f152affd700 1 --2- 172.21.15.6:0/2317043366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f150c066f60 0x7f150c069410 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1524009db0 tx=0x7f15240091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.428+0000 7f1522ffd700 1 -- 172.21.15.6:0/2317043366 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f152c0cee30 con 0x7f152c15d460 2023-10-06T02:18:27.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.703+0000 7f1531694700 1 -- 172.21.15.6:0/2317043366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry"]} v 0) v1 -- 0x7f152c0cee30 con 0x7f152c15d460 2023-10-06T02:18:27.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.870+0000 7f1522ffd700 1 -- 172.21.15.6:0/2317043366 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry"]}]=0 v61) v1 ==== 137+0+0 (secure 0 0 0) 0x7f152c0cee30 con 0x7f152c15d460 2023-10-06T02:18:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.872+0000 7f1531694700 1 -- 172.21.15.6:0/2317043366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f150c066f60 msgr2=0x7f150c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.872+0000 7f1531694700 1 --2- 172.21.15.6:0/2317043366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f150c066f60 0x7f150c069410 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1524009db0 tx=0x7f15240091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.872+0000 7f1531694700 1 -- 172.21.15.6:0/2317043366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f152c15d460 msgr2=0x7f152c14e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.872+0000 7f1531694700 1 --2- 172.21.15.6:0/2317043366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f152c15d460 0x7f152c14e590 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f151c001460 tx=0x7f151c001a40 comp rx=0 tx=0).stop 2023-10-06T02:18:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.873+0000 7f1531694700 1 -- 172.21.15.6:0/2317043366 shutdown_connections 2023-10-06T02:18:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.873+0000 7f1531694700 1 --2- 172.21.15.6:0/2317043366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f150c066f60 0x7f150c069410 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.873+0000 7f1531694700 1 --2- 172.21.15.6:0/2317043366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f152c15d460 0x7f152c14e590 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.873+0000 7f1531694700 1 --2- 172.21.15.6:0/2317043366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152c0af4e0 0x7f152c0cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.873+0000 7f1531694700 1 --2- 172.21.15.6:0/2317043366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f152c0af8b0 0x7f152c150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:27.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.873+0000 7f1531694700 1 -- 172.21.15.6:0/2317043366 >> 172.21.15.6:0/2317043366 conn(0x7f152c068680 msgr2=0x7f152c0b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:27.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.873+0000 7f1531694700 1 -- 172.21.15.6:0/2317043366 shutdown_connections 2023-10-06T02:18:27.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:27.873+0000 7f1531694700 1 -- 172.21.15.6:0/2317043366 wait complete. 2023-10-06T02:18:27.885 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:18:28.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.007+0000 7f3bd8483700 1 Processor -- start 2023-10-06T02:18:28.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.007+0000 7f3bd8483700 1 -- start start 2023-10-06T02:18:28.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.008+0000 7f3bd8483700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3bd006a910 0x7f3bd006ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:28.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.008+0000 7f3bd8483700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3bd00cc740 0x7f3bd00ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:28.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.008+0000 7f3bd8483700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd006a1a0 con 0x7f3bd015cae0 2023-10-06T02:18:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.008+0000 7f3bd8483700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd006a480 con 0x7f3bd006a910 2023-10-06T02:18:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.008+0000 7f3bd8483700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd00c8e40 con 0x7f3bd00cc740 2023-10-06T02:18:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.008+0000 7f3bd5a1e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3bd006a910 0x7f3bd006ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.008+0000 7f3bd621f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3bd015cae0 0x7f3bd00c8730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45800/0 (socket says 172.21.15.6:45800) 2023-10-06T02:18:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.008+0000 7f3bd621f700 1 -- 172.21.15.6:0/3130262065 learned_addr learned my addr 172.21.15.6:0/3130262065 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.008+0000 7f3bd6a20700 1 --2- 172.21.15.6:0/3130262065 >> v2:172.21.15.175:3300/0 conn(0x7f3bd00cc740 0x7f3bd00ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.008+0000 7f3bd5a1e700 1 -- 172.21.15.6:0/3130262065 >> v2:172.21.15.175:3300/0 conn(0x7f3bd00cc740 msgr2=0x7f3bd00ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.008+0000 7f3bd5a1e700 1 --2- 172.21.15.6:0/3130262065 >> v2:172.21.15.175:3300/0 conn(0x7f3bd00cc740 0x7f3bd00ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.008+0000 7f3bd5a1e700 1 -- 172.21.15.6:0/3130262065 >> v1:172.21.15.6:6789/0 conn(0x7f3bd015cae0 legacy=0x7f3bd00c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.008+0000 7f3bd521d700 1 -- 172.21.15.6:0/3130262065 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559762819 0 0) 0x7f3bd006a1a0 con 0x7f3bd015cae0 2023-10-06T02:18:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.008+0000 7f3bd5a1e700 1 -- 172.21.15.6:0/3130262065 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd006b2d0 con 0x7f3bd006a910 2023-10-06T02:18:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.008+0000 7f3bd6a20700 1 --2- 172.21.15.6:0/3130262065 >> v2:172.21.15.175:3300/0 conn(0x7f3bd00cc740 0x7f3bd00ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.008+0000 7f3bd5a1e700 1 --2- 172.21.15.6:0/3130262065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bd006a910 0x7f3bd006ad90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0069580 tx=0x7f3bc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf85e01efe660b51 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.009+0000 7f3bd521d700 1 -- 172.21.15.6:0/3130262065 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400b6b0 con 0x7f3bd006a910 2023-10-06T02:18:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.009+0000 7f3bd521d700 1 -- 172.21.15.6:0/3130262065 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc400b810 con 0x7f3bd006a910 2023-10-06T02:18:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.009+0000 7f3bd521d700 1 -- 172.21.15.6:0/3130262065 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400bbb0 con 0x7f3bd006a910 2023-10-06T02:18:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.009+0000 7f3bd8483700 1 -- 172.21.15.6:0/3130262065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bd006a910 msgr2=0x7f3bd006ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.009+0000 7f3bd8483700 1 --2- 172.21.15.6:0/3130262065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bd006a910 0x7f3bd006ad90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0069580 tx=0x7f3bc40091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:28.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.009+0000 7f3bd8483700 1 -- 172.21.15.6:0/3130262065 shutdown_connections 2023-10-06T02:18:28.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.009+0000 7f3bd8483700 1 --2- 172.21.15.6:0/3130262065 >> v2:172.21.15.175:3300/0 conn(0x7f3bd00cc740 0x7f3bd00ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:28.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.009+0000 7f3bd8483700 1 --2- 172.21.15.6:0/3130262065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bd006a910 0x7f3bd006ad90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:28.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.009+0000 7f3bd8483700 1 -- 172.21.15.6:0/3130262065 >> 172.21.15.6:0/3130262065 conn(0x7f3bd0067910 msgr2=0x7f3bd00ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:28.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.009+0000 7f3bd8483700 1 -- 172.21.15.6:0/3130262065 shutdown_connections 2023-10-06T02:18:28.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.009+0000 7f3bd8483700 1 -- 172.21.15.6:0/3130262065 wait complete. 2023-10-06T02:18:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.010+0000 7f3bd8483700 1 Processor -- start 2023-10-06T02:18:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.010+0000 7f3bd8483700 1 -- start start 2023-10-06T02:18:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.011+0000 7f3bd8483700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd006a910 0x7f3bd00c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.011+0000 7f3bd8483700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bd00cc740 0x7f3bd014ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.011+0000 7f3bd8483700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bd015cae0 0x7f3bd01567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.011+0000 7f3bd8483700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd00b1320 con 0x7f3bd00cc740 2023-10-06T02:18:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.011+0000 7f3bd8483700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd00b1600 con 0x7f3bd006a910 2023-10-06T02:18:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.011+0000 7f3bd8483700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd00b18e0 con 0x7f3bd015cae0 2023-10-06T02:18:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.011+0000 7f3bd5a1e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bd00cc740 0x7f3bd014ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.011+0000 7f3bd5a1e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bd00cc740 0x7f3bd014ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56176/0 (socket says 172.21.15.6:56176) 2023-10-06T02:18:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.011+0000 7f3bd5a1e700 1 -- 172.21.15.6:0/317527736 learned_addr learned my addr 172.21.15.6:0/317527736 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.011+0000 7f3bd621f700 1 --2- 172.21.15.6:0/317527736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd006a910 0x7f3bd00c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.011+0000 7f3bd6a20700 1 --2- 172.21.15.6:0/317527736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bd015cae0 0x7f3bd01567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.011+0000 7f3bd5a1e700 1 -- 172.21.15.6:0/317527736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bd015cae0 msgr2=0x7f3bd01567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.011+0000 7f3bd5a1e700 1 --2- 172.21.15.6:0/317527736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bd015cae0 0x7f3bd01567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.012+0000 7f3bd5a1e700 1 -- 172.21.15.6:0/317527736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd006a910 msgr2=0x7f3bd00c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.012+0000 7f3bd5a1e700 1 --2- 172.21.15.6:0/317527736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd006a910 0x7f3bd00c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.012+0000 7f3bd5a1e700 1 -- 172.21.15.6:0/317527736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc4009420 con 0x7f3bd00cc740 2023-10-06T02:18:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.012+0000 7f3bd6a20700 1 --2- 172.21.15.6:0/317527736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bd015cae0 0x7f3bd01567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.012+0000 7f3bd5a1e700 1 --2- 172.21.15.6:0/317527736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bd00cc740 0x7f3bd014ef70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3bd006f5e0 tx=0x7f3bc4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.012+0000 7f3bce7fc700 1 -- 172.21.15.6:0/317527736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400bb90 con 0x7f3bd00cc740 2023-10-06T02:18:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.012+0000 7f3bce7fc700 1 -- 172.21.15.6:0/317527736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc4011420 con 0x7f3bd00cc740 2023-10-06T02:18:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.012+0000 7f3bd8483700 1 -- 172.21.15.6:0/317527736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd00b1bc0 con 0x7f3bd00cc740 2023-10-06T02:18:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.012+0000 7f3bce7fc700 1 -- 172.21.15.6:0/317527736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc40117a0 con 0x7f3bd00cc740 2023-10-06T02:18:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.012+0000 7f3bd8483700 1 -- 172.21.15.6:0/317527736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd014f4b0 con 0x7f3bd00cc740 2023-10-06T02:18:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.013+0000 7f3bd8483700 1 -- 172.21.15.6:0/317527736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd006e590 con 0x7f3bd00cc740 2023-10-06T02:18:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.013+0000 7f3bce7fc700 1 -- 172.21.15.6:0/317527736 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bc4011b90 con 0x7f3bd00cc740 2023-10-06T02:18:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.014+0000 7f3bce7fc700 1 --2- 172.21.15.6:0/317527736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3bbc066f30 0x7f3bbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.014+0000 7f3bce7fc700 1 -- 172.21.15.6:0/317527736 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3bc4086320 con 0x7f3bd00cc740 2023-10-06T02:18:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.014+0000 7f3bd621f700 1 --2- 172.21.15.6:0/317527736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3bbc066f30 0x7f3bbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.014+0000 7f3bd621f700 1 --2- 172.21.15.6:0/317527736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3bbc066f30 0x7f3bbc0693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00b3eb0 tx=0x7f3bc0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.018+0000 7f3bce7fc700 1 -- 172.21.15.6:0/317527736 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bc4053140 con 0x7f3bd00cc740 2023-10-06T02:18:28.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.215+0000 7f3bd8483700 1 -- 172.21.15.6:0/317527736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3bd0068420 con 0x7f3bd00cc740 2023-10-06T02:18:28.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.218+0000 7f3bce7fc700 1 -- 172.21.15.6:0/317527736 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3bc4056760 con 0x7f3bd00cc740 2023-10-06T02:18:28.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.220+0000 7f3bd8483700 1 -- 172.21.15.6:0/317527736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3bbc066f30 msgr2=0x7f3bbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:28.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.220+0000 7f3bd8483700 1 --2- 172.21.15.6:0/317527736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3bbc066f30 0x7f3bbc0693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00b3eb0 tx=0x7f3bc0009040 comp rx=0 tx=0).stop 2023-10-06T02:18:28.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.220+0000 7f3bd8483700 1 -- 172.21.15.6:0/317527736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bd00cc740 msgr2=0x7f3bd014ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:28.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.220+0000 7f3bd8483700 1 --2- 172.21.15.6:0/317527736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bd00cc740 0x7f3bd014ef70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3bd006f5e0 tx=0x7f3bc4017000 comp rx=0 tx=0).stop 2023-10-06T02:18:28.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.220+0000 7f3bd8483700 1 -- 172.21.15.6:0/317527736 shutdown_connections 2023-10-06T02:18:28.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.220+0000 7f3bd8483700 1 --2- 172.21.15.6:0/317527736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bd015cae0 0x7f3bd01567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:28.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.220+0000 7f3bd8483700 1 --2- 172.21.15.6:0/317527736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd006a910 0x7f3bd00c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:28.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.220+0000 7f3bd8483700 1 --2- 172.21.15.6:0/317527736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3bbc066f30 0x7f3bbc0693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:28.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.220+0000 7f3bd8483700 1 --2- 172.21.15.6:0/317527736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bd00cc740 0x7f3bd014ef70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:28.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.220+0000 7f3bd8483700 1 -- 172.21.15.6:0/317527736 >> 172.21.15.6:0/317527736 conn(0x7f3bd0067910 msgr2=0x7f3bd0158c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:28.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.221+0000 7f3bd8483700 1 -- 172.21.15.6:0/317527736 shutdown_connections 2023-10-06T02:18:28.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.221+0000 7f3bd8483700 1 -- 172.21.15.6:0/317527736 wait complete. 2023-10-06T02:18:28.232 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:18:28.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:18:28.274 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:18:28.318 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:18:28.318 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:18:28.318 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:18:28.318 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:18:28.358 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:18:28.358 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:18:28.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:28.359 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:18:28.413 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi175.front.sepia.ceph.com... 2023-10-06T02:18:28.414 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:18:28.414 DEBUG:teuthology.orchestra.run.smithi175:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-06T02:18:28.450 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:18:28.451 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:18:28.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:28.451 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:18:28.507 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:18:28.508 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:18:28.508 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-06T02:18:28.547 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:18:28.547 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:18:28.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:28.548 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T02:18:28.603 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi175.front.sepia.ceph.com... 2023-10-06T02:18:28.604 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:18:28.604 DEBUG:teuthology.orchestra.run.smithi175:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-10-06T02:18:28.646 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:18:28.647 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:18:28.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:28.647 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T02:18:28.704 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:18:28.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:18:28.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.823+0000 7f214302c700 1 Processor -- start 2023-10-06T02:18:28.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.823+0000 7f214302c700 1 -- start start 2023-10-06T02:18:28.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.823+0000 7f214302c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f213c0b27f0 0x7f213c159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:28.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.823+0000 7f214302c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f213c15d4d0 0x7f213c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:28.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.823+0000 7f214302c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213c0cb6c0 con 0x7f213c159380 2023-10-06T02:18:28.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.823+0000 7f214302c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f213c15e200 con 0x7f213c15d4d0 2023-10-06T02:18:28.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.823+0000 7f214302c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213c0ccb60 con 0x7f213c0b27f0 2023-10-06T02:18:28.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f2140dc8700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f213c159380 0x7f213c0b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50364/0 (socket says 172.21.15.6:50364) 2023-10-06T02:18:28.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f2140dc8700 1 -- 172.21.15.6:0/2952027551 learned_addr learned my addr 172.21.15.6:0/2952027551 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:28.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213b7fe700 1 -- 172.21.15.6:0/2952027551 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993899816 0 0) 0x7f213c0cb6c0 con 0x7f213c159380 2023-10-06T02:18:28.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213bfff700 1 --2- 172.21.15.6:0/2952027551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f213c0b27f0 0x7f213c159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:28.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f21415c9700 1 --2- 172.21.15.6:0/2952027551 >> v2:172.21.15.175:3300/0 conn(0x7f213c15d4d0 0x7f213c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:28.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213b7fe700 1 -- 172.21.15.6:0/2952027551 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f212c003570 con 0x7f213c159380 2023-10-06T02:18:28.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213b7fe700 1 -- 172.21.15.6:0/2952027551 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2266563770 0 0) 0x7f212c003570 con 0x7f213c159380 2023-10-06T02:18:28.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213b7fe700 1 -- 172.21.15.6:0/2952027551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f213c0b27f0 msgr2=0x7f213c159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:28.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213b7fe700 1 --2- 172.21.15.6:0/2952027551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f213c0b27f0 0x7f213c159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:28.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213b7fe700 1 -- 172.21.15.6:0/2952027551 >> v2:172.21.15.175:3300/0 conn(0x7f213c15d4d0 msgr2=0x7f213c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:28.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213b7fe700 1 --2- 172.21.15.6:0/2952027551 >> v2:172.21.15.175:3300/0 conn(0x7f213c15d4d0 0x7f213c15d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:28.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213b7fe700 1 -- 172.21.15.6:0/2952027551 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213c0c3ef0 con 0x7f213c159380 2023-10-06T02:18:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213b7fe700 1 -- 172.21.15.6:0/2952027551 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f2130001470 con 0x7f213c159380 2023-10-06T02:18:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213b7fe700 1 -- 172.21.15.6:0/2952027551 >> v1:172.21.15.6:6789/0 conn(0x7f213c159380 legacy=0x7f213c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213b7fe700 1 --2- 172.21.15.6:0/2952027551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f213c0b27f0 0x7f212c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213b7fe700 1 --2- 172.21.15.6:0/2952027551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f212c004010 0x7f212c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213b7fe700 1 --2- 172.21.15.6:0/2952027551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f212c004d50 0x7f212c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213b7fe700 1 -- 172.21.15.6:0/2952027551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c15e200 con 0x7f212c004010 2023-10-06T02:18:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213b7fe700 1 -- 172.21.15.6:0/2952027551 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c0ccb60 con 0x7f212c004d50 2023-10-06T02:18:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213b7fe700 1 -- 172.21.15.6:0/2952027551 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212c00bb60 con 0x7f213c0b27f0 2023-10-06T02:18:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f213bfff700 1 --2- 172.21.15.6:0/2952027551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f212c004010 0x7f212c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f2140dc8700 1 --2- 172.21.15.6:0/2952027551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f213c0b27f0 0x7f212c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.824+0000 7f21415c9700 1 --2- 172.21.15.6:0/2952027551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f212c004d50 0x7f212c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.825+0000 7f213bfff700 1 -- 172.21.15.6:0/2952027551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f213c0b27f0 msgr2=0x7f212c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.825+0000 7f213bfff700 1 --2- 172.21.15.6:0/2952027551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f213c0b27f0 0x7f212c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:28.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.825+0000 7f213bfff700 1 -- 172.21.15.6:0/2952027551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f212c004d50 msgr2=0x7f212c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:28.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.825+0000 7f213bfff700 1 --2- 172.21.15.6:0/2952027551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f212c004d50 0x7f212c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:28.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.825+0000 7f213bfff700 1 -- 172.21.15.6:0/2952027551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c003570 con 0x7f212c004010 2023-10-06T02:18:28.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.825+0000 7f213bfff700 1 --2- 172.21.15.6:0/2952027551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f212c004010 0x7f212c004810 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2128006f00 tx=0x7f21280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339e443168a5c30e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:28.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.825+0000 7f213b7fe700 1 -- 172.21.15.6:0/2952027551 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212800e710 con 0x7f212c004010 2023-10-06T02:18:28.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.825+0000 7f213b7fe700 1 -- 172.21.15.6:0/2952027551 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212800e870 con 0x7f212c004010 2023-10-06T02:18:28.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.825+0000 7f213b7fe700 1 -- 172.21.15.6:0/2952027551 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212800ec30 con 0x7f212c004010 2023-10-06T02:18:28.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.825+0000 7f214302c700 1 -- 172.21.15.6:0/2952027551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f212c004010 msgr2=0x7f212c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:28.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.825+0000 7f214302c700 1 --2- 172.21.15.6:0/2952027551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f212c004010 0x7f212c004810 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2128006f00 tx=0x7f21280091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:28.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.825+0000 7f21415c9700 1 -- 172.21.15.6:0/2952027551 reap_dead start 2023-10-06T02:18:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.826+0000 7f214302c700 1 -- 172.21.15.6:0/2952027551 shutdown_connections 2023-10-06T02:18:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.826+0000 7f214302c700 1 -- 172.21.15.6:0/2952027551 >> 172.21.15.6:0/2952027551 conn(0x7f213c068680 msgr2=0x7f213c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.826+0000 7f214302c700 1 -- 172.21.15.6:0/2952027551 shutdown_connections 2023-10-06T02:18:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.826+0000 7f214302c700 1 -- 172.21.15.6:0/2952027551 wait complete. 2023-10-06T02:18:28.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.827+0000 7f214302c700 1 Processor -- start 2023-10-06T02:18:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.827+0000 7f214302c700 1 -- start start 2023-10-06T02:18:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.827+0000 7f214302c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f212c004010 0x7f213c0b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f214302c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f213c0d02f0 0x7f213c0d0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f214302c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213c1569e0 0x7f213c156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f214302c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c0cde20 con 0x7f213c1569e0 2023-10-06T02:18:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f214302c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c0c5030 con 0x7f213c0d02f0 2023-10-06T02:18:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f214302c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213c157390 con 0x7f212c004010 2023-10-06T02:18:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f21415c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213c1569e0 0x7f213c156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f21415c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213c1569e0 0x7f213c156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51262/0 (socket says 172.21.15.6:51262) 2023-10-06T02:18:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f21415c9700 1 -- 172.21.15.6:0/3200419230 learned_addr learned my addr 172.21.15.6:0/3200419230 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f2140dc8700 1 --2- 172.21.15.6:0/3200419230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f212c004010 0x7f213c0b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f213bfff700 1 --2- 172.21.15.6:0/3200419230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f213c0d02f0 0x7f213c0d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f21415c9700 1 -- 172.21.15.6:0/3200419230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f212c004010 msgr2=0x7f213c0b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f21415c9700 1 --2- 172.21.15.6:0/3200419230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f212c004010 0x7f213c0b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f21415c9700 1 -- 172.21.15.6:0/3200419230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f213c0d02f0 msgr2=0x7f213c0d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f21415c9700 1 --2- 172.21.15.6:0/3200419230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f213c0d02f0 0x7f213c0d0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f21415c9700 1 -- 172.21.15.6:0/3200419230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213c0c4420 con 0x7f213c1569e0 2023-10-06T02:18:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f2140dc8700 1 --2- 172.21.15.6:0/3200419230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f212c004010 0x7f213c0b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f21415c9700 1 --2- 172.21.15.6:0/3200419230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213c1569e0 0x7f213c156e50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f213c0ca820 tx=0x7f213400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f2138ff9700 1 -- 172.21.15.6:0/3200419230 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213400e040 con 0x7f213c1569e0 2023-10-06T02:18:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f2138ff9700 1 -- 172.21.15.6:0/3200419230 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213400f040 con 0x7f213c1569e0 2023-10-06T02:18:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f214302c700 1 -- 172.21.15.6:0/3200419230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213c0c4700 con 0x7f213c1569e0 2023-10-06T02:18:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f2138ff9700 1 -- 172.21.15.6:0/3200419230 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213400fe20 con 0x7f213c1569e0 2023-10-06T02:18:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.828+0000 7f214302c700 1 -- 172.21.15.6:0/3200419230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213c0c4cc0 con 0x7f213c1569e0 2023-10-06T02:18:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.829+0000 7f214302c700 1 -- 172.21.15.6:0/3200419230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213c088aa0 con 0x7f213c1569e0 2023-10-06T02:18:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.830+0000 7f2138ff9700 1 -- 172.21.15.6:0/3200419230 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2134015640 con 0x7f213c1569e0 2023-10-06T02:18:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.830+0000 7f2138ff9700 1 --2- 172.21.15.6:0/3200419230 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2120066f30 0x7f21200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.830+0000 7f2138ff9700 1 -- 172.21.15.6:0/3200419230 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2134085170 con 0x7f213c1569e0 2023-10-06T02:18:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.830+0000 7f2140dc8700 1 --2- 172.21.15.6:0/3200419230 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2120066f30 0x7f21200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.831+0000 7f2140dc8700 1 --2- 172.21.15.6:0/3200419230 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2120066f30 0x7f21200693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f21300015a0 tx=0x7f2130009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:28.834+0000 7f2138ff9700 1 -- 172.21.15.6:0/3200419230 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2134051f90 con 0x7f213c1569e0 2023-10-06T02:18:29.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.076+0000 7f214302c700 1 -- 172.21.15.6:0/3200419230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f213c0cad90 con 0x7f213c1569e0 2023-10-06T02:18:29.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.077+0000 7f2138ff9700 1 -- 172.21.15.6:0/3200419230 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4590 (secure 0 0 0) 0x7f21340555b0 con 0x7f213c1569e0 2023-10-06T02:18:29.077 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:29.077 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3433510267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3433510267},{"type":"v1","addr":"172.21.15.175:6836","nonce":3433510267}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3290404467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3290404467},{"type":"v1","addr":"172.21.15.175:6837","nonce":3290404467}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/4132952009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4132952009},{"type":"v1","addr":"172.21.15.6:6834","nonce":4132952009}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:17:43.404580+0000","modified":"2023-10-06T02:17:56.734938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/839986504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":839986504},{"type":"v1","addr":"172.21.15.6:6835","nonce":839986504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:18:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.079+0000 7f214302c700 1 -- 172.21.15.6:0/3200419230 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2120066f30 msgr2=0x7f21200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.079+0000 7f214302c700 1 --2- 172.21.15.6:0/3200419230 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2120066f30 0x7f21200693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f21300015a0 tx=0x7f2130009040 comp rx=0 tx=0).stop 2023-10-06T02:18:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.079+0000 7f214302c700 1 -- 172.21.15.6:0/3200419230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213c1569e0 msgr2=0x7f213c156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.079+0000 7f214302c700 1 --2- 172.21.15.6:0/3200419230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213c1569e0 0x7f213c156e50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f213c0ca820 tx=0x7f213400b040 comp rx=0 tx=0).stop 2023-10-06T02:18:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.079+0000 7f214302c700 1 -- 172.21.15.6:0/3200419230 shutdown_connections 2023-10-06T02:18:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.079+0000 7f214302c700 1 --2- 172.21.15.6:0/3200419230 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2120066f30 0x7f21200693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.079+0000 7f214302c700 1 --2- 172.21.15.6:0/3200419230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213c1569e0 0x7f213c156e50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.079+0000 7f214302c700 1 --2- 172.21.15.6:0/3200419230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f212c004010 0x7f213c0b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.079+0000 7f214302c700 1 --2- 172.21.15.6:0/3200419230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f213c0d02f0 0x7f213c0d0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.079+0000 7f214302c700 1 -- 172.21.15.6:0/3200419230 >> 172.21.15.6:0/3200419230 conn(0x7f213c068680 msgr2=0x7f213c0b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.079+0000 7f214302c700 1 -- 172.21.15.6:0/3200419230 shutdown_connections 2023-10-06T02:18:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.079+0000 7f214302c700 1 -- 172.21.15.6:0/3200419230 wait complete. 2023-10-06T02:18:29.082 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-10-06T02:18:29.091 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:18:29.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.209+0000 7f45ca5f6700 1 Processor -- start 2023-10-06T02:18:29.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.209+0000 7f45ca5f6700 1 -- start start 2023-10-06T02:18:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.210+0000 7f45ca5f6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45c40af4e0 0x7f45c40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.210+0000 7f45ca5f6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f45c40af8b0 0x7f45c40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.210+0000 7f45ca5f6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c415e190 con 0x7f45c415d460 2023-10-06T02:18:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.210+0000 7f45ca5f6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c40b1910 con 0x7f45c40af4e0 2023-10-06T02:18:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.210+0000 7f45ca5f6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c415dfa0 con 0x7f45c40af8b0 2023-10-06T02:18:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.210+0000 7f45c3fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45c40af4e0 0x7f45c40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.210+0000 7f45c8b93700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f45c415d460 0x7f45c415d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50372/0 (socket says 172.21.15.6:50372) 2023-10-06T02:18:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.210+0000 7f45c8b93700 1 -- 172.21.15.6:0/747853297 learned_addr learned my addr 172.21.15.6:0/747853297 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:29.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.211+0000 7f45c37fe700 1 --2- 172.21.15.6:0/747853297 >> v2:172.21.15.175:3300/0 conn(0x7f45c40af8b0 0x7f45c40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.211+0000 7f45c3fff700 1 -- 172.21.15.6:0/747853297 >> v2:172.21.15.175:3300/0 conn(0x7f45c40af8b0 msgr2=0x7f45c40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:29.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.211+0000 7f45c3fff700 1 --2- 172.21.15.6:0/747853297 >> v2:172.21.15.175:3300/0 conn(0x7f45c40af8b0 0x7f45c40b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.211+0000 7f45c3fff700 1 -- 172.21.15.6:0/747853297 >> v1:172.21.15.6:6789/0 conn(0x7f45c415d460 legacy=0x7f45c415d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.211+0000 7f45c3fff700 1 -- 172.21.15.6:0/747853297 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c40cb650 con 0x7f45c40af4e0 2023-10-06T02:18:29.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.211+0000 7f45c2ffd700 1 -- 172.21.15.6:0/747853297 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50748454 0 0) 0x7f45c415e190 con 0x7f45c415d460 2023-10-06T02:18:29.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.211+0000 7f45c3fff700 1 --2- 172.21.15.6:0/747853297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c40af4e0 0x7f45c40b20e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f45c40cdd50 tx=0x7f45b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba62b9cc65ab2de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.211+0000 7f45c2ffd700 1 -- 172.21.15.6:0/747853297 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400b6b0 con 0x7f45c40af4e0 2023-10-06T02:18:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.211+0000 7f45c2ffd700 1 -- 172.21.15.6:0/747853297 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b400b810 con 0x7f45c40af4e0 2023-10-06T02:18:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.211+0000 7f45c2ffd700 1 -- 172.21.15.6:0/747853297 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400bbb0 con 0x7f45c40af4e0 2023-10-06T02:18:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.212+0000 7f45ca5f6700 1 -- 172.21.15.6:0/747853297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c40af4e0 msgr2=0x7f45c40b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.212+0000 7f45ca5f6700 1 --2- 172.21.15.6:0/747853297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c40af4e0 0x7f45c40b20e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f45c40cdd50 tx=0x7f45b40091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.212+0000 7f45ca5f6700 1 -- 172.21.15.6:0/747853297 shutdown_connections 2023-10-06T02:18:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.212+0000 7f45ca5f6700 1 --2- 172.21.15.6:0/747853297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c40af4e0 0x7f45c40b20e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.212+0000 7f45ca5f6700 1 --2- 172.21.15.6:0/747853297 >> v2:172.21.15.175:3300/0 conn(0x7f45c40af8b0 0x7f45c40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.212+0000 7f45ca5f6700 1 -- 172.21.15.6:0/747853297 >> 172.21.15.6:0/747853297 conn(0x7f45c4068680 msgr2=0x7f45c4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.212+0000 7f45ca5f6700 1 -- 172.21.15.6:0/747853297 shutdown_connections 2023-10-06T02:18:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.212+0000 7f45ca5f6700 1 -- 172.21.15.6:0/747853297 wait complete. 2023-10-06T02:18:29.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.213+0000 7f45ca5f6700 1 Processor -- start 2023-10-06T02:18:29.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.213+0000 7f45ca5f6700 1 -- start start 2023-10-06T02:18:29.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45ca5f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c40af4e0 0x7f45c40ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45ca5f6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c40af8b0 0x7f45c40a76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45ca5f6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c415d460 0x7f45c40c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45ca5f6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c415a530 con 0x7f45c40af4e0 2023-10-06T02:18:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45ca5f6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40c8010 con 0x7f45c40af8b0 2023-10-06T02:18:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45ca5f6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40aeba0 con 0x7f45c415d460 2023-10-06T02:18:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c40af4e0 0x7f45c40ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c40af4e0 0x7f45c40ae660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51272/0 (socket says 172.21.15.6:51272) 2023-10-06T02:18:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45c3fff700 1 -- 172.21.15.6:0/263376698 learned_addr learned my addr 172.21.15.6:0/263376698 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45c37fe700 1 --2- 172.21.15.6:0/263376698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c40af8b0 0x7f45c40a76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45c8b93700 1 --2- 172.21.15.6:0/263376698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c415d460 0x7f45c40c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45c3fff700 1 -- 172.21.15.6:0/263376698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c415d460 msgr2=0x7f45c40c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45c3fff700 1 --2- 172.21.15.6:0/263376698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c415d460 0x7f45c40c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45c3fff700 1 -- 172.21.15.6:0/263376698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c40af8b0 msgr2=0x7f45c40a76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45c3fff700 1 --2- 172.21.15.6:0/263376698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c40af8b0 0x7f45c40a76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45c3fff700 1 -- 172.21.15.6:0/263376698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4009420 con 0x7f45c40af4e0 2023-10-06T02:18:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45c8b93700 1 --2- 172.21.15.6:0/263376698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c415d460 0x7f45c40c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45c3fff700 1 --2- 172.21.15.6:0/263376698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c40af4e0 0x7f45c40ae660 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f45c4089520 tx=0x7f45b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45bbfff700 1 -- 172.21.15.6:0/263376698 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400bb90 con 0x7f45c40af4e0 2023-10-06T02:18:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45bbfff700 1 -- 172.21.15.6:0/263376698 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b4011420 con 0x7f45c40af4e0 2023-10-06T02:18:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45ca5f6700 1 -- 172.21.15.6:0/263376698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c40c7400 con 0x7f45c40af4e0 2023-10-06T02:18:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.214+0000 7f45bbfff700 1 -- 172.21.15.6:0/263376698 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b40117c0 con 0x7f45c40af4e0 2023-10-06T02:18:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.215+0000 7f45ca5f6700 1 -- 172.21.15.6:0/263376698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c40c79c0 con 0x7f45c40af4e0 2023-10-06T02:18:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.215+0000 7f45ca5f6700 1 -- 172.21.15.6:0/263376698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c40c82f0 con 0x7f45c40af4e0 2023-10-06T02:18:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.216+0000 7f45bbfff700 1 -- 172.21.15.6:0/263376698 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45b4011bf0 con 0x7f45c40af4e0 2023-10-06T02:18:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.216+0000 7f45bbfff700 1 --2- 172.21.15.6:0/263376698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f45a4066f30 0x7f45a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.216+0000 7f45bbfff700 1 -- 172.21.15.6:0/263376698 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f45b40862c0 con 0x7f45c40af4e0 2023-10-06T02:18:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.216+0000 7f45c37fe700 1 --2- 172.21.15.6:0/263376698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f45a4066f30 0x7f45a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.217+0000 7f45c37fe700 1 --2- 172.21.15.6:0/263376698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f45a4066f30 0x7f45a40693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f45c40d0e20 tx=0x7f45ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:29.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.220+0000 7f45bbfff700 1 -- 172.21.15.6:0/263376698 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45b40530e0 con 0x7f45c40af4e0 2023-10-06T02:18:29.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.418+0000 7f45ca5f6700 1 -- 172.21.15.6:0/263376698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45c40b0910 con 0x7f45c40af4e0 2023-10-06T02:18:29.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.418+0000 7f45bbfff700 1 -- 172.21.15.6:0/263376698 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f45b4056700 con 0x7f45c40af4e0 2023-10-06T02:18:29.421 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:29.422 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:17:48.453046+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:18:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.421+0000 7f45ca5f6700 1 -- 172.21.15.6:0/263376698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f45a4066f30 msgr2=0x7f45a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.421+0000 7f45ca5f6700 1 --2- 172.21.15.6:0/263376698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f45a4066f30 0x7f45a40693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f45c40d0e20 tx=0x7f45ac008040 comp rx=0 tx=0).stop 2023-10-06T02:18:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.421+0000 7f45ca5f6700 1 -- 172.21.15.6:0/263376698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c40af4e0 msgr2=0x7f45c40ae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.421+0000 7f45ca5f6700 1 --2- 172.21.15.6:0/263376698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c40af4e0 0x7f45c40ae660 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f45c4089520 tx=0x7f45b4017000 comp rx=0 tx=0).stop 2023-10-06T02:18:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.421+0000 7f45ca5f6700 1 -- 172.21.15.6:0/263376698 shutdown_connections 2023-10-06T02:18:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.421+0000 7f45ca5f6700 1 --2- 172.21.15.6:0/263376698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c415d460 0x7f45c40c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.421+0000 7f45ca5f6700 1 --2- 172.21.15.6:0/263376698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f45a4066f30 0x7f45a40693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.421+0000 7f45ca5f6700 1 --2- 172.21.15.6:0/263376698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c40af4e0 0x7f45c40ae660 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.421+0000 7f45ca5f6700 1 --2- 172.21.15.6:0/263376698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c40af8b0 0x7f45c40a76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.421+0000 7f45ca5f6700 1 -- 172.21.15.6:0/263376698 >> 172.21.15.6:0/263376698 conn(0x7f45c4068680 msgr2=0x7f45c40b50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.421+0000 7f45ca5f6700 1 -- 172.21.15.6:0/263376698 shutdown_connections 2023-10-06T02:18:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.421+0000 7f45ca5f6700 1 -- 172.21.15.6:0/263376698 wait complete. 2023-10-06T02:18:29.433 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:17:41.126402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:17:42.378468+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T02:17:46.053654+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:18:29.434 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:18:29.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.556+0000 7f2da12a2700 1 Processor -- start 2023-10-06T02:18:29.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.556+0000 7f2da12a2700 1 -- start start 2023-10-06T02:18:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2da12a2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2d9c0cf7d0 0x7f2d9c0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2da12a2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d9c06a490 0x7f2d9c0cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2da12a2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9c0cbb80 con 0x7f2d9c0cb6e0 2023-10-06T02:18:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2da12a2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9c159c10 con 0x7f2d9c0cf7d0 2023-10-06T02:18:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2da12a2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c15abd0 con 0x7f2d9c06a490 2023-10-06T02:18:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2d9a7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2d9c0cb6e0 0x7f2d9c069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50384/0 (socket says 172.21.15.6:50384) 2023-10-06T02:18:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2d9a7fc700 1 -- 172.21.15.6:0/188424377 learned_addr learned my addr 172.21.15.6:0/188424377 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2d9affd700 1 --2- 172.21.15.6:0/188424377 >> v2:172.21.15.175:3300/0 conn(0x7f2d9c0cf7d0 0x7f2d9c0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2d9b7fe700 1 --2- 172.21.15.6:0/188424377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d9c06a490 0x7f2d9c0cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2d99ffb700 1 -- 172.21.15.6:0/188424377 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485626571 0 0) 0x7f2d9c0cbb80 con 0x7f2d9c0cb6e0 2023-10-06T02:18:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2d99ffb700 1 -- 172.21.15.6:0/188424377 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d88003570 con 0x7f2d9c0cb6e0 2023-10-06T02:18:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2d99ffb700 1 -- 172.21.15.6:0/188424377 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2979721821 0 0) 0x7f2d88003570 con 0x7f2d9c0cb6e0 2023-10-06T02:18:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2d99ffb700 1 -- 172.21.15.6:0/188424377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d9c06a490 msgr2=0x7f2d9c0cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2d99ffb700 1 --2- 172.21.15.6:0/188424377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d9c06a490 0x7f2d9c0cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2d99ffb700 1 -- 172.21.15.6:0/188424377 >> v2:172.21.15.175:3300/0 conn(0x7f2d9c0cf7d0 msgr2=0x7f2d9c0cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2d99ffb700 1 --2- 172.21.15.6:0/188424377 >> v2:172.21.15.175:3300/0 conn(0x7f2d9c0cf7d0 0x7f2d9c0cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2d99ffb700 1 -- 172.21.15.6:0/188424377 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c15a740 con 0x7f2d9c0cb6e0 2023-10-06T02:18:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.557+0000 7f2d99ffb700 1 -- 172.21.15.6:0/188424377 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f2d84001470 con 0x7f2d9c0cb6e0 2023-10-06T02:18:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d99ffb700 1 -- 172.21.15.6:0/188424377 >> v1:172.21.15.6:6789/0 conn(0x7f2d9c0cb6e0 legacy=0x7f2d9c069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d99ffb700 1 --2- 172.21.15.6:0/188424377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d9c06a490 0x7f2d88003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d99ffb700 1 --2- 172.21.15.6:0/188424377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d88004010 0x7f2d88004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d99ffb700 1 --2- 172.21.15.6:0/188424377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d88004d50 0x7f2d880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d99ffb700 1 -- 172.21.15.6:0/188424377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c159c10 con 0x7f2d88004d50 2023-10-06T02:18:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d99ffb700 1 -- 172.21.15.6:0/188424377 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c15abd0 con 0x7f2d88004010 2023-10-06T02:18:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d99ffb700 1 -- 172.21.15.6:0/188424377 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8800bab0 con 0x7f2d9c06a490 2023-10-06T02:18:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d9b7fe700 1 --2- 172.21.15.6:0/188424377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d88004d50 0x7f2d880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d9affd700 1 --2- 172.21.15.6:0/188424377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d9c06a490 0x7f2d88003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d9a7fc700 1 --2- 172.21.15.6:0/188424377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d88004010 0x7f2d88004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d9b7fe700 1 -- 172.21.15.6:0/188424377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d9c06a490 msgr2=0x7f2d88003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d9b7fe700 1 --2- 172.21.15.6:0/188424377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d9c06a490 0x7f2d88003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d9b7fe700 1 -- 172.21.15.6:0/188424377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d88004010 msgr2=0x7f2d88004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d9b7fe700 1 --2- 172.21.15.6:0/188424377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d88004010 0x7f2d88004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d9b7fe700 1 -- 172.21.15.6:0/188424377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d88003570 con 0x7f2d88004d50 2023-10-06T02:18:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d9b7fe700 1 --2- 172.21.15.6:0/188424377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d88004d50 0x7f2d880051c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c06a890 tx=0x7f2d8c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea6a14d40b5ba68 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d99ffb700 1 -- 172.21.15.6:0/188424377 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c00ea90 con 0x7f2d88004d50 2023-10-06T02:18:29.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d99ffb700 1 -- 172.21.15.6:0/188424377 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c00f040 con 0x7f2d88004d50 2023-10-06T02:18:29.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.558+0000 7f2d99ffb700 1 -- 172.21.15.6:0/188424377 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c00ee40 con 0x7f2d88004d50 2023-10-06T02:18:29.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.559+0000 7f2da12a2700 1 -- 172.21.15.6:0/188424377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d88004d50 msgr2=0x7f2d880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.559+0000 7f2da12a2700 1 --2- 172.21.15.6:0/188424377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d88004d50 0x7f2d880051c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c06a890 tx=0x7f2d8c00b040 comp rx=0 tx=0).stop 2023-10-06T02:18:29.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.559+0000 7f2d9b7fe700 1 -- 172.21.15.6:0/188424377 reap_dead start 2023-10-06T02:18:29.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.559+0000 7f2da12a2700 1 -- 172.21.15.6:0/188424377 shutdown_connections 2023-10-06T02:18:29.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.559+0000 7f2da12a2700 1 -- 172.21.15.6:0/188424377 >> 172.21.15.6:0/188424377 conn(0x7f2d9c0d0c60 msgr2=0x7f2d9c0ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:29.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.559+0000 7f2da12a2700 1 -- 172.21.15.6:0/188424377 shutdown_connections 2023-10-06T02:18:29.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.559+0000 7f2da12a2700 1 -- 172.21.15.6:0/188424377 wait complete. 2023-10-06T02:18:29.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.560+0000 7f2da12a2700 1 Processor -- start 2023-10-06T02:18:29.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.560+0000 7f2da12a2700 1 -- start start 2023-10-06T02:18:29.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.561+0000 7f2da12a2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d9c16a0b0 0x7f2d9c15d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.561+0000 7f2da12a2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d9c16a480 0x7f2d9c16a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.561+0000 7f2da12a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d9c15b7b0 0x7f2d9c15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.561+0000 7f2da12a2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c15b150 con 0x7f2d9c15b7b0 2023-10-06T02:18:29.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.561+0000 7f2da12a2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c15c160 con 0x7f2d9c16a480 2023-10-06T02:18:29.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.561+0000 7f2da12a2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c15ddf0 con 0x7f2d9c16a0b0 2023-10-06T02:18:29.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.561+0000 7f2d9b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d9c15b7b0 0x7f2d9c15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.561+0000 7f2d9b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d9c15b7b0 0x7f2d9c15bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51286/0 (socket says 172.21.15.6:51286) 2023-10-06T02:18:29.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.561+0000 7f2d9b7fe700 1 -- 172.21.15.6:0/2870923840 learned_addr learned my addr 172.21.15.6:0/2870923840 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:29.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.561+0000 7f2d9a7fc700 1 --2- 172.21.15.6:0/2870923840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d9c16a480 0x7f2d9c16a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.561+0000 7f2d9affd700 1 --2- 172.21.15.6:0/2870923840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d9c16a0b0 0x7f2d9c15d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.561+0000 7f2d9b7fe700 1 -- 172.21.15.6:0/2870923840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d9c16a0b0 msgr2=0x7f2d9c15d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.561+0000 7f2d9b7fe700 1 --2- 172.21.15.6:0/2870923840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d9c16a0b0 0x7f2d9c15d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.561+0000 7f2d9b7fe700 1 -- 172.21.15.6:0/2870923840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d9c16a480 msgr2=0x7f2d9c16a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.561+0000 7f2d9b7fe700 1 --2- 172.21.15.6:0/2870923840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d9c16a480 0x7f2d9c16a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.561+0000 7f2d9b7fe700 1 -- 172.21.15.6:0/2870923840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c0b4100 con 0x7f2d9c15b7b0 2023-10-06T02:18:29.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.562+0000 7f2d9b7fe700 1 --2- 172.21.15.6:0/2870923840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d9c15b7b0 0x7f2d9c15bc20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c016000 tx=0x7f2d8c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:29.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.562+0000 7f2d92ffd700 1 -- 172.21.15.6:0/2870923840 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c014e10 con 0x7f2d9c15b7b0 2023-10-06T02:18:29.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.562+0000 7f2d92ffd700 1 -- 172.21.15.6:0/2870923840 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c01d630 con 0x7f2d9c15b7b0 2023-10-06T02:18:29.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.562+0000 7f2d92ffd700 1 -- 172.21.15.6:0/2870923840 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c01d9f0 con 0x7f2d9c15b7b0 2023-10-06T02:18:29.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.562+0000 7f2da12a2700 1 -- 172.21.15.6:0/2870923840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9c0b43e0 con 0x7f2d9c15b7b0 2023-10-06T02:18:29.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.562+0000 7f2da12a2700 1 -- 172.21.15.6:0/2870923840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9c0b4a30 con 0x7f2d9c15b7b0 2023-10-06T02:18:29.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.563+0000 7f2da12a2700 1 -- 172.21.15.6:0/2870923840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9c064f20 con 0x7f2d9c15b7b0 2023-10-06T02:18:29.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.563+0000 7f2d92ffd700 1 -- 172.21.15.6:0/2870923840 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d8c003040 con 0x7f2d9c15b7b0 2023-10-06T02:18:29.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.563+0000 7f2d92ffd700 1 --2- 172.21.15.6:0/2870923840 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2d7c066f30 0x7f2d7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.564+0000 7f2d92ffd700 1 -- 172.21.15.6:0/2870923840 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2d8c085e20 con 0x7f2d9c15b7b0 2023-10-06T02:18:29.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.564+0000 7f2d9affd700 1 --2- 172.21.15.6:0/2870923840 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2d7c066f30 0x7f2d7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.564+0000 7f2d9affd700 1 --2- 172.21.15.6:0/2870923840 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2d7c066f30 0x7f2d7c0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2d94006f00 tx=0x7f2d940091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:29.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.568+0000 7f2d92ffd700 1 -- 172.21.15.6:0/2870923840 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d8c052c40 con 0x7f2d9c15b7b0 2023-10-06T02:18:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.760+0000 7f2da12a2700 1 -- 172.21.15.6:0/2870923840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2d9c0b4c20 con 0x7f2d9c15b7b0 2023-10-06T02:18:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.760+0000 7f2d92ffd700 1 -- 172.21.15.6:0/2870923840 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2d8c018020 con 0x7f2d9c15b7b0 2023-10-06T02:18:29.761 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:18:29.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.763+0000 7f2da12a2700 1 -- 172.21.15.6:0/2870923840 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2d7c066f30 msgr2=0x7f2d7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.763+0000 7f2da12a2700 1 --2- 172.21.15.6:0/2870923840 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2d7c066f30 0x7f2d7c0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2d94006f00 tx=0x7f2d940091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.763+0000 7f2da12a2700 1 -- 172.21.15.6:0/2870923840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d9c15b7b0 msgr2=0x7f2d9c15bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.763+0000 7f2da12a2700 1 --2- 172.21.15.6:0/2870923840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d9c15b7b0 0x7f2d9c15bc20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c016000 tx=0x7f2d8c01a000 comp rx=0 tx=0).stop 2023-10-06T02:18:29.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.763+0000 7f2da12a2700 1 -- 172.21.15.6:0/2870923840 shutdown_connections 2023-10-06T02:18:29.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.763+0000 7f2da12a2700 1 --2- 172.21.15.6:0/2870923840 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2d7c066f30 0x7f2d7c0693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.763+0000 7f2da12a2700 1 --2- 172.21.15.6:0/2870923840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d9c15b7b0 0x7f2d9c15bc20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.763+0000 7f2da12a2700 1 --2- 172.21.15.6:0/2870923840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d9c16a0b0 0x7f2d9c15d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.763+0000 7f2da12a2700 1 --2- 172.21.15.6:0/2870923840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d9c16a480 0x7f2d9c16a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.763+0000 7f2da12a2700 1 -- 172.21.15.6:0/2870923840 >> 172.21.15.6:0/2870923840 conn(0x7f2d9c0d0c60 msgr2=0x7f2d9c158b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:29.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.763+0000 7f2da12a2700 1 -- 172.21.15.6:0/2870923840 shutdown_connections 2023-10-06T02:18:29.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.763+0000 7f2da12a2700 1 -- 172.21.15.6:0/2870923840 wait complete. 2023-10-06T02:18:29.775 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:18:29.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.897+0000 7f7c154df700 1 Processor -- start 2023-10-06T02:18:29.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.897+0000 7f7c154df700 1 -- start start 2023-10-06T02:18:29.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.898+0000 7f7c154df700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c100cf7d0 0x7f7c100cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.898+0000 7f7c154df700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c100cbb80 con 0x7f7c1006a490 2023-10-06T02:18:29.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.898+0000 7f7c154df700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1015a740 con 0x7f7c100cb6e0 2023-10-06T02:18:29.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.898+0000 7f7c154df700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c10159c10 con 0x7f7c100cf7d0 2023-10-06T02:18:29.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.898+0000 7f7c0effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c100cf7d0 0x7f7c100cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.898+0000 7f7c0f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7c1006a490 0x7f7c100cdd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50392/0 (socket says 172.21.15.6:50392) 2023-10-06T02:18:29.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.898+0000 7f7c0f7fe700 1 -- 172.21.15.6:0/3269767274 learned_addr learned my addr 172.21.15.6:0/3269767274 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:29.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.898+0000 7f7c0effd700 1 -- 172.21.15.6:0/3269767274 >> v1:172.21.15.175:6789/0 conn(0x7f7c100cb6e0 legacy=0x7f7c10069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.898+0000 7f7c0effd700 1 -- 172.21.15.6:0/3269767274 >> v1:172.21.15.6:6789/0 conn(0x7f7c1006a490 legacy=0x7f7c100cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.898+0000 7f7c0effd700 1 -- 172.21.15.6:0/3269767274 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c10159e10 con 0x7f7c100cf7d0 2023-10-06T02:18:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.899+0000 7f7c0effd700 1 --2- 172.21.15.6:0/3269767274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c100cf7d0 0x7f7c100cb1a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7c080098e0 tx=0x7f7c080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53689698214cac17 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.899+0000 7f7c0dffb700 1 -- 172.21.15.6:0/3269767274 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08009e80 con 0x7f7c100cf7d0 2023-10-06T02:18:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.899+0000 7f7c0dffb700 1 -- 172.21.15.6:0/3269767274 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800b860 con 0x7f7c100cf7d0 2023-10-06T02:18:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.899+0000 7f7c0dffb700 1 -- 172.21.15.6:0/3269767274 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800bbe0 con 0x7f7c100cf7d0 2023-10-06T02:18:29.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.899+0000 7f7c154df700 1 -- 172.21.15.6:0/3269767274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c100cf7d0 msgr2=0x7f7c100cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.899+0000 7f7c154df700 1 --2- 172.21.15.6:0/3269767274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c100cf7d0 0x7f7c100cb1a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7c080098e0 tx=0x7f7c080091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.899+0000 7f7c154df700 1 -- 172.21.15.6:0/3269767274 shutdown_connections 2023-10-06T02:18:29.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.899+0000 7f7c154df700 1 --2- 172.21.15.6:0/3269767274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c100cf7d0 0x7f7c100cb1a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.899+0000 7f7c154df700 1 -- 172.21.15.6:0/3269767274 >> 172.21.15.6:0/3269767274 conn(0x7f7c100d0c60 msgr2=0x7f7c100ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:29.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.899+0000 7f7c154df700 1 -- 172.21.15.6:0/3269767274 shutdown_connections 2023-10-06T02:18:29.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.899+0000 7f7c154df700 1 -- 172.21.15.6:0/3269767274 wait complete. 2023-10-06T02:18:29.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.901+0000 7f7c154df700 1 Processor -- start 2023-10-06T02:18:29.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.901+0000 7f7c154df700 1 -- start start 2023-10-06T02:18:29.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.901+0000 7f7c154df700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c1006a490 0x7f7c1015ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.901+0000 7f7c154df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c100cb6e0 0x7f7c1014bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.901+0000 7f7c154df700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c100cf7d0 0x7f7c1016a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.901+0000 7f7c154df700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100c7240 con 0x7f7c100cb6e0 2023-10-06T02:18:29.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.901+0000 7f7c154df700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100c8060 con 0x7f7c100cf7d0 2023-10-06T02:18:29.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.901+0000 7f7c154df700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100c7450 con 0x7f7c1006a490 2023-10-06T02:18:29.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.902+0000 7f7c0e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c100cb6e0 0x7f7c1014bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.902+0000 7f7c0e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c100cb6e0 0x7f7c1014bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51298/0 (socket says 172.21.15.6:51298) 2023-10-06T02:18:29.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.902+0000 7f7c0e7fc700 1 -- 172.21.15.6:0/658696649 learned_addr learned my addr 172.21.15.6:0/658696649 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:29.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.902+0000 7f7c0f7fe700 1 --2- 172.21.15.6:0/658696649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c100cf7d0 0x7f7c1016a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.902+0000 7f7c0effd700 1 --2- 172.21.15.6:0/658696649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c1006a490 0x7f7c1015ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.902+0000 7f7c0e7fc700 1 -- 172.21.15.6:0/658696649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c1006a490 msgr2=0x7f7c1015ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.902+0000 7f7c0e7fc700 1 --2- 172.21.15.6:0/658696649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c1006a490 0x7f7c1015ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.902+0000 7f7c0e7fc700 1 -- 172.21.15.6:0/658696649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c100cf7d0 msgr2=0x7f7c1016a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:29.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.902+0000 7f7c0e7fc700 1 --2- 172.21.15.6:0/658696649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c100cf7d0 0x7f7c1016a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:29.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.902+0000 7f7c0e7fc700 1 -- 172.21.15.6:0/658696649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c08009420 con 0x7f7c100cb6e0 2023-10-06T02:18:29.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.902+0000 7f7c0e7fc700 1 --2- 172.21.15.6:0/658696649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c100cb6e0 0x7f7c1014bd50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800c7c0 tx=0x7f7bf8007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:29.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.902+0000 7f7c06ffd700 1 -- 172.21.15.6:0/658696649 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8011590 con 0x7f7c100cb6e0 2023-10-06T02:18:29.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.902+0000 7f7c06ffd700 1 -- 172.21.15.6:0/658696649 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf80116f0 con 0x7f7c100cb6e0 2023-10-06T02:18:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.902+0000 7f7c154df700 1 -- 172.21.15.6:0/658696649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c100c7730 con 0x7f7c100cb6e0 2023-10-06T02:18:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.902+0000 7f7c06ffd700 1 -- 172.21.15.6:0/658696649 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8011ab0 con 0x7f7c100cb6e0 2023-10-06T02:18:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.902+0000 7f7c154df700 1 -- 172.21.15.6:0/658696649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c100c7cf0 con 0x7f7c100cb6e0 2023-10-06T02:18:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.903+0000 7f7c154df700 1 -- 172.21.15.6:0/658696649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c10064f20 con 0x7f7c100cb6e0 2023-10-06T02:18:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.904+0000 7f7c06ffd700 1 -- 172.21.15.6:0/658696649 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bf801b3b0 con 0x7f7c100cb6e0 2023-10-06T02:18:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.904+0000 7f7c06ffd700 1 --2- 172.21.15.6:0/658696649 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f60 0x7f7bf0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.904+0000 7f7c06ffd700 1 -- 172.21.15.6:0/658696649 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7bf8083db0 con 0x7f7c100cb6e0 2023-10-06T02:18:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.904+0000 7f7c0effd700 1 --2- 172.21.15.6:0/658696649 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f60 0x7f7bf0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:29.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.905+0000 7f7c0effd700 1 --2- 172.21.15.6:0/658696649 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f60 0x7f7bf0069410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7c080091e0 tx=0x7f7c08017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:29.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:29.908+0000 7f7c06ffd700 1 -- 172.21.15.6:0/658696649 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bf8050bd0 con 0x7f7c100cb6e0 2023-10-06T02:18:30.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.103+0000 7f7c154df700 1 -- 172.21.15.6:0/658696649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c10064aa0 con 0x7f7c100cb6e0 2023-10-06T02:18:30.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.103+0000 7f7c06ffd700 1 -- 172.21.15.6:0/658696649 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7bf8017070 con 0x7f7c100cb6e0 2023-10-06T02:18:30.103 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:18:30.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.105+0000 7f7c154df700 1 -- 172.21.15.6:0/658696649 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f60 msgr2=0x7f7bf0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.105+0000 7f7c154df700 1 --2- 172.21.15.6:0/658696649 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f60 0x7f7bf0069410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7c080091e0 tx=0x7f7c08017000 comp rx=0 tx=0).stop 2023-10-06T02:18:30.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.105+0000 7f7c154df700 1 -- 172.21.15.6:0/658696649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c100cb6e0 msgr2=0x7f7c1014bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.105+0000 7f7c154df700 1 --2- 172.21.15.6:0/658696649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c100cb6e0 0x7f7c1014bd50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800c7c0 tx=0x7f7bf8007f50 comp rx=0 tx=0).stop 2023-10-06T02:18:30.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.105+0000 7f7c154df700 1 -- 172.21.15.6:0/658696649 shutdown_connections 2023-10-06T02:18:30.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.105+0000 7f7c154df700 1 --2- 172.21.15.6:0/658696649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c100cf7d0 0x7f7c1016a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.105+0000 7f7c154df700 1 --2- 172.21.15.6:0/658696649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c1006a490 0x7f7c1015ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.105+0000 7f7c154df700 1 --2- 172.21.15.6:0/658696649 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f60 0x7f7bf0069410 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.105+0000 7f7c154df700 1 --2- 172.21.15.6:0/658696649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c100cb6e0 0x7f7c1014bd50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.105+0000 7f7c154df700 1 -- 172.21.15.6:0/658696649 >> 172.21.15.6:0/658696649 conn(0x7f7c100d0c60 msgr2=0x7f7c100cd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:30.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.105+0000 7f7c154df700 1 -- 172.21.15.6:0/658696649 shutdown_connections 2023-10-06T02:18:30.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.105+0000 7f7c154df700 1 -- 172.21.15.6:0/658696649 wait complete. 2023-10-06T02:18:30.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:18:30.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.238+0000 7fd429133700 1 Processor -- start 2023-10-06T02:18:30.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.238+0000 7fd429133700 1 -- start start 2023-10-06T02:18:30.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.239+0000 7fd429133700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd4241574b0 0x7fd4240b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:30.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.239+0000 7fd429133700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4240b13f0 0x7fd4240c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:30.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.239+0000 7fd429133700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4240c3b40 con 0x7fd4240c4510 2023-10-06T02:18:30.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.239+0000 7fd429133700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4240c4990 con 0x7fd4241574b0 2023-10-06T02:18:30.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.239+0000 7fd429133700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4240c2f30 con 0x7fd4240b13f0 2023-10-06T02:18:30.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.239+0000 7fd42259c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4240b13f0 0x7fd4240c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:30.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.239+0000 7fd422d9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd4241574b0 0x7fd4240b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:30.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.239+0000 7fd422d9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd4241574b0 0x7fd4240b0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:47888/0 (socket says 172.21.15.6:47888) 2023-10-06T02:18:30.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.239+0000 7fd422d9d700 1 -- 172.21.15.6:0/3085832982 learned_addr learned my addr 172.21.15.6:0/3085832982 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:30.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.239+0000 7fd42259c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4240b13f0 0x7fd4240c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:39722/0 (socket says 172.21.15.6:39722) 2023-10-06T02:18:30.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.239+0000 7fd42359e700 1 --1- 172.21.15.6:0/3085832982 >> v1:172.21.15.175:6789/0 conn(0x7fd4240c4510 0x7fd4240cbcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:55704/0 (socket says 172.21.15.6:55704) 2023-10-06T02:18:30.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.240+0000 7fd422d9d700 1 -- 172.21.15.6:0/3085832982 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4240b13f0 msgr2=0x7fd4240c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:30.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.240+0000 7fd422d9d700 1 --2- 172.21.15.6:0/3085832982 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4240b13f0 0x7fd4240c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.240+0000 7fd422d9d700 1 -- 172.21.15.6:0/3085832982 >> v1:172.21.15.175:6789/0 conn(0x7fd4240c4510 legacy=0x7fd4240cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.240+0000 7fd422d9d700 1 -- 172.21.15.6:0/3085832982 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4240c3210 con 0x7fd4241574b0 2023-10-06T02:18:30.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.240+0000 7fd422d9d700 1 --2- 172.21.15.6:0/3085832982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4241574b0 0x7fd4240b0eb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009990 tx=0x7fd41c009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21322b6ac4b8b1a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:30.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.240+0000 7fd421d9b700 1 -- 172.21.15.6:0/3085832982 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c009e80 con 0x7fd4241574b0 2023-10-06T02:18:30.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.240+0000 7fd421d9b700 1 -- 172.21.15.6:0/3085832982 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c005c10 con 0x7fd4241574b0 2023-10-06T02:18:30.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.240+0000 7fd421d9b700 1 -- 172.21.15.6:0/3085832982 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c00b650 con 0x7fd4241574b0 2023-10-06T02:18:30.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.241+0000 7fd429133700 1 -- 172.21.15.6:0/3085832982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4241574b0 msgr2=0x7fd4240b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.241+0000 7fd429133700 1 --2- 172.21.15.6:0/3085832982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4241574b0 0x7fd4240b0eb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009990 tx=0x7fd41c009220 comp rx=0 tx=0).stop 2023-10-06T02:18:30.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.241+0000 7fd429133700 1 -- 172.21.15.6:0/3085832982 shutdown_connections 2023-10-06T02:18:30.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.241+0000 7fd429133700 1 --2- 172.21.15.6:0/3085832982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4241574b0 0x7fd4240b0eb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.241+0000 7fd429133700 1 --2- 172.21.15.6:0/3085832982 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4240b13f0 0x7fd4240c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.241+0000 7fd429133700 1 -- 172.21.15.6:0/3085832982 >> 172.21.15.6:0/3085832982 conn(0x7fd424067910 msgr2=0x7fd4240ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:30.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.241+0000 7fd429133700 1 -- 172.21.15.6:0/3085832982 shutdown_connections 2023-10-06T02:18:30.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.241+0000 7fd429133700 1 -- 172.21.15.6:0/3085832982 wait complete. 2023-10-06T02:18:30.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.242+0000 7fd429133700 1 Processor -- start 2023-10-06T02:18:30.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.242+0000 7fd429133700 1 -- start start 2023-10-06T02:18:30.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.243+0000 7fd429133700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4240b13f0 0x7fd424069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:30.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.243+0000 7fd429133700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4240c4510 0x7fd424157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:30.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.243+0000 7fd429133700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4241574b0 0x7fd424144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:30.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.243+0000 7fd429133700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd424159120 con 0x7fd4240c4510 2023-10-06T02:18:30.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.243+0000 7fd429133700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd424169970 con 0x7fd4240b13f0 2023-10-06T02:18:30.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.243+0000 7fd429133700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42416a750 con 0x7fd4241574b0 2023-10-06T02:18:30.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.243+0000 7fd42259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4240c4510 0x7fd424157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:30.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.243+0000 7fd42259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4240c4510 0x7fd424157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51300/0 (socket says 172.21.15.6:51300) 2023-10-06T02:18:30.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.243+0000 7fd42259c700 1 -- 172.21.15.6:0/676313283 learned_addr learned my addr 172.21.15.6:0/676313283 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:30.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.243+0000 7fd42359e700 1 --2- 172.21.15.6:0/676313283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4241574b0 0x7fd424144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:30.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.243+0000 7fd422d9d700 1 --2- 172.21.15.6:0/676313283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4240b13f0 0x7fd424069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:30.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.243+0000 7fd42259c700 1 -- 172.21.15.6:0/676313283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4241574b0 msgr2=0x7fd424144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.243+0000 7fd42259c700 1 --2- 172.21.15.6:0/676313283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4241574b0 0x7fd424144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.243+0000 7fd42259c700 1 -- 172.21.15.6:0/676313283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4240b13f0 msgr2=0x7fd424069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.243+0000 7fd42259c700 1 --2- 172.21.15.6:0/676313283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4240b13f0 0x7fd424069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.243+0000 7fd42259c700 1 -- 172.21.15.6:0/676313283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c009480 con 0x7fd4240c4510 2023-10-06T02:18:30.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.243+0000 7fd42259c700 1 --2- 172.21.15.6:0/676313283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4240c4510 0x7fd424157880 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00ec80 tx=0x7fd40c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:30.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.244+0000 7fd41affd700 1 -- 172.21.15.6:0/676313283 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c00c850 con 0x7fd4240c4510 2023-10-06T02:18:30.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.244+0000 7fd41affd700 1 -- 172.21.15.6:0/676313283 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c00c9b0 con 0x7fd4240c4510 2023-10-06T02:18:30.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.244+0000 7fd41affd700 1 -- 172.21.15.6:0/676313283 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c00cd50 con 0x7fd4240c4510 2023-10-06T02:18:30.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.244+0000 7fd429133700 1 -- 172.21.15.6:0/676313283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd424157dc0 con 0x7fd4240c4510 2023-10-06T02:18:30.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.244+0000 7fd429133700 1 -- 172.21.15.6:0/676313283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd424169e20 con 0x7fd4240c4510 2023-10-06T02:18:30.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.244+0000 7fd429133700 1 -- 172.21.15.6:0/676313283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42406e590 con 0x7fd4240c4510 2023-10-06T02:18:30.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.245+0000 7fd41affd700 1 -- 172.21.15.6:0/676313283 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd40c013680 con 0x7fd4240c4510 2023-10-06T02:18:30.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.245+0000 7fd41affd700 1 --2- 172.21.15.6:0/676313283 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd404066f30 0x7fd4040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:30.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.246+0000 7fd41affd700 1 -- 172.21.15.6:0/676313283 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd40c084c50 con 0x7fd4240c4510 2023-10-06T02:18:30.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.246+0000 7fd422d9d700 1 --2- 172.21.15.6:0/676313283 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd404066f30 0x7fd4040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:30.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.246+0000 7fd422d9d700 1 --2- 172.21.15.6:0/676313283 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd404066f30 0x7fd4040693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd41c007fd0 tx=0x7fd41c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:30.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.250+0000 7fd41affd700 1 -- 172.21.15.6:0/676313283 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd40c0519d0 con 0x7fd4240c4510 2023-10-06T02:18:30.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.443+0000 7fd429133700 1 -- 172.21.15.6:0/676313283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4240c3520 con 0x7fd4240c4510 2023-10-06T02:18:30.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.444+0000 7fd41affd700 1 -- 172.21.15.6:0/676313283 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd40c054ff0 con 0x7fd4240c4510 2023-10-06T02:18:30.444 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:18:30.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.446+0000 7fd429133700 1 -- 172.21.15.6:0/676313283 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd404066f30 msgr2=0x7fd4040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.446+0000 7fd429133700 1 --2- 172.21.15.6:0/676313283 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd404066f30 0x7fd4040693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd41c007fd0 tx=0x7fd41c016000 comp rx=0 tx=0).stop 2023-10-06T02:18:30.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.446+0000 7fd429133700 1 -- 172.21.15.6:0/676313283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4240c4510 msgr2=0x7fd424157880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.446+0000 7fd429133700 1 --2- 172.21.15.6:0/676313283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4240c4510 0x7fd424157880 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00ec80 tx=0x7fd40c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.446+0000 7fd429133700 1 -- 172.21.15.6:0/676313283 shutdown_connections 2023-10-06T02:18:30.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.446+0000 7fd429133700 1 --2- 172.21.15.6:0/676313283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4241574b0 0x7fd424144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.446+0000 7fd429133700 1 --2- 172.21.15.6:0/676313283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4240b13f0 0x7fd424069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.446+0000 7fd429133700 1 --2- 172.21.15.6:0/676313283 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd404066f30 0x7fd4040693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.446+0000 7fd429133700 1 --2- 172.21.15.6:0/676313283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4240c4510 0x7fd424157880 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.446+0000 7fd429133700 1 -- 172.21.15.6:0/676313283 >> 172.21.15.6:0/676313283 conn(0x7fd424067910 msgr2=0x7fd424153590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:30.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.446+0000 7fd429133700 1 -- 172.21.15.6:0/676313283 shutdown_connections 2023-10-06T02:18:30.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.446+0000 7fd429133700 1 -- 172.21.15.6:0/676313283 wait complete. 2023-10-06T02:18:30.458 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:18:30.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.579+0000 7f0cadcdf700 1 Processor -- start 2023-10-06T02:18:30.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.580+0000 7f0cadcdf700 1 -- start start 2023-10-06T02:18:30.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.580+0000 7f0cadcdf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ca80c3fd0 0x7f0ca80c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:30.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.580+0000 7f0cadcdf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca80c3b40 con 0x7f0ca80cbcc0 2023-10-06T02:18:30.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.580+0000 7f0cadcdf700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca80c2f30 con 0x7f0ca81574b0 2023-10-06T02:18:30.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.580+0000 7f0cadcdf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca80c4980 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.580+0000 7f0ca6ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ca80c3fd0 0x7f0ca80c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:30.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.581+0000 7f0ca7fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0ca80cbcc0 0x7f0ca80c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50400/0 (socket says 172.21.15.6:50400) 2023-10-06T02:18:30.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.581+0000 7f0ca6ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ca80c3fd0 0x7f0ca80c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51302/0 (socket says 172.21.15.6:51302) 2023-10-06T02:18:30.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.581+0000 7f0ca7fff700 1 -- 172.21.15.6:0/1093712936 learned_addr learned my addr 172.21.15.6:0/1093712936 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:30.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.581+0000 7f0ca6ffd700 1 -- 172.21.15.6:0/1093712936 >> v1:172.21.15.175:6789/0 conn(0x7f0ca81574b0 legacy=0x7f0ca80b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:30.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.581+0000 7f0ca6ffd700 1 -- 172.21.15.6:0/1093712936 >> v1:172.21.15.6:6789/0 conn(0x7f0ca80cbcc0 legacy=0x7f0ca80c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.581+0000 7f0ca6ffd700 1 -- 172.21.15.6:0/1093712936 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca80c3210 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.581+0000 7f0ca6ffd700 1 --2- 172.21.15.6:0/1093712936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ca80c3fd0 0x7f0ca80c4440 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0c900098e0 tx=0x7f0c900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc7239002c56502 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:30.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.581+0000 7f0ca67fc700 1 -- 172.21.15.6:0/1093712936 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c90009e80 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.581+0000 7f0ca67fc700 1 -- 172.21.15.6:0/1093712936 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9000b860 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.581+0000 7f0ca67fc700 1 -- 172.21.15.6:0/1093712936 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9000bbe0 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.582+0000 7f0cadcdf700 1 -- 172.21.15.6:0/1093712936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ca80c3fd0 msgr2=0x7f0ca80c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.582+0000 7f0cadcdf700 1 --2- 172.21.15.6:0/1093712936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ca80c3fd0 0x7f0ca80c4440 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0c900098e0 tx=0x7f0c900091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.582+0000 7f0cadcdf700 1 -- 172.21.15.6:0/1093712936 shutdown_connections 2023-10-06T02:18:30.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.582+0000 7f0cadcdf700 1 --2- 172.21.15.6:0/1093712936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ca80c3fd0 0x7f0ca80c4440 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.582+0000 7f0cadcdf700 1 -- 172.21.15.6:0/1093712936 >> 172.21.15.6:0/1093712936 conn(0x7f0ca8067910 msgr2=0x7f0ca80ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:30.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.582+0000 7f0cadcdf700 1 -- 172.21.15.6:0/1093712936 shutdown_connections 2023-10-06T02:18:30.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.582+0000 7f0cadcdf700 1 -- 172.21.15.6:0/1093712936 wait complete. 2023-10-06T02:18:30.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.583+0000 7f0cadcdf700 1 Processor -- start 2023-10-06T02:18:30.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.583+0000 7f0cadcdf700 1 -- start start 2023-10-06T02:18:30.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0cadcdf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ca80c3fd0 0x7f0ca80c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:30.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0cadcdf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ca80cbcc0 0x7f0ca8153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:30.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0cadcdf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ca81574b0 0x7f0ca8150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:30.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0cadcdf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8154b70 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0cadcdf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8153f60 con 0x7f0ca80cbcc0 2023-10-06T02:18:30.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0cadcdf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8154240 con 0x7f0ca81574b0 2023-10-06T02:18:30.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0ca77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ca80c3fd0 0x7f0ca80c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:30.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0ca77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ca80c3fd0 0x7f0ca80c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51312/0 (socket says 172.21.15.6:51312) 2023-10-06T02:18:30.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0ca77fe700 1 -- 172.21.15.6:0/4243280205 learned_addr learned my addr 172.21.15.6:0/4243280205 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:30.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0ca6ffd700 1 --2- 172.21.15.6:0/4243280205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ca80cbcc0 0x7f0ca8153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:30.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0ca7fff700 1 --2- 172.21.15.6:0/4243280205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ca81574b0 0x7f0ca8150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:30.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0ca77fe700 1 -- 172.21.15.6:0/4243280205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ca81574b0 msgr2=0x7f0ca8150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0ca77fe700 1 --2- 172.21.15.6:0/4243280205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ca81574b0 0x7f0ca8150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0ca77fe700 1 -- 172.21.15.6:0/4243280205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ca80cbcc0 msgr2=0x7f0ca8153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0ca77fe700 1 --2- 172.21.15.6:0/4243280205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ca80cbcc0 0x7f0ca8153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0ca77fe700 1 -- 172.21.15.6:0/4243280205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c90009420 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0ca77fe700 1 --2- 172.21.15.6:0/4243280205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ca80c3fd0 0x7f0ca80c7b30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800b5e0 tx=0x7f0c980090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:30.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0c9f7fe700 1 -- 172.21.15.6:0/4243280205 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9800f510 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0c9f7fe700 1 -- 172.21.15.6:0/4243280205 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9800f690 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0cadcdf700 1 -- 172.21.15.6:0/4243280205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca8154520 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0c9f7fe700 1 -- 172.21.15.6:0/4243280205 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9800fa50 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.584+0000 7f0cadcdf700 1 -- 172.21.15.6:0/4243280205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca8151480 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.585+0000 7f0cadcdf700 1 -- 172.21.15.6:0/4243280205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca81549c0 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.586+0000 7f0c9f7fe700 1 -- 172.21.15.6:0/4243280205 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c9801a400 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.586+0000 7f0c9f7fe700 1 --2- 172.21.15.6:0/4243280205 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0c88066f30 0x7f0c880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.586+0000 7f0c9f7fe700 1 -- 172.21.15.6:0/4243280205 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0c98084420 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.586+0000 7f0ca6ffd700 1 --2- 172.21.15.6:0/4243280205 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0c88066f30 0x7f0c880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.587+0000 7f0ca6ffd700 1 --2- 172.21.15.6:0/4243280205 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0c88066f30 0x7f0c880693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0c900030c0 tx=0x7f0c90016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.590+0000 7f0c9f7fe700 1 -- 172.21.15.6:0/4243280205 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c980512c0 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.784+0000 7f0cadcdf700 1 -- 172.21.15.6:0/4243280205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ca806e590 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.784+0000 7f0c9f7fe700 1 -- 172.21.15.6:0/4243280205 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0c980548e0 con 0x7f0ca80c3fd0 2023-10-06T02:18:30.785 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-06T02:18:30.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.787+0000 7f0cadcdf700 1 -- 172.21.15.6:0/4243280205 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0c88066f30 msgr2=0x7f0c880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.787+0000 7f0cadcdf700 1 --2- 172.21.15.6:0/4243280205 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0c88066f30 0x7f0c880693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0c900030c0 tx=0x7f0c90016000 comp rx=0 tx=0).stop 2023-10-06T02:18:30.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.787+0000 7f0cadcdf700 1 -- 172.21.15.6:0/4243280205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ca80c3fd0 msgr2=0x7f0ca80c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.787+0000 7f0cadcdf700 1 --2- 172.21.15.6:0/4243280205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ca80c3fd0 0x7f0ca80c7b30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800b5e0 tx=0x7f0c980090f0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.787+0000 7f0cadcdf700 1 -- 172.21.15.6:0/4243280205 shutdown_connections 2023-10-06T02:18:30.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.787+0000 7f0cadcdf700 1 --2- 172.21.15.6:0/4243280205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ca81574b0 0x7f0ca8150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.787+0000 7f0cadcdf700 1 --2- 172.21.15.6:0/4243280205 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0c88066f30 0x7f0c880693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.787+0000 7f0cadcdf700 1 --2- 172.21.15.6:0/4243280205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ca80c3fd0 0x7f0ca80c7b30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.787+0000 7f0cadcdf700 1 --2- 172.21.15.6:0/4243280205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ca80cbcc0 0x7f0ca8153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.787+0000 7f0cadcdf700 1 -- 172.21.15.6:0/4243280205 >> 172.21.15.6:0/4243280205 conn(0x7f0ca8067910 msgr2=0x7f0ca815c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:30.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.787+0000 7f0cadcdf700 1 -- 172.21.15.6:0/4243280205 shutdown_connections 2023-10-06T02:18:30.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.787+0000 7f0cadcdf700 1 -- 172.21.15.6:0/4243280205 wait complete. 2023-10-06T02:18:30.799 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T02:18:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.923+0000 7f51fb320700 1 Processor -- start 2023-10-06T02:18:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.924+0000 7f51fb320700 1 -- start start 2023-10-06T02:18:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.924+0000 7f51fb320700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f51f406a380 0x7f51f40cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.924+0000 7f51fb320700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51f4159170 0x7f51f41595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.924+0000 7f51fb320700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f40cae80 con 0x7f51f406a750 2023-10-06T02:18:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.924+0000 7f51fb320700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f40cc3d0 con 0x7f51f4159170 2023-10-06T02:18:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.924+0000 7f51fb320700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f4159b10 con 0x7f51f406a380 2023-10-06T02:18:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.925+0000 7f51f98bd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51f4159170 0x7f51f41595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.925+0000 7f51f88bb700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f51f406a750 0x7f51f415d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50414/0 (socket says 172.21.15.6:50414) 2023-10-06T02:18:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.925+0000 7f51f88bb700 1 -- 172.21.15.6:0/3563686843 learned_addr learned my addr 172.21.15.6:0/3563686843 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.925+0000 7f51f90bc700 1 --2- 172.21.15.6:0/3563686843 >> v2:172.21.15.175:3300/0 conn(0x7f51f406a380 0x7f51f40cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.925+0000 7f51f98bd700 1 -- 172.21.15.6:0/3563686843 >> v2:172.21.15.175:3300/0 conn(0x7f51f406a380 msgr2=0x7f51f40cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.925+0000 7f51f98bd700 1 --2- 172.21.15.6:0/3563686843 >> v2:172.21.15.175:3300/0 conn(0x7f51f406a380 0x7f51f40cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.925+0000 7f51f98bd700 1 -- 172.21.15.6:0/3563686843 >> v1:172.21.15.6:6789/0 conn(0x7f51f406a750 legacy=0x7f51f415d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.925+0000 7f51ebfff700 1 -- 172.21.15.6:0/3563686843 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524387727 0 0) 0x7f51f40cae80 con 0x7f51f406a750 2023-10-06T02:18:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.925+0000 7f51f98bd700 1 -- 172.21.15.6:0/3563686843 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f415dcd0 con 0x7f51f4159170 2023-10-06T02:18:30.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.925+0000 7f51f98bd700 1 --2- 172.21.15.6:0/3563686843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f4159170 0x7f51f41595d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f51f40d0320 tx=0x7f51ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13899af39011ba94 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:30.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.925+0000 7f51ebfff700 1 -- 172.21.15.6:0/3563686843 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec00e070 con 0x7f51f4159170 2023-10-06T02:18:30.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.925+0000 7f51ebfff700 1 -- 172.21.15.6:0/3563686843 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec00bb60 con 0x7f51f4159170 2023-10-06T02:18:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.925+0000 7f51ebfff700 1 -- 172.21.15.6:0/3563686843 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec012430 con 0x7f51f4159170 2023-10-06T02:18:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.926+0000 7f51fb320700 1 -- 172.21.15.6:0/3563686843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f4159170 msgr2=0x7f51f41595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.926+0000 7f51fb320700 1 --2- 172.21.15.6:0/3563686843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f4159170 0x7f51f41595d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f51f40d0320 tx=0x7f51ec009780 comp rx=0 tx=0).stop 2023-10-06T02:18:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.926+0000 7f51fb320700 1 -- 172.21.15.6:0/3563686843 shutdown_connections 2023-10-06T02:18:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.926+0000 7f51fb320700 1 --2- 172.21.15.6:0/3563686843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f4159170 0x7f51f41595d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.926+0000 7f51fb320700 1 --2- 172.21.15.6:0/3563686843 >> v2:172.21.15.175:3300/0 conn(0x7f51f406a380 0x7f51f40cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.926+0000 7f51fb320700 1 -- 172.21.15.6:0/3563686843 >> 172.21.15.6:0/3563686843 conn(0x7f51f40d0350 msgr2=0x7f51f40d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.926+0000 7f51fb320700 1 -- 172.21.15.6:0/3563686843 shutdown_connections 2023-10-06T02:18:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.926+0000 7f51fb320700 1 -- 172.21.15.6:0/3563686843 wait complete. 2023-10-06T02:18:30.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.927+0000 7f51fb320700 1 Processor -- start 2023-10-06T02:18:30.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.927+0000 7f51fb320700 1 -- start start 2023-10-06T02:18:30.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.928+0000 7f51fb320700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51f406a380 0x7f51f40b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:30.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.928+0000 7f51fb320700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51f406a750 0x7f51f4154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:30.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.928+0000 7f51fb320700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f4159170 0x7f51f40c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:30.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.928+0000 7f51fb320700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f40b5ca0 con 0x7f51f4159170 2023-10-06T02:18:30.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.928+0000 7f51fb320700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f40b5090 con 0x7f51f406a380 2023-10-06T02:18:30.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.928+0000 7f51fb320700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f40b5370 con 0x7f51f406a750 2023-10-06T02:18:30.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.928+0000 7f51f98bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f4159170 0x7f51f40c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:30.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.928+0000 7f51f98bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f4159170 0x7f51f40c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51340/0 (socket says 172.21.15.6:51340) 2023-10-06T02:18:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.928+0000 7f51f98bd700 1 -- 172.21.15.6:0/4022528847 learned_addr learned my addr 172.21.15.6:0/4022528847 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.928+0000 7f51f90bc700 1 --2- 172.21.15.6:0/4022528847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51f406a380 0x7f51f40b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.928+0000 7f51f88bb700 1 --2- 172.21.15.6:0/4022528847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51f406a750 0x7f51f4154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.928+0000 7f51f98bd700 1 -- 172.21.15.6:0/4022528847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51f406a750 msgr2=0x7f51f4154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.928+0000 7f51f98bd700 1 --2- 172.21.15.6:0/4022528847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51f406a750 0x7f51f4154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.928+0000 7f51f98bd700 1 -- 172.21.15.6:0/4022528847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51f406a380 msgr2=0x7f51f40b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.928+0000 7f51f98bd700 1 --2- 172.21.15.6:0/4022528847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51f406a380 0x7f51f40b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:30.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.928+0000 7f51f98bd700 1 -- 172.21.15.6:0/4022528847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec009a20 con 0x7f51f4159170 2023-10-06T02:18:30.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.928+0000 7f51f88bb700 1 --2- 172.21.15.6:0/4022528847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51f406a750 0x7f51f4154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:30.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.929+0000 7f51f98bd700 1 --2- 172.21.15.6:0/4022528847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f4159170 0x7f51f40c92d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009fd0 tx=0x7f51ec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:30.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.929+0000 7f51e97fa700 1 -- 172.21.15.6:0/4022528847 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec012e00 con 0x7f51f4159170 2023-10-06T02:18:30.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.929+0000 7f51e97fa700 1 -- 172.21.15.6:0/4022528847 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec01d630 con 0x7f51f4159170 2023-10-06T02:18:30.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.929+0000 7f51e97fa700 1 -- 172.21.15.6:0/4022528847 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec01d9f0 con 0x7f51f4159170 2023-10-06T02:18:30.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.929+0000 7f51fb320700 1 -- 172.21.15.6:0/4022528847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f40b5650 con 0x7f51f4159170 2023-10-06T02:18:30.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.929+0000 7f51fb320700 1 -- 172.21.15.6:0/4022528847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f4155150 con 0x7f51f4159170 2023-10-06T02:18:30.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.930+0000 7f51fb320700 1 -- 172.21.15.6:0/4022528847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f415a560 con 0x7f51f4159170 2023-10-06T02:18:30.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.930+0000 7f51e97fa700 1 -- 172.21.15.6:0/4022528847 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51ec024070 con 0x7f51f4159170 2023-10-06T02:18:30.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.931+0000 7f51e97fa700 1 --2- 172.21.15.6:0/4022528847 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f51d8066f30 0x7f51d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:30.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.931+0000 7f51e97fa700 1 -- 172.21.15.6:0/4022528847 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f51ec087160 con 0x7f51f4159170 2023-10-06T02:18:30.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.931+0000 7f51f90bc700 1 --2- 172.21.15.6:0/4022528847 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f51d8066f30 0x7f51d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:30.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.931+0000 7f51f90bc700 1 --2- 172.21.15.6:0/4022528847 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f51d8066f30 0x7f51d80693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f51f415d130 tx=0x7f51f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:30.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:30.935+0000 7f51e97fa700 1 -- 172.21.15.6:0/4022528847 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51ec053f40 con 0x7f51f4159170 2023-10-06T02:18:31.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.128+0000 7f51fb320700 1 -- 172.21.15.6:0/4022528847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f51f40b5de0 con 0x7f51f4159170 2023-10-06T02:18:31.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.128+0000 7f51e97fa700 1 -- 172.21.15.6:0/4022528847 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f51f40b5de0 con 0x7f51f4159170 2023-10-06T02:18:31.129 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:18:31.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.130+0000 7f51fb320700 1 -- 172.21.15.6:0/4022528847 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f51d8066f30 msgr2=0x7f51d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.130+0000 7f51fb320700 1 --2- 172.21.15.6:0/4022528847 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f51d8066f30 0x7f51d80693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f51f415d130 tx=0x7f51f0008040 comp rx=0 tx=0).stop 2023-10-06T02:18:31.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.130+0000 7f51fb320700 1 -- 172.21.15.6:0/4022528847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f4159170 msgr2=0x7f51f40c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.130+0000 7f51fb320700 1 --2- 172.21.15.6:0/4022528847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f4159170 0x7f51f40c92d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009fd0 tx=0x7f51ec019000 comp rx=0 tx=0).stop 2023-10-06T02:18:31.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.131+0000 7f51fb320700 1 -- 172.21.15.6:0/4022528847 shutdown_connections 2023-10-06T02:18:31.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.131+0000 7f51fb320700 1 --2- 172.21.15.6:0/4022528847 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f51d8066f30 0x7f51d80693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.131+0000 7f51fb320700 1 --2- 172.21.15.6:0/4022528847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f4159170 0x7f51f40c92d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.131+0000 7f51fb320700 1 --2- 172.21.15.6:0/4022528847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51f406a380 0x7f51f40b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.131+0000 7f51fb320700 1 --2- 172.21.15.6:0/4022528847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51f406a750 0x7f51f4154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.131+0000 7f51fb320700 1 -- 172.21.15.6:0/4022528847 >> 172.21.15.6:0/4022528847 conn(0x7f51f40d0350 msgr2=0x7f51f41575e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:31.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.131+0000 7f51fb320700 1 -- 172.21.15.6:0/4022528847 shutdown_connections 2023-10-06T02:18:31.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.131+0000 7f51fb320700 1 -- 172.21.15.6:0/4022528847 wait complete. 2023-10-06T02:18:31.143 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:18:31.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.262+0000 7f9e307a3700 1 Processor -- start 2023-10-06T02:18:31.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.262+0000 7f9e307a3700 1 -- start start 2023-10-06T02:18:31.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.262+0000 7f9e307a3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e28159150 0x7f9e2815de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:31.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.262+0000 7f9e307a3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e280cccf0 0x7f9e280b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:31.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.262+0000 7f9e307a3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e280afbc0 con 0x7f9e280b08f0 2023-10-06T02:18:31.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.262+0000 7f9e307a3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e280cd620 con 0x7f9e28159150 2023-10-06T02:18:31.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.262+0000 7f9e307a3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e280afe10 con 0x7f9e280cccf0 2023-10-06T02:18:31.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.263+0000 7f9e2e53f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e28159150 0x7f9e2815de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:31.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.263+0000 7f9e2e53f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e28159150 0x7f9e2815de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51346/0 (socket says 172.21.15.6:51346) 2023-10-06T02:18:31.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.263+0000 7f9e2e53f700 1 -- 172.21.15.6:0/3707462500 learned_addr learned my addr 172.21.15.6:0/3707462500 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:31.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.263+0000 7f9e2ed40700 1 --2- 172.21.15.6:0/3707462500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e280cccf0 0x7f9e280b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:31.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.263+0000 7f9e2e53f700 1 -- 172.21.15.6:0/3707462500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e280cccf0 msgr2=0x7f9e280b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:31.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.263+0000 7f9e2e53f700 1 --2- 172.21.15.6:0/3707462500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e280cccf0 0x7f9e280b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.263+0000 7f9e2e53f700 1 -- 172.21.15.6:0/3707462500 >> v1:172.21.15.175:6789/0 conn(0x7f9e280b08f0 legacy=0x7f9e28159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.263+0000 7f9e2e53f700 1 -- 172.21.15.6:0/3707462500 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e280b00f0 con 0x7f9e28159150 2023-10-06T02:18:31.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.263+0000 7f9e2e53f700 1 --2- 172.21.15.6:0/3707462500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e28159150 0x7f9e2815de30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9e200099b0 tx=0x7f9e20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8d54685d0c3fac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:31.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.263+0000 7f9e2d53d700 1 -- 172.21.15.6:0/3707462500 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e20009ea0 con 0x7f9e28159150 2023-10-06T02:18:31.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.263+0000 7f9e2d53d700 1 -- 172.21.15.6:0/3707462500 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2000b860 con 0x7f9e28159150 2023-10-06T02:18:31.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.263+0000 7f9e2d53d700 1 -- 172.21.15.6:0/3707462500 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2000bc00 con 0x7f9e28159150 2023-10-06T02:18:31.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.264+0000 7f9e307a3700 1 -- 172.21.15.6:0/3707462500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e28159150 msgr2=0x7f9e2815de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.264+0000 7f9e307a3700 1 --2- 172.21.15.6:0/3707462500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e28159150 0x7f9e2815de30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9e200099b0 tx=0x7f9e20009250 comp rx=0 tx=0).stop 2023-10-06T02:18:31.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.264+0000 7f9e307a3700 1 -- 172.21.15.6:0/3707462500 shutdown_connections 2023-10-06T02:18:31.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.264+0000 7f9e307a3700 1 --2- 172.21.15.6:0/3707462500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e280cccf0 0x7f9e280b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.264+0000 7f9e307a3700 1 --2- 172.21.15.6:0/3707462500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e28159150 0x7f9e2815de30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.264+0000 7f9e307a3700 1 -- 172.21.15.6:0/3707462500 >> 172.21.15.6:0/3707462500 conn(0x7f9e28068680 msgr2=0x7f9e28068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:31.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.264+0000 7f9e307a3700 1 -- 172.21.15.6:0/3707462500 shutdown_connections 2023-10-06T02:18:31.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.264+0000 7f9e307a3700 1 -- 172.21.15.6:0/3707462500 wait complete. 2023-10-06T02:18:31.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.265+0000 7f9e307a3700 1 Processor -- start 2023-10-06T02:18:31.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.265+0000 7f9e307a3700 1 -- start start 2023-10-06T02:18:31.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e307a3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e280b08f0 0x7f9e280c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:31.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e307a3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e280cccf0 0x7f9e280c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:31.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e307a3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e28159150 0x7f9e280c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:31.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e307a3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2815b920 con 0x7f9e280cccf0 2023-10-06T02:18:31.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e307a3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2815ad10 con 0x7f9e280b08f0 2023-10-06T02:18:31.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e307a3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2815aff0 con 0x7f9e28159150 2023-10-06T02:18:31.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e2dd3e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e280cccf0 0x7f9e280c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:31.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e2e53f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e280b08f0 0x7f9e280c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:31.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e2ed40700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e28159150 0x7f9e280c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:31.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e2dd3e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e280cccf0 0x7f9e280c6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51362/0 (socket says 172.21.15.6:51362) 2023-10-06T02:18:31.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e2e53f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e280b08f0 0x7f9e280c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:47938/0 (socket says 172.21.15.6:47938) 2023-10-06T02:18:31.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e2dd3e700 1 -- 172.21.15.6:0/1179540023 learned_addr learned my addr 172.21.15.6:0/1179540023 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:31.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e2dd3e700 1 -- 172.21.15.6:0/1179540023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e28159150 msgr2=0x7f9e280c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e2dd3e700 1 --2- 172.21.15.6:0/1179540023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e28159150 0x7f9e280c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e2dd3e700 1 -- 172.21.15.6:0/1179540023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e280b08f0 msgr2=0x7f9e280c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e2dd3e700 1 --2- 172.21.15.6:0/1179540023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e280b08f0 0x7f9e280c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e2dd3e700 1 -- 172.21.15.6:0/1179540023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e200094f0 con 0x7f9e280cccf0 2023-10-06T02:18:31.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.266+0000 7f9e2dd3e700 1 --2- 172.21.15.6:0/1179540023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e280cccf0 0x7f9e280c6470 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00c4e0 tx=0x7f9e1c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:31.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.267+0000 7f9e267fc700 1 -- 172.21.15.6:0/1179540023 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c011590 con 0x7f9e280cccf0 2023-10-06T02:18:31.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.267+0000 7f9e267fc700 1 -- 172.21.15.6:0/1179540023 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c011710 con 0x7f9e280cccf0 2023-10-06T02:18:31.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.267+0000 7f9e267fc700 1 -- 172.21.15.6:0/1179540023 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c011ad0 con 0x7f9e280cccf0 2023-10-06T02:18:31.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.267+0000 7f9e307a3700 1 -- 172.21.15.6:0/1179540023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2815b2d0 con 0x7f9e280cccf0 2023-10-06T02:18:31.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.267+0000 7f9e307a3700 1 -- 172.21.15.6:0/1179540023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e280c69b0 con 0x7f9e280cccf0 2023-10-06T02:18:31.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.267+0000 7f9e307a3700 1 -- 172.21.15.6:0/1179540023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e28088aa0 con 0x7f9e280cccf0 2023-10-06T02:18:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.268+0000 7f9e267fc700 1 -- 172.21.15.6:0/1179540023 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e1c001020 con 0x7f9e280cccf0 2023-10-06T02:18:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.269+0000 7f9e267fc700 1 --2- 172.21.15.6:0/1179540023 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e14066f30 0x7f9e140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.269+0000 7f9e267fc700 1 -- 172.21.15.6:0/1179540023 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f9e1c083c60 con 0x7f9e280cccf0 2023-10-06T02:18:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.269+0000 7f9e2e53f700 1 --2- 172.21.15.6:0/1179540023 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e14066f30 0x7f9e140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.269+0000 7f9e2e53f700 1 --2- 172.21.15.6:0/1179540023 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e14066f30 0x7f9e140693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9e200099b0 tx=0x7f9e20017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:31.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.273+0000 7f9e267fc700 1 -- 172.21.15.6:0/1179540023 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e1c050a40 con 0x7f9e280cccf0 2023-10-06T02:18:31.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.515+0000 7f9e307a3700 1 -- 172.21.15.6:0/1179540023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e2815ba60 con 0x7f9e280cccf0 2023-10-06T02:18:31.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.516+0000 7f9e267fc700 1 -- 172.21.15.6:0/1179540023 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4590 (secure 0 0 0) 0x7f9e1c017070 con 0x7f9e280cccf0 2023-10-06T02:18:31.516 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:31.516 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3433510267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3433510267},{"type":"v1","addr":"172.21.15.175:6836","nonce":3433510267}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3290404467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3290404467},{"type":"v1","addr":"172.21.15.175:6837","nonce":3290404467}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/4132952009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4132952009},{"type":"v1","addr":"172.21.15.6:6834","nonce":4132952009}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:17:43.404580+0000","modified":"2023-10-06T02:17:56.734938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/839986504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":839986504},{"type":"v1","addr":"172.21.15.6:6835","nonce":839986504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:18:31.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.518+0000 7f9e307a3700 1 -- 172.21.15.6:0/1179540023 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e14066f30 msgr2=0x7f9e140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.518+0000 7f9e307a3700 1 --2- 172.21.15.6:0/1179540023 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e14066f30 0x7f9e140693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9e200099b0 tx=0x7f9e20017000 comp rx=0 tx=0).stop 2023-10-06T02:18:31.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.518+0000 7f9e307a3700 1 -- 172.21.15.6:0/1179540023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e280cccf0 msgr2=0x7f9e280c6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.518+0000 7f9e307a3700 1 --2- 172.21.15.6:0/1179540023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e280cccf0 0x7f9e280c6470 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00c4e0 tx=0x7f9e1c00c7f0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.518+0000 7f9e307a3700 1 -- 172.21.15.6:0/1179540023 shutdown_connections 2023-10-06T02:18:31.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.518+0000 7f9e307a3700 1 --2- 172.21.15.6:0/1179540023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e28159150 0x7f9e280c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.518+0000 7f9e307a3700 1 --2- 172.21.15.6:0/1179540023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e280b08f0 0x7f9e280c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.518+0000 7f9e307a3700 1 --2- 172.21.15.6:0/1179540023 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e14066f30 0x7f9e140693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.518+0000 7f9e307a3700 1 --2- 172.21.15.6:0/1179540023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e280cccf0 0x7f9e280c6470 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.518+0000 7f9e307a3700 1 -- 172.21.15.6:0/1179540023 >> 172.21.15.6:0/1179540023 conn(0x7f9e28068680 msgr2=0x7f9e280cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:31.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.518+0000 7f9e307a3700 1 -- 172.21.15.6:0/1179540023 shutdown_connections 2023-10-06T02:18:31.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.518+0000 7f9e307a3700 1 -- 172.21.15.6:0/1179540023 wait complete. 2023-10-06T02:18:31.520 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-10-06T02:18:31.530 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:18:31.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.649+0000 7f37e23cf700 1 Processor -- start 2023-10-06T02:18:31.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.649+0000 7f37e23cf700 1 -- start start 2023-10-06T02:18:31.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.650+0000 7f37e23cf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f37dc0b27f0 0x7f37dc15db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:31.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.650+0000 7f37e23cf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37dc15e190 con 0x7f37dc0af8b0 2023-10-06T02:18:31.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.650+0000 7f37e23cf700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37dc0cb650 con 0x7f37dc0af4e0 2023-10-06T02:18:31.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.650+0000 7f37e23cf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37dc0b1910 con 0x7f37dc0b27f0 2023-10-06T02:18:31.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.650+0000 7f37e096c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f37dc0b27f0 0x7f37dc15db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:31.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.650+0000 7f37e096c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f37dc0b27f0 0x7f37dc15db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51368/0 (socket says 172.21.15.6:51368) 2023-10-06T02:18:31.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.650+0000 7f37e096c700 1 -- 172.21.15.6:0/60053217 learned_addr learned my addr 172.21.15.6:0/60053217 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:31.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.650+0000 7f37db7fe700 1 --1- 172.21.15.6:0/60053217 >> v1:172.21.15.6:6789/0 conn(0x7f37dc0af8b0 0x7f37dc15d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50418/0 (socket says 172.21.15.6:50418) 2023-10-06T02:18:31.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.650+0000 7f37e096c700 1 -- 172.21.15.6:0/60053217 >> v1:172.21.15.175:6789/0 conn(0x7f37dc0af4e0 legacy=0x7f37dc0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.650+0000 7f37e096c700 1 -- 172.21.15.6:0/60053217 >> v1:172.21.15.6:6789/0 conn(0x7f37dc0af8b0 legacy=0x7f37dc15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.650+0000 7f37e096c700 1 -- 172.21.15.6:0/60053217 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc0ccaf0 con 0x7f37dc0b27f0 2023-10-06T02:18:31.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.650+0000 7f37e096c700 1 --2- 172.21.15.6:0/60053217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37dc0b27f0 0x7f37dc15db70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009f20 tx=0x7f37d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec34b85b41975e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:31.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.650+0000 7f37daffd700 1 -- 172.21.15.6:0/60053217 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d400e070 con 0x7f37dc0b27f0 2023-10-06T02:18:31.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.650+0000 7f37daffd700 1 -- 172.21.15.6:0/60053217 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d400ba80 con 0x7f37dc0b27f0 2023-10-06T02:18:31.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.650+0000 7f37daffd700 1 -- 172.21.15.6:0/60053217 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d40092e0 con 0x7f37dc0b27f0 2023-10-06T02:18:31.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.651+0000 7f37e23cf700 1 -- 172.21.15.6:0/60053217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37dc0b27f0 msgr2=0x7f37dc15db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.651+0000 7f37e23cf700 1 --2- 172.21.15.6:0/60053217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37dc0b27f0 0x7f37dc15db70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009f20 tx=0x7f37d4009840 comp rx=0 tx=0).stop 2023-10-06T02:18:31.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.651+0000 7f37e23cf700 1 -- 172.21.15.6:0/60053217 shutdown_connections 2023-10-06T02:18:31.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.651+0000 7f37e23cf700 1 --2- 172.21.15.6:0/60053217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37dc0b27f0 0x7f37dc15db70 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.651+0000 7f37e23cf700 1 -- 172.21.15.6:0/60053217 >> 172.21.15.6:0/60053217 conn(0x7f37dc068680 msgr2=0x7f37dc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:31.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.651+0000 7f37e23cf700 1 -- 172.21.15.6:0/60053217 shutdown_connections 2023-10-06T02:18:31.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.651+0000 7f37e23cf700 1 -- 172.21.15.6:0/60053217 wait complete. 2023-10-06T02:18:31.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.652+0000 7f37e23cf700 1 Processor -- start 2023-10-06T02:18:31.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.652+0000 7f37e23cf700 1 -- start start 2023-10-06T02:18:31.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.653+0000 7f37e23cf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37dc0af4e0 0x7f37dc0c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:31.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.653+0000 7f37e23cf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37dc0af8b0 0x7f37dc0c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:31.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.653+0000 7f37e23cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37dc0b27f0 0x7f37dc0c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:31.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.653+0000 7f37e23cf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc141f50 con 0x7f37dc0b27f0 2023-10-06T02:18:31.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.653+0000 7f37e23cf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc143590 con 0x7f37dc0af8b0 2023-10-06T02:18:31.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.653+0000 7f37e23cf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc1424f0 con 0x7f37dc0af4e0 2023-10-06T02:18:31.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.653+0000 7f37e096c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37dc0b27f0 0x7f37dc0c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:31.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.653+0000 7f37e096c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37dc0b27f0 0x7f37dc0c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51380/0 (socket says 172.21.15.6:51380) 2023-10-06T02:18:31.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.653+0000 7f37e096c700 1 -- 172.21.15.6:0/1721549041 learned_addr learned my addr 172.21.15.6:0/1721549041 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:31.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.653+0000 7f37db7fe700 1 --2- 172.21.15.6:0/1721549041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37dc0af8b0 0x7f37dc0c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:31.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.653+0000 7f37dbfff700 1 --2- 172.21.15.6:0/1721549041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37dc0af4e0 0x7f37dc0c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:31.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.653+0000 7f37e096c700 1 -- 172.21.15.6:0/1721549041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37dc0af4e0 msgr2=0x7f37dc0c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.653+0000 7f37e096c700 1 --2- 172.21.15.6:0/1721549041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37dc0af4e0 0x7f37dc0c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.653+0000 7f37e096c700 1 -- 172.21.15.6:0/1721549041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37dc0af8b0 msgr2=0x7f37dc0c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.653+0000 7f37e096c700 1 --2- 172.21.15.6:0/1721549041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37dc0af8b0 0x7f37dc0c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.653+0000 7f37e096c700 1 -- 172.21.15.6:0/1721549041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d4009ae0 con 0x7f37dc0b27f0 2023-10-06T02:18:31.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.653+0000 7f37e096c700 1 --2- 172.21.15.6:0/1721549041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37dc0b27f0 0x7f37dc0c7300 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f37dc089520 tx=0x7f37d4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:31.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.654+0000 7f37d3fff700 1 -- 172.21.15.6:0/1721549041 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4008ce0 con 0x7f37dc0b27f0 2023-10-06T02:18:31.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.654+0000 7f37d3fff700 1 -- 172.21.15.6:0/1721549041 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d4008e40 con 0x7f37dc0b27f0 2023-10-06T02:18:31.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.654+0000 7f37e23cf700 1 -- 172.21.15.6:0/1721549041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37dc1427d0 con 0x7f37dc0b27f0 2023-10-06T02:18:31.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.654+0000 7f37d3fff700 1 -- 172.21.15.6:0/1721549041 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d40256b0 con 0x7f37dc0b27f0 2023-10-06T02:18:31.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.654+0000 7f37e23cf700 1 -- 172.21.15.6:0/1721549041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37dc142d90 con 0x7f37dc0b27f0 2023-10-06T02:18:31.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.655+0000 7f37e23cf700 1 -- 172.21.15.6:0/1721549041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37dc088aa0 con 0x7f37dc0b27f0 2023-10-06T02:18:31.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.655+0000 7f37d3fff700 1 -- 172.21.15.6:0/1721549041 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37d4003040 con 0x7f37dc0b27f0 2023-10-06T02:18:31.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.655+0000 7f37d3fff700 1 --2- 172.21.15.6:0/1721549041 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f37bc066f30 0x7f37bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:31.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.656+0000 7f37d3fff700 1 -- 172.21.15.6:0/1721549041 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f37d4086030 con 0x7f37dc0b27f0 2023-10-06T02:18:31.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.656+0000 7f37dbfff700 1 --2- 172.21.15.6:0/1721549041 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f37bc066f30 0x7f37bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:31.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.656+0000 7f37dbfff700 1 --2- 172.21.15.6:0/1721549041 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f37bc066f30 0x7f37bc0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f37c4003a80 tx=0x7f37c4007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:31.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.660+0000 7f37d3fff700 1 -- 172.21.15.6:0/1721549041 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37d4052e10 con 0x7f37dc0b27f0 2023-10-06T02:18:31.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.851+0000 7f37e23cf700 1 -- 172.21.15.6:0/1721549041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37dc0cad20 con 0x7f37dc0b27f0 2023-10-06T02:18:31.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.852+0000 7f37d3fff700 1 -- 172.21.15.6:0/1721549041 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18754 (secure 0 0 0) 0x7f37d4056430 con 0x7f37dc0b27f0 2023-10-06T02:18:31.853 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:31.853 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:18:30.873397+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.28","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:18:31.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.854+0000 7f37e23cf700 1 -- 172.21.15.6:0/1721549041 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f37bc066f30 msgr2=0x7f37bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.854+0000 7f37e23cf700 1 --2- 172.21.15.6:0/1721549041 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f37bc066f30 0x7f37bc0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f37c4003a80 tx=0x7f37c4007ec0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.855+0000 7f37e23cf700 1 -- 172.21.15.6:0/1721549041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37dc0b27f0 msgr2=0x7f37dc0c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.855+0000 7f37e23cf700 1 --2- 172.21.15.6:0/1721549041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37dc0b27f0 0x7f37dc0c7300 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f37dc089520 tx=0x7f37d4018000 comp rx=0 tx=0).stop 2023-10-06T02:18:31.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.855+0000 7f37e23cf700 1 -- 172.21.15.6:0/1721549041 shutdown_connections 2023-10-06T02:18:31.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.855+0000 7f37e23cf700 1 --2- 172.21.15.6:0/1721549041 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f37bc066f30 0x7f37bc0693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.855+0000 7f37e23cf700 1 --2- 172.21.15.6:0/1721549041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37dc0b27f0 0x7f37dc0c7300 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.855+0000 7f37e23cf700 1 --2- 172.21.15.6:0/1721549041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37dc0af4e0 0x7f37dc0c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.855+0000 7f37e23cf700 1 --2- 172.21.15.6:0/1721549041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37dc0af8b0 0x7f37dc0c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.855+0000 7f37e23cf700 1 -- 172.21.15.6:0/1721549041 >> 172.21.15.6:0/1721549041 conn(0x7f37dc068680 msgr2=0x7f37dc0b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:31.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.855+0000 7f37e23cf700 1 -- 172.21.15.6:0/1721549041 shutdown_connections 2023-10-06T02:18:31.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.855+0000 7f37e23cf700 1 -- 172.21.15.6:0/1721549041 wait complete. 2023-10-06T02:18:31.867 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:18:31.867 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:18:31.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.989+0000 7f1919f2a700 1 Processor -- start 2023-10-06T02:18:31.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.989+0000 7f1919f2a700 1 -- start start 2023-10-06T02:18:31.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.989+0000 7f1919f2a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f19140c8b40 0x7f19140af560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:31.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.990+0000 7f1919f2a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191406c950 con 0x7f1914150740 2023-10-06T02:18:31.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.990+0000 7f1919f2a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191406d4f0 con 0x7f1914150370 2023-10-06T02:18:31.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.990+0000 7f1919f2a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1914069b10 con 0x7f19140c8b40 2023-10-06T02:18:31.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.990+0000 7f1913fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f19140c8b40 0x7f19140af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.990+0000 7f1912ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1914150740 0x7f191406cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50422/0 (socket says 172.21.15.6:50422) 2023-10-06T02:18:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.990+0000 7f1912ffd700 1 -- 172.21.15.6:0/2181952321 learned_addr learned my addr 172.21.15.6:0/2181952321 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.990+0000 7f1913fff700 1 -- 172.21.15.6:0/2181952321 >> v1:172.21.15.175:6789/0 conn(0x7f1914150370 legacy=0x7f1914069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.990+0000 7f1913fff700 1 -- 172.21.15.6:0/2181952321 >> v1:172.21.15.6:6789/0 conn(0x7f1914150740 legacy=0x7f191406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.990+0000 7f1913fff700 1 -- 172.21.15.6:0/2181952321 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1914069830 con 0x7f19140c8b40 2023-10-06T02:18:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.990+0000 7f19127fc700 1 -- 172.21.15.6:0/2181952321 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141211703 0 0) 0x7f191406c950 con 0x7f1914150740 2023-10-06T02:18:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.990+0000 7f1913fff700 1 --2- 172.21.15.6:0/2181952321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19140c8b40 0x7f19140af560 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f190c009e60 tx=0x7f190c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c6137f9140e88 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.990+0000 7f19127fc700 1 -- 172.21.15.6:0/2181952321 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c00e070 con 0x7f19140c8b40 2023-10-06T02:18:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.990+0000 7f19127fc700 1 -- 172.21.15.6:0/2181952321 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c00bbf0 con 0x7f19140c8b40 2023-10-06T02:18:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.990+0000 7f19127fc700 1 -- 172.21.15.6:0/2181952321 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c012430 con 0x7f19140c8b40 2023-10-06T02:18:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.991+0000 7f1919f2a700 1 -- 172.21.15.6:0/2181952321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19140c8b40 msgr2=0x7f19140af560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.991+0000 7f1919f2a700 1 --2- 172.21.15.6:0/2181952321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19140c8b40 0x7f19140af560 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f190c009e60 tx=0x7f190c009780 comp rx=0 tx=0).stop 2023-10-06T02:18:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.991+0000 7f1919f2a700 1 -- 172.21.15.6:0/2181952321 shutdown_connections 2023-10-06T02:18:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.991+0000 7f1919f2a700 1 --2- 172.21.15.6:0/2181952321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19140c8b40 0x7f19140af560 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.991+0000 7f1919f2a700 1 -- 172.21.15.6:0/2181952321 >> 172.21.15.6:0/2181952321 conn(0x7f191406b6e0 msgr2=0x7f19140ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.991+0000 7f1919f2a700 1 -- 172.21.15.6:0/2181952321 shutdown_connections 2023-10-06T02:18:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.991+0000 7f1919f2a700 1 -- 172.21.15.6:0/2181952321 wait complete. 2023-10-06T02:18:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.992+0000 7f1919f2a700 1 Processor -- start 2023-10-06T02:18:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.992+0000 7f1919f2a700 1 -- start start 2023-10-06T02:18:31.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f1919f2a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19140c8b40 0x7f191413b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:31.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f1919f2a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1914150370 0x7f19140a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f1919f2a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19140a8e10 0x7f191414f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f1919f2a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19140a9f80 con 0x7f19140c8b40 2023-10-06T02:18:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f1919f2a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19140c93f0 con 0x7f19140a8e10 2023-10-06T02:18:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f1919f2a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19140a9370 con 0x7f1914150370 2023-10-06T02:18:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f19137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19140c8b40 0x7f191413b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f19137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19140c8b40 0x7f191413b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51398/0 (socket says 172.21.15.6:51398) 2023-10-06T02:18:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f19137fe700 1 -- 172.21.15.6:0/3491677319 learned_addr learned my addr 172.21.15.6:0/3491677319 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f1913fff700 1 --2- 172.21.15.6:0/3491677319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19140a8e10 0x7f191414f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f1912ffd700 1 --2- 172.21.15.6:0/3491677319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1914150370 0x7f19140a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f19137fe700 1 -- 172.21.15.6:0/3491677319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1914150370 msgr2=0x7f19140a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f19137fe700 1 --2- 172.21.15.6:0/3491677319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1914150370 0x7f19140a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f19137fe700 1 -- 172.21.15.6:0/3491677319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19140a8e10 msgr2=0x7f191414f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f19137fe700 1 --2- 172.21.15.6:0/3491677319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19140a8e10 0x7f191414f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f19137fe700 1 -- 172.21.15.6:0/3491677319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190c009a20 con 0x7f19140c8b40 2023-10-06T02:18:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f1912ffd700 1 --2- 172.21.15.6:0/3491677319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1914150370 0x7f19140a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f1913fff700 1 --2- 172.21.15.6:0/3491677319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19140a8e10 0x7f191414f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.993+0000 7f19137fe700 1 --2- 172.21.15.6:0/3491677319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19140c8b40 0x7f191413b8e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f190400c5d0 tx=0x7f1904007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.994+0000 7f18fb7fe700 1 -- 172.21.15.6:0/3491677319 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1904012630 con 0x7f19140c8b40 2023-10-06T02:18:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.994+0000 7f18fb7fe700 1 -- 172.21.15.6:0/3491677319 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1904012790 con 0x7f19140c8b40 2023-10-06T02:18:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.994+0000 7f1919f2a700 1 -- 172.21.15.6:0/3491677319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19140a9650 con 0x7f19140c8b40 2023-10-06T02:18:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.994+0000 7f18fb7fe700 1 -- 172.21.15.6:0/3491677319 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1904012b50 con 0x7f19140c8b40 2023-10-06T02:18:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.994+0000 7f1919f2a700 1 -- 172.21.15.6:0/3491677319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19140a9c10 con 0x7f19140c8b40 2023-10-06T02:18:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.995+0000 7f1919f2a700 1 -- 172.21.15.6:0/3491677319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f191406db40 con 0x7f19140c8b40 2023-10-06T02:18:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.995+0000 7f18fb7fe700 1 -- 172.21.15.6:0/3491677319 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f190401b400 con 0x7f19140c8b40 2023-10-06T02:18:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.995+0000 7f18fb7fe700 1 --2- 172.21.15.6:0/3491677319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1900066f60 0x7f1900069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.996+0000 7f18fb7fe700 1 -- 172.21.15.6:0/3491677319 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f1904084bc0 con 0x7f19140c8b40 2023-10-06T02:18:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.996+0000 7f1912ffd700 1 --2- 172.21.15.6:0/3491677319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1900066f60 0x7f1900069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:31.996+0000 7f1912ffd700 1 --2- 172.21.15.6:0/3491677319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1900066f60 0x7f1900069410 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1914142870 tx=0x7f1908009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.000+0000 7f18fb7fe700 1 -- 172.21.15.6:0/3491677319 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1904051900 con 0x7f19140c8b40 2023-10-06T02:18:32.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.242+0000 7f1919f2a700 1 -- 172.21.15.6:0/3491677319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f191404bb80 con 0x7f19140c8b40 2023-10-06T02:18:32.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.243+0000 7f18fb7fe700 1 -- 172.21.15.6:0/3491677319 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4590 (secure 0 0 0) 0x7f1904054f20 con 0x7f19140c8b40 2023-10-06T02:18:32.243 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:32.244 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3433510267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3433510267},{"type":"v1","addr":"172.21.15.175:6836","nonce":3433510267}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3290404467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3290404467},{"type":"v1","addr":"172.21.15.175:6837","nonce":3290404467}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/4132952009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4132952009},{"type":"v1","addr":"172.21.15.6:6834","nonce":4132952009}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:17:43.404580+0000","modified":"2023-10-06T02:17:56.734938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/839986504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":839986504},{"type":"v1","addr":"172.21.15.6:6835","nonce":839986504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:18:32.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.245+0000 7f1919f2a700 1 -- 172.21.15.6:0/3491677319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1900066f60 msgr2=0x7f1900069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:32.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.245+0000 7f1919f2a700 1 --2- 172.21.15.6:0/3491677319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1900066f60 0x7f1900069410 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1914142870 tx=0x7f1908009040 comp rx=0 tx=0).stop 2023-10-06T02:18:32.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.245+0000 7f1919f2a700 1 -- 172.21.15.6:0/3491677319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19140c8b40 msgr2=0x7f191413b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:32.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.245+0000 7f1919f2a700 1 --2- 172.21.15.6:0/3491677319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19140c8b40 0x7f191413b8e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f190400c5d0 tx=0x7f1904007f60 comp rx=0 tx=0).stop 2023-10-06T02:18:32.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.245+0000 7f1919f2a700 1 -- 172.21.15.6:0/3491677319 shutdown_connections 2023-10-06T02:18:32.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.245+0000 7f1919f2a700 1 --2- 172.21.15.6:0/3491677319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19140a8e10 0x7f191414f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.245+0000 7f1919f2a700 1 --2- 172.21.15.6:0/3491677319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1900066f60 0x7f1900069410 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.245+0000 7f1919f2a700 1 --2- 172.21.15.6:0/3491677319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19140c8b40 0x7f191413b8e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.245+0000 7f1919f2a700 1 --2- 172.21.15.6:0/3491677319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1914150370 0x7f19140a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.245+0000 7f1919f2a700 1 -- 172.21.15.6:0/3491677319 >> 172.21.15.6:0/3491677319 conn(0x7f191406b6e0 msgr2=0x7f191414e290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:32.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.245+0000 7f1919f2a700 1 -- 172.21.15.6:0/3491677319 shutdown_connections 2023-10-06T02:18:32.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.245+0000 7f1919f2a700 1 -- 172.21.15.6:0/3491677319 wait complete. 2023-10-06T02:18:32.247 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-10-06T02:18:32.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:18:32.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.377+0000 7f18f88dc700 1 Processor -- start 2023-10-06T02:18:32.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.378+0000 7f18f88dc700 1 -- start start 2023-10-06T02:18:32.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.378+0000 7f18f88dc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f18f4159380 0x7f18f4159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:32.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.378+0000 7f18f88dc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18f415d4d0 0x7f18f415d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:32.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.378+0000 7f18f88dc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f40cb6c0 con 0x7f18f40b20e0 2023-10-06T02:18:32.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.378+0000 7f18f88dc700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f415e200 con 0x7f18f415d4d0 2023-10-06T02:18:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.378+0000 7f18f88dc700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f40ccb60 con 0x7f18f4159380 2023-10-06T02:18:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.379+0000 7f18f2d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18f415d4d0 0x7f18f415d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.379+0000 7f18f1d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f18f40b20e0 0x7f18f40b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50426/0 (socket says 172.21.15.6:50426) 2023-10-06T02:18:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.379+0000 7f18f1d9b700 1 -- 172.21.15.6:0/2070636868 learned_addr learned my addr 172.21.15.6:0/2070636868 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.379+0000 7f18f2d9d700 1 -- 172.21.15.6:0/2070636868 >> v2:172.21.15.175:3300/0 conn(0x7f18f4159380 msgr2=0x7f18f4159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.379+0000 7f18f259c700 1 --2- 172.21.15.6:0/2070636868 >> v2:172.21.15.175:3300/0 conn(0x7f18f4159380 0x7f18f4159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.379+0000 7f18f2d9d700 1 --2- 172.21.15.6:0/2070636868 >> v2:172.21.15.175:3300/0 conn(0x7f18f4159380 0x7f18f4159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.379+0000 7f18f2d9d700 1 -- 172.21.15.6:0/2070636868 >> v1:172.21.15.6:6789/0 conn(0x7f18f40b20e0 legacy=0x7f18f40b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.379+0000 7f18f159a700 1 -- 172.21.15.6:0/2070636868 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308005656 0 0) 0x7f18f40cb6c0 con 0x7f18f40b20e0 2023-10-06T02:18:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.379+0000 7f18f2d9d700 1 -- 172.21.15.6:0/2070636868 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f40c3ef0 con 0x7f18f415d4d0 2023-10-06T02:18:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.379+0000 7f18f2d9d700 1 --2- 172.21.15.6:0/2070636868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f415d4d0 0x7f18f415d930 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f18f4089550 tx=0x7f18e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995e05d1f22a8d90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.379+0000 7f18f159a700 1 -- 172.21.15.6:0/2070636868 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e400e070 con 0x7f18f415d4d0 2023-10-06T02:18:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.379+0000 7f18f159a700 1 -- 172.21.15.6:0/2070636868 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e400bbf0 con 0x7f18f415d4d0 2023-10-06T02:18:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.379+0000 7f18f159a700 1 -- 172.21.15.6:0/2070636868 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e4012430 con 0x7f18f415d4d0 2023-10-06T02:18:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.380+0000 7f18f88dc700 1 -- 172.21.15.6:0/2070636868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f415d4d0 msgr2=0x7f18f415d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.380+0000 7f18f88dc700 1 --2- 172.21.15.6:0/2070636868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f415d4d0 0x7f18f415d930 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f18f4089550 tx=0x7f18e4009780 comp rx=0 tx=0).stop 2023-10-06T02:18:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.380+0000 7f18f88dc700 1 -- 172.21.15.6:0/2070636868 shutdown_connections 2023-10-06T02:18:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.380+0000 7f18f88dc700 1 --2- 172.21.15.6:0/2070636868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f415d4d0 0x7f18f415d930 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.380+0000 7f18f88dc700 1 --2- 172.21.15.6:0/2070636868 >> v2:172.21.15.175:3300/0 conn(0x7f18f4159380 0x7f18f4159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.380+0000 7f18f88dc700 1 -- 172.21.15.6:0/2070636868 >> 172.21.15.6:0/2070636868 conn(0x7f18f4068680 msgr2=0x7f18f4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:32.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.380+0000 7f18f88dc700 1 -- 172.21.15.6:0/2070636868 shutdown_connections 2023-10-06T02:18:32.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.380+0000 7f18f88dc700 1 -- 172.21.15.6:0/2070636868 wait complete. 2023-10-06T02:18:32.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.381+0000 7f18f88dc700 1 Processor -- start 2023-10-06T02:18:32.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.381+0000 7f18f88dc700 1 -- start start 2023-10-06T02:18:32.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f88dc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18f40b20e0 0x7f18f415c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:32.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f88dc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18f4159380 0x7f18f4156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:32.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f88dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f415d4d0 0x7f18f40d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:32.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f88dc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f4159750 con 0x7f18f415d4d0 2023-10-06T02:18:32.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f88dc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f4159cd0 con 0x7f18f4159380 2023-10-06T02:18:32.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f88dc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f40ca270 con 0x7f18f40b20e0 2023-10-06T02:18:32.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f415d4d0 0x7f18f40d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:32.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f415d4d0 0x7f18f40d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51422/0 (socket says 172.21.15.6:51422) 2023-10-06T02:18:32.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f2d9d700 1 -- 172.21.15.6:0/1084086752 learned_addr learned my addr 172.21.15.6:0/1084086752 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:32.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f1d9b700 1 --2- 172.21.15.6:0/1084086752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18f4159380 0x7f18f4156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:32.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f259c700 1 --2- 172.21.15.6:0/1084086752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18f40b20e0 0x7f18f415c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:32.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f2d9d700 1 -- 172.21.15.6:0/1084086752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18f40b20e0 msgr2=0x7f18f415c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:32.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f2d9d700 1 --2- 172.21.15.6:0/1084086752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18f40b20e0 0x7f18f415c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f2d9d700 1 -- 172.21.15.6:0/1084086752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18f4159380 msgr2=0x7f18f4156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:32.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f2d9d700 1 --2- 172.21.15.6:0/1084086752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18f4159380 0x7f18f4156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f2d9d700 1 -- 172.21.15.6:0/1084086752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e4009a20 con 0x7f18f415d4d0 2023-10-06T02:18:32.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f1d9b700 1 --2- 172.21.15.6:0/1084086752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18f4159380 0x7f18f4156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:32.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18f2d9d700 1 --2- 172.21.15.6:0/1084086752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f415d4d0 0x7f18f40d00d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f18e4012560 tx=0x7f18e4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:32.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18ea7fc700 1 -- 172.21.15.6:0/1084086752 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e401b600 con 0x7f18f415d4d0 2023-10-06T02:18:32.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.382+0000 7f18ea7fc700 1 -- 172.21.15.6:0/1084086752 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e401b760 con 0x7f18f415d4d0 2023-10-06T02:18:32.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.383+0000 7f18f88dc700 1 -- 172.21.15.6:0/1084086752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f415c610 con 0x7f18f415d4d0 2023-10-06T02:18:32.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.383+0000 7f18ea7fc700 1 -- 172.21.15.6:0/1084086752 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e401bb20 con 0x7f18f415d4d0 2023-10-06T02:18:32.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.383+0000 7f18f88dc700 1 -- 172.21.15.6:0/1084086752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f40c96c0 con 0x7f18f415d4d0 2023-10-06T02:18:32.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.383+0000 7f18f88dc700 1 -- 172.21.15.6:0/1084086752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f4159e60 con 0x7f18f415d4d0 2023-10-06T02:18:32.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.384+0000 7f18ea7fc700 1 -- 172.21.15.6:0/1084086752 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18e40263f0 con 0x7f18f415d4d0 2023-10-06T02:18:32.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.384+0000 7f18ea7fc700 1 --2- 172.21.15.6:0/1084086752 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f18d4066f30 0x7f18d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:32.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.385+0000 7f18ea7fc700 1 -- 172.21.15.6:0/1084086752 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f18e4086c60 con 0x7f18f415d4d0 2023-10-06T02:18:32.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.385+0000 7f18f259c700 1 --2- 172.21.15.6:0/1084086752 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f18d4066f30 0x7f18d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:32.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.385+0000 7f18f259c700 1 --2- 172.21.15.6:0/1084086752 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f18d4066f30 0x7f18d40693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f18f40c3d40 tx=0x7f18ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:32.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.389+0000 7f18ea7fc700 1 -- 172.21.15.6:0/1084086752 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18e4053a40 con 0x7f18f415d4d0 2023-10-06T02:18:32.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.630+0000 7f18f88dc700 1 -- 172.21.15.6:0/1084086752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18f40cad90 con 0x7f18f415d4d0 2023-10-06T02:18:32.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.631+0000 7f18ea7fc700 1 -- 172.21.15.6:0/1084086752 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4590 (secure 0 0 0) 0x7f18e4057060 con 0x7f18f415d4d0 2023-10-06T02:18:32.631 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:32.631 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3433510267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3433510267},{"type":"v1","addr":"172.21.15.175:6836","nonce":3433510267}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3290404467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3290404467},{"type":"v1","addr":"172.21.15.175:6837","nonce":3290404467}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/4132952009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4132952009},{"type":"v1","addr":"172.21.15.6:6834","nonce":4132952009}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:17:43.404580+0000","modified":"2023-10-06T02:17:56.734938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/839986504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":839986504},{"type":"v1","addr":"172.21.15.6:6835","nonce":839986504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:18:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.633+0000 7f18f88dc700 1 -- 172.21.15.6:0/1084086752 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f18d4066f30 msgr2=0x7f18d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.633+0000 7f18f88dc700 1 --2- 172.21.15.6:0/1084086752 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f18d4066f30 0x7f18d40693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f18f40c3d40 tx=0x7f18ec008040 comp rx=0 tx=0).stop 2023-10-06T02:18:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.633+0000 7f18f88dc700 1 -- 172.21.15.6:0/1084086752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f415d4d0 msgr2=0x7f18f40d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.633+0000 7f18f88dc700 1 --2- 172.21.15.6:0/1084086752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f415d4d0 0x7f18f40d00d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f18e4012560 tx=0x7f18e4019000 comp rx=0 tx=0).stop 2023-10-06T02:18:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.633+0000 7f18f88dc700 1 -- 172.21.15.6:0/1084086752 shutdown_connections 2023-10-06T02:18:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.633+0000 7f18f88dc700 1 --2- 172.21.15.6:0/1084086752 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f18d4066f30 0x7f18d40693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.633+0000 7f18f88dc700 1 --2- 172.21.15.6:0/1084086752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f415d4d0 0x7f18f40d00d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.633+0000 7f18f88dc700 1 --2- 172.21.15.6:0/1084086752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18f40b20e0 0x7f18f415c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.633+0000 7f18f88dc700 1 --2- 172.21.15.6:0/1084086752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18f4159380 0x7f18f4156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.633+0000 7f18f88dc700 1 -- 172.21.15.6:0/1084086752 >> 172.21.15.6:0/1084086752 conn(0x7f18f4068680 msgr2=0x7f18f40b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.633+0000 7f18f88dc700 1 -- 172.21.15.6:0/1084086752 shutdown_connections 2023-10-06T02:18:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.633+0000 7f18f88dc700 1 -- 172.21.15.6:0/1084086752 wait complete. 2023-10-06T02:18:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-10-06T02:18:32.646 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:18:32.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.765+0000 7fae6ecd4700 1 Processor -- start 2023-10-06T02:18:32.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.765+0000 7fae6ecd4700 1 -- start start 2023-10-06T02:18:32.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.765+0000 7fae6ecd4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fae680af4e0 0x7fae680b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:32.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.765+0000 7fae6ecd4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae680af8b0 0x7fae680b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:32.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.765+0000 7fae6ecd4700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6815e190 con 0x7fae6815d460 2023-10-06T02:18:32.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.765+0000 7fae6ecd4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae680b1910 con 0x7fae680af4e0 2023-10-06T02:18:32.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.765+0000 7fae6ecd4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6815dfb0 con 0x7fae680af8b0 2023-10-06T02:18:32.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.766+0000 7fae6ca70700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fae680af4e0 0x7fae680b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.766+0000 7fae67fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae680af8b0 0x7fae680b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.766+0000 7fae6d271700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fae6815d460 0x7fae6815d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:55748/0 (socket says 172.21.15.6:55748) 2023-10-06T02:18:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.766+0000 7fae6d271700 1 -- 172.21.15.6:0/2646808685 learned_addr learned my addr 172.21.15.6:0/2646808685 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.766+0000 7fae67fff700 1 -- 172.21.15.6:0/2646808685 >> v2:172.21.15.175:3300/0 conn(0x7fae680af4e0 msgr2=0x7fae680b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:32.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.766+0000 7fae67fff700 1 --2- 172.21.15.6:0/2646808685 >> v2:172.21.15.175:3300/0 conn(0x7fae680af4e0 0x7fae680b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.766+0000 7fae67fff700 1 -- 172.21.15.6:0/2646808685 >> v1:172.21.15.175:6789/0 conn(0x7fae6815d460 legacy=0x7fae6815d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.766+0000 7fae67fff700 1 -- 172.21.15.6:0/2646808685 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae680cb650 con 0x7fae680af8b0 2023-10-06T02:18:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.766+0000 7fae67fff700 1 --2- 172.21.15.6:0/2646808685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae680af8b0 0x7fae680b2620 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fae58009e60 tx=0x7fae58009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce6ca01d415b977 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.766+0000 7fae677fe700 1 -- 172.21.15.6:0/2646808685 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5800e070 con 0x7fae680af8b0 2023-10-06T02:18:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.767+0000 7fae677fe700 1 -- 172.21.15.6:0/2646808685 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5800bb60 con 0x7fae680af8b0 2023-10-06T02:18:32.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.767+0000 7fae677fe700 1 -- 172.21.15.6:0/2646808685 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58012430 con 0x7fae680af8b0 2023-10-06T02:18:32.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.767+0000 7fae6ecd4700 1 -- 172.21.15.6:0/2646808685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae680af8b0 msgr2=0x7fae680b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:32.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.767+0000 7fae6ecd4700 1 --2- 172.21.15.6:0/2646808685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae680af8b0 0x7fae680b2620 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fae58009e60 tx=0x7fae58009780 comp rx=0 tx=0).stop 2023-10-06T02:18:32.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.767+0000 7fae6ecd4700 1 -- 172.21.15.6:0/2646808685 shutdown_connections 2023-10-06T02:18:32.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.767+0000 7fae6ecd4700 1 --2- 172.21.15.6:0/2646808685 >> v2:172.21.15.175:3300/0 conn(0x7fae680af4e0 0x7fae680b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.767+0000 7fae6ecd4700 1 --2- 172.21.15.6:0/2646808685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae680af8b0 0x7fae680b2620 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.767+0000 7fae6ecd4700 1 -- 172.21.15.6:0/2646808685 >> 172.21.15.6:0/2646808685 conn(0x7fae68068680 msgr2=0x7fae68068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:32.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.767+0000 7fae6ecd4700 1 -- 172.21.15.6:0/2646808685 shutdown_connections 2023-10-06T02:18:32.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.767+0000 7fae6ecd4700 1 -- 172.21.15.6:0/2646808685 wait complete. 2023-10-06T02:18:32.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.768+0000 7fae6ecd4700 1 Processor -- start 2023-10-06T02:18:32.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.768+0000 7fae6ecd4700 1 -- start start 2023-10-06T02:18:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.769+0000 7fae6ecd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae680af4e0 0x7fae68158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.769+0000 7fae6ecd4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae680af8b0 0x7fae680c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.769+0000 7fae6ecd4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae6815d460 0x7fae680c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.769+0000 7fae6ecd4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae680c90f0 con 0x7fae680af4e0 2023-10-06T02:18:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.769+0000 7fae6ecd4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae680cf470 con 0x7fae680af8b0 2023-10-06T02:18:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.769+0000 7fae6ecd4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae680cf9f0 con 0x7fae6815d460 2023-10-06T02:18:32.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.769+0000 7fae6ca70700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae680af4e0 0x7fae68158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:32.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.769+0000 7fae6ca70700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae680af4e0 0x7fae68158330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51434/0 (socket says 172.21.15.6:51434) 2023-10-06T02:18:32.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.769+0000 7fae6ca70700 1 -- 172.21.15.6:0/1946433376 learned_addr learned my addr 172.21.15.6:0/1946433376 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:32.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.770+0000 7fae67fff700 1 --2- 172.21.15.6:0/1946433376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae680af8b0 0x7fae680c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:32.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.770+0000 7fae6d271700 1 --2- 172.21.15.6:0/1946433376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae6815d460 0x7fae680c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:32.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.770+0000 7fae6ca70700 1 -- 172.21.15.6:0/1946433376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae6815d460 msgr2=0x7fae680c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:32.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.770+0000 7fae6ca70700 1 --2- 172.21.15.6:0/1946433376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae6815d460 0x7fae680c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.770+0000 7fae6ca70700 1 -- 172.21.15.6:0/1946433376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae680af8b0 msgr2=0x7fae680c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:32.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.770+0000 7fae6ca70700 1 --2- 172.21.15.6:0/1946433376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae680af8b0 0x7fae680c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.770+0000 7fae6ca70700 1 -- 172.21.15.6:0/1946433376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae58009a20 con 0x7fae680af4e0 2023-10-06T02:18:32.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.770+0000 7fae67fff700 1 --2- 172.21.15.6:0/1946433376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae680af8b0 0x7fae680c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:32.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.770+0000 7fae6d271700 1 --2- 172.21.15.6:0/1946433376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae6815d460 0x7fae680c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:32.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.770+0000 7fae6ca70700 1 --2- 172.21.15.6:0/1946433376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae680af4e0 0x7fae68158330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fae6000e930 tx=0x7fae600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:32.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.770+0000 7fae64ff9700 1 -- 172.21.15.6:0/1946433376 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6000eed0 con 0x7fae680af4e0 2023-10-06T02:18:32.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.770+0000 7fae64ff9700 1 -- 172.21.15.6:0/1946433376 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6000c7f0 con 0x7fae680af4e0 2023-10-06T02:18:32.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.770+0000 7fae64ff9700 1 -- 172.21.15.6:0/1946433376 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6000cb90 con 0x7fae680af4e0 2023-10-06T02:18:32.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.770+0000 7fae6ecd4700 1 -- 172.21.15.6:0/1946433376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae680c8b30 con 0x7fae680af4e0 2023-10-06T02:18:32.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.770+0000 7fae6ecd4700 1 -- 172.21.15.6:0/1946433376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae680cf680 con 0x7fae680af4e0 2023-10-06T02:18:32.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.771+0000 7fae6ecd4700 1 -- 172.21.15.6:0/1946433376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae680ce110 con 0x7fae680af4e0 2023-10-06T02:18:32.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.771+0000 7fae64ff9700 1 -- 172.21.15.6:0/1946433376 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae60013470 con 0x7fae680af4e0 2023-10-06T02:18:32.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.772+0000 7fae64ff9700 1 --2- 172.21.15.6:0/1946433376 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fae48066f60 0x7fae48069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:32.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.772+0000 7fae64ff9700 1 -- 172.21.15.6:0/1946433376 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fae60084b30 con 0x7fae680af4e0 2023-10-06T02:18:32.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.772+0000 7fae67fff700 1 --2- 172.21.15.6:0/1946433376 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fae48066f60 0x7fae48069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:32.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.772+0000 7fae67fff700 1 --2- 172.21.15.6:0/1946433376 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fae48066f60 0x7fae48069410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fae68151db0 tx=0x7fae58019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:32.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.776+0000 7fae64ff9700 1 -- 172.21.15.6:0/1946433376 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae60051910 con 0x7fae680af4e0 2023-10-06T02:18:32.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.973+0000 7fae6ecd4700 1 -- 172.21.15.6:0/1946433376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae680b0910 con 0x7fae680af4e0 2023-10-06T02:18:32.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.974+0000 7fae64ff9700 1 -- 172.21.15.6:0/1946433376 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18754 (secure 0 0 0) 0x7fae60054f30 con 0x7fae680af4e0 2023-10-06T02:18:32.976 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:32.977 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:18:31.879293+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:17:41.126402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:17:42.378468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:17:46.053654+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.28","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:18:32.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.976+0000 7fae6ecd4700 1 -- 172.21.15.6:0/1946433376 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fae48066f60 msgr2=0x7fae48069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:32.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.976+0000 7fae6ecd4700 1 --2- 172.21.15.6:0/1946433376 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fae48066f60 0x7fae48069410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fae68151db0 tx=0x7fae58019000 comp rx=0 tx=0).stop 2023-10-06T02:18:32.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.976+0000 7fae6ecd4700 1 -- 172.21.15.6:0/1946433376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae680af4e0 msgr2=0x7fae68158330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:32.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.976+0000 7fae6ecd4700 1 --2- 172.21.15.6:0/1946433376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae680af4e0 0x7fae68158330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fae6000e930 tx=0x7fae600091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.976+0000 7fae6ecd4700 1 -- 172.21.15.6:0/1946433376 shutdown_connections 2023-10-06T02:18:32.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.976+0000 7fae6ecd4700 1 --2- 172.21.15.6:0/1946433376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae6815d460 0x7fae680c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.976+0000 7fae6ecd4700 1 --2- 172.21.15.6:0/1946433376 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fae48066f60 0x7fae48069410 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.976+0000 7fae6ecd4700 1 --2- 172.21.15.6:0/1946433376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae680af4e0 0x7fae68158330 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.976+0000 7fae6ecd4700 1 --2- 172.21.15.6:0/1946433376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae680af8b0 0x7fae680c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.976+0000 7fae6ecd4700 1 -- 172.21.15.6:0/1946433376 >> 172.21.15.6:0/1946433376 conn(0x7fae68068680 msgr2=0x7fae6815b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.976+0000 7fae6ecd4700 1 -- 172.21.15.6:0/1946433376 shutdown_connections 2023-10-06T02:18:32.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:32.976+0000 7fae6ecd4700 1 -- 172.21.15.6:0/1946433376 wait complete. 2023-10-06T02:18:32.988 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:18:33.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.107+0000 7f1cc850f700 1 Processor -- start 2023-10-06T02:18:33.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.107+0000 7f1cc850f700 1 -- start start 2023-10-06T02:18:33.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.108+0000 7f1cc850f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cc015cae0 0x7f1cc00c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:33.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.108+0000 7f1cc850f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1cc006a910 0x7f1cc006ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.108+0000 7f1cc850f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1cc00c2e90 0x7f1cc00c3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.108+0000 7f1cc850f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc006a1a0 con 0x7f1cc006a910 2023-10-06T02:18:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.108+0000 7f1cc850f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc006a480 con 0x7f1cc00c2e90 2023-10-06T02:18:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.108+0000 7f1cc850f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00c3f40 con 0x7f1cc015cae0 2023-10-06T02:18:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.109+0000 7f1cc5aaa700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1cc006a910 0x7f1cc006ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.109+0000 7f1cc5aaa700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1cc006a910 0x7f1cc006ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51448/0 (socket says 172.21.15.6:51448) 2023-10-06T02:18:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.109+0000 7f1cc5aaa700 1 -- 172.21.15.6:0/2665303685 learned_addr learned my addr 172.21.15.6:0/2665303685 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.109+0000 7f1cc62ab700 1 --2- 172.21.15.6:0/2665303685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cc015cae0 0x7f1cc00c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.109+0000 7f1cc6aac700 1 --2- 172.21.15.6:0/2665303685 >> v2:172.21.15.175:3300/0 conn(0x7f1cc00c2e90 0x7f1cc00c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.109+0000 7f1cc5aaa700 1 -- 172.21.15.6:0/2665303685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cc015cae0 msgr2=0x7f1cc00c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.109+0000 7f1cc5aaa700 1 --2- 172.21.15.6:0/2665303685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cc015cae0 0x7f1cc00c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.109+0000 7f1cc5aaa700 1 -- 172.21.15.6:0/2665303685 >> v2:172.21.15.175:3300/0 conn(0x7f1cc00c2e90 msgr2=0x7f1cc00c3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.109+0000 7f1cc5aaa700 1 --2- 172.21.15.6:0/2665303685 >> v2:172.21.15.175:3300/0 conn(0x7f1cc00c2e90 0x7f1cc00c3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.109+0000 7f1cc5aaa700 1 -- 172.21.15.6:0/2665303685 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc00c4220 con 0x7f1cc006a910 2023-10-06T02:18:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.109+0000 7f1cc62ab700 1 --2- 172.21.15.6:0/2665303685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cc015cae0 0x7f1cc00c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.109+0000 7f1cc5aaa700 1 --2- 172.21.15.6:0/2665303685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cc006a910 0x7f1cc006ad60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0087570 tx=0x7f1cb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829cf9669501dca6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.109+0000 7f1cc52a9700 1 -- 172.21.15.6:0/2665303685 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb400b860 con 0x7f1cc006a910 2023-10-06T02:18:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.109+0000 7f1cc52a9700 1 -- 172.21.15.6:0/2665303685 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb400b9c0 con 0x7f1cc006a910 2023-10-06T02:18:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.109+0000 7f1cc52a9700 1 -- 172.21.15.6:0/2665303685 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb400bd60 con 0x7f1cc006a910 2023-10-06T02:18:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.110+0000 7f1cc850f700 1 -- 172.21.15.6:0/2665303685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cc006a910 msgr2=0x7f1cc006ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.110+0000 7f1cc850f700 1 --2- 172.21.15.6:0/2665303685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cc006a910 0x7f1cc006ad60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0087570 tx=0x7f1cb4009250 comp rx=0 tx=0).stop 2023-10-06T02:18:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.110+0000 7f1cc850f700 1 -- 172.21.15.6:0/2665303685 shutdown_connections 2023-10-06T02:18:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.110+0000 7f1cc850f700 1 --2- 172.21.15.6:0/2665303685 >> v2:172.21.15.175:3300/0 conn(0x7f1cc00c2e90 0x7f1cc00c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.110+0000 7f1cc850f700 1 --2- 172.21.15.6:0/2665303685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cc015cae0 0x7f1cc00c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.110+0000 7f1cc850f700 1 --2- 172.21.15.6:0/2665303685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cc006a910 0x7f1cc006ad60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.110+0000 7f1cc850f700 1 -- 172.21.15.6:0/2665303685 >> 172.21.15.6:0/2665303685 conn(0x7f1cc0067910 msgr2=0x7f1cc00ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.110+0000 7f1cc850f700 1 -- 172.21.15.6:0/2665303685 shutdown_connections 2023-10-06T02:18:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.110+0000 7f1cc850f700 1 -- 172.21.15.6:0/2665303685 wait complete. 2023-10-06T02:18:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.111+0000 7f1cc850f700 1 Processor -- start 2023-10-06T02:18:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.111+0000 7f1cc850f700 1 -- start start 2023-10-06T02:18:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cc850f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cc006a910 0x7f1cc00c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cc850f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cc00c2e90 0x7f1cc0169940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cc850f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cc015cae0 0x7f1cc015a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cc850f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc016a950 con 0x7f1cc006a910 2023-10-06T02:18:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cc850f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc0169e80 con 0x7f1cc015cae0 2023-10-06T02:18:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cc850f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc016a0b0 con 0x7f1cc00c2e90 2023-10-06T02:18:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cc62ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cc006a910 0x7f1cc00c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cc62ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cc006a910 0x7f1cc00c54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51458/0 (socket says 172.21.15.6:51458) 2023-10-06T02:18:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cc62ab700 1 -- 172.21.15.6:0/302416609 learned_addr learned my addr 172.21.15.6:0/302416609 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cc5aaa700 1 --2- 172.21.15.6:0/302416609 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cc00c2e90 0x7f1cc0169940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cc6aac700 1 --2- 172.21.15.6:0/302416609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cc015cae0 0x7f1cc015a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cc62ab700 1 -- 172.21.15.6:0/302416609 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cc00c2e90 msgr2=0x7f1cc0169940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cc62ab700 1 --2- 172.21.15.6:0/302416609 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cc00c2e90 0x7f1cc0169940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cc62ab700 1 -- 172.21.15.6:0/302416609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cc015cae0 msgr2=0x7f1cc015a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cc62ab700 1 --2- 172.21.15.6:0/302416609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cc015cae0 0x7f1cc015a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cc62ab700 1 -- 172.21.15.6:0/302416609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb40094f0 con 0x7f1cc006a910 2023-10-06T02:18:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cc62ab700 1 --2- 172.21.15.6:0/302416609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cc006a910 0x7f1cc00c54c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000d890 tx=0x7f1cb0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.112+0000 7f1cbe7fc700 1 -- 172.21.15.6:0/302416609 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0005a00 con 0x7f1cc006a910 2023-10-06T02:18:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.113+0000 7f1cbe7fc700 1 -- 172.21.15.6:0/302416609 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb0005b60 con 0x7f1cc006a910 2023-10-06T02:18:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.113+0000 7f1cc850f700 1 -- 172.21.15.6:0/302416609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc016a390 con 0x7f1cc006a910 2023-10-06T02:18:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.113+0000 7f1cbe7fc700 1 -- 172.21.15.6:0/302416609 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb00125f0 con 0x7f1cc006a910 2023-10-06T02:18:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.113+0000 7f1cc850f700 1 -- 172.21.15.6:0/302416609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc00b2590 con 0x7f1cc006a910 2023-10-06T02:18:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.114+0000 7f1cc850f700 1 -- 172.21.15.6:0/302416609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc00b2900 con 0x7f1cc006a910 2023-10-06T02:18:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.114+0000 7f1cbe7fc700 1 -- 172.21.15.6:0/302416609 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1cb00129a0 con 0x7f1cc006a910 2023-10-06T02:18:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.114+0000 7f1cbe7fc700 1 --2- 172.21.15.6:0/302416609 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1cac066f30 0x7f1cac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.115+0000 7f1cbe7fc700 1 -- 172.21.15.6:0/302416609 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f1cb0084b10 con 0x7f1cc006a910 2023-10-06T02:18:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.115+0000 7f1cc5aaa700 1 --2- 172.21.15.6:0/302416609 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1cac066f30 0x7f1cac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.115+0000 7f1cc5aaa700 1 --2- 172.21.15.6:0/302416609 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1cac066f30 0x7f1cac0693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0087570 tx=0x7f1cb4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.119+0000 7f1cbe7fc700 1 -- 172.21.15.6:0/302416609 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cb00519a0 con 0x7f1cc006a910 2023-10-06T02:18:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.357+0000 7f1cc850f700 1 -- 172.21.15.6:0/302416609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1cc006e590 con 0x7f1cc006a910 2023-10-06T02:18:33.358 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:18:33.358+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:18:33.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.362+0000 7f1cbe7fc700 1 -- 172.21.15.6:0/302416609 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1cb0054fc0 con 0x7f1cc006a910 2023-10-06T02:18:33.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.364+0000 7f1cc850f700 1 -- 172.21.15.6:0/302416609 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1cac066f30 msgr2=0x7f1cac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:33.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.364+0000 7f1cc850f700 1 --2- 172.21.15.6:0/302416609 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1cac066f30 0x7f1cac0693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0087570 tx=0x7f1cb4017000 comp rx=0 tx=0).stop 2023-10-06T02:18:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.364+0000 7f1cc850f700 1 -- 172.21.15.6:0/302416609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cc006a910 msgr2=0x7f1cc00c54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.364+0000 7f1cc850f700 1 --2- 172.21.15.6:0/302416609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cc006a910 0x7f1cc00c54c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000d890 tx=0x7f1cb0008040 comp rx=0 tx=0).stop 2023-10-06T02:18:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.364+0000 7f1cc850f700 1 -- 172.21.15.6:0/302416609 shutdown_connections 2023-10-06T02:18:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.364+0000 7f1cc850f700 1 --2- 172.21.15.6:0/302416609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cc015cae0 0x7f1cc015a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.364+0000 7f1cc850f700 1 --2- 172.21.15.6:0/302416609 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1cac066f30 0x7f1cac0693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.364+0000 7f1cc850f700 1 --2- 172.21.15.6:0/302416609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cc006a910 0x7f1cc00c54c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.364+0000 7f1cc850f700 1 --2- 172.21.15.6:0/302416609 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cc00c2e90 0x7f1cc0169940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.364+0000 7f1cc850f700 1 -- 172.21.15.6:0/302416609 >> 172.21.15.6:0/302416609 conn(0x7f1cc0067910 msgr2=0x7f1cc00c3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.364+0000 7f1cc850f700 1 -- 172.21.15.6:0/302416609 shutdown_connections 2023-10-06T02:18:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.364+0000 7f1cc850f700 1 -- 172.21.15.6:0/302416609 wait complete. 2023-10-06T02:18:33.366 INFO:tasks.ceph.mds.a.smithi006.stderr: -3981> 2023-10-06T02:17:48.057+0000 7f09b317c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:18:33.366 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:18:33.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:18:33.394 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:18:33.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.502+0000 7fe483198700 1 Processor -- start 2023-10-06T02:18:33.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.502+0000 7fe483198700 1 -- start start 2023-10-06T02:18:33.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.503+0000 7fe483198700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe47c086ff0 0x7fe47c087440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:33.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.503+0000 7fe483198700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe47c0b21b0 0x7fe47c0b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:33.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.503+0000 7fe483198700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c087980 con 0x7fe47c15a030 2023-10-06T02:18:33.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.503+0000 7fe483198700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47c0b0cf0 con 0x7fe47c0b21b0 2023-10-06T02:18:33.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.503+0000 7fe483198700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0b2b30 con 0x7fe47c086ff0 2023-10-06T02:18:33.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.503+0000 7fe47bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe47c086ff0 0x7fe47c087440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:33.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.503+0000 7fe481735700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe47c0b21b0 0x7fe47c0b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:33.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.503+0000 7fe481735700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe47c0b21b0 0x7fe47c0b25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:48030/0 (socket says 172.21.15.6:48030) 2023-10-06T02:18:33.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.503+0000 7fe47bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe47c086ff0 0x7fe47c087440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:39876/0 (socket says 172.21.15.6:39876) 2023-10-06T02:18:33.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.503+0000 7fe481735700 1 -- 172.21.15.6:0/1281061058 learned_addr learned my addr 172.21.15.6:0/1281061058 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:33.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.503+0000 7fe480f34700 1 --1- 172.21.15.6:0/1281061058 >> v1:172.21.15.175:6789/0 conn(0x7fe47c15a030 0x7fe47c15a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:55764/0 (socket says 172.21.15.6:55764) 2023-10-06T02:18:33.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.503+0000 7fe47bfff700 1 -- 172.21.15.6:0/1281061058 >> v2:172.21.15.175:3300/0 conn(0x7fe47c0b21b0 msgr2=0x7fe47c0b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:33.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.503+0000 7fe47bfff700 1 --2- 172.21.15.6:0/1281061058 >> v2:172.21.15.175:3300/0 conn(0x7fe47c0b21b0 0x7fe47c0b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:33.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.504+0000 7fe47bfff700 1 -- 172.21.15.6:0/1281061058 >> v1:172.21.15.175:6789/0 conn(0x7fe47c15a030 legacy=0x7fe47c15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:33.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.504+0000 7fe47bfff700 1 -- 172.21.15.6:0/1281061058 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c0afc50 con 0x7fe47c086ff0 2023-10-06T02:18:33.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.504+0000 7fe47b7fe700 1 -- 172.21.15.6:0/1281061058 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125379196 0 0) 0x7fe47c087980 con 0x7fe47c15a030 2023-10-06T02:18:33.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.504+0000 7fe481735700 1 --2- 172.21.15.6:0/1281061058 >> v2:172.21.15.175:3300/0 conn(0x7fe47c0b21b0 0x7fe47c0b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:33.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.504+0000 7fe47bfff700 1 --2- 172.21.15.6:0/1281061058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe47c086ff0 0x7fe47c087440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009e60 tx=0x7fe46c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11ea9374b7439134 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:33.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.504+0000 7fe47b7fe700 1 -- 172.21.15.6:0/1281061058 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c00e070 con 0x7fe47c086ff0 2023-10-06T02:18:33.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.504+0000 7fe47b7fe700 1 -- 172.21.15.6:0/1281061058 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c00bb60 con 0x7fe47c086ff0 2023-10-06T02:18:33.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.504+0000 7fe47b7fe700 1 -- 172.21.15.6:0/1281061058 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c012430 con 0x7fe47c086ff0 2023-10-06T02:18:33.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.504+0000 7fe483198700 1 -- 172.21.15.6:0/1281061058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe47c086ff0 msgr2=0x7fe47c087440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:33.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.504+0000 7fe483198700 1 --2- 172.21.15.6:0/1281061058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe47c086ff0 0x7fe47c087440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009e60 tx=0x7fe46c009780 comp rx=0 tx=0).stop 2023-10-06T02:18:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.504+0000 7fe483198700 1 -- 172.21.15.6:0/1281061058 shutdown_connections 2023-10-06T02:18:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.504+0000 7fe483198700 1 --2- 172.21.15.6:0/1281061058 >> v2:172.21.15.175:3300/0 conn(0x7fe47c0b21b0 0x7fe47c0b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.504+0000 7fe483198700 1 --2- 172.21.15.6:0/1281061058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe47c086ff0 0x7fe47c087440 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.504+0000 7fe483198700 1 -- 172.21.15.6:0/1281061058 >> 172.21.15.6:0/1281061058 conn(0x7fe47c068680 msgr2=0x7fe47c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.505+0000 7fe483198700 1 -- 172.21.15.6:0/1281061058 shutdown_connections 2023-10-06T02:18:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.505+0000 7fe483198700 1 -- 172.21.15.6:0/1281061058 wait complete. 2023-10-06T02:18:33.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.506+0000 7fe483198700 1 Processor -- start 2023-10-06T02:18:33.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.506+0000 7fe483198700 1 -- start start 2023-10-06T02:18:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.506+0000 7fe483198700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe47c086ff0 0x7fe47c156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe483198700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe47c0b21b0 0x7fe47c0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe483198700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe47c15a030 0x7fe47c16d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe483198700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0c40c0 con 0x7fe47c0b21b0 2023-10-06T02:18:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe483198700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0c4680 con 0x7fe47c15a030 2023-10-06T02:18:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe483198700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0c8940 con 0x7fe47c086ff0 2023-10-06T02:18:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe47bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe47c0b21b0 0x7fe47c0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe47bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe47c0b21b0 0x7fe47c0c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51482/0 (socket says 172.21.15.6:51482) 2023-10-06T02:18:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe47bfff700 1 -- 172.21.15.6:0/209594464 learned_addr learned my addr 172.21.15.6:0/209594464 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe480f34700 1 --2- 172.21.15.6:0/209594464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe47c086ff0 0x7fe47c156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe481735700 1 --2- 172.21.15.6:0/209594464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe47c15a030 0x7fe47c16d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe47bfff700 1 -- 172.21.15.6:0/209594464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe47c086ff0 msgr2=0x7fe47c156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe47bfff700 1 --2- 172.21.15.6:0/209594464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe47c086ff0 0x7fe47c156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe47bfff700 1 -- 172.21.15.6:0/209594464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe47c15a030 msgr2=0x7fe47c16d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe47bfff700 1 --2- 172.21.15.6:0/209594464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe47c15a030 0x7fe47c16d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe47bfff700 1 -- 172.21.15.6:0/209594464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4640094f0 con 0x7fe47c0b21b0 2023-10-06T02:18:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe481735700 1 --2- 172.21.15.6:0/209594464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe47c15a030 0x7fe47c16d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe47bfff700 1 --2- 172.21.15.6:0/209594464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe47c0b21b0 0x7fe47c0c7f80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00b6c0 tx=0x7fe46c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe478ff9700 1 -- 172.21.15.6:0/209594464 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c012d60 con 0x7fe47c0b21b0 2023-10-06T02:18:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe478ff9700 1 -- 172.21.15.6:0/209594464 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c027470 con 0x7fe47c0b21b0 2023-10-06T02:18:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe478ff9700 1 -- 172.21.15.6:0/209594464 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c027830 con 0x7fe47c0b21b0 2023-10-06T02:18:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.507+0000 7fe483198700 1 -- 172.21.15.6:0/209594464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe46c009a20 con 0x7fe47c0b21b0 2023-10-06T02:18:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.508+0000 7fe483198700 1 -- 172.21.15.6:0/209594464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c0c4310 con 0x7fe47c0b21b0 2023-10-06T02:18:33.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.508+0000 7fe483198700 1 -- 172.21.15.6:0/209594464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47c088700 con 0x7fe47c0b21b0 2023-10-06T02:18:33.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.509+0000 7fe478ff9700 1 -- 172.21.15.6:0/209594464 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe46c024070 con 0x7fe47c0b21b0 2023-10-06T02:18:33.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.509+0000 7fe478ff9700 1 --2- 172.21.15.6:0/209594464 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe45c066f30 0x7fe45c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:33.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.509+0000 7fe478ff9700 1 -- 172.21.15.6:0/209594464 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6953+0+0 (secure 0 0 0) 0x7fe46c086fc0 con 0x7fe47c0b21b0 2023-10-06T02:18:33.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.510+0000 7fe480f34700 1 --2- 172.21.15.6:0/209594464 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe45c066f30 0x7fe45c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:33.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.510+0000 7fe480f34700 1 --2- 172.21.15.6:0/209594464 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe45c066f30 0x7fe45c0693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe474007180 tx=0x7fe474007ef0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:33.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.514+0000 7fe478ff9700 1 -- 172.21.15.6:0/209594464 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe46c0b85a0 con 0x7fe47c0b21b0 2023-10-06T02:18:33.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:33.752+0000 7fe483198700 1 -- 172.21.15.6:0/209594464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe47c0aff30 con 0x7fe47c0b21b0 2023-10-06T02:18:34.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.362+0000 7fe478ff9700 1 -- 172.21.15.6:0/209594464 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe46c053d50 con 0x7fe47c0b21b0 2023-10-06T02:18:34.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.365+0000 7fe483198700 1 -- 172.21.15.6:0/209594464 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe45c066f30 msgr2=0x7fe45c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:34.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.365+0000 7fe483198700 1 --2- 172.21.15.6:0/209594464 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe45c066f30 0x7fe45c0693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe474007180 tx=0x7fe474007ef0 comp rx=0 tx=0).stop 2023-10-06T02:18:34.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.365+0000 7fe483198700 1 -- 172.21.15.6:0/209594464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe47c0b21b0 msgr2=0x7fe47c0c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:34.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.365+0000 7fe483198700 1 --2- 172.21.15.6:0/209594464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe47c0b21b0 0x7fe47c0c7f80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00b6c0 tx=0x7fe46c019000 comp rx=0 tx=0).stop 2023-10-06T02:18:34.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.365+0000 7fe483198700 1 -- 172.21.15.6:0/209594464 shutdown_connections 2023-10-06T02:18:34.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.365+0000 7fe483198700 1 --2- 172.21.15.6:0/209594464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe47c15a030 0x7fe47c16d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:34.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.365+0000 7fe483198700 1 --2- 172.21.15.6:0/209594464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe47c086ff0 0x7fe47c156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:34.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.365+0000 7fe483198700 1 --2- 172.21.15.6:0/209594464 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe45c066f30 0x7fe45c0693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:34.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.365+0000 7fe483198700 1 --2- 172.21.15.6:0/209594464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe47c0b21b0 0x7fe47c0c7f80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:34.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.365+0000 7fe483198700 1 -- 172.21.15.6:0/209594464 >> 172.21.15.6:0/209594464 conn(0x7fe47c068680 msgr2=0x7fe47c0cafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:34.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.365+0000 7fe483198700 1 -- 172.21.15.6:0/209594464 shutdown_connections 2023-10-06T02:18:34.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.365+0000 7fe483198700 1 -- 172.21.15.6:0/209594464 wait complete. 2023-10-06T02:18:34.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:18:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.546+0000 7f698160c700 1 Processor -- start 2023-10-06T02:18:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.546+0000 7f698160c700 1 -- start start 2023-10-06T02:18:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f698160c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f697c1598b0 0x7f697c0afef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f698160c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f697c15b940 0x7f697c159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f698160c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697c0afa60 con 0x7f697c0b0430 2023-10-06T02:18:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f698160c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c0af440 con 0x7f697c15b940 2023-10-06T02:18:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f698160c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c15ab00 con 0x7f697c1598b0 2023-10-06T02:18:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f697b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f697c15b940 0x7f697c159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f697b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f697c15b940 0x7f697c159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51484/0 (socket says 172.21.15.6:51484) 2023-10-06T02:18:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f697a7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f697c0b0430 0x7f697c15b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50442/0 (socket says 172.21.15.6:50442) 2023-10-06T02:18:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f697b7fe700 1 -- 172.21.15.6:0/3716571916 learned_addr learned my addr 172.21.15.6:0/3716571916 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f697affd700 1 --2- 172.21.15.6:0/3716571916 >> v2:172.21.15.175:3300/0 conn(0x7f697c1598b0 0x7f697c0afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f697b7fe700 1 -- 172.21.15.6:0/3716571916 >> v2:172.21.15.175:3300/0 conn(0x7f697c1598b0 msgr2=0x7f697c0afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f697b7fe700 1 --2- 172.21.15.6:0/3716571916 >> v2:172.21.15.175:3300/0 conn(0x7f697c1598b0 0x7f697c0afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f697b7fe700 1 -- 172.21.15.6:0/3716571916 >> v1:172.21.15.6:6789/0 conn(0x7f697c0b0430 legacy=0x7f697c15b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f697b7fe700 1 -- 172.21.15.6:0/3716571916 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c15ade0 con 0x7f697c15b940 2023-10-06T02:18:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f6979ffb700 1 -- 172.21.15.6:0/3716571916 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838144485 0 0) 0x7f697c0afa60 con 0x7f697c0b0430 2023-10-06T02:18:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f697b7fe700 1 --2- 172.21.15.6:0/3716571916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f697c15b940 0x7f697c159c80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f697c0b0b80 tx=0x7f696c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed2424e00b67c68 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f6979ffb700 1 -- 172.21.15.6:0/3716571916 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c00e070 con 0x7f697c15b940 2023-10-06T02:18:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.547+0000 7f6979ffb700 1 -- 172.21.15.6:0/3716571916 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c00ba20 con 0x7f697c15b940 2023-10-06T02:18:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.548+0000 7f6979ffb700 1 -- 172.21.15.6:0/3716571916 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c0092e0 con 0x7f697c15b940 2023-10-06T02:18:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.548+0000 7f698160c700 1 -- 172.21.15.6:0/3716571916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f697c15b940 msgr2=0x7f697c159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.548+0000 7f698160c700 1 --2- 172.21.15.6:0/3716571916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f697c15b940 0x7f697c159c80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f697c0b0b80 tx=0x7f696c009840 comp rx=0 tx=0).stop 2023-10-06T02:18:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.548+0000 7f698160c700 1 -- 172.21.15.6:0/3716571916 shutdown_connections 2023-10-06T02:18:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.548+0000 7f698160c700 1 --2- 172.21.15.6:0/3716571916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f697c15b940 0x7f697c159c80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.548+0000 7f698160c700 1 --2- 172.21.15.6:0/3716571916 >> v2:172.21.15.175:3300/0 conn(0x7f697c1598b0 0x7f697c0afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.548+0000 7f698160c700 1 -- 172.21.15.6:0/3716571916 >> 172.21.15.6:0/3716571916 conn(0x7f697c067910 msgr2=0x7f697c0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.548+0000 7f698160c700 1 -- 172.21.15.6:0/3716571916 shutdown_connections 2023-10-06T02:18:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.548+0000 7f698160c700 1 -- 172.21.15.6:0/3716571916 wait complete. 2023-10-06T02:18:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.549+0000 7f698160c700 1 Processor -- start 2023-10-06T02:18:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.549+0000 7f698160c700 1 -- start start 2023-10-06T02:18:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.550+0000 7f698160c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f697c0b0430 0x7f697c09b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.550+0000 7f698160c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f697c1598b0 0x7f697c098b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.550+0000 7f698160c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f697c15b940 0x7f697c1483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.550+0000 7f698160c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c09bce0 con 0x7f697c15b940 2023-10-06T02:18:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.550+0000 7f698160c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c15d310 con 0x7f697c1598b0 2023-10-06T02:18:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.550+0000 7f698160c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c09b720 con 0x7f697c0b0430 2023-10-06T02:18:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.550+0000 7f697b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f697c15b940 0x7f697c1483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.550+0000 7f697b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f697c15b940 0x7f697c1483d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51488/0 (socket says 172.21.15.6:51488) 2023-10-06T02:18:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.550+0000 7f697b7fe700 1 -- 172.21.15.6:0/3685322755 learned_addr learned my addr 172.21.15.6:0/3685322755 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.550+0000 7f697a7fc700 1 --2- 172.21.15.6:0/3685322755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f697c1598b0 0x7f697c098b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.550+0000 7f697affd700 1 --2- 172.21.15.6:0/3685322755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f697c0b0430 0x7f697c09b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.550+0000 7f697b7fe700 1 -- 172.21.15.6:0/3685322755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f697c0b0430 msgr2=0x7f697c09b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.550+0000 7f697b7fe700 1 --2- 172.21.15.6:0/3685322755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f697c0b0430 0x7f697c09b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.551+0000 7f697b7fe700 1 -- 172.21.15.6:0/3685322755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f697c1598b0 msgr2=0x7f697c098b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.551+0000 7f697b7fe700 1 --2- 172.21.15.6:0/3685322755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f697c1598b0 0x7f697c098b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.551+0000 7f697b7fe700 1 -- 172.21.15.6:0/3685322755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c009ae0 con 0x7f697c15b940 2023-10-06T02:18:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.551+0000 7f697a7fc700 1 --2- 172.21.15.6:0/3685322755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f697c1598b0 0x7f697c098b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.551+0000 7f697affd700 1 --2- 172.21.15.6:0/3685322755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f697c0b0430 0x7f697c09b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.551+0000 7f697b7fe700 1 --2- 172.21.15.6:0/3685322755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f697c15b940 0x7f697c1483d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f696c012000 tx=0x7f696c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.551+0000 7f6972ffd700 1 -- 172.21.15.6:0/3685322755 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c008b90 con 0x7f697c15b940 2023-10-06T02:18:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.551+0000 7f6972ffd700 1 -- 172.21.15.6:0/3685322755 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c008cf0 con 0x7f697c15b940 2023-10-06T02:18:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.551+0000 7f698160c700 1 -- 172.21.15.6:0/3685322755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697c09ba00 con 0x7f697c15b940 2023-10-06T02:18:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.551+0000 7f6972ffd700 1 -- 172.21.15.6:0/3685322755 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c0266b0 con 0x7f697c15b940 2023-10-06T02:18:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.551+0000 7f698160c700 1 -- 172.21.15.6:0/3685322755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697c148910 con 0x7f697c15b940 2023-10-06T02:18:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.552+0000 7f698160c700 1 -- 172.21.15.6:0/3685322755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697c15f030 con 0x7f697c15b940 2023-10-06T02:18:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.552+0000 7f6972ffd700 1 -- 172.21.15.6:0/3685322755 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f696c003040 con 0x7f697c15b940 2023-10-06T02:18:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.553+0000 7f6972ffd700 1 --2- 172.21.15.6:0/3685322755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f695c066f30 0x7f695c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.553+0000 7f6972ffd700 1 -- 172.21.15.6:0/3685322755 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6953+0+0 (secure 0 0 0) 0x7f696c086880 con 0x7f697c15b940 2023-10-06T02:18:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.553+0000 7f697affd700 1 --2- 172.21.15.6:0/3685322755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f695c066f30 0x7f695c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.553+0000 7f697affd700 1 --2- 172.21.15.6:0/3685322755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f695c066f30 0x7f695c0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6974006ea0 tx=0x7f6974008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:34.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.557+0000 7f6972ffd700 1 -- 172.21.15.6:0/3685322755 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f696c053610 con 0x7f697c15b940 2023-10-06T02:18:34.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:34.751+0000 7f698160c700 1 -- 172.21.15.6:0/3685322755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f697c15b720 con 0x7f697c15b940 2023-10-06T02:18:35.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.744+0000 7f6972ffd700 1 -- 172.21.15.6:0/3685322755 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f696c009940 con 0x7f697c15b940 2023-10-06T02:18:35.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.750+0000 7f698160c700 1 -- 172.21.15.6:0/3685322755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f695c066f30 msgr2=0x7f695c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:35.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.750+0000 7f698160c700 1 --2- 172.21.15.6:0/3685322755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f695c066f30 0x7f695c0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6974006ea0 tx=0x7f6974008040 comp rx=0 tx=0).stop 2023-10-06T02:18:35.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.750+0000 7f698160c700 1 -- 172.21.15.6:0/3685322755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f697c15b940 msgr2=0x7f697c1483d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:35.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.750+0000 7f698160c700 1 --2- 172.21.15.6:0/3685322755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f697c15b940 0x7f697c1483d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f696c012000 tx=0x7f696c018000 comp rx=0 tx=0).stop 2023-10-06T02:18:35.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.750+0000 7f698160c700 1 -- 172.21.15.6:0/3685322755 shutdown_connections 2023-10-06T02:18:35.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.750+0000 7f698160c700 1 --2- 172.21.15.6:0/3685322755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f695c066f30 0x7f695c0693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:35.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.750+0000 7f698160c700 1 --2- 172.21.15.6:0/3685322755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f697c15b940 0x7f697c1483d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:35.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.750+0000 7f698160c700 1 --2- 172.21.15.6:0/3685322755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f697c0b0430 0x7f697c09b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:35.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.750+0000 7f698160c700 1 --2- 172.21.15.6:0/3685322755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f697c1598b0 0x7f697c098b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:35.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.750+0000 7f698160c700 1 -- 172.21.15.6:0/3685322755 >> 172.21.15.6:0/3685322755 conn(0x7f697c067910 msgr2=0x7f697c158680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:35.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.751+0000 7f698160c700 1 -- 172.21.15.6:0/3685322755 shutdown_connections 2023-10-06T02:18:35.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.751+0000 7f698160c700 1 -- 172.21.15.6:0/3685322755 wait complete. 2023-10-06T02:18:35.753 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:18:35.768 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:18:35.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.897+0000 7fa9d62d8700 1 Processor -- start 2023-10-06T02:18:35.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.897+0000 7fa9d62d8700 1 -- start start 2023-10-06T02:18:35.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.898+0000 7fa9d62d8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9d015a020 0x7fa9d00ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:35.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.898+0000 7fa9d62d8700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa9d00b1450 0x7fa9d00a7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:35.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.898+0000 7fa9d62d8700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d00ae810 con 0x7fa9d015a3f0 2023-10-06T02:18:35.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.898+0000 7fa9d62d8700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d0156c90 con 0x7fa9d00b1450 2023-10-06T02:18:35.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.898+0000 7fa9d62d8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d00adc00 con 0x7fa9d015a020 2023-10-06T02:18:35.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.898+0000 7fa9cffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9d015a020 0x7fa9d00ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:35.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.898+0000 7fa9cf7fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa9d00b1450 0x7fa9d00a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:35.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.898+0000 7fa9cffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9d015a020 0x7fa9d00ad2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:39916/0 (socket says 172.21.15.6:39916) 2023-10-06T02:18:35.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.898+0000 7fa9cffff700 1 -- 172.21.15.6:0/1136507772 learned_addr learned my addr 172.21.15.6:0/1136507772 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:35.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.898+0000 7fa9d4875700 1 --1- 172.21.15.6:0/1136507772 >> v1:172.21.15.175:6789/0 conn(0x7fa9d015a3f0 0x7fa9d00a76d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:55772/0 (socket says 172.21.15.6:55772) 2023-10-06T02:18:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.899+0000 7fa9cf7fe700 1 -- 172.21.15.6:0/1136507772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9d015a020 msgr2=0x7fa9d00ad2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.899+0000 7fa9cf7fe700 1 --2- 172.21.15.6:0/1136507772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9d015a020 0x7fa9d00ad2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.899+0000 7fa9cf7fe700 1 -- 172.21.15.6:0/1136507772 >> v1:172.21.15.175:6789/0 conn(0x7fa9d015a3f0 legacy=0x7fa9d00a76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.899+0000 7fa9cf7fe700 1 -- 172.21.15.6:0/1136507772 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d00adee0 con 0x7fa9d00b1450 2023-10-06T02:18:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.899+0000 7fa9ceffd700 1 -- 172.21.15.6:0/1136507772 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489694905 0 0) 0x7fa9d00ae810 con 0x7fa9d015a3f0 2023-10-06T02:18:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.899+0000 7fa9cffff700 1 --2- 172.21.15.6:0/1136507772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9d015a020 0x7fa9d00ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.899+0000 7fa9cf7fe700 1 --2- 172.21.15.6:0/1136507772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d00b1450 0x7fa9d00a7190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00098e0 tx=0x7fa9c00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=954fd99b0572618 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.899+0000 7fa9ceffd700 1 -- 172.21.15.6:0/1136507772 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c000b640 con 0x7fa9d00b1450 2023-10-06T02:18:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.899+0000 7fa9ceffd700 1 -- 172.21.15.6:0/1136507772 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c000b7a0 con 0x7fa9d00b1450 2023-10-06T02:18:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.899+0000 7fa9ceffd700 1 -- 172.21.15.6:0/1136507772 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c000bb40 con 0x7fa9d00b1450 2023-10-06T02:18:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.900+0000 7fa9d62d8700 1 -- 172.21.15.6:0/1136507772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d00b1450 msgr2=0x7fa9d00a7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.900+0000 7fa9d62d8700 1 --2- 172.21.15.6:0/1136507772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d00b1450 0x7fa9d00a7190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00098e0 tx=0x7fa9c00091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:35.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.900+0000 7fa9d62d8700 1 -- 172.21.15.6:0/1136507772 shutdown_connections 2023-10-06T02:18:35.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.900+0000 7fa9d62d8700 1 --2- 172.21.15.6:0/1136507772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9d015a020 0x7fa9d00ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:35.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.900+0000 7fa9d62d8700 1 --2- 172.21.15.6:0/1136507772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d00b1450 0x7fa9d00a7190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:35.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.900+0000 7fa9d62d8700 1 -- 172.21.15.6:0/1136507772 >> 172.21.15.6:0/1136507772 conn(0x7fa9d00963e0 msgr2=0x7fa9d0069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:35.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.900+0000 7fa9d62d8700 1 -- 172.21.15.6:0/1136507772 shutdown_connections 2023-10-06T02:18:35.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.900+0000 7fa9d62d8700 1 -- 172.21.15.6:0/1136507772 wait complete. 2023-10-06T02:18:35.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.901+0000 7fa9d62d8700 1 Processor -- start 2023-10-06T02:18:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.901+0000 7fa9d62d8700 1 -- start start 2023-10-06T02:18:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.902+0000 7fa9d62d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d00b1450 0x7fa9d014fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.902+0000 7fa9d62d8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d015a020 0x7fa9d0098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.902+0000 7fa9d62d8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9d015a3f0 0x7fa9d0099400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.902+0000 7fa9d62d8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d014cec0 con 0x7fa9d00b1450 2023-10-06T02:18:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.902+0000 7fa9d62d8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d016b520 con 0x7fa9d015a020 2023-10-06T02:18:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.902+0000 7fa9d62d8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d0168700 con 0x7fa9d015a3f0 2023-10-06T02:18:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.902+0000 7fa9cffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d00b1450 0x7fa9d014fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.902+0000 7fa9cffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d00b1450 0x7fa9d014fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51496/0 (socket says 172.21.15.6:51496) 2023-10-06T02:18:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.902+0000 7fa9cffff700 1 -- 172.21.15.6:0/894105200 learned_addr learned my addr 172.21.15.6:0/894105200 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.902+0000 7fa9d4875700 1 --2- 172.21.15.6:0/894105200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9d015a3f0 0x7fa9d0099400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.902+0000 7fa9cf7fe700 1 --2- 172.21.15.6:0/894105200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d015a020 0x7fa9d0098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.902+0000 7fa9cffff700 1 -- 172.21.15.6:0/894105200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9d015a3f0 msgr2=0x7fa9d0099400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.902+0000 7fa9cffff700 1 --2- 172.21.15.6:0/894105200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9d015a3f0 0x7fa9d0099400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.902+0000 7fa9cffff700 1 -- 172.21.15.6:0/894105200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d015a020 msgr2=0x7fa9d0098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.902+0000 7fa9cffff700 1 --2- 172.21.15.6:0/894105200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d015a020 0x7fa9d0098ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.902+0000 7fa9cffff700 1 -- 172.21.15.6:0/894105200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c40094f0 con 0x7fa9d00b1450 2023-10-06T02:18:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.902+0000 7fa9cffff700 1 --2- 172.21.15.6:0/894105200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d00b1450 0x7fa9d014fb20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400ec80 tx=0x7fa9c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.903+0000 7fa9b7fff700 1 -- 172.21.15.6:0/894105200 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c400c850 con 0x7fa9d00b1450 2023-10-06T02:18:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.903+0000 7fa9b7fff700 1 -- 172.21.15.6:0/894105200 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c400c9b0 con 0x7fa9d00b1450 2023-10-06T02:18:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.903+0000 7fa9d62d8700 1 -- 172.21.15.6:0/894105200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c0009420 con 0x7fa9d00b1450 2023-10-06T02:18:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.903+0000 7fa9b7fff700 1 -- 172.21.15.6:0/894105200 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c400cd50 con 0x7fa9d00b1450 2023-10-06T02:18:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.903+0000 7fa9d62d8700 1 -- 172.21.15.6:0/894105200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d016aed0 con 0x7fa9d00b1450 2023-10-06T02:18:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.904+0000 7fa9d62d8700 1 -- 172.21.15.6:0/894105200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d006d590 con 0x7fa9d00b1450 2023-10-06T02:18:35.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.904+0000 7fa9b7fff700 1 -- 172.21.15.6:0/894105200 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9c4013680 con 0x7fa9d00b1450 2023-10-06T02:18:35.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.904+0000 7fa9b7fff700 1 --2- 172.21.15.6:0/894105200 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9bc066f30 0x7fa9bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:35.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.904+0000 7fa9b7fff700 1 -- 172.21.15.6:0/894105200 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6515+0+0 (secure 0 0 0) 0x7fa9c4084ad0 con 0x7fa9d00b1450 2023-10-06T02:18:35.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.905+0000 7fa9cf7fe700 1 --2- 172.21.15.6:0/894105200 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9bc066f30 0x7fa9bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:35.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.905+0000 7fa9cf7fe700 1 --2- 172.21.15.6:0/894105200 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9bc066f30 0x7fa9bc0693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00093f0 tx=0x7fa9c0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:35.909+0000 7fa9b7fff700 1 -- 172.21.15.6:0/894105200 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9c4051a10 con 0x7fa9d00b1450 2023-10-06T02:18:36.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:36.105+0000 7fa9d62d8700 1 -- 172.21.15.6:0/894105200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa9d016b270 con 0x7fa9d00b1450 2023-10-06T02:18:36.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:36.905+0000 7fa9b7fff700 1 -- 172.21.15.6:0/894105200 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa9c4055030 con 0x7fa9d00b1450 2023-10-06T02:18:36.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:36.909+0000 7fa9d62d8700 1 -- 172.21.15.6:0/894105200 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9bc066f30 msgr2=0x7fa9bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:36.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:36.909+0000 7fa9d62d8700 1 --2- 172.21.15.6:0/894105200 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9bc066f30 0x7fa9bc0693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00093f0 tx=0x7fa9c0017000 comp rx=0 tx=0).stop 2023-10-06T02:18:36.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:36.909+0000 7fa9d62d8700 1 -- 172.21.15.6:0/894105200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d00b1450 msgr2=0x7fa9d014fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:36.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:36.909+0000 7fa9d62d8700 1 --2- 172.21.15.6:0/894105200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d00b1450 0x7fa9d014fb20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400ec80 tx=0x7fa9c4009250 comp rx=0 tx=0).stop 2023-10-06T02:18:36.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:36.912+0000 7fa9d62d8700 1 -- 172.21.15.6:0/894105200 shutdown_connections 2023-10-06T02:18:36.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:36.912+0000 7fa9d62d8700 1 --2- 172.21.15.6:0/894105200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9d015a3f0 0x7fa9d0099400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:36.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:36.912+0000 7fa9d62d8700 1 --2- 172.21.15.6:0/894105200 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9bc066f30 0x7fa9bc0693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:36.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:36.912+0000 7fa9d62d8700 1 --2- 172.21.15.6:0/894105200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d00b1450 0x7fa9d014fb20 secure :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400ec80 tx=0x7fa9c4009250 comp rx=0 tx=0).stop 2023-10-06T02:18:36.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:36.912+0000 7fa9d62d8700 1 --2- 172.21.15.6:0/894105200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d015a020 0x7fa9d0098ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:36.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:36.912+0000 7fa9d62d8700 1 -- 172.21.15.6:0/894105200 >> 172.21.15.6:0/894105200 conn(0x7fa9d00963e0 msgr2=0x7fa9d00b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:36.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:36.914+0000 7fa9d62d8700 1 -- 172.21.15.6:0/894105200 shutdown_connections 2023-10-06T02:18:36.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:36.915+0000 7fa9d62d8700 1 -- 172.21.15.6:0/894105200 wait complete. 2023-10-06T02:18:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-06T02:18:36.937 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-06T02:18:37.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.065+0000 7fb63566e700 1 Processor -- start 2023-10-06T02:18:37.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.065+0000 7fb63566e700 1 -- start start 2023-10-06T02:18:37.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.066+0000 7fb63566e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb630142df0 0x7fb6300cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:37.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.066+0000 7fb63566e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6300cc890 0x7fb6300d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.066+0000 7fb63566e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63015a710 con 0x7fb6300d07a0 2023-10-06T02:18:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.066+0000 7fb63566e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6300d0c40 con 0x7fb630142df0 2023-10-06T02:18:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.066+0000 7fb63566e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb630159b40 con 0x7fb6300cc890 2023-10-06T02:18:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.066+0000 7fb62effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb630142df0 0x7fb6300cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.066+0000 7fb62f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb6300d07a0 0x7fb6300cea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50450/0 (socket says 172.21.15.6:50450) 2023-10-06T02:18:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.066+0000 7fb62f7fe700 1 -- 172.21.15.6:0/3666824773 learned_addr learned my addr 172.21.15.6:0/3666824773 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.066+0000 7fb62effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb630142df0 0x7fb6300cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51500/0 (socket says 172.21.15.6:51500) 2023-10-06T02:18:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.066+0000 7fb62e7fc700 1 --2- 172.21.15.6:0/3666824773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6300cc890 0x7fb6300d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.066+0000 7fb62effd700 1 -- 172.21.15.6:0/3666824773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6300cc890 msgr2=0x7fb6300d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.066+0000 7fb62effd700 1 --2- 172.21.15.6:0/3666824773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6300cc890 0x7fb6300d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.066+0000 7fb62effd700 1 -- 172.21.15.6:0/3666824773 >> v1:172.21.15.6:6789/0 conn(0x7fb6300d07a0 legacy=0x7fb6300cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.066+0000 7fb62effd700 1 -- 172.21.15.6:0/3666824773 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb630159de0 con 0x7fb630142df0 2023-10-06T02:18:37.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.066+0000 7fb62dffb700 1 -- 172.21.15.6:0/3666824773 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333233389 0 0) 0x7fb63015a710 con 0x7fb6300d07a0 2023-10-06T02:18:37.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.066+0000 7fb62effd700 1 --2- 172.21.15.6:0/3666824773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb630142df0 0x7fb6300cc350 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb6280098e0 tx=0x7fb6280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4230dfc824e0d0c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:37.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.066+0000 7fb62dffb700 1 -- 172.21.15.6:0/3666824773 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628009e80 con 0x7fb630142df0 2023-10-06T02:18:37.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.067+0000 7fb62dffb700 1 -- 172.21.15.6:0/3666824773 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62800b860 con 0x7fb630142df0 2023-10-06T02:18:37.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.067+0000 7fb62dffb700 1 -- 172.21.15.6:0/3666824773 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800bbe0 con 0x7fb630142df0 2023-10-06T02:18:37.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.067+0000 7fb63566e700 1 -- 172.21.15.6:0/3666824773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb630142df0 msgr2=0x7fb6300cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:37.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.067+0000 7fb63566e700 1 --2- 172.21.15.6:0/3666824773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb630142df0 0x7fb6300cc350 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb6280098e0 tx=0x7fb6280091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:37.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.067+0000 7fb63566e700 1 -- 172.21.15.6:0/3666824773 shutdown_connections 2023-10-06T02:18:37.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.067+0000 7fb63566e700 1 --2- 172.21.15.6:0/3666824773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb630142df0 0x7fb6300cc350 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:37.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.067+0000 7fb63566e700 1 --2- 172.21.15.6:0/3666824773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6300cc890 0x7fb6300d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:37.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.067+0000 7fb63566e700 1 -- 172.21.15.6:0/3666824773 >> 172.21.15.6:0/3666824773 conn(0x7fb6300690f0 msgr2=0x7fb63006a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:37.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.067+0000 7fb63566e700 1 -- 172.21.15.6:0/3666824773 shutdown_connections 2023-10-06T02:18:37.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.067+0000 7fb63566e700 1 -- 172.21.15.6:0/3666824773 wait complete. 2023-10-06T02:18:37.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.068+0000 7fb63566e700 1 Processor -- start 2023-10-06T02:18:37.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.068+0000 7fb63566e700 1 -- start start 2023-10-06T02:18:37.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.069+0000 7fb63566e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6300cc890 0x7fb6300cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:37.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.069+0000 7fb63566e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6300d07a0 0x7fb630153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:37.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.069+0000 7fb63566e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb630142df0 0x7fb6300b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:37.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.069+0000 7fb63566e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300cbf60 con 0x7fb630142df0 2023-10-06T02:18:37.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.069+0000 7fb63566e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63016a520 con 0x7fb6300cc890 2023-10-06T02:18:37.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.069+0000 7fb63566e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63016a090 con 0x7fb6300d07a0 2023-10-06T02:18:37.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.069+0000 7fb62f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb630142df0 0x7fb6300b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.069+0000 7fb62f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb630142df0 0x7fb6300b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51516/0 (socket says 172.21.15.6:51516) 2023-10-06T02:18:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.069+0000 7fb62f7fe700 1 -- 172.21.15.6:0/4278877625 learned_addr learned my addr 172.21.15.6:0/4278877625 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.069+0000 7fb62effd700 1 --2- 172.21.15.6:0/4278877625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6300cc890 0x7fb6300cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.069+0000 7fb62e7fc700 1 --2- 172.21.15.6:0/4278877625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6300d07a0 0x7fb630153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.070+0000 7fb62f7fe700 1 -- 172.21.15.6:0/4278877625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6300d07a0 msgr2=0x7fb630153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.070+0000 7fb62f7fe700 1 --2- 172.21.15.6:0/4278877625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6300d07a0 0x7fb630153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.070+0000 7fb62f7fe700 1 -- 172.21.15.6:0/4278877625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6300cc890 msgr2=0x7fb6300cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.070+0000 7fb62f7fe700 1 --2- 172.21.15.6:0/4278877625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6300cc890 0x7fb6300cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.070+0000 7fb62f7fe700 1 -- 172.21.15.6:0/4278877625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb628009420 con 0x7fb630142df0 2023-10-06T02:18:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.070+0000 7fb62e7fc700 1 --2- 172.21.15.6:0/4278877625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6300d07a0 0x7fb630153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.070+0000 7fb62f7fe700 1 --2- 172.21.15.6:0/4278877625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb630142df0 0x7fb6300b1d60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb62000ccc0 tx=0x7fb620001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.070+0000 7fb626ffd700 1 -- 172.21.15.6:0/4278877625 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62000a950 con 0x7fb630142df0 2023-10-06T02:18:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.070+0000 7fb626ffd700 1 -- 172.21.15.6:0/4278877625 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62000aab0 con 0x7fb630142df0 2023-10-06T02:18:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.070+0000 7fb63566e700 1 -- 172.21.15.6:0/4278877625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6300cbcc0 con 0x7fb630142df0 2023-10-06T02:18:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.070+0000 7fb626ffd700 1 -- 172.21.15.6:0/4278877625 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62000ae70 con 0x7fb630142df0 2023-10-06T02:18:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.070+0000 7fb63566e700 1 -- 172.21.15.6:0/4278877625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb630169760 con 0x7fb630142df0 2023-10-06T02:18:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.071+0000 7fb63566e700 1 -- 172.21.15.6:0/4278877625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb630088ad0 con 0x7fb630142df0 2023-10-06T02:18:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.071+0000 7fb626ffd700 1 -- 172.21.15.6:0/4278877625 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb620007300 con 0x7fb630142df0 2023-10-06T02:18:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.072+0000 7fb626ffd700 1 --2- 172.21.15.6:0/4278877625 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb610066f30 0x7fb6100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.072+0000 7fb626ffd700 1 -- 172.21.15.6:0/4278877625 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6043+0+0 (secure 0 0 0) 0x7fb620084a60 con 0x7fb630142df0 2023-10-06T02:18:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.072+0000 7fb62effd700 1 --2- 172.21.15.6:0/4278877625 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb610066f30 0x7fb6100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.073+0000 7fb62effd700 1 --2- 172.21.15.6:0/4278877625 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb610066f30 0x7fb6100693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb6280091e0 tx=0x7fb628017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:37.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.076+0000 7fb626ffd700 1 -- 172.21.15.6:0/4278877625 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb620051c00 con 0x7fb630142df0 2023-10-06T02:18:37.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.273+0000 7fb63566e700 1 -- 172.21.15.6:0/4278877625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb63016a1d0 con 0x7fb630142df0 2023-10-06T02:18:37.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.906+0000 7fb626ffd700 1 -- 172.21.15.6:0/4278877625 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7fb620055220 con 0x7fb630142df0 2023-10-06T02:18:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.910+0000 7fb63566e700 1 -- 172.21.15.6:0/4278877625 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb610066f30 msgr2=0x7fb6100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.910+0000 7fb63566e700 1 --2- 172.21.15.6:0/4278877625 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb610066f30 0x7fb6100693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb6280091e0 tx=0x7fb628017000 comp rx=0 tx=0).stop 2023-10-06T02:18:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.910+0000 7fb63566e700 1 -- 172.21.15.6:0/4278877625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb630142df0 msgr2=0x7fb6300b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.910+0000 7fb63566e700 1 --2- 172.21.15.6:0/4278877625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb630142df0 0x7fb6300b1d60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb62000ccc0 tx=0x7fb620001a80 comp rx=0 tx=0).stop 2023-10-06T02:18:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.911+0000 7fb63566e700 1 -- 172.21.15.6:0/4278877625 shutdown_connections 2023-10-06T02:18:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.911+0000 7fb63566e700 1 --2- 172.21.15.6:0/4278877625 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb610066f30 0x7fb6100693e0 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb6280091e0 tx=0x7fb628017000 comp rx=0 tx=0).stop 2023-10-06T02:18:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.911+0000 7fb63566e700 1 --2- 172.21.15.6:0/4278877625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb630142df0 0x7fb6300b1d60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.911+0000 7fb63566e700 1 --2- 172.21.15.6:0/4278877625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6300cc890 0x7fb6300cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.911+0000 7fb63566e700 1 --2- 172.21.15.6:0/4278877625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6300d07a0 0x7fb630153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.911+0000 7fb63566e700 1 -- 172.21.15.6:0/4278877625 >> 172.21.15.6:0/4278877625 conn(0x7fb6300690f0 msgr2=0x7fb6300b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:37.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.913+0000 7fb63566e700 1 -- 172.21.15.6:0/4278877625 shutdown_connections 2023-10-06T02:18:37.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:37.915+0000 7fb63566e700 1 -- 172.21.15.6:0/4278877625 wait complete. 2023-10-06T02:18:37.917 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data_ec' removed 2023-10-06T02:18:37.932 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:18:37.932 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:18:37.932 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:18:37.933 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:18:37.933 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:18:37.933 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:18:37.933 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:18:37.933 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:18:37.933 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:18:37.933 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:18:37.934 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:18:37.934 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:18:37.934 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:18:37.934 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:18:37.934 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:18:37.934 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:18:37.945 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:18:37.945 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:18:37.946 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:18:37.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:18:37.947 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:18:37.947 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:18:37.948 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:18:37.948 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:18:37.987 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:18:37.988 DEBUG:teuthology.parallel:result is None 2023-10-06T02:18:37.989 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:18:37.989 DEBUG:teuthology.parallel:result is None 2023-10-06T02:18:37.990 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:18:37.991 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:18:37.991 DEBUG:teuthology.parallel:result is None 2023-10-06T02:18:37.991 DEBUG:teuthology.parallel:result is None 2023-10-06T02:18:37.991 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:18:38.070 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-06T02:18:38.071 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:18:38.082 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-10-06T02:18:38.084 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-10-06T02:18:38.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.120+0000 7f5a0d28f700 1 Processor -- start 2023-10-06T02:18:38.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.120+0000 7f5a0d28f700 1 -- start start 2023-10-06T02:18:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.121+0000 7f5a0d28f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5a08068680 0x7f5a08068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.121+0000 7f5a0d28f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a080c8ad0 con 0x7f5a08157d40 2023-10-06T02:18:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.121+0000 7f5a0d28f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a0806b730 con 0x7f5a0806c210 2023-10-06T02:18:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.121+0000 7f5a0d28f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a08069040 con 0x7f5a08068680 2023-10-06T02:18:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.121+0000 7f5a06ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5a08157d40 0x7f5a08158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50454/0 (socket says 172.21.15.6:50454) 2023-10-06T02:18:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.121+0000 7f5a06ffd700 1 -- 172.21.15.6:0/3604778024 learned_addr learned my addr 172.21.15.6:0/3604778024 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.121+0000 7f5a077fe700 1 --2- 172.21.15.6:0/3604778024 >> v2:172.21.15.175:3300/0 conn(0x7f5a08068680 0x7f5a08068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.121+0000 7f5a05ffb700 1 -- 172.21.15.6:0/3604778024 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734951736 0 0) 0x7f5a080c8ad0 con 0x7f5a08157d40 2023-10-06T02:18:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.121+0000 7f5a05ffb700 1 -- 172.21.15.6:0/3604778024 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59f0003570 con 0x7f5a08157d40 2023-10-06T02:18:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.121+0000 7f5a077fe700 1 -- 172.21.15.6:0/3604778024 >> v1:172.21.15.175:6789/0 conn(0x7f5a0806c210 legacy=0x7f5a080c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.121+0000 7f5a05ffb700 1 -- 172.21.15.6:0/3604778024 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562024406 0 0) 0x7f5a0806b730 con 0x7f5a0806c210 2023-10-06T02:18:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.121+0000 7f5a077fe700 1 -- 172.21.15.6:0/3604778024 >> v1:172.21.15.6:6789/0 conn(0x7f5a08157d40 legacy=0x7f5a08158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.121+0000 7f5a077fe700 1 -- 172.21.15.6:0/3604778024 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0806ba10 con 0x7f5a08068680 2023-10-06T02:18:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.122+0000 7f5a077fe700 1 --2- 172.21.15.6:0/3604778024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a08068680 0x7f5a08068b00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009e60 tx=0x7f5a00009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9c285e2dcc13c10 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.122+0000 7f5a05ffb700 1 -- 172.21.15.6:0/3604778024 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0000e070 con 0x7f5a08068680 2023-10-06T02:18:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.122+0000 7f5a05ffb700 1 -- 172.21.15.6:0/3604778024 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0000bb60 con 0x7f5a08068680 2023-10-06T02:18:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.122+0000 7f5a05ffb700 1 -- 172.21.15.6:0/3604778024 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00012430 con 0x7f5a08068680 2023-10-06T02:18:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.122+0000 7f5a0d28f700 1 -- 172.21.15.6:0/3604778024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a08068680 msgr2=0x7f5a08068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.122+0000 7f5a0d28f700 1 --2- 172.21.15.6:0/3604778024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a08068680 0x7f5a08068b00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009e60 tx=0x7f5a00009780 comp rx=0 tx=0).stop 2023-10-06T02:18:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.122+0000 7f5a0d28f700 1 -- 172.21.15.6:0/3604778024 shutdown_connections 2023-10-06T02:18:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.122+0000 7f5a0d28f700 1 --2- 172.21.15.6:0/3604778024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a08068680 0x7f5a08068b00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:38.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.122+0000 7f5a0d28f700 1 -- 172.21.15.6:0/3604778024 >> 172.21.15.6:0/3604778024 conn(0x7f5a0806a260 msgr2=0x7f5a080cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:38.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.122+0000 7f5a0d28f700 1 -- 172.21.15.6:0/3604778024 shutdown_connections 2023-10-06T02:18:38.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.122+0000 7f5a0d28f700 1 -- 172.21.15.6:0/3604778024 wait complete. 2023-10-06T02:18:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.123+0000 7f5a0d28f700 1 Processor -- start 2023-10-06T02:18:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.124+0000 7f5a0d28f700 1 -- start start 2023-10-06T02:18:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.124+0000 7f5a0d28f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a08068680 0x7f5a080cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.124+0000 7f5a0d28f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a0806c210 0x7f5a080c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.124+0000 7f5a0d28f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a08157d40 0x7f5a080c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.124+0000 7f5a0d28f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a080cbe50 con 0x7f5a08157d40 2023-10-06T02:18:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.124+0000 7f5a0d28f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a080cbb70 con 0x7f5a08068680 2023-10-06T02:18:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.124+0000 7f5a0d28f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0816d6b0 con 0x7f5a0806c210 2023-10-06T02:18:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.124+0000 7f5a077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a08157d40 0x7f5a080c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.124+0000 7f5a077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a08157d40 0x7f5a080c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51554/0 (socket says 172.21.15.6:51554) 2023-10-06T02:18:38.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.124+0000 7f5a077fe700 1 -- 172.21.15.6:0/2145935869 learned_addr learned my addr 172.21.15.6:0/2145935869 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:38.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.125+0000 7f5a067fc700 1 --2- 172.21.15.6:0/2145935869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a0806c210 0x7f5a080c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:38.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.125+0000 7f5a06ffd700 1 --2- 172.21.15.6:0/2145935869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a08068680 0x7f5a080cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:38.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.125+0000 7f5a077fe700 1 -- 172.21.15.6:0/2145935869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a0806c210 msgr2=0x7f5a080c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.125+0000 7f5a077fe700 1 --2- 172.21.15.6:0/2145935869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a0806c210 0x7f5a080c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.125+0000 7f5a077fe700 1 -- 172.21.15.6:0/2145935869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a08068680 msgr2=0x7f5a080cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.125+0000 7f5a077fe700 1 --2- 172.21.15.6:0/2145935869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a08068680 0x7f5a080cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.125+0000 7f5a077fe700 1 -- 172.21.15.6:0/2145935869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a00009a20 con 0x7f5a08157d40 2023-10-06T02:18:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.125+0000 7f5a067fc700 1 --2- 172.21.15.6:0/2145935869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a0806c210 0x7f5a080c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.125+0000 7f5a077fe700 1 --2- 172.21.15.6:0/2145935869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a08157d40 0x7f5a080c9fe0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5a080cce70 tx=0x7f5a00019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.125+0000 7f59eeffd700 1 -- 172.21.15.6:0/2145935869 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0001c610 con 0x7f5a08157d40 2023-10-06T02:18:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.125+0000 7f59eeffd700 1 -- 172.21.15.6:0/2145935869 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0001c790 con 0x7f5a08157d40 2023-10-06T02:18:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.125+0000 7f5a0d28f700 1 -- 172.21.15.6:0/2145935869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0816d990 con 0x7f5a08157d40 2023-10-06T02:18:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.125+0000 7f59eeffd700 1 -- 172.21.15.6:0/2145935869 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0001cb50 con 0x7f5a08157d40 2023-10-06T02:18:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.125+0000 7f5a0d28f700 1 -- 172.21.15.6:0/2145935869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a080cb680 con 0x7f5a08157d40 2023-10-06T02:18:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.126+0000 7f5a0d28f700 1 -- 172.21.15.6:0/2145935869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0816deb0 con 0x7f5a08157d40 2023-10-06T02:18:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.126+0000 7f59eeffd700 1 -- 172.21.15.6:0/2145935869 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a0001b400 con 0x7f5a08157d40 2023-10-06T02:18:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.127+0000 7f59eeffd700 1 --2- 172.21.15.6:0/2145935869 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59f4066f30 0x7f59f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.127+0000 7f59eeffd700 1 -- 172.21.15.6:0/2145935869 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f5a00086640 con 0x7f5a08157d40 2023-10-06T02:18:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.127+0000 7f5a06ffd700 1 --2- 172.21.15.6:0/2145935869 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59f4066f30 0x7f59f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.128+0000 7f5a06ffd700 1 --2- 172.21.15.6:0/2145935869 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59f4066f30 0x7f59f40693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f59f80058d0 tx=0x7f59f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.131+0000 7f59eeffd700 1 -- 172.21.15.6:0/2145935869 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a0816deb0 con 0x7f5a08157d40 2023-10-06T02:18:38.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.340+0000 7f5a0d28f700 1 -- 172.21.15.6:0/2145935869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5a0816deb0 con 0x7f5a08157d40 2023-10-06T02:18:38.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.927+0000 7f59eeffd700 1 -- 172.21.15.6:0/2145935869 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5a0816deb0 con 0x7f5a08157d40 2023-10-06T02:18:38.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.931+0000 7f5a0d28f700 1 -- 172.21.15.6:0/2145935869 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59f4066f30 msgr2=0x7f59f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:38.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.931+0000 7f5a0d28f700 1 --2- 172.21.15.6:0/2145935869 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59f4066f30 0x7f59f40693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f59f80058d0 tx=0x7f59f8009040 comp rx=0 tx=0).stop 2023-10-06T02:18:38.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.931+0000 7f5a0d28f700 1 -- 172.21.15.6:0/2145935869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a08157d40 msgr2=0x7f5a080c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:38.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.931+0000 7f5a0d28f700 1 --2- 172.21.15.6:0/2145935869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a08157d40 0x7f5a080c9fe0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5a080cce70 tx=0x7f5a00019000 comp rx=0 tx=0).stop 2023-10-06T02:18:38.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.931+0000 7f5a0d28f700 1 -- 172.21.15.6:0/2145935869 shutdown_connections 2023-10-06T02:18:38.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.931+0000 7f5a0d28f700 1 --2- 172.21.15.6:0/2145935869 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59f4066f30 0x7f59f40693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:38.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.931+0000 7f5a0d28f700 1 --2- 172.21.15.6:0/2145935869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a08157d40 0x7f5a080c9fe0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:38.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.931+0000 7f5a0d28f700 1 --2- 172.21.15.6:0/2145935869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a08068680 0x7f5a080cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:38.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.931+0000 7f5a0d28f700 1 --2- 172.21.15.6:0/2145935869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a0806c210 0x7f5a080c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:38.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.931+0000 7f5a0d28f700 1 -- 172.21.15.6:0/2145935869 >> 172.21.15.6:0/2145935869 conn(0x7f5a0806a260 msgr2=0x7f5a08158110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:38.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.931+0000 7f5a0d28f700 1 -- 172.21.15.6:0/2145935869 shutdown_connections 2023-10-06T02:18:38.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:38.931+0000 7f5a0d28f700 1 -- 172.21.15.6:0/2145935869 wait complete. 2023-10-06T02:18:38.933 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-10-06T02:18:38.947 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:18:39.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.073+0000 7f8ced069700 1 Processor -- start 2023-10-06T02:18:39.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.073+0000 7f8ced069700 1 -- start start 2023-10-06T02:18:39.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.074+0000 7f8ced069700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8ce80af4e0 0x7f8ce80b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.074+0000 7f8ced069700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce815db70 0x7f8ce80b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.074+0000 7f8ced069700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce815e190 con 0x7f8ce80af8b0 2023-10-06T02:18:39.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.074+0000 7f8ced069700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce80b1910 con 0x7f8ce80af4e0 2023-10-06T02:18:39.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.074+0000 7f8ced069700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce815dfa0 con 0x7f8ce815db70 2023-10-06T02:18:39.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.074+0000 7f8ce6d9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8ce80af4e0 0x7f8ce80b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:39.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.074+0000 7f8ce759e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce815db70 0x7f8ce80b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:39.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.075+0000 7f8ce759e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce815db70 0x7f8ce80b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:38938/0 (socket says 172.21.15.6:38938) 2023-10-06T02:18:39.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.075+0000 7f8ce659c700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8ce80af8b0 0x7f8ce815d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:38020/0 (socket says 172.21.15.6:38020) 2023-10-06T02:18:39.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.075+0000 7f8ce6d9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8ce80af4e0 0x7f8ce80b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:43452/0 (socket says 172.21.15.6:43452) 2023-10-06T02:18:39.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.075+0000 7f8ce759e700 1 -- 172.21.15.6:0/2947305936 learned_addr learned my addr 172.21.15.6:0/2947305936 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:39.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.075+0000 7f8ce5d9b700 1 -- 172.21.15.6:0/2947305936 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27246679 0 0) 0x7f8ce815e190 con 0x7f8ce80af8b0 2023-10-06T02:18:39.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.075+0000 7f8ce5d9b700 1 -- 172.21.15.6:0/2947305936 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cd4003570 con 0x7f8ce80af8b0 2023-10-06T02:18:39.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.075+0000 7f8ce759e700 1 -- 172.21.15.6:0/2947305936 >> v2:172.21.15.175:3300/0 conn(0x7f8ce80af4e0 msgr2=0x7f8ce80b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:39.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.075+0000 7f8ce759e700 1 --2- 172.21.15.6:0/2947305936 >> v2:172.21.15.175:3300/0 conn(0x7f8ce80af4e0 0x7f8ce80b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.075+0000 7f8ce759e700 1 -- 172.21.15.6:0/2947305936 >> v1:172.21.15.175:6789/0 conn(0x7f8ce80af8b0 legacy=0x7f8ce815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.075+0000 7f8ce759e700 1 -- 172.21.15.6:0/2947305936 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce80cb650 con 0x7f8ce815db70 2023-10-06T02:18:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.075+0000 7f8ce6d9d700 1 --2- 172.21.15.6:0/2947305936 >> v2:172.21.15.175:3300/0 conn(0x7f8ce80af4e0 0x7f8ce80b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.075+0000 7f8ce759e700 1 --2- 172.21.15.6:0/2947305936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce815db70 0x7f8ce80b2620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80099b0 tx=0x7f8cd8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e25e11d492549f42 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.075+0000 7f8ce5d9b700 1 -- 172.21.15.6:0/2947305936 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd800b680 con 0x7f8ce815db70 2023-10-06T02:18:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.075+0000 7f8ce5d9b700 1 -- 172.21.15.6:0/2947305936 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd800b7e0 con 0x7f8ce815db70 2023-10-06T02:18:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.075+0000 7f8ce5d9b700 1 -- 172.21.15.6:0/2947305936 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd800bb80 con 0x7f8ce815db70 2023-10-06T02:18:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.076+0000 7f8ced069700 1 -- 172.21.15.6:0/2947305936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce815db70 msgr2=0x7f8ce80b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.076+0000 7f8ced069700 1 --2- 172.21.15.6:0/2947305936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce815db70 0x7f8ce80b2620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80099b0 tx=0x7f8cd8009250 comp rx=0 tx=0).stop 2023-10-06T02:18:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.076+0000 7f8ced069700 1 -- 172.21.15.6:0/2947305936 shutdown_connections 2023-10-06T02:18:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.076+0000 7f8ced069700 1 --2- 172.21.15.6:0/2947305936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce815db70 0x7f8ce80b2620 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.076+0000 7f8ced069700 1 --2- 172.21.15.6:0/2947305936 >> v2:172.21.15.175:3300/0 conn(0x7f8ce80af4e0 0x7f8ce80b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.076+0000 7f8ced069700 1 -- 172.21.15.6:0/2947305936 >> 172.21.15.6:0/2947305936 conn(0x7f8ce8068680 msgr2=0x7f8ce8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:39.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.076+0000 7f8ced069700 1 -- 172.21.15.6:0/2947305936 shutdown_connections 2023-10-06T02:18:39.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.076+0000 7f8ced069700 1 -- 172.21.15.6:0/2947305936 wait complete. 2023-10-06T02:18:39.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.077+0000 7f8ced069700 1 Processor -- start 2023-10-06T02:18:39.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.077+0000 7f8ced069700 1 -- start start 2023-10-06T02:18:39.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.078+0000 7f8ced069700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce80af4e0 0x7f8ce8157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.078+0000 7f8ced069700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce80af8b0 0x7f8ce8155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.078+0000 7f8ced069700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ce815db70 0x7f8ce8150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.078+0000 7f8ced069700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce8150f80 con 0x7f8ce80af8b0 2023-10-06T02:18:39.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.078+0000 7f8ced069700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80c8a60 con 0x7f8ce815db70 2023-10-06T02:18:39.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.078+0000 7f8ced069700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce8158070 con 0x7f8ce80af4e0 2023-10-06T02:18:39.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.078+0000 7f8ce659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce80af8b0 0x7f8ce8155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:39.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.078+0000 7f8ce659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce80af8b0 0x7f8ce8155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40648/0 (socket says 172.21.15.6:40648) 2023-10-06T02:18:39.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.078+0000 7f8ce659c700 1 -- 172.21.15.6:0/191935058 learned_addr learned my addr 172.21.15.6:0/191935058 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:39.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.078+0000 7f8ce6d9d700 1 --2- 172.21.15.6:0/191935058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce80af4e0 0x7f8ce8157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:39.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.078+0000 7f8ce759e700 1 --2- 172.21.15.6:0/191935058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ce815db70 0x7f8ce8150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:39.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.078+0000 7f8ce659c700 1 -- 172.21.15.6:0/191935058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce80af4e0 msgr2=0x7f8ce8157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:39.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.078+0000 7f8ce659c700 1 --2- 172.21.15.6:0/191935058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce80af4e0 0x7f8ce8157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.078+0000 7f8ce659c700 1 -- 172.21.15.6:0/191935058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ce815db70 msgr2=0x7f8ce8150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:39.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.078+0000 7f8ce659c700 1 --2- 172.21.15.6:0/191935058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ce815db70 0x7f8ce8150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.078+0000 7f8ce659c700 1 -- 172.21.15.6:0/191935058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce0009a20 con 0x7f8ce80af8b0 2023-10-06T02:18:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.079+0000 7f8ce659c700 1 --2- 172.21.15.6:0/191935058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce80af8b0 0x7f8ce8155450 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000c7f0 tx=0x7f8cd0007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.079+0000 7f8cdeffd700 1 -- 172.21.15.6:0/191935058 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0005b40 con 0x7f8ce80af8b0 2023-10-06T02:18:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.079+0000 7f8cdeffd700 1 -- 172.21.15.6:0/191935058 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd0005cc0 con 0x7f8ce80af8b0 2023-10-06T02:18:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.079+0000 7f8ced069700 1 -- 172.21.15.6:0/191935058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd80094f0 con 0x7f8ce80af8b0 2023-10-06T02:18:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.079+0000 7f8cdeffd700 1 -- 172.21.15.6:0/191935058 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0007320 con 0x7f8ce80af8b0 2023-10-06T02:18:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.079+0000 7f8ced069700 1 -- 172.21.15.6:0/191935058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce80c9030 con 0x7f8ce80af8b0 2023-10-06T02:18:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.080+0000 7f8ced069700 1 -- 172.21.15.6:0/191935058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce80c91c0 con 0x7f8ce80af8b0 2023-10-06T02:18:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.080+0000 7f8cdeffd700 1 -- 172.21.15.6:0/191935058 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8cd0012400 con 0x7f8ce80af8b0 2023-10-06T02:18:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.081+0000 7f8cdeffd700 1 --2- 172.21.15.6:0/191935058 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8cc8066f30 0x7f8cc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.081+0000 7f8cdeffd700 1 -- 172.21.15.6:0/191935058 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f8cd0083900 con 0x7f8ce80af8b0 2023-10-06T02:18:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.081+0000 7f8ce6d9d700 1 --2- 172.21.15.6:0/191935058 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8cc8066f30 0x7f8cc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:39.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.081+0000 7f8ce6d9d700 1 --2- 172.21.15.6:0/191935058 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8cc8066f30 0x7f8cc80693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000f650 tx=0x7f8ce000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:39.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.085+0000 7f8cdeffd700 1 -- 172.21.15.6:0/191935058 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8cd0050c20 con 0x7f8ce80af8b0 2023-10-06T02:18:39.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.354+0000 7f8ced069700 1 -- 172.21.15.6:0/191935058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8ce80b0910 con 0x7f8ce80af8b0 2023-10-06T02:18:39.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.354+0000 7f8cdeffd700 1 -- 172.21.15.6:0/191935058 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f8cd0054240 con 0x7f8ce80af8b0 2023-10-06T02:18:39.355 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:39.355 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:18:39.355 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-10-06T02:18:39.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.355 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-10-06T02:18:39.355 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9l3UdFFRAAahVHXJW+fzPcTwa/MxOW7A==", 2023-10-06T02:18:39.356 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.356 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:18:39.356 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:18:39.356 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:18:39.356 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:18:39.356 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.356 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-10-06T02:18:39.356 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lcq7HIBAA/3Gaa7gNbUHq176zcCFgjA==", 2023-10-06T02:18:39.357 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.357 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:18:39.357 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:18:39.357 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:18:39.357 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:18:39.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.357 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-10-06T02:18:39.357 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9ls7FDHBAA746JdAc0gr6+qLK9tuWCZg==", 2023-10-06T02:18:39.357 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.358 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:18:39.358 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:18:39.358 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:18:39.358 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:18:39.358 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.358 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-10-06T02:18:39.358 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9llEyZJxAAKXcHXIywnLQVZlbOGKdTTg==", 2023-10-06T02:18:39.358 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.359 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:18:39.359 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:18:39.359 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:18:39.359 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:18:39.359 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.359 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-10-06T02:18:39.359 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAXbh9lLVWHERAAoYIaMicUCppJKlSwl1K8UQ==", 2023-10-06T02:18:39.359 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.360 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:18:39.360 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:18:39.360 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:18:39.360 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.360 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-10-06T02:18:39.360 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAabh9lgpbHDxAAXOwtusarMKccKIu9+SmmHg==", 2023-10-06T02:18:39.360 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.360 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:18:39.361 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:18:39.361 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:18:39.361 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.361 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-10-06T02:18:39.361 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAdbh9lG/ZcFBAA3WpHCcm2R2+IyFMK460CYw==", 2023-10-06T02:18:39.361 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.361 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:18:39.361 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:18:39.362 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:18:39.362 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.362 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-10-06T02:18:39.362 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAgbh9lz8J4ExAAggyFHpD2wvM/b+WKLvVneA==", 2023-10-06T02:18:39.362 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.362 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:18:39.362 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:18:39.362 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:18:39.363 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.363 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-10-06T02:18:39.363 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAmbh9lpSX1ERAA1vkI0SvrJb6mAciDTIGZtA==", 2023-10-06T02:18:39.363 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.363 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:18:39.363 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:18:39.363 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:18:39.363 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.364 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-10-06T02:18:39.364 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQApbh9ljSxwDxAACjsHigTRkZIY+lHrr9/17g==", 2023-10-06T02:18:39.364 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.364 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:18:39.364 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:18:39.364 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:18:39.364 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.365 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-10-06T02:18:39.365 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAsbh9l6vlZDxAAfff29OvnP+8zxQFDDt8SFA==", 2023-10-06T02:18:39.365 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.365 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:18:39.365 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:18:39.365 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:18:39.365 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.365 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-10-06T02:18:39.366 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAvbh9lz+1sDBAANCvbv4nJUuaVde42koP8fA==", 2023-10-06T02:18:39.366 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.366 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:18:39.366 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:18:39.366 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:18:39.366 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.366 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-10-06T02:18:39.366 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lO6GJKxAASfNnkG3FXno1BWm5XiqIMA==", 2023-10-06T02:18:39.366 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.367 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:18:39.367 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:18:39.367 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:18:39.367 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:18:39.367 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.367 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-10-06T02:18:39.367 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lpRgFNBAAYE7yue5MPAzdm5k3EOcvcg==", 2023-10-06T02:18:39.367 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.368 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:18:39.368 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:18:39.368 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:18:39.368 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:18:39.368 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.368 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-10-06T02:18:39.368 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9l1hsHMRAANI0CeqE+ZB7uQ9ZB4cF/Ig==", 2023-10-06T02:18:39.368 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.368 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:18:39.369 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:18:39.369 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:18:39.369 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:18:39.369 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.369 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-10-06T02:18:39.369 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lAV9fORAAXCO4NdIb62PH2IX0y1siCw==", 2023-10-06T02:18:39.369 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.369 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:18:39.370 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:18:39.370 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:18:39.370 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:18:39.370 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.370 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-10-06T02:18:39.370 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQASbh9lIiB6NBAAvHP4z7yHub2TXCgRAAFy5A==", 2023-10-06T02:18:39.370 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.370 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:18:39.370 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:18:39.371 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:18:39.371 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:18:39.371 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.371 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mds", 2023-10-06T02:18:39.371 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQA0bh9lBEiWOBAAIqabvkGYdSLrCkNelwmunQ==", 2023-10-06T02:18:39.371 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.371 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T02:18:39.371 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.372 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T02:18:39.372 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQA0bh9lGFGWOBAAB2AAePa2q+FKtqRG5AGA+A==", 2023-10-06T02:18:39.372 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.372 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T02:18:39.372 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.372 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-osd", 2023-10-06T02:18:39.372 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQA0bh9lOlyWOBAAWO3x/FV31drlB0dlVE3s+A==", 2023-10-06T02:18:39.373 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.373 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T02:18:39.373 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.373 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T02:18:39.373 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQA0bh9lKGSWOBAAeiiM68AdKG388QTeVhKJ4g==", 2023-10-06T02:18:39.373 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.373 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T02:18:39.373 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.374 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T02:18:39.374 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQA0bh9lDWyWOBAAAytjuSfKxjA1RZlkB9MR7A==", 2023-10-06T02:18:39.374 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.374 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T02:18:39.374 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.374 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T02:18:39.374 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQA0bh9laXSWOBAAJm2oa8e4crvbb3JQRCGrGg==", 2023-10-06T02:18:39.375 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.375 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T02:18:39.375 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.375 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-10-06T02:18:39.375 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lMk4mEhAAbIAiSwyo+ygZRqxKBKRxuQ==", 2023-10-06T02:18:39.375 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.375 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:18:39.375 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-06T02:18:39.375 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:18:39.376 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:39.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:39.376 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-10-06T02:18:39.376 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lxXZSDRAALw3s8FP+gOrz+VIDN7tkuw==", 2023-10-06T02:18:39.376 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:18:39.376 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:18:39.376 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-06T02:18:39.376 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:18:39.377 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.377 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:39.377 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-06T02:18:39.377 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:18:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.356+0000 7f8ced069700 1 -- 172.21.15.6:0/191935058 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8cc8066f30 msgr2=0x7f8cc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.356+0000 7f8ced069700 1 --2- 172.21.15.6:0/191935058 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8cc8066f30 0x7f8cc80693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000f650 tx=0x7f8ce000b040 comp rx=0 tx=0).stop 2023-10-06T02:18:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.356+0000 7f8ced069700 1 -- 172.21.15.6:0/191935058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce80af8b0 msgr2=0x7f8ce8155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.356+0000 7f8ced069700 1 --2- 172.21.15.6:0/191935058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce80af8b0 0x7f8ce8155450 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000c7f0 tx=0x7f8cd0007dd0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.356+0000 7f8ced069700 1 -- 172.21.15.6:0/191935058 shutdown_connections 2023-10-06T02:18:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.356+0000 7f8ced069700 1 --2- 172.21.15.6:0/191935058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ce815db70 0x7f8ce8150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.356+0000 7f8ced069700 1 --2- 172.21.15.6:0/191935058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce80af4e0 0x7f8ce8157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.356+0000 7f8ced069700 1 --2- 172.21.15.6:0/191935058 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8cc8066f30 0x7f8cc80693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.356+0000 7f8ced069700 1 --2- 172.21.15.6:0/191935058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce80af8b0 0x7f8ce8155450 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.356+0000 7f8ced069700 1 -- 172.21.15.6:0/191935058 >> 172.21.15.6:0/191935058 conn(0x7f8ce8068680 msgr2=0x7f8ce815b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:39.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.356+0000 7f8ced069700 1 -- 172.21.15.6:0/191935058 shutdown_connections 2023-10-06T02:18:39.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.356+0000 7f8ced069700 1 -- 172.21.15.6:0/191935058 wait complete. 2023-10-06T02:18:39.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T02:18:39.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.500+0000 7fd9df212700 1 Processor -- start 2023-10-06T02:18:39.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.500+0000 7fd9df212700 1 -- start start 2023-10-06T02:18:39.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.501+0000 7fd9df212700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd9d80cf1a0 0x7fd9d80cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.501+0000 7fd9df212700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9d81597d0 0x7fd9d80d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.501+0000 7fd9df212700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d80b3560 con 0x7fd9d8159400 2023-10-06T02:18:39.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.501+0000 7fd9df212700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d80cf6f0 con 0x7fd9d80cf1a0 2023-10-06T02:18:39.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.501+0000 7fd9df212700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80cf9d0 con 0x7fd9d81597d0 2023-10-06T02:18:39.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.501+0000 7fd9dda0f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd9d80cf1a0 0x7fd9d80cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:39.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.501+0000 7fd9de210700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd9d8159400 0x7fd9d80ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43234/0 (socket says 172.21.15.6:43234) 2023-10-06T02:18:39.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.501+0000 7fd9de210700 1 -- 172.21.15.6:0/3064960431 learned_addr learned my addr 172.21.15.6:0/3064960431 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:39.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.501+0000 7fd9dda0f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd9d80cf1a0 0x7fd9d80cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40660/0 (socket says 172.21.15.6:40660) 2023-10-06T02:18:39.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.502+0000 7fd9dea11700 1 --2- 172.21.15.6:0/3064960431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9d81597d0 0x7fd9d80d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:39.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.502+0000 7fd9dda0f700 1 -- 172.21.15.6:0/3064960431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9d81597d0 msgr2=0x7fd9d80d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:39.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.502+0000 7fd9dda0f700 1 --2- 172.21.15.6:0/3064960431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9d81597d0 0x7fd9d80d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.502+0000 7fd9dda0f700 1 -- 172.21.15.6:0/3064960431 >> v1:172.21.15.6:6789/0 conn(0x7fd9d8159400 legacy=0x7fd9d80ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:39.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.502+0000 7fd9dd20e700 1 -- 172.21.15.6:0/3064960431 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040419014 0 0) 0x7fd9d80b3560 con 0x7fd9d8159400 2023-10-06T02:18:39.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.502+0000 7fd9dda0f700 1 -- 172.21.15.6:0/3064960431 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d80b2f10 con 0x7fd9d80cf1a0 2023-10-06T02:18:39.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.502+0000 7fd9dea11700 1 --2- 172.21.15.6:0/3064960431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9d81597d0 0x7fd9d80d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:39.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.502+0000 7fd9dda0f700 1 --2- 172.21.15.6:0/3064960431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d80cf1a0 0x7fd9d80cfec0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0098e0 tx=0x7fd9cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2bb040b5d5a718 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:39.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.502+0000 7fd9dd20e700 1 -- 172.21.15.6:0/3064960431 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc009e80 con 0x7fd9d80cf1a0 2023-10-06T02:18:39.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.502+0000 7fd9dd20e700 1 -- 172.21.15.6:0/3064960431 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc00b860 con 0x7fd9d80cf1a0 2023-10-06T02:18:39.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.502+0000 7fd9dd20e700 1 -- 172.21.15.6:0/3064960431 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc00bbe0 con 0x7fd9d80cf1a0 2023-10-06T02:18:39.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.502+0000 7fd9df212700 1 -- 172.21.15.6:0/3064960431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d80cf1a0 msgr2=0x7fd9d80cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:39.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.502+0000 7fd9df212700 1 --2- 172.21.15.6:0/3064960431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d80cf1a0 0x7fd9d80cfec0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0098e0 tx=0x7fd9cc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.502+0000 7fd9df212700 1 -- 172.21.15.6:0/3064960431 shutdown_connections 2023-10-06T02:18:39.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.502+0000 7fd9df212700 1 --2- 172.21.15.6:0/3064960431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9d81597d0 0x7fd9d80d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.502+0000 7fd9df212700 1 --2- 172.21.15.6:0/3064960431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d80cf1a0 0x7fd9d80cfec0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.503+0000 7fd9df212700 1 -- 172.21.15.6:0/3064960431 >> 172.21.15.6:0/3064960431 conn(0x7fd9d806ac10 msgr2=0x7fd9d8068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:39.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.503+0000 7fd9df212700 1 -- 172.21.15.6:0/3064960431 shutdown_connections 2023-10-06T02:18:39.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.503+0000 7fd9df212700 1 -- 172.21.15.6:0/3064960431 wait complete. 2023-10-06T02:18:39.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.504+0000 7fd9df212700 1 Processor -- start 2023-10-06T02:18:39.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.504+0000 7fd9df212700 1 -- start start 2023-10-06T02:18:39.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.504+0000 7fd9df212700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9d80cf1a0 0x7fd9d80c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.504+0000 7fd9df212700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d8159400 0x7fd9d81561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.504+0000 7fd9df212700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9d81597d0 0x7fd9d81543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.504+0000 7fd9df212700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80c5b20 con 0x7fd9d8159400 2023-10-06T02:18:39.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.504+0000 7fd9df212700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80c5e00 con 0x7fd9d81597d0 2023-10-06T02:18:39.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.504+0000 7fd9df212700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80c60e0 con 0x7fd9d80cf1a0 2023-10-06T02:18:39.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.504+0000 7fd9dda0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d8159400 0x7fd9d81561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.505+0000 7fd9dda0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d8159400 0x7fd9d81561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40668/0 (socket says 172.21.15.6:40668) 2023-10-06T02:18:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.505+0000 7fd9dda0f700 1 -- 172.21.15.6:0/4109250862 learned_addr learned my addr 172.21.15.6:0/4109250862 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.505+0000 7fd9de210700 1 --2- 172.21.15.6:0/4109250862 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9d80cf1a0 0x7fd9d80c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.505+0000 7fd9dea11700 1 --2- 172.21.15.6:0/4109250862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9d81597d0 0x7fd9d81543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.505+0000 7fd9dda0f700 1 -- 172.21.15.6:0/4109250862 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9d80cf1a0 msgr2=0x7fd9d80c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.505+0000 7fd9dda0f700 1 --2- 172.21.15.6:0/4109250862 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9d80cf1a0 0x7fd9d80c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.505+0000 7fd9dda0f700 1 -- 172.21.15.6:0/4109250862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9d81597d0 msgr2=0x7fd9d81543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.505+0000 7fd9dda0f700 1 --2- 172.21.15.6:0/4109250862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9d81597d0 0x7fd9d81543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.505+0000 7fd9dda0f700 1 -- 172.21.15.6:0/4109250862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc009420 con 0x7fd9d8159400 2023-10-06T02:18:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.505+0000 7fd9dda0f700 1 --2- 172.21.15.6:0/4109250862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d8159400 0x7fd9d81561c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd9d80b2b80 tx=0x7fd9cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.505+0000 7fd9d67fc700 1 -- 172.21.15.6:0/4109250862 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc00bbe0 con 0x7fd9d8159400 2023-10-06T02:18:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.505+0000 7fd9d67fc700 1 -- 172.21.15.6:0/4109250862 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc011420 con 0x7fd9d8159400 2023-10-06T02:18:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.505+0000 7fd9df212700 1 -- 172.21.15.6:0/4109250862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d80c63c0 con 0x7fd9d8159400 2023-10-06T02:18:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.505+0000 7fd9d67fc700 1 -- 172.21.15.6:0/4109250862 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0117e0 con 0x7fd9d8159400 2023-10-06T02:18:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.505+0000 7fd9df212700 1 -- 172.21.15.6:0/4109250862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d80c5810 con 0x7fd9d8159400 2023-10-06T02:18:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.506+0000 7fd9df212700 1 -- 172.21.15.6:0/4109250862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d815d660 con 0x7fd9d8159400 2023-10-06T02:18:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.507+0000 7fd9d67fc700 1 -- 172.21.15.6:0/4109250862 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9cc011bd0 con 0x7fd9d8159400 2023-10-06T02:18:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.507+0000 7fd9d67fc700 1 --2- 172.21.15.6:0/4109250862 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd9c4066f30 0x7fd9c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.507+0000 7fd9d67fc700 1 -- 172.21.15.6:0/4109250862 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fd9cc086010 con 0x7fd9d8159400 2023-10-06T02:18:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.507+0000 7fd9de210700 1 --2- 172.21.15.6:0/4109250862 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd9c4066f30 0x7fd9c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.508+0000 7fd9de210700 1 --2- 172.21.15.6:0/4109250862 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd9c4066f30 0x7fd9c40693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00016e0 tx=0x7fd9d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:39.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.511+0000 7fd9d67fc700 1 -- 172.21.15.6:0/4109250862 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9d815d660 con 0x7fd9d8159400 2023-10-06T02:18:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.783+0000 7fd9df212700 1 -- 172.21.15.6:0/4109250862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fd9d815d660 con 0x7fd9d8159400 2023-10-06T02:18:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.787+0000 7fd9d67fc700 1 -- 172.21.15.6:0/4109250862 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd9d815d660 con 0x7fd9d8159400 2023-10-06T02:18:39.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.789+0000 7fd9df212700 1 -- 172.21.15.6:0/4109250862 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd9c4066f30 msgr2=0x7fd9c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.789+0000 7fd9df212700 1 --2- 172.21.15.6:0/4109250862 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd9c4066f30 0x7fd9c40693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00016e0 tx=0x7fd9d0009040 comp rx=0 tx=0).stop 2023-10-06T02:18:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.789+0000 7fd9df212700 1 -- 172.21.15.6:0/4109250862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d8159400 msgr2=0x7fd9d81561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.789+0000 7fd9df212700 1 --2- 172.21.15.6:0/4109250862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d8159400 0x7fd9d81561c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd9d80b2b80 tx=0x7fd9cc017000 comp rx=0 tx=0).stop 2023-10-06T02:18:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.789+0000 7fd9df212700 1 -- 172.21.15.6:0/4109250862 shutdown_connections 2023-10-06T02:18:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.789+0000 7fd9df212700 1 --2- 172.21.15.6:0/4109250862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9d81597d0 0x7fd9d81543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.789+0000 7fd9df212700 1 --2- 172.21.15.6:0/4109250862 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9d80cf1a0 0x7fd9d80c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.789+0000 7fd9df212700 1 --2- 172.21.15.6:0/4109250862 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd9c4066f30 0x7fd9c40693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.789+0000 7fd9df212700 1 --2- 172.21.15.6:0/4109250862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d8159400 0x7fd9d81561c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.789+0000 7fd9df212700 1 -- 172.21.15.6:0/4109250862 >> 172.21.15.6:0/4109250862 conn(0x7fd9d806ac10 msgr2=0x7fd9d80d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.789+0000 7fd9df212700 1 -- 172.21.15.6:0/4109250862 shutdown_connections 2023-10-06T02:18:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.789+0000 7fd9df212700 1 -- 172.21.15.6:0/4109250862 wait complete. 2023-10-06T02:18:39.801 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T02:18:39.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.920+0000 7fdc00aac700 1 Processor -- start 2023-10-06T02:18:39.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.920+0000 7fdc00aac700 1 -- start start 2023-10-06T02:18:39.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.921+0000 7fdc00aac700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdbfc1574b0 0x7fdbfc0b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.921+0000 7fdc00aac700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbfc0b13f0 0x7fdbfc0c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.921+0000 7fdc00aac700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbfc0c3b40 con 0x7fdbfc0c4510 2023-10-06T02:18:39.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.921+0000 7fdc00aac700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbfc0c4990 con 0x7fdbfc1574b0 2023-10-06T02:18:39.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.921+0000 7fdc00aac700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0c2f30 con 0x7fdbfc0b13f0 2023-10-06T02:18:39.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.922+0000 7fdbf9d9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbfc0b13f0 0x7fdbfc0c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:39.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.922+0000 7fdbfa59c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdbfc1574b0 0x7fdbfc0b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:39.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.922+0000 7fdbf9d9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbfc0b13f0 0x7fdbfc0c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:38958/0 (socket says 172.21.15.6:38958) 2023-10-06T02:18:39.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.922+0000 7fdbfa59c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdbfc1574b0 0x7fdbfc0b0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:43482/0 (socket says 172.21.15.6:43482) 2023-10-06T02:18:39.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.922+0000 7fdbf9d9b700 1 -- 172.21.15.6:0/3550259994 learned_addr learned my addr 172.21.15.6:0/3550259994 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:39.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.922+0000 7fdbfa59c700 1 -- 172.21.15.6:0/3550259994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbfc0b13f0 msgr2=0x7fdbfc0c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:39.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.922+0000 7fdbfa59c700 1 --2- 172.21.15.6:0/3550259994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbfc0b13f0 0x7fdbfc0c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.922+0000 7fdbfa59c700 1 -- 172.21.15.6:0/3550259994 >> v1:172.21.15.175:6789/0 conn(0x7fdbfc0c4510 legacy=0x7fdbfc0cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:39.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.922+0000 7fdbfa59c700 1 -- 172.21.15.6:0/3550259994 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc0c3210 con 0x7fdbfc1574b0 2023-10-06T02:18:39.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.922+0000 7fdbf9d9b700 1 --2- 172.21.15.6:0/3550259994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbfc0b13f0 0x7fdbfc0c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:39.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.922+0000 7fdbfa59c700 1 --2- 172.21.15.6:0/3550259994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbfc1574b0 0x7fdbfc0b0eb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40098d0 tx=0x7fdbf4009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55888d9519ed8a67 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.925+0000 7fdbf959a700 1 -- 172.21.15.6:0/3550259994 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4005c10 con 0x7fdbfc1574b0 2023-10-06T02:18:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.925+0000 7fdbf959a700 1 -- 172.21.15.6:0/3550259994 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf4005d70 con 0x7fdbfc1574b0 2023-10-06T02:18:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.925+0000 7fdbf959a700 1 -- 172.21.15.6:0/3550259994 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4006280 con 0x7fdbfc1574b0 2023-10-06T02:18:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.926+0000 7fdc00aac700 1 -- 172.21.15.6:0/3550259994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbfc1574b0 msgr2=0x7fdbfc0b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.926+0000 7fdc00aac700 1 --2- 172.21.15.6:0/3550259994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbfc1574b0 0x7fdbfc0b0eb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40098d0 tx=0x7fdbf4009120 comp rx=0 tx=0).stop 2023-10-06T02:18:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.926+0000 7fdc00aac700 1 -- 172.21.15.6:0/3550259994 shutdown_connections 2023-10-06T02:18:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.926+0000 7fdc00aac700 1 --2- 172.21.15.6:0/3550259994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbfc1574b0 0x7fdbfc0b0eb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.926+0000 7fdc00aac700 1 --2- 172.21.15.6:0/3550259994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbfc0b13f0 0x7fdbfc0c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.926+0000 7fdc00aac700 1 -- 172.21.15.6:0/3550259994 >> 172.21.15.6:0/3550259994 conn(0x7fdbfc067910 msgr2=0x7fdbfc0ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.926+0000 7fdc00aac700 1 -- 172.21.15.6:0/3550259994 shutdown_connections 2023-10-06T02:18:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.926+0000 7fdc00aac700 1 -- 172.21.15.6:0/3550259994 wait complete. 2023-10-06T02:18:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.927+0000 7fdc00aac700 1 Processor -- start 2023-10-06T02:18:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.927+0000 7fdc00aac700 1 -- start start 2023-10-06T02:18:39.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.928+0000 7fdc00aac700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbfc0b13f0 0x7fdbfc154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.928+0000 7fdc00aac700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbfc0c4510 0x7fdbfc1519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.928+0000 7fdc00aac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbfc1574b0 0x7fdbfc151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.928+0000 7fdc00aac700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc14acb0 con 0x7fdbfc1574b0 2023-10-06T02:18:39.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.928+0000 7fdc00aac700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc14a980 con 0x7fdbfc0b13f0 2023-10-06T02:18:39.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.928+0000 7fdc00aac700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc155160 con 0x7fdbfc0c4510 2023-10-06T02:18:39.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.928+0000 7fdbfad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbfc1574b0 0x7fdbfc151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:39.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.928+0000 7fdbfad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbfc1574b0 0x7fdbfc151f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40674/0 (socket says 172.21.15.6:40674) 2023-10-06T02:18:39.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.928+0000 7fdbfad9d700 1 -- 172.21.15.6:0/3479107000 learned_addr learned my addr 172.21.15.6:0/3479107000 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.928+0000 7fdbf9d9b700 1 --2- 172.21.15.6:0/3479107000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbfc0c4510 0x7fdbfc1519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.928+0000 7fdbfad9d700 1 -- 172.21.15.6:0/3479107000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbfc0c4510 msgr2=0x7fdbfc1519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.928+0000 7fdbfad9d700 1 --2- 172.21.15.6:0/3479107000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbfc0c4510 0x7fdbfc1519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.928+0000 7fdbfad9d700 1 -- 172.21.15.6:0/3479107000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbfc0b13f0 msgr2=0x7fdbfc154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.928+0000 7fdbfad9d700 1 --2- 172.21.15.6:0/3479107000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbfc0b13f0 0x7fdbfc154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.928+0000 7fdbfad9d700 1 -- 172.21.15.6:0/3479107000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe40094f0 con 0x7fdbfc1574b0 2023-10-06T02:18:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.928+0000 7fdbf9d9b700 1 --2- 172.21.15.6:0/3479107000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbfc0c4510 0x7fdbfc1519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.929+0000 7fdbfad9d700 1 --2- 172.21.15.6:0/3479107000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbfc1574b0 0x7fdbfc151f10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00c8e0 tx=0x7fdbec001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.929+0000 7fdbf27fc700 1 -- 172.21.15.6:0/3479107000 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec00ce80 con 0x7fdbfc1574b0 2023-10-06T02:18:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.929+0000 7fdbf27fc700 1 -- 172.21.15.6:0/3479107000 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec00a7e0 con 0x7fdbfc1574b0 2023-10-06T02:18:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.929+0000 7fdc00aac700 1 -- 172.21.15.6:0/3479107000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf40093c0 con 0x7fdbfc1574b0 2023-10-06T02:18:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.929+0000 7fdbf27fc700 1 -- 172.21.15.6:0/3479107000 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec00ab80 con 0x7fdbfc1574b0 2023-10-06T02:18:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.929+0000 7fdc00aac700 1 -- 172.21.15.6:0/3479107000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbfc155720 con 0x7fdbfc1574b0 2023-10-06T02:18:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.930+0000 7fdc00aac700 1 -- 172.21.15.6:0/3479107000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbfc155940 con 0x7fdbfc1574b0 2023-10-06T02:18:39.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.930+0000 7fdbf27fc700 1 -- 172.21.15.6:0/3479107000 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdbec012420 con 0x7fdbfc1574b0 2023-10-06T02:18:39.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.931+0000 7fdbf27fc700 1 --2- 172.21.15.6:0/3479107000 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdbdc066f30 0x7fdbdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:39.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.931+0000 7fdbf27fc700 1 -- 172.21.15.6:0/3479107000 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fdbec0847a0 con 0x7fdbfc1574b0 2023-10-06T02:18:39.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.931+0000 7fdbfa59c700 1 --2- 172.21.15.6:0/3479107000 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdbdc066f30 0x7fdbdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:39.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.932+0000 7fdbfa59c700 1 --2- 172.21.15.6:0/3479107000 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdbdc066f30 0x7fdbdc0693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009340 tx=0x7fdbf4016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:39.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:39.935+0000 7fdbf27fc700 1 -- 172.21.15.6:0/3479107000 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbec051ac0 con 0x7fdbfc1574b0 2023-10-06T02:18:40.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.205+0000 7fdc00aac700 1 -- 172.21.15.6:0/3479107000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fdbfc06e590 con 0x7fdbfc1574b0 2023-10-06T02:18:40.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.209+0000 7fdbf27fc700 1 -- 172.21.15.6:0/3479107000 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdbec0550e0 con 0x7fdbfc1574b0 2023-10-06T02:18:40.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.211+0000 7fdc00aac700 1 -- 172.21.15.6:0/3479107000 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdbdc066f30 msgr2=0x7fdbdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:40.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.211+0000 7fdc00aac700 1 --2- 172.21.15.6:0/3479107000 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdbdc066f30 0x7fdbdc0693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009340 tx=0x7fdbf4016000 comp rx=0 tx=0).stop 2023-10-06T02:18:40.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.211+0000 7fdc00aac700 1 -- 172.21.15.6:0/3479107000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbfc1574b0 msgr2=0x7fdbfc151f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:40.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.211+0000 7fdc00aac700 1 --2- 172.21.15.6:0/3479107000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbfc1574b0 0x7fdbfc151f10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00c8e0 tx=0x7fdbec001710 comp rx=0 tx=0).stop 2023-10-06T02:18:40.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.211+0000 7fdc00aac700 1 -- 172.21.15.6:0/3479107000 shutdown_connections 2023-10-06T02:18:40.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.211+0000 7fdc00aac700 1 --2- 172.21.15.6:0/3479107000 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdbdc066f30 0x7fdbdc0693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.211+0000 7fdc00aac700 1 --2- 172.21.15.6:0/3479107000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbfc1574b0 0x7fdbfc151f10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.211+0000 7fdc00aac700 1 --2- 172.21.15.6:0/3479107000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbfc0b13f0 0x7fdbfc154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.211+0000 7fdc00aac700 1 --2- 172.21.15.6:0/3479107000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdbfc0c4510 0x7fdbfc1519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.211+0000 7fdc00aac700 1 -- 172.21.15.6:0/3479107000 >> 172.21.15.6:0/3479107000 conn(0x7fdbfc067910 msgr2=0x7fdbfc06daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:40.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.211+0000 7fdc00aac700 1 -- 172.21.15.6:0/3479107000 shutdown_connections 2023-10-06T02:18:40.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.211+0000 7fdc00aac700 1 -- 172.21.15.6:0/3479107000 wait complete. 2023-10-06T02:18:40.223 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T02:18:40.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.343+0000 7f1fda393700 1 Processor -- start 2023-10-06T02:18:40.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.343+0000 7f1fda393700 1 -- start start 2023-10-06T02:18:40.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.344+0000 7f1fda393700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1fd415a030 0x7f1fd415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:40.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.344+0000 7f1fda393700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1fd4087700 0x7f1fd40b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:40.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.344+0000 7f1fda393700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd40afc50 con 0x7f1fd415a940 2023-10-06T02:18:40.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.344+0000 7f1fda393700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd40b0cf0 con 0x7f1fd415a030 2023-10-06T02:18:40.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.344+0000 7f1fda393700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd40aff30 con 0x7f1fd4087700 2023-10-06T02:18:40.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.344+0000 7f1fd3fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1fd415a030 0x7f1fd415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:40.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.344+0000 7f1fd3fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1fd415a030 0x7f1fd415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40686/0 (socket says 172.21.15.6:40686) 2023-10-06T02:18:40.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.344+0000 7f1fd3fff700 1 -- 172.21.15.6:0/1104784049 learned_addr learned my addr 172.21.15.6:0/1104784049 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:40.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.344+0000 7f1fd37fe700 1 --1- 172.21.15.6:0/1104784049 >> v1:172.21.15.6:6789/0 conn(0x7f1fd415a940 0x7f1fd4086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43248/0 (socket says 172.21.15.6:43248) 2023-10-06T02:18:40.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.344+0000 7f1fd8930700 1 --2- 172.21.15.6:0/1104784049 >> v2:172.21.15.175:3300/0 conn(0x7f1fd4087700 0x7f1fd40b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:40.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.344+0000 7f1fd3fff700 1 -- 172.21.15.6:0/1104784049 >> v2:172.21.15.175:3300/0 conn(0x7f1fd4087700 msgr2=0x7f1fd40b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:40.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.344+0000 7f1fd3fff700 1 --2- 172.21.15.6:0/1104784049 >> v2:172.21.15.175:3300/0 conn(0x7f1fd4087700 0x7f1fd40b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.344+0000 7f1fd3fff700 1 -- 172.21.15.6:0/1104784049 >> v1:172.21.15.6:6789/0 conn(0x7f1fd415a940 legacy=0x7f1fd4086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:40.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.344+0000 7f1fd3fff700 1 -- 172.21.15.6:0/1104784049 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd40b0210 con 0x7f1fd415a030 2023-10-06T02:18:40.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.344+0000 7f1fd2ffd700 1 -- 172.21.15.6:0/1104784049 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424722756 0 0) 0x7f1fd40afc50 con 0x7f1fd415a940 2023-10-06T02:18:40.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.344+0000 7f1fd3fff700 1 --2- 172.21.15.6:0/1104784049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd415a030 0x7f1fd415a400 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40cdd90 tx=0x7f1fbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6b41ba99a51674 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:40.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.345+0000 7f1fd2ffd700 1 -- 172.21.15.6:0/1104784049 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc00b860 con 0x7f1fd415a030 2023-10-06T02:18:40.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.345+0000 7f1fd2ffd700 1 -- 172.21.15.6:0/1104784049 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fbc00b9c0 con 0x7f1fd415a030 2023-10-06T02:18:40.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.345+0000 7f1fd2ffd700 1 -- 172.21.15.6:0/1104784049 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc00bd60 con 0x7f1fd415a030 2023-10-06T02:18:40.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.345+0000 7f1fda393700 1 -- 172.21.15.6:0/1104784049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd415a030 msgr2=0x7f1fd415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:40.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.345+0000 7f1fda393700 1 --2- 172.21.15.6:0/1104784049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd415a030 0x7f1fd415a400 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40cdd90 tx=0x7f1fbc009250 comp rx=0 tx=0).stop 2023-10-06T02:18:40.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.345+0000 7f1fda393700 1 -- 172.21.15.6:0/1104784049 shutdown_connections 2023-10-06T02:18:40.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.345+0000 7f1fda393700 1 --2- 172.21.15.6:0/1104784049 >> v2:172.21.15.175:3300/0 conn(0x7f1fd4087700 0x7f1fd40b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.345+0000 7f1fda393700 1 --2- 172.21.15.6:0/1104784049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd415a030 0x7f1fd415a400 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.345+0000 7f1fda393700 1 -- 172.21.15.6:0/1104784049 >> 172.21.15.6:0/1104784049 conn(0x7f1fd4068680 msgr2=0x7f1fd4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:40.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.345+0000 7f1fda393700 1 -- 172.21.15.6:0/1104784049 shutdown_connections 2023-10-06T02:18:40.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.345+0000 7f1fda393700 1 -- 172.21.15.6:0/1104784049 wait complete. 2023-10-06T02:18:40.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.346+0000 7f1fda393700 1 Processor -- start 2023-10-06T02:18:40.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.346+0000 7f1fda393700 1 -- start start 2023-10-06T02:18:40.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.347+0000 7f1fda393700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fd4087700 0x7f1fd40c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:40.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.347+0000 7f1fda393700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fd415a030 0x7f1fd416d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:40.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.347+0000 7f1fda393700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd415a940 0x7f1fd416db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:40.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.347+0000 7f1fda393700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd40c5140 con 0x7f1fd415a940 2023-10-06T02:18:40.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.347+0000 7f1fda393700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd40c4530 con 0x7f1fd415a030 2023-10-06T02:18:40.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.347+0000 7f1fda393700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd40c4810 con 0x7f1fd4087700 2023-10-06T02:18:40.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.347+0000 7f1fd8930700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd415a940 0x7f1fd416db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:40.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.347+0000 7f1fd8930700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd415a940 0x7f1fd416db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40700/0 (socket says 172.21.15.6:40700) 2023-10-06T02:18:40.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.347+0000 7f1fd8930700 1 -- 172.21.15.6:0/2393681638 learned_addr learned my addr 172.21.15.6:0/2393681638 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:40.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.347+0000 7f1fd37fe700 1 --2- 172.21.15.6:0/2393681638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fd415a030 0x7f1fd416d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:40.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.347+0000 7f1fd3fff700 1 --2- 172.21.15.6:0/2393681638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fd4087700 0x7f1fd40c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:40.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.348+0000 7f1fd8930700 1 -- 172.21.15.6:0/2393681638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fd4087700 msgr2=0x7f1fd40c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:40.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.348+0000 7f1fd8930700 1 --2- 172.21.15.6:0/2393681638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fd4087700 0x7f1fd40c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.348+0000 7f1fd8930700 1 -- 172.21.15.6:0/2393681638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fd415a030 msgr2=0x7f1fd416d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:40.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.348+0000 7f1fd8930700 1 --2- 172.21.15.6:0/2393681638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fd415a030 0x7f1fd416d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.348+0000 7f1fd8930700 1 -- 172.21.15.6:0/2393681638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc0094f0 con 0x7f1fd415a940 2023-10-06T02:18:40.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.348+0000 7f1fd8930700 1 --2- 172.21.15.6:0/2393681638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd415a940 0x7f1fd416db60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc007f20 tx=0x7f1fcc0098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:40.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.348+0000 7f1fcbfff700 1 -- 172.21.15.6:0/2393681638 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc00eb90 con 0x7f1fd415a940 2023-10-06T02:18:40.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.348+0000 7f1fcbfff700 1 -- 172.21.15.6:0/2393681638 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc00ed10 con 0x7f1fd415a940 2023-10-06T02:18:40.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.348+0000 7f1fda393700 1 -- 172.21.15.6:0/2393681638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd40c4af0 con 0x7f1fd415a940 2023-10-06T02:18:40.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.348+0000 7f1fcbfff700 1 -- 172.21.15.6:0/2393681638 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc014670 con 0x7f1fd415a940 2023-10-06T02:18:40.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.348+0000 7f1fda393700 1 -- 172.21.15.6:0/2393681638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd40c4100 con 0x7f1fd415a940 2023-10-06T02:18:40.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.349+0000 7f1fda393700 1 -- 172.21.15.6:0/2393681638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd4088700 con 0x7f1fd415a940 2023-10-06T02:18:40.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.349+0000 7f1fcbfff700 1 -- 172.21.15.6:0/2393681638 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fcc014a60 con 0x7f1fd415a940 2023-10-06T02:18:40.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.350+0000 7f1fcbfff700 1 --2- 172.21.15.6:0/2393681638 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1fb4066f30 0x7f1fb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:40.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.350+0000 7f1fcbfff700 1 -- 172.21.15.6:0/2393681638 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f1fcc084aa0 con 0x7f1fd415a940 2023-10-06T02:18:40.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.350+0000 7f1fd3fff700 1 --2- 172.21.15.6:0/2393681638 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1fb4066f30 0x7f1fb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:40.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.350+0000 7f1fd3fff700 1 --2- 172.21.15.6:0/2393681638 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1fb4066f30 0x7f1fb40693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40cdd90 tx=0x7f1fbc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:40.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.354+0000 7f1fcbfff700 1 -- 172.21.15.6:0/2393681638 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fcc051dc0 con 0x7f1fd415a940 2023-10-06T02:18:40.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.624+0000 7f1fda393700 1 -- 172.21.15.6:0/2393681638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f1fd40c5280 con 0x7f1fd415a940 2023-10-06T02:18:40.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.628+0000 7f1fcbfff700 1 -- 172.21.15.6:0/2393681638 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1fd40c5280 con 0x7f1fd415a940 2023-10-06T02:18:40.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.630+0000 7f1fda393700 1 -- 172.21.15.6:0/2393681638 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1fb4066f30 msgr2=0x7f1fb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:40.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.630+0000 7f1fda393700 1 --2- 172.21.15.6:0/2393681638 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1fb4066f30 0x7f1fb40693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40cdd90 tx=0x7f1fbc017000 comp rx=0 tx=0).stop 2023-10-06T02:18:40.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.630+0000 7f1fda393700 1 -- 172.21.15.6:0/2393681638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd415a940 msgr2=0x7f1fd416db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:40.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.630+0000 7f1fda393700 1 --2- 172.21.15.6:0/2393681638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd415a940 0x7f1fd416db60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc007f20 tx=0x7f1fcc0098a0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.630+0000 7f1fda393700 1 -- 172.21.15.6:0/2393681638 shutdown_connections 2023-10-06T02:18:40.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.630+0000 7f1fda393700 1 --2- 172.21.15.6:0/2393681638 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1fb4066f30 0x7f1fb40693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.630+0000 7f1fda393700 1 --2- 172.21.15.6:0/2393681638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fd415a940 0x7f1fd416db60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.630+0000 7f1fda393700 1 --2- 172.21.15.6:0/2393681638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fd4087700 0x7f1fd40c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.630+0000 7f1fda393700 1 --2- 172.21.15.6:0/2393681638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fd415a030 0x7f1fd416d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.630+0000 7f1fda393700 1 -- 172.21.15.6:0/2393681638 >> 172.21.15.6:0/2393681638 conn(0x7f1fd4068680 msgr2=0x7f1fd40b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:40.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.630+0000 7f1fda393700 1 -- 172.21.15.6:0/2393681638 shutdown_connections 2023-10-06T02:18:40.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.630+0000 7f1fda393700 1 -- 172.21.15.6:0/2393681638 wait complete. 2023-10-06T02:18:40.642 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T02:18:40.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.762+0000 7f7bdf59e700 1 Processor -- start 2023-10-06T02:18:40.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.762+0000 7f7bdf59e700 1 -- start start 2023-10-06T02:18:40.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.763+0000 7f7bdf59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7be00688d0 0x7f7be00afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:40.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.763+0000 7f7bdf59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7be00af390 0x7f7be01594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:40.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.763+0000 7f7bdf59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be00b2330 con 0x7f7be00b0140 2023-10-06T02:18:40.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.763+0000 7f7bdf59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be00ac720 con 0x7f7be00af390 2023-10-06T02:18:40.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.763+0000 7f7bdf59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be00b25d0 con 0x7f7be00688d0 2023-10-06T02:18:40.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.763+0000 7f7bded9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7be00af390 0x7f7be01594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:40.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.763+0000 7f7bddd9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7be00b0140 0x7f7be0158db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43260/0 (socket says 172.21.15.6:43260) 2023-10-06T02:18:40.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.763+0000 7f7bddd9b700 1 -- 172.21.15.6:0/2325544129 learned_addr learned my addr 172.21.15.6:0/2325544129 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:40.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.763+0000 7f7bde59c700 1 --2- 172.21.15.6:0/2325544129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7be00688d0 0x7f7be00afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:40.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.763+0000 7f7bded9d700 1 -- 172.21.15.6:0/2325544129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7be00688d0 msgr2=0x7f7be00afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:40.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.763+0000 7f7bded9d700 1 --2- 172.21.15.6:0/2325544129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7be00688d0 0x7f7be00afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.763+0000 7f7bded9d700 1 -- 172.21.15.6:0/2325544129 >> v1:172.21.15.6:6789/0 conn(0x7f7be00b0140 legacy=0x7f7be0158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:40.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.763+0000 7f7bded9d700 1 -- 172.21.15.6:0/2325544129 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be00b28b0 con 0x7f7be00af390 2023-10-06T02:18:40.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.763+0000 7f7bdd59a700 1 -- 172.21.15.6:0/2325544129 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734431277 0 0) 0x7f7be00b2330 con 0x7f7be00b0140 2023-10-06T02:18:40.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.764+0000 7f7bded9d700 1 --2- 172.21.15.6:0/2325544129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be00af390 0x7f7be01594c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7bd80098e0 tx=0x7f7bd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81f38af730b9f68 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:40.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.764+0000 7f7bdd59a700 1 -- 172.21.15.6:0/2325544129 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8009e80 con 0x7f7be00af390 2023-10-06T02:18:40.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.764+0000 7f7bdd59a700 1 -- 172.21.15.6:0/2325544129 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd800b860 con 0x7f7be00af390 2023-10-06T02:18:40.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.764+0000 7f7bdd59a700 1 -- 172.21.15.6:0/2325544129 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800bbe0 con 0x7f7be00af390 2023-10-06T02:18:40.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.764+0000 7f7bdf59e700 1 -- 172.21.15.6:0/2325544129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be00af390 msgr2=0x7f7be01594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.764+0000 7f7bdf59e700 1 --2- 172.21.15.6:0/2325544129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be00af390 0x7f7be01594c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7bd80098e0 tx=0x7f7bd80091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.764+0000 7f7bdf59e700 1 -- 172.21.15.6:0/2325544129 shutdown_connections 2023-10-06T02:18:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.764+0000 7f7bdf59e700 1 --2- 172.21.15.6:0/2325544129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be00af390 0x7f7be01594c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.764+0000 7f7bdf59e700 1 --2- 172.21.15.6:0/2325544129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7be00688d0 0x7f7be00afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.764+0000 7f7bdf59e700 1 -- 172.21.15.6:0/2325544129 >> 172.21.15.6:0/2325544129 conn(0x7f7be0096240 msgr2=0x7f7be0069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.764+0000 7f7bdf59e700 1 -- 172.21.15.6:0/2325544129 shutdown_connections 2023-10-06T02:18:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.764+0000 7f7bdf59e700 1 -- 172.21.15.6:0/2325544129 wait complete. 2023-10-06T02:18:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.765+0000 7f7bdf59e700 1 Processor -- start 2023-10-06T02:18:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.765+0000 7f7bdf59e700 1 -- start start 2023-10-06T02:18:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.766+0000 7f7bdf59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7be00688d0 0x7f7be016da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.766+0000 7f7bdf59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7be00af390 0x7f7be00c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.766+0000 7f7bdf59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be0099300 0x7f7be015bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.766+0000 7f7bdf59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be009a5c0 con 0x7f7be0099300 2023-10-06T02:18:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.766+0000 7f7bdf59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be0169a50 con 0x7f7be00688d0 2023-10-06T02:18:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.766+0000 7f7bdf59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be016a2f0 con 0x7f7be00af390 2023-10-06T02:18:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.766+0000 7f7bded9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be0099300 0x7f7be015bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.766+0000 7f7bded9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be0099300 0x7f7be015bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40712/0 (socket says 172.21.15.6:40712) 2023-10-06T02:18:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.766+0000 7f7bded9d700 1 -- 172.21.15.6:0/678088781 learned_addr learned my addr 172.21.15.6:0/678088781 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.767+0000 7f7bde59c700 1 --2- 172.21.15.6:0/678088781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7be00688d0 0x7f7be016da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.767+0000 7f7bded9d700 1 -- 172.21.15.6:0/678088781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7be00af390 msgr2=0x7f7be00c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.767+0000 7f7bddd9b700 1 --2- 172.21.15.6:0/678088781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7be00af390 0x7f7be00c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.767+0000 7f7bded9d700 1 --2- 172.21.15.6:0/678088781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7be00af390 0x7f7be00c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.767+0000 7f7bded9d700 1 -- 172.21.15.6:0/678088781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7be00688d0 msgr2=0x7f7be016da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.767+0000 7f7bded9d700 1 --2- 172.21.15.6:0/678088781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7be00688d0 0x7f7be016da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.767+0000 7f7bded9d700 1 -- 172.21.15.6:0/678088781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd8009420 con 0x7f7be0099300 2023-10-06T02:18:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.767+0000 7f7bde59c700 1 --2- 172.21.15.6:0/678088781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7be00688d0 0x7f7be016da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.767+0000 7f7bded9d700 1 --2- 172.21.15.6:0/678088781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be0099300 0x7f7be015bf40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8013000 tx=0x7f7bd8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.767+0000 7f7bd67fc700 1 -- 172.21.15.6:0/678088781 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8025420 con 0x7f7be0099300 2023-10-06T02:18:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.767+0000 7f7bd67fc700 1 -- 172.21.15.6:0/678088781 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd80255a0 con 0x7f7be0099300 2023-10-06T02:18:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.767+0000 7f7bdf59e700 1 -- 172.21.15.6:0/678088781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be00997e0 con 0x7f7be0099300 2023-10-06T02:18:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.767+0000 7f7bd67fc700 1 -- 172.21.15.6:0/678088781 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8025960 con 0x7f7be0099300 2023-10-06T02:18:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.767+0000 7f7bdf59e700 1 -- 172.21.15.6:0/678088781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be0169f80 con 0x7f7be0099300 2023-10-06T02:18:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.768+0000 7f7bdf59e700 1 -- 172.21.15.6:0/678088781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be016a460 con 0x7f7be0099300 2023-10-06T02:18:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.768+0000 7f7bd67fc700 1 -- 172.21.15.6:0/678088781 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bd8023070 con 0x7f7be0099300 2023-10-06T02:18:40.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.769+0000 7f7bd67fc700 1 --2- 172.21.15.6:0/678088781 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bc0066f30 0x7f7bc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:40.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.769+0000 7f7bd67fc700 1 -- 172.21.15.6:0/678088781 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f7bd8086040 con 0x7f7be0099300 2023-10-06T02:18:40.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.769+0000 7f7bde59c700 1 --2- 172.21.15.6:0/678088781 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bc0066f30 0x7f7bc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:40.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.769+0000 7f7bde59c700 1 --2- 172.21.15.6:0/678088781 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bc0066f30 0x7f7bc00693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7be00a78b0 tx=0x7f7bd0007650 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:40.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:40.773+0000 7f7bd67fc700 1 -- 172.21.15.6:0/678088781 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bd8053360 con 0x7f7be0099300 2023-10-06T02:18:41.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.046+0000 7f7bdf59e700 1 -- 172.21.15.6:0/678088781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f7be00ac4f0 con 0x7f7be0099300 2023-10-06T02:18:41.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.050+0000 7f7bd67fc700 1 -- 172.21.15.6:0/678088781 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7bd8056980 con 0x7f7be0099300 2023-10-06T02:18:41.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.052+0000 7f7bdf59e700 1 -- 172.21.15.6:0/678088781 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bc0066f30 msgr2=0x7f7bc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:41.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.052+0000 7f7bdf59e700 1 --2- 172.21.15.6:0/678088781 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bc0066f30 0x7f7bc00693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7be00a78b0 tx=0x7f7bd0007650 comp rx=0 tx=0).stop 2023-10-06T02:18:41.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.052+0000 7f7bdf59e700 1 -- 172.21.15.6:0/678088781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be0099300 msgr2=0x7f7be015bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:41.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.052+0000 7f7bdf59e700 1 --2- 172.21.15.6:0/678088781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be0099300 0x7f7be015bf40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8013000 tx=0x7f7bd8017000 comp rx=0 tx=0).stop 2023-10-06T02:18:41.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.052+0000 7f7bdf59e700 1 -- 172.21.15.6:0/678088781 shutdown_connections 2023-10-06T02:18:41.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.052+0000 7f7bdf59e700 1 --2- 172.21.15.6:0/678088781 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bc0066f30 0x7f7bc00693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.052+0000 7f7bdf59e700 1 --2- 172.21.15.6:0/678088781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be0099300 0x7f7be015bf40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.052+0000 7f7bdf59e700 1 --2- 172.21.15.6:0/678088781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7be00688d0 0x7f7be016da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.052+0000 7f7bdf59e700 1 --2- 172.21.15.6:0/678088781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7be00af390 0x7f7be00c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.052+0000 7f7bdf59e700 1 -- 172.21.15.6:0/678088781 >> 172.21.15.6:0/678088781 conn(0x7f7be0096240 msgr2=0x7f7be0159050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:41.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.052+0000 7f7bdf59e700 1 -- 172.21.15.6:0/678088781 shutdown_connections 2023-10-06T02:18:41.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.052+0000 7f7bdf59e700 1 -- 172.21.15.6:0/678088781 wait complete. 2023-10-06T02:18:41.065 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T02:18:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.184+0000 7f64c65c6700 1 Processor -- start 2023-10-06T02:18:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.184+0000 7f64c65c6700 1 -- start start 2023-10-06T02:18:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.185+0000 7f64c65c6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f64c006f130 0x7f64c00c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.185+0000 7f64c65c6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64c0155920 0x7f64c00c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.185+0000 7f64c65c6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c00c14c0 con 0x7f64c0155550 2023-10-06T02:18:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.185+0000 7f64c65c6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c00c2960 con 0x7f64c006f130 2023-10-06T02:18:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.185+0000 7f64c65c6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c00c8570 con 0x7f64c0155920 2023-10-06T02:18:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.185+0000 7f64c55c4700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f64c0155550 0x7f64c006ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43276/0 (socket says 172.21.15.6:43276) 2023-10-06T02:18:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.185+0000 7f64c55c4700 1 -- 172.21.15.6:0/3646792506 learned_addr learned my addr 172.21.15.6:0/3646792506 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:41.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.185+0000 7f64bffff700 1 -- 172.21.15.6:0/3646792506 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813601313 0 0) 0x7f64c00c14c0 con 0x7f64c0155550 2023-10-06T02:18:41.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.185+0000 7f64c5dc5700 1 --2- 172.21.15.6:0/3646792506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64c0155920 0x7f64c00c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:41.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64c4dc3700 1 --2- 172.21.15.6:0/3646792506 >> v2:172.21.15.175:3300/0 conn(0x7f64c006f130 0x7f64c00c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:41.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64bffff700 1 -- 172.21.15.6:0/3646792506 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64a8004680 con 0x7f64c0155550 2023-10-06T02:18:41.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64bffff700 1 -- 172.21.15.6:0/3646792506 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3244893957 0 0) 0x7f64a8004680 con 0x7f64c0155550 2023-10-06T02:18:41.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64bffff700 1 -- 172.21.15.6:0/3646792506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64c0155920 msgr2=0x7f64c00c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:41.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64bffff700 1 --2- 172.21.15.6:0/3646792506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64c0155920 0x7f64c00c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64bffff700 1 -- 172.21.15.6:0/3646792506 >> v2:172.21.15.175:3300/0 conn(0x7f64c006f130 msgr2=0x7f64c00c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64bffff700 1 --2- 172.21.15.6:0/3646792506 >> v2:172.21.15.175:3300/0 conn(0x7f64c006f130 0x7f64c00c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64bffff700 1 -- 172.21.15.6:0/3646792506 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c00c0b90 con 0x7f64c0155550 2023-10-06T02:18:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64bffff700 1 -- 172.21.15.6:0/3646792506 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f64b0001470 con 0x7f64c0155550 2023-10-06T02:18:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64bffff700 1 -- 172.21.15.6:0/3646792506 >> v1:172.21.15.6:6789/0 conn(0x7f64c0155550 legacy=0x7f64c006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64bffff700 1 --2- 172.21.15.6:0/3646792506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64c0155920 0x7f64a8004b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64bffff700 1 --2- 172.21.15.6:0/3646792506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64a80050f0 0x7f64a8005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64bffff700 1 --2- 172.21.15.6:0/3646792506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64a8005e60 0x7f64a80062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64bffff700 1 -- 172.21.15.6:0/3646792506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c00c2960 con 0x7f64a80050f0 2023-10-06T02:18:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64bffff700 1 -- 172.21.15.6:0/3646792506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c00c8570 con 0x7f64a8005e60 2023-10-06T02:18:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64bffff700 1 -- 172.21.15.6:0/3646792506 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a800cba0 con 0x7f64c0155920 2023-10-06T02:18:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64c4dc3700 1 --2- 172.21.15.6:0/3646792506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64a80050f0 0x7f64a8005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64c55c4700 1 --2- 172.21.15.6:0/3646792506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64c0155920 0x7f64a8004b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64c5dc5700 1 --2- 172.21.15.6:0/3646792506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64a8005e60 0x7f64a80062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64c4dc3700 1 -- 172.21.15.6:0/3646792506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64c0155920 msgr2=0x7f64a8004b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64c4dc3700 1 --2- 172.21.15.6:0/3646792506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64c0155920 0x7f64a8004b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64c4dc3700 1 -- 172.21.15.6:0/3646792506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64a8005e60 msgr2=0x7f64a80062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64c4dc3700 1 --2- 172.21.15.6:0/3646792506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64a8005e60 0x7f64a80062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.186+0000 7f64c4dc3700 1 -- 172.21.15.6:0/3646792506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a8004680 con 0x7f64a80050f0 2023-10-06T02:18:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.187+0000 7f64c4dc3700 1 --2- 172.21.15.6:0/3646792506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64a80050f0 0x7f64a8005920 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009c00 tx=0x7f64b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6584c721ca49648f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.187+0000 7f64bffff700 1 -- 172.21.15.6:0/3646792506 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b400e6b0 con 0x7f64a80050f0 2023-10-06T02:18:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.187+0000 7f64bffff700 1 -- 172.21.15.6:0/3646792506 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b400e810 con 0x7f64a80050f0 2023-10-06T02:18:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.187+0000 7f64bffff700 1 -- 172.21.15.6:0/3646792506 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b400ebd0 con 0x7f64a80050f0 2023-10-06T02:18:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.187+0000 7f64c65c6700 1 -- 172.21.15.6:0/3646792506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64a80050f0 msgr2=0x7f64a8005920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.187+0000 7f64c65c6700 1 --2- 172.21.15.6:0/3646792506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64a80050f0 0x7f64a8005920 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009c00 tx=0x7f64b40091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.187+0000 7f64c5dc5700 1 -- 172.21.15.6:0/3646792506 reap_dead start 2023-10-06T02:18:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.187+0000 7f64c65c6700 1 -- 172.21.15.6:0/3646792506 shutdown_connections 2023-10-06T02:18:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.187+0000 7f64c65c6700 1 -- 172.21.15.6:0/3646792506 >> 172.21.15.6:0/3646792506 conn(0x7f64c00cbd50 msgr2=0x7f64c00cc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.187+0000 7f64c65c6700 1 -- 172.21.15.6:0/3646792506 shutdown_connections 2023-10-06T02:18:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.187+0000 7f64c65c6700 1 -- 172.21.15.6:0/3646792506 wait complete. 2023-10-06T02:18:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.188+0000 7f64c65c6700 1 Processor -- start 2023-10-06T02:18:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.188+0000 7f64c65c6700 1 -- start start 2023-10-06T02:18:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.189+0000 7f64c65c6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64a80050f0 0x7f64c013c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.189+0000 7f64c65c6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64c016ae60 0x7f64c0168200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.189+0000 7f64c65c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64c00c4490 0x7f64c00c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.189+0000 7f64c65c6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c016b2d0 con 0x7f64c00c4490 2023-10-06T02:18:41.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.189+0000 7f64c65c6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c00c4000 con 0x7f64a80050f0 2023-10-06T02:18:41.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.189+0000 7f64c65c6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c0168740 con 0x7f64c016ae60 2023-10-06T02:18:41.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.189+0000 7f64c5dc5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64c00c4490 0x7f64c00c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:41.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.190+0000 7f64c5dc5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64c00c4490 0x7f64c00c4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40724/0 (socket says 172.21.15.6:40724) 2023-10-06T02:18:41.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.190+0000 7f64c5dc5700 1 -- 172.21.15.6:0/2593616252 learned_addr learned my addr 172.21.15.6:0/2593616252 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:41.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.190+0000 7f64c4dc3700 1 --2- 172.21.15.6:0/2593616252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64c016ae60 0x7f64c0168200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:41.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.190+0000 7f64c55c4700 1 --2- 172.21.15.6:0/2593616252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64a80050f0 0x7f64c013c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:41.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.190+0000 7f64c5dc5700 1 -- 172.21.15.6:0/2593616252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64c016ae60 msgr2=0x7f64c0168200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:41.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.190+0000 7f64c5dc5700 1 --2- 172.21.15.6:0/2593616252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64c016ae60 0x7f64c0168200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.190+0000 7f64c5dc5700 1 -- 172.21.15.6:0/2593616252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64a80050f0 msgr2=0x7f64c013c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:41.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.190+0000 7f64c5dc5700 1 --2- 172.21.15.6:0/2593616252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64a80050f0 0x7f64c013c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.190+0000 7f64c5dc5700 1 -- 172.21.15.6:0/2593616252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c016b4f0 con 0x7f64c00c4490 2023-10-06T02:18:41.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.190+0000 7f64c5dc5700 1 --2- 172.21.15.6:0/2593616252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64c00c4490 0x7f64c00c4900 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009d70 tx=0x7f64b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:41.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.190+0000 7f64bd7fa700 1 -- 172.21.15.6:0/2593616252 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b800e040 con 0x7f64c00c4490 2023-10-06T02:18:41.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.190+0000 7f64bd7fa700 1 -- 172.21.15.6:0/2593616252 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b800f040 con 0x7f64c00c4490 2023-10-06T02:18:41.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.190+0000 7f64bd7fa700 1 -- 172.21.15.6:0/2593616252 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b800fd40 con 0x7f64c00c4490 2023-10-06T02:18:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.190+0000 7f64c65c6700 1 -- 172.21.15.6:0/2593616252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c016b7d0 con 0x7f64c00c4490 2023-10-06T02:18:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.190+0000 7f64c65c6700 1 -- 172.21.15.6:0/2593616252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c00a5ce0 con 0x7f64c00c4490 2023-10-06T02:18:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.191+0000 7f64c65c6700 1 -- 172.21.15.6:0/2593616252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c006d3d0 con 0x7f64c00c4490 2023-10-06T02:18:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.192+0000 7f64bd7fa700 1 -- 172.21.15.6:0/2593616252 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64b8015640 con 0x7f64c00c4490 2023-10-06T02:18:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.192+0000 7f64bd7fa700 1 --2- 172.21.15.6:0/2593616252 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f64ac066f30 0x7f64ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.192+0000 7f64bd7fa700 1 -- 172.21.15.6:0/2593616252 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f64b8084b10 con 0x7f64c00c4490 2023-10-06T02:18:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.192+0000 7f64c55c4700 1 --2- 172.21.15.6:0/2593616252 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f64ac066f30 0x7f64ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.193+0000 7f64c55c4700 1 --2- 172.21.15.6:0/2593616252 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f64ac066f30 0x7f64ac0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f64b0001620 tx=0x7f64b0001e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.196+0000 7f64bd7fa700 1 -- 172.21.15.6:0/2593616252 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64b8051e30 con 0x7f64c00c4490 2023-10-06T02:18:41.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.475+0000 7f64c65c6700 1 -- 172.21.15.6:0/2593616252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f64c00c4140 con 0x7f64c00c4490 2023-10-06T02:18:41.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.478+0000 7f64bd7fa700 1 -- 172.21.15.6:0/2593616252 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f64b800fea0 con 0x7f64c00c4490 2023-10-06T02:18:41.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.480+0000 7f64c65c6700 1 -- 172.21.15.6:0/2593616252 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f64ac066f30 msgr2=0x7f64ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:41.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.480+0000 7f64c65c6700 1 --2- 172.21.15.6:0/2593616252 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f64ac066f30 0x7f64ac0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f64b0001620 tx=0x7f64b0001e90 comp rx=0 tx=0).stop 2023-10-06T02:18:41.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.480+0000 7f64c65c6700 1 -- 172.21.15.6:0/2593616252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64c00c4490 msgr2=0x7f64c00c4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:41.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.480+0000 7f64c65c6700 1 --2- 172.21.15.6:0/2593616252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64c00c4490 0x7f64c00c4900 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009d70 tx=0x7f64b800b040 comp rx=0 tx=0).stop 2023-10-06T02:18:41.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.480+0000 7f64c65c6700 1 -- 172.21.15.6:0/2593616252 shutdown_connections 2023-10-06T02:18:41.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.480+0000 7f64c65c6700 1 --2- 172.21.15.6:0/2593616252 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f64ac066f30 0x7f64ac0693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.480+0000 7f64c65c6700 1 --2- 172.21.15.6:0/2593616252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64c00c4490 0x7f64c00c4900 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.480+0000 7f64c65c6700 1 --2- 172.21.15.6:0/2593616252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64a80050f0 0x7f64c013c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.480+0000 7f64c65c6700 1 --2- 172.21.15.6:0/2593616252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64c016ae60 0x7f64c0168200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.480+0000 7f64c65c6700 1 -- 172.21.15.6:0/2593616252 >> 172.21.15.6:0/2593616252 conn(0x7f64c00cbd50 msgr2=0x7f64c00c8740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:41.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.481+0000 7f64c65c6700 1 -- 172.21.15.6:0/2593616252 shutdown_connections 2023-10-06T02:18:41.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.481+0000 7f64c65c6700 1 -- 172.21.15.6:0/2593616252 wait complete. 2023-10-06T02:18:41.493 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T02:18:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.613+0000 7fc6ecf43700 1 Processor -- start 2023-10-06T02:18:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.613+0000 7fc6ecf43700 1 -- start start 2023-10-06T02:18:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.614+0000 7fc6ecf43700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc6e8086ff0 0x7fc6e8087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.614+0000 7fc6ecf43700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6e80b21b0 0x7fc6e80b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.614+0000 7fc6ecf43700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e80b2b70 con 0x7fc6e815a030 2023-10-06T02:18:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.614+0000 7fc6ecf43700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e80b0cf0 con 0x7fc6e8086ff0 2023-10-06T02:18:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.614+0000 7fc6ecf43700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80879b0 con 0x7fc6e80b21b0 2023-10-06T02:18:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.614+0000 7fc6e659c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc6e815a030 0x7fc6e815a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43292/0 (socket says 172.21.15.6:43292) 2023-10-06T02:18:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.614+0000 7fc6e659c700 1 -- 172.21.15.6:0/1978579607 learned_addr learned my addr 172.21.15.6:0/1978579607 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.614+0000 7fc6e6d9d700 1 --2- 172.21.15.6:0/1978579607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6e80b21b0 0x7fc6e80b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.614+0000 7fc6dffff700 1 --2- 172.21.15.6:0/1978579607 >> v2:172.21.15.175:3300/0 conn(0x7fc6e8086ff0 0x7fc6e8087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.614+0000 7fc6e5d9b700 1 -- 172.21.15.6:0/1978579607 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539973088 0 0) 0x7fc6e80b2b70 con 0x7fc6e815a030 2023-10-06T02:18:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.614+0000 7fc6e5d9b700 1 -- 172.21.15.6:0/1978579607 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6d4003570 con 0x7fc6e815a030 2023-10-06T02:18:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.614+0000 7fc6e6d9d700 1 -- 172.21.15.6:0/1978579607 >> v2:172.21.15.175:3300/0 conn(0x7fc6e8086ff0 msgr2=0x7fc6e8087470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.614+0000 7fc6e6d9d700 1 --2- 172.21.15.6:0/1978579607 >> v2:172.21.15.175:3300/0 conn(0x7fc6e8086ff0 0x7fc6e8087470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.614+0000 7fc6e6d9d700 1 -- 172.21.15.6:0/1978579607 >> v1:172.21.15.6:6789/0 conn(0x7fc6e815a030 legacy=0x7fc6e815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.614+0000 7fc6e5d9b700 1 -- 172.21.15.6:0/1978579607 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 790650686 0 0) 0x7fc6d4003570 con 0x7fc6e815a030 2023-10-06T02:18:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.614+0000 7fc6e6d9d700 1 -- 172.21.15.6:0/1978579607 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e80afc50 con 0x7fc6e80b21b0 2023-10-06T02:18:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.614+0000 7fc6dffff700 1 --2- 172.21.15.6:0/1978579607 >> v2:172.21.15.175:3300/0 conn(0x7fc6e8086ff0 0x7fc6e8087470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.615+0000 7fc6e6d9d700 1 --2- 172.21.15.6:0/1978579607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6e80b21b0 0x7fc6e80b2630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009e60 tx=0x7fc6e0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a99163d5ea2018fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.615+0000 7fc6e5d9b700 1 -- 172.21.15.6:0/1978579607 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e000e070 con 0x7fc6e80b21b0 2023-10-06T02:18:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.615+0000 7fc6e5d9b700 1 -- 172.21.15.6:0/1978579607 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e000b7a0 con 0x7fc6e80b21b0 2023-10-06T02:18:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.615+0000 7fc6e5d9b700 1 -- 172.21.15.6:0/1978579607 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8001470 con 0x7fc6e80b21b0 2023-10-06T02:18:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.615+0000 7fc6ecf43700 1 -- 172.21.15.6:0/1978579607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6e80b21b0 msgr2=0x7fc6e80b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.615+0000 7fc6ecf43700 1 --2- 172.21.15.6:0/1978579607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6e80b21b0 0x7fc6e80b2630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009e60 tx=0x7fc6e0009780 comp rx=0 tx=0).stop 2023-10-06T02:18:41.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.615+0000 7fc6ecf43700 1 -- 172.21.15.6:0/1978579607 shutdown_connections 2023-10-06T02:18:41.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.615+0000 7fc6ecf43700 1 --2- 172.21.15.6:0/1978579607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6e80b21b0 0x7fc6e80b2630 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.615+0000 7fc6ecf43700 1 --2- 172.21.15.6:0/1978579607 >> v2:172.21.15.175:3300/0 conn(0x7fc6e8086ff0 0x7fc6e8087470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.615+0000 7fc6ecf43700 1 -- 172.21.15.6:0/1978579607 >> 172.21.15.6:0/1978579607 conn(0x7fc6e8068680 msgr2=0x7fc6e8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:41.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.615+0000 7fc6ecf43700 1 -- 172.21.15.6:0/1978579607 shutdown_connections 2023-10-06T02:18:41.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.615+0000 7fc6ecf43700 1 -- 172.21.15.6:0/1978579607 wait complete. 2023-10-06T02:18:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.616+0000 7fc6ecf43700 1 Processor -- start 2023-10-06T02:18:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.616+0000 7fc6ecf43700 1 -- start start 2023-10-06T02:18:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.617+0000 7fc6ecf43700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6e8086ff0 0x7fc6e815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.617+0000 7fc6ecf43700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6e80b21b0 0x7fc6e81564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.617+0000 7fc6ecf43700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6e815a030 0x7fc6e8156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.617+0000 7fc6ecf43700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e815d270 con 0x7fc6e8086ff0 2023-10-06T02:18:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.617+0000 7fc6ecf43700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80b5c10 con 0x7fc6e815a030 2023-10-06T02:18:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.617+0000 7fc6ecf43700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80c4950 con 0x7fc6e80b21b0 2023-10-06T02:18:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.617+0000 7fc6e659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6e8086ff0 0x7fc6e815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.617+0000 7fc6e659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6e8086ff0 0x7fc6e815a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40730/0 (socket says 172.21.15.6:40730) 2023-10-06T02:18:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.617+0000 7fc6e659c700 1 -- 172.21.15.6:0/2365834183 learned_addr learned my addr 172.21.15.6:0/2365834183 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.617+0000 7fc6dffff700 1 --2- 172.21.15.6:0/2365834183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6e80b21b0 0x7fc6e81564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.617+0000 7fc6e6d9d700 1 --2- 172.21.15.6:0/2365834183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6e815a030 0x7fc6e8156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.618+0000 7fc6e659c700 1 -- 172.21.15.6:0/2365834183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6e80b21b0 msgr2=0x7fc6e81564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.618+0000 7fc6e659c700 1 --2- 172.21.15.6:0/2365834183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6e80b21b0 0x7fc6e81564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.618+0000 7fc6e659c700 1 -- 172.21.15.6:0/2365834183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6e815a030 msgr2=0x7fc6e8156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.618+0000 7fc6e659c700 1 --2- 172.21.15.6:0/2365834183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6e815a030 0x7fc6e8156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.618+0000 7fc6e659c700 1 -- 172.21.15.6:0/2365834183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d0009420 con 0x7fc6e8086ff0 2023-10-06T02:18:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.618+0000 7fc6e659c700 1 --2- 172.21.15.6:0/2365834183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6e8086ff0 0x7fc6e815a5c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800cbc0 tx=0x7fc6d8001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.618+0000 7fc6de7fc700 1 -- 172.21.15.6:0/2365834183 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8007360 con 0x7fc6e8086ff0 2023-10-06T02:18:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.618+0000 7fc6de7fc700 1 -- 172.21.15.6:0/2365834183 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d80074e0 con 0x7fc6e8086ff0 2023-10-06T02:18:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.618+0000 7fc6ecf43700 1 -- 172.21.15.6:0/2365834183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e0009a20 con 0x7fc6e8086ff0 2023-10-06T02:18:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.618+0000 7fc6de7fc700 1 -- 172.21.15.6:0/2365834183 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8004830 con 0x7fc6e8086ff0 2023-10-06T02:18:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.618+0000 7fc6ecf43700 1 -- 172.21.15.6:0/2365834183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e80c4f10 con 0x7fc6e8086ff0 2023-10-06T02:18:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.619+0000 7fc6ecf43700 1 -- 172.21.15.6:0/2365834183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e8088700 con 0x7fc6e8086ff0 2023-10-06T02:18:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.619+0000 7fc6de7fc700 1 -- 172.21.15.6:0/2365834183 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6d8004ba0 con 0x7fc6e8086ff0 2023-10-06T02:18:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.620+0000 7fc6de7fc700 1 --2- 172.21.15.6:0/2365834183 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc6c8066f30 0x7fc6c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.620+0000 7fc6de7fc700 1 -- 172.21.15.6:0/2365834183 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc6d8083ce0 con 0x7fc6e8086ff0 2023-10-06T02:18:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.620+0000 7fc6dffff700 1 --2- 172.21.15.6:0/2365834183 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc6c8066f30 0x7fc6c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.620+0000 7fc6dffff700 1 --2- 172.21.15.6:0/2365834183 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc6c8066f30 0x7fc6c80693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00093f0 tx=0x7fc6d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.624+0000 7fc6de7fc700 1 -- 172.21.15.6:0/2365834183 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6d8051080 con 0x7fc6e8086ff0 2023-10-06T02:18:41.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.900+0000 7fc6ecf43700 1 -- 172.21.15.6:0/2365834183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fc6e80aff30 con 0x7fc6e8086ff0 2023-10-06T02:18:41.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.904+0000 7fc6de7fc700 1 -- 172.21.15.6:0/2365834183 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc6d8018020 con 0x7fc6e8086ff0 2023-10-06T02:18:41.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.906+0000 7fc6ecf43700 1 -- 172.21.15.6:0/2365834183 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc6c8066f30 msgr2=0x7fc6c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:41.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.906+0000 7fc6ecf43700 1 --2- 172.21.15.6:0/2365834183 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc6c8066f30 0x7fc6c80693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00093f0 tx=0x7fc6d0008040 comp rx=0 tx=0).stop 2023-10-06T02:18:41.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.906+0000 7fc6ecf43700 1 -- 172.21.15.6:0/2365834183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6e8086ff0 msgr2=0x7fc6e815a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:41.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.906+0000 7fc6ecf43700 1 --2- 172.21.15.6:0/2365834183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6e8086ff0 0x7fc6e815a5c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800cbc0 tx=0x7fc6d8001a30 comp rx=0 tx=0).stop 2023-10-06T02:18:41.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.906+0000 7fc6ecf43700 1 -- 172.21.15.6:0/2365834183 shutdown_connections 2023-10-06T02:18:41.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.906+0000 7fc6ecf43700 1 --2- 172.21.15.6:0/2365834183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6e815a030 0x7fc6e8156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.906+0000 7fc6ecf43700 1 --2- 172.21.15.6:0/2365834183 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc6c8066f30 0x7fc6c80693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.906+0000 7fc6ecf43700 1 --2- 172.21.15.6:0/2365834183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6e8086ff0 0x7fc6e815a5c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.906+0000 7fc6ecf43700 1 --2- 172.21.15.6:0/2365834183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6e80b21b0 0x7fc6e81564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:41.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.906+0000 7fc6ecf43700 1 -- 172.21.15.6:0/2365834183 >> 172.21.15.6:0/2365834183 conn(0x7fc6e8068680 msgr2=0x7fc6e80cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:41.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.906+0000 7fc6ecf43700 1 -- 172.21.15.6:0/2365834183 shutdown_connections 2023-10-06T02:18:41.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:41.906+0000 7fc6ecf43700 1 -- 172.21.15.6:0/2365834183 wait complete. 2023-10-06T02:18:41.918 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:18:42.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.038+0000 7ffaf1879700 1 Processor -- start 2023-10-06T02:18:42.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.038+0000 7ffaf1879700 1 -- start start 2023-10-06T02:18:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.039+0000 7ffaf1879700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffaec157010 0x7ffaec15ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.039+0000 7ffaf1879700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffaec0ac7f0 0x7ffaec0c7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.039+0000 7ffaf1879700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaec15bc90 con 0x7ffaec1573e0 2023-10-06T02:18:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.039+0000 7ffaf1879700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaec15b3f0 con 0x7ffaec0ac7f0 2023-10-06T02:18:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.039+0000 7ffaf1879700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaec15b6d0 con 0x7ffaec157010 2023-10-06T02:18:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.039+0000 7ffaf1078700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffaec0ac7f0 0x7ffaec0c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.039+0000 7ffaf1078700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffaec0ac7f0 0x7ffaec0c7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40732/0 (socket says 172.21.15.6:40732) 2023-10-06T02:18:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.039+0000 7ffaf1078700 1 -- 172.21.15.6:0/586969807 learned_addr learned my addr 172.21.15.6:0/586969807 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.039+0000 7ffaf0877700 1 --2- 172.21.15.6:0/586969807 >> v2:172.21.15.175:3300/0 conn(0x7ffaec157010 0x7ffaec15ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.040+0000 7ffaf1078700 1 -- 172.21.15.6:0/586969807 >> v2:172.21.15.175:3300/0 conn(0x7ffaec157010 msgr2=0x7ffaec15ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.040+0000 7ffaf1078700 1 --2- 172.21.15.6:0/586969807 >> v2:172.21.15.175:3300/0 conn(0x7ffaec157010 0x7ffaec15ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.040+0000 7ffaf1078700 1 -- 172.21.15.6:0/586969807 >> v1:172.21.15.175:6789/0 conn(0x7ffaec1573e0 legacy=0x7ffaec069aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.040+0000 7ffaf1078700 1 -- 172.21.15.6:0/586969807 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec15b9b0 con 0x7ffaec0ac7f0 2023-10-06T02:18:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.040+0000 7ffaf1078700 1 --2- 172.21.15.6:0/586969807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaec0ac7f0 0x7ffaec0c7810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffaec064830 tx=0x7ffae4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71c0f4e89f50554 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.040+0000 7ffaeb7fe700 1 -- 172.21.15.6:0/586969807 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae400e070 con 0x7ffaec0ac7f0 2023-10-06T02:18:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.040+0000 7ffaeb7fe700 1 -- 172.21.15.6:0/586969807 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae400ba20 con 0x7ffaec0ac7f0 2023-10-06T02:18:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.040+0000 7ffaeb7fe700 1 -- 172.21.15.6:0/586969807 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae40092e0 con 0x7ffaec0ac7f0 2023-10-06T02:18:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.041+0000 7ffaf1879700 1 -- 172.21.15.6:0/586969807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaec0ac7f0 msgr2=0x7ffaec0c7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.041+0000 7ffaf1879700 1 --2- 172.21.15.6:0/586969807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaec0ac7f0 0x7ffaec0c7810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffaec064830 tx=0x7ffae4009840 comp rx=0 tx=0).stop 2023-10-06T02:18:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.041+0000 7ffaf1879700 1 -- 172.21.15.6:0/586969807 shutdown_connections 2023-10-06T02:18:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.041+0000 7ffaf1879700 1 --2- 172.21.15.6:0/586969807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaec0ac7f0 0x7ffaec0c7810 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.041+0000 7ffaf1879700 1 --2- 172.21.15.6:0/586969807 >> v2:172.21.15.175:3300/0 conn(0x7ffaec157010 0x7ffaec15ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.041+0000 7ffaf1879700 1 -- 172.21.15.6:0/586969807 >> 172.21.15.6:0/586969807 conn(0x7ffaec0c9070 msgr2=0x7ffaec0c9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.041+0000 7ffaf1879700 1 -- 172.21.15.6:0/586969807 shutdown_connections 2023-10-06T02:18:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.041+0000 7ffaf1879700 1 -- 172.21.15.6:0/586969807 wait complete. 2023-10-06T02:18:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.042+0000 7ffaf1879700 1 Processor -- start 2023-10-06T02:18:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.042+0000 7ffaf1879700 1 -- start start 2023-10-06T02:18:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaf1879700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffaec0ac7f0 0x7ffaec154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaf1879700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffaec157010 0x7ffaec167840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaf1879700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaec1573e0 0x7ffaec0b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaf1879700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec159540 con 0x7ffaec1573e0 2023-10-06T02:18:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaf1879700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec0a44c0 con 0x7ffaec157010 2023-10-06T02:18:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaf1879700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec0b00e0 con 0x7ffaec0ac7f0 2023-10-06T02:18:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaf1078700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaec1573e0 0x7ffaec0b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaf1078700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaec1573e0 0x7ffaec0b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40744/0 (socket says 172.21.15.6:40744) 2023-10-06T02:18:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaf1078700 1 -- 172.21.15.6:0/1772388962 learned_addr learned my addr 172.21.15.6:0/1772388962 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaf0877700 1 --2- 172.21.15.6:0/1772388962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffaec0ac7f0 0x7ffaec154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaebfff700 1 --2- 172.21.15.6:0/1772388962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffaec157010 0x7ffaec167840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaf1078700 1 -- 172.21.15.6:0/1772388962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffaec0ac7f0 msgr2=0x7ffaec154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaf1078700 1 --2- 172.21.15.6:0/1772388962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffaec0ac7f0 0x7ffaec154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaf1078700 1 -- 172.21.15.6:0/1772388962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffaec157010 msgr2=0x7ffaec167840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaf1078700 1 --2- 172.21.15.6:0/1772388962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffaec157010 0x7ffaec167840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaf1078700 1 -- 172.21.15.6:0/1772388962 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae4009ae0 con 0x7ffaec1573e0 2023-10-06T02:18:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaf1078700 1 --2- 172.21.15.6:0/1772388962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaec1573e0 0x7ffaec0b0570 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009880 tx=0x7ffae4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffae8ff9700 1 -- 172.21.15.6:0/1772388962 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4008a80 con 0x7ffaec1573e0 2023-10-06T02:18:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffae8ff9700 1 -- 172.21.15.6:0/1772388962 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae4008be0 con 0x7ffaec1573e0 2023-10-06T02:18:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffae8ff9700 1 -- 172.21.15.6:0/1772388962 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4026460 con 0x7ffaec1573e0 2023-10-06T02:18:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.043+0000 7ffaf1879700 1 -- 172.21.15.6:0/1772388962 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec0b2190 con 0x7ffaec1573e0 2023-10-06T02:18:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.044+0000 7ffaf1879700 1 -- 172.21.15.6:0/1772388962 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaec0af580 con 0x7ffaec1573e0 2023-10-06T02:18:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.044+0000 7ffaf1879700 1 -- 172.21.15.6:0/1772388962 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaec06dc70 con 0x7ffaec1573e0 2023-10-06T02:18:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.045+0000 7ffae8ff9700 1 -- 172.21.15.6:0/1772388962 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffae4003040 con 0x7ffaec1573e0 2023-10-06T02:18:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.045+0000 7ffae8ff9700 1 --2- 172.21.15.6:0/1772388962 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffad0066f30 0x7ffad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.045+0000 7ffae8ff9700 1 -- 172.21.15.6:0/1772388962 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7ffae4086270 con 0x7ffaec1573e0 2023-10-06T02:18:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.046+0000 7ffaf0877700 1 --2- 172.21.15.6:0/1772388962 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffad0066f30 0x7ffad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.046+0000 7ffaf0877700 1 --2- 172.21.15.6:0/1772388962 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffad0066f30 0x7ffad00693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009db0 tx=0x7ffae00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.049+0000 7ffae8ff9700 1 -- 172.21.15.6:0/1772388962 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffae4053640 con 0x7ffaec1573e0 2023-10-06T02:18:42.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.244+0000 7ffaf1879700 1 -- 172.21.15.6:0/1772388962 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffaec0b0220 con 0x7ffaec1573e0 2023-10-06T02:18:42.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.245+0000 7ffae8ff9700 1 -- 172.21.15.6:0/1772388962 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13807 (secure 0 0 0) 0x7ffae4056c60 con 0x7ffaec1573e0 2023-10-06T02:18:42.245 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:42.245 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":35,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:18:38.933648+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:18:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.246+0000 7ffaf1879700 1 -- 172.21.15.6:0/1772388962 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffad0066f30 msgr2=0x7ffad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.246+0000 7ffaf1879700 1 --2- 172.21.15.6:0/1772388962 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffad0066f30 0x7ffad00693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009db0 tx=0x7ffae00091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.246+0000 7ffaf1879700 1 -- 172.21.15.6:0/1772388962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaec1573e0 msgr2=0x7ffaec0b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.246+0000 7ffaf1879700 1 --2- 172.21.15.6:0/1772388962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaec1573e0 0x7ffaec0b0570 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009880 tx=0x7ffae4018000 comp rx=0 tx=0).stop 2023-10-06T02:18:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.247+0000 7ffaf1879700 1 -- 172.21.15.6:0/1772388962 shutdown_connections 2023-10-06T02:18:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.247+0000 7ffaf1879700 1 --2- 172.21.15.6:0/1772388962 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffad0066f30 0x7ffad00693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.247+0000 7ffaf1879700 1 --2- 172.21.15.6:0/1772388962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaec1573e0 0x7ffaec0b0570 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.247+0000 7ffaf1879700 1 --2- 172.21.15.6:0/1772388962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffaec0ac7f0 0x7ffaec154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.247+0000 7ffaf1879700 1 --2- 172.21.15.6:0/1772388962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffaec157010 0x7ffaec167840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.247+0000 7ffaf1879700 1 -- 172.21.15.6:0/1772388962 >> 172.21.15.6:0/1772388962 conn(0x7ffaec0c9070 msgr2=0x7ffaec155f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:42.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.247+0000 7ffaf1879700 1 -- 172.21.15.6:0/1772388962 shutdown_connections 2023-10-06T02:18:42.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.247+0000 7ffaf1879700 1 -- 172.21.15.6:0/1772388962 wait complete. 2023-10-06T02:18:42.259 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T02:18:42.259 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:18:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.381+0000 7f977cea2700 1 Processor -- start 2023-10-06T02:18:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.381+0000 7f977cea2700 1 -- start start 2023-10-06T02:18:42.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f977cea2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f977806a380 0x7f97780cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f977cea2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f977806a750 0x7f977815d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f977cea2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f977815d770 0x7f9778159170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f977cea2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97780cc3d0 con 0x7f977815d770 2023-10-06T02:18:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f977cea2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97780cae80 con 0x7f977806a750 2023-10-06T02:18:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f977cea2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977815dcd0 con 0x7f977806a380 2023-10-06T02:18:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f9776d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f977815d770 0x7f9778159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f9776d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f977815d770 0x7f9778159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40752/0 (socket says 172.21.15.6:40752) 2023-10-06T02:18:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f9776d9d700 1 -- 172.21.15.6:0/2719033195 learned_addr learned my addr 172.21.15.6:0/2719033195 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f9775d9b700 1 --2- 172.21.15.6:0/2719033195 >> v2:172.21.15.175:3300/0 conn(0x7f977806a750 0x7f977815d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f977659c700 1 --2- 172.21.15.6:0/2719033195 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f977806a380 0x7f97780cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f9776d9d700 1 -- 172.21.15.6:0/2719033195 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f977806a380 msgr2=0x7f97780cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f9776d9d700 1 --2- 172.21.15.6:0/2719033195 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f977806a380 0x7f97780cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f9776d9d700 1 -- 172.21.15.6:0/2719033195 >> v2:172.21.15.175:3300/0 conn(0x7f977806a750 msgr2=0x7f977815d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f9776d9d700 1 --2- 172.21.15.6:0/2719033195 >> v2:172.21.15.175:3300/0 conn(0x7f977806a750 0x7f977815d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f9776d9d700 1 -- 172.21.15.6:0/2719033195 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977815dfb0 con 0x7f977815d770 2023-10-06T02:18:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f977659c700 1 --2- 172.21.15.6:0/2719033195 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f977806a380 0x7f97780cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f9776d9d700 1 --2- 172.21.15.6:0/2719033195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f977815d770 0x7f9778159170 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f977806b6d0 tx=0x7f9770009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563459ebb527213e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.382+0000 7f977559a700 1 -- 172.21.15.6:0/2719033195 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977000e070 con 0x7f977815d770 2023-10-06T02:18:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.383+0000 7f977559a700 1 -- 172.21.15.6:0/2719033195 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977000ba50 con 0x7f977815d770 2023-10-06T02:18:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.383+0000 7f977559a700 1 -- 172.21.15.6:0/2719033195 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97700092e0 con 0x7f977815d770 2023-10-06T02:18:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.383+0000 7f977cea2700 1 -- 172.21.15.6:0/2719033195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f977815d770 msgr2=0x7f9778159170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.383+0000 7f977cea2700 1 --2- 172.21.15.6:0/2719033195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f977815d770 0x7f9778159170 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f977806b6d0 tx=0x7f9770009840 comp rx=0 tx=0).stop 2023-10-06T02:18:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.383+0000 7f977cea2700 1 -- 172.21.15.6:0/2719033195 shutdown_connections 2023-10-06T02:18:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.383+0000 7f977cea2700 1 --2- 172.21.15.6:0/2719033195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f977815d770 0x7f9778159170 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.383+0000 7f977cea2700 1 --2- 172.21.15.6:0/2719033195 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f977806a380 0x7f97780cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.383+0000 7f977cea2700 1 --2- 172.21.15.6:0/2719033195 >> v2:172.21.15.175:3300/0 conn(0x7f977806a750 0x7f977815d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.383+0000 7f977cea2700 1 -- 172.21.15.6:0/2719033195 >> 172.21.15.6:0/2719033195 conn(0x7f97780d0350 msgr2=0x7f97780d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.383+0000 7f977cea2700 1 -- 172.21.15.6:0/2719033195 shutdown_connections 2023-10-06T02:18:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.383+0000 7f977cea2700 1 -- 172.21.15.6:0/2719033195 wait complete. 2023-10-06T02:18:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.384+0000 7f977cea2700 1 Processor -- start 2023-10-06T02:18:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.384+0000 7f977cea2700 1 -- start start 2023-10-06T02:18:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.385+0000 7f977cea2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f977806a380 0x7f97780b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.385+0000 7f977cea2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f977806a750 0x7f9778153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.385+0000 7f977cea2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f977815d770 0x7f977816d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.385+0000 7f977cea2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97780c7de0 con 0x7f977806a380 2023-10-06T02:18:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.385+0000 7f977cea2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97780b30f0 con 0x7f977815d770 2023-10-06T02:18:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.385+0000 7f977cea2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97780b5f10 con 0x7f977806a750 2023-10-06T02:18:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.385+0000 7f977659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f977806a380 0x7f97780b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.385+0000 7f977659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f977806a380 0x7f97780b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40760/0 (socket says 172.21.15.6:40760) 2023-10-06T02:18:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.385+0000 7f977659c700 1 -- 172.21.15.6:0/1741421092 learned_addr learned my addr 172.21.15.6:0/1741421092 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.385+0000 7f9776d9d700 1 --2- 172.21.15.6:0/1741421092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f977815d770 0x7f977816d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.385+0000 7f9775d9b700 1 --2- 172.21.15.6:0/1741421092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f977806a750 0x7f9778153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.385+0000 7f977659c700 1 -- 172.21.15.6:0/1741421092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f977806a750 msgr2=0x7f9778153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.385+0000 7f977659c700 1 --2- 172.21.15.6:0/1741421092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f977806a750 0x7f9778153e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.385+0000 7f977659c700 1 -- 172.21.15.6:0/1741421092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f977815d770 msgr2=0x7f977816d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.385+0000 7f977659c700 1 --2- 172.21.15.6:0/1741421092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f977815d770 0x7f977816d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.385+0000 7f977659c700 1 -- 172.21.15.6:0/1741421092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9770009ae0 con 0x7f977806a380 2023-10-06T02:18:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.386+0000 7f977659c700 1 --2- 172.21.15.6:0/1741421092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f977806a380 0x7f97780b59d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f976800c830 tx=0x7f9768008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.386+0000 7f97667fc700 1 -- 172.21.15.6:0/1741421092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768011600 con 0x7f977806a380 2023-10-06T02:18:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.386+0000 7f97667fc700 1 -- 172.21.15.6:0/1741421092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9768011760 con 0x7f977806a380 2023-10-06T02:18:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.386+0000 7f97667fc700 1 -- 172.21.15.6:0/1741421092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768011b20 con 0x7f977806a380 2023-10-06T02:18:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.386+0000 7f977cea2700 1 -- 172.21.15.6:0/1741421092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97780c8060 con 0x7f977806a380 2023-10-06T02:18:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.386+0000 7f977cea2700 1 -- 172.21.15.6:0/1741421092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97780c8620 con 0x7f977806a380 2023-10-06T02:18:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.387+0000 7f977cea2700 1 -- 172.21.15.6:0/1741421092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9778088a40 con 0x7f977806a380 2023-10-06T02:18:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.387+0000 7f97667fc700 1 -- 172.21.15.6:0/1741421092 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f976800a3e0 con 0x7f977806a380 2023-10-06T02:18:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.387+0000 7f97667fc700 1 --2- 172.21.15.6:0/1741421092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9758066f30 0x7f97580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.388+0000 7f97667fc700 1 -- 172.21.15.6:0/1741421092 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f9768084990 con 0x7f977806a380 2023-10-06T02:18:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.388+0000 7f9775d9b700 1 --2- 172.21.15.6:0/1741421092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9758066f30 0x7f97580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.388+0000 7f9775d9b700 1 --2- 172.21.15.6:0/1741421092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9758066f30 0x7f97580693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f97780c5b20 tx=0x7f976c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.392+0000 7f97667fc700 1 -- 172.21.15.6:0/1741421092 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9768051cb0 con 0x7f977806a380 2023-10-06T02:18:42.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.584+0000 7f977cea2700 1 -- 172.21.15.6:0/1741421092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f97780cab10 con 0x7f977806a380 2023-10-06T02:18:42.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.584+0000 7f97667fc700 1 -- 172.21.15.6:0/1741421092 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v35) v1 ==== 92+0+10 (secure 0 0 0) 0x7f97680150a0 con 0x7f977806a380 2023-10-06T02:18:42.585 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:18:42.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.587+0000 7f977cea2700 1 -- 172.21.15.6:0/1741421092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9758066f30 msgr2=0x7f97580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:42.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.587+0000 7f977cea2700 1 --2- 172.21.15.6:0/1741421092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9758066f30 0x7f97580693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f97780c5b20 tx=0x7f976c008040 comp rx=0 tx=0).stop 2023-10-06T02:18:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.587+0000 7f977cea2700 1 -- 172.21.15.6:0/1741421092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f977806a380 msgr2=0x7f97780b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.587+0000 7f977cea2700 1 --2- 172.21.15.6:0/1741421092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f977806a380 0x7f97780b59d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f976800c830 tx=0x7f9768008040 comp rx=0 tx=0).stop 2023-10-06T02:18:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.587+0000 7f977cea2700 1 -- 172.21.15.6:0/1741421092 shutdown_connections 2023-10-06T02:18:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.587+0000 7f977cea2700 1 --2- 172.21.15.6:0/1741421092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f977815d770 0x7f977816d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.587+0000 7f977cea2700 1 --2- 172.21.15.6:0/1741421092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9758066f30 0x7f97580693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.587+0000 7f977cea2700 1 --2- 172.21.15.6:0/1741421092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f977806a380 0x7f97780b59d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.587+0000 7f977cea2700 1 --2- 172.21.15.6:0/1741421092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f977806a750 0x7f9778153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.587+0000 7f977cea2700 1 -- 172.21.15.6:0/1741421092 >> 172.21.15.6:0/1741421092 conn(0x7f97780d0350 msgr2=0x7f9778155ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:42.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.587+0000 7f977cea2700 1 -- 172.21.15.6:0/1741421092 shutdown_connections 2023-10-06T02:18:42.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.587+0000 7f977cea2700 1 -- 172.21.15.6:0/1741421092 wait complete. 2023-10-06T02:18:42.599 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:18:42.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.721+0000 7f3a6cbc7700 1 Processor -- start 2023-10-06T02:18:42.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.721+0000 7f3a6cbc7700 1 -- start start 2023-10-06T02:18:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.722+0000 7f3a6cbc7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3a681594a0 0x7f3a680cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.722+0000 7f3a6cbc7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a680cca70 0x7f3a680c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.722+0000 7f3a6cbc7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a680ccee0 con 0x7f3a680c90d0 2023-10-06T02:18:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.722+0000 7f3a6cbc7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a680ca5d0 con 0x7f3a681594a0 2023-10-06T02:18:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.722+0000 7f3a6cbc7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680c99c0 con 0x7f3a680cca70 2023-10-06T02:18:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.722+0000 7f3a677fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3a681594a0 0x7f3a680cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.722+0000 7f3a66ffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a680cca70 0x7f3a680c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.722+0000 7f3a67fff700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f3a680c90d0 0x7f3a68069890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:38056/0 (socket says 172.21.15.6:38056) 2023-10-06T02:18:42.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.722+0000 7f3a677fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3a681594a0 0x7f3a680cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:43582/0 (socket says 172.21.15.6:43582) 2023-10-06T02:18:42.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.722+0000 7f3a67fff700 1 -- 172.21.15.6:0/1834876474 learned_addr learned my addr 172.21.15.6:0/1834876474 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:42.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.722+0000 7f3a66ffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a680cca70 0x7f3a680c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:39090/0 (socket says 172.21.15.6:39090) 2023-10-06T02:18:42.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.723+0000 7f3a66ffd700 1 -- 172.21.15.6:0/1834876474 >> v2:172.21.15.175:3300/0 conn(0x7f3a681594a0 msgr2=0x7f3a680cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:42.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.723+0000 7f3a66ffd700 1 --2- 172.21.15.6:0/1834876474 >> v2:172.21.15.175:3300/0 conn(0x7f3a681594a0 0x7f3a680cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.723+0000 7f3a66ffd700 1 -- 172.21.15.6:0/1834876474 >> v1:172.21.15.175:6789/0 conn(0x7f3a680c90d0 legacy=0x7f3a68069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:42.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.723+0000 7f3a66ffd700 1 -- 172.21.15.6:0/1834876474 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a680c9ca0 con 0x7f3a680cca70 2023-10-06T02:18:42.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.723+0000 7f3a677fe700 1 --2- 172.21.15.6:0/1834876474 >> v2:172.21.15.175:3300/0 conn(0x7f3a681594a0 0x7f3a680cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:42.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.723+0000 7f3a66ffd700 1 --2- 172.21.15.6:0/1834876474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a680cca70 0x7f3a680c8b90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0098e0 tx=0x7f3a5c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddbbfe7e4b95c000 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:42.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.723+0000 7f3a667fc700 1 -- 172.21.15.6:0/1834876474 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c00b640 con 0x7f3a680cca70 2023-10-06T02:18:42.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.723+0000 7f3a667fc700 1 -- 172.21.15.6:0/1834876474 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c00b7a0 con 0x7f3a680cca70 2023-10-06T02:18:42.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.723+0000 7f3a667fc700 1 -- 172.21.15.6:0/1834876474 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c00bb40 con 0x7f3a680cca70 2023-10-06T02:18:42.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.724+0000 7f3a6cbc7700 1 -- 172.21.15.6:0/1834876474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a680cca70 msgr2=0x7f3a680c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:42.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.724+0000 7f3a6cbc7700 1 --2- 172.21.15.6:0/1834876474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a680cca70 0x7f3a680c8b90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0098e0 tx=0x7f3a5c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.724+0000 7f3a6cbc7700 1 -- 172.21.15.6:0/1834876474 shutdown_connections 2023-10-06T02:18:42.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.724+0000 7f3a6cbc7700 1 --2- 172.21.15.6:0/1834876474 >> v2:172.21.15.175:3300/0 conn(0x7f3a681594a0 0x7f3a680cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.724+0000 7f3a6cbc7700 1 --2- 172.21.15.6:0/1834876474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a680cca70 0x7f3a680c8b90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.724+0000 7f3a6cbc7700 1 -- 172.21.15.6:0/1834876474 >> 172.21.15.6:0/1834876474 conn(0x7f3a680ce9f0 msgr2=0x7f3a6806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:42.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.724+0000 7f3a6cbc7700 1 -- 172.21.15.6:0/1834876474 shutdown_connections 2023-10-06T02:18:42.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.724+0000 7f3a6cbc7700 1 -- 172.21.15.6:0/1834876474 wait complete. 2023-10-06T02:18:42.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.725+0000 7f3a6cbc7700 1 Processor -- start 2023-10-06T02:18:42.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.725+0000 7f3a6cbc7700 1 -- start start 2023-10-06T02:18:42.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.726+0000 7f3a6cbc7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a680c90d0 0x7f3a6815a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.726+0000 7f3a6cbc7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a680cca70 0x7f3a68144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.726+0000 7f3a6cbc7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a681594a0 0x7f3a680b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.726+0000 7f3a6cbc7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6816e1f0 con 0x7f3a680c90d0 2023-10-06T02:18:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.726+0000 7f3a6cbc7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6816df10 con 0x7f3a681594a0 2023-10-06T02:18:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.726+0000 7f3a6cbc7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a681599a0 con 0x7f3a680cca70 2023-10-06T02:18:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.726+0000 7f3a677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a680c90d0 0x7f3a6815a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.726+0000 7f3a677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a680c90d0 0x7f3a6815a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40776/0 (socket says 172.21.15.6:40776) 2023-10-06T02:18:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.726+0000 7f3a677fe700 1 -- 172.21.15.6:0/1650992495 learned_addr learned my addr 172.21.15.6:0/1650992495 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.726+0000 7f3a66ffd700 1 --2- 172.21.15.6:0/1650992495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a680cca70 0x7f3a68144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.726+0000 7f3a67fff700 1 --2- 172.21.15.6:0/1650992495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a681594a0 0x7f3a680b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.726+0000 7f3a677fe700 1 -- 172.21.15.6:0/1650992495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a680cca70 msgr2=0x7f3a68144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.726+0000 7f3a677fe700 1 --2- 172.21.15.6:0/1650992495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a680cca70 0x7f3a68144100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.726+0000 7f3a677fe700 1 -- 172.21.15.6:0/1650992495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a681594a0 msgr2=0x7f3a680b29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.726+0000 7f3a677fe700 1 --2- 172.21.15.6:0/1650992495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a681594a0 0x7f3a680b29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.726+0000 7f3a677fe700 1 -- 172.21.15.6:0/1650992495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a58009420 con 0x7f3a680c90d0 2023-10-06T02:18:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.727+0000 7f3a677fe700 1 --2- 172.21.15.6:0/1650992495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a680c90d0 0x7f3a6815a480 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800ec80 tx=0x7f3a580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.727+0000 7f3a4f7fe700 1 -- 172.21.15.6:0/1650992495 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5800c850 con 0x7f3a680c90d0 2023-10-06T02:18:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.727+0000 7f3a4f7fe700 1 -- 172.21.15.6:0/1650992495 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5800c9b0 con 0x7f3a680c90d0 2023-10-06T02:18:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.727+0000 7f3a6cbc7700 1 -- 172.21.15.6:0/1650992495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5c009420 con 0x7f3a680c90d0 2023-10-06T02:18:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.727+0000 7f3a4f7fe700 1 -- 172.21.15.6:0/1650992495 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5800cd30 con 0x7f3a680c90d0 2023-10-06T02:18:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.727+0000 7f3a6cbc7700 1 -- 172.21.15.6:0/1650992495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a68159f60 con 0x7f3a680c90d0 2023-10-06T02:18:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.728+0000 7f3a6cbc7700 1 -- 172.21.15.6:0/1650992495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a68064ee0 con 0x7f3a680c90d0 2023-10-06T02:18:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.728+0000 7f3a4f7fe700 1 -- 172.21.15.6:0/1650992495 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a58013680 con 0x7f3a680c90d0 2023-10-06T02:18:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.729+0000 7f3a4f7fe700 1 --2- 172.21.15.6:0/1650992495 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a54066f30 0x7f3a540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.729+0000 7f3a4f7fe700 1 -- 172.21.15.6:0/1650992495 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f3a580846c0 con 0x7f3a680c90d0 2023-10-06T02:18:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.729+0000 7f3a66ffd700 1 --2- 172.21.15.6:0/1650992495 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a54066f30 0x7f3a540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:42.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.729+0000 7f3a66ffd700 1 --2- 172.21.15.6:0/1650992495 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a54066f30 0x7f3a540693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0093f0 tx=0x7f3a5c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:42.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.733+0000 7f3a4f7fe700 1 -- 172.21.15.6:0/1650992495 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a58055470 con 0x7f3a680c90d0 2023-10-06T02:18:42.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.926+0000 7f3a6cbc7700 1 -- 172.21.15.6:0/1650992495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a68064aa0 con 0x7f3a680c90d0 2023-10-06T02:18:42.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.926+0000 7f3a4f7fe700 1 -- 172.21.15.6:0/1650992495 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a58055000 con 0x7f3a680c90d0 2023-10-06T02:18:42.927 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:18:42.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.928+0000 7f3a6cbc7700 1 -- 172.21.15.6:0/1650992495 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a54066f30 msgr2=0x7f3a540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.928+0000 7f3a6cbc7700 1 --2- 172.21.15.6:0/1650992495 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a54066f30 0x7f3a540693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0093f0 tx=0x7f3a5c017000 comp rx=0 tx=0).stop 2023-10-06T02:18:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.928+0000 7f3a6cbc7700 1 -- 172.21.15.6:0/1650992495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a680c90d0 msgr2=0x7f3a6815a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.928+0000 7f3a6cbc7700 1 --2- 172.21.15.6:0/1650992495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a680c90d0 0x7f3a6815a480 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800ec80 tx=0x7f3a580091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.928+0000 7f3a6cbc7700 1 -- 172.21.15.6:0/1650992495 shutdown_connections 2023-10-06T02:18:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.928+0000 7f3a6cbc7700 1 --2- 172.21.15.6:0/1650992495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a681594a0 0x7f3a680b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.928+0000 7f3a6cbc7700 1 --2- 172.21.15.6:0/1650992495 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a54066f30 0x7f3a540693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.928+0000 7f3a6cbc7700 1 --2- 172.21.15.6:0/1650992495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a680c90d0 0x7f3a6815a480 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.928+0000 7f3a6cbc7700 1 --2- 172.21.15.6:0/1650992495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a680cca70 0x7f3a68144100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:42.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.928+0000 7f3a6cbc7700 1 -- 172.21.15.6:0/1650992495 >> 172.21.15.6:0/1650992495 conn(0x7f3a680ce9f0 msgr2=0x7f3a68069890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:42.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.928+0000 7f3a6cbc7700 1 -- 172.21.15.6:0/1650992495 shutdown_connections 2023-10-06T02:18:42.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:42.928+0000 7f3a6cbc7700 1 -- 172.21.15.6:0/1650992495 wait complete. 2023-10-06T02:18:42.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:18:43.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.060+0000 7f164f3cd700 1 Processor -- start 2023-10-06T02:18:43.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.060+0000 7f164f3cd700 1 -- start start 2023-10-06T02:18:43.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.061+0000 7f164f3cd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1648159400 0x7f16480ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:43.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.061+0000 7f164f3cd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16480d05d0 0x7f16480b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:43.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.061+0000 7f164f3cd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16480b3560 con 0x7f16480cd030 2023-10-06T02:18:43.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.061+0000 7f164f3cd700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16480cf6f0 con 0x7f1648159400 2023-10-06T02:18:43.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.061+0000 7f164f3cd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16480cf9d0 con 0x7f16480d05d0 2023-10-06T02:18:43.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.061+0000 7f164dbca700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f16480cd030 0x7f16480cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43294/0 (socket says 172.21.15.6:43294) 2023-10-06T02:18:43.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.061+0000 7f164dbca700 1 -- 172.21.15.6:0/527524990 learned_addr learned my addr 172.21.15.6:0/527524990 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:43.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.061+0000 7f164ebcc700 1 --2- 172.21.15.6:0/527524990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16480d05d0 0x7f16480b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:43.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.061+0000 7f164e3cb700 1 --2- 172.21.15.6:0/527524990 >> v2:172.21.15.175:3300/0 conn(0x7f1648159400 0x7f16480ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:43.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.061+0000 7f164d3c9700 1 -- 172.21.15.6:0/527524990 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011494959 0 0) 0x7f16480b3560 con 0x7f16480cd030 2023-10-06T02:18:43.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.061+0000 7f164d3c9700 1 -- 172.21.15.6:0/527524990 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1630003570 con 0x7f16480cd030 2023-10-06T02:18:43.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.062+0000 7f164e3cb700 1 -- 172.21.15.6:0/527524990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16480d05d0 msgr2=0x7f16480b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:43.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.062+0000 7f164e3cb700 1 --2- 172.21.15.6:0/527524990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16480d05d0 0x7f16480b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.062+0000 7f164e3cb700 1 -- 172.21.15.6:0/527524990 >> v1:172.21.15.6:6789/0 conn(0x7f16480cd030 legacy=0x7f16480cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:43.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.062+0000 7f164e3cb700 1 -- 172.21.15.6:0/527524990 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16480b2f10 con 0x7f1648159400 2023-10-06T02:18:43.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.062+0000 7f164ebcc700 1 --2- 172.21.15.6:0/527524990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16480d05d0 0x7f16480b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:43.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.062+0000 7f164e3cb700 1 --2- 172.21.15.6:0/527524990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1648159400 0x7f16480ccaf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1640009eb0 tx=0x7f1640009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7354bf7e347ed49d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:43.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.062+0000 7f164d3c9700 1 -- 172.21.15.6:0/527524990 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164000e070 con 0x7f1648159400 2023-10-06T02:18:43.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.062+0000 7f164d3c9700 1 -- 172.21.15.6:0/527524990 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164000bb80 con 0x7f1648159400 2023-10-06T02:18:43.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.062+0000 7f164d3c9700 1 -- 172.21.15.6:0/527524990 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640012430 con 0x7f1648159400 2023-10-06T02:18:43.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.063+0000 7f164f3cd700 1 -- 172.21.15.6:0/527524990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1648159400 msgr2=0x7f16480ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:43.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.063+0000 7f164f3cd700 1 --2- 172.21.15.6:0/527524990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1648159400 0x7f16480ccaf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1640009eb0 tx=0x7f1640009780 comp rx=0 tx=0).stop 2023-10-06T02:18:43.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.063+0000 7f164f3cd700 1 -- 172.21.15.6:0/527524990 shutdown_connections 2023-10-06T02:18:43.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.063+0000 7f164f3cd700 1 --2- 172.21.15.6:0/527524990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16480d05d0 0x7f16480b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.063+0000 7f164f3cd700 1 --2- 172.21.15.6:0/527524990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1648159400 0x7f16480ccaf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.063+0000 7f164f3cd700 1 -- 172.21.15.6:0/527524990 >> 172.21.15.6:0/527524990 conn(0x7f164806ac10 msgr2=0x7f1648068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:43.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.063+0000 7f164f3cd700 1 -- 172.21.15.6:0/527524990 shutdown_connections 2023-10-06T02:18:43.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.063+0000 7f164f3cd700 1 -- 172.21.15.6:0/527524990 wait complete. 2023-10-06T02:18:43.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.064+0000 7f164f3cd700 1 Processor -- start 2023-10-06T02:18:43.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.064+0000 7f164f3cd700 1 -- start start 2023-10-06T02:18:43.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164f3cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16480cd030 0x7f1648153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:43.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164f3cd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16480d05d0 0x7f16480b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:43.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164f3cd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1648159400 0x7f16480b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:43.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164f3cd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164816d370 con 0x7f16480cd030 2023-10-06T02:18:43.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164f3cd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16480c8900 con 0x7f16480d05d0 2023-10-06T02:18:43.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164f3cd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16480c8be0 con 0x7f1648159400 2023-10-06T02:18:43.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164e3cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16480cd030 0x7f1648153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:43.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164e3cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16480cd030 0x7f1648153f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40790/0 (socket says 172.21.15.6:40790) 2023-10-06T02:18:43.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164e3cb700 1 -- 172.21.15.6:0/3991767371 learned_addr learned my addr 172.21.15.6:0/3991767371 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:43.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164dbca700 1 --2- 172.21.15.6:0/3991767371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16480d05d0 0x7f16480b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164ebcc700 1 --2- 172.21.15.6:0/3991767371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1648159400 0x7f16480b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164e3cb700 1 -- 172.21.15.6:0/3991767371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1648159400 msgr2=0x7f16480b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164e3cb700 1 --2- 172.21.15.6:0/3991767371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1648159400 0x7f16480b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164e3cb700 1 -- 172.21.15.6:0/3991767371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16480d05d0 msgr2=0x7f16480b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164e3cb700 1 --2- 172.21.15.6:0/3991767371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16480d05d0 0x7f16480b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164e3cb700 1 -- 172.21.15.6:0/3991767371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1638009420 con 0x7f16480cd030 2023-10-06T02:18:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164ebcc700 1 --2- 172.21.15.6:0/3991767371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1648159400 0x7f16480b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f164e3cb700 1 --2- 172.21.15.6:0/3991767371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16480cd030 0x7f1648153f70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f164000b610 tx=0x7f1640019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f16467fc700 1 -- 172.21.15.6:0/3991767371 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640012cb0 con 0x7f16480cd030 2023-10-06T02:18:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f16467fc700 1 -- 172.21.15.6:0/3991767371 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1640012e30 con 0x7f16480cd030 2023-10-06T02:18:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.065+0000 7f16467fc700 1 -- 172.21.15.6:0/3991767371 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16400276c0 con 0x7f16480cd030 2023-10-06T02:18:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.066+0000 7f164f3cd700 1 -- 172.21.15.6:0/3991767371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1640009a20 con 0x7f16480cd030 2023-10-06T02:18:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.066+0000 7f164f3cd700 1 -- 172.21.15.6:0/3991767371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16480ca890 con 0x7f16480cd030 2023-10-06T02:18:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.066+0000 7f164f3cd700 1 -- 172.21.15.6:0/3991767371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16480c9080 con 0x7f16480cd030 2023-10-06T02:18:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.067+0000 7f16467fc700 1 -- 172.21.15.6:0/3991767371 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1640024070 con 0x7f16480cd030 2023-10-06T02:18:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.067+0000 7f16467fc700 1 --2- 172.21.15.6:0/3991767371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1634066f30 0x7f16340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.067+0000 7f16467fc700 1 -- 172.21.15.6:0/3991767371 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f1640086a60 con 0x7f16480cd030 2023-10-06T02:18:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.067+0000 7f164dbca700 1 --2- 172.21.15.6:0/3991767371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1634066f30 0x7f16340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.068+0000 7f164dbca700 1 --2- 172.21.15.6:0/3991767371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1634066f30 0x7f16340693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f16480b1c00 tx=0x7f163c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.072+0000 7f16467fc700 1 -- 172.21.15.6:0/3991767371 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16480c9080 con 0x7f16480cd030 2023-10-06T02:18:43.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.266+0000 7f164f3cd700 1 -- 172.21.15.6:0/3991767371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f16480c9080 con 0x7f16480cd030 2023-10-06T02:18:43.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.267+0000 7f16467fc700 1 -- 172.21.15.6:0/3991767371 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+126 (secure 0 0 0) 0x7f16480c9080 con 0x7f16480cd030 2023-10-06T02:18:43.267 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:43.267 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-06T02:18:43.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:43.268 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-06T02:18:43.268 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-10-06T02:18:43.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:43.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:18:43.268 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-10-06T02:18:43.268 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-06T02:18:43.268 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:43.268 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-06T02:18:43.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.269+0000 7f164f3cd700 1 -- 172.21.15.6:0/3991767371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1634066f30 msgr2=0x7f16340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:43.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.269+0000 7f164f3cd700 1 --2- 172.21.15.6:0/3991767371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1634066f30 0x7f16340693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f16480b1c00 tx=0x7f163c009040 comp rx=0 tx=0).stop 2023-10-06T02:18:43.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.269+0000 7f164f3cd700 1 -- 172.21.15.6:0/3991767371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16480cd030 msgr2=0x7f1648153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:43.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.269+0000 7f164f3cd700 1 --2- 172.21.15.6:0/3991767371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16480cd030 0x7f1648153f70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f164000b610 tx=0x7f1640019000 comp rx=0 tx=0).stop 2023-10-06T02:18:43.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.269+0000 7f164f3cd700 1 -- 172.21.15.6:0/3991767371 shutdown_connections 2023-10-06T02:18:43.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.269+0000 7f164f3cd700 1 --2- 172.21.15.6:0/3991767371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1648159400 0x7f16480b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.269+0000 7f164f3cd700 1 --2- 172.21.15.6:0/3991767371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1634066f30 0x7f16340693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.269+0000 7f164f3cd700 1 --2- 172.21.15.6:0/3991767371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16480cd030 0x7f1648153f70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.269+0000 7f164f3cd700 1 --2- 172.21.15.6:0/3991767371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16480d05d0 0x7f16480b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.269+0000 7f164f3cd700 1 -- 172.21.15.6:0/3991767371 >> 172.21.15.6:0/3991767371 conn(0x7f164806ac10 msgr2=0x7f1648157f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:43.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.269+0000 7f164f3cd700 1 -- 172.21.15.6:0/3991767371 shutdown_connections 2023-10-06T02:18:43.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.269+0000 7f164f3cd700 1 -- 172.21.15.6:0/3991767371 wait complete. 2023-10-06T02:18:43.281 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:18:43.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:18:43.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.404+0000 7fd6d1998700 1 Processor -- start 2023-10-06T02:18:43.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.404+0000 7fd6d1998700 1 -- start start 2023-10-06T02:18:43.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.404+0000 7fd6d1998700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6cc06a9b0 0x7fd6cc15b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:43.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.404+0000 7fd6d1998700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6cc15b770 0x7fd6cc159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.404+0000 7fd6d1998700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6cc0afa60 con 0x7fd6cc1598b0 2023-10-06T02:18:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.404+0000 7fd6d1998700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6cc15bbf0 con 0x7fd6cc06a9b0 2023-10-06T02:18:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.404+0000 7fd6d1998700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc0af440 con 0x7fd6cc15b770 2023-10-06T02:18:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.405+0000 7fd6ca7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6cc06a9b0 0x7fd6cc15b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.405+0000 7fd6ca7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6cc06a9b0 0x7fd6cc15b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40796/0 (socket says 172.21.15.6:40796) 2023-10-06T02:18:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.405+0000 7fd6ca7fc700 1 -- 172.21.15.6:0/846881731 learned_addr learned my addr 172.21.15.6:0/846881731 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.405+0000 7fd6cb7fe700 1 --2- 172.21.15.6:0/846881731 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6cc15b770 0x7fd6cc159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.405+0000 7fd6ca7fc700 1 -- 172.21.15.6:0/846881731 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6cc15b770 msgr2=0x7fd6cc159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.405+0000 7fd6ca7fc700 1 --2- 172.21.15.6:0/846881731 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6cc15b770 0x7fd6cc159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.405+0000 7fd6ca7fc700 1 -- 172.21.15.6:0/846881731 >> v1:172.21.15.175:6789/0 conn(0x7fd6cc1598b0 legacy=0x7fd6cc0afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.405+0000 7fd6ca7fc700 1 -- 172.21.15.6:0/846881731 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc15ab00 con 0x7fd6cc06a9b0 2023-10-06T02:18:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.405+0000 7fd6ca7fc700 1 --2- 172.21.15.6:0/846881731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6cc06a9b0 0x7fd6cc15b230 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40099b0 tx=0x7fd6b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f93fcd07b4ba8f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:43.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.405+0000 7fd6c9ffb700 1 -- 172.21.15.6:0/846881731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b400b860 con 0x7fd6cc06a9b0 2023-10-06T02:18:43.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.405+0000 7fd6c9ffb700 1 -- 172.21.15.6:0/846881731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b400b9c0 con 0x7fd6cc06a9b0 2023-10-06T02:18:43.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.405+0000 7fd6c9ffb700 1 -- 172.21.15.6:0/846881731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b400bd60 con 0x7fd6cc06a9b0 2023-10-06T02:18:43.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.406+0000 7fd6d1998700 1 -- 172.21.15.6:0/846881731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6cc06a9b0 msgr2=0x7fd6cc15b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:43.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.406+0000 7fd6d1998700 1 --2- 172.21.15.6:0/846881731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6cc06a9b0 0x7fd6cc15b230 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40099b0 tx=0x7fd6b4009250 comp rx=0 tx=0).stop 2023-10-06T02:18:43.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.406+0000 7fd6d1998700 1 -- 172.21.15.6:0/846881731 shutdown_connections 2023-10-06T02:18:43.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.406+0000 7fd6d1998700 1 --2- 172.21.15.6:0/846881731 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6cc15b770 0x7fd6cc159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.406+0000 7fd6d1998700 1 --2- 172.21.15.6:0/846881731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6cc06a9b0 0x7fd6cc15b230 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.406+0000 7fd6d1998700 1 -- 172.21.15.6:0/846881731 >> 172.21.15.6:0/846881731 conn(0x7fd6cc067910 msgr2=0x7fd6cc0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:43.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.406+0000 7fd6d1998700 1 -- 172.21.15.6:0/846881731 shutdown_connections 2023-10-06T02:18:43.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.406+0000 7fd6d1998700 1 -- 172.21.15.6:0/846881731 wait complete. 2023-10-06T02:18:43.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.407+0000 7fd6d1998700 1 Processor -- start 2023-10-06T02:18:43.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.407+0000 7fd6d1998700 1 -- start start 2023-10-06T02:18:43.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6d1998700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6cc06a9b0 0x7fd6cc097c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:43.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6d1998700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6cc1598b0 0x7fd6cc0c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6d1998700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6cc15b770 0x7fd6cc0c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6d1998700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc098720 con 0x7fd6cc15b770 2023-10-06T02:18:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6d1998700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc098a00 con 0x7fd6cc06a9b0 2023-10-06T02:18:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6d1998700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc098ce0 con 0x7fd6cc1598b0 2023-10-06T02:18:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6cb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6cc15b770 0x7fd6cc0c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6cb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6cc15b770 0x7fd6cc0c33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40812/0 (socket says 172.21.15.6:40812) 2023-10-06T02:18:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6cb7fe700 1 -- 172.21.15.6:0/1363368551 learned_addr learned my addr 172.21.15.6:0/1363368551 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6ca7fc700 1 --2- 172.21.15.6:0/1363368551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6cc1598b0 0x7fd6cc0c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6caffd700 1 --2- 172.21.15.6:0/1363368551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6cc06a9b0 0x7fd6cc097c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6cb7fe700 1 -- 172.21.15.6:0/1363368551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6cc1598b0 msgr2=0x7fd6cc0c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:43.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6cb7fe700 1 --2- 172.21.15.6:0/1363368551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6cc1598b0 0x7fd6cc0c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6cb7fe700 1 -- 172.21.15.6:0/1363368551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6cc06a9b0 msgr2=0x7fd6cc097c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:43.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6cb7fe700 1 --2- 172.21.15.6:0/1363368551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6cc06a9b0 0x7fd6cc097c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6cb7fe700 1 -- 172.21.15.6:0/1363368551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b40094f0 con 0x7fd6cc15b770 2023-10-06T02:18:43.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6cb7fe700 1 --2- 172.21.15.6:0/1363368551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6cc15b770 0x7fd6cc0c33a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009fa0 tx=0x7fd6c4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:43.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6c2ffd700 1 -- 172.21.15.6:0/1363368551 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c400ebc0 con 0x7fd6cc15b770 2023-10-06T02:18:43.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6c2ffd700 1 -- 172.21.15.6:0/1363368551 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c400ed20 con 0x7fd6cc15b770 2023-10-06T02:18:43.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6d1998700 1 -- 172.21.15.6:0/1363368551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6cc098fc0 con 0x7fd6cc15b770 2023-10-06T02:18:43.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.408+0000 7fd6c2ffd700 1 -- 172.21.15.6:0/1363368551 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4014670 con 0x7fd6cc15b770 2023-10-06T02:18:43.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.409+0000 7fd6d1998700 1 -- 172.21.15.6:0/1363368551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6cc0997c0 con 0x7fd6cc15b770 2023-10-06T02:18:43.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.410+0000 7fd6d1998700 1 -- 172.21.15.6:0/1363368551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6cc0994e0 con 0x7fd6cc15b770 2023-10-06T02:18:43.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.410+0000 7fd6c2ffd700 1 -- 172.21.15.6:0/1363368551 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6c40149e0 con 0x7fd6cc15b770 2023-10-06T02:18:43.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.410+0000 7fd6c2ffd700 1 --2- 172.21.15.6:0/1363368551 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6ac066f30 0x7fd6ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:43.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.410+0000 7fd6c2ffd700 1 -- 172.21.15.6:0/1363368551 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fd6c4084ad0 con 0x7fd6cc15b770 2023-10-06T02:18:43.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.410+0000 7fd6caffd700 1 --2- 172.21.15.6:0/1363368551 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6ac066f30 0x7fd6ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:43.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.411+0000 7fd6caffd700 1 --2- 172.21.15.6:0/1363368551 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6ac066f30 0x7fd6ac0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc003a20 tx=0x7fd6bc007f10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:43.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.414+0000 7fd6c2ffd700 1 -- 172.21.15.6:0/1363368551 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6cc0994e0 con 0x7fd6cc15b770 2023-10-06T02:18:43.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.609+0000 7fd6d1998700 1 -- 172.21.15.6:0/1363368551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd6cc0994e0 con 0x7fd6cc15b770 2023-10-06T02:18:43.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.936+0000 7fd6c2ffd700 1 -- 172.21.15.6:0/1363368551 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd6cc0994e0 con 0x7fd6cc15b770 2023-10-06T02:18:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.940+0000 7fd6d1998700 1 -- 172.21.15.6:0/1363368551 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6ac066f30 msgr2=0x7fd6ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.940+0000 7fd6d1998700 1 --2- 172.21.15.6:0/1363368551 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6ac066f30 0x7fd6ac0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc003a20 tx=0x7fd6bc007f10 comp rx=0 tx=0).stop 2023-10-06T02:18:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.940+0000 7fd6d1998700 1 -- 172.21.15.6:0/1363368551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6cc15b770 msgr2=0x7fd6cc0c33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.940+0000 7fd6d1998700 1 --2- 172.21.15.6:0/1363368551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6cc15b770 0x7fd6cc0c33a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009fa0 tx=0x7fd6c4009900 comp rx=0 tx=0).stop 2023-10-06T02:18:43.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.941+0000 7fd6d1998700 1 -- 172.21.15.6:0/1363368551 shutdown_connections 2023-10-06T02:18:43.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.941+0000 7fd6d1998700 1 --2- 172.21.15.6:0/1363368551 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6ac066f30 0x7fd6ac0693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.941+0000 7fd6d1998700 1 --2- 172.21.15.6:0/1363368551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6cc15b770 0x7fd6cc0c33a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.941+0000 7fd6d1998700 1 --2- 172.21.15.6:0/1363368551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6cc06a9b0 0x7fd6cc097c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.941+0000 7fd6d1998700 1 --2- 172.21.15.6:0/1363368551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6cc1598b0 0x7fd6cc0c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:43.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.941+0000 7fd6d1998700 1 -- 172.21.15.6:0/1363368551 >> 172.21.15.6:0/1363368551 conn(0x7fd6cc067910 msgr2=0x7fd6cc069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:43.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.942+0000 7fd6d1998700 1 -- 172.21.15.6:0/1363368551 shutdown_connections 2023-10-06T02:18:43.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:43.942+0000 7fd6d1998700 1 -- 172.21.15.6:0/1363368551 wait complete. 2023-10-06T02:18:43.944 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-06T02:18:43.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:18:44.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.083+0000 7f4b430fe700 1 Processor -- start 2023-10-06T02:18:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.083+0000 7f4b430fe700 1 -- start start 2023-10-06T02:18:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.084+0000 7f4b430fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b3c0af360 0x7f4b3c15a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.084+0000 7f4b430fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b3c0af730 0x7f4b3c0ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.084+0000 7f4b430fe700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3c15aab0 con 0x7f4b3c15d120 2023-10-06T02:18:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.084+0000 7f4b430fe700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3c0ce6e0 con 0x7f4b3c0af730 2023-10-06T02:18:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.084+0000 7f4b430fe700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c159a30 con 0x7f4b3c0af360 2023-10-06T02:18:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.084+0000 7f4b418fb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b3c0af730 0x7f4b3c0ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.084+0000 7f4b418fb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b3c0af730 0x7f4b3c0ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40824/0 (socket says 172.21.15.6:40824) 2023-10-06T02:18:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.084+0000 7f4b418fb700 1 -- 172.21.15.6:0/4069805559 learned_addr learned my addr 172.21.15.6:0/4069805559 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.084+0000 7f4b428fd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4b3c15d120 0x7f4b3c086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43306/0 (socket says 172.21.15.6:43306) 2023-10-06T02:18:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.084+0000 7f4b420fc700 1 --2- 172.21.15.6:0/4069805559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b3c0af360 0x7f4b3c15a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.085+0000 7f4b418fb700 1 -- 172.21.15.6:0/4069805559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b3c0af360 msgr2=0x7f4b3c15a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.085+0000 7f4b418fb700 1 --2- 172.21.15.6:0/4069805559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b3c0af360 0x7f4b3c15a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.085+0000 7f4b418fb700 1 -- 172.21.15.6:0/4069805559 >> v1:172.21.15.6:6789/0 conn(0x7f4b3c15d120 legacy=0x7f4b3c086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.085+0000 7f4b418fb700 1 -- 172.21.15.6:0/4069805559 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c15d6c0 con 0x7f4b3c0af730 2023-10-06T02:18:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.085+0000 7f4b418fb700 1 --2- 172.21.15.6:0/4069805559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b3c0af730 0x7f4b3c0ccb10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4b300099b0 tx=0x7f4b30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7bfffecbd79bfb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.085+0000 7f4b410fa700 1 -- 172.21.15.6:0/4069805559 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30009ea0 con 0x7f4b3c0af730 2023-10-06T02:18:44.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.085+0000 7f4b410fa700 1 -- 172.21.15.6:0/4069805559 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3000b860 con 0x7f4b3c0af730 2023-10-06T02:18:44.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.085+0000 7f4b410fa700 1 -- 172.21.15.6:0/4069805559 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3000bc00 con 0x7f4b3c0af730 2023-10-06T02:18:44.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.085+0000 7f4b430fe700 1 -- 172.21.15.6:0/4069805559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b3c0af730 msgr2=0x7f4b3c0ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.085+0000 7f4b430fe700 1 --2- 172.21.15.6:0/4069805559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b3c0af730 0x7f4b3c0ccb10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4b300099b0 tx=0x7f4b30009250 comp rx=0 tx=0).stop 2023-10-06T02:18:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.086+0000 7f4b430fe700 1 -- 172.21.15.6:0/4069805559 shutdown_connections 2023-10-06T02:18:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.086+0000 7f4b430fe700 1 --2- 172.21.15.6:0/4069805559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b3c0af360 0x7f4b3c15a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.086+0000 7f4b430fe700 1 --2- 172.21.15.6:0/4069805559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b3c0af730 0x7f4b3c0ccb10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.086+0000 7f4b430fe700 1 -- 172.21.15.6:0/4069805559 >> 172.21.15.6:0/4069805559 conn(0x7f4b3c068680 msgr2=0x7f4b3c068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.086+0000 7f4b430fe700 1 -- 172.21.15.6:0/4069805559 shutdown_connections 2023-10-06T02:18:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.086+0000 7f4b430fe700 1 -- 172.21.15.6:0/4069805559 wait complete. 2023-10-06T02:18:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.087+0000 7f4b430fe700 1 Processor -- start 2023-10-06T02:18:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.087+0000 7f4b430fe700 1 -- start start 2023-10-06T02:18:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.087+0000 7f4b430fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b3c0af360 0x7f4b3c0b4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.087+0000 7f4b430fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b3c0af730 0x7f4b3c1510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.087+0000 7f4b430fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b3c15d120 0x7f4b3c0b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b430fe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c0b24e0 con 0x7f4b3c0af360 2023-10-06T02:18:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b430fe700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c0b18d0 con 0x7f4b3c15d120 2023-10-06T02:18:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b430fe700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c0b1bb0 con 0x7f4b3c0af730 2023-10-06T02:18:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b420fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b3c0af360 0x7f4b3c0b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b420fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b3c0af360 0x7f4b3c0b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40838/0 (socket says 172.21.15.6:40838) 2023-10-06T02:18:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b420fc700 1 -- 172.21.15.6:0/965515785 learned_addr learned my addr 172.21.15.6:0/965515785 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b428fd700 1 --2- 172.21.15.6:0/965515785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b3c15d120 0x7f4b3c0b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b418fb700 1 --2- 172.21.15.6:0/965515785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b3c0af730 0x7f4b3c1510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b420fc700 1 -- 172.21.15.6:0/965515785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b3c0af730 msgr2=0x7f4b3c1510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b420fc700 1 --2- 172.21.15.6:0/965515785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b3c0af730 0x7f4b3c1510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b420fc700 1 -- 172.21.15.6:0/965515785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b3c15d120 msgr2=0x7f4b3c0b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b420fc700 1 --2- 172.21.15.6:0/965515785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b3c15d120 0x7f4b3c0b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b420fc700 1 -- 172.21.15.6:0/965515785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b300094f0 con 0x7f4b3c0af360 2023-10-06T02:18:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b420fc700 1 --2- 172.21.15.6:0/965515785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b3c0af360 0x7f4b3c0b4550 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400ec80 tx=0x7f4b340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b3a7fc700 1 -- 172.21.15.6:0/965515785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3400c850 con 0x7f4b3c0af360 2023-10-06T02:18:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b3a7fc700 1 -- 172.21.15.6:0/965515785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3400c9b0 con 0x7f4b3c0af360 2023-10-06T02:18:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b430fe700 1 -- 172.21.15.6:0/965515785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b3c0b1e90 con 0x7f4b3c0af360 2023-10-06T02:18:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b3a7fc700 1 -- 172.21.15.6:0/965515785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3400cd50 con 0x7f4b3c0af360 2023-10-06T02:18:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.088+0000 7f4b430fe700 1 -- 172.21.15.6:0/965515785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3c0b15e0 con 0x7f4b3c0af360 2023-10-06T02:18:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.089+0000 7f4b430fe700 1 -- 172.21.15.6:0/965515785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3c0b27c0 con 0x7f4b3c0af360 2023-10-06T02:18:44.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.090+0000 7f4b3a7fc700 1 -- 172.21.15.6:0/965515785 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b34013680 con 0x7f4b3c0af360 2023-10-06T02:18:44.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.090+0000 7f4b3a7fc700 1 --2- 172.21.15.6:0/965515785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b28066f30 0x7f4b280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:44.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.090+0000 7f4b3a7fc700 1 -- 172.21.15.6:0/965515785 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f4b34085100 con 0x7f4b3c0af360 2023-10-06T02:18:44.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.091+0000 7f4b418fb700 1 --2- 172.21.15.6:0/965515785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b28066f30 0x7f4b280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:44.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.091+0000 7f4b418fb700 1 --2- 172.21.15.6:0/965515785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b28066f30 0x7f4b280693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4b300099b0 tx=0x7f4b30017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:44.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.094+0000 7f4b3a7fc700 1 -- 172.21.15.6:0/965515785 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b34052290 con 0x7f4b3c0af360 2023-10-06T02:18:44.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.287+0000 7f4b430fe700 1 -- 172.21.15.6:0/965515785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4b3c15be50 con 0x7f4b3c0af360 2023-10-06T02:18:44.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.940+0000 7f4b3a7fc700 1 -- 172.21.15.6:0/965515785 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4b340558b0 con 0x7f4b3c0af360 2023-10-06T02:18:44.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.947+0000 7f4b430fe700 1 -- 172.21.15.6:0/965515785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b28066f30 msgr2=0x7f4b280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:44.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.947+0000 7f4b430fe700 1 --2- 172.21.15.6:0/965515785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b28066f30 0x7f4b280693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4b300099b0 tx=0x7f4b30017000 comp rx=0 tx=0).stop 2023-10-06T02:18:44.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.947+0000 7f4b430fe700 1 -- 172.21.15.6:0/965515785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b3c0af360 msgr2=0x7f4b3c0b4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:44.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.947+0000 7f4b430fe700 1 --2- 172.21.15.6:0/965515785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b3c0af360 0x7f4b3c0b4550 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400ec80 tx=0x7f4b340091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:44.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.948+0000 7f4b430fe700 1 -- 172.21.15.6:0/965515785 shutdown_connections 2023-10-06T02:18:44.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.948+0000 7f4b430fe700 1 --2- 172.21.15.6:0/965515785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b3c15d120 0x7f4b3c0b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:44.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.948+0000 7f4b430fe700 1 --2- 172.21.15.6:0/965515785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b28066f30 0x7f4b280693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:44.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.948+0000 7f4b430fe700 1 --2- 172.21.15.6:0/965515785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b3c0af360 0x7f4b3c0b4550 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.948+0000 7f4b430fe700 1 --2- 172.21.15.6:0/965515785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b3c0af730 0x7f4b3c1510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.948+0000 7f4b430fe700 1 -- 172.21.15.6:0/965515785 >> 172.21.15.6:0/965515785 conn(0x7f4b3c068680 msgr2=0x7f4b3c15c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:44.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.950+0000 7f4b430fe700 1 -- 172.21.15.6:0/965515785 shutdown_connections 2023-10-06T02:18:44.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:44.950+0000 7f4b430fe700 1 -- 172.21.15.6:0/965515785 wait complete. 2023-10-06T02:18:44.953 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-06T02:18:44.970 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:18:45.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.095+0000 7fb8b7c39700 1 Processor -- start 2023-10-06T02:18:45.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.095+0000 7fb8b7c39700 1 -- start start 2023-10-06T02:18:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.096+0000 7fb8b7c39700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8b006a380 0x7fb8b00cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.096+0000 7fb8b7c39700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b006a750 0x7fb8b015d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.096+0000 7fb8b7c39700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b00cae80 con 0x7fb8b015d770 2023-10-06T02:18:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.096+0000 7fb8b7c39700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b00cc3d0 con 0x7fb8b006a380 2023-10-06T02:18:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.096+0000 7fb8b7c39700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b015dcd0 con 0x7fb8b006a750 2023-10-06T02:18:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.096+0000 7fb8b61d6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb8b015d770 0x7fb8b0159170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43320/0 (socket says 172.21.15.6:43320) 2023-10-06T02:18:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.096+0000 7fb8b61d6700 1 -- 172.21.15.6:0/505534350 learned_addr learned my addr 172.21.15.6:0/505534350 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b59d5700 1 --2- 172.21.15.6:0/505534350 >> v2:172.21.15.175:3300/0 conn(0x7fb8b006a380 0x7fb8b00cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b51d4700 1 --2- 172.21.15.6:0/505534350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b006a750 0x7fb8b015d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b49d3700 1 -- 172.21.15.6:0/505534350 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189155241 0 0) 0x7fb8b00cae80 con 0x7fb8b015d770 2023-10-06T02:18:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b49d3700 1 -- 172.21.15.6:0/505534350 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb898003570 con 0x7fb8b015d770 2023-10-06T02:18:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b49d3700 1 -- 172.21.15.6:0/505534350 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3693097860 0 0) 0x7fb898003570 con 0x7fb8b015d770 2023-10-06T02:18:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b49d3700 1 -- 172.21.15.6:0/505534350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b006a750 msgr2=0x7fb8b015d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b49d3700 1 --2- 172.21.15.6:0/505534350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b006a750 0x7fb8b015d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b49d3700 1 -- 172.21.15.6:0/505534350 >> v2:172.21.15.175:3300/0 conn(0x7fb8b006a380 msgr2=0x7fb8b00cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b49d3700 1 --2- 172.21.15.6:0/505534350 >> v2:172.21.15.175:3300/0 conn(0x7fb8b006a380 0x7fb8b00cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b49d3700 1 -- 172.21.15.6:0/505534350 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b015dfb0 con 0x7fb8b015d770 2023-10-06T02:18:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b49d3700 1 -- 172.21.15.6:0/505534350 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fb8a8001470 con 0x7fb8b015d770 2023-10-06T02:18:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b49d3700 1 -- 172.21.15.6:0/505534350 >> v1:172.21.15.6:6789/0 conn(0x7fb8b015d770 legacy=0x7fb8b0159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b49d3700 1 --2- 172.21.15.6:0/505534350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b006a750 0x7fb898003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b49d3700 1 --2- 172.21.15.6:0/505534350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb898003fe0 0x7fb898004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b49d3700 1 --2- 172.21.15.6:0/505534350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb898004d50 0x7fb8980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b49d3700 1 -- 172.21.15.6:0/505534350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b015dcd0 con 0x7fb898003fe0 2023-10-06T02:18:45.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b49d3700 1 -- 172.21.15.6:0/505534350 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89800ba60 con 0x7fb898004d50 2023-10-06T02:18:45.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b49d3700 1 -- 172.21.15.6:0/505534350 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89800bbd0 con 0x7fb8b006a750 2023-10-06T02:18:45.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b51d4700 1 --2- 172.21.15.6:0/505534350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb898003fe0 0x7fb898004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:45.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b59d5700 1 --2- 172.21.15.6:0/505534350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b006a750 0x7fb898003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:45.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.097+0000 7fb8b61d6700 1 --2- 172.21.15.6:0/505534350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb898004d50 0x7fb8980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:45.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.098+0000 7fb8b51d4700 1 -- 172.21.15.6:0/505534350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b006a750 msgr2=0x7fb898003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:45.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.098+0000 7fb8b51d4700 1 --2- 172.21.15.6:0/505534350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b006a750 0x7fb898003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:45.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.098+0000 7fb8b51d4700 1 -- 172.21.15.6:0/505534350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb898004d50 msgr2=0x7fb8980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:45.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.098+0000 7fb8b51d4700 1 --2- 172.21.15.6:0/505534350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb898004d50 0x7fb8980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:45.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.098+0000 7fb8b51d4700 1 -- 172.21.15.6:0/505534350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb898003570 con 0x7fb898003fe0 2023-10-06T02:18:45.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.098+0000 7fb8b51d4700 1 --2- 172.21.15.6:0/505534350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb898003fe0 0x7fb898004810 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009c00 tx=0x7fb8a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57322ed6627aad8b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:45.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.098+0000 7fb8b49d3700 1 -- 172.21.15.6:0/505534350 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a400e6b0 con 0x7fb898003fe0 2023-10-06T02:18:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.098+0000 7fb8b49d3700 1 -- 172.21.15.6:0/505534350 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a400e810 con 0x7fb898003fe0 2023-10-06T02:18:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.098+0000 7fb8b49d3700 1 -- 172.21.15.6:0/505534350 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a400ebd0 con 0x7fb898003fe0 2023-10-06T02:18:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.098+0000 7fb8b7c39700 1 -- 172.21.15.6:0/505534350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb898003fe0 msgr2=0x7fb898004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.098+0000 7fb8b7c39700 1 --2- 172.21.15.6:0/505534350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb898003fe0 0x7fb898004810 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009c00 tx=0x7fb8a40091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.098+0000 7fb8b61d6700 1 -- 172.21.15.6:0/505534350 reap_dead start 2023-10-06T02:18:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.099+0000 7fb8b7c39700 1 -- 172.21.15.6:0/505534350 shutdown_connections 2023-10-06T02:18:45.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.099+0000 7fb8b7c39700 1 -- 172.21.15.6:0/505534350 >> 172.21.15.6:0/505534350 conn(0x7fb8b00d0350 msgr2=0x7fb8b00d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:45.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.099+0000 7fb8b7c39700 1 -- 172.21.15.6:0/505534350 shutdown_connections 2023-10-06T02:18:45.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.099+0000 7fb8b7c39700 1 -- 172.21.15.6:0/505534350 wait complete. 2023-10-06T02:18:45.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.100+0000 7fb8b7c39700 1 Processor -- start 2023-10-06T02:18:45.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.100+0000 7fb8b7c39700 1 -- start start 2023-10-06T02:18:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.100+0000 7fb8b7c39700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb898003fe0 0x7fb8b014fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.100+0000 7fb8b7c39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8b00b10f0 0x7fb8b00c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.100+0000 7fb8b7c39700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b00c6100 0x7fb8b00c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.100+0000 7fb8b7c39700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00b3420 con 0x7fb8b00b10f0 2023-10-06T02:18:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.100+0000 7fb8b7c39700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00ca3d0 con 0x7fb898003fe0 2023-10-06T02:18:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.100+0000 7fb8b7c39700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00b4940 con 0x7fb8b00c6100 2023-10-06T02:18:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.101+0000 7fb8b51d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8b00b10f0 0x7fb8b00c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:45.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.101+0000 7fb8b51d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8b00b10f0 0x7fb8b00c9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40858/0 (socket says 172.21.15.6:40858) 2023-10-06T02:18:45.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.101+0000 7fb8b51d4700 1 -- 172.21.15.6:0/1790855745 learned_addr learned my addr 172.21.15.6:0/1790855745 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:45.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.101+0000 7fb8b59d5700 1 --2- 172.21.15.6:0/1790855745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb898003fe0 0x7fb8b014fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:45.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.101+0000 7fb8b61d6700 1 --2- 172.21.15.6:0/1790855745 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b00c6100 0x7fb8b00c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:45.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.101+0000 7fb8b51d4700 1 -- 172.21.15.6:0/1790855745 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b00c6100 msgr2=0x7fb8b00c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:45.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.101+0000 7fb8b51d4700 1 --2- 172.21.15.6:0/1790855745 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b00c6100 0x7fb8b00c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:45.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.101+0000 7fb8b51d4700 1 -- 172.21.15.6:0/1790855745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb898003fe0 msgr2=0x7fb8b014fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:45.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.101+0000 7fb8b51d4700 1 --2- 172.21.15.6:0/1790855745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb898003fe0 0x7fb8b014fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:45.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.101+0000 7fb8b51d4700 1 -- 172.21.15.6:0/1790855745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b00c6ab0 con 0x7fb8b00b10f0 2023-10-06T02:18:45.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.101+0000 7fb8b59d5700 1 --2- 172.21.15.6:0/1790855745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb898003fe0 0x7fb8b014fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:45.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.101+0000 7fb8b51d4700 1 --2- 172.21.15.6:0/1790855745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8b00b10f0 0x7fb8b00c9e90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb898004730 tx=0x7fb8a401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:45.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.101+0000 7fb8adffb700 1 -- 172.21.15.6:0/1790855745 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4022070 con 0x7fb8b00b10f0 2023-10-06T02:18:45.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.101+0000 7fb8adffb700 1 -- 172.21.15.6:0/1790855745 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a400e980 con 0x7fb8b00b10f0 2023-10-06T02:18:45.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.101+0000 7fb8b7c39700 1 -- 172.21.15.6:0/1790855745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b00b1660 con 0x7fb8b00b10f0 2023-10-06T02:18:45.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.101+0000 7fb8adffb700 1 -- 172.21.15.6:0/1790855745 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4027470 con 0x7fb8b00b10f0 2023-10-06T02:18:45.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.101+0000 7fb8b7c39700 1 -- 172.21.15.6:0/1790855745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b00b1c20 con 0x7fb8b00b10f0 2023-10-06T02:18:45.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.102+0000 7fb8b7c39700 1 -- 172.21.15.6:0/1790855745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b00b4ad0 con 0x7fb8b00b10f0 2023-10-06T02:18:45.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.103+0000 7fb8adffb700 1 -- 172.21.15.6:0/1790855745 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8a401c450 con 0x7fb8b00b10f0 2023-10-06T02:18:45.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.103+0000 7fb8adffb700 1 --2- 172.21.15.6:0/1790855745 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb89c066f30 0x7fb89c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:45.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.103+0000 7fb8adffb700 1 -- 172.21.15.6:0/1790855745 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fb8a4086400 con 0x7fb8b00b10f0 2023-10-06T02:18:45.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.103+0000 7fb8b59d5700 1 --2- 172.21.15.6:0/1790855745 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb89c066f30 0x7fb89c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:45.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.104+0000 7fb8b59d5700 1 --2- 172.21.15.6:0/1790855745 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb89c066f30 0x7fb89c0693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00094d0 tx=0x7fb8a0017040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.108+0000 7fb8adffb700 1 -- 172.21.15.6:0/1790855745 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8b00b4ad0 con 0x7fb8b00b10f0 2023-10-06T02:18:45.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.348+0000 7fb8b7c39700 1 -- 172.21.15.6:0/1790855745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb8b00b4a80 con 0x7fb8b00b10f0 2023-10-06T02:18:45.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:45.993+0000 7fb8adffb700 1 -- 172.21.15.6:0/1790855745 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb8a4056e20 con 0x7fb8b00b10f0 2023-10-06T02:18:46.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.001+0000 7fb8b7c39700 1 -- 172.21.15.6:0/1790855745 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb89c066f30 msgr2=0x7fb89c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.001+0000 7fb8b7c39700 1 --2- 172.21.15.6:0/1790855745 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb89c066f30 0x7fb89c0693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00094d0 tx=0x7fb8a0017040 comp rx=0 tx=0).stop 2023-10-06T02:18:46.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.001+0000 7fb8b7c39700 1 -- 172.21.15.6:0/1790855745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8b00b10f0 msgr2=0x7fb8b00c9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.001+0000 7fb8b7c39700 1 --2- 172.21.15.6:0/1790855745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8b00b10f0 0x7fb8b00c9e90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb898004730 tx=0x7fb8a401a000 comp rx=0 tx=0).stop 2023-10-06T02:18:46.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.002+0000 7fb8b7c39700 1 -- 172.21.15.6:0/1790855745 shutdown_connections 2023-10-06T02:18:46.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.002+0000 7fb8b7c39700 1 --2- 172.21.15.6:0/1790855745 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b00c6100 0x7fb8b00c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.002+0000 7fb8b7c39700 1 --2- 172.21.15.6:0/1790855745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb898003fe0 0x7fb8b014fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.002+0000 7fb8b7c39700 1 --2- 172.21.15.6:0/1790855745 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb89c066f30 0x7fb89c0693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.002+0000 7fb8b7c39700 1 --2- 172.21.15.6:0/1790855745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8b00b10f0 0x7fb8b00c9e90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.002+0000 7fb8b7c39700 1 -- 172.21.15.6:0/1790855745 >> 172.21.15.6:0/1790855745 conn(0x7fb8b00d0350 msgr2=0x7fb8b0158130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:46.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.002+0000 7fb8b7c39700 1 -- 172.21.15.6:0/1790855745 shutdown_connections 2023-10-06T02:18:46.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.002+0000 7fb8b7c39700 1 -- 172.21.15.6:0/1790855745 wait complete. 2023-10-06T02:18:46.003 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 6 and data pool 7 2023-10-06T02:18:46.018 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:18:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.140+0000 7fbc66049700 1 Processor -- start 2023-10-06T02:18:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.140+0000 7fbc66049700 1 -- start start 2023-10-06T02:18:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.141+0000 7fbc66049700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbc600af4e0 0x7fbc600b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.141+0000 7fbc66049700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6015e190 con 0x7fbc600af8b0 2023-10-06T02:18:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.141+0000 7fbc66049700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc600cb650 con 0x7fbc6015db70 2023-10-06T02:18:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.141+0000 7fbc66049700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc600b1910 con 0x7fbc600af4e0 2023-10-06T02:18:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.141+0000 7fbc5effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbc600af8b0 0x7fbc6015d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43322/0 (socket says 172.21.15.6:43322) 2023-10-06T02:18:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.141+0000 7fbc5effd700 1 -- 172.21.15.6:0/1509664798 learned_addr learned my addr 172.21.15.6:0/1509664798 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.141+0000 7fbc5f7fe700 1 --2- 172.21.15.6:0/1509664798 >> v2:172.21.15.175:3300/0 conn(0x7fbc600af4e0 0x7fbc600b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5e7fc700 1 -- 172.21.15.6:0/1509664798 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492922442 0 0) 0x7fbc6015e190 con 0x7fbc600af8b0 2023-10-06T02:18:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5e7fc700 1 -- 172.21.15.6:0/1509664798 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc48003570 con 0x7fbc600af8b0 2023-10-06T02:18:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5e7fc700 1 -- 172.21.15.6:0/1509664798 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908757143 0 0) 0x7fbc600cb650 con 0x7fbc6015db70 2023-10-06T02:18:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5e7fc700 1 -- 172.21.15.6:0/1509664798 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc6015e190 con 0x7fbc6015db70 2023-10-06T02:18:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5e7fc700 1 -- 172.21.15.6:0/1509664798 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2144259825 0 0) 0x7fbc48003570 con 0x7fbc600af8b0 2023-10-06T02:18:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5e7fc700 1 -- 172.21.15.6:0/1509664798 >> v2:172.21.15.175:3300/0 conn(0x7fbc600af4e0 msgr2=0x7fbc600b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5e7fc700 1 --2- 172.21.15.6:0/1509664798 >> v2:172.21.15.175:3300/0 conn(0x7fbc600af4e0 0x7fbc600b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5e7fc700 1 -- 172.21.15.6:0/1509664798 >> v1:172.21.15.175:6789/0 conn(0x7fbc6015db70 legacy=0x7fbc600cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5e7fc700 1 -- 172.21.15.6:0/1509664798 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc600cad20 con 0x7fbc600af8b0 2023-10-06T02:18:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5e7fc700 1 -- 172.21.15.6:0/1509664798 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fbc54001470 con 0x7fbc600af8b0 2023-10-06T02:18:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5e7fc700 1 -- 172.21.15.6:0/1509664798 >> v1:172.21.15.6:6789/0 conn(0x7fbc600af8b0 legacy=0x7fbc6015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5e7fc700 1 --2- 172.21.15.6:0/1509664798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc48003bf0 0x7fbc48003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5e7fc700 1 --2- 172.21.15.6:0/1509664798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48004810 0x7fbc48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5e7fc700 1 --2- 172.21.15.6:0/1509664798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc480051c0 0x7fbc4800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5e7fc700 1 -- 172.21.15.6:0/1509664798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600b1910 con 0x7fbc48004810 2023-10-06T02:18:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5e7fc700 1 -- 172.21.15.6:0/1509664798 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4800c160 con 0x7fbc480051c0 2023-10-06T02:18:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5e7fc700 1 -- 172.21.15.6:0/1509664798 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4800c320 con 0x7fbc48003bf0 2023-10-06T02:18:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5effd700 1 --2- 172.21.15.6:0/1509664798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48004810 0x7fbc48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5f7fe700 1 --2- 172.21.15.6:0/1509664798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc48003bf0 0x7fbc48003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5ffff700 1 --2- 172.21.15.6:0/1509664798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc480051c0 0x7fbc4800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5effd700 1 -- 172.21.15.6:0/1509664798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc48003bf0 msgr2=0x7fbc48003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5effd700 1 --2- 172.21.15.6:0/1509664798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc48003bf0 0x7fbc48003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5effd700 1 -- 172.21.15.6:0/1509664798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc480051c0 msgr2=0x7fbc4800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5effd700 1 --2- 172.21.15.6:0/1509664798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc480051c0 0x7fbc4800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5effd700 1 -- 172.21.15.6:0/1509664798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc48003570 con 0x7fbc48004810 2023-10-06T02:18:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5f7fe700 1 --2- 172.21.15.6:0/1509664798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc48003bf0 0x7fbc48003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5ffff700 1 --2- 172.21.15.6:0/1509664798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc480051c0 0x7fbc4800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.142+0000 7fbc5ffff700 1 -- 172.21.15.6:0/1509664798 reap_dead start 2023-10-06T02:18:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.143+0000 7fbc5effd700 1 --2- 172.21.15.6:0/1509664798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48004810 0x7fbc48004c80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbc60089810 tx=0x7fbc54001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e89450a1203bc1b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.143+0000 7fbc5e7fc700 1 -- 172.21.15.6:0/1509664798 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5400cb40 con 0x7fbc48004810 2023-10-06T02:18:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.143+0000 7fbc5e7fc700 1 -- 172.21.15.6:0/1509664798 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5400cca0 con 0x7fbc48004810 2023-10-06T02:18:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.143+0000 7fbc5e7fc700 1 -- 172.21.15.6:0/1509664798 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54005b70 con 0x7fbc48004810 2023-10-06T02:18:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.143+0000 7fbc66049700 1 -- 172.21.15.6:0/1509664798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48004810 msgr2=0x7fbc48004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.143+0000 7fbc66049700 1 --2- 172.21.15.6:0/1509664798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48004810 0x7fbc48004c80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbc60089810 tx=0x7fbc54001e10 comp rx=0 tx=0).stop 2023-10-06T02:18:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.143+0000 7fbc66049700 1 -- 172.21.15.6:0/1509664798 shutdown_connections 2023-10-06T02:18:46.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.143+0000 7fbc66049700 1 --2- 172.21.15.6:0/1509664798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48004810 0x7fbc48004c80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.143+0000 7fbc66049700 1 -- 172.21.15.6:0/1509664798 >> 172.21.15.6:0/1509664798 conn(0x7fbc60068680 msgr2=0x7fbc60068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:46.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.143+0000 7fbc66049700 1 -- 172.21.15.6:0/1509664798 shutdown_connections 2023-10-06T02:18:46.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.143+0000 7fbc66049700 1 -- 172.21.15.6:0/1509664798 wait complete. 2023-10-06T02:18:46.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.145+0000 7fbc66049700 1 Processor -- start 2023-10-06T02:18:46.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.145+0000 7fbc66049700 1 -- start start 2023-10-06T02:18:46.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.145+0000 7fbc66049700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48004810 0x7fbc6015a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.145+0000 7fbc66049700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc600a84d0 0x7fbc600a8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.145+0000 7fbc66049700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc600a6d20 0x7fbc600a7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.145+0000 7fbc66049700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600c9a10 con 0x7fbc48004810 2023-10-06T02:18:46.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.145+0000 7fbc66049700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600a8e80 con 0x7fbc600a6d20 2023-10-06T02:18:46.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.145+0000 7fbc66049700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600a7f60 con 0x7fbc600a84d0 2023-10-06T02:18:46.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.145+0000 7fbc5f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48004810 0x7fbc6015a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.145+0000 7fbc5f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48004810 0x7fbc6015a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40872/0 (socket says 172.21.15.6:40872) 2023-10-06T02:18:46.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.146+0000 7fbc5f7fe700 1 -- 172.21.15.6:0/1119242963 learned_addr learned my addr 172.21.15.6:0/1119242963 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:46.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.146+0000 7fbc5f7fe700 1 -- 172.21.15.6:0/1119242963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc600a84d0 msgr2=0x7fbc600a8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.146+0000 7fbc5f7fe700 1 --2- 172.21.15.6:0/1119242963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc600a84d0 0x7fbc600a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.146+0000 7fbc5f7fe700 1 -- 172.21.15.6:0/1119242963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc600a6d20 msgr2=0x7fbc600a7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.146+0000 7fbc5f7fe700 1 --2- 172.21.15.6:0/1119242963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc600a6d20 0x7fbc600a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.146+0000 7fbc5f7fe700 1 -- 172.21.15.6:0/1119242963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc600c77a0 con 0x7fbc48004810 2023-10-06T02:18:46.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.146+0000 7fbc5f7fe700 1 --2- 172.21.15.6:0/1119242963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48004810 0x7fbc6015a020 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbc50011700 tx=0x7fbc50008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:46.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.146+0000 7fbc477fe700 1 -- 172.21.15.6:0/1119242963 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50015670 con 0x7fbc48004810 2023-10-06T02:18:46.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.146+0000 7fbc477fe700 1 -- 172.21.15.6:0/1119242963 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc500157d0 con 0x7fbc48004810 2023-10-06T02:18:46.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.146+0000 7fbc66049700 1 -- 172.21.15.6:0/1119242963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc600a76d0 con 0x7fbc48004810 2023-10-06T02:18:46.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.146+0000 7fbc477fe700 1 -- 172.21.15.6:0/1119242963 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50015b90 con 0x7fbc48004810 2023-10-06T02:18:46.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.146+0000 7fbc66049700 1 -- 172.21.15.6:0/1119242963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc600a7c80 con 0x7fbc48004810 2023-10-06T02:18:46.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.147+0000 7fbc66049700 1 -- 172.21.15.6:0/1119242963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc60088aa0 con 0x7fbc48004810 2023-10-06T02:18:46.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.147+0000 7fbc477fe700 1 -- 172.21.15.6:0/1119242963 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc50013410 con 0x7fbc48004810 2023-10-06T02:18:46.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.148+0000 7fbc477fe700 1 --2- 172.21.15.6:0/1119242963 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc4c066f30 0x7fbc4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.148+0000 7fbc477fe700 1 -- 172.21.15.6:0/1119242963 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbc50084e20 con 0x7fbc48004810 2023-10-06T02:18:46.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.148+0000 7fbc5effd700 1 --2- 172.21.15.6:0/1119242963 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc4c066f30 0x7fbc4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.148+0000 7fbc5effd700 1 --2- 172.21.15.6:0/1119242963 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc4c066f30 0x7fbc4c0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbc600b61c0 tx=0x7fbc54015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:46.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.152+0000 7fbc477fe700 1 -- 172.21.15.6:0/1119242963 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc50051df0 con 0x7fbc48004810 2023-10-06T02:18:46.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.346+0000 7fbc66049700 1 -- 172.21.15.6:0/1119242963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc600b0910 con 0x7fbc48004810 2023-10-06T02:18:46.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.347+0000 7fbc477fe700 1 -- 172.21.15.6:0/1119242963 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17036 (secure 0 0 0) 0x7fbc50055410 con 0x7fbc48004810 2023-10-06T02:18:46.347 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:46.347 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":38,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:18:45.349646+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:18:43.639616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T02:18:44.317938+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:18:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.349+0000 7fbc66049700 1 -- 172.21.15.6:0/1119242963 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc4c066f30 msgr2=0x7fbc4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.349+0000 7fbc66049700 1 --2- 172.21.15.6:0/1119242963 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc4c066f30 0x7fbc4c0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbc600b61c0 tx=0x7fbc54015000 comp rx=0 tx=0).stop 2023-10-06T02:18:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.349+0000 7fbc66049700 1 -- 172.21.15.6:0/1119242963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48004810 msgr2=0x7fbc6015a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.349+0000 7fbc66049700 1 --2- 172.21.15.6:0/1119242963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48004810 0x7fbc6015a020 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbc50011700 tx=0x7fbc50008040 comp rx=0 tx=0).stop 2023-10-06T02:18:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.349+0000 7fbc66049700 1 -- 172.21.15.6:0/1119242963 shutdown_connections 2023-10-06T02:18:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.349+0000 7fbc66049700 1 --2- 172.21.15.6:0/1119242963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc600a6d20 0x7fbc600a7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.349+0000 7fbc66049700 1 --2- 172.21.15.6:0/1119242963 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc4c066f30 0x7fbc4c0693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.349+0000 7fbc66049700 1 --2- 172.21.15.6:0/1119242963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48004810 0x7fbc6015a020 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.349+0000 7fbc66049700 1 --2- 172.21.15.6:0/1119242963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc600a84d0 0x7fbc600a8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.349+0000 7fbc66049700 1 -- 172.21.15.6:0/1119242963 >> 172.21.15.6:0/1119242963 conn(0x7fbc60068680 msgr2=0x7fbc6006a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.349+0000 7fbc66049700 1 -- 172.21.15.6:0/1119242963 shutdown_connections 2023-10-06T02:18:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.349+0000 7fbc66049700 1 -- 172.21.15.6:0/1119242963 wait complete. 2023-10-06T02:18:46.362 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:18:46.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.481+0000 7f44a8e59700 1 Processor -- start 2023-10-06T02:18:46.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.482+0000 7f44a8e59700 1 -- start start 2023-10-06T02:18:46.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.482+0000 7f44a8e59700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44a40af8b0 0x7f44a415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.482+0000 7f44a8e59700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44a40b27f0 0x7f44a415d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.482+0000 7f44a8e59700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a415e190 con 0x7f44a40af4e0 2023-10-06T02:18:46.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.482+0000 7f44a8e59700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a40b1910 con 0x7f44a40b27f0 2023-10-06T02:18:46.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.482+0000 7f44a8e59700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a40cb650 con 0x7f44a40af8b0 2023-10-06T02:18:46.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.483+0000 7f44a2d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44a40b27f0 0x7f44a415d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.483+0000 7f44a259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f44a40af4e0 0x7f44a40b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43338/0 (socket says 172.21.15.6:43338) 2023-10-06T02:18:46.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.483+0000 7f44a259c700 1 -- 172.21.15.6:0/2042427836 learned_addr learned my addr 172.21.15.6:0/2042427836 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:46.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.483+0000 7f44a2d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44a40b27f0 0x7f44a415d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40874/0 (socket says 172.21.15.6:40874) 2023-10-06T02:18:46.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.483+0000 7f44a2d9d700 1 -- 172.21.15.6:0/2042427836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44a40af8b0 msgr2=0x7f44a415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:46.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.483+0000 7f44a1d9b700 1 --2- 172.21.15.6:0/2042427836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44a40af8b0 0x7f44a415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.483+0000 7f44a2d9d700 1 --2- 172.21.15.6:0/2042427836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44a40af8b0 0x7f44a415d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.483+0000 7f44a159a700 1 -- 172.21.15.6:0/2042427836 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677862281 0 0) 0x7f44a415e190 con 0x7f44a40af4e0 2023-10-06T02:18:46.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.483+0000 7f44a2d9d700 1 -- 172.21.15.6:0/2042427836 >> v1:172.21.15.6:6789/0 conn(0x7f44a40af4e0 legacy=0x7f44a40b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.483+0000 7f44a2d9d700 1 -- 172.21.15.6:0/2042427836 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a40ccaf0 con 0x7f44a40b27f0 2023-10-06T02:18:46.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.483+0000 7f44a2d9d700 1 --2- 172.21.15.6:0/2042427836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44a40b27f0 0x7f44a415d9a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4494009e60 tx=0x7f4494009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1e8106c8d95479 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:46.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.483+0000 7f44a159a700 1 -- 172.21.15.6:0/2042427836 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449400e070 con 0x7f44a40b27f0 2023-10-06T02:18:46.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.483+0000 7f44a159a700 1 -- 172.21.15.6:0/2042427836 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449400bc30 con 0x7f44a40b27f0 2023-10-06T02:18:46.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.483+0000 7f44a159a700 1 -- 172.21.15.6:0/2042427836 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494012430 con 0x7f44a40b27f0 2023-10-06T02:18:46.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.484+0000 7f44a8e59700 1 -- 172.21.15.6:0/2042427836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44a40b27f0 msgr2=0x7f44a415d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.484+0000 7f44a8e59700 1 --2- 172.21.15.6:0/2042427836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44a40b27f0 0x7f44a415d9a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4494009e60 tx=0x7f4494009780 comp rx=0 tx=0).stop 2023-10-06T02:18:46.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.484+0000 7f44a8e59700 1 -- 172.21.15.6:0/2042427836 shutdown_connections 2023-10-06T02:18:46.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.484+0000 7f44a8e59700 1 --2- 172.21.15.6:0/2042427836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44a40b27f0 0x7f44a415d9a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.484+0000 7f44a8e59700 1 --2- 172.21.15.6:0/2042427836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44a40af8b0 0x7f44a415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.484+0000 7f44a8e59700 1 -- 172.21.15.6:0/2042427836 >> 172.21.15.6:0/2042427836 conn(0x7f44a4068680 msgr2=0x7f44a4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:46.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.484+0000 7f44a8e59700 1 -- 172.21.15.6:0/2042427836 shutdown_connections 2023-10-06T02:18:46.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.484+0000 7f44a8e59700 1 -- 172.21.15.6:0/2042427836 wait complete. 2023-10-06T02:18:46.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.485+0000 7f44a8e59700 1 Processor -- start 2023-10-06T02:18:46.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.485+0000 7f44a8e59700 1 -- start start 2023-10-06T02:18:46.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f44a8e59700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44a40af4e0 0x7f44a40cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f44a8e59700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44a40af8b0 0x7f44a4153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f44a8e59700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44a40b27f0 0x7f44a4154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f44a8e59700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a40d0430 con 0x7f44a40b27f0 2023-10-06T02:18:46.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f44a8e59700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a40cf820 con 0x7f44a40af8b0 2023-10-06T02:18:46.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f44a8e59700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a40cfb00 con 0x7f44a40af4e0 2023-10-06T02:18:46.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f44a2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44a40b27f0 0x7f44a4154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f44a2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44a40b27f0 0x7f44a4154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40876/0 (socket says 172.21.15.6:40876) 2023-10-06T02:18:46.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f44a2d9d700 1 -- 172.21.15.6:0/731634153 learned_addr learned my addr 172.21.15.6:0/731634153 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:46.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f44a259c700 1 --2- 172.21.15.6:0/731634153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44a40af4e0 0x7f44a40cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f44a1d9b700 1 --2- 172.21.15.6:0/731634153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44a40af8b0 0x7f44a4153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f44a2d9d700 1 -- 172.21.15.6:0/731634153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44a40af4e0 msgr2=0x7f44a40cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f44a2d9d700 1 --2- 172.21.15.6:0/731634153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44a40af4e0 0x7f44a40cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f44a2d9d700 1 -- 172.21.15.6:0/731634153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44a40af8b0 msgr2=0x7f44a4153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f44a2d9d700 1 --2- 172.21.15.6:0/731634153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44a40af8b0 0x7f44a4153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f44a2d9d700 1 -- 172.21.15.6:0/731634153 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494009a20 con 0x7f44a40b27f0 2023-10-06T02:18:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f44a2d9d700 1 --2- 172.21.15.6:0/731634153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44a40b27f0 0x7f44a4154330 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f44a4089520 tx=0x7f4494019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.486+0000 7f449a7fc700 1 -- 172.21.15.6:0/731634153 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494027470 con 0x7f44a40b27f0 2023-10-06T02:18:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.487+0000 7f449a7fc700 1 -- 172.21.15.6:0/731634153 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44940275f0 con 0x7f44a40b27f0 2023-10-06T02:18:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.487+0000 7f449a7fc700 1 -- 172.21.15.6:0/731634153 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44940279b0 con 0x7f44a40b27f0 2023-10-06T02:18:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.487+0000 7f44a8e59700 1 -- 172.21.15.6:0/731634153 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a40cfde0 con 0x7f44a40b27f0 2023-10-06T02:18:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.487+0000 7f44a8e59700 1 -- 172.21.15.6:0/731634153 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a40c6980 con 0x7f44a40b27f0 2023-10-06T02:18:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.488+0000 7f44a8e59700 1 -- 172.21.15.6:0/731634153 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a4068420 con 0x7f44a40b27f0 2023-10-06T02:18:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.488+0000 7f449a7fc700 1 -- 172.21.15.6:0/731634153 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4494024070 con 0x7f44a40b27f0 2023-10-06T02:18:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.488+0000 7f449a7fc700 1 --2- 172.21.15.6:0/731634153 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4484066f30 0x7f44840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.489+0000 7f449a7fc700 1 -- 172.21.15.6:0/731634153 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4494086f40 con 0x7f44a40b27f0 2023-10-06T02:18:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.489+0000 7f44a259c700 1 --2- 172.21.15.6:0/731634153 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4484066f30 0x7f44840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.489+0000 7f44a259c700 1 --2- 172.21.15.6:0/731634153 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4484066f30 0x7f44840693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f449c007fd0 tx=0x7f449c007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:46.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.493+0000 7f449a7fc700 1 -- 172.21.15.6:0/731634153 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4494053f10 con 0x7f44a40b27f0 2023-10-06T02:18:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.686+0000 7f44a8e59700 1 -- 172.21.15.6:0/731634153 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44a40d0570 con 0x7f44a40b27f0 2023-10-06T02:18:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.687+0000 7f449a7fc700 1 -- 172.21.15.6:0/731634153 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17036 (secure 0 0 0) 0x7f449402c090 con 0x7f44a40b27f0 2023-10-06T02:18:46.688 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:46.688 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":38,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:18:45.349646+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:18:43.639616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T02:18:44.317938+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:18:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.689+0000 7f44a8e59700 1 -- 172.21.15.6:0/731634153 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4484066f30 msgr2=0x7f44840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.689+0000 7f44a8e59700 1 --2- 172.21.15.6:0/731634153 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4484066f30 0x7f44840693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f449c007fd0 tx=0x7f449c007d30 comp rx=0 tx=0).stop 2023-10-06T02:18:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.689+0000 7f44a8e59700 1 -- 172.21.15.6:0/731634153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44a40b27f0 msgr2=0x7f44a4154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.689+0000 7f44a8e59700 1 --2- 172.21.15.6:0/731634153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44a40b27f0 0x7f44a4154330 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f44a4089520 tx=0x7f4494019000 comp rx=0 tx=0).stop 2023-10-06T02:18:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.689+0000 7f44a8e59700 1 -- 172.21.15.6:0/731634153 shutdown_connections 2023-10-06T02:18:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.689+0000 7f44a8e59700 1 --2- 172.21.15.6:0/731634153 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4484066f30 0x7f44840693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.689+0000 7f44a8e59700 1 --2- 172.21.15.6:0/731634153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44a40b27f0 0x7f44a4154330 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.689+0000 7f44a8e59700 1 --2- 172.21.15.6:0/731634153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44a40af4e0 0x7f44a40cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.689+0000 7f44a8e59700 1 --2- 172.21.15.6:0/731634153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44a40af8b0 0x7f44a4153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.689+0000 7f44a8e59700 1 -- 172.21.15.6:0/731634153 >> 172.21.15.6:0/731634153 conn(0x7f44a4068680 msgr2=0x7f44a40afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.689+0000 7f44a8e59700 1 -- 172.21.15.6:0/731634153 shutdown_connections 2023-10-06T02:18:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.689+0000 7f44a8e59700 1 -- 172.21.15.6:0/731634153 wait complete. 2023-10-06T02:18:46.702 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:18:46.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.823+0000 7f5b13427700 1 Processor -- start 2023-10-06T02:18:46.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.823+0000 7f5b13427700 1 -- start start 2023-10-06T02:18:46.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.824+0000 7f5b13427700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0c0d0400 0x7f5b0c0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.824+0000 7f5b13427700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5b0c0ccd40 0x7f5b0c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.824+0000 7f5b13427700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0c0b6170 con 0x7f5b0c0cf7e0 2023-10-06T02:18:46.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.824+0000 7f5b13427700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0c15dd40 con 0x7f5b0c0ccd40 2023-10-06T02:18:46.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.824+0000 7f5b13427700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c15e020 con 0x7f5b0c0d0400 2023-10-06T02:18:46.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.824+0000 7f5b119c4700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5b0c0cf7e0 0x7f5b0c0b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43354/0 (socket says 172.21.15.6:43354) 2023-10-06T02:18:46.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.824+0000 7f5b119c4700 1 -- 172.21.15.6:0/2724551459 learned_addr learned my addr 172.21.15.6:0/2724551459 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b111c3700 1 --2- 172.21.15.6:0/2724551459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0c0d0400 0x7f5b0c0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b109c2700 1 --2- 172.21.15.6:0/2724551459 >> v2:172.21.15.175:3300/0 conn(0x7f5b0c0ccd40 0x7f5b0c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b0bfff700 1 -- 172.21.15.6:0/2724551459 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42950730 0 0) 0x7f5b0c0b6170 con 0x7f5b0c0cf7e0 2023-10-06T02:18:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b0bfff700 1 -- 172.21.15.6:0/2724551459 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5af4003570 con 0x7f5b0c0cf7e0 2023-10-06T02:18:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b0bfff700 1 -- 172.21.15.6:0/2724551459 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4060683342 0 0) 0x7f5af4003570 con 0x7f5b0c0cf7e0 2023-10-06T02:18:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b0bfff700 1 -- 172.21.15.6:0/2724551459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0c0d0400 msgr2=0x7f5b0c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b0bfff700 1 --2- 172.21.15.6:0/2724551459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0c0d0400 0x7f5b0c0b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b0bfff700 1 -- 172.21.15.6:0/2724551459 >> v2:172.21.15.175:3300/0 conn(0x7f5b0c0ccd40 msgr2=0x7f5b0c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b0bfff700 1 --2- 172.21.15.6:0/2724551459 >> v2:172.21.15.175:3300/0 conn(0x7f5b0c0ccd40 0x7f5b0c0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b0bfff700 1 -- 172.21.15.6:0/2724551459 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c0ceaa0 con 0x7f5b0c0cf7e0 2023-10-06T02:18:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b0bfff700 1 -- 172.21.15.6:0/2724551459 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f5afc001470 con 0x7f5b0c0cf7e0 2023-10-06T02:18:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b111c3700 1 --2- 172.21.15.6:0/2724551459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0c0d0400 0x7f5b0c0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b0bfff700 1 -- 172.21.15.6:0/2724551459 >> v1:172.21.15.6:6789/0 conn(0x7f5b0c0cf7e0 legacy=0x7f5b0c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b0bfff700 1 --2- 172.21.15.6:0/2724551459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af4003a60 0x7f5af4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b0bfff700 1 --2- 172.21.15.6:0/2724551459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0c0d0400 0x7f5af4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b0bfff700 1 --2- 172.21.15.6:0/2724551459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5af4004d50 0x7f5af40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b0bfff700 1 -- 172.21.15.6:0/2724551459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c15dd40 con 0x7f5af4003a60 2023-10-06T02:18:46.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b0bfff700 1 -- 172.21.15.6:0/2724551459 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c15e020 con 0x7f5af4004d50 2023-10-06T02:18:46.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b0bfff700 1 -- 172.21.15.6:0/2724551459 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af400ba60 con 0x7f5b0c0d0400 2023-10-06T02:18:46.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b111c3700 1 --2- 172.21.15.6:0/2724551459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af4003a60 0x7f5af4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b109c2700 1 --2- 172.21.15.6:0/2724551459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0c0d0400 0x7f5af4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b119c4700 1 --2- 172.21.15.6:0/2724551459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5af4004d50 0x7f5af40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b111c3700 1 -- 172.21.15.6:0/2724551459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0c0d0400 msgr2=0x7f5af4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:46.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b111c3700 1 --2- 172.21.15.6:0/2724551459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0c0d0400 0x7f5af4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b111c3700 1 -- 172.21.15.6:0/2724551459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5af4004d50 msgr2=0x7f5af40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:46.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b111c3700 1 --2- 172.21.15.6:0/2724551459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5af4004d50 0x7f5af40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b111c3700 1 -- 172.21.15.6:0/2724551459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b04009a20 con 0x7f5af4003a60 2023-10-06T02:18:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.825+0000 7f5b109c2700 1 --2- 172.21.15.6:0/2724551459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0c0d0400 0x7f5af4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.826+0000 7f5b111c3700 1 --2- 172.21.15.6:0/2724551459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af4003a60 0x7f5af4003e70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400e570 tx=0x7f5b0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9496fa3cb5b3f098 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.826+0000 7f5b0bfff700 1 -- 172.21.15.6:0/2724551459 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b04009ca0 con 0x7f5af4003a60 2023-10-06T02:18:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.826+0000 7f5b0bfff700 1 -- 172.21.15.6:0/2724551459 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0400f040 con 0x7f5af4003a60 2023-10-06T02:18:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.826+0000 7f5b0bfff700 1 -- 172.21.15.6:0/2724551459 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400eec0 con 0x7f5af4003a60 2023-10-06T02:18:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.826+0000 7f5b13427700 1 -- 172.21.15.6:0/2724551459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af4003a60 msgr2=0x7f5af4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.826+0000 7f5b13427700 1 --2- 172.21.15.6:0/2724551459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af4003a60 0x7f5af4003e70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400e570 tx=0x7f5b0400b040 comp rx=0 tx=0).stop 2023-10-06T02:18:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.826+0000 7f5b119c4700 1 -- 172.21.15.6:0/2724551459 reap_dead start 2023-10-06T02:18:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.826+0000 7f5b13427700 1 -- 172.21.15.6:0/2724551459 shutdown_connections 2023-10-06T02:18:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.826+0000 7f5b13427700 1 -- 172.21.15.6:0/2724551459 >> 172.21.15.6:0/2724551459 conn(0x7f5b0c06a220 msgr2=0x7f5b0c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.826+0000 7f5b13427700 1 -- 172.21.15.6:0/2724551459 shutdown_connections 2023-10-06T02:18:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.826+0000 7f5b13427700 1 -- 172.21.15.6:0/2724551459 wait complete. 2023-10-06T02:18:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.828+0000 7f5b13427700 1 Processor -- start 2023-10-06T02:18:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.828+0000 7f5b13427700 1 -- start start 2023-10-06T02:18:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.828+0000 7f5b13427700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5af4003a60 0x7f5b0c146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.828+0000 7f5b13427700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b0c0b1ef0 0x7f5b0c0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b13427700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0c0ca880 0x7f5b0c0cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b13427700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0b28a0 con 0x7f5b0c0b1ef0 2023-10-06T02:18:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b13427700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0cb5b0 con 0x7f5af4003a60 2023-10-06T02:18:46.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b13427700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0cb890 con 0x7f5b0c0ca880 2023-10-06T02:18:46.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b109c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b0c0b1ef0 0x7f5b0c0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b109c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b0c0b1ef0 0x7f5b0c0b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40904/0 (socket says 172.21.15.6:40904) 2023-10-06T02:18:46.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b109c2700 1 -- 172.21.15.6:0/2082630262 learned_addr learned my addr 172.21.15.6:0/2082630262 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:46.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b119c4700 1 --2- 172.21.15.6:0/2082630262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0c0ca880 0x7f5b0c0cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b111c3700 1 --2- 172.21.15.6:0/2082630262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5af4003a60 0x7f5b0c146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b109c2700 1 -- 172.21.15.6:0/2082630262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0c0ca880 msgr2=0x7f5b0c0cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b109c2700 1 --2- 172.21.15.6:0/2082630262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0c0ca880 0x7f5b0c0cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b109c2700 1 -- 172.21.15.6:0/2082630262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5af4003a60 msgr2=0x7f5b0c146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:46.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b109c2700 1 --2- 172.21.15.6:0/2082630262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5af4003a60 0x7f5b0c146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:46.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b109c2700 1 -- 172.21.15.6:0/2082630262 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c0cbb70 con 0x7f5b0c0b1ef0 2023-10-06T02:18:46.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b109c2700 1 --2- 172.21.15.6:0/2082630262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b0c0b1ef0 0x7f5b0c0b2360 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5b000118e0 tx=0x7f5b00008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:46.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b097fa700 1 -- 172.21.15.6:0/2082630262 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00011e80 con 0x7f5b0c0b1ef0 2023-10-06T02:18:46.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b097fa700 1 -- 172.21.15.6:0/2082630262 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0000f8e0 con 0x7f5b0c0b1ef0 2023-10-06T02:18:46.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b13427700 1 -- 172.21.15.6:0/2082630262 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0c0cbe50 con 0x7f5b0c0b1ef0 2023-10-06T02:18:46.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b097fa700 1 -- 172.21.15.6:0/2082630262 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0000fc80 con 0x7f5b0c0b1ef0 2023-10-06T02:18:46.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.829+0000 7f5b13427700 1 -- 172.21.15.6:0/2082630262 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0c0cb240 con 0x7f5b0c0b1ef0 2023-10-06T02:18:46.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.830+0000 7f5b13427700 1 -- 172.21.15.6:0/2082630262 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0c0c5d90 con 0x7f5b0c0b1ef0 2023-10-06T02:18:46.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.831+0000 7f5b097fa700 1 -- 172.21.15.6:0/2082630262 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b00015460 con 0x7f5b0c0b1ef0 2023-10-06T02:18:46.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.831+0000 7f5b097fa700 1 --2- 172.21.15.6:0/2082630262 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5af8066f30 0x7f5af80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:46.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.831+0000 7f5b097fa700 1 -- 172.21.15.6:0/2082630262 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5b00084fd0 con 0x7f5b0c0b1ef0 2023-10-06T02:18:46.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.831+0000 7f5b111c3700 1 --2- 172.21.15.6:0/2082630262 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5af8066f30 0x7f5af80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:46.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.832+0000 7f5b111c3700 1 --2- 172.21.15.6:0/2082630262 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5af8066f30 0x7f5af80693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009fd0 tx=0x7f5b0401a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:46.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:46.835+0000 7f5b097fa700 1 -- 172.21.15.6:0/2082630262 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b0c0c5d90 con 0x7f5b0c0b1ef0 2023-10-06T02:18:47.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:47.082+0000 7f5b13427700 1 -- 172.21.15.6:0/2082630262 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5b0c0c5d90 con 0x7f5b0c0b1ef0 2023-10-06T02:18:48.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.004+0000 7f5b097fa700 1 -- 172.21.15.6:0/2082630262 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5b00052000 con 0x7f5b0c0b1ef0 2023-10-06T02:18:48.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.007+0000 7f5b13427700 1 -- 172.21.15.6:0/2082630262 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5af8066f30 msgr2=0x7f5af80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:48.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.007+0000 7f5b13427700 1 --2- 172.21.15.6:0/2082630262 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5af8066f30 0x7f5af80693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009fd0 tx=0x7f5b0401a000 comp rx=0 tx=0).stop 2023-10-06T02:18:48.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.007+0000 7f5b13427700 1 -- 172.21.15.6:0/2082630262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b0c0b1ef0 msgr2=0x7f5b0c0b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:48.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.007+0000 7f5b13427700 1 --2- 172.21.15.6:0/2082630262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b0c0b1ef0 0x7f5b0c0b2360 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5b000118e0 tx=0x7f5b00008040 comp rx=0 tx=0).stop 2023-10-06T02:18:48.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.007+0000 7f5b13427700 1 -- 172.21.15.6:0/2082630262 shutdown_connections 2023-10-06T02:18:48.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.007+0000 7f5b13427700 1 --2- 172.21.15.6:0/2082630262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0c0ca880 0x7f5b0c0cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:48.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.007+0000 7f5b13427700 1 --2- 172.21.15.6:0/2082630262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5af4003a60 0x7f5b0c146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:48.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.007+0000 7f5b13427700 1 --2- 172.21.15.6:0/2082630262 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5af8066f30 0x7f5af80693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:48.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.007+0000 7f5b13427700 1 --2- 172.21.15.6:0/2082630262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b0c0b1ef0 0x7f5b0c0b2360 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:48.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.007+0000 7f5b13427700 1 -- 172.21.15.6:0/2082630262 >> 172.21.15.6:0/2082630262 conn(0x7f5b0c06a220 msgr2=0x7f5b0c1561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:48.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.008+0000 7f5b13427700 1 -- 172.21.15.6:0/2082630262 shutdown_connections 2023-10-06T02:18:48.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.008+0000 7f5b13427700 1 -- 172.21.15.6:0/2082630262 wait complete. 2023-10-06T02:18:48.023 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:18:48.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.152+0000 7fd72be47700 1 Processor -- start 2023-10-06T02:18:48.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.152+0000 7fd72be47700 1 -- start start 2023-10-06T02:18:48.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.153+0000 7fd72be47700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd7240d0400 0x7fd7240b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:48.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.153+0000 7fd72be47700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7240ccd40 0x7fd7240cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:48.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.153+0000 7fd72be47700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7240b6170 con 0x7fd7240cf7e0 2023-10-06T02:18:48.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.153+0000 7fd72be47700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72415dd40 con 0x7fd7240ccd40 2023-10-06T02:18:48.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.153+0000 7fd72be47700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72415e020 con 0x7fd7240d0400 2023-10-06T02:18:48.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.153+0000 7fd7293e2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7240ccd40 0x7fd7240cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:48.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.153+0000 7fd7293e2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7240ccd40 0x7fd7240cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40910/0 (socket says 172.21.15.6:40910) 2023-10-06T02:18:48.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.153+0000 7fd7293e2700 1 -- 172.21.15.6:0/578746437 learned_addr learned my addr 172.21.15.6:0/578746437 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:48.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.154+0000 7fd729be3700 1 --2- 172.21.15.6:0/578746437 >> v2:172.21.15.175:3300/0 conn(0x7fd7240d0400 0x7fd7240b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:48.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.154+0000 7fd7293e2700 1 -- 172.21.15.6:0/578746437 >> v2:172.21.15.175:3300/0 conn(0x7fd7240d0400 msgr2=0x7fd7240b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:48.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.154+0000 7fd7293e2700 1 --2- 172.21.15.6:0/578746437 >> v2:172.21.15.175:3300/0 conn(0x7fd7240d0400 0x7fd7240b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:48.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.154+0000 7fd7293e2700 1 -- 172.21.15.6:0/578746437 >> v1:172.21.15.175:6789/0 conn(0x7fd7240cf7e0 legacy=0x7fd7240b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:48.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.154+0000 7fd7293e2700 1 -- 172.21.15.6:0/578746437 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7240ceaa0 con 0x7fd7240ccd40 2023-10-06T02:18:48.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.154+0000 7fd7293e2700 1 --2- 172.21.15.6:0/578746437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7240ccd40 0x7fd7240cf2a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd724088f30 tx=0x7fd718009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe9c052f6ffd938 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:48.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.154+0000 7fd728be1700 1 -- 172.21.15.6:0/578746437 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71800b820 con 0x7fd7240ccd40 2023-10-06T02:18:48.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.154+0000 7fd728be1700 1 -- 172.21.15.6:0/578746437 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71800b980 con 0x7fd7240ccd40 2023-10-06T02:18:48.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.154+0000 7fd728be1700 1 -- 172.21.15.6:0/578746437 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71800bd20 con 0x7fd7240ccd40 2023-10-06T02:18:48.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.155+0000 7fd72be47700 1 -- 172.21.15.6:0/578746437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7240ccd40 msgr2=0x7fd7240cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:48.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.155+0000 7fd72be47700 1 --2- 172.21.15.6:0/578746437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7240ccd40 0x7fd7240cf2a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd724088f30 tx=0x7fd718009250 comp rx=0 tx=0).stop 2023-10-06T02:18:48.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.155+0000 7fd72be47700 1 -- 172.21.15.6:0/578746437 shutdown_connections 2023-10-06T02:18:48.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.155+0000 7fd72be47700 1 --2- 172.21.15.6:0/578746437 >> v2:172.21.15.175:3300/0 conn(0x7fd7240d0400 0x7fd7240b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:48.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.155+0000 7fd72be47700 1 --2- 172.21.15.6:0/578746437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7240ccd40 0x7fd7240cf2a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:48.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.155+0000 7fd72be47700 1 -- 172.21.15.6:0/578746437 >> 172.21.15.6:0/578746437 conn(0x7fd72406a220 msgr2=0x7fd72406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:48.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.155+0000 7fd72be47700 1 -- 172.21.15.6:0/578746437 shutdown_connections 2023-10-06T02:18:48.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.155+0000 7fd72be47700 1 -- 172.21.15.6:0/578746437 wait complete. 2023-10-06T02:18:48.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.156+0000 7fd72be47700 1 Processor -- start 2023-10-06T02:18:48.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.156+0000 7fd72be47700 1 -- start start 2023-10-06T02:18:48.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd72be47700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7240ccd40 0x7fd7240c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:48.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd72be47700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7240cf7e0 0x7fd7240cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:48.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd72be47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7240d0400 0x7fd72416d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:48.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd72be47700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7240c7e90 con 0x7fd7240d0400 2023-10-06T02:18:48.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd72be47700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7240c52a0 con 0x7fd7240cf7e0 2023-10-06T02:18:48.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd72be47700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7240c5580 con 0x7fd7240ccd40 2023-10-06T02:18:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd72a3e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7240d0400 0x7fd72416d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd72a3e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7240d0400 0x7fd72416d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40918/0 (socket says 172.21.15.6:40918) 2023-10-06T02:18:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd72a3e4700 1 -- 172.21.15.6:0/2871382268 learned_addr learned my addr 172.21.15.6:0/2871382268 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd729be3700 1 --2- 172.21.15.6:0/2871382268 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7240ccd40 0x7fd7240c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd7293e2700 1 --2- 172.21.15.6:0/2871382268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7240cf7e0 0x7fd7240cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd72a3e4700 1 -- 172.21.15.6:0/2871382268 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7240ccd40 msgr2=0x7fd7240c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd72a3e4700 1 --2- 172.21.15.6:0/2871382268 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7240ccd40 0x7fd7240c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd72a3e4700 1 -- 172.21.15.6:0/2871382268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7240cf7e0 msgr2=0x7fd7240cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd72a3e4700 1 --2- 172.21.15.6:0/2871382268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7240cf7e0 0x7fd7240cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd72a3e4700 1 -- 172.21.15.6:0/2871382268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7180094f0 con 0x7fd7240d0400 2023-10-06T02:18:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd72a3e4700 1 --2- 172.21.15.6:0/2871382268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7240d0400 0x7fd72416d3a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd71400c930 tx=0x7fd7140026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:48.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd721ffb700 1 -- 172.21.15.6:0/2871382268 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd714012630 con 0x7fd7240d0400 2023-10-06T02:18:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd721ffb700 1 -- 172.21.15.6:0/2871382268 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7140127d0 con 0x7fd7240d0400 2023-10-06T02:18:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd72be47700 1 -- 172.21.15.6:0/2871382268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7240c5860 con 0x7fd7240d0400 2023-10-06T02:18:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.157+0000 7fd721ffb700 1 -- 172.21.15.6:0/2871382268 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd714012b90 con 0x7fd7240d0400 2023-10-06T02:18:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.158+0000 7fd72be47700 1 -- 172.21.15.6:0/2871382268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7240c5e20 con 0x7fd7240d0400 2023-10-06T02:18:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.159+0000 7fd72be47700 1 -- 172.21.15.6:0/2871382268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd724088760 con 0x7fd7240d0400 2023-10-06T02:18:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.159+0000 7fd721ffb700 1 -- 172.21.15.6:0/2871382268 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd71401a3b0 con 0x7fd7240d0400 2023-10-06T02:18:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.159+0000 7fd721ffb700 1 --2- 172.21.15.6:0/2871382268 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd710066f30 0x7fd7100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.159+0000 7fd721ffb700 1 -- 172.21.15.6:0/2871382268 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd714084420 con 0x7fd7240d0400 2023-10-06T02:18:48.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.160+0000 7fd729be3700 1 --2- 172.21.15.6:0/2871382268 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd710066f30 0x7fd7100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:48.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.160+0000 7fd729be3700 1 --2- 172.21.15.6:0/2871382268 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd710066f30 0x7fd7100693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd72416af20 tx=0x7fd71c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:48.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.164+0000 7fd721ffb700 1 -- 172.21.15.6:0/2871382268 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd714054e80 con 0x7fd7240d0400 2023-10-06T02:18:48.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:48.405+0000 7fd72be47700 1 -- 172.21.15.6:0/2871382268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd7240ced80 con 0x7fd7240d0400 2023-10-06T02:18:48.929 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-06T02:18:48.929+0000 7fc0c0e5d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:18:49.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.010+0000 7fd721ffb700 1 -- 172.21.15.6:0/2871382268 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd714054a10 con 0x7fd7240d0400 2023-10-06T02:18:49.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.013+0000 7fd72be47700 1 -- 172.21.15.6:0/2871382268 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd710066f30 msgr2=0x7fd7100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.013+0000 7fd72be47700 1 --2- 172.21.15.6:0/2871382268 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd710066f30 0x7fd7100693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd72416af20 tx=0x7fd71c008040 comp rx=0 tx=0).stop 2023-10-06T02:18:49.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.013+0000 7fd72be47700 1 -- 172.21.15.6:0/2871382268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7240d0400 msgr2=0x7fd72416d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.013+0000 7fd72be47700 1 --2- 172.21.15.6:0/2871382268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7240d0400 0x7fd72416d3a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd71400c930 tx=0x7fd7140026e0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.013+0000 7fd72be47700 1 -- 172.21.15.6:0/2871382268 shutdown_connections 2023-10-06T02:18:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.013+0000 7fd72be47700 1 --2- 172.21.15.6:0/2871382268 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd710066f30 0x7fd7100693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.013+0000 7fd72be47700 1 --2- 172.21.15.6:0/2871382268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7240d0400 0x7fd72416d3a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.013+0000 7fd72be47700 1 --2- 172.21.15.6:0/2871382268 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7240ccd40 0x7fd7240c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.013+0000 7fd72be47700 1 --2- 172.21.15.6:0/2871382268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7240cf7e0 0x7fd7240cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.013+0000 7fd72be47700 1 -- 172.21.15.6:0/2871382268 >> 172.21.15.6:0/2871382268 conn(0x7fd72406a220 msgr2=0x7fd7240b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.013+0000 7fd72be47700 1 -- 172.21.15.6:0/2871382268 shutdown_connections 2023-10-06T02:18:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.013+0000 7fd72be47700 1 -- 172.21.15.6:0/2871382268 wait complete. 2023-10-06T02:18:49.028 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:18:49.146 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:18:49.148 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:18:49.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.152+0000 7efe11667700 1 Processor -- start 2023-10-06T02:18:49.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.152+0000 7efe11667700 1 -- start start 2023-10-06T02:18:49.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.153+0000 7efe11667700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe0c0d05d0 0x7efe0c1641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.153+0000 7efe11667700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0c0b3560 con 0x7efe0c159400 2023-10-06T02:18:49.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.153+0000 7efe11667700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0c0cf6f0 con 0x7efe0c0cf1a0 2023-10-06T02:18:49.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.153+0000 7efe11667700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0c0cf9d0 con 0x7efe0c0d05d0 2023-10-06T02:18:49.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.153+0000 7efe10e66700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe0c0d05d0 0x7efe0c1641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.153+0000 7efe0bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efe0c159400 0x7efe0c0ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47710/0 (socket says 172.21.15.6:47710) 2023-10-06T02:18:49.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.153+0000 7efe10e66700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe0c0d05d0 0x7efe0c1641d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41540/0 (socket says 172.21.15.6:41540) 2023-10-06T02:18:49.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.153+0000 7efe0bfff700 1 -- 172.21.15.6:0/323549569 learned_addr learned my addr 172.21.15.6:0/323549569 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:49.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.154+0000 7efe10e66700 1 -- 172.21.15.6:0/323549569 >> v1:172.21.15.175:6789/0 conn(0x7efe0c0cf1a0 legacy=0x7efe0c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.154+0000 7efe10e66700 1 -- 172.21.15.6:0/323549569 >> v1:172.21.15.6:6789/0 conn(0x7efe0c159400 legacy=0x7efe0c0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.154+0000 7efe10e66700 1 -- 172.21.15.6:0/323549569 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c0b2f10 con 0x7efe0c0d05d0 2023-10-06T02:18:49.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.154+0000 7efe0affd700 1 -- 172.21.15.6:0/323549569 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89647359 0 0) 0x7efe0c0b3560 con 0x7efe0c159400 2023-10-06T02:18:49.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.154+0000 7efe10e66700 1 --2- 172.21.15.6:0/323549569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe0c0d05d0 0x7efe0c1641d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efe04009e60 tx=0x7efe04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d28d41832612ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:49.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.154+0000 7efe0affd700 1 -- 172.21.15.6:0/323549569 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0400e070 con 0x7efe0c0d05d0 2023-10-06T02:18:49.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.154+0000 7efe0affd700 1 -- 172.21.15.6:0/323549569 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0400bc30 con 0x7efe0c0d05d0 2023-10-06T02:18:49.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.154+0000 7efe0affd700 1 -- 172.21.15.6:0/323549569 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04012430 con 0x7efe0c0d05d0 2023-10-06T02:18:49.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.155+0000 7efe11667700 1 -- 172.21.15.6:0/323549569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe0c0d05d0 msgr2=0x7efe0c1641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.155+0000 7efe11667700 1 --2- 172.21.15.6:0/323549569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe0c0d05d0 0x7efe0c1641d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efe04009e60 tx=0x7efe04009780 comp rx=0 tx=0).stop 2023-10-06T02:18:49.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.155+0000 7efe11667700 1 -- 172.21.15.6:0/323549569 shutdown_connections 2023-10-06T02:18:49.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.155+0000 7efe11667700 1 --2- 172.21.15.6:0/323549569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe0c0d05d0 0x7efe0c1641d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.155+0000 7efe11667700 1 -- 172.21.15.6:0/323549569 >> 172.21.15.6:0/323549569 conn(0x7efe0c06ac10 msgr2=0x7efe0c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:49.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.155+0000 7efe11667700 1 -- 172.21.15.6:0/323549569 shutdown_connections 2023-10-06T02:18:49.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.155+0000 7efe11667700 1 -- 172.21.15.6:0/323549569 wait complete. 2023-10-06T02:18:49.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.156+0000 7efe11667700 1 Processor -- start 2023-10-06T02:18:49.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.156+0000 7efe11667700 1 -- start start 2023-10-06T02:18:49.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.157+0000 7efe11667700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe0c0cf1a0 0x7efe0c0b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.157+0000 7efe11667700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe0c0d05d0 0x7efe0c0c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.157+0000 7efe11667700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe0c159400 0x7efe0c0ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.157+0000 7efe11667700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0b0ff0 con 0x7efe0c0d05d0 2023-10-06T02:18:49.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.157+0000 7efe11667700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0b03e0 con 0x7efe0c159400 2023-10-06T02:18:49.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.157+0000 7efe11667700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0b06c0 con 0x7efe0c0cf1a0 2023-10-06T02:18:49.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.157+0000 7efe0b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe0c0d05d0 0x7efe0c0c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.157+0000 7efe0b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe0c0d05d0 0x7efe0c0c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41550/0 (socket says 172.21.15.6:41550) 2023-10-06T02:18:49.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.157+0000 7efe0b7fe700 1 -- 172.21.15.6:0/3858334916 learned_addr learned my addr 172.21.15.6:0/3858334916 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:49.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.157+0000 7efe0bfff700 1 --2- 172.21.15.6:0/3858334916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe0c0cf1a0 0x7efe0c0b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.157+0000 7efe10e66700 1 --2- 172.21.15.6:0/3858334916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe0c159400 0x7efe0c0ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.157+0000 7efe0b7fe700 1 -- 172.21.15.6:0/3858334916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe0c0cf1a0 msgr2=0x7efe0c0b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.157+0000 7efe0b7fe700 1 --2- 172.21.15.6:0/3858334916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe0c0cf1a0 0x7efe0c0b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.157+0000 7efe0b7fe700 1 -- 172.21.15.6:0/3858334916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe0c159400 msgr2=0x7efe0c0ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.157+0000 7efe0b7fe700 1 --2- 172.21.15.6:0/3858334916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe0c159400 0x7efe0c0ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.157+0000 7efe0b7fe700 1 -- 172.21.15.6:0/3858334916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe04009a20 con 0x7efe0c0d05d0 2023-10-06T02:18:49.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.157+0000 7efe0b7fe700 1 --2- 172.21.15.6:0/3858334916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe0c0d05d0 0x7efe0c0c9b60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00c590 tx=0x7efdfc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.158+0000 7efdf3fff700 1 -- 172.21.15.6:0/3858334916 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc011590 con 0x7efe0c0d05d0 2023-10-06T02:18:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.158+0000 7efdf3fff700 1 -- 172.21.15.6:0/3858334916 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc011710 con 0x7efe0c0d05d0 2023-10-06T02:18:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.158+0000 7efe11667700 1 -- 172.21.15.6:0/3858334916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0c0b09a0 con 0x7efe0c0d05d0 2023-10-06T02:18:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.158+0000 7efdf3fff700 1 -- 172.21.15.6:0/3858334916 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc011ad0 con 0x7efe0c0d05d0 2023-10-06T02:18:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.158+0000 7efe11667700 1 -- 172.21.15.6:0/3858334916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0c157460 con 0x7efe0c0d05d0 2023-10-06T02:18:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.159+0000 7efe11667700 1 -- 172.21.15.6:0/3858334916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0c1576e0 con 0x7efe0c0d05d0 2023-10-06T02:18:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.159+0000 7efdf3fff700 1 -- 172.21.15.6:0/3858334916 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efdfc01b3b0 con 0x7efe0c0d05d0 2023-10-06T02:18:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.160+0000 7efdf3fff700 1 --2- 172.21.15.6:0/3858334916 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efdf8066f30 0x7efdf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.160+0000 7efdf3fff700 1 -- 172.21.15.6:0/3858334916 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7efdfc083c60 con 0x7efe0c0d05d0 2023-10-06T02:18:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.160+0000 7efe0bfff700 1 --2- 172.21.15.6:0/3858334916 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efdf8066f30 0x7efdf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.160+0000 7efe0bfff700 1 --2- 172.21.15.6:0/3858334916 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efdf8066f30 0x7efdf80693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efe00002970 tx=0x7efe00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:49.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.164+0000 7efdf3fff700 1 -- 172.21.15.6:0/3858334916 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdfc050c30 con 0x7efe0c0d05d0 2023-10-06T02:18:49.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.405+0000 7efe11667700 1 -- 172.21.15.6:0/3858334916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe0c0b1130 con 0x7efe0c0d05d0 2023-10-06T02:18:49.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.405+0000 7efdf3fff700 1 -- 172.21.15.6:0/3858334916 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7efdfc017070 con 0x7efe0c0d05d0 2023-10-06T02:18:49.406 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:49.406 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1173605075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1173605075},{"type":"v1","addr":"172.21.15.175:6837","nonce":1173605075}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/375122461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":375122461},{"type":"v1","addr":"172.21.15.175:6835","nonce":375122461}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5142,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3506443204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3506443204},{"type":"v1","addr":"172.21.15.6:6835","nonce":3506443204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:18:45.349958+0000","modified":"2023-10-06T02:18:49.004214+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5145":{"gid":5145,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/774858203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":774858203},{"type":"v1","addr":"172.21.15.6:6834","nonce":774858203}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:18:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.407+0000 7efe11667700 1 -- 172.21.15.6:0/3858334916 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efdf8066f30 msgr2=0x7efdf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.407+0000 7efe11667700 1 --2- 172.21.15.6:0/3858334916 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efdf8066f30 0x7efdf80693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efe00002970 tx=0x7efe00009040 comp rx=0 tx=0).stop 2023-10-06T02:18:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.407+0000 7efe11667700 1 -- 172.21.15.6:0/3858334916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe0c0d05d0 msgr2=0x7efe0c0c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.407+0000 7efe11667700 1 --2- 172.21.15.6:0/3858334916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe0c0d05d0 0x7efe0c0c9b60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00c590 tx=0x7efdfc00c8a0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.407+0000 7efe11667700 1 -- 172.21.15.6:0/3858334916 shutdown_connections 2023-10-06T02:18:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.407+0000 7efe11667700 1 --2- 172.21.15.6:0/3858334916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe0c159400 0x7efe0c0ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.407+0000 7efe11667700 1 --2- 172.21.15.6:0/3858334916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe0c0cf1a0 0x7efe0c0b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.407+0000 7efe11667700 1 --2- 172.21.15.6:0/3858334916 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efdf8066f30 0x7efdf80693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.407+0000 7efe11667700 1 --2- 172.21.15.6:0/3858334916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe0c0d05d0 0x7efe0c0c9b60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.407+0000 7efe11667700 1 -- 172.21.15.6:0/3858334916 >> 172.21.15.6:0/3858334916 conn(0x7efe0c06ac10 msgr2=0x7efe0c158450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:49.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.407+0000 7efe11667700 1 -- 172.21.15.6:0/3858334916 shutdown_connections 2023-10-06T02:18:49.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.407+0000 7efe11667700 1 -- 172.21.15.6:0/3858334916 wait complete. 2023-10-06T02:18:49.409 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-10-06T02:18:49.420 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:18:49.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.538+0000 7f93b7b1a700 1 Processor -- start 2023-10-06T02:18:49.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.538+0000 7f93b7b1a700 1 -- start start 2023-10-06T02:18:49.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.539+0000 7f93b7b1a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93b00af8b0 0x7f93b015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.539+0000 7f93b7b1a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93b00b27f0 0x7f93b015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.539+0000 7f93b7b1a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b015e190 con 0x7f93b00af4e0 2023-10-06T02:18:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.539+0000 7f93b7b1a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b00b1910 con 0x7f93b00af8b0 2023-10-06T02:18:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.539+0000 7f93b7b1a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b00cb650 con 0x7f93b00b27f0 2023-10-06T02:18:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.539+0000 7f93b58b6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f93b00af4e0 0x7f93b00b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47720/0 (socket says 172.21.15.6:47720) 2023-10-06T02:18:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.539+0000 7f93b58b6700 1 -- 172.21.15.6:0/1975117779 learned_addr learned my addr 172.21.15.6:0/1975117779 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b50b5700 1 --2- 172.21.15.6:0/1975117779 >> v2:172.21.15.175:3300/0 conn(0x7f93b00af8b0 0x7f93b015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b60b7700 1 --2- 172.21.15.6:0/1975117779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93b00b27f0 0x7f93b015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b48b4700 1 -- 172.21.15.6:0/1975117779 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737487573 0 0) 0x7f93b015e190 con 0x7f93b00af4e0 2023-10-06T02:18:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b48b4700 1 -- 172.21.15.6:0/1975117779 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9398003570 con 0x7f93b00af4e0 2023-10-06T02:18:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b48b4700 1 -- 172.21.15.6:0/1975117779 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 447939919 0 0) 0x7f9398003570 con 0x7f93b00af4e0 2023-10-06T02:18:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b48b4700 1 -- 172.21.15.6:0/1975117779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93b00b27f0 msgr2=0x7f93b015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b48b4700 1 --2- 172.21.15.6:0/1975117779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93b00b27f0 0x7f93b015d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b48b4700 1 -- 172.21.15.6:0/1975117779 >> v2:172.21.15.175:3300/0 conn(0x7f93b00af8b0 msgr2=0x7f93b015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b48b4700 1 --2- 172.21.15.6:0/1975117779 >> v2:172.21.15.175:3300/0 conn(0x7f93b00af8b0 0x7f93b015d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b48b4700 1 -- 172.21.15.6:0/1975117779 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b00ccaf0 con 0x7f93b00af4e0 2023-10-06T02:18:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b48b4700 1 -- 172.21.15.6:0/1975117779 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f93a8001470 con 0x7f93b00af4e0 2023-10-06T02:18:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b48b4700 1 -- 172.21.15.6:0/1975117779 >> v1:172.21.15.6:6789/0 conn(0x7f93b00af4e0 legacy=0x7f93b00b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b48b4700 1 --2- 172.21.15.6:0/1975117779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93b00b27f0 0x7f9398003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b48b4700 1 --2- 172.21.15.6:0/1975117779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9398003fe0 0x7f9398004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b48b4700 1 --2- 172.21.15.6:0/1975117779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9398004d50 0x7f93980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b48b4700 1 -- 172.21.15.6:0/1975117779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b00b1910 con 0x7f9398003fe0 2023-10-06T02:18:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b48b4700 1 -- 172.21.15.6:0/1975117779 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b00cb650 con 0x7f9398004d50 2023-10-06T02:18:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b48b4700 1 -- 172.21.15.6:0/1975117779 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939800ba90 con 0x7f93b00b27f0 2023-10-06T02:18:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b50b5700 1 --2- 172.21.15.6:0/1975117779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9398003fe0 0x7f9398004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b58b6700 1 --2- 172.21.15.6:0/1975117779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93b00b27f0 0x7f9398003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b60b7700 1 --2- 172.21.15.6:0/1975117779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9398004d50 0x7f93980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b50b5700 1 -- 172.21.15.6:0/1975117779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93b00b27f0 msgr2=0x7f9398003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b50b5700 1 --2- 172.21.15.6:0/1975117779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93b00b27f0 0x7f9398003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b50b5700 1 -- 172.21.15.6:0/1975117779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9398004d50 msgr2=0x7f93980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b50b5700 1 --2- 172.21.15.6:0/1975117779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9398004d50 0x7f93980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.540+0000 7f93b50b5700 1 -- 172.21.15.6:0/1975117779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9398003570 con 0x7f9398003fe0 2023-10-06T02:18:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.541+0000 7f93b50b5700 1 --2- 172.21.15.6:0/1975117779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9398003fe0 0x7f9398004810 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f93b0089810 tx=0x7f93a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25942e08b06451cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.541+0000 7f93b48b4700 1 -- 172.21.15.6:0/1975117779 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400e6b0 con 0x7f9398003fe0 2023-10-06T02:18:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.541+0000 7f93b48b4700 1 -- 172.21.15.6:0/1975117779 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a400e810 con 0x7f9398003fe0 2023-10-06T02:18:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.541+0000 7f93b48b4700 1 -- 172.21.15.6:0/1975117779 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400ebd0 con 0x7f9398003fe0 2023-10-06T02:18:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.541+0000 7f93b7b1a700 1 -- 172.21.15.6:0/1975117779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9398003fe0 msgr2=0x7f9398004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.541+0000 7f93b7b1a700 1 --2- 172.21.15.6:0/1975117779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9398003fe0 0x7f9398004810 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f93b0089810 tx=0x7f93a40091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.541+0000 7f93b60b7700 1 -- 172.21.15.6:0/1975117779 reap_dead start 2023-10-06T02:18:49.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.541+0000 7f93b7b1a700 1 -- 172.21.15.6:0/1975117779 shutdown_connections 2023-10-06T02:18:49.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.541+0000 7f93b7b1a700 1 -- 172.21.15.6:0/1975117779 >> 172.21.15.6:0/1975117779 conn(0x7f93b0068680 msgr2=0x7f93b0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:49.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.541+0000 7f93b7b1a700 1 -- 172.21.15.6:0/1975117779 shutdown_connections 2023-10-06T02:18:49.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.541+0000 7f93b7b1a700 1 -- 172.21.15.6:0/1975117779 wait complete. 2023-10-06T02:18:49.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.542+0000 7f93b7b1a700 1 Processor -- start 2023-10-06T02:18:49.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.543+0000 7f93b7b1a700 1 -- start start 2023-10-06T02:18:49.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.543+0000 7f93b7b1a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9398003fe0 0x7f93b016ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.543+0000 7f93b7b1a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93b00cde20 0x7f93b0169910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.543+0000 7f93b7b1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b00a90c0 0x7f93b00a9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.543+0000 7f93b7b1a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b00a9a70 con 0x7f93b00a90c0 2023-10-06T02:18:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.543+0000 7f93b7b1a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b00cf180 con 0x7f93b00cde20 2023-10-06T02:18:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.543+0000 7f93b7b1a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b00ce570 con 0x7f9398003fe0 2023-10-06T02:18:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.543+0000 7f93b60b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b00a90c0 0x7f93b00a9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.543+0000 7f93b60b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b00a90c0 0x7f93b00a9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41572/0 (socket says 172.21.15.6:41572) 2023-10-06T02:18:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.543+0000 7f93b60b7700 1 -- 172.21.15.6:0/2970293899 learned_addr learned my addr 172.21.15.6:0/2970293899 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.543+0000 7f93b58b6700 1 --2- 172.21.15.6:0/2970293899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9398003fe0 0x7f93b016ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.543+0000 7f93b50b5700 1 --2- 172.21.15.6:0/2970293899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93b00cde20 0x7f93b0169910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.544+0000 7f93b60b7700 1 -- 172.21.15.6:0/2970293899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9398003fe0 msgr2=0x7f93b016ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.544+0000 7f93b60b7700 1 --2- 172.21.15.6:0/2970293899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9398003fe0 0x7f93b016ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.544+0000 7f93b60b7700 1 -- 172.21.15.6:0/2970293899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93b00cde20 msgr2=0x7f93b0169910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.544+0000 7f93b60b7700 1 --2- 172.21.15.6:0/2970293899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93b00cde20 0x7f93b0169910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.544+0000 7f93b60b7700 1 -- 172.21.15.6:0/2970293899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b00ce850 con 0x7f93b00a90c0 2023-10-06T02:18:49.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.544+0000 7f93b60b7700 1 --2- 172.21.15.6:0/2970293899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b00a90c0 0x7f93b00a9530 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f93b00cdd20 tx=0x7f93a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:49.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.544+0000 7f93adffb700 1 -- 172.21.15.6:0/2970293899 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a000e070 con 0x7f93b00a90c0 2023-10-06T02:18:49.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.544+0000 7f93adffb700 1 -- 172.21.15.6:0/2970293899 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a0011d00 con 0x7f93b00a90c0 2023-10-06T02:18:49.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.544+0000 7f93adffb700 1 -- 172.21.15.6:0/2970293899 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a00166c0 con 0x7f93b00a90c0 2023-10-06T02:18:49.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.544+0000 7f93b7b1a700 1 -- 172.21.15.6:0/2970293899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b00ceb30 con 0x7f93b00a90c0 2023-10-06T02:18:49.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.544+0000 7f93b7b1a700 1 -- 172.21.15.6:0/2970293899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b00ce290 con 0x7f93b00a90c0 2023-10-06T02:18:49.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.545+0000 7f93b7b1a700 1 -- 172.21.15.6:0/2970293899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b0088aa0 con 0x7f93b00a90c0 2023-10-06T02:18:49.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.545+0000 7f93adffb700 1 -- 172.21.15.6:0/2970293899 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93a0016a70 con 0x7f93b00a90c0 2023-10-06T02:18:49.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.546+0000 7f93adffb700 1 --2- 172.21.15.6:0/2970293899 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f939c066f30 0x7f939c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.546+0000 7f93adffb700 1 -- 172.21.15.6:0/2970293899 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f93a0085470 con 0x7f93b00a90c0 2023-10-06T02:18:49.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.546+0000 7f93b58b6700 1 --2- 172.21.15.6:0/2970293899 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f939c066f30 0x7f939c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.547+0000 7f93b58b6700 1 --2- 172.21.15.6:0/2970293899 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f939c066f30 0x7f939c0693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f93a8000e10 tx=0x7f93a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:49.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.550+0000 7f93adffb700 1 -- 172.21.15.6:0/2970293899 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93a0052440 con 0x7f93b00a90c0 2023-10-06T02:18:49.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.744+0000 7f93b7b1a700 1 -- 172.21.15.6:0/2970293899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93b00cad20 con 0x7f93b00a90c0 2023-10-06T02:18:49.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.745+0000 7f93adffb700 1 -- 172.21.15.6:0/2970293899 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+17023 (secure 0 0 0) 0x7f93a0055a60 con 0x7f93b00a90c0 2023-10-06T02:18:49.746 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:49.746 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":39,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:18:46.967410+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:18:43.639616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T02:18:44.317938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:18:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.747+0000 7f93b7b1a700 1 -- 172.21.15.6:0/2970293899 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f939c066f30 msgr2=0x7f939c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.747+0000 7f93b7b1a700 1 --2- 172.21.15.6:0/2970293899 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f939c066f30 0x7f939c0693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f93a8000e10 tx=0x7f93a8009040 comp rx=0 tx=0).stop 2023-10-06T02:18:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.748+0000 7f93b7b1a700 1 -- 172.21.15.6:0/2970293899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b00a90c0 msgr2=0x7f93b00a9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.748+0000 7f93b7b1a700 1 --2- 172.21.15.6:0/2970293899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b00a90c0 0x7f93b00a9530 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f93b00cdd20 tx=0x7f93a000b040 comp rx=0 tx=0).stop 2023-10-06T02:18:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.748+0000 7f93b7b1a700 1 -- 172.21.15.6:0/2970293899 shutdown_connections 2023-10-06T02:18:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.748+0000 7f93b7b1a700 1 --2- 172.21.15.6:0/2970293899 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f939c066f30 0x7f939c0693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.748+0000 7f93b7b1a700 1 --2- 172.21.15.6:0/2970293899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b00a90c0 0x7f93b00a9530 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.748+0000 7f93b7b1a700 1 --2- 172.21.15.6:0/2970293899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9398003fe0 0x7f93b016ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.748+0000 7f93b7b1a700 1 --2- 172.21.15.6:0/2970293899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93b00cde20 0x7f93b0169910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.748+0000 7f93b7b1a700 1 -- 172.21.15.6:0/2970293899 >> 172.21.15.6:0/2970293899 conn(0x7f93b0068680 msgr2=0x7f93b00b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.748+0000 7f93b7b1a700 1 -- 172.21.15.6:0/2970293899 shutdown_connections 2023-10-06T02:18:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.748+0000 7f93b7b1a700 1 -- 172.21.15.6:0/2970293899 wait complete. 2023-10-06T02:18:49.761 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:18:49.761 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:18:49.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.880+0000 7fb946c36700 1 Processor -- start 2023-10-06T02:18:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.880+0000 7fb946c36700 1 -- start start 2023-10-06T02:18:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.881+0000 7fb946c36700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb9400af8b0 0x7fb94015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.881+0000 7fb946c36700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9400b27f0 0x7fb94015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.881+0000 7fb946c36700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb94015e190 con 0x7fb9400af4e0 2023-10-06T02:18:49.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.881+0000 7fb946c36700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9400b1910 con 0x7fb9400af8b0 2023-10-06T02:18:49.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.881+0000 7fb946c36700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9400cb650 con 0x7fb9400b27f0 2023-10-06T02:18:49.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.881+0000 7fb9449d2700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb9400af4e0 0x7fb9400b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47734/0 (socket says 172.21.15.6:47734) 2023-10-06T02:18:49.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.881+0000 7fb9449d2700 1 -- 172.21.15.6:0/2021071027 learned_addr learned my addr 172.21.15.6:0/2021071027 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:49.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.881+0000 7fb93f7fe700 1 -- 172.21.15.6:0/2021071027 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945359857 0 0) 0x7fb94015e190 con 0x7fb9400af4e0 2023-10-06T02:18:49.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93f7fe700 1 -- 172.21.15.6:0/2021071027 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb92c003570 con 0x7fb9400af4e0 2023-10-06T02:18:49.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb9451d3700 1 --2- 172.21.15.6:0/2021071027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9400b27f0 0x7fb94015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93ffff700 1 --2- 172.21.15.6:0/2021071027 >> v2:172.21.15.175:3300/0 conn(0x7fb9400af8b0 0x7fb94015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93f7fe700 1 -- 172.21.15.6:0/2021071027 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 823227589 0 0) 0x7fb92c003570 con 0x7fb9400af4e0 2023-10-06T02:18:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93f7fe700 1 -- 172.21.15.6:0/2021071027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9400b27f0 msgr2=0x7fb94015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93f7fe700 1 --2- 172.21.15.6:0/2021071027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9400b27f0 0x7fb94015d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93f7fe700 1 -- 172.21.15.6:0/2021071027 >> v2:172.21.15.175:3300/0 conn(0x7fb9400af8b0 msgr2=0x7fb94015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93f7fe700 1 --2- 172.21.15.6:0/2021071027 >> v2:172.21.15.175:3300/0 conn(0x7fb9400af8b0 0x7fb94015d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93f7fe700 1 -- 172.21.15.6:0/2021071027 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9400ccaf0 con 0x7fb9400af4e0 2023-10-06T02:18:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93f7fe700 1 -- 172.21.15.6:0/2021071027 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fb938001470 con 0x7fb9400af4e0 2023-10-06T02:18:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93f7fe700 1 -- 172.21.15.6:0/2021071027 >> v1:172.21.15.6:6789/0 conn(0x7fb9400af4e0 legacy=0x7fb9400b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93f7fe700 1 --2- 172.21.15.6:0/2021071027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb92c003a60 0x7fb92c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93f7fe700 1 --2- 172.21.15.6:0/2021071027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb92c004810 0x7fb92c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93f7fe700 1 --2- 172.21.15.6:0/2021071027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9400b27f0 0x7fb92c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93f7fe700 1 -- 172.21.15.6:0/2021071027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9400b1910 con 0x7fb92c004810 2023-10-06T02:18:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93f7fe700 1 -- 172.21.15.6:0/2021071027 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9400cb650 con 0x7fb92c003a60 2023-10-06T02:18:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93f7fe700 1 -- 172.21.15.6:0/2021071027 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c00ba60 con 0x7fb9400b27f0 2023-10-06T02:18:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93ffff700 1 --2- 172.21.15.6:0/2021071027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb92c004810 0x7fb92c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb9449d2700 1 --2- 172.21.15.6:0/2021071027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb92c003a60 0x7fb92c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb9451d3700 1 --2- 172.21.15.6:0/2021071027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9400b27f0 0x7fb92c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93ffff700 1 -- 172.21.15.6:0/2021071027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9400b27f0 msgr2=0x7fb92c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:49.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93ffff700 1 --2- 172.21.15.6:0/2021071027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9400b27f0 0x7fb92c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93ffff700 1 -- 172.21.15.6:0/2021071027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb92c003a60 msgr2=0x7fb92c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:49.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93ffff700 1 --2- 172.21.15.6:0/2021071027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb92c003a60 0x7fb92c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.882+0000 7fb93ffff700 1 -- 172.21.15.6:0/2021071027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92c003570 con 0x7fb92c004810 2023-10-06T02:18:49.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.883+0000 7fb93ffff700 1 --2- 172.21.15.6:0/2021071027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb92c004810 0x7fb92c004c80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb93000e210 tx=0x7fb93000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5fbc08b0e65af4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:49.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.883+0000 7fb93f7fe700 1 -- 172.21.15.6:0/2021071027 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93000eac0 con 0x7fb92c004810 2023-10-06T02:18:49.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.883+0000 7fb93f7fe700 1 -- 172.21.15.6:0/2021071027 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93000f040 con 0x7fb92c004810 2023-10-06T02:18:49.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.883+0000 7fb93f7fe700 1 -- 172.21.15.6:0/2021071027 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93000ee50 con 0x7fb92c004810 2023-10-06T02:18:49.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.883+0000 7fb946c36700 1 -- 172.21.15.6:0/2021071027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb92c004810 msgr2=0x7fb92c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.883+0000 7fb946c36700 1 --2- 172.21.15.6:0/2021071027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb92c004810 0x7fb92c004c80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb93000e210 tx=0x7fb93000b040 comp rx=0 tx=0).stop 2023-10-06T02:18:49.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.883+0000 7fb9451d3700 1 -- 172.21.15.6:0/2021071027 reap_dead start 2023-10-06T02:18:49.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.883+0000 7fb946c36700 1 -- 172.21.15.6:0/2021071027 shutdown_connections 2023-10-06T02:18:49.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.883+0000 7fb946c36700 1 -- 172.21.15.6:0/2021071027 >> 172.21.15.6:0/2021071027 conn(0x7fb940068680 msgr2=0x7fb940068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:49.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.883+0000 7fb946c36700 1 -- 172.21.15.6:0/2021071027 shutdown_connections 2023-10-06T02:18:49.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.883+0000 7fb946c36700 1 -- 172.21.15.6:0/2021071027 wait complete. 2023-10-06T02:18:49.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.884+0000 7fb946c36700 1 Processor -- start 2023-10-06T02:18:49.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.885+0000 7fb946c36700 1 -- start start 2023-10-06T02:18:49.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.885+0000 7fb946c36700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb92c004810 0x7fb9400c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.885+0000 7fb946c36700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb94015a540 0x7fb94016d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.885+0000 7fb946c36700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb94015a9b0 0x7fb94016db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.885+0000 7fb946c36700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94015a0b0 con 0x7fb92c004810 2023-10-06T02:18:49.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.885+0000 7fb946c36700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9401594a0 con 0x7fb94015a540 2023-10-06T02:18:49.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.885+0000 7fb946c36700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb940159780 con 0x7fb94015a9b0 2023-10-06T02:18:49.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.885+0000 7fb9449d2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb92c004810 0x7fb9400c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.885+0000 7fb9449d2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb92c004810 0x7fb9400c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41582/0 (socket says 172.21.15.6:41582) 2023-10-06T02:18:49.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.885+0000 7fb9449d2700 1 -- 172.21.15.6:0/51906958 learned_addr learned my addr 172.21.15.6:0/51906958 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:49.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.886+0000 7fb93ffff700 1 --2- 172.21.15.6:0/51906958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb94015a540 0x7fb94016d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.886+0000 7fb9451d3700 1 --2- 172.21.15.6:0/51906958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb94015a9b0 0x7fb94016db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.886+0000 7fb9449d2700 1 -- 172.21.15.6:0/51906958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb94015a9b0 msgr2=0x7fb94016db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.886+0000 7fb9449d2700 1 --2- 172.21.15.6:0/51906958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb94015a9b0 0x7fb94016db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.886+0000 7fb9449d2700 1 -- 172.21.15.6:0/51906958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb94015a540 msgr2=0x7fb94016d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:49.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.886+0000 7fb9449d2700 1 --2- 172.21.15.6:0/51906958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb94015a540 0x7fb94016d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:49.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.886+0000 7fb9449d2700 1 -- 172.21.15.6:0/51906958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb940159a60 con 0x7fb92c004810 2023-10-06T02:18:49.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.886+0000 7fb9449d2700 1 --2- 172.21.15.6:0/51906958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb92c004810 0x7fb9400c6780 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb9380073c0 tx=0x7fb9400cb790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:49.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.886+0000 7fb93cff9700 1 -- 172.21.15.6:0/51906958 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93800f8d0 con 0x7fb92c004810 2023-10-06T02:18:49.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.886+0000 7fb93cff9700 1 -- 172.21.15.6:0/51906958 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93800fa50 con 0x7fb92c004810 2023-10-06T02:18:49.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.886+0000 7fb93cff9700 1 -- 172.21.15.6:0/51906958 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93800fe10 con 0x7fb92c004810 2023-10-06T02:18:49.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.886+0000 7fb946c36700 1 -- 172.21.15.6:0/51906958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb940159d40 con 0x7fb92c004810 2023-10-06T02:18:49.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.886+0000 7fb946c36700 1 -- 172.21.15.6:0/51906958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9401453e0 con 0x7fb92c004810 2023-10-06T02:18:49.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.887+0000 7fb946c36700 1 -- 172.21.15.6:0/51906958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94015a390 con 0x7fb92c004810 2023-10-06T02:18:49.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.887+0000 7fb93cff9700 1 -- 172.21.15.6:0/51906958 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb938013600 con 0x7fb92c004810 2023-10-06T02:18:49.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.888+0000 7fb93cff9700 1 --2- 172.21.15.6:0/51906958 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb920066f30 0x7fb9200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:49.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.888+0000 7fb93cff9700 1 -- 172.21.15.6:0/51906958 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb9380849b0 con 0x7fb92c004810 2023-10-06T02:18:49.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.888+0000 7fb93ffff700 1 --2- 172.21.15.6:0/51906958 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb920066f30 0x7fb9200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:49.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.888+0000 7fb93ffff700 1 --2- 172.21.15.6:0/51906958 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb920066f30 0x7fb9200693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb94015ae90 tx=0x7fb93001a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:49.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:49.892+0000 7fb93cff9700 1 -- 172.21.15.6:0/51906958 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb938051980 con 0x7fb92c004810 2023-10-06T02:18:50.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.084+0000 7fb946c36700 1 -- 172.21.15.6:0/51906958 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb94015a1f0 con 0x7fb920066f30 2023-10-06T02:18:50.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.093+0000 7fb93cff9700 1 -- 172.21.15.6:0/51906958 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308652 (secure 0 0 0) 0x7fb930001050 con 0x7fb920066f30 2023-10-06T02:18:50.097 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.096+0000 7fb946c36700 1 -- 172.21.15.6:0/51906958 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb920066f30 msgr2=0x7fb9200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.096+0000 7fb946c36700 1 --2- 172.21.15.6:0/51906958 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb920066f30 0x7fb9200693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb94015ae90 tx=0x7fb93001a000 comp rx=0 tx=0).stop 2023-10-06T02:18:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.096+0000 7fb946c36700 1 -- 172.21.15.6:0/51906958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb92c004810 msgr2=0x7fb9400c6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.096+0000 7fb946c36700 1 --2- 172.21.15.6:0/51906958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb92c004810 0x7fb9400c6780 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb9380073c0 tx=0x7fb9400cb790 comp rx=0 tx=0).stop 2023-10-06T02:18:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.096+0000 7fb946c36700 1 -- 172.21.15.6:0/51906958 shutdown_connections 2023-10-06T02:18:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.096+0000 7fb946c36700 1 --2- 172.21.15.6:0/51906958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb94015a9b0 0x7fb94016db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.096+0000 7fb946c36700 1 --2- 172.21.15.6:0/51906958 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb920066f30 0x7fb9200693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.096+0000 7fb946c36700 1 --2- 172.21.15.6:0/51906958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb92c004810 0x7fb9400c6780 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.096+0000 7fb946c36700 1 --2- 172.21.15.6:0/51906958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb94015a540 0x7fb94016d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.096+0000 7fb946c36700 1 -- 172.21.15.6:0/51906958 >> 172.21.15.6:0/51906958 conn(0x7fb940068680 msgr2=0x7fb94006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.097+0000 7fb946c36700 1 -- 172.21.15.6:0/51906958 shutdown_connections 2023-10-06T02:18:50.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.097+0000 7fb946c36700 1 -- 172.21.15.6:0/51906958 wait complete. 2023-10-06T02:18:50.101 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:18:50.109 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-10-06T02:18:48.574986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382756,"kb_used_data":4452,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591964,"statfs":{"total":773094113280,"available":770654171136,"internally_reserved":0,"allocated":4558848,"data_stored":2661981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.636621"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945511+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:28.392538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944769+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:05.439978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944636+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:29.157909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943130+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:21.626772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948284+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:35.807016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.947652+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:29.157909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943079+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:48.223274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942462+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:46.909176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945753+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:24:04.544636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941502+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:46.273367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943070+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:35.807016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944911+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:06.549044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.940910+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:24.276483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943771+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:48.223274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944578+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:56.622088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.952047+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:02.754107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944112+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:56.622088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944528+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:32:43.479197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.947435+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:51.700768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941810+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:18.720086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944592+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:24.267409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941198+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:39.727976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944141+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:04.574891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943739+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:27.470110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.947581+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:40:12.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941643+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:41.962383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944089+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:38.289800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.949302+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:15.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945192+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:01.121797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.946062+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:24:36.091537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943411+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:20.287441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941280+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:40:12.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.947435+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:42.736759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.960473+0000","last_change":"2023-10-06T02:18:44.960473+0000","last_active":"2023-10-06T02:18:44.960473+0000","last_peered":"2023-10-06T02:18:44.960473+0000","last_clean":"2023-10-06T02:18:44.960473+0000","last_became_active":"2023-10-06T02:18:44.960009+0000","last_became_peered":"2023-10-06T02:18:44.960009+0000","last_unstale":"2023-10-06T02:18:44.960473+0000","last_undegraded":"2023-10-06T02:18:44.960473+0000","last_fullsized":"2023-10-06T02:18:44.960473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:20.624772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948588+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:18.720086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.958493+0000","last_change":"2023-10-06T02:18:44.958493+0000","last_active":"2023-10-06T02:18:44.958493+0000","last_peered":"2023-10-06T02:18:44.958493+0000","last_clean":"2023-10-06T02:18:44.958493+0000","last_became_active":"2023-10-06T02:18:44.958170+0000","last_became_peered":"2023-10-06T02:18:44.958170+0000","last_unstale":"2023-10-06T02:18:44.958493+0000","last_undegraded":"2023-10-06T02:18:44.958493+0000","last_fullsized":"2023-10-06T02:18:44.958493+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:27.390538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945528+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:21.626772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.961055+0000","last_change":"2023-10-06T02:18:44.961055+0000","last_active":"2023-10-06T02:18:44.961055+0000","last_peered":"2023-10-06T02:18:44.961055+0000","last_clean":"2023-10-06T02:18:44.961055+0000","last_became_active":"2023-10-06T02:18:44.960851+0000","last_became_peered":"2023-10-06T02:18:44.960851+0000","last_unstale":"2023-10-06T02:18:44.961055+0000","last_undegraded":"2023-10-06T02:18:44.961055+0000","last_fullsized":"2023-10-06T02:18:44.961055+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:47.153725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948023+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:47.458786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.959383+0000","last_change":"2023-10-06T02:18:44.959383+0000","last_active":"2023-10-06T02:18:44.959383+0000","last_peered":"2023-10-06T02:18:44.959383+0000","last_clean":"2023-10-06T02:18:44.959383+0000","last_became_active":"2023-10-06T02:18:44.959073+0000","last_became_peered":"2023-10-06T02:18:44.959073+0000","last_unstale":"2023-10-06T02:18:44.959383+0000","last_undegraded":"2023-10-06T02:18:44.959383+0000","last_fullsized":"2023-10-06T02:18:44.959383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:45.271368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943713+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:24.267409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.952220+0000","last_change":"2023-10-06T02:18:44.952220+0000","last_active":"2023-10-06T02:18:44.952220+0000","last_peered":"2023-10-06T02:18:44.952220+0000","last_clean":"2023-10-06T02:18:44.952220+0000","last_became_active":"2023-10-06T02:18:44.951937+0000","last_became_peered":"2023-10-06T02:18:44.951937+0000","last_unstale":"2023-10-06T02:18:44.952220+0000","last_undegraded":"2023-10-06T02:18:44.952220+0000","last_fullsized":"2023-10-06T02:18:44.952220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:27.390538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941714+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:49.872982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.952812+0000","last_change":"2023-10-06T02:18:44.952812+0000","last_active":"2023-10-06T02:18:44.952812+0000","last_peered":"2023-10-06T02:18:44.952812+0000","last_clean":"2023-10-06T02:18:44.952812+0000","last_became_active":"2023-10-06T02:18:44.952538+0000","last_became_peered":"2023-10-06T02:18:44.952538+0000","last_unstale":"2023-10-06T02:18:44.952812+0000","last_undegraded":"2023-10-06T02:18:44.952812+0000","last_fullsized":"2023-10-06T02:18:44.952812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:01.175622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941401+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:53:55.656192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.950586+0000","last_change":"2023-10-06T02:18:44.950586+0000","last_active":"2023-10-06T02:18:44.950586+0000","last_peered":"2023-10-06T02:18:44.950586+0000","last_clean":"2023-10-06T02:18:44.950586+0000","last_became_active":"2023-10-06T02:18:44.950322+0000","last_became_peered":"2023-10-06T02:18:44.950322+0000","last_unstale":"2023-10-06T02:18:44.950586+0000","last_undegraded":"2023-10-06T02:18:44.950586+0000","last_fullsized":"2023-10-06T02:18:44.950586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:48.870983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944664+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:16.197382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.952867+0000","last_change":"2023-10-06T02:18:44.952867+0000","last_active":"2023-10-06T02:18:44.952867+0000","last_peered":"2023-10-06T02:18:44.952867+0000","last_clean":"2023-10-06T02:18:44.952867+0000","last_became_active":"2023-10-06T02:18:44.952582+0000","last_became_peered":"2023-10-06T02:18:44.952582+0000","last_unstale":"2023-10-06T02:18:44.952867+0000","last_undegraded":"2023-10-06T02:18:44.952867+0000","last_fullsized":"2023-10-06T02:18:44.952867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:41.734760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943621+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:01.893468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.953410+0000","last_change":"2023-10-06T02:18:44.953410+0000","last_active":"2023-10-06T02:18:44.953410+0000","last_peered":"2023-10-06T02:18:44.953410+0000","last_clean":"2023-10-06T02:18:44.953410+0000","last_became_active":"2023-10-06T02:18:44.953098+0000","last_became_peered":"2023-10-06T02:18:44.953098+0000","last_unstale":"2023-10-06T02:18:44.953410+0000","last_undegraded":"2023-10-06T02:18:44.953410+0000","last_fullsized":"2023-10-06T02:18:44.953410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:19.285441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945037+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:15.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.958075+0000","last_change":"2023-10-06T02:18:44.958075+0000","last_active":"2023-10-06T02:18:44.958075+0000","last_peered":"2023-10-06T02:18:44.958075+0000","last_clean":"2023-10-06T02:18:44.958075+0000","last_became_active":"2023-10-06T02:18:44.953714+0000","last_became_peered":"2023-10-06T02:18:44.953714+0000","last_unstale":"2023-10-06T02:18:44.958075+0000","last_undegraded":"2023-10-06T02:18:44.958075+0000","last_fullsized":"2023-10-06T02:18:44.958075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:03.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944013+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:53.401386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.957227+0000","last_change":"2023-10-06T02:18:44.957227+0000","last_active":"2023-10-06T02:18:44.957227+0000","last_peered":"2023-10-06T02:18:44.957227+0000","last_clean":"2023-10-06T02:18:44.957227+0000","last_became_active":"2023-10-06T02:18:44.956968+0000","last_became_peered":"2023-10-06T02:18:44.956968+0000","last_unstale":"2023-10-06T02:18:44.957227+0000","last_undegraded":"2023-10-06T02:18:44.957227+0000","last_fullsized":"2023-10-06T02:18:44.957227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:48.870983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942957+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:21.626772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.950113+0000","last_change":"2023-10-06T02:18:44.950113+0000","last_active":"2023-10-06T02:18:44.950113+0000","last_peered":"2023-10-06T02:18:44.950113+0000","last_clean":"2023-10-06T02:18:44.950113+0000","last_became_active":"2023-10-06T02:18:44.949813+0000","last_became_peered":"2023-10-06T02:18:44.949813+0000","last_unstale":"2023-10-06T02:18:44.950113+0000","last_undegraded":"2023-10-06T02:18:44.950113+0000","last_fullsized":"2023-10-06T02:18:44.950113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:00.119797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.949186+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:49.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.949923+0000","last_change":"2023-10-06T02:18:44.949923+0000","last_active":"2023-10-06T02:18:44.949923+0000","last_peered":"2023-10-06T02:18:44.949923+0000","last_clean":"2023-10-06T02:18:44.949923+0000","last_became_active":"2023-10-06T02:18:44.948547+0000","last_became_peered":"2023-10-06T02:18:44.948547+0000","last_unstale":"2023-10-06T02:18:44.949923+0000","last_undegraded":"2023-10-06T02:18:44.949923+0000","last_fullsized":"2023-10-06T02:18:44.949923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:05.547045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942567+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:06.549044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.954535+0000","last_change":"2023-10-06T02:18:44.954535+0000","last_active":"2023-10-06T02:18:44.954535+0000","last_peered":"2023-10-06T02:18:44.954535+0000","last_clean":"2023-10-06T02:18:44.954535+0000","last_became_active":"2023-10-06T02:18:44.954254+0000","last_became_peered":"2023-10-06T02:18:44.954254+0000","last_unstale":"2023-10-06T02:18:44.954535+0000","last_undegraded":"2023-10-06T02:18:44.954535+0000","last_fullsized":"2023-10-06T02:18:44.954535+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:45.907176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943273+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:02.177622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.949330+0000","last_change":"2023-10-06T02:18:44.949330+0000","last_active":"2023-10-06T02:18:44.949330+0000","last_peered":"2023-10-06T02:18:44.949330+0000","last_clean":"2023-10-06T02:18:44.949330+0000","last_became_active":"2023-10-06T02:18:44.949068+0000","last_became_peered":"2023-10-06T02:18:44.949068+0000","last_unstale":"2023-10-06T02:18:44.949330+0000","last_undegraded":"2023-10-06T02:18:44.949330+0000","last_fullsized":"2023-10-06T02:18:44.949330+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:04.437978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942617+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:35.807016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.953429+0000","last_change":"2023-10-06T02:18:44.953429+0000","last_active":"2023-10-06T02:18:44.953429+0000","last_peered":"2023-10-06T02:18:44.953429+0000","last_clean":"2023-10-06T02:18:44.953429+0000","last_became_active":"2023-10-06T02:18:44.953157+0000","last_became_peered":"2023-10-06T02:18:44.953157+0000","last_unstale":"2023-10-06T02:18:44.953429+0000","last_undegraded":"2023-10-06T02:18:44.953429+0000","last_fullsized":"2023-10-06T02:18:44.953429+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:16.468803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.940987+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:51.700768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.949507+0000","last_change":"2023-10-06T02:18:44.949507+0000","last_active":"2023-10-06T02:18:44.949507+0000","last_peered":"2023-10-06T02:18:44.949507+0000","last_clean":"2023-10-06T02:18:44.949507+0000","last_became_active":"2023-10-06T02:18:44.949197+0000","last_became_peered":"2023-10-06T02:18:44.949197+0000","last_unstale":"2023-10-06T02:18:44.949507+0000","last_undegraded":"2023-10-06T02:18:44.949507+0000","last_fullsized":"2023-10-06T02:18:44.949507+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:15.195382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.940558+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:56.408624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.958383+0000","last_change":"2023-10-06T02:18:44.958383+0000","last_active":"2023-10-06T02:18:44.958383+0000","last_peered":"2023-10-06T02:18:44.958383+0000","last_clean":"2023-10-06T02:18:44.958383+0000","last_became_active":"2023-10-06T02:18:44.957808+0000","last_became_peered":"2023-10-06T02:18:44.957808+0000","last_unstale":"2023-10-06T02:18:44.958383+0000","last_undegraded":"2023-10-06T02:18:44.958383+0000","last_fullsized":"2023-10-06T02:18:44.958383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:11.173858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.946317+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:26.609252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.957231+0000","last_change":"2023-10-06T02:18:44.957231+0000","last_active":"2023-10-06T02:18:44.957231+0000","last_peered":"2023-10-06T02:18:44.957231+0000","last_clean":"2023-10-06T02:18:44.957231+0000","last_became_active":"2023-10-06T02:18:44.955723+0000","last_became_peered":"2023-10-06T02:18:44.955723+0000","last_unstale":"2023-10-06T02:18:44.957231+0000","last_undegraded":"2023-10-06T02:18:44.957231+0000","last_fullsized":"2023-10-06T02:18:44.957231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:45.907176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.946928+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:24.276483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.957249+0000","last_change":"2023-10-06T02:18:44.957249+0000","last_active":"2023-10-06T02:18:44.957249+0000","last_peered":"2023-10-06T02:18:44.957249+0000","last_clean":"2023-10-06T02:18:44.957249+0000","last_became_active":"2023-10-06T02:18:44.956928+0000","last_became_peered":"2023-10-06T02:18:44.956928+0000","last_unstale":"2023-10-06T02:18:44.957249+0000","last_undegraded":"2023-10-06T02:18:44.957249+0000","last_fullsized":"2023-10-06T02:18:44.957249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:34.805017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945196+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:38.289800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.960417+0000","last_change":"2023-10-06T02:18:44.960417+0000","last_active":"2023-10-06T02:18:44.960417+0000","last_peered":"2023-10-06T02:18:44.960417+0000","last_clean":"2023-10-06T02:18:44.960417+0000","last_became_active":"2023-10-06T02:18:44.960095+0000","last_became_peered":"2023-10-06T02:18:44.960095+0000","last_unstale":"2023-10-06T02:18:44.960417+0000","last_undegraded":"2023-10-06T02:18:44.960417+0000","last_fullsized":"2023-10-06T02:18:44.960417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:14.146477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945264+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:17.470803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.955211+0000","last_change":"2023-10-06T02:18:44.955211+0000","last_active":"2023-10-06T02:18:44.955211+0000","last_peered":"2023-10-06T02:18:44.955211+0000","last_clean":"2023-10-06T02:18:44.955211+0000","last_became_active":"2023-10-06T02:18:44.954949+0000","last_became_peered":"2023-10-06T02:18:44.954949+0000","last_unstale":"2023-10-06T02:18:44.955211+0000","last_undegraded":"2023-10-06T02:18:44.955211+0000","last_fullsized":"2023-10-06T02:18:44.955211+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:45.271368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942658+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:49.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.956467+0000","last_change":"2023-10-06T02:18:44.956467+0000","last_active":"2023-10-06T02:18:44.956467+0000","last_peered":"2023-10-06T02:18:44.956467+0000","last_clean":"2023-10-06T02:18:44.956467+0000","last_became_active":"2023-10-06T02:18:44.956221+0000","last_became_peered":"2023-10-06T02:18:44.956221+0000","last_unstale":"2023-10-06T02:18:44.956467+0000","last_undegraded":"2023-10-06T02:18:44.956467+0000","last_fullsized":"2023-10-06T02:18:44.956467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:20.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941761+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:22.904890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.955172+0000","last_change":"2023-10-06T02:18:44.955172+0000","last_active":"2023-10-06T02:18:44.955172+0000","last_peered":"2023-10-06T02:18:44.955172+0000","last_clean":"2023-10-06T02:18:44.955172+0000","last_became_active":"2023-10-06T02:18:44.954905+0000","last_became_peered":"2023-10-06T02:18:44.954905+0000","last_unstale":"2023-10-06T02:18:44.955172+0000","last_undegraded":"2023-10-06T02:18:44.955172+0000","last_fullsized":"2023-10-06T02:18:44.955172+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:21.902890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943679+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:06.448305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.954645+0000","last_change":"2023-10-06T02:18:44.954645+0000","last_active":"2023-10-06T02:18:44.954645+0000","last_peered":"2023-10-06T02:18:44.954645+0000","last_clean":"2023-10-06T02:18:44.954645+0000","last_became_active":"2023-10-06T02:18:44.954349+0000","last_became_peered":"2023-10-06T02:18:44.954349+0000","last_unstale":"2023-10-06T02:18:44.954645+0000","last_undegraded":"2023-10-06T02:18:44.954645+0000","last_fullsized":"2023-10-06T02:18:44.954645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:14.432297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.942284+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:18:43.942284+0000","last_peered":"2023-10-06T02:18:43.942284+0000","last_clean":"2023-10-06T02:18:43.942284+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:18:43.942284+0000","last_undegraded":"2023-10-06T02:18:43.942284+0000","last_fullsized":"2023-10-06T02:18:43.942284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944275+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:01.893468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.956366+0000","last_change":"2023-10-06T02:18:44.956366+0000","last_active":"2023-10-06T02:18:44.956366+0000","last_peered":"2023-10-06T02:18:44.956366+0000","last_clean":"2023-10-06T02:18:44.956366+0000","last_became_active":"2023-10-06T02:18:44.956094+0000","last_became_peered":"2023-10-06T02:18:44.956094+0000","last_unstale":"2023-10-06T02:18:44.956366+0000","last_undegraded":"2023-10-06T02:18:44.956366+0000","last_fullsized":"2023-10-06T02:18:44.956366+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:53:54.654193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.936641+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:18:43.936641+0000","last_peered":"2023-10-06T02:18:43.936641+0000","last_clean":"2023-10-06T02:18:43.936641+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:18:43.936641+0000","last_undegraded":"2023-10-06T02:18:43.936641+0000","last_fullsized":"2023-10-06T02:18:43.936641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942393+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:06.549044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.960597+0000","last_change":"2023-10-06T02:18:44.960597+0000","last_active":"2023-10-06T02:18:44.960597+0000","last_peered":"2023-10-06T02:18:44.960597+0000","last_clean":"2023-10-06T02:18:44.960597+0000","last_became_active":"2023-10-06T02:18:44.960378+0000","last_became_peered":"2023-10-06T02:18:44.960378+0000","last_unstale":"2023-10-06T02:18:44.960597+0000","last_undegraded":"2023-10-06T02:18:44.960597+0000","last_fullsized":"2023-10-06T02:18:44.960597+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:20.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.947295+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:18:43.947295+0000","last_peered":"2023-10-06T02:18:43.947295+0000","last_clean":"2023-10-06T02:18:43.947295+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:18:43.947295+0000","last_undegraded":"2023-10-06T02:18:43.947295+0000","last_fullsized":"2023-10-06T02:18:43.947295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.944083+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:18:43.944083+0000","last_peered":"2023-10-06T02:18:43.944083+0000","last_clean":"2023-10-06T02:18:43.944083+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:18:43.944083+0000","last_undegraded":"2023-10-06T02:18:43.944083+0000","last_fullsized":"2023-10-06T02:18:43.944083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942584+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:05.439978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.956914+0000","last_change":"2023-10-06T02:18:44.956914+0000","last_active":"2023-10-06T02:18:44.956914+0000","last_peered":"2023-10-06T02:18:44.956914+0000","last_clean":"2023-10-06T02:18:44.956914+0000","last_became_active":"2023-10-06T02:18:44.956611+0000","last_became_peered":"2023-10-06T02:18:44.956611+0000","last_unstale":"2023-10-06T02:18:44.956914+0000","last_undegraded":"2023-10-06T02:18:44.956914+0000","last_fullsized":"2023-10-06T02:18:44.956914+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:38.725977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.944020+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:18:43.944020+0000","last_peered":"2023-10-06T02:18:43.944020+0000","last_clean":"2023-10-06T02:18:43.944020+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:18:43.944020+0000","last_undegraded":"2023-10-06T02:18:43.944020+0000","last_fullsized":"2023-10-06T02:18:43.944020+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.940576+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:30.646258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.957887+0000","last_change":"2023-10-06T02:18:44.957887+0000","last_active":"2023-10-06T02:18:44.957887+0000","last_peered":"2023-10-06T02:18:44.957887+0000","last_clean":"2023-10-06T02:18:44.957887+0000","last_became_active":"2023-10-06T02:18:44.955744+0000","last_became_peered":"2023-10-06T02:18:44.955744+0000","last_unstale":"2023-10-06T02:18:44.957887+0000","last_undegraded":"2023-10-06T02:18:44.957887+0000","last_fullsized":"2023-10-06T02:18:44.957887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:21.902890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.943977+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:18:43.943977+0000","last_peered":"2023-10-06T02:18:43.943977+0000","last_clean":"2023-10-06T02:18:43.943977+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:18:43.943977+0000","last_undegraded":"2023-10-06T02:18:43.943977+0000","last_fullsized":"2023-10-06T02:18:43.943977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948115+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:41.962383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.948994+0000","last_change":"2023-10-06T02:18:44.948994+0000","last_active":"2023-10-06T02:18:44.948994+0000","last_peered":"2023-10-06T02:18:44.948994+0000","last_clean":"2023-10-06T02:18:44.948994+0000","last_became_active":"2023-10-06T02:18:44.948536+0000","last_became_peered":"2023-10-06T02:18:44.948536+0000","last_unstale":"2023-10-06T02:18:44.948994+0000","last_undegraded":"2023-10-06T02:18:44.948994+0000","last_fullsized":"2023-10-06T02:18:44.948994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:47.221274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.945442+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:18:43.945442+0000","last_peered":"2023-10-06T02:18:43.945442+0000","last_clean":"2023-10-06T02:18:43.945442+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:18:43.945442+0000","last_undegraded":"2023-10-06T02:18:43.945442+0000","last_fullsized":"2023-10-06T02:18:43.945442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948403+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:48.223274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.961435+0000","last_change":"2023-10-06T02:18:44.961435+0000","last_active":"2023-10-06T02:18:44.961435+0000","last_peered":"2023-10-06T02:18:44.961435+0000","last_clean":"2023-10-06T02:18:44.961435+0000","last_became_active":"2023-10-06T02:18:44.961289+0000","last_became_peered":"2023-10-06T02:18:44.961289+0000","last_unstale":"2023-10-06T02:18:44.961435+0000","last_undegraded":"2023-10-06T02:18:44.961435+0000","last_fullsized":"2023-10-06T02:18:44.961435+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:01.752107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.941552+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:18:43.941552+0000","last_peered":"2023-10-06T02:18:43.941552+0000","last_clean":"2023-10-06T02:18:43.941552+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:18:43.941552+0000","last_undegraded":"2023-10-06T02:18:43.941552+0000","last_fullsized":"2023-10-06T02:18:43.941552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943232+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:53.401386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.958969+0000","last_change":"2023-10-06T02:18:44.958969+0000","last_active":"2023-10-06T02:18:44.958969+0000","last_peered":"2023-10-06T02:18:44.958969+0000","last_clean":"2023-10-06T02:18:44.958969+0000","last_became_active":"2023-10-06T02:18:44.958782+0000","last_became_peered":"2023-10-06T02:18:44.958782+0000","last_unstale":"2023-10-06T02:18:44.958969+0000","last_undegraded":"2023-10-06T02:18:44.958969+0000","last_fullsized":"2023-10-06T02:18:44.958969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:47.153725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.941741+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:18:43.941741+0000","last_peered":"2023-10-06T02:18:43.941741+0000","last_clean":"2023-10-06T02:18:43.941741+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:18:43.941741+0000","last_undegraded":"2023-10-06T02:18:43.941741+0000","last_fullsized":"2023-10-06T02:18:43.941741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298284,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073556,"statfs":{"total":96636764160,"available":96331321344,"internally_reserved":0,"allocated":1019904,"data_stored":777613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.58799999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.45200000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.499}]},{"osd":6,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.621}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":421888,"data_stored":186292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":5.6929999999999996,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":5.7060000000000004,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.628}]},{"osd":2,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":8.8659999999999997,"5min":8.8659999999999997,"15min":8.8659999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":10.659000000000001,"5min":10.659000000000001,"15min":10.659000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65400000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.748},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.80500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298268,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073572,"statfs":{"total":96636764160,"available":96331337728,"internally_reserved":0,"allocated":1003520,"data_stored":769732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.34300000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.33500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.30299999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51800000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":187245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.377,"5min":0.377,"15min":0.377},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.376,"5min":0.376,"15min":0.376},"last":0.30199999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.377}]},{"osd":4,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.70099999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":11.138,"5min":11.138,"15min":11.138},"last":0.625},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":421888,"data_stored":186292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.31900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.373}]},{"osd":3,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.46899999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48399999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.44800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":187245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.311}]},{"osd":4,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.52100000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.57699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":187245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":17.879999999999999,"5min":17.879999999999999,"15min":17.879999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":18.010999999999999,"5min":18.010999999999999,"15min":18.010999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.49299999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.624},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":180317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.59999999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.436}]},{"osd":6,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.628}]},{"osd":7,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.503},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:18:50.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:18:50.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.268+0000 7f94e11fb700 1 Processor -- start 2023-10-06T02:18:50.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.268+0000 7f94e11fb700 1 -- start start 2023-10-06T02:18:50.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.269+0000 7f94e11fb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94dc0cf1a0 0x7f94dc0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:50.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.269+0000 7f94e11fb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f94dc1597d0 0x7f94dc0d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:50.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.269+0000 7f94e11fb700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94dc0b3560 con 0x7f94dc159400 2023-10-06T02:18:50.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.269+0000 7f94e11fb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94dc0cf6f0 con 0x7f94dc1597d0 2023-10-06T02:18:50.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.269+0000 7f94e11fb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc0cf9d0 con 0x7f94dc0cf1a0 2023-10-06T02:18:50.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.269+0000 7f94e09fa700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f94dc1597d0 0x7f94dc0d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:50.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.269+0000 7f94db7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94dc0cf1a0 0x7f94dc0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:50.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.269+0000 7f94dbfff700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f94dc159400 0x7f94dc0ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:38504/0 (socket says 172.21.15.6:38504) 2023-10-06T02:18:50.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.269+0000 7f94dbfff700 1 -- 172.21.15.6:0/3209097427 learned_addr learned my addr 172.21.15.6:0/3209097427 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.270+0000 7f94db7fe700 1 -- 172.21.15.6:0/3209097427 >> v2:172.21.15.175:3300/0 conn(0x7f94dc1597d0 msgr2=0x7f94dc0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.270+0000 7f94db7fe700 1 --2- 172.21.15.6:0/3209097427 >> v2:172.21.15.175:3300/0 conn(0x7f94dc1597d0 0x7f94dc0d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.270+0000 7f94db7fe700 1 -- 172.21.15.6:0/3209097427 >> v1:172.21.15.175:6789/0 conn(0x7f94dc159400 legacy=0x7f94dc0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.270+0000 7f94db7fe700 1 -- 172.21.15.6:0/3209097427 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc0b2f10 con 0x7f94dc0cf1a0 2023-10-06T02:18:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.270+0000 7f94e09fa700 1 --2- 172.21.15.6:0/3209097427 >> v2:172.21.15.175:3300/0 conn(0x7f94dc1597d0 0x7f94dc0d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.270+0000 7f94db7fe700 1 --2- 172.21.15.6:0/3209097427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94dc0cf1a0 0x7f94dc0cfec0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0098e0 tx=0x7f94cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d82d7f3ac545664a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.270+0000 7f94daffd700 1 -- 172.21.15.6:0/3209097427 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc00b640 con 0x7f94dc0cf1a0 2023-10-06T02:18:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.270+0000 7f94daffd700 1 -- 172.21.15.6:0/3209097427 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc00b7a0 con 0x7f94dc0cf1a0 2023-10-06T02:18:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.270+0000 7f94daffd700 1 -- 172.21.15.6:0/3209097427 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc00bb40 con 0x7f94dc0cf1a0 2023-10-06T02:18:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.271+0000 7f94e11fb700 1 -- 172.21.15.6:0/3209097427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94dc0cf1a0 msgr2=0x7f94dc0cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.271+0000 7f94e11fb700 1 --2- 172.21.15.6:0/3209097427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94dc0cf1a0 0x7f94dc0cfec0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0098e0 tx=0x7f94cc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.271+0000 7f94e11fb700 1 -- 172.21.15.6:0/3209097427 shutdown_connections 2023-10-06T02:18:50.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.271+0000 7f94e11fb700 1 --2- 172.21.15.6:0/3209097427 >> v2:172.21.15.175:3300/0 conn(0x7f94dc1597d0 0x7f94dc0d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.271+0000 7f94e11fb700 1 --2- 172.21.15.6:0/3209097427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94dc0cf1a0 0x7f94dc0cfec0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.271+0000 7f94e11fb700 1 -- 172.21.15.6:0/3209097427 >> 172.21.15.6:0/3209097427 conn(0x7f94dc06ac10 msgr2=0x7f94dc068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:50.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.271+0000 7f94e11fb700 1 -- 172.21.15.6:0/3209097427 shutdown_connections 2023-10-06T02:18:50.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.271+0000 7f94e11fb700 1 -- 172.21.15.6:0/3209097427 wait complete. 2023-10-06T02:18:50.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.272+0000 7f94e11fb700 1 Processor -- start 2023-10-06T02:18:50.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.272+0000 7f94e11fb700 1 -- start start 2023-10-06T02:18:50.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.273+0000 7f94e11fb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94dc0cf1a0 0x7f94dc0ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:50.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.273+0000 7f94e11fb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94dc159400 0x7f94dc0c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.273+0000 7f94e11fb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94dc1597d0 0x7f94dc0c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.273+0000 7f94e11fb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc0c9840 con 0x7f94dc159400 2023-10-06T02:18:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.273+0000 7f94e11fb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc0c9b20 con 0x7f94dc0cf1a0 2023-10-06T02:18:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.273+0000 7f94e11fb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc0c9e00 con 0x7f94dc1597d0 2023-10-06T02:18:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.273+0000 7f94db7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94dc159400 0x7f94dc0c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.273+0000 7f94db7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94dc159400 0x7f94dc0c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41588/0 (socket says 172.21.15.6:41588) 2023-10-06T02:18:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.273+0000 7f94db7fe700 1 -- 172.21.15.6:0/3658787957 learned_addr learned my addr 172.21.15.6:0/3658787957 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.273+0000 7f94dbfff700 1 --2- 172.21.15.6:0/3658787957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94dc0cf1a0 0x7f94dc0ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.273+0000 7f94e09fa700 1 --2- 172.21.15.6:0/3658787957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94dc1597d0 0x7f94dc0c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.273+0000 7f94db7fe700 1 -- 172.21.15.6:0/3658787957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94dc1597d0 msgr2=0x7f94dc0c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.273+0000 7f94db7fe700 1 --2- 172.21.15.6:0/3658787957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94dc1597d0 0x7f94dc0c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.273+0000 7f94db7fe700 1 -- 172.21.15.6:0/3658787957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94dc0cf1a0 msgr2=0x7f94dc0ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.273+0000 7f94db7fe700 1 --2- 172.21.15.6:0/3658787957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94dc0cf1a0 0x7f94dc0ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.273+0000 7f94db7fe700 1 -- 172.21.15.6:0/3658787957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d4009a20 con 0x7f94dc159400 2023-10-06T02:18:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.273+0000 7f94db7fe700 1 --2- 172.21.15.6:0/3658787957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94dc159400 0x7f94dc0c8cf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0cfb10 tx=0x7f94cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.274+0000 7f94d3fff700 1 -- 172.21.15.6:0/3658787957 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc01bc40 con 0x7f94dc159400 2023-10-06T02:18:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.274+0000 7f94d3fff700 1 -- 172.21.15.6:0/3658787957 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc01bde0 con 0x7f94dc159400 2023-10-06T02:18:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.274+0000 7f94e11fb700 1 -- 172.21.15.6:0/3658787957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94cc009420 con 0x7f94dc159400 2023-10-06T02:18:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.274+0000 7f94d3fff700 1 -- 172.21.15.6:0/3658787957 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc011670 con 0x7f94dc159400 2023-10-06T02:18:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.274+0000 7f94e11fb700 1 -- 172.21.15.6:0/3658787957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94dc0ca3c0 con 0x7f94dc159400 2023-10-06T02:18:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.275+0000 7f94e11fb700 1 -- 172.21.15.6:0/3658787957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94dc0ca5b0 con 0x7f94dc159400 2023-10-06T02:18:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.275+0000 7f94d3fff700 1 -- 172.21.15.6:0/3658787957 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f94cc0119e0 con 0x7f94dc159400 2023-10-06T02:18:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.275+0000 7f94d3fff700 1 --2- 172.21.15.6:0/3658787957 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f94bc066f30 0x7f94bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.276+0000 7f94d3fff700 1 -- 172.21.15.6:0/3658787957 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f94cc085d60 con 0x7f94dc159400 2023-10-06T02:18:50.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.276+0000 7f94dbfff700 1 --2- 172.21.15.6:0/3658787957 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f94bc066f30 0x7f94bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:50.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.276+0000 7f94dbfff700 1 --2- 172.21.15.6:0/3658787957 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f94bc066f30 0x7f94bc0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f94c4005920 tx=0x7f94c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:50.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.280+0000 7f94d3fff700 1 -- 172.21.15.6:0/3658787957 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94cc052d30 con 0x7f94dc159400 2023-10-06T02:18:50.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.467+0000 7f94e11fb700 1 -- 172.21.15.6:0/3658787957 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94dc0b3290 con 0x7f94bc066f30 2023-10-06T02:18:50.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.476+0000 7f94d3fff700 1 -- 172.21.15.6:0/3658787957 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308652 (secure 0 0 0) 0x7f94c400f6b0 con 0x7f94bc066f30 2023-10-06T02:18:50.480 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:50.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.479+0000 7f94e11fb700 1 -- 172.21.15.6:0/3658787957 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f94bc066f30 msgr2=0x7f94bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:50.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.479+0000 7f94e11fb700 1 --2- 172.21.15.6:0/3658787957 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f94bc066f30 0x7f94bc0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f94c4005920 tx=0x7f94c4009040 comp rx=0 tx=0).stop 2023-10-06T02:18:50.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.479+0000 7f94e11fb700 1 -- 172.21.15.6:0/3658787957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94dc159400 msgr2=0x7f94dc0c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:50.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.479+0000 7f94e11fb700 1 --2- 172.21.15.6:0/3658787957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94dc159400 0x7f94dc0c8cf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0cfb10 tx=0x7f94cc017000 comp rx=0 tx=0).stop 2023-10-06T02:18:50.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.479+0000 7f94e11fb700 1 -- 172.21.15.6:0/3658787957 shutdown_connections 2023-10-06T02:18:50.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.479+0000 7f94e11fb700 1 --2- 172.21.15.6:0/3658787957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94dc1597d0 0x7f94dc0c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.479+0000 7f94e11fb700 1 --2- 172.21.15.6:0/3658787957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94dc0cf1a0 0x7f94dc0ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.479+0000 7f94e11fb700 1 --2- 172.21.15.6:0/3658787957 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f94bc066f30 0x7f94bc0693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.479+0000 7f94e11fb700 1 --2- 172.21.15.6:0/3658787957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94dc159400 0x7f94dc0c8cf0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.479+0000 7f94e11fb700 1 -- 172.21.15.6:0/3658787957 >> 172.21.15.6:0/3658787957 conn(0x7f94dc06ac10 msgr2=0x7f94dc0ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:50.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.479+0000 7f94e11fb700 1 -- 172.21.15.6:0/3658787957 shutdown_connections 2023-10-06T02:18:50.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.479+0000 7f94e11fb700 1 -- 172.21.15.6:0/3658787957 wait complete. 2023-10-06T02:18:50.483 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:18:50.491 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-10-06T02:18:48.574986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382756,"kb_used_data":4452,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591964,"statfs":{"total":773094113280,"available":770654171136,"internally_reserved":0,"allocated":4558848,"data_stored":2661981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.636621"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945511+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:28.392538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944769+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:05.439978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944636+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:29.157909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943130+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:21.626772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948284+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:35.807016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.947652+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:29.157909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943079+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:48.223274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942462+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:46.909176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945753+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:24:04.544636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941502+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:46.273367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943070+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:35.807016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944911+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:06.549044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.940910+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:24.276483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943771+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:48.223274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944578+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:56.622088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.952047+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:02.754107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944112+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:56.622088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944528+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:32:43.479197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.947435+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:51.700768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941810+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:18.720086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944592+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:24.267409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941198+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:39.727976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944141+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:04.574891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943739+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:27.470110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.947581+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:40:12.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941643+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:41.962383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944089+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:38.289800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.949302+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:15.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945192+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:01.121797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.946062+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:24:36.091537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943411+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:20.287441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941280+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:40:12.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.947435+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:42.736759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.960473+0000","last_change":"2023-10-06T02:18:44.960473+0000","last_active":"2023-10-06T02:18:44.960473+0000","last_peered":"2023-10-06T02:18:44.960473+0000","last_clean":"2023-10-06T02:18:44.960473+0000","last_became_active":"2023-10-06T02:18:44.960009+0000","last_became_peered":"2023-10-06T02:18:44.960009+0000","last_unstale":"2023-10-06T02:18:44.960473+0000","last_undegraded":"2023-10-06T02:18:44.960473+0000","last_fullsized":"2023-10-06T02:18:44.960473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:20.624772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948588+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:18.720086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.958493+0000","last_change":"2023-10-06T02:18:44.958493+0000","last_active":"2023-10-06T02:18:44.958493+0000","last_peered":"2023-10-06T02:18:44.958493+0000","last_clean":"2023-10-06T02:18:44.958493+0000","last_became_active":"2023-10-06T02:18:44.958170+0000","last_became_peered":"2023-10-06T02:18:44.958170+0000","last_unstale":"2023-10-06T02:18:44.958493+0000","last_undegraded":"2023-10-06T02:18:44.958493+0000","last_fullsized":"2023-10-06T02:18:44.958493+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:27.390538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945528+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:21.626772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.961055+0000","last_change":"2023-10-06T02:18:44.961055+0000","last_active":"2023-10-06T02:18:44.961055+0000","last_peered":"2023-10-06T02:18:44.961055+0000","last_clean":"2023-10-06T02:18:44.961055+0000","last_became_active":"2023-10-06T02:18:44.960851+0000","last_became_peered":"2023-10-06T02:18:44.960851+0000","last_unstale":"2023-10-06T02:18:44.961055+0000","last_undegraded":"2023-10-06T02:18:44.961055+0000","last_fullsized":"2023-10-06T02:18:44.961055+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:47.153725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948023+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:47.458786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.959383+0000","last_change":"2023-10-06T02:18:44.959383+0000","last_active":"2023-10-06T02:18:44.959383+0000","last_peered":"2023-10-06T02:18:44.959383+0000","last_clean":"2023-10-06T02:18:44.959383+0000","last_became_active":"2023-10-06T02:18:44.959073+0000","last_became_peered":"2023-10-06T02:18:44.959073+0000","last_unstale":"2023-10-06T02:18:44.959383+0000","last_undegraded":"2023-10-06T02:18:44.959383+0000","last_fullsized":"2023-10-06T02:18:44.959383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:45.271368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943713+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:24.267409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.952220+0000","last_change":"2023-10-06T02:18:44.952220+0000","last_active":"2023-10-06T02:18:44.952220+0000","last_peered":"2023-10-06T02:18:44.952220+0000","last_clean":"2023-10-06T02:18:44.952220+0000","last_became_active":"2023-10-06T02:18:44.951937+0000","last_became_peered":"2023-10-06T02:18:44.951937+0000","last_unstale":"2023-10-06T02:18:44.952220+0000","last_undegraded":"2023-10-06T02:18:44.952220+0000","last_fullsized":"2023-10-06T02:18:44.952220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:27.390538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941714+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:49.872982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.952812+0000","last_change":"2023-10-06T02:18:44.952812+0000","last_active":"2023-10-06T02:18:44.952812+0000","last_peered":"2023-10-06T02:18:44.952812+0000","last_clean":"2023-10-06T02:18:44.952812+0000","last_became_active":"2023-10-06T02:18:44.952538+0000","last_became_peered":"2023-10-06T02:18:44.952538+0000","last_unstale":"2023-10-06T02:18:44.952812+0000","last_undegraded":"2023-10-06T02:18:44.952812+0000","last_fullsized":"2023-10-06T02:18:44.952812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:01.175622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941401+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:53:55.656192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.950586+0000","last_change":"2023-10-06T02:18:44.950586+0000","last_active":"2023-10-06T02:18:44.950586+0000","last_peered":"2023-10-06T02:18:44.950586+0000","last_clean":"2023-10-06T02:18:44.950586+0000","last_became_active":"2023-10-06T02:18:44.950322+0000","last_became_peered":"2023-10-06T02:18:44.950322+0000","last_unstale":"2023-10-06T02:18:44.950586+0000","last_undegraded":"2023-10-06T02:18:44.950586+0000","last_fullsized":"2023-10-06T02:18:44.950586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:48.870983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944664+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:16.197382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.952867+0000","last_change":"2023-10-06T02:18:44.952867+0000","last_active":"2023-10-06T02:18:44.952867+0000","last_peered":"2023-10-06T02:18:44.952867+0000","last_clean":"2023-10-06T02:18:44.952867+0000","last_became_active":"2023-10-06T02:18:44.952582+0000","last_became_peered":"2023-10-06T02:18:44.952582+0000","last_unstale":"2023-10-06T02:18:44.952867+0000","last_undegraded":"2023-10-06T02:18:44.952867+0000","last_fullsized":"2023-10-06T02:18:44.952867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:41.734760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943621+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:01.893468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.953410+0000","last_change":"2023-10-06T02:18:44.953410+0000","last_active":"2023-10-06T02:18:44.953410+0000","last_peered":"2023-10-06T02:18:44.953410+0000","last_clean":"2023-10-06T02:18:44.953410+0000","last_became_active":"2023-10-06T02:18:44.953098+0000","last_became_peered":"2023-10-06T02:18:44.953098+0000","last_unstale":"2023-10-06T02:18:44.953410+0000","last_undegraded":"2023-10-06T02:18:44.953410+0000","last_fullsized":"2023-10-06T02:18:44.953410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:19.285441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945037+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:15.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.958075+0000","last_change":"2023-10-06T02:18:44.958075+0000","last_active":"2023-10-06T02:18:44.958075+0000","last_peered":"2023-10-06T02:18:44.958075+0000","last_clean":"2023-10-06T02:18:44.958075+0000","last_became_active":"2023-10-06T02:18:44.953714+0000","last_became_peered":"2023-10-06T02:18:44.953714+0000","last_unstale":"2023-10-06T02:18:44.958075+0000","last_undegraded":"2023-10-06T02:18:44.958075+0000","last_fullsized":"2023-10-06T02:18:44.958075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:03.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944013+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:53.401386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.957227+0000","last_change":"2023-10-06T02:18:44.957227+0000","last_active":"2023-10-06T02:18:44.957227+0000","last_peered":"2023-10-06T02:18:44.957227+0000","last_clean":"2023-10-06T02:18:44.957227+0000","last_became_active":"2023-10-06T02:18:44.956968+0000","last_became_peered":"2023-10-06T02:18:44.956968+0000","last_unstale":"2023-10-06T02:18:44.957227+0000","last_undegraded":"2023-10-06T02:18:44.957227+0000","last_fullsized":"2023-10-06T02:18:44.957227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:48.870983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942957+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:21.626772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.950113+0000","last_change":"2023-10-06T02:18:44.950113+0000","last_active":"2023-10-06T02:18:44.950113+0000","last_peered":"2023-10-06T02:18:44.950113+0000","last_clean":"2023-10-06T02:18:44.950113+0000","last_became_active":"2023-10-06T02:18:44.949813+0000","last_became_peered":"2023-10-06T02:18:44.949813+0000","last_unstale":"2023-10-06T02:18:44.950113+0000","last_undegraded":"2023-10-06T02:18:44.950113+0000","last_fullsized":"2023-10-06T02:18:44.950113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:00.119797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.949186+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:49.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.949923+0000","last_change":"2023-10-06T02:18:44.949923+0000","last_active":"2023-10-06T02:18:44.949923+0000","last_peered":"2023-10-06T02:18:44.949923+0000","last_clean":"2023-10-06T02:18:44.949923+0000","last_became_active":"2023-10-06T02:18:44.948547+0000","last_became_peered":"2023-10-06T02:18:44.948547+0000","last_unstale":"2023-10-06T02:18:44.949923+0000","last_undegraded":"2023-10-06T02:18:44.949923+0000","last_fullsized":"2023-10-06T02:18:44.949923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:05.547045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942567+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:06.549044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.954535+0000","last_change":"2023-10-06T02:18:44.954535+0000","last_active":"2023-10-06T02:18:44.954535+0000","last_peered":"2023-10-06T02:18:44.954535+0000","last_clean":"2023-10-06T02:18:44.954535+0000","last_became_active":"2023-10-06T02:18:44.954254+0000","last_became_peered":"2023-10-06T02:18:44.954254+0000","last_unstale":"2023-10-06T02:18:44.954535+0000","last_undegraded":"2023-10-06T02:18:44.954535+0000","last_fullsized":"2023-10-06T02:18:44.954535+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:45.907176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943273+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:02.177622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.949330+0000","last_change":"2023-10-06T02:18:44.949330+0000","last_active":"2023-10-06T02:18:44.949330+0000","last_peered":"2023-10-06T02:18:44.949330+0000","last_clean":"2023-10-06T02:18:44.949330+0000","last_became_active":"2023-10-06T02:18:44.949068+0000","last_became_peered":"2023-10-06T02:18:44.949068+0000","last_unstale":"2023-10-06T02:18:44.949330+0000","last_undegraded":"2023-10-06T02:18:44.949330+0000","last_fullsized":"2023-10-06T02:18:44.949330+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:04.437978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942617+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:35.807016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.953429+0000","last_change":"2023-10-06T02:18:44.953429+0000","last_active":"2023-10-06T02:18:44.953429+0000","last_peered":"2023-10-06T02:18:44.953429+0000","last_clean":"2023-10-06T02:18:44.953429+0000","last_became_active":"2023-10-06T02:18:44.953157+0000","last_became_peered":"2023-10-06T02:18:44.953157+0000","last_unstale":"2023-10-06T02:18:44.953429+0000","last_undegraded":"2023-10-06T02:18:44.953429+0000","last_fullsized":"2023-10-06T02:18:44.953429+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:16.468803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.940987+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:51.700768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.949507+0000","last_change":"2023-10-06T02:18:44.949507+0000","last_active":"2023-10-06T02:18:44.949507+0000","last_peered":"2023-10-06T02:18:44.949507+0000","last_clean":"2023-10-06T02:18:44.949507+0000","last_became_active":"2023-10-06T02:18:44.949197+0000","last_became_peered":"2023-10-06T02:18:44.949197+0000","last_unstale":"2023-10-06T02:18:44.949507+0000","last_undegraded":"2023-10-06T02:18:44.949507+0000","last_fullsized":"2023-10-06T02:18:44.949507+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:15.195382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.940558+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:56.408624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.958383+0000","last_change":"2023-10-06T02:18:44.958383+0000","last_active":"2023-10-06T02:18:44.958383+0000","last_peered":"2023-10-06T02:18:44.958383+0000","last_clean":"2023-10-06T02:18:44.958383+0000","last_became_active":"2023-10-06T02:18:44.957808+0000","last_became_peered":"2023-10-06T02:18:44.957808+0000","last_unstale":"2023-10-06T02:18:44.958383+0000","last_undegraded":"2023-10-06T02:18:44.958383+0000","last_fullsized":"2023-10-06T02:18:44.958383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:11.173858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.946317+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:26.609252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.957231+0000","last_change":"2023-10-06T02:18:44.957231+0000","last_active":"2023-10-06T02:18:44.957231+0000","last_peered":"2023-10-06T02:18:44.957231+0000","last_clean":"2023-10-06T02:18:44.957231+0000","last_became_active":"2023-10-06T02:18:44.955723+0000","last_became_peered":"2023-10-06T02:18:44.955723+0000","last_unstale":"2023-10-06T02:18:44.957231+0000","last_undegraded":"2023-10-06T02:18:44.957231+0000","last_fullsized":"2023-10-06T02:18:44.957231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:45.907176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.946928+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:24.276483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.957249+0000","last_change":"2023-10-06T02:18:44.957249+0000","last_active":"2023-10-06T02:18:44.957249+0000","last_peered":"2023-10-06T02:18:44.957249+0000","last_clean":"2023-10-06T02:18:44.957249+0000","last_became_active":"2023-10-06T02:18:44.956928+0000","last_became_peered":"2023-10-06T02:18:44.956928+0000","last_unstale":"2023-10-06T02:18:44.957249+0000","last_undegraded":"2023-10-06T02:18:44.957249+0000","last_fullsized":"2023-10-06T02:18:44.957249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:34.805017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945196+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:38.289800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.960417+0000","last_change":"2023-10-06T02:18:44.960417+0000","last_active":"2023-10-06T02:18:44.960417+0000","last_peered":"2023-10-06T02:18:44.960417+0000","last_clean":"2023-10-06T02:18:44.960417+0000","last_became_active":"2023-10-06T02:18:44.960095+0000","last_became_peered":"2023-10-06T02:18:44.960095+0000","last_unstale":"2023-10-06T02:18:44.960417+0000","last_undegraded":"2023-10-06T02:18:44.960417+0000","last_fullsized":"2023-10-06T02:18:44.960417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:14.146477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945264+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:17.470803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.955211+0000","last_change":"2023-10-06T02:18:44.955211+0000","last_active":"2023-10-06T02:18:44.955211+0000","last_peered":"2023-10-06T02:18:44.955211+0000","last_clean":"2023-10-06T02:18:44.955211+0000","last_became_active":"2023-10-06T02:18:44.954949+0000","last_became_peered":"2023-10-06T02:18:44.954949+0000","last_unstale":"2023-10-06T02:18:44.955211+0000","last_undegraded":"2023-10-06T02:18:44.955211+0000","last_fullsized":"2023-10-06T02:18:44.955211+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:45.271368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942658+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:49.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.956467+0000","last_change":"2023-10-06T02:18:44.956467+0000","last_active":"2023-10-06T02:18:44.956467+0000","last_peered":"2023-10-06T02:18:44.956467+0000","last_clean":"2023-10-06T02:18:44.956467+0000","last_became_active":"2023-10-06T02:18:44.956221+0000","last_became_peered":"2023-10-06T02:18:44.956221+0000","last_unstale":"2023-10-06T02:18:44.956467+0000","last_undegraded":"2023-10-06T02:18:44.956467+0000","last_fullsized":"2023-10-06T02:18:44.956467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:20.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941761+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:22.904890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.955172+0000","last_change":"2023-10-06T02:18:44.955172+0000","last_active":"2023-10-06T02:18:44.955172+0000","last_peered":"2023-10-06T02:18:44.955172+0000","last_clean":"2023-10-06T02:18:44.955172+0000","last_became_active":"2023-10-06T02:18:44.954905+0000","last_became_peered":"2023-10-06T02:18:44.954905+0000","last_unstale":"2023-10-06T02:18:44.955172+0000","last_undegraded":"2023-10-06T02:18:44.955172+0000","last_fullsized":"2023-10-06T02:18:44.955172+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:21.902890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943679+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:06.448305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.954645+0000","last_change":"2023-10-06T02:18:44.954645+0000","last_active":"2023-10-06T02:18:44.954645+0000","last_peered":"2023-10-06T02:18:44.954645+0000","last_clean":"2023-10-06T02:18:44.954645+0000","last_became_active":"2023-10-06T02:18:44.954349+0000","last_became_peered":"2023-10-06T02:18:44.954349+0000","last_unstale":"2023-10-06T02:18:44.954645+0000","last_undegraded":"2023-10-06T02:18:44.954645+0000","last_fullsized":"2023-10-06T02:18:44.954645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:14.432297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.942284+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:18:43.942284+0000","last_peered":"2023-10-06T02:18:43.942284+0000","last_clean":"2023-10-06T02:18:43.942284+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:18:43.942284+0000","last_undegraded":"2023-10-06T02:18:43.942284+0000","last_fullsized":"2023-10-06T02:18:43.942284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944275+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:01.893468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.956366+0000","last_change":"2023-10-06T02:18:44.956366+0000","last_active":"2023-10-06T02:18:44.956366+0000","last_peered":"2023-10-06T02:18:44.956366+0000","last_clean":"2023-10-06T02:18:44.956366+0000","last_became_active":"2023-10-06T02:18:44.956094+0000","last_became_peered":"2023-10-06T02:18:44.956094+0000","last_unstale":"2023-10-06T02:18:44.956366+0000","last_undegraded":"2023-10-06T02:18:44.956366+0000","last_fullsized":"2023-10-06T02:18:44.956366+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:53:54.654193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.936641+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:18:43.936641+0000","last_peered":"2023-10-06T02:18:43.936641+0000","last_clean":"2023-10-06T02:18:43.936641+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:18:43.936641+0000","last_undegraded":"2023-10-06T02:18:43.936641+0000","last_fullsized":"2023-10-06T02:18:43.936641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942393+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:06.549044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.960597+0000","last_change":"2023-10-06T02:18:44.960597+0000","last_active":"2023-10-06T02:18:44.960597+0000","last_peered":"2023-10-06T02:18:44.960597+0000","last_clean":"2023-10-06T02:18:44.960597+0000","last_became_active":"2023-10-06T02:18:44.960378+0000","last_became_peered":"2023-10-06T02:18:44.960378+0000","last_unstale":"2023-10-06T02:18:44.960597+0000","last_undegraded":"2023-10-06T02:18:44.960597+0000","last_fullsized":"2023-10-06T02:18:44.960597+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:20.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.947295+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:18:43.947295+0000","last_peered":"2023-10-06T02:18:43.947295+0000","last_clean":"2023-10-06T02:18:43.947295+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:18:43.947295+0000","last_undegraded":"2023-10-06T02:18:43.947295+0000","last_fullsized":"2023-10-06T02:18:43.947295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.944083+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:18:43.944083+0000","last_peered":"2023-10-06T02:18:43.944083+0000","last_clean":"2023-10-06T02:18:43.944083+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:18:43.944083+0000","last_undegraded":"2023-10-06T02:18:43.944083+0000","last_fullsized":"2023-10-06T02:18:43.944083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942584+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:05.439978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.956914+0000","last_change":"2023-10-06T02:18:44.956914+0000","last_active":"2023-10-06T02:18:44.956914+0000","last_peered":"2023-10-06T02:18:44.956914+0000","last_clean":"2023-10-06T02:18:44.956914+0000","last_became_active":"2023-10-06T02:18:44.956611+0000","last_became_peered":"2023-10-06T02:18:44.956611+0000","last_unstale":"2023-10-06T02:18:44.956914+0000","last_undegraded":"2023-10-06T02:18:44.956914+0000","last_fullsized":"2023-10-06T02:18:44.956914+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:38.725977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.944020+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:18:43.944020+0000","last_peered":"2023-10-06T02:18:43.944020+0000","last_clean":"2023-10-06T02:18:43.944020+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:18:43.944020+0000","last_undegraded":"2023-10-06T02:18:43.944020+0000","last_fullsized":"2023-10-06T02:18:43.944020+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.940576+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:30.646258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.957887+0000","last_change":"2023-10-06T02:18:44.957887+0000","last_active":"2023-10-06T02:18:44.957887+0000","last_peered":"2023-10-06T02:18:44.957887+0000","last_clean":"2023-10-06T02:18:44.957887+0000","last_became_active":"2023-10-06T02:18:44.955744+0000","last_became_peered":"2023-10-06T02:18:44.955744+0000","last_unstale":"2023-10-06T02:18:44.957887+0000","last_undegraded":"2023-10-06T02:18:44.957887+0000","last_fullsized":"2023-10-06T02:18:44.957887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:21.902890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.943977+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:18:43.943977+0000","last_peered":"2023-10-06T02:18:43.943977+0000","last_clean":"2023-10-06T02:18:43.943977+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:18:43.943977+0000","last_undegraded":"2023-10-06T02:18:43.943977+0000","last_fullsized":"2023-10-06T02:18:43.943977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948115+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:41.962383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.948994+0000","last_change":"2023-10-06T02:18:44.948994+0000","last_active":"2023-10-06T02:18:44.948994+0000","last_peered":"2023-10-06T02:18:44.948994+0000","last_clean":"2023-10-06T02:18:44.948994+0000","last_became_active":"2023-10-06T02:18:44.948536+0000","last_became_peered":"2023-10-06T02:18:44.948536+0000","last_unstale":"2023-10-06T02:18:44.948994+0000","last_undegraded":"2023-10-06T02:18:44.948994+0000","last_fullsized":"2023-10-06T02:18:44.948994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:47.221274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.945442+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:18:43.945442+0000","last_peered":"2023-10-06T02:18:43.945442+0000","last_clean":"2023-10-06T02:18:43.945442+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:18:43.945442+0000","last_undegraded":"2023-10-06T02:18:43.945442+0000","last_fullsized":"2023-10-06T02:18:43.945442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948403+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:48.223274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.961435+0000","last_change":"2023-10-06T02:18:44.961435+0000","last_active":"2023-10-06T02:18:44.961435+0000","last_peered":"2023-10-06T02:18:44.961435+0000","last_clean":"2023-10-06T02:18:44.961435+0000","last_became_active":"2023-10-06T02:18:44.961289+0000","last_became_peered":"2023-10-06T02:18:44.961289+0000","last_unstale":"2023-10-06T02:18:44.961435+0000","last_undegraded":"2023-10-06T02:18:44.961435+0000","last_fullsized":"2023-10-06T02:18:44.961435+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:01.752107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.941552+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:18:43.941552+0000","last_peered":"2023-10-06T02:18:43.941552+0000","last_clean":"2023-10-06T02:18:43.941552+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:18:43.941552+0000","last_undegraded":"2023-10-06T02:18:43.941552+0000","last_fullsized":"2023-10-06T02:18:43.941552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943232+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:53.401386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.958969+0000","last_change":"2023-10-06T02:18:44.958969+0000","last_active":"2023-10-06T02:18:44.958969+0000","last_peered":"2023-10-06T02:18:44.958969+0000","last_clean":"2023-10-06T02:18:44.958969+0000","last_became_active":"2023-10-06T02:18:44.958782+0000","last_became_peered":"2023-10-06T02:18:44.958782+0000","last_unstale":"2023-10-06T02:18:44.958969+0000","last_undegraded":"2023-10-06T02:18:44.958969+0000","last_fullsized":"2023-10-06T02:18:44.958969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:47.153725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.941741+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:18:43.941741+0000","last_peered":"2023-10-06T02:18:43.941741+0000","last_clean":"2023-10-06T02:18:43.941741+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:18:43.941741+0000","last_undegraded":"2023-10-06T02:18:43.941741+0000","last_fullsized":"2023-10-06T02:18:43.941741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298284,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073556,"statfs":{"total":96636764160,"available":96331321344,"internally_reserved":0,"allocated":1019904,"data_stored":777613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.58799999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.45200000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.499}]},{"osd":6,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.621}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":421888,"data_stored":186292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":5.6929999999999996,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":5.7060000000000004,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.628}]},{"osd":2,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":8.8659999999999997,"5min":8.8659999999999997,"15min":8.8659999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":10.659000000000001,"5min":10.659000000000001,"15min":10.659000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65400000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.748},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.80500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298268,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073572,"statfs":{"total":96636764160,"available":96331337728,"internally_reserved":0,"allocated":1003520,"data_stored":769732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.34300000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.33500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.30299999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51800000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":187245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.377,"5min":0.377,"15min":0.377},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.376,"5min":0.376,"15min":0.376},"last":0.30199999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.377}]},{"osd":4,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.70099999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":11.138,"5min":11.138,"15min":11.138},"last":0.625},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":421888,"data_stored":186292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.31900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.373}]},{"osd":3,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.46899999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48399999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.44800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":187245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.311}]},{"osd":4,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.52100000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.57699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":187245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":17.879999999999999,"5min":17.879999999999999,"15min":17.879999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":18.010999999999999,"5min":18.010999999999999,"15min":18.010999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.49299999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.624},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":180317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.59999999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.436}]},{"osd":6,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.628}]},{"osd":7,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.503},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:18:50.498 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:18:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.651+0000 7f4a3ffb6700 1 Processor -- start 2023-10-06T02:18:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.651+0000 7f4a3ffb6700 1 -- start start 2023-10-06T02:18:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.652+0000 7f4a3ffb6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a380af250 0x7f4a380ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.652+0000 7f4a3ffb6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4a380af620 0x7f4a380cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.652+0000 7f4a3ffb6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a38069550 con 0x7f4a380c9f40 2023-10-06T02:18:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.652+0000 7f4a3ffb6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a380adb30 con 0x7f4a380af620 2023-10-06T02:18:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.652+0000 7f4a3ffb6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a380add80 con 0x7f4a380af250 2023-10-06T02:18:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.652+0000 7f4a3d551700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4a380c9f40 0x7f4a380ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47746/0 (socket says 172.21.15.6:47746) 2023-10-06T02:18:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.652+0000 7f4a3d551700 1 -- 172.21.15.6:0/270327056 learned_addr learned my addr 172.21.15.6:0/270327056 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3e553700 1 --2- 172.21.15.6:0/270327056 >> v2:172.21.15.175:3300/0 conn(0x7f4a380af620 0x7f4a380cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3dd52700 1 --2- 172.21.15.6:0/270327056 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a380af250 0x7f4a380ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3cd50700 1 -- 172.21.15.6:0/270327056 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602558002 0 0) 0x7f4a38069550 con 0x7f4a380c9f40 2023-10-06T02:18:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3cd50700 1 -- 172.21.15.6:0/270327056 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a20003570 con 0x7f4a380c9f40 2023-10-06T02:18:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3cd50700 1 -- 172.21.15.6:0/270327056 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 378778879 0 0) 0x7f4a20003570 con 0x7f4a380c9f40 2023-10-06T02:18:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3cd50700 1 -- 172.21.15.6:0/270327056 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a380af250 msgr2=0x7f4a380ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3cd50700 1 --2- 172.21.15.6:0/270327056 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a380af250 0x7f4a380ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3cd50700 1 -- 172.21.15.6:0/270327056 >> v2:172.21.15.175:3300/0 conn(0x7f4a380af620 msgr2=0x7f4a380cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3cd50700 1 --2- 172.21.15.6:0/270327056 >> v2:172.21.15.175:3300/0 conn(0x7f4a380af620 0x7f4a380cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3cd50700 1 -- 172.21.15.6:0/270327056 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a380ae060 con 0x7f4a380c9f40 2023-10-06T02:18:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3cd50700 1 -- 172.21.15.6:0/270327056 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f4a2c001470 con 0x7f4a380c9f40 2023-10-06T02:18:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3cd50700 1 -- 172.21.15.6:0/270327056 >> v1:172.21.15.6:6789/0 conn(0x7f4a380c9f40 legacy=0x7f4a380ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3cd50700 1 --2- 172.21.15.6:0/270327056 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a380af250 0x7f4a20003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3cd50700 1 --2- 172.21.15.6:0/270327056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a20003fe0 0x7f4a20004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3cd50700 1 --2- 172.21.15.6:0/270327056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a20004d50 0x7f4a200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3cd50700 1 -- 172.21.15.6:0/270327056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a380adb30 con 0x7f4a20004d50 2023-10-06T02:18:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3cd50700 1 -- 172.21.15.6:0/270327056 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a380add80 con 0x7f4a20003fe0 2023-10-06T02:18:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3cd50700 1 -- 172.21.15.6:0/270327056 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2000ba90 con 0x7f4a380af250 2023-10-06T02:18:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3e553700 1 --2- 172.21.15.6:0/270327056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a20004d50 0x7f4a200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3dd52700 1 --2- 172.21.15.6:0/270327056 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a380af250 0x7f4a20003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3d551700 1 --2- 172.21.15.6:0/270327056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a20003fe0 0x7f4a20004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3e553700 1 -- 172.21.15.6:0/270327056 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a380af250 msgr2=0x7f4a20003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3e553700 1 --2- 172.21.15.6:0/270327056 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a380af250 0x7f4a20003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3e553700 1 -- 172.21.15.6:0/270327056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a20003fe0 msgr2=0x7f4a20004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3e553700 1 --2- 172.21.15.6:0/270327056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a20003fe0 0x7f4a20004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3e553700 1 -- 172.21.15.6:0/270327056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a20003570 con 0x7f4a20004d50 2023-10-06T02:18:50.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.653+0000 7f4a3d551700 1 --2- 172.21.15.6:0/270327056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a20003fe0 0x7f4a20004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:50.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.654+0000 7f4a3e553700 1 --2- 172.21.15.6:0/270327056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a20004d50 0x7f4a200051c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800e210 tx=0x7f4a2800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2844ab4ac7bb029 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:50.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.654+0000 7f4a3cd50700 1 -- 172.21.15.6:0/270327056 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800ea60 con 0x7f4a20004d50 2023-10-06T02:18:50.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.654+0000 7f4a3cd50700 1 -- 172.21.15.6:0/270327056 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2800f040 con 0x7f4a20004d50 2023-10-06T02:18:50.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.654+0000 7f4a3cd50700 1 -- 172.21.15.6:0/270327056 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800ee10 con 0x7f4a20004d50 2023-10-06T02:18:50.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.654+0000 7f4a3ffb6700 1 -- 172.21.15.6:0/270327056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a20004d50 msgr2=0x7f4a200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:50.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.654+0000 7f4a3ffb6700 1 --2- 172.21.15.6:0/270327056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a20004d50 0x7f4a200051c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800e210 tx=0x7f4a2800b040 comp rx=0 tx=0).stop 2023-10-06T02:18:50.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.654+0000 7f4a3e553700 1 -- 172.21.15.6:0/270327056 reap_dead start 2023-10-06T02:18:50.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.654+0000 7f4a3ffb6700 1 -- 172.21.15.6:0/270327056 shutdown_connections 2023-10-06T02:18:50.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.654+0000 7f4a3ffb6700 1 -- 172.21.15.6:0/270327056 >> 172.21.15.6:0/270327056 conn(0x7f4a38069790 msgr2=0x7f4a38069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:50.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.654+0000 7f4a3ffb6700 1 -- 172.21.15.6:0/270327056 shutdown_connections 2023-10-06T02:18:50.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.654+0000 7f4a3ffb6700 1 -- 172.21.15.6:0/270327056 wait complete. 2023-10-06T02:18:50.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.655+0000 7f4a3ffb6700 1 Processor -- start 2023-10-06T02:18:50.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.655+0000 7f4a3ffb6700 1 -- start start 2023-10-06T02:18:50.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.656+0000 7f4a3ffb6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a3814dfb0 0x7f4a38156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:50.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.656+0000 7f4a3ffb6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a380c2a60 0x7f4a3815c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:50.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.656+0000 7f4a3ffb6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a380c3b40 0x7f4a3815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:50.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.656+0000 7f4a3ffb6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3814e380 con 0x7f4a3814dfb0 2023-10-06T02:18:50.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.656+0000 7f4a3ffb6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a381571f0 con 0x7f4a380c3b40 2023-10-06T02:18:50.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.656+0000 7f4a3ffb6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a380c25d0 con 0x7f4a380c2a60 2023-10-06T02:18:50.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.656+0000 7f4a3dd52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a3814dfb0 0x7f4a38156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:50.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.656+0000 7f4a3dd52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a3814dfb0 0x7f4a38156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41606/0 (socket says 172.21.15.6:41606) 2023-10-06T02:18:50.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.656+0000 7f4a3dd52700 1 -- 172.21.15.6:0/3106263997 learned_addr learned my addr 172.21.15.6:0/3106263997 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:50.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.657+0000 7f4a3dd52700 1 -- 172.21.15.6:0/3106263997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a380c2a60 msgr2=0x7f4a3815c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:50.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.657+0000 7f4a3dd52700 1 --2- 172.21.15.6:0/3106263997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a380c2a60 0x7f4a3815c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.657+0000 7f4a3dd52700 1 -- 172.21.15.6:0/3106263997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a380c3b40 msgr2=0x7f4a3815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:50.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.657+0000 7f4a3dd52700 1 --2- 172.21.15.6:0/3106263997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a380c3b40 0x7f4a3815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.657+0000 7f4a3dd52700 1 -- 172.21.15.6:0/3106263997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a38156f10 con 0x7f4a3814dfb0 2023-10-06T02:18:50.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.657+0000 7f4a3dd52700 1 --2- 172.21.15.6:0/3106263997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a3814dfb0 0x7f4a38156650 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4a30011b10 tx=0x7f4a300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:50.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.657+0000 7f4a35ffb700 1 -- 172.21.15.6:0/3106263997 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3000f9f0 con 0x7f4a3814dfb0 2023-10-06T02:18:50.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.657+0000 7f4a35ffb700 1 -- 172.21.15.6:0/3106263997 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3000fb50 con 0x7f4a3814dfb0 2023-10-06T02:18:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.657+0000 7f4a3ffb6700 1 -- 172.21.15.6:0/3106263997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a380c1f80 con 0x7f4a3814dfb0 2023-10-06T02:18:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.657+0000 7f4a35ffb700 1 -- 172.21.15.6:0/3106263997 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3000fed0 con 0x7f4a3814dfb0 2023-10-06T02:18:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.657+0000 7f4a3ffb6700 1 -- 172.21.15.6:0/3106263997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a38156b90 con 0x7f4a3814dfb0 2023-10-06T02:18:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.658+0000 7f4a3ffb6700 1 -- 172.21.15.6:0/3106263997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a380c1de0 con 0x7f4a3814dfb0 2023-10-06T02:18:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.659+0000 7f4a35ffb700 1 -- 172.21.15.6:0/3106263997 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a30014650 con 0x7f4a3814dfb0 2023-10-06T02:18:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.659+0000 7f4a35ffb700 1 --2- 172.21.15.6:0/3106263997 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4a24066f30 0x7f4a240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.659+0000 7f4a35ffb700 1 -- 172.21.15.6:0/3106263997 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4a30018030 con 0x7f4a3814dfb0 2023-10-06T02:18:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.659+0000 7f4a3d551700 1 --2- 172.21.15.6:0/3106263997 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4a24066f30 0x7f4a240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.660+0000 7f4a3d551700 1 --2- 172.21.15.6:0/3106263997 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4a24066f30 0x7f4a240693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c000e10 tx=0x7f4a380adc70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.663+0000 7f4a35ffb700 1 -- 172.21.15.6:0/3106263997 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a380c1de0 con 0x7f4a3814dfb0 2023-10-06T02:18:50.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.855+0000 7f4a3ffb6700 1 -- 172.21.15.6:0/3106263997 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4a380c1de0 con 0x7f4a24066f30 2023-10-06T02:18:50.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.864+0000 7f4a35ffb700 1 -- 172.21.15.6:0/3106263997 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308652 (secure 0 0 0) 0x7f4a380c1de0 con 0x7f4a24066f30 2023-10-06T02:18:50.867 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.867+0000 7f4a3ffb6700 1 -- 172.21.15.6:0/3106263997 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4a24066f30 msgr2=0x7f4a240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.867+0000 7f4a3ffb6700 1 --2- 172.21.15.6:0/3106263997 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4a24066f30 0x7f4a240693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c000e10 tx=0x7f4a380adc70 comp rx=0 tx=0).stop 2023-10-06T02:18:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.867+0000 7f4a3ffb6700 1 -- 172.21.15.6:0/3106263997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a3814dfb0 msgr2=0x7f4a38156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.867+0000 7f4a3ffb6700 1 --2- 172.21.15.6:0/3106263997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a3814dfb0 0x7f4a38156650 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4a30011b10 tx=0x7f4a300091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.867+0000 7f4a3ffb6700 1 -- 172.21.15.6:0/3106263997 shutdown_connections 2023-10-06T02:18:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.867+0000 7f4a3ffb6700 1 --2- 172.21.15.6:0/3106263997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a380c3b40 0x7f4a3815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.867+0000 7f4a3ffb6700 1 --2- 172.21.15.6:0/3106263997 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4a24066f30 0x7f4a240693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.867+0000 7f4a3ffb6700 1 --2- 172.21.15.6:0/3106263997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a3814dfb0 0x7f4a38156650 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.867+0000 7f4a3ffb6700 1 --2- 172.21.15.6:0/3106263997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a380c2a60 0x7f4a3815c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.867+0000 7f4a3ffb6700 1 -- 172.21.15.6:0/3106263997 >> 172.21.15.6:0/3106263997 conn(0x7f4a38069790 msgr2=0x7f4a380c6100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:50.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.867+0000 7f4a3ffb6700 1 -- 172.21.15.6:0/3106263997 shutdown_connections 2023-10-06T02:18:50.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:50.867+0000 7f4a3ffb6700 1 -- 172.21.15.6:0/3106263997 wait complete. 2023-10-06T02:18:50.871 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:18:50.879 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-10-06T02:18:50.575539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382756,"kb_used_data":4452,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591964,"statfs":{"total":773094113280,"available":770654171136,"internally_reserved":0,"allocated":4558848,"data_stored":2661981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001561"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945511+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:28.392538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944769+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:05.439978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944636+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:29.157909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943130+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:21.626772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948284+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:35.807016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.947652+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:29.157909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943079+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:48.223274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942462+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:46.909176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945753+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:24:04.544636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941502+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:46.273367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943070+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:35.807016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944911+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:06.549044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.940910+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:24.276483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943771+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:48.223274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944578+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:56.622088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.952047+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:02.754107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944112+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:56.622088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944528+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:32:43.479197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.947435+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:51.700768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941810+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:18.720086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944592+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:24.267409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941198+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:39.727976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944141+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:04.574891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943739+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:27.470110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.947581+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:40:12.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941643+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:41.962383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944089+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:38.289800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.949302+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:15.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945192+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:01.121797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.946062+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:24:36.091537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943411+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:20.287441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941280+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:40:12.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.947435+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:42.736759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.960473+0000","last_change":"2023-10-06T02:18:44.960473+0000","last_active":"2023-10-06T02:18:44.960473+0000","last_peered":"2023-10-06T02:18:44.960473+0000","last_clean":"2023-10-06T02:18:44.960473+0000","last_became_active":"2023-10-06T02:18:44.960009+0000","last_became_peered":"2023-10-06T02:18:44.960009+0000","last_unstale":"2023-10-06T02:18:44.960473+0000","last_undegraded":"2023-10-06T02:18:44.960473+0000","last_fullsized":"2023-10-06T02:18:44.960473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:20.624772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948588+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:18.720086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.958493+0000","last_change":"2023-10-06T02:18:44.958493+0000","last_active":"2023-10-06T02:18:44.958493+0000","last_peered":"2023-10-06T02:18:44.958493+0000","last_clean":"2023-10-06T02:18:44.958493+0000","last_became_active":"2023-10-06T02:18:44.958170+0000","last_became_peered":"2023-10-06T02:18:44.958170+0000","last_unstale":"2023-10-06T02:18:44.958493+0000","last_undegraded":"2023-10-06T02:18:44.958493+0000","last_fullsized":"2023-10-06T02:18:44.958493+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:27.390538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945528+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:21.626772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.961055+0000","last_change":"2023-10-06T02:18:44.961055+0000","last_active":"2023-10-06T02:18:44.961055+0000","last_peered":"2023-10-06T02:18:44.961055+0000","last_clean":"2023-10-06T02:18:44.961055+0000","last_became_active":"2023-10-06T02:18:44.960851+0000","last_became_peered":"2023-10-06T02:18:44.960851+0000","last_unstale":"2023-10-06T02:18:44.961055+0000","last_undegraded":"2023-10-06T02:18:44.961055+0000","last_fullsized":"2023-10-06T02:18:44.961055+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:47.153725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948023+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:47.458786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.959383+0000","last_change":"2023-10-06T02:18:44.959383+0000","last_active":"2023-10-06T02:18:44.959383+0000","last_peered":"2023-10-06T02:18:44.959383+0000","last_clean":"2023-10-06T02:18:44.959383+0000","last_became_active":"2023-10-06T02:18:44.959073+0000","last_became_peered":"2023-10-06T02:18:44.959073+0000","last_unstale":"2023-10-06T02:18:44.959383+0000","last_undegraded":"2023-10-06T02:18:44.959383+0000","last_fullsized":"2023-10-06T02:18:44.959383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:45.271368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943713+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:24.267409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.952220+0000","last_change":"2023-10-06T02:18:44.952220+0000","last_active":"2023-10-06T02:18:44.952220+0000","last_peered":"2023-10-06T02:18:44.952220+0000","last_clean":"2023-10-06T02:18:44.952220+0000","last_became_active":"2023-10-06T02:18:44.951937+0000","last_became_peered":"2023-10-06T02:18:44.951937+0000","last_unstale":"2023-10-06T02:18:44.952220+0000","last_undegraded":"2023-10-06T02:18:44.952220+0000","last_fullsized":"2023-10-06T02:18:44.952220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:27.390538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941714+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:49.872982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.952812+0000","last_change":"2023-10-06T02:18:44.952812+0000","last_active":"2023-10-06T02:18:44.952812+0000","last_peered":"2023-10-06T02:18:44.952812+0000","last_clean":"2023-10-06T02:18:44.952812+0000","last_became_active":"2023-10-06T02:18:44.952538+0000","last_became_peered":"2023-10-06T02:18:44.952538+0000","last_unstale":"2023-10-06T02:18:44.952812+0000","last_undegraded":"2023-10-06T02:18:44.952812+0000","last_fullsized":"2023-10-06T02:18:44.952812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:01.175622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941401+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:53:55.656192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.950586+0000","last_change":"2023-10-06T02:18:44.950586+0000","last_active":"2023-10-06T02:18:44.950586+0000","last_peered":"2023-10-06T02:18:44.950586+0000","last_clean":"2023-10-06T02:18:44.950586+0000","last_became_active":"2023-10-06T02:18:44.950322+0000","last_became_peered":"2023-10-06T02:18:44.950322+0000","last_unstale":"2023-10-06T02:18:44.950586+0000","last_undegraded":"2023-10-06T02:18:44.950586+0000","last_fullsized":"2023-10-06T02:18:44.950586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:48.870983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944664+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:16.197382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.952867+0000","last_change":"2023-10-06T02:18:44.952867+0000","last_active":"2023-10-06T02:18:44.952867+0000","last_peered":"2023-10-06T02:18:44.952867+0000","last_clean":"2023-10-06T02:18:44.952867+0000","last_became_active":"2023-10-06T02:18:44.952582+0000","last_became_peered":"2023-10-06T02:18:44.952582+0000","last_unstale":"2023-10-06T02:18:44.952867+0000","last_undegraded":"2023-10-06T02:18:44.952867+0000","last_fullsized":"2023-10-06T02:18:44.952867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:41.734760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943621+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:01.893468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.953410+0000","last_change":"2023-10-06T02:18:44.953410+0000","last_active":"2023-10-06T02:18:44.953410+0000","last_peered":"2023-10-06T02:18:44.953410+0000","last_clean":"2023-10-06T02:18:44.953410+0000","last_became_active":"2023-10-06T02:18:44.953098+0000","last_became_peered":"2023-10-06T02:18:44.953098+0000","last_unstale":"2023-10-06T02:18:44.953410+0000","last_undegraded":"2023-10-06T02:18:44.953410+0000","last_fullsized":"2023-10-06T02:18:44.953410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:19.285441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945037+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:15.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.958075+0000","last_change":"2023-10-06T02:18:44.958075+0000","last_active":"2023-10-06T02:18:44.958075+0000","last_peered":"2023-10-06T02:18:44.958075+0000","last_clean":"2023-10-06T02:18:44.958075+0000","last_became_active":"2023-10-06T02:18:44.953714+0000","last_became_peered":"2023-10-06T02:18:44.953714+0000","last_unstale":"2023-10-06T02:18:44.958075+0000","last_undegraded":"2023-10-06T02:18:44.958075+0000","last_fullsized":"2023-10-06T02:18:44.958075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:03.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944013+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:53.401386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.957227+0000","last_change":"2023-10-06T02:18:44.957227+0000","last_active":"2023-10-06T02:18:44.957227+0000","last_peered":"2023-10-06T02:18:44.957227+0000","last_clean":"2023-10-06T02:18:44.957227+0000","last_became_active":"2023-10-06T02:18:44.956968+0000","last_became_peered":"2023-10-06T02:18:44.956968+0000","last_unstale":"2023-10-06T02:18:44.957227+0000","last_undegraded":"2023-10-06T02:18:44.957227+0000","last_fullsized":"2023-10-06T02:18:44.957227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:48.870983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942957+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:21.626772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.950113+0000","last_change":"2023-10-06T02:18:44.950113+0000","last_active":"2023-10-06T02:18:44.950113+0000","last_peered":"2023-10-06T02:18:44.950113+0000","last_clean":"2023-10-06T02:18:44.950113+0000","last_became_active":"2023-10-06T02:18:44.949813+0000","last_became_peered":"2023-10-06T02:18:44.949813+0000","last_unstale":"2023-10-06T02:18:44.950113+0000","last_undegraded":"2023-10-06T02:18:44.950113+0000","last_fullsized":"2023-10-06T02:18:44.950113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:00.119797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.949186+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:49.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.949923+0000","last_change":"2023-10-06T02:18:44.949923+0000","last_active":"2023-10-06T02:18:44.949923+0000","last_peered":"2023-10-06T02:18:44.949923+0000","last_clean":"2023-10-06T02:18:44.949923+0000","last_became_active":"2023-10-06T02:18:44.948547+0000","last_became_peered":"2023-10-06T02:18:44.948547+0000","last_unstale":"2023-10-06T02:18:44.949923+0000","last_undegraded":"2023-10-06T02:18:44.949923+0000","last_fullsized":"2023-10-06T02:18:44.949923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:05.547045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942567+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:06.549044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.954535+0000","last_change":"2023-10-06T02:18:44.954535+0000","last_active":"2023-10-06T02:18:44.954535+0000","last_peered":"2023-10-06T02:18:44.954535+0000","last_clean":"2023-10-06T02:18:44.954535+0000","last_became_active":"2023-10-06T02:18:44.954254+0000","last_became_peered":"2023-10-06T02:18:44.954254+0000","last_unstale":"2023-10-06T02:18:44.954535+0000","last_undegraded":"2023-10-06T02:18:44.954535+0000","last_fullsized":"2023-10-06T02:18:44.954535+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:45.907176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943273+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:02.177622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.949330+0000","last_change":"2023-10-06T02:18:44.949330+0000","last_active":"2023-10-06T02:18:44.949330+0000","last_peered":"2023-10-06T02:18:44.949330+0000","last_clean":"2023-10-06T02:18:44.949330+0000","last_became_active":"2023-10-06T02:18:44.949068+0000","last_became_peered":"2023-10-06T02:18:44.949068+0000","last_unstale":"2023-10-06T02:18:44.949330+0000","last_undegraded":"2023-10-06T02:18:44.949330+0000","last_fullsized":"2023-10-06T02:18:44.949330+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:04.437978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942617+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:35.807016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.953429+0000","last_change":"2023-10-06T02:18:44.953429+0000","last_active":"2023-10-06T02:18:44.953429+0000","last_peered":"2023-10-06T02:18:44.953429+0000","last_clean":"2023-10-06T02:18:44.953429+0000","last_became_active":"2023-10-06T02:18:44.953157+0000","last_became_peered":"2023-10-06T02:18:44.953157+0000","last_unstale":"2023-10-06T02:18:44.953429+0000","last_undegraded":"2023-10-06T02:18:44.953429+0000","last_fullsized":"2023-10-06T02:18:44.953429+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:16.468803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.940987+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:51.700768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.949507+0000","last_change":"2023-10-06T02:18:44.949507+0000","last_active":"2023-10-06T02:18:44.949507+0000","last_peered":"2023-10-06T02:18:44.949507+0000","last_clean":"2023-10-06T02:18:44.949507+0000","last_became_active":"2023-10-06T02:18:44.949197+0000","last_became_peered":"2023-10-06T02:18:44.949197+0000","last_unstale":"2023-10-06T02:18:44.949507+0000","last_undegraded":"2023-10-06T02:18:44.949507+0000","last_fullsized":"2023-10-06T02:18:44.949507+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:15.195382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.940558+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:56.408624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.958383+0000","last_change":"2023-10-06T02:18:44.958383+0000","last_active":"2023-10-06T02:18:44.958383+0000","last_peered":"2023-10-06T02:18:44.958383+0000","last_clean":"2023-10-06T02:18:44.958383+0000","last_became_active":"2023-10-06T02:18:44.957808+0000","last_became_peered":"2023-10-06T02:18:44.957808+0000","last_unstale":"2023-10-06T02:18:44.958383+0000","last_undegraded":"2023-10-06T02:18:44.958383+0000","last_fullsized":"2023-10-06T02:18:44.958383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:11.173858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.946317+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:26.609252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.957231+0000","last_change":"2023-10-06T02:18:44.957231+0000","last_active":"2023-10-06T02:18:44.957231+0000","last_peered":"2023-10-06T02:18:44.957231+0000","last_clean":"2023-10-06T02:18:44.957231+0000","last_became_active":"2023-10-06T02:18:44.955723+0000","last_became_peered":"2023-10-06T02:18:44.955723+0000","last_unstale":"2023-10-06T02:18:44.957231+0000","last_undegraded":"2023-10-06T02:18:44.957231+0000","last_fullsized":"2023-10-06T02:18:44.957231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:45.907176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.946928+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:24.276483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.957249+0000","last_change":"2023-10-06T02:18:44.957249+0000","last_active":"2023-10-06T02:18:44.957249+0000","last_peered":"2023-10-06T02:18:44.957249+0000","last_clean":"2023-10-06T02:18:44.957249+0000","last_became_active":"2023-10-06T02:18:44.956928+0000","last_became_peered":"2023-10-06T02:18:44.956928+0000","last_unstale":"2023-10-06T02:18:44.957249+0000","last_undegraded":"2023-10-06T02:18:44.957249+0000","last_fullsized":"2023-10-06T02:18:44.957249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:34.805017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945196+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:38.289800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.960417+0000","last_change":"2023-10-06T02:18:44.960417+0000","last_active":"2023-10-06T02:18:44.960417+0000","last_peered":"2023-10-06T02:18:44.960417+0000","last_clean":"2023-10-06T02:18:44.960417+0000","last_became_active":"2023-10-06T02:18:44.960095+0000","last_became_peered":"2023-10-06T02:18:44.960095+0000","last_unstale":"2023-10-06T02:18:44.960417+0000","last_undegraded":"2023-10-06T02:18:44.960417+0000","last_fullsized":"2023-10-06T02:18:44.960417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:14.146477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945264+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:17.470803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.955211+0000","last_change":"2023-10-06T02:18:44.955211+0000","last_active":"2023-10-06T02:18:44.955211+0000","last_peered":"2023-10-06T02:18:44.955211+0000","last_clean":"2023-10-06T02:18:44.955211+0000","last_became_active":"2023-10-06T02:18:44.954949+0000","last_became_peered":"2023-10-06T02:18:44.954949+0000","last_unstale":"2023-10-06T02:18:44.955211+0000","last_undegraded":"2023-10-06T02:18:44.955211+0000","last_fullsized":"2023-10-06T02:18:44.955211+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:45.271368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942658+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:49.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.956467+0000","last_change":"2023-10-06T02:18:44.956467+0000","last_active":"2023-10-06T02:18:44.956467+0000","last_peered":"2023-10-06T02:18:44.956467+0000","last_clean":"2023-10-06T02:18:44.956467+0000","last_became_active":"2023-10-06T02:18:44.956221+0000","last_became_peered":"2023-10-06T02:18:44.956221+0000","last_unstale":"2023-10-06T02:18:44.956467+0000","last_undegraded":"2023-10-06T02:18:44.956467+0000","last_fullsized":"2023-10-06T02:18:44.956467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:20.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941761+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:22.904890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.955172+0000","last_change":"2023-10-06T02:18:44.955172+0000","last_active":"2023-10-06T02:18:44.955172+0000","last_peered":"2023-10-06T02:18:44.955172+0000","last_clean":"2023-10-06T02:18:44.955172+0000","last_became_active":"2023-10-06T02:18:44.954905+0000","last_became_peered":"2023-10-06T02:18:44.954905+0000","last_unstale":"2023-10-06T02:18:44.955172+0000","last_undegraded":"2023-10-06T02:18:44.955172+0000","last_fullsized":"2023-10-06T02:18:44.955172+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:21.902890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943679+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:06.448305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.954645+0000","last_change":"2023-10-06T02:18:44.954645+0000","last_active":"2023-10-06T02:18:44.954645+0000","last_peered":"2023-10-06T02:18:44.954645+0000","last_clean":"2023-10-06T02:18:44.954645+0000","last_became_active":"2023-10-06T02:18:44.954349+0000","last_became_peered":"2023-10-06T02:18:44.954349+0000","last_unstale":"2023-10-06T02:18:44.954645+0000","last_undegraded":"2023-10-06T02:18:44.954645+0000","last_fullsized":"2023-10-06T02:18:44.954645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:14.432297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.942284+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:18:43.942284+0000","last_peered":"2023-10-06T02:18:43.942284+0000","last_clean":"2023-10-06T02:18:43.942284+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:18:43.942284+0000","last_undegraded":"2023-10-06T02:18:43.942284+0000","last_fullsized":"2023-10-06T02:18:43.942284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944275+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:01.893468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.956366+0000","last_change":"2023-10-06T02:18:44.956366+0000","last_active":"2023-10-06T02:18:44.956366+0000","last_peered":"2023-10-06T02:18:44.956366+0000","last_clean":"2023-10-06T02:18:44.956366+0000","last_became_active":"2023-10-06T02:18:44.956094+0000","last_became_peered":"2023-10-06T02:18:44.956094+0000","last_unstale":"2023-10-06T02:18:44.956366+0000","last_undegraded":"2023-10-06T02:18:44.956366+0000","last_fullsized":"2023-10-06T02:18:44.956366+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:53:54.654193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.936641+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:18:43.936641+0000","last_peered":"2023-10-06T02:18:43.936641+0000","last_clean":"2023-10-06T02:18:43.936641+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:18:43.936641+0000","last_undegraded":"2023-10-06T02:18:43.936641+0000","last_fullsized":"2023-10-06T02:18:43.936641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942393+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:06.549044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.960597+0000","last_change":"2023-10-06T02:18:44.960597+0000","last_active":"2023-10-06T02:18:44.960597+0000","last_peered":"2023-10-06T02:18:44.960597+0000","last_clean":"2023-10-06T02:18:44.960597+0000","last_became_active":"2023-10-06T02:18:44.960378+0000","last_became_peered":"2023-10-06T02:18:44.960378+0000","last_unstale":"2023-10-06T02:18:44.960597+0000","last_undegraded":"2023-10-06T02:18:44.960597+0000","last_fullsized":"2023-10-06T02:18:44.960597+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:20.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.947295+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:18:43.947295+0000","last_peered":"2023-10-06T02:18:43.947295+0000","last_clean":"2023-10-06T02:18:43.947295+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:18:43.947295+0000","last_undegraded":"2023-10-06T02:18:43.947295+0000","last_fullsized":"2023-10-06T02:18:43.947295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.944083+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:18:43.944083+0000","last_peered":"2023-10-06T02:18:43.944083+0000","last_clean":"2023-10-06T02:18:43.944083+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:18:43.944083+0000","last_undegraded":"2023-10-06T02:18:43.944083+0000","last_fullsized":"2023-10-06T02:18:43.944083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942584+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:05.439978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.956914+0000","last_change":"2023-10-06T02:18:44.956914+0000","last_active":"2023-10-06T02:18:44.956914+0000","last_peered":"2023-10-06T02:18:44.956914+0000","last_clean":"2023-10-06T02:18:44.956914+0000","last_became_active":"2023-10-06T02:18:44.956611+0000","last_became_peered":"2023-10-06T02:18:44.956611+0000","last_unstale":"2023-10-06T02:18:44.956914+0000","last_undegraded":"2023-10-06T02:18:44.956914+0000","last_fullsized":"2023-10-06T02:18:44.956914+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:38.725977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.944020+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:18:43.944020+0000","last_peered":"2023-10-06T02:18:43.944020+0000","last_clean":"2023-10-06T02:18:43.944020+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:18:43.944020+0000","last_undegraded":"2023-10-06T02:18:43.944020+0000","last_fullsized":"2023-10-06T02:18:43.944020+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.940576+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:30.646258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.957887+0000","last_change":"2023-10-06T02:18:44.957887+0000","last_active":"2023-10-06T02:18:44.957887+0000","last_peered":"2023-10-06T02:18:44.957887+0000","last_clean":"2023-10-06T02:18:44.957887+0000","last_became_active":"2023-10-06T02:18:44.955744+0000","last_became_peered":"2023-10-06T02:18:44.955744+0000","last_unstale":"2023-10-06T02:18:44.957887+0000","last_undegraded":"2023-10-06T02:18:44.957887+0000","last_fullsized":"2023-10-06T02:18:44.957887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:21.902890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.943977+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:18:43.943977+0000","last_peered":"2023-10-06T02:18:43.943977+0000","last_clean":"2023-10-06T02:18:43.943977+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:18:43.943977+0000","last_undegraded":"2023-10-06T02:18:43.943977+0000","last_fullsized":"2023-10-06T02:18:43.943977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948115+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:41.962383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.948994+0000","last_change":"2023-10-06T02:18:44.948994+0000","last_active":"2023-10-06T02:18:44.948994+0000","last_peered":"2023-10-06T02:18:44.948994+0000","last_clean":"2023-10-06T02:18:44.948994+0000","last_became_active":"2023-10-06T02:18:44.948536+0000","last_became_peered":"2023-10-06T02:18:44.948536+0000","last_unstale":"2023-10-06T02:18:44.948994+0000","last_undegraded":"2023-10-06T02:18:44.948994+0000","last_fullsized":"2023-10-06T02:18:44.948994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:47.221274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.945442+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:18:43.945442+0000","last_peered":"2023-10-06T02:18:43.945442+0000","last_clean":"2023-10-06T02:18:43.945442+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:18:43.945442+0000","last_undegraded":"2023-10-06T02:18:43.945442+0000","last_fullsized":"2023-10-06T02:18:43.945442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948403+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:48.223274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.961435+0000","last_change":"2023-10-06T02:18:44.961435+0000","last_active":"2023-10-06T02:18:44.961435+0000","last_peered":"2023-10-06T02:18:44.961435+0000","last_clean":"2023-10-06T02:18:44.961435+0000","last_became_active":"2023-10-06T02:18:44.961289+0000","last_became_peered":"2023-10-06T02:18:44.961289+0000","last_unstale":"2023-10-06T02:18:44.961435+0000","last_undegraded":"2023-10-06T02:18:44.961435+0000","last_fullsized":"2023-10-06T02:18:44.961435+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:01.752107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.941552+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:18:43.941552+0000","last_peered":"2023-10-06T02:18:43.941552+0000","last_clean":"2023-10-06T02:18:43.941552+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:18:43.941552+0000","last_undegraded":"2023-10-06T02:18:43.941552+0000","last_fullsized":"2023-10-06T02:18:43.941552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943232+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:53.401386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.958969+0000","last_change":"2023-10-06T02:18:44.958969+0000","last_active":"2023-10-06T02:18:44.958969+0000","last_peered":"2023-10-06T02:18:44.958969+0000","last_clean":"2023-10-06T02:18:44.958969+0000","last_became_active":"2023-10-06T02:18:44.958782+0000","last_became_peered":"2023-10-06T02:18:44.958782+0000","last_unstale":"2023-10-06T02:18:44.958969+0000","last_undegraded":"2023-10-06T02:18:44.958969+0000","last_fullsized":"2023-10-06T02:18:44.958969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:47.153725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.941741+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:18:43.941741+0000","last_peered":"2023-10-06T02:18:43.941741+0000","last_clean":"2023-10-06T02:18:43.941741+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:18:43.941741+0000","last_undegraded":"2023-10-06T02:18:43.941741+0000","last_fullsized":"2023-10-06T02:18:43.941741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298284,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073556,"statfs":{"total":96636764160,"available":96331321344,"internally_reserved":0,"allocated":1019904,"data_stored":777613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.58799999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.45200000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.499}]},{"osd":6,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.621}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":421888,"data_stored":186292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":5.6929999999999996,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":5.7060000000000004,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.628}]},{"osd":2,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":8.8659999999999997,"5min":8.8659999999999997,"15min":8.8659999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":10.659000000000001,"5min":10.659000000000001,"15min":10.659000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65400000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.748},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.80500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298268,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073572,"statfs":{"total":96636764160,"available":96331337728,"internally_reserved":0,"allocated":1003520,"data_stored":769732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.34300000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.33500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.30299999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51800000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":187245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.377,"5min":0.377,"15min":0.377},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.376,"5min":0.376,"15min":0.376},"last":0.30199999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.377}]},{"osd":4,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.70099999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":11.138,"5min":11.138,"15min":11.138},"last":0.625},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":421888,"data_stored":186292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.31900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.373}]},{"osd":3,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.46899999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48399999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.44800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":187245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.311}]},{"osd":4,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.52100000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.57699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":187245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":17.879999999999999,"5min":17.879999999999999,"15min":17.879999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":18.010999999999999,"5min":18.010999999999999,"15min":18.010999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.49299999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.624},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":180317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.59999999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.436}]},{"osd":6,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.628}]},{"osd":7,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.503},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:18:50.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-10-06T02:18:50.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.945511+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:29:28.392538+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:18:50.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-10-06T02:18:50.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.944769+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:17:05.439978+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:18:50.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-10-06T02:18:50.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.944636+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:51:29.157909+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:18:50.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-10-06T02:18:50.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.943130+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:43:21.626772+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:18:50.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-10-06T02:18:50.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.948284+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:42:35.807016+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:18:50.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-10-06T02:18:50.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.947652+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:51:29.157909+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:18:50.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-10-06T02:18:50.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.943079+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:24:48.223274+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:18:50.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-10-06T02:18:50.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.942462+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:58:46.909176+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:18:50.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-10-06T02:18:50.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.945753+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:24:04.544636+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:18:50.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-10-06T02:18:50.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.941502+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:36:46.273367+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:18:50.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-10-06T02:18:50.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.943070+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:42:35.807016+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:18:50.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-10-06T02:18:50.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.944911+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:25:06.549044+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:18:50.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-10-06T02:18:50.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.940910+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:43:24.276483+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:18:50.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-10-06T02:18:50.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.943771+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:24:48.223274+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:18:50.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-10-06T02:18:50.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.944578+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:59:56.622088+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:18:50.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-10-06T02:18:50.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.952047+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:46:02.754107+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:18:50.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-10-06T02:18:50.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.944112+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:59:56.622088+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:18:50.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-10-06T02:18:50.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.944528+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:32:43.479197+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:18:50.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-10-06T02:18:50.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.947435+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:04:51.700768+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:18:50.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-10-06T02:18:50.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.941810+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:15:18.720086+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:18:50.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-10-06T02:18:50.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.944592+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:30:24.267409+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:18:50.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-10-06T02:18:50.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.941198+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:43:39.727976+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:18:50.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-10-06T02:18:50.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.944141+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:45:04.574891+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:18:50.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-10-06T02:18:50.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.943739+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:00:27.470110+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:18:50.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-10-06T02:18:50.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.947581+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:40:12.146025+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:18:50.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-10-06T02:18:50.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.941643+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:04:41.962383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:18:50.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-10-06T02:18:50.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.944089+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:59:38.289800+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:18:50.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-10-06T02:18:50.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.949302+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:07:15.148477+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:18:50.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-10-06T02:18:50.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.945192+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:45:01.121797+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:18:50.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-10-06T02:18:50.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.946062+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:24:36.091537+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:18:50.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-10-06T02:18:50.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.943411+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:54:20.287441+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:18:50.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-10-06T02:18:50.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.941280+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:40:12.146025+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:18:50.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-10-06T02:18:50.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.947435+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:43:42.736759+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:18:50.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-10-06T02:18:50.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.948588+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:15:18.720086+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:18:50.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-10-06T02:18:50.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.945528+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:43:21.626772+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:18:50.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-10-06T02:18:50.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.948023+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:37:47.458786+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:18:50.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-10-06T02:18:50.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.943713+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:30:24.267409+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:18:50.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-10-06T02:18:50.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.941714+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:19:49.872982+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:18:50.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-10-06T02:18:50.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.941401+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:53:55.656192+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:18:50.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-10-06T02:18:50.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.944664+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:37:16.197382+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:18:50.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-10-06T02:18:50.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.943621+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:01:01.893468+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:18:50.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-10-06T02:18:50.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.945037+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:07:15.148477+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:18:50.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-10-06T02:18:50.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.944013+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:32:53.401386+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:18:50.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-10-06T02:18:50.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.942957+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:43:21.626772+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:18:50.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-10-06T02:18:50.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.949186+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:26:49.788166+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:18:50.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-10-06T02:18:50.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.942567+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:25:06.549044+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:18:50.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-10-06T02:18:50.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.943273+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:26:02.177622+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:18:50.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-10-06T02:18:50.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.942617+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:42:35.807016+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:18:50.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-10-06T02:18:50.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.940987+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:04:51.700768+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:18:50.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-10-06T02:18:50.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.940558+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:42:56.408624+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:18:50.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-10-06T02:18:50.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.946317+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:18:26.609252+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:18:50.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-10-06T02:18:50.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.946928+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:43:24.276483+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:18:50.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-10-06T02:18:50.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.945196+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:59:38.289800+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:18:50.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-10-06T02:18:50.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.945264+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:10:17.470803+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:18:50.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-10-06T02:18:50.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.942658+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:26:49.788166+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:18:50.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-10-06T02:18:50.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.941761+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:35:22.904890+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:18:50.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-10-06T02:18:50.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.943679+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:03:06.448305+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:18:50.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-10-06T02:18:50.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.944275+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:01:01.893468+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:18:50.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-10-06T02:18:50.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.942393+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:25:06.549044+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:18:50.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-10-06T02:18:50.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.942584+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:17:05.439978+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:18:50.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-10-06T02:18:50.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.940576+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:17:30.646258+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:18:50.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-10-06T02:18:50.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.948115+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:04:41.962383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:18:50.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-10-06T02:18:50.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.948403+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:24:48.223274+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:18:50.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-10-06T02:18:50.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:18:44.935002+0000', 'last_change': '2023-10-06T02:18:44.943232+0000', 'last_active': '2023-10-06T02:18:44.935002+0000', 'last_peered': '2023-10-06T02:18:44.935002+0000', 'last_clean': '2023-10-06T02:18:44.935002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:18:44.935002+0000', 'last_undegraded': '2023-10-06T02:18:44.935002+0000', 'last_fullsized': '2023-10-06T02:18:44.935002+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'last_clean_scrub_stamp': '2023-10-06T02:18:44.935002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:32:53.401386+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:18:50.901 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:18:51.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.039+0000 7f4fa4f9f700 1 Processor -- start 2023-10-06T02:18:51.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.039+0000 7f4fa4f9f700 1 -- start start 2023-10-06T02:18:51.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.040+0000 7f4fa4f9f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4fa00afa40 0x7f4fa00afe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:51.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.040+0000 7f4fa4f9f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fa0159130 0x7f4fa0159590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:51.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.040+0000 7f4fa4f9f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa00caf40 con 0x7f4fa015d2f0 2023-10-06T02:18:51.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.040+0000 7f4fa4f9f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa00b0350 con 0x7f4fa0159130 2023-10-06T02:18:51.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.040+0000 7f4fa4f9f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa015e020 con 0x7f4fa00afa40 2023-10-06T02:18:51.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.040+0000 7f4f9ed9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fa0159130 0x7f4fa0159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:51.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.040+0000 7f4f9ed9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fa0159130 0x7f4fa0159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41608/0 (socket says 172.21.15.6:41608) 2023-10-06T02:18:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.041+0000 7f4f9ed9d700 1 -- 172.21.15.6:0/4246675904 learned_addr learned my addr 172.21.15.6:0/4246675904 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.041+0000 7f4f9e59c700 1 --2- 172.21.15.6:0/4246675904 >> v2:172.21.15.175:3300/0 conn(0x7f4fa00afa40 0x7f4fa00afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.041+0000 7f4f9ed9d700 1 -- 172.21.15.6:0/4246675904 >> v2:172.21.15.175:3300/0 conn(0x7f4fa00afa40 msgr2=0x7f4fa00afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.041+0000 7f4f9ed9d700 1 --2- 172.21.15.6:0/4246675904 >> v2:172.21.15.175:3300/0 conn(0x7f4fa00afa40 0x7f4fa00afe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.041+0000 7f4f9ed9d700 1 -- 172.21.15.6:0/4246675904 >> v1:172.21.15.175:6789/0 conn(0x7f4fa015d2f0 legacy=0x7f4fa015d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.041+0000 7f4f9ed9d700 1 -- 172.21.15.6:0/4246675904 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa00cb190 con 0x7f4fa0159130 2023-10-06T02:18:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.041+0000 7f4f9ed9d700 1 --2- 172.21.15.6:0/4246675904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fa0159130 0x7f4fa0159590 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00696d0 tx=0x7f4f98009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2081ae8ec1d00555 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.041+0000 7f4f9d59a700 1 -- 172.21.15.6:0/4246675904 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9800e070 con 0x7f4fa0159130 2023-10-06T02:18:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.041+0000 7f4f9d59a700 1 -- 172.21.15.6:0/4246675904 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9800ba10 con 0x7f4fa0159130 2023-10-06T02:18:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.041+0000 7f4f9d59a700 1 -- 172.21.15.6:0/4246675904 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f980092e0 con 0x7f4fa0159130 2023-10-06T02:18:51.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.042+0000 7f4fa4f9f700 1 -- 172.21.15.6:0/4246675904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fa0159130 msgr2=0x7f4fa0159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:51.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.042+0000 7f4fa4f9f700 1 --2- 172.21.15.6:0/4246675904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fa0159130 0x7f4fa0159590 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00696d0 tx=0x7f4f98009840 comp rx=0 tx=0).stop 2023-10-06T02:18:51.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.042+0000 7f4fa4f9f700 1 -- 172.21.15.6:0/4246675904 shutdown_connections 2023-10-06T02:18:51.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.042+0000 7f4fa4f9f700 1 --2- 172.21.15.6:0/4246675904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fa0159130 0x7f4fa0159590 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.042+0000 7f4fa4f9f700 1 --2- 172.21.15.6:0/4246675904 >> v2:172.21.15.175:3300/0 conn(0x7f4fa00afa40 0x7f4fa00afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.042+0000 7f4fa4f9f700 1 -- 172.21.15.6:0/4246675904 >> 172.21.15.6:0/4246675904 conn(0x7f4fa0068680 msgr2=0x7f4fa0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:51.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.042+0000 7f4fa4f9f700 1 -- 172.21.15.6:0/4246675904 shutdown_connections 2023-10-06T02:18:51.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.042+0000 7f4fa4f9f700 1 -- 172.21.15.6:0/4246675904 wait complete. 2023-10-06T02:18:51.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.043+0000 7f4fa4f9f700 1 Processor -- start 2023-10-06T02:18:51.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.043+0000 7f4fa4f9f700 1 -- start start 2023-10-06T02:18:51.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.043+0000 7f4fa4f9f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa00afa40 0x7f4fa016a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:51.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.043+0000 7f4fa4f9f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa0159130 0x7f4fa014a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:51.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.043+0000 7f4fa4f9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fa015d2f0 0x7f4fa00c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:51.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4fa4f9f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa0156e80 con 0x7f4fa015d2f0 2023-10-06T02:18:51.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4fa4f9f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa016a970 con 0x7f4fa00afa40 2023-10-06T02:18:51.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4fa4f9f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa016d7d0 con 0x7f4fa0159130 2023-10-06T02:18:51.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4f9ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fa015d2f0 0x7f4fa00c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:51.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4f9ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fa015d2f0 0x7f4fa00c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41622/0 (socket says 172.21.15.6:41622) 2023-10-06T02:18:51.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4f9ed9d700 1 -- 172.21.15.6:0/3602151934 learned_addr learned my addr 172.21.15.6:0/3602151934 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:51.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4f9e59c700 1 --2- 172.21.15.6:0/3602151934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa00afa40 0x7f4fa016a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:51.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4f9dd9b700 1 --2- 172.21.15.6:0/3602151934 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa0159130 0x7f4fa014a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:51.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4f9ed9d700 1 -- 172.21.15.6:0/3602151934 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa0159130 msgr2=0x7f4fa014a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:51.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4f9ed9d700 1 --2- 172.21.15.6:0/3602151934 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa0159130 0x7f4fa014a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4f9ed9d700 1 -- 172.21.15.6:0/3602151934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa00afa40 msgr2=0x7f4fa016a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:51.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4f9ed9d700 1 --2- 172.21.15.6:0/3602151934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa00afa40 0x7f4fa016a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4f9ed9d700 1 -- 172.21.15.6:0/3602151934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f98009ae0 con 0x7f4fa015d2f0 2023-10-06T02:18:51.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4f9e59c700 1 --2- 172.21.15.6:0/3602151934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa00afa40 0x7f4fa016a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:51.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4f9ed9d700 1 --2- 172.21.15.6:0/3602151934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fa015d2f0 0x7f4fa00c9b90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00880f0 tx=0x7f4f98017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:51.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4f967fc700 1 -- 172.21.15.6:0/3602151934 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9800bee0 con 0x7f4fa015d2f0 2023-10-06T02:18:51.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4f967fc700 1 -- 172.21.15.6:0/3602151934 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f98012e60 con 0x7f4fa015d2f0 2023-10-06T02:18:51.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4fa4f9f700 1 -- 172.21.15.6:0/3602151934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa00c5d20 con 0x7f4fa015d2f0 2023-10-06T02:18:51.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4f967fc700 1 -- 172.21.15.6:0/3602151934 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9801d670 con 0x7f4fa015d2f0 2023-10-06T02:18:51.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.044+0000 7f4fa4f9f700 1 -- 172.21.15.6:0/3602151934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa016d460 con 0x7f4fa015d2f0 2023-10-06T02:18:51.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.045+0000 7f4fa4f9f700 1 -- 172.21.15.6:0/3602151934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa016cfe0 con 0x7f4fa015d2f0 2023-10-06T02:18:51.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.046+0000 7f4f967fc700 1 -- 172.21.15.6:0/3602151934 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f9801d9e0 con 0x7f4fa015d2f0 2023-10-06T02:18:51.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.046+0000 7f4f967fc700 1 --2- 172.21.15.6:0/3602151934 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f80066f30 0x7f4f800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:51.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.046+0000 7f4f967fc700 1 -- 172.21.15.6:0/3602151934 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4f98086020 con 0x7f4fa015d2f0 2023-10-06T02:18:51.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.047+0000 7f4f9e59c700 1 --2- 172.21.15.6:0/3602151934 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f80066f30 0x7f4f800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:51.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.047+0000 7f4f9e59c700 1 --2- 172.21.15.6:0/3602151934 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f80066f30 0x7f4f800693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00b0010 tx=0x7f4f90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:51.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.051+0000 7f4f967fc700 1 -- 172.21.15.6:0/3602151934 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fa016cfe0 con 0x7f4fa015d2f0 2023-10-06T02:18:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.325+0000 7f4fa4f9f700 1 -- 172.21.15.6:0/3602151934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4fa016cfe0 con 0x7f4fa015d2f0 2023-10-06T02:18:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.325+0000 7f4f967fc700 1 -- 172.21.15.6:0/3602151934 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1584 (secure 0 0 0) 0x7f4fa016cfe0 con 0x7f4fa015d2f0 2023-10-06T02:18:51.326 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:51.326 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"c557bd13-0401-4965-a08f-5579f545617e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":86,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1696558654,"num_in_osds":8,"osd_in_since":1696558647,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":2439942144,"bytes_avail":770654171136,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5145}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-10-06T02:18:36.572484+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T02:18:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.327+0000 7f4fa4f9f700 1 -- 172.21.15.6:0/3602151934 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f80066f30 msgr2=0x7f4f800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.327+0000 7f4fa4f9f700 1 --2- 172.21.15.6:0/3602151934 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f80066f30 0x7f4f800693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00b0010 tx=0x7f4f90008040 comp rx=0 tx=0).stop 2023-10-06T02:18:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.327+0000 7f4fa4f9f700 1 -- 172.21.15.6:0/3602151934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fa015d2f0 msgr2=0x7f4fa00c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.327+0000 7f4fa4f9f700 1 --2- 172.21.15.6:0/3602151934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fa015d2f0 0x7f4fa00c9b90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00880f0 tx=0x7f4f98017000 comp rx=0 tx=0).stop 2023-10-06T02:18:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.327+0000 7f4fa4f9f700 1 -- 172.21.15.6:0/3602151934 shutdown_connections 2023-10-06T02:18:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.327+0000 7f4fa4f9f700 1 --2- 172.21.15.6:0/3602151934 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f80066f30 0x7f4f800693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.327+0000 7f4fa4f9f700 1 --2- 172.21.15.6:0/3602151934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fa015d2f0 0x7f4fa00c9b90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.327+0000 7f4fa4f9f700 1 --2- 172.21.15.6:0/3602151934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa00afa40 0x7f4fa016a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.327+0000 7f4fa4f9f700 1 --2- 172.21.15.6:0/3602151934 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa0159130 0x7f4fa014a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.327+0000 7f4fa4f9f700 1 -- 172.21.15.6:0/3602151934 >> 172.21.15.6:0/3602151934 conn(0x7f4fa0068680 msgr2=0x7f4fa00b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.327+0000 7f4fa4f9f700 1 -- 172.21.15.6:0/3602151934 shutdown_connections 2023-10-06T02:18:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.327+0000 7f4fa4f9f700 1 -- 172.21.15.6:0/3602151934 wait complete. 2023-10-06T02:18:51.339 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T02:18:51.340 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:18:51.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.458+0000 7f4ea0550700 1 Processor -- start 2023-10-06T02:18:51.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.458+0000 7f4ea0550700 1 -- start start 2023-10-06T02:18:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.459+0000 7f4ea0550700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e980af4e0 0x7f4e980b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.459+0000 7f4ea0550700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4e9815db70 0x7f4e980b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.459+0000 7f4ea0550700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9815e190 con 0x7f4e980af8b0 2023-10-06T02:18:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.459+0000 7f4ea0550700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e980b1910 con 0x7f4e9815db70 2023-10-06T02:18:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.459+0000 7f4ea0550700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9815dfb0 con 0x7f4e980af4e0 2023-10-06T02:18:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.459+0000 7f4e9daeb700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4e980af8b0 0x7f4e9815d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47760/0 (socket says 172.21.15.6:47760) 2023-10-06T02:18:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.459+0000 7f4e9daeb700 1 -- 172.21.15.6:0/4277046527 learned_addr learned my addr 172.21.15.6:0/4277046527 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9eaed700 1 --2- 172.21.15.6:0/4277046527 >> v2:172.21.15.175:3300/0 conn(0x7f4e9815db70 0x7f4e980b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9e2ec700 1 --2- 172.21.15.6:0/4277046527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e980af4e0 0x7f4e980b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9d2ea700 1 -- 172.21.15.6:0/4277046527 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060002239 0 0) 0x7f4e9815e190 con 0x7f4e980af8b0 2023-10-06T02:18:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9d2ea700 1 -- 172.21.15.6:0/4277046527 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e80003570 con 0x7f4e980af8b0 2023-10-06T02:18:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9d2ea700 1 -- 172.21.15.6:0/4277046527 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 777960202 0 0) 0x7f4e80003570 con 0x7f4e980af8b0 2023-10-06T02:18:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9d2ea700 1 -- 172.21.15.6:0/4277046527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e980af4e0 msgr2=0x7f4e980b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9d2ea700 1 --2- 172.21.15.6:0/4277046527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e980af4e0 0x7f4e980b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9d2ea700 1 -- 172.21.15.6:0/4277046527 >> v2:172.21.15.175:3300/0 conn(0x7f4e9815db70 msgr2=0x7f4e980b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9d2ea700 1 --2- 172.21.15.6:0/4277046527 >> v2:172.21.15.175:3300/0 conn(0x7f4e9815db70 0x7f4e980b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9d2ea700 1 -- 172.21.15.6:0/4277046527 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e980cb650 con 0x7f4e980af8b0 2023-10-06T02:18:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9d2ea700 1 -- 172.21.15.6:0/4277046527 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f4e8c001470 con 0x7f4e980af8b0 2023-10-06T02:18:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9eaed700 1 --2- 172.21.15.6:0/4277046527 >> v2:172.21.15.175:3300/0 conn(0x7f4e9815db70 0x7f4e980b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9d2ea700 1 -- 172.21.15.6:0/4277046527 >> v1:172.21.15.6:6789/0 conn(0x7f4e980af8b0 legacy=0x7f4e9815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9d2ea700 1 --2- 172.21.15.6:0/4277046527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e980af4e0 0x7f4e80003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9d2ea700 1 --2- 172.21.15.6:0/4277046527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e80003fe0 0x7f4e80004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9d2ea700 1 --2- 172.21.15.6:0/4277046527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e80004d50 0x7f4e800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9d2ea700 1 -- 172.21.15.6:0/4277046527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980b1910 con 0x7f4e80003fe0 2023-10-06T02:18:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9d2ea700 1 -- 172.21.15.6:0/4277046527 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9815dfb0 con 0x7f4e80004d50 2023-10-06T02:18:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9d2ea700 1 -- 172.21.15.6:0/4277046527 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8000ba90 con 0x7f4e980af4e0 2023-10-06T02:18:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9daeb700 1 --2- 172.21.15.6:0/4277046527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e80003fe0 0x7f4e80004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9e2ec700 1 --2- 172.21.15.6:0/4277046527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e980af4e0 0x7f4e80003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9eaed700 1 --2- 172.21.15.6:0/4277046527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e80004d50 0x7f4e800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9daeb700 1 -- 172.21.15.6:0/4277046527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e980af4e0 msgr2=0x7f4e80003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9daeb700 1 --2- 172.21.15.6:0/4277046527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e980af4e0 0x7f4e80003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9daeb700 1 -- 172.21.15.6:0/4277046527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e80004d50 msgr2=0x7f4e800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9daeb700 1 --2- 172.21.15.6:0/4277046527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e80004d50 0x7f4e800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.460+0000 7f4e9daeb700 1 -- 172.21.15.6:0/4277046527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e80003570 con 0x7f4e80003fe0 2023-10-06T02:18:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.461+0000 7f4e9daeb700 1 --2- 172.21.15.6:0/4277046527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e80003fe0 0x7f4e80004810 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00c3c0 tx=0x7f4e980cb5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d566c93348b3ce2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.461+0000 7f4e9d2ea700 1 -- 172.21.15.6:0/4277046527 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c00cc30 con 0x7f4e80003fe0 2023-10-06T02:18:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.461+0000 7f4e9d2ea700 1 -- 172.21.15.6:0/4277046527 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8c00cdd0 con 0x7f4e80003fe0 2023-10-06T02:18:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.461+0000 7f4e9d2ea700 1 -- 172.21.15.6:0/4277046527 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c005b70 con 0x7f4e80003fe0 2023-10-06T02:18:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.461+0000 7f4ea0550700 1 -- 172.21.15.6:0/4277046527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e80003fe0 msgr2=0x7f4e80004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.461+0000 7f4ea0550700 1 --2- 172.21.15.6:0/4277046527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e80003fe0 0x7f4e80004810 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00c3c0 tx=0x7f4e980cb5c0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.461+0000 7f4e9eaed700 1 -- 172.21.15.6:0/4277046527 reap_dead start 2023-10-06T02:18:51.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.461+0000 7f4ea0550700 1 -- 172.21.15.6:0/4277046527 shutdown_connections 2023-10-06T02:18:51.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.461+0000 7f4ea0550700 1 -- 172.21.15.6:0/4277046527 >> 172.21.15.6:0/4277046527 conn(0x7f4e98068680 msgr2=0x7f4e98068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:51.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.461+0000 7f4ea0550700 1 -- 172.21.15.6:0/4277046527 shutdown_connections 2023-10-06T02:18:51.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.461+0000 7f4ea0550700 1 -- 172.21.15.6:0/4277046527 wait complete. 2023-10-06T02:18:51.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.462+0000 7f4ea0550700 1 Processor -- start 2023-10-06T02:18:51.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.463+0000 7f4ea0550700 1 -- start start 2023-10-06T02:18:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.463+0000 7f4ea0550700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e80003fe0 0x7f4e980a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.463+0000 7f4ea0550700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e980ca0d0 0x7f4e980ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.463+0000 7f4ea0550700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e98159540 0x7f4e981599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.463+0000 7f4ea0550700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980c7300 con 0x7f4e98159540 2023-10-06T02:18:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.463+0000 7f4ea0550700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e98159f20 con 0x7f4e80003fe0 2023-10-06T02:18:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.463+0000 7f4ea0550700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980a7390 con 0x7f4e980ca0d0 2023-10-06T02:18:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.463+0000 7f4e9eaed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e98159540 0x7f4e981599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.463+0000 7f4e9eaed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e98159540 0x7f4e981599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41638/0 (socket says 172.21.15.6:41638) 2023-10-06T02:18:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.463+0000 7f4e9eaed700 1 -- 172.21.15.6:0/2264653782 learned_addr learned my addr 172.21.15.6:0/2264653782 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.463+0000 7f4e9daeb700 1 --2- 172.21.15.6:0/2264653782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e980ca0d0 0x7f4e980ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.464+0000 7f4e9e2ec700 1 --2- 172.21.15.6:0/2264653782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e80003fe0 0x7f4e980a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.464+0000 7f4e9eaed700 1 -- 172.21.15.6:0/2264653782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e980ca0d0 msgr2=0x7f4e980ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.464+0000 7f4e9eaed700 1 --2- 172.21.15.6:0/2264653782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e980ca0d0 0x7f4e980ae350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.464+0000 7f4e9eaed700 1 -- 172.21.15.6:0/2264653782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e80003fe0 msgr2=0x7f4e980a6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.464+0000 7f4e9eaed700 1 --2- 172.21.15.6:0/2264653782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e80003fe0 0x7f4e980a6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.464+0000 7f4e9eaed700 1 -- 172.21.15.6:0/2264653782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e980a7670 con 0x7f4e98159540 2023-10-06T02:18:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.464+0000 7f4e9eaed700 1 --2- 172.21.15.6:0/2264653782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e98159540 0x7f4e981599e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4e980897f0 tx=0x7f4e8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.464+0000 7f4e967fc700 1 -- 172.21.15.6:0/2264653782 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8800e040 con 0x7f4e98159540 2023-10-06T02:18:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.464+0000 7f4e967fc700 1 -- 172.21.15.6:0/2264653782 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8800f040 con 0x7f4e98159540 2023-10-06T02:18:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.464+0000 7f4ea0550700 1 -- 172.21.15.6:0/2264653782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e980a7950 con 0x7f4e98159540 2023-10-06T02:18:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.464+0000 7f4e967fc700 1 -- 172.21.15.6:0/2264653782 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e88015430 con 0x7f4e98159540 2023-10-06T02:18:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.464+0000 7f4ea0550700 1 -- 172.21.15.6:0/2264653782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e980ca540 con 0x7f4e98159540 2023-10-06T02:18:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.465+0000 7f4ea0550700 1 -- 172.21.15.6:0/2264653782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e98088aa0 con 0x7f4e98159540 2023-10-06T02:18:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.465+0000 7f4e967fc700 1 -- 172.21.15.6:0/2264653782 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e880157e0 con 0x7f4e98159540 2023-10-06T02:18:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.466+0000 7f4e967fc700 1 --2- 172.21.15.6:0/2264653782 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e84066f30 0x7f4e840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.466+0000 7f4e967fc700 1 -- 172.21.15.6:0/2264653782 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4e880853b0 con 0x7f4e98159540 2023-10-06T02:18:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.466+0000 7f4e9e2ec700 1 --2- 172.21.15.6:0/2264653782 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e84066f30 0x7f4e840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.466+0000 7f4e9e2ec700 1 --2- 172.21.15.6:0/2264653782 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e84066f30 0x7f4e840693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4e90006dc0 tx=0x7f4e90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.470+0000 7f4e967fc700 1 -- 172.21.15.6:0/2264653782 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e88052380 con 0x7f4e98159540 2023-10-06T02:18:51.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.660+0000 7f4ea0550700 1 -- 172.21.15.6:0/2264653782 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e980b0910 con 0x7f4e84066f30 2023-10-06T02:18:51.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.669+0000 7f4e967fc700 1 -- 172.21.15.6:0/2264653782 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308652 (secure 0 0 0) 0x7f4e980b0910 con 0x7f4e84066f30 2023-10-06T02:18:51.673 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.672+0000 7f4ea0550700 1 -- 172.21.15.6:0/2264653782 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e84066f30 msgr2=0x7f4e840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.672+0000 7f4ea0550700 1 --2- 172.21.15.6:0/2264653782 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e84066f30 0x7f4e840693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4e90006dc0 tx=0x7f4e90008040 comp rx=0 tx=0).stop 2023-10-06T02:18:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.672+0000 7f4ea0550700 1 -- 172.21.15.6:0/2264653782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e98159540 msgr2=0x7f4e981599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.672+0000 7f4ea0550700 1 --2- 172.21.15.6:0/2264653782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e98159540 0x7f4e981599e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4e980897f0 tx=0x7f4e8800b040 comp rx=0 tx=0).stop 2023-10-06T02:18:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.672+0000 7f4ea0550700 1 -- 172.21.15.6:0/2264653782 shutdown_connections 2023-10-06T02:18:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.672+0000 7f4ea0550700 1 --2- 172.21.15.6:0/2264653782 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e84066f30 0x7f4e840693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.672+0000 7f4ea0550700 1 --2- 172.21.15.6:0/2264653782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e98159540 0x7f4e981599e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.672+0000 7f4ea0550700 1 --2- 172.21.15.6:0/2264653782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e80003fe0 0x7f4e980a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.672+0000 7f4ea0550700 1 --2- 172.21.15.6:0/2264653782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e980ca0d0 0x7f4e980ae350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.672+0000 7f4ea0550700 1 -- 172.21.15.6:0/2264653782 >> 172.21.15.6:0/2264653782 conn(0x7f4e98068680 msgr2=0x7f4e980b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:51.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.673+0000 7f4ea0550700 1 -- 172.21.15.6:0/2264653782 shutdown_connections 2023-10-06T02:18:51.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:51.673+0000 7f4ea0550700 1 -- 172.21.15.6:0/2264653782 wait complete. 2023-10-06T02:18:51.677 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:18:51.685 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-10-06T02:18:50.575539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382756,"kb_used_data":4452,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591964,"statfs":{"total":773094113280,"available":770654171136,"internally_reserved":0,"allocated":4558848,"data_stored":2661981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001561"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945511+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:28.392538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944769+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:05.439978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944636+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:29.157909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943130+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:21.626772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948284+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:35.807016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.947652+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:29.157909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943079+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:48.223274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942462+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:46.909176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945753+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:24:04.544636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941502+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:46.273367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943070+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:35.807016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944911+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:06.549044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.940910+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:24.276483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943771+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:48.223274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944578+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:56.622088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.952047+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:02.754107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944112+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:56.622088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944528+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:32:43.479197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.947435+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:51.700768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941810+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:18.720086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944592+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:24.267409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941198+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:39.727976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944141+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:04.574891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943739+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:27.470110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.947581+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:40:12.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941643+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:41.962383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944089+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:38.289800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.949302+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:15.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945192+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:01.121797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.946062+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:24:36.091537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943411+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:20.287441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941280+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:40:12.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.947435+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:42.736759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.960473+0000","last_change":"2023-10-06T02:18:44.960473+0000","last_active":"2023-10-06T02:18:44.960473+0000","last_peered":"2023-10-06T02:18:44.960473+0000","last_clean":"2023-10-06T02:18:44.960473+0000","last_became_active":"2023-10-06T02:18:44.960009+0000","last_became_peered":"2023-10-06T02:18:44.960009+0000","last_unstale":"2023-10-06T02:18:44.960473+0000","last_undegraded":"2023-10-06T02:18:44.960473+0000","last_fullsized":"2023-10-06T02:18:44.960473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:20.624772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948588+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:18.720086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.958493+0000","last_change":"2023-10-06T02:18:44.958493+0000","last_active":"2023-10-06T02:18:44.958493+0000","last_peered":"2023-10-06T02:18:44.958493+0000","last_clean":"2023-10-06T02:18:44.958493+0000","last_became_active":"2023-10-06T02:18:44.958170+0000","last_became_peered":"2023-10-06T02:18:44.958170+0000","last_unstale":"2023-10-06T02:18:44.958493+0000","last_undegraded":"2023-10-06T02:18:44.958493+0000","last_fullsized":"2023-10-06T02:18:44.958493+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:27.390538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945528+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:21.626772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.961055+0000","last_change":"2023-10-06T02:18:44.961055+0000","last_active":"2023-10-06T02:18:44.961055+0000","last_peered":"2023-10-06T02:18:44.961055+0000","last_clean":"2023-10-06T02:18:44.961055+0000","last_became_active":"2023-10-06T02:18:44.960851+0000","last_became_peered":"2023-10-06T02:18:44.960851+0000","last_unstale":"2023-10-06T02:18:44.961055+0000","last_undegraded":"2023-10-06T02:18:44.961055+0000","last_fullsized":"2023-10-06T02:18:44.961055+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:47.153725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948023+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:47.458786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.959383+0000","last_change":"2023-10-06T02:18:44.959383+0000","last_active":"2023-10-06T02:18:44.959383+0000","last_peered":"2023-10-06T02:18:44.959383+0000","last_clean":"2023-10-06T02:18:44.959383+0000","last_became_active":"2023-10-06T02:18:44.959073+0000","last_became_peered":"2023-10-06T02:18:44.959073+0000","last_unstale":"2023-10-06T02:18:44.959383+0000","last_undegraded":"2023-10-06T02:18:44.959383+0000","last_fullsized":"2023-10-06T02:18:44.959383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:45.271368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943713+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:24.267409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.952220+0000","last_change":"2023-10-06T02:18:44.952220+0000","last_active":"2023-10-06T02:18:44.952220+0000","last_peered":"2023-10-06T02:18:44.952220+0000","last_clean":"2023-10-06T02:18:44.952220+0000","last_became_active":"2023-10-06T02:18:44.951937+0000","last_became_peered":"2023-10-06T02:18:44.951937+0000","last_unstale":"2023-10-06T02:18:44.952220+0000","last_undegraded":"2023-10-06T02:18:44.952220+0000","last_fullsized":"2023-10-06T02:18:44.952220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:27.390538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941714+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:49.872982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.952812+0000","last_change":"2023-10-06T02:18:44.952812+0000","last_active":"2023-10-06T02:18:44.952812+0000","last_peered":"2023-10-06T02:18:44.952812+0000","last_clean":"2023-10-06T02:18:44.952812+0000","last_became_active":"2023-10-06T02:18:44.952538+0000","last_became_peered":"2023-10-06T02:18:44.952538+0000","last_unstale":"2023-10-06T02:18:44.952812+0000","last_undegraded":"2023-10-06T02:18:44.952812+0000","last_fullsized":"2023-10-06T02:18:44.952812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:01.175622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941401+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:53:55.656192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.950586+0000","last_change":"2023-10-06T02:18:44.950586+0000","last_active":"2023-10-06T02:18:44.950586+0000","last_peered":"2023-10-06T02:18:44.950586+0000","last_clean":"2023-10-06T02:18:44.950586+0000","last_became_active":"2023-10-06T02:18:44.950322+0000","last_became_peered":"2023-10-06T02:18:44.950322+0000","last_unstale":"2023-10-06T02:18:44.950586+0000","last_undegraded":"2023-10-06T02:18:44.950586+0000","last_fullsized":"2023-10-06T02:18:44.950586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:48.870983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944664+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:16.197382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.952867+0000","last_change":"2023-10-06T02:18:44.952867+0000","last_active":"2023-10-06T02:18:44.952867+0000","last_peered":"2023-10-06T02:18:44.952867+0000","last_clean":"2023-10-06T02:18:44.952867+0000","last_became_active":"2023-10-06T02:18:44.952582+0000","last_became_peered":"2023-10-06T02:18:44.952582+0000","last_unstale":"2023-10-06T02:18:44.952867+0000","last_undegraded":"2023-10-06T02:18:44.952867+0000","last_fullsized":"2023-10-06T02:18:44.952867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:41.734760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943621+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:01.893468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.953410+0000","last_change":"2023-10-06T02:18:44.953410+0000","last_active":"2023-10-06T02:18:44.953410+0000","last_peered":"2023-10-06T02:18:44.953410+0000","last_clean":"2023-10-06T02:18:44.953410+0000","last_became_active":"2023-10-06T02:18:44.953098+0000","last_became_peered":"2023-10-06T02:18:44.953098+0000","last_unstale":"2023-10-06T02:18:44.953410+0000","last_undegraded":"2023-10-06T02:18:44.953410+0000","last_fullsized":"2023-10-06T02:18:44.953410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:19.285441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945037+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:15.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.958075+0000","last_change":"2023-10-06T02:18:44.958075+0000","last_active":"2023-10-06T02:18:44.958075+0000","last_peered":"2023-10-06T02:18:44.958075+0000","last_clean":"2023-10-06T02:18:44.958075+0000","last_became_active":"2023-10-06T02:18:44.953714+0000","last_became_peered":"2023-10-06T02:18:44.953714+0000","last_unstale":"2023-10-06T02:18:44.958075+0000","last_undegraded":"2023-10-06T02:18:44.958075+0000","last_fullsized":"2023-10-06T02:18:44.958075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:03.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944013+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:53.401386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.957227+0000","last_change":"2023-10-06T02:18:44.957227+0000","last_active":"2023-10-06T02:18:44.957227+0000","last_peered":"2023-10-06T02:18:44.957227+0000","last_clean":"2023-10-06T02:18:44.957227+0000","last_became_active":"2023-10-06T02:18:44.956968+0000","last_became_peered":"2023-10-06T02:18:44.956968+0000","last_unstale":"2023-10-06T02:18:44.957227+0000","last_undegraded":"2023-10-06T02:18:44.957227+0000","last_fullsized":"2023-10-06T02:18:44.957227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:48.870983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942957+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:21.626772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.950113+0000","last_change":"2023-10-06T02:18:44.950113+0000","last_active":"2023-10-06T02:18:44.950113+0000","last_peered":"2023-10-06T02:18:44.950113+0000","last_clean":"2023-10-06T02:18:44.950113+0000","last_became_active":"2023-10-06T02:18:44.949813+0000","last_became_peered":"2023-10-06T02:18:44.949813+0000","last_unstale":"2023-10-06T02:18:44.950113+0000","last_undegraded":"2023-10-06T02:18:44.950113+0000","last_fullsized":"2023-10-06T02:18:44.950113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:00.119797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.949186+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:49.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.949923+0000","last_change":"2023-10-06T02:18:44.949923+0000","last_active":"2023-10-06T02:18:44.949923+0000","last_peered":"2023-10-06T02:18:44.949923+0000","last_clean":"2023-10-06T02:18:44.949923+0000","last_became_active":"2023-10-06T02:18:44.948547+0000","last_became_peered":"2023-10-06T02:18:44.948547+0000","last_unstale":"2023-10-06T02:18:44.949923+0000","last_undegraded":"2023-10-06T02:18:44.949923+0000","last_fullsized":"2023-10-06T02:18:44.949923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:05.547045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942567+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:06.549044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.954535+0000","last_change":"2023-10-06T02:18:44.954535+0000","last_active":"2023-10-06T02:18:44.954535+0000","last_peered":"2023-10-06T02:18:44.954535+0000","last_clean":"2023-10-06T02:18:44.954535+0000","last_became_active":"2023-10-06T02:18:44.954254+0000","last_became_peered":"2023-10-06T02:18:44.954254+0000","last_unstale":"2023-10-06T02:18:44.954535+0000","last_undegraded":"2023-10-06T02:18:44.954535+0000","last_fullsized":"2023-10-06T02:18:44.954535+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:45.907176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943273+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:02.177622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.949330+0000","last_change":"2023-10-06T02:18:44.949330+0000","last_active":"2023-10-06T02:18:44.949330+0000","last_peered":"2023-10-06T02:18:44.949330+0000","last_clean":"2023-10-06T02:18:44.949330+0000","last_became_active":"2023-10-06T02:18:44.949068+0000","last_became_peered":"2023-10-06T02:18:44.949068+0000","last_unstale":"2023-10-06T02:18:44.949330+0000","last_undegraded":"2023-10-06T02:18:44.949330+0000","last_fullsized":"2023-10-06T02:18:44.949330+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:04.437978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942617+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:35.807016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.953429+0000","last_change":"2023-10-06T02:18:44.953429+0000","last_active":"2023-10-06T02:18:44.953429+0000","last_peered":"2023-10-06T02:18:44.953429+0000","last_clean":"2023-10-06T02:18:44.953429+0000","last_became_active":"2023-10-06T02:18:44.953157+0000","last_became_peered":"2023-10-06T02:18:44.953157+0000","last_unstale":"2023-10-06T02:18:44.953429+0000","last_undegraded":"2023-10-06T02:18:44.953429+0000","last_fullsized":"2023-10-06T02:18:44.953429+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:16.468803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.940987+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:51.700768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.949507+0000","last_change":"2023-10-06T02:18:44.949507+0000","last_active":"2023-10-06T02:18:44.949507+0000","last_peered":"2023-10-06T02:18:44.949507+0000","last_clean":"2023-10-06T02:18:44.949507+0000","last_became_active":"2023-10-06T02:18:44.949197+0000","last_became_peered":"2023-10-06T02:18:44.949197+0000","last_unstale":"2023-10-06T02:18:44.949507+0000","last_undegraded":"2023-10-06T02:18:44.949507+0000","last_fullsized":"2023-10-06T02:18:44.949507+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:15.195382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.940558+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:56.408624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.958383+0000","last_change":"2023-10-06T02:18:44.958383+0000","last_active":"2023-10-06T02:18:44.958383+0000","last_peered":"2023-10-06T02:18:44.958383+0000","last_clean":"2023-10-06T02:18:44.958383+0000","last_became_active":"2023-10-06T02:18:44.957808+0000","last_became_peered":"2023-10-06T02:18:44.957808+0000","last_unstale":"2023-10-06T02:18:44.958383+0000","last_undegraded":"2023-10-06T02:18:44.958383+0000","last_fullsized":"2023-10-06T02:18:44.958383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:11.173858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.946317+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:26.609252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.957231+0000","last_change":"2023-10-06T02:18:44.957231+0000","last_active":"2023-10-06T02:18:44.957231+0000","last_peered":"2023-10-06T02:18:44.957231+0000","last_clean":"2023-10-06T02:18:44.957231+0000","last_became_active":"2023-10-06T02:18:44.955723+0000","last_became_peered":"2023-10-06T02:18:44.955723+0000","last_unstale":"2023-10-06T02:18:44.957231+0000","last_undegraded":"2023-10-06T02:18:44.957231+0000","last_fullsized":"2023-10-06T02:18:44.957231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:45.907176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.946928+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:24.276483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.957249+0000","last_change":"2023-10-06T02:18:44.957249+0000","last_active":"2023-10-06T02:18:44.957249+0000","last_peered":"2023-10-06T02:18:44.957249+0000","last_clean":"2023-10-06T02:18:44.957249+0000","last_became_active":"2023-10-06T02:18:44.956928+0000","last_became_peered":"2023-10-06T02:18:44.956928+0000","last_unstale":"2023-10-06T02:18:44.957249+0000","last_undegraded":"2023-10-06T02:18:44.957249+0000","last_fullsized":"2023-10-06T02:18:44.957249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:34.805017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945196+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:38.289800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.960417+0000","last_change":"2023-10-06T02:18:44.960417+0000","last_active":"2023-10-06T02:18:44.960417+0000","last_peered":"2023-10-06T02:18:44.960417+0000","last_clean":"2023-10-06T02:18:44.960417+0000","last_became_active":"2023-10-06T02:18:44.960095+0000","last_became_peered":"2023-10-06T02:18:44.960095+0000","last_unstale":"2023-10-06T02:18:44.960417+0000","last_undegraded":"2023-10-06T02:18:44.960417+0000","last_fullsized":"2023-10-06T02:18:44.960417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:14.146477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.945264+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:17.470803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.955211+0000","last_change":"2023-10-06T02:18:44.955211+0000","last_active":"2023-10-06T02:18:44.955211+0000","last_peered":"2023-10-06T02:18:44.955211+0000","last_clean":"2023-10-06T02:18:44.955211+0000","last_became_active":"2023-10-06T02:18:44.954949+0000","last_became_peered":"2023-10-06T02:18:44.954949+0000","last_unstale":"2023-10-06T02:18:44.955211+0000","last_undegraded":"2023-10-06T02:18:44.955211+0000","last_fullsized":"2023-10-06T02:18:44.955211+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:45.271368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942658+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:49.788166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.956467+0000","last_change":"2023-10-06T02:18:44.956467+0000","last_active":"2023-10-06T02:18:44.956467+0000","last_peered":"2023-10-06T02:18:44.956467+0000","last_clean":"2023-10-06T02:18:44.956467+0000","last_became_active":"2023-10-06T02:18:44.956221+0000","last_became_peered":"2023-10-06T02:18:44.956221+0000","last_unstale":"2023-10-06T02:18:44.956467+0000","last_undegraded":"2023-10-06T02:18:44.956467+0000","last_fullsized":"2023-10-06T02:18:44.956467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:20.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.941761+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:22.904890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.955172+0000","last_change":"2023-10-06T02:18:44.955172+0000","last_active":"2023-10-06T02:18:44.955172+0000","last_peered":"2023-10-06T02:18:44.955172+0000","last_clean":"2023-10-06T02:18:44.955172+0000","last_became_active":"2023-10-06T02:18:44.954905+0000","last_became_peered":"2023-10-06T02:18:44.954905+0000","last_unstale":"2023-10-06T02:18:44.955172+0000","last_undegraded":"2023-10-06T02:18:44.955172+0000","last_fullsized":"2023-10-06T02:18:44.955172+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:21.902890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943679+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:06.448305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.954645+0000","last_change":"2023-10-06T02:18:44.954645+0000","last_active":"2023-10-06T02:18:44.954645+0000","last_peered":"2023-10-06T02:18:44.954645+0000","last_clean":"2023-10-06T02:18:44.954645+0000","last_became_active":"2023-10-06T02:18:44.954349+0000","last_became_peered":"2023-10-06T02:18:44.954349+0000","last_unstale":"2023-10-06T02:18:44.954645+0000","last_undegraded":"2023-10-06T02:18:44.954645+0000","last_fullsized":"2023-10-06T02:18:44.954645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:14.432297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.942284+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:18:43.942284+0000","last_peered":"2023-10-06T02:18:43.942284+0000","last_clean":"2023-10-06T02:18:43.942284+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:18:43.942284+0000","last_undegraded":"2023-10-06T02:18:43.942284+0000","last_fullsized":"2023-10-06T02:18:43.942284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.944275+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:01.893468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.956366+0000","last_change":"2023-10-06T02:18:44.956366+0000","last_active":"2023-10-06T02:18:44.956366+0000","last_peered":"2023-10-06T02:18:44.956366+0000","last_clean":"2023-10-06T02:18:44.956366+0000","last_became_active":"2023-10-06T02:18:44.956094+0000","last_became_peered":"2023-10-06T02:18:44.956094+0000","last_unstale":"2023-10-06T02:18:44.956366+0000","last_undegraded":"2023-10-06T02:18:44.956366+0000","last_fullsized":"2023-10-06T02:18:44.956366+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:53:54.654193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.936641+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:18:43.936641+0000","last_peered":"2023-10-06T02:18:43.936641+0000","last_clean":"2023-10-06T02:18:43.936641+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:18:43.936641+0000","last_undegraded":"2023-10-06T02:18:43.936641+0000","last_fullsized":"2023-10-06T02:18:43.936641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942393+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:06.549044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.960597+0000","last_change":"2023-10-06T02:18:44.960597+0000","last_active":"2023-10-06T02:18:44.960597+0000","last_peered":"2023-10-06T02:18:44.960597+0000","last_clean":"2023-10-06T02:18:44.960597+0000","last_became_active":"2023-10-06T02:18:44.960378+0000","last_became_peered":"2023-10-06T02:18:44.960378+0000","last_unstale":"2023-10-06T02:18:44.960597+0000","last_undegraded":"2023-10-06T02:18:44.960597+0000","last_fullsized":"2023-10-06T02:18:44.960597+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:20.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.947295+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:18:43.947295+0000","last_peered":"2023-10-06T02:18:43.947295+0000","last_clean":"2023-10-06T02:18:43.947295+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:18:43.947295+0000","last_undegraded":"2023-10-06T02:18:43.947295+0000","last_fullsized":"2023-10-06T02:18:43.947295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.944083+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:18:43.944083+0000","last_peered":"2023-10-06T02:18:43.944083+0000","last_clean":"2023-10-06T02:18:43.944083+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:18:43.944083+0000","last_undegraded":"2023-10-06T02:18:43.944083+0000","last_fullsized":"2023-10-06T02:18:43.944083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.942584+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:05.439978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.956914+0000","last_change":"2023-10-06T02:18:44.956914+0000","last_active":"2023-10-06T02:18:44.956914+0000","last_peered":"2023-10-06T02:18:44.956914+0000","last_clean":"2023-10-06T02:18:44.956914+0000","last_became_active":"2023-10-06T02:18:44.956611+0000","last_became_peered":"2023-10-06T02:18:44.956611+0000","last_unstale":"2023-10-06T02:18:44.956914+0000","last_undegraded":"2023-10-06T02:18:44.956914+0000","last_fullsized":"2023-10-06T02:18:44.956914+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:38.725977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.944020+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:18:43.944020+0000","last_peered":"2023-10-06T02:18:43.944020+0000","last_clean":"2023-10-06T02:18:43.944020+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:18:43.944020+0000","last_undegraded":"2023-10-06T02:18:43.944020+0000","last_fullsized":"2023-10-06T02:18:43.944020+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.940576+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:30.646258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.957887+0000","last_change":"2023-10-06T02:18:44.957887+0000","last_active":"2023-10-06T02:18:44.957887+0000","last_peered":"2023-10-06T02:18:44.957887+0000","last_clean":"2023-10-06T02:18:44.957887+0000","last_became_active":"2023-10-06T02:18:44.955744+0000","last_became_peered":"2023-10-06T02:18:44.955744+0000","last_unstale":"2023-10-06T02:18:44.957887+0000","last_undegraded":"2023-10-06T02:18:44.957887+0000","last_fullsized":"2023-10-06T02:18:44.957887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:21.902890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.943977+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:18:43.943977+0000","last_peered":"2023-10-06T02:18:43.943977+0000","last_clean":"2023-10-06T02:18:43.943977+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:18:43.943977+0000","last_undegraded":"2023-10-06T02:18:43.943977+0000","last_fullsized":"2023-10-06T02:18:43.943977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948115+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:41.962383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.948994+0000","last_change":"2023-10-06T02:18:44.948994+0000","last_active":"2023-10-06T02:18:44.948994+0000","last_peered":"2023-10-06T02:18:44.948994+0000","last_clean":"2023-10-06T02:18:44.948994+0000","last_became_active":"2023-10-06T02:18:44.948536+0000","last_became_peered":"2023-10-06T02:18:44.948536+0000","last_unstale":"2023-10-06T02:18:44.948994+0000","last_undegraded":"2023-10-06T02:18:44.948994+0000","last_fullsized":"2023-10-06T02:18:44.948994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:47.221274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.945442+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:18:43.945442+0000","last_peered":"2023-10-06T02:18:43.945442+0000","last_clean":"2023-10-06T02:18:43.945442+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:18:43.945442+0000","last_undegraded":"2023-10-06T02:18:43.945442+0000","last_fullsized":"2023-10-06T02:18:43.945442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.948403+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:48.223274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.961435+0000","last_change":"2023-10-06T02:18:44.961435+0000","last_active":"2023-10-06T02:18:44.961435+0000","last_peered":"2023-10-06T02:18:44.961435+0000","last_clean":"2023-10-06T02:18:44.961435+0000","last_became_active":"2023-10-06T02:18:44.961289+0000","last_became_peered":"2023-10-06T02:18:44.961289+0000","last_unstale":"2023-10-06T02:18:44.961435+0000","last_undegraded":"2023-10-06T02:18:44.961435+0000","last_fullsized":"2023-10-06T02:18:44.961435+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:01.752107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.941552+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:18:43.941552+0000","last_peered":"2023-10-06T02:18:43.941552+0000","last_clean":"2023-10-06T02:18:43.941552+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:18:43.941552+0000","last_undegraded":"2023-10-06T02:18:43.941552+0000","last_fullsized":"2023-10-06T02:18:43.941552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:18:44.935002+0000","last_change":"2023-10-06T02:18:44.943232+0000","last_active":"2023-10-06T02:18:44.935002+0000","last_peered":"2023-10-06T02:18:44.935002+0000","last_clean":"2023-10-06T02:18:44.935002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:18:44.935002+0000","last_undegraded":"2023-10-06T02:18:44.935002+0000","last_fullsized":"2023-10-06T02:18:44.935002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:53.401386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T02:18:44.958969+0000","last_change":"2023-10-06T02:18:44.958969+0000","last_active":"2023-10-06T02:18:44.958969+0000","last_peered":"2023-10-06T02:18:44.958969+0000","last_clean":"2023-10-06T02:18:44.958969+0000","last_became_active":"2023-10-06T02:18:44.958782+0000","last_became_peered":"2023-10-06T02:18:44.958782+0000","last_unstale":"2023-10-06T02:18:44.958969+0000","last_undegraded":"2023-10-06T02:18:44.958969+0000","last_fullsized":"2023-10-06T02:18:44.958969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:47.153725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T02:18:43.941741+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:18:43.941741+0000","last_peered":"2023-10-06T02:18:43.941741+0000","last_clean":"2023-10-06T02:18:43.941741+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:18:43.941741+0000","last_undegraded":"2023-10-06T02:18:43.941741+0000","last_fullsized":"2023-10-06T02:18:43.941741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298284,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073556,"statfs":{"total":96636764160,"available":96331321344,"internally_reserved":0,"allocated":1019904,"data_stored":777613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.58799999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.45200000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.499}]},{"osd":6,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.621}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":421888,"data_stored":186292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":5.6929999999999996,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":5.7060000000000004,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.628}]},{"osd":2,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":8.8659999999999997,"5min":8.8659999999999997,"15min":8.8659999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":10.659000000000001,"5min":10.659000000000001,"15min":10.659000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65400000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.748},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.80500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298268,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073572,"statfs":{"total":96636764160,"available":96331337728,"internally_reserved":0,"allocated":1003520,"data_stored":769732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.34300000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.33500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.30299999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51800000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":187245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.377,"5min":0.377,"15min":0.377},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.376,"5min":0.376,"15min":0.376},"last":0.30199999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.377}]},{"osd":4,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.70099999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":11.138,"5min":11.138,"15min":11.138},"last":0.625},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":421888,"data_stored":186292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.31900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.373}]},{"osd":3,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.46899999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48399999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.44800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":187245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.311}]},{"osd":4,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.52100000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.57699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":187245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":17.879999999999999,"5min":17.879999999999999,"15min":17.879999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":18.010999999999999,"5min":18.010999999999999,"15min":18.010999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.49299999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.624},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":180317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.59999999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.436}]},{"osd":6,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.628}]},{"osd":7,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.503},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:18:54.692 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:18:54.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.825+0000 7f9a25043700 1 Processor -- start 2023-10-06T02:18:54.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.825+0000 7f9a25043700 1 -- start start 2023-10-06T02:18:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.825+0000 7f9a25043700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a200af4e0 0x7f9a200b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.825+0000 7f9a25043700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9a2015db70 0x7f9a200b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.825+0000 7f9a25043700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2015e190 con 0x7f9a200af8b0 2023-10-06T02:18:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.825+0000 7f9a25043700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a200b1910 con 0x7f9a2015db70 2023-10-06T02:18:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.825+0000 7f9a25043700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2015dfb0 con 0x7f9a200af4e0 2023-10-06T02:18:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.826+0000 7f9a1ed9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a200af4e0 0x7f9a200b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.826+0000 7f9a1ed9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a200af4e0 0x7f9a200b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:43094/0 (socket says 172.21.15.6:43094) 2023-10-06T02:18:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.826+0000 7f9a1f59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9a2015db70 0x7f9a200b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.826+0000 7f9a1ed9d700 1 -- 172.21.15.6:0/2702924486 learned_addr learned my addr 172.21.15.6:0/2702924486 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.826+0000 7f9a1f59e700 1 -- 172.21.15.6:0/2702924486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a200af4e0 msgr2=0x7f9a200b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.826+0000 7f9a1f59e700 1 --2- 172.21.15.6:0/2702924486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a200af4e0 0x7f9a200b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:54.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.826+0000 7f9a1f59e700 1 -- 172.21.15.6:0/2702924486 >> v1:172.21.15.175:6789/0 conn(0x7f9a200af8b0 legacy=0x7f9a2015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:54.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.826+0000 7f9a1f59e700 1 -- 172.21.15.6:0/2702924486 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a200cb650 con 0x7f9a2015db70 2023-10-06T02:18:54.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.826+0000 7f9a1dd9b700 1 -- 172.21.15.6:0/2702924486 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2445016349 0 0) 0x7f9a2015e190 con 0x7f9a200af8b0 2023-10-06T02:18:54.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.826+0000 7f9a1ed9d700 1 --2- 172.21.15.6:0/2702924486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a200af4e0 0x7f9a200b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:54.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.826+0000 7f9a1f59e700 1 --2- 172.21.15.6:0/2702924486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a2015db70 0x7f9a200b2620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009e60 tx=0x7f9a10009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d081081ecc779c53 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:54.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.827+0000 7f9a1dd9b700 1 -- 172.21.15.6:0/2702924486 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000e070 con 0x7f9a2015db70 2023-10-06T02:18:54.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.827+0000 7f9a1dd9b700 1 -- 172.21.15.6:0/2702924486 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1000bb60 con 0x7f9a2015db70 2023-10-06T02:18:54.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.827+0000 7f9a1dd9b700 1 -- 172.21.15.6:0/2702924486 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10012430 con 0x7f9a2015db70 2023-10-06T02:18:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.827+0000 7f9a25043700 1 -- 172.21.15.6:0/2702924486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a2015db70 msgr2=0x7f9a200b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.827+0000 7f9a25043700 1 --2- 172.21.15.6:0/2702924486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a2015db70 0x7f9a200b2620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009e60 tx=0x7f9a10009780 comp rx=0 tx=0).stop 2023-10-06T02:18:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.827+0000 7f9a25043700 1 -- 172.21.15.6:0/2702924486 shutdown_connections 2023-10-06T02:18:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.827+0000 7f9a25043700 1 --2- 172.21.15.6:0/2702924486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a2015db70 0x7f9a200b2620 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.827+0000 7f9a25043700 1 --2- 172.21.15.6:0/2702924486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a200af4e0 0x7f9a200b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.827+0000 7f9a25043700 1 -- 172.21.15.6:0/2702924486 >> 172.21.15.6:0/2702924486 conn(0x7f9a20068680 msgr2=0x7f9a20068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.827+0000 7f9a25043700 1 -- 172.21.15.6:0/2702924486 shutdown_connections 2023-10-06T02:18:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.827+0000 7f9a25043700 1 -- 172.21.15.6:0/2702924486 wait complete. 2023-10-06T02:18:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.829+0000 7f9a25043700 1 Processor -- start 2023-10-06T02:18:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.829+0000 7f9a25043700 1 -- start start 2023-10-06T02:18:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.829+0000 7f9a25043700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a200af4e0 0x7f9a2014e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.829+0000 7f9a25043700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a200af8b0 0x7f9a200a76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.829+0000 7f9a25043700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a2015db70 0x7f9a200b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.829+0000 7f9a25043700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a200a8dc0 con 0x7f9a200af8b0 2023-10-06T02:18:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.829+0000 7f9a25043700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a200a81b0 con 0x7f9a200af4e0 2023-10-06T02:18:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.829+0000 7f9a25043700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a200a8490 con 0x7f9a2015db70 2023-10-06T02:18:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.829+0000 7f9a1e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a200af8b0 0x7f9a200a76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.829+0000 7f9a1e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a200af8b0 0x7f9a200a76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41640/0 (socket says 172.21.15.6:41640) 2023-10-06T02:18:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.830+0000 7f9a1e59c700 1 -- 172.21.15.6:0/3295099065 learned_addr learned my addr 172.21.15.6:0/3295099065 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.830+0000 7f9a1ed9d700 1 --2- 172.21.15.6:0/3295099065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a200af4e0 0x7f9a2014e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.830+0000 7f9a1f59e700 1 --2- 172.21.15.6:0/3295099065 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a2015db70 0x7f9a200b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.830+0000 7f9a1e59c700 1 -- 172.21.15.6:0/3295099065 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a2015db70 msgr2=0x7f9a200b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.830+0000 7f9a1e59c700 1 --2- 172.21.15.6:0/3295099065 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a2015db70 0x7f9a200b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.830+0000 7f9a1e59c700 1 -- 172.21.15.6:0/3295099065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a200af4e0 msgr2=0x7f9a2014e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.830+0000 7f9a1e59c700 1 --2- 172.21.15.6:0/3295099065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a200af4e0 0x7f9a2014e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.830+0000 7f9a1e59c700 1 -- 172.21.15.6:0/3295099065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a180094f0 con 0x7f9a200af8b0 2023-10-06T02:18:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.830+0000 7f9a1e59c700 1 --2- 172.21.15.6:0/3295099065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a200af8b0 0x7f9a200a76e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800c7e0 tx=0x7f9a08007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.830+0000 7f9a16ffd700 1 -- 172.21.15.6:0/3295099065 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08011590 con 0x7f9a200af8b0 2023-10-06T02:18:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.830+0000 7f9a16ffd700 1 -- 172.21.15.6:0/3295099065 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a08011710 con 0x7f9a200af8b0 2023-10-06T02:18:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.830+0000 7f9a25043700 1 -- 172.21.15.6:0/3295099065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a10009a20 con 0x7f9a200af8b0 2023-10-06T02:18:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.830+0000 7f9a16ffd700 1 -- 172.21.15.6:0/3295099065 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08011ad0 con 0x7f9a200af8b0 2023-10-06T02:18:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.830+0000 7f9a25043700 1 -- 172.21.15.6:0/3295099065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a200a8a50 con 0x7f9a200af8b0 2023-10-06T02:18:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.831+0000 7f9a25043700 1 -- 172.21.15.6:0/3295099065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a200a8f30 con 0x7f9a200af8b0 2023-10-06T02:18:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.832+0000 7f9a16ffd700 1 -- 172.21.15.6:0/3295099065 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a0801b3b0 con 0x7f9a200af8b0 2023-10-06T02:18:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.832+0000 7f9a16ffd700 1 --2- 172.21.15.6:0/3295099065 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9a00066f30 0x7f9a000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.832+0000 7f9a16ffd700 1 -- 172.21.15.6:0/3295099065 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9a08083d10 con 0x7f9a200af8b0 2023-10-06T02:18:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.832+0000 7f9a1ed9d700 1 --2- 172.21.15.6:0/3295099065 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9a00066f30 0x7f9a000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.833+0000 7f9a1ed9d700 1 --2- 172.21.15.6:0/3295099065 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9a00066f30 0x7f9a000693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9a18006d20 tx=0x7f9a18009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:54.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:54.836+0000 7f9a16ffd700 1 -- 172.21.15.6:0/3295099065 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a08050ce0 con 0x7f9a200af8b0 2023-10-06T02:18:55.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.027+0000 7f9a25043700 1 -- 172.21.15.6:0/3295099065 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a200b0910 con 0x7f9a00066f30 2023-10-06T02:18:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.037+0000 7f9a16ffd700 1 -- 172.21.15.6:0/3295099065 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311558 (secure 0 0 0) 0x7f9a200b0910 con 0x7f9a00066f30 2023-10-06T02:18:55.041 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.040+0000 7f9a25043700 1 -- 172.21.15.6:0/3295099065 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9a00066f30 msgr2=0x7f9a000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.040+0000 7f9a25043700 1 --2- 172.21.15.6:0/3295099065 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9a00066f30 0x7f9a000693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9a18006d20 tx=0x7f9a18009250 comp rx=0 tx=0).stop 2023-10-06T02:18:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.040+0000 7f9a25043700 1 -- 172.21.15.6:0/3295099065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a200af8b0 msgr2=0x7f9a200a76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.040+0000 7f9a25043700 1 --2- 172.21.15.6:0/3295099065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a200af8b0 0x7f9a200a76e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800c7e0 tx=0x7f9a08007da0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.040+0000 7f9a25043700 1 -- 172.21.15.6:0/3295099065 shutdown_connections 2023-10-06T02:18:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.040+0000 7f9a25043700 1 --2- 172.21.15.6:0/3295099065 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a2015db70 0x7f9a200b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.040+0000 7f9a25043700 1 --2- 172.21.15.6:0/3295099065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a200af4e0 0x7f9a2014e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.040+0000 7f9a25043700 1 --2- 172.21.15.6:0/3295099065 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9a00066f30 0x7f9a000693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.040+0000 7f9a25043700 1 --2- 172.21.15.6:0/3295099065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a200af8b0 0x7f9a200a76e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.040+0000 7f9a25043700 1 -- 172.21.15.6:0/3295099065 >> 172.21.15.6:0/3295099065 conn(0x7f9a20068680 msgr2=0x7f9a2015c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.040+0000 7f9a25043700 1 -- 172.21.15.6:0/3295099065 shutdown_connections 2023-10-06T02:18:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.040+0000 7f9a25043700 1 -- 172.21.15.6:0/3295099065 wait complete. 2023-10-06T02:18:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:18:55.052 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-10-06T02:18:54.576683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383036,"kb_used_data":4732,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591684,"statfs":{"total":773094113280,"available":770653884416,"internally_reserved":0,"allocated":4845568,"data_stored":2795625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.606002"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.995781+0000","last_change":"2023-10-06T02:18:45.993644+0000","last_active":"2023-10-06T02:18:45.995781+0000","last_peered":"2023-10-06T02:18:45.995781+0000","last_clean":"2023-10-06T02:18:45.995781+0000","last_became_active":"2023-10-06T02:18:45.993048+0000","last_became_peered":"2023-10-06T02:18:45.993048+0000","last_unstale":"2023-10-06T02:18:45.995781+0000","last_undegraded":"2023-10-06T02:18:45.995781+0000","last_fullsized":"2023-10-06T02:18:45.995781+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:12.175857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.989467+0000","last_change":"2023-10-06T02:18:45.985061+0000","last_active":"2023-10-06T02:18:45.989467+0000","last_peered":"2023-10-06T02:18:45.989467+0000","last_clean":"2023-10-06T02:18:45.989467+0000","last_became_active":"2023-10-06T02:18:45.984763+0000","last_became_peered":"2023-10-06T02:18:45.984763+0000","last_unstale":"2023-10-06T02:18:45.989467+0000","last_undegraded":"2023-10-06T02:18:45.989467+0000","last_fullsized":"2023-10-06T02:18:45.989467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:12.175857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.982771+0000","last_change":"2023-10-06T02:18:45.981623+0000","last_active":"2023-10-06T02:18:45.982771+0000","last_peered":"2023-10-06T02:18:45.982771+0000","last_clean":"2023-10-06T02:18:45.982771+0000","last_became_active":"2023-10-06T02:18:45.981354+0000","last_became_peered":"2023-10-06T02:18:45.981354+0000","last_unstale":"2023-10-06T02:18:45.982771+0000","last_undegraded":"2023-10-06T02:18:45.982771+0000","last_fullsized":"2023-10-06T02:18:45.982771+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:33.052602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.997210+0000","last_change":"2023-10-06T02:18:45.988722+0000","last_active":"2023-10-06T02:18:45.997210+0000","last_peered":"2023-10-06T02:18:45.997210+0000","last_clean":"2023-10-06T02:18:45.997210+0000","last_became_active":"2023-10-06T02:18:45.988444+0000","last_became_peered":"2023-10-06T02:18:45.988444+0000","last_unstale":"2023-10-06T02:18:45.997210+0000","last_undegraded":"2023-10-06T02:18:45.997210+0000","last_fullsized":"2023-10-06T02:18:45.997210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:29.157909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.989604+0000","last_change":"2023-10-06T02:18:45.983998+0000","last_active":"2023-10-06T02:18:45.989604+0000","last_peered":"2023-10-06T02:18:45.989604+0000","last_clean":"2023-10-06T02:18:45.989604+0000","last_became_active":"2023-10-06T02:18:45.983706+0000","last_became_peered":"2023-10-06T02:18:45.983706+0000","last_unstale":"2023-10-06T02:18:45.989604+0000","last_undegraded":"2023-10-06T02:18:45.989604+0000","last_fullsized":"2023-10-06T02:18:45.989604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:15.434297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.997363+0000","last_change":"2023-10-06T02:18:45.995164+0000","last_active":"2023-10-06T02:18:45.997363+0000","last_peered":"2023-10-06T02:18:45.997363+0000","last_clean":"2023-10-06T02:18:45.997363+0000","last_became_active":"2023-10-06T02:18:45.994942+0000","last_became_peered":"2023-10-06T02:18:45.994942+0000","last_unstale":"2023-10-06T02:18:45.997363+0000","last_undegraded":"2023-10-06T02:18:45.997363+0000","last_fullsized":"2023-10-06T02:18:45.997363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:31.714237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.996254+0000","last_change":"2023-10-06T02:18:45.995558+0000","last_active":"2023-10-06T02:18:45.996254+0000","last_peered":"2023-10-06T02:18:45.996254+0000","last_clean":"2023-10-06T02:18:45.996254+0000","last_became_active":"2023-10-06T02:18:45.995242+0000","last_became_peered":"2023-10-06T02:18:45.995242+0000","last_unstale":"2023-10-06T02:18:45.996254+0000","last_undegraded":"2023-10-06T02:18:45.996254+0000","last_fullsized":"2023-10-06T02:18:45.996254+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:20.287441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.997288+0000","last_change":"2023-10-06T02:18:45.988557+0000","last_active":"2023-10-06T02:18:45.997288+0000","last_peered":"2023-10-06T02:18:45.997288+0000","last_clean":"2023-10-06T02:18:45.997288+0000","last_became_active":"2023-10-06T02:18:45.987975+0000","last_became_peered":"2023-10-06T02:18:45.987975+0000","last_unstale":"2023-10-06T02:18:45.997288+0000","last_undegraded":"2023-10-06T02:18:45.997288+0000","last_fullsized":"2023-10-06T02:18:45.997288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:38.289800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.984292+0000","last_change":"2023-10-06T02:18:45.981794+0000","last_active":"2023-10-06T02:18:45.984292+0000","last_peered":"2023-10-06T02:18:45.984292+0000","last_clean":"2023-10-06T02:18:45.984292+0000","last_became_active":"2023-10-06T02:18:45.981194+0000","last_became_peered":"2023-10-06T02:18:45.981194+0000","last_unstale":"2023-10-06T02:18:45.984292+0000","last_undegraded":"2023-10-06T02:18:45.984292+0000","last_fullsized":"2023-10-06T02:18:45.984292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:06.448305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.995972+0000","last_change":"2023-10-06T02:18:45.988275+0000","last_active":"2023-10-06T02:18:45.995972+0000","last_peered":"2023-10-06T02:18:45.995972+0000","last_clean":"2023-10-06T02:18:45.995972+0000","last_became_active":"2023-10-06T02:18:45.987982+0000","last_became_peered":"2023-10-06T02:18:45.987982+0000","last_unstale":"2023-10-06T02:18:45.995972+0000","last_undegraded":"2023-10-06T02:18:45.995972+0000","last_fullsized":"2023-10-06T02:18:45.995972+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:24.267409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.985103+0000","last_change":"2023-10-06T02:18:45.979453+0000","last_active":"2023-10-06T02:18:45.985103+0000","last_peered":"2023-10-06T02:18:45.985103+0000","last_clean":"2023-10-06T02:18:45.985103+0000","last_became_active":"2023-10-06T02:18:45.979129+0000","last_became_peered":"2023-10-06T02:18:45.979129+0000","last_unstale":"2023-10-06T02:18:45.985103+0000","last_undegraded":"2023-10-06T02:18:45.985103+0000","last_fullsized":"2023-10-06T02:18:45.985103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:01.893468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.992568+0000","last_change":"2023-10-06T02:18:45.991176+0000","last_active":"2023-10-06T02:18:45.992568+0000","last_peered":"2023-10-06T02:18:45.992568+0000","last_clean":"2023-10-06T02:18:45.992568+0000","last_became_active":"2023-10-06T02:18:45.990725+0000","last_became_peered":"2023-10-06T02:18:45.990725+0000","last_unstale":"2023-10-06T02:18:45.992568+0000","last_undegraded":"2023-10-06T02:18:45.992568+0000","last_fullsized":"2023-10-06T02:18:45.992568+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:20.287441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.996996+0000","last_change":"2023-10-06T02:18:45.994601+0000","last_active":"2023-10-06T02:18:45.996996+0000","last_peered":"2023-10-06T02:18:45.996996+0000","last_clean":"2023-10-06T02:18:45.996996+0000","last_became_active":"2023-10-06T02:18:45.994318+0000","last_became_peered":"2023-10-06T02:18:45.994318+0000","last_unstale":"2023-10-06T02:18:45.996996+0000","last_undegraded":"2023-10-06T02:18:45.996996+0000","last_fullsized":"2023-10-06T02:18:45.996996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:39.207450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.984319+0000","last_change":"2023-10-06T02:18:45.979315+0000","last_active":"2023-10-06T02:18:45.984319+0000","last_peered":"2023-10-06T02:18:45.984319+0000","last_clean":"2023-10-06T02:18:45.984319+0000","last_became_active":"2023-10-06T02:18:45.978967+0000","last_became_peered":"2023-10-06T02:18:45.978967+0000","last_unstale":"2023-10-06T02:18:45.984319+0000","last_undegraded":"2023-10-06T02:18:45.984319+0000","last_fullsized":"2023-10-06T02:18:45.984319+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:53.401386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.995355+0000","last_change":"2023-10-06T02:18:45.985545+0000","last_active":"2023-10-06T02:18:45.995355+0000","last_peered":"2023-10-06T02:18:45.995355+0000","last_clean":"2023-10-06T02:18:45.995355+0000","last_became_active":"2023-10-06T02:18:45.985055+0000","last_became_peered":"2023-10-06T02:18:45.985055+0000","last_unstale":"2023-10-06T02:18:45.995355+0000","last_undegraded":"2023-10-06T02:18:45.995355+0000","last_fullsized":"2023-10-06T02:18:45.995355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:32:43.479197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.986652+0000","last_change":"2023-10-06T02:18:45.981533+0000","last_active":"2023-10-06T02:18:45.986652+0000","last_peered":"2023-10-06T02:18:45.986652+0000","last_clean":"2023-10-06T02:18:45.986652+0000","last_became_active":"2023-10-06T02:18:45.981275+0000","last_became_peered":"2023-10-06T02:18:45.981275+0000","last_unstale":"2023-10-06T02:18:45.986652+0000","last_undegraded":"2023-10-06T02:18:45.986652+0000","last_fullsized":"2023-10-06T02:18:45.986652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:30.646258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.991628+0000","last_change":"2023-10-06T02:18:45.988030+0000","last_active":"2023-10-06T02:18:45.991628+0000","last_peered":"2023-10-06T02:18:45.991628+0000","last_clean":"2023-10-06T02:18:45.991628+0000","last_became_active":"2023-10-06T02:18:45.987744+0000","last_became_peered":"2023-10-06T02:18:45.987744+0000","last_unstale":"2023-10-06T02:18:45.991628+0000","last_undegraded":"2023-10-06T02:18:45.991628+0000","last_fullsized":"2023-10-06T02:18:45.991628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:47.565159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.991189+0000","last_change":"2023-10-06T02:18:45.986589+0000","last_active":"2023-10-06T02:18:45.991189+0000","last_peered":"2023-10-06T02:18:45.991189+0000","last_clean":"2023-10-06T02:18:45.991189+0000","last_became_active":"2023-10-06T02:18:45.986151+0000","last_became_peered":"2023-10-06T02:18:45.986151+0000","last_unstale":"2023-10-06T02:18:45.991189+0000","last_undegraded":"2023-10-06T02:18:45.991189+0000","last_fullsized":"2023-10-06T02:18:45.991189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:58.286369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.986353+0000","last_change":"2023-10-06T02:18:45.981285+0000","last_active":"2023-10-06T02:18:45.986353+0000","last_peered":"2023-10-06T02:18:45.986353+0000","last_clean":"2023-10-06T02:18:45.986353+0000","last_became_active":"2023-10-06T02:18:45.980994+0000","last_became_peered":"2023-10-06T02:18:45.980994+0000","last_unstale":"2023-10-06T02:18:45.986353+0000","last_undegraded":"2023-10-06T02:18:45.986353+0000","last_fullsized":"2023-10-06T02:18:45.986353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:47.458786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.994003+0000","last_change":"2023-10-06T02:18:45.989640+0000","last_active":"2023-10-06T02:18:45.994003+0000","last_peered":"2023-10-06T02:18:45.994003+0000","last_clean":"2023-10-06T02:18:45.994003+0000","last_became_active":"2023-10-06T02:18:45.989366+0000","last_became_peered":"2023-10-06T02:18:45.989366+0000","last_unstale":"2023-10-06T02:18:45.994003+0000","last_undegraded":"2023-10-06T02:18:45.994003+0000","last_fullsized":"2023-10-06T02:18:45.994003+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:26.541010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.993988+0000","last_change":"2023-10-06T02:18:45.984009+0000","last_active":"2023-10-06T02:18:45.993988+0000","last_peered":"2023-10-06T02:18:45.993988+0000","last_clean":"2023-10-06T02:18:45.993988+0000","last_became_active":"2023-10-06T02:18:45.983745+0000","last_became_peered":"2023-10-06T02:18:45.983745+0000","last_unstale":"2023-10-06T02:18:45.993988+0000","last_undegraded":"2023-10-06T02:18:45.993988+0000","last_fullsized":"2023-10-06T02:18:45.993988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:33.052602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.996036+0000","last_change":"2023-10-06T02:18:45.988333+0000","last_active":"2023-10-06T02:18:45.996036+0000","last_peered":"2023-10-06T02:18:45.996036+0000","last_clean":"2023-10-06T02:18:45.996036+0000","last_became_active":"2023-10-06T02:18:45.988009+0000","last_became_peered":"2023-10-06T02:18:45.988009+0000","last_unstale":"2023-10-06T02:18:45.996036+0000","last_undegraded":"2023-10-06T02:18:45.996036+0000","last_fullsized":"2023-10-06T02:18:45.996036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:56.622088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.991679+0000","last_change":"2023-10-06T02:18:45.988169+0000","last_active":"2023-10-06T02:18:45.991679+0000","last_peered":"2023-10-06T02:18:45.991679+0000","last_clean":"2023-10-06T02:18:45.991679+0000","last_became_active":"2023-10-06T02:18:45.987901+0000","last_became_peered":"2023-10-06T02:18:45.987901+0000","last_unstale":"2023-10-06T02:18:45.991679+0000","last_undegraded":"2023-10-06T02:18:45.991679+0000","last_fullsized":"2023-10-06T02:18:45.991679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:39.207450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.992313+0000","last_change":"2023-10-06T02:18:45.991472+0000","last_active":"2023-10-06T02:18:45.992313+0000","last_peered":"2023-10-06T02:18:45.992313+0000","last_clean":"2023-10-06T02:18:45.992313+0000","last_became_active":"2023-10-06T02:18:45.991247+0000","last_became_peered":"2023-10-06T02:18:45.991247+0000","last_unstale":"2023-10-06T02:18:45.992313+0000","last_undegraded":"2023-10-06T02:18:45.992313+0000","last_fullsized":"2023-10-06T02:18:45.992313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:42.736759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.986982+0000","last_change":"2023-10-06T02:18:45.978388+0000","last_active":"2023-10-06T02:18:45.986982+0000","last_peered":"2023-10-06T02:18:45.986982+0000","last_clean":"2023-10-06T02:18:45.986982+0000","last_became_active":"2023-10-06T02:18:45.978087+0000","last_became_peered":"2023-10-06T02:18:45.978087+0000","last_unstale":"2023-10-06T02:18:45.986982+0000","last_undegraded":"2023-10-06T02:18:45.986982+0000","last_fullsized":"2023-10-06T02:18:45.986982+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:26.541010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.997029+0000","last_change":"2023-10-06T02:18:45.994730+0000","last_active":"2023-10-06T02:18:45.997029+0000","last_peered":"2023-10-06T02:18:45.997029+0000","last_clean":"2023-10-06T02:18:45.997029+0000","last_became_active":"2023-10-06T02:18:45.994324+0000","last_became_peered":"2023-10-06T02:18:45.994324+0000","last_unstale":"2023-10-06T02:18:45.997029+0000","last_undegraded":"2023-10-06T02:18:45.997029+0000","last_fullsized":"2023-10-06T02:18:45.997029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:36.158786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.991133+0000","last_change":"2023-10-06T02:18:45.987481+0000","last_active":"2023-10-06T02:18:45.991133+0000","last_peered":"2023-10-06T02:18:45.991133+0000","last_clean":"2023-10-06T02:18:45.991133+0000","last_became_active":"2023-10-06T02:18:45.987233+0000","last_became_peered":"2023-10-06T02:18:45.987233+0000","last_unstale":"2023-10-06T02:18:45.991133+0000","last_undegraded":"2023-10-06T02:18:45.991133+0000","last_fullsized":"2023-10-06T02:18:45.991133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:31.714237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.992552+0000","last_change":"2023-10-06T02:18:45.990991+0000","last_active":"2023-10-06T02:18:45.992552+0000","last_peered":"2023-10-06T02:18:45.992552+0000","last_clean":"2023-10-06T02:18:45.992552+0000","last_became_active":"2023-10-06T02:18:45.990402+0000","last_became_peered":"2023-10-06T02:18:45.990402+0000","last_unstale":"2023-10-06T02:18:45.992552+0000","last_undegraded":"2023-10-06T02:18:45.992552+0000","last_fullsized":"2023-10-06T02:18:45.992552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:06.448305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.986294+0000","last_change":"2023-10-06T02:18:45.979069+0000","last_active":"2023-10-06T02:18:45.986294+0000","last_peered":"2023-10-06T02:18:45.986294+0000","last_clean":"2023-10-06T02:18:45.986294+0000","last_became_active":"2023-10-06T02:18:45.978782+0000","last_became_peered":"2023-10-06T02:18:45.978782+0000","last_unstale":"2023-10-06T02:18:45.986294+0000","last_undegraded":"2023-10-06T02:18:45.986294+0000","last_fullsized":"2023-10-06T02:18:45.986294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:21.331354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.994972+0000","last_change":"2023-10-06T02:18:45.994169+0000","last_active":"2023-10-06T02:18:45.994972+0000","last_peered":"2023-10-06T02:18:45.994972+0000","last_clean":"2023-10-06T02:18:45.994972+0000","last_became_active":"2023-10-06T02:18:45.993925+0000","last_became_peered":"2023-10-06T02:18:45.993925+0000","last_unstale":"2023-10-06T02:18:45.994972+0000","last_undegraded":"2023-10-06T02:18:45.994972+0000","last_fullsized":"2023-10-06T02:18:45.994972+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:44.354367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.995389+0000","last_change":"2023-10-06T02:18:45.986555+0000","last_active":"2023-10-06T02:18:45.995389+0000","last_peered":"2023-10-06T02:18:45.995389+0000","last_clean":"2023-10-06T02:18:45.995389+0000","last_became_active":"2023-10-06T02:18:45.986284+0000","last_became_peered":"2023-10-06T02:18:45.986284+0000","last_unstale":"2023-10-06T02:18:45.995389+0000","last_undegraded":"2023-10-06T02:18:45.995389+0000","last_fullsized":"2023-10-06T02:18:45.995389+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:58.286369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.992757+0000","last_change":"2023-10-06T02:18:45.986030+0000","last_active":"2023-10-06T02:18:45.992757+0000","last_peered":"2023-10-06T02:18:45.992757+0000","last_clean":"2023-10-06T02:18:45.992757+0000","last_became_active":"2023-10-06T02:18:45.985759+0000","last_became_peered":"2023-10-06T02:18:45.985759+0000","last_unstale":"2023-10-06T02:18:45.992757+0000","last_undegraded":"2023-10-06T02:18:45.992757+0000","last_fullsized":"2023-10-06T02:18:45.992757+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:02.754107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.985086+0000","last_change":"2023-10-06T02:18:45.980050+0000","last_active":"2023-10-06T02:18:45.985086+0000","last_peered":"2023-10-06T02:18:45.985086+0000","last_clean":"2023-10-06T02:18:45.985086+0000","last_became_active":"2023-10-06T02:18:45.979798+0000","last_became_peered":"2023-10-06T02:18:45.979798+0000","last_unstale":"2023-10-06T02:18:45.985086+0000","last_undegraded":"2023-10-06T02:18:45.985086+0000","last_fullsized":"2023-10-06T02:18:45.985086+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:00.131461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:46.006152+0000","last_change":"2023-10-06T02:18:44.960473+0000","last_active":"2023-10-06T02:18:46.006152+0000","last_peered":"2023-10-06T02:18:46.006152+0000","last_clean":"2023-10-06T02:18:46.006152+0000","last_became_active":"2023-10-06T02:18:44.960009+0000","last_became_peered":"2023-10-06T02:18:44.960009+0000","last_unstale":"2023-10-06T02:18:46.006152+0000","last_undegraded":"2023-10-06T02:18:46.006152+0000","last_fullsized":"2023-10-06T02:18:46.006152+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:20.624772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.991470+0000","last_change":"2023-10-06T02:18:45.983547+0000","last_active":"2023-10-06T02:18:45.991470+0000","last_peered":"2023-10-06T02:18:45.991470+0000","last_clean":"2023-10-06T02:18:45.991470+0000","last_became_active":"2023-10-06T02:18:45.983249+0000","last_became_peered":"2023-10-06T02:18:45.983249+0000","last_unstale":"2023-10-06T02:18:45.991470+0000","last_undegraded":"2023-10-06T02:18:45.991470+0000","last_fullsized":"2023-10-06T02:18:45.991470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:17.470803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:46.001992+0000","last_change":"2023-10-06T02:18:44.958493+0000","last_active":"2023-10-06T02:18:46.001992+0000","last_peered":"2023-10-06T02:18:46.001992+0000","last_clean":"2023-10-06T02:18:46.001992+0000","last_became_active":"2023-10-06T02:18:44.958170+0000","last_became_peered":"2023-10-06T02:18:44.958170+0000","last_unstale":"2023-10-06T02:18:46.001992+0000","last_undegraded":"2023-10-06T02:18:46.001992+0000","last_fullsized":"2023-10-06T02:18:46.001992+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:27.390538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.989437+0000","last_change":"2023-10-06T02:18:45.984392+0000","last_active":"2023-10-06T02:18:45.989437+0000","last_peered":"2023-10-06T02:18:45.989437+0000","last_clean":"2023-10-06T02:18:45.989437+0000","last_became_active":"2023-10-06T02:18:45.984109+0000","last_became_peered":"2023-10-06T02:18:45.984109+0000","last_unstale":"2023-10-06T02:18:45.989437+0000","last_undegraded":"2023-10-06T02:18:45.989437+0000","last_fullsized":"2023-10-06T02:18:45.989437+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:28.392538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:46.005496+0000","last_change":"2023-10-06T02:18:44.961055+0000","last_active":"2023-10-06T02:18:46.005496+0000","last_peered":"2023-10-06T02:18:46.005496+0000","last_clean":"2023-10-06T02:18:46.005496+0000","last_became_active":"2023-10-06T02:18:44.960851+0000","last_became_peered":"2023-10-06T02:18:44.960851+0000","last_unstale":"2023-10-06T02:18:46.005496+0000","last_undegraded":"2023-10-06T02:18:46.005496+0000","last_fullsized":"2023-10-06T02:18:46.005496+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:47.153725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.993530+0000","last_change":"2023-10-06T02:18:45.987747+0000","last_active":"2023-10-06T02:18:45.993530+0000","last_peered":"2023-10-06T02:18:45.993530+0000","last_clean":"2023-10-06T02:18:45.993530+0000","last_became_active":"2023-10-06T02:18:45.986993+0000","last_became_peered":"2023-10-06T02:18:45.986993+0000","last_unstale":"2023-10-06T02:18:45.993530+0000","last_undegraded":"2023-10-06T02:18:45.993530+0000","last_fullsized":"2023-10-06T02:18:45.993530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:30.646258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:46.003797+0000","last_change":"2023-10-06T02:18:44.959383+0000","last_active":"2023-10-06T02:18:46.003797+0000","last_peered":"2023-10-06T02:18:46.003797+0000","last_clean":"2023-10-06T02:18:46.003797+0000","last_became_active":"2023-10-06T02:18:44.959073+0000","last_became_peered":"2023-10-06T02:18:44.959073+0000","last_unstale":"2023-10-06T02:18:46.003797+0000","last_undegraded":"2023-10-06T02:18:46.003797+0000","last_fullsized":"2023-10-06T02:18:46.003797+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:45.271368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.991504+0000","last_change":"2023-10-06T02:18:45.988130+0000","last_active":"2023-10-06T02:18:45.991504+0000","last_peered":"2023-10-06T02:18:45.991504+0000","last_clean":"2023-10-06T02:18:45.991504+0000","last_became_active":"2023-10-06T02:18:45.987789+0000","last_became_peered":"2023-10-06T02:18:45.987789+0000","last_unstale":"2023-10-06T02:18:45.991504+0000","last_undegraded":"2023-10-06T02:18:45.991504+0000","last_fullsized":"2023-10-06T02:18:45.991504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:39:44.085301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:46.005936+0000","last_change":"2023-10-06T02:18:44.952220+0000","last_active":"2023-10-06T02:18:46.005936+0000","last_peered":"2023-10-06T02:18:46.005936+0000","last_clean":"2023-10-06T02:18:46.005936+0000","last_became_active":"2023-10-06T02:18:44.951937+0000","last_became_peered":"2023-10-06T02:18:44.951937+0000","last_unstale":"2023-10-06T02:18:46.005936+0000","last_undegraded":"2023-10-06T02:18:46.005936+0000","last_fullsized":"2023-10-06T02:18:46.005936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:27.390538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.997268+0000","last_change":"2023-10-06T02:18:45.990896+0000","last_active":"2023-10-06T02:18:45.997268+0000","last_peered":"2023-10-06T02:18:45.997268+0000","last_clean":"2023-10-06T02:18:45.997268+0000","last_became_active":"2023-10-06T02:18:45.990449+0000","last_became_peered":"2023-10-06T02:18:45.990449+0000","last_unstale":"2023-10-06T02:18:45.997268+0000","last_undegraded":"2023-10-06T02:18:45.997268+0000","last_fullsized":"2023-10-06T02:18:45.997268+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:15.148477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:46.002896+0000","last_change":"2023-10-06T02:18:44.952812+0000","last_active":"2023-10-06T02:18:46.002896+0000","last_peered":"2023-10-06T02:18:46.002896+0000","last_clean":"2023-10-06T02:18:46.002896+0000","last_became_active":"2023-10-06T02:18:44.952538+0000","last_became_peered":"2023-10-06T02:18:44.952538+0000","last_unstale":"2023-10-06T02:18:46.002896+0000","last_undegraded":"2023-10-06T02:18:46.002896+0000","last_fullsized":"2023-10-06T02:18:46.002896+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:01.175622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.997310+0000","last_change":"2023-10-06T02:18:45.988746+0000","last_active":"2023-10-06T02:18:45.997310+0000","last_peered":"2023-10-06T02:18:45.997310+0000","last_clean":"2023-10-06T02:18:45.997310+0000","last_became_active":"2023-10-06T02:18:45.988344+0000","last_became_peered":"2023-10-06T02:18:45.988344+0000","last_unstale":"2023-10-06T02:18:45.997310+0000","last_undegraded":"2023-10-06T02:18:45.997310+0000","last_fullsized":"2023-10-06T02:18:45.997310+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:32:43.479197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.981442+0000","last_change":"2023-10-06T02:18:44.950586+0000","last_active":"2023-10-06T02:18:45.981442+0000","last_peered":"2023-10-06T02:18:45.981442+0000","last_clean":"2023-10-06T02:18:45.981442+0000","last_became_active":"2023-10-06T02:18:44.950322+0000","last_became_peered":"2023-10-06T02:18:44.950322+0000","last_unstale":"2023-10-06T02:18:45.981442+0000","last_undegraded":"2023-10-06T02:18:45.981442+0000","last_fullsized":"2023-10-06T02:18:45.981442+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:48.870983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.992042+0000","last_change":"2023-10-06T02:18:45.990688+0000","last_active":"2023-10-06T02:18:45.992042+0000","last_peered":"2023-10-06T02:18:45.992042+0000","last_clean":"2023-10-06T02:18:45.992042+0000","last_became_active":"2023-10-06T02:18:45.990398+0000","last_became_peered":"2023-10-06T02:18:45.990398+0000","last_unstale":"2023-10-06T02:18:45.992042+0000","last_undegraded":"2023-10-06T02:18:45.992042+0000","last_fullsized":"2023-10-06T02:18:45.992042+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:36.158786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.974501+0000","last_change":"2023-10-06T02:18:44.952867+0000","last_active":"2023-10-06T02:18:45.974501+0000","last_peered":"2023-10-06T02:18:45.974501+0000","last_clean":"2023-10-06T02:18:45.974501+0000","last_became_active":"2023-10-06T02:18:44.952582+0000","last_became_peered":"2023-10-06T02:18:44.952582+0000","last_unstale":"2023-10-06T02:18:45.974501+0000","last_undegraded":"2023-10-06T02:18:45.974501+0000","last_fullsized":"2023-10-06T02:18:45.974501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:41.734760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.991168+0000","last_change":"2023-10-06T02:18:45.986408+0000","last_active":"2023-10-06T02:18:45.991168+0000","last_peered":"2023-10-06T02:18:45.991168+0000","last_clean":"2023-10-06T02:18:45.991168+0000","last_became_active":"2023-10-06T02:18:45.985812+0000","last_became_peered":"2023-10-06T02:18:45.985812+0000","last_unstale":"2023-10-06T02:18:45.991168+0000","last_undegraded":"2023-10-06T02:18:45.991168+0000","last_fullsized":"2023-10-06T02:18:45.991168+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:39.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.979591+0000","last_change":"2023-10-06T02:18:44.953410+0000","last_active":"2023-10-06T02:18:45.979591+0000","last_peered":"2023-10-06T02:18:45.979591+0000","last_clean":"2023-10-06T02:18:45.979591+0000","last_became_active":"2023-10-06T02:18:44.953098+0000","last_became_peered":"2023-10-06T02:18:44.953098+0000","last_unstale":"2023-10-06T02:18:45.979591+0000","last_undegraded":"2023-10-06T02:18:45.979591+0000","last_fullsized":"2023-10-06T02:18:45.979591+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:19.285441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.995754+0000","last_change":"2023-10-06T02:18:45.993984+0000","last_active":"2023-10-06T02:18:45.995754+0000","last_peered":"2023-10-06T02:18:45.995754+0000","last_clean":"2023-10-06T02:18:45.995754+0000","last_became_active":"2023-10-06T02:18:45.993676+0000","last_became_peered":"2023-10-06T02:18:45.993676+0000","last_unstale":"2023-10-06T02:18:45.995754+0000","last_undegraded":"2023-10-06T02:18:45.995754+0000","last_fullsized":"2023-10-06T02:18:45.995754+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:06.448305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.976977+0000","last_change":"2023-10-06T02:18:44.958075+0000","last_active":"2023-10-06T02:18:45.976977+0000","last_peered":"2023-10-06T02:18:45.976977+0000","last_clean":"2023-10-06T02:18:45.976977+0000","last_became_active":"2023-10-06T02:18:44.953714+0000","last_became_peered":"2023-10-06T02:18:44.953714+0000","last_unstale":"2023-10-06T02:18:45.976977+0000","last_undegraded":"2023-10-06T02:18:45.976977+0000","last_fullsized":"2023-10-06T02:18:45.976977+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:03.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.997119+0000","last_change":"2023-10-06T02:18:45.990319+0000","last_active":"2023-10-06T02:18:45.997119+0000","last_peered":"2023-10-06T02:18:45.997119+0000","last_clean":"2023-10-06T02:18:45.997119+0000","last_became_active":"2023-10-06T02:18:45.990051+0000","last_became_peered":"2023-10-06T02:18:45.990051+0000","last_unstale":"2023-10-06T02:18:45.997119+0000","last_undegraded":"2023-10-06T02:18:45.997119+0000","last_fullsized":"2023-10-06T02:18:45.997119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:44.354367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:46.002308+0000","last_change":"2023-10-06T02:18:44.957227+0000","last_active":"2023-10-06T02:18:46.002308+0000","last_peered":"2023-10-06T02:18:46.002308+0000","last_clean":"2023-10-06T02:18:46.002308+0000","last_became_active":"2023-10-06T02:18:44.956968+0000","last_became_peered":"2023-10-06T02:18:44.956968+0000","last_unstale":"2023-10-06T02:18:46.002308+0000","last_undegraded":"2023-10-06T02:18:46.002308+0000","last_fullsized":"2023-10-06T02:18:46.002308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:48.870983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.997080+0000","last_change":"2023-10-06T02:18:45.995817+0000","last_active":"2023-10-06T02:18:45.997080+0000","last_peered":"2023-10-06T02:18:45.997080+0000","last_clean":"2023-10-06T02:18:45.997080+0000","last_became_active":"2023-10-06T02:18:45.995580+0000","last_became_peered":"2023-10-06T02:18:45.995580+0000","last_unstale":"2023-10-06T02:18:45.997080+0000","last_undegraded":"2023-10-06T02:18:45.997080+0000","last_fullsized":"2023-10-06T02:18:45.997080+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:53.401386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:46.008075+0000","last_change":"2023-10-06T02:18:44.950113+0000","last_active":"2023-10-06T02:18:46.008075+0000","last_peered":"2023-10-06T02:18:46.008075+0000","last_clean":"2023-10-06T02:18:46.008075+0000","last_became_active":"2023-10-06T02:18:44.949813+0000","last_became_peered":"2023-10-06T02:18:44.949813+0000","last_unstale":"2023-10-06T02:18:46.008075+0000","last_undegraded":"2023-10-06T02:18:46.008075+0000","last_fullsized":"2023-10-06T02:18:46.008075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:00.119797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.991637+0000","last_change":"2023-10-06T02:18:45.983674+0000","last_active":"2023-10-06T02:18:45.991637+0000","last_peered":"2023-10-06T02:18:45.991637+0000","last_clean":"2023-10-06T02:18:45.991637+0000","last_became_active":"2023-10-06T02:18:45.983388+0000","last_became_peered":"2023-10-06T02:18:45.983388+0000","last_unstale":"2023-10-06T02:18:45.991637+0000","last_undegraded":"2023-10-06T02:18:45.991637+0000","last_fullsized":"2023-10-06T02:18:45.991637+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:00.131461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:46.006293+0000","last_change":"2023-10-06T02:18:44.949923+0000","last_active":"2023-10-06T02:18:46.006293+0000","last_peered":"2023-10-06T02:18:46.006293+0000","last_clean":"2023-10-06T02:18:46.006293+0000","last_became_active":"2023-10-06T02:18:44.948547+0000","last_became_peered":"2023-10-06T02:18:44.948547+0000","last_unstale":"2023-10-06T02:18:46.006293+0000","last_undegraded":"2023-10-06T02:18:46.006293+0000","last_fullsized":"2023-10-06T02:18:46.006293+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:05.547045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.997244+0000","last_change":"2023-10-06T02:18:45.989660+0000","last_active":"2023-10-06T02:18:45.997244+0000","last_peered":"2023-10-06T02:18:45.997244+0000","last_clean":"2023-10-06T02:18:45.997244+0000","last_became_active":"2023-10-06T02:18:45.989222+0000","last_became_peered":"2023-10-06T02:18:45.989222+0000","last_unstale":"2023-10-06T02:18:45.997244+0000","last_undegraded":"2023-10-06T02:18:45.997244+0000","last_fullsized":"2023-10-06T02:18:45.997244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:20.287441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.990221+0000","last_change":"2023-10-06T02:18:44.954535+0000","last_active":"2023-10-06T02:18:45.990221+0000","last_peered":"2023-10-06T02:18:45.990221+0000","last_clean":"2023-10-06T02:18:45.990221+0000","last_became_active":"2023-10-06T02:18:44.954254+0000","last_became_peered":"2023-10-06T02:18:44.954254+0000","last_unstale":"2023-10-06T02:18:45.990221+0000","last_undegraded":"2023-10-06T02:18:45.990221+0000","last_fullsized":"2023-10-06T02:18:45.990221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:45.907176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.995493+0000","last_change":"2023-10-06T02:18:45.989697+0000","last_active":"2023-10-06T02:18:45.995493+0000","last_peered":"2023-10-06T02:18:45.995493+0000","last_clean":"2023-10-06T02:18:45.995493+0000","last_became_active":"2023-10-06T02:18:45.989454+0000","last_became_peered":"2023-10-06T02:18:45.989454+0000","last_unstale":"2023-10-06T02:18:45.995493+0000","last_undegraded":"2023-10-06T02:18:45.995493+0000","last_fullsized":"2023-10-06T02:18:45.995493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:46.003001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.969670+0000","last_change":"2023-10-06T02:18:44.949330+0000","last_active":"2023-10-06T02:18:45.969670+0000","last_peered":"2023-10-06T02:18:45.969670+0000","last_clean":"2023-10-06T02:18:45.969670+0000","last_became_active":"2023-10-06T02:18:44.949068+0000","last_became_peered":"2023-10-06T02:18:44.949068+0000","last_unstale":"2023-10-06T02:18:45.969670+0000","last_undegraded":"2023-10-06T02:18:45.969670+0000","last_fullsized":"2023-10-06T02:18:45.969670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:04.437978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.995780+0000","last_change":"2023-10-06T02:18:45.994145+0000","last_active":"2023-10-06T02:18:45.995780+0000","last_peered":"2023-10-06T02:18:45.995780+0000","last_clean":"2023-10-06T02:18:45.995780+0000","last_became_active":"2023-10-06T02:18:45.993394+0000","last_became_peered":"2023-10-06T02:18:45.993394+0000","last_unstale":"2023-10-06T02:18:45.995780+0000","last_undegraded":"2023-10-06T02:18:45.995780+0000","last_fullsized":"2023-10-06T02:18:45.995780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:02.177622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:46.008185+0000","last_change":"2023-10-06T02:18:44.953429+0000","last_active":"2023-10-06T02:18:46.008185+0000","last_peered":"2023-10-06T02:18:46.008185+0000","last_clean":"2023-10-06T02:18:46.008185+0000","last_became_active":"2023-10-06T02:18:44.953157+0000","last_became_peered":"2023-10-06T02:18:44.953157+0000","last_unstale":"2023-10-06T02:18:46.008185+0000","last_undegraded":"2023-10-06T02:18:46.008185+0000","last_fullsized":"2023-10-06T02:18:46.008185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:16.468803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.992782+0000","last_change":"2023-10-06T02:18:45.986748+0000","last_active":"2023-10-06T02:18:45.992782+0000","last_peered":"2023-10-06T02:18:45.992782+0000","last_clean":"2023-10-06T02:18:45.992782+0000","last_became_active":"2023-10-06T02:18:45.986532+0000","last_became_peered":"2023-10-06T02:18:45.986532+0000","last_unstale":"2023-10-06T02:18:45.992782+0000","last_undegraded":"2023-10-06T02:18:45.992782+0000","last_fullsized":"2023-10-06T02:18:45.992782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:21.331354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:46.006401+0000","last_change":"2023-10-06T02:18:44.949507+0000","last_active":"2023-10-06T02:18:46.006401+0000","last_peered":"2023-10-06T02:18:46.006401+0000","last_clean":"2023-10-06T02:18:46.006401+0000","last_became_active":"2023-10-06T02:18:44.949197+0000","last_became_peered":"2023-10-06T02:18:44.949197+0000","last_unstale":"2023-10-06T02:18:46.006401+0000","last_undegraded":"2023-10-06T02:18:46.006401+0000","last_fullsized":"2023-10-06T02:18:46.006401+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:15.195382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.984891+0000","last_change":"2023-10-06T02:18:45.982386+0000","last_active":"2023-10-06T02:18:45.984891+0000","last_peered":"2023-10-06T02:18:45.984891+0000","last_clean":"2023-10-06T02:18:45.984891+0000","last_became_active":"2023-10-06T02:18:45.982095+0000","last_became_peered":"2023-10-06T02:18:45.982095+0000","last_unstale":"2023-10-06T02:18:45.984891+0000","last_undegraded":"2023-10-06T02:18:45.984891+0000","last_fullsized":"2023-10-06T02:18:45.984891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:02.177622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:46.005768+0000","last_change":"2023-10-06T02:18:44.958383+0000","last_active":"2023-10-06T02:18:46.005768+0000","last_peered":"2023-10-06T02:18:46.005768+0000","last_clean":"2023-10-06T02:18:46.005768+0000","last_became_active":"2023-10-06T02:18:44.957808+0000","last_became_peered":"2023-10-06T02:18:44.957808+0000","last_unstale":"2023-10-06T02:18:46.005768+0000","last_undegraded":"2023-10-06T02:18:46.005768+0000","last_fullsized":"2023-10-06T02:18:46.005768+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:11.173858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.987155+0000","last_change":"2023-10-06T02:18:45.980685+0000","last_active":"2023-10-06T02:18:45.987155+0000","last_peered":"2023-10-06T02:18:45.987155+0000","last_clean":"2023-10-06T02:18:45.987155+0000","last_became_active":"2023-10-06T02:18:45.980416+0000","last_became_peered":"2023-10-06T02:18:45.980416+0000","last_unstale":"2023-10-06T02:18:45.987155+0000","last_undegraded":"2023-10-06T02:18:45.987155+0000","last_fullsized":"2023-10-06T02:18:45.987155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:04.146810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:46.005744+0000","last_change":"2023-10-06T02:18:44.957231+0000","last_active":"2023-10-06T02:18:46.005744+0000","last_peered":"2023-10-06T02:18:46.005744+0000","last_clean":"2023-10-06T02:18:46.005744+0000","last_became_active":"2023-10-06T02:18:44.955723+0000","last_became_peered":"2023-10-06T02:18:44.955723+0000","last_unstale":"2023-10-06T02:18:46.005744+0000","last_undegraded":"2023-10-06T02:18:46.005744+0000","last_fullsized":"2023-10-06T02:18:46.005744+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:45.907176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.986332+0000","last_change":"2023-10-06T02:18:45.978487+0000","last_active":"2023-10-06T02:18:45.986332+0000","last_peered":"2023-10-06T02:18:45.986332+0000","last_clean":"2023-10-06T02:18:45.986332+0000","last_became_active":"2023-10-06T02:18:45.978181+0000","last_became_peered":"2023-10-06T02:18:45.978181+0000","last_unstale":"2023-10-06T02:18:45.986332+0000","last_undegraded":"2023-10-06T02:18:45.986332+0000","last_fullsized":"2023-10-06T02:18:45.986332+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:48.155725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.969865+0000","last_change":"2023-10-06T02:18:44.957249+0000","last_active":"2023-10-06T02:18:45.969865+0000","last_peered":"2023-10-06T02:18:45.969865+0000","last_clean":"2023-10-06T02:18:45.969865+0000","last_became_active":"2023-10-06T02:18:44.956928+0000","last_became_peered":"2023-10-06T02:18:44.956928+0000","last_unstale":"2023-10-06T02:18:45.969865+0000","last_undegraded":"2023-10-06T02:18:45.969865+0000","last_fullsized":"2023-10-06T02:18:45.969865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:34.805017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.995655+0000","last_change":"2023-10-06T02:18:45.988905+0000","last_active":"2023-10-06T02:18:45.995655+0000","last_peered":"2023-10-06T02:18:45.995655+0000","last_clean":"2023-10-06T02:18:45.995655+0000","last_became_active":"2023-10-06T02:18:45.988586+0000","last_became_peered":"2023-10-06T02:18:45.988586+0000","last_unstale":"2023-10-06T02:18:45.995655+0000","last_undegraded":"2023-10-06T02:18:45.995655+0000","last_fullsized":"2023-10-06T02:18:45.995655+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:47.565159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:46.006026+0000","last_change":"2023-10-06T02:18:44.960417+0000","last_active":"2023-10-06T02:18:46.006026+0000","last_peered":"2023-10-06T02:18:46.006026+0000","last_clean":"2023-10-06T02:18:46.006026+0000","last_became_active":"2023-10-06T02:18:44.960095+0000","last_became_peered":"2023-10-06T02:18:44.960095+0000","last_unstale":"2023-10-06T02:18:46.006026+0000","last_undegraded":"2023-10-06T02:18:46.006026+0000","last_fullsized":"2023-10-06T02:18:46.006026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:14.146477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.993443+0000","last_change":"2023-10-06T02:18:45.985326+0000","last_active":"2023-10-06T02:18:45.993443+0000","last_peered":"2023-10-06T02:18:45.993443+0000","last_clean":"2023-10-06T02:18:45.993443+0000","last_became_active":"2023-10-06T02:18:45.985080+0000","last_became_peered":"2023-10-06T02:18:45.985080+0000","last_unstale":"2023-10-06T02:18:45.993443+0000","last_undegraded":"2023-10-06T02:18:45.993443+0000","last_fullsized":"2023-10-06T02:18:45.993443+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:56.408624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.981593+0000","last_change":"2023-10-06T02:18:44.955211+0000","last_active":"2023-10-06T02:18:45.981593+0000","last_peered":"2023-10-06T02:18:45.981593+0000","last_clean":"2023-10-06T02:18:45.981593+0000","last_became_active":"2023-10-06T02:18:44.954949+0000","last_became_peered":"2023-10-06T02:18:44.954949+0000","last_unstale":"2023-10-06T02:18:45.981593+0000","last_undegraded":"2023-10-06T02:18:45.981593+0000","last_fullsized":"2023-10-06T02:18:45.981593+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:45.271368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.993740+0000","last_change":"2023-10-06T02:18:45.990454+0000","last_active":"2023-10-06T02:18:45.993740+0000","last_peered":"2023-10-06T02:18:45.993740+0000","last_clean":"2023-10-06T02:18:45.993740+0000","last_became_active":"2023-10-06T02:18:45.990086+0000","last_became_peered":"2023-10-06T02:18:45.990086+0000","last_unstale":"2023-10-06T02:18:45.993740+0000","last_undegraded":"2023-10-06T02:18:45.993740+0000","last_fullsized":"2023-10-06T02:18:45.993740+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:48.155725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.973427+0000","last_change":"2023-10-06T02:18:44.956467+0000","last_active":"2023-10-06T02:18:45.973427+0000","last_peered":"2023-10-06T02:18:45.973427+0000","last_clean":"2023-10-06T02:18:45.973427+0000","last_became_active":"2023-10-06T02:18:44.956221+0000","last_became_peered":"2023-10-06T02:18:44.956221+0000","last_unstale":"2023-10-06T02:18:45.973427+0000","last_undegraded":"2023-10-06T02:18:45.973427+0000","last_fullsized":"2023-10-06T02:18:45.973427+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:20.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.984326+0000","last_change":"2023-10-06T02:18:45.982251+0000","last_active":"2023-10-06T02:18:45.984326+0000","last_peered":"2023-10-06T02:18:45.984326+0000","last_clean":"2023-10-06T02:18:45.984326+0000","last_became_active":"2023-10-06T02:18:45.981819+0000","last_became_peered":"2023-10-06T02:18:45.981819+0000","last_unstale":"2023-10-06T02:18:45.984326+0000","last_undegraded":"2023-10-06T02:18:45.984326+0000","last_fullsized":"2023-10-06T02:18:45.984326+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:12.175857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.989434+0000","last_change":"2023-10-06T02:18:44.955172+0000","last_active":"2023-10-06T02:18:45.989434+0000","last_peered":"2023-10-06T02:18:45.989434+0000","last_clean":"2023-10-06T02:18:45.989434+0000","last_became_active":"2023-10-06T02:18:44.954905+0000","last_became_peered":"2023-10-06T02:18:44.954905+0000","last_unstale":"2023-10-06T02:18:45.989434+0000","last_undegraded":"2023-10-06T02:18:45.989434+0000","last_fullsized":"2023-10-06T02:18:45.989434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:21.902890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.996265+0000","last_change":"2023-10-06T02:18:45.990967+0000","last_active":"2023-10-06T02:18:45.996265+0000","last_peered":"2023-10-06T02:18:45.996265+0000","last_clean":"2023-10-06T02:18:45.996265+0000","last_became_active":"2023-10-06T02:18:45.990712+0000","last_became_peered":"2023-10-06T02:18:45.990712+0000","last_unstale":"2023-10-06T02:18:45.996265+0000","last_undegraded":"2023-10-06T02:18:45.996265+0000","last_fullsized":"2023-10-06T02:18:45.996265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:39.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.977245+0000","last_change":"2023-10-06T02:18:44.954645+0000","last_active":"2023-10-06T02:18:45.977245+0000","last_peered":"2023-10-06T02:18:45.977245+0000","last_clean":"2023-10-06T02:18:45.977245+0000","last_became_active":"2023-10-06T02:18:44.954349+0000","last_became_peered":"2023-10-06T02:18:44.954349+0000","last_unstale":"2023-10-06T02:18:45.977245+0000","last_undegraded":"2023-10-06T02:18:45.977245+0000","last_fullsized":"2023-10-06T02:18:45.977245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:14.432297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.977287+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:18:45.977287+0000","last_peered":"2023-10-06T02:18:45.977287+0000","last_clean":"2023-10-06T02:18:45.977287+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:18:45.977287+0000","last_undegraded":"2023-10-06T02:18:45.977287+0000","last_fullsized":"2023-10-06T02:18:45.977287+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.991057+0000","last_change":"2023-10-06T02:18:45.980050+0000","last_active":"2023-10-06T02:18:45.991057+0000","last_peered":"2023-10-06T02:18:45.991057+0000","last_clean":"2023-10-06T02:18:45.991057+0000","last_became_active":"2023-10-06T02:18:45.979798+0000","last_became_peered":"2023-10-06T02:18:45.979798+0000","last_unstale":"2023-10-06T02:18:45.991057+0000","last_undegraded":"2023-10-06T02:18:45.991057+0000","last_fullsized":"2023-10-06T02:18:45.991057+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:24:36.091537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.985113+0000","last_change":"2023-10-06T02:18:44.956366+0000","last_active":"2023-10-06T02:18:45.985113+0000","last_peered":"2023-10-06T02:18:45.985113+0000","last_clean":"2023-10-06T02:18:45.985113+0000","last_became_active":"2023-10-06T02:18:44.956094+0000","last_became_peered":"2023-10-06T02:18:44.956094+0000","last_unstale":"2023-10-06T02:18:45.985113+0000","last_undegraded":"2023-10-06T02:18:45.985113+0000","last_fullsized":"2023-10-06T02:18:45.985113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:53:54.654193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.970054+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:18:45.970054+0000","last_peered":"2023-10-06T02:18:45.970054+0000","last_clean":"2023-10-06T02:18:45.970054+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:18:45.970054+0000","last_undegraded":"2023-10-06T02:18:45.970054+0000","last_fullsized":"2023-10-06T02:18:45.970054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.995813+0000","last_change":"2023-10-06T02:18:45.993427+0000","last_active":"2023-10-06T02:18:45.995813+0000","last_peered":"2023-10-06T02:18:45.995813+0000","last_clean":"2023-10-06T02:18:45.995813+0000","last_became_active":"2023-10-06T02:18:45.993118+0000","last_became_peered":"2023-10-06T02:18:45.993118+0000","last_unstale":"2023-10-06T02:18:45.995813+0000","last_undegraded":"2023-10-06T02:18:45.995813+0000","last_fullsized":"2023-10-06T02:18:45.995813+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:15.434297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.976597+0000","last_change":"2023-10-06T02:18:44.960597+0000","last_active":"2023-10-06T02:18:45.976597+0000","last_peered":"2023-10-06T02:18:45.976597+0000","last_clean":"2023-10-06T02:18:45.976597+0000","last_became_active":"2023-10-06T02:18:44.960378+0000","last_became_peered":"2023-10-06T02:18:44.960378+0000","last_unstale":"2023-10-06T02:18:45.976597+0000","last_undegraded":"2023-10-06T02:18:45.976597+0000","last_fullsized":"2023-10-06T02:18:45.976597+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:20.329354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.976719+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:18:45.976719+0000","last_peered":"2023-10-06T02:18:45.976719+0000","last_clean":"2023-10-06T02:18:45.976719+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:18:45.976719+0000","last_undegraded":"2023-10-06T02:18:45.976719+0000","last_fullsized":"2023-10-06T02:18:45.976719+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":179,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.989642+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:18:45.989642+0000","last_peered":"2023-10-06T02:18:45.989642+0000","last_clean":"2023-10-06T02:18:45.989642+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:18:45.989642+0000","last_undegraded":"2023-10-06T02:18:45.989642+0000","last_fullsized":"2023-10-06T02:18:45.989642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.985536+0000","last_change":"2023-10-06T02:18:45.982214+0000","last_active":"2023-10-06T02:18:45.985536+0000","last_peered":"2023-10-06T02:18:45.985536+0000","last_clean":"2023-10-06T02:18:45.985536+0000","last_became_active":"2023-10-06T02:18:45.981899+0000","last_became_peered":"2023-10-06T02:18:45.981899+0000","last_unstale":"2023-10-06T02:18:45.985536+0000","last_undegraded":"2023-10-06T02:18:45.985536+0000","last_fullsized":"2023-10-06T02:18:45.985536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:15.434297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.984659+0000","last_change":"2023-10-06T02:18:44.956914+0000","last_active":"2023-10-06T02:18:45.984659+0000","last_peered":"2023-10-06T02:18:45.984659+0000","last_clean":"2023-10-06T02:18:45.984659+0000","last_became_active":"2023-10-06T02:18:44.956611+0000","last_became_peered":"2023-10-06T02:18:44.956611+0000","last_unstale":"2023-10-06T02:18:45.984659+0000","last_undegraded":"2023-10-06T02:18:45.984659+0000","last_fullsized":"2023-10-06T02:18:45.984659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:38.725977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.990297+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:18:45.990297+0000","last_peered":"2023-10-06T02:18:45.990297+0000","last_clean":"2023-10-06T02:18:45.990297+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:18:45.990297+0000","last_undegraded":"2023-10-06T02:18:45.990297+0000","last_fullsized":"2023-10-06T02:18:45.990297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.997478+0000","last_change":"2023-10-06T02:18:45.990657+0000","last_active":"2023-10-06T02:18:45.997478+0000","last_peered":"2023-10-06T02:18:45.997478+0000","last_clean":"2023-10-06T02:18:45.997478+0000","last_became_active":"2023-10-06T02:18:45.990344+0000","last_became_peered":"2023-10-06T02:18:45.990344+0000","last_unstale":"2023-10-06T02:18:45.997478+0000","last_undegraded":"2023-10-06T02:18:45.997478+0000","last_fullsized":"2023-10-06T02:18:45.997478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:28.392538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:46.006548+0000","last_change":"2023-10-06T02:18:44.957887+0000","last_active":"2023-10-06T02:18:46.006548+0000","last_peered":"2023-10-06T02:18:46.006548+0000","last_clean":"2023-10-06T02:18:46.006548+0000","last_became_active":"2023-10-06T02:18:44.955744+0000","last_became_peered":"2023-10-06T02:18:44.955744+0000","last_unstale":"2023-10-06T02:18:46.006548+0000","last_undegraded":"2023-10-06T02:18:46.006548+0000","last_fullsized":"2023-10-06T02:18:46.006548+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:21.902890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.989556+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:18:45.989556+0000","last_peered":"2023-10-06T02:18:45.989556+0000","last_clean":"2023-10-06T02:18:45.989556+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:18:45.989556+0000","last_undegraded":"2023-10-06T02:18:45.989556+0000","last_fullsized":"2023-10-06T02:18:45.989556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.987006+0000","last_change":"2023-10-06T02:18:45.980611+0000","last_active":"2023-10-06T02:18:45.987006+0000","last_peered":"2023-10-06T02:18:45.987006+0000","last_clean":"2023-10-06T02:18:45.987006+0000","last_became_active":"2023-10-06T02:18:45.980315+0000","last_became_peered":"2023-10-06T02:18:45.980315+0000","last_unstale":"2023-10-06T02:18:45.987006+0000","last_undegraded":"2023-10-06T02:18:45.987006+0000","last_fullsized":"2023-10-06T02:18:45.987006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:56.408624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T02:18:46.981546+0000","last_change":"2023-10-06T02:18:44.948994+0000","last_active":"2023-10-06T02:18:46.981546+0000","last_peered":"2023-10-06T02:18:46.981546+0000","last_clean":"2023-10-06T02:18:46.981546+0000","last_became_active":"2023-10-06T02:18:44.948536+0000","last_became_peered":"2023-10-06T02:18:44.948536+0000","last_unstale":"2023-10-06T02:18:46.981546+0000","last_undegraded":"2023-10-06T02:18:46.981546+0000","last_fullsized":"2023-10-06T02:18:46.981546+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:47.221274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.981536+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:18:45.981536+0000","last_peered":"2023-10-06T02:18:45.981536+0000","last_clean":"2023-10-06T02:18:45.981536+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:18:45.981536+0000","last_undegraded":"2023-10-06T02:18:45.981536+0000","last_fullsized":"2023-10-06T02:18:45.981536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.986181+0000","last_change":"2023-10-06T02:18:45.982376+0000","last_active":"2023-10-06T02:18:45.986181+0000","last_peered":"2023-10-06T02:18:45.986181+0000","last_clean":"2023-10-06T02:18:45.986181+0000","last_became_active":"2023-10-06T02:18:45.982120+0000","last_became_peered":"2023-10-06T02:18:45.982120+0000","last_unstale":"2023-10-06T02:18:45.986181+0000","last_undegraded":"2023-10-06T02:18:45.986181+0000","last_fullsized":"2023-10-06T02:18:45.986181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:02.177622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.975595+0000","last_change":"2023-10-06T02:18:44.961435+0000","last_active":"2023-10-06T02:18:45.975595+0000","last_peered":"2023-10-06T02:18:45.975595+0000","last_clean":"2023-10-06T02:18:45.975595+0000","last_became_active":"2023-10-06T02:18:44.961289+0000","last_became_peered":"2023-10-06T02:18:44.961289+0000","last_unstale":"2023-10-06T02:18:45.975595+0000","last_undegraded":"2023-10-06T02:18:45.975595+0000","last_fullsized":"2023-10-06T02:18:45.975595+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:01.752107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.972453+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:18:45.972453+0000","last_peered":"2023-10-06T02:18:45.972453+0000","last_clean":"2023-10-06T02:18:45.972453+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:18:45.972453+0000","last_undegraded":"2023-10-06T02:18:45.972453+0000","last_fullsized":"2023-10-06T02:18:45.972453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.989564+0000","last_change":"2023-10-06T02:18:45.982890+0000","last_active":"2023-10-06T02:18:45.989564+0000","last_peered":"2023-10-06T02:18:45.989564+0000","last_clean":"2023-10-06T02:18:45.989564+0000","last_became_active":"2023-10-06T02:18:45.982559+0000","last_became_peered":"2023-10-06T02:18:45.982559+0000","last_unstale":"2023-10-06T02:18:45.989564+0000","last_undegraded":"2023-10-06T02:18:45.989564+0000","last_fullsized":"2023-10-06T02:18:45.989564+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:44.935002+0000","last_clean_scrub_stamp":"2023-10-06T02:18:44.935002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:46.003001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.974645+0000","last_change":"2023-10-06T02:18:44.958969+0000","last_active":"2023-10-06T02:18:45.974645+0000","last_peered":"2023-10-06T02:18:45.974645+0000","last_clean":"2023-10-06T02:18:45.974645+0000","last_became_active":"2023-10-06T02:18:44.958782+0000","last_became_peered":"2023-10-06T02:18:44.958782+0000","last_unstale":"2023-10-06T02:18:45.974645+0000","last_undegraded":"2023-10-06T02:18:45.974645+0000","last_fullsized":"2023-10-06T02:18:45.974645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:18:43.933003+0000","last_clean_scrub_stamp":"2023-10-06T02:18:43.933003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:47.153725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:18:45.972779+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:18:45.972779+0000","last_peered":"2023-10-06T02:18:45.972779+0000","last_clean":"2023-10-06T02:18:45.972779+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:18:45.972779+0000","last_undegraded":"2023-10-06T02:18:45.972779+0000","last_fullsized":"2023-10-06T02:18:45.972779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298312,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073528,"statfs":{"total":96636764160,"available":96331292672,"internally_reserved":0,"allocated":1048576,"data_stored":792100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.59499999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.56200000000000006}]},{"osd":3,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.63300000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.42399999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.379},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.40500000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":201333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":5.6929999999999996,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":5.7060000000000004,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":8.8659999999999997,"5min":8.8659999999999997,"15min":8.8659999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":10.659000000000001,"5min":10.659000000000001,"15min":10.659000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.63600000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.54700000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298308,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073532,"statfs":{"total":96636764160,"available":96331296768,"internally_reserved":0,"allocated":1044480,"data_stored":791127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.318}]},{"osd":2,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.29999999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.36499999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.67400000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.65500000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.63300000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.55300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":201676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.377,"5min":0.377,"15min":0.377},"last":0.314},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.32800000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.376,"5min":0.376,"15min":0.376},"last":0.26400000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.36299999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.42799999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.39600000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.46700000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:18:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":11.138,"5min":11.138,"15min":11.138},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.56299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":462848,"data_stored":202247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.27200000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.35299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.379}]},{"osd":4,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59499999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.58299999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67100000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.71899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":462848,"data_stored":202252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.248}]},{"osd":1,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.308}]},{"osd":2,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.432}]},{"osd":4,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.47999999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53900000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.442}]},{"osd":7,"last update":"Fri Oct 6 02:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.56499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":462848,"data_stored":203178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":17.879999999999999,"5min":17.879999999999999,"15min":17.879999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":18.010999999999999,"5min":18.010999999999999,"15min":18.010999999999999},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.40999999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.44600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.38200000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:18:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":201712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.314},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.441},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.501}]},{"osd":3,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.33900000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47099999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.45500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:18:55.061 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:18:55.061 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:18:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.219+0000 7f7304155700 1 Processor -- start 2023-10-06T02:18:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.219+0000 7f7304155700 1 -- start start 2023-10-06T02:18:55.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.220+0000 7f7304155700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72fc087610 0x7f72fc159530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:55.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.220+0000 7f7304155700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72fc0cf740 con 0x7f72fc0ce580 2023-10-06T02:18:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.220+0000 7f7304155700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72fc0ceb30 con 0x7f72fc087240 2023-10-06T02:18:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.220+0000 7f7304155700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0cee10 con 0x7f72fc087610 2023-10-06T02:18:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.220+0000 7f73016f0700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f72fc0ce580 0x7f72fc158e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47772/0 (socket says 172.21.15.6:47772) 2023-10-06T02:18:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.220+0000 7f73016f0700 1 -- 172.21.15.6:0/1255782045 learned_addr learned my addr 172.21.15.6:0/1255782045 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.220+0000 7f73026f2700 1 --2- 172.21.15.6:0/1255782045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72fc087610 0x7f72fc159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.220+0000 7f7300eef700 1 -- 172.21.15.6:0/1255782045 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358970410 0 0) 0x7f72fc0cf740 con 0x7f72fc0ce580 2023-10-06T02:18:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.220+0000 7f7300eef700 1 -- 172.21.15.6:0/1255782045 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72e4003570 con 0x7f72fc0ce580 2023-10-06T02:18:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f7300eef700 1 -- 172.21.15.6:0/1255782045 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877292636 0 0) 0x7f72fc0ceb30 con 0x7f72fc087240 2023-10-06T02:18:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f7300eef700 1 -- 172.21.15.6:0/1255782045 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72fc0cf740 con 0x7f72fc087240 2023-10-06T02:18:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f7300eef700 1 -- 172.21.15.6:0/1255782045 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2424193076 0 0) 0x7f72e4003570 con 0x7f72fc0ce580 2023-10-06T02:18:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f7300eef700 1 -- 172.21.15.6:0/1255782045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72fc087610 msgr2=0x7f72fc159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f7300eef700 1 --2- 172.21.15.6:0/1255782045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72fc087610 0x7f72fc159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f7300eef700 1 -- 172.21.15.6:0/1255782045 >> v1:172.21.15.175:6789/0 conn(0x7f72fc087240 legacy=0x7f72fc0cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f7300eef700 1 -- 172.21.15.6:0/1255782045 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc0cf0f0 con 0x7f72fc0ce580 2023-10-06T02:18:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f7300eef700 1 -- 172.21.15.6:0/1255782045 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f72f0001470 con 0x7f72fc0ce580 2023-10-06T02:18:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f73026f2700 1 --2- 172.21.15.6:0/1255782045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72fc087610 0x7f72fc159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f7300eef700 1 -- 172.21.15.6:0/1255782045 >> v1:172.21.15.6:6789/0 conn(0x7f72fc0ce580 legacy=0x7f72fc158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f7300eef700 1 --2- 172.21.15.6:0/1255782045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72e4003c20 0x7f72e4004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f7300eef700 1 --2- 172.21.15.6:0/1255782045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e4004810 0x7f72e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f7300eef700 1 --2- 172.21.15.6:0/1255782045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72fc087610 0x7f72e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f7300eef700 1 -- 172.21.15.6:0/1255782045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0cee10 con 0x7f72e4004810 2023-10-06T02:18:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f7300eef700 1 -- 172.21.15.6:0/1255782045 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e400bb70 con 0x7f72e4003c20 2023-10-06T02:18:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f7300eef700 1 -- 172.21.15.6:0/1255782045 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e400bd30 con 0x7f72fc087610 2023-10-06T02:18:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f73016f0700 1 --2- 172.21.15.6:0/1255782045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e4004810 0x7f72e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f7301ef1700 1 --2- 172.21.15.6:0/1255782045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72e4003c20 0x7f72e4004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f73026f2700 1 --2- 172.21.15.6:0/1255782045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72fc087610 0x7f72e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f73016f0700 1 -- 172.21.15.6:0/1255782045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72fc087610 msgr2=0x7f72e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f73016f0700 1 --2- 172.21.15.6:0/1255782045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72fc087610 0x7f72e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f73016f0700 1 -- 172.21.15.6:0/1255782045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72e4003c20 msgr2=0x7f72e4004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f73016f0700 1 --2- 172.21.15.6:0/1255782045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72e4003c20 0x7f72e4004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f73016f0700 1 -- 172.21.15.6:0/1255782045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f4009420 con 0x7f72e4004810 2023-10-06T02:18:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.221+0000 7f73016f0700 1 --2- 172.21.15.6:0/1255782045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e4004810 0x7f72e4004c80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f72f000c2d0 tx=0x7f72f0001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795b69335b43881d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.222+0000 7f7300eef700 1 -- 172.21.15.6:0/1255782045 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f000cbc0 con 0x7f72e4004810 2023-10-06T02:18:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.222+0000 7f7300eef700 1 -- 172.21.15.6:0/1255782045 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f000cd20 con 0x7f72e4004810 2023-10-06T02:18:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.222+0000 7f7300eef700 1 -- 172.21.15.6:0/1255782045 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0005b70 con 0x7f72e4004810 2023-10-06T02:18:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.222+0000 7f7304155700 1 -- 172.21.15.6:0/1255782045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e4004810 msgr2=0x7f72e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.222+0000 7f7304155700 1 --2- 172.21.15.6:0/1255782045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e4004810 0x7f72e4004c80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f72f000c2d0 tx=0x7f72f0001e10 comp rx=0 tx=0).stop 2023-10-06T02:18:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.222+0000 7f73026f2700 1 -- 172.21.15.6:0/1255782045 reap_dead start 2023-10-06T02:18:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.222+0000 7f7304155700 1 -- 172.21.15.6:0/1255782045 shutdown_connections 2023-10-06T02:18:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.222+0000 7f7304155700 1 -- 172.21.15.6:0/1255782045 >> 172.21.15.6:0/1255782045 conn(0x7f72fc069150 msgr2=0x7f72fc0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:55.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.222+0000 7f7304155700 1 -- 172.21.15.6:0/1255782045 shutdown_connections 2023-10-06T02:18:55.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.222+0000 7f7304155700 1 -- 172.21.15.6:0/1255782045 wait complete. 2023-10-06T02:18:55.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.223+0000 7f7304155700 1 Processor -- start 2023-10-06T02:18:55.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.223+0000 7f7304155700 1 -- start start 2023-10-06T02:18:55.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.224+0000 7f7304155700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72e4004810 0x7f72fc15cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:55.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.224+0000 7f7304155700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72fc159ce0 0x7f72fc146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.224+0000 7f7304155700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72fc169bb0 0x7f72fc16a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.224+0000 7f7304155700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc15ccd0 con 0x7f72fc159ce0 2023-10-06T02:18:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.224+0000 7f7304155700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc15afb0 con 0x7f72e4004810 2023-10-06T02:18:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.224+0000 7f7304155700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc15a150 con 0x7f72fc169bb0 2023-10-06T02:18:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.224+0000 7f73016f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72fc159ce0 0x7f72fc146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.224+0000 7f73016f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72fc159ce0 0x7f72fc146c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41664/0 (socket says 172.21.15.6:41664) 2023-10-06T02:18:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.224+0000 7f73016f0700 1 -- 172.21.15.6:0/2545478477 learned_addr learned my addr 172.21.15.6:0/2545478477 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.224+0000 7f7301ef1700 1 --2- 172.21.15.6:0/2545478477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72e4004810 0x7f72fc15cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.224+0000 7f73026f2700 1 --2- 172.21.15.6:0/2545478477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72fc169bb0 0x7f72fc16a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.225+0000 7f73016f0700 1 -- 172.21.15.6:0/2545478477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72fc169bb0 msgr2=0x7f72fc16a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.225+0000 7f73016f0700 1 --2- 172.21.15.6:0/2545478477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72fc169bb0 0x7f72fc16a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.225+0000 7f73016f0700 1 -- 172.21.15.6:0/2545478477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72e4004810 msgr2=0x7f72fc15cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.225+0000 7f73016f0700 1 --2- 172.21.15.6:0/2545478477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72e4004810 0x7f72fc15cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.225+0000 7f73016f0700 1 -- 172.21.15.6:0/2545478477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc15a3a0 con 0x7f72fc159ce0 2023-10-06T02:18:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.225+0000 7f73026f2700 1 --2- 172.21.15.6:0/2545478477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72fc169bb0 0x7f72fc16a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.225+0000 7f73016f0700 1 --2- 172.21.15.6:0/2545478477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72fc159ce0 0x7f72fc146c10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f72f000c9f0 tx=0x7f72f0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.225+0000 7f72f9ffb700 1 -- 172.21.15.6:0/2545478477 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0001710 con 0x7f72fc159ce0 2023-10-06T02:18:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.225+0000 7f72f9ffb700 1 -- 172.21.15.6:0/2545478477 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f00070d0 con 0x7f72fc159ce0 2023-10-06T02:18:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.225+0000 7f72f9ffb700 1 -- 172.21.15.6:0/2545478477 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0007490 con 0x7f72fc159ce0 2023-10-06T02:18:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.225+0000 7f7304155700 1 -- 172.21.15.6:0/2545478477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc15a680 con 0x7f72fc159ce0 2023-10-06T02:18:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.225+0000 7f7304155700 1 -- 172.21.15.6:0/2545478477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc15ac40 con 0x7f72fc159ce0 2023-10-06T02:18:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.226+0000 7f7304155700 1 -- 172.21.15.6:0/2545478477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72fc15b120 con 0x7f72fc159ce0 2023-10-06T02:18:55.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.226+0000 7f72f9ffb700 1 -- 172.21.15.6:0/2545478477 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72f0028450 con 0x7f72fc159ce0 2023-10-06T02:18:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.227+0000 7f72f9ffb700 1 --2- 172.21.15.6:0/2545478477 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f72e8066f30 0x7f72e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.227+0000 7f72f9ffb700 1 -- 172.21.15.6:0/2545478477 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f72f00861f0 con 0x7f72fc159ce0 2023-10-06T02:18:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.227+0000 7f7301ef1700 1 --2- 172.21.15.6:0/2545478477 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f72e8066f30 0x7f72e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.228+0000 7f7301ef1700 1 --2- 172.21.15.6:0/2545478477 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f72e8066f30 0x7f72e80693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f72ec011320 tx=0x7f72ec0017a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.231+0000 7f72f9ffb700 1 -- 172.21.15.6:0/2545478477 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72f00531c0 con 0x7f72fc159ce0 2023-10-06T02:18:55.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.505+0000 7f7304155700 1 -- 172.21.15.6:0/2545478477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f72fc0cf3d0 con 0x7f72fc159ce0 2023-10-06T02:18:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.509+0000 7f72f9ffb700 1 -- 172.21.15.6:0/2545478477 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f72f00567e0 con 0x7f72fc159ce0 2023-10-06T02:18:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.511+0000 7f7304155700 1 -- 172.21.15.6:0/2545478477 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f72e8066f30 msgr2=0x7f72e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.511+0000 7f7304155700 1 --2- 172.21.15.6:0/2545478477 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f72e8066f30 0x7f72e80693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f72ec011320 tx=0x7f72ec0017a0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.511+0000 7f7304155700 1 -- 172.21.15.6:0/2545478477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72fc159ce0 msgr2=0x7f72fc146c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.511+0000 7f7304155700 1 --2- 172.21.15.6:0/2545478477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72fc159ce0 0x7f72fc146c10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f72f000c9f0 tx=0x7f72f0015000 comp rx=0 tx=0).stop 2023-10-06T02:18:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.511+0000 7f7304155700 1 -- 172.21.15.6:0/2545478477 shutdown_connections 2023-10-06T02:18:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.511+0000 7f7304155700 1 --2- 172.21.15.6:0/2545478477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72fc169bb0 0x7f72fc16a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.511+0000 7f7304155700 1 --2- 172.21.15.6:0/2545478477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72e4004810 0x7f72fc15cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.511+0000 7f7304155700 1 --2- 172.21.15.6:0/2545478477 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f72e8066f30 0x7f72e80693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.511+0000 7f7304155700 1 --2- 172.21.15.6:0/2545478477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72fc159ce0 0x7f72fc146c10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.511+0000 7f7304155700 1 -- 172.21.15.6:0/2545478477 >> 172.21.15.6:0/2545478477 conn(0x7f72fc069150 msgr2=0x7f72fc15f510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:55.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.511+0000 7f7304155700 1 -- 172.21.15.6:0/2545478477 shutdown_connections 2023-10-06T02:18:55.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.511+0000 7f7304155700 1 -- 172.21.15.6:0/2545478477 wait complete. 2023-10-06T02:18:55.531 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-10-06T02:18:55.532 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:18:55.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.650+0000 7fe716504700 1 Processor -- start 2023-10-06T02:18:55.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.651+0000 7fe716504700 1 -- start start 2023-10-06T02:18:55.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.651+0000 7fe716504700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe71015b3c0 0x7fe710097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:55.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.651+0000 7fe716504700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7100afb90 con 0x7fe71015a590 2023-10-06T02:18:55.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.651+0000 7fe716504700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7100b2310 con 0x7fe7100b3c50 2023-10-06T02:18:55.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.651+0000 7fe716504700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7100b25f0 con 0x7fe71015b3c0 2023-10-06T02:18:55.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.651+0000 7fe714aa1700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe71015a590 0x7fe71015a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47780/0 (socket says 172.21.15.6:47780) 2023-10-06T02:18:55.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.652+0000 7fe714aa1700 1 -- 172.21.15.6:0/659420345 learned_addr learned my addr 172.21.15.6:0/659420345 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:55.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.652+0000 7fe70ffff700 1 --2- 172.21.15.6:0/659420345 >> v2:172.21.15.175:3300/0 conn(0x7fe71015b3c0 0x7fe710097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:55.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.652+0000 7fe70effd700 1 -- 172.21.15.6:0/659420345 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981962538 0 0) 0x7fe7100afb90 con 0x7fe71015a590 2023-10-06T02:18:55.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.652+0000 7fe70effd700 1 -- 172.21.15.6:0/659420345 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6fc003570 con 0x7fe71015a590 2023-10-06T02:18:55.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.652+0000 7fe70effd700 1 -- 172.21.15.6:0/659420345 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785338039 0 0) 0x7fe7100b2310 con 0x7fe7100b3c50 2023-10-06T02:18:55.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.652+0000 7fe70effd700 1 -- 172.21.15.6:0/659420345 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7100afb90 con 0x7fe7100b3c50 2023-10-06T02:18:55.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.652+0000 7fe70ffff700 1 -- 172.21.15.6:0/659420345 >> v1:172.21.15.175:6789/0 conn(0x7fe7100b3c50 legacy=0x7fe71015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:55.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.652+0000 7fe70ffff700 1 -- 172.21.15.6:0/659420345 >> v1:172.21.15.6:6789/0 conn(0x7fe71015a590 legacy=0x7fe71015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:55.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.652+0000 7fe70ffff700 1 -- 172.21.15.6:0/659420345 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7100af820 con 0x7fe71015b3c0 2023-10-06T02:18:55.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.652+0000 7fe70ffff700 1 --2- 172.21.15.6:0/659420345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe71015b3c0 0x7fe710097d70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80098d0 tx=0x7fe6f8009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c2ac1c2c5838c62 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:55.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.652+0000 7fe70effd700 1 -- 172.21.15.6:0/659420345 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8005c10 con 0x7fe71015b3c0 2023-10-06T02:18:55.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.653+0000 7fe70effd700 1 -- 172.21.15.6:0/659420345 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f8005d70 con 0x7fe71015b3c0 2023-10-06T02:18:55.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.653+0000 7fe70effd700 1 -- 172.21.15.6:0/659420345 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8006240 con 0x7fe71015b3c0 2023-10-06T02:18:55.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.653+0000 7fe716504700 1 -- 172.21.15.6:0/659420345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe71015b3c0 msgr2=0x7fe710097d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:55.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.653+0000 7fe716504700 1 --2- 172.21.15.6:0/659420345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe71015b3c0 0x7fe710097d70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80098d0 tx=0x7fe6f8009120 comp rx=0 tx=0).stop 2023-10-06T02:18:55.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.653+0000 7fe716504700 1 -- 172.21.15.6:0/659420345 shutdown_connections 2023-10-06T02:18:55.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.653+0000 7fe716504700 1 --2- 172.21.15.6:0/659420345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe71015b3c0 0x7fe710097d70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.653+0000 7fe716504700 1 -- 172.21.15.6:0/659420345 >> 172.21.15.6:0/659420345 conn(0x7fe710067910 msgr2=0x7fe7100ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:55.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.653+0000 7fe716504700 1 -- 172.21.15.6:0/659420345 shutdown_connections 2023-10-06T02:18:55.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.653+0000 7fe716504700 1 -- 172.21.15.6:0/659420345 wait complete. 2023-10-06T02:18:55.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.654+0000 7fe716504700 1 Processor -- start 2023-10-06T02:18:55.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.654+0000 7fe716504700 1 -- start start 2023-10-06T02:18:55.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe716504700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7100b3c50 0x7fe710169b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:55.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe716504700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe71015a590 0x7fe710167120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:55.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe716504700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe71015b3c0 0x7fe7100abc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:55.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe716504700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71016a0d0 con 0x7fe71015a590 2023-10-06T02:18:55.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe716504700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71016ab70 con 0x7fe71015b3c0 2023-10-06T02:18:55.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe716504700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe710167660 con 0x7fe7100b3c50 2023-10-06T02:18:55.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe70f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe71015a590 0x7fe710167120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:55.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe70f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe71015a590 0x7fe710167120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41670/0 (socket says 172.21.15.6:41670) 2023-10-06T02:18:55.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe70f7fe700 1 -- 172.21.15.6:0/1052438038 learned_addr learned my addr 172.21.15.6:0/1052438038 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:55.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe70ffff700 1 --2- 172.21.15.6:0/1052438038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7100b3c50 0x7fe710169b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:55.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe714aa1700 1 --2- 172.21.15.6:0/1052438038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe71015b3c0 0x7fe7100abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:55.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe70f7fe700 1 -- 172.21.15.6:0/1052438038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7100b3c50 msgr2=0x7fe710169b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:55.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe70f7fe700 1 --2- 172.21.15.6:0/1052438038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7100b3c50 0x7fe710169b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe70f7fe700 1 -- 172.21.15.6:0/1052438038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe71015b3c0 msgr2=0x7fe7100abc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:55.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe70f7fe700 1 --2- 172.21.15.6:0/1052438038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe71015b3c0 0x7fe7100abc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe70f7fe700 1 -- 172.21.15.6:0/1052438038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f80093c0 con 0x7fe71015a590 2023-10-06T02:18:55.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe714aa1700 1 --2- 172.21.15.6:0/1052438038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe71015b3c0 0x7fe7100abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:55.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.655+0000 7fe70ffff700 1 --2- 172.21.15.6:0/1052438038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7100b3c50 0x7fe710169b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:55.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.656+0000 7fe70f7fe700 1 --2- 172.21.15.6:0/1052438038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe71015a590 0x7fe710167120 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c590 tx=0x7fe700007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:55.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.656+0000 7fe707fff700 1 -- 172.21.15.6:0/1052438038 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700010510 con 0x7fe71015a590 2023-10-06T02:18:55.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.656+0000 7fe707fff700 1 -- 172.21.15.6:0/1052438038 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe700010670 con 0x7fe71015a590 2023-10-06T02:18:55.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.656+0000 7fe716504700 1 -- 172.21.15.6:0/1052438038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71016a2d0 con 0x7fe71015a590 2023-10-06T02:18:55.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.656+0000 7fe707fff700 1 -- 172.21.15.6:0/1052438038 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700010a30 con 0x7fe71015a590 2023-10-06T02:18:55.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.656+0000 7fe716504700 1 -- 172.21.15.6:0/1052438038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71016a890 con 0x7fe71015a590 2023-10-06T02:18:55.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.657+0000 7fe716504700 1 -- 172.21.15.6:0/1052438038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71006e8d0 con 0x7fe71015a590 2023-10-06T02:18:55.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.657+0000 7fe707fff700 1 -- 172.21.15.6:0/1052438038 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe70001b400 con 0x7fe71015a590 2023-10-06T02:18:55.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.657+0000 7fe707fff700 1 --2- 172.21.15.6:0/1052438038 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6f0066f30 0x7fe6f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:55.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.658+0000 7fe707fff700 1 -- 172.21.15.6:0/1052438038 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe700084430 con 0x7fe71015a590 2023-10-06T02:18:55.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.658+0000 7fe70ffff700 1 --2- 172.21.15.6:0/1052438038 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6f0066f30 0x7fe6f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:55.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.658+0000 7fe70ffff700 1 --2- 172.21.15.6:0/1052438038 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6f0066f30 0x7fe6f00693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009390 tx=0x7fe6f8016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:55.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.662+0000 7fe707fff700 1 -- 172.21.15.6:0/1052438038 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe700051400 con 0x7fe71015a590 2023-10-06T02:18:55.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.900+0000 7fe716504700 1 -- 172.21.15.6:0/1052438038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7100af4f0 con 0x7fe71015a590 2023-10-06T02:18:55.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.900+0000 7fe707fff700 1 -- 172.21.15.6:0/1052438038 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7fe700054a20 con 0x7fe71015a590 2023-10-06T02:18:55.901 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:18:55.901 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1173605075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1173605075},{"type":"v1","addr":"172.21.15.175:6837","nonce":1173605075}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/375122461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":375122461},{"type":"v1","addr":"172.21.15.175:6835","nonce":375122461}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5142,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3506443204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3506443204},{"type":"v1","addr":"172.21.15.6:6835","nonce":3506443204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:18:45.349958+0000","modified":"2023-10-06T02:18:49.004214+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5145":{"gid":5145,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/774858203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":774858203},{"type":"v1","addr":"172.21.15.6:6834","nonce":774858203}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:18:55.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.902+0000 7fe716504700 1 -- 172.21.15.6:0/1052438038 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6f0066f30 msgr2=0x7fe6f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.902+0000 7fe716504700 1 --2- 172.21.15.6:0/1052438038 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6f0066f30 0x7fe6f00693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009390 tx=0x7fe6f8016000 comp rx=0 tx=0).stop 2023-10-06T02:18:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.902+0000 7fe716504700 1 -- 172.21.15.6:0/1052438038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe71015a590 msgr2=0x7fe710167120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.902+0000 7fe716504700 1 --2- 172.21.15.6:0/1052438038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe71015a590 0x7fe710167120 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c590 tx=0x7fe700007dc0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.902+0000 7fe716504700 1 -- 172.21.15.6:0/1052438038 shutdown_connections 2023-10-06T02:18:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.902+0000 7fe716504700 1 --2- 172.21.15.6:0/1052438038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe71015b3c0 0x7fe7100abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.902+0000 7fe716504700 1 --2- 172.21.15.6:0/1052438038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7100b3c50 0x7fe710169b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.902+0000 7fe716504700 1 --2- 172.21.15.6:0/1052438038 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6f0066f30 0x7fe6f00693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.902+0000 7fe716504700 1 --2- 172.21.15.6:0/1052438038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe71015a590 0x7fe710167120 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.902+0000 7fe716504700 1 -- 172.21.15.6:0/1052438038 >> 172.21.15.6:0/1052438038 conn(0x7fe710067910 msgr2=0x7fe71006c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.902+0000 7fe716504700 1 -- 172.21.15.6:0/1052438038 shutdown_connections 2023-10-06T02:18:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:55.902+0000 7fe716504700 1 -- 172.21.15.6:0/1052438038 wait complete. 2023-10-06T02:18:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-10-06T02:18:56.317 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:18:45.349958+0000', 'modified': '2023-10-06T02:18:49.004214+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5145}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5145': {'gid': 5145, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6834/774858203', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 774858203}, {'type': 'v1', 'addr': '172.21.15.6:6834', 'nonce': 774858203}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:18:56.317 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:18:56.317 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:18:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.440+0000 7fc46ad25700 1 Processor -- start 2023-10-06T02:18:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.440+0000 7fc46ad25700 1 -- start start 2023-10-06T02:18:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.440+0000 7fc46ad25700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc46415a030 0x7fc46415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.440+0000 7fc46ad25700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc464087700 0x7fc4640b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.440+0000 7fc46ad25700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4640afc50 con 0x7fc46415a940 2023-10-06T02:18:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.440+0000 7fc46ad25700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4640b0cf0 con 0x7fc464087700 2023-10-06T02:18:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.440+0000 7fc46ad25700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4640aff30 con 0x7fc46415a030 2023-10-06T02:18:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.441+0000 7fc4692c2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc464087700 0x7fc4640b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.441+0000 7fc463fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc46415a940 0x7fc464086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47794/0 (socket says 172.21.15.6:47794) 2023-10-06T02:18:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.441+0000 7fc4692c2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc464087700 0x7fc4640b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41684/0 (socket says 172.21.15.6:41684) 2023-10-06T02:18:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.441+0000 7fc463fff700 1 -- 172.21.15.6:0/311614564 learned_addr learned my addr 172.21.15.6:0/311614564 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:18:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.441+0000 7fc468ac1700 1 --2- 172.21.15.6:0/311614564 >> v2:172.21.15.175:3300/0 conn(0x7fc46415a030 0x7fc46415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.441+0000 7fc4692c2700 1 -- 172.21.15.6:0/311614564 >> v2:172.21.15.175:3300/0 conn(0x7fc46415a030 msgr2=0x7fc46415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.441+0000 7fc4692c2700 1 --2- 172.21.15.6:0/311614564 >> v2:172.21.15.175:3300/0 conn(0x7fc46415a030 0x7fc46415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.441+0000 7fc4692c2700 1 -- 172.21.15.6:0/311614564 >> v1:172.21.15.6:6789/0 conn(0x7fc46415a940 legacy=0x7fc464086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.441+0000 7fc4692c2700 1 -- 172.21.15.6:0/311614564 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4640b0210 con 0x7fc464087700 2023-10-06T02:18:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.441+0000 7fc468ac1700 1 --2- 172.21.15.6:0/311614564 >> v2:172.21.15.175:3300/0 conn(0x7fc46415a030 0x7fc46415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.441+0000 7fc4637fe700 1 -- 172.21.15.6:0/311614564 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163731338 0 0) 0x7fc4640afc50 con 0x7fc46415a940 2023-10-06T02:18:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.441+0000 7fc4692c2700 1 --2- 172.21.15.6:0/311614564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc464087700 0x7fc4640b21b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc4640cddc0 tx=0x7fc44c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250837e368f9f9e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.441+0000 7fc4637fe700 1 -- 172.21.15.6:0/311614564 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c00b6b0 con 0x7fc464087700 2023-10-06T02:18:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.441+0000 7fc4637fe700 1 -- 172.21.15.6:0/311614564 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c00b810 con 0x7fc464087700 2023-10-06T02:18:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.441+0000 7fc4637fe700 1 -- 172.21.15.6:0/311614564 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c00bbb0 con 0x7fc464087700 2023-10-06T02:18:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.442+0000 7fc46ad25700 1 -- 172.21.15.6:0/311614564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc464087700 msgr2=0x7fc4640b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.442+0000 7fc46ad25700 1 --2- 172.21.15.6:0/311614564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc464087700 0x7fc4640b21b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc4640cddc0 tx=0x7fc44c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.442+0000 7fc46ad25700 1 -- 172.21.15.6:0/311614564 shutdown_connections 2023-10-06T02:18:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.442+0000 7fc46ad25700 1 --2- 172.21.15.6:0/311614564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc464087700 0x7fc4640b21b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.442+0000 7fc46ad25700 1 --2- 172.21.15.6:0/311614564 >> v2:172.21.15.175:3300/0 conn(0x7fc46415a030 0x7fc46415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.442+0000 7fc46ad25700 1 -- 172.21.15.6:0/311614564 >> 172.21.15.6:0/311614564 conn(0x7fc464068680 msgr2=0x7fc464068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.442+0000 7fc46ad25700 1 -- 172.21.15.6:0/311614564 shutdown_connections 2023-10-06T02:18:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.442+0000 7fc46ad25700 1 -- 172.21.15.6:0/311614564 wait complete. 2023-10-06T02:18:56.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.443+0000 7fc46ad25700 1 Processor -- start 2023-10-06T02:18:56.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.443+0000 7fc46ad25700 1 -- start start 2023-10-06T02:18:56.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc46ad25700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc464087700 0x7fc4640c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc46ad25700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc46415a030 0x7fc46415ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc46ad25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46415a940 0x7fc4640aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc46ad25700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46415b2a0 con 0x7fc46415a940 2023-10-06T02:18:56.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc46ad25700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46415b4b0 con 0x7fc464087700 2023-10-06T02:18:56.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc46ad25700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46415b790 con 0x7fc46415a030 2023-10-06T02:18:56.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc4692c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46415a940 0x7fc4640aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc4692c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46415a940 0x7fc4640aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41690/0 (socket says 172.21.15.6:41690) 2023-10-06T02:18:56.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc4692c2700 1 -- 172.21.15.6:0/1069989894 learned_addr learned my addr 172.21.15.6:0/1069989894 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:56.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc468ac1700 1 --2- 172.21.15.6:0/1069989894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc464087700 0x7fc4640c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc463fff700 1 --2- 172.21.15.6:0/1069989894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc46415a030 0x7fc46415ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc4692c2700 1 -- 172.21.15.6:0/1069989894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc46415a030 msgr2=0x7fc46415ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:56.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc4692c2700 1 --2- 172.21.15.6:0/1069989894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc46415a030 0x7fc46415ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc4692c2700 1 -- 172.21.15.6:0/1069989894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc464087700 msgr2=0x7fc4640c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:56.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc4692c2700 1 --2- 172.21.15.6:0/1069989894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc464087700 0x7fc4640c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc4692c2700 1 -- 172.21.15.6:0/1069989894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c009420 con 0x7fc46415a940 2023-10-06T02:18:56.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc463fff700 1 --2- 172.21.15.6:0/1069989894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc46415a030 0x7fc46415ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:56.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.444+0000 7fc4692c2700 1 --2- 172.21.15.6:0/1069989894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46415a940 0x7fc4640aefc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0093f0 tx=0x7fc44c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:56.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.445+0000 7fc460ff9700 1 -- 172.21.15.6:0/1069989894 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c00bb50 con 0x7fc46415a940 2023-10-06T02:18:56.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.445+0000 7fc460ff9700 1 -- 172.21.15.6:0/1069989894 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c025420 con 0x7fc46415a940 2023-10-06T02:18:56.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.445+0000 7fc46ad25700 1 -- 172.21.15.6:0/1069989894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc46415ba70 con 0x7fc46415a940 2023-10-06T02:18:56.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.445+0000 7fc460ff9700 1 -- 172.21.15.6:0/1069989894 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c0257e0 con 0x7fc46415a940 2023-10-06T02:18:56.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.445+0000 7fc46ad25700 1 -- 172.21.15.6:0/1069989894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46415c030 con 0x7fc46415a940 2023-10-06T02:18:56.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.446+0000 7fc460ff9700 1 -- 172.21.15.6:0/1069989894 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc44c023070 con 0x7fc46415a940 2023-10-06T02:18:56.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.446+0000 7fc460ff9700 1 --2- 172.21.15.6:0/1069989894 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc444066f30 0x7fc4440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.446+0000 7fc460ff9700 1 -- 172.21.15.6:0/1069989894 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc44c085f50 con 0x7fc46415a940 2023-10-06T02:18:56.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.447+0000 7fc468ac1700 1 --2- 172.21.15.6:0/1069989894 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc444066f30 0x7fc4440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.447+0000 7fc468ac1700 1 --2- 172.21.15.6:0/1069989894 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc444066f30 0x7fc4440693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc4640b2ba0 tx=0x7fc45c0098f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.448+0000 7fc47401db80 1 Processor -- start 2023-10-06T02:18:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.448+0000 7fc47401db80 1 -- start start 2023-10-06T02:18:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.449+0000 7fc47401db80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a2e6840 0x55d83a2e6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.449+0000 7fc47401db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a2e7cc0 0x55d83a3366c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.449+0000 7fc47401db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a336c00 0x55d83a337050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.449+0000 7fc47401db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d83a23da70 con 0x55d83a336c00 2023-10-06T02:18:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.449+0000 7fc47401db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d83a23b270 con 0x55d83a2e7cc0 2023-10-06T02:18:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.449+0000 7fc47401db80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d83a237060 con 0x55d83a2e6840 2023-10-06T02:18:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.449+0000 7fc4692c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a336c00 0x55d83a337050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.449+0000 7fc4692c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a336c00 0x55d83a337050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41692/0 (socket says 172.21.15.6:41692) 2023-10-06T02:18:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.449+0000 7fc4692c2700 1 -- 172.21.15.6:0/892469558 learned_addr learned my addr 172.21.15.6:0/892469558 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.449+0000 7fc468ac1700 1 --2- 172.21.15.6:0/892469558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a2e6840 0x55d83a2e6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.449+0000 7fc463fff700 1 --2- 172.21.15.6:0/892469558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a2e7cc0 0x55d83a3366c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.449+0000 7fc4692c2700 1 -- 172.21.15.6:0/892469558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a2e6840 msgr2=0x55d83a2e6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.449+0000 7fc4692c2700 1 --2- 172.21.15.6:0/892469558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a2e6840 0x55d83a2e6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.449+0000 7fc4692c2700 1 -- 172.21.15.6:0/892469558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a2e7cc0 msgr2=0x55d83a3366c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.449+0000 7fc4692c2700 1 --2- 172.21.15.6:0/892469558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a2e7cc0 0x55d83a3366c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.450+0000 7fc4692c2700 1 -- 172.21.15.6:0/892469558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d83a0d1270 con 0x55d83a336c00 2023-10-06T02:18:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.450+0000 7fc463fff700 1 --2- 172.21.15.6:0/892469558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a2e7cc0 0x55d83a3366c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.450+0000 7fc4692c2700 1 --2- 172.21.15.6:0/892469558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a336c00 0x55d83a337050 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc44c084260 tx=0x7fc44c084130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e906544818f8f5f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.450+0000 7fc459ffb700 1 -- 172.21.15.6:0/892469558 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c0572e0 con 0x55d83a336c00 2023-10-06T02:18:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.450+0000 7fc459ffb700 1 -- 172.21.15.6:0/892469558 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c056be0 con 0x55d83a336c00 2023-10-06T02:18:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.450+0000 7fc459ffb700 1 -- 172.21.15.6:0/892469558 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c059e30 con 0x55d83a336c00 2023-10-06T02:18:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.450+0000 7fc47401db80 1 -- 172.21.15.6:0/892469558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a336c00 msgr2=0x55d83a337050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.450+0000 7fc47401db80 1 --2- 172.21.15.6:0/892469558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a336c00 0x55d83a337050 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc44c084260 tx=0x7fc44c084130 comp rx=0 tx=0).stop 2023-10-06T02:18:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.450+0000 7fc47401db80 1 -- 172.21.15.6:0/892469558 shutdown_connections 2023-10-06T02:18:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.450+0000 7fc47401db80 1 --2- 172.21.15.6:0/892469558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a336c00 0x55d83a337050 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.450+0000 7fc47401db80 1 --2- 172.21.15.6:0/892469558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a2e6840 0x55d83a2e6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.450+0000 7fc47401db80 1 --2- 172.21.15.6:0/892469558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a2e7cc0 0x55d83a3366c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.450+0000 7fc47401db80 1 -- 172.21.15.6:0/892469558 >> 172.21.15.6:0/892469558 conn(0x55d83a2e8160 msgr2=0x55d83a2e8530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.450+0000 7fc47401db80 1 -- 172.21.15.6:0/892469558 shutdown_connections 2023-10-06T02:18:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.451+0000 7fc47401db80 1 -- 172.21.15.6:0/892469558 wait complete. 2023-10-06T02:18:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.451+0000 7fc47401db80 1 -- start start 2023-10-06T02:18:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.451+0000 7fc47401db80 1 Processor -- start 2023-10-06T02:18:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc47401db80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a2e6840 0x55d83a32ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc47401db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e7cc0 0x55d83a3253f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc47401db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a336c00 0x55d83a327fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc47401db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d83a1e2890 con 0x55d83a2e7cc0 2023-10-06T02:18:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc47401db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d83a1fdea0 con 0x55d83a336c00 2023-10-06T02:18:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc47401db80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d83a0b9e30 con 0x55d83a2e6840 2023-10-06T02:18:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc47401db80 10 client.0 _ll_register_callbacks cb 0x55d83a2a9e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:18:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc463fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e7cc0 0x55d83a3253f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc463fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e7cc0 0x55d83a3253f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41706/0 (socket says 172.21.15.6:41706) 2023-10-06T02:18:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc463fff700 1 -- 172.21.15.6:0/308856014 learned_addr learned my addr 172.21.15.6:0/308856014 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc4692c2700 1 --2- 172.21.15.6:0/308856014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a336c00 0x55d83a327fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc468ac1700 1 --2- 172.21.15.6:0/308856014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a2e6840 0x55d83a32ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc463fff700 1 -- 172.21.15.6:0/308856014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a2e6840 msgr2=0x55d83a32ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc463fff700 1 --2- 172.21.15.6:0/308856014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a2e6840 0x55d83a32ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc463fff700 1 -- 172.21.15.6:0/308856014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a336c00 msgr2=0x55d83a327fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:56.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc463fff700 1 --2- 172.21.15.6:0/308856014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a336c00 0x55d83a327fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc463fff700 1 -- 172.21.15.6:0/308856014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46415c030 con 0x55d83a2e7cc0 2023-10-06T02:18:56.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc468ac1700 1 --2- 172.21.15.6:0/308856014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a2e6840 0x55d83a32ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:56.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.452+0000 7fc4692c2700 1 --2- 172.21.15.6:0/308856014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a336c00 0x55d83a327fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:18:56.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.453+0000 7fc463fff700 1 --2- 172.21.15.6:0/308856014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e7cc0 0x55d83a3253f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc45400f340 tx=0x7fc454009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5566f5f7dfa25fe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:56.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.453+0000 7fc442ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:18:56.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.453+0000 7fc442ffd700 1 -- 172.21.15.6:0/308856014 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4540058e0 con 0x55d83a2e7cc0 2023-10-06T02:18:56.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.453+0000 7fc442ffd700 1 -- 172.21.15.6:0/308856014 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc454005a40 con 0x55d83a2e7cc0 2023-10-06T02:18:56.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.453+0000 7fc47401db80 1 -- 172.21.15.6:0/308856014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d83a2db940 con 0x55d83a2e7cc0 2023-10-06T02:18:56.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.453+0000 7fc442ffd700 1 -- 172.21.15.6:0/308856014 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc454005e10 con 0x55d83a2e7cc0 2023-10-06T02:18:56.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.453+0000 7fc47401db80 10 client.5346 fetch_fsmap learned FSMap version 17 2023-10-06T02:18:56.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.453+0000 7fc47401db80 1 -- 172.21.15.6:0/308856014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d83a073fe0 con 0x55d83a2e7cc0 2023-10-06T02:18:56.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.453+0000 7fc442ffd700 1 -- 172.21.15.6:0/308856014 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d83a2db940 con 0x55d83a2e7cc0 2023-10-06T02:18:56.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.453+0000 7fc442ffd700 1 -- 172.21.15.6:0/308856014 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc454012070 con 0x55d83a2e7cc0 2023-10-06T02:18:56.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.453+0000 7fc47401db80 10 client.5346 fetch_fsmap finished waiting for FSMap version 17 2023-10-06T02:18:56.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.453+0000 7fc47401db80 10 client.5346 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:18:56.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.453+0000 7fc47401db80 20 client.5346 populate_metadata read hostname 'smithi006' 2023-10-06T02:18:56.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.453+0000 7fc47401db80 1 --2- 172.21.15.6:0/308856014 >> [v2:172.21.15.6:6832/774858203,v1:172.21.15.6:6834/774858203] conn(0x55d83a340480 0x55d83a340850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.453+0000 7fc47401db80 4 client.5346 mds_command: new command op to 5145 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:18:56.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.453+0000 7fc47401db80 1 -- 172.21.15.6:0/308856014 --> [v2:172.21.15.6:6832/774858203,v1:172.21.15.6:6834/774858203] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d83a2b8870 con 0x55d83a340480 2023-10-06T02:18:56.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.453+0000 7fc468ac1700 1 --2- 172.21.15.6:0/308856014 >> [v2:172.21.15.6:6832/774858203,v1:172.21.15.6:6834/774858203] conn(0x55d83a340480 0x55d83a340850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.454+0000 7fc442ffd700 10 client.5346 ms_handle_connect on v2:172.21.15.6:6832/774858203 2023-10-06T02:18:56.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.454+0000 7fc468ac1700 1 --2- 172.21.15.6:0/308856014 >> [v2:172.21.15.6:6832/774858203,v1:172.21.15.6:6834/774858203] conn(0x55d83a340480 0x55d83a340850 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d82926b38ab6789a server_cookie=6728339ae408eddd in_seq=0 out_seq=0 2023-10-06T02:18:56.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.454+0000 7fc442ffd700 1 -- 172.21.15.6:0/308856014 <== mds.0 v2:172.21.15.6:6832/774858203 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d83a2b8870 con 0x55d83a340480 2023-10-06T02:18:56.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.454+0000 7fc442ffd700 10 client.5346 handle_command_reply: tid=0 2023-10-06T02:18:56.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.454+0000 7fc47401db80 1 client.5346 shutdown 2023-10-06T02:18:56.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.454+0000 7fc47401db80 1 -- 172.21.15.6:0/308856014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e7cc0 msgr2=0x55d83a3253f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:56.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.454+0000 7fc47401db80 1 --2- 172.21.15.6:0/308856014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e7cc0 0x55d83a3253f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc45400f340 tx=0x7fc454009040 comp rx=0 tx=0).stop 2023-10-06T02:18:56.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.454+0000 7fc47401db80 1 -- 172.21.15.6:0/308856014 shutdown_connections 2023-10-06T02:18:56.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.454+0000 7fc47401db80 1 --2- 172.21.15.6:0/308856014 >> [v2:172.21.15.6:6832/774858203,v1:172.21.15.6:6834/774858203] conn(0x55d83a340480 0x55d83a340850 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.454+0000 7fc47401db80 1 --2- 172.21.15.6:0/308856014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a336c00 0x55d83a327fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.454+0000 7fc47401db80 1 --2- 172.21.15.6:0/308856014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a2e6840 0x55d83a32ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.454+0000 7fc47401db80 1 --2- 172.21.15.6:0/308856014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e7cc0 0x55d83a3253f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.454+0000 7fc442ffd700 0 client.5346 ms_handle_reset on v2:172.21.15.6:6832/774858203 2023-10-06T02:18:56.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.454+0000 7fc47401db80 1 -- 172.21.15.6:0/308856014 >> 172.21.15.6:0/308856014 conn(0x55d83a2e8160 msgr2=0x55d83a2e71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:56.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.455+0000 7fc47401db80 1 -- 172.21.15.6:0/308856014 shutdown_connections 2023-10-06T02:18:56.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.455+0000 7fc47401db80 1 -- 172.21.15.6:0/308856014 wait complete. 2023-10-06T02:18:56.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.455+0000 7fc47401db80 20 client.5346 trim_cache size 0 max 16384 2023-10-06T02:18:56.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.471+0000 7fc47401db80 1 Processor -- start 2023-10-06T02:18:56.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.471+0000 7fc47401db80 1 -- start start 2023-10-06T02:18:56.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.472+0000 7fc47401db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e6840 0x55d83a346c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.472+0000 7fc47401db80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a2e7cc0 0x55d83a2e8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.472+0000 7fc47401db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a336c00 0x55d83a2e8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.472+0000 7fc47401db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d83a2e1620 con 0x55d83a2e6840 2023-10-06T02:18:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.472+0000 7fc47401db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d83a32bd60 con 0x55d83a336c00 2023-10-06T02:18:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.472+0000 7fc47401db80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d83a2bf280 con 0x55d83a2e7cc0 2023-10-06T02:18:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.472+0000 7fc468ac1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e6840 0x55d83a346c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.472+0000 7fc468ac1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e6840 0x55d83a346c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41716/0 (socket says 172.21.15.6:41716) 2023-10-06T02:18:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.472+0000 7fc468ac1700 1 -- 172.21.15.6:0/2464182736 learned_addr learned my addr 172.21.15.6:0/2464182736 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.472+0000 7fc4692c2700 1 --2- 172.21.15.6:0/2464182736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a336c00 0x55d83a2e8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.472+0000 7fc463fff700 1 --2- 172.21.15.6:0/2464182736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a2e7cc0 0x55d83a2e8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.472+0000 7fc468ac1700 1 -- 172.21.15.6:0/2464182736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a2e7cc0 msgr2=0x55d83a2e8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.472+0000 7fc468ac1700 1 --2- 172.21.15.6:0/2464182736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a2e7cc0 0x55d83a2e8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.472+0000 7fc468ac1700 1 -- 172.21.15.6:0/2464182736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a336c00 msgr2=0x55d83a2e8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.472+0000 7fc468ac1700 1 --2- 172.21.15.6:0/2464182736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a336c00 0x55d83a2e8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.473+0000 7fc468ac1700 1 -- 172.21.15.6:0/2464182736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d83a205780 con 0x55d83a2e6840 2023-10-06T02:18:56.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.473+0000 7fc463fff700 1 --2- 172.21.15.6:0/2464182736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a2e7cc0 0x55d83a2e8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:18:56.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.473+0000 7fc468ac1700 1 --2- 172.21.15.6:0/2464182736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e6840 0x55d83a346c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x55d83a327550 tx=0x7fc45c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c6f0fee6d5e2a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:56.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.473+0000 7fc45a7fc700 1 -- 172.21.15.6:0/2464182736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c029070 con 0x55d83a2e6840 2023-10-06T02:18:56.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.473+0000 7fc45a7fc700 1 -- 172.21.15.6:0/2464182736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45c0247f0 con 0x55d83a2e6840 2023-10-06T02:18:56.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.473+0000 7fc45a7fc700 1 -- 172.21.15.6:0/2464182736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c024b70 con 0x55d83a2e6840 2023-10-06T02:18:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.473+0000 7fc47401db80 1 -- 172.21.15.6:0/2464182736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e6840 msgr2=0x55d83a346c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.473+0000 7fc47401db80 1 --2- 172.21.15.6:0/2464182736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e6840 0x55d83a346c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x55d83a327550 tx=0x7fc45c016000 comp rx=0 tx=0).stop 2023-10-06T02:18:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.473+0000 7fc47401db80 1 -- 172.21.15.6:0/2464182736 shutdown_connections 2023-10-06T02:18:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.473+0000 7fc47401db80 1 --2- 172.21.15.6:0/2464182736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a336c00 0x55d83a2e8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.473+0000 7fc47401db80 1 --2- 172.21.15.6:0/2464182736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e6840 0x55d83a346c80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.473+0000 7fc47401db80 1 --2- 172.21.15.6:0/2464182736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a2e7cc0 0x55d83a2e8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.473+0000 7fc47401db80 1 -- 172.21.15.6:0/2464182736 >> 172.21.15.6:0/2464182736 conn(0x55d83a2e8160 msgr2=0x55d83a329e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.473+0000 7fc47401db80 1 -- 172.21.15.6:0/2464182736 shutdown_connections 2023-10-06T02:18:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.473+0000 7fc47401db80 1 -- 172.21.15.6:0/2464182736 wait complete. 2023-10-06T02:18:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.474+0000 7fc47401db80 1 -- start start 2023-10-06T02:18:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.474+0000 7fc47401db80 1 Processor -- start 2023-10-06T02:18:56.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.475+0000 7fc47401db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e6840 0x55d83a30d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.475+0000 7fc47401db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a2e7cc0 0x55d83a2e8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.475+0000 7fc47401db80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a336c00 0x55d83a2e8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.475+0000 7fc47401db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d83a392cc0 con 0x55d83a2e6840 2023-10-06T02:18:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.475+0000 7fc47401db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d83a334490 con 0x55d83a2e7cc0 2023-10-06T02:18:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.475+0000 7fc47401db80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d83a324ea0 con 0x55d83a336c00 2023-10-06T02:18:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.475+0000 7fc47401db80 10 client.0 _ll_register_callbacks cb 0x55d83a2a9e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:18:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.475+0000 7fc468ac1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e6840 0x55d83a30d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.475+0000 7fc468ac1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e6840 0x55d83a30d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41730/0 (socket says 172.21.15.6:41730) 2023-10-06T02:18:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.475+0000 7fc468ac1700 1 -- 172.21.15.6:0/1442993557 learned_addr learned my addr 172.21.15.6:0/1442993557 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.475+0000 7fc463fff700 1 --2- 172.21.15.6:0/1442993557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a2e7cc0 0x55d83a2e8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.475+0000 7fc4692c2700 1 --2- 172.21.15.6:0/1442993557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a336c00 0x55d83a2e8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.475+0000 7fc468ac1700 1 -- 172.21.15.6:0/1442993557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a336c00 msgr2=0x55d83a2e8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc468ac1700 1 --2- 172.21.15.6:0/1442993557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a336c00 0x55d83a2e8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc468ac1700 1 -- 172.21.15.6:0/1442993557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a2e7cc0 msgr2=0x55d83a2e8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc468ac1700 1 --2- 172.21.15.6:0/1442993557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a2e7cc0 0x55d83a2e8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc468ac1700 1 -- 172.21.15.6:0/1442993557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45c0168f0 con 0x55d83a2e6840 2023-10-06T02:18:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc468ac1700 1 --2- 172.21.15.6:0/1442993557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e6840 0x55d83a30d3b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc45c02e040 tx=0x7fc45c018030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c323a319a4ffbb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc442ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:18:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc442ffd700 1 -- 172.21.15.6:0/1442993557 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c02c580 con 0x55d83a2e6840 2023-10-06T02:18:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc442ffd700 1 -- 172.21.15.6:0/1442993557 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc45c040d90 con 0x55d83a2e6840 2023-10-06T02:18:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc47401db80 1 -- 172.21.15.6:0/1442993557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc44c056be0 con 0x55d83a2e6840 2023-10-06T02:18:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc442ffd700 1 -- 172.21.15.6:0/1442993557 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc45c02c8f0 con 0x55d83a2e6840 2023-10-06T02:18:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc47401db80 10 client.5352 fetch_fsmap learned FSMap version 17 2023-10-06T02:18:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc47401db80 1 -- 172.21.15.6:0/1442993557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d83a1ec470 con 0x55d83a2e6840 2023-10-06T02:18:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc442ffd700 1 -- 172.21.15.6:0/1442993557 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c056be0 con 0x55d83a2e6840 2023-10-06T02:18:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc442ffd700 1 -- 172.21.15.6:0/1442993557 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc45c02ca50 con 0x55d83a2e6840 2023-10-06T02:18:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc47401db80 10 client.5352 fetch_fsmap finished waiting for FSMap version 17 2023-10-06T02:18:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc47401db80 10 client.5352 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:18:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc47401db80 20 client.5352 populate_metadata read hostname 'smithi006' 2023-10-06T02:18:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc47401db80 1 --2- 172.21.15.6:0/1442993557 >> [v2:172.21.15.6:6832/774858203,v1:172.21.15.6:6834/774858203] conn(0x55d83a3290a0 0x55d83a339620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc47401db80 4 client.5352 mds_command: new command op to 5145 tid=0[{"prefix": "status"}] 2023-10-06T02:18:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.476+0000 7fc47401db80 1 -- 172.21.15.6:0/1442993557 --> [v2:172.21.15.6:6832/774858203,v1:172.21.15.6:6834/774858203] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d83a1d9e00 con 0x55d83a3290a0 2023-10-06T02:18:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.477+0000 7fc463fff700 1 --2- 172.21.15.6:0/1442993557 >> [v2:172.21.15.6:6832/774858203,v1:172.21.15.6:6834/774858203] conn(0x55d83a3290a0 0x55d83a339620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.477+0000 7fc442ffd700 10 client.5352 ms_handle_connect on v2:172.21.15.6:6832/774858203 2023-10-06T02:18:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.477+0000 7fc463fff700 1 --2- 172.21.15.6:0/1442993557 >> [v2:172.21.15.6:6832/774858203,v1:172.21.15.6:6834/774858203] conn(0x55d83a3290a0 0x55d83a339620 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=947627e66094dff5 server_cookie=374a3ffd7a35f3ca in_seq=0 out_seq=0 2023-10-06T02:18:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.477+0000 7fc442ffd700 1 -- 172.21.15.6:0/1442993557 <== mds.0 v2:172.21.15.6:6832/774858203 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55d83a1d9e00 con 0x55d83a3290a0 2023-10-06T02:18:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.477+0000 7fc442ffd700 10 client.5352 handle_command_reply: tid=0 2023-10-06T02:18:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.477+0000 7fc47401db80 1 client.5352 shutdown 2023-10-06T02:18:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.477+0000 7fc47401db80 1 -- 172.21.15.6:0/1442993557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e6840 msgr2=0x55d83a30d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.477+0000 7fc47401db80 1 --2- 172.21.15.6:0/1442993557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e6840 0x55d83a30d3b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc45c02e040 tx=0x7fc45c018030 comp rx=0 tx=0).stop 2023-10-06T02:18:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.477+0000 7fc47401db80 1 -- 172.21.15.6:0/1442993557 shutdown_connections 2023-10-06T02:18:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.477+0000 7fc47401db80 1 --2- 172.21.15.6:0/1442993557 >> [v2:172.21.15.6:6832/774858203,v1:172.21.15.6:6834/774858203] conn(0x55d83a3290a0 0x55d83a339620 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.477+0000 7fc47401db80 1 --2- 172.21.15.6:0/1442993557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d83a336c00 0x55d83a2e8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.477+0000 7fc47401db80 1 --2- 172.21.15.6:0/1442993557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d83a2e6840 0x55d83a30d3b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.477+0000 7fc442ffd700 0 client.5352 ms_handle_reset on v2:172.21.15.6:6832/774858203 2023-10-06T02:18:56.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.477+0000 7fc47401db80 1 --2- 172.21.15.6:0/1442993557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d83a2e7cc0 0x55d83a2e8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.477+0000 7fc47401db80 1 -- 172.21.15.6:0/1442993557 >> 172.21.15.6:0/1442993557 conn(0x55d83a2e8160 msgr2=0x55d83a346c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:56.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.477+0000 7fc47401db80 1 -- 172.21.15.6:0/1442993557 shutdown_connections 2023-10-06T02:18:56.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.477+0000 7fc47401db80 1 -- 172.21.15.6:0/1442993557 wait complete. 2023-10-06T02:18:56.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.478+0000 7fc47401db80 20 client.5352 trim_cache size 0 max 16384 2023-10-06T02:18:56.488 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:18:56.488 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:18:56.488 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:18:56.488 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5145, 2023-10-06T02:18:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:18:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:18:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:18:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.484944966, 2023-10-06T02:18:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 17, 2023-10-06T02:18:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 39, 2023-10-06T02:18:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 39, 2023-10-06T02:18:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 18.405087343000002 2023-10-06T02:18:56.489 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:18:56.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.478+0000 7fc46ad25700 1 -- 172.21.15.6:0/1069989894 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc444066f30 msgr2=0x7fc4440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:56.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.478+0000 7fc46ad25700 1 --2- 172.21.15.6:0/1069989894 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc444066f30 0x7fc4440693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc4640b2ba0 tx=0x7fc45c0098f0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.478+0000 7fc46ad25700 1 -- 172.21.15.6:0/1069989894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46415a940 msgr2=0x7fc4640aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:56.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.478+0000 7fc46ad25700 1 --2- 172.21.15.6:0/1069989894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46415a940 0x7fc4640aefc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0093f0 tx=0x7fc44c017000 comp rx=0 tx=0).stop 2023-10-06T02:18:56.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.478+0000 7fc46ad25700 1 -- 172.21.15.6:0/1069989894 shutdown_connections 2023-10-06T02:18:56.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.478+0000 7fc46ad25700 1 --2- 172.21.15.6:0/1069989894 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc444066f30 0x7fc4440693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.478+0000 7fc46ad25700 1 --2- 172.21.15.6:0/1069989894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46415a940 0x7fc4640aefc0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.478+0000 7fc46ad25700 1 --2- 172.21.15.6:0/1069989894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc464087700 0x7fc4640c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.478+0000 7fc46ad25700 1 --2- 172.21.15.6:0/1069989894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc46415a030 0x7fc46415ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.478+0000 7fc46ad25700 1 -- 172.21.15.6:0/1069989894 >> 172.21.15.6:0/1069989894 conn(0x7fc464068680 msgr2=0x7fc4641569a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:56.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.478+0000 7fc46ad25700 1 -- 172.21.15.6:0/1069989894 shutdown_connections 2023-10-06T02:18:56.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.478+0000 7fc46ad25700 1 -- 172.21.15.6:0/1069989894 wait complete. 2023-10-06T02:18:56.492 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:18:56.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.611+0000 7f8397042700 1 Processor -- start 2023-10-06T02:18:56.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.611+0000 7f8397042700 1 -- start start 2023-10-06T02:18:56.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.611+0000 7f8397042700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83900af4e0 0x7f83900b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.612+0000 7f8397042700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f839015db70 0x7f83900b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.612+0000 7f8397042700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839015e190 con 0x7f83900af8b0 2023-10-06T02:18:56.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.612+0000 7f8397042700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83900b1910 con 0x7f839015db70 2023-10-06T02:18:56.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.612+0000 7f8397042700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839015dfb0 con 0x7f83900af4e0 2023-10-06T02:18:56.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.612+0000 7f8394dde700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83900af4e0 0x7f83900b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.612+0000 7f83955df700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f839015db70 0x7f83900b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.612+0000 7f8394dde700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83900af4e0 0x7f83900b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:43162/0 (socket says 172.21.15.6:43162) 2023-10-06T02:18:56.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.612+0000 7f83955df700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f839015db70 0x7f83900b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:41638/0 (socket says 172.21.15.6:41638) 2023-10-06T02:18:56.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.612+0000 7f838ffff700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f83900af8b0 0x7f839015d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:38550/0 (socket says 172.21.15.6:38550) 2023-10-06T02:18:56.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.612+0000 7f8394dde700 1 -- 172.21.15.6:0/2474596382 learned_addr learned my addr 172.21.15.6:0/2474596382 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:56.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.612+0000 7f838f7fe700 1 -- 172.21.15.6:0/2474596382 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644336613 0 0) 0x7f839015e190 con 0x7f83900af8b0 2023-10-06T02:18:56.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.612+0000 7f838f7fe700 1 -- 172.21.15.6:0/2474596382 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f837c003570 con 0x7f83900af8b0 2023-10-06T02:18:56.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.612+0000 7f83955df700 1 -- 172.21.15.6:0/2474596382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83900af4e0 msgr2=0x7f83900b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:18:56.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.612+0000 7f83955df700 1 --2- 172.21.15.6:0/2474596382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83900af4e0 0x7f83900b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.612+0000 7f83955df700 1 -- 172.21.15.6:0/2474596382 >> v1:172.21.15.175:6789/0 conn(0x7f83900af8b0 legacy=0x7f839015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:56.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.612+0000 7f83955df700 1 -- 172.21.15.6:0/2474596382 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83900cb650 con 0x7f839015db70 2023-10-06T02:18:56.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.612+0000 7f8394dde700 1 --2- 172.21.15.6:0/2474596382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83900af4e0 0x7f83900b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:18:56.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.613+0000 7f83955df700 1 --2- 172.21.15.6:0/2474596382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f839015db70 0x7f83900b2620 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f83780098e0 tx=0x7f83780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7891a4bfe169a36b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:56.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.613+0000 7f838f7fe700 1 -- 172.21.15.6:0/2474596382 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378011630 con 0x7f839015db70 2023-10-06T02:18:56.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.613+0000 7f838f7fe700 1 -- 172.21.15.6:0/2474596382 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8378011790 con 0x7f839015db70 2023-10-06T02:18:56.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.613+0000 7f838f7fe700 1 -- 172.21.15.6:0/2474596382 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378011b30 con 0x7f839015db70 2023-10-06T02:18:56.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.613+0000 7f8397042700 1 -- 172.21.15.6:0/2474596382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f839015db70 msgr2=0x7f83900b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:56.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.613+0000 7f8397042700 1 --2- 172.21.15.6:0/2474596382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f839015db70 0x7f83900b2620 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f83780098e0 tx=0x7f83780091a0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.613+0000 7f8397042700 1 -- 172.21.15.6:0/2474596382 shutdown_connections 2023-10-06T02:18:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.613+0000 7f8397042700 1 --2- 172.21.15.6:0/2474596382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f839015db70 0x7f83900b2620 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.613+0000 7f8397042700 1 --2- 172.21.15.6:0/2474596382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83900af4e0 0x7f83900b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.613+0000 7f8397042700 1 -- 172.21.15.6:0/2474596382 >> 172.21.15.6:0/2474596382 conn(0x7f8390068680 msgr2=0x7f8390068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.613+0000 7f8397042700 1 -- 172.21.15.6:0/2474596382 shutdown_connections 2023-10-06T02:18:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.613+0000 7f8397042700 1 -- 172.21.15.6:0/2474596382 wait complete. 2023-10-06T02:18:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.614+0000 7f8397042700 1 Processor -- start 2023-10-06T02:18:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.615+0000 7f8397042700 1 -- start start 2023-10-06T02:18:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.615+0000 7f8397042700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83900af4e0 0x7f8390159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.615+0000 7f8397042700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83900af8b0 0x7f83900a7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.615+0000 7f8397042700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f839015db70 0x7f83900a7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.615+0000 7f8397042700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8390169770 con 0x7f839015db70 2023-10-06T02:18:56.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.615+0000 7f8397042700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83900c9730 con 0x7f83900af4e0 2023-10-06T02:18:56.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.615+0000 7f8397042700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83900a8310 con 0x7f83900af8b0 2023-10-06T02:18:56.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.615+0000 7f83955df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f839015db70 0x7f83900a7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.615+0000 7f83955df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f839015db70 0x7f83900a7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41732/0 (socket says 172.21.15.6:41732) 2023-10-06T02:18:56.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.615+0000 7f83955df700 1 -- 172.21.15.6:0/2030014180 learned_addr learned my addr 172.21.15.6:0/2030014180 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:18:56.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.615+0000 7f838ffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83900af8b0 0x7f83900a7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.615+0000 7f8394dde700 1 --2- 172.21.15.6:0/2030014180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83900af4e0 0x7f8390159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.616+0000 7f83955df700 1 -- 172.21.15.6:0/2030014180 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83900af8b0 msgr2=0x7f83900a7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:56.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.616+0000 7f83955df700 1 --2- 172.21.15.6:0/2030014180 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83900af8b0 0x7f83900a7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.616+0000 7f83955df700 1 -- 172.21.15.6:0/2030014180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83900af4e0 msgr2=0x7f8390159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:56.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.616+0000 7f83955df700 1 --2- 172.21.15.6:0/2030014180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83900af4e0 0x7f8390159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.616+0000 7f83955df700 1 -- 172.21.15.6:0/2030014180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8388009ae0 con 0x7f839015db70 2023-10-06T02:18:56.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.616+0000 7f83955df700 1 --2- 172.21.15.6:0/2030014180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f839015db70 0x7f83900a7c70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8390089520 tx=0x7f8378017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:56.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.616+0000 7f838cff9700 1 -- 172.21.15.6:0/2030014180 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378011b10 con 0x7f839015db70 2023-10-06T02:18:56.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.616+0000 7f838cff9700 1 -- 172.21.15.6:0/2030014180 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83780253f0 con 0x7f839015db70 2023-10-06T02:18:56.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.616+0000 7f8397042700 1 -- 172.21.15.6:0/2030014180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8378009420 con 0x7f839015db70 2023-10-06T02:18:56.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.616+0000 7f838cff9700 1 -- 172.21.15.6:0/2030014180 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378025790 con 0x7f839015db70 2023-10-06T02:18:56.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.616+0000 7f8397042700 1 -- 172.21.15.6:0/2030014180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83900a88d0 con 0x7f839015db70 2023-10-06T02:18:56.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.617+0000 7f8397042700 1 -- 172.21.15.6:0/2030014180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8390088aa0 con 0x7f839015db70 2023-10-06T02:18:56.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.617+0000 7f838cff9700 1 -- 172.21.15.6:0/2030014180 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8378025b80 con 0x7f839015db70 2023-10-06T02:18:56.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.618+0000 7f838cff9700 1 --2- 172.21.15.6:0/2030014180 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8370066f30 0x7f83700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:18:56.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.618+0000 7f838cff9700 1 -- 172.21.15.6:0/2030014180 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f83780860e0 con 0x7f839015db70 2023-10-06T02:18:56.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.618+0000 7f8394dde700 1 --2- 172.21.15.6:0/2030014180 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8370066f30 0x7f83700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:18:56.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.618+0000 7f8394dde700 1 --2- 172.21.15.6:0/2030014180 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8370066f30 0x7f83700693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f83880072d0 tx=0x7f838800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:18:56.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.622+0000 7f838cff9700 1 -- 172.21.15.6:0/2030014180 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83780530b0 con 0x7f839015db70 2023-10-06T02:18:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.861+0000 7f8397042700 1 -- 172.21.15.6:0/2030014180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f83900b2a50 con 0x7f839015db70 2023-10-06T02:18:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.862+0000 7f838cff9700 1 -- 172.21.15.6:0/2030014180 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f83780566d0 con 0x7f839015db70 2023-10-06T02:18:56.862 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:18:56.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.864+0000 7f8397042700 1 -- 172.21.15.6:0/2030014180 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8370066f30 msgr2=0x7f83700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:56.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.864+0000 7f8397042700 1 --2- 172.21.15.6:0/2030014180 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8370066f30 0x7f83700693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f83880072d0 tx=0x7f838800b040 comp rx=0 tx=0).stop 2023-10-06T02:18:56.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.864+0000 7f8397042700 1 -- 172.21.15.6:0/2030014180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f839015db70 msgr2=0x7f83900a7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:18:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.864+0000 7f8397042700 1 --2- 172.21.15.6:0/2030014180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f839015db70 0x7f83900a7c70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8390089520 tx=0x7f8378017000 comp rx=0 tx=0).stop 2023-10-06T02:18:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.864+0000 7f8397042700 1 -- 172.21.15.6:0/2030014180 shutdown_connections 2023-10-06T02:18:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.864+0000 7f8397042700 1 --2- 172.21.15.6:0/2030014180 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8370066f30 0x7f83700693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.864+0000 7f8397042700 1 --2- 172.21.15.6:0/2030014180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f839015db70 0x7f83900a7c70 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.864+0000 7f8397042700 1 --2- 172.21.15.6:0/2030014180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83900af4e0 0x7f8390159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.864+0000 7f8397042700 1 --2- 172.21.15.6:0/2030014180 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83900af8b0 0x7f83900a7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:18:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.864+0000 7f8397042700 1 -- 172.21.15.6:0/2030014180 >> 172.21.15.6:0/2030014180 conn(0x7f8390068680 msgr2=0x7f83900cee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:18:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.864+0000 7f8397042700 1 -- 172.21.15.6:0/2030014180 shutdown_connections 2023-10-06T02:18:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:18:56.864+0000 7f8397042700 1 -- 172.21.15.6:0/2030014180 wait complete. 2023-10-06T02:18:56.876 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:18:56.876 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:18:56.876 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:18:56.876 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:18:56.876 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:18:56.877 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:18:56.877 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:18:56.877 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:18:56.877 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:18:56.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:56.877 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:18:56.892 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:18:56.893 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:18:56.893 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:18:56.893 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:56.893 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:18:56.893 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:56.893 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:18:56.893 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:56.893 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:18:56.893 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:18:56.893 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:56.893 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:18:56.894 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:18:56.894 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:56.894 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:18:56.894 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:18:56.894 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42409sec preferred_lft 42409sec 2023-10-06T02:18:56.894 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:18:56.894 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:56.894 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:18:56.894 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:56.894 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:18:56.894 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:18:56.894 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:18:56.895 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:18:56.895 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:56.895 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:18:56.895 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:56.895 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:18:56.895 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:18:56.895 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:18:56.895 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:56.895 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:18:56.895 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:18:56.895 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:18:56.895 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:18:56.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:56.896 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:18:56.956 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:18:56.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:56.958 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:18:57.015 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:18:57.015 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:18:57.015 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:18:57.015 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:18:57.015 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:18:57.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:57.015 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:18:57.016 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:18:57.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:18:57.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:18:57.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:18:57.016 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:18:57.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:57.118 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:18:57.133 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:18:57.133 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:18:57.133 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:18:57.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:18:57.133 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:18:57.198 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:18:57.199 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:18:57.199 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:18:57.254 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:18:57.254 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:18:57.254 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:18:57.308 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:18:57.374 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:18:57.374 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:18:57.439 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:18:57.440 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:18:57.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:57.441 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:18:57.496 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:18:57.496 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:18:57.538 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:18:57.563 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:18:57.563 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:18:57.621 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:18:57.621+0000 7f1c9447a540 -1 init, newargv = 0x5575bc4626b0 newargc=15 2023-10-06T02:18:57.621 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[106213]: starting ceph client 2023-10-06T02:18:57.626 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[106213]: starting fuse 2023-10-06T02:18:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:18:57.631 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:18:57.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:57.632 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:18:57.687 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:18:57.687 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:18:57.687 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:18:57.688 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:18:57.688 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:18:57.688 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:18:57.688 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:18:57.688 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:18:57.688 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:18:57.688 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:18:57.688 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:18:57.688 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:18:57.688 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:18:57.688 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:18:57.688 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:18:57.688 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:18:57.689 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:18:57.689 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:18:57.689 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:18:57.689 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:18:57.689 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:18:57.689 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:18:57.689 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:18:57.689 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:18:57.689 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:18:57.689 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:18:57.689 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:18:57.689 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:18:57.689 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:18:57.810 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.106213.asok 2023-10-06T02:18:57.992 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.106213.asok 2023-10-06T02:18:57.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:57.992 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.106213.asok status 2023-10-06T02:18:58.147 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:18:58.147 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:18:58.147 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:18:58.147 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:18:58.148 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:18:58.148 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:18:58.148 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:18:58.148 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "106213", 2023-10-06T02:18:58.148 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:18:58.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:58.148 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:18:58.148 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:18:58.148 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5364, 2023-10-06T02:18:58.148 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:18:58.148 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:18:58.148 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:18:58.148 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5364 2023-10-06T02:18:58.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:58.149 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:18:58.149 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:18:58.149 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:18:58.149 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3417884249 2023-10-06T02:18:58.149 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:18:58.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:58.149 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:18:58.149 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:18:58.149 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:18:58.149 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3417884249 2023-10-06T02:18:58.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:18:58.150 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.5364 192.168.0.1:0/3417884249", 2023-10-06T02:18:58.150 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/3417884249", 2023-10-06T02:18:58.150 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:18:58.150 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 17, 2023-10-06T02:18:58.150 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 39, 2023-10-06T02:18:58.150 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:18:58.150 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:18:58.150 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:18:58.150 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:18:58.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:58.157 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:18:58.157 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:18:58.172 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:18:58.173 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:18:58.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:58.173 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:18:58.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:58.239 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/) 2023-10-06T02:18:58.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:58.301 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_undamaged) 2023-10-06T02:18:58.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:18:58.359 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_to_be_damaged) 2023-10-06T02:18:58.416 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:18:58.416 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:18:58.416 DEBUG:teuthology.orchestra.run.smithi006:> import stat 2023-10-06T02:18:58.416 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:18:58.417 DEBUG:teuthology.orchestra.run.smithi006:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2023-10-06T02:18:58.417 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:18:58.521 INFO:teuthology.orchestra.run.smithi006.stdout:1099511627776 2023-10-06T02:18:58.710 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:18:58.711 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:18:58.711 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:18:58.784 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[106213]: fuse finished with error 0 and tester_r 0 2023-10-06T02:18:58.785 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:19:04.886 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:19:04.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:04.887 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:19:04.906 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:19:05.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.080+0000 7f5efba80700 1 Processor -- start 2023-10-06T02:19:05.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.080+0000 7f5efba80700 1 -- start start 2023-10-06T02:19:05.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.081+0000 7f5efba80700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5ef40af4e0 0x7f5ef40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.081+0000 7f5efba80700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5ef415db70 0x7f5ef40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.081+0000 7f5efba80700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef415e190 con 0x7f5ef40af8b0 2023-10-06T02:19:05.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.081+0000 7f5efba80700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef40b1910 con 0x7f5ef40af4e0 2023-10-06T02:19:05.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.081+0000 7f5efba80700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef415dfa0 con 0x7f5ef415db70 2023-10-06T02:19:05.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.081+0000 7f5ef981c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5ef40af4e0 0x7f5ef40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.081+0000 7f5ef901b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5ef40af8b0 0x7f5ef415d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34054/0 (socket says 172.21.15.6:34054) 2023-10-06T02:19:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.081+0000 7f5ef981c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5ef40af4e0 0x7f5ef40b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32778/0 (socket says 172.21.15.6:32778) 2023-10-06T02:19:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.081+0000 7f5ef901b700 1 -- 172.21.15.6:0/3259456439 learned_addr learned my addr 172.21.15.6:0/3259456439 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:19:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.081+0000 7f5efa01d700 1 --2- 172.21.15.6:0/3259456439 >> v2:172.21.15.175:3300/0 conn(0x7f5ef415db70 0x7f5ef40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.081+0000 7f5ef981c700 1 -- 172.21.15.6:0/3259456439 >> v2:172.21.15.175:3300/0 conn(0x7f5ef415db70 msgr2=0x7f5ef40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.081+0000 7f5ef981c700 1 --2- 172.21.15.6:0/3259456439 >> v2:172.21.15.175:3300/0 conn(0x7f5ef415db70 0x7f5ef40b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.081+0000 7f5ef981c700 1 -- 172.21.15.6:0/3259456439 >> v1:172.21.15.6:6789/0 conn(0x7f5ef40af8b0 legacy=0x7f5ef415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.081+0000 7f5ef981c700 1 -- 172.21.15.6:0/3259456439 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef40cb650 con 0x7f5ef40af4e0 2023-10-06T02:19:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.082+0000 7f5ef981c700 1 --2- 172.21.15.6:0/3259456439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ef40af4e0 0x7f5ef40b20e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40c7280 tx=0x7f5ee40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5733af1ca9d708 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.082+0000 7f5ef881a700 1 -- 172.21.15.6:0/3259456439 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee400b6b0 con 0x7f5ef40af4e0 2023-10-06T02:19:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.082+0000 7f5ef881a700 1 -- 172.21.15.6:0/3259456439 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee400b810 con 0x7f5ef40af4e0 2023-10-06T02:19:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.082+0000 7f5ef881a700 1 -- 172.21.15.6:0/3259456439 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee400bbb0 con 0x7f5ef40af4e0 2023-10-06T02:19:05.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.082+0000 7f5efba80700 1 -- 172.21.15.6:0/3259456439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ef40af4e0 msgr2=0x7f5ef40b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:05.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.082+0000 7f5efba80700 1 --2- 172.21.15.6:0/3259456439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ef40af4e0 0x7f5ef40b20e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40c7280 tx=0x7f5ee40091a0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.082+0000 7f5efba80700 1 -- 172.21.15.6:0/3259456439 shutdown_connections 2023-10-06T02:19:05.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.082+0000 7f5efba80700 1 --2- 172.21.15.6:0/3259456439 >> v2:172.21.15.175:3300/0 conn(0x7f5ef415db70 0x7f5ef40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.082+0000 7f5efba80700 1 --2- 172.21.15.6:0/3259456439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ef40af4e0 0x7f5ef40b20e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.082+0000 7f5efba80700 1 -- 172.21.15.6:0/3259456439 >> 172.21.15.6:0/3259456439 conn(0x7f5ef4068680 msgr2=0x7f5ef4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.082+0000 7f5efba80700 1 -- 172.21.15.6:0/3259456439 shutdown_connections 2023-10-06T02:19:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.083+0000 7f5efba80700 1 -- 172.21.15.6:0/3259456439 wait complete. 2023-10-06T02:19:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.084+0000 7f5efba80700 1 Processor -- start 2023-10-06T02:19:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.084+0000 7f5efba80700 1 -- start start 2023-10-06T02:19:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.084+0000 7f5efba80700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ef40af4e0 0x7f5ef40d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.084+0000 7f5efba80700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef40af8b0 0x7f5ef4152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.084+0000 7f5efba80700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ef415db70 0x7f5ef41510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.084+0000 7f5efba80700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40cff10 con 0x7f5ef415db70 2023-10-06T02:19:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.084+0000 7f5efba80700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef41527c0 con 0x7f5ef40af8b0 2023-10-06T02:19:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.084+0000 7f5efba80700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef4151610 con 0x7f5ef40af4e0 2023-10-06T02:19:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.084+0000 7f5efa01d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ef415db70 0x7f5ef41510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.084+0000 7f5efa01d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ef415db70 0x7f5ef41510d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32790/0 (socket says 172.21.15.6:32790) 2023-10-06T02:19:05.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.084+0000 7f5efa01d700 1 -- 172.21.15.6:0/2561510244 learned_addr learned my addr 172.21.15.6:0/2561510244 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:05.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.085+0000 7f5ef901b700 1 --2- 172.21.15.6:0/2561510244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef40af8b0 0x7f5ef4152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.085+0000 7f5ef981c700 1 --2- 172.21.15.6:0/2561510244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ef40af4e0 0x7f5ef40d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.085+0000 7f5efa01d700 1 -- 172.21.15.6:0/2561510244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ef40af4e0 msgr2=0x7f5ef40d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:05.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.085+0000 7f5efa01d700 1 --2- 172.21.15.6:0/2561510244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ef40af4e0 0x7f5ef40d0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.085+0000 7f5efa01d700 1 -- 172.21.15.6:0/2561510244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef40af8b0 msgr2=0x7f5ef4152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:05.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.085+0000 7f5efa01d700 1 --2- 172.21.15.6:0/2561510244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef40af8b0 0x7f5ef4152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.085+0000 7f5efa01d700 1 -- 172.21.15.6:0/2561510244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee4009420 con 0x7f5ef415db70 2023-10-06T02:19:05.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.085+0000 7f5ef901b700 1 --2- 172.21.15.6:0/2561510244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef40af8b0 0x7f5ef4152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:05.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.085+0000 7f5efa01d700 1 --2- 172.21.15.6:0/2561510244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ef415db70 0x7f5ef41510d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009fd0 tx=0x7f5eec009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:05.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.085+0000 7f5ee9ffb700 1 -- 172.21.15.6:0/2561510244 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec00ed50 con 0x7f5ef415db70 2023-10-06T02:19:05.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.085+0000 7f5ee9ffb700 1 -- 172.21.15.6:0/2561510244 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec00eeb0 con 0x7f5ef415db70 2023-10-06T02:19:05.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.085+0000 7f5efba80700 1 -- 172.21.15.6:0/2561510244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef40d13f0 con 0x7f5ef415db70 2023-10-06T02:19:05.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.085+0000 7f5ee9ffb700 1 -- 172.21.15.6:0/2561510244 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec014650 con 0x7f5ef415db70 2023-10-06T02:19:05.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.085+0000 7f5efba80700 1 -- 172.21.15.6:0/2561510244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef40cf8c0 con 0x7f5ef415db70 2023-10-06T02:19:05.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.086+0000 7f5efba80700 1 -- 172.21.15.6:0/2561510244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef40d00c0 con 0x7f5ef415db70 2023-10-06T02:19:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.087+0000 7f5ee9ffb700 1 -- 172.21.15.6:0/2561510244 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5eec0149c0 con 0x7f5ef415db70 2023-10-06T02:19:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.087+0000 7f5ee9ffb700 1 --2- 172.21.15.6:0/2561510244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ed8066f30 0x7f5ed80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.087+0000 7f5ee9ffb700 1 -- 172.21.15.6:0/2561510244 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5eec084f60 con 0x7f5ef415db70 2023-10-06T02:19:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.087+0000 7f5ef981c700 1 --2- 172.21.15.6:0/2561510244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ed8066f30 0x7f5ed80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.088+0000 7f5ef981c700 1 --2- 172.21.15.6:0/2561510244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ed8066f30 0x7f5ed80693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40cd790 tx=0x7f5ee4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:05.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.091+0000 7f5ee9ffb700 1 -- 172.21.15.6:0/2561510244 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ef40d00c0 con 0x7f5ef415db70 2023-10-06T02:19:05.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.329+0000 7f5efba80700 1 -- 172.21.15.6:0/2561510244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ef40d0050 con 0x7f5ef415db70 2023-10-06T02:19:05.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.329+0000 7f5ee9ffb700 1 -- 172.21.15.6:0/2561510244 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7f5eec051f30 con 0x7f5ef415db70 2023-10-06T02:19:05.330 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:19:05.330 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1173605075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1173605075},{"type":"v1","addr":"172.21.15.175:6837","nonce":1173605075}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/375122461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":375122461},{"type":"v1","addr":"172.21.15.175:6835","nonce":375122461}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5142,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3506443204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3506443204},{"type":"v1","addr":"172.21.15.6:6835","nonce":3506443204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:18:45.349958+0000","modified":"2023-10-06T02:18:49.004214+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5145":{"gid":5145,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/774858203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":774858203},{"type":"v1","addr":"172.21.15.6:6834","nonce":774858203}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:19:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.331+0000 7f5efba80700 1 -- 172.21.15.6:0/2561510244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ed8066f30 msgr2=0x7f5ed80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.331+0000 7f5efba80700 1 --2- 172.21.15.6:0/2561510244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ed8066f30 0x7f5ed80693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40cd790 tx=0x7f5ee4017000 comp rx=0 tx=0).stop 2023-10-06T02:19:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.331+0000 7f5efba80700 1 -- 172.21.15.6:0/2561510244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ef415db70 msgr2=0x7f5ef41510d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.331+0000 7f5efba80700 1 --2- 172.21.15.6:0/2561510244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ef415db70 0x7f5ef41510d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009fd0 tx=0x7f5eec009900 comp rx=0 tx=0).stop 2023-10-06T02:19:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.331+0000 7f5efba80700 1 -- 172.21.15.6:0/2561510244 shutdown_connections 2023-10-06T02:19:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.331+0000 7f5efba80700 1 --2- 172.21.15.6:0/2561510244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ed8066f30 0x7f5ed80693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.331+0000 7f5efba80700 1 --2- 172.21.15.6:0/2561510244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ef415db70 0x7f5ef41510d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.331+0000 7f5efba80700 1 --2- 172.21.15.6:0/2561510244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ef40af4e0 0x7f5ef40d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.331+0000 7f5efba80700 1 --2- 172.21.15.6:0/2561510244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef40af8b0 0x7f5ef4152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.331+0000 7f5efba80700 1 -- 172.21.15.6:0/2561510244 >> 172.21.15.6:0/2561510244 conn(0x7f5ef4068680 msgr2=0x7f5ef40b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:05.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.331+0000 7f5efba80700 1 -- 172.21.15.6:0/2561510244 shutdown_connections 2023-10-06T02:19:05.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.331+0000 7f5efba80700 1 -- 172.21.15.6:0/2561510244 wait complete. 2023-10-06T02:19:05.333 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-10-06T02:19:05.344 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-10-06T02:19:05.490 INFO:teuthology.orchestra.run.smithi006.stdout:{"message":"","return_code":0} 2023-10-06T02:19:05.490 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T02:19:05.491 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:19:05.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.610+0000 7fc15c44d700 1 Processor -- start 2023-10-06T02:19:05.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.610+0000 7fc15c44d700 1 -- start start 2023-10-06T02:19:05.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.611+0000 7fc15c44d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc1540d0400 0x7fc1540b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.611+0000 7fc15c44d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc1540ccd40 0x7fc1540cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.611+0000 7fc15c44d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1540b6170 con 0x7fc1540cf7e0 2023-10-06T02:19:05.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.611+0000 7fc15c44d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc15415dd40 con 0x7fc1540d0400 2023-10-06T02:19:05.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.611+0000 7fc15c44d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc15415e020 con 0x7fc1540ccd40 2023-10-06T02:19:05.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.611+0000 7fc15a1e9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc1540d0400 0x7fc1540b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.611+0000 7fc15a1e9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc1540d0400 0x7fc1540b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32800/0 (socket says 172.21.15.6:32800) 2023-10-06T02:19:05.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.611+0000 7fc15a1e9700 1 -- 172.21.15.6:0/3166115215 learned_addr learned my addr 172.21.15.6:0/3166115215 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:05.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.612+0000 7fc1599e8700 1 --2- 172.21.15.6:0/3166115215 >> v2:172.21.15.175:3300/0 conn(0x7fc1540ccd40 0x7fc1540cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.612+0000 7fc15a1e9700 1 -- 172.21.15.6:0/3166115215 >> v2:172.21.15.175:3300/0 conn(0x7fc1540ccd40 msgr2=0x7fc1540cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:05.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.612+0000 7fc15a1e9700 1 --2- 172.21.15.6:0/3166115215 >> v2:172.21.15.175:3300/0 conn(0x7fc1540ccd40 0x7fc1540cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.612+0000 7fc15a1e9700 1 -- 172.21.15.6:0/3166115215 >> v1:172.21.15.175:6789/0 conn(0x7fc1540cf7e0 legacy=0x7fc1540b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:05.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.612+0000 7fc15a1e9700 1 -- 172.21.15.6:0/3166115215 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1540ceaa0 con 0x7fc1540d0400 2023-10-06T02:19:05.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.612+0000 7fc15a1e9700 1 --2- 172.21.15.6:0/3166115215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1540d0400 0x7fc1540b5c30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc1540cd1c0 tx=0x7fc14c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484531a04c699cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:05.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.612+0000 7fc1591e7700 1 -- 172.21.15.6:0/3166115215 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14c005c10 con 0x7fc1540d0400 2023-10-06T02:19:05.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.612+0000 7fc1591e7700 1 -- 172.21.15.6:0/3166115215 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14c005d70 con 0x7fc1540d0400 2023-10-06T02:19:05.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.612+0000 7fc1591e7700 1 -- 172.21.15.6:0/3166115215 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14c00b840 con 0x7fc1540d0400 2023-10-06T02:19:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.612+0000 7fc15c44d700 1 -- 172.21.15.6:0/3166115215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1540d0400 msgr2=0x7fc1540b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.612+0000 7fc15c44d700 1 --2- 172.21.15.6:0/3166115215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1540d0400 0x7fc1540b5c30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc1540cd1c0 tx=0x7fc14c009220 comp rx=0 tx=0).stop 2023-10-06T02:19:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.613+0000 7fc15c44d700 1 -- 172.21.15.6:0/3166115215 shutdown_connections 2023-10-06T02:19:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.613+0000 7fc15c44d700 1 --2- 172.21.15.6:0/3166115215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1540d0400 0x7fc1540b5c30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.613+0000 7fc15c44d700 1 --2- 172.21.15.6:0/3166115215 >> v2:172.21.15.175:3300/0 conn(0x7fc1540ccd40 0x7fc1540cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.613+0000 7fc15c44d700 1 -- 172.21.15.6:0/3166115215 >> 172.21.15.6:0/3166115215 conn(0x7fc15406a220 msgr2=0x7fc15406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.613+0000 7fc15c44d700 1 -- 172.21.15.6:0/3166115215 shutdown_connections 2023-10-06T02:19:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.613+0000 7fc15c44d700 1 -- 172.21.15.6:0/3166115215 wait complete. 2023-10-06T02:19:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.614+0000 7fc15c44d700 1 Processor -- start 2023-10-06T02:19:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.614+0000 7fc15c44d700 1 -- start start 2023-10-06T02:19:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.614+0000 7fc15c44d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1540ccd40 0x7fc1540b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.614+0000 7fc15c44d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1540cf7e0 0x7fc1540b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.614+0000 7fc15c44d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1540d0400 0x7fc15416a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.614+0000 7fc15c44d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15416c090 con 0x7fc1540cf7e0 2023-10-06T02:19:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.614+0000 7fc15c44d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15416b410 con 0x7fc1540d0400 2023-10-06T02:19:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.614+0000 7fc15c44d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15416b760 con 0x7fc1540ccd40 2023-10-06T02:19:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc1599e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1540cf7e0 0x7fc1540b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc1599e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1540cf7e0 0x7fc1540b4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32816/0 (socket says 172.21.15.6:32816) 2023-10-06T02:19:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc1599e8700 1 -- 172.21.15.6:0/1246869121 learned_addr learned my addr 172.21.15.6:0/1246869121 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc15a9ea700 1 --2- 172.21.15.6:0/1246869121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1540d0400 0x7fc15416a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc15a1e9700 1 --2- 172.21.15.6:0/1246869121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1540ccd40 0x7fc1540b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc1599e8700 1 -- 172.21.15.6:0/1246869121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1540ccd40 msgr2=0x7fc1540b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc1599e8700 1 --2- 172.21.15.6:0/1246869121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1540ccd40 0x7fc1540b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc1599e8700 1 -- 172.21.15.6:0/1246869121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1540d0400 msgr2=0x7fc15416a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc1599e8700 1 --2- 172.21.15.6:0/1246869121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1540d0400 0x7fc15416a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc1599e8700 1 -- 172.21.15.6:0/1246869121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c009480 con 0x7fc1540cf7e0 2023-10-06T02:19:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc15a9ea700 1 --2- 172.21.15.6:0/1246869121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1540d0400 0x7fc15416a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc15a1e9700 1 --2- 172.21.15.6:0/1246869121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1540ccd40 0x7fc1540b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc1599e8700 1 --2- 172.21.15.6:0/1246869121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1540cf7e0 0x7fc1540b4da0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc14800d890 tx=0x7fc148008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:05.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc1527fc700 1 -- 172.21.15.6:0/1246869121 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14800b600 con 0x7fc1540cf7e0 2023-10-06T02:19:05.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc1527fc700 1 -- 172.21.15.6:0/1246869121 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14800b760 con 0x7fc1540cf7e0 2023-10-06T02:19:05.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc15c44d700 1 -- 172.21.15.6:0/1246869121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc15416ba40 con 0x7fc1540cf7e0 2023-10-06T02:19:05.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc1527fc700 1 -- 172.21.15.6:0/1246869121 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14800bae0 con 0x7fc1540cf7e0 2023-10-06T02:19:05.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.615+0000 7fc15c44d700 1 -- 172.21.15.6:0/1246869121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc154153850 con 0x7fc1540cf7e0 2023-10-06T02:19:05.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.616+0000 7fc15c44d700 1 -- 172.21.15.6:0/1246869121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc154088760 con 0x7fc1540cf7e0 2023-10-06T02:19:05.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.617+0000 7fc1527fc700 1 -- 172.21.15.6:0/1246869121 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc14801e460 con 0x7fc1540cf7e0 2023-10-06T02:19:05.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.617+0000 7fc1527fc700 1 --2- 172.21.15.6:0/1246869121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc140066f30 0x7fc1400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.617+0000 7fc1527fc700 1 -- 172.21.15.6:0/1246869121 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc148084eb0 con 0x7fc1540cf7e0 2023-10-06T02:19:05.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.617+0000 7fc15a1e9700 1 --2- 172.21.15.6:0/1246869121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc140066f30 0x7fc1400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.618+0000 7fc15a1e9700 1 --2- 172.21.15.6:0/1246869121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc140066f30 0x7fc1400693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc1540b56c0 tx=0x7fc14c015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:05.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.621+0000 7fc1527fc700 1 -- 172.21.15.6:0/1246869121 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc148051e80 con 0x7fc1540cf7e0 2023-10-06T02:19:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.863+0000 7fc15c44d700 1 -- 172.21.15.6:0/1246869121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc1540ced80 con 0x7fc1540cf7e0 2023-10-06T02:19:05.863 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:19:05.863+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:19:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.867+0000 7fc1527fc700 1 -- 172.21.15.6:0/1246869121 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc1480554a0 con 0x7fc1540cf7e0 2023-10-06T02:19:05.869 INFO:tasks.ceph.mds.c.smithi006.stderr: -3299> 2023-10-06T02:18:48.929+0000 7fc0c0e5d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:19:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.870+0000 7fc15c44d700 1 -- 172.21.15.6:0/1246869121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc140066f30 msgr2=0x7fc1400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.870+0000 7fc15c44d700 1 --2- 172.21.15.6:0/1246869121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc140066f30 0x7fc1400693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc1540b56c0 tx=0x7fc14c015000 comp rx=0 tx=0).stop 2023-10-06T02:19:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.870+0000 7fc15c44d700 1 -- 172.21.15.6:0/1246869121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1540cf7e0 msgr2=0x7fc1540b4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.870+0000 7fc15c44d700 1 --2- 172.21.15.6:0/1246869121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1540cf7e0 0x7fc1540b4da0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc14800d890 tx=0x7fc148008040 comp rx=0 tx=0).stop 2023-10-06T02:19:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.870+0000 7fc15c44d700 1 -- 172.21.15.6:0/1246869121 shutdown_connections 2023-10-06T02:19:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.870+0000 7fc15c44d700 1 --2- 172.21.15.6:0/1246869121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1540d0400 0x7fc15416a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.870+0000 7fc15c44d700 1 --2- 172.21.15.6:0/1246869121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1540ccd40 0x7fc1540b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.870+0000 7fc15c44d700 1 --2- 172.21.15.6:0/1246869121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc140066f30 0x7fc1400693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.870+0000 7fc15c44d700 1 --2- 172.21.15.6:0/1246869121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1540cf7e0 0x7fc1540b4da0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.870+0000 7fc15c44d700 1 -- 172.21.15.6:0/1246869121 >> 172.21.15.6:0/1246869121 conn(0x7fc15406a220 msgr2=0x7fc1540b1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.870+0000 7fc15c44d700 1 -- 172.21.15.6:0/1246869121 shutdown_connections 2023-10-06T02:19:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.870+0000 7fc15c44d700 1 -- 172.21.15.6:0/1246869121 wait complete. 2023-10-06T02:19:05.872 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:19:05.883 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2023-10-06T02:19:05.895 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-06T02:19:05.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.924+0000 7f74838a0000 1 Processor -- start 2023-10-06T02:19:05.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.924+0000 7f74838a0000 1 -- start start 2023-10-06T02:19:05.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.924+0000 7f74838a0000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5628633bde80 0x5628633e9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f74838a0000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56286347aab0 0x56286348f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f74838a0000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56286347ae80 0x56286348f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f74838a0000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562863305980 con 0x56286347ae80 2023-10-06T02:19:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f74838a0000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562863305620 con 0x56286347aab0 2023-10-06T02:19:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f74838a0000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628632fc400 con 0x5628633bde80 2023-10-06T02:19:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f747d2dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56286347ae80 0x56286348f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f747d2dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56286347ae80 0x56286348f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32852/0 (socket says 172.21.15.6:32852) 2023-10-06T02:19:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f747d2dc700 1 -- 172.21.15.6:0/2029930214 learned_addr learned my addr 172.21.15.6:0/2029930214 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f747d2dc700 1 -- 172.21.15.6:0/2029930214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5628633bde80 msgr2=0x5628633e9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f747cadb700 1 --2- 172.21.15.6:0/2029930214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5628633bde80 0x5628633e9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f7477fff700 1 --2- 172.21.15.6:0/2029930214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56286347aab0 0x56286348f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f747d2dc700 1 --2- 172.21.15.6:0/2029930214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5628633bde80 0x5628633e9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f747d2dc700 1 -- 172.21.15.6:0/2029930214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56286347aab0 msgr2=0x56286348f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:05.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f747d2dc700 1 --2- 172.21.15.6:0/2029930214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56286347aab0 0x56286348f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f747d2dc700 1 -- 172.21.15.6:0/2029930214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7468005db0 con 0x56286347ae80 2023-10-06T02:19:05.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f747d2dc700 1 --2- 172.21.15.6:0/2029930214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56286347ae80 0x56286348f680 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f74780096a0 tx=0x7f7478007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c29818e61821ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:05.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f7476ffd700 1 -- 172.21.15.6:0/2029930214 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7478010600 con 0x56286347ae80 2023-10-06T02:19:05.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f7476ffd700 1 -- 172.21.15.6:0/2029930214 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7478010760 con 0x56286347ae80 2023-10-06T02:19:05.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.925+0000 7f7476ffd700 1 -- 172.21.15.6:0/2029930214 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7478010b20 con 0x56286347ae80 2023-10-06T02:19:05.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.926+0000 7f74838a0000 1 -- 172.21.15.6:0/2029930214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56286347ae80 msgr2=0x56286348f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:05.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.926+0000 7f74838a0000 1 --2- 172.21.15.6:0/2029930214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56286347ae80 0x56286348f680 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f74780096a0 tx=0x7f7478007040 comp rx=0 tx=0).stop 2023-10-06T02:19:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.926+0000 7f74838a0000 1 -- 172.21.15.6:0/2029930214 shutdown_connections 2023-10-06T02:19:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.926+0000 7f74838a0000 1 --2- 172.21.15.6:0/2029930214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56286347ae80 0x56286348f680 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.926+0000 7f74838a0000 1 --2- 172.21.15.6:0/2029930214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5628633bde80 0x5628633e9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.926+0000 7f74838a0000 1 --2- 172.21.15.6:0/2029930214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56286347aab0 0x56286348f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.926+0000 7f74838a0000 1 -- 172.21.15.6:0/2029930214 >> 172.21.15.6:0/2029930214 conn(0x5628633b96b0 msgr2=0x5628634052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.926+0000 7f74838a0000 1 -- 172.21.15.6:0/2029930214 shutdown_connections 2023-10-06T02:19:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.926+0000 7f74838a0000 1 -- 172.21.15.6:0/2029930214 wait complete. 2023-10-06T02:19:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.926+0000 7f74838a0000 1 Processor -- start 2023-10-06T02:19:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.926+0000 7f74838a0000 1 -- start start 2023-10-06T02:19:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.927+0000 7f74838a0000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5628633bde80 0x5628634954a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.927+0000 7f74838a0000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56286347aab0 0x5628634017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.927+0000 7f74838a0000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56286347ae80 0x562863493b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.927+0000 7f74838a0000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562863494080 con 0x56286347ae80 2023-10-06T02:19:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.927+0000 7f74838a0000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562863492c20 con 0x56286347aab0 2023-10-06T02:19:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.927+0000 7f74838a0000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x562863492ec0 con 0x5628633bde80 2023-10-06T02:19:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.927+0000 7f747d2dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56286347ae80 0x562863493b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.927+0000 7f747d2dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56286347ae80 0x562863493b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32866/0 (socket says 172.21.15.6:32866) 2023-10-06T02:19:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.927+0000 7f747d2dc700 1 -- 172.21.15.6:0/2300479426 learned_addr learned my addr 172.21.15.6:0/2300479426 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.927+0000 7f7477fff700 1 --2- 172.21.15.6:0/2300479426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56286347aab0 0x5628634017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.927+0000 7f747cadb700 1 --2- 172.21.15.6:0/2300479426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5628633bde80 0x5628634954a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.928+0000 7f747d2dc700 1 -- 172.21.15.6:0/2300479426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5628633bde80 msgr2=0x5628634954a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.928+0000 7f747d2dc700 1 --2- 172.21.15.6:0/2300479426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5628633bde80 0x5628634954a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.928+0000 7f747d2dc700 1 -- 172.21.15.6:0/2300479426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56286347aab0 msgr2=0x5628634017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.928+0000 7f747d2dc700 1 --2- 172.21.15.6:0/2300479426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56286347aab0 0x5628634017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.928+0000 7f747d2dc700 1 -- 172.21.15.6:0/2300479426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74780092a0 con 0x56286347ae80 2023-10-06T02:19:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.928+0000 7f7477fff700 1 --2- 172.21.15.6:0/2300479426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56286347aab0 0x5628634017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.928+0000 7f747d2dc700 1 --2- 172.21.15.6:0/2300479426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56286347ae80 0x562863493b40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7478009df0 tx=0x7f7478017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.928+0000 7f74757fa700 1 -- 172.21.15.6:0/2300479426 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747801e070 con 0x56286347ae80 2023-10-06T02:19:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.928+0000 7f74757fa700 1 -- 172.21.15.6:0/2300479426 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7478010e90 con 0x56286347ae80 2023-10-06T02:19:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.928+0000 7f74757fa700 1 -- 172.21.15.6:0/2300479426 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7478022660 con 0x56286347ae80 2023-10-06T02:19:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.928+0000 7f74838a0000 1 -- 172.21.15.6:0/2300479426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5628633143d0 con 0x56286347ae80 2023-10-06T02:19:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.928+0000 7f74838a0000 1 -- 172.21.15.6:0/2300479426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562863307ae0 con 0x56286347ae80 2023-10-06T02:19:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.929+0000 7f74757fa700 1 -- 172.21.15.6:0/2300479426 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f747802c440 con 0x56286347ae80 2023-10-06T02:19:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.930+0000 7f74757fa700 1 --2- 172.21.15.6:0/2300479426 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f74600658c0 0x7f7460067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.930+0000 7f74757fa700 1 -- 172.21.15.6:0/2300479426 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7478084df0 con 0x56286347ae80 2023-10-06T02:19:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.930+0000 7f747cadb700 1 --2- 172.21.15.6:0/2300479426 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f74600658c0 0x7f7460067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.930+0000 7f74838a0000 1 --2- 172.21.15.6:0/2300479426 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5628633eb200 0x5628634a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.930+0000 7f74838a0000 1 -- 172.21.15.6:0/2300479426 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40) v8 -- 0x5628634a2340 con 0x5628633eb200 2023-10-06T02:19:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.930+0000 7f7477fff700 1 --2- 172.21.15.6:0/2300479426 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5628633eb200 0x5628634a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.930+0000 7f7477fff700 1 --2- 172.21.15.6:0/2300479426 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5628633eb200 0x5628634a1e00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.930+0000 7f747cadb700 1 --2- 172.21.15.6:0/2300479426 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f74600658c0 0x7f7460067d70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f746800afd0 tx=0x7f7468016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:05.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.932+0000 7f7477fff700 1 -- 172.21.15.6:0/2300479426 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v40'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f747000e5e0 con 0x5628633eb200 2023-10-06T02:19:05.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.932+0000 7f74838a0000 1 -- 172.21.15.6:0/2300479426 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5628633eb200 msgr2=0x5628634a1e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:05.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.932+0000 7f74838a0000 1 --2- 172.21.15.6:0/2300479426 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5628633eb200 0x5628634a1e00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:05.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.932+0000 7f74838a0000 1 -- 172.21.15.6:0/2300479426 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f74600658c0 msgr2=0x7f7460067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:05.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.932+0000 7f74838a0000 1 --2- 172.21.15.6:0/2300479426 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f74600658c0 0x7f7460067d70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f746800afd0 tx=0x7f7468016000 comp rx=0 tx=0).stop 2023-10-06T02:19:05.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.932+0000 7f74838a0000 1 -- 172.21.15.6:0/2300479426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56286347ae80 msgr2=0x562863493b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:05.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.932+0000 7f74838a0000 1 --2- 172.21.15.6:0/2300479426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56286347ae80 0x562863493b40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7478009df0 tx=0x7f7478017000 comp rx=0 tx=0).stop 2023-10-06T02:19:05.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.932+0000 7f747d2dc700 1 -- 172.21.15.6:0/2300479426 reap_dead start 2023-10-06T02:19:05.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.932+0000 7f74838a0000 1 -- 172.21.15.6:0/2300479426 shutdown_connections 2023-10-06T02:19:05.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.932+0000 7f74838a0000 1 -- 172.21.15.6:0/2300479426 >> 172.21.15.6:0/2300479426 conn(0x5628633b96b0 msgr2=0x5628634048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:05.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.932+0000 7f74838a0000 1 -- 172.21.15.6:0/2300479426 shutdown_connections 2023-10-06T02:19:05.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:05.932+0000 7f74838a0000 1 -- 172.21.15.6:0/2300479426 wait complete. 2023-10-06T02:19:05.938 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:19:06.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.098+0000 7f1c7e62c700 1 Processor -- start 2023-10-06T02:19:06.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.098+0000 7f1c7e62c700 1 -- start start 2023-10-06T02:19:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.099+0000 7f1c7e62c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c780d0400 0x7f1c780b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.099+0000 7f1c7e62c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1c780d07d0 0x7f1c780b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.099+0000 7f1c7e62c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c780b6170 con 0x7f1c780ccd40 2023-10-06T02:19:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.099+0000 7f1c7e62c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7815dd40 con 0x7f1c780d07d0 2023-10-06T02:19:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.099+0000 7f1c7e62c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7815e020 con 0x7f1c780d0400 2023-10-06T02:19:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.099+0000 7f1c7cbc9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1c780d07d0 0x7f1c780b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:06.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.099+0000 7f1c7cbc9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1c780d07d0 0x7f1c780b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32876/0 (socket says 172.21.15.6:32876) 2023-10-06T02:19:06.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.099+0000 7f1c7cbc9700 1 -- 172.21.15.6:0/1093991899 learned_addr learned my addr 172.21.15.6:0/1093991899 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:06.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.099+0000 7f1c77fff700 1 --2- 172.21.15.6:0/1093991899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c780d0400 0x7f1c780b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:06.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.100+0000 7f1c7cbc9700 1 -- 172.21.15.6:0/1093991899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c780d0400 msgr2=0x7f1c780b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:06.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.100+0000 7f1c7cbc9700 1 --2- 172.21.15.6:0/1093991899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c780d0400 0x7f1c780b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:06.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.100+0000 7f1c7cbc9700 1 -- 172.21.15.6:0/1093991899 >> v1:172.21.15.175:6789/0 conn(0x7f1c780ccd40 legacy=0x7f1c780cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:06.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.100+0000 7f1c7cbc9700 1 -- 172.21.15.6:0/1093991899 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c780ceaa0 con 0x7f1c780d07d0 2023-10-06T02:19:06.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.100+0000 7f1c7cbc9700 1 --2- 172.21.15.6:0/1093991899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c780d07d0 0x7f1c780b3aa0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009f20 tx=0x7f1c70009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ffa92787787d38 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:06.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.100+0000 7f1c76ffd700 1 -- 172.21.15.6:0/1093991899 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7000e070 con 0x7f1c780d07d0 2023-10-06T02:19:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.100+0000 7f1c76ffd700 1 -- 172.21.15.6:0/1093991899 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7000b9d0 con 0x7f1c780d07d0 2023-10-06T02:19:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.100+0000 7f1c76ffd700 1 -- 172.21.15.6:0/1093991899 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c700092e0 con 0x7f1c780d07d0 2023-10-06T02:19:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.101+0000 7f1c7e62c700 1 -- 172.21.15.6:0/1093991899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c780d07d0 msgr2=0x7f1c780b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.101+0000 7f1c7e62c700 1 --2- 172.21.15.6:0/1093991899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c780d07d0 0x7f1c780b3aa0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009f20 tx=0x7f1c70009840 comp rx=0 tx=0).stop 2023-10-06T02:19:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.101+0000 7f1c7e62c700 1 -- 172.21.15.6:0/1093991899 shutdown_connections 2023-10-06T02:19:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.101+0000 7f1c7e62c700 1 --2- 172.21.15.6:0/1093991899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c780d07d0 0x7f1c780b3aa0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.101+0000 7f1c7e62c700 1 --2- 172.21.15.6:0/1093991899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c780d0400 0x7f1c780b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.101+0000 7f1c7e62c700 1 -- 172.21.15.6:0/1093991899 >> 172.21.15.6:0/1093991899 conn(0x7f1c7806a220 msgr2=0x7f1c7806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.101+0000 7f1c7e62c700 1 -- 172.21.15.6:0/1093991899 shutdown_connections 2023-10-06T02:19:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.101+0000 7f1c7e62c700 1 -- 172.21.15.6:0/1093991899 wait complete. 2023-10-06T02:19:06.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.102+0000 7f1c7e62c700 1 Processor -- start 2023-10-06T02:19:06.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.102+0000 7f1c7e62c700 1 -- start start 2023-10-06T02:19:06.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c7e62c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c780ccd40 0x7f1c78152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:06.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c7e62c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c780d0400 0x7f1c7816a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:06.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c7e62c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c780d07d0 0x7f1c7814e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:06.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c7e62c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c781535d0 con 0x7f1c780d07d0 2023-10-06T02:19:06.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c7e62c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c78150c70 con 0x7f1c780ccd40 2023-10-06T02:19:06.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c7e62c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c78150380 con 0x7f1c780d0400 2023-10-06T02:19:06.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c7cbc9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c780d07d0 0x7f1c7814e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:06.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c7cbc9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c780d07d0 0x7f1c7814e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32882/0 (socket says 172.21.15.6:32882) 2023-10-06T02:19:06.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c7cbc9700 1 -- 172.21.15.6:0/1073273802 learned_addr learned my addr 172.21.15.6:0/1073273802 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:06.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c77fff700 1 --2- 172.21.15.6:0/1073273802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c780ccd40 0x7f1c78152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:06.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c777fe700 1 --2- 172.21.15.6:0/1073273802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c780d0400 0x7f1c7816a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:06.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c7cbc9700 1 -- 172.21.15.6:0/1073273802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c780d0400 msgr2=0x7f1c7816a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:06.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c7cbc9700 1 --2- 172.21.15.6:0/1073273802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c780d0400 0x7f1c7816a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:06.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c7cbc9700 1 -- 172.21.15.6:0/1073273802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c780ccd40 msgr2=0x7f1c78152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:06.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c7cbc9700 1 --2- 172.21.15.6:0/1073273802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c780ccd40 0x7f1c78152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:06.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c7cbc9700 1 -- 172.21.15.6:0/1073273802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c70009ae0 con 0x7f1c780d07d0 2023-10-06T02:19:06.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c777fe700 1 --2- 172.21.15.6:0/1073273802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c780d0400 0x7f1c7816a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:06.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.103+0000 7f1c7cbc9700 1 --2- 172.21.15.6:0/1073273802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c780d07d0 0x7f1c7814e8d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000b610 tx=0x7f1c70018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:06.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.104+0000 7f1c5ffff700 1 -- 172.21.15.6:0/1073273802 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70008b80 con 0x7f1c780d07d0 2023-10-06T02:19:06.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.104+0000 7f1c5ffff700 1 -- 172.21.15.6:0/1073273802 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c70008ce0 con 0x7f1c780d07d0 2023-10-06T02:19:06.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.104+0000 7f1c7e62c700 1 -- 172.21.15.6:0/1073273802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c78150620 con 0x7f1c780d07d0 2023-10-06T02:19:06.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.104+0000 7f1c5ffff700 1 -- 172.21.15.6:0/1073273802 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70025690 con 0x7f1c780d07d0 2023-10-06T02:19:06.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.104+0000 7f1c7e62c700 1 -- 172.21.15.6:0/1073273802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c781531c0 con 0x7f1c780d07d0 2023-10-06T02:19:06.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.105+0000 7f1c7e62c700 1 -- 172.21.15.6:0/1073273802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c78088760 con 0x7f1c780d07d0 2023-10-06T02:19:06.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.105+0000 7f1c5ffff700 1 -- 172.21.15.6:0/1073273802 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c70003040 con 0x7f1c780d07d0 2023-10-06T02:19:06.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.105+0000 7f1c5ffff700 1 --2- 172.21.15.6:0/1073273802 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c64066f30 0x7f1c640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:06.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.106+0000 7f1c5ffff700 1 -- 172.21.15.6:0/1073273802 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f1c70086460 con 0x7f1c780d07d0 2023-10-06T02:19:06.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.106+0000 7f1c77fff700 1 --2- 172.21.15.6:0/1073273802 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c64066f30 0x7f1c640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:06.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.106+0000 7f1c77fff700 1 --2- 172.21.15.6:0/1073273802 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c64066f30 0x7f1c640693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009da0 tx=0x7f1c68009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:06.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.110+0000 7f1c5ffff700 1 -- 172.21.15.6:0/1073273802 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c70053410 con 0x7f1c780d07d0 2023-10-06T02:19:06.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.349+0000 7f1c7e62c700 1 -- 172.21.15.6:0/1073273802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f1c780ced80 con 0x7f1c780d07d0 2023-10-06T02:19:06.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.870+0000 7f1c5ffff700 1 -- 172.21.15.6:0/1073273802 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v19) v1 ==== 162+0+0 (secure 0 0 0) 0x7f1c70056a30 con 0x7f1c780d07d0 2023-10-06T02:19:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.872+0000 7f1c7e62c700 1 -- 172.21.15.6:0/1073273802 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c64066f30 msgr2=0x7f1c640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.872+0000 7f1c7e62c700 1 --2- 172.21.15.6:0/1073273802 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c64066f30 0x7f1c640693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009da0 tx=0x7f1c68009120 comp rx=0 tx=0).stop 2023-10-06T02:19:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.872+0000 7f1c7e62c700 1 -- 172.21.15.6:0/1073273802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c780d07d0 msgr2=0x7f1c7814e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.872+0000 7f1c7e62c700 1 --2- 172.21.15.6:0/1073273802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c780d07d0 0x7f1c7814e8d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000b610 tx=0x7f1c70018000 comp rx=0 tx=0).stop 2023-10-06T02:19:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.872+0000 7f1c7e62c700 1 -- 172.21.15.6:0/1073273802 shutdown_connections 2023-10-06T02:19:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.872+0000 7f1c7e62c700 1 --2- 172.21.15.6:0/1073273802 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c64066f30 0x7f1c640693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.872+0000 7f1c7e62c700 1 --2- 172.21.15.6:0/1073273802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c780d07d0 0x7f1c7814e8d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.873+0000 7f1c7e62c700 1 --2- 172.21.15.6:0/1073273802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c780ccd40 0x7f1c78152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.873+0000 7f1c7e62c700 1 --2- 172.21.15.6:0/1073273802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c780d0400 0x7f1c7816a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:06.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.873+0000 7f1c7e62c700 1 -- 172.21.15.6:0/1073273802 >> 172.21.15.6:0/1073273802 conn(0x7f1c7806a220 msgr2=0x7f1c78157f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:06.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.873+0000 7f1c7e62c700 1 -- 172.21.15.6:0/1073273802 shutdown_connections 2023-10-06T02:19:06.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:06.873+0000 7f1c7e62c700 1 -- 172.21.15.6:0/1073273802 wait complete. 2023-10-06T02:19:06.874 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:19:06.888 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:19:07.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.008+0000 7f9640096700 1 Processor -- start 2023-10-06T02:19:07.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.008+0000 7f9640096700 1 -- start start 2023-10-06T02:19:07.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.009+0000 7f9640096700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f96380ad110 0x7f96380aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:07.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.009+0000 7f9640096700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96381597f0 0x7f96380ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:07.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.009+0000 7f9640096700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96380cc430 con 0x7f9638159420 2023-10-06T02:19:07.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.009+0000 7f9640096700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96380b0920 con 0x7f96380ad110 2023-10-06T02:19:07.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.009+0000 7f9640096700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96380af180 con 0x7f96381597f0 2023-10-06T02:19:07.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.009+0000 7f963d631700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f96380ad110 0x7f96380aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:07.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.009+0000 7f963d631700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f96380ad110 0x7f96380aeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32894/0 (socket says 172.21.15.6:32894) 2023-10-06T02:19:07.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.009+0000 7f963d631700 1 -- 172.21.15.6:0/3470736406 learned_addr learned my addr 172.21.15.6:0/3470736406 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:07.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.009+0000 7f963e633700 1 --2- 172.21.15.6:0/3470736406 >> v2:172.21.15.175:3300/0 conn(0x7f96381597f0 0x7f96380ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:07.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.009+0000 7f963d631700 1 -- 172.21.15.6:0/3470736406 >> v2:172.21.15.175:3300/0 conn(0x7f96381597f0 msgr2=0x7f96380ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:07.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.009+0000 7f963d631700 1 --2- 172.21.15.6:0/3470736406 >> v2:172.21.15.175:3300/0 conn(0x7f96381597f0 0x7f96380ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:07.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.009+0000 7f963d631700 1 -- 172.21.15.6:0/3470736406 >> v1:172.21.15.175:6789/0 conn(0x7f9638159420 legacy=0x7f96380aca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:07.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.009+0000 7f963d631700 1 -- 172.21.15.6:0/3470736406 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96380b1400 con 0x7f96380ad110 2023-10-06T02:19:07.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.009+0000 7f963d631700 1 --2- 172.21.15.6:0/3470736406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380ad110 0x7f96380aeaa0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f96380abda0 tx=0x7f962c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadc7ab6b68998b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:07.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.009+0000 7f963ce30700 1 -- 172.21.15.6:0/3470736406 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c00b7e0 con 0x7f96380ad110 2023-10-06T02:19:07.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.009+0000 7f963ce30700 1 -- 172.21.15.6:0/3470736406 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962c00b940 con 0x7f96380ad110 2023-10-06T02:19:07.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.010+0000 7f963ce30700 1 -- 172.21.15.6:0/3470736406 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c00bce0 con 0x7f96380ad110 2023-10-06T02:19:07.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.010+0000 7f9640096700 1 -- 172.21.15.6:0/3470736406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380ad110 msgr2=0x7f96380aeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:07.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.010+0000 7f9640096700 1 --2- 172.21.15.6:0/3470736406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380ad110 0x7f96380aeaa0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f96380abda0 tx=0x7f962c009250 comp rx=0 tx=0).stop 2023-10-06T02:19:07.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.010+0000 7f9640096700 1 -- 172.21.15.6:0/3470736406 shutdown_connections 2023-10-06T02:19:07.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.010+0000 7f9640096700 1 --2- 172.21.15.6:0/3470736406 >> v2:172.21.15.175:3300/0 conn(0x7f96381597f0 0x7f96380ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:07.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.010+0000 7f9640096700 1 --2- 172.21.15.6:0/3470736406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380ad110 0x7f96380aeaa0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:07.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.010+0000 7f9640096700 1 -- 172.21.15.6:0/3470736406 >> 172.21.15.6:0/3470736406 conn(0x7f96380cc790 msgr2=0x7f96380ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:07.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.010+0000 7f9640096700 1 -- 172.21.15.6:0/3470736406 shutdown_connections 2023-10-06T02:19:07.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.010+0000 7f9640096700 1 -- 172.21.15.6:0/3470736406 wait complete. 2023-10-06T02:19:07.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.011+0000 7f9640096700 1 Processor -- start 2023-10-06T02:19:07.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.011+0000 7f9640096700 1 -- start start 2023-10-06T02:19:07.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f9640096700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380ad110 0x7f96380989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:07.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f9640096700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9638159420 0x7f9638096bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f9640096700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96381597f0 0x7f9638097130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f9640096700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9638098530 con 0x7f96380ad110 2023-10-06T02:19:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f9640096700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9638097670 con 0x7f96381597f0 2023-10-06T02:19:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f9640096700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9638097920 con 0x7f9638159420 2023-10-06T02:19:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f963de32700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380ad110 0x7f96380989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f963de32700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380ad110 0x7f96380989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32910/0 (socket says 172.21.15.6:32910) 2023-10-06T02:19:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f963de32700 1 -- 172.21.15.6:0/3862144145 learned_addr learned my addr 172.21.15.6:0/3862144145 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f963e633700 1 --2- 172.21.15.6:0/3862144145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96381597f0 0x7f9638097130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f963de32700 1 -- 172.21.15.6:0/3862144145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9638159420 msgr2=0x7f9638096bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f963d631700 1 --2- 172.21.15.6:0/3862144145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9638159420 0x7f9638096bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f963de32700 1 --2- 172.21.15.6:0/3862144145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9638159420 0x7f9638096bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f963de32700 1 -- 172.21.15.6:0/3862144145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96381597f0 msgr2=0x7f9638097130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:07.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f963de32700 1 --2- 172.21.15.6:0/3862144145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96381597f0 0x7f9638097130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:07.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f963de32700 1 -- 172.21.15.6:0/3862144145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c0094f0 con 0x7f96380ad110 2023-10-06T02:19:07.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f963e633700 1 --2- 172.21.15.6:0/3862144145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96381597f0 0x7f9638097130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:07.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f963d631700 1 --2- 172.21.15.6:0/3862144145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9638159420 0x7f9638096bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:07.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.012+0000 7f963de32700 1 --2- 172.21.15.6:0/3862144145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380ad110 0x7f96380989c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f962800bbb0 tx=0x7f9628009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:07.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.013+0000 7f9635ffb700 1 -- 172.21.15.6:0/3862144145 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96280092e0 con 0x7f96380ad110 2023-10-06T02:19:07.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.013+0000 7f9635ffb700 1 -- 172.21.15.6:0/3862144145 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962800c7a0 con 0x7f96380ad110 2023-10-06T02:19:07.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.013+0000 7f9635ffb700 1 -- 172.21.15.6:0/3862144145 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962800cb40 con 0x7f96380ad110 2023-10-06T02:19:07.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.013+0000 7f9640096700 1 -- 172.21.15.6:0/3862144145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9638097c00 con 0x7f96380ad110 2023-10-06T02:19:07.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.013+0000 7f9640096700 1 -- 172.21.15.6:0/3862144145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96380981c0 con 0x7f96380ad110 2023-10-06T02:19:07.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.014+0000 7f9640096700 1 -- 172.21.15.6:0/3862144145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9638098810 con 0x7f96380ad110 2023-10-06T02:19:07.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.014+0000 7f9635ffb700 1 -- 172.21.15.6:0/3862144145 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9628012070 con 0x7f96380ad110 2023-10-06T02:19:07.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.014+0000 7f9635ffb700 1 --2- 172.21.15.6:0/3862144145 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9624066f30 0x7f96240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:07.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.015+0000 7f9635ffb700 1 -- 172.21.15.6:0/3862144145 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f9628084560 con 0x7f96380ad110 2023-10-06T02:19:07.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.015+0000 7f963d631700 1 --2- 172.21.15.6:0/3862144145 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9624066f30 0x7f96240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:07.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.015+0000 7f963d631700 1 --2- 172.21.15.6:0/3862144145 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9624066f30 0x7f96240693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f96380abda0 tx=0x7f962c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:07.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.019+0000 7f9635ffb700 1 -- 172.21.15.6:0/3862144145 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96280514e0 con 0x7f96380ad110 2023-10-06T02:19:07.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.257+0000 7f9640096700 1 -- 172.21.15.6:0/3862144145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96380ae3f0 con 0x7f96380ad110 2023-10-06T02:19:07.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.258+0000 7f9635ffb700 1 -- 172.21.15.6:0/3862144145 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f9628054b00 con 0x7f96380ad110 2023-10-06T02:19:07.258 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:19:07.258 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1173605075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1173605075},{"type":"v1","addr":"172.21.15.175:6837","nonce":1173605075}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/375122461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":375122461},{"type":"v1","addr":"172.21.15.175:6835","nonce":375122461}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5142,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3506443204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3506443204},{"type":"v1","addr":"172.21.15.6:6835","nonce":3506443204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:18:45.349958+0000","modified":"2023-10-06T02:19:06.870889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5385},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5385":{"gid":5385,"name":"c","rank":0,"incarnation":20,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6834/1188971598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1188971598},{"type":"v1","addr":"172.21.15.6:6834","nonce":1188971598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:19:07.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.260+0000 7f9640096700 1 -- 172.21.15.6:0/3862144145 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9624066f30 msgr2=0x7f96240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:07.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.260+0000 7f9640096700 1 --2- 172.21.15.6:0/3862144145 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9624066f30 0x7f96240693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f96380abda0 tx=0x7f962c016000 comp rx=0 tx=0).stop 2023-10-06T02:19:07.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.260+0000 7f9640096700 1 -- 172.21.15.6:0/3862144145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380ad110 msgr2=0x7f96380989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:07.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.260+0000 7f9640096700 1 --2- 172.21.15.6:0/3862144145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380ad110 0x7f96380989c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f962800bbb0 tx=0x7f9628009840 comp rx=0 tx=0).stop 2023-10-06T02:19:07.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.260+0000 7f9640096700 1 -- 172.21.15.6:0/3862144145 shutdown_connections 2023-10-06T02:19:07.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.260+0000 7f9640096700 1 --2- 172.21.15.6:0/3862144145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96381597f0 0x7f9638097130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:07.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.260+0000 7f9640096700 1 --2- 172.21.15.6:0/3862144145 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9624066f30 0x7f96240693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:07.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.260+0000 7f9640096700 1 --2- 172.21.15.6:0/3862144145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380ad110 0x7f96380989c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:07.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.260+0000 7f9640096700 1 --2- 172.21.15.6:0/3862144145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9638159420 0x7f9638096bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:07.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.260+0000 7f9640096700 1 -- 172.21.15.6:0/3862144145 >> 172.21.15.6:0/3862144145 conn(0x7f96380cc790 msgr2=0x7f9638069a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:07.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.260+0000 7f9640096700 1 -- 172.21.15.6:0/3862144145 shutdown_connections 2023-10-06T02:19:07.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:07.260+0000 7f9640096700 1 -- 172.21.15.6:0/3862144145 wait complete. 2023-10-06T02:19:07.262 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 20 2023-10-06T02:19:07.675 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:18:45.349958+0000', 'modified': '2023-10-06T02:19:06.870889+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 40, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5385}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5385': {'gid': 5385, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.6:6834/1188971598', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 1188971598}, {'type': 'v1', 'addr': '172.21.15.6:6834', 'nonce': 1188971598}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:19:07.675 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5385:up:replay 2023-10-06T02:19:08.676 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:19:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.808+0000 7fd012af5700 1 Processor -- start 2023-10-06T02:19:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.808+0000 7fd012af5700 1 -- start start 2023-10-06T02:19:08.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.809+0000 7fd012af5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd00c159400 0x7fd00c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:08.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.809+0000 7fd012af5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd00c0cd030 0x7fd00c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:08.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.809+0000 7fd012af5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00c0b3560 con 0x7fd00c0cf1a0 2023-10-06T02:19:08.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.809+0000 7fd012af5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd00c0cf6f0 con 0x7fd00c0cd030 2023-10-06T02:19:08.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.809+0000 7fd012af5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c0cf9d0 con 0x7fd00c159400 2023-10-06T02:19:08.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.809+0000 7fd011af3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd00c159400 0x7fd00c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:08.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.809+0000 7fd0112f2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd00c0cd030 0x7fd00c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:08.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.809+0000 7fd0112f2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd00c0cd030 0x7fd00c0cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:41262/0 (socket says 172.21.15.6:41262) 2023-10-06T02:19:08.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.809+0000 7fd0112f2700 1 -- 172.21.15.6:0/3694619801 learned_addr learned my addr 172.21.15.6:0/3694619801 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:08.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.809+0000 7fd011af3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd00c159400 0x7fd00c0ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:49376/0 (socket says 172.21.15.6:49376) 2023-10-06T02:19:08.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.810+0000 7fd011af3700 1 -- 172.21.15.6:0/3694619801 >> v2:172.21.15.175:3300/0 conn(0x7fd00c0cd030 msgr2=0x7fd00c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:08.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.810+0000 7fd011af3700 1 --2- 172.21.15.6:0/3694619801 >> v2:172.21.15.175:3300/0 conn(0x7fd00c0cd030 0x7fd00c0cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:08.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.810+0000 7fd011af3700 1 -- 172.21.15.6:0/3694619801 >> v1:172.21.15.175:6789/0 conn(0x7fd00c0cf1a0 legacy=0x7fd00c0b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:08.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.810+0000 7fd011af3700 1 -- 172.21.15.6:0/3694619801 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c0b2f10 con 0x7fd00c159400 2023-10-06T02:19:08.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.810+0000 7fd0112f2700 1 --2- 172.21.15.6:0/3694619801 >> v2:172.21.15.175:3300/0 conn(0x7fd00c0cd030 0x7fd00c0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:19:08.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.810+0000 7fd011af3700 1 --2- 172.21.15.6:0/3694619801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd00c159400 0x7fd00c0ccaf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd0040098d0 tx=0x7fd004009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acc443845f4b1035 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.810+0000 7fd010af1700 1 -- 172.21.15.6:0/3694619801 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004005c10 con 0x7fd00c159400 2023-10-06T02:19:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.810+0000 7fd010af1700 1 -- 172.21.15.6:0/3694619801 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd004005d70 con 0x7fd00c159400 2023-10-06T02:19:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.810+0000 7fd010af1700 1 -- 172.21.15.6:0/3694619801 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004006280 con 0x7fd00c159400 2023-10-06T02:19:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.811+0000 7fd012af5700 1 -- 172.21.15.6:0/3694619801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd00c159400 msgr2=0x7fd00c0ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.811+0000 7fd012af5700 1 --2- 172.21.15.6:0/3694619801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd00c159400 0x7fd00c0ccaf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd0040098d0 tx=0x7fd004009120 comp rx=0 tx=0).stop 2023-10-06T02:19:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.811+0000 7fd012af5700 1 -- 172.21.15.6:0/3694619801 shutdown_connections 2023-10-06T02:19:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.811+0000 7fd012af5700 1 --2- 172.21.15.6:0/3694619801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd00c159400 0x7fd00c0ccaf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.811+0000 7fd012af5700 1 --2- 172.21.15.6:0/3694619801 >> v2:172.21.15.175:3300/0 conn(0x7fd00c0cd030 0x7fd00c0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.811+0000 7fd012af5700 1 -- 172.21.15.6:0/3694619801 >> 172.21.15.6:0/3694619801 conn(0x7fd00c06ac10 msgr2=0x7fd00c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.811+0000 7fd012af5700 1 -- 172.21.15.6:0/3694619801 shutdown_connections 2023-10-06T02:19:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.811+0000 7fd012af5700 1 -- 172.21.15.6:0/3694619801 wait complete. 2023-10-06T02:19:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.812+0000 7fd012af5700 1 Processor -- start 2023-10-06T02:19:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.812+0000 7fd012af5700 1 -- start start 2023-10-06T02:19:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd012af5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd00c0cd030 0x7fd00c145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd012af5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd00c0cf1a0 0x7fd00c15a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd012af5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd00c159400 0x7fd00c0b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd012af5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c1539c0 con 0x7fd00c0cf1a0 2023-10-06T02:19:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd012af5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c153f80 con 0x7fd00c159400 2023-10-06T02:19:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd012af5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c15af40 con 0x7fd00c0cd030 2023-10-06T02:19:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd0112f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd00c0cf1a0 0x7fd00c15a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd0112f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd00c0cf1a0 0x7fd00c15a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44276/0 (socket says 172.21.15.6:44276) 2023-10-06T02:19:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd0112f2700 1 -- 172.21.15.6:0/3598237366 learned_addr learned my addr 172.21.15.6:0/3598237366 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd011af3700 1 --2- 172.21.15.6:0/3598237366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd00c0cd030 0x7fd00c145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd0122f4700 1 --2- 172.21.15.6:0/3598237366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd00c159400 0x7fd00c0b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd0112f2700 1 -- 172.21.15.6:0/3598237366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd00c0cd030 msgr2=0x7fd00c145b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd0112f2700 1 --2- 172.21.15.6:0/3598237366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd00c0cd030 0x7fd00c145b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd0112f2700 1 -- 172.21.15.6:0/3598237366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd00c159400 msgr2=0x7fd00c0b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd0112f2700 1 --2- 172.21.15.6:0/3598237366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd00c159400 0x7fd00c0b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd0112f2700 1 -- 172.21.15.6:0/3598237366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0000094f0 con 0x7fd00c0cf1a0 2023-10-06T02:19:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd0112f2700 1 --2- 172.21.15.6:0/3598237366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd00c0cf1a0 0x7fd00c15a450 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd00000ec50 tx=0x7fd000009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.813+0000 7fd009ffb700 1 -- 172.21.15.6:0/3598237366 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0000097d0 con 0x7fd00c0cf1a0 2023-10-06T02:19:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.814+0000 7fd009ffb700 1 -- 172.21.15.6:0/3598237366 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00000c850 con 0x7fd00c0cf1a0 2023-10-06T02:19:08.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.814+0000 7fd012af5700 1 -- 172.21.15.6:0/3598237366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0040093c0 con 0x7fd00c0cf1a0 2023-10-06T02:19:08.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.814+0000 7fd009ffb700 1 -- 172.21.15.6:0/3598237366 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00000cbf0 con 0x7fd00c0cf1a0 2023-10-06T02:19:08.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.814+0000 7fd012af5700 1 -- 172.21.15.6:0/3598237366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c153c10 con 0x7fd00c0cf1a0 2023-10-06T02:19:08.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.815+0000 7fd012af5700 1 -- 172.21.15.6:0/3598237366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00c1540f0 con 0x7fd00c0cf1a0 2023-10-06T02:19:08.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.815+0000 7fd009ffb700 1 -- 172.21.15.6:0/3598237366 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd000013470 con 0x7fd00c0cf1a0 2023-10-06T02:19:08.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.816+0000 7fd009ffb700 1 --2- 172.21.15.6:0/3598237366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcff8066f30 0x7fcff80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:08.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.816+0000 7fd009ffb700 1 -- 172.21.15.6:0/3598237366 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fd000084e30 con 0x7fd00c0cf1a0 2023-10-06T02:19:08.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.816+0000 7fd011af3700 1 --2- 172.21.15.6:0/3598237366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcff8066f30 0x7fcff80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:08.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.816+0000 7fd011af3700 1 --2- 172.21.15.6:0/3598237366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcff8066f30 0x7fcff80693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0b5850 tx=0x7fd004016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:08.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:08.820+0000 7fd009ffb700 1 -- 172.21.15.6:0/3598237366 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd000051d30 con 0x7fd00c0cf1a0 2023-10-06T02:19:09.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:09.060+0000 7fd012af5700 1 -- 172.21.15.6:0/3598237366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd00c159860 con 0x7fd00c0cf1a0 2023-10-06T02:19:09.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:09.060+0000 7fd009ffb700 1 -- 172.21.15.6:0/3598237366 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fd000017090 con 0x7fd00c0cf1a0 2023-10-06T02:19:09.061 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:19:09.061 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1173605075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1173605075},{"type":"v1","addr":"172.21.15.175:6837","nonce":1173605075}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/375122461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":375122461},{"type":"v1","addr":"172.21.15.175:6835","nonce":375122461}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5142,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3506443204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3506443204},{"type":"v1","addr":"172.21.15.6:6835","nonce":3506443204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:18:45.349958+0000","modified":"2023-10-06T02:19:08.875356+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5385},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5385":{"gid":5385,"name":"c","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.6:6834/1188971598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1188971598},{"type":"v1","addr":"172.21.15.6:6834","nonce":1188971598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:19:09.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:09.062+0000 7fd012af5700 1 -- 172.21.15.6:0/3598237366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcff8066f30 msgr2=0x7fcff80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:09.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:09.062+0000 7fd012af5700 1 --2- 172.21.15.6:0/3598237366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcff8066f30 0x7fcff80693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0b5850 tx=0x7fd004016000 comp rx=0 tx=0).stop 2023-10-06T02:19:09.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:09.062+0000 7fd012af5700 1 -- 172.21.15.6:0/3598237366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd00c0cf1a0 msgr2=0x7fd00c15a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:09.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:09.062+0000 7fd012af5700 1 --2- 172.21.15.6:0/3598237366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd00c0cf1a0 0x7fd00c15a450 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd00000ec50 tx=0x7fd000009250 comp rx=0 tx=0).stop 2023-10-06T02:19:09.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:09.062+0000 7fd012af5700 1 -- 172.21.15.6:0/3598237366 shutdown_connections 2023-10-06T02:19:09.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:09.062+0000 7fd012af5700 1 --2- 172.21.15.6:0/3598237366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd00c159400 0x7fd00c0b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:09.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:09.062+0000 7fd012af5700 1 --2- 172.21.15.6:0/3598237366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd00c0cd030 0x7fd00c145b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:09.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:09.062+0000 7fd012af5700 1 --2- 172.21.15.6:0/3598237366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcff8066f30 0x7fcff80693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:09.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:09.062+0000 7fd012af5700 1 --2- 172.21.15.6:0/3598237366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd00c0cf1a0 0x7fd00c15a450 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:09.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:09.062+0000 7fd012af5700 1 -- 172.21.15.6:0/3598237366 >> 172.21.15.6:0/3598237366 conn(0x7fd00c06ac10 msgr2=0x7fd00c156830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:09.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:09.063+0000 7fd012af5700 1 -- 172.21.15.6:0/3598237366 shutdown_connections 2023-10-06T02:19:09.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:09.063+0000 7fd012af5700 1 -- 172.21.15.6:0/3598237366 wait complete. 2023-10-06T02:19:09.064 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 22 2023-10-06T02:19:09.477 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:18:45.349958+0000', 'modified': '2023-10-06T02:19:08.875356+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 40, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5385}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5385': {'gid': 5385, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.6:6834/1188971598', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 1188971598}, {'type': 'v1', 'addr': '172.21.15.6:6834', 'nonce': 1188971598}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:19:09.477 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5385:up:rejoin 2023-10-06T02:19:10.478 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:19:10.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.610+0000 7eff0ad6a700 1 Processor -- start 2023-10-06T02:19:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.610+0000 7eff0ad6a700 1 -- start start 2023-10-06T02:19:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.611+0000 7eff0ad6a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7eff04157410 0x7eff040b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.611+0000 7eff0ad6a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff040b2280 0x7eff040ad830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.611+0000 7eff0ad6a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff040cd5b0 con 0x7eff04157040 2023-10-06T02:19:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.611+0000 7eff0ad6a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff040ccc80 con 0x7eff040b2280 2023-10-06T02:19:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.611+0000 7eff0ad6a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff040ccf60 con 0x7eff04157410 2023-10-06T02:19:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.611+0000 7eff09d68700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7eff04157040 0x7eff040cbfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38510/0 (socket says 172.21.15.6:38510) 2023-10-06T02:19:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.611+0000 7eff0a569700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff040b2280 0x7eff040ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.611+0000 7eff09d68700 1 -- 172.21.15.6:0/7580508 learned_addr learned my addr 172.21.15.6:0/7580508 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:19:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.612+0000 7eff09567700 1 --2- 172.21.15.6:0/7580508 >> v2:172.21.15.175:3300/0 conn(0x7eff04157410 0x7eff040b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.612+0000 7eff08d66700 1 -- 172.21.15.6:0/7580508 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293406129 0 0) 0x7eff040cd5b0 con 0x7eff04157040 2023-10-06T02:19:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.612+0000 7eff08d66700 1 -- 172.21.15.6:0/7580508 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efef0003570 con 0x7eff04157040 2023-10-06T02:19:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.612+0000 7eff0a569700 1 -- 172.21.15.6:0/7580508 >> v2:172.21.15.175:3300/0 conn(0x7eff04157410 msgr2=0x7eff040b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.612+0000 7eff0a569700 1 --2- 172.21.15.6:0/7580508 >> v2:172.21.15.175:3300/0 conn(0x7eff04157410 0x7eff040b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.612+0000 7eff0a569700 1 -- 172.21.15.6:0/7580508 >> v1:172.21.15.6:6789/0 conn(0x7eff04157040 legacy=0x7eff040cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.612+0000 7eff0a569700 1 -- 172.21.15.6:0/7580508 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff040cd240 con 0x7eff040b2280 2023-10-06T02:19:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.612+0000 7eff0a569700 1 --2- 172.21.15.6:0/7580508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff040b2280 0x7eff040ad830 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7eff040b2c30 tx=0x7efefc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34840ec4c1e8ef4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.612+0000 7eff08d66700 1 -- 172.21.15.6:0/7580508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc00e070 con 0x7eff040b2280 2023-10-06T02:19:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.612+0000 7eff08d66700 1 -- 172.21.15.6:0/7580508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc00bb60 con 0x7eff040b2280 2023-10-06T02:19:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.612+0000 7eff08d66700 1 -- 172.21.15.6:0/7580508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc012430 con 0x7eff040b2280 2023-10-06T02:19:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.613+0000 7eff0ad6a700 1 -- 172.21.15.6:0/7580508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff040b2280 msgr2=0x7eff040ad830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.613+0000 7eff0ad6a700 1 --2- 172.21.15.6:0/7580508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff040b2280 0x7eff040ad830 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7eff040b2c30 tx=0x7efefc009780 comp rx=0 tx=0).stop 2023-10-06T02:19:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.613+0000 7eff0ad6a700 1 -- 172.21.15.6:0/7580508 shutdown_connections 2023-10-06T02:19:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.613+0000 7eff0ad6a700 1 --2- 172.21.15.6:0/7580508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff040b2280 0x7eff040ad830 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.613+0000 7eff0ad6a700 1 --2- 172.21.15.6:0/7580508 >> v2:172.21.15.175:3300/0 conn(0x7eff04157410 0x7eff040b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.613+0000 7eff0ad6a700 1 -- 172.21.15.6:0/7580508 >> 172.21.15.6:0/7580508 conn(0x7eff04067130 msgr2=0x7eff04067530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.613+0000 7eff0ad6a700 1 -- 172.21.15.6:0/7580508 shutdown_connections 2023-10-06T02:19:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.613+0000 7eff0ad6a700 1 -- 172.21.15.6:0/7580508 wait complete. 2023-10-06T02:19:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.614+0000 7eff0ad6a700 1 Processor -- start 2023-10-06T02:19:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.614+0000 7eff0ad6a700 1 -- start start 2023-10-06T02:19:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff0ad6a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff040b2280 0x7eff0414d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff0ad6a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff04157040 0x7eff040ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff0ad6a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff04157410 0x7eff040add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff0ad6a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff041545f0 con 0x7eff04157040 2023-10-06T02:19:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff0ad6a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff04158090 con 0x7eff040b2280 2023-10-06T02:19:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff0ad6a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff04157a80 con 0x7eff04157410 2023-10-06T02:19:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff09567700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff04157040 0x7eff040ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff09567700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff04157040 0x7eff040ad7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44294/0 (socket says 172.21.15.6:44294) 2023-10-06T02:19:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff09567700 1 -- 172.21.15.6:0/3604618698 learned_addr learned my addr 172.21.15.6:0/3604618698 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff09d68700 1 --2- 172.21.15.6:0/3604618698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff040b2280 0x7eff0414d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff0a569700 1 --2- 172.21.15.6:0/3604618698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff04157410 0x7eff040add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff09567700 1 -- 172.21.15.6:0/3604618698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff04157410 msgr2=0x7eff040add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff09567700 1 --2- 172.21.15.6:0/3604618698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff04157410 0x7eff040add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff09567700 1 -- 172.21.15.6:0/3604618698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff040b2280 msgr2=0x7eff0414d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff09567700 1 --2- 172.21.15.6:0/3604618698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff040b2280 0x7eff0414d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff09567700 1 -- 172.21.15.6:0/3604618698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc009a20 con 0x7eff04157040 2023-10-06T02:19:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff09d68700 1 --2- 172.21.15.6:0/3604618698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff040b2280 0x7eff0414d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff0a569700 1 --2- 172.21.15.6:0/3604618698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff04157410 0x7eff040add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff09567700 1 --2- 172.21.15.6:0/3604618698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff04157040 0x7eff040ad7f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efef400d890 tx=0x7efef4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7efef9ffb700 1 -- 172.21.15.6:0/3604618698 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef4009610 con 0x7eff04157040 2023-10-06T02:19:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7efef9ffb700 1 -- 172.21.15.6:0/3604618698 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef4009770 con 0x7eff04157040 2023-10-06T02:19:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7efef9ffb700 1 -- 172.21.15.6:0/3604618698 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef4009b30 con 0x7eff04157040 2023-10-06T02:19:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.615+0000 7eff0ad6a700 1 -- 172.21.15.6:0/3604618698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff04154310 con 0x7eff04157040 2023-10-06T02:19:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.616+0000 7eff0ad6a700 1 -- 172.21.15.6:0/3604618698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0414dae0 con 0x7eff04157040 2023-10-06T02:19:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.617+0000 7eff0ad6a700 1 -- 172.21.15.6:0/3604618698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff041578e0 con 0x7eff04157040 2023-10-06T02:19:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.617+0000 7efef9ffb700 1 -- 172.21.15.6:0/3604618698 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efef401e460 con 0x7eff04157040 2023-10-06T02:19:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.617+0000 7efef9ffb700 1 --2- 172.21.15.6:0/3604618698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efee8066f30 0x7efee80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.617+0000 7efef9ffb700 1 -- 172.21.15.6:0/3604618698 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7efef4084e10 con 0x7eff04157040 2023-10-06T02:19:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.618+0000 7eff09d68700 1 --2- 172.21.15.6:0/3604618698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efee8066f30 0x7efee80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.618+0000 7eff09d68700 1 --2- 172.21.15.6:0/3604618698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efee8066f30 0x7efee80693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7eff00007fd0 tx=0x7eff00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:10.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.622+0000 7efef9ffb700 1 -- 172.21.15.6:0/3604618698 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff041578e0 con 0x7eff04157040 2023-10-06T02:19:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.860+0000 7eff0ad6a700 1 -- 172.21.15.6:0/3604618698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff041578e0 con 0x7eff04157040 2023-10-06T02:19:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.861+0000 7efef9ffb700 1 -- 172.21.15.6:0/3604618698 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4595 (secure 0 0 0) 0x7eff041578e0 con 0x7eff04157040 2023-10-06T02:19:10.862 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:19:10.862 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1173605075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1173605075},{"type":"v1","addr":"172.21.15.175:6837","nonce":1173605075}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/375122461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":375122461},{"type":"v1","addr":"172.21.15.175:6835","nonce":375122461}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5142,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3506443204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3506443204},{"type":"v1","addr":"172.21.15.6:6835","nonce":3506443204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:18:45.349958+0000","modified":"2023-10-06T02:19:09.880245+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5385},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5385":{"gid":5385,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6834/1188971598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1188971598},{"type":"v1","addr":"172.21.15.6:6834","nonce":1188971598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:19:10.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.863+0000 7eff0ad6a700 1 -- 172.21.15.6:0/3604618698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efee8066f30 msgr2=0x7efee80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:10.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.863+0000 7eff0ad6a700 1 --2- 172.21.15.6:0/3604618698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efee8066f30 0x7efee80693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7eff00007fd0 tx=0x7eff00009040 comp rx=0 tx=0).stop 2023-10-06T02:19:10.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.863+0000 7eff0ad6a700 1 -- 172.21.15.6:0/3604618698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff04157040 msgr2=0x7eff040ad7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:10.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.863+0000 7eff0ad6a700 1 --2- 172.21.15.6:0/3604618698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff04157040 0x7eff040ad7f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efef400d890 tx=0x7efef4008040 comp rx=0 tx=0).stop 2023-10-06T02:19:10.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.863+0000 7eff0ad6a700 1 -- 172.21.15.6:0/3604618698 shutdown_connections 2023-10-06T02:19:10.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.863+0000 7eff0ad6a700 1 --2- 172.21.15.6:0/3604618698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff04157410 0x7eff040add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:10.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.863+0000 7eff0ad6a700 1 --2- 172.21.15.6:0/3604618698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff040b2280 0x7eff0414d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:10.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.863+0000 7eff0ad6a700 1 --2- 172.21.15.6:0/3604618698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efee8066f30 0x7efee80693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:10.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.863+0000 7eff0ad6a700 1 --2- 172.21.15.6:0/3604618698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff04157040 0x7eff040ad7f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:10.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.863+0000 7eff0ad6a700 1 -- 172.21.15.6:0/3604618698 >> 172.21.15.6:0/3604618698 conn(0x7eff04067130 msgr2=0x7eff040cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:10.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.863+0000 7eff0ad6a700 1 -- 172.21.15.6:0/3604618698 shutdown_connections 2023-10-06T02:19:10.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:10.863+0000 7eff0ad6a700 1 -- 172.21.15.6:0/3604618698 wait complete. 2023-10-06T02:19:10.864 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 23 2023-10-06T02:19:11.277 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:18:45.349958+0000', 'modified': '2023-10-06T02:19:09.880245+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 40, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5385}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5385': {'gid': 5385, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.6:6834/1188971598', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 1188971598}, {'type': 'v1', 'addr': '172.21.15.6:6834', 'nonce': 1188971598}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:19:11.277 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:19:11.277 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:19:11.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.401+0000 7f4eab59e700 1 Processor -- start 2023-10-06T02:19:11.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.401+0000 7f4eab59e700 1 -- start start 2023-10-06T02:19:11.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.402+0000 7f4eab59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4eac159400 0x7f4eac0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.402+0000 7f4eab59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4eac0cd030 0x7f4eac0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.402+0000 7f4eab59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eac0cf1a0 0x7f4eac0d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.402+0000 7f4eab59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eac0b3560 con 0x7f4eac0cd030 2023-10-06T02:19:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.402+0000 7f4eab59e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eac0cf6f0 con 0x7f4eac159400 2023-10-06T02:19:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.402+0000 7f4eab59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac0cf9d0 con 0x7f4eac0cf1a0 2023-10-06T02:19:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.402+0000 7f4ea9d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4eac0cd030 0x7f4eac0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.402+0000 7f4ea9d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4eac0cd030 0x7f4eac0cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44306/0 (socket says 172.21.15.6:44306) 2023-10-06T02:19:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.402+0000 7f4ea9d9b700 1 -- 172.21.15.6:0/205557619 learned_addr learned my addr 172.21.15.6:0/205557619 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.402+0000 7f4eaad9d700 1 --2- 172.21.15.6:0/205557619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eac0cf1a0 0x7f4eac0d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.402+0000 7f4eaa59c700 1 --2- 172.21.15.6:0/205557619 >> v2:172.21.15.175:3300/0 conn(0x7f4eac159400 0x7f4eac0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.403+0000 7f4ea9d9b700 1 -- 172.21.15.6:0/205557619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eac0cf1a0 msgr2=0x7f4eac0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.403+0000 7f4ea9d9b700 1 --2- 172.21.15.6:0/205557619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eac0cf1a0 0x7f4eac0d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.403+0000 7f4ea9d9b700 1 -- 172.21.15.6:0/205557619 >> v2:172.21.15.175:3300/0 conn(0x7f4eac159400 msgr2=0x7f4eac0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.403+0000 7f4ea9d9b700 1 --2- 172.21.15.6:0/205557619 >> v2:172.21.15.175:3300/0 conn(0x7f4eac159400 0x7f4eac0ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.403+0000 7f4ea9d9b700 1 -- 172.21.15.6:0/205557619 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac0b2f10 con 0x7f4eac0cd030 2023-10-06T02:19:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.403+0000 7f4eaad9d700 1 --2- 172.21.15.6:0/205557619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eac0cf1a0 0x7f4eac0d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.403+0000 7f4eaa59c700 1 --2- 172.21.15.6:0/205557619 >> v2:172.21.15.175:3300/0 conn(0x7f4eac159400 0x7f4eac0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.403+0000 7f4ea9d9b700 1 --2- 172.21.15.6:0/205557619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0cd030 0x7f4eac0cfec0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4eac067fc0 tx=0x7f4e94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b3b44fa53985aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.403+0000 7f4ea959a700 1 -- 172.21.15.6:0/205557619 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9400b860 con 0x7f4eac0cd030 2023-10-06T02:19:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.403+0000 7f4ea959a700 1 -- 172.21.15.6:0/205557619 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9400b9c0 con 0x7f4eac0cd030 2023-10-06T02:19:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.403+0000 7f4ea959a700 1 -- 172.21.15.6:0/205557619 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9400bd60 con 0x7f4eac0cd030 2023-10-06T02:19:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.403+0000 7f4eab59e700 1 -- 172.21.15.6:0/205557619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0cd030 msgr2=0x7f4eac0cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.403+0000 7f4eab59e700 1 --2- 172.21.15.6:0/205557619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0cd030 0x7f4eac0cfec0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4eac067fc0 tx=0x7f4e94009250 comp rx=0 tx=0).stop 2023-10-06T02:19:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.404+0000 7f4eab59e700 1 -- 172.21.15.6:0/205557619 shutdown_connections 2023-10-06T02:19:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.404+0000 7f4eab59e700 1 --2- 172.21.15.6:0/205557619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eac0cf1a0 0x7f4eac0d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.404+0000 7f4eab59e700 1 --2- 172.21.15.6:0/205557619 >> v2:172.21.15.175:3300/0 conn(0x7f4eac159400 0x7f4eac0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.404+0000 7f4eab59e700 1 --2- 172.21.15.6:0/205557619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0cd030 0x7f4eac0cfec0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.404+0000 7f4eab59e700 1 -- 172.21.15.6:0/205557619 >> 172.21.15.6:0/205557619 conn(0x7f4eac06ac10 msgr2=0x7f4eac068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.404+0000 7f4eab59e700 1 -- 172.21.15.6:0/205557619 shutdown_connections 2023-10-06T02:19:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.404+0000 7f4eab59e700 1 -- 172.21.15.6:0/205557619 wait complete. 2023-10-06T02:19:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.405+0000 7f4eab59e700 1 Processor -- start 2023-10-06T02:19:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.405+0000 7f4eab59e700 1 -- start start 2023-10-06T02:19:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.405+0000 7f4eab59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0cd030 0x7f4eac15a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.405+0000 7f4eab59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eac0cf1a0 0x7f4eac0c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.405+0000 7f4eab59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eac159400 0x7f4eac1404d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.405+0000 7f4eab59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac0c5430 con 0x7f4eac0cd030 2023-10-06T02:19:11.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.405+0000 7f4eab59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac15aba0 con 0x7f4eac159400 2023-10-06T02:19:11.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.405+0000 7f4eab59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac15ae80 con 0x7f4eac0cf1a0 2023-10-06T02:19:11.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.406+0000 7f4eaa59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0cd030 0x7f4eac15a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.406+0000 7f4eaa59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0cd030 0x7f4eac15a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44316/0 (socket says 172.21.15.6:44316) 2023-10-06T02:19:11.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.406+0000 7f4eaa59c700 1 -- 172.21.15.6:0/860082132 learned_addr learned my addr 172.21.15.6:0/860082132 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:11.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.406+0000 7f4eaad9d700 1 --2- 172.21.15.6:0/860082132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eac159400 0x7f4eac1404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.406+0000 7f4ea9d9b700 1 --2- 172.21.15.6:0/860082132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eac0cf1a0 0x7f4eac0c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.406+0000 7f4eaa59c700 1 -- 172.21.15.6:0/860082132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eac0cf1a0 msgr2=0x7f4eac0c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:11.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.406+0000 7f4eaa59c700 1 --2- 172.21.15.6:0/860082132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eac0cf1a0 0x7f4eac0c4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.406+0000 7f4eaa59c700 1 -- 172.21.15.6:0/860082132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eac159400 msgr2=0x7f4eac1404d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:11.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.406+0000 7f4eaa59c700 1 --2- 172.21.15.6:0/860082132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eac159400 0x7f4eac1404d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.406+0000 7f4eaa59c700 1 -- 172.21.15.6:0/860082132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e940094f0 con 0x7f4eac0cd030 2023-10-06T02:19:11.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.406+0000 7f4eaa59c700 1 --2- 172.21.15.6:0/860082132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0cd030 0x7f4eac15a4e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00d100 tx=0x7f4e9c0099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:11.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.406+0000 7f4ea27fc700 1 -- 172.21.15.6:0/860082132 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c00dc40 con 0x7f4eac0cd030 2023-10-06T02:19:11.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.406+0000 7f4ea27fc700 1 -- 172.21.15.6:0/860082132 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c00f040 con 0x7f4eac0cd030 2023-10-06T02:19:11.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.406+0000 7f4eab59e700 1 -- 172.21.15.6:0/860082132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eac15b160 con 0x7f4eac0cd030 2023-10-06T02:19:11.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.406+0000 7f4ea27fc700 1 -- 172.21.15.6:0/860082132 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c015440 con 0x7f4eac0cd030 2023-10-06T02:19:11.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.406+0000 7f4eab59e700 1 -- 172.21.15.6:0/860082132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eac15b720 con 0x7f4eac0cd030 2023-10-06T02:19:11.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.408+0000 7f4ea27fc700 1 -- 172.21.15.6:0/860082132 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e9c0157f0 con 0x7f4eac0cd030 2023-10-06T02:19:11.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.408+0000 7f4ea27fc700 1 --2- 172.21.15.6:0/860082132 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e8c066f30 0x7f4e8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.408+0000 7f4ea27fc700 1 -- 172.21.15.6:0/860082132 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f4e9c084b70 con 0x7f4eac0cd030 2023-10-06T02:19:11.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.409+0000 7f4ea9d9b700 1 --2- 172.21.15.6:0/860082132 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e8c066f30 0x7f4e8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.409+0000 7f4ea9d9b700 1 --2- 172.21.15.6:0/860082132 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e8c066f30 0x7f4e8c0693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4eac067fc0 tx=0x7f4e94017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:11.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.410+0000 7f4eb9d63b80 1 Processor -- start 2023-10-06T02:19:11.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.410+0000 7f4eb9d63b80 1 -- start start 2023-10-06T02:19:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.411+0000 7f4eb9d63b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7970bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.411+0000 7f4eb9d63b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a797112c0 0x557a7970c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.411+0000 7f4eb9d63b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a79712a10 0x557a7970c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.411+0000 7f4eb9d63b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a79666a70 con 0x557a79730e50 2023-10-06T02:19:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.411+0000 7f4eb9d63b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a79664270 con 0x557a79712a10 2023-10-06T02:19:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.411+0000 7f4eb9d63b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a79660060 con 0x557a797112c0 2023-10-06T02:19:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.411+0000 7f4eaa59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7970bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.411+0000 7f4eaa59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7970bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44332/0 (socket says 172.21.15.6:44332) 2023-10-06T02:19:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.411+0000 7f4eaa59c700 1 -- 172.21.15.6:0/561827755 learned_addr learned my addr 172.21.15.6:0/561827755 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.412+0000 7f4ea9d9b700 1 --2- 172.21.15.6:0/561827755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a797112c0 0x557a7970c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.412+0000 7f4eaad9d700 1 --2- 172.21.15.6:0/561827755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a79712a10 0x557a7970c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.412+0000 7f4eaa59c700 1 -- 172.21.15.6:0/561827755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a797112c0 msgr2=0x557a7970c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.412+0000 7f4eaa59c700 1 --2- 172.21.15.6:0/561827755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a797112c0 0x557a7970c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.412+0000 7f4eaa59c700 1 -- 172.21.15.6:0/561827755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a79712a10 msgr2=0x557a7970c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.412+0000 7f4eaa59c700 1 --2- 172.21.15.6:0/561827755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a79712a10 0x557a7970c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.412+0000 7f4eaa59c700 1 -- 172.21.15.6:0/561827755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a794fa270 con 0x557a79730e50 2023-10-06T02:19:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.412+0000 7f4eaa59c700 1 --2- 172.21.15.6:0/561827755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7970bcc0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00d0d0 tx=0x7f4e9c082d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541bb109fb9aa7c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.412+0000 7f4e8b7fe700 1 -- 172.21.15.6:0/561827755 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c053c00 con 0x557a79730e50 2023-10-06T02:19:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.412+0000 7f4e8b7fe700 1 -- 172.21.15.6:0/561827755 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c055ac0 con 0x557a79730e50 2023-10-06T02:19:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.412+0000 7f4e8b7fe700 1 -- 172.21.15.6:0/561827755 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c054d50 con 0x557a79730e50 2023-10-06T02:19:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.413+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/561827755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 msgr2=0x557a7970bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.413+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/561827755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7970bcc0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00d0d0 tx=0x7f4e9c082d00 comp rx=0 tx=0).stop 2023-10-06T02:19:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.413+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/561827755 shutdown_connections 2023-10-06T02:19:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.413+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/561827755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a79712a10 0x557a7970c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.413+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/561827755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7970bcc0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.413+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/561827755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a797112c0 0x557a7970c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.413+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/561827755 >> 172.21.15.6:0/561827755 conn(0x557a79710e80 msgr2=0x557a797116b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.413+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/561827755 shutdown_connections 2023-10-06T02:19:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.413+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/561827755 wait complete. 2023-10-06T02:19:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.413+0000 7f4eb9d63b80 1 -- start start 2023-10-06T02:19:11.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.413+0000 7f4eb9d63b80 1 Processor -- start 2023-10-06T02:19:11.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.414+0000 7f4eb9d63b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a797112c0 0x557a79738e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.414+0000 7f4eb9d63b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a79712a10 0x557a797668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.414+0000 7f4eb9d63b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7973bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.414+0000 7f4eb9d63b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7960b890 con 0x557a79730e50 2023-10-06T02:19:11.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.414+0000 7f4eb9d63b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a79626ea0 con 0x557a79712a10 2023-10-06T02:19:11.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.414+0000 7f4eb9d63b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a794e2e30 con 0x557a797112c0 2023-10-06T02:19:11.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.414+0000 7f4eb9d63b80 10 client.0 _ll_register_callbacks cb 0x557a796d3020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:19:11.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.414+0000 7f4eaad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7973bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.414+0000 7f4eaad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7973bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44340/0 (socket says 172.21.15.6:44340) 2023-10-06T02:19:11.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.414+0000 7f4eaad9d700 1 -- 172.21.15.6:0/122107177 learned_addr learned my addr 172.21.15.6:0/122107177 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:11.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.414+0000 7f4eaa59c700 1 --2- 172.21.15.6:0/122107177 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a797112c0 0x557a79738e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.414+0000 7f4ea9d9b700 1 --2- 172.21.15.6:0/122107177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a79712a10 0x557a797668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4eaad9d700 1 -- 172.21.15.6:0/122107177 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a797112c0 msgr2=0x557a79738e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4eaad9d700 1 --2- 172.21.15.6:0/122107177 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a797112c0 0x557a79738e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4eaad9d700 1 -- 172.21.15.6:0/122107177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a79712a10 msgr2=0x557a797668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4eaad9d700 1 --2- 172.21.15.6:0/122107177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a79712a10 0x557a797668f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4eaad9d700 1 -- 172.21.15.6:0/122107177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eac15b720 con 0x557a79730e50 2023-10-06T02:19:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4eaad9d700 1 --2- 172.21.15.6:0/122107177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7973bff0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40126a0 tx=0x7f4ea4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73c9071d56e8e0a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4e88ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:19:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4e88ff9700 1 -- 172.21.15.6:0/122107177 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40153f0 con 0x557a79730e50 2023-10-06T02:19:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4e88ff9700 1 -- 172.21.15.6:0/122107177 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f4ea4015550 con 0x557a79730e50 2023-10-06T02:19:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/122107177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a79704940 con 0x557a79730e50 2023-10-06T02:19:11.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4e88ff9700 1 -- 172.21.15.6:0/122107177 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ea4015920 con 0x557a79730e50 2023-10-06T02:19:11.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4eb9d63b80 10 client.5433 fetch_fsmap learned FSMap version 23 2023-10-06T02:19:11.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/122107177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x557a7949cfe0 con 0x557a79730e50 2023-10-06T02:19:11.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4e88ff9700 1 -- 172.21.15.6:0/122107177 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557a79704940 con 0x557a79730e50 2023-10-06T02:19:11.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4e88ff9700 1 -- 172.21.15.6:0/122107177 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4ea4015a80 con 0x557a79730e50 2023-10-06T02:19:11.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4eb9d63b80 10 client.5433 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T02:19:11.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4eb9d63b80 10 client.5433 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:19:11.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4eb9d63b80 20 client.5433 populate_metadata read hostname 'smithi006' 2023-10-06T02:19:11.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/122107177 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x557a79768a20 0x557a79768df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4eb9d63b80 4 client.5433 mds_command: new command op to 5385 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:19:11.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.415+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/122107177 --> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a796e1870 con 0x557a79768a20 2023-10-06T02:19:11.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.416+0000 7f4eaa59c700 1 --2- 172.21.15.6:0/122107177 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x557a79768a20 0x557a79768df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.416+0000 7f4eaa59c700 1 --2- 172.21.15.6:0/122107177 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x557a79768a20 0x557a79768df0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d8830f59a6d1d97 server_cookie=aeb3e0888be94cf in_seq=0 out_seq=0 2023-10-06T02:19:11.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.416+0000 7f4e88ff9700 10 client.5433 ms_handle_connect on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:11.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.416+0000 7f4e88ff9700 1 -- 172.21.15.6:0/122107177 <== mds.0 v2:172.21.15.6:6832/1188971598 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557a796e1870 con 0x557a79768a20 2023-10-06T02:19:11.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.416+0000 7f4e88ff9700 10 client.5433 handle_command_reply: tid=0 2023-10-06T02:19:11.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.416+0000 7f4eb9d63b80 1 client.5433 shutdown 2023-10-06T02:19:11.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.417+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/122107177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 msgr2=0x557a7973bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:11.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.417+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/122107177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7973bff0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40126a0 tx=0x7f4ea4008040 comp rx=0 tx=0).stop 2023-10-06T02:19:11.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.417+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/122107177 shutdown_connections 2023-10-06T02:19:11.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.417+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/122107177 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x557a79768a20 0x557a79768df0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.417+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/122107177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7973bff0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.417+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/122107177 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a797112c0 0x557a79738e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.417+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/122107177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a79712a10 0x557a797668f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.417+0000 7f4e88ff9700 0 client.5433 ms_handle_reset on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:11.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.417+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/122107177 >> 172.21.15.6:0/122107177 conn(0x557a79710e80 msgr2=0x557a7970fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:11.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.417+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/122107177 shutdown_connections 2023-10-06T02:19:11.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.417+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/122107177 wait complete. 2023-10-06T02:19:11.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.417+0000 7f4eb9d63b80 20 client.5433 trim_cache size 0 max 16384 2023-10-06T02:19:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.434+0000 7f4eb9d63b80 1 Processor -- start 2023-10-06T02:19:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.434+0000 7f4eb9d63b80 1 -- start start 2023-10-06T02:19:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4eb9d63b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a797112c0 0x557a79731950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4eb9d63b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79712a10 0x557a7970cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4eb9d63b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a79730e50 0x557a7970d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4eb9d63b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a79778880 con 0x557a79712a10 2023-10-06T02:19:11.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4eb9d63b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a79767c50 con 0x557a79730e50 2023-10-06T02:19:11.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4eb9d63b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a796ef2e0 con 0x557a797112c0 2023-10-06T02:19:11.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4ea9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79712a10 0x557a7970cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4ea9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79712a10 0x557a7970cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44346/0 (socket says 172.21.15.6:44346) 2023-10-06T02:19:11.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4ea9d9b700 1 -- 172.21.15.6:0/2140057153 learned_addr learned my addr 172.21.15.6:0/2140057153 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:11.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4eaa59c700 1 --2- 172.21.15.6:0/2140057153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a797112c0 0x557a79731950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4eaad9d700 1 --2- 172.21.15.6:0/2140057153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a79730e50 0x557a7970d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4ea9d9b700 1 -- 172.21.15.6:0/2140057153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a797112c0 msgr2=0x557a79731950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:11.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4ea9d9b700 1 --2- 172.21.15.6:0/2140057153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a797112c0 0x557a79731950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4ea9d9b700 1 -- 172.21.15.6:0/2140057153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a79730e50 msgr2=0x557a7970d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:11.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4ea9d9b700 1 --2- 172.21.15.6:0/2140057153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a79730e50 0x557a7970d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4ea9d9b700 1 -- 172.21.15.6:0/2140057153 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a7962e780 con 0x557a79712a10 2023-10-06T02:19:11.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4eaad9d700 1 --2- 172.21.15.6:0/2140057153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a79730e50 0x557a7970d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:11.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4ea9d9b700 1 --2- 172.21.15.6:0/2140057153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79712a10 0x557a7970cd00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4e94006fd0 tx=0x7f4e94020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf6e757a1c46c05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:11.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.435+0000 7f4e8bfff700 1 -- 172.21.15.6:0/2140057153 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e94020070 con 0x557a79712a10 2023-10-06T02:19:11.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.436+0000 7f4e8bfff700 1 -- 172.21.15.6:0/2140057153 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9402c050 con 0x557a79712a10 2023-10-06T02:19:11.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.436+0000 7f4e8bfff700 1 -- 172.21.15.6:0/2140057153 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e94011ae0 con 0x557a79712a10 2023-10-06T02:19:11.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.436+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/2140057153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79712a10 msgr2=0x557a7970cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:11.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.436+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/2140057153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79712a10 0x557a7970cd00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4e94006fd0 tx=0x7f4e94020000 comp rx=0 tx=0).stop 2023-10-06T02:19:11.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.436+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/2140057153 shutdown_connections 2023-10-06T02:19:11.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.436+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/2140057153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a79730e50 0x557a7970d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.436+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/2140057153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a797112c0 0x557a79731950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.436+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/2140057153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79712a10 0x557a7970cd00 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.436+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/2140057153 >> 172.21.15.6:0/2140057153 conn(0x557a79710e80 msgr2=0x557a7970f710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:11.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.436+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/2140057153 shutdown_connections 2023-10-06T02:19:11.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.436+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/2140057153 wait complete. 2023-10-06T02:19:11.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.437+0000 7f4eb9d63b80 1 -- start start 2023-10-06T02:19:11.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.437+0000 7f4eb9d63b80 1 Processor -- start 2023-10-06T02:19:11.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eb9d63b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a797112c0 0x557a79765e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eb9d63b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a79712a10 0x557a7972eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eb9d63b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7976fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eb9d63b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a797bccb0 con 0x557a79730e50 2023-10-06T02:19:11.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eb9d63b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a79766490 con 0x557a797112c0 2023-10-06T02:19:11.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eb9d63b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a79766ca0 con 0x557a79712a10 2023-10-06T02:19:11.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eb9d63b80 10 client.0 _ll_register_callbacks cb 0x557a796d3020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:19:11.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eaad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7976fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eaad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7976fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44360/0 (socket says 172.21.15.6:44360) 2023-10-06T02:19:11.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eaad9d700 1 -- 172.21.15.6:0/588991815 learned_addr learned my addr 172.21.15.6:0/588991815 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:11.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eaa59c700 1 --2- 172.21.15.6:0/588991815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a797112c0 0x557a79765e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4ea9d9b700 1 --2- 172.21.15.6:0/588991815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a79712a10 0x557a7972eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eaad9d700 1 -- 172.21.15.6:0/588991815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a79712a10 msgr2=0x557a7972eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:11.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eaad9d700 1 --2- 172.21.15.6:0/588991815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a79712a10 0x557a7972eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eaad9d700 1 -- 172.21.15.6:0/588991815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a797112c0 msgr2=0x557a79765e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:11.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eaad9d700 1 --2- 172.21.15.6:0/588991815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a797112c0 0x557a79765e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eaad9d700 1 -- 172.21.15.6:0/588991815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eac0b2f10 con 0x557a79730e50 2023-10-06T02:19:11.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eaa59c700 1 --2- 172.21.15.6:0/588991815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a797112c0 0x557a79765e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:11.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eaad9d700 1 --2- 172.21.15.6:0/588991815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7976fce0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4001eb0 tx=0x7f4ea4022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb41f0e2df8d78b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:11.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4e88ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:19:11.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4e88ff9700 1 -- 172.21.15.6:0/588991815 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40123f0 con 0x557a79730e50 2023-10-06T02:19:11.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4e88ff9700 1 -- 172.21.15.6:0/588991815 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f4ea40153f0 con 0x557a79730e50 2023-10-06T02:19:11.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.438+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/588991815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4e9c055ac0 con 0x557a79730e50 2023-10-06T02:19:11.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.439+0000 7f4e88ff9700 1 -- 172.21.15.6:0/588991815 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ea40155b0 con 0x557a79730e50 2023-10-06T02:19:11.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.439+0000 7f4eb9d63b80 10 client.5439 fetch_fsmap learned FSMap version 23 2023-10-06T02:19:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.439+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/588991815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x557a79615470 con 0x557a79730e50 2023-10-06T02:19:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.439+0000 7f4e88ff9700 1 -- 172.21.15.6:0/588991815 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c055ac0 con 0x557a79730e50 2023-10-06T02:19:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.439+0000 7f4e88ff9700 1 -- 172.21.15.6:0/588991815 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4ea4005a00 con 0x557a79730e50 2023-10-06T02:19:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.439+0000 7f4eb9d63b80 10 client.5439 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T02:19:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.439+0000 7f4eb9d63b80 10 client.5439 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:19:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.439+0000 7f4eb9d63b80 20 client.5439 populate_metadata read hostname 'smithi006' 2023-10-06T02:19:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.439+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/588991815 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x557a7970bb40 0x557a7970bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.439+0000 7f4eb9d63b80 4 client.5439 mds_command: new command op to 5385 tid=0[{"prefix": "status"}] 2023-10-06T02:19:11.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.439+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/588991815 --> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557a79602e00 con 0x557a7970bb40 2023-10-06T02:19:11.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.439+0000 7f4eaa59c700 1 --2- 172.21.15.6:0/588991815 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x557a7970bb40 0x557a7970bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.439+0000 7f4e88ff9700 10 client.5439 ms_handle_connect on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:11.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.439+0000 7f4eaa59c700 1 --2- 172.21.15.6:0/588991815 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x557a7970bb40 0x557a7970bf10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14dff5f9239bdc0a server_cookie=fc4bb38baac59a8 in_seq=0 out_seq=0 2023-10-06T02:19:11.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.439+0000 7f4e88ff9700 1 -- 172.21.15.6:0/588991815 <== mds.0 v2:172.21.15.6:6832/1188971598 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x557a79602e00 con 0x557a7970bb40 2023-10-06T02:19:11.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.439+0000 7f4e88ff9700 10 client.5439 handle_command_reply: tid=0 2023-10-06T02:19:11.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.439+0000 7f4eb9d63b80 1 client.5439 shutdown 2023-10-06T02:19:11.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/588991815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 msgr2=0x557a7976fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:11.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/588991815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7976fce0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4001eb0 tx=0x7f4ea4022000 comp rx=0 tx=0).stop 2023-10-06T02:19:11.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/588991815 shutdown_connections 2023-10-06T02:19:11.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/588991815 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x557a7970bb40 0x557a7970bf10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/588991815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a79730e50 0x557a7976fce0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/588991815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a797112c0 0x557a79765e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4e88ff9700 0 client.5439 ms_handle_reset on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:11.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eb9d63b80 1 --2- 172.21.15.6:0/588991815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a79712a10 0x557a7972eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/588991815 >> 172.21.15.6:0/588991815 conn(0x557a79710e80 msgr2=0x557a79722a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:11.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/588991815 shutdown_connections 2023-10-06T02:19:11.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eb9d63b80 1 -- 172.21.15.6:0/588991815 wait complete. 2023-10-06T02:19:11.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eb9d63b80 20 client.5439 trim_cache size 0 max 16384 2023-10-06T02:19:11.454 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5385, 2023-10-06T02:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 4.5661524660000001, 2023-10-06T02:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 23, 2023-10-06T02:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 40, 2023-10-06T02:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 40, 2023-10-06T02:19:11.456 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 5.5425969610000001 2023-10-06T02:19:11.456 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:19:11.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eab59e700 1 -- 172.21.15.6:0/860082132 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e8c066f30 msgr2=0x7f4e8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eab59e700 1 --2- 172.21.15.6:0/860082132 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e8c066f30 0x7f4e8c0693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4eac067fc0 tx=0x7f4e94017000 comp rx=0 tx=0).stop 2023-10-06T02:19:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eab59e700 1 -- 172.21.15.6:0/860082132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0cd030 msgr2=0x7f4eac15a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eab59e700 1 --2- 172.21.15.6:0/860082132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0cd030 0x7f4eac15a4e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00d100 tx=0x7f4e9c0099c0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eab59e700 1 -- 172.21.15.6:0/860082132 shutdown_connections 2023-10-06T02:19:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eab59e700 1 --2- 172.21.15.6:0/860082132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eac159400 0x7f4eac1404d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eab59e700 1 --2- 172.21.15.6:0/860082132 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e8c066f30 0x7f4e8c0693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eab59e700 1 --2- 172.21.15.6:0/860082132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0cd030 0x7f4eac15a4e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eab59e700 1 --2- 172.21.15.6:0/860082132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eac0cf1a0 0x7f4eac0c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eab59e700 1 -- 172.21.15.6:0/860082132 >> 172.21.15.6:0/860082132 conn(0x7f4eac06ac10 msgr2=0x7f4eac157750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:11.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eab59e700 1 -- 172.21.15.6:0/860082132 shutdown_connections 2023-10-06T02:19:11.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.440+0000 7f4eab59e700 1 -- 172.21.15.6:0/860082132 wait complete. 2023-10-06T02:19:11.459 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:19:11.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.578+0000 7eff78e0c700 1 Processor -- start 2023-10-06T02:19:11.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.578+0000 7eff78e0c700 1 -- start start 2023-10-06T02:19:11.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.579+0000 7eff78e0c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7eff74150370 0x7eff740c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.579+0000 7eff78e0c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff74150740 0x7eff74069040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.579+0000 7eff78e0c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7406c950 con 0x7eff7406cde0 2023-10-06T02:19:11.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.579+0000 7eff78e0c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff74069b10 con 0x7eff74150370 2023-10-06T02:19:11.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.579+0000 7eff78e0c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff74069580 con 0x7eff74150740 2023-10-06T02:19:11.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.579+0000 7eff71d9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff74150740 0x7eff74069040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.579+0000 7eff71d9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff74150740 0x7eff74069040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:49444/0 (socket says 172.21.15.6:49444) 2023-10-06T02:19:11.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.579+0000 7eff71d9b700 1 -- 172.21.15.6:0/3376115322 learned_addr learned my addr 172.21.15.6:0/3376115322 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:11.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.579+0000 7eff7259c700 1 --2- 172.21.15.6:0/3376115322 >> v2:172.21.15.175:3300/0 conn(0x7eff74150370 0x7eff740c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.579+0000 7eff7259c700 1 -- 172.21.15.6:0/3376115322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff74150740 msgr2=0x7eff74069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:11.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.579+0000 7eff7259c700 1 --2- 172.21.15.6:0/3376115322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff74150740 0x7eff74069040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.580+0000 7eff7259c700 1 -- 172.21.15.6:0/3376115322 >> v1:172.21.15.175:6789/0 conn(0x7eff7406cde0 legacy=0x7eff740af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:11.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.580+0000 7eff7259c700 1 -- 172.21.15.6:0/3376115322 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff74069830 con 0x7eff74150370 2023-10-06T02:19:11.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.580+0000 7eff7259c700 1 --2- 172.21.15.6:0/3376115322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff74150370 0x7eff740c8b40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0098e0 tx=0x7eff6c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b2164836e18c32e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:11.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.580+0000 7eff7159a700 1 -- 172.21.15.6:0/3376115322 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c00b640 con 0x7eff74150370 2023-10-06T02:19:11.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.580+0000 7eff7159a700 1 -- 172.21.15.6:0/3376115322 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6c00b7a0 con 0x7eff74150370 2023-10-06T02:19:11.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.580+0000 7eff7159a700 1 -- 172.21.15.6:0/3376115322 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c00bb40 con 0x7eff74150370 2023-10-06T02:19:11.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.580+0000 7eff78e0c700 1 -- 172.21.15.6:0/3376115322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff74150370 msgr2=0x7eff740c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:11.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.580+0000 7eff78e0c700 1 --2- 172.21.15.6:0/3376115322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff74150370 0x7eff740c8b40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0098e0 tx=0x7eff6c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.580+0000 7eff78e0c700 1 -- 172.21.15.6:0/3376115322 shutdown_connections 2023-10-06T02:19:11.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.580+0000 7eff78e0c700 1 --2- 172.21.15.6:0/3376115322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff74150370 0x7eff740c8b40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.580+0000 7eff78e0c700 1 --2- 172.21.15.6:0/3376115322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff74150740 0x7eff74069040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.581+0000 7eff78e0c700 1 -- 172.21.15.6:0/3376115322 >> 172.21.15.6:0/3376115322 conn(0x7eff7406b6e0 msgr2=0x7eff740ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:11.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.581+0000 7eff78e0c700 1 -- 172.21.15.6:0/3376115322 shutdown_connections 2023-10-06T02:19:11.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.581+0000 7eff78e0c700 1 -- 172.21.15.6:0/3376115322 wait complete. 2023-10-06T02:19:11.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.582+0000 7eff78e0c700 1 Processor -- start 2023-10-06T02:19:11.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.582+0000 7eff78e0c700 1 -- start start 2023-10-06T02:19:11.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.582+0000 7eff78e0c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7406cde0 0x7eff7414c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.582+0000 7eff78e0c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff74150370 0x7eff7415d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.582+0000 7eff78e0c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7415d740 0x7eff7414dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.582+0000 7eff78e0c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff741529b0 con 0x7eff74150370 2023-10-06T02:19:11.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.582+0000 7eff78e0c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff74152520 con 0x7eff7406cde0 2023-10-06T02:19:11.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.582+0000 7eff78e0c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff74151910 con 0x7eff7415d740 2023-10-06T02:19:11.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.582+0000 7eff71d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff74150370 0x7eff7415d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.583+0000 7eff71d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff74150370 0x7eff7415d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44364/0 (socket says 172.21.15.6:44364) 2023-10-06T02:19:11.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.583+0000 7eff71d9b700 1 -- 172.21.15.6:0/2868479394 learned_addr learned my addr 172.21.15.6:0/2868479394 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:11.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.583+0000 7eff7259c700 1 --2- 172.21.15.6:0/2868479394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7406cde0 0x7eff7414c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.583+0000 7eff72d9d700 1 --2- 172.21.15.6:0/2868479394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7415d740 0x7eff7414dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.583+0000 7eff71d9b700 1 -- 172.21.15.6:0/2868479394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7415d740 msgr2=0x7eff7414dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:11.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.583+0000 7eff71d9b700 1 --2- 172.21.15.6:0/2868479394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7415d740 0x7eff7414dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.583+0000 7eff71d9b700 1 -- 172.21.15.6:0/2868479394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7406cde0 msgr2=0x7eff7414c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:11.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.583+0000 7eff71d9b700 1 --2- 172.21.15.6:0/2868479394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7406cde0 0x7eff7414c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.583+0000 7eff71d9b700 1 -- 172.21.15.6:0/2868479394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c009420 con 0x7eff74150370 2023-10-06T02:19:11.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.583+0000 7eff7259c700 1 --2- 172.21.15.6:0/2868479394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7406cde0 0x7eff7414c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:11.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.583+0000 7eff71d9b700 1 --2- 172.21.15.6:0/2868479394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff74150370 0x7eff7415d200 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00e980 tx=0x7eff5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:11.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.583+0000 7eff6a7fc700 1 -- 172.21.15.6:0/2868479394 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c00c850 con 0x7eff74150370 2023-10-06T02:19:11.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.583+0000 7eff6a7fc700 1 -- 172.21.15.6:0/2868479394 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c00c9b0 con 0x7eff74150370 2023-10-06T02:19:11.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.583+0000 7eff6a7fc700 1 -- 172.21.15.6:0/2868479394 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c00cd30 con 0x7eff74150370 2023-10-06T02:19:11.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.583+0000 7eff78e0c700 1 -- 172.21.15.6:0/2868479394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff74151bf0 con 0x7eff74150370 2023-10-06T02:19:11.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.583+0000 7eff78e0c700 1 -- 172.21.15.6:0/2868479394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff741521b0 con 0x7eff74150370 2023-10-06T02:19:11.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.584+0000 7eff78e0c700 1 -- 172.21.15.6:0/2868479394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff74152690 con 0x7eff74150370 2023-10-06T02:19:11.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.584+0000 7eff6a7fc700 1 -- 172.21.15.6:0/2868479394 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff5c013680 con 0x7eff74150370 2023-10-06T02:19:11.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.585+0000 7eff6a7fc700 1 --2- 172.21.15.6:0/2868479394 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff54066f30 0x7eff540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:11.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.585+0000 7eff6a7fc700 1 -- 172.21.15.6:0/2868479394 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7eff5c084a10 con 0x7eff74150370 2023-10-06T02:19:11.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.585+0000 7eff7259c700 1 --2- 172.21.15.6:0/2868479394 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff54066f30 0x7eff540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:11.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.586+0000 7eff7259c700 1 --2- 172.21.15.6:0/2868479394 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff54066f30 0x7eff540693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7eff6c00a010 tx=0x7eff6c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:11.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.589+0000 7eff6a7fc700 1 -- 172.21.15.6:0/2868479394 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff5c051990 con 0x7eff74150370 2023-10-06T02:19:11.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.830+0000 7eff78e0c700 1 -- 172.21.15.6:0/2868479394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7eff7406c300 con 0x7eff74150370 2023-10-06T02:19:11.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.830+0000 7eff6a7fc700 1 -- 172.21.15.6:0/2868479394 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7eff5c054fb0 con 0x7eff74150370 2023-10-06T02:19:11.831 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:19:11.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.832+0000 7eff78e0c700 1 -- 172.21.15.6:0/2868479394 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff54066f30 msgr2=0x7eff540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:11.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.832+0000 7eff78e0c700 1 --2- 172.21.15.6:0/2868479394 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff54066f30 0x7eff540693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7eff6c00a010 tx=0x7eff6c017000 comp rx=0 tx=0).stop 2023-10-06T02:19:11.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.832+0000 7eff78e0c700 1 -- 172.21.15.6:0/2868479394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff74150370 msgr2=0x7eff7415d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:11.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.832+0000 7eff78e0c700 1 --2- 172.21.15.6:0/2868479394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff74150370 0x7eff7415d200 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00e980 tx=0x7eff5c009250 comp rx=0 tx=0).stop 2023-10-06T02:19:11.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.832+0000 7eff78e0c700 1 -- 172.21.15.6:0/2868479394 shutdown_connections 2023-10-06T02:19:11.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.832+0000 7eff78e0c700 1 --2- 172.21.15.6:0/2868479394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7415d740 0x7eff7414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.832+0000 7eff78e0c700 1 --2- 172.21.15.6:0/2868479394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7406cde0 0x7eff7414c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.832+0000 7eff78e0c700 1 --2- 172.21.15.6:0/2868479394 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff54066f30 0x7eff540693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.832+0000 7eff78e0c700 1 --2- 172.21.15.6:0/2868479394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff74150370 0x7eff7415d200 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:11.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.832+0000 7eff78e0c700 1 -- 172.21.15.6:0/2868479394 >> 172.21.15.6:0/2868479394 conn(0x7eff7406b6e0 msgr2=0x7eff7414f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:11.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.832+0000 7eff78e0c700 1 -- 172.21.15.6:0/2868479394 shutdown_connections 2023-10-06T02:19:11.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:11.832+0000 7eff78e0c700 1 -- 172.21.15.6:0/2868479394 wait complete. 2023-10-06T02:19:11.844 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:19:11.844 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:19:11.844 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:19:11.844 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:19:11.844 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:19:11.844 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:19:11.845 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:19:11.845 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:19:11.845 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:19:11.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:11.845 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:19:11.860 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:19:11.861 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:19:11.861 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:19:11.861 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:19:11.861 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:19:11.861 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:19:11.861 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:19:11.861 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:19:11.861 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:19:11.861 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:19:11.861 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:19:11.861 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:19:11.862 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:19:11.862 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:19:11.862 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:19:11.862 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:19:11.862 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42394sec preferred_lft 42394sec 2023-10-06T02:19:11.862 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:19:11.862 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:19:11.862 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:19:11.863 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:19:11.863 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:19:11.863 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:19:11.863 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:19:11.863 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:19:11.863 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:19:11.863 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:19:11.863 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:19:11.863 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:19:11.863 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:19:11.863 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:19:11.863 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:19:11.863 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:19:11.864 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:19:11.864 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:19:11.864 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:19:11.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:11.864 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:19:11.925 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:19:11.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:11.926 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:19:11.983 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:19:11.983 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:19:11.983 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:19:11.983 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:19:11.983 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:19:11.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:11.984 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:19:11.984 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:19:11.984 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:19:11.984 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:19:11.984 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:19:11.984 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:19:12.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:12.085 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:19:12.100 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:19:12.100 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:19:12.101 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:19:12.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:12.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:19:12.166 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:19:12.166 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:19:12.166 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:19:12.221 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:19:12.221 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:19:12.221 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:19:12.275 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:19:12.341 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:19:12.341 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:19:12.406 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:19:12.407 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:19:12.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:19:12.408 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:19:12.463 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:19:12.463 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:19:12.505 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:19:12.530 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:19:12.530 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:19:12.587 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:19:12.587+0000 7f914efa9540 -1 init, newargv = 0x55a100c185a0 newargc=15 2023-10-06T02:19:12.588 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[107129]: starting ceph client 2023-10-06T02:19:12.592 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[107129]: starting fuse 2023-10-06T02:19:12.596 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:19:12.598 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:19:12.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:19:12.598 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:19:12.653 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:19:12.653 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:19:12.653 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:19:12.654 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:19:12.654 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:19:12.654 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:19:12.654 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:19:12.654 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:19:12.654 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:19:12.654 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:19:12.654 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:19:12.654 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:19:12.654 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:19:12.654 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:19:12.655 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:19:12.655 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:19:12.655 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:19:12.655 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:19:12.655 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:19:12.655 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:19:12.655 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:19:12.655 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:19:12.655 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:19:12.655 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:19:12.656 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:19:12.656 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:19:12.656 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:19:12.656 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:19:12.656 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:19:12.776 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.107129.asok 2023-10-06T02:19:12.874 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-06T02:19:12.874+0000 7fa7e07da700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:19:12.958 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.107129.asok 2023-10-06T02:19:12.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:19:12.958 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.107129.asok status 2023-10-06T02:19:13.113 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:19:13.113 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:19:13.113 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:19:13.113 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:19:13.113 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:19:13.113 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:19:13.113 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:19:13.113 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "107129", 2023-10-06T02:19:13.113 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:19:13.113 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:19:13.114 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:19:13.114 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:19:13.114 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5445, 2023-10-06T02:19:13.114 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:19:13.114 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:19:13.114 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:19:13.114 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5445 2023-10-06T02:19:13.114 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:19:13.114 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:19:13.114 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:19:13.114 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:19:13.115 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1894742735 2023-10-06T02:19:13.115 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:19:13.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:19:13.115 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:19:13.115 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:19:13.115 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:19:13.115 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1894742735 2023-10-06T02:19:13.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:19:13.115 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.5445 192.168.0.1:0/1894742735", 2023-10-06T02:19:13.115 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/1894742735", 2023-10-06T02:19:13.115 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:19:13.116 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 23, 2023-10-06T02:19:13.116 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 40, 2023-10-06T02:19:13.116 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:19:13.116 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:19:13.116 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:19:13.116 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:19:13.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:19:13.123 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:19:13.123 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:19:13.138 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:19:13.138 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:19:13.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:19:13.138 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:19:13.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:19:13.203 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2023-10-06T02:19:13.262 INFO:teuthology.orchestra.run.smithi006.stdout:file_undamaged 2023-10-06T02:19:13.263 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:19:13.263 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:19:13.263 DEBUG:teuthology.orchestra.run.smithi006:> import stat 2023-10-06T02:19:13.263 DEBUG:teuthology.orchestra.run.smithi006:> import json 2023-10-06T02:19:13.263 DEBUG:teuthology.orchestra.run.smithi006:> import sys 2023-10-06T02:19:13.263 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:19:13.263 DEBUG:teuthology.orchestra.run.smithi006:> try: 2023-10-06T02:19:13.263 DEBUG:teuthology.orchestra.run.smithi006:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2023-10-06T02:19:13.263 DEBUG:teuthology.orchestra.run.smithi006:> except OSError as e: 2023-10-06T02:19:13.263 DEBUG:teuthology.orchestra.run.smithi006:> sys.exit(e.errno) 2023-10-06T02:19:13.263 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:19:13.264 DEBUG:teuthology.orchestra.run.smithi006:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-10-06T02:19:13.264 DEBUG:teuthology.orchestra.run.smithi006:> print(json.dumps( 2023-10-06T02:19:13.264 DEBUG:teuthology.orchestra.run.smithi006:> dict([(a, getattr(s, a)) for a in attrs]), 2023-10-06T02:19:13.264 DEBUG:teuthology.orchestra.run.smithi006:> indent=2)) 2023-10-06T02:19:13.264 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:19:13.550 INFO:teuthology.orchestra.run.smithi006.stderr:daemon-helper: command failed with exit status 2 2023-10-06T02:19:13.555 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-06T02:19:13.556 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:19:13.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.716+0000 7fa2b323c700 1 Processor -- start 2023-10-06T02:19:13.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.716+0000 7fa2b323c700 1 -- start start 2023-10-06T02:19:13.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.717+0000 7fa2b323c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2ac1431b0 0x7fa2ac0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:13.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.717+0000 7fa2b323c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa2ac0d0780 0x7fa2ac0b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:13.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.717+0000 7fa2b323c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ac0cf8a0 con 0x7fa2ac142de0 2023-10-06T02:19:13.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.717+0000 7fa2b323c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac0d0b50 con 0x7fa2ac1431b0 2023-10-06T02:19:13.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.717+0000 7fa2b323c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac0cec90 con 0x7fa2ac0d0780 2023-10-06T02:19:13.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.717+0000 7fa2abfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2ac1431b0 0x7fa2ac0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:13.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.718+0000 7fa2abfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2ac1431b0 0x7fa2ac0d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44366/0 (socket says 172.21.15.6:44366) 2023-10-06T02:19:13.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.718+0000 7fa2abfff700 1 -- 172.21.15.6:0/2374975565 learned_addr learned my addr 172.21.15.6:0/2374975565 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:13.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.718+0000 7fa2b17d9700 1 --2- 172.21.15.6:0/2374975565 >> v2:172.21.15.175:3300/0 conn(0x7fa2ac0d0780 0x7fa2ac0b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:13.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.718+0000 7fa2abfff700 1 -- 172.21.15.6:0/2374975565 >> v2:172.21.15.175:3300/0 conn(0x7fa2ac0d0780 msgr2=0x7fa2ac0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:13.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.718+0000 7fa2abfff700 1 --2- 172.21.15.6:0/2374975565 >> v2:172.21.15.175:3300/0 conn(0x7fa2ac0d0780 0x7fa2ac0b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:13.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.718+0000 7fa2abfff700 1 -- 172.21.15.6:0/2374975565 >> v1:172.21.15.175:6789/0 conn(0x7fa2ac142de0 legacy=0x7fa2ac0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:13.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.718+0000 7fa2abfff700 1 -- 172.21.15.6:0/2374975565 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac0cef70 con 0x7fa2ac1431b0 2023-10-06T02:19:13.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.718+0000 7fa2b17d9700 1 --2- 172.21.15.6:0/2374975565 >> v2:172.21.15.175:3300/0 conn(0x7fa2ac0d0780 0x7fa2ac0b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:13.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.718+0000 7fa2abfff700 1 --2- 172.21.15.6:0/2374975565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ac1431b0 0x7fa2ac0d0240 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0d0e10 tx=0x7fa29c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7dcf25875e4c4fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:13.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.718+0000 7fa2ab7fe700 1 -- 172.21.15.6:0/2374975565 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00e070 con 0x7fa2ac1431b0 2023-10-06T02:19:13.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.718+0000 7fa2ab7fe700 1 -- 172.21.15.6:0/2374975565 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c00ba50 con 0x7fa2ac1431b0 2023-10-06T02:19:13.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.718+0000 7fa2ab7fe700 1 -- 172.21.15.6:0/2374975565 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c0092e0 con 0x7fa2ac1431b0 2023-10-06T02:19:13.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.719+0000 7fa2b323c700 1 -- 172.21.15.6:0/2374975565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ac1431b0 msgr2=0x7fa2ac0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:13.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.719+0000 7fa2b323c700 1 --2- 172.21.15.6:0/2374975565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ac1431b0 0x7fa2ac0d0240 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0d0e10 tx=0x7fa29c009840 comp rx=0 tx=0).stop 2023-10-06T02:19:13.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.719+0000 7fa2b323c700 1 -- 172.21.15.6:0/2374975565 shutdown_connections 2023-10-06T02:19:13.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.719+0000 7fa2b323c700 1 --2- 172.21.15.6:0/2374975565 >> v2:172.21.15.175:3300/0 conn(0x7fa2ac0d0780 0x7fa2ac0b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:13.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.719+0000 7fa2b323c700 1 --2- 172.21.15.6:0/2374975565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ac1431b0 0x7fa2ac0d0240 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:13.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.719+0000 7fa2b323c700 1 -- 172.21.15.6:0/2374975565 >> 172.21.15.6:0/2374975565 conn(0x7fa2ac069110 msgr2=0x7fa2ac06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:13.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.719+0000 7fa2b323c700 1 -- 172.21.15.6:0/2374975565 shutdown_connections 2023-10-06T02:19:13.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.719+0000 7fa2b323c700 1 -- 172.21.15.6:0/2374975565 wait complete. 2023-10-06T02:19:13.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.720+0000 7fa2b323c700 1 Processor -- start 2023-10-06T02:19:13.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.720+0000 7fa2b323c700 1 -- start start 2023-10-06T02:19:13.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.721+0000 7fa2b323c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2ac0d0780 0x7fa2ac0b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:13.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.721+0000 7fa2b323c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ac142de0 0x7fa2ac16ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:13.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.721+0000 7fa2b323c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2ac1431b0 0x7fa2ac0ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:13.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.721+0000 7fa2b323c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0c9530 con 0x7fa2ac142de0 2023-10-06T02:19:13.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.721+0000 7fa2b323c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0c6440 con 0x7fa2ac1431b0 2023-10-06T02:19:13.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.721+0000 7fa2b323c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0c88f0 con 0x7fa2ac0d0780 2023-10-06T02:19:13.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.721+0000 7fa2abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ac142de0 0x7fa2ac16ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:13.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.721+0000 7fa2abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ac142de0 0x7fa2ac16ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44370/0 (socket says 172.21.15.6:44370) 2023-10-06T02:19:13.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.721+0000 7fa2abfff700 1 -- 172.21.15.6:0/3094744827 learned_addr learned my addr 172.21.15.6:0/3094744827 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:13.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.721+0000 7fa2b17d9700 1 --2- 172.21.15.6:0/3094744827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2ac1431b0 0x7fa2ac0ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:13.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.721+0000 7fa2b0fd8700 1 --2- 172.21.15.6:0/3094744827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2ac0d0780 0x7fa2ac0b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:13.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.721+0000 7fa2abfff700 1 -- 172.21.15.6:0/3094744827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2ac0d0780 msgr2=0x7fa2ac0b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:13.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.721+0000 7fa2abfff700 1 --2- 172.21.15.6:0/3094744827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2ac0d0780 0x7fa2ac0b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:13.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.721+0000 7fa2abfff700 1 -- 172.21.15.6:0/3094744827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2ac1431b0 msgr2=0x7fa2ac0ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:13.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.721+0000 7fa2abfff700 1 --2- 172.21.15.6:0/3094744827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2ac1431b0 0x7fa2ac0ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:13.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.721+0000 7fa2abfff700 1 -- 172.21.15.6:0/3094744827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c009ae0 con 0x7fa2ac142de0 2023-10-06T02:19:13.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.722+0000 7fa2abfff700 1 --2- 172.21.15.6:0/3094744827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ac142de0 0x7fa2ac16ab30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac066020 tx=0x7fa29c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:13.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.722+0000 7fa2a8ff9700 1 -- 172.21.15.6:0/3094744827 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c008980 con 0x7fa2ac142de0 2023-10-06T02:19:13.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.722+0000 7fa2a8ff9700 1 -- 172.21.15.6:0/3094744827 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c008b00 con 0x7fa2ac142de0 2023-10-06T02:19:13.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.722+0000 7fa2b323c700 1 -- 172.21.15.6:0/3094744827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ac0c8b90 con 0x7fa2ac142de0 2023-10-06T02:19:13.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.722+0000 7fa2a8ff9700 1 -- 172.21.15.6:0/3094744827 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c026460 con 0x7fa2ac142de0 2023-10-06T02:19:13.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.722+0000 7fa2b323c700 1 -- 172.21.15.6:0/3094744827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac0c9150 con 0x7fa2ac142de0 2023-10-06T02:19:13.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.723+0000 7fa2b323c700 1 -- 172.21.15.6:0/3094744827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ac0c9670 con 0x7fa2ac142de0 2023-10-06T02:19:13.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.723+0000 7fa2a8ff9700 1 -- 172.21.15.6:0/3094744827 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa29c003040 con 0x7fa2ac142de0 2023-10-06T02:19:13.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.724+0000 7fa2a8ff9700 1 --2- 172.21.15.6:0/3094744827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa28c066f30 0x7fa28c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:13.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.724+0000 7fa2a8ff9700 1 -- 172.21.15.6:0/3094744827 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fa29c086540 con 0x7fa2ac142de0 2023-10-06T02:19:13.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.724+0000 7fa2b0fd8700 1 --2- 172.21.15.6:0/3094744827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa28c066f30 0x7fa28c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:13.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.724+0000 7fa2b0fd8700 1 --2- 172.21.15.6:0/3094744827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa28c066f30 0x7fa28c0693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa2940039f0 tx=0x7fa294007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:13.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.728+0000 7fa2a8ff9700 1 -- 172.21.15.6:0/3094744827 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2ac0c9670 con 0x7fa2ac142de0 2023-10-06T02:19:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.966+0000 7fa2b323c700 1 -- 172.21.15.6:0/3094744827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2ac0c9670 con 0x7fa2ac142de0 2023-10-06T02:19:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.967+0000 7fa2a8ff9700 1 -- 172.21.15.6:0/3094744827 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fa2ac0c9670 con 0x7fa2ac142de0 2023-10-06T02:19:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:19:13.967 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1173605075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1173605075},{"type":"v1","addr":"172.21.15.175:6837","nonce":1173605075}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/375122461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":375122461},{"type":"v1","addr":"172.21.15.175:6835","nonce":375122461}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5142,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3506443204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3506443204},{"type":"v1","addr":"172.21.15.6:6835","nonce":3506443204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:18:45.349958+0000","modified":"2023-10-06T02:19:09.880245+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5385},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5385":{"gid":5385,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6834/1188971598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1188971598},{"type":"v1","addr":"172.21.15.6:6834","nonce":1188971598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:19:13.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.969+0000 7fa2b323c700 1 -- 172.21.15.6:0/3094744827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa28c066f30 msgr2=0x7fa28c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.969+0000 7fa2b323c700 1 --2- 172.21.15.6:0/3094744827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa28c066f30 0x7fa28c0693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa2940039f0 tx=0x7fa294007ec0 comp rx=0 tx=0).stop 2023-10-06T02:19:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.969+0000 7fa2b323c700 1 -- 172.21.15.6:0/3094744827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ac142de0 msgr2=0x7fa2ac16ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.969+0000 7fa2b323c700 1 --2- 172.21.15.6:0/3094744827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ac142de0 0x7fa2ac16ab30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac066020 tx=0x7fa29c018000 comp rx=0 tx=0).stop 2023-10-06T02:19:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.969+0000 7fa2b323c700 1 -- 172.21.15.6:0/3094744827 shutdown_connections 2023-10-06T02:19:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.969+0000 7fa2b323c700 1 --2- 172.21.15.6:0/3094744827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2ac1431b0 0x7fa2ac0ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.969+0000 7fa2b323c700 1 --2- 172.21.15.6:0/3094744827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2ac0d0780 0x7fa2ac0b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.969+0000 7fa2b323c700 1 --2- 172.21.15.6:0/3094744827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa28c066f30 0x7fa28c0693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.969+0000 7fa2b323c700 1 --2- 172.21.15.6:0/3094744827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ac142de0 0x7fa2ac16ab30 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.969+0000 7fa2b323c700 1 -- 172.21.15.6:0/3094744827 >> 172.21.15.6:0/3094744827 conn(0x7fa2ac069110 msgr2=0x7fa2ac0b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.969+0000 7fa2b323c700 1 -- 172.21.15.6:0/3094744827 shutdown_connections 2023-10-06T02:19:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:13.969+0000 7fa2b323c700 1 -- 172.21.15.6:0/3094744827 wait complete. 2023-10-06T02:19:13.971 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 23 2023-10-06T02:19:13.981 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2023-10-06T02:19:14.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.101+0000 7fcebefa2700 1 Processor -- start 2023-10-06T02:19:14.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.101+0000 7fcebefa2700 1 -- start start 2023-10-06T02:19:14.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.102+0000 7fcebefa2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fceb806c210 0x7fceb80c8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.102+0000 7fcebefa2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb80c8ad0 con 0x7fceb80c8550 2023-10-06T02:19:14.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.102+0000 7fcebefa2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb806b730 con 0x7fceb8157d40 2023-10-06T02:19:14.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.102+0000 7fcebefa2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb806ba10 con 0x7fceb806c210 2023-10-06T02:19:14.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.102+0000 7fcebd53f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fceb80c8550 0x7fceb8068680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38512/0 (socket says 172.21.15.6:38512) 2023-10-06T02:19:14.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.102+0000 7fcebd53f700 1 -- 172.21.15.6:0/2650743517 learned_addr learned my addr 172.21.15.6:0/2650743517 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:19:14.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.102+0000 7fceb7fff700 1 --2- 172.21.15.6:0/2650743517 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fceb806c210 0x7fceb80c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb77fe700 1 -- 172.21.15.6:0/2650743517 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721674150 0 0) 0x7fceb80c8ad0 con 0x7fceb80c8550 2023-10-06T02:19:14.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb77fe700 1 -- 172.21.15.6:0/2650743517 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcea4003570 con 0x7fceb80c8550 2023-10-06T02:19:14.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb77fe700 1 -- 172.21.15.6:0/2650743517 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612896959 0 0) 0x7fceb806b730 con 0x7fceb8157d40 2023-10-06T02:19:14.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb77fe700 1 -- 172.21.15.6:0/2650743517 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceb80c8ad0 con 0x7fceb8157d40 2023-10-06T02:19:14.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb77fe700 1 -- 172.21.15.6:0/2650743517 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3566814019 0 0) 0x7fcea4003570 con 0x7fceb80c8550 2023-10-06T02:19:14.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb77fe700 1 -- 172.21.15.6:0/2650743517 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fceb806c210 msgr2=0x7fceb80c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:14.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb77fe700 1 --2- 172.21.15.6:0/2650743517 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fceb806c210 0x7fceb80c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb77fe700 1 -- 172.21.15.6:0/2650743517 >> v1:172.21.15.175:6789/0 conn(0x7fceb8157d40 legacy=0x7fceb8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:14.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb77fe700 1 -- 172.21.15.6:0/2650743517 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb806bcf0 con 0x7fceb80c8550 2023-10-06T02:19:14.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb77fe700 1 -- 172.21.15.6:0/2650743517 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fcea0001470 con 0x7fceb80c8550 2023-10-06T02:19:14.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb77fe700 1 -- 172.21.15.6:0/2650743517 >> v1:172.21.15.6:6789/0 conn(0x7fceb80c8550 legacy=0x7fceb8068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:14.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb77fe700 1 --2- 172.21.15.6:0/2650743517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcea4003c20 0x7fcea4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb77fe700 1 --2- 172.21.15.6:0/2650743517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcea4004810 0x7fcea4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb77fe700 1 --2- 172.21.15.6:0/2650743517 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fceb806c210 0x7fcea4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb77fe700 1 -- 172.21.15.6:0/2650743517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb806ba10 con 0x7fcea4004810 2023-10-06T02:19:14.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb77fe700 1 -- 172.21.15.6:0/2650743517 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea400bbf0 con 0x7fcea4003c20 2023-10-06T02:19:14.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb77fe700 1 -- 172.21.15.6:0/2650743517 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea400bdb0 con 0x7fceb806c210 2023-10-06T02:19:14.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb7fff700 1 --2- 172.21.15.6:0/2650743517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcea4004810 0x7fcea4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fcebd53f700 1 --2- 172.21.15.6:0/2650743517 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fceb806c210 0x7fcea4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fcebcd3e700 1 --2- 172.21.15.6:0/2650743517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcea4003c20 0x7fcea4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb7fff700 1 -- 172.21.15.6:0/2650743517 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fceb806c210 msgr2=0x7fcea4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:14.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb7fff700 1 --2- 172.21.15.6:0/2650743517 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fceb806c210 0x7fcea4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb7fff700 1 -- 172.21.15.6:0/2650743517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcea4003c20 msgr2=0x7fcea4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:14.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb7fff700 1 --2- 172.21.15.6:0/2650743517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcea4003c20 0x7fcea4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fceb7fff700 1 -- 172.21.15.6:0/2650743517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4003570 con 0x7fcea4004810 2023-10-06T02:19:14.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.103+0000 7fcebcd3e700 1 --2- 172.21.15.6:0/2650743517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcea4003c20 0x7fcea4004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:14.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.104+0000 7fceb7fff700 1 --2- 172.21.15.6:0/2650743517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcea4004810 0x7fcea4004c80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fceb806c600 tx=0x7fcea800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43545b5da1248d30 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:14.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.104+0000 7fceb77fe700 1 -- 172.21.15.6:0/2650743517 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea800ea90 con 0x7fcea4004810 2023-10-06T02:19:14.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.104+0000 7fceb77fe700 1 -- 172.21.15.6:0/2650743517 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea800f040 con 0x7fcea4004810 2023-10-06T02:19:14.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.104+0000 7fceb77fe700 1 -- 172.21.15.6:0/2650743517 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea800ee40 con 0x7fcea4004810 2023-10-06T02:19:14.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.104+0000 7fcebefa2700 1 -- 172.21.15.6:0/2650743517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcea4004810 msgr2=0x7fcea4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:14.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.104+0000 7fcebefa2700 1 --2- 172.21.15.6:0/2650743517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcea4004810 0x7fcea4004c80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fceb806c600 tx=0x7fcea800b040 comp rx=0 tx=0).stop 2023-10-06T02:19:14.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.104+0000 7fcebd53f700 1 -- 172.21.15.6:0/2650743517 reap_dead start 2023-10-06T02:19:14.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.104+0000 7fcebefa2700 1 -- 172.21.15.6:0/2650743517 shutdown_connections 2023-10-06T02:19:14.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.104+0000 7fcebefa2700 1 -- 172.21.15.6:0/2650743517 >> 172.21.15.6:0/2650743517 conn(0x7fceb806a260 msgr2=0x7fceb80cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:14.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.104+0000 7fcebefa2700 1 -- 172.21.15.6:0/2650743517 shutdown_connections 2023-10-06T02:19:14.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.104+0000 7fcebefa2700 1 -- 172.21.15.6:0/2650743517 wait complete. 2023-10-06T02:19:14.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.105+0000 7fcebefa2700 1 Processor -- start 2023-10-06T02:19:14.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.106+0000 7fcebefa2700 1 -- start start 2023-10-06T02:19:14.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.106+0000 7fcebefa2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcea4004810 0x7fceb8167b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.106+0000 7fcebefa2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb8154600 0x7fceb814d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.106+0000 7fcebefa2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fceb80b08c0 0x7fceb81501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.106+0000 7fcebefa2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80b2d20 con 0x7fceb8154600 2023-10-06T02:19:14.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.106+0000 7fcebefa2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb814e6b0 con 0x7fceb80b08c0 2023-10-06T02:19:14.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.106+0000 7fcebefa2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb81681d0 con 0x7fcea4004810 2023-10-06T02:19:14.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.106+0000 7fceb7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb8154600 0x7fceb814d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.106+0000 7fceb7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb8154600 0x7fceb814d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44396/0 (socket says 172.21.15.6:44396) 2023-10-06T02:19:14.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.106+0000 7fceb7fff700 1 -- 172.21.15.6:0/90206569 learned_addr learned my addr 172.21.15.6:0/90206569 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:14.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.107+0000 7fcebcd3e700 1 --2- 172.21.15.6:0/90206569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcea4004810 0x7fceb8167b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.107+0000 7fcebd53f700 1 --2- 172.21.15.6:0/90206569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fceb80b08c0 0x7fceb81501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.107+0000 7fceb7fff700 1 -- 172.21.15.6:0/90206569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcea4004810 msgr2=0x7fceb8167b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:14.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.107+0000 7fceb7fff700 1 --2- 172.21.15.6:0/90206569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcea4004810 0x7fceb8167b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.107+0000 7fceb7fff700 1 -- 172.21.15.6:0/90206569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fceb80b08c0 msgr2=0x7fceb81501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:14.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.107+0000 7fceb7fff700 1 --2- 172.21.15.6:0/90206569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fceb80b08c0 0x7fceb81501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.107+0000 7fceb7fff700 1 -- 172.21.15.6:0/90206569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb81684b0 con 0x7fceb8154600 2023-10-06T02:19:14.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.107+0000 7fcebd53f700 1 --2- 172.21.15.6:0/90206569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fceb80b08c0 0x7fceb81501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:14.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.107+0000 7fcebcd3e700 1 --2- 172.21.15.6:0/90206569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcea4004810 0x7fceb8167b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:14.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.107+0000 7fceb7fff700 1 --2- 172.21.15.6:0/90206569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb8154600 0x7fceb814d670 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcea40057f0 tx=0x7fcea801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:14.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.107+0000 7fceb4ff9700 1 -- 172.21.15.6:0/90206569 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea801d420 con 0x7fceb8154600 2023-10-06T02:19:14.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.107+0000 7fceb4ff9700 1 -- 172.21.15.6:0/90206569 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea801d5a0 con 0x7fceb8154600 2023-10-06T02:19:14.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.107+0000 7fcebefa2700 1 -- 172.21.15.6:0/90206569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb8168790 con 0x7fceb8154600 2023-10-06T02:19:14.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.107+0000 7fceb4ff9700 1 -- 172.21.15.6:0/90206569 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea801d960 con 0x7fceb8154600 2023-10-06T02:19:14.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.107+0000 7fcebefa2700 1 -- 172.21.15.6:0/90206569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb8154a50 con 0x7fceb8154600 2023-10-06T02:19:14.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.108+0000 7fceb4ff9700 1 -- 172.21.15.6:0/90206569 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcea8003040 con 0x7fceb8154600 2023-10-06T02:19:14.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.109+0000 7fceb4ff9700 1 --2- 172.21.15.6:0/90206569 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce98066f30 0x7fce980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.109+0000 7fceb4ff9700 1 -- 172.21.15.6:0/90206569 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fcea8086c10 con 0x7fceb8154600 2023-10-06T02:19:14.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.109+0000 7fcebcd3e700 1 --2- 172.21.15.6:0/90206569 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce98066f30 0x7fce980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.109+0000 7fcebcd3e700 1 --2- 172.21.15.6:0/90206569 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce98066f30 0x7fce980693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fceb0007bc0 tx=0x7fceb0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:14.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.111+0000 7fcec829ab80 1 Processor -- start 2023-10-06T02:19:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.111+0000 7fcec829ab80 1 -- start start 2023-10-06T02:19:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fcec829ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342edee2c0 0x56342edee690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fcec829ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342edc1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fcec829ab80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 0x56342ee081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fcec829ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342ed18b10 con 0x56342ee0bb90 2023-10-06T02:19:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fcec829ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342ed16310 con 0x56342edee2c0 2023-10-06T02:19:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fcec829ab80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56342ed12100 con 0x56342edc1c50 2023-10-06T02:19:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fceb7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342edc1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fceb7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342edc1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44404/0 (socket says 172.21.15.6:44404) 2023-10-06T02:19:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fceb7fff700 1 -- 172.21.15.6:0/1013400730 learned_addr learned my addr 172.21.15.6:0/1013400730 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fcebcd3e700 1 --2- 172.21.15.6:0/1013400730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342edee2c0 0x56342edee690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fcebd53f700 1 --2- 172.21.15.6:0/1013400730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 0x56342ee081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fceb7fff700 1 -- 172.21.15.6:0/1013400730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 msgr2=0x56342ee081d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fceb7fff700 1 --2- 172.21.15.6:0/1013400730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 0x56342ee081d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fceb7fff700 1 -- 172.21.15.6:0/1013400730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342edee2c0 msgr2=0x56342edee690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fceb7fff700 1 --2- 172.21.15.6:0/1013400730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342edee2c0 0x56342edee690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fceb7fff700 1 -- 172.21.15.6:0/1013400730 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56342ebac310 con 0x56342ee0bb90 2023-10-06T02:19:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fceb7fff700 1 --2- 172.21.15.6:0/1013400730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342edc1710 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcea8053d50 tx=0x7fcea8084da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b532ffebf9b68546 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fceadffb700 1 -- 172.21.15.6:0/1013400730 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea8057f50 con 0x56342ee0bb90 2023-10-06T02:19:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fceadffb700 1 -- 172.21.15.6:0/1013400730 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea8057850 con 0x56342ee0bb90 2023-10-06T02:19:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.112+0000 7fceadffb700 1 -- 172.21.15.6:0/1013400730 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea805aaa0 con 0x56342ee0bb90 2023-10-06T02:19:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.113+0000 7fcec829ab80 1 -- 172.21.15.6:0/1013400730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 msgr2=0x56342edc1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.113+0000 7fcec829ab80 1 --2- 172.21.15.6:0/1013400730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342edc1710 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcea8053d50 tx=0x7fcea8084da0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.113+0000 7fcec829ab80 1 -- 172.21.15.6:0/1013400730 shutdown_connections 2023-10-06T02:19:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.113+0000 7fcec829ab80 1 --2- 172.21.15.6:0/1013400730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 0x56342ee081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.113+0000 7fcec829ab80 1 --2- 172.21.15.6:0/1013400730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342edee2c0 0x56342edee690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.113+0000 7fcec829ab80 1 --2- 172.21.15.6:0/1013400730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342edc1710 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.113+0000 7fcec829ab80 1 -- 172.21.15.6:0/1013400730 >> 172.21.15.6:0/1013400730 conn(0x56342edc3200 msgr2=0x56342edc35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.113+0000 7fcec829ab80 1 -- 172.21.15.6:0/1013400730 shutdown_connections 2023-10-06T02:19:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.113+0000 7fcec829ab80 1 -- 172.21.15.6:0/1013400730 wait complete. 2023-10-06T02:19:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.113+0000 7fcec829ab80 1 -- start start 2023-10-06T02:19:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.114+0000 7fcec829ab80 1 Processor -- start 2023-10-06T02:19:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.114+0000 7fcec829ab80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 0x56342ee09820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.114+0000 7fcec829ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342edee2c0 0x56342edef300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.114+0000 7fcec829ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342ee0bb90 0x56342ee04f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.114+0000 7fcec829ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342ecbd930 con 0x56342edee2c0 2023-10-06T02:19:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.114+0000 7fcec829ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342ecd8f40 con 0x56342ee0bb90 2023-10-06T02:19:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.114+0000 7fcec829ab80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56342eb94ed0 con 0x56342edc1c50 2023-10-06T02:19:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.114+0000 7fcec829ab80 10 client.0 _ll_register_callbacks cb 0x56342ed84f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:19:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fceb7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342edee2c0 0x56342edef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fceb7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342edee2c0 0x56342edef300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44410/0 (socket says 172.21.15.6:44410) 2023-10-06T02:19:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fceb7fff700 1 -- 172.21.15.6:0/1177419448 learned_addr learned my addr 172.21.15.6:0/1177419448 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fcebd53f700 1 --2- 172.21.15.6:0/1177419448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342ee0bb90 0x56342ee04f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fcebcd3e700 1 --2- 172.21.15.6:0/1177419448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 0x56342ee09820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fceb7fff700 1 -- 172.21.15.6:0/1177419448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 msgr2=0x56342ee09820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fceb7fff700 1 --2- 172.21.15.6:0/1177419448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 0x56342ee09820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fceb7fff700 1 -- 172.21.15.6:0/1177419448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342ee0bb90 msgr2=0x56342ee04f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fceb7fff700 1 --2- 172.21.15.6:0/1177419448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342ee0bb90 0x56342ee04f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fceb7fff700 1 -- 172.21.15.6:0/1177419448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb8154a50 con 0x56342edee2c0 2023-10-06T02:19:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fcebd53f700 1 --2- 172.21.15.6:0/1177419448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342ee0bb90 0x56342ee04f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fceb7fff700 1 --2- 172.21.15.6:0/1177419448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342edee2c0 0x56342edef300 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcea8057eb0 tx=0x7fcea806c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65172f93960deb13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fce96ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:19:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fce96ffd700 1 -- 172.21.15.6:0/1177419448 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea805e7f0 con 0x56342edee2c0 2023-10-06T02:19:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fce96ffd700 1 -- 172.21.15.6:0/1177419448 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fcea805aaa0 con 0x56342edee2c0 2023-10-06T02:19:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fcec829ab80 1 -- 172.21.15.6:0/1177419448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56342edb69e0 con 0x56342edee2c0 2023-10-06T02:19:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fce96ffd700 1 -- 172.21.15.6:0/1177419448 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcea80732d0 con 0x56342edee2c0 2023-10-06T02:19:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fcec829ab80 10 client.5463 fetch_fsmap learned FSMap version 23 2023-10-06T02:19:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fcec829ab80 1 -- 172.21.15.6:0/1177419448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x56342eb4f080 con 0x56342edee2c0 2023-10-06T02:19:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.115+0000 7fce96ffd700 1 -- 172.21.15.6:0/1177419448 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56342edb69e0 con 0x56342edee2c0 2023-10-06T02:19:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.116+0000 7fce96ffd700 1 -- 172.21.15.6:0/1177419448 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcea805e360 con 0x56342edee2c0 2023-10-06T02:19:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.116+0000 7fcec829ab80 10 client.5463 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T02:19:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.116+0000 7fcec829ab80 10 client.5463 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:19:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.116+0000 7fcec829ab80 20 client.5463 populate_metadata read hostname 'smithi006' 2023-10-06T02:19:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.116+0000 7fcec829ab80 1 --2- 172.21.15.6:0/1177419448 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x56342edf06d0 0x56342edf0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.116+0000 7fcec829ab80 4 client.5463 mds_command: new command op to 5385 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:19:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.116+0000 7fcec829ab80 1 -- 172.21.15.6:0/1177419448 --> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56342ed93910 con 0x56342edf06d0 2023-10-06T02:19:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.116+0000 7fcebcd3e700 1 --2- 172.21.15.6:0/1177419448 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x56342edf06d0 0x56342edf0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.116+0000 7fcebcd3e700 1 --2- 172.21.15.6:0/1177419448 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x56342edf06d0 0x56342edf0aa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7ab7b6db7bd6f54 server_cookie=d87c9b1e5768e0de in_seq=0 out_seq=0 2023-10-06T02:19:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.116+0000 7fce96ffd700 10 client.5463 ms_handle_connect on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.117+0000 7fce96ffd700 1 -- 172.21.15.6:0/1177419448 <== mds.0 v2:172.21.15.6:6832/1188971598 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56342ed93910 con 0x56342edf06d0 2023-10-06T02:19:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.117+0000 7fce96ffd700 10 client.5463 handle_command_reply: tid=0 2023-10-06T02:19:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.117+0000 7fcec829ab80 1 client.5463 shutdown 2023-10-06T02:19:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.117+0000 7fcec829ab80 1 -- 172.21.15.6:0/1177419448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342edee2c0 msgr2=0x56342edef300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.117+0000 7fcec829ab80 1 --2- 172.21.15.6:0/1177419448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342edee2c0 0x56342edef300 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcea8057eb0 tx=0x7fcea806c000 comp rx=0 tx=0).stop 2023-10-06T02:19:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.117+0000 7fcec829ab80 1 -- 172.21.15.6:0/1177419448 shutdown_connections 2023-10-06T02:19:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.117+0000 7fcec829ab80 1 --2- 172.21.15.6:0/1177419448 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x56342edf06d0 0x56342edf0aa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.117+0000 7fcec829ab80 1 --2- 172.21.15.6:0/1177419448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342ee0bb90 0x56342ee04f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.117+0000 7fcec829ab80 1 --2- 172.21.15.6:0/1177419448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 0x56342ee09820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.117+0000 7fce96ffd700 0 client.5463 ms_handle_reset on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.117+0000 7fcec829ab80 1 --2- 172.21.15.6:0/1177419448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342edee2c0 0x56342edef300 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.117+0000 7fcec829ab80 1 -- 172.21.15.6:0/1177419448 >> 172.21.15.6:0/1177419448 conn(0x56342edc3200 msgr2=0x56342edc2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.117+0000 7fcec829ab80 1 -- 172.21.15.6:0/1177419448 shutdown_connections 2023-10-06T02:19:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.117+0000 7fcec829ab80 1 -- 172.21.15.6:0/1177419448 wait complete. 2023-10-06T02:19:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.117+0000 7fcec829ab80 20 client.5463 trim_cache size 0 max 16384 2023-10-06T02:19:14.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.130+0000 7fcec829ab80 1 Processor -- start 2023-10-06T02:19:14.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.130+0000 7fcec829ab80 1 -- start start 2023-10-06T02:19:14.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.130+0000 7fcec829ab80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 0x56342ee08460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.130+0000 7fcec829ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342edee2c0 0x56342eded260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.130+0000 7fcec829ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342edee9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.130+0000 7fcec829ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342eda1420 con 0x56342ee0bb90 2023-10-06T02:19:14.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.130+0000 7fcec829ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342edbc6c0 con 0x56342edee2c0 2023-10-06T02:19:14.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.130+0000 7fcec829ab80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56342ed89e30 con 0x56342edc1c50 2023-10-06T02:19:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.130+0000 7fcebd53f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342edee9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.130+0000 7fcebd53f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342edee9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44424/0 (socket says 172.21.15.6:44424) 2023-10-06T02:19:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.130+0000 7fcebd53f700 1 -- 172.21.15.6:0/162136994 learned_addr learned my addr 172.21.15.6:0/162136994 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.131+0000 7fcebd53f700 1 -- 172.21.15.6:0/162136994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 msgr2=0x56342ee08460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.131+0000 7fcebd53f700 1 --2- 172.21.15.6:0/162136994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 0x56342ee08460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.131+0000 7fcebd53f700 1 -- 172.21.15.6:0/162136994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342edee2c0 msgr2=0x56342eded260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.131+0000 7fcebd53f700 1 --2- 172.21.15.6:0/162136994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342edee2c0 0x56342eded260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.131+0000 7fcebd53f700 1 -- 172.21.15.6:0/162136994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56342ece0820 con 0x56342ee0bb90 2023-10-06T02:19:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.131+0000 7fcebd53f700 1 --2- 172.21.15.6:0/162136994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342edee9d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fceb806a770 tx=0x7fcea0006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f598eeb4c05f6d61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.131+0000 7fceae7fc700 1 -- 172.21.15.6:0/162136994 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea001b070 con 0x56342ee0bb90 2023-10-06T02:19:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.131+0000 7fceae7fc700 1 -- 172.21.15.6:0/162136994 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea0004fc0 con 0x56342ee0bb90 2023-10-06T02:19:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.131+0000 7fceae7fc700 1 -- 172.21.15.6:0/162136994 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0005380 con 0x56342ee0bb90 2023-10-06T02:19:14.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.131+0000 7fcec829ab80 1 -- 172.21.15.6:0/162136994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 msgr2=0x56342edee9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:14.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.131+0000 7fcec829ab80 1 --2- 172.21.15.6:0/162136994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342edee9d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fceb806a770 tx=0x7fcea0006040 comp rx=0 tx=0).stop 2023-10-06T02:19:14.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.131+0000 7fcec829ab80 1 -- 172.21.15.6:0/162136994 shutdown_connections 2023-10-06T02:19:14.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.131+0000 7fcec829ab80 1 --2- 172.21.15.6:0/162136994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342edee9d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.131+0000 7fcec829ab80 1 --2- 172.21.15.6:0/162136994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 0x56342ee08460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.131+0000 7fcec829ab80 1 --2- 172.21.15.6:0/162136994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342edee2c0 0x56342eded260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.131+0000 7fcec829ab80 1 -- 172.21.15.6:0/162136994 >> 172.21.15.6:0/162136994 conn(0x56342edc3200 msgr2=0x56342edba320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:14.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.132+0000 7fcec829ab80 1 -- 172.21.15.6:0/162136994 shutdown_connections 2023-10-06T02:19:14.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.132+0000 7fcec829ab80 1 -- 172.21.15.6:0/162136994 wait complete. 2023-10-06T02:19:14.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.132+0000 7fcec829ab80 1 -- start start 2023-10-06T02:19:14.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.132+0000 7fcec829ab80 1 Processor -- start 2023-10-06T02:19:14.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.133+0000 7fcec829ab80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 0x56342edeb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.133+0000 7fcec829ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342edee2c0 0x56342ee5a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.133+0000 7fcec829ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342ee1d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.133+0000 7fcec829ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342ede84f0 con 0x56342ee0bb90 2023-10-06T02:19:14.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.133+0000 7fcec829ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342edbdc80 con 0x56342edee2c0 2023-10-06T02:19:14.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.133+0000 7fcec829ab80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56342ee08660 con 0x56342edc1c50 2023-10-06T02:19:14.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.133+0000 7fcec829ab80 10 client.0 _ll_register_callbacks cb 0x56342ed84f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:19:14.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.133+0000 7fcebd53f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342ee1d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.133+0000 7fcebd53f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342ee1d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44428/0 (socket says 172.21.15.6:44428) 2023-10-06T02:19:14.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.133+0000 7fcebd53f700 1 -- 172.21.15.6:0/965764999 learned_addr learned my addr 172.21.15.6:0/965764999 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:14.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fceb7fff700 1 --2- 172.21.15.6:0/965764999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342edee2c0 0x56342ee5a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fcebcd3e700 1 --2- 172.21.15.6:0/965764999 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 0x56342edeb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fcebd53f700 1 -- 172.21.15.6:0/965764999 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 msgr2=0x56342edeb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:14.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fcebd53f700 1 --2- 172.21.15.6:0/965764999 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 0x56342edeb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fcebd53f700 1 -- 172.21.15.6:0/965764999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342edee2c0 msgr2=0x56342ee5a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:14.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fcebd53f700 1 --2- 172.21.15.6:0/965764999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342edee2c0 0x56342ee5a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fcebd53f700 1 -- 172.21.15.6:0/965764999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea000f040 con 0x56342ee0bb90 2023-10-06T02:19:14.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fcebcd3e700 1 --2- 172.21.15.6:0/965764999 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 0x56342edeb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:14.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fceb7fff700 1 --2- 172.21.15.6:0/965764999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342edee2c0 0x56342ee5a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:14.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fcebd53f700 1 --2- 172.21.15.6:0/965764999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342ee1d7b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fceb80c8ee0 tx=0x7fcea0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b022b364ae9c9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:14.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fce96ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:19:14.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fce96ffd700 1 -- 172.21.15.6:0/965764999 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0006070 con 0x56342ee0bb90 2023-10-06T02:19:14.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fce96ffd700 1 -- 172.21.15.6:0/965764999 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fcea0026ac0 con 0x56342ee0bb90 2023-10-06T02:19:14.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fcec829ab80 1 -- 172.21.15.6:0/965764999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcea8057850 con 0x56342ee0bb90 2023-10-06T02:19:14.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fce96ffd700 1 -- 172.21.15.6:0/965764999 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcea001b030 con 0x56342ee0bb90 2023-10-06T02:19:14.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fcec829ab80 10 client.5469 fetch_fsmap learned FSMap version 23 2023-10-06T02:19:14.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fcec829ab80 1 -- 172.21.15.6:0/965764999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x56342ecc7510 con 0x56342ee0bb90 2023-10-06T02:19:14.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fce96ffd700 1 -- 172.21.15.6:0/965764999 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea8057850 con 0x56342ee0bb90 2023-10-06T02:19:14.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fce96ffd700 1 -- 172.21.15.6:0/965764999 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcea0016660 con 0x56342ee0bb90 2023-10-06T02:19:14.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fcec829ab80 10 client.5469 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T02:19:14.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fcec829ab80 10 client.5469 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:19:14.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fcec829ab80 20 client.5469 populate_metadata read hostname 'smithi006' 2023-10-06T02:19:14.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fcec829ab80 1 --2- 172.21.15.6:0/965764999 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x56342edc24a0 0x56342edc2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:14.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fcec829ab80 4 client.5469 mds_command: new command op to 5385 tid=0[{"prefix": "damage ls", "format": "json-pretty"}] 2023-10-06T02:19:14.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.134+0000 7fcec829ab80 1 -- 172.21.15.6:0/965764999 --> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x56342ecb4ea0 con 0x56342edc24a0 2023-10-06T02:19:14.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fcebcd3e700 1 --2- 172.21.15.6:0/965764999 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x56342edc24a0 0x56342edc2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:14.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fce96ffd700 10 client.5469 ms_handle_connect on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:14.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fcebcd3e700 1 --2- 172.21.15.6:0/965764999 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x56342edc24a0 0x56342edc2870 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=641f9b5d9da57079 server_cookie=13cff5ef24f6ba0f in_seq=0 out_seq=0 2023-10-06T02:19:14.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fce96ffd700 1 -- 172.21.15.6:0/965764999 <== mds.0 v2:172.21.15.6:6832/1188971598 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+237 (crc 0 0 0) 0x56342ecb4ea0 con 0x56342edc24a0 2023-10-06T02:19:14.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fce96ffd700 10 client.5469 handle_command_reply: tid=0 2023-10-06T02:19:14.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fcec829ab80 1 client.5469 shutdown 2023-10-06T02:19:14.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fcec829ab80 1 -- 172.21.15.6:0/965764999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 msgr2=0x56342ee1d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:14.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fcec829ab80 1 --2- 172.21.15.6:0/965764999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342ee1d7b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fceb80c8ee0 tx=0x7fcea0017000 comp rx=0 tx=0).stop 2023-10-06T02:19:14.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fcec829ab80 1 -- 172.21.15.6:0/965764999 shutdown_connections 2023-10-06T02:19:14.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fcec829ab80 1 --2- 172.21.15.6:0/965764999 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x56342edc24a0 0x56342edc2870 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fcec829ab80 1 --2- 172.21.15.6:0/965764999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56342ee0bb90 0x56342ee1d7b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fcec829ab80 1 --2- 172.21.15.6:0/965764999 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56342edc1c50 0x56342edeb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fce96ffd700 0 client.5469 ms_handle_reset on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:14.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fcec829ab80 1 --2- 172.21.15.6:0/965764999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56342edee2c0 0x56342ee5a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fcec829ab80 1 -- 172.21.15.6:0/965764999 >> 172.21.15.6:0/965764999 conn(0x56342edc3200 msgr2=0x56342ee03040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:14.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fcec829ab80 1 -- 172.21.15.6:0/965764999 shutdown_connections 2023-10-06T02:19:14.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fcec829ab80 1 -- 172.21.15.6:0/965764999 wait complete. 2023-10-06T02:19:14.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.135+0000 7fcec829ab80 20 client.5469 trim_cache size 0 max 16384 2023-10-06T02:19:14.145 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:19:14.146 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-06T02:19:14.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:19:14.146 INFO:teuthology.orchestra.run.smithi006.stdout: "damage_type": "dentry", 2023-10-06T02:19:14.146 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 2747863959, 2023-10-06T02:19:14.146 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 1099511627776, 2023-10-06T02:19:14.146 INFO:teuthology.orchestra.run.smithi006.stdout: "frag": "*", 2023-10-06T02:19:14.146 INFO:teuthology.orchestra.run.smithi006.stdout: "dname": "file_to_be_damaged", 2023-10-06T02:19:14.146 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_id": "head", 2023-10-06T02:19:14.146 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/subdir/file_to_be_damaged" 2023-10-06T02:19:14.147 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:19:14.147 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-06T02:19:14.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.136+0000 7fcebefa2700 1 -- 172.21.15.6:0/90206569 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce98066f30 msgr2=0x7fce980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:14.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.136+0000 7fcebefa2700 1 --2- 172.21.15.6:0/90206569 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce98066f30 0x7fce980693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fceb0007bc0 tx=0x7fceb0009040 comp rx=0 tx=0).stop 2023-10-06T02:19:14.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.136+0000 7fcebefa2700 1 -- 172.21.15.6:0/90206569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb8154600 msgr2=0x7fceb814d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:14.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.136+0000 7fcebefa2700 1 --2- 172.21.15.6:0/90206569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb8154600 0x7fceb814d670 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcea40057f0 tx=0x7fcea801a000 comp rx=0 tx=0).stop 2023-10-06T02:19:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.136+0000 7fcebefa2700 1 -- 172.21.15.6:0/90206569 shutdown_connections 2023-10-06T02:19:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.136+0000 7fcebefa2700 1 --2- 172.21.15.6:0/90206569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fceb80b08c0 0x7fceb81501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.136+0000 7fcebefa2700 1 --2- 172.21.15.6:0/90206569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcea4004810 0x7fceb8167b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.136+0000 7fcebefa2700 1 --2- 172.21.15.6:0/90206569 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce98066f30 0x7fce980693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.136+0000 7fcebefa2700 1 --2- 172.21.15.6:0/90206569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb8154600 0x7fceb814d670 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.136+0000 7fcebefa2700 1 -- 172.21.15.6:0/90206569 >> 172.21.15.6:0/90206569 conn(0x7fceb806a260 msgr2=0x7fceb8155e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.136+0000 7fcebefa2700 1 -- 172.21.15.6:0/90206569 shutdown_connections 2023-10-06T02:19:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:14.136+0000 7fcebefa2700 1 -- 172.21.15.6:0/90206569 wait complete. 2023-10-06T02:19:14.150 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:19:14.150 DEBUG:teuthology.orchestra.run.smithi006:> import sys 2023-10-06T02:19:14.150 DEBUG:teuthology.orchestra.run.smithi006:> import errno 2023-10-06T02:19:14.150 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:19:14.150 DEBUG:teuthology.orchestra.run.smithi006:> try: 2023-10-06T02:19:14.150 DEBUG:teuthology.orchestra.run.smithi006:> f = open("/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged", "w") 2023-10-06T02:19:14.150 DEBUG:teuthology.orchestra.run.smithi006:> f.close() 2023-10-06T02:19:14.150 DEBUG:teuthology.orchestra.run.smithi006:> except IOError as e: 2023-10-06T02:19:14.150 DEBUG:teuthology.orchestra.run.smithi006:> sys.exit(errno.EIO) 2023-10-06T02:19:14.150 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:19:14.399 INFO:teuthology.orchestra.run.smithi006.stderr:daemon-helper: command failed with exit status 5 2023-10-06T02:19:14.404 DEBUG:teuthology.orchestra.run:got remote process result: 5 2023-10-06T02:19:14.405 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:19:14.405 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:19:14.405 DEBUG:teuthology.orchestra.run.smithi006:> import stat 2023-10-06T02:19:14.405 DEBUG:teuthology.orchestra.run.smithi006:> import json 2023-10-06T02:19:14.405 DEBUG:teuthology.orchestra.run.smithi006:> import sys 2023-10-06T02:19:14.405 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:19:14.406 DEBUG:teuthology.orchestra.run.smithi006:> try: 2023-10-06T02:19:14.406 DEBUG:teuthology.orchestra.run.smithi006:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2023-10-06T02:19:14.406 DEBUG:teuthology.orchestra.run.smithi006:> except OSError as e: 2023-10-06T02:19:14.406 DEBUG:teuthology.orchestra.run.smithi006:> sys.exit(e.errno) 2023-10-06T02:19:14.406 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:19:14.407 DEBUG:teuthology.orchestra.run.smithi006:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-10-06T02:19:14.407 DEBUG:teuthology.orchestra.run.smithi006:> print(json.dumps( 2023-10-06T02:19:14.407 DEBUG:teuthology.orchestra.run.smithi006:> dict([(a, getattr(s, a)) for a in attrs]), 2023-10-06T02:19:14.407 DEBUG:teuthology.orchestra.run.smithi006:> indent=2)) 2023-10-06T02:19:14.407 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:19:14.694 INFO:teuthology.orchestra.run.smithi006.stderr:daemon-helper: command failed with exit status 5 2023-10-06T02:19:14.699 DEBUG:teuthology.orchestra.run:got remote process result: 5 2023-10-06T02:19:14.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:19:14.700 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2023-10-06T02:19:14.757 INFO:teuthology.orchestra.run.smithi006.stdout:2 2023-10-06T02:19:14.758 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:19:14.758 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:19:14.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:19:14.832 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[107129]: fuse finished with error 0 and tester_r 0 2023-10-06T02:19:14.833 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:19:16.894 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:19:16.894+0000 7fc34f931700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-06T02:19:19.211 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:19:19.213 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:19:20.935 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:19:20.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:20.935 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:19:20.955 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub start /subdir repair 2023-10-06T02:19:21.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.131+0000 7f05eec3b700 1 Processor -- start 2023-10-06T02:19:21.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.131+0000 7f05eec3b700 1 -- start start 2023-10-06T02:19:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.132+0000 7f05eec3b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f05e81598b0 0x7f05e80afef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.132+0000 7f05eec3b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05e815b940 0x7f05e8159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.132+0000 7f05eec3b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e80afa60 con 0x7f05e80b0430 2023-10-06T02:19:21.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.132+0000 7f05eec3b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e80af440 con 0x7f05e815b940 2023-10-06T02:19:21.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.132+0000 7f05eec3b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e815ab00 con 0x7f05e81598b0 2023-10-06T02:19:21.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.132+0000 7f05ed1d8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05e815b940 0x7f05e8159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.132+0000 7f05ed1d8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05e815b940 0x7f05e8159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49158/0 (socket says 172.21.15.6:49158) 2023-10-06T02:19:21.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.132+0000 7f05ed1d8700 1 -- 172.21.15.6:0/199699276 learned_addr learned my addr 172.21.15.6:0/199699276 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:21.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.132+0000 7f05ec9d7700 1 --2- 172.21.15.6:0/199699276 >> v2:172.21.15.175:3300/0 conn(0x7f05e81598b0 0x7f05e80afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.132+0000 7f05ed1d8700 1 -- 172.21.15.6:0/199699276 >> v2:172.21.15.175:3300/0 conn(0x7f05e81598b0 msgr2=0x7f05e80afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:21.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.132+0000 7f05ed1d8700 1 --2- 172.21.15.6:0/199699276 >> v2:172.21.15.175:3300/0 conn(0x7f05e81598b0 0x7f05e80afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.132+0000 7f05ed1d8700 1 -- 172.21.15.6:0/199699276 >> v1:172.21.15.175:6789/0 conn(0x7f05e80b0430 legacy=0x7f05e815b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.132+0000 7f05ed1d8700 1 -- 172.21.15.6:0/199699276 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e815ade0 con 0x7f05e815b940 2023-10-06T02:19:21.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.132+0000 7f05ec9d7700 1 --2- 172.21.15.6:0/199699276 >> v2:172.21.15.175:3300/0 conn(0x7f05e81598b0 0x7f05e80afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:21.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.133+0000 7f05ed1d8700 1 --2- 172.21.15.6:0/199699276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e815b940 0x7f05e8159c80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f05e80b0b80 tx=0x7f05e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64b5f8ee3b2e694 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:21.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.133+0000 7f05e77fe700 1 -- 172.21.15.6:0/199699276 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e000e070 con 0x7f05e815b940 2023-10-06T02:19:21.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.133+0000 7f05e77fe700 1 -- 172.21.15.6:0/199699276 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e000ba50 con 0x7f05e815b940 2023-10-06T02:19:21.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.133+0000 7f05e77fe700 1 -- 172.21.15.6:0/199699276 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e00092e0 con 0x7f05e815b940 2023-10-06T02:19:21.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.133+0000 7f05eec3b700 1 -- 172.21.15.6:0/199699276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e815b940 msgr2=0x7f05e8159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.133+0000 7f05eec3b700 1 --2- 172.21.15.6:0/199699276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e815b940 0x7f05e8159c80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f05e80b0b80 tx=0x7f05e0009840 comp rx=0 tx=0).stop 2023-10-06T02:19:21.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.133+0000 7f05eec3b700 1 -- 172.21.15.6:0/199699276 shutdown_connections 2023-10-06T02:19:21.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.133+0000 7f05eec3b700 1 --2- 172.21.15.6:0/199699276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e815b940 0x7f05e8159c80 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.133+0000 7f05eec3b700 1 --2- 172.21.15.6:0/199699276 >> v2:172.21.15.175:3300/0 conn(0x7f05e81598b0 0x7f05e80afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.133+0000 7f05eec3b700 1 -- 172.21.15.6:0/199699276 >> 172.21.15.6:0/199699276 conn(0x7f05e8067910 msgr2=0x7f05e80ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:21.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.133+0000 7f05eec3b700 1 -- 172.21.15.6:0/199699276 shutdown_connections 2023-10-06T02:19:21.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.133+0000 7f05eec3b700 1 -- 172.21.15.6:0/199699276 wait complete. 2023-10-06T02:19:21.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.135+0000 7f05eec3b700 1 Processor -- start 2023-10-06T02:19:21.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.135+0000 7f05eec3b700 1 -- start start 2023-10-06T02:19:21.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.135+0000 7f05eec3b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05e80b0430 0x7f05e8155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.135+0000 7f05eec3b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05e81598b0 0x7f05e809a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.135+0000 7f05eec3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e815b940 0x7f05e8158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.135+0000 7f05eec3b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e816de00 con 0x7f05e815b940 2023-10-06T02:19:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.135+0000 7f05eec3b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e816d180 con 0x7f05e81598b0 2023-10-06T02:19:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05eec3b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e816d460 con 0x7f05e80b0430 2023-10-06T02:19:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05ed1d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e815b940 0x7f05e8158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05ed1d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e815b940 0x7f05e8158210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49172/0 (socket says 172.21.15.6:49172) 2023-10-06T02:19:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05ed1d8700 1 -- 172.21.15.6:0/2064216439 learned_addr learned my addr 172.21.15.6:0/2064216439 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05ec9d7700 1 --2- 172.21.15.6:0/2064216439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05e80b0430 0x7f05e8155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05e7fff700 1 --2- 172.21.15.6:0/2064216439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05e81598b0 0x7f05e809a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05ed1d8700 1 -- 172.21.15.6:0/2064216439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05e80b0430 msgr2=0x7f05e8155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05ed1d8700 1 --2- 172.21.15.6:0/2064216439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05e80b0430 0x7f05e8155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05ed1d8700 1 -- 172.21.15.6:0/2064216439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05e81598b0 msgr2=0x7f05e809a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05ed1d8700 1 --2- 172.21.15.6:0/2064216439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05e81598b0 0x7f05e809a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05ed1d8700 1 -- 172.21.15.6:0/2064216439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e0009ae0 con 0x7f05e815b940 2023-10-06T02:19:21.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05e7fff700 1 --2- 172.21.15.6:0/2064216439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05e81598b0 0x7f05e809a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:21.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05ec9d7700 1 --2- 172.21.15.6:0/2064216439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05e80b0430 0x7f05e8155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:21.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05ed1d8700 1 --2- 172.21.15.6:0/2064216439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e815b940 0x7f05e8158210 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f05e0012000 tx=0x7f05e0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:21.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05e4ff9700 1 -- 172.21.15.6:0/2064216439 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e000be60 con 0x7f05e815b940 2023-10-06T02:19:21.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05e4ff9700 1 -- 172.21.15.6:0/2064216439 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e0008e20 con 0x7f05e815b940 2023-10-06T02:19:21.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05eec3b700 1 -- 172.21.15.6:0/2064216439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e816d740 con 0x7f05e815b940 2023-10-06T02:19:21.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05e4ff9700 1 -- 172.21.15.6:0/2064216439 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e00266b0 con 0x7f05e815b940 2023-10-06T02:19:21.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.136+0000 7f05eec3b700 1 -- 172.21.15.6:0/2064216439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e809b810 con 0x7f05e815b940 2023-10-06T02:19:21.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.138+0000 7f05e4ff9700 1 -- 172.21.15.6:0/2064216439 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05e0003040 con 0x7f05e815b940 2023-10-06T02:19:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.138+0000 7f05e4ff9700 1 --2- 172.21.15.6:0/2064216439 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f05c8066f30 0x7f05c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.139+0000 7f05e4ff9700 1 -- 172.21.15.6:0/2064216439 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f05e00868e0 con 0x7f05e815b940 2023-10-06T02:19:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.139+0000 7f05ec9d7700 1 --2- 172.21.15.6:0/2064216439 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f05c8066f30 0x7f05c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.139+0000 7f05ec9d7700 1 --2- 172.21.15.6:0/2064216439 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f05c8066f30 0x7f05c80693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f05d0006ea0 tx=0x7f05d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.140+0000 7f05f7f33b80 1 Processor -- start 2023-10-06T02:19:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.140+0000 7f05f7f33b80 1 -- start start 2023-10-06T02:19:21.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.141+0000 7f05f7f33b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b94ffe900 0x555b94ffecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.141+0000 7f05f7f33b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94fffd80 0x555b9504e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.141+0000 7f05f7f33b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b9504ecc0 0x555b9504f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.141+0000 7f05f7f33b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b94f55b30 con 0x555b9504ecc0 2023-10-06T02:19:21.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.141+0000 7f05f7f33b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b94f53330 con 0x555b94fffd80 2023-10-06T02:19:21.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.141+0000 7f05f7f33b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b94f4f120 con 0x555b94ffe900 2023-10-06T02:19:21.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.141+0000 7f05ed1d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b9504ecc0 0x555b9504f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.141+0000 7f05ed1d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b9504ecc0 0x555b9504f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49178/0 (socket says 172.21.15.6:49178) 2023-10-06T02:19:21.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.141+0000 7f05ed1d8700 1 -- 172.21.15.6:0/3930389083 learned_addr learned my addr 172.21.15.6:0/3930389083 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:21.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.141+0000 7f05e7fff700 1 --2- 172.21.15.6:0/3930389083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94fffd80 0x555b9504e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.141+0000 7f05ec9d7700 1 --2- 172.21.15.6:0/3930389083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b94ffe900 0x555b94ffecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.141+0000 7f05ed1d8700 1 -- 172.21.15.6:0/3930389083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b94ffe900 msgr2=0x555b94ffecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:21.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.141+0000 7f05ed1d8700 1 --2- 172.21.15.6:0/3930389083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b94ffe900 0x555b94ffecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.141+0000 7f05ed1d8700 1 -- 172.21.15.6:0/3930389083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94fffd80 msgr2=0x555b9504e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:21.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.141+0000 7f05ed1d8700 1 --2- 172.21.15.6:0/3930389083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94fffd80 0x555b9504e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.141+0000 7f05ed1d8700 1 -- 172.21.15.6:0/3930389083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b94de9330 con 0x555b9504ecc0 2023-10-06T02:19:21.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.141+0000 7f05e7fff700 1 --2- 172.21.15.6:0/3930389083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94fffd80 0x555b9504e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:21.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.142+0000 7f05ed1d8700 1 --2- 172.21.15.6:0/3930389083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b9504ecc0 0x555b9504f110 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f05e002c030 tx=0x7f05e00849f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6545eb3a0dca6b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:21.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.142+0000 7f05ddffb700 1 -- 172.21.15.6:0/3930389083 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e000e040 con 0x555b9504ecc0 2023-10-06T02:19:21.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.142+0000 7f05ddffb700 1 -- 172.21.15.6:0/3930389083 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e00574a0 con 0x555b9504ecc0 2023-10-06T02:19:21.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.142+0000 7f05ddffb700 1 -- 172.21.15.6:0/3930389083 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e005a6f0 con 0x555b9504ecc0 2023-10-06T02:19:21.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.142+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3930389083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b9504ecc0 msgr2=0x555b9504f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.142+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/3930389083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b9504ecc0 0x555b9504f110 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f05e002c030 tx=0x7f05e00849f0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.142+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3930389083 shutdown_connections 2023-10-06T02:19:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.142+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/3930389083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b9504ecc0 0x555b9504f110 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.142+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/3930389083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b94ffe900 0x555b94ffecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.142+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/3930389083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94fffd80 0x555b9504e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.142+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3930389083 >> 172.21.15.6:0/3930389083 conn(0x555b95000220 msgr2=0x555b950005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:21.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.142+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3930389083 shutdown_connections 2023-10-06T02:19:21.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.142+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3930389083 wait complete. 2023-10-06T02:19:21.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.143+0000 7f05f7f33b80 1 -- start start 2023-10-06T02:19:21.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.143+0000 7f05f7f33b80 1 Processor -- start 2023-10-06T02:19:21.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05f7f33b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94ffe900 0x555b95042bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05f7f33b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94fffd80 0x555b9503d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05f7f33b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b9504ecc0 0x555b95040080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05f7f33b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b94efa950 con 0x555b94ffe900 2023-10-06T02:19:21.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05f7f33b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b94f15f60 con 0x555b94fffd80 2023-10-06T02:19:21.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05f7f33b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b94dd1ef0 con 0x555b9504ecc0 2023-10-06T02:19:21.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05f7f33b80 10 client.0 _ll_register_callbacks cb 0x555b94fc1f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:19:21.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05ec9d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94ffe900 0x555b95042bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05ec9d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94ffe900 0x555b95042bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49190/0 (socket says 172.21.15.6:49190) 2023-10-06T02:19:21.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05ec9d7700 1 -- 172.21.15.6:0/3855082315 learned_addr learned my addr 172.21.15.6:0/3855082315 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:21.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05e7fff700 1 --2- 172.21.15.6:0/3855082315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94fffd80 0x555b9503d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05ed1d8700 1 --2- 172.21.15.6:0/3855082315 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b9504ecc0 0x555b95040080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05ec9d7700 1 -- 172.21.15.6:0/3855082315 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b9504ecc0 msgr2=0x555b95040080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:21.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05ec9d7700 1 --2- 172.21.15.6:0/3855082315 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b9504ecc0 0x555b95040080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05ec9d7700 1 -- 172.21.15.6:0/3855082315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94fffd80 msgr2=0x555b9503d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:21.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05ec9d7700 1 --2- 172.21.15.6:0/3855082315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94fffd80 0x555b9503d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05ec9d7700 1 -- 172.21.15.6:0/3855082315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e809b810 con 0x555b94ffe900 2023-10-06T02:19:21.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05e7fff700 1 --2- 172.21.15.6:0/3855082315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94fffd80 0x555b9503d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:21.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.144+0000 7f05ed1d8700 1 --2- 172.21.15.6:0/3855082315 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b9504ecc0 0x555b95040080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:21.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.145+0000 7f05ec9d7700 1 --2- 172.21.15.6:0/3855082315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94ffe900 0x555b95042bd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f05d0014810 tx=0x7f05d0018040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2924ef394b17fefa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:21.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.145+0000 7f05c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:19:21.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.145+0000 7f05c6ffd700 1 -- 172.21.15.6:0/3855082315 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d000f840 con 0x555b94ffe900 2023-10-06T02:19:21.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.145+0000 7f05c6ffd700 1 -- 172.21.15.6:0/3855082315 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f05d0005a00 con 0x555b94ffe900 2023-10-06T02:19:21.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.145+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3855082315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555b94ff3a00 con 0x555b94ffe900 2023-10-06T02:19:21.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.145+0000 7f05c6ffd700 1 -- 172.21.15.6:0/3855082315 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05d0005e10 con 0x555b94ffe900 2023-10-06T02:19:21.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.145+0000 7f05f7f33b80 10 client.5481 fetch_fsmap learned FSMap version 24 2023-10-06T02:19:21.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.145+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3855082315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x555b94d8c0a0 con 0x555b94ffe900 2023-10-06T02:19:21.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.145+0000 7f05c6ffd700 1 -- 172.21.15.6:0/3855082315 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555b94ff3a00 con 0x555b94ffe900 2023-10-06T02:19:21.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.145+0000 7f05c6ffd700 1 -- 172.21.15.6:0/3855082315 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f05d00157a0 con 0x555b94ffe900 2023-10-06T02:19:21.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.145+0000 7f05f7f33b80 10 client.5481 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:19:21.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.145+0000 7f05f7f33b80 10 client.5481 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-10-06T02:19:21.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.145+0000 7f05f7f33b80 20 client.5481 populate_metadata read hostname 'smithi006' 2023-10-06T02:19:21.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.145+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/3855082315 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x555b9503f550 0x555b95058470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.145+0000 7f05f7f33b80 4 client.5481 mds_command: new command op to 5385 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:19:21.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.145+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3855082315 --> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555b94fd0930 con 0x555b9503f550 2023-10-06T02:19:21.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.145+0000 7f05e7fff700 1 --2- 172.21.15.6:0/3855082315 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x555b9503f550 0x555b95058470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.146+0000 7f05c6ffd700 10 client.5481 ms_handle_connect on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:21.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.146+0000 7f05e7fff700 1 --2- 172.21.15.6:0/3855082315 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x555b9503f550 0x555b95058470 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73ee259760152374 server_cookie=fa782882e37a91ec in_seq=0 out_seq=0 2023-10-06T02:19:21.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.146+0000 7f05c6ffd700 1 -- 172.21.15.6:0/3855082315 <== mds.0 v2:172.21.15.6:6832/1188971598 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x555b94fd0930 con 0x555b9503f550 2023-10-06T02:19:21.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.146+0000 7f05c6ffd700 10 client.5481 handle_command_reply: tid=0 2023-10-06T02:19:21.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.146+0000 7f05f7f33b80 1 client.5481 shutdown 2023-10-06T02:19:21.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.146+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3855082315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94ffe900 msgr2=0x555b95042bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.146+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/3855082315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94ffe900 0x555b95042bd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f05d0014810 tx=0x7f05d0018040 comp rx=0 tx=0).stop 2023-10-06T02:19:21.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.146+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3855082315 shutdown_connections 2023-10-06T02:19:21.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.146+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/3855082315 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x555b9503f550 0x555b95058470 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.147+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/3855082315 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b9504ecc0 0x555b95040080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.147+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/3855082315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94ffe900 0x555b95042bd0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.147+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/3855082315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94fffd80 0x555b9503d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.147+0000 7f05c6ffd700 0 client.5481 ms_handle_reset on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:21.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.147+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3855082315 >> 172.21.15.6:0/3855082315 conn(0x555b95000220 msgr2=0x555b94fff270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:21.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.147+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3855082315 shutdown_connections 2023-10-06T02:19:21.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.147+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3855082315 wait complete. 2023-10-06T02:19:21.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.147+0000 7f05f7f33b80 20 client.5481 trim_cache size 0 max 16384 2023-10-06T02:19:21.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.163+0000 7f05f7f33b80 1 Processor -- start 2023-10-06T02:19:21.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.163+0000 7f05f7f33b80 1 -- start start 2023-10-06T02:19:21.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.164+0000 7f05f7f33b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94ffe900 0x555b950446a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.164+0000 7f05f7f33b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94fffd80 0x555b950005f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.164+0000 7f05f7f33b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b9504ecc0 0x555b95000b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.164+0000 7f05f7f33b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b950439e0 con 0x555b94fffd80 2023-10-06T02:19:21.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.164+0000 7f05f7f33b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b94fde3a0 con 0x555b94ffe900 2023-10-06T02:19:21.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.164+0000 7f05f7f33b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b94fffbf0 con 0x555b9504ecc0 2023-10-06T02:19:21.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.164+0000 7f05e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94fffd80 0x555b950005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.164+0000 7f05e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94fffd80 0x555b950005f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49192/0 (socket says 172.21.15.6:49192) 2023-10-06T02:19:21.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.164+0000 7f05e7fff700 1 -- 172.21.15.6:0/2640737600 learned_addr learned my addr 172.21.15.6:0/2640737600 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:21.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.164+0000 7f05ec9d7700 1 --2- 172.21.15.6:0/2640737600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94ffe900 0x555b950446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.164+0000 7f05ed1d8700 1 --2- 172.21.15.6:0/2640737600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b9504ecc0 0x555b95000b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.164+0000 7f05e7fff700 1 -- 172.21.15.6:0/2640737600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b9504ecc0 msgr2=0x555b95000b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:21.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.164+0000 7f05e7fff700 1 --2- 172.21.15.6:0/2640737600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b9504ecc0 0x555b95000b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.164+0000 7f05e7fff700 1 -- 172.21.15.6:0/2640737600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94ffe900 msgr2=0x555b950446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:21.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.164+0000 7f05e7fff700 1 --2- 172.21.15.6:0/2640737600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94ffe900 0x555b950446a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.164+0000 7f05e7fff700 1 -- 172.21.15.6:0/2640737600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b94f1d840 con 0x555b94fffd80 2023-10-06T02:19:21.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.164+0000 7f05e7fff700 1 --2- 172.21.15.6:0/2640737600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94fffd80 0x555b950005f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f05e809b3d0 tx=0x7f05d801c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13112b2b4c0e1249 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:21.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.165+0000 7f05de7fc700 1 -- 172.21.15.6:0/2640737600 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d801aa70 con 0x555b94fffd80 2023-10-06T02:19:21.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.165+0000 7f05de7fc700 1 -- 172.21.15.6:0/2640737600 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d801abd0 con 0x555b94fffd80 2023-10-06T02:19:21.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.165+0000 7f05de7fc700 1 -- 172.21.15.6:0/2640737600 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d801ad40 con 0x555b94fffd80 2023-10-06T02:19:21.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.165+0000 7f05f7f33b80 1 -- 172.21.15.6:0/2640737600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94fffd80 msgr2=0x555b950005f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.165+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/2640737600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94fffd80 0x555b950005f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f05e809b3d0 tx=0x7f05d801c040 comp rx=0 tx=0).stop 2023-10-06T02:19:21.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.165+0000 7f05f7f33b80 1 -- 172.21.15.6:0/2640737600 shutdown_connections 2023-10-06T02:19:21.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.165+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/2640737600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b9504ecc0 0x555b95000b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.165+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/2640737600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94ffe900 0x555b950446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.165+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/2640737600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94fffd80 0x555b950005f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.165+0000 7f05f7f33b80 1 -- 172.21.15.6:0/2640737600 >> 172.21.15.6:0/2640737600 conn(0x555b95000220 msgr2=0x555b95041ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:21.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.165+0000 7f05f7f33b80 1 -- 172.21.15.6:0/2640737600 shutdown_connections 2023-10-06T02:19:21.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.165+0000 7f05f7f33b80 1 -- 172.21.15.6:0/2640737600 wait complete. 2023-10-06T02:19:21.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.166+0000 7f05f7f33b80 1 -- start start 2023-10-06T02:19:21.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.166+0000 7f05f7f33b80 1 Processor -- start 2023-10-06T02:19:21.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05f7f33b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94ffe900 0x555b9503fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05f7f33b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94fffd80 0x555b95048fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05f7f33b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b9504ecc0 0x555b950aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05f7f33b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b9503c1c0 con 0x555b94ffe900 2023-10-06T02:19:21.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05f7f33b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b950acd90 con 0x555b94fffd80 2023-10-06T02:19:21.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05f7f33b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b95040290 con 0x555b9504ecc0 2023-10-06T02:19:21.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05f7f33b80 10 client.0 _ll_register_callbacks cb 0x555b94fc1f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:19:21.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05ec9d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94ffe900 0x555b9503fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05ec9d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94ffe900 0x555b9503fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49208/0 (socket says 172.21.15.6:49208) 2023-10-06T02:19:21.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05ec9d7700 1 -- 172.21.15.6:0/3273807801 learned_addr learned my addr 172.21.15.6:0/3273807801 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05e7fff700 1 --2- 172.21.15.6:0/3273807801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94fffd80 0x555b95048fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05ed1d8700 1 --2- 172.21.15.6:0/3273807801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b9504ecc0 0x555b950aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05ec9d7700 1 -- 172.21.15.6:0/3273807801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b9504ecc0 msgr2=0x555b950aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05ec9d7700 1 --2- 172.21.15.6:0/3273807801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b9504ecc0 0x555b950aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05ec9d7700 1 -- 172.21.15.6:0/3273807801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94fffd80 msgr2=0x555b95048fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05ec9d7700 1 --2- 172.21.15.6:0/3273807801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94fffd80 0x555b95048fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05ec9d7700 1 -- 172.21.15.6:0/3273807801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d800f040 con 0x555b94ffe900 2023-10-06T02:19:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05ed1d8700 1 --2- 172.21.15.6:0/3273807801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b9504ecc0 0x555b950aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:21.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05ec9d7700 1 --2- 172.21.15.6:0/3273807801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94ffe900 0x555b9503fd50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f05d002a040 tx=0x7f05d0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d8692c506091c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:21.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:19:21.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05c6ffd700 1 -- 172.21.15.6:0/3273807801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0015cb0 con 0x555b94ffe900 2023-10-06T02:19:21.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05c6ffd700 1 -- 172.21.15.6:0/3273807801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f05d0007380 con 0x555b94ffe900 2023-10-06T02:19:21.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.167+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3273807801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05e00574a0 con 0x555b94ffe900 2023-10-06T02:19:21.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.168+0000 7f05c6ffd700 1 -- 172.21.15.6:0/3273807801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05d0005a00 con 0x555b94ffe900 2023-10-06T02:19:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.168+0000 7f05f7f33b80 10 client.5487 fetch_fsmap learned FSMap version 24 2023-10-06T02:19:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.168+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3273807801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x555b94f04530 con 0x555b94ffe900 2023-10-06T02:19:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.168+0000 7f05c6ffd700 1 -- 172.21.15.6:0/3273807801 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e00574a0 con 0x555b94ffe900 2023-10-06T02:19:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.168+0000 7f05c6ffd700 1 -- 172.21.15.6:0/3273807801 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f05d0006750 con 0x555b94ffe900 2023-10-06T02:19:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.168+0000 7f05f7f33b80 10 client.5487 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:19:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.168+0000 7f05f7f33b80 10 client.5487 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-10-06T02:19:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.168+0000 7f05f7f33b80 20 client.5487 populate_metadata read hostname 'smithi006' 2023-10-06T02:19:21.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.168+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/3273807801 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x555b950af3d0 0x555b950af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.168+0000 7f05f7f33b80 4 client.5487 mds_command: new command op to 5385 tid=0[{"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair"]}] 2023-10-06T02:19:21.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.168+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3273807801 --> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair"]}) v1 -- 0x555b94ef1ec0 con 0x555b950af3d0 2023-10-06T02:19:21.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.168+0000 7f05e7fff700 1 --2- 172.21.15.6:0/3273807801 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x555b950af3d0 0x555b950af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.168+0000 7f05c6ffd700 10 client.5487 ms_handle_connect on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:21.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.168+0000 7f05e7fff700 1 --2- 172.21.15.6:0/3273807801 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x555b950af3d0 0x555b950af7d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db61f9300cd90965 server_cookie=71eb1a1cbc54207b in_seq=0 out_seq=0 2023-10-06T02:19:21.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.169+0000 7f05c6ffd700 1 -- 172.21.15.6:0/3273807801 <== mds.0 v2:172.21.15.6:6832/1188971598 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555b94ef1ec0 con 0x555b950af3d0 2023-10-06T02:19:21.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.169+0000 7f05c6ffd700 10 client.5487 handle_command_reply: tid=0 2023-10-06T02:19:21.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.169+0000 7f05f7f33b80 1 client.5487 shutdown 2023-10-06T02:19:21.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.169+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3273807801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94ffe900 msgr2=0x555b9503fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.169+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/3273807801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94ffe900 0x555b9503fd50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f05d002a040 tx=0x7f05d0021000 comp rx=0 tx=0).stop 2023-10-06T02:19:21.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.169+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3273807801 shutdown_connections 2023-10-06T02:19:21.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.169+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/3273807801 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x555b950af3d0 0x555b950af7d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.169+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/3273807801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555b9504ecc0 0x555b950aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.169+0000 7f05c6ffd700 0 client.5487 ms_handle_reset on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:21.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.169+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/3273807801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b94ffe900 0x555b9503fd50 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.169+0000 7f05f7f33b80 1 --2- 172.21.15.6:0/3273807801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b94fffd80 0x555b95048fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.169+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3273807801 >> 172.21.15.6:0/3273807801 conn(0x555b95000220 msgr2=0x555b950a1270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:21.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.169+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3273807801 shutdown_connections 2023-10-06T02:19:21.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.169+0000 7f05f7f33b80 1 -- 172.21.15.6:0/3273807801 wait complete. 2023-10-06T02:19:21.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.170+0000 7f05f7f33b80 20 client.5487 trim_cache size 0 max 16384 2023-10-06T02:19:21.184 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:19:21.184 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-10-06T02:19:21.184 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "47bb7c69-9340-4902-8ca2-c94504664620", 2023-10-06T02:19:21.184 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-10-06T02:19:21.184 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:19:21.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.170+0000 7f05eec3b700 1 -- 172.21.15.6:0/2064216439 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f05c8066f30 msgr2=0x7f05c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.170+0000 7f05eec3b700 1 --2- 172.21.15.6:0/2064216439 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f05c8066f30 0x7f05c80693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f05d0006ea0 tx=0x7f05d0008040 comp rx=0 tx=0).stop 2023-10-06T02:19:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.170+0000 7f05eec3b700 1 -- 172.21.15.6:0/2064216439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e815b940 msgr2=0x7f05e8158210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.170+0000 7f05eec3b700 1 --2- 172.21.15.6:0/2064216439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e815b940 0x7f05e8158210 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f05e0012000 tx=0x7f05e0018000 comp rx=0 tx=0).stop 2023-10-06T02:19:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.170+0000 7f05eec3b700 1 -- 172.21.15.6:0/2064216439 shutdown_connections 2023-10-06T02:19:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.170+0000 7f05eec3b700 1 --2- 172.21.15.6:0/2064216439 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f05c8066f30 0x7f05c80693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.170+0000 7f05eec3b700 1 --2- 172.21.15.6:0/2064216439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e815b940 0x7f05e8158210 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.170+0000 7f05eec3b700 1 --2- 172.21.15.6:0/2064216439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05e80b0430 0x7f05e8155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.170+0000 7f05eec3b700 1 --2- 172.21.15.6:0/2064216439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05e81598b0 0x7f05e809a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.170+0000 7f05eec3b700 1 -- 172.21.15.6:0/2064216439 >> 172.21.15.6:0/2064216439 conn(0x7f05e8067910 msgr2=0x7f05e806c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:21.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.170+0000 7f05eec3b700 1 -- 172.21.15.6:0/2064216439 shutdown_connections 2023-10-06T02:19:21.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.170+0000 7f05eec3b700 1 -- 172.21.15.6:0/2064216439 wait complete. 2023-10-06T02:19:21.188 INFO:tasks.cephfs.test_damage:{ "return_code": 0, "scrub_tag": "47bb7c69-9340-4902-8ca2-c94504664620", "mode": "asynchronous" } 2023-10-06T02:19:21.188 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub status 2023-10-06T02:19:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.312+0000 7fa9943f6700 1 Processor -- start 2023-10-06T02:19:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.313+0000 7fa9943f6700 1 -- start start 2023-10-06T02:19:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.313+0000 7fa9943f6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa98c0ccd40 0x7fa98c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.313+0000 7fa9943f6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98c15dd40 con 0x7fa98c0cf7e0 2023-10-06T02:19:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.313+0000 7fa9943f6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98c15e020 con 0x7fa98c0d0400 2023-10-06T02:19:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.313+0000 7fa9943f6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98c0ceaa0 con 0x7fa98c0ccd40 2023-10-06T02:19:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.314+0000 7fa991991700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa98c0ccd40 0x7fa98c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.314+0000 7fa992993700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa98c0cf7e0 0x7fa98c0b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49870/0 (socket says 172.21.15.6:49870) 2023-10-06T02:19:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.314+0000 7fa991991700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa98c0ccd40 0x7fa98c0cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49222/0 (socket says 172.21.15.6:49222) 2023-10-06T02:19:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.314+0000 7fa992993700 1 -- 172.21.15.6:0/1215875695 learned_addr learned my addr 172.21.15.6:0/1215875695 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:19:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.314+0000 7fa991991700 1 -- 172.21.15.6:0/1215875695 >> v1:172.21.15.175:6789/0 conn(0x7fa98c0d0400 legacy=0x7fa98c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.314+0000 7fa991991700 1 -- 172.21.15.6:0/1215875695 >> v1:172.21.15.6:6789/0 conn(0x7fa98c0cf7e0 legacy=0x7fa98c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.314+0000 7fa991991700 1 -- 172.21.15.6:0/1215875695 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c0ced80 con 0x7fa98c0ccd40 2023-10-06T02:19:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.314+0000 7fa991190700 1 -- 172.21.15.6:0/1215875695 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037451563 0 0) 0x7fa98c15dd40 con 0x7fa98c0cf7e0 2023-10-06T02:19:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.314+0000 7fa991991700 1 --2- 172.21.15.6:0/1215875695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa98c0ccd40 0x7fa98c0cf2a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa9800098e0 tx=0x7fa9800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979630b5ac5cf32 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.314+0000 7fa991190700 1 -- 172.21.15.6:0/1215875695 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980009e80 con 0x7fa98c0ccd40 2023-10-06T02:19:21.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.314+0000 7fa991190700 1 -- 172.21.15.6:0/1215875695 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98000b860 con 0x7fa98c0ccd40 2023-10-06T02:19:21.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.314+0000 7fa991190700 1 -- 172.21.15.6:0/1215875695 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98000bbe0 con 0x7fa98c0ccd40 2023-10-06T02:19:21.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.315+0000 7fa9943f6700 1 -- 172.21.15.6:0/1215875695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa98c0ccd40 msgr2=0x7fa98c0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.315+0000 7fa9943f6700 1 --2- 172.21.15.6:0/1215875695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa98c0ccd40 0x7fa98c0cf2a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa9800098e0 tx=0x7fa9800091a0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.315+0000 7fa9943f6700 1 -- 172.21.15.6:0/1215875695 shutdown_connections 2023-10-06T02:19:21.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.315+0000 7fa9943f6700 1 --2- 172.21.15.6:0/1215875695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa98c0ccd40 0x7fa98c0cf2a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.315+0000 7fa9943f6700 1 -- 172.21.15.6:0/1215875695 >> 172.21.15.6:0/1215875695 conn(0x7fa98c06a220 msgr2=0x7fa98c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:21.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.315+0000 7fa9943f6700 1 -- 172.21.15.6:0/1215875695 shutdown_connections 2023-10-06T02:19:21.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.315+0000 7fa9943f6700 1 -- 172.21.15.6:0/1215875695 wait complete. 2023-10-06T02:19:21.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.316+0000 7fa9943f6700 1 Processor -- start 2023-10-06T02:19:21.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.316+0000 7fa9943f6700 1 -- start start 2023-10-06T02:19:21.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa9943f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa98c0ccd40 0x7fa98c15b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa9943f6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa98c0cf7e0 0x7fa98c16a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa9943f6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa98c0d0400 0x7fa98c1534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa9943f6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0c5440 con 0x7fa98c0ccd40 2023-10-06T02:19:21.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa9943f6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c159630 con 0x7fa98c0cf7e0 2023-10-06T02:19:21.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa9943f6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c16a9e0 con 0x7fa98c0d0400 2023-10-06T02:19:21.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa992192700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa98c0ccd40 0x7fa98c15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa992192700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa98c0ccd40 0x7fa98c15b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49236/0 (socket says 172.21.15.6:49236) 2023-10-06T02:19:21.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa992192700 1 -- 172.21.15.6:0/1580447076 learned_addr learned my addr 172.21.15.6:0/1580447076 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:21.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa991991700 1 --2- 172.21.15.6:0/1580447076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa98c0cf7e0 0x7fa98c16a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa992993700 1 --2- 172.21.15.6:0/1580447076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa98c0d0400 0x7fa98c1534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa992192700 1 -- 172.21.15.6:0/1580447076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa98c0d0400 msgr2=0x7fa98c1534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa992192700 1 --2- 172.21.15.6:0/1580447076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa98c0d0400 0x7fa98c1534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa992192700 1 -- 172.21.15.6:0/1580447076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa98c0cf7e0 msgr2=0x7fa98c16a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa992192700 1 --2- 172.21.15.6:0/1580447076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa98c0cf7e0 0x7fa98c16a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa992192700 1 -- 172.21.15.6:0/1580447076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa980009420 con 0x7fa98c0ccd40 2023-10-06T02:19:21.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa991991700 1 --2- 172.21.15.6:0/1580447076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa98c0cf7e0 0x7fa98c16a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:21.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa992993700 1 --2- 172.21.15.6:0/1580447076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa98c0d0400 0x7fa98c1534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:21.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa992192700 1 --2- 172.21.15.6:0/1580447076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa98c0ccd40 0x7fa98c15b320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa98400cd30 tx=0x7fa984001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:21.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa98a7fc700 1 -- 172.21.15.6:0/1580447076 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98400ab70 con 0x7fa98c0ccd40 2023-10-06T02:19:21.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa98a7fc700 1 -- 172.21.15.6:0/1580447076 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98400acd0 con 0x7fa98c0ccd40 2023-10-06T02:19:21.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa9943f6700 1 -- 172.21.15.6:0/1580447076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c153a30 con 0x7fa98c0ccd40 2023-10-06T02:19:21.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.317+0000 7fa98a7fc700 1 -- 172.21.15.6:0/1580447076 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984012670 con 0x7fa98c0ccd40 2023-10-06T02:19:21.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.318+0000 7fa9943f6700 1 -- 172.21.15.6:0/1580447076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c158fe0 con 0x7fa98c0ccd40 2023-10-06T02:19:21.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.319+0000 7fa98a7fc700 1 -- 172.21.15.6:0/1580447076 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa984012a60 con 0x7fa98c0ccd40 2023-10-06T02:19:21.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.319+0000 7fa98a7fc700 1 --2- 172.21.15.6:0/1580447076 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa978066f30 0x7fa9780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.319+0000 7fa98a7fc700 1 -- 172.21.15.6:0/1580447076 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fa984084f80 con 0x7fa98c0ccd40 2023-10-06T02:19:21.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.320+0000 7fa991991700 1 --2- 172.21.15.6:0/1580447076 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa978066f30 0x7fa9780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.320+0000 7fa991991700 1 --2- 172.21.15.6:0/1580447076 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa978066f30 0x7fa9780693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa9800093f0 tx=0x7fa980017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:21.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.321+0000 7fa99d6eeb80 1 Processor -- start 2023-10-06T02:19:21.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.321+0000 7fa99d6eeb80 1 -- start start 2023-10-06T02:19:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.322+0000 7fa99d6eeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce212d4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.322+0000 7fa99d6eeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce21324710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.322+0000 7fa99d6eeb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce21324c50 0x55ce213250a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.322+0000 7fa99d6eeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2122bac0 con 0x55ce212d4890 2023-10-06T02:19:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.322+0000 7fa99d6eeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce212292c0 con 0x55ce212d5d10 2023-10-06T02:19:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.322+0000 7fa99d6eeb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce212250b0 con 0x55ce21324c50 2023-10-06T02:19:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.322+0000 7fa992192700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce212d4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.322+0000 7fa992192700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce212d4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49246/0 (socket says 172.21.15.6:49246) 2023-10-06T02:19:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.322+0000 7fa992192700 1 -- 172.21.15.6:0/3235053788 learned_addr learned my addr 172.21.15.6:0/3235053788 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.322+0000 7fa992993700 1 --2- 172.21.15.6:0/3235053788 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce21324c50 0x55ce213250a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.322+0000 7fa991991700 1 --2- 172.21.15.6:0/3235053788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce21324710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.322+0000 7fa992192700 1 -- 172.21.15.6:0/3235053788 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce21324c50 msgr2=0x55ce213250a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.322+0000 7fa992192700 1 --2- 172.21.15.6:0/3235053788 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce21324c50 0x55ce213250a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.322+0000 7fa992192700 1 -- 172.21.15.6:0/3235053788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 msgr2=0x55ce21324710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.322+0000 7fa992192700 1 --2- 172.21.15.6:0/3235053788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce21324710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.322+0000 7fa992192700 1 -- 172.21.15.6:0/3235053788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce210bf2c0 con 0x55ce212d4890 2023-10-06T02:19:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.323+0000 7fa992192700 1 --2- 172.21.15.6:0/3235053788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce212d4c60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa984002280 tx=0x7fa984083110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21dce430529f2be8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.323+0000 7fa9737fe700 1 -- 172.21.15.6:0/3235053788 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984058e10 con 0x55ce212d4890 2023-10-06T02:19:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.323+0000 7fa9737fe700 1 -- 172.21.15.6:0/3235053788 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98405cb60 con 0x55ce212d4890 2023-10-06T02:19:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.323+0000 7fa9737fe700 1 -- 172.21.15.6:0/3235053788 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984053d00 con 0x55ce212d4890 2023-10-06T02:19:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.323+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3235053788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 msgr2=0x55ce212d4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.323+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/3235053788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce212d4c60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa984002280 tx=0x7fa984083110 comp rx=0 tx=0).stop 2023-10-06T02:19:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.323+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3235053788 shutdown_connections 2023-10-06T02:19:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.323+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/3235053788 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce21324c50 0x55ce213250a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.323+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/3235053788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce212d4c60 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.323+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/3235053788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce21324710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.323+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3235053788 >> 172.21.15.6:0/3235053788 conn(0x55ce212d61b0 msgr2=0x55ce212d6580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.323+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3235053788 shutdown_connections 2023-10-06T02:19:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.324+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3235053788 wait complete. 2023-10-06T02:19:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.324+0000 7fa99d6eeb80 1 -- start start 2023-10-06T02:19:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.324+0000 7fa99d6eeb80 1 Processor -- start 2023-10-06T02:19:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.325+0000 7fa99d6eeb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce212d4890 0x55ce212fdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.325+0000 7fa99d6eeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce212fead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.325+0000 7fa99d6eeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce21324c50 0x55ce212ff010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.325+0000 7fa99d6eeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce211d08e0 con 0x55ce21324c50 2023-10-06T02:19:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.325+0000 7fa99d6eeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce211ebef0 con 0x55ce212d5d10 2023-10-06T02:19:21.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.325+0000 7fa99d6eeb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce210a7e80 con 0x55ce212d4890 2023-10-06T02:19:21.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.325+0000 7fa99d6eeb80 10 client.0 _ll_register_callbacks cb 0x55ce21297ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:19:21.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.325+0000 7fa992993700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce21324c50 0x55ce212ff010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.325+0000 7fa992993700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce21324c50 0x55ce212ff010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49250/0 (socket says 172.21.15.6:49250) 2023-10-06T02:19:21.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.325+0000 7fa992993700 1 -- 172.21.15.6:0/3096985563 learned_addr learned my addr 172.21.15.6:0/3096985563 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:21.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.325+0000 7fa991991700 1 --2- 172.21.15.6:0/3096985563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce212fead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.325+0000 7fa992192700 1 --2- 172.21.15.6:0/3096985563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce212d4890 0x55ce212fdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa992993700 1 -- 172.21.15.6:0/3096985563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce212d4890 msgr2=0x55ce212fdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:21.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa992993700 1 --2- 172.21.15.6:0/3096985563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce212d4890 0x55ce212fdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa992993700 1 -- 172.21.15.6:0/3096985563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 msgr2=0x55ce212fead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:21.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa992993700 1 --2- 172.21.15.6:0/3096985563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce212fead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa992993700 1 -- 172.21.15.6:0/3096985563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c158fe0 con 0x55ce21324c50 2023-10-06T02:19:21.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa991991700 1 --2- 172.21.15.6:0/3096985563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce212fead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:21.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa992192700 1 --2- 172.21.15.6:0/3096985563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce212d4890 0x55ce212fdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:21.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa992993700 1 --2- 172.21.15.6:0/3096985563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce21324c50 0x55ce212ff010 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0077f0 tx=0x7fa97c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de76eb1928d82f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:21.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa970ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:19:21.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa970ff9700 1 -- 172.21.15.6:0/3096985563 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c00d070 con 0x55ce21324c50 2023-10-06T02:19:21.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa970ff9700 1 -- 172.21.15.6:0/3096985563 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fa97c001c00 con 0x55ce21324c50 2023-10-06T02:19:21.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3096985563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce212c9990 con 0x55ce21324c50 2023-10-06T02:19:21.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa970ff9700 1 -- 172.21.15.6:0/3096985563 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa97c0063f0 con 0x55ce21324c50 2023-10-06T02:19:21.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa99d6eeb80 10 client.5502 fetch_fsmap learned FSMap version 24 2023-10-06T02:19:21.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3096985563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55ce21062030 con 0x55ce21324c50 2023-10-06T02:19:21.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa970ff9700 1 -- 172.21.15.6:0/3096985563 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c023020 con 0x55ce21324c50 2023-10-06T02:19:21.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa970ff9700 1 -- 172.21.15.6:0/3096985563 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa97c006550 con 0x55ce21324c50 2023-10-06T02:19:21.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa99d6eeb80 10 client.5502 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:19:21.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa99d6eeb80 10 client.5502 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-10-06T02:19:21.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa99d6eeb80 20 client.5502 populate_metadata read hostname 'smithi006' 2023-10-06T02:19:21.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/3096985563 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55ce21335460 0x55ce21337840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa99d6eeb80 4 client.5502 mds_command: new command op to 5385 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:19:21.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3096985563 --> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce212a68c0 con 0x55ce21335460 2023-10-06T02:19:21.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.326+0000 7fa992192700 1 --2- 172.21.15.6:0/3096985563 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55ce21335460 0x55ce21337840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.327+0000 7fa970ff9700 10 client.5502 ms_handle_connect on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:21.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.327+0000 7fa992192700 1 --2- 172.21.15.6:0/3096985563 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55ce21335460 0x55ce21337840 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=362b9c34f98b012f server_cookie=986e9a3b28e76f9a in_seq=0 out_seq=0 2023-10-06T02:19:21.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.327+0000 7fa970ff9700 1 -- 172.21.15.6:0/3096985563 <== mds.0 v2:172.21.15.6:6832/1188971598 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55ce212a68c0 con 0x55ce21335460 2023-10-06T02:19:21.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.327+0000 7fa970ff9700 10 client.5502 handle_command_reply: tid=0 2023-10-06T02:19:21.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.327+0000 7fa99d6eeb80 1 client.5502 shutdown 2023-10-06T02:19:21.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.327+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3096985563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce21324c50 msgr2=0x55ce212ff010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.327+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/3096985563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce21324c50 0x55ce212ff010 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0077f0 tx=0x7fa97c009040 comp rx=0 tx=0).stop 2023-10-06T02:19:21.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.327+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3096985563 shutdown_connections 2023-10-06T02:19:21.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.327+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/3096985563 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55ce21335460 0x55ce21337840 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.327+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/3096985563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce21324c50 0x55ce212ff010 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.327+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/3096985563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce212d4890 0x55ce212fdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.327+0000 7fa970ff9700 0 client.5502 ms_handle_reset on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:21.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.327+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/3096985563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce212fead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.327+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3096985563 >> 172.21.15.6:0/3096985563 conn(0x55ce212d61b0 msgr2=0x55ce212d5200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:21.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.328+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3096985563 shutdown_connections 2023-10-06T02:19:21.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.328+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3096985563 wait complete. 2023-10-06T02:19:21.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.328+0000 7fa99d6eeb80 20 client.5502 trim_cache size 0 max 16384 2023-10-06T02:19:21.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.344+0000 7fa99d6eeb80 1 Processor -- start 2023-10-06T02:19:21.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.344+0000 7fa99d6eeb80 1 -- start start 2023-10-06T02:19:21.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.344+0000 7fa99d6eeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce2132d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa99d6eeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce2132dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa99d6eeb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce21324c50 0x55ce212fdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa99d6eeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce212d3e60 con 0x55ce212d4890 2023-10-06T02:19:21.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa99d6eeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce213025e0 con 0x55ce212d5d10 2023-10-06T02:19:21.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa99d6eeb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce21300a00 con 0x55ce21324c50 2023-10-06T02:19:21.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa992192700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce2132d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa992192700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce2132d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49264/0 (socket says 172.21.15.6:49264) 2023-10-06T02:19:21.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa992192700 1 -- 172.21.15.6:0/3977832991 learned_addr learned my addr 172.21.15.6:0/3977832991 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:21.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa991991700 1 --2- 172.21.15.6:0/3977832991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce2132dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa992192700 1 -- 172.21.15.6:0/3977832991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce21324c50 msgr2=0x55ce212fdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:21.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa992993700 1 --2- 172.21.15.6:0/3977832991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce21324c50 0x55ce212fdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa992192700 1 --2- 172.21.15.6:0/3977832991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce21324c50 0x55ce212fdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa992192700 1 -- 172.21.15.6:0/3977832991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 msgr2=0x55ce2132dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:21.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa992192700 1 --2- 172.21.15.6:0/3977832991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce2132dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa992192700 1 -- 172.21.15.6:0/3977832991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce211f37d0 con 0x55ce212d4890 2023-10-06T02:19:21.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa991991700 1 --2- 172.21.15.6:0/3977832991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce2132dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:21.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa992993700 1 --2- 172.21.15.6:0/3977832991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce21324c50 0x55ce212fdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:21.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa992192700 1 --2- 172.21.15.6:0/3977832991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce2132d6a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa984052070 tx=0x7fa98407f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123876fda936721e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:21.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa973fff700 1 -- 172.21.15.6:0/3977832991 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984062070 con 0x55ce212d4890 2023-10-06T02:19:21.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa973fff700 1 -- 172.21.15.6:0/3977832991 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa984058e10 con 0x55ce212d4890 2023-10-06T02:19:21.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.345+0000 7fa973fff700 1 -- 172.21.15.6:0/3977832991 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984053d00 con 0x55ce212d4890 2023-10-06T02:19:21.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.346+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3977832991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 msgr2=0x55ce2132d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.346+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/3977832991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce2132d6a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa984052070 tx=0x7fa98407f040 comp rx=0 tx=0).stop 2023-10-06T02:19:21.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.346+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3977832991 shutdown_connections 2023-10-06T02:19:21.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.346+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/3977832991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce21324c50 0x55ce212fdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.346+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/3977832991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce2132d6a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.346+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/3977832991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce2132dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.346+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3977832991 >> 172.21.15.6:0/3977832991 conn(0x55ce212d61b0 msgr2=0x55ce2133b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:21.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.346+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3977832991 shutdown_connections 2023-10-06T02:19:21.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.346+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/3977832991 wait complete. 2023-10-06T02:19:21.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.346+0000 7fa99d6eeb80 1 -- start start 2023-10-06T02:19:21.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.346+0000 7fa99d6eeb80 1 Processor -- start 2023-10-06T02:19:21.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.347+0000 7fa99d6eeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce21322e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.347+0000 7fa99d6eeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce2132da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.347+0000 7fa99d6eeb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce21324c50 0x55ce2137ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.347+0000 7fa99d6eeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce21322580 con 0x55ce212d4890 2023-10-06T02:19:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.347+0000 7fa99d6eeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce21323430 con 0x55ce212d5d10 2023-10-06T02:19:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.347+0000 7fa99d6eeb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce21320a40 con 0x55ce21324c50 2023-10-06T02:19:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.347+0000 7fa99d6eeb80 10 client.0 _ll_register_callbacks cb 0x55ce21297ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:19:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.347+0000 7fa992192700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce21322e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.347+0000 7fa992192700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce21322e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49268/0 (socket says 172.21.15.6:49268) 2023-10-06T02:19:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.347+0000 7fa992192700 1 -- 172.21.15.6:0/1940797977 learned_addr learned my addr 172.21.15.6:0/1940797977 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.347+0000 7fa991991700 1 --2- 172.21.15.6:0/1940797977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce2132da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa992993700 1 --2- 172.21.15.6:0/1940797977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce21324c50 0x55ce2137ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa992192700 1 -- 172.21.15.6:0/1940797977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce21324c50 msgr2=0x55ce2137ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa992192700 1 --2- 172.21.15.6:0/1940797977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce21324c50 0x55ce2137ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa992192700 1 -- 172.21.15.6:0/1940797977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 msgr2=0x55ce2132da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa992192700 1 --2- 172.21.15.6:0/1940797977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce2132da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa992192700 1 -- 172.21.15.6:0/1940797977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce210bf2c0 con 0x55ce212d4890 2023-10-06T02:19:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa992993700 1 --2- 172.21.15.6:0/1940797977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce21324c50 0x55ce2137ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa992192700 1 --2- 172.21.15.6:0/1940797977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce21322e60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa984001dd0 tx=0x7fa98405e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a762963cd5631bdf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa970ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:19:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa970ff9700 1 -- 172.21.15.6:0/1940797977 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984062040 con 0x55ce212d4890 2023-10-06T02:19:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa970ff9700 1 -- 172.21.15.6:0/1940797977 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fa9840680d0 con 0x55ce212d4890 2023-10-06T02:19:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/1940797977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa98405cb60 con 0x55ce212d4890 2023-10-06T02:19:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa970ff9700 1 -- 172.21.15.6:0/1940797977 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa984055e20 con 0x55ce212d4890 2023-10-06T02:19:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa99d6eeb80 10 client.5508 fetch_fsmap learned FSMap version 24 2023-10-06T02:19:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/1940797977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55ce211da4c0 con 0x55ce212d4890 2023-10-06T02:19:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa970ff9700 1 -- 172.21.15.6:0/1940797977 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98405cb60 con 0x55ce212d4890 2023-10-06T02:19:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa970ff9700 1 -- 172.21.15.6:0/1940797977 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa9840550b0 con 0x55ce212d4890 2023-10-06T02:19:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa99d6eeb80 10 client.5508 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:19:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa99d6eeb80 10 client.5508 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-10-06T02:19:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa99d6eeb80 20 client.5508 populate_metadata read hostname 'smithi006' 2023-10-06T02:19:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/1940797977 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55ce2131a350 0x55ce213804d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa99d6eeb80 4 client.5508 mds_command: new command op to 5385 tid=0[{"prefix": "scrub status"}] 2023-10-06T02:19:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.348+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/1940797977 --> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ce211c7e50 con 0x55ce2131a350 2023-10-06T02:19:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa991991700 1 --2- 172.21.15.6:0/1940797977 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55ce2131a350 0x55ce213804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa991991700 1 --2- 172.21.15.6:0/1940797977 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55ce2131a350 0x55ce213804d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1316345be1368bd3 server_cookie=1b99c30da942ea03 in_seq=0 out_seq=0 2023-10-06T02:19:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa970ff9700 10 client.5508 ms_handle_connect on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa970ff9700 1 -- 172.21.15.6:0/1940797977 <== mds.0 v2:172.21.15.6:6832/1188971598 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+256 (crc 0 0 0) 0x55ce211c7e50 con 0x55ce2131a350 2023-10-06T02:19:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa970ff9700 10 client.5508 handle_command_reply: tid=0 2023-10-06T02:19:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa99d6eeb80 1 client.5508 shutdown 2023-10-06T02:19:21.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/1940797977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 msgr2=0x55ce21322e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/1940797977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce21322e60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa984001dd0 tx=0x7fa98405e040 comp rx=0 tx=0).stop 2023-10-06T02:19:21.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/1940797977 shutdown_connections 2023-10-06T02:19:21.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/1940797977 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55ce2131a350 0x55ce213804d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/1940797977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce21324c50 0x55ce2137ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa970ff9700 0 client.5508 ms_handle_reset on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:21.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/1940797977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce212d4890 0x55ce21322e60 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa99d6eeb80 1 --2- 172.21.15.6:0/1940797977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce212d5d10 0x55ce2132da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/1940797977 >> 172.21.15.6:0/1940797977 conn(0x55ce212d61b0 msgr2=0x55ce212d5530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:21.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/1940797977 shutdown_connections 2023-10-06T02:19:21.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa99d6eeb80 1 -- 172.21.15.6:0/1940797977 wait complete. 2023-10-06T02:19:21.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.349+0000 7fa99d6eeb80 20 client.5508 trim_cache size 0 max 16384 2023-10-06T02:19:21.360 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:19:21.360 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T02:19:21.361 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-10-06T02:19:21.361 INFO:teuthology.orchestra.run.smithi006.stdout: "47bb7c69-9340-4902-8ca2-c94504664620": { 2023-10-06T02:19:21.361 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/subdir", 2023-10-06T02:19:21.361 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "47bb7c69-9340-4902-8ca2-c94504664620", 2023-10-06T02:19:21.361 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "repair" 2023-10-06T02:19:21.361 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:19:21.361 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:19:21.361 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:19:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.350+0000 7fa9943f6700 1 -- 172.21.15.6:0/1580447076 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa978066f30 msgr2=0x7fa9780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.350+0000 7fa9943f6700 1 --2- 172.21.15.6:0/1580447076 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa978066f30 0x7fa9780693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa9800093f0 tx=0x7fa980017000 comp rx=0 tx=0).stop 2023-10-06T02:19:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.350+0000 7fa9943f6700 1 -- 172.21.15.6:0/1580447076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa98c0ccd40 msgr2=0x7fa98c15b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.350+0000 7fa9943f6700 1 --2- 172.21.15.6:0/1580447076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa98c0ccd40 0x7fa98c15b320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa98400cd30 tx=0x7fa984001b40 comp rx=0 tx=0).stop 2023-10-06T02:19:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.350+0000 7fa9943f6700 1 -- 172.21.15.6:0/1580447076 shutdown_connections 2023-10-06T02:19:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.350+0000 7fa9943f6700 1 --2- 172.21.15.6:0/1580447076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa98c0d0400 0x7fa98c1534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.350+0000 7fa9943f6700 1 --2- 172.21.15.6:0/1580447076 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa978066f30 0x7fa9780693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.350+0000 7fa9943f6700 1 --2- 172.21.15.6:0/1580447076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa98c0ccd40 0x7fa98c15b320 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.350+0000 7fa9943f6700 1 --2- 172.21.15.6:0/1580447076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa98c0cf7e0 0x7fa98c16a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:21.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.350+0000 7fa9943f6700 1 -- 172.21.15.6:0/1580447076 >> 172.21.15.6:0/1580447076 conn(0x7fa98c06a220 msgr2=0x7fa98c0b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:21.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.350+0000 7fa9943f6700 1 -- 172.21.15.6:0/1580447076 shutdown_connections 2023-10-06T02:19:21.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:21.350+0000 7fa9943f6700 1 -- 172.21.15.6:0/1580447076 wait complete. 2023-10-06T02:19:21.364 INFO:tasks.cephfs.filesystem:scrub status for tag:47bb7c69-9340-4902-8ca2-c94504664620 - {'path': '/subdir', 'tag': '47bb7c69-9340-4902-8ca2-c94504664620', 'options': 'repair'} 2023-10-06T02:19:49.289 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:19:49.292 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:19:51.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub status 2023-10-06T02:19:51.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.497+0000 7fdc9759e700 1 Processor -- start 2023-10-06T02:19:51.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.497+0000 7fdc9759e700 1 -- start start 2023-10-06T02:19:51.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.498+0000 7fdc9759e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9813f5e0 0x7fdc980c9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.498+0000 7fdc9759e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc980af750 con 0x7fdc9813f9b0 2023-10-06T02:19:51.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.498+0000 7fdc9759e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc9806b6b0 con 0x7fdc980b1370 2023-10-06T02:19:51.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.498+0000 7fdc9759e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980aeea0 con 0x7fdc9813f5e0 2023-10-06T02:19:51.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.498+0000 7fdc95d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdc9813f9b0 0x7fdc980b0c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47056/0 (socket says 172.21.15.6:47056) 2023-10-06T02:19:51.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.498+0000 7fdc95d9b700 1 -- 172.21.15.6:0/954274031 learned_addr learned my addr 172.21.15.6:0/954274031 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:19:51.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.498+0000 7fdc9659c700 1 --2- 172.21.15.6:0/954274031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9813f5e0 0x7fdc980c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.499+0000 7fdc9559a700 1 -- 172.21.15.6:0/954274031 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592779658 0 0) 0x7fdc980af750 con 0x7fdc9813f9b0 2023-10-06T02:19:51.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.499+0000 7fdc9559a700 1 -- 172.21.15.6:0/954274031 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc84003570 con 0x7fdc9813f9b0 2023-10-06T02:19:51.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.499+0000 7fdc9559a700 1 -- 172.21.15.6:0/954274031 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085330929 0 0) 0x7fdc9806b6b0 con 0x7fdc980b1370 2023-10-06T02:19:51.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.499+0000 7fdc9559a700 1 -- 172.21.15.6:0/954274031 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc980af750 con 0x7fdc980b1370 2023-10-06T02:19:51.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.499+0000 7fdc9659c700 1 -- 172.21.15.6:0/954274031 >> v1:172.21.15.175:6789/0 conn(0x7fdc980b1370 legacy=0x7fdc9806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.499+0000 7fdc9659c700 1 -- 172.21.15.6:0/954274031 >> v1:172.21.15.6:6789/0 conn(0x7fdc9813f9b0 legacy=0x7fdc980b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.499+0000 7fdc9559a700 1 -- 172.21.15.6:0/954274031 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1620973214 0 0) 0x7fdc84003570 con 0x7fdc9813f9b0 2023-10-06T02:19:51.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.499+0000 7fdc9659c700 1 -- 172.21.15.6:0/954274031 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc980af100 con 0x7fdc9813f5e0 2023-10-06T02:19:51.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.499+0000 7fdc9659c700 1 --2- 172.21.15.6:0/954274031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9813f5e0 0x7fdc980c9640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009e90 tx=0x7fdc88009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5d6dfd764ad42a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:51.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.499+0000 7fdc9559a700 1 -- 172.21.15.6:0/954274031 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8800e070 con 0x7fdc9813f5e0 2023-10-06T02:19:51.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.499+0000 7fdc9559a700 1 -- 172.21.15.6:0/954274031 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8800b870 con 0x7fdc9813f5e0 2023-10-06T02:19:51.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.499+0000 7fdc9559a700 1 -- 172.21.15.6:0/954274031 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc80001470 con 0x7fdc9813f5e0 2023-10-06T02:19:51.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.500+0000 7fdc9759e700 1 -- 172.21.15.6:0/954274031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9813f5e0 msgr2=0x7fdc980c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.500+0000 7fdc9759e700 1 --2- 172.21.15.6:0/954274031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9813f5e0 0x7fdc980c9640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009e90 tx=0x7fdc88009780 comp rx=0 tx=0).stop 2023-10-06T02:19:51.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.500+0000 7fdc9759e700 1 -- 172.21.15.6:0/954274031 shutdown_connections 2023-10-06T02:19:51.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.500+0000 7fdc9759e700 1 --2- 172.21.15.6:0/954274031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9813f5e0 0x7fdc980c9640 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.500+0000 7fdc9759e700 1 -- 172.21.15.6:0/954274031 >> 172.21.15.6:0/954274031 conn(0x7fdc98069150 msgr2=0x7fdc980ad720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:51.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.500+0000 7fdc9759e700 1 -- 172.21.15.6:0/954274031 shutdown_connections 2023-10-06T02:19:51.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.500+0000 7fdc9759e700 1 -- 172.21.15.6:0/954274031 wait complete. 2023-10-06T02:19:51.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.501+0000 7fdc9759e700 1 Processor -- start 2023-10-06T02:19:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.501+0000 7fdc9759e700 1 -- start start 2023-10-06T02:19:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc9759e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc980b1370 0x7fdc980c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc9759e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9813f5e0 0x7fdc980cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc9759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9813f9b0 0x7fdc981565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc9759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980ac4b0 con 0x7fdc9813f9b0 2023-10-06T02:19:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc9759e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980ca960 con 0x7fdc980b1370 2023-10-06T02:19:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc9759e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980c9d50 con 0x7fdc9813f5e0 2023-10-06T02:19:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc96d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9813f9b0 0x7fdc981565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc9659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc980b1370 0x7fdc980c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc96d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9813f9b0 0x7fdc981565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36276/0 (socket says 172.21.15.6:36276) 2023-10-06T02:19:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc96d9d700 1 -- 172.21.15.6:0/3936850654 learned_addr learned my addr 172.21.15.6:0/3936850654 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:51.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/3936850654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9813f5e0 0x7fdc980cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc96d9d700 1 -- 172.21.15.6:0/3936850654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9813f5e0 msgr2=0x7fdc980cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc96d9d700 1 --2- 172.21.15.6:0/3936850654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9813f5e0 0x7fdc980cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc96d9d700 1 -- 172.21.15.6:0/3936850654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc980b1370 msgr2=0x7fdc980c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc96d9d700 1 --2- 172.21.15.6:0/3936850654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc980b1370 0x7fdc980c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc96d9d700 1 -- 172.21.15.6:0/3936850654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc88009a20 con 0x7fdc9813f9b0 2023-10-06T02:19:51.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc96d9d700 1 --2- 172.21.15.6:0/3936850654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9813f9b0 0x7fdc981565a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000c590 tx=0x7fdc90007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:51.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.502+0000 7fdc8e7fc700 1 -- 172.21.15.6:0/3936850654 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90011590 con 0x7fdc9813f9b0 2023-10-06T02:19:51.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.503+0000 7fdc8e7fc700 1 -- 172.21.15.6:0/3936850654 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc90011710 con 0x7fdc9813f9b0 2023-10-06T02:19:51.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.503+0000 7fdc8e7fc700 1 -- 172.21.15.6:0/3936850654 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90011ad0 con 0x7fdc9813f9b0 2023-10-06T02:19:51.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.503+0000 7fdc9759e700 1 -- 172.21.15.6:0/3936850654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc980ca030 con 0x7fdc9813f9b0 2023-10-06T02:19:51.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.503+0000 7fdc9759e700 1 -- 172.21.15.6:0/3936850654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc980ca5f0 con 0x7fdc9813f9b0 2023-10-06T02:19:51.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.504+0000 7fdc8e7fc700 1 -- 172.21.15.6:0/3936850654 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc9001c460 con 0x7fdc9813f9b0 2023-10-06T02:19:51.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.504+0000 7fdc8e7fc700 1 --2- 172.21.15.6:0/3936850654 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc78066f30 0x7fdc780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.504+0000 7fdc8e7fc700 1 -- 172.21.15.6:0/3936850654 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fdc90084420 con 0x7fdc9813f9b0 2023-10-06T02:19:51.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.505+0000 7fdc9659c700 1 --2- 172.21.15.6:0/3936850654 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc78066f30 0x7fdc780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.505+0000 7fdc9659c700 1 --2- 172.21.15.6:0/3936850654 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc78066f30 0x7fdc780693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdc880097c0 tx=0x7fdc88017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.507+0000 7fdca5f02b80 1 Processor -- start 2023-10-06T02:19:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.507+0000 7fdca5f02b80 1 -- start start 2023-10-06T02:19:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.507+0000 7fdca5f02b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240a6ee0 0x55d8240d9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.507+0000 7fdca5f02b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240ac2a0 0x55d8240a72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.507+0000 7fdca5f02b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240da3a0 0x55d8240f6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.507+0000 7fdca5f02b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d824001ac0 con 0x55d8240ac2a0 2023-10-06T02:19:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.507+0000 7fdca5f02b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d823fff2c0 con 0x55d8240a6ee0 2023-10-06T02:19:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.507+0000 7fdca5f02b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d823ffb0b0 con 0x55d8240da3a0 2023-10-06T02:19:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.507+0000 7fdc95d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240ac2a0 0x55d8240a72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.507+0000 7fdc95d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240ac2a0 0x55d8240a72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36278/0 (socket says 172.21.15.6:36278) 2023-10-06T02:19:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.507+0000 7fdc95d9b700 1 -- 172.21.15.6:0/1696915535 learned_addr learned my addr 172.21.15.6:0/1696915535 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:51.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.508+0000 7fdc9659c700 1 --2- 172.21.15.6:0/1696915535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240a6ee0 0x55d8240d9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.508+0000 7fdc96d9d700 1 --2- 172.21.15.6:0/1696915535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240da3a0 0x55d8240f6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.508+0000 7fdc95d9b700 1 -- 172.21.15.6:0/1696915535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240da3a0 msgr2=0x55d8240f6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:51.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.508+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/1696915535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240da3a0 0x55d8240f6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.508+0000 7fdc95d9b700 1 -- 172.21.15.6:0/1696915535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240a6ee0 msgr2=0x55d8240d9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:51.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.508+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/1696915535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240a6ee0 0x55d8240d9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.508+0000 7fdc95d9b700 1 -- 172.21.15.6:0/1696915535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d823e952c0 con 0x55d8240ac2a0 2023-10-06T02:19:51.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.508+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/1696915535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240ac2a0 0x55d8240a72b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdc80004c90 tx=0x7fdc80001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f953109013804b81 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:51.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.508+0000 7fdc777fe700 1 -- 172.21.15.6:0/1696915535 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8000fa50 con 0x55d8240ac2a0 2023-10-06T02:19:51.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.508+0000 7fdc777fe700 1 -- 172.21.15.6:0/1696915535 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8000fbb0 con 0x55d8240ac2a0 2023-10-06T02:19:51.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.508+0000 7fdc777fe700 1 -- 172.21.15.6:0/1696915535 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc800133b0 con 0x55d8240ac2a0 2023-10-06T02:19:51.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.509+0000 7fdca5f02b80 1 -- 172.21.15.6:0/1696915535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240ac2a0 msgr2=0x55d8240a72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.509+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/1696915535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240ac2a0 0x55d8240a72b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdc80004c90 tx=0x7fdc80001930 comp rx=0 tx=0).stop 2023-10-06T02:19:51.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.509+0000 7fdca5f02b80 1 -- 172.21.15.6:0/1696915535 shutdown_connections 2023-10-06T02:19:51.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.509+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/1696915535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240da3a0 0x55d8240f6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.509+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/1696915535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240a6ee0 0x55d8240d9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.509+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/1696915535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240ac2a0 0x55d8240a72b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.509+0000 7fdca5f02b80 1 -- 172.21.15.6:0/1696915535 >> 172.21.15.6:0/1696915535 conn(0x55d8240abed0 msgr2=0x55d8240ac700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:51.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.509+0000 7fdca5f02b80 1 -- 172.21.15.6:0/1696915535 shutdown_connections 2023-10-06T02:19:51.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.509+0000 7fdca5f02b80 1 -- 172.21.15.6:0/1696915535 wait complete. 2023-10-06T02:19:51.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.510+0000 7fdca5f02b80 1 -- start start 2023-10-06T02:19:51.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.510+0000 7fdca5f02b80 1 Processor -- start 2023-10-06T02:19:51.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdca5f02b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240a6ee0 0x55d8240f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdca5f02b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240ac2a0 0x55d8240f7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdca5f02b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240da3a0 0x55d8240f7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdca5f02b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d823fa68e0 con 0x55d8240a6ee0 2023-10-06T02:19:51.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdca5f02b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d823fc1ef0 con 0x55d8240da3a0 2023-10-06T02:19:51.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdca5f02b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d823e7de80 con 0x55d8240ac2a0 2023-10-06T02:19:51.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdc9659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240a6ee0 0x55d8240f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdca5f02b80 10 client.0 _ll_register_callbacks cb 0x55d82406e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:19:51.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdc9659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240a6ee0 0x55d8240f5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36292/0 (socket says 172.21.15.6:36292) 2023-10-06T02:19:51.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdc9659c700 1 -- 172.21.15.6:0/11551241 learned_addr learned my addr 172.21.15.6:0/11551241 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdc96d9d700 1 --2- 172.21.15.6:0/11551241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240da3a0 0x55d8240f7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/11551241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240ac2a0 0x55d8240f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdc9659c700 1 -- 172.21.15.6:0/11551241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240ac2a0 msgr2=0x55d8240f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdc9659c700 1 --2- 172.21.15.6:0/11551241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240ac2a0 0x55d8240f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdc9659c700 1 -- 172.21.15.6:0/11551241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240da3a0 msgr2=0x55d8240f7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdc9659c700 1 --2- 172.21.15.6:0/11551241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240da3a0 0x55d8240f7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdc9659c700 1 -- 172.21.15.6:0/11551241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc80004890 con 0x55d8240a6ee0 2023-10-06T02:19:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdc96d9d700 1 --2- 172.21.15.6:0/11551241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240da3a0 0x55d8240f7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdc9659c700 1 --2- 172.21.15.6:0/11551241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240a6ee0 0x55d8240f5c40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdc88003000 tx=0x7fdc88020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f817c0bfde8b37f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdc74ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:19:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdc74ff9700 1 -- 172.21.15.6:0/11551241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8802e070 con 0x55d8240a6ee0 2023-10-06T02:19:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdc74ff9700 1 -- 172.21.15.6:0/11551241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fdc88029860 con 0x55d8240a6ee0 2023-10-06T02:19:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.511+0000 7fdca5f02b80 1 -- 172.21.15.6:0/11551241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d82409f990 con 0x55d8240a6ee0 2023-10-06T02:19:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.512+0000 7fdc74ff9700 1 -- 172.21.15.6:0/11551241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc88029c70 con 0x55d8240a6ee0 2023-10-06T02:19:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.512+0000 7fdca5f02b80 10 client.5520 fetch_fsmap learned FSMap version 24 2023-10-06T02:19:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.512+0000 7fdca5f02b80 1 -- 172.21.15.6:0/11551241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55d823e38030 con 0x55d8240a6ee0 2023-10-06T02:19:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.512+0000 7fdc74ff9700 1 -- 172.21.15.6:0/11551241 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d82409f990 con 0x55d8240a6ee0 2023-10-06T02:19:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.512+0000 7fdc74ff9700 1 -- 172.21.15.6:0/11551241 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdc88027450 con 0x55d8240a6ee0 2023-10-06T02:19:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.512+0000 7fdca5f02b80 10 client.5520 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:19:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.512+0000 7fdca5f02b80 10 client.5520 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-10-06T02:19:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.512+0000 7fdca5f02b80 20 client.5520 populate_metadata read hostname 'smithi006' 2023-10-06T02:19:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.512+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/11551241 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55d8240f7fd0 0x55d8240d40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.512+0000 7fdca5f02b80 4 client.5520 mds_command: new command op to 5385 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:19:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.512+0000 7fdca5f02b80 1 -- 172.21.15.6:0/11551241 --> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d82407c8c0 con 0x55d8240f7fd0 2023-10-06T02:19:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.512+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/11551241 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55d8240f7fd0 0x55d8240d40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.512+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/11551241 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55d8240f7fd0 0x55d8240d40e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dd0129677aac003 server_cookie=289c82aed41dbee5 in_seq=0 out_seq=0 2023-10-06T02:19:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.512+0000 7fdc74ff9700 10 client.5520 ms_handle_connect on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.513+0000 7fdc74ff9700 1 -- 172.21.15.6:0/11551241 <== mds.0 v2:172.21.15.6:6832/1188971598 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d82407c8c0 con 0x55d8240f7fd0 2023-10-06T02:19:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.513+0000 7fdc74ff9700 10 client.5520 handle_command_reply: tid=0 2023-10-06T02:19:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.513+0000 7fdca5f02b80 1 client.5520 shutdown 2023-10-06T02:19:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.513+0000 7fdca5f02b80 1 -- 172.21.15.6:0/11551241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240a6ee0 msgr2=0x55d8240f5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.513+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/11551241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240a6ee0 0x55d8240f5c40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdc88003000 tx=0x7fdc88020040 comp rx=0 tx=0).stop 2023-10-06T02:19:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.513+0000 7fdca5f02b80 1 -- 172.21.15.6:0/11551241 shutdown_connections 2023-10-06T02:19:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.513+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/11551241 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55d8240f7fd0 0x55d8240d40e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.513+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/11551241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240da3a0 0x55d8240f7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.513+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/11551241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240a6ee0 0x55d8240f5c40 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.513+0000 7fdc74ff9700 0 client.5520 ms_handle_reset on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:51.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.513+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/11551241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240ac2a0 0x55d8240f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.513+0000 7fdca5f02b80 1 -- 172.21.15.6:0/11551241 >> 172.21.15.6:0/11551241 conn(0x55d8240abed0 msgr2=0x55d8240a79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:51.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.513+0000 7fdca5f02b80 1 -- 172.21.15.6:0/11551241 shutdown_connections 2023-10-06T02:19:51.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.513+0000 7fdca5f02b80 1 -- 172.21.15.6:0/11551241 wait complete. 2023-10-06T02:19:51.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.513+0000 7fdca5f02b80 20 client.5520 trim_cache size 0 max 16384 2023-10-06T02:19:51.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.530+0000 7fdca5f02b80 1 Processor -- start 2023-10-06T02:19:51.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.530+0000 7fdca5f02b80 1 -- start start 2023-10-06T02:19:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.530+0000 7fdca5f02b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240a6ee0 0x55d8240d9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.531+0000 7fdca5f02b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240ac2a0 0x55d8240aa990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.531+0000 7fdca5f02b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240da3a0 0x55d8240aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.531+0000 7fdca5f02b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d82408a3d0 con 0x55d8240ac2a0 2023-10-06T02:19:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.531+0000 7fdca5f02b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8240abc70 con 0x55d8240a6ee0 2023-10-06T02:19:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.531+0000 7fdca5f02b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8240fd420 con 0x55d8240da3a0 2023-10-06T02:19:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.531+0000 7fdc95d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240ac2a0 0x55d8240aa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.531+0000 7fdc95d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240ac2a0 0x55d8240aa990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36302/0 (socket says 172.21.15.6:36302) 2023-10-06T02:19:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.531+0000 7fdc95d9b700 1 -- 172.21.15.6:0/1334670231 learned_addr learned my addr 172.21.15.6:0/1334670231 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.531+0000 7fdc95d9b700 1 -- 172.21.15.6:0/1334670231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240da3a0 msgr2=0x55d8240aaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.531+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/1334670231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240da3a0 0x55d8240aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.531+0000 7fdc95d9b700 1 -- 172.21.15.6:0/1334670231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240a6ee0 msgr2=0x55d8240d9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.531+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/1334670231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240a6ee0 0x55d8240d9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.531+0000 7fdc95d9b700 1 -- 172.21.15.6:0/1334670231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d823fc97d0 con 0x55d8240ac2a0 2023-10-06T02:19:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.531+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/1334670231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240ac2a0 0x55d8240aa990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdc80001ed0 tx=0x7fdc80016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210ec8859ee2ec4c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.531+0000 7fdc77fff700 1 -- 172.21.15.6:0/1334670231 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc800133b0 con 0x55d8240ac2a0 2023-10-06T02:19:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.531+0000 7fdc77fff700 1 -- 172.21.15.6:0/1334670231 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8000b040 con 0x55d8240ac2a0 2023-10-06T02:19:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.531+0000 7fdc77fff700 1 -- 172.21.15.6:0/1334670231 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8000fd20 con 0x55d8240ac2a0 2023-10-06T02:19:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.532+0000 7fdca5f02b80 1 -- 172.21.15.6:0/1334670231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240ac2a0 msgr2=0x55d8240aa990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.532+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/1334670231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240ac2a0 0x55d8240aa990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdc80001ed0 tx=0x7fdc80016040 comp rx=0 tx=0).stop 2023-10-06T02:19:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.532+0000 7fdca5f02b80 1 -- 172.21.15.6:0/1334670231 shutdown_connections 2023-10-06T02:19:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.532+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/1334670231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240da3a0 0x55d8240aaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.532+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/1334670231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240a6ee0 0x55d8240d9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.532+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/1334670231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240ac2a0 0x55d8240aa990 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.532+0000 7fdca5f02b80 1 -- 172.21.15.6:0/1334670231 >> 172.21.15.6:0/1334670231 conn(0x55d8240abed0 msgr2=0x55d8240d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.532+0000 7fdca5f02b80 1 -- 172.21.15.6:0/1334670231 shutdown_connections 2023-10-06T02:19:51.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.532+0000 7fdca5f02b80 1 -- 172.21.15.6:0/1334670231 wait complete. 2023-10-06T02:19:51.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.532+0000 7fdca5f02b80 1 -- start start 2023-10-06T02:19:51.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.532+0000 7fdca5f02b80 1 Processor -- start 2023-10-06T02:19:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.533+0000 7fdca5f02b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240a6ee0 0x55d8241080b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.533+0000 7fdca5f02b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240ac2a0 0x55d8240aa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.533+0000 7fdca5f02b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240da3a0 0x55d8240aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.533+0000 7fdca5f02b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8240ad030 con 0x55d8240da3a0 2023-10-06T02:19:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.533+0000 7fdca5f02b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d82415b790 con 0x55d8240ac2a0 2023-10-06T02:19:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.533+0000 7fdca5f02b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8240d57c0 con 0x55d8240a6ee0 2023-10-06T02:19:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.533+0000 7fdca5f02b80 10 client.0 _ll_register_callbacks cb 0x55d82406e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:19:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.533+0000 7fdc96d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240da3a0 0x55d8240aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.533+0000 7fdc96d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240da3a0 0x55d8240aaca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36304/0 (socket says 172.21.15.6:36304) 2023-10-06T02:19:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.533+0000 7fdc96d9d700 1 -- 172.21.15.6:0/2449952026 learned_addr learned my addr 172.21.15.6:0/2449952026 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/2449952026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240ac2a0 0x55d8240aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdc9659c700 1 --2- 172.21.15.6:0/2449952026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240a6ee0 0x55d8241080b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdc96d9d700 1 -- 172.21.15.6:0/2449952026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240a6ee0 msgr2=0x55d8241080b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdc96d9d700 1 --2- 172.21.15.6:0/2449952026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240a6ee0 0x55d8241080b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdc96d9d700 1 -- 172.21.15.6:0/2449952026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240ac2a0 msgr2=0x55d8240aa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdc96d9d700 1 --2- 172.21.15.6:0/2449952026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240ac2a0 0x55d8240aa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdc96d9d700 1 -- 172.21.15.6:0/2449952026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d823e952c0 con 0x55d8240da3a0 2023-10-06T02:19:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/2449952026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240ac2a0 0x55d8240aa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdc96d9d700 1 --2- 172.21.15.6:0/2449952026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240da3a0 0x55d8240aaca0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdc90054fb0 tx=0x7fdc90084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21824182d72d5ce4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdc74ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:19:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdc74ff9700 1 -- 172.21.15.6:0/2449952026 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90002ea0 con 0x55d8240da3a0 2023-10-06T02:19:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdc74ff9700 1 -- 172.21.15.6:0/2449952026 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fdc90058270 con 0x55d8240da3a0 2023-10-06T02:19:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdca5f02b80 1 -- 172.21.15.6:0/2449952026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc8000fbb0 con 0x55d8240da3a0 2023-10-06T02:19:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdc74ff9700 1 -- 172.21.15.6:0/2449952026 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc900550a0 con 0x55d8240da3a0 2023-10-06T02:19:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdca5f02b80 10 client.5526 fetch_fsmap learned FSMap version 24 2023-10-06T02:19:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdca5f02b80 1 -- 172.21.15.6:0/2449952026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55d823fb04c0 con 0x55d8240da3a0 2023-10-06T02:19:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdc74ff9700 1 -- 172.21.15.6:0/2449952026 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8000fbb0 con 0x55d8240da3a0 2023-10-06T02:19:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdc74ff9700 1 -- 172.21.15.6:0/2449952026 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdc90055280 con 0x55d8240da3a0 2023-10-06T02:19:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdca5f02b80 10 client.5526 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:19:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdca5f02b80 10 client.5526 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-10-06T02:19:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdca5f02b80 20 client.5526 populate_metadata read hostname 'smithi006' 2023-10-06T02:19:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/2449952026 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55d82415a8e0 0x55d82415ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdca5f02b80 4 client.5526 mds_command: new command op to 5385 tid=0[{"prefix": "scrub status"}] 2023-10-06T02:19:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.534+0000 7fdca5f02b80 1 -- 172.21.15.6:0/2449952026 --> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d823f9de50 con 0x55d82415a8e0 2023-10-06T02:19:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdc9659c700 1 --2- 172.21.15.6:0/2449952026 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55d82415a8e0 0x55d82415ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdc74ff9700 10 client.5526 ms_handle_connect on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdc9659c700 1 --2- 172.21.15.6:0/2449952026 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55d82415a8e0 0x55d82415ace0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=754b2b515ee6fa9e server_cookie=ee9cd95a3c93a8e8 in_seq=0 out_seq=0 2023-10-06T02:19:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdc74ff9700 1 -- 172.21.15.6:0/2449952026 <== mds.0 v2:172.21.15.6:6832/1188971598 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55d823f9de50 con 0x55d82415a8e0 2023-10-06T02:19:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdc74ff9700 10 client.5526 handle_command_reply: tid=0 2023-10-06T02:19:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdca5f02b80 1 client.5526 shutdown 2023-10-06T02:19:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdca5f02b80 1 -- 172.21.15.6:0/2449952026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240da3a0 msgr2=0x55d8240aaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/2449952026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240da3a0 0x55d8240aaca0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdc90054fb0 tx=0x7fdc90084040 comp rx=0 tx=0).stop 2023-10-06T02:19:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdca5f02b80 1 -- 172.21.15.6:0/2449952026 shutdown_connections 2023-10-06T02:19:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/2449952026 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55d82415a8e0 0x55d82415ace0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/2449952026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8240da3a0 0x55d8240aaca0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/2449952026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8240a6ee0 0x55d8241080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdc74ff9700 0 client.5526 ms_handle_reset on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdca5f02b80 1 --2- 172.21.15.6:0/2449952026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8240ac2a0 0x55d8240aa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdca5f02b80 1 -- 172.21.15.6:0/2449952026 >> 172.21.15.6:0/2449952026 conn(0x55d8240abed0 msgr2=0x55d8240cd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:51.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdca5f02b80 1 -- 172.21.15.6:0/2449952026 shutdown_connections 2023-10-06T02:19:51.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdca5f02b80 1 -- 172.21.15.6:0/2449952026 wait complete. 2023-10-06T02:19:51.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.535+0000 7fdca5f02b80 20 client.5526 trim_cache size 0 max 16384 2023-10-06T02:19:51.544 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:19:51.544 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-10-06T02:19:51.544 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-10-06T02:19:51.544 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:19:51.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.536+0000 7fdc9759e700 1 -- 172.21.15.6:0/3936850654 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc78066f30 msgr2=0x7fdc780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.536+0000 7fdc9759e700 1 --2- 172.21.15.6:0/3936850654 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc78066f30 0x7fdc780693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdc880097c0 tx=0x7fdc88017000 comp rx=0 tx=0).stop 2023-10-06T02:19:51.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.536+0000 7fdc9759e700 1 -- 172.21.15.6:0/3936850654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9813f9b0 msgr2=0x7fdc981565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.536+0000 7fdc9759e700 1 --2- 172.21.15.6:0/3936850654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9813f9b0 0x7fdc981565a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000c590 tx=0x7fdc90007d20 comp rx=0 tx=0).stop 2023-10-06T02:19:51.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.536+0000 7fdc9759e700 1 -- 172.21.15.6:0/3936850654 shutdown_connections 2023-10-06T02:19:51.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.536+0000 7fdc9759e700 1 --2- 172.21.15.6:0/3936850654 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc78066f30 0x7fdc780693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.536+0000 7fdc9759e700 1 --2- 172.21.15.6:0/3936850654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9813f9b0 0x7fdc981565a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.536+0000 7fdc9759e700 1 --2- 172.21.15.6:0/3936850654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc980b1370 0x7fdc980c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.536+0000 7fdc9759e700 1 --2- 172.21.15.6:0/3936850654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9813f5e0 0x7fdc980cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.536+0000 7fdc9759e700 1 -- 172.21.15.6:0/3936850654 >> 172.21.15.6:0/3936850654 conn(0x7fdc98069150 msgr2=0x7fdc98134b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:51.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.536+0000 7fdc9759e700 1 -- 172.21.15.6:0/3936850654 shutdown_connections 2023-10-06T02:19:51.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.536+0000 7fdc9759e700 1 -- 172.21.15.6:0/3936850654 wait complete. 2023-10-06T02:19:51.549 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T02:19:51.549 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:19:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.666+0000 7fbf5d6e6700 1 Processor -- start 2023-10-06T02:19:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.666+0000 7fbf5d6e6700 1 -- start start 2023-10-06T02:19:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.667+0000 7fbf5d6e6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbf580af8b0 0x7fbf5815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.667+0000 7fbf5d6e6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5815e190 con 0x7fbf580af4e0 2023-10-06T02:19:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.667+0000 7fbf5d6e6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf580cb650 con 0x7fbf580b27f0 2023-10-06T02:19:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.667+0000 7fbf5d6e6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf580b1910 con 0x7fbf580af8b0 2023-10-06T02:19:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.667+0000 7fbf56ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbf580af4e0 0x7fbf580b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47058/0 (socket says 172.21.15.6:47058) 2023-10-06T02:19:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.667+0000 7fbf56ffd700 1 -- 172.21.15.6:0/3977341263 learned_addr learned my addr 172.21.15.6:0/3977341263 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:19:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.667+0000 7fbf567fc700 1 --2- 172.21.15.6:0/3977341263 >> v2:172.21.15.175:3300/0 conn(0x7fbf580af8b0 0x7fbf5815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.667+0000 7fbf55ffb700 1 -- 172.21.15.6:0/3977341263 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686605139 0 0) 0x7fbf5815e190 con 0x7fbf580af4e0 2023-10-06T02:19:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.667+0000 7fbf55ffb700 1 -- 172.21.15.6:0/3977341263 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf44003570 con 0x7fbf580af4e0 2023-10-06T02:19:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf55ffb700 1 -- 172.21.15.6:0/3977341263 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 505394763 0 0) 0x7fbf44003570 con 0x7fbf580af4e0 2023-10-06T02:19:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf55ffb700 1 -- 172.21.15.6:0/3977341263 >> v2:172.21.15.175:3300/0 conn(0x7fbf580af8b0 msgr2=0x7fbf5815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf55ffb700 1 --2- 172.21.15.6:0/3977341263 >> v2:172.21.15.175:3300/0 conn(0x7fbf580af8b0 0x7fbf5815d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf55ffb700 1 -- 172.21.15.6:0/3977341263 >> v1:172.21.15.175:6789/0 conn(0x7fbf580b27f0 legacy=0x7fbf5815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf55ffb700 1 -- 172.21.15.6:0/3977341263 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf580ccaf0 con 0x7fbf580af4e0 2023-10-06T02:19:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf55ffb700 1 -- 172.21.15.6:0/3977341263 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fbf50001470 con 0x7fbf580af4e0 2023-10-06T02:19:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf55ffb700 1 -- 172.21.15.6:0/3977341263 >> v1:172.21.15.6:6789/0 conn(0x7fbf580af4e0 legacy=0x7fbf580b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf55ffb700 1 --2- 172.21.15.6:0/3977341263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf44003a60 0x7fbf44003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf55ffb700 1 --2- 172.21.15.6:0/3977341263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf44004810 0x7fbf44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf55ffb700 1 --2- 172.21.15.6:0/3977341263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf440051c0 0x7fbf4400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf55ffb700 1 -- 172.21.15.6:0/3977341263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580b1910 con 0x7fbf440051c0 2023-10-06T02:19:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf55ffb700 1 -- 172.21.15.6:0/3977341263 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4400c160 con 0x7fbf44004810 2023-10-06T02:19:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf55ffb700 1 -- 172.21.15.6:0/3977341263 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4400c320 con 0x7fbf44003a60 2023-10-06T02:19:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf577fe700 1 --2- 172.21.15.6:0/3977341263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf440051c0 0x7fbf4400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf567fc700 1 --2- 172.21.15.6:0/3977341263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf44004810 0x7fbf44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf56ffd700 1 --2- 172.21.15.6:0/3977341263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf44003a60 0x7fbf44003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf577fe700 1 -- 172.21.15.6:0/3977341263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf44003a60 msgr2=0x7fbf44003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf577fe700 1 --2- 172.21.15.6:0/3977341263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf44003a60 0x7fbf44003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf577fe700 1 -- 172.21.15.6:0/3977341263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf44004810 msgr2=0x7fbf44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf577fe700 1 --2- 172.21.15.6:0/3977341263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf44004810 0x7fbf44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf577fe700 1 -- 172.21.15.6:0/3977341263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf44003570 con 0x7fbf440051c0 2023-10-06T02:19:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf577fe700 1 -- 172.21.15.6:0/3977341263 reap_dead start 2023-10-06T02:19:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf577fe700 1 --2- 172.21.15.6:0/3977341263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf440051c0 0x7fbf4400ba60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbf48001fc0 tx=0x7fbf48001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f42ef1d49b69f57 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf55ffb700 1 -- 172.21.15.6:0/3977341263 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf48001950 con 0x7fbf440051c0 2023-10-06T02:19:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf55ffb700 1 -- 172.21.15.6:0/3977341263 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4800c8b0 con 0x7fbf440051c0 2023-10-06T02:19:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.668+0000 7fbf55ffb700 1 -- 172.21.15.6:0/3977341263 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4800cc50 con 0x7fbf440051c0 2023-10-06T02:19:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.669+0000 7fbf5d6e6700 1 -- 172.21.15.6:0/3977341263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf440051c0 msgr2=0x7fbf4400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.669+0000 7fbf5d6e6700 1 --2- 172.21.15.6:0/3977341263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf440051c0 0x7fbf4400ba60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbf48001fc0 tx=0x7fbf48001640 comp rx=0 tx=0).stop 2023-10-06T02:19:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.669+0000 7fbf5d6e6700 1 -- 172.21.15.6:0/3977341263 shutdown_connections 2023-10-06T02:19:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.669+0000 7fbf5d6e6700 1 --2- 172.21.15.6:0/3977341263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf440051c0 0x7fbf4400ba60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.669+0000 7fbf5d6e6700 1 -- 172.21.15.6:0/3977341263 >> 172.21.15.6:0/3977341263 conn(0x7fbf58068680 msgr2=0x7fbf58068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.669+0000 7fbf5d6e6700 1 -- 172.21.15.6:0/3977341263 shutdown_connections 2023-10-06T02:19:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.669+0000 7fbf5d6e6700 1 -- 172.21.15.6:0/3977341263 wait complete. 2023-10-06T02:19:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.670+0000 7fbf5d6e6700 1 Processor -- start 2023-10-06T02:19:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.670+0000 7fbf5d6e6700 1 -- start start 2023-10-06T02:19:51.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.671+0000 7fbf5d6e6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf440051c0 0x7fbf58158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.671+0000 7fbf5d6e6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf58154100 0x7fbf58154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.671+0000 7fbf5d6e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf5815b4f0 0x7fbf5815b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.671+0000 7fbf5d6e6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5815beb0 con 0x7fbf5815b4f0 2023-10-06T02:19:51.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.671+0000 7fbf5d6e6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5816acf0 con 0x7fbf58154100 2023-10-06T02:19:51.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.671+0000 7fbf5d6e6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf58157750 con 0x7fbf440051c0 2023-10-06T02:19:51.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.671+0000 7fbf577fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf5815b4f0 0x7fbf5815b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.671+0000 7fbf577fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf5815b4f0 0x7fbf5815b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36326/0 (socket says 172.21.15.6:36326) 2023-10-06T02:19:51.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.671+0000 7fbf577fe700 1 -- 172.21.15.6:0/375027004 learned_addr learned my addr 172.21.15.6:0/375027004 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:51.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.671+0000 7fbf567fc700 1 --2- 172.21.15.6:0/375027004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf58154100 0x7fbf58154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.671+0000 7fbf56ffd700 1 --2- 172.21.15.6:0/375027004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf440051c0 0x7fbf58158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.671+0000 7fbf577fe700 1 -- 172.21.15.6:0/375027004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf440051c0 msgr2=0x7fbf58158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.671+0000 7fbf577fe700 1 --2- 172.21.15.6:0/375027004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf440051c0 0x7fbf58158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.671+0000 7fbf577fe700 1 -- 172.21.15.6:0/375027004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf58154100 msgr2=0x7fbf58154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.671+0000 7fbf577fe700 1 --2- 172.21.15.6:0/375027004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf58154100 0x7fbf58154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.671+0000 7fbf577fe700 1 -- 172.21.15.6:0/375027004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf58157a30 con 0x7fbf5815b4f0 2023-10-06T02:19:51.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.672+0000 7fbf577fe700 1 --2- 172.21.15.6:0/375027004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf5815b4f0 0x7fbf5815b970 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbf5815d200 tx=0x7fbf48015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:51.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.672+0000 7fbf4effd700 1 -- 172.21.15.6:0/375027004 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4800c6d0 con 0x7fbf5815b4f0 2023-10-06T02:19:51.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.672+0000 7fbf4effd700 1 -- 172.21.15.6:0/375027004 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf48012e10 con 0x7fbf5815b4f0 2023-10-06T02:19:51.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.672+0000 7fbf5d6e6700 1 -- 172.21.15.6:0/375027004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf58157d10 con 0x7fbf5815b4f0 2023-10-06T02:19:51.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.672+0000 7fbf4effd700 1 -- 172.21.15.6:0/375027004 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf48006dd0 con 0x7fbf5815b4f0 2023-10-06T02:19:51.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.672+0000 7fbf5d6e6700 1 -- 172.21.15.6:0/375027004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf58158770 con 0x7fbf5815b4f0 2023-10-06T02:19:51.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.673+0000 7fbf5d6e6700 1 -- 172.21.15.6:0/375027004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf581575c0 con 0x7fbf5815b4f0 2023-10-06T02:19:51.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.673+0000 7fbf4effd700 1 -- 172.21.15.6:0/375027004 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf48007030 con 0x7fbf5815b4f0 2023-10-06T02:19:51.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.673+0000 7fbf4effd700 1 --2- 172.21.15.6:0/375027004 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbf38066f30 0x7fbf380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:51.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.674+0000 7fbf4effd700 1 -- 172.21.15.6:0/375027004 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fbf48085600 con 0x7fbf5815b4f0 2023-10-06T02:19:51.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.674+0000 7fbf56ffd700 1 --2- 172.21.15.6:0/375027004 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbf38066f30 0x7fbf380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:51.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.674+0000 7fbf56ffd700 1 --2- 172.21.15.6:0/375027004 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbf38066f30 0x7fbf380693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbf50000c00 tx=0x7fbf580ccc80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:51.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.678+0000 7fbf4effd700 1 -- 172.21.15.6:0/375027004 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf48052540 con 0x7fbf5815b4f0 2023-10-06T02:19:51.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.914+0000 7fbf5d6e6700 1 -- 172.21.15.6:0/375027004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbf580cad20 con 0x7fbf5815b4f0 2023-10-06T02:19:51.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.915+0000 7fbf4effd700 1 -- 172.21.15.6:0/375027004 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbf48017070 con 0x7fbf5815b4f0 2023-10-06T02:19:51.916 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:19:51.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.917+0000 7fbf5d6e6700 1 -- 172.21.15.6:0/375027004 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbf38066f30 msgr2=0x7fbf380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.917+0000 7fbf5d6e6700 1 --2- 172.21.15.6:0/375027004 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbf38066f30 0x7fbf380693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbf50000c00 tx=0x7fbf580ccc80 comp rx=0 tx=0).stop 2023-10-06T02:19:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.917+0000 7fbf5d6e6700 1 -- 172.21.15.6:0/375027004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf5815b4f0 msgr2=0x7fbf5815b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.917+0000 7fbf5d6e6700 1 --2- 172.21.15.6:0/375027004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf5815b4f0 0x7fbf5815b970 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbf5815d200 tx=0x7fbf48015000 comp rx=0 tx=0).stop 2023-10-06T02:19:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.917+0000 7fbf5d6e6700 1 -- 172.21.15.6:0/375027004 shutdown_connections 2023-10-06T02:19:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.917+0000 7fbf5d6e6700 1 --2- 172.21.15.6:0/375027004 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbf38066f30 0x7fbf380693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.917+0000 7fbf5d6e6700 1 --2- 172.21.15.6:0/375027004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf5815b4f0 0x7fbf5815b970 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.917+0000 7fbf5d6e6700 1 --2- 172.21.15.6:0/375027004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf440051c0 0x7fbf58158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.917+0000 7fbf5d6e6700 1 --2- 172.21.15.6:0/375027004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf58154100 0x7fbf58154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.917+0000 7fbf5d6e6700 1 -- 172.21.15.6:0/375027004 >> 172.21.15.6:0/375027004 conn(0x7fbf58068680 msgr2=0x7fbf580b5200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.917+0000 7fbf5d6e6700 1 -- 172.21.15.6:0/375027004 shutdown_connections 2023-10-06T02:19:51.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:51.917+0000 7fbf5d6e6700 1 -- 172.21.15.6:0/375027004 wait complete. 2023-10-06T02:19:51.930 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:19:51.930 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:19:51.930 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:19:51.930 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:19:51.930 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:19:51.930 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:19:51.930 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:19:51.930 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:19:51.930 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:19:51.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:51.931 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:19:51.946 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:19:51.946 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:19:51.946 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:19:51.946 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:19:51.946 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:19:51.946 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:19:51.946 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:19:51.947 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:19:51.947 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:19:51.947 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:19:51.947 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:19:51.947 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:19:51.947 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:19:51.947 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:19:51.947 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:19:51.947 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:19:51.947 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42354sec preferred_lft 42354sec 2023-10-06T02:19:51.947 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:19:51.948 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:19:51.948 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:19:51.948 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:19:51.948 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:19:51.948 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:19:51.948 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:19:51.948 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:19:51.948 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:19:51.948 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:19:51.949 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:19:51.949 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:19:51.949 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:19:51.949 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:19:51.949 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:19:51.949 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:19:51.949 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:19:51.949 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:19:51.949 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:19:51.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:51.950 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:19:52.010 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:19:52.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:52.011 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:19:52.067 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:19:52.067 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:19:52.068 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:19:52.068 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:19:52.068 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:19:52.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:52.068 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:19:52.068 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:19:52.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:19:52.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:19:52.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:19:52.069 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:19:52.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:52.171 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:19:52.188 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:19:52.189 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:19:52.189 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:19:52.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:52.189 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:19:52.254 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:19:52.254 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:19:52.255 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:19:52.311 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:19:52.312 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:19:52.312 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:19:52.367 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:19:52.432 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:19:52.433 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:19:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:19:52.498 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:19:52.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:19:52.499 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:19:52.554 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:19:52.554 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:19:52.598 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:19:52.623 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:19:52.623 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:19:52.680 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:19:52.679+0000 7f7d0a753540 -1 init, newargv = 0x565265a5ec90 newargc=15 2023-10-06T02:19:52.680 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[108007]: starting ceph client 2023-10-06T02:19:52.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[108007]: starting fuse 2023-10-06T02:19:52.690 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:19:52.691 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:19:52.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:19:52.693 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:19:52.749 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:19:52.749 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:19:52.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:19:52.749 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:19:52.749 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:19:52.749 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:19:52.749 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:19:52.750 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:19:52.750 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:19:52.750 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:19:52.750 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:19:52.750 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:19:52.750 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:19:52.750 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:19:52.750 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:19:52.750 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:19:52.750 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:19:52.750 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:19:52.750 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:19:52.750 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:19:52.751 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:19:52.751 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:19:52.751 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:19:52.751 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:19:52.751 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:19:52.751 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:19:52.751 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:19:52.751 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:19:52.751 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:19:52.871 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.108007.asok 2023-10-06T02:19:53.054 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.108007.asok 2023-10-06T02:19:53.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:19:53.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.108007.asok status 2023-10-06T02:19:53.212 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:19:53.212 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:19:53.212 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:19:53.213 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:19:53.213 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:19:53.213 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:19:53.213 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:19:53.213 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "108007", 2023-10-06T02:19:53.213 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:19:53.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:19:53.213 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:19:53.213 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:19:53.213 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5538, 2023-10-06T02:19:53.213 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:19:53.214 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:19:53.214 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:19:53.214 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5538 2023-10-06T02:19:53.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:19:53.214 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:19:53.214 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:19:53.215 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:19:53.215 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2562727799 2023-10-06T02:19:53.215 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:19:53.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:19:53.215 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:19:53.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:19:53.215 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:19:53.216 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2562727799 2023-10-06T02:19:53.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:19:53.216 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.5538 192.168.0.1:0/2562727799", 2023-10-06T02:19:53.216 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/2562727799", 2023-10-06T02:19:53.216 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:19:53.216 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 24, 2023-10-06T02:19:53.216 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 42, 2023-10-06T02:19:53.216 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:19:53.217 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:19:53.217 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:19:53.217 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:19:53.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:19:53.222 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:19:53.222 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:19:53.238 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:19:53.238 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:19:53.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:19:53.239 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:19:53.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:19:53.307 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2023-10-06T02:19:53.372 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:19:53.372 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2023-10-06T02:19:53.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.458+0000 7fec13a9b000 1 Processor -- start 2023-10-06T02:19:53.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.458+0000 7fec13a9b000 1 -- start start 2023-10-06T02:19:53.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec13a9b000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8052cd9d0 0x55b8052e95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:53.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec13a9b000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b805372d90 0x55b805370540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:53.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec13a9b000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b805373160 0x55b80535b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:53.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec13a9b000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b805246320 con 0x55b805373160 2023-10-06T02:19:53.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec13a9b000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8051ea980 con 0x55b8052cd9d0 2023-10-06T02:19:53.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec13a9b000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8051ea620 con 0x55b805372d90 2023-10-06T02:19:53.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec0d4d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b805373160 0x55b80535b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:53.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec0d4d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b805373160 0x55b80535b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36344/0 (socket says 172.21.15.6:36344) 2023-10-06T02:19:53.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec0d4d7700 1 -- 172.21.15.6:0/2664871110 learned_addr learned my addr 172.21.15.6:0/2664871110 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:53.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec0ccd6700 1 --2- 172.21.15.6:0/2664871110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8052cd9d0 0x55b8052e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:53.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec0c4d5700 1 --2- 172.21.15.6:0/2664871110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b805372d90 0x55b805370540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:53.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec0d4d7700 1 -- 172.21.15.6:0/2664871110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b805372d90 msgr2=0x55b805370540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:53.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec0d4d7700 1 --2- 172.21.15.6:0/2664871110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b805372d90 0x55b805370540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:53.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec0d4d7700 1 -- 172.21.15.6:0/2664871110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8052cd9d0 msgr2=0x55b8052e95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:53.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec0d4d7700 1 --2- 172.21.15.6:0/2664871110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8052cd9d0 0x55b8052e95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:53.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec0d4d7700 1 -- 172.21.15.6:0/2664871110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec00005cf0 con 0x55b805373160 2023-10-06T02:19:53.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec0ccd6700 1 --2- 172.21.15.6:0/2664871110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8052cd9d0 0x55b8052e95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:53.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec0d4d7700 1 --2- 172.21.15.6:0/2664871110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b805373160 0x55b80535b9f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fec040016e0 tx=0x7fec04006950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb7ce04999039d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:53.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec0b4d3700 1 -- 172.21.15.6:0/2664871110 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec04006320 con 0x55b805373160 2023-10-06T02:19:53.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec0b4d3700 1 -- 172.21.15.6:0/2664871110 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec04004520 con 0x55b805373160 2023-10-06T02:19:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.459+0000 7fec0b4d3700 1 -- 172.21.15.6:0/2664871110 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec040048e0 con 0x55b805373160 2023-10-06T02:19:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.460+0000 7fec13a9b000 1 -- 172.21.15.6:0/2664871110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b805373160 msgr2=0x55b80535b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.460+0000 7fec13a9b000 1 --2- 172.21.15.6:0/2664871110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b805373160 0x55b80535b9f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fec040016e0 tx=0x7fec04006950 comp rx=0 tx=0).stop 2023-10-06T02:19:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.460+0000 7fec13a9b000 1 -- 172.21.15.6:0/2664871110 shutdown_connections 2023-10-06T02:19:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.460+0000 7fec13a9b000 1 --2- 172.21.15.6:0/2664871110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b805373160 0x55b80535b9f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.460+0000 7fec13a9b000 1 --2- 172.21.15.6:0/2664871110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8052cd9d0 0x55b8052e95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.460+0000 7fec13a9b000 1 --2- 172.21.15.6:0/2664871110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b805372d90 0x55b805370540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.460+0000 7fec13a9b000 1 -- 172.21.15.6:0/2664871110 >> 172.21.15.6:0/2664871110 conn(0x55b8052e6c30 msgr2=0x55b8053720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.460+0000 7fec13a9b000 1 -- 172.21.15.6:0/2664871110 shutdown_connections 2023-10-06T02:19:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.460+0000 7fec13a9b000 1 -- 172.21.15.6:0/2664871110 wait complete. 2023-10-06T02:19:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.460+0000 7fec13a9b000 1 Processor -- start 2023-10-06T02:19:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.461+0000 7fec13a9b000 1 -- start start 2023-10-06T02:19:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.461+0000 7fec13a9b000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b8052cd9d0 0x55b805346400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.461+0000 7fec13a9b000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b805372d90 0x55b805346940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.461+0000 7fec13a9b000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b805373160 0x55b805342cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.461+0000 7fec13a9b000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8051e1400 con 0x55b805372d90 2023-10-06T02:19:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.461+0000 7fec13a9b000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8053443e0 con 0x55b805373160 2023-10-06T02:19:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.461+0000 7fec13a9b000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b805344680 con 0x55b8052cd9d0 2023-10-06T02:19:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.461+0000 7fec0c4d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b805372d90 0x55b805346940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.461+0000 7fec0c4d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b805372d90 0x55b805346940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36360/0 (socket says 172.21.15.6:36360) 2023-10-06T02:19:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.461+0000 7fec0c4d5700 1 -- 172.21.15.6:0/735926247 learned_addr learned my addr 172.21.15.6:0/735926247 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.461+0000 7fec0ccd6700 1 --2- 172.21.15.6:0/735926247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b8052cd9d0 0x55b805346400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.461+0000 7fec0d4d7700 1 --2- 172.21.15.6:0/735926247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b805373160 0x55b805342cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.462+0000 7fec0c4d5700 1 -- 172.21.15.6:0/735926247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b8052cd9d0 msgr2=0x55b805346400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:53.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.462+0000 7fec0c4d5700 1 --2- 172.21.15.6:0/735926247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b8052cd9d0 0x55b805346400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:53.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.462+0000 7fec0c4d5700 1 -- 172.21.15.6:0/735926247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b805373160 msgr2=0x55b805342cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:53.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.462+0000 7fec0c4d5700 1 --2- 172.21.15.6:0/735926247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b805373160 0x55b805342cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:53.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.462+0000 7fec0c4d5700 1 -- 172.21.15.6:0/735926247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec04006c30 con 0x55b805372d90 2023-10-06T02:19:53.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.462+0000 7fec0c4d5700 1 --2- 172.21.15.6:0/735926247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b805372d90 0x55b805346940 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x55b8052a02f0 tx=0x7fec00016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:53.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.462+0000 7fec09cd0700 1 -- 172.21.15.6:0/735926247 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec00021070 con 0x55b805372d90 2023-10-06T02:19:53.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.462+0000 7fec09cd0700 1 -- 172.21.15.6:0/735926247 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec000054f0 con 0x55b805372d90 2023-10-06T02:19:53.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.462+0000 7fec09cd0700 1 -- 172.21.15.6:0/735926247 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec000089d0 con 0x55b805372d90 2023-10-06T02:19:53.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.462+0000 7fec13a9b000 1 -- 172.21.15.6:0/735926247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b8051ecae0 con 0x55b805372d90 2023-10-06T02:19:53.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.462+0000 7fec13a9b000 1 -- 172.21.15.6:0/735926247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b8051ec540 con 0x55b805372d90 2023-10-06T02:19:53.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.463+0000 7fec09cd0700 1 -- 172.21.15.6:0/735926247 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec00025070 con 0x55b805372d90 2023-10-06T02:19:53.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.464+0000 7fec09cd0700 1 --2- 172.21.15.6:0/735926247 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7febf8065890 0x7febf8067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:53.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.464+0000 7fec09cd0700 1 -- 172.21.15.6:0/735926247 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fec00086a10 con 0x55b805372d90 2023-10-06T02:19:53.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.464+0000 7fec0ccd6700 1 --2- 172.21.15.6:0/735926247 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7febf8065890 0x7febf8067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:53.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.464+0000 7fec13a9b000 1 --2- 172.21.15.6:0/735926247 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b805343700 0x55b805345570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:53.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.464+0000 7fec13a9b000 1 -- 172.21.15.6:0/735926247 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) v8 -- 0x55b805345ab0 con 0x55b805343700 2023-10-06T02:19:53.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.464+0000 7fec0d4d7700 1 --2- 172.21.15.6:0/735926247 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b805343700 0x55b805345570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:53.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.464+0000 7fec0ccd6700 1 --2- 172.21.15.6:0/735926247 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7febf8065890 0x7febf8067d40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7febfc000c00 tx=0x7febfc0019b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:53.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.464+0000 7fec0d4d7700 1 --2- 172.21.15.6:0/735926247 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b805343700 0x55b805345570 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:53.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.466+0000 7fec0d4d7700 1 -- 172.21.15.6:0/735926247 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v42'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fec04004ce0 con 0x55b805343700 2023-10-06T02:19:53.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.466+0000 7fec13a9b000 1 -- 172.21.15.6:0/735926247 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b805343700 msgr2=0x55b805345570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:53.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.466+0000 7fec13a9b000 1 --2- 172.21.15.6:0/735926247 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b805343700 0x55b805345570 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:53.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.466+0000 7fec13a9b000 1 -- 172.21.15.6:0/735926247 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7febf8065890 msgr2=0x7febf8067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:53.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.466+0000 7fec13a9b000 1 --2- 172.21.15.6:0/735926247 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7febf8065890 0x7febf8067d40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7febfc000c00 tx=0x7febfc0019b0 comp rx=0 tx=0).stop 2023-10-06T02:19:53.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.466+0000 7fec13a9b000 1 -- 172.21.15.6:0/735926247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b805372d90 msgr2=0x55b805346940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:53.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.466+0000 7fec13a9b000 1 --2- 172.21.15.6:0/735926247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b805372d90 0x55b805346940 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x55b8052a02f0 tx=0x7fec00016000 comp rx=0 tx=0).stop 2023-10-06T02:19:53.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.466+0000 7fec0d4d7700 1 -- 172.21.15.6:0/735926247 reap_dead start 2023-10-06T02:19:53.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.466+0000 7fec13a9b000 1 -- 172.21.15.6:0/735926247 shutdown_connections 2023-10-06T02:19:53.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.466+0000 7fec13a9b000 1 -- 172.21.15.6:0/735926247 >> 172.21.15.6:0/735926247 conn(0x55b8052e6c30 msgr2=0x55b8052e9570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:53.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.466+0000 7fec13a9b000 1 -- 172.21.15.6:0/735926247 shutdown_connections 2023-10-06T02:19:53.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.466+0000 7fec13a9b000 1 -- 172.21.15.6:0/735926247 wait complete. 2023-10-06T02:19:53.477 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:19:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.632+0000 7ffad4eaf700 1 Processor -- start 2023-10-06T02:19:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.633+0000 7ffad4eaf700 1 -- start start 2023-10-06T02:19:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.633+0000 7ffad4eaf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad00b27f0 0x7ffad015db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.633+0000 7ffad4eaf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad015e190 con 0x7ffad00af8b0 2023-10-06T02:19:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.633+0000 7ffad4eaf700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad00cb650 con 0x7ffad00af4e0 2023-10-06T02:19:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.633+0000 7ffad4eaf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00b1910 con 0x7ffad00b27f0 2023-10-06T02:19:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.634+0000 7ffacdd9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ffad00af8b0 0x7ffad015d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47076/0 (socket says 172.21.15.6:47076) 2023-10-06T02:19:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.634+0000 7ffacdd9b700 1 -- 172.21.15.6:0/817386305 learned_addr learned my addr 172.21.15.6:0/817386305 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:19:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.634+0000 7ffaced9d700 1 --2- 172.21.15.6:0/817386305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad00b27f0 0x7ffad015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.634+0000 7ffacd59a700 1 -- 172.21.15.6:0/817386305 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187002448 0 0) 0x7ffad015e190 con 0x7ffad00af8b0 2023-10-06T02:19:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.634+0000 7ffacd59a700 1 -- 172.21.15.6:0/817386305 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffabc003570 con 0x7ffad00af8b0 2023-10-06T02:19:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.634+0000 7ffacd59a700 1 -- 172.21.15.6:0/817386305 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365320028 0 0) 0x7ffad00cb650 con 0x7ffad00af4e0 2023-10-06T02:19:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.634+0000 7ffacd59a700 1 -- 172.21.15.6:0/817386305 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffad015e190 con 0x7ffad00af4e0 2023-10-06T02:19:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.634+0000 7ffacd59a700 1 -- 172.21.15.6:0/817386305 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1652931123 0 0) 0x7ffabc003570 con 0x7ffad00af8b0 2023-10-06T02:19:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.634+0000 7ffaced9d700 1 -- 172.21.15.6:0/817386305 >> v1:172.21.15.175:6789/0 conn(0x7ffad00af4e0 legacy=0x7ffad00b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.634+0000 7ffaced9d700 1 -- 172.21.15.6:0/817386305 >> v1:172.21.15.6:6789/0 conn(0x7ffad00af8b0 legacy=0x7ffad015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.634+0000 7ffaced9d700 1 -- 172.21.15.6:0/817386305 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad00ccaf0 con 0x7ffad00b27f0 2023-10-06T02:19:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.634+0000 7ffaced9d700 1 --2- 172.21.15.6:0/817386305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad00b27f0 0x7ffad015db70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009e90 tx=0x7ffac0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=863cee317b82840c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.634+0000 7ffacd59a700 1 -- 172.21.15.6:0/817386305 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac000e070 con 0x7ffad00b27f0 2023-10-06T02:19:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.635+0000 7ffacd59a700 1 -- 172.21.15.6:0/817386305 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac000b870 con 0x7ffad00b27f0 2023-10-06T02:19:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.635+0000 7ffacd59a700 1 -- 172.21.15.6:0/817386305 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8001470 con 0x7ffad00b27f0 2023-10-06T02:19:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.635+0000 7ffad4eaf700 1 -- 172.21.15.6:0/817386305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad00b27f0 msgr2=0x7ffad015db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.635+0000 7ffad4eaf700 1 --2- 172.21.15.6:0/817386305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad00b27f0 0x7ffad015db70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009e90 tx=0x7ffac0009780 comp rx=0 tx=0).stop 2023-10-06T02:19:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.635+0000 7ffad4eaf700 1 -- 172.21.15.6:0/817386305 shutdown_connections 2023-10-06T02:19:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.635+0000 7ffad4eaf700 1 --2- 172.21.15.6:0/817386305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad00b27f0 0x7ffad015db70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.635+0000 7ffad4eaf700 1 -- 172.21.15.6:0/817386305 >> 172.21.15.6:0/817386305 conn(0x7ffad0068680 msgr2=0x7ffad0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.635+0000 7ffad4eaf700 1 -- 172.21.15.6:0/817386305 shutdown_connections 2023-10-06T02:19:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.635+0000 7ffad4eaf700 1 -- 172.21.15.6:0/817386305 wait complete. 2023-10-06T02:19:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.636+0000 7ffad4eaf700 1 Processor -- start 2023-10-06T02:19:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.636+0000 7ffad4eaf700 1 -- start start 2023-10-06T02:19:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.637+0000 7ffad4eaf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad00af4e0 0x7ffad0154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.637+0000 7ffad4eaf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad00af8b0 0x7ffad00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.637+0000 7ffad4eaf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad00b27f0 0x7ffad0156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.637+0000 7ffad4eaf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00c7bd0 con 0x7ffad00af4e0 2023-10-06T02:19:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.637+0000 7ffad4eaf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00c7e70 con 0x7ffad00af8b0 2023-10-06T02:19:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.637+0000 7ffad4eaf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00cfe00 con 0x7ffad00b27f0 2023-10-06T02:19:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.637+0000 7fface59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad00af4e0 0x7ffad0154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.637+0000 7fface59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad00af4e0 0x7ffad0154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36370/0 (socket says 172.21.15.6:36370) 2023-10-06T02:19:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.637+0000 7fface59c700 1 -- 172.21.15.6:0/1651110396 learned_addr learned my addr 172.21.15.6:0/1651110396 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.637+0000 7ffacdd9b700 1 --2- 172.21.15.6:0/1651110396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad00af8b0 0x7ffad00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.637+0000 7ffaced9d700 1 --2- 172.21.15.6:0/1651110396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad00b27f0 0x7ffad0156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.637+0000 7fface59c700 1 -- 172.21.15.6:0/1651110396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad00b27f0 msgr2=0x7ffad0156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.637+0000 7fface59c700 1 --2- 172.21.15.6:0/1651110396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad00b27f0 0x7ffad0156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.637+0000 7fface59c700 1 -- 172.21.15.6:0/1651110396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad00af8b0 msgr2=0x7ffad00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.638+0000 7fface59c700 1 --2- 172.21.15.6:0/1651110396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad00af8b0 0x7ffad00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.638+0000 7fface59c700 1 -- 172.21.15.6:0/1651110396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac0009a20 con 0x7ffad00af4e0 2023-10-06T02:19:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.638+0000 7fface59c700 1 --2- 172.21.15.6:0/1651110396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad00af4e0 0x7ffad0154d60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ffac800c580 tx=0x7ffac8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.638+0000 7ffac67fc700 1 -- 172.21.15.6:0/1651110396 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac8010510 con 0x7ffad00af4e0 2023-10-06T02:19:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.638+0000 7ffac67fc700 1 -- 172.21.15.6:0/1651110396 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac8010670 con 0x7ffad00af4e0 2023-10-06T02:19:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.638+0000 7ffac67fc700 1 -- 172.21.15.6:0/1651110396 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac8010a30 con 0x7ffad00af4e0 2023-10-06T02:19:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.638+0000 7ffad4eaf700 1 -- 172.21.15.6:0/1651110396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad00d00e0 con 0x7ffad00af4e0 2023-10-06T02:19:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.638+0000 7ffad4eaf700 1 -- 172.21.15.6:0/1651110396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad00cfa30 con 0x7ffad00af4e0 2023-10-06T02:19:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.639+0000 7ffad4eaf700 1 -- 172.21.15.6:0/1651110396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad00694a0 con 0x7ffad00af4e0 2023-10-06T02:19:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.639+0000 7ffac67fc700 1 -- 172.21.15.6:0/1651110396 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffac801b400 con 0x7ffad00af4e0 2023-10-06T02:19:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.640+0000 7ffac67fc700 1 --2- 172.21.15.6:0/1651110396 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffab0066f30 0x7ffab00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.640+0000 7ffac67fc700 1 -- 172.21.15.6:0/1651110396 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7ffac8084580 con 0x7ffad00af4e0 2023-10-06T02:19:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.640+0000 7ffacdd9b700 1 --2- 172.21.15.6:0/1651110396 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffab0066f30 0x7ffab00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.641+0000 7ffacdd9b700 1 --2- 172.21.15.6:0/1651110396 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffab0066f30 0x7ffab00693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffad015a100 tx=0x7ffab8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.644+0000 7ffac67fc700 1 -- 172.21.15.6:0/1651110396 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffac80514c0 con 0x7ffad00af4e0 2023-10-06T02:19:53.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.883+0000 7ffad4eaf700 1 -- 172.21.15.6:0/1651110396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffad00d0600 con 0x7ffad00af4e0 2023-10-06T02:19:53.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.884+0000 7ffac67fc700 1 -- 172.21.15.6:0/1651110396 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4595 (secure 0 0 0) 0x7ffac8054ae0 con 0x7ffad00af4e0 2023-10-06T02:19:53.886 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:19:53.886 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1173605075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1173605075},{"type":"v1","addr":"172.21.15.175:6837","nonce":1173605075}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/375122461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":375122461},{"type":"v1","addr":"172.21.15.175:6835","nonce":375122461}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5142,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3506443204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3506443204},{"type":"v1","addr":"172.21.15.6:6835","nonce":3506443204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:18:45.349958+0000","modified":"2023-10-06T02:19:16.895235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5385},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5385":{"gid":5385,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.6:6834/1188971598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1188971598},{"type":"v1","addr":"172.21.15.6:6834","nonce":1188971598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:19:53.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.886+0000 7ffad4eaf700 1 -- 172.21.15.6:0/1651110396 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffab0066f30 msgr2=0x7ffab00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:53.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.886+0000 7ffad4eaf700 1 --2- 172.21.15.6:0/1651110396 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffab0066f30 0x7ffab00693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffad015a100 tx=0x7ffab8009040 comp rx=0 tx=0).stop 2023-10-06T02:19:53.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.886+0000 7ffad4eaf700 1 -- 172.21.15.6:0/1651110396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad00af4e0 msgr2=0x7ffad0154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:53.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.886+0000 7ffad4eaf700 1 --2- 172.21.15.6:0/1651110396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad00af4e0 0x7ffad0154d60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ffac800c580 tx=0x7ffac8007e10 comp rx=0 tx=0).stop 2023-10-06T02:19:53.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.886+0000 7ffad4eaf700 1 -- 172.21.15.6:0/1651110396 shutdown_connections 2023-10-06T02:19:53.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.886+0000 7ffad4eaf700 1 --2- 172.21.15.6:0/1651110396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad00b27f0 0x7ffad0156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:53.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.886+0000 7ffad4eaf700 1 --2- 172.21.15.6:0/1651110396 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffab0066f30 0x7ffab00693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:53.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.886+0000 7ffad4eaf700 1 --2- 172.21.15.6:0/1651110396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad00af4e0 0x7ffad0154d60 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.886+0000 7ffad4eaf700 1 --2- 172.21.15.6:0/1651110396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad00af8b0 0x7ffad00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.886+0000 7ffad4eaf700 1 -- 172.21.15.6:0/1651110396 >> 172.21.15.6:0/1651110396 conn(0x7ffad0068680 msgr2=0x7ffad015c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.886+0000 7ffad4eaf700 1 -- 172.21.15.6:0/1651110396 shutdown_connections 2023-10-06T02:19:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:53.886+0000 7ffad4eaf700 1 -- 172.21.15.6:0/1651110396 wait complete. 2023-10-06T02:19:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 24 2023-10-06T02:19:53.899 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 2747863959 2023-10-06T02:19:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.022+0000 7f1db7651700 1 Processor -- start 2023-10-06T02:19:54.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.022+0000 7f1db7651700 1 -- start start 2023-10-06T02:19:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.023+0000 7f1db7651700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1db00af3f0 0x7f1db015a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.023+0000 7f1db7651700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db015a170 con 0x7f1db00af7c0 2023-10-06T02:19:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.023+0000 7f1db7651700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db00caeb0 con 0x7f1db0159960 2023-10-06T02:19:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.023+0000 7f1db7651700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db015db80 con 0x7f1db00af3f0 2023-10-06T02:19:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.023+0000 7f1db4bec700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1db00af7c0 0x7f1db015d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47082/0 (socket says 172.21.15.6:47082) 2023-10-06T02:19:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.023+0000 7f1db4bec700 1 -- 172.21.15.6:0/2285265526 learned_addr learned my addr 172.21.15.6:0/2285265526 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:19:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.023+0000 7f1db53ed700 1 --2- 172.21.15.6:0/2285265526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1db00af3f0 0x7f1db015a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.023+0000 7f1da7fff700 1 -- 172.21.15.6:0/2285265526 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501229035 0 0) 0x7f1db015a170 con 0x7f1db00af7c0 2023-10-06T02:19:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.023+0000 7f1da7fff700 1 -- 172.21.15.6:0/2285265526 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d9c003570 con 0x7f1db00af7c0 2023-10-06T02:19:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.023+0000 7f1da7fff700 1 -- 172.21.15.6:0/2285265526 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989984623 0 0) 0x7f1db00caeb0 con 0x7f1db0159960 2023-10-06T02:19:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.023+0000 7f1da7fff700 1 -- 172.21.15.6:0/2285265526 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1db015a170 con 0x7f1db0159960 2023-10-06T02:19:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.023+0000 7f1db53ed700 1 -- 172.21.15.6:0/2285265526 >> v1:172.21.15.175:6789/0 conn(0x7f1db0159960 legacy=0x7f1db0068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.023+0000 7f1db53ed700 1 -- 172.21.15.6:0/2285265526 >> v1:172.21.15.6:6789/0 conn(0x7f1db00af7c0 legacy=0x7f1db015d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.023+0000 7f1db53ed700 1 -- 172.21.15.6:0/2285265526 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db015de60 con 0x7f1db00af3f0 2023-10-06T02:19:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.024+0000 7f1db53ed700 1 --2- 172.21.15.6:0/2285265526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1db00af3f0 0x7f1db015a600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009910 tx=0x7f1dac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=890136bf395fe849 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.024+0000 7f1da7fff700 1 -- 172.21.15.6:0/2285265526 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac011630 con 0x7f1db00af3f0 2023-10-06T02:19:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.024+0000 7f1da7fff700 1 -- 172.21.15.6:0/2285265526 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac011790 con 0x7f1db00af3f0 2023-10-06T02:19:54.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.024+0000 7f1da7fff700 1 -- 172.21.15.6:0/2285265526 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac011b30 con 0x7f1db00af3f0 2023-10-06T02:19:54.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.024+0000 7f1db7651700 1 -- 172.21.15.6:0/2285265526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1db00af3f0 msgr2=0x7f1db015a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:54.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.024+0000 7f1db7651700 1 --2- 172.21.15.6:0/2285265526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1db00af3f0 0x7f1db015a600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009910 tx=0x7f1dac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.024+0000 7f1db7651700 1 -- 172.21.15.6:0/2285265526 shutdown_connections 2023-10-06T02:19:54.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.024+0000 7f1db7651700 1 --2- 172.21.15.6:0/2285265526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1db00af3f0 0x7f1db015a600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.025+0000 7f1db7651700 1 -- 172.21.15.6:0/2285265526 >> 172.21.15.6:0/2285265526 conn(0x7f1db006a260 msgr2=0x7f1db00cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:54.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.025+0000 7f1db7651700 1 -- 172.21.15.6:0/2285265526 shutdown_connections 2023-10-06T02:19:54.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.025+0000 7f1db7651700 1 -- 172.21.15.6:0/2285265526 wait complete. 2023-10-06T02:19:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.026+0000 7f1db7651700 1 Processor -- start 2023-10-06T02:19:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.026+0000 7f1db7651700 1 -- start start 2023-10-06T02:19:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db7651700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1db00af3f0 0x7f1db00c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db7651700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1db0159960 0x7f1db016a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db7651700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db00b2630 0x7f1db016b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db7651700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00c5d60 con 0x7f1db00b2630 2023-10-06T02:19:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db7651700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00c42a0 con 0x7f1db00af3f0 2023-10-06T02:19:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db7651700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db016b400 con 0x7f1db0159960 2023-10-06T02:19:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db5bee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db00b2630 0x7f1db016b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db5bee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db00b2630 0x7f1db016b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36382/0 (socket says 172.21.15.6:36382) 2023-10-06T02:19:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db5bee700 1 -- 172.21.15.6:0/1161359483 learned_addr learned my addr 172.21.15.6:0/1161359483 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db53ed700 1 --2- 172.21.15.6:0/1161359483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1db00af3f0 0x7f1db00c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db4bec700 1 --2- 172.21.15.6:0/1161359483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1db0159960 0x7f1db016a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db5bee700 1 -- 172.21.15.6:0/1161359483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1db0159960 msgr2=0x7f1db016a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db5bee700 1 --2- 172.21.15.6:0/1161359483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1db0159960 0x7f1db016a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db5bee700 1 -- 172.21.15.6:0/1161359483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1db00af3f0 msgr2=0x7f1db00c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db5bee700 1 --2- 172.21.15.6:0/1161359483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1db00af3f0 0x7f1db00c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db5bee700 1 -- 172.21.15.6:0/1161359483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac009420 con 0x7f1db00b2630 2023-10-06T02:19:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db5bee700 1 --2- 172.21.15.6:0/1161359483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db00b2630 0x7f1db016b630 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1da800c910 tx=0x7f1da8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1da57fa700 1 -- 172.21.15.6:0/1161359483 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8012630 con 0x7f1db00b2630 2023-10-06T02:19:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1da57fa700 1 -- 172.21.15.6:0/1161359483 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da80127b0 con 0x7f1db00b2630 2023-10-06T02:19:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db7651700 1 -- 172.21.15.6:0/1161359483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db016ab60 con 0x7f1db00b2630 2023-10-06T02:19:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1da57fa700 1 -- 172.21.15.6:0/1161359483 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8012b70 con 0x7f1db00b2630 2023-10-06T02:19:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.027+0000 7f1db7651700 1 -- 172.21.15.6:0/1161359483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db016b120 con 0x7f1db00b2630 2023-10-06T02:19:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.029+0000 7f1da57fa700 1 -- 172.21.15.6:0/1161359483 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1da801b400 con 0x7f1db00b2630 2023-10-06T02:19:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.029+0000 7f1da57fa700 1 --2- 172.21.15.6:0/1161359483 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d94066f30 0x7f1d940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.029+0000 7f1da57fa700 1 -- 172.21.15.6:0/1161359483 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f1da8084ab0 con 0x7f1db00b2630 2023-10-06T02:19:54.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.029+0000 7f1db53ed700 1 --2- 172.21.15.6:0/1161359483 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d94066f30 0x7f1d940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.030+0000 7f1db53ed700 1 --2- 172.21.15.6:0/1161359483 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d94066f30 0x7f1d940693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009860 tx=0x7f1dac017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.031+0000 7f1dc0949b80 1 Processor -- start 2023-10-06T02:19:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.031+0000 7f1dc0949b80 1 -- start start 2023-10-06T02:19:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1dc0949b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6b8c0 0x55f3f0b6bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1dc0949b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0b6cd40 0x55f3f0bbb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1dc0949b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0bbbc80 0x55f3f0bbc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1dc0949b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f0ac2af0 con 0x55f3f0bbbc80 2023-10-06T02:19:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1dc0949b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f0ac02f0 con 0x55f3f0b6b8c0 2023-10-06T02:19:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1dc0949b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3f0abc0e0 con 0x55f3f0b6cd40 2023-10-06T02:19:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1db5bee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0bbbc80 0x55f3f0bbc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1db53ed700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6b8c0 0x55f3f0b6bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1db5bee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0bbbc80 0x55f3f0bbc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36386/0 (socket says 172.21.15.6:36386) 2023-10-06T02:19:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1db5bee700 1 -- 172.21.15.6:0/1156020709 learned_addr learned my addr 172.21.15.6:0/1156020709 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1db4bec700 1 --2- 172.21.15.6:0/1156020709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0b6cd40 0x55f3f0bbb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1db5bee700 1 -- 172.21.15.6:0/1156020709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0b6cd40 msgr2=0x55f3f0bbb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1db5bee700 1 --2- 172.21.15.6:0/1156020709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0b6cd40 0x55f3f0bbb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1db5bee700 1 -- 172.21.15.6:0/1156020709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6b8c0 msgr2=0x55f3f0b6bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1db5bee700 1 --2- 172.21.15.6:0/1156020709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6b8c0 0x55f3f0b6bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1db5bee700 1 -- 172.21.15.6:0/1156020709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3f09562f0 con 0x55f3f0bbbc80 2023-10-06T02:19:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1db5bee700 1 --2- 172.21.15.6:0/1156020709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0bbbc80 0x55f3f0bbc0d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1da8055640 tx=0x7f1da8082c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e030b32a39c6003d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1d9a7fc700 1 -- 172.21.15.6:0/1156020709 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8055e30 con 0x55f3f0bbbc80 2023-10-06T02:19:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1d9a7fc700 1 -- 172.21.15.6:0/1156020709 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da80556b0 con 0x55f3f0bbbc80 2023-10-06T02:19:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.032+0000 7f1d9a7fc700 1 -- 172.21.15.6:0/1156020709 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8058900 con 0x55f3f0bbbc80 2023-10-06T02:19:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.033+0000 7f1dc0949b80 1 -- 172.21.15.6:0/1156020709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0bbbc80 msgr2=0x55f3f0bbc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.033+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/1156020709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0bbbc80 0x55f3f0bbc0d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1da8055640 tx=0x7f1da8082c00 comp rx=0 tx=0).stop 2023-10-06T02:19:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.033+0000 7f1dc0949b80 1 -- 172.21.15.6:0/1156020709 shutdown_connections 2023-10-06T02:19:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.033+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/1156020709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0bbbc80 0x55f3f0bbc0d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.033+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/1156020709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6b8c0 0x55f3f0b6bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.033+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/1156020709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0b6cd40 0x55f3f0bbb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.033+0000 7f1dc0949b80 1 -- 172.21.15.6:0/1156020709 >> 172.21.15.6:0/1156020709 conn(0x55f3f0b6d1e0 msgr2=0x55f3f0b6d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.033+0000 7f1dc0949b80 1 -- 172.21.15.6:0/1156020709 shutdown_connections 2023-10-06T02:19:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.033+0000 7f1dc0949b80 1 -- 172.21.15.6:0/1156020709 wait complete. 2023-10-06T02:19:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.034+0000 7f1dc0949b80 1 -- start start 2023-10-06T02:19:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.034+0000 7f1dc0949b80 1 Processor -- start 2023-10-06T02:19:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1dc0949b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0b6b8c0 0x55f3f0bb2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1dc0949b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6cd40 0x55f3f0bc2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1dc0949b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0bbbc80 0x55f3f0b95cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1dc0949b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f0a67910 con 0x55f3f0bbbc80 2023-10-06T02:19:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1dc0949b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f0a82f20 con 0x55f3f0b6cd40 2023-10-06T02:19:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1dc0949b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3f093eeb0 con 0x55f3f0b6b8c0 2023-10-06T02:19:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1dc0949b80 10 client.0 _ll_register_callbacks cb 0x55f3f0b2eef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:19:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1db5bee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0bbbc80 0x55f3f0b95cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1db5bee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0bbbc80 0x55f3f0b95cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36392/0 (socket says 172.21.15.6:36392) 2023-10-06T02:19:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1db5bee700 1 -- 172.21.15.6:0/45655037 learned_addr learned my addr 172.21.15.6:0/45655037 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1db53ed700 1 --2- 172.21.15.6:0/45655037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0b6b8c0 0x55f3f0bb2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1db4bec700 1 --2- 172.21.15.6:0/45655037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6cd40 0x55f3f0bc2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1db5bee700 1 -- 172.21.15.6:0/45655037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0b6b8c0 msgr2=0x55f3f0bb2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1db5bee700 1 --2- 172.21.15.6:0/45655037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0b6b8c0 0x55f3f0bb2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1db5bee700 1 -- 172.21.15.6:0/45655037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6cd40 msgr2=0x55f3f0bc2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1db5bee700 1 --2- 172.21.15.6:0/45655037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6cd40 0x55f3f0bc2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1db5bee700 1 -- 172.21.15.6:0/45655037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db016b120 con 0x55f3f0bbbc80 2023-10-06T02:19:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1db4bec700 1 --2- 172.21.15.6:0/45655037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6cd40 0x55f3f0bc2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1db5bee700 1 --2- 172.21.15.6:0/45655037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0bbbc80 0x55f3f0b95cb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1da8082d80 tx=0x7f1da806f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4dd5a30cd4348a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1d8f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:19:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1d8f7fe700 1 -- 172.21.15.6:0/45655037 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8055910 con 0x55f3f0bbbc80 2023-10-06T02:19:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1d8f7fe700 1 -- 172.21.15.6:0/45655037 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f1da8055a70 con 0x55f3f0bbbc80 2023-10-06T02:19:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.035+0000 7f1dc0949b80 1 -- 172.21.15.6:0/45655037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3f0b609c0 con 0x55f3f0bbbc80 2023-10-06T02:19:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.036+0000 7f1d8f7fe700 1 -- 172.21.15.6:0/45655037 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1da8054db0 con 0x55f3f0bbbc80 2023-10-06T02:19:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.036+0000 7f1dc0949b80 10 client.5568 fetch_fsmap learned FSMap version 24 2023-10-06T02:19:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.036+0000 7f1dc0949b80 1 -- 172.21.15.6:0/45655037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55f3f08f9060 con 0x55f3f0bbbc80 2023-10-06T02:19:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.036+0000 7f1d8f7fe700 1 -- 172.21.15.6:0/45655037 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f3f0b609c0 con 0x55f3f0bbbc80 2023-10-06T02:19:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.036+0000 7f1d8f7fe700 1 -- 172.21.15.6:0/45655037 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1da805c1c0 con 0x55f3f0bbbc80 2023-10-06T02:19:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.036+0000 7f1dc0949b80 10 client.5568 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:19:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.036+0000 7f1dc0949b80 10 client.5568 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:19:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.036+0000 7f1dc0949b80 20 client.5568 populate_metadata read hostname 'smithi006' 2023-10-06T02:19:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.036+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/45655037 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55f3f0b96620 0x55f3f0b97940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.036+0000 7f1dc0949b80 4 client.5568 mds_command: new command op to 5385 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:19:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.036+0000 7f1dc0949b80 1 -- 172.21.15.6:0/45655037 --> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3f0b3d8f0 con 0x55f3f0b96620 2023-10-06T02:19:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.036+0000 7f1db53ed700 1 --2- 172.21.15.6:0/45655037 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55f3f0b96620 0x55f3f0b97940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.036+0000 7f1d8f7fe700 10 client.5568 ms_handle_connect on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.036+0000 7f1db53ed700 1 --2- 172.21.15.6:0/45655037 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55f3f0b96620 0x55f3f0b97940 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5b549462ae8b766 server_cookie=71b14886955d873e in_seq=0 out_seq=0 2023-10-06T02:19:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.037+0000 7f1d8f7fe700 1 -- 172.21.15.6:0/45655037 <== mds.0 v2:172.21.15.6:6832/1188971598 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f3f0b3d8f0 con 0x55f3f0b96620 2023-10-06T02:19:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.037+0000 7f1d8f7fe700 10 client.5568 handle_command_reply: tid=0 2023-10-06T02:19:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.037+0000 7f1dc0949b80 1 client.5568 shutdown 2023-10-06T02:19:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.037+0000 7f1dc0949b80 1 -- 172.21.15.6:0/45655037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0bbbc80 msgr2=0x55f3f0b95cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.037+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/45655037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0bbbc80 0x55f3f0b95cb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1da8082d80 tx=0x7f1da806f000 comp rx=0 tx=0).stop 2023-10-06T02:19:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.037+0000 7f1dc0949b80 1 -- 172.21.15.6:0/45655037 shutdown_connections 2023-10-06T02:19:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.037+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/45655037 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55f3f0b96620 0x55f3f0b97940 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.037+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/45655037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0bbbc80 0x55f3f0b95cb0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.037+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/45655037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0b6b8c0 0x55f3f0bb2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.037+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/45655037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6cd40 0x55f3f0bc2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.037+0000 7f1d8f7fe700 0 client.5568 ms_handle_reset on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:54.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.037+0000 7f1dc0949b80 1 -- 172.21.15.6:0/45655037 >> 172.21.15.6:0/45655037 conn(0x55f3f0b6d1e0 msgr2=0x55f3f0b94a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:54.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.037+0000 7f1dc0949b80 1 -- 172.21.15.6:0/45655037 shutdown_connections 2023-10-06T02:19:54.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.037+0000 7f1dc0949b80 1 -- 172.21.15.6:0/45655037 wait complete. 2023-10-06T02:19:54.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.037+0000 7f1dc0949b80 20 client.5568 trim_cache size 0 max 16384 2023-10-06T02:19:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.050+0000 7f1dc0949b80 1 Processor -- start 2023-10-06T02:19:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.050+0000 7f1dc0949b80 1 -- start start 2023-10-06T02:19:54.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.050+0000 7f1dc0949b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6b8c0 0x55f3f0bc18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.050+0000 7f1dc0949b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0b6cd40 0x55f3f0b698e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.050+0000 7f1dc0949b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0bbbc80 0x55f3f0b95be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.050+0000 7f1dc0949b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f0bb4d90 con 0x55f3f0b6cd40 2023-10-06T02:19:54.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.050+0000 7f1dc0949b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f0bc1f50 con 0x55f3f0b6b8c0 2023-10-06T02:19:54.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.050+0000 7f1dc0949b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3f0bace20 con 0x55f3f0bbbc80 2023-10-06T02:19:54.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.051+0000 7f1db4bec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0b6cd40 0x55f3f0b698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.051+0000 7f1db4bec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0b6cd40 0x55f3f0b698e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36396/0 (socket says 172.21.15.6:36396) 2023-10-06T02:19:54.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.051+0000 7f1db4bec700 1 -- 172.21.15.6:0/352583654 learned_addr learned my addr 172.21.15.6:0/352583654 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:54.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.051+0000 7f1db5bee700 1 --2- 172.21.15.6:0/352583654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0bbbc80 0x55f3f0b95be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.051+0000 7f1db53ed700 1 --2- 172.21.15.6:0/352583654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6b8c0 0x55f3f0bc18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.051+0000 7f1db4bec700 1 -- 172.21.15.6:0/352583654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0bbbc80 msgr2=0x55f3f0b95be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:54.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.051+0000 7f1db4bec700 1 --2- 172.21.15.6:0/352583654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0bbbc80 0x55f3f0b95be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.051+0000 7f1db4bec700 1 -- 172.21.15.6:0/352583654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6b8c0 msgr2=0x55f3f0bc18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:54.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.051+0000 7f1db4bec700 1 --2- 172.21.15.6:0/352583654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6b8c0 0x55f3f0bc18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.051+0000 7f1db4bec700 1 -- 172.21.15.6:0/352583654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3f0a8a800 con 0x55f3f0b6cd40 2023-10-06T02:19:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.051+0000 7f1db5bee700 1 --2- 172.21.15.6:0/352583654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0bbbc80 0x55f3f0b95be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.051+0000 7f1db53ed700 1 --2- 172.21.15.6:0/352583654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6b8c0 0x55f3f0bc18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.051+0000 7f1db4bec700 1 --2- 172.21.15.6:0/352583654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0b6cd40 0x55f3f0b698e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1da0005d20 tx=0x7f1da0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7edc4e7f68100a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.051+0000 7f1d9affd700 1 -- 172.21.15.6:0/352583654 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da00016e0 con 0x55f3f0b6cd40 2023-10-06T02:19:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.051+0000 7f1d9affd700 1 -- 172.21.15.6:0/352583654 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da0001840 con 0x55f3f0b6cd40 2023-10-06T02:19:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.051+0000 7f1d9affd700 1 -- 172.21.15.6:0/352583654 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0001bc0 con 0x55f3f0b6cd40 2023-10-06T02:19:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.052+0000 7f1dc0949b80 1 -- 172.21.15.6:0/352583654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0b6cd40 msgr2=0x55f3f0b698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.052+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/352583654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0b6cd40 0x55f3f0b698e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1da0005d20 tx=0x7f1da0009040 comp rx=0 tx=0).stop 2023-10-06T02:19:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.052+0000 7f1dc0949b80 1 -- 172.21.15.6:0/352583654 shutdown_connections 2023-10-06T02:19:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.052+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/352583654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0bbbc80 0x55f3f0b95be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.052+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/352583654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6b8c0 0x55f3f0bc18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.052+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/352583654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0b6cd40 0x55f3f0b698e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.052+0000 7f1dc0949b80 1 -- 172.21.15.6:0/352583654 >> 172.21.15.6:0/352583654 conn(0x55f3f0b6d1e0 msgr2=0x55f3f0b6ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:54.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.052+0000 7f1dc0949b80 1 -- 172.21.15.6:0/352583654 shutdown_connections 2023-10-06T02:19:54.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.052+0000 7f1dc0949b80 1 -- 172.21.15.6:0/352583654 wait complete. 2023-10-06T02:19:54.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.052+0000 7f1dc0949b80 1 -- start start 2023-10-06T02:19:54.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.052+0000 7f1dc0949b80 1 Processor -- start 2023-10-06T02:19:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.053+0000 7f1dc0949b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0b6b8c0 0x55f3f0b94dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.053+0000 7f1dc0949b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6cd40 0x55f3f0bb8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.053+0000 7f1dc0949b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0bbbc80 0x55f3f0c16fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.053+0000 7f1dc0949b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f0b95730 con 0x55f3f0b6b8c0 2023-10-06T02:19:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.053+0000 7f1dc0949b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f0bc0c00 con 0x55f3f0b6cd40 2023-10-06T02:19:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.053+0000 7f1dc0949b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3f0bc0ee0 con 0x55f3f0bbbc80 2023-10-06T02:19:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.053+0000 7f1dc0949b80 10 client.0 _ll_register_callbacks cb 0x55f3f0b2eef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:19:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.053+0000 7f1db53ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0b6b8c0 0x55f3f0b94dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.053+0000 7f1db53ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0b6b8c0 0x55f3f0b94dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36400/0 (socket says 172.21.15.6:36400) 2023-10-06T02:19:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.053+0000 7f1db53ed700 1 -- 172.21.15.6:0/1414124278 learned_addr learned my addr 172.21.15.6:0/1414124278 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.053+0000 7f1db4bec700 1 --2- 172.21.15.6:0/1414124278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6cd40 0x55f3f0bb8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.053+0000 7f1db5bee700 1 --2- 172.21.15.6:0/1414124278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0bbbc80 0x55f3f0c16fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1db53ed700 1 -- 172.21.15.6:0/1414124278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0bbbc80 msgr2=0x55f3f0c16fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1db53ed700 1 --2- 172.21.15.6:0/1414124278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0bbbc80 0x55f3f0c16fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1db53ed700 1 -- 172.21.15.6:0/1414124278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6cd40 msgr2=0x55f3f0bb8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1db53ed700 1 --2- 172.21.15.6:0/1414124278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6cd40 0x55f3f0bb8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1db53ed700 1 -- 172.21.15.6:0/1414124278 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c003570 con 0x55f3f0b6b8c0 2023-10-06T02:19:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1db5bee700 1 --2- 172.21.15.6:0/1414124278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0bbbc80 0x55f3f0c16fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1db53ed700 1 --2- 172.21.15.6:0/1414124278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0b6b8c0 0x55f3f0b94dc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1dac013000 tx=0x7f1dac029040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ecd92fb79f176 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1d8f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:19:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1d8f7fe700 1 -- 172.21.15.6:0/1414124278 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac02c040 con 0x55f3f0b6b8c0 2023-10-06T02:19:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1d8f7fe700 1 -- 172.21.15.6:0/1414124278 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f1dac037810 con 0x55f3f0b6b8c0 2023-10-06T02:19:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1dc0949b80 1 -- 172.21.15.6:0/1414124278 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1da80556b0 con 0x55f3f0b6b8c0 2023-10-06T02:19:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1d8f7fe700 1 -- 172.21.15.6:0/1414124278 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dac00b150 con 0x55f3f0b6b8c0 2023-10-06T02:19:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1dc0949b80 10 client.5574 fetch_fsmap learned FSMap version 24 2023-10-06T02:19:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1dc0949b80 1 -- 172.21.15.6:0/1414124278 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55f3f0a714f0 con 0x55f3f0b6b8c0 2023-10-06T02:19:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1d8f7fe700 1 -- 172.21.15.6:0/1414124278 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da80556b0 con 0x55f3f0b6b8c0 2023-10-06T02:19:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1d8f7fe700 1 -- 172.21.15.6:0/1414124278 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1dac037be0 con 0x55f3f0b6b8c0 2023-10-06T02:19:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1dc0949b80 10 client.5574 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:19:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1dc0949b80 10 client.5574 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:19:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1dc0949b80 20 client.5574 populate_metadata read hostname 'smithi006' 2023-10-06T02:19:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/1414124278 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55f3f0bb1dc0 0x55f3f0bb2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1dc0949b80 4 client.5574 mds_command: new command op to 5385 tid=0[{"prefix": "damage rm", "damage_id": 2747863959}] 2023-10-06T02:19:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1dc0949b80 1 -- 172.21.15.6:0/1414124278 --> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] -- command(tid 0: {"prefix": "damage rm", "damage_id": 2747863959}) v1 -- 0x55f3f0a5ee80 con 0x55f3f0bb1dc0 2023-10-06T02:19:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.054+0000 7f1db4bec700 1 --2- 172.21.15.6:0/1414124278 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55f3f0bb1dc0 0x55f3f0bb2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.055+0000 7f1d8f7fe700 10 client.5574 ms_handle_connect on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.055+0000 7f1db4bec700 1 --2- 172.21.15.6:0/1414124278 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55f3f0bb1dc0 0x55f3f0bb2190 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b557607ca1a460b0 server_cookie=69d770c8d6fee844 in_seq=0 out_seq=0 2023-10-06T02:19:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.055+0000 7f1d8f7fe700 1 -- 172.21.15.6:0/1414124278 <== mds.0 v2:172.21.15.6:6832/1188971598 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+0 (crc 0 0 0) 0x55f3f0a5ee80 con 0x55f3f0bb1dc0 2023-10-06T02:19:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.055+0000 7f1d8f7fe700 10 client.5574 handle_command_reply: tid=0 2023-10-06T02:19:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.055+0000 7f1dc0949b80 1 client.5574 shutdown 2023-10-06T02:19:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.055+0000 7f1dc0949b80 1 -- 172.21.15.6:0/1414124278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0b6b8c0 msgr2=0x55f3f0b94dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.055+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/1414124278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0b6b8c0 0x55f3f0b94dc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1dac013000 tx=0x7f1dac029040 comp rx=0 tx=0).stop 2023-10-06T02:19:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.055+0000 7f1dc0949b80 1 -- 172.21.15.6:0/1414124278 shutdown_connections 2023-10-06T02:19:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.055+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/1414124278 >> [v2:172.21.15.6:6832/1188971598,v1:172.21.15.6:6834/1188971598] conn(0x55f3f0bb1dc0 0x55f3f0bb2190 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.055+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/1414124278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f3f0bbbc80 0x55f3f0c16fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.055+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/1414124278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3f0b6b8c0 0x55f3f0b94dc0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.055+0000 7f1dc0949b80 1 --2- 172.21.15.6:0/1414124278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3f0b6cd40 0x55f3f0bb8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.055+0000 7f1d8f7fe700 0 client.5574 ms_handle_reset on v2:172.21.15.6:6832/1188971598 2023-10-06T02:19:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.055+0000 7f1dc0949b80 1 -- 172.21.15.6:0/1414124278 >> 172.21.15.6:0/1414124278 conn(0x55f3f0b6d1e0 msgr2=0x55f3f0b6d780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.055+0000 7f1dc0949b80 1 -- 172.21.15.6:0/1414124278 shutdown_connections 2023-10-06T02:19:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.055+0000 7f1dc0949b80 1 -- 172.21.15.6:0/1414124278 wait complete. 2023-10-06T02:19:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.055+0000 7f1dc0949b80 20 client.5574 trim_cache size 0 max 16384 2023-10-06T02:19:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.056+0000 7f1db7651700 1 -- 172.21.15.6:0/1161359483 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d94066f30 msgr2=0x7f1d940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.056+0000 7f1db7651700 1 --2- 172.21.15.6:0/1161359483 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d94066f30 0x7f1d940693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009860 tx=0x7f1dac017000 comp rx=0 tx=0).stop 2023-10-06T02:19:54.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.056+0000 7f1db7651700 1 -- 172.21.15.6:0/1161359483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db00b2630 msgr2=0x7f1db016b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:54.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.056+0000 7f1db7651700 1 --2- 172.21.15.6:0/1161359483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db00b2630 0x7f1db016b630 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1da800c910 tx=0x7f1da8007f90 comp rx=0 tx=0).stop 2023-10-06T02:19:54.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.056+0000 7f1db7651700 1 -- 172.21.15.6:0/1161359483 shutdown_connections 2023-10-06T02:19:54.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.056+0000 7f1db7651700 1 --2- 172.21.15.6:0/1161359483 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d94066f30 0x7f1d940693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.056+0000 7f1db7651700 1 --2- 172.21.15.6:0/1161359483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db00b2630 0x7f1db016b630 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.056+0000 7f1db7651700 1 --2- 172.21.15.6:0/1161359483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1db00af3f0 0x7f1db00c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.056+0000 7f1db7651700 1 --2- 172.21.15.6:0/1161359483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1db0159960 0x7f1db016a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.056+0000 7f1db7651700 1 -- 172.21.15.6:0/1161359483 >> 172.21.15.6:0/1161359483 conn(0x7f1db006a260 msgr2=0x7f1db00ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:54.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.056+0000 7f1db7651700 1 -- 172.21.15.6:0/1161359483 shutdown_connections 2023-10-06T02:19:54.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.056+0000 7f1db7651700 1 -- 172.21.15.6:0/1161359483 wait complete. 2023-10-06T02:19:54.069 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:19:54.069 DEBUG:teuthology.orchestra.run.smithi006:> import sys 2023-10-06T02:19:54.069 DEBUG:teuthology.orchestra.run.smithi006:> import errno 2023-10-06T02:19:54.069 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:19:54.069 DEBUG:teuthology.orchestra.run.smithi006:> try: 2023-10-06T02:19:54.069 DEBUG:teuthology.orchestra.run.smithi006:> f = open("/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged", "w") 2023-10-06T02:19:54.069 DEBUG:teuthology.orchestra.run.smithi006:> f.close() 2023-10-06T02:19:54.069 DEBUG:teuthology.orchestra.run.smithi006:> except IOError as e: 2023-10-06T02:19:54.069 DEBUG:teuthology.orchestra.run.smithi006:> sys.exit(errno.EIO) 2023-10-06T02:19:54.069 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:19:54.324 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:19:54.324 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:19:54.401 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:19:54.442 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:19:54.442 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:19:54.442 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:19:54.442 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:19:54.479 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[108007]: fuse finished with error 0 and tester_r 0 2023-10-06T02:19:54.480 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:19:54.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:54.480 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:19:54.645 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:19:54.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:54.645 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:19:54.662 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T02:19:54.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:19:54.664 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:19:54.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:54.664 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T02:19:54.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:19:54.701 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T02:19:54.701 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:19:54.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:19:54.702 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T02:19:54.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:19:54.721 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T02:19:54.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:19:54.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.860+0000 7fe539e26700 1 Processor -- start 2023-10-06T02:19:54.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.860+0000 7fe539e26700 1 -- start start 2023-10-06T02:19:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.861+0000 7fe539e26700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe534159400 0x7fe5340ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.861+0000 7fe539e26700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe5340cd030 0x7fe5340cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.861+0000 7fe539e26700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5340cf1a0 0x7fe5340d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.861+0000 7fe539e26700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5340b3560 con 0x7fe534159400 2023-10-06T02:19:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.861+0000 7fe539e26700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5340cf6f0 con 0x7fe5340cd030 2023-10-06T02:19:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.861+0000 7fe539e26700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340cf9d0 con 0x7fe5340cf1a0 2023-10-06T02:19:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.861+0000 7fe538e24700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe534159400 0x7fe5340ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.861+0000 7fe538e24700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe534159400 0x7fe5340ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36408/0 (socket says 172.21.15.6:36408) 2023-10-06T02:19:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.861+0000 7fe538e24700 1 -- 172.21.15.6:0/2915620670 learned_addr learned my addr 172.21.15.6:0/2915620670 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.861+0000 7fe539625700 1 --2- 172.21.15.6:0/2915620670 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5340cf1a0 0x7fe5340d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.861+0000 7fe533fff700 1 --2- 172.21.15.6:0/2915620670 >> v2:172.21.15.175:3300/0 conn(0x7fe5340cd030 0x7fe5340cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.861+0000 7fe538e24700 1 -- 172.21.15.6:0/2915620670 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5340cf1a0 msgr2=0x7fe5340d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.861+0000 7fe538e24700 1 --2- 172.21.15.6:0/2915620670 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5340cf1a0 0x7fe5340d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.861+0000 7fe538e24700 1 -- 172.21.15.6:0/2915620670 >> v2:172.21.15.175:3300/0 conn(0x7fe5340cd030 msgr2=0x7fe5340cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.861+0000 7fe538e24700 1 --2- 172.21.15.6:0/2915620670 >> v2:172.21.15.175:3300/0 conn(0x7fe5340cd030 0x7fe5340cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.861+0000 7fe538e24700 1 -- 172.21.15.6:0/2915620670 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5340b2f10 con 0x7fe534159400 2023-10-06T02:19:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.862+0000 7fe538e24700 1 --2- 172.21.15.6:0/2915620670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159400 0x7fe5340ccaf0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe53415d0f0 tx=0x7fe52c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909cc82a07ec0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.862+0000 7fe5337fe700 1 -- 172.21.15.6:0/2915620670 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c005c10 con 0x7fe534159400 2023-10-06T02:19:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.862+0000 7fe5337fe700 1 -- 172.21.15.6:0/2915620670 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c005d70 con 0x7fe534159400 2023-10-06T02:19:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.862+0000 7fe5337fe700 1 -- 172.21.15.6:0/2915620670 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c00b880 con 0x7fe534159400 2023-10-06T02:19:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.862+0000 7fe539e26700 1 -- 172.21.15.6:0/2915620670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159400 msgr2=0x7fe5340ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.862+0000 7fe539e26700 1 --2- 172.21.15.6:0/2915620670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159400 0x7fe5340ccaf0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe53415d0f0 tx=0x7fe52c009220 comp rx=0 tx=0).stop 2023-10-06T02:19:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.862+0000 7fe539e26700 1 -- 172.21.15.6:0/2915620670 shutdown_connections 2023-10-06T02:19:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.862+0000 7fe539e26700 1 --2- 172.21.15.6:0/2915620670 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5340cf1a0 0x7fe5340d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.862+0000 7fe539e26700 1 --2- 172.21.15.6:0/2915620670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159400 0x7fe5340ccaf0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.862+0000 7fe539e26700 1 --2- 172.21.15.6:0/2915620670 >> v2:172.21.15.175:3300/0 conn(0x7fe5340cd030 0x7fe5340cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.862+0000 7fe539e26700 1 -- 172.21.15.6:0/2915620670 >> 172.21.15.6:0/2915620670 conn(0x7fe53406ac10 msgr2=0x7fe534068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.862+0000 7fe539e26700 1 -- 172.21.15.6:0/2915620670 shutdown_connections 2023-10-06T02:19:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.862+0000 7fe539e26700 1 -- 172.21.15.6:0/2915620670 wait complete. 2023-10-06T02:19:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.863+0000 7fe539e26700 1 Processor -- start 2023-10-06T02:19:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.864+0000 7fe539e26700 1 -- start start 2023-10-06T02:19:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.864+0000 7fe539e26700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5340cd030 0x7fe5340b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.864+0000 7fe539e26700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5340cf1a0 0x7fe53415c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.864+0000 7fe539e26700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159400 0x7fe53416d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.864+0000 7fe539e26700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340b1280 con 0x7fe534159400 2023-10-06T02:19:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.864+0000 7fe539e26700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53414c1a0 con 0x7fe5340cf1a0 2023-10-06T02:19:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.864+0000 7fe539e26700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53414ca80 con 0x7fe5340cd030 2023-10-06T02:19:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.864+0000 7fe539625700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159400 0x7fe53416d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.864+0000 7fe539625700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159400 0x7fe53416d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36422/0 (socket says 172.21.15.6:36422) 2023-10-06T02:19:54.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.864+0000 7fe539625700 1 -- 172.21.15.6:0/376613099 learned_addr learned my addr 172.21.15.6:0/376613099 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:54.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.865+0000 7fe533fff700 1 --2- 172.21.15.6:0/376613099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5340cf1a0 0x7fe53415c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.865+0000 7fe538e24700 1 --2- 172.21.15.6:0/376613099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5340cd030 0x7fe5340b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.865+0000 7fe539625700 1 -- 172.21.15.6:0/376613099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5340cd030 msgr2=0x7fe5340b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:54.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.865+0000 7fe539625700 1 --2- 172.21.15.6:0/376613099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5340cd030 0x7fe5340b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.865+0000 7fe539625700 1 -- 172.21.15.6:0/376613099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5340cf1a0 msgr2=0x7fe53415c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:54.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.865+0000 7fe539625700 1 --2- 172.21.15.6:0/376613099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5340cf1a0 0x7fe53415c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:54.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.865+0000 7fe539625700 1 -- 172.21.15.6:0/376613099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c009480 con 0x7fe534159400 2023-10-06T02:19:54.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.865+0000 7fe538e24700 1 --2- 172.21.15.6:0/376613099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5340cd030 0x7fe5340b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:54.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.865+0000 7fe539625700 1 --2- 172.21.15.6:0/376613099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159400 0x7fe53416d260 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00d890 tx=0x7fe51c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:54.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.865+0000 7fe530ff9700 1 -- 172.21.15.6:0/376613099 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c0125f0 con 0x7fe534159400 2023-10-06T02:19:54.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.865+0000 7fe530ff9700 1 -- 172.21.15.6:0/376613099 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c012770 con 0x7fe534159400 2023-10-06T02:19:54.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.865+0000 7fe539e26700 1 -- 172.21.15.6:0/376613099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53414cd60 con 0x7fe534159400 2023-10-06T02:19:54.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.865+0000 7fe530ff9700 1 -- 172.21.15.6:0/376613099 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c012b30 con 0x7fe534159400 2023-10-06T02:19:54.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.865+0000 7fe539e26700 1 -- 172.21.15.6:0/376613099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5340b0c20 con 0x7fe534159400 2023-10-06T02:19:54.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.866+0000 7fe539e26700 1 -- 172.21.15.6:0/376613099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5340b1430 con 0x7fe534159400 2023-10-06T02:19:54.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.866+0000 7fe530ff9700 1 -- 172.21.15.6:0/376613099 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe51c01e460 con 0x7fe534159400 2023-10-06T02:19:54.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.867+0000 7fe530ff9700 1 --2- 172.21.15.6:0/376613099 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe514066f30 0x7fe5140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:54.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.867+0000 7fe530ff9700 1 -- 172.21.15.6:0/376613099 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fe51c084f00 con 0x7fe534159400 2023-10-06T02:19:54.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.867+0000 7fe538e24700 1 --2- 172.21.15.6:0/376613099 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe514066f30 0x7fe5140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:54.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.868+0000 7fe538e24700 1 --2- 172.21.15.6:0/376613099 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe514066f30 0x7fe5140693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe53415f300 tx=0x7fe52c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:54.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:54.871+0000 7fe530ff9700 1 -- 172.21.15.6:0/376613099 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5340b1430 con 0x7fe534159400 2023-10-06T02:19:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.109+0000 7fe539e26700 1 -- 172.21.15.6:0/376613099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe53414cf50 con 0x7fe534159400 2023-10-06T02:19:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.110+0000 7fe530ff9700 1 -- 172.21.15.6:0/376613099 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fe51c051e40 con 0x7fe534159400 2023-10-06T02:19:55.111 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:19:55.111 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1173605075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1173605075},{"type":"v1","addr":"172.21.15.175:6837","nonce":1173605075}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/375122461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":375122461},{"type":"v1","addr":"172.21.15.175:6835","nonce":375122461}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5142,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3506443204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3506443204},{"type":"v1","addr":"172.21.15.6:6835","nonce":3506443204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:18:45.349958+0000","modified":"2023-10-06T02:19:16.895235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5385},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5385":{"gid":5385,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.6:6834/1188971598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1188971598},{"type":"v1","addr":"172.21.15.6:6834","nonce":1188971598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:19:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.112+0000 7fe539e26700 1 -- 172.21.15.6:0/376613099 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe514066f30 msgr2=0x7fe5140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.112+0000 7fe539e26700 1 --2- 172.21.15.6:0/376613099 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe514066f30 0x7fe5140693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe53415f300 tx=0x7fe52c016000 comp rx=0 tx=0).stop 2023-10-06T02:19:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.112+0000 7fe539e26700 1 -- 172.21.15.6:0/376613099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159400 msgr2=0x7fe53416d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.112+0000 7fe539e26700 1 --2- 172.21.15.6:0/376613099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159400 0x7fe53416d260 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00d890 tx=0x7fe51c008040 comp rx=0 tx=0).stop 2023-10-06T02:19:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.112+0000 7fe539e26700 1 -- 172.21.15.6:0/376613099 shutdown_connections 2023-10-06T02:19:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.112+0000 7fe539e26700 1 --2- 172.21.15.6:0/376613099 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe514066f30 0x7fe5140693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.112+0000 7fe539e26700 1 --2- 172.21.15.6:0/376613099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159400 0x7fe53416d260 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.112+0000 7fe539e26700 1 --2- 172.21.15.6:0/376613099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5340cd030 0x7fe5340b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.112+0000 7fe539e26700 1 --2- 172.21.15.6:0/376613099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5340cf1a0 0x7fe53415c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.112+0000 7fe539e26700 1 -- 172.21.15.6:0/376613099 >> 172.21.15.6:0/376613099 conn(0x7fe53406ac10 msgr2=0x7fe5340d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.112+0000 7fe539e26700 1 -- 172.21.15.6:0/376613099 shutdown_connections 2023-10-06T02:19:55.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.112+0000 7fe539e26700 1 -- 172.21.15.6:0/376613099 wait complete. 2023-10-06T02:19:55.115 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 24 2023-10-06T02:19:55.125 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:19:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.243+0000 7fc5c94c2700 1 Processor -- start 2023-10-06T02:19:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.243+0000 7fc5c94c2700 1 -- start start 2023-10-06T02:19:55.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.244+0000 7fc5c94c2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c40cfc50 0x7fc5c415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.244+0000 7fc5c94c2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c40ce7b0 con 0x7fc5c40cb920 2023-10-06T02:19:55.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.244+0000 7fc5c94c2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c415dab0 con 0x7fc5c4153b70 2023-10-06T02:19:55.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.244+0000 7fc5c94c2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c415e350 con 0x7fc5c40cfc50 2023-10-06T02:19:55.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.244+0000 7fc5c27fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc5c40cb920 0x7fc5c40cc8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47090/0 (socket says 172.21.15.6:47090) 2023-10-06T02:19:55.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.244+0000 7fc5c27fc700 1 -- 172.21.15.6:0/3314974992 learned_addr learned my addr 172.21.15.6:0/3314974992 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:19:55.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.244+0000 7fc5c1ffb700 1 -- 172.21.15.6:0/3314974992 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760303091 0 0) 0x7fc5c40ce7b0 con 0x7fc5c40cb920 2023-10-06T02:19:55.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.244+0000 7fc5c37fe700 1 --2- 172.21.15.6:0/3314974992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c40cfc50 0x7fc5c415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.244+0000 7fc5c1ffb700 1 -- 172.21.15.6:0/3314974992 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5b0003570 con 0x7fc5c40cb920 2023-10-06T02:19:55.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.244+0000 7fc5c1ffb700 1 -- 172.21.15.6:0/3314974992 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3752677879 0 0) 0x7fc5b0003570 con 0x7fc5c40cb920 2023-10-06T02:19:55.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c1ffb700 1 -- 172.21.15.6:0/3314974992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c40cfc50 msgr2=0x7fc5c415d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:55.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c1ffb700 1 --2- 172.21.15.6:0/3314974992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c40cfc50 0x7fc5c415d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c1ffb700 1 -- 172.21.15.6:0/3314974992 >> v1:172.21.15.175:6789/0 conn(0x7fc5c4153b70 legacy=0x7fc5c40cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c1ffb700 1 -- 172.21.15.6:0/3314974992 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c415dd90 con 0x7fc5c40cb920 2023-10-06T02:19:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c1ffb700 1 -- 172.21.15.6:0/3314974992 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fc5ac001470 con 0x7fc5c40cb920 2023-10-06T02:19:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c1ffb700 1 -- 172.21.15.6:0/3314974992 >> v1:172.21.15.6:6789/0 conn(0x7fc5c40cb920 legacy=0x7fc5c40cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c1ffb700 1 --2- 172.21.15.6:0/3314974992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c40cfc50 0x7fc5b0003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c1ffb700 1 --2- 172.21.15.6:0/3314974992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5b0004030 0x7fc5b0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c1ffb700 1 --2- 172.21.15.6:0/3314974992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5b0004d50 0x7fc5b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c1ffb700 1 -- 172.21.15.6:0/3314974992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c415e350 con 0x7fc5b0004d50 2023-10-06T02:19:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c1ffb700 1 -- 172.21.15.6:0/3314974992 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b000bbf0 con 0x7fc5b0004030 2023-10-06T02:19:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c1ffb700 1 -- 172.21.15.6:0/3314974992 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b000bdb0 con 0x7fc5c40cfc50 2023-10-06T02:19:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c37fe700 1 --2- 172.21.15.6:0/3314974992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5b0004d50 0x7fc5b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c27fc700 1 --2- 172.21.15.6:0/3314974992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5b0004030 0x7fc5b0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c2ffd700 1 --2- 172.21.15.6:0/3314974992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c40cfc50 0x7fc5b0003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c37fe700 1 -- 172.21.15.6:0/3314974992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c40cfc50 msgr2=0x7fc5b0003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c37fe700 1 --2- 172.21.15.6:0/3314974992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c40cfc50 0x7fc5b0003ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c37fe700 1 -- 172.21.15.6:0/3314974992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5b0004030 msgr2=0x7fc5b0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c37fe700 1 --2- 172.21.15.6:0/3314974992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5b0004030 0x7fc5b0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c37fe700 1 -- 172.21.15.6:0/3314974992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b0003570 con 0x7fc5b0004d50 2023-10-06T02:19:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c37fe700 1 --2- 172.21.15.6:0/3314974992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5b0004d50 0x7fc5b00051c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009c00 tx=0x7fc5bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce8833ad6609324 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c1ffb700 1 -- 172.21.15.6:0/3314974992 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc00e710 con 0x7fc5b0004d50 2023-10-06T02:19:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c1ffb700 1 -- 172.21.15.6:0/3314974992 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc00e870 con 0x7fc5b0004d50 2023-10-06T02:19:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.245+0000 7fc5c1ffb700 1 -- 172.21.15.6:0/3314974992 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc00ec30 con 0x7fc5b0004d50 2023-10-06T02:19:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.246+0000 7fc5c94c2700 1 -- 172.21.15.6:0/3314974992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5b0004d50 msgr2=0x7fc5b00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.246+0000 7fc5c94c2700 1 --2- 172.21.15.6:0/3314974992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5b0004d50 0x7fc5b00051c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009c00 tx=0x7fc5bc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.246+0000 7fc5c37fe700 1 -- 172.21.15.6:0/3314974992 reap_dead start 2023-10-06T02:19:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.246+0000 7fc5c94c2700 1 -- 172.21.15.6:0/3314974992 shutdown_connections 2023-10-06T02:19:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.246+0000 7fc5c94c2700 1 -- 172.21.15.6:0/3314974992 >> 172.21.15.6:0/3314974992 conn(0x7fc5c4068680 msgr2=0x7fc5c4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.246+0000 7fc5c94c2700 1 -- 172.21.15.6:0/3314974992 shutdown_connections 2023-10-06T02:19:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.246+0000 7fc5c94c2700 1 -- 172.21.15.6:0/3314974992 wait complete. 2023-10-06T02:19:55.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.247+0000 7fc5c94c2700 1 Processor -- start 2023-10-06T02:19:55.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.247+0000 7fc5c94c2700 1 -- start start 2023-10-06T02:19:55.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c94c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5c4150430 0x7fc5c40c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c94c2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5c40c9140 0x7fc5c416d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c94c2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c416d900 0x7fc5c415bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c94c2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c416dda0 con 0x7fc5c4150430 2023-10-06T02:19:55.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c94c2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40b5e60 con 0x7fc5c40c9140 2023-10-06T02:19:55.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c94c2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40b3400 con 0x7fc5c416d900 2023-10-06T02:19:55.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5c4150430 0x7fc5c40c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5c4150430 0x7fc5c40c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36444/0 (socket says 172.21.15.6:36444) 2023-10-06T02:19:55.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c2ffd700 1 -- 172.21.15.6:0/3456161136 learned_addr learned my addr 172.21.15.6:0/3456161136 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:55.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c37fe700 1 --2- 172.21.15.6:0/3456161136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c416d900 0x7fc5c415bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c27fc700 1 --2- 172.21.15.6:0/3456161136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5c40c9140 0x7fc5c416d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c2ffd700 1 -- 172.21.15.6:0/3456161136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c416d900 msgr2=0x7fc5c415bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c2ffd700 1 --2- 172.21.15.6:0/3456161136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c416d900 0x7fc5c415bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c2ffd700 1 -- 172.21.15.6:0/3456161136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5c40c9140 msgr2=0x7fc5c416d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c2ffd700 1 --2- 172.21.15.6:0/3456161136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5c40c9140 0x7fc5c416d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c2ffd700 1 -- 172.21.15.6:0/3456161136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c40c9750 con 0x7fc5c4150430 2023-10-06T02:19:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c27fc700 1 --2- 172.21.15.6:0/3456161136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5c40c9140 0x7fc5c416d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:19:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.248+0000 7fc5c2ffd700 1 --2- 172.21.15.6:0/3456161136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5c4150430 0x7fc5c40c8c00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400ebc0 tx=0x7fc5b4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.249+0000 7fc5baffd700 1 -- 172.21.15.6:0/3456161136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b400c7d0 con 0x7fc5c4150430 2023-10-06T02:19:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.249+0000 7fc5baffd700 1 -- 172.21.15.6:0/3456161136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b400c930 con 0x7fc5c4150430 2023-10-06T02:19:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.249+0000 7fc5c94c2700 1 -- 172.21.15.6:0/3456161136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c40c9a30 con 0x7fc5c4150430 2023-10-06T02:19:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.249+0000 7fc5baffd700 1 -- 172.21.15.6:0/3456161136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b400ccb0 con 0x7fc5c4150430 2023-10-06T02:19:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.249+0000 7fc5c94c2700 1 -- 172.21.15.6:0/3456161136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c40b3930 con 0x7fc5c4150430 2023-10-06T02:19:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.250+0000 7fc5c94c2700 1 -- 172.21.15.6:0/3456161136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c40c9510 con 0x7fc5c4150430 2023-10-06T02:19:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.250+0000 7fc5baffd700 1 -- 172.21.15.6:0/3456161136 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5b4015640 con 0x7fc5c4150430 2023-10-06T02:19:55.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.251+0000 7fc5baffd700 1 --2- 172.21.15.6:0/3456161136 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc5a4066f30 0x7fc5a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.251+0000 7fc5baffd700 1 -- 172.21.15.6:0/3456161136 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fc5b4084f40 con 0x7fc5c4150430 2023-10-06T02:19:55.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.251+0000 7fc5c27fc700 1 --2- 172.21.15.6:0/3456161136 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc5a4066f30 0x7fc5a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.251+0000 7fc5c27fc700 1 --2- 172.21.15.6:0/3456161136 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc5a4066f30 0x7fc5a40693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac000e10 tx=0x7fc5ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:55.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.255+0000 7fc5baffd700 1 -- 172.21.15.6:0/3456161136 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5c40c9510 con 0x7fc5c4150430 2023-10-06T02:19:55.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.450+0000 7fc5c94c2700 1 -- 172.21.15.6:0/3456161136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5c40c9510 con 0x7fc5c4150430 2023-10-06T02:19:55.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.451+0000 7fc5baffd700 1 -- 172.21.15.6:0/3456161136 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17244 (secure 0 0 0) 0x7fc5c40c9510 con 0x7fc5c4150430 2023-10-06T02:19:55.452 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:19:55.452 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":42,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:19:31.977136+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:18:43.639616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T02:18:44.317938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.16","mappings":[{"from":0,"to":5}]},{"pgid":"7.35","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6834/774858203":"2023-10-07T02:19:05.864154+0000","172.21.15.6:6832/774858203":"2023-10-07T02:19:05.864154+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:19:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.452+0000 7fc5c94c2700 1 -- 172.21.15.6:0/3456161136 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc5a4066f30 msgr2=0x7fc5a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.452+0000 7fc5c94c2700 1 --2- 172.21.15.6:0/3456161136 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc5a4066f30 0x7fc5a40693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac000e10 tx=0x7fc5ac009040 comp rx=0 tx=0).stop 2023-10-06T02:19:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.452+0000 7fc5c94c2700 1 -- 172.21.15.6:0/3456161136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5c4150430 msgr2=0x7fc5c40c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.453+0000 7fc5c94c2700 1 --2- 172.21.15.6:0/3456161136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5c4150430 0x7fc5c40c8c00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400ebc0 tx=0x7fc5b4001640 comp rx=0 tx=0).stop 2023-10-06T02:19:55.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.453+0000 7fc5c94c2700 1 -- 172.21.15.6:0/3456161136 shutdown_connections 2023-10-06T02:19:55.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.453+0000 7fc5c94c2700 1 --2- 172.21.15.6:0/3456161136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c416d900 0x7fc5c415bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.453+0000 7fc5c94c2700 1 --2- 172.21.15.6:0/3456161136 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc5a4066f30 0x7fc5a40693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.453+0000 7fc5c94c2700 1 --2- 172.21.15.6:0/3456161136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5c4150430 0x7fc5c40c8c00 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.453+0000 7fc5c94c2700 1 --2- 172.21.15.6:0/3456161136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5c40c9140 0x7fc5c416d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.453+0000 7fc5c94c2700 1 -- 172.21.15.6:0/3456161136 >> 172.21.15.6:0/3456161136 conn(0x7fc5c4068680 msgr2=0x7fc5c4150b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:55.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.453+0000 7fc5c94c2700 1 -- 172.21.15.6:0/3456161136 shutdown_connections 2023-10-06T02:19:55.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.453+0000 7fc5c94c2700 1 -- 172.21.15.6:0/3456161136 wait complete. 2023-10-06T02:19:55.466 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:18:43.639616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:18:44.317938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:19:55.467 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:19:55.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.587+0000 7fc0e6285700 1 Processor -- start 2023-10-06T02:19:55.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.587+0000 7fc0e6285700 1 -- start start 2023-10-06T02:19:55.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0e6285700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc0e00a89c0 0x7fc0e00aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0e6285700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0e00a8d90 0x7fc0e00af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0e6285700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0e00af570 0x7fc0e00b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0e6285700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e006b030 con 0x7fc0e00af570 2023-10-06T02:19:55.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0e6285700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e00b1ab0 con 0x7fc0e00a89c0 2023-10-06T02:19:55.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0e6285700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e006ad50 con 0x7fc0e00a8d90 2023-10-06T02:19:55.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0e4822700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0e00af570 0x7fc0e00b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0e4822700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0e00af570 0x7fc0e00b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36460/0 (socket says 172.21.15.6:36460) 2023-10-06T02:19:55.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0e4822700 1 -- 172.21.15.6:0/3870313903 learned_addr learned my addr 172.21.15.6:0/3870313903 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:55.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0df7fe700 1 --2- 172.21.15.6:0/3870313903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0e00a8d90 0x7fc0e00af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0dffff700 1 --2- 172.21.15.6:0/3870313903 >> v2:172.21.15.175:3300/0 conn(0x7fc0e00a89c0 0x7fc0e00aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0e4822700 1 -- 172.21.15.6:0/3870313903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0e00a8d90 msgr2=0x7fc0e00af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0e4822700 1 --2- 172.21.15.6:0/3870313903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0e00a8d90 0x7fc0e00af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0e4822700 1 -- 172.21.15.6:0/3870313903 >> v2:172.21.15.175:3300/0 conn(0x7fc0e00a89c0 msgr2=0x7fc0e00aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0e4822700 1 --2- 172.21.15.6:0/3870313903 >> v2:172.21.15.175:3300/0 conn(0x7fc0e00a89c0 0x7fc0e00aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0e4822700 1 -- 172.21.15.6:0/3870313903 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e00b1d30 con 0x7fc0e00af570 2023-10-06T02:19:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0dffff700 1 --2- 172.21.15.6:0/3870313903 >> v2:172.21.15.175:3300/0 conn(0x7fc0e00a89c0 0x7fc0e00aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0df7fe700 1 --2- 172.21.15.6:0/3870313903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0e00a8d90 0x7fc0e00af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.588+0000 7fc0e4822700 1 --2- 172.21.15.6:0/3870313903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0e00af570 0x7fc0e00b2810 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc0e006fc10 tx=0x7fc0d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92ab3f8a073e03a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.589+0000 7fc0deffd700 1 -- 172.21.15.6:0/3870313903 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d800e070 con 0x7fc0e00af570 2023-10-06T02:19:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.589+0000 7fc0deffd700 1 -- 172.21.15.6:0/3870313903 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d800ba50 con 0x7fc0e00af570 2023-10-06T02:19:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.589+0000 7fc0deffd700 1 -- 172.21.15.6:0/3870313903 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80092e0 con 0x7fc0e00af570 2023-10-06T02:19:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.589+0000 7fc0e6285700 1 -- 172.21.15.6:0/3870313903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0e00af570 msgr2=0x7fc0e00b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.589+0000 7fc0e6285700 1 --2- 172.21.15.6:0/3870313903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0e00af570 0x7fc0e00b2810 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc0e006fc10 tx=0x7fc0d8009840 comp rx=0 tx=0).stop 2023-10-06T02:19:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.589+0000 7fc0e6285700 1 -- 172.21.15.6:0/3870313903 shutdown_connections 2023-10-06T02:19:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.589+0000 7fc0e6285700 1 --2- 172.21.15.6:0/3870313903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0e00af570 0x7fc0e00b2810 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.589+0000 7fc0e6285700 1 --2- 172.21.15.6:0/3870313903 >> v2:172.21.15.175:3300/0 conn(0x7fc0e00a89c0 0x7fc0e00aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.589+0000 7fc0e6285700 1 --2- 172.21.15.6:0/3870313903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0e00a8d90 0x7fc0e00af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.589+0000 7fc0e6285700 1 -- 172.21.15.6:0/3870313903 >> 172.21.15.6:0/3870313903 conn(0x7fc0e0067910 msgr2=0x7fc0e00ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.589+0000 7fc0e6285700 1 -- 172.21.15.6:0/3870313903 shutdown_connections 2023-10-06T02:19:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.589+0000 7fc0e6285700 1 -- 172.21.15.6:0/3870313903 wait complete. 2023-10-06T02:19:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.590+0000 7fc0e6285700 1 Processor -- start 2023-10-06T02:19:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.590+0000 7fc0e6285700 1 -- start start 2023-10-06T02:19:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.591+0000 7fc0e6285700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0e00a89c0 0x7fc0e00c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.591+0000 7fc0e6285700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0e00a8d90 0x7fc0e0148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.591+0000 7fc0e6285700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0e00af570 0x7fc0e015db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.591+0000 7fc0e6285700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e0097bb0 con 0x7fc0e00a8d90 2023-10-06T02:19:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.591+0000 7fc0e6285700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e00989a0 con 0x7fc0e00af570 2023-10-06T02:19:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.591+0000 7fc0e6285700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e00c3c40 con 0x7fc0e00a89c0 2023-10-06T02:19:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.591+0000 7fc0df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0e00a8d90 0x7fc0e0148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.591+0000 7fc0df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0e00a8d90 0x7fc0e0148560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36466/0 (socket says 172.21.15.6:36466) 2023-10-06T02:19:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.591+0000 7fc0df7fe700 1 -- 172.21.15.6:0/726175342 learned_addr learned my addr 172.21.15.6:0/726175342 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.591+0000 7fc0dffff700 1 --2- 172.21.15.6:0/726175342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0e00a89c0 0x7fc0e00c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.591+0000 7fc0e4822700 1 --2- 172.21.15.6:0/726175342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0e00af570 0x7fc0e015db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.592+0000 7fc0df7fe700 1 -- 172.21.15.6:0/726175342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0e00a89c0 msgr2=0x7fc0e00c3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.592+0000 7fc0df7fe700 1 --2- 172.21.15.6:0/726175342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0e00a89c0 0x7fc0e00c3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.592+0000 7fc0df7fe700 1 -- 172.21.15.6:0/726175342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0e00af570 msgr2=0x7fc0e015db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.592+0000 7fc0df7fe700 1 --2- 172.21.15.6:0/726175342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0e00af570 0x7fc0e015db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.592+0000 7fc0df7fe700 1 -- 172.21.15.6:0/726175342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d8009ae0 con 0x7fc0e00a8d90 2023-10-06T02:19:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.592+0000 7fc0df7fe700 1 --2- 172.21.15.6:0/726175342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0e00a8d90 0x7fc0e0148560 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000e8a0 tx=0x7fc0d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.592+0000 7fc0d7fff700 1 -- 172.21.15.6:0/726175342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0013410 con 0x7fc0e00a8d90 2023-10-06T02:19:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.592+0000 7fc0d7fff700 1 -- 172.21.15.6:0/726175342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d0013570 con 0x7fc0e00a8d90 2023-10-06T02:19:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.592+0000 7fc0e6285700 1 -- 172.21.15.6:0/726175342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e0148aa0 con 0x7fc0e00a8d90 2023-10-06T02:19:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.592+0000 7fc0d7fff700 1 -- 172.21.15.6:0/726175342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0013930 con 0x7fc0e00a8d90 2023-10-06T02:19:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.592+0000 7fc0e6285700 1 -- 172.21.15.6:0/726175342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e0098070 con 0x7fc0e00a8d90 2023-10-06T02:19:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.593+0000 7fc0e6285700 1 -- 172.21.15.6:0/726175342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e0087170 con 0x7fc0e00a8d90 2023-10-06T02:19:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.593+0000 7fc0d7fff700 1 -- 172.21.15.6:0/726175342 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc0d0013ca0 con 0x7fc0e00a8d90 2023-10-06T02:19:55.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.594+0000 7fc0d7fff700 1 --2- 172.21.15.6:0/726175342 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc0c0066f30 0x7fc0c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.594+0000 7fc0d7fff700 1 -- 172.21.15.6:0/726175342 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fc0d00846a0 con 0x7fc0e00a8d90 2023-10-06T02:19:55.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.594+0000 7fc0dffff700 1 --2- 172.21.15.6:0/726175342 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc0c0066f30 0x7fc0c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.594+0000 7fc0dffff700 1 --2- 172.21.15.6:0/726175342 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc0c0066f30 0x7fc0c00693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8006ea0 tx=0x7fc0c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.598+0000 7fc0d7fff700 1 -- 172.21.15.6:0/726175342 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0d00515e0 con 0x7fc0e00a8d90 2023-10-06T02:19:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.792+0000 7fc0e6285700 1 -- 172.21.15.6:0/726175342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc0e006e5d0 con 0x7fc0e00a8d90 2023-10-06T02:19:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.792+0000 7fc0d7fff700 1 -- 172.21.15.6:0/726175342 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc0d0054c00 con 0x7fc0e00a8d90 2023-10-06T02:19:55.794 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:19:55.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.794+0000 7fc0e6285700 1 -- 172.21.15.6:0/726175342 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc0c0066f30 msgr2=0x7fc0c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.794+0000 7fc0e6285700 1 --2- 172.21.15.6:0/726175342 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc0c0066f30 0x7fc0c00693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8006ea0 tx=0x7fc0c8008040 comp rx=0 tx=0).stop 2023-10-06T02:19:55.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.794+0000 7fc0e6285700 1 -- 172.21.15.6:0/726175342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0e00a8d90 msgr2=0x7fc0e0148560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.794+0000 7fc0e6285700 1 --2- 172.21.15.6:0/726175342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0e00a8d90 0x7fc0e0148560 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000e8a0 tx=0x7fc0d0008040 comp rx=0 tx=0).stop 2023-10-06T02:19:55.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.794+0000 7fc0e6285700 1 -- 172.21.15.6:0/726175342 shutdown_connections 2023-10-06T02:19:55.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.794+0000 7fc0e6285700 1 --2- 172.21.15.6:0/726175342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0e00af570 0x7fc0e015db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.794+0000 7fc0e6285700 1 --2- 172.21.15.6:0/726175342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0e00a89c0 0x7fc0e00c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.794+0000 7fc0e6285700 1 --2- 172.21.15.6:0/726175342 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc0c0066f30 0x7fc0c00693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.794+0000 7fc0e6285700 1 --2- 172.21.15.6:0/726175342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0e00a8d90 0x7fc0e0148560 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.794+0000 7fc0e6285700 1 -- 172.21.15.6:0/726175342 >> 172.21.15.6:0/726175342 conn(0x7fc0e0067910 msgr2=0x7fc0e00aed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.794+0000 7fc0e6285700 1 -- 172.21.15.6:0/726175342 shutdown_connections 2023-10-06T02:19:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.794+0000 7fc0e6285700 1 -- 172.21.15.6:0/726175342 wait complete. 2023-10-06T02:19:55.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:19:55.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.928+0000 7f9674d44700 1 Processor -- start 2023-10-06T02:19:55.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.928+0000 7f9674d44700 1 -- start start 2023-10-06T02:19:55.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.929+0000 7f9674d44700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96700cd400 0x7f96700b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.929+0000 7f9674d44700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f96700cd7d0 0x7f96700b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.929+0000 7f9674d44700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96700b29a0 con 0x7f96700b0810 2023-10-06T02:19:55.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.929+0000 7f9674d44700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96700af770 con 0x7f96700cd7d0 2023-10-06T02:19:55.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.929+0000 7f9674d44700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96700afa50 con 0x7f96700cd400 2023-10-06T02:19:55.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.929+0000 7f966effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f96700cd7d0 0x7f96700b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.929+0000 7f966ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f96700b0810 0x7f96700d01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47092/0 (socket says 172.21.15.6:47092) 2023-10-06T02:19:55.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.929+0000 7f966ffff700 1 -- 172.21.15.6:0/3291968197 learned_addr learned my addr 172.21.15.6:0/3291968197 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:19:55.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.929+0000 7f966f7fe700 1 --2- 172.21.15.6:0/3291968197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96700cd400 0x7f96700b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.929+0000 7f966effd700 1 -- 172.21.15.6:0/3291968197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96700cd400 msgr2=0x7f96700b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.929+0000 7f966effd700 1 --2- 172.21.15.6:0/3291968197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96700cd400 0x7f96700b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.929+0000 7f966effd700 1 -- 172.21.15.6:0/3291968197 >> v1:172.21.15.6:6789/0 conn(0x7f96700b0810 legacy=0x7f96700d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.929+0000 7f966e7fc700 1 -- 172.21.15.6:0/3291968197 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237415265 0 0) 0x7f9668001490 con 0x7f96700b0810 2023-10-06T02:19:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.929+0000 7f966effd700 1 -- 172.21.15.6:0/3291968197 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96700afd30 con 0x7f96700cd7d0 2023-10-06T02:19:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.930+0000 7f966effd700 1 --2- 172.21.15.6:0/3291968197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96700cd7d0 0x7f96700b2460 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f96640098e0 tx=0x7f96640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b30d360586242c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.930+0000 7f966e7fc700 1 -- 172.21.15.6:0/3291968197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9664009e80 con 0x7f96700cd7d0 2023-10-06T02:19:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.930+0000 7f966e7fc700 1 -- 172.21.15.6:0/3291968197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966400b860 con 0x7f96700cd7d0 2023-10-06T02:19:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.930+0000 7f966e7fc700 1 -- 172.21.15.6:0/3291968197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966400bbe0 con 0x7f96700cd7d0 2023-10-06T02:19:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.930+0000 7f9674d44700 1 -- 172.21.15.6:0/3291968197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96700cd7d0 msgr2=0x7f96700b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.930+0000 7f9674d44700 1 --2- 172.21.15.6:0/3291968197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96700cd7d0 0x7f96700b2460 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f96640098e0 tx=0x7f96640091a0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.930+0000 7f9674d44700 1 -- 172.21.15.6:0/3291968197 shutdown_connections 2023-10-06T02:19:55.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.930+0000 7f9674d44700 1 --2- 172.21.15.6:0/3291968197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96700cd400 0x7f96700b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.930+0000 7f9674d44700 1 --2- 172.21.15.6:0/3291968197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96700cd7d0 0x7f96700b2460 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.930+0000 7f9674d44700 1 -- 172.21.15.6:0/3291968197 >> 172.21.15.6:0/3291968197 conn(0x7f967006a110 msgr2=0x7f967006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:55.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.930+0000 7f9674d44700 1 -- 172.21.15.6:0/3291968197 shutdown_connections 2023-10-06T02:19:55.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.930+0000 7f9674d44700 1 -- 172.21.15.6:0/3291968197 wait complete. 2023-10-06T02:19:55.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.932+0000 7f9674d44700 1 Processor -- start 2023-10-06T02:19:55.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.932+0000 7f9674d44700 1 -- start start 2023-10-06T02:19:55.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.932+0000 7f9674d44700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96700b0810 0x7f9670154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.932+0000 7f9674d44700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96700cd400 0x7f9670154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.932+0000 7f9674d44700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96701537c0 0x7f9670153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.932+0000 7f9674d44700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96701579e0 con 0x7f96701537c0 2023-10-06T02:19:55.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.932+0000 7f9674d44700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96700c7270 con 0x7f96700cd400 2023-10-06T02:19:55.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.932+0000 7f9674d44700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96700c7550 con 0x7f96700b0810 2023-10-06T02:19:55.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.932+0000 7f966ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96701537c0 0x7f9670153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.932+0000 7f966ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96701537c0 0x7f9670153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36492/0 (socket says 172.21.15.6:36492) 2023-10-06T02:19:55.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.932+0000 7f966ffff700 1 -- 172.21.15.6:0/1275464411 learned_addr learned my addr 172.21.15.6:0/1275464411 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:55.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.933+0000 7f966f7fe700 1 --2- 172.21.15.6:0/1275464411 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96700b0810 0x7f9670154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.933+0000 7f966effd700 1 --2- 172.21.15.6:0/1275464411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96700cd400 0x7f9670154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.933+0000 7f966ffff700 1 -- 172.21.15.6:0/1275464411 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96700b0810 msgr2=0x7f9670154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.933+0000 7f966ffff700 1 --2- 172.21.15.6:0/1275464411 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96700b0810 0x7f9670154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.933+0000 7f966ffff700 1 -- 172.21.15.6:0/1275464411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96700cd400 msgr2=0x7f9670154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:55.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.933+0000 7f966ffff700 1 --2- 172.21.15.6:0/1275464411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96700cd400 0x7f9670154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:55.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.933+0000 7f966ffff700 1 -- 172.21.15.6:0/1275464411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9664009420 con 0x7f96701537c0 2023-10-06T02:19:55.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.933+0000 7f966f7fe700 1 --2- 172.21.15.6:0/1275464411 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96700b0810 0x7f9670154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:55.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.933+0000 7f966ffff700 1 --2- 172.21.15.6:0/1275464411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96701537c0 0x7f9670153c40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f966800cbf0 tx=0x7f96680019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:55.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.933+0000 7f96577fe700 1 -- 172.21.15.6:0/1275464411 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966800a9c0 con 0x7f96701537c0 2023-10-06T02:19:55.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.933+0000 7f96577fe700 1 -- 172.21.15.6:0/1275464411 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966800ab20 con 0x7f96701537c0 2023-10-06T02:19:55.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.933+0000 7f9674d44700 1 -- 172.21.15.6:0/1275464411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96700c7830 con 0x7f96701537c0 2023-10-06T02:19:55.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.933+0000 7f96577fe700 1 -- 172.21.15.6:0/1275464411 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96680070f0 con 0x7f96701537c0 2023-10-06T02:19:55.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.933+0000 7f9674d44700 1 -- 172.21.15.6:0/1275464411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96700c7df0 con 0x7f96701537c0 2023-10-06T02:19:55.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.934+0000 7f9674d44700 1 -- 172.21.15.6:0/1275464411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96700c7fe0 con 0x7f96701537c0 2023-10-06T02:19:55.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.934+0000 7f96577fe700 1 -- 172.21.15.6:0/1275464411 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9668007520 con 0x7f96701537c0 2023-10-06T02:19:55.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.935+0000 7f96577fe700 1 --2- 172.21.15.6:0/1275464411 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f965c066f30 0x7f965c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:55.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.935+0000 7f96577fe700 1 -- 172.21.15.6:0/1275464411 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f9668084b00 con 0x7f96701537c0 2023-10-06T02:19:55.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.935+0000 7f966f7fe700 1 --2- 172.21.15.6:0/1275464411 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f965c066f30 0x7f965c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:55.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.936+0000 7f966f7fe700 1 --2- 172.21.15.6:0/1275464411 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f965c066f30 0x7f965c0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9660006aa0 tx=0x7f9660008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:55.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:55.939+0000 7f96577fe700 1 -- 172.21.15.6:0/1275464411 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9668051ac0 con 0x7f96701537c0 2023-10-06T02:19:56.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.132+0000 7f9674d44700 1 -- 172.21.15.6:0/1275464411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96700b29a0 con 0x7f96701537c0 2023-10-06T02:19:56.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.133+0000 7f96577fe700 1 -- 172.21.15.6:0/1275464411 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96700b29a0 con 0x7f96701537c0 2023-10-06T02:19:56.134 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:19:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.135+0000 7f9674d44700 1 -- 172.21.15.6:0/1275464411 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f965c066f30 msgr2=0x7f965c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.135+0000 7f9674d44700 1 --2- 172.21.15.6:0/1275464411 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f965c066f30 0x7f965c0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9660006aa0 tx=0x7f9660008040 comp rx=0 tx=0).stop 2023-10-06T02:19:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.135+0000 7f9674d44700 1 -- 172.21.15.6:0/1275464411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96701537c0 msgr2=0x7f9670153c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.135+0000 7f9674d44700 1 --2- 172.21.15.6:0/1275464411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96701537c0 0x7f9670153c40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f966800cbf0 tx=0x7f96680019b0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.135+0000 7f9674d44700 1 -- 172.21.15.6:0/1275464411 shutdown_connections 2023-10-06T02:19:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.135+0000 7f9674d44700 1 --2- 172.21.15.6:0/1275464411 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f965c066f30 0x7f965c0693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.135+0000 7f9674d44700 1 --2- 172.21.15.6:0/1275464411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96701537c0 0x7f9670153c40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.135+0000 7f9674d44700 1 --2- 172.21.15.6:0/1275464411 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96700b0810 0x7f9670154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.135+0000 7f9674d44700 1 --2- 172.21.15.6:0/1275464411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96700cd400 0x7f9670154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.135+0000 7f9674d44700 1 -- 172.21.15.6:0/1275464411 >> 172.21.15.6:0/1275464411 conn(0x7f967006a110 msgr2=0x7f96700cf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.135+0000 7f9674d44700 1 -- 172.21.15.6:0/1275464411 shutdown_connections 2023-10-06T02:19:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.135+0000 7f9674d44700 1 -- 172.21.15.6:0/1275464411 wait complete. 2023-10-06T02:19:56.149 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:19:56.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.269+0000 7f7bf73a0700 1 Processor -- start 2023-10-06T02:19:56.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.269+0000 7f7bf73a0700 1 -- start start 2023-10-06T02:19:56.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.270+0000 7f7bf73a0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7bf006dc60 0x7f7bf0159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.270+0000 7f7bf73a0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bf0159ff0 0x7f7bf0156a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.270+0000 7f7bf73a0700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7bf006cf40 0x7f7bf0156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.270+0000 7f7bf73a0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf0069790 con 0x7f7bf006dc60 2023-10-06T02:19:56.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.270+0000 7f7bf73a0700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf00c8c00 con 0x7f7bf006cf40 2023-10-06T02:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.270+0000 7f7bf73a0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf015aa50 con 0x7f7bf0159ff0 2023-10-06T02:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.271+0000 7f7bf639e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7bf006dc60 0x7f7bf0159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.271+0000 7f7bf639e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7bf006dc60 0x7f7bf0159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36508/0 (socket says 172.21.15.6:36508) 2023-10-06T02:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.271+0000 7f7bf639e700 1 -- 172.21.15.6:0/2282688070 learned_addr learned my addr 172.21.15.6:0/2282688070 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.271+0000 7f7bf6b9f700 1 --2- 172.21.15.6:0/2282688070 >> v2:172.21.15.175:3300/0 conn(0x7f7bf006cf40 0x7f7bf0156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.271+0000 7f7bf5b9d700 1 --2- 172.21.15.6:0/2282688070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bf0159ff0 0x7f7bf0156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.271+0000 7f7bf639e700 1 -- 172.21.15.6:0/2282688070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bf0159ff0 msgr2=0x7f7bf0156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.271+0000 7f7bf639e700 1 --2- 172.21.15.6:0/2282688070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bf0159ff0 0x7f7bf0156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.271+0000 7f7bf639e700 1 -- 172.21.15.6:0/2282688070 >> v2:172.21.15.175:3300/0 conn(0x7f7bf006cf40 msgr2=0x7f7bf0156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.271+0000 7f7bf639e700 1 --2- 172.21.15.6:0/2282688070 >> v2:172.21.15.175:3300/0 conn(0x7f7bf006cf40 0x7f7bf0156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.271+0000 7f7bf639e700 1 -- 172.21.15.6:0/2282688070 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf01574f0 con 0x7f7bf006dc60 2023-10-06T02:19:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.271+0000 7f7bf639e700 1 --2- 172.21.15.6:0/2282688070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bf006dc60 0x7f7bf0159ab0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00cddf0 tx=0x7f7be8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730754ae00754288 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.271+0000 7f7bf539c700 1 -- 172.21.15.6:0/2282688070 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be800b640 con 0x7f7bf006dc60 2023-10-06T02:19:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.271+0000 7f7bf539c700 1 -- 172.21.15.6:0/2282688070 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be800b7a0 con 0x7f7bf006dc60 2023-10-06T02:19:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.271+0000 7f7bf539c700 1 -- 172.21.15.6:0/2282688070 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be800bb40 con 0x7f7bf006dc60 2023-10-06T02:19:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.272+0000 7f7bf73a0700 1 -- 172.21.15.6:0/2282688070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bf006dc60 msgr2=0x7f7bf0159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.272+0000 7f7bf73a0700 1 --2- 172.21.15.6:0/2282688070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bf006dc60 0x7f7bf0159ab0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00cddf0 tx=0x7f7be8009250 comp rx=0 tx=0).stop 2023-10-06T02:19:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.272+0000 7f7bf73a0700 1 -- 172.21.15.6:0/2282688070 shutdown_connections 2023-10-06T02:19:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.272+0000 7f7bf73a0700 1 --2- 172.21.15.6:0/2282688070 >> v2:172.21.15.175:3300/0 conn(0x7f7bf006cf40 0x7f7bf0156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.272+0000 7f7bf73a0700 1 --2- 172.21.15.6:0/2282688070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bf006dc60 0x7f7bf0159ab0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.272+0000 7f7bf73a0700 1 --2- 172.21.15.6:0/2282688070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bf0159ff0 0x7f7bf0156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.272+0000 7f7bf73a0700 1 -- 172.21.15.6:0/2282688070 >> 172.21.15.6:0/2282688070 conn(0x7f7bf00cea20 msgr2=0x7f7bf006c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.272+0000 7f7bf73a0700 1 -- 172.21.15.6:0/2282688070 shutdown_connections 2023-10-06T02:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.272+0000 7f7bf73a0700 1 -- 172.21.15.6:0/2282688070 wait complete. 2023-10-06T02:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.273+0000 7f7bf73a0700 1 Processor -- start 2023-10-06T02:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.273+0000 7f7bf73a0700 1 -- start start 2023-10-06T02:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf73a0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bf006cf40 0x7f7bf0069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf73a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bf006dc60 0x7f7bf01525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf73a0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bf0159ff0 0x7f7bf0152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf73a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf0153050 con 0x7f7bf006dc60 2023-10-06T02:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf73a0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf0169e90 con 0x7f7bf0159ff0 2023-10-06T02:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf73a0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf016a170 con 0x7f7bf006cf40 2023-10-06T02:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf5b9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bf006dc60 0x7f7bf01525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf5b9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bf006dc60 0x7f7bf01525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36518/0 (socket says 172.21.15.6:36518) 2023-10-06T02:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf5b9d700 1 -- 172.21.15.6:0/625884159 learned_addr learned my addr 172.21.15.6:0/625884159 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf639e700 1 --2- 172.21.15.6:0/625884159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bf006cf40 0x7f7bf0069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf6b9f700 1 --2- 172.21.15.6:0/625884159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bf0159ff0 0x7f7bf0152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf5b9d700 1 -- 172.21.15.6:0/625884159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bf006cf40 msgr2=0x7f7bf0069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf5b9d700 1 --2- 172.21.15.6:0/625884159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bf006cf40 0x7f7bf0069b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf5b9d700 1 -- 172.21.15.6:0/625884159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bf0159ff0 msgr2=0x7f7bf0152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf5b9d700 1 --2- 172.21.15.6:0/625884159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bf0159ff0 0x7f7bf0152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf5b9d700 1 -- 172.21.15.6:0/625884159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be80094f0 con 0x7f7bf006dc60 2023-10-06T02:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf5b9d700 1 --2- 172.21.15.6:0/625884159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bf006dc60 0x7f7bf01525d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7be400e900 tx=0x7f7be40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bee7fc700 1 -- 172.21.15.6:0/625884159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4013680 con 0x7f7bf006dc60 2023-10-06T02:19:56.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bee7fc700 1 -- 172.21.15.6:0/625884159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be40137e0 con 0x7f7bf006dc60 2023-10-06T02:19:56.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bf73a0700 1 -- 172.21.15.6:0/625884159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf016a450 con 0x7f7bf006dc60 2023-10-06T02:19:56.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.274+0000 7f7bee7fc700 1 -- 172.21.15.6:0/625884159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4013ba0 con 0x7f7bf006dc60 2023-10-06T02:19:56.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.275+0000 7f7bf73a0700 1 -- 172.21.15.6:0/625884159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf016a7e0 con 0x7f7bf006dc60 2023-10-06T02:19:56.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.275+0000 7f7bf73a0700 1 -- 172.21.15.6:0/625884159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf016a970 con 0x7f7bf006dc60 2023-10-06T02:19:56.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.276+0000 7f7bee7fc700 1 -- 172.21.15.6:0/625884159 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7be40123d0 con 0x7f7bf006dc60 2023-10-06T02:19:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.276+0000 7f7bee7fc700 1 --2- 172.21.15.6:0/625884159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bdc066f30 0x7f7bdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.276+0000 7f7bee7fc700 1 -- 172.21.15.6:0/625884159 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f7be40848e0 con 0x7f7bf006dc60 2023-10-06T02:19:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.276+0000 7f7bf639e700 1 --2- 172.21.15.6:0/625884159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bdc066f30 0x7f7bdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.277+0000 7f7bf639e700 1 --2- 172.21.15.6:0/625884159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bdc066f30 0x7f7bdc0693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00cddf0 tx=0x7f7be8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.281+0000 7f7bee7fc700 1 -- 172.21.15.6:0/625884159 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bf016a970 con 0x7f7bf006dc60 2023-10-06T02:19:56.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.472+0000 7f7bf73a0700 1 -- 172.21.15.6:0/625884159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7bf016a970 con 0x7f7bf006dc60 2023-10-06T02:19:56.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.473+0000 7f7bee7fc700 1 -- 172.21.15.6:0/625884159 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7bf016a970 con 0x7f7bf006dc60 2023-10-06T02:19:56.474 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:19:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.475+0000 7f7bf73a0700 1 -- 172.21.15.6:0/625884159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bdc066f30 msgr2=0x7f7bdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.475+0000 7f7bf73a0700 1 --2- 172.21.15.6:0/625884159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bdc066f30 0x7f7bdc0693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00cddf0 tx=0x7f7be8017000 comp rx=0 tx=0).stop 2023-10-06T02:19:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.475+0000 7f7bf73a0700 1 -- 172.21.15.6:0/625884159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bf006dc60 msgr2=0x7f7bf01525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.475+0000 7f7bf73a0700 1 --2- 172.21.15.6:0/625884159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bf006dc60 0x7f7bf01525d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7be400e900 tx=0x7f7be40091a0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.475+0000 7f7bf73a0700 1 -- 172.21.15.6:0/625884159 shutdown_connections 2023-10-06T02:19:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.475+0000 7f7bf73a0700 1 --2- 172.21.15.6:0/625884159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bf0159ff0 0x7f7bf0152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.475+0000 7f7bf73a0700 1 --2- 172.21.15.6:0/625884159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bf006cf40 0x7f7bf0069b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.475+0000 7f7bf73a0700 1 --2- 172.21.15.6:0/625884159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bdc066f30 0x7f7bdc0693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.475+0000 7f7bf73a0700 1 --2- 172.21.15.6:0/625884159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bf006dc60 0x7f7bf01525d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.475+0000 7f7bf73a0700 1 -- 172.21.15.6:0/625884159 >> 172.21.15.6:0/625884159 conn(0x7f7bf00cea20 msgr2=0x7f7bf0156840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.475+0000 7f7bf73a0700 1 -- 172.21.15.6:0/625884159 shutdown_connections 2023-10-06T02:19:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.475+0000 7f7bf73a0700 1 -- 172.21.15.6:0/625884159 wait complete. 2023-10-06T02:19:56.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:19:56.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.609+0000 7f42392ba700 1 Processor -- start 2023-10-06T02:19:56.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.609+0000 7f42392ba700 1 -- start start 2023-10-06T02:19:56.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.610+0000 7f42392ba700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42340cf7d0 0x7f42340cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.610+0000 7f42392ba700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f42340cb6e0 0x7f4234069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.610+0000 7f42392ba700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42340cbb80 con 0x7f423406a2c0 2023-10-06T02:19:56.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.610+0000 7f42392ba700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4234159c10 con 0x7f42340cb6e0 2023-10-06T02:19:56.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.610+0000 7f42392ba700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423415abd0 con 0x7f42340cf7d0 2023-10-06T02:19:56.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.610+0000 7f42337fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f423406a2c0 0x7f423415d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47100/0 (socket says 172.21.15.6:47100) 2023-10-06T02:19:56.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.610+0000 7f42337fe700 1 -- 172.21.15.6:0/1590305808 learned_addr learned my addr 172.21.15.6:0/1590305808 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:19:56.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.610+0000 7f4232ffd700 1 --2- 172.21.15.6:0/1590305808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42340cf7d0 0x7f42340cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.610+0000 7f42327fc700 1 --2- 172.21.15.6:0/1590305808 >> v2:172.21.15.175:3300/0 conn(0x7f42340cb6e0 0x7f4234069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.610+0000 7f4231ffb700 1 -- 172.21.15.6:0/1590305808 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194487349 0 0) 0x7f42340cbb80 con 0x7f423406a2c0 2023-10-06T02:19:56.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.610+0000 7f4231ffb700 1 -- 172.21.15.6:0/1590305808 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4220003570 con 0x7f423406a2c0 2023-10-06T02:19:56.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f4231ffb700 1 -- 172.21.15.6:0/1590305808 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3786361647 0 0) 0x7f4220003570 con 0x7f423406a2c0 2023-10-06T02:19:56.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f4231ffb700 1 -- 172.21.15.6:0/1590305808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42340cf7d0 msgr2=0x7f42340cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:56.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f4231ffb700 1 --2- 172.21.15.6:0/1590305808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42340cf7d0 0x7f42340cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f4231ffb700 1 -- 172.21.15.6:0/1590305808 >> v2:172.21.15.175:3300/0 conn(0x7f42340cb6e0 msgr2=0x7f4234069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:56.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f4231ffb700 1 --2- 172.21.15.6:0/1590305808 >> v2:172.21.15.175:3300/0 conn(0x7f42340cb6e0 0x7f4234069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f4231ffb700 1 -- 172.21.15.6:0/1590305808 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423415a740 con 0x7f423406a2c0 2023-10-06T02:19:56.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f4232ffd700 1 --2- 172.21.15.6:0/1590305808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42340cf7d0 0x7f42340cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:19:56.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f4231ffb700 1 -- 172.21.15.6:0/1590305808 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f422c001470 con 0x7f423406a2c0 2023-10-06T02:19:56.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f4231ffb700 1 -- 172.21.15.6:0/1590305808 >> v1:172.21.15.6:6789/0 conn(0x7f423406a2c0 legacy=0x7f423415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f4231ffb700 1 --2- 172.21.15.6:0/1590305808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42340cf7d0 0x7f4220003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f4231ffb700 1 --2- 172.21.15.6:0/1590305808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4220003fd0 0x7f4220004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f4231ffb700 1 --2- 172.21.15.6:0/1590305808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4220004d50 0x7f42200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f4231ffb700 1 -- 172.21.15.6:0/1590305808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4234159c10 con 0x7f4220004d50 2023-10-06T02:19:56.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f4231ffb700 1 -- 172.21.15.6:0/1590305808 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423415abd0 con 0x7f4220003fd0 2023-10-06T02:19:56.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f4231ffb700 1 -- 172.21.15.6:0/1590305808 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422000ba90 con 0x7f42340cf7d0 2023-10-06T02:19:56.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f42337fe700 1 --2- 172.21.15.6:0/1590305808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4220004d50 0x7f42200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f4232ffd700 1 --2- 172.21.15.6:0/1590305808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42340cf7d0 0x7f4220003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f42327fc700 1 --2- 172.21.15.6:0/1590305808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4220003fd0 0x7f4220004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f42337fe700 1 -- 172.21.15.6:0/1590305808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42340cf7d0 msgr2=0x7f4220003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:56.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f42337fe700 1 --2- 172.21.15.6:0/1590305808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42340cf7d0 0x7f4220003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f42337fe700 1 -- 172.21.15.6:0/1590305808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4220003fd0 msgr2=0x7f4220004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:56.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f42337fe700 1 --2- 172.21.15.6:0/1590305808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4220003fd0 0x7f4220004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f42337fe700 1 -- 172.21.15.6:0/1590305808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4224009a20 con 0x7f4220004d50 2023-10-06T02:19:56.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.611+0000 7f42337fe700 1 --2- 172.21.15.6:0/1590305808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4220004d50 0x7f42200051c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f422c00c390 tx=0x7f423415a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1536ec62bcd75508 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:56.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.612+0000 7f4231ffb700 1 -- 172.21.15.6:0/1590305808 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c00cc60 con 0x7f4220004d50 2023-10-06T02:19:56.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.612+0000 7f4231ffb700 1 -- 172.21.15.6:0/1590305808 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c00cdc0 con 0x7f4220004d50 2023-10-06T02:19:56.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.612+0000 7f4231ffb700 1 -- 172.21.15.6:0/1590305808 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c005b70 con 0x7f4220004d50 2023-10-06T02:19:56.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.612+0000 7f42392ba700 1 -- 172.21.15.6:0/1590305808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4220004d50 msgr2=0x7f42200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.612+0000 7f42392ba700 1 --2- 172.21.15.6:0/1590305808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4220004d50 0x7f42200051c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f422c00c390 tx=0x7f423415a6b0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.612+0000 7f42337fe700 1 -- 172.21.15.6:0/1590305808 reap_dead start 2023-10-06T02:19:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.612+0000 7f42392ba700 1 -- 172.21.15.6:0/1590305808 shutdown_connections 2023-10-06T02:19:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.612+0000 7f42392ba700 1 -- 172.21.15.6:0/1590305808 >> 172.21.15.6:0/1590305808 conn(0x7f42340d0c60 msgr2=0x7f42340ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.612+0000 7f42392ba700 1 -- 172.21.15.6:0/1590305808 shutdown_connections 2023-10-06T02:19:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.612+0000 7f42392ba700 1 -- 172.21.15.6:0/1590305808 wait complete. 2023-10-06T02:19:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.613+0000 7f42392ba700 1 Processor -- start 2023-10-06T02:19:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.613+0000 7f42392ba700 1 -- start start 2023-10-06T02:19:56.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.614+0000 7f42392ba700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4234155f90 0x7f42340b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.614+0000 7f42392ba700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42340af3b0 0x7f423416e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.614+0000 7f42392ba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4234156360 0x7f42340c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.614+0000 7f42392ba700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423415b640 con 0x7f4234156360 2023-10-06T02:19:56.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.614+0000 7f42392ba700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423416dc10 con 0x7f42340af3b0 2023-10-06T02:19:56.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.614+0000 7f42392ba700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423415ada0 con 0x7f4234155f90 2023-10-06T02:19:56.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.614+0000 7f42337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4234156360 0x7f42340c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.614+0000 7f42337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4234156360 0x7f42340c4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36542/0 (socket says 172.21.15.6:36542) 2023-10-06T02:19:56.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.614+0000 7f42337fe700 1 -- 172.21.15.6:0/2524703516 learned_addr learned my addr 172.21.15.6:0/2524703516 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:56.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.614+0000 7f4232ffd700 1 --2- 172.21.15.6:0/2524703516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4234155f90 0x7f42340b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.614+0000 7f42327fc700 1 --2- 172.21.15.6:0/2524703516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42340af3b0 0x7f423416e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.614+0000 7f42337fe700 1 -- 172.21.15.6:0/2524703516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4234155f90 msgr2=0x7f42340b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.614+0000 7f42337fe700 1 --2- 172.21.15.6:0/2524703516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4234155f90 0x7f42340b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.614+0000 7f42337fe700 1 -- 172.21.15.6:0/2524703516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42340af3b0 msgr2=0x7f423416e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.614+0000 7f42337fe700 1 --2- 172.21.15.6:0/2524703516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42340af3b0 0x7f423416e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.614+0000 7f42337fe700 1 -- 172.21.15.6:0/2524703516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423415b080 con 0x7f4234156360 2023-10-06T02:19:56.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.614+0000 7f42327fc700 1 --2- 172.21.15.6:0/2524703516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42340af3b0 0x7f423416e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:56.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.615+0000 7f42337fe700 1 --2- 172.21.15.6:0/2524703516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4234156360 0x7f42340c4fb0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f422c00c980 tx=0x7f422c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:56.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.615+0000 7f422affd700 1 -- 172.21.15.6:0/2524703516 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c022070 con 0x7f4234156360 2023-10-06T02:19:56.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.615+0000 7f422affd700 1 -- 172.21.15.6:0/2524703516 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c0070d0 con 0x7f4234156360 2023-10-06T02:19:56.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.615+0000 7f42392ba700 1 -- 172.21.15.6:0/2524703516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423415b360 con 0x7f4234156360 2023-10-06T02:19:56.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.615+0000 7f422affd700 1 -- 172.21.15.6:0/2524703516 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c00cc60 con 0x7f4234156360 2023-10-06T02:19:56.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.615+0000 7f42392ba700 1 -- 172.21.15.6:0/2524703516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423416e5e0 con 0x7f4234156360 2023-10-06T02:19:56.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.616+0000 7f42392ba700 1 -- 172.21.15.6:0/2524703516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423416d700 con 0x7f4234156360 2023-10-06T02:19:56.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.616+0000 7f422affd700 1 -- 172.21.15.6:0/2524703516 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f422c0076c0 con 0x7f4234156360 2023-10-06T02:19:56.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.617+0000 7f422affd700 1 --2- 172.21.15.6:0/2524703516 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4214066f30 0x7f42140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.617+0000 7f422affd700 1 -- 172.21.15.6:0/2524703516 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f422c085b50 con 0x7f4234156360 2023-10-06T02:19:56.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.617+0000 7f4232ffd700 1 --2- 172.21.15.6:0/2524703516 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4214066f30 0x7f42140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.617+0000 7f4232ffd700 1 --2- 172.21.15.6:0/2524703516 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4214066f30 0x7f42140693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f42240094d0 tx=0x7f422400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:56.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.621+0000 7f422affd700 1 -- 172.21.15.6:0/2524703516 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f423416d700 con 0x7f4234156360 2023-10-06T02:19:56.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.812+0000 7f42392ba700 1 -- 172.21.15.6:0/2524703516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f423416d700 con 0x7f4234156360 2023-10-06T02:19:56.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.813+0000 7f422affd700 1 -- 172.21.15.6:0/2524703516 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f423416d700 con 0x7f4234156360 2023-10-06T02:19:56.814 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-06T02:19:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.815+0000 7f42392ba700 1 -- 172.21.15.6:0/2524703516 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4214066f30 msgr2=0x7f42140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.815+0000 7f42392ba700 1 --2- 172.21.15.6:0/2524703516 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4214066f30 0x7f42140693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f42240094d0 tx=0x7f422400b040 comp rx=0 tx=0).stop 2023-10-06T02:19:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.815+0000 7f42392ba700 1 -- 172.21.15.6:0/2524703516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4234156360 msgr2=0x7f42340c4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.815+0000 7f42392ba700 1 --2- 172.21.15.6:0/2524703516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4234156360 0x7f42340c4fb0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f422c00c980 tx=0x7f422c015000 comp rx=0 tx=0).stop 2023-10-06T02:19:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.815+0000 7f42392ba700 1 -- 172.21.15.6:0/2524703516 shutdown_connections 2023-10-06T02:19:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.815+0000 7f42392ba700 1 --2- 172.21.15.6:0/2524703516 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4214066f30 0x7f42140693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.815+0000 7f42392ba700 1 --2- 172.21.15.6:0/2524703516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4234156360 0x7f42340c4fb0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.815+0000 7f42392ba700 1 --2- 172.21.15.6:0/2524703516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4234155f90 0x7f42340b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.815+0000 7f42392ba700 1 --2- 172.21.15.6:0/2524703516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42340af3b0 0x7f423416e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.815+0000 7f42392ba700 1 -- 172.21.15.6:0/2524703516 >> 172.21.15.6:0/2524703516 conn(0x7f42340d0c60 msgr2=0x7f42340b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:56.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.815+0000 7f42392ba700 1 -- 172.21.15.6:0/2524703516 shutdown_connections 2023-10-06T02:19:56.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.815+0000 7f42392ba700 1 -- 172.21.15.6:0/2524703516 wait complete. 2023-10-06T02:19:56.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:19:56.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.945+0000 7fb8d9c16700 1 Processor -- start 2023-10-06T02:19:56.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.945+0000 7fb8d9c16700 1 -- start start 2023-10-06T02:19:56.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.946+0000 7fb8d9c16700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8d40af4e0 0x7fb8d40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.946+0000 7fb8d9c16700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d415e190 con 0x7fb8d40af8b0 2023-10-06T02:19:56.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.946+0000 7fb8d9c16700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d40cb650 con 0x7fb8d415db70 2023-10-06T02:19:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.946+0000 7fb8d9c16700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d40b1910 con 0x7fb8d40af4e0 2023-10-06T02:19:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.946+0000 7fb8d2ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb8d40af8b0 0x7fb8d415d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47112/0 (socket says 172.21.15.6:47112) 2023-10-06T02:19:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.946+0000 7fb8d2ffd700 1 -- 172.21.15.6:0/1460390424 learned_addr learned my addr 172.21.15.6:0/1460390424 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:19:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.946+0000 7fb8d37fe700 1 --2- 172.21.15.6:0/1460390424 >> v2:172.21.15.175:3300/0 conn(0x7fb8d40af4e0 0x7fb8d40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.946+0000 7fb8d27fc700 1 -- 172.21.15.6:0/1460390424 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28896743 0 0) 0x7fb8d415e190 con 0x7fb8d40af8b0 2023-10-06T02:19:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d27fc700 1 -- 172.21.15.6:0/1460390424 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8bc003570 con 0x7fb8d40af8b0 2023-10-06T02:19:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d27fc700 1 -- 172.21.15.6:0/1460390424 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17157014 0 0) 0x7fb8d40cb650 con 0x7fb8d415db70 2023-10-06T02:19:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d27fc700 1 -- 172.21.15.6:0/1460390424 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8d415e190 con 0x7fb8d415db70 2023-10-06T02:19:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d27fc700 1 -- 172.21.15.6:0/1460390424 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1387345556 0 0) 0x7fb8bc003570 con 0x7fb8d40af8b0 2023-10-06T02:19:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d27fc700 1 -- 172.21.15.6:0/1460390424 >> v2:172.21.15.175:3300/0 conn(0x7fb8d40af4e0 msgr2=0x7fb8d40b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d27fc700 1 --2- 172.21.15.6:0/1460390424 >> v2:172.21.15.175:3300/0 conn(0x7fb8d40af4e0 0x7fb8d40b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d27fc700 1 -- 172.21.15.6:0/1460390424 >> v1:172.21.15.175:6789/0 conn(0x7fb8d415db70 legacy=0x7fb8d40cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d27fc700 1 -- 172.21.15.6:0/1460390424 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d40cad20 con 0x7fb8d40af8b0 2023-10-06T02:19:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d27fc700 1 -- 172.21.15.6:0/1460390424 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fb8c8001470 con 0x7fb8d40af8b0 2023-10-06T02:19:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d27fc700 1 -- 172.21.15.6:0/1460390424 >> v1:172.21.15.6:6789/0 conn(0x7fb8d40af8b0 legacy=0x7fb8d415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d27fc700 1 --2- 172.21.15.6:0/1460390424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8bc003c40 0x7fb8bc004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d27fc700 1 --2- 172.21.15.6:0/1460390424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8bc004810 0x7fb8bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d27fc700 1 --2- 172.21.15.6:0/1460390424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8bc005210 0x7fb8bc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d27fc700 1 -- 172.21.15.6:0/1460390424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d40b1910 con 0x7fb8bc005210 2023-10-06T02:19:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d27fc700 1 -- 172.21.15.6:0/1460390424 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc00c1b0 con 0x7fb8bc003c40 2023-10-06T02:19:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d27fc700 1 -- 172.21.15.6:0/1460390424 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc00c370 con 0x7fb8bc004810 2023-10-06T02:19:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d3fff700 1 --2- 172.21.15.6:0/1460390424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8bc005210 0x7fb8bc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d37fe700 1 --2- 172.21.15.6:0/1460390424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8bc003c40 0x7fb8bc004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d2ffd700 1 --2- 172.21.15.6:0/1460390424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8bc004810 0x7fb8bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d3fff700 1 -- 172.21.15.6:0/1460390424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8bc004810 msgr2=0x7fb8bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d3fff700 1 --2- 172.21.15.6:0/1460390424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8bc004810 0x7fb8bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d3fff700 1 -- 172.21.15.6:0/1460390424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8bc003c40 msgr2=0x7fb8bc004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d3fff700 1 --2- 172.21.15.6:0/1460390424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8bc003c40 0x7fb8bc004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d3fff700 1 -- 172.21.15.6:0/1460390424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8bc003570 con 0x7fb8bc005210 2023-10-06T02:19:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.947+0000 7fb8d3fff700 1 -- 172.21.15.6:0/1460390424 reap_dead start 2023-10-06T02:19:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.948+0000 7fb8d3fff700 1 --2- 172.21.15.6:0/1460390424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8bc005210 0x7fb8bc00ba60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0020f0 tx=0x7fb8cc0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30596807ba4fda6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.948+0000 7fb8d27fc700 1 -- 172.21.15.6:0/1460390424 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc001ab0 con 0x7fb8bc005210 2023-10-06T02:19:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.948+0000 7fb8d27fc700 1 -- 172.21.15.6:0/1460390424 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc00c8b0 con 0x7fb8bc005210 2023-10-06T02:19:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.948+0000 7fb8d27fc700 1 -- 172.21.15.6:0/1460390424 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc00cc50 con 0x7fb8bc005210 2023-10-06T02:19:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.948+0000 7fb8d9c16700 1 -- 172.21.15.6:0/1460390424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8bc005210 msgr2=0x7fb8bc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.948+0000 7fb8d9c16700 1 --2- 172.21.15.6:0/1460390424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8bc005210 0x7fb8bc00ba60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0020f0 tx=0x7fb8cc0017a0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.948+0000 7fb8d9c16700 1 -- 172.21.15.6:0/1460390424 shutdown_connections 2023-10-06T02:19:56.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.948+0000 7fb8d9c16700 1 --2- 172.21.15.6:0/1460390424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8bc005210 0x7fb8bc00ba60 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.948+0000 7fb8d9c16700 1 -- 172.21.15.6:0/1460390424 >> 172.21.15.6:0/1460390424 conn(0x7fb8d4068680 msgr2=0x7fb8d4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:56.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.948+0000 7fb8d9c16700 1 -- 172.21.15.6:0/1460390424 shutdown_connections 2023-10-06T02:19:56.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.948+0000 7fb8d9c16700 1 -- 172.21.15.6:0/1460390424 wait complete. 2023-10-06T02:19:56.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.950+0000 7fb8d9c16700 1 Processor -- start 2023-10-06T02:19:56.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.950+0000 7fb8d9c16700 1 -- start start 2023-10-06T02:19:56.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.950+0000 7fb8d9c16700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8bc005210 0x7fb8d4169b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.950+0000 7fb8d9c16700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8d40b4170 0x7fb8d40b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8d9c16700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8d40d04a0 0x7fb8d40d0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8d9c16700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d40b4b20 con 0x7fb8d40b4170 2023-10-06T02:19:56.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8d9c16700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d40c8e90 con 0x7fb8d40d04a0 2023-10-06T02:19:56.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8d9c16700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d40ce160 con 0x7fb8bc005210 2023-10-06T02:19:56.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8d2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8d40b4170 0x7fb8d40b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8d2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8d40b4170 0x7fb8d40b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36560/0 (socket says 172.21.15.6:36560) 2023-10-06T02:19:56.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8d2ffd700 1 -- 172.21.15.6:0/646409693 learned_addr learned my addr 172.21.15.6:0/646409693 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:56.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8d37fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8bc005210 0x7fb8d4169b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8d3fff700 1 --2- 172.21.15.6:0/646409693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8d40d04a0 0x7fb8d40d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8d2ffd700 1 -- 172.21.15.6:0/646409693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8bc005210 msgr2=0x7fb8d4169b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8d2ffd700 1 --2- 172.21.15.6:0/646409693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8bc005210 0x7fb8d4169b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8d2ffd700 1 -- 172.21.15.6:0/646409693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8d40d04a0 msgr2=0x7fb8d40d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:56.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8d2ffd700 1 --2- 172.21.15.6:0/646409693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8d40d04a0 0x7fb8d40d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:56.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8d2ffd700 1 -- 172.21.15.6:0/646409693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d40c8560 con 0x7fb8d40b4170 2023-10-06T02:19:56.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8d2ffd700 1 --2- 172.21.15.6:0/646409693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8d40b4170 0x7fb8d40b45e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8000e00 tx=0x7fb8c8001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:56.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8bb7fe700 1 -- 172.21.15.6:0/646409693 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8011590 con 0x7fb8d40b4170 2023-10-06T02:19:56.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8bb7fe700 1 -- 172.21.15.6:0/646409693 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c8011710 con 0x7fb8d40b4170 2023-10-06T02:19:56.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8d9c16700 1 -- 172.21.15.6:0/646409693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d40c8840 con 0x7fb8d40b4170 2023-10-06T02:19:56.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8bb7fe700 1 -- 172.21.15.6:0/646409693 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8011ad0 con 0x7fb8d40b4170 2023-10-06T02:19:56.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.951+0000 7fb8d9c16700 1 -- 172.21.15.6:0/646409693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d416a0c0 con 0x7fb8d40b4170 2023-10-06T02:19:56.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.952+0000 7fb8d9c16700 1 -- 172.21.15.6:0/646409693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d40c8ce0 con 0x7fb8d40b4170 2023-10-06T02:19:56.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.953+0000 7fb8bb7fe700 1 -- 172.21.15.6:0/646409693 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8c801d460 con 0x7fb8d40b4170 2023-10-06T02:19:56.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.953+0000 7fb8bb7fe700 1 --2- 172.21.15.6:0/646409693 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb8c0066f30 0x7fb8c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:56.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.953+0000 7fb8bb7fe700 1 -- 172.21.15.6:0/646409693 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fb8c80848a0 con 0x7fb8d40b4170 2023-10-06T02:19:56.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.954+0000 7fb8d37fe700 1 --2- 172.21.15.6:0/646409693 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb8c0066f30 0x7fb8c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:56.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.954+0000 7fb8d37fe700 1 --2- 172.21.15.6:0/646409693 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb8c0066f30 0x7fb8c00693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4006f00 tx=0x7fb8c40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:56.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:56.958+0000 7fb8bb7fe700 1 -- 172.21.15.6:0/646409693 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8c8051890 con 0x7fb8d40b4170 2023-10-06T02:19:57.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.196+0000 7fb8d9c16700 1 -- 172.21.15.6:0/646409693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8d40b0910 con 0x7fb8d40b4170 2023-10-06T02:19:57.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.196+0000 7fb8bb7fe700 1 -- 172.21.15.6:0/646409693 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fb8c8054eb0 con 0x7fb8d40b4170 2023-10-06T02:19:57.198 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:19:57.198 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1173605075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1173605075},{"type":"v1","addr":"172.21.15.175:6837","nonce":1173605075}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/375122461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":375122461},{"type":"v1","addr":"172.21.15.175:6835","nonce":375122461}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5142,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3506443204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3506443204},{"type":"v1","addr":"172.21.15.6:6835","nonce":3506443204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:18:45.349958+0000","modified":"2023-10-06T02:19:16.895235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5385},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5385":{"gid":5385,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.6:6834/1188971598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1188971598},{"type":"v1","addr":"172.21.15.6:6834","nonce":1188971598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:19:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.199+0000 7fb8d9c16700 1 -- 172.21.15.6:0/646409693 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb8c0066f30 msgr2=0x7fb8c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.199+0000 7fb8d9c16700 1 --2- 172.21.15.6:0/646409693 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb8c0066f30 0x7fb8c00693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4006f00 tx=0x7fb8c40091a0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.199+0000 7fb8d9c16700 1 -- 172.21.15.6:0/646409693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8d40b4170 msgr2=0x7fb8d40b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.199+0000 7fb8d9c16700 1 --2- 172.21.15.6:0/646409693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8d40b4170 0x7fb8d40b45e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8000e00 tx=0x7fb8c8001d20 comp rx=0 tx=0).stop 2023-10-06T02:19:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.199+0000 7fb8d9c16700 1 -- 172.21.15.6:0/646409693 shutdown_connections 2023-10-06T02:19:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.199+0000 7fb8d9c16700 1 --2- 172.21.15.6:0/646409693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8d40d04a0 0x7fb8d40d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.199+0000 7fb8d9c16700 1 --2- 172.21.15.6:0/646409693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8bc005210 0x7fb8d4169b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.199+0000 7fb8d9c16700 1 --2- 172.21.15.6:0/646409693 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb8c0066f30 0x7fb8c00693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.199+0000 7fb8d9c16700 1 --2- 172.21.15.6:0/646409693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8d40b4170 0x7fb8d40b45e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.199+0000 7fb8d9c16700 1 -- 172.21.15.6:0/646409693 >> 172.21.15.6:0/646409693 conn(0x7fb8d4068680 msgr2=0x7fb8d415c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.199+0000 7fb8d9c16700 1 -- 172.21.15.6:0/646409693 shutdown_connections 2023-10-06T02:19:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.199+0000 7fb8d9c16700 1 -- 172.21.15.6:0/646409693 wait complete. 2023-10-06T02:19:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 24 2023-10-06T02:19:57.212 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:19:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.329+0000 7fe71b145700 1 Processor -- start 2023-10-06T02:19:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.329+0000 7fe71b145700 1 -- start start 2023-10-06T02:19:57.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.330+0000 7fe71b145700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe714159150 0x7fe71415de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:57.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.330+0000 7fe71b145700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7140b08f0 0x7fe714159520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:57.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.330+0000 7fe71b145700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7140afbc0 con 0x7fe7140cccf0 2023-10-06T02:19:57.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.330+0000 7fe71b145700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe714159a60 con 0x7fe714159150 2023-10-06T02:19:57.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.330+0000 7fe71b145700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7140cd620 con 0x7fe7140b08f0 2023-10-06T02:19:57.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.330+0000 7fe718ee1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe714159150 0x7fe71415de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:57.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.330+0000 7fe718ee1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe714159150 0x7fe71415de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36574/0 (socket says 172.21.15.6:36574) 2023-10-06T02:19:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.330+0000 7fe718ee1700 1 -- 172.21.15.6:0/2664694863 learned_addr learned my addr 172.21.15.6:0/2664694863 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.330+0000 7fe7196e2700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe7140cccf0 0x7fe7140b20a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47114/0 (socket says 172.21.15.6:47114) 2023-10-06T02:19:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.331+0000 7fe713fff700 1 --2- 172.21.15.6:0/2664694863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7140b08f0 0x7fe714159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.331+0000 7fe718ee1700 1 -- 172.21.15.6:0/2664694863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7140b08f0 msgr2=0x7fe714159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.331+0000 7fe718ee1700 1 --2- 172.21.15.6:0/2664694863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7140b08f0 0x7fe714159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.331+0000 7fe718ee1700 1 -- 172.21.15.6:0/2664694863 >> v1:172.21.15.6:6789/0 conn(0x7fe7140cccf0 legacy=0x7fe7140b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.331+0000 7fe718ee1700 1 -- 172.21.15.6:0/2664694863 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7140afe10 con 0x7fe714159150 2023-10-06T02:19:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.331+0000 7fe7137fe700 1 -- 172.21.15.6:0/2664694863 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176331749 0 0) 0x7fe7140afbc0 con 0x7fe7140cccf0 2023-10-06T02:19:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.331+0000 7fe718ee1700 1 --2- 172.21.15.6:0/2664694863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe714159150 0x7fe71415de30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0099b0 tx=0x7fe6fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db1cd9f119e6eb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.331+0000 7fe7137fe700 1 -- 172.21.15.6:0/2664694863 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc00b860 con 0x7fe714159150 2023-10-06T02:19:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.331+0000 7fe7137fe700 1 -- 172.21.15.6:0/2664694863 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc00b9c0 con 0x7fe714159150 2023-10-06T02:19:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.331+0000 7fe7137fe700 1 -- 172.21.15.6:0/2664694863 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc00bd60 con 0x7fe714159150 2023-10-06T02:19:57.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.331+0000 7fe71b145700 1 -- 172.21.15.6:0/2664694863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe714159150 msgr2=0x7fe71415de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:57.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.331+0000 7fe71b145700 1 --2- 172.21.15.6:0/2664694863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe714159150 0x7fe71415de30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0099b0 tx=0x7fe6fc009250 comp rx=0 tx=0).stop 2023-10-06T02:19:57.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.332+0000 7fe71b145700 1 -- 172.21.15.6:0/2664694863 shutdown_connections 2023-10-06T02:19:57.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.332+0000 7fe71b145700 1 --2- 172.21.15.6:0/2664694863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe714159150 0x7fe71415de30 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.332+0000 7fe71b145700 1 --2- 172.21.15.6:0/2664694863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7140b08f0 0x7fe714159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.332+0000 7fe71b145700 1 -- 172.21.15.6:0/2664694863 >> 172.21.15.6:0/2664694863 conn(0x7fe714068680 msgr2=0x7fe714068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:57.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.332+0000 7fe71b145700 1 -- 172.21.15.6:0/2664694863 shutdown_connections 2023-10-06T02:19:57.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.332+0000 7fe71b145700 1 -- 172.21.15.6:0/2664694863 wait complete. 2023-10-06T02:19:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.333+0000 7fe71b145700 1 Processor -- start 2023-10-06T02:19:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.333+0000 7fe71b145700 1 -- start start 2023-10-06T02:19:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe71b145700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7140b08f0 0x7fe714156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe71b145700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7140cccf0 0x7fe7140c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe71b145700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe714159150 0x7fe7140c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe71b145700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71415bfc0 con 0x7fe7140b08f0 2023-10-06T02:19:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe71b145700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71415af20 con 0x7fe7140cccf0 2023-10-06T02:19:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe71b145700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71415b200 con 0x7fe714159150 2023-10-06T02:19:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe718ee1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7140b08f0 0x7fe714156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe718ee1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7140b08f0 0x7fe714156a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36590/0 (socket says 172.21.15.6:36590) 2023-10-06T02:19:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe718ee1700 1 -- 172.21.15.6:0/422853243 learned_addr learned my addr 172.21.15.6:0/422853243 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe7196e2700 1 --2- 172.21.15.6:0/422853243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe714159150 0x7fe7140c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe713fff700 1 --2- 172.21.15.6:0/422853243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7140cccf0 0x7fe7140c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe718ee1700 1 -- 172.21.15.6:0/422853243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe714159150 msgr2=0x7fe7140c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe718ee1700 1 --2- 172.21.15.6:0/422853243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe714159150 0x7fe7140c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe718ee1700 1 -- 172.21.15.6:0/422853243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7140cccf0 msgr2=0x7fe7140c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe718ee1700 1 --2- 172.21.15.6:0/422853243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7140cccf0 0x7fe7140c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe718ee1700 1 -- 172.21.15.6:0/422853243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc0094f0 con 0x7fe7140b08f0 2023-10-06T02:19:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe718ee1700 1 --2- 172.21.15.6:0/422853243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7140b08f0 0x7fe714156a00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe714067bc0 tx=0x7fe6fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe710ff9700 1 -- 172.21.15.6:0/422853243 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc011d70 con 0x7fe7140b08f0 2023-10-06T02:19:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe710ff9700 1 -- 172.21.15.6:0/422853243 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc024440 con 0x7fe7140b08f0 2023-10-06T02:19:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe71b145700 1 -- 172.21.15.6:0/422853243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71415b4e0 con 0x7fe7140b08f0 2023-10-06T02:19:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.334+0000 7fe710ff9700 1 -- 172.21.15.6:0/422853243 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc024800 con 0x7fe7140b08f0 2023-10-06T02:19:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.335+0000 7fe71b145700 1 -- 172.21.15.6:0/422853243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71415baa0 con 0x7fe7140b08f0 2023-10-06T02:19:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.335+0000 7fe71b145700 1 -- 172.21.15.6:0/422853243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7140cfb90 con 0x7fe7140b08f0 2023-10-06T02:19:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.336+0000 7fe710ff9700 1 -- 172.21.15.6:0/422853243 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6fc02d440 con 0x7fe7140b08f0 2023-10-06T02:19:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.336+0000 7fe710ff9700 1 --2- 172.21.15.6:0/422853243 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6f4066f30 0x7fe6f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.336+0000 7fe710ff9700 1 -- 172.21.15.6:0/422853243 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fe6fc0861d0 con 0x7fe7140b08f0 2023-10-06T02:19:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.336+0000 7fe713fff700 1 --2- 172.21.15.6:0/422853243 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6f4066f30 0x7fe6f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.337+0000 7fe713fff700 1 --2- 172.21.15.6:0/422853243 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6f4066f30 0x7fe6f40693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe7140d1300 tx=0x7fe7040097e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.340+0000 7fe710ff9700 1 -- 172.21.15.6:0/422853243 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6fc053110 con 0x7fe7140b08f0 2023-10-06T02:19:57.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.534+0000 7fe71b145700 1 -- 172.21.15.6:0/422853243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe71415bc90 con 0x7fe7140b08f0 2023-10-06T02:19:57.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.535+0000 7fe710ff9700 1 -- 172.21.15.6:0/422853243 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17244 (secure 0 0 0) 0x7fe6fc056730 con 0x7fe7140b08f0 2023-10-06T02:19:57.536 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:19:57.536 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":42,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:19:31.977136+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:18:43.639616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T02:18:44.317938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.16","mappings":[{"from":0,"to":5}]},{"pgid":"7.35","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6834/774858203":"2023-10-07T02:19:05.864154+0000","172.21.15.6:6832/774858203":"2023-10-07T02:19:05.864154+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:19:57.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.537+0000 7fe71b145700 1 -- 172.21.15.6:0/422853243 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6f4066f30 msgr2=0x7fe6f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:57.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.537+0000 7fe71b145700 1 --2- 172.21.15.6:0/422853243 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6f4066f30 0x7fe6f40693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe7140d1300 tx=0x7fe7040097e0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.537+0000 7fe71b145700 1 -- 172.21.15.6:0/422853243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7140b08f0 msgr2=0x7fe714156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:57.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.537+0000 7fe71b145700 1 --2- 172.21.15.6:0/422853243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7140b08f0 0x7fe714156a00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe714067bc0 tx=0x7fe6fc017000 comp rx=0 tx=0).stop 2023-10-06T02:19:57.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.537+0000 7fe71b145700 1 -- 172.21.15.6:0/422853243 shutdown_connections 2023-10-06T02:19:57.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.537+0000 7fe71b145700 1 --2- 172.21.15.6:0/422853243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe714159150 0x7fe7140c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.537+0000 7fe71b145700 1 --2- 172.21.15.6:0/422853243 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6f4066f30 0x7fe6f40693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.537+0000 7fe71b145700 1 --2- 172.21.15.6:0/422853243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7140b08f0 0x7fe714156a00 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.537+0000 7fe71b145700 1 --2- 172.21.15.6:0/422853243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7140cccf0 0x7fe7140c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.537+0000 7fe71b145700 1 -- 172.21.15.6:0/422853243 >> 172.21.15.6:0/422853243 conn(0x7fe714068680 msgr2=0x7fe7140cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:57.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.537+0000 7fe71b145700 1 -- 172.21.15.6:0/422853243 shutdown_connections 2023-10-06T02:19:57.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.537+0000 7fe71b145700 1 -- 172.21.15.6:0/422853243 wait complete. 2023-10-06T02:19:57.550 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:19:57.550 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:19:57.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.668+0000 7fd70f59e700 1 Processor -- start 2023-10-06T02:19:57.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.668+0000 7fd70f59e700 1 -- start start 2023-10-06T02:19:57.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.669+0000 7fd70f59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd7100cf1a0 0x7fd7100cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:57.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.669+0000 7fd70f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7101597d0 0x7fd7100d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:57.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.669+0000 7fd70f59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7100b3560 con 0x7fd710159400 2023-10-06T02:19:57.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.669+0000 7fd70f59e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7100cf6f0 con 0x7fd7100cf1a0 2023-10-06T02:19:57.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.669+0000 7fd70f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100cf9d0 con 0x7fd7101597d0 2023-10-06T02:19:57.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.669+0000 7fd70dd9b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd7100cf1a0 0x7fd7100cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:57.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.669+0000 7fd70ed9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7101597d0 0x7fd7100d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:57.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.669+0000 7fd70dd9b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd7100cf1a0 0x7fd7100cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:45388/0 (socket says 172.21.15.6:45388) 2023-10-06T02:19:57.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.669+0000 7fd70e59c700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd710159400 0x7fd7100ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:58260/0 (socket says 172.21.15.6:58260) 2023-10-06T02:19:57.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.669+0000 7fd70dd9b700 1 -- 172.21.15.6:0/2620397688 learned_addr learned my addr 172.21.15.6:0/2620397688 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:57.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.669+0000 7fd70dd9b700 1 -- 172.21.15.6:0/2620397688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7101597d0 msgr2=0x7fd7100d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:57.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.669+0000 7fd70dd9b700 1 --2- 172.21.15.6:0/2620397688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7101597d0 0x7fd7100d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.669+0000 7fd70dd9b700 1 -- 172.21.15.6:0/2620397688 >> v1:172.21.15.175:6789/0 conn(0x7fd710159400 legacy=0x7fd7100ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:57.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.669+0000 7fd70d59a700 1 -- 172.21.15.6:0/2620397688 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563396344 0 0) 0x7fd7100b3560 con 0x7fd710159400 2023-10-06T02:19:57.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.669+0000 7fd70dd9b700 1 -- 172.21.15.6:0/2620397688 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7100b2f10 con 0x7fd7100cf1a0 2023-10-06T02:19:57.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.670+0000 7fd70dd9b700 1 --2- 172.21.15.6:0/2620397688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7100cf1a0 0x7fd7100cfec0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80099b0 tx=0x7fd6f8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a41e63b2fdf176a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:57.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.670+0000 7fd70d59a700 1 -- 172.21.15.6:0/2620397688 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8009ea0 con 0x7fd7100cf1a0 2023-10-06T02:19:57.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.670+0000 7fd70d59a700 1 -- 172.21.15.6:0/2620397688 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f800b860 con 0x7fd7100cf1a0 2023-10-06T02:19:57.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.670+0000 7fd70d59a700 1 -- 172.21.15.6:0/2620397688 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f800bc00 con 0x7fd7100cf1a0 2023-10-06T02:19:57.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.670+0000 7fd70f59e700 1 -- 172.21.15.6:0/2620397688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7100cf1a0 msgr2=0x7fd7100cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:57.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.670+0000 7fd70f59e700 1 --2- 172.21.15.6:0/2620397688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7100cf1a0 0x7fd7100cfec0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80099b0 tx=0x7fd6f8009250 comp rx=0 tx=0).stop 2023-10-06T02:19:57.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.670+0000 7fd70f59e700 1 -- 172.21.15.6:0/2620397688 shutdown_connections 2023-10-06T02:19:57.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.670+0000 7fd70f59e700 1 --2- 172.21.15.6:0/2620397688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7101597d0 0x7fd7100d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.670+0000 7fd70f59e700 1 --2- 172.21.15.6:0/2620397688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7100cf1a0 0x7fd7100cfec0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.670+0000 7fd70f59e700 1 -- 172.21.15.6:0/2620397688 >> 172.21.15.6:0/2620397688 conn(0x7fd71006ac10 msgr2=0x7fd710068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:57.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.670+0000 7fd70f59e700 1 -- 172.21.15.6:0/2620397688 shutdown_connections 2023-10-06T02:19:57.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.670+0000 7fd70f59e700 1 -- 172.21.15.6:0/2620397688 wait complete. 2023-10-06T02:19:57.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.672+0000 7fd70f59e700 1 Processor -- start 2023-10-06T02:19:57.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.672+0000 7fd70f59e700 1 -- start start 2023-10-06T02:19:57.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.672+0000 7fd70f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7100cf1a0 0x7fd71015e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:57.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.672+0000 7fd70f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd710159400 0x7fd710146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:57.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.672+0000 7fd70f59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7101597d0 0x7fd7100cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:57.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.672+0000 7fd70f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71015dd00 con 0x7fd710159400 2023-10-06T02:19:57.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.672+0000 7fd70f59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71015ce30 con 0x7fd7101597d0 2023-10-06T02:19:57.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.672+0000 7fd70f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71015d0f0 con 0x7fd7100cf1a0 2023-10-06T02:19:57.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.673+0000 7fd70dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd710159400 0x7fd710146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:57.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.673+0000 7fd70dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd710159400 0x7fd710146b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36592/0 (socket says 172.21.15.6:36592) 2023-10-06T02:19:57.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.673+0000 7fd70dd9b700 1 -- 172.21.15.6:0/1689485995 learned_addr learned my addr 172.21.15.6:0/1689485995 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:57.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.673+0000 7fd70ed9d700 1 --2- 172.21.15.6:0/1689485995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7101597d0 0x7fd7100cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:57.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.673+0000 7fd70e59c700 1 --2- 172.21.15.6:0/1689485995 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7100cf1a0 0x7fd71015e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:57.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.673+0000 7fd70dd9b700 1 -- 172.21.15.6:0/1689485995 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7100cf1a0 msgr2=0x7fd71015e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:57.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.673+0000 7fd70dd9b700 1 --2- 172.21.15.6:0/1689485995 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7100cf1a0 0x7fd71015e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.673+0000 7fd70dd9b700 1 -- 172.21.15.6:0/1689485995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7101597d0 msgr2=0x7fd7100cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:57.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.673+0000 7fd70dd9b700 1 --2- 172.21.15.6:0/1689485995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7101597d0 0x7fd7100cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.673+0000 7fd70dd9b700 1 -- 172.21.15.6:0/1689485995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f80094f0 con 0x7fd710159400 2023-10-06T02:19:57.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.673+0000 7fd70ed9d700 1 --2- 172.21.15.6:0/1689485995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7101597d0 0x7fd7100cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:19:57.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.673+0000 7fd70dd9b700 1 --2- 172.21.15.6:0/1689485995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd710159400 0x7fd710146b50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd7100b2b80 tx=0x7fd6f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:57.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.673+0000 7fd7067fc700 1 -- 172.21.15.6:0/1689485995 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f800bbe0 con 0x7fd710159400 2023-10-06T02:19:57.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.673+0000 7fd7067fc700 1 -- 172.21.15.6:0/1689485995 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f8011420 con 0x7fd710159400 2023-10-06T02:19:57.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.673+0000 7fd70f59e700 1 -- 172.21.15.6:0/1689485995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71015d3d0 con 0x7fd710159400 2023-10-06T02:19:57.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.673+0000 7fd7067fc700 1 -- 172.21.15.6:0/1689485995 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f80117e0 con 0x7fd710159400 2023-10-06T02:19:57.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.673+0000 7fd70f59e700 1 -- 172.21.15.6:0/1689485995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71015d990 con 0x7fd710159400 2023-10-06T02:19:57.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.674+0000 7fd70f59e700 1 -- 172.21.15.6:0/1689485995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7100ccaf0 con 0x7fd710159400 2023-10-06T02:19:57.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.675+0000 7fd7067fc700 1 -- 172.21.15.6:0/1689485995 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6f8011c10 con 0x7fd710159400 2023-10-06T02:19:57.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.675+0000 7fd7067fc700 1 --2- 172.21.15.6:0/1689485995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6f0066f30 0x7fd6f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:57.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.675+0000 7fd7067fc700 1 -- 172.21.15.6:0/1689485995 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fd6f8086310 con 0x7fd710159400 2023-10-06T02:19:57.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.675+0000 7fd70e59c700 1 --2- 172.21.15.6:0/1689485995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6f0066f30 0x7fd6f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:57.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.676+0000 7fd70e59c700 1 --2- 172.21.15.6:0/1689485995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6f0066f30 0x7fd6f00693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd7000015b0 tx=0x7fd700001970 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:57.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.679+0000 7fd7067fc700 1 -- 172.21.15.6:0/1689485995 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6f80531b0 con 0x7fd710159400 2023-10-06T02:19:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.918+0000 7fd70f59e700 1 -- 172.21.15.6:0/1689485995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd71015de40 con 0x7fd710159400 2023-10-06T02:19:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.919+0000 7fd7067fc700 1 -- 172.21.15.6:0/1689485995 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fd6f80567d0 con 0x7fd710159400 2023-10-06T02:19:57.921 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:19:57.921 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1173605075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1173605075},{"type":"v1","addr":"172.21.15.175:6837","nonce":1173605075}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/375122461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":375122461},{"type":"v1","addr":"172.21.15.175:6835","nonce":375122461}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5142,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3506443204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3506443204},{"type":"v1","addr":"172.21.15.6:6835","nonce":3506443204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:18:45.349958+0000","modified":"2023-10-06T02:19:57.758003+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5385},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5385":{"gid":5385,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.6:6834/1188971598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1188971598},{"type":"v1","addr":"172.21.15.6:6834","nonce":1188971598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:19:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.921+0000 7fd70f59e700 1 -- 172.21.15.6:0/1689485995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6f0066f30 msgr2=0x7fd6f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.921+0000 7fd70f59e700 1 --2- 172.21.15.6:0/1689485995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6f0066f30 0x7fd6f00693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd7000015b0 tx=0x7fd700001970 comp rx=0 tx=0).stop 2023-10-06T02:19:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.921+0000 7fd70f59e700 1 -- 172.21.15.6:0/1689485995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd710159400 msgr2=0x7fd710146b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.921+0000 7fd70f59e700 1 --2- 172.21.15.6:0/1689485995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd710159400 0x7fd710146b50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd7100b2b80 tx=0x7fd6f8017000 comp rx=0 tx=0).stop 2023-10-06T02:19:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.921+0000 7fd70f59e700 1 -- 172.21.15.6:0/1689485995 shutdown_connections 2023-10-06T02:19:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.921+0000 7fd70f59e700 1 --2- 172.21.15.6:0/1689485995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7101597d0 0x7fd7100cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.921+0000 7fd70f59e700 1 --2- 172.21.15.6:0/1689485995 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7100cf1a0 0x7fd71015e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.921+0000 7fd70f59e700 1 --2- 172.21.15.6:0/1689485995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6f0066f30 0x7fd6f00693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.921+0000 7fd70f59e700 1 --2- 172.21.15.6:0/1689485995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd710159400 0x7fd710146b50 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.921+0000 7fd70f59e700 1 -- 172.21.15.6:0/1689485995 >> 172.21.15.6:0/1689485995 conn(0x7fd71006ac10 msgr2=0x7fd7100b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:57.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.921+0000 7fd70f59e700 1 -- 172.21.15.6:0/1689485995 shutdown_connections 2023-10-06T02:19:57.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:57.921+0000 7fd70f59e700 1 -- 172.21.15.6:0/1689485995 wait complete. 2023-10-06T02:19:57.924 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 25 2023-10-06T02:19:57.934 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:19:58.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.054+0000 7f04e8019700 1 Processor -- start 2023-10-06T02:19:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.054+0000 7f04e8019700 1 -- start start 2023-10-06T02:19:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.055+0000 7f04e8019700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f04e015b3c0 0x7f04e0097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.055+0000 7f04e8019700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e00afb90 con 0x7f04e015a590 2023-10-06T02:19:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.055+0000 7f04e8019700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e00b2310 con 0x7f04e00b3c50 2023-10-06T02:19:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.055+0000 7f04e8019700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e00b25f0 con 0x7f04e015b3c0 2023-10-06T02:19:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.055+0000 7f04e5db5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f04e015b3c0 0x7f04e0097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.055+0000 7f04e5db5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f04e015b3c0 0x7f04e0097d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36596/0 (socket says 172.21.15.6:36596) 2023-10-06T02:19:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.055+0000 7f04e65b6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f04e015a590 0x7f04e015a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47122/0 (socket says 172.21.15.6:47122) 2023-10-06T02:19:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.055+0000 7f04e5db5700 1 -- 172.21.15.6:0/3045292594 learned_addr learned my addr 172.21.15.6:0/3045292594 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.056+0000 7f04e5db5700 1 -- 172.21.15.6:0/3045292594 >> v1:172.21.15.175:6789/0 conn(0x7f04e00b3c50 legacy=0x7f04e015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.056+0000 7f04e5db5700 1 -- 172.21.15.6:0/3045292594 >> v1:172.21.15.6:6789/0 conn(0x7f04e015a590 legacy=0x7f04e015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.056+0000 7f04e5db5700 1 -- 172.21.15.6:0/3045292594 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e00af820 con 0x7f04e015b3c0 2023-10-06T02:19:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.056+0000 7f04e4db3700 1 -- 172.21.15.6:0/3045292594 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600072829 0 0) 0x7f04e00afb90 con 0x7f04e015a590 2023-10-06T02:19:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.056+0000 7f04e5db5700 1 --2- 172.21.15.6:0/3045292594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b3c0 0x7f04e0097d70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f04d8009990 tx=0x7f04d8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72792553152000a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.056+0000 7f04e4db3700 1 -- 172.21.15.6:0/3045292594 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d8005c10 con 0x7f04e015b3c0 2023-10-06T02:19:58.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.056+0000 7f04e4db3700 1 -- 172.21.15.6:0/3045292594 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d8005d70 con 0x7f04e015b3c0 2023-10-06T02:19:58.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.056+0000 7f04e4db3700 1 -- 172.21.15.6:0/3045292594 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d800b860 con 0x7f04e015b3c0 2023-10-06T02:19:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.057+0000 7f04e8019700 1 -- 172.21.15.6:0/3045292594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b3c0 msgr2=0x7f04e0097d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.057+0000 7f04e8019700 1 --2- 172.21.15.6:0/3045292594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b3c0 0x7f04e0097d70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f04d8009990 tx=0x7f04d8009220 comp rx=0 tx=0).stop 2023-10-06T02:19:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.057+0000 7f04e8019700 1 -- 172.21.15.6:0/3045292594 shutdown_connections 2023-10-06T02:19:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.057+0000 7f04e8019700 1 --2- 172.21.15.6:0/3045292594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b3c0 0x7f04e0097d70 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.057+0000 7f04e8019700 1 -- 172.21.15.6:0/3045292594 >> 172.21.15.6:0/3045292594 conn(0x7f04e0067910 msgr2=0x7f04e00ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.057+0000 7f04e8019700 1 -- 172.21.15.6:0/3045292594 shutdown_connections 2023-10-06T02:19:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.057+0000 7f04e8019700 1 -- 172.21.15.6:0/3045292594 wait complete. 2023-10-06T02:19:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.058+0000 7f04e8019700 1 Processor -- start 2023-10-06T02:19:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.058+0000 7f04e8019700 1 -- start start 2023-10-06T02:19:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04e8019700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04e00b3c50 0x7f04e009c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04e8019700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04e015a590 0x7f04e01473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04e8019700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b3c0 0x7f04e009ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04e8019700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e016b1b0 con 0x7f04e015b3c0 2023-10-06T02:19:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04e8019700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e009c7f0 con 0x7f04e00b3c50 2023-10-06T02:19:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04e8019700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e016b390 con 0x7f04e015a590 2023-10-06T02:19:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04e65b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b3c0 0x7f04e009ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04e65b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b3c0 0x7f04e009ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36608/0 (socket says 172.21.15.6:36608) 2023-10-06T02:19:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04e65b6700 1 -- 172.21.15.6:0/1385335747 learned_addr learned my addr 172.21.15.6:0/1385335747 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04e5db5700 1 --2- 172.21.15.6:0/1385335747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04e00b3c50 0x7f04e009c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04e65b6700 1 -- 172.21.15.6:0/1385335747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04e015a590 msgr2=0x7f04e01473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04e65b6700 1 --2- 172.21.15.6:0/1385335747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04e015a590 0x7f04e01473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04e65b6700 1 -- 172.21.15.6:0/1385335747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04e00b3c50 msgr2=0x7f04e009c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04e65b6700 1 --2- 172.21.15.6:0/1385335747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04e00b3c50 0x7f04e009c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04e65b6700 1 -- 172.21.15.6:0/1385335747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d8009480 con 0x7f04e015b3c0 2023-10-06T02:19:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04e65b6700 1 --2- 172.21.15.6:0/1385335747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b3c0 0x7f04e009ae50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f04d000ccc0 tx=0x7f04d0001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04ddffb700 1 -- 172.21.15.6:0/1385335747 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d000ce00 con 0x7f04e015b3c0 2023-10-06T02:19:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04ddffb700 1 -- 172.21.15.6:0/1385335747 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d0005df0 con 0x7f04e015b3c0 2023-10-06T02:19:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04e8019700 1 -- 172.21.15.6:0/1385335747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e016b670 con 0x7f04e015b3c0 2023-10-06T02:19:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.059+0000 7f04ddffb700 1 -- 172.21.15.6:0/1385335747 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d000abb0 con 0x7f04e015b3c0 2023-10-06T02:19:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.060+0000 7f04e8019700 1 -- 172.21.15.6:0/1385335747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e0147910 con 0x7f04e015b3c0 2023-10-06T02:19:58.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.060+0000 7f04e8019700 1 -- 172.21.15.6:0/1385335747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e016bb90 con 0x7f04e015b3c0 2023-10-06T02:19:58.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.061+0000 7f04ddffb700 1 -- 172.21.15.6:0/1385335747 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04d00070f0 con 0x7f04e015b3c0 2023-10-06T02:19:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.061+0000 7f04ddffb700 1 --2- 172.21.15.6:0/1385335747 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f04cc066f30 0x7f04cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.061+0000 7f04ddffb700 1 -- 172.21.15.6:0/1385335747 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f04d00849a0 con 0x7f04e015b3c0 2023-10-06T02:19:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.061+0000 7f04e5db5700 1 --2- 172.21.15.6:0/1385335747 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f04cc066f30 0x7f04cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.062+0000 7f04e5db5700 1 --2- 172.21.15.6:0/1385335747 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f04cc066f30 0x7f04cc0693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f04d8007fd0 tx=0x7f04d8015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:58.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.066+0000 7f04ddffb700 1 -- 172.21.15.6:0/1385335747 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04e016bb90 con 0x7f04e015b3c0 2023-10-06T02:19:58.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.302+0000 7f04e8019700 1 -- 172.21.15.6:0/1385335747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04e016bb90 con 0x7f04e015b3c0 2023-10-06T02:19:58.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.302+0000 7f04ddffb700 1 -- 172.21.15.6:0/1385335747 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f04e016bb90 con 0x7f04e015b3c0 2023-10-06T02:19:58.303 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:19:58.304 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1173605075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1173605075},{"type":"v1","addr":"172.21.15.175:6837","nonce":1173605075}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/375122461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":375122461},{"type":"v1","addr":"172.21.15.175:6835","nonce":375122461}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5142,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3506443204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3506443204},{"type":"v1","addr":"172.21.15.6:6835","nonce":3506443204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:18:45.349958+0000","modified":"2023-10-06T02:19:57.758003+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5385},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5385":{"gid":5385,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.6:6834/1188971598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1188971598},{"type":"v1","addr":"172.21.15.6:6834","nonce":1188971598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:19:58.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.304+0000 7f04e8019700 1 -- 172.21.15.6:0/1385335747 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f04cc066f30 msgr2=0x7f04cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:58.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.304+0000 7f04e8019700 1 --2- 172.21.15.6:0/1385335747 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f04cc066f30 0x7f04cc0693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f04d8007fd0 tx=0x7f04d8015000 comp rx=0 tx=0).stop 2023-10-06T02:19:58.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.304+0000 7f04e8019700 1 -- 172.21.15.6:0/1385335747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b3c0 msgr2=0x7f04e009ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:58.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.304+0000 7f04e8019700 1 --2- 172.21.15.6:0/1385335747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b3c0 0x7f04e009ae50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f04d000ccc0 tx=0x7f04d0001a70 comp rx=0 tx=0).stop 2023-10-06T02:19:58.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.304+0000 7f04e8019700 1 -- 172.21.15.6:0/1385335747 shutdown_connections 2023-10-06T02:19:58.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.304+0000 7f04e8019700 1 --2- 172.21.15.6:0/1385335747 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f04cc066f30 0x7f04cc0693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.304+0000 7f04e8019700 1 --2- 172.21.15.6:0/1385335747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b3c0 0x7f04e009ae50 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.304+0000 7f04e8019700 1 --2- 172.21.15.6:0/1385335747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04e00b3c50 0x7f04e009c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.304+0000 7f04e8019700 1 --2- 172.21.15.6:0/1385335747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04e015a590 0x7f04e01473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.304+0000 7f04e8019700 1 -- 172.21.15.6:0/1385335747 >> 172.21.15.6:0/1385335747 conn(0x7f04e0067910 msgr2=0x7f04e0155e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:58.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.304+0000 7f04e8019700 1 -- 172.21.15.6:0/1385335747 shutdown_connections 2023-10-06T02:19:58.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.304+0000 7f04e8019700 1 -- 172.21.15.6:0/1385335747 wait complete. 2023-10-06T02:19:58.307 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 25 2023-10-06T02:19:58.317 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:19:58.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.435+0000 7fdc065aa700 1 Processor -- start 2023-10-06T02:19:58.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.435+0000 7fdc065aa700 1 -- start start 2023-10-06T02:19:58.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.436+0000 7fdc065aa700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc00159400 0x7fdc000ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:58.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.436+0000 7fdc065aa700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc000cd030 0x7fdc000cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:58.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.436+0000 7fdc065aa700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc000b3560 con 0x7fdc000cf1a0 2023-10-06T02:19:58.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.436+0000 7fdc065aa700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc000cf6f0 con 0x7fdc000cd030 2023-10-06T02:19:58.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.436+0000 7fdc065aa700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc000cf9d0 con 0x7fdc00159400 2023-10-06T02:19:58.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.436+0000 7fdc04da7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc000cd030 0x7fdc000cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:58.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.436+0000 7fdc04da7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc000cd030 0x7fdc000cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36622/0 (socket says 172.21.15.6:36622) 2023-10-06T02:19:58.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.436+0000 7fdc04da7700 1 -- 172.21.15.6:0/3570855363 learned_addr learned my addr 172.21.15.6:0/3570855363 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:58.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.436+0000 7fdc055a8700 1 --2- 172.21.15.6:0/3570855363 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc00159400 0x7fdc000ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:58.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.437+0000 7fdc04da7700 1 -- 172.21.15.6:0/3570855363 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc00159400 msgr2=0x7fdc000ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:58.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.437+0000 7fdc04da7700 1 --2- 172.21.15.6:0/3570855363 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc00159400 0x7fdc000ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.437+0000 7fdc04da7700 1 -- 172.21.15.6:0/3570855363 >> v1:172.21.15.175:6789/0 conn(0x7fdc000cf1a0 legacy=0x7fdc000b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:58.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.437+0000 7fdc04da7700 1 -- 172.21.15.6:0/3570855363 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc000b2f10 con 0x7fdc000cd030 2023-10-06T02:19:58.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.437+0000 7fdc04da7700 1 --2- 172.21.15.6:0/3570855363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc000cd030 0x7fdc000cfec0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40099b0 tx=0x7fdbf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa42f16c18e821b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:58.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.437+0000 7fdbfffff700 1 -- 172.21.15.6:0/3570855363 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf400b820 con 0x7fdc000cd030 2023-10-06T02:19:58.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.437+0000 7fdbfffff700 1 -- 172.21.15.6:0/3570855363 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf400b980 con 0x7fdc000cd030 2023-10-06T02:19:58.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.437+0000 7fdbfffff700 1 -- 172.21.15.6:0/3570855363 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf400bd20 con 0x7fdc000cd030 2023-10-06T02:19:58.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.437+0000 7fdc065aa700 1 -- 172.21.15.6:0/3570855363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc000cd030 msgr2=0x7fdc000cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:58.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.437+0000 7fdc065aa700 1 --2- 172.21.15.6:0/3570855363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc000cd030 0x7fdc000cfec0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40099b0 tx=0x7fdbf4009250 comp rx=0 tx=0).stop 2023-10-06T02:19:58.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.437+0000 7fdc065aa700 1 -- 172.21.15.6:0/3570855363 shutdown_connections 2023-10-06T02:19:58.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.437+0000 7fdc065aa700 1 --2- 172.21.15.6:0/3570855363 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc00159400 0x7fdc000ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.437+0000 7fdc065aa700 1 --2- 172.21.15.6:0/3570855363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc000cd030 0x7fdc000cfec0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.437+0000 7fdc065aa700 1 -- 172.21.15.6:0/3570855363 >> 172.21.15.6:0/3570855363 conn(0x7fdc0006ac10 msgr2=0x7fdc00068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:58.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.438+0000 7fdc065aa700 1 -- 172.21.15.6:0/3570855363 shutdown_connections 2023-10-06T02:19:58.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.438+0000 7fdc065aa700 1 -- 172.21.15.6:0/3570855363 wait complete. 2023-10-06T02:19:58.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.439+0000 7fdc065aa700 1 Processor -- start 2023-10-06T02:19:58.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.439+0000 7fdc065aa700 1 -- start start 2023-10-06T02:19:58.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.439+0000 7fdc065aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc000cd030 0x7fdc001548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:58.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc065aa700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc000cf1a0 0x7fdc000cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:58.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc065aa700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc00159400 0x7fdc00154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:58.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc065aa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc000cbd90 con 0x7fdc000cd030 2023-10-06T02:19:58.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc065aa700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc000cb3c0 con 0x7fdc000cf1a0 2023-10-06T02:19:58.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc065aa700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc001546c0 con 0x7fdc00159400 2023-10-06T02:19:58.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc055a8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc000cd030 0x7fdc001548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:58.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc055a8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc000cd030 0x7fdc001548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36636/0 (socket says 172.21.15.6:36636) 2023-10-06T02:19:58.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc055a8700 1 -- 172.21.15.6:0/9048361 learned_addr learned my addr 172.21.15.6:0/9048361 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:58.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc04da7700 1 --2- 172.21.15.6:0/9048361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc000cf1a0 0x7fdc000cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:58.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc05da9700 1 --2- 172.21.15.6:0/9048361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc00159400 0x7fdc00154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:58.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc055a8700 1 -- 172.21.15.6:0/9048361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc00159400 msgr2=0x7fdc00154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:58.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc055a8700 1 --2- 172.21.15.6:0/9048361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc00159400 0x7fdc00154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc055a8700 1 -- 172.21.15.6:0/9048361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc000cf1a0 msgr2=0x7fdc000cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:58.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc055a8700 1 --2- 172.21.15.6:0/9048361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc000cf1a0 0x7fdc000cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc055a8700 1 -- 172.21.15.6:0/9048361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf40094f0 con 0x7fdc000cd030 2023-10-06T02:19:58.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc055a8700 1 --2- 172.21.15.6:0/9048361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc000cd030 0x7fdc001548b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800d870 tx=0x7fdbf8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:58.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdbfd7fa700 1 -- 172.21.15.6:0/9048361 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8009630 con 0x7fdc000cd030 2023-10-06T02:19:58.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdbfd7fa700 1 -- 172.21.15.6:0/9048361 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf8009790 con 0x7fdc000cd030 2023-10-06T02:19:58.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc065aa700 1 -- 172.21.15.6:0/9048361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc000ca7b0 con 0x7fdc000cd030 2023-10-06T02:19:58.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdbfd7fa700 1 -- 172.21.15.6:0/9048361 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8009b50 con 0x7fdc000cd030 2023-10-06T02:19:58.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.440+0000 7fdc065aa700 1 -- 172.21.15.6:0/9048361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc000cad70 con 0x7fdc000cd030 2023-10-06T02:19:58.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.441+0000 7fdc065aa700 1 -- 172.21.15.6:0/9048361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc000cb6a0 con 0x7fdc000cd030 2023-10-06T02:19:58.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.442+0000 7fdbfd7fa700 1 -- 172.21.15.6:0/9048361 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdbf8014410 con 0x7fdc000cd030 2023-10-06T02:19:58.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.442+0000 7fdbfd7fa700 1 --2- 172.21.15.6:0/9048361 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdbec066f30 0x7fdbec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:58.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.442+0000 7fdbfd7fa700 1 -- 172.21.15.6:0/9048361 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fdbf8085120 con 0x7fdc000cd030 2023-10-06T02:19:58.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.442+0000 7fdc04da7700 1 --2- 172.21.15.6:0/9048361 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdbec066f30 0x7fdbec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:58.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.443+0000 7fdc04da7700 1 --2- 172.21.15.6:0/9048361 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdbec066f30 0x7fdbec0693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40099b0 tx=0x7fdbf4016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:58.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.447+0000 7fdbfd7fa700 1 -- 172.21.15.6:0/9048361 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbf8052060 con 0x7fdc000cd030 2023-10-06T02:19:58.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.643+0000 7fdc065aa700 1 -- 172.21.15.6:0/9048361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc000b3250 con 0x7fdc000cd030 2023-10-06T02:19:58.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.644+0000 7fdbfd7fa700 1 -- 172.21.15.6:0/9048361 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17244 (secure 0 0 0) 0x7fdbf8055680 con 0x7fdc000cd030 2023-10-06T02:19:58.645 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:19:58.645 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":42,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:19:31.977136+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:18:43.639616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T02:18:44.317938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.16","mappings":[{"from":0,"to":5}]},{"pgid":"7.35","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6834/774858203":"2023-10-07T02:19:05.864154+0000","172.21.15.6:6832/774858203":"2023-10-07T02:19:05.864154+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:19:58.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.646+0000 7fdc065aa700 1 -- 172.21.15.6:0/9048361 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdbec066f30 msgr2=0x7fdbec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:58.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.646+0000 7fdc065aa700 1 --2- 172.21.15.6:0/9048361 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdbec066f30 0x7fdbec0693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40099b0 tx=0x7fdbf4016000 comp rx=0 tx=0).stop 2023-10-06T02:19:58.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.646+0000 7fdc065aa700 1 -- 172.21.15.6:0/9048361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc000cd030 msgr2=0x7fdc001548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:58.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.646+0000 7fdc065aa700 1 --2- 172.21.15.6:0/9048361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc000cd030 0x7fdc001548b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800d870 tx=0x7fdbf8008040 comp rx=0 tx=0).stop 2023-10-06T02:19:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.646+0000 7fdc065aa700 1 -- 172.21.15.6:0/9048361 shutdown_connections 2023-10-06T02:19:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.646+0000 7fdc065aa700 1 --2- 172.21.15.6:0/9048361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc00159400 0x7fdc00154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.646+0000 7fdc065aa700 1 --2- 172.21.15.6:0/9048361 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdbec066f30 0x7fdbec0693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.646+0000 7fdc065aa700 1 --2- 172.21.15.6:0/9048361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc000cd030 0x7fdc001548b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.646+0000 7fdc065aa700 1 --2- 172.21.15.6:0/9048361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc000cf1a0 0x7fdc000cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.646+0000 7fdc065aa700 1 -- 172.21.15.6:0/9048361 >> 172.21.15.6:0/9048361 conn(0x7fdc0006ac10 msgr2=0x7fdc000cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.646+0000 7fdc065aa700 1 -- 172.21.15.6:0/9048361 shutdown_connections 2023-10-06T02:19:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.646+0000 7fdc065aa700 1 -- 172.21.15.6:0/9048361 wait complete. 2023-10-06T02:19:58.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:19:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.780+0000 7fa240534700 1 Processor -- start 2023-10-06T02:19:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.780+0000 7fa240534700 1 -- start start 2023-10-06T02:19:58.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.781+0000 7fa240534700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2380c7840 0x7fa238159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:58.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.781+0000 7fa240534700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa23806c830 0x7fa23815da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:58.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.781+0000 7fa240534700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2380c7cb0 con 0x7fa23806c460 2023-10-06T02:19:58.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.781+0000 7fa240534700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23815dfc0 con 0x7fa2380c7840 2023-10-06T02:19:58.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.781+0000 7fa240534700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2380c7f90 con 0x7fa23806c830 2023-10-06T02:19:58.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.781+0000 7fa23dacf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2380c7840 0x7fa238159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:58.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.781+0000 7fa23e2d0700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa23806c460 0x7fa238158f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50826/0 (socket says 172.21.15.6:50826) 2023-10-06T02:19:58.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.781+0000 7fa23e2d0700 1 -- 172.21.15.6:0/17996781 learned_addr learned my addr 172.21.15.6:0/17996781 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:19:58.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.781+0000 7fa23ead1700 1 --2- 172.21.15.6:0/17996781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa23806c830 0x7fa23815da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.781+0000 7fa23dacf700 1 -- 172.21.15.6:0/17996781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa23806c830 msgr2=0x7fa23815da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:19:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.781+0000 7fa23dacf700 1 --2- 172.21.15.6:0/17996781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa23806c830 0x7fa23815da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.781+0000 7fa23dacf700 1 -- 172.21.15.6:0/17996781 >> v1:172.21.15.6:6789/0 conn(0x7fa23806c460 legacy=0x7fa238158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.781+0000 7fa23d2ce700 1 -- 172.21.15.6:0/17996781 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274326910 0 0) 0x7fa2380c7cb0 con 0x7fa23806c460 2023-10-06T02:19:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.781+0000 7fa23dacf700 1 -- 172.21.15.6:0/17996781 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2380c8270 con 0x7fa2380c7840 2023-10-06T02:19:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.781+0000 7fa23dacf700 1 --2- 172.21.15.6:0/17996781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2380c7840 0x7fa238159670 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa228009910 tx=0x7fa2280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801f1aa9f3a4c075 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.781+0000 7fa23d2ce700 1 -- 172.21.15.6:0/17996781 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22800b820 con 0x7fa2380c7840 2023-10-06T02:19:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.782+0000 7fa23d2ce700 1 -- 172.21.15.6:0/17996781 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22800b980 con 0x7fa2380c7840 2023-10-06T02:19:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.782+0000 7fa23d2ce700 1 -- 172.21.15.6:0/17996781 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22800bd20 con 0x7fa2380c7840 2023-10-06T02:19:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.782+0000 7fa240534700 1 -- 172.21.15.6:0/17996781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2380c7840 msgr2=0x7fa238159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.782+0000 7fa240534700 1 --2- 172.21.15.6:0/17996781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2380c7840 0x7fa238159670 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa228009910 tx=0x7fa2280091a0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.782+0000 7fa240534700 1 -- 172.21.15.6:0/17996781 shutdown_connections 2023-10-06T02:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.782+0000 7fa240534700 1 --2- 172.21.15.6:0/17996781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa23806c830 0x7fa23815da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.782+0000 7fa240534700 1 --2- 172.21.15.6:0/17996781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2380c7840 0x7fa238159670 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.782+0000 7fa240534700 1 -- 172.21.15.6:0/17996781 >> 172.21.15.6:0/17996781 conn(0x7fa2380c9cc0 msgr2=0x7fa23806acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.782+0000 7fa240534700 1 -- 172.21.15.6:0/17996781 shutdown_connections 2023-10-06T02:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.782+0000 7fa240534700 1 -- 172.21.15.6:0/17996781 wait complete. 2023-10-06T02:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.783+0000 7fa240534700 1 Processor -- start 2023-10-06T02:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.783+0000 7fa240534700 1 -- start start 2023-10-06T02:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.784+0000 7fa240534700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa23806c460 0x7fa23815c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.784+0000 7fa240534700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa23806c830 0x7fa23814a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.784+0000 7fa240534700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2380c7840 0x7fa2380c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.784+0000 7fa240534700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23814a830 con 0x7fa2380c7840 2023-10-06T02:19:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.784+0000 7fa240534700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2380c5a10 con 0x7fa23806c830 2023-10-06T02:19:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.784+0000 7fa240534700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2380c5c40 con 0x7fa23806c460 2023-10-06T02:19:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.784+0000 7fa23ead1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2380c7840 0x7fa2380c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.784+0000 7fa23ead1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2380c7840 0x7fa2380c54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34418/0 (socket says 172.21.15.6:34418) 2023-10-06T02:19:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.784+0000 7fa23ead1700 1 -- 172.21.15.6:0/4187432552 learned_addr learned my addr 172.21.15.6:0/4187432552 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.784+0000 7fa23e2d0700 1 --2- 172.21.15.6:0/4187432552 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa23806c460 0x7fa23815c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.784+0000 7fa23ead1700 1 -- 172.21.15.6:0/4187432552 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa23806c460 msgr2=0x7fa23815c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.784+0000 7fa23ead1700 1 --2- 172.21.15.6:0/4187432552 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa23806c460 0x7fa23815c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.784+0000 7fa23dacf700 1 --2- 172.21.15.6:0/4187432552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa23806c830 0x7fa23814a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.784+0000 7fa23ead1700 1 -- 172.21.15.6:0/4187432552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa23806c830 msgr2=0x7fa23814a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.784+0000 7fa23ead1700 1 --2- 172.21.15.6:0/4187432552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa23806c830 0x7fa23814a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.785+0000 7fa23ead1700 1 -- 172.21.15.6:0/4187432552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa228009420 con 0x7fa2380c7840 2023-10-06T02:19:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.785+0000 7fa23ead1700 1 --2- 172.21.15.6:0/4187432552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2380c7840 0x7fa2380c54d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa230009fd0 tx=0x7fa230009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.785+0000 7fa22e7fc700 1 -- 172.21.15.6:0/4187432552 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23000ed50 con 0x7fa2380c7840 2023-10-06T02:19:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.785+0000 7fa22e7fc700 1 -- 172.21.15.6:0/4187432552 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23000eeb0 con 0x7fa2380c7840 2023-10-06T02:19:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.785+0000 7fa240534700 1 -- 172.21.15.6:0/4187432552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2380c38d0 con 0x7fa2380c7840 2023-10-06T02:19:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.785+0000 7fa22e7fc700 1 -- 172.21.15.6:0/4187432552 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa230014650 con 0x7fa2380c7840 2023-10-06T02:19:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.785+0000 7fa240534700 1 -- 172.21.15.6:0/4187432552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2380c3e90 con 0x7fa2380c7840 2023-10-06T02:19:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.786+0000 7fa240534700 1 -- 172.21.15.6:0/4187432552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2380c4080 con 0x7fa2380c7840 2023-10-06T02:19:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.786+0000 7fa22e7fc700 1 -- 172.21.15.6:0/4187432552 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2300149c0 con 0x7fa2380c7840 2023-10-06T02:19:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.787+0000 7fa22e7fc700 1 --2- 172.21.15.6:0/4187432552 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa21c066f30 0x7fa21c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.787+0000 7fa22e7fc700 1 -- 172.21.15.6:0/4187432552 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fa230085050 con 0x7fa2380c7840 2023-10-06T02:19:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.787+0000 7fa23e2d0700 1 --2- 172.21.15.6:0/4187432552 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa21c066f30 0x7fa21c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.787+0000 7fa23e2d0700 1 --2- 172.21.15.6:0/4187432552 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa21c066f30 0x7fa21c0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa2380c68b0 tx=0x7fa234009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:58.791+0000 7fa22e7fc700 1 -- 172.21.15.6:0/4187432552 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa230051f90 con 0x7fa2380c7840 2023-10-06T02:19:59.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.030+0000 7fa240534700 1 -- 172.21.15.6:0/4187432552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa2380c8550 con 0x7fa2380c7840 2023-10-06T02:19:59.032 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:19:59.031+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:19:59.039 INFO:tasks.ceph.mds.c.smithi006.stderr: -3244> 2023-10-06T02:19:12.874+0000 7fa7e07da700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:19:59.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.039+0000 7fa22e7fc700 1 -- 172.21.15.6:0/4187432552 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa2300555b0 con 0x7fa2380c7840 2023-10-06T02:19:59.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.041+0000 7fa240534700 1 -- 172.21.15.6:0/4187432552 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa21c066f30 msgr2=0x7fa21c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.041+0000 7fa240534700 1 --2- 172.21.15.6:0/4187432552 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa21c066f30 0x7fa21c0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa2380c68b0 tx=0x7fa234009040 comp rx=0 tx=0).stop 2023-10-06T02:19:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.041+0000 7fa240534700 1 -- 172.21.15.6:0/4187432552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2380c7840 msgr2=0x7fa2380c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.041+0000 7fa240534700 1 --2- 172.21.15.6:0/4187432552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2380c7840 0x7fa2380c54d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa230009fd0 tx=0x7fa230009900 comp rx=0 tx=0).stop 2023-10-06T02:19:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.041+0000 7fa240534700 1 -- 172.21.15.6:0/4187432552 shutdown_connections 2023-10-06T02:19:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.041+0000 7fa240534700 1 --2- 172.21.15.6:0/4187432552 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa21c066f30 0x7fa21c0693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.041+0000 7fa240534700 1 --2- 172.21.15.6:0/4187432552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2380c7840 0x7fa2380c54d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.041+0000 7fa240534700 1 --2- 172.21.15.6:0/4187432552 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa23806c460 0x7fa23815c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.041+0000 7fa240534700 1 --2- 172.21.15.6:0/4187432552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa23806c830 0x7fa23814a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.041+0000 7fa240534700 1 -- 172.21.15.6:0/4187432552 >> 172.21.15.6:0/4187432552 conn(0x7fa2380c9cc0 msgr2=0x7fa238155ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.041+0000 7fa240534700 1 -- 172.21.15.6:0/4187432552 shutdown_connections 2023-10-06T02:19:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.041+0000 7fa240534700 1 -- 172.21.15.6:0/4187432552 wait complete. 2023-10-06T02:19:59.044 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:19:59.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:19:59.065 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-06T02:19:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.175+0000 7fc68ff9e700 1 Processor -- start 2023-10-06T02:19:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.175+0000 7fc68ff9e700 1 -- start start 2023-10-06T02:19:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.176+0000 7fc68ff9e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc6880af7c0 0x7fc68815d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.176+0000 7fc68ff9e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68815a170 con 0x7fc688159960 2023-10-06T02:19:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.176+0000 7fc68ff9e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6880caeb0 con 0x7fc6880af3f0 2023-10-06T02:19:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.176+0000 7fc68ff9e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68815db80 con 0x7fc6880af7c0 2023-10-06T02:19:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.176+0000 7fc68e53b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc688159960 0x7fc688068680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50836/0 (socket says 172.21.15.6:50836) 2023-10-06T02:19:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.176+0000 7fc68e53b700 1 -- 172.21.15.6:0/3113240652 learned_addr learned my addr 172.21.15.6:0/3113240652 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:19:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.176+0000 7fc68d539700 1 --2- 172.21.15.6:0/3113240652 >> v2:172.21.15.175:3300/0 conn(0x7fc6880af7c0 0x7fc68815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.177+0000 7fc68cd38700 1 -- 172.21.15.6:0/3113240652 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974130248 0 0) 0x7fc68815a170 con 0x7fc688159960 2023-10-06T02:19:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.177+0000 7fc68cd38700 1 -- 172.21.15.6:0/3113240652 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc670003570 con 0x7fc688159960 2023-10-06T02:19:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.177+0000 7fc68d539700 1 -- 172.21.15.6:0/3113240652 >> v1:172.21.15.175:6789/0 conn(0x7fc6880af3f0 legacy=0x7fc68815a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.177+0000 7fc68d539700 1 -- 172.21.15.6:0/3113240652 >> v1:172.21.15.6:6789/0 conn(0x7fc688159960 legacy=0x7fc688068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.177+0000 7fc68d539700 1 -- 172.21.15.6:0/3113240652 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68815de60 con 0x7fc6880af7c0 2023-10-06T02:19:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.177+0000 7fc68d539700 1 --2- 172.21.15.6:0/3113240652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6880af7c0 0x7fc68815d030 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0098e0 tx=0x7fc67c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeb8ce4912fec31b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.177+0000 7fc68cd38700 1 -- 172.21.15.6:0/3113240652 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c00b640 con 0x7fc6880af7c0 2023-10-06T02:19:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.177+0000 7fc68cd38700 1 -- 172.21.15.6:0/3113240652 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c00b7a0 con 0x7fc6880af7c0 2023-10-06T02:19:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.177+0000 7fc68cd38700 1 -- 172.21.15.6:0/3113240652 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c00bb40 con 0x7fc6880af7c0 2023-10-06T02:19:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.178+0000 7fc68ff9e700 1 -- 172.21.15.6:0/3113240652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6880af7c0 msgr2=0x7fc68815d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.178+0000 7fc68ff9e700 1 --2- 172.21.15.6:0/3113240652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6880af7c0 0x7fc68815d030 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0098e0 tx=0x7fc67c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:19:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.178+0000 7fc68ff9e700 1 -- 172.21.15.6:0/3113240652 shutdown_connections 2023-10-06T02:19:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.178+0000 7fc68ff9e700 1 --2- 172.21.15.6:0/3113240652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6880af7c0 0x7fc68815d030 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.178+0000 7fc68ff9e700 1 -- 172.21.15.6:0/3113240652 >> 172.21.15.6:0/3113240652 conn(0x7fc68806a260 msgr2=0x7fc6880cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:19:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.178+0000 7fc68ff9e700 1 -- 172.21.15.6:0/3113240652 shutdown_connections 2023-10-06T02:19:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.178+0000 7fc68ff9e700 1 -- 172.21.15.6:0/3113240652 wait complete. 2023-10-06T02:19:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.179+0000 7fc68ff9e700 1 Processor -- start 2023-10-06T02:19:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.179+0000 7fc68ff9e700 1 -- start start 2023-10-06T02:19:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68ff9e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6880af3f0 0x7fc68813ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68ff9e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc688159960 0x7fc6880c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68ff9e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6880c6290 0x7fc6880c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68ff9e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880c6710 con 0x7fc6880af3f0 2023-10-06T02:19:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68ff9e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880b0150 con 0x7fc688159960 2023-10-06T02:19:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68ff9e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880b0430 con 0x7fc6880c6290 2023-10-06T02:19:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68dd3a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6880af3f0 0x7fc68813ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68dd3a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6880af3f0 0x7fc68813ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34446/0 (socket says 172.21.15.6:34446) 2023-10-06T02:19:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68dd3a700 1 -- 172.21.15.6:0/651036723 learned_addr learned my addr 172.21.15.6:0/651036723 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:19:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68d539700 1 --2- 172.21.15.6:0/651036723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc688159960 0x7fc6880c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68e53b700 1 --2- 172.21.15.6:0/651036723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6880c6290 0x7fc6880c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68dd3a700 1 -- 172.21.15.6:0/651036723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6880c6290 msgr2=0x7fc6880c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68dd3a700 1 --2- 172.21.15.6:0/651036723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6880c6290 0x7fc6880c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68dd3a700 1 -- 172.21.15.6:0/651036723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc688159960 msgr2=0x7fc6880c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:19:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68dd3a700 1 --2- 172.21.15.6:0/651036723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc688159960 0x7fc6880c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:19:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68dd3a700 1 -- 172.21.15.6:0/651036723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c009420 con 0x7fc6880af3f0 2023-10-06T02:19:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68dd3a700 1 --2- 172.21.15.6:0/651036723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6880af3f0 0x7fc68813ca50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc68000cb40 tx=0x7fc6800017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc685ffb700 1 -- 172.21.15.6:0/651036723 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68000a7a0 con 0x7fc6880af3f0 2023-10-06T02:19:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc685ffb700 1 -- 172.21.15.6:0/651036723 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68000a920 con 0x7fc6880af3f0 2023-10-06T02:19:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.180+0000 7fc68ff9e700 1 -- 172.21.15.6:0/651036723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68813cf90 con 0x7fc6880af3f0 2023-10-06T02:19:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.181+0000 7fc685ffb700 1 -- 172.21.15.6:0/651036723 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68000ace0 con 0x7fc6880af3f0 2023-10-06T02:19:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.181+0000 7fc68ff9e700 1 -- 172.21.15.6:0/651036723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6880c6bf0 con 0x7fc6880af3f0 2023-10-06T02:19:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.182+0000 7fc68ff9e700 1 -- 172.21.15.6:0/651036723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68806e700 con 0x7fc6880af3f0 2023-10-06T02:19:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.182+0000 7fc685ffb700 1 -- 172.21.15.6:0/651036723 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc680003030 con 0x7fc6880af3f0 2023-10-06T02:19:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.182+0000 7fc685ffb700 1 --2- 172.21.15.6:0/651036723 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc674066f30 0x7fc6740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:19:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.182+0000 7fc685ffb700 1 -- 172.21.15.6:0/651036723 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fc680084880 con 0x7fc6880af3f0 2023-10-06T02:19:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.183+0000 7fc68d539700 1 --2- 172.21.15.6:0/651036723 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc674066f30 0x7fc6740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:19:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.183+0000 7fc68d539700 1 --2- 172.21.15.6:0/651036723 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc674066f30 0x7fc6740693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0098e0 tx=0x7fc67c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:19:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.187+0000 7fc685ffb700 1 -- 172.21.15.6:0/651036723 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc680051770 con 0x7fc6880af3f0 2023-10-06T02:19:59.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:19:59.425+0000 7fc68ff9e700 1 -- 172.21.15.6:0/651036723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc688068420 con 0x7fc6880af3f0 2023-10-06T02:20:00.000 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:19:59.999+0000 7fc34f931700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2023-10-06T02:20:00.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.037+0000 7fc685ffb700 1 -- 172.21.15.6:0/651036723 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc680054d90 con 0x7fc6880af3f0 2023-10-06T02:20:00.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.039+0000 7fc68ff9e700 1 -- 172.21.15.6:0/651036723 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc674066f30 msgr2=0x7fc6740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:00.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.039+0000 7fc68ff9e700 1 --2- 172.21.15.6:0/651036723 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc674066f30 0x7fc6740693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0098e0 tx=0x7fc67c017000 comp rx=0 tx=0).stop 2023-10-06T02:20:00.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.039+0000 7fc68ff9e700 1 -- 172.21.15.6:0/651036723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6880af3f0 msgr2=0x7fc68813ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:00.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.039+0000 7fc68ff9e700 1 --2- 172.21.15.6:0/651036723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6880af3f0 0x7fc68813ca50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc68000cb40 tx=0x7fc6800017b0 comp rx=0 tx=0).stop 2023-10-06T02:20:00.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.039+0000 7fc68ff9e700 1 -- 172.21.15.6:0/651036723 shutdown_connections 2023-10-06T02:20:00.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.039+0000 7fc68ff9e700 1 --2- 172.21.15.6:0/651036723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6880c6290 0x7fc6880c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:00.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.039+0000 7fc68ff9e700 1 --2- 172.21.15.6:0/651036723 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc674066f30 0x7fc6740693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:00.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.039+0000 7fc68ff9e700 1 --2- 172.21.15.6:0/651036723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6880af3f0 0x7fc68813ca50 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:00.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.040+0000 7fc68ff9e700 1 --2- 172.21.15.6:0/651036723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc688159960 0x7fc6880c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:00.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.040+0000 7fc68ff9e700 1 -- 172.21.15.6:0/651036723 >> 172.21.15.6:0/651036723 conn(0x7fc68806a260 msgr2=0x7fc688157d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:00.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.040+0000 7fc68ff9e700 1 -- 172.21.15.6:0/651036723 shutdown_connections 2023-10-06T02:20:00.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.040+0000 7fc68ff9e700 1 -- 172.21.15.6:0/651036723 wait complete. 2023-10-06T02:20:00.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:20:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.223+0000 7f47c604d700 1 Processor -- start 2023-10-06T02:20:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.223+0000 7f47c604d700 1 -- start start 2023-10-06T02:20:00.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.224+0000 7f47c604d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f47c0155f80 0x7f47c00b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:00.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.224+0000 7f47c604d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47c0156350 0x7f47c00aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:00.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.224+0000 7f47c604d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c00af770 con 0x7f47c00af1f0 2023-10-06T02:20:00.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.224+0000 7f47c604d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c00afa50 con 0x7f47c0156350 2023-10-06T02:20:00.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.224+0000 7f47c604d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c00afd30 con 0x7f47c0155f80 2023-10-06T02:20:00.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.224+0000 7f47beffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47c0156350 0x7f47c00aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:00.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.224+0000 7f47bffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f47c00af1f0 0x7f47c00b0fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50852/0 (socket says 172.21.15.6:50852) 2023-10-06T02:20:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.224+0000 7f47beffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47c0156350 0x7f47c00aecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34450/0 (socket says 172.21.15.6:34450) 2023-10-06T02:20:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.224+0000 7f47bffff700 1 -- 172.21.15.6:0/1108118645 learned_addr learned my addr 172.21.15.6:0/1108118645 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.225+0000 7f47bf7fe700 1 --2- 172.21.15.6:0/1108118645 >> v2:172.21.15.175:3300/0 conn(0x7f47c0155f80 0x7f47c00b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.225+0000 7f47beffd700 1 -- 172.21.15.6:0/1108118645 >> v2:172.21.15.175:3300/0 conn(0x7f47c0155f80 msgr2=0x7f47c00b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.225+0000 7f47beffd700 1 --2- 172.21.15.6:0/1108118645 >> v2:172.21.15.175:3300/0 conn(0x7f47c0155f80 0x7f47c00b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.225+0000 7f47beffd700 1 -- 172.21.15.6:0/1108118645 >> v1:172.21.15.6:6789/0 conn(0x7f47c00af1f0 legacy=0x7f47c00b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.225+0000 7f47beffd700 1 -- 172.21.15.6:0/1108118645 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c00b0010 con 0x7f47c0156350 2023-10-06T02:20:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.225+0000 7f47be7fc700 1 -- 172.21.15.6:0/1108118645 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2146660097 0 0) 0x7f47c00af770 con 0x7f47c00af1f0 2023-10-06T02:20:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.225+0000 7f47beffd700 1 --2- 172.21.15.6:0/1108118645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c0156350 0x7f47c00aecb0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f47c0064f30 tx=0x7f47b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32260a757659dd34 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.225+0000 7f47be7fc700 1 -- 172.21.15.6:0/1108118645 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b400b6b0 con 0x7f47c0156350 2023-10-06T02:20:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.225+0000 7f47be7fc700 1 -- 172.21.15.6:0/1108118645 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b400b810 con 0x7f47c0156350 2023-10-06T02:20:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.225+0000 7f47be7fc700 1 -- 172.21.15.6:0/1108118645 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b400bbb0 con 0x7f47c0156350 2023-10-06T02:20:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.226+0000 7f47c604d700 1 -- 172.21.15.6:0/1108118645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c0156350 msgr2=0x7f47c00aecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.226+0000 7f47c604d700 1 --2- 172.21.15.6:0/1108118645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c0156350 0x7f47c00aecb0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f47c0064f30 tx=0x7f47b40091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.226+0000 7f47c604d700 1 -- 172.21.15.6:0/1108118645 shutdown_connections 2023-10-06T02:20:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.226+0000 7f47c604d700 1 --2- 172.21.15.6:0/1108118645 >> v2:172.21.15.175:3300/0 conn(0x7f47c0155f80 0x7f47c00b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.226+0000 7f47c604d700 1 --2- 172.21.15.6:0/1108118645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c0156350 0x7f47c00aecb0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.226+0000 7f47c604d700 1 -- 172.21.15.6:0/1108118645 >> 172.21.15.6:0/1108118645 conn(0x7f47c00cbef0 msgr2=0x7f47c00cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.226+0000 7f47c604d700 1 -- 172.21.15.6:0/1108118645 shutdown_connections 2023-10-06T02:20:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.226+0000 7f47c604d700 1 -- 172.21.15.6:0/1108118645 wait complete. 2023-10-06T02:20:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.227+0000 7f47c604d700 1 Processor -- start 2023-10-06T02:20:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.227+0000 7f47c604d700 1 -- start start 2023-10-06T02:20:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47c604d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47c00af1f0 0x7f47c01688c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47c604d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47c0155f80 0x7f47c00c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47c604d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c0156350 0x7f47c0159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47c604d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c0169110 con 0x7f47c0156350 2023-10-06T02:20:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47c604d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c01693f0 con 0x7f47c0155f80 2023-10-06T02:20:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47c604d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c01696d0 con 0x7f47c00af1f0 2023-10-06T02:20:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47bffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c0156350 0x7f47c0159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47bffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c0156350 0x7f47c0159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34454/0 (socket says 172.21.15.6:34454) 2023-10-06T02:20:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47bffff700 1 -- 172.21.15.6:0/2640321319 learned_addr learned my addr 172.21.15.6:0/2640321319 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47bf7fe700 1 --2- 172.21.15.6:0/2640321319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47c00af1f0 0x7f47c01688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47beffd700 1 --2- 172.21.15.6:0/2640321319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47c0155f80 0x7f47c00c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47bffff700 1 -- 172.21.15.6:0/2640321319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47c00af1f0 msgr2=0x7f47c01688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47bffff700 1 --2- 172.21.15.6:0/2640321319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47c00af1f0 0x7f47c01688c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47bffff700 1 -- 172.21.15.6:0/2640321319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47c0155f80 msgr2=0x7f47c00c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47bffff700 1 --2- 172.21.15.6:0/2640321319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47c0155f80 0x7f47c00c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47bffff700 1 -- 172.21.15.6:0/2640321319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b4009420 con 0x7f47c0156350 2023-10-06T02:20:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47beffd700 1 --2- 172.21.15.6:0/2640321319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47c0155f80 0x7f47c00c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47bf7fe700 1 --2- 172.21.15.6:0/2640321319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47c00af1f0 0x7f47c01688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47bffff700 1 --2- 172.21.15.6:0/2640321319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c0156350 0x7f47c0159420 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f47b800cc90 tx=0x7f47b8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47a77fe700 1 -- 172.21.15.6:0/2640321319 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b800cea0 con 0x7f47c0156350 2023-10-06T02:20:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47a77fe700 1 -- 172.21.15.6:0/2640321319 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b800ab70 con 0x7f47c0156350 2023-10-06T02:20:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47c604d700 1 -- 172.21.15.6:0/2640321319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c01699b0 con 0x7f47c0156350 2023-10-06T02:20:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.228+0000 7f47a77fe700 1 -- 172.21.15.6:0/2640321319 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b80070f0 con 0x7f47c0156350 2023-10-06T02:20:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.229+0000 7f47c604d700 1 -- 172.21.15.6:0/2640321319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c0168e00 con 0x7f47c0156350 2023-10-06T02:20:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.230+0000 7f47c604d700 1 -- 172.21.15.6:0/2640321319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c0169ed0 con 0x7f47c0156350 2023-10-06T02:20:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.230+0000 7f47a77fe700 1 -- 172.21.15.6:0/2640321319 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47b80074a0 con 0x7f47c0156350 2023-10-06T02:20:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.230+0000 7f47a77fe700 1 --2- 172.21.15.6:0/2640321319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f47ac066f30 0x7f47ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.230+0000 7f47a77fe700 1 -- 172.21.15.6:0/2640321319 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f47b8084d20 con 0x7f47c0156350 2023-10-06T02:20:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.230+0000 7f47bf7fe700 1 --2- 172.21.15.6:0/2640321319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f47ac066f30 0x7f47ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.231+0000 7f47bf7fe700 1 --2- 172.21.15.6:0/2640321319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f47ac066f30 0x7f47ac0693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f47b0006fd0 tx=0x7f47b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.234+0000 7f47a77fe700 1 -- 172.21.15.6:0/2640321319 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47b8051c90 con 0x7f47c0156350 2023-10-06T02:20:00.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:00.429+0000 7f47c604d700 1 -- 172.21.15.6:0/2640321319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f47c006be60 con 0x7f47c0156350 2023-10-06T02:20:01.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.048+0000 7f47a77fe700 1 -- 172.21.15.6:0/2640321319 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7f47b80552b0 con 0x7f47c0156350 2023-10-06T02:20:01.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.051+0000 7f47c604d700 1 -- 172.21.15.6:0/2640321319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f47ac066f30 msgr2=0x7f47ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:01.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.051+0000 7f47c604d700 1 --2- 172.21.15.6:0/2640321319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f47ac066f30 0x7f47ac0693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f47b0006fd0 tx=0x7f47b0008040 comp rx=0 tx=0).stop 2023-10-06T02:20:01.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.051+0000 7f47c604d700 1 -- 172.21.15.6:0/2640321319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c0156350 msgr2=0x7f47c0159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:01.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.051+0000 7f47c604d700 1 --2- 172.21.15.6:0/2640321319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c0156350 0x7f47c0159420 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f47b800cc90 tx=0x7f47b8001a80 comp rx=0 tx=0).stop 2023-10-06T02:20:01.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.052+0000 7f47c604d700 1 -- 172.21.15.6:0/2640321319 shutdown_connections 2023-10-06T02:20:01.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.052+0000 7f47c604d700 1 --2- 172.21.15.6:0/2640321319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f47ac066f30 0x7f47ac0693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:01.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.052+0000 7f47c604d700 1 --2- 172.21.15.6:0/2640321319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c0156350 0x7f47c0159420 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:01.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.052+0000 7f47c604d700 1 --2- 172.21.15.6:0/2640321319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47c00af1f0 0x7f47c01688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:01.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.052+0000 7f47c604d700 1 --2- 172.21.15.6:0/2640321319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47c0155f80 0x7f47c00c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:01.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.052+0000 7f47c604d700 1 -- 172.21.15.6:0/2640321319 >> 172.21.15.6:0/2640321319 conn(0x7f47c00cbef0 msgr2=0x7f47c006b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:01.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.052+0000 7f47c604d700 1 -- 172.21.15.6:0/2640321319 shutdown_connections 2023-10-06T02:20:01.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.052+0000 7f47c604d700 1 -- 172.21.15.6:0/2640321319 wait complete. 2023-10-06T02:20:01.056 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:20:01.069 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:20:01.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.193+0000 7fcb9348b700 1 Processor -- start 2023-10-06T02:20:01.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.193+0000 7fcb9348b700 1 -- start start 2023-10-06T02:20:01.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.194+0000 7fcb9348b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb8c0a95b0 0x7fcb8c1597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:01.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.194+0000 7fcb9348b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c068d90 0x7fcb8c15a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:01.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.194+0000 7fcb9348b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8c159fa0 con 0x7fcb8c1593f0 2023-10-06T02:20:01.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.194+0000 7fcb9348b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8c159d00 con 0x7fcb8c0a95b0 2023-10-06T02:20:01.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.194+0000 7fcb9348b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0a9d20 con 0x7fcb8c068d90 2023-10-06T02:20:01.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.194+0000 7fcb90a26700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb8c0a95b0 0x7fcb8c1597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:01.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.194+0000 7fcb91227700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcb8c1593f0 0x7fcb8c068680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50868/0 (socket says 172.21.15.6:50868) 2023-10-06T02:20:01.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.194+0000 7fcb91227700 1 -- 172.21.15.6:0/1006108832 learned_addr learned my addr 172.21.15.6:0/1006108832 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:01.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.194+0000 7fcb90a26700 1 -- 172.21.15.6:0/1006108832 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c068d90 msgr2=0x7fcb8c15a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:01.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.194+0000 7fcb91a28700 1 --2- 172.21.15.6:0/1006108832 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c068d90 0x7fcb8c15a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:01.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.194+0000 7fcb90a26700 1 --2- 172.21.15.6:0/1006108832 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c068d90 0x7fcb8c15a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:01.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.194+0000 7fcb90a26700 1 -- 172.21.15.6:0/1006108832 >> v1:172.21.15.6:6789/0 conn(0x7fcb8c1593f0 legacy=0x7fcb8c068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:01.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.194+0000 7fcb8bfff700 1 -- 172.21.15.6:0/1006108832 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675429834 0 0) 0x7fcb8c159fa0 con 0x7fcb8c1593f0 2023-10-06T02:20:01.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.194+0000 7fcb90a26700 1 -- 172.21.15.6:0/1006108832 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c0a9fc0 con 0x7fcb8c0a95b0 2023-10-06T02:20:01.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.194+0000 7fcb91a28700 1 --2- 172.21.15.6:0/1006108832 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c068d90 0x7fcb8c15a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:01.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.195+0000 7fcb90a26700 1 --2- 172.21.15.6:0/1006108832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0a95b0 0x7fcb8c1597c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcb800098e0 tx=0x7fcb800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ba3cb696e941e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:01.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.195+0000 7fcb8bfff700 1 -- 172.21.15.6:0/1006108832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb80009e80 con 0x7fcb8c0a95b0 2023-10-06T02:20:01.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.195+0000 7fcb8bfff700 1 -- 172.21.15.6:0/1006108832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8000b860 con 0x7fcb8c0a95b0 2023-10-06T02:20:01.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.195+0000 7fcb8bfff700 1 -- 172.21.15.6:0/1006108832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8000bbe0 con 0x7fcb8c0a95b0 2023-10-06T02:20:01.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.195+0000 7fcb9348b700 1 -- 172.21.15.6:0/1006108832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0a95b0 msgr2=0x7fcb8c1597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:01.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.195+0000 7fcb9348b700 1 --2- 172.21.15.6:0/1006108832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0a95b0 0x7fcb8c1597c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcb800098e0 tx=0x7fcb800091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:01.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.195+0000 7fcb9348b700 1 -- 172.21.15.6:0/1006108832 shutdown_connections 2023-10-06T02:20:01.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.195+0000 7fcb9348b700 1 --2- 172.21.15.6:0/1006108832 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c068d90 0x7fcb8c15a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:01.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.195+0000 7fcb9348b700 1 --2- 172.21.15.6:0/1006108832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0a95b0 0x7fcb8c1597c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:01.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.195+0000 7fcb9348b700 1 -- 172.21.15.6:0/1006108832 >> 172.21.15.6:0/1006108832 conn(0x7fcb8c0af660 msgr2=0x7fcb8c0afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:01.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.195+0000 7fcb9348b700 1 -- 172.21.15.6:0/1006108832 shutdown_connections 2023-10-06T02:20:01.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.195+0000 7fcb9348b700 1 -- 172.21.15.6:0/1006108832 wait complete. 2023-10-06T02:20:01.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.196+0000 7fcb9348b700 1 Processor -- start 2023-10-06T02:20:01.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.197+0000 7fcb9348b700 1 -- start start 2023-10-06T02:20:01.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.197+0000 7fcb9348b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c068d90 0x7fcb8c0add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:01.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.197+0000 7fcb9348b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0a95b0 0x7fcb8c14af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:01.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.197+0000 7fcb9348b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c1593f0 0x7fcb8c14b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:01.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.197+0000 7fcb9348b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c097d10 con 0x7fcb8c0a95b0 2023-10-06T02:20:01.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.197+0000 7fcb9348b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c097ff0 con 0x7fcb8c1593f0 2023-10-06T02:20:01.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.197+0000 7fcb9348b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0982d0 con 0x7fcb8c068d90 2023-10-06T02:20:01.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.197+0000 7fcb90a26700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0a95b0 0x7fcb8c14af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:01.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.198+0000 7fcb90a26700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0a95b0 0x7fcb8c14af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34470/0 (socket says 172.21.15.6:34470) 2023-10-06T02:20:01.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.198+0000 7fcb90a26700 1 -- 172.21.15.6:0/1407499250 learned_addr learned my addr 172.21.15.6:0/1407499250 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:01.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.198+0000 7fcb91227700 1 --2- 172.21.15.6:0/1407499250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c068d90 0x7fcb8c0add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:01.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.198+0000 7fcb91a28700 1 --2- 172.21.15.6:0/1407499250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c1593f0 0x7fcb8c14b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:01.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.198+0000 7fcb90a26700 1 -- 172.21.15.6:0/1407499250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c068d90 msgr2=0x7fcb8c0add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:01.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.198+0000 7fcb90a26700 1 --2- 172.21.15.6:0/1407499250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c068d90 0x7fcb8c0add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:01.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.198+0000 7fcb90a26700 1 -- 172.21.15.6:0/1407499250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c1593f0 msgr2=0x7fcb8c14b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:01.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.198+0000 7fcb90a26700 1 --2- 172.21.15.6:0/1407499250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c1593f0 0x7fcb8c14b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:01.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.198+0000 7fcb90a26700 1 -- 172.21.15.6:0/1407499250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb80009420 con 0x7fcb8c0a95b0 2023-10-06T02:20:01.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.198+0000 7fcb90a26700 1 --2- 172.21.15.6:0/1407499250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0a95b0 0x7fcb8c14af20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c06d8d0 tx=0x7fcb80017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:01.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.198+0000 7fcb897fa700 1 -- 172.21.15.6:0/1407499250 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8000bbe0 con 0x7fcb8c0a95b0 2023-10-06T02:20:01.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.198+0000 7fcb897fa700 1 -- 172.21.15.6:0/1407499250 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb80011420 con 0x7fcb8c0a95b0 2023-10-06T02:20:01.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.198+0000 7fcb897fa700 1 -- 172.21.15.6:0/1407499250 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb800117c0 con 0x7fcb8c0a95b0 2023-10-06T02:20:01.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.198+0000 7fcb9348b700 1 -- 172.21.15.6:0/1407499250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c0985b0 con 0x7fcb8c0a95b0 2023-10-06T02:20:01.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.198+0000 7fcb9348b700 1 -- 172.21.15.6:0/1407499250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8c0974b0 con 0x7fcb8c0a95b0 2023-10-06T02:20:01.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.199+0000 7fcb9348b700 1 -- 172.21.15.6:0/1407499250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8c098ad0 con 0x7fcb8c0a95b0 2023-10-06T02:20:01.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.200+0000 7fcb897fa700 1 -- 172.21.15.6:0/1407499250 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb80011bb0 con 0x7fcb8c0a95b0 2023-10-06T02:20:01.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.200+0000 7fcb897fa700 1 --2- 172.21.15.6:0/1407499250 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb78066f60 0x7fcb78069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:01.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.200+0000 7fcb897fa700 1 -- 172.21.15.6:0/1407499250 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6170+0+0 (secure 0 0 0) 0x7fcb80085eb0 con 0x7fcb8c0a95b0 2023-10-06T02:20:01.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.200+0000 7fcb91227700 1 --2- 172.21.15.6:0/1407499250 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb78066f60 0x7fcb78069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:01.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.201+0000 7fcb91227700 1 --2- 172.21.15.6:0/1407499250 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb78066f60 0x7fcb78069410 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400c870 tx=0x7fcb84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:01.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.204+0000 7fcb897fa700 1 -- 172.21.15.6:0/1407499250 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb8c098ad0 con 0x7fcb8c0a95b0 2023-10-06T02:20:01.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:01.397+0000 7fcb9348b700 1 -- 172.21.15.6:0/1407499250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcb8c098ad0 con 0x7fcb8c0a95b0 2023-10-06T02:20:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.050+0000 7fcb897fa700 1 -- 172.21.15.6:0/1407499250 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcb8c098ad0 con 0x7fcb8c0a95b0 2023-10-06T02:20:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.061+0000 7fcb9348b700 1 -- 172.21.15.6:0/1407499250 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb78066f60 msgr2=0x7fcb78069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.061+0000 7fcb9348b700 1 --2- 172.21.15.6:0/1407499250 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb78066f60 0x7fcb78069410 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400c870 tx=0x7fcb84009040 comp rx=0 tx=0).stop 2023-10-06T02:20:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.061+0000 7fcb9348b700 1 -- 172.21.15.6:0/1407499250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0a95b0 msgr2=0x7fcb8c14af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.061+0000 7fcb9348b700 1 --2- 172.21.15.6:0/1407499250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0a95b0 0x7fcb8c14af20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c06d8d0 tx=0x7fcb80017000 comp rx=0 tx=0).stop 2023-10-06T02:20:02.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.062+0000 7fcb9348b700 1 -- 172.21.15.6:0/1407499250 shutdown_connections 2023-10-06T02:20:02.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.062+0000 7fcb9348b700 1 --2- 172.21.15.6:0/1407499250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c1593f0 0x7fcb8c14b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.062+0000 7fcb9348b700 1 --2- 172.21.15.6:0/1407499250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c068d90 0x7fcb8c0add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.062+0000 7fcb9348b700 1 --2- 172.21.15.6:0/1407499250 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb78066f60 0x7fcb78069410 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.062+0000 7fcb9348b700 1 --2- 172.21.15.6:0/1407499250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0a95b0 0x7fcb8c14af20 secure :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c06d8d0 tx=0x7fcb80017000 comp rx=0 tx=0).stop 2023-10-06T02:20:02.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.062+0000 7fcb9348b700 1 -- 172.21.15.6:0/1407499250 >> 172.21.15.6:0/1407499250 conn(0x7fcb8c0af660 msgr2=0x7fcb8c06bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:02.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.062+0000 7fcb9348b700 1 -- 172.21.15.6:0/1407499250 shutdown_connections 2023-10-06T02:20:02.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.062+0000 7fcb9348b700 1 -- 172.21.15.6:0/1407499250 wait complete. 2023-10-06T02:20:02.066 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-06T02:20:02.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:20:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.206+0000 7fc1dc7f0700 1 Processor -- start 2023-10-06T02:20:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.206+0000 7fc1dc7f0700 1 -- start start 2023-10-06T02:20:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.207+0000 7fc1dc7f0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1d40d0400 0x7fc1d40b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.207+0000 7fc1dc7f0700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc1d40d07d0 0x7fc1d40b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.207+0000 7fc1dc7f0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d40b6170 con 0x7fc1d40ccd40 2023-10-06T02:20:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.207+0000 7fc1dc7f0700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d415dd40 con 0x7fc1d40d07d0 2023-10-06T02:20:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.207+0000 7fc1dc7f0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d415e020 con 0x7fc1d40d0400 2023-10-06T02:20:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.208+0000 7fc1d9d8b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc1d40ccd40 0x7fc1d40cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50880/0 (socket says 172.21.15.6:50880) 2023-10-06T02:20:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.208+0000 7fc1d9d8b700 1 -- 172.21.15.6:0/3719868583 learned_addr learned my addr 172.21.15.6:0/3719868583 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.208+0000 7fc1da58c700 1 --2- 172.21.15.6:0/3719868583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1d40d0400 0x7fc1d40b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.208+0000 7fc1dad8d700 1 --2- 172.21.15.6:0/3719868583 >> v2:172.21.15.175:3300/0 conn(0x7fc1d40d07d0 0x7fc1d40b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.208+0000 7fc1d958a700 1 -- 172.21.15.6:0/3719868583 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293183555 0 0) 0x7fc1d40b6170 con 0x7fc1d40ccd40 2023-10-06T02:20:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.208+0000 7fc1d958a700 1 -- 172.21.15.6:0/3719868583 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1bc003570 con 0x7fc1d40ccd40 2023-10-06T02:20:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.208+0000 7fc1da58c700 1 -- 172.21.15.6:0/3719868583 >> v2:172.21.15.175:3300/0 conn(0x7fc1d40d07d0 msgr2=0x7fc1d40b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.208+0000 7fc1da58c700 1 --2- 172.21.15.6:0/3719868583 >> v2:172.21.15.175:3300/0 conn(0x7fc1d40d07d0 0x7fc1d40b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.208+0000 7fc1da58c700 1 -- 172.21.15.6:0/3719868583 >> v1:172.21.15.6:6789/0 conn(0x7fc1d40ccd40 legacy=0x7fc1d40cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.208+0000 7fc1da58c700 1 -- 172.21.15.6:0/3719868583 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d40ceaa0 con 0x7fc1d40d0400 2023-10-06T02:20:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.208+0000 7fc1da58c700 1 --2- 172.21.15.6:0/3719868583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1d40d0400 0x7fc1d40b5c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0098d0 tx=0x7fc1cc009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70869da16994f0da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.208+0000 7fc1d958a700 1 -- 172.21.15.6:0/3719868583 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc005c10 con 0x7fc1d40d0400 2023-10-06T02:20:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.209+0000 7fc1d958a700 1 -- 172.21.15.6:0/3719868583 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc005d70 con 0x7fc1d40d0400 2023-10-06T02:20:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.209+0000 7fc1d958a700 1 -- 172.21.15.6:0/3719868583 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc006280 con 0x7fc1d40d0400 2023-10-06T02:20:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.209+0000 7fc1dc7f0700 1 -- 172.21.15.6:0/3719868583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1d40d0400 msgr2=0x7fc1d40b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.209+0000 7fc1dc7f0700 1 --2- 172.21.15.6:0/3719868583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1d40d0400 0x7fc1d40b5c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0098d0 tx=0x7fc1cc009120 comp rx=0 tx=0).stop 2023-10-06T02:20:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.209+0000 7fc1dc7f0700 1 -- 172.21.15.6:0/3719868583 shutdown_connections 2023-10-06T02:20:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.209+0000 7fc1dc7f0700 1 --2- 172.21.15.6:0/3719868583 >> v2:172.21.15.175:3300/0 conn(0x7fc1d40d07d0 0x7fc1d40b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.209+0000 7fc1dc7f0700 1 --2- 172.21.15.6:0/3719868583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1d40d0400 0x7fc1d40b5c30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.209+0000 7fc1dc7f0700 1 -- 172.21.15.6:0/3719868583 >> 172.21.15.6:0/3719868583 conn(0x7fc1d406a220 msgr2=0x7fc1d406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.209+0000 7fc1dc7f0700 1 -- 172.21.15.6:0/3719868583 shutdown_connections 2023-10-06T02:20:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.209+0000 7fc1dc7f0700 1 -- 172.21.15.6:0/3719868583 wait complete. 2023-10-06T02:20:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.210+0000 7fc1dc7f0700 1 Processor -- start 2023-10-06T02:20:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.210+0000 7fc1dc7f0700 1 -- start start 2023-10-06T02:20:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.211+0000 7fc1dc7f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1d40ccd40 0x7fc1d413eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.211+0000 7fc1dc7f0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1d40d0400 0x7fc1d414f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.211+0000 7fc1dc7f0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1d40d07d0 0x7fc1d40afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.211+0000 7fc1dc7f0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d413f530 con 0x7fc1d40ccd40 2023-10-06T02:20:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.211+0000 7fc1dc7f0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d41514f0 con 0x7fc1d40d07d0 2023-10-06T02:20:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.211+0000 7fc1dc7f0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d41517d0 con 0x7fc1d40d0400 2023-10-06T02:20:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.211+0000 7fc1da58c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1d40ccd40 0x7fc1d413eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:02.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.211+0000 7fc1da58c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1d40ccd40 0x7fc1d413eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34476/0 (socket says 172.21.15.6:34476) 2023-10-06T02:20:02.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.211+0000 7fc1da58c700 1 -- 172.21.15.6:0/3537474162 learned_addr learned my addr 172.21.15.6:0/3537474162 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:02.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.211+0000 7fc1dad8d700 1 --2- 172.21.15.6:0/3537474162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1d40d07d0 0x7fc1d40afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:02.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.211+0000 7fc1d9d8b700 1 --2- 172.21.15.6:0/3537474162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1d40d0400 0x7fc1d414f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:02.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.211+0000 7fc1da58c700 1 -- 172.21.15.6:0/3537474162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1d40d0400 msgr2=0x7fc1d414f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:02.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.211+0000 7fc1da58c700 1 --2- 172.21.15.6:0/3537474162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1d40d0400 0x7fc1d414f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.211+0000 7fc1da58c700 1 -- 172.21.15.6:0/3537474162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1d40d07d0 msgr2=0x7fc1d40afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:02.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.211+0000 7fc1da58c700 1 --2- 172.21.15.6:0/3537474162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1d40d07d0 0x7fc1d40afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.211+0000 7fc1da58c700 1 -- 172.21.15.6:0/3537474162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc0093c0 con 0x7fc1d40ccd40 2023-10-06T02:20:02.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.212+0000 7fc1da58c700 1 --2- 172.21.15.6:0/3537474162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1d40ccd40 0x7fc1d413eff0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc009ec0 tx=0x7fc1cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:02.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.212+0000 7fc1d27fc700 1 -- 172.21.15.6:0/3537474162 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc006a70 con 0x7fc1d40ccd40 2023-10-06T02:20:02.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.212+0000 7fc1d27fc700 1 -- 172.21.15.6:0/3537474162 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc01d6b0 con 0x7fc1d40ccd40 2023-10-06T02:20:02.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.212+0000 7fc1dc7f0700 1 -- 172.21.15.6:0/3537474162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d4151ab0 con 0x7fc1d40ccd40 2023-10-06T02:20:02.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.212+0000 7fc1d27fc700 1 -- 172.21.15.6:0/3537474162 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc01da70 con 0x7fc1d40ccd40 2023-10-06T02:20:02.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.212+0000 7fc1dc7f0700 1 -- 172.21.15.6:0/3537474162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d4152070 con 0x7fc1d40ccd40 2023-10-06T02:20:02.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.213+0000 7fc1dc7f0700 1 -- 172.21.15.6:0/3537474162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d4088760 con 0x7fc1d40ccd40 2023-10-06T02:20:02.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.213+0000 7fc1d27fc700 1 -- 172.21.15.6:0/3537474162 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1cc01b480 con 0x7fc1d40ccd40 2023-10-06T02:20:02.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.214+0000 7fc1d27fc700 1 --2- 172.21.15.6:0/3537474162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc1c0066f30 0x7fc1c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:02.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.214+0000 7fc1d27fc700 1 -- 172.21.15.6:0/3537474162 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fc1cc0860b0 con 0x7fc1d40ccd40 2023-10-06T02:20:02.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.214+0000 7fc1d9d8b700 1 --2- 172.21.15.6:0/3537474162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc1c0066f30 0x7fc1c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:02.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.214+0000 7fc1d9d8b700 1 --2- 172.21.15.6:0/3537474162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc1c0066f30 0x7fc1c00693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8007fd0 tx=0x7fc1c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:02.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.218+0000 7fc1d27fc700 1 -- 172.21.15.6:0/3537474162 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1cc053320 con 0x7fc1d40ccd40 2023-10-06T02:20:02.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.409+0000 7fc1dc7f0700 1 -- 172.21.15.6:0/3537474162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc1d40ced80 con 0x7fc1d40ccd40 2023-10-06T02:20:02.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.413+0000 7fc1d27fc700 1 -- 172.21.15.6:0/3537474162 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc1cc02a0a0 con 0x7fc1d40ccd40 2023-10-06T02:20:02.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.415+0000 7fc1dc7f0700 1 -- 172.21.15.6:0/3537474162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc1c0066f30 msgr2=0x7fc1c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:02.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.415+0000 7fc1dc7f0700 1 --2- 172.21.15.6:0/3537474162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc1c0066f30 0x7fc1c00693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8007fd0 tx=0x7fc1c8009040 comp rx=0 tx=0).stop 2023-10-06T02:20:02.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.415+0000 7fc1dc7f0700 1 -- 172.21.15.6:0/3537474162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1d40ccd40 msgr2=0x7fc1d413eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:02.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.415+0000 7fc1dc7f0700 1 --2- 172.21.15.6:0/3537474162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1d40ccd40 0x7fc1d413eff0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc009ec0 tx=0x7fc1cc016000 comp rx=0 tx=0).stop 2023-10-06T02:20:02.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.415+0000 7fc1dc7f0700 1 -- 172.21.15.6:0/3537474162 shutdown_connections 2023-10-06T02:20:02.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.415+0000 7fc1dc7f0700 1 --2- 172.21.15.6:0/3537474162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1d40d07d0 0x7fc1d40afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.415+0000 7fc1dc7f0700 1 --2- 172.21.15.6:0/3537474162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc1c0066f30 0x7fc1c00693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.415+0000 7fc1dc7f0700 1 --2- 172.21.15.6:0/3537474162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1d40ccd40 0x7fc1d413eff0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.415+0000 7fc1dc7f0700 1 --2- 172.21.15.6:0/3537474162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1d40d0400 0x7fc1d414f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.415+0000 7fc1dc7f0700 1 -- 172.21.15.6:0/3537474162 >> 172.21.15.6:0/3537474162 conn(0x7fc1d406a220 msgr2=0x7fc1d40b5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:02.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.415+0000 7fc1dc7f0700 1 -- 172.21.15.6:0/3537474162 shutdown_connections 2023-10-06T02:20:02.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.415+0000 7fc1dc7f0700 1 -- 172.21.15.6:0/3537474162 wait complete. 2023-10-06T02:20:02.428 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry' 2023-10-06T02:20:02.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.546+0000 7fa743078700 1 Processor -- start 2023-10-06T02:20:02.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.546+0000 7fa743078700 1 -- start start 2023-10-06T02:20:02.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.547+0000 7fa743078700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa73c15c900 0x7fa73c0b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:02.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.547+0000 7fa743078700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa73c068d90 0x7fa73c15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:02.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.547+0000 7fa743078700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa73c0cfe20 0x7fa73c0d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:02.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.547+0000 7fa743078700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0ce640 con 0x7fa73c068d90 2023-10-06T02:20:02.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.547+0000 7fa743078700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0d07a0 con 0x7fa73c15c900 2023-10-06T02:20:02.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.547+0000 7fa743078700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c15a440 con 0x7fa73c0cfe20 2023-10-06T02:20:02.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.547+0000 7fa741875700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa73c068d90 0x7fa73c15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:02.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.547+0000 7fa741875700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa73c068d90 0x7fa73c15abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34478/0 (socket says 172.21.15.6:34478) 2023-10-06T02:20:02.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.547+0000 7fa741875700 1 -- 172.21.15.6:0/2668768097 learned_addr learned my addr 172.21.15.6:0/2668768097 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:02.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.547+0000 7fa742877700 1 --2- 172.21.15.6:0/2668768097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa73c0cfe20 0x7fa73c0d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:02.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.547+0000 7fa742076700 1 --2- 172.21.15.6:0/2668768097 >> v2:172.21.15.175:3300/0 conn(0x7fa73c15c900 0x7fa73c0b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.547+0000 7fa741875700 1 -- 172.21.15.6:0/2668768097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa73c0cfe20 msgr2=0x7fa73c0d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.547+0000 7fa741875700 1 --2- 172.21.15.6:0/2668768097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa73c0cfe20 0x7fa73c0d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.548+0000 7fa741875700 1 -- 172.21.15.6:0/2668768097 >> v2:172.21.15.175:3300/0 conn(0x7fa73c15c900 msgr2=0x7fa73c0b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.548+0000 7fa741875700 1 --2- 172.21.15.6:0/2668768097 >> v2:172.21.15.175:3300/0 conn(0x7fa73c15c900 0x7fa73c0b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.548+0000 7fa741875700 1 -- 172.21.15.6:0/2668768097 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c15a9c0 con 0x7fa73c068d90 2023-10-06T02:20:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.548+0000 7fa741875700 1 --2- 172.21.15.6:0/2668768097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c068d90 0x7fa73c15abe0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa73c089360 tx=0x7fa730009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab7ee377813fed9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.548+0000 7fa741074700 1 -- 172.21.15.6:0/2668768097 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73000b860 con 0x7fa73c068d90 2023-10-06T02:20:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.548+0000 7fa741074700 1 -- 172.21.15.6:0/2668768097 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73000b9c0 con 0x7fa73c068d90 2023-10-06T02:20:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.548+0000 7fa741074700 1 -- 172.21.15.6:0/2668768097 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73000bd60 con 0x7fa73c068d90 2023-10-06T02:20:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.548+0000 7fa743078700 1 -- 172.21.15.6:0/2668768097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c068d90 msgr2=0x7fa73c15abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.548+0000 7fa743078700 1 --2- 172.21.15.6:0/2668768097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c068d90 0x7fa73c15abe0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa73c089360 tx=0x7fa730009250 comp rx=0 tx=0).stop 2023-10-06T02:20:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.548+0000 7fa743078700 1 -- 172.21.15.6:0/2668768097 shutdown_connections 2023-10-06T02:20:02.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.548+0000 7fa743078700 1 --2- 172.21.15.6:0/2668768097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa73c0cfe20 0x7fa73c0d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.548+0000 7fa743078700 1 --2- 172.21.15.6:0/2668768097 >> v2:172.21.15.175:3300/0 conn(0x7fa73c15c900 0x7fa73c0b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.548+0000 7fa743078700 1 --2- 172.21.15.6:0/2668768097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c068d90 0x7fa73c15abe0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.548+0000 7fa743078700 1 -- 172.21.15.6:0/2668768097 >> 172.21.15.6:0/2668768097 conn(0x7fa73c06ac00 msgr2=0x7fa73c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:02.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.548+0000 7fa743078700 1 -- 172.21.15.6:0/2668768097 shutdown_connections 2023-10-06T02:20:02.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.548+0000 7fa743078700 1 -- 172.21.15.6:0/2668768097 wait complete. 2023-10-06T02:20:02.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.550+0000 7fa743078700 1 Processor -- start 2023-10-06T02:20:02.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.550+0000 7fa743078700 1 -- start start 2023-10-06T02:20:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.550+0000 7fa743078700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c068d90 0x7fa73c15de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.550+0000 7fa743078700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa73c0cfe20 0x7fa73c0b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.550+0000 7fa743078700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa73c15c900 0x7fa73c0b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.550+0000 7fa743078700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c156030 con 0x7fa73c068d90 2023-10-06T02:20:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.550+0000 7fa743078700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0c4ef0 con 0x7fa73c0cfe20 2023-10-06T02:20:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.550+0000 7fa743078700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c15e430 con 0x7fa73c15c900 2023-10-06T02:20:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.550+0000 7fa742076700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c068d90 0x7fa73c15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.550+0000 7fa742076700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c068d90 0x7fa73c15de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34480/0 (socket says 172.21.15.6:34480) 2023-10-06T02:20:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.550+0000 7fa742076700 1 -- 172.21.15.6:0/566675313 learned_addr learned my addr 172.21.15.6:0/566675313 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.551+0000 7fa742076700 1 -- 172.21.15.6:0/566675313 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa73c15c900 msgr2=0x7fa73c0b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.551+0000 7fa742877700 1 --2- 172.21.15.6:0/566675313 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa73c15c900 0x7fa73c0b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.551+0000 7fa742076700 1 --2- 172.21.15.6:0/566675313 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa73c15c900 0x7fa73c0b4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.551+0000 7fa741875700 1 --2- 172.21.15.6:0/566675313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa73c0cfe20 0x7fa73c0b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.551+0000 7fa742076700 1 -- 172.21.15.6:0/566675313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa73c0cfe20 msgr2=0x7fa73c0b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.551+0000 7fa742076700 1 --2- 172.21.15.6:0/566675313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa73c0cfe20 0x7fa73c0b3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.551+0000 7fa742076700 1 -- 172.21.15.6:0/566675313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7300094f0 con 0x7fa73c068d90 2023-10-06T02:20:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.551+0000 7fa742076700 1 --2- 172.21.15.6:0/566675313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c068d90 0x7fa73c15de50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa73400d8c0 tx=0x7fa734008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.551+0000 7fa73a7fc700 1 -- 172.21.15.6:0/566675313 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400de60 con 0x7fa73c068d90 2023-10-06T02:20:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.551+0000 7fa73a7fc700 1 -- 172.21.15.6:0/566675313 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73400b780 con 0x7fa73c068d90 2023-10-06T02:20:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.551+0000 7fa73a7fc700 1 -- 172.21.15.6:0/566675313 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400bb20 con 0x7fa73c068d90 2023-10-06T02:20:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.551+0000 7fa743078700 1 -- 172.21.15.6:0/566675313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c15e710 con 0x7fa73c068d90 2023-10-06T02:20:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.551+0000 7fa743078700 1 -- 172.21.15.6:0/566675313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c15ecd0 con 0x7fa73c068d90 2023-10-06T02:20:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.552+0000 7fa743078700 1 -- 172.21.15.6:0/566675313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c0c51d0 con 0x7fa73c068d90 2023-10-06T02:20:02.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.552+0000 7fa73a7fc700 1 -- 172.21.15.6:0/566675313 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa73401e460 con 0x7fa73c068d90 2023-10-06T02:20:02.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.553+0000 7fa73a7fc700 1 --2- 172.21.15.6:0/566675313 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa728066f30 0x7fa7280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:02.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.553+0000 7fa73a7fc700 1 -- 172.21.15.6:0/566675313 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fa734084be0 con 0x7fa73c068d90 2023-10-06T02:20:02.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.553+0000 7fa741875700 1 --2- 172.21.15.6:0/566675313 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa728066f30 0x7fa7280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:02.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.553+0000 7fa741875700 1 --2- 172.21.15.6:0/566675313 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa728066f30 0x7fa7280693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0691d0 tx=0x7fa730017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:02.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.557+0000 7fa73a7fc700 1 -- 172.21.15.6:0/566675313 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa734051e50 con 0x7fa73c068d90 2023-10-06T02:20:02.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:02.834+0000 7fa743078700 1 -- 172.21.15.6:0/566675313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry"]} v 0) v1 -- 0x7fa73c15a6e0 con 0x7fa73c068d90 2023-10-06T02:20:03.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.048+0000 7fa73a7fc700 1 -- 172.21.15.6:0/566675313 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_damaged_dentry"]}]=0 v133) v1 ==== 134+0+0 (secure 0 0 0) 0x7fa734055470 con 0x7fa73c068d90 2023-10-06T02:20:03.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.050+0000 7fa743078700 1 -- 172.21.15.6:0/566675313 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa728066f30 msgr2=0x7fa7280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:03.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.050+0000 7fa743078700 1 --2- 172.21.15.6:0/566675313 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa728066f30 0x7fa7280693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0691d0 tx=0x7fa730017000 comp rx=0 tx=0).stop 2023-10-06T02:20:03.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.050+0000 7fa743078700 1 -- 172.21.15.6:0/566675313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c068d90 msgr2=0x7fa73c15de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:03.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.050+0000 7fa743078700 1 --2- 172.21.15.6:0/566675313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c068d90 0x7fa73c15de50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa73400d8c0 tx=0x7fa734008040 comp rx=0 tx=0).stop 2023-10-06T02:20:03.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.050+0000 7fa743078700 1 -- 172.21.15.6:0/566675313 shutdown_connections 2023-10-06T02:20:03.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.050+0000 7fa743078700 1 --2- 172.21.15.6:0/566675313 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa73c15c900 0x7fa73c0b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:03.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.050+0000 7fa743078700 1 --2- 172.21.15.6:0/566675313 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa728066f30 0x7fa7280693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:03.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.050+0000 7fa743078700 1 --2- 172.21.15.6:0/566675313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c068d90 0x7fa73c15de50 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:03.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.050+0000 7fa743078700 1 --2- 172.21.15.6:0/566675313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa73c0cfe20 0x7fa73c0b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:03.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.050+0000 7fa743078700 1 -- 172.21.15.6:0/566675313 >> 172.21.15.6:0/566675313 conn(0x7fa73c06ac00 msgr2=0x7fa73c0b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:03.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.050+0000 7fa743078700 1 -- 172.21.15.6:0/566675313 shutdown_connections 2023-10-06T02:20:03.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.050+0000 7fa743078700 1 -- 172.21.15.6:0/566675313 wait complete. 2023-10-06T02:20:03.063 INFO:tasks.cephfs_test_runner:test_damaged_dentry (tasks.cephfs.test_damage.TestDamage) ... ok 2023-10-06T02:20:03.063 INFO:tasks.cephfs_test_runner:Starting test: test_dentry_first_existing (tasks.cephfs.test_damage.TestDamage) That the MDS won't abort when the dentry is already known to be damaged. 2023-10-06T02:20:03.063 INFO:tasks.cephfs_test_runner:test_dentry_first_existing (tasks.cephfs.test_damage.TestDamage) 2023-10-06T02:20:03.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing' 2023-10-06T02:20:03.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.182+0000 7ff00b205700 1 Processor -- start 2023-10-06T02:20:03.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.182+0000 7ff00b205700 1 -- start start 2023-10-06T02:20:03.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.182+0000 7ff00b205700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0040af8b0 0x7ff00415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:03.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.182+0000 7ff00b205700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff0040b27f0 0x7ff00415d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:03.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.182+0000 7ff00b205700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00415e190 con 0x7ff0040af4e0 2023-10-06T02:20:03.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.182+0000 7ff00b205700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0040b1910 con 0x7ff0040b27f0 2023-10-06T02:20:03.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.182+0000 7ff00b205700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0040cb650 con 0x7ff0040af8b0 2023-10-06T02:20:03.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.183+0000 7ff0097a2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff0040b27f0 0x7ff00415d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:03.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.183+0000 7ff0097a2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff0040b27f0 0x7ff00415d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34488/0 (socket says 172.21.15.6:34488) 2023-10-06T02:20:03.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.183+0000 7ff008fa1700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff0040af4e0 0x7ff0040b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50894/0 (socket says 172.21.15.6:50894) 2023-10-06T02:20:03.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.183+0000 7ff0097a2700 1 -- 172.21.15.6:0/751210875 learned_addr learned my addr 172.21.15.6:0/751210875 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:03.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.183+0000 7ff003fff700 1 --2- 172.21.15.6:0/751210875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0040af8b0 0x7ff00415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:03.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.183+0000 7ff0097a2700 1 -- 172.21.15.6:0/751210875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0040af8b0 msgr2=0x7ff00415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:03.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.183+0000 7ff0097a2700 1 --2- 172.21.15.6:0/751210875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0040af8b0 0x7ff00415d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:03.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.183+0000 7ff0097a2700 1 -- 172.21.15.6:0/751210875 >> v1:172.21.15.6:6789/0 conn(0x7ff0040af4e0 legacy=0x7ff0040b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:03.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.183+0000 7ff0037fe700 1 -- 172.21.15.6:0/751210875 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527544647 0 0) 0x7ff00415e190 con 0x7ff0040af4e0 2023-10-06T02:20:03.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.183+0000 7ff0097a2700 1 -- 172.21.15.6:0/751210875 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0040ccaf0 con 0x7ff0040b27f0 2023-10-06T02:20:03.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.183+0000 7ff0097a2700 1 --2- 172.21.15.6:0/751210875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040b27f0 0x7ff00415d9a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fefec0099b0 tx=0x7fefec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db434346ccfad73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:03.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.183+0000 7ff0037fe700 1 -- 172.21.15.6:0/751210875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec00b860 con 0x7ff0040b27f0 2023-10-06T02:20:03.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.183+0000 7ff0037fe700 1 -- 172.21.15.6:0/751210875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec00b9c0 con 0x7ff0040b27f0 2023-10-06T02:20:03.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.183+0000 7ff0037fe700 1 -- 172.21.15.6:0/751210875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec00bd60 con 0x7ff0040b27f0 2023-10-06T02:20:03.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.184+0000 7ff00b205700 1 -- 172.21.15.6:0/751210875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040b27f0 msgr2=0x7ff00415d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:03.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.184+0000 7ff00b205700 1 --2- 172.21.15.6:0/751210875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040b27f0 0x7ff00415d9a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fefec0099b0 tx=0x7fefec009250 comp rx=0 tx=0).stop 2023-10-06T02:20:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.184+0000 7ff00b205700 1 -- 172.21.15.6:0/751210875 shutdown_connections 2023-10-06T02:20:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.184+0000 7ff00b205700 1 --2- 172.21.15.6:0/751210875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040b27f0 0x7ff00415d9a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.184+0000 7ff00b205700 1 --2- 172.21.15.6:0/751210875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0040af8b0 0x7ff00415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.184+0000 7ff00b205700 1 -- 172.21.15.6:0/751210875 >> 172.21.15.6:0/751210875 conn(0x7ff004068680 msgr2=0x7ff004068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.184+0000 7ff00b205700 1 -- 172.21.15.6:0/751210875 shutdown_connections 2023-10-06T02:20:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.184+0000 7ff00b205700 1 -- 172.21.15.6:0/751210875 wait complete. 2023-10-06T02:20:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.185+0000 7ff00b205700 1 Processor -- start 2023-10-06T02:20:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.185+0000 7ff00b205700 1 -- start start 2023-10-06T02:20:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff00b205700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040af4e0 0x7ff004150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff00b205700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0040af8b0 0x7ff0040c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff00b205700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0040b27f0 0x7ff004156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff00b205700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0040d0e60 con 0x7ff0040af4e0 2023-10-06T02:20:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff00b205700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0040c79f0 con 0x7ff0040b27f0 2023-10-06T02:20:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff00b205700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff004151210 con 0x7ff0040af8b0 2023-10-06T02:20:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff008fa1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040af4e0 0x7ff004150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff008fa1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040af4e0 0x7ff004150cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34502/0 (socket says 172.21.15.6:34502) 2023-10-06T02:20:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff008fa1700 1 -- 172.21.15.6:0/1280372308 learned_addr learned my addr 172.21.15.6:0/1280372308 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff003fff700 1 --2- 172.21.15.6:0/1280372308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0040af8b0 0x7ff0040c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff0097a2700 1 --2- 172.21.15.6:0/1280372308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0040b27f0 0x7ff004156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff008fa1700 1 -- 172.21.15.6:0/1280372308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0040af8b0 msgr2=0x7ff0040c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff008fa1700 1 --2- 172.21.15.6:0/1280372308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0040af8b0 0x7ff0040c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff008fa1700 1 -- 172.21.15.6:0/1280372308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0040b27f0 msgr2=0x7ff004156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff008fa1700 1 --2- 172.21.15.6:0/1280372308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0040b27f0 0x7ff004156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff008fa1700 1 -- 172.21.15.6:0/1280372308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefec0094f0 con 0x7ff0040af4e0 2023-10-06T02:20:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff0097a2700 1 --2- 172.21.15.6:0/1280372308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0040b27f0 0x7ff004156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff008fa1700 1 --2- 172.21.15.6:0/1280372308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040af4e0 0x7ff004150cd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7feffc00c7e0 tx=0x7feffc007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff000ff9700 1 -- 172.21.15.6:0/1280372308 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc005a70 con 0x7ff0040af4e0 2023-10-06T02:20:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.186+0000 7ff000ff9700 1 -- 172.21.15.6:0/1280372308 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feffc005bd0 con 0x7ff0040af4e0 2023-10-06T02:20:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.187+0000 7ff00b205700 1 -- 172.21.15.6:0/1280372308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0040ce1e0 con 0x7ff0040af4e0 2023-10-06T02:20:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.187+0000 7ff000ff9700 1 -- 172.21.15.6:0/1280372308 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc0070d0 con 0x7ff0040af4e0 2023-10-06T02:20:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.187+0000 7ff00b205700 1 -- 172.21.15.6:0/1280372308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0040c7680 con 0x7ff0040af4e0 2023-10-06T02:20:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.187+0000 7ff00b205700 1 -- 172.21.15.6:0/1280372308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff004088aa0 con 0x7ff0040af4e0 2023-10-06T02:20:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.188+0000 7ff000ff9700 1 -- 172.21.15.6:0/1280372308 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feffc007440 con 0x7ff0040af4e0 2023-10-06T02:20:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.188+0000 7ff000ff9700 1 --2- 172.21.15.6:0/1280372308 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fefe4066f30 0x7fefe40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.188+0000 7ff000ff9700 1 -- 172.21.15.6:0/1280372308 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5698+0+0 (secure 0 0 0) 0x7feffc0839b0 con 0x7ff0040af4e0 2023-10-06T02:20:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.188+0000 7ff003fff700 1 --2- 172.21.15.6:0/1280372308 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fefe4066f30 0x7fefe40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.189+0000 7ff003fff700 1 --2- 172.21.15.6:0/1280372308 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fefe4066f30 0x7fefe40693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7feff4009fd0 tx=0x7feff4009880 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:03.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.192+0000 7ff000ff9700 1 -- 172.21.15.6:0/1280372308 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feffc050cd0 con 0x7ff0040af4e0 2023-10-06T02:20:03.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:03.469+0000 7ff00b205700 1 -- 172.21.15.6:0/1280372308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing"]} v 0) v1 -- 0x7ff0040b0910 con 0x7ff0040af4e0 2023-10-06T02:20:04.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.049+0000 7ff000ff9700 1 -- 172.21.15.6:0/1280372308 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing"]}]=0 v134) v1 ==== 144+0+0 (secure 0 0 0) 0x7feffc017070 con 0x7ff0040af4e0 2023-10-06T02:20:04.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.052+0000 7ff00b205700 1 -- 172.21.15.6:0/1280372308 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fefe4066f30 msgr2=0x7fefe40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:04.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.052+0000 7ff00b205700 1 --2- 172.21.15.6:0/1280372308 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fefe4066f30 0x7fefe40693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7feff4009fd0 tx=0x7feff4009880 comp rx=0 tx=0).stop 2023-10-06T02:20:04.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.052+0000 7ff00b205700 1 -- 172.21.15.6:0/1280372308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040af4e0 msgr2=0x7ff004150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:04.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.052+0000 7ff00b205700 1 --2- 172.21.15.6:0/1280372308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040af4e0 0x7ff004150cd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7feffc00c7e0 tx=0x7feffc007e10 comp rx=0 tx=0).stop 2023-10-06T02:20:04.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.052+0000 7ff00b205700 1 -- 172.21.15.6:0/1280372308 shutdown_connections 2023-10-06T02:20:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.052+0000 7ff00b205700 1 --2- 172.21.15.6:0/1280372308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0040b27f0 0x7ff004156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.052+0000 7ff00b205700 1 --2- 172.21.15.6:0/1280372308 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fefe4066f30 0x7fefe40693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.052+0000 7ff00b205700 1 --2- 172.21.15.6:0/1280372308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040af4e0 0x7ff004150cd0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.052+0000 7ff00b205700 1 --2- 172.21.15.6:0/1280372308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0040af8b0 0x7ff0040c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.052+0000 7ff00b205700 1 -- 172.21.15.6:0/1280372308 >> 172.21.15.6:0/1280372308 conn(0x7ff004068680 msgr2=0x7ff00415c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.052+0000 7ff00b205700 1 -- 172.21.15.6:0/1280372308 shutdown_connections 2023-10-06T02:20:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.052+0000 7ff00b205700 1 -- 172.21.15.6:0/1280372308 wait complete. 2023-10-06T02:20:04.117 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:20:04.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.245+0000 7f17d1fcd700 1 Processor -- start 2023-10-06T02:20:04.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.245+0000 7f17d1fcd700 1 -- start start 2023-10-06T02:20:04.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.246+0000 7f17d1fcd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f17cc086ff0 0x7f17cc087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:04.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.246+0000 7f17d1fcd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17cc0afc50 con 0x7f17cc15a030 2023-10-06T02:20:04.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.246+0000 7f17d1fcd700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17cc0aff30 con 0x7f17cc0b21b0 2023-10-06T02:20:04.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.246+0000 7f17d1fcd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17cc0b0cf0 con 0x7f17cc086ff0 2023-10-06T02:20:04.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.246+0000 7f17cb7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f17cc15a030 0x7f17cc15a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50908/0 (socket says 172.21.15.6:50908) 2023-10-06T02:20:04.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.246+0000 7f17caffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f17cc086ff0 0x7f17cc087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:04.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.246+0000 7f17cb7fe700 1 -- 172.21.15.6:0/2319495961 learned_addr learned my addr 172.21.15.6:0/2319495961 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:04.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.246+0000 7f17caffd700 1 -- 172.21.15.6:0/2319495961 >> v1:172.21.15.175:6789/0 conn(0x7f17cc0b21b0 legacy=0x7f17cc0b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:04.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.246+0000 7f17caffd700 1 -- 172.21.15.6:0/2319495961 >> v1:172.21.15.6:6789/0 conn(0x7f17cc15a030 legacy=0x7f17cc15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:04.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.246+0000 7f17ca7fc700 1 -- 172.21.15.6:0/2319495961 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077621081 0 0) 0x7f17cc0afc50 con 0x7f17cc15a030 2023-10-06T02:20:04.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.246+0000 7f17caffd700 1 -- 172.21.15.6:0/2319495961 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc0b0210 con 0x7f17cc086ff0 2023-10-06T02:20:04.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.247+0000 7f17caffd700 1 --2- 172.21.15.6:0/2319495961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc086ff0 0x7f17cc087470 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f17c00098e0 tx=0x7f17c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9656b39bd4a30a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:04.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.247+0000 7f17ca7fc700 1 -- 172.21.15.6:0/2319495961 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c0009e80 con 0x7f17cc086ff0 2023-10-06T02:20:04.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.247+0000 7f17ca7fc700 1 -- 172.21.15.6:0/2319495961 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c000b860 con 0x7f17cc086ff0 2023-10-06T02:20:04.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.247+0000 7f17ca7fc700 1 -- 172.21.15.6:0/2319495961 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c000bbe0 con 0x7f17cc086ff0 2023-10-06T02:20:04.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.247+0000 7f17d1fcd700 1 -- 172.21.15.6:0/2319495961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc086ff0 msgr2=0x7f17cc087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:04.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.247+0000 7f17d1fcd700 1 --2- 172.21.15.6:0/2319495961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc086ff0 0x7f17cc087470 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f17c00098e0 tx=0x7f17c00091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.247+0000 7f17d1fcd700 1 -- 172.21.15.6:0/2319495961 shutdown_connections 2023-10-06T02:20:04.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.247+0000 7f17d1fcd700 1 --2- 172.21.15.6:0/2319495961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc086ff0 0x7f17cc087470 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.247+0000 7f17d1fcd700 1 -- 172.21.15.6:0/2319495961 >> 172.21.15.6:0/2319495961 conn(0x7f17cc068680 msgr2=0x7f17cc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.247+0000 7f17d1fcd700 1 -- 172.21.15.6:0/2319495961 shutdown_connections 2023-10-06T02:20:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.247+0000 7f17d1fcd700 1 -- 172.21.15.6:0/2319495961 wait complete. 2023-10-06T02:20:04.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.248+0000 7f17d1fcd700 1 Processor -- start 2023-10-06T02:20:04.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.249+0000 7f17d1fcd700 1 -- start start 2023-10-06T02:20:04.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.249+0000 7f17d1fcd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc086ff0 0x7f17cc0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:04.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.249+0000 7f17d1fcd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17cc0b21b0 0x7f17cc0c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:04.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.249+0000 7f17d1fcd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17cc15a030 0x7f17cc156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:04.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.249+0000 7f17d1fcd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0b4060 con 0x7f17cc086ff0 2023-10-06T02:20:04.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.249+0000 7f17d1fcd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0b4900 con 0x7f17cc15a030 2023-10-06T02:20:04.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.249+0000 7f17d1fcd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc15a8c0 con 0x7f17cc0b21b0 2023-10-06T02:20:04.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.249+0000 7f17cb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc086ff0 0x7f17cc0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:04.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.249+0000 7f17cb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc086ff0 0x7f17cc0c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34514/0 (socket says 172.21.15.6:34514) 2023-10-06T02:20:04.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.249+0000 7f17cb7fe700 1 -- 172.21.15.6:0/2716824785 learned_addr learned my addr 172.21.15.6:0/2716824785 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:04.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.250+0000 7f17cb7fe700 1 -- 172.21.15.6:0/2716824785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17cc0b21b0 msgr2=0x7f17cc0c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:04.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.250+0000 7f17cb7fe700 1 --2- 172.21.15.6:0/2716824785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17cc0b21b0 0x7f17cc0c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.250+0000 7f17cb7fe700 1 -- 172.21.15.6:0/2716824785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17cc15a030 msgr2=0x7f17cc156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:04.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.250+0000 7f17cb7fe700 1 --2- 172.21.15.6:0/2716824785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17cc15a030 0x7f17cc156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.250+0000 7f17cb7fe700 1 -- 172.21.15.6:0/2716824785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c0009420 con 0x7f17cc086ff0 2023-10-06T02:20:04.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.250+0000 7f17cb7fe700 1 --2- 172.21.15.6:0/2716824785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc086ff0 0x7f17cc0c7d00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00c810 tx=0x7f17bc007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:04.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.250+0000 7f17b37fe700 1 -- 172.21.15.6:0/2716824785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc005c00 con 0x7f17cc086ff0 2023-10-06T02:20:04.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.250+0000 7f17b37fe700 1 -- 172.21.15.6:0/2716824785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc005d60 con 0x7f17cc086ff0 2023-10-06T02:20:04.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.250+0000 7f17d1fcd700 1 -- 172.21.15.6:0/2716824785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc15d6a0 con 0x7f17cc086ff0 2023-10-06T02:20:04.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.250+0000 7f17b37fe700 1 -- 172.21.15.6:0/2716824785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc007340 con 0x7f17cc086ff0 2023-10-06T02:20:04.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.250+0000 7f17d1fcd700 1 -- 172.21.15.6:0/2716824785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc0b42b0 con 0x7f17cc086ff0 2023-10-06T02:20:04.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.251+0000 7f17d1fcd700 1 -- 172.21.15.6:0/2716824785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17cc088700 con 0x7f17cc086ff0 2023-10-06T02:20:04.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.251+0000 7f17b37fe700 1 -- 172.21.15.6:0/2716824785 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17bc01b400 con 0x7f17cc086ff0 2023-10-06T02:20:04.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.252+0000 7f17b37fe700 1 --2- 172.21.15.6:0/2716824785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f17b8066f30 0x7f17b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:04.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.252+0000 7f17b37fe700 1 -- 172.21.15.6:0/2716824785 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f17bc084010 con 0x7f17cc086ff0 2023-10-06T02:20:04.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.252+0000 7f17caffd700 1 --2- 172.21.15.6:0/2716824785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f17b8066f30 0x7f17b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:04.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.252+0000 7f17caffd700 1 --2- 172.21.15.6:0/2716824785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f17b8066f30 0x7f17b80693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0cf930 tx=0x7f17c0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:04.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.256+0000 7f17b37fe700 1 -- 172.21.15.6:0/2716824785 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17bc051300 con 0x7f17cc086ff0 2023-10-06T02:20:04.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.449+0000 7f17d1fcd700 1 -- 172.21.15.6:0/2716824785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f17cc0aef10 con 0x7f17cc086ff0 2023-10-06T02:20:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.453+0000 7f17b37fe700 1 -- 172.21.15.6:0/2716824785 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f17bc054920 con 0x7f17cc086ff0 2023-10-06T02:20:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.455+0000 7f17d1fcd700 1 -- 172.21.15.6:0/2716824785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f17b8066f30 msgr2=0x7f17b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.455+0000 7f17d1fcd700 1 --2- 172.21.15.6:0/2716824785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f17b8066f30 0x7f17b80693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0cf930 tx=0x7f17c0017000 comp rx=0 tx=0).stop 2023-10-06T02:20:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.455+0000 7f17d1fcd700 1 -- 172.21.15.6:0/2716824785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc086ff0 msgr2=0x7f17cc0c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.455+0000 7f17d1fcd700 1 --2- 172.21.15.6:0/2716824785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc086ff0 0x7f17cc0c7d00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00c810 tx=0x7f17bc007d90 comp rx=0 tx=0).stop 2023-10-06T02:20:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.455+0000 7f17d1fcd700 1 -- 172.21.15.6:0/2716824785 shutdown_connections 2023-10-06T02:20:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.455+0000 7f17d1fcd700 1 --2- 172.21.15.6:0/2716824785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17cc15a030 0x7f17cc156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.455+0000 7f17d1fcd700 1 --2- 172.21.15.6:0/2716824785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f17b8066f30 0x7f17b80693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.455+0000 7f17d1fcd700 1 --2- 172.21.15.6:0/2716824785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc086ff0 0x7f17cc0c7d00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.455+0000 7f17d1fcd700 1 --2- 172.21.15.6:0/2716824785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17cc0b21b0 0x7f17cc0c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.455+0000 7f17d1fcd700 1 -- 172.21.15.6:0/2716824785 >> 172.21.15.6:0/2716824785 conn(0x7f17cc068680 msgr2=0x7f17cc0cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.455+0000 7f17d1fcd700 1 -- 172.21.15.6:0/2716824785 shutdown_connections 2023-10-06T02:20:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.455+0000 7f17d1fcd700 1 -- 172.21.15.6:0/2716824785 wait complete. 2023-10-06T02:20:04.468 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:20:04.468 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:20:04.508 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:20:04.552 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:20:04.552 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:20:04.552 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:20:04.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.671+0000 7f6082d68700 1 Processor -- start 2023-10-06T02:20:04.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.671+0000 7f6082d68700 1 -- start start 2023-10-06T02:20:04.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.671+0000 7f6082d68700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f607c0af4e0 0x7f607c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:04.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.671+0000 7f6082d68700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f607c0af8b0 0x7f607c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:04.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.671+0000 7f6082d68700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607c15e190 con 0x7f607c15d460 2023-10-06T02:20:04.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.671+0000 7f6082d68700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607c0b1910 con 0x7f607c0af8b0 2023-10-06T02:20:04.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.671+0000 7f6082d68700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607c15dfa0 con 0x7f607c0af4e0 2023-10-06T02:20:04.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.672+0000 7f607bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f607c0af8b0 0x7f607c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:04.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.672+0000 7f607bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f607c0af8b0 0x7f607c0b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34522/0 (socket says 172.21.15.6:34522) 2023-10-06T02:20:04.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.672+0000 7f607bfff700 1 -- 172.21.15.6:0/729453076 learned_addr learned my addr 172.21.15.6:0/729453076 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:04.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.672+0000 7f6080b04700 1 --2- 172.21.15.6:0/729453076 >> v2:172.21.15.175:3300/0 conn(0x7f607c0af4e0 0x7f607c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:04.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.672+0000 7f607bfff700 1 -- 172.21.15.6:0/729453076 >> v2:172.21.15.175:3300/0 conn(0x7f607c0af4e0 msgr2=0x7f607c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:04.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.672+0000 7f607bfff700 1 --2- 172.21.15.6:0/729453076 >> v2:172.21.15.175:3300/0 conn(0x7f607c0af4e0 0x7f607c0b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.672+0000 7f607bfff700 1 -- 172.21.15.6:0/729453076 >> v1:172.21.15.175:6789/0 conn(0x7f607c15d460 legacy=0x7f607c15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:04.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.672+0000 7f607bfff700 1 -- 172.21.15.6:0/729453076 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c0cb650 con 0x7f607c0af8b0 2023-10-06T02:20:04.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.672+0000 7f6080b04700 1 --2- 172.21.15.6:0/729453076 >> v2:172.21.15.175:3300/0 conn(0x7f607c0af4e0 0x7f607c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:04.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.672+0000 7f607bfff700 1 --2- 172.21.15.6:0/729453076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607c0af8b0 0x7f607c0b2620 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f607c0d1360 tx=0x7f6070009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e72fa35635e0f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:04.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.672+0000 7f607b7fe700 1 -- 172.21.15.6:0/729453076 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607000b820 con 0x7f607c0af8b0 2023-10-06T02:20:04.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.672+0000 7f607b7fe700 1 -- 172.21.15.6:0/729453076 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607000b980 con 0x7f607c0af8b0 2023-10-06T02:20:04.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.672+0000 7f607b7fe700 1 -- 172.21.15.6:0/729453076 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607000bd20 con 0x7f607c0af8b0 2023-10-06T02:20:04.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.673+0000 7f6082d68700 1 -- 172.21.15.6:0/729453076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607c0af8b0 msgr2=0x7f607c0b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:04.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.673+0000 7f6082d68700 1 --2- 172.21.15.6:0/729453076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607c0af8b0 0x7f607c0b2620 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f607c0d1360 tx=0x7f6070009250 comp rx=0 tx=0).stop 2023-10-06T02:20:04.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.673+0000 7f6082d68700 1 -- 172.21.15.6:0/729453076 shutdown_connections 2023-10-06T02:20:04.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.673+0000 7f6082d68700 1 --2- 172.21.15.6:0/729453076 >> v2:172.21.15.175:3300/0 conn(0x7f607c0af4e0 0x7f607c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.673+0000 7f6082d68700 1 --2- 172.21.15.6:0/729453076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607c0af8b0 0x7f607c0b2620 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.673+0000 7f6082d68700 1 -- 172.21.15.6:0/729453076 >> 172.21.15.6:0/729453076 conn(0x7f607c068680 msgr2=0x7f607c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:04.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.673+0000 7f6082d68700 1 -- 172.21.15.6:0/729453076 shutdown_connections 2023-10-06T02:20:04.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.673+0000 7f6082d68700 1 -- 172.21.15.6:0/729453076 wait complete. 2023-10-06T02:20:04.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.674+0000 7f6082d68700 1 Processor -- start 2023-10-06T02:20:04.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.674+0000 7f6082d68700 1 -- start start 2023-10-06T02:20:04.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f6082d68700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f607c0af4e0 0x7f607c16acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:04.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f6082d68700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607c0af8b0 0x7f607c157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:04.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f6082d68700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f607c15d460 0x7f607c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:04.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f6082d68700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c157e60 con 0x7f607c0af8b0 2023-10-06T02:20:04.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f6082d68700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c16b210 con 0x7f607c15d460 2023-10-06T02:20:04.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f6082d68700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c157990 con 0x7f607c0af4e0 2023-10-06T02:20:04.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f607bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607c0af8b0 0x7f607c157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:04.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f607bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607c0af8b0 0x7f607c157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34536/0 (socket says 172.21.15.6:34536) 2023-10-06T02:20:04.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f607bfff700 1 -- 172.21.15.6:0/3638414700 learned_addr learned my addr 172.21.15.6:0/3638414700 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:04.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f6081305700 1 --2- 172.21.15.6:0/3638414700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f607c15d460 0x7f607c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:04.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f6080b04700 1 --2- 172.21.15.6:0/3638414700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f607c0af4e0 0x7f607c16acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:04.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f607bfff700 1 -- 172.21.15.6:0/3638414700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f607c0af4e0 msgr2=0x7f607c16acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:04.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f607bfff700 1 --2- 172.21.15.6:0/3638414700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f607c0af4e0 0x7f607c16acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f607bfff700 1 -- 172.21.15.6:0/3638414700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f607c15d460 msgr2=0x7f607c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:04.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f607bfff700 1 --2- 172.21.15.6:0/3638414700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f607c15d460 0x7f607c0d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f607bfff700 1 -- 172.21.15.6:0/3638414700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60700094f0 con 0x7f607c0af8b0 2023-10-06T02:20:04.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f6080b04700 1 --2- 172.21.15.6:0/3638414700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f607c0af4e0 0x7f607c16acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:04.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.675+0000 7f607bfff700 1 --2- 172.21.15.6:0/3638414700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607c0af8b0 0x7f607c157450 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f6070009290 tx=0x7f6070016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:04.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.676+0000 7f6078ff9700 1 -- 172.21.15.6:0/3638414700 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070006bc0 con 0x7f607c0af8b0 2023-10-06T02:20:04.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.676+0000 7f6078ff9700 1 -- 172.21.15.6:0/3638414700 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6070020070 con 0x7f607c0af8b0 2023-10-06T02:20:04.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.676+0000 7f6082d68700 1 -- 172.21.15.6:0/3638414700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607c0c8360 con 0x7f607c0af8b0 2023-10-06T02:20:04.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.676+0000 7f6078ff9700 1 -- 172.21.15.6:0/3638414700 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607001b450 con 0x7f607c0af8b0 2023-10-06T02:20:04.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.676+0000 7f6082d68700 1 -- 172.21.15.6:0/3638414700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607c0c7d10 con 0x7f607c0af8b0 2023-10-06T02:20:04.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.677+0000 7f6082d68700 1 -- 172.21.15.6:0/3638414700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607c0c7b70 con 0x7f607c0af8b0 2023-10-06T02:20:04.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.677+0000 7f6078ff9700 1 -- 172.21.15.6:0/3638414700 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6070022030 con 0x7f607c0af8b0 2023-10-06T02:20:04.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.677+0000 7f6078ff9700 1 --2- 172.21.15.6:0/3638414700 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6068066f30 0x7f60680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:04.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.677+0000 7f6078ff9700 1 -- 172.21.15.6:0/3638414700 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f60700864d0 con 0x7f607c0af8b0 2023-10-06T02:20:04.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.678+0000 7f6080b04700 1 --2- 172.21.15.6:0/3638414700 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6068066f30 0x7f60680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:04.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.678+0000 7f6080b04700 1 --2- 172.21.15.6:0/3638414700 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6068066f30 0x7f60680693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f606c006fd0 tx=0x7f606c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:04.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.682+0000 7f6078ff9700 1 -- 172.21.15.6:0/3638414700 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f607c0c7b70 con 0x7f607c0af8b0 2023-10-06T02:20:04.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.921+0000 7f6082d68700 1 -- 172.21.15.6:0/3638414700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f607c0c7b70 con 0x7f607c0af8b0 2023-10-06T02:20:04.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.921+0000 7f6078ff9700 1 -- 172.21.15.6:0/3638414700 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f607c0c7b70 con 0x7f607c0af8b0 2023-10-06T02:20:04.923 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:04.923 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1173605075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1173605075},{"type":"v1","addr":"172.21.15.175:6837","nonce":1173605075}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/375122461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":375122461},{"type":"v1","addr":"172.21.15.175:6835","nonce":375122461}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5142,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3506443204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3506443204},{"type":"v1","addr":"172.21.15.6:6835","nonce":3506443204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5661,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/939702205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":939702205},{"type":"v1","addr":"172.21.15.6:6834","nonce":939702205}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[]} 2023-10-06T02:20:04.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.923+0000 7f6082d68700 1 -- 172.21.15.6:0/3638414700 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6068066f30 msgr2=0x7f60680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:04.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.923+0000 7f6082d68700 1 --2- 172.21.15.6:0/3638414700 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6068066f30 0x7f60680693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f606c006fd0 tx=0x7f606c008040 comp rx=0 tx=0).stop 2023-10-06T02:20:04.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.923+0000 7f6082d68700 1 -- 172.21.15.6:0/3638414700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607c0af8b0 msgr2=0x7f607c157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:04.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.923+0000 7f6082d68700 1 --2- 172.21.15.6:0/3638414700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607c0af8b0 0x7f607c157450 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f6070009290 tx=0x7f6070016000 comp rx=0 tx=0).stop 2023-10-06T02:20:04.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.923+0000 7f6082d68700 1 -- 172.21.15.6:0/3638414700 shutdown_connections 2023-10-06T02:20:04.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.923+0000 7f6082d68700 1 --2- 172.21.15.6:0/3638414700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f607c15d460 0x7f607c0d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.923+0000 7f6082d68700 1 --2- 172.21.15.6:0/3638414700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f607c0af4e0 0x7f607c16acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.923+0000 7f6082d68700 1 --2- 172.21.15.6:0/3638414700 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6068066f30 0x7f60680693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.923+0000 7f6082d68700 1 --2- 172.21.15.6:0/3638414700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607c0af8b0 0x7f607c157450 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:04.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.923+0000 7f6082d68700 1 -- 172.21.15.6:0/3638414700 >> 172.21.15.6:0/3638414700 conn(0x7f607c068680 msgr2=0x7f607c0b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:04.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.923+0000 7f6082d68700 1 -- 172.21.15.6:0/3638414700 shutdown_connections 2023-10-06T02:20:04.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:04.923+0000 7f6082d68700 1 -- 172.21.15.6:0/3638414700 wait complete. 2023-10-06T02:20:04.926 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2023-10-06T02:20:04.937 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:20:04.937 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:20:04.937 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:20:04.937 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:20:04.938 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:20:04.938 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:20:04.938 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:20:04.938 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:20:04.938 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:20:04.938 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:20:04.939 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:20:04.939 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:20:04.939 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:20:04.939 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:20:04.939 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:20:04.939 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:20:04.947 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:20:04.947 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:20:04.948 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:20:04.948 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:20:04.952 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:20:04.952 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:20:04.953 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:20:04.953 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:20:04.989 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:20:04.989 DEBUG:teuthology.parallel:result is None 2023-10-06T02:20:04.990 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:20:04.990 DEBUG:teuthology.parallel:result is None 2023-10-06T02:20:04.994 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:20:04.995 DEBUG:teuthology.parallel:result is None 2023-10-06T02:20:04.995 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:20:04.995 DEBUG:teuthology.parallel:result is None 2023-10-06T02:20:04.996 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:20:05.066 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-06T02:20:05.067 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:20:05.076 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-10-06T02:20:05.076 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-10-06T02:20:05.077 INFO:tasks.ceph.mds.d.smithi175.stderr:2023-10-06T02:20:05.076+0000 7f57097ec700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-06T02:20:05.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.119+0000 7f8a7472b700 1 Processor -- start 2023-10-06T02:20:05.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.119+0000 7f8a7472b700 1 -- start start 2023-10-06T02:20:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.120+0000 7f8a7472b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8a6c0a89c0 0x7f8a6c0aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.120+0000 7f8a7472b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8a6c0a8d90 0x7f8a6c0af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.120+0000 7f8a7472b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6c06b030 con 0x7f8a6c0af570 2023-10-06T02:20:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.120+0000 7f8a7472b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6c0b1ab0 con 0x7f8a6c0a8d90 2023-10-06T02:20:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.120+0000 7f8a7472b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6c06ad50 con 0x7f8a6c0a89c0 2023-10-06T02:20:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.120+0000 7f8a71cc6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8a6c0a8d90 0x7f8a6c0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.120+0000 7f8a71cc6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8a6c0a8d90 0x7f8a6c0af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34564/0 (socket says 172.21.15.6:34564) 2023-10-06T02:20:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.120+0000 7f8a71cc6700 1 -- 172.21.15.6:0/864124670 learned_addr learned my addr 172.21.15.6:0/864124670 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.120+0000 7f8a724c7700 1 --2- 172.21.15.6:0/864124670 >> v2:172.21.15.175:3300/0 conn(0x7f8a6c0a89c0 0x7f8a6c0aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.121+0000 7f8a71cc6700 1 -- 172.21.15.6:0/864124670 >> v2:172.21.15.175:3300/0 conn(0x7f8a6c0a89c0 msgr2=0x7f8a6c0aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.121+0000 7f8a71cc6700 1 --2- 172.21.15.6:0/864124670 >> v2:172.21.15.175:3300/0 conn(0x7f8a6c0a89c0 0x7f8a6c0aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.121+0000 7f8a71cc6700 1 -- 172.21.15.6:0/864124670 >> v1:172.21.15.175:6789/0 conn(0x7f8a6c0af570 legacy=0x7f8a6c0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.121+0000 7f8a71cc6700 1 -- 172.21.15.6:0/864124670 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c0b1d30 con 0x7f8a6c0a8d90 2023-10-06T02:20:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.121+0000 7f8a71cc6700 1 --2- 172.21.15.6:0/864124670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a6c0a8d90 0x7f8a6c0af030 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c06fc10 tx=0x7f8a60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ef4a947855efdc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.121+0000 7f8a714c5700 1 -- 172.21.15.6:0/864124670 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a60009e70 con 0x7f8a6c0a8d90 2023-10-06T02:20:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.121+0000 7f8a714c5700 1 -- 172.21.15.6:0/864124670 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6000b860 con 0x7f8a6c0a8d90 2023-10-06T02:20:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.121+0000 7f8a714c5700 1 -- 172.21.15.6:0/864124670 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6000bc00 con 0x7f8a6c0a8d90 2023-10-06T02:20:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.121+0000 7f8a7472b700 1 -- 172.21.15.6:0/864124670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a6c0a8d90 msgr2=0x7f8a6c0af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.121+0000 7f8a7472b700 1 --2- 172.21.15.6:0/864124670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a6c0a8d90 0x7f8a6c0af030 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c06fc10 tx=0x7f8a60009250 comp rx=0 tx=0).stop 2023-10-06T02:20:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.122+0000 7f8a7472b700 1 -- 172.21.15.6:0/864124670 shutdown_connections 2023-10-06T02:20:05.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.122+0000 7f8a7472b700 1 --2- 172.21.15.6:0/864124670 >> v2:172.21.15.175:3300/0 conn(0x7f8a6c0a89c0 0x7f8a6c0aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:05.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.122+0000 7f8a7472b700 1 --2- 172.21.15.6:0/864124670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a6c0a8d90 0x7f8a6c0af030 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:05.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.122+0000 7f8a7472b700 1 -- 172.21.15.6:0/864124670 >> 172.21.15.6:0/864124670 conn(0x7f8a6c067910 msgr2=0x7f8a6c0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:05.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.122+0000 7f8a7472b700 1 -- 172.21.15.6:0/864124670 shutdown_connections 2023-10-06T02:20:05.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.122+0000 7f8a7472b700 1 -- 172.21.15.6:0/864124670 wait complete. 2023-10-06T02:20:05.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.123+0000 7f8a7472b700 1 Processor -- start 2023-10-06T02:20:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.123+0000 7f8a7472b700 1 -- start start 2023-10-06T02:20:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.123+0000 7f8a7472b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a6c0a89c0 0x7f8a6c099b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.123+0000 7f8a7472b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a6c0a8d90 0x7f8a6c09b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.123+0000 7f8a7472b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a6c0af570 0x7f8a6c1555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.123+0000 7f8a7472b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c16a690 con 0x7f8a6c0a8d90 2023-10-06T02:20:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.123+0000 7f8a7472b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c09a100 con 0x7f8a6c0af570 2023-10-06T02:20:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.123+0000 7f8a7472b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c09a3e0 con 0x7f8a6c0a89c0 2023-10-06T02:20:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.124+0000 7f8a71cc6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a6c0a8d90 0x7f8a6c09b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.124+0000 7f8a71cc6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a6c0a8d90 0x7f8a6c09b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34580/0 (socket says 172.21.15.6:34580) 2023-10-06T02:20:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.124+0000 7f8a71cc6700 1 -- 172.21.15.6:0/292000971 learned_addr learned my addr 172.21.15.6:0/292000971 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.124+0000 7f8a724c7700 1 --2- 172.21.15.6:0/292000971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a6c0a89c0 0x7f8a6c099b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.124+0000 7f8a72cc8700 1 --2- 172.21.15.6:0/292000971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a6c0af570 0x7f8a6c1555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.124+0000 7f8a71cc6700 1 -- 172.21.15.6:0/292000971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a6c0a89c0 msgr2=0x7f8a6c099b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.124+0000 7f8a71cc6700 1 --2- 172.21.15.6:0/292000971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a6c0a89c0 0x7f8a6c099b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.124+0000 7f8a71cc6700 1 -- 172.21.15.6:0/292000971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a6c0af570 msgr2=0x7f8a6c1555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.124+0000 7f8a71cc6700 1 --2- 172.21.15.6:0/292000971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a6c0af570 0x7f8a6c1555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.124+0000 7f8a71cc6700 1 -- 172.21.15.6:0/292000971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a600094f0 con 0x7f8a6c0a8d90 2023-10-06T02:20:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.124+0000 7f8a71cc6700 1 --2- 172.21.15.6:0/292000971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a6c0a8d90 0x7f8a6c09b710 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c06f2f0 tx=0x7f8a60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.124+0000 7f8a6a7fc700 1 -- 172.21.15.6:0/292000971 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6000bbe0 con 0x7f8a6c0a8d90 2023-10-06T02:20:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.124+0000 7f8a6a7fc700 1 -- 172.21.15.6:0/292000971 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a60011420 con 0x7f8a6c0a8d90 2023-10-06T02:20:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.124+0000 7f8a7472b700 1 -- 172.21.15.6:0/292000971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6c09a6c0 con 0x7f8a6c0a8d90 2023-10-06T02:20:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.124+0000 7f8a6a7fc700 1 -- 172.21.15.6:0/292000971 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a600117c0 con 0x7f8a6c0a8d90 2023-10-06T02:20:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.124+0000 7f8a7472b700 1 -- 172.21.15.6:0/292000971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6c09bc50 con 0x7f8a6c0a8d90 2023-10-06T02:20:05.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.125+0000 7f8a7472b700 1 -- 172.21.15.6:0/292000971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6c087150 con 0x7f8a6c0a8d90 2023-10-06T02:20:05.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.126+0000 7f8a6a7fc700 1 -- 172.21.15.6:0/292000971 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a60011bf0 con 0x7f8a6c0a8d90 2023-10-06T02:20:05.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.126+0000 7f8a6a7fc700 1 --2- 172.21.15.6:0/292000971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a58066f30 0x7f8a580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:05.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.126+0000 7f8a6a7fc700 1 -- 172.21.15.6:0/292000971 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f8a60085a00 con 0x7f8a6c0a8d90 2023-10-06T02:20:05.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.126+0000 7f8a724c7700 1 --2- 172.21.15.6:0/292000971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a58066f30 0x7f8a580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:05.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.127+0000 7f8a724c7700 1 --2- 172.21.15.6:0/292000971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a58066f30 0x7f8a580693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c00f5b0 tx=0x7f8a5c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:05.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.131+0000 7f8a6a7fc700 1 -- 172.21.15.6:0/292000971 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a60052c70 con 0x7f8a6c0a8d90 2023-10-06T02:20:05.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:05.339+0000 7f8a7472b700 1 -- 172.21.15.6:0/292000971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8a6c06e5d0 con 0x7f8a6c0a8d90 2023-10-06T02:20:06.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.476+0000 7f8a6a7fc700 1 -- 172.21.15.6:0/292000971 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v50) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8a60056290 con 0x7f8a6c0a8d90 2023-10-06T02:20:06.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.479+0000 7f8a7472b700 1 -- 172.21.15.6:0/292000971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a58066f30 msgr2=0x7f8a580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:06.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.479+0000 7f8a7472b700 1 --2- 172.21.15.6:0/292000971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a58066f30 0x7f8a580693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c00f5b0 tx=0x7f8a5c00b040 comp rx=0 tx=0).stop 2023-10-06T02:20:06.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.479+0000 7f8a7472b700 1 -- 172.21.15.6:0/292000971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a6c0a8d90 msgr2=0x7f8a6c09b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:06.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.479+0000 7f8a7472b700 1 --2- 172.21.15.6:0/292000971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a6c0a8d90 0x7f8a6c09b710 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c06f2f0 tx=0x7f8a60017000 comp rx=0 tx=0).stop 2023-10-06T02:20:06.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.479+0000 7f8a7472b700 1 -- 172.21.15.6:0/292000971 shutdown_connections 2023-10-06T02:20:06.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.479+0000 7f8a7472b700 1 --2- 172.21.15.6:0/292000971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a6c0af570 0x7f8a6c1555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:06.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.479+0000 7f8a7472b700 1 --2- 172.21.15.6:0/292000971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a6c0a89c0 0x7f8a6c099b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:06.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.479+0000 7f8a7472b700 1 --2- 172.21.15.6:0/292000971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a58066f30 0x7f8a580693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:06.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.479+0000 7f8a7472b700 1 --2- 172.21.15.6:0/292000971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a6c0a8d90 0x7f8a6c09b710 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:06.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.479+0000 7f8a7472b700 1 -- 172.21.15.6:0/292000971 >> 172.21.15.6:0/292000971 conn(0x7f8a6c067910 msgr2=0x7f8a6c159460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:06.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.479+0000 7f8a7472b700 1 -- 172.21.15.6:0/292000971 shutdown_connections 2023-10-06T02:20:06.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.479+0000 7f8a7472b700 1 -- 172.21.15.6:0/292000971 wait complete. 2023-10-06T02:20:06.482 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-10-06T02:20:06.495 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:20:06.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.620+0000 7fd47d720700 1 Processor -- start 2023-10-06T02:20:06.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.620+0000 7fd47d720700 1 -- start start 2023-10-06T02:20:06.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.620+0000 7fd47d720700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4780af4e0 0x7fd4780b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:06.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.620+0000 7fd47d720700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd4780af8b0 0x7fd4780b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:06.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.620+0000 7fd47d720700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd47815d460 0x7fd47815d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:06.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.620+0000 7fd47d720700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4780b1910 con 0x7fd4780af4e0 2023-10-06T02:20:06.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.620+0000 7fd47d720700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47815e190 con 0x7fd4780af8b0 2023-10-06T02:20:06.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.620+0000 7fd47d720700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4780cb650 con 0x7fd47815d460 2023-10-06T02:20:06.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.621+0000 7fd476ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4780af4e0 0x7fd4780b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:06.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.621+0000 7fd476ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4780af4e0 0x7fd4780b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34582/0 (socket says 172.21.15.6:34582) 2023-10-06T02:20:06.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.621+0000 7fd476ffd700 1 -- 172.21.15.6:0/2543020784 learned_addr learned my addr 172.21.15.6:0/2543020784 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:06.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.621+0000 7fd476ffd700 1 -- 172.21.15.6:0/2543020784 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd47815d460 msgr2=0x7fd47815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:06.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.621+0000 7fd4767fc700 1 --2- 172.21.15.6:0/2543020784 >> v2:172.21.15.175:3300/0 conn(0x7fd4780af8b0 0x7fd4780b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:06.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.621+0000 7fd476ffd700 1 --2- 172.21.15.6:0/2543020784 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd47815d460 0x7fd47815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:06.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.621+0000 7fd476ffd700 1 -- 172.21.15.6:0/2543020784 >> v2:172.21.15.175:3300/0 conn(0x7fd4780af8b0 msgr2=0x7fd4780b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:06.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.621+0000 7fd476ffd700 1 --2- 172.21.15.6:0/2543020784 >> v2:172.21.15.175:3300/0 conn(0x7fd4780af8b0 0x7fd4780b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:06.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.621+0000 7fd476ffd700 1 -- 172.21.15.6:0/2543020784 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4780b2b60 con 0x7fd4780af4e0 2023-10-06T02:20:06.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.621+0000 7fd476ffd700 1 --2- 172.21.15.6:0/2543020784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4780af4e0 0x7fd4780b20e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd4780cdd50 tx=0x7fd468009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7c384520b59e94 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:06.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.621+0000 7fd475ffb700 1 -- 172.21.15.6:0/2543020784 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46800b860 con 0x7fd4780af4e0 2023-10-06T02:20:06.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.621+0000 7fd475ffb700 1 -- 172.21.15.6:0/2543020784 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46800b9c0 con 0x7fd4780af4e0 2023-10-06T02:20:06.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.621+0000 7fd475ffb700 1 -- 172.21.15.6:0/2543020784 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46800bd60 con 0x7fd4780af4e0 2023-10-06T02:20:06.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.622+0000 7fd47d720700 1 -- 172.21.15.6:0/2543020784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4780af4e0 msgr2=0x7fd4780b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:06.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.622+0000 7fd47d720700 1 --2- 172.21.15.6:0/2543020784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4780af4e0 0x7fd4780b20e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd4780cdd50 tx=0x7fd468009250 comp rx=0 tx=0).stop 2023-10-06T02:20:06.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.622+0000 7fd47d720700 1 -- 172.21.15.6:0/2543020784 shutdown_connections 2023-10-06T02:20:06.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.622+0000 7fd47d720700 1 --2- 172.21.15.6:0/2543020784 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd47815d460 0x7fd47815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:06.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.622+0000 7fd47d720700 1 --2- 172.21.15.6:0/2543020784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4780af4e0 0x7fd4780b20e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:06.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.622+0000 7fd47d720700 1 --2- 172.21.15.6:0/2543020784 >> v2:172.21.15.175:3300/0 conn(0x7fd4780af8b0 0x7fd4780b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:06.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.622+0000 7fd47d720700 1 -- 172.21.15.6:0/2543020784 >> 172.21.15.6:0/2543020784 conn(0x7fd478068680 msgr2=0x7fd478068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:06.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.622+0000 7fd47d720700 1 -- 172.21.15.6:0/2543020784 shutdown_connections 2023-10-06T02:20:06.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.622+0000 7fd47d720700 1 -- 172.21.15.6:0/2543020784 wait complete. 2023-10-06T02:20:06.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.623+0000 7fd47d720700 1 Processor -- start 2023-10-06T02:20:06.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.623+0000 7fd47d720700 1 -- start start 2023-10-06T02:20:06.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd47d720700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4780af4e0 0x7fd478152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:06.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd47d720700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4780af8b0 0x7fd4780ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:06.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd47d720700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd47815d460 0x7fd47816d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:06.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd47d720700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4780c6b00 con 0x7fd4780af8b0 2023-10-06T02:20:06.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd47d720700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4780cfca0 con 0x7fd4780af4e0 2023-10-06T02:20:06.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd47d720700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4780cf090 con 0x7fd47815d460 2023-10-06T02:20:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd4767fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4780af8b0 0x7fd4780ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd4767fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4780af8b0 0x7fd4780ce790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34598/0 (socket says 172.21.15.6:34598) 2023-10-06T02:20:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd4767fc700 1 -- 172.21.15.6:0/3288500677 learned_addr learned my addr 172.21.15.6:0/3288500677 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd476ffd700 1 --2- 172.21.15.6:0/3288500677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4780af4e0 0x7fd478152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd4777fe700 1 --2- 172.21.15.6:0/3288500677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd47815d460 0x7fd47816d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd4767fc700 1 -- 172.21.15.6:0/3288500677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd47815d460 msgr2=0x7fd47816d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd4767fc700 1 --2- 172.21.15.6:0/3288500677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd47815d460 0x7fd47816d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd4767fc700 1 -- 172.21.15.6:0/3288500677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4780af4e0 msgr2=0x7fd478152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd4767fc700 1 --2- 172.21.15.6:0/3288500677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4780af4e0 0x7fd478152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd4767fc700 1 -- 172.21.15.6:0/3288500677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4680094f0 con 0x7fd4780af8b0 2023-10-06T02:20:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd476ffd700 1 --2- 172.21.15.6:0/3288500677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4780af4e0 0x7fd478152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.624+0000 7fd4777fe700 1 --2- 172.21.15.6:0/3288500677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd47815d460 0x7fd47816d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.625+0000 7fd4767fc700 1 --2- 172.21.15.6:0/3288500677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4780af8b0 0x7fd4780ce790 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00c880 tx=0x7fd46c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:06.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.625+0000 7fd45effd700 1 -- 172.21.15.6:0/3288500677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c011600 con 0x7fd4780af8b0 2023-10-06T02:20:06.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.625+0000 7fd45effd700 1 -- 172.21.15.6:0/3288500677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c011760 con 0x7fd4780af8b0 2023-10-06T02:20:06.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.625+0000 7fd47d720700 1 -- 172.21.15.6:0/3288500677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4780cf370 con 0x7fd4780af8b0 2023-10-06T02:20:06.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.625+0000 7fd45effd700 1 -- 172.21.15.6:0/3288500677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c011b00 con 0x7fd4780af8b0 2023-10-06T02:20:06.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.625+0000 7fd47d720700 1 -- 172.21.15.6:0/3288500677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4780cf930 con 0x7fd4780af8b0 2023-10-06T02:20:06.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.626+0000 7fd47d720700 1 -- 172.21.15.6:0/3288500677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd478152b00 con 0x7fd4780af8b0 2023-10-06T02:20:06.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.626+0000 7fd45effd700 1 -- 172.21.15.6:0/3288500677 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd46c0193f0 con 0x7fd4780af8b0 2023-10-06T02:20:06.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.627+0000 7fd45effd700 1 --2- 172.21.15.6:0/3288500677 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd464066f30 0x7fd4640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:06.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.627+0000 7fd45effd700 1 -- 172.21.15.6:0/3288500677 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fd46c084960 con 0x7fd4780af8b0 2023-10-06T02:20:06.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.627+0000 7fd476ffd700 1 --2- 172.21.15.6:0/3288500677 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd464066f30 0x7fd4640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:06.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.627+0000 7fd476ffd700 1 --2- 172.21.15.6:0/3288500677 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd464066f30 0x7fd4640693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd4780cdd50 tx=0x7fd468017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:06.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.631+0000 7fd45effd700 1 -- 172.21.15.6:0/3288500677 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd46c051be0 con 0x7fd4780af8b0 2023-10-06T02:20:06.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.904+0000 7fd47d720700 1 -- 172.21.15.6:0/3288500677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd478088af0 con 0x7fd4780af8b0 2023-10-06T02:20:06.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.904+0000 7fd45effd700 1 -- 172.21.15.6:0/3288500677 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd46c055200 con 0x7fd4780af8b0 2023-10-06T02:20:06.906 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:06.906 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:20:06.906 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-10-06T02:20:06.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.906 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-10-06T02:20:06.906 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9l3UdFFRAAahVHXJW+fzPcTwa/MxOW7A==", 2023-10-06T02:20:06.906 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.907 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:20:06.907 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:20:06.907 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:20:06.907 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:06.907 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.907 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-10-06T02:20:06.907 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lcq7HIBAA/3Gaa7gNbUHq176zcCFgjA==", 2023-10-06T02:20:06.907 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.907 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:20:06.907 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:20:06.907 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:20:06.908 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:06.908 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.908 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-10-06T02:20:06.908 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9ls7FDHBAA746JdAc0gr6+qLK9tuWCZg==", 2023-10-06T02:20:06.908 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.908 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:20:06.908 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:20:06.908 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:20:06.908 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:06.908 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.909 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-10-06T02:20:06.909 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9llEyZJxAAKXcHXIywnLQVZlbOGKdTTg==", 2023-10-06T02:20:06.909 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.909 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:20:06.909 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:20:06.909 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:20:06.909 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:06.909 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.909 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-10-06T02:20:06.910 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAXbh9lLVWHERAAoYIaMicUCppJKlSwl1K8UQ==", 2023-10-06T02:20:06.910 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.910 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:20:06.910 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:20:06.910 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:06.910 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.910 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-10-06T02:20:06.910 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAabh9lgpbHDxAAXOwtusarMKccKIu9+SmmHg==", 2023-10-06T02:20:06.910 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.910 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:20:06.910 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:20:06.911 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:06.911 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.911 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-10-06T02:20:06.911 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAdbh9lG/ZcFBAA3WpHCcm2R2+IyFMK460CYw==", 2023-10-06T02:20:06.911 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.911 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:20:06.911 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:20:06.911 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:06.911 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.913 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-10-06T02:20:06.913 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAgbh9lz8J4ExAAggyFHpD2wvM/b+WKLvVneA==", 2023-10-06T02:20:06.913 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.913 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:20:06.913 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:20:06.913 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:06.913 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.914 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-10-06T02:20:06.914 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAmbh9lpSX1ERAA1vkI0SvrJb6mAciDTIGZtA==", 2023-10-06T02:20:06.914 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.914 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:20:06.914 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:20:06.914 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:06.914 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.914 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-10-06T02:20:06.915 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQApbh9ljSxwDxAACjsHigTRkZIY+lHrr9/17g==", 2023-10-06T02:20:06.915 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.915 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:20:06.915 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:20:06.915 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:06.915 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.915 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-10-06T02:20:06.915 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAsbh9l6vlZDxAAfff29OvnP+8zxQFDDt8SFA==", 2023-10-06T02:20:06.915 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.915 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:20:06.915 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:20:06.916 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:06.916 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.916 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-10-06T02:20:06.916 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAvbh9lz+1sDBAANCvbv4nJUuaVde42koP8fA==", 2023-10-06T02:20:06.916 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.916 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:20:06.916 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:20:06.916 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:06.916 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.917 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-10-06T02:20:06.917 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lO6GJKxAASfNnkG3FXno1BWm5XiqIMA==", 2023-10-06T02:20:06.917 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.917 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:20:06.917 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-10-06T02:20:06.917 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:20:06.917 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.917 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-10-06T02:20:06.917 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lpRgFNBAAYE7yue5MPAzdm5k3EOcvcg==", 2023-10-06T02:20:06.917 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.918 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:20:06.918 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:20:06.918 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:20:06.918 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:20:06.918 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.918 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-10-06T02:20:06.918 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9l1hsHMRAANI0CeqE+ZB7uQ9ZB4cF/Ig==", 2023-10-06T02:20:06.918 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.918 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:20:06.918 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:20:06.919 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:20:06.919 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:20:06.919 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.919 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-10-06T02:20:06.919 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lAV9fORAAXCO4NdIb62PH2IX0y1siCw==", 2023-10-06T02:20:06.919 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.919 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:20:06.919 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:20:06.919 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:20:06.919 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:20:06.919 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.920 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-10-06T02:20:06.920 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQASbh9lIiB6NBAAvHP4z7yHub2TXCgRAAFy5A==", 2023-10-06T02:20:06.920 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.920 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:20:06.920 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:20:06.920 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:20:06.920 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:06.920 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.920 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-10-06T02:20:06.921 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lMk4mEhAAbIAiSwyo+ygZRqxKBKRxuQ==", 2023-10-06T02:20:06.921 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.921 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:20:06.921 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-06T02:20:06.921 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:06.921 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:06.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:06.921 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-10-06T02:20:06.921 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lxXZSDRAALw3s8FP+gOrz+VIDN7tkuw==", 2023-10-06T02:20:06.921 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:06.921 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:20:06.921 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-06T02:20:06.922 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:06.922 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.922 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:06.922 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-06T02:20:06.922 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:20:06.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.907+0000 7fd47d720700 1 -- 172.21.15.6:0/3288500677 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd464066f30 msgr2=0x7fd4640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:06.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.907+0000 7fd47d720700 1 --2- 172.21.15.6:0/3288500677 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd464066f30 0x7fd4640693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd4780cdd50 tx=0x7fd468017000 comp rx=0 tx=0).stop 2023-10-06T02:20:06.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.907+0000 7fd47d720700 1 -- 172.21.15.6:0/3288500677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4780af8b0 msgr2=0x7fd4780ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:06.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.907+0000 7fd47d720700 1 --2- 172.21.15.6:0/3288500677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4780af8b0 0x7fd4780ce790 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00c880 tx=0x7fd46c008040 comp rx=0 tx=0).stop 2023-10-06T02:20:06.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.907+0000 7fd47d720700 1 -- 172.21.15.6:0/3288500677 shutdown_connections 2023-10-06T02:20:06.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.907+0000 7fd47d720700 1 --2- 172.21.15.6:0/3288500677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd47815d460 0x7fd47816d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:06.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.907+0000 7fd47d720700 1 --2- 172.21.15.6:0/3288500677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4780af4e0 0x7fd478152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:06.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.907+0000 7fd47d720700 1 --2- 172.21.15.6:0/3288500677 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd464066f30 0x7fd4640693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:06.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.907+0000 7fd47d720700 1 --2- 172.21.15.6:0/3288500677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4780af8b0 0x7fd4780ce790 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:06.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.907+0000 7fd47d720700 1 -- 172.21.15.6:0/3288500677 >> 172.21.15.6:0/3288500677 conn(0x7fd478068680 msgr2=0x7fd4780afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:06.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.907+0000 7fd47d720700 1 -- 172.21.15.6:0/3288500677 shutdown_connections 2023-10-06T02:20:06.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:06.907+0000 7fd47d720700 1 -- 172.21.15.6:0/3288500677 wait complete. 2023-10-06T02:20:06.925 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:20:07.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.043+0000 7fd696153700 1 Processor -- start 2023-10-06T02:20:07.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.043+0000 7fd696153700 1 -- start start 2023-10-06T02:20:07.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.044+0000 7fd696153700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6900af8b0 0x7fd69015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.044+0000 7fd696153700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd69015e190 con 0x7fd6900b27f0 2023-10-06T02:20:07.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.044+0000 7fd696153700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6900cb650 con 0x7fd6900af4e0 2023-10-06T02:20:07.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.044+0000 7fd696153700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6900b1910 con 0x7fd6900af8b0 2023-10-06T02:20:07.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.044+0000 7fd68ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd6900b27f0 0x7fd69015d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50936/0 (socket says 172.21.15.6:50936) 2023-10-06T02:20:07.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.044+0000 7fd68ffff700 1 -- 172.21.15.6:0/3689565701 learned_addr learned my addr 172.21.15.6:0/3689565701 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:07.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68effd700 1 --2- 172.21.15.6:0/3689565701 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6900af8b0 0x7fd69015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68e7fc700 1 -- 172.21.15.6:0/3689565701 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663081136 0 0) 0x7fd69015e190 con 0x7fd6900b27f0 2023-10-06T02:20:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68e7fc700 1 -- 172.21.15.6:0/3689565701 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd678003570 con 0x7fd6900b27f0 2023-10-06T02:20:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68e7fc700 1 -- 172.21.15.6:0/3689565701 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2228916617 0 0) 0x7fd678003570 con 0x7fd6900b27f0 2023-10-06T02:20:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68e7fc700 1 -- 172.21.15.6:0/3689565701 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6900af8b0 msgr2=0x7fd69015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68e7fc700 1 --2- 172.21.15.6:0/3689565701 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6900af8b0 0x7fd69015d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68e7fc700 1 -- 172.21.15.6:0/3689565701 >> v1:172.21.15.175:6789/0 conn(0x7fd6900af4e0 legacy=0x7fd6900b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68e7fc700 1 -- 172.21.15.6:0/3689565701 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6900ccaf0 con 0x7fd6900b27f0 2023-10-06T02:20:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68e7fc700 1 -- 172.21.15.6:0/3689565701 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fd6880017f0 con 0x7fd6900b27f0 2023-10-06T02:20:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68e7fc700 1 -- 172.21.15.6:0/3689565701 >> v1:172.21.15.6:6789/0 conn(0x7fd6900b27f0 legacy=0x7fd69015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68e7fc700 1 --2- 172.21.15.6:0/3689565701 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6900af8b0 0x7fd678003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68e7fc700 1 --2- 172.21.15.6:0/3689565701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd678003fd0 0x7fd678004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68e7fc700 1 --2- 172.21.15.6:0/3689565701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678004d50 0x7fd6780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68e7fc700 1 -- 172.21.15.6:0/3689565701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6900b1910 con 0x7fd678004d50 2023-10-06T02:20:07.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68e7fc700 1 -- 172.21.15.6:0/3689565701 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67800bb40 con 0x7fd678003fd0 2023-10-06T02:20:07.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68e7fc700 1 -- 172.21.15.6:0/3689565701 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67800bd00 con 0x7fd6900af8b0 2023-10-06T02:20:07.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68ffff700 1 --2- 172.21.15.6:0/3689565701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678004d50 0x7fd6780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68effd700 1 --2- 172.21.15.6:0/3689565701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd678003fd0 0x7fd678004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68f7fe700 1 --2- 172.21.15.6:0/3689565701 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6900af8b0 0x7fd678003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68ffff700 1 -- 172.21.15.6:0/3689565701 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6900af8b0 msgr2=0x7fd678003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:07.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68ffff700 1 --2- 172.21.15.6:0/3689565701 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6900af8b0 0x7fd678003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68ffff700 1 -- 172.21.15.6:0/3689565701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd678003fd0 msgr2=0x7fd678004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:07.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68ffff700 1 --2- 172.21.15.6:0/3689565701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd678003fd0 0x7fd678004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68ffff700 1 -- 172.21.15.6:0/3689565701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd678003570 con 0x7fd678004d50 2023-10-06T02:20:07.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68effd700 1 --2- 172.21.15.6:0/3689565701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd678003fd0 0x7fd678004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:07.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.045+0000 7fd68f7fe700 1 --2- 172.21.15.6:0/3689565701 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6900af8b0 0x7fd678003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:07.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.046+0000 7fd68ffff700 1 --2- 172.21.15.6:0/3689565701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678004d50 0x7fd6780051c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd68800a8c0 tx=0x7fd6900cb5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc2a0189e2f705b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:07.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.046+0000 7fd68e7fc700 1 -- 172.21.15.6:0/3689565701 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6880070f0 con 0x7fd678004d50 2023-10-06T02:20:07.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.046+0000 7fd68e7fc700 1 -- 172.21.15.6:0/3689565701 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd688007270 con 0x7fd678004d50 2023-10-06T02:20:07.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.046+0000 7fd68e7fc700 1 -- 172.21.15.6:0/3689565701 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688007630 con 0x7fd678004d50 2023-10-06T02:20:07.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.046+0000 7fd696153700 1 -- 172.21.15.6:0/3689565701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678004d50 msgr2=0x7fd6780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.046+0000 7fd696153700 1 --2- 172.21.15.6:0/3689565701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678004d50 0x7fd6780051c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd68800a8c0 tx=0x7fd6900cb5c0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.046+0000 7fd68ffff700 1 -- 172.21.15.6:0/3689565701 reap_dead start 2023-10-06T02:20:07.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.046+0000 7fd696153700 1 -- 172.21.15.6:0/3689565701 shutdown_connections 2023-10-06T02:20:07.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.046+0000 7fd696153700 1 -- 172.21.15.6:0/3689565701 >> 172.21.15.6:0/3689565701 conn(0x7fd690068680 msgr2=0x7fd690068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:07.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.046+0000 7fd696153700 1 -- 172.21.15.6:0/3689565701 shutdown_connections 2023-10-06T02:20:07.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.046+0000 7fd696153700 1 -- 172.21.15.6:0/3689565701 wait complete. 2023-10-06T02:20:07.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.048+0000 7fd696153700 1 Processor -- start 2023-10-06T02:20:07.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.048+0000 7fd696153700 1 -- start start 2023-10-06T02:20:07.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.048+0000 7fd696153700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678004d50 0x7fd6900c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.048+0000 7fd696153700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6900d0a70 0x7fd690155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.048+0000 7fd696153700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6900d0ee0 0x7fd690156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.048+0000 7fd696153700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6900c8640 con 0x7fd678004d50 2023-10-06T02:20:07.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.048+0000 7fd696153700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6900c8920 con 0x7fd6900d0ee0 2023-10-06T02:20:07.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.048+0000 7fd696153700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6900c8c00 con 0x7fd6900d0a70 2023-10-06T02:20:07.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.048+0000 7fd68f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678004d50 0x7fd6900c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.048+0000 7fd68f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678004d50 0x7fd6900c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34618/0 (socket says 172.21.15.6:34618) 2023-10-06T02:20:07.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.048+0000 7fd68f7fe700 1 -- 172.21.15.6:0/4192296295 learned_addr learned my addr 172.21.15.6:0/4192296295 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:07.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.049+0000 7fd68effd700 1 --2- 172.21.15.6:0/4192296295 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6900d0a70 0x7fd690155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.049+0000 7fd68ffff700 1 --2- 172.21.15.6:0/4192296295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6900d0ee0 0x7fd690156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.049+0000 7fd68f7fe700 1 -- 172.21.15.6:0/4192296295 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6900d0a70 msgr2=0x7fd690155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.049+0000 7fd68f7fe700 1 --2- 172.21.15.6:0/4192296295 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6900d0a70 0x7fd690155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.049+0000 7fd68f7fe700 1 -- 172.21.15.6:0/4192296295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6900d0ee0 msgr2=0x7fd690156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.049+0000 7fd68f7fe700 1 --2- 172.21.15.6:0/4192296295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6900d0ee0 0x7fd690156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.049+0000 7fd68f7fe700 1 -- 172.21.15.6:0/4192296295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6900c8ee0 con 0x7fd678004d50 2023-10-06T02:20:07.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.049+0000 7fd68ffff700 1 --2- 172.21.15.6:0/4192296295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6900d0ee0 0x7fd690156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:07.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.049+0000 7fd68f7fe700 1 --2- 172.21.15.6:0/4192296295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678004d50 0x7fd6900c96e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd68000e800 tx=0x7fd680009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:07.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.049+0000 7fd6777fe700 1 -- 172.21.15.6:0/4192296295 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680012500 con 0x7fd678004d50 2023-10-06T02:20:07.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.049+0000 7fd6777fe700 1 -- 172.21.15.6:0/4192296295 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd680010040 con 0x7fd678004d50 2023-10-06T02:20:07.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.049+0000 7fd6777fe700 1 -- 172.21.15.6:0/4192296295 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6800128b0 con 0x7fd678004d50 2023-10-06T02:20:07.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.049+0000 7fd696153700 1 -- 172.21.15.6:0/4192296295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6900c91c0 con 0x7fd678004d50 2023-10-06T02:20:07.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.049+0000 7fd696153700 1 -- 172.21.15.6:0/4192296295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6900c9c20 con 0x7fd678004d50 2023-10-06T02:20:07.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.050+0000 7fd696153700 1 -- 172.21.15.6:0/4192296295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd690088aa0 con 0x7fd678004d50 2023-10-06T02:20:07.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.050+0000 7fd6777fe700 1 -- 172.21.15.6:0/4192296295 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd680012c20 con 0x7fd678004d50 2023-10-06T02:20:07.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.051+0000 7fd6777fe700 1 --2- 172.21.15.6:0/4192296295 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd67c066f30 0x7fd67c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.051+0000 7fd6777fe700 1 -- 172.21.15.6:0/4192296295 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fd680083f70 con 0x7fd678004d50 2023-10-06T02:20:07.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.051+0000 7fd68effd700 1 --2- 172.21.15.6:0/4192296295 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd67c066f30 0x7fd67c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.051+0000 7fd68effd700 1 --2- 172.21.15.6:0/4192296295 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd67c066f30 0x7fd67c0693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd69015a220 tx=0x7fd684008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:07.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.055+0000 7fd6777fe700 1 -- 172.21.15.6:0/4192296295 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd680051290 con 0x7fd678004d50 2023-10-06T02:20:07.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.248+0000 7fd696153700 1 -- 172.21.15.6:0/4192296295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6900cad20 con 0x7fd678004d50 2023-10-06T02:20:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.249+0000 7fd6777fe700 1 -- 172.21.15.6:0/4192296295 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+13807 (secure 0 0 0) 0x7fd680012ed0 con 0x7fd678004d50 2023-10-06T02:20:07.250 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:07.251 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":50,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:20:06.473966+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:20:07.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.251+0000 7fd696153700 1 -- 172.21.15.6:0/4192296295 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd67c066f30 msgr2=0x7fd67c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.251+0000 7fd696153700 1 --2- 172.21.15.6:0/4192296295 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd67c066f30 0x7fd67c0693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd69015a220 tx=0x7fd684008040 comp rx=0 tx=0).stop 2023-10-06T02:20:07.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.251+0000 7fd696153700 1 -- 172.21.15.6:0/4192296295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678004d50 msgr2=0x7fd6900c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.251+0000 7fd696153700 1 --2- 172.21.15.6:0/4192296295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678004d50 0x7fd6900c96e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd68000e800 tx=0x7fd680009040 comp rx=0 tx=0).stop 2023-10-06T02:20:07.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.251+0000 7fd696153700 1 -- 172.21.15.6:0/4192296295 shutdown_connections 2023-10-06T02:20:07.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.251+0000 7fd696153700 1 --2- 172.21.15.6:0/4192296295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6900d0ee0 0x7fd690156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.251+0000 7fd696153700 1 --2- 172.21.15.6:0/4192296295 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd67c066f30 0x7fd67c0693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.251+0000 7fd696153700 1 --2- 172.21.15.6:0/4192296295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678004d50 0x7fd6900c96e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.251+0000 7fd696153700 1 --2- 172.21.15.6:0/4192296295 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6900d0a70 0x7fd690155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.251+0000 7fd696153700 1 -- 172.21.15.6:0/4192296295 >> 172.21.15.6:0/4192296295 conn(0x7fd690068680 msgr2=0x7fd69015c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:07.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.251+0000 7fd696153700 1 -- 172.21.15.6:0/4192296295 shutdown_connections 2023-10-06T02:20:07.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.251+0000 7fd696153700 1 -- 172.21.15.6:0/4192296295 wait complete. 2023-10-06T02:20:07.265 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T02:20:07.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:20:07.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.386+0000 7f9ee95cd700 1 Processor -- start 2023-10-06T02:20:07.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.386+0000 7f9ee95cd700 1 -- start start 2023-10-06T02:20:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.386+0000 7f9ee95cd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ee4155fc0 0x7f9ee40a6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.386+0000 7f9ee95cd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee4156390 0x7f9ee40a7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.386+0000 7f9ee95cd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ee40a79b0 0x7f9ee40b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.386+0000 7f9ee95cd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee40b1500 con 0x7f9ee40a79b0 2023-10-06T02:20:07.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.386+0000 7f9ee95cd700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee40ae010 con 0x7f9ee4155fc0 2023-10-06T02:20:07.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.386+0000 7f9ee95cd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40ad400 con 0x7f9ee4156390 2023-10-06T02:20:07.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.386+0000 7f9ee8dcc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ee40a79b0 0x7f9ee40b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.387+0000 7f9ee8dcc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ee40a79b0 0x7f9ee40b01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34630/0 (socket says 172.21.15.6:34630) 2023-10-06T02:20:07.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.387+0000 7f9ee8dcc700 1 -- 172.21.15.6:0/1085009165 learned_addr learned my addr 172.21.15.6:0/1085009165 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:07.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.387+0000 7f9ee37fe700 1 --2- 172.21.15.6:0/1085009165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee4156390 0x7f9ee40a7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.387+0000 7f9ee3fff700 1 --2- 172.21.15.6:0/1085009165 >> v2:172.21.15.175:3300/0 conn(0x7f9ee4155fc0 0x7f9ee40a6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.387+0000 7f9ee8dcc700 1 -- 172.21.15.6:0/1085009165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee4156390 msgr2=0x7f9ee40a7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.387+0000 7f9ee8dcc700 1 --2- 172.21.15.6:0/1085009165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee4156390 0x7f9ee40a7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.387+0000 7f9ee8dcc700 1 -- 172.21.15.6:0/1085009165 >> v2:172.21.15.175:3300/0 conn(0x7f9ee4155fc0 msgr2=0x7f9ee40a6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.387+0000 7f9ee8dcc700 1 --2- 172.21.15.6:0/1085009165 >> v2:172.21.15.175:3300/0 conn(0x7f9ee4155fc0 0x7f9ee40a6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.387+0000 7f9ee8dcc700 1 -- 172.21.15.6:0/1085009165 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee40ad6e0 con 0x7f9ee40a79b0 2023-10-06T02:20:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.387+0000 7f9ee37fe700 1 --2- 172.21.15.6:0/1085009165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee4156390 0x7f9ee40a7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.387+0000 7f9ee3fff700 1 --2- 172.21.15.6:0/1085009165 >> v2:172.21.15.175:3300/0 conn(0x7f9ee4155fc0 0x7f9ee40a6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.387+0000 7f9ee8dcc700 1 --2- 172.21.15.6:0/1085009165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee40a79b0 0x7f9ee40b01e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9ee406df40 tx=0x7f9edc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888f2e14bdfa270b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.387+0000 7f9ee2ffd700 1 -- 172.21.15.6:0/1085009165 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00e070 con 0x7f9ee40a79b0 2023-10-06T02:20:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.387+0000 7f9ee2ffd700 1 -- 172.21.15.6:0/1085009165 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc00ba50 con 0x7f9ee40a79b0 2023-10-06T02:20:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.387+0000 7f9ee2ffd700 1 -- 172.21.15.6:0/1085009165 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0092e0 con 0x7f9ee40a79b0 2023-10-06T02:20:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.388+0000 7f9ee95cd700 1 -- 172.21.15.6:0/1085009165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee40a79b0 msgr2=0x7f9ee40b01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.388+0000 7f9ee95cd700 1 --2- 172.21.15.6:0/1085009165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee40a79b0 0x7f9ee40b01e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9ee406df40 tx=0x7f9edc009840 comp rx=0 tx=0).stop 2023-10-06T02:20:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.388+0000 7f9ee95cd700 1 -- 172.21.15.6:0/1085009165 shutdown_connections 2023-10-06T02:20:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.388+0000 7f9ee95cd700 1 --2- 172.21.15.6:0/1085009165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee40a79b0 0x7f9ee40b01e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.388+0000 7f9ee95cd700 1 --2- 172.21.15.6:0/1085009165 >> v2:172.21.15.175:3300/0 conn(0x7f9ee4155fc0 0x7f9ee40a6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.388+0000 7f9ee95cd700 1 --2- 172.21.15.6:0/1085009165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee4156390 0x7f9ee40a7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.388+0000 7f9ee95cd700 1 -- 172.21.15.6:0/1085009165 >> 172.21.15.6:0/1085009165 conn(0x7f9ee4096200 msgr2=0x7f9ee4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.388+0000 7f9ee95cd700 1 -- 172.21.15.6:0/1085009165 shutdown_connections 2023-10-06T02:20:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.388+0000 7f9ee95cd700 1 -- 172.21.15.6:0/1085009165 wait complete. 2023-10-06T02:20:07.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.389+0000 7f9ee95cd700 1 Processor -- start 2023-10-06T02:20:07.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.389+0000 7f9ee95cd700 1 -- start start 2023-10-06T02:20:07.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.390+0000 7f9ee95cd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee40a79b0 0x7f9ee40ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.390+0000 7f9ee95cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee4155fc0 0x7f9ee4098e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.390+0000 7f9ee95cd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee4156390 0x7f9ee40a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.390+0000 7f9ee95cd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40989e0 con 0x7f9ee4155fc0 2023-10-06T02:20:07.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.390+0000 7f9ee95cd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee4097dd0 con 0x7f9ee4156390 2023-10-06T02:20:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.390+0000 7f9ee95cd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40980b0 con 0x7f9ee40a79b0 2023-10-06T02:20:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.390+0000 7f9ee37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee4155fc0 0x7f9ee4098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.390+0000 7f9ee37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee4155fc0 0x7f9ee4098e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34634/0 (socket says 172.21.15.6:34634) 2023-10-06T02:20:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.390+0000 7f9ee37fe700 1 -- 172.21.15.6:0/2514181592 learned_addr learned my addr 172.21.15.6:0/2514181592 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.390+0000 7f9ee8dcc700 1 --2- 172.21.15.6:0/2514181592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee4156390 0x7f9ee40a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.390+0000 7f9ee3fff700 1 --2- 172.21.15.6:0/2514181592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee40a79b0 0x7f9ee40ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.390+0000 7f9ee37fe700 1 -- 172.21.15.6:0/2514181592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee40a79b0 msgr2=0x7f9ee40ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.390+0000 7f9ee37fe700 1 --2- 172.21.15.6:0/2514181592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee40a79b0 0x7f9ee40ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.390+0000 7f9ee37fe700 1 -- 172.21.15.6:0/2514181592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee4156390 msgr2=0x7f9ee40a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.390+0000 7f9ee37fe700 1 --2- 172.21.15.6:0/2514181592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee4156390 0x7f9ee40a98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.390+0000 7f9ee37fe700 1 -- 172.21.15.6:0/2514181592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc009ae0 con 0x7f9ee4155fc0 2023-10-06T02:20:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.390+0000 7f9ee8dcc700 1 --2- 172.21.15.6:0/2514181592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee4156390 0x7f9ee40a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.391+0000 7f9ee37fe700 1 --2- 172.21.15.6:0/2514181592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee4155fc0 0x7f9ee4098e70 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800d860 tx=0x7f9ed8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.391+0000 7f9ecbfff700 1 -- 172.21.15.6:0/2514181592 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8009610 con 0x7f9ee4155fc0 2023-10-06T02:20:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.391+0000 7f9ecbfff700 1 -- 172.21.15.6:0/2514181592 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed8009770 con 0x7f9ee4155fc0 2023-10-06T02:20:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.391+0000 7f9ee95cd700 1 -- 172.21.15.6:0/2514181592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee4098390 con 0x7f9ee4155fc0 2023-10-06T02:20:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.391+0000 7f9ecbfff700 1 -- 172.21.15.6:0/2514181592 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8009b10 con 0x7f9ee4155fc0 2023-10-06T02:20:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.391+0000 7f9ee95cd700 1 -- 172.21.15.6:0/2514181592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee40abde0 con 0x7f9ee4155fc0 2023-10-06T02:20:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.392+0000 7f9ee95cd700 1 -- 172.21.15.6:0/2514181592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee4064aa0 con 0x7f9ee4155fc0 2023-10-06T02:20:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.392+0000 7f9ecbfff700 1 -- 172.21.15.6:0/2514181592 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ed8014430 con 0x7f9ee4155fc0 2023-10-06T02:20:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.392+0000 7f9ecbfff700 1 --2- 172.21.15.6:0/2514181592 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ed0066f30 0x7f9ed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.392+0000 7f9ecbfff700 1 -- 172.21.15.6:0/2514181592 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f9ed80848b0 con 0x7f9ee4155fc0 2023-10-06T02:20:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.393+0000 7f9ee3fff700 1 --2- 172.21.15.6:0/2514181592 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ed0066f30 0x7f9ed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.393+0000 7f9ee3fff700 1 --2- 172.21.15.6:0/2514181592 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ed0066f30 0x7f9ed00693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4006f00 tx=0x7f9ed4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:07.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.397+0000 7f9ecbfff700 1 -- 172.21.15.6:0/2514181592 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ed8051bd0 con 0x7f9ee4155fc0 2023-10-06T02:20:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.588+0000 7f9ee95cd700 1 -- 172.21.15.6:0/2514181592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9ee4098b20 con 0x7f9ee4155fc0 2023-10-06T02:20:07.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.589+0000 7f9ecbfff700 1 -- 172.21.15.6:0/2514181592 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9ed80551f0 con 0x7f9ee4155fc0 2023-10-06T02:20:07.590 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:20:07.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.590+0000 7f9ee95cd700 1 -- 172.21.15.6:0/2514181592 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ed0066f30 msgr2=0x7f9ed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.590+0000 7f9ee95cd700 1 --2- 172.21.15.6:0/2514181592 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ed0066f30 0x7f9ed00693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4006f00 tx=0x7f9ed4008040 comp rx=0 tx=0).stop 2023-10-06T02:20:07.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.590+0000 7f9ee95cd700 1 -- 172.21.15.6:0/2514181592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee4155fc0 msgr2=0x7f9ee4098e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.590+0000 7f9ee95cd700 1 --2- 172.21.15.6:0/2514181592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee4155fc0 0x7f9ee4098e70 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800d860 tx=0x7f9ed8008040 comp rx=0 tx=0).stop 2023-10-06T02:20:07.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.590+0000 7f9ee95cd700 1 -- 172.21.15.6:0/2514181592 shutdown_connections 2023-10-06T02:20:07.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.590+0000 7f9ee95cd700 1 --2- 172.21.15.6:0/2514181592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee4156390 0x7f9ee40a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.590+0000 7f9ee95cd700 1 --2- 172.21.15.6:0/2514181592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee40a79b0 0x7f9ee40ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.590+0000 7f9ee95cd700 1 --2- 172.21.15.6:0/2514181592 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ed0066f30 0x7f9ed00693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.590+0000 7f9ee95cd700 1 --2- 172.21.15.6:0/2514181592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee4155fc0 0x7f9ee4098e70 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.590+0000 7f9ee95cd700 1 -- 172.21.15.6:0/2514181592 >> 172.21.15.6:0/2514181592 conn(0x7f9ee4096200 msgr2=0x7f9ee40ac6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:07.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.591+0000 7f9ee95cd700 1 -- 172.21.15.6:0/2514181592 shutdown_connections 2023-10-06T02:20:07.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.591+0000 7f9ee95cd700 1 -- 172.21.15.6:0/2514181592 wait complete. 2023-10-06T02:20:07.604 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:20:07.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.726+0000 7f66434d2700 1 Processor -- start 2023-10-06T02:20:07.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.726+0000 7f66434d2700 1 -- start start 2023-10-06T02:20:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.727+0000 7f66434d2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c0afc10 0x7f663c0af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.727+0000 7f66434d2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c0ada50 con 0x7f663c068680 2023-10-06T02:20:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.727+0000 7f66434d2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c0b01f0 con 0x7f663c1592b0 2023-10-06T02:20:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.727+0000 7f66434d2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0b2cc0 con 0x7f663c0afc10 2023-10-06T02:20:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.727+0000 7f6642cd1700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f663c068680 0x7f663c0adee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50938/0 (socket says 172.21.15.6:50938) 2023-10-06T02:20:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.727+0000 7f6642cd1700 1 -- 172.21.15.6:0/3272939839 learned_addr learned my addr 172.21.15.6:0/3272939839 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.727+0000 7f6641ccf700 1 --2- 172.21.15.6:0/3272939839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c0afc10 0x7f663c0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.727+0000 7f66414ce700 1 -- 172.21.15.6:0/3272939839 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917080653 0 0) 0x7f663c0ada50 con 0x7f663c068680 2023-10-06T02:20:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.727+0000 7f66414ce700 1 -- 172.21.15.6:0/3272939839 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6624003570 con 0x7f663c068680 2023-10-06T02:20:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f66414ce700 1 -- 172.21.15.6:0/3272939839 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1581056792 0 0) 0x7f6624003570 con 0x7f663c068680 2023-10-06T02:20:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f66414ce700 1 -- 172.21.15.6:0/3272939839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c0afc10 msgr2=0x7f663c0af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f66414ce700 1 --2- 172.21.15.6:0/3272939839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c0afc10 0x7f663c0af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f66414ce700 1 -- 172.21.15.6:0/3272939839 >> v1:172.21.15.175:6789/0 conn(0x7f663c1592b0 legacy=0x7f663c159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f66414ce700 1 -- 172.21.15.6:0/3272939839 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c0ad400 con 0x7f663c068680 2023-10-06T02:20:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f66414ce700 1 -- 172.21.15.6:0/3272939839 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f662c0017f0 con 0x7f663c068680 2023-10-06T02:20:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f66414ce700 1 -- 172.21.15.6:0/3272939839 >> v1:172.21.15.6:6789/0 conn(0x7f663c068680 legacy=0x7f663c0adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f66414ce700 1 --2- 172.21.15.6:0/3272939839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c0afc10 0x7f6624003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f66414ce700 1 --2- 172.21.15.6:0/3272939839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6624004010 0x7f6624004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f66414ce700 1 --2- 172.21.15.6:0/3272939839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6624004d50 0x7f66240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f66414ce700 1 -- 172.21.15.6:0/3272939839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0b2cc0 con 0x7f6624004d50 2023-10-06T02:20:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f66414ce700 1 -- 172.21.15.6:0/3272939839 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662400bbf0 con 0x7f6624004010 2023-10-06T02:20:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f66414ce700 1 -- 172.21.15.6:0/3272939839 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662400bdb0 con 0x7f663c0afc10 2023-10-06T02:20:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f6642cd1700 1 --2- 172.21.15.6:0/3272939839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6624004d50 0x7f66240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f6641ccf700 1 --2- 172.21.15.6:0/3272939839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6624004010 0x7f6624004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f66424d0700 1 --2- 172.21.15.6:0/3272939839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c0afc10 0x7f6624003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f6642cd1700 1 -- 172.21.15.6:0/3272939839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c0afc10 msgr2=0x7f6624003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f6642cd1700 1 --2- 172.21.15.6:0/3272939839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c0afc10 0x7f6624003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f6642cd1700 1 -- 172.21.15.6:0/3272939839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6624004010 msgr2=0x7f6624004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f6642cd1700 1 --2- 172.21.15.6:0/3272939839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6624004010 0x7f6624004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f6642cd1700 1 -- 172.21.15.6:0/3272939839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6624003570 con 0x7f6624004d50 2023-10-06T02:20:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f6642cd1700 1 --2- 172.21.15.6:0/3272939839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6624004d50 0x7f66240051c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f662c00a900 tx=0x7f662c0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5daf5719d249c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f66414ce700 1 -- 172.21.15.6:0/3272939839 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0070d0 con 0x7f6624004d50 2023-10-06T02:20:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f66414ce700 1 -- 172.21.15.6:0/3272939839 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c007230 con 0x7f6624004d50 2023-10-06T02:20:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.728+0000 7f66414ce700 1 -- 172.21.15.6:0/3272939839 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0075f0 con 0x7f6624004d50 2023-10-06T02:20:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.729+0000 7f66434d2700 1 -- 172.21.15.6:0/3272939839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6624004d50 msgr2=0x7f66240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.729+0000 7f66434d2700 1 --2- 172.21.15.6:0/3272939839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6624004d50 0x7f66240051c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f662c00a900 tx=0x7f662c0021d0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.729+0000 7f6642cd1700 1 -- 172.21.15.6:0/3272939839 reap_dead start 2023-10-06T02:20:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.729+0000 7f66434d2700 1 -- 172.21.15.6:0/3272939839 shutdown_connections 2023-10-06T02:20:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.729+0000 7f66434d2700 1 -- 172.21.15.6:0/3272939839 >> 172.21.15.6:0/3272939839 conn(0x7f663c096200 msgr2=0x7f663c069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.729+0000 7f66434d2700 1 -- 172.21.15.6:0/3272939839 shutdown_connections 2023-10-06T02:20:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.729+0000 7f66434d2700 1 -- 172.21.15.6:0/3272939839 wait complete. 2023-10-06T02:20:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.730+0000 7f66434d2700 1 Processor -- start 2023-10-06T02:20:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.730+0000 7f66434d2700 1 -- start start 2023-10-06T02:20:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f66434d2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6624004d50 0x7f663c097e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f66434d2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f663c097600 0x7f663c154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f66434d2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c151f20 0x7f663c15f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f66434d2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c155fa0 con 0x7f663c097600 2023-10-06T02:20:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f66434d2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c155110 con 0x7f6624004d50 2023-10-06T02:20:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f66434d2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c155390 con 0x7f663c151f20 2023-10-06T02:20:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f6641ccf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f663c097600 0x7f663c154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f6641ccf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f663c097600 0x7f663c154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34648/0 (socket says 172.21.15.6:34648) 2023-10-06T02:20:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f6641ccf700 1 -- 172.21.15.6:0/1036955478 learned_addr learned my addr 172.21.15.6:0/1036955478 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f66424d0700 1 --2- 172.21.15.6:0/1036955478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6624004d50 0x7f663c097e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f6642cd1700 1 --2- 172.21.15.6:0/1036955478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c151f20 0x7f663c15f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f6641ccf700 1 -- 172.21.15.6:0/1036955478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c151f20 msgr2=0x7f663c15f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f6641ccf700 1 --2- 172.21.15.6:0/1036955478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c151f20 0x7f663c15f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f6641ccf700 1 -- 172.21.15.6:0/1036955478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6624004d50 msgr2=0x7f663c097e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f6641ccf700 1 --2- 172.21.15.6:0/1036955478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6624004d50 0x7f663c097e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f6641ccf700 1 -- 172.21.15.6:0/1036955478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c155670 con 0x7f663c097600 2023-10-06T02:20:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f6642cd1700 1 --2- 172.21.15.6:0/1036955478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c151f20 0x7f663c15f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f6641ccf700 1 --2- 172.21.15.6:0/1036955478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f663c097600 0x7f663c154bd0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6630011b10 tx=0x7f66300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f663a7fc700 1 -- 172.21.15.6:0/1036955478 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663000f9f0 con 0x7f663c097600 2023-10-06T02:20:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f663a7fc700 1 -- 172.21.15.6:0/1036955478 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663000fb50 con 0x7f663c097600 2023-10-06T02:20:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f663a7fc700 1 -- 172.21.15.6:0/1036955478 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663000fed0 con 0x7f663c097600 2023-10-06T02:20:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f66434d2700 1 -- 172.21.15.6:0/1036955478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c155950 con 0x7f663c097600 2023-10-06T02:20:07.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f66434d2700 1 -- 172.21.15.6:0/1036955478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c097a70 con 0x7f663c097600 2023-10-06T02:20:07.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.732+0000 7f66434d2700 1 -- 172.21.15.6:0/1036955478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663c156110 con 0x7f663c097600 2023-10-06T02:20:07.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.733+0000 7f663a7fc700 1 -- 172.21.15.6:0/1036955478 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6630014650 con 0x7f663c097600 2023-10-06T02:20:07.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.733+0000 7f663a7fc700 1 --2- 172.21.15.6:0/1036955478 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6628066f30 0x7f66280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:07.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.734+0000 7f663a7fc700 1 -- 172.21.15.6:0/1036955478 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f6630018030 con 0x7f663c097600 2023-10-06T02:20:07.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.734+0000 7f66424d0700 1 --2- 172.21.15.6:0/1036955478 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6628066f30 0x7f66280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:07.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.734+0000 7f66424d0700 1 --2- 172.21.15.6:0/1036955478 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6628066f30 0x7f66280693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6634003b00 tx=0x7f6634009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:07.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.738+0000 7f663a7fc700 1 -- 172.21.15.6:0/1036955478 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6630052260 con 0x7f663c097600 2023-10-06T02:20:07.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.932+0000 7f66434d2700 1 -- 172.21.15.6:0/1036955478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f663c064aa0 con 0x7f663c097600 2023-10-06T02:20:07.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.932+0000 7f663a7fc700 1 -- 172.21.15.6:0/1036955478 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66300220a0 con 0x7f663c097600 2023-10-06T02:20:07.934 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:20:07.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.934+0000 7f66434d2700 1 -- 172.21.15.6:0/1036955478 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6628066f30 msgr2=0x7f66280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.934+0000 7f66434d2700 1 --2- 172.21.15.6:0/1036955478 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6628066f30 0x7f66280693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6634003b00 tx=0x7f6634009040 comp rx=0 tx=0).stop 2023-10-06T02:20:07.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.934+0000 7f66434d2700 1 -- 172.21.15.6:0/1036955478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f663c097600 msgr2=0x7f663c154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:07.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.934+0000 7f66434d2700 1 --2- 172.21.15.6:0/1036955478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f663c097600 0x7f663c154bd0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6630011b10 tx=0x7f66300091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.934+0000 7f66434d2700 1 -- 172.21.15.6:0/1036955478 shutdown_connections 2023-10-06T02:20:07.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.934+0000 7f66434d2700 1 --2- 172.21.15.6:0/1036955478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c151f20 0x7f663c15f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.934+0000 7f66434d2700 1 --2- 172.21.15.6:0/1036955478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6624004d50 0x7f663c097e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.935+0000 7f66434d2700 1 --2- 172.21.15.6:0/1036955478 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6628066f30 0x7f66280693e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.935+0000 7f66434d2700 1 --2- 172.21.15.6:0/1036955478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f663c097600 0x7f663c154bd0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:07.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.935+0000 7f66434d2700 1 -- 172.21.15.6:0/1036955478 >> 172.21.15.6:0/1036955478 conn(0x7f663c096200 msgr2=0x7f663c158250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:07.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.935+0000 7f66434d2700 1 -- 172.21.15.6:0/1036955478 shutdown_connections 2023-10-06T02:20:07.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:07.935+0000 7f66434d2700 1 -- 172.21.15.6:0/1036955478 wait complete. 2023-10-06T02:20:07.948 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:20:08.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.067+0000 7f29aefbc700 1 Processor -- start 2023-10-06T02:20:08.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.067+0000 7f29aefbc700 1 -- start start 2023-10-06T02:20:08.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.067+0000 7f29aefbc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f29a80ac150 0x7f29a8157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:08.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.067+0000 7f29aefbc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f29a80c1de0 0x7f29a8068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:08.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.067+0000 7f29aefbc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a80c3220 con 0x7f29a80abd80 2023-10-06T02:20:08.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.067+0000 7f29aefbc700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a8159dd0 con 0x7f29a80ac150 2023-10-06T02:20:08.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.067+0000 7f29aefbc700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a80ccfd0 con 0x7f29a80c1de0 2023-10-06T02:20:08.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.067+0000 7f29a7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f29a80ac150 0x7f29a8157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:08.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.068+0000 7f29acd58700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f29a80abd80 0x7f29a815a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50948/0 (socket says 172.21.15.6:50948) 2023-10-06T02:20:08.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.068+0000 7f29acd58700 1 -- 172.21.15.6:0/2279190783 learned_addr learned my addr 172.21.15.6:0/2279190783 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:08.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.068+0000 7f29ad559700 1 --2- 172.21.15.6:0/2279190783 >> v2:172.21.15.175:3300/0 conn(0x7f29a80c1de0 0x7f29a8068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:08.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.068+0000 7f29a77fe700 1 -- 172.21.15.6:0/2279190783 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930454304 0 0) 0x7f29a80c3220 con 0x7f29a80abd80 2023-10-06T02:20:08.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.068+0000 7f29a77fe700 1 -- 172.21.15.6:0/2279190783 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2994003570 con 0x7f29a80abd80 2023-10-06T02:20:08.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.068+0000 7f29a7fff700 1 -- 172.21.15.6:0/2279190783 >> v2:172.21.15.175:3300/0 conn(0x7f29a80c1de0 msgr2=0x7f29a8068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:08.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.068+0000 7f29a7fff700 1 --2- 172.21.15.6:0/2279190783 >> v2:172.21.15.175:3300/0 conn(0x7f29a80c1de0 0x7f29a8068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:08.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.068+0000 7f29a7fff700 1 -- 172.21.15.6:0/2279190783 >> v1:172.21.15.6:6789/0 conn(0x7f29a80abd80 legacy=0x7f29a815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:08.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.068+0000 7f29a7fff700 1 -- 172.21.15.6:0/2279190783 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a80c2330 con 0x7f29a80ac150 2023-10-06T02:20:08.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.068+0000 7f29a7fff700 1 --2- 172.21.15.6:0/2279190783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a80ac150 0x7f29a8157bb0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f29a80c7610 tx=0x7f2998009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229321eac8e3740c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:08.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.068+0000 7f29a77fe700 1 -- 172.21.15.6:0/2279190783 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299800e070 con 0x7f29a80ac150 2023-10-06T02:20:08.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.068+0000 7f29a77fe700 1 -- 172.21.15.6:0/2279190783 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299800bb60 con 0x7f29a80ac150 2023-10-06T02:20:08.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.068+0000 7f29a77fe700 1 -- 172.21.15.6:0/2279190783 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998012430 con 0x7f29a80ac150 2023-10-06T02:20:08.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.069+0000 7f29aefbc700 1 -- 172.21.15.6:0/2279190783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a80ac150 msgr2=0x7f29a8157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:08.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.069+0000 7f29aefbc700 1 --2- 172.21.15.6:0/2279190783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a80ac150 0x7f29a8157bb0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f29a80c7610 tx=0x7f2998009780 comp rx=0 tx=0).stop 2023-10-06T02:20:08.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.069+0000 7f29aefbc700 1 -- 172.21.15.6:0/2279190783 shutdown_connections 2023-10-06T02:20:08.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.069+0000 7f29aefbc700 1 --2- 172.21.15.6:0/2279190783 >> v2:172.21.15.175:3300/0 conn(0x7f29a80c1de0 0x7f29a8068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:08.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.069+0000 7f29aefbc700 1 --2- 172.21.15.6:0/2279190783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a80ac150 0x7f29a8157bb0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:08.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.069+0000 7f29aefbc700 1 -- 172.21.15.6:0/2279190783 >> 172.21.15.6:0/2279190783 conn(0x7f29a8069790 msgr2=0x7f29a8069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:08.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.069+0000 7f29aefbc700 1 -- 172.21.15.6:0/2279190783 shutdown_connections 2023-10-06T02:20:08.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.069+0000 7f29aefbc700 1 -- 172.21.15.6:0/2279190783 wait complete. 2023-10-06T02:20:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.070+0000 7f29aefbc700 1 Processor -- start 2023-10-06T02:20:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.070+0000 7f29aefbc700 1 -- start start 2023-10-06T02:20:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29aefbc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a80abd80 0x7f29a80ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29aefbc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29a80ac150 0x7f29a80ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29aefbc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29a80c1de0 0x7f29a80ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29aefbc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a80a8de0 con 0x7f29a80abd80 2023-10-06T02:20:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29aefbc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a80b14a0 con 0x7f29a80ac150 2023-10-06T02:20:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29aefbc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a80b1780 con 0x7f29a80c1de0 2023-10-06T02:20:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29acd58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a80abd80 0x7f29a80ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29acd58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a80abd80 0x7f29a80ac670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34672/0 (socket says 172.21.15.6:34672) 2023-10-06T02:20:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29acd58700 1 -- 172.21.15.6:0/287224329 learned_addr learned my addr 172.21.15.6:0/287224329 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29ad559700 1 --2- 172.21.15.6:0/287224329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29a80c1de0 0x7f29a80ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29acd58700 1 -- 172.21.15.6:0/287224329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29a80c1de0 msgr2=0x7f29a80ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29a7fff700 1 --2- 172.21.15.6:0/287224329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29a80ac150 0x7f29a80ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29acd58700 1 --2- 172.21.15.6:0/287224329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29a80c1de0 0x7f29a80ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29acd58700 1 -- 172.21.15.6:0/287224329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29a80ac150 msgr2=0x7f29a80ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29acd58700 1 --2- 172.21.15.6:0/287224329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29a80ac150 0x7f29a80ae170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29acd58700 1 -- 172.21.15.6:0/287224329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2998009a20 con 0x7f29a80abd80 2023-10-06T02:20:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29acd58700 1 --2- 172.21.15.6:0/287224329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a80abd80 0x7f29a80ac670 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f299000c7c0 tx=0x7f2990007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.071+0000 7f29a4ff9700 1 -- 172.21.15.6:0/287224329 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990005b30 con 0x7f29a80abd80 2023-10-06T02:20:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.072+0000 7f29a4ff9700 1 -- 172.21.15.6:0/287224329 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2990005c90 con 0x7f29a80abd80 2023-10-06T02:20:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.072+0000 7f29aefbc700 1 -- 172.21.15.6:0/287224329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a80b1a60 con 0x7f29a80abd80 2023-10-06T02:20:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.072+0000 7f29a4ff9700 1 -- 172.21.15.6:0/287224329 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990007340 con 0x7f29a80abd80 2023-10-06T02:20:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.072+0000 7f29aefbc700 1 -- 172.21.15.6:0/287224329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a80acbb0 con 0x7f29a80abd80 2023-10-06T02:20:08.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.072+0000 7f29aefbc700 1 -- 172.21.15.6:0/287224329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a804bb80 con 0x7f29a80abd80 2023-10-06T02:20:08.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.073+0000 7f29a4ff9700 1 -- 172.21.15.6:0/287224329 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f299001b400 con 0x7f29a80abd80 2023-10-06T02:20:08.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.073+0000 7f29a4ff9700 1 --2- 172.21.15.6:0/287224329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2988066f30 0x7f29880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:08.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.073+0000 7f29a4ff9700 1 -- 172.21.15.6:0/287224329 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f2990083f50 con 0x7f29a80abd80 2023-10-06T02:20:08.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.073+0000 7f29a7fff700 1 --2- 172.21.15.6:0/287224329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2988066f30 0x7f29880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:08.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.074+0000 7f29a7fff700 1 --2- 172.21.15.6:0/287224329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2988066f30 0x7f29880693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f29980099f0 tx=0x7f2998019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:08.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.077+0000 7f29a4ff9700 1 -- 172.21.15.6:0/287224329 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29900512f0 con 0x7f29a80abd80 2023-10-06T02:20:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.274+0000 7f29aefbc700 1 -- 172.21.15.6:0/287224329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f29a80691c0 con 0x7f29a80abd80 2023-10-06T02:20:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.274+0000 7f29a4ff9700 1 -- 172.21.15.6:0/287224329 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) v1 ==== 84+0+126 (secure 0 0 0) 0x7f2990054910 con 0x7f29a80abd80 2023-10-06T02:20:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:08.276 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-06T02:20:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-06T02:20:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-10-06T02:20:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-10-06T02:20:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-06T02:20:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:08.277 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-06T02:20:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.276+0000 7f29aefbc700 1 -- 172.21.15.6:0/287224329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2988066f30 msgr2=0x7f29880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.276+0000 7f29aefbc700 1 --2- 172.21.15.6:0/287224329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2988066f30 0x7f29880693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f29980099f0 tx=0x7f2998019000 comp rx=0 tx=0).stop 2023-10-06T02:20:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.276+0000 7f29aefbc700 1 -- 172.21.15.6:0/287224329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a80abd80 msgr2=0x7f29a80ac670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.276+0000 7f29aefbc700 1 --2- 172.21.15.6:0/287224329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a80abd80 0x7f29a80ac670 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f299000c7c0 tx=0x7f2990007e00 comp rx=0 tx=0).stop 2023-10-06T02:20:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.276+0000 7f29aefbc700 1 -- 172.21.15.6:0/287224329 shutdown_connections 2023-10-06T02:20:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.276+0000 7f29aefbc700 1 --2- 172.21.15.6:0/287224329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29a80c1de0 0x7f29a80ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.276+0000 7f29aefbc700 1 --2- 172.21.15.6:0/287224329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2988066f30 0x7f29880693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.276+0000 7f29aefbc700 1 --2- 172.21.15.6:0/287224329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a80abd80 0x7f29a80ac670 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.276+0000 7f29aefbc700 1 --2- 172.21.15.6:0/287224329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29a80ac150 0x7f29a80ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.276+0000 7f29aefbc700 1 -- 172.21.15.6:0/287224329 >> 172.21.15.6:0/287224329 conn(0x7f29a8069790 msgr2=0x7f29a80caf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.276+0000 7f29aefbc700 1 -- 172.21.15.6:0/287224329 shutdown_connections 2023-10-06T02:20:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.276+0000 7f29aefbc700 1 -- 172.21.15.6:0/287224329 wait complete. 2023-10-06T02:20:08.290 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:20:08.290 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:20:08.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.412+0000 7f6347130700 1 Processor -- start 2023-10-06T02:20:08.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.412+0000 7f6347130700 1 -- start start 2023-10-06T02:20:08.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.412+0000 7f6347130700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6340142df0 0x7f63400cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:08.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.412+0000 7f6347130700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63400d0970 0x7f63400cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:08.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.413+0000 7f6347130700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634015a710 con 0x7f63400cc890 2023-10-06T02:20:08.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.413+0000 7f6347130700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6340159b40 con 0x7f63400d0970 2023-10-06T02:20:08.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.413+0000 7f6347130700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6340159de0 con 0x7f6340142df0 2023-10-06T02:20:08.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.413+0000 7f63456cd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63400d0970 0x7f63400cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:08.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.413+0000 7f633ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f63400cc890 0x7f63400d0260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50954/0 (socket says 172.21.15.6:50954) 2023-10-06T02:20:08.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.413+0000 7f633ffff700 1 -- 172.21.15.6:0/2715497364 learned_addr learned my addr 172.21.15.6:0/2715497364 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:08.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.413+0000 7f6344ecc700 1 --2- 172.21.15.6:0/2715497364 >> v2:172.21.15.175:3300/0 conn(0x7f6340142df0 0x7f63400cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:08.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.413+0000 7f63456cd700 1 -- 172.21.15.6:0/2715497364 >> v2:172.21.15.175:3300/0 conn(0x7f6340142df0 msgr2=0x7f63400cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:08.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.413+0000 7f63456cd700 1 --2- 172.21.15.6:0/2715497364 >> v2:172.21.15.175:3300/0 conn(0x7f6340142df0 0x7f63400cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:08.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.413+0000 7f63456cd700 1 -- 172.21.15.6:0/2715497364 >> v1:172.21.15.6:6789/0 conn(0x7f63400cc890 legacy=0x7f63400d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:08.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.413+0000 7f63456cd700 1 -- 172.21.15.6:0/2715497364 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634015a0c0 con 0x7f63400d0970 2023-10-06T02:20:08.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.413+0000 7f63456cd700 1 --2- 172.21.15.6:0/2715497364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63400d0970 0x7f63400cfa90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6340069660 tx=0x7f63300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3895ce0583bb1b6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:08.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.413+0000 7f633f7fe700 1 -- 172.21.15.6:0/2715497364 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633000b6b0 con 0x7f63400d0970 2023-10-06T02:20:08.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.413+0000 7f633f7fe700 1 -- 172.21.15.6:0/2715497364 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633000b810 con 0x7f63400d0970 2023-10-06T02:20:08.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.413+0000 7f633f7fe700 1 -- 172.21.15.6:0/2715497364 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633000bbb0 con 0x7f63400d0970 2023-10-06T02:20:08.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.414+0000 7f6347130700 1 -- 172.21.15.6:0/2715497364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63400d0970 msgr2=0x7f63400cfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:08.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.414+0000 7f6347130700 1 --2- 172.21.15.6:0/2715497364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63400d0970 0x7f63400cfa90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6340069660 tx=0x7f63300091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:08.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.414+0000 7f6347130700 1 -- 172.21.15.6:0/2715497364 shutdown_connections 2023-10-06T02:20:08.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.414+0000 7f6347130700 1 --2- 172.21.15.6:0/2715497364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63400d0970 0x7f63400cfa90 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:08.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.414+0000 7f6347130700 1 --2- 172.21.15.6:0/2715497364 >> v2:172.21.15.175:3300/0 conn(0x7f6340142df0 0x7f63400cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:08.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.414+0000 7f6347130700 1 -- 172.21.15.6:0/2715497364 >> 172.21.15.6:0/2715497364 conn(0x7f63400690f0 msgr2=0x7f634006a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:08.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.414+0000 7f6347130700 1 -- 172.21.15.6:0/2715497364 shutdown_connections 2023-10-06T02:20:08.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.414+0000 7f6347130700 1 -- 172.21.15.6:0/2715497364 wait complete. 2023-10-06T02:20:08.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.415+0000 7f6347130700 1 Processor -- start 2023-10-06T02:20:08.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.415+0000 7f6347130700 1 -- start start 2023-10-06T02:20:08.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.416+0000 7f6347130700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63400cc890 0x7f634016db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:08.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.416+0000 7f6347130700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63400d0970 0x7f63400cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:08.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.416+0000 7f6347130700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6340142df0 0x7f63400b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:08.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.416+0000 7f6347130700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634016e050 con 0x7f6340142df0 2023-10-06T02:20:08.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.416+0000 7f6347130700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6340153c60 con 0x7f63400cc890 2023-10-06T02:20:08.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.416+0000 7f6347130700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6340156a30 con 0x7f63400d0970 2023-10-06T02:20:08.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.416+0000 7f63456cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6340142df0 0x7f63400b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:08.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.416+0000 7f63456cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6340142df0 0x7f63400b0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34696/0 (socket says 172.21.15.6:34696) 2023-10-06T02:20:08.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.416+0000 7f63456cd700 1 -- 172.21.15.6:0/2919646575 learned_addr learned my addr 172.21.15.6:0/2919646575 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:08.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.416+0000 7f63456cd700 1 -- 172.21.15.6:0/2919646575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63400d0970 msgr2=0x7f63400cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:08.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.416+0000 7f6344ecc700 1 --2- 172.21.15.6:0/2919646575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63400cc890 0x7f634016db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:08.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.416+0000 7f633ffff700 1 --2- 172.21.15.6:0/2919646575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63400d0970 0x7f63400cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:08.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.416+0000 7f63456cd700 1 --2- 172.21.15.6:0/2919646575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63400d0970 0x7f63400cb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:08.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.416+0000 7f63456cd700 1 -- 172.21.15.6:0/2919646575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63400cc890 msgr2=0x7f634016db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:08.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.416+0000 7f63456cd700 1 --2- 172.21.15.6:0/2919646575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63400cc890 0x7f634016db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:08.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.416+0000 7f63456cd700 1 -- 172.21.15.6:0/2919646575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6330009420 con 0x7f6340142df0 2023-10-06T02:20:08.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.417+0000 7f63456cd700 1 --2- 172.21.15.6:0/2919646575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6340142df0 0x7f63400b0810 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6340067c10 tx=0x7f6330017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:08.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.417+0000 7f633cff9700 1 -- 172.21.15.6:0/2919646575 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330026470 con 0x7f6340142df0 2023-10-06T02:20:08.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.417+0000 7f633cff9700 1 -- 172.21.15.6:0/2919646575 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63300265d0 con 0x7f6340142df0 2023-10-06T02:20:08.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.417+0000 7f6347130700 1 -- 172.21.15.6:0/2919646575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6340156d10 con 0x7f6340142df0 2023-10-06T02:20:08.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.417+0000 7f633cff9700 1 -- 172.21.15.6:0/2919646575 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330026970 con 0x7f6340142df0 2023-10-06T02:20:08.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.417+0000 7f6347130700 1 -- 172.21.15.6:0/2919646575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63400b2ba0 con 0x7f6340142df0 2023-10-06T02:20:08.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.418+0000 7f6347130700 1 -- 172.21.15.6:0/2919646575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6340156890 con 0x7f6340142df0 2023-10-06T02:20:08.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.418+0000 7f633cff9700 1 -- 172.21.15.6:0/2919646575 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6330023070 con 0x7f6340142df0 2023-10-06T02:20:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.420+0000 7f633cff9700 1 --2- 172.21.15.6:0/2919646575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f632c066f30 0x7f632c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.420+0000 7f633cff9700 1 -- 172.21.15.6:0/2919646575 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f6330086260 con 0x7f6340142df0 2023-10-06T02:20:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.420+0000 7f6344ecc700 1 --2- 172.21.15.6:0/2919646575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f632c066f30 0x7f632c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.420+0000 7f6344ecc700 1 --2- 172.21.15.6:0/2919646575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f632c066f30 0x7f632c0693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6338007f60 tx=0x7f6338007470 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.424+0000 7f633cff9700 1 -- 172.21.15.6:0/2919646575 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6340156890 con 0x7f6340142df0 2023-10-06T02:20:08.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:08.618+0000 7f6347130700 1 -- 172.21.15.6:0/2919646575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6340156890 con 0x7f6340142df0 2023-10-06T02:20:09.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.067+0000 7f633cff9700 1 -- 172.21.15.6:0/2919646575 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v51) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6340156890 con 0x7f6340142df0 2023-10-06T02:20:09.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.071+0000 7f6347130700 1 -- 172.21.15.6:0/2919646575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f632c066f30 msgr2=0x7f632c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:09.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.071+0000 7f6347130700 1 --2- 172.21.15.6:0/2919646575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f632c066f30 0x7f632c0693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6338007f60 tx=0x7f6338007470 comp rx=0 tx=0).stop 2023-10-06T02:20:09.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.071+0000 7f6347130700 1 -- 172.21.15.6:0/2919646575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6340142df0 msgr2=0x7f63400b0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:09.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.071+0000 7f6347130700 1 --2- 172.21.15.6:0/2919646575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6340142df0 0x7f63400b0810 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6340067c10 tx=0x7f6330017000 comp rx=0 tx=0).stop 2023-10-06T02:20:09.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.071+0000 7f6347130700 1 -- 172.21.15.6:0/2919646575 shutdown_connections 2023-10-06T02:20:09.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.071+0000 7f6347130700 1 --2- 172.21.15.6:0/2919646575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f632c066f30 0x7f632c0693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:09.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.071+0000 7f6347130700 1 --2- 172.21.15.6:0/2919646575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6340142df0 0x7f63400b0810 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:09.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.071+0000 7f6347130700 1 --2- 172.21.15.6:0/2919646575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63400cc890 0x7f634016db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:09.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.071+0000 7f6347130700 1 --2- 172.21.15.6:0/2919646575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63400d0970 0x7f63400cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:09.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.071+0000 7f6347130700 1 -- 172.21.15.6:0/2919646575 >> 172.21.15.6:0/2919646575 conn(0x7f63400690f0 msgr2=0x7f6340157630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:09.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.072+0000 7f6347130700 1 -- 172.21.15.6:0/2919646575 shutdown_connections 2023-10-06T02:20:09.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.072+0000 7f6347130700 1 -- 172.21.15.6:0/2919646575 wait complete. 2023-10-06T02:20:09.073 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-06T02:20:09.085 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:20:09.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.213+0000 7f19db344700 1 Processor -- start 2023-10-06T02:20:09.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.213+0000 7f19db344700 1 -- start start 2023-10-06T02:20:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.214+0000 7f19db344700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19d40af360 0x7f19d415a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.214+0000 7f19db344700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d415aab0 con 0x7f19d40af730 2023-10-06T02:20:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.214+0000 7f19db344700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d415d6c0 con 0x7f19d40cd220 2023-10-06T02:20:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.214+0000 7f19db344700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d40ce6e0 con 0x7f19d40af360 2023-10-06T02:20:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.214+0000 7f19d9b41700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f19d40af730 0x7f19d40ccb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38814/0 (socket says 172.21.15.6:38814) 2023-10-06T02:20:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.214+0000 7f19d9b41700 1 -- 172.21.15.6:0/3009504308 learned_addr learned my addr 172.21.15.6:0/3009504308 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.214+0000 7f19da342700 1 --2- 172.21.15.6:0/3009504308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19d40af360 0x7f19d415a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.214+0000 7f19d9340700 1 -- 172.21.15.6:0/3009504308 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229621536 0 0) 0x7f19d415aab0 con 0x7f19d40af730 2023-10-06T02:20:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.214+0000 7f19d9340700 1 -- 172.21.15.6:0/3009504308 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19bc003570 con 0x7f19d40af730 2023-10-06T02:20:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9340700 1 -- 172.21.15.6:0/3009504308 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2175544808 0 0) 0x7f19bc003570 con 0x7f19d40af730 2023-10-06T02:20:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9340700 1 -- 172.21.15.6:0/3009504308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19d40af360 msgr2=0x7f19d415a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9340700 1 --2- 172.21.15.6:0/3009504308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19d40af360 0x7f19d415a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9340700 1 -- 172.21.15.6:0/3009504308 >> v1:172.21.15.175:6789/0 conn(0x7f19d40cd220 legacy=0x7f19d40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9340700 1 -- 172.21.15.6:0/3009504308 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d415d9a0 con 0x7f19d40af730 2023-10-06T02:20:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9340700 1 -- 172.21.15.6:0/3009504308 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f19c8001470 con 0x7f19d40af730 2023-10-06T02:20:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9340700 1 -- 172.21.15.6:0/3009504308 >> v1:172.21.15.6:6789/0 conn(0x7f19d40af730 legacy=0x7f19d40ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9340700 1 --2- 172.21.15.6:0/3009504308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19d40af360 0x7f19bc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9340700 1 --2- 172.21.15.6:0/3009504308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19bc004010 0x7f19bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9340700 1 --2- 172.21.15.6:0/3009504308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19bc004d50 0x7f19bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9340700 1 -- 172.21.15.6:0/3009504308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d40ce6e0 con 0x7f19bc004010 2023-10-06T02:20:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9340700 1 -- 172.21.15.6:0/3009504308 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc00bbf0 con 0x7f19bc004d50 2023-10-06T02:20:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9340700 1 -- 172.21.15.6:0/3009504308 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc00bdb0 con 0x7f19d40af360 2023-10-06T02:20:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9b41700 1 --2- 172.21.15.6:0/3009504308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19bc004010 0x7f19bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19da342700 1 --2- 172.21.15.6:0/3009504308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19d40af360 0x7f19bc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19dab43700 1 --2- 172.21.15.6:0/3009504308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19bc004d50 0x7f19bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9b41700 1 -- 172.21.15.6:0/3009504308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19d40af360 msgr2=0x7f19bc003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9b41700 1 --2- 172.21.15.6:0/3009504308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19d40af360 0x7f19bc003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9b41700 1 -- 172.21.15.6:0/3009504308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19bc004d50 msgr2=0x7f19bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9b41700 1 --2- 172.21.15.6:0/3009504308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19bc004d50 0x7f19bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9b41700 1 -- 172.21.15.6:0/3009504308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc003570 con 0x7f19bc004010 2023-10-06T02:20:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19dab43700 1 --2- 172.21.15.6:0/3009504308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19bc004d50 0x7f19bc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.215+0000 7f19d9b41700 1 --2- 172.21.15.6:0/3009504308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19bc004010 0x7f19bc004810 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f19d40afb00 tx=0x7f19c8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7676a008f2309f5c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:09.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.216+0000 7f19d9340700 1 -- 172.21.15.6:0/3009504308 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c800cc30 con 0x7f19bc004010 2023-10-06T02:20:09.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.216+0000 7f19d9340700 1 -- 172.21.15.6:0/3009504308 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c800cd90 con 0x7f19bc004010 2023-10-06T02:20:09.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.216+0000 7f19d9340700 1 -- 172.21.15.6:0/3009504308 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8005b50 con 0x7f19bc004010 2023-10-06T02:20:09.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.216+0000 7f19db344700 1 -- 172.21.15.6:0/3009504308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19bc004010 msgr2=0x7f19bc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:09.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.216+0000 7f19db344700 1 --2- 172.21.15.6:0/3009504308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19bc004010 0x7f19bc004810 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f19d40afb00 tx=0x7f19c8001e50 comp rx=0 tx=0).stop 2023-10-06T02:20:09.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.216+0000 7f19dab43700 1 -- 172.21.15.6:0/3009504308 reap_dead start 2023-10-06T02:20:09.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.216+0000 7f19db344700 1 -- 172.21.15.6:0/3009504308 shutdown_connections 2023-10-06T02:20:09.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.216+0000 7f19db344700 1 -- 172.21.15.6:0/3009504308 >> 172.21.15.6:0/3009504308 conn(0x7f19d4068680 msgr2=0x7f19d4068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:09.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.216+0000 7f19db344700 1 -- 172.21.15.6:0/3009504308 shutdown_connections 2023-10-06T02:20:09.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.216+0000 7f19db344700 1 -- 172.21.15.6:0/3009504308 wait complete. 2023-10-06T02:20:09.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.217+0000 7f19db344700 1 Processor -- start 2023-10-06T02:20:09.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.217+0000 7f19db344700 1 -- start start 2023-10-06T02:20:09.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.218+0000 7f19db344700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19bc004010 0x7f19d40b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:09.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.218+0000 7f19db344700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19d4142ca0 0x7f19d40b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:09.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.218+0000 7f19db344700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19d4143110 0x7f19d40b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:09.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.218+0000 7f19db344700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d416e210 con 0x7f19d4142ca0 2023-10-06T02:20:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.218+0000 7f19db344700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d416d600 con 0x7f19d4143110 2023-10-06T02:20:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.218+0000 7f19db344700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d416d8e0 con 0x7f19bc004010 2023-10-06T02:20:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.218+0000 7f19d9b41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19d4142ca0 0x7f19d40b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.218+0000 7f19d9b41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19d4142ca0 0x7f19d40b0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41910/0 (socket says 172.21.15.6:41910) 2023-10-06T02:20:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.218+0000 7f19d9b41700 1 -- 172.21.15.6:0/2205174836 learned_addr learned my addr 172.21.15.6:0/2205174836 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.218+0000 7f19da342700 1 --2- 172.21.15.6:0/2205174836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19bc004010 0x7f19d40b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.218+0000 7f19dab43700 1 --2- 172.21.15.6:0/2205174836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19d4143110 0x7f19d40b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.218+0000 7f19d9b41700 1 -- 172.21.15.6:0/2205174836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19bc004010 msgr2=0x7f19d40b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.218+0000 7f19d9b41700 1 --2- 172.21.15.6:0/2205174836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19bc004010 0x7f19d40b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.218+0000 7f19d9b41700 1 -- 172.21.15.6:0/2205174836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19d4143110 msgr2=0x7f19d40b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.218+0000 7f19d9b41700 1 --2- 172.21.15.6:0/2205174836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19d4143110 0x7f19d40b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.218+0000 7f19d9b41700 1 -- 172.21.15.6:0/2205174836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d416dbc0 con 0x7f19d4142ca0 2023-10-06T02:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.218+0000 7f19dab43700 1 --2- 172.21.15.6:0/2205174836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19d4143110 0x7f19d40b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.219+0000 7f19d9b41700 1 --2- 172.21.15.6:0/2205174836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19d4142ca0 0x7f19d40b0d60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0057d0 tx=0x7f19c8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.219+0000 7f19d27fc700 1 -- 172.21.15.6:0/2205174836 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c800cc30 con 0x7f19d4142ca0 2023-10-06T02:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.219+0000 7f19d27fc700 1 -- 172.21.15.6:0/2205174836 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c80070d0 con 0x7f19d4142ca0 2023-10-06T02:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.219+0000 7f19d27fc700 1 -- 172.21.15.6:0/2205174836 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8007470 con 0x7f19d4142ca0 2023-10-06T02:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.219+0000 7f19db344700 1 -- 172.21.15.6:0/2205174836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d416dea0 con 0x7f19d4142ca0 2023-10-06T02:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.219+0000 7f19db344700 1 -- 172.21.15.6:0/2205174836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d40b4160 con 0x7f19d4142ca0 2023-10-06T02:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.220+0000 7f19db344700 1 -- 172.21.15.6:0/2205174836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d40aee30 con 0x7f19d4142ca0 2023-10-06T02:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.220+0000 7f19d27fc700 1 -- 172.21.15.6:0/2205174836 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19c8028460 con 0x7f19d4142ca0 2023-10-06T02:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.221+0000 7f19d27fc700 1 --2- 172.21.15.6:0/2205174836 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f19c0066f30 0x7f19c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.221+0000 7f19d27fc700 1 -- 172.21.15.6:0/2205174836 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f19c8085ba0 con 0x7f19d4142ca0 2023-10-06T02:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.221+0000 7f19da342700 1 --2- 172.21.15.6:0/2205174836 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f19c0066f30 0x7f19c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:09.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.221+0000 7f19da342700 1 --2- 172.21.15.6:0/2205174836 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f19c0066f30 0x7f19c00693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f19cc006f00 tx=0x7f19cc0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:09.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.225+0000 7f19d27fc700 1 -- 172.21.15.6:0/2205174836 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19c8052cb0 con 0x7f19d4142ca0 2023-10-06T02:20:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:09.420+0000 7f19db344700 1 -- 172.21.15.6:0/2205174836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f19d4064aa0 con 0x7f19d4142ca0 2023-10-06T02:20:10.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.068+0000 7f19d27fc700 1 -- 172.21.15.6:0/2205174836 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v52) v1 ==== 170+0+0 (secure 0 0 0) 0x7f19c8017070 con 0x7f19d4142ca0 2023-10-06T02:20:10.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.076+0000 7f19db344700 1 -- 172.21.15.6:0/2205174836 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f19c0066f30 msgr2=0x7f19c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:10.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.076+0000 7f19db344700 1 --2- 172.21.15.6:0/2205174836 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f19c0066f30 0x7f19c00693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f19cc006f00 tx=0x7f19cc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:10.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.076+0000 7f19db344700 1 -- 172.21.15.6:0/2205174836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19d4142ca0 msgr2=0x7f19d40b0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.076+0000 7f19db344700 1 --2- 172.21.15.6:0/2205174836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19d4142ca0 0x7f19d40b0d60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0057d0 tx=0x7f19c8015000 comp rx=0 tx=0).stop 2023-10-06T02:20:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.077+0000 7f19db344700 1 -- 172.21.15.6:0/2205174836 shutdown_connections 2023-10-06T02:20:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.077+0000 7f19db344700 1 --2- 172.21.15.6:0/2205174836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19d4143110 0x7f19d40b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.077+0000 7f19db344700 1 --2- 172.21.15.6:0/2205174836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19bc004010 0x7f19d40b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.077+0000 7f19db344700 1 --2- 172.21.15.6:0/2205174836 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f19c0066f30 0x7f19c00693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.077+0000 7f19db344700 1 --2- 172.21.15.6:0/2205174836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19d4142ca0 0x7f19d40b0d60 secure :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0057d0 tx=0x7f19c8015000 comp rx=0 tx=0).stop 2023-10-06T02:20:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.077+0000 7f19db344700 1 -- 172.21.15.6:0/2205174836 >> 172.21.15.6:0/2205174836 conn(0x7f19d4068680 msgr2=0x7f19d40ca9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.080+0000 7f19db344700 1 -- 172.21.15.6:0/2205174836 shutdown_connections 2023-10-06T02:20:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.080+0000 7f19db344700 1 -- 172.21.15.6:0/2205174836 wait complete. 2023-10-06T02:20:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-06T02:20:10.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:20:10.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.230+0000 7fd885070700 1 Processor -- start 2023-10-06T02:20:10.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.230+0000 7fd885070700 1 -- start start 2023-10-06T02:20:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.231+0000 7fd885070700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd8800d0400 0x7fd8800b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.231+0000 7fd885070700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8800b6170 con 0x7fd8800ccd40 2023-10-06T02:20:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.231+0000 7fd885070700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd88015dd40 con 0x7fd8800d07d0 2023-10-06T02:20:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.231+0000 7fd885070700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88015e020 con 0x7fd8800d0400 2023-10-06T02:20:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.231+0000 7fd87e59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd8800ccd40 0x7fd8800cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38824/0 (socket says 172.21.15.6:38824) 2023-10-06T02:20:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.231+0000 7fd87e59c700 1 -- 172.21.15.6:0/1339406535 learned_addr learned my addr 172.21.15.6:0/1339406535 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.231+0000 7fd87ed9d700 1 --2- 172.21.15.6:0/1339406535 >> v2:172.21.15.175:3300/0 conn(0x7fd8800d0400 0x7fd8800b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.231+0000 7fd87dd9b700 1 -- 172.21.15.6:0/1339406535 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929764525 0 0) 0x7fd8800b6170 con 0x7fd8800ccd40 2023-10-06T02:20:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.231+0000 7fd87dd9b700 1 -- 172.21.15.6:0/1339406535 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd86c003570 con 0x7fd8800ccd40 2023-10-06T02:20:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87dd9b700 1 -- 172.21.15.6:0/1339406535 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800582789 0 0) 0x7fd88015dd40 con 0x7fd8800d07d0 2023-10-06T02:20:10.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87dd9b700 1 -- 172.21.15.6:0/1339406535 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8800b6170 con 0x7fd8800d07d0 2023-10-06T02:20:10.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87dd9b700 1 -- 172.21.15.6:0/1339406535 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1158159202 0 0) 0x7fd86c003570 con 0x7fd8800ccd40 2023-10-06T02:20:10.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87dd9b700 1 -- 172.21.15.6:0/1339406535 >> v2:172.21.15.175:3300/0 conn(0x7fd8800d0400 msgr2=0x7fd8800b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:10.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87dd9b700 1 --2- 172.21.15.6:0/1339406535 >> v2:172.21.15.175:3300/0 conn(0x7fd8800d0400 0x7fd8800b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:10.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87dd9b700 1 -- 172.21.15.6:0/1339406535 >> v1:172.21.15.175:6789/0 conn(0x7fd8800d07d0 legacy=0x7fd8800b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:10.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87dd9b700 1 -- 172.21.15.6:0/1339406535 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8800ceaa0 con 0x7fd8800ccd40 2023-10-06T02:20:10.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87dd9b700 1 -- 172.21.15.6:0/1339406535 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fd868001470 con 0x7fd8800ccd40 2023-10-06T02:20:10.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87dd9b700 1 -- 172.21.15.6:0/1339406535 >> v1:172.21.15.6:6789/0 conn(0x7fd8800ccd40 legacy=0x7fd8800cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:10.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87dd9b700 1 --2- 172.21.15.6:0/1339406535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd86c003c40 0x7fd86c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:10.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87dd9b700 1 --2- 172.21.15.6:0/1339406535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd86c004810 0x7fd86c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:10.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87dd9b700 1 --2- 172.21.15.6:0/1339406535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd86c005210 0x7fd86c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:10.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87dd9b700 1 -- 172.21.15.6:0/1339406535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88015e020 con 0x7fd86c003c40 2023-10-06T02:20:10.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87dd9b700 1 -- 172.21.15.6:0/1339406535 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c00c130 con 0x7fd86c004810 2023-10-06T02:20:10.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87dd9b700 1 -- 172.21.15.6:0/1339406535 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c00c2c0 con 0x7fd86c005210 2023-10-06T02:20:10.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87ed9d700 1 --2- 172.21.15.6:0/1339406535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd86c003c40 0x7fd86c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:10.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87e59c700 1 --2- 172.21.15.6:0/1339406535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd86c004810 0x7fd86c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:10.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87f59e700 1 --2- 172.21.15.6:0/1339406535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd86c005210 0x7fd86c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:10.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87ed9d700 1 -- 172.21.15.6:0/1339406535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd86c005210 msgr2=0x7fd86c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:10.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87ed9d700 1 --2- 172.21.15.6:0/1339406535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd86c005210 0x7fd86c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:10.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87ed9d700 1 -- 172.21.15.6:0/1339406535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd86c004810 msgr2=0x7fd86c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:10.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87ed9d700 1 --2- 172.21.15.6:0/1339406535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd86c004810 0x7fd86c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:10.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87ed9d700 1 -- 172.21.15.6:0/1339406535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86c003570 con 0x7fd86c003c40 2023-10-06T02:20:10.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87f59e700 1 -- 172.21.15.6:0/1339406535 reap_dead start 2023-10-06T02:20:10.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87ed9d700 1 --2- 172.21.15.6:0/1339406535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd86c003c40 0x7fd86c004030 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd870009c20 tx=0x7fd870009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4eab9cb88f031cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:10.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.232+0000 7fd87dd9b700 1 -- 172.21.15.6:0/1339406535 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8700095a0 con 0x7fd86c003c40 2023-10-06T02:20:10.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.233+0000 7fd87dd9b700 1 -- 172.21.15.6:0/1339406535 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd870005a00 con 0x7fd86c003c40 2023-10-06T02:20:10.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.233+0000 7fd87dd9b700 1 -- 172.21.15.6:0/1339406535 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd870005da0 con 0x7fd86c003c40 2023-10-06T02:20:10.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.233+0000 7fd885070700 1 -- 172.21.15.6:0/1339406535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd86c003c40 msgr2=0x7fd86c004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:10.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.233+0000 7fd885070700 1 --2- 172.21.15.6:0/1339406535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd86c003c40 0x7fd86c004030 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd870009c20 tx=0x7fd870009120 comp rx=0 tx=0).stop 2023-10-06T02:20:10.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.233+0000 7fd885070700 1 -- 172.21.15.6:0/1339406535 shutdown_connections 2023-10-06T02:20:10.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.233+0000 7fd885070700 1 --2- 172.21.15.6:0/1339406535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd86c003c40 0x7fd86c004030 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:10.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.233+0000 7fd885070700 1 -- 172.21.15.6:0/1339406535 >> 172.21.15.6:0/1339406535 conn(0x7fd88006a220 msgr2=0x7fd88006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:10.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.233+0000 7fd885070700 1 -- 172.21.15.6:0/1339406535 shutdown_connections 2023-10-06T02:20:10.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.233+0000 7fd885070700 1 -- 172.21.15.6:0/1339406535 wait complete. 2023-10-06T02:20:10.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.234+0000 7fd885070700 1 Processor -- start 2023-10-06T02:20:10.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.234+0000 7fd885070700 1 -- start start 2023-10-06T02:20:10.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.235+0000 7fd885070700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd86c003c40 0x7fd880155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:10.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.235+0000 7fd885070700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8800c7e10 0x7fd8800c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:10.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.235+0000 7fd885070700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8800c8280 0x7fd8800c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:10.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.235+0000 7fd885070700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800c6c50 con 0x7fd8800c7e10 2023-10-06T02:20:10.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.235+0000 7fd885070700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800c5fc0 con 0x7fd86c003c40 2023-10-06T02:20:10.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.235+0000 7fd885070700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800c5ce0 con 0x7fd8800c8280 2023-10-06T02:20:10.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.235+0000 7fd87e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8800c7e10 0x7fd8800c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:10.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.235+0000 7fd87e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8800c7e10 0x7fd8800c5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41920/0 (socket says 172.21.15.6:41920) 2023-10-06T02:20:10.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.235+0000 7fd87e59c700 1 -- 172.21.15.6:0/1491181049 learned_addr learned my addr 172.21.15.6:0/1491181049 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:10.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.235+0000 7fd87f59e700 1 --2- 172.21.15.6:0/1491181049 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8800c8280 0x7fd8800c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:10.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.235+0000 7fd87ed9d700 1 --2- 172.21.15.6:0/1491181049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd86c003c40 0x7fd880155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:10.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.235+0000 7fd87e59c700 1 -- 172.21.15.6:0/1491181049 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8800c8280 msgr2=0x7fd8800c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:10.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.235+0000 7fd87e59c700 1 --2- 172.21.15.6:0/1491181049 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8800c8280 0x7fd8800c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:10.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.235+0000 7fd87e59c700 1 -- 172.21.15.6:0/1491181049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd86c003c40 msgr2=0x7fd880155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:10.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.235+0000 7fd87e59c700 1 --2- 172.21.15.6:0/1491181049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd86c003c40 0x7fd880155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:10.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.235+0000 7fd87e59c700 1 -- 172.21.15.6:0/1491181049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8800c7330 con 0x7fd8800c7e10 2023-10-06T02:20:10.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.236+0000 7fd87e59c700 1 --2- 172.21.15.6:0/1491181049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8800c7e10 0x7fd8800c5100 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd868000fd0 tx=0x7fd868001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:10.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.236+0000 7fd876ffd700 1 -- 172.21.15.6:0/1491181049 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd868018030 con 0x7fd8800c7e10 2023-10-06T02:20:10.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.236+0000 7fd876ffd700 1 -- 172.21.15.6:0/1491181049 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8680077d0 con 0x7fd8800c7e10 2023-10-06T02:20:10.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.236+0000 7fd885070700 1 -- 172.21.15.6:0/1491181049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8800c7610 con 0x7fd8800c7e10 2023-10-06T02:20:10.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.236+0000 7fd876ffd700 1 -- 172.21.15.6:0/1491181049 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86800fae0 con 0x7fd8800c7e10 2023-10-06T02:20:10.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.236+0000 7fd885070700 1 -- 172.21.15.6:0/1491181049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd880155fa0 con 0x7fd8800c7e10 2023-10-06T02:20:10.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.237+0000 7fd885070700 1 -- 172.21.15.6:0/1491181049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8800c7180 con 0x7fd8800c7e10 2023-10-06T02:20:10.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.237+0000 7fd876ffd700 1 -- 172.21.15.6:0/1491181049 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd86801b070 con 0x7fd8800c7e10 2023-10-06T02:20:10.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.237+0000 7fd876ffd700 1 --2- 172.21.15.6:0/1491181049 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd860066f60 0x7fd860069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:10.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.238+0000 7fd876ffd700 1 -- 172.21.15.6:0/1491181049 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fd868019070 con 0x7fd8800c7e10 2023-10-06T02:20:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.238+0000 7fd87ed9d700 1 --2- 172.21.15.6:0/1491181049 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd860066f60 0x7fd860069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.238+0000 7fd87ed9d700 1 --2- 172.21.15.6:0/1491181049 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd860066f60 0x7fd860069410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd870009160 tx=0x7fd870019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.242+0000 7fd876ffd700 1 -- 172.21.15.6:0/1491181049 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd868051410 con 0x7fd8800c7e10 2023-10-06T02:20:10.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:10.478+0000 7fd885070700 1 -- 172.21.15.6:0/1491181049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd8800c7b10 con 0x7fd8800c7e10 2023-10-06T02:20:11.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.098+0000 7fd876ffd700 1 -- 172.21.15.6:0/1491181049 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v29) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd868054a30 con 0x7fd8800c7e10 2023-10-06T02:20:11.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.118+0000 7fd885070700 1 -- 172.21.15.6:0/1491181049 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd860066f60 msgr2=0x7fd860069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.118+0000 7fd885070700 1 --2- 172.21.15.6:0/1491181049 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd860066f60 0x7fd860069410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd870009160 tx=0x7fd870019000 comp rx=0 tx=0).stop 2023-10-06T02:20:11.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.118+0000 7fd885070700 1 -- 172.21.15.6:0/1491181049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8800c7e10 msgr2=0x7fd8800c5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.118+0000 7fd885070700 1 --2- 172.21.15.6:0/1491181049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8800c7e10 0x7fd8800c5100 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd868000fd0 tx=0x7fd868001d40 comp rx=0 tx=0).stop 2023-10-06T02:20:11.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.118+0000 7fd885070700 1 -- 172.21.15.6:0/1491181049 shutdown_connections 2023-10-06T02:20:11.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.118+0000 7fd885070700 1 --2- 172.21.15.6:0/1491181049 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8800c8280 0x7fd8800c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.118+0000 7fd885070700 1 --2- 172.21.15.6:0/1491181049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd86c003c40 0x7fd880155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.118+0000 7fd885070700 1 --2- 172.21.15.6:0/1491181049 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd860066f60 0x7fd860069410 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.118+0000 7fd885070700 1 --2- 172.21.15.6:0/1491181049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8800c7e10 0x7fd8800c5100 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.118+0000 7fd885070700 1 -- 172.21.15.6:0/1491181049 >> 172.21.15.6:0/1491181049 conn(0x7fd88006a220 msgr2=0x7fd8800b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:11.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.119+0000 7fd885070700 1 -- 172.21.15.6:0/1491181049 shutdown_connections 2023-10-06T02:20:11.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.119+0000 7fd885070700 1 -- 172.21.15.6:0/1491181049 wait complete. 2023-10-06T02:20:11.120 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 8 and data pool 9 2023-10-06T02:20:11.134 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:20:11.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.257+0000 7f6d91c4f700 1 Processor -- start 2023-10-06T02:20:11.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.258+0000 7f6d91c4f700 1 -- start start 2023-10-06T02:20:11.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.258+0000 7f6d91c4f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6d8c142de0 0x7f6d8c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.258+0000 7f6d91c4f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8c0cd270 0x7f6d8c0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.258+0000 7f6d91c4f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8c0cf8a0 con 0x7f6d8c1431b0 2023-10-06T02:20:11.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.258+0000 7f6d91c4f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8c0b4100 con 0x7f6d8c142de0 2023-10-06T02:20:11.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.258+0000 7f6d91c4f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c0cec90 con 0x7f6d8c0cd270 2023-10-06T02:20:11.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.259+0000 7f6d8b7fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6d8c142de0 0x7f6d8c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.259+0000 7f6d8affd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8c0cd270 0x7f6d8c0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.259+0000 7f6d8b7fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6d8c142de0 0x7f6d8c0ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:43114/0 (socket says 172.21.15.6:43114) 2023-10-06T02:20:11.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.259+0000 7f6d8b7fe700 1 -- 172.21.15.6:0/2197174471 learned_addr learned my addr 172.21.15.6:0/2197174471 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:11.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.259+0000 7f6d8bfff700 1 --1- 172.21.15.6:0/2197174471 >> v1:172.21.15.175:6789/0 conn(0x7f6d8c1431b0 0x7f6d8c15d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:56070/0 (socket says 172.21.15.6:56070) 2023-10-06T02:20:11.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.259+0000 7f6d8b7fe700 1 -- 172.21.15.6:0/2197174471 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8c0cd270 msgr2=0x7f6d8c0d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:11.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.259+0000 7f6d8b7fe700 1 --2- 172.21.15.6:0/2197174471 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8c0cd270 0x7f6d8c0d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.259+0000 7f6d8b7fe700 1 -- 172.21.15.6:0/2197174471 >> v1:172.21.15.175:6789/0 conn(0x7f6d8c1431b0 legacy=0x7f6d8c15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.259+0000 7f6d8b7fe700 1 -- 172.21.15.6:0/2197174471 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c0cef70 con 0x7f6d8c142de0 2023-10-06T02:20:11.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.259+0000 7f6d8affd700 1 --2- 172.21.15.6:0/2197174471 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8c0cd270 0x7f6d8c0d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:20:11.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.259+0000 7f6d8b7fe700 1 --2- 172.21.15.6:0/2197174471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d8c142de0 0x7f6d8c0ccd30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d800099b0 tx=0x7f6d80009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d6541f4f00621af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:11.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.259+0000 7f6d8a7fc700 1 -- 172.21.15.6:0/2197174471 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80009ea0 con 0x7f6d8c142de0 2023-10-06T02:20:11.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.260+0000 7f6d8a7fc700 1 -- 172.21.15.6:0/2197174471 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8000b860 con 0x7f6d8c142de0 2023-10-06T02:20:11.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.260+0000 7f6d8a7fc700 1 -- 172.21.15.6:0/2197174471 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8000bc00 con 0x7f6d8c142de0 2023-10-06T02:20:11.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.260+0000 7f6d91c4f700 1 -- 172.21.15.6:0/2197174471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d8c142de0 msgr2=0x7f6d8c0ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.260+0000 7f6d91c4f700 1 --2- 172.21.15.6:0/2197174471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d8c142de0 0x7f6d8c0ccd30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d800099b0 tx=0x7f6d80009250 comp rx=0 tx=0).stop 2023-10-06T02:20:11.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.260+0000 7f6d91c4f700 1 -- 172.21.15.6:0/2197174471 shutdown_connections 2023-10-06T02:20:11.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.260+0000 7f6d91c4f700 1 --2- 172.21.15.6:0/2197174471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d8c142de0 0x7f6d8c0ccd30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.260+0000 7f6d91c4f700 1 --2- 172.21.15.6:0/2197174471 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8c0cd270 0x7f6d8c0d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.260+0000 7f6d91c4f700 1 -- 172.21.15.6:0/2197174471 >> 172.21.15.6:0/2197174471 conn(0x7f6d8c069110 msgr2=0x7f6d8c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:11.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.260+0000 7f6d91c4f700 1 -- 172.21.15.6:0/2197174471 shutdown_connections 2023-10-06T02:20:11.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.260+0000 7f6d91c4f700 1 -- 172.21.15.6:0/2197174471 wait complete. 2023-10-06T02:20:11.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.261+0000 7f6d91c4f700 1 Processor -- start 2023-10-06T02:20:11.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.261+0000 7f6d91c4f700 1 -- start start 2023-10-06T02:20:11.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.262+0000 7f6d91c4f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8c0cd270 0x7f6d8c158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.262+0000 7f6d91c4f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d8c142de0 0x7f6d8c156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.262+0000 7f6d91c4f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d8c1431b0 0x7f6d8c13db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.262+0000 7f6d91c4f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c0af690 con 0x7f6d8c1431b0 2023-10-06T02:20:11.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.262+0000 7f6d91c4f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c0af080 con 0x7f6d8c142de0 2023-10-06T02:20:11.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.262+0000 7f6d91c4f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c158f90 con 0x7f6d8c0cd270 2023-10-06T02:20:11.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.262+0000 7f6d8bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d8c1431b0 0x7f6d8c13db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.262+0000 7f6d8bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d8c1431b0 0x7f6d8c13db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41932/0 (socket says 172.21.15.6:41932) 2023-10-06T02:20:11.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.262+0000 7f6d8bfff700 1 -- 172.21.15.6:0/1218581117 learned_addr learned my addr 172.21.15.6:0/1218581117 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:11.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.262+0000 7f6d8affd700 1 --2- 172.21.15.6:0/1218581117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d8c142de0 0x7f6d8c156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.262+0000 7f6d8b7fe700 1 --2- 172.21.15.6:0/1218581117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8c0cd270 0x7f6d8c158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.263+0000 7f6d8bfff700 1 -- 172.21.15.6:0/1218581117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8c0cd270 msgr2=0x7f6d8c158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.263+0000 7f6d8bfff700 1 --2- 172.21.15.6:0/1218581117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8c0cd270 0x7f6d8c158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.263+0000 7f6d8bfff700 1 -- 172.21.15.6:0/1218581117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d8c142de0 msgr2=0x7f6d8c156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.263+0000 7f6d8bfff700 1 --2- 172.21.15.6:0/1218581117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d8c142de0 0x7f6d8c156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.263+0000 7f6d8bfff700 1 -- 172.21.15.6:0/1218581117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7c009420 con 0x7f6d8c1431b0 2023-10-06T02:20:11.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.263+0000 7f6d8bfff700 1 --2- 172.21.15.6:0/1218581117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d8c1431b0 0x7f6d8c13db30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400cd00 tx=0x7f6d84001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:11.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.263+0000 7f6d737fe700 1 -- 172.21.15.6:0/1218581117 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400ce60 con 0x7f6d8c1431b0 2023-10-06T02:20:11.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.263+0000 7f6d737fe700 1 -- 172.21.15.6:0/1218581117 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d84005df0 con 0x7f6d8c1431b0 2023-10-06T02:20:11.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.263+0000 7f6d91c4f700 1 -- 172.21.15.6:0/1218581117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d800094f0 con 0x7f6d8c1431b0 2023-10-06T02:20:11.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.263+0000 7f6d737fe700 1 -- 172.21.15.6:0/1218581117 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400ab00 con 0x7f6d8c1431b0 2023-10-06T02:20:11.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.263+0000 7f6d91c4f700 1 -- 172.21.15.6:0/1218581117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8c159270 con 0x7f6d8c1431b0 2023-10-06T02:20:11.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.264+0000 7f6d91c4f700 1 -- 172.21.15.6:0/1218581117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8c088ac0 con 0x7f6d8c1431b0 2023-10-06T02:20:11.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.265+0000 7f6d737fe700 1 -- 172.21.15.6:0/1218581117 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d840070f0 con 0x7f6d8c1431b0 2023-10-06T02:20:11.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.265+0000 7f6d737fe700 1 --2- 172.21.15.6:0/1218581117 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6d78066f30 0x7f6d780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.265+0000 7f6d737fe700 1 -- 172.21.15.6:0/1218581117 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6d84084780 con 0x7f6d8c1431b0 2023-10-06T02:20:11.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.265+0000 7f6d8b7fe700 1 --2- 172.21.15.6:0/1218581117 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6d78066f30 0x7f6d780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.266+0000 7f6d8b7fe700 1 --2- 172.21.15.6:0/1218581117 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6d78066f30 0x7f6d780693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6d800099b0 tx=0x7f6d80017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:11.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.270+0000 7f6d737fe700 1 -- 172.21.15.6:0/1218581117 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d840517d0 con 0x7f6d8c1431b0 2023-10-06T02:20:11.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.463+0000 7f6d91c4f700 1 -- 172.21.15.6:0/1218581117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d8c15c160 con 0x7f6d8c1431b0 2023-10-06T02:20:11.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.464+0000 7f6d737fe700 1 -- 172.21.15.6:0/1218581117 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+17036 (secure 0 0 0) 0x7f6d84054df0 con 0x7f6d8c1431b0 2023-10-06T02:20:11.465 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:11.465 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":53,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:20:10.479530+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:20:08.649152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T02:20:09.450444+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:20:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.466+0000 7f6d91c4f700 1 -- 172.21.15.6:0/1218581117 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6d78066f30 msgr2=0x7f6d780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.466+0000 7f6d91c4f700 1 --2- 172.21.15.6:0/1218581117 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6d78066f30 0x7f6d780693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6d800099b0 tx=0x7f6d80017000 comp rx=0 tx=0).stop 2023-10-06T02:20:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.466+0000 7f6d91c4f700 1 -- 172.21.15.6:0/1218581117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d8c1431b0 msgr2=0x7f6d8c13db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.466+0000 7f6d91c4f700 1 --2- 172.21.15.6:0/1218581117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d8c1431b0 0x7f6d8c13db30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400cd00 tx=0x7f6d84001b10 comp rx=0 tx=0).stop 2023-10-06T02:20:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.466+0000 7f6d91c4f700 1 -- 172.21.15.6:0/1218581117 shutdown_connections 2023-10-06T02:20:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.466+0000 7f6d91c4f700 1 --2- 172.21.15.6:0/1218581117 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6d78066f30 0x7f6d780693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.466+0000 7f6d91c4f700 1 --2- 172.21.15.6:0/1218581117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d8c1431b0 0x7f6d8c13db30 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.466+0000 7f6d91c4f700 1 --2- 172.21.15.6:0/1218581117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8c0cd270 0x7f6d8c158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.466+0000 7f6d91c4f700 1 --2- 172.21.15.6:0/1218581117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d8c142de0 0x7f6d8c156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.466+0000 7f6d91c4f700 1 -- 172.21.15.6:0/1218581117 >> 172.21.15.6:0/1218581117 conn(0x7f6d8c069110 msgr2=0x7f6d8c0d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:11.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.466+0000 7f6d91c4f700 1 -- 172.21.15.6:0/1218581117 shutdown_connections 2023-10-06T02:20:11.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.466+0000 7f6d91c4f700 1 -- 172.21.15.6:0/1218581117 wait complete. 2023-10-06T02:20:11.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:20:11.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.598+0000 7f8852bfe700 1 Processor -- start 2023-10-06T02:20:11.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.598+0000 7f8852bfe700 1 -- start start 2023-10-06T02:20:11.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.598+0000 7f8852bfe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f884c15cde0 0x7f884c1642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.598+0000 7f8852bfe700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884c0b1ed0 con 0x7f884c067d10 2023-10-06T02:20:11.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.598+0000 7f8852bfe700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884c0879c0 con 0x7f884c15ca10 2023-10-06T02:20:11.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.598+0000 7f8852bfe700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0cec50 con 0x7f884c15cde0 2023-10-06T02:20:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f884c067d10 0x7f884c06a680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38826/0 (socket says 172.21.15.6:38826) 2023-10-06T02:20:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884bfff700 1 -- 172.21.15.6:0/109013043 learned_addr learned my addr 172.21.15.6:0/109013043 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f885119b700 1 --2- 172.21.15.6:0/109013043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f884c15cde0 0x7f884c1642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884b7fe700 1 -- 172.21.15.6:0/109013043 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379119686 0 0) 0x7f884c0b1ed0 con 0x7f884c067d10 2023-10-06T02:20:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884b7fe700 1 -- 172.21.15.6:0/109013043 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8834003570 con 0x7f884c067d10 2023-10-06T02:20:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884b7fe700 1 -- 172.21.15.6:0/109013043 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680522461 0 0) 0x7f884c0879c0 con 0x7f884c15ca10 2023-10-06T02:20:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884b7fe700 1 -- 172.21.15.6:0/109013043 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f884c0b1ed0 con 0x7f884c15ca10 2023-10-06T02:20:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884b7fe700 1 -- 172.21.15.6:0/109013043 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2742987701 0 0) 0x7f8834003570 con 0x7f884c067d10 2023-10-06T02:20:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884b7fe700 1 -- 172.21.15.6:0/109013043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f884c15cde0 msgr2=0x7f884c1642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884b7fe700 1 --2- 172.21.15.6:0/109013043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f884c15cde0 0x7f884c1642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884b7fe700 1 -- 172.21.15.6:0/109013043 >> v1:172.21.15.175:6789/0 conn(0x7f884c15ca10 legacy=0x7f884c069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884b7fe700 1 -- 172.21.15.6:0/109013043 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c0cef30 con 0x7f884c067d10 2023-10-06T02:20:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884b7fe700 1 -- 172.21.15.6:0/109013043 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f8840001470 con 0x7f884c067d10 2023-10-06T02:20:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884b7fe700 1 -- 172.21.15.6:0/109013043 >> v1:172.21.15.6:6789/0 conn(0x7f884c067d10 legacy=0x7f884c06a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884b7fe700 1 --2- 172.21.15.6:0/109013043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8834003c20 0x7f8834004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884b7fe700 1 --2- 172.21.15.6:0/109013043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f884c15cde0 0x7f8834004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884b7fe700 1 --2- 172.21.15.6:0/109013043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8834004d50 0x7f88340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884b7fe700 1 -- 172.21.15.6:0/109013043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0cec50 con 0x7f8834004d50 2023-10-06T02:20:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884b7fe700 1 -- 172.21.15.6:0/109013043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883400bbf0 con 0x7f8834003c20 2023-10-06T02:20:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884b7fe700 1 -- 172.21.15.6:0/109013043 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883400bdb0 con 0x7f884c15cde0 2023-10-06T02:20:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f885119b700 1 --2- 172.21.15.6:0/109013043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8834004d50 0x7f88340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f885099a700 1 --2- 172.21.15.6:0/109013043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8834003c20 0x7f8834004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.599+0000 7f884bfff700 1 --2- 172.21.15.6:0/109013043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f884c15cde0 0x7f8834004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.600+0000 7f885119b700 1 -- 172.21.15.6:0/109013043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f884c15cde0 msgr2=0x7f8834004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.600+0000 7f885119b700 1 --2- 172.21.15.6:0/109013043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f884c15cde0 0x7f8834004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.600+0000 7f885119b700 1 -- 172.21.15.6:0/109013043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8834003c20 msgr2=0x7f8834004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.600+0000 7f885119b700 1 --2- 172.21.15.6:0/109013043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8834003c20 0x7f8834004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.600+0000 7f885119b700 1 -- 172.21.15.6:0/109013043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8834003570 con 0x7f8834004d50 2023-10-06T02:20:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.600+0000 7f885119b700 1 --2- 172.21.15.6:0/109013043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8834004d50 0x7f88340051c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f883c006f00 tx=0x7f883c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875fb7b99cb15e86 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.600+0000 7f884b7fe700 1 -- 172.21.15.6:0/109013043 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c00e710 con 0x7f8834004d50 2023-10-06T02:20:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.600+0000 7f884b7fe700 1 -- 172.21.15.6:0/109013043 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c00e870 con 0x7f8834004d50 2023-10-06T02:20:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.600+0000 7f884b7fe700 1 -- 172.21.15.6:0/109013043 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c00ec30 con 0x7f8834004d50 2023-10-06T02:20:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.600+0000 7f8852bfe700 1 -- 172.21.15.6:0/109013043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8834004d50 msgr2=0x7f88340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.600+0000 7f8852bfe700 1 --2- 172.21.15.6:0/109013043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8834004d50 0x7f88340051c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f883c006f00 tx=0x7f883c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.600+0000 7f885119b700 1 -- 172.21.15.6:0/109013043 reap_dead start 2023-10-06T02:20:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.600+0000 7f8852bfe700 1 -- 172.21.15.6:0/109013043 shutdown_connections 2023-10-06T02:20:11.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.601+0000 7f8852bfe700 1 -- 172.21.15.6:0/109013043 >> 172.21.15.6:0/109013043 conn(0x7f884c067910 msgr2=0x7f884c0ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:11.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.601+0000 7f8852bfe700 1 -- 172.21.15.6:0/109013043 shutdown_connections 2023-10-06T02:20:11.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.601+0000 7f8852bfe700 1 -- 172.21.15.6:0/109013043 wait complete. 2023-10-06T02:20:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.602+0000 7f8852bfe700 1 Processor -- start 2023-10-06T02:20:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.602+0000 7f8852bfe700 1 -- start start 2023-10-06T02:20:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.602+0000 7f8852bfe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8834004d50 0x7f884c155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.602+0000 7f8852bfe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f884c1563a0 0x7f884c152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f8852bfe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f884c152e10 0x7f884c153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f8852bfe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c09bb30 con 0x7f8834004d50 2023-10-06T02:20:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f8852bfe700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c153c00 con 0x7f884c152e10 2023-10-06T02:20:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f8852bfe700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c1537c0 con 0x7f884c1563a0 2023-10-06T02:20:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f885099a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8834004d50 0x7f884c155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f885099a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8834004d50 0x7f884c155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41952/0 (socket says 172.21.15.6:41952) 2023-10-06T02:20:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f885099a700 1 -- 172.21.15.6:0/3078056255 learned_addr learned my addr 172.21.15.6:0/3078056255 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f885119b700 1 --2- 172.21.15.6:0/3078056255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f884c152e10 0x7f884c153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f884bfff700 1 --2- 172.21.15.6:0/3078056255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f884c1563a0 0x7f884c152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f885099a700 1 -- 172.21.15.6:0/3078056255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f884c1563a0 msgr2=0x7f884c152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f885099a700 1 --2- 172.21.15.6:0/3078056255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f884c1563a0 0x7f884c152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f885099a700 1 -- 172.21.15.6:0/3078056255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f884c152e10 msgr2=0x7f884c153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f885099a700 1 --2- 172.21.15.6:0/3078056255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f884c152e10 0x7f884c153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f885099a700 1 -- 172.21.15.6:0/3078056255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c157790 con 0x7f8834004d50 2023-10-06T02:20:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f884bfff700 1 --2- 172.21.15.6:0/3078056255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f884c1563a0 0x7f884c152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f885099a700 1 --2- 172.21.15.6:0/3078056255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8834004d50 0x7f884c155000 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f884400c190 tx=0x7f8844001bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:11.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f8848ff9700 1 -- 172.21.15.6:0/3078056255 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884400cd80 con 0x7f8834004d50 2023-10-06T02:20:11.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f8848ff9700 1 -- 172.21.15.6:0/3078056255 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8844015430 con 0x7f8834004d50 2023-10-06T02:20:11.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f8852bfe700 1 -- 172.21.15.6:0/3078056255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884c152bd0 con 0x7f8834004d50 2023-10-06T02:20:11.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f8848ff9700 1 -- 172.21.15.6:0/3078056255 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88440157f0 con 0x7f8834004d50 2023-10-06T02:20:11.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.603+0000 7f8852bfe700 1 -- 172.21.15.6:0/3078056255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884c156e60 con 0x7f8834004d50 2023-10-06T02:20:11.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.604+0000 7f8852bfe700 1 -- 172.21.15.6:0/3078056255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884c06e8d0 con 0x7f8834004d50 2023-10-06T02:20:11.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.605+0000 7f8848ff9700 1 -- 172.21.15.6:0/3078056255 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8844015ba0 con 0x7f8834004d50 2023-10-06T02:20:11.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.605+0000 7f8848ff9700 1 --2- 172.21.15.6:0/3078056255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8838066f30 0x7f88380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.605+0000 7f8848ff9700 1 -- 172.21.15.6:0/3078056255 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8844085610 con 0x7f8834004d50 2023-10-06T02:20:11.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.605+0000 7f884bfff700 1 --2- 172.21.15.6:0/3078056255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8838066f30 0x7f88380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.606+0000 7f884bfff700 1 --2- 172.21.15.6:0/3078056255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8838066f30 0x7f88380693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8840001bb0 tx=0x7f8840009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:11.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.609+0000 7f8848ff9700 1 -- 172.21.15.6:0/3078056255 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88440525e0 con 0x7f8834004d50 2023-10-06T02:20:11.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.803+0000 7f8852bfe700 1 -- 172.21.15.6:0/3078056255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f884c0b1bf0 con 0x7f8834004d50 2023-10-06T02:20:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.804+0000 7f8848ff9700 1 -- 172.21.15.6:0/3078056255 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+17036 (secure 0 0 0) 0x7f8844055c00 con 0x7f8834004d50 2023-10-06T02:20:11.805 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:11.805 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":53,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:20:10.479530+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:20:08.649152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T02:20:09.450444+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:20:11.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.807+0000 7f8852bfe700 1 -- 172.21.15.6:0/3078056255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8838066f30 msgr2=0x7f88380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.807+0000 7f8852bfe700 1 --2- 172.21.15.6:0/3078056255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8838066f30 0x7f88380693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8840001bb0 tx=0x7f8840009040 comp rx=0 tx=0).stop 2023-10-06T02:20:11.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.807+0000 7f8852bfe700 1 -- 172.21.15.6:0/3078056255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8834004d50 msgr2=0x7f884c155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.807+0000 7f8852bfe700 1 --2- 172.21.15.6:0/3078056255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8834004d50 0x7f884c155000 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f884400c190 tx=0x7f8844001bd0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.807+0000 7f8852bfe700 1 -- 172.21.15.6:0/3078056255 shutdown_connections 2023-10-06T02:20:11.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.807+0000 7f8852bfe700 1 --2- 172.21.15.6:0/3078056255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f884c152e10 0x7f884c153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.807+0000 7f8852bfe700 1 --2- 172.21.15.6:0/3078056255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8838066f30 0x7f88380693e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.807+0000 7f8852bfe700 1 --2- 172.21.15.6:0/3078056255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8834004d50 0x7f884c155000 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.807+0000 7f8852bfe700 1 --2- 172.21.15.6:0/3078056255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f884c1563a0 0x7f884c152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.807+0000 7f8852bfe700 1 -- 172.21.15.6:0/3078056255 >> 172.21.15.6:0/3078056255 conn(0x7f884c067910 msgr2=0x7f884c15a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:11.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.807+0000 7f8852bfe700 1 -- 172.21.15.6:0/3078056255 shutdown_connections 2023-10-06T02:20:11.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.807+0000 7f8852bfe700 1 -- 172.21.15.6:0/3078056255 wait complete. 2023-10-06T02:20:11.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:20:11.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.942+0000 7f43c5ead700 1 Processor -- start 2023-10-06T02:20:11.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.942+0000 7f43c5ead700 1 -- start start 2023-10-06T02:20:11.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.942+0000 7f43c5ead700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43c0153d30 0x7f43c00afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.942+0000 7f43c5ead700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43c0154100 0x7f43c006b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.942+0000 7f43c5ead700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f43c006bba0 0x7f43c00b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.942+0000 7f43c5ead700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c00aeed0 con 0x7f43c0154100 2023-10-06T02:20:11.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.942+0000 7f43c5ead700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c00af9e0 con 0x7f43c006bba0 2023-10-06T02:20:11.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.942+0000 7f43c5ead700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c006bfd0 con 0x7f43c0153d30 2023-10-06T02:20:11.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.943+0000 7f43beffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43c0154100 0x7f43c006b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.943+0000 7f43beffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43c0154100 0x7f43c006b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41958/0 (socket says 172.21.15.6:41958) 2023-10-06T02:20:11.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.943+0000 7f43beffd700 1 -- 172.21.15.6:0/1444637427 learned_addr learned my addr 172.21.15.6:0/1444637427 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:11.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.943+0000 7f43bffff700 1 --2- 172.21.15.6:0/1444637427 >> v2:172.21.15.175:3300/0 conn(0x7f43c006bba0 0x7f43c00b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.943+0000 7f43bf7fe700 1 --2- 172.21.15.6:0/1444637427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43c0153d30 0x7f43c00afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.943+0000 7f43beffd700 1 -- 172.21.15.6:0/1444637427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43c0153d30 msgr2=0x7f43c00afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:11.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.943+0000 7f43beffd700 1 --2- 172.21.15.6:0/1444637427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43c0153d30 0x7f43c00afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.943+0000 7f43beffd700 1 -- 172.21.15.6:0/1444637427 >> v2:172.21.15.175:3300/0 conn(0x7f43c006bba0 msgr2=0x7f43c00b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:11.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.943+0000 7f43beffd700 1 --2- 172.21.15.6:0/1444637427 >> v2:172.21.15.175:3300/0 conn(0x7f43c006bba0 0x7f43c00b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.943+0000 7f43beffd700 1 -- 172.21.15.6:0/1444637427 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c00af0b0 con 0x7f43c0154100 2023-10-06T02:20:11.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.943+0000 7f43beffd700 1 --2- 172.21.15.6:0/1444637427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0154100 0x7f43c006b660 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f43c00c9a10 tx=0x7f43b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482d1669ef820946 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:11.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.943+0000 7f43be7fc700 1 -- 172.21.15.6:0/1444637427 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b400b860 con 0x7f43c0154100 2023-10-06T02:20:11.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.943+0000 7f43be7fc700 1 -- 172.21.15.6:0/1444637427 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b400b9c0 con 0x7f43c0154100 2023-10-06T02:20:11.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.943+0000 7f43be7fc700 1 -- 172.21.15.6:0/1444637427 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b400bd60 con 0x7f43c0154100 2023-10-06T02:20:11.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.944+0000 7f43c5ead700 1 -- 172.21.15.6:0/1444637427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0154100 msgr2=0x7f43c006b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.944+0000 7f43c5ead700 1 --2- 172.21.15.6:0/1444637427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0154100 0x7f43c006b660 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f43c00c9a10 tx=0x7f43b4009250 comp rx=0 tx=0).stop 2023-10-06T02:20:11.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.944+0000 7f43c5ead700 1 -- 172.21.15.6:0/1444637427 shutdown_connections 2023-10-06T02:20:11.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.944+0000 7f43c5ead700 1 --2- 172.21.15.6:0/1444637427 >> v2:172.21.15.175:3300/0 conn(0x7f43c006bba0 0x7f43c00b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.944+0000 7f43c5ead700 1 --2- 172.21.15.6:0/1444637427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43c0153d30 0x7f43c00afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.944+0000 7f43c5ead700 1 --2- 172.21.15.6:0/1444637427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0154100 0x7f43c006b660 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.944+0000 7f43c5ead700 1 -- 172.21.15.6:0/1444637427 >> 172.21.15.6:0/1444637427 conn(0x7f43c00cc110 msgr2=0x7f43c00cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:11.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.944+0000 7f43c5ead700 1 -- 172.21.15.6:0/1444637427 shutdown_connections 2023-10-06T02:20:11.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.944+0000 7f43c5ead700 1 -- 172.21.15.6:0/1444637427 wait complete. 2023-10-06T02:20:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.945+0000 7f43c5ead700 1 Processor -- start 2023-10-06T02:20:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.945+0000 7f43c5ead700 1 -- start start 2023-10-06T02:20:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.946+0000 7f43c5ead700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43c006bba0 0x7f43c0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.946+0000 7f43c5ead700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0153d30 0x7f43c0152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.946+0000 7f43c5ead700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43c0154100 0x7f43c0143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.946+0000 7f43c5ead700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c0153440 con 0x7f43c0153d30 2023-10-06T02:20:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.946+0000 7f43c5ead700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c016e3d0 con 0x7f43c0154100 2023-10-06T02:20:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.946+0000 7f43c5ead700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c0153210 con 0x7f43c006bba0 2023-10-06T02:20:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.946+0000 7f43beffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0153d30 0x7f43c0152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.946+0000 7f43beffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0153d30 0x7f43c0152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41970/0 (socket says 172.21.15.6:41970) 2023-10-06T02:20:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.946+0000 7f43bf7fe700 1 --2- 172.21.15.6:0/2966057386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43c006bba0 0x7f43c0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.946+0000 7f43beffd700 1 -- 172.21.15.6:0/2966057386 learned_addr learned my addr 172.21.15.6:0/2966057386 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.946+0000 7f43bffff700 1 --2- 172.21.15.6:0/2966057386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43c0154100 0x7f43c0143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.946+0000 7f43beffd700 1 -- 172.21.15.6:0/2966057386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43c006bba0 msgr2=0x7f43c0154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.946+0000 7f43beffd700 1 --2- 172.21.15.6:0/2966057386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43c006bba0 0x7f43c0154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.946+0000 7f43beffd700 1 -- 172.21.15.6:0/2966057386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43c0154100 msgr2=0x7f43c0143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.946+0000 7f43beffd700 1 --2- 172.21.15.6:0/2966057386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43c0154100 0x7f43c0143a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.946+0000 7f43beffd700 1 -- 172.21.15.6:0/2966057386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b40094f0 con 0x7f43c0153d30 2023-10-06T02:20:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.946+0000 7f43beffd700 1 --2- 172.21.15.6:0/2966057386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0153d30 0x7f43c0152cd0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f43b4006fd0 tx=0x7f43b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.947+0000 7f43a77fe700 1 -- 172.21.15.6:0/2966057386 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b4011d80 con 0x7f43c0153d30 2023-10-06T02:20:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.947+0000 7f43a77fe700 1 -- 172.21.15.6:0/2966057386 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b4024440 con 0x7f43c0153d30 2023-10-06T02:20:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.947+0000 7f43c5ead700 1 -- 172.21.15.6:0/2966057386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c016df40 con 0x7f43c0153d30 2023-10-06T02:20:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.947+0000 7f43a77fe700 1 -- 172.21.15.6:0/2966057386 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b4024800 con 0x7f43c0153d30 2023-10-06T02:20:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.947+0000 7f43c5ead700 1 -- 172.21.15.6:0/2966057386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c016d8f0 con 0x7f43c0153d30 2023-10-06T02:20:11.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.948+0000 7f43c5ead700 1 -- 172.21.15.6:0/2966057386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c016e0d0 con 0x7f43c0153d30 2023-10-06T02:20:11.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.949+0000 7f43a77fe700 1 -- 172.21.15.6:0/2966057386 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43b401a420 con 0x7f43c0153d30 2023-10-06T02:20:11.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.949+0000 7f43a77fe700 1 --2- 172.21.15.6:0/2966057386 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f43ac066f30 0x7f43ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:11.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.949+0000 7f43a77fe700 1 -- 172.21.15.6:0/2966057386 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f43b4086c40 con 0x7f43c0153d30 2023-10-06T02:20:11.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.949+0000 7f43bf7fe700 1 --2- 172.21.15.6:0/2966057386 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f43ac066f30 0x7f43ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:11.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.950+0000 7f43bf7fe700 1 --2- 172.21.15.6:0/2966057386 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f43ac066f30 0x7f43ac0693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f43b0006fd0 tx=0x7f43b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:11.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:11.953+0000 7f43a77fe700 1 -- 172.21.15.6:0/2966057386 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43b4053c90 con 0x7f43c0153d30 2023-10-06T02:20:12.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:12.193+0000 7f43c5ead700 1 -- 172.21.15.6:0/2966057386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f43c00af390 con 0x7f43c0153d30 2023-10-06T02:20:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.111+0000 7f43a77fe700 1 -- 172.21.15.6:0/2966057386 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7f43b40572b0 con 0x7f43c0153d30 2023-10-06T02:20:13.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.114+0000 7f43c5ead700 1 -- 172.21.15.6:0/2966057386 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f43ac066f30 msgr2=0x7f43ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.114+0000 7f43c5ead700 1 --2- 172.21.15.6:0/2966057386 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f43ac066f30 0x7f43ac0693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f43b0006fd0 tx=0x7f43b0008040 comp rx=0 tx=0).stop 2023-10-06T02:20:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.114+0000 7f43c5ead700 1 -- 172.21.15.6:0/2966057386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0153d30 msgr2=0x7f43c0152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.114+0000 7f43c5ead700 1 --2- 172.21.15.6:0/2966057386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0153d30 0x7f43c0152cd0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f43b4006fd0 tx=0x7f43b4017000 comp rx=0 tx=0).stop 2023-10-06T02:20:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.114+0000 7f43c5ead700 1 -- 172.21.15.6:0/2966057386 shutdown_connections 2023-10-06T02:20:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.114+0000 7f43c5ead700 1 --2- 172.21.15.6:0/2966057386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43c0154100 0x7f43c0143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.114+0000 7f43c5ead700 1 --2- 172.21.15.6:0/2966057386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43c006bba0 0x7f43c0154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.114+0000 7f43c5ead700 1 --2- 172.21.15.6:0/2966057386 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f43ac066f30 0x7f43ac0693e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.114+0000 7f43c5ead700 1 --2- 172.21.15.6:0/2966057386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0153d30 0x7f43c0152cd0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.114+0000 7f43c5ead700 1 -- 172.21.15.6:0/2966057386 >> 172.21.15.6:0/2966057386 conn(0x7f43c00cc110 msgr2=0x7f43c006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.114+0000 7f43c5ead700 1 -- 172.21.15.6:0/2966057386 shutdown_connections 2023-10-06T02:20:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.114+0000 7f43c5ead700 1 -- 172.21.15.6:0/2966057386 wait complete. 2023-10-06T02:20:13.129 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:20:13.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.258+0000 7f7480c54700 1 Processor -- start 2023-10-06T02:20:13.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.258+0000 7f7480c54700 1 -- start start 2023-10-06T02:20:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.259+0000 7f7480c54700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f747c157480 0x7f747c0ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.259+0000 7f7480c54700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f747c06c210 0x7f747c06c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.259+0000 7f7480c54700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747c0acf20 con 0x7f747c1570b0 2023-10-06T02:20:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.259+0000 7f7480c54700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c06cbb0 con 0x7f747c157480 2023-10-06T02:20:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.259+0000 7f7480c54700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c0c6dc0 con 0x7f747c06c210 2023-10-06T02:20:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.260+0000 7f7479d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f747c157480 0x7f747c0ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.260+0000 7f7479d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f747c157480 0x7f747c0ac9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41986/0 (socket says 172.21.15.6:41986) 2023-10-06T02:20:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.260+0000 7f7479d9b700 1 -- 172.21.15.6:0/3476586479 learned_addr learned my addr 172.21.15.6:0/3476586479 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.260+0000 7f747ad9d700 1 --2- 172.21.15.6:0/3476586479 >> v2:172.21.15.175:3300/0 conn(0x7f747c06c210 0x7f747c06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.260+0000 7f7479d9b700 1 -- 172.21.15.6:0/3476586479 >> v2:172.21.15.175:3300/0 conn(0x7f747c06c210 msgr2=0x7f747c06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.260+0000 7f7479d9b700 1 --2- 172.21.15.6:0/3476586479 >> v2:172.21.15.175:3300/0 conn(0x7f747c06c210 0x7f747c06c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.260+0000 7f7479d9b700 1 -- 172.21.15.6:0/3476586479 >> v1:172.21.15.175:6789/0 conn(0x7f747c1570b0 legacy=0x7f747c15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.260+0000 7f7479d9b700 1 -- 172.21.15.6:0/3476586479 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c0c7380 con 0x7f747c157480 2023-10-06T02:20:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.260+0000 7f7479d9b700 1 --2- 172.21.15.6:0/3476586479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f747c157480 0x7f747c0ac9e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f747c06d7d0 tx=0x7f7464009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea89a8643cfefe4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.260+0000 7f747959a700 1 -- 172.21.15.6:0/3476586479 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746400b860 con 0x7f747c157480 2023-10-06T02:20:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.260+0000 7f747959a700 1 -- 172.21.15.6:0/3476586479 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746400b9c0 con 0x7f747c157480 2023-10-06T02:20:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.260+0000 7f747959a700 1 -- 172.21.15.6:0/3476586479 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746400bd60 con 0x7f747c157480 2023-10-06T02:20:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.261+0000 7f7480c54700 1 -- 172.21.15.6:0/3476586479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f747c157480 msgr2=0x7f747c0ac9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.261+0000 7f7480c54700 1 --2- 172.21.15.6:0/3476586479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f747c157480 0x7f747c0ac9e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f747c06d7d0 tx=0x7f7464009250 comp rx=0 tx=0).stop 2023-10-06T02:20:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.261+0000 7f7480c54700 1 -- 172.21.15.6:0/3476586479 shutdown_connections 2023-10-06T02:20:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.261+0000 7f7480c54700 1 --2- 172.21.15.6:0/3476586479 >> v2:172.21.15.175:3300/0 conn(0x7f747c06c210 0x7f747c06c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.261+0000 7f7480c54700 1 --2- 172.21.15.6:0/3476586479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f747c157480 0x7f747c0ac9e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.261+0000 7f7480c54700 1 -- 172.21.15.6:0/3476586479 >> 172.21.15.6:0/3476586479 conn(0x7f747c0c9cc0 msgr2=0x7f747c06acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.261+0000 7f7480c54700 1 -- 172.21.15.6:0/3476586479 shutdown_connections 2023-10-06T02:20:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.261+0000 7f7480c54700 1 -- 172.21.15.6:0/3476586479 wait complete. 2023-10-06T02:20:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.262+0000 7f7480c54700 1 Processor -- start 2023-10-06T02:20:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.262+0000 7f7480c54700 1 -- start start 2023-10-06T02:20:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f7480c54700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f747c06c210 0x7f747c06ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f7480c54700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f747c1570b0 0x7f747c0a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f7480c54700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f747c157480 0x7f747c0a8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f7480c54700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c16abf0 con 0x7f747c157480 2023-10-06T02:20:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f7480c54700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c0ab360 con 0x7f747c06c210 2023-10-06T02:20:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f7480c54700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c0ca350 con 0x7f747c1570b0 2023-10-06T02:20:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f747ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f747c157480 0x7f747c0a8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f747ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f747c157480 0x7f747c0a8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42000/0 (socket says 172.21.15.6:42000) 2023-10-06T02:20:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f747ad9d700 1 -- 172.21.15.6:0/3299452406 learned_addr learned my addr 172.21.15.6:0/3299452406 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f7479d9b700 1 --2- 172.21.15.6:0/3299452406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f747c1570b0 0x7f747c0a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f747a59c700 1 --2- 172.21.15.6:0/3299452406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f747c06c210 0x7f747c06ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f747ad9d700 1 -- 172.21.15.6:0/3299452406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f747c1570b0 msgr2=0x7f747c0a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f747ad9d700 1 --2- 172.21.15.6:0/3299452406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f747c1570b0 0x7f747c0a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f747ad9d700 1 -- 172.21.15.6:0/3299452406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f747c06c210 msgr2=0x7f747c06ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f747ad9d700 1 --2- 172.21.15.6:0/3299452406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f747c06c210 0x7f747c06ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f747ad9d700 1 -- 172.21.15.6:0/3299452406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74640094f0 con 0x7f747c157480 2023-10-06T02:20:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f747ad9d700 1 --2- 172.21.15.6:0/3299452406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f747c157480 0x7f747c0a8e10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f746c007f20 tx=0x7f746c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f74727fc700 1 -- 172.21.15.6:0/3299452406 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c00eb90 con 0x7f747c157480 2023-10-06T02:20:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f74727fc700 1 -- 172.21.15.6:0/3299452406 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c00ed10 con 0x7f747c157480 2023-10-06T02:20:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.263+0000 7f7480c54700 1 -- 172.21.15.6:0/3299452406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747c169e30 con 0x7f747c157480 2023-10-06T02:20:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.264+0000 7f74727fc700 1 -- 172.21.15.6:0/3299452406 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c014670 con 0x7f747c157480 2023-10-06T02:20:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.264+0000 7f7480c54700 1 -- 172.21.15.6:0/3299452406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747c16a3f0 con 0x7f747c157480 2023-10-06T02:20:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.264+0000 7f7480c54700 1 -- 172.21.15.6:0/3299452406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747c06e140 con 0x7f747c157480 2023-10-06T02:20:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.265+0000 7f74727fc700 1 -- 172.21.15.6:0/3299452406 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f746c0149e0 con 0x7f747c157480 2023-10-06T02:20:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.265+0000 7f74727fc700 1 --2- 172.21.15.6:0/3299452406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f745c066f30 0x7f745c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.265+0000 7f74727fc700 1 -- 172.21.15.6:0/3299452406 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f746c084dd0 con 0x7f747c157480 2023-10-06T02:20:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.266+0000 7f747a59c700 1 --2- 172.21.15.6:0/3299452406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f745c066f30 0x7f745c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.266+0000 7f747a59c700 1 --2- 172.21.15.6:0/3299452406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f745c066f30 0x7f745c0693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7474003a80 tx=0x7f7474007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.270+0000 7f74727fc700 1 -- 172.21.15.6:0/3299452406 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f746c051da0 con 0x7f747c157480 2023-10-06T02:20:13.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:13.509+0000 7f7480c54700 1 -- 172.21.15.6:0/3299452406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f747c0abb20 con 0x7f747c157480 2023-10-06T02:20:14.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.113+0000 7f74727fc700 1 -- 172.21.15.6:0/3299452406 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7f746c0553c0 con 0x7f747c157480 2023-10-06T02:20:14.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.115+0000 7f7480c54700 1 -- 172.21.15.6:0/3299452406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f745c066f30 msgr2=0x7f745c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.115+0000 7f7480c54700 1 --2- 172.21.15.6:0/3299452406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f745c066f30 0x7f745c0693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7474003a80 tx=0x7f7474007ec0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.115+0000 7f7480c54700 1 -- 172.21.15.6:0/3299452406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f747c157480 msgr2=0x7f747c0a8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.115+0000 7f7480c54700 1 --2- 172.21.15.6:0/3299452406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f747c157480 0x7f747c0a8e10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f746c007f20 tx=0x7f746c009860 comp rx=0 tx=0).stop 2023-10-06T02:20:14.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.115+0000 7f7480c54700 1 -- 172.21.15.6:0/3299452406 shutdown_connections 2023-10-06T02:20:14.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.115+0000 7f7480c54700 1 --2- 172.21.15.6:0/3299452406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f745c066f30 0x7f745c0693e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.115+0000 7f7480c54700 1 --2- 172.21.15.6:0/3299452406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f747c157480 0x7f747c0a8e10 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.115+0000 7f7480c54700 1 --2- 172.21.15.6:0/3299452406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f747c06c210 0x7f747c06ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.115+0000 7f7480c54700 1 --2- 172.21.15.6:0/3299452406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f747c1570b0 0x7f747c0a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.115+0000 7f7480c54700 1 -- 172.21.15.6:0/3299452406 >> 172.21.15.6:0/3299452406 conn(0x7f747c0c9cc0 msgr2=0x7f747c0b1530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:14.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.115+0000 7f7480c54700 1 -- 172.21.15.6:0/3299452406 shutdown_connections 2023-10-06T02:20:14.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.115+0000 7f7480c54700 1 -- 172.21.15.6:0/3299452406 wait complete. 2023-10-06T02:20:14.129 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:20:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.253+0000 7fe708706700 1 Processor -- start 2023-10-06T02:20:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.253+0000 7fe708706700 1 -- start start 2023-10-06T02:20:14.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.254+0000 7fe708706700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe7000af8b0 0x7fe70015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.254+0000 7fe708706700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7000b27f0 0x7fe70015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.254+0000 7fe708706700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70015e190 con 0x7fe7000af4e0 2023-10-06T02:20:14.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.254+0000 7fe708706700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7000b1910 con 0x7fe7000af8b0 2023-10-06T02:20:14.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.254+0000 7fe708706700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000cb650 con 0x7fe7000b27f0 2023-10-06T02:20:14.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.254+0000 7fe706ca3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7000b27f0 0x7fe70015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.254+0000 7fe705ca1700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe7000af8b0 0x7fe70015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.254+0000 7fe706ca3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7000b27f0 0x7fe70015d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:58670/0 (socket says 172.21.15.6:58670) 2023-10-06T02:20:14.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.254+0000 7fe706ca3700 1 -- 172.21.15.6:0/2333880450 learned_addr learned my addr 172.21.15.6:0/2333880450 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:14.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.254+0000 7fe706ca3700 1 -- 172.21.15.6:0/2333880450 >> v2:172.21.15.175:3300/0 conn(0x7fe7000af8b0 msgr2=0x7fe70015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:14.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.254+0000 7fe706ca3700 1 --2- 172.21.15.6:0/2333880450 >> v2:172.21.15.175:3300/0 conn(0x7fe7000af8b0 0x7fe70015d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.254+0000 7fe706ca3700 1 -- 172.21.15.6:0/2333880450 >> v1:172.21.15.175:6789/0 conn(0x7fe7000af4e0 legacy=0x7fe7000b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.254+0000 7fe706ca3700 1 -- 172.21.15.6:0/2333880450 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7000ccaf0 con 0x7fe7000b27f0 2023-10-06T02:20:14.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.254+0000 7fe705ca1700 1 --2- 172.21.15.6:0/2333880450 >> v2:172.21.15.175:3300/0 conn(0x7fe7000af8b0 0x7fe70015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:20:14.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.255+0000 7fe706ca3700 1 --2- 172.21.15.6:0/2333880450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7000b27f0 0x7fe70015d9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009f20 tx=0x7fe6f8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17cdfbb5c9593eae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:14.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.255+0000 7fe7054a0700 1 -- 172.21.15.6:0/2333880450 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f800e070 con 0x7fe7000b27f0 2023-10-06T02:20:14.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.255+0000 7fe7054a0700 1 -- 172.21.15.6:0/2333880450 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f800b9d0 con 0x7fe7000b27f0 2023-10-06T02:20:14.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.255+0000 7fe7054a0700 1 -- 172.21.15.6:0/2333880450 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f80092e0 con 0x7fe7000b27f0 2023-10-06T02:20:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.255+0000 7fe708706700 1 -- 172.21.15.6:0/2333880450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7000b27f0 msgr2=0x7fe70015d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.255+0000 7fe708706700 1 --2- 172.21.15.6:0/2333880450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7000b27f0 0x7fe70015d9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009f20 tx=0x7fe6f8009840 comp rx=0 tx=0).stop 2023-10-06T02:20:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.255+0000 7fe708706700 1 -- 172.21.15.6:0/2333880450 shutdown_connections 2023-10-06T02:20:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.255+0000 7fe708706700 1 --2- 172.21.15.6:0/2333880450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7000b27f0 0x7fe70015d9a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.255+0000 7fe708706700 1 --2- 172.21.15.6:0/2333880450 >> v2:172.21.15.175:3300/0 conn(0x7fe7000af8b0 0x7fe70015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.255+0000 7fe708706700 1 -- 172.21.15.6:0/2333880450 >> 172.21.15.6:0/2333880450 conn(0x7fe700068680 msgr2=0x7fe700068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.255+0000 7fe708706700 1 -- 172.21.15.6:0/2333880450 shutdown_connections 2023-10-06T02:20:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.255+0000 7fe708706700 1 -- 172.21.15.6:0/2333880450 wait complete. 2023-10-06T02:20:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.256+0000 7fe708706700 1 Processor -- start 2023-10-06T02:20:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.257+0000 7fe708706700 1 -- start start 2023-10-06T02:20:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.257+0000 7fe708706700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7000af4e0 0x7fe70016aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.257+0000 7fe708706700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7000af8b0 0x7fe7000cf330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.257+0000 7fe708706700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7000b27f0 0x7fe7000a8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.257+0000 7fe708706700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000d0ce0 con 0x7fe7000af8b0 2023-10-06T02:20:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.257+0000 7fe708706700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000a8510 con 0x7fe7000af4e0 2023-10-06T02:20:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.257+0000 7fe708706700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70016de00 con 0x7fe7000b27f0 2023-10-06T02:20:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.257+0000 7fe705ca1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7000af8b0 0x7fe7000cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.257+0000 7fe705ca1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7000af8b0 0x7fe7000cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42004/0 (socket says 172.21.15.6:42004) 2023-10-06T02:20:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.257+0000 7fe705ca1700 1 -- 172.21.15.6:0/2260998143 learned_addr learned my addr 172.21.15.6:0/2260998143 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.257+0000 7fe7064a2700 1 --2- 172.21.15.6:0/2260998143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7000af4e0 0x7fe70016aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.258+0000 7fe706ca3700 1 --2- 172.21.15.6:0/2260998143 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7000b27f0 0x7fe7000a8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.258+0000 7fe705ca1700 1 -- 172.21.15.6:0/2260998143 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7000b27f0 msgr2=0x7fe7000a8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.258+0000 7fe705ca1700 1 --2- 172.21.15.6:0/2260998143 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7000b27f0 0x7fe7000a8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.258+0000 7fe705ca1700 1 -- 172.21.15.6:0/2260998143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7000af4e0 msgr2=0x7fe70016aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.258+0000 7fe705ca1700 1 --2- 172.21.15.6:0/2260998143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7000af4e0 0x7fe70016aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.258+0000 7fe705ca1700 1 -- 172.21.15.6:0/2260998143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f0009420 con 0x7fe7000af8b0 2023-10-06T02:20:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.258+0000 7fe705ca1700 1 --2- 172.21.15.6:0/2260998143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7000af8b0 0x7fe7000cf330 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe6f000ec50 tx=0x7fe6f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.258+0000 7fe6f67fc700 1 -- 172.21.15.6:0/2260998143 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f000c850 con 0x7fe7000af8b0 2023-10-06T02:20:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.258+0000 7fe6f67fc700 1 -- 172.21.15.6:0/2260998143 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f000c9b0 con 0x7fe7000af8b0 2023-10-06T02:20:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.258+0000 7fe708706700 1 -- 172.21.15.6:0/2260998143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f8009ae0 con 0x7fe7000af8b0 2023-10-06T02:20:14.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.258+0000 7fe6f67fc700 1 -- 172.21.15.6:0/2260998143 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f000cd50 con 0x7fe7000af8b0 2023-10-06T02:20:14.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.258+0000 7fe708706700 1 -- 172.21.15.6:0/2260998143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7000d0a00 con 0x7fe7000af8b0 2023-10-06T02:20:14.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.259+0000 7fe708706700 1 -- 172.21.15.6:0/2260998143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe700088aa0 con 0x7fe7000af8b0 2023-10-06T02:20:14.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.259+0000 7fe6f67fc700 1 -- 172.21.15.6:0/2260998143 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6f0013680 con 0x7fe7000af8b0 2023-10-06T02:20:14.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.260+0000 7fe6f67fc700 1 --2- 172.21.15.6:0/2260998143 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6e4066f30 0x7fe6e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.260+0000 7fe6f67fc700 1 -- 172.21.15.6:0/2260998143 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe6f0084ad0 con 0x7fe7000af8b0 2023-10-06T02:20:14.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.260+0000 7fe7064a2700 1 --2- 172.21.15.6:0/2260998143 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6e4066f30 0x7fe6e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.261+0000 7fe7064a2700 1 --2- 172.21.15.6:0/2260998143 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6e4066f30 0x7fe6e40693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0039e0 tx=0x7fe6fc007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:14.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.264+0000 7fe6f67fc700 1 -- 172.21.15.6:0/2260998143 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6f0051aa0 con 0x7fe7000af8b0 2023-10-06T02:20:14.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.498+0000 7fe708706700 1 -- 172.21.15.6:0/2260998143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe70016df40 con 0x7fe7000af8b0 2023-10-06T02:20:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.498+0000 7fe6f67fc700 1 -- 172.21.15.6:0/2260998143 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fe6f0084020 con 0x7fe7000af8b0 2023-10-06T02:20:14.501 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:14.501 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":33,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2589522502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2589522502},{"type":"v1","addr":"172.21.15.175:6837","nonce":2589522502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3703329287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3703329287},{"type":"v1","addr":"172.21.15.175:6836","nonce":3703329287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/843207095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":843207095},{"type":"v1","addr":"172.21.15.6:6834","nonce":843207095}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:10.479851+0000","modified":"2023-10-06T02:20:14.110882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1800326966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1800326966},{"type":"v1","addr":"172.21.15.6:6835","nonce":1800326966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:20:14.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.500+0000 7fe708706700 1 -- 172.21.15.6:0/2260998143 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6e4066f30 msgr2=0x7fe6e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.500+0000 7fe708706700 1 --2- 172.21.15.6:0/2260998143 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6e4066f30 0x7fe6e40693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0039e0 tx=0x7fe6fc007ec0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.500+0000 7fe708706700 1 -- 172.21.15.6:0/2260998143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7000af8b0 msgr2=0x7fe7000cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.500+0000 7fe708706700 1 --2- 172.21.15.6:0/2260998143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7000af8b0 0x7fe7000cf330 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe6f000ec50 tx=0x7fe6f00091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.500+0000 7fe708706700 1 -- 172.21.15.6:0/2260998143 shutdown_connections 2023-10-06T02:20:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.500+0000 7fe708706700 1 --2- 172.21.15.6:0/2260998143 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7000b27f0 0x7fe7000a8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.500+0000 7fe708706700 1 --2- 172.21.15.6:0/2260998143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7000af4e0 0x7fe70016aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.500+0000 7fe708706700 1 --2- 172.21.15.6:0/2260998143 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6e4066f30 0x7fe6e40693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.500+0000 7fe708706700 1 --2- 172.21.15.6:0/2260998143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7000af8b0 0x7fe7000cf330 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.500+0000 7fe708706700 1 -- 172.21.15.6:0/2260998143 >> 172.21.15.6:0/2260998143 conn(0x7fe700068680 msgr2=0x7fe70015a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.500+0000 7fe708706700 1 -- 172.21.15.6:0/2260998143 shutdown_connections 2023-10-06T02:20:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.500+0000 7fe708706700 1 -- 172.21.15.6:0/2260998143 wait complete. 2023-10-06T02:20:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 33 2023-10-06T02:20:14.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:20:14.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.632+0000 7fce6e369700 1 Processor -- start 2023-10-06T02:20:14.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.632+0000 7fce6e369700 1 -- start start 2023-10-06T02:20:14.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.633+0000 7fce6e369700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fce680c9f40 0x7fce680ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.633+0000 7fce6e369700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce68069550 con 0x7fce680af620 2023-10-06T02:20:14.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.633+0000 7fce6e369700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce680adb30 con 0x7fce680af250 2023-10-06T02:20:14.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.633+0000 7fce6e369700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce680cddf0 con 0x7fce680c9f40 2023-10-06T02:20:14.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.633+0000 7fce677fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fce680c9f40 0x7fce680ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.633+0000 7fce6c906700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fce680af620 0x7fce680cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38836/0 (socket says 172.21.15.6:38836) 2023-10-06T02:20:14.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.633+0000 7fce677fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fce680c9f40 0x7fce680ad5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42014/0 (socket says 172.21.15.6:42014) 2023-10-06T02:20:14.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.633+0000 7fce6c906700 1 -- 172.21.15.6:0/2771434401 learned_addr learned my addr 172.21.15.6:0/2771434401 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:14.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.634+0000 7fce677fe700 1 -- 172.21.15.6:0/2771434401 >> v1:172.21.15.175:6789/0 conn(0x7fce680af250 legacy=0x7fce680ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.634+0000 7fce677fe700 1 -- 172.21.15.6:0/2771434401 >> v1:172.21.15.6:6789/0 conn(0x7fce680af620 legacy=0x7fce680cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.634+0000 7fce677fe700 1 -- 172.21.15.6:0/2771434401 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce680add80 con 0x7fce680c9f40 2023-10-06T02:20:14.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.634+0000 7fce66ffd700 1 -- 172.21.15.6:0/2771434401 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110776388 0 0) 0x7fce68069550 con 0x7fce680af620 2023-10-06T02:20:14.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.634+0000 7fce677fe700 1 --2- 172.21.15.6:0/2771434401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce680c9f40 0x7fce680ad5f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fce580098e0 tx=0x7fce580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcc31ea4e932835 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:14.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.634+0000 7fce66ffd700 1 -- 172.21.15.6:0/2771434401 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce58009e80 con 0x7fce680c9f40 2023-10-06T02:20:14.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.634+0000 7fce66ffd700 1 -- 172.21.15.6:0/2771434401 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5800b860 con 0x7fce680c9f40 2023-10-06T02:20:14.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.634+0000 7fce66ffd700 1 -- 172.21.15.6:0/2771434401 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5800bbe0 con 0x7fce680c9f40 2023-10-06T02:20:14.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.634+0000 7fce6e369700 1 -- 172.21.15.6:0/2771434401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce680c9f40 msgr2=0x7fce680ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.634+0000 7fce6e369700 1 --2- 172.21.15.6:0/2771434401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce680c9f40 0x7fce680ad5f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fce580098e0 tx=0x7fce580091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.634+0000 7fce6e369700 1 -- 172.21.15.6:0/2771434401 shutdown_connections 2023-10-06T02:20:14.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.634+0000 7fce6e369700 1 --2- 172.21.15.6:0/2771434401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce680c9f40 0x7fce680ad5f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.634+0000 7fce6e369700 1 -- 172.21.15.6:0/2771434401 >> 172.21.15.6:0/2771434401 conn(0x7fce68069790 msgr2=0x7fce68069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:14.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.634+0000 7fce6e369700 1 -- 172.21.15.6:0/2771434401 shutdown_connections 2023-10-06T02:20:14.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.634+0000 7fce6e369700 1 -- 172.21.15.6:0/2771434401 wait complete. 2023-10-06T02:20:14.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.636+0000 7fce6e369700 1 Processor -- start 2023-10-06T02:20:14.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.636+0000 7fce6e369700 1 -- start start 2023-10-06T02:20:14.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.636+0000 7fce6e369700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce680af250 0x7fce68151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.636+0000 7fce6e369700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce680af620 0x7fce680b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.636+0000 7fce6e369700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce680c9f40 0x7fce680cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.636+0000 7fce6e369700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce680aff10 con 0x7fce680c9f40 2023-10-06T02:20:14.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.636+0000 7fce6e369700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce68151590 con 0x7fce680af620 2023-10-06T02:20:14.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.636+0000 7fce6e369700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce680b01b0 con 0x7fce680af250 2023-10-06T02:20:14.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.637+0000 7fce6c906700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce680c9f40 0x7fce680cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.637+0000 7fce6c906700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce680c9f40 0x7fce680cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42030/0 (socket says 172.21.15.6:42030) 2023-10-06T02:20:14.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.637+0000 7fce6c906700 1 -- 172.21.15.6:0/2525277748 learned_addr learned my addr 172.21.15.6:0/2525277748 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:14.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.637+0000 7fce677fe700 1 --2- 172.21.15.6:0/2525277748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce680af620 0x7fce680b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.637+0000 7fce67fff700 1 --2- 172.21.15.6:0/2525277748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce680af250 0x7fce68151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.637+0000 7fce6c906700 1 -- 172.21.15.6:0/2525277748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce680af250 msgr2=0x7fce68151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.637+0000 7fce6c906700 1 --2- 172.21.15.6:0/2525277748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce680af250 0x7fce68151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.637+0000 7fce6c906700 1 -- 172.21.15.6:0/2525277748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce680af620 msgr2=0x7fce680b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.637+0000 7fce6c906700 1 --2- 172.21.15.6:0/2525277748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce680af620 0x7fce680b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.637+0000 7fce6c906700 1 -- 172.21.15.6:0/2525277748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce58009420 con 0x7fce680c9f40 2023-10-06T02:20:14.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.637+0000 7fce6c906700 1 --2- 172.21.15.6:0/2525277748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce680c9f40 0x7fce680cc5d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fce6000cc90 tx=0x7fce60001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:14.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.637+0000 7fce5ffff700 1 -- 172.21.15.6:0/2525277748 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6000a870 con 0x7fce680c9f40 2023-10-06T02:20:14.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.637+0000 7fce5ffff700 1 -- 172.21.15.6:0/2525277748 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6000a9d0 con 0x7fce680c9f40 2023-10-06T02:20:14.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.637+0000 7fce6e369700 1 -- 172.21.15.6:0/2525277748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce680b0490 con 0x7fce680c9f40 2023-10-06T02:20:14.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.637+0000 7fce5ffff700 1 -- 172.21.15.6:0/2525277748 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6000ad90 con 0x7fce680c9f40 2023-10-06T02:20:14.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.637+0000 7fce6e369700 1 -- 172.21.15.6:0/2525277748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce680b0a50 con 0x7fce680c9f40 2023-10-06T02:20:14.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.638+0000 7fce6e369700 1 -- 172.21.15.6:0/2525277748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce680ad910 con 0x7fce680c9f40 2023-10-06T02:20:14.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.639+0000 7fce5ffff700 1 -- 172.21.15.6:0/2525277748 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce60007300 con 0x7fce680c9f40 2023-10-06T02:20:14.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.639+0000 7fce5ffff700 1 --2- 172.21.15.6:0/2525277748 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce48066f30 0x7fce480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.639+0000 7fce5ffff700 1 -- 172.21.15.6:0/2525277748 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fce60084b40 con 0x7fce680c9f40 2023-10-06T02:20:14.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.639+0000 7fce67fff700 1 --2- 172.21.15.6:0/2525277748 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce48066f30 0x7fce480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.640+0000 7fce67fff700 1 --2- 172.21.15.6:0/2525277748 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce48066f30 0x7fce480693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fce50003a80 tx=0x7fce50007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:14.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.644+0000 7fce5ffff700 1 -- 172.21.15.6:0/2525277748 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce60051af0 con 0x7fce680c9f40 2023-10-06T02:20:14.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.838+0000 7fce6e369700 1 -- 172.21.15.6:0/2525277748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce6804bb80 con 0x7fce680c9f40 2023-10-06T02:20:14.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.839+0000 7fce5ffff700 1 -- 172.21.15.6:0/2525277748 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+17023 (secure 0 0 0) 0x7fce60055110 con 0x7fce680c9f40 2023-10-06T02:20:14.839 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:14.839 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":54,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:20:12.091614+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:20:08.649152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T02:20:09.450444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:20:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.841+0000 7fce6e369700 1 -- 172.21.15.6:0/2525277748 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce48066f30 msgr2=0x7fce480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.841+0000 7fce6e369700 1 --2- 172.21.15.6:0/2525277748 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce48066f30 0x7fce480693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fce50003a80 tx=0x7fce50007ec0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.841+0000 7fce6e369700 1 -- 172.21.15.6:0/2525277748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce680c9f40 msgr2=0x7fce680cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.841+0000 7fce6e369700 1 --2- 172.21.15.6:0/2525277748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce680c9f40 0x7fce680cc5d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fce6000cc90 tx=0x7fce60001a20 comp rx=0 tx=0).stop 2023-10-06T02:20:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.841+0000 7fce6e369700 1 -- 172.21.15.6:0/2525277748 shutdown_connections 2023-10-06T02:20:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.841+0000 7fce6e369700 1 --2- 172.21.15.6:0/2525277748 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce48066f30 0x7fce480693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.841+0000 7fce6e369700 1 --2- 172.21.15.6:0/2525277748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce680c9f40 0x7fce680cc5d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.841+0000 7fce6e369700 1 --2- 172.21.15.6:0/2525277748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce680af250 0x7fce68151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.841+0000 7fce6e369700 1 --2- 172.21.15.6:0/2525277748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce680af620 0x7fce680b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.841+0000 7fce6e369700 1 -- 172.21.15.6:0/2525277748 >> 172.21.15.6:0/2525277748 conn(0x7fce68069790 msgr2=0x7fce68153e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.841+0000 7fce6e369700 1 -- 172.21.15.6:0/2525277748 shutdown_connections 2023-10-06T02:20:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.841+0000 7fce6e369700 1 -- 172.21.15.6:0/2525277748 wait complete. 2023-10-06T02:20:14.854 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:20:14.854 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:20:14.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.972+0000 7f436d1d1700 1 Processor -- start 2023-10-06T02:20:14.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.972+0000 7f436d1d1700 1 -- start start 2023-10-06T02:20:14.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.973+0000 7f436d1d1700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f43680af4e0 0x7f43680b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.973+0000 7f436d1d1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436815e190 con 0x7f436815db70 2023-10-06T02:20:14.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.973+0000 7f436d1d1700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43680cb650 con 0x7f43680af8b0 2023-10-06T02:20:14.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.973+0000 7f436d1d1700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43680b1910 con 0x7f43680af4e0 2023-10-06T02:20:14.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.973+0000 7f436759e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f436815db70 0x7f43680cbae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38842/0 (socket says 172.21.15.6:38842) 2023-10-06T02:20:14.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.973+0000 7f436759e700 1 -- 172.21.15.6:0/1273188896 learned_addr learned my addr 172.21.15.6:0/1273188896 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:14.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.973+0000 7f4366d9d700 1 --2- 172.21.15.6:0/1273188896 >> v2:172.21.15.175:3300/0 conn(0x7f43680af4e0 0x7f43680b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f4365d9b700 1 -- 172.21.15.6:0/1273188896 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332453213 0 0) 0x7f436815e190 con 0x7f436815db70 2023-10-06T02:20:14.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f4365d9b700 1 -- 172.21.15.6:0/1273188896 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4354003570 con 0x7f436815db70 2023-10-06T02:20:14.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f4365d9b700 1 -- 172.21.15.6:0/1273188896 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 616993166 0 0) 0x7f4354003570 con 0x7f436815db70 2023-10-06T02:20:14.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f4365d9b700 1 -- 172.21.15.6:0/1273188896 >> v2:172.21.15.175:3300/0 conn(0x7f43680af4e0 msgr2=0x7f43680b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:14.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f4365d9b700 1 --2- 172.21.15.6:0/1273188896 >> v2:172.21.15.175:3300/0 conn(0x7f43680af4e0 0x7f43680b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f4365d9b700 1 -- 172.21.15.6:0/1273188896 >> v1:172.21.15.175:6789/0 conn(0x7f43680af8b0 legacy=0x7f436815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f4365d9b700 1 -- 172.21.15.6:0/1273188896 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43680cad20 con 0x7f436815db70 2023-10-06T02:20:14.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f4365d9b700 1 -- 172.21.15.6:0/1273188896 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f4360001470 con 0x7f436815db70 2023-10-06T02:20:14.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f4365d9b700 1 -- 172.21.15.6:0/1273188896 >> v1:172.21.15.6:6789/0 conn(0x7f436815db70 legacy=0x7f43680cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f4365d9b700 1 --2- 172.21.15.6:0/1273188896 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4354003a60 0x7f4354003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f4365d9b700 1 --2- 172.21.15.6:0/1273188896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4354004810 0x7f4354004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f4365d9b700 1 --2- 172.21.15.6:0/1273188896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43540051c0 0x7f435400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f4365d9b700 1 -- 172.21.15.6:0/1273188896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43680b1910 con 0x7f4354004810 2023-10-06T02:20:14.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f4365d9b700 1 -- 172.21.15.6:0/1273188896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435400c160 con 0x7f43540051c0 2023-10-06T02:20:14.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f4365d9b700 1 -- 172.21.15.6:0/1273188896 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435400c320 con 0x7f4354003a60 2023-10-06T02:20:14.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f436659c700 1 --2- 172.21.15.6:0/1273188896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4354004810 0x7f4354004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f4366d9d700 1 --2- 172.21.15.6:0/1273188896 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4354003a60 0x7f4354003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f436759e700 1 --2- 172.21.15.6:0/1273188896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43540051c0 0x7f435400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f436659c700 1 -- 172.21.15.6:0/1273188896 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4354003a60 msgr2=0x7f4354003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:14.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f436659c700 1 --2- 172.21.15.6:0/1273188896 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4354003a60 0x7f4354003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f436659c700 1 -- 172.21.15.6:0/1273188896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43540051c0 msgr2=0x7f435400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:14.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f436659c700 1 --2- 172.21.15.6:0/1273188896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43540051c0 0x7f435400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f436659c700 1 -- 172.21.15.6:0/1273188896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4354003570 con 0x7f4354004810 2023-10-06T02:20:14.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f436759e700 1 -- 172.21.15.6:0/1273188896 reap_dead start 2023-10-06T02:20:14.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.974+0000 7f436659c700 1 --2- 172.21.15.6:0/1273188896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4354004810 0x7f4354004c80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4350001880 tx=0x7f4350007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d591f3d76d1c31 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:14.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.975+0000 7f4365d9b700 1 -- 172.21.15.6:0/1273188896 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4350012420 con 0x7f4354004810 2023-10-06T02:20:14.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.975+0000 7f4365d9b700 1 -- 172.21.15.6:0/1273188896 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43500125a0 con 0x7f4354004810 2023-10-06T02:20:14.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.975+0000 7f4365d9b700 1 -- 172.21.15.6:0/1273188896 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4350012960 con 0x7f4354004810 2023-10-06T02:20:14.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.975+0000 7f436d1d1700 1 -- 172.21.15.6:0/1273188896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4354004810 msgr2=0x7f4354004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.975+0000 7f436d1d1700 1 --2- 172.21.15.6:0/1273188896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4354004810 0x7f4354004c80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4350001880 tx=0x7f4350007d30 comp rx=0 tx=0).stop 2023-10-06T02:20:14.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.975+0000 7f436d1d1700 1 -- 172.21.15.6:0/1273188896 shutdown_connections 2023-10-06T02:20:14.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.975+0000 7f436d1d1700 1 --2- 172.21.15.6:0/1273188896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4354004810 0x7f4354004c80 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.975+0000 7f436d1d1700 1 -- 172.21.15.6:0/1273188896 >> 172.21.15.6:0/1273188896 conn(0x7f4368068680 msgr2=0x7f4368068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:14.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.975+0000 7f436d1d1700 1 -- 172.21.15.6:0/1273188896 shutdown_connections 2023-10-06T02:20:14.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.975+0000 7f436d1d1700 1 -- 172.21.15.6:0/1273188896 wait complete. 2023-10-06T02:20:14.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.976+0000 7f436d1d1700 1 Processor -- start 2023-10-06T02:20:14.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.976+0000 7f436d1d1700 1 -- start start 2023-10-06T02:20:14.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.977+0000 7f436d1d1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4354004810 0x7f436816a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.977+0000 7f436d1d1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4368159c60 0x7f43680b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.977+0000 7f436d1d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43680b5930 0x7f436815b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.977+0000 7f436d1d1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436816a480 con 0x7f43680b5930 2023-10-06T02:20:14.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.977+0000 7f436d1d1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43680b5e90 con 0x7f4368159c60 2023-10-06T02:20:14.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.977+0000 7f436d1d1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4368169e30 con 0x7f4354004810 2023-10-06T02:20:14.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.977+0000 7f436759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43680b5930 0x7f436815b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.977+0000 7f436759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43680b5930 0x7f436815b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42042/0 (socket says 172.21.15.6:42042) 2023-10-06T02:20:14.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.977+0000 7f436759e700 1 -- 172.21.15.6:0/3528613750 learned_addr learned my addr 172.21.15.6:0/3528613750 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:14.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.977+0000 7f4366d9d700 1 --2- 172.21.15.6:0/3528613750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4354004810 0x7f436816a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.977+0000 7f436659c700 1 --2- 172.21.15.6:0/3528613750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4368159c60 0x7f43680b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.978+0000 7f436759e700 1 -- 172.21.15.6:0/3528613750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4354004810 msgr2=0x7f436816a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.978+0000 7f436759e700 1 --2- 172.21.15.6:0/3528613750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4354004810 0x7f436816a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.978+0000 7f436759e700 1 -- 172.21.15.6:0/3528613750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4368159c60 msgr2=0x7f43680b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:14.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.978+0000 7f436759e700 1 --2- 172.21.15.6:0/3528613750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4368159c60 0x7f43680b53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:14.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.978+0000 7f436759e700 1 -- 172.21.15.6:0/3528613750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436816a110 con 0x7f43680b5930 2023-10-06T02:20:14.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.978+0000 7f436659c700 1 --2- 172.21.15.6:0/3528613750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4368159c60 0x7f43680b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:14.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.978+0000 7f436759e700 1 --2- 172.21.15.6:0/3528613750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43680b5930 0x7f436815b930 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f43680cdd20 tx=0x7f4360001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:14.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.978+0000 7f435effd700 1 -- 172.21.15.6:0/3528613750 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360018030 con 0x7f43680b5930 2023-10-06T02:20:14.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.978+0000 7f435effd700 1 -- 172.21.15.6:0/3528613750 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436000f8a0 con 0x7f43680b5930 2023-10-06T02:20:14.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.978+0000 7f436d1d1700 1 -- 172.21.15.6:0/3528613750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4368169b40 con 0x7f43680b5930 2023-10-06T02:20:14.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.978+0000 7f435effd700 1 -- 172.21.15.6:0/3528613750 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436000fc60 con 0x7f43680b5930 2023-10-06T02:20:14.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.978+0000 7f436d1d1700 1 -- 172.21.15.6:0/3528613750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436815a0d0 con 0x7f43680b5930 2023-10-06T02:20:14.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.979+0000 7f436d1d1700 1 -- 172.21.15.6:0/3528613750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43680a93f0 con 0x7f43680b5930 2023-10-06T02:20:14.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.979+0000 7f435effd700 1 -- 172.21.15.6:0/3528613750 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f436001b070 con 0x7f43680b5930 2023-10-06T02:20:14.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.980+0000 7f435effd700 1 --2- 172.21.15.6:0/3528613750 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4348066f30 0x7f43480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:14.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.980+0000 7f435effd700 1 -- 172.21.15.6:0/3528613750 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4360019070 con 0x7f43680b5930 2023-10-06T02:20:14.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.980+0000 7f4366d9d700 1 --2- 172.21.15.6:0/3528613750 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4348066f30 0x7f43480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:14.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.980+0000 7f4366d9d700 1 --2- 172.21.15.6:0/3528613750 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4348066f30 0x7f43480693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f43580094d0 tx=0x7f435800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:14.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:14.984+0000 7f435effd700 1 -- 172.21.15.6:0/3528613750 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43600515a0 con 0x7f43680b5930 2023-10-06T02:20:15.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.174+0000 7f436d1d1700 1 -- 172.21.15.6:0/3528613750 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43680b0f90 con 0x7f4348066f30 2023-10-06T02:20:15.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.184+0000 7f435effd700 1 -- 172.21.15.6:0/3528613750 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308528 (secure 0 0 0) 0x7f43680b0f90 con 0x7f4348066f30 2023-10-06T02:20:15.188 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:15.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.187+0000 7f436d1d1700 1 -- 172.21.15.6:0/3528613750 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4348066f30 msgr2=0x7f43480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:15.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.187+0000 7f436d1d1700 1 --2- 172.21.15.6:0/3528613750 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4348066f30 0x7f43480693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f43580094d0 tx=0x7f435800b040 comp rx=0 tx=0).stop 2023-10-06T02:20:15.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.187+0000 7f436d1d1700 1 -- 172.21.15.6:0/3528613750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43680b5930 msgr2=0x7f436815b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:15.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.187+0000 7f436d1d1700 1 --2- 172.21.15.6:0/3528613750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43680b5930 0x7f436815b930 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f43680cdd20 tx=0x7f4360001e50 comp rx=0 tx=0).stop 2023-10-06T02:20:15.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.187+0000 7f436d1d1700 1 -- 172.21.15.6:0/3528613750 shutdown_connections 2023-10-06T02:20:15.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.187+0000 7f436d1d1700 1 --2- 172.21.15.6:0/3528613750 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4348066f30 0x7f43480693e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.187+0000 7f436d1d1700 1 --2- 172.21.15.6:0/3528613750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43680b5930 0x7f436815b930 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.187+0000 7f436d1d1700 1 --2- 172.21.15.6:0/3528613750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4354004810 0x7f436816a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.187+0000 7f436d1d1700 1 --2- 172.21.15.6:0/3528613750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4368159c60 0x7f43680b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.187+0000 7f436d1d1700 1 -- 172.21.15.6:0/3528613750 >> 172.21.15.6:0/3528613750 conn(0x7f4368068680 msgr2=0x7f43680ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:15.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.187+0000 7f436d1d1700 1 -- 172.21.15.6:0/3528613750 shutdown_connections 2023-10-06T02:20:15.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.187+0000 7f436d1d1700 1 -- 172.21.15.6:0/3528613750 wait complete. 2023-10-06T02:20:15.192 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:20:15.199 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2023-10-06T02:20:14.596844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384272,"kb_used_data":5968,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590448,"statfs":{"total":773094113280,"available":770652618752,"internally_reserved":0,"allocated":6111232,"data_stored":3448885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.531952"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077680+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:39.810035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075555+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:14.861023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.082516+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:05.611645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.072167+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:36.011425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076702+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:31.183237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070876+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:25.208164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075617+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:06.804501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.082418+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:42.727588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.073768+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.881534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070462+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:47.957631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071570+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:20.004362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070496+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:01.291589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077000+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:47.957631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076524+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:06.782485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075165+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:43.723805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.073125+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:36.577978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075385+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:23.573239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077802+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:47.898090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076811+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:55.084065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.079697+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:05.827417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076191+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:13.256587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.079598+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:05.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075862+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:18.142744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.073224+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:30.195818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077150+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:43.005759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071364+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:52.839061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.073451+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.881534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077514+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:33.121275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.080078+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:00.856511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076913+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:47.078327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076241+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:48.392066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070626+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:58.684533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071824+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:46.518154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.078526+0000","last_change":"2023-10-06T02:20:10.078526+0000","last_active":"2023-10-06T02:20:10.078526+0000","last_peered":"2023-10-06T02:20:10.078526+0000","last_clean":"2023-10-06T02:20:10.078526+0000","last_became_active":"2023-10-06T02:20:10.078260+0000","last_became_peered":"2023-10-06T02:20:10.078260+0000","last_unstale":"2023-10-06T02:20:10.078526+0000","last_undegraded":"2023-10-06T02:20:10.078526+0000","last_fullsized":"2023-10-06T02:20:10.078526+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:40.895709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071010+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:54:21.940162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.090120+0000","last_change":"2023-10-06T02:20:10.090120+0000","last_active":"2023-10-06T02:20:10.090120+0000","last_peered":"2023-10-06T02:20:10.090120+0000","last_clean":"2023-10-06T02:20:10.090120+0000","last_became_active":"2023-10-06T02:20:10.089825+0000","last_became_peered":"2023-10-06T02:20:10.089825+0000","last_unstale":"2023-10-06T02:20:10.090120+0000","last_undegraded":"2023-10-06T02:20:10.090120+0000","last_fullsized":"2023-10-06T02:20:10.090120+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:36.079964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071094+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:24.022995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.076720+0000","last_change":"2023-10-06T02:20:10.076720+0000","last_active":"2023-10-06T02:20:10.076720+0000","last_peered":"2023-10-06T02:20:10.076720+0000","last_clean":"2023-10-06T02:20:10.076720+0000","last_became_active":"2023-10-06T02:20:10.076476+0000","last_became_peered":"2023-10-06T02:20:10.076476+0000","last_unstale":"2023-10-06T02:20:10.076720+0000","last_undegraded":"2023-10-06T02:20:10.076720+0000","last_fullsized":"2023-10-06T02:20:10.076720+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:35.007248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.072918+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:06.452376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.084644+0000","last_change":"2023-10-06T02:20:10.084644+0000","last_active":"2023-10-06T02:20:10.084644+0000","last_peered":"2023-10-06T02:20:10.084644+0000","last_clean":"2023-10-06T02:20:10.084644+0000","last_became_active":"2023-10-06T02:20:10.084341+0000","last_became_peered":"2023-10-06T02:20:10.084341+0000","last_unstale":"2023-10-06T02:20:10.084644+0000","last_undegraded":"2023-10-06T02:20:10.084644+0000","last_fullsized":"2023-10-06T02:20:10.084644+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:21:39.310837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.079108+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:18.081636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.086329+0000","last_change":"2023-10-06T02:20:10.086329+0000","last_active":"2023-10-06T02:20:10.086329+0000","last_peered":"2023-10-06T02:20:10.086329+0000","last_clean":"2023-10-06T02:20:10.086329+0000","last_became_active":"2023-10-06T02:20:10.086046+0000","last_became_peered":"2023-10-06T02:20:10.086046+0000","last_unstale":"2023-10-06T02:20:10.086329+0000","last_undegraded":"2023-10-06T02:20:10.086329+0000","last_fullsized":"2023-10-06T02:20:10.086329+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:29.725518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074636+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:06.782485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.082327+0000","last_change":"2023-10-06T02:20:10.082327+0000","last_active":"2023-10-06T02:20:10.082327+0000","last_peered":"2023-10-06T02:20:10.082327+0000","last_clean":"2023-10-06T02:20:10.082327+0000","last_became_active":"2023-10-06T02:20:10.081996+0000","last_became_peered":"2023-10-06T02:20:10.081996+0000","last_unstale":"2023-10-06T02:20:10.082327+0000","last_undegraded":"2023-10-06T02:20:10.082327+0000","last_fullsized":"2023-10-06T02:20:10.082327+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:14.124501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.072687+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:20.143693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.079757+0000","last_change":"2023-10-06T02:20:10.079757+0000","last_active":"2023-10-06T02:20:10.079757+0000","last_peered":"2023-10-06T02:20:10.079757+0000","last_clean":"2023-10-06T02:20:10.079757+0000","last_became_active":"2023-10-06T02:20:10.079351+0000","last_became_peered":"2023-10-06T02:20:10.079351+0000","last_unstale":"2023-10-06T02:20:10.079757+0000","last_undegraded":"2023-10-06T02:20:10.079757+0000","last_fullsized":"2023-10-06T02:20:10.079757+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:17.138568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074928+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:37.530291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.090205+0000","last_change":"2023-10-06T02:20:10.090205+0000","last_active":"2023-10-06T02:20:10.090205+0000","last_peered":"2023-10-06T02:20:10.090205+0000","last_clean":"2023-10-06T02:20:10.090205+0000","last_became_active":"2023-10-06T02:20:10.089892+0000","last_became_peered":"2023-10-06T02:20:10.089892+0000","last_unstale":"2023-10-06T02:20:10.090205+0000","last_undegraded":"2023-10-06T02:20:10.090205+0000","last_fullsized":"2023-10-06T02:20:10.090205+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.049531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076620+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:37.055350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.091798+0000","last_change":"2023-10-06T02:20:10.091798+0000","last_active":"2023-10-06T02:20:10.091798+0000","last_peered":"2023-10-06T02:20:10.091798+0000","last_clean":"2023-10-06T02:20:10.091798+0000","last_became_active":"2023-10-06T02:20:10.091500+0000","last_became_peered":"2023-10-06T02:20:10.091500+0000","last_unstale":"2023-10-06T02:20:10.091798+0000","last_undegraded":"2023-10-06T02:20:10.091798+0000","last_fullsized":"2023-10-06T02:20:10.091798+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:46.331439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.079689+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:36.011425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.086888+0000","last_change":"2023-10-06T02:20:10.086888+0000","last_active":"2023-10-06T02:20:10.086888+0000","last_peered":"2023-10-06T02:20:10.086888+0000","last_clean":"2023-10-06T02:20:10.086888+0000","last_became_active":"2023-10-06T02:20:10.086534+0000","last_became_peered":"2023-10-06T02:20:10.086534+0000","last_unstale":"2023-10-06T02:20:10.086888+0000","last_undegraded":"2023-10-06T02:20:10.086888+0000","last_fullsized":"2023-10-06T02:20:10.086888+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:35.573802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071028+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:16.770865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.097982+0000","last_change":"2023-10-06T02:20:10.097982+0000","last_active":"2023-10-06T02:20:10.097982+0000","last_peered":"2023-10-06T02:20:10.097982+0000","last_clean":"2023-10-06T02:20:10.097982+0000","last_became_active":"2023-10-06T02:20:10.097762+0000","last_became_peered":"2023-10-06T02:20:10.097762+0000","last_unstale":"2023-10-06T02:20:10.097982+0000","last_undegraded":"2023-10-06T02:20:10.097982+0000","last_fullsized":"2023-10-06T02:20:10.097982+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:37.423409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.079348+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:04.345501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.086470+0000","last_change":"2023-10-06T02:20:10.086470+0000","last_active":"2023-10-06T02:20:10.086470+0000","last_peered":"2023-10-06T02:20:10.086470+0000","last_clean":"2023-10-06T02:20:10.086470+0000","last_became_active":"2023-10-06T02:20:10.086190+0000","last_became_peered":"2023-10-06T02:20:10.086190+0000","last_unstale":"2023-10-06T02:20:10.086470+0000","last_undegraded":"2023-10-06T02:20:10.086470+0000","last_fullsized":"2023-10-06T02:20:10.086470+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:45.513978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071670+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:41.899885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.087539+0000","last_change":"2023-10-06T02:20:10.087539+0000","last_active":"2023-10-06T02:20:10.087539+0000","last_peered":"2023-10-06T02:20:10.087539+0000","last_clean":"2023-10-06T02:20:10.087539+0000","last_became_active":"2023-10-06T02:20:10.086644+0000","last_became_peered":"2023-10-06T02:20:10.086644+0000","last_unstale":"2023-10-06T02:20:10.087539+0000","last_undegraded":"2023-10-06T02:20:10.087539+0000","last_fullsized":"2023-10-06T02:20:10.087539+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.049531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075657+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:24.021258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.088730+0000","last_change":"2023-10-06T02:20:10.088730+0000","last_active":"2023-10-06T02:20:10.088730+0000","last_peered":"2023-10-06T02:20:10.088730+0000","last_clean":"2023-10-06T02:20:10.088730+0000","last_became_active":"2023-10-06T02:20:10.088448+0000","last_became_peered":"2023-10-06T02:20:10.088448+0000","last_unstale":"2023-10-06T02:20:10.088730+0000","last_undegraded":"2023-10-06T02:20:10.088730+0000","last_fullsized":"2023-10-06T02:20:10.088730+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:10.326174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074177+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:30.735219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083978+0000","last_change":"2023-10-06T02:20:10.083978+0000","last_active":"2023-10-06T02:20:10.083978+0000","last_peered":"2023-10-06T02:20:10.083978+0000","last_clean":"2023-10-06T02:20:10.083978+0000","last_became_active":"2023-10-06T02:20:10.083702+0000","last_became_peered":"2023-10-06T02:20:10.083702+0000","last_unstale":"2023-10-06T02:20:10.083978+0000","last_undegraded":"2023-10-06T02:20:10.083978+0000","last_fullsized":"2023-10-06T02:20:10.083978+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:32.118709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075434+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:21:40.315014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.089832+0000","last_change":"2023-10-06T02:20:10.089832+0000","last_active":"2023-10-06T02:20:10.089832+0000","last_peered":"2023-10-06T02:20:10.089832+0000","last_clean":"2023-10-06T02:20:10.089832+0000","last_became_active":"2023-10-06T02:20:10.089490+0000","last_became_peered":"2023-10-06T02:20:10.089490+0000","last_unstale":"2023-10-06T02:20:10.089832+0000","last_undegraded":"2023-10-06T02:20:10.089832+0000","last_fullsized":"2023-10-06T02:20:10.089832+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:00.982977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070432+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:47.898090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.086823+0000","last_change":"2023-10-06T02:20:10.086823+0000","last_active":"2023-10-06T02:20:10.086823+0000","last_peered":"2023-10-06T02:20:10.086823+0000","last_clean":"2023-10-06T02:20:10.086823+0000","last_became_active":"2023-10-06T02:20:10.086536+0000","last_became_peered":"2023-10-06T02:20:10.086536+0000","last_unstale":"2023-10-06T02:20:10.086823+0000","last_undegraded":"2023-10-06T02:20:10.086823+0000","last_fullsized":"2023-10-06T02:20:10.086823+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:10.326174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071540+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:04.345501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.082172+0000","last_change":"2023-10-06T02:20:10.082172+0000","last_active":"2023-10-06T02:20:10.082172+0000","last_peered":"2023-10-06T02:20:10.082172+0000","last_clean":"2023-10-06T02:20:10.082172+0000","last_became_active":"2023-10-06T02:20:10.081872+0000","last_became_peered":"2023-10-06T02:20:10.081872+0000","last_unstale":"2023-10-06T02:20:10.082172+0000","last_undegraded":"2023-10-06T02:20:10.082172+0000","last_fullsized":"2023-10-06T02:20:10.082172+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:04.607469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070422+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:30.195818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083068+0000","last_change":"2023-10-06T02:20:10.083068+0000","last_active":"2023-10-06T02:20:10.083068+0000","last_peered":"2023-10-06T02:20:10.083068+0000","last_clean":"2023-10-06T02:20:10.083068+0000","last_became_active":"2023-10-06T02:20:10.082811+0000","last_became_peered":"2023-10-06T02:20:10.082811+0000","last_unstale":"2023-10-06T02:20:10.083068+0000","last_undegraded":"2023-10-06T02:20:10.083068+0000","last_fullsized":"2023-10-06T02:20:10.083068+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:42.288801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071735+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:37.084141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083108+0000","last_change":"2023-10-06T02:20:10.083108+0000","last_active":"2023-10-06T02:20:10.083108+0000","last_peered":"2023-10-06T02:20:10.083108+0000","last_clean":"2023-10-06T02:20:10.083108+0000","last_became_active":"2023-10-06T02:20:10.082824+0000","last_became_peered":"2023-10-06T02:20:10.082824+0000","last_unstale":"2023-10-06T02:20:10.083108+0000","last_undegraded":"2023-10-06T02:20:10.083108+0000","last_fullsized":"2023-10-06T02:20:10.083108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:12.252411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075066+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:43.723805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.078394+0000","last_change":"2023-10-06T02:20:10.078394+0000","last_active":"2023-10-06T02:20:10.078394+0000","last_peered":"2023-10-06T02:20:10.078394+0000","last_clean":"2023-10-06T02:20:10.078394+0000","last_became_active":"2023-10-06T02:20:10.078110+0000","last_became_peered":"2023-10-06T02:20:10.078110+0000","last_unstale":"2023-10-06T02:20:10.078394+0000","last_undegraded":"2023-10-06T02:20:10.078394+0000","last_fullsized":"2023-10-06T02:20:10.078394+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:36.939948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074825+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:33.122885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.087075+0000","last_change":"2023-10-06T02:20:10.087075+0000","last_active":"2023-10-06T02:20:10.087075+0000","last_peered":"2023-10-06T02:20:10.087075+0000","last_clean":"2023-10-06T02:20:10.087075+0000","last_became_active":"2023-10-06T02:20:10.086766+0000","last_became_peered":"2023-10-06T02:20:10.086766+0000","last_unstale":"2023-10-06T02:20:10.087075+0000","last_undegraded":"2023-10-06T02:20:10.087075+0000","last_fullsized":"2023-10-06T02:20:10.087075+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:05.448199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070371+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:20.143693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.075647+0000","last_change":"2023-10-06T02:20:10.075647+0000","last_active":"2023-10-06T02:20:10.075647+0000","last_peered":"2023-10-06T02:20:10.075647+0000","last_clean":"2023-10-06T02:20:10.075647+0000","last_became_active":"2023-10-06T02:20:10.075395+0000","last_became_peered":"2023-10-06T02:20:10.075395+0000","last_unstale":"2023-10-06T02:20:10.075647+0000","last_undegraded":"2023-10-06T02:20:10.075647+0000","last_fullsized":"2023-10-06T02:20:10.075647+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:52.232393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.073274+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:30.735219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.088960+0000","last_change":"2023-10-06T02:20:10.088960+0000","last_active":"2023-10-06T02:20:10.088960+0000","last_peered":"2023-10-06T02:20:10.088960+0000","last_clean":"2023-10-06T02:20:10.088960+0000","last_became_active":"2023-10-06T02:20:10.088607+0000","last_became_peered":"2023-10-06T02:20:10.088607+0000","last_unstale":"2023-10-06T02:20:10.088960+0000","last_undegraded":"2023-10-06T02:20:10.088960+0000","last_fullsized":"2023-10-06T02:20:10.088960+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:23.018819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.078749+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:23.206192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.085228+0000","last_change":"2023-10-06T02:20:10.085228+0000","last_active":"2023-10-06T02:20:10.085228+0000","last_peered":"2023-10-06T02:20:10.085228+0000","last_clean":"2023-10-06T02:20:10.085228+0000","last_became_active":"2023-10-06T02:20:10.084925+0000","last_became_peered":"2023-10-06T02:20:10.084925+0000","last_unstale":"2023-10-06T02:20:10.085228+0000","last_undegraded":"2023-10-06T02:20:10.085228+0000","last_fullsized":"2023-10-06T02:20:10.085228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:03.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.072867+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:20:09.072867+0000","last_peered":"2023-10-06T02:20:09.072867+0000","last_clean":"2023-10-06T02:20:09.072867+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:20:09.072867+0000","last_undegraded":"2023-10-06T02:20:09.072867+0000","last_fullsized":"2023-10-06T02:20:09.072867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074809+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:37.055350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.087848+0000","last_change":"2023-10-06T02:20:10.087848+0000","last_active":"2023-10-06T02:20:10.087848+0000","last_peered":"2023-10-06T02:20:10.087848+0000","last_clean":"2023-10-06T02:20:10.087848+0000","last_became_active":"2023-10-06T02:20:10.087542+0000","last_became_peered":"2023-10-06T02:20:10.087542+0000","last_unstale":"2023-10-06T02:20:10.087848+0000","last_undegraded":"2023-10-06T02:20:10.087848+0000","last_fullsized":"2023-10-06T02:20:10.087848+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:23.017081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":41,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.065799+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:20:09.065799+0000","last_peered":"2023-10-06T02:20:09.065799+0000","last_clean":"2023-10-06T02:20:09.065799+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:20:09.065799+0000","last_undegraded":"2023-10-06T02:20:09.065799+0000","last_fullsized":"2023-10-06T02:20:09.065799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071975+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:29.053708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083735+0000","last_change":"2023-10-06T02:20:10.083735+0000","last_active":"2023-10-06T02:20:10.083735+0000","last_peered":"2023-10-06T02:20:10.083735+0000","last_clean":"2023-10-06T02:20:10.083735+0000","last_became_active":"2023-10-06T02:20:10.083416+0000","last_became_peered":"2023-10-06T02:20:10.083416+0000","last_unstale":"2023-10-06T02:20:10.083735+0000","last_undegraded":"2023-10-06T02:20:10.083735+0000","last_fullsized":"2023-10-06T02:20:10.083735+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:42.288801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.070646+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:20:09.070646+0000","last_peered":"2023-10-06T02:20:09.070646+0000","last_clean":"2023-10-06T02:20:09.070646+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:20:09.070646+0000","last_undegraded":"2023-10-06T02:20:09.070646+0000","last_fullsized":"2023-10-06T02:20:09.070646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":190,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.072243+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:20:09.072243+0000","last_peered":"2023-10-06T02:20:09.072243+0000","last_clean":"2023-10-06T02:20:09.072243+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:20:09.072243+0000","last_undegraded":"2023-10-06T02:20:09.072243+0000","last_fullsized":"2023-10-06T02:20:09.072243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070303+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:47.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083336+0000","last_change":"2023-10-06T02:20:10.083336+0000","last_active":"2023-10-06T02:20:10.083336+0000","last_peered":"2023-10-06T02:20:10.083336+0000","last_clean":"2023-10-06T02:20:10.083336+0000","last_became_active":"2023-10-06T02:20:10.083061+0000","last_became_peered":"2023-10-06T02:20:10.083061+0000","last_unstale":"2023-10-06T02:20:10.083336+0000","last_undegraded":"2023-10-06T02:20:10.083336+0000","last_fullsized":"2023-10-06T02:20:10.083336+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:05.448199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.071547+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:20:09.071547+0000","last_peered":"2023-10-06T02:20:09.071547+0000","last_clean":"2023-10-06T02:20:09.071547+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:20:09.071547+0000","last_undegraded":"2023-10-06T02:20:09.071547+0000","last_fullsized":"2023-10-06T02:20:09.071547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074530+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:06.804501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.078967+0000","last_change":"2023-10-06T02:20:10.078967+0000","last_active":"2023-10-06T02:20:10.078967+0000","last_peered":"2023-10-06T02:20:10.078967+0000","last_clean":"2023-10-06T02:20:10.078967+0000","last_became_active":"2023-10-06T02:20:10.078653+0000","last_became_peered":"2023-10-06T02:20:10.078653+0000","last_unstale":"2023-10-06T02:20:10.078967+0000","last_undegraded":"2023-10-06T02:20:10.078967+0000","last_fullsized":"2023-10-06T02:20:10.078967+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:52.232393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.072151+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:20:09.072151+0000","last_peered":"2023-10-06T02:20:09.072151+0000","last_clean":"2023-10-06T02:20:09.072151+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:20:09.072151+0000","last_undegraded":"2023-10-06T02:20:09.072151+0000","last_fullsized":"2023-10-06T02:20:09.072151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071797+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:30.729695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.087885+0000","last_change":"2023-10-06T02:20:10.087885+0000","last_active":"2023-10-06T02:20:10.087885+0000","last_peered":"2023-10-06T02:20:10.087885+0000","last_clean":"2023-10-06T02:20:10.087885+0000","last_became_active":"2023-10-06T02:20:10.087566+0000","last_became_peered":"2023-10-06T02:20:10.087566+0000","last_unstale":"2023-10-06T02:20:10.087885+0000","last_undegraded":"2023-10-06T02:20:10.087885+0000","last_fullsized":"2023-10-06T02:20:10.087885+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:01.898029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.071751+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:20:09.071751+0000","last_peered":"2023-10-06T02:20:09.071751+0000","last_clean":"2023-10-06T02:20:09.071751+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:20:09.071751+0000","last_undegraded":"2023-10-06T02:20:09.071751+0000","last_fullsized":"2023-10-06T02:20:09.071751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077399+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:47.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.089395+0000","last_change":"2023-10-06T02:20:10.089395+0000","last_active":"2023-10-06T02:20:10.089395+0000","last_peered":"2023-10-06T02:20:10.089395+0000","last_clean":"2023-10-06T02:20:10.089395+0000","last_became_active":"2023-10-06T02:20:10.088441+0000","last_became_peered":"2023-10-06T02:20:10.088441+0000","last_unstale":"2023-10-06T02:20:10.089395+0000","last_undegraded":"2023-10-06T02:20:10.089395+0000","last_fullsized":"2023-10-06T02:20:10.089395+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:45.513978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.069493+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:20:09.069493+0000","last_peered":"2023-10-06T02:20:09.069493+0000","last_clean":"2023-10-06T02:20:09.069493+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:20:09.069493+0000","last_undegraded":"2023-10-06T02:20:09.069493+0000","last_fullsized":"2023-10-06T02:20:09.069493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070895+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:23.206192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083694+0000","last_change":"2023-10-06T02:20:10.083694+0000","last_active":"2023-10-06T02:20:10.083694+0000","last_peered":"2023-10-06T02:20:10.083694+0000","last_clean":"2023-10-06T02:20:10.083694+0000","last_became_active":"2023-10-06T02:20:10.083428+0000","last_became_peered":"2023-10-06T02:20:10.083428+0000","last_unstale":"2023-10-06T02:20:10.083694+0000","last_undegraded":"2023-10-06T02:20:10.083694+0000","last_fullsized":"2023-10-06T02:20:10.083694+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:51.834884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.069541+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:20:09.069541+0000","last_peered":"2023-10-06T02:20:09.069541+0000","last_clean":"2023-10-06T02:20:09.069541+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:20:09.069541+0000","last_undegraded":"2023-10-06T02:20:09.069541+0000","last_fullsized":"2023-10-06T02:20:09.069541+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298460,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073380,"statfs":{"total":96636764160,"available":96331141120,"internally_reserved":0,"allocated":1200128,"data_stored":868182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.495,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":1.111,"15min":1.111},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.38,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67400000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.499},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":1.008,"15min":1.008},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51300000000000001,"15min":0.504},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":1.075,"15min":1.075},"last":0.629}]},{"osd":2,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75,"5min":1.149,"15min":1.149},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.75,"5min":1.048,"15min":1.048},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.40600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.68300000000000005,"5min":1.175,"15min":1.175},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.44500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71699999999999997,"5min":1.03,"15min":1.03},"last":0.72799999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.30399999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63800000000000001,"5min":0.873,"15min":0.873},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.57699999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.754}]},{"osd":5,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68600000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67700000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69899999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69999999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.78600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297888,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073952,"statfs":{"total":96636764160,"available":96331726848,"internally_reserved":0,"allocated":614400,"data_stored":283789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.82299999999999995,"15min":0.86699999999999999},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.83599999999999997,"15min":0.88200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":0.46899999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68300000000000005,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.371,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":1.002,"15min":1.0780000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69599999999999995,"5min":8.8659999999999997,"15min":8.8659999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69999999999999996,"5min":0.754,"15min":0.754},"last":0.55200000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":1.1100000000000001,"15min":1.198},"min":{"1min":0.48499999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.75,"5min":10.659000000000001,"15min":10.659000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73199999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.30199999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67000000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.495},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.377,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72399999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.35799999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76800000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.40500000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60199999999999998},"min":{"1min":0.41199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.80500000000000005,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.57999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298468,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073372,"statfs":{"total":96636764160,"available":96331132928,"internally_reserved":0,"allocated":1208320,"data_stored":874157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34100000000000003},"min":{"1min":0.23300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35099999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.315},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.376,"15min":0.374},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.60699999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.34699999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.373,"15min":0.36699999999999999},"min":{"1min":0.27600000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.29499999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.32800000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.745,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.505}]},{"osd":5,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61699999999999999,"15min":0.61099999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56899999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.45600000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.48099999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.60899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.47199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":284742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.30499999999999999,"15min":0.29599999999999999},"min":{"1min":0.224,"5min":0.216,"15min":0.216},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.318},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.27400000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.371,"15min":0.36099999999999999},"min":{"1min":0.28699999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.318},"min":{"1min":0.25,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.40999999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.30099999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.40699999999999997,"15min":0.40100000000000002},"min":{"1min":0.313,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.621,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.433}]},{"osd":4,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.60199999999999998},"min":{"1min":0.435,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82199999999999995,"5min":1.369,"15min":1.369},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.55700000000000005,"15min":0.54100000000000004},"min":{"1min":0.42799999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.53000000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82899999999999996,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.62},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56499999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86299999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60199999999999998,"15min":0.58799999999999997},"min":{"1min":0.46700000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":1.083,"15min":1.153},"min":{"1min":0.47799999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.87,"5min":11.138,"15min":11.138},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63,"15min":0.621},"min":{"1min":0.52400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88800000000000001,"5min":1.429,"15min":1.429},"last":0.66100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297888,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073952,"statfs":{"total":96636764160,"available":96331726848,"internally_reserved":0,"allocated":614400,"data_stored":283789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.376,"15min":0.37},"min":{"1min":0.25700000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.27200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.40300000000000002,"15min":0.379},"min":{"1min":0.24299999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.41999999999999998,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.311}]},{"osd":3,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.38100000000000001,"15min":0.36799999999999999},"min":{"1min":0.27500000000000002,"5min":0.252,"15min":0.252},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.42499999999999999,"15min":0.41599999999999998},"min":{"1min":0.312,"5min":0.311,"15min":0.311},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.48099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.626,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.495}]},{"osd":6,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.63400000000000001,"15min":0.624},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.66400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":284742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51700000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.312}]},{"osd":1,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36899999999999999,"15min":0.36699999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.60399999999999998,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40200000000000002,"15min":0.40500000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.58799999999999997,"5min":0.624,"15min":0.624},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53900000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76300000000000001,"5min":0.875,"15min":0.875},"last":0.442},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77200000000000002,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.42499999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61499999999999999,"15min":0.621},"min":{"1min":0.40500000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.748,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.48199999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78700000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53100000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.439,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78600000000000003,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.627,"15min":0.63},"min":{"1min":0.442,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77300000000000002,"5min":1.391,"15min":1.391},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82199999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60199999999999998,"15min":0.59699999999999998},"min":{"1min":0.495,"5min":0.439,"15min":0.439},"max":{"1min":0.79500000000000004,"5min":0.874,"15min":0.874},"last":0.48799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":284742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.42699999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83599999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.626}]},{"osd":1,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":1.1930000000000001,"15min":1.2929999999999999},"min":{"1min":0.42799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77400000000000002,"5min":17.879999999999999,"15min":17.879999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":1.171,"15min":1.272},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84699999999999998,"5min":18.010999999999999,"15min":18.010999999999999},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78500000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54400000000000004,"15min":0.53400000000000003},"min":{"1min":0.437,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.497},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40699999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80300000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58799999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.75,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.627,"15min":0.629},"min":{"1min":0.42199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":284742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":0.71899999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68400000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.54300000000000004,"15min":0.53600000000000003},"min":{"1min":0.38400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.628}]},{"osd":2,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52300000000000002,"15min":0.51500000000000001},"min":{"1min":0.441,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64800000000000002,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.38600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.53100000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.66200000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.51800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.378,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68000000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.33900000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70399999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71299999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72699999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.41999999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74099999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.68500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:20:15.207 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:20:15.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.359+0000 7fb1cf59e700 1 Processor -- start 2023-10-06T02:20:15.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.359+0000 7fb1cf59e700 1 -- start start 2023-10-06T02:20:15.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.360+0000 7fb1cf59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d0069bf0 0x7fb1d00b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:15.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.360+0000 7fb1cf59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb1d0069fc0 0x7fb1d006a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:15.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.360+0000 7fb1cf59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d00b16c0 con 0x7fb1d00ae930 2023-10-06T02:20:15.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.360+0000 7fb1cf59e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d00b1f40 con 0x7fb1d0069fc0 2023-10-06T02:20:15.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.360+0000 7fb1cf59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00b08c0 con 0x7fb1d0069bf0 2023-10-06T02:20:15.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.360+0000 7fb1ced9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb1d00ae930 0x7fb1d00aed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38850/0 (socket says 172.21.15.6:38850) 2023-10-06T02:20:15.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.360+0000 7fb1ced9d700 1 -- 172.21.15.6:0/2614696941 learned_addr learned my addr 172.21.15.6:0/2614696941 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:15.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.360+0000 7fb1ce59c700 1 --2- 172.21.15.6:0/2614696941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d0069bf0 0x7fb1d00b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:15.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.360+0000 7fb1cdd9b700 1 --2- 172.21.15.6:0/2614696941 >> v2:172.21.15.175:3300/0 conn(0x7fb1d0069fc0 0x7fb1d006a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:15.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.360+0000 7fb1cd59a700 1 -- 172.21.15.6:0/2614696941 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963558762 0 0) 0x7fb1d00b16c0 con 0x7fb1d00ae930 2023-10-06T02:20:15.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.360+0000 7fb1cd59a700 1 -- 172.21.15.6:0/2614696941 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1bc003570 con 0x7fb1d00ae930 2023-10-06T02:20:15.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cd59a700 1 -- 172.21.15.6:0/2614696941 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2070687907 0 0) 0x7fb1bc003570 con 0x7fb1d00ae930 2023-10-06T02:20:15.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cd59a700 1 -- 172.21.15.6:0/2614696941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d0069bf0 msgr2=0x7fb1d00b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:15.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cd59a700 1 --2- 172.21.15.6:0/2614696941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d0069bf0 0x7fb1d00b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cd59a700 1 -- 172.21.15.6:0/2614696941 >> v2:172.21.15.175:3300/0 conn(0x7fb1d0069fc0 msgr2=0x7fb1d006a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:15.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cd59a700 1 --2- 172.21.15.6:0/2614696941 >> v2:172.21.15.175:3300/0 conn(0x7fb1d0069fc0 0x7fb1d006a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cd59a700 1 -- 172.21.15.6:0/2614696941 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d006aac0 con 0x7fb1d00ae930 2023-10-06T02:20:15.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cd59a700 1 -- 172.21.15.6:0/2614696941 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fb1c00017f0 con 0x7fb1d00ae930 2023-10-06T02:20:15.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cd59a700 1 -- 172.21.15.6:0/2614696941 >> v1:172.21.15.6:6789/0 conn(0x7fb1d00ae930 legacy=0x7fb1d00aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:15.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cd59a700 1 --2- 172.21.15.6:0/2614696941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1bc003a60 0x7fb1bc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:15.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cd59a700 1 --2- 172.21.15.6:0/2614696941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1bc004810 0x7fb1bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:15.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cd59a700 1 --2- 172.21.15.6:0/2614696941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d0069bf0 0x7fb1bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:15.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cd59a700 1 -- 172.21.15.6:0/2614696941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00b1f40 con 0x7fb1bc004810 2023-10-06T02:20:15.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cd59a700 1 -- 172.21.15.6:0/2614696941 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00b08c0 con 0x7fb1bc003a60 2023-10-06T02:20:15.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cd59a700 1 -- 172.21.15.6:0/2614696941 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc00ba60 con 0x7fb1d0069bf0 2023-10-06T02:20:15.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cdd9b700 1 --2- 172.21.15.6:0/2614696941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1bc004810 0x7fb1bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:15.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1ce59c700 1 --2- 172.21.15.6:0/2614696941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1bc003a60 0x7fb1bc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:15.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1ced9d700 1 --2- 172.21.15.6:0/2614696941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d0069bf0 0x7fb1bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:15.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cdd9b700 1 -- 172.21.15.6:0/2614696941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d0069bf0 msgr2=0x7fb1bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:15.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cdd9b700 1 --2- 172.21.15.6:0/2614696941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d0069bf0 0x7fb1bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cdd9b700 1 -- 172.21.15.6:0/2614696941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1bc003a60 msgr2=0x7fb1bc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:15.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cdd9b700 1 --2- 172.21.15.6:0/2614696941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1bc003a60 0x7fb1bc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cdd9b700 1 -- 172.21.15.6:0/2614696941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc003570 con 0x7fb1bc004810 2023-10-06T02:20:15.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cdd9b700 1 --2- 172.21.15.6:0/2614696941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1bc004810 0x7fb1bc004c80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009c30 tx=0x7fb1b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21863fcd63ad68a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:15.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cd59a700 1 -- 172.21.15.6:0/2614696941 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800e710 con 0x7fb1bc004810 2023-10-06T02:20:15.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cd59a700 1 -- 172.21.15.6:0/2614696941 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b800e870 con 0x7fb1bc004810 2023-10-06T02:20:15.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.361+0000 7fb1cd59a700 1 -- 172.21.15.6:0/2614696941 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800ec30 con 0x7fb1bc004810 2023-10-06T02:20:15.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.362+0000 7fb1cf59e700 1 -- 172.21.15.6:0/2614696941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1bc004810 msgr2=0x7fb1bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:15.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.362+0000 7fb1cf59e700 1 --2- 172.21.15.6:0/2614696941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1bc004810 0x7fb1bc004c80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009c30 tx=0x7fb1b80091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.362+0000 7fb1ced9d700 1 -- 172.21.15.6:0/2614696941 reap_dead start 2023-10-06T02:20:15.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.362+0000 7fb1cf59e700 1 -- 172.21.15.6:0/2614696941 shutdown_connections 2023-10-06T02:20:15.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.362+0000 7fb1cf59e700 1 -- 172.21.15.6:0/2614696941 >> 172.21.15.6:0/2614696941 conn(0x7fb1d0067910 msgr2=0x7fb1d00cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:15.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.362+0000 7fb1cf59e700 1 -- 172.21.15.6:0/2614696941 shutdown_connections 2023-10-06T02:20:15.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.362+0000 7fb1cf59e700 1 -- 172.21.15.6:0/2614696941 wait complete. 2023-10-06T02:20:15.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.363+0000 7fb1cf59e700 1 Processor -- start 2023-10-06T02:20:15.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.363+0000 7fb1cf59e700 1 -- start start 2023-10-06T02:20:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.364+0000 7fb1cf59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1bc004810 0x7fb1d016a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.364+0000 7fb1cf59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1d00cd100 0x7fb1d009a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.364+0000 7fb1cf59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d00cd570 0x7fb1d00988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.364+0000 7fb1cf59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d015af30 con 0x7fb1d00cd100 2023-10-06T02:20:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.364+0000 7fb1cf59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d016a6d0 con 0x7fb1bc004810 2023-10-06T02:20:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.364+0000 7fb1cf59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d009b320 con 0x7fb1d00cd570 2023-10-06T02:20:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.364+0000 7fb1cdd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1d00cd100 0x7fb1d009a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.364+0000 7fb1cdd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1d00cd100 0x7fb1d009a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42058/0 (socket says 172.21.15.6:42058) 2023-10-06T02:20:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.364+0000 7fb1cdd9b700 1 -- 172.21.15.6:0/2700322239 learned_addr learned my addr 172.21.15.6:0/2700322239 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.364+0000 7fb1ce59c700 1 --2- 172.21.15.6:0/2700322239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1bc004810 0x7fb1d016a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.364+0000 7fb1ced9d700 1 --2- 172.21.15.6:0/2700322239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d00cd570 0x7fb1d00988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.364+0000 7fb1cdd9b700 1 -- 172.21.15.6:0/2700322239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d00cd570 msgr2=0x7fb1d00988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.364+0000 7fb1cdd9b700 1 --2- 172.21.15.6:0/2700322239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d00cd570 0x7fb1d00988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.364+0000 7fb1cdd9b700 1 -- 172.21.15.6:0/2700322239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1bc004810 msgr2=0x7fb1d016a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.364+0000 7fb1cdd9b700 1 --2- 172.21.15.6:0/2700322239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1bc004810 0x7fb1d016a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.364+0000 7fb1cdd9b700 1 -- 172.21.15.6:0/2700322239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d015a600 con 0x7fb1d00cd100 2023-10-06T02:20:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.365+0000 7fb1cdd9b700 1 --2- 172.21.15.6:0/2700322239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1d00cd100 0x7fb1d009a8a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0046d0 tx=0x7fb1b801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.365+0000 7fb1c67fc700 1 -- 172.21.15.6:0/2700322239 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8022070 con 0x7fb1d00cd100 2023-10-06T02:20:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.365+0000 7fb1c67fc700 1 -- 172.21.15.6:0/2700322239 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b800e9e0 con 0x7fb1d00cd100 2023-10-06T02:20:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.365+0000 7fb1c67fc700 1 -- 172.21.15.6:0/2700322239 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8006e50 con 0x7fb1d00cd100 2023-10-06T02:20:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.365+0000 7fb1cf59e700 1 -- 172.21.15.6:0/2700322239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d015a8e0 con 0x7fb1d00cd100 2023-10-06T02:20:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.365+0000 7fb1cf59e700 1 -- 172.21.15.6:0/2700322239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d0099630 con 0x7fb1d00cd100 2023-10-06T02:20:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.366+0000 7fb1cf59e700 1 -- 172.21.15.6:0/2700322239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d00cede0 con 0x7fb1d00cd100 2023-10-06T02:20:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.366+0000 7fb1c67fc700 1 -- 172.21.15.6:0/2700322239 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1b801c660 con 0x7fb1d00cd100 2023-10-06T02:20:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.367+0000 7fb1c67fc700 1 --2- 172.21.15.6:0/2700322239 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb1b0066f30 0x7fb1b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.367+0000 7fb1c67fc700 1 -- 172.21.15.6:0/2700322239 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb1b8085ea0 con 0x7fb1d00cd100 2023-10-06T02:20:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.367+0000 7fb1ce59c700 1 --2- 172.21.15.6:0/2700322239 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb1b0066f30 0x7fb1b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.367+0000 7fb1ce59c700 1 --2- 172.21.15.6:0/2700322239 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb1b0066f30 0x7fb1b00693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8006ea0 tx=0x7fb1c8009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.371+0000 7fb1c67fc700 1 -- 172.21.15.6:0/2700322239 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1b8052e70 con 0x7fb1d00cd100 2023-10-06T02:20:15.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.559+0000 7fb1cf59e700 1 -- 172.21.15.6:0/2700322239 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb1d0068420 con 0x7fb1b0066f30 2023-10-06T02:20:15.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.568+0000 7fb1c67fc700 1 -- 172.21.15.6:0/2700322239 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308528 (secure 0 0 0) 0x7fb1d0068420 con 0x7fb1b0066f30 2023-10-06T02:20:15.572 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:15.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.571+0000 7fb1cf59e700 1 -- 172.21.15.6:0/2700322239 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb1b0066f30 msgr2=0x7fb1b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:15.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.571+0000 7fb1cf59e700 1 --2- 172.21.15.6:0/2700322239 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb1b0066f30 0x7fb1b00693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8006ea0 tx=0x7fb1c8009120 comp rx=0 tx=0).stop 2023-10-06T02:20:15.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.572+0000 7fb1cf59e700 1 -- 172.21.15.6:0/2700322239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1d00cd100 msgr2=0x7fb1d009a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:15.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.572+0000 7fb1cf59e700 1 --2- 172.21.15.6:0/2700322239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1d00cd100 0x7fb1d009a8a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0046d0 tx=0x7fb1b801a000 comp rx=0 tx=0).stop 2023-10-06T02:20:15.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.572+0000 7fb1cf59e700 1 -- 172.21.15.6:0/2700322239 shutdown_connections 2023-10-06T02:20:15.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.572+0000 7fb1cf59e700 1 --2- 172.21.15.6:0/2700322239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1d00cd570 0x7fb1d00988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.572+0000 7fb1cf59e700 1 --2- 172.21.15.6:0/2700322239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1bc004810 0x7fb1d016a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.572+0000 7fb1cf59e700 1 --2- 172.21.15.6:0/2700322239 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb1b0066f30 0x7fb1b00693e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.572+0000 7fb1cf59e700 1 --2- 172.21.15.6:0/2700322239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1d00cd100 0x7fb1d009a8a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.572+0000 7fb1cf59e700 1 -- 172.21.15.6:0/2700322239 >> 172.21.15.6:0/2700322239 conn(0x7fb1d0067910 msgr2=0x7fb1d01581d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:15.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.572+0000 7fb1cf59e700 1 -- 172.21.15.6:0/2700322239 shutdown_connections 2023-10-06T02:20:15.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.572+0000 7fb1cf59e700 1 -- 172.21.15.6:0/2700322239 wait complete. 2023-10-06T02:20:15.576 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:20:15.584 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2023-10-06T02:20:14.596844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384272,"kb_used_data":5968,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590448,"statfs":{"total":773094113280,"available":770652618752,"internally_reserved":0,"allocated":6111232,"data_stored":3448885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.531952"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077680+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:39.810035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075555+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:14.861023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.082516+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:05.611645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.072167+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:36.011425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076702+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:31.183237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070876+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:25.208164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075617+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:06.804501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.082418+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:42.727588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.073768+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.881534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070462+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:47.957631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071570+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:20.004362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070496+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:01.291589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077000+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:47.957631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076524+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:06.782485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075165+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:43.723805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.073125+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:36.577978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075385+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:23.573239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077802+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:47.898090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076811+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:55.084065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.079697+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:05.827417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076191+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:13.256587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.079598+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:05.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075862+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:18.142744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.073224+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:30.195818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077150+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:43.005759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071364+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:52.839061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.073451+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.881534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077514+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:33.121275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.080078+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:00.856511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076913+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:47.078327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076241+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:48.392066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070626+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:58.684533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071824+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:46.518154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.078526+0000","last_change":"2023-10-06T02:20:10.078526+0000","last_active":"2023-10-06T02:20:10.078526+0000","last_peered":"2023-10-06T02:20:10.078526+0000","last_clean":"2023-10-06T02:20:10.078526+0000","last_became_active":"2023-10-06T02:20:10.078260+0000","last_became_peered":"2023-10-06T02:20:10.078260+0000","last_unstale":"2023-10-06T02:20:10.078526+0000","last_undegraded":"2023-10-06T02:20:10.078526+0000","last_fullsized":"2023-10-06T02:20:10.078526+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:40.895709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071010+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:54:21.940162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.090120+0000","last_change":"2023-10-06T02:20:10.090120+0000","last_active":"2023-10-06T02:20:10.090120+0000","last_peered":"2023-10-06T02:20:10.090120+0000","last_clean":"2023-10-06T02:20:10.090120+0000","last_became_active":"2023-10-06T02:20:10.089825+0000","last_became_peered":"2023-10-06T02:20:10.089825+0000","last_unstale":"2023-10-06T02:20:10.090120+0000","last_undegraded":"2023-10-06T02:20:10.090120+0000","last_fullsized":"2023-10-06T02:20:10.090120+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:36.079964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071094+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:24.022995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.076720+0000","last_change":"2023-10-06T02:20:10.076720+0000","last_active":"2023-10-06T02:20:10.076720+0000","last_peered":"2023-10-06T02:20:10.076720+0000","last_clean":"2023-10-06T02:20:10.076720+0000","last_became_active":"2023-10-06T02:20:10.076476+0000","last_became_peered":"2023-10-06T02:20:10.076476+0000","last_unstale":"2023-10-06T02:20:10.076720+0000","last_undegraded":"2023-10-06T02:20:10.076720+0000","last_fullsized":"2023-10-06T02:20:10.076720+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:35.007248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.072918+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:06.452376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.084644+0000","last_change":"2023-10-06T02:20:10.084644+0000","last_active":"2023-10-06T02:20:10.084644+0000","last_peered":"2023-10-06T02:20:10.084644+0000","last_clean":"2023-10-06T02:20:10.084644+0000","last_became_active":"2023-10-06T02:20:10.084341+0000","last_became_peered":"2023-10-06T02:20:10.084341+0000","last_unstale":"2023-10-06T02:20:10.084644+0000","last_undegraded":"2023-10-06T02:20:10.084644+0000","last_fullsized":"2023-10-06T02:20:10.084644+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:21:39.310837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.079108+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:18.081636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.086329+0000","last_change":"2023-10-06T02:20:10.086329+0000","last_active":"2023-10-06T02:20:10.086329+0000","last_peered":"2023-10-06T02:20:10.086329+0000","last_clean":"2023-10-06T02:20:10.086329+0000","last_became_active":"2023-10-06T02:20:10.086046+0000","last_became_peered":"2023-10-06T02:20:10.086046+0000","last_unstale":"2023-10-06T02:20:10.086329+0000","last_undegraded":"2023-10-06T02:20:10.086329+0000","last_fullsized":"2023-10-06T02:20:10.086329+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:29.725518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074636+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:06.782485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.082327+0000","last_change":"2023-10-06T02:20:10.082327+0000","last_active":"2023-10-06T02:20:10.082327+0000","last_peered":"2023-10-06T02:20:10.082327+0000","last_clean":"2023-10-06T02:20:10.082327+0000","last_became_active":"2023-10-06T02:20:10.081996+0000","last_became_peered":"2023-10-06T02:20:10.081996+0000","last_unstale":"2023-10-06T02:20:10.082327+0000","last_undegraded":"2023-10-06T02:20:10.082327+0000","last_fullsized":"2023-10-06T02:20:10.082327+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:14.124501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.072687+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:20.143693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.079757+0000","last_change":"2023-10-06T02:20:10.079757+0000","last_active":"2023-10-06T02:20:10.079757+0000","last_peered":"2023-10-06T02:20:10.079757+0000","last_clean":"2023-10-06T02:20:10.079757+0000","last_became_active":"2023-10-06T02:20:10.079351+0000","last_became_peered":"2023-10-06T02:20:10.079351+0000","last_unstale":"2023-10-06T02:20:10.079757+0000","last_undegraded":"2023-10-06T02:20:10.079757+0000","last_fullsized":"2023-10-06T02:20:10.079757+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:17.138568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074928+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:37.530291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.090205+0000","last_change":"2023-10-06T02:20:10.090205+0000","last_active":"2023-10-06T02:20:10.090205+0000","last_peered":"2023-10-06T02:20:10.090205+0000","last_clean":"2023-10-06T02:20:10.090205+0000","last_became_active":"2023-10-06T02:20:10.089892+0000","last_became_peered":"2023-10-06T02:20:10.089892+0000","last_unstale":"2023-10-06T02:20:10.090205+0000","last_undegraded":"2023-10-06T02:20:10.090205+0000","last_fullsized":"2023-10-06T02:20:10.090205+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.049531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076620+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:37.055350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.091798+0000","last_change":"2023-10-06T02:20:10.091798+0000","last_active":"2023-10-06T02:20:10.091798+0000","last_peered":"2023-10-06T02:20:10.091798+0000","last_clean":"2023-10-06T02:20:10.091798+0000","last_became_active":"2023-10-06T02:20:10.091500+0000","last_became_peered":"2023-10-06T02:20:10.091500+0000","last_unstale":"2023-10-06T02:20:10.091798+0000","last_undegraded":"2023-10-06T02:20:10.091798+0000","last_fullsized":"2023-10-06T02:20:10.091798+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:46.331439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.079689+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:36.011425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.086888+0000","last_change":"2023-10-06T02:20:10.086888+0000","last_active":"2023-10-06T02:20:10.086888+0000","last_peered":"2023-10-06T02:20:10.086888+0000","last_clean":"2023-10-06T02:20:10.086888+0000","last_became_active":"2023-10-06T02:20:10.086534+0000","last_became_peered":"2023-10-06T02:20:10.086534+0000","last_unstale":"2023-10-06T02:20:10.086888+0000","last_undegraded":"2023-10-06T02:20:10.086888+0000","last_fullsized":"2023-10-06T02:20:10.086888+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:35.573802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071028+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:16.770865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.097982+0000","last_change":"2023-10-06T02:20:10.097982+0000","last_active":"2023-10-06T02:20:10.097982+0000","last_peered":"2023-10-06T02:20:10.097982+0000","last_clean":"2023-10-06T02:20:10.097982+0000","last_became_active":"2023-10-06T02:20:10.097762+0000","last_became_peered":"2023-10-06T02:20:10.097762+0000","last_unstale":"2023-10-06T02:20:10.097982+0000","last_undegraded":"2023-10-06T02:20:10.097982+0000","last_fullsized":"2023-10-06T02:20:10.097982+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:37.423409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.079348+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:04.345501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.086470+0000","last_change":"2023-10-06T02:20:10.086470+0000","last_active":"2023-10-06T02:20:10.086470+0000","last_peered":"2023-10-06T02:20:10.086470+0000","last_clean":"2023-10-06T02:20:10.086470+0000","last_became_active":"2023-10-06T02:20:10.086190+0000","last_became_peered":"2023-10-06T02:20:10.086190+0000","last_unstale":"2023-10-06T02:20:10.086470+0000","last_undegraded":"2023-10-06T02:20:10.086470+0000","last_fullsized":"2023-10-06T02:20:10.086470+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:45.513978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071670+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:41.899885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.087539+0000","last_change":"2023-10-06T02:20:10.087539+0000","last_active":"2023-10-06T02:20:10.087539+0000","last_peered":"2023-10-06T02:20:10.087539+0000","last_clean":"2023-10-06T02:20:10.087539+0000","last_became_active":"2023-10-06T02:20:10.086644+0000","last_became_peered":"2023-10-06T02:20:10.086644+0000","last_unstale":"2023-10-06T02:20:10.087539+0000","last_undegraded":"2023-10-06T02:20:10.087539+0000","last_fullsized":"2023-10-06T02:20:10.087539+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.049531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075657+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:24.021258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.088730+0000","last_change":"2023-10-06T02:20:10.088730+0000","last_active":"2023-10-06T02:20:10.088730+0000","last_peered":"2023-10-06T02:20:10.088730+0000","last_clean":"2023-10-06T02:20:10.088730+0000","last_became_active":"2023-10-06T02:20:10.088448+0000","last_became_peered":"2023-10-06T02:20:10.088448+0000","last_unstale":"2023-10-06T02:20:10.088730+0000","last_undegraded":"2023-10-06T02:20:10.088730+0000","last_fullsized":"2023-10-06T02:20:10.088730+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:10.326174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074177+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:30.735219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083978+0000","last_change":"2023-10-06T02:20:10.083978+0000","last_active":"2023-10-06T02:20:10.083978+0000","last_peered":"2023-10-06T02:20:10.083978+0000","last_clean":"2023-10-06T02:20:10.083978+0000","last_became_active":"2023-10-06T02:20:10.083702+0000","last_became_peered":"2023-10-06T02:20:10.083702+0000","last_unstale":"2023-10-06T02:20:10.083978+0000","last_undegraded":"2023-10-06T02:20:10.083978+0000","last_fullsized":"2023-10-06T02:20:10.083978+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:32.118709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075434+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:21:40.315014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.089832+0000","last_change":"2023-10-06T02:20:10.089832+0000","last_active":"2023-10-06T02:20:10.089832+0000","last_peered":"2023-10-06T02:20:10.089832+0000","last_clean":"2023-10-06T02:20:10.089832+0000","last_became_active":"2023-10-06T02:20:10.089490+0000","last_became_peered":"2023-10-06T02:20:10.089490+0000","last_unstale":"2023-10-06T02:20:10.089832+0000","last_undegraded":"2023-10-06T02:20:10.089832+0000","last_fullsized":"2023-10-06T02:20:10.089832+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:00.982977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070432+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:47.898090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.086823+0000","last_change":"2023-10-06T02:20:10.086823+0000","last_active":"2023-10-06T02:20:10.086823+0000","last_peered":"2023-10-06T02:20:10.086823+0000","last_clean":"2023-10-06T02:20:10.086823+0000","last_became_active":"2023-10-06T02:20:10.086536+0000","last_became_peered":"2023-10-06T02:20:10.086536+0000","last_unstale":"2023-10-06T02:20:10.086823+0000","last_undegraded":"2023-10-06T02:20:10.086823+0000","last_fullsized":"2023-10-06T02:20:10.086823+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:10.326174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071540+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:04.345501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.082172+0000","last_change":"2023-10-06T02:20:10.082172+0000","last_active":"2023-10-06T02:20:10.082172+0000","last_peered":"2023-10-06T02:20:10.082172+0000","last_clean":"2023-10-06T02:20:10.082172+0000","last_became_active":"2023-10-06T02:20:10.081872+0000","last_became_peered":"2023-10-06T02:20:10.081872+0000","last_unstale":"2023-10-06T02:20:10.082172+0000","last_undegraded":"2023-10-06T02:20:10.082172+0000","last_fullsized":"2023-10-06T02:20:10.082172+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:04.607469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070422+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:30.195818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083068+0000","last_change":"2023-10-06T02:20:10.083068+0000","last_active":"2023-10-06T02:20:10.083068+0000","last_peered":"2023-10-06T02:20:10.083068+0000","last_clean":"2023-10-06T02:20:10.083068+0000","last_became_active":"2023-10-06T02:20:10.082811+0000","last_became_peered":"2023-10-06T02:20:10.082811+0000","last_unstale":"2023-10-06T02:20:10.083068+0000","last_undegraded":"2023-10-06T02:20:10.083068+0000","last_fullsized":"2023-10-06T02:20:10.083068+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:42.288801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071735+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:37.084141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083108+0000","last_change":"2023-10-06T02:20:10.083108+0000","last_active":"2023-10-06T02:20:10.083108+0000","last_peered":"2023-10-06T02:20:10.083108+0000","last_clean":"2023-10-06T02:20:10.083108+0000","last_became_active":"2023-10-06T02:20:10.082824+0000","last_became_peered":"2023-10-06T02:20:10.082824+0000","last_unstale":"2023-10-06T02:20:10.083108+0000","last_undegraded":"2023-10-06T02:20:10.083108+0000","last_fullsized":"2023-10-06T02:20:10.083108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:12.252411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075066+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:43.723805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.078394+0000","last_change":"2023-10-06T02:20:10.078394+0000","last_active":"2023-10-06T02:20:10.078394+0000","last_peered":"2023-10-06T02:20:10.078394+0000","last_clean":"2023-10-06T02:20:10.078394+0000","last_became_active":"2023-10-06T02:20:10.078110+0000","last_became_peered":"2023-10-06T02:20:10.078110+0000","last_unstale":"2023-10-06T02:20:10.078394+0000","last_undegraded":"2023-10-06T02:20:10.078394+0000","last_fullsized":"2023-10-06T02:20:10.078394+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:36.939948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074825+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:33.122885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.087075+0000","last_change":"2023-10-06T02:20:10.087075+0000","last_active":"2023-10-06T02:20:10.087075+0000","last_peered":"2023-10-06T02:20:10.087075+0000","last_clean":"2023-10-06T02:20:10.087075+0000","last_became_active":"2023-10-06T02:20:10.086766+0000","last_became_peered":"2023-10-06T02:20:10.086766+0000","last_unstale":"2023-10-06T02:20:10.087075+0000","last_undegraded":"2023-10-06T02:20:10.087075+0000","last_fullsized":"2023-10-06T02:20:10.087075+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:05.448199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070371+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:20.143693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.075647+0000","last_change":"2023-10-06T02:20:10.075647+0000","last_active":"2023-10-06T02:20:10.075647+0000","last_peered":"2023-10-06T02:20:10.075647+0000","last_clean":"2023-10-06T02:20:10.075647+0000","last_became_active":"2023-10-06T02:20:10.075395+0000","last_became_peered":"2023-10-06T02:20:10.075395+0000","last_unstale":"2023-10-06T02:20:10.075647+0000","last_undegraded":"2023-10-06T02:20:10.075647+0000","last_fullsized":"2023-10-06T02:20:10.075647+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:52.232393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.073274+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:30.735219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.088960+0000","last_change":"2023-10-06T02:20:10.088960+0000","last_active":"2023-10-06T02:20:10.088960+0000","last_peered":"2023-10-06T02:20:10.088960+0000","last_clean":"2023-10-06T02:20:10.088960+0000","last_became_active":"2023-10-06T02:20:10.088607+0000","last_became_peered":"2023-10-06T02:20:10.088607+0000","last_unstale":"2023-10-06T02:20:10.088960+0000","last_undegraded":"2023-10-06T02:20:10.088960+0000","last_fullsized":"2023-10-06T02:20:10.088960+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:23.018819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.078749+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:23.206192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.085228+0000","last_change":"2023-10-06T02:20:10.085228+0000","last_active":"2023-10-06T02:20:10.085228+0000","last_peered":"2023-10-06T02:20:10.085228+0000","last_clean":"2023-10-06T02:20:10.085228+0000","last_became_active":"2023-10-06T02:20:10.084925+0000","last_became_peered":"2023-10-06T02:20:10.084925+0000","last_unstale":"2023-10-06T02:20:10.085228+0000","last_undegraded":"2023-10-06T02:20:10.085228+0000","last_fullsized":"2023-10-06T02:20:10.085228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:03.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.072867+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:20:09.072867+0000","last_peered":"2023-10-06T02:20:09.072867+0000","last_clean":"2023-10-06T02:20:09.072867+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:20:09.072867+0000","last_undegraded":"2023-10-06T02:20:09.072867+0000","last_fullsized":"2023-10-06T02:20:09.072867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074809+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:37.055350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.087848+0000","last_change":"2023-10-06T02:20:10.087848+0000","last_active":"2023-10-06T02:20:10.087848+0000","last_peered":"2023-10-06T02:20:10.087848+0000","last_clean":"2023-10-06T02:20:10.087848+0000","last_became_active":"2023-10-06T02:20:10.087542+0000","last_became_peered":"2023-10-06T02:20:10.087542+0000","last_unstale":"2023-10-06T02:20:10.087848+0000","last_undegraded":"2023-10-06T02:20:10.087848+0000","last_fullsized":"2023-10-06T02:20:10.087848+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:23.017081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":41,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.065799+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:20:09.065799+0000","last_peered":"2023-10-06T02:20:09.065799+0000","last_clean":"2023-10-06T02:20:09.065799+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:20:09.065799+0000","last_undegraded":"2023-10-06T02:20:09.065799+0000","last_fullsized":"2023-10-06T02:20:09.065799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071975+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:29.053708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083735+0000","last_change":"2023-10-06T02:20:10.083735+0000","last_active":"2023-10-06T02:20:10.083735+0000","last_peered":"2023-10-06T02:20:10.083735+0000","last_clean":"2023-10-06T02:20:10.083735+0000","last_became_active":"2023-10-06T02:20:10.083416+0000","last_became_peered":"2023-10-06T02:20:10.083416+0000","last_unstale":"2023-10-06T02:20:10.083735+0000","last_undegraded":"2023-10-06T02:20:10.083735+0000","last_fullsized":"2023-10-06T02:20:10.083735+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:42.288801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.070646+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:20:09.070646+0000","last_peered":"2023-10-06T02:20:09.070646+0000","last_clean":"2023-10-06T02:20:09.070646+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:20:09.070646+0000","last_undegraded":"2023-10-06T02:20:09.070646+0000","last_fullsized":"2023-10-06T02:20:09.070646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":190,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.072243+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:20:09.072243+0000","last_peered":"2023-10-06T02:20:09.072243+0000","last_clean":"2023-10-06T02:20:09.072243+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:20:09.072243+0000","last_undegraded":"2023-10-06T02:20:09.072243+0000","last_fullsized":"2023-10-06T02:20:09.072243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070303+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:47.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083336+0000","last_change":"2023-10-06T02:20:10.083336+0000","last_active":"2023-10-06T02:20:10.083336+0000","last_peered":"2023-10-06T02:20:10.083336+0000","last_clean":"2023-10-06T02:20:10.083336+0000","last_became_active":"2023-10-06T02:20:10.083061+0000","last_became_peered":"2023-10-06T02:20:10.083061+0000","last_unstale":"2023-10-06T02:20:10.083336+0000","last_undegraded":"2023-10-06T02:20:10.083336+0000","last_fullsized":"2023-10-06T02:20:10.083336+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:05.448199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.071547+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:20:09.071547+0000","last_peered":"2023-10-06T02:20:09.071547+0000","last_clean":"2023-10-06T02:20:09.071547+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:20:09.071547+0000","last_undegraded":"2023-10-06T02:20:09.071547+0000","last_fullsized":"2023-10-06T02:20:09.071547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074530+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:06.804501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.078967+0000","last_change":"2023-10-06T02:20:10.078967+0000","last_active":"2023-10-06T02:20:10.078967+0000","last_peered":"2023-10-06T02:20:10.078967+0000","last_clean":"2023-10-06T02:20:10.078967+0000","last_became_active":"2023-10-06T02:20:10.078653+0000","last_became_peered":"2023-10-06T02:20:10.078653+0000","last_unstale":"2023-10-06T02:20:10.078967+0000","last_undegraded":"2023-10-06T02:20:10.078967+0000","last_fullsized":"2023-10-06T02:20:10.078967+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:52.232393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.072151+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:20:09.072151+0000","last_peered":"2023-10-06T02:20:09.072151+0000","last_clean":"2023-10-06T02:20:09.072151+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:20:09.072151+0000","last_undegraded":"2023-10-06T02:20:09.072151+0000","last_fullsized":"2023-10-06T02:20:09.072151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071797+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:30.729695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.087885+0000","last_change":"2023-10-06T02:20:10.087885+0000","last_active":"2023-10-06T02:20:10.087885+0000","last_peered":"2023-10-06T02:20:10.087885+0000","last_clean":"2023-10-06T02:20:10.087885+0000","last_became_active":"2023-10-06T02:20:10.087566+0000","last_became_peered":"2023-10-06T02:20:10.087566+0000","last_unstale":"2023-10-06T02:20:10.087885+0000","last_undegraded":"2023-10-06T02:20:10.087885+0000","last_fullsized":"2023-10-06T02:20:10.087885+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:01.898029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.071751+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:20:09.071751+0000","last_peered":"2023-10-06T02:20:09.071751+0000","last_clean":"2023-10-06T02:20:09.071751+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:20:09.071751+0000","last_undegraded":"2023-10-06T02:20:09.071751+0000","last_fullsized":"2023-10-06T02:20:09.071751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077399+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:47.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.089395+0000","last_change":"2023-10-06T02:20:10.089395+0000","last_active":"2023-10-06T02:20:10.089395+0000","last_peered":"2023-10-06T02:20:10.089395+0000","last_clean":"2023-10-06T02:20:10.089395+0000","last_became_active":"2023-10-06T02:20:10.088441+0000","last_became_peered":"2023-10-06T02:20:10.088441+0000","last_unstale":"2023-10-06T02:20:10.089395+0000","last_undegraded":"2023-10-06T02:20:10.089395+0000","last_fullsized":"2023-10-06T02:20:10.089395+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:45.513978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.069493+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:20:09.069493+0000","last_peered":"2023-10-06T02:20:09.069493+0000","last_clean":"2023-10-06T02:20:09.069493+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:20:09.069493+0000","last_undegraded":"2023-10-06T02:20:09.069493+0000","last_fullsized":"2023-10-06T02:20:09.069493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070895+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:23.206192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083694+0000","last_change":"2023-10-06T02:20:10.083694+0000","last_active":"2023-10-06T02:20:10.083694+0000","last_peered":"2023-10-06T02:20:10.083694+0000","last_clean":"2023-10-06T02:20:10.083694+0000","last_became_active":"2023-10-06T02:20:10.083428+0000","last_became_peered":"2023-10-06T02:20:10.083428+0000","last_unstale":"2023-10-06T02:20:10.083694+0000","last_undegraded":"2023-10-06T02:20:10.083694+0000","last_fullsized":"2023-10-06T02:20:10.083694+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:51.834884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.069541+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:20:09.069541+0000","last_peered":"2023-10-06T02:20:09.069541+0000","last_clean":"2023-10-06T02:20:09.069541+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:20:09.069541+0000","last_undegraded":"2023-10-06T02:20:09.069541+0000","last_fullsized":"2023-10-06T02:20:09.069541+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298460,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073380,"statfs":{"total":96636764160,"available":96331141120,"internally_reserved":0,"allocated":1200128,"data_stored":868182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.495,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":1.111,"15min":1.111},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.38,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67400000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.499},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":1.008,"15min":1.008},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51300000000000001,"15min":0.504},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":1.075,"15min":1.075},"last":0.629}]},{"osd":2,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75,"5min":1.149,"15min":1.149},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.75,"5min":1.048,"15min":1.048},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.40600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.68300000000000005,"5min":1.175,"15min":1.175},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.44500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71699999999999997,"5min":1.03,"15min":1.03},"last":0.72799999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.30399999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63800000000000001,"5min":0.873,"15min":0.873},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.57699999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.754}]},{"osd":5,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68600000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67700000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69899999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69999999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.78600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297888,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073952,"statfs":{"total":96636764160,"available":96331726848,"internally_reserved":0,"allocated":614400,"data_stored":283789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.82299999999999995,"15min":0.86699999999999999},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.83599999999999997,"15min":0.88200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":0.46899999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68300000000000005,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.371,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":1.002,"15min":1.0780000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69599999999999995,"5min":8.8659999999999997,"15min":8.8659999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69999999999999996,"5min":0.754,"15min":0.754},"last":0.55200000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":1.1100000000000001,"15min":1.198},"min":{"1min":0.48499999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.75,"5min":10.659000000000001,"15min":10.659000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73199999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.30199999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67000000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.495},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.377,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72399999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.35799999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76800000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.40500000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60199999999999998},"min":{"1min":0.41199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.80500000000000005,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.57999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298468,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073372,"statfs":{"total":96636764160,"available":96331132928,"internally_reserved":0,"allocated":1208320,"data_stored":874157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34100000000000003},"min":{"1min":0.23300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35099999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.315},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.376,"15min":0.374},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.60699999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.34699999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.373,"15min":0.36699999999999999},"min":{"1min":0.27600000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.29499999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.32800000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.745,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.505}]},{"osd":5,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61699999999999999,"15min":0.61099999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56899999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.45600000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.48099999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.60899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.47199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":284742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.30499999999999999,"15min":0.29599999999999999},"min":{"1min":0.224,"5min":0.216,"15min":0.216},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.318},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.27400000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.371,"15min":0.36099999999999999},"min":{"1min":0.28699999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.318},"min":{"1min":0.25,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.40999999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.30099999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.40699999999999997,"15min":0.40100000000000002},"min":{"1min":0.313,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.621,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.433}]},{"osd":4,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.60199999999999998},"min":{"1min":0.435,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82199999999999995,"5min":1.369,"15min":1.369},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.55700000000000005,"15min":0.54100000000000004},"min":{"1min":0.42799999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.53000000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82899999999999996,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.62},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56499999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86299999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60199999999999998,"15min":0.58799999999999997},"min":{"1min":0.46700000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":1.083,"15min":1.153},"min":{"1min":0.47799999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.87,"5min":11.138,"15min":11.138},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63,"15min":0.621},"min":{"1min":0.52400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88800000000000001,"5min":1.429,"15min":1.429},"last":0.66100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297888,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073952,"statfs":{"total":96636764160,"available":96331726848,"internally_reserved":0,"allocated":614400,"data_stored":283789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.376,"15min":0.37},"min":{"1min":0.25700000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.27200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.40300000000000002,"15min":0.379},"min":{"1min":0.24299999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.41999999999999998,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.311}]},{"osd":3,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.38100000000000001,"15min":0.36799999999999999},"min":{"1min":0.27500000000000002,"5min":0.252,"15min":0.252},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.42499999999999999,"15min":0.41599999999999998},"min":{"1min":0.312,"5min":0.311,"15min":0.311},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.48099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.626,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.495}]},{"osd":6,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.63400000000000001,"15min":0.624},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.66400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":284742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51700000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.312}]},{"osd":1,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36899999999999999,"15min":0.36699999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.60399999999999998,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40200000000000002,"15min":0.40500000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.58799999999999997,"5min":0.624,"15min":0.624},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53900000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76300000000000001,"5min":0.875,"15min":0.875},"last":0.442},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77200000000000002,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.42499999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61499999999999999,"15min":0.621},"min":{"1min":0.40500000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.748,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.48199999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78700000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53100000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.439,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78600000000000003,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.627,"15min":0.63},"min":{"1min":0.442,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77300000000000002,"5min":1.391,"15min":1.391},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82199999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60199999999999998,"15min":0.59699999999999998},"min":{"1min":0.495,"5min":0.439,"15min":0.439},"max":{"1min":0.79500000000000004,"5min":0.874,"15min":0.874},"last":0.48799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":284742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.42699999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83599999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.626}]},{"osd":1,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":1.1930000000000001,"15min":1.2929999999999999},"min":{"1min":0.42799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77400000000000002,"5min":17.879999999999999,"15min":17.879999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":1.171,"15min":1.272},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84699999999999998,"5min":18.010999999999999,"15min":18.010999999999999},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78500000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54400000000000004,"15min":0.53400000000000003},"min":{"1min":0.437,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.497},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40699999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80300000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58799999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.75,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.627,"15min":0.629},"min":{"1min":0.42199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":284742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":0.71899999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68400000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.54300000000000004,"15min":0.53600000000000003},"min":{"1min":0.38400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.628}]},{"osd":2,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52300000000000002,"15min":0.51500000000000001},"min":{"1min":0.441,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64800000000000002,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.38600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.53100000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.66200000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.51800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.378,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68000000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.33900000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70399999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71299999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72699999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.41999999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74099999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.68500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:20:15.590 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:20:15.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.743+0000 7fbe6a1af700 1 Processor -- start 2023-10-06T02:20:15.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.743+0000 7fbe6a1af700 1 -- start start 2023-10-06T02:20:15.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.744+0000 7fbe6a1af700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbe640b27f0 0x7fbe6415db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:15.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.744+0000 7fbe6a1af700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6415e190 con 0x7fbe640af4e0 2023-10-06T02:20:15.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.744+0000 7fbe6a1af700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe640cb650 con 0x7fbe640af8b0 2023-10-06T02:20:15.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.744+0000 7fbe6a1af700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe640b1910 con 0x7fbe640b27f0 2023-10-06T02:20:15.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.744+0000 7fbe637fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbe640af4e0 0x7fbe640b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38858/0 (socket says 172.21.15.6:38858) 2023-10-06T02:20:15.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.744+0000 7fbe637fe700 1 -- 172.21.15.6:0/2219845628 learned_addr learned my addr 172.21.15.6:0/2219845628 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:15.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.744+0000 7fbe62ffd700 1 -- 172.21.15.6:0/2219845628 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405851201 0 0) 0x7fbe6415e190 con 0x7fbe640af4e0 2023-10-06T02:20:15.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.744+0000 7fbe63fff700 1 --2- 172.21.15.6:0/2219845628 >> v2:172.21.15.175:3300/0 conn(0x7fbe640b27f0 0x7fbe6415db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:15.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.744+0000 7fbe62ffd700 1 -- 172.21.15.6:0/2219845628 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe50003570 con 0x7fbe640af4e0 2023-10-06T02:20:15.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.744+0000 7fbe62ffd700 1 -- 172.21.15.6:0/2219845628 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 168094556 0 0) 0x7fbe50003570 con 0x7fbe640af4e0 2023-10-06T02:20:15.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe62ffd700 1 -- 172.21.15.6:0/2219845628 >> v2:172.21.15.175:3300/0 conn(0x7fbe640b27f0 msgr2=0x7fbe6415db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:15.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe62ffd700 1 --2- 172.21.15.6:0/2219845628 >> v2:172.21.15.175:3300/0 conn(0x7fbe640b27f0 0x7fbe6415db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe62ffd700 1 -- 172.21.15.6:0/2219845628 >> v1:172.21.15.175:6789/0 conn(0x7fbe640af8b0 legacy=0x7fbe6415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:15.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe62ffd700 1 -- 172.21.15.6:0/2219845628 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe640ccaf0 con 0x7fbe640af4e0 2023-10-06T02:20:15.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe62ffd700 1 -- 172.21.15.6:0/2219845628 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fbe54001470 con 0x7fbe640af4e0 2023-10-06T02:20:15.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe62ffd700 1 -- 172.21.15.6:0/2219845628 >> v1:172.21.15.6:6789/0 conn(0x7fbe640af4e0 legacy=0x7fbe640b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:15.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe62ffd700 1 --2- 172.21.15.6:0/2219845628 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe50003a60 0x7fbe50003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:15.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe62ffd700 1 --2- 172.21.15.6:0/2219845628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe50004810 0x7fbe50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:15.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe62ffd700 1 --2- 172.21.15.6:0/2219845628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500051c0 0x7fbe5000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:15.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe62ffd700 1 -- 172.21.15.6:0/2219845628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe640b1910 con 0x7fbe500051c0 2023-10-06T02:20:15.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe62ffd700 1 -- 172.21.15.6:0/2219845628 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5000c130 con 0x7fbe50004810 2023-10-06T02:20:15.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe62ffd700 1 -- 172.21.15.6:0/2219845628 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5000c2f0 con 0x7fbe50003a60 2023-10-06T02:20:15.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe63fff700 1 --2- 172.21.15.6:0/2219845628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500051c0 0x7fbe5000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:15.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe637fe700 1 --2- 172.21.15.6:0/2219845628 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe50003a60 0x7fbe50003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:15.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe5affd700 1 --2- 172.21.15.6:0/2219845628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe50004810 0x7fbe50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:15.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe63fff700 1 -- 172.21.15.6:0/2219845628 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe50003a60 msgr2=0x7fbe50003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:15.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe63fff700 1 --2- 172.21.15.6:0/2219845628 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe50003a60 0x7fbe50003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe63fff700 1 -- 172.21.15.6:0/2219845628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe50004810 msgr2=0x7fbe50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:15.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe63fff700 1 --2- 172.21.15.6:0/2219845628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe50004810 0x7fbe50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe63fff700 1 -- 172.21.15.6:0/2219845628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe50003570 con 0x7fbe500051c0 2023-10-06T02:20:15.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe63fff700 1 -- 172.21.15.6:0/2219845628 reap_dead start 2023-10-06T02:20:15.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe63fff700 1 --2- 172.21.15.6:0/2219845628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500051c0 0x7fbe5000ba60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0094d0 tx=0x7fbe5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfb65b69bbb2bfa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:15.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe62ffd700 1 -- 172.21.15.6:0/2219845628 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c00ea90 con 0x7fbe500051c0 2023-10-06T02:20:15.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe62ffd700 1 -- 172.21.15.6:0/2219845628 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c00f040 con 0x7fbe500051c0 2023-10-06T02:20:15.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.745+0000 7fbe62ffd700 1 -- 172.21.15.6:0/2219845628 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c00ee20 con 0x7fbe500051c0 2023-10-06T02:20:15.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.746+0000 7fbe6a1af700 1 -- 172.21.15.6:0/2219845628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500051c0 msgr2=0x7fbe5000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:15.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.746+0000 7fbe6a1af700 1 --2- 172.21.15.6:0/2219845628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500051c0 0x7fbe5000ba60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0094d0 tx=0x7fbe5c00b040 comp rx=0 tx=0).stop 2023-10-06T02:20:15.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.746+0000 7fbe6a1af700 1 -- 172.21.15.6:0/2219845628 shutdown_connections 2023-10-06T02:20:15.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.746+0000 7fbe6a1af700 1 --2- 172.21.15.6:0/2219845628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500051c0 0x7fbe5000ba60 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.746+0000 7fbe6a1af700 1 -- 172.21.15.6:0/2219845628 >> 172.21.15.6:0/2219845628 conn(0x7fbe64068680 msgr2=0x7fbe64068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:15.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.746+0000 7fbe6a1af700 1 -- 172.21.15.6:0/2219845628 shutdown_connections 2023-10-06T02:20:15.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.746+0000 7fbe6a1af700 1 -- 172.21.15.6:0/2219845628 wait complete. 2023-10-06T02:20:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.747+0000 7fbe6a1af700 1 Processor -- start 2023-10-06T02:20:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.747+0000 7fbe6a1af700 1 -- start start 2023-10-06T02:20:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe6a1af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500051c0 0x7fbe64159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe6a1af700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe640c9cb0 0x7fbe640ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe6a1af700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe640ae1a0 0x7fbe640ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe6a1af700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe640ca660 con 0x7fbe500051c0 2023-10-06T02:20:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe6a1af700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe640aeb60 con 0x7fbe640c9cb0 2023-10-06T02:20:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe6a1af700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe64159ab0 con 0x7fbe640ae1a0 2023-10-06T02:20:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe637fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500051c0 0x7fbe64159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:15.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe637fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500051c0 0x7fbe64159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42088/0 (socket says 172.21.15.6:42088) 2023-10-06T02:20:15.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe637fe700 1 -- 172.21.15.6:0/2689294965 learned_addr learned my addr 172.21.15.6:0/2689294965 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:15.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe5affd700 1 --2- 172.21.15.6:0/2689294965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe640c9cb0 0x7fbe640ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:15.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe63fff700 1 --2- 172.21.15.6:0/2689294965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe640ae1a0 0x7fbe640ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:15.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe637fe700 1 -- 172.21.15.6:0/2689294965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe640ae1a0 msgr2=0x7fbe640ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:15.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe637fe700 1 --2- 172.21.15.6:0/2689294965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe640ae1a0 0x7fbe640ae620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe637fe700 1 -- 172.21.15.6:0/2689294965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe640c9cb0 msgr2=0x7fbe640ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:15.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe637fe700 1 --2- 172.21.15.6:0/2689294965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe640c9cb0 0x7fbe640ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe637fe700 1 -- 172.21.15.6:0/2689294965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6416a100 con 0x7fbe500051c0 2023-10-06T02:20:15.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe63fff700 1 --2- 172.21.15.6:0/2689294965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe640ae1a0 0x7fbe640ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:15.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.748+0000 7fbe5affd700 1 --2- 172.21.15.6:0/2689294965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe640c9cb0 0x7fbe640ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:15.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.749+0000 7fbe637fe700 1 --2- 172.21.15.6:0/2689294965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500051c0 0x7fbe64159570 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbe540073c0 tx=0x7fbe640ccc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:15.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.749+0000 7fbe5bfff700 1 -- 172.21.15.6:0/2689294965 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54018030 con 0x7fbe500051c0 2023-10-06T02:20:15.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.749+0000 7fbe5bfff700 1 -- 172.21.15.6:0/2689294965 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe54001080 con 0x7fbe500051c0 2023-10-06T02:20:15.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.749+0000 7fbe6a1af700 1 -- 172.21.15.6:0/2689294965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6416a3e0 con 0x7fbe500051c0 2023-10-06T02:20:15.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.749+0000 7fbe5bfff700 1 -- 172.21.15.6:0/2689294965 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5400fac0 con 0x7fbe500051c0 2023-10-06T02:20:15.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.749+0000 7fbe6a1af700 1 -- 172.21.15.6:0/2689294965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6416a9a0 con 0x7fbe500051c0 2023-10-06T02:20:15.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.750+0000 7fbe6a1af700 1 -- 172.21.15.6:0/2689294965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe640a6d20 con 0x7fbe500051c0 2023-10-06T02:20:15.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.750+0000 7fbe5bfff700 1 -- 172.21.15.6:0/2689294965 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe5401b070 con 0x7fbe500051c0 2023-10-06T02:20:15.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.750+0000 7fbe5bfff700 1 --2- 172.21.15.6:0/2689294965 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbe44066f30 0x7fbe440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:15.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.751+0000 7fbe5bfff700 1 -- 172.21.15.6:0/2689294965 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbe54019070 con 0x7fbe500051c0 2023-10-06T02:20:15.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.751+0000 7fbe5affd700 1 --2- 172.21.15.6:0/2689294965 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbe44066f30 0x7fbe440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:15.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.751+0000 7fbe5affd700 1 --2- 172.21.15.6:0/2689294965 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbe44066f30 0x7fbe440693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c007e20 tx=0x7fbe4c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:15.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.755+0000 7fbe5bfff700 1 -- 172.21.15.6:0/2689294965 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe640a6d20 con 0x7fbe500051c0 2023-10-06T02:20:15.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.944+0000 7fbe6a1af700 1 -- 172.21.15.6:0/2689294965 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe640b0f90 con 0x7fbe44066f30 2023-10-06T02:20:15.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.953+0000 7fbe5bfff700 1 -- 172.21.15.6:0/2689294965 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308528 (secure 0 0 0) 0x7fbe640b0f90 con 0x7fbe44066f30 2023-10-06T02:20:15.957 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.956+0000 7fbe6a1af700 1 -- 172.21.15.6:0/2689294965 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbe44066f30 msgr2=0x7fbe440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.956+0000 7fbe6a1af700 1 --2- 172.21.15.6:0/2689294965 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbe44066f30 0x7fbe440693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c007e20 tx=0x7fbe4c009040 comp rx=0 tx=0).stop 2023-10-06T02:20:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.956+0000 7fbe6a1af700 1 -- 172.21.15.6:0/2689294965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500051c0 msgr2=0x7fbe64159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.956+0000 7fbe6a1af700 1 --2- 172.21.15.6:0/2689294965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500051c0 0x7fbe64159570 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbe540073c0 tx=0x7fbe640ccc80 comp rx=0 tx=0).stop 2023-10-06T02:20:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.956+0000 7fbe6a1af700 1 -- 172.21.15.6:0/2689294965 shutdown_connections 2023-10-06T02:20:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.956+0000 7fbe6a1af700 1 --2- 172.21.15.6:0/2689294965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe640ae1a0 0x7fbe640ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.956+0000 7fbe6a1af700 1 --2- 172.21.15.6:0/2689294965 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbe44066f30 0x7fbe440693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.956+0000 7fbe6a1af700 1 --2- 172.21.15.6:0/2689294965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500051c0 0x7fbe64159570 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.956+0000 7fbe6a1af700 1 --2- 172.21.15.6:0/2689294965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe640c9cb0 0x7fbe640ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.956+0000 7fbe6a1af700 1 -- 172.21.15.6:0/2689294965 >> 172.21.15.6:0/2689294965 conn(0x7fbe64068680 msgr2=0x7fbe6415a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.957+0000 7fbe6a1af700 1 -- 172.21.15.6:0/2689294965 shutdown_connections 2023-10-06T02:20:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:15.957+0000 7fbe6a1af700 1 -- 172.21.15.6:0/2689294965 wait complete. 2023-10-06T02:20:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:20:15.969 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2023-10-06T02:20:14.596844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384272,"kb_used_data":5968,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590448,"statfs":{"total":773094113280,"available":770652618752,"internally_reserved":0,"allocated":6111232,"data_stored":3448885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.531952"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077680+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:39.810035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075555+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:14.861023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.082516+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:05.611645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.072167+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:36.011425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076702+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:31.183237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070876+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:25.208164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075617+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:06.804501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.082418+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:42.727588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.073768+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.881534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070462+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:47.957631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071570+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:20.004362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070496+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:01.291589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077000+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:47.957631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076524+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:06.782485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075165+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:43.723805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.073125+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:36.577978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075385+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:23.573239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077802+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:47.898090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076811+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:55.084065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.079697+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:05.827417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076191+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:13.256587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.079598+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:05.771836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075862+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:18.142744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.073224+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:30.195818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077150+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:43.005759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071364+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:52.839061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.073451+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.881534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077514+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:33.121275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.080078+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:00.856511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076913+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:47.078327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076241+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:48.392066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070626+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:58.684533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071824+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:46.518154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.078526+0000","last_change":"2023-10-06T02:20:10.078526+0000","last_active":"2023-10-06T02:20:10.078526+0000","last_peered":"2023-10-06T02:20:10.078526+0000","last_clean":"2023-10-06T02:20:10.078526+0000","last_became_active":"2023-10-06T02:20:10.078260+0000","last_became_peered":"2023-10-06T02:20:10.078260+0000","last_unstale":"2023-10-06T02:20:10.078526+0000","last_undegraded":"2023-10-06T02:20:10.078526+0000","last_fullsized":"2023-10-06T02:20:10.078526+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:40.895709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071010+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:54:21.940162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.090120+0000","last_change":"2023-10-06T02:20:10.090120+0000","last_active":"2023-10-06T02:20:10.090120+0000","last_peered":"2023-10-06T02:20:10.090120+0000","last_clean":"2023-10-06T02:20:10.090120+0000","last_became_active":"2023-10-06T02:20:10.089825+0000","last_became_peered":"2023-10-06T02:20:10.089825+0000","last_unstale":"2023-10-06T02:20:10.090120+0000","last_undegraded":"2023-10-06T02:20:10.090120+0000","last_fullsized":"2023-10-06T02:20:10.090120+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:36.079964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071094+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:24.022995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.076720+0000","last_change":"2023-10-06T02:20:10.076720+0000","last_active":"2023-10-06T02:20:10.076720+0000","last_peered":"2023-10-06T02:20:10.076720+0000","last_clean":"2023-10-06T02:20:10.076720+0000","last_became_active":"2023-10-06T02:20:10.076476+0000","last_became_peered":"2023-10-06T02:20:10.076476+0000","last_unstale":"2023-10-06T02:20:10.076720+0000","last_undegraded":"2023-10-06T02:20:10.076720+0000","last_fullsized":"2023-10-06T02:20:10.076720+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:35.007248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.072918+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:06.452376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.084644+0000","last_change":"2023-10-06T02:20:10.084644+0000","last_active":"2023-10-06T02:20:10.084644+0000","last_peered":"2023-10-06T02:20:10.084644+0000","last_clean":"2023-10-06T02:20:10.084644+0000","last_became_active":"2023-10-06T02:20:10.084341+0000","last_became_peered":"2023-10-06T02:20:10.084341+0000","last_unstale":"2023-10-06T02:20:10.084644+0000","last_undegraded":"2023-10-06T02:20:10.084644+0000","last_fullsized":"2023-10-06T02:20:10.084644+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:21:39.310837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.079108+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:18.081636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.086329+0000","last_change":"2023-10-06T02:20:10.086329+0000","last_active":"2023-10-06T02:20:10.086329+0000","last_peered":"2023-10-06T02:20:10.086329+0000","last_clean":"2023-10-06T02:20:10.086329+0000","last_became_active":"2023-10-06T02:20:10.086046+0000","last_became_peered":"2023-10-06T02:20:10.086046+0000","last_unstale":"2023-10-06T02:20:10.086329+0000","last_undegraded":"2023-10-06T02:20:10.086329+0000","last_fullsized":"2023-10-06T02:20:10.086329+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:29.725518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074636+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:06.782485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.082327+0000","last_change":"2023-10-06T02:20:10.082327+0000","last_active":"2023-10-06T02:20:10.082327+0000","last_peered":"2023-10-06T02:20:10.082327+0000","last_clean":"2023-10-06T02:20:10.082327+0000","last_became_active":"2023-10-06T02:20:10.081996+0000","last_became_peered":"2023-10-06T02:20:10.081996+0000","last_unstale":"2023-10-06T02:20:10.082327+0000","last_undegraded":"2023-10-06T02:20:10.082327+0000","last_fullsized":"2023-10-06T02:20:10.082327+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:14.124501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.072687+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:20.143693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.079757+0000","last_change":"2023-10-06T02:20:10.079757+0000","last_active":"2023-10-06T02:20:10.079757+0000","last_peered":"2023-10-06T02:20:10.079757+0000","last_clean":"2023-10-06T02:20:10.079757+0000","last_became_active":"2023-10-06T02:20:10.079351+0000","last_became_peered":"2023-10-06T02:20:10.079351+0000","last_unstale":"2023-10-06T02:20:10.079757+0000","last_undegraded":"2023-10-06T02:20:10.079757+0000","last_fullsized":"2023-10-06T02:20:10.079757+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:17.138568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074928+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:37.530291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.090205+0000","last_change":"2023-10-06T02:20:10.090205+0000","last_active":"2023-10-06T02:20:10.090205+0000","last_peered":"2023-10-06T02:20:10.090205+0000","last_clean":"2023-10-06T02:20:10.090205+0000","last_became_active":"2023-10-06T02:20:10.089892+0000","last_became_peered":"2023-10-06T02:20:10.089892+0000","last_unstale":"2023-10-06T02:20:10.090205+0000","last_undegraded":"2023-10-06T02:20:10.090205+0000","last_fullsized":"2023-10-06T02:20:10.090205+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.049531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.076620+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:37.055350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.091798+0000","last_change":"2023-10-06T02:20:10.091798+0000","last_active":"2023-10-06T02:20:10.091798+0000","last_peered":"2023-10-06T02:20:10.091798+0000","last_clean":"2023-10-06T02:20:10.091798+0000","last_became_active":"2023-10-06T02:20:10.091500+0000","last_became_peered":"2023-10-06T02:20:10.091500+0000","last_unstale":"2023-10-06T02:20:10.091798+0000","last_undegraded":"2023-10-06T02:20:10.091798+0000","last_fullsized":"2023-10-06T02:20:10.091798+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:46.331439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.079689+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:36.011425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.086888+0000","last_change":"2023-10-06T02:20:10.086888+0000","last_active":"2023-10-06T02:20:10.086888+0000","last_peered":"2023-10-06T02:20:10.086888+0000","last_clean":"2023-10-06T02:20:10.086888+0000","last_became_active":"2023-10-06T02:20:10.086534+0000","last_became_peered":"2023-10-06T02:20:10.086534+0000","last_unstale":"2023-10-06T02:20:10.086888+0000","last_undegraded":"2023-10-06T02:20:10.086888+0000","last_fullsized":"2023-10-06T02:20:10.086888+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:35.573802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071028+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:16.770865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.097982+0000","last_change":"2023-10-06T02:20:10.097982+0000","last_active":"2023-10-06T02:20:10.097982+0000","last_peered":"2023-10-06T02:20:10.097982+0000","last_clean":"2023-10-06T02:20:10.097982+0000","last_became_active":"2023-10-06T02:20:10.097762+0000","last_became_peered":"2023-10-06T02:20:10.097762+0000","last_unstale":"2023-10-06T02:20:10.097982+0000","last_undegraded":"2023-10-06T02:20:10.097982+0000","last_fullsized":"2023-10-06T02:20:10.097982+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:37.423409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.079348+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:04.345501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.086470+0000","last_change":"2023-10-06T02:20:10.086470+0000","last_active":"2023-10-06T02:20:10.086470+0000","last_peered":"2023-10-06T02:20:10.086470+0000","last_clean":"2023-10-06T02:20:10.086470+0000","last_became_active":"2023-10-06T02:20:10.086190+0000","last_became_peered":"2023-10-06T02:20:10.086190+0000","last_unstale":"2023-10-06T02:20:10.086470+0000","last_undegraded":"2023-10-06T02:20:10.086470+0000","last_fullsized":"2023-10-06T02:20:10.086470+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:45.513978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071670+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:41.899885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.087539+0000","last_change":"2023-10-06T02:20:10.087539+0000","last_active":"2023-10-06T02:20:10.087539+0000","last_peered":"2023-10-06T02:20:10.087539+0000","last_clean":"2023-10-06T02:20:10.087539+0000","last_became_active":"2023-10-06T02:20:10.086644+0000","last_became_peered":"2023-10-06T02:20:10.086644+0000","last_unstale":"2023-10-06T02:20:10.087539+0000","last_undegraded":"2023-10-06T02:20:10.087539+0000","last_fullsized":"2023-10-06T02:20:10.087539+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.049531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075657+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:24.021258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.088730+0000","last_change":"2023-10-06T02:20:10.088730+0000","last_active":"2023-10-06T02:20:10.088730+0000","last_peered":"2023-10-06T02:20:10.088730+0000","last_clean":"2023-10-06T02:20:10.088730+0000","last_became_active":"2023-10-06T02:20:10.088448+0000","last_became_peered":"2023-10-06T02:20:10.088448+0000","last_unstale":"2023-10-06T02:20:10.088730+0000","last_undegraded":"2023-10-06T02:20:10.088730+0000","last_fullsized":"2023-10-06T02:20:10.088730+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:10.326174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074177+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:30.735219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083978+0000","last_change":"2023-10-06T02:20:10.083978+0000","last_active":"2023-10-06T02:20:10.083978+0000","last_peered":"2023-10-06T02:20:10.083978+0000","last_clean":"2023-10-06T02:20:10.083978+0000","last_became_active":"2023-10-06T02:20:10.083702+0000","last_became_peered":"2023-10-06T02:20:10.083702+0000","last_unstale":"2023-10-06T02:20:10.083978+0000","last_undegraded":"2023-10-06T02:20:10.083978+0000","last_fullsized":"2023-10-06T02:20:10.083978+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:32.118709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075434+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:21:40.315014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.089832+0000","last_change":"2023-10-06T02:20:10.089832+0000","last_active":"2023-10-06T02:20:10.089832+0000","last_peered":"2023-10-06T02:20:10.089832+0000","last_clean":"2023-10-06T02:20:10.089832+0000","last_became_active":"2023-10-06T02:20:10.089490+0000","last_became_peered":"2023-10-06T02:20:10.089490+0000","last_unstale":"2023-10-06T02:20:10.089832+0000","last_undegraded":"2023-10-06T02:20:10.089832+0000","last_fullsized":"2023-10-06T02:20:10.089832+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:00.982977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070432+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:47.898090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.086823+0000","last_change":"2023-10-06T02:20:10.086823+0000","last_active":"2023-10-06T02:20:10.086823+0000","last_peered":"2023-10-06T02:20:10.086823+0000","last_clean":"2023-10-06T02:20:10.086823+0000","last_became_active":"2023-10-06T02:20:10.086536+0000","last_became_peered":"2023-10-06T02:20:10.086536+0000","last_unstale":"2023-10-06T02:20:10.086823+0000","last_undegraded":"2023-10-06T02:20:10.086823+0000","last_fullsized":"2023-10-06T02:20:10.086823+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:10.326174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071540+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:04.345501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.082172+0000","last_change":"2023-10-06T02:20:10.082172+0000","last_active":"2023-10-06T02:20:10.082172+0000","last_peered":"2023-10-06T02:20:10.082172+0000","last_clean":"2023-10-06T02:20:10.082172+0000","last_became_active":"2023-10-06T02:20:10.081872+0000","last_became_peered":"2023-10-06T02:20:10.081872+0000","last_unstale":"2023-10-06T02:20:10.082172+0000","last_undegraded":"2023-10-06T02:20:10.082172+0000","last_fullsized":"2023-10-06T02:20:10.082172+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:04.607469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070422+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:30.195818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083068+0000","last_change":"2023-10-06T02:20:10.083068+0000","last_active":"2023-10-06T02:20:10.083068+0000","last_peered":"2023-10-06T02:20:10.083068+0000","last_clean":"2023-10-06T02:20:10.083068+0000","last_became_active":"2023-10-06T02:20:10.082811+0000","last_became_peered":"2023-10-06T02:20:10.082811+0000","last_unstale":"2023-10-06T02:20:10.083068+0000","last_undegraded":"2023-10-06T02:20:10.083068+0000","last_fullsized":"2023-10-06T02:20:10.083068+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:42.288801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071735+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:37.084141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083108+0000","last_change":"2023-10-06T02:20:10.083108+0000","last_active":"2023-10-06T02:20:10.083108+0000","last_peered":"2023-10-06T02:20:10.083108+0000","last_clean":"2023-10-06T02:20:10.083108+0000","last_became_active":"2023-10-06T02:20:10.082824+0000","last_became_peered":"2023-10-06T02:20:10.082824+0000","last_unstale":"2023-10-06T02:20:10.083108+0000","last_undegraded":"2023-10-06T02:20:10.083108+0000","last_fullsized":"2023-10-06T02:20:10.083108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:12.252411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.075066+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:43.723805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.078394+0000","last_change":"2023-10-06T02:20:10.078394+0000","last_active":"2023-10-06T02:20:10.078394+0000","last_peered":"2023-10-06T02:20:10.078394+0000","last_clean":"2023-10-06T02:20:10.078394+0000","last_became_active":"2023-10-06T02:20:10.078110+0000","last_became_peered":"2023-10-06T02:20:10.078110+0000","last_unstale":"2023-10-06T02:20:10.078394+0000","last_undegraded":"2023-10-06T02:20:10.078394+0000","last_fullsized":"2023-10-06T02:20:10.078394+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:36.939948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074825+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:33.122885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.087075+0000","last_change":"2023-10-06T02:20:10.087075+0000","last_active":"2023-10-06T02:20:10.087075+0000","last_peered":"2023-10-06T02:20:10.087075+0000","last_clean":"2023-10-06T02:20:10.087075+0000","last_became_active":"2023-10-06T02:20:10.086766+0000","last_became_peered":"2023-10-06T02:20:10.086766+0000","last_unstale":"2023-10-06T02:20:10.087075+0000","last_undegraded":"2023-10-06T02:20:10.087075+0000","last_fullsized":"2023-10-06T02:20:10.087075+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:05.448199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070371+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:20.143693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.075647+0000","last_change":"2023-10-06T02:20:10.075647+0000","last_active":"2023-10-06T02:20:10.075647+0000","last_peered":"2023-10-06T02:20:10.075647+0000","last_clean":"2023-10-06T02:20:10.075647+0000","last_became_active":"2023-10-06T02:20:10.075395+0000","last_became_peered":"2023-10-06T02:20:10.075395+0000","last_unstale":"2023-10-06T02:20:10.075647+0000","last_undegraded":"2023-10-06T02:20:10.075647+0000","last_fullsized":"2023-10-06T02:20:10.075647+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:52.232393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.073274+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:30.735219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.088960+0000","last_change":"2023-10-06T02:20:10.088960+0000","last_active":"2023-10-06T02:20:10.088960+0000","last_peered":"2023-10-06T02:20:10.088960+0000","last_clean":"2023-10-06T02:20:10.088960+0000","last_became_active":"2023-10-06T02:20:10.088607+0000","last_became_peered":"2023-10-06T02:20:10.088607+0000","last_unstale":"2023-10-06T02:20:10.088960+0000","last_undegraded":"2023-10-06T02:20:10.088960+0000","last_fullsized":"2023-10-06T02:20:10.088960+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:23.018819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.078749+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:23.206192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.085228+0000","last_change":"2023-10-06T02:20:10.085228+0000","last_active":"2023-10-06T02:20:10.085228+0000","last_peered":"2023-10-06T02:20:10.085228+0000","last_clean":"2023-10-06T02:20:10.085228+0000","last_became_active":"2023-10-06T02:20:10.084925+0000","last_became_peered":"2023-10-06T02:20:10.084925+0000","last_unstale":"2023-10-06T02:20:10.085228+0000","last_undegraded":"2023-10-06T02:20:10.085228+0000","last_fullsized":"2023-10-06T02:20:10.085228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:03.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.072867+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:20:09.072867+0000","last_peered":"2023-10-06T02:20:09.072867+0000","last_clean":"2023-10-06T02:20:09.072867+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:20:09.072867+0000","last_undegraded":"2023-10-06T02:20:09.072867+0000","last_fullsized":"2023-10-06T02:20:09.072867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074809+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:37.055350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.087848+0000","last_change":"2023-10-06T02:20:10.087848+0000","last_active":"2023-10-06T02:20:10.087848+0000","last_peered":"2023-10-06T02:20:10.087848+0000","last_clean":"2023-10-06T02:20:10.087848+0000","last_became_active":"2023-10-06T02:20:10.087542+0000","last_became_peered":"2023-10-06T02:20:10.087542+0000","last_unstale":"2023-10-06T02:20:10.087848+0000","last_undegraded":"2023-10-06T02:20:10.087848+0000","last_fullsized":"2023-10-06T02:20:10.087848+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:23.017081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":41,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.065799+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:20:09.065799+0000","last_peered":"2023-10-06T02:20:09.065799+0000","last_clean":"2023-10-06T02:20:09.065799+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:20:09.065799+0000","last_undegraded":"2023-10-06T02:20:09.065799+0000","last_fullsized":"2023-10-06T02:20:09.065799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071975+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:29.053708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083735+0000","last_change":"2023-10-06T02:20:10.083735+0000","last_active":"2023-10-06T02:20:10.083735+0000","last_peered":"2023-10-06T02:20:10.083735+0000","last_clean":"2023-10-06T02:20:10.083735+0000","last_became_active":"2023-10-06T02:20:10.083416+0000","last_became_peered":"2023-10-06T02:20:10.083416+0000","last_unstale":"2023-10-06T02:20:10.083735+0000","last_undegraded":"2023-10-06T02:20:10.083735+0000","last_fullsized":"2023-10-06T02:20:10.083735+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:42.288801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.070646+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:20:09.070646+0000","last_peered":"2023-10-06T02:20:09.070646+0000","last_clean":"2023-10-06T02:20:09.070646+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:20:09.070646+0000","last_undegraded":"2023-10-06T02:20:09.070646+0000","last_fullsized":"2023-10-06T02:20:09.070646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":190,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.072243+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:20:09.072243+0000","last_peered":"2023-10-06T02:20:09.072243+0000","last_clean":"2023-10-06T02:20:09.072243+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:20:09.072243+0000","last_undegraded":"2023-10-06T02:20:09.072243+0000","last_fullsized":"2023-10-06T02:20:09.072243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070303+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:47.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083336+0000","last_change":"2023-10-06T02:20:10.083336+0000","last_active":"2023-10-06T02:20:10.083336+0000","last_peered":"2023-10-06T02:20:10.083336+0000","last_clean":"2023-10-06T02:20:10.083336+0000","last_became_active":"2023-10-06T02:20:10.083061+0000","last_became_peered":"2023-10-06T02:20:10.083061+0000","last_unstale":"2023-10-06T02:20:10.083336+0000","last_undegraded":"2023-10-06T02:20:10.083336+0000","last_fullsized":"2023-10-06T02:20:10.083336+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:05.448199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.071547+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:20:09.071547+0000","last_peered":"2023-10-06T02:20:09.071547+0000","last_clean":"2023-10-06T02:20:09.071547+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:20:09.071547+0000","last_undegraded":"2023-10-06T02:20:09.071547+0000","last_fullsized":"2023-10-06T02:20:09.071547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.074530+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:06.804501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.078967+0000","last_change":"2023-10-06T02:20:10.078967+0000","last_active":"2023-10-06T02:20:10.078967+0000","last_peered":"2023-10-06T02:20:10.078967+0000","last_clean":"2023-10-06T02:20:10.078967+0000","last_became_active":"2023-10-06T02:20:10.078653+0000","last_became_peered":"2023-10-06T02:20:10.078653+0000","last_unstale":"2023-10-06T02:20:10.078967+0000","last_undegraded":"2023-10-06T02:20:10.078967+0000","last_fullsized":"2023-10-06T02:20:10.078967+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:52.232393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.072151+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:20:09.072151+0000","last_peered":"2023-10-06T02:20:09.072151+0000","last_clean":"2023-10-06T02:20:09.072151+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:20:09.072151+0000","last_undegraded":"2023-10-06T02:20:09.072151+0000","last_fullsized":"2023-10-06T02:20:09.072151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.071797+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:30.729695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.087885+0000","last_change":"2023-10-06T02:20:10.087885+0000","last_active":"2023-10-06T02:20:10.087885+0000","last_peered":"2023-10-06T02:20:10.087885+0000","last_clean":"2023-10-06T02:20:10.087885+0000","last_became_active":"2023-10-06T02:20:10.087566+0000","last_became_peered":"2023-10-06T02:20:10.087566+0000","last_unstale":"2023-10-06T02:20:10.087885+0000","last_undegraded":"2023-10-06T02:20:10.087885+0000","last_fullsized":"2023-10-06T02:20:10.087885+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:01.898029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.071751+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:20:09.071751+0000","last_peered":"2023-10-06T02:20:09.071751+0000","last_clean":"2023-10-06T02:20:09.071751+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:20:09.071751+0000","last_undegraded":"2023-10-06T02:20:09.071751+0000","last_fullsized":"2023-10-06T02:20:09.071751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.077399+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:47.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.089395+0000","last_change":"2023-10-06T02:20:10.089395+0000","last_active":"2023-10-06T02:20:10.089395+0000","last_peered":"2023-10-06T02:20:10.089395+0000","last_clean":"2023-10-06T02:20:10.089395+0000","last_became_active":"2023-10-06T02:20:10.088441+0000","last_became_peered":"2023-10-06T02:20:10.088441+0000","last_unstale":"2023-10-06T02:20:10.089395+0000","last_undegraded":"2023-10-06T02:20:10.089395+0000","last_fullsized":"2023-10-06T02:20:10.089395+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:45.513978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.069493+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:20:09.069493+0000","last_peered":"2023-10-06T02:20:09.069493+0000","last_clean":"2023-10-06T02:20:09.069493+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:20:09.069493+0000","last_undegraded":"2023-10-06T02:20:09.069493+0000","last_fullsized":"2023-10-06T02:20:09.069493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:10.064186+0000","last_change":"2023-10-06T02:20:10.070895+0000","last_active":"2023-10-06T02:20:10.064186+0000","last_peered":"2023-10-06T02:20:10.064186+0000","last_clean":"2023-10-06T02:20:10.064186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:10.064186+0000","last_undegraded":"2023-10-06T02:20:10.064186+0000","last_fullsized":"2023-10-06T02:20:10.064186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:23.206192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T02:20:10.083694+0000","last_change":"2023-10-06T02:20:10.083694+0000","last_active":"2023-10-06T02:20:10.083694+0000","last_peered":"2023-10-06T02:20:10.083694+0000","last_clean":"2023-10-06T02:20:10.083694+0000","last_became_active":"2023-10-06T02:20:10.083428+0000","last_became_peered":"2023-10-06T02:20:10.083428+0000","last_unstale":"2023-10-06T02:20:10.083694+0000","last_undegraded":"2023-10-06T02:20:10.083694+0000","last_fullsized":"2023-10-06T02:20:10.083694+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:51.834884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T02:20:09.069541+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:20:09.069541+0000","last_peered":"2023-10-06T02:20:09.069541+0000","last_clean":"2023-10-06T02:20:09.069541+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:20:09.069541+0000","last_undegraded":"2023-10-06T02:20:09.069541+0000","last_fullsized":"2023-10-06T02:20:09.069541+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298460,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073380,"statfs":{"total":96636764160,"available":96331141120,"internally_reserved":0,"allocated":1200128,"data_stored":868182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.495,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":1.111,"15min":1.111},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.38,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67400000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.499},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":1.008,"15min":1.008},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51300000000000001,"15min":0.504},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":1.075,"15min":1.075},"last":0.629}]},{"osd":2,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75,"5min":1.149,"15min":1.149},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.75,"5min":1.048,"15min":1.048},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.40600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.68300000000000005,"5min":1.175,"15min":1.175},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.44500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71699999999999997,"5min":1.03,"15min":1.03},"last":0.72799999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.30399999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63800000000000001,"5min":0.873,"15min":0.873},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.57699999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.754}]},{"osd":5,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68600000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67700000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69899999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69999999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.78600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297888,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073952,"statfs":{"total":96636764160,"available":96331726848,"internally_reserved":0,"allocated":614400,"data_stored":283789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.82299999999999995,"15min":0.86699999999999999},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.83599999999999997,"15min":0.88200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":0.46899999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68300000000000005,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.371,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":1.002,"15min":1.0780000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69599999999999995,"5min":8.8659999999999997,"15min":8.8659999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69999999999999996,"5min":0.754,"15min":0.754},"last":0.55200000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":1.1100000000000001,"15min":1.198},"min":{"1min":0.48499999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.75,"5min":10.659000000000001,"15min":10.659000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73199999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.30199999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67000000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.495},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.377,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72399999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.35799999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76800000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.40500000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60199999999999998},"min":{"1min":0.41199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.80500000000000005,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.57999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298468,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073372,"statfs":{"total":96636764160,"available":96331132928,"internally_reserved":0,"allocated":1208320,"data_stored":874157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34100000000000003},"min":{"1min":0.23300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35099999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.315},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.376,"15min":0.374},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.60699999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.34699999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.373,"15min":0.36699999999999999},"min":{"1min":0.27600000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.29499999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.32800000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.745,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.505}]},{"osd":5,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61699999999999999,"15min":0.61099999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56899999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.45600000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.48099999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.60899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.47199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":284742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.30499999999999999,"15min":0.29599999999999999},"min":{"1min":0.224,"5min":0.216,"15min":0.216},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.318},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.27400000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.371,"15min":0.36099999999999999},"min":{"1min":0.28699999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.318},"min":{"1min":0.25,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.40999999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.30099999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.40699999999999997,"15min":0.40100000000000002},"min":{"1min":0.313,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.621,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.433}]},{"osd":4,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.60199999999999998},"min":{"1min":0.435,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82199999999999995,"5min":1.369,"15min":1.369},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.55700000000000005,"15min":0.54100000000000004},"min":{"1min":0.42799999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.53000000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82899999999999996,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.62},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56499999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86299999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60199999999999998,"15min":0.58799999999999997},"min":{"1min":0.46700000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":1.083,"15min":1.153},"min":{"1min":0.47799999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.87,"5min":11.138,"15min":11.138},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63,"15min":0.621},"min":{"1min":0.52400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88800000000000001,"5min":1.429,"15min":1.429},"last":0.66100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297888,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073952,"statfs":{"total":96636764160,"available":96331726848,"internally_reserved":0,"allocated":614400,"data_stored":283789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.376,"15min":0.37},"min":{"1min":0.25700000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.27200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.40300000000000002,"15min":0.379},"min":{"1min":0.24299999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.41999999999999998,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.311}]},{"osd":3,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.38100000000000001,"15min":0.36799999999999999},"min":{"1min":0.27500000000000002,"5min":0.252,"15min":0.252},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.42499999999999999,"15min":0.41599999999999998},"min":{"1min":0.312,"5min":0.311,"15min":0.311},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.48099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.626,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.495}]},{"osd":6,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.63400000000000001,"15min":0.624},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.66400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":284742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51700000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.312}]},{"osd":1,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36899999999999999,"15min":0.36699999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.60399999999999998,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40200000000000002,"15min":0.40500000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.58799999999999997,"5min":0.624,"15min":0.624},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53900000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76300000000000001,"5min":0.875,"15min":0.875},"last":0.442},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77200000000000002,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.42499999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61499999999999999,"15min":0.621},"min":{"1min":0.40500000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.748,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.48199999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78700000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53100000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.439,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78600000000000003,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.627,"15min":0.63},"min":{"1min":0.442,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77300000000000002,"5min":1.391,"15min":1.391},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82199999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60199999999999998,"15min":0.59699999999999998},"min":{"1min":0.495,"5min":0.439,"15min":0.439},"max":{"1min":0.79500000000000004,"5min":0.874,"15min":0.874},"last":0.48799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":284742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.42699999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83599999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.626}]},{"osd":1,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":1.1930000000000001,"15min":1.2929999999999999},"min":{"1min":0.42799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77400000000000002,"5min":17.879999999999999,"15min":17.879999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":1.171,"15min":1.272},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84699999999999998,"5min":18.010999999999999,"15min":18.010999999999999},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78500000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54400000000000004,"15min":0.53400000000000003},"min":{"1min":0.437,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.497},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40699999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80300000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58799999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.75,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.627,"15min":0.629},"min":{"1min":0.42199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":284742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":0.71899999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68400000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.54300000000000004,"15min":0.53600000000000003},"min":{"1min":0.38400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.628}]},{"osd":2,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52300000000000002,"15min":0.51500000000000001},"min":{"1min":0.441,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64800000000000002,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.38600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.53100000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.66200000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.51800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.378,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68000000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.33900000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70399999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71299999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72699999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.41999999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74099999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.68500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:20:15.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-10-06T02:20:15.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.077680+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:19:39.810035+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:20:15.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-10-06T02:20:15.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.075555+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:20:14.861023+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:20:15.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-10-06T02:20:15.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.082516+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:19:05.611645+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:20:15.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-10-06T02:20:15.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.072167+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:03:36.011425+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:20:15.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-10-06T02:20:15.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.076702+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:45:31.183237+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:20:15.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-10-06T02:20:15.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.070876+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:37:25.208164+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:20:15.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-10-06T02:20:15.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.075617+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:49:06.804501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:20:15.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-10-06T02:20:15.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.082418+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:17:42.727588+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:20:15.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-10-06T02:20:15.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.073768+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:03:14.881534+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:20:15.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-10-06T02:20:15.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.070462+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:41:47.957631+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:20:15.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-10-06T02:20:15.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.071570+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:54:20.004362+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:20:15.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-10-06T02:20:15.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.070496+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:01:01.291589+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:20:15.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-10-06T02:20:15.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.077000+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:41:47.957631+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:20:15.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-10-06T02:20:15.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.076524+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:37:06.782485+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:20:15.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-10-06T02:20:15.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.075165+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:37:43.723805+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:20:15.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-10-06T02:20:15.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.073125+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:35:36.577978+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:20:15.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-10-06T02:20:15.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.075385+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:34:23.573239+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:20:15.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-10-06T02:20:15.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.077802+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:11:47.898090+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:20:15.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-10-06T02:20:15.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.076811+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:03:55.084065+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:20:15.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-10-06T02:20:15.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.079697+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:46:05.827417+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:20:15.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-10-06T02:20:15.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.076191+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:39:13.256587+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:20:15.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-10-06T02:20:15.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.079598+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:15:05.771836+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:20:15.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-10-06T02:20:15.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.075862+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:03:18.142744+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:20:15.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-10-06T02:20:15.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.073224+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:52:30.195818+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:20:15.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-10-06T02:20:15.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.077150+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:37:43.005759+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:20:15.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-10-06T02:20:15.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.071364+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:56:52.839061+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:20:15.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-10-06T02:20:15.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.073451+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:03:14.881534+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:20:15.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-10-06T02:20:15.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.077514+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:57:33.121275+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:20:15.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-10-06T02:20:15.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.080078+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:38:00.856511+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:20:15.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-10-06T02:20:15.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.076913+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:08:47.078327+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:20:15.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-10-06T02:20:15.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.076241+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:35:48.392066+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:20:15.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-10-06T02:20:15.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.070626+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:13:58.684533+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:20:15.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-10-06T02:20:15.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.071824+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:09:46.518154+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:20:15.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-10-06T02:20:15.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.071010+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:54:21.940162+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:20:15.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-10-06T02:20:15.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.071094+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:27:24.022995+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:20:15.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-10-06T02:20:15.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.072918+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:16:06.452376+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:20:15.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-10-06T02:20:15.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.079108+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:01:18.081636+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:20:15.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-10-06T02:20:15.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.074636+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:37:06.782485+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:20:15.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-10-06T02:20:15.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.072687+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:18:20.143693+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:20:15.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-10-06T02:20:15.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.074928+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:45:37.530291+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:20:15.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-10-06T02:20:15.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.076620+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:50:37.055350+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:20:15.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-10-06T02:20:15.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.079689+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:03:36.011425+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:20:15.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-10-06T02:20:15.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.071028+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:01:16.770865+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:20:15.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-10-06T02:20:15.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.079348+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:25:04.345501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:20:15.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-10-06T02:20:15.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.071670+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:32:41.899885+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:20:15.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-10-06T02:20:15.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.075657+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:31:24.021258+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:20:15.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-10-06T02:20:15.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.074177+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:48:30.735219+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:20:15.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-10-06T02:20:15.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.075434+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:21:40.315014+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:20:15.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-10-06T02:20:15.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.070432+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:11:47.898090+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:20:15.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-10-06T02:20:15.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.071540+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:25:04.345501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:20:15.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-10-06T02:20:15.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.070422+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:52:30.195818+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:20:15.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-10-06T02:20:15.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.071735+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:11:37.084141+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:20:15.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-10-06T02:20:15.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.075066+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:37:43.723805+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:20:15.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-10-06T02:20:15.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.074825+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:19:33.122885+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:20:15.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-10-06T02:20:15.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.070371+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:18:20.143693+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:20:15.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-10-06T02:20:15.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.073274+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:48:30.735219+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:20:15.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-10-06T02:20:15.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.078749+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:03:23.206192+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:20:15.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-10-06T02:20:15.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.074809+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:50:37.055350+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:20:15.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-10-06T02:20:15.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.071975+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:11:29.053708+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:20:15.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-10-06T02:20:15.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.070303+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:02:47.888573+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:20:15.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-10-06T02:20:15.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.074530+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:49:06.804501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:20:15.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-10-06T02:20:15.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.071797+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:08:30.729695+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:20:15.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-10-06T02:20:15.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.077399+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:02:47.888573+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:20:15.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-10-06T02:20:15.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:20:10.064186+0000', 'last_change': '2023-10-06T02:20:10.070895+0000', 'last_active': '2023-10-06T02:20:10.064186+0000', 'last_peered': '2023-10-06T02:20:10.064186+0000', 'last_clean': '2023-10-06T02:20:10.064186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:20:10.064186+0000', 'last_undegraded': '2023-10-06T02:20:10.064186+0000', 'last_fullsized': '2023-10-06T02:20:10.064186+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'last_clean_scrub_stamp': '2023-10-06T02:20:10.064186+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:03:23.206192+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:20:15.992 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:20:16.062 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:20:16.062+0000 7f68b7299700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:20:16.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.127+0000 7f03bfde5700 1 Processor -- start 2023-10-06T02:20:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.127+0000 7f03bfde5700 1 -- start start 2023-10-06T02:20:16.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.128+0000 7f03bfde5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b8159330 0x7f03b806ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:16.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.128+0000 7f03bfde5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b8069790 con 0x7f03b80b0ec0 2023-10-06T02:20:16.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.128+0000 7f03bfde5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b8069a70 con 0x7f03b80b0560 2023-10-06T02:20:16.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.128+0000 7f03bfde5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80b2000 con 0x7f03b8159330 2023-10-06T02:20:16.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.128+0000 7f03be382700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f03b80b0ec0 0x7f03b806a610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38864/0 (socket says 172.21.15.6:38864) 2023-10-06T02:20:16.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.128+0000 7f03be382700 1 -- 172.21.15.6:0/1726292681 learned_addr learned my addr 172.21.15.6:0/1726292681 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:16.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bdb81700 1 --2- 172.21.15.6:0/1726292681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b8159330 0x7f03b806ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bcb7f700 1 -- 172.21.15.6:0/1726292681 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60328881 0 0) 0x7f03b8069790 con 0x7f03b80b0ec0 2023-10-06T02:20:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bcb7f700 1 -- 172.21.15.6:0/1726292681 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03a0003570 con 0x7f03b80b0ec0 2023-10-06T02:20:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bcb7f700 1 -- 172.21.15.6:0/1726292681 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2620112171 0 0) 0x7f03a0003570 con 0x7f03b80b0ec0 2023-10-06T02:20:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bcb7f700 1 -- 172.21.15.6:0/1726292681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b8159330 msgr2=0x7f03b806ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bcb7f700 1 --2- 172.21.15.6:0/1726292681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b8159330 0x7f03b806ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bcb7f700 1 -- 172.21.15.6:0/1726292681 >> v1:172.21.15.175:6789/0 conn(0x7f03b80b0560 legacy=0x7f03b8069f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bcb7f700 1 -- 172.21.15.6:0/1726292681 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b80b22e0 con 0x7f03b80b0ec0 2023-10-06T02:20:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bcb7f700 1 -- 172.21.15.6:0/1726292681 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f03a80017f0 con 0x7f03b80b0ec0 2023-10-06T02:20:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bcb7f700 1 -- 172.21.15.6:0/1726292681 >> v1:172.21.15.6:6789/0 conn(0x7f03b80b0ec0 legacy=0x7f03b806a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bcb7f700 1 --2- 172.21.15.6:0/1726292681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b8159330 0x7f03a0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bcb7f700 1 --2- 172.21.15.6:0/1726292681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a0003fd0 0x7f03a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bcb7f700 1 --2- 172.21.15.6:0/1726292681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03a0004d50 0x7f03a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bcb7f700 1 -- 172.21.15.6:0/1726292681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80b2000 con 0x7f03a0003fd0 2023-10-06T02:20:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bcb7f700 1 -- 172.21.15.6:0/1726292681 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a000bb40 con 0x7f03a0004d50 2023-10-06T02:20:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bcb7f700 1 -- 172.21.15.6:0/1726292681 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a000bd00 con 0x7f03b8159330 2023-10-06T02:20:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bd380700 1 --2- 172.21.15.6:0/1726292681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a0003fd0 0x7f03a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bdb81700 1 --2- 172.21.15.6:0/1726292681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b8159330 0x7f03a0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03be382700 1 --2- 172.21.15.6:0/1726292681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03a0004d50 0x7f03a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bd380700 1 -- 172.21.15.6:0/1726292681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b8159330 msgr2=0x7f03a0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bd380700 1 --2- 172.21.15.6:0/1726292681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b8159330 0x7f03a0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bd380700 1 -- 172.21.15.6:0/1726292681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03a0004d50 msgr2=0x7f03a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.129+0000 7f03bd380700 1 --2- 172.21.15.6:0/1726292681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03a0004d50 0x7f03a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.130+0000 7f03bd380700 1 -- 172.21.15.6:0/1726292681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a0003570 con 0x7f03a0003fd0 2023-10-06T02:20:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.130+0000 7f03bd380700 1 --2- 172.21.15.6:0/1726292681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a0003fd0 0x7f03a0004810 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f03ac0019a0 tx=0x7f03ac007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26803e3040e534aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.130+0000 7f03bcb7f700 1 -- 172.21.15.6:0/1726292681 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac00c5d0 con 0x7f03a0003fd0 2023-10-06T02:20:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.130+0000 7f03bcb7f700 1 -- 172.21.15.6:0/1726292681 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac00c750 con 0x7f03a0003fd0 2023-10-06T02:20:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.130+0000 7f03bcb7f700 1 -- 172.21.15.6:0/1726292681 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac00cb10 con 0x7f03a0003fd0 2023-10-06T02:20:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.130+0000 7f03bfde5700 1 -- 172.21.15.6:0/1726292681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a0003fd0 msgr2=0x7f03a0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.130+0000 7f03bfde5700 1 --2- 172.21.15.6:0/1726292681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a0003fd0 0x7f03a0004810 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f03ac0019a0 tx=0x7f03ac007d10 comp rx=0 tx=0).stop 2023-10-06T02:20:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.130+0000 7f03be382700 1 -- 172.21.15.6:0/1726292681 reap_dead start 2023-10-06T02:20:16.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.130+0000 7f03bfde5700 1 -- 172.21.15.6:0/1726292681 shutdown_connections 2023-10-06T02:20:16.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.130+0000 7f03bfde5700 1 -- 172.21.15.6:0/1726292681 >> 172.21.15.6:0/1726292681 conn(0x7f03b806cf70 msgr2=0x7f03b80afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:16.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.130+0000 7f03bfde5700 1 -- 172.21.15.6:0/1726292681 shutdown_connections 2023-10-06T02:20:16.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.130+0000 7f03bfde5700 1 -- 172.21.15.6:0/1726292681 wait complete. 2023-10-06T02:20:16.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.131+0000 7f03bfde5700 1 Processor -- start 2023-10-06T02:20:16.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.132+0000 7f03bfde5700 1 -- start start 2023-10-06T02:20:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.132+0000 7f03bfde5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a0003fd0 0x7f03b80c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.132+0000 7f03bfde5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b80c9160 0x7f03b8169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.132+0000 7f03bfde5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03b816a360 0x7f03b816a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.132+0000 7f03bfde5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b816ad20 con 0x7f03a0003fd0 2023-10-06T02:20:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.132+0000 7f03bfde5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80c7bb0 con 0x7f03b816a360 2023-10-06T02:20:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.132+0000 7f03bfde5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80c7e90 con 0x7f03b80c9160 2023-10-06T02:20:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.132+0000 7f03bdb81700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a0003fd0 0x7f03b80c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.132+0000 7f03bdb81700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a0003fd0 0x7f03b80c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42110/0 (socket says 172.21.15.6:42110) 2023-10-06T02:20:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.132+0000 7f03bdb81700 1 -- 172.21.15.6:0/350290554 learned_addr learned my addr 172.21.15.6:0/350290554 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.132+0000 7f03bd380700 1 --2- 172.21.15.6:0/350290554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b80c9160 0x7f03b8169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.132+0000 7f03be382700 1 --2- 172.21.15.6:0/350290554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03b816a360 0x7f03b816a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.133+0000 7f03bdb81700 1 -- 172.21.15.6:0/350290554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b80c9160 msgr2=0x7f03b8169e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.133+0000 7f03bdb81700 1 --2- 172.21.15.6:0/350290554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b80c9160 0x7f03b8169e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.133+0000 7f03bdb81700 1 -- 172.21.15.6:0/350290554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03b816a360 msgr2=0x7f03b816a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.133+0000 7f03bdb81700 1 --2- 172.21.15.6:0/350290554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03b816a360 0x7f03b816a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.133+0000 7f03bdb81700 1 -- 172.21.15.6:0/350290554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b80c8170 con 0x7f03a0003fd0 2023-10-06T02:20:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.133+0000 7f03be382700 1 --2- 172.21.15.6:0/350290554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03b816a360 0x7f03b816a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.133+0000 7f03bdb81700 1 --2- 172.21.15.6:0/350290554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a0003fd0 0x7f03b80c72b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f03b0011d40 tx=0x7f03b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.133+0000 7f03b5ffb700 1 -- 172.21.15.6:0/350290554 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b000fac0 con 0x7f03a0003fd0 2023-10-06T02:20:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.133+0000 7f03b5ffb700 1 -- 172.21.15.6:0/350290554 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b000fc20 con 0x7f03a0003fd0 2023-10-06T02:20:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.133+0000 7f03bfde5700 1 -- 172.21.15.6:0/350290554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b80c8450 con 0x7f03a0003fd0 2023-10-06T02:20:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.133+0000 7f03b5ffb700 1 -- 172.21.15.6:0/350290554 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0014440 con 0x7f03a0003fd0 2023-10-06T02:20:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.133+0000 7f03bfde5700 1 -- 172.21.15.6:0/350290554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b8153fb0 con 0x7f03a0003fd0 2023-10-06T02:20:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.134+0000 7f03bfde5700 1 -- 172.21.15.6:0/350290554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b806f440 con 0x7f03a0003fd0 2023-10-06T02:20:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.135+0000 7f03b5ffb700 1 -- 172.21.15.6:0/350290554 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03b0014a80 con 0x7f03a0003fd0 2023-10-06T02:20:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.135+0000 7f03b5ffb700 1 --2- 172.21.15.6:0/350290554 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f03a4066f30 0x7f03a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.135+0000 7f03b5ffb700 1 -- 172.21.15.6:0/350290554 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f03b0018030 con 0x7f03a0003fd0 2023-10-06T02:20:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.135+0000 7f03bd380700 1 --2- 172.21.15.6:0/350290554 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f03a4066f30 0x7f03a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.136+0000 7f03bd380700 1 --2- 172.21.15.6:0/350290554 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f03a4066f30 0x7f03a40693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f03ac008fd0 tx=0x7f03ac015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:16.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.139+0000 7f03b5ffb700 1 -- 172.21.15.6:0/350290554 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03b0052500 con 0x7f03a0003fd0 2023-10-06T02:20:16.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.415+0000 7f03bfde5700 1 -- 172.21.15.6:0/350290554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f03b80b25c0 con 0x7f03a0003fd0 2023-10-06T02:20:16.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.416+0000 7f03b5ffb700 1 -- 172.21.15.6:0/350290554 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1198 (secure 0 0 0) 0x7f03b00224c0 con 0x7f03a0003fd0 2023-10-06T02:20:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:16.416 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"c557bd13-0401-4965-a08f-5579f545617e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":171,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1696558654,"num_in_osds":8,"osd_in_since":1696558647,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":2441494528,"bytes_avail":770652618752,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":33,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5736}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-10-06T02:19:40.588349+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T02:20:16.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.418+0000 7f03bfde5700 1 -- 172.21.15.6:0/350290554 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f03a4066f30 msgr2=0x7f03a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.418+0000 7f03bfde5700 1 --2- 172.21.15.6:0/350290554 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f03a4066f30 0x7f03a40693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f03ac008fd0 tx=0x7f03ac015000 comp rx=0 tx=0).stop 2023-10-06T02:20:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.418+0000 7f03bfde5700 1 -- 172.21.15.6:0/350290554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a0003fd0 msgr2=0x7f03b80c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.418+0000 7f03bfde5700 1 --2- 172.21.15.6:0/350290554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a0003fd0 0x7f03b80c72b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f03b0011d40 tx=0x7f03b00091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.418+0000 7f03bfde5700 1 -- 172.21.15.6:0/350290554 shutdown_connections 2023-10-06T02:20:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.418+0000 7f03bfde5700 1 --2- 172.21.15.6:0/350290554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03b816a360 0x7f03b816a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.418+0000 7f03bfde5700 1 --2- 172.21.15.6:0/350290554 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f03a4066f30 0x7f03a40693e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.418+0000 7f03bfde5700 1 --2- 172.21.15.6:0/350290554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a0003fd0 0x7f03b80c72b0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.418+0000 7f03bfde5700 1 --2- 172.21.15.6:0/350290554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b80c9160 0x7f03b8169e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.418+0000 7f03bfde5700 1 -- 172.21.15.6:0/350290554 >> 172.21.15.6:0/350290554 conn(0x7f03b806cf70 msgr2=0x7f03b80ad2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.418+0000 7f03bfde5700 1 -- 172.21.15.6:0/350290554 shutdown_connections 2023-10-06T02:20:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.418+0000 7f03bfde5700 1 -- 172.21.15.6:0/350290554 wait complete. 2023-10-06T02:20:16.430 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T02:20:16.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:20:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.549+0000 7f1362f71700 1 Processor -- start 2023-10-06T02:20:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.549+0000 7f1362f71700 1 -- start start 2023-10-06T02:20:16.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.550+0000 7f1362f71700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f135c0af4e0 0x7f135c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:16.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.550+0000 7f1362f71700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135c15e190 con 0x7f135c0af8b0 2023-10-06T02:20:16.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.550+0000 7f1362f71700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135c0cb650 con 0x7f135c15db70 2023-10-06T02:20:16.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.550+0000 7f1362f71700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0b1910 con 0x7f135c0af4e0 2023-10-06T02:20:16.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.550+0000 7f135bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f135c0af8b0 0x7f135c15d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38878/0 (socket says 172.21.15.6:38878) 2023-10-06T02:20:16.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.550+0000 7f135bfff700 1 -- 172.21.15.6:0/1928809871 learned_addr learned my addr 172.21.15.6:0/1928809871 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:16.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.550+0000 7f1360d0d700 1 --2- 172.21.15.6:0/1928809871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f135c0af4e0 0x7f135c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:16.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.550+0000 7f135b7fe700 1 -- 172.21.15.6:0/1928809871 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448141539 0 0) 0x7f135c15e190 con 0x7f135c0af8b0 2023-10-06T02:20:16.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.550+0000 7f135b7fe700 1 -- 172.21.15.6:0/1928809871 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1344003570 con 0x7f135c0af8b0 2023-10-06T02:20:16.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f135b7fe700 1 -- 172.21.15.6:0/1928809871 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 260440394 0 0) 0x7f1344003570 con 0x7f135c0af8b0 2023-10-06T02:20:16.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f135b7fe700 1 -- 172.21.15.6:0/1928809871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f135c0af4e0 msgr2=0x7f135c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:16.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f135b7fe700 1 --2- 172.21.15.6:0/1928809871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f135c0af4e0 0x7f135c0b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f135b7fe700 1 -- 172.21.15.6:0/1928809871 >> v1:172.21.15.175:6789/0 conn(0x7f135c15db70 legacy=0x7f135c0cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:16.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f135b7fe700 1 -- 172.21.15.6:0/1928809871 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c0cad20 con 0x7f135c0af8b0 2023-10-06T02:20:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f135b7fe700 1 -- 172.21.15.6:0/1928809871 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f1350001470 con 0x7f135c0af8b0 2023-10-06T02:20:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f135b7fe700 1 -- 172.21.15.6:0/1928809871 >> v1:172.21.15.6:6789/0 conn(0x7f135c0af8b0 legacy=0x7f135c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f135b7fe700 1 --2- 172.21.15.6:0/1928809871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1344003a90 0x7f1344003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f135b7fe700 1 --2- 172.21.15.6:0/1928809871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f135c0af4e0 0x7f1344004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f135b7fe700 1 --2- 172.21.15.6:0/1928809871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1344004d50 0x7f13440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f135b7fe700 1 -- 172.21.15.6:0/1928809871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0b1910 con 0x7f1344004d50 2023-10-06T02:20:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f135b7fe700 1 -- 172.21.15.6:0/1928809871 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134400bb10 con 0x7f1344003a90 2023-10-06T02:20:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f135b7fe700 1 -- 172.21.15.6:0/1928809871 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134400bcd0 con 0x7f135c0af4e0 2023-10-06T02:20:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f136150e700 1 --2- 172.21.15.6:0/1928809871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1344004d50 0x7f13440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f135bfff700 1 --2- 172.21.15.6:0/1928809871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f135c0af4e0 0x7f1344004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f1360d0d700 1 --2- 172.21.15.6:0/1928809871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1344003a90 0x7f1344003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f136150e700 1 -- 172.21.15.6:0/1928809871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f135c0af4e0 msgr2=0x7f1344004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f136150e700 1 --2- 172.21.15.6:0/1928809871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f135c0af4e0 0x7f1344004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f136150e700 1 -- 172.21.15.6:0/1928809871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1344003a90 msgr2=0x7f1344003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f136150e700 1 --2- 172.21.15.6:0/1928809871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1344003a90 0x7f1344003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f136150e700 1 -- 172.21.15.6:0/1928809871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1344003570 con 0x7f1344004d50 2023-10-06T02:20:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f136150e700 1 --2- 172.21.15.6:0/1928809871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1344004d50 0x7f13440051c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f13540020a0 tx=0x7f13540016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c73d6ac2056c29d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f135b7fe700 1 -- 172.21.15.6:0/1928809871 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540019e0 con 0x7f1344004d50 2023-10-06T02:20:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f135b7fe700 1 -- 172.21.15.6:0/1928809871 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135400c8b0 con 0x7f1344004d50 2023-10-06T02:20:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.551+0000 7f135b7fe700 1 -- 172.21.15.6:0/1928809871 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135400cc50 con 0x7f1344004d50 2023-10-06T02:20:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.552+0000 7f1362f71700 1 -- 172.21.15.6:0/1928809871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1344004d50 msgr2=0x7f13440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.552+0000 7f1362f71700 1 --2- 172.21.15.6:0/1928809871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1344004d50 0x7f13440051c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f13540020a0 tx=0x7f13540016d0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.552+0000 7f136150e700 1 -- 172.21.15.6:0/1928809871 reap_dead start 2023-10-06T02:20:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.552+0000 7f1362f71700 1 -- 172.21.15.6:0/1928809871 shutdown_connections 2023-10-06T02:20:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.552+0000 7f1362f71700 1 -- 172.21.15.6:0/1928809871 >> 172.21.15.6:0/1928809871 conn(0x7f135c068680 msgr2=0x7f135c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.552+0000 7f1362f71700 1 -- 172.21.15.6:0/1928809871 shutdown_connections 2023-10-06T02:20:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.552+0000 7f1362f71700 1 -- 172.21.15.6:0/1928809871 wait complete. 2023-10-06T02:20:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.553+0000 7f1362f71700 1 Processor -- start 2023-10-06T02:20:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.553+0000 7f1362f71700 1 -- start start 2023-10-06T02:20:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.554+0000 7f1362f71700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c151c80 0x7f135c0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.554+0000 7f1362f71700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f135c152050 0x7f135c0cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.554+0000 7f1362f71700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f135c0cf0f0 0x7f135c0b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.554+0000 7f1362f71700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c15dfb0 con 0x7f135c151c80 2023-10-06T02:20:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.554+0000 7f1362f71700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0d01a0 con 0x7f135c152050 2023-10-06T02:20:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.554+0000 7f1362f71700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0cf590 con 0x7f135c0cf0f0 2023-10-06T02:20:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.554+0000 7f1360d0d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c151c80 0x7f135c0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.554+0000 7f1360d0d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c151c80 0x7f135c0d0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42126/0 (socket says 172.21.15.6:42126) 2023-10-06T02:20:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.554+0000 7f1360d0d700 1 -- 172.21.15.6:0/1494295673 learned_addr learned my addr 172.21.15.6:0/1494295673 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.554+0000 7f135bfff700 1 --2- 172.21.15.6:0/1494295673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f135c152050 0x7f135c0cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.554+0000 7f136150e700 1 --2- 172.21.15.6:0/1494295673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f135c0cf0f0 0x7f135c0b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.554+0000 7f1360d0d700 1 -- 172.21.15.6:0/1494295673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f135c0cf0f0 msgr2=0x7f135c0b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.554+0000 7f1360d0d700 1 --2- 172.21.15.6:0/1494295673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f135c0cf0f0 0x7f135c0b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.554+0000 7f1360d0d700 1 -- 172.21.15.6:0/1494295673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f135c152050 msgr2=0x7f135c0cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.554+0000 7f1360d0d700 1 --2- 172.21.15.6:0/1494295673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f135c152050 0x7f135c0cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.554+0000 7f1360d0d700 1 -- 172.21.15.6:0/1494295673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c0cf870 con 0x7f135c151c80 2023-10-06T02:20:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.554+0000 7f1360d0d700 1 --2- 172.21.15.6:0/1494295673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c151c80 0x7f135c0d0630 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f134c006ac0 tx=0x7f134c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.555+0000 7f1358ff9700 1 -- 172.21.15.6:0/1494295673 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c00f940 con 0x7f135c151c80 2023-10-06T02:20:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.555+0000 7f1358ff9700 1 -- 172.21.15.6:0/1494295673 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c00faa0 con 0x7f135c151c80 2023-10-06T02:20:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.555+0000 7f1362f71700 1 -- 172.21.15.6:0/1494295673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135c0cfb50 con 0x7f135c151c80 2023-10-06T02:20:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.555+0000 7f1358ff9700 1 -- 172.21.15.6:0/1494295673 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c00fe20 con 0x7f135c151c80 2023-10-06T02:20:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.555+0000 7f1362f71700 1 -- 172.21.15.6:0/1494295673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135c0d0b70 con 0x7f135c151c80 2023-10-06T02:20:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.556+0000 7f1362f71700 1 -- 172.21.15.6:0/1494295673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135c0d0480 con 0x7f135c151c80 2023-10-06T02:20:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.556+0000 7f1358ff9700 1 -- 172.21.15.6:0/1494295673 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f134c014650 con 0x7f135c151c80 2023-10-06T02:20:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.556+0000 7f1358ff9700 1 --2- 172.21.15.6:0/1494295673 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1348066f30 0x7f13480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.557+0000 7f1358ff9700 1 -- 172.21.15.6:0/1494295673 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f134c018030 con 0x7f135c151c80 2023-10-06T02:20:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.557+0000 7f135bfff700 1 --2- 172.21.15.6:0/1494295673 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1348066f30 0x7f13480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.557+0000 7f135bfff700 1 --2- 172.21.15.6:0/1494295673 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1348066f30 0x7f13480693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f135c152460 tx=0x7f1350001e70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.561+0000 7f1358ff9700 1 -- 172.21.15.6:0/1494295673 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f134c052210 con 0x7f135c151c80 2023-10-06T02:20:16.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.748+0000 7f1362f71700 1 -- 172.21.15.6:0/1494295673 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f135c0cb000 con 0x7f1348066f30 2023-10-06T02:20:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.758+0000 7f1358ff9700 1 -- 172.21.15.6:0/1494295673 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311366 (secure 0 0 0) 0x7f135c0cb000 con 0x7f1348066f30 2023-10-06T02:20:16.761 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:16.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.761+0000 7f1362f71700 1 -- 172.21.15.6:0/1494295673 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1348066f30 msgr2=0x7f13480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:16.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.761+0000 7f1362f71700 1 --2- 172.21.15.6:0/1494295673 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1348066f30 0x7f13480693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f135c152460 tx=0x7f1350001e70 comp rx=0 tx=0).stop 2023-10-06T02:20:16.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.761+0000 7f1362f71700 1 -- 172.21.15.6:0/1494295673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c151c80 msgr2=0x7f135c0d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:16.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.761+0000 7f1362f71700 1 --2- 172.21.15.6:0/1494295673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c151c80 0x7f135c0d0630 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f134c006ac0 tx=0x7f134c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.761+0000 7f1362f71700 1 -- 172.21.15.6:0/1494295673 shutdown_connections 2023-10-06T02:20:16.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.761+0000 7f1362f71700 1 --2- 172.21.15.6:0/1494295673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f135c0cf0f0 0x7f135c0b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.761+0000 7f1362f71700 1 --2- 172.21.15.6:0/1494295673 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1348066f30 0x7f13480693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.761+0000 7f1362f71700 1 --2- 172.21.15.6:0/1494295673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c151c80 0x7f135c0d0630 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.761+0000 7f1362f71700 1 --2- 172.21.15.6:0/1494295673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f135c152050 0x7f135c0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:16.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.761+0000 7f1362f71700 1 -- 172.21.15.6:0/1494295673 >> 172.21.15.6:0/1494295673 conn(0x7f135c068680 msgr2=0x7f135c0cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:16.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.761+0000 7f1362f71700 1 -- 172.21.15.6:0/1494295673 shutdown_connections 2023-10-06T02:20:16.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:16.761+0000 7f1362f71700 1 -- 172.21.15.6:0/1494295673 wait complete. 2023-10-06T02:20:16.765 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:20:16.773 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2023-10-06T02:20:16.597416+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384540,"kb_used_data":6236,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590180,"statfs":{"total":773094113280,"available":770652344320,"internally_reserved":0,"allocated":6385664,"data_stored":3575601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.530135"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.116404+0000","last_change":"2023-10-06T02:20:11.113993+0000","last_active":"2023-10-06T02:20:11.116404+0000","last_peered":"2023-10-06T02:20:11.116404+0000","last_clean":"2023-10-06T02:20:11.116404+0000","last_became_active":"2023-10-06T02:20:11.113708+0000","last_became_peered":"2023-10-06T02:20:11.113708+0000","last_unstale":"2023-10-06T02:20:11.116404+0000","last_undegraded":"2023-10-06T02:20:11.116404+0000","last_fullsized":"2023-10-06T02:20:11.116404+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:44:13.118097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.118877+0000","last_change":"2023-10-06T02:20:11.106655+0000","last_active":"2023-10-06T02:20:11.118877+0000","last_peered":"2023-10-06T02:20:11.118877+0000","last_clean":"2023-10-06T02:20:11.118877+0000","last_became_active":"2023-10-06T02:20:11.106318+0000","last_became_peered":"2023-10-06T02:20:11.106318+0000","last_unstale":"2023-10-06T02:20:11.118877+0000","last_undegraded":"2023-10-06T02:20:11.118877+0000","last_fullsized":"2023-10-06T02:20:11.118877+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:58:37.663097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117680+0000","last_change":"2023-10-06T02:20:11.116541+0000","last_active":"2023-10-06T02:20:11.117680+0000","last_peered":"2023-10-06T02:20:11.117680+0000","last_clean":"2023-10-06T02:20:11.117680+0000","last_became_active":"2023-10-06T02:20:11.115502+0000","last_became_peered":"2023-10-06T02:20:11.115502+0000","last_unstale":"2023-10-06T02:20:11.117680+0000","last_undegraded":"2023-10-06T02:20:11.117680+0000","last_fullsized":"2023-10-06T02:20:11.117680+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:25.208164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.106445+0000","last_change":"2023-10-06T02:20:11.101554+0000","last_active":"2023-10-06T02:20:11.106445+0000","last_peered":"2023-10-06T02:20:11.106445+0000","last_clean":"2023-10-06T02:20:11.106445+0000","last_became_active":"2023-10-06T02:20:11.101303+0000","last_became_peered":"2023-10-06T02:20:11.101303+0000","last_unstale":"2023-10-06T02:20:11.106445+0000","last_undegraded":"2023-10-06T02:20:11.106445+0000","last_fullsized":"2023-10-06T02:20:11.106445+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:36.577978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.107733+0000","last_change":"2023-10-06T02:20:11.105166+0000","last_active":"2023-10-06T02:20:11.107733+0000","last_peered":"2023-10-06T02:20:11.107733+0000","last_clean":"2023-10-06T02:20:11.107733+0000","last_became_active":"2023-10-06T02:20:11.104838+0000","last_became_peered":"2023-10-06T02:20:11.104838+0000","last_unstale":"2023-10-06T02:20:11.107733+0000","last_undegraded":"2023-10-06T02:20:11.107733+0000","last_fullsized":"2023-10-06T02:20:11.107733+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:15.005156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.120626+0000","last_change":"2023-10-06T02:20:11.109852+0000","last_active":"2023-10-06T02:20:11.120626+0000","last_peered":"2023-10-06T02:20:11.120626+0000","last_clean":"2023-10-06T02:20:11.120626+0000","last_became_active":"2023-10-06T02:20:11.108642+0000","last_became_peered":"2023-10-06T02:20:11.108642+0000","last_unstale":"2023-10-06T02:20:11.120626+0000","last_undegraded":"2023-10-06T02:20:11.120626+0000","last_fullsized":"2023-10-06T02:20:11.120626+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:40.247731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115080+0000","last_change":"2023-10-06T02:20:11.103938+0000","last_active":"2023-10-06T02:20:11.115080+0000","last_peered":"2023-10-06T02:20:11.115080+0000","last_clean":"2023-10-06T02:20:11.115080+0000","last_became_active":"2023-10-06T02:20:11.103574+0000","last_became_peered":"2023-10-06T02:20:11.103574+0000","last_unstale":"2023-10-06T02:20:11.115080+0000","last_undegraded":"2023-10-06T02:20:11.115080+0000","last_fullsized":"2023-10-06T02:20:11.115080+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:14.544433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117418+0000","last_change":"2023-10-06T02:20:11.102969+0000","last_active":"2023-10-06T02:20:11.117418+0000","last_peered":"2023-10-06T02:20:11.117418+0000","last_clean":"2023-10-06T02:20:11.117418+0000","last_became_active":"2023-10-06T02:20:11.101913+0000","last_became_peered":"2023-10-06T02:20:11.101913+0000","last_unstale":"2023-10-06T02:20:11.117418+0000","last_undegraded":"2023-10-06T02:20:11.117418+0000","last_fullsized":"2023-10-06T02:20:11.117418+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:12:44.220957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.112846+0000","last_change":"2023-10-06T02:20:11.101607+0000","last_active":"2023-10-06T02:20:11.112846+0000","last_peered":"2023-10-06T02:20:11.112846+0000","last_clean":"2023-10-06T02:20:11.112846+0000","last_became_active":"2023-10-06T02:20:11.101357+0000","last_became_peered":"2023-10-06T02:20:11.101357+0000","last_unstale":"2023-10-06T02:20:11.112846+0000","last_undegraded":"2023-10-06T02:20:11.112846+0000","last_fullsized":"2023-10-06T02:20:11.112846+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:23.573239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.103390+0000","last_change":"2023-10-06T02:20:11.098641+0000","last_active":"2023-10-06T02:20:11.103390+0000","last_peered":"2023-10-06T02:20:11.103390+0000","last_clean":"2023-10-06T02:20:11.103390+0000","last_became_active":"2023-10-06T02:20:11.098306+0000","last_became_peered":"2023-10-06T02:20:11.098306+0000","last_unstale":"2023-10-06T02:20:11.103390+0000","last_undegraded":"2023-10-06T02:20:11.103390+0000","last_fullsized":"2023-10-06T02:20:11.103390+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:47.335615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.100816+0000","last_change":"2023-10-06T02:20:11.097311+0000","last_active":"2023-10-06T02:20:11.100816+0000","last_peered":"2023-10-06T02:20:11.100816+0000","last_clean":"2023-10-06T02:20:11.100816+0000","last_became_active":"2023-10-06T02:20:11.097030+0000","last_became_peered":"2023-10-06T02:20:11.097030+0000","last_unstale":"2023-10-06T02:20:11.100816+0000","last_undegraded":"2023-10-06T02:20:11.100816+0000","last_fullsized":"2023-10-06T02:20:11.100816+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:45.786887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.110463+0000","last_change":"2023-10-06T02:20:11.106034+0000","last_active":"2023-10-06T02:20:11.110463+0000","last_peered":"2023-10-06T02:20:11.110463+0000","last_clean":"2023-10-06T02:20:11.110463+0000","last_became_active":"2023-10-06T02:20:11.105663+0000","last_became_peered":"2023-10-06T02:20:11.105663+0000","last_unstale":"2023-10-06T02:20:11.110463+0000","last_undegraded":"2023-10-06T02:20:11.110463+0000","last_fullsized":"2023-10-06T02:20:11.110463+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:25.208164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115694+0000","last_change":"2023-10-06T02:20:11.109172+0000","last_active":"2023-10-06T02:20:11.115694+0000","last_peered":"2023-10-06T02:20:11.115694+0000","last_clean":"2023-10-06T02:20:11.115694+0000","last_became_active":"2023-10-06T02:20:11.108658+0000","last_became_peered":"2023-10-06T02:20:11.108658+0000","last_unstale":"2023-10-06T02:20:11.115694+0000","last_undegraded":"2023-10-06T02:20:11.115694+0000","last_fullsized":"2023-10-06T02:20:11.115694+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:20.004362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115634+0000","last_change":"2023-10-06T02:20:11.111069+0000","last_active":"2023-10-06T02:20:11.115634+0000","last_peered":"2023-10-06T02:20:11.115634+0000","last_clean":"2023-10-06T02:20:11.115634+0000","last_became_active":"2023-10-06T02:20:11.110748+0000","last_became_peered":"2023-10-06T02:20:11.110748+0000","last_unstale":"2023-10-06T02:20:11.115634+0000","last_undegraded":"2023-10-06T02:20:11.115634+0000","last_fullsized":"2023-10-06T02:20:11.115634+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:52.685391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.112861+0000","last_change":"2023-10-06T02:20:11.102068+0000","last_active":"2023-10-06T02:20:11.112861+0000","last_peered":"2023-10-06T02:20:11.112861+0000","last_clean":"2023-10-06T02:20:11.112861+0000","last_became_active":"2023-10-06T02:20:11.101835+0000","last_became_peered":"2023-10-06T02:20:11.101835+0000","last_unstale":"2023-10-06T02:20:11.112861+0000","last_undegraded":"2023-10-06T02:20:11.112861+0000","last_fullsized":"2023-10-06T02:20:11.112861+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:37.530291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.112165+0000","last_change":"2023-10-06T02:20:11.106403+0000","last_active":"2023-10-06T02:20:11.112165+0000","last_peered":"2023-10-06T02:20:11.112165+0000","last_clean":"2023-10-06T02:20:11.112165+0000","last_became_active":"2023-10-06T02:20:11.106111+0000","last_became_peered":"2023-10-06T02:20:11.106111+0000","last_unstale":"2023-10-06T02:20:11.112165+0000","last_undegraded":"2023-10-06T02:20:11.112165+0000","last_fullsized":"2023-10-06T02:20:11.112165+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:23.573239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117317+0000","last_change":"2023-10-06T02:20:11.102613+0000","last_active":"2023-10-06T02:20:11.117317+0000","last_peered":"2023-10-06T02:20:11.117317+0000","last_clean":"2023-10-06T02:20:11.117317+0000","last_became_active":"2023-10-06T02:20:11.102045+0000","last_became_peered":"2023-10-06T02:20:11.102045+0000","last_unstale":"2023-10-06T02:20:11.117317+0000","last_undegraded":"2023-10-06T02:20:11.117317+0000","last_fullsized":"2023-10-06T02:20:11.117317+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:52.685391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.110710+0000","last_change":"2023-10-06T02:20:11.108935+0000","last_active":"2023-10-06T02:20:11.110710+0000","last_peered":"2023-10-06T02:20:11.110710+0000","last_clean":"2023-10-06T02:20:11.110710+0000","last_became_active":"2023-10-06T02:20:11.108653+0000","last_became_peered":"2023-10-06T02:20:11.108653+0000","last_unstale":"2023-10-06T02:20:11.110710+0000","last_undegraded":"2023-10-06T02:20:11.110710+0000","last_fullsized":"2023-10-06T02:20:11.110710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:30.729695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115740+0000","last_change":"2023-10-06T02:20:11.113996+0000","last_active":"2023-10-06T02:20:11.115740+0000","last_peered":"2023-10-06T02:20:11.115740+0000","last_clean":"2023-10-06T02:20:11.115740+0000","last_became_active":"2023-10-06T02:20:11.113696+0000","last_became_peered":"2023-10-06T02:20:11.113696+0000","last_unstale":"2023-10-06T02:20:11.115740+0000","last_undegraded":"2023-10-06T02:20:11.115740+0000","last_fullsized":"2023-10-06T02:20:11.115740+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:28.757859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.113773+0000","last_change":"2023-10-06T02:20:11.101947+0000","last_active":"2023-10-06T02:20:11.113773+0000","last_peered":"2023-10-06T02:20:11.113773+0000","last_clean":"2023-10-06T02:20:11.113773+0000","last_became_active":"2023-10-06T02:20:11.101516+0000","last_became_peered":"2023-10-06T02:20:11.101516+0000","last_unstale":"2023-10-06T02:20:11.113773+0000","last_undegraded":"2023-10-06T02:20:11.113773+0000","last_fullsized":"2023-10-06T02:20:11.113773+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:24.891501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.110317+0000","last_change":"2023-10-06T02:20:11.106052+0000","last_active":"2023-10-06T02:20:11.110317+0000","last_peered":"2023-10-06T02:20:11.110317+0000","last_clean":"2023-10-06T02:20:11.110317+0000","last_became_active":"2023-10-06T02:20:11.105782+0000","last_became_peered":"2023-10-06T02:20:11.105782+0000","last_unstale":"2023-10-06T02:20:11.110317+0000","last_undegraded":"2023-10-06T02:20:11.110317+0000","last_fullsized":"2023-10-06T02:20:11.110317+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:15.128677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117349+0000","last_change":"2023-10-06T02:20:11.104778+0000","last_active":"2023-10-06T02:20:11.117349+0000","last_peered":"2023-10-06T02:20:11.117349+0000","last_clean":"2023-10-06T02:20:11.117349+0000","last_became_active":"2023-10-06T02:20:11.104197+0000","last_became_peered":"2023-10-06T02:20:11.104197+0000","last_unstale":"2023-10-06T02:20:11.117349+0000","last_undegraded":"2023-10-06T02:20:11.117349+0000","last_fullsized":"2023-10-06T02:20:11.117349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:55.600630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117473+0000","last_change":"2023-10-06T02:20:11.114438+0000","last_active":"2023-10-06T02:20:11.117473+0000","last_peered":"2023-10-06T02:20:11.117473+0000","last_clean":"2023-10-06T02:20:11.117473+0000","last_became_active":"2023-10-06T02:20:11.114020+0000","last_became_peered":"2023-10-06T02:20:11.114020+0000","last_unstale":"2023-10-06T02:20:11.117473+0000","last_undegraded":"2023-10-06T02:20:11.117473+0000","last_fullsized":"2023-10-06T02:20:11.117473+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:36.577978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.104692+0000","last_change":"2023-10-06T02:20:11.101302+0000","last_active":"2023-10-06T02:20:11.104692+0000","last_peered":"2023-10-06T02:20:11.104692+0000","last_clean":"2023-10-06T02:20:11.104692+0000","last_became_active":"2023-10-06T02:20:11.101039+0000","last_became_peered":"2023-10-06T02:20:11.101039+0000","last_unstale":"2023-10-06T02:20:11.104692+0000","last_undegraded":"2023-10-06T02:20:11.104692+0000","last_fullsized":"2023-10-06T02:20:11.104692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:54:21.940162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.107474+0000","last_change":"2023-10-06T02:20:11.104759+0000","last_active":"2023-10-06T02:20:11.107474+0000","last_peered":"2023-10-06T02:20:11.107474+0000","last_clean":"2023-10-06T02:20:11.107474+0000","last_became_active":"2023-10-06T02:20:11.104465+0000","last_became_peered":"2023-10-06T02:20:11.104465+0000","last_unstale":"2023-10-06T02:20:11.107474+0000","last_undegraded":"2023-10-06T02:20:11.107474+0000","last_fullsized":"2023-10-06T02:20:11.107474+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.381824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.102876+0000","last_change":"2023-10-06T02:20:11.099696+0000","last_active":"2023-10-06T02:20:11.102876+0000","last_peered":"2023-10-06T02:20:11.102876+0000","last_clean":"2023-10-06T02:20:11.102876+0000","last_became_active":"2023-10-06T02:20:11.099475+0000","last_became_peered":"2023-10-06T02:20:11.099475+0000","last_unstale":"2023-10-06T02:20:11.102876+0000","last_undegraded":"2023-10-06T02:20:11.102876+0000","last_fullsized":"2023-10-06T02:20:11.102876+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:58.684533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.120768+0000","last_change":"2023-10-06T02:20:11.113137+0000","last_active":"2023-10-06T02:20:11.120768+0000","last_peered":"2023-10-06T02:20:11.120768+0000","last_clean":"2023-10-06T02:20:11.120768+0000","last_became_active":"2023-10-06T02:20:11.110638+0000","last_became_peered":"2023-10-06T02:20:11.110638+0000","last_unstale":"2023-10-06T02:20:11.120768+0000","last_undegraded":"2023-10-06T02:20:11.120768+0000","last_fullsized":"2023-10-06T02:20:11.120768+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:43.723805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.107543+0000","last_change":"2023-10-06T02:20:11.105026+0000","last_active":"2023-10-06T02:20:11.107543+0000","last_peered":"2023-10-06T02:20:11.107543+0000","last_clean":"2023-10-06T02:20:11.107543+0000","last_became_active":"2023-10-06T02:20:11.104786+0000","last_became_peered":"2023-10-06T02:20:11.104786+0000","last_unstale":"2023-10-06T02:20:11.107543+0000","last_undegraded":"2023-10-06T02:20:11.107543+0000","last_fullsized":"2023-10-06T02:20:11.107543+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:24.277448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117670+0000","last_change":"2023-10-06T02:20:11.095082+0000","last_active":"2023-10-06T02:20:11.117670+0000","last_peered":"2023-10-06T02:20:11.117670+0000","last_clean":"2023-10-06T02:20:11.117670+0000","last_became_active":"2023-10-06T02:20:11.094812+0000","last_became_peered":"2023-10-06T02:20:11.094812+0000","last_unstale":"2023-10-06T02:20:11.117670+0000","last_undegraded":"2023-10-06T02:20:11.117670+0000","last_fullsized":"2023-10-06T02:20:11.117670+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:34.589757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117580+0000","last_change":"2023-10-06T02:20:11.115833+0000","last_active":"2023-10-06T02:20:11.117580+0000","last_peered":"2023-10-06T02:20:11.117580+0000","last_clean":"2023-10-06T02:20:11.117580+0000","last_became_active":"2023-10-06T02:20:11.115414+0000","last_became_peered":"2023-10-06T02:20:11.115414+0000","last_unstale":"2023-10-06T02:20:11.117580+0000","last_undegraded":"2023-10-06T02:20:11.117580+0000","last_fullsized":"2023-10-06T02:20:11.117580+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:52.839061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.107187+0000","last_change":"2023-10-06T02:20:11.101695+0000","last_active":"2023-10-06T02:20:11.107187+0000","last_peered":"2023-10-06T02:20:11.107187+0000","last_clean":"2023-10-06T02:20:11.107187+0000","last_became_active":"2023-10-06T02:20:11.101322+0000","last_became_peered":"2023-10-06T02:20:11.101322+0000","last_unstale":"2023-10-06T02:20:11.107187+0000","last_undegraded":"2023-10-06T02:20:11.107187+0000","last_fullsized":"2023-10-06T02:20:11.107187+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:44.705688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.120791+0000","last_change":"2023-10-06T02:20:11.112468+0000","last_active":"2023-10-06T02:20:11.120791+0000","last_peered":"2023-10-06T02:20:11.120791+0000","last_clean":"2023-10-06T02:20:11.120791+0000","last_became_active":"2023-10-06T02:20:11.112156+0000","last_became_peered":"2023-10-06T02:20:11.112156+0000","last_unstale":"2023-10-06T02:20:11.120791+0000","last_undegraded":"2023-10-06T02:20:11.120791+0000","last_fullsized":"2023-10-06T02:20:11.120791+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:14.544433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115780+0000","last_change":"2023-10-06T02:20:11.109133+0000","last_active":"2023-10-06T02:20:11.115780+0000","last_peered":"2023-10-06T02:20:11.115780+0000","last_clean":"2023-10-06T02:20:11.115780+0000","last_became_active":"2023-10-06T02:20:11.108779+0000","last_became_peered":"2023-10-06T02:20:11.108779+0000","last_unstale":"2023-10-06T02:20:11.115780+0000","last_undegraded":"2023-10-06T02:20:11.115780+0000","last_fullsized":"2023-10-06T02:20:11.115780+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:37.530291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.123474+0000","last_change":"2023-10-06T02:20:10.078526+0000","last_active":"2023-10-06T02:20:11.123474+0000","last_peered":"2023-10-06T02:20:11.123474+0000","last_clean":"2023-10-06T02:20:11.123474+0000","last_became_active":"2023-10-06T02:20:10.078260+0000","last_became_peered":"2023-10-06T02:20:10.078260+0000","last_unstale":"2023-10-06T02:20:11.123474+0000","last_undegraded":"2023-10-06T02:20:11.123474+0000","last_fullsized":"2023-10-06T02:20:11.123474+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:40.895709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.110325+0000","last_change":"2023-10-06T02:20:11.106658+0000","last_active":"2023-10-06T02:20:11.110325+0000","last_peered":"2023-10-06T02:20:11.110325+0000","last_clean":"2023-10-06T02:20:11.110325+0000","last_became_active":"2023-10-06T02:20:11.105920+0000","last_became_peered":"2023-10-06T02:20:11.105920+0000","last_unstale":"2023-10-06T02:20:11.110325+0000","last_undegraded":"2023-10-06T02:20:11.110325+0000","last_fullsized":"2023-10-06T02:20:11.110325+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:01.987154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.118896+0000","last_change":"2023-10-06T02:20:10.090120+0000","last_active":"2023-10-06T02:20:11.118896+0000","last_peered":"2023-10-06T02:20:11.118896+0000","last_clean":"2023-10-06T02:20:11.118896+0000","last_became_active":"2023-10-06T02:20:10.089825+0000","last_became_peered":"2023-10-06T02:20:10.089825+0000","last_unstale":"2023-10-06T02:20:11.118896+0000","last_undegraded":"2023-10-06T02:20:11.118896+0000","last_fullsized":"2023-10-06T02:20:11.118896+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:36.079964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.108110+0000","last_change":"2023-10-06T02:20:11.103298+0000","last_active":"2023-10-06T02:20:11.108110+0000","last_peered":"2023-10-06T02:20:11.108110+0000","last_clean":"2023-10-06T02:20:11.108110+0000","last_became_active":"2023-10-06T02:20:11.103008+0000","last_became_peered":"2023-10-06T02:20:11.103008+0000","last_unstale":"2023-10-06T02:20:11.108110+0000","last_undegraded":"2023-10-06T02:20:11.108110+0000","last_fullsized":"2023-10-06T02:20:11.108110+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:06.804501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.123849+0000","last_change":"2023-10-06T02:20:10.076720+0000","last_active":"2023-10-06T02:20:11.123849+0000","last_peered":"2023-10-06T02:20:11.123849+0000","last_clean":"2023-10-06T02:20:11.123849+0000","last_became_active":"2023-10-06T02:20:10.076476+0000","last_became_peered":"2023-10-06T02:20:10.076476+0000","last_unstale":"2023-10-06T02:20:11.123849+0000","last_undegraded":"2023-10-06T02:20:11.123849+0000","last_fullsized":"2023-10-06T02:20:11.123849+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:35.007248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.120813+0000","last_change":"2023-10-06T02:20:11.113419+0000","last_active":"2023-10-06T02:20:11.120813+0000","last_peered":"2023-10-06T02:20:11.120813+0000","last_clean":"2023-10-06T02:20:11.120813+0000","last_became_active":"2023-10-06T02:20:11.109829+0000","last_became_peered":"2023-10-06T02:20:11.109829+0000","last_unstale":"2023-10-06T02:20:11.120813+0000","last_undegraded":"2023-10-06T02:20:11.120813+0000","last_fullsized":"2023-10-06T02:20:11.120813+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:37.055350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117468+0000","last_change":"2023-10-06T02:20:10.084644+0000","last_active":"2023-10-06T02:20:11.117468+0000","last_peered":"2023-10-06T02:20:11.117468+0000","last_clean":"2023-10-06T02:20:11.117468+0000","last_became_active":"2023-10-06T02:20:10.084341+0000","last_became_peered":"2023-10-06T02:20:10.084341+0000","last_unstale":"2023-10-06T02:20:11.117468+0000","last_undegraded":"2023-10-06T02:20:11.117468+0000","last_fullsized":"2023-10-06T02:20:11.117468+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:21:39.310837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117377+0000","last_change":"2023-10-06T02:20:11.104954+0000","last_active":"2023-10-06T02:20:11.117377+0000","last_peered":"2023-10-06T02:20:11.117377+0000","last_clean":"2023-10-06T02:20:11.117377+0000","last_became_active":"2023-10-06T02:20:11.104509+0000","last_became_peered":"2023-10-06T02:20:11.104509+0000","last_unstale":"2023-10-06T02:20:11.117377+0000","last_undegraded":"2023-10-06T02:20:11.117377+0000","last_fullsized":"2023-10-06T02:20:11.117377+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:26.803730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.116311+0000","last_change":"2023-10-06T02:20:10.086329+0000","last_active":"2023-10-06T02:20:11.116311+0000","last_peered":"2023-10-06T02:20:11.116311+0000","last_clean":"2023-10-06T02:20:11.116311+0000","last_became_active":"2023-10-06T02:20:10.086046+0000","last_became_peered":"2023-10-06T02:20:10.086046+0000","last_unstale":"2023-10-06T02:20:11.116311+0000","last_undegraded":"2023-10-06T02:20:11.116311+0000","last_fullsized":"2023-10-06T02:20:11.116311+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:29.725518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.118965+0000","last_change":"2023-10-06T02:20:11.107278+0000","last_active":"2023-10-06T02:20:11.118965+0000","last_peered":"2023-10-06T02:20:11.118965+0000","last_clean":"2023-10-06T02:20:11.118965+0000","last_became_active":"2023-10-06T02:20:11.107025+0000","last_became_peered":"2023-10-06T02:20:11.107025+0000","last_unstale":"2023-10-06T02:20:11.118965+0000","last_undegraded":"2023-10-06T02:20:11.118965+0000","last_fullsized":"2023-10-06T02:20:11.118965+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:10.734750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.122704+0000","last_change":"2023-10-06T02:20:10.082327+0000","last_active":"2023-10-06T02:20:11.122704+0000","last_peered":"2023-10-06T02:20:11.122704+0000","last_clean":"2023-10-06T02:20:11.122704+0000","last_became_active":"2023-10-06T02:20:10.081996+0000","last_became_peered":"2023-10-06T02:20:10.081996+0000","last_unstale":"2023-10-06T02:20:11.122704+0000","last_undegraded":"2023-10-06T02:20:11.122704+0000","last_fullsized":"2023-10-06T02:20:11.122704+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:14.124501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.107261+0000","last_change":"2023-10-06T02:20:11.105312+0000","last_active":"2023-10-06T02:20:11.107261+0000","last_peered":"2023-10-06T02:20:11.107261+0000","last_clean":"2023-10-06T02:20:11.107261+0000","last_became_active":"2023-10-06T02:20:11.105053+0000","last_became_peered":"2023-10-06T02:20:11.105053+0000","last_unstale":"2023-10-06T02:20:11.107261+0000","last_undegraded":"2023-10-06T02:20:11.107261+0000","last_fullsized":"2023-10-06T02:20:11.107261+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:16.770865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.087427+0000","last_change":"2023-10-06T02:20:10.079757+0000","last_active":"2023-10-06T02:20:11.087427+0000","last_peered":"2023-10-06T02:20:11.087427+0000","last_clean":"2023-10-06T02:20:11.087427+0000","last_became_active":"2023-10-06T02:20:10.079351+0000","last_became_peered":"2023-10-06T02:20:10.079351+0000","last_unstale":"2023-10-06T02:20:11.087427+0000","last_undegraded":"2023-10-06T02:20:11.087427+0000","last_fullsized":"2023-10-06T02:20:11.087427+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:17.138568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117360+0000","last_change":"2023-10-06T02:20:11.102879+0000","last_active":"2023-10-06T02:20:11.117360+0000","last_peered":"2023-10-06T02:20:11.117360+0000","last_clean":"2023-10-06T02:20:11.117360+0000","last_became_active":"2023-10-06T02:20:11.102239+0000","last_became_peered":"2023-10-06T02:20:11.102239+0000","last_unstale":"2023-10-06T02:20:11.117360+0000","last_undegraded":"2023-10-06T02:20:11.117360+0000","last_fullsized":"2023-10-06T02:20:11.117360+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:14.544433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.096920+0000","last_change":"2023-10-06T02:20:10.090205+0000","last_active":"2023-10-06T02:20:11.096920+0000","last_peered":"2023-10-06T02:20:11.096920+0000","last_clean":"2023-10-06T02:20:11.096920+0000","last_became_active":"2023-10-06T02:20:10.089892+0000","last_became_peered":"2023-10-06T02:20:10.089892+0000","last_unstale":"2023-10-06T02:20:11.096920+0000","last_undegraded":"2023-10-06T02:20:11.096920+0000","last_fullsized":"2023-10-06T02:20:11.096920+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.049531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115105+0000","last_change":"2023-10-06T02:20:11.104171+0000","last_active":"2023-10-06T02:20:11.115105+0000","last_peered":"2023-10-06T02:20:11.115105+0000","last_clean":"2023-10-06T02:20:11.115105+0000","last_became_active":"2023-10-06T02:20:11.103880+0000","last_became_peered":"2023-10-06T02:20:11.103880+0000","last_unstale":"2023-10-06T02:20:11.115105+0000","last_undegraded":"2023-10-06T02:20:11.115105+0000","last_fullsized":"2023-10-06T02:20:11.115105+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:40.247731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.099588+0000","last_change":"2023-10-06T02:20:10.091798+0000","last_active":"2023-10-06T02:20:11.099588+0000","last_peered":"2023-10-06T02:20:11.099588+0000","last_clean":"2023-10-06T02:20:11.099588+0000","last_became_active":"2023-10-06T02:20:10.091500+0000","last_became_peered":"2023-10-06T02:20:10.091500+0000","last_unstale":"2023-10-06T02:20:11.099588+0000","last_undegraded":"2023-10-06T02:20:11.099588+0000","last_fullsized":"2023-10-06T02:20:11.099588+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:46.331439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.110370+0000","last_change":"2023-10-06T02:20:11.105655+0000","last_active":"2023-10-06T02:20:11.110370+0000","last_peered":"2023-10-06T02:20:11.110370+0000","last_clean":"2023-10-06T02:20:11.110370+0000","last_became_active":"2023-10-06T02:20:11.105371+0000","last_became_peered":"2023-10-06T02:20:11.105371+0000","last_unstale":"2023-10-06T02:20:11.110370+0000","last_undegraded":"2023-10-06T02:20:11.110370+0000","last_fullsized":"2023-10-06T02:20:11.110370+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:03.891383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.090867+0000","last_change":"2023-10-06T02:20:10.086888+0000","last_active":"2023-10-06T02:20:11.090867+0000","last_peered":"2023-10-06T02:20:11.090867+0000","last_clean":"2023-10-06T02:20:11.090867+0000","last_became_active":"2023-10-06T02:20:10.086534+0000","last_became_peered":"2023-10-06T02:20:10.086534+0000","last_unstale":"2023-10-06T02:20:11.090867+0000","last_undegraded":"2023-10-06T02:20:11.090867+0000","last_fullsized":"2023-10-06T02:20:11.090867+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:35.573802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.108145+0000","last_change":"2023-10-06T02:20:11.102733+0000","last_active":"2023-10-06T02:20:11.108145+0000","last_peered":"2023-10-06T02:20:11.108145+0000","last_clean":"2023-10-06T02:20:11.108145+0000","last_became_active":"2023-10-06T02:20:11.102431+0000","last_became_peered":"2023-10-06T02:20:11.102431+0000","last_unstale":"2023-10-06T02:20:11.108145+0000","last_undegraded":"2023-10-06T02:20:11.108145+0000","last_fullsized":"2023-10-06T02:20:11.108145+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:38.427585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.123788+0000","last_change":"2023-10-06T02:20:10.097982+0000","last_active":"2023-10-06T02:20:11.123788+0000","last_peered":"2023-10-06T02:20:11.123788+0000","last_clean":"2023-10-06T02:20:11.123788+0000","last_became_active":"2023-10-06T02:20:10.097762+0000","last_became_peered":"2023-10-06T02:20:10.097762+0000","last_unstale":"2023-10-06T02:20:11.123788+0000","last_undegraded":"2023-10-06T02:20:11.123788+0000","last_fullsized":"2023-10-06T02:20:11.123788+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:37.423409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115436+0000","last_change":"2023-10-06T02:20:11.110781+0000","last_active":"2023-10-06T02:20:11.115436+0000","last_peered":"2023-10-06T02:20:11.115436+0000","last_clean":"2023-10-06T02:20:11.115436+0000","last_became_active":"2023-10-06T02:20:11.110507+0000","last_became_peered":"2023-10-06T02:20:11.110507+0000","last_unstale":"2023-10-06T02:20:11.115436+0000","last_undegraded":"2023-10-06T02:20:11.115436+0000","last_fullsized":"2023-10-06T02:20:11.115436+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:46.518154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.125607+0000","last_change":"2023-10-06T02:20:10.086470+0000","last_active":"2023-10-06T02:20:11.125607+0000","last_peered":"2023-10-06T02:20:11.125607+0000","last_clean":"2023-10-06T02:20:11.125607+0000","last_became_active":"2023-10-06T02:20:10.086190+0000","last_became_peered":"2023-10-06T02:20:10.086190+0000","last_unstale":"2023-10-06T02:20:11.125607+0000","last_undegraded":"2023-10-06T02:20:11.125607+0000","last_fullsized":"2023-10-06T02:20:11.125607+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:45.513978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.103915+0000","last_change":"2023-10-06T02:20:11.095263+0000","last_active":"2023-10-06T02:20:11.103915+0000","last_peered":"2023-10-06T02:20:11.103915+0000","last_clean":"2023-10-06T02:20:11.103915+0000","last_became_active":"2023-10-06T02:20:11.094738+0000","last_became_peered":"2023-10-06T02:20:11.094738+0000","last_unstale":"2023-10-06T02:20:11.103915+0000","last_undegraded":"2023-10-06T02:20:11.103915+0000","last_fullsized":"2023-10-06T02:20:11.103915+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:03.891383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.122794+0000","last_change":"2023-10-06T02:20:10.087539+0000","last_active":"2023-10-06T02:20:11.122794+0000","last_peered":"2023-10-06T02:20:11.122794+0000","last_clean":"2023-10-06T02:20:11.122794+0000","last_became_active":"2023-10-06T02:20:10.086644+0000","last_became_peered":"2023-10-06T02:20:10.086644+0000","last_unstale":"2023-10-06T02:20:11.122794+0000","last_undegraded":"2023-10-06T02:20:11.122794+0000","last_fullsized":"2023-10-06T02:20:11.122794+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.049531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.110337+0000","last_change":"2023-10-06T02:20:11.106048+0000","last_active":"2023-10-06T02:20:11.110337+0000","last_peered":"2023-10-06T02:20:11.110337+0000","last_clean":"2023-10-06T02:20:11.110337+0000","last_became_active":"2023-10-06T02:20:11.105787+0000","last_became_peered":"2023-10-06T02:20:11.105787+0000","last_unstale":"2023-10-06T02:20:11.110337+0000","last_undegraded":"2023-10-06T02:20:11.110337+0000","last_fullsized":"2023-10-06T02:20:11.110337+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:01.291589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.091525+0000","last_change":"2023-10-06T02:20:10.088730+0000","last_active":"2023-10-06T02:20:11.091525+0000","last_peered":"2023-10-06T02:20:11.091525+0000","last_clean":"2023-10-06T02:20:11.091525+0000","last_became_active":"2023-10-06T02:20:10.088448+0000","last_became_peered":"2023-10-06T02:20:10.088448+0000","last_unstale":"2023-10-06T02:20:11.091525+0000","last_undegraded":"2023-10-06T02:20:11.091525+0000","last_fullsized":"2023-10-06T02:20:11.091525+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:10.326174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115661+0000","last_change":"2023-10-06T02:20:11.105890+0000","last_active":"2023-10-06T02:20:11.115661+0000","last_peered":"2023-10-06T02:20:11.115661+0000","last_clean":"2023-10-06T02:20:11.115661+0000","last_became_active":"2023-10-06T02:20:11.105607+0000","last_became_peered":"2023-10-06T02:20:11.105607+0000","last_unstale":"2023-10-06T02:20:11.115661+0000","last_undegraded":"2023-10-06T02:20:11.115661+0000","last_fullsized":"2023-10-06T02:20:11.115661+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:14.861023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.087552+0000","last_change":"2023-10-06T02:20:10.083978+0000","last_active":"2023-10-06T02:20:11.087552+0000","last_peered":"2023-10-06T02:20:11.087552+0000","last_clean":"2023-10-06T02:20:11.087552+0000","last_became_active":"2023-10-06T02:20:10.083702+0000","last_became_peered":"2023-10-06T02:20:10.083702+0000","last_unstale":"2023-10-06T02:20:11.087552+0000","last_undegraded":"2023-10-06T02:20:11.087552+0000","last_fullsized":"2023-10-06T02:20:11.087552+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:32.118709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117452+0000","last_change":"2023-10-06T02:20:11.114227+0000","last_active":"2023-10-06T02:20:11.117452+0000","last_peered":"2023-10-06T02:20:11.117452+0000","last_clean":"2023-10-06T02:20:11.117452+0000","last_became_active":"2023-10-06T02:20:11.113647+0000","last_became_peered":"2023-10-06T02:20:11.113647+0000","last_unstale":"2023-10-06T02:20:11.117452+0000","last_undegraded":"2023-10-06T02:20:11.117452+0000","last_fullsized":"2023-10-06T02:20:11.117452+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:24.022995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.119108+0000","last_change":"2023-10-06T02:20:10.089832+0000","last_active":"2023-10-06T02:20:11.119108+0000","last_peered":"2023-10-06T02:20:11.119108+0000","last_clean":"2023-10-06T02:20:11.119108+0000","last_became_active":"2023-10-06T02:20:10.089490+0000","last_became_peered":"2023-10-06T02:20:10.089490+0000","last_unstale":"2023-10-06T02:20:11.119108+0000","last_undegraded":"2023-10-06T02:20:11.119108+0000","last_fullsized":"2023-10-06T02:20:11.119108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:00.982977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.105430+0000","last_change":"2023-10-06T02:20:11.102113+0000","last_active":"2023-10-06T02:20:11.105430+0000","last_peered":"2023-10-06T02:20:11.105430+0000","last_clean":"2023-10-06T02:20:11.105430+0000","last_became_active":"2023-10-06T02:20:11.101830+0000","last_became_peered":"2023-10-06T02:20:11.101830+0000","last_unstale":"2023-10-06T02:20:11.105430+0000","last_undegraded":"2023-10-06T02:20:11.105430+0000","last_fullsized":"2023-10-06T02:20:11.105430+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:24.022995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.120230+0000","last_change":"2023-10-06T02:20:10.086823+0000","last_active":"2023-10-06T02:20:11.120230+0000","last_peered":"2023-10-06T02:20:11.120230+0000","last_clean":"2023-10-06T02:20:11.120230+0000","last_became_active":"2023-10-06T02:20:10.086536+0000","last_became_peered":"2023-10-06T02:20:10.086536+0000","last_unstale":"2023-10-06T02:20:11.120230+0000","last_undegraded":"2023-10-06T02:20:11.120230+0000","last_fullsized":"2023-10-06T02:20:11.120230+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:10.326174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.110436+0000","last_change":"2023-10-06T02:20:11.106015+0000","last_active":"2023-10-06T02:20:11.110436+0000","last_peered":"2023-10-06T02:20:11.110436+0000","last_clean":"2023-10-06T02:20:11.110436+0000","last_became_active":"2023-10-06T02:20:11.105747+0000","last_became_peered":"2023-10-06T02:20:11.105747+0000","last_unstale":"2023-10-06T02:20:11.110436+0000","last_undegraded":"2023-10-06T02:20:11.110436+0000","last_fullsized":"2023-10-06T02:20:11.110436+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:37.084141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:20:12.101179+0000","last_change":"2023-10-06T02:20:10.082172+0000","last_active":"2023-10-06T02:20:12.101179+0000","last_peered":"2023-10-06T02:20:12.101179+0000","last_clean":"2023-10-06T02:20:12.101179+0000","last_became_active":"2023-10-06T02:20:10.081872+0000","last_became_peered":"2023-10-06T02:20:10.081872+0000","last_unstale":"2023-10-06T02:20:12.101179+0000","last_undegraded":"2023-10-06T02:20:12.101179+0000","last_fullsized":"2023-10-06T02:20:12.101179+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:04.607469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.108163+0000","last_change":"2023-10-06T02:20:11.105313+0000","last_active":"2023-10-06T02:20:11.108163+0000","last_peered":"2023-10-06T02:20:11.108163+0000","last_clean":"2023-10-06T02:20:11.108163+0000","last_became_active":"2023-10-06T02:20:11.103856+0000","last_became_peered":"2023-10-06T02:20:11.103856+0000","last_unstale":"2023-10-06T02:20:11.108163+0000","last_undegraded":"2023-10-06T02:20:11.108163+0000","last_fullsized":"2023-10-06T02:20:11.108163+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:11.745697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.091439+0000","last_change":"2023-10-06T02:20:10.083068+0000","last_active":"2023-10-06T02:20:11.091439+0000","last_peered":"2023-10-06T02:20:11.091439+0000","last_clean":"2023-10-06T02:20:11.091439+0000","last_became_active":"2023-10-06T02:20:10.082811+0000","last_became_peered":"2023-10-06T02:20:10.082811+0000","last_unstale":"2023-10-06T02:20:11.091439+0000","last_undegraded":"2023-10-06T02:20:11.091439+0000","last_fullsized":"2023-10-06T02:20:11.091439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:42.288801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.120712+0000","last_change":"2023-10-06T02:20:11.110935+0000","last_active":"2023-10-06T02:20:11.120712+0000","last_peered":"2023-10-06T02:20:11.120712+0000","last_clean":"2023-10-06T02:20:11.120712+0000","last_became_active":"2023-10-06T02:20:11.109468+0000","last_became_peered":"2023-10-06T02:20:11.109468+0000","last_unstale":"2023-10-06T02:20:11.120712+0000","last_undegraded":"2023-10-06T02:20:11.120712+0000","last_fullsized":"2023-10-06T02:20:11.120712+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:30.735219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.089067+0000","last_change":"2023-10-06T02:20:10.083108+0000","last_active":"2023-10-06T02:20:11.089067+0000","last_peered":"2023-10-06T02:20:11.089067+0000","last_clean":"2023-10-06T02:20:11.089067+0000","last_became_active":"2023-10-06T02:20:10.082824+0000","last_became_peered":"2023-10-06T02:20:10.082824+0000","last_unstale":"2023-10-06T02:20:11.089067+0000","last_undegraded":"2023-10-06T02:20:11.089067+0000","last_fullsized":"2023-10-06T02:20:11.089067+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:12.252411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.113723+0000","last_change":"2023-10-06T02:20:11.095747+0000","last_active":"2023-10-06T02:20:11.113723+0000","last_peered":"2023-10-06T02:20:11.113723+0000","last_clean":"2023-10-06T02:20:11.113723+0000","last_became_active":"2023-10-06T02:20:11.095461+0000","last_became_peered":"2023-10-06T02:20:11.095461+0000","last_unstale":"2023-10-06T02:20:11.113723+0000","last_undegraded":"2023-10-06T02:20:11.113723+0000","last_fullsized":"2023-10-06T02:20:11.113723+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:00.053151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.084275+0000","last_change":"2023-10-06T02:20:10.078394+0000","last_active":"2023-10-06T02:20:11.084275+0000","last_peered":"2023-10-06T02:20:11.084275+0000","last_clean":"2023-10-06T02:20:11.084275+0000","last_became_active":"2023-10-06T02:20:10.078110+0000","last_became_peered":"2023-10-06T02:20:10.078110+0000","last_unstale":"2023-10-06T02:20:11.084275+0000","last_undegraded":"2023-10-06T02:20:11.084275+0000","last_fullsized":"2023-10-06T02:20:11.084275+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:36.939948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.120123+0000","last_change":"2023-10-06T02:20:11.119665+0000","last_active":"2023-10-06T02:20:11.120123+0000","last_peered":"2023-10-06T02:20:11.120123+0000","last_clean":"2023-10-06T02:20:11.120123+0000","last_became_active":"2023-10-06T02:20:11.119406+0000","last_became_peered":"2023-10-06T02:20:11.119406+0000","last_unstale":"2023-10-06T02:20:11.120123+0000","last_undegraded":"2023-10-06T02:20:11.120123+0000","last_fullsized":"2023-10-06T02:20:11.120123+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:58.684533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.097065+0000","last_change":"2023-10-06T02:20:10.087075+0000","last_active":"2023-10-06T02:20:11.097065+0000","last_peered":"2023-10-06T02:20:11.097065+0000","last_clean":"2023-10-06T02:20:11.097065+0000","last_became_active":"2023-10-06T02:20:10.086766+0000","last_became_peered":"2023-10-06T02:20:10.086766+0000","last_unstale":"2023-10-06T02:20:11.097065+0000","last_undegraded":"2023-10-06T02:20:11.097065+0000","last_fullsized":"2023-10-06T02:20:11.097065+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:05.448199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.100959+0000","last_change":"2023-10-06T02:20:11.098498+0000","last_active":"2023-10-06T02:20:11.100959+0000","last_peered":"2023-10-06T02:20:11.100959+0000","last_clean":"2023-10-06T02:20:11.100959+0000","last_became_active":"2023-10-06T02:20:11.098265+0000","last_became_peered":"2023-10-06T02:20:11.098265+0000","last_unstale":"2023-10-06T02:20:11.100959+0000","last_undegraded":"2023-10-06T02:20:11.100959+0000","last_fullsized":"2023-10-06T02:20:11.100959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:02.033773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.084267+0000","last_change":"2023-10-06T02:20:10.075647+0000","last_active":"2023-10-06T02:20:11.084267+0000","last_peered":"2023-10-06T02:20:11.084267+0000","last_clean":"2023-10-06T02:20:11.084267+0000","last_became_active":"2023-10-06T02:20:10.075395+0000","last_became_peered":"2023-10-06T02:20:10.075395+0000","last_unstale":"2023-10-06T02:20:11.084267+0000","last_undegraded":"2023-10-06T02:20:11.084267+0000","last_fullsized":"2023-10-06T02:20:11.084267+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:52.232393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117384+0000","last_change":"2023-10-06T02:20:11.103000+0000","last_active":"2023-10-06T02:20:11.117384+0000","last_peered":"2023-10-06T02:20:11.117384+0000","last_clean":"2023-10-06T02:20:11.117384+0000","last_became_active":"2023-10-06T02:20:11.102626+0000","last_became_peered":"2023-10-06T02:20:11.102626+0000","last_unstale":"2023-10-06T02:20:11.117384+0000","last_undegraded":"2023-10-06T02:20:11.117384+0000","last_fullsized":"2023-10-06T02:20:11.117384+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:40.247731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.089921+0000","last_change":"2023-10-06T02:20:10.088960+0000","last_active":"2023-10-06T02:20:11.089921+0000","last_peered":"2023-10-06T02:20:11.089921+0000","last_clean":"2023-10-06T02:20:11.089921+0000","last_became_active":"2023-10-06T02:20:10.088607+0000","last_became_peered":"2023-10-06T02:20:10.088607+0000","last_unstale":"2023-10-06T02:20:11.089921+0000","last_undegraded":"2023-10-06T02:20:11.089921+0000","last_fullsized":"2023-10-06T02:20:11.089921+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:23.018819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115457+0000","last_change":"2023-10-06T02:20:11.110802+0000","last_active":"2023-10-06T02:20:11.115457+0000","last_peered":"2023-10-06T02:20:11.115457+0000","last_clean":"2023-10-06T02:20:11.115457+0000","last_became_active":"2023-10-06T02:20:11.110527+0000","last_became_peered":"2023-10-06T02:20:11.110527+0000","last_unstale":"2023-10-06T02:20:11.115457+0000","last_undegraded":"2023-10-06T02:20:11.115457+0000","last_fullsized":"2023-10-06T02:20:11.115457+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:37.084141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.093657+0000","last_change":"2023-10-06T02:20:10.085228+0000","last_active":"2023-10-06T02:20:11.093657+0000","last_peered":"2023-10-06T02:20:11.093657+0000","last_clean":"2023-10-06T02:20:11.093657+0000","last_became_active":"2023-10-06T02:20:10.084925+0000","last_became_peered":"2023-10-06T02:20:10.084925+0000","last_unstale":"2023-10-06T02:20:11.093657+0000","last_undegraded":"2023-10-06T02:20:11.093657+0000","last_fullsized":"2023-10-06T02:20:11.093657+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:03.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.097311+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:20:11.097311+0000","last_peered":"2023-10-06T02:20:11.097311+0000","last_clean":"2023-10-06T02:20:11.097311+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:20:11.097311+0000","last_undegraded":"2023-10-06T02:20:11.097311+0000","last_fullsized":"2023-10-06T02:20:11.097311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117388+0000","last_change":"2023-10-06T02:20:11.102666+0000","last_active":"2023-10-06T02:20:11.117388+0000","last_peered":"2023-10-06T02:20:11.117388+0000","last_clean":"2023-10-06T02:20:11.117388+0000","last_became_active":"2023-10-06T02:20:11.102361+0000","last_became_peered":"2023-10-06T02:20:11.102361+0000","last_unstale":"2023-10-06T02:20:11.117388+0000","last_undegraded":"2023-10-06T02:20:11.117388+0000","last_fullsized":"2023-10-06T02:20:11.117388+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:20.630927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117531+0000","last_change":"2023-10-06T02:20:10.087848+0000","last_active":"2023-10-06T02:20:11.117531+0000","last_peered":"2023-10-06T02:20:11.117531+0000","last_clean":"2023-10-06T02:20:11.117531+0000","last_became_active":"2023-10-06T02:20:10.087542+0000","last_became_peered":"2023-10-06T02:20:10.087542+0000","last_unstale":"2023-10-06T02:20:11.117531+0000","last_undegraded":"2023-10-06T02:20:11.117531+0000","last_fullsized":"2023-10-06T02:20:11.117531+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:23.017081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":43,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.090490+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:20:11.090490+0000","last_peered":"2023-10-06T02:20:11.090490+0000","last_clean":"2023-10-06T02:20:11.090490+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:20:11.090490+0000","last_undegraded":"2023-10-06T02:20:11.090490+0000","last_fullsized":"2023-10-06T02:20:11.090490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.120783+0000","last_change":"2023-10-06T02:20:11.112779+0000","last_active":"2023-10-06T02:20:11.120783+0000","last_peered":"2023-10-06T02:20:11.120783+0000","last_clean":"2023-10-06T02:20:11.120783+0000","last_became_active":"2023-10-06T02:20:11.104847+0000","last_became_peered":"2023-10-06T02:20:11.104847+0000","last_unstale":"2023-10-06T02:20:11.120783+0000","last_undegraded":"2023-10-06T02:20:11.120783+0000","last_fullsized":"2023-10-06T02:20:11.120783+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:14.861023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.084267+0000","last_change":"2023-10-06T02:20:10.083735+0000","last_active":"2023-10-06T02:20:11.084267+0000","last_peered":"2023-10-06T02:20:11.084267+0000","last_clean":"2023-10-06T02:20:11.084267+0000","last_became_active":"2023-10-06T02:20:10.083416+0000","last_became_peered":"2023-10-06T02:20:10.083416+0000","last_unstale":"2023-10-06T02:20:11.084267+0000","last_undegraded":"2023-10-06T02:20:11.084267+0000","last_fullsized":"2023-10-06T02:20:11.084267+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:42.288801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.084294+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:20:11.084294+0000","last_peered":"2023-10-06T02:20:11.084294+0000","last_clean":"2023-10-06T02:20:11.084294+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:20:11.084294+0000","last_undegraded":"2023-10-06T02:20:11.084294+0000","last_fullsized":"2023-10-06T02:20:11.084294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":192,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.100015+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:20:11.100015+0000","last_peered":"2023-10-06T02:20:11.100015+0000","last_clean":"2023-10-06T02:20:11.100015+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:20:11.100015+0000","last_undegraded":"2023-10-06T02:20:11.100015+0000","last_fullsized":"2023-10-06T02:20:11.100015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.103936+0000","last_change":"2023-10-06T02:20:11.095410+0000","last_active":"2023-10-06T02:20:11.103936+0000","last_peered":"2023-10-06T02:20:11.103936+0000","last_clean":"2023-10-06T02:20:11.103936+0000","last_became_active":"2023-10-06T02:20:11.095079+0000","last_became_peered":"2023-10-06T02:20:11.095079+0000","last_unstale":"2023-10-06T02:20:11.103936+0000","last_undegraded":"2023-10-06T02:20:11.103936+0000","last_fullsized":"2023-10-06T02:20:11.103936+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:15.128677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.122679+0000","last_change":"2023-10-06T02:20:10.083336+0000","last_active":"2023-10-06T02:20:11.122679+0000","last_peered":"2023-10-06T02:20:11.122679+0000","last_clean":"2023-10-06T02:20:11.122679+0000","last_became_active":"2023-10-06T02:20:10.083061+0000","last_became_peered":"2023-10-06T02:20:10.083061+0000","last_unstale":"2023-10-06T02:20:11.122679+0000","last_undegraded":"2023-10-06T02:20:11.122679+0000","last_fullsized":"2023-10-06T02:20:11.122679+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:05.448199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.099155+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:20:11.099155+0000","last_peered":"2023-10-06T02:20:11.099155+0000","last_clean":"2023-10-06T02:20:11.099155+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:20:11.099155+0000","last_undegraded":"2023-10-06T02:20:11.099155+0000","last_fullsized":"2023-10-06T02:20:11.099155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.113218+0000","last_change":"2023-10-06T02:20:11.099959+0000","last_active":"2023-10-06T02:20:11.113218+0000","last_peered":"2023-10-06T02:20:11.113218+0000","last_clean":"2023-10-06T02:20:11.113218+0000","last_became_active":"2023-10-06T02:20:11.099712+0000","last_became_peered":"2023-10-06T02:20:11.099712+0000","last_unstale":"2023-10-06T02:20:11.113218+0000","last_undegraded":"2023-10-06T02:20:11.113218+0000","last_fullsized":"2023-10-06T02:20:11.113218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:34:57.871546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.091479+0000","last_change":"2023-10-06T02:20:10.078967+0000","last_active":"2023-10-06T02:20:11.091479+0000","last_peered":"2023-10-06T02:20:11.091479+0000","last_clean":"2023-10-06T02:20:11.091479+0000","last_became_active":"2023-10-06T02:20:10.078653+0000","last_became_peered":"2023-10-06T02:20:10.078653+0000","last_unstale":"2023-10-06T02:20:11.091479+0000","last_undegraded":"2023-10-06T02:20:11.091479+0000","last_fullsized":"2023-10-06T02:20:11.091479+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:52.232393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.099919+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:20:11.099919+0000","last_peered":"2023-10-06T02:20:11.099919+0000","last_clean":"2023-10-06T02:20:11.099919+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:20:11.099919+0000","last_undegraded":"2023-10-06T02:20:11.099919+0000","last_fullsized":"2023-10-06T02:20:11.099919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115148+0000","last_change":"2023-10-06T02:20:11.109633+0000","last_active":"2023-10-06T02:20:11.115148+0000","last_peered":"2023-10-06T02:20:11.115148+0000","last_clean":"2023-10-06T02:20:11.115148+0000","last_became_active":"2023-10-06T02:20:11.108810+0000","last_became_peered":"2023-10-06T02:20:11.108810+0000","last_unstale":"2023-10-06T02:20:11.115148+0000","last_undegraded":"2023-10-06T02:20:11.115148+0000","last_fullsized":"2023-10-06T02:20:11.115148+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:06.782485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.087789+0000","last_change":"2023-10-06T02:20:10.087885+0000","last_active":"2023-10-06T02:20:11.087789+0000","last_peered":"2023-10-06T02:20:11.087789+0000","last_clean":"2023-10-06T02:20:11.087789+0000","last_became_active":"2023-10-06T02:20:10.087566+0000","last_became_peered":"2023-10-06T02:20:10.087566+0000","last_unstale":"2023-10-06T02:20:11.087789+0000","last_undegraded":"2023-10-06T02:20:11.087789+0000","last_fullsized":"2023-10-06T02:20:11.087789+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:01.898029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.087643+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:20:11.087643+0000","last_peered":"2023-10-06T02:20:11.087643+0000","last_clean":"2023-10-06T02:20:11.087643+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:20:11.087643+0000","last_undegraded":"2023-10-06T02:20:11.087643+0000","last_fullsized":"2023-10-06T02:20:11.087643+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117599+0000","last_change":"2023-10-06T02:20:11.115708+0000","last_active":"2023-10-06T02:20:11.117599+0000","last_peered":"2023-10-06T02:20:11.117599+0000","last_clean":"2023-10-06T02:20:11.117599+0000","last_became_active":"2023-10-06T02:20:11.115448+0000","last_became_peered":"2023-10-06T02:20:11.115448+0000","last_unstale":"2023-10-06T02:20:11.117599+0000","last_undegraded":"2023-10-06T02:20:11.117599+0000","last_fullsized":"2023-10-06T02:20:11.117599+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:41.899885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.119738+0000","last_change":"2023-10-06T02:20:10.089395+0000","last_active":"2023-10-06T02:20:11.119738+0000","last_peered":"2023-10-06T02:20:11.119738+0000","last_clean":"2023-10-06T02:20:11.119738+0000","last_became_active":"2023-10-06T02:20:10.088441+0000","last_became_peered":"2023-10-06T02:20:10.088441+0000","last_unstale":"2023-10-06T02:20:11.119738+0000","last_undegraded":"2023-10-06T02:20:11.119738+0000","last_fullsized":"2023-10-06T02:20:11.119738+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:45.513978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.091641+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:20:11.091641+0000","last_peered":"2023-10-06T02:20:11.091641+0000","last_clean":"2023-10-06T02:20:11.091641+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:20:11.091641+0000","last_undegraded":"2023-10-06T02:20:11.091641+0000","last_fullsized":"2023-10-06T02:20:11.091641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.101995+0000","last_change":"2023-10-06T02:20:11.094987+0000","last_active":"2023-10-06T02:20:11.101995+0000","last_peered":"2023-10-06T02:20:11.101995+0000","last_clean":"2023-10-06T02:20:11.101995+0000","last_became_active":"2023-10-06T02:20:11.094703+0000","last_became_peered":"2023-10-06T02:20:11.094703+0000","last_unstale":"2023-10-06T02:20:11.101995+0000","last_undegraded":"2023-10-06T02:20:11.101995+0000","last_fullsized":"2023-10-06T02:20:11.101995+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:05.611645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.122818+0000","last_change":"2023-10-06T02:20:10.083694+0000","last_active":"2023-10-06T02:20:11.122818+0000","last_peered":"2023-10-06T02:20:11.122818+0000","last_clean":"2023-10-06T02:20:11.122818+0000","last_became_active":"2023-10-06T02:20:10.083428+0000","last_became_peered":"2023-10-06T02:20:10.083428+0000","last_unstale":"2023-10-06T02:20:11.122818+0000","last_undegraded":"2023-10-06T02:20:11.122818+0000","last_fullsized":"2023-10-06T02:20:11.122818+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:51.834884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.091642+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:20:11.091642+0000","last_peered":"2023-10-06T02:20:11.091642+0000","last_clean":"2023-10-06T02:20:11.091642+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:20:11.091642+0000","last_undegraded":"2023-10-06T02:20:11.091642+0000","last_fullsized":"2023-10-06T02:20:11.091642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298504,"kb_used_data":1216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073336,"statfs":{"total":96636764160,"available":96331096064,"internally_reserved":0,"allocated":1245184,"data_stored":889667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.495,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":1.111,"15min":1.111},"last":0.377},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.38,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67400000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.499},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":1.008,"15min":1.008},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51300000000000001,"15min":0.504},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":1.075,"15min":1.075},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75,"5min":1.149,"15min":1.149},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.75,"5min":1.048,"15min":1.048},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.40600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.68300000000000005,"5min":1.175,"15min":1.175},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.44500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71699999999999997,"5min":1.03,"15min":1.03},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.30399999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63800000000000001,"5min":0.873,"15min":0.873},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.57699999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.45900000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68600000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67700000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53700000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69899999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69999999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.56000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297912,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073928,"statfs":{"total":96636764160,"available":96331702272,"internally_reserved":0,"allocated":638976,"data_stored":298186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.82299999999999995,"15min":0.86699999999999999},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.83599999999999997,"15min":0.88200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":0.433}]},{"osd":1,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68300000000000005,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.371,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":1.002,"15min":1.0780000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69599999999999995,"5min":8.8659999999999997,"15min":8.8659999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69999999999999996,"5min":0.754,"15min":0.754},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":1.1100000000000001,"15min":1.198},"min":{"1min":0.48499999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.75,"5min":10.659000000000001,"15min":10.659000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73199999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.30199999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67000000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.377,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72399999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76800000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.754}]},{"osd":7,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60199999999999998},"min":{"1min":0.41199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.80500000000000005,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.80100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298496,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073344,"statfs":{"total":96636764160,"available":96331104256,"internally_reserved":0,"allocated":1236992,"data_stored":888644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34100000000000003},"min":{"1min":0.23300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35099999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.28100000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.315},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.317},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.376,"15min":0.374},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.60699999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.34000000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.373,"15min":0.36699999999999999},"min":{"1min":0.27600000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.29499999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.33400000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.745,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54200000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61699999999999999,"15min":0.61099999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.52600000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.45600000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.46300000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.60899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.503}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":301229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.30499999999999999,"15min":0.29599999999999999},"min":{"1min":0.224,"5min":0.216,"15min":0.216},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.27400000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.29699999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.371,"15min":0.36099999999999999},"min":{"1min":0.28699999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.318},"min":{"1min":0.25,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.316}]},{"osd":3,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.30099999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.376},{"interface":"front","average":{"1min":0.439,"5min":0.40699999999999997,"15min":0.40100000000000002},"min":{"1min":0.313,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.621,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.60199999999999998},"min":{"1min":0.435,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82199999999999995,"5min":1.369,"15min":1.369},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.55700000000000005,"15min":0.54100000000000004},"min":{"1min":0.42799999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.42699999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.53000000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82899999999999996,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.436},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86299999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60199999999999998,"15min":0.58799999999999997},"min":{"1min":0.46700000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.496}]},{"osd":7,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":1.083,"15min":1.153},"min":{"1min":0.47799999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.87,"5min":11.138,"15min":11.138},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63,"15min":0.621},"min":{"1min":0.52400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88800000000000001,"5min":1.429,"15min":1.429},"last":0.41599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297920,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":647168,"data_stored":298242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.376,"15min":0.37},"min":{"1min":0.25700000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.246},{"interface":"front","average":{"1min":0.439,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.27200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.38600000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.40300000000000002,"15min":0.379},"min":{"1min":0.24299999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.41999999999999998,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.38100000000000001,"15min":0.36799999999999999},"min":{"1min":0.27500000000000002,"5min":0.252,"15min":0.252},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.42499999999999999,"15min":0.41599999999999998},"min":{"1min":0.312,"5min":0.311,"15min":0.311},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.48099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.44600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.437},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.626,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.46200000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.63400000000000001,"15min":0.624},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.47599999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.57399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":299195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51700000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.371},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.38900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36899999999999999,"15min":0.36699999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.60399999999999998,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.42499999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40200000000000002,"15min":0.40500000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.58799999999999997,"5min":0.624,"15min":0.624},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53900000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.44}]},{"osd":4,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76300000000000001,"5min":0.875,"15min":0.875},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77200000000000002,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61499999999999999,"15min":0.621},"min":{"1min":0.40500000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.748,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.48199999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78700000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.52300000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.439,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78600000000000003,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.627,"15min":0.63},"min":{"1min":0.442,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77300000000000002,"5min":1.391,"15min":1.391},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82199999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60199999999999998,"15min":0.59699999999999998},"min":{"1min":0.495,"5min":0.439,"15min":0.439},"max":{"1min":0.79500000000000004,"5min":0.874,"15min":0.874},"last":0.60599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":300675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.42699999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83599999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":1.1930000000000001,"15min":1.2929999999999999},"min":{"1min":0.42799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77400000000000002,"5min":17.879999999999999,"15min":17.879999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":1.171,"15min":1.272},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84699999999999998,"5min":18.010999999999999,"15min":18.010999999999999},"last":0.46300000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78500000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54400000000000004,"15min":0.53400000000000003},"min":{"1min":0.437,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.63}]},{"osd":5,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.51000000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.495},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40699999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80300000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52700000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.75,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.627,"15min":0.629},"min":{"1min":0.42199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.44}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":299763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":0.71899999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68400000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.36299999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.54300000000000004,"15min":0.53600000000000003},"min":{"1min":0.38400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52300000000000002,"15min":0.51500000000000001},"min":{"1min":0.441,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64800000000000002,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.42899999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.53100000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.66200000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.51800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.378,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68000000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.443},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.33900000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.45700000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70399999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71299999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.52200000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72699999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.41999999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74099999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.59499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:20:19.358 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:20:19.361 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:20:19.781 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:20:19.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.915+0000 7f9f23b7c700 1 Processor -- start 2023-10-06T02:20:19.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.915+0000 7f9f23b7c700 1 -- start start 2023-10-06T02:20:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.916+0000 7f9f23b7c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9f1c14fda0 0x7f9f1c1569e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.916+0000 7f9f23b7c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c150170 0x7f9f1c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.916+0000 7f9f23b7c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f1c0c87a0 con 0x7f9f1c0b0800 2023-10-06T02:20:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.916+0000 7f9f23b7c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f1c0c89d0 con 0x7f9f1c14fda0 2023-10-06T02:20:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.916+0000 7f9f23b7c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c1594b0 con 0x7f9f1c150170 2023-10-06T02:20:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.916+0000 7f9f21918700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9f1c14fda0 0x7f9f1c1569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.916+0000 7f9f21117700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c150170 0x7f9f1c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.916+0000 7f9f22119700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f9f1c0b0800 0x7f9f1c0b0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:35158/0 (socket says 172.21.15.6:35158) 2023-10-06T02:20:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.916+0000 7f9f22119700 1 -- 172.21.15.6:0/1800746740 learned_addr learned my addr 172.21.15.6:0/1800746740 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.916+0000 7f9f21117700 1 -- 172.21.15.6:0/1800746740 >> v2:172.21.15.175:3300/0 conn(0x7f9f1c14fda0 msgr2=0x7f9f1c1569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.916+0000 7f9f21117700 1 --2- 172.21.15.6:0/1800746740 >> v2:172.21.15.175:3300/0 conn(0x7f9f1c14fda0 0x7f9f1c1569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.916+0000 7f9f21117700 1 -- 172.21.15.6:0/1800746740 >> v1:172.21.15.175:6789/0 conn(0x7f9f1c0b0800 legacy=0x7f9f1c0b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.916+0000 7f9f21117700 1 -- 172.21.15.6:0/1800746740 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c1596c0 con 0x7f9f1c150170 2023-10-06T02:20:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.916+0000 7f9f20916700 1 -- 172.21.15.6:0/1800746740 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941268021 0 0) 0x7f9f1c0c87a0 con 0x7f9f1c0b0800 2023-10-06T02:20:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.916+0000 7f9f21918700 1 --2- 172.21.15.6:0/1800746740 >> v2:172.21.15.175:3300/0 conn(0x7f9f1c14fda0 0x7f9f1c1569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:20:19.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.917+0000 7f9f21117700 1 --2- 172.21.15.6:0/1800746740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c150170 0x7f9f1c0c8260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9f100098e0 tx=0x7f9f100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d65eb3206d0e1d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:19.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.917+0000 7f9f20916700 1 -- 172.21.15.6:0/1800746740 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1000b640 con 0x7f9f1c150170 2023-10-06T02:20:19.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.917+0000 7f9f20916700 1 -- 172.21.15.6:0/1800746740 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1000b7a0 con 0x7f9f1c150170 2023-10-06T02:20:19.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.917+0000 7f9f20916700 1 -- 172.21.15.6:0/1800746740 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1000bb40 con 0x7f9f1c150170 2023-10-06T02:20:19.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.917+0000 7f9f23b7c700 1 -- 172.21.15.6:0/1800746740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c150170 msgr2=0x7f9f1c0c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:19.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.917+0000 7f9f23b7c700 1 --2- 172.21.15.6:0/1800746740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c150170 0x7f9f1c0c8260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9f100098e0 tx=0x7f9f100091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:19.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.917+0000 7f9f23b7c700 1 -- 172.21.15.6:0/1800746740 shutdown_connections 2023-10-06T02:20:19.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.917+0000 7f9f23b7c700 1 --2- 172.21.15.6:0/1800746740 >> v2:172.21.15.175:3300/0 conn(0x7f9f1c14fda0 0x7f9f1c1569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:19.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.917+0000 7f9f23b7c700 1 --2- 172.21.15.6:0/1800746740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c150170 0x7f9f1c0c8260 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:19.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.917+0000 7f9f23b7c700 1 -- 172.21.15.6:0/1800746740 >> 172.21.15.6:0/1800746740 conn(0x7f9f1c069100 msgr2=0x7f9f1c0ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:19.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.917+0000 7f9f23b7c700 1 -- 172.21.15.6:0/1800746740 shutdown_connections 2023-10-06T02:20:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.918+0000 7f9f23b7c700 1 -- 172.21.15.6:0/1800746740 wait complete. 2023-10-06T02:20:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.919+0000 7f9f23b7c700 1 Processor -- start 2023-10-06T02:20:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.919+0000 7f9f23b7c700 1 -- start start 2023-10-06T02:20:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.919+0000 7f9f23b7c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f1c0b0800 0x7f9f1c14a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.919+0000 7f9f23b7c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f1c14fda0 0x7f9f1c151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.919+0000 7f9f23b7c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c150170 0x7f9f1c1522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.919+0000 7f9f23b7c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c150560 con 0x7f9f1c0b0800 2023-10-06T02:20:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.919+0000 7f9f23b7c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c150840 con 0x7f9f1c14fda0 2023-10-06T02:20:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.919+0000 7f9f23b7c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c150b20 con 0x7f9f1c150170 2023-10-06T02:20:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.919+0000 7f9f21918700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f1c0b0800 0x7f9f1c14a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.920+0000 7f9f21918700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f1c0b0800 0x7f9f1c14a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59888/0 (socket says 172.21.15.6:59888) 2023-10-06T02:20:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.920+0000 7f9f21918700 1 -- 172.21.15.6:0/2915632514 learned_addr learned my addr 172.21.15.6:0/2915632514 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.920+0000 7f9f21117700 1 --2- 172.21.15.6:0/2915632514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f1c14fda0 0x7f9f1c151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.920+0000 7f9f22119700 1 --2- 172.21.15.6:0/2915632514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c150170 0x7f9f1c1522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.920+0000 7f9f21918700 1 -- 172.21.15.6:0/2915632514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c150170 msgr2=0x7f9f1c1522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.920+0000 7f9f21918700 1 --2- 172.21.15.6:0/2915632514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c150170 0x7f9f1c1522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.920+0000 7f9f21918700 1 -- 172.21.15.6:0/2915632514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f1c14fda0 msgr2=0x7f9f1c151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.920+0000 7f9f21918700 1 --2- 172.21.15.6:0/2915632514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f1c14fda0 0x7f9f1c151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.920+0000 7f9f21918700 1 -- 172.21.15.6:0/2915632514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c009a20 con 0x7f9f1c0b0800 2023-10-06T02:20:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.920+0000 7f9f21117700 1 --2- 172.21.15.6:0/2915632514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f1c14fda0 0x7f9f1c151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.920+0000 7f9f21918700 1 --2- 172.21.15.6:0/2915632514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f1c0b0800 0x7f9f1c14a900 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00c170 tx=0x7f9f0c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.920+0000 7f9f19ffb700 1 -- 172.21.15.6:0/2915632514 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c00ce10 con 0x7f9f1c0b0800 2023-10-06T02:20:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.920+0000 7f9f19ffb700 1 -- 172.21.15.6:0/2915632514 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c00f040 con 0x7f9f1c0b0800 2023-10-06T02:20:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.920+0000 7f9f23b7c700 1 -- 172.21.15.6:0/2915632514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f10009420 con 0x7f9f1c0b0800 2023-10-06T02:20:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.920+0000 7f9f19ffb700 1 -- 172.21.15.6:0/2915632514 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c014690 con 0x7f9f1c0b0800 2023-10-06T02:20:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.921+0000 7f9f23b7c700 1 -- 172.21.15.6:0/2915632514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1c151160 con 0x7f9f1c0b0800 2023-10-06T02:20:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.922+0000 7f9f23b7c700 1 -- 172.21.15.6:0/2915632514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1c151730 con 0x7f9f1c0b0800 2023-10-06T02:20:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.922+0000 7f9f19ffb700 1 -- 172.21.15.6:0/2915632514 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f0c014a00 con 0x7f9f1c0b0800 2023-10-06T02:20:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.922+0000 7f9f19ffb700 1 --2- 172.21.15.6:0/2915632514 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9f08066f30 0x7f9f080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.922+0000 7f9f19ffb700 1 -- 172.21.15.6:0/2915632514 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9f0c0856b0 con 0x7f9f1c0b0800 2023-10-06T02:20:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.923+0000 7f9f21117700 1 --2- 172.21.15.6:0/2915632514 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9f08066f30 0x7f9f080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.923+0000 7f9f21117700 1 --2- 172.21.15.6:0/2915632514 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9f08066f30 0x7f9f080693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9f100098e0 tx=0x7f9f10017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:19.927+0000 7f9f19ffb700 1 -- 172.21.15.6:0/2915632514 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f0c052680 con 0x7f9f1c0b0800 2023-10-06T02:20:20.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.115+0000 7f9f23b7c700 1 -- 172.21.15.6:0/2915632514 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f1c04bb80 con 0x7f9f08066f30 2023-10-06T02:20:20.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.125+0000 7f9f19ffb700 1 -- 172.21.15.6:0/2915632514 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311366 (secure 0 0 0) 0x7f9f1c04bb80 con 0x7f9f08066f30 2023-10-06T02:20:20.129 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.128+0000 7f9f23b7c700 1 -- 172.21.15.6:0/2915632514 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9f08066f30 msgr2=0x7f9f080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.128+0000 7f9f23b7c700 1 --2- 172.21.15.6:0/2915632514 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9f08066f30 0x7f9f080693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9f100098e0 tx=0x7f9f10017000 comp rx=0 tx=0).stop 2023-10-06T02:20:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.128+0000 7f9f23b7c700 1 -- 172.21.15.6:0/2915632514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f1c0b0800 msgr2=0x7f9f1c14a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.128+0000 7f9f23b7c700 1 --2- 172.21.15.6:0/2915632514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f1c0b0800 0x7f9f1c14a900 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00c170 tx=0x7f9f0c00b040 comp rx=0 tx=0).stop 2023-10-06T02:20:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.128+0000 7f9f23b7c700 1 -- 172.21.15.6:0/2915632514 shutdown_connections 2023-10-06T02:20:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.128+0000 7f9f23b7c700 1 --2- 172.21.15.6:0/2915632514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c150170 0x7f9f1c1522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.128+0000 7f9f23b7c700 1 --2- 172.21.15.6:0/2915632514 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9f08066f30 0x7f9f080693e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.128+0000 7f9f23b7c700 1 --2- 172.21.15.6:0/2915632514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f1c0b0800 0x7f9f1c14a900 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.128+0000 7f9f23b7c700 1 --2- 172.21.15.6:0/2915632514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f1c14fda0 0x7f9f1c151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.128+0000 7f9f23b7c700 1 -- 172.21.15.6:0/2915632514 >> 172.21.15.6:0/2915632514 conn(0x7f9f1c069100 msgr2=0x7f9f1c14b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.128+0000 7f9f23b7c700 1 -- 172.21.15.6:0/2915632514 shutdown_connections 2023-10-06T02:20:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.128+0000 7f9f23b7c700 1 -- 172.21.15.6:0/2915632514 wait complete. 2023-10-06T02:20:20.133 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:20:20.140 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2023-10-06T02:20:18.598250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384540,"kb_used_data":6236,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590180,"statfs":{"total":773094113280,"available":770652344320,"internally_reserved":0,"allocated":6385664,"data_stored":3575601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002253"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.116404+0000","last_change":"2023-10-06T02:20:11.113993+0000","last_active":"2023-10-06T02:20:11.116404+0000","last_peered":"2023-10-06T02:20:11.116404+0000","last_clean":"2023-10-06T02:20:11.116404+0000","last_became_active":"2023-10-06T02:20:11.113708+0000","last_became_peered":"2023-10-06T02:20:11.113708+0000","last_unstale":"2023-10-06T02:20:11.116404+0000","last_undegraded":"2023-10-06T02:20:11.116404+0000","last_fullsized":"2023-10-06T02:20:11.116404+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:44:13.118097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.118877+0000","last_change":"2023-10-06T02:20:11.106655+0000","last_active":"2023-10-06T02:20:11.118877+0000","last_peered":"2023-10-06T02:20:11.118877+0000","last_clean":"2023-10-06T02:20:11.118877+0000","last_became_active":"2023-10-06T02:20:11.106318+0000","last_became_peered":"2023-10-06T02:20:11.106318+0000","last_unstale":"2023-10-06T02:20:11.118877+0000","last_undegraded":"2023-10-06T02:20:11.118877+0000","last_fullsized":"2023-10-06T02:20:11.118877+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:58:37.663097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117680+0000","last_change":"2023-10-06T02:20:11.116541+0000","last_active":"2023-10-06T02:20:11.117680+0000","last_peered":"2023-10-06T02:20:11.117680+0000","last_clean":"2023-10-06T02:20:11.117680+0000","last_became_active":"2023-10-06T02:20:11.115502+0000","last_became_peered":"2023-10-06T02:20:11.115502+0000","last_unstale":"2023-10-06T02:20:11.117680+0000","last_undegraded":"2023-10-06T02:20:11.117680+0000","last_fullsized":"2023-10-06T02:20:11.117680+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:25.208164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.106445+0000","last_change":"2023-10-06T02:20:11.101554+0000","last_active":"2023-10-06T02:20:11.106445+0000","last_peered":"2023-10-06T02:20:11.106445+0000","last_clean":"2023-10-06T02:20:11.106445+0000","last_became_active":"2023-10-06T02:20:11.101303+0000","last_became_peered":"2023-10-06T02:20:11.101303+0000","last_unstale":"2023-10-06T02:20:11.106445+0000","last_undegraded":"2023-10-06T02:20:11.106445+0000","last_fullsized":"2023-10-06T02:20:11.106445+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:36.577978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.107733+0000","last_change":"2023-10-06T02:20:11.105166+0000","last_active":"2023-10-06T02:20:11.107733+0000","last_peered":"2023-10-06T02:20:11.107733+0000","last_clean":"2023-10-06T02:20:11.107733+0000","last_became_active":"2023-10-06T02:20:11.104838+0000","last_became_peered":"2023-10-06T02:20:11.104838+0000","last_unstale":"2023-10-06T02:20:11.107733+0000","last_undegraded":"2023-10-06T02:20:11.107733+0000","last_fullsized":"2023-10-06T02:20:11.107733+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:15.005156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.120626+0000","last_change":"2023-10-06T02:20:11.109852+0000","last_active":"2023-10-06T02:20:11.120626+0000","last_peered":"2023-10-06T02:20:11.120626+0000","last_clean":"2023-10-06T02:20:11.120626+0000","last_became_active":"2023-10-06T02:20:11.108642+0000","last_became_peered":"2023-10-06T02:20:11.108642+0000","last_unstale":"2023-10-06T02:20:11.120626+0000","last_undegraded":"2023-10-06T02:20:11.120626+0000","last_fullsized":"2023-10-06T02:20:11.120626+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:40.247731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115080+0000","last_change":"2023-10-06T02:20:11.103938+0000","last_active":"2023-10-06T02:20:11.115080+0000","last_peered":"2023-10-06T02:20:11.115080+0000","last_clean":"2023-10-06T02:20:11.115080+0000","last_became_active":"2023-10-06T02:20:11.103574+0000","last_became_peered":"2023-10-06T02:20:11.103574+0000","last_unstale":"2023-10-06T02:20:11.115080+0000","last_undegraded":"2023-10-06T02:20:11.115080+0000","last_fullsized":"2023-10-06T02:20:11.115080+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:14.544433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117418+0000","last_change":"2023-10-06T02:20:11.102969+0000","last_active":"2023-10-06T02:20:11.117418+0000","last_peered":"2023-10-06T02:20:11.117418+0000","last_clean":"2023-10-06T02:20:11.117418+0000","last_became_active":"2023-10-06T02:20:11.101913+0000","last_became_peered":"2023-10-06T02:20:11.101913+0000","last_unstale":"2023-10-06T02:20:11.117418+0000","last_undegraded":"2023-10-06T02:20:11.117418+0000","last_fullsized":"2023-10-06T02:20:11.117418+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:12:44.220957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.112846+0000","last_change":"2023-10-06T02:20:11.101607+0000","last_active":"2023-10-06T02:20:11.112846+0000","last_peered":"2023-10-06T02:20:11.112846+0000","last_clean":"2023-10-06T02:20:11.112846+0000","last_became_active":"2023-10-06T02:20:11.101357+0000","last_became_peered":"2023-10-06T02:20:11.101357+0000","last_unstale":"2023-10-06T02:20:11.112846+0000","last_undegraded":"2023-10-06T02:20:11.112846+0000","last_fullsized":"2023-10-06T02:20:11.112846+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:23.573239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.103390+0000","last_change":"2023-10-06T02:20:11.098641+0000","last_active":"2023-10-06T02:20:11.103390+0000","last_peered":"2023-10-06T02:20:11.103390+0000","last_clean":"2023-10-06T02:20:11.103390+0000","last_became_active":"2023-10-06T02:20:11.098306+0000","last_became_peered":"2023-10-06T02:20:11.098306+0000","last_unstale":"2023-10-06T02:20:11.103390+0000","last_undegraded":"2023-10-06T02:20:11.103390+0000","last_fullsized":"2023-10-06T02:20:11.103390+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:47.335615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.100816+0000","last_change":"2023-10-06T02:20:11.097311+0000","last_active":"2023-10-06T02:20:11.100816+0000","last_peered":"2023-10-06T02:20:11.100816+0000","last_clean":"2023-10-06T02:20:11.100816+0000","last_became_active":"2023-10-06T02:20:11.097030+0000","last_became_peered":"2023-10-06T02:20:11.097030+0000","last_unstale":"2023-10-06T02:20:11.100816+0000","last_undegraded":"2023-10-06T02:20:11.100816+0000","last_fullsized":"2023-10-06T02:20:11.100816+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:45.786887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.110463+0000","last_change":"2023-10-06T02:20:11.106034+0000","last_active":"2023-10-06T02:20:11.110463+0000","last_peered":"2023-10-06T02:20:11.110463+0000","last_clean":"2023-10-06T02:20:11.110463+0000","last_became_active":"2023-10-06T02:20:11.105663+0000","last_became_peered":"2023-10-06T02:20:11.105663+0000","last_unstale":"2023-10-06T02:20:11.110463+0000","last_undegraded":"2023-10-06T02:20:11.110463+0000","last_fullsized":"2023-10-06T02:20:11.110463+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:25.208164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115694+0000","last_change":"2023-10-06T02:20:11.109172+0000","last_active":"2023-10-06T02:20:11.115694+0000","last_peered":"2023-10-06T02:20:11.115694+0000","last_clean":"2023-10-06T02:20:11.115694+0000","last_became_active":"2023-10-06T02:20:11.108658+0000","last_became_peered":"2023-10-06T02:20:11.108658+0000","last_unstale":"2023-10-06T02:20:11.115694+0000","last_undegraded":"2023-10-06T02:20:11.115694+0000","last_fullsized":"2023-10-06T02:20:11.115694+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:20.004362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115634+0000","last_change":"2023-10-06T02:20:11.111069+0000","last_active":"2023-10-06T02:20:11.115634+0000","last_peered":"2023-10-06T02:20:11.115634+0000","last_clean":"2023-10-06T02:20:11.115634+0000","last_became_active":"2023-10-06T02:20:11.110748+0000","last_became_peered":"2023-10-06T02:20:11.110748+0000","last_unstale":"2023-10-06T02:20:11.115634+0000","last_undegraded":"2023-10-06T02:20:11.115634+0000","last_fullsized":"2023-10-06T02:20:11.115634+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:52.685391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.112861+0000","last_change":"2023-10-06T02:20:11.102068+0000","last_active":"2023-10-06T02:20:11.112861+0000","last_peered":"2023-10-06T02:20:11.112861+0000","last_clean":"2023-10-06T02:20:11.112861+0000","last_became_active":"2023-10-06T02:20:11.101835+0000","last_became_peered":"2023-10-06T02:20:11.101835+0000","last_unstale":"2023-10-06T02:20:11.112861+0000","last_undegraded":"2023-10-06T02:20:11.112861+0000","last_fullsized":"2023-10-06T02:20:11.112861+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:37.530291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.112165+0000","last_change":"2023-10-06T02:20:11.106403+0000","last_active":"2023-10-06T02:20:11.112165+0000","last_peered":"2023-10-06T02:20:11.112165+0000","last_clean":"2023-10-06T02:20:11.112165+0000","last_became_active":"2023-10-06T02:20:11.106111+0000","last_became_peered":"2023-10-06T02:20:11.106111+0000","last_unstale":"2023-10-06T02:20:11.112165+0000","last_undegraded":"2023-10-06T02:20:11.112165+0000","last_fullsized":"2023-10-06T02:20:11.112165+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:23.573239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117317+0000","last_change":"2023-10-06T02:20:11.102613+0000","last_active":"2023-10-06T02:20:11.117317+0000","last_peered":"2023-10-06T02:20:11.117317+0000","last_clean":"2023-10-06T02:20:11.117317+0000","last_became_active":"2023-10-06T02:20:11.102045+0000","last_became_peered":"2023-10-06T02:20:11.102045+0000","last_unstale":"2023-10-06T02:20:11.117317+0000","last_undegraded":"2023-10-06T02:20:11.117317+0000","last_fullsized":"2023-10-06T02:20:11.117317+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:52.685391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.110710+0000","last_change":"2023-10-06T02:20:11.108935+0000","last_active":"2023-10-06T02:20:11.110710+0000","last_peered":"2023-10-06T02:20:11.110710+0000","last_clean":"2023-10-06T02:20:11.110710+0000","last_became_active":"2023-10-06T02:20:11.108653+0000","last_became_peered":"2023-10-06T02:20:11.108653+0000","last_unstale":"2023-10-06T02:20:11.110710+0000","last_undegraded":"2023-10-06T02:20:11.110710+0000","last_fullsized":"2023-10-06T02:20:11.110710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:30.729695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115740+0000","last_change":"2023-10-06T02:20:11.113996+0000","last_active":"2023-10-06T02:20:11.115740+0000","last_peered":"2023-10-06T02:20:11.115740+0000","last_clean":"2023-10-06T02:20:11.115740+0000","last_became_active":"2023-10-06T02:20:11.113696+0000","last_became_peered":"2023-10-06T02:20:11.113696+0000","last_unstale":"2023-10-06T02:20:11.115740+0000","last_undegraded":"2023-10-06T02:20:11.115740+0000","last_fullsized":"2023-10-06T02:20:11.115740+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:28.757859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.113773+0000","last_change":"2023-10-06T02:20:11.101947+0000","last_active":"2023-10-06T02:20:11.113773+0000","last_peered":"2023-10-06T02:20:11.113773+0000","last_clean":"2023-10-06T02:20:11.113773+0000","last_became_active":"2023-10-06T02:20:11.101516+0000","last_became_peered":"2023-10-06T02:20:11.101516+0000","last_unstale":"2023-10-06T02:20:11.113773+0000","last_undegraded":"2023-10-06T02:20:11.113773+0000","last_fullsized":"2023-10-06T02:20:11.113773+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:24.891501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.110317+0000","last_change":"2023-10-06T02:20:11.106052+0000","last_active":"2023-10-06T02:20:11.110317+0000","last_peered":"2023-10-06T02:20:11.110317+0000","last_clean":"2023-10-06T02:20:11.110317+0000","last_became_active":"2023-10-06T02:20:11.105782+0000","last_became_peered":"2023-10-06T02:20:11.105782+0000","last_unstale":"2023-10-06T02:20:11.110317+0000","last_undegraded":"2023-10-06T02:20:11.110317+0000","last_fullsized":"2023-10-06T02:20:11.110317+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:15.128677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117349+0000","last_change":"2023-10-06T02:20:11.104778+0000","last_active":"2023-10-06T02:20:11.117349+0000","last_peered":"2023-10-06T02:20:11.117349+0000","last_clean":"2023-10-06T02:20:11.117349+0000","last_became_active":"2023-10-06T02:20:11.104197+0000","last_became_peered":"2023-10-06T02:20:11.104197+0000","last_unstale":"2023-10-06T02:20:11.117349+0000","last_undegraded":"2023-10-06T02:20:11.117349+0000","last_fullsized":"2023-10-06T02:20:11.117349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:55.600630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117473+0000","last_change":"2023-10-06T02:20:11.114438+0000","last_active":"2023-10-06T02:20:11.117473+0000","last_peered":"2023-10-06T02:20:11.117473+0000","last_clean":"2023-10-06T02:20:11.117473+0000","last_became_active":"2023-10-06T02:20:11.114020+0000","last_became_peered":"2023-10-06T02:20:11.114020+0000","last_unstale":"2023-10-06T02:20:11.117473+0000","last_undegraded":"2023-10-06T02:20:11.117473+0000","last_fullsized":"2023-10-06T02:20:11.117473+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:36.577978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.104692+0000","last_change":"2023-10-06T02:20:11.101302+0000","last_active":"2023-10-06T02:20:11.104692+0000","last_peered":"2023-10-06T02:20:11.104692+0000","last_clean":"2023-10-06T02:20:11.104692+0000","last_became_active":"2023-10-06T02:20:11.101039+0000","last_became_peered":"2023-10-06T02:20:11.101039+0000","last_unstale":"2023-10-06T02:20:11.104692+0000","last_undegraded":"2023-10-06T02:20:11.104692+0000","last_fullsized":"2023-10-06T02:20:11.104692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:54:21.940162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.107474+0000","last_change":"2023-10-06T02:20:11.104759+0000","last_active":"2023-10-06T02:20:11.107474+0000","last_peered":"2023-10-06T02:20:11.107474+0000","last_clean":"2023-10-06T02:20:11.107474+0000","last_became_active":"2023-10-06T02:20:11.104465+0000","last_became_peered":"2023-10-06T02:20:11.104465+0000","last_unstale":"2023-10-06T02:20:11.107474+0000","last_undegraded":"2023-10-06T02:20:11.107474+0000","last_fullsized":"2023-10-06T02:20:11.107474+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.381824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.102876+0000","last_change":"2023-10-06T02:20:11.099696+0000","last_active":"2023-10-06T02:20:11.102876+0000","last_peered":"2023-10-06T02:20:11.102876+0000","last_clean":"2023-10-06T02:20:11.102876+0000","last_became_active":"2023-10-06T02:20:11.099475+0000","last_became_peered":"2023-10-06T02:20:11.099475+0000","last_unstale":"2023-10-06T02:20:11.102876+0000","last_undegraded":"2023-10-06T02:20:11.102876+0000","last_fullsized":"2023-10-06T02:20:11.102876+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:58.684533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.120768+0000","last_change":"2023-10-06T02:20:11.113137+0000","last_active":"2023-10-06T02:20:11.120768+0000","last_peered":"2023-10-06T02:20:11.120768+0000","last_clean":"2023-10-06T02:20:11.120768+0000","last_became_active":"2023-10-06T02:20:11.110638+0000","last_became_peered":"2023-10-06T02:20:11.110638+0000","last_unstale":"2023-10-06T02:20:11.120768+0000","last_undegraded":"2023-10-06T02:20:11.120768+0000","last_fullsized":"2023-10-06T02:20:11.120768+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:43.723805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.107543+0000","last_change":"2023-10-06T02:20:11.105026+0000","last_active":"2023-10-06T02:20:11.107543+0000","last_peered":"2023-10-06T02:20:11.107543+0000","last_clean":"2023-10-06T02:20:11.107543+0000","last_became_active":"2023-10-06T02:20:11.104786+0000","last_became_peered":"2023-10-06T02:20:11.104786+0000","last_unstale":"2023-10-06T02:20:11.107543+0000","last_undegraded":"2023-10-06T02:20:11.107543+0000","last_fullsized":"2023-10-06T02:20:11.107543+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:24.277448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117670+0000","last_change":"2023-10-06T02:20:11.095082+0000","last_active":"2023-10-06T02:20:11.117670+0000","last_peered":"2023-10-06T02:20:11.117670+0000","last_clean":"2023-10-06T02:20:11.117670+0000","last_became_active":"2023-10-06T02:20:11.094812+0000","last_became_peered":"2023-10-06T02:20:11.094812+0000","last_unstale":"2023-10-06T02:20:11.117670+0000","last_undegraded":"2023-10-06T02:20:11.117670+0000","last_fullsized":"2023-10-06T02:20:11.117670+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:34.589757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117580+0000","last_change":"2023-10-06T02:20:11.115833+0000","last_active":"2023-10-06T02:20:11.117580+0000","last_peered":"2023-10-06T02:20:11.117580+0000","last_clean":"2023-10-06T02:20:11.117580+0000","last_became_active":"2023-10-06T02:20:11.115414+0000","last_became_peered":"2023-10-06T02:20:11.115414+0000","last_unstale":"2023-10-06T02:20:11.117580+0000","last_undegraded":"2023-10-06T02:20:11.117580+0000","last_fullsized":"2023-10-06T02:20:11.117580+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:52.839061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.107187+0000","last_change":"2023-10-06T02:20:11.101695+0000","last_active":"2023-10-06T02:20:11.107187+0000","last_peered":"2023-10-06T02:20:11.107187+0000","last_clean":"2023-10-06T02:20:11.107187+0000","last_became_active":"2023-10-06T02:20:11.101322+0000","last_became_peered":"2023-10-06T02:20:11.101322+0000","last_unstale":"2023-10-06T02:20:11.107187+0000","last_undegraded":"2023-10-06T02:20:11.107187+0000","last_fullsized":"2023-10-06T02:20:11.107187+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:44.705688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.120791+0000","last_change":"2023-10-06T02:20:11.112468+0000","last_active":"2023-10-06T02:20:11.120791+0000","last_peered":"2023-10-06T02:20:11.120791+0000","last_clean":"2023-10-06T02:20:11.120791+0000","last_became_active":"2023-10-06T02:20:11.112156+0000","last_became_peered":"2023-10-06T02:20:11.112156+0000","last_unstale":"2023-10-06T02:20:11.120791+0000","last_undegraded":"2023-10-06T02:20:11.120791+0000","last_fullsized":"2023-10-06T02:20:11.120791+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:14.544433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115780+0000","last_change":"2023-10-06T02:20:11.109133+0000","last_active":"2023-10-06T02:20:11.115780+0000","last_peered":"2023-10-06T02:20:11.115780+0000","last_clean":"2023-10-06T02:20:11.115780+0000","last_became_active":"2023-10-06T02:20:11.108779+0000","last_became_peered":"2023-10-06T02:20:11.108779+0000","last_unstale":"2023-10-06T02:20:11.115780+0000","last_undegraded":"2023-10-06T02:20:11.115780+0000","last_fullsized":"2023-10-06T02:20:11.115780+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:37.530291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.123474+0000","last_change":"2023-10-06T02:20:10.078526+0000","last_active":"2023-10-06T02:20:11.123474+0000","last_peered":"2023-10-06T02:20:11.123474+0000","last_clean":"2023-10-06T02:20:11.123474+0000","last_became_active":"2023-10-06T02:20:10.078260+0000","last_became_peered":"2023-10-06T02:20:10.078260+0000","last_unstale":"2023-10-06T02:20:11.123474+0000","last_undegraded":"2023-10-06T02:20:11.123474+0000","last_fullsized":"2023-10-06T02:20:11.123474+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:40.895709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.110325+0000","last_change":"2023-10-06T02:20:11.106658+0000","last_active":"2023-10-06T02:20:11.110325+0000","last_peered":"2023-10-06T02:20:11.110325+0000","last_clean":"2023-10-06T02:20:11.110325+0000","last_became_active":"2023-10-06T02:20:11.105920+0000","last_became_peered":"2023-10-06T02:20:11.105920+0000","last_unstale":"2023-10-06T02:20:11.110325+0000","last_undegraded":"2023-10-06T02:20:11.110325+0000","last_fullsized":"2023-10-06T02:20:11.110325+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:01.987154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.118896+0000","last_change":"2023-10-06T02:20:10.090120+0000","last_active":"2023-10-06T02:20:11.118896+0000","last_peered":"2023-10-06T02:20:11.118896+0000","last_clean":"2023-10-06T02:20:11.118896+0000","last_became_active":"2023-10-06T02:20:10.089825+0000","last_became_peered":"2023-10-06T02:20:10.089825+0000","last_unstale":"2023-10-06T02:20:11.118896+0000","last_undegraded":"2023-10-06T02:20:11.118896+0000","last_fullsized":"2023-10-06T02:20:11.118896+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:36.079964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.108110+0000","last_change":"2023-10-06T02:20:11.103298+0000","last_active":"2023-10-06T02:20:11.108110+0000","last_peered":"2023-10-06T02:20:11.108110+0000","last_clean":"2023-10-06T02:20:11.108110+0000","last_became_active":"2023-10-06T02:20:11.103008+0000","last_became_peered":"2023-10-06T02:20:11.103008+0000","last_unstale":"2023-10-06T02:20:11.108110+0000","last_undegraded":"2023-10-06T02:20:11.108110+0000","last_fullsized":"2023-10-06T02:20:11.108110+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:06.804501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.123849+0000","last_change":"2023-10-06T02:20:10.076720+0000","last_active":"2023-10-06T02:20:11.123849+0000","last_peered":"2023-10-06T02:20:11.123849+0000","last_clean":"2023-10-06T02:20:11.123849+0000","last_became_active":"2023-10-06T02:20:10.076476+0000","last_became_peered":"2023-10-06T02:20:10.076476+0000","last_unstale":"2023-10-06T02:20:11.123849+0000","last_undegraded":"2023-10-06T02:20:11.123849+0000","last_fullsized":"2023-10-06T02:20:11.123849+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:35.007248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.120813+0000","last_change":"2023-10-06T02:20:11.113419+0000","last_active":"2023-10-06T02:20:11.120813+0000","last_peered":"2023-10-06T02:20:11.120813+0000","last_clean":"2023-10-06T02:20:11.120813+0000","last_became_active":"2023-10-06T02:20:11.109829+0000","last_became_peered":"2023-10-06T02:20:11.109829+0000","last_unstale":"2023-10-06T02:20:11.120813+0000","last_undegraded":"2023-10-06T02:20:11.120813+0000","last_fullsized":"2023-10-06T02:20:11.120813+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:37.055350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117468+0000","last_change":"2023-10-06T02:20:10.084644+0000","last_active":"2023-10-06T02:20:11.117468+0000","last_peered":"2023-10-06T02:20:11.117468+0000","last_clean":"2023-10-06T02:20:11.117468+0000","last_became_active":"2023-10-06T02:20:10.084341+0000","last_became_peered":"2023-10-06T02:20:10.084341+0000","last_unstale":"2023-10-06T02:20:11.117468+0000","last_undegraded":"2023-10-06T02:20:11.117468+0000","last_fullsized":"2023-10-06T02:20:11.117468+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:21:39.310837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117377+0000","last_change":"2023-10-06T02:20:11.104954+0000","last_active":"2023-10-06T02:20:11.117377+0000","last_peered":"2023-10-06T02:20:11.117377+0000","last_clean":"2023-10-06T02:20:11.117377+0000","last_became_active":"2023-10-06T02:20:11.104509+0000","last_became_peered":"2023-10-06T02:20:11.104509+0000","last_unstale":"2023-10-06T02:20:11.117377+0000","last_undegraded":"2023-10-06T02:20:11.117377+0000","last_fullsized":"2023-10-06T02:20:11.117377+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:26.803730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.116311+0000","last_change":"2023-10-06T02:20:10.086329+0000","last_active":"2023-10-06T02:20:11.116311+0000","last_peered":"2023-10-06T02:20:11.116311+0000","last_clean":"2023-10-06T02:20:11.116311+0000","last_became_active":"2023-10-06T02:20:10.086046+0000","last_became_peered":"2023-10-06T02:20:10.086046+0000","last_unstale":"2023-10-06T02:20:11.116311+0000","last_undegraded":"2023-10-06T02:20:11.116311+0000","last_fullsized":"2023-10-06T02:20:11.116311+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:29.725518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.118965+0000","last_change":"2023-10-06T02:20:11.107278+0000","last_active":"2023-10-06T02:20:11.118965+0000","last_peered":"2023-10-06T02:20:11.118965+0000","last_clean":"2023-10-06T02:20:11.118965+0000","last_became_active":"2023-10-06T02:20:11.107025+0000","last_became_peered":"2023-10-06T02:20:11.107025+0000","last_unstale":"2023-10-06T02:20:11.118965+0000","last_undegraded":"2023-10-06T02:20:11.118965+0000","last_fullsized":"2023-10-06T02:20:11.118965+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:10.734750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.122704+0000","last_change":"2023-10-06T02:20:10.082327+0000","last_active":"2023-10-06T02:20:11.122704+0000","last_peered":"2023-10-06T02:20:11.122704+0000","last_clean":"2023-10-06T02:20:11.122704+0000","last_became_active":"2023-10-06T02:20:10.081996+0000","last_became_peered":"2023-10-06T02:20:10.081996+0000","last_unstale":"2023-10-06T02:20:11.122704+0000","last_undegraded":"2023-10-06T02:20:11.122704+0000","last_fullsized":"2023-10-06T02:20:11.122704+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:14.124501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.107261+0000","last_change":"2023-10-06T02:20:11.105312+0000","last_active":"2023-10-06T02:20:11.107261+0000","last_peered":"2023-10-06T02:20:11.107261+0000","last_clean":"2023-10-06T02:20:11.107261+0000","last_became_active":"2023-10-06T02:20:11.105053+0000","last_became_peered":"2023-10-06T02:20:11.105053+0000","last_unstale":"2023-10-06T02:20:11.107261+0000","last_undegraded":"2023-10-06T02:20:11.107261+0000","last_fullsized":"2023-10-06T02:20:11.107261+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:16.770865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.087427+0000","last_change":"2023-10-06T02:20:10.079757+0000","last_active":"2023-10-06T02:20:11.087427+0000","last_peered":"2023-10-06T02:20:11.087427+0000","last_clean":"2023-10-06T02:20:11.087427+0000","last_became_active":"2023-10-06T02:20:10.079351+0000","last_became_peered":"2023-10-06T02:20:10.079351+0000","last_unstale":"2023-10-06T02:20:11.087427+0000","last_undegraded":"2023-10-06T02:20:11.087427+0000","last_fullsized":"2023-10-06T02:20:11.087427+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:17.138568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117360+0000","last_change":"2023-10-06T02:20:11.102879+0000","last_active":"2023-10-06T02:20:11.117360+0000","last_peered":"2023-10-06T02:20:11.117360+0000","last_clean":"2023-10-06T02:20:11.117360+0000","last_became_active":"2023-10-06T02:20:11.102239+0000","last_became_peered":"2023-10-06T02:20:11.102239+0000","last_unstale":"2023-10-06T02:20:11.117360+0000","last_undegraded":"2023-10-06T02:20:11.117360+0000","last_fullsized":"2023-10-06T02:20:11.117360+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:14.544433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.096920+0000","last_change":"2023-10-06T02:20:10.090205+0000","last_active":"2023-10-06T02:20:11.096920+0000","last_peered":"2023-10-06T02:20:11.096920+0000","last_clean":"2023-10-06T02:20:11.096920+0000","last_became_active":"2023-10-06T02:20:10.089892+0000","last_became_peered":"2023-10-06T02:20:10.089892+0000","last_unstale":"2023-10-06T02:20:11.096920+0000","last_undegraded":"2023-10-06T02:20:11.096920+0000","last_fullsized":"2023-10-06T02:20:11.096920+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.049531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115105+0000","last_change":"2023-10-06T02:20:11.104171+0000","last_active":"2023-10-06T02:20:11.115105+0000","last_peered":"2023-10-06T02:20:11.115105+0000","last_clean":"2023-10-06T02:20:11.115105+0000","last_became_active":"2023-10-06T02:20:11.103880+0000","last_became_peered":"2023-10-06T02:20:11.103880+0000","last_unstale":"2023-10-06T02:20:11.115105+0000","last_undegraded":"2023-10-06T02:20:11.115105+0000","last_fullsized":"2023-10-06T02:20:11.115105+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:40.247731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.099588+0000","last_change":"2023-10-06T02:20:10.091798+0000","last_active":"2023-10-06T02:20:11.099588+0000","last_peered":"2023-10-06T02:20:11.099588+0000","last_clean":"2023-10-06T02:20:11.099588+0000","last_became_active":"2023-10-06T02:20:10.091500+0000","last_became_peered":"2023-10-06T02:20:10.091500+0000","last_unstale":"2023-10-06T02:20:11.099588+0000","last_undegraded":"2023-10-06T02:20:11.099588+0000","last_fullsized":"2023-10-06T02:20:11.099588+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:46.331439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.110370+0000","last_change":"2023-10-06T02:20:11.105655+0000","last_active":"2023-10-06T02:20:11.110370+0000","last_peered":"2023-10-06T02:20:11.110370+0000","last_clean":"2023-10-06T02:20:11.110370+0000","last_became_active":"2023-10-06T02:20:11.105371+0000","last_became_peered":"2023-10-06T02:20:11.105371+0000","last_unstale":"2023-10-06T02:20:11.110370+0000","last_undegraded":"2023-10-06T02:20:11.110370+0000","last_fullsized":"2023-10-06T02:20:11.110370+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:03.891383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.090867+0000","last_change":"2023-10-06T02:20:10.086888+0000","last_active":"2023-10-06T02:20:11.090867+0000","last_peered":"2023-10-06T02:20:11.090867+0000","last_clean":"2023-10-06T02:20:11.090867+0000","last_became_active":"2023-10-06T02:20:10.086534+0000","last_became_peered":"2023-10-06T02:20:10.086534+0000","last_unstale":"2023-10-06T02:20:11.090867+0000","last_undegraded":"2023-10-06T02:20:11.090867+0000","last_fullsized":"2023-10-06T02:20:11.090867+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:35.573802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.108145+0000","last_change":"2023-10-06T02:20:11.102733+0000","last_active":"2023-10-06T02:20:11.108145+0000","last_peered":"2023-10-06T02:20:11.108145+0000","last_clean":"2023-10-06T02:20:11.108145+0000","last_became_active":"2023-10-06T02:20:11.102431+0000","last_became_peered":"2023-10-06T02:20:11.102431+0000","last_unstale":"2023-10-06T02:20:11.108145+0000","last_undegraded":"2023-10-06T02:20:11.108145+0000","last_fullsized":"2023-10-06T02:20:11.108145+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:38.427585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.123788+0000","last_change":"2023-10-06T02:20:10.097982+0000","last_active":"2023-10-06T02:20:11.123788+0000","last_peered":"2023-10-06T02:20:11.123788+0000","last_clean":"2023-10-06T02:20:11.123788+0000","last_became_active":"2023-10-06T02:20:10.097762+0000","last_became_peered":"2023-10-06T02:20:10.097762+0000","last_unstale":"2023-10-06T02:20:11.123788+0000","last_undegraded":"2023-10-06T02:20:11.123788+0000","last_fullsized":"2023-10-06T02:20:11.123788+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:37.423409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115436+0000","last_change":"2023-10-06T02:20:11.110781+0000","last_active":"2023-10-06T02:20:11.115436+0000","last_peered":"2023-10-06T02:20:11.115436+0000","last_clean":"2023-10-06T02:20:11.115436+0000","last_became_active":"2023-10-06T02:20:11.110507+0000","last_became_peered":"2023-10-06T02:20:11.110507+0000","last_unstale":"2023-10-06T02:20:11.115436+0000","last_undegraded":"2023-10-06T02:20:11.115436+0000","last_fullsized":"2023-10-06T02:20:11.115436+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:46.518154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.125607+0000","last_change":"2023-10-06T02:20:10.086470+0000","last_active":"2023-10-06T02:20:11.125607+0000","last_peered":"2023-10-06T02:20:11.125607+0000","last_clean":"2023-10-06T02:20:11.125607+0000","last_became_active":"2023-10-06T02:20:10.086190+0000","last_became_peered":"2023-10-06T02:20:10.086190+0000","last_unstale":"2023-10-06T02:20:11.125607+0000","last_undegraded":"2023-10-06T02:20:11.125607+0000","last_fullsized":"2023-10-06T02:20:11.125607+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:45.513978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.103915+0000","last_change":"2023-10-06T02:20:11.095263+0000","last_active":"2023-10-06T02:20:11.103915+0000","last_peered":"2023-10-06T02:20:11.103915+0000","last_clean":"2023-10-06T02:20:11.103915+0000","last_became_active":"2023-10-06T02:20:11.094738+0000","last_became_peered":"2023-10-06T02:20:11.094738+0000","last_unstale":"2023-10-06T02:20:11.103915+0000","last_undegraded":"2023-10-06T02:20:11.103915+0000","last_fullsized":"2023-10-06T02:20:11.103915+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:03.891383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.122794+0000","last_change":"2023-10-06T02:20:10.087539+0000","last_active":"2023-10-06T02:20:11.122794+0000","last_peered":"2023-10-06T02:20:11.122794+0000","last_clean":"2023-10-06T02:20:11.122794+0000","last_became_active":"2023-10-06T02:20:10.086644+0000","last_became_peered":"2023-10-06T02:20:10.086644+0000","last_unstale":"2023-10-06T02:20:11.122794+0000","last_undegraded":"2023-10-06T02:20:11.122794+0000","last_fullsized":"2023-10-06T02:20:11.122794+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.049531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.110337+0000","last_change":"2023-10-06T02:20:11.106048+0000","last_active":"2023-10-06T02:20:11.110337+0000","last_peered":"2023-10-06T02:20:11.110337+0000","last_clean":"2023-10-06T02:20:11.110337+0000","last_became_active":"2023-10-06T02:20:11.105787+0000","last_became_peered":"2023-10-06T02:20:11.105787+0000","last_unstale":"2023-10-06T02:20:11.110337+0000","last_undegraded":"2023-10-06T02:20:11.110337+0000","last_fullsized":"2023-10-06T02:20:11.110337+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:01.291589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.091525+0000","last_change":"2023-10-06T02:20:10.088730+0000","last_active":"2023-10-06T02:20:11.091525+0000","last_peered":"2023-10-06T02:20:11.091525+0000","last_clean":"2023-10-06T02:20:11.091525+0000","last_became_active":"2023-10-06T02:20:10.088448+0000","last_became_peered":"2023-10-06T02:20:10.088448+0000","last_unstale":"2023-10-06T02:20:11.091525+0000","last_undegraded":"2023-10-06T02:20:11.091525+0000","last_fullsized":"2023-10-06T02:20:11.091525+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:10.326174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115661+0000","last_change":"2023-10-06T02:20:11.105890+0000","last_active":"2023-10-06T02:20:11.115661+0000","last_peered":"2023-10-06T02:20:11.115661+0000","last_clean":"2023-10-06T02:20:11.115661+0000","last_became_active":"2023-10-06T02:20:11.105607+0000","last_became_peered":"2023-10-06T02:20:11.105607+0000","last_unstale":"2023-10-06T02:20:11.115661+0000","last_undegraded":"2023-10-06T02:20:11.115661+0000","last_fullsized":"2023-10-06T02:20:11.115661+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:14.861023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.087552+0000","last_change":"2023-10-06T02:20:10.083978+0000","last_active":"2023-10-06T02:20:11.087552+0000","last_peered":"2023-10-06T02:20:11.087552+0000","last_clean":"2023-10-06T02:20:11.087552+0000","last_became_active":"2023-10-06T02:20:10.083702+0000","last_became_peered":"2023-10-06T02:20:10.083702+0000","last_unstale":"2023-10-06T02:20:11.087552+0000","last_undegraded":"2023-10-06T02:20:11.087552+0000","last_fullsized":"2023-10-06T02:20:11.087552+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:32.118709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117452+0000","last_change":"2023-10-06T02:20:11.114227+0000","last_active":"2023-10-06T02:20:11.117452+0000","last_peered":"2023-10-06T02:20:11.117452+0000","last_clean":"2023-10-06T02:20:11.117452+0000","last_became_active":"2023-10-06T02:20:11.113647+0000","last_became_peered":"2023-10-06T02:20:11.113647+0000","last_unstale":"2023-10-06T02:20:11.117452+0000","last_undegraded":"2023-10-06T02:20:11.117452+0000","last_fullsized":"2023-10-06T02:20:11.117452+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:24.022995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.119108+0000","last_change":"2023-10-06T02:20:10.089832+0000","last_active":"2023-10-06T02:20:11.119108+0000","last_peered":"2023-10-06T02:20:11.119108+0000","last_clean":"2023-10-06T02:20:11.119108+0000","last_became_active":"2023-10-06T02:20:10.089490+0000","last_became_peered":"2023-10-06T02:20:10.089490+0000","last_unstale":"2023-10-06T02:20:11.119108+0000","last_undegraded":"2023-10-06T02:20:11.119108+0000","last_fullsized":"2023-10-06T02:20:11.119108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:00.982977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.105430+0000","last_change":"2023-10-06T02:20:11.102113+0000","last_active":"2023-10-06T02:20:11.105430+0000","last_peered":"2023-10-06T02:20:11.105430+0000","last_clean":"2023-10-06T02:20:11.105430+0000","last_became_active":"2023-10-06T02:20:11.101830+0000","last_became_peered":"2023-10-06T02:20:11.101830+0000","last_unstale":"2023-10-06T02:20:11.105430+0000","last_undegraded":"2023-10-06T02:20:11.105430+0000","last_fullsized":"2023-10-06T02:20:11.105430+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:24.022995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.120230+0000","last_change":"2023-10-06T02:20:10.086823+0000","last_active":"2023-10-06T02:20:11.120230+0000","last_peered":"2023-10-06T02:20:11.120230+0000","last_clean":"2023-10-06T02:20:11.120230+0000","last_became_active":"2023-10-06T02:20:10.086536+0000","last_became_peered":"2023-10-06T02:20:10.086536+0000","last_unstale":"2023-10-06T02:20:11.120230+0000","last_undegraded":"2023-10-06T02:20:11.120230+0000","last_fullsized":"2023-10-06T02:20:11.120230+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:10.326174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.110436+0000","last_change":"2023-10-06T02:20:11.106015+0000","last_active":"2023-10-06T02:20:11.110436+0000","last_peered":"2023-10-06T02:20:11.110436+0000","last_clean":"2023-10-06T02:20:11.110436+0000","last_became_active":"2023-10-06T02:20:11.105747+0000","last_became_peered":"2023-10-06T02:20:11.105747+0000","last_unstale":"2023-10-06T02:20:11.110436+0000","last_undegraded":"2023-10-06T02:20:11.110436+0000","last_fullsized":"2023-10-06T02:20:11.110436+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:37.084141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:20:12.101179+0000","last_change":"2023-10-06T02:20:10.082172+0000","last_active":"2023-10-06T02:20:12.101179+0000","last_peered":"2023-10-06T02:20:12.101179+0000","last_clean":"2023-10-06T02:20:12.101179+0000","last_became_active":"2023-10-06T02:20:10.081872+0000","last_became_peered":"2023-10-06T02:20:10.081872+0000","last_unstale":"2023-10-06T02:20:12.101179+0000","last_undegraded":"2023-10-06T02:20:12.101179+0000","last_fullsized":"2023-10-06T02:20:12.101179+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:04.607469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.108163+0000","last_change":"2023-10-06T02:20:11.105313+0000","last_active":"2023-10-06T02:20:11.108163+0000","last_peered":"2023-10-06T02:20:11.108163+0000","last_clean":"2023-10-06T02:20:11.108163+0000","last_became_active":"2023-10-06T02:20:11.103856+0000","last_became_peered":"2023-10-06T02:20:11.103856+0000","last_unstale":"2023-10-06T02:20:11.108163+0000","last_undegraded":"2023-10-06T02:20:11.108163+0000","last_fullsized":"2023-10-06T02:20:11.108163+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:11.745697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.091439+0000","last_change":"2023-10-06T02:20:10.083068+0000","last_active":"2023-10-06T02:20:11.091439+0000","last_peered":"2023-10-06T02:20:11.091439+0000","last_clean":"2023-10-06T02:20:11.091439+0000","last_became_active":"2023-10-06T02:20:10.082811+0000","last_became_peered":"2023-10-06T02:20:10.082811+0000","last_unstale":"2023-10-06T02:20:11.091439+0000","last_undegraded":"2023-10-06T02:20:11.091439+0000","last_fullsized":"2023-10-06T02:20:11.091439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:42.288801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.120712+0000","last_change":"2023-10-06T02:20:11.110935+0000","last_active":"2023-10-06T02:20:11.120712+0000","last_peered":"2023-10-06T02:20:11.120712+0000","last_clean":"2023-10-06T02:20:11.120712+0000","last_became_active":"2023-10-06T02:20:11.109468+0000","last_became_peered":"2023-10-06T02:20:11.109468+0000","last_unstale":"2023-10-06T02:20:11.120712+0000","last_undegraded":"2023-10-06T02:20:11.120712+0000","last_fullsized":"2023-10-06T02:20:11.120712+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:30.735219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.089067+0000","last_change":"2023-10-06T02:20:10.083108+0000","last_active":"2023-10-06T02:20:11.089067+0000","last_peered":"2023-10-06T02:20:11.089067+0000","last_clean":"2023-10-06T02:20:11.089067+0000","last_became_active":"2023-10-06T02:20:10.082824+0000","last_became_peered":"2023-10-06T02:20:10.082824+0000","last_unstale":"2023-10-06T02:20:11.089067+0000","last_undegraded":"2023-10-06T02:20:11.089067+0000","last_fullsized":"2023-10-06T02:20:11.089067+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:12.252411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.113723+0000","last_change":"2023-10-06T02:20:11.095747+0000","last_active":"2023-10-06T02:20:11.113723+0000","last_peered":"2023-10-06T02:20:11.113723+0000","last_clean":"2023-10-06T02:20:11.113723+0000","last_became_active":"2023-10-06T02:20:11.095461+0000","last_became_peered":"2023-10-06T02:20:11.095461+0000","last_unstale":"2023-10-06T02:20:11.113723+0000","last_undegraded":"2023-10-06T02:20:11.113723+0000","last_fullsized":"2023-10-06T02:20:11.113723+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:00.053151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.084275+0000","last_change":"2023-10-06T02:20:10.078394+0000","last_active":"2023-10-06T02:20:11.084275+0000","last_peered":"2023-10-06T02:20:11.084275+0000","last_clean":"2023-10-06T02:20:11.084275+0000","last_became_active":"2023-10-06T02:20:10.078110+0000","last_became_peered":"2023-10-06T02:20:10.078110+0000","last_unstale":"2023-10-06T02:20:11.084275+0000","last_undegraded":"2023-10-06T02:20:11.084275+0000","last_fullsized":"2023-10-06T02:20:11.084275+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:36.939948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.120123+0000","last_change":"2023-10-06T02:20:11.119665+0000","last_active":"2023-10-06T02:20:11.120123+0000","last_peered":"2023-10-06T02:20:11.120123+0000","last_clean":"2023-10-06T02:20:11.120123+0000","last_became_active":"2023-10-06T02:20:11.119406+0000","last_became_peered":"2023-10-06T02:20:11.119406+0000","last_unstale":"2023-10-06T02:20:11.120123+0000","last_undegraded":"2023-10-06T02:20:11.120123+0000","last_fullsized":"2023-10-06T02:20:11.120123+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:58.684533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.097065+0000","last_change":"2023-10-06T02:20:10.087075+0000","last_active":"2023-10-06T02:20:11.097065+0000","last_peered":"2023-10-06T02:20:11.097065+0000","last_clean":"2023-10-06T02:20:11.097065+0000","last_became_active":"2023-10-06T02:20:10.086766+0000","last_became_peered":"2023-10-06T02:20:10.086766+0000","last_unstale":"2023-10-06T02:20:11.097065+0000","last_undegraded":"2023-10-06T02:20:11.097065+0000","last_fullsized":"2023-10-06T02:20:11.097065+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:05.448199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.100959+0000","last_change":"2023-10-06T02:20:11.098498+0000","last_active":"2023-10-06T02:20:11.100959+0000","last_peered":"2023-10-06T02:20:11.100959+0000","last_clean":"2023-10-06T02:20:11.100959+0000","last_became_active":"2023-10-06T02:20:11.098265+0000","last_became_peered":"2023-10-06T02:20:11.098265+0000","last_unstale":"2023-10-06T02:20:11.100959+0000","last_undegraded":"2023-10-06T02:20:11.100959+0000","last_fullsized":"2023-10-06T02:20:11.100959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:02.033773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.084267+0000","last_change":"2023-10-06T02:20:10.075647+0000","last_active":"2023-10-06T02:20:11.084267+0000","last_peered":"2023-10-06T02:20:11.084267+0000","last_clean":"2023-10-06T02:20:11.084267+0000","last_became_active":"2023-10-06T02:20:10.075395+0000","last_became_peered":"2023-10-06T02:20:10.075395+0000","last_unstale":"2023-10-06T02:20:11.084267+0000","last_undegraded":"2023-10-06T02:20:11.084267+0000","last_fullsized":"2023-10-06T02:20:11.084267+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:52.232393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117384+0000","last_change":"2023-10-06T02:20:11.103000+0000","last_active":"2023-10-06T02:20:11.117384+0000","last_peered":"2023-10-06T02:20:11.117384+0000","last_clean":"2023-10-06T02:20:11.117384+0000","last_became_active":"2023-10-06T02:20:11.102626+0000","last_became_peered":"2023-10-06T02:20:11.102626+0000","last_unstale":"2023-10-06T02:20:11.117384+0000","last_undegraded":"2023-10-06T02:20:11.117384+0000","last_fullsized":"2023-10-06T02:20:11.117384+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:40.247731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.089921+0000","last_change":"2023-10-06T02:20:10.088960+0000","last_active":"2023-10-06T02:20:11.089921+0000","last_peered":"2023-10-06T02:20:11.089921+0000","last_clean":"2023-10-06T02:20:11.089921+0000","last_became_active":"2023-10-06T02:20:10.088607+0000","last_became_peered":"2023-10-06T02:20:10.088607+0000","last_unstale":"2023-10-06T02:20:11.089921+0000","last_undegraded":"2023-10-06T02:20:11.089921+0000","last_fullsized":"2023-10-06T02:20:11.089921+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:23.018819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115457+0000","last_change":"2023-10-06T02:20:11.110802+0000","last_active":"2023-10-06T02:20:11.115457+0000","last_peered":"2023-10-06T02:20:11.115457+0000","last_clean":"2023-10-06T02:20:11.115457+0000","last_became_active":"2023-10-06T02:20:11.110527+0000","last_became_peered":"2023-10-06T02:20:11.110527+0000","last_unstale":"2023-10-06T02:20:11.115457+0000","last_undegraded":"2023-10-06T02:20:11.115457+0000","last_fullsized":"2023-10-06T02:20:11.115457+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:37.084141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.093657+0000","last_change":"2023-10-06T02:20:10.085228+0000","last_active":"2023-10-06T02:20:11.093657+0000","last_peered":"2023-10-06T02:20:11.093657+0000","last_clean":"2023-10-06T02:20:11.093657+0000","last_became_active":"2023-10-06T02:20:10.084925+0000","last_became_peered":"2023-10-06T02:20:10.084925+0000","last_unstale":"2023-10-06T02:20:11.093657+0000","last_undegraded":"2023-10-06T02:20:11.093657+0000","last_fullsized":"2023-10-06T02:20:11.093657+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:03.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.097311+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:20:11.097311+0000","last_peered":"2023-10-06T02:20:11.097311+0000","last_clean":"2023-10-06T02:20:11.097311+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:20:11.097311+0000","last_undegraded":"2023-10-06T02:20:11.097311+0000","last_fullsized":"2023-10-06T02:20:11.097311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117388+0000","last_change":"2023-10-06T02:20:11.102666+0000","last_active":"2023-10-06T02:20:11.117388+0000","last_peered":"2023-10-06T02:20:11.117388+0000","last_clean":"2023-10-06T02:20:11.117388+0000","last_became_active":"2023-10-06T02:20:11.102361+0000","last_became_peered":"2023-10-06T02:20:11.102361+0000","last_unstale":"2023-10-06T02:20:11.117388+0000","last_undegraded":"2023-10-06T02:20:11.117388+0000","last_fullsized":"2023-10-06T02:20:11.117388+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:20.630927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117531+0000","last_change":"2023-10-06T02:20:10.087848+0000","last_active":"2023-10-06T02:20:11.117531+0000","last_peered":"2023-10-06T02:20:11.117531+0000","last_clean":"2023-10-06T02:20:11.117531+0000","last_became_active":"2023-10-06T02:20:10.087542+0000","last_became_peered":"2023-10-06T02:20:10.087542+0000","last_unstale":"2023-10-06T02:20:11.117531+0000","last_undegraded":"2023-10-06T02:20:11.117531+0000","last_fullsized":"2023-10-06T02:20:11.117531+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:23.017081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":43,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.090490+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:20:11.090490+0000","last_peered":"2023-10-06T02:20:11.090490+0000","last_clean":"2023-10-06T02:20:11.090490+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:20:11.090490+0000","last_undegraded":"2023-10-06T02:20:11.090490+0000","last_fullsized":"2023-10-06T02:20:11.090490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.120783+0000","last_change":"2023-10-06T02:20:11.112779+0000","last_active":"2023-10-06T02:20:11.120783+0000","last_peered":"2023-10-06T02:20:11.120783+0000","last_clean":"2023-10-06T02:20:11.120783+0000","last_became_active":"2023-10-06T02:20:11.104847+0000","last_became_peered":"2023-10-06T02:20:11.104847+0000","last_unstale":"2023-10-06T02:20:11.120783+0000","last_undegraded":"2023-10-06T02:20:11.120783+0000","last_fullsized":"2023-10-06T02:20:11.120783+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:14.861023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.084267+0000","last_change":"2023-10-06T02:20:10.083735+0000","last_active":"2023-10-06T02:20:11.084267+0000","last_peered":"2023-10-06T02:20:11.084267+0000","last_clean":"2023-10-06T02:20:11.084267+0000","last_became_active":"2023-10-06T02:20:10.083416+0000","last_became_peered":"2023-10-06T02:20:10.083416+0000","last_unstale":"2023-10-06T02:20:11.084267+0000","last_undegraded":"2023-10-06T02:20:11.084267+0000","last_fullsized":"2023-10-06T02:20:11.084267+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:42.288801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.084294+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:20:11.084294+0000","last_peered":"2023-10-06T02:20:11.084294+0000","last_clean":"2023-10-06T02:20:11.084294+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:20:11.084294+0000","last_undegraded":"2023-10-06T02:20:11.084294+0000","last_fullsized":"2023-10-06T02:20:11.084294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":192,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.100015+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:20:11.100015+0000","last_peered":"2023-10-06T02:20:11.100015+0000","last_clean":"2023-10-06T02:20:11.100015+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:20:11.100015+0000","last_undegraded":"2023-10-06T02:20:11.100015+0000","last_fullsized":"2023-10-06T02:20:11.100015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.103936+0000","last_change":"2023-10-06T02:20:11.095410+0000","last_active":"2023-10-06T02:20:11.103936+0000","last_peered":"2023-10-06T02:20:11.103936+0000","last_clean":"2023-10-06T02:20:11.103936+0000","last_became_active":"2023-10-06T02:20:11.095079+0000","last_became_peered":"2023-10-06T02:20:11.095079+0000","last_unstale":"2023-10-06T02:20:11.103936+0000","last_undegraded":"2023-10-06T02:20:11.103936+0000","last_fullsized":"2023-10-06T02:20:11.103936+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:15.128677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.122679+0000","last_change":"2023-10-06T02:20:10.083336+0000","last_active":"2023-10-06T02:20:11.122679+0000","last_peered":"2023-10-06T02:20:11.122679+0000","last_clean":"2023-10-06T02:20:11.122679+0000","last_became_active":"2023-10-06T02:20:10.083061+0000","last_became_peered":"2023-10-06T02:20:10.083061+0000","last_unstale":"2023-10-06T02:20:11.122679+0000","last_undegraded":"2023-10-06T02:20:11.122679+0000","last_fullsized":"2023-10-06T02:20:11.122679+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:05.448199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.099155+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:20:11.099155+0000","last_peered":"2023-10-06T02:20:11.099155+0000","last_clean":"2023-10-06T02:20:11.099155+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:20:11.099155+0000","last_undegraded":"2023-10-06T02:20:11.099155+0000","last_fullsized":"2023-10-06T02:20:11.099155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.113218+0000","last_change":"2023-10-06T02:20:11.099959+0000","last_active":"2023-10-06T02:20:11.113218+0000","last_peered":"2023-10-06T02:20:11.113218+0000","last_clean":"2023-10-06T02:20:11.113218+0000","last_became_active":"2023-10-06T02:20:11.099712+0000","last_became_peered":"2023-10-06T02:20:11.099712+0000","last_unstale":"2023-10-06T02:20:11.113218+0000","last_undegraded":"2023-10-06T02:20:11.113218+0000","last_fullsized":"2023-10-06T02:20:11.113218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:34:57.871546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.091479+0000","last_change":"2023-10-06T02:20:10.078967+0000","last_active":"2023-10-06T02:20:11.091479+0000","last_peered":"2023-10-06T02:20:11.091479+0000","last_clean":"2023-10-06T02:20:11.091479+0000","last_became_active":"2023-10-06T02:20:10.078653+0000","last_became_peered":"2023-10-06T02:20:10.078653+0000","last_unstale":"2023-10-06T02:20:11.091479+0000","last_undegraded":"2023-10-06T02:20:11.091479+0000","last_fullsized":"2023-10-06T02:20:11.091479+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:52.232393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.099919+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:20:11.099919+0000","last_peered":"2023-10-06T02:20:11.099919+0000","last_clean":"2023-10-06T02:20:11.099919+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:20:11.099919+0000","last_undegraded":"2023-10-06T02:20:11.099919+0000","last_fullsized":"2023-10-06T02:20:11.099919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.115148+0000","last_change":"2023-10-06T02:20:11.109633+0000","last_active":"2023-10-06T02:20:11.115148+0000","last_peered":"2023-10-06T02:20:11.115148+0000","last_clean":"2023-10-06T02:20:11.115148+0000","last_became_active":"2023-10-06T02:20:11.108810+0000","last_became_peered":"2023-10-06T02:20:11.108810+0000","last_unstale":"2023-10-06T02:20:11.115148+0000","last_undegraded":"2023-10-06T02:20:11.115148+0000","last_fullsized":"2023-10-06T02:20:11.115148+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:06.782485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.087789+0000","last_change":"2023-10-06T02:20:10.087885+0000","last_active":"2023-10-06T02:20:11.087789+0000","last_peered":"2023-10-06T02:20:11.087789+0000","last_clean":"2023-10-06T02:20:11.087789+0000","last_became_active":"2023-10-06T02:20:10.087566+0000","last_became_peered":"2023-10-06T02:20:10.087566+0000","last_unstale":"2023-10-06T02:20:11.087789+0000","last_undegraded":"2023-10-06T02:20:11.087789+0000","last_fullsized":"2023-10-06T02:20:11.087789+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:01.898029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.087643+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:20:11.087643+0000","last_peered":"2023-10-06T02:20:11.087643+0000","last_clean":"2023-10-06T02:20:11.087643+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:20:11.087643+0000","last_undegraded":"2023-10-06T02:20:11.087643+0000","last_fullsized":"2023-10-06T02:20:11.087643+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.117599+0000","last_change":"2023-10-06T02:20:11.115708+0000","last_active":"2023-10-06T02:20:11.117599+0000","last_peered":"2023-10-06T02:20:11.117599+0000","last_clean":"2023-10-06T02:20:11.117599+0000","last_became_active":"2023-10-06T02:20:11.115448+0000","last_became_peered":"2023-10-06T02:20:11.115448+0000","last_unstale":"2023-10-06T02:20:11.117599+0000","last_undegraded":"2023-10-06T02:20:11.117599+0000","last_fullsized":"2023-10-06T02:20:11.117599+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:41.899885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.119738+0000","last_change":"2023-10-06T02:20:10.089395+0000","last_active":"2023-10-06T02:20:11.119738+0000","last_peered":"2023-10-06T02:20:11.119738+0000","last_clean":"2023-10-06T02:20:11.119738+0000","last_became_active":"2023-10-06T02:20:10.088441+0000","last_became_peered":"2023-10-06T02:20:10.088441+0000","last_unstale":"2023-10-06T02:20:11.119738+0000","last_undegraded":"2023-10-06T02:20:11.119738+0000","last_fullsized":"2023-10-06T02:20:11.119738+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:45.513978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.091641+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:20:11.091641+0000","last_peered":"2023-10-06T02:20:11.091641+0000","last_clean":"2023-10-06T02:20:11.091641+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:20:11.091641+0000","last_undegraded":"2023-10-06T02:20:11.091641+0000","last_fullsized":"2023-10-06T02:20:11.091641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.101995+0000","last_change":"2023-10-06T02:20:11.094987+0000","last_active":"2023-10-06T02:20:11.101995+0000","last_peered":"2023-10-06T02:20:11.101995+0000","last_clean":"2023-10-06T02:20:11.101995+0000","last_became_active":"2023-10-06T02:20:11.094703+0000","last_became_peered":"2023-10-06T02:20:11.094703+0000","last_unstale":"2023-10-06T02:20:11.101995+0000","last_undegraded":"2023-10-06T02:20:11.101995+0000","last_fullsized":"2023-10-06T02:20:11.101995+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:10.064186+0000","last_clean_scrub_stamp":"2023-10-06T02:20:10.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:05.611645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.122818+0000","last_change":"2023-10-06T02:20:10.083694+0000","last_active":"2023-10-06T02:20:11.122818+0000","last_peered":"2023-10-06T02:20:11.122818+0000","last_clean":"2023-10-06T02:20:11.122818+0000","last_became_active":"2023-10-06T02:20:10.083428+0000","last_became_peered":"2023-10-06T02:20:10.083428+0000","last_unstale":"2023-10-06T02:20:11.122818+0000","last_undegraded":"2023-10-06T02:20:11.122818+0000","last_fullsized":"2023-10-06T02:20:11.122818+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:09.060009+0000","last_clean_scrub_stamp":"2023-10-06T02:20:09.060009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:51.834884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:20:11.091642+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:20:11.091642+0000","last_peered":"2023-10-06T02:20:11.091642+0000","last_clean":"2023-10-06T02:20:11.091642+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:20:11.091642+0000","last_undegraded":"2023-10-06T02:20:11.091642+0000","last_fullsized":"2023-10-06T02:20:11.091642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298504,"kb_used_data":1216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073336,"statfs":{"total":96636764160,"available":96331096064,"internally_reserved":0,"allocated":1245184,"data_stored":889667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.495,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":1.111,"15min":1.111},"last":0.377},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.38,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67400000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.499},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":1.008,"15min":1.008},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51300000000000001,"15min":0.504},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":1.075,"15min":1.075},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75,"5min":1.149,"15min":1.149},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.75,"5min":1.048,"15min":1.048},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.40600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.68300000000000005,"5min":1.175,"15min":1.175},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.44500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71699999999999997,"5min":1.03,"15min":1.03},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.30399999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63800000000000001,"5min":0.873,"15min":0.873},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.57699999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.45900000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68600000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67700000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53700000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69899999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69999999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.56000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297912,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073928,"statfs":{"total":96636764160,"available":96331702272,"internally_reserved":0,"allocated":638976,"data_stored":298186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.82299999999999995,"15min":0.86699999999999999},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.83599999999999997,"15min":0.88200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":0.433}]},{"osd":1,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68300000000000005,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.371,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":1.002,"15min":1.0780000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69599999999999995,"5min":8.8659999999999997,"15min":8.8659999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69999999999999996,"5min":0.754,"15min":0.754},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":1.1100000000000001,"15min":1.198},"min":{"1min":0.48499999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.75,"5min":10.659000000000001,"15min":10.659000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73199999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.30199999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67000000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.377,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72399999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76800000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.754}]},{"osd":7,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60199999999999998},"min":{"1min":0.41199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.80500000000000005,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.80100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298496,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073344,"statfs":{"total":96636764160,"available":96331104256,"internally_reserved":0,"allocated":1236992,"data_stored":888644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34100000000000003},"min":{"1min":0.23300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35099999999999998,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.28100000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.315},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.317},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.376,"15min":0.374},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.60699999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.34000000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.373,"15min":0.36699999999999999},"min":{"1min":0.27600000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.29499999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.33400000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.745,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54200000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61699999999999999,"15min":0.61099999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.52600000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.45600000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.46300000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.60899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.503}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":301229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.30499999999999999,"15min":0.29599999999999999},"min":{"1min":0.224,"5min":0.216,"15min":0.216},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.27400000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.29699999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.371,"15min":0.36099999999999999},"min":{"1min":0.28699999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.318},"min":{"1min":0.25,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.316}]},{"osd":3,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.30099999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.376},{"interface":"front","average":{"1min":0.439,"5min":0.40699999999999997,"15min":0.40100000000000002},"min":{"1min":0.313,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.621,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.60199999999999998},"min":{"1min":0.435,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82199999999999995,"5min":1.369,"15min":1.369},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.55700000000000005,"15min":0.54100000000000004},"min":{"1min":0.42799999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.42699999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.53000000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82899999999999996,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.436},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79700000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86299999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60199999999999998,"15min":0.58799999999999997},"min":{"1min":0.46700000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.496}]},{"osd":7,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":1.083,"15min":1.153},"min":{"1min":0.47799999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.87,"5min":11.138,"15min":11.138},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63,"15min":0.621},"min":{"1min":0.52400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88800000000000001,"5min":1.429,"15min":1.429},"last":0.41599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297920,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":647168,"data_stored":298242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.376,"15min":0.37},"min":{"1min":0.25700000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.246},{"interface":"front","average":{"1min":0.439,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.27200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.38600000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.40300000000000002,"15min":0.379},"min":{"1min":0.24299999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.41999999999999998,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.38100000000000001,"15min":0.36799999999999999},"min":{"1min":0.27500000000000002,"5min":0.252,"15min":0.252},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.42499999999999999,"15min":0.41599999999999998},"min":{"1min":0.312,"5min":0.311,"15min":0.311},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.48099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.44600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.437},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.626,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.46200000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.63400000000000001,"15min":0.624},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.47599999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.57399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":299195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51700000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.371},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.52200000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.38900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36899999999999999,"15min":0.36699999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.60399999999999998,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.42499999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40200000000000002,"15min":0.40500000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.58799999999999997,"5min":0.624,"15min":0.624},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53900000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.44}]},{"osd":4,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76300000000000001,"5min":0.875,"15min":0.875},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77200000000000002,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61499999999999999,"15min":0.621},"min":{"1min":0.40500000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.748,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.48199999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78700000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.52300000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.439,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78600000000000003,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.627,"15min":0.63},"min":{"1min":0.442,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77300000000000002,"5min":1.391,"15min":1.391},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82199999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60199999999999998,"15min":0.59699999999999998},"min":{"1min":0.495,"5min":0.439,"15min":0.439},"max":{"1min":0.79500000000000004,"5min":0.874,"15min":0.874},"last":0.60599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":300675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.42699999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83599999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":1.1930000000000001,"15min":1.2929999999999999},"min":{"1min":0.42799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77400000000000002,"5min":17.879999999999999,"15min":17.879999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":1.171,"15min":1.272},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84699999999999998,"5min":18.010999999999999,"15min":18.010999999999999},"last":0.46300000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78500000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54400000000000004,"15min":0.53400000000000003},"min":{"1min":0.437,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.63}]},{"osd":5,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.51000000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.495},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40699999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80300000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52700000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.75,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.627,"15min":0.629},"min":{"1min":0.42199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.44}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":299763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":0.71899999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68400000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.36299999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.54300000000000004,"15min":0.53600000000000003},"min":{"1min":0.38400000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52300000000000002,"15min":0.51500000000000001},"min":{"1min":0.441,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64800000000000002,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.42899999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.53100000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.66200000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.51800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.378,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68000000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.443},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.33900000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.45700000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70399999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71299999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.52200000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72699999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.41999999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74099999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.59499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:20:20.157 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:20:20.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:20:20.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.306+0000 7f85d1666700 1 Processor -- start 2023-10-06T02:20:20.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.306+0000 7f85d1666700 1 -- start start 2023-10-06T02:20:20.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85d1666700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85cc0d04e0 0x7f85cc15dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:20.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85d1666700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f85cc0d08b0 0x7f85cc0ce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:20.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85d1666700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f85cc142890 0x7f85cc142d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:20.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85d1666700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85cc0cf250 con 0x7f85cc0d08b0 2023-10-06T02:20:20.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85d1666700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85cc0cf530 con 0x7f85cc142890 2023-10-06T02:20:20.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85d1666700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc0cf810 con 0x7f85cc0d04e0 2023-10-06T02:20:20.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85ca7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f85cc0d08b0 0x7f85cc0ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:20.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85ca7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f85cc0d08b0 0x7f85cc0ce900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59900/0 (socket says 172.21.15.6:59900) 2023-10-06T02:20:20.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85ca7fc700 1 -- 172.21.15.6:0/221315351 learned_addr learned my addr 172.21.15.6:0/221315351 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:20.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85caffd700 1 --2- 172.21.15.6:0/221315351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85cc0d04e0 0x7f85cc15dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:20.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85cb7fe700 1 --2- 172.21.15.6:0/221315351 >> v2:172.21.15.175:3300/0 conn(0x7f85cc142890 0x7f85cc142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:20.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85ca7fc700 1 -- 172.21.15.6:0/221315351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85cc0d04e0 msgr2=0x7f85cc15dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:20.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85ca7fc700 1 --2- 172.21.15.6:0/221315351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85cc0d04e0 0x7f85cc15dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85ca7fc700 1 -- 172.21.15.6:0/221315351 >> v2:172.21.15.175:3300/0 conn(0x7f85cc142890 msgr2=0x7f85cc142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:20.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85ca7fc700 1 --2- 172.21.15.6:0/221315351 >> v2:172.21.15.175:3300/0 conn(0x7f85cc142890 0x7f85cc142d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85ca7fc700 1 -- 172.21.15.6:0/221315351 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc0cfaf0 con 0x7f85cc0d08b0 2023-10-06T02:20:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85caffd700 1 --2- 172.21.15.6:0/221315351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85cc0d04e0 0x7f85cc15dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85cb7fe700 1 --2- 172.21.15.6:0/221315351 >> v2:172.21.15.175:3300/0 conn(0x7f85cc142890 0x7f85cc142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85ca7fc700 1 --2- 172.21.15.6:0/221315351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85cc0d08b0 0x7f85cc0ce900 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0d0f90 tx=0x7f85b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20de1d07290f9e09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85c9ffb700 1 -- 172.21.15.6:0/221315351 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b400b860 con 0x7f85cc0d08b0 2023-10-06T02:20:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85c9ffb700 1 -- 172.21.15.6:0/221315351 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b400b9c0 con 0x7f85cc0d08b0 2023-10-06T02:20:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.307+0000 7f85c9ffb700 1 -- 172.21.15.6:0/221315351 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b400bd60 con 0x7f85cc0d08b0 2023-10-06T02:20:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.308+0000 7f85d1666700 1 -- 172.21.15.6:0/221315351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85cc0d08b0 msgr2=0x7f85cc0ce900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.308+0000 7f85d1666700 1 --2- 172.21.15.6:0/221315351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85cc0d08b0 0x7f85cc0ce900 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0d0f90 tx=0x7f85b4009250 comp rx=0 tx=0).stop 2023-10-06T02:20:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.308+0000 7f85d1666700 1 -- 172.21.15.6:0/221315351 shutdown_connections 2023-10-06T02:20:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.308+0000 7f85d1666700 1 --2- 172.21.15.6:0/221315351 >> v2:172.21.15.175:3300/0 conn(0x7f85cc142890 0x7f85cc142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.308+0000 7f85d1666700 1 --2- 172.21.15.6:0/221315351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85cc0d04e0 0x7f85cc15dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.308+0000 7f85d1666700 1 --2- 172.21.15.6:0/221315351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85cc0d08b0 0x7f85cc0ce900 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.308+0000 7f85d1666700 1 -- 172.21.15.6:0/221315351 >> 172.21.15.6:0/221315351 conn(0x7f85cc06a320 msgr2=0x7f85cc06a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.308+0000 7f85d1666700 1 -- 172.21.15.6:0/221315351 shutdown_connections 2023-10-06T02:20:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.308+0000 7f85d1666700 1 -- 172.21.15.6:0/221315351 wait complete. 2023-10-06T02:20:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.309+0000 7f85d1666700 1 Processor -- start 2023-10-06T02:20:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.309+0000 7f85d1666700 1 -- start start 2023-10-06T02:20:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.310+0000 7f85d1666700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85cc0d04e0 0x7f85cc16a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.310+0000 7f85d1666700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85cc0d08b0 0x7f85cc0af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.310+0000 7f85d1666700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85cc142890 0x7f85cc0af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.310+0000 7f85d1666700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc137590 con 0x7f85cc142890 2023-10-06T02:20:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.310+0000 7f85d1666700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc169dc0 con 0x7f85cc0d08b0 2023-10-06T02:20:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.310+0000 7f85d1666700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc16aa10 con 0x7f85cc0d04e0 2023-10-06T02:20:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.310+0000 7f85cb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85cc142890 0x7f85cc0af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.310+0000 7f85cb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85cc142890 0x7f85cc0af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59906/0 (socket says 172.21.15.6:59906) 2023-10-06T02:20:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.310+0000 7f85cb7fe700 1 -- 172.21.15.6:0/641268621 learned_addr learned my addr 172.21.15.6:0/641268621 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.310+0000 7f85caffd700 1 --2- 172.21.15.6:0/641268621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85cc0d04e0 0x7f85cc16a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.310+0000 7f85ca7fc700 1 --2- 172.21.15.6:0/641268621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85cc0d08b0 0x7f85cc0af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:20.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.311+0000 7f85cb7fe700 1 -- 172.21.15.6:0/641268621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85cc0d04e0 msgr2=0x7f85cc16a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:20.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.311+0000 7f85cb7fe700 1 --2- 172.21.15.6:0/641268621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85cc0d04e0 0x7f85cc16a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.311+0000 7f85cb7fe700 1 -- 172.21.15.6:0/641268621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85cc0d08b0 msgr2=0x7f85cc0af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:20.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.311+0000 7f85cb7fe700 1 --2- 172.21.15.6:0/641268621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85cc0d08b0 0x7f85cc0af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.311+0000 7f85cb7fe700 1 -- 172.21.15.6:0/641268621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b40094f0 con 0x7f85cc142890 2023-10-06T02:20:20.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.311+0000 7f85ca7fc700 1 --2- 172.21.15.6:0/641268621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85cc0d08b0 0x7f85cc0af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:20.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.311+0000 7f85cb7fe700 1 --2- 172.21.15.6:0/641268621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85cc142890 0x7f85cc0af710 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00c850 tx=0x7f85bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:20.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.311+0000 7f85c2ffd700 1 -- 172.21.15.6:0/641268621 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc011600 con 0x7f85cc142890 2023-10-06T02:20:20.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.311+0000 7f85c2ffd700 1 -- 172.21.15.6:0/641268621 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc011760 con 0x7f85cc142890 2023-10-06T02:20:20.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.311+0000 7f85d1666700 1 -- 172.21.15.6:0/641268621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85cc138ca0 con 0x7f85cc142890 2023-10-06T02:20:20.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.311+0000 7f85c2ffd700 1 -- 172.21.15.6:0/641268621 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc011b00 con 0x7f85cc142890 2023-10-06T02:20:20.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.311+0000 7f85d1666700 1 -- 172.21.15.6:0/641268621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85cc0b2210 con 0x7f85cc142890 2023-10-06T02:20:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.312+0000 7f85d1666700 1 -- 172.21.15.6:0/641268621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85cc138e30 con 0x7f85cc142890 2023-10-06T02:20:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.312+0000 7f85c2ffd700 1 -- 172.21.15.6:0/641268621 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85bc018350 con 0x7f85cc142890 2023-10-06T02:20:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.313+0000 7f85c2ffd700 1 --2- 172.21.15.6:0/641268621 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f85ac066f30 0x7f85ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.313+0000 7f85c2ffd700 1 -- 172.21.15.6:0/641268621 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f85bc084620 con 0x7f85cc142890 2023-10-06T02:20:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.313+0000 7f85caffd700 1 --2- 172.21.15.6:0/641268621 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f85ac066f30 0x7f85ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.313+0000 7f85caffd700 1 --2- 172.21.15.6:0/641268621 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f85ac066f30 0x7f85ac0693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f85c4007fd0 tx=0x7f85c40077c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:20.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.317+0000 7f85c2ffd700 1 -- 172.21.15.6:0/641268621 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85bc055080 con 0x7f85cc142890 2023-10-06T02:20:20.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.589+0000 7f85d1666700 1 -- 172.21.15.6:0/641268621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f85cc0cfdd0 con 0x7f85cc142890 2023-10-06T02:20:20.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.593+0000 7f85c2ffd700 1 -- 172.21.15.6:0/641268621 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f85bc054c10 con 0x7f85cc142890 2023-10-06T02:20:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.595+0000 7f85d1666700 1 -- 172.21.15.6:0/641268621 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f85ac066f30 msgr2=0x7f85ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.595+0000 7f85d1666700 1 --2- 172.21.15.6:0/641268621 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f85ac066f30 0x7f85ac0693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f85c4007fd0 tx=0x7f85c40077c0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.595+0000 7f85d1666700 1 -- 172.21.15.6:0/641268621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85cc142890 msgr2=0x7f85cc0af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.595+0000 7f85d1666700 1 --2- 172.21.15.6:0/641268621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85cc142890 0x7f85cc0af710 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00c850 tx=0x7f85bc008040 comp rx=0 tx=0).stop 2023-10-06T02:20:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.595+0000 7f85d1666700 1 -- 172.21.15.6:0/641268621 shutdown_connections 2023-10-06T02:20:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.595+0000 7f85d1666700 1 --2- 172.21.15.6:0/641268621 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f85ac066f30 0x7f85ac0693e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.595+0000 7f85d1666700 1 --2- 172.21.15.6:0/641268621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85cc142890 0x7f85cc0af710 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.595+0000 7f85d1666700 1 --2- 172.21.15.6:0/641268621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85cc0d04e0 0x7f85cc16a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.595+0000 7f85d1666700 1 --2- 172.21.15.6:0/641268621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85cc0d08b0 0x7f85cc0af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.595+0000 7f85d1666700 1 -- 172.21.15.6:0/641268621 >> 172.21.15.6:0/641268621 conn(0x7f85cc06a320 msgr2=0x7f85cc140730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:20.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.595+0000 7f85d1666700 1 -- 172.21.15.6:0/641268621 shutdown_connections 2023-10-06T02:20:20.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.595+0000 7f85d1666700 1 -- 172.21.15.6:0/641268621 wait complete. 2023-10-06T02:20:20.598 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-10-06T02:20:20.608 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:20:20.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.726+0000 7f6dd10f9700 1 Processor -- start 2023-10-06T02:20:20.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.726+0000 7f6dd10f9700 1 -- start start 2023-10-06T02:20:20.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.727+0000 7f6dd10f9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6dcc15ca10 0x7f6dcc069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:20.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.727+0000 7f6dd10f9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dcc0b1ed0 con 0x7f6dcc067d10 2023-10-06T02:20:20.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.727+0000 7f6dd10f9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dcc0879c0 con 0x7f6dcc15cde0 2023-10-06T02:20:20.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.727+0000 7f6dd10f9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dcc0cec50 con 0x7f6dcc15ca10 2023-10-06T02:20:20.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.727+0000 7f6dcad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6dcc15ca10 0x7f6dcc069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:20.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.727+0000 7f6dca59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6dcc067d10 0x7f6dcc06a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54914/0 (socket says 172.21.15.6:54914) 2023-10-06T02:20:20.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.728+0000 7f6dca59c700 1 -- 172.21.15.6:0/1548422301 learned_addr learned my addr 172.21.15.6:0/1548422301 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:20.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.728+0000 7f6dc9d9b700 1 -- 172.21.15.6:0/1548422301 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281181794 0 0) 0x7f6dcc0b1ed0 con 0x7f6dcc067d10 2023-10-06T02:20:20.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.728+0000 7f6dcad9d700 1 -- 172.21.15.6:0/1548422301 >> v1:172.21.15.175:6789/0 conn(0x7f6dcc15cde0 legacy=0x7f6dcc0b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:20.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.728+0000 7f6dcad9d700 1 -- 172.21.15.6:0/1548422301 >> v1:172.21.15.6:6789/0 conn(0x7f6dcc067d10 legacy=0x7f6dcc06a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:20.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.728+0000 7f6dcad9d700 1 -- 172.21.15.6:0/1548422301 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc0cef30 con 0x7f6dcc15ca10 2023-10-06T02:20:20.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.728+0000 7f6dcad9d700 1 --2- 172.21.15.6:0/1548422301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dcc15ca10 0x7f6dcc069f70 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0098d0 tx=0x7f6dbc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ff98b6af09e159 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:20.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.728+0000 7f6dc9d9b700 1 -- 172.21.15.6:0/1548422301 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc009e70 con 0x7f6dcc15ca10 2023-10-06T02:20:20.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.728+0000 7f6dc9d9b700 1 -- 172.21.15.6:0/1548422301 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc005c10 con 0x7f6dcc15ca10 2023-10-06T02:20:20.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.728+0000 7f6dc9d9b700 1 -- 172.21.15.6:0/1548422301 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00b610 con 0x7f6dcc15ca10 2023-10-06T02:20:20.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.729+0000 7f6dd10f9700 1 -- 172.21.15.6:0/1548422301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dcc15ca10 msgr2=0x7f6dcc069f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:20.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.729+0000 7f6dd10f9700 1 --2- 172.21.15.6:0/1548422301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dcc15ca10 0x7f6dcc069f70 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0098d0 tx=0x7f6dbc009120 comp rx=0 tx=0).stop 2023-10-06T02:20:20.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.729+0000 7f6dd10f9700 1 -- 172.21.15.6:0/1548422301 shutdown_connections 2023-10-06T02:20:20.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.729+0000 7f6dd10f9700 1 --2- 172.21.15.6:0/1548422301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dcc15ca10 0x7f6dcc069f70 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.729+0000 7f6dd10f9700 1 -- 172.21.15.6:0/1548422301 >> 172.21.15.6:0/1548422301 conn(0x7f6dcc067910 msgr2=0x7f6dcc0ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:20.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.729+0000 7f6dd10f9700 1 -- 172.21.15.6:0/1548422301 shutdown_connections 2023-10-06T02:20:20.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.729+0000 7f6dd10f9700 1 -- 172.21.15.6:0/1548422301 wait complete. 2023-10-06T02:20:20.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.730+0000 7f6dd10f9700 1 Processor -- start 2023-10-06T02:20:20.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.730+0000 7f6dd10f9700 1 -- start start 2023-10-06T02:20:20.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dd10f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dcc067d10 0x7f6dcc09b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:20.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dd10f9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dcc15ca10 0x7f6dcc0cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:20.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dd10f9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dcc15cde0 0x7f6dcc14a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:20.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dd10f9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc09bb90 con 0x7f6dcc067d10 2023-10-06T02:20:20.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dd10f9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc158280 con 0x7f6dcc15ca10 2023-10-06T02:20:20.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dd10f9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc14a1b0 con 0x7f6dcc15cde0 2023-10-06T02:20:20.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dcad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dcc067d10 0x7f6dcc09b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:20.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dcad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dcc067d10 0x7f6dcc09b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59916/0 (socket says 172.21.15.6:59916) 2023-10-06T02:20:20.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dcad9d700 1 -- 172.21.15.6:0/755575950 learned_addr learned my addr 172.21.15.6:0/755575950 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:20.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dcb59e700 1 --2- 172.21.15.6:0/755575950 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dcc15cde0 0x7f6dcc14a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:20.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dca59c700 1 --2- 172.21.15.6:0/755575950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dcc15ca10 0x7f6dcc0cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:20.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dcad9d700 1 -- 172.21.15.6:0/755575950 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dcc15cde0 msgr2=0x7f6dcc14a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:20.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dcad9d700 1 --2- 172.21.15.6:0/755575950 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dcc15cde0 0x7f6dcc14a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dcad9d700 1 -- 172.21.15.6:0/755575950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dcc15ca10 msgr2=0x7f6dcc0cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:20.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dcad9d700 1 --2- 172.21.15.6:0/755575950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dcc15ca10 0x7f6dcc0cd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dcad9d700 1 -- 172.21.15.6:0/755575950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc0093c0 con 0x7f6dcc067d10 2023-10-06T02:20:20.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dcb59e700 1 --2- 172.21.15.6:0/755575950 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dcc15cde0 0x7f6dcc14a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:20.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dca59c700 1 --2- 172.21.15.6:0/755575950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dcc15ca10 0x7f6dcc0cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:20.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.731+0000 7f6dcad9d700 1 --2- 172.21.15.6:0/755575950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dcc067d10 0x7f6dcc09b650 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009390 tx=0x7f6dbc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:20.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.732+0000 7f6dc2ffd700 1 -- 172.21.15.6:0/755575950 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc0066c0 con 0x7f6dcc067d10 2023-10-06T02:20:20.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.732+0000 7f6dc2ffd700 1 -- 172.21.15.6:0/755575950 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc006820 con 0x7f6dcc067d10 2023-10-06T02:20:20.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.732+0000 7f6dd10f9700 1 -- 172.21.15.6:0/755575950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dcc09bd80 con 0x7f6dcc067d10 2023-10-06T02:20:20.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.732+0000 7f6dc2ffd700 1 -- 172.21.15.6:0/755575950 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc026680 con 0x7f6dcc067d10 2023-10-06T02:20:20.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.732+0000 7f6dd10f9700 1 -- 172.21.15.6:0/755575950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dcc149b60 con 0x7f6dcc067d10 2023-10-06T02:20:20.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.733+0000 7f6dd10f9700 1 -- 172.21.15.6:0/755575950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dcc14a490 con 0x7f6dcc067d10 2023-10-06T02:20:20.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.733+0000 7f6dc2ffd700 1 -- 172.21.15.6:0/755575950 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6dbc023070 con 0x7f6dcc067d10 2023-10-06T02:20:20.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.733+0000 7f6dc2ffd700 1 --2- 172.21.15.6:0/755575950 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6dac066f30 0x7f6dac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:20.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.733+0000 7f6dc2ffd700 1 -- 172.21.15.6:0/755575950 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6dbc086da0 con 0x7f6dcc067d10 2023-10-06T02:20:20.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.733+0000 7f6dca59c700 1 --2- 172.21.15.6:0/755575950 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6dac066f30 0x7f6dac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:20.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.734+0000 7f6dca59c700 1 --2- 172.21.15.6:0/755575950 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6dac066f30 0x7f6dac0693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc064d40 tx=0x7f6db4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:20.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.738+0000 7f6dc2ffd700 1 -- 172.21.15.6:0/755575950 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6dbc053d70 con 0x7f6dcc067d10 2023-10-06T02:20:20.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.978+0000 7f6dd10f9700 1 -- 172.21.15.6:0/755575950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6dcc06e8d0 con 0x7f6dcc067d10 2023-10-06T02:20:20.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.978+0000 7f6dc2ffd700 1 -- 172.21.15.6:0/755575950 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f6dbc057390 con 0x7f6dcc067d10 2023-10-06T02:20:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:20.979 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":33,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2589522502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2589522502},{"type":"v1","addr":"172.21.15.175:6837","nonce":2589522502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3703329287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3703329287},{"type":"v1","addr":"172.21.15.175:6836","nonce":3703329287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/843207095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":843207095},{"type":"v1","addr":"172.21.15.6:6834","nonce":843207095}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:10.479851+0000","modified":"2023-10-06T02:20:14.110882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1800326966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1800326966},{"type":"v1","addr":"172.21.15.6:6835","nonce":1800326966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:20:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.980+0000 7f6dd10f9700 1 -- 172.21.15.6:0/755575950 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6dac066f30 msgr2=0x7f6dac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.980+0000 7f6dd10f9700 1 --2- 172.21.15.6:0/755575950 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6dac066f30 0x7f6dac0693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc064d40 tx=0x7f6db4009040 comp rx=0 tx=0).stop 2023-10-06T02:20:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.980+0000 7f6dd10f9700 1 -- 172.21.15.6:0/755575950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dcc067d10 msgr2=0x7f6dcc09b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.980+0000 7f6dd10f9700 1 --2- 172.21.15.6:0/755575950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dcc067d10 0x7f6dcc09b650 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009390 tx=0x7f6dbc015000 comp rx=0 tx=0).stop 2023-10-06T02:20:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.980+0000 7f6dd10f9700 1 -- 172.21.15.6:0/755575950 shutdown_connections 2023-10-06T02:20:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.980+0000 7f6dd10f9700 1 --2- 172.21.15.6:0/755575950 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dcc15cde0 0x7f6dcc14a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.980+0000 7f6dd10f9700 1 --2- 172.21.15.6:0/755575950 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6dac066f30 0x7f6dac0693e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.980+0000 7f6dd10f9700 1 --2- 172.21.15.6:0/755575950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dcc067d10 0x7f6dcc09b650 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.980+0000 7f6dd10f9700 1 --2- 172.21.15.6:0/755575950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dcc15ca10 0x7f6dcc0cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.980+0000 7f6dd10f9700 1 -- 172.21.15.6:0/755575950 >> 172.21.15.6:0/755575950 conn(0x7f6dcc067910 msgr2=0x7f6dcc06dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.980+0000 7f6dd10f9700 1 -- 172.21.15.6:0/755575950 shutdown_connections 2023-10-06T02:20:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:20.980+0000 7f6dd10f9700 1 -- 172.21.15.6:0/755575950 wait complete. 2023-10-06T02:20:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 33 2023-10-06T02:20:21.395 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:20:10.479851+0000', 'modified': '2023-10-06T02:20:14.110882+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5736}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5736': {'gid': 5736, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/1800326966', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 1800326966}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 1800326966}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:20:21.395 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:20:21.395 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:20:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.519+0000 7fdc991f1700 1 Processor -- start 2023-10-06T02:20:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.519+0000 7fdc991f1700 1 -- start start 2023-10-06T02:20:21.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc991f1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9415a030 0x7fdc9415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc991f1700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdc9415a940 0x7fdc94086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc991f1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc94087530 0x7fdc940b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc991f1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc940b0cf0 con 0x7fdc94087530 2023-10-06T02:20:21.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc991f1700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc94087960 con 0x7fdc9415a940 2023-10-06T02:20:21.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc991f1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940afc50 con 0x7fdc9415a030 2023-10-06T02:20:21.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc9359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc94087530 0x7fdc940b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc9359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc94087530 0x7fdc940b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59932/0 (socket says 172.21.15.6:59932) 2023-10-06T02:20:21.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc9359e700 1 -- 172.21.15.6:0/2490377412 learned_addr learned my addr 172.21.15.6:0/2490377412 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:21.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc92d9d700 1 --2- 172.21.15.6:0/2490377412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9415a030 0x7fdc9415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc9259c700 1 --2- 172.21.15.6:0/2490377412 >> v2:172.21.15.175:3300/0 conn(0x7fdc9415a940 0x7fdc94086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc9359e700 1 -- 172.21.15.6:0/2490377412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9415a030 msgr2=0x7fdc9415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:21.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc9359e700 1 --2- 172.21.15.6:0/2490377412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9415a030 0x7fdc9415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc9359e700 1 -- 172.21.15.6:0/2490377412 >> v2:172.21.15.175:3300/0 conn(0x7fdc9415a940 msgr2=0x7fdc94086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:21.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc9359e700 1 --2- 172.21.15.6:0/2490377412 >> v2:172.21.15.175:3300/0 conn(0x7fdc9415a940 0x7fdc94086ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc9359e700 1 -- 172.21.15.6:0/2490377412 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc940aff30 con 0x7fdc94087530 2023-10-06T02:20:21.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc92d9d700 1 --2- 172.21.15.6:0/2490377412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9415a030 0x7fdc9415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:21.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.520+0000 7fdc9359e700 1 --2- 172.21.15.6:0/2490377412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc94087530 0x7fdc940b21b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fdc94089180 tx=0x7fdc8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af72959959af8c07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:21.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.521+0000 7fdc91d9b700 1 -- 172.21.15.6:0/2490377412 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00b860 con 0x7fdc94087530 2023-10-06T02:20:21.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.521+0000 7fdc91d9b700 1 -- 172.21.15.6:0/2490377412 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c00b9c0 con 0x7fdc94087530 2023-10-06T02:20:21.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.521+0000 7fdc91d9b700 1 -- 172.21.15.6:0/2490377412 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00bd60 con 0x7fdc94087530 2023-10-06T02:20:21.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.521+0000 7fdc991f1700 1 -- 172.21.15.6:0/2490377412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc94087530 msgr2=0x7fdc940b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:21.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.521+0000 7fdc991f1700 1 --2- 172.21.15.6:0/2490377412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc94087530 0x7fdc940b21b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fdc94089180 tx=0x7fdc8c009250 comp rx=0 tx=0).stop 2023-10-06T02:20:21.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.521+0000 7fdc991f1700 1 -- 172.21.15.6:0/2490377412 shutdown_connections 2023-10-06T02:20:21.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.521+0000 7fdc991f1700 1 --2- 172.21.15.6:0/2490377412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc94087530 0x7fdc940b21b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.521+0000 7fdc991f1700 1 --2- 172.21.15.6:0/2490377412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9415a030 0x7fdc9415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.521+0000 7fdc991f1700 1 --2- 172.21.15.6:0/2490377412 >> v2:172.21.15.175:3300/0 conn(0x7fdc9415a940 0x7fdc94086ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.521+0000 7fdc991f1700 1 -- 172.21.15.6:0/2490377412 >> 172.21.15.6:0/2490377412 conn(0x7fdc94068680 msgr2=0x7fdc94068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:21.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.521+0000 7fdc991f1700 1 -- 172.21.15.6:0/2490377412 shutdown_connections 2023-10-06T02:20:21.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.521+0000 7fdc991f1700 1 -- 172.21.15.6:0/2490377412 wait complete. 2023-10-06T02:20:21.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.522+0000 7fdc991f1700 1 Processor -- start 2023-10-06T02:20:21.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.523+0000 7fdc991f1700 1 -- start start 2023-10-06T02:20:21.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.523+0000 7fdc991f1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc94087530 0x7fdc9414a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.523+0000 7fdc991f1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9415a030 0x7fdc940c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.523+0000 7fdc991f1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9415a940 0x7fdc940b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.523+0000 7fdc991f1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9415b170 con 0x7fdc9415a030 2023-10-06T02:20:21.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.523+0000 7fdc991f1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940c5da0 con 0x7fdc94087530 2023-10-06T02:20:21.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.523+0000 7fdc991f1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940c6080 con 0x7fdc9415a940 2023-10-06T02:20:21.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.523+0000 7fdc9259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9415a030 0x7fdc940c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.523+0000 7fdc9259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9415a030 0x7fdc940c5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59942/0 (socket says 172.21.15.6:59942) 2023-10-06T02:20:21.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.523+0000 7fdc9259c700 1 -- 172.21.15.6:0/3252744186 learned_addr learned my addr 172.21.15.6:0/3252744186 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:21.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.524+0000 7fdc9359e700 1 --2- 172.21.15.6:0/3252744186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9415a940 0x7fdc940b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.524+0000 7fdc92d9d700 1 --2- 172.21.15.6:0/3252744186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc94087530 0x7fdc9414a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.524+0000 7fdc9259c700 1 -- 172.21.15.6:0/3252744186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9415a940 msgr2=0x7fdc940b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.524+0000 7fdc9259c700 1 --2- 172.21.15.6:0/3252744186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9415a940 0x7fdc940b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.524+0000 7fdc9259c700 1 -- 172.21.15.6:0/3252744186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc94087530 msgr2=0x7fdc9414a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.524+0000 7fdc9259c700 1 --2- 172.21.15.6:0/3252744186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc94087530 0x7fdc9414a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.524+0000 7fdc9259c700 1 -- 172.21.15.6:0/3252744186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c0094f0 con 0x7fdc9415a030 2023-10-06T02:20:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.524+0000 7fdc9359e700 1 --2- 172.21.15.6:0/3252744186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9415a940 0x7fdc940b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.524+0000 7fdc9259c700 1 --2- 172.21.15.6:0/3252744186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9415a030 0x7fdc940c5320 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c00c880 tx=0x7fdc7c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.524+0000 7fdc8affd700 1 -- 172.21.15.6:0/3252744186 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c011600 con 0x7fdc9415a030 2023-10-06T02:20:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.524+0000 7fdc8affd700 1 -- 172.21.15.6:0/3252744186 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7c011760 con 0x7fdc9415a030 2023-10-06T02:20:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.524+0000 7fdc8affd700 1 -- 172.21.15.6:0/3252744186 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c011b00 con 0x7fdc9415a030 2023-10-06T02:20:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.524+0000 7fdc991f1700 1 -- 172.21.15.6:0/3252744186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9415ae00 con 0x7fdc9415a030 2023-10-06T02:20:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.524+0000 7fdc991f1700 1 -- 172.21.15.6:0/3252744186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc94155d70 con 0x7fdc9415a030 2023-10-06T02:20:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.526+0000 7fdc8affd700 1 -- 172.21.15.6:0/3252744186 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc7c0223a0 con 0x7fdc9415a030 2023-10-06T02:20:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.526+0000 7fdc8affd700 1 --2- 172.21.15.6:0/3252744186 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc74066f30 0x7fdc740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.526+0000 7fdc8affd700 1 -- 172.21.15.6:0/3252744186 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdc7c084880 con 0x7fdc9415a030 2023-10-06T02:20:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.526+0000 7fdc92d9d700 1 --2- 172.21.15.6:0/3252744186 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc74066f30 0x7fdc740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.527+0000 7fdc92d9d700 1 --2- 172.21.15.6:0/3252744186 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc74066f30 0x7fdc740693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400d560 tx=0x7fdc840075a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:21.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.528+0000 7fdca24e9b80 1 Processor -- start 2023-10-06T02:20:21.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.528+0000 7fdca24e9b80 1 -- start start 2023-10-06T02:20:21.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.529+0000 7fdca24e9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0db2840 0x5629d0db2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.529+0000 7fdca24e9b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0db3cc0 0x5629d0e026c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.529+0000 7fdca24e9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0e02c00 0x5629d0e03050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.529+0000 7fdca24e9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d0d09a70 con 0x5629d0e02c00 2023-10-06T02:20:21.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.529+0000 7fdca24e9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d0d07270 con 0x5629d0db2840 2023-10-06T02:20:21.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.529+0000 7fdca24e9b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629d0d03060 con 0x5629d0db3cc0 2023-10-06T02:20:21.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.529+0000 7fdc9359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0e02c00 0x5629d0e03050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.529+0000 7fdc9359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0e02c00 0x5629d0e03050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59948/0 (socket says 172.21.15.6:59948) 2023-10-06T02:20:21.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.529+0000 7fdc9359e700 1 -- 172.21.15.6:0/3307090961 learned_addr learned my addr 172.21.15.6:0/3307090961 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:21.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.529+0000 7fdc9259c700 1 --2- 172.21.15.6:0/3307090961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0db3cc0 0x5629d0e026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.529+0000 7fdc92d9d700 1 --2- 172.21.15.6:0/3307090961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0db2840 0x5629d0db2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.529+0000 7fdc9359e700 1 -- 172.21.15.6:0/3307090961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0db3cc0 msgr2=0x5629d0e026c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:21.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.529+0000 7fdc9359e700 1 --2- 172.21.15.6:0/3307090961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0db3cc0 0x5629d0e026c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.529+0000 7fdc9359e700 1 -- 172.21.15.6:0/3307090961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0db2840 msgr2=0x5629d0db2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:21.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.529+0000 7fdc9359e700 1 --2- 172.21.15.6:0/3307090961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0db2840 0x5629d0db2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.529+0000 7fdc9359e700 1 -- 172.21.15.6:0/3307090961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629d0b9d270 con 0x5629d0e02c00 2023-10-06T02:20:21.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.529+0000 7fdc9359e700 1 --2- 172.21.15.6:0/3307090961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0e02c00 0x5629d0e03050 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fdc940891b0 tx=0x7fdc8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47087804ddde4e42 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:21.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.530+0000 7fdc73fff700 1 -- 172.21.15.6:0/3307090961 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00bb30 con 0x5629d0e02c00 2023-10-06T02:20:21.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.530+0000 7fdc73fff700 1 -- 172.21.15.6:0/3307090961 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c00bc90 con 0x5629d0e02c00 2023-10-06T02:20:21.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.530+0000 7fdc73fff700 1 -- 172.21.15.6:0/3307090961 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c011630 con 0x5629d0e02c00 2023-10-06T02:20:21.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.530+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3307090961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0e02c00 msgr2=0x5629d0e03050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:21.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.530+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/3307090961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0e02c00 0x5629d0e03050 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fdc940891b0 tx=0x7fdc8c017000 comp rx=0 tx=0).stop 2023-10-06T02:20:21.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.530+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3307090961 shutdown_connections 2023-10-06T02:20:21.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.530+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/3307090961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0e02c00 0x5629d0e03050 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.530+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/3307090961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0db2840 0x5629d0db2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.530+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/3307090961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0db3cc0 0x5629d0e026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.530+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3307090961 >> 172.21.15.6:0/3307090961 conn(0x5629d0db4160 msgr2=0x5629d0db4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:21.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.530+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3307090961 shutdown_connections 2023-10-06T02:20:21.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.530+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3307090961 wait complete. 2023-10-06T02:20:21.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.531+0000 7fdca24e9b80 1 -- start start 2023-10-06T02:20:21.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.531+0000 7fdca24e9b80 1 Processor -- start 2023-10-06T02:20:21.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdca24e9b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0db2840 0x5629d0df2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdca24e9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0db3cc0 0x5629d0df3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdca24e9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0e02c00 0x5629d0df4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdca24e9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d0cae890 con 0x5629d0db3cc0 2023-10-06T02:20:21.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdca24e9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d0cc9ea0 con 0x5629d0e02c00 2023-10-06T02:20:21.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdca24e9b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629d0b85e30 con 0x5629d0db2840 2023-10-06T02:20:21.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdca24e9b80 10 client.0 _ll_register_callbacks cb 0x5629d0d75e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:20:21.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdc9259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0db3cc0 0x5629d0df3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdc9259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0db3cc0 0x5629d0df3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59954/0 (socket says 172.21.15.6:59954) 2023-10-06T02:20:21.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdc9259c700 1 -- 172.21.15.6:0/3823824923 learned_addr learned my addr 172.21.15.6:0/3823824923 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:21.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdc92d9d700 1 --2- 172.21.15.6:0/3823824923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0db2840 0x5629d0df2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdc9359e700 1 --2- 172.21.15.6:0/3823824923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0e02c00 0x5629d0df4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdc9259c700 1 -- 172.21.15.6:0/3823824923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0db2840 msgr2=0x5629d0df2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:21.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdc9259c700 1 --2- 172.21.15.6:0/3823824923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0db2840 0x5629d0df2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdc9259c700 1 -- 172.21.15.6:0/3823824923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0e02c00 msgr2=0x5629d0df4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:21.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdc9259c700 1 --2- 172.21.15.6:0/3823824923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0e02c00 0x5629d0df4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdc9259c700 1 -- 172.21.15.6:0/3823824923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc940aff30 con 0x5629d0db3cc0 2023-10-06T02:20:21.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.532+0000 7fdc9359e700 1 --2- 172.21.15.6:0/3823824923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0e02c00 0x5629d0df4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:21.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.533+0000 7fdc9259c700 1 --2- 172.21.15.6:0/3823824923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0db3cc0 0x5629d0df3040 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0519c0 tx=0x7fdc7c013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae2ac93e3d754aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:21.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.533+0000 7fdc717fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:20:21.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.533+0000 7fdc717fa700 1 -- 172.21.15.6:0/3823824923 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c054a00 con 0x5629d0db3cc0 2023-10-06T02:20:21.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.533+0000 7fdc717fa700 1 -- 172.21.15.6:0/3823824923 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdc7c054b60 con 0x5629d0db3cc0 2023-10-06T02:20:21.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.533+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3823824923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5629d0da7940 con 0x5629d0db3cc0 2023-10-06T02:20:21.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.533+0000 7fdc717fa700 1 -- 172.21.15.6:0/3823824923 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc7c05c230 con 0x5629d0db3cc0 2023-10-06T02:20:21.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.533+0000 7fdca24e9b80 10 client.5904 fetch_fsmap learned FSMap version 33 2023-10-06T02:20:21.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.533+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3823824923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x5629d0b3ffe0 con 0x5629d0db3cc0 2023-10-06T02:20:21.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.533+0000 7fdc717fa700 1 -- 172.21.15.6:0/3823824923 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5629d0da7940 con 0x5629d0db3cc0 2023-10-06T02:20:21.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.533+0000 7fdc717fa700 1 -- 172.21.15.6:0/3823824923 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdc7c06bb30 con 0x5629d0db3cc0 2023-10-06T02:20:21.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.533+0000 7fdca24e9b80 10 client.5904 fetch_fsmap finished waiting for FSMap version 33 2023-10-06T02:20:21.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.533+0000 7fdca24e9b80 10 client.5904 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:20:21.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.533+0000 7fdca24e9b80 20 client.5904 populate_metadata read hostname 'smithi006' 2023-10-06T02:20:21.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.533+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/3823824923 >> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] conn(0x5629d0df0ec0 0x5629d0df1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.533+0000 7fdca24e9b80 4 client.5904 mds_command: new command op to 5736 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:20:21.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.533+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3823824923 --> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5629d0d84870 con 0x5629d0df0ec0 2023-10-06T02:20:21.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.533+0000 7fdc92d9d700 1 --2- 172.21.15.6:0/3823824923 >> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] conn(0x5629d0df0ec0 0x5629d0df1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.534+0000 7fdc717fa700 10 client.5904 ms_handle_connect on v2:172.21.15.6:6833/1800326966 2023-10-06T02:20:21.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.534+0000 7fdc92d9d700 1 --2- 172.21.15.6:0/3823824923 >> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] conn(0x5629d0df0ec0 0x5629d0df1290 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c25e749a84fc1c06 server_cookie=2698bc5850882453 in_seq=0 out_seq=0 2023-10-06T02:20:21.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.534+0000 7fdc717fa700 1 -- 172.21.15.6:0/3823824923 <== mds.0 v2:172.21.15.6:6833/1800326966 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5629d0d84870 con 0x5629d0df0ec0 2023-10-06T02:20:21.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.534+0000 7fdc717fa700 10 client.5904 handle_command_reply: tid=0 2023-10-06T02:20:21.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.534+0000 7fdca24e9b80 1 client.5904 shutdown 2023-10-06T02:20:21.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.534+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3823824923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0db3cc0 msgr2=0x5629d0df3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:21.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.534+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/3823824923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0db3cc0 0x5629d0df3040 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0519c0 tx=0x7fdc7c013040 comp rx=0 tx=0).stop 2023-10-06T02:20:21.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.534+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3823824923 shutdown_connections 2023-10-06T02:20:21.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.534+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/3823824923 >> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] conn(0x5629d0df0ec0 0x5629d0df1290 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.534+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/3823824923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0e02c00 0x5629d0df4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.534+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/3823824923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0db2840 0x5629d0df2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.534+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/3823824923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0db3cc0 0x5629d0df3040 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.534+0000 7fdc717fa700 0 client.5904 ms_handle_reset on v2:172.21.15.6:6833/1800326966 2023-10-06T02:20:21.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.534+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3823824923 >> 172.21.15.6:0/3823824923 conn(0x5629d0db4160 msgr2=0x5629d0dada10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:21.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.535+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3823824923 shutdown_connections 2023-10-06T02:20:21.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.535+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3823824923 wait complete. 2023-10-06T02:20:21.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.535+0000 7fdca24e9b80 20 client.5904 trim_cache size 0 max 16384 2023-10-06T02:20:21.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.551+0000 7fdca24e9b80 1 Processor -- start 2023-10-06T02:20:21.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.552+0000 7fdca24e9b80 1 -- start start 2023-10-06T02:20:21.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.552+0000 7fdca24e9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0db2840 0x5629d0df87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.552+0000 7fdca24e9b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0db3cc0 0x5629d0dd7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.552+0000 7fdca24e9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0e02c00 0x5629d0dd7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.552+0000 7fdca24e9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d0dfcc20 con 0x5629d0e02c00 2023-10-06T02:20:21.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.552+0000 7fdca24e9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d0e0c000 con 0x5629d0db2840 2023-10-06T02:20:21.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.552+0000 7fdca24e9b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629d0dab400 con 0x5629d0db3cc0 2023-10-06T02:20:21.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.552+0000 7fdc9359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0e02c00 0x5629d0dd7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.552+0000 7fdc9359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0e02c00 0x5629d0dd7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59966/0 (socket says 172.21.15.6:59966) 2023-10-06T02:20:21.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.552+0000 7fdc9359e700 1 -- 172.21.15.6:0/3541532501 learned_addr learned my addr 172.21.15.6:0/3541532501 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:21.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.553+0000 7fdc9359e700 1 -- 172.21.15.6:0/3541532501 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0db3cc0 msgr2=0x5629d0dd7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:21.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.553+0000 7fdc9359e700 1 --2- 172.21.15.6:0/3541532501 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0db3cc0 0x5629d0dd7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.553+0000 7fdc9359e700 1 -- 172.21.15.6:0/3541532501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0db2840 msgr2=0x5629d0df87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:21.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.553+0000 7fdc92d9d700 1 --2- 172.21.15.6:0/3541532501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0db2840 0x5629d0df87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.553+0000 7fdc9359e700 1 --2- 172.21.15.6:0/3541532501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0db2840 0x5629d0df87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.553+0000 7fdc9359e700 1 -- 172.21.15.6:0/3541532501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629d0cd1780 con 0x5629d0e02c00 2023-10-06T02:20:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.553+0000 7fdc9359e700 1 --2- 172.21.15.6:0/3541532501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0e02c00 0x5629d0dd7e70 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c000c00 tx=0x7fdc8c01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a89c45d6b70f2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.553+0000 7fdc88ff9700 1 -- 172.21.15.6:0/3541532501 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c011630 con 0x5629d0e02c00 2023-10-06T02:20:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.553+0000 7fdc88ff9700 1 -- 172.21.15.6:0/3541532501 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c00b3f0 con 0x5629d0e02c00 2023-10-06T02:20:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.553+0000 7fdc88ff9700 1 -- 172.21.15.6:0/3541532501 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00be00 con 0x5629d0e02c00 2023-10-06T02:20:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.553+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3541532501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0e02c00 msgr2=0x5629d0dd7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.553+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/3541532501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0e02c00 0x5629d0dd7e70 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c000c00 tx=0x7fdc8c01e040 comp rx=0 tx=0).stop 2023-10-06T02:20:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.553+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3541532501 shutdown_connections 2023-10-06T02:20:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.553+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/3541532501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0e02c00 0x5629d0dd7e70 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.553+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/3541532501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0db2840 0x5629d0df87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.553+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/3541532501 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0db3cc0 0x5629d0dd7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.554+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3541532501 >> 172.21.15.6:0/3541532501 conn(0x5629d0db4160 msgr2=0x5629d0df3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.554+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3541532501 shutdown_connections 2023-10-06T02:20:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.554+0000 7fdca24e9b80 1 -- 172.21.15.6:0/3541532501 wait complete. 2023-10-06T02:20:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.554+0000 7fdca24e9b80 1 -- start start 2023-10-06T02:20:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.554+0000 7fdca24e9b80 1 Processor -- start 2023-10-06T02:20:21.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdca24e9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0db2840 0x5629d0e618b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdca24e9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0db3cc0 0x5629d0dae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdca24e9b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0e02c00 0x5629d0daea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdca24e9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d0e61df0 con 0x5629d0db3cc0 2023-10-06T02:20:21.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdca24e9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d0dd7670 con 0x5629d0db2840 2023-10-06T02:20:21.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdca24e9b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629d0e076c0 con 0x5629d0e02c00 2023-10-06T02:20:21.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdca24e9b80 10 client.0 _ll_register_callbacks cb 0x5629d0d75e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:20:21.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdc9259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0db3cc0 0x5629d0dae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdc9259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0db3cc0 0x5629d0dae510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59976/0 (socket says 172.21.15.6:59976) 2023-10-06T02:20:21.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdc9259c700 1 -- 172.21.15.6:0/2990589345 learned_addr learned my addr 172.21.15.6:0/2990589345 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:21.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdc92d9d700 1 --2- 172.21.15.6:0/2990589345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0db2840 0x5629d0e618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdc9359e700 1 --2- 172.21.15.6:0/2990589345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0e02c00 0x5629d0daea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdc9259c700 1 -- 172.21.15.6:0/2990589345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0e02c00 msgr2=0x5629d0daea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:21.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdc9259c700 1 --2- 172.21.15.6:0/2990589345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0e02c00 0x5629d0daea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdc9259c700 1 -- 172.21.15.6:0/2990589345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0db2840 msgr2=0x5629d0e618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:21.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdc9259c700 1 --2- 172.21.15.6:0/2990589345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0db2840 0x5629d0e618b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdc9259c700 1 -- 172.21.15.6:0/2990589345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629d0b9d270 con 0x5629d0db3cc0 2023-10-06T02:20:21.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.555+0000 7fdc9359e700 1 --2- 172.21.15.6:0/2990589345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0e02c00 0x5629d0daea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:21.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.556+0000 7fdc9259c700 1 --2- 172.21.15.6:0/2990589345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0db3cc0 0x5629d0dae510 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c055210 tx=0x7fdc7c068000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab1f5bcc8311cab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:21.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.556+0000 7fdc717fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:20:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.556+0000 7fdc717fa700 1 -- 172.21.15.6:0/2990589345 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c05c230 con 0x5629d0db3cc0 2023-10-06T02:20:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.556+0000 7fdc717fa700 1 -- 172.21.15.6:0/2990589345 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdc7c011cb0 con 0x5629d0db3cc0 2023-10-06T02:20:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.556+0000 7fdca24e9b80 1 -- 172.21.15.6:0/2990589345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc8c00bc90 con 0x5629d0db3cc0 2023-10-06T02:20:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.556+0000 7fdc717fa700 1 -- 172.21.15.6:0/2990589345 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc7c051300 con 0x5629d0db3cc0 2023-10-06T02:20:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.556+0000 7fdca24e9b80 10 client.5910 fetch_fsmap learned FSMap version 33 2023-10-06T02:20:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.556+0000 7fdca24e9b80 1 -- 172.21.15.6:0/2990589345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x5629d0cb8470 con 0x5629d0db3cc0 2023-10-06T02:20:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.556+0000 7fdc717fa700 1 -- 172.21.15.6:0/2990589345 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7c060020 con 0x5629d0db3cc0 2023-10-06T02:20:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.556+0000 7fdc717fa700 1 -- 172.21.15.6:0/2990589345 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdc7c051460 con 0x5629d0db3cc0 2023-10-06T02:20:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.556+0000 7fdca24e9b80 10 client.5910 fetch_fsmap finished waiting for FSMap version 33 2023-10-06T02:20:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.556+0000 7fdca24e9b80 10 client.5910 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:20:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.556+0000 7fdca24e9b80 20 client.5910 populate_metadata read hostname 'smithi006' 2023-10-06T02:20:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.556+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/2990589345 >> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] conn(0x5629d0defa10 0x5629d0defde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.556+0000 7fdca24e9b80 4 client.5910 mds_command: new command op to 5736 tid=0[{"prefix": "status"}] 2023-10-06T02:20:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.556+0000 7fdca24e9b80 1 -- 172.21.15.6:0/2990589345 --> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5629d0ca5e00 con 0x5629d0defa10 2023-10-06T02:20:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.556+0000 7fdc92d9d700 1 --2- 172.21.15.6:0/2990589345 >> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] conn(0x5629d0defa10 0x5629d0defde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.557+0000 7fdc717fa700 10 client.5910 ms_handle_connect on v2:172.21.15.6:6833/1800326966 2023-10-06T02:20:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.557+0000 7fdc92d9d700 1 --2- 172.21.15.6:0/2990589345 >> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] conn(0x5629d0defa10 0x5629d0defde0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=616701c25dae743b server_cookie=8dcc660a954f3b87 in_seq=0 out_seq=0 2023-10-06T02:20:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.557+0000 7fdc717fa700 1 -- 172.21.15.6:0/2990589345 <== mds.0 v2:172.21.15.6:6833/1800326966 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5629d0ca5e00 con 0x5629d0defa10 2023-10-06T02:20:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.557+0000 7fdc717fa700 10 client.5910 handle_command_reply: tid=0 2023-10-06T02:20:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.557+0000 7fdca24e9b80 1 client.5910 shutdown 2023-10-06T02:20:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.557+0000 7fdca24e9b80 1 -- 172.21.15.6:0/2990589345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0db3cc0 msgr2=0x5629d0dae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.557+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/2990589345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0db3cc0 0x5629d0dae510 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c055210 tx=0x7fdc7c068000 comp rx=0 tx=0).stop 2023-10-06T02:20:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.557+0000 7fdca24e9b80 1 -- 172.21.15.6:0/2990589345 shutdown_connections 2023-10-06T02:20:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.557+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/2990589345 >> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] conn(0x5629d0defa10 0x5629d0defde0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.557+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/2990589345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5629d0e02c00 0x5629d0daea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.557+0000 7fdc717fa700 0 client.5910 ms_handle_reset on v2:172.21.15.6:6833/1800326966 2023-10-06T02:20:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.557+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/2990589345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5629d0db2840 0x5629d0e618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.557+0000 7fdca24e9b80 1 --2- 172.21.15.6:0/2990589345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5629d0db3cc0 0x5629d0dae510 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.557+0000 7fdca24e9b80 1 -- 172.21.15.6:0/2990589345 >> 172.21.15.6:0/2990589345 conn(0x5629d0db4160 msgr2=0x5629d0df8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.557+0000 7fdca24e9b80 1 -- 172.21.15.6:0/2990589345 shutdown_connections 2023-10-06T02:20:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.557+0000 7fdca24e9b80 1 -- 172.21.15.6:0/2990589345 wait complete. 2023-10-06T02:20:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.557+0000 7fdca24e9b80 20 client.5910 trim_cache size 0 max 16384 2023-10-06T02:20:21.566 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:20:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:20:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:20:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5736, 2023-10-06T02:20:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:20:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:20:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:20:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.465903276000001, 2023-10-06T02:20:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 33, 2023-10-06T02:20:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 54, 2023-10-06T02:20:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 54, 2023-10-06T02:20:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 16.489257603999999 2023-10-06T02:20:21.567 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:20:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.558+0000 7fdc991f1700 1 -- 172.21.15.6:0/3252744186 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc74066f30 msgr2=0x7fdc740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.558+0000 7fdc991f1700 1 --2- 172.21.15.6:0/3252744186 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc74066f30 0x7fdc740693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400d560 tx=0x7fdc840075a0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.558+0000 7fdc991f1700 1 -- 172.21.15.6:0/3252744186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9415a030 msgr2=0x7fdc940c5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.558+0000 7fdc991f1700 1 --2- 172.21.15.6:0/3252744186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9415a030 0x7fdc940c5320 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c00c880 tx=0x7fdc7c008040 comp rx=0 tx=0).stop 2023-10-06T02:20:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.558+0000 7fdc991f1700 1 -- 172.21.15.6:0/3252744186 shutdown_connections 2023-10-06T02:20:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.558+0000 7fdc991f1700 1 --2- 172.21.15.6:0/3252744186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9415a940 0x7fdc940b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.558+0000 7fdc991f1700 1 --2- 172.21.15.6:0/3252744186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc94087530 0x7fdc9414a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.558+0000 7fdc991f1700 1 --2- 172.21.15.6:0/3252744186 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc74066f30 0x7fdc740693e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.558+0000 7fdc991f1700 1 --2- 172.21.15.6:0/3252744186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9415a030 0x7fdc940c5320 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.558+0000 7fdc991f1700 1 -- 172.21.15.6:0/3252744186 >> 172.21.15.6:0/3252744186 conn(0x7fdc94068680 msgr2=0x7fdc94156930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:21.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.558+0000 7fdc991f1700 1 -- 172.21.15.6:0/3252744186 shutdown_connections 2023-10-06T02:20:21.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.558+0000 7fdc991f1700 1 -- 172.21.15.6:0/3252744186 wait complete. 2023-10-06T02:20:21.570 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:20:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.689+0000 7ff8484f0700 1 Processor -- start 2023-10-06T02:20:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.689+0000 7ff8484f0700 1 -- start start 2023-10-06T02:20:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.690+0000 7ff8484f0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8400c78d0 0x7ff8400ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.690+0000 7ff8484f0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8400ca3e0 con 0x7ff840140040 2023-10-06T02:20:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.690+0000 7ff8484f0700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8400c97d0 con 0x7ff8400c7ca0 2023-10-06T02:20:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.690+0000 7ff8484f0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8400c95c0 con 0x7ff8400c78d0 2023-10-06T02:20:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.691+0000 7ff84628c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8400c78d0 0x7ff8400ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.691+0000 7ff84628c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8400c78d0 0x7ff8400ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59980/0 (socket says 172.21.15.6:59980) 2023-10-06T02:20:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.691+0000 7ff84628c700 1 -- 172.21.15.6:0/3031528878 learned_addr learned my addr 172.21.15.6:0/3031528878 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:21.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.691+0000 7ff84628c700 1 -- 172.21.15.6:0/3031528878 >> v1:172.21.15.175:6789/0 conn(0x7ff8400c7ca0 legacy=0x7ff84013f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:21.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.691+0000 7ff84628c700 1 -- 172.21.15.6:0/3031528878 >> v1:172.21.15.6:6789/0 conn(0x7ff840140040 legacy=0x7ff8400c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:21.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.691+0000 7ff84628c700 1 -- 172.21.15.6:0/3031528878 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8400c9ab0 con 0x7ff8400c78d0 2023-10-06T02:20:21.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.691+0000 7ff84528a700 1 -- 172.21.15.6:0/3031528878 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300139246 0 0) 0x7ff8400ca3e0 con 0x7ff840140040 2023-10-06T02:20:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.691+0000 7ff84628c700 1 --2- 172.21.15.6:0/3031528878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400c78d0 0x7ff8400ccfd0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff8380099b0 tx=0x7ff838009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9697b25da8220f30 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.691+0000 7ff84528a700 1 -- 172.21.15.6:0/3031528878 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83800b820 con 0x7ff8400c78d0 2023-10-06T02:20:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.691+0000 7ff84528a700 1 -- 172.21.15.6:0/3031528878 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83800b980 con 0x7ff8400c78d0 2023-10-06T02:20:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.691+0000 7ff84528a700 1 -- 172.21.15.6:0/3031528878 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83800bd20 con 0x7ff8400c78d0 2023-10-06T02:20:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.692+0000 7ff8484f0700 1 -- 172.21.15.6:0/3031528878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400c78d0 msgr2=0x7ff8400ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.692+0000 7ff8484f0700 1 --2- 172.21.15.6:0/3031528878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400c78d0 0x7ff8400ccfd0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff8380099b0 tx=0x7ff838009250 comp rx=0 tx=0).stop 2023-10-06T02:20:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.692+0000 7ff8484f0700 1 -- 172.21.15.6:0/3031528878 shutdown_connections 2023-10-06T02:20:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.692+0000 7ff8484f0700 1 --2- 172.21.15.6:0/3031528878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400c78d0 0x7ff8400ccfd0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.692+0000 7ff8484f0700 1 -- 172.21.15.6:0/3031528878 >> 172.21.15.6:0/3031528878 conn(0x7ff840069790 msgr2=0x7ff840069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.692+0000 7ff8484f0700 1 -- 172.21.15.6:0/3031528878 shutdown_connections 2023-10-06T02:20:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.692+0000 7ff8484f0700 1 -- 172.21.15.6:0/3031528878 wait complete. 2023-10-06T02:20:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.693+0000 7ff8484f0700 1 Processor -- start 2023-10-06T02:20:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.693+0000 7ff8484f0700 1 -- start start 2023-10-06T02:20:21.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff8484f0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400c78d0 0x7ff8400c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff8484f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400c7ca0 0x7ff84013acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff8484f0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff840140040 0x7ff8400c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff8484f0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400c5190 con 0x7ff8400c7ca0 2023-10-06T02:20:21.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff8484f0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff840159820 con 0x7ff8400c78d0 2023-10-06T02:20:21.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff8484f0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400c7310 con 0x7ff840140040 2023-10-06T02:20:21.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff845a8b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400c7ca0 0x7ff84013acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff845a8b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400c7ca0 0x7ff84013acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59986/0 (socket says 172.21.15.6:59986) 2023-10-06T02:20:21.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff845a8b700 1 -- 172.21.15.6:0/18321608 learned_addr learned my addr 172.21.15.6:0/18321608 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:21.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff84628c700 1 --2- 172.21.15.6:0/18321608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400c78d0 0x7ff8400c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff846a8d700 1 --2- 172.21.15.6:0/18321608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff840140040 0x7ff8400c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff845a8b700 1 -- 172.21.15.6:0/18321608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff840140040 msgr2=0x7ff8400c5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:21.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff845a8b700 1 --2- 172.21.15.6:0/18321608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff840140040 0x7ff8400c5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff845a8b700 1 -- 172.21.15.6:0/18321608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400c78d0 msgr2=0x7ff8400c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:21.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff845a8b700 1 --2- 172.21.15.6:0/18321608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400c78d0 0x7ff8400c6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff845a8b700 1 -- 172.21.15.6:0/18321608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8380094f0 con 0x7ff8400c7ca0 2023-10-06T02:20:21.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff845a8b700 1 --2- 172.21.15.6:0/18321608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400c7ca0 0x7ff84013acc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff83400c630 tx=0x7ff834007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:21.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.694+0000 7ff83e7fc700 1 -- 172.21.15.6:0/18321608 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834011590 con 0x7ff8400c7ca0 2023-10-06T02:20:21.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.695+0000 7ff83e7fc700 1 -- 172.21.15.6:0/18321608 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff834011710 con 0x7ff8400c7ca0 2023-10-06T02:20:21.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.695+0000 7ff8484f0700 1 -- 172.21.15.6:0/18321608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84013b200 con 0x7ff8400c7ca0 2023-10-06T02:20:21.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.695+0000 7ff83e7fc700 1 -- 172.21.15.6:0/18321608 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834011ad0 con 0x7ff8400c7ca0 2023-10-06T02:20:21.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.695+0000 7ff8484f0700 1 -- 172.21.15.6:0/18321608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8400c4860 con 0x7ff8400c7ca0 2023-10-06T02:20:21.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.696+0000 7ff8484f0700 1 -- 172.21.15.6:0/18321608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8400c5340 con 0x7ff8400c7ca0 2023-10-06T02:20:21.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.696+0000 7ff83e7fc700 1 -- 172.21.15.6:0/18321608 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff83401c460 con 0x7ff8400c7ca0 2023-10-06T02:20:21.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.696+0000 7ff83e7fc700 1 --2- 172.21.15.6:0/18321608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff82c066f30 0x7ff82c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:21.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.696+0000 7ff83e7fc700 1 -- 172.21.15.6:0/18321608 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff834084440 con 0x7ff8400c7ca0 2023-10-06T02:20:21.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.697+0000 7ff84628c700 1 --2- 172.21.15.6:0/18321608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff82c066f30 0x7ff82c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:21.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.697+0000 7ff84628c700 1 --2- 172.21.15.6:0/18321608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff82c066f30 0x7ff82c0693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff8380099b0 tx=0x7ff838016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:21.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.701+0000 7ff83e7fc700 1 -- 172.21.15.6:0/18321608 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8400c5340 con 0x7ff8400c7ca0 2023-10-06T02:20:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.939+0000 7ff8484f0700 1 -- 172.21.15.6:0/18321608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff8400c5340 con 0x7ff8400c7ca0 2023-10-06T02:20:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.940+0000 7ff83e7fc700 1 -- 172.21.15.6:0/18321608 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff8400c5340 con 0x7ff8400c7ca0 2023-10-06T02:20:21.940 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:20:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.942+0000 7ff8484f0700 1 -- 172.21.15.6:0/18321608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff82c066f30 msgr2=0x7ff82c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.942+0000 7ff8484f0700 1 --2- 172.21.15.6:0/18321608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff82c066f30 0x7ff82c0693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff8380099b0 tx=0x7ff838016000 comp rx=0 tx=0).stop 2023-10-06T02:20:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.942+0000 7ff8484f0700 1 -- 172.21.15.6:0/18321608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400c7ca0 msgr2=0x7ff84013acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.942+0000 7ff8484f0700 1 --2- 172.21.15.6:0/18321608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400c7ca0 0x7ff84013acc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff83400c630 tx=0x7ff834007f60 comp rx=0 tx=0).stop 2023-10-06T02:20:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.942+0000 7ff8484f0700 1 -- 172.21.15.6:0/18321608 shutdown_connections 2023-10-06T02:20:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.942+0000 7ff8484f0700 1 --2- 172.21.15.6:0/18321608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff840140040 0x7ff8400c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.942+0000 7ff8484f0700 1 --2- 172.21.15.6:0/18321608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400c78d0 0x7ff8400c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.942+0000 7ff8484f0700 1 --2- 172.21.15.6:0/18321608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff82c066f30 0x7ff82c0693e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.942+0000 7ff8484f0700 1 --2- 172.21.15.6:0/18321608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400c7ca0 0x7ff84013acc0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.942+0000 7ff8484f0700 1 -- 172.21.15.6:0/18321608 >> 172.21.15.6:0/18321608 conn(0x7ff840069790 msgr2=0x7ff8400cca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.942+0000 7ff8484f0700 1 -- 172.21.15.6:0/18321608 shutdown_connections 2023-10-06T02:20:21.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:21.942+0000 7ff8484f0700 1 -- 172.21.15.6:0/18321608 wait complete. 2023-10-06T02:20:21.954 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:20:21.954 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:20:21.955 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:20:21.955 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:20:21.955 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:20:21.955 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:20:21.955 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:20:21.955 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:20:21.955 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:20:21.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:20:21.956 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:20:21.971 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:20:21.971 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:20:21.972 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:20:21.972 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:20:21.972 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:20:21.972 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:20:21.972 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:20:21.972 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:20:21.972 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:20:21.972 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:20:21.972 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:20:21.972 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:20:21.972 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:20:21.972 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:20:21.973 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:20:21.973 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:20:21.973 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42324sec preferred_lft 42324sec 2023-10-06T02:20:21.973 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:20:21.973 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:20:21.973 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:20:21.973 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:20:21.973 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:20:21.973 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:20:21.973 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:20:21.973 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:20:21.973 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:20:21.974 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:20:21.974 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:20:21.974 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:20:21.974 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:20:21.974 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:20:21.974 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:20:21.974 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:20:21.974 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:20:21.974 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:20:21.974 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:20:21.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:20:21.975 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:20:22.036 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:20:22.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:20:22.038 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:20:22.094 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:20:22.094 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:20:22.094 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:20:22.095 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:20:22.095 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:20:22.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:20:22.095 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:20:22.096 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:20:22.096 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:20:22.096 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:20:22.096 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:20:22.096 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:20:22.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:20:22.196 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:20:22.211 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:20:22.211 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:20:22.211 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:20:22.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:20:22.211 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:20:22.276 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:20:22.276 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:20:22.276 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:20:22.331 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:20:22.332 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:20:22.332 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:20:22.387 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:20:22.452 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:20:22.453 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:20:22.517 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:20:22.518 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:20:22.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:20:22.519 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:20:22.574 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:20:22.574 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:20:22.617 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:20:22.642 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:20:22.642 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:20:22.699 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:20:22.699+0000 7fce9971c540 -1 init, newargv = 0x5647d5a3d840 newargc=15 2023-10-06T02:20:22.700 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[110688]: starting ceph client 2023-10-06T02:20:22.704 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[110688]: starting fuse 2023-10-06T02:20:22.708 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:20:22.709 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:20:22.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:20:22.710 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:20:22.765 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:20:22.766 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:20:22.766 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:20:22.766 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:20:22.766 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:20:22.766 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:20:22.766 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:20:22.766 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:20:22.766 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:20:22.766 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:20:22.766 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:20:22.767 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:20:22.767 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:20:22.767 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:20:22.767 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:20:22.767 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:20:22.767 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:20:22.767 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:20:22.767 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:20:22.767 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:20:22.767 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:20:22.767 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:20:22.767 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:20:22.767 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:20:22.768 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:20:22.768 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:20:22.768 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:20:22.768 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:20:22.768 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:20:22.889 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.110688.asok 2023-10-06T02:20:23.071 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.110688.asok 2023-10-06T02:20:23.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:20:23.203 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.110688.asok status 2023-10-06T02:20:23.322 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:20:23.322 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:20:23.322 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:20:23.322 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:20:23.323 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:20:23.323 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:20:23.323 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:20:23.323 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "110688", 2023-10-06T02:20:23.323 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:20:23.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:23.323 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:20:23.324 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:20:23.324 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5925, 2023-10-06T02:20:23.324 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:20:23.324 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:20:23.324 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:20:23.324 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5925 2023-10-06T02:20:23.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:23.324 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:20:23.324 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:20:23.324 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:20:23.324 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 606410324 2023-10-06T02:20:23.325 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:23.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:23.325 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:20:23.325 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:20:23.325 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:20:23.325 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 606410324 2023-10-06T02:20:23.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:23.325 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.5925 192.168.0.1:0/606410324", 2023-10-06T02:20:23.325 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/606410324", 2023-10-06T02:20:23.325 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:20:23.325 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 33, 2023-10-06T02:20:23.326 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 54, 2023-10-06T02:20:23.326 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:20:23.326 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:20:23.326 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:20:23.326 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:20:23.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:20:23.332 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:20:23.333 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:20:23.351 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:20:23.351 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:20:23.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:20:23.351 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:20:23.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:20:23.420 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'mkdir -p a/b') 2023-10-06T02:20:23.509 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush journal 2023-10-06T02:20:23.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.673+0000 7f7c5c31b700 1 Processor -- start 2023-10-06T02:20:23.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.673+0000 7f7c5c31b700 1 -- start start 2023-10-06T02:20:23.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.674+0000 7f7c5c31b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c540ccd40 0x7f7c540cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.674+0000 7f7c5c31b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c540cf7e0 0x7f7c540b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.674+0000 7f7c5c31b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5415dd40 con 0x7f7c540d0400 2023-10-06T02:20:23.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.674+0000 7f7c5c31b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5415e020 con 0x7f7c540ccd40 2023-10-06T02:20:23.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.674+0000 7f7c5c31b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540ceaa0 con 0x7f7c540cf7e0 2023-10-06T02:20:23.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.674+0000 7f7c598b6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c540ccd40 0x7f7c540cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.674+0000 7f7c5a0b7700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7c540d0400 0x7f7c540b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54938/0 (socket says 172.21.15.6:54938) 2023-10-06T02:20:23.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.674+0000 7f7c5a0b7700 1 -- 172.21.15.6:0/385062601 learned_addr learned my addr 172.21.15.6:0/385062601 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.674+0000 7f7c5a8b8700 1 --2- 172.21.15.6:0/385062601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c540cf7e0 0x7f7c540b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.674+0000 7f7c598b6700 1 -- 172.21.15.6:0/385062601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c540cf7e0 msgr2=0x7f7c540b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.674+0000 7f7c598b6700 1 --2- 172.21.15.6:0/385062601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c540cf7e0 0x7f7c540b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.674+0000 7f7c598b6700 1 -- 172.21.15.6:0/385062601 >> v1:172.21.15.6:6789/0 conn(0x7f7c540d0400 legacy=0x7f7c540b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.674+0000 7f7c598b6700 1 -- 172.21.15.6:0/385062601 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540ced80 con 0x7f7c540ccd40 2023-10-06T02:20:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.674+0000 7f7c590b5700 1 -- 172.21.15.6:0/385062601 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104106117 0 0) 0x7f7c5415dd40 con 0x7f7c540d0400 2023-10-06T02:20:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.674+0000 7f7c5a8b8700 1 --2- 172.21.15.6:0/385062601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c540cf7e0 0x7f7c540b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.674+0000 7f7c598b6700 1 --2- 172.21.15.6:0/385062601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c540ccd40 0x7f7c540cf2a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7c440098e0 tx=0x7f7c440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc614b05fd873447 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.675+0000 7f7c590b5700 1 -- 172.21.15.6:0/385062601 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44009e80 con 0x7f7c540ccd40 2023-10-06T02:20:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.675+0000 7f7c590b5700 1 -- 172.21.15.6:0/385062601 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4400b860 con 0x7f7c540ccd40 2023-10-06T02:20:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.675+0000 7f7c590b5700 1 -- 172.21.15.6:0/385062601 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4400bbe0 con 0x7f7c540ccd40 2023-10-06T02:20:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.675+0000 7f7c5c31b700 1 -- 172.21.15.6:0/385062601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c540ccd40 msgr2=0x7f7c540cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.675+0000 7f7c5c31b700 1 --2- 172.21.15.6:0/385062601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c540ccd40 0x7f7c540cf2a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7c440098e0 tx=0x7f7c440091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.675+0000 7f7c5c31b700 1 -- 172.21.15.6:0/385062601 shutdown_connections 2023-10-06T02:20:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.675+0000 7f7c5c31b700 1 --2- 172.21.15.6:0/385062601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c540cf7e0 0x7f7c540b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.675+0000 7f7c5c31b700 1 --2- 172.21.15.6:0/385062601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c540ccd40 0x7f7c540cf2a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.675+0000 7f7c5c31b700 1 -- 172.21.15.6:0/385062601 >> 172.21.15.6:0/385062601 conn(0x7f7c5406a220 msgr2=0x7f7c5406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.675+0000 7f7c5c31b700 1 -- 172.21.15.6:0/385062601 shutdown_connections 2023-10-06T02:20:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.675+0000 7f7c5c31b700 1 -- 172.21.15.6:0/385062601 wait complete. 2023-10-06T02:20:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.676+0000 7f7c5c31b700 1 Processor -- start 2023-10-06T02:20:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.676+0000 7f7c5c31b700 1 -- start start 2023-10-06T02:20:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.677+0000 7f7c5c31b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c540ccd40 0x7f7c5415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.677+0000 7f7c5c31b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c540cf7e0 0x7f7c54153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.677+0000 7f7c5c31b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c540d0400 0x7f7c540aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.677+0000 7f7c5c31b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54159e30 con 0x7f7c540ccd40 2023-10-06T02:20:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.677+0000 7f7c5c31b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54159220 con 0x7f7c540cf7e0 2023-10-06T02:20:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.677+0000 7f7c5c31b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54159500 con 0x7f7c540d0400 2023-10-06T02:20:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.677+0000 7f7c5a0b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c540ccd40 0x7f7c5415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.677+0000 7f7c5a0b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c540ccd40 0x7f7c5415a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59994/0 (socket says 172.21.15.6:59994) 2023-10-06T02:20:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.677+0000 7f7c5a0b7700 1 -- 172.21.15.6:0/247793877 learned_addr learned my addr 172.21.15.6:0/247793877 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.677+0000 7f7c598b6700 1 --2- 172.21.15.6:0/247793877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c540cf7e0 0x7f7c54153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.677+0000 7f7c5a8b8700 1 --2- 172.21.15.6:0/247793877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c540d0400 0x7f7c540aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.678+0000 7f7c5a0b7700 1 -- 172.21.15.6:0/247793877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c540d0400 msgr2=0x7f7c540aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.678+0000 7f7c5a0b7700 1 --2- 172.21.15.6:0/247793877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c540d0400 0x7f7c540aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.678+0000 7f7c5a0b7700 1 -- 172.21.15.6:0/247793877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c540cf7e0 msgr2=0x7f7c54153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.678+0000 7f7c5a0b7700 1 --2- 172.21.15.6:0/247793877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c540cf7e0 0x7f7c54153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.678+0000 7f7c5a0b7700 1 -- 172.21.15.6:0/247793877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c44009420 con 0x7f7c540ccd40 2023-10-06T02:20:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.678+0000 7f7c5a0b7700 1 --2- 172.21.15.6:0/247793877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c540ccd40 0x7f7c5415a2c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000c5e0 tx=0x7f7c50007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.678+0000 7f7c4a7fc700 1 -- 172.21.15.6:0/247793877 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c500072e0 con 0x7f7c540ccd40 2023-10-06T02:20:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.678+0000 7f7c4a7fc700 1 -- 172.21.15.6:0/247793877 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c50007440 con 0x7f7c540ccd40 2023-10-06T02:20:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.678+0000 7f7c5c31b700 1 -- 172.21.15.6:0/247793877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c541597e0 con 0x7f7c540ccd40 2023-10-06T02:20:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.678+0000 7f7c4a7fc700 1 -- 172.21.15.6:0/247793877 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c500057f0 con 0x7f7c540ccd40 2023-10-06T02:20:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.678+0000 7f7c5c31b700 1 -- 172.21.15.6:0/247793877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c54158e40 con 0x7f7c540ccd40 2023-10-06T02:20:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.680+0000 7f7c4a7fc700 1 -- 172.21.15.6:0/247793877 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c50005c00 con 0x7f7c540ccd40 2023-10-06T02:20:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.680+0000 7f7c4a7fc700 1 --2- 172.21.15.6:0/247793877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c38066f30 0x7f7c380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.680+0000 7f7c4a7fc700 1 -- 172.21.15.6:0/247793877 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7c50083d70 con 0x7f7c540ccd40 2023-10-06T02:20:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.680+0000 7f7c598b6700 1 --2- 172.21.15.6:0/247793877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c38066f30 0x7f7c380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.681+0000 7f7c598b6700 1 --2- 172.21.15.6:0/247793877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c38066f30 0x7f7c380693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7c440091e0 tx=0x7f7c44017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.682+0000 7f7c65613b80 1 Processor -- start 2023-10-06T02:20:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.682+0000 7f7c65613b80 1 -- start start 2023-10-06T02:20:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c65613b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4a3890 0x5606bd4a3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c65613b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a4d10 0x5606bd4f3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c65613b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4f3c50 0x5606bd4f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c65613b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606bd3faac0 con 0x5606bd4a4d10 2023-10-06T02:20:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c65613b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606bd3f82c0 con 0x5606bd4f3c50 2023-10-06T02:20:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c65613b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606bd3f40b0 con 0x5606bd4a3890 2023-10-06T02:20:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c598b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a4d10 0x5606bd4f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c598b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a4d10 0x5606bd4f3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60002/0 (socket says 172.21.15.6:60002) 2023-10-06T02:20:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c598b6700 1 -- 172.21.15.6:0/980379093 learned_addr learned my addr 172.21.15.6:0/980379093 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c5a0b7700 1 --2- 172.21.15.6:0/980379093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4a3890 0x5606bd4a3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c5a8b8700 1 --2- 172.21.15.6:0/980379093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4f3c50 0x5606bd4f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c598b6700 1 -- 172.21.15.6:0/980379093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4a3890 msgr2=0x5606bd4a3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c598b6700 1 --2- 172.21.15.6:0/980379093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4a3890 0x5606bd4a3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c598b6700 1 -- 172.21.15.6:0/980379093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4f3c50 msgr2=0x5606bd4f40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c598b6700 1 --2- 172.21.15.6:0/980379093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4f3c50 0x5606bd4f40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c598b6700 1 -- 172.21.15.6:0/980379093 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606bd28e2c0 con 0x5606bd4a4d10 2023-10-06T02:20:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c598b6700 1 --2- 172.21.15.6:0/980379093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a4d10 0x5606bd4f3710 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400b3c0 tx=0x7f7c44020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9e8d93284b3c66 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c377fe700 1 -- 172.21.15.6:0/980379093 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44020070 con 0x5606bd4a4d10 2023-10-06T02:20:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c377fe700 1 -- 172.21.15.6:0/980379093 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c44032480 con 0x5606bd4a4d10 2023-10-06T02:20:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.683+0000 7f7c377fe700 1 -- 172.21.15.6:0/980379093 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44032630 con 0x5606bd4a4d10 2023-10-06T02:20:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.684+0000 7f7c65613b80 1 -- 172.21.15.6:0/980379093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a4d10 msgr2=0x5606bd4f3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.684+0000 7f7c65613b80 1 --2- 172.21.15.6:0/980379093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a4d10 0x5606bd4f3710 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400b3c0 tx=0x7f7c44020000 comp rx=0 tx=0).stop 2023-10-06T02:20:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.684+0000 7f7c65613b80 1 -- 172.21.15.6:0/980379093 shutdown_connections 2023-10-06T02:20:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.684+0000 7f7c65613b80 1 --2- 172.21.15.6:0/980379093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4f3c50 0x5606bd4f40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.684+0000 7f7c65613b80 1 --2- 172.21.15.6:0/980379093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4a3890 0x5606bd4a3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.684+0000 7f7c65613b80 1 --2- 172.21.15.6:0/980379093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a4d10 0x5606bd4f3710 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.684+0000 7f7c65613b80 1 -- 172.21.15.6:0/980379093 >> 172.21.15.6:0/980379093 conn(0x5606bd4a51b0 msgr2=0x5606bd4a5580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.684+0000 7f7c65613b80 1 -- 172.21.15.6:0/980379093 shutdown_connections 2023-10-06T02:20:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.684+0000 7f7c65613b80 1 -- 172.21.15.6:0/980379093 wait complete. 2023-10-06T02:20:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.685+0000 7f7c65613b80 1 -- start start 2023-10-06T02:20:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.685+0000 7f7c65613b80 1 Processor -- start 2023-10-06T02:20:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c65613b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a3890 0x5606bd4d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c65613b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4a4d10 0x5606bd4ed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c65613b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4f3c50 0x5606bd4ed700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c65613b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606bd39f8e0 con 0x5606bd4a3890 2023-10-06T02:20:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c65613b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606bd3baef0 con 0x5606bd4a4d10 2023-10-06T02:20:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c65613b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606bd276e80 con 0x5606bd4f3c50 2023-10-06T02:20:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c65613b80 10 client.0 _ll_register_callbacks cb 0x5606bd466ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:20:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c5a0b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a3890 0x5606bd4d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c5a0b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a3890 0x5606bd4d3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60016/0 (socket says 172.21.15.6:60016) 2023-10-06T02:20:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c5a0b7700 1 -- 172.21.15.6:0/226472801 learned_addr learned my addr 172.21.15.6:0/226472801 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:23.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c598b6700 1 --2- 172.21.15.6:0/226472801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4a4d10 0x5606bd4ed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c5a8b8700 1 --2- 172.21.15.6:0/226472801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4f3c50 0x5606bd4ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c5a0b7700 1 -- 172.21.15.6:0/226472801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4f3c50 msgr2=0x5606bd4ed700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:23.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c5a0b7700 1 --2- 172.21.15.6:0/226472801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4f3c50 0x5606bd4ed700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c5a0b7700 1 -- 172.21.15.6:0/226472801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4a4d10 msgr2=0x5606bd4ed1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:23.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c5a0b7700 1 --2- 172.21.15.6:0/226472801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4a4d10 0x5606bd4ed1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c5a0b7700 1 -- 172.21.15.6:0/226472801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c540ced80 con 0x5606bd4a3890 2023-10-06T02:20:23.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c5a8b8700 1 --2- 172.21.15.6:0/226472801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4f3c50 0x5606bd4ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:23.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c5a0b7700 1 --2- 172.21.15.6:0/226472801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a3890 0x5606bd4d3a40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7c500077e0 tx=0x7f7c5000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882e9c143759b103 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:23.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c34ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:20:23.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c34ff9700 1 -- 172.21.15.6:0/226472801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50057c50 con 0x5606bd4a3890 2023-10-06T02:20:23.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c34ff9700 1 -- 172.21.15.6:0/226472801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7c5005b9a0 con 0x5606bd4a3890 2023-10-06T02:20:23.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.686+0000 7f7c65613b80 1 -- 172.21.15.6:0/226472801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606bd498990 con 0x5606bd4a3890 2023-10-06T02:20:23.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.687+0000 7f7c34ff9700 1 -- 172.21.15.6:0/226472801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c5005b720 con 0x5606bd4a3890 2023-10-06T02:20:23.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.687+0000 7f7c65613b80 10 client.5940 fetch_fsmap learned FSMap version 33 2023-10-06T02:20:23.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.687+0000 7f7c65613b80 1 -- 172.21.15.6:0/226472801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x5606bd231030 con 0x5606bd4a3890 2023-10-06T02:20:23.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.687+0000 7f7c34ff9700 1 -- 172.21.15.6:0/226472801 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5005f020 con 0x5606bd4a3890 2023-10-06T02:20:23.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.687+0000 7f7c34ff9700 1 -- 172.21.15.6:0/226472801 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7c500507f0 con 0x5606bd4a3890 2023-10-06T02:20:23.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.687+0000 7f7c65613b80 10 client.5940 fetch_fsmap finished waiting for FSMap version 33 2023-10-06T02:20:23.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.687+0000 7f7c65613b80 10 client.5940 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-06T02:20:23.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.687+0000 7f7c65613b80 20 client.5940 populate_metadata read hostname 'smithi006' 2023-10-06T02:20:23.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.687+0000 7f7c65613b80 1 --2- 172.21.15.6:0/226472801 >> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] conn(0x5606bd4f9cb0 0x5606bd4e3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.687+0000 7f7c65613b80 4 client.5940 mds_command: new command op to 5736 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:20:23.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.687+0000 7f7c65613b80 1 -- 172.21.15.6:0/226472801 --> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5606bd4758c0 con 0x5606bd4f9cb0 2023-10-06T02:20:23.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.687+0000 7f7c598b6700 1 --2- 172.21.15.6:0/226472801 >> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] conn(0x5606bd4f9cb0 0x5606bd4e3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.687+0000 7f7c34ff9700 10 client.5940 ms_handle_connect on v2:172.21.15.6:6833/1800326966 2023-10-06T02:20:23.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.687+0000 7f7c598b6700 1 --2- 172.21.15.6:0/226472801 >> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] conn(0x5606bd4f9cb0 0x5606bd4e3570 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5591fb466fefcd3 server_cookie=72eeaed1dc75bcd7 in_seq=0 out_seq=0 2023-10-06T02:20:23.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.688+0000 7f7c34ff9700 1 -- 172.21.15.6:0/226472801 <== mds.0 v2:172.21.15.6:6833/1800326966 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5606bd4758c0 con 0x5606bd4f9cb0 2023-10-06T02:20:23.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.688+0000 7f7c34ff9700 10 client.5940 handle_command_reply: tid=0 2023-10-06T02:20:23.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.688+0000 7f7c65613b80 1 client.5940 shutdown 2023-10-06T02:20:23.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.688+0000 7f7c65613b80 1 -- 172.21.15.6:0/226472801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a3890 msgr2=0x5606bd4d3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:23.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.688+0000 7f7c65613b80 1 --2- 172.21.15.6:0/226472801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a3890 0x5606bd4d3a40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7c500077e0 tx=0x7f7c5000f000 comp rx=0 tx=0).stop 2023-10-06T02:20:23.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.688+0000 7f7c65613b80 1 -- 172.21.15.6:0/226472801 shutdown_connections 2023-10-06T02:20:23.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.688+0000 7f7c65613b80 1 --2- 172.21.15.6:0/226472801 >> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] conn(0x5606bd4f9cb0 0x5606bd4e3570 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.688+0000 7f7c65613b80 1 --2- 172.21.15.6:0/226472801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4f3c50 0x5606bd4ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.688+0000 7f7c34ff9700 0 client.5940 ms_handle_reset on v2:172.21.15.6:6833/1800326966 2023-10-06T02:20:23.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.688+0000 7f7c65613b80 1 --2- 172.21.15.6:0/226472801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a3890 0x5606bd4d3a40 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.688+0000 7f7c65613b80 1 --2- 172.21.15.6:0/226472801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4a4d10 0x5606bd4ed1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.688+0000 7f7c65613b80 1 -- 172.21.15.6:0/226472801 >> 172.21.15.6:0/226472801 conn(0x5606bd4a51b0 msgr2=0x5606bd4a43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:23.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.688+0000 7f7c65613b80 1 -- 172.21.15.6:0/226472801 shutdown_connections 2023-10-06T02:20:23.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.688+0000 7f7c65613b80 1 -- 172.21.15.6:0/226472801 wait complete. 2023-10-06T02:20:23.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.688+0000 7f7c65613b80 20 client.5940 trim_cache size 0 max 16384 2023-10-06T02:20:23.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.702+0000 7f7c65613b80 1 Processor -- start 2023-10-06T02:20:23.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.702+0000 7f7c65613b80 1 -- start start 2023-10-06T02:20:23.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.703+0000 7f7c65613b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4a3890 0x5606bd4e6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.703+0000 7f7c65613b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a4d10 0x5606bd4e7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.703+0000 7f7c65613b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4f3c50 0x5606bd4d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.703+0000 7f7c65613b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606bd4fb160 con 0x5606bd4a4d10 2023-10-06T02:20:23.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.703+0000 7f7c65613b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606bd4a3fb0 con 0x5606bd4f3c50 2023-10-06T02:20:23.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.703+0000 7f7c65613b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606bd4ed010 con 0x5606bd4a3890 2023-10-06T02:20:23.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.703+0000 7f7c598b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a4d10 0x5606bd4e7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.703+0000 7f7c598b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a4d10 0x5606bd4e7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60030/0 (socket says 172.21.15.6:60030) 2023-10-06T02:20:23.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.703+0000 7f7c598b6700 1 -- 172.21.15.6:0/2602671638 learned_addr learned my addr 172.21.15.6:0/2602671638 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:23.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.703+0000 7f7c5a0b7700 1 --2- 172.21.15.6:0/2602671638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4a3890 0x5606bd4e6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.703+0000 7f7c5a8b8700 1 --2- 172.21.15.6:0/2602671638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4f3c50 0x5606bd4d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.703+0000 7f7c598b6700 1 -- 172.21.15.6:0/2602671638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4a3890 msgr2=0x5606bd4e6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:23.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.703+0000 7f7c598b6700 1 --2- 172.21.15.6:0/2602671638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4a3890 0x5606bd4e6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.703+0000 7f7c598b6700 1 -- 172.21.15.6:0/2602671638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4f3c50 msgr2=0x5606bd4d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:23.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.703+0000 7f7c598b6700 1 --2- 172.21.15.6:0/2602671638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4f3c50 0x5606bd4d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.703+0000 7f7c598b6700 1 -- 172.21.15.6:0/2602671638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606bd3c27d0 con 0x5606bd4a4d10 2023-10-06T02:20:23.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.704+0000 7f7c598b6700 1 --2- 172.21.15.6:0/2602671638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a4d10 0x5606bd4e7460 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7c44027000 tx=0x7f7c44034040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0918b8ac484053 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:23.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.704+0000 7f7c37fff700 1 -- 172.21.15.6:0/2602671638 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44020040 con 0x5606bd4a4d10 2023-10-06T02:20:23.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.704+0000 7f7c37fff700 1 -- 172.21.15.6:0/2602671638 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4403c0d0 con 0x5606bd4a4d10 2023-10-06T02:20:23.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.704+0000 7f7c37fff700 1 -- 172.21.15.6:0/2602671638 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440325f0 con 0x5606bd4a4d10 2023-10-06T02:20:23.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.704+0000 7f7c65613b80 1 -- 172.21.15.6:0/2602671638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a4d10 msgr2=0x5606bd4e7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:23.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.704+0000 7f7c65613b80 1 --2- 172.21.15.6:0/2602671638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a4d10 0x5606bd4e7460 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7c44027000 tx=0x7f7c44034040 comp rx=0 tx=0).stop 2023-10-06T02:20:23.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.704+0000 7f7c65613b80 1 -- 172.21.15.6:0/2602671638 shutdown_connections 2023-10-06T02:20:23.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.704+0000 7f7c65613b80 1 --2- 172.21.15.6:0/2602671638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4f3c50 0x5606bd4d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.704+0000 7f7c65613b80 1 --2- 172.21.15.6:0/2602671638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4a3890 0x5606bd4e6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.704+0000 7f7c65613b80 1 --2- 172.21.15.6:0/2602671638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4a4d10 0x5606bd4e7460 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.704+0000 7f7c65613b80 1 -- 172.21.15.6:0/2602671638 >> 172.21.15.6:0/2602671638 conn(0x5606bd4a51b0 msgr2=0x5606bd4ef5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:23.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.704+0000 7f7c65613b80 1 -- 172.21.15.6:0/2602671638 shutdown_connections 2023-10-06T02:20:23.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.704+0000 7f7c65613b80 1 -- 172.21.15.6:0/2602671638 wait complete. 2023-10-06T02:20:23.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.705+0000 7f7c65613b80 1 -- start start 2023-10-06T02:20:23.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.705+0000 7f7c65613b80 1 Processor -- start 2023-10-06T02:20:23.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c65613b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4a3890 0x5606bd54f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c65613b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4a4d10 0x5606bd4e6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c65613b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4f3c50 0x5606bd4e7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c65613b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606bd4e39f0 con 0x5606bd4f3c50 2023-10-06T02:20:23.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c65613b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606bd4eba90 con 0x5606bd4a4d10 2023-10-06T02:20:23.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c65613b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606bd553260 con 0x5606bd4a3890 2023-10-06T02:20:23.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c65613b80 10 client.0 _ll_register_callbacks cb 0x5606bd466ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:20:23.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c5a8b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4f3c50 0x5606bd4e7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c5a8b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4f3c50 0x5606bd4e7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60042/0 (socket says 172.21.15.6:60042) 2023-10-06T02:20:23.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c5a8b8700 1 -- 172.21.15.6:0/91937347 learned_addr learned my addr 172.21.15.6:0/91937347 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:23.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c598b6700 1 --2- 172.21.15.6:0/91937347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4a4d10 0x5606bd4e6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c5a0b7700 1 --2- 172.21.15.6:0/91937347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4a3890 0x5606bd54f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c5a8b8700 1 -- 172.21.15.6:0/91937347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4a3890 msgr2=0x5606bd54f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:23.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c5a8b8700 1 --2- 172.21.15.6:0/91937347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4a3890 0x5606bd54f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c5a8b8700 1 -- 172.21.15.6:0/91937347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4a4d10 msgr2=0x5606bd4e6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:23.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c5a8b8700 1 --2- 172.21.15.6:0/91937347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4a4d10 0x5606bd4e6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c5a8b8700 1 -- 172.21.15.6:0/91937347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606bd28e2c0 con 0x5606bd4f3c50 2023-10-06T02:20:23.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c5a8b8700 1 --2- 172.21.15.6:0/91937347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4f3c50 0x5606bd4e7460 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00df00 tx=0x7f7c4c007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec25efc7ace7188 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:23.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c34ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:20:23.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c34ff9700 1 -- 172.21.15.6:0/91937347 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c013050 con 0x5606bd4f3c50 2023-10-06T02:20:23.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c34ff9700 1 -- 172.21.15.6:0/91937347 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7c4c018400 con 0x5606bd4f3c50 2023-10-06T02:20:23.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.706+0000 7f7c65613b80 1 -- 172.21.15.6:0/91937347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606bd396e50 con 0x5606bd4f3c50 2023-10-06T02:20:23.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.707+0000 7f7c34ff9700 1 -- 172.21.15.6:0/91937347 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c4c0187d0 con 0x5606bd4f3c50 2023-10-06T02:20:23.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.707+0000 7f7c65613b80 10 client.5946 fetch_fsmap learned FSMap version 33 2023-10-06T02:20:23.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.707+0000 7f7c65613b80 1 -- 172.21.15.6:0/91937347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x5606bd3a94c0 con 0x5606bd4f3c50 2023-10-06T02:20:23.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.707+0000 7f7c34ff9700 1 -- 172.21.15.6:0/91937347 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5606bd396e50 con 0x5606bd4f3c50 2023-10-06T02:20:23.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.707+0000 7f7c34ff9700 1 -- 172.21.15.6:0/91937347 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7c4c018930 con 0x5606bd4f3c50 2023-10-06T02:20:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.707+0000 7f7c65613b80 10 client.5946 fetch_fsmap finished waiting for FSMap version 33 2023-10-06T02:20:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.707+0000 7f7c65613b80 10 client.5946 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-06T02:20:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.707+0000 7f7c65613b80 20 client.5946 populate_metadata read hostname 'smithi006' 2023-10-06T02:20:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.707+0000 7f7c65613b80 1 --2- 172.21.15.6:0/91937347 >> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] conn(0x5606bd4a5a90 0x5606bd4d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.707+0000 7f7c65613b80 4 client.5946 mds_command: new command op to 5736 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:20:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.707+0000 7f7c65613b80 1 -- 172.21.15.6:0/91937347 --> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5606bd396b70 con 0x5606bd4a5a90 2023-10-06T02:20:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.707+0000 7f7c5a0b7700 1 --2- 172.21.15.6:0/91937347 >> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] conn(0x5606bd4a5a90 0x5606bd4d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.707+0000 7f7c34ff9700 10 client.5946 ms_handle_connect on v2:172.21.15.6:6833/1800326966 2023-10-06T02:20:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.707+0000 7f7c5a0b7700 1 --2- 172.21.15.6:0/91937347 >> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] conn(0x5606bd4a5a90 0x5606bd4d32a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adb4726f8cbae219 server_cookie=a8867b1587e1a44 in_seq=0 out_seq=0 2023-10-06T02:20:23.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.719+0000 7f7c34ff9700 1 -- 172.21.15.6:0/91937347 <== mds.0 v2:172.21.15.6:6833/1800326966 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5606bd396b70 con 0x5606bd4a5a90 2023-10-06T02:20:23.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.719+0000 7f7c34ff9700 10 client.5946 handle_command_reply: tid=0 2023-10-06T02:20:23.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.719+0000 7f7c65613b80 1 client.5946 shutdown 2023-10-06T02:20:23.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.719+0000 7f7c65613b80 1 -- 172.21.15.6:0/91937347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4f3c50 msgr2=0x5606bd4e7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:23.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.719+0000 7f7c65613b80 1 --2- 172.21.15.6:0/91937347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4f3c50 0x5606bd4e7460 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00df00 tx=0x7f7c4c007d50 comp rx=0 tx=0).stop 2023-10-06T02:20:23.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.719+0000 7f7c65613b80 1 -- 172.21.15.6:0/91937347 shutdown_connections 2023-10-06T02:20:23.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.719+0000 7f7c65613b80 1 --2- 172.21.15.6:0/91937347 >> [v2:172.21.15.6:6833/1800326966,v1:172.21.15.6:6835/1800326966] conn(0x5606bd4a5a90 0x5606bd4d32a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.719+0000 7f7c65613b80 1 --2- 172.21.15.6:0/91937347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5606bd4f3c50 0x5606bd4e7460 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.719+0000 7f7c34ff9700 0 client.5946 ms_handle_reset on v2:172.21.15.6:6833/1800326966 2023-10-06T02:20:23.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.719+0000 7f7c65613b80 1 --2- 172.21.15.6:0/91937347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5606bd4a3890 0x5606bd54f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.719+0000 7f7c65613b80 1 --2- 172.21.15.6:0/91937347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606bd4a4d10 0x5606bd4e6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.719+0000 7f7c65613b80 1 -- 172.21.15.6:0/91937347 >> 172.21.15.6:0/91937347 conn(0x5606bd4a51b0 msgr2=0x5606bd49c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:23.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.719+0000 7f7c65613b80 1 -- 172.21.15.6:0/91937347 shutdown_connections 2023-10-06T02:20:23.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.719+0000 7f7c65613b80 1 -- 172.21.15.6:0/91937347 wait complete. 2023-10-06T02:20:23.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.719+0000 7f7c65613b80 20 client.5946 trim_cache size 0 max 16384 2023-10-06T02:20:23.721 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:20:23.721 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "", 2023-10-06T02:20:23.721 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0 2023-10-06T02:20:23.722 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:20:23.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.720+0000 7f7c5c31b700 1 -- 172.21.15.6:0/247793877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c38066f30 msgr2=0x7f7c380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:23.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.720+0000 7f7c5c31b700 1 --2- 172.21.15.6:0/247793877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c38066f30 0x7f7c380693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7c440091e0 tx=0x7f7c44017000 comp rx=0 tx=0).stop 2023-10-06T02:20:23.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.720+0000 7f7c5c31b700 1 -- 172.21.15.6:0/247793877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c540ccd40 msgr2=0x7f7c5415a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:23.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.720+0000 7f7c5c31b700 1 --2- 172.21.15.6:0/247793877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c540ccd40 0x7f7c5415a2c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000c5e0 tx=0x7f7c50007e80 comp rx=0 tx=0).stop 2023-10-06T02:20:23.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.720+0000 7f7c5c31b700 1 -- 172.21.15.6:0/247793877 shutdown_connections 2023-10-06T02:20:23.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.720+0000 7f7c5c31b700 1 --2- 172.21.15.6:0/247793877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c540d0400 0x7f7c540aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.720+0000 7f7c5c31b700 1 --2- 172.21.15.6:0/247793877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c38066f30 0x7f7c380693e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.720+0000 7f7c5c31b700 1 --2- 172.21.15.6:0/247793877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c540ccd40 0x7f7c5415a2c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.720+0000 7f7c5c31b700 1 --2- 172.21.15.6:0/247793877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c540cf7e0 0x7f7c54153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.720+0000 7f7c5c31b700 1 -- 172.21.15.6:0/247793877 >> 172.21.15.6:0/247793877 conn(0x7f7c5406a220 msgr2=0x7f7c540b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:23.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.720+0000 7f7c5c31b700 1 -- 172.21.15.6:0/247793877 shutdown_connections 2023-10-06T02:20:23.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.720+0000 7f7c5c31b700 1 -- 172.21.15.6:0/247793877 wait complete. 2023-10-06T02:20:23.732 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_abort_on_newly_corrupt_dentry False 2023-10-06T02:20:23.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.854+0000 7f5ec5eb5700 1 Processor -- start 2023-10-06T02:20:23.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.854+0000 7f5ec5eb5700 1 -- start start 2023-10-06T02:20:23.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.855+0000 7f5ec5eb5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5ec0159170 0x7f5ec01595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.855+0000 7f5ec5eb5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec00cae80 con 0x7f5ec006a750 2023-10-06T02:20:23.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.855+0000 7f5ec5eb5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec0159b10 con 0x7f5ec006a380 2023-10-06T02:20:23.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.855+0000 7f5ec5eb5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec00cba20 con 0x7f5ec0159170 2023-10-06T02:20:23.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.855+0000 7f5ebeffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5ec006a750 0x7f5ec015d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54948/0 (socket says 172.21.15.6:54948) 2023-10-06T02:20:23.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.855+0000 7f5ebeffd700 1 -- 172.21.15.6:0/3720530315 learned_addr learned my addr 172.21.15.6:0/3720530315 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:23.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.855+0000 7f5ebffff700 1 --2- 172.21.15.6:0/3720530315 >> v2:172.21.15.175:3300/0 conn(0x7f5ec0159170 0x7f5ec01595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.855+0000 7f5ebe7fc700 1 -- 172.21.15.6:0/3720530315 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962681776 0 0) 0x7f5ec00cae80 con 0x7f5ec006a750 2023-10-06T02:20:23.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.855+0000 7f5ebe7fc700 1 -- 172.21.15.6:0/3720530315 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ea8003570 con 0x7f5ec006a750 2023-10-06T02:20:23.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.855+0000 7f5ebe7fc700 1 -- 172.21.15.6:0/3720530315 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1478641647 0 0) 0x7f5ea8003570 con 0x7f5ec006a750 2023-10-06T02:20:23.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.855+0000 7f5ebffff700 1 -- 172.21.15.6:0/3720530315 >> v1:172.21.15.175:6789/0 conn(0x7f5ec006a380 legacy=0x7f5ec00cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:23.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.855+0000 7f5ebffff700 1 -- 172.21.15.6:0/3720530315 >> v1:172.21.15.6:6789/0 conn(0x7f5ec006a750 legacy=0x7f5ec015d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:23.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.855+0000 7f5ebffff700 1 -- 172.21.15.6:0/3720530315 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec015dcd0 con 0x7f5ec0159170 2023-10-06T02:20:23.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.856+0000 7f5ebffff700 1 --2- 172.21.15.6:0/3720530315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ec0159170 0x7f5ec01595d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009e60 tx=0x7f5eb8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=918386bcddfa0a70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:23.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.856+0000 7f5ebe7fc700 1 -- 172.21.15.6:0/3720530315 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb800e070 con 0x7f5ec0159170 2023-10-06T02:20:23.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.856+0000 7f5ebe7fc700 1 -- 172.21.15.6:0/3720530315 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb800b850 con 0x7f5ec0159170 2023-10-06T02:20:23.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.856+0000 7f5ebe7fc700 1 -- 172.21.15.6:0/3720530315 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4001470 con 0x7f5ec0159170 2023-10-06T02:20:23.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.856+0000 7f5ec5eb5700 1 -- 172.21.15.6:0/3720530315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ec0159170 msgr2=0x7f5ec01595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:23.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.856+0000 7f5ec5eb5700 1 --2- 172.21.15.6:0/3720530315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ec0159170 0x7f5ec01595d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009e60 tx=0x7f5eb8009780 comp rx=0 tx=0).stop 2023-10-06T02:20:23.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.856+0000 7f5ec5eb5700 1 -- 172.21.15.6:0/3720530315 shutdown_connections 2023-10-06T02:20:23.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.856+0000 7f5ec5eb5700 1 --2- 172.21.15.6:0/3720530315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ec0159170 0x7f5ec01595d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.856+0000 7f5ec5eb5700 1 -- 172.21.15.6:0/3720530315 >> 172.21.15.6:0/3720530315 conn(0x7f5ec00d0350 msgr2=0x7f5ec00d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:23.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.856+0000 7f5ec5eb5700 1 -- 172.21.15.6:0/3720530315 shutdown_connections 2023-10-06T02:20:23.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.856+0000 7f5ec5eb5700 1 -- 172.21.15.6:0/3720530315 wait complete. 2023-10-06T02:20:23.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.857+0000 7f5ec5eb5700 1 Processor -- start 2023-10-06T02:20:23.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.858+0000 7f5ec5eb5700 1 -- start start 2023-10-06T02:20:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.858+0000 7f5ec5eb5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ec006a380 0x7f5ec00b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.858+0000 7f5ec5eb5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ec006a750 0x7f5ec01580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.858+0000 7f5ec5eb5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ec0159170 0x7f5ec00c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.858+0000 7f5ec5eb5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00b4010 con 0x7f5ec006a380 2023-10-06T02:20:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.858+0000 7f5ec5eb5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00b4dc0 con 0x7f5ec0159170 2023-10-06T02:20:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.858+0000 7f5ec5eb5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00b50a0 con 0x7f5ec006a750 2023-10-06T02:20:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.858+0000 7f5ebf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ec006a380 0x7f5ec00b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.858+0000 7f5ebf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ec006a380 0x7f5ec00b3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60044/0 (socket says 172.21.15.6:60044) 2023-10-06T02:20:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.858+0000 7f5ebf7fe700 1 -- 172.21.15.6:0/4060360764 learned_addr learned my addr 172.21.15.6:0/4060360764 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.859+0000 7f5ebffff700 1 --2- 172.21.15.6:0/4060360764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ec0159170 0x7f5ec00c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.859+0000 7f5ebeffd700 1 --2- 172.21.15.6:0/4060360764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ec006a750 0x7f5ec01580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.859+0000 7f5ebf7fe700 1 -- 172.21.15.6:0/4060360764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ec006a750 msgr2=0x7f5ec01580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.859+0000 7f5ebf7fe700 1 --2- 172.21.15.6:0/4060360764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ec006a750 0x7f5ec01580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.859+0000 7f5ebf7fe700 1 -- 172.21.15.6:0/4060360764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ec0159170 msgr2=0x7f5ec00c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.859+0000 7f5ebf7fe700 1 --2- 172.21.15.6:0/4060360764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ec0159170 0x7f5ec00c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.859+0000 7f5ebf7fe700 1 -- 172.21.15.6:0/4060360764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb8009a20 con 0x7f5ec006a380 2023-10-06T02:20:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.859+0000 7f5ebffff700 1 --2- 172.21.15.6:0/4060360764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ec0159170 0x7f5ec00c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.859+0000 7f5ebf7fe700 1 --2- 172.21.15.6:0/4060360764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ec006a380 0x7f5ec00b3ad0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000c4e0 tx=0x7f5eb000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.859+0000 7f5ea77fe700 1 -- 172.21.15.6:0/4060360764 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0011590 con 0x7f5ec006a380 2023-10-06T02:20:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.859+0000 7f5ea77fe700 1 -- 172.21.15.6:0/4060360764 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb0011710 con 0x7f5ec006a380 2023-10-06T02:20:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.859+0000 7f5ec5eb5700 1 -- 172.21.15.6:0/4060360764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec00b5380 con 0x7f5ec006a380 2023-10-06T02:20:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.859+0000 7f5ea77fe700 1 -- 172.21.15.6:0/4060360764 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0011ad0 con 0x7f5ec006a380 2023-10-06T02:20:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.859+0000 7f5ec5eb5700 1 -- 172.21.15.6:0/4060360764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec00b5940 con 0x7f5ec006a380 2023-10-06T02:20:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.860+0000 7f5ec5eb5700 1 -- 172.21.15.6:0/4060360764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec00cfd00 con 0x7f5ec006a380 2023-10-06T02:20:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.860+0000 7f5ea77fe700 1 -- 172.21.15.6:0/4060360764 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5eb001b3b0 con 0x7f5ec006a380 2023-10-06T02:20:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.861+0000 7f5ea77fe700 1 --2- 172.21.15.6:0/4060360764 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5eac066f30 0x7f5eac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.861+0000 7f5ea77fe700 1 -- 172.21.15.6:0/4060360764 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5eb0083d00 con 0x7f5ec006a380 2023-10-06T02:20:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.861+0000 7f5ebeffd700 1 --2- 172.21.15.6:0/4060360764 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5eac066f30 0x7f5eac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.862+0000 7f5ebeffd700 1 --2- 172.21.15.6:0/4060360764 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5eac066f30 0x7f5eac0693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4001620 tx=0x7f5eb4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:23.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:23.865+0000 7f5ea77fe700 1 -- 172.21.15.6:0/4060360764 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5eb0050cd0 con 0x7f5ec006a380 2023-10-06T02:20:24.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.057+0000 7f5ec5eb5700 1 -- 172.21.15.6:0/4060360764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_abort_on_newly_corrupt_dentry}] v 0) v1 -- 0x7f5ec00b5b30 con 0x7f5ec006a380 2023-10-06T02:20:24.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.060+0000 7f5ea77fe700 1 -- 172.21.15.6:0/4060360764 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_abort_on_newly_corrupt_dentry}]=0 v13)=0 v13) v1 ==== 135+0+0 (secure 0 0 0) 0x7f5eb0017070 con 0x7f5ec006a380 2023-10-06T02:20:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.062+0000 7f5ec5eb5700 1 -- 172.21.15.6:0/4060360764 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5eac066f30 msgr2=0x7f5eac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.062+0000 7f5ec5eb5700 1 --2- 172.21.15.6:0/4060360764 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5eac066f30 0x7f5eac0693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4001620 tx=0x7f5eb4009040 comp rx=0 tx=0).stop 2023-10-06T02:20:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.062+0000 7f5ec5eb5700 1 -- 172.21.15.6:0/4060360764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ec006a380 msgr2=0x7f5ec00b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.062+0000 7f5ec5eb5700 1 --2- 172.21.15.6:0/4060360764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ec006a380 0x7f5ec00b3ad0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000c4e0 tx=0x7f5eb000c8a0 comp rx=0 tx=0).stop 2023-10-06T02:20:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.062+0000 7f5ec5eb5700 1 -- 172.21.15.6:0/4060360764 shutdown_connections 2023-10-06T02:20:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.062+0000 7f5ec5eb5700 1 --2- 172.21.15.6:0/4060360764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ec0159170 0x7f5ec00c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.062+0000 7f5ec5eb5700 1 --2- 172.21.15.6:0/4060360764 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5eac066f30 0x7f5eac0693e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.062+0000 7f5ec5eb5700 1 --2- 172.21.15.6:0/4060360764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ec006a380 0x7f5ec00b3ad0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.062+0000 7f5ec5eb5700 1 --2- 172.21.15.6:0/4060360764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ec006a750 0x7f5ec01580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.062+0000 7f5ec5eb5700 1 -- 172.21.15.6:0/4060360764 >> 172.21.15.6:0/4060360764 conn(0x7f5ec00d0350 msgr2=0x7f5ec015cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:24.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.062+0000 7f5ec5eb5700 1 -- 172.21.15.6:0/4060360764 shutdown_connections 2023-10-06T02:20:24.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.062+0000 7f5ec5eb5700 1 -- 172.21.15.6:0/4060360764 wait complete. 2023-10-06T02:20:24.074 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_inject_rename_corrupt_dentry_first 1.0 2023-10-06T02:20:24.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.195+0000 7fe802a82700 1 Processor -- start 2023-10-06T02:20:24.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.195+0000 7fe802a82700 1 -- start start 2023-10-06T02:20:24.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.196+0000 7fe802a82700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7fc0a89c0 0x7fe7fc0aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:24.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.196+0000 7fe802a82700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc06b030 con 0x7fe7fc0a8d90 2023-10-06T02:20:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.196+0000 7fe802a82700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc0b1ab0 con 0x7fe7fc0b3820 2023-10-06T02:20:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.196+0000 7fe802a82700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc06ad50 con 0x7fe7fc0a89c0 2023-10-06T02:20:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.196+0000 7fe7fbfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe7fc0a8d90 0x7fe7fc0af030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54958/0 (socket says 172.21.15.6:54958) 2023-10-06T02:20:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.196+0000 7fe7fbfff700 1 -- 172.21.15.6:0/3847890292 learned_addr learned my addr 172.21.15.6:0/3847890292 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe80081e700 1 --2- 172.21.15.6:0/3847890292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7fc0a89c0 0x7fe7fc0aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe7fb7fe700 1 -- 172.21.15.6:0/3847890292 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366895079 0 0) 0x7fe7fc06b030 con 0x7fe7fc0a8d90 2023-10-06T02:20:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe7fb7fe700 1 -- 172.21.15.6:0/3847890292 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7e4003570 con 0x7fe7fc0a8d90 2023-10-06T02:20:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe7fb7fe700 1 -- 172.21.15.6:0/3847890292 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 961492305 0 0) 0x7fe7e4003570 con 0x7fe7fc0a8d90 2023-10-06T02:20:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe7fb7fe700 1 -- 172.21.15.6:0/3847890292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7fc0a89c0 msgr2=0x7fe7fc0aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe7fb7fe700 1 --2- 172.21.15.6:0/3847890292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7fc0a89c0 0x7fe7fc0aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe7fb7fe700 1 -- 172.21.15.6:0/3847890292 >> v1:172.21.15.175:6789/0 conn(0x7fe7fc0b3820 legacy=0x7fe7fc069790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe7fb7fe700 1 -- 172.21.15.6:0/3847890292 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc0b1d30 con 0x7fe7fc0a8d90 2023-10-06T02:20:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe7fb7fe700 1 -- 172.21.15.6:0/3847890292 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fe7f0001470 con 0x7fe7fc0a8d90 2023-10-06T02:20:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe7fb7fe700 1 -- 172.21.15.6:0/3847890292 >> v1:172.21.15.6:6789/0 conn(0x7fe7fc0a8d90 legacy=0x7fe7fc0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe7fb7fe700 1 --2- 172.21.15.6:0/3847890292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7fc0a89c0 0x7fe7e4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe7fb7fe700 1 --2- 172.21.15.6:0/3847890292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e4004010 0x7fe7e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe7fb7fe700 1 --2- 172.21.15.6:0/3847890292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7e4004d50 0x7fe7e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe7fb7fe700 1 -- 172.21.15.6:0/3847890292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc06ad50 con 0x7fe7e4004010 2023-10-06T02:20:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe7fb7fe700 1 -- 172.21.15.6:0/3847890292 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e400bbf0 con 0x7fe7e4004d50 2023-10-06T02:20:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe7fb7fe700 1 -- 172.21.15.6:0/3847890292 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e400bdb0 con 0x7fe7fc0a89c0 2023-10-06T02:20:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe80081e700 1 --2- 172.21.15.6:0/3847890292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7fc0a89c0 0x7fe7e4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe7fbfff700 1 --2- 172.21.15.6:0/3847890292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e4004010 0x7fe7e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe80101f700 1 --2- 172.21.15.6:0/3847890292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7e4004d50 0x7fe7e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:24.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.197+0000 7fe7fbfff700 1 -- 172.21.15.6:0/3847890292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7fc0a89c0 msgr2=0x7fe7e4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:24.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.198+0000 7fe7fbfff700 1 --2- 172.21.15.6:0/3847890292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7fc0a89c0 0x7fe7e4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:24.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.198+0000 7fe7fbfff700 1 -- 172.21.15.6:0/3847890292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7e4004d50 msgr2=0x7fe7e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:24.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.198+0000 7fe7fbfff700 1 --2- 172.21.15.6:0/3847890292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7e4004d50 0x7fe7e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:24.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.198+0000 7fe7fbfff700 1 -- 172.21.15.6:0/3847890292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e4003570 con 0x7fe7e4004010 2023-10-06T02:20:24.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.198+0000 7fe7fbfff700 1 --2- 172.21.15.6:0/3847890292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e4004010 0x7fe7e4004810 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000c390 tx=0x7fe7f0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9a7c21bc2ebeda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:24.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.198+0000 7fe7fb7fe700 1 -- 172.21.15.6:0/3847890292 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f000cc60 con 0x7fe7e4004010 2023-10-06T02:20:24.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.198+0000 7fe7fb7fe700 1 -- 172.21.15.6:0/3847890292 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f000cdc0 con 0x7fe7e4004010 2023-10-06T02:20:24.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.198+0000 7fe7fb7fe700 1 -- 172.21.15.6:0/3847890292 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0005b70 con 0x7fe7e4004010 2023-10-06T02:20:24.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.198+0000 7fe802a82700 1 -- 172.21.15.6:0/3847890292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e4004010 msgr2=0x7fe7e4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:24.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.198+0000 7fe802a82700 1 --2- 172.21.15.6:0/3847890292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e4004010 0x7fe7e4004810 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000c390 tx=0x7fe7f0001e50 comp rx=0 tx=0).stop 2023-10-06T02:20:24.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.198+0000 7fe80101f700 1 -- 172.21.15.6:0/3847890292 reap_dead start 2023-10-06T02:20:24.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.198+0000 7fe802a82700 1 -- 172.21.15.6:0/3847890292 shutdown_connections 2023-10-06T02:20:24.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.198+0000 7fe802a82700 1 -- 172.21.15.6:0/3847890292 >> 172.21.15.6:0/3847890292 conn(0x7fe7fc067910 msgr2=0x7fe7fc0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:24.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.198+0000 7fe802a82700 1 -- 172.21.15.6:0/3847890292 shutdown_connections 2023-10-06T02:20:24.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.198+0000 7fe802a82700 1 -- 172.21.15.6:0/3847890292 wait complete. 2023-10-06T02:20:24.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.199+0000 7fe802a82700 1 Processor -- start 2023-10-06T02:20:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.200+0000 7fe802a82700 1 -- start start 2023-10-06T02:20:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.200+0000 7fe802a82700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e4004010 0x7fe7fc15c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.200+0000 7fe802a82700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7fc14ffc0 0x7fe7fc15c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.200+0000 7fe802a82700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7fc16a8e0 0x7fe7fc16ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.200+0000 7fe802a82700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc154930 con 0x7fe7e4004010 2023-10-06T02:20:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.200+0000 7fe802a82700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0a83c0 con 0x7fe7fc16a8e0 2023-10-06T02:20:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.200+0000 7fe802a82700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc16b2a0 con 0x7fe7fc14ffc0 2023-10-06T02:20:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.201+0000 7fe80081e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e4004010 0x7fe7fc15c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.201+0000 7fe80081e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e4004010 0x7fe7fc15c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60060/0 (socket says 172.21.15.6:60060) 2023-10-06T02:20:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.201+0000 7fe80081e700 1 -- 172.21.15.6:0/3368463901 learned_addr learned my addr 172.21.15.6:0/3368463901 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.201+0000 7fe80101f700 1 --2- 172.21.15.6:0/3368463901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7fc16a8e0 0x7fe7fc16ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.201+0000 7fe7fbfff700 1 --2- 172.21.15.6:0/3368463901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7fc14ffc0 0x7fe7fc15c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.201+0000 7fe80081e700 1 -- 172.21.15.6:0/3368463901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7fc14ffc0 msgr2=0x7fe7fc15c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.201+0000 7fe80081e700 1 --2- 172.21.15.6:0/3368463901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7fc14ffc0 0x7fe7fc15c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.201+0000 7fe80081e700 1 -- 172.21.15.6:0/3368463901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7fc16a8e0 msgr2=0x7fe7fc16ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.201+0000 7fe80081e700 1 --2- 172.21.15.6:0/3368463901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7fc16a8e0 0x7fe7fc16ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.201+0000 7fe80081e700 1 -- 172.21.15.6:0/3368463901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc1504a0 con 0x7fe7e4004010 2023-10-06T02:20:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.201+0000 7fe80101f700 1 --2- 172.21.15.6:0/3368463901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7fc16a8e0 0x7fe7fc16ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.201+0000 7fe80081e700 1 --2- 172.21.15.6:0/3368463901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e4004010 0x7fe7fc15c0f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400f1b0 tx=0x7fe7f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.201+0000 7fe7f8ff9700 1 -- 172.21.15.6:0/3368463901 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f400e040 con 0x7fe7e4004010 2023-10-06T02:20:24.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.201+0000 7fe7f8ff9700 1 -- 172.21.15.6:0/3368463901 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f400f040 con 0x7fe7e4004010 2023-10-06T02:20:24.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.201+0000 7fe802a82700 1 -- 172.21.15.6:0/3368463901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7fc150780 con 0x7fe7e4004010 2023-10-06T02:20:24.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.201+0000 7fe7f8ff9700 1 -- 172.21.15.6:0/3368463901 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4015430 con 0x7fe7e4004010 2023-10-06T02:20:24.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.201+0000 7fe802a82700 1 -- 172.21.15.6:0/3368463901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7fc150d40 con 0x7fe7e4004010 2023-10-06T02:20:24.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.202+0000 7fe802a82700 1 -- 172.21.15.6:0/3368463901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7fc087170 con 0x7fe7e4004010 2023-10-06T02:20:24.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.203+0000 7fe7f8ff9700 1 -- 172.21.15.6:0/3368463901 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7f40157a0 con 0x7fe7e4004010 2023-10-06T02:20:24.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.203+0000 7fe7f8ff9700 1 --2- 172.21.15.6:0/3368463901 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7e8066f30 0x7fe7e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:24.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.203+0000 7fe7f8ff9700 1 -- 172.21.15.6:0/3368463901 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe7f40854e0 con 0x7fe7e4004010 2023-10-06T02:20:24.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.203+0000 7fe7fbfff700 1 --2- 172.21.15.6:0/3368463901 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7e8066f30 0x7fe7e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:24.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.204+0000 7fe7fbfff700 1 --2- 172.21.15.6:0/3368463901 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7e8066f30 0x7fe7e80693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc1503d0 tx=0x7fe7f0015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:24.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.207+0000 7fe7f8ff9700 1 -- 172.21.15.6:0/3368463901 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7f4055f40 con 0x7fe7e4004010 2023-10-06T02:20:24.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.403+0000 7fe802a82700 1 -- 172.21.15.6:0/3368463901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_inject_rename_corrupt_dentry_first}] v 0) v1 -- 0x7fe7fc06e5d0 con 0x7fe7e4004010 2023-10-06T02:20:24.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.409+0000 7fe7f8ff9700 1 -- 172.21.15.6:0/3368463901 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_inject_rename_corrupt_dentry_first}]=0 v14)=0 v14) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe7f4055ad0 con 0x7fe7e4004010 2023-10-06T02:20:24.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.411+0000 7fe802a82700 1 -- 172.21.15.6:0/3368463901 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7e8066f30 msgr2=0x7fe7e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:24.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.411+0000 7fe802a82700 1 --2- 172.21.15.6:0/3368463901 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7e8066f30 0x7fe7e80693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc1503d0 tx=0x7fe7f0015000 comp rx=0 tx=0).stop 2023-10-06T02:20:24.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.411+0000 7fe802a82700 1 -- 172.21.15.6:0/3368463901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e4004010 msgr2=0x7fe7fc15c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:24.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.411+0000 7fe802a82700 1 --2- 172.21.15.6:0/3368463901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e4004010 0x7fe7fc15c0f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400f1b0 tx=0x7fe7f400b040 comp rx=0 tx=0).stop 2023-10-06T02:20:24.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.411+0000 7fe802a82700 1 -- 172.21.15.6:0/3368463901 shutdown_connections 2023-10-06T02:20:24.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.411+0000 7fe802a82700 1 --2- 172.21.15.6:0/3368463901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7fc16a8e0 0x7fe7fc16ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:24.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.411+0000 7fe802a82700 1 --2- 172.21.15.6:0/3368463901 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7e8066f30 0x7fe7e80693e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:24.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.411+0000 7fe802a82700 1 --2- 172.21.15.6:0/3368463901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e4004010 0x7fe7fc15c0f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:24.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.411+0000 7fe802a82700 1 --2- 172.21.15.6:0/3368463901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7fc14ffc0 0x7fe7fc15c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:24.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.411+0000 7fe802a82700 1 -- 172.21.15.6:0/3368463901 >> 172.21.15.6:0/3368463901 conn(0x7fe7fc067910 msgr2=0x7fe7fc0ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:24.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.411+0000 7fe802a82700 1 -- 172.21.15.6:0/3368463901 shutdown_connections 2023-10-06T02:20:24.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:24.411+0000 7fe802a82700 1 -- 172.21.15.6:0/3368463901 wait complete. 2023-10-06T02:20:29.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:20:29.425 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'mv a/b a/c; sync .') 2023-10-06T02:20:29.466 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:20:29.465+0000 7f68b9a9e700 -1 mds.0.cache.den(0x10000000000 c) newly corrupt dentry to be committed: [dentry #0x1/a/c [fffffffffffffff6,head] auth NULL (dn xlock x=1 by 0x56229c56f800) (dversion lock w=1 last_client=5925) pv=4 v=3 ap=2 ino=(nil) state=1073741888|bottomlru | request=1 lock=2 authpin=1 0x56229c481680] 2023-10-06T02:20:29.468 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:20:29.468 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:20:29.468 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:20:29.547 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[110688]: fuse finished with error 0 and tester_r 0 2023-10-06T02:20:29.549 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:20:29.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:20:29.549 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:20:29.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:20:29.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.777+0000 7fbaf5996700 1 Processor -- start 2023-10-06T02:20:29.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.777+0000 7fbaf5996700 1 -- start start 2023-10-06T02:20:29.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.778+0000 7fbaf5996700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf015a5d0 0x7fbaf00b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:29.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.778+0000 7fbaf5996700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbaf015a9a0 0x7fbaf00b1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:29.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.778+0000 7fbaf5996700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbaf006efc0 0x7fbaf00c8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:29.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.778+0000 7fbaf5996700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf006eb30 con 0x7fbaf015a9a0 2023-10-06T02:20:29.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.778+0000 7fbaf5996700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf00c9760 con 0x7fbaf006efc0 2023-10-06T02:20:29.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.778+0000 7fbaf5996700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf00c9480 con 0x7fbaf015a5d0 2023-10-06T02:20:29.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.778+0000 7fbaee7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbaf015a9a0 0x7fbaf00b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:29.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.778+0000 7fbaee7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbaf015a9a0 0x7fbaf00b1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56446/0 (socket says 172.21.15.6:56446) 2023-10-06T02:20:29.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.778+0000 7fbaee7fc700 1 -- 172.21.15.6:0/1072363024 learned_addr learned my addr 172.21.15.6:0/1072363024 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:29.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.779+0000 7fbaef7fe700 1 --2- 172.21.15.6:0/1072363024 >> v2:172.21.15.175:3300/0 conn(0x7fbaf006efc0 0x7fbaf00c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:29.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.779+0000 7fbaeeffd700 1 --2- 172.21.15.6:0/1072363024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf015a5d0 0x7fbaf00b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:29.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.779+0000 7fbaee7fc700 1 -- 172.21.15.6:0/1072363024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf015a5d0 msgr2=0x7fbaf00b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:29.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.779+0000 7fbaee7fc700 1 --2- 172.21.15.6:0/1072363024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf015a5d0 0x7fbaf00b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:29.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.779+0000 7fbaee7fc700 1 -- 172.21.15.6:0/1072363024 >> v2:172.21.15.175:3300/0 conn(0x7fbaf006efc0 msgr2=0x7fbaf00c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:29.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.779+0000 7fbaee7fc700 1 --2- 172.21.15.6:0/1072363024 >> v2:172.21.15.175:3300/0 conn(0x7fbaf006efc0 0x7fbaf00c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:29.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.779+0000 7fbaee7fc700 1 -- 172.21.15.6:0/1072363024 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf006e4e0 con 0x7fbaf015a9a0 2023-10-06T02:20:29.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.779+0000 7fbaee7fc700 1 --2- 172.21.15.6:0/1072363024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf015a9a0 0x7fbaf00b1580 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0065090 tx=0x7fbad8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54244e12e673a766 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:29.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.779+0000 7fbaedffb700 1 -- 172.21.15.6:0/1072363024 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800b640 con 0x7fbaf015a9a0 2023-10-06T02:20:29.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.779+0000 7fbaedffb700 1 -- 172.21.15.6:0/1072363024 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad800b7a0 con 0x7fbaf015a9a0 2023-10-06T02:20:29.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.779+0000 7fbaedffb700 1 -- 172.21.15.6:0/1072363024 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800bb60 con 0x7fbaf015a9a0 2023-10-06T02:20:29.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.780+0000 7fbaf5996700 1 -- 172.21.15.6:0/1072363024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf015a9a0 msgr2=0x7fbaf00b1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:29.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.780+0000 7fbaf5996700 1 --2- 172.21.15.6:0/1072363024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf015a9a0 0x7fbaf00b1580 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0065090 tx=0x7fbad8009250 comp rx=0 tx=0).stop 2023-10-06T02:20:29.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.780+0000 7fbaf5996700 1 -- 172.21.15.6:0/1072363024 shutdown_connections 2023-10-06T02:20:29.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.780+0000 7fbaf5996700 1 --2- 172.21.15.6:0/1072363024 >> v2:172.21.15.175:3300/0 conn(0x7fbaf006efc0 0x7fbaf00c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:29.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.780+0000 7fbaf5996700 1 --2- 172.21.15.6:0/1072363024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf015a5d0 0x7fbaf00b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:29.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.780+0000 7fbaf5996700 1 --2- 172.21.15.6:0/1072363024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf015a9a0 0x7fbaf00b1580 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:29.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.780+0000 7fbaf5996700 1 -- 172.21.15.6:0/1072363024 >> 172.21.15.6:0/1072363024 conn(0x7fbaf0069100 msgr2=0x7fbaf00ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:29.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.780+0000 7fbaf5996700 1 -- 172.21.15.6:0/1072363024 shutdown_connections 2023-10-06T02:20:29.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.780+0000 7fbaf5996700 1 -- 172.21.15.6:0/1072363024 wait complete. 2023-10-06T02:20:29.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.781+0000 7fbaf5996700 1 Processor -- start 2023-10-06T02:20:29.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.781+0000 7fbaf5996700 1 -- start start 2023-10-06T02:20:29.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.782+0000 7fbaf5996700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaf006efc0 0x7fbaf014c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:29.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.782+0000 7fbaf5996700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf015a5d0 0x7fbaf014f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:29.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.782+0000 7fbaf5996700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf015a9a0 0x7fbaf014f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:29.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.782+0000 7fbaf5996700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf00ac130 con 0x7fbaf015a5d0 2023-10-06T02:20:29.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.782+0000 7fbaf5996700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf01535d0 con 0x7fbaf006efc0 2023-10-06T02:20:29.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.782+0000 7fbaf5996700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf014c770 con 0x7fbaf015a9a0 2023-10-06T02:20:29.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.782+0000 7fbaee7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf015a5d0 0x7fbaf014f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:29.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.782+0000 7fbaee7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf015a5d0 0x7fbaf014f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56450/0 (socket says 172.21.15.6:56450) 2023-10-06T02:20:29.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.782+0000 7fbaee7fc700 1 -- 172.21.15.6:0/1510769636 learned_addr learned my addr 172.21.15.6:0/1510769636 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:29.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.782+0000 7fbaeeffd700 1 --2- 172.21.15.6:0/1510769636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaf006efc0 0x7fbaf014c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:29.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.782+0000 7fbaef7fe700 1 --2- 172.21.15.6:0/1510769636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf015a9a0 0x7fbaf014f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:29.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.782+0000 7fbaee7fc700 1 -- 172.21.15.6:0/1510769636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf015a9a0 msgr2=0x7fbaf014f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:29.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.782+0000 7fbaee7fc700 1 --2- 172.21.15.6:0/1510769636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf015a9a0 0x7fbaf014f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:29.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.782+0000 7fbaee7fc700 1 -- 172.21.15.6:0/1510769636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaf006efc0 msgr2=0x7fbaf014c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:29.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.782+0000 7fbaee7fc700 1 --2- 172.21.15.6:0/1510769636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaf006efc0 0x7fbaf014c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:29.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.782+0000 7fbaee7fc700 1 -- 172.21.15.6:0/1510769636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad80094f0 con 0x7fbaf015a5d0 2023-10-06T02:20:29.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.782+0000 7fbaee7fc700 1 --2- 172.21.15.6:0/1510769636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf015a5d0 0x7fbaf014f460 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00695a0 tx=0x7fbad8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:29.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.783+0000 7fbae6ffd700 1 -- 172.21.15.6:0/1510769636 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800b910 con 0x7fbaf015a5d0 2023-10-06T02:20:29.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.783+0000 7fbae6ffd700 1 -- 172.21.15.6:0/1510769636 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad800ba70 con 0x7fbaf015a5d0 2023-10-06T02:20:29.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.783+0000 7fbaf5996700 1 -- 172.21.15.6:0/1510769636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf00acf10 con 0x7fbaf015a5d0 2023-10-06T02:20:29.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.783+0000 7fbae6ffd700 1 -- 172.21.15.6:0/1510769636 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8011630 con 0x7fbaf015a5d0 2023-10-06T02:20:29.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.783+0000 7fbaf5996700 1 -- 172.21.15.6:0/1510769636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf00ad490 con 0x7fbaf015a5d0 2023-10-06T02:20:29.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.784+0000 7fbaf5996700 1 -- 172.21.15.6:0/1510769636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf0153760 con 0x7fbaf015a5d0 2023-10-06T02:20:29.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.784+0000 7fbae6ffd700 1 -- 172.21.15.6:0/1510769636 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbad80119a0 con 0x7fbaf015a5d0 2023-10-06T02:20:29.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.785+0000 7fbae6ffd700 1 --2- 172.21.15.6:0/1510769636 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbad0066f30 0x7fbad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:29.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.785+0000 7fbae6ffd700 1 -- 172.21.15.6:0/1510769636 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbad8085e60 con 0x7fbaf015a5d0 2023-10-06T02:20:29.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.785+0000 7fbaeeffd700 1 --2- 172.21.15.6:0/1510769636 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbad0066f30 0x7fbad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:29.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.785+0000 7fbaeeffd700 1 --2- 172.21.15.6:0/1510769636 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbad0066f30 0x7fbad00693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbae000f570 tx=0x7fbae000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:29.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:29.789+0000 7fbae6ffd700 1 -- 172.21.15.6:0/1510769636 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbad8052e30 con 0x7fbaf015a5d0 2023-10-06T02:20:30.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.027+0000 7fbaf5996700 1 -- 172.21.15.6:0/1510769636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbaf006e7c0 con 0x7fbaf015a5d0 2023-10-06T02:20:30.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.028+0000 7fbae6ffd700 1 -- 172.21.15.6:0/1510769636 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fbad8056450 con 0x7fbaf015a5d0 2023-10-06T02:20:30.028 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:30.028 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":33,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2589522502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2589522502},{"type":"v1","addr":"172.21.15.175:6837","nonce":2589522502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3703329287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3703329287},{"type":"v1","addr":"172.21.15.175:6836","nonce":3703329287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/843207095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":843207095},{"type":"v1","addr":"172.21.15.6:6834","nonce":843207095}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:10.479851+0000","modified":"2023-10-06T02:20:14.110882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1800326966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1800326966},{"type":"v1","addr":"172.21.15.6:6835","nonce":1800326966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:20:30.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.030+0000 7fbaf5996700 1 -- 172.21.15.6:0/1510769636 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbad0066f30 msgr2=0x7fbad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:30.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.030+0000 7fbaf5996700 1 --2- 172.21.15.6:0/1510769636 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbad0066f30 0x7fbad00693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbae000f570 tx=0x7fbae000b040 comp rx=0 tx=0).stop 2023-10-06T02:20:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.030+0000 7fbaf5996700 1 -- 172.21.15.6:0/1510769636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf015a5d0 msgr2=0x7fbaf014f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.030+0000 7fbaf5996700 1 --2- 172.21.15.6:0/1510769636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf015a5d0 0x7fbaf014f460 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00695a0 tx=0x7fbad8017000 comp rx=0 tx=0).stop 2023-10-06T02:20:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.030+0000 7fbaf5996700 1 -- 172.21.15.6:0/1510769636 shutdown_connections 2023-10-06T02:20:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.030+0000 7fbaf5996700 1 --2- 172.21.15.6:0/1510769636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf015a9a0 0x7fbaf014f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.030+0000 7fbaf5996700 1 --2- 172.21.15.6:0/1510769636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaf006efc0 0x7fbaf014c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.030+0000 7fbaf5996700 1 --2- 172.21.15.6:0/1510769636 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbad0066f30 0x7fbad00693e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.030+0000 7fbaf5996700 1 --2- 172.21.15.6:0/1510769636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf015a5d0 0x7fbaf014f460 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.030+0000 7fbaf5996700 1 -- 172.21.15.6:0/1510769636 >> 172.21.15.6:0/1510769636 conn(0x7fbaf0069100 msgr2=0x7fbaf0157000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.030+0000 7fbaf5996700 1 -- 172.21.15.6:0/1510769636 shutdown_connections 2023-10-06T02:20:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.030+0000 7fbaf5996700 1 -- 172.21.15.6:0/1510769636 wait complete. 2023-10-06T02:20:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 33 2023-10-06T02:20:30.043 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump tree /a 0 2023-10-06T02:20:30.179 INFO:teuthology.orchestra.run.smithi006.stdout:[{"ino":1099511627776,"rdev":0,"ctime":"2023-10-06T02:20:29.465419+0000","btime":"2023-10-06T02:20:23.504918+0000","mode":16893,"uid":1000,"gid":1275,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2023-10-06T02:20:29.465419+0000","atime":"2023-10-06T02:20:23.504918+0000","time_warp_seq":0,"change_attr":3,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2023-10-06T02:20:29.465419+0000","num_files":0,"num_subdirs":1,"change_attr":3},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":2,"rsnaps":0,"rctime":"2023-10-06T02:20:29.465419+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":2,"rsnaps":0,"rctime":"2023-10-06T02:20:29.465419+0000"},"version":9,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"dirfrag":1,"caps":0,"dirtyparent":0,"dirty":1,"waiter":0,"authpin":0},"nref":2,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[{"path":"/a","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"7","version":"7","committing_version":"3","committed_version":"3","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"a/c","path_ino":1,"snap_first":18446744073709551606,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511627777,"remote_type":"","version":4,"projected_version":4,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]},{"path":"a/b","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":false,"is_remote":false,"is_null":true,"is_new":false,"inode":0,"remote_type":"","version":5,"projected_version":5,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":0,"dirty":1,"authpin":0},"nref":1,"lock":{},"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}]}] 2023-10-06T02:20:30.180 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 0, "rctime": "2023-10-06T02:20:29.465419+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "atime": "2023-10-06T02:20:23.504918+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2023-10-06T02:20:23.504918+0000", "change_attr": 3, "client_caps": [], "client_ranges": [], "ctime": "2023-10-06T02:20:29.465419+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "3", "committing_version": "3", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511627777, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "a/c", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 4, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 18446744073709551606, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} } }, { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 0, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": true, "is_primary": false, "is_remote": false, "lock": {}, "nref": 1, "path": "a/b", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 0, "lock": 0, "request": 0 }, "projected_version": 5, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 5, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/a", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 3, "mtime": "2023-10-06T02:20:29.465419+0000", "num_files": 0, "num_subdirs": 1, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1275, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2023-10-06T02:20:29.465419+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 2, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 0, "dirfrag": 1, "dirty": 1, "dirtyparent": 0, "lock": 0, "request": 0, "waiter": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2023-10-06T02:20:29.465419+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 9, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } ] 2023-10-06T02:20:30.181 DEBUG:tasks.cephfs.test_damage:[{'ino': 1099511627776, 'rdev': 0, 'ctime': '2023-10-06T02:20:29.465419+0000', 'btime': '2023-10-06T02:20:23.504918+0000', 'mode': 16893, 'uid': 1000, 'gid': 1275, 'nlink': 1, 'dir_layout': {'dir_hash': 2, 'unused1': 0, 'unused2': 0, 'unused3': 0}, 'layout': {'stripe_unit': 0, 'stripe_count': 0, 'object_size': 0, 'pool_id': -1, 'pool_ns': ''}, 'old_pools': [], 'size': 0, 'truncate_seq': 1, 'truncate_size': 18446744073709551615, 'truncate_from': 0, 'truncate_pending': 0, 'mtime': '2023-10-06T02:20:29.465419+0000', 'atime': '2023-10-06T02:20:23.504918+0000', 'time_warp_seq': 0, 'change_attr': 3, 'export_pin': -1, 'export_ephemeral_random_pin': 0, 'export_ephemeral_distributed_pin': False, 'client_ranges': [], 'dirstat': {'version': 0, 'mtime': '2023-10-06T02:20:29.465419+0000', 'num_files': 0, 'num_subdirs': 1, 'change_attr': 3}, 'rstat': {'version': 0, 'rbytes': 0, 'rfiles': 0, 'rsubdirs': 2, 'rsnaps': 0, 'rctime': '2023-10-06T02:20:29.465419+0000'}, 'accounted_rstat': {'version': 0, 'rbytes': 0, 'rfiles': 0, 'rsubdirs': 2, 'rsnaps': 0, 'rctime': '2023-10-06T02:20:29.465419+0000'}, 'version': 9, 'file_data_version': 0, 'xattr_version': 1, 'backtrace_version': 2, 'stray_prior_path': '', 'max_size_ever': 0, 'quota': {'max_bytes': 0, 'max_files': 0}, 'last_scrub_stamp': '0.000000', 'last_scrub_version': 0, 'symlink': '', 'xattrs': [], 'dirfragtree': {'splits': []}, 'old_inodes': [], 'oldest_snap': 18446744073709551614, 'damage_flags': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'request': 0, 'lock': 0, 'dirfrag': 1, 'caps': 0, 'dirtyparent': 0, 'dirty': 1, 'waiter': 0, 'authpin': 0}, 'nref': 2, 'versionlock': {'gather_set': [], 'state': 'lock', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'authlock': {}, 'linklock': {}, 'dirfragtreelock': {}, 'filelock': {}, 'xattrlock': {}, 'snaplock': {}, 'nestlock': {'gather_set': [], 'state': 'lock', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'flocklock': {}, 'policylock': {}, 'states': ['auth', 'dirty'], 'client_caps': [], 'loner': -1, 'want_loner': -1, 'mds_caps_wanted': [], 'dirfrags': [{'path': '/a', 'dirfrag': '0x10000000000', 'snapid_first': 2, 'projected_version': '7', 'version': '7', 'committing_version': '3', 'committed_version': '3', 'is_rep': False, 'dir_auth': '', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'child': 1, 'dirty': 1, 'authpin': 0}, 'nref': 2, 'dentries': [{'path': 'a/c', 'path_ino': 1, 'snap_first': 18446744073709551606, 'snap_last': 18446744073709551614, 'is_primary': True, 'is_remote': False, 'is_null': False, 'is_new': False, 'inode': 1099511627777, 'remote_type': '', 'version': 4, 'projected_version': 4, 'auth_pins': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'is_frozen': False, 'is_freezing': False, 'pins': {'request': 0, 'lock': 0, 'inodepin': 1, 'dirty': 1, 'authpin': 0}, 'nref': 2, 'lock': {}, 'versionlock': {'gather_set': [], 'state': 'lock', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'states': ['auth', 'dirty']}, {'path': 'a/b', 'path_ino': 1, 'snap_first': 2, 'snap_last': 18446744073709551614, 'is_primary': False, 'is_remote': False, 'is_null': True, 'is_new': False, 'inode': 0, 'remote_type': '', 'version': 5, 'projected_version': 5, 'auth_pins': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'is_frozen': False, 'is_freezing': False, 'pins': {'request': 0, 'lock': 0, 'inodepin': 0, 'dirty': 1, 'authpin': 0}, 'nref': 1, 'lock': {}, 'versionlock': {'gather_set': [], 'state': 'lock', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'states': ['auth', 'dirty']}]}]}] 2023-10-06T02:20:30.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:20:30.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.300+0000 7f4130e1d700 1 Processor -- start 2023-10-06T02:20:30.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.300+0000 7f4130e1d700 1 -- start start 2023-10-06T02:20:30.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.301+0000 7f4130e1d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f412c0cf1a0 0x7f412c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:30.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.301+0000 7f4130e1d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412c0b3560 con 0x7f412c159400 2023-10-06T02:20:30.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.301+0000 7f4130e1d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412c0cf6f0 con 0x7f412c1597d0 2023-10-06T02:20:30.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.301+0000 7f4130e1d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412c0cf9d0 con 0x7f412c0cf1a0 2023-10-06T02:20:30.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.301+0000 7f412b7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f412c159400 0x7f412c0ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46636/0 (socket says 172.21.15.6:46636) 2023-10-06T02:20:30.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.301+0000 7f412b7fe700 1 -- 172.21.15.6:0/1437980284 learned_addr learned my addr 172.21.15.6:0/1437980284 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.301+0000 7f412a7fc700 1 -- 172.21.15.6:0/1437980284 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384285967 0 0) 0x7f412c0b3560 con 0x7f412c159400 2023-10-06T02:20:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.301+0000 7f412a7fc700 1 -- 172.21.15.6:0/1437980284 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4114003570 con 0x7f412c159400 2023-10-06T02:20:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.301+0000 7f412affd700 1 --2- 172.21.15.6:0/1437980284 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f412c0cf1a0 0x7f412c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.301+0000 7f412a7fc700 1 -- 172.21.15.6:0/1437980284 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3020549633 0 0) 0x7f4114003570 con 0x7f412c159400 2023-10-06T02:20:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.301+0000 7f412a7fc700 1 -- 172.21.15.6:0/1437980284 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f412c0cf1a0 msgr2=0x7f412c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.301+0000 7f412a7fc700 1 --2- 172.21.15.6:0/1437980284 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f412c0cf1a0 0x7f412c0cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.301+0000 7f412a7fc700 1 -- 172.21.15.6:0/1437980284 >> v1:172.21.15.175:6789/0 conn(0x7f412c1597d0 legacy=0x7f412c0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.301+0000 7f412a7fc700 1 -- 172.21.15.6:0/1437980284 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c0b2f10 con 0x7f412c159400 2023-10-06T02:20:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.301+0000 7f412a7fc700 1 -- 172.21.15.6:0/1437980284 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f411c0015f0 con 0x7f412c159400 2023-10-06T02:20:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412a7fc700 1 -- 172.21.15.6:0/1437980284 >> v1:172.21.15.6:6789/0 conn(0x7f412c159400 legacy=0x7f412c0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412a7fc700 1 --2- 172.21.15.6:0/1437980284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4114003a90 0x7f4114003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:30.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412a7fc700 1 --2- 172.21.15.6:0/1437980284 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f412c0cf1a0 0x7f4114004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:30.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412a7fc700 1 --2- 172.21.15.6:0/1437980284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4114004d50 0x7f41140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:30.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412a7fc700 1 -- 172.21.15.6:0/1437980284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c0cf9d0 con 0x7f4114004d50 2023-10-06T02:20:30.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412a7fc700 1 -- 172.21.15.6:0/1437980284 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411400bb70 con 0x7f4114003a90 2023-10-06T02:20:30.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412a7fc700 1 -- 172.21.15.6:0/1437980284 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411400bd30 con 0x7f412c0cf1a0 2023-10-06T02:20:30.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412bfff700 1 --2- 172.21.15.6:0/1437980284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4114004d50 0x7f41140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:30.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412b7fe700 1 --2- 172.21.15.6:0/1437980284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4114003a90 0x7f4114003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:30.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412affd700 1 --2- 172.21.15.6:0/1437980284 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f412c0cf1a0 0x7f4114004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:30.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412bfff700 1 -- 172.21.15.6:0/1437980284 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f412c0cf1a0 msgr2=0x7f4114004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:30.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412bfff700 1 --2- 172.21.15.6:0/1437980284 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f412c0cf1a0 0x7f4114004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412bfff700 1 -- 172.21.15.6:0/1437980284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4114003a90 msgr2=0x7f4114003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:30.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412bfff700 1 --2- 172.21.15.6:0/1437980284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4114003a90 0x7f4114003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412bfff700 1 -- 172.21.15.6:0/1437980284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4114003570 con 0x7f4114004d50 2023-10-06T02:20:30.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412bfff700 1 --2- 172.21.15.6:0/1437980284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4114004d50 0x7f41140051c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f4124001f90 tx=0x7f4124001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a031b48e3dc58c8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:30.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412a7fc700 1 -- 172.21.15.6:0/1437980284 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4124001950 con 0x7f4114004d50 2023-10-06T02:20:30.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412a7fc700 1 -- 172.21.15.6:0/1437980284 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412400c8b0 con 0x7f4114004d50 2023-10-06T02:20:30.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.302+0000 7f412a7fc700 1 -- 172.21.15.6:0/1437980284 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412400cc50 con 0x7f4114004d50 2023-10-06T02:20:30.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.303+0000 7f4130e1d700 1 -- 172.21.15.6:0/1437980284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4114004d50 msgr2=0x7f41140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:30.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.303+0000 7f4130e1d700 1 --2- 172.21.15.6:0/1437980284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4114004d50 0x7f41140051c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f4124001f90 tx=0x7f4124001640 comp rx=0 tx=0).stop 2023-10-06T02:20:30.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.303+0000 7f412bfff700 1 -- 172.21.15.6:0/1437980284 reap_dead start 2023-10-06T02:20:30.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.303+0000 7f4130e1d700 1 -- 172.21.15.6:0/1437980284 shutdown_connections 2023-10-06T02:20:30.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.303+0000 7f4130e1d700 1 -- 172.21.15.6:0/1437980284 >> 172.21.15.6:0/1437980284 conn(0x7f412c06ac10 msgr2=0x7f412c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:30.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.303+0000 7f4130e1d700 1 -- 172.21.15.6:0/1437980284 shutdown_connections 2023-10-06T02:20:30.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.303+0000 7f4130e1d700 1 -- 172.21.15.6:0/1437980284 wait complete. 2023-10-06T02:20:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.304+0000 7f4130e1d700 1 Processor -- start 2023-10-06T02:20:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.304+0000 7f4130e1d700 1 -- start start 2023-10-06T02:20:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.305+0000 7f4130e1d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f412c169930 0x7f412c0c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.305+0000 7f4130e1d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f412c155640 0x7f412c169d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.305+0000 7f4130e1d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0c7ee0 0x7f412c16a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.305+0000 7f4130e1d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c16a780 con 0x7f412c0c7ee0 2023-10-06T02:20:30.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.305+0000 7f4130e1d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c0c5720 con 0x7f412c155640 2023-10-06T02:20:30.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.305+0000 7f4130e1d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412c0c5a00 con 0x7f412c169930 2023-10-06T02:20:30.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.305+0000 7f412bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0c7ee0 0x7f412c16a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:30.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.305+0000 7f412bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0c7ee0 0x7f412c16a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56466/0 (socket says 172.21.15.6:56466) 2023-10-06T02:20:30.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.305+0000 7f412bfff700 1 -- 172.21.15.6:0/479857101 learned_addr learned my addr 172.21.15.6:0/479857101 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:30.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.305+0000 7f412affd700 1 --2- 172.21.15.6:0/479857101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f412c155640 0x7f412c169d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:30.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.305+0000 7f412b7fe700 1 --2- 172.21.15.6:0/479857101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f412c169930 0x7f412c0c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:30.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.305+0000 7f412bfff700 1 -- 172.21.15.6:0/479857101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f412c169930 msgr2=0x7f412c0c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:30.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.305+0000 7f412bfff700 1 --2- 172.21.15.6:0/479857101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f412c169930 0x7f412c0c4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.305+0000 7f412bfff700 1 -- 172.21.15.6:0/479857101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f412c155640 msgr2=0x7f412c169d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:30.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.305+0000 7f412bfff700 1 --2- 172.21.15.6:0/479857101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f412c155640 0x7f412c169d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.305+0000 7f412bfff700 1 -- 172.21.15.6:0/479857101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c0c5ce0 con 0x7f412c0c7ee0 2023-10-06T02:20:30.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.306+0000 7f412bfff700 1 --2- 172.21.15.6:0/479857101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0c7ee0 0x7f412c16a240 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f411400bb40 tx=0x7f4124015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:30.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.306+0000 7f41137fe700 1 -- 172.21.15.6:0/479857101 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4124001950 con 0x7f412c0c7ee0 2023-10-06T02:20:30.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.306+0000 7f41137fe700 1 -- 172.21.15.6:0/479857101 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412400c6d0 con 0x7f412c0c7ee0 2023-10-06T02:20:30.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.306+0000 7f4130e1d700 1 -- 172.21.15.6:0/479857101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f412c0c5fc0 con 0x7f412c0c7ee0 2023-10-06T02:20:30.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.306+0000 7f41137fe700 1 -- 172.21.15.6:0/479857101 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4124006dd0 con 0x7f412c0c7ee0 2023-10-06T02:20:30.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.306+0000 7f4130e1d700 1 -- 172.21.15.6:0/479857101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f412c15bfe0 con 0x7f412c0c7ee0 2023-10-06T02:20:30.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.307+0000 7f4130e1d700 1 -- 172.21.15.6:0/479857101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f412c0c64e0 con 0x7f412c0c7ee0 2023-10-06T02:20:30.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.307+0000 7f41137fe700 1 -- 172.21.15.6:0/479857101 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4124019070 con 0x7f412c0c7ee0 2023-10-06T02:20:30.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.308+0000 7f41137fe700 1 --2- 172.21.15.6:0/479857101 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4118066f30 0x7f41180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:30.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.308+0000 7f41137fe700 1 -- 172.21.15.6:0/479857101 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4124085d20 con 0x7f412c0c7ee0 2023-10-06T02:20:30.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.308+0000 7f412b7fe700 1 --2- 172.21.15.6:0/479857101 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4118066f30 0x7f41180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:30.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.308+0000 7f412b7fe700 1 --2- 172.21.15.6:0/479857101 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4118066f30 0x7f41180693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f411c002e70 tx=0x7f411c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:30.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.312+0000 7f41137fe700 1 -- 172.21.15.6:0/479857101 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f412c0c64e0 con 0x7f412c0c7ee0 2023-10-06T02:20:30.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.552+0000 7f4130e1d700 1 -- 172.21.15.6:0/479857101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f412c0c64e0 con 0x7f412c0c7ee0 2023-10-06T02:20:30.553 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:20:30.553+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:20:30.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.557+0000 7f41137fe700 1 -- 172.21.15.6:0/479857101 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7f412c0c64e0 con 0x7f412c0c7ee0 2023-10-06T02:20:30.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.559+0000 7f4130e1d700 1 -- 172.21.15.6:0/479857101 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4118066f30 msgr2=0x7f41180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:30.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.559+0000 7f4130e1d700 1 --2- 172.21.15.6:0/479857101 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4118066f30 0x7f41180693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f411c002e70 tx=0x7f411c009040 comp rx=0 tx=0).stop 2023-10-06T02:20:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.559+0000 7f4130e1d700 1 -- 172.21.15.6:0/479857101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0c7ee0 msgr2=0x7f412c16a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.559+0000 7f4130e1d700 1 --2- 172.21.15.6:0/479857101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0c7ee0 0x7f412c16a240 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f411400bb40 tx=0x7f4124015000 comp rx=0 tx=0).stop 2023-10-06T02:20:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.559+0000 7f4130e1d700 1 -- 172.21.15.6:0/479857101 shutdown_connections 2023-10-06T02:20:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.559+0000 7f4130e1d700 1 --2- 172.21.15.6:0/479857101 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4118066f30 0x7f41180693e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.559+0000 7f4130e1d700 1 --2- 172.21.15.6:0/479857101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0c7ee0 0x7f412c16a240 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.559+0000 7f4130e1d700 1 --2- 172.21.15.6:0/479857101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f412c169930 0x7f412c0c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.559+0000 7f4130e1d700 1 --2- 172.21.15.6:0/479857101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f412c155640 0x7f412c169d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.559+0000 7f4130e1d700 1 -- 172.21.15.6:0/479857101 >> 172.21.15.6:0/479857101 conn(0x7f412c06ac10 msgr2=0x7f412c0b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:30.561 INFO:tasks.ceph.mds.a.smithi006.stderr: -3330> 2023-10-06T02:20:16.062+0000 7f68b7299700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:20:30.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.559+0000 7f4130e1d700 1 -- 172.21.15.6:0/479857101 shutdown_connections 2023-10-06T02:20:30.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.559+0000 7f4130e1d700 1 -- 172.21.15.6:0/479857101 wait complete. 2023-10-06T02:20:30.561 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:20:30.564 INFO:tasks.ceph.mds.a.smithi006.stderr: -279> 2023-10-06T02:20:29.465+0000 7f68b9a9e700 -1 mds.0.cache.den(0x10000000000 c) newly corrupt dentry to be committed: [dentry #0x1/a/c [fffffffffffffff6,head] auth NULL (dn xlock x=1 by 0x56229c56f800) (dversion lock w=1 last_client=5925) pv=4 v=3 ap=2 ino=(nil) state=1073741888|bottomlru | request=1 lock=2 authpin=1 0x56229c481680] 2023-10-06T02:20:30.573 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_rename_corrupt_dentry_first 2023-10-06T02:20:30.585 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:20:30.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.696+0000 7f2b7a1e4700 1 Processor -- start 2023-10-06T02:20:30.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.696+0000 7f2b7a1e4700 1 -- start start 2023-10-06T02:20:30.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.697+0000 7f2b7a1e4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b740d0400 0x7f2b740b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:30.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.697+0000 7f2b7a1e4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2b740d07d0 0x7f2b740b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:30.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.697+0000 7f2b7a1e4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b740b6170 con 0x7f2b740ccd40 2023-10-06T02:20:30.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.697+0000 7f2b7a1e4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7415dd40 con 0x7f2b740d07d0 2023-10-06T02:20:30.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.697+0000 7f2b7a1e4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7415e020 con 0x7f2b740d0400 2023-10-06T02:20:30.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.697+0000 7f2b72ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2b740ccd40 0x7f2b740cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46640/0 (socket says 172.21.15.6:46640) 2023-10-06T02:20:30.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.697+0000 7f2b72ffd700 1 -- 172.21.15.6:0/43013289 learned_addr learned my addr 172.21.15.6:0/43013289 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:30.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.697+0000 7f2b73fff700 1 --2- 172.21.15.6:0/43013289 >> v2:172.21.15.175:3300/0 conn(0x7f2b740d07d0 0x7f2b740b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:30.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.697+0000 7f2b737fe700 1 --2- 172.21.15.6:0/43013289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b740d0400 0x7f2b740b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:30.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.697+0000 7f2b727fc700 1 -- 172.21.15.6:0/43013289 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455051818 0 0) 0x7f2b740b6170 con 0x7f2b740ccd40 2023-10-06T02:20:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.697+0000 7f2b727fc700 1 -- 172.21.15.6:0/43013289 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b5c003570 con 0x7f2b740ccd40 2023-10-06T02:20:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.697+0000 7f2b73fff700 1 -- 172.21.15.6:0/43013289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b740d0400 msgr2=0x7f2b740b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.697+0000 7f2b73fff700 1 --2- 172.21.15.6:0/43013289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b740d0400 0x7f2b740b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.697+0000 7f2b73fff700 1 -- 172.21.15.6:0/43013289 >> v1:172.21.15.6:6789/0 conn(0x7f2b740ccd40 legacy=0x7f2b740cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.697+0000 7f2b73fff700 1 -- 172.21.15.6:0/43013289 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b740ceaa0 con 0x7f2b740d07d0 2023-10-06T02:20:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.698+0000 7f2b73fff700 1 --2- 172.21.15.6:0/43013289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b740d07d0 0x7f2b740b3aa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009e60 tx=0x7f2b6c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92ba5af4466bca3a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.698+0000 7f2b727fc700 1 -- 172.21.15.6:0/43013289 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c00e070 con 0x7f2b740d07d0 2023-10-06T02:20:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.698+0000 7f2b727fc700 1 -- 172.21.15.6:0/43013289 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c00bab0 con 0x7f2b740d07d0 2023-10-06T02:20:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.698+0000 7f2b727fc700 1 -- 172.21.15.6:0/43013289 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c00be70 con 0x7f2b740d07d0 2023-10-06T02:20:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.698+0000 7f2b7a1e4700 1 -- 172.21.15.6:0/43013289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b740d07d0 msgr2=0x7f2b740b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.698+0000 7f2b7a1e4700 1 --2- 172.21.15.6:0/43013289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b740d07d0 0x7f2b740b3aa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009e60 tx=0x7f2b6c009780 comp rx=0 tx=0).stop 2023-10-06T02:20:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.698+0000 7f2b7a1e4700 1 -- 172.21.15.6:0/43013289 shutdown_connections 2023-10-06T02:20:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.698+0000 7f2b7a1e4700 1 --2- 172.21.15.6:0/43013289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b740d07d0 0x7f2b740b3aa0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.698+0000 7f2b7a1e4700 1 --2- 172.21.15.6:0/43013289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b740d0400 0x7f2b740b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.698+0000 7f2b7a1e4700 1 -- 172.21.15.6:0/43013289 >> 172.21.15.6:0/43013289 conn(0x7f2b7406a220 msgr2=0x7f2b7406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:30.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.698+0000 7f2b7a1e4700 1 -- 172.21.15.6:0/43013289 shutdown_connections 2023-10-06T02:20:30.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.698+0000 7f2b7a1e4700 1 -- 172.21.15.6:0/43013289 wait complete. 2023-10-06T02:20:30.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.700+0000 7f2b7a1e4700 1 Processor -- start 2023-10-06T02:20:30.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.700+0000 7f2b7a1e4700 1 -- start start 2023-10-06T02:20:30.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.700+0000 7f2b7a1e4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b740ccd40 0x7f2b74152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:30.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.700+0000 7f2b7a1e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b740d0400 0x7f2b7415ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:30.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.700+0000 7f2b7a1e4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b740d07d0 0x7f2b7415b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:30.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.700+0000 7f2b7a1e4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7415a900 con 0x7f2b740d0400 2023-10-06T02:20:30.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.700+0000 7f2b7a1e4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7415b6e0 con 0x7f2b740d07d0 2023-10-06T02:20:30.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.700+0000 7f2b7a1e4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7415b9c0 con 0x7f2b740ccd40 2023-10-06T02:20:30.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.700+0000 7f2b72ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b740d0400 0x7f2b7415ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:30.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.700+0000 7f2b72ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b740d0400 0x7f2b7415ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56496/0 (socket says 172.21.15.6:56496) 2023-10-06T02:20:30.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.700+0000 7f2b72ffd700 1 -- 172.21.15.6:0/3253520564 learned_addr learned my addr 172.21.15.6:0/3253520564 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:30.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.701+0000 7f2b737fe700 1 --2- 172.21.15.6:0/3253520564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b740ccd40 0x7f2b74152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:30.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.701+0000 7f2b73fff700 1 --2- 172.21.15.6:0/3253520564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b740d07d0 0x7f2b7415b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:30.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.701+0000 7f2b72ffd700 1 -- 172.21.15.6:0/3253520564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b740ccd40 msgr2=0x7f2b74152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:30.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.701+0000 7f2b72ffd700 1 --2- 172.21.15.6:0/3253520564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b740ccd40 0x7f2b74152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.701+0000 7f2b72ffd700 1 -- 172.21.15.6:0/3253520564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b740d07d0 msgr2=0x7f2b7415b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:30.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.701+0000 7f2b72ffd700 1 --2- 172.21.15.6:0/3253520564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b740d07d0 0x7f2b7415b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.701+0000 7f2b72ffd700 1 -- 172.21.15.6:0/3253520564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c009a20 con 0x7f2b740d0400 2023-10-06T02:20:30.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.701+0000 7f2b72ffd700 1 --2- 172.21.15.6:0/3253520564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b740d0400 0x7f2b7415ab70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800c7c0 tx=0x7f2b68007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:30.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.701+0000 7f2b5b7fe700 1 -- 172.21.15.6:0/3253520564 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68005cd0 con 0x7f2b740d0400 2023-10-06T02:20:30.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.701+0000 7f2b5b7fe700 1 -- 172.21.15.6:0/3253520564 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b68005e30 con 0x7f2b740d0400 2023-10-06T02:20:30.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.701+0000 7f2b7a1e4700 1 -- 172.21.15.6:0/3253520564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7415bca0 con 0x7f2b740d0400 2023-10-06T02:20:30.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.701+0000 7f2b5b7fe700 1 -- 172.21.15.6:0/3253520564 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68007320 con 0x7f2b740d0400 2023-10-06T02:20:30.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.701+0000 7f2b7a1e4700 1 -- 172.21.15.6:0/3253520564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b74169900 con 0x7f2b740d0400 2023-10-06T02:20:30.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.702+0000 7f2b7a1e4700 1 -- 172.21.15.6:0/3253520564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b74088760 con 0x7f2b740d0400 2023-10-06T02:20:30.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.702+0000 7f2b5b7fe700 1 -- 172.21.15.6:0/3253520564 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b6801b3b0 con 0x7f2b740d0400 2023-10-06T02:20:30.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.703+0000 7f2b5b7fe700 1 --2- 172.21.15.6:0/3253520564 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2b60066f30 0x7f2b600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:30.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.703+0000 7f2b5b7fe700 1 -- 172.21.15.6:0/3253520564 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f2b68083ec0 con 0x7f2b740d0400 2023-10-06T02:20:30.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.703+0000 7f2b737fe700 1 --2- 172.21.15.6:0/3253520564 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2b60066f30 0x7f2b600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:30.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.704+0000 7f2b737fe700 1 --2- 172.21.15.6:0/3253520564 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2b60066f30 0x7f2b600693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009da0 tx=0x7f2b64009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:30.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.707+0000 7f2b5b7fe700 1 -- 172.21.15.6:0/3253520564 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b68050e40 con 0x7f2b740d0400 2023-10-06T02:20:30.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.903+0000 7f2b7a1e4700 1 -- 172.21.15.6:0/3253520564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"} v 0) v1 -- 0x7f2b740ced80 con 0x7f2b740d0400 2023-10-06T02:20:30.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.909+0000 7f2b5b7fe700 1 -- 172.21.15.6:0/3253520564 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"}]=0 v15) v1 ==== 121+0+0 (secure 0 0 0) 0x7f2b68017020 con 0x7f2b740d0400 2023-10-06T02:20:30.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.911+0000 7f2b7a1e4700 1 -- 172.21.15.6:0/3253520564 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2b60066f30 msgr2=0x7f2b600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:30.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.911+0000 7f2b7a1e4700 1 --2- 172.21.15.6:0/3253520564 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2b60066f30 0x7f2b600693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009da0 tx=0x7f2b64009120 comp rx=0 tx=0).stop 2023-10-06T02:20:30.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.911+0000 7f2b7a1e4700 1 -- 172.21.15.6:0/3253520564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b740d0400 msgr2=0x7f2b7415ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:30.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.911+0000 7f2b7a1e4700 1 --2- 172.21.15.6:0/3253520564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b740d0400 0x7f2b7415ab70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800c7c0 tx=0x7f2b68007e00 comp rx=0 tx=0).stop 2023-10-06T02:20:30.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.911+0000 7f2b7a1e4700 1 -- 172.21.15.6:0/3253520564 shutdown_connections 2023-10-06T02:20:30.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.911+0000 7f2b7a1e4700 1 --2- 172.21.15.6:0/3253520564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b740d07d0 0x7f2b7415b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.911+0000 7f2b7a1e4700 1 --2- 172.21.15.6:0/3253520564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b740ccd40 0x7f2b74152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.911+0000 7f2b7a1e4700 1 --2- 172.21.15.6:0/3253520564 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2b60066f30 0x7f2b600693e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.911+0000 7f2b7a1e4700 1 --2- 172.21.15.6:0/3253520564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b740d0400 0x7f2b7415ab70 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:30.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.911+0000 7f2b7a1e4700 1 -- 172.21.15.6:0/3253520564 >> 172.21.15.6:0/3253520564 conn(0x7f2b7406a220 msgr2=0x7f2b74153d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:30.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.911+0000 7f2b7a1e4700 1 -- 172.21.15.6:0/3253520564 shutdown_connections 2023-10-06T02:20:30.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:30.911+0000 7f2b7a1e4700 1 -- 172.21.15.6:0/3253520564 wait complete. 2023-10-06T02:20:30.924 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_abort_on_newly_corrupt_dentry False 2023-10-06T02:20:31.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.086+0000 7f83d8976700 1 Processor -- start 2023-10-06T02:20:31.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.086+0000 7f83d8976700 1 -- start start 2023-10-06T02:20:31.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.087+0000 7f83d8976700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83d413f5e0 0x7f83d40c9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.087+0000 7f83d8976700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83d40b1370 0x7f83d406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.087+0000 7f83d8976700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d40af750 con 0x7f83d413f9b0 2023-10-06T02:20:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.087+0000 7f83d8976700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d40aeea0 con 0x7f83d413f5e0 2023-10-06T02:20:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.087+0000 7f83d8976700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d406b6b0 con 0x7f83d40b1370 2023-10-06T02:20:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.087+0000 7f83d2d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83d413f5e0 0x7f83d40c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.087+0000 7f83d259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f83d413f9b0 0x7f83d40b0c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46650/0 (socket says 172.21.15.6:46650) 2023-10-06T02:20:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.087+0000 7f83d259c700 1 -- 172.21.15.6:0/942818988 learned_addr learned my addr 172.21.15.6:0/942818988 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.087+0000 7f83d359e700 1 --2- 172.21.15.6:0/942818988 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83d40b1370 0x7f83d406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.087+0000 7f83d2d9d700 1 -- 172.21.15.6:0/942818988 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83d40b1370 msgr2=0x7f83d406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.087+0000 7f83d2d9d700 1 --2- 172.21.15.6:0/942818988 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83d40b1370 0x7f83d406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.087+0000 7f83d2d9d700 1 -- 172.21.15.6:0/942818988 >> v1:172.21.15.6:6789/0 conn(0x7f83d413f9b0 legacy=0x7f83d40b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.087+0000 7f83d2d9d700 1 -- 172.21.15.6:0/942818988 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d40af100 con 0x7f83d413f5e0 2023-10-06T02:20:31.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.087+0000 7f83d1d9b700 1 -- 172.21.15.6:0/942818988 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148387824 0 0) 0x7f83d40af750 con 0x7f83d413f9b0 2023-10-06T02:20:31.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.087+0000 7f83d2d9d700 1 --2- 172.21.15.6:0/942818988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d413f5e0 0x7f83d40c9640 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009e60 tx=0x7f83c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c417b906d2a70f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:31.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.088+0000 7f83d1d9b700 1 -- 172.21.15.6:0/942818988 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c400e070 con 0x7f83d413f5e0 2023-10-06T02:20:31.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.088+0000 7f83d1d9b700 1 -- 172.21.15.6:0/942818988 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c400bc30 con 0x7f83d413f5e0 2023-10-06T02:20:31.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.088+0000 7f83d1d9b700 1 -- 172.21.15.6:0/942818988 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c4012430 con 0x7f83d413f5e0 2023-10-06T02:20:31.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.088+0000 7f83d8976700 1 -- 172.21.15.6:0/942818988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d413f5e0 msgr2=0x7f83d40c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:31.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.088+0000 7f83d8976700 1 --2- 172.21.15.6:0/942818988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d413f5e0 0x7f83d40c9640 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009e60 tx=0x7f83c4009780 comp rx=0 tx=0).stop 2023-10-06T02:20:31.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.088+0000 7f83d8976700 1 -- 172.21.15.6:0/942818988 shutdown_connections 2023-10-06T02:20:31.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.088+0000 7f83d8976700 1 --2- 172.21.15.6:0/942818988 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83d40b1370 0x7f83d406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:31.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.088+0000 7f83d8976700 1 --2- 172.21.15.6:0/942818988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d413f5e0 0x7f83d40c9640 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:31.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.088+0000 7f83d8976700 1 -- 172.21.15.6:0/942818988 >> 172.21.15.6:0/942818988 conn(0x7f83d4069150 msgr2=0x7f83d40ad720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:31.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.088+0000 7f83d8976700 1 -- 172.21.15.6:0/942818988 shutdown_connections 2023-10-06T02:20:31.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.088+0000 7f83d8976700 1 -- 172.21.15.6:0/942818988 wait complete. 2023-10-06T02:20:31.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.089+0000 7f83d8976700 1 Processor -- start 2023-10-06T02:20:31.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.089+0000 7f83d8976700 1 -- start start 2023-10-06T02:20:31.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.090+0000 7f83d8976700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83d40b1370 0x7f83d4136da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:31.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.090+0000 7f83d8976700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83d413f5e0 0x7f83d4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:31.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.090+0000 7f83d8976700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d413f9b0 0x7f83d40acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:31.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.090+0000 7f83d8976700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d4135ad0 con 0x7f83d413f9b0 2023-10-06T02:20:31.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.090+0000 7f83d8976700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d4136910 con 0x7f83d413f5e0 2023-10-06T02:20:31.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.090+0000 7f83d8976700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d4135d00 con 0x7f83d40b1370 2023-10-06T02:20:31.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.090+0000 7f83d359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d413f9b0 0x7f83d40acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:31.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.090+0000 7f83d359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d413f9b0 0x7f83d40acfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56506/0 (socket says 172.21.15.6:56506) 2023-10-06T02:20:31.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.090+0000 7f83d359e700 1 -- 172.21.15.6:0/901714857 learned_addr learned my addr 172.21.15.6:0/901714857 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:31.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.090+0000 7f83d2d9d700 1 --2- 172.21.15.6:0/901714857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83d40b1370 0x7f83d4136da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:31.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.090+0000 7f83d259c700 1 --2- 172.21.15.6:0/901714857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83d413f5e0 0x7f83d4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:31.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.090+0000 7f83d359e700 1 -- 172.21.15.6:0/901714857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83d40b1370 msgr2=0x7f83d4136da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:31.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.090+0000 7f83d359e700 1 --2- 172.21.15.6:0/901714857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83d40b1370 0x7f83d4136da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:31.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.091+0000 7f83d359e700 1 -- 172.21.15.6:0/901714857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83d413f5e0 msgr2=0x7f83d4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:31.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.091+0000 7f83d359e700 1 --2- 172.21.15.6:0/901714857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83d413f5e0 0x7f83d4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:31.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.091+0000 7f83d359e700 1 -- 172.21.15.6:0/901714857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c4009a20 con 0x7f83d413f9b0 2023-10-06T02:20:31.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.091+0000 7f83d359e700 1 --2- 172.21.15.6:0/901714857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d413f9b0 0x7f83d40acfa0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00d860 tx=0x7f83cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:31.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.091+0000 7f83caffd700 1 -- 172.21.15.6:0/901714857 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc0125f0 con 0x7f83d413f9b0 2023-10-06T02:20:31.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.091+0000 7f83caffd700 1 -- 172.21.15.6:0/901714857 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83cc012770 con 0x7f83d413f9b0 2023-10-06T02:20:31.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.091+0000 7f83d8976700 1 -- 172.21.15.6:0/901714857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d4135fe0 con 0x7f83d413f9b0 2023-10-06T02:20:31.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.091+0000 7f83caffd700 1 -- 172.21.15.6:0/901714857 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc012b30 con 0x7f83d413f9b0 2023-10-06T02:20:31.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.091+0000 7f83d8976700 1 -- 172.21.15.6:0/901714857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d41365a0 con 0x7f83d413f9b0 2023-10-06T02:20:31.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.092+0000 7f83d8976700 1 -- 172.21.15.6:0/901714857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d4136a80 con 0x7f83d413f9b0 2023-10-06T02:20:31.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.092+0000 7f83caffd700 1 -- 172.21.15.6:0/901714857 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83cc01e460 con 0x7f83d413f9b0 2023-10-06T02:20:31.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.093+0000 7f83caffd700 1 --2- 172.21.15.6:0/901714857 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83b4066f30 0x7f83b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:31.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.093+0000 7f83caffd700 1 -- 172.21.15.6:0/901714857 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f83cc084dc0 con 0x7f83d413f9b0 2023-10-06T02:20:31.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.093+0000 7f83d2d9d700 1 --2- 172.21.15.6:0/901714857 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83b4066f30 0x7f83b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:31.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.093+0000 7f83d2d9d700 1 --2- 172.21.15.6:0/901714857 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83b4066f30 0x7f83b40693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009e60 tx=0x7f83c4019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:31.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.097+0000 7f83caffd700 1 -- 172.21.15.6:0/901714857 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83cc051d40 con 0x7f83d413f9b0 2023-10-06T02:20:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.292+0000 7f83d8976700 1 -- 172.21.15.6:0/901714857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_abort_on_newly_corrupt_dentry}] v 0) v1 -- 0x7f83d4064aa0 con 0x7f83d413f9b0 2023-10-06T02:20:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.293+0000 7f83caffd700 1 -- 172.21.15.6:0/901714857 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_abort_on_newly_corrupt_dentry}]=0 v15)=0 v15) v1 ==== 135+0+0 (secure 0 0 0) 0x7f83cc055360 con 0x7f83d413f9b0 2023-10-06T02:20:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.294+0000 7f83d8976700 1 -- 172.21.15.6:0/901714857 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83b4066f30 msgr2=0x7f83b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.294+0000 7f83d8976700 1 --2- 172.21.15.6:0/901714857 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83b4066f30 0x7f83b40693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009e60 tx=0x7f83c4019000 comp rx=0 tx=0).stop 2023-10-06T02:20:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.294+0000 7f83d8976700 1 -- 172.21.15.6:0/901714857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d413f9b0 msgr2=0x7f83d40acfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.294+0000 7f83d8976700 1 --2- 172.21.15.6:0/901714857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d413f9b0 0x7f83d40acfa0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00d860 tx=0x7f83cc008040 comp rx=0 tx=0).stop 2023-10-06T02:20:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.295+0000 7f83d8976700 1 -- 172.21.15.6:0/901714857 shutdown_connections 2023-10-06T02:20:31.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.295+0000 7f83d8976700 1 --2- 172.21.15.6:0/901714857 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83b4066f30 0x7f83b40693e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:31.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.295+0000 7f83d8976700 1 --2- 172.21.15.6:0/901714857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d413f9b0 0x7f83d40acfa0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:31.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.295+0000 7f83d8976700 1 --2- 172.21.15.6:0/901714857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83d40b1370 0x7f83d4136da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:31.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.295+0000 7f83d8976700 1 --2- 172.21.15.6:0/901714857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83d413f5e0 0x7f83d4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:31.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.295+0000 7f83d8976700 1 -- 172.21.15.6:0/901714857 >> 172.21.15.6:0/901714857 conn(0x7f83d4069150 msgr2=0x7f83d413cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:31.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.295+0000 7f83d8976700 1 -- 172.21.15.6:0/901714857 shutdown_connections 2023-10-06T02:20:31.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.295+0000 7f83d8976700 1 -- 172.21.15.6:0/901714857 wait complete. 2023-10-06T02:20:31.307 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:20:31.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.429+0000 7f7365bd7700 1 Processor -- start 2023-10-06T02:20:31.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.429+0000 7f7365bd7700 1 -- start start 2023-10-06T02:20:31.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f7365bd7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f736006a900 0x7f73600b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:31.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f7365bd7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73600b4e20 con 0x7f73600cc370 2023-10-06T02:20:31.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f7365bd7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73600b4570 con 0x7f7360159190 2023-10-06T02:20:31.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f7365bd7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73600cd5a0 con 0x7f736006a900 2023-10-06T02:20:31.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f73600cc370 0x7f736006a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46662/0 (socket says 172.21.15.6:46662) 2023-10-06T02:20:31.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735effd700 1 -- 172.21.15.6:0/2647120732 learned_addr learned my addr 172.21.15.6:0/2647120732 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:31.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735e7fc700 1 -- 172.21.15.6:0/2647120732 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328726810 0 0) 0x7f73600b4e20 con 0x7f73600cc370 2023-10-06T02:20:31.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735ffff700 1 --2- 172.21.15.6:0/2647120732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f736006a900 0x7f73600b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:31.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735e7fc700 1 -- 172.21.15.6:0/2647120732 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7348003570 con 0x7f73600cc370 2023-10-06T02:20:31.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735e7fc700 1 -- 172.21.15.6:0/2647120732 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4161248802 0 0) 0x7f7348003570 con 0x7f73600cc370 2023-10-06T02:20:31.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735e7fc700 1 -- 172.21.15.6:0/2647120732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f736006a900 msgr2=0x7f73600b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:31.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735e7fc700 1 --2- 172.21.15.6:0/2647120732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f736006a900 0x7f73600b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:31.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735e7fc700 1 -- 172.21.15.6:0/2647120732 >> v1:172.21.15.175:6789/0 conn(0x7f7360159190 legacy=0x7f73600ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:31.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735e7fc700 1 -- 172.21.15.6:0/2647120732 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73600cd2c0 con 0x7f73600cc370 2023-10-06T02:20:31.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735e7fc700 1 -- 172.21.15.6:0/2647120732 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f7354001470 con 0x7f73600cc370 2023-10-06T02:20:31.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735e7fc700 1 -- 172.21.15.6:0/2647120732 >> v1:172.21.15.6:6789/0 conn(0x7f73600cc370 legacy=0x7f736006a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:31.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735e7fc700 1 --2- 172.21.15.6:0/2647120732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7348003a90 0x7f7348003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:31.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735e7fc700 1 --2- 172.21.15.6:0/2647120732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7348004810 0x7f7348004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:31.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735e7fc700 1 --2- 172.21.15.6:0/2647120732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f736006a900 0x7f7348005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:31.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735e7fc700 1 -- 172.21.15.6:0/2647120732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73600cd5a0 con 0x7f7348003a90 2023-10-06T02:20:31.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735e7fc700 1 -- 172.21.15.6:0/2647120732 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734800bb90 con 0x7f7348004810 2023-10-06T02:20:31.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735e7fc700 1 -- 172.21.15.6:0/2647120732 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734800bd50 con 0x7f736006a900 2023-10-06T02:20:31.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.430+0000 7f735f7fe700 1 --2- 172.21.15.6:0/2647120732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7348003a90 0x7f7348003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:31.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.431+0000 7f735effd700 1 --2- 172.21.15.6:0/2647120732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7348004810 0x7f7348004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:31.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.431+0000 7f735ffff700 1 --2- 172.21.15.6:0/2647120732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f736006a900 0x7f7348005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:31.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.431+0000 7f735f7fe700 1 -- 172.21.15.6:0/2647120732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f736006a900 msgr2=0x7f7348005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:31.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.431+0000 7f735f7fe700 1 --2- 172.21.15.6:0/2647120732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f736006a900 0x7f7348005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:31.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.431+0000 7f735f7fe700 1 -- 172.21.15.6:0/2647120732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7348004810 msgr2=0x7f7348004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:31.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.431+0000 7f735f7fe700 1 --2- 172.21.15.6:0/2647120732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7348004810 0x7f7348004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:31.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.431+0000 7f735f7fe700 1 -- 172.21.15.6:0/2647120732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7348003570 con 0x7f7348003a90 2023-10-06T02:20:31.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.431+0000 7f735ffff700 1 --2- 172.21.15.6:0/2647120732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f736006a900 0x7f7348005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:31.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.431+0000 7f735f7fe700 1 --2- 172.21.15.6:0/2647120732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7348003a90 0x7f7348003ec0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f73500018b0 tx=0x7f7350007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fac2eaaa3b049e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:31.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.431+0000 7f735e7fc700 1 -- 172.21.15.6:0/2647120732 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7350012420 con 0x7f7348003a90 2023-10-06T02:20:31.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.431+0000 7f735e7fc700 1 -- 172.21.15.6:0/2647120732 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7350012580 con 0x7f7348003a90 2023-10-06T02:20:31.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.431+0000 7f735e7fc700 1 -- 172.21.15.6:0/2647120732 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7350012920 con 0x7f7348003a90 2023-10-06T02:20:31.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.431+0000 7f7365bd7700 1 -- 172.21.15.6:0/2647120732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7348003a90 msgr2=0x7f7348003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:31.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.431+0000 7f7365bd7700 1 --2- 172.21.15.6:0/2647120732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7348003a90 0x7f7348003ec0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f73500018b0 tx=0x7f7350007d30 comp rx=0 tx=0).stop 2023-10-06T02:20:31.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.431+0000 7f735ffff700 1 -- 172.21.15.6:0/2647120732 reap_dead start 2023-10-06T02:20:31.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.431+0000 7f7365bd7700 1 -- 172.21.15.6:0/2647120732 shutdown_connections 2023-10-06T02:20:31.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.431+0000 7f7365bd7700 1 -- 172.21.15.6:0/2647120732 >> 172.21.15.6:0/2647120732 conn(0x7f7360087340 msgr2=0x7f7360087710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:31.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.432+0000 7f7365bd7700 1 -- 172.21.15.6:0/2647120732 shutdown_connections 2023-10-06T02:20:31.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.432+0000 7f7365bd7700 1 -- 172.21.15.6:0/2647120732 wait complete. 2023-10-06T02:20:31.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.433+0000 7f7365bd7700 1 Processor -- start 2023-10-06T02:20:31.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.433+0000 7f7365bd7700 1 -- start start 2023-10-06T02:20:31.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.433+0000 7f7365bd7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7348003a90 0x7f73600cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:31.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.433+0000 7f7365bd7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73600cb1a0 0x7f7360156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:31.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f7365bd7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73601569c0 0x7f7360156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:31.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f7365bd7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7360169bf0 con 0x7f73601569c0 2023-10-06T02:20:31.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f7365bd7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73600cc010 con 0x7f73600cb1a0 2023-10-06T02:20:31.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f7365bd7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73600cb770 con 0x7f7348003a90 2023-10-06T02:20:31.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f735ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73601569c0 0x7f7360156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:31.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f735ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73601569c0 0x7f7360156e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56524/0 (socket says 172.21.15.6:56524) 2023-10-06T02:20:31.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f735ffff700 1 -- 172.21.15.6:0/2845837261 learned_addr learned my addr 172.21.15.6:0/2845837261 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:31.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f735f7fe700 1 --2- 172.21.15.6:0/2845837261 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7348003a90 0x7f73600cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:31.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f735effd700 1 --2- 172.21.15.6:0/2845837261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73600cb1a0 0x7f7360156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:31.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f735ffff700 1 -- 172.21.15.6:0/2845837261 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7348003a90 msgr2=0x7f73600cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:31.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f735ffff700 1 --2- 172.21.15.6:0/2845837261 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7348003a90 0x7f73600cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:31.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f735ffff700 1 -- 172.21.15.6:0/2845837261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73600cb1a0 msgr2=0x7f7360156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:31.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f735ffff700 1 --2- 172.21.15.6:0/2845837261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73600cb1a0 0x7f7360156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:31.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f735ffff700 1 -- 172.21.15.6:0/2845837261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73600cba50 con 0x7f73601569c0 2023-10-06T02:20:31.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f735ffff700 1 --2- 172.21.15.6:0/2845837261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73601569c0 0x7f7360156e30 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f73600d13d0 tx=0x7f735800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:31.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f73477fe700 1 -- 172.21.15.6:0/2845837261 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735801b070 con 0x7f73601569c0 2023-10-06T02:20:31.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f73477fe700 1 -- 172.21.15.6:0/2845837261 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735800f040 con 0x7f73601569c0 2023-10-06T02:20:31.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f73477fe700 1 -- 172.21.15.6:0/2845837261 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735800e050 con 0x7f73601569c0 2023-10-06T02:20:31.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f7365bd7700 1 -- 172.21.15.6:0/2845837261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73600cbd30 con 0x7f73601569c0 2023-10-06T02:20:31.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.434+0000 7f7365bd7700 1 -- 172.21.15.6:0/2845837261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7360153bc0 con 0x7f73601569c0 2023-10-06T02:20:31.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.435+0000 7f7365bd7700 1 -- 172.21.15.6:0/2845837261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7360088a20 con 0x7f73601569c0 2023-10-06T02:20:31.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.436+0000 7f73477fe700 1 -- 172.21.15.6:0/2845837261 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7358003020 con 0x7f73601569c0 2023-10-06T02:20:31.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.436+0000 7f73477fe700 1 --2- 172.21.15.6:0/2845837261 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f734c066f30 0x7f734c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:31.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.436+0000 7f73477fe700 1 -- 172.21.15.6:0/2845837261 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7358084b40 con 0x7f73601569c0 2023-10-06T02:20:31.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.436+0000 7f735f7fe700 1 --2- 172.21.15.6:0/2845837261 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f734c066f30 0x7f734c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:31.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.437+0000 7f735f7fe700 1 --2- 172.21.15.6:0/2845837261 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f734c066f30 0x7f734c0693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7350001690 tx=0x7f7350015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:31.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.440+0000 7f73477fe700 1 -- 172.21.15.6:0/2845837261 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7358051ac0 con 0x7f73601569c0 2023-10-06T02:20:31.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:31.681+0000 7f7365bd7700 1 -- 172.21.15.6:0/2845837261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f73600b47d0 con 0x7f73601569c0 2023-10-06T02:20:32.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.565+0000 7f73477fe700 1 -- 172.21.15.6:0/2845837261 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v36) v1 ==== 162+0+0 (secure 0 0 0) 0x7f73580550e0 con 0x7f73601569c0 2023-10-06T02:20:32.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.568+0000 7f7365bd7700 1 -- 172.21.15.6:0/2845837261 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f734c066f30 msgr2=0x7f734c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:32.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.568+0000 7f7365bd7700 1 --2- 172.21.15.6:0/2845837261 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f734c066f30 0x7f734c0693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7350001690 tx=0x7f7350015000 comp rx=0 tx=0).stop 2023-10-06T02:20:32.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.568+0000 7f7365bd7700 1 -- 172.21.15.6:0/2845837261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73601569c0 msgr2=0x7f7360156e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:32.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.568+0000 7f7365bd7700 1 --2- 172.21.15.6:0/2845837261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73601569c0 0x7f7360156e30 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f73600d13d0 tx=0x7f735800b040 comp rx=0 tx=0).stop 2023-10-06T02:20:32.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.568+0000 7f7365bd7700 1 -- 172.21.15.6:0/2845837261 shutdown_connections 2023-10-06T02:20:32.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.568+0000 7f7365bd7700 1 --2- 172.21.15.6:0/2845837261 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f734c066f30 0x7f734c0693e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:32.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.568+0000 7f7365bd7700 1 --2- 172.21.15.6:0/2845837261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73601569c0 0x7f7360156e30 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:32.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.568+0000 7f7365bd7700 1 --2- 172.21.15.6:0/2845837261 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7348003a90 0x7f73600cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:32.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.568+0000 7f7365bd7700 1 --2- 172.21.15.6:0/2845837261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73600cb1a0 0x7f7360156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:32.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.568+0000 7f7365bd7700 1 -- 172.21.15.6:0/2845837261 >> 172.21.15.6:0/2845837261 conn(0x7f7360087340 msgr2=0x7f736015b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:32.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.568+0000 7f7365bd7700 1 -- 172.21.15.6:0/2845837261 shutdown_connections 2023-10-06T02:20:32.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.568+0000 7f7365bd7700 1 -- 172.21.15.6:0/2845837261 wait complete. 2023-10-06T02:20:32.570 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:20:32.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:20:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.711+0000 7f165fa91700 1 Processor -- start 2023-10-06T02:20:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.711+0000 7f165fa91700 1 -- start start 2023-10-06T02:20:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.712+0000 7f165fa91700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16581593f0 0x7f165806de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.712+0000 7f165fa91700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f165806adf0 0x7f165806e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.712+0000 7f165fa91700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1658069950 con 0x7f16581597c0 2023-10-06T02:20:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.712+0000 7f165fa91700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16580b2850 con 0x7f165806adf0 2023-10-06T02:20:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.712+0000 7f165fa91700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16580b1fb0 con 0x7f16581593f0 2023-10-06T02:20:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.712+0000 7f165e02e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f165806adf0 0x7f165806e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.712+0000 7f165d02c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f16581597c0 0x7f165815d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46674/0 (socket says 172.21.15.6:46674) 2023-10-06T02:20:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.712+0000 7f165d02c700 1 -- 172.21.15.6:0/233947845 learned_addr learned my addr 172.21.15.6:0/233947845 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.712+0000 7f165d82d700 1 --2- 172.21.15.6:0/233947845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16581593f0 0x7f165806de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.712+0000 7f165e02e700 1 -- 172.21.15.6:0/233947845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16581593f0 msgr2=0x7f165806de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.712+0000 7f165e02e700 1 --2- 172.21.15.6:0/233947845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16581593f0 0x7f165806de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.712+0000 7f165e02e700 1 -- 172.21.15.6:0/233947845 >> v1:172.21.15.6:6789/0 conn(0x7f16581597c0 legacy=0x7f165815d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.712+0000 7f165c82b700 1 -- 172.21.15.6:0/233947845 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149479192 0 0) 0x7f1658069950 con 0x7f16581597c0 2023-10-06T02:20:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.712+0000 7f165e02e700 1 -- 172.21.15.6:0/233947845 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16580b2290 con 0x7f165806adf0 2023-10-06T02:20:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.712+0000 7f165d82d700 1 --2- 172.21.15.6:0/233947845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16581593f0 0x7f165806de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.712+0000 7f165e02e700 1 --2- 172.21.15.6:0/233947845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f165806adf0 0x7f165806e350 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1650009e60 tx=0x7f1650009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9397889d34ef59c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.713+0000 7f165c82b700 1 -- 172.21.15.6:0/233947845 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165000e070 con 0x7f165806adf0 2023-10-06T02:20:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.713+0000 7f165c82b700 1 -- 172.21.15.6:0/233947845 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165000bc30 con 0x7f165806adf0 2023-10-06T02:20:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.713+0000 7f165c82b700 1 -- 172.21.15.6:0/233947845 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650012430 con 0x7f165806adf0 2023-10-06T02:20:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.713+0000 7f165fa91700 1 -- 172.21.15.6:0/233947845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f165806adf0 msgr2=0x7f165806e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.713+0000 7f165fa91700 1 --2- 172.21.15.6:0/233947845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f165806adf0 0x7f165806e350 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1650009e60 tx=0x7f1650009780 comp rx=0 tx=0).stop 2023-10-06T02:20:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.713+0000 7f165fa91700 1 -- 172.21.15.6:0/233947845 shutdown_connections 2023-10-06T02:20:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.713+0000 7f165fa91700 1 --2- 172.21.15.6:0/233947845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f165806adf0 0x7f165806e350 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.713+0000 7f165fa91700 1 --2- 172.21.15.6:0/233947845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16581593f0 0x7f165806de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.713+0000 7f165fa91700 1 -- 172.21.15.6:0/233947845 >> 172.21.15.6:0/233947845 conn(0x7f165806cff0 msgr2=0x7f16580afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.713+0000 7f165fa91700 1 -- 172.21.15.6:0/233947845 shutdown_connections 2023-10-06T02:20:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.713+0000 7f165fa91700 1 -- 172.21.15.6:0/233947845 wait complete. 2023-10-06T02:20:32.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.714+0000 7f165fa91700 1 Processor -- start 2023-10-06T02:20:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.714+0000 7f165fa91700 1 -- start start 2023-10-06T02:20:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165fa91700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f165806adf0 0x7f1658143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165fa91700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16581593f0 0x7f16580c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165fa91700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16581597c0 0x7f16580cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165fa91700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1658143d90 con 0x7f16581597c0 2023-10-06T02:20:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165fa91700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16580c8f80 con 0x7f16581593f0 2023-10-06T02:20:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165fa91700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16580c9260 con 0x7f165806adf0 2023-10-06T02:20:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165e02e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16581597c0 0x7f16580cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165e02e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16581597c0 0x7f16580cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56542/0 (socket says 172.21.15.6:56542) 2023-10-06T02:20:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165e02e700 1 -- 172.21.15.6:0/2094203525 learned_addr learned my addr 172.21.15.6:0/2094203525 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165d82d700 1 --2- 172.21.15.6:0/2094203525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f165806adf0 0x7f1658143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165d02c700 1 --2- 172.21.15.6:0/2094203525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16581593f0 0x7f16580c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165e02e700 1 -- 172.21.15.6:0/2094203525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f165806adf0 msgr2=0x7f1658143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165e02e700 1 --2- 172.21.15.6:0/2094203525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f165806adf0 0x7f1658143850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165e02e700 1 -- 172.21.15.6:0/2094203525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16581593f0 msgr2=0x7f16580c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165e02e700 1 --2- 172.21.15.6:0/2094203525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16581593f0 0x7f16580c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165e02e700 1 -- 172.21.15.6:0/2094203525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1650009a20 con 0x7f16581597c0 2023-10-06T02:20:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165d82d700 1 --2- 172.21.15.6:0/2094203525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f165806adf0 0x7f1658143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.715+0000 7f165d02c700 1 --2- 172.21.15.6:0/2094203525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16581593f0 0x7f16580c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.716+0000 7f165e02e700 1 --2- 172.21.15.6:0/2094203525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16581597c0 0x7f16580cdf80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f165806fe40 tx=0x7f1650019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.716+0000 7f164dffb700 1 -- 172.21.15.6:0/2094203525 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650012e50 con 0x7f16581597c0 2023-10-06T02:20:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.716+0000 7f164dffb700 1 -- 172.21.15.6:0/2094203525 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165001d630 con 0x7f16581597c0 2023-10-06T02:20:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.716+0000 7f165fa91700 1 -- 172.21.15.6:0/2094203525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16580c9540 con 0x7f16581597c0 2023-10-06T02:20:32.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.716+0000 7f164dffb700 1 -- 172.21.15.6:0/2094203525 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165001d9f0 con 0x7f16581597c0 2023-10-06T02:20:32.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.716+0000 7f165fa91700 1 -- 172.21.15.6:0/2094203525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16580c9b00 con 0x7f16581597c0 2023-10-06T02:20:32.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.717+0000 7f165fa91700 1 -- 172.21.15.6:0/2094203525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165806d3f0 con 0x7f16581597c0 2023-10-06T02:20:32.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.717+0000 7f164dffb700 1 -- 172.21.15.6:0/2094203525 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1650024070 con 0x7f16581597c0 2023-10-06T02:20:32.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.718+0000 7f164dffb700 1 --2- 172.21.15.6:0/2094203525 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f163c066f30 0x7f163c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:32.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.718+0000 7f164dffb700 1 -- 172.21.15.6:0/2094203525 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f1650086f60 con 0x7f16581597c0 2023-10-06T02:20:32.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.718+0000 7f165d82d700 1 --2- 172.21.15.6:0/2094203525 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f163c066f30 0x7f163c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:32.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.719+0000 7f165d82d700 1 --2- 172.21.15.6:0/2094203525 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f163c066f30 0x7f163c0693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1654006f00 tx=0x7f1654008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:32.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.722+0000 7f164dffb700 1 -- 172.21.15.6:0/2094203525 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1650053f20 con 0x7f16581597c0 2023-10-06T02:20:32.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.958+0000 7f165fa91700 1 -- 172.21.15.6:0/2094203525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f165815c090 con 0x7f16581597c0 2023-10-06T02:20:32.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.959+0000 7f164dffb700 1 -- 172.21.15.6:0/2094203525 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f165002c090 con 0x7f16581597c0 2023-10-06T02:20:32.960 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:32.960 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":37,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2589522502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2589522502},{"type":"v1","addr":"172.21.15.175:6837","nonce":2589522502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3703329287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3703329287},{"type":"v1","addr":"172.21.15.175:6836","nonce":3703329287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/843207095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":843207095},{"type":"v1","addr":"172.21.15.6:6834","nonce":843207095}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:10.479851+0000","modified":"2023-10-06T02:20:32.566168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5973":{"gid":5973,"name":"a","rank":0,"incarnation":37,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/1891041000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1891041000},{"type":"v1","addr":"172.21.15.6:6835","nonce":1891041000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:20:32.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.961+0000 7f165fa91700 1 -- 172.21.15.6:0/2094203525 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f163c066f30 msgr2=0x7f163c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:32.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.961+0000 7f165fa91700 1 --2- 172.21.15.6:0/2094203525 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f163c066f30 0x7f163c0693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1654006f00 tx=0x7f1654008040 comp rx=0 tx=0).stop 2023-10-06T02:20:32.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.961+0000 7f165fa91700 1 -- 172.21.15.6:0/2094203525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16581597c0 msgr2=0x7f16580cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:32.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.961+0000 7f165fa91700 1 --2- 172.21.15.6:0/2094203525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16581597c0 0x7f16580cdf80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f165806fe40 tx=0x7f1650019000 comp rx=0 tx=0).stop 2023-10-06T02:20:32.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.961+0000 7f165fa91700 1 -- 172.21.15.6:0/2094203525 shutdown_connections 2023-10-06T02:20:32.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.961+0000 7f165fa91700 1 --2- 172.21.15.6:0/2094203525 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f163c066f30 0x7f163c0693e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:32.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.961+0000 7f165fa91700 1 --2- 172.21.15.6:0/2094203525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16581597c0 0x7f16580cdf80 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:32.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.961+0000 7f165fa91700 1 --2- 172.21.15.6:0/2094203525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f165806adf0 0x7f1658143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:32.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.961+0000 7f165fa91700 1 --2- 172.21.15.6:0/2094203525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16581593f0 0x7f16580c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:32.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.961+0000 7f165fa91700 1 -- 172.21.15.6:0/2094203525 >> 172.21.15.6:0/2094203525 conn(0x7f165806cff0 msgr2=0x7f16580ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:32.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.961+0000 7f165fa91700 1 -- 172.21.15.6:0/2094203525 shutdown_connections 2023-10-06T02:20:32.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:32.961+0000 7f165fa91700 1 -- 172.21.15.6:0/2094203525 wait complete. 2023-10-06T02:20:32.964 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 37 2023-10-06T02:20:32.973 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush journal 2023-10-06T02:20:33.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.094+0000 7f8961167700 1 Processor -- start 2023-10-06T02:20:33.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.094+0000 7f8961167700 1 -- start start 2023-10-06T02:20:33.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.095+0000 7f8961167700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f895c15a030 0x7f895c15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.095+0000 7f8961167700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f895c15a940 0x7f895c086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.095+0000 7f8961167700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895c0afc50 con 0x7f895c087530 2023-10-06T02:20:33.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.095+0000 7f8961167700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895c0b0cf0 con 0x7f895c15a030 2023-10-06T02:20:33.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.095+0000 7f8961167700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c0879b0 con 0x7f895c15a940 2023-10-06T02:20:33.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.095+0000 7f895ad9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f895c15a030 0x7f895c15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.095+0000 7f895ad9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f895c15a030 0x7f895c15a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:59574/0 (socket says 172.21.15.6:59574) 2023-10-06T02:20:33.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.095+0000 7f895a59c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f895c15a940 0x7f895c086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.095+0000 7f895ad9d700 1 -- 172.21.15.6:0/444501221 learned_addr learned my addr 172.21.15.6:0/444501221 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:33.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.095+0000 7f895b59e700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f895c087530 0x7f895c0b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:41894/0 (socket says 172.21.15.6:41894) 2023-10-06T02:20:33.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.095+0000 7f895ad9d700 1 -- 172.21.15.6:0/444501221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f895c15a940 msgr2=0x7f895c086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:33.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.095+0000 7f895ad9d700 1 --2- 172.21.15.6:0/444501221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f895c15a940 0x7f895c086ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.095+0000 7f895ad9d700 1 -- 172.21.15.6:0/444501221 >> v1:172.21.15.175:6789/0 conn(0x7f895c087530 legacy=0x7f895c0b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.095+0000 7f895ad9d700 1 -- 172.21.15.6:0/444501221 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c0aff30 con 0x7f895c15a030 2023-10-06T02:20:33.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.095+0000 7f8959d9b700 1 -- 172.21.15.6:0/444501221 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500992282 0 0) 0x7f895c0afc50 con 0x7f895c087530 2023-10-06T02:20:33.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.095+0000 7f895a59c700 1 --2- 172.21.15.6:0/444501221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f895c15a940 0x7f895c086ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:20:33.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.096+0000 7f895ad9d700 1 --2- 172.21.15.6:0/444501221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f895c15a030 0x7f895c15a400 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f894c009f50 tx=0x7f894c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7fa2272adf29ebe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:33.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.096+0000 7f8959d9b700 1 -- 172.21.15.6:0/444501221 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c00e070 con 0x7f895c15a030 2023-10-06T02:20:33.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.096+0000 7f8959d9b700 1 -- 172.21.15.6:0/444501221 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c00b9c0 con 0x7f895c15a030 2023-10-06T02:20:33.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.096+0000 7f8959d9b700 1 -- 172.21.15.6:0/444501221 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c0092e0 con 0x7f895c15a030 2023-10-06T02:20:33.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.096+0000 7f8961167700 1 -- 172.21.15.6:0/444501221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f895c15a030 msgr2=0x7f895c15a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.096+0000 7f8961167700 1 --2- 172.21.15.6:0/444501221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f895c15a030 0x7f895c15a400 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f894c009f50 tx=0x7f894c009840 comp rx=0 tx=0).stop 2023-10-06T02:20:33.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.096+0000 7f8961167700 1 -- 172.21.15.6:0/444501221 shutdown_connections 2023-10-06T02:20:33.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.096+0000 7f8961167700 1 --2- 172.21.15.6:0/444501221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f895c15a030 0x7f895c15a400 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.096+0000 7f8961167700 1 --2- 172.21.15.6:0/444501221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f895c15a940 0x7f895c086ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.096+0000 7f8961167700 1 -- 172.21.15.6:0/444501221 >> 172.21.15.6:0/444501221 conn(0x7f895c068680 msgr2=0x7f895c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:33.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.096+0000 7f8961167700 1 -- 172.21.15.6:0/444501221 shutdown_connections 2023-10-06T02:20:33.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.096+0000 7f8961167700 1 -- 172.21.15.6:0/444501221 wait complete. 2023-10-06T02:20:33.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.098+0000 7f8961167700 1 Processor -- start 2023-10-06T02:20:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.098+0000 7f8961167700 1 -- start start 2023-10-06T02:20:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.098+0000 7f8961167700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f895c087530 0x7f895c0c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.098+0000 7f8961167700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c15a030 0x7f895c0c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.098+0000 7f8961167700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f895c15a940 0x7f895c169b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.098+0000 7f8961167700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c0c83e0 con 0x7f895c15a030 2023-10-06T02:20:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.098+0000 7f8961167700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c0c7cc0 con 0x7f895c087530 2023-10-06T02:20:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f8961167700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c15dec0 con 0x7f895c15a940 2023-10-06T02:20:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f895a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c15a030 0x7f895c0c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f895a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c15a030 0x7f895c0c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56548/0 (socket says 172.21.15.6:56548) 2023-10-06T02:20:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f895a59c700 1 -- 172.21.15.6:0/2095323073 learned_addr learned my addr 172.21.15.6:0/2095323073 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f895b59e700 1 --2- 172.21.15.6:0/2095323073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f895c15a940 0x7f895c169b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f895ad9d700 1 --2- 172.21.15.6:0/2095323073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f895c087530 0x7f895c0c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f895a59c700 1 -- 172.21.15.6:0/2095323073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f895c15a940 msgr2=0x7f895c169b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f895a59c700 1 --2- 172.21.15.6:0/2095323073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f895c15a940 0x7f895c169b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f895a59c700 1 -- 172.21.15.6:0/2095323073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f895c087530 msgr2=0x7f895c0c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f895a59c700 1 --2- 172.21.15.6:0/2095323073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f895c087530 0x7f895c0c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f895a59c700 1 -- 172.21.15.6:0/2095323073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8944009420 con 0x7f895c15a030 2023-10-06T02:20:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f895b59e700 1 --2- 172.21.15.6:0/2095323073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f895c15a940 0x7f895c169b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f895ad9d700 1 --2- 172.21.15.6:0/2095323073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f895c087530 0x7f895c0c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f895a59c700 1 --2- 172.21.15.6:0/2095323073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c15a030 0x7f895c0c9ef0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f894400ecb0 tx=0x7f89440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f8952ffd700 1 -- 172.21.15.6:0/2095323073 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894400c9d0 con 0x7f895c15a030 2023-10-06T02:20:33.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f8952ffd700 1 -- 172.21.15.6:0/2095323073 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894400cb30 con 0x7f895c15a030 2023-10-06T02:20:33.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f8961167700 1 -- 172.21.15.6:0/2095323073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894c009ae0 con 0x7f895c15a030 2023-10-06T02:20:33.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f8952ffd700 1 -- 172.21.15.6:0/2095323073 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894400ced0 con 0x7f895c15a030 2023-10-06T02:20:33.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.099+0000 7f8961167700 1 -- 172.21.15.6:0/2095323073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895c15d870 con 0x7f895c15a030 2023-10-06T02:20:33.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.101+0000 7f8952ffd700 1 -- 172.21.15.6:0/2095323073 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8944013680 con 0x7f895c15a030 2023-10-06T02:20:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.101+0000 7f8952ffd700 1 --2- 172.21.15.6:0/2095323073 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f893c066f30 0x7f893c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.102+0000 7f8952ffd700 1 -- 172.21.15.6:0/2095323073 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f8944084930 con 0x7f895c15a030 2023-10-06T02:20:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.102+0000 7f895ad9d700 1 --2- 172.21.15.6:0/2095323073 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f893c066f30 0x7f893c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.102+0000 7f895ad9d700 1 --2- 172.21.15.6:0/2095323073 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f893c066f30 0x7f893c0693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f894c009ea0 tx=0x7f894c018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.103+0000 7f896a45fb80 1 Processor -- start 2023-10-06T02:20:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.103+0000 7f896a45fb80 1 -- start start 2023-10-06T02:20:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.104+0000 7f896a45fb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af468a890 0x563af468ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.104+0000 7f896a45fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af468bd10 0x563af46da710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.104+0000 7f896a45fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af46dac50 0x563af46db0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.104+0000 7f896a45fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563af45e1ac0 con 0x563af46dac50 2023-10-06T02:20:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.104+0000 7f896a45fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563af45df2c0 con 0x563af468bd10 2023-10-06T02:20:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.104+0000 7f896a45fb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563af45db0b0 con 0x563af468a890 2023-10-06T02:20:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.104+0000 7f895b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af46dac50 0x563af46db0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.104+0000 7f895b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af46dac50 0x563af46db0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56558/0 (socket says 172.21.15.6:56558) 2023-10-06T02:20:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.104+0000 7f895b59e700 1 -- 172.21.15.6:0/2625726455 learned_addr learned my addr 172.21.15.6:0/2625726455 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.104+0000 7f895ad9d700 1 --2- 172.21.15.6:0/2625726455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af468a890 0x563af468ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.104+0000 7f895a59c700 1 --2- 172.21.15.6:0/2625726455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af468bd10 0x563af46da710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.105+0000 7f895b59e700 1 -- 172.21.15.6:0/2625726455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af468a890 msgr2=0x563af468ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.105+0000 7f895b59e700 1 --2- 172.21.15.6:0/2625726455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af468a890 0x563af468ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.105+0000 7f895b59e700 1 -- 172.21.15.6:0/2625726455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af468bd10 msgr2=0x563af46da710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.105+0000 7f895b59e700 1 --2- 172.21.15.6:0/2625726455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af468bd10 0x563af46da710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.105+0000 7f895b59e700 1 -- 172.21.15.6:0/2625726455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563af44752c0 con 0x563af46dac50 2023-10-06T02:20:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.105+0000 7f895b59e700 1 --2- 172.21.15.6:0/2625726455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af46dac50 0x563af46db0a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f89540018b0 tx=0x7f8954009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d264b488599429a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.105+0000 7f893bfff700 1 -- 172.21.15.6:0/2625726455 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895400b070 con 0x563af46dac50 2023-10-06T02:20:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.105+0000 7f893bfff700 1 -- 172.21.15.6:0/2625726455 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8954005a70 con 0x563af46dac50 2023-10-06T02:20:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.105+0000 7f893bfff700 1 -- 172.21.15.6:0/2625726455 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954005df0 con 0x563af46dac50 2023-10-06T02:20:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.106+0000 7f896a45fb80 1 -- 172.21.15.6:0/2625726455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af46dac50 msgr2=0x563af46db0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.106+0000 7f896a45fb80 1 --2- 172.21.15.6:0/2625726455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af46dac50 0x563af46db0a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f89540018b0 tx=0x7f8954009040 comp rx=0 tx=0).stop 2023-10-06T02:20:33.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.106+0000 7f896a45fb80 1 -- 172.21.15.6:0/2625726455 shutdown_connections 2023-10-06T02:20:33.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.106+0000 7f896a45fb80 1 --2- 172.21.15.6:0/2625726455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af46dac50 0x563af46db0a0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.106+0000 7f896a45fb80 1 --2- 172.21.15.6:0/2625726455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af468a890 0x563af468ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.106+0000 7f896a45fb80 1 --2- 172.21.15.6:0/2625726455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af468bd10 0x563af46da710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.106+0000 7f896a45fb80 1 -- 172.21.15.6:0/2625726455 >> 172.21.15.6:0/2625726455 conn(0x563af468c1b0 msgr2=0x563af468c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:33.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.106+0000 7f896a45fb80 1 -- 172.21.15.6:0/2625726455 shutdown_connections 2023-10-06T02:20:33.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.106+0000 7f896a45fb80 1 -- 172.21.15.6:0/2625726455 wait complete. 2023-10-06T02:20:33.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.106+0000 7f896a45fb80 1 -- start start 2023-10-06T02:20:33.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.106+0000 7f896a45fb80 1 Processor -- start 2023-10-06T02:20:33.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.107+0000 7f896a45fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.107+0000 7f896a45fb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af468bd10 0x563af46c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.107+0000 7f896a45fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af46dac50 0x563af46c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.107+0000 7f896a45fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563af45868e0 con 0x563af468a890 2023-10-06T02:20:33.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.107+0000 7f896a45fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563af45a1ef0 con 0x563af46dac50 2023-10-06T02:20:33.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.107+0000 7f896a45fb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563af445de80 con 0x563af468bd10 2023-10-06T02:20:33.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.107+0000 7f896a45fb80 10 client.0 _ll_register_callbacks cb 0x563af464dec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:20:33.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.107+0000 7f895ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f895ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56574/0 (socket says 172.21.15.6:56574) 2023-10-06T02:20:33.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f895ad9d700 1 -- 172.21.15.6:0/3634009598 learned_addr learned my addr 172.21.15.6:0/3634009598 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:33.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f895a59c700 1 --2- 172.21.15.6:0/3634009598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af468bd10 0x563af46c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f895b59e700 1 --2- 172.21.15.6:0/3634009598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af46dac50 0x563af46c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f895ad9d700 1 -- 172.21.15.6:0/3634009598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af468bd10 msgr2=0x563af46c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f895ad9d700 1 --2- 172.21.15.6:0/3634009598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af468bd10 0x563af46c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f895ad9d700 1 -- 172.21.15.6:0/3634009598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af46dac50 msgr2=0x563af46c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f895ad9d700 1 --2- 172.21.15.6:0/3634009598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af46dac50 0x563af46c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f895ad9d700 1 -- 172.21.15.6:0/3634009598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8954001430 con 0x563af468a890 2023-10-06T02:20:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f895ad9d700 1 --2- 172.21.15.6:0/3634009598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46ccfe0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f894c00b6c0 tx=0x7f894c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9fd49dc401c7be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f89397fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:20:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f89397fa700 1 -- 172.21.15.6:0/3634009598 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c012a90 con 0x563af468a890 2023-10-06T02:20:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f89397fa700 1 -- 172.21.15.6:0/3634009598 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f894c012bf0 con 0x563af468a890 2023-10-06T02:20:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f896a45fb80 1 -- 172.21.15.6:0/3634009598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563af467f990 con 0x563af468a890 2023-10-06T02:20:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f89397fa700 1 -- 172.21.15.6:0/3634009598 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f894c02c430 con 0x563af468a890 2023-10-06T02:20:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f896a45fb80 10 client.6012 fetch_fsmap learned FSMap version 37 2023-10-06T02:20:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f896a45fb80 1 -- 172.21.15.6:0/3634009598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x563af4418030 con 0x563af468a890 2023-10-06T02:20:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.108+0000 7f89397fa700 1 -- 172.21.15.6:0/3634009598 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563af467f990 con 0x563af468a890 2023-10-06T02:20:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.109+0000 7f89397fa700 1 -- 172.21.15.6:0/3634009598 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f894c032020 con 0x563af468a890 2023-10-06T02:20:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.109+0000 7f896a45fb80 10 client.6012 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T02:20:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.109+0000 7f896a45fb80 10 client.6012 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-06T02:20:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.109+0000 7f896a45fb80 20 client.6012 populate_metadata read hostname 'smithi006' 2023-10-06T02:20:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.109+0000 7f896a45fb80 1 --2- 172.21.15.6:0/3634009598 >> [v2:172.21.15.6:6833/1891041000,v1:172.21.15.6:6835/1891041000] conn(0x563af46b6200 0x563af46b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.109+0000 7f896a45fb80 4 client.6012 mds_command: new command op to 5973 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:20:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.109+0000 7f896a45fb80 1 -- 172.21.15.6:0/3634009598 --> [v2:172.21.15.6:6833/1891041000,v1:172.21.15.6:6835/1891041000] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563af465c8c0 con 0x563af46b6200 2023-10-06T02:20:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.109+0000 7f895a59c700 1 --2- 172.21.15.6:0/3634009598 >> [v2:172.21.15.6:6833/1891041000,v1:172.21.15.6:6835/1891041000] conn(0x563af46b6200 0x563af46b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.109+0000 7f89397fa700 10 client.6012 ms_handle_connect on v2:172.21.15.6:6833/1891041000 2023-10-06T02:20:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.109+0000 7f895a59c700 1 --2- 172.21.15.6:0/3634009598 >> [v2:172.21.15.6:6833/1891041000,v1:172.21.15.6:6835/1891041000] conn(0x563af46b6200 0x563af46b65d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddab86fed9acf694 server_cookie=f2d46500e119458 in_seq=0 out_seq=0 2023-10-06T02:20:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.110+0000 7f89397fa700 1 -- 172.21.15.6:0/3634009598 <== mds.0 v2:172.21.15.6:6833/1891041000 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x563af465c8c0 con 0x563af46b6200 2023-10-06T02:20:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.110+0000 7f89397fa700 10 client.6012 handle_command_reply: tid=0 2023-10-06T02:20:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.110+0000 7f896a45fb80 1 client.6012 shutdown 2023-10-06T02:20:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.110+0000 7f896a45fb80 1 -- 172.21.15.6:0/3634009598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 msgr2=0x563af46ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.110+0000 7f896a45fb80 1 --2- 172.21.15.6:0/3634009598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46ccfe0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f894c00b6c0 tx=0x7f894c01f000 comp rx=0 tx=0).stop 2023-10-06T02:20:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.110+0000 7f896a45fb80 1 -- 172.21.15.6:0/3634009598 shutdown_connections 2023-10-06T02:20:33.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.110+0000 7f896a45fb80 1 --2- 172.21.15.6:0/3634009598 >> [v2:172.21.15.6:6833/1891041000,v1:172.21.15.6:6835/1891041000] conn(0x563af46b6200 0x563af46b65d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.110+0000 7f896a45fb80 1 --2- 172.21.15.6:0/3634009598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af46dac50 0x563af46c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.110+0000 7f896a45fb80 1 --2- 172.21.15.6:0/3634009598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46ccfe0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.110+0000 7f896a45fb80 1 --2- 172.21.15.6:0/3634009598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af468bd10 0x563af46c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.110+0000 7f89397fa700 0 client.6012 ms_handle_reset on v2:172.21.15.6:6833/1891041000 2023-10-06T02:20:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.110+0000 7f896a45fb80 1 -- 172.21.15.6:0/3634009598 >> 172.21.15.6:0/3634009598 conn(0x563af468c1b0 msgr2=0x563af46b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.110+0000 7f896a45fb80 1 -- 172.21.15.6:0/3634009598 shutdown_connections 2023-10-06T02:20:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.110+0000 7f896a45fb80 1 -- 172.21.15.6:0/3634009598 wait complete. 2023-10-06T02:20:33.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.110+0000 7f896a45fb80 20 client.6012 trim_cache size 0 max 16384 2023-10-06T02:20:33.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.124+0000 7f896a45fb80 1 Processor -- start 2023-10-06T02:20:33.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.124+0000 7f896a45fb80 1 -- start start 2023-10-06T02:20:33.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f896a45fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46d4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f896a45fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af468bd10 0x563af46b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f896a45fb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af46dac50 0x563af46b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f896a45fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563af46ca5a0 con 0x563af468a890 2023-10-06T02:20:33.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f896a45fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563af46daac0 con 0x563af468bd10 2023-10-06T02:20:33.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f896a45fb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563af46cecb0 con 0x563af46dac50 2023-10-06T02:20:33.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f895ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46d4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f895ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46d4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56588/0 (socket says 172.21.15.6:56588) 2023-10-06T02:20:33.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f895ad9d700 1 -- 172.21.15.6:0/1766419855 learned_addr learned my addr 172.21.15.6:0/1766419855 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:33.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f895a59c700 1 --2- 172.21.15.6:0/1766419855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af468bd10 0x563af46b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f895ad9d700 1 -- 172.21.15.6:0/1766419855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af46dac50 msgr2=0x563af46b70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:33.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f895b59e700 1 --2- 172.21.15.6:0/1766419855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af46dac50 0x563af46b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f895ad9d700 1 --2- 172.21.15.6:0/1766419855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af46dac50 0x563af46b70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f895ad9d700 1 -- 172.21.15.6:0/1766419855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af468bd10 msgr2=0x563af46b6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:33.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f895ad9d700 1 --2- 172.21.15.6:0/1766419855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af468bd10 0x563af46b6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f895ad9d700 1 -- 172.21.15.6:0/1766419855 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563af45a97d0 con 0x563af468a890 2023-10-06T02:20:33.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f895a59c700 1 --2- 172.21.15.6:0/1766419855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af468bd10 0x563af46b6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:33.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f895b59e700 1 --2- 172.21.15.6:0/1766419855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af46dac50 0x563af46b70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:33.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f895ad9d700 1 --2- 172.21.15.6:0/1766419855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46d4240 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f894c02c460 tx=0x7f894c02d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be7401166a3e505 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:33.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f8950ff9700 1 -- 172.21.15.6:0/1766419855 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c0126d0 con 0x563af468a890 2023-10-06T02:20:33.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f8950ff9700 1 -- 172.21.15.6:0/1766419855 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c00bd20 con 0x563af468a890 2023-10-06T02:20:33.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.125+0000 7f8950ff9700 1 -- 172.21.15.6:0/1766419855 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c02c770 con 0x563af468a890 2023-10-06T02:20:33.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.126+0000 7f896a45fb80 1 -- 172.21.15.6:0/1766419855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 msgr2=0x563af46d4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.126+0000 7f896a45fb80 1 --2- 172.21.15.6:0/1766419855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46d4240 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f894c02c460 tx=0x7f894c02d000 comp rx=0 tx=0).stop 2023-10-06T02:20:33.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.126+0000 7f896a45fb80 1 -- 172.21.15.6:0/1766419855 shutdown_connections 2023-10-06T02:20:33.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.126+0000 7f896a45fb80 1 --2- 172.21.15.6:0/1766419855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af46dac50 0x563af46b70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.126+0000 7f896a45fb80 1 --2- 172.21.15.6:0/1766419855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46d4240 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.126+0000 7f896a45fb80 1 --2- 172.21.15.6:0/1766419855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af468bd10 0x563af46b6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.126+0000 7f896a45fb80 1 -- 172.21.15.6:0/1766419855 >> 172.21.15.6:0/1766419855 conn(0x563af468c1b0 msgr2=0x563af46832d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:33.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.126+0000 7f896a45fb80 1 -- 172.21.15.6:0/1766419855 shutdown_connections 2023-10-06T02:20:33.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.126+0000 7f896a45fb80 1 -- 172.21.15.6:0/1766419855 wait complete. 2023-10-06T02:20:33.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.126+0000 7f896a45fb80 1 -- start start 2023-10-06T02:20:33.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.127+0000 7f896a45fb80 1 Processor -- start 2023-10-06T02:20:33.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.127+0000 7f896a45fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.127+0000 7f896a45fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af468bd10 0x563af4720920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.127+0000 7f896a45fb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af46dac50 0x563af46b0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.127+0000 7f896a45fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563af4720e60 con 0x563af468a890 2023-10-06T02:20:33.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.127+0000 7f896a45fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563af46b1220 con 0x563af468bd10 2023-10-06T02:20:33.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.127+0000 7f896a45fb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563af46d2e30 con 0x563af46dac50 2023-10-06T02:20:33.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.127+0000 7f896a45fb80 10 client.0 _ll_register_callbacks cb 0x563af464dec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:20:33.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.127+0000 7f895ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f895ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46d32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56592/0 (socket says 172.21.15.6:56592) 2023-10-06T02:20:33.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f895ad9d700 1 -- 172.21.15.6:0/3011121924 learned_addr learned my addr 172.21.15.6:0/3011121924 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:33.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f895a59c700 1 --2- 172.21.15.6:0/3011121924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af468bd10 0x563af4720920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f895b59e700 1 --2- 172.21.15.6:0/3011121924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af46dac50 0x563af46b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f895ad9d700 1 -- 172.21.15.6:0/3011121924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af46dac50 msgr2=0x563af46b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:33.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f895ad9d700 1 --2- 172.21.15.6:0/3011121924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af46dac50 0x563af46b0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f895ad9d700 1 -- 172.21.15.6:0/3011121924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af468bd10 msgr2=0x563af4720920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:33.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f895ad9d700 1 --2- 172.21.15.6:0/3011121924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af468bd10 0x563af4720920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f895ad9d700 1 -- 172.21.15.6:0/3011121924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563af4418030 con 0x563af468a890 2023-10-06T02:20:33.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f895a59c700 1 --2- 172.21.15.6:0/3011121924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af468bd10 0x563af4720920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:33.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f895ad9d700 1 --2- 172.21.15.6:0/3011121924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46d32c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f894c0033f0 tx=0x7f894c041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7dce1b80d5d2090 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:33.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f89397fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:20:33.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f89397fa700 1 -- 172.21.15.6:0/3011121924 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c012ab0 con 0x563af468a890 2023-10-06T02:20:33.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f89397fa700 1 -- 172.21.15.6:0/3011121924 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f894c04e070 con 0x563af468a890 2023-10-06T02:20:33.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f896a45fb80 1 -- 172.21.15.6:0/3011121924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8954005a70 con 0x563af468a890 2023-10-06T02:20:33.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f89397fa700 1 -- 172.21.15.6:0/3011121924 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f894c012c10 con 0x563af468a890 2023-10-06T02:20:33.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f896a45fb80 10 client.6018 fetch_fsmap learned FSMap version 37 2023-10-06T02:20:33.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f896a45fb80 1 -- 172.21.15.6:0/3011121924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x563af45904c0 con 0x563af468a890 2023-10-06T02:20:33.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f89397fa700 1 -- 172.21.15.6:0/3011121924 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8954005a70 con 0x563af468a890 2023-10-06T02:20:33.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.128+0000 7f89397fa700 1 -- 172.21.15.6:0/3011121924 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f894c01ece0 con 0x563af468a890 2023-10-06T02:20:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f896a45fb80 10 client.6018 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T02:20:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f896a45fb80 10 client.6018 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-06T02:20:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f896a45fb80 20 client.6018 populate_metadata read hostname 'smithi006' 2023-10-06T02:20:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f896a45fb80 1 --2- 172.21.15.6:0/3011121924 >> [v2:172.21.15.6:6833/1891041000,v1:172.21.15.6:6835/1891041000] conn(0x563af46c8ef0 0x563af46b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f896a45fb80 4 client.6018 mds_command: new command op to 5973 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:20:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f896a45fb80 1 -- 172.21.15.6:0/3011121924 --> [v2:172.21.15.6:6833/1891041000,v1:172.21.15.6:6835/1891041000] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563af457de50 con 0x563af46c8ef0 2023-10-06T02:20:33.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f895a59c700 1 --2- 172.21.15.6:0/3011121924 >> [v2:172.21.15.6:6833/1891041000,v1:172.21.15.6:6835/1891041000] conn(0x563af46c8ef0 0x563af46b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f89397fa700 10 client.6018 ms_handle_connect on v2:172.21.15.6:6833/1891041000 2023-10-06T02:20:33.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f895a59c700 1 --2- 172.21.15.6:0/3011121924 >> [v2:172.21.15.6:6833/1891041000,v1:172.21.15.6:6835/1891041000] conn(0x563af46c8ef0 0x563af46b0960 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1076de391613ba04 server_cookie=87a1ec2d90abe452 in_seq=0 out_seq=0 2023-10-06T02:20:33.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f89397fa700 1 -- 172.21.15.6:0/3011121924 <== mds.0 v2:172.21.15.6:6833/1891041000 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563af457de50 con 0x563af46c8ef0 2023-10-06T02:20:33.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f89397fa700 10 client.6018 handle_command_reply: tid=0 2023-10-06T02:20:33.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f896a45fb80 1 client.6018 shutdown 2023-10-06T02:20:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f896a45fb80 1 -- 172.21.15.6:0/3011121924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 msgr2=0x563af46d32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f896a45fb80 1 --2- 172.21.15.6:0/3011121924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46d32c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f894c0033f0 tx=0x7f894c041000 comp rx=0 tx=0).stop 2023-10-06T02:20:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f896a45fb80 1 -- 172.21.15.6:0/3011121924 shutdown_connections 2023-10-06T02:20:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f896a45fb80 1 --2- 172.21.15.6:0/3011121924 >> [v2:172.21.15.6:6833/1891041000,v1:172.21.15.6:6835/1891041000] conn(0x563af46c8ef0 0x563af46b0960 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f896a45fb80 1 --2- 172.21.15.6:0/3011121924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563af46dac50 0x563af46b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f896a45fb80 1 --2- 172.21.15.6:0/3011121924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563af468a890 0x563af46d32c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f89397fa700 0 client.6018 ms_handle_reset on v2:172.21.15.6:6833/1891041000 2023-10-06T02:20:33.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f896a45fb80 1 --2- 172.21.15.6:0/3011121924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563af468bd10 0x563af4720920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f896a45fb80 1 -- 172.21.15.6:0/3011121924 >> 172.21.15.6:0/3011121924 conn(0x563af468c1b0 msgr2=0x563af468c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:33.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f896a45fb80 1 -- 172.21.15.6:0/3011121924 shutdown_connections 2023-10-06T02:20:33.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.129+0000 7f896a45fb80 1 -- 172.21.15.6:0/3011121924 wait complete. 2023-10-06T02:20:33.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.130+0000 7f896a45fb80 20 client.6018 trim_cache size 0 max 16384 2023-10-06T02:20:33.144 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:20:33.144 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "", 2023-10-06T02:20:33.144 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0 2023-10-06T02:20:33.144 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:20:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.130+0000 7f8961167700 1 -- 172.21.15.6:0/2095323073 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f893c066f30 msgr2=0x7f893c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.130+0000 7f8961167700 1 --2- 172.21.15.6:0/2095323073 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f893c066f30 0x7f893c0693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f894c009ea0 tx=0x7f894c018000 comp rx=0 tx=0).stop 2023-10-06T02:20:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.130+0000 7f8961167700 1 -- 172.21.15.6:0/2095323073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c15a030 msgr2=0x7f895c0c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.130+0000 7f8961167700 1 --2- 172.21.15.6:0/2095323073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c15a030 0x7f895c0c9ef0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f894400ecb0 tx=0x7f89440091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.130+0000 7f8961167700 1 -- 172.21.15.6:0/2095323073 shutdown_connections 2023-10-06T02:20:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.130+0000 7f8961167700 1 --2- 172.21.15.6:0/2095323073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f895c15a940 0x7f895c169b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.130+0000 7f8961167700 1 --2- 172.21.15.6:0/2095323073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f895c087530 0x7f895c0c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.130+0000 7f8961167700 1 --2- 172.21.15.6:0/2095323073 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f893c066f30 0x7f893c0693e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.130+0000 7f8961167700 1 --2- 172.21.15.6:0/2095323073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c15a030 0x7f895c0c9ef0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.130+0000 7f8961167700 1 -- 172.21.15.6:0/2095323073 >> 172.21.15.6:0/2095323073 conn(0x7f895c068680 msgr2=0x7f895c0b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.130+0000 7f8961167700 1 -- 172.21.15.6:0/2095323073 shutdown_connections 2023-10-06T02:20:33.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.130+0000 7f8961167700 1 -- 172.21.15.6:0/2095323073 wait complete. 2023-10-06T02:20:33.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:20:33.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.267+0000 7fd6749a3700 1 Processor -- start 2023-10-06T02:20:33.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.267+0000 7fd6749a3700 1 -- start start 2023-10-06T02:20:33.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.268+0000 7fd6749a3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6700d05d0 0x7fd6701641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.268+0000 7fd6749a3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6700b3560 con 0x7fd670159400 2023-10-06T02:20:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.268+0000 7fd6749a3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6700cf6f0 con 0x7fd6700cf1a0 2023-10-06T02:20:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.268+0000 7fd6749a3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6700cf9d0 con 0x7fd6700d05d0 2023-10-06T02:20:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.268+0000 7fd66ed9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd670159400 0x7fd6700ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46686/0 (socket says 172.21.15.6:46686) 2023-10-06T02:20:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.268+0000 7fd66ed9d700 1 -- 172.21.15.6:0/4279459389 learned_addr learned my addr 172.21.15.6:0/4279459389 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.268+0000 7fd66f59e700 1 --2- 172.21.15.6:0/4279459389 >> v2:172.21.15.6:3300/0 conn(0x7fd6700d05d0 0x7fd6701641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.268+0000 7fd66f59e700 1 -- 172.21.15.6:0/4279459389 >> v1:172.21.15.175:6789/0 conn(0x7fd6700cf1a0 legacy=0x7fd6700cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.268+0000 7fd66f59e700 1 -- 172.21.15.6:0/4279459389 >> v1:172.21.15.6:6789/0 conn(0x7fd670159400 legacy=0x7fd6700ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.268+0000 7fd66f59e700 1 -- 172.21.15.6:0/4279459389 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6700b2f10 con 0x7fd6700d05d0 2023-10-06T02:20:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.268+0000 7fd66f59e700 1 --2- 172.21.15.6:0/4279459389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6700d05d0 0x7fd6701641d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd668009e60 tx=0x7fd668009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1bbba1bf082e398 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.268+0000 7fd66dd9b700 1 -- 172.21.15.6:0/4279459389 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66800e070 con 0x7fd6700d05d0 2023-10-06T02:20:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.268+0000 7fd66dd9b700 1 -- 172.21.15.6:0/4279459389 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66800bc30 con 0x7fd6700d05d0 2023-10-06T02:20:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.268+0000 7fd66dd9b700 1 -- 172.21.15.6:0/4279459389 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668012430 con 0x7fd6700d05d0 2023-10-06T02:20:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.269+0000 7fd6749a3700 1 -- 172.21.15.6:0/4279459389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6700d05d0 msgr2=0x7fd6701641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.269+0000 7fd6749a3700 1 --2- 172.21.15.6:0/4279459389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6700d05d0 0x7fd6701641d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd668009e60 tx=0x7fd668009780 comp rx=0 tx=0).stop 2023-10-06T02:20:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.269+0000 7fd6749a3700 1 -- 172.21.15.6:0/4279459389 shutdown_connections 2023-10-06T02:20:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.269+0000 7fd6749a3700 1 --2- 172.21.15.6:0/4279459389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6700d05d0 0x7fd6701641d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.269+0000 7fd6749a3700 1 -- 172.21.15.6:0/4279459389 >> 172.21.15.6:0/4279459389 conn(0x7fd67006ac10 msgr2=0x7fd670068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.269+0000 7fd6749a3700 1 -- 172.21.15.6:0/4279459389 shutdown_connections 2023-10-06T02:20:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.269+0000 7fd6749a3700 1 -- 172.21.15.6:0/4279459389 wait complete. 2023-10-06T02:20:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.270+0000 7fd6749a3700 1 Processor -- start 2023-10-06T02:20:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.270+0000 7fd6749a3700 1 -- start start 2023-10-06T02:20:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd6749a3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6700cf1a0 0x7fd67016abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd6749a3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6700d05d0 0x7fd67015b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd6749a3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd670159400 0x7fd67015b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd6749a3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67016b100 con 0x7fd670159400 2023-10-06T02:20:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd6749a3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67015a7c0 con 0x7fd6700cf1a0 2023-10-06T02:20:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd6749a3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd670159bb0 con 0x7fd6700d05d0 2023-10-06T02:20:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd66f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd670159400 0x7fd67015b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd66f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd670159400 0x7fd67015b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56604/0 (socket says 172.21.15.6:56604) 2023-10-06T02:20:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd66f59e700 1 -- 172.21.15.6:0/240142794 learned_addr learned my addr 172.21.15.6:0/240142794 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd66ed9d700 1 --2- 172.21.15.6:0/240142794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6700cf1a0 0x7fd67016abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd66e59c700 1 --2- 172.21.15.6:0/240142794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6700d05d0 0x7fd67015b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd66f59e700 1 -- 172.21.15.6:0/240142794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6700d05d0 msgr2=0x7fd67015b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd66f59e700 1 --2- 172.21.15.6:0/240142794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6700d05d0 0x7fd67015b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd66f59e700 1 -- 172.21.15.6:0/240142794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6700cf1a0 msgr2=0x7fd67016abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd66f59e700 1 --2- 172.21.15.6:0/240142794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6700cf1a0 0x7fd67016abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd66f59e700 1 -- 172.21.15.6:0/240142794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd668009a20 con 0x7fd670159400 2023-10-06T02:20:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd66e59c700 1 --2- 172.21.15.6:0/240142794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6700d05d0 0x7fd67015b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.271+0000 7fd66ed9d700 1 --2- 172.21.15.6:0/240142794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6700cf1a0 0x7fd67016abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.272+0000 7fd66f59e700 1 --2- 172.21.15.6:0/240142794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd670159400 0x7fd67015b680 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd6680097c0 tx=0x7fd668019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.272+0000 7fd656ffd700 1 -- 172.21.15.6:0/240142794 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66801e630 con 0x7fd670159400 2023-10-06T02:20:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.272+0000 7fd656ffd700 1 -- 172.21.15.6:0/240142794 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66801e7b0 con 0x7fd670159400 2023-10-06T02:20:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.272+0000 7fd6749a3700 1 -- 172.21.15.6:0/240142794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd670159e90 con 0x7fd670159400 2023-10-06T02:20:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.272+0000 7fd656ffd700 1 -- 172.21.15.6:0/240142794 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66801eb70 con 0x7fd670159400 2023-10-06T02:20:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.272+0000 7fd6749a3700 1 -- 172.21.15.6:0/240142794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67015a450 con 0x7fd670159400 2023-10-06T02:20:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.273+0000 7fd6749a3700 1 -- 172.21.15.6:0/240142794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6700d0f20 con 0x7fd670159400 2023-10-06T02:20:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.273+0000 7fd656ffd700 1 -- 172.21.15.6:0/240142794 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd668024070 con 0x7fd670159400 2023-10-06T02:20:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.273+0000 7fd656ffd700 1 --2- 172.21.15.6:0/240142794 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd65c066f30 0x7fd65c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.274+0000 7fd656ffd700 1 -- 172.21.15.6:0/240142794 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fd668087240 con 0x7fd670159400 2023-10-06T02:20:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.274+0000 7fd66ed9d700 1 --2- 172.21.15.6:0/240142794 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd65c066f30 0x7fd65c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.274+0000 7fd66ed9d700 1 --2- 172.21.15.6:0/240142794 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd65c066f30 0x7fd65c0693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd6700c9db0 tx=0x7fd660009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:33.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.278+0000 7fd656ffd700 1 -- 172.21.15.6:0/240142794 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6680541c0 con 0x7fd670159400 2023-10-06T02:20:33.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.516+0000 7fd6749a3700 1 -- 172.21.15.6:0/240142794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6700d0380 con 0x7fd670159400 2023-10-06T02:20:33.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.516+0000 7fd656ffd700 1 -- 172.21.15.6:0/240142794 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fd6680577e0 con 0x7fd670159400 2023-10-06T02:20:33.517 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:33.518 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":37,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2589522502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2589522502},{"type":"v1","addr":"172.21.15.175:6837","nonce":2589522502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3703329287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3703329287},{"type":"v1","addr":"172.21.15.175:6836","nonce":3703329287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/843207095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":843207095},{"type":"v1","addr":"172.21.15.6:6834","nonce":843207095}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:10.479851+0000","modified":"2023-10-06T02:20:32.566168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5973":{"gid":5973,"name":"a","rank":0,"incarnation":37,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/1891041000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1891041000},{"type":"v1","addr":"172.21.15.6:6835","nonce":1891041000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:20:33.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.518+0000 7fd6749a3700 1 -- 172.21.15.6:0/240142794 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd65c066f30 msgr2=0x7fd65c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.518+0000 7fd6749a3700 1 --2- 172.21.15.6:0/240142794 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd65c066f30 0x7fd65c0693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd6700c9db0 tx=0x7fd660009040 comp rx=0 tx=0).stop 2023-10-06T02:20:33.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.518+0000 7fd6749a3700 1 -- 172.21.15.6:0/240142794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd670159400 msgr2=0x7fd67015b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.518+0000 7fd6749a3700 1 --2- 172.21.15.6:0/240142794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd670159400 0x7fd67015b680 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd6680097c0 tx=0x7fd668019000 comp rx=0 tx=0).stop 2023-10-06T02:20:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.518+0000 7fd6749a3700 1 -- 172.21.15.6:0/240142794 shutdown_connections 2023-10-06T02:20:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.518+0000 7fd6749a3700 1 --2- 172.21.15.6:0/240142794 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd65c066f30 0x7fd65c0693e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.518+0000 7fd6749a3700 1 --2- 172.21.15.6:0/240142794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd670159400 0x7fd67015b680 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.518+0000 7fd6749a3700 1 --2- 172.21.15.6:0/240142794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6700cf1a0 0x7fd67016abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.518+0000 7fd6749a3700 1 --2- 172.21.15.6:0/240142794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6700d05d0 0x7fd67015b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.518+0000 7fd6749a3700 1 -- 172.21.15.6:0/240142794 >> 172.21.15.6:0/240142794 conn(0x7fd67006ac10 msgr2=0x7fd6700b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.519+0000 7fd6749a3700 1 -- 172.21.15.6:0/240142794 shutdown_connections 2023-10-06T02:20:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.519+0000 7fd6749a3700 1 -- 172.21.15.6:0/240142794 wait complete. 2023-10-06T02:20:33.522 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 37 2023-10-06T02:20:33.532 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:20:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.651+0000 7fc838f9d700 1 Processor -- start 2023-10-06T02:20:33.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.651+0000 7fc838f9d700 1 -- start start 2023-10-06T02:20:33.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.652+0000 7fc838f9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc8340af4e0 0x7fc8340b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.652+0000 7fc838f9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8340af8b0 0x7fc8340b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.652+0000 7fc838f9d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83415e190 con 0x7fc83415d460 2023-10-06T02:20:33.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.652+0000 7fc838f9d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8340b1910 con 0x7fc8340af4e0 2023-10-06T02:20:33.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.652+0000 7fc838f9d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83415dfb0 con 0x7fc8340af8b0 2023-10-06T02:20:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.653+0000 7fc83259c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc8340af4e0 0x7fc8340b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.653+0000 7fc831d9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8340af8b0 0x7fc8340b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.653+0000 7fc83259c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc8340af4e0 0x7fc8340b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:59634/0 (socket says 172.21.15.6:59634) 2023-10-06T02:20:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.653+0000 7fc83259c700 1 -- 172.21.15.6:0/1201452257 learned_addr learned my addr 172.21.15.6:0/1201452257 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.653+0000 7fc831d9b700 1 -- 172.21.15.6:0/1201452257 >> v2:172.21.15.175:3300/0 conn(0x7fc8340af4e0 msgr2=0x7fc8340b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.653+0000 7fc831d9b700 1 --2- 172.21.15.6:0/1201452257 >> v2:172.21.15.175:3300/0 conn(0x7fc8340af4e0 0x7fc8340b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.653+0000 7fc831d9b700 1 -- 172.21.15.6:0/1201452257 >> v1:172.21.15.175:6789/0 conn(0x7fc83415d460 legacy=0x7fc83415d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.653+0000 7fc831d9b700 1 -- 172.21.15.6:0/1201452257 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8340cb650 con 0x7fc8340af8b0 2023-10-06T02:20:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.653+0000 7fc83159a700 1 -- 172.21.15.6:0/1201452257 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764789045 0 0) 0x7fc83415e190 con 0x7fc83415d460 2023-10-06T02:20:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.653+0000 7fc83259c700 1 --2- 172.21.15.6:0/1201452257 >> v2:172.21.15.175:3300/0 conn(0x7fc8340af4e0 0x7fc8340b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:20:33.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.653+0000 7fc831d9b700 1 --2- 172.21.15.6:0/1201452257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8340af8b0 0x7fc8340b2620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0098e0 tx=0x7fc81c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7564e6701117ad09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:33.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.654+0000 7fc83159a700 1 -- 172.21.15.6:0/1201452257 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c00b640 con 0x7fc8340af8b0 2023-10-06T02:20:33.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.654+0000 7fc83159a700 1 -- 172.21.15.6:0/1201452257 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c00b7a0 con 0x7fc8340af8b0 2023-10-06T02:20:33.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.654+0000 7fc83159a700 1 -- 172.21.15.6:0/1201452257 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c00bb40 con 0x7fc8340af8b0 2023-10-06T02:20:33.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.654+0000 7fc838f9d700 1 -- 172.21.15.6:0/1201452257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8340af8b0 msgr2=0x7fc8340b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.654+0000 7fc838f9d700 1 --2- 172.21.15.6:0/1201452257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8340af8b0 0x7fc8340b2620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0098e0 tx=0x7fc81c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.654+0000 7fc838f9d700 1 -- 172.21.15.6:0/1201452257 shutdown_connections 2023-10-06T02:20:33.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.654+0000 7fc838f9d700 1 --2- 172.21.15.6:0/1201452257 >> v2:172.21.15.175:3300/0 conn(0x7fc8340af4e0 0x7fc8340b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.654+0000 7fc838f9d700 1 --2- 172.21.15.6:0/1201452257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8340af8b0 0x7fc8340b2620 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.654+0000 7fc838f9d700 1 -- 172.21.15.6:0/1201452257 >> 172.21.15.6:0/1201452257 conn(0x7fc834068680 msgr2=0x7fc834068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:33.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.654+0000 7fc838f9d700 1 -- 172.21.15.6:0/1201452257 shutdown_connections 2023-10-06T02:20:33.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.654+0000 7fc838f9d700 1 -- 172.21.15.6:0/1201452257 wait complete. 2023-10-06T02:20:33.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.655+0000 7fc838f9d700 1 Processor -- start 2023-10-06T02:20:33.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.655+0000 7fc838f9d700 1 -- start start 2023-10-06T02:20:33.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.656+0000 7fc838f9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8340af4e0 0x7fc8340a7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.656+0000 7fc838f9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8340af8b0 0x7fc83416b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.656+0000 7fc838f9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc83415d460 0x7fc8340c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.656+0000 7fc838f9d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340c8080 con 0x7fc8340af4e0 2023-10-06T02:20:33.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.656+0000 7fc838f9d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340c7470 con 0x7fc8340af8b0 2023-10-06T02:20:33.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.656+0000 7fc838f9d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340c7750 con 0x7fc83415d460 2023-10-06T02:20:33.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.656+0000 7fc83259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8340af4e0 0x7fc8340a7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.656+0000 7fc83259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8340af4e0 0x7fc8340a7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56618/0 (socket says 172.21.15.6:56618) 2023-10-06T02:20:33.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.656+0000 7fc83259c700 1 -- 172.21.15.6:0/373577026 learned_addr learned my addr 172.21.15.6:0/373577026 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:33.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.656+0000 7fc831d9b700 1 --2- 172.21.15.6:0/373577026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8340af8b0 0x7fc83416b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.656+0000 7fc832d9d700 1 --2- 172.21.15.6:0/373577026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc83415d460 0x7fc8340c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.656+0000 7fc83259c700 1 -- 172.21.15.6:0/373577026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc83415d460 msgr2=0x7fc8340c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.656+0000 7fc83259c700 1 --2- 172.21.15.6:0/373577026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc83415d460 0x7fc8340c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.656+0000 7fc83259c700 1 -- 172.21.15.6:0/373577026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8340af8b0 msgr2=0x7fc83416b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.656+0000 7fc83259c700 1 --2- 172.21.15.6:0/373577026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8340af8b0 0x7fc83416b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.656+0000 7fc83259c700 1 -- 172.21.15.6:0/373577026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c0094f0 con 0x7fc8340af4e0 2023-10-06T02:20:33.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.656+0000 7fc832d9d700 1 --2- 172.21.15.6:0/373577026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc83415d460 0x7fc8340c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:33.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.657+0000 7fc83259c700 1 --2- 172.21.15.6:0/373577026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8340af4e0 0x7fc8340a7c40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00ec50 tx=0x7fc82c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:33.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.657+0000 7fc82a7fc700 1 -- 172.21.15.6:0/373577026 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00c850 con 0x7fc8340af4e0 2023-10-06T02:20:33.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.657+0000 7fc82a7fc700 1 -- 172.21.15.6:0/373577026 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c00c9b0 con 0x7fc8340af4e0 2023-10-06T02:20:33.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.657+0000 7fc838f9d700 1 -- 172.21.15.6:0/373577026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c009420 con 0x7fc8340af4e0 2023-10-06T02:20:33.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.657+0000 7fc82a7fc700 1 -- 172.21.15.6:0/373577026 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00cd30 con 0x7fc8340af4e0 2023-10-06T02:20:33.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.657+0000 7fc838f9d700 1 -- 172.21.15.6:0/373577026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8340c7d10 con 0x7fc8340af4e0 2023-10-06T02:20:33.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.658+0000 7fc838f9d700 1 -- 172.21.15.6:0/373577026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc834088aa0 con 0x7fc8340af4e0 2023-10-06T02:20:33.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.658+0000 7fc82a7fc700 1 -- 172.21.15.6:0/373577026 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc82c013680 con 0x7fc8340af4e0 2023-10-06T02:20:33.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.659+0000 7fc82a7fc700 1 --2- 172.21.15.6:0/373577026 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc814066f30 0x7fc8140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:33.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.659+0000 7fc82a7fc700 1 -- 172.21.15.6:0/373577026 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fc82c084fe0 con 0x7fc8340af4e0 2023-10-06T02:20:33.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.659+0000 7fc831d9b700 1 --2- 172.21.15.6:0/373577026 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc814066f30 0x7fc8140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:33.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.659+0000 7fc831d9b700 1 --2- 172.21.15.6:0/373577026 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc814066f30 0x7fc8140693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0093f0 tx=0x7fc81c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:33.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.663+0000 7fc82a7fc700 1 -- 172.21.15.6:0/373577026 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc82c051f60 con 0x7fc8340af4e0 2023-10-06T02:20:33.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.901+0000 7fc838f9d700 1 -- 172.21.15.6:0/373577026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc83415dd60 con 0x7fc8340af4e0 2023-10-06T02:20:33.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.901+0000 7fc82a7fc700 1 -- 172.21.15.6:0/373577026 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7fc82c055580 con 0x7fc8340af4e0 2023-10-06T02:20:33.902 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:33.902 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2589522502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2589522502},{"type":"v1","addr":"172.21.15.175:6837","nonce":2589522502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3703329287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3703329287},{"type":"v1","addr":"172.21.15.175:6836","nonce":3703329287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/843207095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":843207095},{"type":"v1","addr":"172.21.15.6:6834","nonce":843207095}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:10.479851+0000","modified":"2023-10-06T02:20:33.567905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5973":{"gid":5973,"name":"a","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.6:6835/1891041000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1891041000},{"type":"v1","addr":"172.21.15.6:6835","nonce":1891041000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:20:33.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.903+0000 7fc838f9d700 1 -- 172.21.15.6:0/373577026 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc814066f30 msgr2=0x7fc8140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.903+0000 7fc838f9d700 1 --2- 172.21.15.6:0/373577026 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc814066f30 0x7fc8140693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0093f0 tx=0x7fc81c017000 comp rx=0 tx=0).stop 2023-10-06T02:20:33.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.903+0000 7fc838f9d700 1 -- 172.21.15.6:0/373577026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8340af4e0 msgr2=0x7fc8340a7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:33.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.903+0000 7fc838f9d700 1 --2- 172.21.15.6:0/373577026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8340af4e0 0x7fc8340a7c40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00ec50 tx=0x7fc82c009250 comp rx=0 tx=0).stop 2023-10-06T02:20:33.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.903+0000 7fc838f9d700 1 -- 172.21.15.6:0/373577026 shutdown_connections 2023-10-06T02:20:33.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.904+0000 7fc838f9d700 1 --2- 172.21.15.6:0/373577026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc83415d460 0x7fc8340c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.904+0000 7fc838f9d700 1 --2- 172.21.15.6:0/373577026 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc814066f30 0x7fc8140693e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.904+0000 7fc838f9d700 1 --2- 172.21.15.6:0/373577026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8340af4e0 0x7fc8340a7c40 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.904+0000 7fc838f9d700 1 --2- 172.21.15.6:0/373577026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8340af8b0 0x7fc83416b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:33.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.904+0000 7fc838f9d700 1 -- 172.21.15.6:0/373577026 >> 172.21.15.6:0/373577026 conn(0x7fc834068680 msgr2=0x7fc8340cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:33.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.904+0000 7fc838f9d700 1 -- 172.21.15.6:0/373577026 shutdown_connections 2023-10-06T02:20:33.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:33.904+0000 7fc838f9d700 1 -- 172.21.15.6:0/373577026 wait complete. 2023-10-06T02:20:33.905 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 38 2023-10-06T02:20:33.916 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump tree /a 0 2023-10-06T02:20:34.052 INFO:teuthology.orchestra.run.smithi006.stdout:[{"ino":1099511627776,"rdev":0,"ctime":"2023-10-06T02:20:29.465419+0000","btime":"2023-10-06T02:20:23.504918+0000","mode":16893,"uid":1000,"gid":1275,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2023-10-06T02:20:29.465419+0000","atime":"2023-10-06T02:20:23.504918+0000","time_warp_seq":0,"change_attr":3,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2023-10-06T02:20:29.465419+0000","num_files":0,"num_subdirs":1,"change_attr":3},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":2,"rsnaps":0,"rctime":"2023-10-06T02:20:29.465419+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":2,"rsnaps":0,"rctime":"2023-10-06T02:20:29.465419+0000"},"version":9,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirfrag":1,"dirty":1},"nref":2,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"states":["auth","dirty"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[{"path":"/a","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"7","version":"7","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1},"nref":1,"dentries":[{"path":"a/c","path_ino":1,"snap_first":18446744073709551606,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511627777,"remote_type":"","version":4,"projected_version":4,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"inodepin":1,"dirty":1},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]},{"path":"a/b","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":false,"is_remote":false,"is_null":true,"is_new":false,"inode":0,"remote_type":"","version":5,"projected_version":5,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirty":1},"nref":1,"lock":{},"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}]}] 2023-10-06T02:20:34.053 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 0, "rctime": "2023-10-06T02:20:29.465419+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "atime": "2023-10-06T02:20:23.504918+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2023-10-06T02:20:23.504918+0000", "change_attr": 3, "client_caps": [], "client_ranges": [], "ctime": "2023-10-06T02:20:29.465419+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511627777, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "a/c", "path_ino": 1, "pins": { "dirty": 1, "inodepin": 1 }, "projected_version": 4, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 18446744073709551606, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} } }, { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 0, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": true, "is_primary": false, "is_remote": false, "lock": {}, "nref": 1, "path": "a/b", "path_ino": 1, "pins": { "dirty": 1 }, "projected_version": 5, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 5, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/a", "pins": { "child": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth" ], "version": "7" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 3, "mtime": "2023-10-06T02:20:29.465419+0000", "num_files": 0, "num_subdirs": 1, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1275, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2023-10-06T02:20:29.465419+0000", "nestlock": {}, "nlink": 1, "nref": 2, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "dirfrag": 1, "dirty": 1 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2023-10-06T02:20:29.465419+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 9, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } ] 2023-10-06T02:20:34.054 DEBUG:tasks.cephfs.test_damage:[{'ino': 1099511627776, 'rdev': 0, 'ctime': '2023-10-06T02:20:29.465419+0000', 'btime': '2023-10-06T02:20:23.504918+0000', 'mode': 16893, 'uid': 1000, 'gid': 1275, 'nlink': 1, 'dir_layout': {'dir_hash': 2, 'unused1': 0, 'unused2': 0, 'unused3': 0}, 'layout': {'stripe_unit': 0, 'stripe_count': 0, 'object_size': 0, 'pool_id': -1, 'pool_ns': ''}, 'old_pools': [], 'size': 0, 'truncate_seq': 1, 'truncate_size': 18446744073709551615, 'truncate_from': 0, 'truncate_pending': 0, 'mtime': '2023-10-06T02:20:29.465419+0000', 'atime': '2023-10-06T02:20:23.504918+0000', 'time_warp_seq': 0, 'change_attr': 3, 'export_pin': -1, 'export_ephemeral_random_pin': 0, 'export_ephemeral_distributed_pin': False, 'client_ranges': [], 'dirstat': {'version': 0, 'mtime': '2023-10-06T02:20:29.465419+0000', 'num_files': 0, 'num_subdirs': 1, 'change_attr': 3}, 'rstat': {'version': 0, 'rbytes': 0, 'rfiles': 0, 'rsubdirs': 2, 'rsnaps': 0, 'rctime': '2023-10-06T02:20:29.465419+0000'}, 'accounted_rstat': {'version': 0, 'rbytes': 0, 'rfiles': 0, 'rsubdirs': 2, 'rsnaps': 0, 'rctime': '2023-10-06T02:20:29.465419+0000'}, 'version': 9, 'file_data_version': 0, 'xattr_version': 1, 'backtrace_version': 2, 'stray_prior_path': '', 'max_size_ever': 0, 'quota': {'max_bytes': 0, 'max_files': 0}, 'last_scrub_stamp': '0.000000', 'last_scrub_version': 0, 'symlink': '', 'xattrs': [], 'dirfragtree': {'splits': []}, 'old_inodes': [], 'oldest_snap': 18446744073709551614, 'damage_flags': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'dirfrag': 1, 'dirty': 1}, 'nref': 2, 'versionlock': {'gather_set': [], 'state': 'lock', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'authlock': {}, 'linklock': {}, 'dirfragtreelock': {}, 'filelock': {}, 'xattrlock': {}, 'snaplock': {}, 'nestlock': {}, 'flocklock': {}, 'policylock': {}, 'states': ['auth', 'dirty'], 'client_caps': [], 'loner': -1, 'want_loner': -1, 'mds_caps_wanted': [], 'dirfrags': [{'path': '/a', 'dirfrag': '0x10000000000', 'snapid_first': 2, 'projected_version': '7', 'version': '7', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '', 'states': ['auth'], 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'child': 1}, 'nref': 1, 'dentries': [{'path': 'a/c', 'path_ino': 1, 'snap_first': 18446744073709551606, 'snap_last': 18446744073709551614, 'is_primary': True, 'is_remote': False, 'is_null': False, 'is_new': False, 'inode': 1099511627777, 'remote_type': '', 'version': 4, 'projected_version': 4, 'auth_pins': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'is_frozen': False, 'is_freezing': False, 'pins': {'inodepin': 1, 'dirty': 1}, 'nref': 2, 'lock': {}, 'versionlock': {'gather_set': [], 'state': 'lock', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'states': ['auth', 'dirty']}, {'path': 'a/b', 'path_ino': 1, 'snap_first': 2, 'snap_last': 18446744073709551614, 'is_primary': False, 'is_remote': False, 'is_null': True, 'is_new': False, 'inode': 0, 'remote_type': '', 'version': 5, 'projected_version': 5, 'auth_pins': 0, 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'is_frozen': False, 'is_freezing': False, 'pins': {'dirty': 1}, 'nref': 1, 'lock': {}, 'versionlock': {'gather_set': [], 'state': 'lock', 'is_leased': False, 'num_rdlocks': 0, 'num_wrlocks': 0, 'num_xlocks': 0, 'xlock_by': {}}, 'states': ['auth', 'dirty']}]}]}] 2023-10-06T02:20:34.054 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:20:34.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:20:34.091 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:20:34.135 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:20:34.135 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:20:34.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:20:34.136 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:20:34.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:20:34.151 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:20:34.152 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:20:34.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:20:34.152 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:20:34.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:20:34.193 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T02:20:34.193 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:20:34.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:20:34.193 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T02:20:34.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:20:34.209 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T02:20:34.210 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:20:34.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:20:34.210 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T02:20:34.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:20:34.250 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T02:20:34.250 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:20:34.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.369+0000 7ff621194700 1 Processor -- start 2023-10-06T02:20:34.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.369+0000 7ff621194700 1 -- start start 2023-10-06T02:20:34.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.369+0000 7ff621194700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff61c1597c0 0x7ff61c06a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:34.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.369+0000 7ff621194700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff61c069950 con 0x7ff61c1593f0 2023-10-06T02:20:34.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff621194700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff61c0b1fb0 con 0x7ff61c06e520 2023-10-06T02:20:34.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff621194700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c0b2850 con 0x7ff61c1597c0 2023-10-06T02:20:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff61ad9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff61c1593f0 0x7ff61c06de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46702/0 (socket says 172.21.15.6:46702) 2023-10-06T02:20:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff61ad9d700 1 -- 172.21.15.6:0/3407398773 learned_addr learned my addr 172.21.15.6:0/3407398773 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff619d9b700 1 -- 172.21.15.6:0/3407398773 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368614794 0 0) 0x7ff61c069950 con 0x7ff61c1593f0 2023-10-06T02:20:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff61b59e700 1 --2- 172.21.15.6:0/3407398773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff61c1597c0 0x7ff61c06a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff619d9b700 1 -- 172.21.15.6:0/3407398773 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff604003570 con 0x7ff61c1593f0 2023-10-06T02:20:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff619d9b700 1 -- 172.21.15.6:0/3407398773 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1863414476 0 0) 0x7ff604003570 con 0x7ff61c1593f0 2023-10-06T02:20:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff619d9b700 1 -- 172.21.15.6:0/3407398773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff61c1597c0 msgr2=0x7ff61c06a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff619d9b700 1 --2- 172.21.15.6:0/3407398773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff61c1597c0 0x7ff61c06a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff619d9b700 1 -- 172.21.15.6:0/3407398773 >> v1:172.21.15.175:6789/0 conn(0x7ff61c06e520 legacy=0x7ff61c069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff619d9b700 1 -- 172.21.15.6:0/3407398773 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c0b2290 con 0x7ff61c1593f0 2023-10-06T02:20:34.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff619d9b700 1 -- 172.21.15.6:0/3407398773 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7ff60c001470 con 0x7ff61c1593f0 2023-10-06T02:20:34.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff619d9b700 1 -- 172.21.15.6:0/3407398773 >> v1:172.21.15.6:6789/0 conn(0x7ff61c1593f0 legacy=0x7ff61c06de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:34.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff619d9b700 1 --2- 172.21.15.6:0/3407398773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff604003a90 0x7ff604003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:34.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff619d9b700 1 --2- 172.21.15.6:0/3407398773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff604004810 0x7ff604004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:34.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff619d9b700 1 --2- 172.21.15.6:0/3407398773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff61c1597c0 0x7ff604005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:34.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff619d9b700 1 -- 172.21.15.6:0/3407398773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c0b2850 con 0x7ff604003a90 2023-10-06T02:20:34.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff619d9b700 1 -- 172.21.15.6:0/3407398773 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60400bbf0 con 0x7ff604004810 2023-10-06T02:20:34.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff619d9b700 1 -- 172.21.15.6:0/3407398773 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60400bd80 con 0x7ff61c1597c0 2023-10-06T02:20:34.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff61ad9d700 1 --2- 172.21.15.6:0/3407398773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff604003a90 0x7ff604003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:34.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff61b59e700 1 --2- 172.21.15.6:0/3407398773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff61c1597c0 0x7ff604005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:34.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.370+0000 7ff61a59c700 1 --2- 172.21.15.6:0/3407398773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff604004810 0x7ff604004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:34.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.371+0000 7ff61ad9d700 1 -- 172.21.15.6:0/3407398773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff61c1597c0 msgr2=0x7ff604005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:34.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.371+0000 7ff61ad9d700 1 --2- 172.21.15.6:0/3407398773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff61c1597c0 0x7ff604005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.371+0000 7ff61ad9d700 1 -- 172.21.15.6:0/3407398773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff604004810 msgr2=0x7ff604004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:34.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.371+0000 7ff61ad9d700 1 --2- 172.21.15.6:0/3407398773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff604004810 0x7ff604004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.371+0000 7ff61ad9d700 1 -- 172.21.15.6:0/3407398773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff604003570 con 0x7ff604003a90 2023-10-06T02:20:34.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.371+0000 7ff61ad9d700 1 --2- 172.21.15.6:0/3407398773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff604003a90 0x7ff604003ea0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00c300 tx=0x7ff60c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39783a69a2a5dee4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:34.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.371+0000 7ff619d9b700 1 -- 172.21.15.6:0/3407398773 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c00cb90 con 0x7ff604003a90 2023-10-06T02:20:34.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.371+0000 7ff619d9b700 1 -- 172.21.15.6:0/3407398773 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60c00cd10 con 0x7ff604003a90 2023-10-06T02:20:34.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.371+0000 7ff619d9b700 1 -- 172.21.15.6:0/3407398773 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c005b70 con 0x7ff604003a90 2023-10-06T02:20:34.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.371+0000 7ff621194700 1 -- 172.21.15.6:0/3407398773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff604003a90 msgr2=0x7ff604003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:34.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.371+0000 7ff621194700 1 --2- 172.21.15.6:0/3407398773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff604003a90 0x7ff604003ea0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00c300 tx=0x7ff60c001d80 comp rx=0 tx=0).stop 2023-10-06T02:20:34.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.371+0000 7ff61b59e700 1 -- 172.21.15.6:0/3407398773 reap_dead start 2023-10-06T02:20:34.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.372+0000 7ff621194700 1 -- 172.21.15.6:0/3407398773 shutdown_connections 2023-10-06T02:20:34.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.372+0000 7ff621194700 1 -- 172.21.15.6:0/3407398773 >> 172.21.15.6:0/3407398773 conn(0x7ff61c06cff0 msgr2=0x7ff61c0afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:34.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.372+0000 7ff621194700 1 -- 172.21.15.6:0/3407398773 shutdown_connections 2023-10-06T02:20:34.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.372+0000 7ff621194700 1 -- 172.21.15.6:0/3407398773 wait complete. 2023-10-06T02:20:34.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.373+0000 7ff621194700 1 Processor -- start 2023-10-06T02:20:34.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.373+0000 7ff621194700 1 -- start start 2023-10-06T02:20:34.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.373+0000 7ff621194700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff604003a90 0x7ff61c151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:34.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.373+0000 7ff621194700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff61c0c7dd0 0x7ff61c0c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:34.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.373+0000 7ff621194700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61c155890 0x7ff61c0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:34.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.373+0000 7ff621194700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c0c9460 con 0x7ff61c155890 2023-10-06T02:20:34.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.373+0000 7ff621194700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c0cbf80 con 0x7ff61c0c7dd0 2023-10-06T02:20:34.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.373+0000 7ff621194700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c0c8240 con 0x7ff604003a90 2023-10-06T02:20:34.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.374+0000 7ff61b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61c155890 0x7ff61c0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:34.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.374+0000 7ff61b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61c155890 0x7ff61c0cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56644/0 (socket says 172.21.15.6:56644) 2023-10-06T02:20:34.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.374+0000 7ff61b59e700 1 -- 172.21.15.6:0/694613121 learned_addr learned my addr 172.21.15.6:0/694613121 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:34.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.374+0000 7ff61ad9d700 1 --2- 172.21.15.6:0/694613121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff604003a90 0x7ff61c151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:34.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.374+0000 7ff61a59c700 1 --2- 172.21.15.6:0/694613121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff61c0c7dd0 0x7ff61c0c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:34.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.374+0000 7ff61b59e700 1 -- 172.21.15.6:0/694613121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff604003a90 msgr2=0x7ff61c151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:34.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.374+0000 7ff61b59e700 1 --2- 172.21.15.6:0/694613121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff604003a90 0x7ff61c151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.374+0000 7ff61b59e700 1 -- 172.21.15.6:0/694613121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff61c0c7dd0 msgr2=0x7ff61c0c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:34.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.374+0000 7ff61b59e700 1 --2- 172.21.15.6:0/694613121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff61c0c7dd0 0x7ff61c0c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.374+0000 7ff61b59e700 1 -- 172.21.15.6:0/694613121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c0c84a0 con 0x7ff61c155890 2023-10-06T02:20:34.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.374+0000 7ff61a59c700 1 --2- 172.21.15.6:0/694613121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff61c0c7dd0 0x7ff61c0c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:34.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.374+0000 7ff61b59e700 1 --2- 172.21.15.6:0/694613121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61c155890 0x7ff61c0cc410 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff6140094d0 tx=0x7ff61400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:34.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.374+0000 7ff602ffd700 1 -- 172.21.15.6:0/694613121 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61400e040 con 0x7ff61c155890 2023-10-06T02:20:34.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.374+0000 7ff602ffd700 1 -- 172.21.15.6:0/694613121 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61400f040 con 0x7ff61c155890 2023-10-06T02:20:34.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.374+0000 7ff621194700 1 -- 172.21.15.6:0/694613121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61c0cb930 con 0x7ff61c155890 2023-10-06T02:20:34.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.374+0000 7ff602ffd700 1 -- 172.21.15.6:0/694613121 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61400fdf0 con 0x7ff61c155890 2023-10-06T02:20:34.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.374+0000 7ff621194700 1 -- 172.21.15.6:0/694613121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61c0cb5e0 con 0x7ff61c155890 2023-10-06T02:20:34.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.375+0000 7ff621194700 1 -- 172.21.15.6:0/694613121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff61c06d3f0 con 0x7ff61c155890 2023-10-06T02:20:34.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.376+0000 7ff602ffd700 1 -- 172.21.15.6:0/694613121 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff614015640 con 0x7ff61c155890 2023-10-06T02:20:34.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.376+0000 7ff602ffd700 1 --2- 172.21.15.6:0/694613121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff608066f30 0x7ff6080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:34.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.376+0000 7ff602ffd700 1 -- 172.21.15.6:0/694613121 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff614085020 con 0x7ff61c155890 2023-10-06T02:20:34.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.376+0000 7ff61ad9d700 1 --2- 172.21.15.6:0/694613121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff608066f30 0x7ff6080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:34.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.377+0000 7ff61ad9d700 1 --2- 172.21.15.6:0/694613121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff608066f30 0x7ff6080693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00c2a0 tx=0x7ff60c015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:34.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.380+0000 7ff602ffd700 1 -- 172.21.15.6:0/694613121 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff614051fa0 con 0x7ff61c155890 2023-10-06T02:20:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.618+0000 7ff621194700 1 -- 172.21.15.6:0/694613121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff61c0b2570 con 0x7ff61c155890 2023-10-06T02:20:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.619+0000 7ff602ffd700 1 -- 172.21.15.6:0/694613121 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4595 (secure 0 0 0) 0x7ff6140555c0 con 0x7ff61c155890 2023-10-06T02:20:34.619 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:34.619 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2589522502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2589522502},{"type":"v1","addr":"172.21.15.175:6837","nonce":2589522502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3703329287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3703329287},{"type":"v1","addr":"172.21.15.175:6836","nonce":3703329287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/843207095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":843207095},{"type":"v1","addr":"172.21.15.6:6834","nonce":843207095}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:10.479851+0000","modified":"2023-10-06T02:20:34.571220+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5973":{"gid":5973,"name":"a","rank":0,"incarnation":37,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.6:6835/1891041000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1891041000},{"type":"v1","addr":"172.21.15.6:6835","nonce":1891041000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:20:34.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.621+0000 7ff621194700 1 -- 172.21.15.6:0/694613121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff608066f30 msgr2=0x7ff6080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:34.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.621+0000 7ff621194700 1 --2- 172.21.15.6:0/694613121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff608066f30 0x7ff6080693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00c2a0 tx=0x7ff60c015000 comp rx=0 tx=0).stop 2023-10-06T02:20:34.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.621+0000 7ff621194700 1 -- 172.21.15.6:0/694613121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61c155890 msgr2=0x7ff61c0cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:34.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.621+0000 7ff621194700 1 --2- 172.21.15.6:0/694613121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61c155890 0x7ff61c0cc410 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff6140094d0 tx=0x7ff61400b040 comp rx=0 tx=0).stop 2023-10-06T02:20:34.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.621+0000 7ff621194700 1 -- 172.21.15.6:0/694613121 shutdown_connections 2023-10-06T02:20:34.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.621+0000 7ff621194700 1 --2- 172.21.15.6:0/694613121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff608066f30 0x7ff6080693e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.621+0000 7ff621194700 1 --2- 172.21.15.6:0/694613121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61c155890 0x7ff61c0cc410 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.621+0000 7ff621194700 1 --2- 172.21.15.6:0/694613121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff604003a90 0x7ff61c151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.621+0000 7ff621194700 1 --2- 172.21.15.6:0/694613121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff61c0c7dd0 0x7ff61c0c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.621+0000 7ff621194700 1 -- 172.21.15.6:0/694613121 >> 172.21.15.6:0/694613121 conn(0x7ff61c06cff0 msgr2=0x7ff61c06ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:34.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.621+0000 7ff621194700 1 -- 172.21.15.6:0/694613121 shutdown_connections 2023-10-06T02:20:34.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.621+0000 7ff621194700 1 -- 172.21.15.6:0/694613121 wait complete. 2023-10-06T02:20:34.623 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 39 2023-10-06T02:20:34.634 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:20:34.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.752+0000 7fe421c76700 1 Processor -- start 2023-10-06T02:20:34.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.753+0000 7fe421c76700 1 -- start start 2023-10-06T02:20:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.753+0000 7fe421c76700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe41c0b27f0 0x7fe41c15db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.753+0000 7fe421c76700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41c15e190 con 0x7fe41c0af4e0 2023-10-06T02:20:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.753+0000 7fe421c76700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41c0cb650 con 0x7fe41c0af8b0 2023-10-06T02:20:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.753+0000 7fe421c76700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0b1910 con 0x7fe41c0b27f0 2023-10-06T02:20:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.753+0000 7fe41b7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe41c0af4e0 0x7fe41c0b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46706/0 (socket says 172.21.15.6:46706) 2023-10-06T02:20:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.753+0000 7fe41b7fe700 1 -- 172.21.15.6:0/1199006940 learned_addr learned my addr 172.21.15.6:0/1199006940 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41bfff700 1 --2- 172.21.15.6:0/1199006940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe41c0b27f0 0x7fe41c15db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41a7fc700 1 -- 172.21.15.6:0/1199006940 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741964266 0 0) 0x7fe41c15e190 con 0x7fe41c0af4e0 2023-10-06T02:20:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41a7fc700 1 -- 172.21.15.6:0/1199006940 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe404003570 con 0x7fe41c0af4e0 2023-10-06T02:20:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41a7fc700 1 -- 172.21.15.6:0/1199006940 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656113196 0 0) 0x7fe41c0cb650 con 0x7fe41c0af8b0 2023-10-06T02:20:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41a7fc700 1 -- 172.21.15.6:0/1199006940 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe41c15e190 con 0x7fe41c0af8b0 2023-10-06T02:20:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41a7fc700 1 -- 172.21.15.6:0/1199006940 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1967790473 0 0) 0x7fe404003570 con 0x7fe41c0af4e0 2023-10-06T02:20:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41a7fc700 1 -- 172.21.15.6:0/1199006940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe41c0b27f0 msgr2=0x7fe41c15db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41a7fc700 1 --2- 172.21.15.6:0/1199006940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe41c0b27f0 0x7fe41c15db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41a7fc700 1 -- 172.21.15.6:0/1199006940 >> v1:172.21.15.175:6789/0 conn(0x7fe41c0af8b0 legacy=0x7fe41c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41a7fc700 1 -- 172.21.15.6:0/1199006940 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c0ccaf0 con 0x7fe41c0af4e0 2023-10-06T02:20:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41a7fc700 1 -- 172.21.15.6:0/1199006940 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fe40c001470 con 0x7fe41c0af4e0 2023-10-06T02:20:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41a7fc700 1 -- 172.21.15.6:0/1199006940 >> v1:172.21.15.6:6789/0 conn(0x7fe41c0af4e0 legacy=0x7fe41c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41a7fc700 1 --2- 172.21.15.6:0/1199006940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe404003c20 0x7fe404004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41a7fc700 1 --2- 172.21.15.6:0/1199006940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe404004810 0x7fe404004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41a7fc700 1 --2- 172.21.15.6:0/1199006940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe41c0b27f0 0x7fe4040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41a7fc700 1 -- 172.21.15.6:0/1199006940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0b1910 con 0x7fe404004810 2023-10-06T02:20:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41a7fc700 1 -- 172.21.15.6:0/1199006940 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40400bb40 con 0x7fe404003c20 2023-10-06T02:20:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41a7fc700 1 -- 172.21.15.6:0/1199006940 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40400bd00 con 0x7fe41c0b27f0 2023-10-06T02:20:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41affd700 1 --2- 172.21.15.6:0/1199006940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe404004810 0x7fe404004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41b7fe700 1 --2- 172.21.15.6:0/1199006940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe404003c20 0x7fe404004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.754+0000 7fe41bfff700 1 --2- 172.21.15.6:0/1199006940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe41c0b27f0 0x7fe4040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.755+0000 7fe41affd700 1 -- 172.21.15.6:0/1199006940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe41c0b27f0 msgr2=0x7fe4040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.755+0000 7fe41affd700 1 --2- 172.21.15.6:0/1199006940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe41c0b27f0 0x7fe4040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.755+0000 7fe41affd700 1 -- 172.21.15.6:0/1199006940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe404003c20 msgr2=0x7fe404004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.755+0000 7fe41affd700 1 --2- 172.21.15.6:0/1199006940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe404003c20 0x7fe404004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.755+0000 7fe41affd700 1 -- 172.21.15.6:0/1199006940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe404003570 con 0x7fe404004810 2023-10-06T02:20:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.755+0000 7fe41affd700 1 --2- 172.21.15.6:0/1199006940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe404004810 0x7fe404004c80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe4100019e0 tx=0x7fe410007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7b93978244906 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.755+0000 7fe41a7fc700 1 -- 172.21.15.6:0/1199006940 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41000c5d0 con 0x7fe404004810 2023-10-06T02:20:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.755+0000 7fe41a7fc700 1 -- 172.21.15.6:0/1199006940 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41000c730 con 0x7fe404004810 2023-10-06T02:20:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.755+0000 7fe41a7fc700 1 -- 172.21.15.6:0/1199006940 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41000cad0 con 0x7fe404004810 2023-10-06T02:20:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.755+0000 7fe421c76700 1 -- 172.21.15.6:0/1199006940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe404004810 msgr2=0x7fe404004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.755+0000 7fe421c76700 1 --2- 172.21.15.6:0/1199006940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe404004810 0x7fe404004c80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe4100019e0 tx=0x7fe410007d30 comp rx=0 tx=0).stop 2023-10-06T02:20:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.755+0000 7fe41bfff700 1 -- 172.21.15.6:0/1199006940 reap_dead start 2023-10-06T02:20:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.755+0000 7fe421c76700 1 -- 172.21.15.6:0/1199006940 shutdown_connections 2023-10-06T02:20:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.755+0000 7fe421c76700 1 -- 172.21.15.6:0/1199006940 >> 172.21.15.6:0/1199006940 conn(0x7fe41c068680 msgr2=0x7fe41c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.755+0000 7fe421c76700 1 -- 172.21.15.6:0/1199006940 shutdown_connections 2023-10-06T02:20:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.755+0000 7fe421c76700 1 -- 172.21.15.6:0/1199006940 wait complete. 2023-10-06T02:20:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.757+0000 7fe421c76700 1 Processor -- start 2023-10-06T02:20:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.757+0000 7fe421c76700 1 -- start start 2023-10-06T02:20:34.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.757+0000 7fe421c76700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe41c1540d0 0x7fe41c16a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.757+0000 7fe421c76700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe41c0c7760 0x7fe41c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.757+0000 7fe421c76700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe41c0c9a60 0x7fe41c0c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.757+0000 7fe421c76700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c155930 con 0x7fe41c0c9a60 2023-10-06T02:20:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.757+0000 7fe421c76700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0ca440 con 0x7fe41c1540d0 2023-10-06T02:20:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.757+0000 7fe421c76700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c1578e0 con 0x7fe41c0c7760 2023-10-06T02:20:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.758+0000 7fe41bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe41c0c9a60 0x7fe41c0c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.758+0000 7fe41bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe41c0c9a60 0x7fe41c0c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56664/0 (socket says 172.21.15.6:56664) 2023-10-06T02:20:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.758+0000 7fe41bfff700 1 -- 172.21.15.6:0/1458461244 learned_addr learned my addr 172.21.15.6:0/1458461244 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.758+0000 7fe41affd700 1 --2- 172.21.15.6:0/1458461244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe41c0c7760 0x7fe41c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.758+0000 7fe41b7fe700 1 --2- 172.21.15.6:0/1458461244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe41c1540d0 0x7fe41c16a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.758+0000 7fe41bfff700 1 -- 172.21.15.6:0/1458461244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe41c0c7760 msgr2=0x7fe41c0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.758+0000 7fe41bfff700 1 --2- 172.21.15.6:0/1458461244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe41c0c7760 0x7fe41c0cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.758+0000 7fe41bfff700 1 -- 172.21.15.6:0/1458461244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe41c1540d0 msgr2=0x7fe41c16a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.758+0000 7fe41bfff700 1 --2- 172.21.15.6:0/1458461244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe41c1540d0 0x7fe41c16a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.758+0000 7fe41bfff700 1 -- 172.21.15.6:0/1458461244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c16aa60 con 0x7fe41c0c9a60 2023-10-06T02:20:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.758+0000 7fe41bfff700 1 --2- 172.21.15.6:0/1458461244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe41c0c9a60 0x7fe41c0c9f00 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe4140094d0 tx=0x7fe41400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.758+0000 7fe4037fe700 1 -- 172.21.15.6:0/1458461244 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41400e040 con 0x7fe41c0c9a60 2023-10-06T02:20:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.758+0000 7fe4037fe700 1 -- 172.21.15.6:0/1458461244 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41400f040 con 0x7fe41c0c9a60 2023-10-06T02:20:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.758+0000 7fe4037fe700 1 -- 172.21.15.6:0/1458461244 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41400fda0 con 0x7fe41c0c9a60 2023-10-06T02:20:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.758+0000 7fe421c76700 1 -- 172.21.15.6:0/1458461244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c0c7cb0 con 0x7fe41c0c9a60 2023-10-06T02:20:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.758+0000 7fe421c76700 1 -- 172.21.15.6:0/1458461244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41c157570 con 0x7fe41c0c9a60 2023-10-06T02:20:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.759+0000 7fe421c76700 1 -- 172.21.15.6:0/1458461244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41c157a70 con 0x7fe41c0c9a60 2023-10-06T02:20:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.760+0000 7fe4037fe700 1 -- 172.21.15.6:0/1458461244 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe414015640 con 0x7fe41c0c9a60 2023-10-06T02:20:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.760+0000 7fe4037fe700 1 --2- 172.21.15.6:0/1458461244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe408066f30 0x7fe4080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:34.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.760+0000 7fe4037fe700 1 -- 172.21.15.6:0/1458461244 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fe414084ff0 con 0x7fe41c0c9a60 2023-10-06T02:20:34.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.761+0000 7fe41b7fe700 1 --2- 172.21.15.6:0/1458461244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe408066f30 0x7fe4080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:34.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.761+0000 7fe41b7fe700 1 --2- 172.21.15.6:0/1458461244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe408066f30 0x7fe4080693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0d0ac0 tx=0x7fe41c0cb5c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:34.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.765+0000 7fe4037fe700 1 -- 172.21.15.6:0/1458461244 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe414051ef0 con 0x7fe41c0c9a60 2023-10-06T02:20:34.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.959+0000 7fe421c76700 1 -- 172.21.15.6:0/1458461244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe41c0cad20 con 0x7fe41c0c9a60 2023-10-06T02:20:34.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.960+0000 7fe4037fe700 1 -- 172.21.15.6:0/1458461244 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17150 (secure 0 0 0) 0x7fe414055510 con 0x7fe41c0c9a60 2023-10-06T02:20:34.961 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:34.961 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":55,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:20:30.553655+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:20:08.649152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T02:20:09.450444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/1800326966":"2023-10-07T02:20:30.553628+0000","172.21.15.6:6833/1800326966":"2023-10-07T02:20:30.553628+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:20:34.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.962+0000 7fe421c76700 1 -- 172.21.15.6:0/1458461244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe408066f30 msgr2=0x7fe4080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:34.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.962+0000 7fe421c76700 1 --2- 172.21.15.6:0/1458461244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe408066f30 0x7fe4080693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0d0ac0 tx=0x7fe41c0cb5c0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.962+0000 7fe421c76700 1 -- 172.21.15.6:0/1458461244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe41c0c9a60 msgr2=0x7fe41c0c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:34.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.962+0000 7fe421c76700 1 --2- 172.21.15.6:0/1458461244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe41c0c9a60 0x7fe41c0c9f00 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe4140094d0 tx=0x7fe41400b040 comp rx=0 tx=0).stop 2023-10-06T02:20:34.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.962+0000 7fe421c76700 1 -- 172.21.15.6:0/1458461244 shutdown_connections 2023-10-06T02:20:34.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.962+0000 7fe421c76700 1 --2- 172.21.15.6:0/1458461244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe408066f30 0x7fe4080693e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.962+0000 7fe421c76700 1 --2- 172.21.15.6:0/1458461244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe41c0c9a60 0x7fe41c0c9f00 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.962+0000 7fe421c76700 1 --2- 172.21.15.6:0/1458461244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe41c1540d0 0x7fe41c16a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.962+0000 7fe421c76700 1 --2- 172.21.15.6:0/1458461244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe41c0c7760 0x7fe41c0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:34.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.962+0000 7fe421c76700 1 -- 172.21.15.6:0/1458461244 >> 172.21.15.6:0/1458461244 conn(0x7fe41c068680 msgr2=0x7fe41c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:34.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.962+0000 7fe421c76700 1 -- 172.21.15.6:0/1458461244 shutdown_connections 2023-10-06T02:20:34.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:34.963+0000 7fe421c76700 1 -- 172.21.15.6:0/1458461244 wait complete. 2023-10-06T02:20:34.976 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:20:08.649152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:20:09.450444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:20:34.976 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:20:35.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.098+0000 7faec3b43700 1 Processor -- start 2023-10-06T02:20:35.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.098+0000 7faec3b43700 1 -- start start 2023-10-06T02:20:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.099+0000 7faec3b43700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faebc0cc3d0 0x7faebc0c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.099+0000 7faec3b43700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faebc0c3b40 con 0x7faebc0c3fd0 2023-10-06T02:20:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.099+0000 7faec3b43700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faebc0c2f30 con 0x7faebc1574b0 2023-10-06T02:20:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.099+0000 7faec3b43700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faebc0c4980 con 0x7faebc0cc3d0 2023-10-06T02:20:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.099+0000 7faec20e0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faebc0cc3d0 0x7faebc0c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.099+0000 7faec20e0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faebc0cc3d0 0x7faebc0c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56678/0 (socket says 172.21.15.6:56678) 2023-10-06T02:20:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.099+0000 7faec10de700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faebc0c3fd0 0x7faebc0cbcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46718/0 (socket says 172.21.15.6:46718) 2023-10-06T02:20:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.099+0000 7faec20e0700 1 -- 172.21.15.6:0/2577858499 learned_addr learned my addr 172.21.15.6:0/2577858499 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.099+0000 7faec08dd700 1 -- 172.21.15.6:0/2577858499 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025372887 0 0) 0x7faebc0c3b40 con 0x7faebc0c3fd0 2023-10-06T02:20:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.099+0000 7faec08dd700 1 -- 172.21.15.6:0/2577858499 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faea8003570 con 0x7faebc0c3fd0 2023-10-06T02:20:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.099+0000 7faec08dd700 1 -- 172.21.15.6:0/2577858499 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389524718 0 0) 0x7faebc0c2f30 con 0x7faebc1574b0 2023-10-06T02:20:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.099+0000 7faec08dd700 1 -- 172.21.15.6:0/2577858499 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faebc0c3b40 con 0x7faebc1574b0 2023-10-06T02:20:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.099+0000 7faec20e0700 1 -- 172.21.15.6:0/2577858499 >> v1:172.21.15.175:6789/0 conn(0x7faebc1574b0 legacy=0x7faebc0b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.099+0000 7faec20e0700 1 -- 172.21.15.6:0/2577858499 >> v1:172.21.15.6:6789/0 conn(0x7faebc0c3fd0 legacy=0x7faebc0cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.099+0000 7faec20e0700 1 -- 172.21.15.6:0/2577858499 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc0c3210 con 0x7faebc0cc3d0 2023-10-06T02:20:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.099+0000 7faec20e0700 1 --2- 172.21.15.6:0/2577858499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faebc0cc3d0 0x7faebc0c4440 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009f20 tx=0x7faeb4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c976f72e1cec148 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.100+0000 7faec08dd700 1 -- 172.21.15.6:0/2577858499 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb400e070 con 0x7faebc0cc3d0 2023-10-06T02:20:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.100+0000 7faec08dd700 1 -- 172.21.15.6:0/2577858499 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb400b930 con 0x7faebc0cc3d0 2023-10-06T02:20:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.100+0000 7faec08dd700 1 -- 172.21.15.6:0/2577858499 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb40092e0 con 0x7faebc0cc3d0 2023-10-06T02:20:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.100+0000 7faec3b43700 1 -- 172.21.15.6:0/2577858499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faebc0cc3d0 msgr2=0x7faebc0c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.100+0000 7faec3b43700 1 --2- 172.21.15.6:0/2577858499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faebc0cc3d0 0x7faebc0c4440 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009f20 tx=0x7faeb4009840 comp rx=0 tx=0).stop 2023-10-06T02:20:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.100+0000 7faec3b43700 1 -- 172.21.15.6:0/2577858499 shutdown_connections 2023-10-06T02:20:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.100+0000 7faec3b43700 1 --2- 172.21.15.6:0/2577858499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faebc0cc3d0 0x7faebc0c4440 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.100+0000 7faec3b43700 1 -- 172.21.15.6:0/2577858499 >> 172.21.15.6:0/2577858499 conn(0x7faebc067910 msgr2=0x7faebc0ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:35.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.100+0000 7faec3b43700 1 -- 172.21.15.6:0/2577858499 shutdown_connections 2023-10-06T02:20:35.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.100+0000 7faec3b43700 1 -- 172.21.15.6:0/2577858499 wait complete. 2023-10-06T02:20:35.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.102+0000 7faec3b43700 1 Processor -- start 2023-10-06T02:20:35.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.102+0000 7faec3b43700 1 -- start start 2023-10-06T02:20:35.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.103+0000 7faec3b43700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faebc0c3fd0 0x7faebc152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:35.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.103+0000 7faec3b43700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faebc0cc3d0 0x7faebc158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:35.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.103+0000 7faec3b43700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faebc1574b0 0x7faebc159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:35.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.103+0000 7faec3b43700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc0c9c10 con 0x7faebc0c3fd0 2023-10-06T02:20:35.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.103+0000 7faec3b43700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc0c9070 con 0x7faebc1574b0 2023-10-06T02:20:35.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.103+0000 7faec3b43700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faebc0c92e0 con 0x7faebc0cc3d0 2023-10-06T02:20:35.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.103+0000 7faec18df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faebc0c3fd0 0x7faebc152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:35.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.103+0000 7faec18df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faebc0c3fd0 0x7faebc152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56680/0 (socket says 172.21.15.6:56680) 2023-10-06T02:20:35.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.103+0000 7faec18df700 1 -- 172.21.15.6:0/3479813838 learned_addr learned my addr 172.21.15.6:0/3479813838 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:35.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.103+0000 7faec10de700 1 --2- 172.21.15.6:0/3479813838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faebc0cc3d0 0x7faebc158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:35.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.103+0000 7faec20e0700 1 --2- 172.21.15.6:0/3479813838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faebc1574b0 0x7faebc159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:35.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.103+0000 7faec18df700 1 -- 172.21.15.6:0/3479813838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faebc0cc3d0 msgr2=0x7faebc158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.103+0000 7faec18df700 1 --2- 172.21.15.6:0/3479813838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faebc0cc3d0 0x7faebc158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.103+0000 7faec18df700 1 -- 172.21.15.6:0/3479813838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faebc1574b0 msgr2=0x7faebc159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.103+0000 7faec18df700 1 --2- 172.21.15.6:0/3479813838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faebc1574b0 0x7faebc159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.103+0000 7faec18df700 1 -- 172.21.15.6:0/3479813838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb4009ae0 con 0x7faebc0c3fd0 2023-10-06T02:20:35.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.103+0000 7faec18df700 1 --2- 172.21.15.6:0/3479813838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faebc0c3fd0 0x7faebc152b50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7faeb800c4f0 tx=0x7faeb8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.104+0000 7faeb1ffb700 1 -- 172.21.15.6:0/3479813838 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb800cea0 con 0x7faebc0c3fd0 2023-10-06T02:20:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.104+0000 7faeb1ffb700 1 -- 172.21.15.6:0/3479813838 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb8011590 con 0x7faebc0c3fd0 2023-10-06T02:20:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.104+0000 7faec3b43700 1 -- 172.21.15.6:0/3479813838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faebc0c95c0 con 0x7faebc0c3fd0 2023-10-06T02:20:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.104+0000 7faeb1ffb700 1 -- 172.21.15.6:0/3479813838 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb8011970 con 0x7faebc0c3fd0 2023-10-06T02:20:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.104+0000 7faec3b43700 1 -- 172.21.15.6:0/3479813838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faebc153090 con 0x7faebc0c3fd0 2023-10-06T02:20:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.105+0000 7faec3b43700 1 -- 172.21.15.6:0/3479813838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faebc06e590 con 0x7faebc0c3fd0 2023-10-06T02:20:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.105+0000 7faeb1ffb700 1 -- 172.21.15.6:0/3479813838 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faeb801b3b0 con 0x7faebc0c3fd0 2023-10-06T02:20:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.106+0000 7faeb1ffb700 1 --2- 172.21.15.6:0/3479813838 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faea0066f30 0x7faea00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.106+0000 7faeb1ffb700 1 -- 172.21.15.6:0/3479813838 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7faeb8083ad0 con 0x7faebc0c3fd0 2023-10-06T02:20:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.106+0000 7faec10de700 1 --2- 172.21.15.6:0/3479813838 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faea0066f30 0x7faea00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.106+0000 7faec10de700 1 --2- 172.21.15.6:0/3479813838 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faea0066f30 0x7faea00693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faebc0888f0 tx=0x7faeac007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:35.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.110+0000 7faeb1ffb700 1 -- 172.21.15.6:0/3479813838 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faeb8050b00 con 0x7faebc0c3fd0 2023-10-06T02:20:35.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.304+0000 7faec3b43700 1 -- 172.21.15.6:0/3479813838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faebc0c9ef0 con 0x7faebc0c3fd0 2023-10-06T02:20:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.304+0000 7faeb1ffb700 1 -- 172.21.15.6:0/3479813838 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7faeb8017070 con 0x7faebc0c3fd0 2023-10-06T02:20:35.305 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:20:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.306+0000 7faec3b43700 1 -- 172.21.15.6:0/3479813838 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faea0066f30 msgr2=0x7faea00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.306+0000 7faec3b43700 1 --2- 172.21.15.6:0/3479813838 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faea0066f30 0x7faea00693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faebc0888f0 tx=0x7faeac007d40 comp rx=0 tx=0).stop 2023-10-06T02:20:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.306+0000 7faec3b43700 1 -- 172.21.15.6:0/3479813838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faebc0c3fd0 msgr2=0x7faebc152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.306+0000 7faec3b43700 1 --2- 172.21.15.6:0/3479813838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faebc0c3fd0 0x7faebc152b50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7faeb800c4f0 tx=0x7faeb8007f70 comp rx=0 tx=0).stop 2023-10-06T02:20:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.307+0000 7faec3b43700 1 -- 172.21.15.6:0/3479813838 shutdown_connections 2023-10-06T02:20:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.307+0000 7faec3b43700 1 --2- 172.21.15.6:0/3479813838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faebc1574b0 0x7faebc159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.307+0000 7faec3b43700 1 --2- 172.21.15.6:0/3479813838 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faea0066f30 0x7faea00693e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.307+0000 7faec3b43700 1 --2- 172.21.15.6:0/3479813838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faebc0c3fd0 0x7faebc152b50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.307+0000 7faec3b43700 1 --2- 172.21.15.6:0/3479813838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faebc0cc3d0 0x7faebc158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.307+0000 7faec3b43700 1 -- 172.21.15.6:0/3479813838 >> 172.21.15.6:0/3479813838 conn(0x7faebc067910 msgr2=0x7faebc0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:35.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.307+0000 7faec3b43700 1 -- 172.21.15.6:0/3479813838 shutdown_connections 2023-10-06T02:20:35.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.307+0000 7faec3b43700 1 -- 172.21.15.6:0/3479813838 wait complete. 2023-10-06T02:20:35.319 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:20:35.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.440+0000 7f6c58ddd700 1 Processor -- start 2023-10-06T02:20:35.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.440+0000 7f6c58ddd700 1 -- start start 2023-10-06T02:20:35.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.441+0000 7f6c58ddd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6c5415a030 0x7f6c5415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:35.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.441+0000 7f6c58ddd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c540afc50 con 0x7f6c54087700 2023-10-06T02:20:35.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.441+0000 7f6c58ddd700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c540aff30 con 0x7f6c5415a940 2023-10-06T02:20:35.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.441+0000 7f6c58ddd700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c540b0cf0 con 0x7f6c5415a030 2023-10-06T02:20:35.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.441+0000 7f6c52d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6c54087700 0x7f6c540b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46728/0 (socket says 172.21.15.6:46728) 2023-10-06T02:20:35.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.441+0000 7f6c52d9d700 1 -- 172.21.15.6:0/1618708729 learned_addr learned my addr 172.21.15.6:0/1618708729 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:35.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.441+0000 7f6c5259c700 1 --2- 172.21.15.6:0/1618708729 >> v2:172.21.15.175:3300/0 conn(0x7f6c5415a030 0x7f6c5415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:35.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.442+0000 7f6c5159a700 1 -- 172.21.15.6:0/1618708729 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011637728 0 0) 0x7f6c540afc50 con 0x7f6c54087700 2023-10-06T02:20:35.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.442+0000 7f6c5159a700 1 -- 172.21.15.6:0/1618708729 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c40003570 con 0x7f6c54087700 2023-10-06T02:20:35.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.442+0000 7f6c5259c700 1 -- 172.21.15.6:0/1618708729 >> v1:172.21.15.175:6789/0 conn(0x7f6c5415a940 legacy=0x7f6c54086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.442+0000 7f6c5259c700 1 -- 172.21.15.6:0/1618708729 >> v1:172.21.15.6:6789/0 conn(0x7f6c54087700 legacy=0x7f6c540b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.442+0000 7f6c5259c700 1 -- 172.21.15.6:0/1618708729 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540b0210 con 0x7f6c5415a030 2023-10-06T02:20:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.442+0000 7f6c5259c700 1 --2- 172.21.15.6:0/1618708729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c5415a030 0x7f6c5415a400 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0098e0 tx=0x7f6c4c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e175d42877a4cd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.442+0000 7f6c5159a700 1 -- 172.21.15.6:0/1618708729 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00b640 con 0x7f6c5415a030 2023-10-06T02:20:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.442+0000 7f6c5159a700 1 -- 172.21.15.6:0/1618708729 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c00b7a0 con 0x7f6c5415a030 2023-10-06T02:20:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.442+0000 7f6c5159a700 1 -- 172.21.15.6:0/1618708729 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00bb20 con 0x7f6c5415a030 2023-10-06T02:20:35.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.443+0000 7f6c58ddd700 1 -- 172.21.15.6:0/1618708729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c5415a030 msgr2=0x7f6c5415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.443+0000 7f6c58ddd700 1 --2- 172.21.15.6:0/1618708729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c5415a030 0x7f6c5415a400 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0098e0 tx=0x7f6c4c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.443+0000 7f6c58ddd700 1 -- 172.21.15.6:0/1618708729 shutdown_connections 2023-10-06T02:20:35.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.443+0000 7f6c58ddd700 1 --2- 172.21.15.6:0/1618708729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c5415a030 0x7f6c5415a400 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.443+0000 7f6c58ddd700 1 -- 172.21.15.6:0/1618708729 >> 172.21.15.6:0/1618708729 conn(0x7f6c54068680 msgr2=0x7f6c54068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:35.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.443+0000 7f6c58ddd700 1 -- 172.21.15.6:0/1618708729 shutdown_connections 2023-10-06T02:20:35.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.443+0000 7f6c58ddd700 1 -- 172.21.15.6:0/1618708729 wait complete. 2023-10-06T02:20:35.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.444+0000 7f6c58ddd700 1 Processor -- start 2023-10-06T02:20:35.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.444+0000 7f6c58ddd700 1 -- start start 2023-10-06T02:20:35.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c58ddd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c54087700 0x7f6c54155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:35.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c58ddd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5415a030 0x7f6c5415cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:35.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c58ddd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c5415a940 0x7f6c5415d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:35.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c58ddd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540c63d0 con 0x7f6c5415a030 2023-10-06T02:20:35.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c58ddd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540c57c0 con 0x7f6c5415a940 2023-10-06T02:20:35.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c58ddd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540c5aa0 con 0x7f6c54087700 2023-10-06T02:20:35.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c51d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5415a030 0x7f6c5415cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:35.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c51d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5415a030 0x7f6c5415cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56694/0 (socket says 172.21.15.6:56694) 2023-10-06T02:20:35.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c51d9b700 1 -- 172.21.15.6:0/2539025319 learned_addr learned my addr 172.21.15.6:0/2539025319 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:35.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c5259c700 1 --2- 172.21.15.6:0/2539025319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c54087700 0x7f6c54155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:35.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c51d9b700 1 -- 172.21.15.6:0/2539025319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c54087700 msgr2=0x7f6c54155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c51d9b700 1 --2- 172.21.15.6:0/2539025319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c54087700 0x7f6c54155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c51d9b700 1 -- 172.21.15.6:0/2539025319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c5415a940 msgr2=0x7f6c5415d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c52d9d700 1 --2- 172.21.15.6:0/2539025319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c5415a940 0x7f6c5415d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:35.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c51d9b700 1 --2- 172.21.15.6:0/2539025319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c5415a940 0x7f6c5415d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c51d9b700 1 -- 172.21.15.6:0/2539025319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c009420 con 0x7f6c5415a030 2023-10-06T02:20:35.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c51d9b700 1 --2- 172.21.15.6:0/2539025319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5415a030 0x7f6c5415cfe0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00c590 tx=0x7f6c3c007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:35.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c4a7fc700 1 -- 172.21.15.6:0/2539025319 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c011590 con 0x7f6c5415a030 2023-10-06T02:20:35.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c4a7fc700 1 -- 172.21.15.6:0/2539025319 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c011730 con 0x7f6c5415a030 2023-10-06T02:20:35.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c4a7fc700 1 -- 172.21.15.6:0/2539025319 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c011af0 con 0x7f6c5415a030 2023-10-06T02:20:35.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c58ddd700 1 -- 172.21.15.6:0/2539025319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c540c5d80 con 0x7f6c5415a030 2023-10-06T02:20:35.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.445+0000 7f6c58ddd700 1 -- 172.21.15.6:0/2539025319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c54156030 con 0x7f6c5415a030 2023-10-06T02:20:35.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.446+0000 7f6c58ddd700 1 -- 172.21.15.6:0/2539025319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c540c6580 con 0x7f6c5415a030 2023-10-06T02:20:35.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.447+0000 7f6c4a7fc700 1 -- 172.21.15.6:0/2539025319 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c3c000f90 con 0x7f6c5415a030 2023-10-06T02:20:35.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.447+0000 7f6c4a7fc700 1 --2- 172.21.15.6:0/2539025319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6c34066f60 0x7f6c34069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:35.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.447+0000 7f6c4a7fc700 1 -- 172.21.15.6:0/2539025319 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f6c3c083ae0 con 0x7f6c5415a030 2023-10-06T02:20:35.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.447+0000 7f6c5259c700 1 --2- 172.21.15.6:0/2539025319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6c34066f60 0x7f6c34069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:35.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.448+0000 7f6c5259c700 1 --2- 172.21.15.6:0/2539025319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6c34066f60 0x7f6c34069410 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c003080 tx=0x7f6c4c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:35.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.451+0000 7f6c4a7fc700 1 -- 172.21.15.6:0/2539025319 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c3c04b5a0 con 0x7f6c5415a030 2023-10-06T02:20:35.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.646+0000 7f6c58ddd700 1 -- 172.21.15.6:0/2539025319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c540b04f0 con 0x7f6c5415a030 2023-10-06T02:20:35.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.647+0000 7f6c4a7fc700 1 -- 172.21.15.6:0/2539025319 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c3c017070 con 0x7f6c5415a030 2023-10-06T02:20:35.647 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:20:35.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.649+0000 7f6c58ddd700 1 -- 172.21.15.6:0/2539025319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6c34066f60 msgr2=0x7f6c34069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.649+0000 7f6c58ddd700 1 --2- 172.21.15.6:0/2539025319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6c34066f60 0x7f6c34069410 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c003080 tx=0x7f6c4c017000 comp rx=0 tx=0).stop 2023-10-06T02:20:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.649+0000 7f6c58ddd700 1 -- 172.21.15.6:0/2539025319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5415a030 msgr2=0x7f6c5415cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.649+0000 7f6c58ddd700 1 --2- 172.21.15.6:0/2539025319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5415a030 0x7f6c5415cfe0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00c590 tx=0x7f6c3c007ed0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.649+0000 7f6c58ddd700 1 -- 172.21.15.6:0/2539025319 shutdown_connections 2023-10-06T02:20:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.649+0000 7f6c58ddd700 1 --2- 172.21.15.6:0/2539025319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c5415a940 0x7f6c5415d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.649+0000 7f6c58ddd700 1 --2- 172.21.15.6:0/2539025319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c54087700 0x7f6c54155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.649+0000 7f6c58ddd700 1 --2- 172.21.15.6:0/2539025319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6c34066f60 0x7f6c34069410 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.649+0000 7f6c58ddd700 1 --2- 172.21.15.6:0/2539025319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5415a030 0x7f6c5415cfe0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.649+0000 7f6c58ddd700 1 -- 172.21.15.6:0/2539025319 >> 172.21.15.6:0/2539025319 conn(0x7f6c54068680 msgr2=0x7f6c54158620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.649+0000 7f6c58ddd700 1 -- 172.21.15.6:0/2539025319 shutdown_connections 2023-10-06T02:20:35.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.649+0000 7f6c58ddd700 1 -- 172.21.15.6:0/2539025319 wait complete. 2023-10-06T02:20:35.661 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:20:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.782+0000 7f7c169c2700 1 Processor -- start 2023-10-06T02:20:35.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.782+0000 7f7c169c2700 1 -- start start 2023-10-06T02:20:35.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.783+0000 7f7c169c2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c100b28c0 0x7f7c10087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:35.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.783+0000 7f7c169c2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c100afc50 con 0x7f7c10086ff0 2023-10-06T02:20:35.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.783+0000 7f7c169c2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c100aff30 con 0x7f7c1015a030 2023-10-06T02:20:35.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.783+0000 7f7c169c2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c100b0cf0 con 0x7f7c100b28c0 2023-10-06T02:20:35.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.783+0000 7f7c14f5f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c100b28c0 0x7f7c10087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:35.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.783+0000 7f7c14f5f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c100b28c0 0x7f7c10087470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56700/0 (socket says 172.21.15.6:56700) 2023-10-06T02:20:35.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.783+0000 7f7c14f5f700 1 -- 172.21.15.6:0/2798412035 learned_addr learned my addr 172.21.15.6:0/2798412035 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:35.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.783+0000 7f7c0f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7c10086ff0 0x7f7c100b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46736/0 (socket says 172.21.15.6:46736) 2023-10-06T02:20:35.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.783+0000 7f7c14f5f700 1 -- 172.21.15.6:0/2798412035 >> v1:172.21.15.175:6789/0 conn(0x7f7c1015a030 legacy=0x7f7c1015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:35.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.783+0000 7f7c14f5f700 1 -- 172.21.15.6:0/2798412035 >> v1:172.21.15.6:6789/0 conn(0x7f7c10086ff0 legacy=0x7f7c100b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.784+0000 7f7c14f5f700 1 -- 172.21.15.6:0/2798412035 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c100b0210 con 0x7f7c100b28c0 2023-10-06T02:20:35.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.784+0000 7f7c14f5f700 1 --2- 172.21.15.6:0/2798412035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c100b28c0 0x7f7c10087470 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009f20 tx=0x7f7c08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a198831fc134077 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:35.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.784+0000 7f7c0effd700 1 -- 172.21.15.6:0/2798412035 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800e070 con 0x7f7c100b28c0 2023-10-06T02:20:35.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.784+0000 7f7c0effd700 1 -- 172.21.15.6:0/2798412035 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800ba40 con 0x7f7c100b28c0 2023-10-06T02:20:35.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.784+0000 7f7c0effd700 1 -- 172.21.15.6:0/2798412035 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c080092e0 con 0x7f7c100b28c0 2023-10-06T02:20:35.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.784+0000 7f7c169c2700 1 -- 172.21.15.6:0/2798412035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c100b28c0 msgr2=0x7f7c10087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.784+0000 7f7c169c2700 1 --2- 172.21.15.6:0/2798412035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c100b28c0 0x7f7c10087470 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009f20 tx=0x7f7c08009840 comp rx=0 tx=0).stop 2023-10-06T02:20:35.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.784+0000 7f7c169c2700 1 -- 172.21.15.6:0/2798412035 shutdown_connections 2023-10-06T02:20:35.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.784+0000 7f7c169c2700 1 --2- 172.21.15.6:0/2798412035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c100b28c0 0x7f7c10087470 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.784+0000 7f7c169c2700 1 -- 172.21.15.6:0/2798412035 >> 172.21.15.6:0/2798412035 conn(0x7f7c10068680 msgr2=0x7f7c10068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:35.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.784+0000 7f7c169c2700 1 -- 172.21.15.6:0/2798412035 shutdown_connections 2023-10-06T02:20:35.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.784+0000 7f7c169c2700 1 -- 172.21.15.6:0/2798412035 wait complete. 2023-10-06T02:20:35.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.785+0000 7f7c169c2700 1 Processor -- start 2023-10-06T02:20:35.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.786+0000 7f7c169c2700 1 -- start start 2023-10-06T02:20:35.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.786+0000 7f7c169c2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c10086ff0 0x7f7c100c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:35.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.786+0000 7f7c169c2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c100b28c0 0x7f7c1015c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:35.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.786+0000 7f7c169c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c1015a030 0x7f7c10156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:35.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.786+0000 7f7c169c2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1016b040 con 0x7f7c1015a030 2023-10-06T02:20:35.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.786+0000 7f7c169c2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1015ad60 con 0x7f7c10086ff0 2023-10-06T02:20:35.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.786+0000 7f7c169c2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1015b040 con 0x7f7c100b28c0 2023-10-06T02:20:35.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.786+0000 7f7c14f5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c1015a030 0x7f7c10156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:35.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.786+0000 7f7c14f5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c1015a030 0x7f7c10156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56706/0 (socket says 172.21.15.6:56706) 2023-10-06T02:20:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.786+0000 7f7c14f5f700 1 -- 172.21.15.6:0/158522162 learned_addr learned my addr 172.21.15.6:0/158522162 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.787+0000 7f7c0ffff700 1 --2- 172.21.15.6:0/158522162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c10086ff0 0x7f7c100c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.787+0000 7f7c0f7fe700 1 --2- 172.21.15.6:0/158522162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c100b28c0 0x7f7c1015c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.787+0000 7f7c14f5f700 1 -- 172.21.15.6:0/158522162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c100b28c0 msgr2=0x7f7c1015c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.787+0000 7f7c14f5f700 1 --2- 172.21.15.6:0/158522162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c100b28c0 0x7f7c1015c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.787+0000 7f7c14f5f700 1 -- 172.21.15.6:0/158522162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c10086ff0 msgr2=0x7f7c100c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.787+0000 7f7c14f5f700 1 --2- 172.21.15.6:0/158522162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c10086ff0 0x7f7c100c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.787+0000 7f7c14f5f700 1 -- 172.21.15.6:0/158522162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c08009ae0 con 0x7f7c1015a030 2023-10-06T02:20:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.787+0000 7f7c14f5f700 1 --2- 172.21.15.6:0/158522162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c1015a030 0x7f7c10156570 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7c100891b0 tx=0x7f7c08017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.787+0000 7f7c07fff700 1 -- 172.21.15.6:0/158522162 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c080092e0 con 0x7f7c1015a030 2023-10-06T02:20:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.787+0000 7f7c07fff700 1 -- 172.21.15.6:0/158522162 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c08012d00 con 0x7f7c1015a030 2023-10-06T02:20:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.787+0000 7f7c169c2700 1 -- 172.21.15.6:0/158522162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1015b320 con 0x7f7c1015a030 2023-10-06T02:20:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.787+0000 7f7c07fff700 1 -- 172.21.15.6:0/158522162 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0801d650 con 0x7f7c1015a030 2023-10-06T02:20:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.787+0000 7f7c169c2700 1 -- 172.21.15.6:0/158522162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1015bb20 con 0x7f7c1015a030 2023-10-06T02:20:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.788+0000 7f7c169c2700 1 -- 172.21.15.6:0/158522162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c100c7830 con 0x7f7c1015a030 2023-10-06T02:20:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.789+0000 7f7c07fff700 1 -- 172.21.15.6:0/158522162 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c0801da00 con 0x7f7c1015a030 2023-10-06T02:20:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.789+0000 7f7c07fff700 1 --2- 172.21.15.6:0/158522162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f30 0x7f7bf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.789+0000 7f7c07fff700 1 -- 172.21.15.6:0/158522162 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7c08085fe0 con 0x7f7c1015a030 2023-10-06T02:20:35.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.789+0000 7f7c0ffff700 1 --2- 172.21.15.6:0/158522162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f30 0x7f7bf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:35.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.790+0000 7f7c0ffff700 1 --2- 172.21.15.6:0/158522162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f30 0x7f7bf00693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7c1015d500 tx=0x7f7c00007ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:35.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.793+0000 7f7c07fff700 1 -- 172.21.15.6:0/158522162 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c08052f60 con 0x7f7c1015a030 2023-10-06T02:20:35.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.985+0000 7f7c169c2700 1 -- 172.21.15.6:0/158522162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c1015bd10 con 0x7f7c1015a030 2023-10-06T02:20:35.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.986+0000 7f7c07fff700 1 -- 172.21.15.6:0/158522162 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c0801dcb0 con 0x7f7c1015a030 2023-10-06T02:20:35.986 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:20:35.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.988+0000 7f7c169c2700 1 -- 172.21.15.6:0/158522162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f30 msgr2=0x7f7bf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.988+0000 7f7c169c2700 1 --2- 172.21.15.6:0/158522162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f30 0x7f7bf00693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7c1015d500 tx=0x7f7c00007ea0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.988+0000 7f7c169c2700 1 -- 172.21.15.6:0/158522162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c1015a030 msgr2=0x7f7c10156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:35.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.988+0000 7f7c169c2700 1 --2- 172.21.15.6:0/158522162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c1015a030 0x7f7c10156570 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7c100891b0 tx=0x7f7c08017000 comp rx=0 tx=0).stop 2023-10-06T02:20:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.988+0000 7f7c169c2700 1 -- 172.21.15.6:0/158522162 shutdown_connections 2023-10-06T02:20:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.988+0000 7f7c169c2700 1 --2- 172.21.15.6:0/158522162 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bf0066f30 0x7f7bf00693e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.988+0000 7f7c169c2700 1 --2- 172.21.15.6:0/158522162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c1015a030 0x7f7c10156570 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.988+0000 7f7c169c2700 1 --2- 172.21.15.6:0/158522162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c10086ff0 0x7f7c100c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.988+0000 7f7c169c2700 1 --2- 172.21.15.6:0/158522162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c100b28c0 0x7f7c1015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.988+0000 7f7c169c2700 1 -- 172.21.15.6:0/158522162 >> 172.21.15.6:0/158522162 conn(0x7f7c10068680 msgr2=0x7f7c100b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.988+0000 7f7c169c2700 1 -- 172.21.15.6:0/158522162 shutdown_connections 2023-10-06T02:20:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:35.988+0000 7f7c169c2700 1 -- 172.21.15.6:0/158522162 wait complete. 2023-10-06T02:20:36.000 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:20:36.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.121+0000 7fd8d93fb700 1 Processor -- start 2023-10-06T02:20:36.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.121+0000 7fd8d93fb700 1 -- start start 2023-10-06T02:20:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.122+0000 7fd8d93fb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d415cae0 0x7fd8d40c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.122+0000 7fd8d93fb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8d40cc740 0x7fd8d40ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.122+0000 7fd8d93fb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d406a1a0 con 0x7fd8d406a910 2023-10-06T02:20:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.122+0000 7fd8d93fb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d406a480 con 0x7fd8d40cc740 2023-10-06T02:20:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.122+0000 7fd8d93fb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d40c3f40 con 0x7fd8d415cae0 2023-10-06T02:20:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.122+0000 7fd8d37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8d40cc740 0x7fd8d40ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.122+0000 7fd8d27fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd8d406a910 0x7fd8d406ad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46752/0 (socket says 172.21.15.6:46752) 2023-10-06T02:20:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.122+0000 7fd8d27fc700 1 -- 172.21.15.6:0/1713737405 learned_addr learned my addr 172.21.15.6:0/1713737405 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.122+0000 7fd8d37fe700 1 --2- 172.21.15.6:0/1713737405 >> v2:172.21.15.6:3300/0 conn(0x7fd8d40cc740 0x7fd8d40ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56718/0 (socket says 172.21.15.6:56718) 2023-10-06T02:20:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.123+0000 7fd8d2ffd700 1 --2- 172.21.15.6:0/1713737405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d415cae0 0x7fd8d40c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.123+0000 7fd8d37fe700 1 -- 172.21.15.6:0/1713737405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d415cae0 msgr2=0x7fd8d40c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.123+0000 7fd8d37fe700 1 --2- 172.21.15.6:0/1713737405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d415cae0 0x7fd8d40c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.123+0000 7fd8d37fe700 1 -- 172.21.15.6:0/1713737405 >> v1:172.21.15.6:6789/0 conn(0x7fd8d406a910 legacy=0x7fd8d406ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.123+0000 7fd8d1ffb700 1 -- 172.21.15.6:0/1713737405 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895109178 0 0) 0x7fd8d406a1a0 con 0x7fd8d406a910 2023-10-06T02:20:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.123+0000 7fd8d37fe700 1 -- 172.21.15.6:0/1713737405 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d40c4220 con 0x7fd8d40cc740 2023-10-06T02:20:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.123+0000 7fd8d2ffd700 1 --2- 172.21.15.6:0/1713737405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d415cae0 0x7fd8d40c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.123+0000 7fd8d37fe700 1 --2- 172.21.15.6:0/1713737405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8d40cc740 0x7fd8d40ccbc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40098e0 tx=0x7fd8c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f474acd05f4db7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.123+0000 7fd8d1ffb700 1 -- 172.21.15.6:0/1713737405 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4009e80 con 0x7fd8d40cc740 2023-10-06T02:20:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.123+0000 7fd8d1ffb700 1 -- 172.21.15.6:0/1713737405 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c400b860 con 0x7fd8d40cc740 2023-10-06T02:20:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.123+0000 7fd8d1ffb700 1 -- 172.21.15.6:0/1713737405 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c400bbe0 con 0x7fd8d40cc740 2023-10-06T02:20:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.124+0000 7fd8d93fb700 1 -- 172.21.15.6:0/1713737405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8d40cc740 msgr2=0x7fd8d40ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.124+0000 7fd8d93fb700 1 --2- 172.21.15.6:0/1713737405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8d40cc740 0x7fd8d40ccbc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40098e0 tx=0x7fd8c40091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.124+0000 7fd8d93fb700 1 -- 172.21.15.6:0/1713737405 shutdown_connections 2023-10-06T02:20:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.124+0000 7fd8d93fb700 1 --2- 172.21.15.6:0/1713737405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8d40cc740 0x7fd8d40ccbc0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.124+0000 7fd8d93fb700 1 --2- 172.21.15.6:0/1713737405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d415cae0 0x7fd8d40c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.124+0000 7fd8d93fb700 1 -- 172.21.15.6:0/1713737405 >> 172.21.15.6:0/1713737405 conn(0x7fd8d4067910 msgr2=0x7fd8d40ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.124+0000 7fd8d93fb700 1 -- 172.21.15.6:0/1713737405 shutdown_connections 2023-10-06T02:20:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.124+0000 7fd8d93fb700 1 -- 172.21.15.6:0/1713737405 wait complete. 2023-10-06T02:20:36.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.125+0000 7fd8d93fb700 1 Processor -- start 2023-10-06T02:20:36.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.125+0000 7fd8d93fb700 1 -- start start 2023-10-06T02:20:36.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d93fb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d406a910 0x7fd8d4159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:36.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d93fb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8d40cc740 0x7fd8d4156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:36.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d93fb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d415cae0 0x7fd8d40b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:36.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d93fb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d4169910 con 0x7fd8d40cc740 2023-10-06T02:20:36.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d93fb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d4159740 con 0x7fd8d406a910 2023-10-06T02:20:36.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d93fb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d4157330 con 0x7fd8d415cae0 2023-10-06T02:20:36.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8d40cc740 0x7fd8d4156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:36.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8d40cc740 0x7fd8d4156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56722/0 (socket says 172.21.15.6:56722) 2023-10-06T02:20:36.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d27fc700 1 -- 172.21.15.6:0/659491854 learned_addr learned my addr 172.21.15.6:0/659491854 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:36.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d37fe700 1 --2- 172.21.15.6:0/659491854 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d415cae0 0x7fd8d40b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:36.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d2ffd700 1 --2- 172.21.15.6:0/659491854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d406a910 0x7fd8d4159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:36.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d27fc700 1 -- 172.21.15.6:0/659491854 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d415cae0 msgr2=0x7fd8d40b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:36.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d27fc700 1 --2- 172.21.15.6:0/659491854 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d415cae0 0x7fd8d40b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d27fc700 1 -- 172.21.15.6:0/659491854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d406a910 msgr2=0x7fd8d4159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:36.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d27fc700 1 --2- 172.21.15.6:0/659491854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d406a910 0x7fd8d4159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d27fc700 1 -- 172.21.15.6:0/659491854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c4009420 con 0x7fd8d40cc740 2023-10-06T02:20:36.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d2ffd700 1 --2- 172.21.15.6:0/659491854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d406a910 0x7fd8d4159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:36.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d27fc700 1 --2- 172.21.15.6:0/659491854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8d40cc740 0x7fd8d4156df0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00c810 tx=0x7fd8bc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:36.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8caffd700 1 -- 172.21.15.6:0/659491854 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc005b30 con 0x7fd8d40cc740 2023-10-06T02:20:36.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8caffd700 1 -- 172.21.15.6:0/659491854 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc005c90 con 0x7fd8d40cc740 2023-10-06T02:20:36.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8d93fb700 1 -- 172.21.15.6:0/659491854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d416d2a0 con 0x7fd8d40cc740 2023-10-06T02:20:36.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.126+0000 7fd8caffd700 1 -- 172.21.15.6:0/659491854 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc007300 con 0x7fd8d40cc740 2023-10-06T02:20:36.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.127+0000 7fd8d93fb700 1 -- 172.21.15.6:0/659491854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d416d860 con 0x7fd8d40cc740 2023-10-06T02:20:36.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.127+0000 7fd8d93fb700 1 -- 172.21.15.6:0/659491854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d406e590 con 0x7fd8d40cc740 2023-10-06T02:20:36.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.128+0000 7fd8caffd700 1 -- 172.21.15.6:0/659491854 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8bc01b400 con 0x7fd8d40cc740 2023-10-06T02:20:36.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.128+0000 7fd8caffd700 1 --2- 172.21.15.6:0/659491854 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8b4066f60 0x7fd8b4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:36.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.128+0000 7fd8caffd700 1 -- 172.21.15.6:0/659491854 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fd8bc084330 con 0x7fd8d40cc740 2023-10-06T02:20:36.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.128+0000 7fd8d2ffd700 1 --2- 172.21.15.6:0/659491854 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8b4066f60 0x7fd8b4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:36.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.129+0000 7fd8d2ffd700 1 --2- 172.21.15.6:0/659491854 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8b4066f60 0x7fd8b4069410 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00d510 tx=0x7fd8cc007620 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:36.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.132+0000 7fd8caffd700 1 -- 172.21.15.6:0/659491854 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8bc051330 con 0x7fd8d40cc740 2023-10-06T02:20:36.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.323+0000 7fd8d93fb700 1 -- 172.21.15.6:0/659491854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8d406da90 con 0x7fd8d40cc740 2023-10-06T02:20:36.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.323+0000 7fd8caffd700 1 -- 172.21.15.6:0/659491854 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd8bc054950 con 0x7fd8d40cc740 2023-10-06T02:20:36.324 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-06T02:20:36.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.325+0000 7fd8d93fb700 1 -- 172.21.15.6:0/659491854 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8b4066f60 msgr2=0x7fd8b4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:36.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.325+0000 7fd8d93fb700 1 --2- 172.21.15.6:0/659491854 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8b4066f60 0x7fd8b4069410 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00d510 tx=0x7fd8cc007620 comp rx=0 tx=0).stop 2023-10-06T02:20:36.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.325+0000 7fd8d93fb700 1 -- 172.21.15.6:0/659491854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8d40cc740 msgr2=0x7fd8d4156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:36.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.325+0000 7fd8d93fb700 1 --2- 172.21.15.6:0/659491854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8d40cc740 0x7fd8d4156df0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00c810 tx=0x7fd8bc007df0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.325+0000 7fd8d93fb700 1 -- 172.21.15.6:0/659491854 shutdown_connections 2023-10-06T02:20:36.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.325+0000 7fd8d93fb700 1 --2- 172.21.15.6:0/659491854 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d415cae0 0x7fd8d40b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.325+0000 7fd8d93fb700 1 --2- 172.21.15.6:0/659491854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d406a910 0x7fd8d4159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.325+0000 7fd8d93fb700 1 --2- 172.21.15.6:0/659491854 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8b4066f60 0x7fd8b4069410 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.325+0000 7fd8d93fb700 1 --2- 172.21.15.6:0/659491854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8d40cc740 0x7fd8d4156df0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.325+0000 7fd8d93fb700 1 -- 172.21.15.6:0/659491854 >> 172.21.15.6:0/659491854 conn(0x7fd8d4067910 msgr2=0x7fd8d414f240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:36.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.325+0000 7fd8d93fb700 1 -- 172.21.15.6:0/659491854 shutdown_connections 2023-10-06T02:20:36.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.325+0000 7fd8d93fb700 1 -- 172.21.15.6:0/659491854 wait complete. 2023-10-06T02:20:36.338 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:20:36.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.456+0000 7f83bf265700 1 Processor -- start 2023-10-06T02:20:36.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.456+0000 7f83bf265700 1 -- start start 2023-10-06T02:20:36.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.457+0000 7f83bf265700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83b8159400 0x7f83b80ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:36.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.457+0000 7f83bf265700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f83b80cd030 0x7f83b80cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:36.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.457+0000 7f83bf265700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b80b3560 con 0x7f83b80cf1a0 2023-10-06T02:20:36.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.457+0000 7f83bf265700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b80cf6f0 con 0x7f83b80cd030 2023-10-06T02:20:36.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.457+0000 7f83bf265700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80cf9d0 con 0x7f83b8159400 2023-10-06T02:20:36.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.457+0000 7f83bea64700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f83b80cf1a0 0x7f83b80b5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46754/0 (socket says 172.21.15.6:46754) 2023-10-06T02:20:36.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.457+0000 7f83bea64700 1 -- 172.21.15.6:0/140980869 learned_addr learned my addr 172.21.15.6:0/140980869 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:36.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.457+0000 7f83be263700 1 --2- 172.21.15.6:0/140980869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83b8159400 0x7f83b80ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:36.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.457+0000 7f83bda62700 1 --2- 172.21.15.6:0/140980869 >> v2:172.21.15.175:3300/0 conn(0x7f83b80cd030 0x7f83b80cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:36.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.457+0000 7f83bd261700 1 -- 172.21.15.6:0/140980869 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540687698 0 0) 0x7f83b80b3560 con 0x7f83b80cf1a0 2023-10-06T02:20:36.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.458+0000 7f83bd261700 1 -- 172.21.15.6:0/140980869 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83a0003570 con 0x7f83b80cf1a0 2023-10-06T02:20:36.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.458+0000 7f83be263700 1 -- 172.21.15.6:0/140980869 >> v2:172.21.15.175:3300/0 conn(0x7f83b80cd030 msgr2=0x7f83b80cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:36.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.458+0000 7f83be263700 1 --2- 172.21.15.6:0/140980869 >> v2:172.21.15.175:3300/0 conn(0x7f83b80cd030 0x7f83b80cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.458+0000 7f83be263700 1 -- 172.21.15.6:0/140980869 >> v1:172.21.15.6:6789/0 conn(0x7f83b80cf1a0 legacy=0x7f83b80b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:36.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.458+0000 7f83be263700 1 -- 172.21.15.6:0/140980869 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b80b2f10 con 0x7f83b8159400 2023-10-06T02:20:36.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.458+0000 7f83bda62700 1 --2- 172.21.15.6:0/140980869 >> v2:172.21.15.175:3300/0 conn(0x7f83b80cd030 0x7f83b80cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:20:36.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.458+0000 7f83be263700 1 --2- 172.21.15.6:0/140980869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83b8159400 0x7f83b80ccaf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f83b00098d0 tx=0x7f83b0009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=676e9d14805c97c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:36.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.458+0000 7f83bd261700 1 -- 172.21.15.6:0/140980869 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0005c10 con 0x7f83b8159400 2023-10-06T02:20:36.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.458+0000 7f83bd261700 1 -- 172.21.15.6:0/140980869 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b0005d70 con 0x7f83b8159400 2023-10-06T02:20:36.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.458+0000 7f83bd261700 1 -- 172.21.15.6:0/140980869 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0006260 con 0x7f83b8159400 2023-10-06T02:20:36.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.459+0000 7f83bf265700 1 -- 172.21.15.6:0/140980869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83b8159400 msgr2=0x7f83b80ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:36.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.459+0000 7f83bf265700 1 --2- 172.21.15.6:0/140980869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83b8159400 0x7f83b80ccaf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f83b00098d0 tx=0x7f83b0009120 comp rx=0 tx=0).stop 2023-10-06T02:20:36.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.459+0000 7f83bf265700 1 -- 172.21.15.6:0/140980869 shutdown_connections 2023-10-06T02:20:36.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.459+0000 7f83bf265700 1 --2- 172.21.15.6:0/140980869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83b8159400 0x7f83b80ccaf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.459+0000 7f83bf265700 1 --2- 172.21.15.6:0/140980869 >> v2:172.21.15.175:3300/0 conn(0x7f83b80cd030 0x7f83b80cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.459+0000 7f83bf265700 1 -- 172.21.15.6:0/140980869 >> 172.21.15.6:0/140980869 conn(0x7f83b806ac10 msgr2=0x7f83b8068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:36.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.459+0000 7f83bf265700 1 -- 172.21.15.6:0/140980869 shutdown_connections 2023-10-06T02:20:36.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.459+0000 7f83bf265700 1 -- 172.21.15.6:0/140980869 wait complete. 2023-10-06T02:20:36.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.460+0000 7f83bf265700 1 Processor -- start 2023-10-06T02:20:36.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.460+0000 7f83bf265700 1 -- start start 2023-10-06T02:20:36.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83bf265700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83b80cd030 0x7f83b815c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:36.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83bf265700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83b80cf1a0 0x7f83b80c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:36.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83bf265700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b8159400 0x7f83b8154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:36.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83bf265700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80c61c0 con 0x7f83b8159400 2023-10-06T02:20:36.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83bf265700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b815d2f0 con 0x7f83b80cf1a0 2023-10-06T02:20:36.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83bf265700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80c63b0 con 0x7f83b80cd030 2023-10-06T02:20:36.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83bea64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b8159400 0x7f83b8154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:36.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83bea64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b8159400 0x7f83b8154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56734/0 (socket says 172.21.15.6:56734) 2023-10-06T02:20:36.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83bea64700 1 -- 172.21.15.6:0/3028915818 learned_addr learned my addr 172.21.15.6:0/3028915818 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:36.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83be263700 1 --2- 172.21.15.6:0/3028915818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83b80cd030 0x7f83b815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:36.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83bda62700 1 --2- 172.21.15.6:0/3028915818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83b80cf1a0 0x7f83b80c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:36.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83bea64700 1 -- 172.21.15.6:0/3028915818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83b80cd030 msgr2=0x7f83b815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:36.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83bea64700 1 --2- 172.21.15.6:0/3028915818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83b80cd030 0x7f83b815c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83bea64700 1 -- 172.21.15.6:0/3028915818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83b80cf1a0 msgr2=0x7f83b80c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:36.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83bea64700 1 --2- 172.21.15.6:0/3028915818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83b80cf1a0 0x7f83b80c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83bea64700 1 -- 172.21.15.6:0/3028915818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac009420 con 0x7f83b8159400 2023-10-06T02:20:36.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83be263700 1 --2- 172.21.15.6:0/3028915818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83b80cd030 0x7f83b815c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:20:36.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83bea64700 1 --2- 172.21.15.6:0/3028915818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b8159400 0x7f83b8154070 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f83a8001460 tx=0x7f83a8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:36.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83b67fc700 1 -- 172.21.15.6:0/3028915818 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a800a890 con 0x7f83b8159400 2023-10-06T02:20:36.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83b67fc700 1 -- 172.21.15.6:0/3028915818 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a800a9f0 con 0x7f83b8159400 2023-10-06T02:20:36.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83bf265700 1 -- 172.21.15.6:0/3028915818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b00093c0 con 0x7f83b8159400 2023-10-06T02:20:36.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.461+0000 7f83b67fc700 1 -- 172.21.15.6:0/3028915818 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a800ad70 con 0x7f83b8159400 2023-10-06T02:20:36.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.462+0000 7f83bf265700 1 -- 172.21.15.6:0/3028915818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b815d540 con 0x7f83b8159400 2023-10-06T02:20:36.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.462+0000 7f83bf265700 1 -- 172.21.15.6:0/3028915818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b8159860 con 0x7f83b8159400 2023-10-06T02:20:36.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.463+0000 7f83b67fc700 1 -- 172.21.15.6:0/3028915818 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83a8007300 con 0x7f83b8159400 2023-10-06T02:20:36.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.463+0000 7f83b67fc700 1 --2- 172.21.15.6:0/3028915818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83a4066f30 0x7f83a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:36.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.463+0000 7f83b67fc700 1 -- 172.21.15.6:0/3028915818 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f83a8084d10 con 0x7f83b8159400 2023-10-06T02:20:36.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.463+0000 7f83be263700 1 --2- 172.21.15.6:0/3028915818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83a4066f30 0x7f83a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:36.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.464+0000 7f83be263700 1 --2- 172.21.15.6:0/3028915818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83a4066f30 0x7f83a40693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009160 tx=0x7f83b0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:36.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.467+0000 7f83b67fc700 1 -- 172.21.15.6:0/3028915818 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83a808a020 con 0x7f83b8159400 2023-10-06T02:20:36.566 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:20:36.566+0000 7f6d6816c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:20:36.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.707+0000 7f83bf265700 1 -- 172.21.15.6:0/3028915818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83b8068420 con 0x7f83b8159400 2023-10-06T02:20:36.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.707+0000 7f83b67fc700 1 -- 172.21.15.6:0/3028915818 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f83a8051c00 con 0x7f83b8159400 2023-10-06T02:20:36.708 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:36.708 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2589522502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2589522502},{"type":"v1","addr":"172.21.15.175:6837","nonce":2589522502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3703329287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3703329287},{"type":"v1","addr":"172.21.15.175:6836","nonce":3703329287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/843207095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":843207095},{"type":"v1","addr":"172.21.15.6:6834","nonce":843207095}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:10.479851+0000","modified":"2023-10-06T02:20:35.576072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5973":{"gid":5973,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/1891041000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1891041000},{"type":"v1","addr":"172.21.15.6:6835","nonce":1891041000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:20:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.709+0000 7f83bf265700 1 -- 172.21.15.6:0/3028915818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83a4066f30 msgr2=0x7f83a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.709+0000 7f83bf265700 1 --2- 172.21.15.6:0/3028915818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83a4066f30 0x7f83a40693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009160 tx=0x7f83b0016000 comp rx=0 tx=0).stop 2023-10-06T02:20:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.709+0000 7f83bf265700 1 -- 172.21.15.6:0/3028915818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b8159400 msgr2=0x7f83b8154070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.709+0000 7f83bf265700 1 --2- 172.21.15.6:0/3028915818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b8159400 0x7f83b8154070 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f83a8001460 tx=0x7f83a8001ae0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.709+0000 7f83bf265700 1 -- 172.21.15.6:0/3028915818 shutdown_connections 2023-10-06T02:20:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.709+0000 7f83bf265700 1 --2- 172.21.15.6:0/3028915818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83a4066f30 0x7f83a40693e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.709+0000 7f83bf265700 1 --2- 172.21.15.6:0/3028915818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b8159400 0x7f83b8154070 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.709+0000 7f83bf265700 1 --2- 172.21.15.6:0/3028915818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83b80cd030 0x7f83b815c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.709+0000 7f83bf265700 1 --2- 172.21.15.6:0/3028915818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83b80cf1a0 0x7f83b80c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.709+0000 7f83bf265700 1 -- 172.21.15.6:0/3028915818 >> 172.21.15.6:0/3028915818 conn(0x7f83b806ac10 msgr2=0x7f83b8155eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:36.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.709+0000 7f83bf265700 1 -- 172.21.15.6:0/3028915818 shutdown_connections 2023-10-06T02:20:36.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.709+0000 7f83bf265700 1 -- 172.21.15.6:0/3028915818 wait complete. 2023-10-06T02:20:36.711 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 40 2023-10-06T02:20:36.722 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:20:36.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.840+0000 7f2c8b821700 1 Processor -- start 2023-10-06T02:20:36.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.841+0000 7f2c8b821700 1 -- start start 2023-10-06T02:20:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.841+0000 7f2c8b821700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c840c1de0 0x7f2c84068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.841+0000 7f2c8b821700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c840c3220 con 0x7f2c840abd80 2023-10-06T02:20:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.841+0000 7f2c8b821700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c841582c0 con 0x7f2c840ac150 2023-10-06T02:20:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.841+0000 7f2c8b821700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c84159dd0 con 0x7f2c840c1de0 2023-10-06T02:20:36.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.842+0000 7f2c895bd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2c840abd80 0x7f2c8415a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46770/0 (socket says 172.21.15.6:46770) 2023-10-06T02:20:36.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.842+0000 7f2c895bd700 1 -- 172.21.15.6:0/2764300278 learned_addr learned my addr 172.21.15.6:0/2764300278 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:36.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.842+0000 7f2c89dbe700 1 --2- 172.21.15.6:0/2764300278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c840c1de0 0x7f2c84068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:36.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.842+0000 7f2c83fff700 1 -- 172.21.15.6:0/2764300278 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004959968 0 0) 0x7f2c840c3220 con 0x7f2c840abd80 2023-10-06T02:20:36.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.842+0000 7f2c83fff700 1 -- 172.21.15.6:0/2764300278 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c6c003570 con 0x7f2c840abd80 2023-10-06T02:20:36.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.842+0000 7f2c83fff700 1 -- 172.21.15.6:0/2764300278 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464370824 0 0) 0x7f2c841582c0 con 0x7f2c840ac150 2023-10-06T02:20:36.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.842+0000 7f2c83fff700 1 -- 172.21.15.6:0/2764300278 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c840c3220 con 0x7f2c840ac150 2023-10-06T02:20:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.842+0000 7f2c89dbe700 1 -- 172.21.15.6:0/2764300278 >> v1:172.21.15.175:6789/0 conn(0x7f2c840ac150 legacy=0x7f2c84157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.842+0000 7f2c89dbe700 1 -- 172.21.15.6:0/2764300278 >> v1:172.21.15.6:6789/0 conn(0x7f2c840abd80 legacy=0x7f2c8415a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.842+0000 7f2c83fff700 1 -- 172.21.15.6:0/2764300278 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2233814633 0 0) 0x7f2c6c003570 con 0x7f2c840abd80 2023-10-06T02:20:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.842+0000 7f2c89dbe700 1 -- 172.21.15.6:0/2764300278 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c840ccfd0 con 0x7f2c840c1de0 2023-10-06T02:20:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.842+0000 7f2c89dbe700 1 --2- 172.21.15.6:0/2764300278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c840c1de0 0x7f2c84068680 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2c74009910 tx=0x7f2c740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=622fd972de1da98 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.842+0000 7f2c83fff700 1 -- 172.21.15.6:0/2764300278 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c0017f0 con 0x7f2c840c1de0 2023-10-06T02:20:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.843+0000 7f2c83fff700 1 -- 172.21.15.6:0/2764300278 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c74011420 con 0x7f2c840c1de0 2023-10-06T02:20:36.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.843+0000 7f2c83fff700 1 -- 172.21.15.6:0/2764300278 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c740117c0 con 0x7f2c840c1de0 2023-10-06T02:20:36.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.843+0000 7f2c8b821700 1 -- 172.21.15.6:0/2764300278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c840c1de0 msgr2=0x7f2c84068680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:36.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.843+0000 7f2c8b821700 1 --2- 172.21.15.6:0/2764300278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c840c1de0 0x7f2c84068680 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2c74009910 tx=0x7f2c740091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.843+0000 7f2c8b821700 1 -- 172.21.15.6:0/2764300278 shutdown_connections 2023-10-06T02:20:36.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.843+0000 7f2c8b821700 1 --2- 172.21.15.6:0/2764300278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c840c1de0 0x7f2c84068680 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.843+0000 7f2c8b821700 1 -- 172.21.15.6:0/2764300278 >> 172.21.15.6:0/2764300278 conn(0x7f2c84069790 msgr2=0x7f2c84069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:36.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.843+0000 7f2c8b821700 1 -- 172.21.15.6:0/2764300278 shutdown_connections 2023-10-06T02:20:36.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.843+0000 7f2c8b821700 1 -- 172.21.15.6:0/2764300278 wait complete. 2023-10-06T02:20:36.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.844+0000 7f2c8b821700 1 Processor -- start 2023-10-06T02:20:36.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.844+0000 7f2c8b821700 1 -- start start 2023-10-06T02:20:36.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.845+0000 7f2c8b821700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c840abd80 0x7f2c840c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:36.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.845+0000 7f2c8b821700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c840ac150 0x7f2c84141320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:36.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.845+0000 7f2c8b821700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c840c1de0 0x7f2c84141860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:36.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.845+0000 7f2c8b821700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840c71e0 con 0x7f2c840abd80 2023-10-06T02:20:36.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.845+0000 7f2c8b821700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840b29c0 con 0x7f2c840c1de0 2023-10-06T02:20:36.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.845+0000 7f2c8b821700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840b1db0 con 0x7f2c840ac150 2023-10-06T02:20:36.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.845+0000 7f2c895bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c840abd80 0x7f2c840c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:36.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.845+0000 7f2c895bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c840abd80 0x7f2c840c6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56748/0 (socket says 172.21.15.6:56748) 2023-10-06T02:20:36.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.845+0000 7f2c895bd700 1 -- 172.21.15.6:0/1339032097 learned_addr learned my addr 172.21.15.6:0/1339032097 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:36.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.845+0000 7f2c895bd700 1 -- 172.21.15.6:0/1339032097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c840ac150 msgr2=0x7f2c84141320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:36.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.845+0000 7f2c895bd700 1 --2- 172.21.15.6:0/1339032097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c840ac150 0x7f2c84141320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.845+0000 7f2c895bd700 1 -- 172.21.15.6:0/1339032097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c840c1de0 msgr2=0x7f2c84141860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:36.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.845+0000 7f2c89dbe700 1 --2- 172.21.15.6:0/1339032097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c840c1de0 0x7f2c84141860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:36.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.846+0000 7f2c895bd700 1 --2- 172.21.15.6:0/1339032097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c840c1de0 0x7f2c84141860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:36.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.846+0000 7f2c895bd700 1 -- 172.21.15.6:0/1339032097 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c74009420 con 0x7f2c840abd80 2023-10-06T02:20:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.846+0000 7f2c89dbe700 1 --2- 172.21.15.6:0/1339032097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c840c1de0 0x7f2c84141860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.846+0000 7f2c895bd700 1 --2- 172.21.15.6:0/1339032097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c840abd80 0x7f2c840c6ca0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00ccf0 tx=0x7f2c7c007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.846+0000 7f2c817fa700 1 -- 172.21.15.6:0/1339032097 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c004dc0 con 0x7f2c840abd80 2023-10-06T02:20:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.846+0000 7f2c817fa700 1 -- 172.21.15.6:0/1339032097 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7c00a8e0 con 0x7f2c840abd80 2023-10-06T02:20:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.846+0000 7f2c817fa700 1 -- 172.21.15.6:0/1339032097 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c00aca0 con 0x7f2c840abd80 2023-10-06T02:20:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.846+0000 7f2c8b821700 1 -- 172.21.15.6:0/1339032097 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c840b2090 con 0x7f2c840abd80 2023-10-06T02:20:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.846+0000 7f2c8b821700 1 -- 172.21.15.6:0/1339032097 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c840b2650 con 0x7f2c840abd80 2023-10-06T02:20:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.847+0000 7f2c8b821700 1 -- 172.21.15.6:0/1339032097 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c840c8570 con 0x7f2c840abd80 2023-10-06T02:20:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.847+0000 7f2c817fa700 1 -- 172.21.15.6:0/1339032097 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c7c007360 con 0x7f2c840abd80 2023-10-06T02:20:36.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.848+0000 7f2c817fa700 1 --2- 172.21.15.6:0/1339032097 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c70066f30 0x7f2c700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:36.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.848+0000 7f2c817fa700 1 -- 172.21.15.6:0/1339032097 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f2c7c084030 con 0x7f2c840abd80 2023-10-06T02:20:36.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.848+0000 7f2c88dbc700 1 --2- 172.21.15.6:0/1339032097 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c70066f30 0x7f2c700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:36.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.849+0000 7f2c88dbc700 1 --2- 172.21.15.6:0/1339032097 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c70066f30 0x7f2c700693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2c841428a0 tx=0x7f2c780079f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:36.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:36.852+0000 7f2c817fa700 1 -- 172.21.15.6:0/1339032097 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c7c051030 con 0x7f2c840abd80 2023-10-06T02:20:37.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.049+0000 7f2c8b821700 1 -- 172.21.15.6:0/1339032097 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c840c73c0 con 0x7f2c840abd80 2023-10-06T02:20:37.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.049+0000 7f2c817fa700 1 -- 172.21.15.6:0/1339032097 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17150 (secure 0 0 0) 0x7f2c7c054650 con 0x7f2c840abd80 2023-10-06T02:20:37.050 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:37.050 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":55,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:20:30.553655+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:20:08.649152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T02:20:09.450444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/1800326966":"2023-10-07T02:20:30.553628+0000","172.21.15.6:6833/1800326966":"2023-10-07T02:20:30.553628+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:20:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.051+0000 7f2c8b821700 1 -- 172.21.15.6:0/1339032097 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c70066f30 msgr2=0x7f2c700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.051+0000 7f2c8b821700 1 --2- 172.21.15.6:0/1339032097 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c70066f30 0x7f2c700693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2c841428a0 tx=0x7f2c780079f0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.051+0000 7f2c8b821700 1 -- 172.21.15.6:0/1339032097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c840abd80 msgr2=0x7f2c840c6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.051+0000 7f2c8b821700 1 --2- 172.21.15.6:0/1339032097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c840abd80 0x7f2c840c6ca0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00ccf0 tx=0x7f2c7c007da0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.051+0000 7f2c8b821700 1 -- 172.21.15.6:0/1339032097 shutdown_connections 2023-10-06T02:20:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.052+0000 7f2c8b821700 1 --2- 172.21.15.6:0/1339032097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c840c1de0 0x7f2c84141860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.052+0000 7f2c8b821700 1 --2- 172.21.15.6:0/1339032097 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c70066f30 0x7f2c700693e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.052+0000 7f2c8b821700 1 --2- 172.21.15.6:0/1339032097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c840abd80 0x7f2c840c6ca0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.052+0000 7f2c8b821700 1 --2- 172.21.15.6:0/1339032097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c840ac150 0x7f2c84141320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.052+0000 7f2c8b821700 1 -- 172.21.15.6:0/1339032097 >> 172.21.15.6:0/1339032097 conn(0x7f2c84069790 msgr2=0x7f2c84068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:37.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.052+0000 7f2c8b821700 1 -- 172.21.15.6:0/1339032097 shutdown_connections 2023-10-06T02:20:37.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.052+0000 7f2c8b821700 1 -- 172.21.15.6:0/1339032097 wait complete. 2023-10-06T02:20:37.064 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:20:37.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:20:37.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.183+0000 7fc4090aa700 1 Processor -- start 2023-10-06T02:20:37.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.183+0000 7fc4090aa700 1 -- start start 2023-10-06T02:20:37.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.184+0000 7fc4090aa700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc404157040 0x7fc4040cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.184+0000 7fc4090aa700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4040cd5b0 con 0x7fc4040cda40 2023-10-06T02:20:37.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.184+0000 7fc4090aa700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4040ccc80 con 0x7fc404157410 2023-10-06T02:20:37.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.184+0000 7fc4090aa700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4040ccf60 con 0x7fc404157040 2023-10-06T02:20:37.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.184+0000 7fc4088a9700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc4040cda40 0x7fc4040adf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46784/0 (socket says 172.21.15.6:46784) 2023-10-06T02:20:37.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.184+0000 7fc4088a9700 1 -- 172.21.15.6:0/404370491 learned_addr learned my addr 172.21.15.6:0/404370491 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.184+0000 7fc403fff700 1 --2- 172.21.15.6:0/404370491 >> v2:172.21.15.175:3300/0 conn(0x7fc404157040 0x7fc4040cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.184+0000 7fc402ffd700 1 -- 172.21.15.6:0/404370491 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349631795 0 0) 0x7fc4040cd5b0 con 0x7fc4040cda40 2023-10-06T02:20:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.184+0000 7fc402ffd700 1 -- 172.21.15.6:0/404370491 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3ec003570 con 0x7fc4040cda40 2023-10-06T02:20:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc402ffd700 1 -- 172.21.15.6:0/404370491 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1866160927 0 0) 0x7fc3ec003570 con 0x7fc4040cda40 2023-10-06T02:20:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc402ffd700 1 -- 172.21.15.6:0/404370491 >> v2:172.21.15.175:3300/0 conn(0x7fc404157040 msgr2=0x7fc4040cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc402ffd700 1 --2- 172.21.15.6:0/404370491 >> v2:172.21.15.175:3300/0 conn(0x7fc404157040 0x7fc4040cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc402ffd700 1 -- 172.21.15.6:0/404370491 >> v1:172.21.15.175:6789/0 conn(0x7fc404157410 legacy=0x7fc4040ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc402ffd700 1 -- 172.21.15.6:0/404370491 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4040cd240 con 0x7fc4040cda40 2023-10-06T02:20:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc402ffd700 1 -- 172.21.15.6:0/404370491 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fc3fc0017f0 con 0x7fc4040cda40 2023-10-06T02:20:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc402ffd700 1 -- 172.21.15.6:0/404370491 >> v1:172.21.15.6:6789/0 conn(0x7fc4040cda40 legacy=0x7fc4040adf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc402ffd700 1 --2- 172.21.15.6:0/404370491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3ec003a60 0x7fc3ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc402ffd700 1 --2- 172.21.15.6:0/404370491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3ec004810 0x7fc3ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc402ffd700 1 --2- 172.21.15.6:0/404370491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3ec0051c0 0x7fc3ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc402ffd700 1 -- 172.21.15.6:0/404370491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4040ccf60 con 0x7fc3ec003a60 2023-10-06T02:20:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc402ffd700 1 -- 172.21.15.6:0/404370491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec00c0d0 con 0x7fc3ec0051c0 2023-10-06T02:20:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc402ffd700 1 -- 172.21.15.6:0/404370491 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec00c290 con 0x7fc3ec004810 2023-10-06T02:20:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc403fff700 1 --2- 172.21.15.6:0/404370491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3ec003a60 0x7fc3ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc4088a9700 1 --2- 172.21.15.6:0/404370491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3ec0051c0 0x7fc3ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc4037fe700 1 --2- 172.21.15.6:0/404370491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3ec004810 0x7fc3ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc403fff700 1 -- 172.21.15.6:0/404370491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3ec004810 msgr2=0x7fc3ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc403fff700 1 --2- 172.21.15.6:0/404370491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3ec004810 0x7fc3ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc403fff700 1 -- 172.21.15.6:0/404370491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3ec0051c0 msgr2=0x7fc3ec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc403fff700 1 --2- 172.21.15.6:0/404370491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3ec0051c0 0x7fc3ec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc403fff700 1 -- 172.21.15.6:0/404370491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec003570 con 0x7fc3ec003a60 2023-10-06T02:20:37.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc4088a9700 1 --2- 172.21.15.6:0/404370491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3ec0051c0 0x7fc3ec00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:37.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc4088a9700 1 -- 172.21.15.6:0/404370491 reap_dead start 2023-10-06T02:20:37.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc403fff700 1 --2- 172.21.15.6:0/404370491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3ec003a60 0x7fc3ec003e70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4009c00 tx=0x7fc3f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca045eeaa1f9e3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:37.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc402ffd700 1 -- 172.21.15.6:0/404370491 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400e710 con 0x7fc3ec003a60 2023-10-06T02:20:37.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc402ffd700 1 -- 172.21.15.6:0/404370491 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f400e870 con 0x7fc3ec003a60 2023-10-06T02:20:37.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.185+0000 7fc402ffd700 1 -- 172.21.15.6:0/404370491 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400ec30 con 0x7fc3ec003a60 2023-10-06T02:20:37.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.186+0000 7fc4090aa700 1 -- 172.21.15.6:0/404370491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3ec003a60 msgr2=0x7fc3ec003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.186+0000 7fc4090aa700 1 --2- 172.21.15.6:0/404370491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3ec003a60 0x7fc3ec003e70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4009c00 tx=0x7fc3f40091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.186+0000 7fc4090aa700 1 -- 172.21.15.6:0/404370491 shutdown_connections 2023-10-06T02:20:37.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.186+0000 7fc4090aa700 1 --2- 172.21.15.6:0/404370491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3ec003a60 0x7fc3ec003e70 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.186+0000 7fc4090aa700 1 -- 172.21.15.6:0/404370491 >> 172.21.15.6:0/404370491 conn(0x7fc404067130 msgr2=0x7fc404067530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:37.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.186+0000 7fc4090aa700 1 -- 172.21.15.6:0/404370491 shutdown_connections 2023-10-06T02:20:37.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.186+0000 7fc4090aa700 1 -- 172.21.15.6:0/404370491 wait complete. 2023-10-06T02:20:37.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.187+0000 7fc4090aa700 1 Processor -- start 2023-10-06T02:20:37.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.187+0000 7fc4090aa700 1 -- start start 2023-10-06T02:20:37.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.188+0000 7fc4090aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3ec003a60 0x7fc40406a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.188+0000 7fc4090aa700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4040ac4f0 0x7fc404154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.188+0000 7fc4090aa700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc40406abe0 0x7fc40409a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.188+0000 7fc4090aa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40406b830 con 0x7fc3ec003a60 2023-10-06T02:20:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.188+0000 7fc4090aa700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc404069f80 con 0x7fc4040ac4f0 2023-10-06T02:20:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.188+0000 7fc4090aa700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40406b550 con 0x7fc40406abe0 2023-10-06T02:20:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.188+0000 7fc403fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3ec003a60 0x7fc40406a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.188+0000 7fc403fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3ec003a60 0x7fc40406a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56764/0 (socket says 172.21.15.6:56764) 2023-10-06T02:20:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.188+0000 7fc403fff700 1 -- 172.21.15.6:0/3828470993 learned_addr learned my addr 172.21.15.6:0/3828470993 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.188+0000 7fc4037fe700 1 --2- 172.21.15.6:0/3828470993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4040ac4f0 0x7fc404154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.188+0000 7fc4088a9700 1 --2- 172.21.15.6:0/3828470993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc40406abe0 0x7fc40409a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.188+0000 7fc403fff700 1 -- 172.21.15.6:0/3828470993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc40406abe0 msgr2=0x7fc40409a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.188+0000 7fc403fff700 1 --2- 172.21.15.6:0/3828470993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc40406abe0 0x7fc40409a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.188+0000 7fc403fff700 1 -- 172.21.15.6:0/3828470993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4040ac4f0 msgr2=0x7fc404154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.188+0000 7fc403fff700 1 --2- 172.21.15.6:0/3828470993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4040ac4f0 0x7fc404154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.188+0000 7fc403fff700 1 -- 172.21.15.6:0/3828470993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc404069930 con 0x7fc3ec003a60 2023-10-06T02:20:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.189+0000 7fc403fff700 1 --2- 172.21.15.6:0/3828470993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3ec003a60 0x7fc40406a410 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00c0a0 tx=0x7fc3f401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.189+0000 7fc3ebfff700 1 -- 172.21.15.6:0/3828470993 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4022070 con 0x7fc3ec003a60 2023-10-06T02:20:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.189+0000 7fc3ebfff700 1 -- 172.21.15.6:0/3828470993 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f400e9e0 con 0x7fc3ec003a60 2023-10-06T02:20:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.189+0000 7fc4090aa700 1 -- 172.21.15.6:0/3828470993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc404069c10 con 0x7fc3ec003a60 2023-10-06T02:20:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.189+0000 7fc3ebfff700 1 -- 172.21.15.6:0/3828470993 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f401c450 con 0x7fc3ec003a60 2023-10-06T02:20:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.189+0000 7fc4090aa700 1 -- 172.21.15.6:0/3828470993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc404154a40 con 0x7fc3ec003a60 2023-10-06T02:20:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.190+0000 7fc4090aa700 1 -- 172.21.15.6:0/3828470993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc404069790 con 0x7fc3ec003a60 2023-10-06T02:20:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.191+0000 7fc3ebfff700 1 -- 172.21.15.6:0/3828470993 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc3f401c880 con 0x7fc3ec003a60 2023-10-06T02:20:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.191+0000 7fc3ebfff700 1 --2- 172.21.15.6:0/3828470993 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3f0066f30 0x7fc3f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.192+0000 7fc3ebfff700 1 -- 172.21.15.6:0/3828470993 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fc3f4086590 con 0x7fc3ec003a60 2023-10-06T02:20:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.192+0000 7fc4037fe700 1 --2- 172.21.15.6:0/3828470993 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3f0066f30 0x7fc3f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.192+0000 7fc4037fe700 1 --2- 172.21.15.6:0/3828470993 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3f0066f30 0x7fc3f00693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc4040ac8c0 tx=0x7fc3f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:37.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.195+0000 7fc3ebfff700 1 -- 172.21.15.6:0/3828470993 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3f4053640 con 0x7fc3ec003a60 2023-10-06T02:20:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.436+0000 7fc4090aa700 1 -- 172.21.15.6:0/3828470993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc404069790 con 0x7fc3ec003a60 2023-10-06T02:20:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.436+0000 7fc3ebfff700 1 -- 172.21.15.6:0/3828470993 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fc404069790 con 0x7fc3ec003a60 2023-10-06T02:20:37.437 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:37.437 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2589522502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2589522502},{"type":"v1","addr":"172.21.15.175:6837","nonce":2589522502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3703329287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3703329287},{"type":"v1","addr":"172.21.15.175:6836","nonce":3703329287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/843207095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":843207095},{"type":"v1","addr":"172.21.15.6:6834","nonce":843207095}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:10.479851+0000","modified":"2023-10-06T02:20:35.576072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5973":{"gid":5973,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/1891041000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1891041000},{"type":"v1","addr":"172.21.15.6:6835","nonce":1891041000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:20:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.438+0000 7fc4090aa700 1 -- 172.21.15.6:0/3828470993 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3f0066f30 msgr2=0x7fc3f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.439+0000 7fc4090aa700 1 --2- 172.21.15.6:0/3828470993 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3f0066f30 0x7fc3f00693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc4040ac8c0 tx=0x7fc3f8009040 comp rx=0 tx=0).stop 2023-10-06T02:20:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.439+0000 7fc4090aa700 1 -- 172.21.15.6:0/3828470993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3ec003a60 msgr2=0x7fc40406a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.439+0000 7fc4090aa700 1 --2- 172.21.15.6:0/3828470993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3ec003a60 0x7fc40406a410 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00c0a0 tx=0x7fc3f401a000 comp rx=0 tx=0).stop 2023-10-06T02:20:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.439+0000 7fc4090aa700 1 -- 172.21.15.6:0/3828470993 shutdown_connections 2023-10-06T02:20:37.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.439+0000 7fc4090aa700 1 --2- 172.21.15.6:0/3828470993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc40406abe0 0x7fc40409a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.439+0000 7fc4090aa700 1 --2- 172.21.15.6:0/3828470993 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3f0066f30 0x7fc3f00693e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.439+0000 7fc4090aa700 1 --2- 172.21.15.6:0/3828470993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3ec003a60 0x7fc40406a410 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.439+0000 7fc4090aa700 1 --2- 172.21.15.6:0/3828470993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4040ac4f0 0x7fc404154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.439+0000 7fc4090aa700 1 -- 172.21.15.6:0/3828470993 >> 172.21.15.6:0/3828470993 conn(0x7fc404067130 msgr2=0x7fc40406d340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:37.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.439+0000 7fc4090aa700 1 -- 172.21.15.6:0/3828470993 shutdown_connections 2023-10-06T02:20:37.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.439+0000 7fc4090aa700 1 -- 172.21.15.6:0/3828470993 wait complete. 2023-10-06T02:20:37.441 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 40 2023-10-06T02:20:37.451 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:20:37.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.569+0000 7f4725628700 1 Processor -- start 2023-10-06T02:20:37.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.570+0000 7f4725628700 1 -- start start 2023-10-06T02:20:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.570+0000 7f4725628700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f472015b3c0 0x7f4720097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.570+0000 7f4725628700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47200afb90 con 0x7f472015a590 2023-10-06T02:20:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.570+0000 7f4725628700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47200b2310 con 0x7f47200b3c50 2023-10-06T02:20:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.570+0000 7f4725628700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47200b25f0 con 0x7f472015b3c0 2023-10-06T02:20:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.570+0000 7f471f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f472015a590 0x7f472015a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46798/0 (socket says 172.21.15.6:46798) 2023-10-06T02:20:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.570+0000 7f471f7fe700 1 -- 172.21.15.6:0/3460747990 learned_addr learned my addr 172.21.15.6:0/3460747990 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471effd700 1 --2- 172.21.15.6:0/3460747990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f472015b3c0 0x7f4720097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471dffb700 1 -- 172.21.15.6:0/3460747990 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404639196 0 0) 0x7f47200afb90 con 0x7f472015a590 2023-10-06T02:20:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471dffb700 1 -- 172.21.15.6:0/3460747990 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f470c003570 con 0x7f472015a590 2023-10-06T02:20:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471dffb700 1 -- 172.21.15.6:0/3460747990 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4174506422 0 0) 0x7f470c003570 con 0x7f472015a590 2023-10-06T02:20:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471dffb700 1 -- 172.21.15.6:0/3460747990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f472015b3c0 msgr2=0x7f4720097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471dffb700 1 --2- 172.21.15.6:0/3460747990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f472015b3c0 0x7f4720097d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471dffb700 1 -- 172.21.15.6:0/3460747990 >> v1:172.21.15.175:6789/0 conn(0x7f47200b3c50 legacy=0x7f472015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471dffb700 1 -- 172.21.15.6:0/3460747990 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47200af820 con 0x7f472015a590 2023-10-06T02:20:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471dffb700 1 -- 172.21.15.6:0/3460747990 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f47100017f0 con 0x7f472015a590 2023-10-06T02:20:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471dffb700 1 -- 172.21.15.6:0/3460747990 >> v1:172.21.15.6:6789/0 conn(0x7f472015a590 legacy=0x7f472015a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471dffb700 1 --2- 172.21.15.6:0/3460747990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f470c003a90 0x7f470c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471dffb700 1 --2- 172.21.15.6:0/3460747990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f472015b3c0 0x7f470c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471dffb700 1 --2- 172.21.15.6:0/3460747990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f470c004d50 0x7f470c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471dffb700 1 -- 172.21.15.6:0/3460747990 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47200b25f0 con 0x7f470c004d50 2023-10-06T02:20:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471dffb700 1 -- 172.21.15.6:0/3460747990 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c00bb10 con 0x7f470c003a90 2023-10-06T02:20:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471dffb700 1 -- 172.21.15.6:0/3460747990 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470c00bcd0 con 0x7f472015b3c0 2023-10-06T02:20:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471f7fe700 1 --2- 172.21.15.6:0/3460747990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f470c004d50 0x7f470c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471effd700 1 --2- 172.21.15.6:0/3460747990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f470c003a90 0x7f470c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471e7fc700 1 --2- 172.21.15.6:0/3460747990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f472015b3c0 0x7f470c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471f7fe700 1 -- 172.21.15.6:0/3460747990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f472015b3c0 msgr2=0x7f470c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471f7fe700 1 --2- 172.21.15.6:0/3460747990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f472015b3c0 0x7f470c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471f7fe700 1 -- 172.21.15.6:0/3460747990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f470c003a90 msgr2=0x7f470c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.571+0000 7f471f7fe700 1 --2- 172.21.15.6:0/3460747990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f470c003a90 0x7f470c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.572+0000 7f471f7fe700 1 -- 172.21.15.6:0/3460747990 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c003570 con 0x7f470c004d50 2023-10-06T02:20:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.572+0000 7f471f7fe700 1 --2- 172.21.15.6:0/3460747990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f470c004d50 0x7f470c0051c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f471000a8d0 tx=0x7f4710002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439850077afc449a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.572+0000 7f471dffb700 1 -- 172.21.15.6:0/3460747990 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47100070d0 con 0x7f470c004d50 2023-10-06T02:20:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.572+0000 7f471dffb700 1 -- 172.21.15.6:0/3460747990 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4710007230 con 0x7f470c004d50 2023-10-06T02:20:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.572+0000 7f471dffb700 1 -- 172.21.15.6:0/3460747990 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47100075d0 con 0x7f470c004d50 2023-10-06T02:20:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.572+0000 7f4725628700 1 -- 172.21.15.6:0/3460747990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f470c004d50 msgr2=0x7f470c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.572+0000 7f4725628700 1 --2- 172.21.15.6:0/3460747990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f470c004d50 0x7f470c0051c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f471000a8d0 tx=0x7f4710002170 comp rx=0 tx=0).stop 2023-10-06T02:20:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.572+0000 7f471f7fe700 1 -- 172.21.15.6:0/3460747990 reap_dead start 2023-10-06T02:20:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.572+0000 7f4725628700 1 -- 172.21.15.6:0/3460747990 shutdown_connections 2023-10-06T02:20:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.572+0000 7f4725628700 1 -- 172.21.15.6:0/3460747990 >> 172.21.15.6:0/3460747990 conn(0x7f4720067910 msgr2=0x7f47200ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.572+0000 7f4725628700 1 -- 172.21.15.6:0/3460747990 shutdown_connections 2023-10-06T02:20:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.572+0000 7f4725628700 1 -- 172.21.15.6:0/3460747990 wait complete. 2023-10-06T02:20:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.574+0000 7f4725628700 1 Processor -- start 2023-10-06T02:20:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.574+0000 7f4725628700 1 -- start start 2023-10-06T02:20:37.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f4725628700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4720145600 0x7f47201678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f4725628700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4720152140 0x7f47201525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f4725628700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f472009a7e0 0x7f472009ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f4725628700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4720152af0 con 0x7f472009a7e0 2023-10-06T02:20:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f4725628700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472009b190 con 0x7f4720145600 2023-10-06T02:20:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f4725628700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4720097f80 con 0x7f4720152140 2023-10-06T02:20:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f471f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f472009a7e0 0x7f472009ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f471f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f472009a7e0 0x7f472009ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56786/0 (socket says 172.21.15.6:56786) 2023-10-06T02:20:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f471f7fe700 1 -- 172.21.15.6:0/2093627029 learned_addr learned my addr 172.21.15.6:0/2093627029 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f471e7fc700 1 --2- 172.21.15.6:0/2093627029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4720152140 0x7f47201525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f471effd700 1 --2- 172.21.15.6:0/2093627029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4720145600 0x7f47201678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f471f7fe700 1 -- 172.21.15.6:0/2093627029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4720152140 msgr2=0x7f47201525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f471f7fe700 1 --2- 172.21.15.6:0/2093627029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4720152140 0x7f47201525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f471f7fe700 1 -- 172.21.15.6:0/2093627029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4720145600 msgr2=0x7f47201678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f471f7fe700 1 --2- 172.21.15.6:0/2093627029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4720145600 0x7f47201678e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f471f7fe700 1 -- 172.21.15.6:0/2093627029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4720098b00 con 0x7f472009a7e0 2023-10-06T02:20:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f471f7fe700 1 --2- 172.21.15.6:0/2093627029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f472009a7e0 0x7f472009ac50 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f470c004770 tx=0x7f4710016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f4716ffd700 1 -- 172.21.15.6:0/2093627029 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4710023070 con 0x7f472009a7e0 2023-10-06T02:20:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f4716ffd700 1 -- 172.21.15.6:0/2093627029 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4710001a10 con 0x7f472009a7e0 2023-10-06T02:20:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f4725628700 1 -- 172.21.15.6:0/2093627029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4720167e20 con 0x7f472009a7e0 2023-10-06T02:20:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f4716ffd700 1 -- 172.21.15.6:0/2093627029 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47100070d0 con 0x7f472009a7e0 2023-10-06T02:20:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.575+0000 7f4725628700 1 -- 172.21.15.6:0/2093627029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47200981d0 con 0x7f472009a7e0 2023-10-06T02:20:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.577+0000 7f4725628700 1 -- 172.21.15.6:0/2093627029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4720098c90 con 0x7f472009a7e0 2023-10-06T02:20:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.577+0000 7f4716ffd700 1 -- 172.21.15.6:0/2093627029 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f471001e430 con 0x7f472009a7e0 2023-10-06T02:20:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.577+0000 7f4716ffd700 1 --2- 172.21.15.6:0/2093627029 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4700066f30 0x7f47000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.577+0000 7f4716ffd700 1 -- 172.21.15.6:0/2093627029 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f4710086b50 con 0x7f472009a7e0 2023-10-06T02:20:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.577+0000 7f471effd700 1 --2- 172.21.15.6:0/2093627029 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4700066f30 0x7f47000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.578+0000 7f471effd700 1 --2- 172.21.15.6:0/2093627029 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4700066f30 0x7f47000693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4718006ea0 tx=0x7f4718008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.582+0000 7f4716ffd700 1 -- 172.21.15.6:0/2093627029 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4710053ad0 con 0x7f472009a7e0 2023-10-06T02:20:37.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.819+0000 7f4725628700 1 -- 172.21.15.6:0/2093627029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f472006e8d0 con 0x7f472009a7e0 2023-10-06T02:20:37.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.820+0000 7f4716ffd700 1 -- 172.21.15.6:0/2093627029 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f47100570f0 con 0x7f472009a7e0 2023-10-06T02:20:37.820 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:37.820 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2589522502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2589522502},{"type":"v1","addr":"172.21.15.175:6837","nonce":2589522502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3703329287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3703329287},{"type":"v1","addr":"172.21.15.175:6836","nonce":3703329287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/843207095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":843207095},{"type":"v1","addr":"172.21.15.6:6834","nonce":843207095}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:10.479851+0000","modified":"2023-10-06T02:20:35.576072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5973":{"gid":5973,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/1891041000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1891041000},{"type":"v1","addr":"172.21.15.6:6835","nonce":1891041000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:20:37.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.821+0000 7f4725628700 1 -- 172.21.15.6:0/2093627029 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4700066f30 msgr2=0x7f47000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.821+0000 7f4725628700 1 --2- 172.21.15.6:0/2093627029 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4700066f30 0x7f47000693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4718006ea0 tx=0x7f4718008040 comp rx=0 tx=0).stop 2023-10-06T02:20:37.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.821+0000 7f4725628700 1 -- 172.21.15.6:0/2093627029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f472009a7e0 msgr2=0x7f472009ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.821+0000 7f4725628700 1 --2- 172.21.15.6:0/2093627029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f472009a7e0 0x7f472009ac50 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f470c004770 tx=0x7f4710016000 comp rx=0 tx=0).stop 2023-10-06T02:20:37.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.821+0000 7f4725628700 1 -- 172.21.15.6:0/2093627029 shutdown_connections 2023-10-06T02:20:37.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.821+0000 7f4725628700 1 --2- 172.21.15.6:0/2093627029 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4700066f30 0x7f47000693e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.821+0000 7f4725628700 1 --2- 172.21.15.6:0/2093627029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f472009a7e0 0x7f472009ac50 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.821+0000 7f4725628700 1 --2- 172.21.15.6:0/2093627029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4720145600 0x7f47201678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.821+0000 7f4725628700 1 --2- 172.21.15.6:0/2093627029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4720152140 0x7f47201525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.822+0000 7f4725628700 1 -- 172.21.15.6:0/2093627029 >> 172.21.15.6:0/2093627029 conn(0x7f4720067910 msgr2=0x7f4720156300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:37.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.822+0000 7f4725628700 1 -- 172.21.15.6:0/2093627029 shutdown_connections 2023-10-06T02:20:37.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.822+0000 7f4725628700 1 -- 172.21.15.6:0/2093627029 wait complete. 2023-10-06T02:20:37.823 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 40 2023-10-06T02:20:37.834 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:20:37.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.952+0000 7f0386e5d700 1 Processor -- start 2023-10-06T02:20:37.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.952+0000 7f0386e5d700 1 -- start start 2023-10-06T02:20:37.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.953+0000 7f0386e5d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0380151590 0x7f03800690d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.953+0000 7f0386e5d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f03801575f0 0x7f03801587c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.953+0000 7f0386e5d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03800cbc80 con 0x7f03800b1f50 2023-10-06T02:20:37.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.953+0000 7f0386e5d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0380157e40 con 0x7f03801575f0 2023-10-06T02:20:37.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.953+0000 7f0386e5d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0380158120 con 0x7f0380151590 2023-10-06T02:20:37.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.953+0000 7f038565a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f03801575f0 0x7f03801587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.953+0000 7f038565a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f03801575f0 0x7f03801587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56802/0 (socket says 172.21.15.6:56802) 2023-10-06T02:20:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.953+0000 7f038565a700 1 -- 172.21.15.6:0/3847036042 learned_addr learned my addr 172.21.15.6:0/3847036042 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.953+0000 7f038665c700 1 --1- 172.21.15.6:0/3847036042 >> v1:172.21.15.6:6789/0 conn(0x7f03800b1f50 0x7f03800b2370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46808/0 (socket says 172.21.15.6:46808) 2023-10-06T02:20:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.953+0000 7f0385e5b700 1 --2- 172.21.15.6:0/3847036042 >> v2:172.21.15.175:3300/0 conn(0x7f0380151590 0x7f03800690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.953+0000 7f038565a700 1 -- 172.21.15.6:0/3847036042 >> v2:172.21.15.175:3300/0 conn(0x7f0380151590 msgr2=0x7f03800690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.953+0000 7f038565a700 1 --2- 172.21.15.6:0/3847036042 >> v2:172.21.15.175:3300/0 conn(0x7f0380151590 0x7f03800690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.953+0000 7f038565a700 1 -- 172.21.15.6:0/3847036042 >> v1:172.21.15.6:6789/0 conn(0x7f03800b1f50 legacy=0x7f03800b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.954+0000 7f038565a700 1 -- 172.21.15.6:0/3847036042 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0380158400 con 0x7f03801575f0 2023-10-06T02:20:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.954+0000 7f0385e5b700 1 --2- 172.21.15.6:0/3847036042 >> v2:172.21.15.175:3300/0 conn(0x7f0380151590 0x7f03800690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.954+0000 7f038565a700 1 --2- 172.21.15.6:0/3847036042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03801575f0 0x7f03801587c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f03800647e0 tx=0x7f0374009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2e20352bd319a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.954+0000 7f0384e59700 1 -- 172.21.15.6:0/3847036042 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037400b860 con 0x7f03801575f0 2023-10-06T02:20:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.954+0000 7f0384e59700 1 -- 172.21.15.6:0/3847036042 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037400b9c0 con 0x7f03801575f0 2023-10-06T02:20:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.954+0000 7f0384e59700 1 -- 172.21.15.6:0/3847036042 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037400bd60 con 0x7f03801575f0 2023-10-06T02:20:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.954+0000 7f0386e5d700 1 -- 172.21.15.6:0/3847036042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03801575f0 msgr2=0x7f03801587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.954+0000 7f0386e5d700 1 --2- 172.21.15.6:0/3847036042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03801575f0 0x7f03801587c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f03800647e0 tx=0x7f0374009250 comp rx=0 tx=0).stop 2023-10-06T02:20:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.954+0000 7f0386e5d700 1 -- 172.21.15.6:0/3847036042 shutdown_connections 2023-10-06T02:20:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.954+0000 7f0386e5d700 1 --2- 172.21.15.6:0/3847036042 >> v2:172.21.15.175:3300/0 conn(0x7f0380151590 0x7f03800690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.954+0000 7f0386e5d700 1 --2- 172.21.15.6:0/3847036042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03801575f0 0x7f03801587c0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.954+0000 7f0386e5d700 1 -- 172.21.15.6:0/3847036042 >> 172.21.15.6:0/3847036042 conn(0x7f038006b320 msgr2=0x7f038006b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.955+0000 7f0386e5d700 1 -- 172.21.15.6:0/3847036042 shutdown_connections 2023-10-06T02:20:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.955+0000 7f0386e5d700 1 -- 172.21.15.6:0/3847036042 wait complete. 2023-10-06T02:20:37.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.956+0000 7f0386e5d700 1 Processor -- start 2023-10-06T02:20:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.956+0000 7f0386e5d700 1 -- start start 2023-10-06T02:20:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.957+0000 7f0386e5d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03800b1f50 0x7f038016b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.957+0000 7f0386e5d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0380151590 0x7f0380152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.957+0000 7f0386e5d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03801575f0 0x7f038014ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.957+0000 7f0386e5d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03800a5780 con 0x7f0380151590 2023-10-06T02:20:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.957+0000 7f0386e5d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03800a5a60 con 0x7f03800b1f50 2023-10-06T02:20:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.957+0000 7f0386e5d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0380152e70 con 0x7f03801575f0 2023-10-06T02:20:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.957+0000 7f038565a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0380151590 0x7f0380152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.957+0000 7f038565a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0380151590 0x7f0380152930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56804/0 (socket says 172.21.15.6:56804) 2023-10-06T02:20:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.957+0000 7f038565a700 1 -- 172.21.15.6:0/2855889635 learned_addr learned my addr 172.21.15.6:0/2855889635 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.957+0000 7f0385e5b700 1 --2- 172.21.15.6:0/2855889635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03800b1f50 0x7f038016b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.957+0000 7f038665c700 1 --2- 172.21.15.6:0/2855889635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03801575f0 0x7f038014ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.957+0000 7f038565a700 1 -- 172.21.15.6:0/2855889635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03801575f0 msgr2=0x7f038014ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.957+0000 7f038565a700 1 --2- 172.21.15.6:0/2855889635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03801575f0 0x7f038014ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.957+0000 7f038565a700 1 -- 172.21.15.6:0/2855889635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03800b1f50 msgr2=0x7f038016b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.957+0000 7f038565a700 1 --2- 172.21.15.6:0/2855889635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03800b1f50 0x7f038016b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.957+0000 7f038565a700 1 -- 172.21.15.6:0/2855889635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03740094f0 con 0x7f0380151590 2023-10-06T02:20:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.958+0000 7f038565a700 1 --2- 172.21.15.6:0/2855889635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0380151590 0x7f0380152930 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0374009290 tx=0x7f0374017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.958+0000 7f037dffb700 1 -- 172.21.15.6:0/2855889635 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037401a450 con 0x7f0380151590 2023-10-06T02:20:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.958+0000 7f037dffb700 1 -- 172.21.15.6:0/2855889635 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037401a5b0 con 0x7f0380151590 2023-10-06T02:20:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.958+0000 7f0386e5d700 1 -- 172.21.15.6:0/2855889635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0380153110 con 0x7f0380151590 2023-10-06T02:20:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.958+0000 7f037dffb700 1 -- 172.21.15.6:0/2855889635 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037401a970 con 0x7f0380151590 2023-10-06T02:20:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.958+0000 7f0386e5d700 1 -- 172.21.15.6:0/2855889635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03801536d0 con 0x7f0380151590 2023-10-06T02:20:37.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.959+0000 7f0386e5d700 1 -- 172.21.15.6:0/2855889635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03800a6f50 con 0x7f0380151590 2023-10-06T02:20:37.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.959+0000 7f037dffb700 1 -- 172.21.15.6:0/2855889635 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f037401ace0 con 0x7f0380151590 2023-10-06T02:20:37.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.960+0000 7f037dffb700 1 --2- 172.21.15.6:0/2855889635 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f036c066f30 0x7f036c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:37.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.960+0000 7f037dffb700 1 -- 172.21.15.6:0/2855889635 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f0374085ff0 con 0x7f0380151590 2023-10-06T02:20:37.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.960+0000 7f0385e5b700 1 --2- 172.21.15.6:0/2855889635 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f036c066f30 0x7f036c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:37.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.961+0000 7f0385e5b700 1 --2- 172.21.15.6:0/2855889635 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f036c066f30 0x7f036c0693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0378007740 tx=0x7f03780099d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:37.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:37.968+0000 7f037dffb700 1 -- 172.21.15.6:0/2855889635 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0374052f70 con 0x7f0380151590 2023-10-06T02:20:38.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.163+0000 7f0386e5d700 1 -- 172.21.15.6:0/2855889635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03800a5bd0 con 0x7f0380151590 2023-10-06T02:20:38.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.164+0000 7f037dffb700 1 -- 172.21.15.6:0/2855889635 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17150 (secure 0 0 0) 0x7f0374056590 con 0x7f0380151590 2023-10-06T02:20:38.165 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:38.165 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":55,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:20:30.553655+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:20:08.649152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T02:20:09.450444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/1800326966":"2023-10-07T02:20:30.553628+0000","172.21.15.6:6833/1800326966":"2023-10-07T02:20:30.553628+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:20:38.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.166+0000 7f0386e5d700 1 -- 172.21.15.6:0/2855889635 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f036c066f30 msgr2=0x7f036c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:38.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.166+0000 7f0386e5d700 1 --2- 172.21.15.6:0/2855889635 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f036c066f30 0x7f036c0693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0378007740 tx=0x7f03780099d0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.166+0000 7f0386e5d700 1 -- 172.21.15.6:0/2855889635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0380151590 msgr2=0x7f0380152930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:38.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.166+0000 7f0386e5d700 1 --2- 172.21.15.6:0/2855889635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0380151590 0x7f0380152930 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0374009290 tx=0x7f0374017000 comp rx=0 tx=0).stop 2023-10-06T02:20:38.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.166+0000 7f0386e5d700 1 -- 172.21.15.6:0/2855889635 shutdown_connections 2023-10-06T02:20:38.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.166+0000 7f0386e5d700 1 --2- 172.21.15.6:0/2855889635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03801575f0 0x7f038014ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.166+0000 7f0386e5d700 1 --2- 172.21.15.6:0/2855889635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03800b1f50 0x7f038016b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.166+0000 7f0386e5d700 1 --2- 172.21.15.6:0/2855889635 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f036c066f30 0x7f036c0693e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.167+0000 7f0386e5d700 1 --2- 172.21.15.6:0/2855889635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0380151590 0x7f0380152930 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.167+0000 7f0386e5d700 1 -- 172.21.15.6:0/2855889635 >> 172.21.15.6:0/2855889635 conn(0x7f038006b320 msgr2=0x7f0380156630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:38.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.167+0000 7f0386e5d700 1 -- 172.21.15.6:0/2855889635 shutdown_connections 2023-10-06T02:20:38.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.167+0000 7f0386e5d700 1 -- 172.21.15.6:0/2855889635 wait complete. 2023-10-06T02:20:38.179 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:20:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.299+0000 7ff484fed700 1 Processor -- start 2023-10-06T02:20:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.299+0000 7ff484fed700 1 -- start start 2023-10-06T02:20:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.300+0000 7ff484fed700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff480159400 0x7ff4800ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.300+0000 7ff484fed700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4800b3560 con 0x7ff4800d05d0 2023-10-06T02:20:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.300+0000 7ff484fed700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4800cf6f0 con 0x7ff4800cd030 2023-10-06T02:20:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.300+0000 7ff484fed700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4800cf9d0 con 0x7ff480159400 2023-10-06T02:20:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.300+0000 7ff47ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff4800d05d0 0x7ff4800b39f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46816/0 (socket says 172.21.15.6:46816) 2023-10-06T02:20:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.300+0000 7ff47ffff700 1 -- 172.21.15.6:0/897001959 learned_addr learned my addr 172.21.15.6:0/897001959 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.300+0000 7ff47f7fe700 1 --2- 172.21.15.6:0/897001959 >> v2:172.21.15.175:3300/0 conn(0x7ff480159400 0x7ff4800ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.300+0000 7ff47e7fc700 1 -- 172.21.15.6:0/897001959 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415360739 0 0) 0x7ff4800b3560 con 0x7ff4800d05d0 2023-10-06T02:20:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.300+0000 7ff47e7fc700 1 -- 172.21.15.6:0/897001959 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff468003570 con 0x7ff4800d05d0 2023-10-06T02:20:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.300+0000 7ff47e7fc700 1 -- 172.21.15.6:0/897001959 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161245215 0 0) 0x7ff4800cf6f0 con 0x7ff4800cd030 2023-10-06T02:20:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.300+0000 7ff47e7fc700 1 -- 172.21.15.6:0/897001959 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4800b3560 con 0x7ff4800cd030 2023-10-06T02:20:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.300+0000 7ff47f7fe700 1 -- 172.21.15.6:0/897001959 >> v1:172.21.15.175:6789/0 conn(0x7ff4800cd030 legacy=0x7ff4800cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.300+0000 7ff47f7fe700 1 -- 172.21.15.6:0/897001959 >> v1:172.21.15.6:6789/0 conn(0x7ff4800d05d0 legacy=0x7ff4800b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.300+0000 7ff47f7fe700 1 -- 172.21.15.6:0/897001959 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4800b2f10 con 0x7ff480159400 2023-10-06T02:20:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.301+0000 7ff47f7fe700 1 --2- 172.21.15.6:0/897001959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff480159400 0x7ff4800ccaf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff4700098d0 tx=0x7ff470009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b70a16ed12b375b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.301+0000 7ff47e7fc700 1 -- 172.21.15.6:0/897001959 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff470005c10 con 0x7ff480159400 2023-10-06T02:20:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.301+0000 7ff47e7fc700 1 -- 172.21.15.6:0/897001959 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff470005d70 con 0x7ff480159400 2023-10-06T02:20:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.301+0000 7ff47e7fc700 1 -- 172.21.15.6:0/897001959 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff470006260 con 0x7ff480159400 2023-10-06T02:20:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.301+0000 7ff484fed700 1 -- 172.21.15.6:0/897001959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff480159400 msgr2=0x7ff4800ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.301+0000 7ff484fed700 1 --2- 172.21.15.6:0/897001959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff480159400 0x7ff4800ccaf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff4700098d0 tx=0x7ff470009120 comp rx=0 tx=0).stop 2023-10-06T02:20:38.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.301+0000 7ff484fed700 1 -- 172.21.15.6:0/897001959 shutdown_connections 2023-10-06T02:20:38.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.301+0000 7ff484fed700 1 --2- 172.21.15.6:0/897001959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff480159400 0x7ff4800ccaf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.301+0000 7ff484fed700 1 -- 172.21.15.6:0/897001959 >> 172.21.15.6:0/897001959 conn(0x7ff48006ac10 msgr2=0x7ff480068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:38.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.301+0000 7ff484fed700 1 -- 172.21.15.6:0/897001959 shutdown_connections 2023-10-06T02:20:38.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.301+0000 7ff484fed700 1 -- 172.21.15.6:0/897001959 wait complete. 2023-10-06T02:20:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.303+0000 7ff484fed700 1 Processor -- start 2023-10-06T02:20:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.303+0000 7ff484fed700 1 -- start start 2023-10-06T02:20:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.303+0000 7ff484fed700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4800cd030 0x7ff48014f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.303+0000 7ff484fed700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4800d05d0 0x7ff4800c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.303+0000 7ff484fed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff480159400 0x7ff4800c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.303+0000 7ff484fed700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48016e510 con 0x7ff480159400 2023-10-06T02:20:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.303+0000 7ff484fed700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff480150220 con 0x7ff4800d05d0 2023-10-06T02:20:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.303+0000 7ff484fed700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff480150500 con 0x7ff4800cd030 2023-10-06T02:20:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.303+0000 7ff47ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff480159400 0x7ff4800c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.304+0000 7ff47ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff480159400 0x7ff4800c6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56812/0 (socket says 172.21.15.6:56812) 2023-10-06T02:20:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.304+0000 7ff47ffff700 1 -- 172.21.15.6:0/3663905715 learned_addr learned my addr 172.21.15.6:0/3663905715 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.304+0000 7ff47ffff700 1 -- 172.21.15.6:0/3663905715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4800cd030 msgr2=0x7ff48014f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.304+0000 7ff47f7fe700 1 --2- 172.21.15.6:0/3663905715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4800cd030 0x7ff48014f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.304+0000 7ff47effd700 1 --2- 172.21.15.6:0/3663905715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4800d05d0 0x7ff4800c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.304+0000 7ff47ffff700 1 --2- 172.21.15.6:0/3663905715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4800cd030 0x7ff48014f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.304+0000 7ff47ffff700 1 -- 172.21.15.6:0/3663905715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4800d05d0 msgr2=0x7ff4800c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.304+0000 7ff47ffff700 1 --2- 172.21.15.6:0/3663905715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4800d05d0 0x7ff4800c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.304+0000 7ff47ffff700 1 -- 172.21.15.6:0/3663905715 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4700093c0 con 0x7ff480159400 2023-10-06T02:20:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.304+0000 7ff47effd700 1 --2- 172.21.15.6:0/3663905715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4800d05d0 0x7ff4800c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.304+0000 7ff47ffff700 1 --2- 172.21.15.6:0/3663905715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff480159400 0x7ff4800c6e60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff478001460 tx=0x7ff478001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.304+0000 7ff4677fe700 1 -- 172.21.15.6:0/3663905715 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47800cea0 con 0x7ff480159400 2023-10-06T02:20:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.304+0000 7ff4677fe700 1 -- 172.21.15.6:0/3663905715 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47800ab70 con 0x7ff480159400 2023-10-06T02:20:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.304+0000 7ff484fed700 1 -- 172.21.15.6:0/3663905715 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4801507e0 con 0x7ff480159400 2023-10-06T02:20:38.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.304+0000 7ff4677fe700 1 -- 172.21.15.6:0/3663905715 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4780070f0 con 0x7ff480159400 2023-10-06T02:20:38.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.304+0000 7ff484fed700 1 -- 172.21.15.6:0/3663905715 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48014fb60 con 0x7ff480159400 2023-10-06T02:20:38.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.305+0000 7ff484fed700 1 -- 172.21.15.6:0/3663905715 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff480069210 con 0x7ff480159400 2023-10-06T02:20:38.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.306+0000 7ff4677fe700 1 -- 172.21.15.6:0/3663905715 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff478007460 con 0x7ff480159400 2023-10-06T02:20:38.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.306+0000 7ff4677fe700 1 --2- 172.21.15.6:0/3663905715 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff46c066f30 0x7ff46c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:38.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.306+0000 7ff4677fe700 1 -- 172.21.15.6:0/3663905715 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff478084d70 con 0x7ff480159400 2023-10-06T02:20:38.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.306+0000 7ff47f7fe700 1 --2- 172.21.15.6:0/3663905715 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff46c066f30 0x7ff46c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:38.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.307+0000 7ff47f7fe700 1 --2- 172.21.15.6:0/3663905715 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff46c066f30 0x7ff46c0693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff4700098d0 tx=0x7ff470016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:38.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.310+0000 7ff4677fe700 1 -- 172.21.15.6:0/3663905715 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff478051cf0 con 0x7ff480159400 2023-10-06T02:20:38.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.549+0000 7ff484fed700 1 -- 172.21.15.6:0/3663905715 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff4800cf2b0 con 0x7ff480159400 2023-10-06T02:20:38.550 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:20:38.550+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:20:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.554+0000 7ff4677fe700 1 -- 172.21.15.6:0/3663905715 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff478055310 con 0x7ff480159400 2023-10-06T02:20:38.556 INFO:tasks.ceph.mds.a.smithi006.stderr: -42> 2023-10-06T02:20:36.566+0000 7f6d6816c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:20:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.557+0000 7ff484fed700 1 -- 172.21.15.6:0/3663905715 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff46c066f30 msgr2=0x7ff46c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.557+0000 7ff484fed700 1 --2- 172.21.15.6:0/3663905715 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff46c066f30 0x7ff46c0693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff4700098d0 tx=0x7ff470016000 comp rx=0 tx=0).stop 2023-10-06T02:20:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.557+0000 7ff484fed700 1 -- 172.21.15.6:0/3663905715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff480159400 msgr2=0x7ff4800c6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.557+0000 7ff484fed700 1 --2- 172.21.15.6:0/3663905715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff480159400 0x7ff4800c6e60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff478001460 tx=0x7ff478001ac0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.557+0000 7ff484fed700 1 -- 172.21.15.6:0/3663905715 shutdown_connections 2023-10-06T02:20:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.557+0000 7ff484fed700 1 --2- 172.21.15.6:0/3663905715 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff46c066f30 0x7ff46c0693e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.557+0000 7ff484fed700 1 --2- 172.21.15.6:0/3663905715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff480159400 0x7ff4800c6e60 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.557+0000 7ff484fed700 1 --2- 172.21.15.6:0/3663905715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4800cd030 0x7ff48014f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.557+0000 7ff484fed700 1 --2- 172.21.15.6:0/3663905715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4800d05d0 0x7ff4800c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.557+0000 7ff484fed700 1 -- 172.21.15.6:0/3663905715 >> 172.21.15.6:0/3663905715 conn(0x7ff48006ac10 msgr2=0x7ff4800cc230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.557+0000 7ff484fed700 1 -- 172.21.15.6:0/3663905715 shutdown_connections 2023-10-06T02:20:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.557+0000 7ff484fed700 1 -- 172.21.15.6:0/3663905715 wait complete. 2023-10-06T02:20:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:20:38.571 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:20:38.576 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:20:38.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.692+0000 7f3bb0e96700 1 Processor -- start 2023-10-06T02:20:38.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.692+0000 7f3bb0e96700 1 -- start start 2023-10-06T02:20:38.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.693+0000 7f3bb0e96700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3bac0d0400 0x7f3bac0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.693+0000 7f3bb0e96700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac0d07d0 0x7f3bac0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.693+0000 7f3bb0e96700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bac0b6170 con 0x7f3bac0ccd40 2023-10-06T02:20:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.693+0000 7f3bb0e96700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bac15dd40 con 0x7f3bac0d0400 2023-10-06T02:20:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.693+0000 7f3bb0e96700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac15e020 con 0x7f3bac0d07d0 2023-10-06T02:20:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.693+0000 7f3baa59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3bac0d0400 0x7f3bac0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.693+0000 7f3ba9d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3bac0ccd40 0x7f3bac0cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59854/0 (socket says 172.21.15.6:59854) 2023-10-06T02:20:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.693+0000 7f3ba9d9b700 1 -- 172.21.15.6:0/98003352 learned_addr learned my addr 172.21.15.6:0/98003352 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.693+0000 7f3baad9d700 1 --2- 172.21.15.6:0/98003352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac0d07d0 0x7f3bac0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.693+0000 7f3baa59c700 1 -- 172.21.15.6:0/98003352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac0d07d0 msgr2=0x7f3bac0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.693+0000 7f3baa59c700 1 --2- 172.21.15.6:0/98003352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac0d07d0 0x7f3bac0b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.693+0000 7f3baa59c700 1 -- 172.21.15.6:0/98003352 >> v1:172.21.15.6:6789/0 conn(0x7f3bac0ccd40 legacy=0x7f3bac0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:38.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.693+0000 7f3baa59c700 1 -- 172.21.15.6:0/98003352 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac0ceaa0 con 0x7f3bac0d0400 2023-10-06T02:20:38.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.693+0000 7f3ba959a700 1 -- 172.21.15.6:0/98003352 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311830290 0 0) 0x7f3bac0b6170 con 0x7f3bac0ccd40 2023-10-06T02:20:38.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.693+0000 7f3baa59c700 1 --2- 172.21.15.6:0/98003352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bac0d0400 0x7f3bac0b5c30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0098d0 tx=0x7f3b9c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fafc4a81a71745d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:38.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.693+0000 7f3ba959a700 1 -- 172.21.15.6:0/98003352 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c005c10 con 0x7f3bac0d0400 2023-10-06T02:20:38.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.694+0000 7f3ba959a700 1 -- 172.21.15.6:0/98003352 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c005d70 con 0x7f3bac0d0400 2023-10-06T02:20:38.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.694+0000 7f3ba959a700 1 -- 172.21.15.6:0/98003352 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c006280 con 0x7f3bac0d0400 2023-10-06T02:20:38.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.694+0000 7f3bb0e96700 1 -- 172.21.15.6:0/98003352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bac0d0400 msgr2=0x7f3bac0b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:38.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.694+0000 7f3bb0e96700 1 --2- 172.21.15.6:0/98003352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bac0d0400 0x7f3bac0b5c30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0098d0 tx=0x7f3b9c009120 comp rx=0 tx=0).stop 2023-10-06T02:20:38.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.694+0000 7f3bb0e96700 1 -- 172.21.15.6:0/98003352 shutdown_connections 2023-10-06T02:20:38.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.694+0000 7f3bb0e96700 1 --2- 172.21.15.6:0/98003352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac0d07d0 0x7f3bac0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.694+0000 7f3bb0e96700 1 --2- 172.21.15.6:0/98003352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bac0d0400 0x7f3bac0b5c30 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.694+0000 7f3bb0e96700 1 -- 172.21.15.6:0/98003352 >> 172.21.15.6:0/98003352 conn(0x7f3bac06a220 msgr2=0x7f3bac06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:38.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.694+0000 7f3bb0e96700 1 -- 172.21.15.6:0/98003352 shutdown_connections 2023-10-06T02:20:38.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.694+0000 7f3bb0e96700 1 -- 172.21.15.6:0/98003352 wait complete. 2023-10-06T02:20:38.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.695+0000 7f3bb0e96700 1 Processor -- start 2023-10-06T02:20:38.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.695+0000 7f3bb0e96700 1 -- start start 2023-10-06T02:20:38.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.696+0000 7f3bb0e96700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bac0ccd40 0x7f3bac154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:38.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.696+0000 7f3bb0e96700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bac0d0400 0x7f3bac0c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:38.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.696+0000 7f3bb0e96700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac0d07d0 0x7f3bac0c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.696+0000 7f3bb0e96700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac15d800 con 0x7f3bac0ccd40 2023-10-06T02:20:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.696+0000 7f3bb0e96700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac15d520 con 0x7f3bac0d0400 2023-10-06T02:20:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.696+0000 7f3bb0e96700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0c5a20 con 0x7f3bac0d07d0 2023-10-06T02:20:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.696+0000 7f3baa59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bac0ccd40 0x7f3bac154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.696+0000 7f3baa59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bac0ccd40 0x7f3bac154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46318/0 (socket says 172.21.15.6:46318) 2023-10-06T02:20:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.696+0000 7f3baa59c700 1 -- 172.21.15.6:0/3882865265 learned_addr learned my addr 172.21.15.6:0/3882865265 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.696+0000 7f3baa59c700 1 -- 172.21.15.6:0/3882865265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac0d07d0 msgr2=0x7f3bac0c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.696+0000 7f3baa59c700 1 --2- 172.21.15.6:0/3882865265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac0d07d0 0x7f3bac0c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.696+0000 7f3baa59c700 1 -- 172.21.15.6:0/3882865265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bac0d0400 msgr2=0x7f3bac0c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.696+0000 7f3baa59c700 1 --2- 172.21.15.6:0/3882865265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bac0d0400 0x7f3bac0c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.696+0000 7f3baa59c700 1 -- 172.21.15.6:0/3882865265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c0093c0 con 0x7f3bac0ccd40 2023-10-06T02:20:38.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.697+0000 7f3baa59c700 1 --2- 172.21.15.6:0/3882865265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bac0ccd40 0x7f3bac154fe0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c009f70 tx=0x7f3b9c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:38.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.697+0000 7f3b9a7fc700 1 -- 172.21.15.6:0/3882865265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c01d730 con 0x7f3bac0ccd40 2023-10-06T02:20:38.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.697+0000 7f3b9a7fc700 1 -- 172.21.15.6:0/3882865265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c01d8b0 con 0x7f3bac0ccd40 2023-10-06T02:20:38.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.697+0000 7f3bb0e96700 1 -- 172.21.15.6:0/3882865265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bac0c5d00 con 0x7f3bac0ccd40 2023-10-06T02:20:38.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.697+0000 7f3b9a7fc700 1 -- 172.21.15.6:0/3882865265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c01dc70 con 0x7f3bac0ccd40 2023-10-06T02:20:38.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.697+0000 7f3bb0e96700 1 -- 172.21.15.6:0/3882865265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bac155520 con 0x7f3bac0ccd40 2023-10-06T02:20:38.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.698+0000 7f3bb0e96700 1 -- 172.21.15.6:0/3882865265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bac0c5880 con 0x7f3bac0ccd40 2023-10-06T02:20:38.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.698+0000 7f3b9a7fc700 1 -- 172.21.15.6:0/3882865265 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b9c01b690 con 0x7f3bac0ccd40 2023-10-06T02:20:38.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.699+0000 7f3b9a7fc700 1 --2- 172.21.15.6:0/3882865265 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3b8c066f30 0x7f3b8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:38.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.699+0000 7f3b9a7fc700 1 -- 172.21.15.6:0/3882865265 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f3b9c086640 con 0x7f3bac0ccd40 2023-10-06T02:20:38.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.699+0000 7f3ba9d9b700 1 --2- 172.21.15.6:0/3882865265 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3b8c066f30 0x7f3b8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:38.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.699+0000 7f3ba9d9b700 1 --2- 172.21.15.6:0/3882865265 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3b8c066f30 0x7f3b8c0693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00011e0 tx=0x7f3ba00079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:38.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.703+0000 7f3b9a7fc700 1 -- 172.21.15.6:0/3882865265 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bac0c5880 con 0x7f3bac0ccd40 2023-10-06T02:20:38.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:38.938+0000 7f3bb0e96700 1 -- 172.21.15.6:0/3882865265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3bac0c5880 con 0x7f3bac0ccd40 2023-10-06T02:20:39.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.592+0000 7f3b9a7fc700 1 -- 172.21.15.6:0/3882865265 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3bac0c5880 con 0x7f3bac0ccd40 2023-10-06T02:20:39.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.595+0000 7f3bb0e96700 1 -- 172.21.15.6:0/3882865265 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3b8c066f30 msgr2=0x7f3b8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:39.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.595+0000 7f3bb0e96700 1 --2- 172.21.15.6:0/3882865265 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3b8c066f30 0x7f3b8c0693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00011e0 tx=0x7f3ba00079d0 comp rx=0 tx=0).stop 2023-10-06T02:20:39.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.595+0000 7f3bb0e96700 1 -- 172.21.15.6:0/3882865265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bac0ccd40 msgr2=0x7f3bac154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:39.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.595+0000 7f3bb0e96700 1 --2- 172.21.15.6:0/3882865265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bac0ccd40 0x7f3bac154fe0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c009f70 tx=0x7f3b9c016000 comp rx=0 tx=0).stop 2023-10-06T02:20:39.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.595+0000 7f3bb0e96700 1 -- 172.21.15.6:0/3882865265 shutdown_connections 2023-10-06T02:20:39.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.595+0000 7f3bb0e96700 1 --2- 172.21.15.6:0/3882865265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac0d07d0 0x7f3bac0c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:39.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.595+0000 7f3bb0e96700 1 --2- 172.21.15.6:0/3882865265 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3b8c066f30 0x7f3b8c0693e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:39.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.595+0000 7f3bb0e96700 1 --2- 172.21.15.6:0/3882865265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bac0ccd40 0x7f3bac154fe0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:39.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.595+0000 7f3bb0e96700 1 --2- 172.21.15.6:0/3882865265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bac0d0400 0x7f3bac0c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:39.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.595+0000 7f3bb0e96700 1 -- 172.21.15.6:0/3882865265 >> 172.21.15.6:0/3882865265 conn(0x7f3bac06a220 msgr2=0x7f3bac0b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:39.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.595+0000 7f3bb0e96700 1 -- 172.21.15.6:0/3882865265 shutdown_connections 2023-10-06T02:20:39.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.595+0000 7f3bb0e96700 1 -- 172.21.15.6:0/3882865265 wait complete. 2023-10-06T02:20:39.609 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:20:39.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.775+0000 7f8cbafe3700 1 Processor -- start 2023-10-06T02:20:39.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.775+0000 7f8cbafe3700 1 -- start start 2023-10-06T02:20:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.776+0000 7f8cbafe3700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8cb4155660 0x7f8cb40b0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.776+0000 7f8cbafe3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb40affa0 con 0x7f8cb40ad9f0 2023-10-06T02:20:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.776+0000 7f8cbafe3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb40c9100 con 0x7f8cb4155a30 2023-10-06T02:20:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.776+0000 7f8cbafe3700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb40af9e0 con 0x7f8cb4155660 2023-10-06T02:20:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.776+0000 7f8cb9580700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8cb40ad9f0 0x7f8cb415f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59866/0 (socket says 172.21.15.6:59866) 2023-10-06T02:20:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.776+0000 7f8cb9580700 1 -- 172.21.15.6:0/509636060 learned_addr learned my addr 172.21.15.6:0/509636060 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.776+0000 7f8cb8d7f700 1 --2- 172.21.15.6:0/509636060 >> v2:172.21.15.175:3300/0 conn(0x7f8cb4155660 0x7f8cb40b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.776+0000 7f8cb37fe700 1 -- 172.21.15.6:0/509636060 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405554390 0 0) 0x7f8cb40affa0 con 0x7f8cb40ad9f0 2023-10-06T02:20:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.776+0000 7f8cb37fe700 1 -- 172.21.15.6:0/509636060 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ca0004680 con 0x7f8cb40ad9f0 2023-10-06T02:20:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb37fe700 1 -- 172.21.15.6:0/509636060 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2732630021 0 0) 0x7f8ca0004680 con 0x7f8cb40ad9f0 2023-10-06T02:20:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb37fe700 1 -- 172.21.15.6:0/509636060 >> v2:172.21.15.175:3300/0 conn(0x7f8cb4155660 msgr2=0x7f8cb40b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb37fe700 1 --2- 172.21.15.6:0/509636060 >> v2:172.21.15.175:3300/0 conn(0x7f8cb4155660 0x7f8cb40b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb37fe700 1 -- 172.21.15.6:0/509636060 >> v1:172.21.15.175:6789/0 conn(0x7f8cb4155a30 legacy=0x7f8cb40aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb37fe700 1 -- 172.21.15.6:0/509636060 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb40afcc0 con 0x7f8cb40ad9f0 2023-10-06T02:20:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb37fe700 1 -- 172.21.15.6:0/509636060 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f8c9c001470 con 0x7f8cb40ad9f0 2023-10-06T02:20:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb37fe700 1 -- 172.21.15.6:0/509636060 >> v1:172.21.15.6:6789/0 conn(0x7f8cb40ad9f0 legacy=0x7f8cb415f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb37fe700 1 --2- 172.21.15.6:0/509636060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ca0004b70 0x7f8ca0004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb37fe700 1 --2- 172.21.15.6:0/509636060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ca0005920 0x7f8ca0005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb37fe700 1 --2- 172.21.15.6:0/509636060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ca00062d0 0x7f8ca000cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb37fe700 1 -- 172.21.15.6:0/509636060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40af9e0 con 0x7f8ca0004b70 2023-10-06T02:20:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb37fe700 1 -- 172.21.15.6:0/509636060 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca000d1e0 con 0x7f8ca0005920 2023-10-06T02:20:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb37fe700 1 -- 172.21.15.6:0/509636060 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca000d3a0 con 0x7f8ca00062d0 2023-10-06T02:20:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb8d7f700 1 --2- 172.21.15.6:0/509636060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ca0004b70 0x7f8ca0004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb9580700 1 --2- 172.21.15.6:0/509636060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ca00062d0 0x7f8ca000cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb3fff700 1 --2- 172.21.15.6:0/509636060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ca0005920 0x7f8ca0005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb8d7f700 1 -- 172.21.15.6:0/509636060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ca00062d0 msgr2=0x7f8ca000cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb8d7f700 1 --2- 172.21.15.6:0/509636060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ca00062d0 0x7f8ca000cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb8d7f700 1 -- 172.21.15.6:0/509636060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ca0005920 msgr2=0x7f8ca0005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb8d7f700 1 --2- 172.21.15.6:0/509636060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ca0005920 0x7f8ca0005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb8d7f700 1 -- 172.21.15.6:0/509636060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca0004680 con 0x7f8ca0004b70 2023-10-06T02:20:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb9580700 1 --2- 172.21.15.6:0/509636060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ca00062d0 0x7f8ca000cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb3fff700 1 --2- 172.21.15.6:0/509636060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ca0005920 0x7f8ca0005d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb9580700 1 -- 172.21.15.6:0/509636060 reap_dead start 2023-10-06T02:20:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb8d7f700 1 --2- 172.21.15.6:0/509636060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ca0004b70 0x7f8ca0004f80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00e210 tx=0x7f8cac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b20129d20ce12a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.777+0000 7f8cb37fe700 1 -- 172.21.15.6:0/509636060 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac00eac0 con 0x7f8ca0004b70 2023-10-06T02:20:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.778+0000 7f8cb37fe700 1 -- 172.21.15.6:0/509636060 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac00f040 con 0x7f8ca0004b70 2023-10-06T02:20:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.778+0000 7f8cb37fe700 1 -- 172.21.15.6:0/509636060 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac00ee70 con 0x7f8ca0004b70 2023-10-06T02:20:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.778+0000 7f8cbafe3700 1 -- 172.21.15.6:0/509636060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ca0004b70 msgr2=0x7f8ca0004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.778+0000 7f8cbafe3700 1 --2- 172.21.15.6:0/509636060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ca0004b70 0x7f8ca0004f80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00e210 tx=0x7f8cac00b040 comp rx=0 tx=0).stop 2023-10-06T02:20:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.778+0000 7f8cbafe3700 1 -- 172.21.15.6:0/509636060 shutdown_connections 2023-10-06T02:20:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.778+0000 7f8cbafe3700 1 --2- 172.21.15.6:0/509636060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ca0004b70 0x7f8ca0004f80 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.778+0000 7f8cbafe3700 1 -- 172.21.15.6:0/509636060 >> 172.21.15.6:0/509636060 conn(0x7f8cb40cbef0 msgr2=0x7f8cb40cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.778+0000 7f8cbafe3700 1 -- 172.21.15.6:0/509636060 shutdown_connections 2023-10-06T02:20:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.778+0000 7f8cbafe3700 1 -- 172.21.15.6:0/509636060 wait complete. 2023-10-06T02:20:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.779+0000 7f8cbafe3700 1 Processor -- start 2023-10-06T02:20:39.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.779+0000 7f8cbafe3700 1 -- start start 2023-10-06T02:20:39.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.780+0000 7f8cbafe3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ca0004b70 0x7f8cb4169480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.780+0000 7f8cbafe3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb40a9bf0 0x7f8cb41505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.780+0000 7f8cbafe3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cb4150af0 0x7f8cb40a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.780+0000 7f8cbafe3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb4150f90 con 0x7f8cb40a9bf0 2023-10-06T02:20:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.780+0000 7f8cbafe3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb41513f0 con 0x7f8ca0004b70 2023-10-06T02:20:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.780+0000 7f8cbafe3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb4169ad0 con 0x7f8cb4150af0 2023-10-06T02:20:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.780+0000 7f8cb3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb40a9bf0 0x7f8cb41505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.780+0000 7f8cb3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb40a9bf0 0x7f8cb41505b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46328/0 (socket says 172.21.15.6:46328) 2023-10-06T02:20:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.780+0000 7f8cb3fff700 1 -- 172.21.15.6:0/3308157068 learned_addr learned my addr 172.21.15.6:0/3308157068 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.780+0000 7f8cb8d7f700 1 --2- 172.21.15.6:0/3308157068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ca0004b70 0x7f8cb4169480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.780+0000 7f8cb9580700 1 --2- 172.21.15.6:0/3308157068 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cb4150af0 0x7f8cb40a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.781+0000 7f8cb3fff700 1 -- 172.21.15.6:0/3308157068 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cb4150af0 msgr2=0x7f8cb40a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.781+0000 7f8cb3fff700 1 --2- 172.21.15.6:0/3308157068 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cb4150af0 0x7f8cb40a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.781+0000 7f8cb3fff700 1 -- 172.21.15.6:0/3308157068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ca0004b70 msgr2=0x7f8cb4169480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.781+0000 7f8cb3fff700 1 --2- 172.21.15.6:0/3308157068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ca0004b70 0x7f8cb4169480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.781+0000 7f8cb3fff700 1 -- 172.21.15.6:0/3308157068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb4169db0 con 0x7f8cb40a9bf0 2023-10-06T02:20:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.781+0000 7f8cb3fff700 1 --2- 172.21.15.6:0/3308157068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb40a9bf0 0x7f8cb41505b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400e840 tx=0x7f8ca4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.781+0000 7f8cb0ff9700 1 -- 172.21.15.6:0/3308157068 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4010520 con 0x7f8cb40a9bf0 2023-10-06T02:20:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.781+0000 7f8cb0ff9700 1 -- 172.21.15.6:0/3308157068 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca4010680 con 0x7f8cb40a9bf0 2023-10-06T02:20:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.781+0000 7f8cbafe3700 1 -- 172.21.15.6:0/3308157068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb416a090 con 0x7f8cb40a9bf0 2023-10-06T02:20:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.781+0000 7f8cb0ff9700 1 -- 172.21.15.6:0/3308157068 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4010a20 con 0x7f8cb40a9bf0 2023-10-06T02:20:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.781+0000 7f8cbafe3700 1 -- 172.21.15.6:0/3308157068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb414f0a0 con 0x7f8cb40a9bf0 2023-10-06T02:20:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.782+0000 7f8cbafe3700 1 -- 172.21.15.6:0/3308157068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb4151560 con 0x7f8cb40a9bf0 2023-10-06T02:20:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.782+0000 7f8cb0ff9700 1 -- 172.21.15.6:0/3308157068 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ca4014480 con 0x7f8cb40a9bf0 2023-10-06T02:20:39.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.783+0000 7f8cb0ff9700 1 --2- 172.21.15.6:0/3308157068 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c94066f60 0x7f8c94069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:39.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.783+0000 7f8cb0ff9700 1 -- 172.21.15.6:0/3308157068 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f8ca40842b0 con 0x7f8cb40a9bf0 2023-10-06T02:20:39.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.783+0000 7f8cb8d7f700 1 --2- 172.21.15.6:0/3308157068 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c94066f60 0x7f8c94069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:39.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.783+0000 7f8cb8d7f700 1 --2- 172.21.15.6:0/3308157068 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c94066f60 0x7f8c94069410 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00afd0 tx=0x7f8cac01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:39.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.787+0000 7f8cb0ff9700 1 -- 172.21.15.6:0/3308157068 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8cb4151560 con 0x7f8cb40a9bf0 2023-10-06T02:20:39.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:39.979+0000 7f8cbafe3700 1 -- 172.21.15.6:0/3308157068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8cb4151560 con 0x7f8cb40a9bf0 2023-10-06T02:20:40.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.766+0000 7f8cb0ff9700 1 -- 172.21.15.6:0/3308157068 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8cb4151560 con 0x7f8cb40a9bf0 2023-10-06T02:20:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.770+0000 7f8cbafe3700 1 -- 172.21.15.6:0/3308157068 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c94066f60 msgr2=0x7f8c94069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.770+0000 7f8cbafe3700 1 --2- 172.21.15.6:0/3308157068 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c94066f60 0x7f8c94069410 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00afd0 tx=0x7f8cac01a000 comp rx=0 tx=0).stop 2023-10-06T02:20:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.770+0000 7f8cbafe3700 1 -- 172.21.15.6:0/3308157068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb40a9bf0 msgr2=0x7f8cb41505b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.770+0000 7f8cbafe3700 1 --2- 172.21.15.6:0/3308157068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb40a9bf0 0x7f8cb41505b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400e840 tx=0x7f8ca4009040 comp rx=0 tx=0).stop 2023-10-06T02:20:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.770+0000 7f8cbafe3700 1 -- 172.21.15.6:0/3308157068 shutdown_connections 2023-10-06T02:20:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.770+0000 7f8cbafe3700 1 --2- 172.21.15.6:0/3308157068 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cb4150af0 0x7f8cb40a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.770+0000 7f8cbafe3700 1 --2- 172.21.15.6:0/3308157068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ca0004b70 0x7f8cb4169480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.770+0000 7f8cbafe3700 1 --2- 172.21.15.6:0/3308157068 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c94066f60 0x7f8c94069410 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.770+0000 7f8cbafe3700 1 --2- 172.21.15.6:0/3308157068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb40a9bf0 0x7f8cb41505b0 secure :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400e840 tx=0x7f8ca4009040 comp rx=0 tx=0).stop 2023-10-06T02:20:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.770+0000 7f8cbafe3700 1 -- 172.21.15.6:0/3308157068 >> 172.21.15.6:0/3308157068 conn(0x7f8cb40cbef0 msgr2=0x7f8cb40aec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.772+0000 7f8cbafe3700 1 -- 172.21.15.6:0/3308157068 shutdown_connections 2023-10-06T02:20:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.772+0000 7f8cbafe3700 1 -- 172.21.15.6:0/3308157068 wait complete. 2023-10-06T02:20:40.774 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:20:40.789 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:20:40.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.919+0000 7f5789473700 1 Processor -- start 2023-10-06T02:20:40.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.919+0000 7f5789473700 1 -- start start 2023-10-06T02:20:40.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.919+0000 7f5789473700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f57841598b0 0x7f57840afef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:40.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.919+0000 7f5789473700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57840b0430 0x7f578415b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:40.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.919+0000 7f5789473700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57840afa60 con 0x7f578415b770 2023-10-06T02:20:40.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.919+0000 7f5789473700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578415bbf0 con 0x7f57841598b0 2023-10-06T02:20:40.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.919+0000 7f5789473700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57840af440 con 0x7f57840b0430 2023-10-06T02:20:40.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.920+0000 7f5782ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f57841598b0 0x7f57840afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:40.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.920+0000 7f57837fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f578415b770 0x7f5784159c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59882/0 (socket says 172.21.15.6:59882) 2023-10-06T02:20:40.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.920+0000 7f57837fe700 1 -- 172.21.15.6:0/2137666208 learned_addr learned my addr 172.21.15.6:0/2137666208 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:40.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.920+0000 7f57827fc700 1 --2- 172.21.15.6:0/2137666208 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57840b0430 0x7f578415b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:40.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.920+0000 7f5782ffd700 1 -- 172.21.15.6:0/2137666208 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57840b0430 msgr2=0x7f578415b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:40.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.920+0000 7f5782ffd700 1 --2- 172.21.15.6:0/2137666208 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57840b0430 0x7f578415b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:40.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.920+0000 7f5782ffd700 1 -- 172.21.15.6:0/2137666208 >> v1:172.21.15.6:6789/0 conn(0x7f578415b770 legacy=0x7f5784159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:40.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.920+0000 7f5782ffd700 1 -- 172.21.15.6:0/2137666208 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578415ab00 con 0x7f57841598b0 2023-10-06T02:20:40.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.920+0000 7f5781ffb700 1 -- 172.21.15.6:0/2137666208 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921294117 0 0) 0x7f57840afa60 con 0x7f578415b770 2023-10-06T02:20:40.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.920+0000 7f5782ffd700 1 --2- 172.21.15.6:0/2137666208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57841598b0 0x7f57840afef0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f577c009eb0 tx=0x7f577c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb38f35ce33cc8b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:40.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.920+0000 7f5781ffb700 1 -- 172.21.15.6:0/2137666208 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c00e070 con 0x7f57841598b0 2023-10-06T02:20:40.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.920+0000 7f5781ffb700 1 -- 172.21.15.6:0/2137666208 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c00bc30 con 0x7f57841598b0 2023-10-06T02:20:40.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.920+0000 7f5781ffb700 1 -- 172.21.15.6:0/2137666208 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c012430 con 0x7f57841598b0 2023-10-06T02:20:40.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.921+0000 7f5789473700 1 -- 172.21.15.6:0/2137666208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57841598b0 msgr2=0x7f57840afef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:40.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.921+0000 7f5789473700 1 --2- 172.21.15.6:0/2137666208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57841598b0 0x7f57840afef0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f577c009eb0 tx=0x7f577c009780 comp rx=0 tx=0).stop 2023-10-06T02:20:40.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.921+0000 7f5789473700 1 -- 172.21.15.6:0/2137666208 shutdown_connections 2023-10-06T02:20:40.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.921+0000 7f5789473700 1 --2- 172.21.15.6:0/2137666208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57841598b0 0x7f57840afef0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:40.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.921+0000 7f5789473700 1 --2- 172.21.15.6:0/2137666208 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57840b0430 0x7f578415b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:40.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.921+0000 7f5789473700 1 -- 172.21.15.6:0/2137666208 >> 172.21.15.6:0/2137666208 conn(0x7f5784067910 msgr2=0x7f57840ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:40.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.921+0000 7f5789473700 1 -- 172.21.15.6:0/2137666208 shutdown_connections 2023-10-06T02:20:40.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.921+0000 7f5789473700 1 -- 172.21.15.6:0/2137666208 wait complete. 2023-10-06T02:20:40.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.922+0000 7f5789473700 1 Processor -- start 2023-10-06T02:20:40.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.922+0000 7f5789473700 1 -- start start 2023-10-06T02:20:40.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f5789473700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57840b0430 0x7f57840cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:40.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f5789473700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57841598b0 0x7f578416ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f5789473700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f578415b770 0x7f578416ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f5789473700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578416c570 con 0x7f57841598b0 2023-10-06T02:20:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f5789473700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578416b960 con 0x7f57840b0430 2023-10-06T02:20:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f5789473700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578416bc40 con 0x7f578415b770 2023-10-06T02:20:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f57827fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57841598b0 0x7f578416ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f57827fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57841598b0 0x7f578416ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46344/0 (socket says 172.21.15.6:46344) 2023-10-06T02:20:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f57827fc700 1 -- 172.21.15.6:0/3236676794 learned_addr learned my addr 172.21.15.6:0/3236676794 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f5782ffd700 1 --2- 172.21.15.6:0/3236676794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57840b0430 0x7f57840cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f57837fe700 1 --2- 172.21.15.6:0/3236676794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f578415b770 0x7f578416ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f57827fc700 1 -- 172.21.15.6:0/3236676794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f578415b770 msgr2=0x7f578416ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f57827fc700 1 --2- 172.21.15.6:0/3236676794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f578415b770 0x7f578416ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:40.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f57827fc700 1 -- 172.21.15.6:0/3236676794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57840b0430 msgr2=0x7f57840cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:40.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f57827fc700 1 --2- 172.21.15.6:0/3236676794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57840b0430 0x7f57840cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:40.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f57827fc700 1 -- 172.21.15.6:0/3236676794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c009a20 con 0x7f57841598b0 2023-10-06T02:20:40.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f57837fe700 1 --2- 172.21.15.6:0/3236676794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f578415b770 0x7f578416ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:40.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.923+0000 7f5782ffd700 1 --2- 172.21.15.6:0/3236676794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57840b0430 0x7f57840cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:40.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.924+0000 7f57827fc700 1 --2- 172.21.15.6:0/3236676794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57841598b0 0x7f578416ca00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f576c006b00 tx=0x7f576c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:40.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.924+0000 7f577affd700 1 -- 172.21.15.6:0/3236676794 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c0125f0 con 0x7f57841598b0 2023-10-06T02:20:40.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.924+0000 7f577affd700 1 -- 172.21.15.6:0/3236676794 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c012770 con 0x7f57841598b0 2023-10-06T02:20:40.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.924+0000 7f5789473700 1 -- 172.21.15.6:0/3236676794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578416bf20 con 0x7f57841598b0 2023-10-06T02:20:40.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.924+0000 7f577affd700 1 -- 172.21.15.6:0/3236676794 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c012b30 con 0x7f57841598b0 2023-10-06T02:20:40.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.924+0000 7f5789473700 1 -- 172.21.15.6:0/3236676794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578416a010 con 0x7f57841598b0 2023-10-06T02:20:40.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.925+0000 7f5789473700 1 -- 172.21.15.6:0/3236676794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f578416c6e0 con 0x7f57841598b0 2023-10-06T02:20:40.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.925+0000 7f577affd700 1 -- 172.21.15.6:0/3236676794 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f576c01e460 con 0x7f57841598b0 2023-10-06T02:20:40.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.926+0000 7f577affd700 1 --2- 172.21.15.6:0/3236676794 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5764066f30 0x7f57640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:40.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.926+0000 7f577affd700 1 -- 172.21.15.6:0/3236676794 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6112+0+0 (secure 0 0 0) 0x7f576c084cc0 con 0x7f57841598b0 2023-10-06T02:20:40.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.926+0000 7f5782ffd700 1 --2- 172.21.15.6:0/3236676794 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5764066f30 0x7f57640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:40.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.927+0000 7f5782ffd700 1 --2- 172.21.15.6:0/3236676794 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5764066f30 0x7f57640693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f577c009eb0 tx=0x7f577c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:40.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:40.930+0000 7f577affd700 1 -- 172.21.15.6:0/3236676794 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f576c051da0 con 0x7f57841598b0 2023-10-06T02:20:41.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.123+0000 7f5789473700 1 -- 172.21.15.6:0/3236676794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5784067d50 con 0x7f57841598b0 2023-10-06T02:20:41.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.766+0000 7f577affd700 1 -- 172.21.15.6:0/3236676794 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) v1 ==== 169+0+0 (secure 0 0 0) 0x7f576c0553c0 con 0x7f57841598b0 2023-10-06T02:20:41.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.772+0000 7f5789473700 1 -- 172.21.15.6:0/3236676794 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5764066f30 msgr2=0x7f57640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.772+0000 7f5789473700 1 --2- 172.21.15.6:0/3236676794 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5764066f30 0x7f57640693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f577c009eb0 tx=0x7f577c017000 comp rx=0 tx=0).stop 2023-10-06T02:20:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.772+0000 7f5789473700 1 -- 172.21.15.6:0/3236676794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57841598b0 msgr2=0x7f578416ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.772+0000 7f5789473700 1 --2- 172.21.15.6:0/3236676794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57841598b0 0x7f578416ca00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f576c006b00 tx=0x7f576c008040 comp rx=0 tx=0).stop 2023-10-06T02:20:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.773+0000 7f5789473700 1 -- 172.21.15.6:0/3236676794 shutdown_connections 2023-10-06T02:20:41.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.773+0000 7f5789473700 1 --2- 172.21.15.6:0/3236676794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f578415b770 0x7f578416ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:41.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.773+0000 7f5789473700 1 --2- 172.21.15.6:0/3236676794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57840b0430 0x7f57840cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:41.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.773+0000 7f5789473700 1 --2- 172.21.15.6:0/3236676794 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5764066f30 0x7f57640693e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:41.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.773+0000 7f5789473700 1 --2- 172.21.15.6:0/3236676794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57841598b0 0x7f578416ca00 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:41.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.773+0000 7f5789473700 1 -- 172.21.15.6:0/3236676794 >> 172.21.15.6:0/3236676794 conn(0x7f5784067910 msgr2=0x7f578406c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:41.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.774+0000 7f5789473700 1 -- 172.21.15.6:0/3236676794 shutdown_connections 2023-10-06T02:20:41.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.774+0000 7f5789473700 1 -- 172.21.15.6:0/3236676794 wait complete. 2023-10-06T02:20:41.775 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-06T02:20:41.791 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_abort_on_newly_corrupt_dentry 2023-10-06T02:20:41.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.917+0000 7fb347656700 1 Processor -- start 2023-10-06T02:20:41.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.918+0000 7fb347656700 1 -- start start 2023-10-06T02:20:41.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.918+0000 7fb347656700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb3400d0400 0x7fb3400b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:41.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.918+0000 7fb347656700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3400ccd40 0x7fb3400cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:41.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.918+0000 7fb347656700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3400b6170 con 0x7fb3400cf7e0 2023-10-06T02:20:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.918+0000 7fb347656700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34015dd40 con 0x7fb3400ccd40 2023-10-06T02:20:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.918+0000 7fb347656700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34015e020 con 0x7fb3400d0400 2023-10-06T02:20:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.919+0000 7fb344bf1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3400ccd40 0x7fb3400cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.919+0000 7fb344bf1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3400ccd40 0x7fb3400cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46356/0 (socket says 172.21.15.6:46356) 2023-10-06T02:20:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.919+0000 7fb344bf1700 1 -- 172.21.15.6:0/1343512855 learned_addr learned my addr 172.21.15.6:0/1343512855 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.919+0000 7fb3453f2700 1 --2- 172.21.15.6:0/1343512855 >> v2:172.21.15.175:3300/0 conn(0x7fb3400d0400 0x7fb3400b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.919+0000 7fb344bf1700 1 -- 172.21.15.6:0/1343512855 >> v2:172.21.15.175:3300/0 conn(0x7fb3400d0400 msgr2=0x7fb3400b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.919+0000 7fb344bf1700 1 --2- 172.21.15.6:0/1343512855 >> v2:172.21.15.175:3300/0 conn(0x7fb3400d0400 0x7fb3400b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.919+0000 7fb344bf1700 1 -- 172.21.15.6:0/1343512855 >> v1:172.21.15.175:6789/0 conn(0x7fb3400cf7e0 legacy=0x7fb3400b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.919+0000 7fb344bf1700 1 -- 172.21.15.6:0/1343512855 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3400ceaa0 con 0x7fb3400ccd40 2023-10-06T02:20:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.919+0000 7fb344bf1700 1 --2- 172.21.15.6:0/1343512855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3400ccd40 0x7fb3400cf2a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb340088f30 tx=0x7fb334009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e5989dcf7a770e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.919+0000 7fb33ffff700 1 -- 172.21.15.6:0/1343512855 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb334009e70 con 0x7fb3400ccd40 2023-10-06T02:20:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.919+0000 7fb33ffff700 1 -- 172.21.15.6:0/1343512855 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33400b860 con 0x7fb3400ccd40 2023-10-06T02:20:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.919+0000 7fb33ffff700 1 -- 172.21.15.6:0/1343512855 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33400bc00 con 0x7fb3400ccd40 2023-10-06T02:20:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.920+0000 7fb347656700 1 -- 172.21.15.6:0/1343512855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3400ccd40 msgr2=0x7fb3400cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.920+0000 7fb347656700 1 --2- 172.21.15.6:0/1343512855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3400ccd40 0x7fb3400cf2a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb340088f30 tx=0x7fb334009250 comp rx=0 tx=0).stop 2023-10-06T02:20:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.920+0000 7fb347656700 1 -- 172.21.15.6:0/1343512855 shutdown_connections 2023-10-06T02:20:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.920+0000 7fb347656700 1 --2- 172.21.15.6:0/1343512855 >> v2:172.21.15.175:3300/0 conn(0x7fb3400d0400 0x7fb3400b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.920+0000 7fb347656700 1 --2- 172.21.15.6:0/1343512855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3400ccd40 0x7fb3400cf2a0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.920+0000 7fb347656700 1 -- 172.21.15.6:0/1343512855 >> 172.21.15.6:0/1343512855 conn(0x7fb34006a220 msgr2=0x7fb34006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.920+0000 7fb347656700 1 -- 172.21.15.6:0/1343512855 shutdown_connections 2023-10-06T02:20:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.920+0000 7fb347656700 1 -- 172.21.15.6:0/1343512855 wait complete. 2023-10-06T02:20:41.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.921+0000 7fb347656700 1 Processor -- start 2023-10-06T02:20:41.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.921+0000 7fb347656700 1 -- start start 2023-10-06T02:20:41.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.922+0000 7fb347656700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3400ccd40 0x7fb3400c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:41.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.922+0000 7fb347656700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3400cf7e0 0x7fb3400cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:41.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.922+0000 7fb347656700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3400d0400 0x7fb34016d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:41.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.922+0000 7fb347656700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34015ce10 con 0x7fb3400cf7e0 2023-10-06T02:20:41.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.922+0000 7fb347656700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34015c200 con 0x7fb3400ccd40 2023-10-06T02:20:41.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.922+0000 7fb347656700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34015c4e0 con 0x7fb3400d0400 2023-10-06T02:20:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.922+0000 7fb344bf1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3400cf7e0 0x7fb3400cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.922+0000 7fb344bf1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3400cf7e0 0x7fb3400cb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46372/0 (socket says 172.21.15.6:46372) 2023-10-06T02:20:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.922+0000 7fb344bf1700 1 -- 172.21.15.6:0/258883034 learned_addr learned my addr 172.21.15.6:0/258883034 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.922+0000 7fb3453f2700 1 --2- 172.21.15.6:0/258883034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3400ccd40 0x7fb3400c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.922+0000 7fb344bf1700 1 -- 172.21.15.6:0/258883034 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3400d0400 msgr2=0x7fb34016d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.922+0000 7fb345bf3700 1 --2- 172.21.15.6:0/258883034 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3400d0400 0x7fb34016d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.922+0000 7fb344bf1700 1 --2- 172.21.15.6:0/258883034 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3400d0400 0x7fb34016d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.922+0000 7fb344bf1700 1 -- 172.21.15.6:0/258883034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3400ccd40 msgr2=0x7fb3400c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.922+0000 7fb344bf1700 1 --2- 172.21.15.6:0/258883034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3400ccd40 0x7fb3400c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.922+0000 7fb344bf1700 1 -- 172.21.15.6:0/258883034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3340094f0 con 0x7fb3400cf7e0 2023-10-06T02:20:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.922+0000 7fb3453f2700 1 --2- 172.21.15.6:0/258883034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3400ccd40 0x7fb3400c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.923+0000 7fb344bf1700 1 --2- 172.21.15.6:0/258883034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3400cf7e0 0x7fb3400cb750 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb3400883f0 tx=0x7fb334017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:41.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.923+0000 7fb33d7fa700 1 -- 172.21.15.6:0/258883034 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb334011420 con 0x7fb3400cf7e0 2023-10-06T02:20:41.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.923+0000 7fb33d7fa700 1 -- 172.21.15.6:0/258883034 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3340115a0 con 0x7fb3400cf7e0 2023-10-06T02:20:41.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.923+0000 7fb347656700 1 -- 172.21.15.6:0/258883034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34015c7c0 con 0x7fb3400cf7e0 2023-10-06T02:20:41.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.923+0000 7fb33d7fa700 1 -- 172.21.15.6:0/258883034 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb334011960 con 0x7fb3400cf7e0 2023-10-06T02:20:41.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.923+0000 7fb347656700 1 -- 172.21.15.6:0/258883034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3400c6ae0 con 0x7fb3400cf7e0 2023-10-06T02:20:41.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.924+0000 7fb347656700 1 -- 172.21.15.6:0/258883034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb340088760 con 0x7fb3400cf7e0 2023-10-06T02:20:41.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.924+0000 7fb33d7fa700 1 -- 172.21.15.6:0/258883034 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3340253f0 con 0x7fb3400cf7e0 2023-10-06T02:20:41.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.925+0000 7fb33d7fa700 1 --2- 172.21.15.6:0/258883034 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb32c066f30 0x7fb32c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:41.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.925+0000 7fb33d7fa700 1 -- 172.21.15.6:0/258883034 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fb334085ee0 con 0x7fb3400cf7e0 2023-10-06T02:20:41.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.925+0000 7fb3453f2700 1 --2- 172.21.15.6:0/258883034 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb32c066f30 0x7fb32c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:41.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.925+0000 7fb3453f2700 1 --2- 172.21.15.6:0/258883034 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb32c066f30 0x7fb32c0693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb338006ea0 tx=0x7fb338008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:41.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:41.929+0000 7fb33d7fa700 1 -- 172.21.15.6:0/258883034 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb334053150 con 0x7fb3400cf7e0 2023-10-06T02:20:42.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.122+0000 7fb347656700 1 -- 172.21.15.6:0/258883034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_abort_on_newly_corrupt_dentry"} v 0) v1 -- 0x7fb3400ced80 con 0x7fb3400cf7e0 2023-10-06T02:20:42.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.126+0000 7fb33d7fa700 1 -- 172.21.15.6:0/258883034 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_abort_on_newly_corrupt_dentry"}]=0 v16) v1 ==== 116+0+0 (secure 0 0 0) 0x7fb334056770 con 0x7fb3400cf7e0 2023-10-06T02:20:42.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.128+0000 7fb347656700 1 -- 172.21.15.6:0/258883034 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb32c066f30 msgr2=0x7fb32c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.128+0000 7fb347656700 1 --2- 172.21.15.6:0/258883034 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb32c066f30 0x7fb32c0693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb338006ea0 tx=0x7fb338008040 comp rx=0 tx=0).stop 2023-10-06T02:20:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.128+0000 7fb347656700 1 -- 172.21.15.6:0/258883034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3400cf7e0 msgr2=0x7fb3400cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.128+0000 7fb347656700 1 --2- 172.21.15.6:0/258883034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3400cf7e0 0x7fb3400cb750 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb3400883f0 tx=0x7fb334017000 comp rx=0 tx=0).stop 2023-10-06T02:20:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.128+0000 7fb347656700 1 -- 172.21.15.6:0/258883034 shutdown_connections 2023-10-06T02:20:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.128+0000 7fb347656700 1 --2- 172.21.15.6:0/258883034 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3400d0400 0x7fb34016d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.128+0000 7fb347656700 1 --2- 172.21.15.6:0/258883034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3400ccd40 0x7fb3400c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.128+0000 7fb347656700 1 --2- 172.21.15.6:0/258883034 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb32c066f30 0x7fb32c0693e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.128+0000 7fb347656700 1 --2- 172.21.15.6:0/258883034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3400cf7e0 0x7fb3400cb750 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.128+0000 7fb347656700 1 -- 172.21.15.6:0/258883034 >> 172.21.15.6:0/258883034 conn(0x7fb34006a220 msgr2=0x7fb3400b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.128+0000 7fb347656700 1 -- 172.21.15.6:0/258883034 shutdown_connections 2023-10-06T02:20:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.128+0000 7fb347656700 1 -- 172.21.15.6:0/258883034 wait complete. 2023-10-06T02:20:42.140 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_rename_corrupt_dentry_first 2023-10-06T02:20:42.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.261+0000 7ff4adae7700 1 Processor -- start 2023-10-06T02:20:42.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.261+0000 7ff4adae7700 1 -- start start 2023-10-06T02:20:42.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.261+0000 7ff4adae7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4a8159190 0x7ff4a80ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.261+0000 7ff4adae7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff4a806a900 0x7ff4a80b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.262+0000 7ff4adae7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a80b4e20 con 0x7ff4a80ceed0 2023-10-06T02:20:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.262+0000 7ff4adae7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a80cd5a0 con 0x7ff4a8159190 2023-10-06T02:20:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.262+0000 7ff4adae7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a80b4570 con 0x7ff4a806a900 2023-10-06T02:20:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.262+0000 7ff4a77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4a8159190 0x7ff4a80ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.262+0000 7ff4a6ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff4a80ceed0 0x7ff4a806a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59894/0 (socket says 172.21.15.6:59894) 2023-10-06T02:20:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.262+0000 7ff4a6ffd700 1 -- 172.21.15.6:0/287166825 learned_addr learned my addr 172.21.15.6:0/287166825 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.262+0000 7ff4a77fe700 1 -- 172.21.15.6:0/287166825 >> v2:172.21.15.175:3300/0 conn(0x7ff4a806a900 msgr2=0x7ff4a80b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.262+0000 7ff4a7fff700 1 --2- 172.21.15.6:0/287166825 >> v2:172.21.15.175:3300/0 conn(0x7ff4a806a900 0x7ff4a80b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.262+0000 7ff4a67fc700 1 -- 172.21.15.6:0/287166825 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182552904 0 0) 0x7ff4a80b4e20 con 0x7ff4a80ceed0 2023-10-06T02:20:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.262+0000 7ff4a77fe700 1 --2- 172.21.15.6:0/287166825 >> v2:172.21.15.175:3300/0 conn(0x7ff4a806a900 0x7ff4a80b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.262+0000 7ff4a77fe700 1 -- 172.21.15.6:0/287166825 >> v1:172.21.15.6:6789/0 conn(0x7ff4a80ceed0 legacy=0x7ff4a806a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.262+0000 7ff4a77fe700 1 -- 172.21.15.6:0/287166825 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a80cd2c0 con 0x7ff4a8159190 2023-10-06T02:20:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.262+0000 7ff4a7fff700 1 --2- 172.21.15.6:0/287166825 >> v2:172.21.15.175:3300/0 conn(0x7ff4a806a900 0x7ff4a80b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.262+0000 7ff4a77fe700 1 --2- 172.21.15.6:0/287166825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a8159190 0x7ff4a80ce990 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80cdee0 tx=0x7ff4980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166b7dbefc6b6edc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.262+0000 7ff4a67fc700 1 -- 172.21.15.6:0/287166825 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49800b6b0 con 0x7ff4a8159190 2023-10-06T02:20:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.262+0000 7ff4a67fc700 1 -- 172.21.15.6:0/287166825 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49800b810 con 0x7ff4a8159190 2023-10-06T02:20:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.262+0000 7ff4a67fc700 1 -- 172.21.15.6:0/287166825 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49800bbb0 con 0x7ff4a8159190 2023-10-06T02:20:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.263+0000 7ff4adae7700 1 -- 172.21.15.6:0/287166825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a8159190 msgr2=0x7ff4a80ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.263+0000 7ff4adae7700 1 --2- 172.21.15.6:0/287166825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a8159190 0x7ff4a80ce990 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80cdee0 tx=0x7ff4980091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.263+0000 7ff4adae7700 1 -- 172.21.15.6:0/287166825 shutdown_connections 2023-10-06T02:20:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.263+0000 7ff4adae7700 1 --2- 172.21.15.6:0/287166825 >> v2:172.21.15.175:3300/0 conn(0x7ff4a806a900 0x7ff4a80b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.263+0000 7ff4adae7700 1 --2- 172.21.15.6:0/287166825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a8159190 0x7ff4a80ce990 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.263+0000 7ff4adae7700 1 -- 172.21.15.6:0/287166825 >> 172.21.15.6:0/287166825 conn(0x7ff4a8087340 msgr2=0x7ff4a8087710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.263+0000 7ff4adae7700 1 -- 172.21.15.6:0/287166825 shutdown_connections 2023-10-06T02:20:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.263+0000 7ff4adae7700 1 -- 172.21.15.6:0/287166825 wait complete. 2023-10-06T02:20:42.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.264+0000 7ff4adae7700 1 Processor -- start 2023-10-06T02:20:42.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.264+0000 7ff4adae7700 1 -- start start 2023-10-06T02:20:42.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.265+0000 7ff4adae7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4a806a900 0x7ff4a8153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.265+0000 7ff4adae7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a80ceed0 0x7ff4a80c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.265+0000 7ff4adae7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4a8159190 0x7ff4a80c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.265+0000 7ff4adae7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a815d3d0 con 0x7ff4a80ceed0 2023-10-06T02:20:42.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.265+0000 7ff4adae7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a8153750 con 0x7ff4a8159190 2023-10-06T02:20:42.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.265+0000 7ff4adae7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a815c7c0 con 0x7ff4a806a900 2023-10-06T02:20:42.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.265+0000 7ff4a6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a80ceed0 0x7ff4a80c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:42.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.265+0000 7ff4a6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a80ceed0 0x7ff4a80c5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46396/0 (socket says 172.21.15.6:46396) 2023-10-06T02:20:42.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.265+0000 7ff4a6ffd700 1 -- 172.21.15.6:0/1609271019 learned_addr learned my addr 172.21.15.6:0/1609271019 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:42.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.265+0000 7ff4a77fe700 1 --2- 172.21.15.6:0/1609271019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4a806a900 0x7ff4a8153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:42.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.265+0000 7ff4a7fff700 1 --2- 172.21.15.6:0/1609271019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4a8159190 0x7ff4a80c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:42.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.265+0000 7ff4a6ffd700 1 -- 172.21.15.6:0/1609271019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4a806a900 msgr2=0x7ff4a8153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.265+0000 7ff4a6ffd700 1 --2- 172.21.15.6:0/1609271019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4a806a900 0x7ff4a8153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.265+0000 7ff4a6ffd700 1 -- 172.21.15.6:0/1609271019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4a8159190 msgr2=0x7ff4a80c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.265+0000 7ff4a6ffd700 1 --2- 172.21.15.6:0/1609271019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4a8159190 0x7ff4a80c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.265+0000 7ff4a6ffd700 1 -- 172.21.15.6:0/1609271019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff498009420 con 0x7ff4a80ceed0 2023-10-06T02:20:42.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.266+0000 7ff4a6ffd700 1 --2- 172.21.15.6:0/1609271019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a80ceed0 0x7ff4a80c5a80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00c810 tx=0x7ff49c007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:42.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.266+0000 7ff48f7fe700 1 -- 172.21.15.6:0/1609271019 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c005c00 con 0x7ff4a80ceed0 2023-10-06T02:20:42.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.266+0000 7ff48f7fe700 1 -- 172.21.15.6:0/1609271019 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c005d60 con 0x7ff4a80ceed0 2023-10-06T02:20:42.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.266+0000 7ff4adae7700 1 -- 172.21.15.6:0/1609271019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a815caa0 con 0x7ff4a80ceed0 2023-10-06T02:20:42.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.266+0000 7ff48f7fe700 1 -- 172.21.15.6:0/1609271019 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c0072e0 con 0x7ff4a80ceed0 2023-10-06T02:20:42.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.266+0000 7ff4adae7700 1 -- 172.21.15.6:0/1609271019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a815d060 con 0x7ff4a80ceed0 2023-10-06T02:20:42.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.267+0000 7ff4adae7700 1 -- 172.21.15.6:0/1609271019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a8088a20 con 0x7ff4a80ceed0 2023-10-06T02:20:42.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.267+0000 7ff48f7fe700 1 -- 172.21.15.6:0/1609271019 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff49c007690 con 0x7ff4a80ceed0 2023-10-06T02:20:42.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.268+0000 7ff48f7fe700 1 --2- 172.21.15.6:0/1609271019 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff494066f30 0x7ff4940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.268+0000 7ff48f7fe700 1 -- 172.21.15.6:0/1609271019 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5698+0+0 (secure 0 0 0) 0x7ff49c083950 con 0x7ff4a80ceed0 2023-10-06T02:20:42.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.268+0000 7ff4a77fe700 1 --2- 172.21.15.6:0/1609271019 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff494066f30 0x7ff4940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:42.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.268+0000 7ff4a77fe700 1 --2- 172.21.15.6:0/1609271019 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff494066f30 0x7ff4940693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff4980091e0 tx=0x7ff498017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:42.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.272+0000 7ff48f7fe700 1 -- 172.21.15.6:0/1609271019 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff49c04b5a0 con 0x7ff4a80ceed0 2023-10-06T02:20:42.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.474+0000 7ff4adae7700 1 -- 172.21.15.6:0/1609271019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"} v 0) v1 -- 0x7ff4a80b47d0 con 0x7ff4a80ceed0 2023-10-06T02:20:42.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.474+0000 7ff48f7fe700 1 -- 172.21.15.6:0/1609271019 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"}]=0 v16) v1 ==== 121+0+0 (secure 0 0 0) 0x7ff49c017020 con 0x7ff4a80ceed0 2023-10-06T02:20:42.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.477+0000 7ff4adae7700 1 -- 172.21.15.6:0/1609271019 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff494066f30 msgr2=0x7ff4940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.477+0000 7ff4adae7700 1 --2- 172.21.15.6:0/1609271019 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff494066f30 0x7ff4940693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff4980091e0 tx=0x7ff498017000 comp rx=0 tx=0).stop 2023-10-06T02:20:42.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.477+0000 7ff4adae7700 1 -- 172.21.15.6:0/1609271019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a80ceed0 msgr2=0x7ff4a80c5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.477+0000 7ff4adae7700 1 --2- 172.21.15.6:0/1609271019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a80ceed0 0x7ff4a80c5a80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00c810 tx=0x7ff49c007db0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.477+0000 7ff4adae7700 1 -- 172.21.15.6:0/1609271019 shutdown_connections 2023-10-06T02:20:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.477+0000 7ff4adae7700 1 --2- 172.21.15.6:0/1609271019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4a8159190 0x7ff4a80c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.477+0000 7ff4adae7700 1 --2- 172.21.15.6:0/1609271019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4a806a900 0x7ff4a8153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.477+0000 7ff4adae7700 1 --2- 172.21.15.6:0/1609271019 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff494066f30 0x7ff4940693e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.477+0000 7ff4adae7700 1 --2- 172.21.15.6:0/1609271019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a80ceed0 0x7ff4a80c5a80 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.477+0000 7ff4adae7700 1 -- 172.21.15.6:0/1609271019 >> 172.21.15.6:0/1609271019 conn(0x7ff4a8087340 msgr2=0x7ff4a80b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.477+0000 7ff4adae7700 1 -- 172.21.15.6:0/1609271019 shutdown_connections 2023-10-06T02:20:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.477+0000 7ff4adae7700 1 -- 172.21.15.6:0/1609271019 wait complete. 2023-10-06T02:20:42.489 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:20:42.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.610+0000 7f4d00129700 1 Processor -- start 2023-10-06T02:20:42.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.610+0000 7f4d00129700 1 -- start start 2023-10-06T02:20:42.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.611+0000 7f4d00129700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4cf815a030 0x7f4cf815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.611+0000 7f4d00129700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf80afc50 con 0x7f4cf815a940 2023-10-06T02:20:42.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.611+0000 7f4d00129700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf80aff30 con 0x7f4cf8087700 2023-10-06T02:20:42.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.611+0000 7f4d00129700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf80b0cf0 con 0x7f4cf815a030 2023-10-06T02:20:42.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.611+0000 7f4cfd6c4700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4cf815a940 0x7f4cf8086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59910/0 (socket says 172.21.15.6:59910) 2023-10-06T02:20:42.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.611+0000 7f4cfd6c4700 1 -- 172.21.15.6:0/3058678912 learned_addr learned my addr 172.21.15.6:0/3058678912 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:42.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.611+0000 7f4cfcec3700 1 -- 172.21.15.6:0/3058678912 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017056629 0 0) 0x7f4cf80afc50 con 0x7f4cf815a940 2023-10-06T02:20:42.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.611+0000 7f4cfcec3700 1 -- 172.21.15.6:0/3058678912 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ce0003570 con 0x7f4cf815a940 2023-10-06T02:20:42.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.611+0000 7f4cfdec5700 1 --2- 172.21.15.6:0/3058678912 >> v2:172.21.15.175:3300/0 conn(0x7f4cf815a030 0x7f4cf815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfcec3700 1 -- 172.21.15.6:0/3058678912 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 645024515 0 0) 0x7f4ce0003570 con 0x7f4cf815a940 2023-10-06T02:20:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfcec3700 1 -- 172.21.15.6:0/3058678912 >> v2:172.21.15.175:3300/0 conn(0x7f4cf815a030 msgr2=0x7f4cf815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfcec3700 1 --2- 172.21.15.6:0/3058678912 >> v2:172.21.15.175:3300/0 conn(0x7f4cf815a030 0x7f4cf815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfcec3700 1 -- 172.21.15.6:0/3058678912 >> v1:172.21.15.175:6789/0 conn(0x7f4cf8087700 legacy=0x7f4cf80b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfcec3700 1 -- 172.21.15.6:0/3058678912 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf80b0210 con 0x7f4cf815a940 2023-10-06T02:20:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfcec3700 1 -- 172.21.15.6:0/3058678912 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f4cec001470 con 0x7f4cf815a940 2023-10-06T02:20:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfcec3700 1 -- 172.21.15.6:0/3058678912 >> v1:172.21.15.6:6789/0 conn(0x7f4cf815a940 legacy=0x7f4cf8086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfcec3700 1 --2- 172.21.15.6:0/3058678912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce0003a60 0x7f4ce0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfcec3700 1 --2- 172.21.15.6:0/3058678912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ce0004810 0x7f4ce0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfcec3700 1 --2- 172.21.15.6:0/3058678912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ce00051c0 0x7f4ce000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfcec3700 1 -- 172.21.15.6:0/3058678912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf80b0cf0 con 0x7f4ce0003a60 2023-10-06T02:20:42.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfcec3700 1 -- 172.21.15.6:0/3058678912 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce000c0d0 con 0x7f4ce00051c0 2023-10-06T02:20:42.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfcec3700 1 -- 172.21.15.6:0/3058678912 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce000c290 con 0x7f4ce0004810 2023-10-06T02:20:42.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfdec5700 1 --2- 172.21.15.6:0/3058678912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce0003a60 0x7f4ce0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:42.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfdec5700 1 -- 172.21.15.6:0/3058678912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ce0004810 msgr2=0x7f4ce0004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:20:42.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfdec5700 1 --2- 172.21.15.6:0/3058678912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ce0004810 0x7f4ce0004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfdec5700 1 -- 172.21.15.6:0/3058678912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ce00051c0 msgr2=0x7f4ce000ba60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:20:42.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfdec5700 1 --2- 172.21.15.6:0/3058678912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ce00051c0 0x7f4ce000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfdec5700 1 -- 172.21.15.6:0/3058678912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce0003570 con 0x7f4ce0003a60 2023-10-06T02:20:42.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfe6c6700 1 -- 172.21.15.6:0/3058678912 reap_dead start 2023-10-06T02:20:42.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfdec5700 1 --2- 172.21.15.6:0/3058678912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce0003a60 0x7f4ce0003e70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009c00 tx=0x7f4cf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e5c27abef08329 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:42.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfcec3700 1 -- 172.21.15.6:0/3058678912 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf000e710 con 0x7f4ce0003a60 2023-10-06T02:20:42.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfcec3700 1 -- 172.21.15.6:0/3058678912 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf000e870 con 0x7f4ce0003a60 2023-10-06T02:20:42.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.612+0000 7f4cfcec3700 1 -- 172.21.15.6:0/3058678912 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf000ec30 con 0x7f4ce0003a60 2023-10-06T02:20:42.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.613+0000 7f4d00129700 1 -- 172.21.15.6:0/3058678912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce0003a60 msgr2=0x7f4ce0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.613+0000 7f4d00129700 1 --2- 172.21.15.6:0/3058678912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce0003a60 0x7f4ce0003e70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009c00 tx=0x7f4cf00091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.613+0000 7f4d00129700 1 -- 172.21.15.6:0/3058678912 shutdown_connections 2023-10-06T02:20:42.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.613+0000 7f4d00129700 1 --2- 172.21.15.6:0/3058678912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce0003a60 0x7f4ce0003e70 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.613+0000 7f4d00129700 1 -- 172.21.15.6:0/3058678912 >> 172.21.15.6:0/3058678912 conn(0x7f4cf8068680 msgr2=0x7f4cf8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:42.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.613+0000 7f4d00129700 1 -- 172.21.15.6:0/3058678912 shutdown_connections 2023-10-06T02:20:42.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.613+0000 7f4d00129700 1 -- 172.21.15.6:0/3058678912 wait complete. 2023-10-06T02:20:42.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.614+0000 7f4d00129700 1 Processor -- start 2023-10-06T02:20:42.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.614+0000 7f4d00129700 1 -- start start 2023-10-06T02:20:42.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4d00129700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce0003a60 0x7f4cf80c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4d00129700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf815d130 0x7f4cf815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4d00129700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cf815d5a0 0x7f4cf815c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4d00129700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf815baa0 con 0x7f4ce0003a60 2023-10-06T02:20:42.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4d00129700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf815ae90 con 0x7f4cf815d130 2023-10-06T02:20:42.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4d00129700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf815b170 con 0x7f4cf815d5a0 2023-10-06T02:20:42.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4cfdec5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce0003a60 0x7f4cf80c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:42.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4cfdec5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce0003a60 0x7f4cf80c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46408/0 (socket says 172.21.15.6:46408) 2023-10-06T02:20:42.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4cfdec5700 1 -- 172.21.15.6:0/3229120553 learned_addr learned my addr 172.21.15.6:0/3229120553 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:42.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4cfd6c4700 1 --2- 172.21.15.6:0/3229120553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf815d130 0x7f4cf815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:42.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4cfe6c6700 1 --2- 172.21.15.6:0/3229120553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cf815d5a0 0x7f4cf815c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:42.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4cfdec5700 1 -- 172.21.15.6:0/3229120553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cf815d5a0 msgr2=0x7f4cf815c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4cfdec5700 1 --2- 172.21.15.6:0/3229120553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cf815d5a0 0x7f4cf815c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4cfdec5700 1 -- 172.21.15.6:0/3229120553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf815d130 msgr2=0x7f4cf815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4cfdec5700 1 --2- 172.21.15.6:0/3229120553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf815d130 0x7f4cf815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4cfdec5700 1 -- 172.21.15.6:0/3229120553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf815b450 con 0x7f4ce0003a60 2023-10-06T02:20:42.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4cfe6c6700 1 --2- 172.21.15.6:0/3229120553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cf815d5a0 0x7f4cf815c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:42.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.615+0000 7f4cfdec5700 1 --2- 172.21.15.6:0/3229120553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce0003a60 0x7f4cf80c5b20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000c0a0 tx=0x7f4cf001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:42.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.616+0000 7f4cf5ffb700 1 -- 172.21.15.6:0/3229120553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0022070 con 0x7f4ce0003a60 2023-10-06T02:20:42.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.616+0000 7f4cf5ffb700 1 -- 172.21.15.6:0/3229120553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf000e9e0 con 0x7f4ce0003a60 2023-10-06T02:20:42.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.616+0000 7f4cf5ffb700 1 -- 172.21.15.6:0/3229120553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf001c450 con 0x7f4ce0003a60 2023-10-06T02:20:42.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.616+0000 7f4d00129700 1 -- 172.21.15.6:0/3229120553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf815b730 con 0x7f4ce0003a60 2023-10-06T02:20:42.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.616+0000 7f4d00129700 1 -- 172.21.15.6:0/3229120553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf80c6220 con 0x7f4ce0003a60 2023-10-06T02:20:42.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.617+0000 7f4d00129700 1 -- 172.21.15.6:0/3229120553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf8088700 con 0x7f4ce0003a60 2023-10-06T02:20:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.617+0000 7f4cf5ffb700 1 -- 172.21.15.6:0/3229120553 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4cf001c8a0 con 0x7f4ce0003a60 2023-10-06T02:20:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.618+0000 7f4cf5ffb700 1 --2- 172.21.15.6:0/3229120553 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4ce4066fb0 0x7f4ce4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.618+0000 7f4cf5ffb700 1 -- 172.21.15.6:0/3229120553 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f4cf0085bf0 con 0x7f4ce0003a60 2023-10-06T02:20:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.618+0000 7f4cfd6c4700 1 --2- 172.21.15.6:0/3229120553 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4ce4066fb0 0x7f4ce4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.618+0000 7f4cfd6c4700 1 --2- 172.21.15.6:0/3229120553 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4ce4066fb0 0x7f4ce4069460 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8158690 tx=0x7f4cec001aa0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.622+0000 7f4cf5ffb700 1 -- 172.21.15.6:0/3229120553 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4cf0052dc0 con 0x7f4ce0003a60 2023-10-06T02:20:42.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.818+0000 7f4d00129700 1 -- 172.21.15.6:0/3229120553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4cf815bd80 con 0x7f4ce0003a60 2023-10-06T02:20:42.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.821+0000 7f4cf5ffb700 1 -- 172.21.15.6:0/3229120553 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4cf0006cb0 con 0x7f4ce0003a60 2023-10-06T02:20:42.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.823+0000 7f4d00129700 1 -- 172.21.15.6:0/3229120553 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4ce4066fb0 msgr2=0x7f4ce4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.823+0000 7f4d00129700 1 --2- 172.21.15.6:0/3229120553 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4ce4066fb0 0x7f4ce4069460 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8158690 tx=0x7f4cec001aa0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.823+0000 7f4d00129700 1 -- 172.21.15.6:0/3229120553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce0003a60 msgr2=0x7f4cf80c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.823+0000 7f4d00129700 1 --2- 172.21.15.6:0/3229120553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce0003a60 0x7f4cf80c5b20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000c0a0 tx=0x7f4cf001a000 comp rx=0 tx=0).stop 2023-10-06T02:20:42.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.824+0000 7f4d00129700 1 -- 172.21.15.6:0/3229120553 shutdown_connections 2023-10-06T02:20:42.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.824+0000 7f4d00129700 1 --2- 172.21.15.6:0/3229120553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cf815d5a0 0x7f4cf815c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.824+0000 7f4d00129700 1 --2- 172.21.15.6:0/3229120553 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4ce4066fb0 0x7f4ce4069460 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.824+0000 7f4d00129700 1 --2- 172.21.15.6:0/3229120553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce0003a60 0x7f4cf80c5b20 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.824+0000 7f4d00129700 1 --2- 172.21.15.6:0/3229120553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf815d130 0x7f4cf815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.824+0000 7f4d00129700 1 -- 172.21.15.6:0/3229120553 >> 172.21.15.6:0/3229120553 conn(0x7f4cf8068680 msgr2=0x7f4cf8158f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:42.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.824+0000 7f4d00129700 1 -- 172.21.15.6:0/3229120553 shutdown_connections 2023-10-06T02:20:42.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.824+0000 7f4d00129700 1 -- 172.21.15.6:0/3229120553 wait complete. 2023-10-06T02:20:42.836 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing' 2023-10-06T02:20:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.954+0000 7fb615a64700 1 Processor -- start 2023-10-06T02:20:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.954+0000 7fb615a64700 1 -- start start 2023-10-06T02:20:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.955+0000 7fb615a64700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb610157040 0x7fb6100cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.955+0000 7fb615a64700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6100cd5b0 con 0x7fb610157410 2023-10-06T02:20:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.955+0000 7fb615a64700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6100ccc80 con 0x7fb6100cda40 2023-10-06T02:20:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.955+0000 7fb615a64700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6100ccf60 con 0x7fb610157040 2023-10-06T02:20:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.955+0000 7fb614a62700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb610157040 0x7fb6100cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.955+0000 7fb60ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb610157410 0x7fb6100ad830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59924/0 (socket says 172.21.15.6:59924) 2023-10-06T02:20:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.955+0000 7fb614a62700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb610157040 0x7fb6100cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46422/0 (socket says 172.21.15.6:46422) 2023-10-06T02:20:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.955+0000 7fb60ffff700 1 -- 172.21.15.6:0/1156481291 learned_addr learned my addr 172.21.15.6:0/1156481291 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.956+0000 7fb614a62700 1 -- 172.21.15.6:0/1156481291 >> v1:172.21.15.175:6789/0 conn(0x7fb6100cda40 legacy=0x7fb6100adf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.956+0000 7fb614a62700 1 -- 172.21.15.6:0/1156481291 >> v1:172.21.15.6:6789/0 conn(0x7fb610157410 legacy=0x7fb6100ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.956+0000 7fb614a62700 1 -- 172.21.15.6:0/1156481291 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6100cd240 con 0x7fb610157040 2023-10-06T02:20:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.956+0000 7fb60f7fe700 1 -- 172.21.15.6:0/1156481291 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763926339 0 0) 0x7fb6100cd5b0 con 0x7fb610157410 2023-10-06T02:20:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.956+0000 7fb614a62700 1 --2- 172.21.15.6:0/1156481291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb610157040 0x7fb6100cbfa0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb608009e60 tx=0x7fb608009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64cc1ac994b68a62 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.956+0000 7fb60f7fe700 1 -- 172.21.15.6:0/1156481291 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60800e070 con 0x7fb610157040 2023-10-06T02:20:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.956+0000 7fb60f7fe700 1 -- 172.21.15.6:0/1156481291 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60800bbf0 con 0x7fb610157040 2023-10-06T02:20:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.956+0000 7fb60f7fe700 1 -- 172.21.15.6:0/1156481291 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608012430 con 0x7fb610157040 2023-10-06T02:20:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.956+0000 7fb615a64700 1 -- 172.21.15.6:0/1156481291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb610157040 msgr2=0x7fb6100cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.956+0000 7fb615a64700 1 --2- 172.21.15.6:0/1156481291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb610157040 0x7fb6100cbfa0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb608009e60 tx=0x7fb608009780 comp rx=0 tx=0).stop 2023-10-06T02:20:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.957+0000 7fb615a64700 1 -- 172.21.15.6:0/1156481291 shutdown_connections 2023-10-06T02:20:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.957+0000 7fb615a64700 1 --2- 172.21.15.6:0/1156481291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb610157040 0x7fb6100cbfa0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.957+0000 7fb615a64700 1 -- 172.21.15.6:0/1156481291 >> 172.21.15.6:0/1156481291 conn(0x7fb610067130 msgr2=0x7fb610067530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.957+0000 7fb615a64700 1 -- 172.21.15.6:0/1156481291 shutdown_connections 2023-10-06T02:20:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.957+0000 7fb615a64700 1 -- 172.21.15.6:0/1156481291 wait complete. 2023-10-06T02:20:42.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.958+0000 7fb615a64700 1 Processor -- start 2023-10-06T02:20:42.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.958+0000 7fb615a64700 1 -- start start 2023-10-06T02:20:42.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb615a64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6100cda40 0x7fb61006ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb615a64700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb610157040 0x7fb6100a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb615a64700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb610157410 0x7fb61016f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb615a64700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100ca760 con 0x7fb6100cda40 2023-10-06T02:20:42.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb615a64700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100a6070 con 0x7fb610157410 2023-10-06T02:20:42.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb615a64700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb610153d30 con 0x7fb610157040 2023-10-06T02:20:42.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb614a62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6100cda40 0x7fb61006ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:42.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb614a62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6100cda40 0x7fb61006ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46434/0 (socket says 172.21.15.6:46434) 2023-10-06T02:20:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb614a62700 1 -- 172.21.15.6:0/2645199530 learned_addr learned my addr 172.21.15.6:0/2645199530 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb614a62700 1 -- 172.21.15.6:0/2645199530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb610157040 msgr2=0x7fb6100a6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb614a62700 1 --2- 172.21.15.6:0/2645199530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb610157040 0x7fb6100a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb614a62700 1 -- 172.21.15.6:0/2645199530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb610157410 msgr2=0x7fb61016f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb614a62700 1 --2- 172.21.15.6:0/2645199530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb610157410 0x7fb61016f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb614a62700 1 -- 172.21.15.6:0/2645199530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb608009a20 con 0x7fb6100cda40 2023-10-06T02:20:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb614a62700 1 --2- 172.21.15.6:0/2645199530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6100cda40 0x7fb61006ab60 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb60800b6c0 tx=0x7fb608018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb60cff9700 1 -- 172.21.15.6:0/2645199530 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608012e80 con 0x7fb6100cda40 2023-10-06T02:20:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb60cff9700 1 -- 172.21.15.6:0/2645199530 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60801e640 con 0x7fb6100cda40 2023-10-06T02:20:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb615a64700 1 -- 172.21.15.6:0/2645199530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb610069ac0 con 0x7fb6100cda40 2023-10-06T02:20:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb60cff9700 1 -- 172.21.15.6:0/2645199530 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60801ea00 con 0x7fb6100cda40 2023-10-06T02:20:42.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.959+0000 7fb615a64700 1 -- 172.21.15.6:0/2645199530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb610069e50 con 0x7fb6100cda40 2023-10-06T02:20:42.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.960+0000 7fb615a64700 1 -- 172.21.15.6:0/2645199530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61006f3c0 con 0x7fb6100cda40 2023-10-06T02:20:42.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.961+0000 7fb60cff9700 1 -- 172.21.15.6:0/2645199530 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb608024070 con 0x7fb6100cda40 2023-10-06T02:20:42.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.961+0000 7fb60cff9700 1 --2- 172.21.15.6:0/2645199530 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5f0066f30 0x7fb5f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:42.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.961+0000 7fb60cff9700 1 -- 172.21.15.6:0/2645199530 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fb608086fa0 con 0x7fb6100cda40 2023-10-06T02:20:42.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.961+0000 7fb60ffff700 1 --2- 172.21.15.6:0/2645199530 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5f0066f30 0x7fb5f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:42.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.962+0000 7fb60ffff700 1 --2- 172.21.15.6:0/2645199530 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5f0066f30 0x7fb5f00693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb61016be10 tx=0x7fb600007bd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:42.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:42.965+0000 7fb60cff9700 1 -- 172.21.15.6:0/2645199530 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6080b85a0 con 0x7fb6100cda40 2023-10-06T02:20:43.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.242+0000 7fb615a64700 1 -- 172.21.15.6:0/2645199530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing"]} v 0) v1 -- 0x7fb61009b5d0 con 0x7fb6100cda40 2023-10-06T02:20:43.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.773+0000 7fb60cff9700 1 -- 172.21.15.6:0/2645199530 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_existing"]}]=0 v168) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb60805be60 con 0x7fb6100cda40 2023-10-06T02:20:43.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.776+0000 7fb615a64700 1 -- 172.21.15.6:0/2645199530 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5f0066f30 msgr2=0x7fb5f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:43.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.776+0000 7fb615a64700 1 --2- 172.21.15.6:0/2645199530 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5f0066f30 0x7fb5f00693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb61016be10 tx=0x7fb600007bd0 comp rx=0 tx=0).stop 2023-10-06T02:20:43.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.776+0000 7fb615a64700 1 -- 172.21.15.6:0/2645199530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6100cda40 msgr2=0x7fb61006ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:43.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.776+0000 7fb615a64700 1 --2- 172.21.15.6:0/2645199530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6100cda40 0x7fb61006ab60 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb60800b6c0 tx=0x7fb608018000 comp rx=0 tx=0).stop 2023-10-06T02:20:43.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.776+0000 7fb615a64700 1 -- 172.21.15.6:0/2645199530 shutdown_connections 2023-10-06T02:20:43.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.776+0000 7fb615a64700 1 --2- 172.21.15.6:0/2645199530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb610157410 0x7fb61016f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:43.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.776+0000 7fb615a64700 1 --2- 172.21.15.6:0/2645199530 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5f0066f30 0x7fb5f00693e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:43.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.776+0000 7fb615a64700 1 --2- 172.21.15.6:0/2645199530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6100cda40 0x7fb61006ab60 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:43.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.776+0000 7fb615a64700 1 --2- 172.21.15.6:0/2645199530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb610157040 0x7fb6100a6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:43.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.776+0000 7fb615a64700 1 -- 172.21.15.6:0/2645199530 >> 172.21.15.6:0/2645199530 conn(0x7fb610067130 msgr2=0x7fb61006ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.776+0000 7fb615a64700 1 -- 172.21.15.6:0/2645199530 shutdown_connections 2023-10-06T02:20:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.776+0000 7fb615a64700 1 -- 172.21.15.6:0/2645199530 wait complete. 2023-10-06T02:20:43.790 INFO:tasks.cephfs_test_runner:That the MDS won't abort when the dentry is already known to be damaged. ... ok 2023-10-06T02:20:43.790 INFO:tasks.cephfs_test_runner:Starting test: test_dentry_first_precommit (tasks.cephfs.test_damage.TestDamage) That the MDS won't write a dentry with new damage to CDentry::first 2023-10-06T02:20:43.791 INFO:tasks.cephfs_test_runner:test_dentry_first_precommit (tasks.cephfs.test_damage.TestDamage) 2023-10-06T02:20:43.791 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit' 2023-10-06T02:20:43.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.915+0000 7f376fd95700 1 Processor -- start 2023-10-06T02:20:43.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.915+0000 7f376fd95700 1 -- start start 2023-10-06T02:20:43.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376fd95700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f37680b08f0 0x7f376815de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:43.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376fd95700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37680afbc0 con 0x7f3768159150 2023-10-06T02:20:43.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376fd95700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37680cd620 con 0x7f37680cccf0 2023-10-06T02:20:43.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376fd95700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37680afe10 con 0x7f37680b08f0 2023-10-06T02:20:43.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376db31700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3768159150 0x7f3768159520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59926/0 (socket says 172.21.15.6:59926) 2023-10-06T02:20:43.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376db31700 1 -- 172.21.15.6:0/3681378255 learned_addr learned my addr 172.21.15.6:0/3681378255 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:43.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376d330700 1 --2- 172.21.15.6:0/3681378255 >> v2:172.21.15.175:3300/0 conn(0x7f37680b08f0 0x7f376815de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:43.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376cb2f700 1 -- 172.21.15.6:0/3681378255 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371188882 0 0) 0x7f37680afbc0 con 0x7f3768159150 2023-10-06T02:20:43.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376cb2f700 1 -- 172.21.15.6:0/3681378255 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3750003570 con 0x7f3768159150 2023-10-06T02:20:43.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376cb2f700 1 -- 172.21.15.6:0/3681378255 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2672093528 0 0) 0x7f3750003570 con 0x7f3768159150 2023-10-06T02:20:43.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376cb2f700 1 -- 172.21.15.6:0/3681378255 >> v2:172.21.15.175:3300/0 conn(0x7f37680b08f0 msgr2=0x7f376815de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:43.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376cb2f700 1 --2- 172.21.15.6:0/3681378255 >> v2:172.21.15.175:3300/0 conn(0x7f37680b08f0 0x7f376815de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:43.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376cb2f700 1 -- 172.21.15.6:0/3681378255 >> v1:172.21.15.175:6789/0 conn(0x7f37680cccf0 legacy=0x7f37680b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376cb2f700 1 -- 172.21.15.6:0/3681378255 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37680b00f0 con 0x7f3768159150 2023-10-06T02:20:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376cb2f700 1 -- 172.21.15.6:0/3681378255 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f3760001470 con 0x7f3768159150 2023-10-06T02:20:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376cb2f700 1 -- 172.21.15.6:0/3681378255 >> v1:172.21.15.6:6789/0 conn(0x7f3768159150 legacy=0x7f3768159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376cb2f700 1 --2- 172.21.15.6:0/3681378255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3750003a60 0x7f3750003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376cb2f700 1 --2- 172.21.15.6:0/3681378255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3750004810 0x7f3750004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376cb2f700 1 --2- 172.21.15.6:0/3681378255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37500051c0 0x7f375000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376cb2f700 1 -- 172.21.15.6:0/3681378255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37680afe10 con 0x7f37500051c0 2023-10-06T02:20:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376cb2f700 1 -- 172.21.15.6:0/3681378255 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375000c160 con 0x7f3750004810 2023-10-06T02:20:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.916+0000 7f376cb2f700 1 -- 172.21.15.6:0/3681378255 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375000c320 con 0x7f3750003a60 2023-10-06T02:20:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.917+0000 7f376e332700 1 --2- 172.21.15.6:0/3681378255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37500051c0 0x7f375000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.917+0000 7f376d330700 1 --2- 172.21.15.6:0/3681378255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3750004810 0x7f3750004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.917+0000 7f376db31700 1 --2- 172.21.15.6:0/3681378255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3750003a60 0x7f3750003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.917+0000 7f376e332700 1 -- 172.21.15.6:0/3681378255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3750003a60 msgr2=0x7f3750003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.917+0000 7f376e332700 1 --2- 172.21.15.6:0/3681378255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3750003a60 0x7f3750003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.917+0000 7f376e332700 1 -- 172.21.15.6:0/3681378255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3750004810 msgr2=0x7f3750004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.917+0000 7f376e332700 1 --2- 172.21.15.6:0/3681378255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3750004810 0x7f3750004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.917+0000 7f376e332700 1 -- 172.21.15.6:0/3681378255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3750003570 con 0x7f37500051c0 2023-10-06T02:20:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.917+0000 7f376db31700 1 --2- 172.21.15.6:0/3681378255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3750003a60 0x7f3750003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.917+0000 7f376e332700 1 -- 172.21.15.6:0/3681378255 reap_dead start 2023-10-06T02:20:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.917+0000 7f376e332700 1 --2- 172.21.15.6:0/3681378255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37500051c0 0x7f375000ba60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3758001fc0 tx=0x7f3758001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a3e82d3732779b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.917+0000 7f376cb2f700 1 -- 172.21.15.6:0/3681378255 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758001950 con 0x7f37500051c0 2023-10-06T02:20:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.917+0000 7f376cb2f700 1 -- 172.21.15.6:0/3681378255 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375800c8b0 con 0x7f37500051c0 2023-10-06T02:20:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.917+0000 7f376cb2f700 1 -- 172.21.15.6:0/3681378255 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375800cc90 con 0x7f37500051c0 2023-10-06T02:20:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.918+0000 7f376fd95700 1 -- 172.21.15.6:0/3681378255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37500051c0 msgr2=0x7f375000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.918+0000 7f376fd95700 1 --2- 172.21.15.6:0/3681378255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37500051c0 0x7f375000ba60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3758001fc0 tx=0x7f3758001640 comp rx=0 tx=0).stop 2023-10-06T02:20:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.918+0000 7f376fd95700 1 -- 172.21.15.6:0/3681378255 shutdown_connections 2023-10-06T02:20:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.918+0000 7f376fd95700 1 --2- 172.21.15.6:0/3681378255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37500051c0 0x7f375000ba60 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.918+0000 7f376fd95700 1 -- 172.21.15.6:0/3681378255 >> 172.21.15.6:0/3681378255 conn(0x7f3768068680 msgr2=0x7f3768068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.918+0000 7f376fd95700 1 -- 172.21.15.6:0/3681378255 shutdown_connections 2023-10-06T02:20:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.918+0000 7f376fd95700 1 -- 172.21.15.6:0/3681378255 wait complete. 2023-10-06T02:20:43.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.919+0000 7f376fd95700 1 Processor -- start 2023-10-06T02:20:43.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.919+0000 7f376fd95700 1 -- start start 2023-10-06T02:20:43.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.919+0000 7f376fd95700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37500051c0 0x7f3768159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:43.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.919+0000 7f376fd95700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37680c7920 0x7f37680c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:43.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f376fd95700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37680c9ed0 0x7f3768156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:43.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f376fd95700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376815a360 con 0x7f37680c7920 2023-10-06T02:20:43.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f376fd95700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376815bb30 con 0x7f37680c9ed0 2023-10-06T02:20:43.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f376fd95700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37680c8a40 con 0x7f37500051c0 2023-10-06T02:20:43.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f376d330700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37680c7920 0x7f37680c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:43.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f376d330700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37680c7920 0x7f37680c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46450/0 (socket says 172.21.15.6:46450) 2023-10-06T02:20:43.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f376d330700 1 -- 172.21.15.6:0/2629053057 learned_addr learned my addr 172.21.15.6:0/2629053057 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:43.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f376db31700 1 --2- 172.21.15.6:0/2629053057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37500051c0 0x7f3768159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:43.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f376e332700 1 --2- 172.21.15.6:0/2629053057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37680c9ed0 0x7f3768156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:43.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f376d330700 1 -- 172.21.15.6:0/2629053057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37500051c0 msgr2=0x7f3768159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:43.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f376d330700 1 --2- 172.21.15.6:0/2629053057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37500051c0 0x7f3768159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:43.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f376d330700 1 -- 172.21.15.6:0/2629053057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37680c9ed0 msgr2=0x7f3768156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:43.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f376d330700 1 --2- 172.21.15.6:0/2629053057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37680c9ed0 0x7f3768156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:43.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f376d330700 1 -- 172.21.15.6:0/2629053057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37680c8ca0 con 0x7f37680c7920 2023-10-06T02:20:43.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f376d330700 1 --2- 172.21.15.6:0/2629053057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37680c7920 0x7f37680c9990 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f375c006ac0 tx=0x7f375c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:43.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f3765ffb700 1 -- 172.21.15.6:0/2629053057 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c011ec0 con 0x7f37680c7920 2023-10-06T02:20:43.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f3765ffb700 1 -- 172.21.15.6:0/2629053057 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c00f940 con 0x7f37680c7920 2023-10-06T02:20:43.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f376fd95700 1 -- 172.21.15.6:0/2629053057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37680c8f80 con 0x7f37680c7920 2023-10-06T02:20:43.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.920+0000 7f3765ffb700 1 -- 172.21.15.6:0/2629053057 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c00fcc0 con 0x7f37680c7920 2023-10-06T02:20:43.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.921+0000 7f376fd95700 1 -- 172.21.15.6:0/2629053057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37680c4c30 con 0x7f37680c7920 2023-10-06T02:20:43.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.921+0000 7f376fd95700 1 -- 172.21.15.6:0/2629053057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376815b910 con 0x7f37680c7920 2023-10-06T02:20:43.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.922+0000 7f3765ffb700 1 -- 172.21.15.6:0/2629053057 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f375c014650 con 0x7f37680c7920 2023-10-06T02:20:43.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.922+0000 7f3765ffb700 1 --2- 172.21.15.6:0/2629053057 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3754066f30 0x7f37540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:43.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.922+0000 7f3765ffb700 1 -- 172.21.15.6:0/2629053057 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f375c018030 con 0x7f37680c7920 2023-10-06T02:20:43.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.923+0000 7f376db31700 1 --2- 172.21.15.6:0/2629053057 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3754066f30 0x7f37540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:43.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.923+0000 7f376db31700 1 --2- 172.21.15.6:0/2629053057 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3754066f30 0x7f37540693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3760005d70 tx=0x7f3760007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:43.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:43.926+0000 7f3765ffb700 1 -- 172.21.15.6:0/2629053057 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f375c055b80 con 0x7f37680c7920 2023-10-06T02:20:44.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.200+0000 7f376fd95700 1 -- 172.21.15.6:0/2629053057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit"]} v 0) v1 -- 0x7f376815bc70 con 0x7f37680c7920 2023-10-06T02:20:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.776+0000 7f3765ffb700 1 -- 172.21.15.6:0/2629053057 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit"]}]=0 v169) v1 ==== 145+0+0 (secure 0 0 0) 0x7f375c055710 con 0x7f37680c7920 2023-10-06T02:20:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.778+0000 7f376fd95700 1 -- 172.21.15.6:0/2629053057 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3754066f30 msgr2=0x7f37540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.778+0000 7f376fd95700 1 --2- 172.21.15.6:0/2629053057 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3754066f30 0x7f37540693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3760005d70 tx=0x7f3760007040 comp rx=0 tx=0).stop 2023-10-06T02:20:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.778+0000 7f376fd95700 1 -- 172.21.15.6:0/2629053057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37680c7920 msgr2=0x7f37680c9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.778+0000 7f376fd95700 1 --2- 172.21.15.6:0/2629053057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37680c7920 0x7f37680c9990 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f375c006ac0 tx=0x7f375c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.779+0000 7f376fd95700 1 -- 172.21.15.6:0/2629053057 shutdown_connections 2023-10-06T02:20:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.779+0000 7f376fd95700 1 --2- 172.21.15.6:0/2629053057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37680c9ed0 0x7f3768156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.779+0000 7f376fd95700 1 --2- 172.21.15.6:0/2629053057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37500051c0 0x7f3768159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.779+0000 7f376fd95700 1 --2- 172.21.15.6:0/2629053057 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3754066f30 0x7f37540693e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.779+0000 7f376fd95700 1 --2- 172.21.15.6:0/2629053057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37680c7920 0x7f37680c9990 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.779+0000 7f376fd95700 1 -- 172.21.15.6:0/2629053057 >> 172.21.15.6:0/2629053057 conn(0x7f3768068680 msgr2=0x7f37680b50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.779+0000 7f376fd95700 1 -- 172.21.15.6:0/2629053057 shutdown_connections 2023-10-06T02:20:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.779+0000 7f376fd95700 1 -- 172.21.15.6:0/2629053057 wait complete. 2023-10-06T02:20:44.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:20:44.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.916+0000 7fdb6b94c700 1 Processor -- start 2023-10-06T02:20:44.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.916+0000 7fdb6b94c700 1 -- start start 2023-10-06T02:20:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.917+0000 7fdb6b94c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdb6406a380 0x7fdb640cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.917+0000 7fdb6b94c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdb6406a750 0x7fdb6415d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.917+0000 7fdb6b94c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb640cae80 con 0x7fdb6415d770 2023-10-06T02:20:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.917+0000 7fdb6b94c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb640cc3d0 con 0x7fdb6406a380 2023-10-06T02:20:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.917+0000 7fdb6b94c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6415dcd0 con 0x7fdb6406a750 2023-10-06T02:20:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.917+0000 7fdb696e8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdb6406a380 0x7fdb640cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.917+0000 7fdb696e8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdb6406a380 0x7fdb640cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46456/0 (socket says 172.21.15.6:46456) 2023-10-06T02:20:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.917+0000 7fdb696e8700 1 -- 172.21.15.6:0/1683235576 learned_addr learned my addr 172.21.15.6:0/1683235576 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.918+0000 7fdb68ee7700 1 --2- 172.21.15.6:0/1683235576 >> v2:172.21.15.175:3300/0 conn(0x7fdb6406a750 0x7fdb6415d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.918+0000 7fdb696e8700 1 -- 172.21.15.6:0/1683235576 >> v2:172.21.15.175:3300/0 conn(0x7fdb6406a750 msgr2=0x7fdb6415d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.918+0000 7fdb696e8700 1 --2- 172.21.15.6:0/1683235576 >> v2:172.21.15.175:3300/0 conn(0x7fdb6406a750 0x7fdb6415d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.918+0000 7fdb696e8700 1 -- 172.21.15.6:0/1683235576 >> v1:172.21.15.175:6789/0 conn(0x7fdb6415d770 legacy=0x7fdb64159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.918+0000 7fdb696e8700 1 -- 172.21.15.6:0/1683235576 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6415dfb0 con 0x7fdb6406a380 2023-10-06T02:20:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.918+0000 7fdb696e8700 1 --2- 172.21.15.6:0/1683235576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6406a380 0x7fdb640cb310 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fdb6406b670 tx=0x7fdb5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99b81845a3d9d17 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.918+0000 7fdb63fff700 1 -- 172.21.15.6:0/1683235576 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c00b820 con 0x7fdb6406a380 2023-10-06T02:20:44.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.918+0000 7fdb63fff700 1 -- 172.21.15.6:0/1683235576 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c00b980 con 0x7fdb6406a380 2023-10-06T02:20:44.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.918+0000 7fdb63fff700 1 -- 172.21.15.6:0/1683235576 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c00bd20 con 0x7fdb6406a380 2023-10-06T02:20:44.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.919+0000 7fdb6b94c700 1 -- 172.21.15.6:0/1683235576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6406a380 msgr2=0x7fdb640cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.919+0000 7fdb6b94c700 1 --2- 172.21.15.6:0/1683235576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6406a380 0x7fdb640cb310 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fdb6406b670 tx=0x7fdb5c009250 comp rx=0 tx=0).stop 2023-10-06T02:20:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.919+0000 7fdb6b94c700 1 -- 172.21.15.6:0/1683235576 shutdown_connections 2023-10-06T02:20:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.919+0000 7fdb6b94c700 1 --2- 172.21.15.6:0/1683235576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6406a380 0x7fdb640cb310 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.919+0000 7fdb6b94c700 1 --2- 172.21.15.6:0/1683235576 >> v2:172.21.15.175:3300/0 conn(0x7fdb6406a750 0x7fdb6415d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.919+0000 7fdb6b94c700 1 -- 172.21.15.6:0/1683235576 >> 172.21.15.6:0/1683235576 conn(0x7fdb640d0350 msgr2=0x7fdb640d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.919+0000 7fdb6b94c700 1 -- 172.21.15.6:0/1683235576 shutdown_connections 2023-10-06T02:20:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.919+0000 7fdb6b94c700 1 -- 172.21.15.6:0/1683235576 wait complete. 2023-10-06T02:20:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.920+0000 7fdb6b94c700 1 Processor -- start 2023-10-06T02:20:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.920+0000 7fdb6b94c700 1 -- start start 2023-10-06T02:20:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb6b94c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb6406a380 0x7fdb64153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb6b94c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6406a750 0x7fdb640b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb6b94c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb6415d770 0x7fdb6416a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb6b94c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640c8100 con 0x7fdb6406a750 2023-10-06T02:20:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb6b94c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640b3b70 con 0x7fdb6406a380 2023-10-06T02:20:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb6b94c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640b3e50 con 0x7fdb6415d770 2023-10-06T02:20:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb68ee7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6406a750 0x7fdb640b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb68ee7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6406a750 0x7fdb640b30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46462/0 (socket says 172.21.15.6:46462) 2023-10-06T02:20:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb68ee7700 1 -- 172.21.15.6:0/429476131 learned_addr learned my addr 172.21.15.6:0/429476131 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb696e8700 1 --2- 172.21.15.6:0/429476131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb6406a380 0x7fdb64153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb69ee9700 1 --2- 172.21.15.6:0/429476131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb6415d770 0x7fdb6416a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb68ee7700 1 -- 172.21.15.6:0/429476131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb6415d770 msgr2=0x7fdb6416a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb68ee7700 1 --2- 172.21.15.6:0/429476131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb6415d770 0x7fdb6416a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb68ee7700 1 -- 172.21.15.6:0/429476131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb6406a380 msgr2=0x7fdb64153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb68ee7700 1 --2- 172.21.15.6:0/429476131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb6406a380 0x7fdb64153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb68ee7700 1 -- 172.21.15.6:0/429476131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c0094f0 con 0x7fdb6406a750 2023-10-06T02:20:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb68ee7700 1 --2- 172.21.15.6:0/429476131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6406a750 0x7fdb640b30f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800d890 tx=0x7fdb58008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb617fa700 1 -- 172.21.15.6:0/429476131 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb580125f0 con 0x7fdb6406a750 2023-10-06T02:20:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb617fa700 1 -- 172.21.15.6:0/429476131 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb58012750 con 0x7fdb6406a750 2023-10-06T02:20:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb617fa700 1 -- 172.21.15.6:0/429476131 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb58012af0 con 0x7fdb6406a750 2023-10-06T02:20:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.921+0000 7fdb6b94c700 1 -- 172.21.15.6:0/429476131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb640b4130 con 0x7fdb6406a750 2023-10-06T02:20:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.922+0000 7fdb6b94c700 1 -- 172.21.15.6:0/429476131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb64153590 con 0x7fdb6406a750 2023-10-06T02:20:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.923+0000 7fdb6b94c700 1 -- 172.21.15.6:0/429476131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb640c82b0 con 0x7fdb6406a750 2023-10-06T02:20:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.923+0000 7fdb617fa700 1 -- 172.21.15.6:0/429476131 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb5801e460 con 0x7fdb6406a750 2023-10-06T02:20:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.923+0000 7fdb617fa700 1 --2- 172.21.15.6:0/429476131 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdb50066f30 0x7fdb500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.923+0000 7fdb617fa700 1 -- 172.21.15.6:0/429476131 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fdb58084a60 con 0x7fdb6406a750 2023-10-06T02:20:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.923+0000 7fdb696e8700 1 --2- 172.21.15.6:0/429476131 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdb50066f30 0x7fdb500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.924+0000 7fdb696e8700 1 --2- 172.21.15.6:0/429476131 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdb50066f30 0x7fdb500693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdb6406b670 tx=0x7fdb5c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:44.927+0000 7fdb617fa700 1 -- 172.21.15.6:0/429476131 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb640c82b0 con 0x7fdb6406a750 2023-10-06T02:20:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.123+0000 7fdb6b94c700 1 -- 172.21.15.6:0/429476131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdb640c8240 con 0x7fdb6406a750 2023-10-06T02:20:45.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.127+0000 7fdb617fa700 1 -- 172.21.15.6:0/429476131 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdb58055760 con 0x7fdb6406a750 2023-10-06T02:20:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.129+0000 7fdb6b94c700 1 -- 172.21.15.6:0/429476131 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdb50066f30 msgr2=0x7fdb500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.129+0000 7fdb6b94c700 1 --2- 172.21.15.6:0/429476131 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdb50066f30 0x7fdb500693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdb6406b670 tx=0x7fdb5c016000 comp rx=0 tx=0).stop 2023-10-06T02:20:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.129+0000 7fdb6b94c700 1 -- 172.21.15.6:0/429476131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6406a750 msgr2=0x7fdb640b30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.129+0000 7fdb6b94c700 1 --2- 172.21.15.6:0/429476131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6406a750 0x7fdb640b30f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800d890 tx=0x7fdb58008040 comp rx=0 tx=0).stop 2023-10-06T02:20:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.129+0000 7fdb6b94c700 1 -- 172.21.15.6:0/429476131 shutdown_connections 2023-10-06T02:20:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.129+0000 7fdb6b94c700 1 --2- 172.21.15.6:0/429476131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb6415d770 0x7fdb6416a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.129+0000 7fdb6b94c700 1 --2- 172.21.15.6:0/429476131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb6406a380 0x7fdb64153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.129+0000 7fdb6b94c700 1 --2- 172.21.15.6:0/429476131 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdb50066f30 0x7fdb500693e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.129+0000 7fdb6b94c700 1 --2- 172.21.15.6:0/429476131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6406a750 0x7fdb640b30f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.129+0000 7fdb6b94c700 1 -- 172.21.15.6:0/429476131 >> 172.21.15.6:0/429476131 conn(0x7fdb640d0350 msgr2=0x7fdb641538e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:45.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.129+0000 7fdb6b94c700 1 -- 172.21.15.6:0/429476131 shutdown_connections 2023-10-06T02:20:45.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.129+0000 7fdb6b94c700 1 -- 172.21.15.6:0/429476131 wait complete. 2023-10-06T02:20:45.141 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:20:45.142 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:20:45.186 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:20:45.244 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:20:45.244 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:20:45.245 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:20:45.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.362+0000 7f712fcc0700 1 Processor -- start 2023-10-06T02:20:45.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.363+0000 7f712fcc0700 1 -- start start 2023-10-06T02:20:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.363+0000 7f712fcc0700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f712815ca10 0x7f7128069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.363+0000 7f712fcc0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f712815cde0 0x7f71280b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.363+0000 7f712fcc0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71280b1ed0 con 0x7f7128067d10 2023-10-06T02:20:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.363+0000 7f712fcc0700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71280879c0 con 0x7f712815ca10 2023-10-06T02:20:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.363+0000 7f712fcc0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71280cec50 con 0x7f712815cde0 2023-10-06T02:20:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712d25b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7128067d10 0x7f712806a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59930/0 (socket says 172.21.15.6:59930) 2023-10-06T02:20:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712d25b700 1 -- 172.21.15.6:0/3223559688 learned_addr learned my addr 172.21.15.6:0/3223559688 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712e25d700 1 --2- 172.21.15.6:0/3223559688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f712815cde0 0x7f71280b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712ca5a700 1 -- 172.21.15.6:0/3223559688 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526123213 0 0) 0x7f71280b1ed0 con 0x7f7128067d10 2023-10-06T02:20:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712ca5a700 1 -- 172.21.15.6:0/3223559688 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7110003570 con 0x7f7128067d10 2023-10-06T02:20:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712da5c700 1 --2- 172.21.15.6:0/3223559688 >> v2:172.21.15.175:3300/0 conn(0x7f712815ca10 0x7f7128069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712ca5a700 1 -- 172.21.15.6:0/3223559688 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 998075426 0 0) 0x7f7110003570 con 0x7f7128067d10 2023-10-06T02:20:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712ca5a700 1 -- 172.21.15.6:0/3223559688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f712815cde0 msgr2=0x7f71280b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712ca5a700 1 --2- 172.21.15.6:0/3223559688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f712815cde0 0x7f71280b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712ca5a700 1 -- 172.21.15.6:0/3223559688 >> v2:172.21.15.175:3300/0 conn(0x7f712815ca10 msgr2=0x7f7128069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712ca5a700 1 --2- 172.21.15.6:0/3223559688 >> v2:172.21.15.175:3300/0 conn(0x7f712815ca10 0x7f7128069f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712ca5a700 1 -- 172.21.15.6:0/3223559688 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71280cef30 con 0x7f7128067d10 2023-10-06T02:20:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712ca5a700 1 -- 172.21.15.6:0/3223559688 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f711c001470 con 0x7f7128067d10 2023-10-06T02:20:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712ca5a700 1 -- 172.21.15.6:0/3223559688 >> v1:172.21.15.6:6789/0 conn(0x7f7128067d10 legacy=0x7f712806a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712ca5a700 1 --2- 172.21.15.6:0/3223559688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f712815cde0 0x7f7110003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712ca5a700 1 --2- 172.21.15.6:0/3223559688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7110003fe0 0x7f7110004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712ca5a700 1 --2- 172.21.15.6:0/3223559688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7110004d50 0x7f71100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712ca5a700 1 -- 172.21.15.6:0/3223559688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71280879c0 con 0x7f7110003fe0 2023-10-06T02:20:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712ca5a700 1 -- 172.21.15.6:0/3223559688 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71280cec50 con 0x7f7110004d50 2023-10-06T02:20:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712ca5a700 1 -- 172.21.15.6:0/3223559688 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711000ba90 con 0x7f712815cde0 2023-10-06T02:20:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712d25b700 1 --2- 172.21.15.6:0/3223559688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7110003fe0 0x7f7110004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.364+0000 7f712da5c700 1 --2- 172.21.15.6:0/3223559688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f712815cde0 0x7f7110003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.365+0000 7f712e25d700 1 --2- 172.21.15.6:0/3223559688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7110004d50 0x7f71100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.365+0000 7f712d25b700 1 -- 172.21.15.6:0/3223559688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f712815cde0 msgr2=0x7f7110003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.365+0000 7f712d25b700 1 --2- 172.21.15.6:0/3223559688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f712815cde0 0x7f7110003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.365+0000 7f712d25b700 1 -- 172.21.15.6:0/3223559688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7110004d50 msgr2=0x7f71100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.365+0000 7f712d25b700 1 --2- 172.21.15.6:0/3223559688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7110004d50 0x7f71100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.365+0000 7f712d25b700 1 -- 172.21.15.6:0/3223559688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7110003570 con 0x7f7110003fe0 2023-10-06T02:20:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.365+0000 7f712d25b700 1 --2- 172.21.15.6:0/3223559688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7110003fe0 0x7f7110004810 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f71280885d0 tx=0x7f711c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589cbff9d38fdb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.365+0000 7f712ca5a700 1 -- 172.21.15.6:0/3223559688 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c00cbd0 con 0x7f7110003fe0 2023-10-06T02:20:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.365+0000 7f712ca5a700 1 -- 172.21.15.6:0/3223559688 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c00cd50 con 0x7f7110003fe0 2023-10-06T02:20:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.365+0000 7f712ca5a700 1 -- 172.21.15.6:0/3223559688 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c005b70 con 0x7f7110003fe0 2023-10-06T02:20:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.365+0000 7f712fcc0700 1 -- 172.21.15.6:0/3223559688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7110003fe0 msgr2=0x7f7110004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.365+0000 7f712fcc0700 1 --2- 172.21.15.6:0/3223559688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7110003fe0 0x7f7110004810 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f71280885d0 tx=0x7f711c001e90 comp rx=0 tx=0).stop 2023-10-06T02:20:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.366+0000 7f712e25d700 1 -- 172.21.15.6:0/3223559688 reap_dead start 2023-10-06T02:20:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.366+0000 7f712fcc0700 1 -- 172.21.15.6:0/3223559688 shutdown_connections 2023-10-06T02:20:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.366+0000 7f712fcc0700 1 -- 172.21.15.6:0/3223559688 >> 172.21.15.6:0/3223559688 conn(0x7f7128067910 msgr2=0x7f71280ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.366+0000 7f712fcc0700 1 -- 172.21.15.6:0/3223559688 shutdown_connections 2023-10-06T02:20:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.366+0000 7f712fcc0700 1 -- 172.21.15.6:0/3223559688 wait complete. 2023-10-06T02:20:45.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.367+0000 7f712fcc0700 1 Processor -- start 2023-10-06T02:20:45.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.367+0000 7f712fcc0700 1 -- start start 2023-10-06T02:20:45.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.367+0000 7f712fcc0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7110003fe0 0x7f71281527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:45.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.367+0000 7f712fcc0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71280afc30 0x7f71280b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:45.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.367+0000 7f712fcc0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f712815db60 0x7f712815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:45.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.367+0000 7f712fcc0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71280cd790 con 0x7f71280afc30 2023-10-06T02:20:45.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.367+0000 7f712fcc0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71280b05e0 con 0x7f7110003fe0 2023-10-06T02:20:45.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.367+0000 7f712fcc0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712815f390 con 0x7f712815db60 2023-10-06T02:20:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.368+0000 7f712d25b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71280afc30 0x7f71280b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.368+0000 7f712d25b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71280afc30 0x7f71280b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46472/0 (socket says 172.21.15.6:46472) 2023-10-06T02:20:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.368+0000 7f712d25b700 1 -- 172.21.15.6:0/22961815 learned_addr learned my addr 172.21.15.6:0/22961815 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.368+0000 7f712da5c700 1 --2- 172.21.15.6:0/22961815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7110003fe0 0x7f71281527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.368+0000 7f712e25d700 1 --2- 172.21.15.6:0/22961815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f712815db60 0x7f712815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.368+0000 7f712d25b700 1 -- 172.21.15.6:0/22961815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f712815db60 msgr2=0x7f712815dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.368+0000 7f712d25b700 1 --2- 172.21.15.6:0/22961815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f712815db60 0x7f712815dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.368+0000 7f712d25b700 1 -- 172.21.15.6:0/22961815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7110003fe0 msgr2=0x7f71281527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.368+0000 7f712d25b700 1 --2- 172.21.15.6:0/22961815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7110003fe0 0x7f71281527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.368+0000 7f712d25b700 1 -- 172.21.15.6:0/22961815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712815e510 con 0x7f71280afc30 2023-10-06T02:20:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.368+0000 7f712d25b700 1 --2- 172.21.15.6:0/22961815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71280afc30 0x7f71280b00a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f711c001ed0 tx=0x7f711c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.368+0000 7f7125ffb700 1 -- 172.21.15.6:0/22961815 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c00cec0 con 0x7f71280afc30 2023-10-06T02:20:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.368+0000 7f7125ffb700 1 -- 172.21.15.6:0/22961815 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c001430 con 0x7f71280afc30 2023-10-06T02:20:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.368+0000 7f7125ffb700 1 -- 172.21.15.6:0/22961815 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c007550 con 0x7f71280afc30 2023-10-06T02:20:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.368+0000 7f712fcc0700 1 -- 172.21.15.6:0/22961815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712815e780 con 0x7f71280afc30 2023-10-06T02:20:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.369+0000 7f712fcc0700 1 -- 172.21.15.6:0/22961815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712815ed40 con 0x7f71280afc30 2023-10-06T02:20:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.369+0000 7f712fcc0700 1 -- 172.21.15.6:0/22961815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712815f500 con 0x7f71280afc30 2023-10-06T02:20:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.370+0000 7f7125ffb700 1 -- 172.21.15.6:0/22961815 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f711c019030 con 0x7f71280afc30 2023-10-06T02:20:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.370+0000 7f7125ffb700 1 --2- 172.21.15.6:0/22961815 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7114066f30 0x7f71140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.370+0000 7f7125ffb700 1 -- 172.21.15.6:0/22961815 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f711c085700 con 0x7f71280afc30 2023-10-06T02:20:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.370+0000 7f712da5c700 1 --2- 172.21.15.6:0/22961815 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7114066f30 0x7f71140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.371+0000 7f712da5c700 1 --2- 172.21.15.6:0/22961815 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7114066f30 0x7f71140693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7120006ea0 tx=0x7f7120009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.374+0000 7f7125ffb700 1 -- 172.21.15.6:0/22961815 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f711c0528d0 con 0x7f71280afc30 2023-10-06T02:20:45.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.613+0000 7f712fcc0700 1 -- 172.21.15.6:0/22961815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f712806e8d0 con 0x7f71280afc30 2023-10-06T02:20:45.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.614+0000 7f7125ffb700 1 -- 172.21.15.6:0/22961815 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f711c017de0 con 0x7f71280afc30 2023-10-06T02:20:45.614 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:45.615 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2589522502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2589522502},{"type":"v1","addr":"172.21.15.175:6837","nonce":2589522502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3703329287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3703329287},{"type":"v1","addr":"172.21.15.175:6836","nonce":3703329287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/843207095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":843207095},{"type":"v1","addr":"172.21.15.6:6834","nonce":843207095}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6123,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/602229913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":602229913},{"type":"v1","addr":"172.21.15.6:6835","nonce":602229913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[]} 2023-10-06T02:20:45.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.616+0000 7f712fcc0700 1 -- 172.21.15.6:0/22961815 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7114066f30 msgr2=0x7f71140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:45.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.616+0000 7f712fcc0700 1 --2- 172.21.15.6:0/22961815 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7114066f30 0x7f71140693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7120006ea0 tx=0x7f7120009120 comp rx=0 tx=0).stop 2023-10-06T02:20:45.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.616+0000 7f712fcc0700 1 -- 172.21.15.6:0/22961815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71280afc30 msgr2=0x7f71280b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:45.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.616+0000 7f712fcc0700 1 --2- 172.21.15.6:0/22961815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71280afc30 0x7f71280b00a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f711c001ed0 tx=0x7f711c015000 comp rx=0 tx=0).stop 2023-10-06T02:20:45.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.616+0000 7f712fcc0700 1 -- 172.21.15.6:0/22961815 shutdown_connections 2023-10-06T02:20:45.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.616+0000 7f712fcc0700 1 --2- 172.21.15.6:0/22961815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f712815db60 0x7f712815dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.616+0000 7f712fcc0700 1 --2- 172.21.15.6:0/22961815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7110003fe0 0x7f71281527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.616+0000 7f712fcc0700 1 --2- 172.21.15.6:0/22961815 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7114066f30 0x7f71140693e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.616+0000 7f712fcc0700 1 --2- 172.21.15.6:0/22961815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71280afc30 0x7f71280b00a0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.616+0000 7f712fcc0700 1 -- 172.21.15.6:0/22961815 >> 172.21.15.6:0/22961815 conn(0x7f7128067910 msgr2=0x7f712806c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:45.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.616+0000 7f712fcc0700 1 -- 172.21.15.6:0/22961815 shutdown_connections 2023-10-06T02:20:45.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.616+0000 7f712fcc0700 1 -- 172.21.15.6:0/22961815 wait complete. 2023-10-06T02:20:45.618 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 42 2023-10-06T02:20:45.629 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:20:45.629 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:20:45.629 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:20:45.629 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:20:45.629 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:20:45.629 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:20:45.630 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:20:45.630 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:20:45.630 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:20:45.630 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:20:45.630 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:20:45.630 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:20:45.631 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:20:45.631 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:20:45.631 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:20:45.631 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:20:45.639 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:20:45.639 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:20:45.640 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:20:45.640 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:20:45.641 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:20:45.642 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:20:45.642 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:20:45.642 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:20:45.682 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:20:45.682 DEBUG:teuthology.parallel:result is None 2023-10-06T02:20:45.682 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:20:45.683 DEBUG:teuthology.parallel:result is None 2023-10-06T02:20:45.685 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:20:45.685 DEBUG:teuthology.parallel:result is None 2023-10-06T02:20:45.685 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:20:45.686 DEBUG:teuthology.parallel:result is None 2023-10-06T02:20:45.686 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:20:45.757 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-06T02:20:45.758 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:20:45.769 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-10-06T02:20:45.769 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-10-06T02:20:45.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.813+0000 7f4383682700 1 Processor -- start 2023-10-06T02:20:45.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.813+0000 7f4383682700 1 -- start start 2023-10-06T02:20:45.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.814+0000 7f4383682700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f437c06c210 0x7f437c0c8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:45.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.814+0000 7f4383682700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f437c0c8550 0x7f437c068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.814+0000 7f4383682700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f437c0c8ad0 con 0x7f437c157d40 2023-10-06T02:20:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.814+0000 7f4383682700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437c06b730 con 0x7f437c0c8550 2023-10-06T02:20:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.814+0000 7f4383682700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437c06ba10 con 0x7f437c06c210 2023-10-06T02:20:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.814+0000 7f4381c1f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f437c0c8550 0x7f437c068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.814+0000 7f4380c1d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f437c06c210 0x7f437c0c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.814+0000 7f438141e700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f437c157d40 0x7f437c158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:55598/0 (socket says 172.21.15.6:55598) 2023-10-06T02:20:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.814+0000 7f438141e700 1 -- 172.21.15.6:0/1289654144 learned_addr learned my addr 172.21.15.6:0/1289654144 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.815+0000 7f436ffff700 1 -- 172.21.15.6:0/1289654144 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922751095 0 0) 0x7f437c0c8ad0 con 0x7f437c157d40 2023-10-06T02:20:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.815+0000 7f436ffff700 1 -- 172.21.15.6:0/1289654144 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4368003570 con 0x7f437c157d40 2023-10-06T02:20:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.815+0000 7f4380c1d700 1 -- 172.21.15.6:0/1289654144 >> v2:172.21.15.175:3300/0 conn(0x7f437c0c8550 msgr2=0x7f437c068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.815+0000 7f4380c1d700 1 --2- 172.21.15.6:0/1289654144 >> v2:172.21.15.175:3300/0 conn(0x7f437c0c8550 0x7f437c068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.815+0000 7f4380c1d700 1 -- 172.21.15.6:0/1289654144 >> v1:172.21.15.175:6789/0 conn(0x7f437c157d40 legacy=0x7f437c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:45.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.815+0000 7f4380c1d700 1 -- 172.21.15.6:0/1289654144 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437c06bcf0 con 0x7f437c06c210 2023-10-06T02:20:45.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.815+0000 7f4381c1f700 1 --2- 172.21.15.6:0/1289654144 >> v2:172.21.15.175:3300/0 conn(0x7f437c0c8550 0x7f437c068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:20:45.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.815+0000 7f4380c1d700 1 --2- 172.21.15.6:0/1289654144 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f437c06c210 0x7f437c0c8010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f43780098e0 tx=0x7f43780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7554932331bf735c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:45.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.815+0000 7f436ffff700 1 -- 172.21.15.6:0/1289654144 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378011630 con 0x7f437c06c210 2023-10-06T02:20:45.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.815+0000 7f436ffff700 1 -- 172.21.15.6:0/1289654144 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4378011790 con 0x7f437c06c210 2023-10-06T02:20:45.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.815+0000 7f436ffff700 1 -- 172.21.15.6:0/1289654144 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378011b30 con 0x7f437c06c210 2023-10-06T02:20:45.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.816+0000 7f4383682700 1 -- 172.21.15.6:0/1289654144 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f437c06c210 msgr2=0x7f437c0c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.816+0000 7f4383682700 1 --2- 172.21.15.6:0/1289654144 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f437c06c210 0x7f437c0c8010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f43780098e0 tx=0x7f43780091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.816+0000 7f4383682700 1 -- 172.21.15.6:0/1289654144 shutdown_connections 2023-10-06T02:20:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.816+0000 7f4383682700 1 --2- 172.21.15.6:0/1289654144 >> v2:172.21.15.175:3300/0 conn(0x7f437c0c8550 0x7f437c068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.816+0000 7f4383682700 1 --2- 172.21.15.6:0/1289654144 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f437c06c210 0x7f437c0c8010 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.816+0000 7f4383682700 1 -- 172.21.15.6:0/1289654144 >> 172.21.15.6:0/1289654144 conn(0x7f437c06a260 msgr2=0x7f437c0cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.816+0000 7f4383682700 1 -- 172.21.15.6:0/1289654144 shutdown_connections 2023-10-06T02:20:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.816+0000 7f4383682700 1 -- 172.21.15.6:0/1289654144 wait complete. 2023-10-06T02:20:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.817+0000 7f4383682700 1 Processor -- start 2023-10-06T02:20:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.817+0000 7f4383682700 1 -- start start 2023-10-06T02:20:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f4383682700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f437c06c210 0x7f437c14dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f4383682700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f437c0c8550 0x7f437c0c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f4383682700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f437c157d40 0x7f437c1507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f4383682700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c150330 con 0x7f437c06c210 2023-10-06T02:20:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f4383682700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c14f720 con 0x7f437c0c8550 2023-10-06T02:20:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f4383682700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437c14fa00 con 0x7f437c157d40 2023-10-06T02:20:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f438141e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f437c06c210 0x7f437c14dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f4381c1f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f437c157d40 0x7f437c1507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f4380c1d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f437c0c8550 0x7f437c0c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f438141e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f437c06c210 0x7f437c14dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46524/0 (socket says 172.21.15.6:46524) 2023-10-06T02:20:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f438141e700 1 -- 172.21.15.6:0/2833459614 learned_addr learned my addr 172.21.15.6:0/2833459614 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f4381c1f700 1 -- 172.21.15.6:0/2833459614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f437c0c8550 msgr2=0x7f437c0c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f4381c1f700 1 --2- 172.21.15.6:0/2833459614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f437c0c8550 0x7f437c0c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f4381c1f700 1 -- 172.21.15.6:0/2833459614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f437c06c210 msgr2=0x7f437c14dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f4381c1f700 1 --2- 172.21.15.6:0/2833459614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f437c06c210 0x7f437c14dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f4381c1f700 1 -- 172.21.15.6:0/2833459614 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4374009a20 con 0x7f437c157d40 2023-10-06T02:20:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f438141e700 1 --2- 172.21.15.6:0/2833459614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f437c06c210 0x7f437c14dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:20:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.818+0000 7f4381c1f700 1 --2- 172.21.15.6:0/2833459614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f437c157d40 0x7f437c1507c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4374009f10 tx=0x7f437400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.819+0000 7f436d7fa700 1 -- 172.21.15.6:0/2833459614 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437400cb70 con 0x7f437c157d40 2023-10-06T02:20:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.819+0000 7f436d7fa700 1 -- 172.21.15.6:0/2833459614 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437400f040 con 0x7f437c157d40 2023-10-06T02:20:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.819+0000 7f436d7fa700 1 -- 172.21.15.6:0/2833459614 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374014480 con 0x7f437c157d40 2023-10-06T02:20:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.819+0000 7f4383682700 1 -- 172.21.15.6:0/2833459614 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4378009420 con 0x7f437c157d40 2023-10-06T02:20:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.819+0000 7f4383682700 1 -- 172.21.15.6:0/2833459614 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437c14ffc0 con 0x7f437c157d40 2023-10-06T02:20:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.819+0000 7f4383682700 1 -- 172.21.15.6:0/2833459614 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f437c1504a0 con 0x7f437c157d40 2023-10-06T02:20:45.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.820+0000 7f436d7fa700 1 -- 172.21.15.6:0/2833459614 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4374003020 con 0x7f437c157d40 2023-10-06T02:20:45.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.820+0000 7f436d7fa700 1 --2- 172.21.15.6:0/2833459614 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4360066f30 0x7f43600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:45.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.820+0000 7f436d7fa700 1 -- 172.21.15.6:0/2833459614 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f4374084e50 con 0x7f437c157d40 2023-10-06T02:20:45.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.821+0000 7f438141e700 1 --2- 172.21.15.6:0/2833459614 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4360066f30 0x7f43600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:45.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.821+0000 7f438141e700 1 --2- 172.21.15.6:0/2833459614 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4360066f30 0x7f43600693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4370001e30 tx=0x7f4370009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:45.825+0000 7f436d7fa700 1 -- 172.21.15.6:0/2833459614 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4374052020 con 0x7f437c157d40 2023-10-06T02:20:46.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.037+0000 7f4383682700 1 -- 172.21.15.6:0/2833459614 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f437c068bc0 con 0x7f437c157d40 2023-10-06T02:20:46.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.789+0000 7f436d7fa700 1 -- 172.21.15.6:0/2833459614 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4374055640 con 0x7f437c157d40 2023-10-06T02:20:46.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.792+0000 7f4383682700 1 -- 172.21.15.6:0/2833459614 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4360066f30 msgr2=0x7f43600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.792+0000 7f4383682700 1 --2- 172.21.15.6:0/2833459614 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4360066f30 0x7f43600693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4370001e30 tx=0x7f4370009040 comp rx=0 tx=0).stop 2023-10-06T02:20:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.792+0000 7f4383682700 1 -- 172.21.15.6:0/2833459614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f437c157d40 msgr2=0x7f437c1507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.792+0000 7f4383682700 1 --2- 172.21.15.6:0/2833459614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f437c157d40 0x7f437c1507c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4374009f10 tx=0x7f437400b040 comp rx=0 tx=0).stop 2023-10-06T02:20:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.792+0000 7f4383682700 1 -- 172.21.15.6:0/2833459614 shutdown_connections 2023-10-06T02:20:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.792+0000 7f4383682700 1 --2- 172.21.15.6:0/2833459614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f437c157d40 0x7f437c1507c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.792+0000 7f4383682700 1 --2- 172.21.15.6:0/2833459614 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4360066f30 0x7f43600693e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.792+0000 7f4383682700 1 --2- 172.21.15.6:0/2833459614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f437c06c210 0x7f437c14dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.792+0000 7f4383682700 1 --2- 172.21.15.6:0/2833459614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f437c0c8550 0x7f437c0c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.792+0000 7f4383682700 1 -- 172.21.15.6:0/2833459614 >> 172.21.15.6:0/2833459614 conn(0x7f437c06a260 msgr2=0x7f437c15a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:46.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.792+0000 7f4383682700 1 -- 172.21.15.6:0/2833459614 shutdown_connections 2023-10-06T02:20:46.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.792+0000 7f4383682700 1 -- 172.21.15.6:0/2833459614 wait complete. 2023-10-06T02:20:46.794 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-10-06T02:20:46.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:20:46.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.933+0000 7efc9d8ac700 1 Processor -- start 2023-10-06T02:20:46.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.933+0000 7efc9d8ac700 1 -- start start 2023-10-06T02:20:46.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.933+0000 7efc9d8ac700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efc98142cf0 0x7efc980ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:46.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.933+0000 7efc9d8ac700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efc980ce9f0 0x7efc980d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:46.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.933+0000 7efc9d8ac700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc980cee60 con 0x7efc981430c0 2023-10-06T02:20:46.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.933+0000 7efc9d8ac700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc980cf140 con 0x7efc980ce9f0 2023-10-06T02:20:46.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.934+0000 7efc9d8ac700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc980cf420 con 0x7efc98142cf0 2023-10-06T02:20:46.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.934+0000 7efc967fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efc980ce9f0 0x7efc980d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:46.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.934+0000 7efc967fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efc980ce9f0 0x7efc980d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46540/0 (socket says 172.21.15.6:46540) 2023-10-06T02:20:46.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.934+0000 7efc967fc700 1 -- 172.21.15.6:0/872062413 learned_addr learned my addr 172.21.15.6:0/872062413 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:46.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.934+0000 7efc96ffd700 1 --2- 172.21.15.6:0/872062413 >> v2:172.21.15.175:3300/0 conn(0x7efc98142cf0 0x7efc980ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:46.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.934+0000 7efc967fc700 1 -- 172.21.15.6:0/872062413 >> v2:172.21.15.175:3300/0 conn(0x7efc98142cf0 msgr2=0x7efc980ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:46.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.934+0000 7efc967fc700 1 --2- 172.21.15.6:0/872062413 >> v2:172.21.15.175:3300/0 conn(0x7efc98142cf0 0x7efc980ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:46.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.934+0000 7efc967fc700 1 -- 172.21.15.6:0/872062413 >> v1:172.21.15.175:6789/0 conn(0x7efc981430c0 legacy=0x7efc980b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:46.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.934+0000 7efc967fc700 1 -- 172.21.15.6:0/872062413 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc980cf700 con 0x7efc980ce9f0 2023-10-06T02:20:46.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.934+0000 7efc96ffd700 1 --2- 172.21.15.6:0/872062413 >> v2:172.21.15.175:3300/0 conn(0x7efc98142cf0 0x7efc980ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:46.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.934+0000 7efc967fc700 1 --2- 172.21.15.6:0/872062413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ce9f0 0x7efc980d02a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7efc98089580 tx=0x7efc80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05ca8b3851ff431 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:46.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.934+0000 7efc95ffb700 1 -- 172.21.15.6:0/872062413 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8000b860 con 0x7efc980ce9f0 2023-10-06T02:20:46.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.934+0000 7efc95ffb700 1 -- 172.21.15.6:0/872062413 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8000b9c0 con 0x7efc980ce9f0 2023-10-06T02:20:46.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.934+0000 7efc95ffb700 1 -- 172.21.15.6:0/872062413 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8000bd60 con 0x7efc980ce9f0 2023-10-06T02:20:46.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.935+0000 7efc9d8ac700 1 -- 172.21.15.6:0/872062413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ce9f0 msgr2=0x7efc980d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:46.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.935+0000 7efc9d8ac700 1 --2- 172.21.15.6:0/872062413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ce9f0 0x7efc980d02a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7efc98089580 tx=0x7efc80009250 comp rx=0 tx=0).stop 2023-10-06T02:20:46.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.935+0000 7efc9d8ac700 1 -- 172.21.15.6:0/872062413 shutdown_connections 2023-10-06T02:20:46.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.935+0000 7efc9d8ac700 1 --2- 172.21.15.6:0/872062413 >> v2:172.21.15.175:3300/0 conn(0x7efc98142cf0 0x7efc980ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:46.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.935+0000 7efc9d8ac700 1 --2- 172.21.15.6:0/872062413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ce9f0 0x7efc980d02a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:46.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.935+0000 7efc9d8ac700 1 -- 172.21.15.6:0/872062413 >> 172.21.15.6:0/872062413 conn(0x7efc980690f0 msgr2=0x7efc9806a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:46.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.935+0000 7efc9d8ac700 1 -- 172.21.15.6:0/872062413 shutdown_connections 2023-10-06T02:20:46.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.935+0000 7efc9d8ac700 1 -- 172.21.15.6:0/872062413 wait complete. 2023-10-06T02:20:46.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.936+0000 7efc9d8ac700 1 Processor -- start 2023-10-06T02:20:46.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.936+0000 7efc9d8ac700 1 -- start start 2023-10-06T02:20:46.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.937+0000 7efc9d8ac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ce9f0 0x7efc980ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:46.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.937+0000 7efc9d8ac700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc98142cf0 0x7efc980cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:46.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.937+0000 7efc9d8ac700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc981430c0 0x7efc98169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.937+0000 7efc9d8ac700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc98134180 con 0x7efc980ce9f0 2023-10-06T02:20:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.937+0000 7efc9d8ac700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc980cb5b0 con 0x7efc981430c0 2023-10-06T02:20:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.937+0000 7efc9d8ac700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc980b0770 con 0x7efc98142cf0 2023-10-06T02:20:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.937+0000 7efc96ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ce9f0 0x7efc980ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.937+0000 7efc96ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ce9f0 0x7efc980ca850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46556/0 (socket says 172.21.15.6:46556) 2023-10-06T02:20:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.937+0000 7efc96ffd700 1 -- 172.21.15.6:0/1559446677 learned_addr learned my addr 172.21.15.6:0/1559446677 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.937+0000 7efc977fe700 1 --2- 172.21.15.6:0/1559446677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc981430c0 0x7efc98169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.937+0000 7efc967fc700 1 --2- 172.21.15.6:0/1559446677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc98142cf0 0x7efc980cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.937+0000 7efc96ffd700 1 -- 172.21.15.6:0/1559446677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc98142cf0 msgr2=0x7efc980cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.937+0000 7efc96ffd700 1 --2- 172.21.15.6:0/1559446677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc98142cf0 0x7efc980cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.937+0000 7efc96ffd700 1 -- 172.21.15.6:0/1559446677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc981430c0 msgr2=0x7efc98169ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.937+0000 7efc96ffd700 1 --2- 172.21.15.6:0/1559446677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc981430c0 0x7efc98169ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.937+0000 7efc96ffd700 1 -- 172.21.15.6:0/1559446677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc800094f0 con 0x7efc980ce9f0 2023-10-06T02:20:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.937+0000 7efc977fe700 1 --2- 172.21.15.6:0/1559446677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc981430c0 0x7efc98169ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.938+0000 7efc96ffd700 1 --2- 172.21.15.6:0/1559446677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ce9f0 0x7efc980ca850 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7efc9000d1d0 tx=0x7efc90009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.938+0000 7efc8effd700 1 -- 172.21.15.6:0/1559446677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9000de70 con 0x7efc980ce9f0 2023-10-06T02:20:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.938+0000 7efc8effd700 1 -- 172.21.15.6:0/1559446677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9000f040 con 0x7efc980ce9f0 2023-10-06T02:20:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.938+0000 7efc8effd700 1 -- 172.21.15.6:0/1559446677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90015670 con 0x7efc980ce9f0 2023-10-06T02:20:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.938+0000 7efc9d8ac700 1 -- 172.21.15.6:0/1559446677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc980b0a50 con 0x7efc980ce9f0 2023-10-06T02:20:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.938+0000 7efc9d8ac700 1 -- 172.21.15.6:0/1559446677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc980cb2d0 con 0x7efc980ce9f0 2023-10-06T02:20:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.939+0000 7efc9d8ac700 1 -- 172.21.15.6:0/1559446677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc980b05d0 con 0x7efc980ce9f0 2023-10-06T02:20:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.939+0000 7efc8effd700 1 -- 172.21.15.6:0/1559446677 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc90015a60 con 0x7efc980ce9f0 2023-10-06T02:20:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.940+0000 7efc8effd700 1 --2- 172.21.15.6:0/1559446677 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc78066f30 0x7efc780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.940+0000 7efc8effd700 1 -- 172.21.15.6:0/1559446677 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5526+0+0 (secure 0 0 0) 0x7efc90084970 con 0x7efc980ce9f0 2023-10-06T02:20:46.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.940+0000 7efc967fc700 1 --2- 172.21.15.6:0/1559446677 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc78066f30 0x7efc780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:46.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.940+0000 7efc967fc700 1 --2- 172.21.15.6:0/1559446677 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc78066f30 0x7efc780693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efc98089580 tx=0x7efc80017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:46.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:46.944+0000 7efc8effd700 1 -- 172.21.15.6:0/1559446677 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc9004e5a0 con 0x7efc980ce9f0 2023-10-06T02:20:47.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.221+0000 7efc9d8ac700 1 -- 172.21.15.6:0/1559446677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7efc980cf9e0 con 0x7efc980ce9f0 2023-10-06T02:20:47.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.221+0000 7efc8effd700 1 -- 172.21.15.6:0/1559446677 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7efc9001a090 con 0x7efc980ce9f0 2023-10-06T02:20:47.222 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:47.222 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:20:47.222 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-10-06T02:20:47.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.223 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-10-06T02:20:47.223 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9l3UdFFRAAahVHXJW+fzPcTwa/MxOW7A==", 2023-10-06T02:20:47.223 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.223 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:20:47.223 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:20:47.223 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:20:47.223 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:47.223 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.224 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-10-06T02:20:47.224 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lcq7HIBAA/3Gaa7gNbUHq176zcCFgjA==", 2023-10-06T02:20:47.224 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.224 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:20:47.224 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:20:47.224 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:20:47.224 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:47.224 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.225 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-10-06T02:20:47.225 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9ls7FDHBAA746JdAc0gr6+qLK9tuWCZg==", 2023-10-06T02:20:47.225 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.225 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:20:47.225 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:20:47.225 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:20:47.225 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:47.225 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.226 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-10-06T02:20:47.226 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9llEyZJxAAKXcHXIywnLQVZlbOGKdTTg==", 2023-10-06T02:20:47.226 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.226 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:20:47.226 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:20:47.226 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:20:47.226 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:47.226 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.227 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-10-06T02:20:47.227 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAXbh9lLVWHERAAoYIaMicUCppJKlSwl1K8UQ==", 2023-10-06T02:20:47.227 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.227 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:20:47.227 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:20:47.227 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:47.227 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.227 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-10-06T02:20:47.228 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAabh9lgpbHDxAAXOwtusarMKccKIu9+SmmHg==", 2023-10-06T02:20:47.228 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.228 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:20:47.228 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:20:47.228 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:47.228 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.228 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-10-06T02:20:47.228 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAdbh9lG/ZcFBAA3WpHCcm2R2+IyFMK460CYw==", 2023-10-06T02:20:47.228 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.229 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:20:47.229 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:20:47.229 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:47.229 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.229 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-10-06T02:20:47.229 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAgbh9lz8J4ExAAggyFHpD2wvM/b+WKLvVneA==", 2023-10-06T02:20:47.230 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.230 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:20:47.230 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:20:47.230 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:47.230 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.230 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-10-06T02:20:47.230 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAmbh9lpSX1ERAA1vkI0SvrJb6mAciDTIGZtA==", 2023-10-06T02:20:47.230 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.231 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:20:47.231 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:20:47.231 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:47.231 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.231 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-10-06T02:20:47.231 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQApbh9ljSxwDxAACjsHigTRkZIY+lHrr9/17g==", 2023-10-06T02:20:47.231 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.231 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:20:47.232 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:20:47.232 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:47.232 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.232 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-10-06T02:20:47.232 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAsbh9l6vlZDxAAfff29OvnP+8zxQFDDt8SFA==", 2023-10-06T02:20:47.232 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.232 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:20:47.232 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:20:47.232 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:47.233 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.233 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-10-06T02:20:47.233 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAvbh9lz+1sDBAANCvbv4nJUuaVde42koP8fA==", 2023-10-06T02:20:47.233 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.233 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:20:47.233 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:20:47.233 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:47.233 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.234 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-10-06T02:20:47.234 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lO6GJKxAASfNnkG3FXno1BWm5XiqIMA==", 2023-10-06T02:20:47.234 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.234 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:20:47.234 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-10-06T02:20:47.234 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:20:47.234 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.235 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-10-06T02:20:47.235 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lpRgFNBAAYE7yue5MPAzdm5k3EOcvcg==", 2023-10-06T02:20:47.235 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.235 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:20:47.235 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:20:47.235 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:20:47.235 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:20:47.236 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.236 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.236 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-10-06T02:20:47.236 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9l1hsHMRAANI0CeqE+ZB7uQ9ZB4cF/Ig==", 2023-10-06T02:20:47.236 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.236 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:20:47.236 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:20:47.236 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:20:47.237 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:20:47.237 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.237 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-10-06T02:20:47.237 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lAV9fORAAXCO4NdIb62PH2IX0y1siCw==", 2023-10-06T02:20:47.237 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.237 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:20:47.237 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:20:47.237 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:20:47.238 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:20:47.238 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.238 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-10-06T02:20:47.238 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQASbh9lIiB6NBAAvHP4z7yHub2TXCgRAAFy5A==", 2023-10-06T02:20:47.238 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.238 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:20:47.238 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:20:47.239 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:20:47.239 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:47.239 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.239 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-10-06T02:20:47.239 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lMk4mEhAAbIAiSwyo+ygZRqxKBKRxuQ==", 2023-10-06T02:20:47.239 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.240 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:20:47.240 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-06T02:20:47.240 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:47.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:47.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:47.240 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-10-06T02:20:47.240 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lxXZSDRAALw3s8FP+gOrz+VIDN7tkuw==", 2023-10-06T02:20:47.241 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:20:47.241 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:20:47.241 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-06T02:20:47.241 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:20:47.241 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.241 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:47.241 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-06T02:20:47.241 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:20:47.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.224+0000 7efc9d8ac700 1 -- 172.21.15.6:0/1559446677 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc78066f30 msgr2=0x7efc780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:47.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.224+0000 7efc9d8ac700 1 --2- 172.21.15.6:0/1559446677 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc78066f30 0x7efc780693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efc98089580 tx=0x7efc80017000 comp rx=0 tx=0).stop 2023-10-06T02:20:47.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.224+0000 7efc9d8ac700 1 -- 172.21.15.6:0/1559446677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ce9f0 msgr2=0x7efc980ca850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:47.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.224+0000 7efc9d8ac700 1 --2- 172.21.15.6:0/1559446677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ce9f0 0x7efc980ca850 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7efc9000d1d0 tx=0x7efc90009a90 comp rx=0 tx=0).stop 2023-10-06T02:20:47.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.224+0000 7efc9d8ac700 1 -- 172.21.15.6:0/1559446677 shutdown_connections 2023-10-06T02:20:47.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.224+0000 7efc9d8ac700 1 --2- 172.21.15.6:0/1559446677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc981430c0 0x7efc98169ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.224+0000 7efc9d8ac700 1 --2- 172.21.15.6:0/1559446677 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc78066f30 0x7efc780693e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.224+0000 7efc9d8ac700 1 --2- 172.21.15.6:0/1559446677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ce9f0 0x7efc980ca850 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.224+0000 7efc9d8ac700 1 --2- 172.21.15.6:0/1559446677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc98142cf0 0x7efc980cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.224+0000 7efc9d8ac700 1 -- 172.21.15.6:0/1559446677 >> 172.21.15.6:0/1559446677 conn(0x7efc980690f0 msgr2=0x7efc9815b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:47.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.224+0000 7efc9d8ac700 1 -- 172.21.15.6:0/1559446677 shutdown_connections 2023-10-06T02:20:47.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.224+0000 7efc9d8ac700 1 -- 172.21.15.6:0/1559446677 wait complete. 2023-10-06T02:20:47.245 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:20:47.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.363+0000 7f7f24f6d700 1 Processor -- start 2023-10-06T02:20:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.363+0000 7f7f24f6d700 1 -- start start 2023-10-06T02:20:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.364+0000 7f7f24f6d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7f201431b0 0x7f7f200d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.364+0000 7f7f24f6d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f200cf8a0 con 0x7f7f200d0780 2023-10-06T02:20:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.364+0000 7f7f24f6d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f200d0b50 con 0x7f7f20142de0 2023-10-06T02:20:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.364+0000 7f7f24f6d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f200cec90 con 0x7f7f201431b0 2023-10-06T02:20:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.364+0000 7f7f1dd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7f201431b0 0x7f7f200d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.364+0000 7f7f1ed9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7f200d0780 0x7f7f200b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59964/0 (socket says 172.21.15.6:59964) 2023-10-06T02:20:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.364+0000 7f7f1ed9d700 1 -- 172.21.15.6:0/316405930 learned_addr learned my addr 172.21.15.6:0/316405930 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.365+0000 7f7f1dd9b700 1 -- 172.21.15.6:0/316405930 >> v1:172.21.15.175:6789/0 conn(0x7f7f20142de0 legacy=0x7f7f200ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.365+0000 7f7f1dd9b700 1 -- 172.21.15.6:0/316405930 >> v1:172.21.15.6:6789/0 conn(0x7f7f200d0780 legacy=0x7f7f200b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.365+0000 7f7f1dd9b700 1 -- 172.21.15.6:0/316405930 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f200cef70 con 0x7f7f201431b0 2023-10-06T02:20:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.365+0000 7f7f1dd9b700 1 --2- 172.21.15.6:0/316405930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f201431b0 0x7f7f200d0240 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7f080098e0 tx=0x7f7f080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2630520b43f402a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.365+0000 7f7f1d59a700 1 -- 172.21.15.6:0/316405930 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08009e80 con 0x7f7f201431b0 2023-10-06T02:20:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.365+0000 7f7f1d59a700 1 -- 172.21.15.6:0/316405930 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0800b860 con 0x7f7f201431b0 2023-10-06T02:20:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.365+0000 7f7f1d59a700 1 -- 172.21.15.6:0/316405930 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0800bbe0 con 0x7f7f201431b0 2023-10-06T02:20:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.365+0000 7f7f24f6d700 1 -- 172.21.15.6:0/316405930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f201431b0 msgr2=0x7f7f200d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.365+0000 7f7f24f6d700 1 --2- 172.21.15.6:0/316405930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f201431b0 0x7f7f200d0240 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7f080098e0 tx=0x7f7f080091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.366+0000 7f7f24f6d700 1 -- 172.21.15.6:0/316405930 shutdown_connections 2023-10-06T02:20:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.366+0000 7f7f24f6d700 1 --2- 172.21.15.6:0/316405930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f201431b0 0x7f7f200d0240 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.366+0000 7f7f24f6d700 1 -- 172.21.15.6:0/316405930 >> 172.21.15.6:0/316405930 conn(0x7f7f20069110 msgr2=0x7f7f2006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.366+0000 7f7f24f6d700 1 -- 172.21.15.6:0/316405930 shutdown_connections 2023-10-06T02:20:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.366+0000 7f7f24f6d700 1 -- 172.21.15.6:0/316405930 wait complete. 2023-10-06T02:20:47.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.367+0000 7f7f24f6d700 1 Processor -- start 2023-10-06T02:20:47.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.367+0000 7f7f24f6d700 1 -- start start 2023-10-06T02:20:47.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f24f6d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f200d0780 0x7f7f20169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:47.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f24f6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f20142de0 0x7f7f200b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:47.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f24f6d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f201431b0 0x7f7f200b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:47.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f24f6d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2016e340 con 0x7f7f20142de0 2023-10-06T02:20:47.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f24f6d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f20157940 con 0x7f7f200d0780 2023-10-06T02:20:47.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f24f6d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f20156a50 con 0x7f7f201431b0 2023-10-06T02:20:47.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f1dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f20142de0 0x7f7f200b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:47.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f1dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f20142de0 0x7f7f200b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46574/0 (socket says 172.21.15.6:46574) 2023-10-06T02:20:47.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f1dd9b700 1 -- 172.21.15.6:0/1989565883 learned_addr learned my addr 172.21.15.6:0/1989565883 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:47.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f1e59c700 1 --2- 172.21.15.6:0/1989565883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f200d0780 0x7f7f20169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:47.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f1ed9d700 1 --2- 172.21.15.6:0/1989565883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f201431b0 0x7f7f200b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:47.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f1dd9b700 1 -- 172.21.15.6:0/1989565883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f201431b0 msgr2=0x7f7f200b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:47.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f1dd9b700 1 --2- 172.21.15.6:0/1989565883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f201431b0 0x7f7f200b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f1dd9b700 1 -- 172.21.15.6:0/1989565883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f200d0780 msgr2=0x7f7f20169ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:47.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f1dd9b700 1 --2- 172.21.15.6:0/1989565883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f200d0780 0x7f7f20169ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f1dd9b700 1 -- 172.21.15.6:0/1989565883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f08009420 con 0x7f7f20142de0 2023-10-06T02:20:47.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f1dd9b700 1 --2- 172.21.15.6:0/1989565883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f20142de0 0x7f7f200b1090 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7f20066020 tx=0x7f7f08017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:47.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f167fc700 1 -- 172.21.15.6:0/1989565883 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0800b9d0 con 0x7f7f20142de0 2023-10-06T02:20:47.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f167fc700 1 -- 172.21.15.6:0/1989565883 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0800bb30 con 0x7f7f20142de0 2023-10-06T02:20:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f24f6d700 1 -- 172.21.15.6:0/1989565883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f20156d30 con 0x7f7f20142de0 2023-10-06T02:20:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.368+0000 7f7f167fc700 1 -- 172.21.15.6:0/1989565883 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08025650 con 0x7f7f20142de0 2023-10-06T02:20:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.369+0000 7f7f24f6d700 1 -- 172.21.15.6:0/1989565883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f201572f0 con 0x7f7f20142de0 2023-10-06T02:20:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.369+0000 7f7f24f6d700 1 -- 172.21.15.6:0/1989565883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f20088ac0 con 0x7f7f20142de0 2023-10-06T02:20:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.370+0000 7f7f167fc700 1 -- 172.21.15.6:0/1989565883 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f08023070 con 0x7f7f20142de0 2023-10-06T02:20:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.370+0000 7f7f167fc700 1 --2- 172.21.15.6:0/1989565883 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f00066f30 0x7f7f000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.370+0000 7f7f167fc700 1 -- 172.21.15.6:0/1989565883 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f7f08085980 con 0x7f7f20142de0 2023-10-06T02:20:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.371+0000 7f7f1e59c700 1 --2- 172.21.15.6:0/1989565883 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f00066f30 0x7f7f000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.371+0000 7f7f1e59c700 1 --2- 172.21.15.6:0/1989565883 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f00066f30 0x7f7f000693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7f18003a80 tx=0x7f7f18007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:47.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.375+0000 7f7f167fc700 1 -- 172.21.15.6:0/1989565883 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f08052ca0 con 0x7f7f20142de0 2023-10-06T02:20:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.569+0000 7f7f24f6d700 1 -- 172.21.15.6:0/1989565883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f20157a80 con 0x7f7f20142de0 2023-10-06T02:20:47.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.570+0000 7f7f167fc700 1 -- 172.21.15.6:0/1989565883 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+13807 (secure 0 0 0) 0x7f7f080562c0 con 0x7f7f20142de0 2023-10-06T02:20:47.570 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:47.570 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":62,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:20:46.780289+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:20:47.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.572+0000 7f7f24f6d700 1 -- 172.21.15.6:0/1989565883 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f00066f30 msgr2=0x7f7f000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:47.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.572+0000 7f7f24f6d700 1 --2- 172.21.15.6:0/1989565883 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f00066f30 0x7f7f000693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7f18003a80 tx=0x7f7f18007ec0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.572+0000 7f7f24f6d700 1 -- 172.21.15.6:0/1989565883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f20142de0 msgr2=0x7f7f200b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:47.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.572+0000 7f7f24f6d700 1 --2- 172.21.15.6:0/1989565883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f20142de0 0x7f7f200b1090 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7f20066020 tx=0x7f7f08017000 comp rx=0 tx=0).stop 2023-10-06T02:20:47.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.572+0000 7f7f24f6d700 1 -- 172.21.15.6:0/1989565883 shutdown_connections 2023-10-06T02:20:47.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.572+0000 7f7f24f6d700 1 --2- 172.21.15.6:0/1989565883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f201431b0 0x7f7f200b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.572+0000 7f7f24f6d700 1 --2- 172.21.15.6:0/1989565883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f200d0780 0x7f7f20169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.572+0000 7f7f24f6d700 1 --2- 172.21.15.6:0/1989565883 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f00066f30 0x7f7f000693e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.572+0000 7f7f24f6d700 1 --2- 172.21.15.6:0/1989565883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f20142de0 0x7f7f200b1090 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.572+0000 7f7f24f6d700 1 -- 172.21.15.6:0/1989565883 >> 172.21.15.6:0/1989565883 conn(0x7f7f20069110 msgr2=0x7f7f2015cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:47.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.572+0000 7f7f24f6d700 1 -- 172.21.15.6:0/1989565883 shutdown_connections 2023-10-06T02:20:47.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.572+0000 7f7f24f6d700 1 -- 172.21.15.6:0/1989565883 wait complete. 2023-10-06T02:20:47.584 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T02:20:47.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:20:47.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.706+0000 7f81998a1700 1 Processor -- start 2023-10-06T02:20:47.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.706+0000 7f81998a1700 1 -- start start 2023-10-06T02:20:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.707+0000 7f81998a1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81941574b0 0x7f81940b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.707+0000 7f81998a1700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f81940c46e0 0x7f81940cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.707+0000 7f81998a1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81940c3b40 con 0x7f81940b13f0 2023-10-06T02:20:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.707+0000 7f81998a1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81940c2f30 con 0x7f81941574b0 2023-10-06T02:20:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.707+0000 7f81998a1700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81940c3210 con 0x7f81940c46e0 2023-10-06T02:20:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.707+0000 7f8192ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81941574b0 0x7f81940b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.707+0000 7f81927fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f81940b13f0 0x7f81940c3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59968/0 (socket says 172.21.15.6:59968) 2023-10-06T02:20:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.707+0000 7f81927fc700 1 -- 172.21.15.6:0/2084819062 learned_addr learned my addr 172.21.15.6:0/2084819062 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.707+0000 7f81937fe700 1 --2- 172.21.15.6:0/2084819062 >> v2:172.21.15.175:3300/0 conn(0x7f81940c46e0 0x7f81940cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.708+0000 7f8192ffd700 1 -- 172.21.15.6:0/2084819062 >> v2:172.21.15.175:3300/0 conn(0x7f81940c46e0 msgr2=0x7f81940cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.708+0000 7f8192ffd700 1 --2- 172.21.15.6:0/2084819062 >> v2:172.21.15.175:3300/0 conn(0x7f81940c46e0 0x7f81940cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.708+0000 7f8192ffd700 1 -- 172.21.15.6:0/2084819062 >> v1:172.21.15.6:6789/0 conn(0x7f81940b13f0 legacy=0x7f81940c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.708+0000 7f8191ffb700 1 -- 172.21.15.6:0/2084819062 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4159578822 0 0) 0x7f81940c3b40 con 0x7f81940b13f0 2023-10-06T02:20:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.708+0000 7f8192ffd700 1 -- 172.21.15.6:0/2084819062 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81940c34f0 con 0x7f81941574b0 2023-10-06T02:20:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.708+0000 7f81937fe700 1 --2- 172.21.15.6:0/2084819062 >> v2:172.21.15.175:3300/0 conn(0x7f81940c46e0 0x7f81940cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.708+0000 7f8192ffd700 1 --2- 172.21.15.6:0/2084819062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81941574b0 0x7f81940b0eb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f819406be40 tx=0x7f818c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7e8f6c0bfb6eb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.708+0000 7f8191ffb700 1 -- 172.21.15.6:0/2084819062 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c005c10 con 0x7f81941574b0 2023-10-06T02:20:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.708+0000 7f8191ffb700 1 -- 172.21.15.6:0/2084819062 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c005d70 con 0x7f81941574b0 2023-10-06T02:20:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.708+0000 7f8191ffb700 1 -- 172.21.15.6:0/2084819062 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c006260 con 0x7f81941574b0 2023-10-06T02:20:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.708+0000 7f81998a1700 1 -- 172.21.15.6:0/2084819062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81941574b0 msgr2=0x7f81940b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.708+0000 7f81998a1700 1 --2- 172.21.15.6:0/2084819062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81941574b0 0x7f81940b0eb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f819406be40 tx=0x7f818c009120 comp rx=0 tx=0).stop 2023-10-06T02:20:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.708+0000 7f81998a1700 1 -- 172.21.15.6:0/2084819062 shutdown_connections 2023-10-06T02:20:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.708+0000 7f81998a1700 1 --2- 172.21.15.6:0/2084819062 >> v2:172.21.15.175:3300/0 conn(0x7f81940c46e0 0x7f81940cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.708+0000 7f81998a1700 1 --2- 172.21.15.6:0/2084819062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81941574b0 0x7f81940b0eb0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.708+0000 7f81998a1700 1 -- 172.21.15.6:0/2084819062 >> 172.21.15.6:0/2084819062 conn(0x7f8194067910 msgr2=0x7f81940ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.708+0000 7f81998a1700 1 -- 172.21.15.6:0/2084819062 shutdown_connections 2023-10-06T02:20:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.709+0000 7f81998a1700 1 -- 172.21.15.6:0/2084819062 wait complete. 2023-10-06T02:20:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.710+0000 7f81998a1700 1 Processor -- start 2023-10-06T02:20:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.710+0000 7f81998a1700 1 -- start start 2023-10-06T02:20:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.710+0000 7f81998a1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81940b13f0 0x7f8194142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.710+0000 7f81998a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81940c46e0 0x7f8194154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.710+0000 7f81998a1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81941574b0 0x7f81940c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.710+0000 7f81998a1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8194155ed0 con 0x7f81940c46e0 2023-10-06T02:20:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.710+0000 7f81998a1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81941552c0 con 0x7f81941574b0 2023-10-06T02:20:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.710+0000 7f81998a1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81941555a0 con 0x7f81940b13f0 2023-10-06T02:20:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.711+0000 7f81927fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81940c46e0 0x7f8194154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.711+0000 7f81927fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81940c46e0 0x7f8194154820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46588/0 (socket says 172.21.15.6:46588) 2023-10-06T02:20:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.711+0000 7f81927fc700 1 -- 172.21.15.6:0/3231541413 learned_addr learned my addr 172.21.15.6:0/3231541413 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.711+0000 7f8192ffd700 1 --2- 172.21.15.6:0/3231541413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81940b13f0 0x7f8194142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.711+0000 7f81937fe700 1 --2- 172.21.15.6:0/3231541413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81941574b0 0x7f81940c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.711+0000 7f81927fc700 1 -- 172.21.15.6:0/3231541413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81940b13f0 msgr2=0x7f8194142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.711+0000 7f81927fc700 1 --2- 172.21.15.6:0/3231541413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81940b13f0 0x7f8194142ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.711+0000 7f81927fc700 1 -- 172.21.15.6:0/3231541413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81941574b0 msgr2=0x7f81940c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.711+0000 7f81927fc700 1 --2- 172.21.15.6:0/3231541413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81941574b0 0x7f81940c71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.711+0000 7f81927fc700 1 -- 172.21.15.6:0/3231541413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c0093c0 con 0x7f81940c46e0 2023-10-06T02:20:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.711+0000 7f81927fc700 1 --2- 172.21.15.6:0/3231541413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81940c46e0 0x7f8194154820 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c7e0 tx=0x7f817c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.711+0000 7f818affd700 1 -- 172.21.15.6:0/3231541413 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c005b30 con 0x7f81940c46e0 2023-10-06T02:20:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.711+0000 7f818affd700 1 -- 172.21.15.6:0/3231541413 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817c005c90 con 0x7f81940c46e0 2023-10-06T02:20:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.711+0000 7f81998a1700 1 -- 172.21.15.6:0/3231541413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8194155880 con 0x7f81940c46e0 2023-10-06T02:20:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.711+0000 7f818affd700 1 -- 172.21.15.6:0/3231541413 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c007300 con 0x7f81940c46e0 2023-10-06T02:20:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.711+0000 7f81998a1700 1 -- 172.21.15.6:0/3231541413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8194143000 con 0x7f81940c46e0 2023-10-06T02:20:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.712+0000 7f81998a1700 1 -- 172.21.15.6:0/3231541413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8194156040 con 0x7f81940c46e0 2023-10-06T02:20:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.713+0000 7f818affd700 1 -- 172.21.15.6:0/3231541413 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f817c01b400 con 0x7f81940c46e0 2023-10-06T02:20:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.713+0000 7f818affd700 1 --2- 172.21.15.6:0/3231541413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8174066f30 0x7f81740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.713+0000 7f818affd700 1 -- 172.21.15.6:0/3231541413 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f817c083f30 con 0x7f81940c46e0 2023-10-06T02:20:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.713+0000 7f8192ffd700 1 --2- 172.21.15.6:0/3231541413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8174066f30 0x7f81740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.714+0000 7f8192ffd700 1 --2- 172.21.15.6:0/3231541413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8174066f30 0x7f81740693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f818c009160 tx=0x7f818c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.717+0000 7f818affd700 1 -- 172.21.15.6:0/3231541413 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f817c0512d0 con 0x7f81940c46e0 2023-10-06T02:20:47.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.911+0000 7f81998a1700 1 -- 172.21.15.6:0/3231541413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f819406e590 con 0x7f81940c46e0 2023-10-06T02:20:47.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.912+0000 7f818affd700 1 -- 172.21.15.6:0/3231541413 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v62) v1 ==== 92+0+10 (secure 0 0 0) 0x7f817c0548f0 con 0x7f81940c46e0 2023-10-06T02:20:47.912 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:20:47.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.913+0000 7f81998a1700 1 -- 172.21.15.6:0/3231541413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8174066f30 msgr2=0x7f81740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:47.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.913+0000 7f81998a1700 1 --2- 172.21.15.6:0/3231541413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8174066f30 0x7f81740693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f818c009160 tx=0x7f818c016000 comp rx=0 tx=0).stop 2023-10-06T02:20:47.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.913+0000 7f81998a1700 1 -- 172.21.15.6:0/3231541413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81940c46e0 msgr2=0x7f8194154820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.913+0000 7f81998a1700 1 --2- 172.21.15.6:0/3231541413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81940c46e0 0x7f8194154820 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c7e0 tx=0x7f817c007df0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.914+0000 7f81998a1700 1 -- 172.21.15.6:0/3231541413 shutdown_connections 2023-10-06T02:20:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.914+0000 7f81998a1700 1 --2- 172.21.15.6:0/3231541413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81941574b0 0x7f81940c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.914+0000 7f81998a1700 1 --2- 172.21.15.6:0/3231541413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81940b13f0 0x7f8194142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.914+0000 7f81998a1700 1 --2- 172.21.15.6:0/3231541413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8174066f30 0x7f81740693e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.914+0000 7f81998a1700 1 --2- 172.21.15.6:0/3231541413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81940c46e0 0x7f8194154820 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.914+0000 7f81998a1700 1 -- 172.21.15.6:0/3231541413 >> 172.21.15.6:0/3231541413 conn(0x7f8194067910 msgr2=0x7f81940c3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.914+0000 7f81998a1700 1 -- 172.21.15.6:0/3231541413 shutdown_connections 2023-10-06T02:20:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:47.914+0000 7f81998a1700 1 -- 172.21.15.6:0/3231541413 wait complete. 2023-10-06T02:20:47.926 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:20:48.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.047+0000 7f9e3353d700 1 Processor -- start 2023-10-06T02:20:48.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.047+0000 7f9e3353d700 1 -- start start 2023-10-06T02:20:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.048+0000 7f9e3353d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e2c0d0400 0x7f9e2c0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.048+0000 7f9e3353d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e2c0ccd40 0x7f9e2c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.048+0000 7f9e3353d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e2c0b6170 con 0x7f9e2c0cf7e0 2023-10-06T02:20:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.048+0000 7f9e3353d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2c15dd40 con 0x7f9e2c0d0400 2023-10-06T02:20:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.048+0000 7f9e3353d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c15e020 con 0x7f9e2c0ccd40 2023-10-06T02:20:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.048+0000 7f9e312d9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e2c0d0400 0x7f9e2c0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.048+0000 7f9e312d9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e2c0d0400 0x7f9e2c0b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46594/0 (socket says 172.21.15.6:46594) 2023-10-06T02:20:48.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.048+0000 7f9e312d9700 1 -- 172.21.15.6:0/3884895566 learned_addr learned my addr 172.21.15.6:0/3884895566 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:48.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.048+0000 7f9e30ad8700 1 --2- 172.21.15.6:0/3884895566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e2c0ccd40 0x7f9e2c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:48.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.049+0000 7f9e312d9700 1 -- 172.21.15.6:0/3884895566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e2c0ccd40 msgr2=0x7f9e2c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:48.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.049+0000 7f9e312d9700 1 --2- 172.21.15.6:0/3884895566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e2c0ccd40 0x7f9e2c0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.049+0000 7f9e312d9700 1 -- 172.21.15.6:0/3884895566 >> v1:172.21.15.175:6789/0 conn(0x7f9e2c0cf7e0 legacy=0x7f9e2c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:48.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.049+0000 7f9e312d9700 1 -- 172.21.15.6:0/3884895566 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c0ceaa0 con 0x7f9e2c0d0400 2023-10-06T02:20:48.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.049+0000 7f9e312d9700 1 --2- 172.21.15.6:0/3884895566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0d0400 0x7f9e2c0b5c30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9e240099b0 tx=0x7f9e24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f588180b9ef894 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:48.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.049+0000 7f9e2bfff700 1 -- 172.21.15.6:0/3884895566 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2400b860 con 0x7f9e2c0d0400 2023-10-06T02:20:48.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.049+0000 7f9e2bfff700 1 -- 172.21.15.6:0/3884895566 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2400b9c0 con 0x7f9e2c0d0400 2023-10-06T02:20:48.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.049+0000 7f9e2bfff700 1 -- 172.21.15.6:0/3884895566 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2400bd60 con 0x7f9e2c0d0400 2023-10-06T02:20:48.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.049+0000 7f9e3353d700 1 -- 172.21.15.6:0/3884895566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0d0400 msgr2=0x7f9e2c0b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:48.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.049+0000 7f9e3353d700 1 --2- 172.21.15.6:0/3884895566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0d0400 0x7f9e2c0b5c30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9e240099b0 tx=0x7f9e24009250 comp rx=0 tx=0).stop 2023-10-06T02:20:48.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.050+0000 7f9e3353d700 1 -- 172.21.15.6:0/3884895566 shutdown_connections 2023-10-06T02:20:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.050+0000 7f9e3353d700 1 --2- 172.21.15.6:0/3884895566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0d0400 0x7f9e2c0b5c30 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.050+0000 7f9e3353d700 1 --2- 172.21.15.6:0/3884895566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e2c0ccd40 0x7f9e2c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.050+0000 7f9e3353d700 1 -- 172.21.15.6:0/3884895566 >> 172.21.15.6:0/3884895566 conn(0x7f9e2c06a220 msgr2=0x7f9e2c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.050+0000 7f9e3353d700 1 -- 172.21.15.6:0/3884895566 shutdown_connections 2023-10-06T02:20:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.050+0000 7f9e3353d700 1 -- 172.21.15.6:0/3884895566 wait complete. 2023-10-06T02:20:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.051+0000 7f9e3353d700 1 Processor -- start 2023-10-06T02:20:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.051+0000 7f9e3353d700 1 -- start start 2023-10-06T02:20:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e3353d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e2c0ccd40 0x7f9e2c144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e3353d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e2c0cf7e0 0x7f9e2c0c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e3353d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0d0400 0x7f9e2c0c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e3353d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c169f70 con 0x7f9e2c0d0400 2023-10-06T02:20:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e3353d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c0c6360 con 0x7f9e2c0cf7e0 2023-10-06T02:20:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e3353d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c0ca8b0 con 0x7f9e2c0ccd40 2023-10-06T02:20:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e31ada700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0d0400 0x7f9e2c0c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e31ada700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0d0400 0x7f9e2c0c6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46606/0 (socket says 172.21.15.6:46606) 2023-10-06T02:20:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e31ada700 1 -- 172.21.15.6:0/2017343288 learned_addr learned my addr 172.21.15.6:0/2017343288 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e312d9700 1 --2- 172.21.15.6:0/2017343288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e2c0ccd40 0x7f9e2c144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e30ad8700 1 --2- 172.21.15.6:0/2017343288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e2c0cf7e0 0x7f9e2c0c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e31ada700 1 -- 172.21.15.6:0/2017343288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e2c0ccd40 msgr2=0x7f9e2c144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e31ada700 1 --2- 172.21.15.6:0/2017343288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e2c0ccd40 0x7f9e2c144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e31ada700 1 -- 172.21.15.6:0/2017343288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e2c0cf7e0 msgr2=0x7f9e2c0c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e31ada700 1 --2- 172.21.15.6:0/2017343288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e2c0cf7e0 0x7f9e2c0c5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e31ada700 1 -- 172.21.15.6:0/2017343288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e240094f0 con 0x7f9e2c0d0400 2023-10-06T02:20:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e31ada700 1 --2- 172.21.15.6:0/2017343288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0d0400 0x7f9e2c0c6690 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00c8e0 tx=0x7f9e1c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e297fa700 1 -- 172.21.15.6:0/2017343288 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c012630 con 0x7f9e2c0d0400 2023-10-06T02:20:48.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e297fa700 1 -- 172.21.15.6:0/2017343288 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c0127b0 con 0x7f9e2c0d0400 2023-10-06T02:20:48.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e3353d700 1 -- 172.21.15.6:0/2017343288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2c0cab90 con 0x7f9e2c0d0400 2023-10-06T02:20:48.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.052+0000 7f9e297fa700 1 -- 172.21.15.6:0/2017343288 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c012b70 con 0x7f9e2c0d0400 2023-10-06T02:20:48.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.053+0000 7f9e3353d700 1 -- 172.21.15.6:0/2017343288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2c0cb150 con 0x7f9e2c0d0400 2023-10-06T02:20:48.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.053+0000 7f9e3353d700 1 -- 172.21.15.6:0/2017343288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2c0cb340 con 0x7f9e2c0d0400 2023-10-06T02:20:48.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.054+0000 7f9e297fa700 1 -- 172.21.15.6:0/2017343288 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e1c003030 con 0x7f9e2c0d0400 2023-10-06T02:20:48.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.054+0000 7f9e297fa700 1 --2- 172.21.15.6:0/2017343288 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e18066f30 0x7f9e180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:48.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.055+0000 7f9e297fa700 1 -- 172.21.15.6:0/2017343288 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f9e1c0843c0 con 0x7f9e2c0d0400 2023-10-06T02:20:48.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.055+0000 7f9e312d9700 1 --2- 172.21.15.6:0/2017343288 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e18066f30 0x7f9e180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:48.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.055+0000 7f9e312d9700 1 --2- 172.21.15.6:0/2017343288 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e18066f30 0x7f9e180693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9e240099b0 tx=0x7f9e24017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:48.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.059+0000 7f9e297fa700 1 -- 172.21.15.6:0/2017343288 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e1c051640 con 0x7f9e2c0d0400 2023-10-06T02:20:48.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.251+0000 7f9e3353d700 1 -- 172.21.15.6:0/2017343288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e2c0c64d0 con 0x7f9e2c0d0400 2023-10-06T02:20:48.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.252+0000 7f9e297fa700 1 -- 172.21.15.6:0/2017343288 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e1c054c60 con 0x7f9e2c0d0400 2023-10-06T02:20:48.281 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:20:48.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.254+0000 7f9e3353d700 1 -- 172.21.15.6:0/2017343288 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e18066f30 msgr2=0x7f9e180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:48.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.254+0000 7f9e3353d700 1 --2- 172.21.15.6:0/2017343288 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e18066f30 0x7f9e180693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9e240099b0 tx=0x7f9e24017000 comp rx=0 tx=0).stop 2023-10-06T02:20:48.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.254+0000 7f9e3353d700 1 -- 172.21.15.6:0/2017343288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0d0400 msgr2=0x7f9e2c0c6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:48.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.254+0000 7f9e3353d700 1 --2- 172.21.15.6:0/2017343288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0d0400 0x7f9e2c0c6690 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00c8e0 tx=0x7f9e1c001710 comp rx=0 tx=0).stop 2023-10-06T02:20:48.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.254+0000 7f9e3353d700 1 -- 172.21.15.6:0/2017343288 shutdown_connections 2023-10-06T02:20:48.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.254+0000 7f9e3353d700 1 --2- 172.21.15.6:0/2017343288 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e18066f30 0x7f9e180693e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.254+0000 7f9e3353d700 1 --2- 172.21.15.6:0/2017343288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0d0400 0x7f9e2c0c6690 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.254+0000 7f9e3353d700 1 --2- 172.21.15.6:0/2017343288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e2c0ccd40 0x7f9e2c144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.254+0000 7f9e3353d700 1 --2- 172.21.15.6:0/2017343288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e2c0cf7e0 0x7f9e2c0c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.254+0000 7f9e3353d700 1 -- 172.21.15.6:0/2017343288 >> 172.21.15.6:0/2017343288 conn(0x7f9e2c06a220 msgr2=0x7f9e2c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.254+0000 7f9e3353d700 1 -- 172.21.15.6:0/2017343288 shutdown_connections 2023-10-06T02:20:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.254+0000 7f9e3353d700 1 -- 172.21.15.6:0/2017343288 wait complete. 2023-10-06T02:20:48.297 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:20:48.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.415+0000 7f70ea0f4700 1 Processor -- start 2023-10-06T02:20:48.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.415+0000 7f70ea0f4700 1 -- start start 2023-10-06T02:20:48.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.416+0000 7f70ea0f4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f70e40cf830 0x7f70e4159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:48.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.416+0000 7f70ea0f4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e40ce390 con 0x7f70e406a010 2023-10-06T02:20:48.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.416+0000 7f70ea0f4700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e415d700 con 0x7f70e406a3e0 2023-10-06T02:20:48.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.416+0000 7f70ea0f4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e415d9d0 con 0x7f70e40cf830 2023-10-06T02:20:48.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.416+0000 7f70e3fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f70e40cf830 0x7f70e4159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:48.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.416+0000 7f70e37fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f70e406a010 0x7f70e415cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59980/0 (socket says 172.21.15.6:59980) 2023-10-06T02:20:48.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.416+0000 7f70e37fe700 1 -- 172.21.15.6:0/3843225099 learned_addr learned my addr 172.21.15.6:0/3843225099 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:48.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.417+0000 7f70e3fff700 1 -- 172.21.15.6:0/3843225099 >> v1:172.21.15.175:6789/0 conn(0x7f70e406a3e0 legacy=0x7f70e4158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:48.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.417+0000 7f70e3fff700 1 -- 172.21.15.6:0/3843225099 >> v1:172.21.15.6:6789/0 conn(0x7f70e406a010 legacy=0x7f70e415cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:48.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.417+0000 7f70e3fff700 1 -- 172.21.15.6:0/3843225099 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e415dcb0 con 0x7f70e40cf830 2023-10-06T02:20:48.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.417+0000 7f70e3fff700 1 --2- 172.21.15.6:0/3843225099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70e40cf830 0x7f70e4159550 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009e60 tx=0x7f70dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f8ea0101b4e2d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:48.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.417+0000 7f70e27fc700 1 -- 172.21.15.6:0/3843225099 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc00e070 con 0x7f70e40cf830 2023-10-06T02:20:48.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.417+0000 7f70e27fc700 1 -- 172.21.15.6:0/3843225099 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc00bc30 con 0x7f70e40cf830 2023-10-06T02:20:48.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.417+0000 7f70e27fc700 1 -- 172.21.15.6:0/3843225099 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc012430 con 0x7f70e40cf830 2023-10-06T02:20:48.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.417+0000 7f70ea0f4700 1 -- 172.21.15.6:0/3843225099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70e40cf830 msgr2=0x7f70e4159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:48.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.417+0000 7f70ea0f4700 1 --2- 172.21.15.6:0/3843225099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70e40cf830 0x7f70e4159550 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009e60 tx=0x7f70dc009780 comp rx=0 tx=0).stop 2023-10-06T02:20:48.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.418+0000 7f70ea0f4700 1 -- 172.21.15.6:0/3843225099 shutdown_connections 2023-10-06T02:20:48.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.418+0000 7f70ea0f4700 1 --2- 172.21.15.6:0/3843225099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70e40cf830 0x7f70e4159550 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.418+0000 7f70ea0f4700 1 -- 172.21.15.6:0/3843225099 >> 172.21.15.6:0/3843225099 conn(0x7f70e4087c90 msgr2=0x7f70e40d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:48.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.418+0000 7f70ea0f4700 1 -- 172.21.15.6:0/3843225099 shutdown_connections 2023-10-06T02:20:48.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.418+0000 7f70ea0f4700 1 -- 172.21.15.6:0/3843225099 wait complete. 2023-10-06T02:20:48.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.419+0000 7f70ea0f4700 1 Processor -- start 2023-10-06T02:20:48.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.419+0000 7f70ea0f4700 1 -- start start 2023-10-06T02:20:48.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.419+0000 7f70ea0f4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70e406a010 0x7f70e40c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:48.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.419+0000 7f70ea0f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70e406a3e0 0x7f70e4169b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:48.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.419+0000 7f70ea0f4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70e40cf830 0x7f70e40c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:48.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.419+0000 7f70ea0f4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e416ab70 con 0x7f70e406a3e0 2023-10-06T02:20:48.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.419+0000 7f70ea0f4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e416a060 con 0x7f70e406a010 2023-10-06T02:20:48.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.419+0000 7f70ea0f4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e416a2d0 con 0x7f70e40cf830 2023-10-06T02:20:48.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.420+0000 7f70e2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70e406a3e0 0x7f70e4169b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:48.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.420+0000 7f70e2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70e406a3e0 0x7f70e4169b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46630/0 (socket says 172.21.15.6:46630) 2023-10-06T02:20:48.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.420+0000 7f70e2ffd700 1 -- 172.21.15.6:0/1623136853 learned_addr learned my addr 172.21.15.6:0/1623136853 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:48.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.420+0000 7f70e37fe700 1 --2- 172.21.15.6:0/1623136853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70e406a010 0x7f70e40c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:48.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.420+0000 7f70e3fff700 1 --2- 172.21.15.6:0/1623136853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70e40cf830 0x7f70e40c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:48.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.420+0000 7f70e2ffd700 1 -- 172.21.15.6:0/1623136853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70e40cf830 msgr2=0x7f70e40c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:48.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.420+0000 7f70e2ffd700 1 --2- 172.21.15.6:0/1623136853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70e40cf830 0x7f70e40c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.420+0000 7f70e2ffd700 1 -- 172.21.15.6:0/1623136853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70e406a010 msgr2=0x7f70e40c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:48.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.420+0000 7f70e2ffd700 1 --2- 172.21.15.6:0/1623136853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70e406a010 0x7f70e40c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.420+0000 7f70e2ffd700 1 -- 172.21.15.6:0/1623136853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc009a20 con 0x7f70e406a3e0 2023-10-06T02:20:48.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.420+0000 7f70e2ffd700 1 --2- 172.21.15.6:0/1623136853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70e406a3e0 0x7f70e4169b20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c7c0 tx=0x7f70d8007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:48.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.420+0000 7f70cb7fe700 1 -- 172.21.15.6:0/1623136853 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8011590 con 0x7f70e406a3e0 2023-10-06T02:20:48.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.420+0000 7f70cb7fe700 1 -- 172.21.15.6:0/1623136853 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d80116f0 con 0x7f70e406a3e0 2023-10-06T02:20:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.420+0000 7f70ea0f4700 1 -- 172.21.15.6:0/1623136853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e416a5b0 con 0x7f70e406a3e0 2023-10-06T02:20:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.420+0000 7f70cb7fe700 1 -- 172.21.15.6:0/1623136853 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8011ab0 con 0x7f70e406a3e0 2023-10-06T02:20:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.420+0000 7f70ea0f4700 1 -- 172.21.15.6:0/1623136853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e416aed0 con 0x7f70e406a3e0 2023-10-06T02:20:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.421+0000 7f70ea0f4700 1 -- 172.21.15.6:0/1623136853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e416b0f0 con 0x7f70e406a3e0 2023-10-06T02:20:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.422+0000 7f70cb7fe700 1 -- 172.21.15.6:0/1623136853 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70d801b3b0 con 0x7f70e406a3e0 2023-10-06T02:20:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.422+0000 7f70cb7fe700 1 --2- 172.21.15.6:0/1623136853 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f70d0066f30 0x7f70d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.422+0000 7f70cb7fe700 1 -- 172.21.15.6:0/1623136853 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f70d8083980 con 0x7f70e406a3e0 2023-10-06T02:20:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.422+0000 7f70e37fe700 1 --2- 172.21.15.6:0/1623136853 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f70d0066f30 0x7f70d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.423+0000 7f70e37fe700 1 --2- 172.21.15.6:0/1623136853 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f70d0066f30 0x7f70d00693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f70d4001820 tx=0x7f70d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.426+0000 7f70cb7fe700 1 -- 172.21.15.6:0/1623136853 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70d8050ca0 con 0x7f70e406a3e0 2023-10-06T02:20:48.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.621+0000 7f70ea0f4700 1 -- 172.21.15.6:0/1623136853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f70e4088610 con 0x7f70e406a3e0 2023-10-06T02:20:48.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.621+0000 7f70cb7fe700 1 -- 172.21.15.6:0/1623136853 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v62) v1 ==== 84+0+126 (secure 0 0 0) 0x7f70d8017070 con 0x7f70e406a3e0 2023-10-06T02:20:48.622 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:48.622 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-06T02:20:48.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:48.622 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-06T02:20:48.622 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-10-06T02:20:48.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:20:48.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:20:48.623 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-10-06T02:20:48.623 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-06T02:20:48.623 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:20:48.623 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-06T02:20:48.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.623+0000 7f70ea0f4700 1 -- 172.21.15.6:0/1623136853 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f70d0066f30 msgr2=0x7f70d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:48.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.623+0000 7f70ea0f4700 1 --2- 172.21.15.6:0/1623136853 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f70d0066f30 0x7f70d00693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f70d4001820 tx=0x7f70d4009040 comp rx=0 tx=0).stop 2023-10-06T02:20:48.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.623+0000 7f70ea0f4700 1 -- 172.21.15.6:0/1623136853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70e406a3e0 msgr2=0x7f70e4169b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:48.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.623+0000 7f70ea0f4700 1 --2- 172.21.15.6:0/1623136853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70e406a3e0 0x7f70e4169b20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c7c0 tx=0x7f70d8007f40 comp rx=0 tx=0).stop 2023-10-06T02:20:48.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.623+0000 7f70ea0f4700 1 -- 172.21.15.6:0/1623136853 shutdown_connections 2023-10-06T02:20:48.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.623+0000 7f70ea0f4700 1 --2- 172.21.15.6:0/1623136853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70e40cf830 0x7f70e40c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.623+0000 7f70ea0f4700 1 --2- 172.21.15.6:0/1623136853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70e406a010 0x7f70e40c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.623+0000 7f70ea0f4700 1 --2- 172.21.15.6:0/1623136853 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f70d0066f30 0x7f70d00693e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.623+0000 7f70ea0f4700 1 --2- 172.21.15.6:0/1623136853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70e406a3e0 0x7f70e4169b20 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.623+0000 7f70ea0f4700 1 -- 172.21.15.6:0/1623136853 >> 172.21.15.6:0/1623136853 conn(0x7f70e4087c90 msgr2=0x7f70e40c5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:48.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.623+0000 7f70ea0f4700 1 -- 172.21.15.6:0/1623136853 shutdown_connections 2023-10-06T02:20:48.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.623+0000 7f70ea0f4700 1 -- 172.21.15.6:0/1623136853 wait complete. 2023-10-06T02:20:48.636 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:20:48.636 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:20:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.759+0000 7f82b0900700 1 Processor -- start 2023-10-06T02:20:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.759+0000 7f82b0900700 1 -- start start 2023-10-06T02:20:48.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.760+0000 7f82b0900700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f82ac0cfa90 0x7f82ac0d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:48.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.760+0000 7f82b0900700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82ac0d07a0 0x7f82ac163060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:48.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.760+0000 7f82b0900700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82ac15a710 con 0x7f82ac142df0 2023-10-06T02:20:48.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.760+0000 7f82b0900700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82ac0d0c20 con 0x7f82ac0cfa90 2023-10-06T02:20:48.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.760+0000 7f82b0900700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac159b40 con 0x7f82ac0d07a0 2023-10-06T02:20:48.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.760+0000 7f82aad9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82ac0d07a0 0x7f82ac163060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:48.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.760+0000 7f82a9d9b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f82ac0cfa90 0x7f82ac0d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:48.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.760+0000 7f82a9d9b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f82ac0cfa90 0x7f82ac0d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:45850/0 (socket says 172.21.15.6:45850) 2023-10-06T02:20:48.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.760+0000 7f82a9d9b700 1 -- 172.21.15.6:0/1042447696 learned_addr learned my addr 172.21.15.6:0/1042447696 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:48.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.760+0000 7f82aad9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82ac0d07a0 0x7f82ac163060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:44806/0 (socket says 172.21.15.6:44806) 2023-10-06T02:20:48.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.760+0000 7f82aa59c700 1 --1- 172.21.15.6:0/1042447696 >> v1:172.21.15.175:6789/0 conn(0x7f82ac142df0 0x7f82ac0cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:52082/0 (socket says 172.21.15.6:52082) 2023-10-06T02:20:48.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.760+0000 7f82a9d9b700 1 -- 172.21.15.6:0/1042447696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82ac0d07a0 msgr2=0x7f82ac163060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:48.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.760+0000 7f82a9d9b700 1 --2- 172.21.15.6:0/1042447696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82ac0d07a0 0x7f82ac163060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.760+0000 7f82a9d9b700 1 -- 172.21.15.6:0/1042447696 >> v1:172.21.15.175:6789/0 conn(0x7f82ac142df0 legacy=0x7f82ac0cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:48.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.760+0000 7f82a9d9b700 1 -- 172.21.15.6:0/1042447696 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac159de0 con 0x7f82ac0cfa90 2023-10-06T02:20:48.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.760+0000 7f82a9d9b700 1 --2- 172.21.15.6:0/1042447696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82ac0cfa90 0x7f82ac0d0260 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f82940099e0 tx=0x7f8294009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c200adf3ed393a5f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:48.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.761+0000 7f82a959a700 1 -- 172.21.15.6:0/1042447696 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829400b820 con 0x7f82ac0cfa90 2023-10-06T02:20:48.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.761+0000 7f82a959a700 1 -- 172.21.15.6:0/1042447696 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829400b980 con 0x7f82ac0cfa90 2023-10-06T02:20:48.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.761+0000 7f82a959a700 1 -- 172.21.15.6:0/1042447696 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829400bd20 con 0x7f82ac0cfa90 2023-10-06T02:20:48.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.761+0000 7f82b0900700 1 -- 172.21.15.6:0/1042447696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82ac0cfa90 msgr2=0x7f82ac0d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:48.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.761+0000 7f82b0900700 1 --2- 172.21.15.6:0/1042447696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82ac0cfa90 0x7f82ac0d0260 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f82940099e0 tx=0x7f8294009250 comp rx=0 tx=0).stop 2023-10-06T02:20:48.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.761+0000 7f82b0900700 1 -- 172.21.15.6:0/1042447696 shutdown_connections 2023-10-06T02:20:48.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.761+0000 7f82b0900700 1 --2- 172.21.15.6:0/1042447696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82ac0d07a0 0x7f82ac163060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.761+0000 7f82b0900700 1 --2- 172.21.15.6:0/1042447696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82ac0cfa90 0x7f82ac0d0260 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.761+0000 7f82b0900700 1 -- 172.21.15.6:0/1042447696 >> 172.21.15.6:0/1042447696 conn(0x7f82ac0690f0 msgr2=0x7f82ac06a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:48.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.761+0000 7f82b0900700 1 -- 172.21.15.6:0/1042447696 shutdown_connections 2023-10-06T02:20:48.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.761+0000 7f82b0900700 1 -- 172.21.15.6:0/1042447696 wait complete. 2023-10-06T02:20:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.762+0000 7f82b0900700 1 Processor -- start 2023-10-06T02:20:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.762+0000 7f82b0900700 1 -- start start 2023-10-06T02:20:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.763+0000 7f82b0900700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82ac0cfa90 0x7f82ac0cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.763+0000 7f82b0900700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82ac0d07a0 0x7f82ac0b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.763+0000 7f82b0900700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac142df0 0x7f82ac16cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.763+0000 7f82b0900700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac1568d0 con 0x7f82ac142df0 2023-10-06T02:20:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.763+0000 7f82b0900700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac157070 con 0x7f82ac0cfa90 2023-10-06T02:20:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.763+0000 7f82b0900700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac156ab0 con 0x7f82ac0d07a0 2023-10-06T02:20:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.763+0000 7f82aad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac142df0 0x7f82ac16cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.763+0000 7f82aad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac142df0 0x7f82ac16cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54642/0 (socket says 172.21.15.6:54642) 2023-10-06T02:20:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.763+0000 7f82aad9d700 1 -- 172.21.15.6:0/1923912365 learned_addr learned my addr 172.21.15.6:0/1923912365 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.763+0000 7f82aa59c700 1 --2- 172.21.15.6:0/1923912365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82ac0cfa90 0x7f82ac0cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.763+0000 7f82a9d9b700 1 --2- 172.21.15.6:0/1923912365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82ac0d07a0 0x7f82ac0b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.763+0000 7f82aad9d700 1 -- 172.21.15.6:0/1923912365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82ac0d07a0 msgr2=0x7f82ac0b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.763+0000 7f82aad9d700 1 --2- 172.21.15.6:0/1923912365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82ac0d07a0 0x7f82ac0b2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.764+0000 7f82aad9d700 1 -- 172.21.15.6:0/1923912365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82ac0cfa90 msgr2=0x7f82ac0cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.764+0000 7f82aad9d700 1 --2- 172.21.15.6:0/1923912365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82ac0cfa90 0x7f82ac0cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.764+0000 7f82aad9d700 1 -- 172.21.15.6:0/1923912365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82940094f0 con 0x7f82ac142df0 2023-10-06T02:20:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.764+0000 7f82aad9d700 1 --2- 172.21.15.6:0/1923912365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac142df0 0x7f82ac16cb40 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f829c009df0 tx=0x7f829c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.764+0000 7f82a27fc700 1 -- 172.21.15.6:0/1923912365 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c00caa0 con 0x7f82ac142df0 2023-10-06T02:20:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.764+0000 7f82a27fc700 1 -- 172.21.15.6:0/1923912365 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829c00f040 con 0x7f82ac142df0 2023-10-06T02:20:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.764+0000 7f82b0900700 1 -- 172.21.15.6:0/1923912365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ac156d90 con 0x7f82ac142df0 2023-10-06T02:20:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.764+0000 7f82a27fc700 1 -- 172.21.15.6:0/1923912365 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c00ce70 con 0x7f82ac142df0 2023-10-06T02:20:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.764+0000 7f82b0900700 1 -- 172.21.15.6:0/1923912365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82ac154460 con 0x7f82ac142df0 2023-10-06T02:20:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.765+0000 7f82b0900700 1 -- 172.21.15.6:0/1923912365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82ac088ad0 con 0x7f82ac142df0 2023-10-06T02:20:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.765+0000 7f82a27fc700 1 -- 172.21.15.6:0/1923912365 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f829c014690 con 0x7f82ac142df0 2023-10-06T02:20:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.766+0000 7f82a27fc700 1 --2- 172.21.15.6:0/1923912365 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f828c066f30 0x7f828c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:48.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.766+0000 7f82a27fc700 1 -- 172.21.15.6:0/1923912365 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f829c084c90 con 0x7f82ac142df0 2023-10-06T02:20:48.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.766+0000 7f82aa59c700 1 --2- 172.21.15.6:0/1923912365 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f828c066f30 0x7f828c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:48.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.766+0000 7f82aa59c700 1 --2- 172.21.15.6:0/1923912365 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f828c066f30 0x7f828c0693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f82ac154090 tx=0x7f82a4007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:48.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.770+0000 7f82a27fc700 1 -- 172.21.15.6:0/1923912365 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f829c055a40 con 0x7f82ac142df0 2023-10-06T02:20:48.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:48.962+0000 7f82b0900700 1 -- 172.21.15.6:0/1923912365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f82ac15a0c0 con 0x7f82ac142df0 2023-10-06T02:20:49.422 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:20:49.425 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:20:49.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.792+0000 7f82a27fc700 1 -- 172.21.15.6:0/1923912365 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v63) v1 ==== 138+0+0 (secure 0 0 0) 0x7f829c0555d0 con 0x7f82ac142df0 2023-10-06T02:20:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.796+0000 7f82b0900700 1 -- 172.21.15.6:0/1923912365 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f828c066f30 msgr2=0x7f828c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.796+0000 7f82b0900700 1 --2- 172.21.15.6:0/1923912365 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f828c066f30 0x7f828c0693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f82ac154090 tx=0x7f82a4007eb0 comp rx=0 tx=0).stop 2023-10-06T02:20:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.796+0000 7f82b0900700 1 -- 172.21.15.6:0/1923912365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac142df0 msgr2=0x7f82ac16cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.796+0000 7f82b0900700 1 --2- 172.21.15.6:0/1923912365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac142df0 0x7f82ac16cb40 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f829c009df0 tx=0x7f829c00b040 comp rx=0 tx=0).stop 2023-10-06T02:20:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.796+0000 7f82b0900700 1 -- 172.21.15.6:0/1923912365 shutdown_connections 2023-10-06T02:20:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.796+0000 7f82b0900700 1 --2- 172.21.15.6:0/1923912365 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f828c066f30 0x7f828c0693e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.796+0000 7f82b0900700 1 --2- 172.21.15.6:0/1923912365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac142df0 0x7f82ac16cb40 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.796+0000 7f82b0900700 1 --2- 172.21.15.6:0/1923912365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82ac0cfa90 0x7f82ac0cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.796+0000 7f82b0900700 1 --2- 172.21.15.6:0/1923912365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82ac0d07a0 0x7f82ac0b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.796+0000 7f82b0900700 1 -- 172.21.15.6:0/1923912365 >> 172.21.15.6:0/1923912365 conn(0x7f82ac0690f0 msgr2=0x7f82ac15af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:49.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.797+0000 7f82b0900700 1 -- 172.21.15.6:0/1923912365 shutdown_connections 2023-10-06T02:20:49.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.798+0000 7f82b0900700 1 -- 172.21.15.6:0/1923912365 wait complete. 2023-10-06T02:20:49.799 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-06T02:20:49.813 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:20:49.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.942+0000 7f5e7990e700 1 Processor -- start 2023-10-06T02:20:49.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.942+0000 7f5e7990e700 1 -- start start 2023-10-06T02:20:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.943+0000 7f5e7990e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5e740a7760 0x7f5e74069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.943+0000 7f5e7990e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e740ac8d0 con 0x7f5e74068d90 2023-10-06T02:20:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.943+0000 7f5e7990e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e740b2510 con 0x7f5e740a7b30 2023-10-06T02:20:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.943+0000 7f5e7990e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e740b2330 con 0x7f5e740a7760 2023-10-06T02:20:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.943+0000 7f5e737fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5e74068d90 0x7f5e740acd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52278/0 (socket says 172.21.15.6:52278) 2023-10-06T02:20:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.943+0000 7f5e737fe700 1 -- 172.21.15.6:0/3664826819 learned_addr learned my addr 172.21.15.6:0/3664826819 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.943+0000 7f5e72ffd700 1 --2- 172.21.15.6:0/3664826819 >> v2:172.21.15.175:3300/0 conn(0x7f5e740a7760 0x7f5e74069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.943+0000 7f5e71ffb700 1 -- 172.21.15.6:0/3664826819 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 821794667 0 0) 0x7f5e740ac8d0 con 0x7f5e74068d90 2023-10-06T02:20:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.943+0000 7f5e71ffb700 1 -- 172.21.15.6:0/3664826819 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e5c003570 con 0x7f5e74068d90 2023-10-06T02:20:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.943+0000 7f5e71ffb700 1 -- 172.21.15.6:0/3664826819 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1721741549 0 0) 0x7f5e5c003570 con 0x7f5e74068d90 2023-10-06T02:20:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.943+0000 7f5e72ffd700 1 -- 172.21.15.6:0/3664826819 >> v1:172.21.15.175:6789/0 conn(0x7f5e740a7b30 legacy=0x7f5e74068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.944+0000 7f5e72ffd700 1 -- 172.21.15.6:0/3664826819 >> v1:172.21.15.6:6789/0 conn(0x7f5e74068d90 legacy=0x7f5e740acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.944+0000 7f5e72ffd700 1 -- 172.21.15.6:0/3664826819 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e740b27f0 con 0x7f5e740a7760 2023-10-06T02:20:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.944+0000 7f5e72ffd700 1 --2- 172.21.15.6:0/3664826819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e740a7760 0x7f5e74069f70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5e640098d0 tx=0x7f5e64009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38c4b29d9042f78e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.944+0000 7f5e71ffb700 1 -- 172.21.15.6:0/3664826819 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0017f0 con 0x7f5e740a7760 2023-10-06T02:20:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.944+0000 7f5e71ffb700 1 -- 172.21.15.6:0/3664826819 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e64011420 con 0x7f5e740a7760 2023-10-06T02:20:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.944+0000 7f5e71ffb700 1 -- 172.21.15.6:0/3664826819 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e640117a0 con 0x7f5e740a7760 2023-10-06T02:20:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.944+0000 7f5e7990e700 1 -- 172.21.15.6:0/3664826819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e740a7760 msgr2=0x7f5e74069f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.944+0000 7f5e7990e700 1 --2- 172.21.15.6:0/3664826819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e740a7760 0x7f5e74069f70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5e640098d0 tx=0x7f5e64009120 comp rx=0 tx=0).stop 2023-10-06T02:20:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.944+0000 7f5e7990e700 1 -- 172.21.15.6:0/3664826819 shutdown_connections 2023-10-06T02:20:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.944+0000 7f5e7990e700 1 --2- 172.21.15.6:0/3664826819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e740a7760 0x7f5e74069f70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.944+0000 7f5e7990e700 1 -- 172.21.15.6:0/3664826819 >> 172.21.15.6:0/3664826819 conn(0x7f5e74086ff0 msgr2=0x7f5e740963c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.945+0000 7f5e7990e700 1 -- 172.21.15.6:0/3664826819 shutdown_connections 2023-10-06T02:20:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.945+0000 7f5e7990e700 1 -- 172.21.15.6:0/3664826819 wait complete. 2023-10-06T02:20:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.946+0000 7f5e7990e700 1 Processor -- start 2023-10-06T02:20:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.946+0000 7f5e7990e700 1 -- start start 2023-10-06T02:20:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.946+0000 7f5e7990e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e74068d90 0x7f5e7416b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.946+0000 7f5e7990e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e740a7760 0x7f5e74156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.946+0000 7f5e7990e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e740a7b30 0x7f5e74156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.946+0000 7f5e7990e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74157590 con 0x7f5e740a7b30 2023-10-06T02:20:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.946+0000 7f5e7990e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e741577e0 con 0x7f5e74068d90 2023-10-06T02:20:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.946+0000 7f5e7990e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74157ac0 con 0x7f5e740a7760 2023-10-06T02:20:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.947+0000 7f5e737fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e740a7b30 0x7f5e74156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.947+0000 7f5e737fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e740a7b30 0x7f5e74156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54656/0 (socket says 172.21.15.6:54656) 2023-10-06T02:20:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.947+0000 7f5e737fe700 1 -- 172.21.15.6:0/102725263 learned_addr learned my addr 172.21.15.6:0/102725263 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.947+0000 7f5e72ffd700 1 --2- 172.21.15.6:0/102725263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e74068d90 0x7f5e7416b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.947+0000 7f5e727fc700 1 --2- 172.21.15.6:0/102725263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e740a7760 0x7f5e74156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.947+0000 7f5e737fe700 1 -- 172.21.15.6:0/102725263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e740a7760 msgr2=0x7f5e74156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.947+0000 7f5e737fe700 1 --2- 172.21.15.6:0/102725263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e740a7760 0x7f5e74156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.947+0000 7f5e737fe700 1 -- 172.21.15.6:0/102725263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e74068d90 msgr2=0x7f5e7416b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.947+0000 7f5e737fe700 1 --2- 172.21.15.6:0/102725263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e74068d90 0x7f5e7416b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.947+0000 7f5e737fe700 1 -- 172.21.15.6:0/102725263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e640093c0 con 0x7f5e740a7b30 2023-10-06T02:20:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.947+0000 7f5e72ffd700 1 --2- 172.21.15.6:0/102725263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e74068d90 0x7f5e7416b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.947+0000 7f5e737fe700 1 --2- 172.21.15.6:0/102725263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e740a7b30 0x7f5e74156760 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00cb90 tx=0x7f5e6c007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.947+0000 7f5e5affd700 1 -- 172.21.15.6:0/102725263 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c004dc0 con 0x7f5e740a7b30 2023-10-06T02:20:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.947+0000 7f5e5affd700 1 -- 172.21.15.6:0/102725263 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c00a660 con 0x7f5e740a7b30 2023-10-06T02:20:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.947+0000 7f5e5affd700 1 -- 172.21.15.6:0/102725263 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c00aa20 con 0x7f5e740a7b30 2023-10-06T02:20:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.947+0000 7f5e7990e700 1 -- 172.21.15.6:0/102725263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e74157da0 con 0x7f5e740a7b30 2023-10-06T02:20:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.947+0000 7f5e7990e700 1 -- 172.21.15.6:0/102725263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e74158360 con 0x7f5e740a7b30 2023-10-06T02:20:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.948+0000 7f5e7990e700 1 -- 172.21.15.6:0/102725263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e74158580 con 0x7f5e740a7b30 2023-10-06T02:20:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.949+0000 7f5e5affd700 1 -- 172.21.15.6:0/102725263 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e6c007150 con 0x7f5e740a7b30 2023-10-06T02:20:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.949+0000 7f5e5affd700 1 --2- 172.21.15.6:0/102725263 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5e60066f30 0x7f5e600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.950+0000 7f5e5affd700 1 -- 172.21.15.6:0/102725263 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f5e6c083d70 con 0x7f5e740a7b30 2023-10-06T02:20:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.950+0000 7f5e72ffd700 1 --2- 172.21.15.6:0/102725263 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5e60066f30 0x7f5e600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.950+0000 7f5e72ffd700 1 --2- 172.21.15.6:0/102725263 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5e60066f30 0x7f5e600693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5e640098d0 tx=0x7f5e64017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:49.954+0000 7f5e5affd700 1 -- 172.21.15.6:0/102725263 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e6c050f20 con 0x7f5e740a7b30 2023-10-06T02:20:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.147+0000 7f5e7990e700 1 -- 172.21.15.6:0/102725263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5e7406d7e0 con 0x7f5e740a7b30 2023-10-06T02:20:50.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.799+0000 7f5e5affd700 1 -- 172.21.15.6:0/102725263 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v64) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5e6c018020 con 0x7f5e740a7b30 2023-10-06T02:20:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.803+0000 7f5e7990e700 1 -- 172.21.15.6:0/102725263 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5e60066f30 msgr2=0x7f5e600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.803+0000 7f5e7990e700 1 --2- 172.21.15.6:0/102725263 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5e60066f30 0x7f5e600693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5e640098d0 tx=0x7f5e64017000 comp rx=0 tx=0).stop 2023-10-06T02:20:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.803+0000 7f5e7990e700 1 -- 172.21.15.6:0/102725263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e740a7b30 msgr2=0x7f5e74156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.803+0000 7f5e7990e700 1 --2- 172.21.15.6:0/102725263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e740a7b30 0x7f5e74156760 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00cb90 tx=0x7f5e6c007c70 comp rx=0 tx=0).stop 2023-10-06T02:20:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.804+0000 7f5e7990e700 1 -- 172.21.15.6:0/102725263 shutdown_connections 2023-10-06T02:20:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.804+0000 7f5e7990e700 1 --2- 172.21.15.6:0/102725263 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5e60066f30 0x7f5e600693e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.804+0000 7f5e7990e700 1 --2- 172.21.15.6:0/102725263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e740a7b30 0x7f5e74156760 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.804+0000 7f5e7990e700 1 --2- 172.21.15.6:0/102725263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e74068d90 0x7f5e7416b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.804+0000 7f5e7990e700 1 --2- 172.21.15.6:0/102725263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e740a7760 0x7f5e74156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:50.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.804+0000 7f5e7990e700 1 -- 172.21.15.6:0/102725263 >> 172.21.15.6:0/102725263 conn(0x7f5e74086ff0 msgr2=0x7f5e74068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:50.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.805+0000 7f5e7990e700 1 -- 172.21.15.6:0/102725263 shutdown_connections 2023-10-06T02:20:50.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.805+0000 7f5e7990e700 1 -- 172.21.15.6:0/102725263 wait complete. 2023-10-06T02:20:50.806 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-06T02:20:50.829 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:20:50.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.956+0000 7f2cfbfbf700 1 Processor -- start 2023-10-06T02:20:50.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.956+0000 7f2cfbfbf700 1 -- start start 2023-10-06T02:20:50.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.957+0000 7f2cfbfbf700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2cf40cc370 0x7f2cf406a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:50.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.957+0000 7f2cfbfbf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf40b4e20 con 0x7f2cf40ccd20 2023-10-06T02:20:50.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.957+0000 7f2cfbfbf700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf40b4570 con 0x7f2cf4159190 2023-10-06T02:20:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.957+0000 7f2cfbfbf700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf40cd5a0 con 0x7f2cf40cc370 2023-10-06T02:20:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.957+0000 7f2cfa55c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2cf40ccd20 0x7f2cf40b52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52284/0 (socket says 172.21.15.6:52284) 2023-10-06T02:20:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.957+0000 7f2cfa55c700 1 -- 172.21.15.6:0/810354474 learned_addr learned my addr 172.21.15.6:0/810354474 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.957+0000 7f2cf955a700 1 --2- 172.21.15.6:0/810354474 >> v2:172.21.15.175:3300/0 conn(0x7f2cf40cc370 0x7f2cf406a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.957+0000 7f2cf8d59700 1 -- 172.21.15.6:0/810354474 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167346292 0 0) 0x7f2cf40b4e20 con 0x7f2cf40ccd20 2023-10-06T02:20:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.957+0000 7f2cf8d59700 1 -- 172.21.15.6:0/810354474 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ce0003570 con 0x7f2cf40ccd20 2023-10-06T02:20:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.958+0000 7f2cf8d59700 1 -- 172.21.15.6:0/810354474 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238858651 0 0) 0x7f2cf40b4570 con 0x7f2cf4159190 2023-10-06T02:20:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.958+0000 7f2cf8d59700 1 -- 172.21.15.6:0/810354474 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cf40b4e20 con 0x7f2cf4159190 2023-10-06T02:20:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.958+0000 7f2cf8d59700 1 -- 172.21.15.6:0/810354474 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1486798867 0 0) 0x7f2ce0003570 con 0x7f2cf40ccd20 2023-10-06T02:20:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.958+0000 7f2cf955a700 1 -- 172.21.15.6:0/810354474 >> v1:172.21.15.175:6789/0 conn(0x7f2cf4159190 legacy=0x7f2cf40ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.958+0000 7f2cf955a700 1 -- 172.21.15.6:0/810354474 >> v1:172.21.15.6:6789/0 conn(0x7f2cf40ccd20 legacy=0x7f2cf40b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.958+0000 7f2cf955a700 1 -- 172.21.15.6:0/810354474 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf40cd2c0 con 0x7f2cf40cc370 2023-10-06T02:20:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.958+0000 7f2cf955a700 1 --2- 172.21.15.6:0/810354474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cf40cc370 0x7f2cf406a1f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40098e0 tx=0x7f2ce40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca79b6c1cfb7389c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.958+0000 7f2cf8d59700 1 -- 172.21.15.6:0/810354474 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0017f0 con 0x7f2cf40cc370 2023-10-06T02:20:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.958+0000 7f2cf8d59700 1 -- 172.21.15.6:0/810354474 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce4011420 con 0x7f2cf40cc370 2023-10-06T02:20:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.958+0000 7f2cf8d59700 1 -- 172.21.15.6:0/810354474 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce40117a0 con 0x7f2cf40cc370 2023-10-06T02:20:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.958+0000 7f2cfbfbf700 1 -- 172.21.15.6:0/810354474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cf40cc370 msgr2=0x7f2cf406a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.958+0000 7f2cfbfbf700 1 --2- 172.21.15.6:0/810354474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cf40cc370 0x7f2cf406a1f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40098e0 tx=0x7f2ce40091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.959+0000 7f2cfbfbf700 1 -- 172.21.15.6:0/810354474 shutdown_connections 2023-10-06T02:20:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.959+0000 7f2cfbfbf700 1 --2- 172.21.15.6:0/810354474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cf40cc370 0x7f2cf406a1f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.959+0000 7f2cfbfbf700 1 -- 172.21.15.6:0/810354474 >> 172.21.15.6:0/810354474 conn(0x7f2cf4087340 msgr2=0x7f2cf4087710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.959+0000 7f2cfbfbf700 1 -- 172.21.15.6:0/810354474 shutdown_connections 2023-10-06T02:20:50.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.959+0000 7f2cfbfbf700 1 -- 172.21.15.6:0/810354474 wait complete. 2023-10-06T02:20:50.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.960+0000 7f2cfbfbf700 1 Processor -- start 2023-10-06T02:20:50.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.960+0000 7f2cfbfbf700 1 -- start start 2023-10-06T02:20:50.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.960+0000 7f2cfbfbf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cf40cc370 0x7f2cf414af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cfbfbf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2cf40ccd20 0x7f2cf415cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cfbfbf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cf4159190 0x7f2cf40b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cfbfbf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf414b450 con 0x7f2cf40cc370 2023-10-06T02:20:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cfbfbf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf415b100 con 0x7f2cf4159190 2023-10-06T02:20:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cfbfbf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf416cf70 con 0x7f2cf40ccd20 2023-10-06T02:20:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cf9d5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cf40cc370 0x7f2cf414af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cf9d5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cf40cc370 0x7f2cf414af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54664/0 (socket says 172.21.15.6:54664) 2023-10-06T02:20:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cf9d5b700 1 -- 172.21.15.6:0/1328237494 learned_addr learned my addr 172.21.15.6:0/1328237494 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cfa55c700 1 --2- 172.21.15.6:0/1328237494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cf4159190 0x7f2cf40b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cf955a700 1 --2- 172.21.15.6:0/1328237494 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2cf40ccd20 0x7f2cf415cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cf9d5b700 1 -- 172.21.15.6:0/1328237494 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2cf40ccd20 msgr2=0x7f2cf415cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:50.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cf9d5b700 1 --2- 172.21.15.6:0/1328237494 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2cf40ccd20 0x7f2cf415cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:50.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cf9d5b700 1 -- 172.21.15.6:0/1328237494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cf4159190 msgr2=0x7f2cf40b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:50.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cf9d5b700 1 --2- 172.21.15.6:0/1328237494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cf4159190 0x7f2cf40b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:50.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cf9d5b700 1 -- 172.21.15.6:0/1328237494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce4009420 con 0x7f2cf40cc370 2023-10-06T02:20:50.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cf955a700 1 --2- 172.21.15.6:0/1328237494 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2cf40ccd20 0x7f2cf415cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:50.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cf9d5b700 1 --2- 172.21.15.6:0/1328237494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cf40cc370 0x7f2cf414af10 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000c790 tx=0x7f2cf0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:50.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2ce9ffb700 1 -- 172.21.15.6:0/1328237494 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0010510 con 0x7f2cf40cc370 2023-10-06T02:20:50.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2ce9ffb700 1 -- 172.21.15.6:0/1328237494 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf0010670 con 0x7f2cf40cc370 2023-10-06T02:20:50.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2ce9ffb700 1 -- 172.21.15.6:0/1328237494 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0010a30 con 0x7f2cf40cc370 2023-10-06T02:20:50.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.961+0000 7f2cfbfbf700 1 -- 172.21.15.6:0/1328237494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf416d1c0 con 0x7f2cf40cc370 2023-10-06T02:20:50.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.962+0000 7f2cfbfbf700 1 -- 172.21.15.6:0/1328237494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf416d780 con 0x7f2cf40cc370 2023-10-06T02:20:50.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.963+0000 7f2cfbfbf700 1 -- 172.21.15.6:0/1328237494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf4088a20 con 0x7f2cf40cc370 2023-10-06T02:20:50.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.963+0000 7f2ce9ffb700 1 -- 172.21.15.6:0/1328237494 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2cf001b3b0 con 0x7f2cf40cc370 2023-10-06T02:20:50.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.963+0000 7f2ce9ffb700 1 --2- 172.21.15.6:0/1328237494 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2cd8066f30 0x7f2cd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:50.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.963+0000 7f2ce9ffb700 1 -- 172.21.15.6:0/1328237494 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f2cf0084090 con 0x7f2cf40cc370 2023-10-06T02:20:50.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.964+0000 7f2cf955a700 1 --2- 172.21.15.6:0/1328237494 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2cd8066f30 0x7f2cd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:50.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.964+0000 7f2cf955a700 1 --2- 172.21.15.6:0/1328237494 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2cd8066f30 0x7f2cd80693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40093f0 tx=0x7f2ce4016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:50.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:50.968+0000 7f2ce9ffb700 1 -- 172.21.15.6:0/1328237494 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2cf00510c0 con 0x7f2cf40cc370 2023-10-06T02:20:51.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.205+0000 7f2cfbfbf700 1 -- 172.21.15.6:0/1328237494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2cf40b47d0 con 0x7f2cf40cc370 2023-10-06T02:20:51.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.801+0000 7f2ce9ffb700 1 -- 172.21.15.6:0/1328237494 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v45) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2cf00170c0 con 0x7f2cf40cc370 2023-10-06T02:20:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.806+0000 7f2cfbfbf700 1 -- 172.21.15.6:0/1328237494 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2cd8066f30 msgr2=0x7f2cd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.806+0000 7f2cfbfbf700 1 --2- 172.21.15.6:0/1328237494 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2cd8066f30 0x7f2cd80693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40093f0 tx=0x7f2ce4016000 comp rx=0 tx=0).stop 2023-10-06T02:20:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.806+0000 7f2cfbfbf700 1 -- 172.21.15.6:0/1328237494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cf40cc370 msgr2=0x7f2cf414af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.806+0000 7f2cfbfbf700 1 --2- 172.21.15.6:0/1328237494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cf40cc370 0x7f2cf414af10 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000c790 tx=0x7f2cf0007e10 comp rx=0 tx=0).stop 2023-10-06T02:20:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.806+0000 7f2cfbfbf700 1 -- 172.21.15.6:0/1328237494 shutdown_connections 2023-10-06T02:20:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.806+0000 7f2cfbfbf700 1 --2- 172.21.15.6:0/1328237494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cf4159190 0x7f2cf40b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.806+0000 7f2cfbfbf700 1 --2- 172.21.15.6:0/1328237494 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2cd8066f30 0x7f2cd80693e0 secure :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40093f0 tx=0x7f2ce4016000 comp rx=0 tx=0).stop 2023-10-06T02:20:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.806+0000 7f2cfbfbf700 1 --2- 172.21.15.6:0/1328237494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cf40cc370 0x7f2cf414af10 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.806+0000 7f2cfbfbf700 1 --2- 172.21.15.6:0/1328237494 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2cf40ccd20 0x7f2cf415cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.806+0000 7f2cfbfbf700 1 -- 172.21.15.6:0/1328237494 >> 172.21.15.6:0/1328237494 conn(0x7f2cf4087340 msgr2=0x7f2cf41535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.806+0000 7f2cfbfbf700 1 -- 172.21.15.6:0/1328237494 shutdown_connections 2023-10-06T02:20:51.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.807+0000 7f2cfbfbf700 1 -- 172.21.15.6:0/1328237494 wait complete. 2023-10-06T02:20:51.808 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 10 and data pool 11 2023-10-06T02:20:51.836 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:20:51.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.957+0000 7f0165ca2700 1 Processor -- start 2023-10-06T02:20:51.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.957+0000 7f0165ca2700 1 -- start start 2023-10-06T02:20:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.958+0000 7f0165ca2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01600af4e0 0x7f01600b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.958+0000 7f0165ca2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f016015db70 0x7f01600b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.958+0000 7f0165ca2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016015e190 con 0x7f01600af8b0 2023-10-06T02:20:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.958+0000 7f0165ca2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01600b1910 con 0x7f016015db70 2023-10-06T02:20:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.958+0000 7f0165ca2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016015dfb0 con 0x7f01600af4e0 2023-10-06T02:20:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.958+0000 7f015f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01600af4e0 0x7f01600b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.958+0000 7f015f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01600af4e0 0x7f01600b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:44850/0 (socket says 172.21.15.6:44850) 2023-10-06T02:20:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.958+0000 7f015ffff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f016015db70 0x7f01600b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.958+0000 7f015f7fe700 1 -- 172.21.15.6:0/467683543 learned_addr learned my addr 172.21.15.6:0/467683543 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.959+0000 7f015f7fe700 1 -- 172.21.15.6:0/467683543 >> v2:172.21.15.175:3300/0 conn(0x7f016015db70 msgr2=0x7f01600b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.959+0000 7f015f7fe700 1 --2- 172.21.15.6:0/467683543 >> v2:172.21.15.175:3300/0 conn(0x7f016015db70 0x7f01600b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.959+0000 7f015f7fe700 1 -- 172.21.15.6:0/467683543 >> v1:172.21.15.175:6789/0 conn(0x7f01600af8b0 legacy=0x7f016015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.959+0000 7f015f7fe700 1 -- 172.21.15.6:0/467683543 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01600cb650 con 0x7f01600af4e0 2023-10-06T02:20:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.959+0000 7f015ffff700 1 --2- 172.21.15.6:0/467683543 >> v2:172.21.15.175:3300/0 conn(0x7f016015db70 0x7f01600b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:20:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.959+0000 7f015f7fe700 1 --2- 172.21.15.6:0/467683543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01600af4e0 0x7f01600b20e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f01500099b0 tx=0x7f0150009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11ab3a623a5f9bc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.959+0000 7f015e7fc700 1 -- 172.21.15.6:0/467683543 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0150009ea0 con 0x7f01600af4e0 2023-10-06T02:20:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.959+0000 7f015e7fc700 1 -- 172.21.15.6:0/467683543 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015000b860 con 0x7f01600af4e0 2023-10-06T02:20:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.959+0000 7f015e7fc700 1 -- 172.21.15.6:0/467683543 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015000bc00 con 0x7f01600af4e0 2023-10-06T02:20:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.960+0000 7f0165ca2700 1 -- 172.21.15.6:0/467683543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01600af4e0 msgr2=0x7f01600b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.960+0000 7f0165ca2700 1 --2- 172.21.15.6:0/467683543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01600af4e0 0x7f01600b20e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f01500099b0 tx=0x7f0150009250 comp rx=0 tx=0).stop 2023-10-06T02:20:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.960+0000 7f0165ca2700 1 -- 172.21.15.6:0/467683543 shutdown_connections 2023-10-06T02:20:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.960+0000 7f0165ca2700 1 --2- 172.21.15.6:0/467683543 >> v2:172.21.15.175:3300/0 conn(0x7f016015db70 0x7f01600b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.960+0000 7f0165ca2700 1 --2- 172.21.15.6:0/467683543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01600af4e0 0x7f01600b20e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.960+0000 7f0165ca2700 1 -- 172.21.15.6:0/467683543 >> 172.21.15.6:0/467683543 conn(0x7f0160068680 msgr2=0x7f0160068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.960+0000 7f0165ca2700 1 -- 172.21.15.6:0/467683543 shutdown_connections 2023-10-06T02:20:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.960+0000 7f0165ca2700 1 -- 172.21.15.6:0/467683543 wait complete. 2023-10-06T02:20:51.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.961+0000 7f0165ca2700 1 Processor -- start 2023-10-06T02:20:51.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.961+0000 7f0165ca2700 1 -- start start 2023-10-06T02:20:51.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f0165ca2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01600af4e0 0x7f016016cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:51.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f0165ca2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01600af8b0 0x7f016016a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:51.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f0165ca2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f016015db70 0x7f01600a76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:51.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f0165ca2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01600b5b70 con 0x7f01600af8b0 2023-10-06T02:20:51.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f0165ca2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01600b3de0 con 0x7f016015db70 2023-10-06T02:20:51.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f0165ca2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01600b31d0 con 0x7f01600af4e0 2023-10-06T02:20:51.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f015effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01600af8b0 0x7f016016a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:51.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f015f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01600af4e0 0x7f016016cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:51.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f015ffff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f016015db70 0x7f01600a76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:51.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f015effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01600af8b0 0x7f016016a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54676/0 (socket says 172.21.15.6:54676) 2023-10-06T02:20:51.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f015effd700 1 -- 172.21.15.6:0/1369614509 learned_addr learned my addr 172.21.15.6:0/1369614509 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:51.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f015f7fe700 1 -- 172.21.15.6:0/1369614509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f016015db70 msgr2=0x7f01600a76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:51.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f015f7fe700 1 --2- 172.21.15.6:0/1369614509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f016015db70 0x7f01600a76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:51.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f015f7fe700 1 -- 172.21.15.6:0/1369614509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01600af8b0 msgr2=0x7f016016a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:51.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f015f7fe700 1 --2- 172.21.15.6:0/1369614509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01600af8b0 0x7f016016a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:51.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f015f7fe700 1 -- 172.21.15.6:0/1369614509 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0158009a20 con 0x7f01600af4e0 2023-10-06T02:20:51.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f015effd700 1 --2- 172.21.15.6:0/1369614509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01600af8b0 0x7f016016a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:20:51.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f015ffff700 1 --2- 172.21.15.6:0/1369614509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f016015db70 0x7f01600a76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:20:51.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.962+0000 7f015f7fe700 1 --2- 172.21.15.6:0/1369614509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01600af4e0 0x7f016016cde0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f016006b140 tx=0x7f0150017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:51.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.963+0000 7f01477fe700 1 -- 172.21.15.6:0/1369614509 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015000bbe0 con 0x7f01600af4e0 2023-10-06T02:20:51.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.963+0000 7f01477fe700 1 -- 172.21.15.6:0/1369614509 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0150011420 con 0x7f01600af4e0 2023-10-06T02:20:51.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.963+0000 7f0165ca2700 1 -- 172.21.15.6:0/1369614509 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01500094f0 con 0x7f01600af4e0 2023-10-06T02:20:51.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.963+0000 7f01477fe700 1 -- 172.21.15.6:0/1369614509 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01500117c0 con 0x7f01600af4e0 2023-10-06T02:20:51.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.963+0000 7f0165ca2700 1 -- 172.21.15.6:0/1369614509 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01600b3790 con 0x7f01600af4e0 2023-10-06T02:20:51.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.963+0000 7f0165ca2700 1 -- 172.21.15.6:0/1369614509 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0160088aa0 con 0x7f01600af4e0 2023-10-06T02:20:51.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.964+0000 7f01477fe700 1 -- 172.21.15.6:0/1369614509 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0150011bf0 con 0x7f01600af4e0 2023-10-06T02:20:51.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.965+0000 7f01477fe700 1 --2- 172.21.15.6:0/1369614509 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f014c066fb0 0x7f014c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:51.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.965+0000 7f01477fe700 1 -- 172.21.15.6:0/1369614509 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0150085b00 con 0x7f01600af4e0 2023-10-06T02:20:51.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.965+0000 7f015effd700 1 --2- 172.21.15.6:0/1369614509 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f014c066fb0 0x7f014c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:51.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.965+0000 7f015effd700 1 --2- 172.21.15.6:0/1369614509 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f014c066fb0 0x7f014c069460 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f01600b5220 tx=0x7f0154009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:51.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:51.968+0000 7f01477fe700 1 -- 172.21.15.6:0/1369614509 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0150052ca0 con 0x7f01600af4e0 2023-10-06T02:20:52.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.165+0000 7f0165ca2700 1 -- 172.21.15.6:0/1369614509 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01600b0910 con 0x7f01600af4e0 2023-10-06T02:20:52.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.166+0000 7f01477fe700 1 -- 172.21.15.6:0/1369614509 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+17039 (secure 0 0 0) 0x7f01500562c0 con 0x7f01600af4e0 2023-10-06T02:20:52.167 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:52.167 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":65,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:20:51.206396+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:20:48.992600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T02:20:50.177537+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:20:52.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.168+0000 7f0165ca2700 1 -- 172.21.15.6:0/1369614509 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f014c066fb0 msgr2=0x7f014c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:52.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.168+0000 7f0165ca2700 1 --2- 172.21.15.6:0/1369614509 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f014c066fb0 0x7f014c069460 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f01600b5220 tx=0x7f0154009040 comp rx=0 tx=0).stop 2023-10-06T02:20:52.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.168+0000 7f0165ca2700 1 -- 172.21.15.6:0/1369614509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01600af4e0 msgr2=0x7f016016cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:52.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.168+0000 7f0165ca2700 1 --2- 172.21.15.6:0/1369614509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01600af4e0 0x7f016016cde0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f016006b140 tx=0x7f0150017000 comp rx=0 tx=0).stop 2023-10-06T02:20:52.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.168+0000 7f0165ca2700 1 -- 172.21.15.6:0/1369614509 shutdown_connections 2023-10-06T02:20:52.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.168+0000 7f0165ca2700 1 --2- 172.21.15.6:0/1369614509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f016015db70 0x7f01600a76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.168+0000 7f0165ca2700 1 --2- 172.21.15.6:0/1369614509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01600af4e0 0x7f016016cde0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.168+0000 7f0165ca2700 1 --2- 172.21.15.6:0/1369614509 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f014c066fb0 0x7f014c069460 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.168+0000 7f0165ca2700 1 --2- 172.21.15.6:0/1369614509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01600af8b0 0x7f016016a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.168+0000 7f0165ca2700 1 -- 172.21.15.6:0/1369614509 >> 172.21.15.6:0/1369614509 conn(0x7f0160068680 msgr2=0x7f01600cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:52.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.168+0000 7f0165ca2700 1 -- 172.21.15.6:0/1369614509 shutdown_connections 2023-10-06T02:20:52.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.168+0000 7f0165ca2700 1 -- 172.21.15.6:0/1369614509 wait complete. 2023-10-06T02:20:52.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:20:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.300+0000 7f2221cc2700 1 Processor -- start 2023-10-06T02:20:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.300+0000 7f2221cc2700 1 -- start start 2023-10-06T02:20:52.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.301+0000 7f2221cc2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f221c159400 0x7f221c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.301+0000 7f2221cc2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f221c0d05d0 0x7f221c0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.301+0000 7f2221cc2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221c0b3560 con 0x7f221c0cd030 2023-10-06T02:20:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.301+0000 7f2221cc2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221c0cf6f0 con 0x7f221c159400 2023-10-06T02:20:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.301+0000 7f2221cc2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221c0cf9d0 con 0x7f221c0d05d0 2023-10-06T02:20:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.301+0000 7f2220cc0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f221c159400 0x7f221c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.301+0000 7f2220cc0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f221c159400 0x7f221c0ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54686/0 (socket says 172.21.15.6:54686) 2023-10-06T02:20:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.301+0000 7f2220cc0700 1 -- 172.21.15.6:0/3014735376 learned_addr learned my addr 172.21.15.6:0/3014735376 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.301+0000 7f22214c1700 1 --2- 172.21.15.6:0/3014735376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f221c0d05d0 0x7f221c0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.301+0000 7f2220cc0700 1 -- 172.21.15.6:0/3014735376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f221c0d05d0 msgr2=0x7f221c0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.301+0000 7f2220cc0700 1 --2- 172.21.15.6:0/3014735376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f221c0d05d0 0x7f221c0b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.301+0000 7f2220cc0700 1 -- 172.21.15.6:0/3014735376 >> v1:172.21.15.175:6789/0 conn(0x7f221c0cd030 legacy=0x7f221c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.301+0000 7f2220cc0700 1 -- 172.21.15.6:0/3014735376 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c0b2f10 con 0x7f221c159400 2023-10-06T02:20:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.301+0000 7f22214c1700 1 --2- 172.21.15.6:0/3014735376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f221c0d05d0 0x7f221c0b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.302+0000 7f2220cc0700 1 --2- 172.21.15.6:0/3014735376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221c159400 0x7f221c0ccaf0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2214009f70 tx=0x7f2214009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cff5dc2eecd38f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.302+0000 7f221b7fe700 1 -- 172.21.15.6:0/3014735376 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221400e070 con 0x7f221c159400 2023-10-06T02:20:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.302+0000 7f221b7fe700 1 -- 172.21.15.6:0/3014735376 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221400bad0 con 0x7f221c159400 2023-10-06T02:20:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.302+0000 7f221b7fe700 1 -- 172.21.15.6:0/3014735376 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140092e0 con 0x7f221c159400 2023-10-06T02:20:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.302+0000 7f2221cc2700 1 -- 172.21.15.6:0/3014735376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221c159400 msgr2=0x7f221c0ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.302+0000 7f2221cc2700 1 --2- 172.21.15.6:0/3014735376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221c159400 0x7f221c0ccaf0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2214009f70 tx=0x7f2214009840 comp rx=0 tx=0).stop 2023-10-06T02:20:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.302+0000 7f2221cc2700 1 -- 172.21.15.6:0/3014735376 shutdown_connections 2023-10-06T02:20:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.302+0000 7f2221cc2700 1 --2- 172.21.15.6:0/3014735376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f221c0d05d0 0x7f221c0b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.302+0000 7f2221cc2700 1 --2- 172.21.15.6:0/3014735376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221c159400 0x7f221c0ccaf0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.302+0000 7f2221cc2700 1 -- 172.21.15.6:0/3014735376 >> 172.21.15.6:0/3014735376 conn(0x7f221c06ac10 msgr2=0x7f221c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.302+0000 7f2221cc2700 1 -- 172.21.15.6:0/3014735376 shutdown_connections 2023-10-06T02:20:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.302+0000 7f2221cc2700 1 -- 172.21.15.6:0/3014735376 wait complete. 2023-10-06T02:20:52.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.303+0000 7f2221cc2700 1 Processor -- start 2023-10-06T02:20:52.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.304+0000 7f2221cc2700 1 -- start start 2023-10-06T02:20:52.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.304+0000 7f2221cc2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221c0cd030 0x7f221c0aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:52.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.304+0000 7f2221cc2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f221c0d05d0 0x7f221c169d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:52.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.304+0000 7f2221cc2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f221c159400 0x7f221c0c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:52.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.304+0000 7f2221cc2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c0c5260 con 0x7f221c0cd030 2023-10-06T02:20:52.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.304+0000 7f2221cc2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c16a690 con 0x7f221c159400 2023-10-06T02:20:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.304+0000 7f2221cc2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221c16a970 con 0x7f221c0d05d0 2023-10-06T02:20:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.305+0000 7f2220cc0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221c0cd030 0x7f221c0aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.305+0000 7f2220cc0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221c0cd030 0x7f221c0aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54700/0 (socket says 172.21.15.6:54700) 2023-10-06T02:20:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.305+0000 7f2220cc0700 1 -- 172.21.15.6:0/3300188731 learned_addr learned my addr 172.21.15.6:0/3300188731 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.305+0000 7f22214c1700 1 --2- 172.21.15.6:0/3300188731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f221c159400 0x7f221c0c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.305+0000 7f221bfff700 1 --2- 172.21.15.6:0/3300188731 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f221c0d05d0 0x7f221c169d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.305+0000 7f2220cc0700 1 -- 172.21.15.6:0/3300188731 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f221c0d05d0 msgr2=0x7f221c169d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.305+0000 7f2220cc0700 1 --2- 172.21.15.6:0/3300188731 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f221c0d05d0 0x7f221c169d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.305+0000 7f2220cc0700 1 -- 172.21.15.6:0/3300188731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f221c159400 msgr2=0x7f221c0c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.305+0000 7f2220cc0700 1 --2- 172.21.15.6:0/3300188731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f221c159400 0x7f221c0c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.305+0000 7f2220cc0700 1 -- 172.21.15.6:0/3300188731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2214009ae0 con 0x7f221c0cd030 2023-10-06T02:20:52.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.305+0000 7f2220cc0700 1 --2- 172.21.15.6:0/3300188731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221c0cd030 0x7f221c0aef70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f221400b770 tx=0x7f2214018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:52.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.305+0000 7f2218ff9700 1 -- 172.21.15.6:0/3300188731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2214008ac0 con 0x7f221c0cd030 2023-10-06T02:20:52.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.305+0000 7f2218ff9700 1 -- 172.21.15.6:0/3300188731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2214008c20 con 0x7f221c0cd030 2023-10-06T02:20:52.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.305+0000 7f2221cc2700 1 -- 172.21.15.6:0/3300188731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221c16ac50 con 0x7f221c0cd030 2023-10-06T02:20:52.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.305+0000 7f2218ff9700 1 -- 172.21.15.6:0/3300188731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2214025460 con 0x7f221c0cd030 2023-10-06T02:20:52.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.305+0000 7f2221cc2700 1 -- 172.21.15.6:0/3300188731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c0af4b0 con 0x7f221c0cd030 2023-10-06T02:20:52.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.306+0000 7f2221cc2700 1 -- 172.21.15.6:0/3300188731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221c0cf230 con 0x7f221c0cd030 2023-10-06T02:20:52.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.307+0000 7f2218ff9700 1 -- 172.21.15.6:0/3300188731 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2214003040 con 0x7f221c0cd030 2023-10-06T02:20:52.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.307+0000 7f2218ff9700 1 --2- 172.21.15.6:0/3300188731 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f21fc066f30 0x7f21fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:52.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.307+0000 7f2218ff9700 1 -- 172.21.15.6:0/3300188731 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2214086300 con 0x7f221c0cd030 2023-10-06T02:20:52.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.307+0000 7f221bfff700 1 --2- 172.21.15.6:0/3300188731 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f21fc066f30 0x7f21fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:52.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.308+0000 7f221bfff700 1 --2- 172.21.15.6:0/3300188731 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f21fc066f30 0x7f21fc0693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f221c15cb80 tx=0x7f220c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:52.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.312+0000 7f2218ff9700 1 -- 172.21.15.6:0/3300188731 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22140532d0 con 0x7f221c0cd030 2023-10-06T02:20:52.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.506+0000 7f2221cc2700 1 -- 172.21.15.6:0/3300188731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f221c0b31f0 con 0x7f221c0cd030 2023-10-06T02:20:52.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.507+0000 7f2218ff9700 1 -- 172.21.15.6:0/3300188731 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+17039 (secure 0 0 0) 0x7f22140568f0 con 0x7f221c0cd030 2023-10-06T02:20:52.507 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:52.508 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":65,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:20:51.206396+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:20:48.992600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T02:20:50.177537+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:20:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.509+0000 7f2221cc2700 1 -- 172.21.15.6:0/3300188731 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f21fc066f30 msgr2=0x7f21fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.509+0000 7f2221cc2700 1 --2- 172.21.15.6:0/3300188731 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f21fc066f30 0x7f21fc0693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f221c15cb80 tx=0x7f220c009040 comp rx=0 tx=0).stop 2023-10-06T02:20:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.509+0000 7f2221cc2700 1 -- 172.21.15.6:0/3300188731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221c0cd030 msgr2=0x7f221c0aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.509+0000 7f2221cc2700 1 --2- 172.21.15.6:0/3300188731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221c0cd030 0x7f221c0aef70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f221400b770 tx=0x7f2214018000 comp rx=0 tx=0).stop 2023-10-06T02:20:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.509+0000 7f2221cc2700 1 -- 172.21.15.6:0/3300188731 shutdown_connections 2023-10-06T02:20:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.509+0000 7f2221cc2700 1 --2- 172.21.15.6:0/3300188731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f221c159400 0x7f221c0c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.509+0000 7f2221cc2700 1 --2- 172.21.15.6:0/3300188731 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f21fc066f30 0x7f21fc0693e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.509+0000 7f2221cc2700 1 --2- 172.21.15.6:0/3300188731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221c0cd030 0x7f221c0aef70 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.509+0000 7f2221cc2700 1 --2- 172.21.15.6:0/3300188731 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f221c0d05d0 0x7f221c169d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.509+0000 7f2221cc2700 1 -- 172.21.15.6:0/3300188731 >> 172.21.15.6:0/3300188731 conn(0x7f221c06ac10 msgr2=0x7f221c158120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.509+0000 7f2221cc2700 1 -- 172.21.15.6:0/3300188731 shutdown_connections 2023-10-06T02:20:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.509+0000 7f2221cc2700 1 -- 172.21.15.6:0/3300188731 wait complete. 2023-10-06T02:20:52.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:20:52.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.643+0000 7f09d8d8b700 1 Processor -- start 2023-10-06T02:20:52.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.643+0000 7f09d8d8b700 1 -- start start 2023-10-06T02:20:52.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d8d8b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f09d415a030 0x7f09d415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:52.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d8d8b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09d415a940 0x7f09d4086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:52.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d8d8b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f09d4087530 0x7f09d40b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:52.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d8d8b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d40b0cf0 con 0x7f09d415a030 2023-10-06T02:20:52.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d8d8b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d40879b0 con 0x7f09d4087530 2023-10-06T02:20:52.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d8d8b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d40afc50 con 0x7f09d415a940 2023-10-06T02:20:52.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f09d415a030 0x7f09d415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:52.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f09d415a030 0x7f09d415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54706/0 (socket says 172.21.15.6:54706) 2023-10-06T02:20:52.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d259c700 1 -- 172.21.15.6:0/3752580094 learned_addr learned my addr 172.21.15.6:0/3752580094 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:52.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d1d9b700 1 --2- 172.21.15.6:0/3752580094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09d415a940 0x7f09d4086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:52.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d2d9d700 1 --2- 172.21.15.6:0/3752580094 >> v2:172.21.15.175:3300/0 conn(0x7f09d4087530 0x7f09d40b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d259c700 1 -- 172.21.15.6:0/3752580094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09d415a940 msgr2=0x7f09d4086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d259c700 1 --2- 172.21.15.6:0/3752580094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09d415a940 0x7f09d4086ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d259c700 1 -- 172.21.15.6:0/3752580094 >> v2:172.21.15.175:3300/0 conn(0x7f09d4087530 msgr2=0x7f09d40b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d259c700 1 --2- 172.21.15.6:0/3752580094 >> v2:172.21.15.175:3300/0 conn(0x7f09d4087530 0x7f09d40b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d259c700 1 -- 172.21.15.6:0/3752580094 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d40aff30 con 0x7f09d415a030 2023-10-06T02:20:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d259c700 1 --2- 172.21.15.6:0/3752580094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09d415a030 0x7f09d415a400 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f09d40b1fa0 tx=0x7f09c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb7222057674286 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.644+0000 7f09d159a700 1 -- 172.21.15.6:0/3752580094 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c400b640 con 0x7f09d415a030 2023-10-06T02:20:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.645+0000 7f09d159a700 1 -- 172.21.15.6:0/3752580094 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c400b7a0 con 0x7f09d415a030 2023-10-06T02:20:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.645+0000 7f09d159a700 1 -- 172.21.15.6:0/3752580094 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c400bb40 con 0x7f09d415a030 2023-10-06T02:20:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.645+0000 7f09d8d8b700 1 -- 172.21.15.6:0/3752580094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09d415a030 msgr2=0x7f09d415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.645+0000 7f09d8d8b700 1 --2- 172.21.15.6:0/3752580094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09d415a030 0x7f09d415a400 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f09d40b1fa0 tx=0x7f09c4009250 comp rx=0 tx=0).stop 2023-10-06T02:20:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.645+0000 7f09d8d8b700 1 -- 172.21.15.6:0/3752580094 shutdown_connections 2023-10-06T02:20:52.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.645+0000 7f09d8d8b700 1 --2- 172.21.15.6:0/3752580094 >> v2:172.21.15.175:3300/0 conn(0x7f09d4087530 0x7f09d40b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.645+0000 7f09d8d8b700 1 --2- 172.21.15.6:0/3752580094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09d415a030 0x7f09d415a400 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.645+0000 7f09d8d8b700 1 --2- 172.21.15.6:0/3752580094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09d415a940 0x7f09d4086ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.645+0000 7f09d8d8b700 1 -- 172.21.15.6:0/3752580094 >> 172.21.15.6:0/3752580094 conn(0x7f09d4068680 msgr2=0x7f09d4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:52.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.645+0000 7f09d8d8b700 1 -- 172.21.15.6:0/3752580094 shutdown_connections 2023-10-06T02:20:52.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.645+0000 7f09d8d8b700 1 -- 172.21.15.6:0/3752580094 wait complete. 2023-10-06T02:20:52.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.646+0000 7f09d8d8b700 1 Processor -- start 2023-10-06T02:20:52.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.646+0000 7f09d8d8b700 1 -- start start 2023-10-06T02:20:52.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d8d8b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09d4087530 0x7f09d4155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:52.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d8d8b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09d415a030 0x7f09d40b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:52.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d8d8b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09d415a940 0x7f09d40b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:52.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d8d8b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d41561e0 con 0x7f09d4087530 2023-10-06T02:20:52.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d8d8b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d416b1e0 con 0x7f09d415a030 2023-10-06T02:20:52.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d8d8b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d416a050 con 0x7f09d415a940 2023-10-06T02:20:52.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09d4087530 0x7f09d4155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:52.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09d4087530 0x7f09d4155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54720/0 (socket says 172.21.15.6:54720) 2023-10-06T02:20:52.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d259c700 1 -- 172.21.15.6:0/1455735216 learned_addr learned my addr 172.21.15.6:0/1455735216 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:52.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d1d9b700 1 --2- 172.21.15.6:0/1455735216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09d415a030 0x7f09d40b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:52.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d2d9d700 1 --2- 172.21.15.6:0/1455735216 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09d415a940 0x7f09d40b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d259c700 1 -- 172.21.15.6:0/1455735216 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09d415a940 msgr2=0x7f09d40b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d259c700 1 --2- 172.21.15.6:0/1455735216 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09d415a940 0x7f09d40b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d259c700 1 -- 172.21.15.6:0/1455735216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09d415a030 msgr2=0x7f09d40b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d259c700 1 --2- 172.21.15.6:0/1455735216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09d415a030 0x7f09d40b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d259c700 1 -- 172.21.15.6:0/1455735216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c40094f0 con 0x7f09d4087530 2023-10-06T02:20:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d1d9b700 1 --2- 172.21.15.6:0/1455735216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09d415a030 0x7f09d40b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.647+0000 7f09d259c700 1 --2- 172.21.15.6:0/1455735216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09d4087530 0x7f09d4155ca0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f09c40099b0 tx=0x7f09c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.648+0000 7f09c27fc700 1 -- 172.21.15.6:0/1455735216 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c400bb20 con 0x7f09d4087530 2023-10-06T02:20:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.648+0000 7f09c27fc700 1 -- 172.21.15.6:0/1455735216 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c4011420 con 0x7f09d4087530 2023-10-06T02:20:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.648+0000 7f09d8d8b700 1 -- 172.21.15.6:0/1455735216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d416a310 con 0x7f09d4087530 2023-10-06T02:20:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.648+0000 7f09c27fc700 1 -- 172.21.15.6:0/1455735216 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c40117c0 con 0x7f09d4087530 2023-10-06T02:20:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.648+0000 7f09d8d8b700 1 -- 172.21.15.6:0/1455735216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d416a8d0 con 0x7f09d4087530 2023-10-06T02:20:52.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.649+0000 7f09d8d8b700 1 -- 172.21.15.6:0/1455735216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d4088700 con 0x7f09d4087530 2023-10-06T02:20:52.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.649+0000 7f09c27fc700 1 -- 172.21.15.6:0/1455735216 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09c4011bb0 con 0x7f09d4087530 2023-10-06T02:20:52.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.649+0000 7f09c27fc700 1 --2- 172.21.15.6:0/1455735216 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f09b4066f30 0x7f09b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:52.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.650+0000 7f09c27fc700 1 -- 172.21.15.6:0/1455735216 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f09c40862b0 con 0x7f09d4087530 2023-10-06T02:20:52.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.650+0000 7f09d1d9b700 1 --2- 172.21.15.6:0/1455735216 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f09b4066f30 0x7f09b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:52.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.650+0000 7f09d1d9b700 1 --2- 172.21.15.6:0/1455735216 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f09b4066f30 0x7f09b40693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f09d415e090 tx=0x7f09c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:52.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.654+0000 7f09c27fc700 1 -- 172.21.15.6:0/1455735216 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09c40531e0 con 0x7f09d4087530 2023-10-06T02:20:52.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:52.894+0000 7f09d8d8b700 1 -- 172.21.15.6:0/1455735216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f09d40b0210 con 0x7f09d4087530 2023-10-06T02:20:53.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.822+0000 7f09c27fc700 1 -- 172.21.15.6:0/1455735216 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) v1 ==== 118+0+0 (secure 0 0 0) 0x7f09c4011e60 con 0x7f09d4087530 2023-10-06T02:20:53.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.825+0000 7f09d8d8b700 1 -- 172.21.15.6:0/1455735216 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f09b4066f30 msgr2=0x7f09b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:53.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.825+0000 7f09d8d8b700 1 --2- 172.21.15.6:0/1455735216 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f09b4066f30 0x7f09b40693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f09d415e090 tx=0x7f09c8008040 comp rx=0 tx=0).stop 2023-10-06T02:20:53.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.825+0000 7f09d8d8b700 1 -- 172.21.15.6:0/1455735216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09d4087530 msgr2=0x7f09d4155ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:53.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.825+0000 7f09d8d8b700 1 --2- 172.21.15.6:0/1455735216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09d4087530 0x7f09d4155ca0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f09c40099b0 tx=0x7f09c4017000 comp rx=0 tx=0).stop 2023-10-06T02:20:53.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.825+0000 7f09d8d8b700 1 -- 172.21.15.6:0/1455735216 shutdown_connections 2023-10-06T02:20:53.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.825+0000 7f09d8d8b700 1 --2- 172.21.15.6:0/1455735216 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09d415a940 0x7f09d40b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:53.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.825+0000 7f09d8d8b700 1 --2- 172.21.15.6:0/1455735216 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f09b4066f30 0x7f09b40693e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:53.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.825+0000 7f09d8d8b700 1 --2- 172.21.15.6:0/1455735216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09d4087530 0x7f09d4155ca0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:53.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.825+0000 7f09d8d8b700 1 --2- 172.21.15.6:0/1455735216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09d415a030 0x7f09d40b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:53.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.825+0000 7f09d8d8b700 1 -- 172.21.15.6:0/1455735216 >> 172.21.15.6:0/1455735216 conn(0x7f09d4068680 msgr2=0x7f09d4159020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:53.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.825+0000 7f09d8d8b700 1 -- 172.21.15.6:0/1455735216 shutdown_connections 2023-10-06T02:20:53.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.825+0000 7f09d8d8b700 1 -- 172.21.15.6:0/1455735216 wait complete. 2023-10-06T02:20:53.840 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:20:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.969+0000 7f49b90a9700 1 Processor -- start 2023-10-06T02:20:53.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.969+0000 7f49b90a9700 1 -- start start 2023-10-06T02:20:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.970+0000 7f49b90a9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49b40b0810 0x7f49b4164160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.970+0000 7f49b90a9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b40af770 con 0x7f49b40cd400 2023-10-06T02:20:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.970+0000 7f49b90a9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b40afa50 con 0x7f49b40cd7d0 2023-10-06T02:20:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.970+0000 7f49b90a9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b40afd30 con 0x7f49b40b0810 2023-10-06T02:20:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.970+0000 7f49b3fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f49b40cd400 0x7f49b40b1f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52296/0 (socket says 172.21.15.6:52296) 2023-10-06T02:20:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.970+0000 7f49b3fff700 1 -- 172.21.15.6:0/1839180200 learned_addr learned my addr 172.21.15.6:0/1839180200 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.970+0000 7f49b88a8700 1 --2- 172.21.15.6:0/1839180200 >> v2:172.21.15.6:3300/0 conn(0x7f49b40b0810 0x7f49b4164160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.970+0000 7f49b2ffd700 1 -- 172.21.15.6:0/1839180200 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204778303 0 0) 0x7f49b40af770 con 0x7f49b40cd400 2023-10-06T02:20:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.970+0000 7f49b2ffd700 1 -- 172.21.15.6:0/1839180200 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49a0003570 con 0x7f49b40cd400 2023-10-06T02:20:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.970+0000 7f49b88a8700 1 -- 172.21.15.6:0/1839180200 >> v1:172.21.15.175:6789/0 conn(0x7f49b40cd7d0 legacy=0x7f49b40d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.971+0000 7f49b88a8700 1 -- 172.21.15.6:0/1839180200 >> v1:172.21.15.6:6789/0 conn(0x7f49b40cd400 legacy=0x7f49b40b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.971+0000 7f49b88a8700 1 -- 172.21.15.6:0/1839180200 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b40b0010 con 0x7f49b40b0810 2023-10-06T02:20:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.971+0000 7f49b88a8700 1 --2- 172.21.15.6:0/1839180200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49b40b0810 0x7f49b4164160 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009e90 tx=0x7f49ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee2b8ad720a8bfc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.971+0000 7f49b2ffd700 1 -- 172.21.15.6:0/1839180200 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac00e070 con 0x7f49b40b0810 2023-10-06T02:20:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.971+0000 7f49b2ffd700 1 -- 172.21.15.6:0/1839180200 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac00bc40 con 0x7f49b40b0810 2023-10-06T02:20:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.971+0000 7f49b2ffd700 1 -- 172.21.15.6:0/1839180200 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac012430 con 0x7f49b40b0810 2023-10-06T02:20:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.971+0000 7f49b90a9700 1 -- 172.21.15.6:0/1839180200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49b40b0810 msgr2=0x7f49b4164160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.971+0000 7f49b90a9700 1 --2- 172.21.15.6:0/1839180200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49b40b0810 0x7f49b4164160 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009e90 tx=0x7f49ac009780 comp rx=0 tx=0).stop 2023-10-06T02:20:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.971+0000 7f49b90a9700 1 -- 172.21.15.6:0/1839180200 shutdown_connections 2023-10-06T02:20:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.971+0000 7f49b90a9700 1 --2- 172.21.15.6:0/1839180200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49b40b0810 0x7f49b4164160 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.971+0000 7f49b90a9700 1 -- 172.21.15.6:0/1839180200 >> 172.21.15.6:0/1839180200 conn(0x7f49b406a110 msgr2=0x7f49b406a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.971+0000 7f49b90a9700 1 -- 172.21.15.6:0/1839180200 shutdown_connections 2023-10-06T02:20:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.971+0000 7f49b90a9700 1 -- 172.21.15.6:0/1839180200 wait complete. 2023-10-06T02:20:53.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.972+0000 7f49b90a9700 1 Processor -- start 2023-10-06T02:20:53.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.973+0000 7f49b90a9700 1 -- start start 2023-10-06T02:20:53.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.973+0000 7f49b90a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49b40b0810 0x7f49b40ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:53.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.973+0000 7f49b90a9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49b40cd400 0x7f49b41541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:53.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.973+0000 7f49b90a9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49b40b4060 0x7f49b40b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:53.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.973+0000 7f49b90a9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b41546f0 con 0x7f49b40b0810 2023-10-06T02:20:53.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.973+0000 7f49b90a9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b40b4a20 con 0x7f49b40cd400 2023-10-06T02:20:53.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.973+0000 7f49b90a9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b4157970 con 0x7f49b40b4060 2023-10-06T02:20:53.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.973+0000 7f49b3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49b40b0810 0x7f49b40ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:53.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.974+0000 7f49b3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49b40b0810 0x7f49b40ce5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54734/0 (socket says 172.21.15.6:54734) 2023-10-06T02:20:53.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.974+0000 7f49b3fff700 1 -- 172.21.15.6:0/658178822 learned_addr learned my addr 172.21.15.6:0/658178822 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:53.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.974+0000 7f49b88a8700 1 --2- 172.21.15.6:0/658178822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49b40b4060 0x7f49b40b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:53.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.974+0000 7f49b3fff700 1 -- 172.21.15.6:0/658178822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49b40b4060 msgr2=0x7f49b40b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:53.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.974+0000 7f49b37fe700 1 --2- 172.21.15.6:0/658178822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49b40cd400 0x7f49b41541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:53.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.974+0000 7f49b3fff700 1 --2- 172.21.15.6:0/658178822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49b40b4060 0x7f49b40b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:53.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.974+0000 7f49b3fff700 1 -- 172.21.15.6:0/658178822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49b40cd400 msgr2=0x7f49b41541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:53.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.974+0000 7f49b3fff700 1 --2- 172.21.15.6:0/658178822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49b40cd400 0x7f49b41541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:53.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.974+0000 7f49b3fff700 1 -- 172.21.15.6:0/658178822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac009a20 con 0x7f49b40b0810 2023-10-06T02:20:53.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.974+0000 7f49b88a8700 1 --2- 172.21.15.6:0/658178822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49b40b4060 0x7f49b40b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:53.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.974+0000 7f49b37fe700 1 --2- 172.21.15.6:0/658178822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49b40cd400 0x7f49b41541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:53.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.974+0000 7f49b3fff700 1 --2- 172.21.15.6:0/658178822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49b40b0810 0x7f49b40ce5f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f49a400c7c0 tx=0x7f49a4007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:53.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.974+0000 7f49abfff700 1 -- 172.21.15.6:0/658178822 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a40072e0 con 0x7f49b40b0810 2023-10-06T02:20:53.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.974+0000 7f49abfff700 1 -- 172.21.15.6:0/658178822 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a4007440 con 0x7f49b40b0810 2023-10-06T02:20:53.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.974+0000 7f49b90a9700 1 -- 172.21.15.6:0/658178822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b4158be0 con 0x7f49b40b0810 2023-10-06T02:20:53.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.974+0000 7f49abfff700 1 -- 172.21.15.6:0/658178822 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a40057f0 con 0x7f49b40b0810 2023-10-06T02:20:53.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.974+0000 7f49b90a9700 1 -- 172.21.15.6:0/658178822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b4157320 con 0x7f49b40b0810 2023-10-06T02:20:53.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.975+0000 7f49b90a9700 1 -- 172.21.15.6:0/658178822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b4064aa0 con 0x7f49b40b0810 2023-10-06T02:20:53.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.976+0000 7f49abfff700 1 -- 172.21.15.6:0/658178822 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49a4005be0 con 0x7f49b40b0810 2023-10-06T02:20:53.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.976+0000 7f49abfff700 1 --2- 172.21.15.6:0/658178822 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4994066f30 0x7f49940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:53.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.976+0000 7f49abfff700 1 -- 172.21.15.6:0/658178822 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f49a4083ca0 con 0x7f49b40b0810 2023-10-06T02:20:53.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.976+0000 7f49b37fe700 1 --2- 172.21.15.6:0/658178822 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4994066f30 0x7f49940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:53.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.977+0000 7f49b37fe700 1 --2- 172.21.15.6:0/658178822 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4994066f30 0x7f49940693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f49b40c63d0 tx=0x7f499c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:53.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:53.980+0000 7f49abfff700 1 -- 172.21.15.6:0/658178822 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49a404b5a0 con 0x7f49b40b0810 2023-10-06T02:20:54.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.219+0000 7f49b90a9700 1 -- 172.21.15.6:0/658178822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f49b40b02f0 con 0x7f49b40b0810 2023-10-06T02:20:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.826+0000 7f49abfff700 1 -- 172.21.15.6:0/658178822 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) v1 ==== 122+0+0 (secure 0 0 0) 0x7f49a4017020 con 0x7f49b40b0810 2023-10-06T02:20:54.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.829+0000 7f49b90a9700 1 -- 172.21.15.6:0/658178822 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4994066f30 msgr2=0x7f49940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:54.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.829+0000 7f49b90a9700 1 --2- 172.21.15.6:0/658178822 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4994066f30 0x7f49940693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f49b40c63d0 tx=0x7f499c009040 comp rx=0 tx=0).stop 2023-10-06T02:20:54.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.829+0000 7f49b90a9700 1 -- 172.21.15.6:0/658178822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49b40b0810 msgr2=0x7f49b40ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.829+0000 7f49b90a9700 1 --2- 172.21.15.6:0/658178822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49b40b0810 0x7f49b40ce5f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f49a400c7c0 tx=0x7f49a4007c80 comp rx=0 tx=0).stop 2023-10-06T02:20:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.829+0000 7f49b90a9700 1 -- 172.21.15.6:0/658178822 shutdown_connections 2023-10-06T02:20:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.829+0000 7f49b90a9700 1 --2- 172.21.15.6:0/658178822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49b40b4060 0x7f49b40b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.829+0000 7f49b90a9700 1 --2- 172.21.15.6:0/658178822 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4994066f30 0x7f49940693e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.829+0000 7f49b90a9700 1 --2- 172.21.15.6:0/658178822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49b40b0810 0x7f49b40ce5f0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.829+0000 7f49b90a9700 1 --2- 172.21.15.6:0/658178822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49b40cd400 0x7f49b41541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.829+0000 7f49b90a9700 1 -- 172.21.15.6:0/658178822 >> 172.21.15.6:0/658178822 conn(0x7f49b406a110 msgr2=0x7f49b4156550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.829+0000 7f49b90a9700 1 -- 172.21.15.6:0/658178822 shutdown_connections 2023-10-06T02:20:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.829+0000 7f49b90a9700 1 -- 172.21.15.6:0/658178822 wait complete. 2023-10-06T02:20:54.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:20:54.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.967+0000 7fc4c3585700 1 Processor -- start 2023-10-06T02:20:54.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.967+0000 7fc4c3585700 1 -- start start 2023-10-06T02:20:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.968+0000 7fc4c3585700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc4bc159400 0x7fc4bc0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.968+0000 7fc4c3585700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc4bc0cd030 0x7fc4bc0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.968+0000 7fc4c3585700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4bc0cf1a0 0x7fc4bc0d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.968+0000 7fc4c3585700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4bc0b3560 con 0x7fc4bc0cd030 2023-10-06T02:20:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.968+0000 7fc4c3585700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4bc0cf6f0 con 0x7fc4bc159400 2023-10-06T02:20:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.968+0000 7fc4c3585700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0cf9d0 con 0x7fc4bc0cf1a0 2023-10-06T02:20:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.968+0000 7fc4c1d82700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc4bc0cd030 0x7fc4bc0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.968+0000 7fc4c1d82700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc4bc0cd030 0x7fc4bc0cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54748/0 (socket says 172.21.15.6:54748) 2023-10-06T02:20:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.968+0000 7fc4c1d82700 1 -- 172.21.15.6:0/2544596617 learned_addr learned my addr 172.21.15.6:0/2544596617 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.968+0000 7fc4c2583700 1 --2- 172.21.15.6:0/2544596617 >> v2:172.21.15.175:3300/0 conn(0x7fc4bc159400 0x7fc4bc0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.968+0000 7fc4c2d84700 1 --2- 172.21.15.6:0/2544596617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4bc0cf1a0 0x7fc4bc0d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.968+0000 7fc4c1d82700 1 -- 172.21.15.6:0/2544596617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4bc0cf1a0 msgr2=0x7fc4bc0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.968+0000 7fc4c1d82700 1 --2- 172.21.15.6:0/2544596617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4bc0cf1a0 0x7fc4bc0d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.968+0000 7fc4c1d82700 1 -- 172.21.15.6:0/2544596617 >> v2:172.21.15.175:3300/0 conn(0x7fc4bc159400 msgr2=0x7fc4bc0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.968+0000 7fc4c1d82700 1 --2- 172.21.15.6:0/2544596617 >> v2:172.21.15.175:3300/0 conn(0x7fc4bc159400 0x7fc4bc0ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.969+0000 7fc4c1d82700 1 -- 172.21.15.6:0/2544596617 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc0b2f10 con 0x7fc4bc0cd030 2023-10-06T02:20:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.969+0000 7fc4c1d82700 1 --2- 172.21.15.6:0/2544596617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc0cd030 0x7fc4bc0cfec0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc067fc0 tx=0x7fc4b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fbf2377fc9c203 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.969+0000 7fc4c1581700 1 -- 172.21.15.6:0/2544596617 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b000b860 con 0x7fc4bc0cd030 2023-10-06T02:20:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.969+0000 7fc4c1581700 1 -- 172.21.15.6:0/2544596617 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b000b9c0 con 0x7fc4bc0cd030 2023-10-06T02:20:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.969+0000 7fc4c1581700 1 -- 172.21.15.6:0/2544596617 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b000bd60 con 0x7fc4bc0cd030 2023-10-06T02:20:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.969+0000 7fc4c3585700 1 -- 172.21.15.6:0/2544596617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc0cd030 msgr2=0x7fc4bc0cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.969+0000 7fc4c3585700 1 --2- 172.21.15.6:0/2544596617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc0cd030 0x7fc4bc0cfec0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc067fc0 tx=0x7fc4b0009250 comp rx=0 tx=0).stop 2023-10-06T02:20:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.969+0000 7fc4c3585700 1 -- 172.21.15.6:0/2544596617 shutdown_connections 2023-10-06T02:20:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.969+0000 7fc4c3585700 1 --2- 172.21.15.6:0/2544596617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4bc0cf1a0 0x7fc4bc0d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.969+0000 7fc4c3585700 1 --2- 172.21.15.6:0/2544596617 >> v2:172.21.15.175:3300/0 conn(0x7fc4bc159400 0x7fc4bc0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.969+0000 7fc4c3585700 1 --2- 172.21.15.6:0/2544596617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc0cd030 0x7fc4bc0cfec0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.969+0000 7fc4c3585700 1 -- 172.21.15.6:0/2544596617 >> 172.21.15.6:0/2544596617 conn(0x7fc4bc06ac10 msgr2=0x7fc4bc068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.969+0000 7fc4c3585700 1 -- 172.21.15.6:0/2544596617 shutdown_connections 2023-10-06T02:20:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.970+0000 7fc4c3585700 1 -- 172.21.15.6:0/2544596617 wait complete. 2023-10-06T02:20:54.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.971+0000 7fc4c3585700 1 Processor -- start 2023-10-06T02:20:54.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.971+0000 7fc4c3585700 1 -- start start 2023-10-06T02:20:54.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.971+0000 7fc4c3585700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4bc0cd030 0x7fc4bc15e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:54.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.971+0000 7fc4c3585700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4bc0cf1a0 0x7fc4bc0c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:54.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.971+0000 7fc4c3585700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc159400 0x7fc4bc16c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:54.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.971+0000 7fc4c3585700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc15b550 con 0x7fc4bc159400 2023-10-06T02:20:54.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.971+0000 7fc4c3585700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc15a940 con 0x7fc4bc0cf1a0 2023-10-06T02:20:54.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.971+0000 7fc4c3585700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc15ac20 con 0x7fc4bc0cd030 2023-10-06T02:20:54.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.971+0000 7fc4c2d84700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc159400 0x7fc4bc16c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:54.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.971+0000 7fc4c2d84700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc159400 0x7fc4bc16c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54756/0 (socket says 172.21.15.6:54756) 2023-10-06T02:20:54.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.971+0000 7fc4c2d84700 1 -- 172.21.15.6:0/190317187 learned_addr learned my addr 172.21.15.6:0/190317187 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:54.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.972+0000 7fc4c1d82700 1 --2- 172.21.15.6:0/190317187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4bc0cf1a0 0x7fc4bc0c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:54.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.972+0000 7fc4c2583700 1 --2- 172.21.15.6:0/190317187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4bc0cd030 0x7fc4bc15e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:54.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.972+0000 7fc4c2d84700 1 -- 172.21.15.6:0/190317187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4bc0cd030 msgr2=0x7fc4bc15e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:54.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.972+0000 7fc4c2d84700 1 --2- 172.21.15.6:0/190317187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4bc0cd030 0x7fc4bc15e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:54.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.972+0000 7fc4c2d84700 1 -- 172.21.15.6:0/190317187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4bc0cf1a0 msgr2=0x7fc4bc0c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:54.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.972+0000 7fc4c2d84700 1 --2- 172.21.15.6:0/190317187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4bc0cf1a0 0x7fc4bc0c59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:54.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.972+0000 7fc4c2d84700 1 -- 172.21.15.6:0/190317187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b00094f0 con 0x7fc4bc159400 2023-10-06T02:20:54.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.972+0000 7fc4c2583700 1 --2- 172.21.15.6:0/190317187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4bc0cd030 0x7fc4bc15e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:54.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.972+0000 7fc4c2d84700 1 --2- 172.21.15.6:0/190317187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc159400 0x7fc4bc16c720 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009fa0 tx=0x7fc4ac009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:54.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.972+0000 7fc4ba7fc700 1 -- 172.21.15.6:0/190317187 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac00ed20 con 0x7fc4bc159400 2023-10-06T02:20:54.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.972+0000 7fc4ba7fc700 1 -- 172.21.15.6:0/190317187 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac00ee80 con 0x7fc4bc159400 2023-10-06T02:20:54.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.972+0000 7fc4c3585700 1 -- 172.21.15.6:0/190317187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc15af00 con 0x7fc4bc159400 2023-10-06T02:20:54.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.972+0000 7fc4ba7fc700 1 -- 172.21.15.6:0/190317187 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac014670 con 0x7fc4bc159400 2023-10-06T02:20:54.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.972+0000 7fc4c3585700 1 -- 172.21.15.6:0/190317187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc15eb80 con 0x7fc4bc159400 2023-10-06T02:20:54.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.973+0000 7fc4c3585700 1 -- 172.21.15.6:0/190317187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4bc1597d0 con 0x7fc4bc159400 2023-10-06T02:20:54.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.973+0000 7fc4ba7fc700 1 -- 172.21.15.6:0/190317187 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc4ac0149e0 con 0x7fc4bc159400 2023-10-06T02:20:54.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.974+0000 7fc4ba7fc700 1 --2- 172.21.15.6:0/190317187 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc4a8066f30 0x7fc4a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:54.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.974+0000 7fc4ba7fc700 1 -- 172.21.15.6:0/190317187 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc4ac084f50 con 0x7fc4bc159400 2023-10-06T02:20:54.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.974+0000 7fc4c2583700 1 --2- 172.21.15.6:0/190317187 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc4a8066f30 0x7fc4a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:54.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.975+0000 7fc4c2583700 1 --2- 172.21.15.6:0/190317187 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc4a8066f30 0x7fc4a80693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4006aa0 tx=0x7fc4b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:54.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:54.978+0000 7fc4ba7fc700 1 -- 172.21.15.6:0/190317187 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4ac051f20 con 0x7fc4bc159400 2023-10-06T02:20:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.219+0000 7fc4c3585700 1 -- 172.21.15.6:0/190317187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4bc069ee0 con 0x7fc4bc159400 2023-10-06T02:20:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.219+0000 7fc4ba7fc700 1 -- 172.21.15.6:0/190317187 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fc4ac055540 con 0x7fc4bc159400 2023-10-06T02:20:55.220 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:55.220 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":49,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1006897436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1006897436},{"type":"v1","addr":"172.21.15.6:6835","nonce":1006897436}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3777949337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3777949337},{"type":"v1","addr":"172.21.15.6:6834","nonce":3777949337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:51.206714+0000","modified":"2023-10-06T02:20:54.822293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6222":{"gid":6222,"name":"b","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1125020360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1125020360},{"type":"v1","addr":"172.21.15.175:6837","nonce":1125020360}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:20:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.221+0000 7fc4c3585700 1 -- 172.21.15.6:0/190317187 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc4a8066f30 msgr2=0x7fc4a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.221+0000 7fc4c3585700 1 --2- 172.21.15.6:0/190317187 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc4a8066f30 0x7fc4a80693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4006aa0 tx=0x7fc4b4008040 comp rx=0 tx=0).stop 2023-10-06T02:20:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.221+0000 7fc4c3585700 1 -- 172.21.15.6:0/190317187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc159400 msgr2=0x7fc4bc16c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.221+0000 7fc4c3585700 1 --2- 172.21.15.6:0/190317187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc159400 0x7fc4bc16c720 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009fa0 tx=0x7fc4ac009900 comp rx=0 tx=0).stop 2023-10-06T02:20:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.221+0000 7fc4c3585700 1 -- 172.21.15.6:0/190317187 shutdown_connections 2023-10-06T02:20:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.221+0000 7fc4c3585700 1 --2- 172.21.15.6:0/190317187 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc4a8066f30 0x7fc4a80693e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.221+0000 7fc4c3585700 1 --2- 172.21.15.6:0/190317187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc159400 0x7fc4bc16c720 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.221+0000 7fc4c3585700 1 --2- 172.21.15.6:0/190317187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4bc0cd030 0x7fc4bc15e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.221+0000 7fc4c3585700 1 --2- 172.21.15.6:0/190317187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4bc0cf1a0 0x7fc4bc0c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.221+0000 7fc4c3585700 1 -- 172.21.15.6:0/190317187 >> 172.21.15.6:0/190317187 conn(0x7fc4bc06ac10 msgr2=0x7fc4bc0b4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.221+0000 7fc4c3585700 1 -- 172.21.15.6:0/190317187 shutdown_connections 2023-10-06T02:20:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.221+0000 7fc4c3585700 1 -- 172.21.15.6:0/190317187 wait complete. 2023-10-06T02:20:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 49 2023-10-06T02:20:55.234 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:20:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.352+0000 7fdc9cf11700 1 Processor -- start 2023-10-06T02:20:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.352+0000 7fdc9cf11700 1 -- start start 2023-10-06T02:20:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.353+0000 7fdc9cf11700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc98068d90 0x7fdc980af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.353+0000 7fdc9cf11700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdc9806da40 0x7fdc98159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.353+0000 7fdc9cf11700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc9806d5b0 con 0x7fdc980af1d0 2023-10-06T02:20:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.353+0000 7fdc9cf11700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc980caf90 con 0x7fdc9806da40 2023-10-06T02:20:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.353+0000 7fdc9cf11700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9806dee0 con 0x7fdc98068d90 2023-10-06T02:20:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.354+0000 7fdc9659c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdc980af1d0 0x7fdc98068680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52310/0 (socket says 172.21.15.6:52310) 2023-10-06T02:20:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.354+0000 7fdc9659c700 1 -- 172.21.15.6:0/2356903959 learned_addr learned my addr 172.21.15.6:0/2356903959 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.354+0000 7fdc96d9d700 1 --2- 172.21.15.6:0/2356903959 >> v2:172.21.15.175:3300/0 conn(0x7fdc9806da40 0x7fdc98159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.354+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/2356903959 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc98068d90 0x7fdc980af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.354+0000 7fdc9559a700 1 -- 172.21.15.6:0/2356903959 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890720118 0 0) 0x7fdc9806d5b0 con 0x7fdc980af1d0 2023-10-06T02:20:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.354+0000 7fdc9559a700 1 -- 172.21.15.6:0/2356903959 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc84003570 con 0x7fdc980af1d0 2023-10-06T02:20:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.354+0000 7fdc9559a700 1 -- 172.21.15.6:0/2356903959 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1294672498 0 0) 0x7fdc84003570 con 0x7fdc980af1d0 2023-10-06T02:20:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.354+0000 7fdc95d9b700 1 -- 172.21.15.6:0/2356903959 >> v2:172.21.15.175:3300/0 conn(0x7fdc9806da40 msgr2=0x7fdc98159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.354+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/2356903959 >> v2:172.21.15.175:3300/0 conn(0x7fdc9806da40 0x7fdc98159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.354+0000 7fdc95d9b700 1 -- 172.21.15.6:0/2356903959 >> v1:172.21.15.6:6789/0 conn(0x7fdc980af1d0 legacy=0x7fdc98068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.354+0000 7fdc95d9b700 1 -- 172.21.15.6:0/2356903959 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9815a9a0 con 0x7fdc98068d90 2023-10-06T02:20:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.354+0000 7fdc96d9d700 1 --2- 172.21.15.6:0/2356903959 >> v2:172.21.15.175:3300/0 conn(0x7fdc9806da40 0x7fdc98159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:20:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.354+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/2356903959 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc98068d90 0x7fdc980af5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc800098e0 tx=0x7fdc800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=196a3830b375ace3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.355+0000 7fdc9559a700 1 -- 172.21.15.6:0/2356903959 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90001470 con 0x7fdc98068d90 2023-10-06T02:20:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.355+0000 7fdc9559a700 1 -- 172.21.15.6:0/2356903959 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc80011420 con 0x7fdc98068d90 2023-10-06T02:20:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.355+0000 7fdc9559a700 1 -- 172.21.15.6:0/2356903959 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc800117c0 con 0x7fdc98068d90 2023-10-06T02:20:55.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.355+0000 7fdc9cf11700 1 -- 172.21.15.6:0/2356903959 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc98068d90 msgr2=0x7fdc980af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.355+0000 7fdc9cf11700 1 --2- 172.21.15.6:0/2356903959 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc98068d90 0x7fdc980af5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc800098e0 tx=0x7fdc800091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.355+0000 7fdc9cf11700 1 -- 172.21.15.6:0/2356903959 shutdown_connections 2023-10-06T02:20:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.355+0000 7fdc9cf11700 1 --2- 172.21.15.6:0/2356903959 >> v2:172.21.15.175:3300/0 conn(0x7fdc9806da40 0x7fdc98159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.355+0000 7fdc9cf11700 1 --2- 172.21.15.6:0/2356903959 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc98068d90 0x7fdc980af5a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.355+0000 7fdc9cf11700 1 -- 172.21.15.6:0/2356903959 >> 172.21.15.6:0/2356903959 conn(0x7fdc9806a220 msgr2=0x7fdc9806b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.355+0000 7fdc9cf11700 1 -- 172.21.15.6:0/2356903959 shutdown_connections 2023-10-06T02:20:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.355+0000 7fdc9cf11700 1 -- 172.21.15.6:0/2356903959 wait complete. 2023-10-06T02:20:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.356+0000 7fdc9cf11700 1 Processor -- start 2023-10-06T02:20:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.356+0000 7fdc9cf11700 1 -- start start 2023-10-06T02:20:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.357+0000 7fdc9cf11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc98068d90 0x7fdc980c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.357+0000 7fdc9cf11700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9806da40 0x7fdc98145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.357+0000 7fdc9cf11700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc980af1d0 0x7fdc980c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:55.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.357+0000 7fdc9cf11700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980c4880 con 0x7fdc98068d90 2023-10-06T02:20:55.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.357+0000 7fdc9cf11700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc98143d20 con 0x7fdc980af1d0 2023-10-06T02:20:55.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.357+0000 7fdc9cf11700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980c4600 con 0x7fdc9806da40 2023-10-06T02:20:55.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.357+0000 7fdc9659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc98068d90 0x7fdc980c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:55.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.357+0000 7fdc9659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc98068d90 0x7fdc980c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54768/0 (socket says 172.21.15.6:54768) 2023-10-06T02:20:55.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.357+0000 7fdc9659c700 1 -- 172.21.15.6:0/2171719804 learned_addr learned my addr 172.21.15.6:0/2171719804 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:55.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.357+0000 7fdc96d9d700 1 --2- 172.21.15.6:0/2171719804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc980af1d0 0x7fdc980c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:55.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.357+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/2171719804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9806da40 0x7fdc98145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:55.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.358+0000 7fdc9659c700 1 -- 172.21.15.6:0/2171719804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9806da40 msgr2=0x7fdc98145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:55.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.358+0000 7fdc9659c700 1 --2- 172.21.15.6:0/2171719804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9806da40 0x7fdc98145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.358+0000 7fdc9659c700 1 -- 172.21.15.6:0/2171719804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc980af1d0 msgr2=0x7fdc980c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:55.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.358+0000 7fdc9659c700 1 --2- 172.21.15.6:0/2171719804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc980af1d0 0x7fdc980c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.358+0000 7fdc9659c700 1 -- 172.21.15.6:0/2171719804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc88009a20 con 0x7fdc98068d90 2023-10-06T02:20:55.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.358+0000 7fdc9659c700 1 --2- 172.21.15.6:0/2171719804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc98068d90 0x7fdc980c7200 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000cb90 tx=0x7fdc90001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:55.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.358+0000 7fdc8e7fc700 1 -- 172.21.15.6:0/2171719804 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90007360 con 0x7fdc98068d90 2023-10-06T02:20:55.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.358+0000 7fdc9cf11700 1 -- 172.21.15.6:0/2171719804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc80009420 con 0x7fdc98068d90 2023-10-06T02:20:55.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.358+0000 7fdc8e7fc700 1 -- 172.21.15.6:0/2171719804 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc900074e0 con 0x7fdc98068d90 2023-10-06T02:20:55.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.358+0000 7fdc8e7fc700 1 -- 172.21.15.6:0/2171719804 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90004830 con 0x7fdc98068d90 2023-10-06T02:20:55.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.358+0000 7fdc9cf11700 1 -- 172.21.15.6:0/2171719804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc981436d0 con 0x7fdc98068d90 2023-10-06T02:20:55.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.359+0000 7fdc9cf11700 1 -- 172.21.15.6:0/2171719804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9806e720 con 0x7fdc98068d90 2023-10-06T02:20:55.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.359+0000 7fdc8e7fc700 1 -- 172.21.15.6:0/2171719804 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc90004ba0 con 0x7fdc98068d90 2023-10-06T02:20:55.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.360+0000 7fdc8e7fc700 1 --2- 172.21.15.6:0/2171719804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc78066f30 0x7fdc780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:55.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.360+0000 7fdc8e7fc700 1 -- 172.21.15.6:0/2171719804 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdc900841a0 con 0x7fdc98068d90 2023-10-06T02:20:55.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.360+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/2171719804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc78066f30 0x7fdc780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:55.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.360+0000 7fdc95d9b700 1 --2- 172.21.15.6:0/2171719804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc78066f30 0x7fdc780693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdc800030c0 tx=0x7fdc80016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:55.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.364+0000 7fdc8e7fc700 1 -- 172.21.15.6:0/2171719804 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc90051190 con 0x7fdc98068d90 2023-10-06T02:20:55.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.564+0000 7fdc9cf11700 1 -- 172.21.15.6:0/2171719804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc9815a6c0 con 0x7fdc98068d90 2023-10-06T02:20:55.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.565+0000 7fdc8e7fc700 1 -- 172.21.15.6:0/2171719804 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+17026 (secure 0 0 0) 0x7fdc900547b0 con 0x7fdc98068d90 2023-10-06T02:20:55.566 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:55.566 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":66,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:20:52.809152+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:20:48.992600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T02:20:50.177537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:20:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.567+0000 7fdc9cf11700 1 -- 172.21.15.6:0/2171719804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc78066f30 msgr2=0x7fdc780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.567+0000 7fdc9cf11700 1 --2- 172.21.15.6:0/2171719804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc78066f30 0x7fdc780693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdc800030c0 tx=0x7fdc80016000 comp rx=0 tx=0).stop 2023-10-06T02:20:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.567+0000 7fdc9cf11700 1 -- 172.21.15.6:0/2171719804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc98068d90 msgr2=0x7fdc980c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.567+0000 7fdc9cf11700 1 --2- 172.21.15.6:0/2171719804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc98068d90 0x7fdc980c7200 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000cb90 tx=0x7fdc90001b50 comp rx=0 tx=0).stop 2023-10-06T02:20:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.567+0000 7fdc9cf11700 1 -- 172.21.15.6:0/2171719804 shutdown_connections 2023-10-06T02:20:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.567+0000 7fdc9cf11700 1 --2- 172.21.15.6:0/2171719804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc980af1d0 0x7fdc980c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.567+0000 7fdc9cf11700 1 --2- 172.21.15.6:0/2171719804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc78066f30 0x7fdc780693e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.567+0000 7fdc9cf11700 1 --2- 172.21.15.6:0/2171719804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc98068d90 0x7fdc980c7200 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.567+0000 7fdc9cf11700 1 --2- 172.21.15.6:0/2171719804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc9806da40 0x7fdc98145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.567+0000 7fdc9cf11700 1 -- 172.21.15.6:0/2171719804 >> 172.21.15.6:0/2171719804 conn(0x7fdc9806a220 msgr2=0x7fdc9815f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.567+0000 7fdc9cf11700 1 -- 172.21.15.6:0/2171719804 shutdown_connections 2023-10-06T02:20:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.567+0000 7fdc9cf11700 1 -- 172.21.15.6:0/2171719804 wait complete. 2023-10-06T02:20:55.580 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:20:55.580 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:20:55.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.699+0000 7fd462aa8700 1 Processor -- start 2023-10-06T02:20:55.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.699+0000 7fd462aa8700 1 -- start start 2023-10-06T02:20:55.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd462aa8700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd45c0af4e0 0x7fd45c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd462aa8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd45c15db70 0x7fd45c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd462aa8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45c15e190 con 0x7fd45c0af8b0 2023-10-06T02:20:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd462aa8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45c0b1910 con 0x7fd45c15db70 2023-10-06T02:20:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd462aa8700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45c15dfa0 con 0x7fd45c0af4e0 2023-10-06T02:20:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd461045700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd45c15db70 0x7fd45c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd461045700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd45c15db70 0x7fd45c0b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54772/0 (socket says 172.21.15.6:54772) 2023-10-06T02:20:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd461045700 1 -- 172.21.15.6:0/835397788 learned_addr learned my addr 172.21.15.6:0/835397788 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd45bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd45c0af8b0 0x7fd45c15d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52326/0 (socket says 172.21.15.6:52326) 2023-10-06T02:20:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd460844700 1 --2- 172.21.15.6:0/835397788 >> v2:172.21.15.175:3300/0 conn(0x7fd45c0af4e0 0x7fd45c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd461045700 1 -- 172.21.15.6:0/835397788 >> v2:172.21.15.175:3300/0 conn(0x7fd45c0af4e0 msgr2=0x7fd45c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd461045700 1 --2- 172.21.15.6:0/835397788 >> v2:172.21.15.175:3300/0 conn(0x7fd45c0af4e0 0x7fd45c0b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd461045700 1 -- 172.21.15.6:0/835397788 >> v1:172.21.15.6:6789/0 conn(0x7fd45c0af8b0 legacy=0x7fd45c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd45b7fe700 1 -- 172.21.15.6:0/835397788 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529710909 0 0) 0x7fd45c15e190 con 0x7fd45c0af8b0 2023-10-06T02:20:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd461045700 1 -- 172.21.15.6:0/835397788 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c0cb650 con 0x7fd45c15db70 2023-10-06T02:20:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd460844700 1 --2- 172.21.15.6:0/835397788 >> v2:172.21.15.175:3300/0 conn(0x7fd45c0af4e0 0x7fd45c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:20:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd461045700 1 --2- 172.21.15.6:0/835397788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c15db70 0x7fd45c0b2620 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd45c0d1360 tx=0x7fd444009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971c35719d82edda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.700+0000 7fd45b7fe700 1 -- 172.21.15.6:0/835397788 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44400b860 con 0x7fd45c15db70 2023-10-06T02:20:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.701+0000 7fd45b7fe700 1 -- 172.21.15.6:0/835397788 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44400b9c0 con 0x7fd45c15db70 2023-10-06T02:20:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.701+0000 7fd45b7fe700 1 -- 172.21.15.6:0/835397788 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44400bd60 con 0x7fd45c15db70 2023-10-06T02:20:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.701+0000 7fd462aa8700 1 -- 172.21.15.6:0/835397788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c15db70 msgr2=0x7fd45c0b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.701+0000 7fd462aa8700 1 --2- 172.21.15.6:0/835397788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c15db70 0x7fd45c0b2620 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd45c0d1360 tx=0x7fd444009250 comp rx=0 tx=0).stop 2023-10-06T02:20:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.701+0000 7fd462aa8700 1 -- 172.21.15.6:0/835397788 shutdown_connections 2023-10-06T02:20:55.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.701+0000 7fd462aa8700 1 --2- 172.21.15.6:0/835397788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c15db70 0x7fd45c0b2620 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.701+0000 7fd462aa8700 1 --2- 172.21.15.6:0/835397788 >> v2:172.21.15.175:3300/0 conn(0x7fd45c0af4e0 0x7fd45c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.701+0000 7fd462aa8700 1 -- 172.21.15.6:0/835397788 >> 172.21.15.6:0/835397788 conn(0x7fd45c068680 msgr2=0x7fd45c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:55.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.701+0000 7fd462aa8700 1 -- 172.21.15.6:0/835397788 shutdown_connections 2023-10-06T02:20:55.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.701+0000 7fd462aa8700 1 -- 172.21.15.6:0/835397788 wait complete. 2023-10-06T02:20:55.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.702+0000 7fd462aa8700 1 Processor -- start 2023-10-06T02:20:55.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.702+0000 7fd462aa8700 1 -- start start 2023-10-06T02:20:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.703+0000 7fd462aa8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd45c0af4e0 0x7fd45c0ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.703+0000 7fd462aa8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c0af8b0 0x7fd45c16a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.703+0000 7fd462aa8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd45c15db70 0x7fd45c159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.703+0000 7fd462aa8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c16aa50 con 0x7fd45c0af8b0 2023-10-06T02:20:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.703+0000 7fd462aa8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c1595c0 con 0x7fd45c15db70 2023-10-06T02:20:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.703+0000 7fd462aa8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c0c9a50 con 0x7fd45c0af4e0 2023-10-06T02:20:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.703+0000 7fd45bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c0af8b0 0x7fd45c16a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.703+0000 7fd45bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c0af8b0 0x7fd45c16a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54786/0 (socket says 172.21.15.6:54786) 2023-10-06T02:20:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.703+0000 7fd45bfff700 1 -- 172.21.15.6:0/1016878197 learned_addr learned my addr 172.21.15.6:0/1016878197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.703+0000 7fd45bfff700 1 -- 172.21.15.6:0/1016878197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd45c0af4e0 msgr2=0x7fd45c0ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.703+0000 7fd461045700 1 --2- 172.21.15.6:0/1016878197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd45c15db70 0x7fd45c159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.703+0000 7fd45bfff700 1 --2- 172.21.15.6:0/1016878197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd45c0af4e0 0x7fd45c0ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.703+0000 7fd45bfff700 1 -- 172.21.15.6:0/1016878197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd45c15db70 msgr2=0x7fd45c159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.704+0000 7fd45bfff700 1 --2- 172.21.15.6:0/1016878197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd45c15db70 0x7fd45c159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.704+0000 7fd45bfff700 1 -- 172.21.15.6:0/1016878197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4440094f0 con 0x7fd45c0af8b0 2023-10-06T02:20:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.704+0000 7fd45bfff700 1 --2- 172.21.15.6:0/1016878197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c0af8b0 0x7fd45c16a510 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd44c002230 tx=0x7fd44c001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.704+0000 7fd458ff9700 1 -- 172.21.15.6:0/1016878197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c005df0 con 0x7fd45c0af8b0 2023-10-06T02:20:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.704+0000 7fd458ff9700 1 -- 172.21.15.6:0/1016878197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c00a960 con 0x7fd45c0af8b0 2023-10-06T02:20:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.704+0000 7fd462aa8700 1 -- 172.21.15.6:0/1016878197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45c0c9d30 con 0x7fd45c0af8b0 2023-10-06T02:20:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.704+0000 7fd458ff9700 1 -- 172.21.15.6:0/1016878197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c00ad20 con 0x7fd45c0af8b0 2023-10-06T02:20:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.704+0000 7fd462aa8700 1 -- 172.21.15.6:0/1016878197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45c0a7180 con 0x7fd45c0af8b0 2023-10-06T02:20:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.705+0000 7fd462aa8700 1 -- 172.21.15.6:0/1016878197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45c0a73a0 con 0x7fd45c0af8b0 2023-10-06T02:20:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.705+0000 7fd458ff9700 1 -- 172.21.15.6:0/1016878197 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd44c007300 con 0x7fd45c0af8b0 2023-10-06T02:20:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.706+0000 7fd458ff9700 1 --2- 172.21.15.6:0/1016878197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd43c066f30 0x7fd43c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.706+0000 7fd458ff9700 1 -- 172.21.15.6:0/1016878197 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd44c084a20 con 0x7fd45c0af8b0 2023-10-06T02:20:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.706+0000 7fd460844700 1 --2- 172.21.15.6:0/1016878197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd43c066f30 0x7fd43c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.706+0000 7fd460844700 1 --2- 172.21.15.6:0/1016878197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd43c066f30 0x7fd43c0693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd454006fd0 tx=0x7fd454008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:55.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.710+0000 7fd458ff9700 1 -- 172.21.15.6:0/1016878197 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd44c051a70 con 0x7fd45c0af8b0 2023-10-06T02:20:55.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.902+0000 7fd462aa8700 1 -- 172.21.15.6:0/1016878197 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd45c0afd60 con 0x7fd43c066f30 2023-10-06T02:20:55.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.911+0000 7fd458ff9700 1 -- 172.21.15.6:0/1016878197 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300900 (secure 0 0 0) 0x7fd45c0afd60 con 0x7fd43c066f30 2023-10-06T02:20:55.915 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:55.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.915+0000 7fd462aa8700 1 -- 172.21.15.6:0/1016878197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd43c066f30 msgr2=0x7fd43c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:55.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.915+0000 7fd462aa8700 1 --2- 172.21.15.6:0/1016878197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd43c066f30 0x7fd43c0693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd454006fd0 tx=0x7fd454008040 comp rx=0 tx=0).stop 2023-10-06T02:20:55.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.915+0000 7fd462aa8700 1 -- 172.21.15.6:0/1016878197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c0af8b0 msgr2=0x7fd45c16a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:55.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.915+0000 7fd462aa8700 1 --2- 172.21.15.6:0/1016878197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c0af8b0 0x7fd45c16a510 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd44c002230 tx=0x7fd44c001b90 comp rx=0 tx=0).stop 2023-10-06T02:20:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.915+0000 7fd462aa8700 1 -- 172.21.15.6:0/1016878197 shutdown_connections 2023-10-06T02:20:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.915+0000 7fd462aa8700 1 --2- 172.21.15.6:0/1016878197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd45c15db70 0x7fd45c159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.915+0000 7fd462aa8700 1 --2- 172.21.15.6:0/1016878197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd45c0af4e0 0x7fd45c0ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.915+0000 7fd462aa8700 1 --2- 172.21.15.6:0/1016878197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd43c066f30 0x7fd43c0693e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.915+0000 7fd462aa8700 1 --2- 172.21.15.6:0/1016878197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c0af8b0 0x7fd45c16a510 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.915+0000 7fd462aa8700 1 -- 172.21.15.6:0/1016878197 >> 172.21.15.6:0/1016878197 conn(0x7fd45c068680 msgr2=0x7fd45c068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.915+0000 7fd462aa8700 1 -- 172.21.15.6:0/1016878197 shutdown_connections 2023-10-06T02:20:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:55.915+0000 7fd462aa8700 1 -- 172.21.15.6:0/1016878197 wait complete. 2023-10-06T02:20:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:20:55.927 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2023-10-06T02:20:54.606965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385404,"kb_used_data":7100,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589316,"statfs":{"total":773094113280,"available":770651459584,"internally_reserved":0,"allocated":7270400,"data_stored":4024093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.813335"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.801938+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:51.759990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.795240+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:39.212586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797535+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:10.251809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.796108+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:22.450446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.794732+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.989620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797080+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:04.614360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.798892+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:50.457608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797238+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:17.253149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797930+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:39.212586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.796098+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:00.353785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.794270+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:39.657314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.799332+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:26.911597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.799267+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:34.978104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.796640+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:14.312615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.798061+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:34:00.963280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797476+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:33.539246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.796119+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:23.943816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797851+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:50:41.193249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797240+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:54.583881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.795267+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:10.251809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797465+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:19.970590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.799242+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:04.614360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797498+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:24.123927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.795751+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:59:17.385955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.798968+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:59.586917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:47.733584+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:20:47.733584+0000","last_peered":"2023-10-06T02:20:47.733584+0000","last_clean":"2023-10-06T02:20:47.733584+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:20:47.733584+0000","last_undegraded":"2023-10-06T02:20:47.733584+0000","last_fullsized":"2023-10-06T02:20:47.733584+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.796835+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:50.457608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:47.733238+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:20:47.733238+0000","last_peered":"2023-10-06T02:20:47.733238+0000","last_clean":"2023-10-06T02:20:47.733238+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:20:47.733238+0000","last_undegraded":"2023-10-06T02:20:47.733238+0000","last_fullsized":"2023-10-06T02:20:47.733238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.795266+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:24.123927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:46.786772+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:20:46.786772+0000","last_peered":"2023-10-06T02:20:46.786772+0000","last_clean":"2023-10-06T02:20:46.786772+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:20:46.786772+0000","last_undegraded":"2023-10-06T02:20:46.786772+0000","last_fullsized":"2023-10-06T02:20:46.786772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":200,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:47.447129+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:20:47.447129+0000","last_peered":"2023-10-06T02:20:47.447129+0000","last_clean":"2023-10-06T02:20:47.447129+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:20:47.447129+0000","last_undegraded":"2023-10-06T02:20:47.447129+0000","last_fullsized":"2023-10-06T02:20:47.447129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797558+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:12.524357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":50,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:47.447140+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:20:47.447140+0000","last_peered":"2023-10-06T02:20:47.447140+0000","last_clean":"2023-10-06T02:20:47.447140+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:20:47.447140+0000","last_undegraded":"2023-10-06T02:20:47.447140+0000","last_fullsized":"2023-10-06T02:20:47.447140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.796058+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:35.323489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":50,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:47.447121+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:20:47.447121+0000","last_peered":"2023-10-06T02:20:47.447121+0000","last_clean":"2023-10-06T02:20:47.447121+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:20:47.447121+0000","last_undegraded":"2023-10-06T02:20:47.447121+0000","last_fullsized":"2023-10-06T02:20:47.447121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.796036+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:22:06.526588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:46.789880+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:20:46.789880+0000","last_peered":"2023-10-06T02:20:46.789880+0000","last_clean":"2023-10-06T02:20:46.789880+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:20:46.789880+0000","last_undegraded":"2023-10-06T02:20:46.789880+0000","last_fullsized":"2023-10-06T02:20:46.789880+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.796498+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:35:37.594405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":50,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:47.733700+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:20:47.733700+0000","last_peered":"2023-10-06T02:20:47.733700+0000","last_clean":"2023-10-06T02:20:47.733700+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:20:47.733700+0000","last_undegraded":"2023-10-06T02:20:47.733700+0000","last_fullsized":"2023-10-06T02:20:47.733700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.801853+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:45.187739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":50,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:47.733737+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:20:47.733737+0000","last_peered":"2023-10-06T02:20:47.733737+0000","last_clean":"2023-10-06T02:20:47.733737+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:20:47.733737+0000","last_undegraded":"2023-10-06T02:20:47.733737+0000","last_fullsized":"2023-10-06T02:20:47.733737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298612,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073228,"statfs":{"total":96636764160,"available":96330985472,"internally_reserved":0,"allocated":1355776,"data_stored":946145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.377,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":1.111,"15min":1.111},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.47999999999999998},"min":{"1min":0.30499999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80600000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.35899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86299999999999999,"5min":1.008,"15min":1.008},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.505},"min":{"1min":0.36699999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70499999999999996,"5min":1.075,"15min":1.075},"last":0.504}]},{"osd":2,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82199999999999995,"5min":1.149,"15min":1.149},"last":0.442},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.56699999999999995},"min":{"1min":0.49199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77400000000000002,"5min":1.048,"15min":1.048},"last":0.52900000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45900000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79200000000000004,"5min":1.175,"15min":1.175},"last":0.374},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.56299999999999994},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83799999999999997,"5min":1.03,"15min":1.03},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.41599999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75800000000000001,"5min":0.873,"15min":0.873},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80300000000000005,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.39500000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.71199999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55800000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84799999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78600000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.77800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298028,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073812,"statfs":{"total":96636764160,"available":96331583488,"internally_reserved":0,"allocated":757760,"data_stored":354824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.76300000000000001,"15min":0.84699999999999998},"min":{"1min":0.44800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82399999999999995,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.76600000000000001,"15min":0.85899999999999999},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82799999999999996,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":0.70799999999999996}]},{"osd":1,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.748},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.433,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.58699999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.88800000000000001,"15min":1.04},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77700000000000002,"5min":8.8659999999999997,"15min":8.8659999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.35599999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.65100000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.98499999999999999,"15min":1.157},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86799999999999999,"5min":10.659000000000001,"15min":10.659000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57699999999999996}]},{"osd":4,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.36899999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70099999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54200000000000004,"15min":0.55300000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.70799999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72199999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.754,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.49099999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.38100000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.64200000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.53400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298608,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073232,"statfs":{"total":96636764160,"available":96330989568,"internally_reserved":0,"allocated":1351680,"data_stored":945192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.34300000000000003},"min":{"1min":0.23499999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.379},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.28100000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53100000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.434}]},{"osd":2,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.32600000000000001,"15min":0.317},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.499,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.379,"15min":0.375},"min":{"1min":0.28999999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51900000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.46899999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.38300000000000001,"15min":0.37},"min":{"1min":0.312,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54500000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.41599999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.68500000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.81499999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.621}]},{"osd":6,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75800000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.73899999999999999,"5min":0.87,"15min":0.87},"last":0.70499999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83899999999999997,"5min":0.879,"15min":0.879},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79700000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.68899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":355777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.316,"15min":0.29999999999999999},"min":{"1min":0.246,"5min":0.216,"15min":0.216},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.34999999999999998,"15min":0.33400000000000002},"min":{"1min":0.27600000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.48799999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.36299999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.376,"15min":0.36299999999999999},"min":{"1min":0.28100000000000003,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.33600000000000002,"15min":0.32200000000000001},"min":{"1min":0.25700000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.29199999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.377},"min":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.51600000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.41199999999999998,"15min":0.40300000000000002},"min":{"1min":0.27300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.39800000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":1.369,"15min":1.369},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83799999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61899999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.42099999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77800000000000002,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.748},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.66700000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79600000000000004,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61499999999999999,"15min":0.59299999999999997},"min":{"1min":0.495,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.77600000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.96699999999999997,"15min":1.115},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79400000000000004,"5min":11.138,"15min":11.138},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84499999999999997,"5min":1.429,"15min":1.429},"last":0.68300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298028,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073812,"statfs":{"total":96636764160,"available":96331583488,"internally_reserved":0,"allocated":757760,"data_stored":354824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.23999999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.42799999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.378},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.376,"15min":0.36699999999999999},"min":{"1min":0.27800000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.46100000000000002,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.30599999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.39700000000000002,"15min":0.377},"min":{"1min":0.255,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.44400000000000001,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.41399999999999998,"15min":0.39200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.45600000000000002,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.33300000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.379,"15min":0.36699999999999999},"min":{"1min":0.27100000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.44700000000000001,"5min":1.423,"15min":1.423},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.498,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.501}]},{"osd":4,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.56899999999999995},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84099999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.76900000000000002,"5min":1.304,"15min":1.304},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.76000000000000001,"5min":0.875,"15min":0.875},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77400000000000002,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.629,"15min":0.622},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82799999999999996,"5min":1.347,"15min":1.347},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77100000000000002,"5min":1.206,"15min":1.206},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.45800000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89500000000000002,"5min":1.385,"15min":1.385},"last":0.55600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":355777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.35699999999999998,"15min":0.36199999999999999},"min":{"1min":0.22700000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.44700000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.25700000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.53200000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.37}]},{"osd":1,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.36399999999999999,"15min":0.36599999999999999},"min":{"1min":0.23799999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48999999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39900000000000002,"15min":0.39700000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58499999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.42599999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.318,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51400000000000001,"5min":0.624,"15min":0.624},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.29399999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96599999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.42399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89300000000000002,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92300000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59099999999999997,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91100000000000003,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.628,"15min":0.63},"min":{"1min":0.443,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96399999999999997,"5min":1.391,"15min":1.391},"last":0.502}]},{"osd":7,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61199999999999999,"15min":0.59999999999999998},"min":{"1min":0.47299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.81899999999999995,"5min":0.874,"15min":0.874},"last":0.52300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":355777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.34300000000000003,"5min":0.217,"15min":0.217},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59099999999999997,"15min":0.57999999999999996},"min":{"1min":0.45700000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78600000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":1.028,"15min":1.238},"min":{"1min":0.39900000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74399999999999999,"5min":17.879999999999999,"15min":17.879999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":1.024,"15min":1.2230000000000001},"min":{"1min":0.45900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.74099999999999999,"5min":18.010999999999999,"15min":18.010999999999999},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.51700000000000002},"min":{"1min":0.436,"5min":0.309,"15min":0.309},"max":{"1min":0.72499999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72699999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.53600000000000003},"min":{"1min":0.434,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66600000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.373,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80300000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.42799999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.371,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.32700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.36799999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.53800000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.77400000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.40799999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82099999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":355777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.318,"5min":0.307,"15min":0.307},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.40799999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.439},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.38200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.48899999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.36799999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51200000000000001,"15min":0.51800000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.61099999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.503,"15min":0.504},"min":{"1min":0.34300000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69999999999999996,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.308}]},{"osd":6,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.52200000000000002},"min":{"1min":0.36899999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71399999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.41899999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73799999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.378},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71099999999999997,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.39700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:20:55.935 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:20:56.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.085+0000 7f679e01b700 1 Processor -- start 2023-10-06T02:20:56.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.085+0000 7f679e01b700 1 -- start start 2023-10-06T02:20:56.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.086+0000 7f679e01b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6798067d10 0x7f679806a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:56.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.086+0000 7f679e01b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f679815cde0 0x7f67980b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:56.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.086+0000 7f679e01b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67980b1ed0 con 0x7f679815ca10 2023-10-06T02:20:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.086+0000 7f679e01b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67980879c0 con 0x7f679815cde0 2023-10-06T02:20:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.086+0000 7f679e01b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67980cec50 con 0x7f6798067d10 2023-10-06T02:20:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.086+0000 7f67977fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f679815ca10 0x7f6798069f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52330/0 (socket says 172.21.15.6:52330) 2023-10-06T02:20:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.086+0000 7f67977fe700 1 -- 172.21.15.6:0/379398088 learned_addr learned my addr 172.21.15.6:0/379398088 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.087+0000 7f6797fff700 1 --2- 172.21.15.6:0/379398088 >> v2:172.21.15.175:3300/0 conn(0x7f679815cde0 0x7f67980b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.087+0000 7f6796ffd700 1 --2- 172.21.15.6:0/379398088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6798067d10 0x7f679806a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.087+0000 7f67967fc700 1 -- 172.21.15.6:0/379398088 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106247078 0 0) 0x7f67980b1ed0 con 0x7f679815ca10 2023-10-06T02:20:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.087+0000 7f67967fc700 1 -- 172.21.15.6:0/379398088 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6780003570 con 0x7f679815ca10 2023-10-06T02:20:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.087+0000 7f6797fff700 1 -- 172.21.15.6:0/379398088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6798067d10 msgr2=0x7f679806a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.087+0000 7f6797fff700 1 --2- 172.21.15.6:0/379398088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6798067d10 0x7f679806a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.087+0000 7f6797fff700 1 -- 172.21.15.6:0/379398088 >> v1:172.21.15.6:6789/0 conn(0x7f679815ca10 legacy=0x7f6798069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.087+0000 7f6797fff700 1 -- 172.21.15.6:0/379398088 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67980cef30 con 0x7f679815cde0 2023-10-06T02:20:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.087+0000 7f6796ffd700 1 --2- 172.21.15.6:0/379398088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6798067d10 0x7f679806a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:20:56.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.087+0000 7f6797fff700 1 --2- 172.21.15.6:0/379398088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f679815cde0 0x7f67980b2360 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6790009e60 tx=0x7f6790009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9f1a60ac7d41a0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:56.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.087+0000 7f67967fc700 1 -- 172.21.15.6:0/379398088 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679000e070 con 0x7f679815cde0 2023-10-06T02:20:56.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.087+0000 7f67967fc700 1 -- 172.21.15.6:0/379398088 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679000bab0 con 0x7f679815cde0 2023-10-06T02:20:56.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.087+0000 7f67967fc700 1 -- 172.21.15.6:0/379398088 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679000be70 con 0x7f679815cde0 2023-10-06T02:20:56.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.088+0000 7f679e01b700 1 -- 172.21.15.6:0/379398088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f679815cde0 msgr2=0x7f67980b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:56.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.088+0000 7f679e01b700 1 --2- 172.21.15.6:0/379398088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f679815cde0 0x7f67980b2360 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6790009e60 tx=0x7f6790009780 comp rx=0 tx=0).stop 2023-10-06T02:20:56.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.088+0000 7f679e01b700 1 -- 172.21.15.6:0/379398088 shutdown_connections 2023-10-06T02:20:56.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.088+0000 7f679e01b700 1 --2- 172.21.15.6:0/379398088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f679815cde0 0x7f67980b2360 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.088+0000 7f679e01b700 1 --2- 172.21.15.6:0/379398088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6798067d10 0x7f679806a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.088+0000 7f679e01b700 1 -- 172.21.15.6:0/379398088 >> 172.21.15.6:0/379398088 conn(0x7f6798067910 msgr2=0x7f67980ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:56.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.088+0000 7f679e01b700 1 -- 172.21.15.6:0/379398088 shutdown_connections 2023-10-06T02:20:56.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.088+0000 7f679e01b700 1 -- 172.21.15.6:0/379398088 wait complete. 2023-10-06T02:20:56.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.089+0000 7f679e01b700 1 Processor -- start 2023-10-06T02:20:56.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.089+0000 7f679e01b700 1 -- start start 2023-10-06T02:20:56.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f679e01b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6798067d10 0x7f6798169730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:56.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f679e01b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f679815ca10 0x7f679816c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:56.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f679e01b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f679815cde0 0x7f679809add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:56.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f679e01b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679816cb20 con 0x7f6798067d10 2023-10-06T02:20:56.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f679e01b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679815e8d0 con 0x7f679815ca10 2023-10-06T02:20:56.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f679e01b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679809bb50 con 0x7f679815cde0 2023-10-06T02:20:56.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f67977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6798067d10 0x7f6798169730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:56.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f67977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6798067d10 0x7f6798169730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54800/0 (socket says 172.21.15.6:54800) 2023-10-06T02:20:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f67977fe700 1 -- 172.21.15.6:0/2785812396 learned_addr learned my addr 172.21.15.6:0/2785812396 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f6797fff700 1 --2- 172.21.15.6:0/2785812396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f679815cde0 0x7f679809add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f6796ffd700 1 --2- 172.21.15.6:0/2785812396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f679815ca10 0x7f679816c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f67977fe700 1 -- 172.21.15.6:0/2785812396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f679815cde0 msgr2=0x7f679809add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f67977fe700 1 --2- 172.21.15.6:0/2785812396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f679815cde0 0x7f679809add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f67977fe700 1 -- 172.21.15.6:0/2785812396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f679815ca10 msgr2=0x7f679816c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f67977fe700 1 --2- 172.21.15.6:0/2785812396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f679815ca10 0x7f679816c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f67977fe700 1 -- 172.21.15.6:0/2785812396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c009420 con 0x7f6798067d10 2023-10-06T02:20:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f6797fff700 1 --2- 172.21.15.6:0/2785812396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f679815cde0 0x7f679809add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:20:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f67977fe700 1 --2- 172.21.15.6:0/2785812396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6798067d10 0x7f6798169730 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f678800c790 tx=0x7f6788007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.090+0000 7f677f7fe700 1 -- 172.21.15.6:0/2785812396 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880072e0 con 0x7f6798067d10 2023-10-06T02:20:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.091+0000 7f677f7fe700 1 -- 172.21.15.6:0/2785812396 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6788007440 con 0x7f6798067d10 2023-10-06T02:20:56.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.091+0000 7f679e01b700 1 -- 172.21.15.6:0/2785812396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6790009a20 con 0x7f6798067d10 2023-10-06T02:20:56.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.091+0000 7f677f7fe700 1 -- 172.21.15.6:0/2785812396 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880057f0 con 0x7f6798067d10 2023-10-06T02:20:56.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.091+0000 7f679e01b700 1 -- 172.21.15.6:0/2785812396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679815e280 con 0x7f6798067d10 2023-10-06T02:20:56.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.092+0000 7f679e01b700 1 -- 172.21.15.6:0/2785812396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679806e8d0 con 0x7f6798067d10 2023-10-06T02:20:56.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.092+0000 7f677f7fe700 1 -- 172.21.15.6:0/2785812396 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6788005c20 con 0x7f6798067d10 2023-10-06T02:20:56.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.092+0000 7f677f7fe700 1 --2- 172.21.15.6:0/2785812396 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6784066f30 0x7f67840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:56.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.092+0000 7f677f7fe700 1 -- 172.21.15.6:0/2785812396 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6788083c30 con 0x7f6798067d10 2023-10-06T02:20:56.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.093+0000 7f6796ffd700 1 --2- 172.21.15.6:0/2785812396 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6784066f30 0x7f67840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:56.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.093+0000 7f6796ffd700 1 --2- 172.21.15.6:0/2785812396 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6784066f30 0x7f67840693e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6798098fa0 tx=0x7f678c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:56.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.097+0000 7f677f7fe700 1 -- 172.21.15.6:0/2785812396 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f678804b5a0 con 0x7f6798067d10 2023-10-06T02:20:56.133 INFO:tasks.ceph.mds.b.smithi175.stderr:2023-10-06T02:20:56.132+0000 7f1929c06700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:20:56.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.288+0000 7f679e01b700 1 -- 172.21.15.6:0/2785812396 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f679815ea10 con 0x7f6784066f30 2023-10-06T02:20:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.297+0000 7f677f7fe700 1 -- 172.21.15.6:0/2785812396 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300900 (secure 0 0 0) 0x7f678c01a030 con 0x7f6784066f30 2023-10-06T02:20:56.301 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.300+0000 7f679e01b700 1 -- 172.21.15.6:0/2785812396 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6784066f30 msgr2=0x7f67840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.300+0000 7f679e01b700 1 --2- 172.21.15.6:0/2785812396 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6784066f30 0x7f67840693e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6798098fa0 tx=0x7f678c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.300+0000 7f679e01b700 1 -- 172.21.15.6:0/2785812396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6798067d10 msgr2=0x7f6798169730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.300+0000 7f679e01b700 1 --2- 172.21.15.6:0/2785812396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6798067d10 0x7f6798169730 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f678800c790 tx=0x7f6788007c80 comp rx=0 tx=0).stop 2023-10-06T02:20:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.300+0000 7f679e01b700 1 -- 172.21.15.6:0/2785812396 shutdown_connections 2023-10-06T02:20:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.300+0000 7f679e01b700 1 --2- 172.21.15.6:0/2785812396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f679815cde0 0x7f679809add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.300+0000 7f679e01b700 1 --2- 172.21.15.6:0/2785812396 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6784066f30 0x7f67840693e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.300+0000 7f679e01b700 1 --2- 172.21.15.6:0/2785812396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6798067d10 0x7f6798169730 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.300+0000 7f679e01b700 1 --2- 172.21.15.6:0/2785812396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f679815ca10 0x7f679816c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.300+0000 7f679e01b700 1 -- 172.21.15.6:0/2785812396 >> 172.21.15.6:0/2785812396 conn(0x7f6798067910 msgr2=0x7f679815a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.301+0000 7f679e01b700 1 -- 172.21.15.6:0/2785812396 shutdown_connections 2023-10-06T02:20:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.301+0000 7f679e01b700 1 -- 172.21.15.6:0/2785812396 wait complete. 2023-10-06T02:20:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:20:56.313 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2023-10-06T02:20:54.606965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385404,"kb_used_data":7100,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589316,"statfs":{"total":773094113280,"available":770651459584,"internally_reserved":0,"allocated":7270400,"data_stored":4024093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.813335"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.801938+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:51.759990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.795240+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:39.212586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797535+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:10.251809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.796108+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:22.450446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.794732+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:26.989620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797080+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:04.614360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.798892+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:50.457608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797238+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:17.253149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797930+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:39.212586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.796098+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:00.353785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.794270+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:39.657314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.799332+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:26.911597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.799267+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:34.978104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.796640+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:14.312615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.798061+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:34:00.963280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797476+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:33.539246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.796119+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:23.943816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797851+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:50:41.193249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797240+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:54.583881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.795267+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:10.251809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797465+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:19.970590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.799242+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:04.614360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797498+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:24.123927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.795751+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:59:17.385955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.798968+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:59.586917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:47.733584+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:20:47.733584+0000","last_peered":"2023-10-06T02:20:47.733584+0000","last_clean":"2023-10-06T02:20:47.733584+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:20:47.733584+0000","last_undegraded":"2023-10-06T02:20:47.733584+0000","last_fullsized":"2023-10-06T02:20:47.733584+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.796835+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:50.457608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:47.733238+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:20:47.733238+0000","last_peered":"2023-10-06T02:20:47.733238+0000","last_clean":"2023-10-06T02:20:47.733238+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:20:47.733238+0000","last_undegraded":"2023-10-06T02:20:47.733238+0000","last_fullsized":"2023-10-06T02:20:47.733238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.795266+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:24.123927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:46.786772+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:20:46.786772+0000","last_peered":"2023-10-06T02:20:46.786772+0000","last_clean":"2023-10-06T02:20:46.786772+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:20:46.786772+0000","last_undegraded":"2023-10-06T02:20:46.786772+0000","last_fullsized":"2023-10-06T02:20:46.786772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":200,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:47.447129+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:20:47.447129+0000","last_peered":"2023-10-06T02:20:47.447129+0000","last_clean":"2023-10-06T02:20:47.447129+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:20:47.447129+0000","last_undegraded":"2023-10-06T02:20:47.447129+0000","last_fullsized":"2023-10-06T02:20:47.447129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.797558+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:12.524357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":50,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:47.447140+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:20:47.447140+0000","last_peered":"2023-10-06T02:20:47.447140+0000","last_clean":"2023-10-06T02:20:47.447140+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:20:47.447140+0000","last_undegraded":"2023-10-06T02:20:47.447140+0000","last_fullsized":"2023-10-06T02:20:47.447140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.796058+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:35.323489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":50,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:47.447121+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:20:47.447121+0000","last_peered":"2023-10-06T02:20:47.447121+0000","last_clean":"2023-10-06T02:20:47.447121+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:20:47.447121+0000","last_undegraded":"2023-10-06T02:20:47.447121+0000","last_fullsized":"2023-10-06T02:20:47.447121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.796036+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:22:06.526588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:46.789880+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:20:46.789880+0000","last_peered":"2023-10-06T02:20:46.789880+0000","last_clean":"2023-10-06T02:20:46.789880+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:20:46.789880+0000","last_undegraded":"2023-10-06T02:20:46.789880+0000","last_fullsized":"2023-10-06T02:20:46.789880+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.796498+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:35:37.594405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":50,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:47.733700+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:20:47.733700+0000","last_peered":"2023-10-06T02:20:47.733700+0000","last_clean":"2023-10-06T02:20:47.733700+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:20:47.733700+0000","last_undegraded":"2023-10-06T02:20:47.733700+0000","last_fullsized":"2023-10-06T02:20:47.733700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:20:50.791970+0000","last_change":"2023-10-06T02:20:50.791970+0000","last_active":"2023-10-06T02:20:50.791970+0000","last_peered":"2023-10-06T02:20:50.791970+0000","last_clean":"2023-10-06T02:20:50.791970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:50.791970+0000","last_undegraded":"2023-10-06T02:20:50.791970+0000","last_fullsized":"2023-10-06T02:20:50.791970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:20:49.787044+0000","last_change":"2023-10-06T02:20:49.801853+0000","last_active":"2023-10-06T02:20:49.787044+0000","last_peered":"2023-10-06T02:20:49.787044+0000","last_clean":"2023-10-06T02:20:49.787044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:20:49.787044+0000","last_undegraded":"2023-10-06T02:20:49.787044+0000","last_fullsized":"2023-10-06T02:20:49.787044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:45.187739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":50,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-06T02:20:47.733737+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:20:47.733737+0000","last_peered":"2023-10-06T02:20:47.733737+0000","last_clean":"2023-10-06T02:20:47.733737+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:20:47.733737+0000","last_undegraded":"2023-10-06T02:20:47.733737+0000","last_fullsized":"2023-10-06T02:20:47.733737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298612,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073228,"statfs":{"total":96636764160,"available":96330985472,"internally_reserved":0,"allocated":1355776,"data_stored":946145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.377,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":1.111,"15min":1.111},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.47999999999999998},"min":{"1min":0.30499999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80600000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.35899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86299999999999999,"5min":1.008,"15min":1.008},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.505},"min":{"1min":0.36699999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70499999999999996,"5min":1.075,"15min":1.075},"last":0.504}]},{"osd":2,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82199999999999995,"5min":1.149,"15min":1.149},"last":0.442},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.56699999999999995},"min":{"1min":0.49199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77400000000000002,"5min":1.048,"15min":1.048},"last":0.52900000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45900000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79200000000000004,"5min":1.175,"15min":1.175},"last":0.374},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.56299999999999994},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83799999999999997,"5min":1.03,"15min":1.03},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.41599999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75800000000000001,"5min":0.873,"15min":0.873},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80300000000000005,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.39500000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.71199999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55800000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84799999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78600000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.77800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298028,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073812,"statfs":{"total":96636764160,"available":96331583488,"internally_reserved":0,"allocated":757760,"data_stored":354824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.76300000000000001,"15min":0.84699999999999998},"min":{"1min":0.44800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82399999999999995,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.76600000000000001,"15min":0.85899999999999999},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82799999999999996,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":0.70799999999999996}]},{"osd":1,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.748},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.433,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.58699999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.88800000000000001,"15min":1.04},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77700000000000002,"5min":8.8659999999999997,"15min":8.8659999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.35599999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.65100000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.98499999999999999,"15min":1.157},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86799999999999999,"5min":10.659000000000001,"15min":10.659000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57699999999999996}]},{"osd":4,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.36899999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70099999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54200000000000004,"15min":0.55300000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.70799999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72199999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.754,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.49099999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.38100000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.64200000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.53400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298608,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073232,"statfs":{"total":96636764160,"available":96330989568,"internally_reserved":0,"allocated":1351680,"data_stored":945192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.34300000000000003},"min":{"1min":0.23499999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.379},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.28100000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53100000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.434}]},{"osd":2,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.32600000000000001,"15min":0.317},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.499,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.379,"15min":0.375},"min":{"1min":0.28999999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51900000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.46899999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.38300000000000001,"15min":0.37},"min":{"1min":0.312,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54500000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.41599999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.68500000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.81499999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.621}]},{"osd":6,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75800000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.73899999999999999,"5min":0.87,"15min":0.87},"last":0.70499999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83899999999999997,"5min":0.879,"15min":0.879},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79700000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.68899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":355777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.316,"15min":0.29999999999999999},"min":{"1min":0.246,"5min":0.216,"15min":0.216},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.34999999999999998,"15min":0.33400000000000002},"min":{"1min":0.27600000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.48799999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.36299999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.376,"15min":0.36299999999999999},"min":{"1min":0.28100000000000003,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.33600000000000002,"15min":0.32200000000000001},"min":{"1min":0.25700000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.29199999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.377},"min":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.51600000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.41199999999999998,"15min":0.40300000000000002},"min":{"1min":0.27300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.39800000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":1.369,"15min":1.369},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83799999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61899999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.42099999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77800000000000002,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.748},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.66700000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79600000000000004,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61499999999999999,"15min":0.59299999999999997},"min":{"1min":0.495,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.77600000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.96699999999999997,"15min":1.115},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79400000000000004,"5min":11.138,"15min":11.138},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84499999999999997,"5min":1.429,"15min":1.429},"last":0.68300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298028,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073812,"statfs":{"total":96636764160,"available":96331583488,"internally_reserved":0,"allocated":757760,"data_stored":354824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.23999999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.42799999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.378},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.376,"15min":0.36699999999999999},"min":{"1min":0.27800000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.46100000000000002,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.30599999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.39700000000000002,"15min":0.377},"min":{"1min":0.255,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.44400000000000001,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.41399999999999998,"15min":0.39200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.45600000000000002,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.33300000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.379,"15min":0.36699999999999999},"min":{"1min":0.27100000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.44700000000000001,"5min":1.423,"15min":1.423},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.498,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.501}]},{"osd":4,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.56899999999999995},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84099999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.76900000000000002,"5min":1.304,"15min":1.304},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.76000000000000001,"5min":0.875,"15min":0.875},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77400000000000002,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.629,"15min":0.622},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82799999999999996,"5min":1.347,"15min":1.347},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77100000000000002,"5min":1.206,"15min":1.206},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.45800000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89500000000000002,"5min":1.385,"15min":1.385},"last":0.55600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":355777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.35699999999999998,"15min":0.36199999999999999},"min":{"1min":0.22700000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.44700000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.25700000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.53200000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.37}]},{"osd":1,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.36399999999999999,"15min":0.36599999999999999},"min":{"1min":0.23799999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48999999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39900000000000002,"15min":0.39700000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58499999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.42599999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.318,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51400000000000001,"5min":0.624,"15min":0.624},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.29399999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96599999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.42399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89300000000000002,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92300000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59099999999999997,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91100000000000003,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.628,"15min":0.63},"min":{"1min":0.443,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96399999999999997,"5min":1.391,"15min":1.391},"last":0.502}]},{"osd":7,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61199999999999999,"15min":0.59999999999999998},"min":{"1min":0.47299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.81899999999999995,"5min":0.874,"15min":0.874},"last":0.52300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":355777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.34300000000000003,"5min":0.217,"15min":0.217},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59099999999999997,"15min":0.57999999999999996},"min":{"1min":0.45700000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78600000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":1.028,"15min":1.238},"min":{"1min":0.39900000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74399999999999999,"5min":17.879999999999999,"15min":17.879999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":1.024,"15min":1.2230000000000001},"min":{"1min":0.45900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.74099999999999999,"5min":18.010999999999999,"15min":18.010999999999999},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.51700000000000002},"min":{"1min":0.436,"5min":0.309,"15min":0.309},"max":{"1min":0.72499999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72699999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.53600000000000003},"min":{"1min":0.434,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66600000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.373,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80300000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.42799999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.371,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.32700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.36799999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.53800000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.77400000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.40799999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82099999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":355777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.318,"5min":0.307,"15min":0.307},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.40799999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.439},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.38200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.48899999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.36799999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51200000000000001,"15min":0.51800000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.61099999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.503,"15min":0.504},"min":{"1min":0.34300000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69999999999999996,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.308}]},{"osd":6,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.52200000000000002},"min":{"1min":0.36899999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71399999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.41899999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73799999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.378},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71099999999999997,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.39700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:20:56.328 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:20:56.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.471+0000 7f1ae9abf700 1 Processor -- start 2023-10-06T02:20:56.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.471+0000 7f1ae9abf700 1 -- start start 2023-10-06T02:20:56.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.472+0000 7f1ae9abf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ae40af4e0 0x7f1ae40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:56.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.472+0000 7f1ae9abf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae415e190 con 0x7f1ae40af8b0 2023-10-06T02:20:56.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.472+0000 7f1ae9abf700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae40cb650 con 0x7f1ae415db70 2023-10-06T02:20:56.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.472+0000 7f1ae9abf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae40b1910 con 0x7f1ae40af4e0 2023-10-06T02:20:56.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.472+0000 7f1ae37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ae40af4e0 0x7f1ae40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.472+0000 7f1ae2ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1ae40af8b0 0x7f1ae415d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52342/0 (socket says 172.21.15.6:52342) 2023-10-06T02:20:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.472+0000 7f1ae2ffd700 1 -- 172.21.15.6:0/1751789067 learned_addr learned my addr 172.21.15.6:0/1751789067 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.473+0000 7f1ae37fe700 1 -- 172.21.15.6:0/1751789067 >> v1:172.21.15.175:6789/0 conn(0x7f1ae415db70 legacy=0x7f1ae40cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.473+0000 7f1ae37fe700 1 -- 172.21.15.6:0/1751789067 >> v1:172.21.15.6:6789/0 conn(0x7f1ae40af8b0 legacy=0x7f1ae415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.473+0000 7f1ae37fe700 1 -- 172.21.15.6:0/1751789067 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae40cad20 con 0x7f1ae40af4e0 2023-10-06T02:20:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.473+0000 7f1ae37fe700 1 --2- 172.21.15.6:0/1751789067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ae40af4e0 0x7f1ae40b20e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40098e0 tx=0x7f1ad40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81be33a1d568e1cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.473+0000 7f1ae27fc700 1 -- 172.21.15.6:0/1751789067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4009e80 con 0x7f1ae40af4e0 2023-10-06T02:20:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.473+0000 7f1ae27fc700 1 -- 172.21.15.6:0/1751789067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad400b860 con 0x7f1ae40af4e0 2023-10-06T02:20:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.473+0000 7f1ae27fc700 1 -- 172.21.15.6:0/1751789067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad400bbe0 con 0x7f1ae40af4e0 2023-10-06T02:20:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.474+0000 7f1ae9abf700 1 -- 172.21.15.6:0/1751789067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ae40af4e0 msgr2=0x7f1ae40b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.474+0000 7f1ae9abf700 1 --2- 172.21.15.6:0/1751789067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ae40af4e0 0x7f1ae40b20e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40098e0 tx=0x7f1ad40091a0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.474+0000 7f1ae9abf700 1 -- 172.21.15.6:0/1751789067 shutdown_connections 2023-10-06T02:20:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.474+0000 7f1ae9abf700 1 --2- 172.21.15.6:0/1751789067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ae40af4e0 0x7f1ae40b20e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.474+0000 7f1ae9abf700 1 -- 172.21.15.6:0/1751789067 >> 172.21.15.6:0/1751789067 conn(0x7f1ae4068680 msgr2=0x7f1ae4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.474+0000 7f1ae9abf700 1 -- 172.21.15.6:0/1751789067 shutdown_connections 2023-10-06T02:20:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.474+0000 7f1ae9abf700 1 -- 172.21.15.6:0/1751789067 wait complete. 2023-10-06T02:20:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.475+0000 7f1ae9abf700 1 Processor -- start 2023-10-06T02:20:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.475+0000 7f1ae9abf700 1 -- start start 2023-10-06T02:20:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.476+0000 7f1ae9abf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ae40af4e0 0x7f1ae414d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.476+0000 7f1ae9abf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ae40af8b0 0x7f1ae414c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.476+0000 7f1ae9abf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ae415db70 0x7f1ae40a6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.476+0000 7f1ae9abf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae40c97d0 con 0x7f1ae415db70 2023-10-06T02:20:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.476+0000 7f1ae9abf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae414d9a0 con 0x7f1ae40af4e0 2023-10-06T02:20:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.476+0000 7f1ae9abf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae40c8bc0 con 0x7f1ae40af8b0 2023-10-06T02:20:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.476+0000 7f1ae3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ae415db70 0x7f1ae40a6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.476+0000 7f1ae3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ae415db70 0x7f1ae40a6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54828/0 (socket says 172.21.15.6:54828) 2023-10-06T02:20:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.476+0000 7f1ae3fff700 1 -- 172.21.15.6:0/1739026127 learned_addr learned my addr 172.21.15.6:0/1739026127 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.476+0000 7f1ae37fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ae40af4e0 0x7f1ae414d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.476+0000 7f1ae2ffd700 1 --2- 172.21.15.6:0/1739026127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ae40af8b0 0x7f1ae414c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.476+0000 7f1ae3fff700 1 -- 172.21.15.6:0/1739026127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ae40af8b0 msgr2=0x7f1ae414c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.476+0000 7f1ae3fff700 1 --2- 172.21.15.6:0/1739026127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ae40af8b0 0x7f1ae414c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.476+0000 7f1ae3fff700 1 -- 172.21.15.6:0/1739026127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ae40af4e0 msgr2=0x7f1ae414d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.476+0000 7f1ae3fff700 1 --2- 172.21.15.6:0/1739026127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ae40af4e0 0x7f1ae414d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.476+0000 7f1ae3fff700 1 -- 172.21.15.6:0/1739026127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4009420 con 0x7f1ae415db70 2023-10-06T02:20:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.476+0000 7f1ae3fff700 1 --2- 172.21.15.6:0/1739026127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ae415db70 0x7f1ae40a6ee0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1adc00c8e0 tx=0x7f1adc001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.477+0000 7f1acb7fe700 1 -- 172.21.15.6:0/1739026127 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc012630 con 0x7f1ae415db70 2023-10-06T02:20:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.477+0000 7f1acb7fe700 1 -- 172.21.15.6:0/1739026127 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc012790 con 0x7f1ae415db70 2023-10-06T02:20:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.477+0000 7f1ae9abf700 1 -- 172.21.15.6:0/1739026127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae40c8ea0 con 0x7f1ae415db70 2023-10-06T02:20:56.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.477+0000 7f1acb7fe700 1 -- 172.21.15.6:0/1739026127 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc012b50 con 0x7f1ae415db70 2023-10-06T02:20:56.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.477+0000 7f1ae9abf700 1 -- 172.21.15.6:0/1739026127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae40c9460 con 0x7f1ae415db70 2023-10-06T02:20:56.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.478+0000 7f1ae9abf700 1 -- 172.21.15.6:0/1739026127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae40c9980 con 0x7f1ae415db70 2023-10-06T02:20:56.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.478+0000 7f1acb7fe700 1 -- 172.21.15.6:0/1739026127 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1adc01a3a0 con 0x7f1ae415db70 2023-10-06T02:20:56.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.478+0000 7f1acb7fe700 1 --2- 172.21.15.6:0/1739026127 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ad0066f30 0x7f1ad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:56.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.478+0000 7f1acb7fe700 1 -- 172.21.15.6:0/1739026127 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1adc0849b0 con 0x7f1ae415db70 2023-10-06T02:20:56.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.479+0000 7f1ae37fe700 1 --2- 172.21.15.6:0/1739026127 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ad0066f30 0x7f1ad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:56.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.480+0000 7f1ae37fe700 1 --2- 172.21.15.6:0/1739026127 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ad0066f30 0x7f1ad00693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40093f0 tx=0x7f1ad4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:56.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.483+0000 7f1acb7fe700 1 -- 172.21.15.6:0/1739026127 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ae40c9980 con 0x7f1ae415db70 2023-10-06T02:20:56.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.672+0000 7f1ae9abf700 1 -- 172.21.15.6:0/1739026127 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ae40afcc0 con 0x7f1ad0066f30 2023-10-06T02:20:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.681+0000 7f1acb7fe700 1 -- 172.21.15.6:0/1739026127 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311590 (secure 0 0 0) 0x7f1ae40afcc0 con 0x7f1ad0066f30 2023-10-06T02:20:56.688 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:56.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.684+0000 7f1ae9abf700 1 -- 172.21.15.6:0/1739026127 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ad0066f30 msgr2=0x7f1ad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:56.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.684+0000 7f1ae9abf700 1 --2- 172.21.15.6:0/1739026127 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ad0066f30 0x7f1ad00693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40093f0 tx=0x7f1ad4017000 comp rx=0 tx=0).stop 2023-10-06T02:20:56.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.684+0000 7f1ae9abf700 1 -- 172.21.15.6:0/1739026127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ae415db70 msgr2=0x7f1ae40a6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:56.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.684+0000 7f1ae9abf700 1 --2- 172.21.15.6:0/1739026127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ae415db70 0x7f1ae40a6ee0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1adc00c8e0 tx=0x7f1adc001710 comp rx=0 tx=0).stop 2023-10-06T02:20:56.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.685+0000 7f1ae9abf700 1 -- 172.21.15.6:0/1739026127 shutdown_connections 2023-10-06T02:20:56.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.685+0000 7f1ae9abf700 1 --2- 172.21.15.6:0/1739026127 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ad0066f30 0x7f1ad00693e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.685+0000 7f1ae9abf700 1 --2- 172.21.15.6:0/1739026127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ae415db70 0x7f1ae40a6ee0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.685+0000 7f1ae9abf700 1 --2- 172.21.15.6:0/1739026127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ae40af4e0 0x7f1ae414d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.685+0000 7f1ae9abf700 1 --2- 172.21.15.6:0/1739026127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ae40af8b0 0x7f1ae414c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.685+0000 7f1ae9abf700 1 -- 172.21.15.6:0/1739026127 >> 172.21.15.6:0/1739026127 conn(0x7f1ae4068680 msgr2=0x7f1ae415cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:56.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.685+0000 7f1ae9abf700 1 -- 172.21.15.6:0/1739026127 shutdown_connections 2023-10-06T02:20:56.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.685+0000 7f1ae9abf700 1 -- 172.21.15.6:0/1739026127 wait complete. 2023-10-06T02:20:56.693 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:20:56.697 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2023-10-06T02:20:56.607411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385756,"kb_used_data":7452,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588964,"statfs":{"total":773094113280,"available":770651099136,"internally_reserved":0,"allocated":7630848,"data_stored":4199369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001332"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838094+0000","last_change":"2023-10-06T02:20:51.833161+0000","last_active":"2023-10-06T02:20:51.838094+0000","last_peered":"2023-10-06T02:20:51.838094+0000","last_clean":"2023-10-06T02:20:51.838094+0000","last_became_active":"2023-10-06T02:20:51.832806+0000","last_became_peered":"2023-10-06T02:20:51.832806+0000","last_unstale":"2023-10-06T02:20:51.838094+0000","last_undegraded":"2023-10-06T02:20:51.838094+0000","last_fullsized":"2023-10-06T02:20:51.838094+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:22.524253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838203+0000","last_change":"2023-10-06T02:20:51.832644+0000","last_active":"2023-10-06T02:20:51.838203+0000","last_peered":"2023-10-06T02:20:51.838203+0000","last_clean":"2023-10-06T02:20:51.838203+0000","last_became_active":"2023-10-06T02:20:51.832111+0000","last_became_peered":"2023-10-06T02:20:51.832111+0000","last_unstale":"2023-10-06T02:20:51.838203+0000","last_undegraded":"2023-10-06T02:20:51.838203+0000","last_fullsized":"2023-10-06T02:20:51.838203+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:17.290467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.823910+0000","last_change":"2023-10-06T02:20:51.818576+0000","last_active":"2023-10-06T02:20:51.823910+0000","last_peered":"2023-10-06T02:20:51.823910+0000","last_clean":"2023-10-06T02:20:51.823910+0000","last_became_active":"2023-10-06T02:20:51.818282+0000","last_became_peered":"2023-10-06T02:20:51.818282+0000","last_unstale":"2023-10-06T02:20:51.823910+0000","last_undegraded":"2023-10-06T02:20:51.823910+0000","last_fullsized":"2023-10-06T02:20:51.823910+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:07.959025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829576+0000","last_change":"2023-10-06T02:20:51.828039+0000","last_active":"2023-10-06T02:20:51.829576+0000","last_peered":"2023-10-06T02:20:51.829576+0000","last_clean":"2023-10-06T02:20:51.829576+0000","last_became_active":"2023-10-06T02:20:51.827793+0000","last_became_peered":"2023-10-06T02:20:51.827793+0000","last_unstale":"2023-10-06T02:20:51.829576+0000","last_undegraded":"2023-10-06T02:20:51.829576+0000","last_fullsized":"2023-10-06T02:20:51.829576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:26.648876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830905+0000","last_change":"2023-10-06T02:20:51.824928+0000","last_active":"2023-10-06T02:20:51.830905+0000","last_peered":"2023-10-06T02:20:51.830905+0000","last_clean":"2023-10-06T02:20:51.830905+0000","last_became_active":"2023-10-06T02:20:51.824649+0000","last_became_peered":"2023-10-06T02:20:51.824649+0000","last_unstale":"2023-10-06T02:20:51.830905+0000","last_undegraded":"2023-10-06T02:20:51.830905+0000","last_fullsized":"2023-10-06T02:20:51.830905+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:27.916523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838132+0000","last_change":"2023-10-06T02:20:51.832649+0000","last_active":"2023-10-06T02:20:51.838132+0000","last_peered":"2023-10-06T02:20:51.838132+0000","last_clean":"2023-10-06T02:20:51.838132+0000","last_became_active":"2023-10-06T02:20:51.832210+0000","last_became_peered":"2023-10-06T02:20:51.832210+0000","last_unstale":"2023-10-06T02:20:51.838132+0000","last_undegraded":"2023-10-06T02:20:51.838132+0000","last_fullsized":"2023-10-06T02:20:51.838132+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:52.764916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.818048+0000","last_change":"2023-10-06T02:20:51.816289+0000","last_active":"2023-10-06T02:20:51.818048+0000","last_peered":"2023-10-06T02:20:51.818048+0000","last_clean":"2023-10-06T02:20:51.818048+0000","last_became_active":"2023-10-06T02:20:51.816011+0000","last_became_peered":"2023-10-06T02:20:51.816011+0000","last_unstale":"2023-10-06T02:20:51.818048+0000","last_undegraded":"2023-10-06T02:20:51.818048+0000","last_fullsized":"2023-10-06T02:20:51.818048+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:11.256735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838053+0000","last_change":"2023-10-06T02:20:51.830772+0000","last_active":"2023-10-06T02:20:51.838053+0000","last_peered":"2023-10-06T02:20:51.838053+0000","last_clean":"2023-10-06T02:20:51.838053+0000","last_became_active":"2023-10-06T02:20:51.830511+0000","last_became_peered":"2023-10-06T02:20:51.830511+0000","last_unstale":"2023-10-06T02:20:51.838053+0000","last_undegraded":"2023-10-06T02:20:51.838053+0000","last_fullsized":"2023-10-06T02:20:51.838053+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:34:01.968206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830038+0000","last_change":"2023-10-06T02:20:51.827652+0000","last_active":"2023-10-06T02:20:51.830038+0000","last_peered":"2023-10-06T02:20:51.830038+0000","last_clean":"2023-10-06T02:20:51.830038+0000","last_became_active":"2023-10-06T02:20:51.826951+0000","last_became_peered":"2023-10-06T02:20:51.826951+0000","last_unstale":"2023-10-06T02:20:51.830038+0000","last_undegraded":"2023-10-06T02:20:51.830038+0000","last_fullsized":"2023-10-06T02:20:51.830038+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:32.371220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830500+0000","last_change":"2023-10-06T02:20:51.823449+0000","last_active":"2023-10-06T02:20:51.830500+0000","last_peered":"2023-10-06T02:20:51.830500+0000","last_clean":"2023-10-06T02:20:51.830500+0000","last_became_active":"2023-10-06T02:20:51.823206+0000","last_became_peered":"2023-10-06T02:20:51.823206+0000","last_unstale":"2023-10-06T02:20:51.830500+0000","last_undegraded":"2023-10-06T02:20:51.830500+0000","last_fullsized":"2023-10-06T02:20:51.830500+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:06.182600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.826736+0000","last_change":"2023-10-06T02:20:51.824383+0000","last_active":"2023-10-06T02:20:51.826736+0000","last_peered":"2023-10-06T02:20:51.826736+0000","last_clean":"2023-10-06T02:20:51.826736+0000","last_became_active":"2023-10-06T02:20:51.824143+0000","last_became_peered":"2023-10-06T02:20:51.824143+0000","last_unstale":"2023-10-06T02:20:51.826736+0000","last_undegraded":"2023-10-06T02:20:51.826736+0000","last_fullsized":"2023-10-06T02:20:51.826736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:16.074398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.828337+0000","last_change":"2023-10-06T02:20:51.823286+0000","last_active":"2023-10-06T02:20:51.828337+0000","last_peered":"2023-10-06T02:20:51.828337+0000","last_clean":"2023-10-06T02:20:51.828337+0000","last_became_active":"2023-10-06T02:20:51.822843+0000","last_became_peered":"2023-10-06T02:20:51.822843+0000","last_unstale":"2023-10-06T02:20:51.828337+0000","last_undegraded":"2023-10-06T02:20:51.828337+0000","last_fullsized":"2023-10-06T02:20:51.828337+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:34.666306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830947+0000","last_change":"2023-10-06T02:20:51.827347+0000","last_active":"2023-10-06T02:20:51.830947+0000","last_peered":"2023-10-06T02:20:51.830947+0000","last_clean":"2023-10-06T02:20:51.830947+0000","last_became_active":"2023-10-06T02:20:51.827067+0000","last_became_peered":"2023-10-06T02:20:51.827067+0000","last_unstale":"2023-10-06T02:20:51.830947+0000","last_undegraded":"2023-10-06T02:20:51.830947+0000","last_fullsized":"2023-10-06T02:20:51.830947+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:38.335002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.824189+0000","last_change":"2023-10-06T02:20:51.819988+0000","last_active":"2023-10-06T02:20:51.824189+0000","last_peered":"2023-10-06T02:20:51.824189+0000","last_clean":"2023-10-06T02:20:51.824189+0000","last_became_active":"2023-10-06T02:20:51.819699+0000","last_became_peered":"2023-10-06T02:20:51.819699+0000","last_unstale":"2023-10-06T02:20:51.824189+0000","last_undegraded":"2023-10-06T02:20:51.824189+0000","last_fullsized":"2023-10-06T02:20:51.824189+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:22:07.531514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.821210+0000","last_change":"2023-10-06T02:20:51.818432+0000","last_active":"2023-10-06T02:20:51.821210+0000","last_peered":"2023-10-06T02:20:51.821210+0000","last_clean":"2023-10-06T02:20:51.821210+0000","last_became_active":"2023-10-06T02:20:51.818132+0000","last_became_peered":"2023-10-06T02:20:51.818132+0000","last_unstale":"2023-10-06T02:20:51.821210+0000","last_undegraded":"2023-10-06T02:20:51.821210+0000","last_fullsized":"2023-10-06T02:20:51.821210+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:27.994546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831034+0000","last_change":"2023-10-06T02:20:51.823644+0000","last_active":"2023-10-06T02:20:51.831034+0000","last_peered":"2023-10-06T02:20:51.831034+0000","last_clean":"2023-10-06T02:20:51.831034+0000","last_became_active":"2023-10-06T02:20:51.823368+0000","last_became_peered":"2023-10-06T02:20:51.823368+0000","last_unstale":"2023-10-06T02:20:51.831034+0000","last_undegraded":"2023-10-06T02:20:51.831034+0000","last_fullsized":"2023-10-06T02:20:51.831034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:38.335002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830054+0000","last_change":"2023-10-06T02:20:51.827211+0000","last_active":"2023-10-06T02:20:51.830054+0000","last_peered":"2023-10-06T02:20:51.830054+0000","last_clean":"2023-10-06T02:20:51.830054+0000","last_became_active":"2023-10-06T02:20:51.826592+0000","last_became_peered":"2023-10-06T02:20:51.826592+0000","last_unstale":"2023-10-06T02:20:51.830054+0000","last_undegraded":"2023-10-06T02:20:51.830054+0000","last_fullsized":"2023-10-06T02:20:51.830054+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:24.608807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829550+0000","last_change":"2023-10-06T02:20:51.827857+0000","last_active":"2023-10-06T02:20:51.829550+0000","last_peered":"2023-10-06T02:20:51.829550+0000","last_clean":"2023-10-06T02:20:51.829550+0000","last_became_active":"2023-10-06T02:20:51.827566+0000","last_became_peered":"2023-10-06T02:20:51.827566+0000","last_unstale":"2023-10-06T02:20:51.829550+0000","last_undegraded":"2023-10-06T02:20:51.829550+0000","last_fullsized":"2023-10-06T02:20:51.829550+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:40:30.735186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838046+0000","last_change":"2023-10-06T02:20:51.830131+0000","last_active":"2023-10-06T02:20:51.838046+0000","last_peered":"2023-10-06T02:20:51.838046+0000","last_clean":"2023-10-06T02:20:51.838046+0000","last_became_active":"2023-10-06T02:20:51.829829+0000","last_became_peered":"2023-10-06T02:20:51.829829+0000","last_unstale":"2023-10-06T02:20:51.838046+0000","last_undegraded":"2023-10-06T02:20:51.838046+0000","last_fullsized":"2023-10-06T02:20:51.838046+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:50:42.198175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.821206+0000","last_change":"2023-10-06T02:20:51.818549+0000","last_active":"2023-10-06T02:20:51.821206+0000","last_peered":"2023-10-06T02:20:51.821206+0000","last_clean":"2023-10-06T02:20:51.821206+0000","last_became_active":"2023-10-06T02:20:51.818288+0000","last_became_peered":"2023-10-06T02:20:51.818288+0000","last_unstale":"2023-10-06T02:20:51.821206+0000","last_undegraded":"2023-10-06T02:20:51.821206+0000","last_fullsized":"2023-10-06T02:20:51.821206+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:45.261565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829073+0000","last_change":"2023-10-06T02:20:51.814480+0000","last_active":"2023-10-06T02:20:51.829073+0000","last_peered":"2023-10-06T02:20:51.829073+0000","last_clean":"2023-10-06T02:20:51.829073+0000","last_became_active":"2023-10-06T02:20:51.814204+0000","last_became_peered":"2023-10-06T02:20:51.814204+0000","last_unstale":"2023-10-06T02:20:51.829073+0000","last_undegraded":"2023-10-06T02:20:51.829073+0000","last_fullsized":"2023-10-06T02:20:51.829073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:23.870295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831267+0000","last_change":"2023-10-06T02:20:51.820729+0000","last_active":"2023-10-06T02:20:51.831267+0000","last_peered":"2023-10-06T02:20:51.831267+0000","last_clean":"2023-10-06T02:20:51.831267+0000","last_became_active":"2023-10-06T02:20:51.816847+0000","last_became_peered":"2023-10-06T02:20:51.816847+0000","last_unstale":"2023-10-06T02:20:51.831267+0000","last_undegraded":"2023-10-06T02:20:51.831267+0000","last_fullsized":"2023-10-06T02:20:51.831267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:36:54.493043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.825691+0000","last_change":"2023-10-06T02:20:51.822228+0000","last_active":"2023-10-06T02:20:51.825691+0000","last_peered":"2023-10-06T02:20:51.825691+0000","last_clean":"2023-10-06T02:20:51.825691+0000","last_became_active":"2023-10-06T02:20:51.821966+0000","last_became_peered":"2023-10-06T02:20:51.821966+0000","last_unstale":"2023-10-06T02:20:51.825691+0000","last_undegraded":"2023-10-06T02:20:51.825691+0000","last_fullsized":"2023-10-06T02:20:51.825691+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:00.591843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831438+0000","last_change":"2023-10-06T02:20:51.826196+0000","last_active":"2023-10-06T02:20:51.831438+0000","last_peered":"2023-10-06T02:20:51.831438+0000","last_clean":"2023-10-06T02:20:51.831438+0000","last_became_active":"2023-10-06T02:20:51.825929+0000","last_became_peered":"2023-10-06T02:20:51.825929+0000","last_unstale":"2023-10-06T02:20:51.831438+0000","last_undegraded":"2023-10-06T02:20:51.831438+0000","last_fullsized":"2023-10-06T02:20:51.831438+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:28.010680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830509+0000","last_change":"2023-10-06T02:20:51.814794+0000","last_active":"2023-10-06T02:20:51.830509+0000","last_peered":"2023-10-06T02:20:51.830509+0000","last_clean":"2023-10-06T02:20:51.830509+0000","last_became_active":"2023-10-06T02:20:51.809059+0000","last_became_peered":"2023-10-06T02:20:51.809059+0000","last_unstale":"2023-10-06T02:20:51.830509+0000","last_undegraded":"2023-10-06T02:20:51.830509+0000","last_fullsized":"2023-10-06T02:20:51.830509+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:47.466678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829706+0000","last_change":"2023-10-06T02:20:51.824773+0000","last_active":"2023-10-06T02:20:51.829706+0000","last_peered":"2023-10-06T02:20:51.829706+0000","last_clean":"2023-10-06T02:20:51.829706+0000","last_became_active":"2023-10-06T02:20:51.824476+0000","last_became_peered":"2023-10-06T02:20:51.824476+0000","last_unstale":"2023-10-06T02:20:51.829706+0000","last_undegraded":"2023-10-06T02:20:51.829706+0000","last_fullsized":"2023-10-06T02:20:51.829706+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:00.591843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.827311+0000","last_change":"2023-10-06T02:20:51.822355+0000","last_active":"2023-10-06T02:20:51.827311+0000","last_peered":"2023-10-06T02:20:51.827311+0000","last_clean":"2023-10-06T02:20:51.827311+0000","last_became_active":"2023-10-06T02:20:51.822041+0000","last_became_peered":"2023-10-06T02:20:51.822041+0000","last_unstale":"2023-10-06T02:20:51.827311+0000","last_undegraded":"2023-10-06T02:20:51.827311+0000","last_fullsized":"2023-10-06T02:20:51.827311+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:05.642500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830537+0000","last_change":"2023-10-06T02:20:51.822859+0000","last_active":"2023-10-06T02:20:51.830537+0000","last_peered":"2023-10-06T02:20:51.830537+0000","last_clean":"2023-10-06T02:20:51.830537+0000","last_became_active":"2023-10-06T02:20:51.822601+0000","last_became_peered":"2023-10-06T02:20:51.822601+0000","last_unstale":"2023-10-06T02:20:51.830537+0000","last_undegraded":"2023-10-06T02:20:51.830537+0000","last_fullsized":"2023-10-06T02:20:51.830537+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:53.757794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.822313+0000","last_change":"2023-10-06T02:20:51.817408+0000","last_active":"2023-10-06T02:20:51.822313+0000","last_peered":"2023-10-06T02:20:51.822313+0000","last_clean":"2023-10-06T02:20:51.822313+0000","last_became_active":"2023-10-06T02:20:51.817044+0000","last_became_peered":"2023-10-06T02:20:51.817044+0000","last_unstale":"2023-10-06T02:20:51.822313+0000","last_undegraded":"2023-10-06T02:20:51.822313+0000","last_fullsized":"2023-10-06T02:20:51.822313+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:25.714407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.827098+0000","last_change":"2023-10-06T02:20:51.824139+0000","last_active":"2023-10-06T02:20:51.827098+0000","last_peered":"2023-10-06T02:20:51.827098+0000","last_clean":"2023-10-06T02:20:51.827098+0000","last_became_active":"2023-10-06T02:20:51.823884+0000","last_became_peered":"2023-10-06T02:20:51.823884+0000","last_unstale":"2023-10-06T02:20:51.827098+0000","last_undegraded":"2023-10-06T02:20:51.827098+0000","last_fullsized":"2023-10-06T02:20:51.827098+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:40.217512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.820661+0000","last_change":"2023-10-06T02:20:51.817343+0000","last_active":"2023-10-06T02:20:51.820661+0000","last_peered":"2023-10-06T02:20:51.820661+0000","last_clean":"2023-10-06T02:20:51.820661+0000","last_became_active":"2023-10-06T02:20:51.817079+0000","last_became_peered":"2023-10-06T02:20:51.817079+0000","last_unstale":"2023-10-06T02:20:51.820661+0000","last_undegraded":"2023-10-06T02:20:51.820661+0000","last_fullsized":"2023-10-06T02:20:51.820661+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:28.010680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829310+0000","last_change":"2023-10-06T02:20:51.828115+0000","last_active":"2023-10-06T02:20:51.829310+0000","last_peered":"2023-10-06T02:20:51.829310+0000","last_clean":"2023-10-06T02:20:51.829310+0000","last_became_active":"2023-10-06T02:20:51.827857+0000","last_became_peered":"2023-10-06T02:20:51.827857+0000","last_unstale":"2023-10-06T02:20:51.829310+0000","last_undegraded":"2023-10-06T02:20:51.829310+0000","last_fullsized":"2023-10-06T02:20:51.829310+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:49:25.458611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.833059+0000","last_change":"2023-10-06T02:20:51.830780+0000","last_active":"2023-10-06T02:20:51.833059+0000","last_peered":"2023-10-06T02:20:51.833059+0000","last_clean":"2023-10-06T02:20:51.833059+0000","last_became_active":"2023-10-06T02:20:51.830516+0000","last_became_peered":"2023-10-06T02:20:51.830516+0000","last_unstale":"2023-10-06T02:20:51.833059+0000","last_undegraded":"2023-10-06T02:20:51.833059+0000","last_fullsized":"2023-10-06T02:20:51.833059+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:12:16.185906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"65'4","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829186+0000","last_change":"2023-10-06T02:20:50.822437+0000","last_active":"2023-10-06T02:20:51.829186+0000","last_peered":"2023-10-06T02:20:51.829186+0000","last_clean":"2023-10-06T02:20:51.829186+0000","last_became_active":"2023-10-06T02:20:50.822220+0000","last_became_peered":"2023-10-06T02:20:50.822220+0000","last_unstale":"2023-10-06T02:20:51.829186+0000","last_undegraded":"2023-10-06T02:20:51.829186+0000","last_fullsized":"2023-10-06T02:20:51.829186+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:32.995079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830018+0000","last_change":"2023-10-06T02:20:51.825686+0000","last_active":"2023-10-06T02:20:51.830018+0000","last_peered":"2023-10-06T02:20:51.830018+0000","last_clean":"2023-10-06T02:20:51.830018+0000","last_became_active":"2023-10-06T02:20:51.825407+0000","last_became_peered":"2023-10-06T02:20:51.825407+0000","last_unstale":"2023-10-06T02:20:51.830018+0000","last_undegraded":"2023-10-06T02:20:51.830018+0000","last_fullsized":"2023-10-06T02:20:51.830018+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:35.983030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.826803+0000","last_change":"2023-10-06T02:20:50.818921+0000","last_active":"2023-10-06T02:20:51.826803+0000","last_peered":"2023-10-06T02:20:51.826803+0000","last_clean":"2023-10-06T02:20:51.826803+0000","last_became_active":"2023-10-06T02:20:50.818714+0000","last_became_peered":"2023-10-06T02:20:50.818714+0000","last_unstale":"2023-10-06T02:20:51.826803+0000","last_undegraded":"2023-10-06T02:20:51.826803+0000","last_fullsized":"2023-10-06T02:20:51.826803+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:59.586917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831337+0000","last_change":"2023-10-06T02:20:51.828901+0000","last_active":"2023-10-06T02:20:51.831337+0000","last_peered":"2023-10-06T02:20:51.831337+0000","last_clean":"2023-10-06T02:20:51.831337+0000","last_became_active":"2023-10-06T02:20:51.828658+0000","last_became_peered":"2023-10-06T02:20:51.828658+0000","last_unstale":"2023-10-06T02:20:51.831337+0000","last_undegraded":"2023-10-06T02:20:51.831337+0000","last_fullsized":"2023-10-06T02:20:51.831337+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:34.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.822829+0000","last_change":"2023-10-06T02:20:50.819353+0000","last_active":"2023-10-06T02:20:51.822829+0000","last_peered":"2023-10-06T02:20:51.822829+0000","last_clean":"2023-10-06T02:20:51.822829+0000","last_became_active":"2023-10-06T02:20:50.819040+0000","last_became_peered":"2023-10-06T02:20:50.819040+0000","last_unstale":"2023-10-06T02:20:51.822829+0000","last_undegraded":"2023-10-06T02:20:51.822829+0000","last_fullsized":"2023-10-06T02:20:51.822829+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:15.069472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.826717+0000","last_change":"2023-10-06T02:20:51.823050+0000","last_active":"2023-10-06T02:20:51.826717+0000","last_peered":"2023-10-06T02:20:51.826717+0000","last_clean":"2023-10-06T02:20:51.826717+0000","last_became_active":"2023-10-06T02:20:51.822791+0000","last_became_peered":"2023-10-06T02:20:51.822791+0000","last_unstale":"2023-10-06T02:20:51.826717+0000","last_undegraded":"2023-10-06T02:20:51.826717+0000","last_fullsized":"2023-10-06T02:20:51.826717+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:40.217512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830417+0000","last_change":"2023-10-06T02:20:50.818515+0000","last_active":"2023-10-06T02:20:51.830417+0000","last_peered":"2023-10-06T02:20:51.830417+0000","last_clean":"2023-10-06T02:20:51.830417+0000","last_became_active":"2023-10-06T02:20:50.818264+0000","last_became_peered":"2023-10-06T02:20:50.818264+0000","last_unstale":"2023-10-06T02:20:51.830417+0000","last_undegraded":"2023-10-06T02:20:51.830417+0000","last_fullsized":"2023-10-06T02:20:51.830417+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:01.744172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.825520+0000","last_change":"2023-10-06T02:20:51.818483+0000","last_active":"2023-10-06T02:20:51.825520+0000","last_peered":"2023-10-06T02:20:51.825520+0000","last_clean":"2023-10-06T02:20:51.825520+0000","last_became_active":"2023-10-06T02:20:51.818229+0000","last_became_peered":"2023-10-06T02:20:51.818229+0000","last_unstale":"2023-10-06T02:20:51.825520+0000","last_undegraded":"2023-10-06T02:20:51.825520+0000","last_fullsized":"2023-10-06T02:20:51.825520+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:34.544171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.816622+0000","last_change":"2023-10-06T02:20:50.808802+0000","last_active":"2023-10-06T02:20:51.816622+0000","last_peered":"2023-10-06T02:20:51.816622+0000","last_clean":"2023-10-06T02:20:51.816622+0000","last_became_active":"2023-10-06T02:20:50.808512+0000","last_became_peered":"2023-10-06T02:20:50.808512+0000","last_unstale":"2023-10-06T02:20:51.816622+0000","last_undegraded":"2023-10-06T02:20:51.816622+0000","last_fullsized":"2023-10-06T02:20:51.816622+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.330076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.816247+0000","last_change":"2023-10-06T02:20:51.809429+0000","last_active":"2023-10-06T02:20:51.816247+0000","last_peered":"2023-10-06T02:20:51.816247+0000","last_clean":"2023-10-06T02:20:51.816247+0000","last_became_active":"2023-10-06T02:20:51.809123+0000","last_became_peered":"2023-10-06T02:20:51.809123+0000","last_unstale":"2023-10-06T02:20:51.816247+0000","last_undegraded":"2023-10-06T02:20:51.816247+0000","last_fullsized":"2023-10-06T02:20:51.816247+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:24.338553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.828508+0000","last_change":"2023-10-06T02:20:50.823496+0000","last_active":"2023-10-06T02:20:51.828508+0000","last_peered":"2023-10-06T02:20:51.828508+0000","last_clean":"2023-10-06T02:20:51.828508+0000","last_became_active":"2023-10-06T02:20:50.823162+0000","last_became_peered":"2023-10-06T02:20:50.823162+0000","last_unstale":"2023-10-06T02:20:51.828508+0000","last_undegraded":"2023-10-06T02:20:51.828508+0000","last_fullsized":"2023-10-06T02:20:51.828508+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:30:28.469240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830809+0000","last_change":"2023-10-06T02:20:51.830099+0000","last_active":"2023-10-06T02:20:51.830809+0000","last_peered":"2023-10-06T02:20:51.830809+0000","last_clean":"2023-10-06T02:20:51.830809+0000","last_became_active":"2023-10-06T02:20:51.829808+0000","last_became_peered":"2023-10-06T02:20:51.829808+0000","last_unstale":"2023-10-06T02:20:51.830809+0000","last_undegraded":"2023-10-06T02:20:51.830809+0000","last_fullsized":"2023-10-06T02:20:51.830809+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:15.317541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.800486+0000","last_change":"2023-10-06T02:20:50.820965+0000","last_active":"2023-10-06T02:20:51.800486+0000","last_peered":"2023-10-06T02:20:51.800486+0000","last_clean":"2023-10-06T02:20:51.800486+0000","last_became_active":"2023-10-06T02:20:50.820752+0000","last_became_peered":"2023-10-06T02:20:50.820752+0000","last_unstale":"2023-10-06T02:20:51.800486+0000","last_undegraded":"2023-10-06T02:20:51.800486+0000","last_fullsized":"2023-10-06T02:20:51.800486+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:31.366294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.810104+0000","last_change":"2023-10-06T02:20:51.808589+0000","last_active":"2023-10-06T02:20:51.810104+0000","last_peered":"2023-10-06T02:20:51.810104+0000","last_clean":"2023-10-06T02:20:51.810104+0000","last_became_active":"2023-10-06T02:20:51.808235+0000","last_became_peered":"2023-10-06T02:20:51.808235+0000","last_unstale":"2023-10-06T02:20:51.810104+0000","last_undegraded":"2023-10-06T02:20:51.810104+0000","last_fullsized":"2023-10-06T02:20:51.810104+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:53.001974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.813219+0000","last_change":"2023-10-06T02:20:50.818453+0000","last_active":"2023-10-06T02:20:51.813219+0000","last_peered":"2023-10-06T02:20:51.813219+0000","last_clean":"2023-10-06T02:20:51.813219+0000","last_became_active":"2023-10-06T02:20:50.818167+0000","last_became_peered":"2023-10-06T02:20:50.818167+0000","last_unstale":"2023-10-06T02:20:51.813219+0000","last_undegraded":"2023-10-06T02:20:51.813219+0000","last_fullsized":"2023-10-06T02:20:51.813219+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:32.408249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829728+0000","last_change":"2023-10-06T02:20:51.825296+0000","last_active":"2023-10-06T02:20:51.829728+0000","last_peered":"2023-10-06T02:20:51.829728+0000","last_clean":"2023-10-06T02:20:51.829728+0000","last_became_active":"2023-10-06T02:20:51.825046+0000","last_became_peered":"2023-10-06T02:20:51.825046+0000","last_unstale":"2023-10-06T02:20:51.829728+0000","last_undegraded":"2023-10-06T02:20:51.829728+0000","last_fullsized":"2023-10-06T02:20:51.829728+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:25.128853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.803449+0000","last_change":"2023-10-06T02:20:50.816556+0000","last_active":"2023-10-06T02:20:51.803449+0000","last_peered":"2023-10-06T02:20:51.803449+0000","last_clean":"2023-10-06T02:20:51.803449+0000","last_became_active":"2023-10-06T02:20:50.816295+0000","last_became_peered":"2023-10-06T02:20:50.816295+0000","last_unstale":"2023-10-06T02:20:51.803449+0000","last_undegraded":"2023-10-06T02:20:51.803449+0000","last_fullsized":"2023-10-06T02:20:51.803449+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.005754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.835416+0000","last_change":"2023-10-06T02:20:51.831925+0000","last_active":"2023-10-06T02:20:51.835416+0000","last_peered":"2023-10-06T02:20:51.835416+0000","last_clean":"2023-10-06T02:20:51.835416+0000","last_became_active":"2023-10-06T02:20:51.831642+0000","last_became_peered":"2023-10-06T02:20:51.831642+0000","last_unstale":"2023-10-06T02:20:51.835416+0000","last_undegraded":"2023-10-06T02:20:51.835416+0000","last_fullsized":"2023-10-06T02:20:51.835416+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:27.385871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.817954+0000","last_change":"2023-10-06T02:20:50.817299+0000","last_active":"2023-10-06T02:20:51.817954+0000","last_peered":"2023-10-06T02:20:51.817954+0000","last_clean":"2023-10-06T02:20:51.817954+0000","last_became_active":"2023-10-06T02:20:50.816988+0000","last_became_peered":"2023-10-06T02:20:50.816988+0000","last_unstale":"2023-10-06T02:20:51.817954+0000","last_undegraded":"2023-10-06T02:20:51.817954+0000","last_fullsized":"2023-10-06T02:20:51.817954+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:05.025893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838003+0000","last_change":"2023-10-06T02:20:51.830161+0000","last_active":"2023-10-06T02:20:51.838003+0000","last_peered":"2023-10-06T02:20:51.838003+0000","last_clean":"2023-10-06T02:20:51.838003+0000","last_became_active":"2023-10-06T02:20:51.829914+0000","last_became_peered":"2023-10-06T02:20:51.829914+0000","last_unstale":"2023-10-06T02:20:51.838003+0000","last_undegraded":"2023-10-06T02:20:51.838003+0000","last_fullsized":"2023-10-06T02:20:51.838003+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:36.124998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"65'3","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.818102+0000","last_change":"2023-10-06T02:20:50.810864+0000","last_active":"2023-10-06T02:20:51.818102+0000","last_peered":"2023-10-06T02:20:51.818102+0000","last_clean":"2023-10-06T02:20:51.818102+0000","last_became_active":"2023-10-06T02:20:50.810578+0000","last_became_peered":"2023-10-06T02:20:50.810578+0000","last_unstale":"2023-10-06T02:20:51.818102+0000","last_undegraded":"2023-10-06T02:20:51.818102+0000","last_fullsized":"2023-10-06T02:20:51.818102+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:22.865369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829629+0000","last_change":"2023-10-06T02:20:51.826105+0000","last_active":"2023-10-06T02:20:51.829629+0000","last_peered":"2023-10-06T02:20:51.829629+0000","last_clean":"2023-10-06T02:20:51.829629+0000","last_became_active":"2023-10-06T02:20:51.825480+0000","last_became_peered":"2023-10-06T02:20:51.825480+0000","last_unstale":"2023-10-06T02:20:51.829629+0000","last_undegraded":"2023-10-06T02:20:51.829629+0000","last_fullsized":"2023-10-06T02:20:51.829629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:06.030819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"65'6","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.833376+0000","last_change":"2023-10-06T02:20:50.818481+0000","last_active":"2023-10-06T02:20:51.833376+0000","last_peered":"2023-10-06T02:20:51.833376+0000","last_clean":"2023-10-06T02:20:51.833376+0000","last_became_active":"2023-10-06T02:20:50.818177+0000","last_became_peered":"2023-10-06T02:20:50.818177+0000","last_unstale":"2023-10-06T02:20:51.833376+0000","last_undegraded":"2023-10-06T02:20:51.833376+0000","last_fullsized":"2023-10-06T02:20:51.833376+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:23.603882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.827327+0000","last_change":"2023-10-06T02:20:51.825095+0000","last_active":"2023-10-06T02:20:51.827327+0000","last_peered":"2023-10-06T02:20:51.827327+0000","last_clean":"2023-10-06T02:20:51.827327+0000","last_became_active":"2023-10-06T02:20:51.824795+0000","last_became_peered":"2023-10-06T02:20:51.824795+0000","last_unstale":"2023-10-06T02:20:51.827327+0000","last_undegraded":"2023-10-06T02:20:51.827327+0000","last_fullsized":"2023-10-06T02:20:51.827327+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:59.948754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.824845+0000","last_change":"2023-10-06T02:20:50.820106+0000","last_active":"2023-10-06T02:20:51.824845+0000","last_peered":"2023-10-06T02:20:51.824845+0000","last_clean":"2023-10-06T02:20:51.824845+0000","last_became_active":"2023-10-06T02:20:50.819489+0000","last_became_peered":"2023-10-06T02:20:50.819489+0000","last_unstale":"2023-10-06T02:20:51.824845+0000","last_undegraded":"2023-10-06T02:20:51.824845+0000","last_fullsized":"2023-10-06T02:20:51.824845+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:44.274895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.824489+0000","last_change":"2023-10-06T02:20:51.818073+0000","last_active":"2023-10-06T02:20:51.824489+0000","last_peered":"2023-10-06T02:20:51.824489+0000","last_clean":"2023-10-06T02:20:51.824489+0000","last_became_active":"2023-10-06T02:20:51.817742+0000","last_became_peered":"2023-10-06T02:20:51.817742+0000","last_unstale":"2023-10-06T02:20:51.824489+0000","last_undegraded":"2023-10-06T02:20:51.824489+0000","last_fullsized":"2023-10-06T02:20:51.824489+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:59.299607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.817349+0000","last_change":"2023-10-06T02:20:50.818283+0000","last_active":"2023-10-06T02:20:51.817349+0000","last_peered":"2023-10-06T02:20:51.817349+0000","last_clean":"2023-10-06T02:20:51.817349+0000","last_became_active":"2023-10-06T02:20:50.817899+0000","last_became_peered":"2023-10-06T02:20:50.817899+0000","last_unstale":"2023-10-06T02:20:51.817349+0000","last_undegraded":"2023-10-06T02:20:51.817349+0000","last_fullsized":"2023-10-06T02:20:51.817349+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:26.911597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.824337+0000","last_change":"2023-10-06T02:20:51.822915+0000","last_active":"2023-10-06T02:20:51.824337+0000","last_peered":"2023-10-06T02:20:51.824337+0000","last_clean":"2023-10-06T02:20:51.824337+0000","last_became_active":"2023-10-06T02:20:51.822627+0000","last_became_peered":"2023-10-06T02:20:51.822627+0000","last_unstale":"2023-10-06T02:20:51.824337+0000","last_undegraded":"2023-10-06T02:20:51.824337+0000","last_fullsized":"2023-10-06T02:20:51.824337+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:26.021599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.807534+0000","last_change":"2023-10-06T02:20:50.812022+0000","last_active":"2023-10-06T02:20:51.807534+0000","last_peered":"2023-10-06T02:20:51.807534+0000","last_clean":"2023-10-06T02:20:51.807534+0000","last_became_active":"2023-10-06T02:20:50.811750+0000","last_became_peered":"2023-10-06T02:20:50.811750+0000","last_unstale":"2023-10-06T02:20:51.807534+0000","last_undegraded":"2023-10-06T02:20:51.807534+0000","last_fullsized":"2023-10-06T02:20:51.807534+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:35.120072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829962+0000","last_change":"2023-10-06T02:20:51.827416+0000","last_active":"2023-10-06T02:20:51.829962+0000","last_peered":"2023-10-06T02:20:51.829962+0000","last_clean":"2023-10-06T02:20:51.829962+0000","last_became_active":"2023-10-06T02:20:51.827125+0000","last_became_peered":"2023-10-06T02:20:51.827125+0000","last_unstale":"2023-10-06T02:20:51.829962+0000","last_undegraded":"2023-10-06T02:20:51.829962+0000","last_fullsized":"2023-10-06T02:20:51.829962+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:45.279821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"65'8","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.826758+0000","last_change":"2023-10-06T02:20:50.817524+0000","last_active":"2023-10-06T02:20:51.826758+0000","last_peered":"2023-10-06T02:20:51.826758+0000","last_clean":"2023-10-06T02:20:51.826758+0000","last_became_active":"2023-10-06T02:20:50.817267+0000","last_became_peered":"2023-10-06T02:20:50.817267+0000","last_unstale":"2023-10-06T02:20:51.826758+0000","last_undegraded":"2023-10-06T02:20:51.826758+0000","last_fullsized":"2023-10-06T02:20:51.826758+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:26.380945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.821408+0000","last_change":"2023-10-06T02:20:51.818539+0000","last_active":"2023-10-06T02:20:51.821408+0000","last_peered":"2023-10-06T02:20:51.821408+0000","last_clean":"2023-10-06T02:20:51.821408+0000","last_became_active":"2023-10-06T02:20:51.817767+0000","last_became_peered":"2023-10-06T02:20:51.817767+0000","last_unstale":"2023-10-06T02:20:51.821408+0000","last_undegraded":"2023-10-06T02:20:51.821408+0000","last_fullsized":"2023-10-06T02:20:51.821408+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:40.662240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.832278+0000","last_change":"2023-10-06T02:20:50.816771+0000","last_active":"2023-10-06T02:20:51.832278+0000","last_peered":"2023-10-06T02:20:51.832278+0000","last_clean":"2023-10-06T02:20:51.832278+0000","last_became_active":"2023-10-06T02:20:50.816456+0000","last_became_peered":"2023-10-06T02:20:50.816456+0000","last_unstale":"2023-10-06T02:20:51.832278+0000","last_undegraded":"2023-10-06T02:20:51.832278+0000","last_fullsized":"2023-10-06T02:20:51.832278+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:31.366294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.824392+0000","last_change":"2023-10-06T02:20:51.817536+0000","last_active":"2023-10-06T02:20:51.824392+0000","last_peered":"2023-10-06T02:20:51.824392+0000","last_clean":"2023-10-06T02:20:51.824392+0000","last_became_active":"2023-10-06T02:20:51.817253+0000","last_became_peered":"2023-10-06T02:20:51.817253+0000","last_unstale":"2023-10-06T02:20:51.824392+0000","last_undegraded":"2023-10-06T02:20:51.824392+0000","last_fullsized":"2023-10-06T02:20:51.824392+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:44.060757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.808802+0000","last_change":"2023-10-06T02:20:50.815180+0000","last_active":"2023-10-06T02:20:51.808802+0000","last_peered":"2023-10-06T02:20:51.808802+0000","last_clean":"2023-10-06T02:20:51.808802+0000","last_became_active":"2023-10-06T02:20:50.814883+0000","last_became_peered":"2023-10-06T02:20:50.814883+0000","last_unstale":"2023-10-06T02:20:51.808802+0000","last_undegraded":"2023-10-06T02:20:51.808802+0000","last_fullsized":"2023-10-06T02:20:51.808802+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:51.759990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831337+0000","last_change":"2023-10-06T02:20:51.825845+0000","last_active":"2023-10-06T02:20:51.831337+0000","last_peered":"2023-10-06T02:20:51.831337+0000","last_clean":"2023-10-06T02:20:51.831337+0000","last_became_active":"2023-10-06T02:20:51.825570+0000","last_became_peered":"2023-10-06T02:20:51.825570+0000","last_unstale":"2023-10-06T02:20:51.831337+0000","last_undegraded":"2023-10-06T02:20:51.831337+0000","last_fullsized":"2023-10-06T02:20:51.831337+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:40.535060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.816858+0000","last_change":"2023-10-06T02:20:50.823586+0000","last_active":"2023-10-06T02:20:51.816858+0000","last_peered":"2023-10-06T02:20:51.816858+0000","last_clean":"2023-10-06T02:20:51.816858+0000","last_became_active":"2023-10-06T02:20:50.823256+0000","last_became_peered":"2023-10-06T02:20:50.823256+0000","last_unstale":"2023-10-06T02:20:51.816858+0000","last_undegraded":"2023-10-06T02:20:51.816858+0000","last_fullsized":"2023-10-06T02:20:51.816858+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:54.267291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831482+0000","last_change":"2023-10-06T02:20:51.826844+0000","last_active":"2023-10-06T02:20:51.831482+0000","last_peered":"2023-10-06T02:20:51.831482+0000","last_clean":"2023-10-06T02:20:51.831482+0000","last_became_active":"2023-10-06T02:20:51.826542+0000","last_became_peered":"2023-10-06T02:20:51.826542+0000","last_unstale":"2023-10-06T02:20:51.831482+0000","last_undegraded":"2023-10-06T02:20:51.831482+0000","last_fullsized":"2023-10-06T02:20:51.831482+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:11:34.615395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.802137+0000","last_change":"2023-10-06T02:20:50.813573+0000","last_active":"2023-10-06T02:20:51.802137+0000","last_peered":"2023-10-06T02:20:51.802137+0000","last_clean":"2023-10-06T02:20:51.802137+0000","last_became_active":"2023-10-06T02:20:50.813255+0000","last_became_peered":"2023-10-06T02:20:50.813255+0000","last_unstale":"2023-10-06T02:20:51.802137+0000","last_undegraded":"2023-10-06T02:20:51.802137+0000","last_fullsized":"2023-10-06T02:20:51.802137+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:15.069472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829180+0000","last_change":"2023-10-06T02:20:51.824549+0000","last_active":"2023-10-06T02:20:51.829180+0000","last_peered":"2023-10-06T02:20:51.829180+0000","last_clean":"2023-10-06T02:20:51.829180+0000","last_became_active":"2023-10-06T02:20:51.824271+0000","last_became_peered":"2023-10-06T02:20:51.824271+0000","last_unstale":"2023-10-06T02:20:51.829180+0000","last_undegraded":"2023-10-06T02:20:51.829180+0000","last_fullsized":"2023-10-06T02:20:51.829180+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:51.462534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.814860+0000","last_change":"2023-10-06T02:20:50.820302+0000","last_active":"2023-10-06T02:20:51.814860+0000","last_peered":"2023-10-06T02:20:51.814860+0000","last_clean":"2023-10-06T02:20:51.814860+0000","last_became_active":"2023-10-06T02:20:50.820059+0000","last_became_peered":"2023-10-06T02:20:50.820059+0000","last_unstale":"2023-10-06T02:20:51.814860+0000","last_undegraded":"2023-10-06T02:20:51.814860+0000","last_fullsized":"2023-10-06T02:20:51.814860+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:57.804494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838101+0000","last_change":"2023-10-06T02:20:51.830945+0000","last_active":"2023-10-06T02:20:51.838101+0000","last_peered":"2023-10-06T02:20:51.838101+0000","last_clean":"2023-10-06T02:20:51.838101+0000","last_became_active":"2023-10-06T02:20:51.829801+0000","last_became_peered":"2023-10-06T02:20:51.829801+0000","last_unstale":"2023-10-06T02:20:51.838101+0000","last_undegraded":"2023-10-06T02:20:51.838101+0000","last_fullsized":"2023-10-06T02:20:51.838101+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:46.192665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.800545+0000","last_change":"2023-10-06T02:20:50.820326+0000","last_active":"2023-10-06T02:20:51.800545+0000","last_peered":"2023-10-06T02:20:51.800545+0000","last_clean":"2023-10-06T02:20:51.800545+0000","last_became_active":"2023-10-06T02:20:50.820055+0000","last_became_peered":"2023-10-06T02:20:50.820055+0000","last_unstale":"2023-10-06T02:20:51.800545+0000","last_undegraded":"2023-10-06T02:20:51.800545+0000","last_fullsized":"2023-10-06T02:20:51.800545+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:31.728925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.823686+0000","last_change":"2023-10-06T02:20:51.816976+0000","last_active":"2023-10-06T02:20:51.823686+0000","last_peered":"2023-10-06T02:20:51.823686+0000","last_clean":"2023-10-06T02:20:51.823686+0000","last_became_active":"2023-10-06T02:20:51.816812+0000","last_became_peered":"2023-10-06T02:20:51.816812+0000","last_unstale":"2023-10-06T02:20:51.823686+0000","last_undegraded":"2023-10-06T02:20:51.823686+0000","last_fullsized":"2023-10-06T02:20:51.823686+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:07.545935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.802209+0000","last_change":"2023-10-06T02:20:50.819720+0000","last_active":"2023-10-06T02:20:51.802209+0000","last_peered":"2023-10-06T02:20:51.802209+0000","last_clean":"2023-10-06T02:20:51.802209+0000","last_became_active":"2023-10-06T02:20:50.819461+0000","last_became_peered":"2023-10-06T02:20:50.819461+0000","last_unstale":"2023-10-06T02:20:51.802209+0000","last_undegraded":"2023-10-06T02:20:51.802209+0000","last_fullsized":"2023-10-06T02:20:51.802209+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:58.943828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829316+0000","last_change":"2023-10-06T02:20:51.828069+0000","last_active":"2023-10-06T02:20:51.829316+0000","last_peered":"2023-10-06T02:20:51.829316+0000","last_clean":"2023-10-06T02:20:51.829316+0000","last_became_active":"2023-10-06T02:20:51.827793+0000","last_became_peered":"2023-10-06T02:20:51.827793+0000","last_unstale":"2023-10-06T02:20:51.829316+0000","last_undegraded":"2023-10-06T02:20:51.829316+0000","last_fullsized":"2023-10-06T02:20:51.829316+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:26.442837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.815750+0000","last_change":"2023-10-06T02:20:50.817824+0000","last_active":"2023-10-06T02:20:51.815750+0000","last_peered":"2023-10-06T02:20:51.815750+0000","last_clean":"2023-10-06T02:20:51.815750+0000","last_became_active":"2023-10-06T02:20:50.817563+0000","last_became_peered":"2023-10-06T02:20:50.817563+0000","last_unstale":"2023-10-06T02:20:51.815750+0000","last_undegraded":"2023-10-06T02:20:51.815750+0000","last_fullsized":"2023-10-06T02:20:51.815750+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:31.728925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.832986+0000","last_change":"2023-10-06T02:20:51.826479+0000","last_active":"2023-10-06T02:20:51.832986+0000","last_peered":"2023-10-06T02:20:51.832986+0000","last_clean":"2023-10-06T02:20:51.832986+0000","last_became_active":"2023-10-06T02:20:51.826238+0000","last_became_peered":"2023-10-06T02:20:51.826238+0000","last_unstale":"2023-10-06T02:20:51.832986+0000","last_undegraded":"2023-10-06T02:20:51.832986+0000","last_fullsized":"2023-10-06T02:20:51.832986+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:11.256735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.826818+0000","last_change":"2023-10-06T02:20:50.815734+0000","last_active":"2023-10-06T02:20:51.826818+0000","last_peered":"2023-10-06T02:20:51.826818+0000","last_clean":"2023-10-06T02:20:51.826818+0000","last_became_active":"2023-10-06T02:20:50.815483+0000","last_became_peered":"2023-10-06T02:20:50.815483+0000","last_unstale":"2023-10-06T02:20:51.826818+0000","last_undegraded":"2023-10-06T02:20:51.826818+0000","last_fullsized":"2023-10-06T02:20:51.826818+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:39.530134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":54,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.803148+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:20:51.803148+0000","last_peered":"2023-10-06T02:20:51.803148+0000","last_clean":"2023-10-06T02:20:51.803148+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:20:51.803148+0000","last_undegraded":"2023-10-06T02:20:51.803148+0000","last_fullsized":"2023-10-06T02:20:51.803148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830418+0000","last_change":"2023-10-06T02:20:51.816262+0000","last_active":"2023-10-06T02:20:51.830418+0000","last_peered":"2023-10-06T02:20:51.830418+0000","last_clean":"2023-10-06T02:20:51.830418+0000","last_became_active":"2023-10-06T02:20:51.815939+0000","last_became_peered":"2023-10-06T02:20:51.815939+0000","last_unstale":"2023-10-06T02:20:51.830418+0000","last_undegraded":"2023-10-06T02:20:51.830418+0000","last_fullsized":"2023-10-06T02:20:51.830418+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:21.905626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.832392+0000","last_change":"2023-10-06T02:20:50.821250+0000","last_active":"2023-10-06T02:20:51.832392+0000","last_peered":"2023-10-06T02:20:51.832392+0000","last_clean":"2023-10-06T02:20:51.832392+0000","last_became_active":"2023-10-06T02:20:50.821031+0000","last_became_peered":"2023-10-06T02:20:50.821031+0000","last_unstale":"2023-10-06T02:20:51.832392+0000","last_undegraded":"2023-10-06T02:20:51.832392+0000","last_fullsized":"2023-10-06T02:20:51.832392+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:44.274895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":54,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.805834+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:20:51.805834+0000","last_peered":"2023-10-06T02:20:51.805834+0000","last_clean":"2023-10-06T02:20:51.805834+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:20:51.805834+0000","last_undegraded":"2023-10-06T02:20:51.805834+0000","last_fullsized":"2023-10-06T02:20:51.805834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.828868+0000","last_change":"2023-10-06T02:20:51.824180+0000","last_active":"2023-10-06T02:20:51.828868+0000","last_peered":"2023-10-06T02:20:51.828868+0000","last_clean":"2023-10-06T02:20:51.828868+0000","last_became_active":"2023-10-06T02:20:51.823933+0000","last_became_peered":"2023-10-06T02:20:51.823933+0000","last_unstale":"2023-10-06T02:20:51.828868+0000","last_undegraded":"2023-10-06T02:20:51.828868+0000","last_fullsized":"2023-10-06T02:20:51.828868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:54.434676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.801803+0000","last_change":"2023-10-06T02:20:50.816680+0000","last_active":"2023-10-06T02:20:51.801803+0000","last_peered":"2023-10-06T02:20:51.801803+0000","last_clean":"2023-10-06T02:20:51.801803+0000","last_became_active":"2023-10-06T02:20:50.816160+0000","last_became_peered":"2023-10-06T02:20:50.816160+0000","last_unstale":"2023-10-06T02:20:51.801803+0000","last_undegraded":"2023-10-06T02:20:51.801803+0000","last_fullsized":"2023-10-06T02:20:51.801803+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.005754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":54,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.800765+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:20:51.800765+0000","last_peered":"2023-10-06T02:20:51.800765+0000","last_clean":"2023-10-06T02:20:51.800765+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:20:51.800765+0000","last_undegraded":"2023-10-06T02:20:51.800765+0000","last_fullsized":"2023-10-06T02:20:51.800765+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":203,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.810740+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:20:51.810740+0000","last_peered":"2023-10-06T02:20:51.810740+0000","last_clean":"2023-10-06T02:20:51.810740+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:20:51.810740+0000","last_undegraded":"2023-10-06T02:20:51.810740+0000","last_fullsized":"2023-10-06T02:20:51.810740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.828752+0000","last_change":"2023-10-06T02:20:51.823933+0000","last_active":"2023-10-06T02:20:51.828752+0000","last_peered":"2023-10-06T02:20:51.828752+0000","last_clean":"2023-10-06T02:20:51.828752+0000","last_became_active":"2023-10-06T02:20:51.823658+0000","last_became_peered":"2023-10-06T02:20:51.823658+0000","last_unstale":"2023-10-06T02:20:51.828752+0000","last_undegraded":"2023-10-06T02:20:51.828752+0000","last_fullsized":"2023-10-06T02:20:51.828752+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:36.288865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.807631+0000","last_change":"2023-10-06T02:20:50.818342+0000","last_active":"2023-10-06T02:20:51.807631+0000","last_peered":"2023-10-06T02:20:51.807631+0000","last_clean":"2023-10-06T02:20:51.807631+0000","last_became_active":"2023-10-06T02:20:50.818161+0000","last_became_peered":"2023-10-06T02:20:50.818161+0000","last_unstale":"2023-10-06T02:20:51.807631+0000","last_undegraded":"2023-10-06T02:20:51.807631+0000","last_fullsized":"2023-10-06T02:20:51.807631+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:45.187739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.810014+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:20:51.810014+0000","last_peered":"2023-10-06T02:20:51.810014+0000","last_clean":"2023-10-06T02:20:51.810014+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:20:51.810014+0000","last_undegraded":"2023-10-06T02:20:51.810014+0000","last_fullsized":"2023-10-06T02:20:51.810014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831822+0000","last_change":"2023-10-06T02:20:51.827047+0000","last_active":"2023-10-06T02:20:51.831822+0000","last_peered":"2023-10-06T02:20:51.831822+0000","last_clean":"2023-10-06T02:20:51.831822+0000","last_became_active":"2023-10-06T02:20:51.826783+0000","last_became_peered":"2023-10-06T02:20:51.826783+0000","last_unstale":"2023-10-06T02:20:51.831822+0000","last_undegraded":"2023-10-06T02:20:51.831822+0000","last_fullsized":"2023-10-06T02:20:51.831822+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:28.423769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.833154+0000","last_change":"2023-10-06T02:20:50.817443+0000","last_active":"2023-10-06T02:20:51.833154+0000","last_peered":"2023-10-06T02:20:51.833154+0000","last_clean":"2023-10-06T02:20:51.833154+0000","last_became_active":"2023-10-06T02:20:50.817182+0000","last_became_peered":"2023-10-06T02:20:50.817182+0000","last_unstale":"2023-10-06T02:20:51.833154+0000","last_undegraded":"2023-10-06T02:20:51.833154+0000","last_fullsized":"2023-10-06T02:20:51.833154+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:57.783928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.810629+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:20:51.810629+0000","last_peered":"2023-10-06T02:20:51.810629+0000","last_clean":"2023-10-06T02:20:51.810629+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:20:51.810629+0000","last_undegraded":"2023-10-06T02:20:51.810629+0000","last_fullsized":"2023-10-06T02:20:51.810629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.822290+0000","last_change":"2023-10-06T02:20:51.817247+0000","last_active":"2023-10-06T02:20:51.822290+0000","last_peered":"2023-10-06T02:20:51.822290+0000","last_clean":"2023-10-06T02:20:51.822290+0000","last_became_active":"2023-10-06T02:20:51.816810+0000","last_became_peered":"2023-10-06T02:20:51.816810+0000","last_unstale":"2023-10-06T02:20:51.822290+0000","last_undegraded":"2023-10-06T02:20:51.822290+0000","last_fullsized":"2023-10-06T02:20:51.822290+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:04.234529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.817437+0000","last_change":"2023-10-06T02:20:50.814717+0000","last_active":"2023-10-06T02:20:51.817437+0000","last_peered":"2023-10-06T02:20:51.817437+0000","last_clean":"2023-10-06T02:20:51.817437+0000","last_became_active":"2023-10-06T02:20:50.814458+0000","last_became_peered":"2023-10-06T02:20:50.814458+0000","last_unstale":"2023-10-06T02:20:51.817437+0000","last_undegraded":"2023-10-06T02:20:51.817437+0000","last_fullsized":"2023-10-06T02:20:51.817437+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:34.978104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":52,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.807704+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:20:51.807704+0000","last_peered":"2023-10-06T02:20:51.807704+0000","last_clean":"2023-10-06T02:20:51.807704+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:20:51.807704+0000","last_undegraded":"2023-10-06T02:20:51.807704+0000","last_fullsized":"2023-10-06T02:20:51.807704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.828318+0000","last_change":"2023-10-06T02:20:51.823101+0000","last_active":"2023-10-06T02:20:51.828318+0000","last_peered":"2023-10-06T02:20:51.828318+0000","last_clean":"2023-10-06T02:20:51.828318+0000","last_became_active":"2023-10-06T02:20:51.822490+0000","last_became_peered":"2023-10-06T02:20:51.822490+0000","last_unstale":"2023-10-06T02:20:51.828318+0000","last_undegraded":"2023-10-06T02:20:51.828318+0000","last_fullsized":"2023-10-06T02:20:51.828318+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:50.167140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.832501+0000","last_change":"2023-10-06T02:20:50.816477+0000","last_active":"2023-10-06T02:20:51.832501+0000","last_peered":"2023-10-06T02:20:51.832501+0000","last_clean":"2023-10-06T02:20:51.832501+0000","last_became_active":"2023-10-06T02:20:50.813835+0000","last_became_peered":"2023-10-06T02:20:50.813835+0000","last_unstale":"2023-10-06T02:20:51.832501+0000","last_undegraded":"2023-10-06T02:20:51.832501+0000","last_fullsized":"2023-10-06T02:20:51.832501+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:23.603882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.817728+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:20:51.817728+0000","last_peered":"2023-10-06T02:20:51.817728+0000","last_clean":"2023-10-06T02:20:51.817728+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:20:51.817728+0000","last_undegraded":"2023-10-06T02:20:51.817728+0000","last_fullsized":"2023-10-06T02:20:51.817728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.834420+0000","last_change":"2023-10-06T02:20:51.832929+0000","last_active":"2023-10-06T02:20:51.834420+0000","last_peered":"2023-10-06T02:20:51.834420+0000","last_clean":"2023-10-06T02:20:51.834420+0000","last_became_active":"2023-10-06T02:20:51.832707+0000","last_became_peered":"2023-10-06T02:20:51.832707+0000","last_unstale":"2023-10-06T02:20:51.834420+0000","last_undegraded":"2023-10-06T02:20:51.834420+0000","last_fullsized":"2023-10-06T02:20:51.834420+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:32.733850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.810242+0000","last_change":"2023-10-06T02:20:50.819383+0000","last_active":"2023-10-06T02:20:51.810242+0000","last_peered":"2023-10-06T02:20:51.810242+0000","last_clean":"2023-10-06T02:20:51.810242+0000","last_became_active":"2023-10-06T02:20:50.819113+0000","last_became_peered":"2023-10-06T02:20:50.819113+0000","last_unstale":"2023-10-06T02:20:51.810242+0000","last_undegraded":"2023-10-06T02:20:51.810242+0000","last_fullsized":"2023-10-06T02:20:51.810242+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:35.120072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.817115+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:20:51.817115+0000","last_peered":"2023-10-06T02:20:51.817115+0000","last_clean":"2023-10-06T02:20:51.817115+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:20:51.817115+0000","last_undegraded":"2023-10-06T02:20:51.817115+0000","last_fullsized":"2023-10-06T02:20:51.817115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298656,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073184,"statfs":{"total":96636764160,"available":96330940416,"internally_reserved":0,"allocated":1400832,"data_stored":968066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.377,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":1.111,"15min":1.111},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.47999999999999998},"min":{"1min":0.30499999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80600000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.438}]},{"osd":1,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.35899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86299999999999999,"5min":1.008,"15min":1.008},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.505},"min":{"1min":0.36699999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70499999999999996,"5min":1.075,"15min":1.075},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82199999999999995,"5min":1.149,"15min":1.149},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.56699999999999995},"min":{"1min":0.49199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77400000000000002,"5min":1.048,"15min":1.048},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45900000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79200000000000004,"5min":1.175,"15min":1.175},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.56299999999999994},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83799999999999997,"5min":1.03,"15min":1.03},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.41599999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75800000000000001,"5min":0.873,"15min":0.873},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80300000000000005,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.39500000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.71199999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.502},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84799999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78600000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":376249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.76300000000000001,"15min":0.84699999999999998},"min":{"1min":0.44800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82399999999999995,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.76600000000000001,"15min":0.85899999999999999},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82799999999999996,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":0.74099999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.433,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.88800000000000001,"15min":1.04},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77700000000000002,"5min":8.8659999999999997,"15min":8.8659999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.35599999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.98499999999999999,"15min":1.157},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86799999999999999,"5min":10.659000000000001,"15min":10.659000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.36899999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70099999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54200000000000004,"15min":0.55300000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.70799999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.41299999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72199999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.754,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.38100000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.64200000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298664,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073176,"statfs":{"total":96636764160,"available":96330932224,"internally_reserved":0,"allocated":1409024,"data_stored":968649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.34300000000000003},"min":{"1min":0.23499999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.28100000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53100000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.34000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.32600000000000001,"15min":0.317},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.499,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.379,"15min":0.375},"min":{"1min":0.28999999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51900000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.32400000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.38300000000000001,"15min":0.37},"min":{"1min":0.312,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54500000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.38700000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.41599999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.68500000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.435},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.81499999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75800000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.73899999999999999,"5min":0.87,"15min":0.87},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83899999999999997,"5min":0.879,"15min":0.879},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79700000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":377110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.316,"15min":0.29999999999999999},"min":{"1min":0.246,"5min":0.216,"15min":0.216},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.34999999999999998,"15min":0.33400000000000002},"min":{"1min":0.27600000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.48799999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.42199999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.376,"15min":0.36299999999999999},"min":{"1min":0.28100000000000003,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.377},{"interface":"front","average":{"1min":0.376,"5min":0.33600000000000002,"15min":0.32200000000000001},"min":{"1min":0.25700000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.34799999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.377},"min":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.51600000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.41199999999999998,"15min":0.40300000000000002},"min":{"1min":0.27300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.498}]},{"osd":4,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":1.369,"15min":1.369},"last":0.629},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83799999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54600000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.42099999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77800000000000002,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79600000000000004,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61499999999999999,"15min":0.59299999999999997},"min":{"1min":0.495,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.96699999999999997,"15min":1.115},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79400000000000004,"5min":11.138,"15min":11.138},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84499999999999997,"5min":1.429,"15min":1.429},"last":0.76200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298076,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073764,"statfs":{"total":96636764160,"available":96331534336,"internally_reserved":0,"allocated":806912,"data_stored":377693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.23999999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.42799999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.254},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.376,"15min":0.36699999999999999},"min":{"1min":0.27800000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.46100000000000002,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.39700000000000002,"15min":0.377},"min":{"1min":0.255,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.44400000000000001,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.41399999999999998,"15min":0.39200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.45600000000000002,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.33000000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.379,"15min":0.36699999999999999},"min":{"1min":0.27100000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.44700000000000001,"5min":1.423,"15min":1.423},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.498,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.56899999999999995},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84099999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.76900000000000002,"5min":1.304,"15min":1.304},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.76000000000000001,"5min":0.875,"15min":0.875},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77400000000000002,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.629,"15min":0.622},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82799999999999996,"5min":1.347,"15min":1.347},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77100000000000002,"5min":1.206,"15min":1.206},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.45800000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89500000000000002,"5min":1.385,"15min":1.385},"last":0.59499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298076,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073764,"statfs":{"total":96636764160,"available":96331534336,"internally_reserved":0,"allocated":806912,"data_stored":377222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.35699999999999998,"15min":0.36199999999999999},"min":{"1min":0.22700000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.44700000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.373},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.25700000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.53200000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.36399999999999999,"15min":0.36599999999999999},"min":{"1min":0.23799999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48999999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.311},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39900000000000002,"15min":0.39700000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58499999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.29499999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.318,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51400000000000001,"5min":0.624,"15min":0.624},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.29399999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96599999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.42399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89300000000000002,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92300000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.69299999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59099999999999997,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91100000000000003,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.628,"15min":0.63},"min":{"1min":0.443,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96399999999999997,"5min":1.391,"15min":1.391},"last":0.72299999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61199999999999999,"15min":0.59999999999999998},"min":{"1min":0.47299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.81899999999999995,"5min":0.874,"15min":0.874},"last":0.65500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":377180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.34300000000000003,"5min":0.217,"15min":0.217},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59099999999999997,"15min":0.57999999999999996},"min":{"1min":0.45700000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78600000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":1.028,"15min":1.238},"min":{"1min":0.39900000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74399999999999999,"5min":17.879999999999999,"15min":17.879999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":1.024,"15min":1.2230000000000001},"min":{"1min":0.45900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.74099999999999999,"5min":18.010999999999999,"15min":18.010999999999999},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.51700000000000002},"min":{"1min":0.436,"5min":0.309,"15min":0.309},"max":{"1min":0.72499999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72699999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.54100000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.53600000000000003},"min":{"1min":0.434,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66600000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.373,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80300000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.371,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.32700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50600000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.36799999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.77400000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.40799999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82099999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":377200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.318,"5min":0.307,"15min":0.307},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.312}]},{"osd":1,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.441},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.59399999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.38200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.48899999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51200000000000001,"15min":0.51800000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.61099999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.503,"15min":0.504},"min":{"1min":0.34300000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69999999999999996,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.40999999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.52200000000000002},"min":{"1min":0.36899999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71399999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73799999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71099999999999997,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:20:56.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:20:56.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.856+0000 7f3c658ff700 1 Processor -- start 2023-10-06T02:20:56.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.856+0000 7f3c658ff700 1 -- start start 2023-10-06T02:20:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.856+0000 7f3c658ff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c601596d0 0x7f3c60159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.857+0000 7f3c658ff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c600c59c0 0x7f3c6015d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.857+0000 7f3c658ff700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6015d490 con 0x7f3c600c5540 2023-10-06T02:20:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.857+0000 7f3c658ff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6015a390 con 0x7f3c601596d0 2023-10-06T02:20:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.857+0000 7f3c658ff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6015a670 con 0x7f3c600c59c0 2023-10-06T02:20:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.857+0000 7f3c5effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c601596d0 0x7f3c60159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.857+0000 7f3c5effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c601596d0 0x7f3c60159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54830/0 (socket says 172.21.15.6:54830) 2023-10-06T02:20:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.857+0000 7f3c5effd700 1 -- 172.21.15.6:0/1316728163 learned_addr learned my addr 172.21.15.6:0/1316728163 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.857+0000 7f3c5f7fe700 1 --2- 172.21.15.6:0/1316728163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c600c59c0 0x7f3c6015d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.857+0000 7f3c5effd700 1 -- 172.21.15.6:0/1316728163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c600c59c0 msgr2=0x7f3c6015d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.857+0000 7f3c5effd700 1 --2- 172.21.15.6:0/1316728163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c600c59c0 0x7f3c6015d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.857+0000 7f3c5effd700 1 -- 172.21.15.6:0/1316728163 >> v1:172.21.15.175:6789/0 conn(0x7f3c600c5540 legacy=0x7f3c600cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:20:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.857+0000 7f3c5effd700 1 -- 172.21.15.6:0/1316728163 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6015a950 con 0x7f3c601596d0 2023-10-06T02:20:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.857+0000 7f3c5effd700 1 --2- 172.21.15.6:0/1316728163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c601596d0 0x7f3c60159aa0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f3c500099b0 tx=0x7f3c50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7acd557292179ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.857+0000 7f3c5dffb700 1 -- 172.21.15.6:0/1316728163 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5000b860 con 0x7f3c601596d0 2023-10-06T02:20:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.857+0000 7f3c5dffb700 1 -- 172.21.15.6:0/1316728163 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5000b9c0 con 0x7f3c601596d0 2023-10-06T02:20:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.857+0000 7f3c5dffb700 1 -- 172.21.15.6:0/1316728163 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5000bd60 con 0x7f3c601596d0 2023-10-06T02:20:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.858+0000 7f3c658ff700 1 -- 172.21.15.6:0/1316728163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c601596d0 msgr2=0x7f3c60159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.858+0000 7f3c658ff700 1 --2- 172.21.15.6:0/1316728163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c601596d0 0x7f3c60159aa0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f3c500099b0 tx=0x7f3c50009250 comp rx=0 tx=0).stop 2023-10-06T02:20:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.858+0000 7f3c658ff700 1 -- 172.21.15.6:0/1316728163 shutdown_connections 2023-10-06T02:20:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.858+0000 7f3c658ff700 1 --2- 172.21.15.6:0/1316728163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c600c59c0 0x7f3c6015d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.858+0000 7f3c658ff700 1 --2- 172.21.15.6:0/1316728163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c601596d0 0x7f3c60159aa0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.858+0000 7f3c658ff700 1 -- 172.21.15.6:0/1316728163 >> 172.21.15.6:0/1316728163 conn(0x7f3c60068680 msgr2=0x7f3c60068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.858+0000 7f3c658ff700 1 -- 172.21.15.6:0/1316728163 shutdown_connections 2023-10-06T02:20:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.858+0000 7f3c658ff700 1 -- 172.21.15.6:0/1316728163 wait complete. 2023-10-06T02:20:56.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.859+0000 7f3c658ff700 1 Processor -- start 2023-10-06T02:20:56.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.859+0000 7f3c658ff700 1 -- start start 2023-10-06T02:20:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.860+0000 7f3c658ff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c600c5540 0x7f3c600c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.860+0000 7f3c658ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c600c59c0 0x7f3c60149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.860+0000 7f3c658ff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c601596d0 0x7f3c6015d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.860+0000 7f3c658ff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c60153380 con 0x7f3c600c59c0 2023-10-06T02:20:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.860+0000 7f3c658ff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c600c96b0 con 0x7f3c600c5540 2023-10-06T02:20:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.860+0000 7f3c658ff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c60152770 con 0x7f3c601596d0 2023-10-06T02:20:56.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.860+0000 7f3c5e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c600c59c0 0x7f3c60149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:56.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.860+0000 7f3c5e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c600c59c0 0x7f3c60149240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54832/0 (socket says 172.21.15.6:54832) 2023-10-06T02:20:56.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.860+0000 7f3c5e7fc700 1 -- 172.21.15.6:0/1245697851 learned_addr learned my addr 172.21.15.6:0/1245697851 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.860+0000 7f3c5f7fe700 1 --2- 172.21.15.6:0/1245697851 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c601596d0 0x7f3c6015d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.860+0000 7f3c5effd700 1 --2- 172.21.15.6:0/1245697851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c600c5540 0x7f3c600c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.860+0000 7f3c5e7fc700 1 -- 172.21.15.6:0/1245697851 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c601596d0 msgr2=0x7f3c6015d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.860+0000 7f3c5e7fc700 1 --2- 172.21.15.6:0/1245697851 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c601596d0 0x7f3c6015d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.861+0000 7f3c5e7fc700 1 -- 172.21.15.6:0/1245697851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c600c5540 msgr2=0x7f3c600c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.861+0000 7f3c5e7fc700 1 --2- 172.21.15.6:0/1245697851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c600c5540 0x7f3c600c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.861+0000 7f3c5e7fc700 1 -- 172.21.15.6:0/1245697851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c500094f0 con 0x7f3c600c59c0 2023-10-06T02:20:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.861+0000 7f3c5e7fc700 1 --2- 172.21.15.6:0/1245697851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c600c59c0 0x7f3c60149240 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c790 tx=0x7f3c54007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.861+0000 7f3c46ffd700 1 -- 172.21.15.6:0/1245697851 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54011590 con 0x7f3c600c59c0 2023-10-06T02:20:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.861+0000 7f3c46ffd700 1 -- 172.21.15.6:0/1245697851 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c54011710 con 0x7f3c600c59c0 2023-10-06T02:20:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.861+0000 7f3c658ff700 1 -- 172.21.15.6:0/1245697851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c60152a50 con 0x7f3c600c59c0 2023-10-06T02:20:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.861+0000 7f3c46ffd700 1 -- 172.21.15.6:0/1245697851 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54011ad0 con 0x7f3c600c59c0 2023-10-06T02:20:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.861+0000 7f3c658ff700 1 -- 172.21.15.6:0/1245697851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c60153010 con 0x7f3c600c59c0 2023-10-06T02:20:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.862+0000 7f3c658ff700 1 -- 172.21.15.6:0/1245697851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c600b38d0 con 0x7f3c600c59c0 2023-10-06T02:20:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.862+0000 7f3c46ffd700 1 -- 172.21.15.6:0/1245697851 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c5401b3b0 con 0x7f3c600c59c0 2023-10-06T02:20:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.863+0000 7f3c46ffd700 1 --2- 172.21.15.6:0/1245697851 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c4c066f30 0x7f3c4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.863+0000 7f3c46ffd700 1 -- 172.21.15.6:0/1245697851 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3c54083da0 con 0x7f3c600c59c0 2023-10-06T02:20:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.863+0000 7f3c5effd700 1 --2- 172.21.15.6:0/1245697851 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c4c066f30 0x7f3c4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.864+0000 7f3c5effd700 1 --2- 172.21.15.6:0/1245697851 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c4c066f30 0x7f3c4c0693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3c500099b0 tx=0x7f3c50017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:56.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:56.867+0000 7f3c46ffd700 1 -- 172.21.15.6:0/1245697851 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c54050cd0 con 0x7f3c600c59c0 2023-10-06T02:20:57.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.140+0000 7f3c658ff700 1 -- 172.21.15.6:0/1245697851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3c6015ac30 con 0x7f3c600c59c0 2023-10-06T02:20:57.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.141+0000 7f3c46ffd700 1 -- 172.21.15.6:0/1245697851 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1436 (secure 0 0 0) 0x7f3c54017020 con 0x7f3c600c59c0 2023-10-06T02:20:57.141 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:57.141 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"c557bd13-0401-4965-a08f-5579f545617e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":212,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":66,"num_osds":8,"num_up_osds":8,"osd_up_since":1696558654,"num_in_osds":8,"osd_in_since":1696558647,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592674,"bytes_used":2443014144,"bytes_avail":770651099136,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":49,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"b","status":"up:active","gid":6222}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2023-10-06T02:20:38.603576+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T02:20:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.143+0000 7f3c658ff700 1 -- 172.21.15.6:0/1245697851 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c4c066f30 msgr2=0x7f3c4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.143+0000 7f3c658ff700 1 --2- 172.21.15.6:0/1245697851 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c4c066f30 0x7f3c4c0693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3c500099b0 tx=0x7f3c50017000 comp rx=0 tx=0).stop 2023-10-06T02:20:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.143+0000 7f3c658ff700 1 -- 172.21.15.6:0/1245697851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c600c59c0 msgr2=0x7f3c60149240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.143+0000 7f3c658ff700 1 --2- 172.21.15.6:0/1245697851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c600c59c0 0x7f3c60149240 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c790 tx=0x7f3c54007f40 comp rx=0 tx=0).stop 2023-10-06T02:20:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.143+0000 7f3c658ff700 1 -- 172.21.15.6:0/1245697851 shutdown_connections 2023-10-06T02:20:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.143+0000 7f3c658ff700 1 --2- 172.21.15.6:0/1245697851 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c601596d0 0x7f3c6015d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.143+0000 7f3c658ff700 1 --2- 172.21.15.6:0/1245697851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c600c5540 0x7f3c600c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.143+0000 7f3c658ff700 1 --2- 172.21.15.6:0/1245697851 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3c4c066f30 0x7f3c4c0693e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.143+0000 7f3c658ff700 1 --2- 172.21.15.6:0/1245697851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c600c59c0 0x7f3c60149240 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.143+0000 7f3c658ff700 1 -- 172.21.15.6:0/1245697851 >> 172.21.15.6:0/1245697851 conn(0x7f3c60068680 msgr2=0x7f3c600cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.143+0000 7f3c658ff700 1 -- 172.21.15.6:0/1245697851 shutdown_connections 2023-10-06T02:20:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.143+0000 7f3c658ff700 1 -- 172.21.15.6:0/1245697851 wait complete. 2023-10-06T02:20:57.155 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T02:20:57.155 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:20:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.273+0000 7fe32b9c6700 1 Processor -- start 2023-10-06T02:20:57.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.273+0000 7fe32b9c6700 1 -- start start 2023-10-06T02:20:57.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.274+0000 7fe32b9c6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3240b27f0 0x7fe32415db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:57.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.274+0000 7fe32b9c6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32415e190 con 0x7fe3240af8b0 2023-10-06T02:20:57.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.274+0000 7fe32b9c6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3240cb650 con 0x7fe3240af4e0 2023-10-06T02:20:57.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.274+0000 7fe32b9c6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3240b1910 con 0x7fe3240b27f0 2023-10-06T02:20:57.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.274+0000 7fe329f63700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3240b27f0 0x7fe32415db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:57.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.274+0000 7fe328f61700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe3240af8b0 0x7fe32415d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52350/0 (socket says 172.21.15.6:52350) 2023-10-06T02:20:57.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.274+0000 7fe328f61700 1 -- 172.21.15.6:0/1771341309 learned_addr learned my addr 172.21.15.6:0/1771341309 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:20:57.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.274+0000 7fe329f63700 1 --2- 172.21.15.6:0/1771341309 >> v2:172.21.15.6:3300/0 conn(0x7fe3240b27f0 0x7fe32415db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54838/0 (socket says 172.21.15.6:54838) 2023-10-06T02:20:57.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.275+0000 7fe329f63700 1 -- 172.21.15.6:0/1771341309 >> v1:172.21.15.175:6789/0 conn(0x7fe3240af4e0 legacy=0x7fe3240b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:57.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.275+0000 7fe329f63700 1 -- 172.21.15.6:0/1771341309 >> v1:172.21.15.6:6789/0 conn(0x7fe3240af8b0 legacy=0x7fe32415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:57.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.275+0000 7fe329f63700 1 -- 172.21.15.6:0/1771341309 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3240ccaf0 con 0x7fe3240b27f0 2023-10-06T02:20:57.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.275+0000 7fe329f63700 1 --2- 172.21.15.6:0/1771341309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3240b27f0 0x7fe32415db70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe314009e60 tx=0x7fe314009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1081ddf03a1c49f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:57.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.275+0000 7fe323fff700 1 -- 172.21.15.6:0/1771341309 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31400e070 con 0x7fe3240b27f0 2023-10-06T02:20:57.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.275+0000 7fe323fff700 1 -- 172.21.15.6:0/1771341309 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31400bc30 con 0x7fe3240b27f0 2023-10-06T02:20:57.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.275+0000 7fe323fff700 1 -- 172.21.15.6:0/1771341309 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe314012430 con 0x7fe3240b27f0 2023-10-06T02:20:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.275+0000 7fe32b9c6700 1 -- 172.21.15.6:0/1771341309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3240b27f0 msgr2=0x7fe32415db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.275+0000 7fe32b9c6700 1 --2- 172.21.15.6:0/1771341309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3240b27f0 0x7fe32415db70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe314009e60 tx=0x7fe314009780 comp rx=0 tx=0).stop 2023-10-06T02:20:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.276+0000 7fe32b9c6700 1 -- 172.21.15.6:0/1771341309 shutdown_connections 2023-10-06T02:20:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.276+0000 7fe32b9c6700 1 --2- 172.21.15.6:0/1771341309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3240b27f0 0x7fe32415db70 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.276+0000 7fe32b9c6700 1 -- 172.21.15.6:0/1771341309 >> 172.21.15.6:0/1771341309 conn(0x7fe324068680 msgr2=0x7fe324068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.276+0000 7fe32b9c6700 1 -- 172.21.15.6:0/1771341309 shutdown_connections 2023-10-06T02:20:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.276+0000 7fe32b9c6700 1 -- 172.21.15.6:0/1771341309 wait complete. 2023-10-06T02:20:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.277+0000 7fe32b9c6700 1 Processor -- start 2023-10-06T02:20:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.277+0000 7fe32b9c6700 1 -- start start 2023-10-06T02:20:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe32b9c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3240af4e0 0x7fe3240c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:57.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe32b9c6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3240af8b0 0x7fe324155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:57.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe32b9c6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3240b27f0 0x7fe3241433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:57.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe32b9c6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32416ab20 con 0x7fe3240af4e0 2023-10-06T02:20:57.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe32b9c6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe324169f10 con 0x7fe3240b27f0 2023-10-06T02:20:57.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe32b9c6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32416a1f0 con 0x7fe3240af8b0 2023-10-06T02:20:57.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe329762700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3240af4e0 0x7fe3240c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:57.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe329762700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3240af4e0 0x7fe3240c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54854/0 (socket says 172.21.15.6:54854) 2023-10-06T02:20:57.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe329762700 1 -- 172.21.15.6:0/3971869779 learned_addr learned my addr 172.21.15.6:0/3971869779 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:20:57.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe329762700 1 -- 172.21.15.6:0/3971869779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3240af8b0 msgr2=0x7fe324155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe329762700 1 --2- 172.21.15.6:0/3971869779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3240af8b0 0x7fe324155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe329762700 1 -- 172.21.15.6:0/3971869779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3240b27f0 msgr2=0x7fe3241433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe329762700 1 --2- 172.21.15.6:0/3971869779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3240b27f0 0x7fe3241433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe329762700 1 -- 172.21.15.6:0/3971869779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe314009a20 con 0x7fe3240af4e0 2023-10-06T02:20:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe329762700 1 --2- 172.21.15.6:0/3971869779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3240af4e0 0x7fe3240c6130 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00c790 tx=0x7fe31c007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe3217fa700 1 -- 172.21.15.6:0/3971869779 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c011590 con 0x7fe3240af4e0 2023-10-06T02:20:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe3217fa700 1 -- 172.21.15.6:0/3971869779 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c011710 con 0x7fe3240af4e0 2023-10-06T02:20:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe32b9c6700 1 -- 172.21.15.6:0/3971869779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32416a4d0 con 0x7fe3240af4e0 2023-10-06T02:20:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe3217fa700 1 -- 172.21.15.6:0/3971869779 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c011ad0 con 0x7fe3240af4e0 2023-10-06T02:20:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.278+0000 7fe32b9c6700 1 -- 172.21.15.6:0/3971869779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3240c6670 con 0x7fe3240af4e0 2023-10-06T02:20:57.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.279+0000 7fe32b9c6700 1 -- 172.21.15.6:0/3971869779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe324088aa0 con 0x7fe3240af4e0 2023-10-06T02:20:57.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.280+0000 7fe3217fa700 1 -- 172.21.15.6:0/3971869779 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe31c01b3b0 con 0x7fe3240af4e0 2023-10-06T02:20:57.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.280+0000 7fe3217fa700 1 --2- 172.21.15.6:0/3971869779 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe310066f30 0x7fe3100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:20:57.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.280+0000 7fe3217fa700 1 -- 172.21.15.6:0/3971869779 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe31c083cf0 con 0x7fe3240af4e0 2023-10-06T02:20:57.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.280+0000 7fe328f61700 1 --2- 172.21.15.6:0/3971869779 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe310066f30 0x7fe3100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:20:57.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.281+0000 7fe328f61700 1 --2- 172.21.15.6:0/3971869779 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe310066f30 0x7fe3100693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe3240d15d0 tx=0x7fe318007b30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:20:57.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.284+0000 7fe3217fa700 1 -- 172.21.15.6:0/3971869779 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe31c088070 con 0x7fe3240af4e0 2023-10-06T02:20:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.474+0000 7fe32b9c6700 1 -- 172.21.15.6:0/3971869779 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe32416ac60 con 0x7fe310066f30 2023-10-06T02:20:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.484+0000 7fe3217fa700 1 -- 172.21.15.6:0/3971869779 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311590 (secure 0 0 0) 0x7fe318005900 con 0x7fe310066f30 2023-10-06T02:20:57.488 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:20:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.487+0000 7fe32b9c6700 1 -- 172.21.15.6:0/3971869779 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe310066f30 msgr2=0x7fe3100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.487+0000 7fe32b9c6700 1 --2- 172.21.15.6:0/3971869779 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe310066f30 0x7fe3100693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe3240d15d0 tx=0x7fe318007b30 comp rx=0 tx=0).stop 2023-10-06T02:20:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.487+0000 7fe32b9c6700 1 -- 172.21.15.6:0/3971869779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3240af4e0 msgr2=0x7fe3240c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:20:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.487+0000 7fe32b9c6700 1 --2- 172.21.15.6:0/3971869779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3240af4e0 0x7fe3240c6130 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00c790 tx=0x7fe31c007f40 comp rx=0 tx=0).stop 2023-10-06T02:20:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.487+0000 7fe32b9c6700 1 -- 172.21.15.6:0/3971869779 shutdown_connections 2023-10-06T02:20:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.487+0000 7fe32b9c6700 1 --2- 172.21.15.6:0/3971869779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3240b27f0 0x7fe3241433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.487+0000 7fe32b9c6700 1 --2- 172.21.15.6:0/3971869779 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe310066f30 0x7fe3100693e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.487+0000 7fe32b9c6700 1 --2- 172.21.15.6:0/3971869779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3240af4e0 0x7fe3240c6130 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.487+0000 7fe32b9c6700 1 --2- 172.21.15.6:0/3971869779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3240af8b0 0x7fe324155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:20:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.487+0000 7fe32b9c6700 1 -- 172.21.15.6:0/3971869779 >> 172.21.15.6:0/3971869779 conn(0x7fe324068680 msgr2=0x7fe3240cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:20:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.487+0000 7fe32b9c6700 1 -- 172.21.15.6:0/3971869779 shutdown_connections 2023-10-06T02:20:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:20:57.487+0000 7fe32b9c6700 1 -- 172.21.15.6:0/3971869779 wait complete. 2023-10-06T02:20:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:20:57.500 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2023-10-06T02:20:56.607411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385756,"kb_used_data":7452,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588964,"statfs":{"total":773094113280,"available":770651099136,"internally_reserved":0,"allocated":7630848,"data_stored":4199369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001332"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838094+0000","last_change":"2023-10-06T02:20:51.833161+0000","last_active":"2023-10-06T02:20:51.838094+0000","last_peered":"2023-10-06T02:20:51.838094+0000","last_clean":"2023-10-06T02:20:51.838094+0000","last_became_active":"2023-10-06T02:20:51.832806+0000","last_became_peered":"2023-10-06T02:20:51.832806+0000","last_unstale":"2023-10-06T02:20:51.838094+0000","last_undegraded":"2023-10-06T02:20:51.838094+0000","last_fullsized":"2023-10-06T02:20:51.838094+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:22.524253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838203+0000","last_change":"2023-10-06T02:20:51.832644+0000","last_active":"2023-10-06T02:20:51.838203+0000","last_peered":"2023-10-06T02:20:51.838203+0000","last_clean":"2023-10-06T02:20:51.838203+0000","last_became_active":"2023-10-06T02:20:51.832111+0000","last_became_peered":"2023-10-06T02:20:51.832111+0000","last_unstale":"2023-10-06T02:20:51.838203+0000","last_undegraded":"2023-10-06T02:20:51.838203+0000","last_fullsized":"2023-10-06T02:20:51.838203+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:17.290467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.823910+0000","last_change":"2023-10-06T02:20:51.818576+0000","last_active":"2023-10-06T02:20:51.823910+0000","last_peered":"2023-10-06T02:20:51.823910+0000","last_clean":"2023-10-06T02:20:51.823910+0000","last_became_active":"2023-10-06T02:20:51.818282+0000","last_became_peered":"2023-10-06T02:20:51.818282+0000","last_unstale":"2023-10-06T02:20:51.823910+0000","last_undegraded":"2023-10-06T02:20:51.823910+0000","last_fullsized":"2023-10-06T02:20:51.823910+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:07.959025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829576+0000","last_change":"2023-10-06T02:20:51.828039+0000","last_active":"2023-10-06T02:20:51.829576+0000","last_peered":"2023-10-06T02:20:51.829576+0000","last_clean":"2023-10-06T02:20:51.829576+0000","last_became_active":"2023-10-06T02:20:51.827793+0000","last_became_peered":"2023-10-06T02:20:51.827793+0000","last_unstale":"2023-10-06T02:20:51.829576+0000","last_undegraded":"2023-10-06T02:20:51.829576+0000","last_fullsized":"2023-10-06T02:20:51.829576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:26.648876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830905+0000","last_change":"2023-10-06T02:20:51.824928+0000","last_active":"2023-10-06T02:20:51.830905+0000","last_peered":"2023-10-06T02:20:51.830905+0000","last_clean":"2023-10-06T02:20:51.830905+0000","last_became_active":"2023-10-06T02:20:51.824649+0000","last_became_peered":"2023-10-06T02:20:51.824649+0000","last_unstale":"2023-10-06T02:20:51.830905+0000","last_undegraded":"2023-10-06T02:20:51.830905+0000","last_fullsized":"2023-10-06T02:20:51.830905+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:27.916523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838132+0000","last_change":"2023-10-06T02:20:51.832649+0000","last_active":"2023-10-06T02:20:51.838132+0000","last_peered":"2023-10-06T02:20:51.838132+0000","last_clean":"2023-10-06T02:20:51.838132+0000","last_became_active":"2023-10-06T02:20:51.832210+0000","last_became_peered":"2023-10-06T02:20:51.832210+0000","last_unstale":"2023-10-06T02:20:51.838132+0000","last_undegraded":"2023-10-06T02:20:51.838132+0000","last_fullsized":"2023-10-06T02:20:51.838132+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:52.764916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.818048+0000","last_change":"2023-10-06T02:20:51.816289+0000","last_active":"2023-10-06T02:20:51.818048+0000","last_peered":"2023-10-06T02:20:51.818048+0000","last_clean":"2023-10-06T02:20:51.818048+0000","last_became_active":"2023-10-06T02:20:51.816011+0000","last_became_peered":"2023-10-06T02:20:51.816011+0000","last_unstale":"2023-10-06T02:20:51.818048+0000","last_undegraded":"2023-10-06T02:20:51.818048+0000","last_fullsized":"2023-10-06T02:20:51.818048+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:11.256735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838053+0000","last_change":"2023-10-06T02:20:51.830772+0000","last_active":"2023-10-06T02:20:51.838053+0000","last_peered":"2023-10-06T02:20:51.838053+0000","last_clean":"2023-10-06T02:20:51.838053+0000","last_became_active":"2023-10-06T02:20:51.830511+0000","last_became_peered":"2023-10-06T02:20:51.830511+0000","last_unstale":"2023-10-06T02:20:51.838053+0000","last_undegraded":"2023-10-06T02:20:51.838053+0000","last_fullsized":"2023-10-06T02:20:51.838053+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:34:01.968206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830038+0000","last_change":"2023-10-06T02:20:51.827652+0000","last_active":"2023-10-06T02:20:51.830038+0000","last_peered":"2023-10-06T02:20:51.830038+0000","last_clean":"2023-10-06T02:20:51.830038+0000","last_became_active":"2023-10-06T02:20:51.826951+0000","last_became_peered":"2023-10-06T02:20:51.826951+0000","last_unstale":"2023-10-06T02:20:51.830038+0000","last_undegraded":"2023-10-06T02:20:51.830038+0000","last_fullsized":"2023-10-06T02:20:51.830038+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:32.371220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830500+0000","last_change":"2023-10-06T02:20:51.823449+0000","last_active":"2023-10-06T02:20:51.830500+0000","last_peered":"2023-10-06T02:20:51.830500+0000","last_clean":"2023-10-06T02:20:51.830500+0000","last_became_active":"2023-10-06T02:20:51.823206+0000","last_became_peered":"2023-10-06T02:20:51.823206+0000","last_unstale":"2023-10-06T02:20:51.830500+0000","last_undegraded":"2023-10-06T02:20:51.830500+0000","last_fullsized":"2023-10-06T02:20:51.830500+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:06.182600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.826736+0000","last_change":"2023-10-06T02:20:51.824383+0000","last_active":"2023-10-06T02:20:51.826736+0000","last_peered":"2023-10-06T02:20:51.826736+0000","last_clean":"2023-10-06T02:20:51.826736+0000","last_became_active":"2023-10-06T02:20:51.824143+0000","last_became_peered":"2023-10-06T02:20:51.824143+0000","last_unstale":"2023-10-06T02:20:51.826736+0000","last_undegraded":"2023-10-06T02:20:51.826736+0000","last_fullsized":"2023-10-06T02:20:51.826736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:16.074398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.828337+0000","last_change":"2023-10-06T02:20:51.823286+0000","last_active":"2023-10-06T02:20:51.828337+0000","last_peered":"2023-10-06T02:20:51.828337+0000","last_clean":"2023-10-06T02:20:51.828337+0000","last_became_active":"2023-10-06T02:20:51.822843+0000","last_became_peered":"2023-10-06T02:20:51.822843+0000","last_unstale":"2023-10-06T02:20:51.828337+0000","last_undegraded":"2023-10-06T02:20:51.828337+0000","last_fullsized":"2023-10-06T02:20:51.828337+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:34.666306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830947+0000","last_change":"2023-10-06T02:20:51.827347+0000","last_active":"2023-10-06T02:20:51.830947+0000","last_peered":"2023-10-06T02:20:51.830947+0000","last_clean":"2023-10-06T02:20:51.830947+0000","last_became_active":"2023-10-06T02:20:51.827067+0000","last_became_peered":"2023-10-06T02:20:51.827067+0000","last_unstale":"2023-10-06T02:20:51.830947+0000","last_undegraded":"2023-10-06T02:20:51.830947+0000","last_fullsized":"2023-10-06T02:20:51.830947+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:38.335002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.824189+0000","last_change":"2023-10-06T02:20:51.819988+0000","last_active":"2023-10-06T02:20:51.824189+0000","last_peered":"2023-10-06T02:20:51.824189+0000","last_clean":"2023-10-06T02:20:51.824189+0000","last_became_active":"2023-10-06T02:20:51.819699+0000","last_became_peered":"2023-10-06T02:20:51.819699+0000","last_unstale":"2023-10-06T02:20:51.824189+0000","last_undegraded":"2023-10-06T02:20:51.824189+0000","last_fullsized":"2023-10-06T02:20:51.824189+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:22:07.531514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.821210+0000","last_change":"2023-10-06T02:20:51.818432+0000","last_active":"2023-10-06T02:20:51.821210+0000","last_peered":"2023-10-06T02:20:51.821210+0000","last_clean":"2023-10-06T02:20:51.821210+0000","last_became_active":"2023-10-06T02:20:51.818132+0000","last_became_peered":"2023-10-06T02:20:51.818132+0000","last_unstale":"2023-10-06T02:20:51.821210+0000","last_undegraded":"2023-10-06T02:20:51.821210+0000","last_fullsized":"2023-10-06T02:20:51.821210+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:27.994546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831034+0000","last_change":"2023-10-06T02:20:51.823644+0000","last_active":"2023-10-06T02:20:51.831034+0000","last_peered":"2023-10-06T02:20:51.831034+0000","last_clean":"2023-10-06T02:20:51.831034+0000","last_became_active":"2023-10-06T02:20:51.823368+0000","last_became_peered":"2023-10-06T02:20:51.823368+0000","last_unstale":"2023-10-06T02:20:51.831034+0000","last_undegraded":"2023-10-06T02:20:51.831034+0000","last_fullsized":"2023-10-06T02:20:51.831034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:38.335002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830054+0000","last_change":"2023-10-06T02:20:51.827211+0000","last_active":"2023-10-06T02:20:51.830054+0000","last_peered":"2023-10-06T02:20:51.830054+0000","last_clean":"2023-10-06T02:20:51.830054+0000","last_became_active":"2023-10-06T02:20:51.826592+0000","last_became_peered":"2023-10-06T02:20:51.826592+0000","last_unstale":"2023-10-06T02:20:51.830054+0000","last_undegraded":"2023-10-06T02:20:51.830054+0000","last_fullsized":"2023-10-06T02:20:51.830054+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:24.608807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829550+0000","last_change":"2023-10-06T02:20:51.827857+0000","last_active":"2023-10-06T02:20:51.829550+0000","last_peered":"2023-10-06T02:20:51.829550+0000","last_clean":"2023-10-06T02:20:51.829550+0000","last_became_active":"2023-10-06T02:20:51.827566+0000","last_became_peered":"2023-10-06T02:20:51.827566+0000","last_unstale":"2023-10-06T02:20:51.829550+0000","last_undegraded":"2023-10-06T02:20:51.829550+0000","last_fullsized":"2023-10-06T02:20:51.829550+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:40:30.735186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838046+0000","last_change":"2023-10-06T02:20:51.830131+0000","last_active":"2023-10-06T02:20:51.838046+0000","last_peered":"2023-10-06T02:20:51.838046+0000","last_clean":"2023-10-06T02:20:51.838046+0000","last_became_active":"2023-10-06T02:20:51.829829+0000","last_became_peered":"2023-10-06T02:20:51.829829+0000","last_unstale":"2023-10-06T02:20:51.838046+0000","last_undegraded":"2023-10-06T02:20:51.838046+0000","last_fullsized":"2023-10-06T02:20:51.838046+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:50:42.198175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.821206+0000","last_change":"2023-10-06T02:20:51.818549+0000","last_active":"2023-10-06T02:20:51.821206+0000","last_peered":"2023-10-06T02:20:51.821206+0000","last_clean":"2023-10-06T02:20:51.821206+0000","last_became_active":"2023-10-06T02:20:51.818288+0000","last_became_peered":"2023-10-06T02:20:51.818288+0000","last_unstale":"2023-10-06T02:20:51.821206+0000","last_undegraded":"2023-10-06T02:20:51.821206+0000","last_fullsized":"2023-10-06T02:20:51.821206+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:45.261565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829073+0000","last_change":"2023-10-06T02:20:51.814480+0000","last_active":"2023-10-06T02:20:51.829073+0000","last_peered":"2023-10-06T02:20:51.829073+0000","last_clean":"2023-10-06T02:20:51.829073+0000","last_became_active":"2023-10-06T02:20:51.814204+0000","last_became_peered":"2023-10-06T02:20:51.814204+0000","last_unstale":"2023-10-06T02:20:51.829073+0000","last_undegraded":"2023-10-06T02:20:51.829073+0000","last_fullsized":"2023-10-06T02:20:51.829073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:23.870295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831267+0000","last_change":"2023-10-06T02:20:51.820729+0000","last_active":"2023-10-06T02:20:51.831267+0000","last_peered":"2023-10-06T02:20:51.831267+0000","last_clean":"2023-10-06T02:20:51.831267+0000","last_became_active":"2023-10-06T02:20:51.816847+0000","last_became_peered":"2023-10-06T02:20:51.816847+0000","last_unstale":"2023-10-06T02:20:51.831267+0000","last_undegraded":"2023-10-06T02:20:51.831267+0000","last_fullsized":"2023-10-06T02:20:51.831267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:36:54.493043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.825691+0000","last_change":"2023-10-06T02:20:51.822228+0000","last_active":"2023-10-06T02:20:51.825691+0000","last_peered":"2023-10-06T02:20:51.825691+0000","last_clean":"2023-10-06T02:20:51.825691+0000","last_became_active":"2023-10-06T02:20:51.821966+0000","last_became_peered":"2023-10-06T02:20:51.821966+0000","last_unstale":"2023-10-06T02:20:51.825691+0000","last_undegraded":"2023-10-06T02:20:51.825691+0000","last_fullsized":"2023-10-06T02:20:51.825691+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:00.591843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831438+0000","last_change":"2023-10-06T02:20:51.826196+0000","last_active":"2023-10-06T02:20:51.831438+0000","last_peered":"2023-10-06T02:20:51.831438+0000","last_clean":"2023-10-06T02:20:51.831438+0000","last_became_active":"2023-10-06T02:20:51.825929+0000","last_became_peered":"2023-10-06T02:20:51.825929+0000","last_unstale":"2023-10-06T02:20:51.831438+0000","last_undegraded":"2023-10-06T02:20:51.831438+0000","last_fullsized":"2023-10-06T02:20:51.831438+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:28.010680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830509+0000","last_change":"2023-10-06T02:20:51.814794+0000","last_active":"2023-10-06T02:20:51.830509+0000","last_peered":"2023-10-06T02:20:51.830509+0000","last_clean":"2023-10-06T02:20:51.830509+0000","last_became_active":"2023-10-06T02:20:51.809059+0000","last_became_peered":"2023-10-06T02:20:51.809059+0000","last_unstale":"2023-10-06T02:20:51.830509+0000","last_undegraded":"2023-10-06T02:20:51.830509+0000","last_fullsized":"2023-10-06T02:20:51.830509+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:47.466678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829706+0000","last_change":"2023-10-06T02:20:51.824773+0000","last_active":"2023-10-06T02:20:51.829706+0000","last_peered":"2023-10-06T02:20:51.829706+0000","last_clean":"2023-10-06T02:20:51.829706+0000","last_became_active":"2023-10-06T02:20:51.824476+0000","last_became_peered":"2023-10-06T02:20:51.824476+0000","last_unstale":"2023-10-06T02:20:51.829706+0000","last_undegraded":"2023-10-06T02:20:51.829706+0000","last_fullsized":"2023-10-06T02:20:51.829706+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:00.591843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.827311+0000","last_change":"2023-10-06T02:20:51.822355+0000","last_active":"2023-10-06T02:20:51.827311+0000","last_peered":"2023-10-06T02:20:51.827311+0000","last_clean":"2023-10-06T02:20:51.827311+0000","last_became_active":"2023-10-06T02:20:51.822041+0000","last_became_peered":"2023-10-06T02:20:51.822041+0000","last_unstale":"2023-10-06T02:20:51.827311+0000","last_undegraded":"2023-10-06T02:20:51.827311+0000","last_fullsized":"2023-10-06T02:20:51.827311+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:05.642500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830537+0000","last_change":"2023-10-06T02:20:51.822859+0000","last_active":"2023-10-06T02:20:51.830537+0000","last_peered":"2023-10-06T02:20:51.830537+0000","last_clean":"2023-10-06T02:20:51.830537+0000","last_became_active":"2023-10-06T02:20:51.822601+0000","last_became_peered":"2023-10-06T02:20:51.822601+0000","last_unstale":"2023-10-06T02:20:51.830537+0000","last_undegraded":"2023-10-06T02:20:51.830537+0000","last_fullsized":"2023-10-06T02:20:51.830537+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:53.757794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.822313+0000","last_change":"2023-10-06T02:20:51.817408+0000","last_active":"2023-10-06T02:20:51.822313+0000","last_peered":"2023-10-06T02:20:51.822313+0000","last_clean":"2023-10-06T02:20:51.822313+0000","last_became_active":"2023-10-06T02:20:51.817044+0000","last_became_peered":"2023-10-06T02:20:51.817044+0000","last_unstale":"2023-10-06T02:20:51.822313+0000","last_undegraded":"2023-10-06T02:20:51.822313+0000","last_fullsized":"2023-10-06T02:20:51.822313+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:25.714407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.827098+0000","last_change":"2023-10-06T02:20:51.824139+0000","last_active":"2023-10-06T02:20:51.827098+0000","last_peered":"2023-10-06T02:20:51.827098+0000","last_clean":"2023-10-06T02:20:51.827098+0000","last_became_active":"2023-10-06T02:20:51.823884+0000","last_became_peered":"2023-10-06T02:20:51.823884+0000","last_unstale":"2023-10-06T02:20:51.827098+0000","last_undegraded":"2023-10-06T02:20:51.827098+0000","last_fullsized":"2023-10-06T02:20:51.827098+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:40.217512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.820661+0000","last_change":"2023-10-06T02:20:51.817343+0000","last_active":"2023-10-06T02:20:51.820661+0000","last_peered":"2023-10-06T02:20:51.820661+0000","last_clean":"2023-10-06T02:20:51.820661+0000","last_became_active":"2023-10-06T02:20:51.817079+0000","last_became_peered":"2023-10-06T02:20:51.817079+0000","last_unstale":"2023-10-06T02:20:51.820661+0000","last_undegraded":"2023-10-06T02:20:51.820661+0000","last_fullsized":"2023-10-06T02:20:51.820661+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:28.010680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829310+0000","last_change":"2023-10-06T02:20:51.828115+0000","last_active":"2023-10-06T02:20:51.829310+0000","last_peered":"2023-10-06T02:20:51.829310+0000","last_clean":"2023-10-06T02:20:51.829310+0000","last_became_active":"2023-10-06T02:20:51.827857+0000","last_became_peered":"2023-10-06T02:20:51.827857+0000","last_unstale":"2023-10-06T02:20:51.829310+0000","last_undegraded":"2023-10-06T02:20:51.829310+0000","last_fullsized":"2023-10-06T02:20:51.829310+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:49:25.458611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.833059+0000","last_change":"2023-10-06T02:20:51.830780+0000","last_active":"2023-10-06T02:20:51.833059+0000","last_peered":"2023-10-06T02:20:51.833059+0000","last_clean":"2023-10-06T02:20:51.833059+0000","last_became_active":"2023-10-06T02:20:51.830516+0000","last_became_peered":"2023-10-06T02:20:51.830516+0000","last_unstale":"2023-10-06T02:20:51.833059+0000","last_undegraded":"2023-10-06T02:20:51.833059+0000","last_fullsized":"2023-10-06T02:20:51.833059+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:12:16.185906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"65'4","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829186+0000","last_change":"2023-10-06T02:20:50.822437+0000","last_active":"2023-10-06T02:20:51.829186+0000","last_peered":"2023-10-06T02:20:51.829186+0000","last_clean":"2023-10-06T02:20:51.829186+0000","last_became_active":"2023-10-06T02:20:50.822220+0000","last_became_peered":"2023-10-06T02:20:50.822220+0000","last_unstale":"2023-10-06T02:20:51.829186+0000","last_undegraded":"2023-10-06T02:20:51.829186+0000","last_fullsized":"2023-10-06T02:20:51.829186+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:32.995079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830018+0000","last_change":"2023-10-06T02:20:51.825686+0000","last_active":"2023-10-06T02:20:51.830018+0000","last_peered":"2023-10-06T02:20:51.830018+0000","last_clean":"2023-10-06T02:20:51.830018+0000","last_became_active":"2023-10-06T02:20:51.825407+0000","last_became_peered":"2023-10-06T02:20:51.825407+0000","last_unstale":"2023-10-06T02:20:51.830018+0000","last_undegraded":"2023-10-06T02:20:51.830018+0000","last_fullsized":"2023-10-06T02:20:51.830018+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:35.983030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.826803+0000","last_change":"2023-10-06T02:20:50.818921+0000","last_active":"2023-10-06T02:20:51.826803+0000","last_peered":"2023-10-06T02:20:51.826803+0000","last_clean":"2023-10-06T02:20:51.826803+0000","last_became_active":"2023-10-06T02:20:50.818714+0000","last_became_peered":"2023-10-06T02:20:50.818714+0000","last_unstale":"2023-10-06T02:20:51.826803+0000","last_undegraded":"2023-10-06T02:20:51.826803+0000","last_fullsized":"2023-10-06T02:20:51.826803+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:59.586917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831337+0000","last_change":"2023-10-06T02:20:51.828901+0000","last_active":"2023-10-06T02:20:51.831337+0000","last_peered":"2023-10-06T02:20:51.831337+0000","last_clean":"2023-10-06T02:20:51.831337+0000","last_became_active":"2023-10-06T02:20:51.828658+0000","last_became_peered":"2023-10-06T02:20:51.828658+0000","last_unstale":"2023-10-06T02:20:51.831337+0000","last_undegraded":"2023-10-06T02:20:51.831337+0000","last_fullsized":"2023-10-06T02:20:51.831337+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:34.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.822829+0000","last_change":"2023-10-06T02:20:50.819353+0000","last_active":"2023-10-06T02:20:51.822829+0000","last_peered":"2023-10-06T02:20:51.822829+0000","last_clean":"2023-10-06T02:20:51.822829+0000","last_became_active":"2023-10-06T02:20:50.819040+0000","last_became_peered":"2023-10-06T02:20:50.819040+0000","last_unstale":"2023-10-06T02:20:51.822829+0000","last_undegraded":"2023-10-06T02:20:51.822829+0000","last_fullsized":"2023-10-06T02:20:51.822829+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:15.069472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.826717+0000","last_change":"2023-10-06T02:20:51.823050+0000","last_active":"2023-10-06T02:20:51.826717+0000","last_peered":"2023-10-06T02:20:51.826717+0000","last_clean":"2023-10-06T02:20:51.826717+0000","last_became_active":"2023-10-06T02:20:51.822791+0000","last_became_peered":"2023-10-06T02:20:51.822791+0000","last_unstale":"2023-10-06T02:20:51.826717+0000","last_undegraded":"2023-10-06T02:20:51.826717+0000","last_fullsized":"2023-10-06T02:20:51.826717+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:40.217512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830417+0000","last_change":"2023-10-06T02:20:50.818515+0000","last_active":"2023-10-06T02:20:51.830417+0000","last_peered":"2023-10-06T02:20:51.830417+0000","last_clean":"2023-10-06T02:20:51.830417+0000","last_became_active":"2023-10-06T02:20:50.818264+0000","last_became_peered":"2023-10-06T02:20:50.818264+0000","last_unstale":"2023-10-06T02:20:51.830417+0000","last_undegraded":"2023-10-06T02:20:51.830417+0000","last_fullsized":"2023-10-06T02:20:51.830417+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:01.744172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.825520+0000","last_change":"2023-10-06T02:20:51.818483+0000","last_active":"2023-10-06T02:20:51.825520+0000","last_peered":"2023-10-06T02:20:51.825520+0000","last_clean":"2023-10-06T02:20:51.825520+0000","last_became_active":"2023-10-06T02:20:51.818229+0000","last_became_peered":"2023-10-06T02:20:51.818229+0000","last_unstale":"2023-10-06T02:20:51.825520+0000","last_undegraded":"2023-10-06T02:20:51.825520+0000","last_fullsized":"2023-10-06T02:20:51.825520+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:34.544171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.816622+0000","last_change":"2023-10-06T02:20:50.808802+0000","last_active":"2023-10-06T02:20:51.816622+0000","last_peered":"2023-10-06T02:20:51.816622+0000","last_clean":"2023-10-06T02:20:51.816622+0000","last_became_active":"2023-10-06T02:20:50.808512+0000","last_became_peered":"2023-10-06T02:20:50.808512+0000","last_unstale":"2023-10-06T02:20:51.816622+0000","last_undegraded":"2023-10-06T02:20:51.816622+0000","last_fullsized":"2023-10-06T02:20:51.816622+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.330076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.816247+0000","last_change":"2023-10-06T02:20:51.809429+0000","last_active":"2023-10-06T02:20:51.816247+0000","last_peered":"2023-10-06T02:20:51.816247+0000","last_clean":"2023-10-06T02:20:51.816247+0000","last_became_active":"2023-10-06T02:20:51.809123+0000","last_became_peered":"2023-10-06T02:20:51.809123+0000","last_unstale":"2023-10-06T02:20:51.816247+0000","last_undegraded":"2023-10-06T02:20:51.816247+0000","last_fullsized":"2023-10-06T02:20:51.816247+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:24.338553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.828508+0000","last_change":"2023-10-06T02:20:50.823496+0000","last_active":"2023-10-06T02:20:51.828508+0000","last_peered":"2023-10-06T02:20:51.828508+0000","last_clean":"2023-10-06T02:20:51.828508+0000","last_became_active":"2023-10-06T02:20:50.823162+0000","last_became_peered":"2023-10-06T02:20:50.823162+0000","last_unstale":"2023-10-06T02:20:51.828508+0000","last_undegraded":"2023-10-06T02:20:51.828508+0000","last_fullsized":"2023-10-06T02:20:51.828508+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:30:28.469240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830809+0000","last_change":"2023-10-06T02:20:51.830099+0000","last_active":"2023-10-06T02:20:51.830809+0000","last_peered":"2023-10-06T02:20:51.830809+0000","last_clean":"2023-10-06T02:20:51.830809+0000","last_became_active":"2023-10-06T02:20:51.829808+0000","last_became_peered":"2023-10-06T02:20:51.829808+0000","last_unstale":"2023-10-06T02:20:51.830809+0000","last_undegraded":"2023-10-06T02:20:51.830809+0000","last_fullsized":"2023-10-06T02:20:51.830809+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:15.317541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.800486+0000","last_change":"2023-10-06T02:20:50.820965+0000","last_active":"2023-10-06T02:20:51.800486+0000","last_peered":"2023-10-06T02:20:51.800486+0000","last_clean":"2023-10-06T02:20:51.800486+0000","last_became_active":"2023-10-06T02:20:50.820752+0000","last_became_peered":"2023-10-06T02:20:50.820752+0000","last_unstale":"2023-10-06T02:20:51.800486+0000","last_undegraded":"2023-10-06T02:20:51.800486+0000","last_fullsized":"2023-10-06T02:20:51.800486+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:31.366294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.810104+0000","last_change":"2023-10-06T02:20:51.808589+0000","last_active":"2023-10-06T02:20:51.810104+0000","last_peered":"2023-10-06T02:20:51.810104+0000","last_clean":"2023-10-06T02:20:51.810104+0000","last_became_active":"2023-10-06T02:20:51.808235+0000","last_became_peered":"2023-10-06T02:20:51.808235+0000","last_unstale":"2023-10-06T02:20:51.810104+0000","last_undegraded":"2023-10-06T02:20:51.810104+0000","last_fullsized":"2023-10-06T02:20:51.810104+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:53.001974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.813219+0000","last_change":"2023-10-06T02:20:50.818453+0000","last_active":"2023-10-06T02:20:51.813219+0000","last_peered":"2023-10-06T02:20:51.813219+0000","last_clean":"2023-10-06T02:20:51.813219+0000","last_became_active":"2023-10-06T02:20:50.818167+0000","last_became_peered":"2023-10-06T02:20:50.818167+0000","last_unstale":"2023-10-06T02:20:51.813219+0000","last_undegraded":"2023-10-06T02:20:51.813219+0000","last_fullsized":"2023-10-06T02:20:51.813219+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:32.408249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829728+0000","last_change":"2023-10-06T02:20:51.825296+0000","last_active":"2023-10-06T02:20:51.829728+0000","last_peered":"2023-10-06T02:20:51.829728+0000","last_clean":"2023-10-06T02:20:51.829728+0000","last_became_active":"2023-10-06T02:20:51.825046+0000","last_became_peered":"2023-10-06T02:20:51.825046+0000","last_unstale":"2023-10-06T02:20:51.829728+0000","last_undegraded":"2023-10-06T02:20:51.829728+0000","last_fullsized":"2023-10-06T02:20:51.829728+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:25.128853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.803449+0000","last_change":"2023-10-06T02:20:50.816556+0000","last_active":"2023-10-06T02:20:51.803449+0000","last_peered":"2023-10-06T02:20:51.803449+0000","last_clean":"2023-10-06T02:20:51.803449+0000","last_became_active":"2023-10-06T02:20:50.816295+0000","last_became_peered":"2023-10-06T02:20:50.816295+0000","last_unstale":"2023-10-06T02:20:51.803449+0000","last_undegraded":"2023-10-06T02:20:51.803449+0000","last_fullsized":"2023-10-06T02:20:51.803449+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.005754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.835416+0000","last_change":"2023-10-06T02:20:51.831925+0000","last_active":"2023-10-06T02:20:51.835416+0000","last_peered":"2023-10-06T02:20:51.835416+0000","last_clean":"2023-10-06T02:20:51.835416+0000","last_became_active":"2023-10-06T02:20:51.831642+0000","last_became_peered":"2023-10-06T02:20:51.831642+0000","last_unstale":"2023-10-06T02:20:51.835416+0000","last_undegraded":"2023-10-06T02:20:51.835416+0000","last_fullsized":"2023-10-06T02:20:51.835416+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:27.385871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.817954+0000","last_change":"2023-10-06T02:20:50.817299+0000","last_active":"2023-10-06T02:20:51.817954+0000","last_peered":"2023-10-06T02:20:51.817954+0000","last_clean":"2023-10-06T02:20:51.817954+0000","last_became_active":"2023-10-06T02:20:50.816988+0000","last_became_peered":"2023-10-06T02:20:50.816988+0000","last_unstale":"2023-10-06T02:20:51.817954+0000","last_undegraded":"2023-10-06T02:20:51.817954+0000","last_fullsized":"2023-10-06T02:20:51.817954+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:05.025893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838003+0000","last_change":"2023-10-06T02:20:51.830161+0000","last_active":"2023-10-06T02:20:51.838003+0000","last_peered":"2023-10-06T02:20:51.838003+0000","last_clean":"2023-10-06T02:20:51.838003+0000","last_became_active":"2023-10-06T02:20:51.829914+0000","last_became_peered":"2023-10-06T02:20:51.829914+0000","last_unstale":"2023-10-06T02:20:51.838003+0000","last_undegraded":"2023-10-06T02:20:51.838003+0000","last_fullsized":"2023-10-06T02:20:51.838003+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:36.124998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"65'3","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.818102+0000","last_change":"2023-10-06T02:20:50.810864+0000","last_active":"2023-10-06T02:20:51.818102+0000","last_peered":"2023-10-06T02:20:51.818102+0000","last_clean":"2023-10-06T02:20:51.818102+0000","last_became_active":"2023-10-06T02:20:50.810578+0000","last_became_peered":"2023-10-06T02:20:50.810578+0000","last_unstale":"2023-10-06T02:20:51.818102+0000","last_undegraded":"2023-10-06T02:20:51.818102+0000","last_fullsized":"2023-10-06T02:20:51.818102+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:22.865369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829629+0000","last_change":"2023-10-06T02:20:51.826105+0000","last_active":"2023-10-06T02:20:51.829629+0000","last_peered":"2023-10-06T02:20:51.829629+0000","last_clean":"2023-10-06T02:20:51.829629+0000","last_became_active":"2023-10-06T02:20:51.825480+0000","last_became_peered":"2023-10-06T02:20:51.825480+0000","last_unstale":"2023-10-06T02:20:51.829629+0000","last_undegraded":"2023-10-06T02:20:51.829629+0000","last_fullsized":"2023-10-06T02:20:51.829629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:06.030819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"65'6","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.833376+0000","last_change":"2023-10-06T02:20:50.818481+0000","last_active":"2023-10-06T02:20:51.833376+0000","last_peered":"2023-10-06T02:20:51.833376+0000","last_clean":"2023-10-06T02:20:51.833376+0000","last_became_active":"2023-10-06T02:20:50.818177+0000","last_became_peered":"2023-10-06T02:20:50.818177+0000","last_unstale":"2023-10-06T02:20:51.833376+0000","last_undegraded":"2023-10-06T02:20:51.833376+0000","last_fullsized":"2023-10-06T02:20:51.833376+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:23.603882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.827327+0000","last_change":"2023-10-06T02:20:51.825095+0000","last_active":"2023-10-06T02:20:51.827327+0000","last_peered":"2023-10-06T02:20:51.827327+0000","last_clean":"2023-10-06T02:20:51.827327+0000","last_became_active":"2023-10-06T02:20:51.824795+0000","last_became_peered":"2023-10-06T02:20:51.824795+0000","last_unstale":"2023-10-06T02:20:51.827327+0000","last_undegraded":"2023-10-06T02:20:51.827327+0000","last_fullsized":"2023-10-06T02:20:51.827327+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:59.948754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.824845+0000","last_change":"2023-10-06T02:20:50.820106+0000","last_active":"2023-10-06T02:20:51.824845+0000","last_peered":"2023-10-06T02:20:51.824845+0000","last_clean":"2023-10-06T02:20:51.824845+0000","last_became_active":"2023-10-06T02:20:50.819489+0000","last_became_peered":"2023-10-06T02:20:50.819489+0000","last_unstale":"2023-10-06T02:20:51.824845+0000","last_undegraded":"2023-10-06T02:20:51.824845+0000","last_fullsized":"2023-10-06T02:20:51.824845+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:44.274895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.824489+0000","last_change":"2023-10-06T02:20:51.818073+0000","last_active":"2023-10-06T02:20:51.824489+0000","last_peered":"2023-10-06T02:20:51.824489+0000","last_clean":"2023-10-06T02:20:51.824489+0000","last_became_active":"2023-10-06T02:20:51.817742+0000","last_became_peered":"2023-10-06T02:20:51.817742+0000","last_unstale":"2023-10-06T02:20:51.824489+0000","last_undegraded":"2023-10-06T02:20:51.824489+0000","last_fullsized":"2023-10-06T02:20:51.824489+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:59.299607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.817349+0000","last_change":"2023-10-06T02:20:50.818283+0000","last_active":"2023-10-06T02:20:51.817349+0000","last_peered":"2023-10-06T02:20:51.817349+0000","last_clean":"2023-10-06T02:20:51.817349+0000","last_became_active":"2023-10-06T02:20:50.817899+0000","last_became_peered":"2023-10-06T02:20:50.817899+0000","last_unstale":"2023-10-06T02:20:51.817349+0000","last_undegraded":"2023-10-06T02:20:51.817349+0000","last_fullsized":"2023-10-06T02:20:51.817349+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:26.911597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.824337+0000","last_change":"2023-10-06T02:20:51.822915+0000","last_active":"2023-10-06T02:20:51.824337+0000","last_peered":"2023-10-06T02:20:51.824337+0000","last_clean":"2023-10-06T02:20:51.824337+0000","last_became_active":"2023-10-06T02:20:51.822627+0000","last_became_peered":"2023-10-06T02:20:51.822627+0000","last_unstale":"2023-10-06T02:20:51.824337+0000","last_undegraded":"2023-10-06T02:20:51.824337+0000","last_fullsized":"2023-10-06T02:20:51.824337+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:26.021599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.807534+0000","last_change":"2023-10-06T02:20:50.812022+0000","last_active":"2023-10-06T02:20:51.807534+0000","last_peered":"2023-10-06T02:20:51.807534+0000","last_clean":"2023-10-06T02:20:51.807534+0000","last_became_active":"2023-10-06T02:20:50.811750+0000","last_became_peered":"2023-10-06T02:20:50.811750+0000","last_unstale":"2023-10-06T02:20:51.807534+0000","last_undegraded":"2023-10-06T02:20:51.807534+0000","last_fullsized":"2023-10-06T02:20:51.807534+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:35.120072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829962+0000","last_change":"2023-10-06T02:20:51.827416+0000","last_active":"2023-10-06T02:20:51.829962+0000","last_peered":"2023-10-06T02:20:51.829962+0000","last_clean":"2023-10-06T02:20:51.829962+0000","last_became_active":"2023-10-06T02:20:51.827125+0000","last_became_peered":"2023-10-06T02:20:51.827125+0000","last_unstale":"2023-10-06T02:20:51.829962+0000","last_undegraded":"2023-10-06T02:20:51.829962+0000","last_fullsized":"2023-10-06T02:20:51.829962+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:45.279821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"65'8","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.826758+0000","last_change":"2023-10-06T02:20:50.817524+0000","last_active":"2023-10-06T02:20:51.826758+0000","last_peered":"2023-10-06T02:20:51.826758+0000","last_clean":"2023-10-06T02:20:51.826758+0000","last_became_active":"2023-10-06T02:20:50.817267+0000","last_became_peered":"2023-10-06T02:20:50.817267+0000","last_unstale":"2023-10-06T02:20:51.826758+0000","last_undegraded":"2023-10-06T02:20:51.826758+0000","last_fullsized":"2023-10-06T02:20:51.826758+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:26.380945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.821408+0000","last_change":"2023-10-06T02:20:51.818539+0000","last_active":"2023-10-06T02:20:51.821408+0000","last_peered":"2023-10-06T02:20:51.821408+0000","last_clean":"2023-10-06T02:20:51.821408+0000","last_became_active":"2023-10-06T02:20:51.817767+0000","last_became_peered":"2023-10-06T02:20:51.817767+0000","last_unstale":"2023-10-06T02:20:51.821408+0000","last_undegraded":"2023-10-06T02:20:51.821408+0000","last_fullsized":"2023-10-06T02:20:51.821408+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:40.662240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.832278+0000","last_change":"2023-10-06T02:20:50.816771+0000","last_active":"2023-10-06T02:20:51.832278+0000","last_peered":"2023-10-06T02:20:51.832278+0000","last_clean":"2023-10-06T02:20:51.832278+0000","last_became_active":"2023-10-06T02:20:50.816456+0000","last_became_peered":"2023-10-06T02:20:50.816456+0000","last_unstale":"2023-10-06T02:20:51.832278+0000","last_undegraded":"2023-10-06T02:20:51.832278+0000","last_fullsized":"2023-10-06T02:20:51.832278+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:31.366294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.824392+0000","last_change":"2023-10-06T02:20:51.817536+0000","last_active":"2023-10-06T02:20:51.824392+0000","last_peered":"2023-10-06T02:20:51.824392+0000","last_clean":"2023-10-06T02:20:51.824392+0000","last_became_active":"2023-10-06T02:20:51.817253+0000","last_became_peered":"2023-10-06T02:20:51.817253+0000","last_unstale":"2023-10-06T02:20:51.824392+0000","last_undegraded":"2023-10-06T02:20:51.824392+0000","last_fullsized":"2023-10-06T02:20:51.824392+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:44.060757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.808802+0000","last_change":"2023-10-06T02:20:50.815180+0000","last_active":"2023-10-06T02:20:51.808802+0000","last_peered":"2023-10-06T02:20:51.808802+0000","last_clean":"2023-10-06T02:20:51.808802+0000","last_became_active":"2023-10-06T02:20:50.814883+0000","last_became_peered":"2023-10-06T02:20:50.814883+0000","last_unstale":"2023-10-06T02:20:51.808802+0000","last_undegraded":"2023-10-06T02:20:51.808802+0000","last_fullsized":"2023-10-06T02:20:51.808802+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:51.759990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831337+0000","last_change":"2023-10-06T02:20:51.825845+0000","last_active":"2023-10-06T02:20:51.831337+0000","last_peered":"2023-10-06T02:20:51.831337+0000","last_clean":"2023-10-06T02:20:51.831337+0000","last_became_active":"2023-10-06T02:20:51.825570+0000","last_became_peered":"2023-10-06T02:20:51.825570+0000","last_unstale":"2023-10-06T02:20:51.831337+0000","last_undegraded":"2023-10-06T02:20:51.831337+0000","last_fullsized":"2023-10-06T02:20:51.831337+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:40.535060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.816858+0000","last_change":"2023-10-06T02:20:50.823586+0000","last_active":"2023-10-06T02:20:51.816858+0000","last_peered":"2023-10-06T02:20:51.816858+0000","last_clean":"2023-10-06T02:20:51.816858+0000","last_became_active":"2023-10-06T02:20:50.823256+0000","last_became_peered":"2023-10-06T02:20:50.823256+0000","last_unstale":"2023-10-06T02:20:51.816858+0000","last_undegraded":"2023-10-06T02:20:51.816858+0000","last_fullsized":"2023-10-06T02:20:51.816858+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:54.267291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831482+0000","last_change":"2023-10-06T02:20:51.826844+0000","last_active":"2023-10-06T02:20:51.831482+0000","last_peered":"2023-10-06T02:20:51.831482+0000","last_clean":"2023-10-06T02:20:51.831482+0000","last_became_active":"2023-10-06T02:20:51.826542+0000","last_became_peered":"2023-10-06T02:20:51.826542+0000","last_unstale":"2023-10-06T02:20:51.831482+0000","last_undegraded":"2023-10-06T02:20:51.831482+0000","last_fullsized":"2023-10-06T02:20:51.831482+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:11:34.615395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.802137+0000","last_change":"2023-10-06T02:20:50.813573+0000","last_active":"2023-10-06T02:20:51.802137+0000","last_peered":"2023-10-06T02:20:51.802137+0000","last_clean":"2023-10-06T02:20:51.802137+0000","last_became_active":"2023-10-06T02:20:50.813255+0000","last_became_peered":"2023-10-06T02:20:50.813255+0000","last_unstale":"2023-10-06T02:20:51.802137+0000","last_undegraded":"2023-10-06T02:20:51.802137+0000","last_fullsized":"2023-10-06T02:20:51.802137+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:15.069472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829180+0000","last_change":"2023-10-06T02:20:51.824549+0000","last_active":"2023-10-06T02:20:51.829180+0000","last_peered":"2023-10-06T02:20:51.829180+0000","last_clean":"2023-10-06T02:20:51.829180+0000","last_became_active":"2023-10-06T02:20:51.824271+0000","last_became_peered":"2023-10-06T02:20:51.824271+0000","last_unstale":"2023-10-06T02:20:51.829180+0000","last_undegraded":"2023-10-06T02:20:51.829180+0000","last_fullsized":"2023-10-06T02:20:51.829180+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:51.462534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.814860+0000","last_change":"2023-10-06T02:20:50.820302+0000","last_active":"2023-10-06T02:20:51.814860+0000","last_peered":"2023-10-06T02:20:51.814860+0000","last_clean":"2023-10-06T02:20:51.814860+0000","last_became_active":"2023-10-06T02:20:50.820059+0000","last_became_peered":"2023-10-06T02:20:50.820059+0000","last_unstale":"2023-10-06T02:20:51.814860+0000","last_undegraded":"2023-10-06T02:20:51.814860+0000","last_fullsized":"2023-10-06T02:20:51.814860+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:57.804494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838101+0000","last_change":"2023-10-06T02:20:51.830945+0000","last_active":"2023-10-06T02:20:51.838101+0000","last_peered":"2023-10-06T02:20:51.838101+0000","last_clean":"2023-10-06T02:20:51.838101+0000","last_became_active":"2023-10-06T02:20:51.829801+0000","last_became_peered":"2023-10-06T02:20:51.829801+0000","last_unstale":"2023-10-06T02:20:51.838101+0000","last_undegraded":"2023-10-06T02:20:51.838101+0000","last_fullsized":"2023-10-06T02:20:51.838101+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:46.192665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.800545+0000","last_change":"2023-10-06T02:20:50.820326+0000","last_active":"2023-10-06T02:20:51.800545+0000","last_peered":"2023-10-06T02:20:51.800545+0000","last_clean":"2023-10-06T02:20:51.800545+0000","last_became_active":"2023-10-06T02:20:50.820055+0000","last_became_peered":"2023-10-06T02:20:50.820055+0000","last_unstale":"2023-10-06T02:20:51.800545+0000","last_undegraded":"2023-10-06T02:20:51.800545+0000","last_fullsized":"2023-10-06T02:20:51.800545+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:31.728925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.823686+0000","last_change":"2023-10-06T02:20:51.816976+0000","last_active":"2023-10-06T02:20:51.823686+0000","last_peered":"2023-10-06T02:20:51.823686+0000","last_clean":"2023-10-06T02:20:51.823686+0000","last_became_active":"2023-10-06T02:20:51.816812+0000","last_became_peered":"2023-10-06T02:20:51.816812+0000","last_unstale":"2023-10-06T02:20:51.823686+0000","last_undegraded":"2023-10-06T02:20:51.823686+0000","last_fullsized":"2023-10-06T02:20:51.823686+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:07.545935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.802209+0000","last_change":"2023-10-06T02:20:50.819720+0000","last_active":"2023-10-06T02:20:51.802209+0000","last_peered":"2023-10-06T02:20:51.802209+0000","last_clean":"2023-10-06T02:20:51.802209+0000","last_became_active":"2023-10-06T02:20:50.819461+0000","last_became_peered":"2023-10-06T02:20:50.819461+0000","last_unstale":"2023-10-06T02:20:51.802209+0000","last_undegraded":"2023-10-06T02:20:51.802209+0000","last_fullsized":"2023-10-06T02:20:51.802209+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:58.943828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829316+0000","last_change":"2023-10-06T02:20:51.828069+0000","last_active":"2023-10-06T02:20:51.829316+0000","last_peered":"2023-10-06T02:20:51.829316+0000","last_clean":"2023-10-06T02:20:51.829316+0000","last_became_active":"2023-10-06T02:20:51.827793+0000","last_became_peered":"2023-10-06T02:20:51.827793+0000","last_unstale":"2023-10-06T02:20:51.829316+0000","last_undegraded":"2023-10-06T02:20:51.829316+0000","last_fullsized":"2023-10-06T02:20:51.829316+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:26.442837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.815750+0000","last_change":"2023-10-06T02:20:50.817824+0000","last_active":"2023-10-06T02:20:51.815750+0000","last_peered":"2023-10-06T02:20:51.815750+0000","last_clean":"2023-10-06T02:20:51.815750+0000","last_became_active":"2023-10-06T02:20:50.817563+0000","last_became_peered":"2023-10-06T02:20:50.817563+0000","last_unstale":"2023-10-06T02:20:51.815750+0000","last_undegraded":"2023-10-06T02:20:51.815750+0000","last_fullsized":"2023-10-06T02:20:51.815750+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:31.728925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.832986+0000","last_change":"2023-10-06T02:20:51.826479+0000","last_active":"2023-10-06T02:20:51.832986+0000","last_peered":"2023-10-06T02:20:51.832986+0000","last_clean":"2023-10-06T02:20:51.832986+0000","last_became_active":"2023-10-06T02:20:51.826238+0000","last_became_peered":"2023-10-06T02:20:51.826238+0000","last_unstale":"2023-10-06T02:20:51.832986+0000","last_undegraded":"2023-10-06T02:20:51.832986+0000","last_fullsized":"2023-10-06T02:20:51.832986+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:11.256735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.826818+0000","last_change":"2023-10-06T02:20:50.815734+0000","last_active":"2023-10-06T02:20:51.826818+0000","last_peered":"2023-10-06T02:20:51.826818+0000","last_clean":"2023-10-06T02:20:51.826818+0000","last_became_active":"2023-10-06T02:20:50.815483+0000","last_became_peered":"2023-10-06T02:20:50.815483+0000","last_unstale":"2023-10-06T02:20:51.826818+0000","last_undegraded":"2023-10-06T02:20:51.826818+0000","last_fullsized":"2023-10-06T02:20:51.826818+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:39.530134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":54,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.803148+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:20:51.803148+0000","last_peered":"2023-10-06T02:20:51.803148+0000","last_clean":"2023-10-06T02:20:51.803148+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:20:51.803148+0000","last_undegraded":"2023-10-06T02:20:51.803148+0000","last_fullsized":"2023-10-06T02:20:51.803148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830418+0000","last_change":"2023-10-06T02:20:51.816262+0000","last_active":"2023-10-06T02:20:51.830418+0000","last_peered":"2023-10-06T02:20:51.830418+0000","last_clean":"2023-10-06T02:20:51.830418+0000","last_became_active":"2023-10-06T02:20:51.815939+0000","last_became_peered":"2023-10-06T02:20:51.815939+0000","last_unstale":"2023-10-06T02:20:51.830418+0000","last_undegraded":"2023-10-06T02:20:51.830418+0000","last_fullsized":"2023-10-06T02:20:51.830418+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:21.905626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.832392+0000","last_change":"2023-10-06T02:20:50.821250+0000","last_active":"2023-10-06T02:20:51.832392+0000","last_peered":"2023-10-06T02:20:51.832392+0000","last_clean":"2023-10-06T02:20:51.832392+0000","last_became_active":"2023-10-06T02:20:50.821031+0000","last_became_peered":"2023-10-06T02:20:50.821031+0000","last_unstale":"2023-10-06T02:20:51.832392+0000","last_undegraded":"2023-10-06T02:20:51.832392+0000","last_fullsized":"2023-10-06T02:20:51.832392+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:44.274895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":54,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.805834+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:20:51.805834+0000","last_peered":"2023-10-06T02:20:51.805834+0000","last_clean":"2023-10-06T02:20:51.805834+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:20:51.805834+0000","last_undegraded":"2023-10-06T02:20:51.805834+0000","last_fullsized":"2023-10-06T02:20:51.805834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.828868+0000","last_change":"2023-10-06T02:20:51.824180+0000","last_active":"2023-10-06T02:20:51.828868+0000","last_peered":"2023-10-06T02:20:51.828868+0000","last_clean":"2023-10-06T02:20:51.828868+0000","last_became_active":"2023-10-06T02:20:51.823933+0000","last_became_peered":"2023-10-06T02:20:51.823933+0000","last_unstale":"2023-10-06T02:20:51.828868+0000","last_undegraded":"2023-10-06T02:20:51.828868+0000","last_fullsized":"2023-10-06T02:20:51.828868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:54.434676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.801803+0000","last_change":"2023-10-06T02:20:50.816680+0000","last_active":"2023-10-06T02:20:51.801803+0000","last_peered":"2023-10-06T02:20:51.801803+0000","last_clean":"2023-10-06T02:20:51.801803+0000","last_became_active":"2023-10-06T02:20:50.816160+0000","last_became_peered":"2023-10-06T02:20:50.816160+0000","last_unstale":"2023-10-06T02:20:51.801803+0000","last_undegraded":"2023-10-06T02:20:51.801803+0000","last_fullsized":"2023-10-06T02:20:51.801803+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.005754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":54,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.800765+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:20:51.800765+0000","last_peered":"2023-10-06T02:20:51.800765+0000","last_clean":"2023-10-06T02:20:51.800765+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:20:51.800765+0000","last_undegraded":"2023-10-06T02:20:51.800765+0000","last_fullsized":"2023-10-06T02:20:51.800765+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":203,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.810740+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:20:51.810740+0000","last_peered":"2023-10-06T02:20:51.810740+0000","last_clean":"2023-10-06T02:20:51.810740+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:20:51.810740+0000","last_undegraded":"2023-10-06T02:20:51.810740+0000","last_fullsized":"2023-10-06T02:20:51.810740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.828752+0000","last_change":"2023-10-06T02:20:51.823933+0000","last_active":"2023-10-06T02:20:51.828752+0000","last_peered":"2023-10-06T02:20:51.828752+0000","last_clean":"2023-10-06T02:20:51.828752+0000","last_became_active":"2023-10-06T02:20:51.823658+0000","last_became_peered":"2023-10-06T02:20:51.823658+0000","last_unstale":"2023-10-06T02:20:51.828752+0000","last_undegraded":"2023-10-06T02:20:51.828752+0000","last_fullsized":"2023-10-06T02:20:51.828752+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:36.288865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.807631+0000","last_change":"2023-10-06T02:20:50.818342+0000","last_active":"2023-10-06T02:20:51.807631+0000","last_peered":"2023-10-06T02:20:51.807631+0000","last_clean":"2023-10-06T02:20:51.807631+0000","last_became_active":"2023-10-06T02:20:50.818161+0000","last_became_peered":"2023-10-06T02:20:50.818161+0000","last_unstale":"2023-10-06T02:20:51.807631+0000","last_undegraded":"2023-10-06T02:20:51.807631+0000","last_fullsized":"2023-10-06T02:20:51.807631+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:45.187739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.810014+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:20:51.810014+0000","last_peered":"2023-10-06T02:20:51.810014+0000","last_clean":"2023-10-06T02:20:51.810014+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:20:51.810014+0000","last_undegraded":"2023-10-06T02:20:51.810014+0000","last_fullsized":"2023-10-06T02:20:51.810014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831822+0000","last_change":"2023-10-06T02:20:51.827047+0000","last_active":"2023-10-06T02:20:51.831822+0000","last_peered":"2023-10-06T02:20:51.831822+0000","last_clean":"2023-10-06T02:20:51.831822+0000","last_became_active":"2023-10-06T02:20:51.826783+0000","last_became_peered":"2023-10-06T02:20:51.826783+0000","last_unstale":"2023-10-06T02:20:51.831822+0000","last_undegraded":"2023-10-06T02:20:51.831822+0000","last_fullsized":"2023-10-06T02:20:51.831822+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:28.423769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.833154+0000","last_change":"2023-10-06T02:20:50.817443+0000","last_active":"2023-10-06T02:20:51.833154+0000","last_peered":"2023-10-06T02:20:51.833154+0000","last_clean":"2023-10-06T02:20:51.833154+0000","last_became_active":"2023-10-06T02:20:50.817182+0000","last_became_peered":"2023-10-06T02:20:50.817182+0000","last_unstale":"2023-10-06T02:20:51.833154+0000","last_undegraded":"2023-10-06T02:20:51.833154+0000","last_fullsized":"2023-10-06T02:20:51.833154+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:57.783928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.810629+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:20:51.810629+0000","last_peered":"2023-10-06T02:20:51.810629+0000","last_clean":"2023-10-06T02:20:51.810629+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:20:51.810629+0000","last_undegraded":"2023-10-06T02:20:51.810629+0000","last_fullsized":"2023-10-06T02:20:51.810629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.822290+0000","last_change":"2023-10-06T02:20:51.817247+0000","last_active":"2023-10-06T02:20:51.822290+0000","last_peered":"2023-10-06T02:20:51.822290+0000","last_clean":"2023-10-06T02:20:51.822290+0000","last_became_active":"2023-10-06T02:20:51.816810+0000","last_became_peered":"2023-10-06T02:20:51.816810+0000","last_unstale":"2023-10-06T02:20:51.822290+0000","last_undegraded":"2023-10-06T02:20:51.822290+0000","last_fullsized":"2023-10-06T02:20:51.822290+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:04.234529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.817437+0000","last_change":"2023-10-06T02:20:50.814717+0000","last_active":"2023-10-06T02:20:51.817437+0000","last_peered":"2023-10-06T02:20:51.817437+0000","last_clean":"2023-10-06T02:20:51.817437+0000","last_became_active":"2023-10-06T02:20:50.814458+0000","last_became_peered":"2023-10-06T02:20:50.814458+0000","last_unstale":"2023-10-06T02:20:51.817437+0000","last_undegraded":"2023-10-06T02:20:51.817437+0000","last_fullsized":"2023-10-06T02:20:51.817437+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:34.978104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":52,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.807704+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:20:51.807704+0000","last_peered":"2023-10-06T02:20:51.807704+0000","last_clean":"2023-10-06T02:20:51.807704+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:20:51.807704+0000","last_undegraded":"2023-10-06T02:20:51.807704+0000","last_fullsized":"2023-10-06T02:20:51.807704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.828318+0000","last_change":"2023-10-06T02:20:51.823101+0000","last_active":"2023-10-06T02:20:51.828318+0000","last_peered":"2023-10-06T02:20:51.828318+0000","last_clean":"2023-10-06T02:20:51.828318+0000","last_became_active":"2023-10-06T02:20:51.822490+0000","last_became_peered":"2023-10-06T02:20:51.822490+0000","last_unstale":"2023-10-06T02:20:51.828318+0000","last_undegraded":"2023-10-06T02:20:51.828318+0000","last_fullsized":"2023-10-06T02:20:51.828318+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:50.167140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.832501+0000","last_change":"2023-10-06T02:20:50.816477+0000","last_active":"2023-10-06T02:20:51.832501+0000","last_peered":"2023-10-06T02:20:51.832501+0000","last_clean":"2023-10-06T02:20:51.832501+0000","last_became_active":"2023-10-06T02:20:50.813835+0000","last_became_peered":"2023-10-06T02:20:50.813835+0000","last_unstale":"2023-10-06T02:20:51.832501+0000","last_undegraded":"2023-10-06T02:20:51.832501+0000","last_fullsized":"2023-10-06T02:20:51.832501+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:23.603882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.817728+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:20:51.817728+0000","last_peered":"2023-10-06T02:20:51.817728+0000","last_clean":"2023-10-06T02:20:51.817728+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:20:51.817728+0000","last_undegraded":"2023-10-06T02:20:51.817728+0000","last_fullsized":"2023-10-06T02:20:51.817728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.834420+0000","last_change":"2023-10-06T02:20:51.832929+0000","last_active":"2023-10-06T02:20:51.834420+0000","last_peered":"2023-10-06T02:20:51.834420+0000","last_clean":"2023-10-06T02:20:51.834420+0000","last_became_active":"2023-10-06T02:20:51.832707+0000","last_became_peered":"2023-10-06T02:20:51.832707+0000","last_unstale":"2023-10-06T02:20:51.834420+0000","last_undegraded":"2023-10-06T02:20:51.834420+0000","last_fullsized":"2023-10-06T02:20:51.834420+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:32.733850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.810242+0000","last_change":"2023-10-06T02:20:50.819383+0000","last_active":"2023-10-06T02:20:51.810242+0000","last_peered":"2023-10-06T02:20:51.810242+0000","last_clean":"2023-10-06T02:20:51.810242+0000","last_became_active":"2023-10-06T02:20:50.819113+0000","last_became_peered":"2023-10-06T02:20:50.819113+0000","last_unstale":"2023-10-06T02:20:51.810242+0000","last_undegraded":"2023-10-06T02:20:51.810242+0000","last_fullsized":"2023-10-06T02:20:51.810242+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:35.120072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.817115+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:20:51.817115+0000","last_peered":"2023-10-06T02:20:51.817115+0000","last_clean":"2023-10-06T02:20:51.817115+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:20:51.817115+0000","last_undegraded":"2023-10-06T02:20:51.817115+0000","last_fullsized":"2023-10-06T02:20:51.817115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298656,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073184,"statfs":{"total":96636764160,"available":96330940416,"internally_reserved":0,"allocated":1400832,"data_stored":968066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.377,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":1.111,"15min":1.111},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.47999999999999998},"min":{"1min":0.30499999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80600000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.438}]},{"osd":1,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.35899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86299999999999999,"5min":1.008,"15min":1.008},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.505},"min":{"1min":0.36699999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70499999999999996,"5min":1.075,"15min":1.075},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82199999999999995,"5min":1.149,"15min":1.149},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.56699999999999995},"min":{"1min":0.49199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77400000000000002,"5min":1.048,"15min":1.048},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45900000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79200000000000004,"5min":1.175,"15min":1.175},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.56299999999999994},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83799999999999997,"5min":1.03,"15min":1.03},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.41599999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75800000000000001,"5min":0.873,"15min":0.873},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80300000000000005,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.39500000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.71199999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.502},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84799999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78600000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":376249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.76300000000000001,"15min":0.84699999999999998},"min":{"1min":0.44800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82399999999999995,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.76600000000000001,"15min":0.85899999999999999},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82799999999999996,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":0.74099999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.433,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.88800000000000001,"15min":1.04},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77700000000000002,"5min":8.8659999999999997,"15min":8.8659999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.35599999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.98499999999999999,"15min":1.157},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86799999999999999,"5min":10.659000000000001,"15min":10.659000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.36899999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70099999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54200000000000004,"15min":0.55300000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.70799999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.41299999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72199999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.754,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.38100000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.64200000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298664,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073176,"statfs":{"total":96636764160,"available":96330932224,"internally_reserved":0,"allocated":1409024,"data_stored":968649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.34300000000000003},"min":{"1min":0.23499999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.28100000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53100000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.34000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.32600000000000001,"15min":0.317},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.499,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.379,"15min":0.375},"min":{"1min":0.28999999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51900000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.32400000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.38300000000000001,"15min":0.37},"min":{"1min":0.312,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54500000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.38700000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.41599999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.68500000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.435},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.81499999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75800000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.73899999999999999,"5min":0.87,"15min":0.87},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83899999999999997,"5min":0.879,"15min":0.879},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79700000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":377110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.316,"15min":0.29999999999999999},"min":{"1min":0.246,"5min":0.216,"15min":0.216},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.34999999999999998,"15min":0.33400000000000002},"min":{"1min":0.27600000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.48799999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.42199999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.376,"15min":0.36299999999999999},"min":{"1min":0.28100000000000003,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.377},{"interface":"front","average":{"1min":0.376,"5min":0.33600000000000002,"15min":0.32200000000000001},"min":{"1min":0.25700000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.34799999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.377},"min":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.51600000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.41199999999999998,"15min":0.40300000000000002},"min":{"1min":0.27300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.498}]},{"osd":4,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":1.369,"15min":1.369},"last":0.629},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83799999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54600000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.42099999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77800000000000002,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79600000000000004,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61499999999999999,"15min":0.59299999999999997},"min":{"1min":0.495,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.96699999999999997,"15min":1.115},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79400000000000004,"5min":11.138,"15min":11.138},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84499999999999997,"5min":1.429,"15min":1.429},"last":0.76200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298076,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073764,"statfs":{"total":96636764160,"available":96331534336,"internally_reserved":0,"allocated":806912,"data_stored":377693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.23999999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.42799999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.254},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.376,"15min":0.36699999999999999},"min":{"1min":0.27800000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.46100000000000002,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.39700000000000002,"15min":0.377},"min":{"1min":0.255,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.44400000000000001,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.41399999999999998,"15min":0.39200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.45600000000000002,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.33000000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.379,"15min":0.36699999999999999},"min":{"1min":0.27100000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.44700000000000001,"5min":1.423,"15min":1.423},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.498,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.56899999999999995},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84099999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.76900000000000002,"5min":1.304,"15min":1.304},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.76000000000000001,"5min":0.875,"15min":0.875},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77400000000000002,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.629,"15min":0.622},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82799999999999996,"5min":1.347,"15min":1.347},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77100000000000002,"5min":1.206,"15min":1.206},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.45800000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89500000000000002,"5min":1.385,"15min":1.385},"last":0.59499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298076,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073764,"statfs":{"total":96636764160,"available":96331534336,"internally_reserved":0,"allocated":806912,"data_stored":377222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.35699999999999998,"15min":0.36199999999999999},"min":{"1min":0.22700000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.44700000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.373},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.25700000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.53200000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.36399999999999999,"15min":0.36599999999999999},"min":{"1min":0.23799999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48999999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.311},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39900000000000002,"15min":0.39700000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58499999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.29499999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.318,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51400000000000001,"5min":0.624,"15min":0.624},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.29399999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96599999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.42399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89300000000000002,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92300000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.69299999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59099999999999997,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91100000000000003,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.628,"15min":0.63},"min":{"1min":0.443,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96399999999999997,"5min":1.391,"15min":1.391},"last":0.72299999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61199999999999999,"15min":0.59999999999999998},"min":{"1min":0.47299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.81899999999999995,"5min":0.874,"15min":0.874},"last":0.65500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":377180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.34300000000000003,"5min":0.217,"15min":0.217},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59099999999999997,"15min":0.57999999999999996},"min":{"1min":0.45700000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78600000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":1.028,"15min":1.238},"min":{"1min":0.39900000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74399999999999999,"5min":17.879999999999999,"15min":17.879999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":1.024,"15min":1.2230000000000001},"min":{"1min":0.45900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.74099999999999999,"5min":18.010999999999999,"15min":18.010999999999999},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.51700000000000002},"min":{"1min":0.436,"5min":0.309,"15min":0.309},"max":{"1min":0.72499999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72699999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.54100000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.53600000000000003},"min":{"1min":0.434,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66600000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.373,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80300000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.371,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.32700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50600000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.36799999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.77400000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.40799999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82099999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":377200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.318,"5min":0.307,"15min":0.307},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.312}]},{"osd":1,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.441},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.59399999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.38200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.48899999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51200000000000001,"15min":0.51800000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.61099999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.503,"15min":0.504},"min":{"1min":0.34300000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69999999999999996,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.40999999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.52200000000000002},"min":{"1min":0.36899999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71399999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73799999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71099999999999997,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:21:00.506 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:21:00.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.639+0000 7f81e55c9700 1 Processor -- start 2023-10-06T02:21:00.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.639+0000 7f81e55c9700 1 -- start start 2023-10-06T02:21:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.640+0000 7f81e55c9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81e01574a0 0x7f81e0157870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.640+0000 7f81e55c9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e00b1570 con 0x7f81e00c8600 2023-10-06T02:21:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.640+0000 7f81e55c9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e00c4c60 con 0x7f81e00c3470 2023-10-06T02:21:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.640+0000 7f81e55c9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e00b0f20 con 0x7f81e01574a0 2023-10-06T02:21:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.640+0000 7f81deffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81e01574a0 0x7f81e0157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.640+0000 7f81deffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81e01574a0 0x7f81e0157870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40876/0 (socket says 172.21.15.6:40876) 2023-10-06T02:21:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.640+0000 7f81de7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f81e00c8600 0x7f81e00c2d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43542/0 (socket says 172.21.15.6:43542) 2023-10-06T02:21:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.640+0000 7f81deffd700 1 -- 172.21.15.6:0/2328246192 learned_addr learned my addr 172.21.15.6:0/2328246192 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.641+0000 7f81deffd700 1 -- 172.21.15.6:0/2328246192 >> v1:172.21.15.175:6789/0 conn(0x7f81e00c3470 legacy=0x7f81e015b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:00.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.641+0000 7f81deffd700 1 -- 172.21.15.6:0/2328246192 >> v1:172.21.15.6:6789/0 conn(0x7f81e00c8600 legacy=0x7f81e00c2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:00.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.641+0000 7f81ddffb700 1 -- 172.21.15.6:0/2328246192 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260111316 0 0) 0x7f81e00b1570 con 0x7f81e00c8600 2023-10-06T02:21:00.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.641+0000 7f81deffd700 1 -- 172.21.15.6:0/2328246192 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e00b1200 con 0x7f81e01574a0 2023-10-06T02:21:00.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.641+0000 7f81deffd700 1 --2- 172.21.15.6:0/2328246192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e01574a0 0x7f81e0157870 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009990 tx=0x7f81d0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6593b88ff46b33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.641+0000 7f81ddffb700 1 -- 172.21.15.6:0/2328246192 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0005c10 con 0x7f81e01574a0 2023-10-06T02:21:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.641+0000 7f81ddffb700 1 -- 172.21.15.6:0/2328246192 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d0005d70 con 0x7f81e01574a0 2023-10-06T02:21:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.641+0000 7f81ddffb700 1 -- 172.21.15.6:0/2328246192 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d000b880 con 0x7f81e01574a0 2023-10-06T02:21:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.642+0000 7f81e55c9700 1 -- 172.21.15.6:0/2328246192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e01574a0 msgr2=0x7f81e0157870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:00.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.642+0000 7f81e55c9700 1 --2- 172.21.15.6:0/2328246192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e01574a0 0x7f81e0157870 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009990 tx=0x7f81d0009220 comp rx=0 tx=0).stop 2023-10-06T02:21:00.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.642+0000 7f81e55c9700 1 -- 172.21.15.6:0/2328246192 shutdown_connections 2023-10-06T02:21:00.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.642+0000 7f81e55c9700 1 --2- 172.21.15.6:0/2328246192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e01574a0 0x7f81e0157870 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:00.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.642+0000 7f81e55c9700 1 -- 172.21.15.6:0/2328246192 >> 172.21.15.6:0/2328246192 conn(0x7f81e0067ba0 msgr2=0x7f81e00cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:00.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.642+0000 7f81e55c9700 1 -- 172.21.15.6:0/2328246192 shutdown_connections 2023-10-06T02:21:00.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.642+0000 7f81e55c9700 1 -- 172.21.15.6:0/2328246192 wait complete. 2023-10-06T02:21:00.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.643+0000 7f81e55c9700 1 Processor -- start 2023-10-06T02:21:00.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.643+0000 7f81e55c9700 1 -- start start 2023-10-06T02:21:00.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81e55c9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81e00c3470 0x7f81e0069790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:00.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81e55c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e00c8600 0x7f81e014aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:00.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81e55c9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81e01574a0 0x7f81e009a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:00.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81e55c9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e015c110 con 0x7f81e00c8600 2023-10-06T02:21:00.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81e55c9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e0159b50 con 0x7f81e00c3470 2023-10-06T02:21:00.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81e55c9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e0159e30 con 0x7f81e01574a0 2023-10-06T02:21:00.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81de7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e00c8600 0x7f81e014aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:00.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81de7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e00c8600 0x7f81e014aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40886/0 (socket says 172.21.15.6:40886) 2023-10-06T02:21:00.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81de7fc700 1 -- 172.21.15.6:0/3744912237 learned_addr learned my addr 172.21.15.6:0/3744912237 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:00.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81deffd700 1 --2- 172.21.15.6:0/3744912237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81e00c3470 0x7f81e0069790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:00.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81de7fc700 1 -- 172.21.15.6:0/3744912237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81e01574a0 msgr2=0x7f81e009a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:00.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81df7fe700 1 --2- 172.21.15.6:0/3744912237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81e01574a0 0x7f81e009a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:00.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81de7fc700 1 --2- 172.21.15.6:0/3744912237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81e01574a0 0x7f81e009a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:00.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81de7fc700 1 -- 172.21.15.6:0/3744912237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81e00c3470 msgr2=0x7f81e0069790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:00.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81de7fc700 1 --2- 172.21.15.6:0/3744912237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81e00c3470 0x7f81e0069790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:00.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81de7fc700 1 -- 172.21.15.6:0/3744912237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d0009480 con 0x7f81e00c8600 2023-10-06T02:21:00.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81de7fc700 1 --2- 172.21.15.6:0/3744912237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e00c8600 0x7f81e014aaf0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f81c800c510 tx=0x7f81c800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:00.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81d6ffd700 1 -- 172.21.15.6:0/3744912237 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8005a70 con 0x7f81e00c8600 2023-10-06T02:21:00.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.644+0000 7f81d6ffd700 1 -- 172.21.15.6:0/3744912237 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c8005bf0 con 0x7f81e00c8600 2023-10-06T02:21:00.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.645+0000 7f81e55c9700 1 -- 172.21.15.6:0/3744912237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e015a110 con 0x7f81e00c8600 2023-10-06T02:21:00.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.645+0000 7f81d6ffd700 1 -- 172.21.15.6:0/3744912237 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80070d0 con 0x7f81e00c8600 2023-10-06T02:21:00.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.645+0000 7f81e55c9700 1 -- 172.21.15.6:0/3744912237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e0069cd0 con 0x7f81e00c8600 2023-10-06T02:21:00.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.645+0000 7f81e55c9700 1 -- 172.21.15.6:0/3744912237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e0064ee0 con 0x7f81e00c8600 2023-10-06T02:21:00.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.646+0000 7f81d6ffd700 1 -- 172.21.15.6:0/3744912237 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81c8007440 con 0x7f81e00c8600 2023-10-06T02:21:00.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.646+0000 7f81d6ffd700 1 --2- 172.21.15.6:0/3744912237 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81c0066f30 0x7f81c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:00.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.646+0000 7f81d6ffd700 1 -- 172.21.15.6:0/3744912237 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f81c8083d10 con 0x7f81e00c8600 2023-10-06T02:21:00.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.647+0000 7f81deffd700 1 --2- 172.21.15.6:0/3744912237 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81c0066f30 0x7f81c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:00.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.647+0000 7f81deffd700 1 --2- 172.21.15.6:0/3744912237 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81c0066f30 0x7f81c00693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f81d0007fd0 tx=0x7f81d0015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:00.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.651+0000 7f81d6ffd700 1 -- 172.21.15.6:0/3744912237 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81c8050ce0 con 0x7f81e00c8600 2023-10-06T02:21:00.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.840+0000 7f81e55c9700 1 -- 172.21.15.6:0/3744912237 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81e0159cc0 con 0x7f81c0066f30 2023-10-06T02:21:00.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.851+0000 7f81d6ffd700 1 -- 172.21.15.6:0/3744912237 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311590 (secure 0 0 0) 0x7f81e0159cc0 con 0x7f81c0066f30 2023-10-06T02:21:00.854 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:21:00.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.854+0000 7f81e55c9700 1 -- 172.21.15.6:0/3744912237 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81c0066f30 msgr2=0x7f81c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:00.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.854+0000 7f81e55c9700 1 --2- 172.21.15.6:0/3744912237 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81c0066f30 0x7f81c00693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f81d0007fd0 tx=0x7f81d0015000 comp rx=0 tx=0).stop 2023-10-06T02:21:00.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.854+0000 7f81e55c9700 1 -- 172.21.15.6:0/3744912237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e00c8600 msgr2=0x7f81e014aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:00.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.854+0000 7f81e55c9700 1 --2- 172.21.15.6:0/3744912237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e00c8600 0x7f81e014aaf0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f81c800c510 tx=0x7f81c800c8d0 comp rx=0 tx=0).stop 2023-10-06T02:21:00.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.854+0000 7f81e55c9700 1 -- 172.21.15.6:0/3744912237 shutdown_connections 2023-10-06T02:21:00.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.854+0000 7f81e55c9700 1 --2- 172.21.15.6:0/3744912237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81e01574a0 0x7f81e009a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:00.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.854+0000 7f81e55c9700 1 --2- 172.21.15.6:0/3744912237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81e00c3470 0x7f81e0069790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:00.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.854+0000 7f81e55c9700 1 --2- 172.21.15.6:0/3744912237 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81c0066f30 0x7f81c00693e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:00.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.854+0000 7f81e55c9700 1 --2- 172.21.15.6:0/3744912237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e00c8600 0x7f81e014aaf0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:00.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.854+0000 7f81e55c9700 1 -- 172.21.15.6:0/3744912237 >> 172.21.15.6:0/3744912237 conn(0x7f81e0067ba0 msgr2=0x7f81e0155850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:00.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.854+0000 7f81e55c9700 1 -- 172.21.15.6:0/3744912237 shutdown_connections 2023-10-06T02:21:00.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:00.854+0000 7f81e55c9700 1 -- 172.21.15.6:0/3744912237 wait complete. 2023-10-06T02:21:00.858 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:21:00.866 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2023-10-06T02:21:00.608529+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385756,"kb_used_data":7452,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588964,"statfs":{"total":773094113280,"available":770651099136,"internally_reserved":0,"allocated":7630848,"data_stored":4199369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.808988"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838094+0000","last_change":"2023-10-06T02:20:51.833161+0000","last_active":"2023-10-06T02:20:51.838094+0000","last_peered":"2023-10-06T02:20:51.838094+0000","last_clean":"2023-10-06T02:20:51.838094+0000","last_became_active":"2023-10-06T02:20:51.832806+0000","last_became_peered":"2023-10-06T02:20:51.832806+0000","last_unstale":"2023-10-06T02:20:51.838094+0000","last_undegraded":"2023-10-06T02:20:51.838094+0000","last_fullsized":"2023-10-06T02:20:51.838094+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:22.524253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838203+0000","last_change":"2023-10-06T02:20:51.832644+0000","last_active":"2023-10-06T02:20:51.838203+0000","last_peered":"2023-10-06T02:20:51.838203+0000","last_clean":"2023-10-06T02:20:51.838203+0000","last_became_active":"2023-10-06T02:20:51.832111+0000","last_became_peered":"2023-10-06T02:20:51.832111+0000","last_unstale":"2023-10-06T02:20:51.838203+0000","last_undegraded":"2023-10-06T02:20:51.838203+0000","last_fullsized":"2023-10-06T02:20:51.838203+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:17.290467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.823910+0000","last_change":"2023-10-06T02:20:51.818576+0000","last_active":"2023-10-06T02:20:51.823910+0000","last_peered":"2023-10-06T02:20:51.823910+0000","last_clean":"2023-10-06T02:20:51.823910+0000","last_became_active":"2023-10-06T02:20:51.818282+0000","last_became_peered":"2023-10-06T02:20:51.818282+0000","last_unstale":"2023-10-06T02:20:51.823910+0000","last_undegraded":"2023-10-06T02:20:51.823910+0000","last_fullsized":"2023-10-06T02:20:51.823910+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:07.959025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829576+0000","last_change":"2023-10-06T02:20:51.828039+0000","last_active":"2023-10-06T02:20:51.829576+0000","last_peered":"2023-10-06T02:20:51.829576+0000","last_clean":"2023-10-06T02:20:51.829576+0000","last_became_active":"2023-10-06T02:20:51.827793+0000","last_became_peered":"2023-10-06T02:20:51.827793+0000","last_unstale":"2023-10-06T02:20:51.829576+0000","last_undegraded":"2023-10-06T02:20:51.829576+0000","last_fullsized":"2023-10-06T02:20:51.829576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:26.648876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830905+0000","last_change":"2023-10-06T02:20:51.824928+0000","last_active":"2023-10-06T02:20:51.830905+0000","last_peered":"2023-10-06T02:20:51.830905+0000","last_clean":"2023-10-06T02:20:51.830905+0000","last_became_active":"2023-10-06T02:20:51.824649+0000","last_became_peered":"2023-10-06T02:20:51.824649+0000","last_unstale":"2023-10-06T02:20:51.830905+0000","last_undegraded":"2023-10-06T02:20:51.830905+0000","last_fullsized":"2023-10-06T02:20:51.830905+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:27.916523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838132+0000","last_change":"2023-10-06T02:20:51.832649+0000","last_active":"2023-10-06T02:20:51.838132+0000","last_peered":"2023-10-06T02:20:51.838132+0000","last_clean":"2023-10-06T02:20:51.838132+0000","last_became_active":"2023-10-06T02:20:51.832210+0000","last_became_peered":"2023-10-06T02:20:51.832210+0000","last_unstale":"2023-10-06T02:20:51.838132+0000","last_undegraded":"2023-10-06T02:20:51.838132+0000","last_fullsized":"2023-10-06T02:20:51.838132+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:52.764916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.818048+0000","last_change":"2023-10-06T02:20:51.816289+0000","last_active":"2023-10-06T02:20:51.818048+0000","last_peered":"2023-10-06T02:20:51.818048+0000","last_clean":"2023-10-06T02:20:51.818048+0000","last_became_active":"2023-10-06T02:20:51.816011+0000","last_became_peered":"2023-10-06T02:20:51.816011+0000","last_unstale":"2023-10-06T02:20:51.818048+0000","last_undegraded":"2023-10-06T02:20:51.818048+0000","last_fullsized":"2023-10-06T02:20:51.818048+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:11.256735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838053+0000","last_change":"2023-10-06T02:20:51.830772+0000","last_active":"2023-10-06T02:20:51.838053+0000","last_peered":"2023-10-06T02:20:51.838053+0000","last_clean":"2023-10-06T02:20:51.838053+0000","last_became_active":"2023-10-06T02:20:51.830511+0000","last_became_peered":"2023-10-06T02:20:51.830511+0000","last_unstale":"2023-10-06T02:20:51.838053+0000","last_undegraded":"2023-10-06T02:20:51.838053+0000","last_fullsized":"2023-10-06T02:20:51.838053+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:34:01.968206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830038+0000","last_change":"2023-10-06T02:20:51.827652+0000","last_active":"2023-10-06T02:20:51.830038+0000","last_peered":"2023-10-06T02:20:51.830038+0000","last_clean":"2023-10-06T02:20:51.830038+0000","last_became_active":"2023-10-06T02:20:51.826951+0000","last_became_peered":"2023-10-06T02:20:51.826951+0000","last_unstale":"2023-10-06T02:20:51.830038+0000","last_undegraded":"2023-10-06T02:20:51.830038+0000","last_fullsized":"2023-10-06T02:20:51.830038+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:32.371220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830500+0000","last_change":"2023-10-06T02:20:51.823449+0000","last_active":"2023-10-06T02:20:51.830500+0000","last_peered":"2023-10-06T02:20:51.830500+0000","last_clean":"2023-10-06T02:20:51.830500+0000","last_became_active":"2023-10-06T02:20:51.823206+0000","last_became_peered":"2023-10-06T02:20:51.823206+0000","last_unstale":"2023-10-06T02:20:51.830500+0000","last_undegraded":"2023-10-06T02:20:51.830500+0000","last_fullsized":"2023-10-06T02:20:51.830500+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:06.182600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.826736+0000","last_change":"2023-10-06T02:20:51.824383+0000","last_active":"2023-10-06T02:20:51.826736+0000","last_peered":"2023-10-06T02:20:51.826736+0000","last_clean":"2023-10-06T02:20:51.826736+0000","last_became_active":"2023-10-06T02:20:51.824143+0000","last_became_peered":"2023-10-06T02:20:51.824143+0000","last_unstale":"2023-10-06T02:20:51.826736+0000","last_undegraded":"2023-10-06T02:20:51.826736+0000","last_fullsized":"2023-10-06T02:20:51.826736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:16.074398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.828337+0000","last_change":"2023-10-06T02:20:51.823286+0000","last_active":"2023-10-06T02:20:51.828337+0000","last_peered":"2023-10-06T02:20:51.828337+0000","last_clean":"2023-10-06T02:20:51.828337+0000","last_became_active":"2023-10-06T02:20:51.822843+0000","last_became_peered":"2023-10-06T02:20:51.822843+0000","last_unstale":"2023-10-06T02:20:51.828337+0000","last_undegraded":"2023-10-06T02:20:51.828337+0000","last_fullsized":"2023-10-06T02:20:51.828337+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:34.666306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830947+0000","last_change":"2023-10-06T02:20:51.827347+0000","last_active":"2023-10-06T02:20:51.830947+0000","last_peered":"2023-10-06T02:20:51.830947+0000","last_clean":"2023-10-06T02:20:51.830947+0000","last_became_active":"2023-10-06T02:20:51.827067+0000","last_became_peered":"2023-10-06T02:20:51.827067+0000","last_unstale":"2023-10-06T02:20:51.830947+0000","last_undegraded":"2023-10-06T02:20:51.830947+0000","last_fullsized":"2023-10-06T02:20:51.830947+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:38.335002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.824189+0000","last_change":"2023-10-06T02:20:51.819988+0000","last_active":"2023-10-06T02:20:51.824189+0000","last_peered":"2023-10-06T02:20:51.824189+0000","last_clean":"2023-10-06T02:20:51.824189+0000","last_became_active":"2023-10-06T02:20:51.819699+0000","last_became_peered":"2023-10-06T02:20:51.819699+0000","last_unstale":"2023-10-06T02:20:51.824189+0000","last_undegraded":"2023-10-06T02:20:51.824189+0000","last_fullsized":"2023-10-06T02:20:51.824189+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:22:07.531514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.821210+0000","last_change":"2023-10-06T02:20:51.818432+0000","last_active":"2023-10-06T02:20:51.821210+0000","last_peered":"2023-10-06T02:20:51.821210+0000","last_clean":"2023-10-06T02:20:51.821210+0000","last_became_active":"2023-10-06T02:20:51.818132+0000","last_became_peered":"2023-10-06T02:20:51.818132+0000","last_unstale":"2023-10-06T02:20:51.821210+0000","last_undegraded":"2023-10-06T02:20:51.821210+0000","last_fullsized":"2023-10-06T02:20:51.821210+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:27.994546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831034+0000","last_change":"2023-10-06T02:20:51.823644+0000","last_active":"2023-10-06T02:20:51.831034+0000","last_peered":"2023-10-06T02:20:51.831034+0000","last_clean":"2023-10-06T02:20:51.831034+0000","last_became_active":"2023-10-06T02:20:51.823368+0000","last_became_peered":"2023-10-06T02:20:51.823368+0000","last_unstale":"2023-10-06T02:20:51.831034+0000","last_undegraded":"2023-10-06T02:20:51.831034+0000","last_fullsized":"2023-10-06T02:20:51.831034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:38.335002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830054+0000","last_change":"2023-10-06T02:20:51.827211+0000","last_active":"2023-10-06T02:20:51.830054+0000","last_peered":"2023-10-06T02:20:51.830054+0000","last_clean":"2023-10-06T02:20:51.830054+0000","last_became_active":"2023-10-06T02:20:51.826592+0000","last_became_peered":"2023-10-06T02:20:51.826592+0000","last_unstale":"2023-10-06T02:20:51.830054+0000","last_undegraded":"2023-10-06T02:20:51.830054+0000","last_fullsized":"2023-10-06T02:20:51.830054+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:24.608807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829550+0000","last_change":"2023-10-06T02:20:51.827857+0000","last_active":"2023-10-06T02:20:51.829550+0000","last_peered":"2023-10-06T02:20:51.829550+0000","last_clean":"2023-10-06T02:20:51.829550+0000","last_became_active":"2023-10-06T02:20:51.827566+0000","last_became_peered":"2023-10-06T02:20:51.827566+0000","last_unstale":"2023-10-06T02:20:51.829550+0000","last_undegraded":"2023-10-06T02:20:51.829550+0000","last_fullsized":"2023-10-06T02:20:51.829550+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:40:30.735186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838046+0000","last_change":"2023-10-06T02:20:51.830131+0000","last_active":"2023-10-06T02:20:51.838046+0000","last_peered":"2023-10-06T02:20:51.838046+0000","last_clean":"2023-10-06T02:20:51.838046+0000","last_became_active":"2023-10-06T02:20:51.829829+0000","last_became_peered":"2023-10-06T02:20:51.829829+0000","last_unstale":"2023-10-06T02:20:51.838046+0000","last_undegraded":"2023-10-06T02:20:51.838046+0000","last_fullsized":"2023-10-06T02:20:51.838046+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:50:42.198175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.821206+0000","last_change":"2023-10-06T02:20:51.818549+0000","last_active":"2023-10-06T02:20:51.821206+0000","last_peered":"2023-10-06T02:20:51.821206+0000","last_clean":"2023-10-06T02:20:51.821206+0000","last_became_active":"2023-10-06T02:20:51.818288+0000","last_became_peered":"2023-10-06T02:20:51.818288+0000","last_unstale":"2023-10-06T02:20:51.821206+0000","last_undegraded":"2023-10-06T02:20:51.821206+0000","last_fullsized":"2023-10-06T02:20:51.821206+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:45.261565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829073+0000","last_change":"2023-10-06T02:20:51.814480+0000","last_active":"2023-10-06T02:20:51.829073+0000","last_peered":"2023-10-06T02:20:51.829073+0000","last_clean":"2023-10-06T02:20:51.829073+0000","last_became_active":"2023-10-06T02:20:51.814204+0000","last_became_peered":"2023-10-06T02:20:51.814204+0000","last_unstale":"2023-10-06T02:20:51.829073+0000","last_undegraded":"2023-10-06T02:20:51.829073+0000","last_fullsized":"2023-10-06T02:20:51.829073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:23.870295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831267+0000","last_change":"2023-10-06T02:20:51.820729+0000","last_active":"2023-10-06T02:20:51.831267+0000","last_peered":"2023-10-06T02:20:51.831267+0000","last_clean":"2023-10-06T02:20:51.831267+0000","last_became_active":"2023-10-06T02:20:51.816847+0000","last_became_peered":"2023-10-06T02:20:51.816847+0000","last_unstale":"2023-10-06T02:20:51.831267+0000","last_undegraded":"2023-10-06T02:20:51.831267+0000","last_fullsized":"2023-10-06T02:20:51.831267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:36:54.493043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.825691+0000","last_change":"2023-10-06T02:20:51.822228+0000","last_active":"2023-10-06T02:20:51.825691+0000","last_peered":"2023-10-06T02:20:51.825691+0000","last_clean":"2023-10-06T02:20:51.825691+0000","last_became_active":"2023-10-06T02:20:51.821966+0000","last_became_peered":"2023-10-06T02:20:51.821966+0000","last_unstale":"2023-10-06T02:20:51.825691+0000","last_undegraded":"2023-10-06T02:20:51.825691+0000","last_fullsized":"2023-10-06T02:20:51.825691+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:00.591843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831438+0000","last_change":"2023-10-06T02:20:51.826196+0000","last_active":"2023-10-06T02:20:51.831438+0000","last_peered":"2023-10-06T02:20:51.831438+0000","last_clean":"2023-10-06T02:20:51.831438+0000","last_became_active":"2023-10-06T02:20:51.825929+0000","last_became_peered":"2023-10-06T02:20:51.825929+0000","last_unstale":"2023-10-06T02:20:51.831438+0000","last_undegraded":"2023-10-06T02:20:51.831438+0000","last_fullsized":"2023-10-06T02:20:51.831438+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:28.010680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830509+0000","last_change":"2023-10-06T02:20:51.814794+0000","last_active":"2023-10-06T02:20:51.830509+0000","last_peered":"2023-10-06T02:20:51.830509+0000","last_clean":"2023-10-06T02:20:51.830509+0000","last_became_active":"2023-10-06T02:20:51.809059+0000","last_became_peered":"2023-10-06T02:20:51.809059+0000","last_unstale":"2023-10-06T02:20:51.830509+0000","last_undegraded":"2023-10-06T02:20:51.830509+0000","last_fullsized":"2023-10-06T02:20:51.830509+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:47.466678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829706+0000","last_change":"2023-10-06T02:20:51.824773+0000","last_active":"2023-10-06T02:20:51.829706+0000","last_peered":"2023-10-06T02:20:51.829706+0000","last_clean":"2023-10-06T02:20:51.829706+0000","last_became_active":"2023-10-06T02:20:51.824476+0000","last_became_peered":"2023-10-06T02:20:51.824476+0000","last_unstale":"2023-10-06T02:20:51.829706+0000","last_undegraded":"2023-10-06T02:20:51.829706+0000","last_fullsized":"2023-10-06T02:20:51.829706+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:00.591843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.827311+0000","last_change":"2023-10-06T02:20:51.822355+0000","last_active":"2023-10-06T02:20:51.827311+0000","last_peered":"2023-10-06T02:20:51.827311+0000","last_clean":"2023-10-06T02:20:51.827311+0000","last_became_active":"2023-10-06T02:20:51.822041+0000","last_became_peered":"2023-10-06T02:20:51.822041+0000","last_unstale":"2023-10-06T02:20:51.827311+0000","last_undegraded":"2023-10-06T02:20:51.827311+0000","last_fullsized":"2023-10-06T02:20:51.827311+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:05.642500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830537+0000","last_change":"2023-10-06T02:20:51.822859+0000","last_active":"2023-10-06T02:20:51.830537+0000","last_peered":"2023-10-06T02:20:51.830537+0000","last_clean":"2023-10-06T02:20:51.830537+0000","last_became_active":"2023-10-06T02:20:51.822601+0000","last_became_peered":"2023-10-06T02:20:51.822601+0000","last_unstale":"2023-10-06T02:20:51.830537+0000","last_undegraded":"2023-10-06T02:20:51.830537+0000","last_fullsized":"2023-10-06T02:20:51.830537+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:53.757794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.822313+0000","last_change":"2023-10-06T02:20:51.817408+0000","last_active":"2023-10-06T02:20:51.822313+0000","last_peered":"2023-10-06T02:20:51.822313+0000","last_clean":"2023-10-06T02:20:51.822313+0000","last_became_active":"2023-10-06T02:20:51.817044+0000","last_became_peered":"2023-10-06T02:20:51.817044+0000","last_unstale":"2023-10-06T02:20:51.822313+0000","last_undegraded":"2023-10-06T02:20:51.822313+0000","last_fullsized":"2023-10-06T02:20:51.822313+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:25.714407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.827098+0000","last_change":"2023-10-06T02:20:51.824139+0000","last_active":"2023-10-06T02:20:51.827098+0000","last_peered":"2023-10-06T02:20:51.827098+0000","last_clean":"2023-10-06T02:20:51.827098+0000","last_became_active":"2023-10-06T02:20:51.823884+0000","last_became_peered":"2023-10-06T02:20:51.823884+0000","last_unstale":"2023-10-06T02:20:51.827098+0000","last_undegraded":"2023-10-06T02:20:51.827098+0000","last_fullsized":"2023-10-06T02:20:51.827098+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:40.217512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.820661+0000","last_change":"2023-10-06T02:20:51.817343+0000","last_active":"2023-10-06T02:20:51.820661+0000","last_peered":"2023-10-06T02:20:51.820661+0000","last_clean":"2023-10-06T02:20:51.820661+0000","last_became_active":"2023-10-06T02:20:51.817079+0000","last_became_peered":"2023-10-06T02:20:51.817079+0000","last_unstale":"2023-10-06T02:20:51.820661+0000","last_undegraded":"2023-10-06T02:20:51.820661+0000","last_fullsized":"2023-10-06T02:20:51.820661+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:28.010680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829310+0000","last_change":"2023-10-06T02:20:51.828115+0000","last_active":"2023-10-06T02:20:51.829310+0000","last_peered":"2023-10-06T02:20:51.829310+0000","last_clean":"2023-10-06T02:20:51.829310+0000","last_became_active":"2023-10-06T02:20:51.827857+0000","last_became_peered":"2023-10-06T02:20:51.827857+0000","last_unstale":"2023-10-06T02:20:51.829310+0000","last_undegraded":"2023-10-06T02:20:51.829310+0000","last_fullsized":"2023-10-06T02:20:51.829310+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:49:25.458611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.833059+0000","last_change":"2023-10-06T02:20:51.830780+0000","last_active":"2023-10-06T02:20:51.833059+0000","last_peered":"2023-10-06T02:20:51.833059+0000","last_clean":"2023-10-06T02:20:51.833059+0000","last_became_active":"2023-10-06T02:20:51.830516+0000","last_became_peered":"2023-10-06T02:20:51.830516+0000","last_unstale":"2023-10-06T02:20:51.833059+0000","last_undegraded":"2023-10-06T02:20:51.833059+0000","last_fullsized":"2023-10-06T02:20:51.833059+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:12:16.185906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"65'4","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829186+0000","last_change":"2023-10-06T02:20:50.822437+0000","last_active":"2023-10-06T02:20:51.829186+0000","last_peered":"2023-10-06T02:20:51.829186+0000","last_clean":"2023-10-06T02:20:51.829186+0000","last_became_active":"2023-10-06T02:20:50.822220+0000","last_became_peered":"2023-10-06T02:20:50.822220+0000","last_unstale":"2023-10-06T02:20:51.829186+0000","last_undegraded":"2023-10-06T02:20:51.829186+0000","last_fullsized":"2023-10-06T02:20:51.829186+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:32.995079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830018+0000","last_change":"2023-10-06T02:20:51.825686+0000","last_active":"2023-10-06T02:20:51.830018+0000","last_peered":"2023-10-06T02:20:51.830018+0000","last_clean":"2023-10-06T02:20:51.830018+0000","last_became_active":"2023-10-06T02:20:51.825407+0000","last_became_peered":"2023-10-06T02:20:51.825407+0000","last_unstale":"2023-10-06T02:20:51.830018+0000","last_undegraded":"2023-10-06T02:20:51.830018+0000","last_fullsized":"2023-10-06T02:20:51.830018+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:35.983030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.826803+0000","last_change":"2023-10-06T02:20:50.818921+0000","last_active":"2023-10-06T02:20:51.826803+0000","last_peered":"2023-10-06T02:20:51.826803+0000","last_clean":"2023-10-06T02:20:51.826803+0000","last_became_active":"2023-10-06T02:20:50.818714+0000","last_became_peered":"2023-10-06T02:20:50.818714+0000","last_unstale":"2023-10-06T02:20:51.826803+0000","last_undegraded":"2023-10-06T02:20:51.826803+0000","last_fullsized":"2023-10-06T02:20:51.826803+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:59.586917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831337+0000","last_change":"2023-10-06T02:20:51.828901+0000","last_active":"2023-10-06T02:20:51.831337+0000","last_peered":"2023-10-06T02:20:51.831337+0000","last_clean":"2023-10-06T02:20:51.831337+0000","last_became_active":"2023-10-06T02:20:51.828658+0000","last_became_peered":"2023-10-06T02:20:51.828658+0000","last_unstale":"2023-10-06T02:20:51.831337+0000","last_undegraded":"2023-10-06T02:20:51.831337+0000","last_fullsized":"2023-10-06T02:20:51.831337+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:34.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.822829+0000","last_change":"2023-10-06T02:20:50.819353+0000","last_active":"2023-10-06T02:20:51.822829+0000","last_peered":"2023-10-06T02:20:51.822829+0000","last_clean":"2023-10-06T02:20:51.822829+0000","last_became_active":"2023-10-06T02:20:50.819040+0000","last_became_peered":"2023-10-06T02:20:50.819040+0000","last_unstale":"2023-10-06T02:20:51.822829+0000","last_undegraded":"2023-10-06T02:20:51.822829+0000","last_fullsized":"2023-10-06T02:20:51.822829+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:15.069472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.826717+0000","last_change":"2023-10-06T02:20:51.823050+0000","last_active":"2023-10-06T02:20:51.826717+0000","last_peered":"2023-10-06T02:20:51.826717+0000","last_clean":"2023-10-06T02:20:51.826717+0000","last_became_active":"2023-10-06T02:20:51.822791+0000","last_became_peered":"2023-10-06T02:20:51.822791+0000","last_unstale":"2023-10-06T02:20:51.826717+0000","last_undegraded":"2023-10-06T02:20:51.826717+0000","last_fullsized":"2023-10-06T02:20:51.826717+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:40.217512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830417+0000","last_change":"2023-10-06T02:20:50.818515+0000","last_active":"2023-10-06T02:20:51.830417+0000","last_peered":"2023-10-06T02:20:51.830417+0000","last_clean":"2023-10-06T02:20:51.830417+0000","last_became_active":"2023-10-06T02:20:50.818264+0000","last_became_peered":"2023-10-06T02:20:50.818264+0000","last_unstale":"2023-10-06T02:20:51.830417+0000","last_undegraded":"2023-10-06T02:20:51.830417+0000","last_fullsized":"2023-10-06T02:20:51.830417+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:01.744172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.825520+0000","last_change":"2023-10-06T02:20:51.818483+0000","last_active":"2023-10-06T02:20:51.825520+0000","last_peered":"2023-10-06T02:20:51.825520+0000","last_clean":"2023-10-06T02:20:51.825520+0000","last_became_active":"2023-10-06T02:20:51.818229+0000","last_became_peered":"2023-10-06T02:20:51.818229+0000","last_unstale":"2023-10-06T02:20:51.825520+0000","last_undegraded":"2023-10-06T02:20:51.825520+0000","last_fullsized":"2023-10-06T02:20:51.825520+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:34.544171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.816622+0000","last_change":"2023-10-06T02:20:50.808802+0000","last_active":"2023-10-06T02:20:51.816622+0000","last_peered":"2023-10-06T02:20:51.816622+0000","last_clean":"2023-10-06T02:20:51.816622+0000","last_became_active":"2023-10-06T02:20:50.808512+0000","last_became_peered":"2023-10-06T02:20:50.808512+0000","last_unstale":"2023-10-06T02:20:51.816622+0000","last_undegraded":"2023-10-06T02:20:51.816622+0000","last_fullsized":"2023-10-06T02:20:51.816622+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:37.330076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.816247+0000","last_change":"2023-10-06T02:20:51.809429+0000","last_active":"2023-10-06T02:20:51.816247+0000","last_peered":"2023-10-06T02:20:51.816247+0000","last_clean":"2023-10-06T02:20:51.816247+0000","last_became_active":"2023-10-06T02:20:51.809123+0000","last_became_peered":"2023-10-06T02:20:51.809123+0000","last_unstale":"2023-10-06T02:20:51.816247+0000","last_undegraded":"2023-10-06T02:20:51.816247+0000","last_fullsized":"2023-10-06T02:20:51.816247+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:24.338553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.828508+0000","last_change":"2023-10-06T02:20:50.823496+0000","last_active":"2023-10-06T02:20:51.828508+0000","last_peered":"2023-10-06T02:20:51.828508+0000","last_clean":"2023-10-06T02:20:51.828508+0000","last_became_active":"2023-10-06T02:20:50.823162+0000","last_became_peered":"2023-10-06T02:20:50.823162+0000","last_unstale":"2023-10-06T02:20:51.828508+0000","last_undegraded":"2023-10-06T02:20:51.828508+0000","last_fullsized":"2023-10-06T02:20:51.828508+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:30:28.469240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830809+0000","last_change":"2023-10-06T02:20:51.830099+0000","last_active":"2023-10-06T02:20:51.830809+0000","last_peered":"2023-10-06T02:20:51.830809+0000","last_clean":"2023-10-06T02:20:51.830809+0000","last_became_active":"2023-10-06T02:20:51.829808+0000","last_became_peered":"2023-10-06T02:20:51.829808+0000","last_unstale":"2023-10-06T02:20:51.830809+0000","last_undegraded":"2023-10-06T02:20:51.830809+0000","last_fullsized":"2023-10-06T02:20:51.830809+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:15.317541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.800486+0000","last_change":"2023-10-06T02:20:50.820965+0000","last_active":"2023-10-06T02:20:51.800486+0000","last_peered":"2023-10-06T02:20:51.800486+0000","last_clean":"2023-10-06T02:20:51.800486+0000","last_became_active":"2023-10-06T02:20:50.820752+0000","last_became_peered":"2023-10-06T02:20:50.820752+0000","last_unstale":"2023-10-06T02:20:51.800486+0000","last_undegraded":"2023-10-06T02:20:51.800486+0000","last_fullsized":"2023-10-06T02:20:51.800486+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:31.366294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.810104+0000","last_change":"2023-10-06T02:20:51.808589+0000","last_active":"2023-10-06T02:20:51.810104+0000","last_peered":"2023-10-06T02:20:51.810104+0000","last_clean":"2023-10-06T02:20:51.810104+0000","last_became_active":"2023-10-06T02:20:51.808235+0000","last_became_peered":"2023-10-06T02:20:51.808235+0000","last_unstale":"2023-10-06T02:20:51.810104+0000","last_undegraded":"2023-10-06T02:20:51.810104+0000","last_fullsized":"2023-10-06T02:20:51.810104+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:53.001974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.813219+0000","last_change":"2023-10-06T02:20:50.818453+0000","last_active":"2023-10-06T02:20:51.813219+0000","last_peered":"2023-10-06T02:20:51.813219+0000","last_clean":"2023-10-06T02:20:51.813219+0000","last_became_active":"2023-10-06T02:20:50.818167+0000","last_became_peered":"2023-10-06T02:20:50.818167+0000","last_unstale":"2023-10-06T02:20:51.813219+0000","last_undegraded":"2023-10-06T02:20:51.813219+0000","last_fullsized":"2023-10-06T02:20:51.813219+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:32.408249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829728+0000","last_change":"2023-10-06T02:20:51.825296+0000","last_active":"2023-10-06T02:20:51.829728+0000","last_peered":"2023-10-06T02:20:51.829728+0000","last_clean":"2023-10-06T02:20:51.829728+0000","last_became_active":"2023-10-06T02:20:51.825046+0000","last_became_peered":"2023-10-06T02:20:51.825046+0000","last_unstale":"2023-10-06T02:20:51.829728+0000","last_undegraded":"2023-10-06T02:20:51.829728+0000","last_fullsized":"2023-10-06T02:20:51.829728+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:25.128853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.803449+0000","last_change":"2023-10-06T02:20:50.816556+0000","last_active":"2023-10-06T02:20:51.803449+0000","last_peered":"2023-10-06T02:20:51.803449+0000","last_clean":"2023-10-06T02:20:51.803449+0000","last_became_active":"2023-10-06T02:20:50.816295+0000","last_became_peered":"2023-10-06T02:20:50.816295+0000","last_unstale":"2023-10-06T02:20:51.803449+0000","last_undegraded":"2023-10-06T02:20:51.803449+0000","last_fullsized":"2023-10-06T02:20:51.803449+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.005754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.835416+0000","last_change":"2023-10-06T02:20:51.831925+0000","last_active":"2023-10-06T02:20:51.835416+0000","last_peered":"2023-10-06T02:20:51.835416+0000","last_clean":"2023-10-06T02:20:51.835416+0000","last_became_active":"2023-10-06T02:20:51.831642+0000","last_became_peered":"2023-10-06T02:20:51.831642+0000","last_unstale":"2023-10-06T02:20:51.835416+0000","last_undegraded":"2023-10-06T02:20:51.835416+0000","last_fullsized":"2023-10-06T02:20:51.835416+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:27.385871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.817954+0000","last_change":"2023-10-06T02:20:50.817299+0000","last_active":"2023-10-06T02:20:51.817954+0000","last_peered":"2023-10-06T02:20:51.817954+0000","last_clean":"2023-10-06T02:20:51.817954+0000","last_became_active":"2023-10-06T02:20:50.816988+0000","last_became_peered":"2023-10-06T02:20:50.816988+0000","last_unstale":"2023-10-06T02:20:51.817954+0000","last_undegraded":"2023-10-06T02:20:51.817954+0000","last_fullsized":"2023-10-06T02:20:51.817954+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:05.025893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838003+0000","last_change":"2023-10-06T02:20:51.830161+0000","last_active":"2023-10-06T02:20:51.838003+0000","last_peered":"2023-10-06T02:20:51.838003+0000","last_clean":"2023-10-06T02:20:51.838003+0000","last_became_active":"2023-10-06T02:20:51.829914+0000","last_became_peered":"2023-10-06T02:20:51.829914+0000","last_unstale":"2023-10-06T02:20:51.838003+0000","last_undegraded":"2023-10-06T02:20:51.838003+0000","last_fullsized":"2023-10-06T02:20:51.838003+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:36.124998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"65'3","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.818102+0000","last_change":"2023-10-06T02:20:50.810864+0000","last_active":"2023-10-06T02:20:51.818102+0000","last_peered":"2023-10-06T02:20:51.818102+0000","last_clean":"2023-10-06T02:20:51.818102+0000","last_became_active":"2023-10-06T02:20:50.810578+0000","last_became_peered":"2023-10-06T02:20:50.810578+0000","last_unstale":"2023-10-06T02:20:51.818102+0000","last_undegraded":"2023-10-06T02:20:51.818102+0000","last_fullsized":"2023-10-06T02:20:51.818102+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:22.865369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829629+0000","last_change":"2023-10-06T02:20:51.826105+0000","last_active":"2023-10-06T02:20:51.829629+0000","last_peered":"2023-10-06T02:20:51.829629+0000","last_clean":"2023-10-06T02:20:51.829629+0000","last_became_active":"2023-10-06T02:20:51.825480+0000","last_became_peered":"2023-10-06T02:20:51.825480+0000","last_unstale":"2023-10-06T02:20:51.829629+0000","last_undegraded":"2023-10-06T02:20:51.829629+0000","last_fullsized":"2023-10-06T02:20:51.829629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:06.030819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"65'6","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.833376+0000","last_change":"2023-10-06T02:20:50.818481+0000","last_active":"2023-10-06T02:20:51.833376+0000","last_peered":"2023-10-06T02:20:51.833376+0000","last_clean":"2023-10-06T02:20:51.833376+0000","last_became_active":"2023-10-06T02:20:50.818177+0000","last_became_peered":"2023-10-06T02:20:50.818177+0000","last_unstale":"2023-10-06T02:20:51.833376+0000","last_undegraded":"2023-10-06T02:20:51.833376+0000","last_fullsized":"2023-10-06T02:20:51.833376+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:23.603882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.827327+0000","last_change":"2023-10-06T02:20:51.825095+0000","last_active":"2023-10-06T02:20:51.827327+0000","last_peered":"2023-10-06T02:20:51.827327+0000","last_clean":"2023-10-06T02:20:51.827327+0000","last_became_active":"2023-10-06T02:20:51.824795+0000","last_became_peered":"2023-10-06T02:20:51.824795+0000","last_unstale":"2023-10-06T02:20:51.827327+0000","last_undegraded":"2023-10-06T02:20:51.827327+0000","last_fullsized":"2023-10-06T02:20:51.827327+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:59.948754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.824845+0000","last_change":"2023-10-06T02:20:50.820106+0000","last_active":"2023-10-06T02:20:51.824845+0000","last_peered":"2023-10-06T02:20:51.824845+0000","last_clean":"2023-10-06T02:20:51.824845+0000","last_became_active":"2023-10-06T02:20:50.819489+0000","last_became_peered":"2023-10-06T02:20:50.819489+0000","last_unstale":"2023-10-06T02:20:51.824845+0000","last_undegraded":"2023-10-06T02:20:51.824845+0000","last_fullsized":"2023-10-06T02:20:51.824845+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:44.274895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.824489+0000","last_change":"2023-10-06T02:20:51.818073+0000","last_active":"2023-10-06T02:20:51.824489+0000","last_peered":"2023-10-06T02:20:51.824489+0000","last_clean":"2023-10-06T02:20:51.824489+0000","last_became_active":"2023-10-06T02:20:51.817742+0000","last_became_peered":"2023-10-06T02:20:51.817742+0000","last_unstale":"2023-10-06T02:20:51.824489+0000","last_undegraded":"2023-10-06T02:20:51.824489+0000","last_fullsized":"2023-10-06T02:20:51.824489+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:59.299607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.817349+0000","last_change":"2023-10-06T02:20:50.818283+0000","last_active":"2023-10-06T02:20:51.817349+0000","last_peered":"2023-10-06T02:20:51.817349+0000","last_clean":"2023-10-06T02:20:51.817349+0000","last_became_active":"2023-10-06T02:20:50.817899+0000","last_became_peered":"2023-10-06T02:20:50.817899+0000","last_unstale":"2023-10-06T02:20:51.817349+0000","last_undegraded":"2023-10-06T02:20:51.817349+0000","last_fullsized":"2023-10-06T02:20:51.817349+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:26.911597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.824337+0000","last_change":"2023-10-06T02:20:51.822915+0000","last_active":"2023-10-06T02:20:51.824337+0000","last_peered":"2023-10-06T02:20:51.824337+0000","last_clean":"2023-10-06T02:20:51.824337+0000","last_became_active":"2023-10-06T02:20:51.822627+0000","last_became_peered":"2023-10-06T02:20:51.822627+0000","last_unstale":"2023-10-06T02:20:51.824337+0000","last_undegraded":"2023-10-06T02:20:51.824337+0000","last_fullsized":"2023-10-06T02:20:51.824337+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:26.021599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.807534+0000","last_change":"2023-10-06T02:20:50.812022+0000","last_active":"2023-10-06T02:20:51.807534+0000","last_peered":"2023-10-06T02:20:51.807534+0000","last_clean":"2023-10-06T02:20:51.807534+0000","last_became_active":"2023-10-06T02:20:50.811750+0000","last_became_peered":"2023-10-06T02:20:50.811750+0000","last_unstale":"2023-10-06T02:20:51.807534+0000","last_undegraded":"2023-10-06T02:20:51.807534+0000","last_fullsized":"2023-10-06T02:20:51.807534+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:35.120072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829962+0000","last_change":"2023-10-06T02:20:51.827416+0000","last_active":"2023-10-06T02:20:51.829962+0000","last_peered":"2023-10-06T02:20:51.829962+0000","last_clean":"2023-10-06T02:20:51.829962+0000","last_became_active":"2023-10-06T02:20:51.827125+0000","last_became_peered":"2023-10-06T02:20:51.827125+0000","last_unstale":"2023-10-06T02:20:51.829962+0000","last_undegraded":"2023-10-06T02:20:51.829962+0000","last_fullsized":"2023-10-06T02:20:51.829962+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:45.279821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"65'8","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.826758+0000","last_change":"2023-10-06T02:20:50.817524+0000","last_active":"2023-10-06T02:20:51.826758+0000","last_peered":"2023-10-06T02:20:51.826758+0000","last_clean":"2023-10-06T02:20:51.826758+0000","last_became_active":"2023-10-06T02:20:50.817267+0000","last_became_peered":"2023-10-06T02:20:50.817267+0000","last_unstale":"2023-10-06T02:20:51.826758+0000","last_undegraded":"2023-10-06T02:20:51.826758+0000","last_fullsized":"2023-10-06T02:20:51.826758+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:26.380945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.821408+0000","last_change":"2023-10-06T02:20:51.818539+0000","last_active":"2023-10-06T02:20:51.821408+0000","last_peered":"2023-10-06T02:20:51.821408+0000","last_clean":"2023-10-06T02:20:51.821408+0000","last_became_active":"2023-10-06T02:20:51.817767+0000","last_became_peered":"2023-10-06T02:20:51.817767+0000","last_unstale":"2023-10-06T02:20:51.821408+0000","last_undegraded":"2023-10-06T02:20:51.821408+0000","last_fullsized":"2023-10-06T02:20:51.821408+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:40.662240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.832278+0000","last_change":"2023-10-06T02:20:50.816771+0000","last_active":"2023-10-06T02:20:51.832278+0000","last_peered":"2023-10-06T02:20:51.832278+0000","last_clean":"2023-10-06T02:20:51.832278+0000","last_became_active":"2023-10-06T02:20:50.816456+0000","last_became_peered":"2023-10-06T02:20:50.816456+0000","last_unstale":"2023-10-06T02:20:51.832278+0000","last_undegraded":"2023-10-06T02:20:51.832278+0000","last_fullsized":"2023-10-06T02:20:51.832278+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:31.366294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.824392+0000","last_change":"2023-10-06T02:20:51.817536+0000","last_active":"2023-10-06T02:20:51.824392+0000","last_peered":"2023-10-06T02:20:51.824392+0000","last_clean":"2023-10-06T02:20:51.824392+0000","last_became_active":"2023-10-06T02:20:51.817253+0000","last_became_peered":"2023-10-06T02:20:51.817253+0000","last_unstale":"2023-10-06T02:20:51.824392+0000","last_undegraded":"2023-10-06T02:20:51.824392+0000","last_fullsized":"2023-10-06T02:20:51.824392+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:44.060757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.808802+0000","last_change":"2023-10-06T02:20:50.815180+0000","last_active":"2023-10-06T02:20:51.808802+0000","last_peered":"2023-10-06T02:20:51.808802+0000","last_clean":"2023-10-06T02:20:51.808802+0000","last_became_active":"2023-10-06T02:20:50.814883+0000","last_became_peered":"2023-10-06T02:20:50.814883+0000","last_unstale":"2023-10-06T02:20:51.808802+0000","last_undegraded":"2023-10-06T02:20:51.808802+0000","last_fullsized":"2023-10-06T02:20:51.808802+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:51.759990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831337+0000","last_change":"2023-10-06T02:20:51.825845+0000","last_active":"2023-10-06T02:20:51.831337+0000","last_peered":"2023-10-06T02:20:51.831337+0000","last_clean":"2023-10-06T02:20:51.831337+0000","last_became_active":"2023-10-06T02:20:51.825570+0000","last_became_peered":"2023-10-06T02:20:51.825570+0000","last_unstale":"2023-10-06T02:20:51.831337+0000","last_undegraded":"2023-10-06T02:20:51.831337+0000","last_fullsized":"2023-10-06T02:20:51.831337+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:40.535060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.816858+0000","last_change":"2023-10-06T02:20:50.823586+0000","last_active":"2023-10-06T02:20:51.816858+0000","last_peered":"2023-10-06T02:20:51.816858+0000","last_clean":"2023-10-06T02:20:51.816858+0000","last_became_active":"2023-10-06T02:20:50.823256+0000","last_became_peered":"2023-10-06T02:20:50.823256+0000","last_unstale":"2023-10-06T02:20:51.816858+0000","last_undegraded":"2023-10-06T02:20:51.816858+0000","last_fullsized":"2023-10-06T02:20:51.816858+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:54.267291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831482+0000","last_change":"2023-10-06T02:20:51.826844+0000","last_active":"2023-10-06T02:20:51.831482+0000","last_peered":"2023-10-06T02:20:51.831482+0000","last_clean":"2023-10-06T02:20:51.831482+0000","last_became_active":"2023-10-06T02:20:51.826542+0000","last_became_peered":"2023-10-06T02:20:51.826542+0000","last_unstale":"2023-10-06T02:20:51.831482+0000","last_undegraded":"2023-10-06T02:20:51.831482+0000","last_fullsized":"2023-10-06T02:20:51.831482+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:11:34.615395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.802137+0000","last_change":"2023-10-06T02:20:50.813573+0000","last_active":"2023-10-06T02:20:51.802137+0000","last_peered":"2023-10-06T02:20:51.802137+0000","last_clean":"2023-10-06T02:20:51.802137+0000","last_became_active":"2023-10-06T02:20:50.813255+0000","last_became_peered":"2023-10-06T02:20:50.813255+0000","last_unstale":"2023-10-06T02:20:51.802137+0000","last_undegraded":"2023-10-06T02:20:51.802137+0000","last_fullsized":"2023-10-06T02:20:51.802137+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:15.069472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829180+0000","last_change":"2023-10-06T02:20:51.824549+0000","last_active":"2023-10-06T02:20:51.829180+0000","last_peered":"2023-10-06T02:20:51.829180+0000","last_clean":"2023-10-06T02:20:51.829180+0000","last_became_active":"2023-10-06T02:20:51.824271+0000","last_became_peered":"2023-10-06T02:20:51.824271+0000","last_unstale":"2023-10-06T02:20:51.829180+0000","last_undegraded":"2023-10-06T02:20:51.829180+0000","last_fullsized":"2023-10-06T02:20:51.829180+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:51.462534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.814860+0000","last_change":"2023-10-06T02:20:50.820302+0000","last_active":"2023-10-06T02:20:51.814860+0000","last_peered":"2023-10-06T02:20:51.814860+0000","last_clean":"2023-10-06T02:20:51.814860+0000","last_became_active":"2023-10-06T02:20:50.820059+0000","last_became_peered":"2023-10-06T02:20:50.820059+0000","last_unstale":"2023-10-06T02:20:51.814860+0000","last_undegraded":"2023-10-06T02:20:51.814860+0000","last_fullsized":"2023-10-06T02:20:51.814860+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:57.804494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.838101+0000","last_change":"2023-10-06T02:20:51.830945+0000","last_active":"2023-10-06T02:20:51.838101+0000","last_peered":"2023-10-06T02:20:51.838101+0000","last_clean":"2023-10-06T02:20:51.838101+0000","last_became_active":"2023-10-06T02:20:51.829801+0000","last_became_peered":"2023-10-06T02:20:51.829801+0000","last_unstale":"2023-10-06T02:20:51.838101+0000","last_undegraded":"2023-10-06T02:20:51.838101+0000","last_fullsized":"2023-10-06T02:20:51.838101+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:46.192665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.800545+0000","last_change":"2023-10-06T02:20:50.820326+0000","last_active":"2023-10-06T02:20:51.800545+0000","last_peered":"2023-10-06T02:20:51.800545+0000","last_clean":"2023-10-06T02:20:51.800545+0000","last_became_active":"2023-10-06T02:20:50.820055+0000","last_became_peered":"2023-10-06T02:20:50.820055+0000","last_unstale":"2023-10-06T02:20:51.800545+0000","last_undegraded":"2023-10-06T02:20:51.800545+0000","last_fullsized":"2023-10-06T02:20:51.800545+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:31.728925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.823686+0000","last_change":"2023-10-06T02:20:51.816976+0000","last_active":"2023-10-06T02:20:51.823686+0000","last_peered":"2023-10-06T02:20:51.823686+0000","last_clean":"2023-10-06T02:20:51.823686+0000","last_became_active":"2023-10-06T02:20:51.816812+0000","last_became_peered":"2023-10-06T02:20:51.816812+0000","last_unstale":"2023-10-06T02:20:51.823686+0000","last_undegraded":"2023-10-06T02:20:51.823686+0000","last_fullsized":"2023-10-06T02:20:51.823686+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:07.545935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.802209+0000","last_change":"2023-10-06T02:20:50.819720+0000","last_active":"2023-10-06T02:20:51.802209+0000","last_peered":"2023-10-06T02:20:51.802209+0000","last_clean":"2023-10-06T02:20:51.802209+0000","last_became_active":"2023-10-06T02:20:50.819461+0000","last_became_peered":"2023-10-06T02:20:50.819461+0000","last_unstale":"2023-10-06T02:20:51.802209+0000","last_undegraded":"2023-10-06T02:20:51.802209+0000","last_fullsized":"2023-10-06T02:20:51.802209+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:58.943828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.829316+0000","last_change":"2023-10-06T02:20:51.828069+0000","last_active":"2023-10-06T02:20:51.829316+0000","last_peered":"2023-10-06T02:20:51.829316+0000","last_clean":"2023-10-06T02:20:51.829316+0000","last_became_active":"2023-10-06T02:20:51.827793+0000","last_became_peered":"2023-10-06T02:20:51.827793+0000","last_unstale":"2023-10-06T02:20:51.829316+0000","last_undegraded":"2023-10-06T02:20:51.829316+0000","last_fullsized":"2023-10-06T02:20:51.829316+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:26.442837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.815750+0000","last_change":"2023-10-06T02:20:50.817824+0000","last_active":"2023-10-06T02:20:51.815750+0000","last_peered":"2023-10-06T02:20:51.815750+0000","last_clean":"2023-10-06T02:20:51.815750+0000","last_became_active":"2023-10-06T02:20:50.817563+0000","last_became_peered":"2023-10-06T02:20:50.817563+0000","last_unstale":"2023-10-06T02:20:51.815750+0000","last_undegraded":"2023-10-06T02:20:51.815750+0000","last_fullsized":"2023-10-06T02:20:51.815750+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:31.728925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.832986+0000","last_change":"2023-10-06T02:20:51.826479+0000","last_active":"2023-10-06T02:20:51.832986+0000","last_peered":"2023-10-06T02:20:51.832986+0000","last_clean":"2023-10-06T02:20:51.832986+0000","last_became_active":"2023-10-06T02:20:51.826238+0000","last_became_peered":"2023-10-06T02:20:51.826238+0000","last_unstale":"2023-10-06T02:20:51.832986+0000","last_undegraded":"2023-10-06T02:20:51.832986+0000","last_fullsized":"2023-10-06T02:20:51.832986+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:11.256735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.826818+0000","last_change":"2023-10-06T02:20:50.815734+0000","last_active":"2023-10-06T02:20:51.826818+0000","last_peered":"2023-10-06T02:20:51.826818+0000","last_clean":"2023-10-06T02:20:51.826818+0000","last_became_active":"2023-10-06T02:20:50.815483+0000","last_became_peered":"2023-10-06T02:20:50.815483+0000","last_unstale":"2023-10-06T02:20:51.826818+0000","last_undegraded":"2023-10-06T02:20:51.826818+0000","last_fullsized":"2023-10-06T02:20:51.826818+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:39.530134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":54,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.803148+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:20:51.803148+0000","last_peered":"2023-10-06T02:20:51.803148+0000","last_clean":"2023-10-06T02:20:51.803148+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:20:51.803148+0000","last_undegraded":"2023-10-06T02:20:51.803148+0000","last_fullsized":"2023-10-06T02:20:51.803148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.830418+0000","last_change":"2023-10-06T02:20:51.816262+0000","last_active":"2023-10-06T02:20:51.830418+0000","last_peered":"2023-10-06T02:20:51.830418+0000","last_clean":"2023-10-06T02:20:51.830418+0000","last_became_active":"2023-10-06T02:20:51.815939+0000","last_became_peered":"2023-10-06T02:20:51.815939+0000","last_unstale":"2023-10-06T02:20:51.830418+0000","last_undegraded":"2023-10-06T02:20:51.830418+0000","last_fullsized":"2023-10-06T02:20:51.830418+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:21.905626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.832392+0000","last_change":"2023-10-06T02:20:50.821250+0000","last_active":"2023-10-06T02:20:51.832392+0000","last_peered":"2023-10-06T02:20:51.832392+0000","last_clean":"2023-10-06T02:20:51.832392+0000","last_became_active":"2023-10-06T02:20:50.821031+0000","last_became_peered":"2023-10-06T02:20:50.821031+0000","last_unstale":"2023-10-06T02:20:51.832392+0000","last_undegraded":"2023-10-06T02:20:51.832392+0000","last_fullsized":"2023-10-06T02:20:51.832392+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:44.274895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":54,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.805834+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:20:51.805834+0000","last_peered":"2023-10-06T02:20:51.805834+0000","last_clean":"2023-10-06T02:20:51.805834+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:20:51.805834+0000","last_undegraded":"2023-10-06T02:20:51.805834+0000","last_fullsized":"2023-10-06T02:20:51.805834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.828868+0000","last_change":"2023-10-06T02:20:51.824180+0000","last_active":"2023-10-06T02:20:51.828868+0000","last_peered":"2023-10-06T02:20:51.828868+0000","last_clean":"2023-10-06T02:20:51.828868+0000","last_became_active":"2023-10-06T02:20:51.823933+0000","last_became_peered":"2023-10-06T02:20:51.823933+0000","last_unstale":"2023-10-06T02:20:51.828868+0000","last_undegraded":"2023-10-06T02:20:51.828868+0000","last_fullsized":"2023-10-06T02:20:51.828868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:54.434676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.801803+0000","last_change":"2023-10-06T02:20:50.816680+0000","last_active":"2023-10-06T02:20:51.801803+0000","last_peered":"2023-10-06T02:20:51.801803+0000","last_clean":"2023-10-06T02:20:51.801803+0000","last_became_active":"2023-10-06T02:20:50.816160+0000","last_became_peered":"2023-10-06T02:20:50.816160+0000","last_unstale":"2023-10-06T02:20:51.801803+0000","last_undegraded":"2023-10-06T02:20:51.801803+0000","last_fullsized":"2023-10-06T02:20:51.801803+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.005754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":54,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.800765+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:20:51.800765+0000","last_peered":"2023-10-06T02:20:51.800765+0000","last_clean":"2023-10-06T02:20:51.800765+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:20:51.800765+0000","last_undegraded":"2023-10-06T02:20:51.800765+0000","last_fullsized":"2023-10-06T02:20:51.800765+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":203,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.810740+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:20:51.810740+0000","last_peered":"2023-10-06T02:20:51.810740+0000","last_clean":"2023-10-06T02:20:51.810740+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:20:51.810740+0000","last_undegraded":"2023-10-06T02:20:51.810740+0000","last_fullsized":"2023-10-06T02:20:51.810740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.828752+0000","last_change":"2023-10-06T02:20:51.823933+0000","last_active":"2023-10-06T02:20:51.828752+0000","last_peered":"2023-10-06T02:20:51.828752+0000","last_clean":"2023-10-06T02:20:51.828752+0000","last_became_active":"2023-10-06T02:20:51.823658+0000","last_became_peered":"2023-10-06T02:20:51.823658+0000","last_unstale":"2023-10-06T02:20:51.828752+0000","last_undegraded":"2023-10-06T02:20:51.828752+0000","last_fullsized":"2023-10-06T02:20:51.828752+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:36.288865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.807631+0000","last_change":"2023-10-06T02:20:50.818342+0000","last_active":"2023-10-06T02:20:51.807631+0000","last_peered":"2023-10-06T02:20:51.807631+0000","last_clean":"2023-10-06T02:20:51.807631+0000","last_became_active":"2023-10-06T02:20:50.818161+0000","last_became_peered":"2023-10-06T02:20:50.818161+0000","last_unstale":"2023-10-06T02:20:51.807631+0000","last_undegraded":"2023-10-06T02:20:51.807631+0000","last_fullsized":"2023-10-06T02:20:51.807631+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:45.187739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.810014+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:20:51.810014+0000","last_peered":"2023-10-06T02:20:51.810014+0000","last_clean":"2023-10-06T02:20:51.810014+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:20:51.810014+0000","last_undegraded":"2023-10-06T02:20:51.810014+0000","last_fullsized":"2023-10-06T02:20:51.810014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.831822+0000","last_change":"2023-10-06T02:20:51.827047+0000","last_active":"2023-10-06T02:20:51.831822+0000","last_peered":"2023-10-06T02:20:51.831822+0000","last_clean":"2023-10-06T02:20:51.831822+0000","last_became_active":"2023-10-06T02:20:51.826783+0000","last_became_peered":"2023-10-06T02:20:51.826783+0000","last_unstale":"2023-10-06T02:20:51.831822+0000","last_undegraded":"2023-10-06T02:20:51.831822+0000","last_fullsized":"2023-10-06T02:20:51.831822+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:28.423769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"65'2","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.833154+0000","last_change":"2023-10-06T02:20:50.817443+0000","last_active":"2023-10-06T02:20:51.833154+0000","last_peered":"2023-10-06T02:20:51.833154+0000","last_clean":"2023-10-06T02:20:51.833154+0000","last_became_active":"2023-10-06T02:20:50.817182+0000","last_became_peered":"2023-10-06T02:20:50.817182+0000","last_unstale":"2023-10-06T02:20:51.833154+0000","last_undegraded":"2023-10-06T02:20:51.833154+0000","last_fullsized":"2023-10-06T02:20:51.833154+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:57.783928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.810629+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:20:51.810629+0000","last_peered":"2023-10-06T02:20:51.810629+0000","last_clean":"2023-10-06T02:20:51.810629+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:20:51.810629+0000","last_undegraded":"2023-10-06T02:20:51.810629+0000","last_fullsized":"2023-10-06T02:20:51.810629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.822290+0000","last_change":"2023-10-06T02:20:51.817247+0000","last_active":"2023-10-06T02:20:51.822290+0000","last_peered":"2023-10-06T02:20:51.822290+0000","last_clean":"2023-10-06T02:20:51.822290+0000","last_became_active":"2023-10-06T02:20:51.816810+0000","last_became_peered":"2023-10-06T02:20:51.816810+0000","last_unstale":"2023-10-06T02:20:51.822290+0000","last_undegraded":"2023-10-06T02:20:51.822290+0000","last_fullsized":"2023-10-06T02:20:51.822290+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:04.234529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.817437+0000","last_change":"2023-10-06T02:20:50.814717+0000","last_active":"2023-10-06T02:20:51.817437+0000","last_peered":"2023-10-06T02:20:51.817437+0000","last_clean":"2023-10-06T02:20:51.817437+0000","last_became_active":"2023-10-06T02:20:50.814458+0000","last_became_peered":"2023-10-06T02:20:50.814458+0000","last_unstale":"2023-10-06T02:20:51.817437+0000","last_undegraded":"2023-10-06T02:20:51.817437+0000","last_fullsized":"2023-10-06T02:20:51.817437+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:34.978104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":52,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.807704+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:20:51.807704+0000","last_peered":"2023-10-06T02:20:51.807704+0000","last_clean":"2023-10-06T02:20:51.807704+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:20:51.807704+0000","last_undegraded":"2023-10-06T02:20:51.807704+0000","last_fullsized":"2023-10-06T02:20:51.807704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.828318+0000","last_change":"2023-10-06T02:20:51.823101+0000","last_active":"2023-10-06T02:20:51.828318+0000","last_peered":"2023-10-06T02:20:51.828318+0000","last_clean":"2023-10-06T02:20:51.828318+0000","last_became_active":"2023-10-06T02:20:51.822490+0000","last_became_peered":"2023-10-06T02:20:51.822490+0000","last_unstale":"2023-10-06T02:20:51.828318+0000","last_undegraded":"2023-10-06T02:20:51.828318+0000","last_fullsized":"2023-10-06T02:20:51.828318+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:50.167140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"65'1","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.832501+0000","last_change":"2023-10-06T02:20:50.816477+0000","last_active":"2023-10-06T02:20:51.832501+0000","last_peered":"2023-10-06T02:20:51.832501+0000","last_clean":"2023-10-06T02:20:51.832501+0000","last_became_active":"2023-10-06T02:20:50.813835+0000","last_became_peered":"2023-10-06T02:20:50.813835+0000","last_unstale":"2023-10-06T02:20:51.832501+0000","last_undegraded":"2023-10-06T02:20:51.832501+0000","last_fullsized":"2023-10-06T02:20:51.832501+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:23.603882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.817728+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:20:51.817728+0000","last_peered":"2023-10-06T02:20:51.817728+0000","last_clean":"2023-10-06T02:20:51.817728+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:20:51.817728+0000","last_undegraded":"2023-10-06T02:20:51.817728+0000","last_fullsized":"2023-10-06T02:20:51.817728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.834420+0000","last_change":"2023-10-06T02:20:51.832929+0000","last_active":"2023-10-06T02:20:51.834420+0000","last_peered":"2023-10-06T02:20:51.834420+0000","last_clean":"2023-10-06T02:20:51.834420+0000","last_became_active":"2023-10-06T02:20:51.832707+0000","last_became_peered":"2023-10-06T02:20:51.832707+0000","last_unstale":"2023-10-06T02:20:51.834420+0000","last_undegraded":"2023-10-06T02:20:51.834420+0000","last_fullsized":"2023-10-06T02:20:51.834420+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:50.791970+0000","last_clean_scrub_stamp":"2023-10-06T02:20:50.791970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:32.733850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.810242+0000","last_change":"2023-10-06T02:20:50.819383+0000","last_active":"2023-10-06T02:20:51.810242+0000","last_peered":"2023-10-06T02:20:51.810242+0000","last_clean":"2023-10-06T02:20:51.810242+0000","last_became_active":"2023-10-06T02:20:50.819113+0000","last_became_peered":"2023-10-06T02:20:50.819113+0000","last_unstale":"2023-10-06T02:20:51.810242+0000","last_undegraded":"2023-10-06T02:20:51.810242+0000","last_fullsized":"2023-10-06T02:20:51.810242+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:20:49.787044+0000","last_clean_scrub_stamp":"2023-10-06T02:20:49.787044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:35.120072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:20:51.817115+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:20:51.817115+0000","last_peered":"2023-10-06T02:20:51.817115+0000","last_clean":"2023-10-06T02:20:51.817115+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:20:51.817115+0000","last_undegraded":"2023-10-06T02:20:51.817115+0000","last_fullsized":"2023-10-06T02:20:51.817115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298656,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073184,"statfs":{"total":96636764160,"available":96330940416,"internally_reserved":0,"allocated":1400832,"data_stored":968066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.377,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":1.111,"15min":1.111},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.47999999999999998},"min":{"1min":0.30499999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80600000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.438}]},{"osd":1,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.35899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86299999999999999,"5min":1.008,"15min":1.008},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.505},"min":{"1min":0.36699999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70499999999999996,"5min":1.075,"15min":1.075},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82199999999999995,"5min":1.149,"15min":1.149},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.56699999999999995},"min":{"1min":0.49199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77400000000000002,"5min":1.048,"15min":1.048},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45900000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79200000000000004,"5min":1.175,"15min":1.175},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.56299999999999994},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83799999999999997,"5min":1.03,"15min":1.03},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.41599999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75800000000000001,"5min":0.873,"15min":0.873},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80300000000000005,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.39500000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.71199999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.502},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84799999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78600000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":376249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.76300000000000001,"15min":0.84699999999999998},"min":{"1min":0.44800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82399999999999995,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.76600000000000001,"15min":0.85899999999999999},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82799999999999996,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":0.74099999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.433,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.88800000000000001,"15min":1.04},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77700000000000002,"5min":8.8659999999999997,"15min":8.8659999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.35599999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.98499999999999999,"15min":1.157},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86799999999999999,"5min":10.659000000000001,"15min":10.659000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.36899999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70099999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54200000000000004,"15min":0.55300000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.70799999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.41299999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72199999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.754,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.38100000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.64200000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298664,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073176,"statfs":{"total":96636764160,"available":96330932224,"internally_reserved":0,"allocated":1409024,"data_stored":968649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.34300000000000003},"min":{"1min":0.23499999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.28100000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53100000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.34000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.32600000000000001,"15min":0.317},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.499,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.379,"15min":0.375},"min":{"1min":0.28999999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51900000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.32400000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.38300000000000001,"15min":0.37},"min":{"1min":0.312,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54500000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.38700000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.41599999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.68500000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.435},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.81499999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75800000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.73899999999999999,"5min":0.87,"15min":0.87},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83899999999999997,"5min":0.879,"15min":0.879},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79700000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":377110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.316,"15min":0.29999999999999999},"min":{"1min":0.246,"5min":0.216,"15min":0.216},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.34999999999999998,"15min":0.33400000000000002},"min":{"1min":0.27600000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.48799999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.42199999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.376,"15min":0.36299999999999999},"min":{"1min":0.28100000000000003,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.377},{"interface":"front","average":{"1min":0.376,"5min":0.33600000000000002,"15min":0.32200000000000001},"min":{"1min":0.25700000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.34799999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.377},"min":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.51600000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.41199999999999998,"15min":0.40300000000000002},"min":{"1min":0.27300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.498}]},{"osd":4,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":1.369,"15min":1.369},"last":0.629},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83799999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54600000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.42099999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77800000000000002,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79600000000000004,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61499999999999999,"15min":0.59299999999999997},"min":{"1min":0.495,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.96699999999999997,"15min":1.115},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79400000000000004,"5min":11.138,"15min":11.138},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84499999999999997,"5min":1.429,"15min":1.429},"last":0.76200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298076,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073764,"statfs":{"total":96636764160,"available":96331534336,"internally_reserved":0,"allocated":806912,"data_stored":377693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.23999999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.42799999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.254},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.376,"15min":0.36699999999999999},"min":{"1min":0.27800000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.46100000000000002,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.39700000000000002,"15min":0.377},"min":{"1min":0.255,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.44400000000000001,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.41399999999999998,"15min":0.39200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.45600000000000002,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.33000000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.379,"15min":0.36699999999999999},"min":{"1min":0.27100000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.44700000000000001,"5min":1.423,"15min":1.423},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.498,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.56899999999999995},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84099999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.76900000000000002,"5min":1.304,"15min":1.304},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.76000000000000001,"5min":0.875,"15min":0.875},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77400000000000002,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.629,"15min":0.622},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82799999999999996,"5min":1.347,"15min":1.347},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77100000000000002,"5min":1.206,"15min":1.206},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.45800000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89500000000000002,"5min":1.385,"15min":1.385},"last":0.59499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298076,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073764,"statfs":{"total":96636764160,"available":96331534336,"internally_reserved":0,"allocated":806912,"data_stored":377222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.35699999999999998,"15min":0.36199999999999999},"min":{"1min":0.22700000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.44700000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.373},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.25700000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.53200000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.36399999999999999,"15min":0.36599999999999999},"min":{"1min":0.23799999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48999999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.311},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39900000000000002,"15min":0.39700000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58499999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.29499999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.318,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51400000000000001,"5min":0.624,"15min":0.624},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.29399999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96599999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.42399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89300000000000002,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92300000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.69299999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59099999999999997,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91100000000000003,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.628,"15min":0.63},"min":{"1min":0.443,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96399999999999997,"5min":1.391,"15min":1.391},"last":0.72299999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:20:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61199999999999999,"15min":0.59999999999999998},"min":{"1min":0.47299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.81899999999999995,"5min":0.874,"15min":0.874},"last":0.65500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":377180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.34300000000000003,"5min":0.217,"15min":0.217},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59099999999999997,"15min":0.57999999999999996},"min":{"1min":0.45700000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78600000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":1.028,"15min":1.238},"min":{"1min":0.39900000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74399999999999999,"5min":17.879999999999999,"15min":17.879999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":1.024,"15min":1.2230000000000001},"min":{"1min":0.45900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.74099999999999999,"5min":18.010999999999999,"15min":18.010999999999999},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.51700000000000002},"min":{"1min":0.436,"5min":0.309,"15min":0.309},"max":{"1min":0.72499999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72699999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.54100000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.53600000000000003},"min":{"1min":0.434,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66600000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.373,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80300000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.371,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.32700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50600000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.36799999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.77400000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.40799999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82099999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":377200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.318,"5min":0.307,"15min":0.307},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.312}]},{"osd":1,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.441},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.59399999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.38200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.48899999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51200000000000001,"15min":0.51800000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.61099999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.503,"15min":0.504},"min":{"1min":0.34300000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69999999999999996,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.40999999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.52200000000000002},"min":{"1min":0.36899999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71399999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73799999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71099999999999997,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:21:00.872 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:21:00.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:21:01.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.031+0000 7f4c59b0f700 1 Processor -- start 2023-10-06T02:21:01.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.032+0000 7f4c59b0f700 1 -- start start 2023-10-06T02:21:01.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.032+0000 7f4c59b0f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4c54156280 0x7f4c540b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.032+0000 7f4c59b0f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4c54159eb0 0x7f4c5415a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.032+0000 7f4c59b0f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c54157db0 con 0x7f4c5415a890 2023-10-06T02:21:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.032+0000 7f4c59b0f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c540c9a10 con 0x7f4c54159eb0 2023-10-06T02:21:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.032+0000 7f4c59b0f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c540b1570 con 0x7f4c54156280 2023-10-06T02:21:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.033+0000 7f4c52ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4c54159eb0 0x7f4c5415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.033+0000 7f4c53fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4c5415a890 0x7f4c54158ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43558/0 (socket says 172.21.15.6:43558) 2023-10-06T02:21:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.033+0000 7f4c53fff700 1 -- 172.21.15.6:0/3295161796 learned_addr learned my addr 172.21.15.6:0/3295161796 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:21:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.033+0000 7f4c537fe700 1 --2- 172.21.15.6:0/3295161796 >> v2:172.21.15.175:3300/0 conn(0x7f4c54156280 0x7f4c540b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.033+0000 7f4c52ffd700 1 -- 172.21.15.6:0/3295161796 >> v2:172.21.15.175:3300/0 conn(0x7f4c54156280 msgr2=0x7f4c540b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.033+0000 7f4c52ffd700 1 --2- 172.21.15.6:0/3295161796 >> v2:172.21.15.175:3300/0 conn(0x7f4c54156280 0x7f4c540b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.033+0000 7f4c52ffd700 1 -- 172.21.15.6:0/3295161796 >> v1:172.21.15.6:6789/0 conn(0x7f4c5415a890 legacy=0x7f4c54158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:01.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.033+0000 7f4c52ffd700 1 -- 172.21.15.6:0/3295161796 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c54158000 con 0x7f4c54159eb0 2023-10-06T02:21:01.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.033+0000 7f4c527fc700 1 -- 172.21.15.6:0/3295161796 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525071346 0 0) 0x7f4c54157db0 con 0x7f4c5415a890 2023-10-06T02:21:01.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.033+0000 7f4c52ffd700 1 --2- 172.21.15.6:0/3295161796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c54159eb0 0x7f4c5415a350 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4c5406e860 tx=0x7f4c480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b3ee51d8f93ece server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.033+0000 7f4c527fc700 1 -- 172.21.15.6:0/3295161796 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c48011630 con 0x7f4c54159eb0 2023-10-06T02:21:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.033+0000 7f4c527fc700 1 -- 172.21.15.6:0/3295161796 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c48011790 con 0x7f4c54159eb0 2023-10-06T02:21:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.033+0000 7f4c527fc700 1 -- 172.21.15.6:0/3295161796 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c48011b30 con 0x7f4c54159eb0 2023-10-06T02:21:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.034+0000 7f4c59b0f700 1 -- 172.21.15.6:0/3295161796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c54159eb0 msgr2=0x7f4c5415a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.034+0000 7f4c59b0f700 1 --2- 172.21.15.6:0/3295161796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c54159eb0 0x7f4c5415a350 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4c5406e860 tx=0x7f4c480091a0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.034+0000 7f4c59b0f700 1 -- 172.21.15.6:0/3295161796 shutdown_connections 2023-10-06T02:21:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.034+0000 7f4c59b0f700 1 --2- 172.21.15.6:0/3295161796 >> v2:172.21.15.175:3300/0 conn(0x7f4c54156280 0x7f4c540b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.034+0000 7f4c59b0f700 1 --2- 172.21.15.6:0/3295161796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c54159eb0 0x7f4c5415a350 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.034+0000 7f4c59b0f700 1 -- 172.21.15.6:0/3295161796 >> 172.21.15.6:0/3295161796 conn(0x7f4c54086ff0 msgr2=0x7f4c540963c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.034+0000 7f4c59b0f700 1 -- 172.21.15.6:0/3295161796 shutdown_connections 2023-10-06T02:21:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.034+0000 7f4c59b0f700 1 -- 172.21.15.6:0/3295161796 wait complete. 2023-10-06T02:21:01.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.035+0000 7f4c59b0f700 1 Processor -- start 2023-10-06T02:21:01.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.035+0000 7f4c59b0f700 1 -- start start 2023-10-06T02:21:01.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c59b0f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c54156280 0x7f4c540a82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:01.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c59b0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c54159eb0 0x7f4c54153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:01.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c59b0f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c5415a890 0x7f4c54153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:01.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c59b0f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c540ac8d0 con 0x7f4c54159eb0 2023-10-06T02:21:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c59b0f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c54166360 con 0x7f4c5415a890 2023-10-06T02:21:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c59b0f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c54166640 con 0x7f4c54156280 2023-10-06T02:21:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c52ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c54159eb0 0x7f4c54153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c52ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c54159eb0 0x7f4c54153660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40900/0 (socket says 172.21.15.6:40900) 2023-10-06T02:21:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c52ffd700 1 -- 172.21.15.6:0/514721364 learned_addr learned my addr 172.21.15.6:0/514721364 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c537fe700 1 --2- 172.21.15.6:0/514721364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c54156280 0x7f4c540a82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c53fff700 1 --2- 172.21.15.6:0/514721364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c5415a890 0x7f4c54153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c52ffd700 1 -- 172.21.15.6:0/514721364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c54156280 msgr2=0x7f4c540a82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c52ffd700 1 --2- 172.21.15.6:0/514721364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c54156280 0x7f4c540a82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c52ffd700 1 -- 172.21.15.6:0/514721364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c5415a890 msgr2=0x7f4c54153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c52ffd700 1 --2- 172.21.15.6:0/514721364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c5415a890 0x7f4c54153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c52ffd700 1 -- 172.21.15.6:0/514721364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c48009420 con 0x7f4c54159eb0 2023-10-06T02:21:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c52ffd700 1 --2- 172.21.15.6:0/514721364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c54159eb0 0x7f4c54153660 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4c5406e790 tx=0x7f4c48017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.036+0000 7f4c3b7fe700 1 -- 172.21.15.6:0/514721364 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c48000d10 con 0x7f4c54159eb0 2023-10-06T02:21:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.037+0000 7f4c3b7fe700 1 -- 172.21.15.6:0/514721364 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c48011b10 con 0x7f4c54159eb0 2023-10-06T02:21:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.037+0000 7f4c3b7fe700 1 -- 172.21.15.6:0/514721364 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c48025640 con 0x7f4c54159eb0 2023-10-06T02:21:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.037+0000 7f4c59b0f700 1 -- 172.21.15.6:0/514721364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c540acae0 con 0x7f4c54159eb0 2023-10-06T02:21:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.037+0000 7f4c59b0f700 1 -- 172.21.15.6:0/514721364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c540a8ce0 con 0x7f4c54159eb0 2023-10-06T02:21:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.038+0000 7f4c59b0f700 1 -- 172.21.15.6:0/514721364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c540ad000 con 0x7f4c54159eb0 2023-10-06T02:21:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.038+0000 7f4c3b7fe700 1 -- 172.21.15.6:0/514721364 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c48025a30 con 0x7f4c54159eb0 2023-10-06T02:21:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.038+0000 7f4c3b7fe700 1 --2- 172.21.15.6:0/514721364 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c40066f30 0x7f4c400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.038+0000 7f4c3b7fe700 1 -- 172.21.15.6:0/514721364 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4c48085f90 con 0x7f4c54159eb0 2023-10-06T02:21:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.039+0000 7f4c537fe700 1 --2- 172.21.15.6:0/514721364 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c40066f30 0x7f4c400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.039+0000 7f4c537fe700 1 --2- 172.21.15.6:0/514721364 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c40066f30 0x7f4c400693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4c44009da0 tx=0x7f4c44009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:01.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.043+0000 7f4c3b7fe700 1 -- 172.21.15.6:0/514721364 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c480b75a0 con 0x7f4c54159eb0 2023-10-06T02:21:01.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.315+0000 7f4c59b0f700 1 -- 172.21.15.6:0/514721364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4c54166800 con 0x7f4c54159eb0 2023-10-06T02:21:01.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.318+0000 7f4c3b7fe700 1 -- 172.21.15.6:0/514721364 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4c540ad000 con 0x7f4c54159eb0 2023-10-06T02:21:01.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.320+0000 7f4c59b0f700 1 -- 172.21.15.6:0/514721364 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c40066f30 msgr2=0x7f4c400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:01.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.320+0000 7f4c59b0f700 1 --2- 172.21.15.6:0/514721364 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c40066f30 0x7f4c400693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4c44009da0 tx=0x7f4c44009120 comp rx=0 tx=0).stop 2023-10-06T02:21:01.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.320+0000 7f4c59b0f700 1 -- 172.21.15.6:0/514721364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c54159eb0 msgr2=0x7f4c54153660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:01.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.320+0000 7f4c59b0f700 1 --2- 172.21.15.6:0/514721364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c54159eb0 0x7f4c54153660 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4c5406e790 tx=0x7f4c48017000 comp rx=0 tx=0).stop 2023-10-06T02:21:01.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.320+0000 7f4c59b0f700 1 -- 172.21.15.6:0/514721364 shutdown_connections 2023-10-06T02:21:01.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.320+0000 7f4c59b0f700 1 --2- 172.21.15.6:0/514721364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c5415a890 0x7f4c54153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.320+0000 7f4c59b0f700 1 --2- 172.21.15.6:0/514721364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c54156280 0x7f4c540a82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.320+0000 7f4c59b0f700 1 --2- 172.21.15.6:0/514721364 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c40066f30 0x7f4c400693e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.320+0000 7f4c59b0f700 1 --2- 172.21.15.6:0/514721364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c54159eb0 0x7f4c54153660 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.320+0000 7f4c59b0f700 1 -- 172.21.15.6:0/514721364 >> 172.21.15.6:0/514721364 conn(0x7f4c54086ff0 msgr2=0x7f4c540cbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:01.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.320+0000 7f4c59b0f700 1 -- 172.21.15.6:0/514721364 shutdown_connections 2023-10-06T02:21:01.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.320+0000 7f4c59b0f700 1 -- 172.21.15.6:0/514721364 wait complete. 2023-10-06T02:21:01.322 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-10-06T02:21:01.333 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:21:01.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.451+0000 7f26cfae5700 1 Processor -- start 2023-10-06T02:21:01.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.452+0000 7f26cfae5700 1 -- start start 2023-10-06T02:21:01.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.452+0000 7f26cfae5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26c815b3c0 0x7f26c8097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:01.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.452+0000 7f26cfae5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f26c80b3c50 0x7f26c815b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:01.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.452+0000 7f26cfae5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26c815bcd0 0x7f26c815a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:01.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.452+0000 7f26cfae5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c80afb90 con 0x7f26c815b3c0 2023-10-06T02:21:01.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.452+0000 7f26cfae5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c80b2310 con 0x7f26c80b3c50 2023-10-06T02:21:01.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.452+0000 7f26cfae5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c80b25f0 con 0x7f26c815bcd0 2023-10-06T02:21:01.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.453+0000 7f26cd881700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26c815b3c0 0x7f26c8097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:01.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.453+0000 7f26cd881700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26c815b3c0 0x7f26c8097d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40910/0 (socket says 172.21.15.6:40910) 2023-10-06T02:21:01.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.453+0000 7f26cd881700 1 -- 172.21.15.6:0/2789686192 learned_addr learned my addr 172.21.15.6:0/2789686192 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:01.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.453+0000 7f26cd080700 1 --2- 172.21.15.6:0/2789686192 >> v2:172.21.15.175:3300/0 conn(0x7f26c80b3c50 0x7f26c815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:01.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.453+0000 7f26ce082700 1 --2- 172.21.15.6:0/2789686192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26c815bcd0 0x7f26c815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:01.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.453+0000 7f26cd881700 1 -- 172.21.15.6:0/2789686192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26c815bcd0 msgr2=0x7f26c815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:01.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.453+0000 7f26cd881700 1 --2- 172.21.15.6:0/2789686192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26c815bcd0 0x7f26c815a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.453+0000 7f26cd881700 1 -- 172.21.15.6:0/2789686192 >> v2:172.21.15.175:3300/0 conn(0x7f26c80b3c50 msgr2=0x7f26c815b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.453+0000 7f26cd881700 1 --2- 172.21.15.6:0/2789686192 >> v2:172.21.15.175:3300/0 conn(0x7f26c80b3c50 0x7f26c815b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.453+0000 7f26cd881700 1 -- 172.21.15.6:0/2789686192 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c80af820 con 0x7f26c815b3c0 2023-10-06T02:21:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.453+0000 7f26cd881700 1 --2- 172.21.15.6:0/2789686192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c815b3c0 0x7f26c8097d70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f26c806f9c0 tx=0x7f26bc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3c0d77c242bb91 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.453+0000 7f26cc87f700 1 -- 172.21.15.6:0/2789686192 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc005c10 con 0x7f26c815b3c0 2023-10-06T02:21:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.453+0000 7f26cc87f700 1 -- 172.21.15.6:0/2789686192 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc005d70 con 0x7f26c815b3c0 2023-10-06T02:21:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.453+0000 7f26cc87f700 1 -- 172.21.15.6:0/2789686192 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc006280 con 0x7f26c815b3c0 2023-10-06T02:21:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.454+0000 7f26cfae5700 1 -- 172.21.15.6:0/2789686192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c815b3c0 msgr2=0x7f26c8097d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.454+0000 7f26cfae5700 1 --2- 172.21.15.6:0/2789686192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c815b3c0 0x7f26c8097d70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f26c806f9c0 tx=0x7f26bc009220 comp rx=0 tx=0).stop 2023-10-06T02:21:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.454+0000 7f26cfae5700 1 -- 172.21.15.6:0/2789686192 shutdown_connections 2023-10-06T02:21:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.454+0000 7f26cfae5700 1 --2- 172.21.15.6:0/2789686192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26c815bcd0 0x7f26c815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.454+0000 7f26cfae5700 1 --2- 172.21.15.6:0/2789686192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c815b3c0 0x7f26c8097d70 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.454+0000 7f26cfae5700 1 --2- 172.21.15.6:0/2789686192 >> v2:172.21.15.175:3300/0 conn(0x7f26c80b3c50 0x7f26c815b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.454+0000 7f26cfae5700 1 -- 172.21.15.6:0/2789686192 >> 172.21.15.6:0/2789686192 conn(0x7f26c8067910 msgr2=0x7f26c80ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:01.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.454+0000 7f26cfae5700 1 -- 172.21.15.6:0/2789686192 shutdown_connections 2023-10-06T02:21:01.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.454+0000 7f26cfae5700 1 -- 172.21.15.6:0/2789686192 wait complete. 2023-10-06T02:21:01.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.455+0000 7f26cfae5700 1 Processor -- start 2023-10-06T02:21:01.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.455+0000 7f26cfae5700 1 -- start start 2023-10-06T02:21:01.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26cfae5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c80b3c50 0x7f26c8099dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:01.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26cfae5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26c815b3c0 0x7f26c8154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:01.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26cfae5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26c815bcd0 0x7f26c80abe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:01.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26cfae5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c809b220 con 0x7f26c80b3c50 2023-10-06T02:21:01.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26cfae5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c809b6b0 con 0x7f26c815bcd0 2023-10-06T02:21:01.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26cfae5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c809a610 con 0x7f26c815b3c0 2023-10-06T02:21:01.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26cd881700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c80b3c50 0x7f26c8099dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:01.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26cd881700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c80b3c50 0x7f26c8099dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40920/0 (socket says 172.21.15.6:40920) 2023-10-06T02:21:01.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26cd881700 1 -- 172.21.15.6:0/2948800213 learned_addr learned my addr 172.21.15.6:0/2948800213 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:01.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26ce082700 1 --2- 172.21.15.6:0/2948800213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26c815bcd0 0x7f26c80abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:01.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26cd080700 1 --2- 172.21.15.6:0/2948800213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26c815b3c0 0x7f26c8154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:01.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26cd881700 1 -- 172.21.15.6:0/2948800213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26c815b3c0 msgr2=0x7f26c8154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:01.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26cd881700 1 --2- 172.21.15.6:0/2948800213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26c815b3c0 0x7f26c8154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26cd881700 1 -- 172.21.15.6:0/2948800213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26c815bcd0 msgr2=0x7f26c80abe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:01.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26cd881700 1 --2- 172.21.15.6:0/2948800213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26c815bcd0 0x7f26c80abe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26cd881700 1 -- 172.21.15.6:0/2948800213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc009480 con 0x7f26c80b3c50 2023-10-06T02:21:01.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26ce082700 1 --2- 172.21.15.6:0/2948800213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26c815bcd0 0x7f26c80abe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:01.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26cd881700 1 --2- 172.21.15.6:0/2948800213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c80b3c50 0x7f26c8099dc0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f26c806f4d0 tx=0x7f26bc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:01.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.456+0000 7f26b9ffb700 1 -- 172.21.15.6:0/2948800213 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc006280 con 0x7f26c80b3c50 2023-10-06T02:21:01.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.457+0000 7f26b9ffb700 1 -- 172.21.15.6:0/2948800213 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc006ba0 con 0x7f26c80b3c50 2023-10-06T02:21:01.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.457+0000 7f26cfae5700 1 -- 172.21.15.6:0/2948800213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c809a8f0 con 0x7f26c80b3c50 2023-10-06T02:21:01.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.457+0000 7f26b9ffb700 1 -- 172.21.15.6:0/2948800213 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc0256b0 con 0x7f26c80b3c50 2023-10-06T02:21:01.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.457+0000 7f26cfae5700 1 -- 172.21.15.6:0/2948800213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c809aeb0 con 0x7f26c80b3c50 2023-10-06T02:21:01.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.458+0000 7f26cfae5700 1 -- 172.21.15.6:0/2948800213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c809b500 con 0x7f26c80b3c50 2023-10-06T02:21:01.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.458+0000 7f26b9ffb700 1 -- 172.21.15.6:0/2948800213 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26bc02e440 con 0x7f26c80b3c50 2023-10-06T02:21:01.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.458+0000 7f26b9ffb700 1 --2- 172.21.15.6:0/2948800213 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f26ac066f30 0x7f26ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:01.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.458+0000 7f26b9ffb700 1 -- 172.21.15.6:0/2948800213 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f26bc085f30 con 0x7f26c80b3c50 2023-10-06T02:21:01.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.459+0000 7f26cd080700 1 --2- 172.21.15.6:0/2948800213 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f26ac066f30 0x7f26ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:01.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.459+0000 7f26cd080700 1 --2- 172.21.15.6:0/2948800213 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f26ac066f30 0x7f26ac0693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f26c8157b90 tx=0x7f26c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:01.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.463+0000 7f26b9ffb700 1 -- 172.21.15.6:0/2948800213 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26bc052e60 con 0x7f26c80b3c50 2023-10-06T02:21:01.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.699+0000 7f26cfae5700 1 -- 172.21.15.6:0/2948800213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26c806e8d0 con 0x7f26c80b3c50 2023-10-06T02:21:01.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.699+0000 7f26b9ffb700 1 -- 172.21.15.6:0/2948800213 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f26bc056480 con 0x7f26c80b3c50 2023-10-06T02:21:01.700 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:21:01.700 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":49,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1006897436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1006897436},{"type":"v1","addr":"172.21.15.6:6835","nonce":1006897436}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3777949337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3777949337},{"type":"v1","addr":"172.21.15.6:6834","nonce":3777949337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:51.206714+0000","modified":"2023-10-06T02:20:54.822293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6222":{"gid":6222,"name":"b","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1125020360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1125020360},{"type":"v1","addr":"172.21.15.175:6837","nonce":1125020360}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:21:01.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.701+0000 7f26cfae5700 1 -- 172.21.15.6:0/2948800213 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f26ac066f30 msgr2=0x7f26ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:01.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.701+0000 7f26cfae5700 1 --2- 172.21.15.6:0/2948800213 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f26ac066f30 0x7f26ac0693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f26c8157b90 tx=0x7f26c4008040 comp rx=0 tx=0).stop 2023-10-06T02:21:01.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.701+0000 7f26cfae5700 1 -- 172.21.15.6:0/2948800213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c80b3c50 msgr2=0x7f26c8099dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:01.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.701+0000 7f26cfae5700 1 --2- 172.21.15.6:0/2948800213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c80b3c50 0x7f26c8099dc0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f26c806f4d0 tx=0x7f26bc016000 comp rx=0 tx=0).stop 2023-10-06T02:21:01.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.701+0000 7f26cfae5700 1 -- 172.21.15.6:0/2948800213 shutdown_connections 2023-10-06T02:21:01.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.701+0000 7f26cfae5700 1 --2- 172.21.15.6:0/2948800213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26c815bcd0 0x7f26c80abe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.701+0000 7f26cfae5700 1 --2- 172.21.15.6:0/2948800213 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f26ac066f30 0x7f26ac0693e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.701+0000 7f26cfae5700 1 --2- 172.21.15.6:0/2948800213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c80b3c50 0x7f26c8099dc0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.701+0000 7f26cfae5700 1 --2- 172.21.15.6:0/2948800213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26c815b3c0 0x7f26c8154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:01.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.701+0000 7f26cfae5700 1 -- 172.21.15.6:0/2948800213 >> 172.21.15.6:0/2948800213 conn(0x7f26c8067910 msgr2=0x7f26c81586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:01.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.701+0000 7f26cfae5700 1 -- 172.21.15.6:0/2948800213 shutdown_connections 2023-10-06T02:21:01.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:01.701+0000 7f26cfae5700 1 -- 172.21.15.6:0/2948800213 wait complete. 2023-10-06T02:21:01.704 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 49 2023-10-06T02:21:02.116 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:20:51.206714+0000', 'modified': '2023-10-06T02:20:54.822293+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6222}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6222': {'gid': 6222, 'name': 'b', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6837/1125020360', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6835', 'nonce': 1125020360}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 1125020360}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:21:02.117 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:21:02.117 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T02:21:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.240+0000 7f60ed227700 1 Processor -- start 2023-10-06T02:21:02.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.240+0000 7f60ed227700 1 -- start start 2023-10-06T02:21:02.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.241+0000 7f60ed227700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e815a030 0x7f60e815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.241+0000 7f60ed227700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f60e815a940 0x7f60e8086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.241+0000 7f60ed227700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f60e8087530 0x7f60e80b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.241+0000 7f60ed227700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e80b0cf0 con 0x7f60e8087530 2023-10-06T02:21:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.241+0000 7f60ed227700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e8087960 con 0x7f60e815a940 2023-10-06T02:21:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.241+0000 7f60ed227700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80afc50 con 0x7f60e815a030 2023-10-06T02:21:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.241+0000 7f60e759e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f60e8087530 0x7f60e80b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.241+0000 7f60e759e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f60e8087530 0x7f60e80b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40924/0 (socket says 172.21.15.6:40924) 2023-10-06T02:21:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.241+0000 7f60e759e700 1 -- 172.21.15.6:0/324780265 learned_addr learned my addr 172.21.15.6:0/324780265 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.241+0000 7f60e659c700 1 --2- 172.21.15.6:0/324780265 >> v2:172.21.15.175:3300/0 conn(0x7f60e815a940 0x7f60e8086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.241+0000 7f60e759e700 1 -- 172.21.15.6:0/324780265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e815a030 msgr2=0x7f60e815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.241+0000 7f60e6d9d700 1 --2- 172.21.15.6:0/324780265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e815a030 0x7f60e815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.241+0000 7f60e759e700 1 --2- 172.21.15.6:0/324780265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e815a030 0x7f60e815a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.241+0000 7f60e759e700 1 -- 172.21.15.6:0/324780265 >> v2:172.21.15.175:3300/0 conn(0x7f60e815a940 msgr2=0x7f60e8086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.242+0000 7f60e759e700 1 --2- 172.21.15.6:0/324780265 >> v2:172.21.15.175:3300/0 conn(0x7f60e815a940 0x7f60e8086ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.242+0000 7f60e759e700 1 -- 172.21.15.6:0/324780265 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e80aff30 con 0x7f60e8087530 2023-10-06T02:21:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.242+0000 7f60e659c700 1 --2- 172.21.15.6:0/324780265 >> v2:172.21.15.175:3300/0 conn(0x7f60e815a940 0x7f60e8086ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:21:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.242+0000 7f60e759e700 1 --2- 172.21.15.6:0/324780265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e8087530 0x7f60e80b21b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f60e8089180 tx=0x7f60d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee171a7e253fe8c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.242+0000 7f60e5d9b700 1 -- 172.21.15.6:0/324780265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d800e070 con 0x7f60e8087530 2023-10-06T02:21:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.242+0000 7f60e5d9b700 1 -- 172.21.15.6:0/324780265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d800ba50 con 0x7f60e8087530 2023-10-06T02:21:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.242+0000 7f60e5d9b700 1 -- 172.21.15.6:0/324780265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d80092e0 con 0x7f60e8087530 2023-10-06T02:21:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.242+0000 7f60ed227700 1 -- 172.21.15.6:0/324780265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e8087530 msgr2=0x7f60e80b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.242+0000 7f60ed227700 1 --2- 172.21.15.6:0/324780265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e8087530 0x7f60e80b21b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f60e8089180 tx=0x7f60d8009840 comp rx=0 tx=0).stop 2023-10-06T02:21:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.242+0000 7f60ed227700 1 -- 172.21.15.6:0/324780265 shutdown_connections 2023-10-06T02:21:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.242+0000 7f60ed227700 1 --2- 172.21.15.6:0/324780265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e8087530 0x7f60e80b21b0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.242+0000 7f60ed227700 1 --2- 172.21.15.6:0/324780265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e815a030 0x7f60e815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.242+0000 7f60ed227700 1 --2- 172.21.15.6:0/324780265 >> v2:172.21.15.175:3300/0 conn(0x7f60e815a940 0x7f60e8086ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.242+0000 7f60ed227700 1 -- 172.21.15.6:0/324780265 >> 172.21.15.6:0/324780265 conn(0x7f60e8068680 msgr2=0x7f60e8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.242+0000 7f60ed227700 1 -- 172.21.15.6:0/324780265 shutdown_connections 2023-10-06T02:21:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.242+0000 7f60ed227700 1 -- 172.21.15.6:0/324780265 wait complete. 2023-10-06T02:21:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.244+0000 7f60ed227700 1 Processor -- start 2023-10-06T02:21:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.244+0000 7f60ed227700 1 -- start start 2023-10-06T02:21:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.244+0000 7f60ed227700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60e8087530 0x7f60e8155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.244+0000 7f60ed227700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e815a030 0x7f60e80c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.244+0000 7f60ed227700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e815a940 0x7f60e80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.244+0000 7f60ed227700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80c79f0 con 0x7f60e815a030 2023-10-06T02:21:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.244+0000 7f60ed227700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80c5190 con 0x7f60e8087530 2023-10-06T02:21:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.244+0000 7f60ed227700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80c4610 con 0x7f60e815a940 2023-10-06T02:21:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.245+0000 7f60e659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e815a030 0x7f60e80c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.245+0000 7f60e659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e815a030 0x7f60e80c3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40934/0 (socket says 172.21.15.6:40934) 2023-10-06T02:21:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.245+0000 7f60e659c700 1 -- 172.21.15.6:0/2099090920 learned_addr learned my addr 172.21.15.6:0/2099090920 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.245+0000 7f60e6d9d700 1 --2- 172.21.15.6:0/2099090920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60e8087530 0x7f60e8155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.245+0000 7f60e759e700 1 --2- 172.21.15.6:0/2099090920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e815a940 0x7f60e80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.245+0000 7f60e659c700 1 -- 172.21.15.6:0/2099090920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e815a940 msgr2=0x7f60e80b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.245+0000 7f60e659c700 1 --2- 172.21.15.6:0/2099090920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e815a940 0x7f60e80b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.245+0000 7f60e659c700 1 -- 172.21.15.6:0/2099090920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60e8087530 msgr2=0x7f60e8155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.245+0000 7f60e659c700 1 --2- 172.21.15.6:0/2099090920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60e8087530 0x7f60e8155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.245+0000 7f60e659c700 1 -- 172.21.15.6:0/2099090920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d8009ae0 con 0x7f60e815a030 2023-10-06T02:21:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.245+0000 7f60e759e700 1 --2- 172.21.15.6:0/2099090920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e815a940 0x7f60e80b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.245+0000 7f60e659c700 1 --2- 172.21.15.6:0/2099090920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e815a030 0x7f60e80c3bc0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c800 tx=0x7f60d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.245+0000 7f60deffd700 1 -- 172.21.15.6:0/2099090920 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0011600 con 0x7f60e815a030 2023-10-06T02:21:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.245+0000 7f60deffd700 1 -- 172.21.15.6:0/2099090920 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d0011760 con 0x7f60e815a030 2023-10-06T02:21:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.245+0000 7f60deffd700 1 -- 172.21.15.6:0/2099090920 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0011ae0 con 0x7f60e815a030 2023-10-06T02:21:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.245+0000 7f60ed227700 1 -- 172.21.15.6:0/2099090920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e80c48f0 con 0x7f60e815a030 2023-10-06T02:21:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.245+0000 7f60ed227700 1 -- 172.21.15.6:0/2099090920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e80c4eb0 con 0x7f60e815a030 2023-10-06T02:21:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.247+0000 7f60deffd700 1 -- 172.21.15.6:0/2099090920 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60d0021350 con 0x7f60e815a030 2023-10-06T02:21:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.247+0000 7f60deffd700 1 --2- 172.21.15.6:0/2099090920 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60c8066f30 0x7f60c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.247+0000 7f60deffd700 1 -- 172.21.15.6:0/2099090920 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f60d0084640 con 0x7f60e815a030 2023-10-06T02:21:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.247+0000 7f60e6d9d700 1 --2- 172.21.15.6:0/2099090920 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60c8066f30 0x7f60c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.248+0000 7f60e6d9d700 1 --2- 172.21.15.6:0/2099090920 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60c8066f30 0x7f60c80693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f60e000acb0 tx=0x7f60e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.249+0000 7f60f651fb80 1 Processor -- start 2023-10-06T02:21:02.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.249+0000 7f60f651fb80 1 -- start start 2023-10-06T02:21:02.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60f651fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fda94840 0x5633fda94c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60f651fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fda95cc0 0x5633fdae46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60f651fb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fdae4c00 0x5633fdae5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60f651fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633fd9eba70 con 0x5633fda95cc0 2023-10-06T02:21:02.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60f651fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633fd9e9270 con 0x5633fda94840 2023-10-06T02:21:02.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60f651fb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633fd9e5060 con 0x5633fdae4c00 2023-10-06T02:21:02.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60e659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fda95cc0 0x5633fdae46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60e659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fda95cc0 0x5633fdae46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40944/0 (socket says 172.21.15.6:40944) 2023-10-06T02:21:02.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60e659c700 1 -- 172.21.15.6:0/1049523597 learned_addr learned my addr 172.21.15.6:0/1049523597 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:02.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60e759e700 1 --2- 172.21.15.6:0/1049523597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fdae4c00 0x5633fdae5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60e6d9d700 1 --2- 172.21.15.6:0/1049523597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fda94840 0x5633fda94c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60e659c700 1 -- 172.21.15.6:0/1049523597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fdae4c00 msgr2=0x5633fdae5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:02.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60e659c700 1 --2- 172.21.15.6:0/1049523597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fdae4c00 0x5633fdae5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60e659c700 1 -- 172.21.15.6:0/1049523597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fda94840 msgr2=0x5633fda94c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:02.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60e659c700 1 --2- 172.21.15.6:0/1049523597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fda94840 0x5633fda94c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60e659c700 1 -- 172.21.15.6:0/1049523597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633fd87f270 con 0x5633fda95cc0 2023-10-06T02:21:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60e759e700 1 --2- 172.21.15.6:0/1049523597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fdae4c00 0x5633fdae5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:21:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60e6d9d700 1 --2- 172.21.15.6:0/1049523597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fda94840 0x5633fda94c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:21:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.250+0000 7f60e659c700 1 --2- 172.21.15.6:0/1049523597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fda95cc0 0x5633fdae46c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f60d0082950 tx=0x7f60d0082820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655bc485c218cf4d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.251+0000 7f60c7fff700 1 -- 172.21.15.6:0/1049523597 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0054e10 con 0x5633fda95cc0 2023-10-06T02:21:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.251+0000 7f60c7fff700 1 -- 172.21.15.6:0/1049523597 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d0058520 con 0x5633fda95cc0 2023-10-06T02:21:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.251+0000 7f60c7fff700 1 -- 172.21.15.6:0/1049523597 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d005c270 con 0x5633fda95cc0 2023-10-06T02:21:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.251+0000 7f60f651fb80 1 -- 172.21.15.6:0/1049523597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fda95cc0 msgr2=0x5633fdae46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.251+0000 7f60f651fb80 1 --2- 172.21.15.6:0/1049523597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fda95cc0 0x5633fdae46c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f60d0082950 tx=0x7f60d0082820 comp rx=0 tx=0).stop 2023-10-06T02:21:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.251+0000 7f60f651fb80 1 -- 172.21.15.6:0/1049523597 shutdown_connections 2023-10-06T02:21:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.251+0000 7f60f651fb80 1 --2- 172.21.15.6:0/1049523597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fdae4c00 0x5633fdae5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.251+0000 7f60f651fb80 1 --2- 172.21.15.6:0/1049523597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fda94840 0x5633fda94c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.251+0000 7f60f651fb80 1 --2- 172.21.15.6:0/1049523597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fda95cc0 0x5633fdae46c0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.251+0000 7f60f651fb80 1 -- 172.21.15.6:0/1049523597 >> 172.21.15.6:0/1049523597 conn(0x5633fda96160 msgr2=0x5633fda96530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.251+0000 7f60f651fb80 1 -- 172.21.15.6:0/1049523597 shutdown_connections 2023-10-06T02:21:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.251+0000 7f60f651fb80 1 -- 172.21.15.6:0/1049523597 wait complete. 2023-10-06T02:21:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.252+0000 7f60f651fb80 1 -- start start 2023-10-06T02:21:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.252+0000 7f60f651fb80 1 Processor -- start 2023-10-06T02:21:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.253+0000 7f60f651fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fda94840 0x5633fdaeb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.253+0000 7f60f651fb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fda95cc0 0x5633fda8fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.253+0000 7f60f651fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fdae4c00 0x5633fda8ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.253+0000 7f60f651fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633fd990890 con 0x5633fdae4c00 2023-10-06T02:21:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.253+0000 7f60f651fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633fd9abea0 con 0x5633fda94840 2023-10-06T02:21:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.253+0000 7f60f651fb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633fd867e30 con 0x5633fda95cc0 2023-10-06T02:21:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.253+0000 7f60f651fb80 10 client.0 _ll_register_callbacks cb 0x5633fda57e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:21:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.253+0000 7f60e759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fdae4c00 0x5633fda8ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.253+0000 7f60e759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fdae4c00 0x5633fda8ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40948/0 (socket says 172.21.15.6:40948) 2023-10-06T02:21:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.253+0000 7f60e759e700 1 -- 172.21.15.6:0/2424172487 learned_addr learned my addr 172.21.15.6:0/2424172487 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.253+0000 7f60e6d9d700 1 --2- 172.21.15.6:0/2424172487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fda94840 0x5633fdaeb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.253+0000 7f60e659c700 1 --2- 172.21.15.6:0/2424172487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fda95cc0 0x5633fda8fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60e759e700 1 -- 172.21.15.6:0/2424172487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fda95cc0 msgr2=0x5633fda8fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60e759e700 1 --2- 172.21.15.6:0/2424172487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fda95cc0 0x5633fda8fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60e759e700 1 -- 172.21.15.6:0/2424172487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fda94840 msgr2=0x5633fdaeb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60e759e700 1 --2- 172.21.15.6:0/2424172487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fda94840 0x5633fdaeb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60e759e700 1 -- 172.21.15.6:0/2424172487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e80c4eb0 con 0x5633fdae4c00 2023-10-06T02:21:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60e659c700 1 --2- 172.21.15.6:0/2424172487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fda95cc0 0x5633fda8fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60e759e700 1 --2- 172.21.15.6:0/2424172487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fdae4c00 0x5633fda8ff90 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f60e80891b0 tx=0x7f60d8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d77f8aa2927961 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:21:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60c57fa700 1 -- 172.21.15.6:0/2424172487 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d80092e0 con 0x5633fdae4c00 2023-10-06T02:21:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60c57fa700 1 -- 172.21.15.6:0/2424172487 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f60d8029dd0 con 0x5633fdae4c00 2023-10-06T02:21:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60f651fb80 1 -- 172.21.15.6:0/2424172487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633fda89940 con 0x5633fdae4c00 2023-10-06T02:21:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60c57fa700 1 -- 172.21.15.6:0/2424172487 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60d801f440 con 0x5633fdae4c00 2023-10-06T02:21:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60f651fb80 10 client.6390 fetch_fsmap learned FSMap version 49 2023-10-06T02:21:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60f651fb80 1 -- 172.21.15.6:0/2424172487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x5633fd821fe0 con 0x5633fdae4c00 2023-10-06T02:21:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60c57fa700 1 -- 172.21.15.6:0/2424172487 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5633fda89940 con 0x5633fdae4c00 2023-10-06T02:21:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60c57fa700 1 -- 172.21.15.6:0/2424172487 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f60d800b050 con 0x5633fdae4c00 2023-10-06T02:21:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60f651fb80 10 client.6390 fetch_fsmap finished waiting for FSMap version 49 2023-10-06T02:21:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60f651fb80 10 client.6390 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T02:21:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60f651fb80 20 client.6390 populate_metadata read hostname 'smithi006' 2023-10-06T02:21:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60f651fb80 1 --2- 172.21.15.6:0/2424172487 >> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] conn(0x5633fdae1870 0x5633fdaedac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60f651fb80 4 client.6390 mds_command: new command op to 6222 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:21:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.254+0000 7f60f651fb80 1 -- 172.21.15.6:0/2424172487 --> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5633fda66870 con 0x5633fdae1870 2023-10-06T02:21:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.255+0000 7f60e6d9d700 1 --2- 172.21.15.6:0/2424172487 >> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] conn(0x5633fdae1870 0x5633fdaedac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.255+0000 7f60e6d9d700 1 --2- 172.21.15.6:0/2424172487 >> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] conn(0x5633fdae1870 0x5633fdaedac0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fac1289953d1dd server_cookie=20ac3af613f591ec in_seq=0 out_seq=0 2023-10-06T02:21:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.255+0000 7f60c57fa700 10 client.6390 ms_handle_connect on v2:172.21.15.175:6835/1125020360 2023-10-06T02:21:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.256+0000 7f60c57fa700 1 -- 172.21.15.6:0/2424172487 <== mds.0 v2:172.21.15.175:6835/1125020360 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5633fda66870 con 0x5633fdae1870 2023-10-06T02:21:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.256+0000 7f60c57fa700 10 client.6390 handle_command_reply: tid=0 2023-10-06T02:21:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.256+0000 7f60f651fb80 1 client.6390 shutdown 2023-10-06T02:21:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.256+0000 7f60f651fb80 1 -- 172.21.15.6:0/2424172487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fdae4c00 msgr2=0x5633fda8ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.256+0000 7f60f651fb80 1 --2- 172.21.15.6:0/2424172487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fdae4c00 0x5633fda8ff90 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f60e80891b0 tx=0x7f60d8018000 comp rx=0 tx=0).stop 2023-10-06T02:21:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.256+0000 7f60f651fb80 1 -- 172.21.15.6:0/2424172487 shutdown_connections 2023-10-06T02:21:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.256+0000 7f60f651fb80 1 --2- 172.21.15.6:0/2424172487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fdae4c00 0x5633fda8ff90 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.256+0000 7f60f651fb80 1 --2- 172.21.15.6:0/2424172487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fda94840 0x5633fdaeb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.256+0000 7f60f651fb80 1 --2- 172.21.15.6:0/2424172487 >> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] conn(0x5633fdae1870 0x5633fdaedac0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.256+0000 7f60f651fb80 1 --2- 172.21.15.6:0/2424172487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fda95cc0 0x5633fda8fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.256+0000 7f60c57fa700 0 client.6390 ms_handle_reset on v2:172.21.15.175:6835/1125020360 2023-10-06T02:21:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.256+0000 7f60f651fb80 1 -- 172.21.15.6:0/2424172487 >> 172.21.15.6:0/2424172487 conn(0x5633fda96160 msgr2=0x5633fdad81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.256+0000 7f60f651fb80 1 -- 172.21.15.6:0/2424172487 shutdown_connections 2023-10-06T02:21:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.256+0000 7f60f651fb80 1 -- 172.21.15.6:0/2424172487 wait complete. 2023-10-06T02:21:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.256+0000 7f60f651fb80 20 client.6390 trim_cache size 0 max 16384 2023-10-06T02:21:02.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.273+0000 7f60f651fb80 1 Processor -- start 2023-10-06T02:21:02.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.273+0000 7f60f651fb80 1 -- start start 2023-10-06T02:21:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60f651fb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fda94840 0x5633fdaeb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60f651fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fda95cc0 0x5633fdaeb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60f651fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fdae4c00 0x5633fdaea650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60f651fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633fdafd670 con 0x5633fda95cc0 2023-10-06T02:21:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60f651fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633fdae1170 con 0x5633fdae4c00 2023-10-06T02:21:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60f651fb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633fda981f0 con 0x5633fda94840 2023-10-06T02:21:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60e659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fda95cc0 0x5633fdaeb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60e659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fda95cc0 0x5633fdaeb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40954/0 (socket says 172.21.15.6:40954) 2023-10-06T02:21:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60e659c700 1 -- 172.21.15.6:0/3258796757 learned_addr learned my addr 172.21.15.6:0/3258796757 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60e659c700 1 -- 172.21.15.6:0/3258796757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fda94840 msgr2=0x5633fdaeb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60e659c700 1 --2- 172.21.15.6:0/3258796757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fda94840 0x5633fdaeb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60e659c700 1 -- 172.21.15.6:0/3258796757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fdae4c00 msgr2=0x5633fdaea650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60e659c700 1 --2- 172.21.15.6:0/3258796757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fdae4c00 0x5633fdaea650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60e659c700 1 -- 172.21.15.6:0/3258796757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633fd9b3780 con 0x5633fda95cc0 2023-10-06T02:21:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60e659c700 1 --2- 172.21.15.6:0/3258796757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fda95cc0 0x5633fdaeb810 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f60d00829a0 tx=0x7f60d006c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266edac8d600822d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60dcff9700 1 -- 172.21.15.6:0/3258796757 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d005c270 con 0x5633fda95cc0 2023-10-06T02:21:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60dcff9700 1 -- 172.21.15.6:0/3258796757 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d0053410 con 0x5633fda95cc0 2023-10-06T02:21:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.274+0000 7f60dcff9700 1 -- 172.21.15.6:0/3258796757 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d00549d0 con 0x5633fda95cc0 2023-10-06T02:21:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.275+0000 7f60f651fb80 1 -- 172.21.15.6:0/3258796757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fda95cc0 msgr2=0x5633fdaeb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.275+0000 7f60f651fb80 1 --2- 172.21.15.6:0/3258796757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fda95cc0 0x5633fdaeb810 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f60d00829a0 tx=0x7f60d006c000 comp rx=0 tx=0).stop 2023-10-06T02:21:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.275+0000 7f60f651fb80 1 -- 172.21.15.6:0/3258796757 shutdown_connections 2023-10-06T02:21:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.275+0000 7f60f651fb80 1 --2- 172.21.15.6:0/3258796757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fdae4c00 0x5633fdaea650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.275+0000 7f60f651fb80 1 --2- 172.21.15.6:0/3258796757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fda94840 0x5633fdaeb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.275+0000 7f60f651fb80 1 --2- 172.21.15.6:0/3258796757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fda95cc0 0x5633fdaeb810 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.275+0000 7f60f651fb80 1 -- 172.21.15.6:0/3258796757 >> 172.21.15.6:0/3258796757 conn(0x5633fda96160 msgr2=0x5633fdae04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:02.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.275+0000 7f60f651fb80 1 -- 172.21.15.6:0/3258796757 shutdown_connections 2023-10-06T02:21:02.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.275+0000 7f60f651fb80 1 -- 172.21.15.6:0/3258796757 wait complete. 2023-10-06T02:21:02.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.275+0000 7f60f651fb80 1 -- start start 2023-10-06T02:21:02.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.275+0000 7f60f651fb80 1 Processor -- start 2023-10-06T02:21:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.276+0000 7f60f651fb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fda94840 0x5633fdb3d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.276+0000 7f60f651fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fda95cc0 0x5633fdabbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.276+0000 7f60f651fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fdae4c00 0x5633fdabc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.276+0000 7f60f651fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633fdb437c0 con 0x5633fdae4c00 2023-10-06T02:21:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.276+0000 7f60f651fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633fdaba7a0 con 0x5633fda95cc0 2023-10-06T02:21:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.276+0000 7f60f651fb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633fdad8190 con 0x5633fda94840 2023-10-06T02:21:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.276+0000 7f60f651fb80 10 client.0 _ll_register_callbacks cb 0x5633fda57e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:21:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.276+0000 7f60e759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fdae4c00 0x5633fdabc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.276+0000 7f60e759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fdae4c00 0x5633fdabc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40964/0 (socket says 172.21.15.6:40964) 2023-10-06T02:21:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.276+0000 7f60e759e700 1 -- 172.21.15.6:0/2592087005 learned_addr learned my addr 172.21.15.6:0/2592087005 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60e659c700 1 --2- 172.21.15.6:0/2592087005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fda95cc0 0x5633fdabbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60e6d9d700 1 --2- 172.21.15.6:0/2592087005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fda94840 0x5633fdb3d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60e759e700 1 -- 172.21.15.6:0/2592087005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fda94840 msgr2=0x5633fdb3d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60e759e700 1 --2- 172.21.15.6:0/2592087005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fda94840 0x5633fdb3d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60e759e700 1 -- 172.21.15.6:0/2592087005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fda95cc0 msgr2=0x5633fdabbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60e759e700 1 --2- 172.21.15.6:0/2592087005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fda95cc0 0x5633fdabbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60e759e700 1 -- 172.21.15.6:0/2592087005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d006f040 con 0x5633fdae4c00 2023-10-06T02:21:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60e659c700 1 --2- 172.21.15.6:0/2592087005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fda95cc0 0x5633fdabbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:21:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60e759e700 1 --2- 172.21.15.6:0/2592087005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fdae4c00 0x5633fdabc530 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009880 tx=0x7f60d8021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23f9feb953c809a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:21:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60c57fa700 1 -- 172.21.15.6:0/2592087005 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d800b190 con 0x5633fdae4c00 2023-10-06T02:21:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60c57fa700 1 -- 172.21.15.6:0/2592087005 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f60d80090d0 con 0x5633fdae4c00 2023-10-06T02:21:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60f651fb80 1 -- 172.21.15.6:0/2592087005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f60d0058520 con 0x5633fdae4c00 2023-10-06T02:21:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60c57fa700 1 -- 172.21.15.6:0/2592087005 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60d801fb80 con 0x5633fdae4c00 2023-10-06T02:21:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60f651fb80 10 client.6396 fetch_fsmap learned FSMap version 49 2023-10-06T02:21:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60f651fb80 1 -- 172.21.15.6:0/2592087005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x5633fd99a470 con 0x5633fdae4c00 2023-10-06T02:21:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60c57fa700 1 -- 172.21.15.6:0/2592087005 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d0058520 con 0x5633fdae4c00 2023-10-06T02:21:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60c57fa700 1 -- 172.21.15.6:0/2592087005 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f60d801fce0 con 0x5633fdae4c00 2023-10-06T02:21:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60f651fb80 10 client.6396 fetch_fsmap finished waiting for FSMap version 49 2023-10-06T02:21:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60f651fb80 10 client.6396 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T02:21:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60f651fb80 20 client.6396 populate_metadata read hostname 'smithi006' 2023-10-06T02:21:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60f651fb80 1 --2- 172.21.15.6:0/2592087005 >> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] conn(0x5633fdb40170 0x5633fdb40540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60f651fb80 4 client.6396 mds_command: new command op to 6222 tid=0[{"prefix": "status"}] 2023-10-06T02:21:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.277+0000 7f60f651fb80 1 -- 172.21.15.6:0/2592087005 --> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5633fd987e00 con 0x5633fdb40170 2023-10-06T02:21:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.278+0000 7f60e6d9d700 1 --2- 172.21.15.6:0/2592087005 >> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] conn(0x5633fdb40170 0x5633fdb40540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.278+0000 7f60c57fa700 10 client.6396 ms_handle_connect on v2:172.21.15.175:6835/1125020360 2023-10-06T02:21:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.278+0000 7f60e6d9d700 1 --2- 172.21.15.6:0/2592087005 >> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] conn(0x5633fdb40170 0x5633fdb40540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=361c071ffbc3c13 server_cookie=8dcfdf325d50bfc in_seq=0 out_seq=0 2023-10-06T02:21:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.278+0000 7f60c57fa700 1 -- 172.21.15.6:0/2592087005 <== mds.0 v2:172.21.15.175:6835/1125020360 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5633fd987e00 con 0x5633fdb40170 2023-10-06T02:21:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.278+0000 7f60c57fa700 10 client.6396 handle_command_reply: tid=0 2023-10-06T02:21:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.278+0000 7f60f651fb80 1 client.6396 shutdown 2023-10-06T02:21:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.278+0000 7f60f651fb80 1 -- 172.21.15.6:0/2592087005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fdae4c00 msgr2=0x5633fdabc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.278+0000 7f60f651fb80 1 --2- 172.21.15.6:0/2592087005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fdae4c00 0x5633fdabc530 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009880 tx=0x7f60d8021070 comp rx=0 tx=0).stop 2023-10-06T02:21:02.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.278+0000 7f60f651fb80 1 -- 172.21.15.6:0/2592087005 shutdown_connections 2023-10-06T02:21:02.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.278+0000 7f60f651fb80 1 --2- 172.21.15.6:0/2592087005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633fdae4c00 0x5633fdabc530 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.278+0000 7f60f651fb80 1 --2- 172.21.15.6:0/2592087005 >> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] conn(0x5633fdb40170 0x5633fdb40540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.278+0000 7f60f651fb80 1 --2- 172.21.15.6:0/2592087005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5633fda94840 0x5633fdb3d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.278+0000 7f60f651fb80 1 --2- 172.21.15.6:0/2592087005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633fda95cc0 0x5633fdabbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.278+0000 7f60c57fa700 0 client.6396 ms_handle_reset on v2:172.21.15.175:6835/1125020360 2023-10-06T02:21:02.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.278+0000 7f60f651fb80 1 -- 172.21.15.6:0/2592087005 >> 172.21.15.6:0/2592087005 conn(0x5633fda96160 msgr2=0x5633fda8fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:02.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.278+0000 7f60f651fb80 1 -- 172.21.15.6:0/2592087005 shutdown_connections 2023-10-06T02:21:02.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.278+0000 7f60f651fb80 1 -- 172.21.15.6:0/2592087005 wait complete. 2023-10-06T02:21:02.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.279+0000 7f60f651fb80 20 client.6396 trim_cache size 0 max 16384 2023-10-06T02:21:02.291 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:21:02.291 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:21:02.291 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:21:02.291 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 6222, 2023-10-06T02:21:02.291 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:21:02.291 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:21:02.291 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:21:02.291 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.480182166000001, 2023-10-06T02:21:02.291 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 49, 2023-10-06T02:21:02.292 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 66, 2023-10-06T02:21:02.292 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 66, 2023-10-06T02:21:02.292 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 16.507425169000001 2023-10-06T02:21:02.292 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:21:02.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.279+0000 7f60ed227700 1 -- 172.21.15.6:0/2099090920 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60c8066f30 msgr2=0x7f60c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:02.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.279+0000 7f60ed227700 1 --2- 172.21.15.6:0/2099090920 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60c8066f30 0x7f60c80693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f60e000acb0 tx=0x7f60e0008040 comp rx=0 tx=0).stop 2023-10-06T02:21:02.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.279+0000 7f60ed227700 1 -- 172.21.15.6:0/2099090920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e815a030 msgr2=0x7f60e80c3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:02.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.279+0000 7f60ed227700 1 --2- 172.21.15.6:0/2099090920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e815a030 0x7f60e80c3bc0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c800 tx=0x7f60d0008040 comp rx=0 tx=0).stop 2023-10-06T02:21:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.279+0000 7f60ed227700 1 -- 172.21.15.6:0/2099090920 shutdown_connections 2023-10-06T02:21:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.279+0000 7f60ed227700 1 --2- 172.21.15.6:0/2099090920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e815a940 0x7f60e80b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.279+0000 7f60ed227700 1 --2- 172.21.15.6:0/2099090920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60e8087530 0x7f60e8155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.279+0000 7f60ed227700 1 --2- 172.21.15.6:0/2099090920 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60c8066f30 0x7f60c80693e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.279+0000 7f60ed227700 1 --2- 172.21.15.6:0/2099090920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e815a030 0x7f60e80c3bc0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.279+0000 7f60ed227700 1 -- 172.21.15.6:0/2099090920 >> 172.21.15.6:0/2099090920 conn(0x7f60e8068680 msgr2=0x7f60e8158510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.279+0000 7f60ed227700 1 -- 172.21.15.6:0/2099090920 shutdown_connections 2023-10-06T02:21:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.279+0000 7f60ed227700 1 -- 172.21.15.6:0/2099090920 wait complete. 2023-10-06T02:21:02.295 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:21:02.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.414+0000 7f227359e700 1 Processor -- start 2023-10-06T02:21:02.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.414+0000 7f227359e700 1 -- start start 2023-10-06T02:21:02.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.415+0000 7f227359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2274159400 0x7f22740ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.415+0000 7f227359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22740d05d0 0x7f22740b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.415+0000 7f227359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22740b3560 con 0x7f22740cd030 2023-10-06T02:21:02.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.415+0000 7f227359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22740cf6f0 con 0x7f2274159400 2023-10-06T02:21:02.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.415+0000 7f227359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22740cf9d0 con 0x7f22740d05d0 2023-10-06T02:21:02.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.415+0000 7f227259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2274159400 0x7f22740ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.415+0000 7f2271d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f22740cd030 0x7f22740cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43568/0 (socket says 172.21.15.6:43568) 2023-10-06T02:21:02.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.415+0000 7f2271d9b700 1 -- 172.21.15.6:0/3744018931 learned_addr learned my addr 172.21.15.6:0/3744018931 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:21:02.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.415+0000 7f2272d9d700 1 --2- 172.21.15.6:0/3744018931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22740d05d0 0x7f22740b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.416+0000 7f227259c700 1 -- 172.21.15.6:0/3744018931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22740d05d0 msgr2=0x7f22740b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:02.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.416+0000 7f227259c700 1 --2- 172.21.15.6:0/3744018931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22740d05d0 0x7f22740b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.416+0000 7f227259c700 1 -- 172.21.15.6:0/3744018931 >> v1:172.21.15.6:6789/0 conn(0x7f22740cd030 legacy=0x7f22740cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:02.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.416+0000 7f227259c700 1 -- 172.21.15.6:0/3744018931 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22740b2f10 con 0x7f2274159400 2023-10-06T02:21:02.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.416+0000 7f227159a700 1 -- 172.21.15.6:0/3744018931 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051844030 0 0) 0x7f22740b3560 con 0x7f22740cd030 2023-10-06T02:21:02.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.416+0000 7f227259c700 1 --2- 172.21.15.6:0/3744018931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2274159400 0x7f22740ccaf0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f226c0098d0 tx=0x7f226c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e269fa8daf33ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:02.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.416+0000 7f227159a700 1 -- 172.21.15.6:0/3744018931 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c009e70 con 0x7f2274159400 2023-10-06T02:21:02.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.416+0000 7f227159a700 1 -- 172.21.15.6:0/3744018931 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c005c10 con 0x7f2274159400 2023-10-06T02:21:02.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.416+0000 7f227159a700 1 -- 172.21.15.6:0/3744018931 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c00b650 con 0x7f2274159400 2023-10-06T02:21:02.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.416+0000 7f227359e700 1 -- 172.21.15.6:0/3744018931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2274159400 msgr2=0x7f22740ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:02.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.416+0000 7f227359e700 1 --2- 172.21.15.6:0/3744018931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2274159400 0x7f22740ccaf0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f226c0098d0 tx=0x7f226c009120 comp rx=0 tx=0).stop 2023-10-06T02:21:02.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.417+0000 7f227359e700 1 -- 172.21.15.6:0/3744018931 shutdown_connections 2023-10-06T02:21:02.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.417+0000 7f227359e700 1 --2- 172.21.15.6:0/3744018931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22740d05d0 0x7f22740b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.417+0000 7f227359e700 1 --2- 172.21.15.6:0/3744018931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2274159400 0x7f22740ccaf0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.417+0000 7f227359e700 1 -- 172.21.15.6:0/3744018931 >> 172.21.15.6:0/3744018931 conn(0x7f227406ac10 msgr2=0x7f2274068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:02.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.417+0000 7f227359e700 1 -- 172.21.15.6:0/3744018931 shutdown_connections 2023-10-06T02:21:02.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.417+0000 7f227359e700 1 -- 172.21.15.6:0/3744018931 wait complete. 2023-10-06T02:21:02.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.418+0000 7f227359e700 1 Processor -- start 2023-10-06T02:21:02.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.418+0000 7f227359e700 1 -- start start 2023-10-06T02:21:02.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f227359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22740cd030 0x7f227415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f227359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22740d05d0 0x7f2274152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f227359e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2274159400 0x7f227415f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f227359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22741532f0 con 0x7f22740cd030 2023-10-06T02:21:02.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f227359e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227415a8a0 con 0x7f2274159400 2023-10-06T02:21:02.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f227359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227415ab80 con 0x7f22740d05d0 2023-10-06T02:21:02.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f227259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22740cd030 0x7f227415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f227259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22740cd030 0x7f227415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40980/0 (socket says 172.21.15.6:40980) 2023-10-06T02:21:02.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f227259c700 1 -- 172.21.15.6:0/2949185736 learned_addr learned my addr 172.21.15.6:0/2949185736 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:02.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f2271d9b700 1 --2- 172.21.15.6:0/2949185736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22740d05d0 0x7f2274152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f2272d9d700 1 --2- 172.21.15.6:0/2949185736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2274159400 0x7f227415f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f227259c700 1 -- 172.21.15.6:0/2949185736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22740d05d0 msgr2=0x7f2274152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:02.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f227259c700 1 --2- 172.21.15.6:0/2949185736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22740d05d0 0x7f2274152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f227259c700 1 -- 172.21.15.6:0/2949185736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2274159400 msgr2=0x7f227415f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:02.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f227259c700 1 --2- 172.21.15.6:0/2949185736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2274159400 0x7f227415f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f227259c700 1 -- 172.21.15.6:0/2949185736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c0093c0 con 0x7f22740cd030 2023-10-06T02:21:02.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f2271d9b700 1 --2- 172.21.15.6:0/2949185736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22740d05d0 0x7f2274152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:02.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f2272d9d700 1 --2- 172.21.15.6:0/2949185736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2274159400 0x7f227415f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:02.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f227259c700 1 --2- 172.21.15.6:0/2949185736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22740cd030 0x7f227415a1e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f226c00b3c0 tx=0x7f226c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:02.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f226a7fc700 1 -- 172.21.15.6:0/2949185736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c006310 con 0x7f22740cd030 2023-10-06T02:21:02.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f226a7fc700 1 -- 172.21.15.6:0/2949185736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c006490 con 0x7f22740cd030 2023-10-06T02:21:02.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f227359e700 1 -- 172.21.15.6:0/2949185736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227415ae60 con 0x7f22740cd030 2023-10-06T02:21:02.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f226a7fc700 1 -- 172.21.15.6:0/2949185736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c006850 con 0x7f22740cd030 2023-10-06T02:21:02.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.419+0000 7f227359e700 1 -- 172.21.15.6:0/2949185736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227415b420 con 0x7f22740cd030 2023-10-06T02:21:02.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.420+0000 7f227359e700 1 -- 172.21.15.6:0/2949185736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227415b640 con 0x7f22740cd030 2023-10-06T02:21:02.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.421+0000 7f226a7fc700 1 -- 172.21.15.6:0/2949185736 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f226c01b690 con 0x7f22740cd030 2023-10-06T02:21:02.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.421+0000 7f226a7fc700 1 --2- 172.21.15.6:0/2949185736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2254066f30 0x7f22540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:02.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.421+0000 7f226a7fc700 1 -- 172.21.15.6:0/2949185736 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f226c086970 con 0x7f22740cd030 2023-10-06T02:21:02.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.421+0000 7f2271d9b700 1 --2- 172.21.15.6:0/2949185736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2254066f30 0x7f22540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:02.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.422+0000 7f2271d9b700 1 --2- 172.21.15.6:0/2949185736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2254066f30 0x7f22540693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f22740b2320 tx=0x7f225c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:02.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.425+0000 7f226a7fc700 1 -- 172.21.15.6:0/2949185736 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f226c053940 con 0x7f22740cd030 2023-10-06T02:21:02.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.668+0000 7f227359e700 1 -- 172.21.15.6:0/2949185736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f22740cf220 con 0x7f22740cd030 2023-10-06T02:21:02.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.668+0000 7f226a7fc700 1 -- 172.21.15.6:0/2949185736 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7f226c056f60 con 0x7f22740cd030 2023-10-06T02:21:02.669 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:21:02.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.670+0000 7f227359e700 1 -- 172.21.15.6:0/2949185736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2254066f30 msgr2=0x7f22540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:02.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.670+0000 7f227359e700 1 --2- 172.21.15.6:0/2949185736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2254066f30 0x7f22540693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f22740b2320 tx=0x7f225c009040 comp rx=0 tx=0).stop 2023-10-06T02:21:02.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.670+0000 7f227359e700 1 -- 172.21.15.6:0/2949185736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22740cd030 msgr2=0x7f227415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:02.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.670+0000 7f227359e700 1 --2- 172.21.15.6:0/2949185736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22740cd030 0x7f227415a1e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f226c00b3c0 tx=0x7f226c016000 comp rx=0 tx=0).stop 2023-10-06T02:21:02.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.670+0000 7f227359e700 1 -- 172.21.15.6:0/2949185736 shutdown_connections 2023-10-06T02:21:02.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.670+0000 7f227359e700 1 --2- 172.21.15.6:0/2949185736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2274159400 0x7f227415f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.670+0000 7f227359e700 1 --2- 172.21.15.6:0/2949185736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2254066f30 0x7f22540693e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.670+0000 7f227359e700 1 --2- 172.21.15.6:0/2949185736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22740cd030 0x7f227415a1e0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.670+0000 7f227359e700 1 --2- 172.21.15.6:0/2949185736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22740d05d0 0x7f2274152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:02.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.670+0000 7f227359e700 1 -- 172.21.15.6:0/2949185736 >> 172.21.15.6:0/2949185736 conn(0x7f227406ac10 msgr2=0x7f22740ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:02.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.670+0000 7f227359e700 1 -- 172.21.15.6:0/2949185736 shutdown_connections 2023-10-06T02:21:02.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:02.670+0000 7f227359e700 1 -- 172.21.15.6:0/2949185736 wait complete. 2023-10-06T02:21:02.682 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:21:02.682 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:21:02.683 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:21:02.683 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:21:02.683 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:21:02.683 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:21:02.683 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:21:02.683 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:21:02.683 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:21:02.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:21:02.683 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:21:02.698 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:21:02.698 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:21:02.699 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:21:02.699 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:21:02.699 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:21:02.699 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:21:02.699 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:21:02.699 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:21:02.699 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:21:02.699 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:21:02.699 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:21:02.699 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:21:02.699 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:21:02.699 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:21:02.700 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:21:02.700 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:21:02.700 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42283sec preferred_lft 42283sec 2023-10-06T02:21:02.700 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:21:02.700 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:21:02.700 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:21:02.700 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:21:02.700 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:21:02.700 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:21:02.700 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:21:02.700 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:21:02.700 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:21:02.701 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:21:02.701 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:21:02.701 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:21:02.701 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:21:02.701 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:21:02.701 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:21:02.701 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:21:02.701 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:21:02.701 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:21:02.701 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:21:02.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:21:02.702 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:21:02.763 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:21:02.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:21:02.764 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:21:02.820 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:21:02.820 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:21:02.821 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:21:02.821 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:21:02.821 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:21:02.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:21:02.822 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:21:02.822 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:21:02.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:21:02.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:21:02.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:21:02.822 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:21:02.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:21:02.924 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:21:02.939 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:21:02.939 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:21:02.939 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:21:02.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:21:02.940 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:21:03.004 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:21:03.004 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:21:03.004 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:21:03.059 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:21:03.059 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:21:03.060 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:21:03.114 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:21:03.180 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:21:03.180 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:21:03.244 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:21:03.245 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:21:03.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:21:03.246 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:21:03.301 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:21:03.301 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:21:03.344 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:21:03.368 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:21:03.368 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:21:03.427 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:21:03.427+0000 7fa3954e5540 -1 init, newargv = 0x556a681949f0 newargc=15 2023-10-06T02:21:03.428 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[113974]: starting ceph client 2023-10-06T02:21:03.432 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[113974]: starting fuse 2023-10-06T02:21:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:21:03.437 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:21:03.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:21:03.437 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:21:03.493 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:21:03.493 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:21:03.494 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:21:03.494 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:21:03.494 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:21:03.494 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:21:03.494 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:21:03.494 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:21:03.494 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:21:03.494 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:21:03.494 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:21:03.494 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:21:03.494 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:21:03.494 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:21:03.495 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:21:03.495 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:21:03.495 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:21:03.495 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:21:03.495 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:21:03.495 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:21:03.495 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:21:03.495 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:21:03.495 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:21:03.495 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:21:03.495 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:21:03.495 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:21:03.495 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:21:03.496 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:21:03.496 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:21:03.616 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.113974.asok 2023-10-06T02:21:03.798 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.113974.asok 2023-10-06T02:21:03.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:21:03.798 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.113974.asok status 2023-10-06T02:21:03.952 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:21:03.952 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:21:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:21:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:21:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:21:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:21:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:21:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "113974", 2023-10-06T02:21:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:21:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:21:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:21:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:21:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 6408, 2023-10-06T02:21:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:21:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:21:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:21:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 6408 2023-10-06T02:21:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:21:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:21:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:21:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:21:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2660262910 2023-10-06T02:21:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:21:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:21:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:21:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:21:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:21:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2660262910 2023-10-06T02:21:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:21:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.6408 192.168.0.1:0/2660262910", 2023-10-06T02:21:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/2660262910", 2023-10-06T02:21:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:21:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 49, 2023-10-06T02:21:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 66, 2023-10-06T02:21:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:21:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:21:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:21:03.956 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:21:03.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:21:03.963 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:21:03.963 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:21:03.978 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:21:03.978 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:21:03.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:21:03.978 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:21:04.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:21:04.044 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'mkdir -p a/{b,c}/d; sync .') 2023-10-06T02:21:04.142 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:21:04.142 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:21:04.142 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:21:04.177 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[113974]: fuse finished with error 0 and tester_r 0 2023-10-06T02:21:04.178 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:21:04.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:21:04.178 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:21:04.272 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2023-10-06T02:21:04.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.433+0000 7faade548700 1 Processor -- start 2023-10-06T02:21:04.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.434+0000 7faade548700 1 -- start start 2023-10-06T02:21:04.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.434+0000 7faade548700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faad80b1510 0x7faad81571c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.434+0000 7faade548700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad80c93f0 con 0x7faad80aa920 2023-10-06T02:21:04.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.435+0000 7faade548700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad80cac20 con 0x7faad8156df0 2023-10-06T02:21:04.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.435+0000 7faade548700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad806b0a0 con 0x7faad80b1510 2023-10-06T02:21:04.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.435+0000 7faaddd47700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faad80aa920 0x7faad80aad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43580/0 (socket says 172.21.15.6:43580) 2023-10-06T02:21:04.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.435+0000 7faaddd47700 1 -- 172.21.15.6:0/3626694300 learned_addr learned my addr 172.21.15.6:0/3626694300 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:21:04.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.435+0000 7faadcd45700 1 --2- 172.21.15.6:0/3626694300 >> v2:172.21.15.175:3300/0 conn(0x7faad80b1510 0x7faad81571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.435+0000 7faad7fff700 1 -- 172.21.15.6:0/3626694300 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972120802 0 0) 0x7faad80c93f0 con 0x7faad80aa920 2023-10-06T02:21:04.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.435+0000 7faad7fff700 1 -- 172.21.15.6:0/3626694300 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faac0003570 con 0x7faad80aa920 2023-10-06T02:21:04.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.435+0000 7faad7fff700 1 -- 172.21.15.6:0/3626694300 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743229244 0 0) 0x7faad80cac20 con 0x7faad8156df0 2023-10-06T02:21:04.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.435+0000 7faad7fff700 1 -- 172.21.15.6:0/3626694300 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faad80c93f0 con 0x7faad8156df0 2023-10-06T02:21:04.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.435+0000 7faadcd45700 1 -- 172.21.15.6:0/3626694300 >> v1:172.21.15.175:6789/0 conn(0x7faad8156df0 legacy=0x7faad80b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.435+0000 7faadcd45700 1 -- 172.21.15.6:0/3626694300 >> v1:172.21.15.6:6789/0 conn(0x7faad80aa920 legacy=0x7faad80aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.435+0000 7faad7fff700 1 -- 172.21.15.6:0/3626694300 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2301118733 0 0) 0x7faac0003570 con 0x7faad80aa920 2023-10-06T02:21:04.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.435+0000 7faadcd45700 1 -- 172.21.15.6:0/3626694300 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad80caf00 con 0x7faad80b1510 2023-10-06T02:21:04.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.435+0000 7faadcd45700 1 --2- 172.21.15.6:0/3626694300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faad80b1510 0x7faad81571c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faacc0098e0 tx=0x7faacc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d941e4a58514107 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:04.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.436+0000 7faad7fff700 1 -- 172.21.15.6:0/3626694300 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac80017f0 con 0x7faad80b1510 2023-10-06T02:21:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.436+0000 7faad7fff700 1 -- 172.21.15.6:0/3626694300 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc011420 con 0x7faad80b1510 2023-10-06T02:21:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.436+0000 7faad7fff700 1 -- 172.21.15.6:0/3626694300 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0117c0 con 0x7faad80b1510 2023-10-06T02:21:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.436+0000 7faade548700 1 -- 172.21.15.6:0/3626694300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faad80b1510 msgr2=0x7faad81571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.436+0000 7faade548700 1 --2- 172.21.15.6:0/3626694300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faad80b1510 0x7faad81571c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faacc0098e0 tx=0x7faacc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.436+0000 7faade548700 1 -- 172.21.15.6:0/3626694300 shutdown_connections 2023-10-06T02:21:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.436+0000 7faade548700 1 --2- 172.21.15.6:0/3626694300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faad80b1510 0x7faad81571c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.436+0000 7faade548700 1 -- 172.21.15.6:0/3626694300 >> 172.21.15.6:0/3626694300 conn(0x7faad8069150 msgr2=0x7faad80ad720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.436+0000 7faade548700 1 -- 172.21.15.6:0/3626694300 shutdown_connections 2023-10-06T02:21:04.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.436+0000 7faade548700 1 -- 172.21.15.6:0/3626694300 wait complete. 2023-10-06T02:21:04.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.437+0000 7faade548700 1 Processor -- start 2023-10-06T02:21:04.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.437+0000 7faade548700 1 -- start start 2023-10-06T02:21:04.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.438+0000 7faade548700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faad80aa920 0x7faad814cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.438+0000 7faade548700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faad80b1510 0x7faad8148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.438+0000 7faade548700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad8156df0 0x7faad80ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.438+0000 7faade548700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad8150a00 con 0x7faad8156df0 2023-10-06T02:21:04.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.438+0000 7faade548700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad814b130 con 0x7faad80b1510 2023-10-06T02:21:04.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.438+0000 7faade548700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad8150230 con 0x7faad80aa920 2023-10-06T02:21:04.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.438+0000 7faaddd47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad8156df0 0x7faad80ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.438+0000 7faaddd47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad8156df0 0x7faad80ac840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40988/0 (socket says 172.21.15.6:40988) 2023-10-06T02:21:04.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.438+0000 7faaddd47700 1 -- 172.21.15.6:0/3838787074 learned_addr learned my addr 172.21.15.6:0/3838787074 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:04.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.439+0000 7faadcd45700 1 --2- 172.21.15.6:0/3838787074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faad80b1510 0x7faad8148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.439+0000 7faadd546700 1 --2- 172.21.15.6:0/3838787074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faad80aa920 0x7faad814cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.439+0000 7faaddd47700 1 -- 172.21.15.6:0/3838787074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faad80aa920 msgr2=0x7faad814cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.439+0000 7faaddd47700 1 --2- 172.21.15.6:0/3838787074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faad80aa920 0x7faad814cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.439+0000 7faaddd47700 1 -- 172.21.15.6:0/3838787074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faad80b1510 msgr2=0x7faad8148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.439+0000 7faaddd47700 1 --2- 172.21.15.6:0/3838787074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faad80b1510 0x7faad8148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.439+0000 7faaddd47700 1 -- 172.21.15.6:0/3838787074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc009420 con 0x7faad8156df0 2023-10-06T02:21:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.439+0000 7faaddd47700 1 --2- 172.21.15.6:0/3838787074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad8156df0 0x7faad80ac840 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7faac800cbd0 tx=0x7faac8007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.439+0000 7faad57fa700 1 -- 172.21.15.6:0/3838787074 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac8004dc0 con 0x7faad8156df0 2023-10-06T02:21:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.439+0000 7faad57fa700 1 -- 172.21.15.6:0/3838787074 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac800a600 con 0x7faad8156df0 2023-10-06T02:21:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.439+0000 7faade548700 1 -- 172.21.15.6:0/3838787074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad814ae50 con 0x7faad8156df0 2023-10-06T02:21:04.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.439+0000 7faad57fa700 1 -- 172.21.15.6:0/3838787074 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac800a9c0 con 0x7faad8156df0 2023-10-06T02:21:04.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.439+0000 7faade548700 1 -- 172.21.15.6:0/3838787074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad8150720 con 0x7faad8156df0 2023-10-06T02:21:04.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.441+0000 7faad57fa700 1 -- 172.21.15.6:0/3838787074 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faac8007150 con 0x7faad8156df0 2023-10-06T02:21:04.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.441+0000 7faad57fa700 1 --2- 172.21.15.6:0/3838787074 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faac4066f30 0x7faac40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.441+0000 7faad57fa700 1 -- 172.21.15.6:0/3838787074 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7faac80840d0 con 0x7faad8156df0 2023-10-06T02:21:04.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.441+0000 7faadd546700 1 --2- 172.21.15.6:0/3838787074 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faac4066f30 0x7faac40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.442+0000 7faadd546700 1 --2- 172.21.15.6:0/3838787074 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faac4066f30 0x7faac40693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faad0003870 tx=0x7faad0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.443+0000 7faae8aa2b80 1 Processor -- start 2023-10-06T02:21:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.443+0000 7faae8aa2b80 1 -- start start 2023-10-06T02:21:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.443+0000 7faae8aa2b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a98904ea0 0x563a988dfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.443+0000 7faae8aa2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a988e5310 0x563a988e0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.443+0000 7faae8aa2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a988e0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.443+0000 7faae8aa2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9883aac0 con 0x563a988e6a60 2023-10-06T02:21:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.443+0000 7faae8aa2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a988382c0 con 0x563a988e5310 2023-10-06T02:21:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.443+0000 7faae8aa2b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a988340b0 con 0x563a98904ea0 2023-10-06T02:21:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.444+0000 7faaddd47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a988e0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.444+0000 7faaddd47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a988e0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40990/0 (socket says 172.21.15.6:40990) 2023-10-06T02:21:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.444+0000 7faaddd47700 1 -- 172.21.15.6:0/2393606939 learned_addr learned my addr 172.21.15.6:0/2393606939 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.444+0000 7faadcd45700 1 --2- 172.21.15.6:0/2393606939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a988e5310 0x563a988e0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.444+0000 7faadd546700 1 --2- 172.21.15.6:0/2393606939 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a98904ea0 0x563a988dfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.444+0000 7faaddd47700 1 -- 172.21.15.6:0/2393606939 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a98904ea0 msgr2=0x563a988dfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.444+0000 7faaddd47700 1 --2- 172.21.15.6:0/2393606939 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a98904ea0 0x563a988dfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.444+0000 7faaddd47700 1 -- 172.21.15.6:0/2393606939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a988e5310 msgr2=0x563a988e0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.444+0000 7faaddd47700 1 --2- 172.21.15.6:0/2393606939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a988e5310 0x563a988e0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.444+0000 7faaddd47700 1 -- 172.21.15.6:0/2393606939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a986ce2c0 con 0x563a988e6a60 2023-10-06T02:21:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.444+0000 7faadcd45700 1 --2- 172.21.15.6:0/2393606939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a988e5310 0x563a988e0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.444+0000 7faaddd47700 1 --2- 172.21.15.6:0/2393606939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a988e0790 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7faac80512e0 tx=0x7faac80822b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195e3d4c0e9bf7a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.444+0000 7faabe7fc700 1 -- 172.21.15.6:0/2393606939 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac8054920 con 0x563a988e6a60 2023-10-06T02:21:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.444+0000 7faabe7fc700 1 -- 172.21.15.6:0/2393606939 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac806b1c0 con 0x563a988e6a60 2023-10-06T02:21:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.444+0000 7faabe7fc700 1 -- 172.21.15.6:0/2393606939 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac8058030 con 0x563a988e6a60 2023-10-06T02:21:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.445+0000 7faae8aa2b80 1 -- 172.21.15.6:0/2393606939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 msgr2=0x563a988e0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.445+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/2393606939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a988e0790 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7faac80512e0 tx=0x7faac80822b0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.445+0000 7faae8aa2b80 1 -- 172.21.15.6:0/2393606939 shutdown_connections 2023-10-06T02:21:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.445+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/2393606939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a988e0790 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.445+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/2393606939 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a98904ea0 0x563a988dfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.445+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/2393606939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a988e5310 0x563a988e0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.445+0000 7faae8aa2b80 1 -- 172.21.15.6:0/2393606939 >> 172.21.15.6:0/2393606939 conn(0x563a988e4ed0 msgr2=0x563a988e5700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:04.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.445+0000 7faae8aa2b80 1 -- 172.21.15.6:0/2393606939 shutdown_connections 2023-10-06T02:21:04.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.445+0000 7faae8aa2b80 1 -- 172.21.15.6:0/2393606939 wait complete. 2023-10-06T02:21:04.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.445+0000 7faae8aa2b80 1 -- start start 2023-10-06T02:21:04.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.446+0000 7faae8aa2b80 1 Processor -- start 2023-10-06T02:21:04.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.446+0000 7faae8aa2b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a988e5310 0x563a98902a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.446+0000 7faae8aa2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a98910340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.446+0000 7faae8aa2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a98904ea0 0x563a988da450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.446+0000 7faae8aa2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a987df8e0 con 0x563a988e6a60 2023-10-06T02:21:04.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.446+0000 7faae8aa2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a987faef0 con 0x563a98904ea0 2023-10-06T02:21:04.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.446+0000 7faae8aa2b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a986b6e80 con 0x563a988e5310 2023-10-06T02:21:04.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.446+0000 7faae8aa2b80 10 client.0 _ll_register_callbacks cb 0x563a988a7070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:21:04.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.446+0000 7faadcd45700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a98910340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.446+0000 7faadcd45700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a98910340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40994/0 (socket says 172.21.15.6:40994) 2023-10-06T02:21:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faadcd45700 1 -- 172.21.15.6:0/85263047 learned_addr learned my addr 172.21.15.6:0/85263047 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faadd546700 1 --2- 172.21.15.6:0/85263047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a988e5310 0x563a98902a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faaddd47700 1 --2- 172.21.15.6:0/85263047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a98904ea0 0x563a988da450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faadcd45700 1 -- 172.21.15.6:0/85263047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a988e5310 msgr2=0x563a98902a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faadcd45700 1 --2- 172.21.15.6:0/85263047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a988e5310 0x563a98902a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faadcd45700 1 -- 172.21.15.6:0/85263047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a98904ea0 msgr2=0x563a988da450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faadcd45700 1 --2- 172.21.15.6:0/85263047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a98904ea0 0x563a988da450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faadcd45700 1 -- 172.21.15.6:0/85263047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad8150720 con 0x563a988e6a60 2023-10-06T02:21:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faadd546700 1 --2- 172.21.15.6:0/85263047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a988e5310 0x563a98902a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faadcd45700 1 --2- 172.21.15.6:0/85263047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a98910340 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7faacc0091e0 tx=0x7faacc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69c691152fe22a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faab77fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:21:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faab77fe700 1 -- 172.21.15.6:0/85263047 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc023070 con 0x563a988e6a60 2023-10-06T02:21:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faab77fe700 1 -- 172.21.15.6:0/85263047 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7faacc01c450 con 0x563a988e6a60 2023-10-06T02:21:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faae8aa2b80 1 -- 172.21.15.6:0/85263047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a988d8990 con 0x563a988e6a60 2023-10-06T02:21:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faab77fe700 1 -- 172.21.15.6:0/85263047 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7faacc011e90 con 0x563a988e6a60 2023-10-06T02:21:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faae8aa2b80 10 client.6420 fetch_fsmap learned FSMap version 49 2023-10-06T02:21:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faae8aa2b80 1 -- 172.21.15.6:0/85263047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x563a98671030 con 0x563a988e6a60 2023-10-06T02:21:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.447+0000 7faab77fe700 1 -- 172.21.15.6:0/85263047 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563a988d8990 con 0x563a988e6a60 2023-10-06T02:21:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.448+0000 7faab77fe700 1 -- 172.21.15.6:0/85263047 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faacc018070 con 0x563a988e6a60 2023-10-06T02:21:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.448+0000 7faae8aa2b80 10 client.6420 fetch_fsmap finished waiting for FSMap version 49 2023-10-06T02:21:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.448+0000 7faae8aa2b80 10 client.6420 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-10-06T02:21:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.448+0000 7faae8aa2b80 20 client.6420 populate_metadata read hostname 'smithi006' 2023-10-06T02:21:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.448+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/85263047 >> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] conn(0x563a9893d350 0x563a9893d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.448+0000 7faae8aa2b80 4 client.6420 mds_command: new command op to 6222 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:21:04.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.448+0000 7faae8aa2b80 1 -- 172.21.15.6:0/85263047 --> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563a988b58c0 con 0x563a9893d350 2023-10-06T02:21:04.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.448+0000 7faadd546700 1 --2- 172.21.15.6:0/85263047 >> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] conn(0x563a9893d350 0x563a9893d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.448+0000 7faab77fe700 10 client.6420 ms_handle_connect on v2:172.21.15.175:6835/1125020360 2023-10-06T02:21:04.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.448+0000 7faadd546700 1 --2- 172.21.15.6:0/85263047 >> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] conn(0x563a9893d350 0x563a9893d750 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc298d8927741b0a server_cookie=348d924a22c8e098 in_seq=0 out_seq=0 2023-10-06T02:21:04.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.449+0000 7faab77fe700 1 -- 172.21.15.6:0/85263047 <== mds.0 v2:172.21.15.175:6835/1125020360 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x563a988b58c0 con 0x563a9893d350 2023-10-06T02:21:04.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.449+0000 7faab77fe700 10 client.6420 handle_command_reply: tid=0 2023-10-06T02:21:04.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.449+0000 7faae8aa2b80 1 client.6420 shutdown 2023-10-06T02:21:04.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.449+0000 7faae8aa2b80 1 -- 172.21.15.6:0/85263047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 msgr2=0x563a98910340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.449+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/85263047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a98910340 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7faacc0091e0 tx=0x7faacc016000 comp rx=0 tx=0).stop 2023-10-06T02:21:04.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.449+0000 7faae8aa2b80 1 -- 172.21.15.6:0/85263047 shutdown_connections 2023-10-06T02:21:04.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.449+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/85263047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a98904ea0 0x563a988da450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.449+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/85263047 >> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] conn(0x563a9893d350 0x563a9893d750 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.449+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/85263047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a988e5310 0x563a98902a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.449+0000 7faab77fe700 0 client.6420 ms_handle_reset on v2:172.21.15.175:6835/1125020360 2023-10-06T02:21:04.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.449+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/85263047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a98910340 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.449+0000 7faae8aa2b80 1 -- 172.21.15.6:0/85263047 >> 172.21.15.6:0/85263047 conn(0x563a988e4ed0 msgr2=0x563a988e3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:04.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.449+0000 7faae8aa2b80 1 -- 172.21.15.6:0/85263047 shutdown_connections 2023-10-06T02:21:04.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.449+0000 7faae8aa2b80 1 -- 172.21.15.6:0/85263047 wait complete. 2023-10-06T02:21:04.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.449+0000 7faae8aa2b80 20 client.6420 trim_cache size 0 max 16384 2023-10-06T02:21:04.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.463+0000 7faae8aa2b80 1 Processor -- start 2023-10-06T02:21:04.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.463+0000 7faae8aa2b80 1 -- start start 2023-10-06T02:21:04.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faae8aa2b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a988e4ed0 0x563a98910340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faae8aa2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a988e5310 0x563a989046f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faae8aa2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a9892dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faae8aa2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a989101e0 con 0x563a988e6a60 2023-10-06T02:21:04.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faae8aa2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9893cd50 con 0x563a988e5310 2023-10-06T02:21:04.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faae8aa2b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a9892e420 con 0x563a988e4ed0 2023-10-06T02:21:04.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faaddd47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a9892dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faaddd47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a9892dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41008/0 (socket says 172.21.15.6:41008) 2023-10-06T02:21:04.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faaddd47700 1 -- 172.21.15.6:0/739077846 learned_addr learned my addr 172.21.15.6:0/739077846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:04.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faadd546700 1 --2- 172.21.15.6:0/739077846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a988e4ed0 0x563a98910340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faadcd45700 1 --2- 172.21.15.6:0/739077846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a988e5310 0x563a989046f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faaddd47700 1 -- 172.21.15.6:0/739077846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a988e4ed0 msgr2=0x563a98910340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:04.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faaddd47700 1 --2- 172.21.15.6:0/739077846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a988e4ed0 0x563a98910340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faaddd47700 1 -- 172.21.15.6:0/739077846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a988e5310 msgr2=0x563a989046f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:04.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faaddd47700 1 --2- 172.21.15.6:0/739077846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a988e5310 0x563a989046f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faaddd47700 1 -- 172.21.15.6:0/739077846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a988027d0 con 0x563a988e6a60 2023-10-06T02:21:04.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faadd546700 1 --2- 172.21.15.6:0/739077846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a988e4ed0 0x563a98910340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:21:04.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.464+0000 7faadcd45700 1 --2- 172.21.15.6:0/739077846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a988e5310 0x563a989046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:21:04.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.465+0000 7faaddd47700 1 --2- 172.21.15.6:0/739077846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a9892dee0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7faac8054d70 tx=0x7faac8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c419f7f9fb194b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:04.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.465+0000 7faabeffd700 1 -- 172.21.15.6:0/739077846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac805bd80 con 0x563a988e6a60 2023-10-06T02:21:04.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.465+0000 7faabeffd700 1 -- 172.21.15.6:0/739077846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac8058030 con 0x563a988e6a60 2023-10-06T02:21:04.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.465+0000 7faabeffd700 1 -- 172.21.15.6:0/739077846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac8082430 con 0x563a988e6a60 2023-10-06T02:21:04.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.465+0000 7faae8aa2b80 1 -- 172.21.15.6:0/739077846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 msgr2=0x563a9892dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.465+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/739077846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a9892dee0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7faac8054d70 tx=0x7faac8015000 comp rx=0 tx=0).stop 2023-10-06T02:21:04.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.465+0000 7faae8aa2b80 1 -- 172.21.15.6:0/739077846 shutdown_connections 2023-10-06T02:21:04.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.465+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/739077846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e6a60 0x563a9892dee0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.465+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/739077846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a988e4ed0 0x563a98910340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.465+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/739077846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a988e5310 0x563a989046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.465+0000 7faae8aa2b80 1 -- 172.21.15.6:0/739077846 >> 172.21.15.6:0/739077846 conn(0x563a98913d50 msgr2=0x563a989019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:04.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.465+0000 7faae8aa2b80 1 -- 172.21.15.6:0/739077846 shutdown_connections 2023-10-06T02:21:04.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.465+0000 7faae8aa2b80 1 -- 172.21.15.6:0/739077846 wait complete. 2023-10-06T02:21:04.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.466+0000 7faae8aa2b80 1 -- start start 2023-10-06T02:21:04.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.466+0000 7faae8aa2b80 1 Processor -- start 2023-10-06T02:21:04.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faae8aa2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e4ed0 0x563a98904640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faae8aa2b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a988e5310 0x563a98912b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faae8aa2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a988e6a60 0x563a98993410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faae8aa2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9890aaf0 con 0x563a988e4ed0 2023-10-06T02:21:04.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faae8aa2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a988e16b0 con 0x563a988e6a60 2023-10-06T02:21:04.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faae8aa2b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a98913040 con 0x563a988e5310 2023-10-06T02:21:04.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faae8aa2b80 10 client.0 _ll_register_callbacks cb 0x563a988a7070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:21:04.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faadd546700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e4ed0 0x563a98904640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faadd546700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e4ed0 0x563a98904640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41018/0 (socket says 172.21.15.6:41018) 2023-10-06T02:21:04.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faadd546700 1 -- 172.21.15.6:0/2525472000 learned_addr learned my addr 172.21.15.6:0/2525472000 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:04.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faadcd45700 1 --2- 172.21.15.6:0/2525472000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a988e5310 0x563a98912b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faaddd47700 1 --2- 172.21.15.6:0/2525472000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a988e6a60 0x563a98993410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faadd546700 1 -- 172.21.15.6:0/2525472000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a988e5310 msgr2=0x563a98912b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:04.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faadd546700 1 --2- 172.21.15.6:0/2525472000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a988e5310 0x563a98912b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faadd546700 1 -- 172.21.15.6:0/2525472000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a988e6a60 msgr2=0x563a98993410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:04.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faadd546700 1 --2- 172.21.15.6:0/2525472000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a988e6a60 0x563a98993410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faadd546700 1 -- 172.21.15.6:0/2525472000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a986ce2c0 con 0x563a988e4ed0 2023-10-06T02:21:04.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faadd546700 1 --2- 172.21.15.6:0/2525472000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e4ed0 0x563a98904640 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x563a9892dd00 tx=0x7faad0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6937b0926975b605 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:04.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.467+0000 7faab77fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:21:04.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.468+0000 7faab77fe700 1 -- 172.21.15.6:0/2525472000 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0026cd0 con 0x563a988e4ed0 2023-10-06T02:21:04.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.468+0000 7faab77fe700 1 -- 172.21.15.6:0/2525472000 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7faad001b040 con 0x563a988e4ed0 2023-10-06T02:21:04.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.468+0000 7faae8aa2b80 1 -- 172.21.15.6:0/2525472000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faac806b1c0 con 0x563a988e4ed0 2023-10-06T02:21:04.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.468+0000 7faab77fe700 1 -- 172.21.15.6:0/2525472000 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7faad0026e30 con 0x563a988e4ed0 2023-10-06T02:21:04.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.468+0000 7faae8aa2b80 10 client.6426 fetch_fsmap learned FSMap version 49 2023-10-06T02:21:04.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.468+0000 7faae8aa2b80 1 -- 172.21.15.6:0/2525472000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x563a987e94c0 con 0x563a988e4ed0 2023-10-06T02:21:04.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.468+0000 7faab77fe700 1 -- 172.21.15.6:0/2525472000 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac806b1c0 con 0x563a988e4ed0 2023-10-06T02:21:04.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.468+0000 7faab77fe700 1 -- 172.21.15.6:0/2525472000 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faad002f400 con 0x563a988e4ed0 2023-10-06T02:21:04.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.468+0000 7faae8aa2b80 10 client.6426 fetch_fsmap finished waiting for FSMap version 49 2023-10-06T02:21:04.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.468+0000 7faae8aa2b80 10 client.6426 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-10-06T02:21:04.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.468+0000 7faae8aa2b80 20 client.6426 populate_metadata read hostname 'smithi006' 2023-10-06T02:21:04.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.468+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/2525472000 >> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] conn(0x563a98904ea0 0x563a98993950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.468+0000 7faae8aa2b80 4 client.6426 mds_command: new command op to 6222 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:21:04.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.468+0000 7faae8aa2b80 1 -- 172.21.15.6:0/2525472000 --> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563a987d6e50 con 0x563a98904ea0 2023-10-06T02:21:04.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.468+0000 7faadcd45700 1 --2- 172.21.15.6:0/2525472000 >> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] conn(0x563a98904ea0 0x563a98993950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.469+0000 7faab77fe700 10 client.6426 ms_handle_connect on v2:172.21.15.175:6835/1125020360 2023-10-06T02:21:04.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.469+0000 7faadcd45700 1 --2- 172.21.15.6:0/2525472000 >> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] conn(0x563a98904ea0 0x563a98993950 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c391bcdc1bc8017 server_cookie=459dfca777f60ced in_seq=0 out_seq=0 2023-10-06T02:21:04.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.486+0000 7faab77fe700 1 -- 172.21.15.6:0/2525472000 <== mds.0 v2:172.21.15.175:6835/1125020360 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563a987d6e50 con 0x563a98904ea0 2023-10-06T02:21:04.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.486+0000 7faab77fe700 10 client.6426 handle_command_reply: tid=0 2023-10-06T02:21:04.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.486+0000 7faae8aa2b80 1 client.6426 shutdown 2023-10-06T02:21:04.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.486+0000 7faae8aa2b80 1 -- 172.21.15.6:0/2525472000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e4ed0 msgr2=0x563a98904640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.486+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/2525472000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e4ed0 0x563a98904640 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x563a9892dd00 tx=0x7faad0013000 comp rx=0 tx=0).stop 2023-10-06T02:21:04.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.486+0000 7faae8aa2b80 1 -- 172.21.15.6:0/2525472000 shutdown_connections 2023-10-06T02:21:04.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.486+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/2525472000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a988e6a60 0x563a98993410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.486+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/2525472000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a988e4ed0 0x563a98904640 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.486+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/2525472000 >> [v2:172.21.15.175:6835/1125020360,v1:172.21.15.175:6837/1125020360] conn(0x563a98904ea0 0x563a98993950 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.486+0000 7faae8aa2b80 1 --2- 172.21.15.6:0/2525472000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563a988e5310 0x563a98912b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.486+0000 7faab77fe700 0 client.6426 ms_handle_reset on v2:172.21.15.175:6835/1125020360 2023-10-06T02:21:04.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.486+0000 7faae8aa2b80 1 -- 172.21.15.6:0/2525472000 >> 172.21.15.6:0/2525472000 conn(0x563a98913d50 msgr2=0x563a98905b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:04.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.486+0000 7faae8aa2b80 1 -- 172.21.15.6:0/2525472000 shutdown_connections 2023-10-06T02:21:04.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.486+0000 7faae8aa2b80 1 -- 172.21.15.6:0/2525472000 wait complete. 2023-10-06T02:21:04.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.487+0000 7faae8aa2b80 20 client.6426 trim_cache size 0 max 16384 2023-10-06T02:21:04.490 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:21:04.490 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "", 2023-10-06T02:21:04.490 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0 2023-10-06T02:21:04.491 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:21:04.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.487+0000 7faade548700 1 -- 172.21.15.6:0/3838787074 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faac4066f30 msgr2=0x7faac40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.487+0000 7faade548700 1 --2- 172.21.15.6:0/3838787074 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faac4066f30 0x7faac40693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faad0003870 tx=0x7faad0009040 comp rx=0 tx=0).stop 2023-10-06T02:21:04.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.487+0000 7faade548700 1 -- 172.21.15.6:0/3838787074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad8156df0 msgr2=0x7faad80ac840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.487+0000 7faade548700 1 --2- 172.21.15.6:0/3838787074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad8156df0 0x7faad80ac840 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7faac800cbd0 tx=0x7faac8007d20 comp rx=0 tx=0).stop 2023-10-06T02:21:04.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.487+0000 7faade548700 1 -- 172.21.15.6:0/3838787074 shutdown_connections 2023-10-06T02:21:04.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.487+0000 7faade548700 1 --2- 172.21.15.6:0/3838787074 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faac4066f30 0x7faac40693e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.487+0000 7faade548700 1 --2- 172.21.15.6:0/3838787074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad8156df0 0x7faad80ac840 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.487+0000 7faade548700 1 --2- 172.21.15.6:0/3838787074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faad80aa920 0x7faad814cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.487+0000 7faade548700 1 --2- 172.21.15.6:0/3838787074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faad80b1510 0x7faad8148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.487+0000 7faade548700 1 -- 172.21.15.6:0/3838787074 >> 172.21.15.6:0/3838787074 conn(0x7faad8069150 msgr2=0x7faad80cc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:04.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.487+0000 7faade548700 1 -- 172.21.15.6:0/3838787074 shutdown_connections 2023-10-06T02:21:04.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.487+0000 7faade548700 1 -- 172.21.15.6:0/3838787074 wait complete. 2023-10-06T02:21:04.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:21:04.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.618+0000 7f6b0e785700 1 Processor -- start 2023-10-06T02:21:04.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.618+0000 7f6b0e785700 1 -- start start 2023-10-06T02:21:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.619+0000 7f6b0e785700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6b080b27f0 0x7f6b08159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.619+0000 7f6b0e785700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b080ccb60 con 0x7f6b08159380 2023-10-06T02:21:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.619+0000 7f6b0e785700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b080cb6c0 con 0x7f6b0815d4d0 2023-10-06T02:21:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.619+0000 7f6b0e785700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0815e200 con 0x7f6b080b27f0 2023-10-06T02:21:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.619+0000 7f6b07fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6b08159380 0x7f6b080b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43588/0 (socket says 172.21.15.6:43588) 2023-10-06T02:21:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.619+0000 7f6b07fff700 1 -- 172.21.15.6:0/21261925 learned_addr learned my addr 172.21.15.6:0/21261925 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:21:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.619+0000 7f6b077fe700 1 --2- 172.21.15.6:0/21261925 >> v2:172.21.15.175:3300/0 conn(0x7f6b080b27f0 0x7f6b08159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.619+0000 7f6b06ffd700 1 -- 172.21.15.6:0/21261925 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077538535 0 0) 0x7f6b080ccb60 con 0x7f6b08159380 2023-10-06T02:21:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.619+0000 7f6b06ffd700 1 -- 172.21.15.6:0/21261925 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6af0003570 con 0x7f6b08159380 2023-10-06T02:21:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.619+0000 7f6b06ffd700 1 -- 172.21.15.6:0/21261925 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2331914064 0 0) 0x7f6af0003570 con 0x7f6b08159380 2023-10-06T02:21:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.619+0000 7f6b06ffd700 1 -- 172.21.15.6:0/21261925 >> v2:172.21.15.175:3300/0 conn(0x7f6b080b27f0 msgr2=0x7f6b08159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.619+0000 7f6b06ffd700 1 --2- 172.21.15.6:0/21261925 >> v2:172.21.15.175:3300/0 conn(0x7f6b080b27f0 0x7f6b08159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.619+0000 7f6b06ffd700 1 -- 172.21.15.6:0/21261925 >> v1:172.21.15.175:6789/0 conn(0x7f6b0815d4d0 legacy=0x7f6b0815d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b06ffd700 1 -- 172.21.15.6:0/21261925 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b080c3ef0 con 0x7f6b08159380 2023-10-06T02:21:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b06ffd700 1 -- 172.21.15.6:0/21261925 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f6afc001470 con 0x7f6b08159380 2023-10-06T02:21:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b06ffd700 1 -- 172.21.15.6:0/21261925 >> v1:172.21.15.6:6789/0 conn(0x7f6b08159380 legacy=0x7f6b080b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b06ffd700 1 --2- 172.21.15.6:0/21261925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6af0003a60 0x7f6af0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b06ffd700 1 --2- 172.21.15.6:0/21261925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6af0004810 0x7f6af0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b06ffd700 1 --2- 172.21.15.6:0/21261925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6af00052e0 0x7f6af000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b06ffd700 1 -- 172.21.15.6:0/21261925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0815e200 con 0x7f6af0003a60 2023-10-06T02:21:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b06ffd700 1 -- 172.21.15.6:0/21261925 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af000c2a0 con 0x7f6af00052e0 2023-10-06T02:21:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b06ffd700 1 -- 172.21.15.6:0/21261925 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af000c460 con 0x7f6af0004810 2023-10-06T02:21:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b07fff700 1 --2- 172.21.15.6:0/21261925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6af0003a60 0x7f6af0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b0cd22700 1 --2- 172.21.15.6:0/21261925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6af00052e0 0x7f6af000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b077fe700 1 --2- 172.21.15.6:0/21261925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6af0004810 0x7f6af0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b07fff700 1 -- 172.21.15.6:0/21261925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6af0004810 msgr2=0x7f6af0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b07fff700 1 --2- 172.21.15.6:0/21261925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6af0004810 0x7f6af0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b07fff700 1 -- 172.21.15.6:0/21261925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6af00052e0 msgr2=0x7f6af000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b07fff700 1 --2- 172.21.15.6:0/21261925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6af00052e0 0x7f6af000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b07fff700 1 -- 172.21.15.6:0/21261925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af0003570 con 0x7f6af0003a60 2023-10-06T02:21:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b0cd22700 1 --2- 172.21.15.6:0/21261925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6af00052e0 0x7f6af000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b0cd22700 1 -- 172.21.15.6:0/21261925 reap_dead start 2023-10-06T02:21:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b07fff700 1 --2- 172.21.15.6:0/21261925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6af0003a60 0x7f6af0003e70 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00c390 tx=0x7f6b080cb630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d71fab5b66b0c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:04.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b06ffd700 1 -- 172.21.15.6:0/21261925 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc00cc60 con 0x7f6af0003a60 2023-10-06T02:21:04.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b06ffd700 1 -- 172.21.15.6:0/21261925 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc00cdc0 con 0x7f6af0003a60 2023-10-06T02:21:04.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.620+0000 7f6b06ffd700 1 -- 172.21.15.6:0/21261925 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc005b70 con 0x7f6af0003a60 2023-10-06T02:21:04.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.621+0000 7f6b0e785700 1 -- 172.21.15.6:0/21261925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6af0003a60 msgr2=0x7f6af0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.621+0000 7f6b0e785700 1 --2- 172.21.15.6:0/21261925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6af0003a60 0x7f6af0003e70 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00c390 tx=0x7f6b080cb630 comp rx=0 tx=0).stop 2023-10-06T02:21:04.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.621+0000 7f6b0e785700 1 -- 172.21.15.6:0/21261925 shutdown_connections 2023-10-06T02:21:04.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.621+0000 7f6b0e785700 1 --2- 172.21.15.6:0/21261925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6af0003a60 0x7f6af0003e70 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.621+0000 7f6b0e785700 1 -- 172.21.15.6:0/21261925 >> 172.21.15.6:0/21261925 conn(0x7f6b08068680 msgr2=0x7f6b08068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:04.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.621+0000 7f6b0e785700 1 -- 172.21.15.6:0/21261925 shutdown_connections 2023-10-06T02:21:04.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.621+0000 7f6b0e785700 1 -- 172.21.15.6:0/21261925 wait complete. 2023-10-06T02:21:04.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.622+0000 7f6b0e785700 1 Processor -- start 2023-10-06T02:21:04.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.622+0000 7f6b0e785700 1 -- start start 2023-10-06T02:21:04.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.623+0000 7f6b0e785700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6af0003a60 0x7f6b080c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.623+0000 7f6b0e785700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b080ca390 0x7f6b0816d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.623+0000 7f6b0e785700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b0816d8e0 0x7f6b0815b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.623+0000 7f6b0e785700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0816dd60 con 0x7f6b0816d8e0 2023-10-06T02:21:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.623+0000 7f6b0e785700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0815c280 con 0x7f6b080ca390 2023-10-06T02:21:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.623+0000 7f6b0e785700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0815c560 con 0x7f6af0003a60 2023-10-06T02:21:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.623+0000 7f6b0cd22700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b0816d8e0 0x7f6b0815b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.623+0000 7f6b0cd22700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b0816d8e0 0x7f6b0815b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41034/0 (socket says 172.21.15.6:41034) 2023-10-06T02:21:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.623+0000 7f6b0cd22700 1 -- 172.21.15.6:0/1257509329 learned_addr learned my addr 172.21.15.6:0/1257509329 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.623+0000 7f6b077fe700 1 --2- 172.21.15.6:0/1257509329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b080ca390 0x7f6b0816d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.623+0000 7f6b07fff700 1 --2- 172.21.15.6:0/1257509329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6af0003a60 0x7f6b080c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.623+0000 7f6b0cd22700 1 -- 172.21.15.6:0/1257509329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6af0003a60 msgr2=0x7f6b080c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.623+0000 7f6b0cd22700 1 --2- 172.21.15.6:0/1257509329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6af0003a60 0x7f6b080c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.623+0000 7f6b0cd22700 1 -- 172.21.15.6:0/1257509329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b080ca390 msgr2=0x7f6b0816d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.623+0000 7f6b0cd22700 1 --2- 172.21.15.6:0/1257509329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b080ca390 0x7f6b0816d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.623+0000 7f6b0cd22700 1 -- 172.21.15.6:0/1257509329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0815c840 con 0x7f6b0816d8e0 2023-10-06T02:21:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.624+0000 7f6b0cd22700 1 --2- 172.21.15.6:0/1257509329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b0816d8e0 0x7f6b0815b550 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6b080ca820 tx=0x7f6b00009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.624+0000 7f6aeffff700 1 -- 172.21.15.6:0/1257509329 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00012590 con 0x7f6b0816d8e0 2023-10-06T02:21:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.624+0000 7f6aeffff700 1 -- 172.21.15.6:0/1257509329 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b000126f0 con 0x7f6b0816d8e0 2023-10-06T02:21:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.624+0000 7f6b0e785700 1 -- 172.21.15.6:0/1257509329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0815cb20 con 0x7f6b0816d8e0 2023-10-06T02:21:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.624+0000 7f6aeffff700 1 -- 172.21.15.6:0/1257509329 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00012a70 con 0x7f6b0816d8e0 2023-10-06T02:21:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.624+0000 7f6b0e785700 1 -- 172.21.15.6:0/1257509329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0815ba90 con 0x7f6b0816d8e0 2023-10-06T02:21:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.625+0000 7f6b0e785700 1 -- 172.21.15.6:0/1257509329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b080cf0d0 con 0x7f6b0816d8e0 2023-10-06T02:21:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.625+0000 7f6aeffff700 1 -- 172.21.15.6:0/1257509329 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b00003030 con 0x7f6b0816d8e0 2023-10-06T02:21:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.626+0000 7f6aeffff700 1 --2- 172.21.15.6:0/1257509329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6af4066f30 0x7f6af40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.626+0000 7f6aeffff700 1 -- 172.21.15.6:0/1257509329 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6b000845d0 con 0x7f6b0816d8e0 2023-10-06T02:21:04.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.626+0000 7f6b07fff700 1 --2- 172.21.15.6:0/1257509329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6af4066f30 0x7f6af40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:04.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.626+0000 7f6b07fff700 1 --2- 172.21.15.6:0/1257509329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6af4066f30 0x7f6af40693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6afc007cd0 tx=0x7f6afc015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:04.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.630+0000 7f6aeffff700 1 -- 172.21.15.6:0/1257509329 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b080cf0d0 con 0x7f6b0816d8e0 2023-10-06T02:21:04.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.869+0000 7f6b0e785700 1 -- 172.21.15.6:0/1257509329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6b080cf0d0 con 0x7f6b0816d8e0 2023-10-06T02:21:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.869+0000 7f6aeffff700 1 -- 172.21.15.6:0/1257509329 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6b080cf0d0 con 0x7f6b0816d8e0 2023-10-06T02:21:04.870 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:21:04.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.872+0000 7f6b0e785700 1 -- 172.21.15.6:0/1257509329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6af4066f30 msgr2=0x7f6af40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.872+0000 7f6b0e785700 1 --2- 172.21.15.6:0/1257509329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6af4066f30 0x7f6af40693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6afc007cd0 tx=0x7f6afc015000 comp rx=0 tx=0).stop 2023-10-06T02:21:04.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.872+0000 7f6b0e785700 1 -- 172.21.15.6:0/1257509329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b0816d8e0 msgr2=0x7f6b0815b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:04.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.872+0000 7f6b0e785700 1 --2- 172.21.15.6:0/1257509329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b0816d8e0 0x7f6b0815b550 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6b080ca820 tx=0x7f6b00009040 comp rx=0 tx=0).stop 2023-10-06T02:21:04.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.872+0000 7f6b0e785700 1 -- 172.21.15.6:0/1257509329 shutdown_connections 2023-10-06T02:21:04.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.872+0000 7f6b0e785700 1 --2- 172.21.15.6:0/1257509329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6af4066f30 0x7f6af40693e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.872+0000 7f6b0e785700 1 --2- 172.21.15.6:0/1257509329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b0816d8e0 0x7f6b0815b550 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.872+0000 7f6b0e785700 1 --2- 172.21.15.6:0/1257509329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6af0003a60 0x7f6b080c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.872+0000 7f6b0e785700 1 --2- 172.21.15.6:0/1257509329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b080ca390 0x7f6b0816d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:04.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.872+0000 7f6b0e785700 1 -- 172.21.15.6:0/1257509329 >> 172.21.15.6:0/1257509329 conn(0x7f6b08068680 msgr2=0x7f6b081568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:04.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.872+0000 7f6b0e785700 1 -- 172.21.15.6:0/1257509329 shutdown_connections 2023-10-06T02:21:04.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:04.872+0000 7f6b0e785700 1 -- 172.21.15.6:0/1257509329 wait complete. 2023-10-06T02:21:04.884 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:21:04.884 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:21:04.884 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:21:04.885 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:21:04.885 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:21:04.885 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:21:04.885 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:21:04.885 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:21:04.885 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:21:04.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:21:04.886 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:21:04.901 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:21:04.901 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:21:04.901 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:21:04.901 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:21:04.902 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:21:04.902 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:21:04.902 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:21:04.902 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:21:04.902 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:21:04.902 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:21:04.902 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:21:04.902 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:21:04.902 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:21:04.902 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:21:04.902 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:21:04.902 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:21:04.903 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42281sec preferred_lft 42281sec 2023-10-06T02:21:04.903 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:21:04.903 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:21:04.903 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:21:04.903 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:21:04.903 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:21:04.903 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:21:04.903 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:21:04.904 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:21:04.904 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:21:04.904 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:21:04.904 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:21:04.905 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:21:04.905 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:21:04.905 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:21:04.905 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:21:04.905 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:21:04.905 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:21:04.905 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:21:04.905 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:21:04.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:21:04.906 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:21:04.965 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:21:04.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:21:04.966 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:21:05.023 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:21:05.023 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:21:05.023 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:21:05.023 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:21:05.023 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:21:05.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:21:05.024 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:21:05.024 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:21:05.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:21:05.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:21:05.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:21:05.024 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:21:05.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:21:05.127 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:21:05.142 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:21:05.143 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:21:05.143 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:21:05.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:21:05.143 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:21:05.208 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:21:05.208 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:21:05.209 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:21:05.264 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:21:05.264 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:21:05.264 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:21:05.319 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:21:05.384 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:21:05.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:21:05.449 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:21:05.450 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:21:05.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:21:05.451 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:21:05.506 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:21:05.506 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:21:05.548 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:21:05.573 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:21:05.573 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:21:05.631 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:21:05.631+0000 7f09b8a35540 -1 init, newargv = 0x55a188f7b9b0 newargc=15 2023-10-06T02:21:05.631 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[114519]: starting ceph client 2023-10-06T02:21:05.636 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[114519]: starting fuse 2023-10-06T02:21:05.640 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:21:05.641 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:21:05.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:21:05.642 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:21:05.697 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:21:05.697 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:21:05.698 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:21:05.698 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:21:05.698 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:21:05.698 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:21:05.698 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:21:05.698 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:21:05.698 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:21:05.698 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:21:05.699 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:21:05.699 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:21:05.699 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:21:05.699 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:21:05.699 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:21:05.699 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:21:05.699 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:21:05.699 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:21:05.699 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:21:05.700 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:21:05.700 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:21:05.700 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:21:05.700 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:21:05.700 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:21:05.700 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:21:05.700 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:21:05.700 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:21:05.700 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:21:05.701 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:21:05.820 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.114519.asok 2023-10-06T02:21:06.002 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.114519.asok 2023-10-06T02:21:06.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:21:06.002 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.114519.asok status 2023-10-06T02:21:06.157 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:21:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:21:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:21:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:21:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:21:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:21:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:21:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "114519", 2023-10-06T02:21:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:21:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:21:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:21:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:21:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 6438, 2023-10-06T02:21:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:21:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:21:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:21:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 6438 2023-10-06T02:21:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:21:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:21:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:21:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:21:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3324065241 2023-10-06T02:21:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:21:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:21:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:21:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:21:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:21:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3324065241 2023-10-06T02:21:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:21:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.6438 192.168.0.1:0/3324065241", 2023-10-06T02:21:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/3324065241", 2023-10-06T02:21:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:21:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 49, 2023-10-06T02:21:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 66, 2023-10-06T02:21:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:21:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:21:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:21:06.160 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:21:06.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:21:06.167 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:21:06.167 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:21:06.183 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:21:06.183 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:21:06.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:21:06.184 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:21:06.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:21:06.250 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'chmod 711 a/b/d; sync .') 2023-10-06T02:21:06.326 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:21:06.326 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:21:06.326 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:21:06.400 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[114519]: fuse finished with error 0 and tester_r 0 2023-10-06T02:21:06.401 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:21:06.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:21:06.401 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:21:06.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:21:06.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.639+0000 7fb089783700 1 Processor -- start 2023-10-06T02:21:06.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.639+0000 7fb089783700 1 -- start start 2023-10-06T02:21:06.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.640+0000 7fb089783700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0841574b0 0x7fb0840b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:06.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.640+0000 7fb089783700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0840c46e0 0x7fb0840cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:06.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.640+0000 7fb089783700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0840c3b40 con 0x7fb0840b13f0 2023-10-06T02:21:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.640+0000 7fb089783700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0840c2f30 con 0x7fb0841574b0 2023-10-06T02:21:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.640+0000 7fb089783700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840c3210 con 0x7fb0840c46e0 2023-10-06T02:21:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.640+0000 7fb082ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0841574b0 0x7fb0840b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.640+0000 7fb082ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0841574b0 0x7fb0840b0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41040/0 (socket says 172.21.15.6:41040) 2023-10-06T02:21:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.640+0000 7fb082ffd700 1 -- 172.21.15.6:0/2416197596 learned_addr learned my addr 172.21.15.6:0/2416197596 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.640+0000 7fb0837fe700 1 --2- 172.21.15.6:0/2416197596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0840c46e0 0x7fb0840cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.640+0000 7fb082ffd700 1 -- 172.21.15.6:0/2416197596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0840c46e0 msgr2=0x7fb0840cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.640+0000 7fb082ffd700 1 --2- 172.21.15.6:0/2416197596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0840c46e0 0x7fb0840cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.640+0000 7fb082ffd700 1 -- 172.21.15.6:0/2416197596 >> v1:172.21.15.175:6789/0 conn(0x7fb0840b13f0 legacy=0x7fb0840c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.640+0000 7fb082ffd700 1 -- 172.21.15.6:0/2416197596 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0840c34f0 con 0x7fb0841574b0 2023-10-06T02:21:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.640+0000 7fb082ffd700 1 --2- 172.21.15.6:0/2416197596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0841574b0 0x7fb0840b0eb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009f70 tx=0x7fb07c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf230d342fe67fed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.640+0000 7fb081ffb700 1 -- 172.21.15.6:0/2416197596 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c00e070 con 0x7fb0841574b0 2023-10-06T02:21:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.641+0000 7fb081ffb700 1 -- 172.21.15.6:0/2416197596 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c00bad0 con 0x7fb0841574b0 2023-10-06T02:21:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.641+0000 7fb081ffb700 1 -- 172.21.15.6:0/2416197596 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0092e0 con 0x7fb0841574b0 2023-10-06T02:21:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.641+0000 7fb089783700 1 -- 172.21.15.6:0/2416197596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0841574b0 msgr2=0x7fb0840b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.641+0000 7fb089783700 1 --2- 172.21.15.6:0/2416197596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0841574b0 0x7fb0840b0eb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009f70 tx=0x7fb07c009840 comp rx=0 tx=0).stop 2023-10-06T02:21:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.641+0000 7fb089783700 1 -- 172.21.15.6:0/2416197596 shutdown_connections 2023-10-06T02:21:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.641+0000 7fb089783700 1 --2- 172.21.15.6:0/2416197596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0840c46e0 0x7fb0840cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.641+0000 7fb089783700 1 --2- 172.21.15.6:0/2416197596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0841574b0 0x7fb0840b0eb0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.641+0000 7fb089783700 1 -- 172.21.15.6:0/2416197596 >> 172.21.15.6:0/2416197596 conn(0x7fb084067910 msgr2=0x7fb0840ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.641+0000 7fb089783700 1 -- 172.21.15.6:0/2416197596 shutdown_connections 2023-10-06T02:21:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.641+0000 7fb089783700 1 -- 172.21.15.6:0/2416197596 wait complete. 2023-10-06T02:21:06.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.642+0000 7fb089783700 1 Processor -- start 2023-10-06T02:21:06.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.642+0000 7fb089783700 1 -- start start 2023-10-06T02:21:06.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.643+0000 7fb089783700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0840b13f0 0x7fb0840af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:06.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.643+0000 7fb089783700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0840c46e0 0x7fb0840c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:06.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.643+0000 7fb089783700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0841574b0 0x7fb0840ce860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:06.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.643+0000 7fb089783700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0841558a0 con 0x7fb0840c46e0 2023-10-06T02:21:06.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.643+0000 7fb089783700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0841552e0 con 0x7fb0841574b0 2023-10-06T02:21:06.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.643+0000 7fb089783700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0841555c0 con 0x7fb0840b13f0 2023-10-06T02:21:06.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.643+0000 7fb0827fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0840c46e0 0x7fb0840c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:06.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.643+0000 7fb0827fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0840c46e0 0x7fb0840c7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41052/0 (socket says 172.21.15.6:41052) 2023-10-06T02:21:06.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.643+0000 7fb0827fc700 1 -- 172.21.15.6:0/3175726298 learned_addr learned my addr 172.21.15.6:0/3175726298 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:06.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.643+0000 7fb0837fe700 1 --2- 172.21.15.6:0/3175726298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0841574b0 0x7fb0840ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:06.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.643+0000 7fb082ffd700 1 --2- 172.21.15.6:0/3175726298 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0840b13f0 0x7fb0840af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:06.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.643+0000 7fb0827fc700 1 -- 172.21.15.6:0/3175726298 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0840b13f0 msgr2=0x7fb0840af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:06.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.643+0000 7fb0827fc700 1 --2- 172.21.15.6:0/3175726298 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0840b13f0 0x7fb0840af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:06.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.643+0000 7fb0827fc700 1 -- 172.21.15.6:0/3175726298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0841574b0 msgr2=0x7fb0840ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:06.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.643+0000 7fb0827fc700 1 --2- 172.21.15.6:0/3175726298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0841574b0 0x7fb0840ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:06.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.644+0000 7fb0827fc700 1 -- 172.21.15.6:0/3175726298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c009ae0 con 0x7fb0840c46e0 2023-10-06T02:21:06.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.644+0000 7fb0827fc700 1 --2- 172.21.15.6:0/3175726298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0840c46e0 0x7fb0840c7930 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00c590 tx=0x7fb06c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:06.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.644+0000 7fb07affd700 1 -- 172.21.15.6:0/3175726298 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c011590 con 0x7fb0840c46e0 2023-10-06T02:21:06.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.644+0000 7fb07affd700 1 -- 172.21.15.6:0/3175726298 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c011710 con 0x7fb0840c46e0 2023-10-06T02:21:06.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.644+0000 7fb089783700 1 -- 172.21.15.6:0/3175726298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0840af050 con 0x7fb0840c46e0 2023-10-06T02:21:06.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.644+0000 7fb07affd700 1 -- 172.21.15.6:0/3175726298 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c011ad0 con 0x7fb0840c46e0 2023-10-06T02:21:06.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.644+0000 7fb089783700 1 -- 172.21.15.6:0/3175726298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0840afd90 con 0x7fb0840c46e0 2023-10-06T02:21:06.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.645+0000 7fb089783700 1 -- 172.21.15.6:0/3175726298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08406e590 con 0x7fb0840c46e0 2023-10-06T02:21:06.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.645+0000 7fb07affd700 1 -- 172.21.15.6:0/3175726298 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb06c01b3b0 con 0x7fb0840c46e0 2023-10-06T02:21:06.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.646+0000 7fb07affd700 1 --2- 172.21.15.6:0/3175726298 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb064066f30 0x7fb0640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:06.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.646+0000 7fb07affd700 1 -- 172.21.15.6:0/3175726298 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb06c083ce0 con 0x7fb0840c46e0 2023-10-06T02:21:06.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.646+0000 7fb082ffd700 1 --2- 172.21.15.6:0/3175726298 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb064066f30 0x7fb0640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:06.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.646+0000 7fb082ffd700 1 --2- 172.21.15.6:0/3175726298 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb064066f30 0x7fb0640693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb0840b1a40 tx=0x7fb07c018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:06.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.650+0000 7fb07affd700 1 -- 172.21.15.6:0/3175726298 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb06c050c10 con 0x7fb0840c46e0 2023-10-06T02:21:06.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.889+0000 7fb089783700 1 -- 172.21.15.6:0/3175726298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb0840c37d0 con 0x7fb0840c46e0 2023-10-06T02:21:06.890 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:21:06.890+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:21:06.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.895+0000 7fb07affd700 1 -- 172.21.15.6:0/3175726298 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb06c017070 con 0x7fb0840c46e0 2023-10-06T02:21:06.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.898+0000 7fb089783700 1 -- 172.21.15.6:0/3175726298 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb064066f30 msgr2=0x7fb0640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:06.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.898+0000 7fb089783700 1 --2- 172.21.15.6:0/3175726298 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb064066f30 0x7fb0640693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb0840b1a40 tx=0x7fb07c018000 comp rx=0 tx=0).stop 2023-10-06T02:21:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.898+0000 7fb089783700 1 -- 172.21.15.6:0/3175726298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0840c46e0 msgr2=0x7fb0840c7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.898+0000 7fb089783700 1 --2- 172.21.15.6:0/3175726298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0840c46e0 0x7fb0840c7930 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00c590 tx=0x7fb06c00c8a0 comp rx=0 tx=0).stop 2023-10-06T02:21:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.898+0000 7fb089783700 1 -- 172.21.15.6:0/3175726298 shutdown_connections 2023-10-06T02:21:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.898+0000 7fb089783700 1 --2- 172.21.15.6:0/3175726298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0841574b0 0x7fb0840ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.898+0000 7fb089783700 1 --2- 172.21.15.6:0/3175726298 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0840b13f0 0x7fb0840af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.898+0000 7fb089783700 1 --2- 172.21.15.6:0/3175726298 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb064066f30 0x7fb0640693e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.898+0000 7fb089783700 1 --2- 172.21.15.6:0/3175726298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0840c46e0 0x7fb0840c7930 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.898+0000 7fb089783700 1 -- 172.21.15.6:0/3175726298 >> 172.21.15.6:0/3175726298 conn(0x7fb084067910 msgr2=0x7fb0841536c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.898+0000 7fb089783700 1 -- 172.21.15.6:0/3175726298 shutdown_connections 2023-10-06T02:21:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:06.898+0000 7fb089783700 1 -- 172.21.15.6:0/3175726298 wait complete. 2023-10-06T02:21:06.900 INFO:tasks.ceph.mds.b.smithi175.stderr: -4563> 2023-10-06T02:20:56.132+0000 7f1929c06700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:21:06.900 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:21:06.910 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_inject_journal_corrupt_dentry_first 1.0 2023-10-06T02:21:06.926 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-10-06T02:21:07.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.032+0000 7f6377e4f700 1 Processor -- start 2023-10-06T02:21:07.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.032+0000 7f6377e4f700 1 -- start start 2023-10-06T02:21:07.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.033+0000 7f6377e4f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f637015cae0 0x7f63700c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:07.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.033+0000 7f6377e4f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637006a1a0 con 0x7f63700cc740 2023-10-06T02:21:07.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.033+0000 7f6377e4f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637006a480 con 0x7f637006a910 2023-10-06T02:21:07.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.033+0000 7f6377e4f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63700c3f40 con 0x7f637015cae0 2023-10-06T02:21:07.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.033+0000 7f63763ec700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f63700cc740 0x7f63700ccbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43598/0 (socket says 172.21.15.6:43598) 2023-10-06T02:21:07.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.033+0000 7f63763ec700 1 -- 172.21.15.6:0/1580893739 learned_addr learned my addr 172.21.15.6:0/1580893739 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:21:07.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6375beb700 1 --2- 172.21.15.6:0/1580893739 >> v2:172.21.15.175:3300/0 conn(0x7f637015cae0 0x7f63700c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:07.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6374be9700 1 -- 172.21.15.6:0/1580893739 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078277856 0 0) 0x7f637006a1a0 con 0x7f63700cc740 2023-10-06T02:21:07.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6374be9700 1 -- 172.21.15.6:0/1580893739 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6358003570 con 0x7f63700cc740 2023-10-06T02:21:07.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6374be9700 1 -- 172.21.15.6:0/1580893739 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1212361345 0 0) 0x7f6358003570 con 0x7f63700cc740 2023-10-06T02:21:07.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6374be9700 1 -- 172.21.15.6:0/1580893739 >> v2:172.21.15.175:3300/0 conn(0x7f637015cae0 msgr2=0x7f63700c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:07.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6374be9700 1 --2- 172.21.15.6:0/1580893739 >> v2:172.21.15.175:3300/0 conn(0x7f637015cae0 0x7f63700c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:07.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6374be9700 1 -- 172.21.15.6:0/1580893739 >> v1:172.21.15.175:6789/0 conn(0x7f637006a910 legacy=0x7f637006ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:07.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6374be9700 1 -- 172.21.15.6:0/1580893739 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63700c4220 con 0x7f63700cc740 2023-10-06T02:21:07.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6374be9700 1 -- 172.21.15.6:0/1580893739 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f63600017f0 con 0x7f63700cc740 2023-10-06T02:21:07.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6374be9700 1 -- 172.21.15.6:0/1580893739 >> v1:172.21.15.6:6789/0 conn(0x7f63700cc740 legacy=0x7f63700ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:07.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6374be9700 1 --2- 172.21.15.6:0/1580893739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6358003a60 0x7f6358003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:07.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6374be9700 1 --2- 172.21.15.6:0/1580893739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6358004810 0x7f6358004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:07.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6374be9700 1 --2- 172.21.15.6:0/1580893739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63580051c0 0x7f635800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:07.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6374be9700 1 -- 172.21.15.6:0/1580893739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63700c3f40 con 0x7f6358003a60 2023-10-06T02:21:07.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6374be9700 1 -- 172.21.15.6:0/1580893739 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635800c0d0 con 0x7f63580051c0 2023-10-06T02:21:07.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6374be9700 1 -- 172.21.15.6:0/1580893739 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635800c290 con 0x7f6358004810 2023-10-06T02:21:07.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6375beb700 1 --2- 172.21.15.6:0/1580893739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6358003a60 0x7f6358003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:07.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f63763ec700 1 --2- 172.21.15.6:0/1580893739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63580051c0 0x7f635800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:07.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f63753ea700 1 --2- 172.21.15.6:0/1580893739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6358004810 0x7f6358004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:07.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6375beb700 1 -- 172.21.15.6:0/1580893739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6358004810 msgr2=0x7f6358004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:07.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6375beb700 1 --2- 172.21.15.6:0/1580893739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6358004810 0x7f6358004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:07.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6375beb700 1 -- 172.21.15.6:0/1580893739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63580051c0 msgr2=0x7f635800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:07.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6375beb700 1 --2- 172.21.15.6:0/1580893739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63580051c0 0x7f635800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:07.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f63763ec700 1 -- 172.21.15.6:0/1580893739 reap_dead start 2023-10-06T02:21:07.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.034+0000 7f6375beb700 1 -- 172.21.15.6:0/1580893739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6358003570 con 0x7f6358003a60 2023-10-06T02:21:07.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.035+0000 7f6375beb700 1 --2- 172.21.15.6:0/1580893739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6358003a60 0x7f6358003e70 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6368009bf0 tx=0x7f6368009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c9a2b6dc907913 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:07.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.035+0000 7f6374be9700 1 -- 172.21.15.6:0/1580893739 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6368005a00 con 0x7f6358003a60 2023-10-06T02:21:07.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.035+0000 7f6374be9700 1 -- 172.21.15.6:0/1580893739 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6368005b60 con 0x7f6358003a60 2023-10-06T02:21:07.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.035+0000 7f6374be9700 1 -- 172.21.15.6:0/1580893739 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636800e710 con 0x7f6358003a60 2023-10-06T02:21:07.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.035+0000 7f6377e4f700 1 -- 172.21.15.6:0/1580893739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6358003a60 msgr2=0x7f6358003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:07.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.035+0000 7f6377e4f700 1 --2- 172.21.15.6:0/1580893739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6358003a60 0x7f6358003e70 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6368009bf0 tx=0x7f6368009120 comp rx=0 tx=0).stop 2023-10-06T02:21:07.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.035+0000 7f6377e4f700 1 -- 172.21.15.6:0/1580893739 shutdown_connections 2023-10-06T02:21:07.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.035+0000 7f6377e4f700 1 --2- 172.21.15.6:0/1580893739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6358003a60 0x7f6358003e70 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.035+0000 7f6377e4f700 1 -- 172.21.15.6:0/1580893739 >> 172.21.15.6:0/1580893739 conn(0x7f6370067910 msgr2=0x7f63700ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.036+0000 7f6377e4f700 1 -- 172.21.15.6:0/1580893739 shutdown_connections 2023-10-06T02:21:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.036+0000 7f6377e4f700 1 -- 172.21.15.6:0/1580893739 wait complete. 2023-10-06T02:21:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.037+0000 7f6377e4f700 1 Processor -- start 2023-10-06T02:21:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.037+0000 7f6377e4f700 1 -- start start 2023-10-06T02:21:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.037+0000 7f6377e4f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6358003a60 0x7f63700b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.037+0000 7f6377e4f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63700b3000 0x7f63700cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.037+0000 7f6377e4f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63700cb3d0 0x7f6370158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.037+0000 7f6377e4f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63700b2730 con 0x7f63700b3000 2023-10-06T02:21:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.037+0000 7f6377e4f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6370169d10 con 0x7f6358003a60 2023-10-06T02:21:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.037+0000 7f6377e4f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6370169ff0 con 0x7f63700cb3d0 2023-10-06T02:21:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.037+0000 7f63753ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63700b3000 0x7f63700cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.037+0000 7f63753ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63700b3000 0x7f63700cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41076/0 (socket says 172.21.15.6:41076) 2023-10-06T02:21:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.037+0000 7f63753ea700 1 -- 172.21.15.6:0/1078026329 learned_addr learned my addr 172.21.15.6:0/1078026329 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.038+0000 7f6375beb700 1 --2- 172.21.15.6:0/1078026329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6358003a60 0x7f63700b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.038+0000 7f63763ec700 1 --2- 172.21.15.6:0/1078026329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63700cb3d0 0x7f6370158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.038+0000 7f63753ea700 1 -- 172.21.15.6:0/1078026329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63700cb3d0 msgr2=0x7f6370158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:07.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.038+0000 7f63753ea700 1 --2- 172.21.15.6:0/1078026329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63700cb3d0 0x7f6370158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:07.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.038+0000 7f63753ea700 1 -- 172.21.15.6:0/1078026329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6358003a60 msgr2=0x7f63700b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:07.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.038+0000 7f63753ea700 1 --2- 172.21.15.6:0/1078026329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6358003a60 0x7f63700b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:07.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.038+0000 7f63753ea700 1 -- 172.21.15.6:0/1078026329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637016a2d0 con 0x7f63700b3000 2023-10-06T02:21:07.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.038+0000 7f63753ea700 1 --2- 172.21.15.6:0/1078026329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63700b3000 0x7f63700cae90 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f6364002950 tx=0x7f6364007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:07.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.038+0000 7f636dffb700 1 -- 172.21.15.6:0/1078026329 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364002e90 con 0x7f63700b3000 2023-10-06T02:21:07.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.038+0000 7f636dffb700 1 -- 172.21.15.6:0/1078026329 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636400f8d0 con 0x7f63700b3000 2023-10-06T02:21:07.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.038+0000 7f6377e4f700 1 -- 172.21.15.6:0/1078026329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637016a5b0 con 0x7f63700b3000 2023-10-06T02:21:07.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.038+0000 7f636dffb700 1 -- 172.21.15.6:0/1078026329 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636400fc90 con 0x7f63700b3000 2023-10-06T02:21:07.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.038+0000 7f6377e4f700 1 -- 172.21.15.6:0/1078026329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63701699c0 con 0x7f63700b3000 2023-10-06T02:21:07.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.039+0000 7f6377e4f700 1 -- 172.21.15.6:0/1078026329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63700cb7d0 con 0x7f63700b3000 2023-10-06T02:21:07.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.040+0000 7f636dffb700 1 -- 172.21.15.6:0/1078026329 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6364006a30 con 0x7f63700b3000 2023-10-06T02:21:07.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.040+0000 7f636dffb700 1 --2- 172.21.15.6:0/1078026329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f635c066f30 0x7f635c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:07.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.040+0000 7f636dffb700 1 -- 172.21.15.6:0/1078026329 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f6364084820 con 0x7f63700b3000 2023-10-06T02:21:07.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.040+0000 7f6375beb700 1 --2- 172.21.15.6:0/1078026329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f635c066f30 0x7f635c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:07.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.041+0000 7f6375beb700 1 --2- 172.21.15.6:0/1078026329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f635c066f30 0x7f635c0693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6368009160 tx=0x7f6368019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:07.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.044+0000 7f636dffb700 1 -- 172.21.15.6:0/1078026329 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63640517a0 con 0x7f63700b3000 2023-10-06T02:21:07.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.237+0000 7f6377e4f700 1 -- 172.21.15.6:0/1078026329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_inject_journal_corrupt_dentry_first}] v 0) v1 -- 0x7f6370068420 con 0x7f63700b3000 2023-10-06T02:21:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.241+0000 7f636dffb700 1 -- 172.21.15.6:0/1078026329 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_inject_journal_corrupt_dentry_first}]=0 v19)=0 v19) v1 ==== 139+0+0 (secure 0 0 0) 0x7f6364054dc0 con 0x7f63700b3000 2023-10-06T02:21:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.243+0000 7f6377e4f700 1 -- 172.21.15.6:0/1078026329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f635c066f30 msgr2=0x7f635c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.243+0000 7f6377e4f700 1 --2- 172.21.15.6:0/1078026329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f635c066f30 0x7f635c0693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6368009160 tx=0x7f6368019000 comp rx=0 tx=0).stop 2023-10-06T02:21:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.243+0000 7f6377e4f700 1 -- 172.21.15.6:0/1078026329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63700b3000 msgr2=0x7f63700cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.243+0000 7f6377e4f700 1 --2- 172.21.15.6:0/1078026329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63700b3000 0x7f63700cae90 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f6364002950 tx=0x7f6364007d30 comp rx=0 tx=0).stop 2023-10-06T02:21:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.243+0000 7f6377e4f700 1 -- 172.21.15.6:0/1078026329 shutdown_connections 2023-10-06T02:21:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.243+0000 7f6377e4f700 1 --2- 172.21.15.6:0/1078026329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63700cb3d0 0x7f6370158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.243+0000 7f6377e4f700 1 --2- 172.21.15.6:0/1078026329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6358003a60 0x7f63700b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.243+0000 7f6377e4f700 1 --2- 172.21.15.6:0/1078026329 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f635c066f30 0x7f635c0693e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.243+0000 7f6377e4f700 1 --2- 172.21.15.6:0/1078026329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63700b3000 0x7f63700cae90 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.243+0000 7f6377e4f700 1 -- 172.21.15.6:0/1078026329 >> 172.21.15.6:0/1078026329 conn(0x7f6370067910 msgr2=0x7f637006c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.243+0000 7f6377e4f700 1 -- 172.21.15.6:0/1078026329 shutdown_connections 2023-10-06T02:21:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:07.243+0000 7f6377e4f700 1 -- 172.21.15.6:0/1078026329 wait complete. 2023-10-06T02:21:12.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:21:12.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.392+0000 7fb6a3861700 1 Processor -- start 2023-10-06T02:21:12.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.392+0000 7fb6a3861700 1 -- start start 2023-10-06T02:21:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.393+0000 7fb6a3861700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb69c0a8d90 0x7fb69c0af200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.393+0000 7fb6a3861700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb69c0b3820 0x7fb69c069790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.393+0000 7fb6a3861700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69c06b030 con 0x7fb69c0a89c0 2023-10-06T02:21:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.393+0000 7fb6a3861700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69c0b1ab0 con 0x7fb69c0a8d90 2023-10-06T02:21:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.393+0000 7fb6a3861700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c06ad50 con 0x7fb69c0b3820 2023-10-06T02:21:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.393+0000 7fb6a0dfc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb69c0a8d90 0x7fb69c0af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.393+0000 7fb6a0dfc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb69c0a8d90 0x7fb69c0af200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52174/0 (socket says 172.21.15.6:52174) 2023-10-06T02:21:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.393+0000 7fb6a15fd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb69c0a89c0 0x7fb69c0aeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45386/0 (socket says 172.21.15.6:45386) 2023-10-06T02:21:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.393+0000 7fb6a0dfc700 1 -- 172.21.15.6:0/2096124582 learned_addr learned my addr 172.21.15.6:0/2096124582 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.394+0000 7fb6a1dfe700 1 --2- 172.21.15.6:0/2096124582 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb69c0b3820 0x7fb69c069790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.394+0000 7fb6a0dfc700 1 -- 172.21.15.6:0/2096124582 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb69c0b3820 msgr2=0x7fb69c069790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.394+0000 7fb6a0dfc700 1 --2- 172.21.15.6:0/2096124582 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb69c0b3820 0x7fb69c069790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.394+0000 7fb6a0dfc700 1 -- 172.21.15.6:0/2096124582 >> v1:172.21.15.6:6789/0 conn(0x7fb69c0a89c0 legacy=0x7fb69c0aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.394+0000 7fb6a0dfc700 1 -- 172.21.15.6:0/2096124582 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c0b1d30 con 0x7fb69c0a8d90 2023-10-06T02:21:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.394+0000 7fb69bfff700 1 -- 172.21.15.6:0/2096124582 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676788805 0 0) 0x7fb69c06b030 con 0x7fb69c0a89c0 2023-10-06T02:21:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.394+0000 7fb6a1dfe700 1 --2- 172.21.15.6:0/2096124582 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb69c0b3820 0x7fb69c069790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:21:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.394+0000 7fb6a0dfc700 1 --2- 172.21.15.6:0/2096124582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb69c0a8d90 0x7fb69c0af200 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb6900099b0 tx=0x7fb690009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41982826528856dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.394+0000 7fb69bfff700 1 -- 172.21.15.6:0/2096124582 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69000b860 con 0x7fb69c0a8d90 2023-10-06T02:21:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.394+0000 7fb69bfff700 1 -- 172.21.15.6:0/2096124582 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69000b9c0 con 0x7fb69c0a8d90 2023-10-06T02:21:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.394+0000 7fb69bfff700 1 -- 172.21.15.6:0/2096124582 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69000bd60 con 0x7fb69c0a8d90 2023-10-06T02:21:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.395+0000 7fb6a3861700 1 -- 172.21.15.6:0/2096124582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb69c0a8d90 msgr2=0x7fb69c0af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.395+0000 7fb6a3861700 1 --2- 172.21.15.6:0/2096124582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb69c0a8d90 0x7fb69c0af200 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb6900099b0 tx=0x7fb690009250 comp rx=0 tx=0).stop 2023-10-06T02:21:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.395+0000 7fb6a3861700 1 -- 172.21.15.6:0/2096124582 shutdown_connections 2023-10-06T02:21:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.395+0000 7fb6a3861700 1 --2- 172.21.15.6:0/2096124582 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb69c0b3820 0x7fb69c069790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.395+0000 7fb6a3861700 1 --2- 172.21.15.6:0/2096124582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb69c0a8d90 0x7fb69c0af200 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.395+0000 7fb6a3861700 1 -- 172.21.15.6:0/2096124582 >> 172.21.15.6:0/2096124582 conn(0x7fb69c067910 msgr2=0x7fb69c0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.395+0000 7fb6a3861700 1 -- 172.21.15.6:0/2096124582 shutdown_connections 2023-10-06T02:21:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.395+0000 7fb6a3861700 1 -- 172.21.15.6:0/2096124582 wait complete. 2023-10-06T02:21:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.396+0000 7fb6a3861700 1 Processor -- start 2023-10-06T02:21:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.396+0000 7fb6a3861700 1 -- start start 2023-10-06T02:21:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.397+0000 7fb6a3861700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb69c0a89c0 0x7fb69c0c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.397+0000 7fb6a3861700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb69c0a8d90 0x7fb69c09a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.397+0000 7fb6a3861700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb69c0b3820 0x7fb69c0c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.397+0000 7fb6a3861700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c16ae70 con 0x7fb69c0a8d90 2023-10-06T02:21:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.397+0000 7fb6a3861700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c16a020 con 0x7fb69c0b3820 2023-10-06T02:21:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.397+0000 7fb6a3861700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c16a260 con 0x7fb69c0a89c0 2023-10-06T02:21:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.397+0000 7fb6a0dfc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb69c0a8d90 0x7fb69c09a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.397+0000 7fb6a0dfc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb69c0a8d90 0x7fb69c09a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52178/0 (socket says 172.21.15.6:52178) 2023-10-06T02:21:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.397+0000 7fb6a0dfc700 1 -- 172.21.15.6:0/1881675384 learned_addr learned my addr 172.21.15.6:0/1881675384 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.397+0000 7fb6a15fd700 1 --2- 172.21.15.6:0/1881675384 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb69c0a89c0 0x7fb69c0c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.397+0000 7fb6a1dfe700 1 --2- 172.21.15.6:0/1881675384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb69c0b3820 0x7fb69c0c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.397+0000 7fb6a0dfc700 1 -- 172.21.15.6:0/1881675384 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb69c0a89c0 msgr2=0x7fb69c0c2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.397+0000 7fb6a0dfc700 1 --2- 172.21.15.6:0/1881675384 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb69c0a89c0 0x7fb69c0c2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.397+0000 7fb6a0dfc700 1 -- 172.21.15.6:0/1881675384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb69c0b3820 msgr2=0x7fb69c0c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.397+0000 7fb6a0dfc700 1 --2- 172.21.15.6:0/1881675384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb69c0b3820 0x7fb69c0c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.397+0000 7fb6a0dfc700 1 -- 172.21.15.6:0/1881675384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6900094f0 con 0x7fb69c0a8d90 2023-10-06T02:21:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.398+0000 7fb6a0dfc700 1 --2- 172.21.15.6:0/1881675384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb69c0a8d90 0x7fb69c09a7a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb690009290 tx=0x7fb690017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.398+0000 7fb6997fa700 1 -- 172.21.15.6:0/1881675384 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb690011e40 con 0x7fb69c0a8d90 2023-10-06T02:21:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.398+0000 7fb6997fa700 1 -- 172.21.15.6:0/1881675384 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69001a420 con 0x7fb69c0a8d90 2023-10-06T02:21:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.398+0000 7fb6a3861700 1 -- 172.21.15.6:0/1881675384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69c16a540 con 0x7fb69c0a8d90 2023-10-06T02:21:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.398+0000 7fb6997fa700 1 -- 172.21.15.6:0/1881675384 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69001a7e0 con 0x7fb69c0a8d90 2023-10-06T02:21:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.398+0000 7fb6a3861700 1 -- 172.21.15.6:0/1881675384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69c16ab00 con 0x7fb69c0a8d90 2023-10-06T02:21:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.399+0000 7fb6a3861700 1 -- 172.21.15.6:0/1881675384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69c087170 con 0x7fb69c0a8d90 2023-10-06T02:21:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.399+0000 7fb6997fa700 1 -- 172.21.15.6:0/1881675384 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb69001ab50 con 0x7fb69c0a8d90 2023-10-06T02:21:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.400+0000 7fb6997fa700 1 --2- 172.21.15.6:0/1881675384 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb688066f30 0x7fb6880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.400+0000 7fb6997fa700 1 -- 172.21.15.6:0/1881675384 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fb690086210 con 0x7fb69c0a8d90 2023-10-06T02:21:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.400+0000 7fb6a15fd700 1 --2- 172.21.15.6:0/1881675384 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb688066f30 0x7fb6880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.400+0000 7fb6a15fd700 1 --2- 172.21.15.6:0/1881675384 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb688066f30 0x7fb6880693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb68c007fd0 tx=0x7fb68c001630 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:12.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.404+0000 7fb6997fa700 1 -- 172.21.15.6:0/1881675384 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb690053190 con 0x7fb69c0a8d90 2023-10-06T02:21:12.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.641+0000 7fb6a3861700 1 -- 172.21.15.6:0/1881675384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fb69c06e5d0 con 0x7fb69c0a8d90 2023-10-06T02:21:12.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.911+0000 7fb6997fa700 1 -- 172.21.15.6:0/1881675384 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v52) v1 ==== 162+0+0 (secure 0 0 0) 0x7fb6900567b0 con 0x7fb69c0a8d90 2023-10-06T02:21:12.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.914+0000 7fb6a3861700 1 -- 172.21.15.6:0/1881675384 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb688066f30 msgr2=0x7fb6880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:12.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.914+0000 7fb6a3861700 1 --2- 172.21.15.6:0/1881675384 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb688066f30 0x7fb6880693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb68c007fd0 tx=0x7fb68c001630 comp rx=0 tx=0).stop 2023-10-06T02:21:12.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.914+0000 7fb6a3861700 1 -- 172.21.15.6:0/1881675384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb69c0a8d90 msgr2=0x7fb69c09a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:12.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.914+0000 7fb6a3861700 1 --2- 172.21.15.6:0/1881675384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb69c0a8d90 0x7fb69c09a7a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb690009290 tx=0x7fb690017000 comp rx=0 tx=0).stop 2023-10-06T02:21:12.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.914+0000 7fb6a3861700 1 -- 172.21.15.6:0/1881675384 shutdown_connections 2023-10-06T02:21:12.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.914+0000 7fb6a3861700 1 --2- 172.21.15.6:0/1881675384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb69c0b3820 0x7fb69c0c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:12.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.914+0000 7fb6a3861700 1 --2- 172.21.15.6:0/1881675384 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb69c0a89c0 0x7fb69c0c2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:12.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.914+0000 7fb6a3861700 1 --2- 172.21.15.6:0/1881675384 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb688066f30 0x7fb6880693e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:12.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.914+0000 7fb6a3861700 1 --2- 172.21.15.6:0/1881675384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb69c0a8d90 0x7fb69c09a7a0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:12.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.914+0000 7fb6a3861700 1 -- 172.21.15.6:0/1881675384 >> 172.21.15.6:0/1881675384 conn(0x7fb69c067910 msgr2=0x7fb69c069750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:12.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.914+0000 7fb6a3861700 1 -- 172.21.15.6:0/1881675384 shutdown_connections 2023-10-06T02:21:12.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:12.914+0000 7fb6a3861700 1 -- 172.21.15.6:0/1881675384 wait complete. 2023-10-06T02:21:12.915 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:21:12.929 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:21:13.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.050+0000 7fa049965700 1 Processor -- start 2023-10-06T02:21:13.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.050+0000 7fa049965700 1 -- start start 2023-10-06T02:21:13.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.051+0000 7fa049965700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0440af8b0 0x7fa04415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:13.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.051+0000 7fa049965700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa0440b27f0 0x7fa04415d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:13.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.051+0000 7fa049965700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04415e190 con 0x7fa0440af4e0 2023-10-06T02:21:13.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.051+0000 7fa049965700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0440b1910 con 0x7fa0440af8b0 2023-10-06T02:21:13.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.051+0000 7fa049965700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0440cb650 con 0x7fa0440b27f0 2023-10-06T02:21:13.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.051+0000 7fa0427fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0440af8b0 0x7fa04415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:13.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.051+0000 7fa042ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa0440af4e0 0x7fa0440b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45388/0 (socket says 172.21.15.6:45388) 2023-10-06T02:21:13.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.051+0000 7fa042ffd700 1 -- 172.21.15.6:0/3295747137 learned_addr learned my addr 172.21.15.6:0/3295747137 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:21:13.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.051+0000 7fa0427fc700 1 -- 172.21.15.6:0/3295747137 >> v2:172.21.15.175:3300/0 conn(0x7fa0440b27f0 msgr2=0x7fa04415d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:13.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.051+0000 7fa0427fc700 1 --2- 172.21.15.6:0/3295747137 >> v2:172.21.15.175:3300/0 conn(0x7fa0440b27f0 0x7fa04415d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:13.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.051+0000 7fa0427fc700 1 -- 172.21.15.6:0/3295747137 >> v1:172.21.15.6:6789/0 conn(0x7fa0440af4e0 legacy=0x7fa0440b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:13.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.051+0000 7fa0427fc700 1 -- 172.21.15.6:0/3295747137 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0440ccaf0 con 0x7fa0440af8b0 2023-10-06T02:21:13.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.051+0000 7fa0427fc700 1 --2- 172.21.15.6:0/3295747137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0440af8b0 0x7fa04415d460 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa0440c7280 tx=0x7fa0380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22258983143a7c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:13.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.051+0000 7fa041ffb700 1 -- 172.21.15.6:0/3295747137 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038011630 con 0x7fa0440af8b0 2023-10-06T02:21:13.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.051+0000 7fa041ffb700 1 -- 172.21.15.6:0/3295747137 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa038011790 con 0x7fa0440af8b0 2023-10-06T02:21:13.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.051+0000 7fa041ffb700 1 -- 172.21.15.6:0/3295747137 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038011b30 con 0x7fa0440af8b0 2023-10-06T02:21:13.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.052+0000 7fa049965700 1 -- 172.21.15.6:0/3295747137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0440af8b0 msgr2=0x7fa04415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:13.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.052+0000 7fa049965700 1 --2- 172.21.15.6:0/3295747137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0440af8b0 0x7fa04415d460 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa0440c7280 tx=0x7fa0380091a0 comp rx=0 tx=0).stop 2023-10-06T02:21:13.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.052+0000 7fa049965700 1 -- 172.21.15.6:0/3295747137 shutdown_connections 2023-10-06T02:21:13.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.052+0000 7fa049965700 1 --2- 172.21.15.6:0/3295747137 >> v2:172.21.15.175:3300/0 conn(0x7fa0440b27f0 0x7fa04415d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:13.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.052+0000 7fa049965700 1 --2- 172.21.15.6:0/3295747137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0440af8b0 0x7fa04415d460 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:13.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.052+0000 7fa049965700 1 -- 172.21.15.6:0/3295747137 >> 172.21.15.6:0/3295747137 conn(0x7fa044068680 msgr2=0x7fa044068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:13.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.052+0000 7fa049965700 1 -- 172.21.15.6:0/3295747137 shutdown_connections 2023-10-06T02:21:13.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.052+0000 7fa049965700 1 -- 172.21.15.6:0/3295747137 wait complete. 2023-10-06T02:21:13.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.053+0000 7fa049965700 1 Processor -- start 2023-10-06T02:21:13.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.053+0000 7fa049965700 1 -- start start 2023-10-06T02:21:13.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.054+0000 7fa049965700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0440af4e0 0x7fa0440c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:13.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.054+0000 7fa049965700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0440af8b0 0x7fa0440c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:13.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.054+0000 7fa049965700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0440b27f0 0x7fa04414fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:13.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.054+0000 7fa049965700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0440ca370 con 0x7fa0440b27f0 2023-10-06T02:21:13.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.054+0000 7fa049965700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04414f250 con 0x7fa0440af8b0 2023-10-06T02:21:13.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.054+0000 7fa049965700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0440ce750 con 0x7fa0440af4e0 2023-10-06T02:21:13.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.054+0000 7fa0437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0440b27f0 0x7fa04414fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:13.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.054+0000 7fa0437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0440b27f0 0x7fa04414fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52204/0 (socket says 172.21.15.6:52204) 2023-10-06T02:21:13.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.054+0000 7fa0437fe700 1 -- 172.21.15.6:0/552949235 learned_addr learned my addr 172.21.15.6:0/552949235 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:13.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.054+0000 7fa0427fc700 1 --2- 172.21.15.6:0/552949235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0440af8b0 0x7fa0440c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:13.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.054+0000 7fa042ffd700 1 --2- 172.21.15.6:0/552949235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0440af4e0 0x7fa0440c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:13.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.054+0000 7fa0437fe700 1 -- 172.21.15.6:0/552949235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0440af4e0 msgr2=0x7fa0440c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:13.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.054+0000 7fa0437fe700 1 --2- 172.21.15.6:0/552949235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0440af4e0 0x7fa0440c7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:13.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.054+0000 7fa0437fe700 1 -- 172.21.15.6:0/552949235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0440af8b0 msgr2=0x7fa0440c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:13.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.054+0000 7fa0437fe700 1 --2- 172.21.15.6:0/552949235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0440af8b0 0x7fa0440c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:13.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.054+0000 7fa0437fe700 1 -- 172.21.15.6:0/552949235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa038009420 con 0x7fa0440b27f0 2023-10-06T02:21:13.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.054+0000 7fa0427fc700 1 --2- 172.21.15.6:0/552949235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0440af8b0 0x7fa0440c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:21:13.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.055+0000 7fa0437fe700 1 --2- 172.21.15.6:0/552949235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0440b27f0 0x7fa04414fc50 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00bc30 tx=0x7fa03c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:13.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.055+0000 7fa02affd700 1 -- 172.21.15.6:0/552949235 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c0092e0 con 0x7fa0440b27f0 2023-10-06T02:21:13.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.055+0000 7fa02affd700 1 -- 172.21.15.6:0/552949235 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c00c7a0 con 0x7fa0440b27f0 2023-10-06T02:21:13.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.055+0000 7fa02affd700 1 -- 172.21.15.6:0/552949235 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00cb80 con 0x7fa0440b27f0 2023-10-06T02:21:13.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.055+0000 7fa049965700 1 -- 172.21.15.6:0/552949235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04416aab0 con 0x7fa0440b27f0 2023-10-06T02:21:13.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.055+0000 7fa049965700 1 -- 172.21.15.6:0/552949235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0440c7390 con 0x7fa0440b27f0 2023-10-06T02:21:13.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.056+0000 7fa049965700 1 -- 172.21.15.6:0/552949235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa044088aa0 con 0x7fa0440b27f0 2023-10-06T02:21:13.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.056+0000 7fa02affd700 1 -- 172.21.15.6:0/552949235 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa03c012070 con 0x7fa0440b27f0 2023-10-06T02:21:13.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.056+0000 7fa02affd700 1 --2- 172.21.15.6:0/552949235 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa030066f30 0x7fa0300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:13.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.057+0000 7fa02affd700 1 -- 172.21.15.6:0/552949235 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fa03c0844e0 con 0x7fa0440b27f0 2023-10-06T02:21:13.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.057+0000 7fa042ffd700 1 --2- 172.21.15.6:0/552949235 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa030066f30 0x7fa0300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:13.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.057+0000 7fa042ffd700 1 --2- 172.21.15.6:0/552949235 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa030066f30 0x7fa0300693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa0340058d0 tx=0x7fa034009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:13.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.061+0000 7fa02affd700 1 -- 172.21.15.6:0/552949235 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa03c051460 con 0x7fa0440b27f0 2023-10-06T02:21:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.297+0000 7fa049965700 1 -- 172.21.15.6:0/552949235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0440b0910 con 0x7fa0440b27f0 2023-10-06T02:21:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.297+0000 7fa02affd700 1 -- 172.21.15.6:0/552949235 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fa03c054a80 con 0x7fa0440b27f0 2023-10-06T02:21:13.298 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:21:13.298 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":53,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/400475961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":400475961},{"type":"v1","addr":"172.21.15.175:6837","nonce":400475961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1006897436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1006897436},{"type":"v1","addr":"172.21.15.6:6835","nonce":1006897436}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:51.206714+0000","modified":"2023-10-06T02:21:12.912362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":67,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6210},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6210":{"gid":6210,"name":"c","rank":0,"incarnation":53,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6834/3777949337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3777949337},{"type":"v1","addr":"172.21.15.6:6834","nonce":3777949337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:21:13.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.299+0000 7fa049965700 1 -- 172.21.15.6:0/552949235 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa030066f30 msgr2=0x7fa0300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:13.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.299+0000 7fa049965700 1 --2- 172.21.15.6:0/552949235 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa030066f30 0x7fa0300693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa0340058d0 tx=0x7fa034009040 comp rx=0 tx=0).stop 2023-10-06T02:21:13.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.299+0000 7fa049965700 1 -- 172.21.15.6:0/552949235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0440b27f0 msgr2=0x7fa04414fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:13.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.299+0000 7fa049965700 1 --2- 172.21.15.6:0/552949235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0440b27f0 0x7fa04414fc50 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00bc30 tx=0x7fa03c009840 comp rx=0 tx=0).stop 2023-10-06T02:21:13.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.299+0000 7fa049965700 1 -- 172.21.15.6:0/552949235 shutdown_connections 2023-10-06T02:21:13.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.299+0000 7fa049965700 1 --2- 172.21.15.6:0/552949235 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa030066f30 0x7fa0300693e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:13.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.299+0000 7fa049965700 1 --2- 172.21.15.6:0/552949235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0440b27f0 0x7fa04414fc50 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:13.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.299+0000 7fa049965700 1 --2- 172.21.15.6:0/552949235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0440af4e0 0x7fa0440c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:13.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.299+0000 7fa049965700 1 --2- 172.21.15.6:0/552949235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0440af8b0 0x7fa0440c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:13.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.299+0000 7fa049965700 1 -- 172.21.15.6:0/552949235 >> 172.21.15.6:0/552949235 conn(0x7fa044068680 msgr2=0x7fa0440b5310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:13.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.299+0000 7fa049965700 1 -- 172.21.15.6:0/552949235 shutdown_connections 2023-10-06T02:21:13.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:13.299+0000 7fa049965700 1 -- 172.21.15.6:0/552949235 wait complete. 2023-10-06T02:21:13.301 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 53 2023-10-06T02:21:13.715 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:20:51.206714+0000', 'modified': '2023-10-06T02:21:12.912362+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 67, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6210}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6210': {'gid': 6210, 'name': 'c', 'rank': 0, 'incarnation': 53, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.6:6834/3777949337', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 3777949337}, {'type': 'v1', 'addr': '172.21.15.6:6834', 'nonce': 3777949337}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:21:13.715 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6210:up:replay 2023-10-06T02:21:14.715 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:21:14.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.850+0000 7fcaa45ca700 1 Processor -- start 2023-10-06T02:21:14.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.850+0000 7fcaa45ca700 1 -- start start 2023-10-06T02:21:14.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.851+0000 7fcaa45ca700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca9c142de0 0x7fca9c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:14.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.851+0000 7fcaa45ca700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fca9c0cd270 0x7fca9c0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:14.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.851+0000 7fcaa45ca700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9c0cf8a0 con 0x7fca9c1431b0 2023-10-06T02:21:14.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.851+0000 7fcaa45ca700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c0b4100 con 0x7fca9c0cd270 2023-10-06T02:21:14.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.851+0000 7fcaa45ca700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0cec90 con 0x7fca9c142de0 2023-10-06T02:21:14.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.851+0000 7fcaa1b65700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fca9c0cd270 0x7fca9c0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:14.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.851+0000 7fcaa1b65700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fca9c0cd270 0x7fca9c0d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52216/0 (socket says 172.21.15.6:52216) 2023-10-06T02:21:14.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.851+0000 7fcaa1b65700 1 -- 172.21.15.6:0/2750119265 learned_addr learned my addr 172.21.15.6:0/2750119265 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:14.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.851+0000 7fcaa2366700 1 --2- 172.21.15.6:0/2750119265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca9c142de0 0x7fca9c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:14.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.851+0000 7fcaa1b65700 1 -- 172.21.15.6:0/2750119265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca9c142de0 msgr2=0x7fca9c0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:14.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.851+0000 7fcaa1b65700 1 --2- 172.21.15.6:0/2750119265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca9c142de0 0x7fca9c0ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.851+0000 7fcaa1b65700 1 -- 172.21.15.6:0/2750119265 >> v1:172.21.15.175:6789/0 conn(0x7fca9c1431b0 legacy=0x7fca9c15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.851+0000 7fcaa1b65700 1 -- 172.21.15.6:0/2750119265 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c0cef70 con 0x7fca9c0cd270 2023-10-06T02:21:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.851+0000 7fcaa1b65700 1 --2- 172.21.15.6:0/2750119265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c0cd270 0x7fca9c0d0240 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0099b0 tx=0x7fca8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794fa002cfe78e8c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.852+0000 7fcaa1364700 1 -- 172.21.15.6:0/2750119265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c009ea0 con 0x7fca9c0cd270 2023-10-06T02:21:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.852+0000 7fcaa1364700 1 -- 172.21.15.6:0/2750119265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c00b860 con 0x7fca9c0cd270 2023-10-06T02:21:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.852+0000 7fcaa1364700 1 -- 172.21.15.6:0/2750119265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c00bc00 con 0x7fca9c0cd270 2023-10-06T02:21:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.852+0000 7fcaa45ca700 1 -- 172.21.15.6:0/2750119265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c0cd270 msgr2=0x7fca9c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.852+0000 7fcaa45ca700 1 --2- 172.21.15.6:0/2750119265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c0cd270 0x7fca9c0d0240 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0099b0 tx=0x7fca8c009250 comp rx=0 tx=0).stop 2023-10-06T02:21:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.852+0000 7fcaa45ca700 1 -- 172.21.15.6:0/2750119265 shutdown_connections 2023-10-06T02:21:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.852+0000 7fcaa45ca700 1 --2- 172.21.15.6:0/2750119265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca9c142de0 0x7fca9c0ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.852+0000 7fcaa45ca700 1 --2- 172.21.15.6:0/2750119265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c0cd270 0x7fca9c0d0240 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.852+0000 7fcaa45ca700 1 -- 172.21.15.6:0/2750119265 >> 172.21.15.6:0/2750119265 conn(0x7fca9c069110 msgr2=0x7fca9c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:14.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.852+0000 7fcaa45ca700 1 -- 172.21.15.6:0/2750119265 shutdown_connections 2023-10-06T02:21:14.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.852+0000 7fcaa45ca700 1 -- 172.21.15.6:0/2750119265 wait complete. 2023-10-06T02:21:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.853+0000 7fcaa45ca700 1 Processor -- start 2023-10-06T02:21:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.853+0000 7fcaa45ca700 1 -- start start 2023-10-06T02:21:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.854+0000 7fcaa45ca700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca9c0cd270 0x7fca9c0b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.854+0000 7fcaa45ca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c142de0 0x7fca9c0af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.854+0000 7fcaa45ca700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca9c1431b0 0x7fca9c0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.854+0000 7fcaa45ca700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c1541c0 con 0x7fca9c142de0 2023-10-06T02:21:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.854+0000 7fcaa45ca700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0b22b0 con 0x7fca9c0cd270 2023-10-06T02:21:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.854+0000 7fcaa45ca700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c1535b0 con 0x7fca9c1431b0 2023-10-06T02:21:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.854+0000 7fcaa1b65700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c142de0 0x7fca9c0af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.854+0000 7fcaa1b65700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c142de0 0x7fca9c0af9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52220/0 (socket says 172.21.15.6:52220) 2023-10-06T02:21:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.854+0000 7fcaa1b65700 1 -- 172.21.15.6:0/1952693995 learned_addr learned my addr 172.21.15.6:0/1952693995 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.854+0000 7fcaa2366700 1 --2- 172.21.15.6:0/1952693995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca9c0cd270 0x7fca9c0b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.854+0000 7fcaa2b67700 1 --2- 172.21.15.6:0/1952693995 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca9c1431b0 0x7fca9c0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.855+0000 7fcaa1b65700 1 -- 172.21.15.6:0/1952693995 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca9c1431b0 msgr2=0x7fca9c0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.855+0000 7fcaa1b65700 1 --2- 172.21.15.6:0/1952693995 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca9c1431b0 0x7fca9c0aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.855+0000 7fcaa1b65700 1 -- 172.21.15.6:0/1952693995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca9c0cd270 msgr2=0x7fca9c0b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.855+0000 7fcaa1b65700 1 --2- 172.21.15.6:0/1952693995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca9c0cd270 0x7fca9c0b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.855+0000 7fcaa1b65700 1 -- 172.21.15.6:0/1952693995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c0094f0 con 0x7fca9c142de0 2023-10-06T02:21:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.855+0000 7fcaa2b67700 1 --2- 172.21.15.6:0/1952693995 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca9c1431b0 0x7fca9c0aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.855+0000 7fcaa1b65700 1 --2- 172.21.15.6:0/1952693995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c142de0 0x7fca9c0af9d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fca9c066020 tx=0x7fca8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.855+0000 7fca927fc700 1 -- 172.21.15.6:0/1952693995 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c00bbe0 con 0x7fca9c142de0 2023-10-06T02:21:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.855+0000 7fca927fc700 1 -- 172.21.15.6:0/1952693995 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c011420 con 0x7fca9c142de0 2023-10-06T02:21:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.855+0000 7fcaa45ca700 1 -- 172.21.15.6:0/1952693995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c153890 con 0x7fca9c142de0 2023-10-06T02:21:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.855+0000 7fca927fc700 1 -- 172.21.15.6:0/1952693995 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c0117c0 con 0x7fca9c142de0 2023-10-06T02:21:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.855+0000 7fcaa45ca700 1 -- 172.21.15.6:0/1952693995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c153e50 con 0x7fca9c142de0 2023-10-06T02:21:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.856+0000 7fcaa45ca700 1 -- 172.21.15.6:0/1952693995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9c154330 con 0x7fca9c142de0 2023-10-06T02:21:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.856+0000 7fca927fc700 1 -- 172.21.15.6:0/1952693995 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca8c011bf0 con 0x7fca9c142de0 2023-10-06T02:21:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.857+0000 7fca927fc700 1 --2- 172.21.15.6:0/1952693995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fca80066f30 0x7fca800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.857+0000 7fca927fc700 1 -- 172.21.15.6:0/1952693995 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fca8c085fd0 con 0x7fca9c142de0 2023-10-06T02:21:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.857+0000 7fcaa2366700 1 --2- 172.21.15.6:0/1952693995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fca80066f30 0x7fca800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:14.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.857+0000 7fcaa2366700 1 --2- 172.21.15.6:0/1952693995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fca80066f30 0x7fca800693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fca98009db0 tx=0x7fca980091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:14.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:14.861+0000 7fca927fc700 1 -- 172.21.15.6:0/1952693995 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca8c052f50 con 0x7fca9c142de0 2023-10-06T02:21:15.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:15.099+0000 7fcaa45ca700 1 -- 172.21.15.6:0/1952693995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca9c088ac0 con 0x7fca9c142de0 2023-10-06T02:21:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:15.100+0000 7fca927fc700 1 -- 172.21.15.6:0/1952693995 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fca8c056570 con 0x7fca9c142de0 2023-10-06T02:21:15.100 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:21:15.100 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":55,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/400475961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":400475961},{"type":"v1","addr":"172.21.15.175:6837","nonce":400475961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1006897436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1006897436},{"type":"v1","addr":"172.21.15.6:6835","nonce":1006897436}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:51.206714+0000","modified":"2023-10-06T02:21:14.916690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":67,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6210},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6210":{"gid":6210,"name":"c","rank":0,"incarnation":53,"state":"up:rejoin","state_seq":9,"addr":"172.21.15.6:6834/3777949337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3777949337},{"type":"v1","addr":"172.21.15.6:6834","nonce":3777949337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:21:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:15.102+0000 7fcaa45ca700 1 -- 172.21.15.6:0/1952693995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fca80066f30 msgr2=0x7fca800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:15.102+0000 7fcaa45ca700 1 --2- 172.21.15.6:0/1952693995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fca80066f30 0x7fca800693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fca98009db0 tx=0x7fca980091a0 comp rx=0 tx=0).stop 2023-10-06T02:21:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:15.102+0000 7fcaa45ca700 1 -- 172.21.15.6:0/1952693995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c142de0 msgr2=0x7fca9c0af9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:15.102+0000 7fcaa45ca700 1 --2- 172.21.15.6:0/1952693995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c142de0 0x7fca9c0af9d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fca9c066020 tx=0x7fca8c017000 comp rx=0 tx=0).stop 2023-10-06T02:21:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:15.102+0000 7fcaa45ca700 1 -- 172.21.15.6:0/1952693995 shutdown_connections 2023-10-06T02:21:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:15.102+0000 7fcaa45ca700 1 --2- 172.21.15.6:0/1952693995 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca9c1431b0 0x7fca9c0aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:15.102+0000 7fcaa45ca700 1 --2- 172.21.15.6:0/1952693995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca9c0cd270 0x7fca9c0b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:15.102+0000 7fcaa45ca700 1 --2- 172.21.15.6:0/1952693995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fca80066f30 0x7fca800693e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:15.102+0000 7fcaa45ca700 1 --2- 172.21.15.6:0/1952693995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c142de0 0x7fca9c0af9d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:15.102+0000 7fcaa45ca700 1 -- 172.21.15.6:0/1952693995 >> 172.21.15.6:0/1952693995 conn(0x7fca9c069110 msgr2=0x7fca9c0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:15.102+0000 7fcaa45ca700 1 -- 172.21.15.6:0/1952693995 shutdown_connections 2023-10-06T02:21:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:15.102+0000 7fcaa45ca700 1 -- 172.21.15.6:0/1952693995 wait complete. 2023-10-06T02:21:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 55 2023-10-06T02:21:15.517 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:20:51.206714+0000', 'modified': '2023-10-06T02:21:14.916690+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 67, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6210}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6210': {'gid': 6210, 'name': 'c', 'rank': 0, 'incarnation': 53, 'state': 'up:rejoin', 'state_seq': 9, 'addr': '172.21.15.6:6834/3777949337', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 3777949337}, {'type': 'v1', 'addr': '172.21.15.6:6834', 'nonce': 3777949337}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:21:15.517 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6210:up:rejoin 2023-10-06T02:21:16.133 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-06T02:21:16.133+0000 7f0af5ee6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:21:16.518 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:21:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.651+0000 7fe539fad700 1 Processor -- start 2023-10-06T02:21:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.651+0000 7fe539fad700 1 -- start start 2023-10-06T02:21:16.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.652+0000 7fe539fad700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe534159150 0x7fe53415de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:16.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.652+0000 7fe539fad700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe5340b08f0 0x7fe534159520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:16.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.652+0000 7fe539fad700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5340afbc0 con 0x7fe5340cccf0 2023-10-06T02:21:16.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.652+0000 7fe539fad700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe534159a60 con 0x7fe5340b08f0 2023-10-06T02:21:16.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.652+0000 7fe539fad700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5340cd620 con 0x7fe534159150 2023-10-06T02:21:16.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.652+0000 7fe532ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe5340b08f0 0x7fe534159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:16.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.652+0000 7fe532ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe5340b08f0 0x7fe534159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52226/0 (socket says 172.21.15.6:52226) 2023-10-06T02:21:16.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.652+0000 7fe532ffd700 1 -- 172.21.15.6:0/2213684804 learned_addr learned my addr 172.21.15.6:0/2213684804 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:16.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.652+0000 7fe5337fe700 1 --2- 172.21.15.6:0/2213684804 >> v2:172.21.15.175:3300/0 conn(0x7fe534159150 0x7fe53415de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:16.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.652+0000 7fe532ffd700 1 -- 172.21.15.6:0/2213684804 >> v2:172.21.15.175:3300/0 conn(0x7fe534159150 msgr2=0x7fe53415de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:16.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.652+0000 7fe532ffd700 1 --2- 172.21.15.6:0/2213684804 >> v2:172.21.15.175:3300/0 conn(0x7fe534159150 0x7fe53415de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:16.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.652+0000 7fe532ffd700 1 -- 172.21.15.6:0/2213684804 >> v1:172.21.15.175:6789/0 conn(0x7fe5340cccf0 legacy=0x7fe5340b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:16.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.652+0000 7fe532ffd700 1 -- 172.21.15.6:0/2213684804 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5340afe10 con 0x7fe5340b08f0 2023-10-06T02:21:16.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.652+0000 7fe532ffd700 1 --2- 172.21.15.6:0/2213684804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5340b08f0 0x7fe534159520 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe5340cddd0 tx=0x7fe528009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2deff7b11614ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:16.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.653+0000 7fe5327fc700 1 -- 172.21.15.6:0/2213684804 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800b820 con 0x7fe5340b08f0 2023-10-06T02:21:16.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.653+0000 7fe5327fc700 1 -- 172.21.15.6:0/2213684804 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52800b980 con 0x7fe5340b08f0 2023-10-06T02:21:16.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.653+0000 7fe5327fc700 1 -- 172.21.15.6:0/2213684804 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800bd20 con 0x7fe5340b08f0 2023-10-06T02:21:16.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.653+0000 7fe539fad700 1 -- 172.21.15.6:0/2213684804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5340b08f0 msgr2=0x7fe534159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:16.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.653+0000 7fe539fad700 1 --2- 172.21.15.6:0/2213684804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5340b08f0 0x7fe534159520 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe5340cddd0 tx=0x7fe528009250 comp rx=0 tx=0).stop 2023-10-06T02:21:16.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.653+0000 7fe539fad700 1 -- 172.21.15.6:0/2213684804 shutdown_connections 2023-10-06T02:21:16.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.653+0000 7fe539fad700 1 --2- 172.21.15.6:0/2213684804 >> v2:172.21.15.175:3300/0 conn(0x7fe534159150 0x7fe53415de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:16.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.653+0000 7fe539fad700 1 --2- 172.21.15.6:0/2213684804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5340b08f0 0x7fe534159520 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:16.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.653+0000 7fe539fad700 1 -- 172.21.15.6:0/2213684804 >> 172.21.15.6:0/2213684804 conn(0x7fe534068680 msgr2=0x7fe534068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:16.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.653+0000 7fe539fad700 1 -- 172.21.15.6:0/2213684804 shutdown_connections 2023-10-06T02:21:16.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.653+0000 7fe539fad700 1 -- 172.21.15.6:0/2213684804 wait complete. 2023-10-06T02:21:16.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.655+0000 7fe539fad700 1 Processor -- start 2023-10-06T02:21:16.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.655+0000 7fe539fad700 1 -- start start 2023-10-06T02:21:16.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.655+0000 7fe539fad700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5340b08f0 0x7fe5340c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:16.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.655+0000 7fe539fad700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5340cccf0 0x7fe5340ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:16.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.655+0000 7fe539fad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159150 0x7fe53415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:16.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.655+0000 7fe539fad700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340c84f0 con 0x7fe534159150 2023-10-06T02:21:16.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.655+0000 7fe539fad700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340c78e0 con 0x7fe5340cccf0 2023-10-06T02:21:16.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.655+0000 7fe539fad700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340c7bc0 con 0x7fe5340b08f0 2023-10-06T02:21:16.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.655+0000 7fe533fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159150 0x7fe53415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:16.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.655+0000 7fe533fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159150 0x7fe53415c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52240/0 (socket says 172.21.15.6:52240) 2023-10-06T02:21:16.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.655+0000 7fe533fff700 1 -- 172.21.15.6:0/18502212 learned_addr learned my addr 172.21.15.6:0/18502212 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:16.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.656+0000 7fe532ffd700 1 --2- 172.21.15.6:0/18502212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5340cccf0 0x7fe5340ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:16.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.656+0000 7fe5337fe700 1 --2- 172.21.15.6:0/18502212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5340b08f0 0x7fe5340c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:16.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.656+0000 7fe533fff700 1 -- 172.21.15.6:0/18502212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5340b08f0 msgr2=0x7fe5340c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:16.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.656+0000 7fe533fff700 1 --2- 172.21.15.6:0/18502212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5340b08f0 0x7fe5340c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:16.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.656+0000 7fe533fff700 1 -- 172.21.15.6:0/18502212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5340cccf0 msgr2=0x7fe5340ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:16.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.656+0000 7fe533fff700 1 --2- 172.21.15.6:0/18502212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5340cccf0 0x7fe5340ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:16.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.656+0000 7fe533fff700 1 -- 172.21.15.6:0/18502212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5280094f0 con 0x7fe534159150 2023-10-06T02:21:16.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.656+0000 7fe533fff700 1 --2- 172.21.15.6:0/18502212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159150 0x7fe53415c7f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00c930 tx=0x7fe52c0026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:16.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.656+0000 7fe51b7fe700 1 -- 172.21.15.6:0/18502212 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c00ce70 con 0x7fe534159150 2023-10-06T02:21:16.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.656+0000 7fe51b7fe700 1 -- 172.21.15.6:0/18502212 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c00a7e0 con 0x7fe534159150 2023-10-06T02:21:16.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.656+0000 7fe539fad700 1 -- 172.21.15.6:0/18502212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5340c7ea0 con 0x7fe534159150 2023-10-06T02:21:16.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.656+0000 7fe51b7fe700 1 -- 172.21.15.6:0/18502212 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c00aba0 con 0x7fe534159150 2023-10-06T02:21:16.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.656+0000 7fe539fad700 1 -- 172.21.15.6:0/18502212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5340ca540 con 0x7fe534159150 2023-10-06T02:21:16.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.657+0000 7fe539fad700 1 -- 172.21.15.6:0/18502212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5340d0f30 con 0x7fe534159150 2023-10-06T02:21:16.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.658+0000 7fe51b7fe700 1 -- 172.21.15.6:0/18502212 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe52c012420 con 0x7fe534159150 2023-10-06T02:21:16.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.658+0000 7fe51b7fe700 1 --2- 172.21.15.6:0/18502212 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe520066f30 0x7fe5200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:16.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.658+0000 7fe51b7fe700 1 -- 172.21.15.6:0/18502212 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fe52c084bf0 con 0x7fe534159150 2023-10-06T02:21:16.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.658+0000 7fe5337fe700 1 --2- 172.21.15.6:0/18502212 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe520066f30 0x7fe5200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:16.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.659+0000 7fe5337fe700 1 --2- 172.21.15.6:0/18502212 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe520066f30 0x7fe5200693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe524006fd0 tx=0x7fe524008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:16.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.662+0000 7fe51b7fe700 1 -- 172.21.15.6:0/18502212 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe52c0556b0 con 0x7fe534159150 2023-10-06T02:21:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.901+0000 7fe539fad700 1 -- 172.21.15.6:0/18502212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5340c8630 con 0x7fe534159150 2023-10-06T02:21:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.901+0000 7fe51b7fe700 1 -- 172.21.15.6:0/18502212 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fe52c055240 con 0x7fe534159150 2023-10-06T02:21:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:21:16.902 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":56,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/400475961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":400475961},{"type":"v1","addr":"172.21.15.175:6837","nonce":400475961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1006897436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1006897436},{"type":"v1","addr":"172.21.15.6:6835","nonce":1006897436}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:51.206714+0000","modified":"2023-10-06T02:21:15.926365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":67,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6210},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6210":{"gid":6210,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":10,"addr":"172.21.15.6:6834/3777949337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3777949337},{"type":"v1","addr":"172.21.15.6:6834","nonce":3777949337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:21:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.903+0000 7fe539fad700 1 -- 172.21.15.6:0/18502212 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe520066f30 msgr2=0x7fe5200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.903+0000 7fe539fad700 1 --2- 172.21.15.6:0/18502212 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe520066f30 0x7fe5200693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe524006fd0 tx=0x7fe524008040 comp rx=0 tx=0).stop 2023-10-06T02:21:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.903+0000 7fe539fad700 1 -- 172.21.15.6:0/18502212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159150 msgr2=0x7fe53415c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.903+0000 7fe539fad700 1 --2- 172.21.15.6:0/18502212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159150 0x7fe53415c7f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00c930 tx=0x7fe52c0026e0 comp rx=0 tx=0).stop 2023-10-06T02:21:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.903+0000 7fe539fad700 1 -- 172.21.15.6:0/18502212 shutdown_connections 2023-10-06T02:21:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.903+0000 7fe539fad700 1 --2- 172.21.15.6:0/18502212 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe520066f30 0x7fe5200693e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.903+0000 7fe539fad700 1 --2- 172.21.15.6:0/18502212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe534159150 0x7fe53415c7f0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.903+0000 7fe539fad700 1 --2- 172.21.15.6:0/18502212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5340b08f0 0x7fe5340c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.903+0000 7fe539fad700 1 --2- 172.21.15.6:0/18502212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5340cccf0 0x7fe5340ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.903+0000 7fe539fad700 1 -- 172.21.15.6:0/18502212 >> 172.21.15.6:0/18502212 conn(0x7fe534068680 msgr2=0x7fe5340d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.904+0000 7fe539fad700 1 -- 172.21.15.6:0/18502212 shutdown_connections 2023-10-06T02:21:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:16.904+0000 7fe539fad700 1 -- 172.21.15.6:0/18502212 wait complete. 2023-10-06T02:21:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 56 2023-10-06T02:21:17.319 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:20:51.206714+0000', 'modified': '2023-10-06T02:21:15.926365+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 67, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6210}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6210': {'gid': 6210, 'name': 'c', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.6:6834/3777949337', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 3777949337}, {'type': 'v1', 'addr': '172.21.15.6:6834', 'nonce': 3777949337}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:21:17.319 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:21:17.319 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:21:17.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.440+0000 7efe95022700 1 Processor -- start 2023-10-06T02:21:17.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.440+0000 7efe95022700 1 -- start start 2023-10-06T02:21:17.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.441+0000 7efe95022700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efe9015a030 0x7efe9015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.441+0000 7efe95022700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe9015a940 0x7efe90086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.441+0000 7efe95022700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe90087530 0x7efe900b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.441+0000 7efe95022700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe900879d0 con 0x7efe9015a940 2023-10-06T02:21:17.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.441+0000 7efe95022700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe900b0cf0 con 0x7efe9015a030 2023-10-06T02:21:17.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.441+0000 7efe95022700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe900afc50 con 0x7efe90087530 2023-10-06T02:21:17.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.441+0000 7efe8e59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe9015a940 0x7efe90086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.441+0000 7efe8e59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe9015a940 0x7efe90086ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52248/0 (socket says 172.21.15.6:52248) 2023-10-06T02:21:17.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.441+0000 7efe8e59c700 1 -- 172.21.15.6:0/2854733724 learned_addr learned my addr 172.21.15.6:0/2854733724 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:17.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.442+0000 7efe8ed9d700 1 --2- 172.21.15.6:0/2854733724 >> v2:172.21.15.175:3300/0 conn(0x7efe9015a030 0x7efe9015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.442+0000 7efe8f59e700 1 --2- 172.21.15.6:0/2854733724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe90087530 0x7efe900b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.442+0000 7efe8e59c700 1 -- 172.21.15.6:0/2854733724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe90087530 msgr2=0x7efe900b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:17.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.442+0000 7efe8e59c700 1 --2- 172.21.15.6:0/2854733724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe90087530 0x7efe900b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.442+0000 7efe8e59c700 1 -- 172.21.15.6:0/2854733724 >> v2:172.21.15.175:3300/0 conn(0x7efe9015a030 msgr2=0x7efe9015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:17.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.442+0000 7efe8e59c700 1 --2- 172.21.15.6:0/2854733724 >> v2:172.21.15.175:3300/0 conn(0x7efe9015a030 0x7efe9015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.442+0000 7efe8e59c700 1 -- 172.21.15.6:0/2854733724 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe900aff30 con 0x7efe9015a940 2023-10-06T02:21:17.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.442+0000 7efe8ed9d700 1 --2- 172.21.15.6:0/2854733724 >> v2:172.21.15.175:3300/0 conn(0x7efe9015a030 0x7efe9015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:17.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.442+0000 7efe8f59e700 1 --2- 172.21.15.6:0/2854733724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe90087530 0x7efe900b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:17.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.442+0000 7efe8e59c700 1 --2- 172.21.15.6:0/2854733724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe9015a940 0x7efe90086ff0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7efe900cddc0 tx=0x7efe84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a003d5b63b0b87 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:17.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.442+0000 7efe8dd9b700 1 -- 172.21.15.6:0/2854733724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8400b820 con 0x7efe9015a940 2023-10-06T02:21:17.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.442+0000 7efe8dd9b700 1 -- 172.21.15.6:0/2854733724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8400b980 con 0x7efe9015a940 2023-10-06T02:21:17.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.442+0000 7efe8dd9b700 1 -- 172.21.15.6:0/2854733724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8400bd20 con 0x7efe9015a940 2023-10-06T02:21:17.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.442+0000 7efe95022700 1 -- 172.21.15.6:0/2854733724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe9015a940 msgr2=0x7efe90086ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:17.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.442+0000 7efe95022700 1 --2- 172.21.15.6:0/2854733724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe9015a940 0x7efe90086ff0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7efe900cddc0 tx=0x7efe84009250 comp rx=0 tx=0).stop 2023-10-06T02:21:17.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.443+0000 7efe95022700 1 -- 172.21.15.6:0/2854733724 shutdown_connections 2023-10-06T02:21:17.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.443+0000 7efe95022700 1 --2- 172.21.15.6:0/2854733724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe90087530 0x7efe900b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.443+0000 7efe95022700 1 --2- 172.21.15.6:0/2854733724 >> v2:172.21.15.175:3300/0 conn(0x7efe9015a030 0x7efe9015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.443+0000 7efe95022700 1 --2- 172.21.15.6:0/2854733724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe9015a940 0x7efe90086ff0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.443+0000 7efe95022700 1 -- 172.21.15.6:0/2854733724 >> 172.21.15.6:0/2854733724 conn(0x7efe90068680 msgr2=0x7efe90068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:17.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.443+0000 7efe95022700 1 -- 172.21.15.6:0/2854733724 shutdown_connections 2023-10-06T02:21:17.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.443+0000 7efe95022700 1 -- 172.21.15.6:0/2854733724 wait complete. 2023-10-06T02:21:17.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.444+0000 7efe95022700 1 Processor -- start 2023-10-06T02:21:17.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.444+0000 7efe95022700 1 -- start start 2023-10-06T02:21:17.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe95022700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe90087530 0x7efe9016d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe95022700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe9015a030 0x7efe9016b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe95022700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe9015a940 0x7efe900ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe95022700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9016b3c0 con 0x7efe90087530 2023-10-06T02:21:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe95022700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe900c7f10 con 0x7efe9015a940 2023-10-06T02:21:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe95022700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9016d740 con 0x7efe9015a030 2023-10-06T02:21:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe8ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe90087530 0x7efe9016d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe8ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe90087530 0x7efe9016d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52256/0 (socket says 172.21.15.6:52256) 2023-10-06T02:21:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe8ed9d700 1 -- 172.21.15.6:0/79953171 learned_addr learned my addr 172.21.15.6:0/79953171 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe8f59e700 1 --2- 172.21.15.6:0/79953171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe9015a940 0x7efe900ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe8e59c700 1 --2- 172.21.15.6:0/79953171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe9015a030 0x7efe9016b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe8ed9d700 1 -- 172.21.15.6:0/79953171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe9015a030 msgr2=0x7efe9016b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe8ed9d700 1 --2- 172.21.15.6:0/79953171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe9015a030 0x7efe9016b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe8ed9d700 1 -- 172.21.15.6:0/79953171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe9015a940 msgr2=0x7efe900ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe8ed9d700 1 --2- 172.21.15.6:0/79953171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe9015a940 0x7efe900ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe8ed9d700 1 -- 172.21.15.6:0/79953171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe840094f0 con 0x7efe90087530 2023-10-06T02:21:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe8ed9d700 1 --2- 172.21.15.6:0/79953171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe90087530 0x7efe9016d200 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7efe8000e880 tx=0x7efe80008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe76ffd700 1 -- 172.21.15.6:0/79953171 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80013410 con 0x7efe90087530 2023-10-06T02:21:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe76ffd700 1 -- 172.21.15.6:0/79953171 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe80013570 con 0x7efe90087530 2023-10-06T02:21:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe95022700 1 -- 172.21.15.6:0/79953171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe900c75e0 con 0x7efe90087530 2023-10-06T02:21:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe76ffd700 1 -- 172.21.15.6:0/79953171 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80013910 con 0x7efe90087530 2023-10-06T02:21:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.445+0000 7efe95022700 1 -- 172.21.15.6:0/79953171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe900c7ba0 con 0x7efe90087530 2023-10-06T02:21:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.447+0000 7efe76ffd700 1 -- 172.21.15.6:0/79953171 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe80013cc0 con 0x7efe90087530 2023-10-06T02:21:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.447+0000 7efe76ffd700 1 --2- 172.21.15.6:0/79953171 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efe7c066f30 0x7efe7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.447+0000 7efe76ffd700 1 -- 172.21.15.6:0/79953171 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7efe80084400 con 0x7efe90087530 2023-10-06T02:21:17.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.447+0000 7efe8e59c700 1 --2- 172.21.15.6:0/79953171 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efe7c066f30 0x7efe7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.448+0000 7efe8e59c700 1 --2- 172.21.15.6:0/79953171 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efe7c066f30 0x7efe7c0693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efe9015ad30 tx=0x7efe84017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:17.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.449+0000 7efe9e31ab80 1 Processor -- start 2023-10-06T02:21:17.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.449+0000 7efe9e31ab80 1 -- start start 2023-10-06T02:21:17.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.450+0000 7efe9e31ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee5840 0x555df0ee5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.450+0000 7efe9e31ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee6cc0 0x555df0f356c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.450+0000 7efe9e31ab80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0f35c00 0x555df0f36050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.450+0000 7efe9e31ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555df0e3ca70 con 0x555df0ee5840 2023-10-06T02:21:17.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.450+0000 7efe9e31ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555df0e3a270 con 0x555df0ee6cc0 2023-10-06T02:21:17.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.450+0000 7efe9e31ab80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x555df0e36060 con 0x555df0f35c00 2023-10-06T02:21:17.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.450+0000 7efe8ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee5840 0x555df0ee5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.450+0000 7efe8ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee5840 0x555df0ee5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52264/0 (socket says 172.21.15.6:52264) 2023-10-06T02:21:17.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.450+0000 7efe8ed9d700 1 -- 172.21.15.6:0/2872043744 learned_addr learned my addr 172.21.15.6:0/2872043744 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:17.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.450+0000 7efe8f59e700 1 --2- 172.21.15.6:0/2872043744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0f35c00 0x555df0f36050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.450+0000 7efe8e59c700 1 --2- 172.21.15.6:0/2872043744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee6cc0 0x555df0f356c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.450+0000 7efe8ed9d700 1 -- 172.21.15.6:0/2872043744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0f35c00 msgr2=0x555df0f36050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.451+0000 7efe8ed9d700 1 --2- 172.21.15.6:0/2872043744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0f35c00 0x555df0f36050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.451+0000 7efe8ed9d700 1 -- 172.21.15.6:0/2872043744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee6cc0 msgr2=0x555df0f356c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.451+0000 7efe8ed9d700 1 --2- 172.21.15.6:0/2872043744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee6cc0 0x555df0f356c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.451+0000 7efe8ed9d700 1 -- 172.21.15.6:0/2872043744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555df0cd0270 con 0x555df0ee5840 2023-10-06T02:21:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.451+0000 7efe8e59c700 1 --2- 172.21.15.6:0/2872043744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee6cc0 0x555df0f356c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:21:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.451+0000 7efe8ed9d700 1 --2- 172.21.15.6:0/2872043744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee5840 0x555df0ee5c10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7efe80054fd0 tx=0x7efe80082590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833097ef49cd8a32 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.451+0000 7efe6ffff700 1 -- 172.21.15.6:0/2872043744 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80058290 con 0x555df0ee5840 2023-10-06T02:21:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.451+0000 7efe6ffff700 1 -- 172.21.15.6:0/2872043744 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8005bfe0 con 0x555df0ee5840 2023-10-06T02:21:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.451+0000 7efe6ffff700 1 -- 172.21.15.6:0/2872043744 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe800533e0 con 0x555df0ee5840 2023-10-06T02:21:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.451+0000 7efe9e31ab80 1 -- 172.21.15.6:0/2872043744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee5840 msgr2=0x555df0ee5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.451+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/2872043744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee5840 0x555df0ee5c10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7efe80054fd0 tx=0x7efe80082590 comp rx=0 tx=0).stop 2023-10-06T02:21:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.452+0000 7efe9e31ab80 1 -- 172.21.15.6:0/2872043744 shutdown_connections 2023-10-06T02:21:17.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.452+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/2872043744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0f35c00 0x555df0f36050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.452+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/2872043744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee5840 0x555df0ee5c10 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.452+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/2872043744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee6cc0 0x555df0f356c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.452+0000 7efe9e31ab80 1 -- 172.21.15.6:0/2872043744 >> 172.21.15.6:0/2872043744 conn(0x555df0ee7160 msgr2=0x555df0ee7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:17.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.452+0000 7efe9e31ab80 1 -- 172.21.15.6:0/2872043744 shutdown_connections 2023-10-06T02:21:17.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.452+0000 7efe9e31ab80 1 -- 172.21.15.6:0/2872043744 wait complete. 2023-10-06T02:21:17.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.452+0000 7efe9e31ab80 1 -- start start 2023-10-06T02:21:17.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.452+0000 7efe9e31ab80 1 Processor -- start 2023-10-06T02:21:17.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.453+0000 7efe9e31ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee5840 0x555df0f3f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.453+0000 7efe9e31ab80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0ee6cc0 0x555df0f3fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.453+0000 7efe9e31ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0f35c00 0x555df0f2c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.453+0000 7efe9e31ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555df0de1890 con 0x555df0f35c00 2023-10-06T02:21:17.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.453+0000 7efe9e31ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555df0dfcea0 con 0x555df0ee5840 2023-10-06T02:21:17.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.453+0000 7efe9e31ab80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x555df0cb8e30 con 0x555df0ee6cc0 2023-10-06T02:21:17.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.453+0000 7efe9e31ab80 10 client.0 _ll_register_callbacks cb 0x555df0ea8e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:21:17.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.453+0000 7efe8f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0f35c00 0x555df0f2c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.453+0000 7efe8f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0f35c00 0x555df0f2c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52268/0 (socket says 172.21.15.6:52268) 2023-10-06T02:21:17.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.453+0000 7efe8f59e700 1 -- 172.21.15.6:0/2216501384 learned_addr learned my addr 172.21.15.6:0/2216501384 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:17.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.453+0000 7efe8e59c700 1 --2- 172.21.15.6:0/2216501384 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0ee6cc0 0x555df0f3fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.453+0000 7efe8ed9d700 1 --2- 172.21.15.6:0/2216501384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee5840 0x555df0f3f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe8f59e700 1 -- 172.21.15.6:0/2216501384 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0ee6cc0 msgr2=0x555df0f3fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:17.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe8f59e700 1 --2- 172.21.15.6:0/2216501384 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0ee6cc0 0x555df0f3fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe8f59e700 1 -- 172.21.15.6:0/2216501384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee5840 msgr2=0x555df0f3f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:17.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe8f59e700 1 --2- 172.21.15.6:0/2216501384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee5840 0x555df0f3f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe8f59e700 1 -- 172.21.15.6:0/2216501384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe900c7ba0 con 0x555df0f35c00 2023-10-06T02:21:17.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe8f59e700 1 --2- 172.21.15.6:0/2216501384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0f35c00 0x555df0f2c0a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7efe88007f60 tx=0x7efe8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24526694aa788fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:17.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe6d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:21:17.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe6d7fa700 1 -- 172.21.15.6:0/2216501384 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88012c70 con 0x555df0f35c00 2023-10-06T02:21:17.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe6d7fa700 1 -- 172.21.15.6:0/2216501384 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7efe88012dd0 con 0x555df0f35c00 2023-10-06T02:21:17.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe9e31ab80 1 -- 172.21.15.6:0/2216501384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555df0eda940 con 0x555df0f35c00 2023-10-06T02:21:17.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe6d7fa700 1 -- 172.21.15.6:0/2216501384 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe88018680 con 0x555df0f35c00 2023-10-06T02:21:17.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe9e31ab80 10 client.6498 fetch_fsmap learned FSMap version 56 2023-10-06T02:21:17.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe9e31ab80 1 -- 172.21.15.6:0/2216501384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x555df0c72fe0 con 0x555df0f35c00 2023-10-06T02:21:17.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe6d7fa700 1 -- 172.21.15.6:0/2216501384 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555df0eda940 con 0x555df0f35c00 2023-10-06T02:21:17.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe6d7fa700 1 -- 172.21.15.6:0/2216501384 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efe88014040 con 0x555df0f35c00 2023-10-06T02:21:17.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe9e31ab80 10 client.6498 fetch_fsmap finished waiting for FSMap version 56 2023-10-06T02:21:17.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe9e31ab80 10 client.6498 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:21:17.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe9e31ab80 20 client.6498 populate_metadata read hostname 'smithi006' 2023-10-06T02:21:17.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/2216501384 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x555df0f2cc70 0x555df0f25b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe9e31ab80 4 client.6498 mds_command: new command op to 6210 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:21:17.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.454+0000 7efe9e31ab80 1 -- 172.21.15.6:0/2216501384 --> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555df0eb7870 con 0x555df0f2cc70 2023-10-06T02:21:17.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.455+0000 7efe8ed9d700 1 --2- 172.21.15.6:0/2216501384 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x555df0f2cc70 0x555df0f25b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.455+0000 7efe6d7fa700 10 client.6498 ms_handle_connect on v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:17.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.455+0000 7efe8ed9d700 1 --2- 172.21.15.6:0/2216501384 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x555df0f2cc70 0x555df0f25b60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91c3de2f5d52e94b server_cookie=1bbe1b984d1361b1 in_seq=0 out_seq=0 2023-10-06T02:21:17.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.456+0000 7efe6d7fa700 1 -- 172.21.15.6:0/2216501384 <== mds.0 v2:172.21.15.6:6832/3777949337 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x555df0eb7870 con 0x555df0f2cc70 2023-10-06T02:21:17.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.456+0000 7efe6d7fa700 10 client.6498 handle_command_reply: tid=0 2023-10-06T02:21:17.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.456+0000 7efe9e31ab80 1 client.6498 shutdown 2023-10-06T02:21:17.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.456+0000 7efe9e31ab80 1 -- 172.21.15.6:0/2216501384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0f35c00 msgr2=0x555df0f2c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:17.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.456+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/2216501384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0f35c00 0x555df0f2c0a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7efe88007f60 tx=0x7efe8800b040 comp rx=0 tx=0).stop 2023-10-06T02:21:17.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.456+0000 7efe9e31ab80 1 -- 172.21.15.6:0/2216501384 shutdown_connections 2023-10-06T02:21:17.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.456+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/2216501384 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x555df0f2cc70 0x555df0f25b60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.456+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/2216501384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0f35c00 0x555df0f2c0a0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.456+0000 7efe6d7fa700 0 client.6498 ms_handle_reset on v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:17.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.456+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/2216501384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee5840 0x555df0f3f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.456+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/2216501384 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0ee6cc0 0x555df0f3fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.456+0000 7efe9e31ab80 1 -- 172.21.15.6:0/2216501384 >> 172.21.15.6:0/2216501384 conn(0x555df0ee7160 msgr2=0x555df0ee0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:17.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.456+0000 7efe9e31ab80 1 -- 172.21.15.6:0/2216501384 shutdown_connections 2023-10-06T02:21:17.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.456+0000 7efe9e31ab80 1 -- 172.21.15.6:0/2216501384 wait complete. 2023-10-06T02:21:17.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.456+0000 7efe9e31ab80 20 client.6498 trim_cache size 0 max 16384 2023-10-06T02:21:17.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.473+0000 7efe9e31ab80 1 Processor -- start 2023-10-06T02:21:17.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.473+0000 7efe9e31ab80 1 -- start start 2023-10-06T02:21:17.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.473+0000 7efe9e31ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee5840 0x555df0f8b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.473+0000 7efe9e31ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee6cc0 0x555df0ee0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.473+0000 7efe9e31ab80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0f35c00 0x555df0ee0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.474+0000 7efe9e31ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555df0f2bb70 con 0x555df0ee6cc0 2023-10-06T02:21:17.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.474+0000 7efe9e31ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555df0ee33b0 con 0x555df0ee5840 2023-10-06T02:21:17.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.474+0000 7efe9e31ab80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x555df0f31bb0 con 0x555df0f35c00 2023-10-06T02:21:17.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.474+0000 7efe8e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee6cc0 0x555df0ee0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.474+0000 7efe8e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee6cc0 0x555df0ee0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52270/0 (socket says 172.21.15.6:52270) 2023-10-06T02:21:17.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.474+0000 7efe8e59c700 1 -- 172.21.15.6:0/1818926919 learned_addr learned my addr 172.21.15.6:0/1818926919 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:17.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.474+0000 7efe8e59c700 1 -- 172.21.15.6:0/1818926919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0f35c00 msgr2=0x555df0ee0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:17.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.474+0000 7efe8e59c700 1 --2- 172.21.15.6:0/1818926919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0f35c00 0x555df0ee0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.474+0000 7efe8e59c700 1 -- 172.21.15.6:0/1818926919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee5840 msgr2=0x555df0f8b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:17.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.474+0000 7efe8e59c700 1 --2- 172.21.15.6:0/1818926919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee5840 0x555df0f8b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.474+0000 7efe8e59c700 1 -- 172.21.15.6:0/1818926919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555df0e04780 con 0x555df0ee6cc0 2023-10-06T02:21:17.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.474+0000 7efe8e59c700 1 --2- 172.21.15.6:0/1818926919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee6cc0 0x555df0ee0a10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7efe840099b0 tx=0x7efe84020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7cb94206da8d053 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:17.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.474+0000 7efe74ff9700 1 -- 172.21.15.6:0/1818926919 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84020070 con 0x555df0ee6cc0 2023-10-06T02:21:17.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.474+0000 7efe74ff9700 1 -- 172.21.15.6:0/1818926919 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8402c040 con 0x555df0ee6cc0 2023-10-06T02:21:17.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.474+0000 7efe74ff9700 1 -- 172.21.15.6:0/1818926919 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8400be20 con 0x555df0ee6cc0 2023-10-06T02:21:17.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.475+0000 7efe9e31ab80 1 -- 172.21.15.6:0/1818926919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee6cc0 msgr2=0x555df0ee0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:17.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.475+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/1818926919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee6cc0 0x555df0ee0a10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7efe840099b0 tx=0x7efe84020000 comp rx=0 tx=0).stop 2023-10-06T02:21:17.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.475+0000 7efe9e31ab80 1 -- 172.21.15.6:0/1818926919 shutdown_connections 2023-10-06T02:21:17.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.475+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/1818926919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0f35c00 0x555df0ee0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.475+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/1818926919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee5840 0x555df0f8b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.475+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/1818926919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee6cc0 0x555df0ee0a10 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.475+0000 7efe9e31ab80 1 -- 172.21.15.6:0/1818926919 >> 172.21.15.6:0/1818926919 conn(0x555df0ee7160 msgr2=0x555df0f2be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:17.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.475+0000 7efe9e31ab80 1 -- 172.21.15.6:0/1818926919 shutdown_connections 2023-10-06T02:21:17.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.475+0000 7efe9e31ab80 1 -- 172.21.15.6:0/1818926919 wait complete. 2023-10-06T02:21:17.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.475+0000 7efe9e31ab80 1 -- start start 2023-10-06T02:21:17.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.475+0000 7efe9e31ab80 1 Processor -- start 2023-10-06T02:21:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.476+0000 7efe9e31ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee5840 0x555df0f4d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.476+0000 7efe9e31ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee6cc0 0x555df0f22cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.476+0000 7efe9e31ab80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0f35c00 0x555df0ee7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.476+0000 7efe9e31ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555df0f28860 con 0x555df0ee6cc0 2023-10-06T02:21:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.476+0000 7efe9e31ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555df0f28cc0 con 0x555df0ee5840 2023-10-06T02:21:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.476+0000 7efe9e31ab80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x555df0f8a750 con 0x555df0f35c00 2023-10-06T02:21:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.476+0000 7efe9e31ab80 10 client.0 _ll_register_callbacks cb 0x555df0ea8e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:21:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.476+0000 7efe8e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee6cc0 0x555df0f22cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe8e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee6cc0 0x555df0f22cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52272/0 (socket says 172.21.15.6:52272) 2023-10-06T02:21:17.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe8e59c700 1 -- 172.21.15.6:0/743317702 learned_addr learned my addr 172.21.15.6:0/743317702 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:17.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe8ed9d700 1 --2- 172.21.15.6:0/743317702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee5840 0x555df0f4d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe8f59e700 1 --2- 172.21.15.6:0/743317702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0f35c00 0x555df0ee7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe8e59c700 1 -- 172.21.15.6:0/743317702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0f35c00 msgr2=0x555df0ee7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:17.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe8e59c700 1 --2- 172.21.15.6:0/743317702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0f35c00 0x555df0ee7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe8e59c700 1 -- 172.21.15.6:0/743317702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee5840 msgr2=0x555df0f4d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:17.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe8e59c700 1 --2- 172.21.15.6:0/743317702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee5840 0x555df0f4d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe8e59c700 1 -- 172.21.15.6:0/743317702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe900aff30 con 0x555df0ee6cc0 2023-10-06T02:21:17.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe8ed9d700 1 --2- 172.21.15.6:0/743317702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee5840 0x555df0f4d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:17.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe8e59c700 1 --2- 172.21.15.6:0/743317702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee6cc0 0x555df0f22cd0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7efe840099b0 tx=0x7efe84028050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a60180cac16ac00 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:17.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe6d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:21:17.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe6d7fa700 1 -- 172.21.15.6:0/743317702 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84020040 con 0x555df0ee6cc0 2023-10-06T02:21:17.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe6d7fa700 1 -- 172.21.15.6:0/743317702 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7efe84026980 con 0x555df0ee6cc0 2023-10-06T02:21:17.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe9e31ab80 1 -- 172.21.15.6:0/743317702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe8005bfe0 con 0x555df0ee6cc0 2023-10-06T02:21:17.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe6d7fa700 1 -- 172.21.15.6:0/743317702 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe84026d50 con 0x555df0ee6cc0 2023-10-06T02:21:17.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe9e31ab80 10 client.6504 fetch_fsmap learned FSMap version 56 2023-10-06T02:21:17.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe9e31ab80 1 -- 172.21.15.6:0/743317702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x555df0deb470 con 0x555df0ee6cc0 2023-10-06T02:21:17.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe6d7fa700 1 -- 172.21.15.6:0/743317702 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8005bfe0 con 0x555df0ee6cc0 2023-10-06T02:21:17.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe6d7fa700 1 -- 172.21.15.6:0/743317702 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efe84045350 con 0x555df0ee6cc0 2023-10-06T02:21:17.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe9e31ab80 10 client.6504 fetch_fsmap finished waiting for FSMap version 56 2023-10-06T02:21:17.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe9e31ab80 10 client.6504 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:21:17.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.477+0000 7efe9e31ab80 20 client.6504 populate_metadata read hostname 'smithi006' 2023-10-06T02:21:17.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/743317702 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x555df0f22350 0x555df0ee7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe9e31ab80 4 client.6504 mds_command: new command op to 6210 tid=0[{"prefix": "status"}] 2023-10-06T02:21:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe9e31ab80 1 -- 172.21.15.6:0/743317702 --> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555df0dd8e00 con 0x555df0f22350 2023-10-06T02:21:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe8ed9d700 1 --2- 172.21.15.6:0/743317702 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x555df0f22350 0x555df0ee7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe6d7fa700 10 client.6504 ms_handle_connect on v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe8ed9d700 1 --2- 172.21.15.6:0/743317702 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x555df0f22350 0x555df0ee7a70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ceaaebb5342d0ca server_cookie=6e0594a2a8add792 in_seq=0 out_seq=0 2023-10-06T02:21:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe6d7fa700 1 -- 172.21.15.6:0/743317702 <== mds.0 v2:172.21.15.6:6832/3777949337 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+316 (crc 0 0 0) 0x555df0dd8e00 con 0x555df0f22350 2023-10-06T02:21:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe6d7fa700 10 client.6504 handle_command_reply: tid=0 2023-10-06T02:21:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe9e31ab80 1 client.6504 shutdown 2023-10-06T02:21:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe9e31ab80 1 -- 172.21.15.6:0/743317702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee6cc0 msgr2=0x555df0f22cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/743317702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee6cc0 0x555df0f22cd0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7efe840099b0 tx=0x7efe84028050 comp rx=0 tx=0).stop 2023-10-06T02:21:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe9e31ab80 1 -- 172.21.15.6:0/743317702 shutdown_connections 2023-10-06T02:21:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/743317702 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x555df0f22350 0x555df0ee7a70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/743317702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555df0f35c00 0x555df0ee7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/743317702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555df0ee5840 0x555df0f4d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe6d7fa700 0 client.6504 ms_handle_reset on v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe9e31ab80 1 --2- 172.21.15.6:0/743317702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555df0ee6cc0 0x555df0f22cd0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe9e31ab80 1 -- 172.21.15.6:0/743317702 >> 172.21.15.6:0/743317702 conn(0x555df0ee7160 msgr2=0x555df0ee0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe9e31ab80 1 -- 172.21.15.6:0/743317702 shutdown_connections 2023-10-06T02:21:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.478+0000 7efe9e31ab80 1 -- 172.21.15.6:0/743317702 wait complete. 2023-10-06T02:21:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.479+0000 7efe9e31ab80 20 client.6504 trim_cache size 0 max 16384 2023-10-06T02:21:17.486 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:21:17.486 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:21:17.487 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:21:17.487 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 6210, 2023-10-06T02:21:17.487 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:21:17.487 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:21:17.487 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:21:17.487 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 4.56342582, 2023-10-06T02:21:17.487 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 56, 2023-10-06T02:21:17.487 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 67, 2023-10-06T02:21:17.487 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 67, 2023-10-06T02:21:17.487 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 31.71913352 2023-10-06T02:21:17.487 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:21:17.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.479+0000 7efe95022700 1 -- 172.21.15.6:0/79953171 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efe7c066f30 msgr2=0x7efe7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:17.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.479+0000 7efe95022700 1 --2- 172.21.15.6:0/79953171 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efe7c066f30 0x7efe7c0693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efe9015ad30 tx=0x7efe84017000 comp rx=0 tx=0).stop 2023-10-06T02:21:17.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.479+0000 7efe95022700 1 -- 172.21.15.6:0/79953171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe90087530 msgr2=0x7efe9016d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:17.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.479+0000 7efe95022700 1 --2- 172.21.15.6:0/79953171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe90087530 0x7efe9016d200 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7efe8000e880 tx=0x7efe80008040 comp rx=0 tx=0).stop 2023-10-06T02:21:17.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.479+0000 7efe95022700 1 -- 172.21.15.6:0/79953171 shutdown_connections 2023-10-06T02:21:17.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.479+0000 7efe95022700 1 --2- 172.21.15.6:0/79953171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe9015a940 0x7efe900ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.479+0000 7efe95022700 1 --2- 172.21.15.6:0/79953171 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efe7c066f30 0x7efe7c0693e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.479+0000 7efe95022700 1 --2- 172.21.15.6:0/79953171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe90087530 0x7efe9016d200 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.479+0000 7efe95022700 1 --2- 172.21.15.6:0/79953171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe9015a030 0x7efe9016b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.479+0000 7efe95022700 1 -- 172.21.15.6:0/79953171 >> 172.21.15.6:0/79953171 conn(0x7efe90068680 msgr2=0x7efe900b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:17.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.479+0000 7efe95022700 1 -- 172.21.15.6:0/79953171 shutdown_connections 2023-10-06T02:21:17.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.479+0000 7efe95022700 1 -- 172.21.15.6:0/79953171 wait complete. 2023-10-06T02:21:17.491 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:21:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.609+0000 7fe8a1c36700 1 Processor -- start 2023-10-06T02:21:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.609+0000 7fe8a1c36700 1 -- start start 2023-10-06T02:21:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.609+0000 7fe8a1c36700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe89c069fc0 0x7fe89c06a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.609+0000 7fe8a1c36700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe89c15d2d0 0x7fe89c15d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.609+0000 7fe8a1c36700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c0b16c0 con 0x7fe89c069bf0 2023-10-06T02:21:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.609+0000 7fe8a1c36700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c0b1f40 con 0x7fe89c15d2d0 2023-10-06T02:21:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.609+0000 7fe8a1c36700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c06aac0 con 0x7fe89c069fc0 2023-10-06T02:21:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.610+0000 7fe89bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe89c069fc0 0x7fe89c06a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.610+0000 7fe8a1435700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe89c15d2d0 0x7fe89c15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.610+0000 7fe8a0c34700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe89c069bf0 0x7fe89c0b0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:51316/0 (socket says 172.21.15.6:51316) 2023-10-06T02:21:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.610+0000 7fe8a0c34700 1 -- 172.21.15.6:0/2894829948 learned_addr learned my addr 172.21.15.6:0/2894829948 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:21:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.610+0000 7fe89b7fe700 1 -- 172.21.15.6:0/2894829948 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666295744 0 0) 0x7fe89c0b16c0 con 0x7fe89c069bf0 2023-10-06T02:21:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.610+0000 7fe89b7fe700 1 -- 172.21.15.6:0/2894829948 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe888003570 con 0x7fe89c069bf0 2023-10-06T02:21:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.610+0000 7fe89bfff700 1 -- 172.21.15.6:0/2894829948 >> v2:172.21.15.175:3300/0 conn(0x7fe89c15d2d0 msgr2=0x7fe89c15d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.610+0000 7fe89bfff700 1 --2- 172.21.15.6:0/2894829948 >> v2:172.21.15.175:3300/0 conn(0x7fe89c15d2d0 0x7fe89c15d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.610+0000 7fe89bfff700 1 -- 172.21.15.6:0/2894829948 >> v1:172.21.15.175:6789/0 conn(0x7fe89c069bf0 legacy=0x7fe89c0b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.610+0000 7fe89bfff700 1 -- 172.21.15.6:0/2894829948 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c0b18f0 con 0x7fe89c069fc0 2023-10-06T02:21:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.611+0000 7fe89bfff700 1 --2- 172.21.15.6:0/2894829948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe89c069fc0 0x7fe89c06a430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe8840098e0 tx=0x7fe8840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b5bd306e587f2bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.611+0000 7fe89b7fe700 1 -- 172.21.15.6:0/2894829948 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884011630 con 0x7fe89c069fc0 2023-10-06T02:21:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.611+0000 7fe89b7fe700 1 -- 172.21.15.6:0/2894829948 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe884011790 con 0x7fe89c069fc0 2023-10-06T02:21:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.611+0000 7fe89b7fe700 1 -- 172.21.15.6:0/2894829948 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884011b30 con 0x7fe89c069fc0 2023-10-06T02:21:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.611+0000 7fe8a1c36700 1 -- 172.21.15.6:0/2894829948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe89c069fc0 msgr2=0x7fe89c06a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.611+0000 7fe8a1c36700 1 --2- 172.21.15.6:0/2894829948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe89c069fc0 0x7fe89c06a430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe8840098e0 tx=0x7fe8840091a0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.611+0000 7fe8a1c36700 1 -- 172.21.15.6:0/2894829948 shutdown_connections 2023-10-06T02:21:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.611+0000 7fe8a1c36700 1 --2- 172.21.15.6:0/2894829948 >> v2:172.21.15.175:3300/0 conn(0x7fe89c15d2d0 0x7fe89c15d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.611+0000 7fe8a1c36700 1 --2- 172.21.15.6:0/2894829948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe89c069fc0 0x7fe89c06a430 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.611+0000 7fe8a1c36700 1 -- 172.21.15.6:0/2894829948 >> 172.21.15.6:0/2894829948 conn(0x7fe89c067910 msgr2=0x7fe89c0cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.611+0000 7fe8a1c36700 1 -- 172.21.15.6:0/2894829948 shutdown_connections 2023-10-06T02:21:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.611+0000 7fe8a1c36700 1 -- 172.21.15.6:0/2894829948 wait complete. 2023-10-06T02:21:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.612+0000 7fe8a1c36700 1 Processor -- start 2023-10-06T02:21:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.612+0000 7fe8a1c36700 1 -- start start 2023-10-06T02:21:17.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.613+0000 7fe8a1c36700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe89c069bf0 0x7fe89c1576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.613+0000 7fe8a1c36700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe89c069fc0 0x7fe89c099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.613+0000 7fe8a1c36700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe89c15d2d0 0x7fe89c0c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.613+0000 7fe8a1c36700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c09ace0 con 0x7fe89c15d2d0 2023-10-06T02:21:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.613+0000 7fe8a1c36700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c169ad0 con 0x7fe89c069bf0 2023-10-06T02:21:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.613+0000 7fe8a1c36700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c1697d0 con 0x7fe89c069fc0 2023-10-06T02:21:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.613+0000 7fe8a1435700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe89c15d2d0 0x7fe89c0c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.613+0000 7fe8a1435700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe89c15d2d0 0x7fe89c0c3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52276/0 (socket says 172.21.15.6:52276) 2023-10-06T02:21:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.613+0000 7fe8a1435700 1 -- 172.21.15.6:0/3383729361 learned_addr learned my addr 172.21.15.6:0/3383729361 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.613+0000 7fe8a0c34700 1 --2- 172.21.15.6:0/3383729361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe89c069bf0 0x7fe89c1576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.613+0000 7fe89bfff700 1 --2- 172.21.15.6:0/3383729361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe89c069fc0 0x7fe89c099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.614+0000 7fe8a1435700 1 -- 172.21.15.6:0/3383729361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe89c069fc0 msgr2=0x7fe89c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.614+0000 7fe8a1435700 1 --2- 172.21.15.6:0/3383729361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe89c069fc0 0x7fe89c099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.614+0000 7fe8a1435700 1 -- 172.21.15.6:0/3383729361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe89c069bf0 msgr2=0x7fe89c1576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.614+0000 7fe8a1435700 1 --2- 172.21.15.6:0/3383729361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe89c069bf0 0x7fe89c1576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.614+0000 7fe8a1435700 1 -- 172.21.15.6:0/3383729361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe884009420 con 0x7fe89c15d2d0 2023-10-06T02:21:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.614+0000 7fe8a1435700 1 --2- 172.21.15.6:0/3383729361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe89c15d2d0 0x7fe89c0c3e20 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00e900 tx=0x7fe88c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.614+0000 7fe898ff9700 1 -- 172.21.15.6:0/3383729361 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c013680 con 0x7fe89c15d2d0 2023-10-06T02:21:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.614+0000 7fe898ff9700 1 -- 172.21.15.6:0/3383729361 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c0137e0 con 0x7fe89c15d2d0 2023-10-06T02:21:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.614+0000 7fe8a1c36700 1 -- 172.21.15.6:0/3383729361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89c09a440 con 0x7fe89c15d2d0 2023-10-06T02:21:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.614+0000 7fe898ff9700 1 -- 172.21.15.6:0/3383729361 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c013ba0 con 0x7fe89c15d2d0 2023-10-06T02:21:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.614+0000 7fe8a1c36700 1 -- 172.21.15.6:0/3383729361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89c09aa80 con 0x7fe89c15d2d0 2023-10-06T02:21:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.615+0000 7fe8a1c36700 1 -- 172.21.15.6:0/3383729361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89c169c80 con 0x7fe89c15d2d0 2023-10-06T02:21:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.615+0000 7fe898ff9700 1 -- 172.21.15.6:0/3383729361 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe88c01c450 con 0x7fe89c15d2d0 2023-10-06T02:21:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.616+0000 7fe898ff9700 1 --2- 172.21.15.6:0/3383729361 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe87c066f30 0x7fe87c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.616+0000 7fe898ff9700 1 -- 172.21.15.6:0/3383729361 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fe88c0848d0 con 0x7fe89c15d2d0 2023-10-06T02:21:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.616+0000 7fe8a0c34700 1 --2- 172.21.15.6:0/3383729361 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe87c066f30 0x7fe87c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.616+0000 7fe8a0c34700 1 --2- 172.21.15.6:0/3383729361 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe87c066f30 0x7fe87c0693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe8940022a0 tx=0x7fe894009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:17.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.620+0000 7fe898ff9700 1 -- 172.21.15.6:0/3383729361 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe88c051850 con 0x7fe89c15d2d0 2023-10-06T02:21:17.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.858+0000 7fe8a1c36700 1 -- 172.21.15.6:0/3383729361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe89c0b1bd0 con 0x7fe89c15d2d0 2023-10-06T02:21:17.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.859+0000 7fe898ff9700 1 -- 172.21.15.6:0/3383729361 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fe88c054e70 con 0x7fe89c15d2d0 2023-10-06T02:21:17.860 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:21:17.860 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":56,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/400475961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":400475961},{"type":"v1","addr":"172.21.15.175:6837","nonce":400475961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1006897436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1006897436},{"type":"v1","addr":"172.21.15.6:6835","nonce":1006897436}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:51.206714+0000","modified":"2023-10-06T02:21:15.926365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":67,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6210},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6210":{"gid":6210,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":10,"addr":"172.21.15.6:6834/3777949337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3777949337},{"type":"v1","addr":"172.21.15.6:6834","nonce":3777949337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:21:17.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.861+0000 7fe8a1c36700 1 -- 172.21.15.6:0/3383729361 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe87c066f30 msgr2=0x7fe87c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:17.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.861+0000 7fe8a1c36700 1 --2- 172.21.15.6:0/3383729361 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe87c066f30 0x7fe87c0693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe8940022a0 tx=0x7fe894009040 comp rx=0 tx=0).stop 2023-10-06T02:21:17.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.861+0000 7fe8a1c36700 1 -- 172.21.15.6:0/3383729361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe89c15d2d0 msgr2=0x7fe89c0c3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:17.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.861+0000 7fe8a1c36700 1 --2- 172.21.15.6:0/3383729361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe89c15d2d0 0x7fe89c0c3e20 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00e900 tx=0x7fe88c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.861+0000 7fe8a1c36700 1 -- 172.21.15.6:0/3383729361 shutdown_connections 2023-10-06T02:21:17.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.861+0000 7fe8a1c36700 1 --2- 172.21.15.6:0/3383729361 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe87c066f30 0x7fe87c0693e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.861+0000 7fe8a1c36700 1 --2- 172.21.15.6:0/3383729361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe89c15d2d0 0x7fe89c0c3e20 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.861+0000 7fe8a1c36700 1 --2- 172.21.15.6:0/3383729361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe89c069bf0 0x7fe89c1576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.861+0000 7fe8a1c36700 1 --2- 172.21.15.6:0/3383729361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe89c069fc0 0x7fe89c099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.861+0000 7fe8a1c36700 1 -- 172.21.15.6:0/3383729361 >> 172.21.15.6:0/3383729361 conn(0x7fe89c067910 msgr2=0x7fe89c158900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:17.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.861+0000 7fe8a1c36700 1 -- 172.21.15.6:0/3383729361 shutdown_connections 2023-10-06T02:21:17.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.861+0000 7fe8a1c36700 1 -- 172.21.15.6:0/3383729361 wait complete. 2023-10-06T02:21:17.864 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 56 2023-10-06T02:21:17.874 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 4:0 true 2023-10-06T02:21:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.994+0000 7fdf737dd700 1 Processor -- start 2023-10-06T02:21:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.994+0000 7fdf737dd700 1 -- start start 2023-10-06T02:21:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.995+0000 7fdf737dd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdf6c0cd180 0x7fdf6c159990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.995+0000 7fdf737dd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf6c0af830 0x7fdf6c15d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.995+0000 7fdf737dd700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf6c0ce870 con 0x7fdf6c0af460 2023-10-06T02:21:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.995+0000 7fdf737dd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6c15dec0 con 0x7fdf6c0af830 2023-10-06T02:21:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.995+0000 7fdf737dd700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6c0cfd10 con 0x7fdf6c0cd180 2023-10-06T02:21:17.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.995+0000 7fdf71d7a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf6c0af830 0x7fdf6c15d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.995+0000 7fdf71d7a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf6c0af830 0x7fdf6c15d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52280/0 (socket says 172.21.15.6:52280) 2023-10-06T02:21:17.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.995+0000 7fdf71d7a700 1 -- 172.21.15.6:0/751239072 learned_addr learned my addr 172.21.15.6:0/751239072 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:17.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.995+0000 7fdf70d78700 1 --2- 172.21.15.6:0/751239072 >> v2:172.21.15.175:3300/0 conn(0x7fdf6c0cd180 0x7fdf6c159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:17.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.996+0000 7fdf71d7a700 1 -- 172.21.15.6:0/751239072 >> v2:172.21.15.175:3300/0 conn(0x7fdf6c0cd180 msgr2=0x7fdf6c159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:17.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.996+0000 7fdf71d7a700 1 --2- 172.21.15.6:0/751239072 >> v2:172.21.15.175:3300/0 conn(0x7fdf6c0cd180 0x7fdf6c159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:17.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.996+0000 7fdf71d7a700 1 -- 172.21.15.6:0/751239072 >> v1:172.21.15.175:6789/0 conn(0x7fdf6c0af460 legacy=0x7fdf6c0cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:17.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.996+0000 7fdf71d7a700 1 -- 172.21.15.6:0/751239072 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c0cffb0 con 0x7fdf6c0af830 2023-10-06T02:21:17.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.996+0000 7fdf71d7a700 1 --2- 172.21.15.6:0/751239072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c0af830 0x7fdf6c15d980 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0883a0 tx=0x7fdf5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b780b4a867a93ba0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:17.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.996+0000 7fdf6bfff700 1 -- 172.21.15.6:0/751239072 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c00e070 con 0x7fdf6c0af830 2023-10-06T02:21:17.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.996+0000 7fdf6bfff700 1 -- 172.21.15.6:0/751239072 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5c00ba20 con 0x7fdf6c0af830 2023-10-06T02:21:17.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.996+0000 7fdf6bfff700 1 -- 172.21.15.6:0/751239072 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c0092e0 con 0x7fdf6c0af830 2023-10-06T02:21:18.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.996+0000 7fdf737dd700 1 -- 172.21.15.6:0/751239072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c0af830 msgr2=0x7fdf6c15d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:18.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.996+0000 7fdf737dd700 1 --2- 172.21.15.6:0/751239072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c0af830 0x7fdf6c15d980 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0883a0 tx=0x7fdf5c009840 comp rx=0 tx=0).stop 2023-10-06T02:21:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.996+0000 7fdf737dd700 1 -- 172.21.15.6:0/751239072 shutdown_connections 2023-10-06T02:21:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.997+0000 7fdf737dd700 1 --2- 172.21.15.6:0/751239072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c0af830 0x7fdf6c15d980 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.997+0000 7fdf737dd700 1 --2- 172.21.15.6:0/751239072 >> v2:172.21.15.175:3300/0 conn(0x7fdf6c0cd180 0x7fdf6c159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.997+0000 7fdf737dd700 1 -- 172.21.15.6:0/751239072 >> 172.21.15.6:0/751239072 conn(0x7fdf6c068680 msgr2=0x7fdf6c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.997+0000 7fdf737dd700 1 -- 172.21.15.6:0/751239072 shutdown_connections 2023-10-06T02:21:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.997+0000 7fdf737dd700 1 -- 172.21.15.6:0/751239072 wait complete. 2023-10-06T02:21:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.998+0000 7fdf737dd700 1 Processor -- start 2023-10-06T02:21:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.998+0000 7fdf737dd700 1 -- start start 2023-10-06T02:21:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf737dd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf6c0af460 0x7fdf6c15c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf737dd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf6c0af830 0x7fdf6c16dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf737dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c0cd180 0x7fdf6c1573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf737dd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c16e020 con 0x7fdf6c0cd180 2023-10-06T02:21:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf737dd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c0b4e00 con 0x7fdf6c0af830 2023-10-06T02:21:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf737dd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c0b41f0 con 0x7fdf6c0af460 2023-10-06T02:21:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf71d7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c0cd180 0x7fdf6c1573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf71d7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c0cd180 0x7fdf6c1573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52282/0 (socket says 172.21.15.6:52282) 2023-10-06T02:21:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf71d7a700 1 -- 172.21.15.6:0/571297561 learned_addr learned my addr 172.21.15.6:0/571297561 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf70d78700 1 --2- 172.21.15.6:0/571297561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf6c0af830 0x7fdf6c16dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf71579700 1 --2- 172.21.15.6:0/571297561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf6c0af460 0x7fdf6c15c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf71d7a700 1 -- 172.21.15.6:0/571297561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf6c0af460 msgr2=0x7fdf6c15c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf71d7a700 1 --2- 172.21.15.6:0/571297561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf6c0af460 0x7fdf6c15c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf71d7a700 1 -- 172.21.15.6:0/571297561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf6c0af830 msgr2=0x7fdf6c16dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf71d7a700 1 --2- 172.21.15.6:0/571297561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf6c0af830 0x7fdf6c16dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf71d7a700 1 -- 172.21.15.6:0/571297561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c009ae0 con 0x7fdf6c0cd180 2023-10-06T02:21:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf70d78700 1 --2- 172.21.15.6:0/571297561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf6c0af830 0x7fdf6c16dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf71d7a700 1 --2- 172.21.15.6:0/571297561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c0cd180 0x7fdf6c1573d0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009880 tx=0x7fdf5c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf697fa700 1 -- 172.21.15.6:0/571297561 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c008be0 con 0x7fdf6c0cd180 2023-10-06T02:21:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf697fa700 1 -- 172.21.15.6:0/571297561 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5c008d40 con 0x7fdf6c0cd180 2023-10-06T02:21:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf737dd700 1 -- 172.21.15.6:0/571297561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf6c0b44d0 con 0x7fdf6c0cd180 2023-10-06T02:21:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf697fa700 1 -- 172.21.15.6:0/571297561 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c0266b0 con 0x7fdf6c0cd180 2023-10-06T02:21:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:17.999+0000 7fdf737dd700 1 -- 172.21.15.6:0/571297561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6c0b4a90 con 0x7fdf6c0cd180 2023-10-06T02:21:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.000+0000 7fdf737dd700 1 -- 172.21.15.6:0/571297561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf6c0b4fb0 con 0x7fdf6c0cd180 2023-10-06T02:21:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.001+0000 7fdf697fa700 1 -- 172.21.15.6:0/571297561 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf5c003040 con 0x7fdf6c0cd180 2023-10-06T02:21:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.001+0000 7fdf697fa700 1 --2- 172.21.15.6:0/571297561 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdf58066f30 0x7fdf580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.001+0000 7fdf697fa700 1 -- 172.21.15.6:0/571297561 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fdf5c086840 con 0x7fdf6c0cd180 2023-10-06T02:21:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.001+0000 7fdf71579700 1 --2- 172.21.15.6:0/571297561 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdf58066f30 0x7fdf580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.002+0000 7fdf71579700 1 --2- 172.21.15.6:0/571297561 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdf58066f30 0x7fdf580693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdf640037c0 tx=0x7fdf64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:18.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.005+0000 7fdf697fa700 1 -- 172.21.15.6:0/571297561 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf6c0b4fb0 con 0x7fdf6c0cd180 2023-10-06T02:21:18.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.281+0000 7fdf737dd700 1 -- 172.21.15.6:0/571297561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "4:0", "val": "true"} v 0) v1 -- 0x7fdf6c0b4f70 con 0x7fdf6c0cd180 2023-10-06T02:21:18.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.941+0000 7fdf697fa700 1 -- 172.21.15.6:0/571297561 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "4:0", "val": "true"}]=0 freezing mds.6210 v57) v1 ==== 112+0+0 (secure 0 0 0) 0x7fdf5c0210a0 con 0x7fdf6c0cd180 2023-10-06T02:21:18.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.943+0000 7fdf737dd700 1 -- 172.21.15.6:0/571297561 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdf58066f30 msgr2=0x7fdf580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:18.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.943+0000 7fdf737dd700 1 --2- 172.21.15.6:0/571297561 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdf58066f30 0x7fdf580693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdf640037c0 tx=0x7fdf64009040 comp rx=0 tx=0).stop 2023-10-06T02:21:18.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.943+0000 7fdf737dd700 1 -- 172.21.15.6:0/571297561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c0cd180 msgr2=0x7fdf6c1573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:18.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.943+0000 7fdf737dd700 1 --2- 172.21.15.6:0/571297561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c0cd180 0x7fdf6c1573d0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009880 tx=0x7fdf5c018000 comp rx=0 tx=0).stop 2023-10-06T02:21:18.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.944+0000 7fdf737dd700 1 -- 172.21.15.6:0/571297561 shutdown_connections 2023-10-06T02:21:18.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.944+0000 7fdf737dd700 1 --2- 172.21.15.6:0/571297561 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdf58066f30 0x7fdf580693e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:18.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.944+0000 7fdf737dd700 1 --2- 172.21.15.6:0/571297561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c0cd180 0x7fdf6c1573d0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:18.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.944+0000 7fdf737dd700 1 --2- 172.21.15.6:0/571297561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf6c0af460 0x7fdf6c15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:18.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.944+0000 7fdf737dd700 1 --2- 172.21.15.6:0/571297561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf6c0af830 0x7fdf6c16dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:18.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.944+0000 7fdf737dd700 1 -- 172.21.15.6:0/571297561 >> 172.21.15.6:0/571297561 conn(0x7fdf6c068680 msgr2=0x7fdf6c0c69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:18.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.944+0000 7fdf737dd700 1 -- 172.21.15.6:0/571297561 shutdown_connections 2023-10-06T02:21:18.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:18.944+0000 7fdf737dd700 1 -- 172.21.15.6:0/571297561 wait complete. 2023-10-06T02:21:18.946 INFO:teuthology.orchestra.run.smithi006.stderr:freezing mds.6210 2023-10-06T02:21:18.959 DEBUG:teuthology.orchestra.run.smithi006:> timeout 30 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --connect-timeout=60 tell mds.4:0 flush journal 2023-10-06T02:21:18.962 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-10-06T02:21:19.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.087+0000 7fc399c2c700 1 Processor -- start 2023-10-06T02:21:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.087+0000 7fc399c2c700 1 -- start start 2023-10-06T02:21:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.088+0000 7fc399c2c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3940d0400 0x7fc3940b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.088+0000 7fc399c2c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc3940ccd40 0x7fc3940cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.088+0000 7fc399c2c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3940cf7e0 0x7fc3940b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.088+0000 7fc399c2c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3940b6170 con 0x7fc3940cf7e0 2023-10-06T02:21:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.088+0000 7fc399c2c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39415dd40 con 0x7fc3940ccd40 2023-10-06T02:21:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.088+0000 7fc399c2c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39415e020 con 0x7fc3940d0400 2023-10-06T02:21:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.088+0000 7fc393fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3940cf7e0 0x7fc3940b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.088+0000 7fc393fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3940cf7e0 0x7fc3940b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52904/0 (socket says 172.21.15.6:52904) 2023-10-06T02:21:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.088+0000 7fc393fff700 1 -- 172.21.15.6:0/3941455958 learned_addr learned my addr 172.21.15.6:0/3941455958 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.089+0000 7fc392ffd700 1 --2- 172.21.15.6:0/3941455958 >> v2:172.21.15.175:3300/0 conn(0x7fc3940ccd40 0x7fc3940cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.089+0000 7fc3937fe700 1 --2- 172.21.15.6:0/3941455958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3940d0400 0x7fc3940b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.089+0000 7fc393fff700 1 -- 172.21.15.6:0/3941455958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3940d0400 msgr2=0x7fc3940b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.089+0000 7fc393fff700 1 --2- 172.21.15.6:0/3941455958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3940d0400 0x7fc3940b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.089+0000 7fc393fff700 1 -- 172.21.15.6:0/3941455958 >> v2:172.21.15.175:3300/0 conn(0x7fc3940ccd40 msgr2=0x7fc3940cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.089+0000 7fc393fff700 1 --2- 172.21.15.6:0/3941455958 >> v2:172.21.15.175:3300/0 conn(0x7fc3940ccd40 0x7fc3940cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.089+0000 7fc393fff700 1 -- 172.21.15.6:0/3941455958 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3940ceaa0 con 0x7fc3940cf7e0 2023-10-06T02:21:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.089+0000 7fc393fff700 1 --2- 172.21.15.6:0/3941455958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3940cf7e0 0x7fc3940b3aa0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc394089490 tx=0x7fc38c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38417d7f4627425c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.089+0000 7fc3927fc700 1 -- 172.21.15.6:0/3941455958 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00e070 con 0x7fc3940cf7e0 2023-10-06T02:21:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.089+0000 7fc3927fc700 1 -- 172.21.15.6:0/3941455958 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c00b970 con 0x7fc3940cf7e0 2023-10-06T02:21:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.089+0000 7fc3927fc700 1 -- 172.21.15.6:0/3941455958 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c0092e0 con 0x7fc3940cf7e0 2023-10-06T02:21:19.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.090+0000 7fc399c2c700 1 -- 172.21.15.6:0/3941455958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3940cf7e0 msgr2=0x7fc3940b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.090+0000 7fc399c2c700 1 --2- 172.21.15.6:0/3941455958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3940cf7e0 0x7fc3940b3aa0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc394089490 tx=0x7fc38c009840 comp rx=0 tx=0).stop 2023-10-06T02:21:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.090+0000 7fc399c2c700 1 -- 172.21.15.6:0/3941455958 shutdown_connections 2023-10-06T02:21:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.090+0000 7fc399c2c700 1 --2- 172.21.15.6:0/3941455958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3940cf7e0 0x7fc3940b3aa0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.090+0000 7fc399c2c700 1 --2- 172.21.15.6:0/3941455958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3940d0400 0x7fc3940b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.090+0000 7fc399c2c700 1 --2- 172.21.15.6:0/3941455958 >> v2:172.21.15.175:3300/0 conn(0x7fc3940ccd40 0x7fc3940cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.090+0000 7fc399c2c700 1 -- 172.21.15.6:0/3941455958 >> 172.21.15.6:0/3941455958 conn(0x7fc39406a220 msgr2=0x7fc39406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.090+0000 7fc399c2c700 1 -- 172.21.15.6:0/3941455958 shutdown_connections 2023-10-06T02:21:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.090+0000 7fc399c2c700 1 -- 172.21.15.6:0/3941455958 wait complete. 2023-10-06T02:21:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.091+0000 7fc399c2c700 1 Processor -- start 2023-10-06T02:21:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.091+0000 7fc399c2c700 1 -- start start 2023-10-06T02:21:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.092+0000 7fc399c2c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3940ccd40 0x7fc394156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.092+0000 7fc399c2c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3940cf7e0 0x7fc39415c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.092+0000 7fc399c2c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3940d0400 0x7fc3940c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.092+0000 7fc399c2c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3941698c0 con 0x7fc3940d0400 2023-10-06T02:21:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.092+0000 7fc399c2c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39415ad20 con 0x7fc3940ccd40 2023-10-06T02:21:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.092+0000 7fc399c2c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39415a110 con 0x7fc3940cf7e0 2023-10-06T02:21:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.092+0000 7fc393fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3940d0400 0x7fc3940c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.092+0000 7fc393fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3940d0400 0x7fc3940c5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52906/0 (socket says 172.21.15.6:52906) 2023-10-06T02:21:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.092+0000 7fc393fff700 1 -- 172.21.15.6:0/3759094563 learned_addr learned my addr 172.21.15.6:0/3759094563 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.092+0000 7fc392ffd700 1 --2- 172.21.15.6:0/3759094563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3940cf7e0 0x7fc39415c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.092+0000 7fc3937fe700 1 --2- 172.21.15.6:0/3759094563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3940ccd40 0x7fc394156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.092+0000 7fc393fff700 1 -- 172.21.15.6:0/3759094563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3940cf7e0 msgr2=0x7fc39415c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:19.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.093+0000 7fc393fff700 1 --2- 172.21.15.6:0/3759094563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3940cf7e0 0x7fc39415c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.093+0000 7fc393fff700 1 -- 172.21.15.6:0/3759094563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3940ccd40 msgr2=0x7fc394156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:19.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.093+0000 7fc393fff700 1 --2- 172.21.15.6:0/3759094563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3940ccd40 0x7fc394156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.093+0000 7fc393fff700 1 -- 172.21.15.6:0/3759094563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c009ae0 con 0x7fc3940d0400 2023-10-06T02:21:19.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.093+0000 7fc393fff700 1 --2- 172.21.15.6:0/3759094563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3940d0400 0x7fc3940c5100 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009880 tx=0x7fc38c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:19.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.093+0000 7fc38b7fe700 1 -- 172.21.15.6:0/3759094563 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c0032f0 con 0x7fc3940d0400 2023-10-06T02:21:19.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.093+0000 7fc38b7fe700 1 -- 172.21.15.6:0/3759094563 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c008b10 con 0x7fc3940d0400 2023-10-06T02:21:19.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.093+0000 7fc38b7fe700 1 -- 172.21.15.6:0/3759094563 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c026460 con 0x7fc3940d0400 2023-10-06T02:21:19.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.093+0000 7fc399c2c700 1 -- 172.21.15.6:0/3759094563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39415a3f0 con 0x7fc3940d0400 2023-10-06T02:21:19.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.093+0000 7fc399c2c700 1 -- 172.21.15.6:0/3759094563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39415a9b0 con 0x7fc3940d0400 2023-10-06T02:21:19.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.095+0000 7fc38b7fe700 1 -- 172.21.15.6:0/3759094563 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc38c003040 con 0x7fc3940d0400 2023-10-06T02:21:19.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.095+0000 7fc38b7fe700 1 --2- 172.21.15.6:0/3759094563 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc374066f30 0x7fc3740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.095+0000 7fc38b7fe700 1 -- 172.21.15.6:0/3759094563 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fc38c086560 con 0x7fc3940d0400 2023-10-06T02:21:19.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.095+0000 7fc3937fe700 1 --2- 172.21.15.6:0/3759094563 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc374066f30 0x7fc3740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.096+0000 7fc3937fe700 1 --2- 172.21.15.6:0/3759094563 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc374066f30 0x7fc3740693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc37c009d00 tx=0x7fc37c009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:19.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.097+0000 7fc3a2f24b80 1 Processor -- start 2023-10-06T02:21:19.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.097+0000 7fc3a2f24b80 1 -- start start 2023-10-06T02:21:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.098+0000 7fc3a2f24b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766ab8f0 0x5567766abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.098+0000 7fc3a2f24b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766acd70 0x5567766fb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.098+0000 7fc3a2f24b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 0x5567766fc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.098+0000 7fc3a2f24b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556776602b20 con 0x5567766ab8f0 2023-10-06T02:21:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.098+0000 7fc3a2f24b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556776600320 con 0x5567766fbcb0 2023-10-06T02:21:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.098+0000 7fc3a2f24b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5567765fc110 con 0x5567766acd70 2023-10-06T02:21:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.098+0000 7fc3937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766ab8f0 0x5567766abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.098+0000 7fc3937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766ab8f0 0x5567766abcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52914/0 (socket says 172.21.15.6:52914) 2023-10-06T02:21:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.098+0000 7fc392ffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766acd70 0x5567766fb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.098+0000 7fc3937fe700 1 -- 172.21.15.6:0/2759480799 learned_addr learned my addr 172.21.15.6:0/2759480799 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.098+0000 7fc393fff700 1 --2- 172.21.15.6:0/2759480799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 0x5567766fc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.098+0000 7fc3937fe700 1 -- 172.21.15.6:0/2759480799 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766acd70 msgr2=0x5567766fb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.098+0000 7fc3937fe700 1 --2- 172.21.15.6:0/2759480799 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766acd70 0x5567766fb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.098+0000 7fc3937fe700 1 -- 172.21.15.6:0/2759480799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 msgr2=0x5567766fc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.098+0000 7fc3937fe700 1 --2- 172.21.15.6:0/2759480799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 0x5567766fc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.098+0000 7fc3937fe700 1 -- 172.21.15.6:0/2759480799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556776496320 con 0x5567766ab8f0 2023-10-06T02:21:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.098+0000 7fc3937fe700 1 --2- 172.21.15.6:0/2759480799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766ab8f0 0x5567766abcc0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fc37c011eb0 tx=0x7fc37c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6a40292b8cdace server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.099+0000 7fc388ff9700 1 -- 172.21.15.6:0/2759480799 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c0060d0 con 0x5567766ab8f0 2023-10-06T02:21:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.099+0000 7fc388ff9700 1 -- 172.21.15.6:0/2759480799 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37c006230 con 0x5567766ab8f0 2023-10-06T02:21:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.099+0000 7fc388ff9700 1 -- 172.21.15.6:0/2759480799 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c0065b0 con 0x5567766ab8f0 2023-10-06T02:21:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.099+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/2759480799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766ab8f0 msgr2=0x5567766abcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.099+0000 7fc3a2f24b80 1 --2- 172.21.15.6:0/2759480799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766ab8f0 0x5567766abcc0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fc37c011eb0 tx=0x7fc37c018000 comp rx=0 tx=0).stop 2023-10-06T02:21:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.099+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/2759480799 shutdown_connections 2023-10-06T02:21:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.099+0000 7fc3a2f24b80 1 --2- 172.21.15.6:0/2759480799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 0x5567766fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.099+0000 7fc3a2f24b80 1 --2- 172.21.15.6:0/2759480799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766ab8f0 0x5567766abcc0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.099+0000 7fc3a2f24b80 1 --2- 172.21.15.6:0/2759480799 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766acd70 0x5567766fb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.099+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/2759480799 >> 172.21.15.6:0/2759480799 conn(0x5567766ad210 msgr2=0x5567766ad5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.099+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/2759480799 shutdown_connections 2023-10-06T02:21:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.099+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/2759480799 wait complete. 2023-10-06T02:21:19.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.100+0000 7fc3a2f24b80 1 -- start start 2023-10-06T02:21:19.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.100+0000 7fc3a2f24b80 1 Processor -- start 2023-10-06T02:21:19.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc3a2f24b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766ab8f0 0x5567766ea4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc3a2f24b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766acd70 0x5567766ea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc3a2f24b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 0x5567766eaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc3a2f24b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567765a7940 con 0x5567766acd70 2023-10-06T02:21:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc3a2f24b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567765c2f50 con 0x5567766fbcb0 2023-10-06T02:21:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc3a2f24b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55677647eee0 con 0x5567766ab8f0 2023-10-06T02:21:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc3a2f24b80 10 client.0 _ll_register_callbacks cb 0x55677666ef20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:21:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc392ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766acd70 0x5567766ea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc392ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766acd70 0x5567766ea9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52930/0 (socket says 172.21.15.6:52930) 2023-10-06T02:21:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc392ffd700 1 -- 172.21.15.6:0/3397208679 learned_addr learned my addr 172.21.15.6:0/3397208679 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc393fff700 1 --2- 172.21.15.6:0/3397208679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 0x5567766eaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc3937fe700 1 --2- 172.21.15.6:0/3397208679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766ab8f0 0x5567766ea4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc392ffd700 1 -- 172.21.15.6:0/3397208679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766ab8f0 msgr2=0x5567766ea4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc392ffd700 1 --2- 172.21.15.6:0/3397208679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766ab8f0 0x5567766ea4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc392ffd700 1 -- 172.21.15.6:0/3397208679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 msgr2=0x5567766eaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc392ffd700 1 --2- 172.21.15.6:0/3397208679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 0x5567766eaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc392ffd700 1 -- 172.21.15.6:0/3397208679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c011ab0 con 0x5567766acd70 2023-10-06T02:21:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc393fff700 1 --2- 172.21.15.6:0/3397208679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 0x5567766eaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc392ffd700 1 --2- 172.21.15.6:0/3397208679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766acd70 0x5567766ea9e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fc384014a60 tx=0x7fc3840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9c70f8130ba696 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.101+0000 7fc371ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:21:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.102+0000 7fc371ffb700 1 -- 172.21.15.6:0/3397208679 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc384015760 con 0x5567766acd70 2023-10-06T02:21:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.102+0000 7fc371ffb700 1 -- 172.21.15.6:0/3397208679 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fc3840158c0 con 0x5567766acd70 2023-10-06T02:21:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.102+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/3397208679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5567766a09f0 con 0x5567766acd70 2023-10-06T02:21:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.102+0000 7fc371ffb700 1 -- 172.21.15.6:0/3397208679 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc384015c90 con 0x5567766acd70 2023-10-06T02:21:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.102+0000 7fc3a2f24b80 10 client.6525 fetch_fsmap learned FSMap version 57 2023-10-06T02:21:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.102+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/3397208679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x556776439090 con 0x5567766acd70 2023-10-06T02:21:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.102+0000 7fc371ffb700 1 -- 172.21.15.6:0/3397208679 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5567766a09f0 con 0x5567766acd70 2023-10-06T02:21:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.102+0000 7fc371ffb700 1 -- 172.21.15.6:0/3397208679 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 57) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc38401d440 con 0x5567766acd70 2023-10-06T02:21:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.102+0000 7fc3a2f24b80 10 client.6525 fetch_fsmap finished waiting for FSMap version 57 2023-10-06T02:21:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.102+0000 7fc3a2f24b80 10 client.6525 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T02:21:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.102+0000 7fc3a2f24b80 20 client.6525 populate_metadata read hostname 'smithi006' 2023-10-06T02:21:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.102+0000 7fc3a2f24b80 1 --2- 172.21.15.6:0/3397208679 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x5567766e9c90 0x5567766da9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.102+0000 7fc3a2f24b80 4 client.6525 mds_command: new command op to 6210 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:21:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.102+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/3397208679 --> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55677667d920 con 0x5567766e9c90 2023-10-06T02:21:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.102+0000 7fc3937fe700 1 --2- 172.21.15.6:0/3397208679 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x5567766e9c90 0x5567766da9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.103+0000 7fc371ffb700 10 client.6525 ms_handle_connect on v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.103+0000 7fc3937fe700 1 --2- 172.21.15.6:0/3397208679 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x5567766e9c90 0x5567766da9b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7e6304b9343f5dc server_cookie=778efb2bb9dde19a in_seq=0 out_seq=0 2023-10-06T02:21:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.103+0000 7fc371ffb700 1 -- 172.21.15.6:0/3397208679 <== mds.0 v2:172.21.15.6:6832/3777949337 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55677667d920 con 0x5567766e9c90 2023-10-06T02:21:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.103+0000 7fc371ffb700 10 client.6525 handle_command_reply: tid=0 2023-10-06T02:21:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.103+0000 7fc3a2f24b80 1 client.6525 shutdown 2023-10-06T02:21:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.103+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/3397208679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766acd70 msgr2=0x5567766ea9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.103+0000 7fc3a2f24b80 1 --2- 172.21.15.6:0/3397208679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766acd70 0x5567766ea9e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fc384014a60 tx=0x7fc3840091a0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.103+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/3397208679 shutdown_connections 2023-10-06T02:21:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.103+0000 7fc3a2f24b80 1 --2- 172.21.15.6:0/3397208679 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x5567766e9c90 0x5567766da9b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.103+0000 7fc3a2f24b80 1 --2- 172.21.15.6:0/3397208679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 0x5567766eaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.103+0000 7fc3a2f24b80 1 --2- 172.21.15.6:0/3397208679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766ab8f0 0x5567766ea4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.103+0000 7fc3a2f24b80 1 --2- 172.21.15.6:0/3397208679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766acd70 0x5567766ea9e0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.103+0000 7fc371ffb700 0 client.6525 ms_handle_reset on v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.103+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/3397208679 >> 172.21.15.6:0/3397208679 conn(0x5567766ad210 msgr2=0x5567766ac260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.104+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/3397208679 shutdown_connections 2023-10-06T02:21:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.104+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/3397208679 wait complete. 2023-10-06T02:21:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.104+0000 7fc3a2f24b80 20 client.6525 trim_cache size 0 max 16384 2023-10-06T02:21:19.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.118+0000 7fc3a2f24b80 1 Processor -- start 2023-10-06T02:21:19.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.118+0000 7fc3a2f24b80 1 -- start start 2023-10-06T02:21:19.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.118+0000 7fc3a2f24b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766ab8f0 0x5567766ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.118+0000 7fc3a2f24b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766acd70 0x5567766da9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.118+0000 7fc3a2f24b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 0x5567766daef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.118+0000 7fc3a2f24b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567766e9b00 con 0x5567766acd70 2023-10-06T02:21:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.118+0000 7fc3a2f24b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567766efc80 con 0x5567766fbcb0 2023-10-06T02:21:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.118+0000 7fc3a2f24b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5567766a7770 con 0x5567766ab8f0 2023-10-06T02:21:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.119+0000 7fc392ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766acd70 0x5567766da9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.119+0000 7fc392ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766acd70 0x5567766da9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52942/0 (socket says 172.21.15.6:52942) 2023-10-06T02:21:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.119+0000 7fc392ffd700 1 -- 172.21.15.6:0/2513245126 learned_addr learned my addr 172.21.15.6:0/2513245126 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.119+0000 7fc3937fe700 1 --2- 172.21.15.6:0/2513245126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766ab8f0 0x5567766ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.119+0000 7fc393fff700 1 --2- 172.21.15.6:0/2513245126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 0x5567766daef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.119+0000 7fc392ffd700 1 -- 172.21.15.6:0/2513245126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766ab8f0 msgr2=0x5567766ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.119+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2513245126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766ab8f0 0x5567766ad9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.119+0000 7fc392ffd700 1 -- 172.21.15.6:0/2513245126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 msgr2=0x5567766daef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.119+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2513245126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 0x5567766daef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.119+0000 7fc392ffd700 1 -- 172.21.15.6:0/2513245126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567765ca830 con 0x5567766acd70 2023-10-06T02:21:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.119+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2513245126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766acd70 0x5567766da9b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc384009930 tx=0x7fc38401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e42984d535d736 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.119+0000 7fc3897fa700 1 -- 172.21.15.6:0/2513245126 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38401d9a0 con 0x5567766acd70 2023-10-06T02:21:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.119+0000 7fc3897fa700 1 -- 172.21.15.6:0/2513245126 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38401d440 con 0x5567766acd70 2023-10-06T02:21:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.119+0000 7fc3897fa700 1 -- 172.21.15.6:0/2513245126 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38401d5b0 con 0x5567766acd70 2023-10-06T02:21:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.120+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/2513245126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766acd70 msgr2=0x5567766da9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.120+0000 7fc3a2f24b80 1 --2- 172.21.15.6:0/2513245126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766acd70 0x5567766da9b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc384009930 tx=0x7fc38401d000 comp rx=0 tx=0).stop 2023-10-06T02:21:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.120+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/2513245126 shutdown_connections 2023-10-06T02:21:19.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.120+0000 7fc3a2f24b80 1 --2- 172.21.15.6:0/2513245126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 0x5567766daef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.120+0000 7fc3a2f24b80 1 --2- 172.21.15.6:0/2513245126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766ab8f0 0x5567766ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.120+0000 7fc3a2f24b80 1 --2- 172.21.15.6:0/2513245126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766acd70 0x5567766da9b0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.120+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/2513245126 >> 172.21.15.6:0/2513245126 conn(0x5567766ad210 msgr2=0x5567766d8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:19.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.120+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/2513245126 shutdown_connections 2023-10-06T02:21:19.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.120+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/2513245126 wait complete. 2023-10-06T02:21:19.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.121+0000 7fc3a2f24b80 1 -- start start 2023-10-06T02:21:19.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.121+0000 7fc3a2f24b80 1 Processor -- start 2023-10-06T02:21:19.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.121+0000 7fc3a2f24b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766ab8f0 0x5567766da9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.121+0000 7fc3a2f24b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766acd70 0x5567766daef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.121+0000 7fc3a2f24b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 0x5567766a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.121+0000 7fc3a2f24b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567766f3650 con 0x5567766ab8f0 2023-10-06T02:21:19.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.121+0000 7fc3a2f24b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567766eaaf0 con 0x5567766fbcb0 2023-10-06T02:21:19.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.121+0000 7fc3a2f24b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55677675afc0 con 0x5567766acd70 2023-10-06T02:21:19.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.121+0000 7fc3a2f24b80 10 client.0 _ll_register_callbacks cb 0x55677666ef20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:21:19.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.121+0000 7fc3937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766ab8f0 0x5567766da9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc3937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766ab8f0 0x5567766da9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52946/0 (socket says 172.21.15.6:52946) 2023-10-06T02:21:19.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc3937fe700 1 -- 172.21.15.6:0/2705567037 learned_addr learned my addr 172.21.15.6:0/2705567037 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:19.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766acd70 0x5567766daef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc393fff700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 0x5567766a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc3937fe700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766acd70 msgr2=0x5567766daef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:19.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc3937fe700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5567766acd70 0x5567766daef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc3937fe700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 msgr2=0x5567766a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:19.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc3937fe700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 0x5567766a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc3937fe700 1 -- 172.21.15.6:0/2705567037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556776439090 con 0x5567766ab8f0 2023-10-06T02:21:19.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc393fff700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567766fbcb0 0x5567766a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:19.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc3937fe700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5567766ab8f0 0x5567766da9b0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc37c011930 tx=0x7fc37c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca25ae83b755adc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:19.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc371ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:21:19.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc371ffb700 1 -- 172.21.15.6:0/2705567037 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c006090 con 0x5567766ab8f0 2023-10-06T02:21:19.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc371ffb700 1 -- 172.21.15.6:0/2705567037 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fc37c0065b0 con 0x5567766ab8f0 2023-10-06T02:21:19.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/2705567037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc37c006230 con 0x5567766ab8f0 2023-10-06T02:21:19.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc371ffb700 1 -- 172.21.15.6:0/2705567037 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc37c021650 con 0x5567766ab8f0 2023-10-06T02:21:19.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc3a2f24b80 10 client.6531 fetch_fsmap learned FSMap version 57 2023-10-06T02:21:19.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/2705567037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x5567765b1520 con 0x5567766ab8f0 2023-10-06T02:21:19.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.122+0000 7fc371ffb700 1 -- 172.21.15.6:0/2705567037 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37c006230 con 0x5567766ab8f0 2023-10-06T02:21:19.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.123+0000 7fc371ffb700 1 -- 172.21.15.6:0/2705567037 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 57) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc37c0217b0 con 0x5567766ab8f0 2023-10-06T02:21:19.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.123+0000 7fc3a2f24b80 10 client.6531 fetch_fsmap finished waiting for FSMap version 57 2023-10-06T02:21:19.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.123+0000 7fc3a2f24b80 10 client.6531 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T02:21:19.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.123+0000 7fc3a2f24b80 20 client.6531 populate_metadata read hostname 'smithi006' 2023-10-06T02:21:19.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.123+0000 7fc3a2f24b80 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.123+0000 7fc3a2f24b80 4 client.6531 mds_command: new command op to 6210 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:21:19.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.123+0000 7fc3a2f24b80 1 -- 172.21.15.6:0/2705567037 --> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55677659eeb0 con 0x556776758350 2023-10-06T02:21:19.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.123+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.123+0000 7fc371ffb700 10 client.6531 ms_handle_connect on v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:19.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.123+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2a8c3aea0ee341a server_cookie=818a74a7cbb9bf56 in_seq=0 out_seq=0 2023-10-06T02:21:19.130 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-06T02:21:19.125+0000 7f0af26df700 -1 mds.0.cache.den(0x1 a) newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x559c10f4d400] 2023-10-06T02:21:19.130 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-06T02:21:19.125+0000 7f0af26df700 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x559c10f4d400] 2023-10-06T02:21:19.131 INFO:tasks.ceph.mds.c.smithi006.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.2.6-1296-g736ac5ba/rpm/el8/BUILD/ceph-17.2.6-1296-g736ac5ba/src/mds/CDentry.cc: In function 'bool CDentry::check_corruption(bool)' thread 7f0af26df700 time 2023-10-06T02:21:19.127507+0000 2023-10-06T02:21:19.131 INFO:tasks.ceph.mds.c.smithi006.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.2.6-1296-g736ac5ba/rpm/el8/BUILD/ceph-17.2.6-1296-g736ac5ba/src/mds/CDentry.cc: 703: ceph_abort_msg("abort() called") 2023-10-06T02:21:19.132 INFO:tasks.ceph.mds.c.smithi006.stderr: ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable) 2023-10-06T02:21:19.132 INFO:tasks.ceph.mds.c.smithi006.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7f0b00ef1afd] 2023-10-06T02:21:19.132 INFO:tasks.ceph.mds.c.smithi006.stderr: 2: (CDentry::check_corruption(bool)+0x9a2) [0x559c100723d2] 2023-10-06T02:21:19.132 INFO:tasks.ceph.mds.c.smithi006.stderr: 3: ceph-mds(+0x448252) [0x559c1008a252] 2023-10-06T02:21:19.132 INFO:tasks.ceph.mds.c.smithi006.stderr: 4: (CDir::_omap_commit(int)+0x2da) [0x559c1008a9ba] 2023-10-06T02:21:19.132 INFO:tasks.ceph.mds.c.smithi006.stderr: 5: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x21e) [0x559c1008bd8e] 2023-10-06T02:21:19.132 INFO:tasks.ceph.mds.c.smithi006.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xc8f) [0x559c101ea9ef] 2023-10-06T02:21:19.132 INFO:tasks.ceph.mds.c.smithi006.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x6a) [0x559c10169a4a] 2023-10-06T02:21:19.132 INFO:tasks.ceph.mds.c.smithi006.stderr: 8: (MDLog::trim_all()+0x764) [0x559c1016b364] 2023-10-06T02:21:19.132 INFO:tasks.ceph.mds.c.smithi006.stderr: 9: (C_Flush_Journal::trim_mdlog()+0x154) [0x559c0fe36884] 2023-10-06T02:21:19.132 INFO:tasks.ceph.mds.c.smithi006.stderr: 10: (Context::complete(int)+0xd) [0x559c0fdef95d] 2023-10-06T02:21:19.133 INFO:tasks.ceph.mds.c.smithi006.stderr: 11: (MDSContext::complete(int)+0x5f) [0x559c101508af] 2023-10-06T02:21:19.133 INFO:tasks.ceph.mds.c.smithi006.stderr: 12: (C_IO_Wrapper::finish(int)+0x12) [0x559c10151792] 2023-10-06T02:21:19.133 INFO:tasks.ceph.mds.c.smithi006.stderr: 13: (MDSContext::complete(int)+0x5f) [0x559c101508af] 2023-10-06T02:21:19.133 INFO:tasks.ceph.mds.c.smithi006.stderr: 14: (MDSIOContextBase::complete(int)+0x534) [0x559c10151044] 2023-10-06T02:21:19.133 INFO:tasks.ceph.mds.c.smithi006.stderr: 15: (Finisher::finisher_thread_entry()+0x18d) [0x7f0b00f9084d] 2023-10-06T02:21:19.133 INFO:tasks.ceph.mds.c.smithi006.stderr: 16: /lib64/libpthread.so.0(+0x814a) [0x7f0affee414a] 2023-10-06T02:21:19.133 INFO:tasks.ceph.mds.c.smithi006.stderr: 17: clone() 2023-10-06T02:21:19.133 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-06T02:21:19.127+0000 7f0af26df700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.2.6-1296-g736ac5ba/rpm/el8/BUILD/ceph-17.2.6-1296-g736ac5ba/src/mds/CDentry.cc: In function 'bool CDentry::check_corruption(bool)' thread 7f0af26df700 time 2023-10-06T02:21:19.127507+0000 2023-10-06T02:21:19.133 INFO:tasks.ceph.mds.c.smithi006.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.2.6-1296-g736ac5ba/rpm/el8/BUILD/ceph-17.2.6-1296-g736ac5ba/src/mds/CDentry.cc: 703: ceph_abort_msg("abort() called") 2023-10-06T02:21:19.133 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:21:19.133 INFO:tasks.ceph.mds.c.smithi006.stderr: ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable) 2023-10-06T02:21:19.133 INFO:tasks.ceph.mds.c.smithi006.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7f0b00ef1afd] 2023-10-06T02:21:19.133 INFO:tasks.ceph.mds.c.smithi006.stderr: 2: (CDentry::check_corruption(bool)+0x9a2) [0x559c100723d2] 2023-10-06T02:21:19.134 INFO:tasks.ceph.mds.c.smithi006.stderr: 3: ceph-mds(+0x448252) [0x559c1008a252] 2023-10-06T02:21:19.134 INFO:tasks.ceph.mds.c.smithi006.stderr: 4: (CDir::_omap_commit(int)+0x2da) [0x559c1008a9ba] 2023-10-06T02:21:19.134 INFO:tasks.ceph.mds.c.smithi006.stderr: 5: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x21e) [0x559c1008bd8e] 2023-10-06T02:21:19.134 INFO:tasks.ceph.mds.c.smithi006.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xc8f) [0x559c101ea9ef] 2023-10-06T02:21:19.134 INFO:tasks.ceph.mds.c.smithi006.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x6a) [0x559c10169a4a] 2023-10-06T02:21:19.134 INFO:tasks.ceph.mds.c.smithi006.stderr: 8: (MDLog::trim_all()+0x764) [0x559c1016b364] 2023-10-06T02:21:19.134 INFO:tasks.ceph.mds.c.smithi006.stderr: 9: (C_Flush_Journal::trim_mdlog()+0x154) [0x559c0fe36884] 2023-10-06T02:21:19.134 INFO:tasks.ceph.mds.c.smithi006.stderr: 10: (Context::complete(int)+0xd) [0x559c0fdef95d] 2023-10-06T02:21:19.134 INFO:tasks.ceph.mds.c.smithi006.stderr: 11: (MDSContext::complete(int)+0x5f) [0x559c101508af] 2023-10-06T02:21:19.134 INFO:tasks.ceph.mds.c.smithi006.stderr: 12: (C_IO_Wrapper::finish(int)+0x12) [0x559c10151792] 2023-10-06T02:21:19.134 INFO:tasks.ceph.mds.c.smithi006.stderr: 13: (MDSContext::complete(int)+0x5f) [0x559c101508af] 2023-10-06T02:21:19.134 INFO:tasks.ceph.mds.c.smithi006.stderr: 14: (MDSIOContextBase::complete(int)+0x534) [0x559c10151044] 2023-10-06T02:21:19.135 INFO:tasks.ceph.mds.c.smithi006.stderr: 15: (Finisher::finisher_thread_entry()+0x18d) [0x7f0b00f9084d] 2023-10-06T02:21:19.135 INFO:tasks.ceph.mds.c.smithi006.stderr: 16: /lib64/libpthread.so.0(+0x814a) [0x7f0affee414a] 2023-10-06T02:21:19.135 INFO:tasks.ceph.mds.c.smithi006.stderr: 17: clone() 2023-10-06T02:21:19.135 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:21:19.135 INFO:tasks.ceph.mds.c.smithi006.stderr:*** Caught signal (Aborted) ** 2023-10-06T02:21:19.135 INFO:tasks.ceph.mds.c.smithi006.stderr: in thread 7f0af26df700 thread_name:MR_Finisher 2023-10-06T02:21:19.135 INFO:tasks.ceph.mds.c.smithi006.stderr: ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable) 2023-10-06T02:21:19.135 INFO:tasks.ceph.mds.c.smithi006.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f0affeeeb20] 2023-10-06T02:21:19.135 INFO:tasks.ceph.mds.c.smithi006.stderr: 2: gsignal() 2023-10-06T02:21:19.135 INFO:tasks.ceph.mds.c.smithi006.stderr: 3: abort() 2023-10-06T02:21:19.135 INFO:tasks.ceph.mds.c.smithi006.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x7f0b00ef1bbd] 2023-10-06T02:21:19.135 INFO:tasks.ceph.mds.c.smithi006.stderr: 5: (CDentry::check_corruption(bool)+0x9a2) [0x559c100723d2] 2023-10-06T02:21:19.136 INFO:tasks.ceph.mds.c.smithi006.stderr: 6: ceph-mds(+0x448252) [0x559c1008a252] 2023-10-06T02:21:19.136 INFO:tasks.ceph.mds.c.smithi006.stderr: 7: (CDir::_omap_commit(int)+0x2da) [0x559c1008a9ba] 2023-10-06T02:21:19.136 INFO:tasks.ceph.mds.c.smithi006.stderr: 8: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x21e) [0x559c1008bd8e] 2023-10-06T02:21:19.136 INFO:tasks.ceph.mds.c.smithi006.stderr: 9: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xc8f) [0x559c101ea9ef] 2023-10-06T02:21:19.136 INFO:tasks.ceph.mds.c.smithi006.stderr: 10: (MDLog::try_expire(LogSegment*, int)+0x6a) [0x559c10169a4a] 2023-10-06T02:21:19.136 INFO:tasks.ceph.mds.c.smithi006.stderr: 11: (MDLog::trim_all()+0x764) [0x559c1016b364] 2023-10-06T02:21:19.136 INFO:tasks.ceph.mds.c.smithi006.stderr: 12: (C_Flush_Journal::trim_mdlog()+0x154) [0x559c0fe36884] 2023-10-06T02:21:19.136 INFO:tasks.ceph.mds.c.smithi006.stderr: 13: (Context::complete(int)+0xd) [0x559c0fdef95d] 2023-10-06T02:21:19.136 INFO:tasks.ceph.mds.c.smithi006.stderr: 14: (MDSContext::complete(int)+0x5f) [0x559c101508af] 2023-10-06T02:21:19.136 INFO:tasks.ceph.mds.c.smithi006.stderr: 15: (C_IO_Wrapper::finish(int)+0x12) [0x559c10151792] 2023-10-06T02:21:19.136 INFO:tasks.ceph.mds.c.smithi006.stderr: 16: (MDSContext::complete(int)+0x5f) [0x559c101508af] 2023-10-06T02:21:19.136 INFO:tasks.ceph.mds.c.smithi006.stderr: 17: (MDSIOContextBase::complete(int)+0x534) [0x559c10151044] 2023-10-06T02:21:19.137 INFO:tasks.ceph.mds.c.smithi006.stderr: 18: (Finisher::finisher_thread_entry()+0x18d) [0x7f0b00f9084d] 2023-10-06T02:21:19.137 INFO:tasks.ceph.mds.c.smithi006.stderr: 19: /lib64/libpthread.so.0(+0x814a) [0x7f0affee414a] 2023-10-06T02:21:19.137 INFO:tasks.ceph.mds.c.smithi006.stderr: 20: clone() 2023-10-06T02:21:19.137 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-06T02:21:19.129+0000 7f0af26df700 -1 *** Caught signal (Aborted) ** 2023-10-06T02:21:19.137 INFO:tasks.ceph.mds.c.smithi006.stderr: in thread 7f0af26df700 thread_name:MR_Finisher 2023-10-06T02:21:19.137 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:21:19.137 INFO:tasks.ceph.mds.c.smithi006.stderr: ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable) 2023-10-06T02:21:19.137 INFO:tasks.ceph.mds.c.smithi006.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f0affeeeb20] 2023-10-06T02:21:19.137 INFO:tasks.ceph.mds.c.smithi006.stderr: 2: gsignal() 2023-10-06T02:21:19.137 INFO:tasks.ceph.mds.c.smithi006.stderr: 3: abort() 2023-10-06T02:21:19.137 INFO:tasks.ceph.mds.c.smithi006.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x7f0b00ef1bbd] 2023-10-06T02:21:19.137 INFO:tasks.ceph.mds.c.smithi006.stderr: 5: (CDentry::check_corruption(bool)+0x9a2) [0x559c100723d2] 2023-10-06T02:21:19.137 INFO:tasks.ceph.mds.c.smithi006.stderr: 6: ceph-mds(+0x448252) [0x559c1008a252] 2023-10-06T02:21:19.138 INFO:tasks.ceph.mds.c.smithi006.stderr: 7: (CDir::_omap_commit(int)+0x2da) [0x559c1008a9ba] 2023-10-06T02:21:19.138 INFO:tasks.ceph.mds.c.smithi006.stderr: 8: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x21e) [0x559c1008bd8e] 2023-10-06T02:21:19.138 INFO:tasks.ceph.mds.c.smithi006.stderr: 9: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xc8f) [0x559c101ea9ef] 2023-10-06T02:21:19.138 INFO:tasks.ceph.mds.c.smithi006.stderr: 10: (MDLog::try_expire(LogSegment*, int)+0x6a) [0x559c10169a4a] 2023-10-06T02:21:19.138 INFO:tasks.ceph.mds.c.smithi006.stderr: 11: (MDLog::trim_all()+0x764) [0x559c1016b364] 2023-10-06T02:21:19.138 INFO:tasks.ceph.mds.c.smithi006.stderr: 12: (C_Flush_Journal::trim_mdlog()+0x154) [0x559c0fe36884] 2023-10-06T02:21:19.138 INFO:tasks.ceph.mds.c.smithi006.stderr: 13: (Context::complete(int)+0xd) [0x559c0fdef95d] 2023-10-06T02:21:19.138 INFO:tasks.ceph.mds.c.smithi006.stderr: 14: (MDSContext::complete(int)+0x5f) [0x559c101508af] 2023-10-06T02:21:19.138 INFO:tasks.ceph.mds.c.smithi006.stderr: 15: (C_IO_Wrapper::finish(int)+0x12) [0x559c10151792] 2023-10-06T02:21:19.138 INFO:tasks.ceph.mds.c.smithi006.stderr: 16: (MDSContext::complete(int)+0x5f) [0x559c101508af] 2023-10-06T02:21:19.138 INFO:tasks.ceph.mds.c.smithi006.stderr: 17: (MDSIOContextBase::complete(int)+0x534) [0x559c10151044] 2023-10-06T02:21:19.138 INFO:tasks.ceph.mds.c.smithi006.stderr: 18: (Finisher::finisher_thread_entry()+0x18d) [0x7f0b00f9084d] 2023-10-06T02:21:19.139 INFO:tasks.ceph.mds.c.smithi006.stderr: 19: /lib64/libpthread.so.0(+0x814a) [0x7f0affee414a] 2023-10-06T02:21:19.139 INFO:tasks.ceph.mds.c.smithi006.stderr: 20: clone() 2023-10-06T02:21:19.139 INFO:tasks.ceph.mds.c.smithi006.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-06T02:21:19.139 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:21:19.140 INFO:tasks.ceph.mds.c.smithi006.stderr: -210> 2023-10-06T02:21:16.133+0000 7f0af5ee6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:21:19.140 INFO:tasks.ceph.mds.c.smithi006.stderr: -7> 2023-10-06T02:21:19.125+0000 7f0af26df700 -1 mds.0.cache.den(0x1 a) newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x559c10f4d400] 2023-10-06T02:21:19.140 INFO:tasks.ceph.mds.c.smithi006.stderr: -5> 2023-10-06T02:21:19.125+0000 7f0af26df700 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x559c10f4d400] 2023-10-06T02:21:19.140 INFO:tasks.ceph.mds.c.smithi006.stderr: -1> 2023-10-06T02:21:19.127+0000 7f0af26df700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.2.6-1296-g736ac5ba/rpm/el8/BUILD/ceph-17.2.6-1296-g736ac5ba/src/mds/CDentry.cc: In function 'bool CDentry::check_corruption(bool)' thread 7f0af26df700 time 2023-10-06T02:21:19.127507+0000 2023-10-06T02:21:19.140 INFO:tasks.ceph.mds.c.smithi006.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.2.6-1296-g736ac5ba/rpm/el8/BUILD/ceph-17.2.6-1296-g736ac5ba/src/mds/CDentry.cc: 703: ceph_abort_msg("abort() called") 2023-10-06T02:21:19.140 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:21:19.140 INFO:tasks.ceph.mds.c.smithi006.stderr: ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable) 2023-10-06T02:21:19.141 INFO:tasks.ceph.mds.c.smithi006.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7f0b00ef1afd] 2023-10-06T02:21:19.141 INFO:tasks.ceph.mds.c.smithi006.stderr: 2: (CDentry::check_corruption(bool)+0x9a2) [0x559c100723d2] 2023-10-06T02:21:19.141 INFO:tasks.ceph.mds.c.smithi006.stderr: 3: ceph-mds(+0x448252) [0x559c1008a252] 2023-10-06T02:21:19.141 INFO:tasks.ceph.mds.c.smithi006.stderr: 4: (CDir::_omap_commit(int)+0x2da) [0x559c1008a9ba] 2023-10-06T02:21:19.141 INFO:tasks.ceph.mds.c.smithi006.stderr: 5: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x21e) [0x559c1008bd8e] 2023-10-06T02:21:19.141 INFO:tasks.ceph.mds.c.smithi006.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xc8f) [0x559c101ea9ef] 2023-10-06T02:21:19.141 INFO:tasks.ceph.mds.c.smithi006.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x6a) [0x559c10169a4a] 2023-10-06T02:21:19.141 INFO:tasks.ceph.mds.c.smithi006.stderr: 8: (MDLog::trim_all()+0x764) [0x559c1016b364] 2023-10-06T02:21:19.141 INFO:tasks.ceph.mds.c.smithi006.stderr: 9: (C_Flush_Journal::trim_mdlog()+0x154) [0x559c0fe36884] 2023-10-06T02:21:19.141 INFO:tasks.ceph.mds.c.smithi006.stderr: 10: (Context::complete(int)+0xd) [0x559c0fdef95d] 2023-10-06T02:21:19.141 INFO:tasks.ceph.mds.c.smithi006.stderr: 11: (MDSContext::complete(int)+0x5f) [0x559c101508af] 2023-10-06T02:21:19.141 INFO:tasks.ceph.mds.c.smithi006.stderr: 12: (C_IO_Wrapper::finish(int)+0x12) [0x559c10151792] 2023-10-06T02:21:19.142 INFO:tasks.ceph.mds.c.smithi006.stderr: 13: (MDSContext::complete(int)+0x5f) [0x559c101508af] 2023-10-06T02:21:19.142 INFO:tasks.ceph.mds.c.smithi006.stderr: 14: (MDSIOContextBase::complete(int)+0x534) [0x559c10151044] 2023-10-06T02:21:19.142 INFO:tasks.ceph.mds.c.smithi006.stderr: 15: (Finisher::finisher_thread_entry()+0x18d) [0x7f0b00f9084d] 2023-10-06T02:21:19.142 INFO:tasks.ceph.mds.c.smithi006.stderr: 16: /lib64/libpthread.so.0(+0x814a) [0x7f0affee414a] 2023-10-06T02:21:19.142 INFO:tasks.ceph.mds.c.smithi006.stderr: 17: clone() 2023-10-06T02:21:19.142 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:21:19.142 INFO:tasks.ceph.mds.c.smithi006.stderr: 0> 2023-10-06T02:21:19.129+0000 7f0af26df700 -1 *** Caught signal (Aborted) ** 2023-10-06T02:21:19.142 INFO:tasks.ceph.mds.c.smithi006.stderr: in thread 7f0af26df700 thread_name:MR_Finisher 2023-10-06T02:21:19.142 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:21:19.142 INFO:tasks.ceph.mds.c.smithi006.stderr: ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable) 2023-10-06T02:21:19.142 INFO:tasks.ceph.mds.c.smithi006.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f0affeeeb20] 2023-10-06T02:21:19.142 INFO:tasks.ceph.mds.c.smithi006.stderr: 2: gsignal() 2023-10-06T02:21:19.143 INFO:tasks.ceph.mds.c.smithi006.stderr: 3: abort() 2023-10-06T02:21:19.143 INFO:tasks.ceph.mds.c.smithi006.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x7f0b00ef1bbd] 2023-10-06T02:21:19.143 INFO:tasks.ceph.mds.c.smithi006.stderr: 5: (CDentry::check_corruption(bool)+0x9a2) [0x559c100723d2] 2023-10-06T02:21:19.143 INFO:tasks.ceph.mds.c.smithi006.stderr: 6: ceph-mds(+0x448252) [0x559c1008a252] 2023-10-06T02:21:19.143 INFO:tasks.ceph.mds.c.smithi006.stderr: 7: (CDir::_omap_commit(int)+0x2da) [0x559c1008a9ba] 2023-10-06T02:21:19.143 INFO:tasks.ceph.mds.c.smithi006.stderr: 8: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x21e) [0x559c1008bd8e] 2023-10-06T02:21:19.143 INFO:tasks.ceph.mds.c.smithi006.stderr: 9: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xc8f) [0x559c101ea9ef] 2023-10-06T02:21:19.143 INFO:tasks.ceph.mds.c.smithi006.stderr: 10: (MDLog::try_expire(LogSegment*, int)+0x6a) [0x559c10169a4a] 2023-10-06T02:21:19.143 INFO:tasks.ceph.mds.c.smithi006.stderr: 11: (MDLog::trim_all()+0x764) [0x559c1016b364] 2023-10-06T02:21:19.143 INFO:tasks.ceph.mds.c.smithi006.stderr: 12: (C_Flush_Journal::trim_mdlog()+0x154) [0x559c0fe36884] 2023-10-06T02:21:19.143 INFO:tasks.ceph.mds.c.smithi006.stderr: 13: (Context::complete(int)+0xd) [0x559c0fdef95d] 2023-10-06T02:21:19.144 INFO:tasks.ceph.mds.c.smithi006.stderr: 14: (MDSContext::complete(int)+0x5f) [0x559c101508af] 2023-10-06T02:21:19.144 INFO:tasks.ceph.mds.c.smithi006.stderr: 15: (C_IO_Wrapper::finish(int)+0x12) [0x559c10151792] 2023-10-06T02:21:19.144 INFO:tasks.ceph.mds.c.smithi006.stderr: 16: (MDSContext::complete(int)+0x5f) [0x559c101508af] 2023-10-06T02:21:19.144 INFO:tasks.ceph.mds.c.smithi006.stderr: 17: (MDSIOContextBase::complete(int)+0x534) [0x559c10151044] 2023-10-06T02:21:19.144 INFO:tasks.ceph.mds.c.smithi006.stderr: 18: (Finisher::finisher_thread_entry()+0x18d) [0x7f0b00f9084d] 2023-10-06T02:21:19.144 INFO:tasks.ceph.mds.c.smithi006.stderr: 19: /lib64/libpthread.so.0(+0x814a) [0x7f0affee414a] 2023-10-06T02:21:19.144 INFO:tasks.ceph.mds.c.smithi006.stderr: 20: clone() 2023-10-06T02:21:19.144 INFO:tasks.ceph.mds.c.smithi006.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-06T02:21:19.144 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:21:19.144 INFO:tasks.ceph.mds.c.smithi006.stderr: -210> 2023-10-06T02:21:16.133+0000 7f0af5ee6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:21:19.144 INFO:tasks.ceph.mds.c.smithi006.stderr: -7> 2023-10-06T02:21:19.125+0000 7f0af26df700 -1 mds.0.cache.den(0x1 a) newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x559c10f4d400] 2023-10-06T02:21:19.144 INFO:tasks.ceph.mds.c.smithi006.stderr: -5> 2023-10-06T02:21:19.125+0000 7f0af26df700 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13 ino=0x10000000000 state=1610612736 | inodepin=1 dirty=1 0x559c10f4d400] 2023-10-06T02:21:19.145 INFO:tasks.ceph.mds.c.smithi006.stderr: -1> 2023-10-06T02:21:19.127+0000 7f0af26df700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.2.6-1296-g736ac5ba/rpm/el8/BUILD/ceph-17.2.6-1296-g736ac5ba/src/mds/CDentry.cc: In function 'bool CDentry::check_corruption(bool)' thread 7f0af26df700 time 2023-10-06T02:21:19.127507+0000 2023-10-06T02:21:19.145 INFO:tasks.ceph.mds.c.smithi006.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.2.6-1296-g736ac5ba/rpm/el8/BUILD/ceph-17.2.6-1296-g736ac5ba/src/mds/CDentry.cc: 703: ceph_abort_msg("abort() called") 2023-10-06T02:21:19.145 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:21:19.145 INFO:tasks.ceph.mds.c.smithi006.stderr: ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable) 2023-10-06T02:21:19.145 INFO:tasks.ceph.mds.c.smithi006.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7f0b00ef1afd] 2023-10-06T02:21:19.145 INFO:tasks.ceph.mds.c.smithi006.stderr: 2: (CDentry::check_corruption(bool)+0x9a2) [0x559c100723d2] 2023-10-06T02:21:19.145 INFO:tasks.ceph.mds.c.smithi006.stderr: 3: ceph-mds(+0x448252) [0x559c1008a252] 2023-10-06T02:21:19.145 INFO:tasks.ceph.mds.c.smithi006.stderr: 4: (CDir::_omap_commit(int)+0x2da) [0x559c1008a9ba] 2023-10-06T02:21:19.145 INFO:tasks.ceph.mds.c.smithi006.stderr: 5: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x21e) [0x559c1008bd8e] 2023-10-06T02:21:19.145 INFO:tasks.ceph.mds.c.smithi006.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xc8f) [0x559c101ea9ef] 2023-10-06T02:21:19.145 INFO:tasks.ceph.mds.c.smithi006.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x6a) [0x559c10169a4a] 2023-10-06T02:21:19.145 INFO:tasks.ceph.mds.c.smithi006.stderr: 8: (MDLog::trim_all()+0x764) [0x559c1016b364] 2023-10-06T02:21:19.146 INFO:tasks.ceph.mds.c.smithi006.stderr: 9: (C_Flush_Journal::trim_mdlog()+0x154) [0x559c0fe36884] 2023-10-06T02:21:19.146 INFO:tasks.ceph.mds.c.smithi006.stderr: 10: (Context::complete(int)+0xd) [0x559c0fdef95d] 2023-10-06T02:21:19.146 INFO:tasks.ceph.mds.c.smithi006.stderr: 11: (MDSContext::complete(int)+0x5f) [0x559c101508af] 2023-10-06T02:21:19.146 INFO:tasks.ceph.mds.c.smithi006.stderr: 12: (C_IO_Wrapper::finish(int)+0x12) [0x559c10151792] 2023-10-06T02:21:19.146 INFO:tasks.ceph.mds.c.smithi006.stderr: 13: (MDSContext::complete(int)+0x5f) [0x559c101508af] 2023-10-06T02:21:19.146 INFO:tasks.ceph.mds.c.smithi006.stderr: 14: (MDSIOContextBase::complete(int)+0x534) [0x559c10151044] 2023-10-06T02:21:19.146 INFO:tasks.ceph.mds.c.smithi006.stderr: 15: (Finisher::finisher_thread_entry()+0x18d) [0x7f0b00f9084d] 2023-10-06T02:21:19.146 INFO:tasks.ceph.mds.c.smithi006.stderr: 16: /lib64/libpthread.so.0(+0x814a) [0x7f0affee414a] 2023-10-06T02:21:19.146 INFO:tasks.ceph.mds.c.smithi006.stderr: 17: clone() 2023-10-06T02:21:19.146 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:21:19.146 INFO:tasks.ceph.mds.c.smithi006.stderr: 0> 2023-10-06T02:21:19.129+0000 7f0af26df700 -1 *** Caught signal (Aborted) ** 2023-10-06T02:21:19.146 INFO:tasks.ceph.mds.c.smithi006.stderr: in thread 7f0af26df700 thread_name:MR_Finisher 2023-10-06T02:21:19.146 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:21:19.147 INFO:tasks.ceph.mds.c.smithi006.stderr: ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable) 2023-10-06T02:21:19.147 INFO:tasks.ceph.mds.c.smithi006.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f0affeeeb20] 2023-10-06T02:21:19.147 INFO:tasks.ceph.mds.c.smithi006.stderr: 2: gsignal() 2023-10-06T02:21:19.147 INFO:tasks.ceph.mds.c.smithi006.stderr: 3: abort() 2023-10-06T02:21:19.147 INFO:tasks.ceph.mds.c.smithi006.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x7f0b00ef1bbd] 2023-10-06T02:21:19.147 INFO:tasks.ceph.mds.c.smithi006.stderr: 5: (CDentry::check_corruption(bool)+0x9a2) [0x559c100723d2] 2023-10-06T02:21:19.147 INFO:tasks.ceph.mds.c.smithi006.stderr: 6: ceph-mds(+0x448252) [0x559c1008a252] 2023-10-06T02:21:19.147 INFO:tasks.ceph.mds.c.smithi006.stderr: 7: (CDir::_omap_commit(int)+0x2da) [0x559c1008a9ba] 2023-10-06T02:21:19.147 INFO:tasks.ceph.mds.c.smithi006.stderr: 8: (CDir::commit(unsigned long, MDSContext*, bool, int)+0x21e) [0x559c1008bd8e] 2023-10-06T02:21:19.147 INFO:tasks.ceph.mds.c.smithi006.stderr: 9: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0xc8f) [0x559c101ea9ef] 2023-10-06T02:21:19.147 INFO:tasks.ceph.mds.c.smithi006.stderr: 10: (MDLog::try_expire(LogSegment*, int)+0x6a) [0x559c10169a4a] 2023-10-06T02:21:19.147 INFO:tasks.ceph.mds.c.smithi006.stderr: 11: (MDLog::trim_all()+0x764) [0x559c1016b364] 2023-10-06T02:21:19.148 INFO:tasks.ceph.mds.c.smithi006.stderr: 12: (C_Flush_Journal::trim_mdlog()+0x154) [0x559c0fe36884] 2023-10-06T02:21:19.148 INFO:tasks.ceph.mds.c.smithi006.stderr: 13: (Context::complete(int)+0xd) [0x559c0fdef95d] 2023-10-06T02:21:19.148 INFO:tasks.ceph.mds.c.smithi006.stderr: 14: (MDSContext::complete(int)+0x5f) [0x559c101508af] 2023-10-06T02:21:19.148 INFO:tasks.ceph.mds.c.smithi006.stderr: 15: (C_IO_Wrapper::finish(int)+0x12) [0x559c10151792] 2023-10-06T02:21:19.148 INFO:tasks.ceph.mds.c.smithi006.stderr: 16: (MDSContext::complete(int)+0x5f) [0x559c101508af] 2023-10-06T02:21:19.148 INFO:tasks.ceph.mds.c.smithi006.stderr: 17: (MDSIOContextBase::complete(int)+0x534) [0x559c10151044] 2023-10-06T02:21:19.148 INFO:tasks.ceph.mds.c.smithi006.stderr: 18: (Finisher::finisher_thread_entry()+0x18d) [0x7f0b00f9084d] 2023-10-06T02:21:19.148 INFO:tasks.ceph.mds.c.smithi006.stderr: 19: /lib64/libpthread.so.0(+0x814a) [0x7f0affee414a] 2023-10-06T02:21:19.148 INFO:tasks.ceph.mds.c.smithi006.stderr: 20: clone() 2023-10-06T02:21:19.148 INFO:tasks.ceph.mds.c.smithi006.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-06T02:21:19.148 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:21:19.149 INFO:teuthology.orchestra.run.smithi006.stdout:{"mds_beacon_grace":"15.000000"} 2023-10-06T02:21:19.149 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-10-06T02:21:19.150 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:21:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.155+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2023-10-06T02:21:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.155+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:21:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.155+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:21:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.155+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2023-10-06T02:21:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.155+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.155+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=START_CONNECT pgs=15 cs=2 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T02:21:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.155+0000 7fc371ffb700 1 client.6531 ms_handle_refused on v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.267+0000 7fcc9359e700 1 Processor -- start 2023-10-06T02:21:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.267+0000 7fcc9359e700 1 -- start start 2023-10-06T02:21:19.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.268+0000 7fcc9359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc941419b0 0x7fcc94164260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.268+0000 7fcc9359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc940b0350 con 0x7fcc940b0ed0 2023-10-06T02:21:19.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.268+0000 7fcc9359e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc940b0590 con 0x7fcc940688d0 2023-10-06T02:21:19.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.268+0000 7fcc9359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940b0870 con 0x7fcc941419b0 2023-10-06T02:21:19.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.268+0000 7fcc91d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcc940b0ed0 0x7fcc9413f3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47508/0 (socket says 172.21.15.6:47508) 2023-10-06T02:21:19.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.268+0000 7fcc91d9b700 1 -- 172.21.15.6:0/2310040880 learned_addr learned my addr 172.21.15.6:0/2310040880 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:21:19.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.269+0000 7fcc92d9d700 1 --2- 172.21.15.6:0/2310040880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc941419b0 0x7fcc94164260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.269+0000 7fcc9159a700 1 -- 172.21.15.6:0/2310040880 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274951481 0 0) 0x7fcc7c001110 con 0x7fcc940b0ed0 2023-10-06T02:21:19.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.269+0000 7fcc9159a700 1 -- 172.21.15.6:0/2310040880 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc80003570 con 0x7fcc940b0ed0 2023-10-06T02:21:19.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.269+0000 7fcc9159a700 1 -- 172.21.15.6:0/2310040880 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664392349 0 0) 0x7fcc940b0590 con 0x7fcc940688d0 2023-10-06T02:21:19.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.269+0000 7fcc9159a700 1 -- 172.21.15.6:0/2310040880 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc7c001110 con 0x7fcc940688d0 2023-10-06T02:21:19.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.269+0000 7fcc92d9d700 1 -- 172.21.15.6:0/2310040880 >> v1:172.21.15.175:6789/0 conn(0x7fcc940688d0 legacy=0x7fcc940afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:19.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.269+0000 7fcc92d9d700 1 -- 172.21.15.6:0/2310040880 >> v1:172.21.15.6:6789/0 conn(0x7fcc940b0ed0 legacy=0x7fcc9413f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:19.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.269+0000 7fcc92d9d700 1 -- 172.21.15.6:0/2310040880 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc940b0b50 con 0x7fcc941419b0 2023-10-06T02:21:19.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.269+0000 7fcc92d9d700 1 --2- 172.21.15.6:0/2310040880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc941419b0 0x7fcc94164260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009e90 tx=0x7fcc84009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=252b98900de562 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:19.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.269+0000 7fcc9159a700 1 -- 172.21.15.6:0/2310040880 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8400e070 con 0x7fcc941419b0 2023-10-06T02:21:19.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.270+0000 7fcc9159a700 1 -- 172.21.15.6:0/2310040880 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8400bb80 con 0x7fcc941419b0 2023-10-06T02:21:19.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.270+0000 7fcc9159a700 1 -- 172.21.15.6:0/2310040880 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84012430 con 0x7fcc941419b0 2023-10-06T02:21:19.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.270+0000 7fcc9359e700 1 -- 172.21.15.6:0/2310040880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc941419b0 msgr2=0x7fcc94164260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:19.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.270+0000 7fcc9359e700 1 --2- 172.21.15.6:0/2310040880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc941419b0 0x7fcc94164260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009e90 tx=0x7fcc84009780 comp rx=0 tx=0).stop 2023-10-06T02:21:19.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.270+0000 7fcc9359e700 1 -- 172.21.15.6:0/2310040880 shutdown_connections 2023-10-06T02:21:19.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.270+0000 7fcc9359e700 1 --2- 172.21.15.6:0/2310040880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc941419b0 0x7fcc94164260 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.270+0000 7fcc9359e700 1 -- 172.21.15.6:0/2310040880 >> 172.21.15.6:0/2310040880 conn(0x7fcc9406b320 msgr2=0x7fcc9406b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:19.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.270+0000 7fcc9359e700 1 -- 172.21.15.6:0/2310040880 shutdown_connections 2023-10-06T02:21:19.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.270+0000 7fcc9359e700 1 -- 172.21.15.6:0/2310040880 wait complete. 2023-10-06T02:21:19.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.271+0000 7fcc9359e700 1 Processor -- start 2023-10-06T02:21:19.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.271+0000 7fcc9359e700 1 -- start start 2023-10-06T02:21:19.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.272+0000 7fcc9359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc940688d0 0x7fcc940ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.272+0000 7fcc9359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc940b0ed0 0x7fcc9416ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.272+0000 7fcc9359e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc941419b0 0x7fcc941676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.272+0000 7fcc9359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9416b1b0 con 0x7fcc940b0ed0 2023-10-06T02:21:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.272+0000 7fcc9359e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9416b480 con 0x7fcc941419b0 2023-10-06T02:21:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.272+0000 7fcc9359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9416b760 con 0x7fcc940688d0 2023-10-06T02:21:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.272+0000 7fcc91d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc940b0ed0 0x7fcc9416ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.272+0000 7fcc91d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc940b0ed0 0x7fcc9416ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52956/0 (socket says 172.21.15.6:52956) 2023-10-06T02:21:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.272+0000 7fcc91d9b700 1 -- 172.21.15.6:0/4090714649 learned_addr learned my addr 172.21.15.6:0/4090714649 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.272+0000 7fcc92d9d700 1 --2- 172.21.15.6:0/4090714649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc941419b0 0x7fcc941676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.272+0000 7fcc9259c700 1 --2- 172.21.15.6:0/4090714649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc940688d0 0x7fcc940ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.272+0000 7fcc91d9b700 1 -- 172.21.15.6:0/4090714649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc940688d0 msgr2=0x7fcc940ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.273+0000 7fcc91d9b700 1 --2- 172.21.15.6:0/4090714649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc940688d0 0x7fcc940ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.273+0000 7fcc91d9b700 1 -- 172.21.15.6:0/4090714649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc941419b0 msgr2=0x7fcc941676e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:19.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.273+0000 7fcc91d9b700 1 --2- 172.21.15.6:0/4090714649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc941419b0 0x7fcc941676e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.273+0000 7fcc91d9b700 1 -- 172.21.15.6:0/4090714649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc84009a20 con 0x7fcc940b0ed0 2023-10-06T02:21:19.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.273+0000 7fcc91d9b700 1 --2- 172.21.15.6:0/4090714649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc940b0ed0 0x7fcc9416ac70 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00c830 tx=0x7fcc7c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:19.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.273+0000 7fcc8a7fc700 1 -- 172.21.15.6:0/4090714649 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c005b30 con 0x7fcc940b0ed0 2023-10-06T02:21:19.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.273+0000 7fcc8a7fc700 1 -- 172.21.15.6:0/4090714649 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c005c90 con 0x7fcc940b0ed0 2023-10-06T02:21:19.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.273+0000 7fcc9359e700 1 -- 172.21.15.6:0/4090714649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc9416ba40 con 0x7fcc940b0ed0 2023-10-06T02:21:19.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.273+0000 7fcc8a7fc700 1 -- 172.21.15.6:0/4090714649 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c007300 con 0x7fcc940b0ed0 2023-10-06T02:21:19.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.273+0000 7fcc9359e700 1 -- 172.21.15.6:0/4090714649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9416c000 con 0x7fcc940b0ed0 2023-10-06T02:21:19.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.274+0000 7fcc9359e700 1 -- 172.21.15.6:0/4090714649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9416c1f0 con 0x7fcc940b0ed0 2023-10-06T02:21:19.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.274+0000 7fcc8a7fc700 1 -- 172.21.15.6:0/4090714649 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc7c01b400 con 0x7fcc940b0ed0 2023-10-06T02:21:19.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.275+0000 7fcc8a7fc700 1 --2- 172.21.15.6:0/4090714649 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcc74066f30 0x7fcc740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:19.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.275+0000 7fcc8a7fc700 1 -- 172.21.15.6:0/4090714649 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fcc7c084390 con 0x7fcc940b0ed0 2023-10-06T02:21:19.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.275+0000 7fcc9259c700 1 --2- 172.21.15.6:0/4090714649 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcc74066f30 0x7fcc740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:19.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.276+0000 7fcc9259c700 1 --2- 172.21.15.6:0/4090714649 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcc74066f30 0x7fcc740693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c0027d0 tx=0x7fcc8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:19.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.279+0000 7fcc8a7fc700 1 -- 172.21.15.6:0/4090714649 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc7c051390 con 0x7fcc940b0ed0 2023-10-06T02:21:19.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.356+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:19.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.356+0000 7fc371ffb700 1 client.6531 ms_handle_refused on v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:19.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.356+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=START_CONNECT pgs=15 cs=3 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T02:21:19.385 INFO:tasks.ceph.mds.c.smithi006.stderr:daemon-helper: command crashed with signal 6 2023-10-06T02:21:19.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:21:19.490 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:21:19.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.519+0000 7fcc9359e700 1 -- 172.21.15.6:0/4090714649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc940b0350 con 0x7fcc940b0ed0 2023-10-06T02:21:19.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.519+0000 7fcc8a7fc700 1 -- 172.21.15.6:0/4090714649 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fcc940b0350 con 0x7fcc940b0ed0 2023-10-06T02:21:19.521 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:21:19.521 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":57,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/400475961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":400475961},{"type":"v1","addr":"172.21.15.175:6837","nonce":400475961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1006897436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1006897436},{"type":"v1","addr":"172.21.15.6:6835","nonce":1006897436}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:51.206714+0000","modified":"2023-10-06T02:21:18.937064+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":67,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6210},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6210":{"gid":6210,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":10,"addr":"172.21.15.6:6834/3777949337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3777949337},{"type":"v1","addr":"172.21.15.6:6834","nonce":3777949337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:21:19.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.521+0000 7fcc9359e700 1 -- 172.21.15.6:0/4090714649 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcc74066f30 msgr2=0x7fcc740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:19.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.521+0000 7fcc9359e700 1 --2- 172.21.15.6:0/4090714649 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcc74066f30 0x7fcc740693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c0027d0 tx=0x7fcc8c009040 comp rx=0 tx=0).stop 2023-10-06T02:21:19.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.521+0000 7fcc9359e700 1 -- 172.21.15.6:0/4090714649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc940b0ed0 msgr2=0x7fcc9416ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:19.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.521+0000 7fcc9359e700 1 --2- 172.21.15.6:0/4090714649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc940b0ed0 0x7fcc9416ac70 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00c830 tx=0x7fcc7c007ea0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.521+0000 7fcc9359e700 1 -- 172.21.15.6:0/4090714649 shutdown_connections 2023-10-06T02:21:19.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.521+0000 7fcc9359e700 1 --2- 172.21.15.6:0/4090714649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc941419b0 0x7fcc941676e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.521+0000 7fcc9359e700 1 --2- 172.21.15.6:0/4090714649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc940688d0 0x7fcc940ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.521+0000 7fcc9359e700 1 --2- 172.21.15.6:0/4090714649 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcc74066f30 0x7fcc740693e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.521+0000 7fcc9359e700 1 --2- 172.21.15.6:0/4090714649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc940b0ed0 0x7fcc9416ac70 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:19.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.521+0000 7fcc9359e700 1 -- 172.21.15.6:0/4090714649 >> 172.21.15.6:0/4090714649 conn(0x7fcc9406b320 msgr2=0x7fcc9413db30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:19.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.521+0000 7fcc9359e700 1 -- 172.21.15.6:0/4090714649 shutdown_connections 2023-10-06T02:21:19.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.521+0000 7fcc9359e700 1 -- 172.21.15.6:0/4090714649 wait complete. 2023-10-06T02:21:19.524 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 57 2023-10-06T02:21:19.534 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-10-06T02:21:19.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.757+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:19.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.757+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=START_CONNECT pgs=15 cs=4 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T02:21:19.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:19.757+0000 7fc371ffb700 1 client.6531 ms_handle_refused on v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:20.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:20.558+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:20.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:20.558+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=START_CONNECT pgs=15 cs=5 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T02:21:20.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:20.558+0000 7fc371ffb700 1 client.6531 ms_handle_refused on v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:21.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-06T02:21:22.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:22.160+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:22.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:22.160+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=START_CONNECT pgs=15 cs=6 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-06T02:21:22.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:22.160+0000 7fc371ffb700 1 client.6531 ms_handle_refused on v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:24.536 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:21:24.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.668+0000 7f8c815f8700 1 Processor -- start 2023-10-06T02:21:24.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.669+0000 7f8c815f8700 1 -- start start 2023-10-06T02:21:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.669+0000 7f8c815f8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c7c0af8b0 0x7f8c7c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.669+0000 7f8c815f8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c7c0b27f0 0x7f8c7c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.669+0000 7f8c815f8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7c15e190 con 0x7f8c7c0af4e0 2023-10-06T02:21:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.669+0000 7f8c815f8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7c0b1910 con 0x7f8c7c0b27f0 2023-10-06T02:21:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.669+0000 7f8c815f8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c0cb650 con 0x7f8c7c0af8b0 2023-10-06T02:21:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.669+0000 7f8c7b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c7c0b27f0 0x7f8c7c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.670+0000 7f8c7b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c7c0b27f0 0x7f8c7c15d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52958/0 (socket says 172.21.15.6:52958) 2023-10-06T02:21:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.670+0000 7f8c7b7fe700 1 -- 172.21.15.6:0/2917793436 learned_addr learned my addr 172.21.15.6:0/2917793436 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.670+0000 7f8c7affd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8c7c0af4e0 0x7f8c7c0b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47512/0 (socket says 172.21.15.6:47512) 2023-10-06T02:21:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.670+0000 7f8c7a7fc700 1 --2- 172.21.15.6:0/2917793436 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c7c0af8b0 0x7f8c7c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.670+0000 7f8c7b7fe700 1 -- 172.21.15.6:0/2917793436 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c7c0af8b0 msgr2=0x7f8c7c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.670+0000 7f8c7b7fe700 1 --2- 172.21.15.6:0/2917793436 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c7c0af8b0 0x7f8c7c15d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.670+0000 7f8c7b7fe700 1 -- 172.21.15.6:0/2917793436 >> v1:172.21.15.6:6789/0 conn(0x7f8c7c0af4e0 legacy=0x7f8c7c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.670+0000 7f8c7b7fe700 1 -- 172.21.15.6:0/2917793436 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c0ccaf0 con 0x7f8c7c0b27f0 2023-10-06T02:21:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.670+0000 7f8c79ffb700 1 -- 172.21.15.6:0/2917793436 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54149732 0 0) 0x7f8c7c15e190 con 0x7f8c7c0af4e0 2023-10-06T02:21:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.670+0000 7f8c7b7fe700 1 --2- 172.21.15.6:0/2917793436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c7c0b27f0 0x7f8c7c15d9a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c009f20 tx=0x7f8c6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9420da6da3bde4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.670+0000 7f8c79ffb700 1 -- 172.21.15.6:0/2917793436 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00e070 con 0x7f8c7c0b27f0 2023-10-06T02:21:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.670+0000 7f8c79ffb700 1 -- 172.21.15.6:0/2917793436 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c00ba80 con 0x7f8c7c0b27f0 2023-10-06T02:21:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.670+0000 7f8c79ffb700 1 -- 172.21.15.6:0/2917793436 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c0092e0 con 0x7f8c7c0b27f0 2023-10-06T02:21:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.671+0000 7f8c815f8700 1 -- 172.21.15.6:0/2917793436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c7c0b27f0 msgr2=0x7f8c7c15d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.671+0000 7f8c815f8700 1 --2- 172.21.15.6:0/2917793436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c7c0b27f0 0x7f8c7c15d9a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c009f20 tx=0x7f8c6c009840 comp rx=0 tx=0).stop 2023-10-06T02:21:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.671+0000 7f8c815f8700 1 -- 172.21.15.6:0/2917793436 shutdown_connections 2023-10-06T02:21:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.671+0000 7f8c815f8700 1 --2- 172.21.15.6:0/2917793436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c7c0b27f0 0x7f8c7c15d9a0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.671+0000 7f8c815f8700 1 --2- 172.21.15.6:0/2917793436 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c7c0af8b0 0x7f8c7c15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.671+0000 7f8c815f8700 1 -- 172.21.15.6:0/2917793436 >> 172.21.15.6:0/2917793436 conn(0x7f8c7c068680 msgr2=0x7f8c7c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:24.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.671+0000 7f8c815f8700 1 -- 172.21.15.6:0/2917793436 shutdown_connections 2023-10-06T02:21:24.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.671+0000 7f8c815f8700 1 -- 172.21.15.6:0/2917793436 wait complete. 2023-10-06T02:21:24.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.672+0000 7f8c815f8700 1 Processor -- start 2023-10-06T02:21:24.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.672+0000 7f8c815f8700 1 -- start start 2023-10-06T02:21:24.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.673+0000 7f8c815f8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c7c0af4e0 0x7f8c7c0ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:24.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.673+0000 7f8c815f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c7c0af8b0 0x7f8c7c0c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:24.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.673+0000 7f8c815f8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c7c0b27f0 0x7f8c7c153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.673+0000 7f8c815f8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c155440 con 0x7f8c7c0af8b0 2023-10-06T02:21:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.673+0000 7f8c815f8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c0ca540 con 0x7f8c7c0af4e0 2023-10-06T02:21:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.673+0000 7f8c815f8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c154830 con 0x7f8c7c0b27f0 2023-10-06T02:21:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.673+0000 7f8c7a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c7c0af8b0 0x7f8c7c0c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.673+0000 7f8c7a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c7c0af8b0 0x7f8c7c0c77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52962/0 (socket says 172.21.15.6:52962) 2023-10-06T02:21:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.673+0000 7f8c7a7fc700 1 -- 172.21.15.6:0/515544686 learned_addr learned my addr 172.21.15.6:0/515544686 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.673+0000 7f8c7b7fe700 1 --2- 172.21.15.6:0/515544686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c7c0b27f0 0x7f8c7c153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.673+0000 7f8c7affd700 1 --2- 172.21.15.6:0/515544686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c7c0af4e0 0x7f8c7c0ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.673+0000 7f8c7a7fc700 1 -- 172.21.15.6:0/515544686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c7c0b27f0 msgr2=0x7f8c7c153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.673+0000 7f8c7a7fc700 1 --2- 172.21.15.6:0/515544686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c7c0b27f0 0x7f8c7c153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.673+0000 7f8c7a7fc700 1 -- 172.21.15.6:0/515544686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c7c0af4e0 msgr2=0x7f8c7c0ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.673+0000 7f8c7a7fc700 1 --2- 172.21.15.6:0/515544686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c7c0af4e0 0x7f8c7c0ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.673+0000 7f8c7a7fc700 1 -- 172.21.15.6:0/515544686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c009ae0 con 0x7f8c7c0af8b0 2023-10-06T02:21:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.674+0000 7f8c7a7fc700 1 --2- 172.21.15.6:0/515544686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c7c0af8b0 0x7f8c7c0c77a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400c7d0 tx=0x7f8c64008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.674+0000 7f8c72ffd700 1 -- 172.21.15.6:0/515544686 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c64011600 con 0x7f8c7c0af8b0 2023-10-06T02:21:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.674+0000 7f8c72ffd700 1 -- 172.21.15.6:0/515544686 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c64011760 con 0x7f8c7c0af8b0 2023-10-06T02:21:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.674+0000 7f8c815f8700 1 -- 172.21.15.6:0/515544686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7c154b10 con 0x7f8c7c0af8b0 2023-10-06T02:21:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.674+0000 7f8c72ffd700 1 -- 172.21.15.6:0/515544686 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c64011b20 con 0x7f8c7c0af8b0 2023-10-06T02:21:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.674+0000 7f8c815f8700 1 -- 172.21.15.6:0/515544686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7c1550d0 con 0x7f8c7c0af8b0 2023-10-06T02:21:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.675+0000 7f8c815f8700 1 -- 172.21.15.6:0/515544686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7c0c8130 con 0x7f8c7c0af8b0 2023-10-06T02:21:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.675+0000 7f8c72ffd700 1 -- 172.21.15.6:0/515544686 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c640193f0 con 0x7f8c7c0af8b0 2023-10-06T02:21:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.676+0000 7f8c72ffd700 1 --2- 172.21.15.6:0/515544686 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c5c066f30 0x7f8c5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:24.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.676+0000 7f8c72ffd700 1 -- 172.21.15.6:0/515544686 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f8c64084d20 con 0x7f8c7c0af8b0 2023-10-06T02:21:24.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.676+0000 7f8c7affd700 1 --2- 172.21.15.6:0/515544686 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c5c066f30 0x7f8c5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:24.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.676+0000 7f8c7affd700 1 --2- 172.21.15.6:0/515544686 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c5c066f30 0x7f8c5c0693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8c740011e0 tx=0x7f8c74007bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:24.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.680+0000 7f8c72ffd700 1 -- 172.21.15.6:0/515544686 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c7c0c8130 con 0x7f8c7c0af8b0 2023-10-06T02:21:24.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.920+0000 7f8c815f8700 1 -- 172.21.15.6:0/515544686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c7c0c8130 con 0x7f8c7c0af8b0 2023-10-06T02:21:24.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.921+0000 7f8c72ffd700 1 -- 172.21.15.6:0/515544686 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f8c7c0c8130 con 0x7f8c7c0af8b0 2023-10-06T02:21:24.922 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:21:24.923 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":57,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/400475961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":400475961},{"type":"v1","addr":"172.21.15.175:6837","nonce":400475961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1006897436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1006897436},{"type":"v1","addr":"172.21.15.6:6835","nonce":1006897436}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:51.206714+0000","modified":"2023-10-06T02:21:18.937064+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":67,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6210},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6210":{"gid":6210,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":10,"addr":"172.21.15.6:6834/3777949337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3777949337},{"type":"v1","addr":"172.21.15.6:6834","nonce":3777949337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:21:24.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.923+0000 7f8c815f8700 1 -- 172.21.15.6:0/515544686 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c5c066f30 msgr2=0x7f8c5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:24.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.923+0000 7f8c815f8700 1 --2- 172.21.15.6:0/515544686 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c5c066f30 0x7f8c5c0693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8c740011e0 tx=0x7f8c74007bf0 comp rx=0 tx=0).stop 2023-10-06T02:21:24.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.923+0000 7f8c815f8700 1 -- 172.21.15.6:0/515544686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c7c0af8b0 msgr2=0x7f8c7c0c77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:24.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.923+0000 7f8c815f8700 1 --2- 172.21.15.6:0/515544686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c7c0af8b0 0x7f8c7c0c77a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400c7d0 tx=0x7f8c64008040 comp rx=0 tx=0).stop 2023-10-06T02:21:24.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.923+0000 7f8c815f8700 1 -- 172.21.15.6:0/515544686 shutdown_connections 2023-10-06T02:21:24.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.923+0000 7f8c815f8700 1 --2- 172.21.15.6:0/515544686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c7c0b27f0 0x7f8c7c153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:24.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.923+0000 7f8c815f8700 1 --2- 172.21.15.6:0/515544686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c7c0af4e0 0x7f8c7c0ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:24.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.923+0000 7f8c815f8700 1 --2- 172.21.15.6:0/515544686 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c5c066f30 0x7f8c5c0693e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:24.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.923+0000 7f8c815f8700 1 --2- 172.21.15.6:0/515544686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c7c0af8b0 0x7f8c7c0c77a0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:24.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.923+0000 7f8c815f8700 1 -- 172.21.15.6:0/515544686 >> 172.21.15.6:0/515544686 conn(0x7f8c7c068680 msgr2=0x7f8c7c0afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:24.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.923+0000 7f8c815f8700 1 -- 172.21.15.6:0/515544686 shutdown_connections 2023-10-06T02:21:24.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:24.923+0000 7f8c815f8700 1 -- 172.21.15.6:0/515544686 wait complete. 2023-10-06T02:21:24.927 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 57 2023-10-06T02:21:24.937 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-10-06T02:21:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:25.363+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:25.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:25.363+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=START_CONNECT pgs=15 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-10-06T02:21:25.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:25.363+0000 7fc371ffb700 1 client.6531 ms_handle_refused on v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:27.858 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-10-06T02:21:29.937 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:21:30.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.069+0000 7f2945ab4700 1 Processor -- start 2023-10-06T02:21:30.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.070+0000 7f2945ab4700 1 -- start start 2023-10-06T02:21:30.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.070+0000 7f2945ab4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29400d0950 0x7f29401645c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:30.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.070+0000 7f2945ab4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29400cf8a0 con 0x7f29401431b0 2023-10-06T02:21:30.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.070+0000 7f2945ab4700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29400b4100 con 0x7f2940142de0 2023-10-06T02:21:30.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.070+0000 7f2945ab4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29400cec90 con 0x7f29400d0950 2023-10-06T02:21:30.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f29401431b0 0x7f29400d0240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55272/0 (socket says 172.21.15.6:55272) 2023-10-06T02:21:30.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293effd700 1 -- 172.21.15.6:0/3330493307 learned_addr learned my addr 172.21.15.6:0/3330493307 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:21:30.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293ffff700 1 --2- 172.21.15.6:0/3330493307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29400d0950 0x7f29401645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:30.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293e7fc700 1 -- 172.21.15.6:0/3330493307 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366050298 0 0) 0x7f29400cf8a0 con 0x7f29401431b0 2023-10-06T02:21:30.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293e7fc700 1 -- 172.21.15.6:0/3330493307 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2928003570 con 0x7f29401431b0 2023-10-06T02:21:30.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293e7fc700 1 -- 172.21.15.6:0/3330493307 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3386463995 0 0) 0x7f2928003570 con 0x7f29401431b0 2023-10-06T02:21:30.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293e7fc700 1 -- 172.21.15.6:0/3330493307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29400d0950 msgr2=0x7f29401645c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:30.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293e7fc700 1 --2- 172.21.15.6:0/3330493307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29400d0950 0x7f29401645c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:30.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293e7fc700 1 -- 172.21.15.6:0/3330493307 >> v1:172.21.15.175:6789/0 conn(0x7f2940142de0 legacy=0x7f29400ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:30.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293e7fc700 1 -- 172.21.15.6:0/3330493307 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29400cef70 con 0x7f29401431b0 2023-10-06T02:21:30.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293e7fc700 1 -- 172.21.15.6:0/3330493307 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f2934001470 con 0x7f29401431b0 2023-10-06T02:21:30.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293e7fc700 1 -- 172.21.15.6:0/3330493307 >> v1:172.21.15.6:6789/0 conn(0x7f29401431b0 legacy=0x7f29400d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:30.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293e7fc700 1 --2- 172.21.15.6:0/3330493307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2928003a90 0x7f2928003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:30.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293e7fc700 1 --2- 172.21.15.6:0/3330493307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29400d0950 0x7f2928004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:30.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293e7fc700 1 --2- 172.21.15.6:0/3330493307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2928004d50 0x7f29280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:30.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293e7fc700 1 -- 172.21.15.6:0/3330493307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29400cec90 con 0x7f2928004d50 2023-10-06T02:21:30.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293e7fc700 1 -- 172.21.15.6:0/3330493307 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292800bb70 con 0x7f2928003a90 2023-10-06T02:21:30.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293e7fc700 1 -- 172.21.15.6:0/3330493307 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292800bd30 con 0x7f29400d0950 2023-10-06T02:21:30.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293ffff700 1 --2- 172.21.15.6:0/3330493307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2928004d50 0x7f29280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:30.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293f7fe700 1 --2- 172.21.15.6:0/3330493307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2928003a90 0x7f2928003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:30.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.071+0000 7f293effd700 1 --2- 172.21.15.6:0/3330493307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29400d0950 0x7f2928004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:30.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.072+0000 7f293ffff700 1 -- 172.21.15.6:0/3330493307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29400d0950 msgr2=0x7f2928004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:30.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.072+0000 7f293ffff700 1 --2- 172.21.15.6:0/3330493307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29400d0950 0x7f2928004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:30.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.072+0000 7f293ffff700 1 -- 172.21.15.6:0/3330493307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2928003a90 msgr2=0x7f2928003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:30.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.072+0000 7f293ffff700 1 --2- 172.21.15.6:0/3330493307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2928003a90 0x7f2928003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:30.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.072+0000 7f293ffff700 1 -- 172.21.15.6:0/3330493307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2928003570 con 0x7f2928004d50 2023-10-06T02:21:30.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.072+0000 7f293ffff700 1 --2- 172.21.15.6:0/3330493307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2928004d50 0x7f29280051c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f29400d0d50 tx=0x7f293800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837fbea3e17d1830 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:30.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.072+0000 7f293e7fc700 1 -- 172.21.15.6:0/3330493307 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293800ea90 con 0x7f2928004d50 2023-10-06T02:21:30.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.072+0000 7f293e7fc700 1 -- 172.21.15.6:0/3330493307 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293800f040 con 0x7f2928004d50 2023-10-06T02:21:30.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.072+0000 7f293e7fc700 1 -- 172.21.15.6:0/3330493307 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293800ee40 con 0x7f2928004d50 2023-10-06T02:21:30.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.072+0000 7f2945ab4700 1 -- 172.21.15.6:0/3330493307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2928004d50 msgr2=0x7f29280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:30.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.072+0000 7f2945ab4700 1 --2- 172.21.15.6:0/3330493307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2928004d50 0x7f29280051c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f29400d0d50 tx=0x7f293800b040 comp rx=0 tx=0).stop 2023-10-06T02:21:30.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.073+0000 7f293ffff700 1 -- 172.21.15.6:0/3330493307 reap_dead start 2023-10-06T02:21:30.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.073+0000 7f2945ab4700 1 -- 172.21.15.6:0/3330493307 shutdown_connections 2023-10-06T02:21:30.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.073+0000 7f2945ab4700 1 -- 172.21.15.6:0/3330493307 >> 172.21.15.6:0/3330493307 conn(0x7f2940069110 msgr2=0x7f294006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:30.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.073+0000 7f2945ab4700 1 -- 172.21.15.6:0/3330493307 shutdown_connections 2023-10-06T02:21:30.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.073+0000 7f2945ab4700 1 -- 172.21.15.6:0/3330493307 wait complete. 2023-10-06T02:21:30.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.074+0000 7f2945ab4700 1 Processor -- start 2023-10-06T02:21:30.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.074+0000 7f2945ab4700 1 -- start start 2023-10-06T02:21:30.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f2945ab4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2940152b60 0x7f294016b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:30.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f2945ab4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f294016d5c0 0x7f294016da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:30.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f2945ab4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29400b1c20 0x7f29400b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:30.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f2945ab4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294016df70 con 0x7f294016d5c0 2023-10-06T02:21:30.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f2945ab4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29400b25e0 con 0x7f29400b1c20 2023-10-06T02:21:30.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f2945ab4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29400b0e60 con 0x7f2940152b60 2023-10-06T02:21:30.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f293effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f294016d5c0 0x7f294016da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:30.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f293effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f294016d5c0 0x7f294016da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53916/0 (socket says 172.21.15.6:53916) 2023-10-06T02:21:30.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f293effd700 1 -- 172.21.15.6:0/2140832343 learned_addr learned my addr 172.21.15.6:0/2140832343 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:30.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f293f7fe700 1 --2- 172.21.15.6:0/2140832343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2940152b60 0x7f294016b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:30.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f293ffff700 1 --2- 172.21.15.6:0/2140832343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29400b1c20 0x7f29400b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:30.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f293effd700 1 -- 172.21.15.6:0/2140832343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2940152b60 msgr2=0x7f294016b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:30.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f293effd700 1 --2- 172.21.15.6:0/2140832343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2940152b60 0x7f294016b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:30.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f293effd700 1 -- 172.21.15.6:0/2140832343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29400b1c20 msgr2=0x7f29400b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:30.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f293effd700 1 --2- 172.21.15.6:0/2140832343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29400b1c20 0x7f29400b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:30.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f293effd700 1 -- 172.21.15.6:0/2140832343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29400b1140 con 0x7f294016d5c0 2023-10-06T02:21:30.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f293effd700 1 --2- 172.21.15.6:0/2140832343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f294016d5c0 0x7f294016da30 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2934007390 tx=0x7f2940065040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:30.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f29277fe700 1 -- 172.21.15.6:0/2140832343 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934018030 con 0x7f294016d5c0 2023-10-06T02:21:30.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f29277fe700 1 -- 172.21.15.6:0/2140832343 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2934007880 con 0x7f294016d5c0 2023-10-06T02:21:30.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f2945ab4700 1 -- 172.21.15.6:0/2140832343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29400b1420 con 0x7f294016d5c0 2023-10-06T02:21:30.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.075+0000 7f29277fe700 1 -- 172.21.15.6:0/2140832343 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293400fac0 con 0x7f294016d5c0 2023-10-06T02:21:30.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.076+0000 7f2945ab4700 1 -- 172.21.15.6:0/2140832343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294016b6d0 con 0x7f294016d5c0 2023-10-06T02:21:30.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.076+0000 7f2945ab4700 1 -- 172.21.15.6:0/2140832343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29400b1940 con 0x7f294016d5c0 2023-10-06T02:21:30.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.077+0000 7f29277fe700 1 -- 172.21.15.6:0/2140832343 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f293401b070 con 0x7f294016d5c0 2023-10-06T02:21:30.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.077+0000 7f29277fe700 1 --2- 172.21.15.6:0/2140832343 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f292c066f30 0x7f292c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:30.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.077+0000 7f29277fe700 1 -- 172.21.15.6:0/2140832343 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f2934019070 con 0x7f294016d5c0 2023-10-06T02:21:30.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.078+0000 7f293f7fe700 1 --2- 172.21.15.6:0/2140832343 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f292c066f30 0x7f292c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:30.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.078+0000 7f293f7fe700 1 --2- 172.21.15.6:0/2140832343 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f292c066f30 0x7f292c0693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2930007e40 tx=0x7f2930007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:30.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.082+0000 7f29277fe700 1 -- 172.21.15.6:0/2140832343 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29400b1940 con 0x7f294016d5c0 2023-10-06T02:21:30.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.320+0000 7f2945ab4700 1 -- 172.21.15.6:0/2140832343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29400b1940 con 0x7f294016d5c0 2023-10-06T02:21:30.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.320+0000 7f29277fe700 1 -- 172.21.15.6:0/2140832343 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f29400b1940 con 0x7f294016d5c0 2023-10-06T02:21:30.322 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:21:30.322 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":57,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/400475961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":400475961},{"type":"v1","addr":"172.21.15.175:6837","nonce":400475961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1006897436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1006897436},{"type":"v1","addr":"172.21.15.6:6835","nonce":1006897436}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:51.206714+0000","modified":"2023-10-06T02:21:18.937064+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":67,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6210},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6210":{"gid":6210,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":10,"addr":"172.21.15.6:6834/3777949337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3777949337},{"type":"v1","addr":"172.21.15.6:6834","nonce":3777949337}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:21:30.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.322+0000 7f2945ab4700 1 -- 172.21.15.6:0/2140832343 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f292c066f30 msgr2=0x7f292c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:30.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.322+0000 7f2945ab4700 1 --2- 172.21.15.6:0/2140832343 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f292c066f30 0x7f292c0693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2930007e40 tx=0x7f2930007d30 comp rx=0 tx=0).stop 2023-10-06T02:21:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.322+0000 7f2945ab4700 1 -- 172.21.15.6:0/2140832343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f294016d5c0 msgr2=0x7f294016da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.322+0000 7f2945ab4700 1 --2- 172.21.15.6:0/2140832343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f294016d5c0 0x7f294016da30 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2934007390 tx=0x7f2940065040 comp rx=0 tx=0).stop 2023-10-06T02:21:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.322+0000 7f2945ab4700 1 -- 172.21.15.6:0/2140832343 shutdown_connections 2023-10-06T02:21:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.322+0000 7f2945ab4700 1 --2- 172.21.15.6:0/2140832343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29400b1c20 0x7f29400b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.322+0000 7f2945ab4700 1 --2- 172.21.15.6:0/2140832343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2940152b60 0x7f294016b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.322+0000 7f2945ab4700 1 --2- 172.21.15.6:0/2140832343 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f292c066f30 0x7f292c0693e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.322+0000 7f2945ab4700 1 --2- 172.21.15.6:0/2140832343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f294016d5c0 0x7f294016da30 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.322+0000 7f2945ab4700 1 -- 172.21.15.6:0/2140832343 >> 172.21.15.6:0/2140832343 conn(0x7f2940069110 msgr2=0x7f29400d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.322+0000 7f2945ab4700 1 -- 172.21.15.6:0/2140832343 shutdown_connections 2023-10-06T02:21:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:30.322+0000 7f2945ab4700 1 -- 172.21.15.6:0/2140832343 wait complete. 2023-10-06T02:21:30.325 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 57 2023-10-06T02:21:30.335 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-10-06T02:21:31.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:31.770+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:31.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:31.770+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=START_CONNECT pgs=15 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2023-10-06T02:21:31.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:31.770+0000 7fc371ffb700 1 client.6531 ms_handle_refused on v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:34.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-10-06T02:21:35.337 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:21:35.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.464+0000 7fa7d290c700 1 Processor -- start 2023-10-06T02:21:35.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.464+0000 7fa7d290c700 1 -- start start 2023-10-06T02:21:35.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.465+0000 7fa7d290c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa7cc0b27f0 0x7fa7cc159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:35.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.465+0000 7fa7d290c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7cc15d4d0 0x7fa7cc15d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:35.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.465+0000 7fa7d290c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7cc0cb6c0 con 0x7fa7cc159380 2023-10-06T02:21:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.465+0000 7fa7d290c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7cc15e200 con 0x7fa7cc0b27f0 2023-10-06T02:21:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.465+0000 7fa7d290c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc0ccb60 con 0x7fa7cc15d4d0 2023-10-06T02:21:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.465+0000 7fa7cb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa7cc0b27f0 0x7fa7cc159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.465+0000 7fa7cbfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa7cc159380 0x7fa7cc0b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55284/0 (socket says 172.21.15.6:55284) 2023-10-06T02:21:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.465+0000 7fa7cbfff700 1 -- 172.21.15.6:0/3821567790 learned_addr learned my addr 172.21.15.6:0/3821567790 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:21:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.466+0000 7fa7d0ea9700 1 --2- 172.21.15.6:0/3821567790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7cc15d4d0 0x7fa7cc15d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.466+0000 7fa7cb7fe700 1 -- 172.21.15.6:0/3821567790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7cc15d4d0 msgr2=0x7fa7cc15d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.466+0000 7fa7cb7fe700 1 --2- 172.21.15.6:0/3821567790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7cc15d4d0 0x7fa7cc15d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.466+0000 7fa7cb7fe700 1 -- 172.21.15.6:0/3821567790 >> v1:172.21.15.6:6789/0 conn(0x7fa7cc159380 legacy=0x7fa7cc0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.466+0000 7fa7cb7fe700 1 -- 172.21.15.6:0/3821567790 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc0c3ef0 con 0x7fa7cc0b27f0 2023-10-06T02:21:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.466+0000 7fa7d0ea9700 1 --2- 172.21.15.6:0/3821567790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7cc15d4d0 0x7fa7cc15d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.466+0000 7fa7cb7fe700 1 --2- 172.21.15.6:0/3821567790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc0b27f0 0x7fa7cc159750 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00098e0 tx=0x7fa7c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52ceb33bb5a0e01 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.466+0000 7fa7caffd700 1 -- 172.21.15.6:0/3821567790 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0009e80 con 0x7fa7cc0b27f0 2023-10-06T02:21:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.466+0000 7fa7caffd700 1 -- 172.21.15.6:0/3821567790 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c000b860 con 0x7fa7cc0b27f0 2023-10-06T02:21:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.466+0000 7fa7caffd700 1 -- 172.21.15.6:0/3821567790 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c000bbe0 con 0x7fa7cc0b27f0 2023-10-06T02:21:35.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.467+0000 7fa7d290c700 1 -- 172.21.15.6:0/3821567790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc0b27f0 msgr2=0x7fa7cc159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:35.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.467+0000 7fa7d290c700 1 --2- 172.21.15.6:0/3821567790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc0b27f0 0x7fa7cc159750 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00098e0 tx=0x7fa7c00091a0 comp rx=0 tx=0).stop 2023-10-06T02:21:35.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.467+0000 7fa7d290c700 1 -- 172.21.15.6:0/3821567790 shutdown_connections 2023-10-06T02:21:35.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.467+0000 7fa7d290c700 1 --2- 172.21.15.6:0/3821567790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7cc15d4d0 0x7fa7cc15d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:35.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.467+0000 7fa7d290c700 1 --2- 172.21.15.6:0/3821567790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc0b27f0 0x7fa7cc159750 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:35.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.467+0000 7fa7d290c700 1 -- 172.21.15.6:0/3821567790 >> 172.21.15.6:0/3821567790 conn(0x7fa7cc068680 msgr2=0x7fa7cc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:35.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.467+0000 7fa7d290c700 1 -- 172.21.15.6:0/3821567790 shutdown_connections 2023-10-06T02:21:35.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.467+0000 7fa7d290c700 1 -- 172.21.15.6:0/3821567790 wait complete. 2023-10-06T02:21:35.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.468+0000 7fa7d290c700 1 Processor -- start 2023-10-06T02:21:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.468+0000 7fa7d290c700 1 -- start start 2023-10-06T02:21:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7d290c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7cc0b27f0 0x7fa7cc0c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7d290c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7cc159380 0x7fa7cc0c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7d290c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc15d4d0 0x7fa7cc0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7d290c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc0ce6b0 con 0x7fa7cc15d4d0 2023-10-06T02:21:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7d290c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc0ce990 con 0x7fa7cc0b27f0 2023-10-06T02:21:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7d290c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc0cec70 con 0x7fa7cc159380 2023-10-06T02:21:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7d0ea9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc15d4d0 0x7fa7cc0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7d0ea9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc15d4d0 0x7fa7cc0b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53934/0 (socket says 172.21.15.6:53934) 2023-10-06T02:21:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7d0ea9700 1 -- 172.21.15.6:0/2118052639 learned_addr learned my addr 172.21.15.6:0/2118052639 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7cb7fe700 1 --2- 172.21.15.6:0/2118052639 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7cc159380 0x7fa7cc0c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7cbfff700 1 --2- 172.21.15.6:0/2118052639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7cc0b27f0 0x7fa7cc0c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7d0ea9700 1 -- 172.21.15.6:0/2118052639 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7cc159380 msgr2=0x7fa7cc0c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7d0ea9700 1 --2- 172.21.15.6:0/2118052639 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7cc159380 0x7fa7cc0c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7d0ea9700 1 -- 172.21.15.6:0/2118052639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7cc0b27f0 msgr2=0x7fa7cc0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7d0ea9700 1 --2- 172.21.15.6:0/2118052639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7cc0b27f0 0x7fa7cc0c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7d0ea9700 1 -- 172.21.15.6:0/2118052639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c0009420 con 0x7fa7cc15d4d0 2023-10-06T02:21:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7d0ea9700 1 --2- 172.21.15.6:0/2118052639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc15d4d0 0x7fa7cc0b3a00 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400d180 tx=0x7fa7c4009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.469+0000 7fa7b3fff700 1 -- 172.21.15.6:0/2118052639 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c400dcc0 con 0x7fa7cc15d4d0 2023-10-06T02:21:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.470+0000 7fa7b3fff700 1 -- 172.21.15.6:0/2118052639 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c400f040 con 0x7fa7cc15d4d0 2023-10-06T02:21:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.470+0000 7fa7b3fff700 1 -- 172.21.15.6:0/2118052639 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4015690 con 0x7fa7cc15d4d0 2023-10-06T02:21:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.470+0000 7fa7d290c700 1 -- 172.21.15.6:0/2118052639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7cc0cef50 con 0x7fa7cc15d4d0 2023-10-06T02:21:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.470+0000 7fa7d290c700 1 -- 172.21.15.6:0/2118052639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7cc0c7520 con 0x7fa7cc15d4d0 2023-10-06T02:21:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.470+0000 7fa7d290c700 1 -- 172.21.15.6:0/2118052639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7cc0cf470 con 0x7fa7cc15d4d0 2023-10-06T02:21:35.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.471+0000 7fa7b3fff700 1 -- 172.21.15.6:0/2118052639 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa7c401e3b0 con 0x7fa7cc15d4d0 2023-10-06T02:21:35.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.471+0000 7fa7b3fff700 1 --2- 172.21.15.6:0/2118052639 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7b8066f30 0x7fa7b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:35.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.471+0000 7fa7b3fff700 1 -- 172.21.15.6:0/2118052639 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fa7c4084d00 con 0x7fa7cc15d4d0 2023-10-06T02:21:35.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.472+0000 7fa7cbfff700 1 --2- 172.21.15.6:0/2118052639 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7b8066f30 0x7fa7b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:35.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.472+0000 7fa7cbfff700 1 --2- 172.21.15.6:0/2118052639 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7b8066f30 0x7fa7b80693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc007130 tx=0x7fa7bc007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:35.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.476+0000 7fa7b3fff700 1 -- 172.21.15.6:0/2118052639 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7cc0cf470 con 0x7fa7cc15d4d0 2023-10-06T02:21:35.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.716+0000 7fa7d290c700 1 -- 172.21.15.6:0/2118052639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7cc0cf470 con 0x7fa7cc15d4d0 2023-10-06T02:21:35.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.717+0000 7fa7b3fff700 1 -- 172.21.15.6:0/2118052639 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4643 (secure 0 0 0) 0x7fa7cc0cf470 con 0x7fa7cc15d4d0 2023-10-06T02:21:35.718 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:21:35.718 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":58,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/400475961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":400475961},{"type":"v1","addr":"172.21.15.175:6837","nonce":400475961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1006897436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1006897436},{"type":"v1","addr":"172.21.15.6:6835","nonce":1006897436}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:51.206714+0000","modified":"2023-10-06T02:21:34.768933+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":67,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6210},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6210":{"gid":6210,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":10,"addr":"172.21.15.6:6834/3777949337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3777949337},{"type":"v1","addr":"172.21.15.6:6834","nonce":3777949337}]},"join_fscid":-1,"laggy_since":"2023-10-06T02:21:34.768857+0000","export_targets":[],"features":4540138320759226367,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:21:35.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.719+0000 7fa7d290c700 1 -- 172.21.15.6:0/2118052639 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7b8066f30 msgr2=0x7fa7b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:35.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.719+0000 7fa7d290c700 1 --2- 172.21.15.6:0/2118052639 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7b8066f30 0x7fa7b80693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc007130 tx=0x7fa7bc007eb0 comp rx=0 tx=0).stop 2023-10-06T02:21:35.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.719+0000 7fa7d290c700 1 -- 172.21.15.6:0/2118052639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc15d4d0 msgr2=0x7fa7cc0b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:35.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.719+0000 7fa7d290c700 1 --2- 172.21.15.6:0/2118052639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc15d4d0 0x7fa7cc0b3a00 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400d180 tx=0x7fa7c4009a50 comp rx=0 tx=0).stop 2023-10-06T02:21:35.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.719+0000 7fa7d290c700 1 -- 172.21.15.6:0/2118052639 shutdown_connections 2023-10-06T02:21:35.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.719+0000 7fa7d290c700 1 --2- 172.21.15.6:0/2118052639 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7b8066f30 0x7fa7b80693e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:35.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.719+0000 7fa7d290c700 1 --2- 172.21.15.6:0/2118052639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc15d4d0 0x7fa7cc0b3a00 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:35.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.719+0000 7fa7d290c700 1 --2- 172.21.15.6:0/2118052639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7cc0b27f0 0x7fa7cc0c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:35.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.719+0000 7fa7d290c700 1 --2- 172.21.15.6:0/2118052639 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7cc159380 0x7fa7cc0c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:35.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.719+0000 7fa7d290c700 1 -- 172.21.15.6:0/2118052639 >> 172.21.15.6:0/2118052639 conn(0x7fa7cc068680 msgr2=0x7fa7cc0c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:35.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.719+0000 7fa7d290c700 1 -- 172.21.15.6:0/2118052639 shutdown_connections 2023-10-06T02:21:35.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.719+0000 7fa7d290c700 1 -- 172.21.15.6:0/2118052639 wait complete. 2023-10-06T02:21:35.722 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 58 2023-10-06T02:21:35.732 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-10-06T02:21:35.733 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_journal_corrupt_dentry_first 2023-10-06T02:21:35.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.853+0000 7f8d4d6db700 1 Processor -- start 2023-10-06T02:21:35.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.853+0000 7f8d4d6db700 1 -- start start 2023-10-06T02:21:35.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.853+0000 7f8d4d6db700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d4815a030 0x7f8d4815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:35.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.853+0000 7f8d4d6db700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8d4815a940 0x7f8d48086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:35.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.853+0000 7f8d4d6db700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d48087960 con 0x7f8d48087530 2023-10-06T02:21:35.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.853+0000 7f8d4d6db700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d480b0cf0 con 0x7f8d4815a940 2023-10-06T02:21:35.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.853+0000 7f8d4d6db700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480afc50 con 0x7f8d4815a030 2023-10-06T02:21:35.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.854+0000 7f8d477fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8d48087530 0x7f8d480b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55296/0 (socket says 172.21.15.6:55296) 2023-10-06T02:21:35.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.854+0000 7f8d477fe700 1 -- 172.21.15.6:0/747768059 learned_addr learned my addr 172.21.15.6:0/747768059 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:21:35.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.854+0000 7f8d467fc700 1 --2- 172.21.15.6:0/747768059 >> v2:172.21.15.175:3300/0 conn(0x7f8d4815a940 0x7f8d48086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:35.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.854+0000 7f8d46ffd700 1 --2- 172.21.15.6:0/747768059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d4815a030 0x7f8d4815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:35.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.854+0000 7f8d45ffb700 1 -- 172.21.15.6:0/747768059 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803748679 0 0) 0x7f8d48087960 con 0x7f8d48087530 2023-10-06T02:21:35.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.854+0000 7f8d45ffb700 1 -- 172.21.15.6:0/747768059 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d34003570 con 0x7f8d48087530 2023-10-06T02:21:35.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.854+0000 7f8d45ffb700 1 -- 172.21.15.6:0/747768059 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 309914413 0 0) 0x7f8d34003570 con 0x7f8d48087530 2023-10-06T02:21:35.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.854+0000 7f8d467fc700 1 -- 172.21.15.6:0/747768059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d4815a030 msgr2=0x7f8d4815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:35.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.854+0000 7f8d467fc700 1 --2- 172.21.15.6:0/747768059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d4815a030 0x7f8d4815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:35.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.854+0000 7f8d467fc700 1 -- 172.21.15.6:0/747768059 >> v1:172.21.15.6:6789/0 conn(0x7f8d48087530 legacy=0x7f8d480b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:35.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.854+0000 7f8d467fc700 1 -- 172.21.15.6:0/747768059 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d480aff30 con 0x7f8d4815a940 2023-10-06T02:21:35.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.854+0000 7f8d46ffd700 1 --2- 172.21.15.6:0/747768059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d4815a030 0x7f8d4815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:21:35.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.854+0000 7f8d467fc700 1 --2- 172.21.15.6:0/747768059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d4815a940 0x7f8d48086ff0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8d300098e0 tx=0x7f8d300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=278d9d416668a54e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:35.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.854+0000 7f8d45ffb700 1 -- 172.21.15.6:0/747768059 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38001470 con 0x7f8d4815a940 2023-10-06T02:21:35.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.855+0000 7f8d45ffb700 1 -- 172.21.15.6:0/747768059 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d30011420 con 0x7f8d4815a940 2023-10-06T02:21:35.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.855+0000 7f8d45ffb700 1 -- 172.21.15.6:0/747768059 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d300117a0 con 0x7f8d4815a940 2023-10-06T02:21:35.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.855+0000 7f8d4d6db700 1 -- 172.21.15.6:0/747768059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d4815a940 msgr2=0x7f8d48086ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:35.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.855+0000 7f8d4d6db700 1 --2- 172.21.15.6:0/747768059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d4815a940 0x7f8d48086ff0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8d300098e0 tx=0x7f8d300091a0 comp rx=0 tx=0).stop 2023-10-06T02:21:35.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.855+0000 7f8d4d6db700 1 -- 172.21.15.6:0/747768059 shutdown_connections 2023-10-06T02:21:35.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.855+0000 7f8d4d6db700 1 --2- 172.21.15.6:0/747768059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d4815a030 0x7f8d4815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:35.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.855+0000 7f8d4d6db700 1 --2- 172.21.15.6:0/747768059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d4815a940 0x7f8d48086ff0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:35.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.855+0000 7f8d4d6db700 1 -- 172.21.15.6:0/747768059 >> 172.21.15.6:0/747768059 conn(0x7f8d48068680 msgr2=0x7f8d48068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:35.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.855+0000 7f8d4d6db700 1 -- 172.21.15.6:0/747768059 shutdown_connections 2023-10-06T02:21:35.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.855+0000 7f8d4d6db700 1 -- 172.21.15.6:0/747768059 wait complete. 2023-10-06T02:21:35.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.856+0000 7f8d4d6db700 1 Processor -- start 2023-10-06T02:21:35.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.856+0000 7f8d4d6db700 1 -- start start 2023-10-06T02:21:35.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.857+0000 7f8d4d6db700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d48087530 0x7f8d480ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:35.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.857+0000 7f8d4d6db700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d4815a030 0x7f8d481455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:35.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.857+0000 7f8d4d6db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d4815a940 0x7f8d4816d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.857+0000 7f8d4d6db700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480c9e00 con 0x7f8d4815a940 2023-10-06T02:21:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.857+0000 7f8d4d6db700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480c91f0 con 0x7f8d4815a030 2023-10-06T02:21:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.857+0000 7f8d4d6db700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480c94d0 con 0x7f8d48087530 2023-10-06T02:21:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.857+0000 7f8d477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d4815a940 0x7f8d4816d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.857+0000 7f8d477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d4815a940 0x7f8d4816d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53940/0 (socket says 172.21.15.6:53940) 2023-10-06T02:21:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.857+0000 7f8d477fe700 1 -- 172.21.15.6:0/2845373804 learned_addr learned my addr 172.21.15.6:0/2845373804 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.857+0000 7f8d467fc700 1 --2- 172.21.15.6:0/2845373804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d4815a030 0x7f8d481455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.857+0000 7f8d46ffd700 1 --2- 172.21.15.6:0/2845373804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d48087530 0x7f8d480ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.857+0000 7f8d477fe700 1 -- 172.21.15.6:0/2845373804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d48087530 msgr2=0x7f8d480ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.857+0000 7f8d477fe700 1 --2- 172.21.15.6:0/2845373804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d48087530 0x7f8d480ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.857+0000 7f8d477fe700 1 -- 172.21.15.6:0/2845373804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d4815a030 msgr2=0x7f8d481455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.857+0000 7f8d477fe700 1 --2- 172.21.15.6:0/2845373804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d4815a030 0x7f8d481455b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.858+0000 7f8d477fe700 1 -- 172.21.15.6:0/2845373804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d40009a20 con 0x7f8d4815a940 2023-10-06T02:21:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.858+0000 7f8d477fe700 1 --2- 172.21.15.6:0/2845373804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d4815a940 0x7f8d4816d400 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800cb90 tx=0x7f8d38001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.858+0000 7f8d3effd700 1 -- 172.21.15.6:0/2845373804 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38007150 con 0x7f8d4815a940 2023-10-06T02:21:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.858+0000 7f8d3effd700 1 -- 172.21.15.6:0/2845373804 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d380072b0 con 0x7f8d4815a940 2023-10-06T02:21:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.858+0000 7f8d4d6db700 1 -- 172.21.15.6:0/2845373804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d30009420 con 0x7f8d4815a940 2023-10-06T02:21:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.858+0000 7f8d3effd700 1 -- 172.21.15.6:0/2845373804 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38007670 con 0x7f8d4815a940 2023-10-06T02:21:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.858+0000 7f8d4d6db700 1 -- 172.21.15.6:0/2845373804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d480c9a90 con 0x7f8d4815a940 2023-10-06T02:21:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.859+0000 7f8d4d6db700 1 -- 172.21.15.6:0/2845373804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d480c9f70 con 0x7f8d4815a940 2023-10-06T02:21:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.859+0000 7f8d3effd700 1 -- 172.21.15.6:0/2845373804 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d38004a40 con 0x7f8d4815a940 2023-10-06T02:21:35.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.860+0000 7f8d3effd700 1 --2- 172.21.15.6:0/2845373804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8d28066f30 0x7f8d280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:35.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.860+0000 7f8d3effd700 1 -- 172.21.15.6:0/2845373804 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f8d38083f80 con 0x7f8d4815a940 2023-10-06T02:21:35.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.860+0000 7f8d46ffd700 1 --2- 172.21.15.6:0/2845373804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8d28066f30 0x7f8d280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:35.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.860+0000 7f8d46ffd700 1 --2- 172.21.15.6:0/2845373804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8d28066f30 0x7f8d280693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009fd0 tx=0x7f8d4000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:35.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:35.864+0000 7f8d3effd700 1 -- 172.21.15.6:0/2845373804 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d38050f40 con 0x7f8d4815a940 2023-10-06T02:21:36.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.060+0000 7f8d4d6db700 1 -- 172.21.15.6:0/2845373804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_journal_corrupt_dentry_first"} v 0) v1 -- 0x7f8d480b0210 con 0x7f8d4815a940 2023-10-06T02:21:36.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.064+0000 7f8d3effd700 1 -- 172.21.15.6:0/2845373804 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_journal_corrupt_dentry_first"}]=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8d38018020 con 0x7f8d4815a940 2023-10-06T02:21:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.066+0000 7f8d4d6db700 1 -- 172.21.15.6:0/2845373804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8d28066f30 msgr2=0x7f8d280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.066+0000 7f8d4d6db700 1 --2- 172.21.15.6:0/2845373804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8d28066f30 0x7f8d280693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009fd0 tx=0x7f8d4000b040 comp rx=0 tx=0).stop 2023-10-06T02:21:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.066+0000 7f8d4d6db700 1 -- 172.21.15.6:0/2845373804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d4815a940 msgr2=0x7f8d4816d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.066+0000 7f8d4d6db700 1 --2- 172.21.15.6:0/2845373804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d4815a940 0x7f8d4816d400 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800cb90 tx=0x7f8d38001aa0 comp rx=0 tx=0).stop 2023-10-06T02:21:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.066+0000 7f8d4d6db700 1 -- 172.21.15.6:0/2845373804 shutdown_connections 2023-10-06T02:21:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.066+0000 7f8d4d6db700 1 --2- 172.21.15.6:0/2845373804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8d28066f30 0x7f8d280693e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.066+0000 7f8d4d6db700 1 --2- 172.21.15.6:0/2845373804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d4815a940 0x7f8d4816d400 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.066+0000 7f8d4d6db700 1 --2- 172.21.15.6:0/2845373804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d48087530 0x7f8d480ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.066+0000 7f8d4d6db700 1 --2- 172.21.15.6:0/2845373804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d4815a030 0x7f8d481455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:36.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.066+0000 7f8d4d6db700 1 -- 172.21.15.6:0/2845373804 >> 172.21.15.6:0/2845373804 conn(0x7f8d48068680 msgr2=0x7f8d480b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:36.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.066+0000 7f8d4d6db700 1 -- 172.21.15.6:0/2845373804 shutdown_connections 2023-10-06T02:21:36.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.066+0000 7f8d4d6db700 1 -- 172.21.15.6:0/2845373804 wait complete. 2023-10-06T02:21:36.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 4:0 false 2023-10-06T02:21:36.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.199+0000 7f49d14d1700 1 Processor -- start 2023-10-06T02:21:36.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.199+0000 7f49d14d1700 1 -- start start 2023-10-06T02:21:36.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.200+0000 7f49d14d1700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f49cc0cd400 0x7f49cc0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:36.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.200+0000 7f49d14d1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49cc0cd7d0 0x7f49cc0b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.200+0000 7f49d14d1700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49cc0b29a0 con 0x7f49cc0b0810 2023-10-06T02:21:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.200+0000 7f49d14d1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49cc0af770 con 0x7f49cc0cd7d0 2023-10-06T02:21:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.200+0000 7f49d14d1700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49cc0afa50 con 0x7f49cc0cd400 2023-10-06T02:21:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.200+0000 7f49cb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49cc0cd7d0 0x7f49cc0b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.200+0000 7f49cb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49cc0cd7d0 0x7f49cc0b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53942/0 (socket says 172.21.15.6:53942) 2023-10-06T02:21:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.200+0000 7f49cb7fe700 1 -- 172.21.15.6:0/2104064842 learned_addr learned my addr 172.21.15.6:0/2104064842 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.200+0000 7f49cbfff700 1 --2- 172.21.15.6:0/2104064842 >> v2:172.21.15.175:3300/0 conn(0x7f49cc0cd400 0x7f49cc0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.200+0000 7f49cb7fe700 1 -- 172.21.15.6:0/2104064842 >> v2:172.21.15.175:3300/0 conn(0x7f49cc0cd400 msgr2=0x7f49cc0b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.200+0000 7f49cb7fe700 1 --2- 172.21.15.6:0/2104064842 >> v2:172.21.15.175:3300/0 conn(0x7f49cc0cd400 0x7f49cc0b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.200+0000 7f49cb7fe700 1 -- 172.21.15.6:0/2104064842 >> v1:172.21.15.175:6789/0 conn(0x7f49cc0b0810 legacy=0x7f49cc0d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.200+0000 7f49cb7fe700 1 -- 172.21.15.6:0/2104064842 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc0afd30 con 0x7f49cc0cd7d0 2023-10-06T02:21:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.200+0000 7f49cbfff700 1 --2- 172.21.15.6:0/2104064842 >> v2:172.21.15.175:3300/0 conn(0x7f49cc0cd400 0x7f49cc0b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:21:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.200+0000 7f49cb7fe700 1 --2- 172.21.15.6:0/2104064842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49cc0cd7d0 0x7f49cc0b2460 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f49b40099b0 tx=0x7f49b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fa449641713e96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.201+0000 7f49caffd700 1 -- 172.21.15.6:0/2104064842 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b400b7e0 con 0x7f49cc0cd7d0 2023-10-06T02:21:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.201+0000 7f49caffd700 1 -- 172.21.15.6:0/2104064842 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b400b940 con 0x7f49cc0cd7d0 2023-10-06T02:21:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.201+0000 7f49caffd700 1 -- 172.21.15.6:0/2104064842 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b400bd00 con 0x7f49cc0cd7d0 2023-10-06T02:21:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.201+0000 7f49d14d1700 1 -- 172.21.15.6:0/2104064842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49cc0cd7d0 msgr2=0x7f49cc0b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.201+0000 7f49d14d1700 1 --2- 172.21.15.6:0/2104064842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49cc0cd7d0 0x7f49cc0b2460 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f49b40099b0 tx=0x7f49b4009250 comp rx=0 tx=0).stop 2023-10-06T02:21:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.201+0000 7f49d14d1700 1 -- 172.21.15.6:0/2104064842 shutdown_connections 2023-10-06T02:21:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.201+0000 7f49d14d1700 1 --2- 172.21.15.6:0/2104064842 >> v2:172.21.15.175:3300/0 conn(0x7f49cc0cd400 0x7f49cc0b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.201+0000 7f49d14d1700 1 --2- 172.21.15.6:0/2104064842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49cc0cd7d0 0x7f49cc0b2460 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.201+0000 7f49d14d1700 1 -- 172.21.15.6:0/2104064842 >> 172.21.15.6:0/2104064842 conn(0x7f49cc06a110 msgr2=0x7f49cc06a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.201+0000 7f49d14d1700 1 -- 172.21.15.6:0/2104064842 shutdown_connections 2023-10-06T02:21:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.201+0000 7f49d14d1700 1 -- 172.21.15.6:0/2104064842 wait complete. 2023-10-06T02:21:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.202+0000 7f49d14d1700 1 Processor -- start 2023-10-06T02:21:36.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.202+0000 7f49d14d1700 1 -- start start 2023-10-06T02:21:36.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.203+0000 7f49d14d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49cc0b0810 0x7f49cc1549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:36.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.203+0000 7f49d14d1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49cc0cd400 0x7f49cc15af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:36.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.203+0000 7f49d14d1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49cc15b460 0x7f49cc0b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:36.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.203+0000 7f49d14d1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc154f10 con 0x7f49cc0b0810 2023-10-06T02:21:36.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.203+0000 7f49d14d1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc1597f0 con 0x7f49cc0cd400 2023-10-06T02:21:36.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.203+0000 7f49d14d1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc16d8a0 con 0x7f49cc15b460 2023-10-06T02:21:36.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.203+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49cc0b0810 0x7f49cc1549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:36.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.203+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49cc0b0810 0x7f49cc1549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53948/0 (socket says 172.21.15.6:53948) 2023-10-06T02:21:36.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.203+0000 7f49cbfff700 1 -- 172.21.15.6:0/1270957526 learned_addr learned my addr 172.21.15.6:0/1270957526 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:36.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.203+0000 7f49d0cd0700 1 --2- 172.21.15.6:0/1270957526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49cc15b460 0x7f49cc0b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:36.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.203+0000 7f49cb7fe700 1 --2- 172.21.15.6:0/1270957526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49cc0cd400 0x7f49cc15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:36.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.203+0000 7f49cbfff700 1 -- 172.21.15.6:0/1270957526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49cc15b460 msgr2=0x7f49cc0b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:36.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.203+0000 7f49cbfff700 1 --2- 172.21.15.6:0/1270957526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49cc15b460 0x7f49cc0b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:36.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.203+0000 7f49cbfff700 1 -- 172.21.15.6:0/1270957526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49cc0cd400 msgr2=0x7f49cc15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:36.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.203+0000 7f49cbfff700 1 --2- 172.21.15.6:0/1270957526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49cc0cd400 0x7f49cc15af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:36.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.203+0000 7f49cbfff700 1 -- 172.21.15.6:0/1270957526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b40094f0 con 0x7f49cc0b0810 2023-10-06T02:21:36.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.204+0000 7f49cbfff700 1 --2- 172.21.15.6:0/1270957526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49cc0b0810 0x7f49cc1549d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00c8b0 tx=0x7f49bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:36.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.204+0000 7f49c3fff700 1 -- 172.21.15.6:0/1270957526 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc005a00 con 0x7f49cc0b0810 2023-10-06T02:21:36.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.204+0000 7f49c3fff700 1 -- 172.21.15.6:0/1270957526 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc005b60 con 0x7f49cc0b0810 2023-10-06T02:21:36.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.204+0000 7f49d14d1700 1 -- 172.21.15.6:0/1270957526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49cc16dd30 con 0x7f49cc0b0810 2023-10-06T02:21:36.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.204+0000 7f49c3fff700 1 -- 172.21.15.6:0/1270957526 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc011600 con 0x7f49cc0b0810 2023-10-06T02:21:36.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.204+0000 7f49d14d1700 1 -- 172.21.15.6:0/1270957526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49cc16cf70 con 0x7f49cc0b0810 2023-10-06T02:21:36.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.205+0000 7f49d14d1700 1 -- 172.21.15.6:0/1270957526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49cc064aa0 con 0x7f49cc0b0810 2023-10-06T02:21:36.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.205+0000 7f49c3fff700 1 -- 172.21.15.6:0/1270957526 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49bc0119f0 con 0x7f49cc0b0810 2023-10-06T02:21:36.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.205+0000 7f49c3fff700 1 --2- 172.21.15.6:0/1270957526 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f49ac066f30 0x7f49ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:36.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.206+0000 7f49c3fff700 1 -- 172.21.15.6:0/1270957526 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f49bc0847e0 con 0x7f49cc0b0810 2023-10-06T02:21:36.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.206+0000 7f49cb7fe700 1 --2- 172.21.15.6:0/1270957526 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f49ac066f30 0x7f49ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:36.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.206+0000 7f49cb7fe700 1 --2- 172.21.15.6:0/1270957526 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f49ac066f30 0x7f49ac0693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f49cc069d40 tx=0x7f49b4016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:36.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.210+0000 7f49c3fff700 1 -- 172.21.15.6:0/1270957526 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49bc051680 con 0x7f49cc0b0810 2023-10-06T02:21:36.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:36.484+0000 7f49d14d1700 1 -- 172.21.15.6:0/1270957526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "4:0", "val": "false"} v 0) v1 -- 0x7f49cc0b0010 con 0x7f49cc0b0810 2023-10-06T02:21:37.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.068+0000 7f49c3fff700 1 -- 172.21.15.6:0/1270957526 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "4:0", "val": "false"}]=0 unfreezing mds.6210 v59) v1 ==== 115+0+0 (secure 0 0 0) 0x7f49bc054ca0 con 0x7f49cc0b0810 2023-10-06T02:21:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.073+0000 7f49d14d1700 1 -- 172.21.15.6:0/1270957526 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f49ac066f30 msgr2=0x7f49ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.073+0000 7f49d14d1700 1 --2- 172.21.15.6:0/1270957526 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f49ac066f30 0x7f49ac0693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f49cc069d40 tx=0x7f49b4016000 comp rx=0 tx=0).stop 2023-10-06T02:21:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.073+0000 7f49d14d1700 1 -- 172.21.15.6:0/1270957526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49cc0b0810 msgr2=0x7f49cc1549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.073+0000 7f49d14d1700 1 --2- 172.21.15.6:0/1270957526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49cc0b0810 0x7f49cc1549d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00c8b0 tx=0x7f49bc008040 comp rx=0 tx=0).stop 2023-10-06T02:21:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.073+0000 7f49d14d1700 1 -- 172.21.15.6:0/1270957526 shutdown_connections 2023-10-06T02:21:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.073+0000 7f49d14d1700 1 --2- 172.21.15.6:0/1270957526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49cc15b460 0x7f49cc0b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.073+0000 7f49d14d1700 1 --2- 172.21.15.6:0/1270957526 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f49ac066f30 0x7f49ac0693e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.073+0000 7f49d14d1700 1 --2- 172.21.15.6:0/1270957526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49cc0b0810 0x7f49cc1549d0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.073+0000 7f49d14d1700 1 --2- 172.21.15.6:0/1270957526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49cc0cd400 0x7f49cc15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.073+0000 7f49d14d1700 1 -- 172.21.15.6:0/1270957526 >> 172.21.15.6:0/1270957526 conn(0x7f49cc06a110 msgr2=0x7f49cc0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:37.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.074+0000 7f49d14d1700 1 -- 172.21.15.6:0/1270957526 shutdown_connections 2023-10-06T02:21:37.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.074+0000 7f49d14d1700 1 -- 172.21.15.6:0/1270957526 wait complete. 2023-10-06T02:21:37.076 INFO:teuthology.orchestra.run.smithi006.stderr:unfreezing mds.6210 2023-10-06T02:21:37.092 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -n kernel.core_pattern 2023-10-06T02:21:37.118 INFO:teuthology.orchestra.run.smithi006.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:21:37.119 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-10-06T02:21:37.119 DEBUG:teuthology.orchestra.run.smithi006:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-10-06T02:21:37.189 INFO:teuthology.orchestra.run.smithi006.stdout:1696558879.112621.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-10-06T02:21:37.191 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1696558879.112621.core'] 2023-10-06T02:21:37.191 INFO:tasks.cephfs.cephfs_test_case:Found core file 1696558879.112621.core, deleting it 2023-10-06T02:21:37.191 DEBUG:teuthology.orchestra.run.smithi006:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1696558879.112621.core 2023-10-06T02:21:37.259 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:21:37.260 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:21:37.260 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:21:37.260 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:21:37.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:21:37.260 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-10-06T02:21:37.261 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:21:37.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:21:37.302 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:21:37.302 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:21:37.377 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-06T02:21:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.422+0000 7fed310a6700 1 Processor -- start 2023-10-06T02:21:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.422+0000 7fed310a6700 1 -- start start 2023-10-06T02:21:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.423+0000 7fed310a6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fed2c15ca10 0x7fed2c069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.423+0000 7fed310a6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2c15cde0 0x7fed2c0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.423+0000 7fed310a6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed2c0b1ed0 con 0x7fed2c067d10 2023-10-06T02:21:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.423+0000 7fed310a6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed2c0879c0 con 0x7fed2c15ca10 2023-10-06T02:21:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.423+0000 7fed310a6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0cec50 con 0x7fed2c15cde0 2023-10-06T02:21:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.423+0000 7fed2a59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fed2c067d10 0x7fed2c06a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55310/0 (socket says 172.21.15.6:55310) 2023-10-06T02:21:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.423+0000 7fed2a59c700 1 -- 172.21.15.6:0/301098770 learned_addr learned my addr 172.21.15.6:0/301098770 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:21:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed2b59e700 1 --2- 172.21.15.6:0/301098770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2c15cde0 0x7fed2c0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed2ad9d700 1 --2- 172.21.15.6:0/301098770 >> v2:172.21.15.175:3300/0 conn(0x7fed2c15ca10 0x7fed2c069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed29d9b700 1 -- 172.21.15.6:0/301098770 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798792160 0 0) 0x7fed2c0b1ed0 con 0x7fed2c067d10 2023-10-06T02:21:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed29d9b700 1 -- 172.21.15.6:0/301098770 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed18003570 con 0x7fed2c067d10 2023-10-06T02:21:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed29d9b700 1 -- 172.21.15.6:0/301098770 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3687566828 0 0) 0x7fed18003570 con 0x7fed2c067d10 2023-10-06T02:21:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed29d9b700 1 -- 172.21.15.6:0/301098770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2c15cde0 msgr2=0x7fed2c0b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed29d9b700 1 --2- 172.21.15.6:0/301098770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2c15cde0 0x7fed2c0b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed29d9b700 1 -- 172.21.15.6:0/301098770 >> v2:172.21.15.175:3300/0 conn(0x7fed2c15ca10 msgr2=0x7fed2c069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed29d9b700 1 --2- 172.21.15.6:0/301098770 >> v2:172.21.15.175:3300/0 conn(0x7fed2c15ca10 0x7fed2c069f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed29d9b700 1 -- 172.21.15.6:0/301098770 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c0cef30 con 0x7fed2c067d10 2023-10-06T02:21:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed29d9b700 1 -- 172.21.15.6:0/301098770 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fed14001470 con 0x7fed2c067d10 2023-10-06T02:21:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed29d9b700 1 -- 172.21.15.6:0/301098770 >> v1:172.21.15.6:6789/0 conn(0x7fed2c067d10 legacy=0x7fed2c06a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed29d9b700 1 --2- 172.21.15.6:0/301098770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed18003a60 0x7fed18003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed29d9b700 1 --2- 172.21.15.6:0/301098770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2c15cde0 0x7fed18004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed29d9b700 1 --2- 172.21.15.6:0/301098770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed18004d50 0x7fed180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed29d9b700 1 -- 172.21.15.6:0/301098770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0879c0 con 0x7fed18003a60 2023-10-06T02:21:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed29d9b700 1 -- 172.21.15.6:0/301098770 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0cec50 con 0x7fed18004d50 2023-10-06T02:21:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed29d9b700 1 -- 172.21.15.6:0/301098770 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1800ba60 con 0x7fed2c15cde0 2023-10-06T02:21:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed2ad9d700 1 --2- 172.21.15.6:0/301098770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed18003a60 0x7fed18003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed2a59c700 1 --2- 172.21.15.6:0/301098770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2c15cde0 0x7fed18004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed2b59e700 1 --2- 172.21.15.6:0/301098770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed18004d50 0x7fed180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed2ad9d700 1 -- 172.21.15.6:0/301098770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2c15cde0 msgr2=0x7fed18004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed2ad9d700 1 --2- 172.21.15.6:0/301098770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2c15cde0 0x7fed18004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed2ad9d700 1 -- 172.21.15.6:0/301098770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed18004d50 msgr2=0x7fed180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed2ad9d700 1 --2- 172.21.15.6:0/301098770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed18004d50 0x7fed180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed2ad9d700 1 -- 172.21.15.6:0/301098770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed18003570 con 0x7fed18003a60 2023-10-06T02:21:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.424+0000 7fed2b59e700 1 --2- 172.21.15.6:0/301098770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed18004d50 0x7fed180051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.425+0000 7fed2ad9d700 1 --2- 172.21.15.6:0/301098770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed18003a60 0x7fed18003e70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009bf0 tx=0x7fed1c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984af56c6143de9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.425+0000 7fed29d9b700 1 -- 172.21.15.6:0/301098770 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c005a00 con 0x7fed18003a60 2023-10-06T02:21:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.425+0000 7fed29d9b700 1 -- 172.21.15.6:0/301098770 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c005b60 con 0x7fed18003a60 2023-10-06T02:21:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.425+0000 7fed29d9b700 1 -- 172.21.15.6:0/301098770 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c00e6b0 con 0x7fed18003a60 2023-10-06T02:21:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.425+0000 7fed310a6700 1 -- 172.21.15.6:0/301098770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed18003a60 msgr2=0x7fed18003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.425+0000 7fed310a6700 1 --2- 172.21.15.6:0/301098770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed18003a60 0x7fed18003e70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009bf0 tx=0x7fed1c009120 comp rx=0 tx=0).stop 2023-10-06T02:21:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.425+0000 7fed2b59e700 1 -- 172.21.15.6:0/301098770 reap_dead start 2023-10-06T02:21:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.425+0000 7fed310a6700 1 -- 172.21.15.6:0/301098770 shutdown_connections 2023-10-06T02:21:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.425+0000 7fed310a6700 1 -- 172.21.15.6:0/301098770 >> 172.21.15.6:0/301098770 conn(0x7fed2c067910 msgr2=0x7fed2c0ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.425+0000 7fed310a6700 1 -- 172.21.15.6:0/301098770 shutdown_connections 2023-10-06T02:21:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.425+0000 7fed310a6700 1 -- 172.21.15.6:0/301098770 wait complete. 2023-10-06T02:21:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.426+0000 7fed310a6700 1 Processor -- start 2023-10-06T02:21:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.426+0000 7fed310a6700 1 -- start start 2023-10-06T02:21:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.427+0000 7fed310a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed18003a60 0x7fed2c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.427+0000 7fed310a6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed2c098560 0x7fed2c151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.427+0000 7fed310a6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2c0aeaf0 0x7fed2c0aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.427+0000 7fed310a6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0af4b0 con 0x7fed18003a60 2023-10-06T02:21:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.427+0000 7fed310a6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0989b0 con 0x7fed2c098560 2023-10-06T02:21:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.427+0000 7fed310a6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c151c60 con 0x7fed2c0aeaf0 2023-10-06T02:21:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.427+0000 7fed2ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed18003a60 0x7fed2c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.427+0000 7fed2ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed18003a60 0x7fed2c09aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53986/0 (socket says 172.21.15.6:53986) 2023-10-06T02:21:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.427+0000 7fed2ad9d700 1 -- 172.21.15.6:0/2878383143 learned_addr learned my addr 172.21.15.6:0/2878383143 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.427+0000 7fed2b59e700 1 --2- 172.21.15.6:0/2878383143 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2c0aeaf0 0x7fed2c0aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.427+0000 7fed2ad9d700 1 -- 172.21.15.6:0/2878383143 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2c0aeaf0 msgr2=0x7fed2c0aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.427+0000 7fed2ad9d700 1 --2- 172.21.15.6:0/2878383143 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2c0aeaf0 0x7fed2c0aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.427+0000 7fed2ad9d700 1 -- 172.21.15.6:0/2878383143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed2c098560 msgr2=0x7fed2c151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.428+0000 7fed2ad9d700 1 --2- 172.21.15.6:0/2878383143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed2c098560 0x7fed2c151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.428+0000 7fed2ad9d700 1 -- 172.21.15.6:0/2878383143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c09b100 con 0x7fed18003a60 2023-10-06T02:21:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.428+0000 7fed2ad9d700 1 --2- 172.21.15.6:0/2878383143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed18003a60 0x7fed2c09aa30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fed18004760 tx=0x7fed1c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.428+0000 7fed22ffd700 1 -- 172.21.15.6:0/2878383143 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c006240 con 0x7fed18003a60 2023-10-06T02:21:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.428+0000 7fed22ffd700 1 -- 172.21.15.6:0/2878383143 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c0063e0 con 0x7fed18003a60 2023-10-06T02:21:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.428+0000 7fed310a6700 1 -- 172.21.15.6:0/2878383143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2c09b3e0 con 0x7fed18003a60 2023-10-06T02:21:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.428+0000 7fed22ffd700 1 -- 172.21.15.6:0/2878383143 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c0067a0 con 0x7fed18003a60 2023-10-06T02:21:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.428+0000 7fed310a6700 1 -- 172.21.15.6:0/2878383143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2c09b9a0 con 0x7fed18003a60 2023-10-06T02:21:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.429+0000 7fed310a6700 1 -- 172.21.15.6:0/2878383143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2c09bbc0 con 0x7fed18003a60 2023-10-06T02:21:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.429+0000 7fed22ffd700 1 -- 172.21.15.6:0/2878383143 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed1c013680 con 0x7fed18003a60 2023-10-06T02:21:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.430+0000 7fed22ffd700 1 --2- 172.21.15.6:0/2878383143 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fed0c066f30 0x7fed0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.430+0000 7fed22ffd700 1 -- 172.21.15.6:0/2878383143 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fed1c085ef0 con 0x7fed18003a60 2023-10-06T02:21:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.430+0000 7fed2a59c700 1 --2- 172.21.15.6:0/2878383143 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fed0c066f30 0x7fed0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.430+0000 7fed2a59c700 1 --2- 172.21.15.6:0/2878383143 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fed0c066f30 0x7fed0c0693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fed14001050 tx=0x7fed14001e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.434+0000 7fed22ffd700 1 -- 172.21.15.6:0/2878383143 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed1c052de0 con 0x7fed18003a60 2023-10-06T02:21:37.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.674+0000 7fed310a6700 1 -- 172.21.15.6:0/2878383143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed2c06e8d0 con 0x7fed18003a60 2023-10-06T02:21:37.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.674+0000 7fed22ffd700 1 -- 172.21.15.6:0/2878383143 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3840 (secure 0 0 0) 0x7fed1c056400 con 0x7fed18003a60 2023-10-06T02:21:37.676 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:21:37.676 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":60,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/400475961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":400475961},{"type":"v1","addr":"172.21.15.175:6837","nonce":400475961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:51.206714+0000","modified":"2023-10-06T02:21:37.070626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":60,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/1006897436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1006897436},{"type":"v1","addr":"172.21.15.6:6835","nonce":1006897436}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:21:37.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.676+0000 7fed310a6700 1 -- 172.21.15.6:0/2878383143 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fed0c066f30 msgr2=0x7fed0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:37.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.676+0000 7fed310a6700 1 --2- 172.21.15.6:0/2878383143 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fed0c066f30 0x7fed0c0693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fed14001050 tx=0x7fed14001e90 comp rx=0 tx=0).stop 2023-10-06T02:21:37.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.676+0000 7fed310a6700 1 -- 172.21.15.6:0/2878383143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed18003a60 msgr2=0x7fed2c09aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:37.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.676+0000 7fed310a6700 1 --2- 172.21.15.6:0/2878383143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed18003a60 0x7fed2c09aa30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fed18004760 tx=0x7fed1c019000 comp rx=0 tx=0).stop 2023-10-06T02:21:37.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.676+0000 7fed310a6700 1 -- 172.21.15.6:0/2878383143 shutdown_connections 2023-10-06T02:21:37.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.676+0000 7fed310a6700 1 --2- 172.21.15.6:0/2878383143 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2c0aeaf0 0x7fed2c0aef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:37.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.676+0000 7fed310a6700 1 --2- 172.21.15.6:0/2878383143 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fed0c066f30 0x7fed0c0693e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:37.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.676+0000 7fed310a6700 1 --2- 172.21.15.6:0/2878383143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed18003a60 0x7fed2c09aa30 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:37.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.676+0000 7fed310a6700 1 --2- 172.21.15.6:0/2878383143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed2c098560 0x7fed2c151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:37.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.676+0000 7fed310a6700 1 -- 172.21.15.6:0/2878383143 >> 172.21.15.6:0/2878383143 conn(0x7fed2c067910 msgr2=0x7fed2c152790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:37.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.677+0000 7fed310a6700 1 -- 172.21.15.6:0/2878383143 shutdown_connections 2023-10-06T02:21:37.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:37.677+0000 7fed310a6700 1 -- 172.21.15.6:0/2878383143 wait complete. 2023-10-06T02:21:37.679 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 60 2023-10-06T02:21:38.092 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:20:51.206714+0000', 'modified': '2023-10-06T02:21:37.070626+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6207}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6207': {'gid': 6207, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.6:6835/1006897436', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 1006897436}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 1006897436}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:21:38.092 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6207:up:replay 2023-10-06T02:21:39.093 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:21:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.225+0000 7f774aa87700 1 Processor -- start 2023-10-06T02:21:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.225+0000 7f774aa87700 1 -- start start 2023-10-06T02:21:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.226+0000 7f774aa87700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7744142de0 0x7f77440ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.226+0000 7f774aa87700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f77440d0950 0x7f77440b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.226+0000 7f774aa87700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77440cf8a0 con 0x7f77440cd270 2023-10-06T02:21:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.226+0000 7f774aa87700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77440cec90 con 0x7f7744142de0 2023-10-06T02:21:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.226+0000 7f774aa87700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77440cef70 con 0x7f77440d0950 2023-10-06T02:21:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.226+0000 7f7748823700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7744142de0 0x7f77440ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.226+0000 7f7748823700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7744142de0 0x7f77440ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39028/0 (socket says 172.21.15.6:39028) 2023-10-06T02:21:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.226+0000 7f7748823700 1 -- 172.21.15.6:0/1042694625 learned_addr learned my addr 172.21.15.6:0/1042694625 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.227+0000 7f7748823700 1 -- 172.21.15.6:0/1042694625 >> v2:172.21.15.175:3300/0 conn(0x7f77440d0950 msgr2=0x7f77440b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.227+0000 7f7749024700 1 --2- 172.21.15.6:0/1042694625 >> v2:172.21.15.175:3300/0 conn(0x7f77440d0950 0x7f77440b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.227+0000 7f7748823700 1 --2- 172.21.15.6:0/1042694625 >> v2:172.21.15.175:3300/0 conn(0x7f77440d0950 0x7f77440b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.227+0000 7f7748823700 1 -- 172.21.15.6:0/1042694625 >> v1:172.21.15.175:6789/0 conn(0x7f77440cd270 legacy=0x7f77440d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.227+0000 7f7748823700 1 -- 172.21.15.6:0/1042694625 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77440cf250 con 0x7f7744142de0 2023-10-06T02:21:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.227+0000 7f7749024700 1 --2- 172.21.15.6:0/1042694625 >> v2:172.21.15.175:3300/0 conn(0x7f77440d0950 0x7f77440b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:21:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.227+0000 7f7748823700 1 --2- 172.21.15.6:0/1042694625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7744142de0 0x7f77440ccd30 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f77440d0e40 tx=0x7f772c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0341d853a2eed16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.227+0000 7f77437fe700 1 -- 172.21.15.6:0/1042694625 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c00b820 con 0x7f7744142de0 2023-10-06T02:21:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.227+0000 7f77437fe700 1 -- 172.21.15.6:0/1042694625 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c00b980 con 0x7f7744142de0 2023-10-06T02:21:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.227+0000 7f77437fe700 1 -- 172.21.15.6:0/1042694625 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c00bd20 con 0x7f7744142de0 2023-10-06T02:21:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.228+0000 7f774aa87700 1 -- 172.21.15.6:0/1042694625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7744142de0 msgr2=0x7f77440ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.228+0000 7f774aa87700 1 --2- 172.21.15.6:0/1042694625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7744142de0 0x7f77440ccd30 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f77440d0e40 tx=0x7f772c009250 comp rx=0 tx=0).stop 2023-10-06T02:21:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.228+0000 7f774aa87700 1 -- 172.21.15.6:0/1042694625 shutdown_connections 2023-10-06T02:21:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.228+0000 7f774aa87700 1 --2- 172.21.15.6:0/1042694625 >> v2:172.21.15.175:3300/0 conn(0x7f77440d0950 0x7f77440b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.228+0000 7f774aa87700 1 --2- 172.21.15.6:0/1042694625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7744142de0 0x7f77440ccd30 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.228+0000 7f774aa87700 1 -- 172.21.15.6:0/1042694625 >> 172.21.15.6:0/1042694625 conn(0x7f7744069110 msgr2=0x7f774406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.228+0000 7f774aa87700 1 -- 172.21.15.6:0/1042694625 shutdown_connections 2023-10-06T02:21:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.228+0000 7f774aa87700 1 -- 172.21.15.6:0/1042694625 wait complete. 2023-10-06T02:21:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.229+0000 7f774aa87700 1 Processor -- start 2023-10-06T02:21:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.229+0000 7f774aa87700 1 -- start start 2023-10-06T02:21:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.230+0000 7f774aa87700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77440cd270 0x7f774413e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.230+0000 7f774aa87700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77440d0950 0x7f77440cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.230+0000 7f774aa87700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7744142de0 0x7f77440b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.230+0000 7f774aa87700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77440cbf40 con 0x7f77440d0950 2023-10-06T02:21:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.230+0000 7f774aa87700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774416a540 con 0x7f7744142de0 2023-10-06T02:21:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.230+0000 7f774aa87700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77440cbc60 con 0x7f77440cd270 2023-10-06T02:21:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.230+0000 7f7743fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77440d0950 0x7f77440cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.230+0000 7f7743fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77440d0950 0x7f77440cb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39036/0 (socket says 172.21.15.6:39036) 2023-10-06T02:21:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.230+0000 7f7743fff700 1 -- 172.21.15.6:0/1932292201 learned_addr learned my addr 172.21.15.6:0/1932292201 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.230+0000 7f7749024700 1 --2- 172.21.15.6:0/1932292201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7744142de0 0x7f77440b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.230+0000 7f7748823700 1 --2- 172.21.15.6:0/1932292201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77440cd270 0x7f774413e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.230+0000 7f7743fff700 1 -- 172.21.15.6:0/1932292201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77440cd270 msgr2=0x7f774413e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.230+0000 7f7743fff700 1 --2- 172.21.15.6:0/1932292201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77440cd270 0x7f774413e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.230+0000 7f7743fff700 1 -- 172.21.15.6:0/1932292201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7744142de0 msgr2=0x7f77440b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.230+0000 7f7743fff700 1 --2- 172.21.15.6:0/1932292201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7744142de0 0x7f77440b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.230+0000 7f7743fff700 1 -- 172.21.15.6:0/1932292201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c0094f0 con 0x7f77440d0950 2023-10-06T02:21:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.230+0000 7f7743fff700 1 --2- 172.21.15.6:0/1932292201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77440d0950 0x7f77440cb210 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f773400b610 tx=0x7f7734009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.231+0000 7f7740ff9700 1 -- 172.21.15.6:0/1932292201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773400f510 con 0x7f77440d0950 2023-10-06T02:21:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.231+0000 7f7740ff9700 1 -- 172.21.15.6:0/1932292201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773400f670 con 0x7f77440d0950 2023-10-06T02:21:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.231+0000 7f774aa87700 1 -- 172.21.15.6:0/1932292201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7744169ef0 con 0x7f77440d0950 2023-10-06T02:21:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.231+0000 7f7740ff9700 1 -- 172.21.15.6:0/1932292201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773400fa30 con 0x7f77440d0950 2023-10-06T02:21:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.231+0000 7f774aa87700 1 -- 172.21.15.6:0/1932292201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f774413e580 con 0x7f77440d0950 2023-10-06T02:21:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.232+0000 7f774aa87700 1 -- 172.21.15.6:0/1932292201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7744088ac0 con 0x7f77440d0950 2023-10-06T02:21:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.232+0000 7f7740ff9700 1 -- 172.21.15.6:0/1932292201 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f773401a400 con 0x7f77440d0950 2023-10-06T02:21:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.232+0000 7f7740ff9700 1 --2- 172.21.15.6:0/1932292201 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7724066f30 0x7f77240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.233+0000 7f7740ff9700 1 -- 172.21.15.6:0/1932292201 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f77340842c0 con 0x7f77440d0950 2023-10-06T02:21:39.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.233+0000 7f7748823700 1 --2- 172.21.15.6:0/1932292201 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7724066f30 0x7f77240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:39.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.233+0000 7f7748823700 1 --2- 172.21.15.6:0/1932292201 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7724066f30 0x7f77240693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f77440d0e40 tx=0x7f772c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:39.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.237+0000 7f7740ff9700 1 -- 172.21.15.6:0/1932292201 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7734051230 con 0x7f77440d0950 2023-10-06T02:21:39.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.477+0000 7f774aa87700 1 -- 172.21.15.6:0/1932292201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f774416a680 con 0x7f77440d0950 2023-10-06T02:21:39.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.477+0000 7f7740ff9700 1 -- 172.21.15.6:0/1932292201 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f7734054850 con 0x7f77440d0950 2023-10-06T02:21:39.479 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:21:39.479 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":62,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/400475961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":400475961},{"type":"v1","addr":"172.21.15.175:6837","nonce":400475961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6579,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/628657260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":628657260},{"type":"v1","addr":"172.21.15.6:6834","nonce":628657260}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:51.206714+0000","modified":"2023-10-06T02:21:39.074141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":60,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.6:6835/1006897436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1006897436},{"type":"v1","addr":"172.21.15.6:6835","nonce":1006897436}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:21:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.479+0000 7f774aa87700 1 -- 172.21.15.6:0/1932292201 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7724066f30 msgr2=0x7f77240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.479+0000 7f774aa87700 1 --2- 172.21.15.6:0/1932292201 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7724066f30 0x7f77240693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f77440d0e40 tx=0x7f772c016000 comp rx=0 tx=0).stop 2023-10-06T02:21:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.480+0000 7f774aa87700 1 -- 172.21.15.6:0/1932292201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77440d0950 msgr2=0x7f77440cb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.480+0000 7f774aa87700 1 --2- 172.21.15.6:0/1932292201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77440d0950 0x7f77440cb210 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f773400b610 tx=0x7f7734009120 comp rx=0 tx=0).stop 2023-10-06T02:21:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.480+0000 7f774aa87700 1 -- 172.21.15.6:0/1932292201 shutdown_connections 2023-10-06T02:21:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.480+0000 7f774aa87700 1 --2- 172.21.15.6:0/1932292201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7744142de0 0x7f77440b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.480+0000 7f774aa87700 1 --2- 172.21.15.6:0/1932292201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77440cd270 0x7f774413e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.480+0000 7f774aa87700 1 --2- 172.21.15.6:0/1932292201 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7724066f30 0x7f77240693e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:39.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.480+0000 7f774aa87700 1 --2- 172.21.15.6:0/1932292201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77440d0950 0x7f77440cb210 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:39.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.480+0000 7f774aa87700 1 -- 172.21.15.6:0/1932292201 >> 172.21.15.6:0/1932292201 conn(0x7f7744069110 msgr2=0x7f77440b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:39.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.480+0000 7f774aa87700 1 -- 172.21.15.6:0/1932292201 shutdown_connections 2023-10-06T02:21:39.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:39.480+0000 7f774aa87700 1 -- 172.21.15.6:0/1932292201 wait complete. 2023-10-06T02:21:39.483 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 62 2023-10-06T02:21:39.896 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:20:51.206714+0000', 'modified': '2023-10-06T02:21:39.074141+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6207}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6207': {'gid': 6207, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:rejoin', 'state_seq': 15, 'addr': '172.21.15.6:6835/1006897436', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 1006897436}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 1006897436}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:21:39.896 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6207:up:rejoin 2023-10-06T02:21:40.897 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:21:41.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.027+0000 7f835816f700 1 Processor -- start 2023-10-06T02:21:41.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.028+0000 7f835816f700 1 -- start start 2023-10-06T02:21:41.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.028+0000 7f835816f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8350159380 0x7f8350159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.028+0000 7f835816f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f835015d4d0 0x7f835015d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.028+0000 7f835816f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83500cb6c0 con 0x7f83500b20e0 2023-10-06T02:21:41.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.028+0000 7f835816f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f835015e200 con 0x7f8350159380 2023-10-06T02:21:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.028+0000 7f835816f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83500ccb60 con 0x7f835015d4d0 2023-10-06T02:21:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.029+0000 7f8355f0b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8350159380 0x7f8350159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.029+0000 7f835570a700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f83500b20e0 0x7f83500b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40782/0 (socket says 172.21.15.6:40782) 2023-10-06T02:21:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.029+0000 7f835570a700 1 -- 172.21.15.6:0/398029543 learned_addr learned my addr 172.21.15.6:0/398029543 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:21:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.029+0000 7f835670c700 1 --2- 172.21.15.6:0/398029543 >> v2:172.21.15.175:3300/0 conn(0x7f835015d4d0 0x7f835015d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.029+0000 7f8355f0b700 1 -- 172.21.15.6:0/398029543 >> v2:172.21.15.175:3300/0 conn(0x7f835015d4d0 msgr2=0x7f835015d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.029+0000 7f8355f0b700 1 --2- 172.21.15.6:0/398029543 >> v2:172.21.15.175:3300/0 conn(0x7f835015d4d0 0x7f835015d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.029+0000 7f8355f0b700 1 -- 172.21.15.6:0/398029543 >> v1:172.21.15.6:6789/0 conn(0x7f83500b20e0 legacy=0x7f83500b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.029+0000 7f8355f0b700 1 -- 172.21.15.6:0/398029543 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83500c3ef0 con 0x7f8350159380 2023-10-06T02:21:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.029+0000 7f8354f09700 1 -- 172.21.15.6:0/398029543 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663495634 0 0) 0x7f83500cb6c0 con 0x7f83500b20e0 2023-10-06T02:21:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.029+0000 7f8355f0b700 1 --2- 172.21.15.6:0/398029543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8350159380 0x7f8350159750 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f83500c72b0 tx=0x7f83480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff2b8cfd0bf41eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:41.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.029+0000 7f8354f09700 1 -- 172.21.15.6:0/398029543 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8348009e80 con 0x7f8350159380 2023-10-06T02:21:41.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.029+0000 7f8354f09700 1 -- 172.21.15.6:0/398029543 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834800b820 con 0x7f8350159380 2023-10-06T02:21:41.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.029+0000 7f8354f09700 1 -- 172.21.15.6:0/398029543 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834800bba0 con 0x7f8350159380 2023-10-06T02:21:41.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.030+0000 7f835816f700 1 -- 172.21.15.6:0/398029543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8350159380 msgr2=0x7f8350159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:41.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.030+0000 7f835816f700 1 --2- 172.21.15.6:0/398029543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8350159380 0x7f8350159750 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f83500c72b0 tx=0x7f83480091a0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.030+0000 7f835816f700 1 -- 172.21.15.6:0/398029543 shutdown_connections 2023-10-06T02:21:41.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.030+0000 7f835816f700 1 --2- 172.21.15.6:0/398029543 >> v2:172.21.15.175:3300/0 conn(0x7f835015d4d0 0x7f835015d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.030+0000 7f835816f700 1 --2- 172.21.15.6:0/398029543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8350159380 0x7f8350159750 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.030+0000 7f835816f700 1 -- 172.21.15.6:0/398029543 >> 172.21.15.6:0/398029543 conn(0x7f8350068680 msgr2=0x7f8350068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:41.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.030+0000 7f835816f700 1 -- 172.21.15.6:0/398029543 shutdown_connections 2023-10-06T02:21:41.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.030+0000 7f835816f700 1 -- 172.21.15.6:0/398029543 wait complete. 2023-10-06T02:21:41.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.031+0000 7f835816f700 1 Processor -- start 2023-10-06T02:21:41.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.031+0000 7f835816f700 1 -- start start 2023-10-06T02:21:41.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f835816f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83500b20e0 0x7f8350155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f835816f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8350159380 0x7f83500c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f835816f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835015d4d0 0x7f83500d0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f835816f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83500c9370 con 0x7f835015d4d0 2023-10-06T02:21:41.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f835816f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83500c8480 con 0x7f83500b20e0 2023-10-06T02:21:41.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f835816f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83500c8760 con 0x7f8350159380 2023-10-06T02:21:41.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f835670c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835015d4d0 0x7f83500d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f835670c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835015d4d0 0x7f83500d0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39062/0 (socket says 172.21.15.6:39062) 2023-10-06T02:21:41.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f835670c700 1 -- 172.21.15.6:0/2799524596 learned_addr learned my addr 172.21.15.6:0/2799524596 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:41.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f8355f0b700 1 --2- 172.21.15.6:0/2799524596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83500b20e0 0x7f8350155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f835570a700 1 --2- 172.21.15.6:0/2799524596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8350159380 0x7f83500c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f835670c700 1 -- 172.21.15.6:0/2799524596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8350159380 msgr2=0x7f83500c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:41.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f835670c700 1 --2- 172.21.15.6:0/2799524596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8350159380 0x7f83500c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f835670c700 1 -- 172.21.15.6:0/2799524596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83500b20e0 msgr2=0x7f8350155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:41.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f835670c700 1 --2- 172.21.15.6:0/2799524596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83500b20e0 0x7f8350155ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f835670c700 1 -- 172.21.15.6:0/2799524596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8348009420 con 0x7f835015d4d0 2023-10-06T02:21:41.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f835570a700 1 --2- 172.21.15.6:0/2799524596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8350159380 0x7f83500c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:21:41.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.032+0000 7f835670c700 1 --2- 172.21.15.6:0/2799524596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835015d4d0 0x7f83500d0890 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f834000ceb0 tx=0x7f8340007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:41.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.033+0000 7f834dffb700 1 -- 172.21.15.6:0/2799524596 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834000ae40 con 0x7f835015d4d0 2023-10-06T02:21:41.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.033+0000 7f834dffb700 1 -- 172.21.15.6:0/2799524596 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8340016430 con 0x7f835015d4d0 2023-10-06T02:21:41.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.033+0000 7f835816f700 1 -- 172.21.15.6:0/2799524596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83500c8a40 con 0x7f835015d4d0 2023-10-06T02:21:41.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.033+0000 7f834dffb700 1 -- 172.21.15.6:0/2799524596 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83400167d0 con 0x7f835015d4d0 2023-10-06T02:21:41.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.033+0000 7f835816f700 1 -- 172.21.15.6:0/2799524596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83500c9000 con 0x7f835015d4d0 2023-10-06T02:21:41.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.034+0000 7f835816f700 1 -- 172.21.15.6:0/2799524596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83500b0e20 con 0x7f835015d4d0 2023-10-06T02:21:41.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.034+0000 7f834dffb700 1 -- 172.21.15.6:0/2799524596 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8340003020 con 0x7f835015d4d0 2023-10-06T02:21:41.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.035+0000 7f834dffb700 1 --2- 172.21.15.6:0/2799524596 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f833c066f30 0x7f833c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.035+0000 7f834dffb700 1 -- 172.21.15.6:0/2799524596 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f8340012070 con 0x7f835015d4d0 2023-10-06T02:21:41.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.035+0000 7f8355f0b700 1 --2- 172.21.15.6:0/2799524596 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f833c066f30 0x7f833c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.035+0000 7f8355f0b700 1 --2- 172.21.15.6:0/2799524596 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f833c066f30 0x7f833c0693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f83480093f0 tx=0x7f8348017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:41.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.039+0000 7f834dffb700 1 -- 172.21.15.6:0/2799524596 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8340052720 con 0x7f835015d4d0 2023-10-06T02:21:41.134 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:21:41.133+0000 7fcaacc27700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:21:41.180 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-06T02:21:41.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.280+0000 7f835816f700 1 -- 172.21.15.6:0/2799524596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83500c94b0 con 0x7f835015d4d0 2023-10-06T02:21:41.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.280+0000 7f834dffb700 1 -- 172.21.15.6:0/2799524596 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f8340055d40 con 0x7f835015d4d0 2023-10-06T02:21:41.282 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:21:41.282 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":63,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/400475961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":400475961},{"type":"v1","addr":"172.21.15.175:6837","nonce":400475961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6579,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/628657260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":628657260},{"type":"v1","addr":"172.21.15.6:6834","nonce":628657260}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:51.206714+0000","modified":"2023-10-06T02:21:40.079021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":16,"addr":"172.21.15.6:6835/1006897436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1006897436},{"type":"v1","addr":"172.21.15.6:6835","nonce":1006897436}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:21:41.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.282+0000 7f835816f700 1 -- 172.21.15.6:0/2799524596 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f833c066f30 msgr2=0x7f833c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:41.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.282+0000 7f835816f700 1 --2- 172.21.15.6:0/2799524596 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f833c066f30 0x7f833c0693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f83480093f0 tx=0x7f8348017000 comp rx=0 tx=0).stop 2023-10-06T02:21:41.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.282+0000 7f835816f700 1 -- 172.21.15.6:0/2799524596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835015d4d0 msgr2=0x7f83500d0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:41.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.282+0000 7f835816f700 1 --2- 172.21.15.6:0/2799524596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835015d4d0 0x7f83500d0890 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f834000ceb0 tx=0x7f8340007870 comp rx=0 tx=0).stop 2023-10-06T02:21:41.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.282+0000 7f835816f700 1 -- 172.21.15.6:0/2799524596 shutdown_connections 2023-10-06T02:21:41.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.282+0000 7f835816f700 1 --2- 172.21.15.6:0/2799524596 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f833c066f30 0x7f833c0693e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.282+0000 7f835816f700 1 --2- 172.21.15.6:0/2799524596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835015d4d0 0x7f83500d0890 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.282+0000 7f835816f700 1 --2- 172.21.15.6:0/2799524596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83500b20e0 0x7f8350155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.282+0000 7f835816f700 1 --2- 172.21.15.6:0/2799524596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8350159380 0x7f83500c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.282+0000 7f835816f700 1 -- 172.21.15.6:0/2799524596 >> 172.21.15.6:0/2799524596 conn(0x7f8350068680 msgr2=0x7f8350156b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:41.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.283+0000 7f835816f700 1 -- 172.21.15.6:0/2799524596 shutdown_connections 2023-10-06T02:21:41.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.283+0000 7f835816f700 1 -- 172.21.15.6:0/2799524596 wait complete. 2023-10-06T02:21:41.285 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 63 2023-10-06T02:21:41.698 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:20:51.206714+0000', 'modified': '2023-10-06T02:21:40.079021+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6207}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6207': {'gid': 6207, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.6:6835/1006897436', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 1006897436}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 1006897436}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:21:41.698 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:21:41.698 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:21:41.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.821+0000 7ff5311fa700 1 Processor -- start 2023-10-06T02:21:41.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.821+0000 7ff5311fa700 1 -- start start 2023-10-06T02:21:41.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.822+0000 7ff5311fa700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff52c155b70 0x7ff52c0ad510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.822+0000 7ff5311fa700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff52c0c9080 0x7ff52c0ada50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.822+0000 7ff5311fa700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52c0abd90 con 0x7ff52c155f40 2023-10-06T02:21:41.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.822+0000 7ff5311fa700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52c0ad230 con 0x7ff52c0c9080 2023-10-06T02:21:41.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.822+0000 7ff5311fa700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52c0c96e0 con 0x7ff52c155b70 2023-10-06T02:21:41.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.822+0000 7ff52b59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff52c0c9080 0x7ff52c0ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.822+0000 7ff52b59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff52c0c9080 0x7ff52c0ada50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39070/0 (socket says 172.21.15.6:39070) 2023-10-06T02:21:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.822+0000 7ff52b59e700 1 -- 172.21.15.6:0/1090761574 learned_addr learned my addr 172.21.15.6:0/1090761574 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.822+0000 7ff52ad9d700 1 --2- 172.21.15.6:0/1090761574 >> v2:172.21.15.175:3300/0 conn(0x7ff52c155b70 0x7ff52c0ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.822+0000 7ff52b59e700 1 -- 172.21.15.6:0/1090761574 >> v2:172.21.15.175:3300/0 conn(0x7ff52c155b70 msgr2=0x7ff52c0ad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.822+0000 7ff52b59e700 1 --2- 172.21.15.6:0/1090761574 >> v2:172.21.15.175:3300/0 conn(0x7ff52c155b70 0x7ff52c0ad510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.822+0000 7ff52b59e700 1 -- 172.21.15.6:0/1090761574 >> v1:172.21.15.175:6789/0 conn(0x7ff52c155f40 legacy=0x7ff52c0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.822+0000 7ff52b59e700 1 -- 172.21.15.6:0/1090761574 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c0c99c0 con 0x7ff52c0c9080 2023-10-06T02:21:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.823+0000 7ff52b59e700 1 --2- 172.21.15.6:0/1090761574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff52c0c9080 0x7ff52c0ada50 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ff52c065ff0 tx=0x7ff524009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81514f7c7d2fffae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.823+0000 7ff529d9b700 1 -- 172.21.15.6:0/1090761574 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff524009e70 con 0x7ff52c0c9080 2023-10-06T02:21:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.823+0000 7ff529d9b700 1 -- 172.21.15.6:0/1090761574 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52400ca00 con 0x7ff52c0c9080 2023-10-06T02:21:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.823+0000 7ff529d9b700 1 -- 172.21.15.6:0/1090761574 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52400cda0 con 0x7ff52c0c9080 2023-10-06T02:21:41.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.823+0000 7ff5311fa700 1 -- 172.21.15.6:0/1090761574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff52c0c9080 msgr2=0x7ff52c0ada50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:41.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.823+0000 7ff5311fa700 1 --2- 172.21.15.6:0/1090761574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff52c0c9080 0x7ff52c0ada50 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ff52c065ff0 tx=0x7ff524009250 comp rx=0 tx=0).stop 2023-10-06T02:21:41.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.823+0000 7ff5311fa700 1 -- 172.21.15.6:0/1090761574 shutdown_connections 2023-10-06T02:21:41.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.823+0000 7ff5311fa700 1 --2- 172.21.15.6:0/1090761574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff52c0c9080 0x7ff52c0ada50 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.823+0000 7ff5311fa700 1 --2- 172.21.15.6:0/1090761574 >> v2:172.21.15.175:3300/0 conn(0x7ff52c155b70 0x7ff52c0ad510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.823+0000 7ff5311fa700 1 -- 172.21.15.6:0/1090761574 >> 172.21.15.6:0/1090761574 conn(0x7ff52c069110 msgr2=0x7ff52c0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:41.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.823+0000 7ff5311fa700 1 -- 172.21.15.6:0/1090761574 shutdown_connections 2023-10-06T02:21:41.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.823+0000 7ff5311fa700 1 -- 172.21.15.6:0/1090761574 wait complete. 2023-10-06T02:21:41.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.824+0000 7ff5311fa700 1 Processor -- start 2023-10-06T02:21:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.825+0000 7ff5311fa700 1 -- start start 2023-10-06T02:21:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.825+0000 7ff5311fa700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff52c0c9080 0x7ff52c140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.825+0000 7ff5311fa700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff52c155b70 0x7ff52c13d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.825+0000 7ff5311fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff52c155f40 0x7ff52c13e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.825+0000 7ff5311fa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c13d7f0 con 0x7ff52c155f40 2023-10-06T02:21:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.825+0000 7ff5311fa700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c13dd10 con 0x7ff52c155b70 2023-10-06T02:21:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.825+0000 7ff5311fa700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c13f4e0 con 0x7ff52c0c9080 2023-10-06T02:21:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.825+0000 7ff52b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff52c155f40 0x7ff52c13e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.825+0000 7ff52b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff52c155f40 0x7ff52c13e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39080/0 (socket says 172.21.15.6:39080) 2023-10-06T02:21:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.825+0000 7ff52b59e700 1 -- 172.21.15.6:0/2108307258 learned_addr learned my addr 172.21.15.6:0/2108307258 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.826+0000 7ff52a59c700 1 --2- 172.21.15.6:0/2108307258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff52c155b70 0x7ff52c13d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.826+0000 7ff52ad9d700 1 --2- 172.21.15.6:0/2108307258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff52c0c9080 0x7ff52c140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.826+0000 7ff52b59e700 1 -- 172.21.15.6:0/2108307258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff52c0c9080 msgr2=0x7ff52c140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.826+0000 7ff52b59e700 1 --2- 172.21.15.6:0/2108307258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff52c0c9080 0x7ff52c140580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.826+0000 7ff52b59e700 1 -- 172.21.15.6:0/2108307258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff52c155b70 msgr2=0x7ff52c13d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.826+0000 7ff52b59e700 1 --2- 172.21.15.6:0/2108307258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff52c155b70 0x7ff52c13d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.826+0000 7ff52b59e700 1 -- 172.21.15.6:0/2108307258 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5240094f0 con 0x7ff52c155f40 2023-10-06T02:21:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.826+0000 7ff52b59e700 1 --2- 172.21.15.6:0/2108307258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff52c155f40 0x7ff52c13e970 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ff52c067c40 tx=0x7ff524018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.826+0000 7ff522ffd700 1 -- 172.21.15.6:0/2108307258 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff524009e70 con 0x7ff52c155f40 2023-10-06T02:21:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.826+0000 7ff522ffd700 1 -- 172.21.15.6:0/2108307258 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff524010600 con 0x7ff52c155f40 2023-10-06T02:21:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.826+0000 7ff5311fa700 1 -- 172.21.15.6:0/2108307258 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52c13f7c0 con 0x7ff52c155f40 2023-10-06T02:21:41.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.826+0000 7ff522ffd700 1 -- 172.21.15.6:0/2108307258 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5240109e0 con 0x7ff52c155f40 2023-10-06T02:21:41.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.826+0000 7ff5311fa700 1 -- 172.21.15.6:0/2108307258 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52c13fd80 con 0x7ff52c155f40 2023-10-06T02:21:41.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.827+0000 7ff522ffd700 1 -- 172.21.15.6:0/2108307258 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5240233f0 con 0x7ff52c155f40 2023-10-06T02:21:41.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.828+0000 7ff522ffd700 1 --2- 172.21.15.6:0/2108307258 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff50c066f30 0x7ff50c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.828+0000 7ff522ffd700 1 -- 172.21.15.6:0/2108307258 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7ff5240862c0 con 0x7ff52c155f40 2023-10-06T02:21:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.828+0000 7ff52ad9d700 1 --2- 172.21.15.6:0/2108307258 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff50c066f30 0x7ff50c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.829+0000 7ff52ad9d700 1 --2- 172.21.15.6:0/2108307258 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff50c066f30 0x7ff50c0693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff52c06edc0 tx=0x7ff51c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.830+0000 7ff53a4f2b80 1 Processor -- start 2023-10-06T02:21:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.830+0000 7ff53a4f2b80 1 -- start start 2023-10-06T02:21:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff53a4f2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee2840 0x564e90ee2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff53a4f2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90ee3cc0 0x564e90f326c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff53a4f2b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90f32c00 0x564e90f33050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff53a4f2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e90e39a70 con 0x564e90ee2840 2023-10-06T02:21:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff53a4f2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e90e37270 con 0x564e90ee3cc0 2023-10-06T02:21:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff53a4f2b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e90e33060 con 0x564e90f32c00 2023-10-06T02:21:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff52ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee2840 0x564e90ee2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff52ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee2840 0x564e90ee2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39084/0 (socket says 172.21.15.6:39084) 2023-10-06T02:21:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff52ad9d700 1 -- 172.21.15.6:0/476987126 learned_addr learned my addr 172.21.15.6:0/476987126 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff52b59e700 1 --2- 172.21.15.6:0/476987126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90f32c00 0x564e90f33050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff52a59c700 1 --2- 172.21.15.6:0/476987126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90ee3cc0 0x564e90f326c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff52ad9d700 1 -- 172.21.15.6:0/476987126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90f32c00 msgr2=0x564e90f33050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff52ad9d700 1 --2- 172.21.15.6:0/476987126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90f32c00 0x564e90f33050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff52ad9d700 1 -- 172.21.15.6:0/476987126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90ee3cc0 msgr2=0x564e90f326c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff52ad9d700 1 --2- 172.21.15.6:0/476987126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90ee3cc0 0x564e90f326c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff52ad9d700 1 -- 172.21.15.6:0/476987126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e90ccd270 con 0x564e90ee2840 2023-10-06T02:21:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff52a59c700 1 --2- 172.21.15.6:0/476987126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90ee3cc0 0x564e90f326c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff52b59e700 1 --2- 172.21.15.6:0/476987126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90f32c00 0x564e90f33050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:21:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff52ad9d700 1 --2- 172.21.15.6:0/476987126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee2840 0x564e90ee2c10 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0168a0 tx=0x7ff51c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173158ba74ab6eda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff50bfff700 1 -- 172.21.15.6:0/476987126 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c017400 con 0x564e90ee2840 2023-10-06T02:21:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff50bfff700 1 -- 172.21.15.6:0/476987126 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c00f050 con 0x564e90ee2840 2023-10-06T02:21:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.831+0000 7ff50bfff700 1 -- 172.21.15.6:0/476987126 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c017770 con 0x564e90ee2840 2023-10-06T02:21:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.832+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/476987126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee2840 msgr2=0x564e90ee2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.832+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/476987126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee2840 0x564e90ee2c10 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0168a0 tx=0x7ff51c018000 comp rx=0 tx=0).stop 2023-10-06T02:21:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.832+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/476987126 shutdown_connections 2023-10-06T02:21:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.832+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/476987126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90f32c00 0x564e90f33050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.832+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/476987126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee2840 0x564e90ee2c10 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.832+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/476987126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90ee3cc0 0x564e90f326c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.832+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/476987126 >> 172.21.15.6:0/476987126 conn(0x564e90ee4160 msgr2=0x564e90ee4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.832+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/476987126 shutdown_connections 2023-10-06T02:21:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.832+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/476987126 wait complete. 2023-10-06T02:21:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.833+0000 7ff53a4f2b80 1 -- start start 2023-10-06T02:21:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.833+0000 7ff53a4f2b80 1 Processor -- start 2023-10-06T02:21:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.834+0000 7ff53a4f2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee2840 0x564e90f24ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.834+0000 7ff53a4f2b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90ee3cc0 0x564e90f253e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.834+0000 7ff53a4f2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90f32c00 0x564e90f2aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.834+0000 7ff53a4f2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e90dde890 con 0x564e90ee2840 2023-10-06T02:21:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.834+0000 7ff53a4f2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e90df9ea0 con 0x564e90f32c00 2023-10-06T02:21:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.834+0000 7ff53a4f2b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e90cb5e30 con 0x564e90ee3cc0 2023-10-06T02:21:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.834+0000 7ff53a4f2b80 10 client.0 _ll_register_callbacks cb 0x564e90ea5e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:21:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.834+0000 7ff52ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee2840 0x564e90f24ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.834+0000 7ff52ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee2840 0x564e90f24ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39086/0 (socket says 172.21.15.6:39086) 2023-10-06T02:21:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.834+0000 7ff52ad9d700 1 -- 172.21.15.6:0/1101449236 learned_addr learned my addr 172.21.15.6:0/1101449236 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.834+0000 7ff52b59e700 1 --2- 172.21.15.6:0/1101449236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90f32c00 0x564e90f2aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.834+0000 7ff52a59c700 1 --2- 172.21.15.6:0/1101449236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90ee3cc0 0x564e90f253e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.834+0000 7ff52ad9d700 1 -- 172.21.15.6:0/1101449236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90ee3cc0 msgr2=0x564e90f253e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.834+0000 7ff52ad9d700 1 --2- 172.21.15.6:0/1101449236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90ee3cc0 0x564e90f253e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.834+0000 7ff52ad9d700 1 -- 172.21.15.6:0/1101449236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90f32c00 msgr2=0x564e90f2aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.834+0000 7ff52ad9d700 1 --2- 172.21.15.6:0/1101449236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90f32c00 0x564e90f2aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.834+0000 7ff52ad9d700 1 -- 172.21.15.6:0/1101449236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51c016550 con 0x564e90ee2840 2023-10-06T02:21:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.835+0000 7ff52ad9d700 1 --2- 172.21.15.6:0/1101449236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee2840 0x564e90f24ea0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff51c023040 tx=0x7ff51c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31929973d8e76dae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:41.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.835+0000 7ff5097fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:21:41.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.835+0000 7ff5097fa700 1 -- 172.21.15.6:0/1101449236 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c0177e0 con 0x564e90ee2840 2023-10-06T02:21:41.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.835+0000 7ff5097fa700 1 -- 172.21.15.6:0/1101449236 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7ff51c031070 con 0x564e90ee2840 2023-10-06T02:21:41.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.835+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/1101449236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564e90ed7940 con 0x564e90ee2840 2023-10-06T02:21:41.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.835+0000 7ff5097fa700 1 -- 172.21.15.6:0/1101449236 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff51c035630 con 0x564e90ee2840 2023-10-06T02:21:41.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.835+0000 7ff53a4f2b80 10 client.6612 fetch_fsmap learned FSMap version 63 2023-10-06T02:21:41.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.835+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/1101449236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x564e90c6ffe0 con 0x564e90ee2840 2023-10-06T02:21:41.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.835+0000 7ff5097fa700 1 -- 172.21.15.6:0/1101449236 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564e90ed7940 con 0x564e90ee2840 2023-10-06T02:21:41.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.835+0000 7ff5097fa700 1 -- 172.21.15.6:0/1101449236 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 63) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff51c035790 con 0x564e90ee2840 2023-10-06T02:21:41.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.835+0000 7ff53a4f2b80 10 client.6612 fetch_fsmap finished waiting for FSMap version 63 2023-10-06T02:21:41.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.835+0000 7ff53a4f2b80 10 client.6612 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:21:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.835+0000 7ff53a4f2b80 20 client.6612 populate_metadata read hostname 'smithi006' 2023-10-06T02:21:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.835+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/1101449236 >> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] conn(0x564e90f248c0 0x564e90f2b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.835+0000 7ff53a4f2b80 4 client.6612 mds_command: new command op to 6207 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:21:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.835+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/1101449236 --> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e90eb4870 con 0x564e90f248c0 2023-10-06T02:21:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.835+0000 7ff52a59c700 1 --2- 172.21.15.6:0/1101449236 >> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] conn(0x564e90f248c0 0x564e90f2b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.836+0000 7ff5097fa700 10 client.6612 ms_handle_connect on v2:172.21.15.6:6833/1006897436 2023-10-06T02:21:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.836+0000 7ff52a59c700 1 --2- 172.21.15.6:0/1101449236 >> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] conn(0x564e90f248c0 0x564e90f2b8f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6633f81a232fbeb server_cookie=be7e31c323f43d9a in_seq=0 out_seq=0 2023-10-06T02:21:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.836+0000 7ff5097fa700 1 -- 172.21.15.6:0/1101449236 <== mds.0 v2:172.21.15.6:6833/1006897436 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564e90eb4870 con 0x564e90f248c0 2023-10-06T02:21:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.836+0000 7ff5097fa700 10 client.6612 handle_command_reply: tid=0 2023-10-06T02:21:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.836+0000 7ff53a4f2b80 1 client.6612 shutdown 2023-10-06T02:21:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.836+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/1101449236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee2840 msgr2=0x564e90f24ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.836+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/1101449236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee2840 0x564e90f24ea0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff51c023040 tx=0x7ff51c021000 comp rx=0 tx=0).stop 2023-10-06T02:21:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.837+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/1101449236 shutdown_connections 2023-10-06T02:21:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.837+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/1101449236 >> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] conn(0x564e90f248c0 0x564e90f2b8f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.837+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/1101449236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90f32c00 0x564e90f2aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.837+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/1101449236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee2840 0x564e90f24ea0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.837+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/1101449236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90ee3cc0 0x564e90f253e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.837+0000 7ff5097fa700 0 client.6612 ms_handle_reset on v2:172.21.15.6:6833/1006897436 2023-10-06T02:21:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.837+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/1101449236 >> 172.21.15.6:0/1101449236 conn(0x564e90ee4160 msgr2=0x564e90f0ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.837+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/1101449236 shutdown_connections 2023-10-06T02:21:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.837+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/1101449236 wait complete. 2023-10-06T02:21:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.837+0000 7ff53a4f2b80 20 client.6612 trim_cache size 0 max 16384 2023-10-06T02:21:41.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.853+0000 7ff53a4f2b80 1 Processor -- start 2023-10-06T02:21:41.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.854+0000 7ff53a4f2b80 1 -- start start 2023-10-06T02:21:41.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.854+0000 7ff53a4f2b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90ee2840 0x564e90ee4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.854+0000 7ff53a4f2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee3cc0 0x564e90f23370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.854+0000 7ff53a4f2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90f32c00 0x564e90f238b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.854+0000 7ff53a4f2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e90f2cc20 con 0x564e90ee3cc0 2023-10-06T02:21:41.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.854+0000 7ff53a4f2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e90edd620 con 0x564e90f32c00 2023-10-06T02:21:41.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.854+0000 7ff53a4f2b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e90ec2380 con 0x564e90ee2840 2023-10-06T02:21:41.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.854+0000 7ff52a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee3cc0 0x564e90f23370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.854+0000 7ff52a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee3cc0 0x564e90f23370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39094/0 (socket says 172.21.15.6:39094) 2023-10-06T02:21:41.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.854+0000 7ff52a59c700 1 -- 172.21.15.6:0/3350108719 learned_addr learned my addr 172.21.15.6:0/3350108719 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:41.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.855+0000 7ff52a59c700 1 -- 172.21.15.6:0/3350108719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90ee2840 msgr2=0x564e90ee4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:41.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.855+0000 7ff52a59c700 1 --2- 172.21.15.6:0/3350108719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90ee2840 0x564e90ee4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.855+0000 7ff52a59c700 1 -- 172.21.15.6:0/3350108719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90f32c00 msgr2=0x564e90f238b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:41.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.855+0000 7ff52a59c700 1 --2- 172.21.15.6:0/3350108719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90f32c00 0x564e90f238b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.855+0000 7ff52a59c700 1 -- 172.21.15.6:0/3350108719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e90e01780 con 0x564e90ee3cc0 2023-10-06T02:21:41.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.855+0000 7ff52a59c700 1 --2- 172.21.15.6:0/3350108719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee3cc0 0x564e90f23370 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x564e90ee1380 tx=0x7ff51400a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb2eda9db591d6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:41.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.855+0000 7ff520ff9700 1 -- 172.21.15.6:0/3350108719 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff514019a20 con 0x564e90ee3cc0 2023-10-06T02:21:41.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.855+0000 7ff520ff9700 1 -- 172.21.15.6:0/3350108719 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff514019b80 con 0x564e90ee3cc0 2023-10-06T02:21:41.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.855+0000 7ff520ff9700 1 -- 172.21.15.6:0/3350108719 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff514019d10 con 0x564e90ee3cc0 2023-10-06T02:21:41.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.855+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/3350108719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee3cc0 msgr2=0x564e90f23370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:41.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.855+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/3350108719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee3cc0 0x564e90f23370 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x564e90ee1380 tx=0x7ff51400a040 comp rx=0 tx=0).stop 2023-10-06T02:21:41.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.855+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/3350108719 shutdown_connections 2023-10-06T02:21:41.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.855+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/3350108719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90f32c00 0x564e90f238b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.855+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/3350108719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90ee2840 0x564e90ee4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.855+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/3350108719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90ee3cc0 0x564e90f23370 secure :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0x564e90ee1380 tx=0x7ff51400a040 comp rx=0 tx=0).stop 2023-10-06T02:21:41.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.855+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/3350108719 >> 172.21.15.6:0/3350108719 conn(0x564e90ee4160 msgr2=0x564e90edb280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:41.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.855+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/3350108719 shutdown_connections 2023-10-06T02:21:41.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.856+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/3350108719 wait complete. 2023-10-06T02:21:41.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.856+0000 7ff53a4f2b80 1 -- start start 2023-10-06T02:21:41.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.856+0000 7ff53a4f2b80 1 Processor -- start 2023-10-06T02:21:41.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.857+0000 7ff53a4f2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90ee2840 0x564e90f087a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.857+0000 7ff53a4f2b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90f32c00 0x564e90f08ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.857+0000 7ff53a4f2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90f91ac0 0x564e90f41260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.857+0000 7ff53a4f2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e90f0cdc0 con 0x564e90f91ac0 2023-10-06T02:21:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.857+0000 7ff53a4f2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e90ee1b10 con 0x564e90ee2840 2023-10-06T02:21:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.857+0000 7ff53a4f2b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e90f316d0 con 0x564e90f32c00 2023-10-06T02:21:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.857+0000 7ff53a4f2b80 10 client.0 _ll_register_callbacks cb 0x564e90ea5e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:21:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.857+0000 7ff52b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90f91ac0 0x564e90f41260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.857+0000 7ff52b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90f91ac0 0x564e90f41260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39104/0 (socket says 172.21.15.6:39104) 2023-10-06T02:21:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.857+0000 7ff52b59e700 1 -- 172.21.15.6:0/4216675316 learned_addr learned my addr 172.21.15.6:0/4216675316 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:21:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.857+0000 7ff52a59c700 1 --2- 172.21.15.6:0/4216675316 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90f32c00 0x564e90f08ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.857+0000 7ff52ad9d700 1 --2- 172.21.15.6:0/4216675316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90ee2840 0x564e90f087a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.857+0000 7ff52b59e700 1 -- 172.21.15.6:0/4216675316 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90f32c00 msgr2=0x564e90f08ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.857+0000 7ff52b59e700 1 --2- 172.21.15.6:0/4216675316 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90f32c00 0x564e90f08ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.857+0000 7ff52b59e700 1 -- 172.21.15.6:0/4216675316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90ee2840 msgr2=0x564e90f087a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:21:41.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.857+0000 7ff52b59e700 1 --2- 172.21.15.6:0/4216675316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90ee2840 0x564e90f087a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.857+0000 7ff52b59e700 1 -- 172.21.15.6:0/4216675316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51400f040 con 0x564e90f91ac0 2023-10-06T02:21:41.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.858+0000 7ff52b59e700 1 --2- 172.21.15.6:0/4216675316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90f91ac0 0x564e90f41260 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff524019fd0 tx=0x7ff524059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ccd6356ad45676 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:21:41.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.858+0000 7ff5097fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:21:41.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.858+0000 7ff5097fa700 1 -- 172.21.15.6:0/4216675316 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52405de10 con 0x564e90f91ac0 2023-10-06T02:21:41.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.858+0000 7ff5097fa700 1 -- 172.21.15.6:0/4216675316 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7ff524055210 con 0x564e90f91ac0 2023-10-06T02:21:41.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.858+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/4216675316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff51c00f050 con 0x564e90f91ac0 2023-10-06T02:21:41.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.858+0000 7ff5097fa700 1 -- 172.21.15.6:0/4216675316 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5240570d0 con 0x564e90f91ac0 2023-10-06T02:21:41.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.858+0000 7ff53a4f2b80 10 client.6618 fetch_fsmap learned FSMap version 63 2023-10-06T02:21:41.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.858+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/4216675316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x564e90de8470 con 0x564e90f91ac0 2023-10-06T02:21:41.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.858+0000 7ff5097fa700 1 -- 172.21.15.6:0/4216675316 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff524082020 con 0x564e90f91ac0 2023-10-06T02:21:41.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.858+0000 7ff5097fa700 1 -- 172.21.15.6:0/4216675316 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 63) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff524056360 con 0x564e90f91ac0 2023-10-06T02:21:41.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.858+0000 7ff53a4f2b80 10 client.6618 fetch_fsmap finished waiting for FSMap version 63 2023-10-06T02:21:41.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.858+0000 7ff53a4f2b80 10 client.6618 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:21:41.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.858+0000 7ff53a4f2b80 20 client.6618 populate_metadata read hostname 'smithi006' 2023-10-06T02:21:41.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.858+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/4216675316 >> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] conn(0x564e90f41a20 0x564e90f30390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:21:41.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.858+0000 7ff53a4f2b80 4 client.6618 mds_command: new command op to 6207 tid=0[{"prefix": "status"}] 2023-10-06T02:21:41.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.858+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/4216675316 --> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564e90dd5e00 con 0x564e90f41a20 2023-10-06T02:21:41.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.858+0000 7ff52ad9d700 1 --2- 172.21.15.6:0/4216675316 >> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] conn(0x564e90f41a20 0x564e90f30390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:41.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.859+0000 7ff5097fa700 10 client.6618 ms_handle_connect on v2:172.21.15.6:6833/1006897436 2023-10-06T02:21:41.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.859+0000 7ff52ad9d700 1 --2- 172.21.15.6:0/4216675316 >> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] conn(0x564e90f41a20 0x564e90f30390 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce3e93c5a3d39d server_cookie=b7f6bb146f105b51 in_seq=0 out_seq=0 2023-10-06T02:21:41.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.859+0000 7ff5097fa700 1 -- 172.21.15.6:0/4216675316 <== mds.0 v2:172.21.15.6:6833/1006897436 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x564e90dd5e00 con 0x564e90f41a20 2023-10-06T02:21:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.859+0000 7ff5097fa700 10 client.6618 handle_command_reply: tid=0 2023-10-06T02:21:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.859+0000 7ff53a4f2b80 1 client.6618 shutdown 2023-10-06T02:21:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.859+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/4216675316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90f91ac0 msgr2=0x564e90f41260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.859+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/4216675316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90f91ac0 0x564e90f41260 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff524019fd0 tx=0x7ff524059040 comp rx=0 tx=0).stop 2023-10-06T02:21:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.859+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/4216675316 shutdown_connections 2023-10-06T02:21:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.859+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/4216675316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e90f91ac0 0x564e90f41260 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.859+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/4216675316 >> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] conn(0x564e90f41a20 0x564e90f30390 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.859+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/4216675316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e90ee2840 0x564e90f087a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.859+0000 7ff5097fa700 0 client.6618 ms_handle_reset on v2:172.21.15.6:6833/1006897436 2023-10-06T02:21:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.859+0000 7ff53a4f2b80 1 --2- 172.21.15.6:0/4216675316 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e90f32c00 0x564e90f08ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.859+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/4216675316 >> 172.21.15.6:0/4216675316 conn(0x564e90ee4160 msgr2=0x564e90f23370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.859+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/4216675316 shutdown_connections 2023-10-06T02:21:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.859+0000 7ff53a4f2b80 1 -- 172.21.15.6:0/4216675316 wait complete. 2023-10-06T02:21:41.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.859+0000 7ff53a4f2b80 20 client.6618 trim_cache size 0 max 16384 2023-10-06T02:21:41.868 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:21:41.868 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:21:41.868 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:21:41.868 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 6207, 2023-10-06T02:21:41.868 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:21:41.868 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:21:41.868 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:21:41.868 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 4.7881786450000003, 2023-10-06T02:21:41.869 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 63, 2023-10-06T02:21:41.869 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 70, 2023-10-06T02:21:41.869 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 70, 2023-10-06T02:21:41.869 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 56.100534496000002 2023-10-06T02:21:41.869 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:21:41.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.860+0000 7ff5311fa700 1 -- 172.21.15.6:0/2108307258 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff50c066f30 msgr2=0x7ff50c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:41.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.860+0000 7ff5311fa700 1 --2- 172.21.15.6:0/2108307258 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff50c066f30 0x7ff50c0693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff52c06edc0 tx=0x7ff51c00b040 comp rx=0 tx=0).stop 2023-10-06T02:21:41.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.860+0000 7ff5311fa700 1 -- 172.21.15.6:0/2108307258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff52c155f40 msgr2=0x7ff52c13e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:21:41.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.860+0000 7ff5311fa700 1 --2- 172.21.15.6:0/2108307258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff52c155f40 0x7ff52c13e970 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ff52c067c40 tx=0x7ff524018000 comp rx=0 tx=0).stop 2023-10-06T02:21:41.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.860+0000 7ff5311fa700 1 -- 172.21.15.6:0/2108307258 shutdown_connections 2023-10-06T02:21:41.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.860+0000 7ff5311fa700 1 --2- 172.21.15.6:0/2108307258 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff50c066f30 0x7ff50c0693e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.860+0000 7ff5311fa700 1 --2- 172.21.15.6:0/2108307258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff52c155f40 0x7ff52c13e970 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.860+0000 7ff5311fa700 1 --2- 172.21.15.6:0/2108307258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff52c0c9080 0x7ff52c140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.860+0000 7ff5311fa700 1 --2- 172.21.15.6:0/2108307258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff52c155b70 0x7ff52c13d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:21:41.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.860+0000 7ff5311fa700 1 -- 172.21.15.6:0/2108307258 >> 172.21.15.6:0/2108307258 conn(0x7ff52c069110 msgr2=0x7ff52c0b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:21:41.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.860+0000 7ff5311fa700 1 -- 172.21.15.6:0/2108307258 shutdown_connections 2023-10-06T02:21:41.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:41.860+0000 7ff5311fa700 1 -- 172.21.15.6:0/2108307258 wait complete. 2023-10-06T02:21:44.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:44.583+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=BANNER_CONNECTING pgs=15 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:44.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:44.583+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 crc :-1 s=SESSION_RECONNECTING pgs=15 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_session_reset received session reset full=1 2023-10-06T02:21:44.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:44.583+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 crc :-1 s=SESSION_RECONNECTING pgs=15 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).reset_session 2023-10-06T02:21:44.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:44.583+0000 7fc371ffb700 0 client.6531 ms_handle_remote_reset on v2:172.21.15.6:6832/3777949337 2023-10-06T02:21:44.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:44.583+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2023-10-06T02:21:44.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:44.583+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:21:44.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:44.583+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:21:44.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:44.583+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-10-06T02:21:49.572 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:21:49.575 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:21:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:59.596+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:21:59.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:59.596+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2023-10-06T02:21:59.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:59.596+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:21:59.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:59.596+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:21:59.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:21:59.596+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-10-06T02:22:14.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:14.603+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:14.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:14.603+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2023-10-06T02:22:14.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:14.603+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:22:14.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:14.603+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:22:14.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:14.603+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-10-06T02:22:19.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:22:19.696 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:22:29.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:29.619+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:29.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:29.619+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2023-10-06T02:22:29.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:29.619+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:22:29.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:29.619+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:22:29.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:29.619+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-10-06T02:22:44.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:44.635+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:44.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:44.635+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2023-10-06T02:22:44.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:44.635+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:22:44.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:44.635+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:22:44.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:44.635+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-10-06T02:22:49.762 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:22:49.765 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:22:59.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:59.650+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:59.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:59.650+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2023-10-06T02:22:59.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:59.650+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:22:59.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:59.650+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:22:59.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:22:59.650+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-10-06T02:23:14.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:14.662+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:14.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:14.662+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2023-10-06T02:23:14.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:14.662+0000 7fc392ffd700 1 -- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 msgr2=0x5567766a7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:23:14.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:14.662+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:23:14.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:14.662+0000 7fc392ffd700 1 --2- 172.21.15.6:0/2705567037 >> [v2:172.21.15.6:6832/3777949337,v1:172.21.15.6:6834/3777949337] conn(0x556776758350 0x5567766a7e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-10-06T02:23:18.993 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-06T02:23:18.994 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:23:19.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.124+0000 7f2f9b4b8700 1 Processor -- start 2023-10-06T02:23:19.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.124+0000 7f2f9b4b8700 1 -- start start 2023-10-06T02:23:19.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.125+0000 7f2f9b4b8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f940688d0 0x7f2f940afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.125+0000 7f2f9b4b8700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2f940af390 0x7f2f941594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.125+0000 7f2f9b4b8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f940b2330 con 0x7f2f940b0140 2023-10-06T02:23:19.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.125+0000 7f2f9b4b8700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f940ac720 con 0x7f2f940af390 2023-10-06T02:23:19.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.125+0000 7f2f9b4b8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f940b25d0 con 0x7f2f940688d0 2023-10-06T02:23:19.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.125+0000 7f2f99cb5700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2f940b0140 0x7f2f94158db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59604/0 (socket says 172.21.15.6:59604) 2023-10-06T02:23:19.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.125+0000 7f2f99cb5700 1 -- 172.21.15.6:0/1103267431 learned_addr learned my addr 172.21.15.6:0/1103267431 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:19.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.125+0000 7f2f994b4700 1 -- 172.21.15.6:0/1103267431 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424908137 0 0) 0x7f2f940b2330 con 0x7f2f940b0140 2023-10-06T02:23:19.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f994b4700 1 -- 172.21.15.6:0/1103267431 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f7c003570 con 0x7f2f940b0140 2023-10-06T02:23:19.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f9a4b6700 1 --2- 172.21.15.6:0/1103267431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f940688d0 0x7f2f940afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f9acb7700 1 --2- 172.21.15.6:0/1103267431 >> v2:172.21.15.175:3300/0 conn(0x7f2f940af390 0x7f2f941594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f994b4700 1 -- 172.21.15.6:0/1103267431 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1431907613 0 0) 0x7f2f7c003570 con 0x7f2f940b0140 2023-10-06T02:23:19.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f994b4700 1 -- 172.21.15.6:0/1103267431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f940688d0 msgr2=0x7f2f940afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:19.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f994b4700 1 --2- 172.21.15.6:0/1103267431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f940688d0 0x7f2f940afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f994b4700 1 -- 172.21.15.6:0/1103267431 >> v2:172.21.15.175:3300/0 conn(0x7f2f940af390 msgr2=0x7f2f941594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:19.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f994b4700 1 --2- 172.21.15.6:0/1103267431 >> v2:172.21.15.175:3300/0 conn(0x7f2f940af390 0x7f2f941594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f994b4700 1 -- 172.21.15.6:0/1103267431 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f940b28b0 con 0x7f2f940b0140 2023-10-06T02:23:19.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f994b4700 1 -- 172.21.15.6:0/1103267431 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f2f880015f0 con 0x7f2f940b0140 2023-10-06T02:23:19.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f994b4700 1 -- 172.21.15.6:0/1103267431 >> v1:172.21.15.6:6789/0 conn(0x7f2f940b0140 legacy=0x7f2f94158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f994b4700 1 --2- 172.21.15.6:0/1103267431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f7c003a60 0x7f2f7c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f994b4700 1 --2- 172.21.15.6:0/1103267431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7c004810 0x7f2f7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f994b4700 1 --2- 172.21.15.6:0/1103267431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f940688d0 0x7f2f7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f994b4700 1 -- 172.21.15.6:0/1103267431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f940ac720 con 0x7f2f7c004810 2023-10-06T02:23:19.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f994b4700 1 -- 172.21.15.6:0/1103267431 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f940b25d0 con 0x7f2f7c003a60 2023-10-06T02:23:19.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f994b4700 1 -- 172.21.15.6:0/1103267431 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c00ba60 con 0x7f2f940688d0 2023-10-06T02:23:19.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f99cb5700 1 --2- 172.21.15.6:0/1103267431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7c004810 0x7f2f7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f9a4b6700 1 --2- 172.21.15.6:0/1103267431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f7c003a60 0x7f2f7c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f9acb7700 1 --2- 172.21.15.6:0/1103267431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f940688d0 0x7f2f7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f99cb5700 1 -- 172.21.15.6:0/1103267431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f940688d0 msgr2=0x7f2f7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f99cb5700 1 --2- 172.21.15.6:0/1103267431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f940688d0 0x7f2f7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f99cb5700 1 -- 172.21.15.6:0/1103267431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f7c003a60 msgr2=0x7f2f7c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f99cb5700 1 --2- 172.21.15.6:0/1103267431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f7c003a60 0x7f2f7c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f99cb5700 1 -- 172.21.15.6:0/1103267431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c003570 con 0x7f2f7c004810 2023-10-06T02:23:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.126+0000 7f2f9acb7700 1 --2- 172.21.15.6:0/1103267431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f940688d0 0x7f2f7c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.127+0000 7f2f99cb5700 1 --2- 172.21.15.6:0/1103267431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7c004810 0x7f2f7c004c80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800c3f0 tx=0x7f2f88007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940933d0802f0f29 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.127+0000 7f2f994b4700 1 -- 172.21.15.6:0/1103267431 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800cc80 con 0x7f2f7c004810 2023-10-06T02:23:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.127+0000 7f2f994b4700 1 -- 172.21.15.6:0/1103267431 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8800cde0 con 0x7f2f7c004810 2023-10-06T02:23:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.127+0000 7f2f994b4700 1 -- 172.21.15.6:0/1103267431 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88007320 con 0x7f2f7c004810 2023-10-06T02:23:19.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.127+0000 7f2f9b4b8700 1 -- 172.21.15.6:0/1103267431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7c004810 msgr2=0x7f2f7c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.127+0000 7f2f9b4b8700 1 --2- 172.21.15.6:0/1103267431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7c004810 0x7f2f7c004c80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800c3f0 tx=0x7f2f88007920 comp rx=0 tx=0).stop 2023-10-06T02:23:19.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.127+0000 7f2f9acb7700 1 -- 172.21.15.6:0/1103267431 reap_dead start 2023-10-06T02:23:19.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.127+0000 7f2f9b4b8700 1 -- 172.21.15.6:0/1103267431 shutdown_connections 2023-10-06T02:23:19.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.127+0000 7f2f9b4b8700 1 -- 172.21.15.6:0/1103267431 >> 172.21.15.6:0/1103267431 conn(0x7f2f94096240 msgr2=0x7f2f94069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:19.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.127+0000 7f2f9b4b8700 1 -- 172.21.15.6:0/1103267431 shutdown_connections 2023-10-06T02:23:19.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.127+0000 7f2f9b4b8700 1 -- 172.21.15.6:0/1103267431 wait complete. 2023-10-06T02:23:19.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.129+0000 7f2f9b4b8700 1 Processor -- start 2023-10-06T02:23:19.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.129+0000 7f2f9b4b8700 1 -- start start 2023-10-06T02:23:19.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.129+0000 7f2f9b4b8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f7c004810 0x7f2f9414eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.129+0000 7f2f9b4b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f9414f0b0 0x7f2f94157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.129+0000 7f2f9b4b8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f94158470 0x7f2f941507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.129+0000 7f2f9b4b8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9409aa60 con 0x7f2f9414f0b0 2023-10-06T02:23:19.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.129+0000 7f2f9b4b8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f94152660 con 0x7f2f94158470 2023-10-06T02:23:19.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.129+0000 7f2f9b4b8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f941521d0 con 0x7f2f7c004810 2023-10-06T02:23:19.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.129+0000 7f2f99cb5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f9414f0b0 0x7f2f94157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.129+0000 7f2f99cb5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f9414f0b0 0x7f2f94157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33860/0 (socket says 172.21.15.6:33860) 2023-10-06T02:23:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.129+0000 7f2f99cb5700 1 -- 172.21.15.6:0/336791899 learned_addr learned my addr 172.21.15.6:0/336791899 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.130+0000 7f2f9a4b6700 1 --2- 172.21.15.6:0/336791899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f7c004810 0x7f2f9414eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.130+0000 7f2f9acb7700 1 --2- 172.21.15.6:0/336791899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f94158470 0x7f2f941507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.130+0000 7f2f99cb5700 1 -- 172.21.15.6:0/336791899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f7c004810 msgr2=0x7f2f9414eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.130+0000 7f2f99cb5700 1 --2- 172.21.15.6:0/336791899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f7c004810 0x7f2f9414eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.130+0000 7f2f99cb5700 1 -- 172.21.15.6:0/336791899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f94158470 msgr2=0x7f2f941507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.130+0000 7f2f99cb5700 1 --2- 172.21.15.6:0/336791899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f94158470 0x7f2f941507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.130+0000 7f2f99cb5700 1 -- 172.21.15.6:0/336791899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f941588c0 con 0x7f2f9414f0b0 2023-10-06T02:23:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.130+0000 7f2f99cb5700 1 --2- 172.21.15.6:0/336791899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f9414f0b0 0x7f2f94157f30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2f88005b50 tx=0x7f2f88015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.130+0000 7f2f927fc700 1 -- 172.21.15.6:0/336791899 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800cc80 con 0x7f2f9414f0b0 2023-10-06T02:23:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.130+0000 7f2f927fc700 1 -- 172.21.15.6:0/336791899 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f88007690 con 0x7f2f9414f0b0 2023-10-06T02:23:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.130+0000 7f2f9b4b8700 1 -- 172.21.15.6:0/336791899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f941515c0 con 0x7f2f9414f0b0 2023-10-06T02:23:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.130+0000 7f2f927fc700 1 -- 172.21.15.6:0/336791899 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88002d80 con 0x7f2f9414f0b0 2023-10-06T02:23:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.130+0000 7f2f9b4b8700 1 -- 172.21.15.6:0/336791899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f94151b80 con 0x7f2f9414f0b0 2023-10-06T02:23:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.131+0000 7f2f9b4b8700 1 -- 172.21.15.6:0/336791899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f94152360 con 0x7f2f9414f0b0 2023-10-06T02:23:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.132+0000 7f2f927fc700 1 -- 172.21.15.6:0/336791899 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f88019030 con 0x7f2f9414f0b0 2023-10-06T02:23:19.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.132+0000 7f2f927fc700 1 --2- 172.21.15.6:0/336791899 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f80066f30 0x7f2f800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.132+0000 7f2f927fc700 1 -- 172.21.15.6:0/336791899 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f2f88085ae0 con 0x7f2f9414f0b0 2023-10-06T02:23:19.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.132+0000 7f2f9a4b6700 1 --2- 172.21.15.6:0/336791899 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f80066f30 0x7f2f800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.133+0000 7f2f9a4b6700 1 --2- 172.21.15.6:0/336791899 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f80066f30 0x7f2f800693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2f840094d0 tx=0x7f2f8400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:19.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.137+0000 7f2f927fc700 1 -- 172.21.15.6:0/336791899 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f880529d0 con 0x7f2f9414f0b0 2023-10-06T02:23:19.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.379+0000 7f2f9b4b8700 1 -- 172.21.15.6:0/336791899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2f940b2b90 con 0x7f2f9414f0b0 2023-10-06T02:23:19.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.380+0000 7f2f927fc700 1 -- 172.21.15.6:0/336791899 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v63) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2f88017070 con 0x7f2f9414f0b0 2023-10-06T02:23:19.381 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:23:19.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.382+0000 7f2f9b4b8700 1 -- 172.21.15.6:0/336791899 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f80066f30 msgr2=0x7f2f800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.382+0000 7f2f9b4b8700 1 --2- 172.21.15.6:0/336791899 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f80066f30 0x7f2f800693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2f840094d0 tx=0x7f2f8400b040 comp rx=0 tx=0).stop 2023-10-06T02:23:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.382+0000 7f2f9b4b8700 1 -- 172.21.15.6:0/336791899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f9414f0b0 msgr2=0x7f2f94157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.382+0000 7f2f9b4b8700 1 --2- 172.21.15.6:0/336791899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f9414f0b0 0x7f2f94157f30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2f88005b50 tx=0x7f2f88015000 comp rx=0 tx=0).stop 2023-10-06T02:23:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.382+0000 7f2f9b4b8700 1 -- 172.21.15.6:0/336791899 shutdown_connections 2023-10-06T02:23:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.382+0000 7f2f9b4b8700 1 --2- 172.21.15.6:0/336791899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f94158470 0x7f2f941507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.382+0000 7f2f9b4b8700 1 --2- 172.21.15.6:0/336791899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f7c004810 0x7f2f9414eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.382+0000 7f2f9b4b8700 1 --2- 172.21.15.6:0/336791899 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f80066f30 0x7f2f800693e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.382+0000 7f2f9b4b8700 1 --2- 172.21.15.6:0/336791899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f9414f0b0 0x7f2f94157f30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.382+0000 7f2f9b4b8700 1 -- 172.21.15.6:0/336791899 >> 172.21.15.6:0/336791899 conn(0x7f2f94096240 msgr2=0x7f2f94158b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.382+0000 7f2f9b4b8700 1 -- 172.21.15.6:0/336791899 shutdown_connections 2023-10-06T02:23:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:19.382+0000 7f2f9b4b8700 1 -- 172.21.15.6:0/336791899 wait complete. 2023-10-06T02:23:19.395 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:23:19.395 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:23:19.395 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:23:19.395 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:23:19.395 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:19.395 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:23:19.395 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:23:19.396 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:23:19.396 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:23:19.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:19.396 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:23:19.411 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:23:19.411 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:23:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:23:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:23:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:19.412 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:23:19.412 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:23:19.412 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:23:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:23:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:23:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42147sec preferred_lft 42147sec 2023-10-06T02:23:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:23:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:19.413 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:23:19.413 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:23:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:23:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:23:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:19.414 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:23:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:23:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:23:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:19.414 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:23:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:23:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:23:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:19.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:19.415 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:23:19.475 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:23:19.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:19.477 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:23:19.533 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:23:19.533 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:23:19.533 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:23:19.533 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:23:19.534 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:23:19.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:19.534 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:23:19.534 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:23:19.534 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:23:19.534 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:23:19.534 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:23:19.534 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:23:19.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:19.636 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:23:19.651 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:23:19.651 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:23:19.651 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:23:19.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:19.651 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:23:19.716 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:23:19.716 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:23:19.716 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:19.771 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:23:19.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:23:19.771 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:19.826 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:23:19.834 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:23:19.869 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:23:19.892 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:23:19.892 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:23:19.980 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:23:19.980 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:23:19.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:19.981 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:23:20.036 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:23:20.036 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:23:20.078 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:23:20.103 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:23:20.103 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:23:20.161 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:23:20.160+0000 7f78b9048540 -1 init, newargv = 0x55ab92543a90 newargc=15 2023-10-06T02:23:20.162 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[116149]: starting ceph client 2023-10-06T02:23:20.167 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[116149]: starting fuse 2023-10-06T02:23:20.170 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:23:20.172 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:23:20.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:20.172 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:23:20.227 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:23:20.227 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:23:20.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:23:20.228 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:23:20.228 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:23:20.228 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:23:20.228 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:23:20.228 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:23:20.228 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:23:20.228 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:23:20.228 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:23:20.228 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:23:20.228 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:23:20.228 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:23:20.228 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:23:20.228 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:23:20.229 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:23:20.229 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:23:20.229 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:23:20.229 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:23:20.229 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:23:20.229 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:23:20.229 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:23:20.229 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:23:20.229 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:23:20.229 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:23:20.229 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:23:20.230 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:23:20.230 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:23:20.350 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.116149.asok 2023-10-06T02:23:20.532 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.116149.asok 2023-10-06T02:23:20.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:20.533 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.116149.asok status 2023-10-06T02:23:20.687 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:23:20.687 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:23:20.687 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:23:20.687 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:23:20.688 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:23:20.688 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:23:20.688 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:23:20.688 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "116149", 2023-10-06T02:23:20.688 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:23:20.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:20.688 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:23:20.688 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:23:20.688 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 6630, 2023-10-06T02:23:20.688 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:23:20.688 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:23:20.688 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:23:20.689 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 6630 2023-10-06T02:23:20.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:20.689 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:23:20.689 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:23:20.689 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:23:20.689 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2723645330 2023-10-06T02:23:20.689 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:20.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:20.689 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:23:20.689 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:23:20.689 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:23:20.689 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2723645330 2023-10-06T02:23:20.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:20.690 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.6630 192.168.0.1:0/2723645330", 2023-10-06T02:23:20.690 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/2723645330", 2023-10-06T02:23:20.690 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:23:20.690 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 63, 2023-10-06T02:23:20.690 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 70, 2023-10-06T02:23:20.690 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:23:20.690 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:23:20.690 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:23:20.690 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:23:20.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:20.698 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:23:20.698 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:20.713 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:23:20.713 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:20.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:20.714 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:20.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:20.779 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat a/ && find a/') 2023-10-06T02:23:20.850 INFO:teuthology.orchestra.run.smithi006.stdout: File: a/ 2023-10-06T02:23:20.850 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 0 Blocks: 1 IO Block: 4096 directory 2023-10-06T02:23:20.850 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 2fh/47d Inode: 1099511627776 Links: 4 2023-10-06T02:23:20.851 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0775/drwxrwxr-x) Uid: ( 1000/ ubuntu) Gid: ( 1275/ ubuntu) 2023-10-06T02:23:20.851 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:fusefs_t:s0 2023-10-06T02:23:20.851 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-10-06 02:21:04.130785771 +0000 2023-10-06T02:23:20.851 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-10-06 02:21:04.137436059 +0000 2023-10-06T02:23:20.851 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-10-06 02:21:04.137436059 +0000 2023-10-06T02:23:20.851 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-10-06T02:23:20.863 INFO:teuthology.orchestra.run.smithi006.stdout:a/ 2023-10-06T02:23:20.863 INFO:teuthology.orchestra.run.smithi006.stdout:a/c 2023-10-06T02:23:20.863 INFO:teuthology.orchestra.run.smithi006.stdout:a/c/d 2023-10-06T02:23:20.863 INFO:teuthology.orchestra.run.smithi006.stdout:a/b 2023-10-06T02:23:20.863 INFO:teuthology.orchestra.run.smithi006.stdout:a/b/d 2023-10-06T02:23:20.864 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2023-10-06T02:23:21.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.022+0000 7fafd0765700 1 Processor -- start 2023-10-06T02:23:21.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.022+0000 7fafd0765700 1 -- start start 2023-10-06T02:23:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.023+0000 7fafd0765700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fafc8086ff0 0x7fafc8087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.023+0000 7fafd0765700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fafc80b21b0 0x7fafc80b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.023+0000 7fafd0765700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc80b2b70 con 0x7fafc815a030 2023-10-06T02:23:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.023+0000 7fafd0765700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc80b0cf0 con 0x7fafc80b21b0 2023-10-06T02:23:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.023+0000 7fafd0765700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc80879b0 con 0x7fafc8086ff0 2023-10-06T02:23:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.023+0000 7fafced02700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fafc80b21b0 0x7fafc80b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.023+0000 7fafce501700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fafc815a030 0x7fafc815a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59612/0 (socket says 172.21.15.6:59612) 2023-10-06T02:23:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.023+0000 7fafce501700 1 -- 172.21.15.6:0/336087689 learned_addr learned my addr 172.21.15.6:0/336087689 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.024+0000 7fafcdd00700 1 --2- 172.21.15.6:0/336087689 >> v2:172.21.15.175:3300/0 conn(0x7fafc8086ff0 0x7fafc8087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.024+0000 7fafced02700 1 -- 172.21.15.6:0/336087689 >> v2:172.21.15.175:3300/0 conn(0x7fafc8086ff0 msgr2=0x7fafc8087470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.024+0000 7fafced02700 1 --2- 172.21.15.6:0/336087689 >> v2:172.21.15.175:3300/0 conn(0x7fafc8086ff0 0x7fafc8087470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.024+0000 7fafced02700 1 -- 172.21.15.6:0/336087689 >> v1:172.21.15.6:6789/0 conn(0x7fafc815a030 legacy=0x7fafc815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.024+0000 7fafced02700 1 -- 172.21.15.6:0/336087689 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc80afc50 con 0x7fafc80b21b0 2023-10-06T02:23:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.024+0000 7fafced02700 1 --2- 172.21.15.6:0/336087689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc80b21b0 0x7fafc80b2630 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fafc80b1fa0 tx=0x7fafb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e28527cba15c51 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.024+0000 7fafcd4ff700 1 -- 172.21.15.6:0/336087689 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8009e80 con 0x7fafc80b21b0 2023-10-06T02:23:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.024+0000 7fafcd4ff700 1 -- 172.21.15.6:0/336087689 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb800b820 con 0x7fafc80b21b0 2023-10-06T02:23:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.024+0000 7fafcd4ff700 1 -- 172.21.15.6:0/336087689 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb800bba0 con 0x7fafc80b21b0 2023-10-06T02:23:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.024+0000 7fafd0765700 1 -- 172.21.15.6:0/336087689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc80b21b0 msgr2=0x7fafc80b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.024+0000 7fafd0765700 1 --2- 172.21.15.6:0/336087689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc80b21b0 0x7fafc80b2630 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fafc80b1fa0 tx=0x7fafb80091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.025+0000 7fafd0765700 1 -- 172.21.15.6:0/336087689 shutdown_connections 2023-10-06T02:23:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.025+0000 7fafd0765700 1 --2- 172.21.15.6:0/336087689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc80b21b0 0x7fafc80b2630 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.025+0000 7fafd0765700 1 --2- 172.21.15.6:0/336087689 >> v2:172.21.15.175:3300/0 conn(0x7fafc8086ff0 0x7fafc8087470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.025+0000 7fafd0765700 1 -- 172.21.15.6:0/336087689 >> 172.21.15.6:0/336087689 conn(0x7fafc8068680 msgr2=0x7fafc8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.025+0000 7fafd0765700 1 -- 172.21.15.6:0/336087689 shutdown_connections 2023-10-06T02:23:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.025+0000 7fafd0765700 1 -- 172.21.15.6:0/336087689 wait complete. 2023-10-06T02:23:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.026+0000 7fafd0765700 1 Processor -- start 2023-10-06T02:23:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.026+0000 7fafd0765700 1 -- start start 2023-10-06T02:23:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.026+0000 7fafd0765700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc8086ff0 0x7fafc80b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.026+0000 7fafd0765700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafc80b21b0 0x7fafc80af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.026+0000 7fafd0765700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafc815a030 0x7fafc816da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.026+0000 7fafd0765700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc815c5e0 con 0x7fafc8086ff0 2023-10-06T02:23:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.026+0000 7fafd0765700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc80b5bd0 con 0x7fafc80b21b0 2023-10-06T02:23:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.026+0000 7fafd0765700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc80b5eb0 con 0x7fafc815a030 2023-10-06T02:23:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.026+0000 7fafce501700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc8086ff0 0x7fafc80b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.026+0000 7fafce501700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc8086ff0 0x7fafc80b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33868/0 (socket says 172.21.15.6:33868) 2023-10-06T02:23:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.027+0000 7fafce501700 1 -- 172.21.15.6:0/2145330135 learned_addr learned my addr 172.21.15.6:0/2145330135 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.027+0000 7fafcdd00700 1 --2- 172.21.15.6:0/2145330135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafc80b21b0 0x7fafc80af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.027+0000 7fafced02700 1 --2- 172.21.15.6:0/2145330135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafc815a030 0x7fafc816da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.027+0000 7fafce501700 1 -- 172.21.15.6:0/2145330135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafc815a030 msgr2=0x7fafc816da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.027+0000 7fafce501700 1 --2- 172.21.15.6:0/2145330135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafc815a030 0x7fafc816da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.027+0000 7fafce501700 1 -- 172.21.15.6:0/2145330135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafc80b21b0 msgr2=0x7fafc80af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.027+0000 7fafce501700 1 --2- 172.21.15.6:0/2145330135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafc80b21b0 0x7fafc80af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.027+0000 7fafce501700 1 -- 172.21.15.6:0/2145330135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb8009420 con 0x7fafc8086ff0 2023-10-06T02:23:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.027+0000 7fafcdd00700 1 --2- 172.21.15.6:0/2145330135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafc80b21b0 0x7fafc80af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.027+0000 7fafced02700 1 --2- 172.21.15.6:0/2145330135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafc815a030 0x7fafc816da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.027+0000 7fafce501700 1 --2- 172.21.15.6:0/2145330135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc8086ff0 0x7fafc80b3090 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fafc000cc70 tx=0x7fafc0001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.027+0000 7fafc67fc700 1 -- 172.21.15.6:0/2145330135 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc000ce80 con 0x7fafc8086ff0 2023-10-06T02:23:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.027+0000 7fafc67fc700 1 -- 172.21.15.6:0/2145330135 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc000ab70 con 0x7fafc8086ff0 2023-10-06T02:23:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.027+0000 7fafd0765700 1 -- 172.21.15.6:0/2145330135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc815c880 con 0x7fafc8086ff0 2023-10-06T02:23:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.027+0000 7fafc67fc700 1 -- 172.21.15.6:0/2145330135 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00070f0 con 0x7fafc8086ff0 2023-10-06T02:23:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.027+0000 7fafd0765700 1 -- 172.21.15.6:0/2145330135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc80b6190 con 0x7fafc8086ff0 2023-10-06T02:23:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.028+0000 7fafc67fc700 1 -- 172.21.15.6:0/2145330135 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fafc0007520 con 0x7fafc8086ff0 2023-10-06T02:23:21.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.029+0000 7fafc67fc700 1 --2- 172.21.15.6:0/2145330135 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fafb4066f30 0x7fafb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.029+0000 7fafc67fc700 1 -- 172.21.15.6:0/2145330135 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fafc0084c80 con 0x7fafc8086ff0 2023-10-06T02:23:21.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.029+0000 7fafcdd00700 1 --2- 172.21.15.6:0/2145330135 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fafb4066f30 0x7fafb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.030+0000 7fafcdd00700 1 --2- 172.21.15.6:0/2145330135 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fafb4066f30 0x7fafb40693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fafc80ca3f0 tx=0x7fafbc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:21.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.031+0000 7fafd9a5db80 1 Processor -- start 2023-10-06T02:23:21.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.031+0000 7fafd9a5db80 1 -- start start 2023-10-06T02:23:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafd9a5db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56bdca890 0x55c56bdcac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafd9a5db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56bdcbd10 0x55c56be1a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafd9a5db80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56be1ac50 0x55c56be1b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafd9a5db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c56bd21ac0 con 0x55c56bdcbd10 2023-10-06T02:23:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafd9a5db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c56bd1f2c0 con 0x55c56bdca890 2023-10-06T02:23:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafd9a5db80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c56bd1b0b0 con 0x55c56be1ac50 2023-10-06T02:23:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafcdd00700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56bdcbd10 0x55c56be1a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafce501700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56bdca890 0x55c56bdcac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafcdd00700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56bdcbd10 0x55c56be1a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33882/0 (socket says 172.21.15.6:33882) 2023-10-06T02:23:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafcdd00700 1 -- 172.21.15.6:0/865615878 learned_addr learned my addr 172.21.15.6:0/865615878 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafced02700 1 --2- 172.21.15.6:0/865615878 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56be1ac50 0x55c56be1b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafcdd00700 1 -- 172.21.15.6:0/865615878 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56be1ac50 msgr2=0x55c56be1b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafcdd00700 1 --2- 172.21.15.6:0/865615878 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56be1ac50 0x55c56be1b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafcdd00700 1 -- 172.21.15.6:0/865615878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56bdca890 msgr2=0x55c56bdcac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafcdd00700 1 --2- 172.21.15.6:0/865615878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56bdca890 0x55c56bdcac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafcdd00700 1 -- 172.21.15.6:0/865615878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c56bbb52c0 con 0x55c56bdcbd10 2023-10-06T02:23:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafcdd00700 1 --2- 172.21.15.6:0/865615878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56bdcbd10 0x55c56be1a710 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00ea60 tx=0x7fafbc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ab759a4abf6da9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.032+0000 7fafaf7fe700 1 -- 172.21.15.6:0/865615878 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc01d070 con 0x55c56bdcbd10 2023-10-06T02:23:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.033+0000 7fafaf7fe700 1 -- 172.21.15.6:0/865615878 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc00ed70 con 0x55c56bdcbd10 2023-10-06T02:23:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.033+0000 7fafaf7fe700 1 -- 172.21.15.6:0/865615878 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc00eee0 con 0x55c56bdcbd10 2023-10-06T02:23:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.033+0000 7fafd9a5db80 1 -- 172.21.15.6:0/865615878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56bdcbd10 msgr2=0x55c56be1a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.033+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/865615878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56bdcbd10 0x55c56be1a710 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00ea60 tx=0x7fafbc013000 comp rx=0 tx=0).stop 2023-10-06T02:23:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.033+0000 7fafd9a5db80 1 -- 172.21.15.6:0/865615878 shutdown_connections 2023-10-06T02:23:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.033+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/865615878 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56be1ac50 0x55c56be1b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.033+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/865615878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56bdca890 0x55c56bdcac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.033+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/865615878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56bdcbd10 0x55c56be1a710 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.033+0000 7fafd9a5db80 1 -- 172.21.15.6:0/865615878 >> 172.21.15.6:0/865615878 conn(0x55c56bdcc1b0 msgr2=0x55c56bdcc580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.033+0000 7fafd9a5db80 1 -- 172.21.15.6:0/865615878 shutdown_connections 2023-10-06T02:23:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.033+0000 7fafd9a5db80 1 -- 172.21.15.6:0/865615878 wait complete. 2023-10-06T02:23:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.034+0000 7fafd9a5db80 1 -- start start 2023-10-06T02:23:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.034+0000 7fafd9a5db80 1 Processor -- start 2023-10-06T02:23:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafd9a5db80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56bdca890 0x55c56be188d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafd9a5db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56bdcbd10 0x55c56bdf3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafd9a5db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56be1ac50 0x55c56be11280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafd9a5db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c56bcc68e0 con 0x55c56be1ac50 2023-10-06T02:23:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafd9a5db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c56bce1ef0 con 0x55c56bdcbd10 2023-10-06T02:23:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafd9a5db80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c56bb9de80 con 0x55c56bdca890 2023-10-06T02:23:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafd9a5db80 10 client.0 _ll_register_callbacks cb 0x55c56bd8dec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:23:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafced02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56be1ac50 0x55c56be11280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafced02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56be1ac50 0x55c56be11280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33892/0 (socket says 172.21.15.6:33892) 2023-10-06T02:23:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafced02700 1 -- 172.21.15.6:0/1225047921 learned_addr learned my addr 172.21.15.6:0/1225047921 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafce501700 1 --2- 172.21.15.6:0/1225047921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56bdca890 0x55c56be188d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafcdd00700 1 --2- 172.21.15.6:0/1225047921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56bdcbd10 0x55c56bdf3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafced02700 1 -- 172.21.15.6:0/1225047921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56bdca890 msgr2=0x55c56be188d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafced02700 1 --2- 172.21.15.6:0/1225047921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56bdca890 0x55c56be188d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafced02700 1 -- 172.21.15.6:0/1225047921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56bdcbd10 msgr2=0x55c56bdf3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafced02700 1 --2- 172.21.15.6:0/1225047921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56bdcbd10 0x55c56bdf3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafced02700 1 -- 172.21.15.6:0/1225047921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafbc00e6e0 con 0x55c56be1ac50 2023-10-06T02:23:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafce501700 1 --2- 172.21.15.6:0/1225047921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56bdca890 0x55c56be188d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafcdd00700 1 --2- 172.21.15.6:0/1225047921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56bdcbd10 0x55c56bdf3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafced02700 1 --2- 172.21.15.6:0/1225047921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56be1ac50 0x55c56be11280 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fafb8013000 tx=0x7fafb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48b61a2e3431671 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafacff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:23:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafacff9700 1 -- 172.21.15.6:0/1225047921 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8022070 con 0x55c56be1ac50 2023-10-06T02:23:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1225047921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c56bdbf990 con 0x55c56be1ac50 2023-10-06T02:23:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.035+0000 7fafacff9700 1 -- 172.21.15.6:0/1225047921 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fafb801b740 con 0x55c56be1ac50 2023-10-06T02:23:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.036+0000 7fafacff9700 1 -- 172.21.15.6:0/1225047921 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafb801bb50 con 0x55c56be1ac50 2023-10-06T02:23:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.036+0000 7fafd9a5db80 10 client.6645 fetch_fsmap learned FSMap version 63 2023-10-06T02:23:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.036+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1225047921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55c56bb58030 con 0x55c56be1ac50 2023-10-06T02:23:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.036+0000 7fafacff9700 1 -- 172.21.15.6:0/1225047921 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c56bdbf990 con 0x55c56be1ac50 2023-10-06T02:23:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.036+0000 7fafacff9700 1 -- 172.21.15.6:0/1225047921 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 63) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fafb801bcb0 con 0x55c56be1ac50 2023-10-06T02:23:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.036+0000 7fafd9a5db80 10 client.6645 fetch_fsmap finished waiting for FSMap version 63 2023-10-06T02:23:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.036+0000 7fafd9a5db80 10 client.6645 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-06T02:23:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.036+0000 7fafd9a5db80 20 client.6645 populate_metadata read hostname 'smithi006' 2023-10-06T02:23:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.036+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/1225047921 >> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] conn(0x55c56be17a20 0x55c56be11cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.036+0000 7fafd9a5db80 4 client.6645 mds_command: new command op to 6207 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:23:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.036+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1225047921 --> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c56bd9c8c0 con 0x55c56be17a20 2023-10-06T02:23:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.036+0000 7fafce501700 1 --2- 172.21.15.6:0/1225047921 >> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] conn(0x55c56be17a20 0x55c56be11cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.036+0000 7fafce501700 1 --2- 172.21.15.6:0/1225047921 >> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] conn(0x55c56be17a20 0x55c56be11cb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99d796e5cb1aa server_cookie=6233280010433cf9 in_seq=0 out_seq=0 2023-10-06T02:23:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.036+0000 7fafacff9700 10 client.6645 ms_handle_connect on v2:172.21.15.6:6833/1006897436 2023-10-06T02:23:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.037+0000 7fafacff9700 1 -- 172.21.15.6:0/1225047921 <== mds.0 v2:172.21.15.6:6833/1006897436 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c56bd9c8c0 con 0x55c56be17a20 2023-10-06T02:23:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.037+0000 7fafacff9700 10 client.6645 handle_command_reply: tid=0 2023-10-06T02:23:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.037+0000 7fafd9a5db80 1 client.6645 shutdown 2023-10-06T02:23:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.037+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1225047921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56be1ac50 msgr2=0x55c56be11280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.037+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/1225047921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56be1ac50 0x55c56be11280 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fafb8013000 tx=0x7fafb8017000 comp rx=0 tx=0).stop 2023-10-06T02:23:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.037+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1225047921 shutdown_connections 2023-10-06T02:23:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.037+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/1225047921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56be1ac50 0x55c56be11280 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.037+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/1225047921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56bdca890 0x55c56be188d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.037+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/1225047921 >> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] conn(0x55c56be17a20 0x55c56be11cb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.037+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/1225047921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56bdcbd10 0x55c56bdf3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.037+0000 7fafacff9700 0 client.6645 ms_handle_reset on v2:172.21.15.6:6833/1006897436 2023-10-06T02:23:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.037+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1225047921 >> 172.21.15.6:0/1225047921 conn(0x55c56bdcc1b0 msgr2=0x55c56bdcb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.037+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1225047921 shutdown_connections 2023-10-06T02:23:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.037+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1225047921 wait complete. 2023-10-06T02:23:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.037+0000 7fafd9a5db80 20 client.6645 trim_cache size 0 max 16384 2023-10-06T02:23:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.051+0000 7fafd9a5db80 1 Processor -- start 2023-10-06T02:23:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.052+0000 7fafd9a5db80 1 -- start start 2023-10-06T02:23:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.052+0000 7fafd9a5db80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56bdca890 0x55c56be0e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.052+0000 7fafd9a5db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56bdcbd10 0x55c56be10860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.052+0000 7fafd9a5db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56be1ac50 0x55c56bdf28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.052+0000 7fafd9a5db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c56be1a0a0 con 0x55c56bdcbd10 2023-10-06T02:23:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.052+0000 7fafd9a5db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c56bdcbb80 con 0x55c56be1ac50 2023-10-06T02:23:21.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.052+0000 7fafd9a5db80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c56bdf3500 con 0x55c56bdca890 2023-10-06T02:23:21.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.052+0000 7fafcdd00700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56bdcbd10 0x55c56be10860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.052+0000 7fafcdd00700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56bdcbd10 0x55c56be10860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33904/0 (socket says 172.21.15.6:33904) 2023-10-06T02:23:21.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.052+0000 7fafcdd00700 1 -- 172.21.15.6:0/1015944672 learned_addr learned my addr 172.21.15.6:0/1015944672 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:21.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafce501700 1 --2- 172.21.15.6:0/1015944672 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56bdca890 0x55c56be0e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafced02700 1 --2- 172.21.15.6:0/1015944672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56be1ac50 0x55c56bdf28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafcdd00700 1 -- 172.21.15.6:0/1015944672 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56bdca890 msgr2=0x55c56be0e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:21.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafcdd00700 1 --2- 172.21.15.6:0/1015944672 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56bdca890 0x55c56be0e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafcdd00700 1 -- 172.21.15.6:0/1015944672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56be1ac50 msgr2=0x55c56bdf28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:21.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafcdd00700 1 --2- 172.21.15.6:0/1015944672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56be1ac50 0x55c56bdf28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafcdd00700 1 -- 172.21.15.6:0/1015944672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c56bce97d0 con 0x55c56bdcbd10 2023-10-06T02:23:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafcdd00700 1 --2- 172.21.15.6:0/1015944672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56bdcbd10 0x55c56be10860 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009570 tx=0x7fafbc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac04d2843137b4e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafaffff700 1 -- 172.21.15.6:0/1015944672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0180d0 con 0x55c56bdcbd10 2023-10-06T02:23:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafaffff700 1 -- 172.21.15.6:0/1015944672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc018230 con 0x55c56bdcbd10 2023-10-06T02:23:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafaffff700 1 -- 172.21.15.6:0/1015944672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc018ae0 con 0x55c56bdcbd10 2023-10-06T02:23:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1015944672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56bdcbd10 msgr2=0x55c56be10860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/1015944672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56bdcbd10 0x55c56be10860 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009570 tx=0x7fafbc018000 comp rx=0 tx=0).stop 2023-10-06T02:23:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1015944672 shutdown_connections 2023-10-06T02:23:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/1015944672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56be1ac50 0x55c56bdf28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/1015944672 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56bdca890 0x55c56be0e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/1015944672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56bdcbd10 0x55c56be10860 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.053+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1015944672 >> 172.21.15.6:0/1015944672 conn(0x55c56bdcc1b0 msgr2=0x55c56bdc32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.054+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1015944672 shutdown_connections 2023-10-06T02:23:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.054+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1015944672 wait complete. 2023-10-06T02:23:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.054+0000 7fafd9a5db80 1 -- start start 2023-10-06T02:23:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.054+0000 7fafd9a5db80 1 Processor -- start 2023-10-06T02:23:21.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.055+0000 7fafd9a5db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56bdca890 0x55c56be14380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.055+0000 7fafd9a5db80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56bdcbd10 0x55c56be153c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.055+0000 7fafd9a5db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56be1ac50 0x55c56be6f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.055+0000 7fafd9a5db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c56bdf2050 con 0x55c56be1ac50 2023-10-06T02:23:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.055+0000 7fafd9a5db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c56be32690 con 0x55c56bdca890 2023-10-06T02:23:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.055+0000 7fafd9a5db80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c56be15900 con 0x55c56bdcbd10 2023-10-06T02:23:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.055+0000 7fafd9a5db80 10 client.0 _ll_register_callbacks cb 0x55c56bd8dec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:23:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.055+0000 7fafced02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56be1ac50 0x55c56be6f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.055+0000 7fafced02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56be1ac50 0x55c56be6f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33910/0 (socket says 172.21.15.6:33910) 2023-10-06T02:23:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.055+0000 7fafced02700 1 -- 172.21.15.6:0/1996408390 learned_addr learned my addr 172.21.15.6:0/1996408390 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.055+0000 7fafcdd00700 1 --2- 172.21.15.6:0/1996408390 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56bdcbd10 0x55c56be153c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.055+0000 7fafce501700 1 --2- 172.21.15.6:0/1996408390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56bdca890 0x55c56be14380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.055+0000 7fafced02700 1 -- 172.21.15.6:0/1996408390 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56bdcbd10 msgr2=0x55c56be153c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.055+0000 7fafced02700 1 --2- 172.21.15.6:0/1996408390 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56bdcbd10 0x55c56be153c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.055+0000 7fafced02700 1 -- 172.21.15.6:0/1996408390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56bdca890 msgr2=0x55c56be14380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.055+0000 7fafced02700 1 --2- 172.21.15.6:0/1996408390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56bdca890 0x55c56be14380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.055+0000 7fafced02700 1 -- 172.21.15.6:0/1996408390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafbc026040 con 0x55c56be1ac50 2023-10-06T02:23:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.056+0000 7fafced02700 1 --2- 172.21.15.6:0/1996408390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56be1ac50 0x55c56be6f8b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009110 tx=0x7fafb8022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a01e0d47ad6263 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.056+0000 7fafacff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:23:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.056+0000 7fafacff9700 1 -- 172.21.15.6:0/1996408390 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb801b740 con 0x55c56be1ac50 2023-10-06T02:23:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.056+0000 7fafacff9700 1 -- 172.21.15.6:0/1996408390 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fafb8000e40 con 0x55c56be1ac50 2023-10-06T02:23:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.056+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1996408390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fafbc00ed70 con 0x55c56be1ac50 2023-10-06T02:23:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.056+0000 7fafacff9700 1 -- 172.21.15.6:0/1996408390 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafb8011510 con 0x55c56be1ac50 2023-10-06T02:23:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.056+0000 7fafd9a5db80 10 client.6651 fetch_fsmap learned FSMap version 63 2023-10-06T02:23:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.056+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1996408390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55c56bcd04c0 con 0x55c56be1ac50 2023-10-06T02:23:21.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.056+0000 7fafacff9700 1 -- 172.21.15.6:0/1996408390 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc00ed70 con 0x55c56be1ac50 2023-10-06T02:23:21.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.056+0000 7fafacff9700 1 -- 172.21.15.6:0/1996408390 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 63) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fafb80116f0 con 0x55c56be1ac50 2023-10-06T02:23:21.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.056+0000 7fafd9a5db80 10 client.6651 fetch_fsmap finished waiting for FSMap version 63 2023-10-06T02:23:21.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.056+0000 7fafd9a5db80 10 client.6651 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-06T02:23:21.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.056+0000 7fafd9a5db80 20 client.6651 populate_metadata read hostname 'smithi006' 2023-10-06T02:23:21.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.056+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/1996408390 >> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] conn(0x55c56be6fdf0 0x55c56be701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.056+0000 7fafd9a5db80 4 client.6651 mds_command: new command op to 6207 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:23:21.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.056+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1996408390 --> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c56bcbde50 con 0x55c56be6fdf0 2023-10-06T02:23:21.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.056+0000 7fafce501700 1 --2- 172.21.15.6:0/1996408390 >> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] conn(0x55c56be6fdf0 0x55c56be701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.057+0000 7fafacff9700 10 client.6651 ms_handle_connect on v2:172.21.15.6:6833/1006897436 2023-10-06T02:23:21.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.057+0000 7fafce501700 1 --2- 172.21.15.6:0/1996408390 >> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] conn(0x55c56be6fdf0 0x55c56be701f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=727798dec9ce0b1f server_cookie=f03b5fd7d33904fe in_seq=0 out_seq=0 2023-10-06T02:23:21.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.070+0000 7fafacff9700 1 -- 172.21.15.6:0/1996408390 <== mds.0 v2:172.21.15.6:6833/1006897436 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c56bcbde50 con 0x55c56be6fdf0 2023-10-06T02:23:21.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.070+0000 7fafacff9700 10 client.6651 handle_command_reply: tid=0 2023-10-06T02:23:21.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.070+0000 7fafd9a5db80 1 client.6651 shutdown 2023-10-06T02:23:21.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.070+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1996408390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56be1ac50 msgr2=0x55c56be6f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.070+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/1996408390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56be1ac50 0x55c56be6f8b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009110 tx=0x7fafb8022000 comp rx=0 tx=0).stop 2023-10-06T02:23:21.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.070+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1996408390 shutdown_connections 2023-10-06T02:23:21.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.070+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/1996408390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c56be1ac50 0x55c56be6f8b0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.070+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/1996408390 >> [v2:172.21.15.6:6833/1006897436,v1:172.21.15.6:6835/1006897436] conn(0x55c56be6fdf0 0x55c56be701f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.070+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/1996408390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c56bdca890 0x55c56be14380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.070+0000 7fafd9a5db80 1 --2- 172.21.15.6:0/1996408390 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c56bdcbd10 0x55c56be153c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.070+0000 7fafacff9700 0 client.6651 ms_handle_reset on v2:172.21.15.6:6833/1006897436 2023-10-06T02:23:21.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.070+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1996408390 >> 172.21.15.6:0/1996408390 conn(0x55c56bdcc1b0 msgr2=0x55c56bdc32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:21.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.070+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1996408390 shutdown_connections 2023-10-06T02:23:21.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.070+0000 7fafd9a5db80 1 -- 172.21.15.6:0/1996408390 wait complete. 2023-10-06T02:23:21.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.070+0000 7fafd9a5db80 20 client.6651 trim_cache size 0 max 16384 2023-10-06T02:23:21.073 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:23:21.073 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "", 2023-10-06T02:23:21.073 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0 2023-10-06T02:23:21.073 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:23:21.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.071+0000 7fafd0765700 1 -- 172.21.15.6:0/2145330135 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fafb4066f30 msgr2=0x7fafb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.071+0000 7fafd0765700 1 --2- 172.21.15.6:0/2145330135 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fafb4066f30 0x7fafb40693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fafc80ca3f0 tx=0x7fafbc008040 comp rx=0 tx=0).stop 2023-10-06T02:23:21.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.071+0000 7fafd0765700 1 -- 172.21.15.6:0/2145330135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc8086ff0 msgr2=0x7fafc80b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.071+0000 7fafd0765700 1 --2- 172.21.15.6:0/2145330135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc8086ff0 0x7fafc80b3090 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fafc000cc70 tx=0x7fafc0001a30 comp rx=0 tx=0).stop 2023-10-06T02:23:21.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.071+0000 7fafd0765700 1 -- 172.21.15.6:0/2145330135 shutdown_connections 2023-10-06T02:23:21.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.071+0000 7fafd0765700 1 --2- 172.21.15.6:0/2145330135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafc815a030 0x7fafc816da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.071+0000 7fafd0765700 1 --2- 172.21.15.6:0/2145330135 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fafb4066f30 0x7fafb40693e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.071+0000 7fafd0765700 1 --2- 172.21.15.6:0/2145330135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc8086ff0 0x7fafc80b3090 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.071+0000 7fafd0765700 1 --2- 172.21.15.6:0/2145330135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafc80b21b0 0x7fafc80af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.071+0000 7fafd0765700 1 -- 172.21.15.6:0/2145330135 >> 172.21.15.6:0/2145330135 conn(0x7fafc8068680 msgr2=0x7fafc80cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:21.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.071+0000 7fafd0765700 1 -- 172.21.15.6:0/2145330135 shutdown_connections 2023-10-06T02:23:21.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.071+0000 7fafd0765700 1 -- 172.21.15.6:0/2145330135 wait complete. 2023-10-06T02:23:21.084 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:23:21.084 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:23:21.127 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:23:21.167 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:23:21.167 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:23:21.167 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:23:21.167 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:21.200 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[116149]: fuse finished with error 0 and tester_r 0 2023-10-06T02:23:21.201 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:23:21.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:21.202 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:23:21.355 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:23:21.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:21.355 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:23:21.372 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T02:23:21.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:23:21.373 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:23:21.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:21.374 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T02:23:21.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:23:21.388 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T02:23:21.389 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:23:21.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:21.389 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T02:23:21.430 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T02:23:21.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:23:21.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:21.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.548+0000 7fb4eca55700 1 Processor -- start 2023-10-06T02:23:21.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.548+0000 7fb4eca55700 1 -- start start 2023-10-06T02:23:21.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.549+0000 7fb4eca55700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4e815c900 0x7fb4e80b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.549+0000 7fb4eca55700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4e80d0530 0x7fb4e815abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.549+0000 7fb4eca55700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e80ce640 con 0x7fb4e8068d90 2023-10-06T02:23:21.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.549+0000 7fb4eca55700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e815a440 con 0x7fb4e815c900 2023-10-06T02:23:21.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.549+0000 7fb4eca55700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e815a9c0 con 0x7fb4e80d0530 2023-10-06T02:23:21.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.549+0000 7fb4e6d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4e815c900 0x7fb4e80b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.549+0000 7fb4e6d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4e815c900 0x7fb4e80b5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33926/0 (socket says 172.21.15.6:33926) 2023-10-06T02:23:21.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.549+0000 7fb4e6d9d700 1 -- 172.21.15.6:0/3437966846 learned_addr learned my addr 172.21.15.6:0/3437966846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:21.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.549+0000 7fb4e759e700 1 --2- 172.21.15.6:0/3437966846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4e80d0530 0x7fb4e815abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.549+0000 7fb4e6d9d700 1 -- 172.21.15.6:0/3437966846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4e80d0530 msgr2=0x7fb4e815abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:21.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.549+0000 7fb4e6d9d700 1 --2- 172.21.15.6:0/3437966846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4e80d0530 0x7fb4e815abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.549+0000 7fb4e6d9d700 1 -- 172.21.15.6:0/3437966846 >> v1:172.21.15.175:6789/0 conn(0x7fb4e8068d90 legacy=0x7fb4e80cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:21.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.549+0000 7fb4e6d9d700 1 -- 172.21.15.6:0/3437966846 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e80cccf0 con 0x7fb4e815c900 2023-10-06T02:23:21.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.549+0000 7fb4e6d9d700 1 --2- 172.21.15.6:0/3437966846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4e815c900 0x7fb4e80b5c00 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009f20 tx=0x7fb4d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2efa9e0a5351c206 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:21.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.550+0000 7fb4e5d9b700 1 -- 172.21.15.6:0/3437966846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d800e070 con 0x7fb4e815c900 2023-10-06T02:23:21.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.550+0000 7fb4e5d9b700 1 -- 172.21.15.6:0/3437966846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d800ba40 con 0x7fb4e815c900 2023-10-06T02:23:21.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.550+0000 7fb4e5d9b700 1 -- 172.21.15.6:0/3437966846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80092e0 con 0x7fb4e815c900 2023-10-06T02:23:21.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.550+0000 7fb4eca55700 1 -- 172.21.15.6:0/3437966846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4e815c900 msgr2=0x7fb4e80b5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.550+0000 7fb4eca55700 1 --2- 172.21.15.6:0/3437966846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4e815c900 0x7fb4e80b5c00 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009f20 tx=0x7fb4d8009840 comp rx=0 tx=0).stop 2023-10-06T02:23:21.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.550+0000 7fb4eca55700 1 -- 172.21.15.6:0/3437966846 shutdown_connections 2023-10-06T02:23:21.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.550+0000 7fb4eca55700 1 --2- 172.21.15.6:0/3437966846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4e80d0530 0x7fb4e815abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.550+0000 7fb4eca55700 1 --2- 172.21.15.6:0/3437966846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4e815c900 0x7fb4e80b5c00 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.550+0000 7fb4eca55700 1 -- 172.21.15.6:0/3437966846 >> 172.21.15.6:0/3437966846 conn(0x7fb4e806ac00 msgr2=0x7fb4e8068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:21.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.550+0000 7fb4eca55700 1 -- 172.21.15.6:0/3437966846 shutdown_connections 2023-10-06T02:23:21.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.550+0000 7fb4eca55700 1 -- 172.21.15.6:0/3437966846 wait complete. 2023-10-06T02:23:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.551+0000 7fb4eca55700 1 Processor -- start 2023-10-06T02:23:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.551+0000 7fb4eca55700 1 -- start start 2023-10-06T02:23:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.552+0000 7fb4eca55700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e8068d90 0x7fb4e816a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.552+0000 7fb4eca55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4e80d0530 0x7fb4e80cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.552+0000 7fb4eca55700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4e815c900 0x7fb4e80c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.552+0000 7fb4eca55700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80cb970 con 0x7fb4e80d0530 2023-10-06T02:23:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.552+0000 7fb4eca55700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e81466d0 con 0x7fb4e8068d90 2023-10-06T02:23:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.552+0000 7fb4eca55700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80c8620 con 0x7fb4e815c900 2023-10-06T02:23:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.552+0000 7fb4e659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4e80d0530 0x7fb4e80cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.552+0000 7fb4e659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4e80d0530 0x7fb4e80cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33936/0 (socket says 172.21.15.6:33936) 2023-10-06T02:23:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.552+0000 7fb4e659c700 1 -- 172.21.15.6:0/2864255319 learned_addr learned my addr 172.21.15.6:0/2864255319 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.552+0000 7fb4e6d9d700 1 --2- 172.21.15.6:0/2864255319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e8068d90 0x7fb4e816a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.552+0000 7fb4e759e700 1 --2- 172.21.15.6:0/2864255319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4e815c900 0x7fb4e80c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.553+0000 7fb4e659c700 1 -- 172.21.15.6:0/2864255319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4e815c900 msgr2=0x7fb4e80c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.553+0000 7fb4e659c700 1 --2- 172.21.15.6:0/2864255319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4e815c900 0x7fb4e80c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.553+0000 7fb4e659c700 1 -- 172.21.15.6:0/2864255319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e8068d90 msgr2=0x7fb4e816a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.553+0000 7fb4e659c700 1 --2- 172.21.15.6:0/2864255319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e8068d90 0x7fb4e816a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.553+0000 7fb4e659c700 1 -- 172.21.15.6:0/2864255319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d8009ae0 con 0x7fb4e80d0530 2023-10-06T02:23:21.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.553+0000 7fb4e659c700 1 --2- 172.21.15.6:0/2864255319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4e80d0530 0x7fb4e80cb430 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000c5c0 tx=0x7fb4d0007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:21.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.553+0000 7fb4deffd700 1 -- 172.21.15.6:0/2864255319 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0011590 con 0x7fb4e80d0530 2023-10-06T02:23:21.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.553+0000 7fb4deffd700 1 -- 172.21.15.6:0/2864255319 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d00116f0 con 0x7fb4e80d0530 2023-10-06T02:23:21.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.553+0000 7fb4deffd700 1 -- 172.21.15.6:0/2864255319 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0011ab0 con 0x7fb4e80d0530 2023-10-06T02:23:21.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.553+0000 7fb4eca55700 1 -- 172.21.15.6:0/2864255319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e80c7bb0 con 0x7fb4e80d0530 2023-10-06T02:23:21.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.553+0000 7fb4eca55700 1 -- 172.21.15.6:0/2864255319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e8169d70 con 0x7fb4e80d0530 2023-10-06T02:23:21.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.554+0000 7fb4eca55700 1 -- 172.21.15.6:0/2864255319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e80ce870 con 0x7fb4e80d0530 2023-10-06T02:23:21.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.554+0000 7fb4deffd700 1 -- 172.21.15.6:0/2864255319 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4d001c460 con 0x7fb4e80d0530 2023-10-06T02:23:21.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.555+0000 7fb4deffd700 1 --2- 172.21.15.6:0/2864255319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4c8066f30 0x7fb4c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.555+0000 7fb4deffd700 1 -- 172.21.15.6:0/2864255319 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fb4d0084610 con 0x7fb4e80d0530 2023-10-06T02:23:21.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.555+0000 7fb4e6d9d700 1 --2- 172.21.15.6:0/2864255319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4c8066f30 0x7fb4c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.555+0000 7fb4e6d9d700 1 --2- 172.21.15.6:0/2864255319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4c8066f30 0x7fb4c80693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009880 tx=0x7fb4d8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:21.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.559+0000 7fb4deffd700 1 -- 172.21.15.6:0/2864255319 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4d0051500 con 0x7fb4e80d0530 2023-10-06T02:23:21.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.795+0000 7fb4eca55700 1 -- 172.21.15.6:0/2864255319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4e8068420 con 0x7fb4e80d0530 2023-10-06T02:23:21.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.796+0000 7fb4deffd700 1 -- 172.21.15.6:0/2864255319 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4592 (secure 0 0 0) 0x7fb4d0054b20 con 0x7fb4e80d0530 2023-10-06T02:23:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:21.798 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":63,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/400475961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":400475961},{"type":"v1","addr":"172.21.15.175:6837","nonce":400475961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6579,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/628657260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":628657260},{"type":"v1","addr":"172.21.15.6:6834","nonce":628657260}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:51.206714+0000","modified":"2023-10-06T02:21:40.079021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":16,"addr":"172.21.15.6:6835/1006897436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1006897436},{"type":"v1","addr":"172.21.15.6:6835","nonce":1006897436}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:23:21.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.798+0000 7fb4eca55700 1 -- 172.21.15.6:0/2864255319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4c8066f30 msgr2=0x7fb4c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.798+0000 7fb4eca55700 1 --2- 172.21.15.6:0/2864255319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4c8066f30 0x7fb4c80693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009880 tx=0x7fb4d8017000 comp rx=0 tx=0).stop 2023-10-06T02:23:21.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.798+0000 7fb4eca55700 1 -- 172.21.15.6:0/2864255319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4e80d0530 msgr2=0x7fb4e80cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.798+0000 7fb4eca55700 1 --2- 172.21.15.6:0/2864255319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4e80d0530 0x7fb4e80cb430 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000c5c0 tx=0x7fb4d0007f30 comp rx=0 tx=0).stop 2023-10-06T02:23:21.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.798+0000 7fb4eca55700 1 -- 172.21.15.6:0/2864255319 shutdown_connections 2023-10-06T02:23:21.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.798+0000 7fb4eca55700 1 --2- 172.21.15.6:0/2864255319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4e815c900 0x7fb4e80c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.798+0000 7fb4eca55700 1 --2- 172.21.15.6:0/2864255319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e8068d90 0x7fb4e816a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.798+0000 7fb4eca55700 1 --2- 172.21.15.6:0/2864255319 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4c8066f30 0x7fb4c80693e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.798+0000 7fb4eca55700 1 --2- 172.21.15.6:0/2864255319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4e80d0530 0x7fb4e80cb430 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.798+0000 7fb4eca55700 1 -- 172.21.15.6:0/2864255319 >> 172.21.15.6:0/2864255319 conn(0x7fb4e806ac00 msgr2=0x7fb4e80b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:21.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.798+0000 7fb4eca55700 1 -- 172.21.15.6:0/2864255319 shutdown_connections 2023-10-06T02:23:21.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.798+0000 7fb4eca55700 1 -- 172.21.15.6:0/2864255319 wait complete. 2023-10-06T02:23:21.802 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 63 2023-10-06T02:23:21.811 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:21.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.929+0000 7f7c9437a700 1 Processor -- start 2023-10-06T02:23:21.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.929+0000 7f7c9437a700 1 -- start start 2023-10-06T02:23:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.930+0000 7f7c9437a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7c8c068d90 0x7f7c8c0af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.930+0000 7f7c9437a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c8c06da40 0x7f7c8c159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.930+0000 7f7c9437a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8c06d5b0 con 0x7f7c8c0af1d0 2023-10-06T02:23:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.930+0000 7f7c9437a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8c0caf90 con 0x7f7c8c06da40 2023-10-06T02:23:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.930+0000 7f7c9437a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8c06dea0 con 0x7f7c8c068d90 2023-10-06T02:23:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.930+0000 7f7c92116700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7c8c0af1d0 0x7f7c8c068680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59620/0 (socket says 172.21.15.6:59620) 2023-10-06T02:23:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.930+0000 7f7c92917700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c8c06da40 0x7f7c8c159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.930+0000 7f7c92116700 1 -- 172.21.15.6:0/1934440489 learned_addr learned my addr 172.21.15.6:0/1934440489 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.930+0000 7f7c91114700 1 -- 172.21.15.6:0/1934440489 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025721776 0 0) 0x7f7c8c06d5b0 con 0x7f7c8c0af1d0 2023-10-06T02:23:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.931+0000 7f7c91114700 1 -- 172.21.15.6:0/1934440489 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c74003570 con 0x7f7c8c0af1d0 2023-10-06T02:23:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.931+0000 7f7c91915700 1 --2- 172.21.15.6:0/1934440489 >> v2:172.21.15.175:3300/0 conn(0x7f7c8c068d90 0x7f7c8c0af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.931+0000 7f7c92917700 1 -- 172.21.15.6:0/1934440489 >> v2:172.21.15.175:3300/0 conn(0x7f7c8c068d90 msgr2=0x7f7c8c0af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.931+0000 7f7c92917700 1 --2- 172.21.15.6:0/1934440489 >> v2:172.21.15.175:3300/0 conn(0x7f7c8c068d90 0x7f7c8c0af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.931+0000 7f7c92917700 1 -- 172.21.15.6:0/1934440489 >> v1:172.21.15.6:6789/0 conn(0x7f7c8c0af1d0 legacy=0x7f7c8c068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.931+0000 7f7c92917700 1 -- 172.21.15.6:0/1934440489 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c15a9a0 con 0x7f7c8c06da40 2023-10-06T02:23:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.931+0000 7f7c91915700 1 --2- 172.21.15.6:0/1934440489 >> v2:172.21.15.175:3300/0 conn(0x7f7c8c068d90 0x7f7c8c0af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.931+0000 7f7c92917700 1 --2- 172.21.15.6:0/1934440489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c06da40 0x7f7c8c159a40 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c15e170 tx=0x7f7c84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f247c598c2e033e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.931+0000 7f7c91114700 1 -- 172.21.15.6:0/1934440489 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8400e070 con 0x7f7c8c06da40 2023-10-06T02:23:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.931+0000 7f7c91114700 1 -- 172.21.15.6:0/1934440489 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8400bb60 con 0x7f7c8c06da40 2023-10-06T02:23:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.931+0000 7f7c91114700 1 -- 172.21.15.6:0/1934440489 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84012430 con 0x7f7c8c06da40 2023-10-06T02:23:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.931+0000 7f7c9437a700 1 -- 172.21.15.6:0/1934440489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c06da40 msgr2=0x7f7c8c159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.931+0000 7f7c9437a700 1 --2- 172.21.15.6:0/1934440489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c06da40 0x7f7c8c159a40 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c15e170 tx=0x7f7c84009780 comp rx=0 tx=0).stop 2023-10-06T02:23:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.932+0000 7f7c9437a700 1 -- 172.21.15.6:0/1934440489 shutdown_connections 2023-10-06T02:23:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.932+0000 7f7c9437a700 1 --2- 172.21.15.6:0/1934440489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c06da40 0x7f7c8c159a40 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.932+0000 7f7c9437a700 1 --2- 172.21.15.6:0/1934440489 >> v2:172.21.15.175:3300/0 conn(0x7f7c8c068d90 0x7f7c8c0af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.932+0000 7f7c9437a700 1 -- 172.21.15.6:0/1934440489 >> 172.21.15.6:0/1934440489 conn(0x7f7c8c06a220 msgr2=0x7f7c8c06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:21.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.932+0000 7f7c9437a700 1 -- 172.21.15.6:0/1934440489 shutdown_connections 2023-10-06T02:23:21.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.932+0000 7f7c9437a700 1 -- 172.21.15.6:0/1934440489 wait complete. 2023-10-06T02:23:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.933+0000 7f7c9437a700 1 Processor -- start 2023-10-06T02:23:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.933+0000 7f7c9437a700 1 -- start start 2023-10-06T02:23:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.933+0000 7f7c9437a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c8c068d90 0x7f7c8c1564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.933+0000 7f7c9437a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c8c06da40 0x7f7c8c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.933+0000 7f7c9437a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c0af1d0 0x7f7c8c0c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.933+0000 7f7c9437a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c0b0d80 con 0x7f7c8c0af1d0 2023-10-06T02:23:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.933+0000 7f7c9437a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c156a00 con 0x7f7c8c06da40 2023-10-06T02:23:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.933+0000 7f7c9437a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c0c6ad0 con 0x7f7c8c068d90 2023-10-06T02:23:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.934+0000 7f7c92917700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c0af1d0 0x7f7c8c0c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.934+0000 7f7c92917700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c0af1d0 0x7f7c8c0c6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33954/0 (socket says 172.21.15.6:33954) 2023-10-06T02:23:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.934+0000 7f7c92917700 1 -- 172.21.15.6:0/3487261760 learned_addr learned my addr 172.21.15.6:0/3487261760 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.934+0000 7f7c92116700 1 --2- 172.21.15.6:0/3487261760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c8c068d90 0x7f7c8c1564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.934+0000 7f7c91915700 1 --2- 172.21.15.6:0/3487261760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c8c06da40 0x7f7c8c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.934+0000 7f7c92917700 1 -- 172.21.15.6:0/3487261760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c8c068d90 msgr2=0x7f7c8c1564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.934+0000 7f7c92917700 1 --2- 172.21.15.6:0/3487261760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c8c068d90 0x7f7c8c1564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.934+0000 7f7c92917700 1 -- 172.21.15.6:0/3487261760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c8c06da40 msgr2=0x7f7c8c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.934+0000 7f7c92917700 1 --2- 172.21.15.6:0/3487261760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c8c06da40 0x7f7c8c0c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.934+0000 7f7c92917700 1 -- 172.21.15.6:0/3487261760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c84009a20 con 0x7f7c8c0af1d0 2023-10-06T02:23:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.934+0000 7f7c92917700 1 --2- 172.21.15.6:0/3487261760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c0af1d0 0x7f7c8c0c6450 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009fd0 tx=0x7f7c84019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.934+0000 7f7c8a7fc700 1 -- 172.21.15.6:0/3487261760 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84012e00 con 0x7f7c8c0af1d0 2023-10-06T02:23:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.934+0000 7f7c8a7fc700 1 -- 172.21.15.6:0/3487261760 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8401d630 con 0x7f7c8c0af1d0 2023-10-06T02:23:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.934+0000 7f7c9437a700 1 -- 172.21.15.6:0/3487261760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8c0c6db0 con 0x7f7c8c0af1d0 2023-10-06T02:23:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.934+0000 7f7c8a7fc700 1 -- 172.21.15.6:0/3487261760 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8401d9f0 con 0x7f7c8c0af1d0 2023-10-06T02:23:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.934+0000 7f7c9437a700 1 -- 172.21.15.6:0/3487261760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8c0c7370 con 0x7f7c8c0af1d0 2023-10-06T02:23:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.935+0000 7f7c9437a700 1 -- 172.21.15.6:0/3487261760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c8c0b0ec0 con 0x7f7c8c0af1d0 2023-10-06T02:23:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.936+0000 7f7c8a7fc700 1 -- 172.21.15.6:0/3487261760 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c84024070 con 0x7f7c8c0af1d0 2023-10-06T02:23:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.936+0000 7f7c8a7fc700 1 --2- 172.21.15.6:0/3487261760 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c78066f30 0x7f7c780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.936+0000 7f7c8a7fc700 1 -- 172.21.15.6:0/3487261760 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f7c840870c0 con 0x7f7c8c0af1d0 2023-10-06T02:23:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.936+0000 7f7c92116700 1 --2- 172.21.15.6:0/3487261760 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c78066f30 0x7f7c780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.937+0000 7f7c92116700 1 --2- 172.21.15.6:0/3487261760 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c78066f30 0x7f7c780693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c007fd0 tx=0x7f7c7c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:21.941+0000 7f7c8a7fc700 1 -- 172.21.15.6:0/3487261760 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c8c0b0ec0 con 0x7f7c8c0af1d0 2023-10-06T02:23:22.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.138+0000 7f7c9437a700 1 -- 172.21.15.6:0/3487261760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c8c0b0ec0 con 0x7f7c8c0af1d0 2023-10-06T02:23:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.139+0000 7f7c8a7fc700 1 -- 172.21.15.6:0/3487261760 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+17382 (secure 0 0 0) 0x7f7c8c0b0ec0 con 0x7f7c8c0af1d0 2023-10-06T02:23:22.140 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:22.140 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:21:37.070484+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:20:48.992600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T02:20:50.177537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6832/3777949337":"2023-10-07T02:21:37.070416+0000","172.21.15.6:6834/3777949337":"2023-10-07T02:21:37.070416+0000","172.21.15.175:6837/1125020360":"2023-10-07T02:21:06.890609+0000","172.21.15.175:6835/1125020360":"2023-10-07T02:21:06.890609+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:22.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.141+0000 7f7c9437a700 1 -- 172.21.15.6:0/3487261760 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c78066f30 msgr2=0x7f7c780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.141+0000 7f7c9437a700 1 --2- 172.21.15.6:0/3487261760 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c78066f30 0x7f7c780693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c007fd0 tx=0x7f7c7c009040 comp rx=0 tx=0).stop 2023-10-06T02:23:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.141+0000 7f7c9437a700 1 -- 172.21.15.6:0/3487261760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c0af1d0 msgr2=0x7f7c8c0c6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.141+0000 7f7c9437a700 1 --2- 172.21.15.6:0/3487261760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c0af1d0 0x7f7c8c0c6450 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009fd0 tx=0x7f7c84019000 comp rx=0 tx=0).stop 2023-10-06T02:23:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.141+0000 7f7c9437a700 1 -- 172.21.15.6:0/3487261760 shutdown_connections 2023-10-06T02:23:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.141+0000 7f7c9437a700 1 --2- 172.21.15.6:0/3487261760 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c78066f30 0x7f7c780693e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.141+0000 7f7c9437a700 1 --2- 172.21.15.6:0/3487261760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c0af1d0 0x7f7c8c0c6450 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.141+0000 7f7c9437a700 1 --2- 172.21.15.6:0/3487261760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c8c068d90 0x7f7c8c1564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.141+0000 7f7c9437a700 1 --2- 172.21.15.6:0/3487261760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c8c06da40 0x7f7c8c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.141+0000 7f7c9437a700 1 -- 172.21.15.6:0/3487261760 >> 172.21.15.6:0/3487261760 conn(0x7f7c8c06a220 msgr2=0x7f7c8c0c80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.141+0000 7f7c9437a700 1 -- 172.21.15.6:0/3487261760 shutdown_connections 2023-10-06T02:23:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.141+0000 7f7c9437a700 1 -- 172.21.15.6:0/3487261760 wait complete. 2023-10-06T02:23:22.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:20:48.992600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:20:50.177537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:23:22.155 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:23:22.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.275+0000 7f0d0c9b1700 1 Processor -- start 2023-10-06T02:23:22.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.275+0000 7f0d0c9b1700 1 -- start start 2023-10-06T02:23:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.276+0000 7f0d0c9b1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d0806c830 0x7f0d08159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.276+0000 7f0d0c9b1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d080c7cb0 con 0x7f0d080c7840 2023-10-06T02:23:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.276+0000 7f0d0c9b1700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d080c7f90 con 0x7f0d0806c460 2023-10-06T02:23:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.276+0000 7f0d0c9b1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d080c8270 con 0x7f0d0806c830 2023-10-06T02:23:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.276+0000 7f0d06d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d0806c830 0x7f0d08159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.276+0000 7f0d05d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0d080c7840 0x7f0d080ca350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59624/0 (socket says 172.21.15.6:59624) 2023-10-06T02:23:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.276+0000 7f0d05d9b700 1 -- 172.21.15.6:0/1085695923 learned_addr learned my addr 172.21.15.6:0/1085695923 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.276+0000 7f0d06d9d700 1 -- 172.21.15.6:0/1085695923 >> v1:172.21.15.175:6789/0 conn(0x7f0d0806c460 legacy=0x7f0d08158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.276+0000 7f0d06d9d700 1 -- 172.21.15.6:0/1085695923 >> v1:172.21.15.6:6789/0 conn(0x7f0d080c7840 legacy=0x7f0d080ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.276+0000 7f0d0559a700 1 -- 172.21.15.6:0/1085695923 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709626165 0 0) 0x7f0d080c7cb0 con 0x7f0d080c7840 2023-10-06T02:23:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.276+0000 7f0d06d9d700 1 -- 172.21.15.6:0/1085695923 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d080c8550 con 0x7f0d0806c830 2023-10-06T02:23:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.277+0000 7f0d06d9d700 1 --2- 172.21.15.6:0/1085695923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d0806c830 0x7f0d08159670 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009910 tx=0x7f0cf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2f74532241df72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.277+0000 7f0d0559a700 1 -- 172.21.15.6:0/1085695923 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf800b7e0 con 0x7f0d0806c830 2023-10-06T02:23:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.277+0000 7f0d0559a700 1 -- 172.21.15.6:0/1085695923 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf800b940 con 0x7f0d0806c830 2023-10-06T02:23:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.277+0000 7f0d0559a700 1 -- 172.21.15.6:0/1085695923 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf800bce0 con 0x7f0d0806c830 2023-10-06T02:23:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.277+0000 7f0d0c9b1700 1 -- 172.21.15.6:0/1085695923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d0806c830 msgr2=0x7f0d08159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.277+0000 7f0d0c9b1700 1 --2- 172.21.15.6:0/1085695923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d0806c830 0x7f0d08159670 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009910 tx=0x7f0cf80091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.277+0000 7f0d0c9b1700 1 -- 172.21.15.6:0/1085695923 shutdown_connections 2023-10-06T02:23:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.277+0000 7f0d0c9b1700 1 --2- 172.21.15.6:0/1085695923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d0806c830 0x7f0d08159670 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.277+0000 7f0d0c9b1700 1 -- 172.21.15.6:0/1085695923 >> 172.21.15.6:0/1085695923 conn(0x7f0d080c9cc0 msgr2=0x7f0d0806acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.278+0000 7f0d0c9b1700 1 -- 172.21.15.6:0/1085695923 shutdown_connections 2023-10-06T02:23:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.278+0000 7f0d0c9b1700 1 -- 172.21.15.6:0/1085695923 wait complete. 2023-10-06T02:23:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.279+0000 7f0d0c9b1700 1 Processor -- start 2023-10-06T02:23:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.279+0000 7f0d0c9b1700 1 -- start start 2023-10-06T02:23:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.279+0000 7f0d0c9b1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d0806c460 0x7f0d080c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.279+0000 7f0d0c9b1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d0806c830 0x7f0d081545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.279+0000 7f0d0c9b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d080c7840 0x7f0d08157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.279+0000 7f0d0c9b1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0816a710 con 0x7f0d080c7840 2023-10-06T02:23:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.279+0000 7f0d0c9b1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08169b00 con 0x7f0d0806c460 2023-10-06T02:23:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.279+0000 7f0d0c9b1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08169de0 con 0x7f0d0806c830 2023-10-06T02:23:22.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.279+0000 7f0d06d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d080c7840 0x7f0d08157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:22.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.279+0000 7f0d06d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d080c7840 0x7f0d08157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33966/0 (socket says 172.21.15.6:33966) 2023-10-06T02:23:22.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.279+0000 7f0d06d9d700 1 -- 172.21.15.6:0/2417582285 learned_addr learned my addr 172.21.15.6:0/2417582285 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:22.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.280+0000 7f0d05d9b700 1 --2- 172.21.15.6:0/2417582285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d0806c830 0x7f0d081545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:22.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.280+0000 7f0d0659c700 1 --2- 172.21.15.6:0/2417582285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d0806c460 0x7f0d080c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:22.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.280+0000 7f0d06d9d700 1 -- 172.21.15.6:0/2417582285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d0806c830 msgr2=0x7f0d081545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.280+0000 7f0d06d9d700 1 --2- 172.21.15.6:0/2417582285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d0806c830 0x7f0d081545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.280+0000 7f0d06d9d700 1 -- 172.21.15.6:0/2417582285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d0806c460 msgr2=0x7f0d080c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.280+0000 7f0d06d9d700 1 --2- 172.21.15.6:0/2417582285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d0806c460 0x7f0d080c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.280+0000 7f0d06d9d700 1 -- 172.21.15.6:0/2417582285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf8009420 con 0x7f0d080c7840 2023-10-06T02:23:22.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.280+0000 7f0d05d9b700 1 --2- 172.21.15.6:0/2417582285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d0806c830 0x7f0d081545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:22.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.280+0000 7f0d0659c700 1 --2- 172.21.15.6:0/2417582285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d0806c460 0x7f0d080c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:22.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.280+0000 7f0d06d9d700 1 --2- 172.21.15.6:0/2417582285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d080c7840 0x7f0d08157dd0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80030c0 tx=0x7f0cf8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:22.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.280+0000 7f0cfe7fc700 1 -- 172.21.15.6:0/2417582285 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf801b520 con 0x7f0d080c7840 2023-10-06T02:23:22.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.280+0000 7f0cfe7fc700 1 -- 172.21.15.6:0/2417582285 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf8020070 con 0x7f0d080c7840 2023-10-06T02:23:22.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.280+0000 7f0d0c9b1700 1 -- 172.21.15.6:0/2417582285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d0816a0c0 con 0x7f0d080c7840 2023-10-06T02:23:22.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.280+0000 7f0cfe7fc700 1 -- 172.21.15.6:0/2417582285 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf801b8b0 con 0x7f0d080c7840 2023-10-06T02:23:22.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.280+0000 7f0d0c9b1700 1 -- 172.21.15.6:0/2417582285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d08154b00 con 0x7f0d080c7840 2023-10-06T02:23:22.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.281+0000 7f0d0c9b1700 1 -- 172.21.15.6:0/2417582285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d080c3830 con 0x7f0d080c7840 2023-10-06T02:23:22.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.281+0000 7f0cfe7fc700 1 -- 172.21.15.6:0/2417582285 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0cf8022030 con 0x7f0d080c7840 2023-10-06T02:23:22.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.282+0000 7f0cfe7fc700 1 --2- 172.21.15.6:0/2417582285 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ce8066f30 0x7f0ce80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:22.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.282+0000 7f0cfe7fc700 1 -- 172.21.15.6:0/2417582285 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f0cf8086b30 con 0x7f0d080c7840 2023-10-06T02:23:22.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.282+0000 7f0d0659c700 1 --2- 172.21.15.6:0/2417582285 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ce8066f30 0x7f0ce80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:22.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.283+0000 7f0d0659c700 1 --2- 172.21.15.6:0/2417582285 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ce8066f30 0x7f0ce80693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0d00007fd0 tx=0x7f0d00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:22.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.286+0000 7f0cfe7fc700 1 -- 172.21.15.6:0/2417582285 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d080c3830 con 0x7f0d080c7840 2023-10-06T02:23:22.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.478+0000 7f0d0c9b1700 1 -- 172.21.15.6:0/2417582285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0d080c3830 con 0x7f0d080c7840 2023-10-06T02:23:22.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.478+0000 7f0cfe7fc700 1 -- 172.21.15.6:0/2417582285 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v70) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0d080c3830 con 0x7f0d080c7840 2023-10-06T02:23:22.480 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:23:22.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.480+0000 7f0d0c9b1700 1 -- 172.21.15.6:0/2417582285 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ce8066f30 msgr2=0x7f0ce80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.480+0000 7f0d0c9b1700 1 --2- 172.21.15.6:0/2417582285 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ce8066f30 0x7f0ce80693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0d00007fd0 tx=0x7f0d00009040 comp rx=0 tx=0).stop 2023-10-06T02:23:22.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.480+0000 7f0d0c9b1700 1 -- 172.21.15.6:0/2417582285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d080c7840 msgr2=0x7f0d08157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.480+0000 7f0d0c9b1700 1 --2- 172.21.15.6:0/2417582285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d080c7840 0x7f0d08157dd0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80030c0 tx=0x7f0cf8016000 comp rx=0 tx=0).stop 2023-10-06T02:23:22.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.480+0000 7f0d0c9b1700 1 -- 172.21.15.6:0/2417582285 shutdown_connections 2023-10-06T02:23:22.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.480+0000 7f0d0c9b1700 1 --2- 172.21.15.6:0/2417582285 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ce8066f30 0x7f0ce80693e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.480+0000 7f0d0c9b1700 1 --2- 172.21.15.6:0/2417582285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d080c7840 0x7f0d08157dd0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.480+0000 7f0d0c9b1700 1 --2- 172.21.15.6:0/2417582285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d0806c460 0x7f0d080c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.480+0000 7f0d0c9b1700 1 --2- 172.21.15.6:0/2417582285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d0806c830 0x7f0d081545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.480+0000 7f0d0c9b1700 1 -- 172.21.15.6:0/2417582285 >> 172.21.15.6:0/2417582285 conn(0x7f0d080c9cc0 msgr2=0x7f0d08155e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:22.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.481+0000 7f0d0c9b1700 1 -- 172.21.15.6:0/2417582285 shutdown_connections 2023-10-06T02:23:22.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.481+0000 7f0d0c9b1700 1 -- 172.21.15.6:0/2417582285 wait complete. 2023-10-06T02:23:22.494 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:23:22.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.616+0000 7f915b2ba700 1 Processor -- start 2023-10-06T02:23:22.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.616+0000 7f915b2ba700 1 -- start start 2023-10-06T02:23:22.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.617+0000 7f915b2ba700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91540a89c0 0x7f91540aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:22.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.617+0000 7f915b2ba700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91540a8d90 0x7f91540af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:22.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.617+0000 7f915b2ba700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915406b030 con 0x7f91540af570 2023-10-06T02:23:22.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.617+0000 7f915b2ba700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91540b1ab0 con 0x7f91540a89c0 2023-10-06T02:23:22.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.617+0000 7f915b2ba700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915406ad50 con 0x7f91540a8d90 2023-10-06T02:23:22.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.617+0000 7f9159056700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91540a89c0 0x7f91540aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:22.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.617+0000 7f9159857700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f91540af570 0x7f91540b2810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59636/0 (socket says 172.21.15.6:59636) 2023-10-06T02:23:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.617+0000 7f9159857700 1 -- 172.21.15.6:0/4083289024 learned_addr learned my addr 172.21.15.6:0/4083289024 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.617+0000 7f9158855700 1 --2- 172.21.15.6:0/4083289024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91540a8d90 0x7f91540af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.617+0000 7f9159056700 1 -- 172.21.15.6:0/4083289024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91540a8d90 msgr2=0x7f91540af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.617+0000 7f9159056700 1 --2- 172.21.15.6:0/4083289024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91540a8d90 0x7f91540af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.617+0000 7f9159056700 1 -- 172.21.15.6:0/4083289024 >> v1:172.21.15.6:6789/0 conn(0x7f91540af570 legacy=0x7f91540b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.617+0000 7f9159056700 1 -- 172.21.15.6:0/4083289024 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91540b1d30 con 0x7f91540a89c0 2023-10-06T02:23:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.617+0000 7f9153fff700 1 -- 172.21.15.6:0/4083289024 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754597911 0 0) 0x7f915406b030 con 0x7f91540af570 2023-10-06T02:23:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.617+0000 7f9159056700 1 --2- 172.21.15.6:0/4083289024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91540a89c0 0x7f91540aeaf0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f914c0098d0 tx=0x7f914c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17a3c9e1a5dc708 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.617+0000 7f9153fff700 1 -- 172.21.15.6:0/4083289024 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c009e70 con 0x7f91540a89c0 2023-10-06T02:23:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.617+0000 7f9153fff700 1 -- 172.21.15.6:0/4083289024 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c005c10 con 0x7f91540a89c0 2023-10-06T02:23:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.618+0000 7f9153fff700 1 -- 172.21.15.6:0/4083289024 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c00b650 con 0x7f91540a89c0 2023-10-06T02:23:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.618+0000 7f915b2ba700 1 -- 172.21.15.6:0/4083289024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91540a89c0 msgr2=0x7f91540aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.618+0000 7f915b2ba700 1 --2- 172.21.15.6:0/4083289024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91540a89c0 0x7f91540aeaf0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f914c0098d0 tx=0x7f914c009120 comp rx=0 tx=0).stop 2023-10-06T02:23:22.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.618+0000 7f915b2ba700 1 -- 172.21.15.6:0/4083289024 shutdown_connections 2023-10-06T02:23:22.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.618+0000 7f915b2ba700 1 --2- 172.21.15.6:0/4083289024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91540a89c0 0x7f91540aeaf0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.618+0000 7f915b2ba700 1 --2- 172.21.15.6:0/4083289024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91540a8d90 0x7f91540af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.618+0000 7f915b2ba700 1 -- 172.21.15.6:0/4083289024 >> 172.21.15.6:0/4083289024 conn(0x7f9154067910 msgr2=0x7f91540ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:22.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.618+0000 7f915b2ba700 1 -- 172.21.15.6:0/4083289024 shutdown_connections 2023-10-06T02:23:22.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.618+0000 7f915b2ba700 1 -- 172.21.15.6:0/4083289024 wait complete. 2023-10-06T02:23:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.619+0000 7f915b2ba700 1 Processor -- start 2023-10-06T02:23:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.619+0000 7f915b2ba700 1 -- start start 2023-10-06T02:23:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.620+0000 7f915b2ba700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91540a89c0 0x7f91540cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.620+0000 7f915b2ba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91540a8d90 0x7f915409a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.620+0000 7f915b2ba700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91540af570 0x7f915409aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.620+0000 7f915b2ba700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91540988e0 con 0x7f91540a8d90 2023-10-06T02:23:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.620+0000 7f915b2ba700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9154098bc0 con 0x7f91540a89c0 2023-10-06T02:23:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.620+0000 7f915b2ba700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9154098ea0 con 0x7f91540af570 2023-10-06T02:23:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.620+0000 7f9158855700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91540a8d90 0x7f915409a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.620+0000 7f9158855700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91540a8d90 0x7f915409a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33982/0 (socket says 172.21.15.6:33982) 2023-10-06T02:23:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.620+0000 7f9158855700 1 -- 172.21.15.6:0/2852173531 learned_addr learned my addr 172.21.15.6:0/2852173531 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.620+0000 7f9159056700 1 --2- 172.21.15.6:0/2852173531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91540a89c0 0x7f91540cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:22.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.620+0000 7f9159857700 1 --2- 172.21.15.6:0/2852173531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91540af570 0x7f915409aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:22.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.620+0000 7f9158855700 1 -- 172.21.15.6:0/2852173531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91540af570 msgr2=0x7f915409aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.620+0000 7f9158855700 1 --2- 172.21.15.6:0/2852173531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91540af570 0x7f915409aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.620+0000 7f9158855700 1 -- 172.21.15.6:0/2852173531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91540a89c0 msgr2=0x7f91540cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.620+0000 7f9158855700 1 --2- 172.21.15.6:0/2852173531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91540a89c0 0x7f91540cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.620+0000 7f9158855700 1 -- 172.21.15.6:0/2852173531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c0093c0 con 0x7f91540a8d90 2023-10-06T02:23:22.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.620+0000 7f9159056700 1 --2- 172.21.15.6:0/2852173531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91540a89c0 0x7f91540cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:22.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.621+0000 7f9158855700 1 --2- 172.21.15.6:0/2852173531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91540a8d90 0x7f915409a660 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f914800d860 tx=0x7f9148008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:22.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.621+0000 7f91517fa700 1 -- 172.21.15.6:0/2852173531 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148018070 con 0x7f91540a8d90 2023-10-06T02:23:22.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.621+0000 7f91517fa700 1 -- 172.21.15.6:0/2852173531 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91480125f0 con 0x7f91540a8d90 2023-10-06T02:23:22.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.621+0000 7f915b2ba700 1 -- 172.21.15.6:0/2852173531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9154099180 con 0x7f91540a8d90 2023-10-06T02:23:22.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.621+0000 7f91517fa700 1 -- 172.21.15.6:0/2852173531 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91480129b0 con 0x7f91540a8d90 2023-10-06T02:23:22.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.621+0000 7f915b2ba700 1 -- 172.21.15.6:0/2852173531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91540ccbb0 con 0x7f91540a8d90 2023-10-06T02:23:22.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.622+0000 7f915b2ba700 1 -- 172.21.15.6:0/2852173531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9154098a20 con 0x7f91540a8d90 2023-10-06T02:23:22.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.622+0000 7f91517fa700 1 -- 172.21.15.6:0/2852173531 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9148012d20 con 0x7f91540a8d90 2023-10-06T02:23:22.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.623+0000 7f91517fa700 1 --2- 172.21.15.6:0/2852173531 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9140066f30 0x7f91400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:22.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.623+0000 7f91517fa700 1 -- 172.21.15.6:0/2852173531 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f9148084b80 con 0x7f91540a8d90 2023-10-06T02:23:22.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.623+0000 7f9159056700 1 --2- 172.21.15.6:0/2852173531 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9140066f30 0x7f91400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:22.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.623+0000 7f9159056700 1 --2- 172.21.15.6:0/2852173531 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9140066f30 0x7f91400693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f915409b290 tx=0x7f914c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:22.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.627+0000 7f91517fa700 1 -- 172.21.15.6:0/2852173531 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9154098a20 con 0x7f91540a8d90 2023-10-06T02:23:22.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.822+0000 7f915b2ba700 1 -- 172.21.15.6:0/2852173531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9154098a20 con 0x7f91540a8d90 2023-10-06T02:23:22.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.823+0000 7f91517fa700 1 -- 172.21.15.6:0/2852173531 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9154098a20 con 0x7f91540a8d90 2023-10-06T02:23:22.837 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:23:22.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.825+0000 7f915b2ba700 1 -- 172.21.15.6:0/2852173531 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9140066f30 msgr2=0x7f91400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.825+0000 7f915b2ba700 1 --2- 172.21.15.6:0/2852173531 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9140066f30 0x7f91400693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f915409b290 tx=0x7f914c016000 comp rx=0 tx=0).stop 2023-10-06T02:23:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.825+0000 7f915b2ba700 1 -- 172.21.15.6:0/2852173531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91540a8d90 msgr2=0x7f915409a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.825+0000 7f915b2ba700 1 --2- 172.21.15.6:0/2852173531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91540a8d90 0x7f915409a660 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f914800d860 tx=0x7f9148008040 comp rx=0 tx=0).stop 2023-10-06T02:23:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.825+0000 7f915b2ba700 1 -- 172.21.15.6:0/2852173531 shutdown_connections 2023-10-06T02:23:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.825+0000 7f915b2ba700 1 --2- 172.21.15.6:0/2852173531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91540af570 0x7f915409aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.825+0000 7f915b2ba700 1 --2- 172.21.15.6:0/2852173531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91540a89c0 0x7f91540cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.825+0000 7f915b2ba700 1 --2- 172.21.15.6:0/2852173531 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9140066f30 0x7f91400693e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.825+0000 7f915b2ba700 1 --2- 172.21.15.6:0/2852173531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91540a8d90 0x7f915409a660 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.825+0000 7f915b2ba700 1 -- 172.21.15.6:0/2852173531 >> 172.21.15.6:0/2852173531 conn(0x7f9154067910 msgr2=0x7f915406d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.825+0000 7f915b2ba700 1 -- 172.21.15.6:0/2852173531 shutdown_connections 2023-10-06T02:23:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.825+0000 7f915b2ba700 1 -- 172.21.15.6:0/2852173531 wait complete. 2023-10-06T02:23:22.840 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:23:22.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.961+0000 7f5a19a11700 1 Processor -- start 2023-10-06T02:23:22.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.961+0000 7f5a19a11700 1 -- start start 2023-10-06T02:23:22.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.962+0000 7f5a19a11700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5a140af460 0x7f5a14159990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:22.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.962+0000 7f5a19a11700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a140af830 0x7f5a1415d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:22.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.962+0000 7f5a19a11700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a140ce870 con 0x7f5a140cca70 2023-10-06T02:23:22.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.962+0000 7f5a19a11700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a1415dec0 con 0x7f5a140af460 2023-10-06T02:23:22.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.962+0000 7f5a19a11700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a140cfd10 con 0x7f5a140af830 2023-10-06T02:23:22.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.962+0000 7f5a127fc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a140af830 0x7f5a1415d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:22.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.962+0000 7f5a12ffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5a140af460 0x7f5a14159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:22.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.962+0000 7f5a127fc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a140af830 0x7f5a1415d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:51912/0 (socket says 172.21.15.6:51912) 2023-10-06T02:23:22.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.963+0000 7f5a12ffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5a140af460 0x7f5a14159990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:58464/0 (socket says 172.21.15.6:58464) 2023-10-06T02:23:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.963+0000 7f5a127fc700 1 -- 172.21.15.6:0/3225070192 learned_addr learned my addr 172.21.15.6:0/3225070192 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.963+0000 7f5a12ffd700 1 -- 172.21.15.6:0/3225070192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a140af830 msgr2=0x7f5a1415d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.963+0000 7f5a12ffd700 1 --2- 172.21.15.6:0/3225070192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a140af830 0x7f5a1415d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.963+0000 7f5a12ffd700 1 -- 172.21.15.6:0/3225070192 >> v1:172.21.15.175:6789/0 conn(0x7f5a140cca70 legacy=0x7f5a140ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.963+0000 7f5a12ffd700 1 -- 172.21.15.6:0/3225070192 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a140cffb0 con 0x7f5a140af460 2023-10-06T02:23:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.963+0000 7f5a127fc700 1 --2- 172.21.15.6:0/3225070192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a140af830 0x7f5a1415d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.963+0000 7f5a11ffb700 1 -- 172.21.15.6:0/3225070192 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527534847 0 0) 0x7f5a140ce870 con 0x7f5a140cca70 2023-10-06T02:23:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.963+0000 7f5a12ffd700 1 --2- 172.21.15.6:0/3225070192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a140af460 0x7f5a14159990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5a04009e60 tx=0x7f5a04009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2c314e500190458 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.963+0000 7f5a11ffb700 1 -- 172.21.15.6:0/3225070192 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0400e070 con 0x7f5a140af460 2023-10-06T02:23:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.963+0000 7f5a11ffb700 1 -- 172.21.15.6:0/3225070192 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0400bb60 con 0x7f5a140af460 2023-10-06T02:23:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.963+0000 7f5a11ffb700 1 -- 172.21.15.6:0/3225070192 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04012430 con 0x7f5a140af460 2023-10-06T02:23:22.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.964+0000 7f5a19a11700 1 -- 172.21.15.6:0/3225070192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a140af460 msgr2=0x7f5a14159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.964+0000 7f5a19a11700 1 --2- 172.21.15.6:0/3225070192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a140af460 0x7f5a14159990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5a04009e60 tx=0x7f5a04009780 comp rx=0 tx=0).stop 2023-10-06T02:23:22.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.964+0000 7f5a19a11700 1 -- 172.21.15.6:0/3225070192 shutdown_connections 2023-10-06T02:23:22.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.964+0000 7f5a19a11700 1 --2- 172.21.15.6:0/3225070192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a140af460 0x7f5a14159990 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.964+0000 7f5a19a11700 1 --2- 172.21.15.6:0/3225070192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a140af830 0x7f5a1415d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.964+0000 7f5a19a11700 1 -- 172.21.15.6:0/3225070192 >> 172.21.15.6:0/3225070192 conn(0x7f5a14068680 msgr2=0x7f5a14068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:22.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.964+0000 7f5a19a11700 1 -- 172.21.15.6:0/3225070192 shutdown_connections 2023-10-06T02:23:22.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.964+0000 7f5a19a11700 1 -- 172.21.15.6:0/3225070192 wait complete. 2023-10-06T02:23:22.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.965+0000 7f5a19a11700 1 Processor -- start 2023-10-06T02:23:22.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.965+0000 7f5a19a11700 1 -- start start 2023-10-06T02:23:22.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.966+0000 7f5a19a11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a140af460 0x7f5a140c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:22.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.966+0000 7f5a19a11700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a140af830 0x7f5a140b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:22.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.966+0000 7f5a19a11700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a140cca70 0x7f5a1414bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:22.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.966+0000 7f5a19a11700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a140b3630 con 0x7f5a140af460 2023-10-06T02:23:22.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.966+0000 7f5a19a11700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a140b44c0 con 0x7f5a140cca70 2023-10-06T02:23:22.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.966+0000 7f5a19a11700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1414c490 con 0x7f5a140af830 2023-10-06T02:23:22.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.966+0000 7f5a12ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a140af460 0x7f5a140c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:22.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.966+0000 7f5a12ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a140af460 0x7f5a140c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33990/0 (socket says 172.21.15.6:33990) 2023-10-06T02:23:22.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.966+0000 7f5a12ffd700 1 -- 172.21.15.6:0/2659702346 learned_addr learned my addr 172.21.15.6:0/2659702346 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:22.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.966+0000 7f5a127fc700 1 --2- 172.21.15.6:0/2659702346 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a140af830 0x7f5a140b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:22.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.966+0000 7f5a137fe700 1 --2- 172.21.15.6:0/2659702346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a140cca70 0x7f5a1414bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:22.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.966+0000 7f5a12ffd700 1 -- 172.21.15.6:0/2659702346 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a140af830 msgr2=0x7f5a140b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.966+0000 7f5a12ffd700 1 --2- 172.21.15.6:0/2659702346 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a140af830 0x7f5a140b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.966+0000 7f5a12ffd700 1 -- 172.21.15.6:0/2659702346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a140cca70 msgr2=0x7f5a1414bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:22.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.966+0000 7f5a12ffd700 1 --2- 172.21.15.6:0/2659702346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a140cca70 0x7f5a1414bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:22.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.966+0000 7f5a12ffd700 1 -- 172.21.15.6:0/2659702346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59fc0094f0 con 0x7f5a140af460 2023-10-06T02:23:22.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.967+0000 7f5a12ffd700 1 --2- 172.21.15.6:0/2659702346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a140af460 0x7f5a140c9e70 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f5a140c71a0 tx=0x7f5a04019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:22.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.967+0000 7f5a0affd700 1 -- 172.21.15.6:0/2659702346 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04012de0 con 0x7f5a140af460 2023-10-06T02:23:22.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.967+0000 7f5a0affd700 1 -- 172.21.15.6:0/2659702346 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a04027470 con 0x7f5a140af460 2023-10-06T02:23:22.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.967+0000 7f5a0affd700 1 -- 172.21.15.6:0/2659702346 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04027830 con 0x7f5a140af460 2023-10-06T02:23:22.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.967+0000 7f5a19a11700 1 -- 172.21.15.6:0/2659702346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a04009a20 con 0x7f5a140af460 2023-10-06T02:23:22.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.967+0000 7f5a19a11700 1 -- 172.21.15.6:0/2659702346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a140b3b40 con 0x7f5a140af460 2023-10-06T02:23:22.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.968+0000 7f5a19a11700 1 -- 172.21.15.6:0/2659702346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a140b4290 con 0x7f5a140af460 2023-10-06T02:23:22.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.968+0000 7f5a0affd700 1 -- 172.21.15.6:0/2659702346 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a04024070 con 0x7f5a140af460 2023-10-06T02:23:22.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.968+0000 7f5a0affd700 1 --2- 172.21.15.6:0/2659702346 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59f4066f30 0x7f59f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:22.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.969+0000 7f5a0affd700 1 -- 172.21.15.6:0/2659702346 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f5a04086f10 con 0x7f5a140af460 2023-10-06T02:23:22.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.969+0000 7f5a127fc700 1 --2- 172.21.15.6:0/2659702346 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59f4066f30 0x7f59f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:22.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.969+0000 7f5a127fc700 1 --2- 172.21.15.6:0/2659702346 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59f4066f30 0x7f59f40693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5a140c5aa0 tx=0x7f59fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:22.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:22.973+0000 7f5a0affd700 1 -- 172.21.15.6:0/2659702346 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a04053e00 con 0x7f5a140af460 2023-10-06T02:23:23.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.167+0000 7f5a19a11700 1 -- 172.21.15.6:0/2659702346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5a1415a010 con 0x7f5a140af460 2023-10-06T02:23:23.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.167+0000 7f5a0affd700 1 -- 172.21.15.6:0/2659702346 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v70) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5a0402c020 con 0x7f5a140af460 2023-10-06T02:23:23.169 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:23:23.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.169+0000 7f5a19a11700 1 -- 172.21.15.6:0/2659702346 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59f4066f30 msgr2=0x7f59f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:23.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.169+0000 7f5a19a11700 1 --2- 172.21.15.6:0/2659702346 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59f4066f30 0x7f59f40693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5a140c5aa0 tx=0x7f59fc008040 comp rx=0 tx=0).stop 2023-10-06T02:23:23.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.169+0000 7f5a19a11700 1 -- 172.21.15.6:0/2659702346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a140af460 msgr2=0x7f5a140c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:23.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.169+0000 7f5a19a11700 1 --2- 172.21.15.6:0/2659702346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a140af460 0x7f5a140c9e70 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f5a140c71a0 tx=0x7f5a04019000 comp rx=0 tx=0).stop 2023-10-06T02:23:23.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.169+0000 7f5a19a11700 1 -- 172.21.15.6:0/2659702346 shutdown_connections 2023-10-06T02:23:23.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.169+0000 7f5a19a11700 1 --2- 172.21.15.6:0/2659702346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a140cca70 0x7f5a1414bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.169+0000 7f5a19a11700 1 --2- 172.21.15.6:0/2659702346 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59f4066f30 0x7f59f40693e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.169+0000 7f5a19a11700 1 --2- 172.21.15.6:0/2659702346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a140af460 0x7f5a140c9e70 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.169+0000 7f5a19a11700 1 --2- 172.21.15.6:0/2659702346 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a140af830 0x7f5a140b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.169+0000 7f5a19a11700 1 -- 172.21.15.6:0/2659702346 >> 172.21.15.6:0/2659702346 conn(0x7f5a14068680 msgr2=0x7f5a140ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:23.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.169+0000 7f5a19a11700 1 -- 172.21.15.6:0/2659702346 shutdown_connections 2023-10-06T02:23:23.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.169+0000 7f5a19a11700 1 -- 172.21.15.6:0/2659702346 wait complete. 2023-10-06T02:23:23.183 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:23:23.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.305+0000 7f9d50554700 1 Processor -- start 2023-10-06T02:23:23.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.305+0000 7f9d50554700 1 -- start start 2023-10-06T02:23:23.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.305+0000 7f9d50554700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9d480ccd40 0x7f9d480cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:23.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d50554700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d480cf7e0 0x7f9d480b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:23.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d50554700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4815dd40 con 0x7f9d480d0400 2023-10-06T02:23:23.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d50554700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4815e020 con 0x7f9d480ccd40 2023-10-06T02:23:23.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d50554700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d480ceaa0 con 0x7f9d480cf7e0 2023-10-06T02:23:23.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4e2f0700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9d480d0400 0x7f9d480b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59648/0 (socket says 172.21.15.6:59648) 2023-10-06T02:23:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4e2f0700 1 -- 172.21.15.6:0/3475616438 learned_addr learned my addr 172.21.15.6:0/3475616438 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4eaf1700 1 --2- 172.21.15.6:0/3475616438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d480cf7e0 0x7f9d480b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4daef700 1 --2- 172.21.15.6:0/3475616438 >> v2:172.21.15.175:3300/0 conn(0x7f9d480ccd40 0x7f9d480cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4d2ee700 1 -- 172.21.15.6:0/3475616438 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824554135 0 0) 0x7f9d4815dd40 con 0x7f9d480d0400 2023-10-06T02:23:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4d2ee700 1 -- 172.21.15.6:0/3475616438 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d30003570 con 0x7f9d480d0400 2023-10-06T02:23:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4d2ee700 1 -- 172.21.15.6:0/3475616438 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1101949185 0 0) 0x7f9d30003570 con 0x7f9d480d0400 2023-10-06T02:23:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4d2ee700 1 -- 172.21.15.6:0/3475616438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d480cf7e0 msgr2=0x7f9d480b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4d2ee700 1 --2- 172.21.15.6:0/3475616438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d480cf7e0 0x7f9d480b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4d2ee700 1 -- 172.21.15.6:0/3475616438 >> v2:172.21.15.175:3300/0 conn(0x7f9d480ccd40 msgr2=0x7f9d480cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4d2ee700 1 --2- 172.21.15.6:0/3475616438 >> v2:172.21.15.175:3300/0 conn(0x7f9d480ccd40 0x7f9d480cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4d2ee700 1 -- 172.21.15.6:0/3475616438 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d480ced80 con 0x7f9d480d0400 2023-10-06T02:23:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4d2ee700 1 -- 172.21.15.6:0/3475616438 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f9d40001970 con 0x7f9d480d0400 2023-10-06T02:23:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4d2ee700 1 -- 172.21.15.6:0/3475616438 >> v1:172.21.15.6:6789/0 conn(0x7f9d480d0400 legacy=0x7f9d480b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4d2ee700 1 --2- 172.21.15.6:0/3475616438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d480cf7e0 0x7f9d30003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4d2ee700 1 --2- 172.21.15.6:0/3475616438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d30003fe0 0x7f9d30004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4d2ee700 1 --2- 172.21.15.6:0/3475616438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d30004d50 0x7f9d300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4d2ee700 1 -- 172.21.15.6:0/3475616438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4815e020 con 0x7f9d30004d50 2023-10-06T02:23:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4d2ee700 1 -- 172.21.15.6:0/3475616438 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d480ceaa0 con 0x7f9d30003fe0 2023-10-06T02:23:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.306+0000 7f9d4d2ee700 1 -- 172.21.15.6:0/3475616438 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3000ba90 con 0x7f9d480cf7e0 2023-10-06T02:23:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.307+0000 7f9d4eaf1700 1 --2- 172.21.15.6:0/3475616438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d30004d50 0x7f9d300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.307+0000 7f9d4e2f0700 1 --2- 172.21.15.6:0/3475616438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d480cf7e0 0x7f9d30003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.307+0000 7f9d4daef700 1 --2- 172.21.15.6:0/3475616438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d30003fe0 0x7f9d30004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.307+0000 7f9d4eaf1700 1 -- 172.21.15.6:0/3475616438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d480cf7e0 msgr2=0x7f9d30003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.307+0000 7f9d4eaf1700 1 --2- 172.21.15.6:0/3475616438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d480cf7e0 0x7f9d30003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.307+0000 7f9d4eaf1700 1 -- 172.21.15.6:0/3475616438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d30003fe0 msgr2=0x7f9d30004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.307+0000 7f9d4eaf1700 1 --2- 172.21.15.6:0/3475616438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d30003fe0 0x7f9d30004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.307+0000 7f9d4eaf1700 1 -- 172.21.15.6:0/3475616438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d30003570 con 0x7f9d30004d50 2023-10-06T02:23:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.307+0000 7f9d4eaf1700 1 --2- 172.21.15.6:0/3475616438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d30004d50 0x7f9d300051c0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f9d38009c00 tx=0x7f9d380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1cc901072dd8e5f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.307+0000 7f9d4d2ee700 1 -- 172.21.15.6:0/3475616438 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3800e6b0 con 0x7f9d30004d50 2023-10-06T02:23:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.307+0000 7f9d4d2ee700 1 -- 172.21.15.6:0/3475616438 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3800e810 con 0x7f9d30004d50 2023-10-06T02:23:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.307+0000 7f9d4d2ee700 1 -- 172.21.15.6:0/3475616438 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3800ebd0 con 0x7f9d30004d50 2023-10-06T02:23:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.308+0000 7f9d50554700 1 -- 172.21.15.6:0/3475616438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d30004d50 msgr2=0x7f9d300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.308+0000 7f9d50554700 1 --2- 172.21.15.6:0/3475616438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d30004d50 0x7f9d300051c0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f9d38009c00 tx=0x7f9d380091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.308+0000 7f9d4eaf1700 1 -- 172.21.15.6:0/3475616438 reap_dead start 2023-10-06T02:23:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.308+0000 7f9d50554700 1 -- 172.21.15.6:0/3475616438 shutdown_connections 2023-10-06T02:23:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.308+0000 7f9d50554700 1 -- 172.21.15.6:0/3475616438 >> 172.21.15.6:0/3475616438 conn(0x7f9d4806a220 msgr2=0x7f9d4806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:23.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.308+0000 7f9d50554700 1 -- 172.21.15.6:0/3475616438 shutdown_connections 2023-10-06T02:23:23.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.308+0000 7f9d50554700 1 -- 172.21.15.6:0/3475616438 wait complete. 2023-10-06T02:23:23.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.309+0000 7f9d50554700 1 Processor -- start 2023-10-06T02:23:23.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.309+0000 7f9d50554700 1 -- start start 2023-10-06T02:23:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.309+0000 7f9d50554700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d30004d50 0x7f9d481536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d50554700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4816c9c0 0x7f9d48169b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d50554700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d48151a60 0x7f9d4814ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d50554700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d48159230 con 0x7f9d48151a60 2023-10-06T02:23:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d50554700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4814dac0 con 0x7f9d4816c9c0 2023-10-06T02:23:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d50554700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4814e360 con 0x7f9d30004d50 2023-10-06T02:23:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d4eaf1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d48151a60 0x7f9d4814ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d4eaf1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d48151a60 0x7f9d4814ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34006/0 (socket says 172.21.15.6:34006) 2023-10-06T02:23:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d4eaf1700 1 -- 172.21.15.6:0/2517079490 learned_addr learned my addr 172.21.15.6:0/2517079490 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d4e2f0700 1 --2- 172.21.15.6:0/2517079490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d30004d50 0x7f9d481536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d4daef700 1 --2- 172.21.15.6:0/2517079490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4816c9c0 0x7f9d48169b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d4eaf1700 1 -- 172.21.15.6:0/2517079490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d30004d50 msgr2=0x7f9d481536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d4eaf1700 1 --2- 172.21.15.6:0/2517079490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d30004d50 0x7f9d481536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d4eaf1700 1 -- 172.21.15.6:0/2517079490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4816c9c0 msgr2=0x7f9d48169b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d4eaf1700 1 --2- 172.21.15.6:0/2517079490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4816c9c0 0x7f9d48169b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d4eaf1700 1 -- 172.21.15.6:0/2517079490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4816ce30 con 0x7f9d48151a60 2023-10-06T02:23:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d4eaf1700 1 --2- 172.21.15.6:0/2517079490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d48151a60 0x7f9d4814ff90 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f9d38016000 tx=0x7f9d3801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d467fc700 1 -- 172.21.15.6:0/2517079490 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d38022070 con 0x7f9d48151a60 2023-10-06T02:23:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d467fc700 1 -- 172.21.15.6:0/2517079490 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3800eb90 con 0x7f9d48151a60 2023-10-06T02:23:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d50554700 1 -- 172.21.15.6:0/2517079490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4816a060 con 0x7f9d48151a60 2023-10-06T02:23:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d467fc700 1 -- 172.21.15.6:0/2517079490 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3800e6b0 con 0x7f9d48151a60 2023-10-06T02:23:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.310+0000 7f9d50554700 1 -- 172.21.15.6:0/2517079490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4814dd10 con 0x7f9d48151a60 2023-10-06T02:23:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.311+0000 7f9d50554700 1 -- 172.21.15.6:0/2517079490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d48088760 con 0x7f9d48151a60 2023-10-06T02:23:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.312+0000 7f9d467fc700 1 -- 172.21.15.6:0/2517079490 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d3801c450 con 0x7f9d48151a60 2023-10-06T02:23:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.312+0000 7f9d467fc700 1 --2- 172.21.15.6:0/2517079490 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9d34066f30 0x7f9d340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.312+0000 7f9d467fc700 1 -- 172.21.15.6:0/2517079490 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f9d380862b0 con 0x7f9d48151a60 2023-10-06T02:23:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.312+0000 7f9d4e2f0700 1 --2- 172.21.15.6:0/2517079490 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9d34066f30 0x7f9d340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.313+0000 7f9d4e2f0700 1 --2- 172.21.15.6:0/2517079490 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9d34066f30 0x7f9d340693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9d40003230 tx=0x7f9d40009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.316+0000 7f9d467fc700 1 -- 172.21.15.6:0/2517079490 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d380531a0 con 0x7f9d48151a60 2023-10-06T02:23:23.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.509+0000 7f9d50554700 1 -- 172.21.15.6:0/2517079490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d4814e4a0 con 0x7f9d48151a60 2023-10-06T02:23:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.510+0000 7f9d467fc700 1 -- 172.21.15.6:0/2517079490 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v70) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9d380567c0 con 0x7f9d48151a60 2023-10-06T02:23:23.536 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-06T02:23:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.512+0000 7f9d50554700 1 -- 172.21.15.6:0/2517079490 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9d34066f30 msgr2=0x7f9d340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.512+0000 7f9d50554700 1 --2- 172.21.15.6:0/2517079490 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9d34066f30 0x7f9d340693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9d40003230 tx=0x7f9d40009040 comp rx=0 tx=0).stop 2023-10-06T02:23:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.512+0000 7f9d50554700 1 -- 172.21.15.6:0/2517079490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d48151a60 msgr2=0x7f9d4814ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.512+0000 7f9d50554700 1 --2- 172.21.15.6:0/2517079490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d48151a60 0x7f9d4814ff90 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f9d38016000 tx=0x7f9d3801a000 comp rx=0 tx=0).stop 2023-10-06T02:23:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.512+0000 7f9d50554700 1 -- 172.21.15.6:0/2517079490 shutdown_connections 2023-10-06T02:23:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.512+0000 7f9d50554700 1 --2- 172.21.15.6:0/2517079490 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9d34066f30 0x7f9d340693e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.512+0000 7f9d50554700 1 --2- 172.21.15.6:0/2517079490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d48151a60 0x7f9d4814ff90 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.512+0000 7f9d50554700 1 --2- 172.21.15.6:0/2517079490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d30004d50 0x7f9d481536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.512+0000 7f9d50554700 1 --2- 172.21.15.6:0/2517079490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4816c9c0 0x7f9d48169b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.512+0000 7f9d50554700 1 -- 172.21.15.6:0/2517079490 >> 172.21.15.6:0/2517079490 conn(0x7f9d4806a220 msgr2=0x7f9d480af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:23.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.512+0000 7f9d50554700 1 -- 172.21.15.6:0/2517079490 shutdown_connections 2023-10-06T02:23:23.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.512+0000 7f9d50554700 1 -- 172.21.15.6:0/2517079490 wait complete. 2023-10-06T02:23:23.540 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.658+0000 7fe2959b6700 1 Processor -- start 2023-10-06T02:23:23.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.658+0000 7fe2959b6700 1 -- start start 2023-10-06T02:23:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.659+0000 7fe2959b6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe2900cb920 0x7fe29015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.659+0000 7fe2959b6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe290153f40 0x7fe29015a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.659+0000 7fe2959b6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2900ce7b0 con 0x7fe290153b70 2023-10-06T02:23:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.659+0000 7fe2959b6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29015e350 con 0x7fe2900cb920 2023-10-06T02:23:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.659+0000 7fe2959b6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29015adb0 con 0x7fe290153f40 2023-10-06T02:23:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.659+0000 7fe28f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe290153f40 0x7fe29015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.659+0000 7fe28e7fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe2900cb920 0x7fe29015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.659+0000 7fe28f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe290153f40 0x7fe29015a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:51954/0 (socket says 172.21.15.6:51954) 2023-10-06T02:23:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.659+0000 7fe28e7fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe2900cb920 0x7fe29015d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:58510/0 (socket says 172.21.15.6:58510) 2023-10-06T02:23:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.659+0000 7fe28f7fe700 1 -- 172.21.15.6:0/3838965353 learned_addr learned my addr 172.21.15.6:0/3838965353 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.659+0000 7fe28effd700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe290153b70 0x7fe2900cb210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:54938/0 (socket says 172.21.15.6:54938) 2023-10-06T02:23:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.660+0000 7fe28f7fe700 1 -- 172.21.15.6:0/3838965353 >> v2:172.21.15.175:3300/0 conn(0x7fe2900cb920 msgr2=0x7fe29015d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.660+0000 7fe28f7fe700 1 --2- 172.21.15.6:0/3838965353 >> v2:172.21.15.175:3300/0 conn(0x7fe2900cb920 0x7fe29015d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.660+0000 7fe28f7fe700 1 -- 172.21.15.6:0/3838965353 >> v1:172.21.15.175:6789/0 conn(0x7fe290153b70 legacy=0x7fe2900cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.660+0000 7fe28f7fe700 1 -- 172.21.15.6:0/3838965353 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29015dab0 con 0x7fe290153f40 2023-10-06T02:23:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.660+0000 7fe28e7fc700 1 --2- 172.21.15.6:0/3838965353 >> v2:172.21.15.175:3300/0 conn(0x7fe2900cb920 0x7fe29015d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.660+0000 7fe28f7fe700 1 --2- 172.21.15.6:0/3838965353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe290153f40 0x7fe29015a870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe280009f20 tx=0x7fe280009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d8bb30086fc6632 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.660+0000 7fe28dffb700 1 -- 172.21.15.6:0/3838965353 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28000e070 con 0x7fe290153f40 2023-10-06T02:23:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.660+0000 7fe28dffb700 1 -- 172.21.15.6:0/3838965353 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28000b9d0 con 0x7fe290153f40 2023-10-06T02:23:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.660+0000 7fe28dffb700 1 -- 172.21.15.6:0/3838965353 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2800092e0 con 0x7fe290153f40 2023-10-06T02:23:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.661+0000 7fe2959b6700 1 -- 172.21.15.6:0/3838965353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe290153f40 msgr2=0x7fe29015a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.661+0000 7fe2959b6700 1 --2- 172.21.15.6:0/3838965353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe290153f40 0x7fe29015a870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe280009f20 tx=0x7fe280009840 comp rx=0 tx=0).stop 2023-10-06T02:23:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.661+0000 7fe2959b6700 1 -- 172.21.15.6:0/3838965353 shutdown_connections 2023-10-06T02:23:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.661+0000 7fe2959b6700 1 --2- 172.21.15.6:0/3838965353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe290153f40 0x7fe29015a870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.661+0000 7fe2959b6700 1 --2- 172.21.15.6:0/3838965353 >> v2:172.21.15.175:3300/0 conn(0x7fe2900cb920 0x7fe29015d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.661+0000 7fe2959b6700 1 -- 172.21.15.6:0/3838965353 >> 172.21.15.6:0/3838965353 conn(0x7fe290068680 msgr2=0x7fe290068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.661+0000 7fe2959b6700 1 -- 172.21.15.6:0/3838965353 shutdown_connections 2023-10-06T02:23:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.661+0000 7fe2959b6700 1 -- 172.21.15.6:0/3838965353 wait complete. 2023-10-06T02:23:23.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.662+0000 7fe2959b6700 1 Processor -- start 2023-10-06T02:23:23.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.662+0000 7fe2959b6700 1 -- start start 2023-10-06T02:23:23.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe2959b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2900cb920 0x7fe29014b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:23.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe2959b6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe290153b70 0x7fe29014f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:23.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe2959b6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe290153f40 0x7fe2900c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:23.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe2959b6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900d0d50 con 0x7fe2900cb920 2023-10-06T02:23:23.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe2959b6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900d0140 con 0x7fe290153f40 2023-10-06T02:23:23.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe2959b6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900d0420 con 0x7fe290153b70 2023-10-06T02:23:23.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe28effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2900cb920 0x7fe29014b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:23.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe28effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2900cb920 0x7fe29014b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34020/0 (socket says 172.21.15.6:34020) 2023-10-06T02:23:23.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe28effd700 1 -- 172.21.15.6:0/4065361021 learned_addr learned my addr 172.21.15.6:0/4065361021 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:23.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe28e7fc700 1 --2- 172.21.15.6:0/4065361021 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe290153b70 0x7fe29014f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:23.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe28f7fe700 1 --2- 172.21.15.6:0/4065361021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe290153f40 0x7fe2900c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:23.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe28effd700 1 -- 172.21.15.6:0/4065361021 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe290153b70 msgr2=0x7fe29014f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:23.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe28effd700 1 --2- 172.21.15.6:0/4065361021 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe290153b70 0x7fe29014f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe28effd700 1 -- 172.21.15.6:0/4065361021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe290153f40 msgr2=0x7fe2900c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:23.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe28effd700 1 --2- 172.21.15.6:0/4065361021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe290153f40 0x7fe2900c5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe28effd700 1 -- 172.21.15.6:0/4065361021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe278009420 con 0x7fe2900cb920 2023-10-06T02:23:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe28effd700 1 --2- 172.21.15.6:0/4065361021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2900cb920 0x7fe29014b040 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fe28800c7c0 tx=0x7fe288007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe286ffd700 1 -- 172.21.15.6:0/4065361021 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe288005a70 con 0x7fe2900cb920 2023-10-06T02:23:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe286ffd700 1 -- 172.21.15.6:0/4065361021 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe288005bd0 con 0x7fe2900cb920 2023-10-06T02:23:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.663+0000 7fe286ffd700 1 -- 172.21.15.6:0/4065361021 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2880070d0 con 0x7fe2900cb920 2023-10-06T02:23:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.664+0000 7fe2959b6700 1 -- 172.21.15.6:0/4065361021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe280009ae0 con 0x7fe2900cb920 2023-10-06T02:23:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.664+0000 7fe2959b6700 1 -- 172.21.15.6:0/4065361021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2900d09e0 con 0x7fe2900cb920 2023-10-06T02:23:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.664+0000 7fe2959b6700 1 -- 172.21.15.6:0/4065361021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe290088980 con 0x7fe2900cb920 2023-10-06T02:23:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.665+0000 7fe286ffd700 1 -- 172.21.15.6:0/4065361021 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe288007480 con 0x7fe2900cb920 2023-10-06T02:23:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.665+0000 7fe286ffd700 1 --2- 172.21.15.6:0/4065361021 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe270066f30 0x7fe2700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.665+0000 7fe286ffd700 1 -- 172.21.15.6:0/4065361021 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fe288083d40 con 0x7fe2900cb920 2023-10-06T02:23:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.665+0000 7fe28e7fc700 1 --2- 172.21.15.6:0/4065361021 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe270066f30 0x7fe2700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.666+0000 7fe28e7fc700 1 --2- 172.21.15.6:0/4065361021 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe270066f30 0x7fe2700693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe2901508e0 tx=0x7fe2780091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.670+0000 7fe286ffd700 1 -- 172.21.15.6:0/4065361021 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe288050bb0 con 0x7fe2900cb920 2023-10-06T02:23:23.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.910+0000 7fe2959b6700 1 -- 172.21.15.6:0/4065361021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe290068420 con 0x7fe2900cb920 2023-10-06T02:23:23.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.910+0000 7fe286ffd700 1 -- 172.21.15.6:0/4065361021 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4592 (secure 0 0 0) 0x7fe288017020 con 0x7fe2900cb920 2023-10-06T02:23:23.912 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:23.913 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":63,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/400475961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":400475961},{"type":"v1","addr":"172.21.15.175:6837","nonce":400475961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6579,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/628657260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":628657260},{"type":"v1","addr":"172.21.15.6:6834","nonce":628657260}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:51.206714+0000","modified":"2023-10-06T02:21:40.079021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":16,"addr":"172.21.15.6:6835/1006897436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1006897436},{"type":"v1","addr":"172.21.15.6:6835","nonce":1006897436}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:23:23.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.912+0000 7fe2959b6700 1 -- 172.21.15.6:0/4065361021 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe270066f30 msgr2=0x7fe2700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:23.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.912+0000 7fe2959b6700 1 --2- 172.21.15.6:0/4065361021 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe270066f30 0x7fe2700693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe2901508e0 tx=0x7fe2780091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.912+0000 7fe2959b6700 1 -- 172.21.15.6:0/4065361021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2900cb920 msgr2=0x7fe29014b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:23.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.912+0000 7fe2959b6700 1 --2- 172.21.15.6:0/4065361021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2900cb920 0x7fe29014b040 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fe28800c7c0 tx=0x7fe288007f70 comp rx=0 tx=0).stop 2023-10-06T02:23:23.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.912+0000 7fe2959b6700 1 -- 172.21.15.6:0/4065361021 shutdown_connections 2023-10-06T02:23:23.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.912+0000 7fe2959b6700 1 --2- 172.21.15.6:0/4065361021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe290153f40 0x7fe2900c5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.912+0000 7fe2959b6700 1 --2- 172.21.15.6:0/4065361021 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe270066f30 0x7fe2700693e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.912+0000 7fe2959b6700 1 --2- 172.21.15.6:0/4065361021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2900cb920 0x7fe29014b040 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.912+0000 7fe2959b6700 1 --2- 172.21.15.6:0/4065361021 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe290153b70 0x7fe29014f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:23.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.912+0000 7fe2959b6700 1 -- 172.21.15.6:0/4065361021 >> 172.21.15.6:0/4065361021 conn(0x7fe290068680 msgr2=0x7fe290086ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:23.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.912+0000 7fe2959b6700 1 -- 172.21.15.6:0/4065361021 shutdown_connections 2023-10-06T02:23:23.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:23.912+0000 7fe2959b6700 1 -- 172.21.15.6:0/4065361021 wait complete. 2023-10-06T02:23:23.917 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 63 2023-10-06T02:23:23.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:24.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.044+0000 7f20a6198700 1 Processor -- start 2023-10-06T02:23:24.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.044+0000 7f20a6198700 1 -- start start 2023-10-06T02:23:24.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.045+0000 7f20a6198700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20a0153a10 0x7f20a00cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.045+0000 7f20a6198700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f20a00d05a0 0x7f20a015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.045+0000 7f20a6198700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a00ceea0 con 0x7f20a00cf870 2023-10-06T02:23:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.045+0000 7f20a6198700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a0069140 con 0x7f20a00d05a0 2023-10-06T02:23:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.045+0000 7f20a6198700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a015a690 con 0x7f20a0153a10 2023-10-06T02:23:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.045+0000 7f20a4995700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f20a00cf870 0x7f20a00cfe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59664/0 (socket says 172.21.15.6:59664) 2023-10-06T02:23:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.045+0000 7f20a4995700 1 -- 172.21.15.6:0/945435498 learned_addr learned my addr 172.21.15.6:0/945435498 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.045+0000 7f209ffff700 1 -- 172.21.15.6:0/945435498 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857615930 0 0) 0x7f20a00ceea0 con 0x7f20a00cf870 2023-10-06T02:23:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.045+0000 7f209ffff700 1 -- 172.21.15.6:0/945435498 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2088003570 con 0x7f20a00cf870 2023-10-06T02:23:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.045+0000 7f20a5196700 1 --2- 172.21.15.6:0/945435498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20a0153a10 0x7f20a00cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.045+0000 7f20a5997700 1 --2- 172.21.15.6:0/945435498 >> v2:172.21.15.175:3300/0 conn(0x7f20a00d05a0 0x7f20a015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f209ffff700 1 -- 172.21.15.6:0/945435498 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2955837054 0 0) 0x7f2088003570 con 0x7f20a00cf870 2023-10-06T02:23:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f209ffff700 1 -- 172.21.15.6:0/945435498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20a0153a10 msgr2=0x7f20a00cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f209ffff700 1 --2- 172.21.15.6:0/945435498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20a0153a10 0x7f20a00cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f209ffff700 1 -- 172.21.15.6:0/945435498 >> v2:172.21.15.175:3300/0 conn(0x7f20a00d05a0 msgr2=0x7f20a015abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f209ffff700 1 --2- 172.21.15.6:0/945435498 >> v2:172.21.15.175:3300/0 conn(0x7f20a00d05a0 0x7f20a015abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f209ffff700 1 -- 172.21.15.6:0/945435498 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a00ce850 con 0x7f20a00cf870 2023-10-06T02:23:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f209ffff700 1 -- 172.21.15.6:0/945435498 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f2094001470 con 0x7f20a00cf870 2023-10-06T02:23:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f209ffff700 1 -- 172.21.15.6:0/945435498 >> v1:172.21.15.6:6789/0 conn(0x7f20a00cf870 legacy=0x7f20a00cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f209ffff700 1 --2- 172.21.15.6:0/945435498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2088003a60 0x7f2088003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f209ffff700 1 --2- 172.21.15.6:0/945435498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2088004810 0x7f2088004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f209ffff700 1 --2- 172.21.15.6:0/945435498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20a0153a10 0x7f20880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f209ffff700 1 -- 172.21.15.6:0/945435498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a0069140 con 0x7f2088003a60 2023-10-06T02:23:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f209ffff700 1 -- 172.21.15.6:0/945435498 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a015a690 con 0x7f2088004810 2023-10-06T02:23:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f209ffff700 1 -- 172.21.15.6:0/945435498 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208800ba60 con 0x7f20a0153a10 2023-10-06T02:23:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f20a5196700 1 --2- 172.21.15.6:0/945435498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2088003a60 0x7f2088003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f20a4995700 1 --2- 172.21.15.6:0/945435498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2088004810 0x7f2088004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f20a5997700 1 --2- 172.21.15.6:0/945435498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20a0153a10 0x7f20880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f20a5196700 1 -- 172.21.15.6:0/945435498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20a0153a10 msgr2=0x7f20880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f20a5196700 1 --2- 172.21.15.6:0/945435498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20a0153a10 0x7f20880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f20a5196700 1 -- 172.21.15.6:0/945435498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2088004810 msgr2=0x7f2088004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f20a5196700 1 --2- 172.21.15.6:0/945435498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2088004810 0x7f2088004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f20a5196700 1 -- 172.21.15.6:0/945435498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2088003570 con 0x7f2088003a60 2023-10-06T02:23:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.046+0000 7f20a5196700 1 --2- 172.21.15.6:0/945435498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2088003a60 0x7f2088003e70 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f2098009c30 tx=0x7f20980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85aeb6350bfc626 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.047+0000 7f209ffff700 1 -- 172.21.15.6:0/945435498 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209800e710 con 0x7f2088003a60 2023-10-06T02:23:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.047+0000 7f209ffff700 1 -- 172.21.15.6:0/945435498 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209800e870 con 0x7f2088003a60 2023-10-06T02:23:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.047+0000 7f209ffff700 1 -- 172.21.15.6:0/945435498 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209800ec30 con 0x7f2088003a60 2023-10-06T02:23:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.047+0000 7f20a6198700 1 -- 172.21.15.6:0/945435498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2088003a60 msgr2=0x7f2088003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.047+0000 7f20a6198700 1 --2- 172.21.15.6:0/945435498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2088003a60 0x7f2088003e70 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f2098009c30 tx=0x7f20980091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.047+0000 7f20a5997700 1 -- 172.21.15.6:0/945435498 reap_dead start 2023-10-06T02:23:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.047+0000 7f20a6198700 1 -- 172.21.15.6:0/945435498 shutdown_connections 2023-10-06T02:23:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.047+0000 7f20a6198700 1 -- 172.21.15.6:0/945435498 >> 172.21.15.6:0/945435498 conn(0x7f20a006ac00 msgr2=0x7f20a0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.047+0000 7f20a6198700 1 -- 172.21.15.6:0/945435498 shutdown_connections 2023-10-06T02:23:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.047+0000 7f20a6198700 1 -- 172.21.15.6:0/945435498 wait complete. 2023-10-06T02:23:24.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.048+0000 7f20a6198700 1 Processor -- start 2023-10-06T02:23:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.048+0000 7f20a6198700 1 -- start start 2023-10-06T02:23:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.049+0000 7f20a6198700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2088003a60 0x7f20a01567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.049+0000 7f20a6198700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a0156d00 0x7f20a00b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.049+0000 7f20a6198700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a00b1520 0x7f20a0158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.049+0000 7f20a6198700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a016b030 con 0x7f20a00b1520 2023-10-06T02:23:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.049+0000 7f20a6198700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a00aff40 con 0x7f20a0156d00 2023-10-06T02:23:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.049+0000 7f20a6198700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a00b0220 con 0x7f2088003a60 2023-10-06T02:23:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.049+0000 7f20a5997700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a00b1520 0x7f20a0158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.049+0000 7f20a5997700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a00b1520 0x7f20a0158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34030/0 (socket says 172.21.15.6:34030) 2023-10-06T02:23:24.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.049+0000 7f20a5997700 1 -- 172.21.15.6:0/1748257272 learned_addr learned my addr 172.21.15.6:0/1748257272 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:24.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.050+0000 7f20a5196700 1 --2- 172.21.15.6:0/1748257272 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2088003a60 0x7f20a01567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.050+0000 7f20a4995700 1 --2- 172.21.15.6:0/1748257272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a0156d00 0x7f20a00b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.050+0000 7f20a5997700 1 -- 172.21.15.6:0/1748257272 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2088003a60 msgr2=0x7f20a01567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.050+0000 7f20a5997700 1 --2- 172.21.15.6:0/1748257272 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2088003a60 0x7f20a01567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.050+0000 7f20a5997700 1 -- 172.21.15.6:0/1748257272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a0156d00 msgr2=0x7f20a00b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.050+0000 7f20a5997700 1 --2- 172.21.15.6:0/1748257272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a0156d00 0x7f20a00b0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.050+0000 7f20a5997700 1 -- 172.21.15.6:0/1748257272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a00b0500 con 0x7f20a00b1520 2023-10-06T02:23:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.050+0000 7f20a4995700 1 --2- 172.21.15.6:0/1748257272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a0156d00 0x7f20a00b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.050+0000 7f20a5997700 1 --2- 172.21.15.6:0/1748257272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a00b1520 0x7f20a0158830 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f20900094d0 tx=0x7f209000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.050+0000 7f209d7fa700 1 -- 172.21.15.6:0/1748257272 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209000e040 con 0x7f20a00b1520 2023-10-06T02:23:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.050+0000 7f209d7fa700 1 -- 172.21.15.6:0/1748257272 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209000f040 con 0x7f20a00b1520 2023-10-06T02:23:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.050+0000 7f20a6198700 1 -- 172.21.15.6:0/1748257272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a00b07e0 con 0x7f20a00b1520 2023-10-06T02:23:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.050+0000 7f209d7fa700 1 -- 172.21.15.6:0/1748257272 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209000fe20 con 0x7f20a00b1520 2023-10-06T02:23:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.050+0000 7f20a6198700 1 -- 172.21.15.6:0/1748257272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a0158d70 con 0x7f20a00b1520 2023-10-06T02:23:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.051+0000 7f20a6198700 1 -- 172.21.15.6:0/1748257272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a00b0d00 con 0x7f20a00b1520 2023-10-06T02:23:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.051+0000 7f209d7fa700 1 -- 172.21.15.6:0/1748257272 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2090015640 con 0x7f20a00b1520 2023-10-06T02:23:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.052+0000 7f209d7fa700 1 --2- 172.21.15.6:0/1748257272 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f208c066f30 0x7f208c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.052+0000 7f209d7fa700 1 -- 172.21.15.6:0/1748257272 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f2090085100 con 0x7f20a00b1520 2023-10-06T02:23:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.052+0000 7f20a5196700 1 --2- 172.21.15.6:0/1748257272 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f208c066f30 0x7f208c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.052+0000 7f20a5196700 1 --2- 172.21.15.6:0/1748257272 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f208c066f30 0x7f208c0693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f20980091e0 tx=0x7f209801a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.056+0000 7f209d7fa700 1 -- 172.21.15.6:0/1748257272 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20a00b0d00 con 0x7f20a00b1520 2023-10-06T02:23:24.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.250+0000 7f20a6198700 1 -- 172.21.15.6:0/1748257272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20a00b0d00 con 0x7f20a00b1520 2023-10-06T02:23:24.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.251+0000 7f209d7fa700 1 -- 172.21.15.6:0/1748257272 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+17382 (secure 0 0 0) 0x7f20a00b0d00 con 0x7f20a00b1520 2023-10-06T02:23:24.253 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:24.253 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:21:37.070484+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:20:48.992600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T02:20:50.177537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6832/3777949337":"2023-10-07T02:21:37.070416+0000","172.21.15.6:6834/3777949337":"2023-10-07T02:21:37.070416+0000","172.21.15.175:6837/1125020360":"2023-10-07T02:21:06.890609+0000","172.21.15.175:6835/1125020360":"2023-10-07T02:21:06.890609+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:24.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.253+0000 7f20a6198700 1 -- 172.21.15.6:0/1748257272 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f208c066f30 msgr2=0x7f208c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.253+0000 7f20a6198700 1 --2- 172.21.15.6:0/1748257272 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f208c066f30 0x7f208c0693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f20980091e0 tx=0x7f209801a000 comp rx=0 tx=0).stop 2023-10-06T02:23:24.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.253+0000 7f20a6198700 1 -- 172.21.15.6:0/1748257272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a00b1520 msgr2=0x7f20a0158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.253+0000 7f20a6198700 1 --2- 172.21.15.6:0/1748257272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a00b1520 0x7f20a0158830 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f20900094d0 tx=0x7f209000b040 comp rx=0 tx=0).stop 2023-10-06T02:23:24.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.254+0000 7f20a6198700 1 -- 172.21.15.6:0/1748257272 shutdown_connections 2023-10-06T02:23:24.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.254+0000 7f20a6198700 1 --2- 172.21.15.6:0/1748257272 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f208c066f30 0x7f208c0693e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.254+0000 7f20a6198700 1 --2- 172.21.15.6:0/1748257272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a00b1520 0x7f20a0158830 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.254+0000 7f20a6198700 1 --2- 172.21.15.6:0/1748257272 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2088003a60 0x7f20a01567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.254+0000 7f20a6198700 1 --2- 172.21.15.6:0/1748257272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a0156d00 0x7f20a00b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.254+0000 7f20a6198700 1 -- 172.21.15.6:0/1748257272 >> 172.21.15.6:0/1748257272 conn(0x7f20a006ac00 msgr2=0x7f20a00b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:24.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.254+0000 7f20a6198700 1 -- 172.21.15.6:0/1748257272 shutdown_connections 2023-10-06T02:23:24.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.254+0000 7f20a6198700 1 -- 172.21.15.6:0/1748257272 wait complete. 2023-10-06T02:23:24.267 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:23:24.267 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.384+0000 7f5330019700 1 Processor -- start 2023-10-06T02:23:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.384+0000 7f5330019700 1 -- start start 2023-10-06T02:23:24.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.385+0000 7f5330019700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53280b3c50 0x7f532815b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.385+0000 7f5330019700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f532815bcd0 0x7f532815a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.385+0000 7f5330019700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53280afb90 con 0x7f532815b3c0 2023-10-06T02:23:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.385+0000 7f5330019700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53280b2310 con 0x7f53280b3c50 2023-10-06T02:23:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.385+0000 7f5330019700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53280b25f0 con 0x7f532815bcd0 2023-10-06T02:23:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.385+0000 7f532d5b4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53280b3c50 0x7f532815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.385+0000 7f532d5b4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53280b3c50 0x7f532815b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34036/0 (socket says 172.21.15.6:34036) 2023-10-06T02:23:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.385+0000 7f532d5b4700 1 -- 172.21.15.6:0/2615727481 learned_addr learned my addr 172.21.15.6:0/2615727481 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.386+0000 7f532e5b6700 1 --2- 172.21.15.6:0/2615727481 >> v2:172.21.15.175:3300/0 conn(0x7f532815bcd0 0x7f532815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.386+0000 7f532d5b4700 1 -- 172.21.15.6:0/2615727481 >> v2:172.21.15.175:3300/0 conn(0x7f532815bcd0 msgr2=0x7f532815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.386+0000 7f532d5b4700 1 --2- 172.21.15.6:0/2615727481 >> v2:172.21.15.175:3300/0 conn(0x7f532815bcd0 0x7f532815a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.386+0000 7f532d5b4700 1 -- 172.21.15.6:0/2615727481 >> v1:172.21.15.175:6789/0 conn(0x7f532815b3c0 legacy=0x7f5328097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.386+0000 7f532d5b4700 1 -- 172.21.15.6:0/2615727481 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53280af820 con 0x7f53280b3c50 2023-10-06T02:23:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.386+0000 7f532d5b4700 1 --2- 172.21.15.6:0/2615727481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53280b3c50 0x7f532815b790 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f532806f100 tx=0x7f531c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656cd4ae824c7639 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:24.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.386+0000 7f532cdb3700 1 -- 172.21.15.6:0/2615727481 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c00b860 con 0x7f53280b3c50 2023-10-06T02:23:24.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.386+0000 7f532cdb3700 1 -- 172.21.15.6:0/2615727481 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c00b9c0 con 0x7f53280b3c50 2023-10-06T02:23:24.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.386+0000 7f532cdb3700 1 -- 172.21.15.6:0/2615727481 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c00bd80 con 0x7f53280b3c50 2023-10-06T02:23:24.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.387+0000 7f5330019700 1 -- 172.21.15.6:0/2615727481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53280b3c50 msgr2=0x7f532815b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.387+0000 7f5330019700 1 --2- 172.21.15.6:0/2615727481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53280b3c50 0x7f532815b790 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f532806f100 tx=0x7f531c009250 comp rx=0 tx=0).stop 2023-10-06T02:23:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.387+0000 7f5330019700 1 -- 172.21.15.6:0/2615727481 shutdown_connections 2023-10-06T02:23:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.387+0000 7f5330019700 1 --2- 172.21.15.6:0/2615727481 >> v2:172.21.15.175:3300/0 conn(0x7f532815bcd0 0x7f532815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.387+0000 7f5330019700 1 --2- 172.21.15.6:0/2615727481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53280b3c50 0x7f532815b790 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.387+0000 7f5330019700 1 -- 172.21.15.6:0/2615727481 >> 172.21.15.6:0/2615727481 conn(0x7f5328067910 msgr2=0x7f53280ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.387+0000 7f5330019700 1 -- 172.21.15.6:0/2615727481 shutdown_connections 2023-10-06T02:23:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.387+0000 7f5330019700 1 -- 172.21.15.6:0/2615727481 wait complete. 2023-10-06T02:23:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.388+0000 7f5330019700 1 Processor -- start 2023-10-06T02:23:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.388+0000 7f5330019700 1 -- start start 2023-10-06T02:23:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f5330019700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53280b3c50 0x7f5328156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f5330019700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f532815b3c0 0x7f53280c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f5330019700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532815bcd0 0x7f53280c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f5330019700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53280c3260 con 0x7f532815bcd0 2023-10-06T02:23:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f5330019700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53280c34b0 con 0x7f532815b3c0 2023-10-06T02:23:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f5330019700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53280c3790 con 0x7f53280b3c50 2023-10-06T02:23:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f532e5b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532815bcd0 0x7f53280c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f532e5b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532815bcd0 0x7f53280c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34052/0 (socket says 172.21.15.6:34052) 2023-10-06T02:23:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f532e5b6700 1 -- 172.21.15.6:0/1120504841 learned_addr learned my addr 172.21.15.6:0/1120504841 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f532ddb5700 1 --2- 172.21.15.6:0/1120504841 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53280b3c50 0x7f5328156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f532d5b4700 1 --2- 172.21.15.6:0/1120504841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f532815b3c0 0x7f53280c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f532e5b6700 1 -- 172.21.15.6:0/1120504841 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53280b3c50 msgr2=0x7f5328156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f532e5b6700 1 --2- 172.21.15.6:0/1120504841 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53280b3c50 0x7f5328156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f532e5b6700 1 -- 172.21.15.6:0/1120504841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f532815b3c0 msgr2=0x7f53280c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f532e5b6700 1 --2- 172.21.15.6:0/1120504841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f532815b3c0 0x7f53280c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f532e5b6700 1 -- 172.21.15.6:0/1120504841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c0094f0 con 0x7f532815bcd0 2023-10-06T02:23:24.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f532e5b6700 1 --2- 172.21.15.6:0/1120504841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532815bcd0 0x7f53280c6150 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f5318009fa0 tx=0x7f5318009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:24.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f5325ffb700 1 -- 172.21.15.6:0/1120504841 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531800ebc0 con 0x7f532815bcd0 2023-10-06T02:23:24.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f5325ffb700 1 -- 172.21.15.6:0/1120504841 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531800ed20 con 0x7f532815bcd0 2023-10-06T02:23:24.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f5330019700 1 -- 172.21.15.6:0/1120504841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53280c3a70 con 0x7f532815bcd0 2023-10-06T02:23:24.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.389+0000 7f5325ffb700 1 -- 172.21.15.6:0/1120504841 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318014670 con 0x7f532815bcd0 2023-10-06T02:23:24.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.390+0000 7f5330019700 1 -- 172.21.15.6:0/1120504841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53280c4030 con 0x7f532815bcd0 2023-10-06T02:23:24.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.391+0000 7f5330019700 1 -- 172.21.15.6:0/1120504841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53280c4220 con 0x7f532815bcd0 2023-10-06T02:23:24.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.391+0000 7f5325ffb700 1 -- 172.21.15.6:0/1120504841 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53180149e0 con 0x7f532815bcd0 2023-10-06T02:23:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.391+0000 7f5325ffb700 1 --2- 172.21.15.6:0/1120504841 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5314066f30 0x7f53140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.392+0000 7f5325ffb700 1 -- 172.21.15.6:0/1120504841 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f5318084fc0 con 0x7f532815bcd0 2023-10-06T02:23:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.392+0000 7f532ddb5700 1 --2- 172.21.15.6:0/1120504841 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5314066f30 0x7f53140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.392+0000 7f532ddb5700 1 --2- 172.21.15.6:0/1120504841 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5314066f30 0x7f53140693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5320003a20 tx=0x7f5320007f10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:24.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.396+0000 7f5325ffb700 1 -- 172.21.15.6:0/1120504841 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5318051e30 con 0x7f532815bcd0 2023-10-06T02:23:24.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.633+0000 7f5330019700 1 -- 172.21.15.6:0/1120504841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f532806e8d0 con 0x7f532815bcd0 2023-10-06T02:23:24.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.634+0000 7f5325ffb700 1 -- 172.21.15.6:0/1120504841 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f5318055450 con 0x7f532815bcd0 2023-10-06T02:23:24.636 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:24.636 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":63,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/400475961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":400475961},{"type":"v1","addr":"172.21.15.175:6837","nonce":400475961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6579,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/628657260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":628657260},{"type":"v1","addr":"172.21.15.6:6834","nonce":628657260}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:51.206714+0000","modified":"2023-10-06T02:21:40.079021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":16,"addr":"172.21.15.6:6835/1006897436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1006897436},{"type":"v1","addr":"172.21.15.6:6835","nonce":1006897436}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:23:24.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.636+0000 7f5330019700 1 -- 172.21.15.6:0/1120504841 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5314066f30 msgr2=0x7f53140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.636+0000 7f5330019700 1 --2- 172.21.15.6:0/1120504841 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5314066f30 0x7f53140693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5320003a20 tx=0x7f5320007f10 comp rx=0 tx=0).stop 2023-10-06T02:23:24.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.636+0000 7f5330019700 1 -- 172.21.15.6:0/1120504841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532815bcd0 msgr2=0x7f53280c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.636+0000 7f5330019700 1 --2- 172.21.15.6:0/1120504841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532815bcd0 0x7f53280c6150 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f5318009fa0 tx=0x7f5318009900 comp rx=0 tx=0).stop 2023-10-06T02:23:24.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.636+0000 7f5330019700 1 -- 172.21.15.6:0/1120504841 shutdown_connections 2023-10-06T02:23:24.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.636+0000 7f5330019700 1 --2- 172.21.15.6:0/1120504841 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5314066f30 0x7f53140693e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.636+0000 7f5330019700 1 --2- 172.21.15.6:0/1120504841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532815bcd0 0x7f53280c6150 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.636+0000 7f5330019700 1 --2- 172.21.15.6:0/1120504841 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53280b3c50 0x7f5328156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.636+0000 7f5330019700 1 --2- 172.21.15.6:0/1120504841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f532815b3c0 0x7f53280c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.636+0000 7f5330019700 1 -- 172.21.15.6:0/1120504841 >> 172.21.15.6:0/1120504841 conn(0x7f5328067910 msgr2=0x7f532806de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:24.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.636+0000 7f5330019700 1 -- 172.21.15.6:0/1120504841 shutdown_connections 2023-10-06T02:23:24.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.636+0000 7f5330019700 1 -- 172.21.15.6:0/1120504841 wait complete. 2023-10-06T02:23:24.639 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 63 2023-10-06T02:23:24.650 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:24.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.767+0000 7f9631ed9700 1 Processor -- start 2023-10-06T02:23:24.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.768+0000 7f9631ed9700 1 -- start start 2023-10-06T02:23:24.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.768+0000 7f9631ed9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f962c0af8b0 0x7f962c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.768+0000 7f9631ed9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f962c0b27f0 0x7f962c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.768+0000 7f9631ed9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f962c15e190 con 0x7f962c0af4e0 2023-10-06T02:23:24.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.768+0000 7f9631ed9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962c0b1910 con 0x7f962c0b27f0 2023-10-06T02:23:24.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.768+0000 7f9631ed9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0cb650 con 0x7f962c0af8b0 2023-10-06T02:23:24.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.769+0000 7f962bfff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f962c0b27f0 0x7f962c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.769+0000 7f962affd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f962c0af8b0 0x7f962c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.769+0000 7f962bfff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f962c0b27f0 0x7f962c15d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:58578/0 (socket says 172.21.15.6:58578) 2023-10-06T02:23:24.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.769+0000 7f962b7fe700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f962c0af4e0 0x7f962c0b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:54954/0 (socket says 172.21.15.6:54954) 2023-10-06T02:23:24.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.769+0000 7f962bfff700 1 -- 172.21.15.6:0/3712551528 learned_addr learned my addr 172.21.15.6:0/3712551528 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:24.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.769+0000 7f962affd700 1 -- 172.21.15.6:0/3712551528 >> v2:172.21.15.175:3300/0 conn(0x7f962c0b27f0 msgr2=0x7f962c15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:24.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.769+0000 7f962affd700 1 --2- 172.21.15.6:0/3712551528 >> v2:172.21.15.175:3300/0 conn(0x7f962c0b27f0 0x7f962c15d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.769+0000 7f962affd700 1 -- 172.21.15.6:0/3712551528 >> v1:172.21.15.175:6789/0 conn(0x7f962c0af4e0 legacy=0x7f962c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.769+0000 7f962affd700 1 -- 172.21.15.6:0/3712551528 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c0ccaf0 con 0x7f962c0af8b0 2023-10-06T02:23:24.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.769+0000 7f962bfff700 1 --2- 172.21.15.6:0/3712551528 >> v2:172.21.15.175:3300/0 conn(0x7f962c0b27f0 0x7f962c15d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:24.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.769+0000 7f962affd700 1 --2- 172.21.15.6:0/3712551528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f962c0af8b0 0x7f962c15d460 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f96200098e0 tx=0x7f96200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e33879f514bf5b07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:24.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.770+0000 7f962a7fc700 1 -- 172.21.15.6:0/3712551528 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962000b640 con 0x7f962c0af8b0 2023-10-06T02:23:24.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.770+0000 7f962a7fc700 1 -- 172.21.15.6:0/3712551528 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962000b7a0 con 0x7f962c0af8b0 2023-10-06T02:23:24.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.770+0000 7f962a7fc700 1 -- 172.21.15.6:0/3712551528 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962000bb40 con 0x7f962c0af8b0 2023-10-06T02:23:24.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.770+0000 7f9631ed9700 1 -- 172.21.15.6:0/3712551528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f962c0af8b0 msgr2=0x7f962c15d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.770+0000 7f9631ed9700 1 --2- 172.21.15.6:0/3712551528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f962c0af8b0 0x7f962c15d460 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f96200098e0 tx=0x7f96200091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.770+0000 7f9631ed9700 1 -- 172.21.15.6:0/3712551528 shutdown_connections 2023-10-06T02:23:24.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.770+0000 7f9631ed9700 1 --2- 172.21.15.6:0/3712551528 >> v2:172.21.15.175:3300/0 conn(0x7f962c0b27f0 0x7f962c15d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.770+0000 7f9631ed9700 1 --2- 172.21.15.6:0/3712551528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f962c0af8b0 0x7f962c15d460 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.770+0000 7f9631ed9700 1 -- 172.21.15.6:0/3712551528 >> 172.21.15.6:0/3712551528 conn(0x7f962c068680 msgr2=0x7f962c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:24.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.770+0000 7f9631ed9700 1 -- 172.21.15.6:0/3712551528 shutdown_connections 2023-10-06T02:23:24.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.770+0000 7f9631ed9700 1 -- 172.21.15.6:0/3712551528 wait complete. 2023-10-06T02:23:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.771+0000 7f9631ed9700 1 Processor -- start 2023-10-06T02:23:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.772+0000 7f9631ed9700 1 -- start start 2023-10-06T02:23:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.772+0000 7f9631ed9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f962c0af4e0 0x7f962c16ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.772+0000 7f9631ed9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f962c0af8b0 0x7f962c16ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.772+0000 7f9631ed9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f962c0b27f0 0x7f962c0a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.772+0000 7f9631ed9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0cefd0 con 0x7f962c0af8b0 2023-10-06T02:23:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.772+0000 7f9631ed9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0a7c10 con 0x7f962c0b27f0 2023-10-06T02:23:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.772+0000 7f9631ed9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0cecf0 con 0x7f962c0af4e0 2023-10-06T02:23:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.772+0000 7f962affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f962c0af8b0 0x7f962c16ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.772+0000 7f962affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f962c0af8b0 0x7f962c16ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34066/0 (socket says 172.21.15.6:34066) 2023-10-06T02:23:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.772+0000 7f962affd700 1 -- 172.21.15.6:0/2605513902 learned_addr learned my addr 172.21.15.6:0/2605513902 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.773+0000 7f962b7fe700 1 --2- 172.21.15.6:0/2605513902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f962c0af4e0 0x7f962c16ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.773+0000 7f962bfff700 1 --2- 172.21.15.6:0/2605513902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f962c0b27f0 0x7f962c0a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.773+0000 7f962affd700 1 -- 172.21.15.6:0/2605513902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f962c0af4e0 msgr2=0x7f962c16ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.773+0000 7f962affd700 1 --2- 172.21.15.6:0/2605513902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f962c0af4e0 0x7f962c16ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.773+0000 7f962affd700 1 -- 172.21.15.6:0/2605513902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f962c0b27f0 msgr2=0x7f962c0a6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.773+0000 7f962affd700 1 --2- 172.21.15.6:0/2605513902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f962c0b27f0 0x7f962c0a6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.773+0000 7f962affd700 1 -- 172.21.15.6:0/2605513902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9624009ae0 con 0x7f962c0af8b0 2023-10-06T02:23:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.773+0000 7f962affd700 1 --2- 172.21.15.6:0/2605513902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f962c0af8b0 0x7f962c16ce90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f962c0cb790 tx=0x7f9620017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.773+0000 7f96137fe700 1 -- 172.21.15.6:0/2605513902 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962001bb70 con 0x7f962c0af8b0 2023-10-06T02:23:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.773+0000 7f96137fe700 1 -- 172.21.15.6:0/2605513902 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962001bcd0 con 0x7f962c0af8b0 2023-10-06T02:23:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.773+0000 7f9631ed9700 1 -- 172.21.15.6:0/2605513902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9620009420 con 0x7f962c0af8b0 2023-10-06T02:23:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.773+0000 7f96137fe700 1 -- 172.21.15.6:0/2605513902 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620011670 con 0x7f962c0af8b0 2023-10-06T02:23:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.773+0000 7f9631ed9700 1 -- 172.21.15.6:0/2605513902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962c0b3cc0 con 0x7f962c0af8b0 2023-10-06T02:23:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.774+0000 7f9631ed9700 1 -- 172.21.15.6:0/2605513902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962c0b37c0 con 0x7f962c0af8b0 2023-10-06T02:23:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.774+0000 7f96137fe700 1 -- 172.21.15.6:0/2605513902 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9620011a20 con 0x7f962c0af8b0 2023-10-06T02:23:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.775+0000 7f96137fe700 1 --2- 172.21.15.6:0/2605513902 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9618066f30 0x7f96180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.775+0000 7f96137fe700 1 -- 172.21.15.6:0/2605513902 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f9620085c80 con 0x7f962c0af8b0 2023-10-06T02:23:24.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.775+0000 7f962b7fe700 1 --2- 172.21.15.6:0/2605513902 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9618066f30 0x7f96180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.776+0000 7f962b7fe700 1 --2- 172.21.15.6:0/2605513902 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9618066f30 0x7f96180693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f961c004fd0 tx=0x7f961c007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:24.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:24.779+0000 7f96137fe700 1 -- 172.21.15.6:0/2605513902 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f962c0b37c0 con 0x7f962c0af8b0 2023-10-06T02:23:25.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.017+0000 7f9631ed9700 1 -- 172.21.15.6:0/2605513902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f962c0b37c0 con 0x7f962c0af8b0 2023-10-06T02:23:25.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.018+0000 7f96137fe700 1 -- 172.21.15.6:0/2605513902 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f962c0b37c0 con 0x7f962c0af8b0 2023-10-06T02:23:25.019 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:25.019 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":63,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/400475961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":400475961},{"type":"v1","addr":"172.21.15.175:6837","nonce":400475961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6579,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/628657260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":628657260},{"type":"v1","addr":"172.21.15.6:6834","nonce":628657260}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:20:51.206714+0000","modified":"2023-10-06T02:21:40.079021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":16,"addr":"172.21.15.6:6835/1006897436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1006897436},{"type":"v1","addr":"172.21.15.6:6835","nonce":1006897436}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:23:25.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.020+0000 7f9631ed9700 1 -- 172.21.15.6:0/2605513902 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9618066f30 msgr2=0x7f96180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.020+0000 7f9631ed9700 1 --2- 172.21.15.6:0/2605513902 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9618066f30 0x7f96180693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f961c004fd0 tx=0x7f961c007eb0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.020+0000 7f9631ed9700 1 -- 172.21.15.6:0/2605513902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f962c0af8b0 msgr2=0x7f962c16ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.020+0000 7f9631ed9700 1 --2- 172.21.15.6:0/2605513902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f962c0af8b0 0x7f962c16ce90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f962c0cb790 tx=0x7f9620017000 comp rx=0 tx=0).stop 2023-10-06T02:23:25.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.020+0000 7f9631ed9700 1 -- 172.21.15.6:0/2605513902 shutdown_connections 2023-10-06T02:23:25.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.020+0000 7f9631ed9700 1 --2- 172.21.15.6:0/2605513902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f962c0b27f0 0x7f962c0a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.020+0000 7f9631ed9700 1 --2- 172.21.15.6:0/2605513902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f962c0af4e0 0x7f962c16ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.020+0000 7f9631ed9700 1 --2- 172.21.15.6:0/2605513902 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9618066f30 0x7f96180693e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.020+0000 7f9631ed9700 1 --2- 172.21.15.6:0/2605513902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f962c0af8b0 0x7f962c16ce90 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.020+0000 7f9631ed9700 1 -- 172.21.15.6:0/2605513902 >> 172.21.15.6:0/2605513902 conn(0x7f962c068680 msgr2=0x7f962c06a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:25.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.020+0000 7f9631ed9700 1 -- 172.21.15.6:0/2605513902 shutdown_connections 2023-10-06T02:23:25.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.020+0000 7f9631ed9700 1 -- 172.21.15.6:0/2605513902 wait complete. 2023-10-06T02:23:25.023 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 63 2023-10-06T02:23:25.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:25.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.151+0000 7fe9131e9700 1 Processor -- start 2023-10-06T02:23:25.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.151+0000 7fe9131e9700 1 -- start start 2023-10-06T02:23:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.152+0000 7fe9131e9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe90c0cf1a0 0x7fe90c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.152+0000 7fe9131e9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe90c0b3560 con 0x7fe90c1597d0 2023-10-06T02:23:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.152+0000 7fe9131e9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe90c0cf6f0 con 0x7fe90c159400 2023-10-06T02:23:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.152+0000 7fe9131e9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c0cf9d0 con 0x7fe90c0cf1a0 2023-10-06T02:23:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.152+0000 7fe9129e8700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe90c1597d0 0x7fe90c0b39f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59670/0 (socket says 172.21.15.6:59670) 2023-10-06T02:23:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.152+0000 7fe9129e8700 1 -- 172.21.15.6:0/2868652804 learned_addr learned my addr 172.21.15.6:0/2868652804 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.152+0000 7fe9119e6700 1 --2- 172.21.15.6:0/2868652804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe90c0cf1a0 0x7fe90c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.152+0000 7fe9111e5700 1 -- 172.21.15.6:0/2868652804 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999865407 0 0) 0x7fe90c0b3560 con 0x7fe90c1597d0 2023-10-06T02:23:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.152+0000 7fe9111e5700 1 -- 172.21.15.6:0/2868652804 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8f4003570 con 0x7fe90c1597d0 2023-10-06T02:23:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.153+0000 7fe9111e5700 1 -- 172.21.15.6:0/2868652804 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296688413 0 0) 0x7fe90c0cf6f0 con 0x7fe90c159400 2023-10-06T02:23:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.153+0000 7fe9111e5700 1 -- 172.21.15.6:0/2868652804 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe90c0b3560 con 0x7fe90c159400 2023-10-06T02:23:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.153+0000 7fe9119e6700 1 -- 172.21.15.6:0/2868652804 >> v1:172.21.15.175:6789/0 conn(0x7fe90c159400 legacy=0x7fe90c0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.153+0000 7fe9111e5700 1 -- 172.21.15.6:0/2868652804 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3369654685 0 0) 0x7fe8f4003570 con 0x7fe90c1597d0 2023-10-06T02:23:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.153+0000 7fe9119e6700 1 -- 172.21.15.6:0/2868652804 >> v1:172.21.15.6:6789/0 conn(0x7fe90c1597d0 legacy=0x7fe90c0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.153+0000 7fe9119e6700 1 -- 172.21.15.6:0/2868652804 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c0b2f10 con 0x7fe90c0cf1a0 2023-10-06T02:23:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.153+0000 7fe9119e6700 1 --2- 172.21.15.6:0/2868652804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe90c0cf1a0 0x7fe90c0cfec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe900009910 tx=0x7fe9000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ab0e2147ad39d85 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.153+0000 7fe9111e5700 1 -- 172.21.15.6:0/2868652804 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9040017f0 con 0x7fe90c0cf1a0 2023-10-06T02:23:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.153+0000 7fe9111e5700 1 -- 172.21.15.6:0/2868652804 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe900011420 con 0x7fe90c0cf1a0 2023-10-06T02:23:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.153+0000 7fe9111e5700 1 -- 172.21.15.6:0/2868652804 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000117c0 con 0x7fe90c0cf1a0 2023-10-06T02:23:25.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.154+0000 7fe9131e9700 1 -- 172.21.15.6:0/2868652804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe90c0cf1a0 msgr2=0x7fe90c0cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.154+0000 7fe9131e9700 1 --2- 172.21.15.6:0/2868652804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe90c0cf1a0 0x7fe90c0cfec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe900009910 tx=0x7fe9000091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.154+0000 7fe9131e9700 1 -- 172.21.15.6:0/2868652804 shutdown_connections 2023-10-06T02:23:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.154+0000 7fe9131e9700 1 --2- 172.21.15.6:0/2868652804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe90c0cf1a0 0x7fe90c0cfec0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.154+0000 7fe9131e9700 1 -- 172.21.15.6:0/2868652804 >> 172.21.15.6:0/2868652804 conn(0x7fe90c06ac10 msgr2=0x7fe90c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.154+0000 7fe9131e9700 1 -- 172.21.15.6:0/2868652804 shutdown_connections 2023-10-06T02:23:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.154+0000 7fe9131e9700 1 -- 172.21.15.6:0/2868652804 wait complete. 2023-10-06T02:23:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.155+0000 7fe9131e9700 1 Processor -- start 2023-10-06T02:23:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.155+0000 7fe9131e9700 1 -- start start 2023-10-06T02:23:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.155+0000 7fe9131e9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe90c0cf1a0 0x7fe90c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9131e9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe90c159400 0x7fe90c15db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9131e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe90c1597d0 0x7fe90c15e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9131e9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c15e910 con 0x7fe90c1597d0 2023-10-06T02:23:25.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9131e9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c169fb0 con 0x7fe90c159400 2023-10-06T02:23:25.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9131e9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c16a290 con 0x7fe90c0cf1a0 2023-10-06T02:23:25.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9129e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe90c1597d0 0x7fe90c15e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9129e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe90c1597d0 0x7fe90c15e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34072/0 (socket says 172.21.15.6:34072) 2023-10-06T02:23:25.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9129e8700 1 -- 172.21.15.6:0/49417068 learned_addr learned my addr 172.21.15.6:0/49417068 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:25.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9119e6700 1 --2- 172.21.15.6:0/49417068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe90c159400 0x7fe90c15db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9121e7700 1 --2- 172.21.15.6:0/49417068 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe90c0cf1a0 0x7fe90c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9129e8700 1 -- 172.21.15.6:0/49417068 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe90c0cf1a0 msgr2=0x7fe90c155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9129e8700 1 --2- 172.21.15.6:0/49417068 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe90c0cf1a0 0x7fe90c155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9129e8700 1 -- 172.21.15.6:0/49417068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe90c159400 msgr2=0x7fe90c15db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9129e8700 1 --2- 172.21.15.6:0/49417068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe90c159400 0x7fe90c15db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9129e8700 1 -- 172.21.15.6:0/49417068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe900009420 con 0x7fe90c1597d0 2023-10-06T02:23:25.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9129e8700 1 --2- 172.21.15.6:0/49417068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe90c1597d0 0x7fe90c15e0b0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fe90400cbe0 tx=0x7fe904007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe90a7fc700 1 -- 172.21.15.6:0/49417068 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904004dc0 con 0x7fe90c1597d0 2023-10-06T02:23:25.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe90a7fc700 1 -- 172.21.15.6:0/49417068 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90400a6d0 con 0x7fe90c1597d0 2023-10-06T02:23:25.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9131e9700 1 -- 172.21.15.6:0/49417068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe90c16a570 con 0x7fe90c1597d0 2023-10-06T02:23:25.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe90a7fc700 1 -- 172.21.15.6:0/49417068 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90400aa90 con 0x7fe90c1597d0 2023-10-06T02:23:25.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.156+0000 7fe9131e9700 1 -- 172.21.15.6:0/49417068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe90c0c9cd0 con 0x7fe90c1597d0 2023-10-06T02:23:25.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.157+0000 7fe9131e9700 1 -- 172.21.15.6:0/49417068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe90c0ccaf0 con 0x7fe90c1597d0 2023-10-06T02:23:25.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.158+0000 7fe90a7fc700 1 -- 172.21.15.6:0/49417068 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe904007150 con 0x7fe90c1597d0 2023-10-06T02:23:25.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.158+0000 7fe90a7fc700 1 --2- 172.21.15.6:0/49417068 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe8f8066f30 0x7fe8f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.158+0000 7fe90a7fc700 1 -- 172.21.15.6:0/49417068 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fe9040842e0 con 0x7fe90c1597d0 2023-10-06T02:23:25.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.158+0000 7fe9121e7700 1 --2- 172.21.15.6:0/49417068 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe8f8066f30 0x7fe8f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.159+0000 7fe9121e7700 1 --2- 172.21.15.6:0/49417068 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe8f8066f30 0x7fe8f80693e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc0028b0 tx=0x7fe8fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.163+0000 7fe90a7fc700 1 -- 172.21.15.6:0/49417068 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe904051250 con 0x7fe90c1597d0 2023-10-06T02:23:25.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.358+0000 7fe9131e9700 1 -- 172.21.15.6:0/49417068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe90c068420 con 0x7fe90c1597d0 2023-10-06T02:23:25.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.359+0000 7fe90a7fc700 1 -- 172.21.15.6:0/49417068 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+17382 (secure 0 0 0) 0x7fe904054870 con 0x7fe90c1597d0 2023-10-06T02:23:25.360 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:25.360 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:21:37.070484+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:20:48.992600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T02:20:50.177537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6832/3777949337":"2023-10-07T02:21:37.070416+0000","172.21.15.6:6834/3777949337":"2023-10-07T02:21:37.070416+0000","172.21.15.175:6837/1125020360":"2023-10-07T02:21:06.890609+0000","172.21.15.175:6835/1125020360":"2023-10-07T02:21:06.890609+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:25.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.361+0000 7fe9131e9700 1 -- 172.21.15.6:0/49417068 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe8f8066f30 msgr2=0x7fe8f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.361+0000 7fe9131e9700 1 --2- 172.21.15.6:0/49417068 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe8f8066f30 0x7fe8f80693e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc0028b0 tx=0x7fe8fc009040 comp rx=0 tx=0).stop 2023-10-06T02:23:25.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.361+0000 7fe9131e9700 1 -- 172.21.15.6:0/49417068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe90c1597d0 msgr2=0x7fe90c15e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.361+0000 7fe9131e9700 1 --2- 172.21.15.6:0/49417068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe90c1597d0 0x7fe90c15e0b0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fe90400cbe0 tx=0x7fe904007d20 comp rx=0 tx=0).stop 2023-10-06T02:23:25.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.361+0000 7fe9131e9700 1 -- 172.21.15.6:0/49417068 shutdown_connections 2023-10-06T02:23:25.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.361+0000 7fe9131e9700 1 --2- 172.21.15.6:0/49417068 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe8f8066f30 0x7fe8f80693e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.361+0000 7fe9131e9700 1 --2- 172.21.15.6:0/49417068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe90c1597d0 0x7fe90c15e0b0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.361+0000 7fe9131e9700 1 --2- 172.21.15.6:0/49417068 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe90c0cf1a0 0x7fe90c155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.361+0000 7fe9131e9700 1 --2- 172.21.15.6:0/49417068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe90c159400 0x7fe90c15db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.361+0000 7fe9131e9700 1 -- 172.21.15.6:0/49417068 >> 172.21.15.6:0/49417068 conn(0x7fe90c06ac10 msgr2=0x7fe90c0b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:25.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.361+0000 7fe9131e9700 1 -- 172.21.15.6:0/49417068 shutdown_connections 2023-10-06T02:23:25.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.361+0000 7fe9131e9700 1 -- 172.21.15.6:0/49417068 wait complete. 2023-10-06T02:23:25.374 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:23:25.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.493+0000 7fec5c0f1700 1 Processor -- start 2023-10-06T02:23:25.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.493+0000 7fec5c0f1700 1 -- start start 2023-10-06T02:23:25.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.494+0000 7fec5c0f1700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fec540a8d90 0x7fec540af200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.494+0000 7fec5c0f1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec540b3820 0x7fec54069790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.494+0000 7fec5c0f1700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5406b030 con 0x7fec540a89c0 2023-10-06T02:23:25.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.494+0000 7fec5c0f1700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec540b1ab0 con 0x7fec540a8d90 2023-10-06T02:23:25.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.494+0000 7fec5c0f1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5406ad50 con 0x7fec540b3820 2023-10-06T02:23:25.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.494+0000 7fec5968c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fec540a8d90 0x7fec540af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.494+0000 7fec5a68e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec540b3820 0x7fec54069790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.494+0000 7fec59e8d700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fec540a89c0 0x7fec540aeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:54974/0 (socket says 172.21.15.6:54974) 2023-10-06T02:23:25.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.494+0000 7fec5a68e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec540b3820 0x7fec54069790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:52042/0 (socket says 172.21.15.6:52042) 2023-10-06T02:23:25.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.494+0000 7fec59e8d700 1 -- 172.21.15.6:0/1493749555 learned_addr learned my addr 172.21.15.6:0/1493749555 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.494+0000 7fec5968c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fec540a8d90 0x7fec540af200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:58604/0 (socket says 172.21.15.6:58604) 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.494+0000 7fec5968c700 1 -- 172.21.15.6:0/1493749555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec540b3820 msgr2=0x7fec54069790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.494+0000 7fec5968c700 1 --2- 172.21.15.6:0/1493749555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec540b3820 0x7fec54069790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.494+0000 7fec5968c700 1 -- 172.21.15.6:0/1493749555 >> v1:172.21.15.175:6789/0 conn(0x7fec540a89c0 legacy=0x7fec540aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.494+0000 7fec5968c700 1 -- 172.21.15.6:0/1493749555 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec540b1d30 con 0x7fec540a8d90 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.494+0000 7fec58e8b700 1 -- 172.21.15.6:0/1493749555 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656557466 0 0) 0x7fec5406b030 con 0x7fec540a89c0 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.494+0000 7fec5a68e700 1 --2- 172.21.15.6:0/1493749555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec540b3820 0x7fec54069790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.495+0000 7fec5968c700 1 --2- 172.21.15.6:0/1493749555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec540a8d90 0x7fec540af200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fec480098e0 tx=0x7fec480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c52e1c1197efaa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.495+0000 7fec58e8b700 1 -- 172.21.15.6:0/1493749555 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4800b640 con 0x7fec540a8d90 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.495+0000 7fec58e8b700 1 -- 172.21.15.6:0/1493749555 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4800b7a0 con 0x7fec540a8d90 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.495+0000 7fec58e8b700 1 -- 172.21.15.6:0/1493749555 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4800bb40 con 0x7fec540a8d90 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.495+0000 7fec5c0f1700 1 -- 172.21.15.6:0/1493749555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec540a8d90 msgr2=0x7fec540af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.495+0000 7fec5c0f1700 1 --2- 172.21.15.6:0/1493749555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec540a8d90 0x7fec540af200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fec480098e0 tx=0x7fec480091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.495+0000 7fec5c0f1700 1 -- 172.21.15.6:0/1493749555 shutdown_connections 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.495+0000 7fec5c0f1700 1 --2- 172.21.15.6:0/1493749555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec540b3820 0x7fec54069790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.495+0000 7fec5c0f1700 1 --2- 172.21.15.6:0/1493749555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec540a8d90 0x7fec540af200 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.495+0000 7fec5c0f1700 1 -- 172.21.15.6:0/1493749555 >> 172.21.15.6:0/1493749555 conn(0x7fec54067910 msgr2=0x7fec540ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.495+0000 7fec5c0f1700 1 -- 172.21.15.6:0/1493749555 shutdown_connections 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.495+0000 7fec5c0f1700 1 -- 172.21.15.6:0/1493749555 wait complete. 2023-10-06T02:23:25.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.496+0000 7fec5c0f1700 1 Processor -- start 2023-10-06T02:23:25.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.497+0000 7fec5c0f1700 1 -- start start 2023-10-06T02:23:25.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.497+0000 7fec5c0f1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec540a89c0 0x7fec54151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.497+0000 7fec5c0f1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec540a8d90 0x7fec541564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.497+0000 7fec5c0f1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec540b3820 0x7fec54154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.497+0000 7fec5c0f1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec54156040 con 0x7fec540b3820 2023-10-06T02:23:25.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.497+0000 7fec5c0f1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec54156a10 con 0x7fec540a89c0 2023-10-06T02:23:25.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.497+0000 7fec5c0f1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec54155430 con 0x7fec540a8d90 2023-10-06T02:23:25.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.497+0000 7fec5a68e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec540b3820 0x7fec54154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.497+0000 7fec5a68e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec540b3820 0x7fec54154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34082/0 (socket says 172.21.15.6:34082) 2023-10-06T02:23:25.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.497+0000 7fec5a68e700 1 -- 172.21.15.6:0/1583710466 learned_addr learned my addr 172.21.15.6:0/1583710466 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:25.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.498+0000 7fec5968c700 1 --2- 172.21.15.6:0/1583710466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec540a8d90 0x7fec541564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.498+0000 7fec59e8d700 1 --2- 172.21.15.6:0/1583710466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec540a89c0 0x7fec54151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.498+0000 7fec5a68e700 1 -- 172.21.15.6:0/1583710466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec540a8d90 msgr2=0x7fec541564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.498+0000 7fec5a68e700 1 --2- 172.21.15.6:0/1583710466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec540a8d90 0x7fec541564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.498+0000 7fec5a68e700 1 -- 172.21.15.6:0/1583710466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec540a89c0 msgr2=0x7fec54151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.498+0000 7fec5a68e700 1 --2- 172.21.15.6:0/1583710466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec540a89c0 0x7fec54151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.498+0000 7fec5a68e700 1 -- 172.21.15.6:0/1583710466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec44009a20 con 0x7fec540b3820 2023-10-06T02:23:25.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.498+0000 7fec5a68e700 1 --2- 172.21.15.6:0/1583710466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec540b3820 0x7fec54154be0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fec44009fc0 tx=0x7fec4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.498+0000 7fec51ffb700 1 -- 172.21.15.6:0/1583710466 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4400cbd0 con 0x7fec540b3820 2023-10-06T02:23:25.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.498+0000 7fec51ffb700 1 -- 172.21.15.6:0/1583710466 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4400f040 con 0x7fec540b3820 2023-10-06T02:23:25.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.498+0000 7fec5c0f1700 1 -- 172.21.15.6:0/1583710466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec48009420 con 0x7fec540b3820 2023-10-06T02:23:25.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.498+0000 7fec51ffb700 1 -- 172.21.15.6:0/1583710466 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec44014480 con 0x7fec540b3820 2023-10-06T02:23:25.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.498+0000 7fec5c0f1700 1 -- 172.21.15.6:0/1583710466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec541559f0 con 0x7fec540b3820 2023-10-06T02:23:25.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.499+0000 7fec5c0f1700 1 -- 172.21.15.6:0/1583710466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec54087170 con 0x7fec540b3820 2023-10-06T02:23:25.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.500+0000 7fec51ffb700 1 -- 172.21.15.6:0/1583710466 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec44003020 con 0x7fec540b3820 2023-10-06T02:23:25.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.500+0000 7fec51ffb700 1 --2- 172.21.15.6:0/1583710466 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec40066f60 0x7fec40069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.500+0000 7fec51ffb700 1 -- 172.21.15.6:0/1583710466 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fec440851e0 con 0x7fec540b3820 2023-10-06T02:23:25.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.500+0000 7fec59e8d700 1 --2- 172.21.15.6:0/1583710466 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec40066f60 0x7fec40069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.501+0000 7fec59e8d700 1 --2- 172.21.15.6:0/1583710466 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec40066f60 0x7fec40069410 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fec4c007fd0 tx=0x7fec4c007f40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.504+0000 7fec51ffb700 1 -- 172.21.15.6:0/1583710466 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec440520d0 con 0x7fec540b3820 2023-10-06T02:23:25.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.740+0000 7fec5c0f1700 1 -- 172.21.15.6:0/1583710466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fec5406e5d0 con 0x7fec540b3820 2023-10-06T02:23:25.742 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:23:25.741+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:23:25.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.745+0000 7fec51ffb700 1 -- 172.21.15.6:0/1583710466 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) v1 ==== 161+0+0 (secure 0 0 0) 0x7fec440556f0 con 0x7fec540b3820 2023-10-06T02:23:25.750 INFO:tasks.ceph.mds.a.smithi006.stderr: -3886> 2023-10-06T02:21:41.133+0000 7fcaacc27700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:23:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.748+0000 7fec5c0f1700 1 -- 172.21.15.6:0/1583710466 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec40066f60 msgr2=0x7fec40069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.748+0000 7fec5c0f1700 1 --2- 172.21.15.6:0/1583710466 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec40066f60 0x7fec40069410 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fec4c007fd0 tx=0x7fec4c007f40 comp rx=0 tx=0).stop 2023-10-06T02:23:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.749+0000 7fec5c0f1700 1 -- 172.21.15.6:0/1583710466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec540b3820 msgr2=0x7fec54154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.749+0000 7fec5c0f1700 1 --2- 172.21.15.6:0/1583710466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec540b3820 0x7fec54154be0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fec44009fc0 tx=0x7fec4400b040 comp rx=0 tx=0).stop 2023-10-06T02:23:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.749+0000 7fec5c0f1700 1 -- 172.21.15.6:0/1583710466 shutdown_connections 2023-10-06T02:23:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.749+0000 7fec5c0f1700 1 --2- 172.21.15.6:0/1583710466 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec40066f60 0x7fec40069410 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.749+0000 7fec5c0f1700 1 --2- 172.21.15.6:0/1583710466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec540b3820 0x7fec54154be0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.749+0000 7fec5c0f1700 1 --2- 172.21.15.6:0/1583710466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec540a89c0 0x7fec54151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.749+0000 7fec5c0f1700 1 --2- 172.21.15.6:0/1583710466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec540a8d90 0x7fec541564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.749+0000 7fec5c0f1700 1 -- 172.21.15.6:0/1583710466 >> 172.21.15.6:0/1583710466 conn(0x7fec54067910 msgr2=0x7fec54069750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:25.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.749+0000 7fec5c0f1700 1 -- 172.21.15.6:0/1583710466 shutdown_connections 2023-10-06T02:23:25.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.749+0000 7fec5c0f1700 1 -- 172.21.15.6:0/1583710466 wait complete. 2023-10-06T02:23:25.752 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:23:25.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:23:25.776 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:23:25.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.883+0000 7fa236ae5700 1 Processor -- start 2023-10-06T02:23:25.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.883+0000 7fa236ae5700 1 -- start start 2023-10-06T02:23:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.884+0000 7fa236ae5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa230086ff0 0x7fa2301596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.884+0000 7fa236ae5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23015a100 con 0x7fa2301592f0 2023-10-06T02:23:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.884+0000 7fa236ae5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2300875d0 con 0x7fa23015a590 2023-10-06T02:23:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.884+0000 7fa236ae5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300878b0 con 0x7fa230086ff0 2023-10-06T02:23:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.884+0000 7fa235ae3700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa2301592f0 0x7fa2300d0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59682/0 (socket says 172.21.15.6:59682) 2023-10-06T02:23:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.884+0000 7fa235ae3700 1 -- 172.21.15.6:0/563116126 learned_addr learned my addr 172.21.15.6:0/563116126 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.884+0000 7fa2352e2700 1 --2- 172.21.15.6:0/563116126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa230086ff0 0x7fa2301596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.884+0000 7fa234ae1700 1 -- 172.21.15.6:0/563116126 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642291000 0 0) 0x7fa23015a100 con 0x7fa2301592f0 2023-10-06T02:23:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.884+0000 7fa234ae1700 1 -- 172.21.15.6:0/563116126 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa218003570 con 0x7fa2301592f0 2023-10-06T02:23:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa234ae1700 1 -- 172.21.15.6:0/563116126 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1427912733 0 0) 0x7fa218003570 con 0x7fa2301592f0 2023-10-06T02:23:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa234ae1700 1 -- 172.21.15.6:0/563116126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa230086ff0 msgr2=0x7fa2301596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa234ae1700 1 --2- 172.21.15.6:0/563116126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa230086ff0 0x7fa2301596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa234ae1700 1 -- 172.21.15.6:0/563116126 >> v1:172.21.15.175:6789/0 conn(0x7fa23015a590 legacy=0x7fa2300aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa234ae1700 1 -- 172.21.15.6:0/563116126 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa230159d90 con 0x7fa2301592f0 2023-10-06T02:23:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa234ae1700 1 -- 172.21.15.6:0/563116126 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fa228001470 con 0x7fa2301592f0 2023-10-06T02:23:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa234ae1700 1 -- 172.21.15.6:0/563116126 >> v1:172.21.15.6:6789/0 conn(0x7fa2301592f0 legacy=0x7fa2300d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa234ae1700 1 --2- 172.21.15.6:0/563116126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa230086ff0 0x7fa218003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa234ae1700 1 --2- 172.21.15.6:0/563116126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa218003fd0 0x7fa218004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa234ae1700 1 --2- 172.21.15.6:0/563116126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa218004d50 0x7fa2180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa234ae1700 1 -- 172.21.15.6:0/563116126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300878b0 con 0x7fa218004d50 2023-10-06T02:23:25.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa234ae1700 1 -- 172.21.15.6:0/563116126 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21800bb40 con 0x7fa218003fd0 2023-10-06T02:23:25.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa234ae1700 1 -- 172.21.15.6:0/563116126 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21800bd00 con 0x7fa230086ff0 2023-10-06T02:23:25.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa2362e4700 1 --2- 172.21.15.6:0/563116126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa218004d50 0x7fa2180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa2352e2700 1 --2- 172.21.15.6:0/563116126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa218003fd0 0x7fa218004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa235ae3700 1 --2- 172.21.15.6:0/563116126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa230086ff0 0x7fa218003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa2362e4700 1 -- 172.21.15.6:0/563116126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa230086ff0 msgr2=0x7fa218003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:25.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa2362e4700 1 --2- 172.21.15.6:0/563116126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa230086ff0 0x7fa218003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa2362e4700 1 -- 172.21.15.6:0/563116126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa218003fd0 msgr2=0x7fa218004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:25.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa2362e4700 1 --2- 172.21.15.6:0/563116126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa218003fd0 0x7fa218004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa2362e4700 1 -- 172.21.15.6:0/563116126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218003570 con 0x7fa218004d50 2023-10-06T02:23:25.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.885+0000 7fa2362e4700 1 --2- 172.21.15.6:0/563116126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa218004d50 0x7fa2180051c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa2200020a0 tx=0x7fa2200016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c978b7f4030a67ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.886+0000 7fa234ae1700 1 -- 172.21.15.6:0/563116126 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2200019e0 con 0x7fa218004d50 2023-10-06T02:23:25.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.886+0000 7fa234ae1700 1 -- 172.21.15.6:0/563116126 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22000c8b0 con 0x7fa218004d50 2023-10-06T02:23:25.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.886+0000 7fa234ae1700 1 -- 172.21.15.6:0/563116126 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22000cc50 con 0x7fa218004d50 2023-10-06T02:23:25.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.886+0000 7fa236ae5700 1 -- 172.21.15.6:0/563116126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa218004d50 msgr2=0x7fa2180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.886+0000 7fa236ae5700 1 --2- 172.21.15.6:0/563116126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa218004d50 0x7fa2180051c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa2200020a0 tx=0x7fa2200016d0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.886+0000 7fa2362e4700 1 -- 172.21.15.6:0/563116126 reap_dead start 2023-10-06T02:23:25.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.886+0000 7fa236ae5700 1 -- 172.21.15.6:0/563116126 shutdown_connections 2023-10-06T02:23:25.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.886+0000 7fa236ae5700 1 -- 172.21.15.6:0/563116126 >> 172.21.15.6:0/563116126 conn(0x7fa230069150 msgr2=0x7fa2300d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:25.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.886+0000 7fa236ae5700 1 -- 172.21.15.6:0/563116126 shutdown_connections 2023-10-06T02:23:25.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.886+0000 7fa236ae5700 1 -- 172.21.15.6:0/563116126 wait complete. 2023-10-06T02:23:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.887+0000 7fa236ae5700 1 Processor -- start 2023-10-06T02:23:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.887+0000 7fa236ae5700 1 -- start start 2023-10-06T02:23:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.888+0000 7fa236ae5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa218004d50 0x7fa2300c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.888+0000 7fa236ae5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2300c9bc0 0x7fa2300b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.888+0000 7fa236ae5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2300b3450 0x7fa2300b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.888+0000 7fa236ae5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23015d840 con 0x7fa2300c9bc0 2023-10-06T02:23:25.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.888+0000 7fa236ae5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300c8690 con 0x7fa218004d50 2023-10-06T02:23:25.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.888+0000 7fa236ae5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300ca030 con 0x7fa2300b3450 2023-10-06T02:23:25.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.888+0000 7fa2352e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2300c9bc0 0x7fa2300b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.888+0000 7fa2352e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2300c9bc0 0x7fa2300b2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34102/0 (socket says 172.21.15.6:34102) 2023-10-06T02:23:25.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.888+0000 7fa2352e2700 1 -- 172.21.15.6:0/2421130644 learned_addr learned my addr 172.21.15.6:0/2421130644 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:25.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.888+0000 7fa2362e4700 1 --2- 172.21.15.6:0/2421130644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2300b3450 0x7fa2300b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.888+0000 7fa235ae3700 1 --2- 172.21.15.6:0/2421130644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa218004d50 0x7fa2300c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.888+0000 7fa2352e2700 1 -- 172.21.15.6:0/2421130644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2300b3450 msgr2=0x7fa2300b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.888+0000 7fa2352e2700 1 --2- 172.21.15.6:0/2421130644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2300b3450 0x7fa2300b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.888+0000 7fa2352e2700 1 -- 172.21.15.6:0/2421130644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa218004d50 msgr2=0x7fa2300c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.888+0000 7fa2352e2700 1 --2- 172.21.15.6:0/2421130644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa218004d50 0x7fa2300c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.888+0000 7fa2352e2700 1 -- 172.21.15.6:0/2421130644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2300c7d60 con 0x7fa2300c9bc0 2023-10-06T02:23:25.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.889+0000 7fa2352e2700 1 --2- 172.21.15.6:0/2421130644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2300c9bc0 0x7fa2300b2f10 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa224006ac0 tx=0x7fa2240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.889+0000 7fa22dffb700 1 -- 172.21.15.6:0/2421130644 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22400f940 con 0x7fa2300c9bc0 2023-10-06T02:23:25.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.889+0000 7fa22dffb700 1 -- 172.21.15.6:0/2421130644 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22400faa0 con 0x7fa2300c9bc0 2023-10-06T02:23:25.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.889+0000 7fa236ae5700 1 -- 172.21.15.6:0/2421130644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2300c8040 con 0x7fa2300c9bc0 2023-10-06T02:23:25.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.889+0000 7fa22dffb700 1 -- 172.21.15.6:0/2421130644 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22400fe20 con 0x7fa2300c9bc0 2023-10-06T02:23:25.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.889+0000 7fa236ae5700 1 -- 172.21.15.6:0/2421130644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2300b5ad0 con 0x7fa2300c9bc0 2023-10-06T02:23:25.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.890+0000 7fa236ae5700 1 -- 172.21.15.6:0/2421130644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa230064aa0 con 0x7fa2300c9bc0 2023-10-06T02:23:25.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.890+0000 7fa22dffb700 1 -- 172.21.15.6:0/2421130644 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa224014650 con 0x7fa2300c9bc0 2023-10-06T02:23:25.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.890+0000 7fa22dffb700 1 --2- 172.21.15.6:0/2421130644 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa21c066f30 0x7fa21c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.891+0000 7fa22dffb700 1 -- 172.21.15.6:0/2421130644 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6694+0+0 (secure 0 0 0) 0x7fa224018030 con 0x7fa2300c9bc0 2023-10-06T02:23:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.891+0000 7fa235ae3700 1 --2- 172.21.15.6:0/2421130644 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa21c066f30 0x7fa21c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.891+0000 7fa235ae3700 1 --2- 172.21.15.6:0/2421130644 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa21c066f30 0x7fa21c0693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa228001d00 tx=0x7fa228001e70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:25.895+0000 7fa22dffb700 1 -- 172.21.15.6:0/2421130644 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa224052170 con 0x7fa2300c9bc0 2023-10-06T02:23:26.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.137+0000 7fa236ae5700 1 -- 172.21.15.6:0/2421130644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa2300638a0 con 0x7fa2300c9bc0 2023-10-06T02:23:26.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.746+0000 7fa22dffb700 1 -- 172.21.15.6:0/2421130644 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa224055790 con 0x7fa2300c9bc0 2023-10-06T02:23:26.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.749+0000 7fa236ae5700 1 -- 172.21.15.6:0/2421130644 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa21c066f30 msgr2=0x7fa21c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.749+0000 7fa236ae5700 1 --2- 172.21.15.6:0/2421130644 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa21c066f30 0x7fa21c0693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa228001d00 tx=0x7fa228001e70 comp rx=0 tx=0).stop 2023-10-06T02:23:26.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.749+0000 7fa236ae5700 1 -- 172.21.15.6:0/2421130644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2300c9bc0 msgr2=0x7fa2300b2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.749+0000 7fa236ae5700 1 --2- 172.21.15.6:0/2421130644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2300c9bc0 0x7fa2300b2f10 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa224006ac0 tx=0x7fa2240091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.749+0000 7fa236ae5700 1 -- 172.21.15.6:0/2421130644 shutdown_connections 2023-10-06T02:23:26.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.749+0000 7fa236ae5700 1 --2- 172.21.15.6:0/2421130644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2300b3450 0x7fa2300b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.749+0000 7fa236ae5700 1 --2- 172.21.15.6:0/2421130644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa218004d50 0x7fa2300c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.749+0000 7fa236ae5700 1 --2- 172.21.15.6:0/2421130644 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa21c066f30 0x7fa21c0693e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.749+0000 7fa236ae5700 1 --2- 172.21.15.6:0/2421130644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2300c9bc0 0x7fa2300b2f10 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.749+0000 7fa236ae5700 1 -- 172.21.15.6:0/2421130644 >> 172.21.15.6:0/2421130644 conn(0x7fa230069150 msgr2=0x7fa230155e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.749+0000 7fa236ae5700 1 -- 172.21.15.6:0/2421130644 shutdown_connections 2023-10-06T02:23:26.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.749+0000 7fa236ae5700 1 -- 172.21.15.6:0/2421130644 wait complete. 2023-10-06T02:23:26.764 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:23:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.929+0000 7fa22c50c700 1 Processor -- start 2023-10-06T02:23:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.929+0000 7fa22c50c700 1 -- start start 2023-10-06T02:23:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.930+0000 7fa22c50c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa22406a560 0x7fa22406a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.930+0000 7fa22c50c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa2240b59d0 0x7fa2240b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.930+0000 7fa22c50c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22415d1d0 con 0x7fa2241568d0 2023-10-06T02:23:26.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.930+0000 7fa22c50c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22415cfe0 con 0x7fa2240b59d0 2023-10-06T02:23:26.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.930+0000 7fa22c50c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2240b62e0 con 0x7fa22406a560 2023-10-06T02:23:26.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.931+0000 7fa22a2a8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa22406a560 0x7fa22406a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.931+0000 7fa229aa7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa2240b59d0 0x7fa2240b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.931+0000 7fa229aa7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa2240b59d0 0x7fa2240b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:58678/0 (socket says 172.21.15.6:58678) 2023-10-06T02:23:26.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.931+0000 7fa229aa7700 1 -- 172.21.15.6:0/1640778257 learned_addr learned my addr 172.21.15.6:0/1640778257 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:26.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.931+0000 7fa22aaa9700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa2241568d0 0x7fa224156d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:55002/0 (socket says 172.21.15.6:55002) 2023-10-06T02:23:26.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.931+0000 7fa22a2a8700 1 -- 172.21.15.6:0/1640778257 >> v2:172.21.15.175:3300/0 conn(0x7fa2240b59d0 msgr2=0x7fa2240b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.931+0000 7fa22a2a8700 1 --2- 172.21.15.6:0/1640778257 >> v2:172.21.15.175:3300/0 conn(0x7fa2240b59d0 0x7fa2240b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.931+0000 7fa22a2a8700 1 -- 172.21.15.6:0/1640778257 >> v1:172.21.15.175:6789/0 conn(0x7fa2241568d0 legacy=0x7fa224156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.931+0000 7fa22a2a8700 1 -- 172.21.15.6:0/1640778257 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22415d490 con 0x7fa22406a560 2023-10-06T02:23:26.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.931+0000 7fa229aa7700 1 --2- 172.21.15.6:0/1640778257 >> v2:172.21.15.175:3300/0 conn(0x7fa2240b59d0 0x7fa2240b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:26.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.931+0000 7fa22a2a8700 1 --2- 172.21.15.6:0/1640778257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa22406a560 0x7fa22406a930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa214009910 tx=0x7fa2140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e62df7178ebe3189 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.932+0000 7fa2292a6700 1 -- 172.21.15.6:0/1640778257 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21400b640 con 0x7fa22406a560 2023-10-06T02:23:26.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.932+0000 7fa2292a6700 1 -- 172.21.15.6:0/1640778257 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21400b7a0 con 0x7fa22406a560 2023-10-06T02:23:26.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.932+0000 7fa2292a6700 1 -- 172.21.15.6:0/1640778257 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21400bb60 con 0x7fa22406a560 2023-10-06T02:23:26.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.932+0000 7fa22c50c700 1 -- 172.21.15.6:0/1640778257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa22406a560 msgr2=0x7fa22406a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.932+0000 7fa22c50c700 1 --2- 172.21.15.6:0/1640778257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa22406a560 0x7fa22406a930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa214009910 tx=0x7fa2140091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.932+0000 7fa22c50c700 1 -- 172.21.15.6:0/1640778257 shutdown_connections 2023-10-06T02:23:26.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.932+0000 7fa22c50c700 1 --2- 172.21.15.6:0/1640778257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa22406a560 0x7fa22406a930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.932+0000 7fa22c50c700 1 --2- 172.21.15.6:0/1640778257 >> v2:172.21.15.175:3300/0 conn(0x7fa2240b59d0 0x7fa2240b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.932+0000 7fa22c50c700 1 -- 172.21.15.6:0/1640778257 >> 172.21.15.6:0/1640778257 conn(0x7fa2240d0340 msgr2=0x7fa2240d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.932+0000 7fa22c50c700 1 -- 172.21.15.6:0/1640778257 shutdown_connections 2023-10-06T02:23:26.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.932+0000 7fa22c50c700 1 -- 172.21.15.6:0/1640778257 wait complete. 2023-10-06T02:23:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.933+0000 7fa22c50c700 1 Processor -- start 2023-10-06T02:23:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.933+0000 7fa22c50c700 1 -- start start 2023-10-06T02:23:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.934+0000 7fa22c50c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa22406a560 0x7fa2241546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.934+0000 7fa22c50c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2240b59d0 0x7fa22416d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.934+0000 7fa22c50c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2241568d0 0x7fa224155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.934+0000 7fa22c50c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22416dd70 con 0x7fa2241568d0 2023-10-06T02:23:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.934+0000 7fa22c50c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa224154c20 con 0x7fa22406a560 2023-10-06T02:23:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.934+0000 7fa22c50c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa224153660 con 0x7fa2240b59d0 2023-10-06T02:23:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.935+0000 7fa22aaa9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2241568d0 0x7fa224155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.935+0000 7fa22aaa9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2241568d0 0x7fa224155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34114/0 (socket says 172.21.15.6:34114) 2023-10-06T02:23:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.935+0000 7fa22aaa9700 1 -- 172.21.15.6:0/423076184 learned_addr learned my addr 172.21.15.6:0/423076184 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:26.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.935+0000 7fa22a2a8700 1 --2- 172.21.15.6:0/423076184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa22406a560 0x7fa2241546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.935+0000 7fa229aa7700 1 --2- 172.21.15.6:0/423076184 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2240b59d0 0x7fa22416d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.935+0000 7fa22aaa9700 1 -- 172.21.15.6:0/423076184 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2240b59d0 msgr2=0x7fa22416d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.935+0000 7fa22aaa9700 1 --2- 172.21.15.6:0/423076184 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2240b59d0 0x7fa22416d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.935+0000 7fa22aaa9700 1 -- 172.21.15.6:0/423076184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa22406a560 msgr2=0x7fa2241546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.935+0000 7fa22aaa9700 1 --2- 172.21.15.6:0/423076184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa22406a560 0x7fa2241546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.935+0000 7fa22aaa9700 1 -- 172.21.15.6:0/423076184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218009ae0 con 0x7fa2241568d0 2023-10-06T02:23:26.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.935+0000 7fa22aaa9700 1 --2- 172.21.15.6:0/423076184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2241568d0 0x7fa224155b70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00c4e0 tx=0x7fa21c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.935+0000 7fa2227fc700 1 -- 172.21.15.6:0/423076184 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c00ce90 con 0x7fa2241568d0 2023-10-06T02:23:26.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.935+0000 7fa2227fc700 1 -- 172.21.15.6:0/423076184 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c005a70 con 0x7fa2241568d0 2023-10-06T02:23:26.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.935+0000 7fa22c50c700 1 -- 172.21.15.6:0/423076184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa214009420 con 0x7fa2241568d0 2023-10-06T02:23:26.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.935+0000 7fa2227fc700 1 -- 172.21.15.6:0/423076184 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c005e10 con 0x7fa2241568d0 2023-10-06T02:23:26.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.935+0000 7fa22c50c700 1 -- 172.21.15.6:0/423076184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa224153f00 con 0x7fa2241568d0 2023-10-06T02:23:26.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.936+0000 7fa22c50c700 1 -- 172.21.15.6:0/423076184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa224154550 con 0x7fa2241568d0 2023-10-06T02:23:26.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.937+0000 7fa2227fc700 1 -- 172.21.15.6:0/423076184 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa21c0072e0 con 0x7fa2241568d0 2023-10-06T02:23:26.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.937+0000 7fa2227fc700 1 --2- 172.21.15.6:0/423076184 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa210066f30 0x7fa2100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.937+0000 7fa2227fc700 1 -- 172.21.15.6:0/423076184 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6694+0+0 (secure 0 0 0) 0x7fa21c083c20 con 0x7fa2241568d0 2023-10-06T02:23:26.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.937+0000 7fa22a2a8700 1 --2- 172.21.15.6:0/423076184 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa210066f30 0x7fa2100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.938+0000 7fa22a2a8700 1 --2- 172.21.15.6:0/423076184 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa210066f30 0x7fa2100693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa2140091e0 tx=0x7fa214017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:26.941+0000 7fa2227fc700 1 -- 172.21.15.6:0/423076184 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa21c050ab0 con 0x7fa2241568d0 2023-10-06T02:23:27.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:27.135+0000 7fa22c50c700 1 -- 172.21.15.6:0/423076184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa224153a50 con 0x7fa2241568d0 2023-10-06T02:23:27.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:27.936+0000 7fa2227fc700 1 -- 172.21.15.6:0/423076184 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v72) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa21c017020 con 0x7fa2241568d0 2023-10-06T02:23:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:27.942+0000 7fa22c50c700 1 -- 172.21.15.6:0/423076184 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa210066f30 msgr2=0x7fa2100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:27.942+0000 7fa22c50c700 1 --2- 172.21.15.6:0/423076184 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa210066f30 0x7fa2100693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa2140091e0 tx=0x7fa214017000 comp rx=0 tx=0).stop 2023-10-06T02:23:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:27.942+0000 7fa22c50c700 1 -- 172.21.15.6:0/423076184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2241568d0 msgr2=0x7fa224155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:27.942+0000 7fa22c50c700 1 --2- 172.21.15.6:0/423076184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2241568d0 0x7fa224155b70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00c4e0 tx=0x7fa21c007f50 comp rx=0 tx=0).stop 2023-10-06T02:23:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:27.943+0000 7fa22c50c700 1 -- 172.21.15.6:0/423076184 shutdown_connections 2023-10-06T02:23:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:27.943+0000 7fa22c50c700 1 --2- 172.21.15.6:0/423076184 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa210066f30 0x7fa2100693e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:27.943+0000 7fa22c50c700 1 --2- 172.21.15.6:0/423076184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2241568d0 0x7fa224155b70 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:27.943+0000 7fa22c50c700 1 --2- 172.21.15.6:0/423076184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa22406a560 0x7fa2241546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:27.943+0000 7fa22c50c700 1 --2- 172.21.15.6:0/423076184 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2240b59d0 0x7fa22416d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:27.943+0000 7fa22c50c700 1 -- 172.21.15.6:0/423076184 >> 172.21.15.6:0/423076184 conn(0x7fa2240d0340 msgr2=0x7fa22414cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:27.944+0000 7fa22c50c700 1 -- 172.21.15.6:0/423076184 shutdown_connections 2023-10-06T02:23:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:27.944+0000 7fa22c50c700 1 -- 172.21.15.6:0/423076184 wait complete. 2023-10-06T02:23:27.946 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:23:27.964 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:23:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.090+0000 7fc7c10a1700 1 Processor -- start 2023-10-06T02:23:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.090+0000 7fc7c10a1700 1 -- start start 2023-10-06T02:23:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.091+0000 7fc7c10a1700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc7bc1596c0 0x7fc7bc0ac610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.091+0000 7fc7c10a1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7bc06b140 0x7fc7bc15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.091+0000 7fc7c10a1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7bc15a6e0 con 0x7fc7bc0acb50 2023-10-06T02:23:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.091+0000 7fc7c10a1700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7bc06b530 con 0x7fc7bc1596c0 2023-10-06T02:23:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.091+0000 7fc7c10a1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc0ad090 con 0x7fc7bc06b140 2023-10-06T02:23:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.091+0000 7fc7ba59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc7bc0acb50 0x7fc7bc159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59686/0 (socket says 172.21.15.6:59686) 2023-10-06T02:23:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.091+0000 7fc7ba59c700 1 -- 172.21.15.6:0/1399127875 learned_addr learned my addr 172.21.15.6:0/1399127875 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.091+0000 7fc7bb59e700 1 --2- 172.21.15.6:0/1399127875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7bc06b140 0x7fc7bc15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.091+0000 7fc7bad9d700 1 --2- 172.21.15.6:0/1399127875 >> v2:172.21.15.175:3300/0 conn(0x7fc7bc1596c0 0x7fc7bc0ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7b9d9b700 1 -- 172.21.15.6:0/1399127875 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595430315 0 0) 0x7fc7bc15a6e0 con 0x7fc7bc0acb50 2023-10-06T02:23:28.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7b9d9b700 1 -- 172.21.15.6:0/1399127875 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7a8003570 con 0x7fc7bc0acb50 2023-10-06T02:23:28.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7b9d9b700 1 -- 172.21.15.6:0/1399127875 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2924175062 0 0) 0x7fc7a8003570 con 0x7fc7bc0acb50 2023-10-06T02:23:28.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7b9d9b700 1 -- 172.21.15.6:0/1399127875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7bc06b140 msgr2=0x7fc7bc15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:28.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7b9d9b700 1 --2- 172.21.15.6:0/1399127875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7bc06b140 0x7fc7bc15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7b9d9b700 1 -- 172.21.15.6:0/1399127875 >> v2:172.21.15.175:3300/0 conn(0x7fc7bc1596c0 msgr2=0x7fc7bc0ac610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:28.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7b9d9b700 1 --2- 172.21.15.6:0/1399127875 >> v2:172.21.15.175:3300/0 conn(0x7fc7bc1596c0 0x7fc7bc0ac610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7b9d9b700 1 -- 172.21.15.6:0/1399127875 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc0ad370 con 0x7fc7bc0acb50 2023-10-06T02:23:28.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7b9d9b700 1 -- 172.21.15.6:0/1399127875 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fc7a4001470 con 0x7fc7bc0acb50 2023-10-06T02:23:28.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7b9d9b700 1 -- 172.21.15.6:0/1399127875 >> v1:172.21.15.6:6789/0 conn(0x7fc7bc0acb50 legacy=0x7fc7bc159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7b9d9b700 1 --2- 172.21.15.6:0/1399127875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7a8003a60 0x7fc7a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7b9d9b700 1 --2- 172.21.15.6:0/1399127875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7a8004810 0x7fc7a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7b9d9b700 1 --2- 172.21.15.6:0/1399127875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7bc06b140 0x7fc7a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7b9d9b700 1 -- 172.21.15.6:0/1399127875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc06b530 con 0x7fc7a8003a60 2023-10-06T02:23:28.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7b9d9b700 1 -- 172.21.15.6:0/1399127875 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc0ad090 con 0x7fc7a8004810 2023-10-06T02:23:28.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7b9d9b700 1 -- 172.21.15.6:0/1399127875 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a800ba60 con 0x7fc7bc06b140 2023-10-06T02:23:28.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7bad9d700 1 --2- 172.21.15.6:0/1399127875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7a8003a60 0x7fc7a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7ba59c700 1 --2- 172.21.15.6:0/1399127875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7a8004810 0x7fc7a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7bb59e700 1 --2- 172.21.15.6:0/1399127875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7bc06b140 0x7fc7a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7bad9d700 1 -- 172.21.15.6:0/1399127875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7bc06b140 msgr2=0x7fc7a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7bad9d700 1 --2- 172.21.15.6:0/1399127875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7bc06b140 0x7fc7a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7bad9d700 1 -- 172.21.15.6:0/1399127875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7a8004810 msgr2=0x7fc7a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7bad9d700 1 --2- 172.21.15.6:0/1399127875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7a8004810 0x7fc7a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.092+0000 7fc7bad9d700 1 -- 172.21.15.6:0/1399127875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a8003570 con 0x7fc7a8003a60 2023-10-06T02:23:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.093+0000 7fc7bad9d700 1 --2- 172.21.15.6:0/1399127875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7a8003a60 0x7fc7a8003e70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400e240 tx=0x7fc7b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0bcb07164d87be9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.093+0000 7fc7b9d9b700 1 -- 172.21.15.6:0/1399127875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b400eaf0 con 0x7fc7a8003a60 2023-10-06T02:23:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.093+0000 7fc7b9d9b700 1 -- 172.21.15.6:0/1399127875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b400f040 con 0x7fc7a8003a60 2023-10-06T02:23:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.093+0000 7fc7b9d9b700 1 -- 172.21.15.6:0/1399127875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b400eea0 con 0x7fc7a8003a60 2023-10-06T02:23:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.093+0000 7fc7c10a1700 1 -- 172.21.15.6:0/1399127875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7a8003a60 msgr2=0x7fc7a8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.093+0000 7fc7c10a1700 1 --2- 172.21.15.6:0/1399127875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7a8003a60 0x7fc7a8003e70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400e240 tx=0x7fc7b400b040 comp rx=0 tx=0).stop 2023-10-06T02:23:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.093+0000 7fc7bb59e700 1 -- 172.21.15.6:0/1399127875 reap_dead start 2023-10-06T02:23:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.093+0000 7fc7c10a1700 1 -- 172.21.15.6:0/1399127875 shutdown_connections 2023-10-06T02:23:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.093+0000 7fc7c10a1700 1 -- 172.21.15.6:0/1399127875 >> 172.21.15.6:0/1399127875 conn(0x7fc7bc067910 msgr2=0x7fc7bc0ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:28.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.093+0000 7fc7c10a1700 1 -- 172.21.15.6:0/1399127875 shutdown_connections 2023-10-06T02:23:28.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.093+0000 7fc7c10a1700 1 -- 172.21.15.6:0/1399127875 wait complete. 2023-10-06T02:23:28.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.094+0000 7fc7c10a1700 1 Processor -- start 2023-10-06T02:23:28.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.094+0000 7fc7c10a1700 1 -- start start 2023-10-06T02:23:28.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.095+0000 7fc7c10a1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7a8003a60 0x7fc7bc098060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.095+0000 7fc7c10a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7bc145910 0x7fc7bc16d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.095+0000 7fc7c10a1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7bc16d6d0 0x7fc7bc16db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.095+0000 7fc7c10a1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc0986d0 con 0x7fc7bc145910 2023-10-06T02:23:28.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.095+0000 7fc7c10a1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc0989b0 con 0x7fc7a8003a60 2023-10-06T02:23:28.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.095+0000 7fc7c10a1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc098c90 con 0x7fc7bc16d6d0 2023-10-06T02:23:28.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.095+0000 7fc7ba59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7bc145910 0x7fc7bc16d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.095+0000 7fc7ba59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7bc145910 0x7fc7bc16d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34122/0 (socket says 172.21.15.6:34122) 2023-10-06T02:23:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.095+0000 7fc7ba59c700 1 -- 172.21.15.6:0/55452015 learned_addr learned my addr 172.21.15.6:0/55452015 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.095+0000 7fc7bad9d700 1 --2- 172.21.15.6:0/55452015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7a8003a60 0x7fc7bc098060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.095+0000 7fc7bb59e700 1 --2- 172.21.15.6:0/55452015 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7bc16d6d0 0x7fc7bc16db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.096+0000 7fc7ba59c700 1 -- 172.21.15.6:0/55452015 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7bc16d6d0 msgr2=0x7fc7bc16db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.096+0000 7fc7ba59c700 1 --2- 172.21.15.6:0/55452015 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7bc16d6d0 0x7fc7bc16db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.096+0000 7fc7ba59c700 1 -- 172.21.15.6:0/55452015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7a8003a60 msgr2=0x7fc7bc098060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.096+0000 7fc7ba59c700 1 --2- 172.21.15.6:0/55452015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7a8003a60 0x7fc7bc098060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.096+0000 7fc7ba59c700 1 -- 172.21.15.6:0/55452015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc098f70 con 0x7fc7bc145910 2023-10-06T02:23:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.096+0000 7fc7ba59c700 1 --2- 172.21.15.6:0/55452015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7bc145910 0x7fc7bc16d190 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4007390 tx=0x7fc7a4001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.096+0000 7fc7b2ffd700 1 -- 172.21.15.6:0/55452015 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4018030 con 0x7fc7bc145910 2023-10-06T02:23:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.096+0000 7fc7b2ffd700 1 -- 172.21.15.6:0/55452015 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a400f8d0 con 0x7fc7bc145910 2023-10-06T02:23:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.096+0000 7fc7c10a1700 1 -- 172.21.15.6:0/55452015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7bc099250 con 0x7fc7bc145910 2023-10-06T02:23:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.096+0000 7fc7b2ffd700 1 -- 172.21.15.6:0/55452015 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a400fc90 con 0x7fc7bc145910 2023-10-06T02:23:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.096+0000 7fc7c10a1700 1 -- 172.21.15.6:0/55452015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7bc145d60 con 0x7fc7bc145910 2023-10-06T02:23:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.097+0000 7fc7c10a1700 1 -- 172.21.15.6:0/55452015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7bc145f50 con 0x7fc7bc145910 2023-10-06T02:23:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.097+0000 7fc7b2ffd700 1 -- 172.21.15.6:0/55452015 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7a401b070 con 0x7fc7bc145910 2023-10-06T02:23:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.098+0000 7fc7b2ffd700 1 --2- 172.21.15.6:0/55452015 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc79c066f30 0x7fc79c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.098+0000 7fc7b2ffd700 1 -- 172.21.15.6:0/55452015 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6256+0+0 (secure 0 0 0) 0x7fc7a4019070 con 0x7fc7bc145910 2023-10-06T02:23:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.098+0000 7fc7bad9d700 1 --2- 172.21.15.6:0/55452015 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc79c066f30 0x7fc79c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.098+0000 7fc7bad9d700 1 --2- 172.21.15.6:0/55452015 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc79c066f30 0x7fc79c0693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009c30 tx=0x7fc7b401a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.102+0000 7fc7b2ffd700 1 -- 172.21.15.6:0/55452015 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7a4051670 con 0x7fc7bc145910 2023-10-06T02:23:28.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.297+0000 7fc7c10a1700 1 -- 172.21.15.6:0/55452015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc7bc099440 con 0x7fc7bc145910 2023-10-06T02:23:28.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.950+0000 7fc7b2ffd700 1 -- 172.21.15.6:0/55452015 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v73) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc7a4054c90 con 0x7fc7bc145910 2023-10-06T02:23:28.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.955+0000 7fc7c10a1700 1 -- 172.21.15.6:0/55452015 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc79c066f30 msgr2=0x7fc79c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.955+0000 7fc7c10a1700 1 --2- 172.21.15.6:0/55452015 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc79c066f30 0x7fc79c0693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009c30 tx=0x7fc7b401a000 comp rx=0 tx=0).stop 2023-10-06T02:23:28.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.955+0000 7fc7c10a1700 1 -- 172.21.15.6:0/55452015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7bc145910 msgr2=0x7fc7bc16d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.955+0000 7fc7c10a1700 1 --2- 172.21.15.6:0/55452015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7bc145910 0x7fc7bc16d190 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4007390 tx=0x7fc7a4001e90 comp rx=0 tx=0).stop 2023-10-06T02:23:28.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.955+0000 7fc7c10a1700 1 -- 172.21.15.6:0/55452015 shutdown_connections 2023-10-06T02:23:28.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.955+0000 7fc7c10a1700 1 --2- 172.21.15.6:0/55452015 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7bc16d6d0 0x7fc7bc16db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.955+0000 7fc7c10a1700 1 --2- 172.21.15.6:0/55452015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7a8003a60 0x7fc7bc098060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.955+0000 7fc7c10a1700 1 --2- 172.21.15.6:0/55452015 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc79c066f30 0x7fc79c0693e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.955+0000 7fc7c10a1700 1 --2- 172.21.15.6:0/55452015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7bc145910 0x7fc7bc16d190 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.955+0000 7fc7c10a1700 1 -- 172.21.15.6:0/55452015 >> 172.21.15.6:0/55452015 conn(0x7fc7bc067910 msgr2=0x7fc7bc1558c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:28.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.956+0000 7fc7c10a1700 1 -- 172.21.15.6:0/55452015 shutdown_connections 2023-10-06T02:23:28.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:28.956+0000 7fc7c10a1700 1 -- 172.21.15.6:0/55452015 wait complete. 2023-10-06T02:23:28.959 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-06T02:23:28.974 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_journal_corrupt_dentry_first 2023-10-06T02:23:29.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.100+0000 7f44c6326700 1 Processor -- start 2023-10-06T02:23:29.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.100+0000 7f44c6326700 1 -- start start 2023-10-06T02:23:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.101+0000 7f44c6326700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44c00ccd40 0x7f44c00cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.101+0000 7f44c6326700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c015dd40 con 0x7f44c00cf7e0 2023-10-06T02:23:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.101+0000 7f44c6326700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c015e020 con 0x7f44c00d0400 2023-10-06T02:23:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.101+0000 7f44c6326700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c00ceaa0 con 0x7f44c00ccd40 2023-10-06T02:23:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.101+0000 7f44bf7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44c00ccd40 0x7f44c00cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.101+0000 7f44c48c3700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f44c00cf7e0 0x7f44c00b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53054/0 (socket says 172.21.15.6:53054) 2023-10-06T02:23:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.101+0000 7f44c48c3700 1 -- 172.21.15.6:0/1893220197 learned_addr learned my addr 172.21.15.6:0/1893220197 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.101+0000 7f44bf7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44c00ccd40 0x7f44c00cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47864/0 (socket says 172.21.15.6:47864) 2023-10-06T02:23:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.102+0000 7f44bf7fe700 1 -- 172.21.15.6:0/1893220197 >> v1:172.21.15.175:6789/0 conn(0x7f44c00d0400 legacy=0x7f44c00b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.102+0000 7f44bf7fe700 1 -- 172.21.15.6:0/1893220197 >> v1:172.21.15.6:6789/0 conn(0x7f44c00cf7e0 legacy=0x7f44c00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.102+0000 7f44beffd700 1 -- 172.21.15.6:0/1893220197 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060960676 0 0) 0x7f44c015dd40 con 0x7f44c00cf7e0 2023-10-06T02:23:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.102+0000 7f44bf7fe700 1 -- 172.21.15.6:0/1893220197 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c00ced80 con 0x7f44c00ccd40 2023-10-06T02:23:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.102+0000 7f44bf7fe700 1 --2- 172.21.15.6:0/1893220197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c00ccd40 0x7f44c00cf2a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f44b00098e0 tx=0x7f44b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdce8a500e9bbbe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.102+0000 7f44beffd700 1 -- 172.21.15.6:0/1893220197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0009e80 con 0x7f44c00ccd40 2023-10-06T02:23:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.102+0000 7f44beffd700 1 -- 172.21.15.6:0/1893220197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b000b860 con 0x7f44c00ccd40 2023-10-06T02:23:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.102+0000 7f44beffd700 1 -- 172.21.15.6:0/1893220197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b000bbe0 con 0x7f44c00ccd40 2023-10-06T02:23:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.102+0000 7f44c6326700 1 -- 172.21.15.6:0/1893220197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c00ccd40 msgr2=0x7f44c00cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.102+0000 7f44c6326700 1 --2- 172.21.15.6:0/1893220197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c00ccd40 0x7f44c00cf2a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f44b00098e0 tx=0x7f44b00091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.103+0000 7f44c6326700 1 -- 172.21.15.6:0/1893220197 shutdown_connections 2023-10-06T02:23:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.103+0000 7f44c6326700 1 --2- 172.21.15.6:0/1893220197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c00ccd40 0x7f44c00cf2a0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.103+0000 7f44c6326700 1 -- 172.21.15.6:0/1893220197 >> 172.21.15.6:0/1893220197 conn(0x7f44c006a220 msgr2=0x7f44c006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.103+0000 7f44c6326700 1 -- 172.21.15.6:0/1893220197 shutdown_connections 2023-10-06T02:23:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.103+0000 7f44c6326700 1 -- 172.21.15.6:0/1893220197 wait complete. 2023-10-06T02:23:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.104+0000 7f44c6326700 1 Processor -- start 2023-10-06T02:23:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.104+0000 7f44c6326700 1 -- start start 2023-10-06T02:23:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.104+0000 7f44c6326700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44c00ccd40 0x7f44c015b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44c6326700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44c00cf7e0 0x7f44c016a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44c6326700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c00d0400 0x7f44c01534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44c6326700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c00c5440 con 0x7f44c00d0400 2023-10-06T02:23:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44c6326700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c0159630 con 0x7f44c00ccd40 2023-10-06T02:23:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44c6326700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c016a9e0 con 0x7f44c00cf7e0 2023-10-06T02:23:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44c48c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c00d0400 0x7f44c01534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44c48c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c00d0400 0x7f44c01534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47870/0 (socket says 172.21.15.6:47870) 2023-10-06T02:23:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44c48c3700 1 -- 172.21.15.6:0/3449394428 learned_addr learned my addr 172.21.15.6:0/3449394428 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44bf7fe700 1 --2- 172.21.15.6:0/3449394428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44c00cf7e0 0x7f44c016a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44bffff700 1 --2- 172.21.15.6:0/3449394428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44c00ccd40 0x7f44c015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44c48c3700 1 -- 172.21.15.6:0/3449394428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44c00cf7e0 msgr2=0x7f44c016a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44c48c3700 1 --2- 172.21.15.6:0/3449394428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44c00cf7e0 0x7f44c016a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44c48c3700 1 -- 172.21.15.6:0/3449394428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44c00ccd40 msgr2=0x7f44c015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44c48c3700 1 --2- 172.21.15.6:0/3449394428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44c00ccd40 0x7f44c015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44c48c3700 1 -- 172.21.15.6:0/3449394428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b0009420 con 0x7f44c00d0400 2023-10-06T02:23:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44c48c3700 1 --2- 172.21.15.6:0/3449394428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c00d0400 0x7f44c01534f0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f44b800cc90 tx=0x7f44b8001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44b7fff700 1 -- 172.21.15.6:0/3449394428 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b800a870 con 0x7f44c00d0400 2023-10-06T02:23:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44b7fff700 1 -- 172.21.15.6:0/3449394428 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b800a9d0 con 0x7f44c00d0400 2023-10-06T02:23:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44c6326700 1 -- 172.21.15.6:0/3449394428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c0153a30 con 0x7f44c00d0400 2023-10-06T02:23:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44b7fff700 1 -- 172.21.15.6:0/3449394428 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b800ad90 con 0x7f44c00d0400 2023-10-06T02:23:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.105+0000 7f44c6326700 1 -- 172.21.15.6:0/3449394428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c0158fe0 con 0x7f44c00d0400 2023-10-06T02:23:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.106+0000 7f44c6326700 1 -- 172.21.15.6:0/3449394428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c0158e40 con 0x7f44c00d0400 2023-10-06T02:23:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.107+0000 7f44b7fff700 1 -- 172.21.15.6:0/3449394428 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44b8007300 con 0x7f44c00d0400 2023-10-06T02:23:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.107+0000 7f44b7fff700 1 --2- 172.21.15.6:0/3449394428 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44a0066f30 0x7f44a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.107+0000 7f44b7fff700 1 -- 172.21.15.6:0/3449394428 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f44b80848e0 con 0x7f44c00d0400 2023-10-06T02:23:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.107+0000 7f44bffff700 1 --2- 172.21.15.6:0/3449394428 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44a0066f30 0x7f44a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.108+0000 7f44bffff700 1 --2- 172.21.15.6:0/3449394428 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44a0066f30 0x7f44a00693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f44c006b140 tx=0x7f44a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.111+0000 7f44b7fff700 1 -- 172.21.15.6:0/3449394428 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44c0158e40 con 0x7f44c00d0400 2023-10-06T02:23:29.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.306+0000 7f44c6326700 1 -- 172.21.15.6:0/3449394428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_journal_corrupt_dentry_first"} v 0) v1 -- 0x7f44c0158e40 con 0x7f44c00d0400 2023-10-06T02:23:29.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.306+0000 7f44b7fff700 1 -- 172.21.15.6:0/3449394428 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_journal_corrupt_dentry_first"}]=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f44c0158e40 con 0x7f44c00d0400 2023-10-06T02:23:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.308+0000 7f44c6326700 1 -- 172.21.15.6:0/3449394428 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44a0066f30 msgr2=0x7f44a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.308+0000 7f44c6326700 1 --2- 172.21.15.6:0/3449394428 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44a0066f30 0x7f44a00693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f44c006b140 tx=0x7f44a8009040 comp rx=0 tx=0).stop 2023-10-06T02:23:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.308+0000 7f44c6326700 1 -- 172.21.15.6:0/3449394428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c00d0400 msgr2=0x7f44c01534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.308+0000 7f44c6326700 1 --2- 172.21.15.6:0/3449394428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c00d0400 0x7f44c01534f0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f44b800cc90 tx=0x7f44b8001a20 comp rx=0 tx=0).stop 2023-10-06T02:23:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.308+0000 7f44c6326700 1 -- 172.21.15.6:0/3449394428 shutdown_connections 2023-10-06T02:23:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.308+0000 7f44c6326700 1 --2- 172.21.15.6:0/3449394428 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44a0066f30 0x7f44a00693e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.308+0000 7f44c6326700 1 --2- 172.21.15.6:0/3449394428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c00d0400 0x7f44c01534f0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.308+0000 7f44c6326700 1 --2- 172.21.15.6:0/3449394428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44c00ccd40 0x7f44c015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.308+0000 7f44c6326700 1 --2- 172.21.15.6:0/3449394428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44c00cf7e0 0x7f44c016a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.308+0000 7f44c6326700 1 -- 172.21.15.6:0/3449394428 >> 172.21.15.6:0/3449394428 conn(0x7f44c006a220 msgr2=0x7f44c00b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.308+0000 7f44c6326700 1 -- 172.21.15.6:0/3449394428 shutdown_connections 2023-10-06T02:23:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.308+0000 7f44c6326700 1 -- 172.21.15.6:0/3449394428 wait complete. 2023-10-06T02:23:29.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:23:29.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.441+0000 7fd63d59d700 1 Processor -- start 2023-10-06T02:23:29.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.441+0000 7fd63d59d700 1 -- start start 2023-10-06T02:23:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.442+0000 7fd63d59d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd638154100 0x7fd63806b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.442+0000 7fd63d59d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd63806bba0 0x7fd6380b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.442+0000 7fd63d59d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6380b0580 con 0x7fd638153d30 2023-10-06T02:23:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.442+0000 7fd63d59d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6380aeed0 con 0x7fd638154100 2023-10-06T02:23:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.442+0000 7fd63d59d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63806c020 con 0x7fd63806bba0 2023-10-06T02:23:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.443+0000 7fd6367fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd638154100 0x7fd63806b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.443+0000 7fd636ffd700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd638153d30 0x7fd6380afe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:36558/0 (socket says 172.21.15.6:36558) 2023-10-06T02:23:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.443+0000 7fd6367fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd638154100 0x7fd63806b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:42846/0 (socket says 172.21.15.6:42846) 2023-10-06T02:23:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.443+0000 7fd636ffd700 1 -- 172.21.15.6:0/1136257142 learned_addr learned my addr 172.21.15.6:0/1136257142 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.443+0000 7fd6377fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd63806bba0 0x7fd6380b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.443+0000 7fd6367fc700 1 -- 172.21.15.6:0/1136257142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd63806bba0 msgr2=0x7fd6380b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.443+0000 7fd6367fc700 1 --2- 172.21.15.6:0/1136257142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd63806bba0 0x7fd6380b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.443+0000 7fd6367fc700 1 -- 172.21.15.6:0/1136257142 >> v1:172.21.15.175:6789/0 conn(0x7fd638153d30 legacy=0x7fd6380afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.443+0000 7fd6367fc700 1 -- 172.21.15.6:0/1136257142 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6380af9e0 con 0x7fd638154100 2023-10-06T02:23:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.443+0000 7fd635ffb700 1 -- 172.21.15.6:0/1136257142 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770173205 0 0) 0x7fd628001110 con 0x7fd638153d30 2023-10-06T02:23:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.443+0000 7fd6367fc700 1 --2- 172.21.15.6:0/1136257142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd638154100 0x7fd63806b660 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd620009910 tx=0x7fd6200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f22980d53d096a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.443+0000 7fd635ffb700 1 -- 172.21.15.6:0/1136257142 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62000b640 con 0x7fd638154100 2023-10-06T02:23:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.443+0000 7fd635ffb700 1 -- 172.21.15.6:0/1136257142 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62000b7a0 con 0x7fd638154100 2023-10-06T02:23:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.443+0000 7fd635ffb700 1 -- 172.21.15.6:0/1136257142 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62000bb60 con 0x7fd638154100 2023-10-06T02:23:29.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.444+0000 7fd63d59d700 1 -- 172.21.15.6:0/1136257142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd638154100 msgr2=0x7fd63806b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.444+0000 7fd63d59d700 1 --2- 172.21.15.6:0/1136257142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd638154100 0x7fd63806b660 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd620009910 tx=0x7fd6200091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.444+0000 7fd63d59d700 1 -- 172.21.15.6:0/1136257142 shutdown_connections 2023-10-06T02:23:29.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.444+0000 7fd63d59d700 1 --2- 172.21.15.6:0/1136257142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd63806bba0 0x7fd6380b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.444+0000 7fd63d59d700 1 --2- 172.21.15.6:0/1136257142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd638154100 0x7fd63806b660 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.444+0000 7fd63d59d700 1 -- 172.21.15.6:0/1136257142 >> 172.21.15.6:0/1136257142 conn(0x7fd6380cc110 msgr2=0x7fd6380cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:29.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.444+0000 7fd63d59d700 1 -- 172.21.15.6:0/1136257142 shutdown_connections 2023-10-06T02:23:29.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.444+0000 7fd63d59d700 1 -- 172.21.15.6:0/1136257142 wait complete. 2023-10-06T02:23:29.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.445+0000 7fd63d59d700 1 Processor -- start 2023-10-06T02:23:29.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.445+0000 7fd63d59d700 1 -- start start 2023-10-06T02:23:29.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.446+0000 7fd63d59d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd63806bba0 0x7fd63816d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.446+0000 7fd63d59d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd638153d30 0x7fd6380c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.446+0000 7fd63d59d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd638154100 0x7fd6381698f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.446+0000 7fd63d59d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63806b4d0 con 0x7fd638154100 2023-10-06T02:23:29.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.446+0000 7fd63d59d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63816dee0 con 0x7fd63806bba0 2023-10-06T02:23:29.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.446+0000 7fd63d59d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380a46f0 con 0x7fd638153d30 2023-10-06T02:23:29.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.446+0000 7fd6377fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd638154100 0x7fd6381698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.446+0000 7fd6377fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd638154100 0x7fd6381698f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47886/0 (socket says 172.21.15.6:47886) 2023-10-06T02:23:29.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.446+0000 7fd6377fe700 1 -- 172.21.15.6:0/3732931618 learned_addr learned my addr 172.21.15.6:0/3732931618 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:29.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.446+0000 7fd636ffd700 1 --2- 172.21.15.6:0/3732931618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd63806bba0 0x7fd63816d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.446+0000 7fd6367fc700 1 --2- 172.21.15.6:0/3732931618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd638153d30 0x7fd6380c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.446+0000 7fd6377fe700 1 -- 172.21.15.6:0/3732931618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd638153d30 msgr2=0x7fd6380c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.446+0000 7fd6377fe700 1 --2- 172.21.15.6:0/3732931618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd638153d30 0x7fd6380c0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.446+0000 7fd6377fe700 1 -- 172.21.15.6:0/3732931618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd63806bba0 msgr2=0x7fd63816d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.446+0000 7fd6377fe700 1 --2- 172.21.15.6:0/3732931618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd63806bba0 0x7fd63816d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.446+0000 7fd6377fe700 1 -- 172.21.15.6:0/3732931618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd620009420 con 0x7fd638154100 2023-10-06T02:23:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.447+0000 7fd636ffd700 1 --2- 172.21.15.6:0/3732931618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd63806bba0 0x7fd63816d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.447+0000 7fd6367fc700 1 --2- 172.21.15.6:0/3732931618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd638153d30 0x7fd6380c0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.447+0000 7fd6377fe700 1 --2- 172.21.15.6:0/3732931618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd638154100 0x7fd6381698f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fd630009ec0 tx=0x7fd63000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.447+0000 7fd62effd700 1 -- 172.21.15.6:0/3732931618 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63000cb70 con 0x7fd638154100 2023-10-06T02:23:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.447+0000 7fd62effd700 1 -- 172.21.15.6:0/3732931618 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63000f040 con 0x7fd638154100 2023-10-06T02:23:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.447+0000 7fd63d59d700 1 -- 172.21.15.6:0/3732931618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63806af10 con 0x7fd638154100 2023-10-06T02:23:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.447+0000 7fd62effd700 1 -- 172.21.15.6:0/3732931618 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630014480 con 0x7fd638154100 2023-10-06T02:23:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.447+0000 7fd63d59d700 1 -- 172.21.15.6:0/3732931618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd638169e30 con 0x7fd638154100 2023-10-06T02:23:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.448+0000 7fd63d59d700 1 -- 172.21.15.6:0/3732931618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6380a44c0 con 0x7fd638154100 2023-10-06T02:23:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.448+0000 7fd62effd700 1 -- 172.21.15.6:0/3732931618 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd630014830 con 0x7fd638154100 2023-10-06T02:23:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.449+0000 7fd62effd700 1 --2- 172.21.15.6:0/3732931618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd618066f30 0x7fd6180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.449+0000 7fd62effd700 1 -- 172.21.15.6:0/3732931618 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fd630084ee0 con 0x7fd638154100 2023-10-06T02:23:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.449+0000 7fd636ffd700 1 --2- 172.21.15.6:0/3732931618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd618066f30 0x7fd6180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.449+0000 7fd636ffd700 1 --2- 172.21.15.6:0/3732931618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd618066f30 0x7fd6180693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd628006920 tx=0x7fd628007b90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.453+0000 7fd62effd700 1 -- 172.21.15.6:0/3732931618 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6380a44c0 con 0x7fd638154100 2023-10-06T02:23:29.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.650+0000 7fd63d59d700 1 -- 172.21.15.6:0/3732931618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd6380a44c0 con 0x7fd638154100 2023-10-06T02:23:29.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.654+0000 7fd62effd700 1 -- 172.21.15.6:0/3732931618 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd630052100 con 0x7fd638154100 2023-10-06T02:23:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.656+0000 7fd63d59d700 1 -- 172.21.15.6:0/3732931618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd618066f30 msgr2=0x7fd6180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.656+0000 7fd63d59d700 1 --2- 172.21.15.6:0/3732931618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd618066f30 0x7fd6180693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd628006920 tx=0x7fd628007b90 comp rx=0 tx=0).stop 2023-10-06T02:23:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.656+0000 7fd63d59d700 1 -- 172.21.15.6:0/3732931618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd638154100 msgr2=0x7fd6381698f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.656+0000 7fd63d59d700 1 --2- 172.21.15.6:0/3732931618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd638154100 0x7fd6381698f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fd630009ec0 tx=0x7fd63000b040 comp rx=0 tx=0).stop 2023-10-06T02:23:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.656+0000 7fd63d59d700 1 -- 172.21.15.6:0/3732931618 shutdown_connections 2023-10-06T02:23:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.656+0000 7fd63d59d700 1 --2- 172.21.15.6:0/3732931618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd618066f30 0x7fd6180693e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.656+0000 7fd63d59d700 1 --2- 172.21.15.6:0/3732931618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd638154100 0x7fd6381698f0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.656+0000 7fd63d59d700 1 --2- 172.21.15.6:0/3732931618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd63806bba0 0x7fd63816d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.656+0000 7fd63d59d700 1 --2- 172.21.15.6:0/3732931618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd638153d30 0x7fd6380c0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.656+0000 7fd63d59d700 1 -- 172.21.15.6:0/3732931618 >> 172.21.15.6:0/3732931618 conn(0x7fd6380cc110 msgr2=0x7fd6381520b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.656+0000 7fd63d59d700 1 -- 172.21.15.6:0/3732931618 shutdown_connections 2023-10-06T02:23:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.656+0000 7fd63d59d700 1 -- 172.21.15.6:0/3732931618 wait complete. 2023-10-06T02:23:29.671 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit' 2023-10-06T02:23:29.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.789+0000 7f806ea1a700 1 Processor -- start 2023-10-06T02:23:29.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.789+0000 7f806ea1a700 1 -- start start 2023-10-06T02:23:29.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.790+0000 7f806ea1a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8068069fc0 0x7f806806a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.790+0000 7f806ea1a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80680b16c0 con 0x7f8068069bf0 2023-10-06T02:23:29.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.790+0000 7f806ea1a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80680b1f40 con 0x7f806815d2d0 2023-10-06T02:23:29.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.790+0000 7f806ea1a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806806aac0 con 0x7f8068069fc0 2023-10-06T02:23:29.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.790+0000 7f806da18700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8068069bf0 0x7f80680b0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53058/0 (socket says 172.21.15.6:53058) 2023-10-06T02:23:29.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.790+0000 7f806da18700 1 -- 172.21.15.6:0/3085898545 learned_addr learned my addr 172.21.15.6:0/3085898545 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:29.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.791+0000 7f806d217700 1 --2- 172.21.15.6:0/3085898545 >> v2:172.21.15.175:3300/0 conn(0x7f8068069fc0 0x7f806806a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.791+0000 7f806d217700 1 -- 172.21.15.6:0/3085898545 >> v1:172.21.15.175:6789/0 conn(0x7f806815d2d0 legacy=0x7f806815d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.791+0000 7f806d217700 1 -- 172.21.15.6:0/3085898545 >> v1:172.21.15.6:6789/0 conn(0x7f8068069bf0 legacy=0x7f80680b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.791+0000 7f806d217700 1 -- 172.21.15.6:0/3085898545 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80680b18f0 con 0x7f8068069fc0 2023-10-06T02:23:29.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.791+0000 7f806d217700 1 --2- 172.21.15.6:0/3085898545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8068069fc0 0x7f806806a460 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f805c0098e0 tx=0x7f805c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c85de603f7dbe72c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.792+0000 7f806ca16700 1 -- 172.21.15.6:0/3085898545 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805c009e80 con 0x7f8068069fc0 2023-10-06T02:23:29.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.792+0000 7f806ca16700 1 -- 172.21.15.6:0/3085898545 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805c00b860 con 0x7f8068069fc0 2023-10-06T02:23:29.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.792+0000 7f806ca16700 1 -- 172.21.15.6:0/3085898545 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805c00bbe0 con 0x7f8068069fc0 2023-10-06T02:23:29.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.793+0000 7f806ea1a700 1 -- 172.21.15.6:0/3085898545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8068069fc0 msgr2=0x7f806806a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.793+0000 7f806ea1a700 1 --2- 172.21.15.6:0/3085898545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8068069fc0 0x7f806806a460 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f805c0098e0 tx=0x7f805c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.793+0000 7f806ea1a700 1 -- 172.21.15.6:0/3085898545 shutdown_connections 2023-10-06T02:23:29.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.793+0000 7f806ea1a700 1 --2- 172.21.15.6:0/3085898545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8068069fc0 0x7f806806a460 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.793+0000 7f806ea1a700 1 -- 172.21.15.6:0/3085898545 >> 172.21.15.6:0/3085898545 conn(0x7f8068067910 msgr2=0x7f80680cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:29.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.793+0000 7f806ea1a700 1 -- 172.21.15.6:0/3085898545 shutdown_connections 2023-10-06T02:23:29.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.793+0000 7f806ea1a700 1 -- 172.21.15.6:0/3085898545 wait complete. 2023-10-06T02:23:29.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.794+0000 7f806ea1a700 1 Processor -- start 2023-10-06T02:23:29.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.794+0000 7f806ea1a700 1 -- start start 2023-10-06T02:23:29.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.795+0000 7f806ea1a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8068069bf0 0x7f806815c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.795+0000 7f806ea1a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8068069fc0 0x7f80681524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.795+0000 7f806ea1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806815d2d0 0x7f8068156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.795+0000 7f806ea1a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8068152a00 con 0x7f806815d2d0 2023-10-06T02:23:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.795+0000 7f806ea1a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8068157cf0 con 0x7f8068069bf0 2023-10-06T02:23:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.795+0000 7f806ea1a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8068156e40 con 0x7f8068069fc0 2023-10-06T02:23:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.795+0000 7f806e219700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806815d2d0 0x7f8068156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.795+0000 7f806e219700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806815d2d0 0x7f8068156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47892/0 (socket says 172.21.15.6:47892) 2023-10-06T02:23:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.795+0000 7f806e219700 1 -- 172.21.15.6:0/95027660 learned_addr learned my addr 172.21.15.6:0/95027660 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.795+0000 7f806da18700 1 --2- 172.21.15.6:0/95027660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8068069bf0 0x7f806815c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.795+0000 7f806d217700 1 --2- 172.21.15.6:0/95027660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8068069fc0 0x7f80681524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.795+0000 7f806e219700 1 -- 172.21.15.6:0/95027660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8068069fc0 msgr2=0x7f80681524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.795+0000 7f806e219700 1 --2- 172.21.15.6:0/95027660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8068069fc0 0x7f80681524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.795+0000 7f806e219700 1 -- 172.21.15.6:0/95027660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8068069bf0 msgr2=0x7f806815c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.795+0000 7f806e219700 1 --2- 172.21.15.6:0/95027660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8068069bf0 0x7f806815c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.795+0000 7f806e219700 1 -- 172.21.15.6:0/95027660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805c009420 con 0x7f806815d2d0 2023-10-06T02:23:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.796+0000 7f806e219700 1 --2- 172.21.15.6:0/95027660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806815d2d0 0x7f8068156900 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f806000c4c0 tx=0x7f8060007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.796+0000 7f8065ffb700 1 -- 172.21.15.6:0/95027660 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060011590 con 0x7f806815d2d0 2023-10-06T02:23:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.796+0000 7f8065ffb700 1 -- 172.21.15.6:0/95027660 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8060011710 con 0x7f806815d2d0 2023-10-06T02:23:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.796+0000 7f806ea1a700 1 -- 172.21.15.6:0/95027660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80681570e0 con 0x7f806815d2d0 2023-10-06T02:23:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.796+0000 7f8065ffb700 1 -- 172.21.15.6:0/95027660 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060011ad0 con 0x7f806815d2d0 2023-10-06T02:23:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.796+0000 7f806ea1a700 1 -- 172.21.15.6:0/95027660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80681576a0 con 0x7f806815d2d0 2023-10-06T02:23:29.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.797+0000 7f806ea1a700 1 -- 172.21.15.6:0/95027660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80680ad5f0 con 0x7f806815d2d0 2023-10-06T02:23:29.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.797+0000 7f8065ffb700 1 -- 172.21.15.6:0/95027660 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f806001b3b0 con 0x7f806815d2d0 2023-10-06T02:23:29.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.797+0000 7f8065ffb700 1 --2- 172.21.15.6:0/95027660 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8054066f30 0x7f80540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.798+0000 7f8065ffb700 1 -- 172.21.15.6:0/95027660 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f8060083870 con 0x7f806815d2d0 2023-10-06T02:23:29.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.798+0000 7f806da18700 1 --2- 172.21.15.6:0/95027660 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8054066f30 0x7f80540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.798+0000 7f806da18700 1 --2- 172.21.15.6:0/95027660 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8054066f30 0x7f80540693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8058001460 tx=0x7f8058009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:29.802+0000 7f8065ffb700 1 -- 172.21.15.6:0/95027660 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8060050b50 con 0x7f806815d2d0 2023-10-06T02:23:30.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:30.076+0000 7f806ea1a700 1 -- 172.21.15.6:0/95027660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit"]} v 0) v1 -- 0x7f80680b1bd0 con 0x7f806815d2d0 2023-10-06T02:23:30.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:30.959+0000 7f8065ffb700 1 -- 172.21.15.6:0/95027660 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_precommit"]}]=0 v275) v1 ==== 142+0+0 (secure 0 0 0) 0x7f8060017070 con 0x7f806815d2d0 2023-10-06T02:23:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:30.961+0000 7f806ea1a700 1 -- 172.21.15.6:0/95027660 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8054066f30 msgr2=0x7f80540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:30.961+0000 7f806ea1a700 1 --2- 172.21.15.6:0/95027660 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8054066f30 0x7f80540693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8058001460 tx=0x7f8058009040 comp rx=0 tx=0).stop 2023-10-06T02:23:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:30.961+0000 7f806ea1a700 1 -- 172.21.15.6:0/95027660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806815d2d0 msgr2=0x7f8068156900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:30.961+0000 7f806ea1a700 1 --2- 172.21.15.6:0/95027660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806815d2d0 0x7f8068156900 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f806000c4c0 tx=0x7f8060007f50 comp rx=0 tx=0).stop 2023-10-06T02:23:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:30.961+0000 7f806ea1a700 1 -- 172.21.15.6:0/95027660 shutdown_connections 2023-10-06T02:23:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:30.961+0000 7f806ea1a700 1 --2- 172.21.15.6:0/95027660 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8054066f30 0x7f80540693e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:30.961+0000 7f806ea1a700 1 --2- 172.21.15.6:0/95027660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806815d2d0 0x7f8068156900 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:30.961+0000 7f806ea1a700 1 --2- 172.21.15.6:0/95027660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8068069bf0 0x7f806815c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:30.961+0000 7f806ea1a700 1 --2- 172.21.15.6:0/95027660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8068069fc0 0x7f80681524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:30.961+0000 7f806ea1a700 1 -- 172.21.15.6:0/95027660 >> 172.21.15.6:0/95027660 conn(0x7f8068067910 msgr2=0x7f80680b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:30.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:30.962+0000 7f806ea1a700 1 -- 172.21.15.6:0/95027660 shutdown_connections 2023-10-06T02:23:30.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:30.962+0000 7f806ea1a700 1 -- 172.21.15.6:0/95027660 wait complete. 2023-10-06T02:23:30.978 INFO:tasks.cephfs_test_runner:That the MDS won't write a dentry with new damage to CDentry::first ... ok 2023-10-06T02:23:30.978 INFO:tasks.cephfs_test_runner:Starting test: test_dentry_first_preflush (tasks.cephfs.test_damage.TestDamage) That the MDS won't write a dentry with new damage to CDentry::first 2023-10-06T02:23:30.978 INFO:tasks.cephfs_test_runner:test_dentry_first_preflush (tasks.cephfs.test_damage.TestDamage) 2023-10-06T02:23:30.978 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush' 2023-10-06T02:23:31.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.103+0000 7ff0187f9700 1 Processor -- start 2023-10-06T02:23:31.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.103+0000 7ff0187f9700 1 -- start start 2023-10-06T02:23:31.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff0187f9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff010068d90 0x7ff0100af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff0187f9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01006d5b0 con 0x7ff0100af1d0 2023-10-06T02:23:31.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff0187f9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01006dea0 con 0x7ff01006da40 2023-10-06T02:23:31.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff0187f9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0100caf90 con 0x7ff010068d90 2023-10-06T02:23:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff016595700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff0100af1d0 0x7ff010068680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53064/0 (socket says 172.21.15.6:53064) 2023-10-06T02:23:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff016595700 1 -- 172.21.15.6:0/296589921 learned_addr learned my addr 172.21.15.6:0/296589921 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015593700 1 -- 172.21.15.6:0/296589921 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786232596 0 0) 0x7ff01006d5b0 con 0x7ff0100af1d0 2023-10-06T02:23:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015593700 1 -- 172.21.15.6:0/296589921 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff8003570 con 0x7ff0100af1d0 2023-10-06T02:23:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015d94700 1 --2- 172.21.15.6:0/296589921 >> v2:172.21.15.175:3300/0 conn(0x7ff010068d90 0x7ff0100af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015593700 1 -- 172.21.15.6:0/296589921 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3148558242 0 0) 0x7feff8003570 con 0x7ff0100af1d0 2023-10-06T02:23:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015593700 1 -- 172.21.15.6:0/296589921 >> v2:172.21.15.175:3300/0 conn(0x7ff010068d90 msgr2=0x7ff0100af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015593700 1 --2- 172.21.15.6:0/296589921 >> v2:172.21.15.175:3300/0 conn(0x7ff010068d90 0x7ff0100af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015593700 1 -- 172.21.15.6:0/296589921 >> v1:172.21.15.175:6789/0 conn(0x7ff01006da40 legacy=0x7ff010159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015593700 1 -- 172.21.15.6:0/296589921 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01015a9a0 con 0x7ff0100af1d0 2023-10-06T02:23:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015593700 1 -- 172.21.15.6:0/296589921 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7ff0000017f0 con 0x7ff0100af1d0 2023-10-06T02:23:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015593700 1 -- 172.21.15.6:0/296589921 >> v1:172.21.15.6:6789/0 conn(0x7ff0100af1d0 legacy=0x7ff010068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015593700 1 --2- 172.21.15.6:0/296589921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feff8003a60 0x7feff8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015593700 1 --2- 172.21.15.6:0/296589921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feff8004810 0x7feff8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015593700 1 --2- 172.21.15.6:0/296589921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feff80051c0 0x7feff800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015593700 1 -- 172.21.15.6:0/296589921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100caf90 con 0x7feff8004810 2023-10-06T02:23:31.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015593700 1 -- 172.21.15.6:0/296589921 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff800c0d0 con 0x7feff8003a60 2023-10-06T02:23:31.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015593700 1 -- 172.21.15.6:0/296589921 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff800c290 con 0x7feff80051c0 2023-10-06T02:23:31.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015d94700 1 --2- 172.21.15.6:0/296589921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feff8004810 0x7feff8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff016595700 1 --2- 172.21.15.6:0/296589921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feff8003a60 0x7feff8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff016d96700 1 --2- 172.21.15.6:0/296589921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feff80051c0 0x7feff800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015d94700 1 -- 172.21.15.6:0/296589921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feff80051c0 msgr2=0x7feff800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:31.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015d94700 1 --2- 172.21.15.6:0/296589921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feff80051c0 0x7feff800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015d94700 1 -- 172.21.15.6:0/296589921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feff8003a60 msgr2=0x7feff8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015d94700 1 --2- 172.21.15.6:0/296589921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feff8003a60 0x7feff8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015d94700 1 -- 172.21.15.6:0/296589921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff8003570 con 0x7feff8004810 2023-10-06T02:23:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff016d96700 1 -- 172.21.15.6:0/296589921 reap_dead start 2023-10-06T02:23:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.105+0000 7ff015d94700 1 --2- 172.21.15.6:0/296589921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feff8004810 0x7feff8004c80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ff004009c00 tx=0x7ff0040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91fb4b45ca5f878 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.106+0000 7ff015593700 1 -- 172.21.15.6:0/296589921 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00400e710 con 0x7feff8004810 2023-10-06T02:23:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.106+0000 7ff015593700 1 -- 172.21.15.6:0/296589921 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00400e870 con 0x7feff8004810 2023-10-06T02:23:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.106+0000 7ff015593700 1 -- 172.21.15.6:0/296589921 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00400ec30 con 0x7feff8004810 2023-10-06T02:23:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.106+0000 7ff0187f9700 1 -- 172.21.15.6:0/296589921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feff8004810 msgr2=0x7feff8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.106+0000 7ff0187f9700 1 --2- 172.21.15.6:0/296589921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feff8004810 0x7feff8004c80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ff004009c00 tx=0x7ff0040091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.106+0000 7ff0187f9700 1 -- 172.21.15.6:0/296589921 shutdown_connections 2023-10-06T02:23:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.106+0000 7ff0187f9700 1 --2- 172.21.15.6:0/296589921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feff8004810 0x7feff8004c80 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.106+0000 7ff0187f9700 1 -- 172.21.15.6:0/296589921 >> 172.21.15.6:0/296589921 conn(0x7ff01006a220 msgr2=0x7ff01006b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.106+0000 7ff0187f9700 1 -- 172.21.15.6:0/296589921 shutdown_connections 2023-10-06T02:23:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.106+0000 7ff0187f9700 1 -- 172.21.15.6:0/296589921 wait complete. 2023-10-06T02:23:31.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.107+0000 7ff0187f9700 1 Processor -- start 2023-10-06T02:23:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.107+0000 7ff0187f9700 1 -- start start 2023-10-06T02:23:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.108+0000 7ff0187f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feff8004810 0x7ff0100b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.108+0000 7ff0187f9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0100ca690 0x7ff010169c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.108+0000 7ff0187f9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff01016b1c0 0x7ff010158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.108+0000 7ff0187f9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100afe50 con 0x7feff8004810 2023-10-06T02:23:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.108+0000 7ff0187f9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100b2740 con 0x7ff01016b1c0 2023-10-06T02:23:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.108+0000 7ff0187f9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01016a630 con 0x7ff0100ca690 2023-10-06T02:23:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.108+0000 7ff016595700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feff8004810 0x7ff0100b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.108+0000 7ff016595700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feff8004810 0x7ff0100b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47916/0 (socket says 172.21.15.6:47916) 2023-10-06T02:23:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.108+0000 7ff016595700 1 -- 172.21.15.6:0/560388508 learned_addr learned my addr 172.21.15.6:0/560388508 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.108+0000 7ff016d96700 1 --2- 172.21.15.6:0/560388508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff01016b1c0 0x7ff010158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.108+0000 7ff015d94700 1 --2- 172.21.15.6:0/560388508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0100ca690 0x7ff010169c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.108+0000 7ff016595700 1 -- 172.21.15.6:0/560388508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0100ca690 msgr2=0x7ff010169c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.108+0000 7ff016595700 1 --2- 172.21.15.6:0/560388508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0100ca690 0x7ff010169c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.108+0000 7ff016595700 1 -- 172.21.15.6:0/560388508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff01016b1c0 msgr2=0x7ff010158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.108+0000 7ff016595700 1 --2- 172.21.15.6:0/560388508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff01016b1c0 0x7ff010158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.109+0000 7ff016595700 1 -- 172.21.15.6:0/560388508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01016a910 con 0x7feff8004810 2023-10-06T02:23:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.109+0000 7ff015d94700 1 --2- 172.21.15.6:0/560388508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0100ca690 0x7ff010169c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.109+0000 7ff016d96700 1 --2- 172.21.15.6:0/560388508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff01016b1c0 0x7ff010158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.109+0000 7ff016595700 1 --2- 172.21.15.6:0/560388508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feff8004810 0x7ff0100b2200 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7ff000007bc0 tx=0x7ff0000021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.109+0000 7ff00e7fc700 1 -- 172.21.15.6:0/560388508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0000133f0 con 0x7feff8004810 2023-10-06T02:23:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.109+0000 7ff00e7fc700 1 -- 172.21.15.6:0/560388508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff000013570 con 0x7feff8004810 2023-10-06T02:23:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.109+0000 7ff0187f9700 1 -- 172.21.15.6:0/560388508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0100b00f0 con 0x7feff8004810 2023-10-06T02:23:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.109+0000 7ff00e7fc700 1 -- 172.21.15.6:0/560388508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000013930 con 0x7feff8004810 2023-10-06T02:23:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.109+0000 7ff0187f9700 1 -- 172.21.15.6:0/560388508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01016a1d0 con 0x7feff8004810 2023-10-06T02:23:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.110+0000 7ff0187f9700 1 -- 172.21.15.6:0/560388508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0100b0330 con 0x7feff8004810 2023-10-06T02:23:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.110+0000 7ff00e7fc700 1 -- 172.21.15.6:0/560388508 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff000013ca0 con 0x7feff8004810 2023-10-06T02:23:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.111+0000 7ff00e7fc700 1 --2- 172.21.15.6:0/560388508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feffc066f30 0x7feffc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.111+0000 7ff00e7fc700 1 -- 172.21.15.6:0/560388508 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5784+0+0 (secure 0 0 0) 0x7ff000085440 con 0x7feff8004810 2023-10-06T02:23:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.111+0000 7ff015d94700 1 --2- 172.21.15.6:0/560388508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feffc066f30 0x7feffc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.112+0000 7ff015d94700 1 --2- 172.21.15.6:0/560388508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feffc066f30 0x7feffc0693e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff0101678b0 tx=0x7ff00401a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.116+0000 7ff00e7fc700 1 -- 172.21.15.6:0/560388508 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0100b0330 con 0x7feff8004810 2023-10-06T02:23:31.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.390+0000 7ff0187f9700 1 -- 172.21.15.6:0/560388508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush"]} v 0) v1 -- 0x7ff0100b0330 con 0x7feff8004810 2023-10-06T02:23:31.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.960+0000 7ff00e7fc700 1 -- 172.21.15.6:0/560388508 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush"]}]=0 v276) v1 ==== 144+0+0 (secure 0 0 0) 0x7ff0100b0330 con 0x7feff8004810 2023-10-06T02:23:31.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.963+0000 7ff0187f9700 1 -- 172.21.15.6:0/560388508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feffc066f30 msgr2=0x7feffc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.963+0000 7ff0187f9700 1 --2- 172.21.15.6:0/560388508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feffc066f30 0x7feffc0693e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff0101678b0 tx=0x7ff00401a000 comp rx=0 tx=0).stop 2023-10-06T02:23:31.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.963+0000 7ff0187f9700 1 -- 172.21.15.6:0/560388508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feff8004810 msgr2=0x7ff0100b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.963+0000 7ff0187f9700 1 --2- 172.21.15.6:0/560388508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feff8004810 0x7ff0100b2200 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7ff000007bc0 tx=0x7ff0000021d0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.963+0000 7ff0187f9700 1 -- 172.21.15.6:0/560388508 shutdown_connections 2023-10-06T02:23:31.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.963+0000 7ff0187f9700 1 --2- 172.21.15.6:0/560388508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff01016b1c0 0x7ff010158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.963+0000 7ff0187f9700 1 --2- 172.21.15.6:0/560388508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feffc066f30 0x7feffc0693e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.963+0000 7ff0187f9700 1 --2- 172.21.15.6:0/560388508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feff8004810 0x7ff0100b2200 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.963+0000 7ff0187f9700 1 --2- 172.21.15.6:0/560388508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0100ca690 0x7ff010169c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.963+0000 7ff0187f9700 1 -- 172.21.15.6:0/560388508 >> 172.21.15.6:0/560388508 conn(0x7ff01006a220 msgr2=0x7ff010068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:31.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.964+0000 7ff0187f9700 1 -- 172.21.15.6:0/560388508 shutdown_connections 2023-10-06T02:23:31.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:31.964+0000 7ff0187f9700 1 -- 172.21.15.6:0/560388508 wait complete. 2023-10-06T02:23:31.982 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:23:32.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.104+0000 7f6ed2a25700 1 Processor -- start 2023-10-06T02:23:32.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.104+0000 7f6ed2a25700 1 -- start start 2023-10-06T02:23:32.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.105+0000 7f6ed2a25700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6ecc15a030 0x7f6ecc15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.105+0000 7f6ed2a25700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc087700 0x7f6ecc0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.105+0000 7f6ed2a25700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ecc0afc50 con 0x7f6ecc15a940 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.105+0000 7f6ed2a25700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ecc0b0cf0 con 0x7f6ecc15a030 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.105+0000 7f6ed2a25700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0aff30 con 0x7f6ecc087700 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.105+0000 7f6ed0fc2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc087700 0x7f6ecc0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.105+0000 7f6ecbfff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6ecc15a030 0x7f6ecc15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.105+0000 7f6ed0fc2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc087700 0x7f6ecc0b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:42082/0 (socket says 172.21.15.6:42082) 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.105+0000 7f6ecbfff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6ecc15a030 0x7f6ecc15a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:42916/0 (socket says 172.21.15.6:42916) 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.105+0000 7f6ed0fc2700 1 -- 172.21.15.6:0/771629339 learned_addr learned my addr 172.21.15.6:0/771629339 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.105+0000 7f6ecb7fe700 1 --1- 172.21.15.6:0/771629339 >> v1:172.21.15.175:6789/0 conn(0x7f6ecc15a940 0x7f6ecc086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:36592/0 (socket says 172.21.15.6:36592) 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.106+0000 7f6ecbfff700 1 -- 172.21.15.6:0/771629339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc087700 msgr2=0x7f6ecc0b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:32.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.106+0000 7f6ecbfff700 1 --2- 172.21.15.6:0/771629339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc087700 0x7f6ecc0b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.106+0000 7f6ecbfff700 1 -- 172.21.15.6:0/771629339 >> v1:172.21.15.175:6789/0 conn(0x7f6ecc15a940 legacy=0x7f6ecc086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.106+0000 7f6ecbfff700 1 -- 172.21.15.6:0/771629339 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc0b0210 con 0x7f6ecc15a030 2023-10-06T02:23:32.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.106+0000 7f6ecbfff700 1 --2- 172.21.15.6:0/771629339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ecc15a030 0x7f6ecc15a400 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0098e0 tx=0x7f6ebc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11256a179a1b0488 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.106+0000 7f6ecaffd700 1 -- 172.21.15.6:0/771629339 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc00b640 con 0x7f6ecc15a030 2023-10-06T02:23:32.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.106+0000 7f6ecaffd700 1 -- 172.21.15.6:0/771629339 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc00b7a0 con 0x7f6ecc15a030 2023-10-06T02:23:32.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.106+0000 7f6ecaffd700 1 -- 172.21.15.6:0/771629339 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc00bb40 con 0x7f6ecc15a030 2023-10-06T02:23:32.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.107+0000 7f6ed2a25700 1 -- 172.21.15.6:0/771629339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ecc15a030 msgr2=0x7f6ecc15a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.107+0000 7f6ed2a25700 1 --2- 172.21.15.6:0/771629339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ecc15a030 0x7f6ecc15a400 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0098e0 tx=0x7f6ebc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.107+0000 7f6ed2a25700 1 -- 172.21.15.6:0/771629339 shutdown_connections 2023-10-06T02:23:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.107+0000 7f6ed2a25700 1 --2- 172.21.15.6:0/771629339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc087700 0x7f6ecc0b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.107+0000 7f6ed2a25700 1 --2- 172.21.15.6:0/771629339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ecc15a030 0x7f6ecc15a400 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.107+0000 7f6ed2a25700 1 -- 172.21.15.6:0/771629339 >> 172.21.15.6:0/771629339 conn(0x7f6ecc068680 msgr2=0x7f6ecc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.107+0000 7f6ed2a25700 1 -- 172.21.15.6:0/771629339 shutdown_connections 2023-10-06T02:23:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.107+0000 7f6ed2a25700 1 -- 172.21.15.6:0/771629339 wait complete. 2023-10-06T02:23:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.108+0000 7f6ed2a25700 1 Processor -- start 2023-10-06T02:23:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.108+0000 7f6ed2a25700 1 -- start start 2023-10-06T02:23:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ed2a25700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc087700 0x7f6ecc16b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ed2a25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ecc15a030 0x7f6ecc15d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ed2a25700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ecc15a940 0x7f6ecc0c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ed2a25700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc15b810 con 0x7f6ecc15a030 2023-10-06T02:23:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ed2a25700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc15aee0 con 0x7f6ecc15a940 2023-10-06T02:23:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ed2a25700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc15b1c0 con 0x7f6ecc087700 2023-10-06T02:23:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ecb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ecc15a030 0x7f6ecc15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ecb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ecc15a030 0x7f6ecc15d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47924/0 (socket says 172.21.15.6:47924) 2023-10-06T02:23:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ecb7fe700 1 -- 172.21.15.6:0/3863376513 learned_addr learned my addr 172.21.15.6:0/3863376513 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ecbfff700 1 --2- 172.21.15.6:0/3863376513 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc087700 0x7f6ecc16b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ed0fc2700 1 --2- 172.21.15.6:0/3863376513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ecc15a940 0x7f6ecc0c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ecb7fe700 1 -- 172.21.15.6:0/3863376513 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc087700 msgr2=0x7f6ecc16b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ecb7fe700 1 --2- 172.21.15.6:0/3863376513 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc087700 0x7f6ecc16b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ecb7fe700 1 -- 172.21.15.6:0/3863376513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ecc15a940 msgr2=0x7f6ecc0c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ecb7fe700 1 --2- 172.21.15.6:0/3863376513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ecc15a940 0x7f6ecc0c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ecb7fe700 1 -- 172.21.15.6:0/3863376513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc009420 con 0x7f6ecc15a030 2023-10-06T02:23:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ecb7fe700 1 --2- 172.21.15.6:0/3863376513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ecc15a030 0x7f6ecc15d370 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000c590 tx=0x7f6ec0007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6eb3fff700 1 -- 172.21.15.6:0/3863376513 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec000ce60 con 0x7f6ecc15a030 2023-10-06T02:23:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6eb3fff700 1 -- 172.21.15.6:0/3863376513 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec0005a70 con 0x7f6ecc15a030 2023-10-06T02:23:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ed2a25700 1 -- 172.21.15.6:0/3863376513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc15b4a0 con 0x7f6ecc15a030 2023-10-06T02:23:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6eb3fff700 1 -- 172.21.15.6:0/3863376513 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0005e50 con 0x7f6ecc15a030 2023-10-06T02:23:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.110+0000 7f6ed2a25700 1 -- 172.21.15.6:0/3863376513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc15d8b0 con 0x7f6ecc15a030 2023-10-06T02:23:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.111+0000 7f6ed2a25700 1 -- 172.21.15.6:0/3863376513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ecc15b980 con 0x7f6ecc15a030 2023-10-06T02:23:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.111+0000 7f6eb3fff700 1 -- 172.21.15.6:0/3863376513 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ec00072e0 con 0x7f6ecc15a030 2023-10-06T02:23:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.111+0000 7f6eb3fff700 1 --2- 172.21.15.6:0/3863376513 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6eb8066f30 0x7f6eb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.112+0000 7f6eb3fff700 1 -- 172.21.15.6:0/3863376513 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f6ec0083840 con 0x7f6ecc15a030 2023-10-06T02:23:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.112+0000 7f6ecbfff700 1 --2- 172.21.15.6:0/3863376513 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6eb8066f30 0x7f6eb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.112+0000 7f6ecbfff700 1 --2- 172.21.15.6:0/3863376513 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6eb8066f30 0x7f6eb80693e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0093f0 tx=0x7f6ebc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.116+0000 7f6eb3fff700 1 -- 172.21.15.6:0/3863376513 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ec0050a60 con 0x7f6ecc15a030 2023-10-06T02:23:32.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.310+0000 7f6ed2a25700 1 -- 172.21.15.6:0/3863376513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6ecc0b04f0 con 0x7f6ecc15a030 2023-10-06T02:23:32.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.313+0000 7f6eb3fff700 1 -- 172.21.15.6:0/3863376513 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6ec0017020 con 0x7f6ecc15a030 2023-10-06T02:23:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.315+0000 7f6ed2a25700 1 -- 172.21.15.6:0/3863376513 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6eb8066f30 msgr2=0x7f6eb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.315+0000 7f6ed2a25700 1 --2- 172.21.15.6:0/3863376513 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6eb8066f30 0x7f6eb80693e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0093f0 tx=0x7f6ebc017000 comp rx=0 tx=0).stop 2023-10-06T02:23:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.315+0000 7f6ed2a25700 1 -- 172.21.15.6:0/3863376513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ecc15a030 msgr2=0x7f6ecc15d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.315+0000 7f6ed2a25700 1 --2- 172.21.15.6:0/3863376513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ecc15a030 0x7f6ecc15d370 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000c590 tx=0x7f6ec0007f10 comp rx=0 tx=0).stop 2023-10-06T02:23:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.315+0000 7f6ed2a25700 1 -- 172.21.15.6:0/3863376513 shutdown_connections 2023-10-06T02:23:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.315+0000 7f6ed2a25700 1 --2- 172.21.15.6:0/3863376513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ecc15a940 0x7f6ecc0c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.315+0000 7f6ed2a25700 1 --2- 172.21.15.6:0/3863376513 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc087700 0x7f6ecc16b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.315+0000 7f6ed2a25700 1 --2- 172.21.15.6:0/3863376513 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6eb8066f30 0x7f6eb80693e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.315+0000 7f6ed2a25700 1 --2- 172.21.15.6:0/3863376513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ecc15a030 0x7f6ecc15d370 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.315+0000 7f6ed2a25700 1 -- 172.21.15.6:0/3863376513 >> 172.21.15.6:0/3863376513 conn(0x7f6ecc068680 msgr2=0x7f6ecc158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:32.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.316+0000 7f6ed2a25700 1 -- 172.21.15.6:0/3863376513 shutdown_connections 2023-10-06T02:23:32.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.316+0000 7f6ed2a25700 1 -- 172.21.15.6:0/3863376513 wait complete. 2023-10-06T02:23:32.329 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:23:32.329 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:23:32.370 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:23:32.415 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:23:32.415 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:23:32.415 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:32.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.533+0000 7f32d486e700 1 Processor -- start 2023-10-06T02:23:32.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.533+0000 7f32d486e700 1 -- start start 2023-10-06T02:23:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.534+0000 7f32d486e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32d01593f0 0x7f32d006de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.534+0000 7f32d486e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f32d01597c0 0x7f32d006e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.534+0000 7f32d486e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d0069950 con 0x7f32d00b3d30 2023-10-06T02:23:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.534+0000 7f32d486e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d00b2850 con 0x7f32d01597c0 2023-10-06T02:23:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.534+0000 7f32d486e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d00b1fb0 con 0x7f32d01593f0 2023-10-06T02:23:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.534+0000 7f32cdd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f32d01597c0 0x7f32d006e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.534+0000 7f32ced9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f32d00b3d30 0x7f32d015d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53074/0 (socket says 172.21.15.6:53074) 2023-10-06T02:23:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.534+0000 7f32cdd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f32d01597c0 0x7f32d006e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47936/0 (socket says 172.21.15.6:47936) 2023-10-06T02:23:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.534+0000 7f32ced9d700 1 -- 172.21.15.6:0/2029010019 learned_addr learned my addr 172.21.15.6:0/2029010019 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.534+0000 7f32ce59c700 1 --2- 172.21.15.6:0/2029010019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32d01593f0 0x7f32d006de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.534+0000 7f32cdd9b700 1 -- 172.21.15.6:0/2029010019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32d01593f0 msgr2=0x7f32d006de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.534+0000 7f32cdd9b700 1 --2- 172.21.15.6:0/2029010019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32d01593f0 0x7f32d006de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.534+0000 7f32cdd9b700 1 -- 172.21.15.6:0/2029010019 >> v1:172.21.15.6:6789/0 conn(0x7f32d00b3d30 legacy=0x7f32d015d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.534+0000 7f32cd59a700 1 -- 172.21.15.6:0/2029010019 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3404305854 0 0) 0x7f32d0069950 con 0x7f32d00b3d30 2023-10-06T02:23:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.534+0000 7f32cdd9b700 1 -- 172.21.15.6:0/2029010019 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d00b2290 con 0x7f32d01597c0 2023-10-06T02:23:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.534+0000 7f32ce59c700 1 --2- 172.21.15.6:0/2029010019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32d01593f0 0x7f32d006de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.534+0000 7f32cdd9b700 1 --2- 172.21.15.6:0/2029010019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d01597c0 0x7f32d006e350 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f32c40098d0 tx=0x7f32c4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d628f962df84745 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.535+0000 7f32cd59a700 1 -- 172.21.15.6:0/2029010019 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c4009e70 con 0x7f32d01597c0 2023-10-06T02:23:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.535+0000 7f32cd59a700 1 -- 172.21.15.6:0/2029010019 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c4005c10 con 0x7f32d01597c0 2023-10-06T02:23:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.535+0000 7f32cd59a700 1 -- 172.21.15.6:0/2029010019 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c400b650 con 0x7f32d01597c0 2023-10-06T02:23:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.535+0000 7f32d486e700 1 -- 172.21.15.6:0/2029010019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d01597c0 msgr2=0x7f32d006e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.535+0000 7f32d486e700 1 --2- 172.21.15.6:0/2029010019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d01597c0 0x7f32d006e350 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f32c40098d0 tx=0x7f32c4009120 comp rx=0 tx=0).stop 2023-10-06T02:23:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.535+0000 7f32d486e700 1 -- 172.21.15.6:0/2029010019 shutdown_connections 2023-10-06T02:23:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.535+0000 7f32d486e700 1 --2- 172.21.15.6:0/2029010019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32d01593f0 0x7f32d006de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.535+0000 7f32d486e700 1 --2- 172.21.15.6:0/2029010019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d01597c0 0x7f32d006e350 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.535+0000 7f32d486e700 1 -- 172.21.15.6:0/2029010019 >> 172.21.15.6:0/2029010019 conn(0x7f32d006cff0 msgr2=0x7f32d00afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.535+0000 7f32d486e700 1 -- 172.21.15.6:0/2029010019 shutdown_connections 2023-10-06T02:23:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.535+0000 7f32d486e700 1 -- 172.21.15.6:0/2029010019 wait complete. 2023-10-06T02:23:32.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.536+0000 7f32d486e700 1 Processor -- start 2023-10-06T02:23:32.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.536+0000 7f32d486e700 1 -- start start 2023-10-06T02:23:32.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.537+0000 7f32d486e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32d00b3d30 0x7f32d015db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.537+0000 7f32d486e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d01593f0 0x7f32d0169ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.537+0000 7f32d486e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d01597c0 0x7f32d016a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.537+0000 7f32d486e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d0156120 con 0x7f32d01593f0 2023-10-06T02:23:32.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.537+0000 7f32d486e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d015e5a0 con 0x7f32d01597c0 2023-10-06T02:23:32.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.537+0000 7f32d486e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d015e880 con 0x7f32d00b3d30 2023-10-06T02:23:32.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.537+0000 7f32cdd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d01593f0 0x7f32d0169ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.537+0000 7f32cdd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d01593f0 0x7f32d0169ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47950/0 (socket says 172.21.15.6:47950) 2023-10-06T02:23:32.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.537+0000 7f32cdd9b700 1 -- 172.21.15.6:0/3408898952 learned_addr learned my addr 172.21.15.6:0/3408898952 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:32.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.537+0000 7f32ced9d700 1 --2- 172.21.15.6:0/3408898952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d01597c0 0x7f32d016a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.537+0000 7f32ce59c700 1 --2- 172.21.15.6:0/3408898952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32d00b3d30 0x7f32d015db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.538+0000 7f32cdd9b700 1 -- 172.21.15.6:0/3408898952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32d00b3d30 msgr2=0x7f32d015db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.538+0000 7f32cdd9b700 1 --2- 172.21.15.6:0/3408898952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32d00b3d30 0x7f32d015db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.538+0000 7f32cdd9b700 1 -- 172.21.15.6:0/3408898952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d01597c0 msgr2=0x7f32d016a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.538+0000 7f32cdd9b700 1 --2- 172.21.15.6:0/3408898952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d01597c0 0x7f32d016a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.538+0000 7f32cdd9b700 1 -- 172.21.15.6:0/3408898952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c40093c0 con 0x7f32d01593f0 2023-10-06T02:23:32.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.538+0000 7f32ced9d700 1 --2- 172.21.15.6:0/3408898952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d01597c0 0x7f32d016a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:32.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.538+0000 7f32ce59c700 1 --2- 172.21.15.6:0/3408898952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32d00b3d30 0x7f32d015db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:32.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.538+0000 7f32cdd9b700 1 --2- 172.21.15.6:0/3408898952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d01593f0 0x7f32d0169ea0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f32d006fe40 tx=0x7f32c4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.538+0000 7f32be7fc700 1 -- 172.21.15.6:0/3408898952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c4006490 con 0x7f32d01593f0 2023-10-06T02:23:32.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.538+0000 7f32be7fc700 1 -- 172.21.15.6:0/3408898952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c4006610 con 0x7f32d01593f0 2023-10-06T02:23:32.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.538+0000 7f32d486e700 1 -- 172.21.15.6:0/3408898952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d0155db0 con 0x7f32d01593f0 2023-10-06T02:23:32.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.538+0000 7f32be7fc700 1 -- 172.21.15.6:0/3408898952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c401b480 con 0x7f32d01593f0 2023-10-06T02:23:32.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.538+0000 7f32d486e700 1 -- 172.21.15.6:0/3408898952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d0158a90 con 0x7f32d01593f0 2023-10-06T02:23:32.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.539+0000 7f32d486e700 1 -- 172.21.15.6:0/3408898952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d0155c10 con 0x7f32d01593f0 2023-10-06T02:23:32.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.539+0000 7f32be7fc700 1 -- 172.21.15.6:0/3408898952 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32c401b870 con 0x7f32d01593f0 2023-10-06T02:23:32.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.540+0000 7f32be7fc700 1 --2- 172.21.15.6:0/3408898952 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f32b0066f30 0x7f32b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.540+0000 7f32be7fc700 1 -- 172.21.15.6:0/3408898952 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f32c40867d0 con 0x7f32d01593f0 2023-10-06T02:23:32.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.540+0000 7f32ce59c700 1 --2- 172.21.15.6:0/3408898952 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f32b0066f30 0x7f32b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.540+0000 7f32ce59c700 1 --2- 172.21.15.6:0/3408898952 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f32b0066f30 0x7f32b00693e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f32d015ed40 tx=0x7f32c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.545+0000 7f32be7fc700 1 -- 172.21.15.6:0/3408898952 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32d0155c10 con 0x7f32d01593f0 2023-10-06T02:23:32.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.781+0000 7f32d486e700 1 -- 172.21.15.6:0/3408898952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32d0155c10 con 0x7f32d01593f0 2023-10-06T02:23:32.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.782+0000 7f32be7fc700 1 -- 172.21.15.6:0/3408898952 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+3520 (secure 0 0 0) 0x7f32d0155c10 con 0x7f32d01593f0 2023-10-06T02:23:32.783 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:32.783 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":65,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/798794538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":798794538},{"type":"v1","addr":"172.21.15.175:6836","nonce":798794538}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/400475961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":400475961},{"type":"v1","addr":"172.21.15.175:6837","nonce":400475961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6579,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/628657260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":628657260},{"type":"v1","addr":"172.21.15.6:6834","nonce":628657260}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1170510238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1170510238},{"type":"v1","addr":"172.21.15.6:6835","nonce":1170510238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[]} 2023-10-06T02:23:32.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.783+0000 7f32d486e700 1 -- 172.21.15.6:0/3408898952 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f32b0066f30 msgr2=0x7f32b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.783+0000 7f32d486e700 1 --2- 172.21.15.6:0/3408898952 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f32b0066f30 0x7f32b00693e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f32d015ed40 tx=0x7f32c0008040 comp rx=0 tx=0).stop 2023-10-06T02:23:32.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.783+0000 7f32d486e700 1 -- 172.21.15.6:0/3408898952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d01593f0 msgr2=0x7f32d0169ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.783+0000 7f32d486e700 1 --2- 172.21.15.6:0/3408898952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d01593f0 0x7f32d0169ea0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f32d006fe40 tx=0x7f32c4016000 comp rx=0 tx=0).stop 2023-10-06T02:23:32.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.783+0000 7f32d486e700 1 -- 172.21.15.6:0/3408898952 shutdown_connections 2023-10-06T02:23:32.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.784+0000 7f32d486e700 1 --2- 172.21.15.6:0/3408898952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d01597c0 0x7f32d016a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.784+0000 7f32d486e700 1 --2- 172.21.15.6:0/3408898952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32d00b3d30 0x7f32d015db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.784+0000 7f32d486e700 1 --2- 172.21.15.6:0/3408898952 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f32b0066f30 0x7f32b00693e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.784+0000 7f32d486e700 1 --2- 172.21.15.6:0/3408898952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d01593f0 0x7f32d0169ea0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.784+0000 7f32d486e700 1 -- 172.21.15.6:0/3408898952 >> 172.21.15.6:0/3408898952 conn(0x7f32d006cff0 msgr2=0x7f32d00afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:32.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.784+0000 7f32d486e700 1 -- 172.21.15.6:0/3408898952 shutdown_connections 2023-10-06T02:23:32.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.784+0000 7f32d486e700 1 -- 172.21.15.6:0/3408898952 wait complete. 2023-10-06T02:23:32.787 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 65 2023-10-06T02:23:32.797 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:23:32.797 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:23:32.798 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:23:32.798 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:23:32.798 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:23:32.798 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:23:32.798 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:23:32.798 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:23:32.798 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:23:32.799 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:23:32.799 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:23:32.799 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:23:32.799 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:23:32.799 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:23:32.799 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:23:32.799 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:23:32.807 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:23:32.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:23:32.807 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:23:32.808 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:23:32.810 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:23:32.810 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:23:32.811 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:23:32.811 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:23:32.849 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:23:32.849 DEBUG:teuthology.parallel:result is None 2023-10-06T02:23:32.850 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:23:32.850 DEBUG:teuthology.parallel:result is None 2023-10-06T02:23:32.853 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:23:32.853 DEBUG:teuthology.parallel:result is None 2023-10-06T02:23:32.853 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:23:32.854 DEBUG:teuthology.parallel:result is None 2023-10-06T02:23:32.854 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:23:32.926 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:23:32.926 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-06T02:23:32.938 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-10-06T02:23:32.938 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-10-06T02:23:32.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.985+0000 7fd6f7076700 1 Processor -- start 2023-10-06T02:23:32.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.985+0000 7fd6f7076700 1 -- start start 2023-10-06T02:23:32.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.985+0000 7fd6f7076700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6f0086ff0 0x7fd6f0087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.985+0000 7fd6f7076700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6f00b21b0 0x7fd6f00b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.985+0000 7fd6f7076700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f00b2b70 con 0x7fd6f015a030 2023-10-06T02:23:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.985+0000 7fd6f7076700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f00b0cf0 con 0x7fd6f0086ff0 2023-10-06T02:23:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.985+0000 7fd6f7076700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00879b0 con 0x7fd6f00b21b0 2023-10-06T02:23:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.985+0000 7fd6effff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6f0086ff0 0x7fd6f0087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.986+0000 7fd6effff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6f0086ff0 0x7fd6f0087470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47986/0 (socket says 172.21.15.6:47986) 2023-10-06T02:23:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.986+0000 7fd6effff700 1 -- 172.21.15.6:0/343492179 learned_addr learned my addr 172.21.15.6:0/343492179 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.986+0000 7fd6f4e12700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd6f015a030 0x7fd6f015a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53108/0 (socket says 172.21.15.6:53108) 2023-10-06T02:23:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.986+0000 7fd6f5613700 1 --2- 172.21.15.6:0/343492179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6f00b21b0 0x7fd6f00b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.986+0000 7fd6effff700 1 -- 172.21.15.6:0/343492179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6f00b21b0 msgr2=0x7fd6f00b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.986+0000 7fd6effff700 1 --2- 172.21.15.6:0/343492179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6f00b21b0 0x7fd6f00b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.986+0000 7fd6effff700 1 -- 172.21.15.6:0/343492179 >> v1:172.21.15.6:6789/0 conn(0x7fd6f015a030 legacy=0x7fd6f015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.986+0000 7fd6effff700 1 -- 172.21.15.6:0/343492179 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00afc50 con 0x7fd6f0086ff0 2023-10-06T02:23:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.986+0000 7fd6f5613700 1 --2- 172.21.15.6:0/343492179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6f00b21b0 0x7fd6f00b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.986+0000 7fd6ef7fe700 1 -- 172.21.15.6:0/343492179 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363981488 0 0) 0x7fd6f00b2b70 con 0x7fd6f015a030 2023-10-06T02:23:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.986+0000 7fd6effff700 1 --2- 172.21.15.6:0/343492179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f0086ff0 0x7fd6f0087470 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80099b0 tx=0x7fd6d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816a0704aa3fa517 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.986+0000 7fd6ef7fe700 1 -- 172.21.15.6:0/343492179 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d800b860 con 0x7fd6f0086ff0 2023-10-06T02:23:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.986+0000 7fd6ef7fe700 1 -- 172.21.15.6:0/343492179 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d800b9c0 con 0x7fd6f0086ff0 2023-10-06T02:23:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.986+0000 7fd6ef7fe700 1 -- 172.21.15.6:0/343492179 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d800bd60 con 0x7fd6f0086ff0 2023-10-06T02:23:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.987+0000 7fd6f7076700 1 -- 172.21.15.6:0/343492179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f0086ff0 msgr2=0x7fd6f0087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.987+0000 7fd6f7076700 1 --2- 172.21.15.6:0/343492179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f0086ff0 0x7fd6f0087470 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80099b0 tx=0x7fd6d8009250 comp rx=0 tx=0).stop 2023-10-06T02:23:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.987+0000 7fd6f7076700 1 -- 172.21.15.6:0/343492179 shutdown_connections 2023-10-06T02:23:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.987+0000 7fd6f7076700 1 --2- 172.21.15.6:0/343492179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6f00b21b0 0x7fd6f00b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.987+0000 7fd6f7076700 1 --2- 172.21.15.6:0/343492179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f0086ff0 0x7fd6f0087470 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.987+0000 7fd6f7076700 1 -- 172.21.15.6:0/343492179 >> 172.21.15.6:0/343492179 conn(0x7fd6f0068680 msgr2=0x7fd6f0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.987+0000 7fd6f7076700 1 -- 172.21.15.6:0/343492179 shutdown_connections 2023-10-06T02:23:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.987+0000 7fd6f7076700 1 -- 172.21.15.6:0/343492179 wait complete. 2023-10-06T02:23:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.988+0000 7fd6f7076700 1 Processor -- start 2023-10-06T02:23:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.988+0000 7fd6f7076700 1 -- start start 2023-10-06T02:23:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6f7076700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f0086ff0 0x7fd6f014b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6f7076700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6f00b21b0 0x7fd6f015ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6f7076700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6f015a030 0x7fd6f0169a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6f7076700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f015a400 con 0x7fd6f0086ff0 2023-10-06T02:23:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6f7076700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f015a9c0 con 0x7fd6f015a030 2023-10-06T02:23:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6f7076700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f016a490 con 0x7fd6f00b21b0 2023-10-06T02:23:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6f4e12700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f0086ff0 0x7fd6f014b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6f4e12700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f0086ff0 0x7fd6f014b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47994/0 (socket says 172.21.15.6:47994) 2023-10-06T02:23:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6f4e12700 1 -- 172.21.15.6:0/2209150374 learned_addr learned my addr 172.21.15.6:0/2209150374 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6effff700 1 --2- 172.21.15.6:0/2209150374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6f00b21b0 0x7fd6f015ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6f5613700 1 --2- 172.21.15.6:0/2209150374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6f015a030 0x7fd6f0169a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6f4e12700 1 -- 172.21.15.6:0/2209150374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6f00b21b0 msgr2=0x7fd6f015ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6f4e12700 1 --2- 172.21.15.6:0/2209150374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6f00b21b0 0x7fd6f015ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6f4e12700 1 -- 172.21.15.6:0/2209150374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6f015a030 msgr2=0x7fd6f0169a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6f4e12700 1 --2- 172.21.15.6:0/2209150374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6f015a030 0x7fd6f0169a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6f4e12700 1 -- 172.21.15.6:0/2209150374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d80094f0 con 0x7fd6f0086ff0 2023-10-06T02:23:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6effff700 1 --2- 172.21.15.6:0/2209150374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6f00b21b0 0x7fd6f015ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6f4e12700 1 --2- 172.21.15.6:0/2209150374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f0086ff0 0x7fd6f014b840 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000c5e0 tx=0x7fd6e0001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6ecff9700 1 -- 172.21.15.6:0/2209150374 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0005a70 con 0x7fd6f0086ff0 2023-10-06T02:23:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6ecff9700 1 -- 172.21.15.6:0/2209150374 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e0005bd0 con 0x7fd6f0086ff0 2023-10-06T02:23:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6ecff9700 1 -- 172.21.15.6:0/2209150374 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00070d0 con 0x7fd6f0086ff0 2023-10-06T02:23:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.989+0000 7fd6f7076700 1 -- 172.21.15.6:0/2209150374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f016a770 con 0x7fd6f0086ff0 2023-10-06T02:23:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.990+0000 7fd6f7076700 1 -- 172.21.15.6:0/2209150374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f014bd80 con 0x7fd6f0086ff0 2023-10-06T02:23:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.991+0000 7fd6f7076700 1 -- 172.21.15.6:0/2209150374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f015aca0 con 0x7fd6f0086ff0 2023-10-06T02:23:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.991+0000 7fd6ecff9700 1 -- 172.21.15.6:0/2209150374 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6e00074c0 con 0x7fd6f0086ff0 2023-10-06T02:23:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.991+0000 7fd6ecff9700 1 --2- 172.21.15.6:0/2209150374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6d0066f30 0x7fd6d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.991+0000 7fd6ecff9700 1 -- 172.21.15.6:0/2209150374 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fd6e0083aa0 con 0x7fd6f0086ff0 2023-10-06T02:23:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.991+0000 7fd6effff700 1 --2- 172.21.15.6:0/2209150374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6d0066f30 0x7fd6d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.992+0000 7fd6effff700 1 --2- 172.21.15.6:0/2209150374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6d0066f30 0x7fd6d00693e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80099b0 tx=0x7fd6d8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:32.995+0000 7fd6ecff9700 1 -- 172.21.15.6:0/2209150374 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6e0050cc0 con 0x7fd6f0086ff0 2023-10-06T02:23:33.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:33.207+0000 7fd6f7076700 1 -- 172.21.15.6:0/2209150374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd6f00aff30 con 0x7fd6f0086ff0 2023-10-06T02:23:33.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:33.976+0000 7fd6ecff9700 1 -- 172.21.15.6:0/2209150374 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v78) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd6e0017070 con 0x7fd6f0086ff0 2023-10-06T02:23:33.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:33.979+0000 7fd6f7076700 1 -- 172.21.15.6:0/2209150374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6d0066f30 msgr2=0x7fd6d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:33.979+0000 7fd6f7076700 1 --2- 172.21.15.6:0/2209150374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6d0066f30 0x7fd6d00693e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80099b0 tx=0x7fd6d8017000 comp rx=0 tx=0).stop 2023-10-06T02:23:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:33.979+0000 7fd6f7076700 1 -- 172.21.15.6:0/2209150374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f0086ff0 msgr2=0x7fd6f014b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:33.979+0000 7fd6f7076700 1 --2- 172.21.15.6:0/2209150374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f0086ff0 0x7fd6f014b840 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000c5e0 tx=0x7fd6e0001040 comp rx=0 tx=0).stop 2023-10-06T02:23:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:33.979+0000 7fd6f7076700 1 -- 172.21.15.6:0/2209150374 shutdown_connections 2023-10-06T02:23:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:33.979+0000 7fd6f7076700 1 --2- 172.21.15.6:0/2209150374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6f015a030 0x7fd6f0169a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:33.979+0000 7fd6f7076700 1 --2- 172.21.15.6:0/2209150374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd6d0066f30 0x7fd6d00693e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:33.979+0000 7fd6f7076700 1 --2- 172.21.15.6:0/2209150374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f0086ff0 0x7fd6f014b840 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:33.979+0000 7fd6f7076700 1 --2- 172.21.15.6:0/2209150374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6f00b21b0 0x7fd6f015ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:33.979+0000 7fd6f7076700 1 -- 172.21.15.6:0/2209150374 >> 172.21.15.6:0/2209150374 conn(0x7fd6f0068680 msgr2=0x7fd6f00b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:33.979+0000 7fd6f7076700 1 -- 172.21.15.6:0/2209150374 shutdown_connections 2023-10-06T02:23:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:33.979+0000 7fd6f7076700 1 -- 172.21.15.6:0/2209150374 wait complete. 2023-10-06T02:23:33.981 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-10-06T02:23:33.993 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:23:34.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.115+0000 7faecf34a700 1 Processor -- start 2023-10-06T02:23:34.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.115+0000 7faecf34a700 1 -- start start 2023-10-06T02:23:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.116+0000 7faecf34a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec80cd520 0x7faec81566a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.116+0000 7faecf34a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faec8156be0 0x7faec8158500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.116+0000 7faecf34a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec8158070 con 0x7faec8153ad0 2023-10-06T02:23:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.116+0000 7faecf34a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec8157780 con 0x7faec8156be0 2023-10-06T02:23:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.116+0000 7faecf34a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec8157a20 con 0x7faec80cd520 2023-10-06T02:23:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.116+0000 7faeceb49700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faec8156be0 0x7faec8158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.116+0000 7faeceb49700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faec8156be0 0x7faec8158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48000/0 (socket says 172.21.15.6:48000) 2023-10-06T02:23:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.116+0000 7faeceb49700 1 -- 172.21.15.6:0/2611477658 learned_addr learned my addr 172.21.15.6:0/2611477658 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.116+0000 7faecdb47700 1 --2- 172.21.15.6:0/2611477658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec80cd520 0x7faec81566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.116+0000 7faeceb49700 1 -- 172.21.15.6:0/2611477658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec80cd520 msgr2=0x7faec81566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.116+0000 7faeceb49700 1 --2- 172.21.15.6:0/2611477658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec80cd520 0x7faec81566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.116+0000 7faeceb49700 1 -- 172.21.15.6:0/2611477658 >> v1:172.21.15.175:6789/0 conn(0x7faec8153ad0 legacy=0x7faec80cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.116+0000 7faeceb49700 1 -- 172.21.15.6:0/2611477658 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec8157d00 con 0x7faec8156be0 2023-10-06T02:23:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.117+0000 7faeceb49700 1 --2- 172.21.15.6:0/2611477658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec8156be0 0x7faec8158500 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7faeb80099b0 tx=0x7faeb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275c8f7fbe306507 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.117+0000 7faecd346700 1 -- 172.21.15.6:0/2611477658 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb800b860 con 0x7faec8156be0 2023-10-06T02:23:34.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.117+0000 7faecd346700 1 -- 172.21.15.6:0/2611477658 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb800b9c0 con 0x7faec8156be0 2023-10-06T02:23:34.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.117+0000 7faecd346700 1 -- 172.21.15.6:0/2611477658 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb800bd60 con 0x7faec8156be0 2023-10-06T02:23:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.117+0000 7faecf34a700 1 -- 172.21.15.6:0/2611477658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec8156be0 msgr2=0x7faec8158500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.117+0000 7faecf34a700 1 --2- 172.21.15.6:0/2611477658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec8156be0 0x7faec8158500 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7faeb80099b0 tx=0x7faeb8009250 comp rx=0 tx=0).stop 2023-10-06T02:23:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.117+0000 7faecf34a700 1 -- 172.21.15.6:0/2611477658 shutdown_connections 2023-10-06T02:23:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.117+0000 7faecf34a700 1 --2- 172.21.15.6:0/2611477658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec8156be0 0x7faec8158500 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.117+0000 7faecf34a700 1 --2- 172.21.15.6:0/2611477658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec80cd520 0x7faec81566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.117+0000 7faecf34a700 1 -- 172.21.15.6:0/2611477658 >> 172.21.15.6:0/2611477658 conn(0x7faec806b320 msgr2=0x7faec806b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.117+0000 7faecf34a700 1 -- 172.21.15.6:0/2611477658 shutdown_connections 2023-10-06T02:23:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.117+0000 7faecf34a700 1 -- 172.21.15.6:0/2611477658 wait complete. 2023-10-06T02:23:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.118+0000 7faecf34a700 1 Processor -- start 2023-10-06T02:23:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.118+0000 7faecf34a700 1 -- start start 2023-10-06T02:23:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.119+0000 7faecf34a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec80cd520 0x7faec816a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.119+0000 7faecf34a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec8153ad0 0x7faec80ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.119+0000 7faecf34a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec8156be0 0x7faec80ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.119+0000 7faecf34a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec80c1c20 con 0x7faec80cd520 2023-10-06T02:23:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.119+0000 7faecf34a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec80c1f00 con 0x7faec8156be0 2023-10-06T02:23:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.119+0000 7faecf34a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec80c21e0 con 0x7faec8153ad0 2023-10-06T02:23:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.119+0000 7faece348700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec80cd520 0x7faec816a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.119+0000 7faece348700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec80cd520 0x7faec816a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48010/0 (socket says 172.21.15.6:48010) 2023-10-06T02:23:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.119+0000 7faece348700 1 -- 172.21.15.6:0/4008411913 learned_addr learned my addr 172.21.15.6:0/4008411913 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.119+0000 7faeceb49700 1 --2- 172.21.15.6:0/4008411913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec8156be0 0x7faec80ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.119+0000 7faecdb47700 1 --2- 172.21.15.6:0/4008411913 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec8153ad0 0x7faec80ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.120+0000 7faece348700 1 -- 172.21.15.6:0/4008411913 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec8153ad0 msgr2=0x7faec80ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.120+0000 7faece348700 1 --2- 172.21.15.6:0/4008411913 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec8153ad0 0x7faec80ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.120+0000 7faece348700 1 -- 172.21.15.6:0/4008411913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec8156be0 msgr2=0x7faec80ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.120+0000 7faece348700 1 --2- 172.21.15.6:0/4008411913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec8156be0 0x7faec80ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.120+0000 7faece348700 1 -- 172.21.15.6:0/4008411913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80094f0 con 0x7faec80cd520 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.120+0000 7faecdb47700 1 --2- 172.21.15.6:0/4008411913 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec8153ad0 0x7faec80ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.120+0000 7faece348700 1 --2- 172.21.15.6:0/4008411913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec80cd520 0x7faec816a790 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7faec000cb10 tx=0x7faec00017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.120+0000 7faec67fc700 1 -- 172.21.15.6:0/4008411913 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec00020c0 con 0x7faec80cd520 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.120+0000 7faec67fc700 1 -- 172.21.15.6:0/4008411913 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec000a7e0 con 0x7faec80cd520 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.120+0000 7faecf34a700 1 -- 172.21.15.6:0/4008411913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec80c24c0 con 0x7faec80cd520 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.120+0000 7faec67fc700 1 -- 172.21.15.6:0/4008411913 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec000ab80 con 0x7faec80cd520 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.120+0000 7faecf34a700 1 -- 172.21.15.6:0/4008411913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec816acd0 con 0x7faec80cd520 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.121+0000 7faecf34a700 1 -- 172.21.15.6:0/4008411913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec806e820 con 0x7faec80cd520 2023-10-06T02:23:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.122+0000 7faec67fc700 1 -- 172.21.15.6:0/4008411913 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faec0003030 con 0x7faec80cd520 2023-10-06T02:23:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.123+0000 7faec67fc700 1 --2- 172.21.15.6:0/4008411913 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faeb4066f30 0x7faeb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.123+0000 7faec67fc700 1 -- 172.21.15.6:0/4008411913 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5526+0+0 (secure 0 0 0) 0x7faec0084c60 con 0x7faec80cd520 2023-10-06T02:23:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.123+0000 7faecdb47700 1 --2- 172.21.15.6:0/4008411913 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faeb4066f30 0x7faeb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.123+0000 7faecdb47700 1 --2- 172.21.15.6:0/4008411913 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faeb4066f30 0x7faeb40693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7faec8139450 tx=0x7faebc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.126+0000 7faec67fc700 1 -- 172.21.15.6:0/4008411913 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faec0052000 con 0x7faec80cd520 2023-10-06T02:23:34.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.398+0000 7faecf34a700 1 -- 172.21.15.6:0/4008411913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7faec8068420 con 0x7faec80cd520 2023-10-06T02:23:34.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.399+0000 7faec67fc700 1 -- 172.21.15.6:0/4008411913 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7faec0055620 con 0x7faec80cd520 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9l3UdFFRAAahVHXJW+fzPcTwa/MxOW7A==", 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lcq7HIBAA/3Gaa7gNbUHq176zcCFgjA==", 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:23:34.402 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.402 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-10-06T02:23:34.402 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9ls7FDHBAA746JdAc0gr6+qLK9tuWCZg==", 2023-10-06T02:23:34.402 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.402 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:23:34.402 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:23:34.402 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:23:34.402 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:23:34.402 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.403 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-10-06T02:23:34.403 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9llEyZJxAAKXcHXIywnLQVZlbOGKdTTg==", 2023-10-06T02:23:34.403 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.403 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:23:34.403 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:23:34.403 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:23:34.403 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:23:34.403 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.403 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-10-06T02:23:34.403 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAXbh9lLVWHERAAoYIaMicUCppJKlSwl1K8UQ==", 2023-10-06T02:23:34.404 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.404 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:23:34.404 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:23:34.404 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:23:34.404 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.404 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-10-06T02:23:34.404 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAabh9lgpbHDxAAXOwtusarMKccKIu9+SmmHg==", 2023-10-06T02:23:34.407 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.407 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:23:34.407 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:23:34.407 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:23:34.407 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.407 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-10-06T02:23:34.407 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAdbh9lG/ZcFBAA3WpHCcm2R2+IyFMK460CYw==", 2023-10-06T02:23:34.407 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.407 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:23:34.408 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:23:34.408 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:23:34.408 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.408 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-10-06T02:23:34.408 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAgbh9lz8J4ExAAggyFHpD2wvM/b+WKLvVneA==", 2023-10-06T02:23:34.408 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.408 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:23:34.408 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:23:34.408 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:23:34.408 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.409 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-10-06T02:23:34.409 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAmbh9lpSX1ERAA1vkI0SvrJb6mAciDTIGZtA==", 2023-10-06T02:23:34.409 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.409 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:23:34.409 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:23:34.409 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:23:34.409 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.409 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-10-06T02:23:34.410 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQApbh9ljSxwDxAACjsHigTRkZIY+lHrr9/17g==", 2023-10-06T02:23:34.410 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.410 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:23:34.410 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:23:34.410 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:23:34.410 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.410 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-10-06T02:23:34.410 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAsbh9l6vlZDxAAfff29OvnP+8zxQFDDt8SFA==", 2023-10-06T02:23:34.410 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.410 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:23:34.411 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:23:34.411 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:23:34.411 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.411 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-10-06T02:23:34.411 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAvbh9lz+1sDBAANCvbv4nJUuaVde42koP8fA==", 2023-10-06T02:23:34.411 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.411 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:23:34.411 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:23:34.411 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:23:34.411 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.412 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-10-06T02:23:34.412 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lO6GJKxAASfNnkG3FXno1BWm5XiqIMA==", 2023-10-06T02:23:34.412 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.412 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:23:34.412 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-10-06T02:23:34.412 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:23:34.412 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.412 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-10-06T02:23:34.412 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lpRgFNBAAYE7yue5MPAzdm5k3EOcvcg==", 2023-10-06T02:23:34.413 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.413 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:23:34.413 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:23:34.413 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:23:34.413 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:23:34.413 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.413 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-10-06T02:23:34.413 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9l1hsHMRAANI0CeqE+ZB7uQ9ZB4cF/Ig==", 2023-10-06T02:23:34.413 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.413 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:23:34.413 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:23:34.414 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:23:34.414 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:23:34.414 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.414 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-10-06T02:23:34.414 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lAV9fORAAXCO4NdIb62PH2IX0y1siCw==", 2023-10-06T02:23:34.414 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.414 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:23:34.414 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:23:34.414 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:23:34.414 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:23:34.415 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.415 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-10-06T02:23:34.415 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQASbh9lIiB6NBAAvHP4z7yHub2TXCgRAAFy5A==", 2023-10-06T02:23:34.415 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.415 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:23:34.415 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:23:34.415 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:23:34.415 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:23:34.415 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.416 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-10-06T02:23:34.416 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lMk4mEhAAbIAiSwyo+ygZRqxKBKRxuQ==", 2023-10-06T02:23:34.416 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.416 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:23:34.416 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-06T02:23:34.416 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:23:34.416 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:34.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:34.416 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-10-06T02:23:34.416 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lxXZSDRAALw3s8FP+gOrz+VIDN7tkuw==", 2023-10-06T02:23:34.417 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:23:34.417 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:23:34.417 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-06T02:23:34.417 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:23:34.417 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.417 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:34.417 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-06T02:23:34.417 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:23:34.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.400+0000 7faecf34a700 1 -- 172.21.15.6:0/4008411913 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faeb4066f30 msgr2=0x7faeb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.400+0000 7faecf34a700 1 --2- 172.21.15.6:0/4008411913 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faeb4066f30 0x7faeb40693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7faec8139450 tx=0x7faebc008040 comp rx=0 tx=0).stop 2023-10-06T02:23:34.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.400+0000 7faecf34a700 1 -- 172.21.15.6:0/4008411913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec80cd520 msgr2=0x7faec816a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.400+0000 7faecf34a700 1 --2- 172.21.15.6:0/4008411913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec80cd520 0x7faec816a790 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7faec000cb10 tx=0x7faec00017b0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.401+0000 7faecf34a700 1 -- 172.21.15.6:0/4008411913 shutdown_connections 2023-10-06T02:23:34.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.401+0000 7faecf34a700 1 --2- 172.21.15.6:0/4008411913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec8156be0 0x7faec80ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.401+0000 7faecf34a700 1 --2- 172.21.15.6:0/4008411913 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faeb4066f30 0x7faeb40693e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.401+0000 7faecf34a700 1 --2- 172.21.15.6:0/4008411913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec80cd520 0x7faec816a790 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.401+0000 7faecf34a700 1 --2- 172.21.15.6:0/4008411913 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec8153ad0 0x7faec80ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.401+0000 7faecf34a700 1 -- 172.21.15.6:0/4008411913 >> 172.21.15.6:0/4008411913 conn(0x7faec806b320 msgr2=0x7faec81557c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:34.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.401+0000 7faecf34a700 1 -- 172.21.15.6:0/4008411913 shutdown_connections 2023-10-06T02:23:34.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.401+0000 7faecf34a700 1 -- 172.21.15.6:0/4008411913 wait complete. 2023-10-06T02:23:34.420 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:34.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.538+0000 7f217ca75700 1 Processor -- start 2023-10-06T02:23:34.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.538+0000 7f217ca75700 1 -- start start 2023-10-06T02:23:34.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.539+0000 7f217ca75700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2178159400 0x7f21780ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.539+0000 7f217ca75700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f21780cd030 0x7f21780cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.539+0000 7f217ca75700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21780b3560 con 0x7f21780cf1a0 2023-10-06T02:23:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.539+0000 7f217ca75700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21780cf6f0 con 0x7f21780cd030 2023-10-06T02:23:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.539+0000 7f217ca75700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21780cf9d0 con 0x7f2178159400 2023-10-06T02:23:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.539+0000 7f21777fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2178159400 0x7f21780ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.539+0000 7f2176ffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f21780cd030 0x7f21780cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.539+0000 7f21777fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2178159400 0x7f21780ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:42168/0 (socket says 172.21.15.6:42168) 2023-10-06T02:23:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.539+0000 7f21777fe700 1 -- 172.21.15.6:0/1223869120 learned_addr learned my addr 172.21.15.6:0/1223869120 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.540+0000 7f21777fe700 1 -- 172.21.15.6:0/1223869120 >> v2:172.21.15.175:3300/0 conn(0x7f21780cd030 msgr2=0x7f21780cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.540+0000 7f21777fe700 1 --2- 172.21.15.6:0/1223869120 >> v2:172.21.15.175:3300/0 conn(0x7f21780cd030 0x7f21780cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.540+0000 7f21777fe700 1 -- 172.21.15.6:0/1223869120 >> v1:172.21.15.175:6789/0 conn(0x7f21780cf1a0 legacy=0x7f21780b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.540+0000 7f21777fe700 1 -- 172.21.15.6:0/1223869120 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21780b2f10 con 0x7f2178159400 2023-10-06T02:23:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.540+0000 7f2176ffd700 1 --2- 172.21.15.6:0/1223869120 >> v2:172.21.15.175:3300/0 conn(0x7f21780cd030 0x7f21780cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.540+0000 7f21777fe700 1 --2- 172.21.15.6:0/1223869120 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2178159400 0x7f21780ccaf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2168009990 tx=0x7f2168009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85ce0e7f1efd8281 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.540+0000 7f21767fc700 1 -- 172.21.15.6:0/1223869120 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2168009e80 con 0x7f2178159400 2023-10-06T02:23:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.540+0000 7f21767fc700 1 -- 172.21.15.6:0/1223869120 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2168005c10 con 0x7f2178159400 2023-10-06T02:23:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.540+0000 7f21767fc700 1 -- 172.21.15.6:0/1223869120 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216800b650 con 0x7f2178159400 2023-10-06T02:23:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.541+0000 7f217ca75700 1 -- 172.21.15.6:0/1223869120 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2178159400 msgr2=0x7f21780ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.541+0000 7f217ca75700 1 --2- 172.21.15.6:0/1223869120 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2178159400 0x7f21780ccaf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2168009990 tx=0x7f2168009220 comp rx=0 tx=0).stop 2023-10-06T02:23:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.541+0000 7f217ca75700 1 -- 172.21.15.6:0/1223869120 shutdown_connections 2023-10-06T02:23:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.541+0000 7f217ca75700 1 --2- 172.21.15.6:0/1223869120 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2178159400 0x7f21780ccaf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.541+0000 7f217ca75700 1 --2- 172.21.15.6:0/1223869120 >> v2:172.21.15.175:3300/0 conn(0x7f21780cd030 0x7f21780cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.541+0000 7f217ca75700 1 -- 172.21.15.6:0/1223869120 >> 172.21.15.6:0/1223869120 conn(0x7f217806ac10 msgr2=0x7f2178068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.541+0000 7f217ca75700 1 -- 172.21.15.6:0/1223869120 shutdown_connections 2023-10-06T02:23:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.541+0000 7f217ca75700 1 -- 172.21.15.6:0/1223869120 wait complete. 2023-10-06T02:23:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.542+0000 7f217ca75700 1 Processor -- start 2023-10-06T02:23:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.542+0000 7f217ca75700 1 -- start start 2023-10-06T02:23:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.543+0000 7f217ca75700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21780cd030 0x7f2178145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.543+0000 7f217ca75700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21780cf1a0 0x7f217815a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.543+0000 7f217ca75700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2178159400 0x7f21780b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.543+0000 7f217ca75700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21781539c0 con 0x7f21780cf1a0 2023-10-06T02:23:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.543+0000 7f217ca75700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2178153f80 con 0x7f2178159400 2023-10-06T02:23:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.543+0000 7f217ca75700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217815af40 con 0x7f21780cd030 2023-10-06T02:23:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.543+0000 7f2176ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21780cf1a0 0x7f217815a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.543+0000 7f2176ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21780cf1a0 0x7f217815a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48016/0 (socket says 172.21.15.6:48016) 2023-10-06T02:23:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.543+0000 7f2176ffd700 1 -- 172.21.15.6:0/1020775898 learned_addr learned my addr 172.21.15.6:0/1020775898 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.543+0000 7f21777fe700 1 --2- 172.21.15.6:0/1020775898 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21780cd030 0x7f2178145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.543+0000 7f2177fff700 1 --2- 172.21.15.6:0/1020775898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2178159400 0x7f21780b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.543+0000 7f2176ffd700 1 -- 172.21.15.6:0/1020775898 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21780cd030 msgr2=0x7f2178145b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.543+0000 7f2176ffd700 1 --2- 172.21.15.6:0/1020775898 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21780cd030 0x7f2178145b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.543+0000 7f2176ffd700 1 -- 172.21.15.6:0/1020775898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2178159400 msgr2=0x7f21780b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.543+0000 7f2176ffd700 1 --2- 172.21.15.6:0/1020775898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2178159400 0x7f21780b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.543+0000 7f2176ffd700 1 -- 172.21.15.6:0/1020775898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c009420 con 0x7f21780cf1a0 2023-10-06T02:23:34.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.543+0000 7f2176ffd700 1 --2- 172.21.15.6:0/1020775898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21780cf1a0 0x7f217815a450 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f216c00ec80 tx=0x7f216c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:34.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.544+0000 7f215f7fe700 1 -- 172.21.15.6:0/1020775898 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c00c850 con 0x7f21780cf1a0 2023-10-06T02:23:34.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.544+0000 7f215f7fe700 1 -- 172.21.15.6:0/1020775898 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c00c9b0 con 0x7f21780cf1a0 2023-10-06T02:23:34.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.544+0000 7f217ca75700 1 -- 172.21.15.6:0/1020775898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2168009480 con 0x7f21780cf1a0 2023-10-06T02:23:34.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.544+0000 7f215f7fe700 1 -- 172.21.15.6:0/1020775898 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c00cd30 con 0x7f21780cf1a0 2023-10-06T02:23:34.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.544+0000 7f217ca75700 1 -- 172.21.15.6:0/1020775898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2178153c10 con 0x7f21780cf1a0 2023-10-06T02:23:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.545+0000 7f217ca75700 1 -- 172.21.15.6:0/1020775898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21781540f0 con 0x7f21780cf1a0 2023-10-06T02:23:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.545+0000 7f215f7fe700 1 -- 172.21.15.6:0/1020775898 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f216c013680 con 0x7f21780cf1a0 2023-10-06T02:23:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.545+0000 7f215f7fe700 1 --2- 172.21.15.6:0/1020775898 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2164066f30 0x7f21640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.546+0000 7f215f7fe700 1 -- 172.21.15.6:0/1020775898 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f216c084730 con 0x7f21780cf1a0 2023-10-06T02:23:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.546+0000 7f21777fe700 1 --2- 172.21.15.6:0/1020775898 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2164066f30 0x7f21640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.546+0000 7f21777fe700 1 --2- 172.21.15.6:0/1020775898 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2164066f30 0x7f21640693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f21780b5850 tx=0x7f2168016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.550+0000 7f215f7fe700 1 -- 172.21.15.6:0/1020775898 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f216c0554e0 con 0x7f21780cf1a0 2023-10-06T02:23:34.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.744+0000 7f217ca75700 1 -- 172.21.15.6:0/1020775898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2178159860 con 0x7f21780cf1a0 2023-10-06T02:23:34.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.745+0000 7f215f7fe700 1 -- 172.21.15.6:0/1020775898 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+13808 (secure 0 0 0) 0x7f216c055070 con 0x7f21780cf1a0 2023-10-06T02:23:34.745 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:34.746 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":78,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:23:33.974060+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.747+0000 7f217ca75700 1 -- 172.21.15.6:0/1020775898 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2164066f30 msgr2=0x7f21640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.747+0000 7f217ca75700 1 --2- 172.21.15.6:0/1020775898 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2164066f30 0x7f21640693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f21780b5850 tx=0x7f2168016000 comp rx=0 tx=0).stop 2023-10-06T02:23:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.747+0000 7f217ca75700 1 -- 172.21.15.6:0/1020775898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21780cf1a0 msgr2=0x7f217815a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.747+0000 7f217ca75700 1 --2- 172.21.15.6:0/1020775898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21780cf1a0 0x7f217815a450 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f216c00ec80 tx=0x7f216c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.747+0000 7f217ca75700 1 -- 172.21.15.6:0/1020775898 shutdown_connections 2023-10-06T02:23:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.747+0000 7f217ca75700 1 --2- 172.21.15.6:0/1020775898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2178159400 0x7f21780b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.747+0000 7f217ca75700 1 --2- 172.21.15.6:0/1020775898 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21780cd030 0x7f2178145b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.747+0000 7f217ca75700 1 --2- 172.21.15.6:0/1020775898 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2164066f30 0x7f21640693e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.747+0000 7f217ca75700 1 --2- 172.21.15.6:0/1020775898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21780cf1a0 0x7f217815a450 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.747+0000 7f217ca75700 1 -- 172.21.15.6:0/1020775898 >> 172.21.15.6:0/1020775898 conn(0x7f217806ac10 msgr2=0x7f2178156830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:34.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.747+0000 7f217ca75700 1 -- 172.21.15.6:0/1020775898 shutdown_connections 2023-10-06T02:23:34.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.747+0000 7f217ca75700 1 -- 172.21.15.6:0/1020775898 wait complete. 2023-10-06T02:23:34.760 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T02:23:34.760 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:23:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.881+0000 7fc427b95700 1 Processor -- start 2023-10-06T02:23:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.882+0000 7fc427b95700 1 -- start start 2023-10-06T02:23:34.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.882+0000 7fc427b95700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc4200d0400 0x7fc4200b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.882+0000 7fc427b95700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4200d07d0 0x7fc4200b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.882+0000 7fc427b95700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4200b6170 con 0x7fc4200ccd40 2023-10-06T02:23:34.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.882+0000 7fc427b95700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc42015dd40 con 0x7fc4200d0400 2023-10-06T02:23:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.882+0000 7fc427b95700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42015e020 con 0x7fc4200d07d0 2023-10-06T02:23:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.883+0000 7fc425931700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc4200d0400 0x7fc4200b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.883+0000 7fc425130700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc4200ccd40 0x7fc4200cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53122/0 (socket says 172.21.15.6:53122) 2023-10-06T02:23:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.883+0000 7fc425931700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc4200d0400 0x7fc4200b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48022/0 (socket says 172.21.15.6:48022) 2023-10-06T02:23:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.883+0000 7fc425931700 1 -- 172.21.15.6:0/1096444299 learned_addr learned my addr 172.21.15.6:0/1096444299 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.883+0000 7fc426132700 1 --2- 172.21.15.6:0/1096444299 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4200d07d0 0x7fc4200b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.883+0000 7fc425931700 1 -- 172.21.15.6:0/1096444299 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4200d07d0 msgr2=0x7fc4200b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.883+0000 7fc425931700 1 --2- 172.21.15.6:0/1096444299 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4200d07d0 0x7fc4200b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.883+0000 7fc425931700 1 -- 172.21.15.6:0/1096444299 >> v1:172.21.15.6:6789/0 conn(0x7fc4200ccd40 legacy=0x7fc4200cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.883+0000 7fc425931700 1 -- 172.21.15.6:0/1096444299 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4200ceaa0 con 0x7fc4200d0400 2023-10-06T02:23:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.883+0000 7fc42492f700 1 -- 172.21.15.6:0/1096444299 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910618698 0 0) 0x7fc4200b6170 con 0x7fc4200ccd40 2023-10-06T02:23:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.883+0000 7fc425931700 1 --2- 172.21.15.6:0/1096444299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4200d0400 0x7fc4200b5c30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fc410009f70 tx=0x7fc410009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6922720a84520a9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.883+0000 7fc42492f700 1 -- 172.21.15.6:0/1096444299 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41000e070 con 0x7fc4200d0400 2023-10-06T02:23:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.883+0000 7fc42492f700 1 -- 172.21.15.6:0/1096444299 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41000ba20 con 0x7fc4200d0400 2023-10-06T02:23:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.883+0000 7fc42492f700 1 -- 172.21.15.6:0/1096444299 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4100092e0 con 0x7fc4200d0400 2023-10-06T02:23:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.884+0000 7fc427b95700 1 -- 172.21.15.6:0/1096444299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4200d0400 msgr2=0x7fc4200b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.884+0000 7fc427b95700 1 --2- 172.21.15.6:0/1096444299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4200d0400 0x7fc4200b5c30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fc410009f70 tx=0x7fc410009840 comp rx=0 tx=0).stop 2023-10-06T02:23:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.884+0000 7fc427b95700 1 -- 172.21.15.6:0/1096444299 shutdown_connections 2023-10-06T02:23:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.884+0000 7fc427b95700 1 --2- 172.21.15.6:0/1096444299 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4200d07d0 0x7fc4200b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.884+0000 7fc427b95700 1 --2- 172.21.15.6:0/1096444299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4200d0400 0x7fc4200b5c30 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.884+0000 7fc427b95700 1 -- 172.21.15.6:0/1096444299 >> 172.21.15.6:0/1096444299 conn(0x7fc42006a220 msgr2=0x7fc42006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.884+0000 7fc427b95700 1 -- 172.21.15.6:0/1096444299 shutdown_connections 2023-10-06T02:23:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.884+0000 7fc427b95700 1 -- 172.21.15.6:0/1096444299 wait complete. 2023-10-06T02:23:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.885+0000 7fc427b95700 1 Processor -- start 2023-10-06T02:23:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.885+0000 7fc427b95700 1 -- start start 2023-10-06T02:23:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc427b95700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4200ccd40 0x7fc420152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc427b95700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4200d0400 0x7fc42014ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc427b95700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4200d07d0 0x7fc42016a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc427b95700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4201511c0 con 0x7fc4200d0400 2023-10-06T02:23:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc427b95700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4201505b0 con 0x7fc4200d07d0 2023-10-06T02:23:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc427b95700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc420150890 con 0x7fc4200ccd40 2023-10-06T02:23:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc425130700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4200d0400 0x7fc42014ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc425130700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4200d0400 0x7fc42014ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48032/0 (socket says 172.21.15.6:48032) 2023-10-06T02:23:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc425130700 1 -- 172.21.15.6:0/2130160254 learned_addr learned my addr 172.21.15.6:0/2130160254 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc425931700 1 --2- 172.21.15.6:0/2130160254 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4200ccd40 0x7fc420152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc426132700 1 --2- 172.21.15.6:0/2130160254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4200d07d0 0x7fc42016a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc425130700 1 -- 172.21.15.6:0/2130160254 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4200ccd40 msgr2=0x7fc420152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc425130700 1 --2- 172.21.15.6:0/2130160254 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4200ccd40 0x7fc420152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc425130700 1 -- 172.21.15.6:0/2130160254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4200d07d0 msgr2=0x7fc42016a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc425130700 1 --2- 172.21.15.6:0/2130160254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4200d07d0 0x7fc42016a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc425130700 1 -- 172.21.15.6:0/2130160254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc410009ae0 con 0x7fc4200d0400 2023-10-06T02:23:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc425130700 1 --2- 172.21.15.6:0/2130160254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4200d0400 0x7fc42014ec80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fc4140011e0 tx=0x7fc414007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc41dffb700 1 -- 172.21.15.6:0/2130160254 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414005a70 con 0x7fc4200d0400 2023-10-06T02:23:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc41dffb700 1 -- 172.21.15.6:0/2130160254 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc414005bd0 con 0x7fc4200d0400 2023-10-06T02:23:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc427b95700 1 -- 172.21.15.6:0/2130160254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc420150b70 con 0x7fc4200d0400 2023-10-06T02:23:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.886+0000 7fc41dffb700 1 -- 172.21.15.6:0/2130160254 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4140070d0 con 0x7fc4200d0400 2023-10-06T02:23:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.887+0000 7fc427b95700 1 -- 172.21.15.6:0/2130160254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc420153150 con 0x7fc4200d0400 2023-10-06T02:23:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.887+0000 7fc427b95700 1 -- 172.21.15.6:0/2130160254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4200d14a0 con 0x7fc4200d0400 2023-10-06T02:23:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.888+0000 7fc41dffb700 1 -- 172.21.15.6:0/2130160254 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc414007480 con 0x7fc4200d0400 2023-10-06T02:23:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.888+0000 7fc41dffb700 1 --2- 172.21.15.6:0/2130160254 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc40c066f30 0x7fc40c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.888+0000 7fc41dffb700 1 -- 172.21.15.6:0/2130160254 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc4140839d0 con 0x7fc4200d0400 2023-10-06T02:23:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.889+0000 7fc425931700 1 --2- 172.21.15.6:0/2130160254 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc40c066f30 0x7fc40c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.889+0000 7fc425931700 1 --2- 172.21.15.6:0/2130160254 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc40c066f30 0x7fc40c0693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc410009880 tx=0x7fc410018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:34.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:34.893+0000 7fc41dffb700 1 -- 172.21.15.6:0/2130160254 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc414050c50 con 0x7fc4200d0400 2023-10-06T02:23:35.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.087+0000 7fc427b95700 1 -- 172.21.15.6:0/2130160254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc420151300 con 0x7fc4200d0400 2023-10-06T02:23:35.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.087+0000 7fc41dffb700 1 -- 172.21.15.6:0/2130160254 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v78) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc414017070 con 0x7fc4200d0400 2023-10-06T02:23:35.088 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:23:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.089+0000 7fc427b95700 1 -- 172.21.15.6:0/2130160254 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc40c066f30 msgr2=0x7fc40c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.089+0000 7fc427b95700 1 --2- 172.21.15.6:0/2130160254 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc40c066f30 0x7fc40c0693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc410009880 tx=0x7fc410018000 comp rx=0 tx=0).stop 2023-10-06T02:23:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.089+0000 7fc427b95700 1 -- 172.21.15.6:0/2130160254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4200d0400 msgr2=0x7fc42014ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.089+0000 7fc427b95700 1 --2- 172.21.15.6:0/2130160254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4200d0400 0x7fc42014ec80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fc4140011e0 tx=0x7fc414007e10 comp rx=0 tx=0).stop 2023-10-06T02:23:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.089+0000 7fc427b95700 1 -- 172.21.15.6:0/2130160254 shutdown_connections 2023-10-06T02:23:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.089+0000 7fc427b95700 1 --2- 172.21.15.6:0/2130160254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4200d07d0 0x7fc42016a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.089+0000 7fc427b95700 1 --2- 172.21.15.6:0/2130160254 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4200ccd40 0x7fc420152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.089+0000 7fc427b95700 1 --2- 172.21.15.6:0/2130160254 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc40c066f30 0x7fc40c0693e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.089+0000 7fc427b95700 1 --2- 172.21.15.6:0/2130160254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4200d0400 0x7fc42014ec80 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.089+0000 7fc427b95700 1 -- 172.21.15.6:0/2130160254 >> 172.21.15.6:0/2130160254 conn(0x7fc42006a220 msgr2=0x7fc4200b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:35.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.089+0000 7fc427b95700 1 -- 172.21.15.6:0/2130160254 shutdown_connections 2023-10-06T02:23:35.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.089+0000 7fc427b95700 1 -- 172.21.15.6:0/2130160254 wait complete. 2023-10-06T02:23:35.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:23:35.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.223+0000 7f85c41e1700 1 Processor -- start 2023-10-06T02:23:35.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.224+0000 7f85c41e1700 1 -- start start 2023-10-06T02:23:35.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.224+0000 7f85c41e1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85bc0d0400 0x7f85bc0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:35.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.224+0000 7f85c41e1700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f85bc0d07d0 0x7f85bc0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:35.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.224+0000 7f85c41e1700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85bc0b6170 con 0x7f85bc0ccd40 2023-10-06T02:23:35.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.224+0000 7f85c41e1700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85bc15dd40 con 0x7f85bc0d07d0 2023-10-06T02:23:35.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.224+0000 7f85c41e1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc15e020 con 0x7f85bc0d0400 2023-10-06T02:23:35.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.225+0000 7f85c1f7d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85bc0d0400 0x7f85bc0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:35.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.225+0000 7f85c277e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f85bc0d07d0 0x7f85bc0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:35.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.225+0000 7f85c277e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f85bc0d07d0 0x7f85bc0b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:42988/0 (socket says 172.21.15.6:42988) 2023-10-06T02:23:35.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.225+0000 7f85c1f7d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85bc0d0400 0x7f85bc0b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:42194/0 (socket says 172.21.15.6:42194) 2023-10-06T02:23:35.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.225+0000 7f85c177c700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f85bc0ccd40 0x7f85bc0cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:36638/0 (socket says 172.21.15.6:36638) 2023-10-06T02:23:35.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.225+0000 7f85c277e700 1 -- 172.21.15.6:0/3843205379 learned_addr learned my addr 172.21.15.6:0/3843205379 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:35.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.225+0000 7f85c1f7d700 1 -- 172.21.15.6:0/3843205379 >> v2:172.21.15.175:3300/0 conn(0x7f85bc0d07d0 msgr2=0x7f85bc0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:35.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.225+0000 7f85c1f7d700 1 --2- 172.21.15.6:0/3843205379 >> v2:172.21.15.175:3300/0 conn(0x7f85bc0d07d0 0x7f85bc0b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.225+0000 7f85c1f7d700 1 -- 172.21.15.6:0/3843205379 >> v1:172.21.15.175:6789/0 conn(0x7f85bc0ccd40 legacy=0x7f85bc0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.225+0000 7f85c1f7d700 1 -- 172.21.15.6:0/3843205379 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc0ceaa0 con 0x7f85bc0d0400 2023-10-06T02:23:35.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.225+0000 7f85c277e700 1 --2- 172.21.15.6:0/3843205379 >> v2:172.21.15.175:3300/0 conn(0x7f85bc0d07d0 0x7f85bc0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:35.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.225+0000 7f85c1f7d700 1 --2- 172.21.15.6:0/3843205379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85bc0d0400 0x7f85bc0b5c30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009eb0 tx=0x7f85b4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9125251676b99c6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:35.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.226+0000 7f85c0f7b700 1 -- 172.21.15.6:0/3843205379 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b400e070 con 0x7f85bc0d0400 2023-10-06T02:23:35.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.226+0000 7f85c0f7b700 1 -- 172.21.15.6:0/3843205379 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b400bc30 con 0x7f85bc0d0400 2023-10-06T02:23:35.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.226+0000 7f85c0f7b700 1 -- 172.21.15.6:0/3843205379 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4012430 con 0x7f85bc0d0400 2023-10-06T02:23:35.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.226+0000 7f85c41e1700 1 -- 172.21.15.6:0/3843205379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85bc0d0400 msgr2=0x7f85bc0b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.226+0000 7f85c41e1700 1 --2- 172.21.15.6:0/3843205379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85bc0d0400 0x7f85bc0b5c30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009eb0 tx=0x7f85b4009780 comp rx=0 tx=0).stop 2023-10-06T02:23:35.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.226+0000 7f85c41e1700 1 -- 172.21.15.6:0/3843205379 shutdown_connections 2023-10-06T02:23:35.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.226+0000 7f85c41e1700 1 --2- 172.21.15.6:0/3843205379 >> v2:172.21.15.175:3300/0 conn(0x7f85bc0d07d0 0x7f85bc0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.226+0000 7f85c41e1700 1 --2- 172.21.15.6:0/3843205379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85bc0d0400 0x7f85bc0b5c30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.226+0000 7f85c41e1700 1 -- 172.21.15.6:0/3843205379 >> 172.21.15.6:0/3843205379 conn(0x7f85bc06a220 msgr2=0x7f85bc06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.226+0000 7f85c41e1700 1 -- 172.21.15.6:0/3843205379 shutdown_connections 2023-10-06T02:23:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.226+0000 7f85c41e1700 1 -- 172.21.15.6:0/3843205379 wait complete. 2023-10-06T02:23:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.227+0000 7f85c41e1700 1 Processor -- start 2023-10-06T02:23:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.227+0000 7f85c41e1700 1 -- start start 2023-10-06T02:23:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.228+0000 7f85c41e1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85bc0ccd40 0x7f85bc16a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.228+0000 7f85c41e1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85bc0d0400 0x7f85bc0c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.228+0000 7f85c41e1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85bc0d07d0 0x7f85bc0c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.228+0000 7f85c41e1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc16ad60 con 0x7f85bc0ccd40 2023-10-06T02:23:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.228+0000 7f85c41e1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc0c65b0 con 0x7f85bc0d0400 2023-10-06T02:23:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.228+0000 7f85c41e1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc0c6890 con 0x7f85bc0d07d0 2023-10-06T02:23:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.228+0000 7f85c1f7d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85bc0ccd40 0x7f85bc16a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.228+0000 7f85c1f7d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85bc0ccd40 0x7f85bc16a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48038/0 (socket says 172.21.15.6:48038) 2023-10-06T02:23:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.228+0000 7f85c1f7d700 1 -- 172.21.15.6:0/1258232646 learned_addr learned my addr 172.21.15.6:0/1258232646 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.228+0000 7f85c177c700 1 --2- 172.21.15.6:0/1258232646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85bc0d0400 0x7f85bc0c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.228+0000 7f85c277e700 1 --2- 172.21.15.6:0/1258232646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85bc0d07d0 0x7f85bc0c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.228+0000 7f85c1f7d700 1 -- 172.21.15.6:0/1258232646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85bc0d07d0 msgr2=0x7f85bc0c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.228+0000 7f85c1f7d700 1 --2- 172.21.15.6:0/1258232646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85bc0d07d0 0x7f85bc0c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.228+0000 7f85c1f7d700 1 -- 172.21.15.6:0/1258232646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85bc0d0400 msgr2=0x7f85bc0c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.228+0000 7f85c1f7d700 1 --2- 172.21.15.6:0/1258232646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85bc0d0400 0x7f85bc0c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.228+0000 7f85c1f7d700 1 -- 172.21.15.6:0/1258232646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac0094f0 con 0x7f85bc0ccd40 2023-10-06T02:23:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.228+0000 7f85c277e700 1 --2- 172.21.15.6:0/1258232646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85bc0d07d0 0x7f85bc0c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.229+0000 7f85c1f7d700 1 --2- 172.21.15.6:0/1258232646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85bc0ccd40 0x7f85bc16a820 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f85b4012580 tx=0x7f85b4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.229+0000 7f85b9ffb700 1 -- 172.21.15.6:0/1258232646 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4012db0 con 0x7f85bc0ccd40 2023-10-06T02:23:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.229+0000 7f85b9ffb700 1 -- 172.21.15.6:0/1258232646 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b4027470 con 0x7f85bc0ccd40 2023-10-06T02:23:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.229+0000 7f85b9ffb700 1 -- 172.21.15.6:0/1258232646 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4027830 con 0x7f85bc0ccd40 2023-10-06T02:23:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.229+0000 7f85c41e1700 1 -- 172.21.15.6:0/1258232646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b4009a20 con 0x7f85bc0ccd40 2023-10-06T02:23:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.229+0000 7f85c41e1700 1 -- 172.21.15.6:0/1258232646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85bc0c6e50 con 0x7f85bc0ccd40 2023-10-06T02:23:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.230+0000 7f85c41e1700 1 -- 172.21.15.6:0/1258232646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85bc088760 con 0x7f85bc0ccd40 2023-10-06T02:23:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.230+0000 7f85b9ffb700 1 -- 172.21.15.6:0/1258232646 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85b4024070 con 0x7f85bc0ccd40 2023-10-06T02:23:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.231+0000 7f85b9ffb700 1 --2- 172.21.15.6:0/1258232646 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f85a8066f30 0x7f85a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.231+0000 7f85b9ffb700 1 -- 172.21.15.6:0/1258232646 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f85b4086e20 con 0x7f85bc0ccd40 2023-10-06T02:23:35.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.231+0000 7f85c177c700 1 --2- 172.21.15.6:0/1258232646 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f85a8066f30 0x7f85a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:35.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.231+0000 7f85c177c700 1 --2- 172.21.15.6:0/1258232646 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f85a8066f30 0x7f85a80693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f85b0007fd0 tx=0x7f85b0007d70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:35.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.235+0000 7f85b9ffb700 1 -- 172.21.15.6:0/1258232646 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85b4054140 con 0x7f85bc0ccd40 2023-10-06T02:23:35.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.426+0000 7f85c41e1700 1 -- 172.21.15.6:0/1258232646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85bc0ced80 con 0x7f85bc0ccd40 2023-10-06T02:23:35.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.427+0000 7f85b9ffb700 1 -- 172.21.15.6:0/1258232646 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85b4057760 con 0x7f85bc0ccd40 2023-10-06T02:23:35.427 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:23:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.429+0000 7f85c41e1700 1 -- 172.21.15.6:0/1258232646 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f85a8066f30 msgr2=0x7f85a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.429+0000 7f85c41e1700 1 --2- 172.21.15.6:0/1258232646 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f85a8066f30 0x7f85a80693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f85b0007fd0 tx=0x7f85b0007d70 comp rx=0 tx=0).stop 2023-10-06T02:23:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.429+0000 7f85c41e1700 1 -- 172.21.15.6:0/1258232646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85bc0ccd40 msgr2=0x7f85bc16a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.429+0000 7f85c41e1700 1 --2- 172.21.15.6:0/1258232646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85bc0ccd40 0x7f85bc16a820 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f85b4012580 tx=0x7f85b4019000 comp rx=0 tx=0).stop 2023-10-06T02:23:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.429+0000 7f85c41e1700 1 -- 172.21.15.6:0/1258232646 shutdown_connections 2023-10-06T02:23:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.429+0000 7f85c41e1700 1 --2- 172.21.15.6:0/1258232646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85bc0d07d0 0x7f85bc0c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.429+0000 7f85c41e1700 1 --2- 172.21.15.6:0/1258232646 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f85a8066f30 0x7f85a80693e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.429+0000 7f85c41e1700 1 --2- 172.21.15.6:0/1258232646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85bc0ccd40 0x7f85bc16a820 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.429+0000 7f85c41e1700 1 --2- 172.21.15.6:0/1258232646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85bc0d0400 0x7f85bc0c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.429+0000 7f85c41e1700 1 -- 172.21.15.6:0/1258232646 >> 172.21.15.6:0/1258232646 conn(0x7f85bc06a220 msgr2=0x7f85bc0b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.429+0000 7f85c41e1700 1 -- 172.21.15.6:0/1258232646 shutdown_connections 2023-10-06T02:23:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.429+0000 7f85c41e1700 1 -- 172.21.15.6:0/1258232646 wait complete. 2023-10-06T02:23:35.442 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:23:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.561+0000 7f5643fdc700 1 Processor -- start 2023-10-06T02:23:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.561+0000 7f5643fdc700 1 -- start start 2023-10-06T02:23:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.562+0000 7f5643fdc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f563c159380 0x7f563c159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.562+0000 7f5643fdc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563c0ccb60 con 0x7f563c0b20e0 2023-10-06T02:23:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.562+0000 7f5643fdc700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563c0cb6c0 con 0x7f563c15d4d0 2023-10-06T02:23:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.562+0000 7f5643fdc700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563c15e200 con 0x7f563c159380 2023-10-06T02:23:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.562+0000 7f5641d78700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f563c159380 0x7f563c159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.562+0000 7f5641577700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f563c0b20e0 0x7f563c0b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53132/0 (socket says 172.21.15.6:53132) 2023-10-06T02:23:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.562+0000 7f5641577700 1 -- 172.21.15.6:0/1118203830 learned_addr learned my addr 172.21.15.6:0/1118203830 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.562+0000 7f5641d78700 1 -- 172.21.15.6:0/1118203830 >> v1:172.21.15.175:6789/0 conn(0x7f563c15d4d0 legacy=0x7f563c15d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.562+0000 7f5641d78700 1 -- 172.21.15.6:0/1118203830 >> v1:172.21.15.6:6789/0 conn(0x7f563c0b20e0 legacy=0x7f563c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.562+0000 7f5641d78700 1 -- 172.21.15.6:0/1118203830 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c0c3ef0 con 0x7f563c159380 2023-10-06T02:23:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.562+0000 7f5641d78700 1 --2- 172.21.15.6:0/1118203830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f563c159380 0x7f563c159750 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f56380098e0 tx=0x7f56380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5770c30d7a69aab1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.562+0000 7f5640d76700 1 -- 172.21.15.6:0/1118203830 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638009e80 con 0x7f563c159380 2023-10-06T02:23:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.562+0000 7f5640d76700 1 -- 172.21.15.6:0/1118203830 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563800b820 con 0x7f563c159380 2023-10-06T02:23:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.562+0000 7f5640d76700 1 -- 172.21.15.6:0/1118203830 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800bba0 con 0x7f563c159380 2023-10-06T02:23:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.563+0000 7f5643fdc700 1 -- 172.21.15.6:0/1118203830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f563c159380 msgr2=0x7f563c159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.563+0000 7f5643fdc700 1 --2- 172.21.15.6:0/1118203830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f563c159380 0x7f563c159750 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f56380098e0 tx=0x7f56380091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.563+0000 7f5643fdc700 1 -- 172.21.15.6:0/1118203830 shutdown_connections 2023-10-06T02:23:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.563+0000 7f5643fdc700 1 --2- 172.21.15.6:0/1118203830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f563c159380 0x7f563c159750 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.563+0000 7f5643fdc700 1 -- 172.21.15.6:0/1118203830 >> 172.21.15.6:0/1118203830 conn(0x7f563c068680 msgr2=0x7f563c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.563+0000 7f5643fdc700 1 -- 172.21.15.6:0/1118203830 shutdown_connections 2023-10-06T02:23:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.563+0000 7f5643fdc700 1 -- 172.21.15.6:0/1118203830 wait complete. 2023-10-06T02:23:35.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.564+0000 7f5643fdc700 1 Processor -- start 2023-10-06T02:23:35.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.564+0000 7f5643fdc700 1 -- start start 2023-10-06T02:23:35.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.565+0000 7f5643fdc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f563c0b20e0 0x7f563c0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:35.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.565+0000 7f5643fdc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f563c159380 0x7f563c0c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:35.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.565+0000 7f5643fdc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f563c15d4d0 0x7f563c0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:35.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.565+0000 7f5643fdc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0c7510 con 0x7f563c0b20e0 2023-10-06T02:23:35.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.565+0000 7f5643fdc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0c7760 con 0x7f563c15d4d0 2023-10-06T02:23:35.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.565+0000 7f5643fdc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0c7a40 con 0x7f563c159380 2023-10-06T02:23:35.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.565+0000 7f5641d78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f563c0b20e0 0x7f563c0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:35.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.565+0000 7f5641d78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f563c0b20e0 0x7f563c0b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48056/0 (socket says 172.21.15.6:48056) 2023-10-06T02:23:35.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.565+0000 7f5641d78700 1 -- 172.21.15.6:0/1006833859 learned_addr learned my addr 172.21.15.6:0/1006833859 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:35.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.565+0000 7f5642579700 1 --2- 172.21.15.6:0/1006833859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f563c15d4d0 0x7f563c0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:35.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.565+0000 7f5641d78700 1 -- 172.21.15.6:0/1006833859 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f563c159380 msgr2=0x7f563c0c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.565+0000 7f5641d78700 1 --2- 172.21.15.6:0/1006833859 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f563c159380 0x7f563c0c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.565+0000 7f5641d78700 1 -- 172.21.15.6:0/1006833859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f563c15d4d0 msgr2=0x7f563c0ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.565+0000 7f5641d78700 1 --2- 172.21.15.6:0/1006833859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f563c15d4d0 0x7f563c0ca210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.565+0000 7f5641d78700 1 -- 172.21.15.6:0/1006833859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5638009420 con 0x7f563c0b20e0 2023-10-06T02:23:35.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.566+0000 7f5641d78700 1 --2- 172.21.15.6:0/1006833859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f563c0b20e0 0x7f563c0b3a00 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f56380030c0 tx=0x7f5638016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:35.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.566+0000 7f5631ffb700 1 -- 172.21.15.6:0/1006833859 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800b990 con 0x7f563c0b20e0 2023-10-06T02:23:35.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.566+0000 7f5631ffb700 1 -- 172.21.15.6:0/1006833859 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638020070 con 0x7f563c0b20e0 2023-10-06T02:23:35.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.566+0000 7f5643fdc700 1 -- 172.21.15.6:0/1006833859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563c0c7d20 con 0x7f563c0b20e0 2023-10-06T02:23:35.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.566+0000 7f5631ffb700 1 -- 172.21.15.6:0/1006833859 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563801b450 con 0x7f563c0b20e0 2023-10-06T02:23:35.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.566+0000 7f5643fdc700 1 -- 172.21.15.6:0/1006833859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563c0b3f40 con 0x7f563c0b20e0 2023-10-06T02:23:35.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.567+0000 7f5643fdc700 1 -- 172.21.15.6:0/1006833859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563c15d310 con 0x7f563c0b20e0 2023-10-06T02:23:35.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.567+0000 7f5631ffb700 1 -- 172.21.15.6:0/1006833859 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5638022030 con 0x7f563c0b20e0 2023-10-06T02:23:35.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.568+0000 7f5631ffb700 1 --2- 172.21.15.6:0/1006833859 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5620066f30 0x7f56200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:35.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.568+0000 7f5631ffb700 1 -- 172.21.15.6:0/1006833859 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f5638086250 con 0x7f563c0b20e0 2023-10-06T02:23:35.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.568+0000 7f5641577700 1 --2- 172.21.15.6:0/1006833859 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5620066f30 0x7f56200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:35.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.569+0000 7f5641577700 1 --2- 172.21.15.6:0/1006833859 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5620066f30 0x7f56200693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f562c007fd0 tx=0x7f562c007b90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:35.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.572+0000 7f5631ffb700 1 -- 172.21.15.6:0/1006833859 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5638053570 con 0x7f563c0b20e0 2023-10-06T02:23:35.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.769+0000 7f5643fdc700 1 -- 172.21.15.6:0/1006833859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f563c15d310 con 0x7f563c0b20e0 2023-10-06T02:23:35.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.769+0000 7f5631ffb700 1 -- 172.21.15.6:0/1006833859 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v78) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5638056b90 con 0x7f563c0b20e0 2023-10-06T02:23:35.770 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:35.770 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-06T02:23:35.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:35.770 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-06T02:23:35.770 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-10-06T02:23:35.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:35.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:23:35.771 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-10-06T02:23:35.771 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-06T02:23:35.771 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:35.771 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-06T02:23:35.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.771+0000 7f5643fdc700 1 -- 172.21.15.6:0/1006833859 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5620066f30 msgr2=0x7f56200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.771+0000 7f5643fdc700 1 --2- 172.21.15.6:0/1006833859 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5620066f30 0x7f56200693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f562c007fd0 tx=0x7f562c007b90 comp rx=0 tx=0).stop 2023-10-06T02:23:35.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.771+0000 7f5643fdc700 1 -- 172.21.15.6:0/1006833859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f563c0b20e0 msgr2=0x7f563c0b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.771+0000 7f5643fdc700 1 --2- 172.21.15.6:0/1006833859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f563c0b20e0 0x7f563c0b3a00 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f56380030c0 tx=0x7f5638016000 comp rx=0 tx=0).stop 2023-10-06T02:23:35.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.772+0000 7f5643fdc700 1 -- 172.21.15.6:0/1006833859 shutdown_connections 2023-10-06T02:23:35.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.772+0000 7f5643fdc700 1 --2- 172.21.15.6:0/1006833859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f563c15d4d0 0x7f563c0ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.772+0000 7f5643fdc700 1 --2- 172.21.15.6:0/1006833859 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5620066f30 0x7f56200693e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.772+0000 7f5643fdc700 1 --2- 172.21.15.6:0/1006833859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f563c0b20e0 0x7f563c0b3a00 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.772+0000 7f5643fdc700 1 --2- 172.21.15.6:0/1006833859 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f563c159380 0x7f563c0c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.772+0000 7f5643fdc700 1 -- 172.21.15.6:0/1006833859 >> 172.21.15.6:0/1006833859 conn(0x7f563c068680 msgr2=0x7f563c157740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:35.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.772+0000 7f5643fdc700 1 -- 172.21.15.6:0/1006833859 shutdown_connections 2023-10-06T02:23:35.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.772+0000 7f5643fdc700 1 -- 172.21.15.6:0/1006833859 wait complete. 2023-10-06T02:23:35.784 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:23:35.784 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:23:35.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.906+0000 7f855bc31700 1 Processor -- start 2023-10-06T02:23:35.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.907+0000 7f855bc31700 1 -- start start 2023-10-06T02:23:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.907+0000 7f855bc31700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f85540aedf0 0x7f85540af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.907+0000 7f855bc31700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f855406a370 0x7f8554159d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.907+0000 7f855bc31700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85540b1ce0 con 0x7f855415a280 2023-10-06T02:23:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.907+0000 7f855bc31700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8554069030 con 0x7f85540aedf0 2023-10-06T02:23:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.907+0000 7f855bc31700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8554069510 con 0x7f855406a370 2023-10-06T02:23:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.908+0000 7f85599cd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f85540aedf0 0x7f85540af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.908+0000 7f85591cc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f855406a370 0x7f8554159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.908+0000 7f85599cd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f85540aedf0 0x7f85540af1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:43014/0 (socket says 172.21.15.6:43014) 2023-10-06T02:23:35.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.908+0000 7f855a1ce700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f855415a280 0x7f85540b2170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:36670/0 (socket says 172.21.15.6:36670) 2023-10-06T02:23:35.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.908+0000 7f85599cd700 1 -- 172.21.15.6:0/2756325599 learned_addr learned my addr 172.21.15.6:0/2756325599 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:35.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.908+0000 7f85591cc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f855406a370 0x7f8554159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:42210/0 (socket says 172.21.15.6:42210) 2023-10-06T02:23:35.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.908+0000 7f85599cd700 1 -- 172.21.15.6:0/2756325599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f855406a370 msgr2=0x7f8554159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:35.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.908+0000 7f85599cd700 1 --2- 172.21.15.6:0/2756325599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f855406a370 0x7f8554159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.908+0000 7f85599cd700 1 -- 172.21.15.6:0/2756325599 >> v1:172.21.15.175:6789/0 conn(0x7f855415a280 legacy=0x7f85540b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.908+0000 7f85599cd700 1 -- 172.21.15.6:0/2756325599 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8554069230 con 0x7f85540aedf0 2023-10-06T02:23:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.908+0000 7f85591cc700 1 --2- 172.21.15.6:0/2756325599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f855406a370 0x7f8554159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.908+0000 7f85599cd700 1 --2- 172.21.15.6:0/2756325599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85540aedf0 0x7f85540af1c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f854c0099e0 tx=0x7f854c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5caee4df49adecc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.908+0000 7f85589cb700 1 -- 172.21.15.6:0/2756325599 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c00b8b0 con 0x7f85540aedf0 2023-10-06T02:23:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.908+0000 7f85589cb700 1 -- 172.21.15.6:0/2756325599 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c00ba10 con 0x7f85540aedf0 2023-10-06T02:23:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.908+0000 7f85589cb700 1 -- 172.21.15.6:0/2756325599 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c00bdb0 con 0x7f85540aedf0 2023-10-06T02:23:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.909+0000 7f855bc31700 1 -- 172.21.15.6:0/2756325599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85540aedf0 msgr2=0x7f85540af1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.909+0000 7f855bc31700 1 --2- 172.21.15.6:0/2756325599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85540aedf0 0x7f85540af1c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f854c0099e0 tx=0x7f854c009250 comp rx=0 tx=0).stop 2023-10-06T02:23:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.909+0000 7f855bc31700 1 -- 172.21.15.6:0/2756325599 shutdown_connections 2023-10-06T02:23:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.909+0000 7f855bc31700 1 --2- 172.21.15.6:0/2756325599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85540aedf0 0x7f85540af1c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.909+0000 7f855bc31700 1 --2- 172.21.15.6:0/2756325599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f855406a370 0x7f8554159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.909+0000 7f855bc31700 1 -- 172.21.15.6:0/2756325599 >> 172.21.15.6:0/2756325599 conn(0x7f8554069f70 msgr2=0x7f85540ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.909+0000 7f855bc31700 1 -- 172.21.15.6:0/2756325599 shutdown_connections 2023-10-06T02:23:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.909+0000 7f855bc31700 1 -- 172.21.15.6:0/2756325599 wait complete. 2023-10-06T02:23:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.910+0000 7f855bc31700 1 Processor -- start 2023-10-06T02:23:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.910+0000 7f855bc31700 1 -- start start 2023-10-06T02:23:35.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.911+0000 7f855bc31700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f855406a370 0x7f855416cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:35.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.911+0000 7f855bc31700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85540aedf0 0x7f85540996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:35.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.911+0000 7f855bc31700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f855415a280 0x7f85540c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:35.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.911+0000 7f855bc31700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855416de60 con 0x7f85540aedf0 2023-10-06T02:23:35.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.911+0000 7f855bc31700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855416d8a0 con 0x7f855406a370 2023-10-06T02:23:35.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.911+0000 7f855bc31700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855416db80 con 0x7f855415a280 2023-10-06T02:23:35.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.911+0000 7f85591cc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85540aedf0 0x7f85540996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:35.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.911+0000 7f85591cc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85540aedf0 0x7f85540996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48072/0 (socket says 172.21.15.6:48072) 2023-10-06T02:23:35.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.911+0000 7f85591cc700 1 -- 172.21.15.6:0/1564094904 learned_addr learned my addr 172.21.15.6:0/1564094904 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:35.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.911+0000 7f85599cd700 1 --2- 172.21.15.6:0/1564094904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f855406a370 0x7f855416cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:35.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.911+0000 7f855a1ce700 1 --2- 172.21.15.6:0/1564094904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f855415a280 0x7f85540c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:35.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.911+0000 7f85591cc700 1 -- 172.21.15.6:0/1564094904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f855415a280 msgr2=0x7f85540c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.911+0000 7f85591cc700 1 --2- 172.21.15.6:0/1564094904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f855415a280 0x7f85540c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.911+0000 7f85591cc700 1 -- 172.21.15.6:0/1564094904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f855406a370 msgr2=0x7f855416cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.911+0000 7f85591cc700 1 --2- 172.21.15.6:0/1564094904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f855406a370 0x7f855416cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.911+0000 7f85591cc700 1 -- 172.21.15.6:0/1564094904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8548009420 con 0x7f85540aedf0 2023-10-06T02:23:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.912+0000 7f85591cc700 1 --2- 172.21.15.6:0/1564094904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85540aedf0 0x7f85540996c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f854800ec80 tx=0x7f85480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.912+0000 7f8551ffb700 1 -- 172.21.15.6:0/1564094904 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854800c850 con 0x7f85540aedf0 2023-10-06T02:23:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.912+0000 7f8551ffb700 1 -- 172.21.15.6:0/1564094904 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854800c9b0 con 0x7f85540aedf0 2023-10-06T02:23:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.912+0000 7f8551ffb700 1 -- 172.21.15.6:0/1564094904 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854800cd30 con 0x7f85540aedf0 2023-10-06T02:23:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.912+0000 7f855bc31700 1 -- 172.21.15.6:0/1564094904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854c0094f0 con 0x7f85540aedf0 2023-10-06T02:23:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.912+0000 7f855bc31700 1 -- 172.21.15.6:0/1564094904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85540c20d0 con 0x7f85540aedf0 2023-10-06T02:23:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.913+0000 7f855bc31700 1 -- 172.21.15.6:0/1564094904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85540cde30 con 0x7f85540aedf0 2023-10-06T02:23:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.913+0000 7f8551ffb700 1 -- 172.21.15.6:0/1564094904 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8548013680 con 0x7f85540aedf0 2023-10-06T02:23:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.914+0000 7f8551ffb700 1 --2- 172.21.15.6:0/1564094904 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8540066f30 0x7f85400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.914+0000 7f8551ffb700 1 -- 172.21.15.6:0/1564094904 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f8548084660 con 0x7f85540aedf0 2023-10-06T02:23:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.914+0000 7f85599cd700 1 --2- 172.21.15.6:0/1564094904 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8540066f30 0x7f85400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:35.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.915+0000 7f85599cd700 1 --2- 172.21.15.6:0/1564094904 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8540066f30 0x7f85400693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f854c0099e0 tx=0x7f854c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:35.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:35.918+0000 7f8551ffb700 1 -- 172.21.15.6:0/1564094904 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8548055410 con 0x7f85540aedf0 2023-10-06T02:23:36.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:36.113+0000 7f855bc31700 1 -- 172.21.15.6:0/1564094904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f855404bb80 con 0x7f85540aedf0 2023-10-06T02:23:36.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:36.987+0000 7f8551ffb700 1 -- 172.21.15.6:0/1564094904 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v79) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8548054fa0 con 0x7f85540aedf0 2023-10-06T02:23:36.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:36.991+0000 7f855bc31700 1 -- 172.21.15.6:0/1564094904 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8540066f30 msgr2=0x7f85400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:36.991+0000 7f855bc31700 1 --2- 172.21.15.6:0/1564094904 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8540066f30 0x7f85400693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f854c0099e0 tx=0x7f854c017000 comp rx=0 tx=0).stop 2023-10-06T02:23:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:36.991+0000 7f855bc31700 1 -- 172.21.15.6:0/1564094904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85540aedf0 msgr2=0x7f85540996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:36.991+0000 7f855bc31700 1 --2- 172.21.15.6:0/1564094904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85540aedf0 0x7f85540996c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f854800ec80 tx=0x7f85480091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:36.992+0000 7f855bc31700 1 -- 172.21.15.6:0/1564094904 shutdown_connections 2023-10-06T02:23:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:36.992+0000 7f855bc31700 1 --2- 172.21.15.6:0/1564094904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f855415a280 0x7f85540c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:36.992+0000 7f855bc31700 1 --2- 172.21.15.6:0/1564094904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f855406a370 0x7f855416cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:36.992+0000 7f855bc31700 1 --2- 172.21.15.6:0/1564094904 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8540066f30 0x7f85400693e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:36.992+0000 7f855bc31700 1 --2- 172.21.15.6:0/1564094904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85540aedf0 0x7f85540996c0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:36.992+0000 7f855bc31700 1 -- 172.21.15.6:0/1564094904 >> 172.21.15.6:0/1564094904 conn(0x7f8554069f70 msgr2=0x7f8554096b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:36.992+0000 7f855bc31700 1 -- 172.21.15.6:0/1564094904 shutdown_connections 2023-10-06T02:23:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:36.992+0000 7f855bc31700 1 -- 172.21.15.6:0/1564094904 wait complete. 2023-10-06T02:23:36.995 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-06T02:23:37.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:23:37.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.138+0000 7f304d566700 1 Processor -- start 2023-10-06T02:23:37.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.138+0000 7f304d566700 1 -- start start 2023-10-06T02:23:37.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f304d566700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480b2820 0x7f30480b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:37.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f304d566700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3048069120 con 0x7f3048158e70 2023-10-06T02:23:37.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f304d566700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30480cb120 con 0x7f30480b2450 2023-10-06T02:23:37.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f304d566700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30481599c0 con 0x7f30480b2820 2023-10-06T02:23:37.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f30477fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3048158e70 0x7f30481592b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53144/0 (socket says 172.21.15.6:53144) 2023-10-06T02:23:37.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f30477fe700 1 -- 172.21.15.6:0/2416921632 learned_addr learned my addr 172.21.15.6:0/2416921632 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:37.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f3045ffb700 1 -- 172.21.15.6:0/2416921632 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1658646388 0 0) 0x7f3048069120 con 0x7f3048158e70 2023-10-06T02:23:37.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f30467fc700 1 --2- 172.21.15.6:0/2416921632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480b2820 0x7f30480b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:37.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f3045ffb700 1 -- 172.21.15.6:0/2416921632 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3030003570 con 0x7f3048158e70 2023-10-06T02:23:37.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f3045ffb700 1 -- 172.21.15.6:0/2416921632 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355143630 0 0) 0x7f30480cb120 con 0x7f30480b2450 2023-10-06T02:23:37.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f3045ffb700 1 -- 172.21.15.6:0/2416921632 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3048069120 con 0x7f30480b2450 2023-10-06T02:23:37.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f3045ffb700 1 -- 172.21.15.6:0/2416921632 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2435763595 0 0) 0x7f3030003570 con 0x7f3048158e70 2023-10-06T02:23:37.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f3045ffb700 1 -- 172.21.15.6:0/2416921632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480b2820 msgr2=0x7f30480b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:37.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f3045ffb700 1 --2- 172.21.15.6:0/2416921632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480b2820 0x7f30480b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:37.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f3045ffb700 1 -- 172.21.15.6:0/2416921632 >> v1:172.21.15.175:6789/0 conn(0x7f30480b2450 legacy=0x7f3048068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:37.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f3045ffb700 1 -- 172.21.15.6:0/2416921632 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304815de80 con 0x7f3048158e70 2023-10-06T02:23:37.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f3045ffb700 1 -- 172.21.15.6:0/2416921632 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f30400017f0 con 0x7f3048158e70 2023-10-06T02:23:37.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f3045ffb700 1 -- 172.21.15.6:0/2416921632 >> v1:172.21.15.6:6789/0 conn(0x7f3048158e70 legacy=0x7f30481592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:37.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f3045ffb700 1 --2- 172.21.15.6:0/2416921632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3030003c20 0x7f3030004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:37.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f3045ffb700 1 --2- 172.21.15.6:0/2416921632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480b2820 0x7f3030004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:37.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f3045ffb700 1 --2- 172.21.15.6:0/2416921632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3030004d50 0x7f30300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:37.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f3045ffb700 1 -- 172.21.15.6:0/2416921632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30481599c0 con 0x7f3030004d50 2023-10-06T02:23:37.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f3045ffb700 1 -- 172.21.15.6:0/2416921632 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303000bbf0 con 0x7f3030003c20 2023-10-06T02:23:37.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.139+0000 7f3045ffb700 1 -- 172.21.15.6:0/2416921632 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303000bdb0 con 0x7f30480b2820 2023-10-06T02:23:37.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.140+0000 7f30477fe700 1 --2- 172.21.15.6:0/2416921632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3030004d50 0x7f30300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:37.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.140+0000 7f3046ffd700 1 --2- 172.21.15.6:0/2416921632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3030003c20 0x7f3030004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:37.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.140+0000 7f30467fc700 1 --2- 172.21.15.6:0/2416921632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480b2820 0x7f3030004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:37.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.140+0000 7f30477fe700 1 -- 172.21.15.6:0/2416921632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480b2820 msgr2=0x7f3030004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:37.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.140+0000 7f30477fe700 1 --2- 172.21.15.6:0/2416921632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480b2820 0x7f3030004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:37.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.140+0000 7f30477fe700 1 -- 172.21.15.6:0/2416921632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3030003c20 msgr2=0x7f3030004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:37.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.140+0000 7f30477fe700 1 --2- 172.21.15.6:0/2416921632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3030003c20 0x7f3030004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:37.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.140+0000 7f30477fe700 1 -- 172.21.15.6:0/2416921632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3030003570 con 0x7f3030004d50 2023-10-06T02:23:37.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.140+0000 7f30467fc700 1 --2- 172.21.15.6:0/2416921632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480b2820 0x7f3030004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:37.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.140+0000 7f3046ffd700 1 --2- 172.21.15.6:0/2416921632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3030003c20 0x7f3030004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:37.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.140+0000 7f30477fe700 1 --2- 172.21.15.6:0/2416921632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3030004d50 0x7f30300051c0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f304000a7d0 tx=0x7f30400020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7315c01365953e6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:37.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.140+0000 7f3045ffb700 1 -- 172.21.15.6:0/2416921632 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30400070d0 con 0x7f3030004d50 2023-10-06T02:23:37.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.140+0000 7f3045ffb700 1 -- 172.21.15.6:0/2416921632 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3040007230 con 0x7f3030004d50 2023-10-06T02:23:37.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.140+0000 7f3045ffb700 1 -- 172.21.15.6:0/2416921632 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30400075d0 con 0x7f3030004d50 2023-10-06T02:23:37.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.141+0000 7f304d566700 1 -- 172.21.15.6:0/2416921632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3030004d50 msgr2=0x7f30300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:37.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.141+0000 7f304d566700 1 --2- 172.21.15.6:0/2416921632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3030004d50 0x7f30300051c0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f304000a7d0 tx=0x7f30400020c0 comp rx=0 tx=0).stop 2023-10-06T02:23:37.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.141+0000 7f30477fe700 1 -- 172.21.15.6:0/2416921632 reap_dead start 2023-10-06T02:23:37.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.141+0000 7f304d566700 1 -- 172.21.15.6:0/2416921632 shutdown_connections 2023-10-06T02:23:37.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.141+0000 7f304d566700 1 -- 172.21.15.6:0/2416921632 >> 172.21.15.6:0/2416921632 conn(0x7f30480d0310 msgr2=0x7f30480d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:37.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.141+0000 7f304d566700 1 -- 172.21.15.6:0/2416921632 shutdown_connections 2023-10-06T02:23:37.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.141+0000 7f304d566700 1 -- 172.21.15.6:0/2416921632 wait complete. 2023-10-06T02:23:37.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.142+0000 7f304d566700 1 Processor -- start 2023-10-06T02:23:37.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.142+0000 7f304d566700 1 -- start start 2023-10-06T02:23:37.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f304d566700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3048153f10 0x7f3048169b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:37.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f304d566700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30481577c0 0x7f3048155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:37.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f304d566700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3048157c30 0x7f3048155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f304d566700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30480ca2a0 con 0x7f30481577c0 2023-10-06T02:23:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f304d566700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304816a050 con 0x7f3048157c30 2023-10-06T02:23:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f304d566700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30480c7aa0 con 0x7f3048153f10 2023-10-06T02:23:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f30467fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30481577c0 0x7f3048155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f30467fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30481577c0 0x7f3048155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48086/0 (socket says 172.21.15.6:48086) 2023-10-06T02:23:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f30467fc700 1 -- 172.21.15.6:0/2530311857 learned_addr learned my addr 172.21.15.6:0/2530311857 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f30477fe700 1 --2- 172.21.15.6:0/2530311857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3048157c30 0x7f3048155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f3046ffd700 1 --2- 172.21.15.6:0/2530311857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3048153f10 0x7f3048169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f30467fc700 1 -- 172.21.15.6:0/2530311857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3048153f10 msgr2=0x7f3048169b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f30467fc700 1 --2- 172.21.15.6:0/2530311857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3048153f10 0x7f3048169b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f30467fc700 1 -- 172.21.15.6:0/2530311857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3048157c30 msgr2=0x7f3048155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f30467fc700 1 --2- 172.21.15.6:0/2530311857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3048157c30 0x7f3048155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:37.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f30467fc700 1 -- 172.21.15.6:0/2530311857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3048156380 con 0x7f30481577c0 2023-10-06T02:23:37.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f30477fe700 1 --2- 172.21.15.6:0/2530311857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3048157c30 0x7f3048155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:37.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.143+0000 7f30467fc700 1 --2- 172.21.15.6:0/2530311857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30481577c0 0x7f3048155510 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f303c011d70 tx=0x7f303c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:37.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.144+0000 7f302effd700 1 -- 172.21.15.6:0/2530311857 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c00fcd0 con 0x7f30481577c0 2023-10-06T02:23:37.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.144+0000 7f302effd700 1 -- 172.21.15.6:0/2530311857 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c00fe30 con 0x7f30481577c0 2023-10-06T02:23:37.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.144+0000 7f304d566700 1 -- 172.21.15.6:0/2530311857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30480c9fc0 con 0x7f30481577c0 2023-10-06T02:23:37.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.144+0000 7f302effd700 1 -- 172.21.15.6:0/2530311857 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c014670 con 0x7f30481577c0 2023-10-06T02:23:37.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.144+0000 7f304d566700 1 -- 172.21.15.6:0/2530311857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30480c7730 con 0x7f30481577c0 2023-10-06T02:23:37.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.145+0000 7f304d566700 1 -- 172.21.15.6:0/2530311857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3048088d10 con 0x7f30481577c0 2023-10-06T02:23:37.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.145+0000 7f302effd700 1 -- 172.21.15.6:0/2530311857 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f303c014aa0 con 0x7f30481577c0 2023-10-06T02:23:37.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.145+0000 7f302effd700 1 --2- 172.21.15.6:0/2530311857 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3034066f30 0x7f30340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:37.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.146+0000 7f302effd700 1 -- 172.21.15.6:0/2530311857 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f303c018070 con 0x7f30481577c0 2023-10-06T02:23:37.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.146+0000 7f3046ffd700 1 --2- 172.21.15.6:0/2530311857 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3034066f30 0x7f30340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:37.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.146+0000 7f3046ffd700 1 --2- 172.21.15.6:0/2530311857 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3034066f30 0x7f30340693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f30380010e0 tx=0x7f3038009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:37.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.150+0000 7f302effd700 1 -- 172.21.15.6:0/2530311857 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f303c052480 con 0x7f30481577c0 2023-10-06T02:23:37.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.343+0000 7f304d566700 1 -- 172.21.15.6:0/2530311857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f30480cb3c0 con 0x7f30481577c0 2023-10-06T02:23:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:37.991+0000 7f302effd700 1 -- 172.21.15.6:0/2530311857 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) v1 ==== 170+0+0 (secure 0 0 0) 0x7f303c055aa0 con 0x7f30481577c0 2023-10-06T02:23:38.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.005+0000 7f304d566700 1 -- 172.21.15.6:0/2530311857 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3034066f30 msgr2=0x7f30340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:38.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.005+0000 7f304d566700 1 --2- 172.21.15.6:0/2530311857 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3034066f30 0x7f30340693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f30380010e0 tx=0x7f3038009040 comp rx=0 tx=0).stop 2023-10-06T02:23:38.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.005+0000 7f304d566700 1 -- 172.21.15.6:0/2530311857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30481577c0 msgr2=0x7f3048155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:38.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.005+0000 7f304d566700 1 --2- 172.21.15.6:0/2530311857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30481577c0 0x7f3048155510 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f303c011d70 tx=0x7f303c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.005+0000 7f304d566700 1 -- 172.21.15.6:0/2530311857 shutdown_connections 2023-10-06T02:23:38.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.005+0000 7f304d566700 1 --2- 172.21.15.6:0/2530311857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3048157c30 0x7f3048155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.005+0000 7f304d566700 1 --2- 172.21.15.6:0/2530311857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3048153f10 0x7f3048169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.005+0000 7f304d566700 1 --2- 172.21.15.6:0/2530311857 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3034066f30 0x7f30340693e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.005+0000 7f304d566700 1 --2- 172.21.15.6:0/2530311857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30481577c0 0x7f3048155510 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.005+0000 7f304d566700 1 -- 172.21.15.6:0/2530311857 >> 172.21.15.6:0/2530311857 conn(0x7f30480d0310 msgr2=0x7f30480cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:38.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.006+0000 7f304d566700 1 -- 172.21.15.6:0/2530311857 shutdown_connections 2023-10-06T02:23:38.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.007+0000 7f304d566700 1 -- 172.21.15.6:0/2530311857 wait complete. 2023-10-06T02:23:38.010 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-06T02:23:38.023 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:23:38.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.148+0000 7fa3b3a76700 1 Processor -- start 2023-10-06T02:23:38.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.148+0000 7fa3b3a76700 1 -- start start 2023-10-06T02:23:38.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b3a76700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa3ac0d0400 0x7fa3ac0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:38.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b3a76700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3ac0d07d0 0x7fa3ac0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:38.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b3a76700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ac0b6170 con 0x7fa3ac0ccd40 2023-10-06T02:23:38.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b3a76700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ac15dd40 con 0x7fa3ac0d07d0 2023-10-06T02:23:38.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b3a76700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ac15e020 con 0x7fa3ac0d0400 2023-10-06T02:23:38.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b2013700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3ac0d07d0 0x7fa3ac0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:38.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b2013700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3ac0d07d0 0x7fa3ac0b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48100/0 (socket says 172.21.15.6:48100) 2023-10-06T02:23:38.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b1011700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa3ac0ccd40 0x7fa3ac0cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53152/0 (socket says 172.21.15.6:53152) 2023-10-06T02:23:38.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b2013700 1 -- 172.21.15.6:0/1025531808 learned_addr learned my addr 172.21.15.6:0/1025531808 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:38.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b1812700 1 --2- 172.21.15.6:0/1025531808 >> v2:172.21.15.175:3300/0 conn(0x7fa3ac0d0400 0x7fa3ac0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:38.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b2013700 1 -- 172.21.15.6:0/1025531808 >> v2:172.21.15.175:3300/0 conn(0x7fa3ac0d0400 msgr2=0x7fa3ac0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:38.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b2013700 1 --2- 172.21.15.6:0/1025531808 >> v2:172.21.15.175:3300/0 conn(0x7fa3ac0d0400 0x7fa3ac0b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b2013700 1 -- 172.21.15.6:0/1025531808 >> v1:172.21.15.6:6789/0 conn(0x7fa3ac0ccd40 legacy=0x7fa3ac0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:38.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b2013700 1 -- 172.21.15.6:0/1025531808 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac0ceaa0 con 0x7fa3ac0d07d0 2023-10-06T02:23:38.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b2013700 1 --2- 172.21.15.6:0/1025531808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0d07d0 0x7fa3ac0b3aa0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac088f30 tx=0x7fa3a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b819836cc5a38e8a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:38.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b0810700 1 -- 172.21.15.6:0/1025531808 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a400e070 con 0x7fa3ac0d07d0 2023-10-06T02:23:38.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b0810700 1 -- 172.21.15.6:0/1025531808 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a400ba50 con 0x7fa3ac0d07d0 2023-10-06T02:23:38.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.149+0000 7fa3b0810700 1 -- 172.21.15.6:0/1025531808 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a40092e0 con 0x7fa3ac0d07d0 2023-10-06T02:23:38.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.150+0000 7fa3b3a76700 1 -- 172.21.15.6:0/1025531808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0d07d0 msgr2=0x7fa3ac0b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:38.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.150+0000 7fa3b3a76700 1 --2- 172.21.15.6:0/1025531808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0d07d0 0x7fa3ac0b3aa0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac088f30 tx=0x7fa3a4009840 comp rx=0 tx=0).stop 2023-10-06T02:23:38.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.150+0000 7fa3b3a76700 1 -- 172.21.15.6:0/1025531808 shutdown_connections 2023-10-06T02:23:38.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.150+0000 7fa3b3a76700 1 --2- 172.21.15.6:0/1025531808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0d07d0 0x7fa3ac0b3aa0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.150+0000 7fa3b3a76700 1 --2- 172.21.15.6:0/1025531808 >> v2:172.21.15.175:3300/0 conn(0x7fa3ac0d0400 0x7fa3ac0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.150+0000 7fa3b3a76700 1 -- 172.21.15.6:0/1025531808 >> 172.21.15.6:0/1025531808 conn(0x7fa3ac06a220 msgr2=0x7fa3ac06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:38.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.150+0000 7fa3b3a76700 1 -- 172.21.15.6:0/1025531808 shutdown_connections 2023-10-06T02:23:38.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.150+0000 7fa3b3a76700 1 -- 172.21.15.6:0/1025531808 wait complete. 2023-10-06T02:23:38.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.151+0000 7fa3b3a76700 1 Processor -- start 2023-10-06T02:23:38.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.151+0000 7fa3b3a76700 1 -- start start 2023-10-06T02:23:38.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.152+0000 7fa3b3a76700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3ac0ccd40 0x7fa3ac150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:38.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.152+0000 7fa3b3a76700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0d0400 0x7fa3ac14cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:38.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.152+0000 7fa3b3a76700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3ac0d07d0 0x7fa3ac151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:38.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.152+0000 7fa3b3a76700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac14f0f0 con 0x7fa3ac0d0400 2023-10-06T02:23:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.152+0000 7fa3b3a76700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac153ef0 con 0x7fa3ac0ccd40 2023-10-06T02:23:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.152+0000 7fa3b3a76700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac14e7c0 con 0x7fa3ac0d07d0 2023-10-06T02:23:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.152+0000 7fa3b1011700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0d0400 0x7fa3ac14cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.152+0000 7fa3b1011700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0d0400 0x7fa3ac14cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48104/0 (socket says 172.21.15.6:48104) 2023-10-06T02:23:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.152+0000 7fa3b1011700 1 -- 172.21.15.6:0/4114273080 learned_addr learned my addr 172.21.15.6:0/4114273080 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.152+0000 7fa3b1812700 1 --2- 172.21.15.6:0/4114273080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3ac0ccd40 0x7fa3ac150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.152+0000 7fa3b1011700 1 -- 172.21.15.6:0/4114273080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3ac0d07d0 msgr2=0x7fa3ac151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.152+0000 7fa3b1011700 1 --2- 172.21.15.6:0/4114273080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3ac0d07d0 0x7fa3ac151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.152+0000 7fa3b1011700 1 -- 172.21.15.6:0/4114273080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3ac0ccd40 msgr2=0x7fa3ac150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.152+0000 7fa3b1011700 1 --2- 172.21.15.6:0/4114273080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3ac0ccd40 0x7fa3ac150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.152+0000 7fa3b1011700 1 -- 172.21.15.6:0/4114273080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a4009ae0 con 0x7fa3ac0d0400 2023-10-06T02:23:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.152+0000 7fa3b1011700 1 --2- 172.21.15.6:0/4114273080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0d0400 0x7fa3ac14cfd0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00c7c0 tx=0x7fa39c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:38.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.153+0000 7fa3a1ffb700 1 -- 172.21.15.6:0/4114273080 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c005a70 con 0x7fa3ac0d0400 2023-10-06T02:23:38.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.153+0000 7fa3a1ffb700 1 -- 172.21.15.6:0/4114273080 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c005bf0 con 0x7fa3ac0d0400 2023-10-06T02:23:38.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.153+0000 7fa3a1ffb700 1 -- 172.21.15.6:0/4114273080 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0070f0 con 0x7fa3ac0d0400 2023-10-06T02:23:38.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.153+0000 7fa3b3a76700 1 -- 172.21.15.6:0/4114273080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ac14eaa0 con 0x7fa3ac0d0400 2023-10-06T02:23:38.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.153+0000 7fa3b3a76700 1 -- 172.21.15.6:0/4114273080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ac14d510 con 0x7fa3ac0d0400 2023-10-06T02:23:38.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.154+0000 7fa3b3a76700 1 -- 172.21.15.6:0/4114273080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ac14f2a0 con 0x7fa3ac0d0400 2023-10-06T02:23:38.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.154+0000 7fa3a1ffb700 1 -- 172.21.15.6:0/4114273080 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa39c007460 con 0x7fa3ac0d0400 2023-10-06T02:23:38.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.155+0000 7fa3a1ffb700 1 --2- 172.21.15.6:0/4114273080 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa390066f30 0x7fa3900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:38.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.155+0000 7fa3a1ffb700 1 -- 172.21.15.6:0/4114273080 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fa39c0841a0 con 0x7fa3ac0d0400 2023-10-06T02:23:38.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.155+0000 7fa3b1812700 1 --2- 172.21.15.6:0/4114273080 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa390066f30 0x7fa3900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:38.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.156+0000 7fa3b1812700 1 --2- 172.21.15.6:0/4114273080 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa390066f30 0x7fa3900693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009970 tx=0x7fa3a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:38.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.160+0000 7fa3a1ffb700 1 -- 172.21.15.6:0/4114273080 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3ac14f2a0 con 0x7fa3ac0d0400 2023-10-06T02:23:38.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:38.398+0000 7fa3b3a76700 1 -- 172.21.15.6:0/4114273080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa3ac14f230 con 0x7fa3ac0d0400 2023-10-06T02:23:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.031+0000 7fa3a1ffb700 1 -- 172.21.15.6:0/4114273080 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v67) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa39c051250 con 0x7fa3ac0d0400 2023-10-06T02:23:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.039+0000 7fa3b3a76700 1 -- 172.21.15.6:0/4114273080 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa390066f30 msgr2=0x7fa3900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.039+0000 7fa3b3a76700 1 --2- 172.21.15.6:0/4114273080 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa390066f30 0x7fa3900693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009970 tx=0x7fa3a8008040 comp rx=0 tx=0).stop 2023-10-06T02:23:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.039+0000 7fa3b3a76700 1 -- 172.21.15.6:0/4114273080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0d0400 msgr2=0x7fa3ac14cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.039+0000 7fa3b3a76700 1 --2- 172.21.15.6:0/4114273080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0d0400 0x7fa3ac14cfd0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00c7c0 tx=0x7fa39c007f70 comp rx=0 tx=0).stop 2023-10-06T02:23:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.040+0000 7fa3b3a76700 1 -- 172.21.15.6:0/4114273080 shutdown_connections 2023-10-06T02:23:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.040+0000 7fa3b3a76700 1 --2- 172.21.15.6:0/4114273080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3ac0d07d0 0x7fa3ac151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.040+0000 7fa3b3a76700 1 --2- 172.21.15.6:0/4114273080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3ac0ccd40 0x7fa3ac150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.040+0000 7fa3b3a76700 1 --2- 172.21.15.6:0/4114273080 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa390066f30 0x7fa3900693e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.040+0000 7fa3b3a76700 1 --2- 172.21.15.6:0/4114273080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0d0400 0x7fa3ac14cfd0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.040+0000 7fa3b3a76700 1 -- 172.21.15.6:0/4114273080 >> 172.21.15.6:0/4114273080 conn(0x7fa3ac06a220 msgr2=0x7fa3ac06a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.041+0000 7fa3b3a76700 1 -- 172.21.15.6:0/4114273080 shutdown_connections 2023-10-06T02:23:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.042+0000 7fa3b3a76700 1 -- 172.21.15.6:0/4114273080 wait complete. 2023-10-06T02:23:39.043 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 12 and data pool 13 2023-10-06T02:23:39.057 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:39.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.177+0000 7fe55e16a700 1 Processor -- start 2023-10-06T02:23:39.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.177+0000 7fe55e16a700 1 -- start start 2023-10-06T02:23:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.178+0000 7fe55e16a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe5580af4e0 0x7fe5580b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.178+0000 7fe55e16a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe5580af8b0 0x7fe5580b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.178+0000 7fe55e16a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55815e190 con 0x7fe55815d460 2023-10-06T02:23:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.178+0000 7fe55e16a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5580b1910 con 0x7fe5580af8b0 2023-10-06T02:23:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.178+0000 7fe55e16a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55815dfa0 con 0x7fe5580af4e0 2023-10-06T02:23:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.178+0000 7fe556ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe5580af8b0 0x7fe5580b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.178+0000 7fe557fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe55815d460 0x7fe55815d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36410/0 (socket says 172.21.15.6:36410) 2023-10-06T02:23:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.178+0000 7fe557fff700 1 -- 172.21.15.6:0/2577012986 learned_addr learned my addr 172.21.15.6:0/2577012986 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.178+0000 7fe5577fe700 1 --2- 172.21.15.6:0/2577012986 >> v2:172.21.15.175:3300/0 conn(0x7fe5580af4e0 0x7fe5580b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.178+0000 7fe556ffd700 1 -- 172.21.15.6:0/2577012986 >> v2:172.21.15.175:3300/0 conn(0x7fe5580af4e0 msgr2=0x7fe5580b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.178+0000 7fe556ffd700 1 --2- 172.21.15.6:0/2577012986 >> v2:172.21.15.175:3300/0 conn(0x7fe5580af4e0 0x7fe5580b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.178+0000 7fe556ffd700 1 -- 172.21.15.6:0/2577012986 >> v1:172.21.15.6:6789/0 conn(0x7fe55815d460 legacy=0x7fe55815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.178+0000 7fe556ffd700 1 -- 172.21.15.6:0/2577012986 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5580cb650 con 0x7fe5580af8b0 2023-10-06T02:23:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.178+0000 7fe5567fc700 1 -- 172.21.15.6:0/2577012986 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888857202 0 0) 0x7fe55815e190 con 0x7fe55815d460 2023-10-06T02:23:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.179+0000 7fe556ffd700 1 --2- 172.21.15.6:0/2577012986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5580af8b0 0x7fe5580b2620 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe5580d1360 tx=0x7fe54c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15cc6998e720293d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.179+0000 7fe5567fc700 1 -- 172.21.15.6:0/2577012986 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c00b6b0 con 0x7fe5580af8b0 2023-10-06T02:23:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.179+0000 7fe5567fc700 1 -- 172.21.15.6:0/2577012986 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c00b810 con 0x7fe5580af8b0 2023-10-06T02:23:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.179+0000 7fe5567fc700 1 -- 172.21.15.6:0/2577012986 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c00bbb0 con 0x7fe5580af8b0 2023-10-06T02:23:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.179+0000 7fe55e16a700 1 -- 172.21.15.6:0/2577012986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5580af8b0 msgr2=0x7fe5580b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.179+0000 7fe55e16a700 1 --2- 172.21.15.6:0/2577012986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5580af8b0 0x7fe5580b2620 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe5580d1360 tx=0x7fe54c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.179+0000 7fe55e16a700 1 -- 172.21.15.6:0/2577012986 shutdown_connections 2023-10-06T02:23:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.179+0000 7fe55e16a700 1 --2- 172.21.15.6:0/2577012986 >> v2:172.21.15.175:3300/0 conn(0x7fe5580af4e0 0x7fe5580b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.179+0000 7fe55e16a700 1 --2- 172.21.15.6:0/2577012986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5580af8b0 0x7fe5580b2620 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.179+0000 7fe55e16a700 1 -- 172.21.15.6:0/2577012986 >> 172.21.15.6:0/2577012986 conn(0x7fe558068680 msgr2=0x7fe558068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.179+0000 7fe55e16a700 1 -- 172.21.15.6:0/2577012986 shutdown_connections 2023-10-06T02:23:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.179+0000 7fe55e16a700 1 -- 172.21.15.6:0/2577012986 wait complete. 2023-10-06T02:23:39.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.180+0000 7fe55e16a700 1 Processor -- start 2023-10-06T02:23:39.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.181+0000 7fe55e16a700 1 -- start start 2023-10-06T02:23:39.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.181+0000 7fe55e16a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5580af4e0 0x7fe5580a9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:39.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.181+0000 7fe55e16a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5580af8b0 0x7fe55814f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:39.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.181+0000 7fe55e16a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe55815d460 0x7fe55814f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:39.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.181+0000 7fe55e16a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55814fe90 con 0x7fe5580af8b0 2023-10-06T02:23:39.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.181+0000 7fe55e16a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5580ceec0 con 0x7fe5580af4e0 2023-10-06T02:23:39.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.181+0000 7fe55e16a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5580cf1a0 con 0x7fe55815d460 2023-10-06T02:23:39.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.181+0000 7fe556ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5580af8b0 0x7fe55814f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:39.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.181+0000 7fe556ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5580af8b0 0x7fe55814f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40138/0 (socket says 172.21.15.6:40138) 2023-10-06T02:23:39.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.181+0000 7fe556ffd700 1 -- 172.21.15.6:0/67133409 learned_addr learned my addr 172.21.15.6:0/67133409 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:39.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.182+0000 7fe5577fe700 1 --2- 172.21.15.6:0/67133409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5580af4e0 0x7fe5580a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:39.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.182+0000 7fe556ffd700 1 -- 172.21.15.6:0/67133409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe55815d460 msgr2=0x7fe55814f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.182+0000 7fe556ffd700 1 --2- 172.21.15.6:0/67133409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe55815d460 0x7fe55814f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.182+0000 7fe556ffd700 1 -- 172.21.15.6:0/67133409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5580af4e0 msgr2=0x7fe5580a9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.182+0000 7fe556ffd700 1 --2- 172.21.15.6:0/67133409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5580af4e0 0x7fe5580a9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.182+0000 7fe556ffd700 1 -- 172.21.15.6:0/67133409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c009420 con 0x7fe5580af8b0 2023-10-06T02:23:39.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.182+0000 7fe5577fe700 1 --2- 172.21.15.6:0/67133409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5580af4e0 0x7fe5580a9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:39.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.182+0000 7fe556ffd700 1 --2- 172.21.15.6:0/67133409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5580af8b0 0x7fe55814f410 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fe54c013000 tx=0x7fe54c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:39.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.182+0000 7fe53f7fe700 1 -- 172.21.15.6:0/67133409 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c011420 con 0x7fe5580af8b0 2023-10-06T02:23:39.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.182+0000 7fe53f7fe700 1 -- 172.21.15.6:0/67133409 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c011580 con 0x7fe5580af8b0 2023-10-06T02:23:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.182+0000 7fe53f7fe700 1 -- 172.21.15.6:0/67133409 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c011920 con 0x7fe5580af8b0 2023-10-06T02:23:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.182+0000 7fe55e16a700 1 -- 172.21.15.6:0/67133409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5580cf480 con 0x7fe5580af8b0 2023-10-06T02:23:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.182+0000 7fe55e16a700 1 -- 172.21.15.6:0/67133409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5580cfa40 con 0x7fe5580af8b0 2023-10-06T02:23:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.183+0000 7fe55e16a700 1 -- 172.21.15.6:0/67133409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe558068d10 con 0x7fe5580af8b0 2023-10-06T02:23:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.183+0000 7fe53f7fe700 1 -- 172.21.15.6:0/67133409 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe54c011d10 con 0x7fe5580af8b0 2023-10-06T02:23:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.184+0000 7fe53f7fe700 1 --2- 172.21.15.6:0/67133409 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe544066f30 0x7fe5440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.184+0000 7fe53f7fe700 1 -- 172.21.15.6:0/67133409 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe54c0863a0 con 0x7fe5580af8b0 2023-10-06T02:23:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.184+0000 7fe5577fe700 1 --2- 172.21.15.6:0/67133409 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe544066f30 0x7fe5440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.184+0000 7fe5577fe700 1 --2- 172.21.15.6:0/67133409 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe544066f30 0x7fe5440693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe548006fd0 tx=0x7fe548008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.188+0000 7fe53f7fe700 1 -- 172.21.15.6:0/67133409 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe54c0533f0 con 0x7fe5580af8b0 2023-10-06T02:23:39.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.382+0000 7fe55e16a700 1 -- 172.21.15.6:0/67133409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe55805f270 con 0x7fe5580af8b0 2023-10-06T02:23:39.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.383+0000 7fe53f7fe700 1 -- 172.21.15.6:0/67133409 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+17039 (secure 0 0 0) 0x7fe54c056a10 con 0x7fe5580af8b0 2023-10-06T02:23:39.384 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:39.384 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":81,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:23:38.399458+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:36.143952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:37.374144+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.385+0000 7fe55e16a700 1 -- 172.21.15.6:0/67133409 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe544066f30 msgr2=0x7fe5440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.385+0000 7fe55e16a700 1 --2- 172.21.15.6:0/67133409 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe544066f30 0x7fe5440693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe548006fd0 tx=0x7fe548008040 comp rx=0 tx=0).stop 2023-10-06T02:23:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.385+0000 7fe55e16a700 1 -- 172.21.15.6:0/67133409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5580af8b0 msgr2=0x7fe55814f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.385+0000 7fe55e16a700 1 --2- 172.21.15.6:0/67133409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5580af8b0 0x7fe55814f410 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fe54c013000 tx=0x7fe54c017000 comp rx=0 tx=0).stop 2023-10-06T02:23:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.385+0000 7fe55e16a700 1 -- 172.21.15.6:0/67133409 shutdown_connections 2023-10-06T02:23:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.385+0000 7fe55e16a700 1 --2- 172.21.15.6:0/67133409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe55815d460 0x7fe55814f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.385+0000 7fe55e16a700 1 --2- 172.21.15.6:0/67133409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5580af4e0 0x7fe5580a9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.385+0000 7fe55e16a700 1 --2- 172.21.15.6:0/67133409 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe544066f30 0x7fe5440693e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.385+0000 7fe55e16a700 1 --2- 172.21.15.6:0/67133409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5580af8b0 0x7fe55814f410 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.385+0000 7fe55e16a700 1 -- 172.21.15.6:0/67133409 >> 172.21.15.6:0/67133409 conn(0x7fe558068680 msgr2=0x7fe55815b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.386+0000 7fe55e16a700 1 -- 172.21.15.6:0/67133409 shutdown_connections 2023-10-06T02:23:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.386+0000 7fe55e16a700 1 -- 172.21.15.6:0/67133409 wait complete. 2023-10-06T02:23:39.398 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:39.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.517+0000 7f6e313c2700 1 Processor -- start 2023-10-06T02:23:39.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.517+0000 7f6e313c2700 1 -- start start 2023-10-06T02:23:39.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.518+0000 7f6e313c2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e2c068d90 0x7f6e2c0af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:39.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.518+0000 7f6e313c2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6e2c06da40 0x7f6e2c159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:39.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.518+0000 7f6e313c2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2c06d5b0 con 0x7f6e2c0af1d0 2023-10-06T02:23:39.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.518+0000 7f6e313c2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2c0caf90 con 0x7f6e2c06da40 2023-10-06T02:23:39.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.518+0000 7f6e313c2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c06dee0 con 0x7f6e2c068d90 2023-10-06T02:23:39.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.518+0000 7f6e2a7fc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e2c068d90 0x7f6e2c0af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:39.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.518+0000 7f6e2b7fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6e2c06da40 0x7f6e2c159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:39.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.518+0000 7f6e2affd700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f6e2c0af1d0 0x7f6e2c068680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:53590/0 (socket says 172.21.15.6:53590) 2023-10-06T02:23:39.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.518+0000 7f6e2affd700 1 -- 172.21.15.6:0/41813504 learned_addr learned my addr 172.21.15.6:0/41813504 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:39.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.518+0000 7f6e29ffb700 1 -- 172.21.15.6:0/41813504 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394552350 0 0) 0x7f6e2c06d5b0 con 0x7f6e2c0af1d0 2023-10-06T02:23:39.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.519+0000 7f6e29ffb700 1 -- 172.21.15.6:0/41813504 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e18003570 con 0x7f6e2c0af1d0 2023-10-06T02:23:39.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.519+0000 7f6e2b7fe700 1 -- 172.21.15.6:0/41813504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e2c068d90 msgr2=0x7f6e2c0af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:39.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.519+0000 7f6e2b7fe700 1 --2- 172.21.15.6:0/41813504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e2c068d90 0x7f6e2c0af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.519+0000 7f6e2b7fe700 1 -- 172.21.15.6:0/41813504 >> v1:172.21.15.175:6789/0 conn(0x7f6e2c0af1d0 legacy=0x7f6e2c068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.519+0000 7f6e2b7fe700 1 -- 172.21.15.6:0/41813504 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c15a9a0 con 0x7f6e2c06da40 2023-10-06T02:23:39.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.519+0000 7f6e2a7fc700 1 --2- 172.21.15.6:0/41813504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e2c068d90 0x7f6e2c0af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:39.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.519+0000 7f6e2b7fe700 1 --2- 172.21.15.6:0/41813504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2c06da40 0x7f6e2c159a40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009e60 tx=0x7f6e1c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5387ac9512897e59 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:39.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.519+0000 7f6e29ffb700 1 -- 172.21.15.6:0/41813504 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c00e070 con 0x7f6e2c06da40 2023-10-06T02:23:39.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.519+0000 7f6e29ffb700 1 -- 172.21.15.6:0/41813504 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c00bab0 con 0x7f6e2c06da40 2023-10-06T02:23:39.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.519+0000 7f6e29ffb700 1 -- 172.21.15.6:0/41813504 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c00be70 con 0x7f6e2c06da40 2023-10-06T02:23:39.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.520+0000 7f6e313c2700 1 -- 172.21.15.6:0/41813504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2c06da40 msgr2=0x7f6e2c159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.520+0000 7f6e313c2700 1 --2- 172.21.15.6:0/41813504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2c06da40 0x7f6e2c159a40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009e60 tx=0x7f6e1c009780 comp rx=0 tx=0).stop 2023-10-06T02:23:39.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.520+0000 7f6e313c2700 1 -- 172.21.15.6:0/41813504 shutdown_connections 2023-10-06T02:23:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.520+0000 7f6e313c2700 1 --2- 172.21.15.6:0/41813504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2c06da40 0x7f6e2c159a40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.520+0000 7f6e313c2700 1 --2- 172.21.15.6:0/41813504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e2c068d90 0x7f6e2c0af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.520+0000 7f6e313c2700 1 -- 172.21.15.6:0/41813504 >> 172.21.15.6:0/41813504 conn(0x7f6e2c06a220 msgr2=0x7f6e2c06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.520+0000 7f6e313c2700 1 -- 172.21.15.6:0/41813504 shutdown_connections 2023-10-06T02:23:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.520+0000 7f6e313c2700 1 -- 172.21.15.6:0/41813504 wait complete. 2023-10-06T02:23:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.521+0000 7f6e313c2700 1 Processor -- start 2023-10-06T02:23:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.521+0000 7f6e313c2700 1 -- start start 2023-10-06T02:23:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e313c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2c068d90 0x7f6e2c0c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e313c2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2c06da40 0x7f6e2c159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e313c2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e2c0af1d0 0x7f6e2c159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e313c2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0b0cc0 con 0x7f6e2c068d90 2023-10-06T02:23:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e313c2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0b0fa0 con 0x7f6e2c06da40 2023-10-06T02:23:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e313c2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0b1280 con 0x7f6e2c0af1d0 2023-10-06T02:23:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e2affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2c068d90 0x7f6e2c0c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e2affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2c068d90 0x7f6e2c0c5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40152/0 (socket says 172.21.15.6:40152) 2023-10-06T02:23:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e2affd700 1 -- 172.21.15.6:0/3448794514 learned_addr learned my addr 172.21.15.6:0/3448794514 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e2a7fc700 1 --2- 172.21.15.6:0/3448794514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2c06da40 0x7f6e2c159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e2b7fe700 1 --2- 172.21.15.6:0/3448794514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e2c0af1d0 0x7f6e2c159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e2affd700 1 -- 172.21.15.6:0/3448794514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e2c0af1d0 msgr2=0x7f6e2c159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e2affd700 1 --2- 172.21.15.6:0/3448794514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e2c0af1d0 0x7f6e2c159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e2affd700 1 -- 172.21.15.6:0/3448794514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2c06da40 msgr2=0x7f6e2c159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e2affd700 1 --2- 172.21.15.6:0/3448794514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2c06da40 0x7f6e2c159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e2affd700 1 -- 172.21.15.6:0/3448794514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e14009420 con 0x7f6e2c068d90 2023-10-06T02:23:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e2affd700 1 --2- 172.21.15.6:0/3448794514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2c068d90 0x7f6e2c0c5cd0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400c7c0 tx=0x7f6e24007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.522+0000 7f6e22ffd700 1 -- 172.21.15.6:0/3448794514 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24005cd0 con 0x7f6e2c068d90 2023-10-06T02:23:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.523+0000 7f6e22ffd700 1 -- 172.21.15.6:0/3448794514 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e24005e30 con 0x7f6e2c068d90 2023-10-06T02:23:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.523+0000 7f6e22ffd700 1 -- 172.21.15.6:0/3448794514 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24007320 con 0x7f6e2c068d90 2023-10-06T02:23:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.523+0000 7f6e313c2700 1 -- 172.21.15.6:0/3448794514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1c009a20 con 0x7f6e2c068d90 2023-10-06T02:23:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.523+0000 7f6e313c2700 1 -- 172.21.15.6:0/3448794514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2c0b1840 con 0x7f6e2c068d90 2023-10-06T02:23:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.524+0000 7f6e313c2700 1 -- 172.21.15.6:0/3448794514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2c06e720 con 0x7f6e2c068d90 2023-10-06T02:23:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.524+0000 7f6e22ffd700 1 -- 172.21.15.6:0/3448794514 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e2401b3b0 con 0x7f6e2c068d90 2023-10-06T02:23:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.524+0000 7f6e22ffd700 1 --2- 172.21.15.6:0/3448794514 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e0c066f30 0x7f6e0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.525+0000 7f6e22ffd700 1 -- 172.21.15.6:0/3448794514 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6e24083e70 con 0x7f6e2c068d90 2023-10-06T02:23:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.525+0000 7f6e2a7fc700 1 --2- 172.21.15.6:0/3448794514 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e0c066f30 0x7f6e0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.525+0000 7f6e2a7fc700 1 --2- 172.21.15.6:0/3448794514 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e0c066f30 0x7f6e0c0693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c151c00 tx=0x7f6e140091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.529+0000 7f6e22ffd700 1 -- 172.21.15.6:0/3448794514 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e24050e40 con 0x7f6e2c068d90 2023-10-06T02:23:39.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.724+0000 7f6e313c2700 1 -- 172.21.15.6:0/3448794514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e2c15a6c0 con 0x7f6e2c068d90 2023-10-06T02:23:39.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.725+0000 7f6e22ffd700 1 -- 172.21.15.6:0/3448794514 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+17039 (secure 0 0 0) 0x7f6e24017020 con 0x7f6e2c068d90 2023-10-06T02:23:39.726 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:39.726 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":81,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:23:38.399458+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:36.143952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:37.374144+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:39.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.727+0000 7f6e313c2700 1 -- 172.21.15.6:0/3448794514 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e0c066f30 msgr2=0x7f6e0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.727+0000 7f6e313c2700 1 --2- 172.21.15.6:0/3448794514 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e0c066f30 0x7f6e0c0693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c151c00 tx=0x7f6e140091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.727+0000 7f6e313c2700 1 -- 172.21.15.6:0/3448794514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2c068d90 msgr2=0x7f6e2c0c5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.727+0000 7f6e313c2700 1 --2- 172.21.15.6:0/3448794514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2c068d90 0x7f6e2c0c5cd0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400c7c0 tx=0x7f6e24007e00 comp rx=0 tx=0).stop 2023-10-06T02:23:39.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.727+0000 7f6e313c2700 1 -- 172.21.15.6:0/3448794514 shutdown_connections 2023-10-06T02:23:39.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.727+0000 7f6e313c2700 1 --2- 172.21.15.6:0/3448794514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e2c0af1d0 0x7f6e2c159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.727+0000 7f6e313c2700 1 --2- 172.21.15.6:0/3448794514 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e0c066f30 0x7f6e0c0693e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.727+0000 7f6e313c2700 1 --2- 172.21.15.6:0/3448794514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2c068d90 0x7f6e2c0c5cd0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.727+0000 7f6e313c2700 1 --2- 172.21.15.6:0/3448794514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2c06da40 0x7f6e2c159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.727+0000 7f6e313c2700 1 -- 172.21.15.6:0/3448794514 >> 172.21.15.6:0/3448794514 conn(0x7f6e2c06a220 msgr2=0x7f6e2c0ca0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:39.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.727+0000 7f6e313c2700 1 -- 172.21.15.6:0/3448794514 shutdown_connections 2023-10-06T02:23:39.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.727+0000 7f6e313c2700 1 -- 172.21.15.6:0/3448794514 wait complete. 2023-10-06T02:23:39.740 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:23:39.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.862+0000 7f4dd835b700 1 Processor -- start 2023-10-06T02:23:39.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.862+0000 7f4dd835b700 1 -- start start 2023-10-06T02:23:39.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.863+0000 7f4dd835b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4dd00c7840 0x7f4dd0159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:39.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.863+0000 7f4dd835b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd00c7cb0 con 0x7f4dd006c830 2023-10-06T02:23:39.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.863+0000 7f4dd835b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd00c7f90 con 0x7f4dd006c460 2023-10-06T02:23:39.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.863+0000 7f4dd835b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd00c8270 con 0x7f4dd00c7840 2023-10-06T02:23:39.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.863+0000 7f4dd58f6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4dd00c7840 0x7f4dd0159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.863+0000 7f4dd68f8700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4dd006c830 0x7f4dd00ca350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36414/0 (socket says 172.21.15.6:36414) 2023-10-06T02:23:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.863+0000 7f4dd68f8700 1 -- 172.21.15.6:0/1863461545 learned_addr learned my addr 172.21.15.6:0/1863461545 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.864+0000 7f4dd58f6700 1 -- 172.21.15.6:0/1863461545 >> v1:172.21.15.175:6789/0 conn(0x7f4dd006c460 legacy=0x7f4dd0158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.864+0000 7f4dd58f6700 1 -- 172.21.15.6:0/1863461545 >> v1:172.21.15.6:6789/0 conn(0x7f4dd006c830 legacy=0x7f4dd00ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.864+0000 7f4dd58f6700 1 -- 172.21.15.6:0/1863461545 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd00c8550 con 0x7f4dd00c7840 2023-10-06T02:23:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.864+0000 7f4dd50f5700 1 -- 172.21.15.6:0/1863461545 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912852970 0 0) 0x7f4dd00c7cb0 con 0x7f4dd006c830 2023-10-06T02:23:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.864+0000 7f4dd58f6700 1 --2- 172.21.15.6:0/1863461545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dd00c7840 0x7f4dd0159670 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009910 tx=0x7f4dc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c2037ef9dfbe5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.864+0000 7f4dd50f5700 1 -- 172.21.15.6:0/1863461545 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc400b820 con 0x7f4dd00c7840 2023-10-06T02:23:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.864+0000 7f4dd50f5700 1 -- 172.21.15.6:0/1863461545 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc400b980 con 0x7f4dd00c7840 2023-10-06T02:23:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.864+0000 7f4dd50f5700 1 -- 172.21.15.6:0/1863461545 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc400bd20 con 0x7f4dd00c7840 2023-10-06T02:23:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.864+0000 7f4dd835b700 1 -- 172.21.15.6:0/1863461545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dd00c7840 msgr2=0x7f4dd0159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.864+0000 7f4dd835b700 1 --2- 172.21.15.6:0/1863461545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dd00c7840 0x7f4dd0159670 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009910 tx=0x7f4dc40091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.865+0000 7f4dd835b700 1 -- 172.21.15.6:0/1863461545 shutdown_connections 2023-10-06T02:23:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.865+0000 7f4dd835b700 1 --2- 172.21.15.6:0/1863461545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dd00c7840 0x7f4dd0159670 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.865+0000 7f4dd835b700 1 -- 172.21.15.6:0/1863461545 >> 172.21.15.6:0/1863461545 conn(0x7f4dd00c9cc0 msgr2=0x7f4dd006acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.865+0000 7f4dd835b700 1 -- 172.21.15.6:0/1863461545 shutdown_connections 2023-10-06T02:23:39.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.865+0000 7f4dd835b700 1 -- 172.21.15.6:0/1863461545 wait complete. 2023-10-06T02:23:39.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.866+0000 7f4dd835b700 1 Processor -- start 2023-10-06T02:23:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.866+0000 7f4dd835b700 1 -- start start 2023-10-06T02:23:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.866+0000 7f4dd835b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dd006c460 0x7f4dd01472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.866+0000 7f4dd835b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4dd006c830 0x7f4dd00c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.866+0000 7f4dd835b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dd00c7840 0x7f4dd0159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.866+0000 7f4dd835b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd0147800 con 0x7f4dd00c7840 2023-10-06T02:23:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.866+0000 7f4dd835b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd0158ed0 con 0x7f4dd006c460 2023-10-06T02:23:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.866+0000 7f4dd835b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd0159170 con 0x7f4dd006c830 2023-10-06T02:23:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.867+0000 7f4dd68f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dd00c7840 0x7f4dd0159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.867+0000 7f4dd68f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dd00c7840 0x7f4dd0159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40184/0 (socket says 172.21.15.6:40184) 2023-10-06T02:23:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.867+0000 7f4dd68f8700 1 -- 172.21.15.6:0/1232972317 learned_addr learned my addr 172.21.15.6:0/1232972317 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.867+0000 7f4dd60f7700 1 --2- 172.21.15.6:0/1232972317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dd006c460 0x7f4dd01472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.867+0000 7f4dd58f6700 1 --2- 172.21.15.6:0/1232972317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4dd006c830 0x7f4dd00c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.867+0000 7f4dd68f8700 1 -- 172.21.15.6:0/1232972317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4dd006c830 msgr2=0x7f4dd00c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.867+0000 7f4dd68f8700 1 --2- 172.21.15.6:0/1232972317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4dd006c830 0x7f4dd00c5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.867+0000 7f4dd68f8700 1 -- 172.21.15.6:0/1232972317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dd006c460 msgr2=0x7f4dd01472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.867+0000 7f4dd68f8700 1 --2- 172.21.15.6:0/1232972317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dd006c460 0x7f4dd01472c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.867+0000 7f4dd68f8700 1 -- 172.21.15.6:0/1232972317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc4009420 con 0x7f4dd00c7840 2023-10-06T02:23:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.867+0000 7f4dd68f8700 1 --2- 172.21.15.6:0/1232972317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dd00c7840 0x7f4dd0159f30 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000cc90 tx=0x7f4dc0001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.867+0000 7f4dce7fc700 1 -- 172.21.15.6:0/1232972317 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000a8b0 con 0x7f4dd00c7840 2023-10-06T02:23:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.867+0000 7f4dce7fc700 1 -- 172.21.15.6:0/1232972317 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc000aa10 con 0x7f4dd00c7840 2023-10-06T02:23:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.867+0000 7f4dd835b700 1 -- 172.21.15.6:0/1232972317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd0159450 con 0x7f4dd00c7840 2023-10-06T02:23:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.867+0000 7f4dce7fc700 1 -- 172.21.15.6:0/1232972317 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000add0 con 0x7f4dd00c7840 2023-10-06T02:23:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.867+0000 7f4dd835b700 1 -- 172.21.15.6:0/1232972317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd0159a10 con 0x7f4dd00c7840 2023-10-06T02:23:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.868+0000 7f4dd835b700 1 -- 172.21.15.6:0/1232972317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd006e140 con 0x7f4dd00c7840 2023-10-06T02:23:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.869+0000 7f4dce7fc700 1 -- 172.21.15.6:0/1232972317 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4dc0007300 con 0x7f4dd00c7840 2023-10-06T02:23:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.869+0000 7f4dce7fc700 1 --2- 172.21.15.6:0/1232972317 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4dbc066f30 0x7f4dbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.869+0000 7f4dce7fc700 1 -- 172.21.15.6:0/1232972317 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4dc0084ab0 con 0x7f4dd00c7840 2023-10-06T02:23:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.869+0000 7f4dd60f7700 1 --2- 172.21.15.6:0/1232972317 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4dbc066f30 0x7f4dbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.870+0000 7f4dd60f7700 1 --2- 172.21.15.6:0/1232972317 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4dbc066f30 0x7f4dbc0693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8003a80 tx=0x7f4dc8007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:39.873+0000 7f4dce7fc700 1 -- 172.21.15.6:0/1232972317 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4dc0051b00 con 0x7f4dd00c7840 2023-10-06T02:23:40.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:40.116+0000 7f4dd835b700 1 -- 172.21.15.6:0/1232972317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4dd00c8830 con 0x7f4dd00c7840 2023-10-06T02:23:41.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.035+0000 7f4dce7fc700 1 -- 172.21.15.6:0/1232972317 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v69) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4dc0055120 con 0x7f4dd00c7840 2023-10-06T02:23:41.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.038+0000 7f4dd835b700 1 -- 172.21.15.6:0/1232972317 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4dbc066f30 msgr2=0x7f4dbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:41.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.038+0000 7f4dd835b700 1 --2- 172.21.15.6:0/1232972317 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4dbc066f30 0x7f4dbc0693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8003a80 tx=0x7f4dc8007ec0 comp rx=0 tx=0).stop 2023-10-06T02:23:41.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.038+0000 7f4dd835b700 1 -- 172.21.15.6:0/1232972317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dd00c7840 msgr2=0x7f4dd0159f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:41.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.038+0000 7f4dd835b700 1 --2- 172.21.15.6:0/1232972317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dd00c7840 0x7f4dd0159f30 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000cc90 tx=0x7f4dc0001a80 comp rx=0 tx=0).stop 2023-10-06T02:23:41.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.038+0000 7f4dd835b700 1 -- 172.21.15.6:0/1232972317 shutdown_connections 2023-10-06T02:23:41.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.038+0000 7f4dd835b700 1 --2- 172.21.15.6:0/1232972317 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4dbc066f30 0x7f4dbc0693e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:41.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.038+0000 7f4dd835b700 1 --2- 172.21.15.6:0/1232972317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dd00c7840 0x7f4dd0159f30 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:41.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.038+0000 7f4dd835b700 1 --2- 172.21.15.6:0/1232972317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dd006c460 0x7f4dd01472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:41.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.038+0000 7f4dd835b700 1 --2- 172.21.15.6:0/1232972317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4dd006c830 0x7f4dd00c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:41.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.038+0000 7f4dd835b700 1 -- 172.21.15.6:0/1232972317 >> 172.21.15.6:0/1232972317 conn(0x7f4dd00c9cc0 msgr2=0x7f4dd006acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:41.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.038+0000 7f4dd835b700 1 -- 172.21.15.6:0/1232972317 shutdown_connections 2023-10-06T02:23:41.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.038+0000 7f4dd835b700 1 -- 172.21.15.6:0/1232972317 wait complete. 2023-10-06T02:23:41.053 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:23:41.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.181+0000 7fcb688dc700 1 Processor -- start 2023-10-06T02:23:41.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.181+0000 7fcb688dc700 1 -- start start 2023-10-06T02:23:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.182+0000 7fcb688dc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcb640a8d90 0x7fcb640af200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.182+0000 7fcb688dc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb640b3820 0x7fcb64069790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.182+0000 7fcb688dc700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6406b030 con 0x7fcb640a89c0 2023-10-06T02:23:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.182+0000 7fcb688dc700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb640b1ab0 con 0x7fcb640a8d90 2023-10-06T02:23:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.182+0000 7fcb688dc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6406ad50 con 0x7fcb640b3820 2023-10-06T02:23:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.182+0000 7fcb62d9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb640b3820 0x7fcb64069790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.182+0000 7fcb61d9b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcb640a8d90 0x7fcb640af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.182+0000 7fcb62d9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb640b3820 0x7fcb64069790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:41804/0 (socket says 172.21.15.6:41804) 2023-10-06T02:23:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.182+0000 7fcb62d9d700 1 -- 172.21.15.6:0/1815535621 learned_addr learned my addr 172.21.15.6:0/1815535621 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.182+0000 7fcb6259c700 1 --1- 172.21.15.6:0/1815535621 >> v1:172.21.15.175:6789/0 conn(0x7fcb640a89c0 0x7fcb640aeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:53610/0 (socket says 172.21.15.6:53610) 2023-10-06T02:23:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.182+0000 7fcb6159a700 1 -- 172.21.15.6:0/1815535621 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922402032 0 0) 0x7fcb6406b030 con 0x7fcb640a89c0 2023-10-06T02:23:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.182+0000 7fcb6159a700 1 -- 172.21.15.6:0/1815535621 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb50003570 con 0x7fcb640a89c0 2023-10-06T02:23:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.182+0000 7fcb61d9b700 1 -- 172.21.15.6:0/1815535621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb640b3820 msgr2=0x7fcb64069790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.182+0000 7fcb61d9b700 1 --2- 172.21.15.6:0/1815535621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb640b3820 0x7fcb64069790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.182+0000 7fcb61d9b700 1 -- 172.21.15.6:0/1815535621 >> v1:172.21.15.175:6789/0 conn(0x7fcb640a89c0 legacy=0x7fcb640aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.182+0000 7fcb61d9b700 1 -- 172.21.15.6:0/1815535621 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb640b1d30 con 0x7fcb640a8d90 2023-10-06T02:23:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.182+0000 7fcb62d9d700 1 --2- 172.21.15.6:0/1815535621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb640b3820 0x7fcb64069790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.183+0000 7fcb61d9b700 1 --2- 172.21.15.6:0/1815535621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb640a8d90 0x7fcb640af200 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0098e0 tx=0x7fcb4c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0bfa10406cc493c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.183+0000 7fcb6159a700 1 -- 172.21.15.6:0/1815535621 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c011630 con 0x7fcb640a8d90 2023-10-06T02:23:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.183+0000 7fcb6159a700 1 -- 172.21.15.6:0/1815535621 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c011790 con 0x7fcb640a8d90 2023-10-06T02:23:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.183+0000 7fcb6159a700 1 -- 172.21.15.6:0/1815535621 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c011b30 con 0x7fcb640a8d90 2023-10-06T02:23:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.183+0000 7fcb688dc700 1 -- 172.21.15.6:0/1815535621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb640a8d90 msgr2=0x7fcb640af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.183+0000 7fcb688dc700 1 --2- 172.21.15.6:0/1815535621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb640a8d90 0x7fcb640af200 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0098e0 tx=0x7fcb4c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.183+0000 7fcb688dc700 1 -- 172.21.15.6:0/1815535621 shutdown_connections 2023-10-06T02:23:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.183+0000 7fcb688dc700 1 --2- 172.21.15.6:0/1815535621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb640b3820 0x7fcb64069790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.183+0000 7fcb688dc700 1 --2- 172.21.15.6:0/1815535621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb640a8d90 0x7fcb640af200 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.183+0000 7fcb688dc700 1 -- 172.21.15.6:0/1815535621 >> 172.21.15.6:0/1815535621 conn(0x7fcb64067910 msgr2=0x7fcb640ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.183+0000 7fcb688dc700 1 -- 172.21.15.6:0/1815535621 shutdown_connections 2023-10-06T02:23:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.183+0000 7fcb688dc700 1 -- 172.21.15.6:0/1815535621 wait complete. 2023-10-06T02:23:41.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.184+0000 7fcb688dc700 1 Processor -- start 2023-10-06T02:23:41.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.184+0000 7fcb688dc700 1 -- start start 2023-10-06T02:23:41.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.185+0000 7fcb688dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb640a89c0 0x7fcb64159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:41.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.185+0000 7fcb688dc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb640a8d90 0x7fcb6415f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:41.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.185+0000 7fcb688dc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb640b3820 0x7fcb640699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:41.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.185+0000 7fcb688dc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6415f620 con 0x7fcb640a89c0 2023-10-06T02:23:41.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.185+0000 7fcb688dc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6415a580 con 0x7fcb640b3820 2023-10-06T02:23:41.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.185+0000 7fcb688dc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6415a860 con 0x7fcb640a8d90 2023-10-06T02:23:41.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.185+0000 7fcb6259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb640a89c0 0x7fcb64159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:41.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.185+0000 7fcb6259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb640a89c0 0x7fcb64159f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40200/0 (socket says 172.21.15.6:40200) 2023-10-06T02:23:41.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.185+0000 7fcb6259c700 1 -- 172.21.15.6:0/2853217213 learned_addr learned my addr 172.21.15.6:0/2853217213 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:41.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.185+0000 7fcb62d9d700 1 --2- 172.21.15.6:0/2853217213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb640b3820 0x7fcb640699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:41.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.185+0000 7fcb61d9b700 1 --2- 172.21.15.6:0/2853217213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb640a8d90 0x7fcb6415f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:41.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.186+0000 7fcb6259c700 1 -- 172.21.15.6:0/2853217213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb640a8d90 msgr2=0x7fcb6415f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:41.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.186+0000 7fcb6259c700 1 --2- 172.21.15.6:0/2853217213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb640a8d90 0x7fcb6415f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:41.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.186+0000 7fcb6259c700 1 -- 172.21.15.6:0/2853217213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb640b3820 msgr2=0x7fcb640699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:41.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.186+0000 7fcb6259c700 1 --2- 172.21.15.6:0/2853217213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb640b3820 0x7fcb640699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:41.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.186+0000 7fcb6259c700 1 -- 172.21.15.6:0/2853217213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb54009ae0 con 0x7fcb640a89c0 2023-10-06T02:23:41.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.186+0000 7fcb6259c700 1 --2- 172.21.15.6:0/2853217213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb640a89c0 0x7fcb64159f10 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00c790 tx=0x7fcb5c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:41.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.186+0000 7fcb5a7fc700 1 -- 172.21.15.6:0/2853217213 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c005ac0 con 0x7fcb640a89c0 2023-10-06T02:23:41.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.186+0000 7fcb5a7fc700 1 -- 172.21.15.6:0/2853217213 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c005c20 con 0x7fcb640a89c0 2023-10-06T02:23:41.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.186+0000 7fcb688dc700 1 -- 172.21.15.6:0/2853217213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4c009420 con 0x7fcb640a89c0 2023-10-06T02:23:41.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.186+0000 7fcb5a7fc700 1 -- 172.21.15.6:0/2853217213 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0070d0 con 0x7fcb640a89c0 2023-10-06T02:23:41.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.186+0000 7fcb688dc700 1 -- 172.21.15.6:0/2853217213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6415aea0 con 0x7fcb640a89c0 2023-10-06T02:23:41.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.187+0000 7fcb688dc700 1 -- 172.21.15.6:0/2853217213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb64087170 con 0x7fcb640a89c0 2023-10-06T02:23:41.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.187+0000 7fcb5a7fc700 1 -- 172.21.15.6:0/2853217213 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb5c007440 con 0x7fcb640a89c0 2023-10-06T02:23:41.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.188+0000 7fcb5a7fc700 1 --2- 172.21.15.6:0/2853217213 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb44066f30 0x7fcb440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:41.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.188+0000 7fcb5a7fc700 1 -- 172.21.15.6:0/2853217213 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcb5c083b00 con 0x7fcb640a89c0 2023-10-06T02:23:41.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.188+0000 7fcb61d9b700 1 --2- 172.21.15.6:0/2853217213 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb44066f30 0x7fcb440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:41.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.189+0000 7fcb61d9b700 1 --2- 172.21.15.6:0/2853217213 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb44066f30 0x7fcb440693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0098e0 tx=0x7fcb4c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.192+0000 7fcb5a7fc700 1 -- 172.21.15.6:0/2853217213 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb5c04b5a0 con 0x7fcb640a89c0 2023-10-06T02:23:41.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:41.434+0000 7fcb688dc700 1 -- 172.21.15.6:0/2853217213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcb640b2010 con 0x7fcb640a89c0 2023-10-06T02:23:42.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.037+0000 7fcb5a7fc700 1 -- 172.21.15.6:0/2853217213 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcb5c050b80 con 0x7fcb640a89c0 2023-10-06T02:23:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.040+0000 7fcb688dc700 1 -- 172.21.15.6:0/2853217213 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb44066f30 msgr2=0x7fcb440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.040+0000 7fcb688dc700 1 --2- 172.21.15.6:0/2853217213 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb44066f30 0x7fcb440693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0098e0 tx=0x7fcb4c017000 comp rx=0 tx=0).stop 2023-10-06T02:23:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.040+0000 7fcb688dc700 1 -- 172.21.15.6:0/2853217213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb640a89c0 msgr2=0x7fcb64159f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.040+0000 7fcb688dc700 1 --2- 172.21.15.6:0/2853217213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb640a89c0 0x7fcb64159f10 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00c790 tx=0x7fcb5c007df0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.040+0000 7fcb688dc700 1 -- 172.21.15.6:0/2853217213 shutdown_connections 2023-10-06T02:23:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.040+0000 7fcb688dc700 1 --2- 172.21.15.6:0/2853217213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb640b3820 0x7fcb640699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.040+0000 7fcb688dc700 1 --2- 172.21.15.6:0/2853217213 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb44066f30 0x7fcb440693e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.040+0000 7fcb688dc700 1 --2- 172.21.15.6:0/2853217213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb640a89c0 0x7fcb64159f10 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.040+0000 7fcb688dc700 1 --2- 172.21.15.6:0/2853217213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb640a8d90 0x7fcb6415f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.040+0000 7fcb688dc700 1 -- 172.21.15.6:0/2853217213 >> 172.21.15.6:0/2853217213 conn(0x7fcb64067910 msgr2=0x7fcb640afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.040+0000 7fcb688dc700 1 -- 172.21.15.6:0/2853217213 shutdown_connections 2023-10-06T02:23:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.040+0000 7fcb688dc700 1 -- 172.21.15.6:0/2853217213 wait complete. 2023-10-06T02:23:42.054 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:42.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.178+0000 7f40d6b8b700 1 Processor -- start 2023-10-06T02:23:42.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.178+0000 7f40d6b8b700 1 -- start start 2023-10-06T02:23:42.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.178+0000 7f40d6b8b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40d00af4e0 0x7f40d00b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.178+0000 7f40d6b8b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f40d015db70 0x7f40d00b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.178+0000 7f40d6b8b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d015e190 con 0x7f40d00af8b0 2023-10-06T02:23:42.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.178+0000 7f40d6b8b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d00b1910 con 0x7f40d00af4e0 2023-10-06T02:23:42.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.178+0000 7f40d6b8b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d015dfa0 con 0x7f40d015db70 2023-10-06T02:23:42.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.179+0000 7f40d4927700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40d00af4e0 0x7f40d00b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.179+0000 7f40cffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f40d00af8b0 0x7f40d015d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36416/0 (socket says 172.21.15.6:36416) 2023-10-06T02:23:42.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.179+0000 7f40cffff700 1 -- 172.21.15.6:0/2527108508 learned_addr learned my addr 172.21.15.6:0/2527108508 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:42.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.179+0000 7f40d5128700 1 --2- 172.21.15.6:0/2527108508 >> v2:172.21.15.175:3300/0 conn(0x7f40d015db70 0x7f40d00b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.179+0000 7f40d4927700 1 -- 172.21.15.6:0/2527108508 >> v2:172.21.15.175:3300/0 conn(0x7f40d015db70 msgr2=0x7f40d00b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:42.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.179+0000 7f40d4927700 1 --2- 172.21.15.6:0/2527108508 >> v2:172.21.15.175:3300/0 conn(0x7f40d015db70 0x7f40d00b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.179+0000 7f40d4927700 1 -- 172.21.15.6:0/2527108508 >> v1:172.21.15.6:6789/0 conn(0x7f40d00af8b0 legacy=0x7f40d015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:42.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.179+0000 7f40d4927700 1 -- 172.21.15.6:0/2527108508 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d00cb650 con 0x7f40d00af4e0 2023-10-06T02:23:42.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.179+0000 7f40cf7fe700 1 -- 172.21.15.6:0/2527108508 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683873014 0 0) 0x7f40d015e190 con 0x7f40d00af8b0 2023-10-06T02:23:42.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.179+0000 7f40d4927700 1 --2- 172.21.15.6:0/2527108508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00af4e0 0x7f40d00b20e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f40d00c7280 tx=0x7f40c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03f8880553aad28 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:42.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.179+0000 7f40cf7fe700 1 -- 172.21.15.6:0/2527108508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c800e070 con 0x7f40d00af4e0 2023-10-06T02:23:42.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.179+0000 7f40cf7fe700 1 -- 172.21.15.6:0/2527108508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c800bc30 con 0x7f40d00af4e0 2023-10-06T02:23:42.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.179+0000 7f40cf7fe700 1 -- 172.21.15.6:0/2527108508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8012430 con 0x7f40d00af4e0 2023-10-06T02:23:42.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.180+0000 7f40d6b8b700 1 -- 172.21.15.6:0/2527108508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00af4e0 msgr2=0x7f40d00b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:42.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.180+0000 7f40d6b8b700 1 --2- 172.21.15.6:0/2527108508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00af4e0 0x7f40d00b20e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f40d00c7280 tx=0x7f40c8009780 comp rx=0 tx=0).stop 2023-10-06T02:23:42.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.180+0000 7f40d6b8b700 1 -- 172.21.15.6:0/2527108508 shutdown_connections 2023-10-06T02:23:42.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.180+0000 7f40d6b8b700 1 --2- 172.21.15.6:0/2527108508 >> v2:172.21.15.175:3300/0 conn(0x7f40d015db70 0x7f40d00b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.180+0000 7f40d6b8b700 1 --2- 172.21.15.6:0/2527108508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00af4e0 0x7f40d00b20e0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.180+0000 7f40d6b8b700 1 -- 172.21.15.6:0/2527108508 >> 172.21.15.6:0/2527108508 conn(0x7f40d0068680 msgr2=0x7f40d0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:42.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.180+0000 7f40d6b8b700 1 -- 172.21.15.6:0/2527108508 shutdown_connections 2023-10-06T02:23:42.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.180+0000 7f40d6b8b700 1 -- 172.21.15.6:0/2527108508 wait complete. 2023-10-06T02:23:42.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.181+0000 7f40d6b8b700 1 Processor -- start 2023-10-06T02:23:42.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.181+0000 7f40d6b8b700 1 -- start start 2023-10-06T02:23:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40d6b8b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00af4e0 0x7f40d00c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40d6b8b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40d00af8b0 0x7f40d016d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40d6b8b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40d015db70 0x7f40d016db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40d6b8b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00cf090 con 0x7f40d00af4e0 2023-10-06T02:23:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40d6b8b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00c8e90 con 0x7f40d015db70 2023-10-06T02:23:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40d6b8b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00c85f0 con 0x7f40d00af8b0 2023-10-06T02:23:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40d4927700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00af4e0 0x7f40d00c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40d4927700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00af4e0 0x7f40d00c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40210/0 (socket says 172.21.15.6:40210) 2023-10-06T02:23:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40d4927700 1 -- 172.21.15.6:0/161211322 learned_addr learned my addr 172.21.15.6:0/161211322 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40d5128700 1 --2- 172.21.15.6:0/161211322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40d015db70 0x7f40d016db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40cffff700 1 --2- 172.21.15.6:0/161211322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40d00af8b0 0x7f40d016d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40d4927700 1 -- 172.21.15.6:0/161211322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40d00af8b0 msgr2=0x7f40d016d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:42.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40d4927700 1 --2- 172.21.15.6:0/161211322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40d00af8b0 0x7f40d016d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40d4927700 1 -- 172.21.15.6:0/161211322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40d015db70 msgr2=0x7f40d016db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:42.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40d4927700 1 --2- 172.21.15.6:0/161211322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40d015db70 0x7f40d016db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40d4927700 1 -- 172.21.15.6:0/161211322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c8009a20 con 0x7f40d00af4e0 2023-10-06T02:23:42.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40cffff700 1 --2- 172.21.15.6:0/161211322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40d00af8b0 0x7f40d016d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:42.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.182+0000 7f40d4927700 1 --2- 172.21.15.6:0/161211322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00af4e0 0x7f40d00c9ac0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f40c8013000 tx=0x7f40c8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:42.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.183+0000 7f40ccff9700 1 -- 172.21.15.6:0/161211322 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8027470 con 0x7f40d00af4e0 2023-10-06T02:23:42.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.183+0000 7f40ccff9700 1 -- 172.21.15.6:0/161211322 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c80275f0 con 0x7f40d00af4e0 2023-10-06T02:23:42.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.183+0000 7f40d6b8b700 1 -- 172.21.15.6:0/161211322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d00c88d0 con 0x7f40d00af4e0 2023-10-06T02:23:42.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.183+0000 7f40ccff9700 1 -- 172.21.15.6:0/161211322 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c80279b0 con 0x7f40d00af4e0 2023-10-06T02:23:42.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.183+0000 7f40d6b8b700 1 -- 172.21.15.6:0/161211322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d00ca000 con 0x7f40d00af4e0 2023-10-06T02:23:42.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.184+0000 7f40d6b8b700 1 -- 172.21.15.6:0/161211322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d00ca220 con 0x7f40d00af4e0 2023-10-06T02:23:42.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.184+0000 7f40ccff9700 1 -- 172.21.15.6:0/161211322 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40c8024070 con 0x7f40d00af4e0 2023-10-06T02:23:42.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.184+0000 7f40ccff9700 1 --2- 172.21.15.6:0/161211322 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f40b0066f30 0x7f40b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.185+0000 7f40ccff9700 1 -- 172.21.15.6:0/161211322 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f40c8086e40 con 0x7f40d00af4e0 2023-10-06T02:23:42.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.185+0000 7f40cffff700 1 --2- 172.21.15.6:0/161211322 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f40b0066f30 0x7f40b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.185+0000 7f40cffff700 1 --2- 172.21.15.6:0/161211322 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f40b0066f30 0x7f40b00693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f40d00c6d60 tx=0x7f40c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:42.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.189+0000 7f40ccff9700 1 -- 172.21.15.6:0/161211322 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40c8053e10 con 0x7f40d00af4e0 2023-10-06T02:23:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.431+0000 7f40d6b8b700 1 -- 172.21.15.6:0/161211322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40d0068ef0 con 0x7f40d00af4e0 2023-10-06T02:23:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.431+0000 7f40ccff9700 1 -- 172.21.15.6:0/161211322 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f40c802c090 con 0x7f40d00af4e0 2023-10-06T02:23:42.432 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:42.432 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2575759355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2575759355},{"type":"v1","addr":"172.21.15.175:6836","nonce":2575759355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2523304335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2523304335},{"type":"v1","addr":"172.21.15.175:6837","nonce":2523304335}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":6786,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/353268974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":353268974},{"type":"v1","addr":"172.21.15.6:6834","nonce":353268974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:38.399768+0000","modified":"2023-10-06T02:23:42.035051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6789":{"gid":6789,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1625434310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1625434310},{"type":"v1","addr":"172.21.15.6:6835","nonce":1625434310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:23:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.433+0000 7f40d6b8b700 1 -- 172.21.15.6:0/161211322 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f40b0066f30 msgr2=0x7f40b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.433+0000 7f40d6b8b700 1 --2- 172.21.15.6:0/161211322 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f40b0066f30 0x7f40b00693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f40d00c6d60 tx=0x7f40c0009040 comp rx=0 tx=0).stop 2023-10-06T02:23:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.433+0000 7f40d6b8b700 1 -- 172.21.15.6:0/161211322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00af4e0 msgr2=0x7f40d00c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.433+0000 7f40d6b8b700 1 --2- 172.21.15.6:0/161211322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00af4e0 0x7f40d00c9ac0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f40c8013000 tx=0x7f40c8019000 comp rx=0 tx=0).stop 2023-10-06T02:23:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.433+0000 7f40d6b8b700 1 -- 172.21.15.6:0/161211322 shutdown_connections 2023-10-06T02:23:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.433+0000 7f40d6b8b700 1 --2- 172.21.15.6:0/161211322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40d015db70 0x7f40d016db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.433+0000 7f40d6b8b700 1 --2- 172.21.15.6:0/161211322 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f40b0066f30 0x7f40b00693e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.433+0000 7f40d6b8b700 1 --2- 172.21.15.6:0/161211322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00af4e0 0x7f40d00c9ac0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.433+0000 7f40d6b8b700 1 --2- 172.21.15.6:0/161211322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40d00af8b0 0x7f40d016d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.433+0000 7f40d6b8b700 1 -- 172.21.15.6:0/161211322 >> 172.21.15.6:0/161211322 conn(0x7f40d0068680 msgr2=0x7f40d00b54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.433+0000 7f40d6b8b700 1 -- 172.21.15.6:0/161211322 shutdown_connections 2023-10-06T02:23:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.433+0000 7f40d6b8b700 1 -- 172.21.15.6:0/161211322 wait complete. 2023-10-06T02:23:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 70 2023-10-06T02:23:42.446 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:42.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.565+0000 7f6ebf59e700 1 Processor -- start 2023-10-06T02:23:42.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.565+0000 7f6ebf59e700 1 -- start start 2023-10-06T02:23:42.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.566+0000 7f6ebf59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ec0159400 0x7f6ec00ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.566+0000 7f6ebf59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ec00cd030 0x7f6ec00cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.566+0000 7f6ebf59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec00b3560 con 0x7f6ec00cf1a0 2023-10-06T02:23:42.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.566+0000 7f6ebf59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec00cf6f0 con 0x7f6ec0159400 2023-10-06T02:23:42.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.566+0000 7f6ebf59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec00cf9d0 con 0x7f6ec00cd030 2023-10-06T02:23:42.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.566+0000 7f6ebe59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ec0159400 0x7f6ec00ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.566+0000 7f6ebed9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6ec00cf1a0 0x7f6ec00b5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36432/0 (socket says 172.21.15.6:36432) 2023-10-06T02:23:42.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.566+0000 7f6ebed9d700 1 -- 172.21.15.6:0/3504677668 learned_addr learned my addr 172.21.15.6:0/3504677668 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.566+0000 7f6ebdd9b700 1 --2- 172.21.15.6:0/3504677668 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ec00cd030 0x7f6ec00cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.566+0000 7f6ebe59c700 1 -- 172.21.15.6:0/3504677668 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ec00cd030 msgr2=0x7f6ec00cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.566+0000 7f6ebe59c700 1 --2- 172.21.15.6:0/3504677668 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ec00cd030 0x7f6ec00cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.566+0000 7f6ebe59c700 1 -- 172.21.15.6:0/3504677668 >> v1:172.21.15.6:6789/0 conn(0x7f6ec00cf1a0 legacy=0x7f6ec00b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.566+0000 7f6ebe59c700 1 -- 172.21.15.6:0/3504677668 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec00b2f10 con 0x7f6ec0159400 2023-10-06T02:23:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.566+0000 7f6ebd59a700 1 -- 172.21.15.6:0/3504677668 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2385888789 0 0) 0x7f6ec00b3560 con 0x7f6ec00cf1a0 2023-10-06T02:23:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.566+0000 7f6ebdd9b700 1 --2- 172.21.15.6:0/3504677668 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ec00cd030 0x7f6ec00cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.567+0000 7f6ebe59c700 1 --2- 172.21.15.6:0/3504677668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec0159400 0x7f6ec00ccaf0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009eb0 tx=0x7f6eb0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19cfb23a3e3dd08a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.567+0000 7f6ebd59a700 1 -- 172.21.15.6:0/3504677668 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb000e070 con 0x7f6ec0159400 2023-10-06T02:23:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.567+0000 7f6ebd59a700 1 -- 172.21.15.6:0/3504677668 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb000bc30 con 0x7f6ec0159400 2023-10-06T02:23:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.567+0000 7f6ebd59a700 1 -- 172.21.15.6:0/3504677668 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0012430 con 0x7f6ec0159400 2023-10-06T02:23:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.567+0000 7f6ebf59e700 1 -- 172.21.15.6:0/3504677668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec0159400 msgr2=0x7f6ec00ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.567+0000 7f6ebf59e700 1 --2- 172.21.15.6:0/3504677668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec0159400 0x7f6ec00ccaf0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009eb0 tx=0x7f6eb0009780 comp rx=0 tx=0).stop 2023-10-06T02:23:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.567+0000 7f6ebf59e700 1 -- 172.21.15.6:0/3504677668 shutdown_connections 2023-10-06T02:23:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.567+0000 7f6ebf59e700 1 --2- 172.21.15.6:0/3504677668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec0159400 0x7f6ec00ccaf0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.567+0000 7f6ebf59e700 1 --2- 172.21.15.6:0/3504677668 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ec00cd030 0x7f6ec00cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.567+0000 7f6ebf59e700 1 -- 172.21.15.6:0/3504677668 >> 172.21.15.6:0/3504677668 conn(0x7f6ec006ac10 msgr2=0x7f6ec0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.567+0000 7f6ebf59e700 1 -- 172.21.15.6:0/3504677668 shutdown_connections 2023-10-06T02:23:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.567+0000 7f6ebf59e700 1 -- 172.21.15.6:0/3504677668 wait complete. 2023-10-06T02:23:42.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.568+0000 7f6ebf59e700 1 Processor -- start 2023-10-06T02:23:42.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.569+0000 7f6ebf59e700 1 -- start start 2023-10-06T02:23:42.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.569+0000 7f6ebf59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec00cd030 0x7f6ec0158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.569+0000 7f6ebf59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ec00cf1a0 0x7f6ec0141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.569+0000 7f6ebf59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec0159400 0x7f6ec00b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.569+0000 7f6ebf59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec0158bc0 con 0x7f6ec0159400 2023-10-06T02:23:42.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.569+0000 7f6ebf59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec01512f0 con 0x7f6ec00cd030 2023-10-06T02:23:42.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.569+0000 7f6ebf59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec01515d0 con 0x7f6ec00cf1a0 2023-10-06T02:23:42.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.569+0000 7f6ebed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec0159400 0x7f6ec00b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.569+0000 7f6ebed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec0159400 0x7f6ec00b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40222/0 (socket says 172.21.15.6:40222) 2023-10-06T02:23:42.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.569+0000 7f6ebed9d700 1 -- 172.21.15.6:0/493149083 learned_addr learned my addr 172.21.15.6:0/493149083 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:42.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.570+0000 7f6ebdd9b700 1 --2- 172.21.15.6:0/493149083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ec00cf1a0 0x7f6ec0141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.570+0000 7f6ebe59c700 1 --2- 172.21.15.6:0/493149083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec00cd030 0x7f6ec0158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.570+0000 7f6ebed9d700 1 -- 172.21.15.6:0/493149083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ec00cf1a0 msgr2=0x7f6ec0141a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:42.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.570+0000 7f6ebed9d700 1 --2- 172.21.15.6:0/493149083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ec00cf1a0 0x7f6ec0141a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.570+0000 7f6ebed9d700 1 -- 172.21.15.6:0/493149083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec00cd030 msgr2=0x7f6ec0158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:42.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.570+0000 7f6ebed9d700 1 --2- 172.21.15.6:0/493149083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec00cd030 0x7f6ec0158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.570+0000 7f6ebed9d700 1 -- 172.21.15.6:0/493149083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb0009a20 con 0x7f6ec0159400 2023-10-06T02:23:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.570+0000 7f6ebe59c700 1 --2- 172.21.15.6:0/493149083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec00cd030 0x7f6ec0158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.570+0000 7f6ebed9d700 1 --2- 172.21.15.6:0/493149083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec0159400 0x7f6ec00b0aa0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800c7e0 tx=0x7f6eb8007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.570+0000 7f6eae7fc700 1 -- 172.21.15.6:0/493149083 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8005c00 con 0x7f6ec0159400 2023-10-06T02:23:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.570+0000 7f6eae7fc700 1 -- 172.21.15.6:0/493149083 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb8005d60 con 0x7f6ec0159400 2023-10-06T02:23:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.570+0000 7f6eae7fc700 1 -- 172.21.15.6:0/493149083 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8004a80 con 0x7f6ec0159400 2023-10-06T02:23:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.570+0000 7f6ebf59e700 1 -- 172.21.15.6:0/493149083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec01518b0 con 0x7f6ec0159400 2023-10-06T02:23:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.570+0000 7f6ebf59e700 1 -- 172.21.15.6:0/493149083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec0151e70 con 0x7f6ec0159400 2023-10-06T02:23:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.571+0000 7f6ebf59e700 1 -- 172.21.15.6:0/493149083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec0159860 con 0x7f6ec0159400 2023-10-06T02:23:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.571+0000 7f6eae7fc700 1 -- 172.21.15.6:0/493149083 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6eb8005030 con 0x7f6ec0159400 2023-10-06T02:23:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.572+0000 7f6eae7fc700 1 --2- 172.21.15.6:0/493149083 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6ea0066f30 0x7f6ea00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.572+0000 7f6eae7fc700 1 -- 172.21.15.6:0/493149083 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6eb8083c40 con 0x7f6ec0159400 2023-10-06T02:23:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.572+0000 7f6ebe59c700 1 --2- 172.21.15.6:0/493149083 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6ea0066f30 0x7f6ea00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.573+0000 7f6ebe59c700 1 --2- 172.21.15.6:0/493149083 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6ea0066f30 0x7f6ea00693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009eb0 tx=0x7f6eb0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.576+0000 7f6eae7fc700 1 -- 172.21.15.6:0/493149083 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6eb804b5a0 con 0x7f6ec0159400 2023-10-06T02:23:42.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.774+0000 7f6ebf59e700 1 -- 172.21.15.6:0/493149083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ec00b31f0 con 0x7f6ec0159400 2023-10-06T02:23:42.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.775+0000 7f6eae7fc700 1 -- 172.21.15.6:0/493149083 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+17026 (secure 0 0 0) 0x7f6eb8050c10 con 0x7f6ec0159400 2023-10-06T02:23:42.776 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:42.776 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":82,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:23:40.010842+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:36.143952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:37.374144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:42.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.777+0000 7f6ebf59e700 1 -- 172.21.15.6:0/493149083 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6ea0066f30 msgr2=0x7f6ea00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:42.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.778+0000 7f6ebf59e700 1 --2- 172.21.15.6:0/493149083 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6ea0066f30 0x7f6ea00693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009eb0 tx=0x7f6eb0017000 comp rx=0 tx=0).stop 2023-10-06T02:23:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.778+0000 7f6ebf59e700 1 -- 172.21.15.6:0/493149083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec0159400 msgr2=0x7f6ec00b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.778+0000 7f6ebf59e700 1 --2- 172.21.15.6:0/493149083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec0159400 0x7f6ec00b0aa0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800c7e0 tx=0x7f6eb8007d90 comp rx=0 tx=0).stop 2023-10-06T02:23:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.778+0000 7f6ebf59e700 1 -- 172.21.15.6:0/493149083 shutdown_connections 2023-10-06T02:23:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.778+0000 7f6ebf59e700 1 --2- 172.21.15.6:0/493149083 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6ea0066f30 0x7f6ea00693e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.778+0000 7f6ebf59e700 1 --2- 172.21.15.6:0/493149083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec0159400 0x7f6ec00b0aa0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.778+0000 7f6ebf59e700 1 --2- 172.21.15.6:0/493149083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec00cd030 0x7f6ec0158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.778+0000 7f6ebf59e700 1 --2- 172.21.15.6:0/493149083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ec00cf1a0 0x7f6ec0141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.778+0000 7f6ebf59e700 1 -- 172.21.15.6:0/493149083 >> 172.21.15.6:0/493149083 conn(0x7f6ec006ac10 msgr2=0x7f6ec015be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.778+0000 7f6ebf59e700 1 -- 172.21.15.6:0/493149083 shutdown_connections 2023-10-06T02:23:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.778+0000 7f6ebf59e700 1 -- 172.21.15.6:0/493149083 wait complete. 2023-10-06T02:23:42.790 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:23:42.791 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:23:42.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.908+0000 7fc4d3fd7700 1 Processor -- start 2023-10-06T02:23:42.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.908+0000 7fc4d3fd7700 1 -- start start 2023-10-06T02:23:42.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.909+0000 7fc4d3fd7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc4cc15b3c0 0x7fc4cc097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.909+0000 7fc4d3fd7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4cc15a590 0x7fc4cc15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.909+0000 7fc4d3fd7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4cc0afb90 con 0x7fc4cc0b3c50 2023-10-06T02:23:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.909+0000 7fc4d3fd7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4cc15aef0 con 0x7fc4cc15b3c0 2023-10-06T02:23:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.909+0000 7fc4d3fd7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc0b2310 con 0x7fc4cc15a590 2023-10-06T02:23:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.909+0000 7fc4d1d73700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc4cc15b3c0 0x7fc4cc097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.909+0000 7fc4d1d73700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc4cc15b3c0 0x7fc4cc097d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40228/0 (socket says 172.21.15.6:40228) 2023-10-06T02:23:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.909+0000 7fc4d1d73700 1 -- 172.21.15.6:0/3439852461 learned_addr learned my addr 172.21.15.6:0/3439852461 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.910+0000 7fc4d2574700 1 --2- 172.21.15.6:0/3439852461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4cc15a590 0x7fc4cc15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.910+0000 7fc4d1d73700 1 -- 172.21.15.6:0/3439852461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4cc15a590 msgr2=0x7fc4cc15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.910+0000 7fc4d1d73700 1 --2- 172.21.15.6:0/3439852461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4cc15a590 0x7fc4cc15a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.910+0000 7fc4d1d73700 1 -- 172.21.15.6:0/3439852461 >> v1:172.21.15.175:6789/0 conn(0x7fc4cc0b3c50 legacy=0x7fc4cc15b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.910+0000 7fc4d1d73700 1 -- 172.21.15.6:0/3439852461 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc0b25f0 con 0x7fc4cc15b3c0 2023-10-06T02:23:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.910+0000 7fc4d2574700 1 --2- 172.21.15.6:0/3439852461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4cc15a590 0x7fc4cc15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.910+0000 7fc4d1d73700 1 --2- 172.21.15.6:0/3439852461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4cc15b3c0 0x7fc4cc097d70 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009f70 tx=0x7fc4c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a54f8b837d6bbe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.910+0000 7fc4d0d71700 1 -- 172.21.15.6:0/3439852461 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c400e070 con 0x7fc4cc15b3c0 2023-10-06T02:23:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.910+0000 7fc4d0d71700 1 -- 172.21.15.6:0/3439852461 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c400ba90 con 0x7fc4cc15b3c0 2023-10-06T02:23:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.910+0000 7fc4d0d71700 1 -- 172.21.15.6:0/3439852461 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c40092e0 con 0x7fc4cc15b3c0 2023-10-06T02:23:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.911+0000 7fc4d3fd7700 1 -- 172.21.15.6:0/3439852461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4cc15b3c0 msgr2=0x7fc4cc097d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.911+0000 7fc4d3fd7700 1 --2- 172.21.15.6:0/3439852461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4cc15b3c0 0x7fc4cc097d70 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009f70 tx=0x7fc4c4009840 comp rx=0 tx=0).stop 2023-10-06T02:23:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.911+0000 7fc4d3fd7700 1 -- 172.21.15.6:0/3439852461 shutdown_connections 2023-10-06T02:23:42.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.911+0000 7fc4d3fd7700 1 --2- 172.21.15.6:0/3439852461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4cc15a590 0x7fc4cc15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.911+0000 7fc4d3fd7700 1 --2- 172.21.15.6:0/3439852461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4cc15b3c0 0x7fc4cc097d70 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.911+0000 7fc4d3fd7700 1 -- 172.21.15.6:0/3439852461 >> 172.21.15.6:0/3439852461 conn(0x7fc4cc067910 msgr2=0x7fc4cc0ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:42.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.911+0000 7fc4d3fd7700 1 -- 172.21.15.6:0/3439852461 shutdown_connections 2023-10-06T02:23:42.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.911+0000 7fc4d3fd7700 1 -- 172.21.15.6:0/3439852461 wait complete. 2023-10-06T02:23:42.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.912+0000 7fc4d3fd7700 1 Processor -- start 2023-10-06T02:23:42.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.912+0000 7fc4d3fd7700 1 -- start start 2023-10-06T02:23:42.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.912+0000 7fc4d3fd7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4cc0b3c50 0x7fc4cc164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.912+0000 7fc4d3fd7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4cc15a590 0x7fc4cc0a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.912+0000 7fc4d3fd7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4cc15b3c0 0x7fc4cc0c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.912+0000 7fc4d3fd7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc155ed0 con 0x7fc4cc0b3c50 2023-10-06T02:23:42.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.912+0000 7fc4d3fd7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc1651e0 con 0x7fc4cc15a590 2023-10-06T02:23:42.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.912+0000 7fc4d3fd7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc0a9a00 con 0x7fc4cc15b3c0 2023-10-06T02:23:42.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.913+0000 7fc4d1d73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4cc0b3c50 0x7fc4cc164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.913+0000 7fc4d1d73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4cc0b3c50 0x7fc4cc164ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40238/0 (socket says 172.21.15.6:40238) 2023-10-06T02:23:42.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.913+0000 7fc4d1d73700 1 -- 172.21.15.6:0/2163799834 learned_addr learned my addr 172.21.15.6:0/2163799834 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:42.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.913+0000 7fc4d1572700 1 --2- 172.21.15.6:0/2163799834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4cc15a590 0x7fc4cc0a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.913+0000 7fc4d2574700 1 --2- 172.21.15.6:0/2163799834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4cc15b3c0 0x7fc4cc0c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.913+0000 7fc4d1d73700 1 -- 172.21.15.6:0/2163799834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4cc15b3c0 msgr2=0x7fc4cc0c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:42.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.913+0000 7fc4d1d73700 1 --2- 172.21.15.6:0/2163799834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4cc15b3c0 0x7fc4cc0c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.913+0000 7fc4d1d73700 1 -- 172.21.15.6:0/2163799834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4cc15a590 msgr2=0x7fc4cc0a8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:42.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.913+0000 7fc4d1d73700 1 --2- 172.21.15.6:0/2163799834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4cc15a590 0x7fc4cc0a8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:42.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.913+0000 7fc4d1d73700 1 -- 172.21.15.6:0/2163799834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c4009ae0 con 0x7fc4cc0b3c50 2023-10-06T02:23:42.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.913+0000 7fc4d1572700 1 --2- 172.21.15.6:0/2163799834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4cc15a590 0x7fc4cc0a8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:42.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.913+0000 7fc4d1d73700 1 --2- 172.21.15.6:0/2163799834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4cc0b3c50 0x7fc4cc164ca0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400b770 tx=0x7fc4c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:42.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.913+0000 7fc4c9ffb700 1 -- 172.21.15.6:0/2163799834 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4012ab0 con 0x7fc4cc0b3c50 2023-10-06T02:23:42.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.913+0000 7fc4c9ffb700 1 -- 172.21.15.6:0/2163799834 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c4012c10 con 0x7fc4cc0b3c50 2023-10-06T02:23:42.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.913+0000 7fc4d3fd7700 1 -- 172.21.15.6:0/2163799834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4cc0a9ce0 con 0x7fc4cc0b3c50 2023-10-06T02:23:42.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.913+0000 7fc4c9ffb700 1 -- 172.21.15.6:0/2163799834 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c401d420 con 0x7fc4cc0b3c50 2023-10-06T02:23:42.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.913+0000 7fc4d3fd7700 1 -- 172.21.15.6:0/2163799834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4cc0aa2a0 con 0x7fc4cc0b3c50 2023-10-06T02:23:42.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.914+0000 7fc4d3fd7700 1 -- 172.21.15.6:0/2163799834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4cc06e8d0 con 0x7fc4cc0b3c50 2023-10-06T02:23:42.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.915+0000 7fc4c9ffb700 1 -- 172.21.15.6:0/2163799834 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc4c401d850 con 0x7fc4cc0b3c50 2023-10-06T02:23:42.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.915+0000 7fc4c9ffb700 1 --2- 172.21.15.6:0/2163799834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc4b8066f30 0x7fc4b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:42.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.915+0000 7fc4c9ffb700 1 -- 172.21.15.6:0/2163799834 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc4c4086230 con 0x7fc4cc0b3c50 2023-10-06T02:23:42.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.916+0000 7fc4d1572700 1 --2- 172.21.15.6:0/2163799834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc4b8066f30 0x7fc4b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:42.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.916+0000 7fc4d1572700 1 --2- 172.21.15.6:0/2163799834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc4b8066f30 0x7fc4b80693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0006fd0 tx=0x7fc4c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:42.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:42.920+0000 7fc4c9ffb700 1 -- 172.21.15.6:0/2163799834 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4c4053200 con 0x7fc4cc0b3c50 2023-10-06T02:23:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.113+0000 7fc4d3fd7700 1 -- 172.21.15.6:0/2163799834 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4cc0af820 con 0x7fc4b8066f30 2023-10-06T02:23:43.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.122+0000 7fc4c9ffb700 1 -- 172.21.15.6:0/2163799834 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311331 (secure 0 0 0) 0x7fc4cc0af820 con 0x7fc4b8066f30 2023-10-06T02:23:43.126 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:43.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.126+0000 7fc4d3fd7700 1 -- 172.21.15.6:0/2163799834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc4b8066f30 msgr2=0x7fc4b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.126+0000 7fc4d3fd7700 1 --2- 172.21.15.6:0/2163799834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc4b8066f30 0x7fc4b80693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0006fd0 tx=0x7fc4c0008040 comp rx=0 tx=0).stop 2023-10-06T02:23:43.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.126+0000 7fc4d3fd7700 1 -- 172.21.15.6:0/2163799834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4cc0b3c50 msgr2=0x7fc4cc164ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.126+0000 7fc4d3fd7700 1 --2- 172.21.15.6:0/2163799834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4cc0b3c50 0x7fc4cc164ca0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400b770 tx=0x7fc4c4017000 comp rx=0 tx=0).stop 2023-10-06T02:23:43.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.126+0000 7fc4d3fd7700 1 -- 172.21.15.6:0/2163799834 shutdown_connections 2023-10-06T02:23:43.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.126+0000 7fc4d3fd7700 1 --2- 172.21.15.6:0/2163799834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4cc15b3c0 0x7fc4cc0c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.126+0000 7fc4d3fd7700 1 --2- 172.21.15.6:0/2163799834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc4b8066f30 0x7fc4b80693e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.126+0000 7fc4d3fd7700 1 --2- 172.21.15.6:0/2163799834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4cc0b3c50 0x7fc4cc164ca0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.126+0000 7fc4d3fd7700 1 --2- 172.21.15.6:0/2163799834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4cc15a590 0x7fc4cc0a8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.126+0000 7fc4d3fd7700 1 -- 172.21.15.6:0/2163799834 >> 172.21.15.6:0/2163799834 conn(0x7fc4cc067910 msgr2=0x7fc4cc158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:43.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.126+0000 7fc4d3fd7700 1 -- 172.21.15.6:0/2163799834 shutdown_connections 2023-10-06T02:23:43.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.126+0000 7fc4d3fd7700 1 -- 172.21.15.6:0/2163799834 wait complete. 2023-10-06T02:23:43.130 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:23:43.138 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2023-10-06T02:23:42.649618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387284,"kb_used_data":8980,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752587436,"statfs":{"total":773094113280,"available":770649534464,"internally_reserved":0,"allocated":9195520,"data_stored":4998171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.660992"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.026897+0000","last_change":"2023-10-06T02:23:39.026897+0000","last_active":"2023-10-06T02:23:39.026897+0000","last_peered":"2023-10-06T02:23:39.026897+0000","last_clean":"2023-10-06T02:23:39.026897+0000","last_became_active":"2023-10-06T02:23:39.026596+0000","last_became_peered":"2023-10-06T02:23:39.026596+0000","last_unstale":"2023-10-06T02:23:39.026897+0000","last_undegraded":"2023-10-06T02:23:39.026897+0000","last_fullsized":"2023-10-06T02:23:39.026897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:45.096265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.035327+0000","last_change":"2023-10-06T02:23:39.023248+0000","last_active":"2023-10-06T02:23:39.035327+0000","last_peered":"2023-10-06T02:23:39.035327+0000","last_clean":"2023-10-06T02:23:39.035327+0000","last_became_active":"2023-10-06T02:23:39.022983+0000","last_became_peered":"2023-10-06T02:23:39.022983+0000","last_unstale":"2023-10-06T02:23:39.035327+0000","last_undegraded":"2023-10-06T02:23:39.035327+0000","last_fullsized":"2023-10-06T02:23:39.035327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:01.296062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.031529+0000","last_change":"2023-10-06T02:23:39.031529+0000","last_active":"2023-10-06T02:23:39.031529+0000","last_peered":"2023-10-06T02:23:39.031529+0000","last_clean":"2023-10-06T02:23:39.031529+0000","last_became_active":"2023-10-06T02:23:39.031268+0000","last_became_peered":"2023-10-06T02:23:39.031268+0000","last_unstale":"2023-10-06T02:23:39.031529+0000","last_undegraded":"2023-10-06T02:23:39.031529+0000","last_fullsized":"2023-10-06T02:23:39.031529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:15.116170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.024171+0000","last_change":"2023-10-06T02:23:39.024171+0000","last_active":"2023-10-06T02:23:39.024171+0000","last_peered":"2023-10-06T02:23:39.024171+0000","last_clean":"2023-10-06T02:23:39.024171+0000","last_became_active":"2023-10-06T02:23:39.023905+0000","last_became_peered":"2023-10-06T02:23:39.023905+0000","last_unstale":"2023-10-06T02:23:39.024171+0000","last_undegraded":"2023-10-06T02:23:39.024171+0000","last_fullsized":"2023-10-06T02:23:39.024171+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:54.386624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.038934+0000","last_change":"2023-10-06T02:23:39.037836+0000","last_active":"2023-10-06T02:23:39.038934+0000","last_peered":"2023-10-06T02:23:39.038934+0000","last_clean":"2023-10-06T02:23:39.038934+0000","last_became_active":"2023-10-06T02:23:39.037559+0000","last_became_peered":"2023-10-06T02:23:39.037559+0000","last_unstale":"2023-10-06T02:23:39.038934+0000","last_undegraded":"2023-10-06T02:23:39.038934+0000","last_fullsized":"2023-10-06T02:23:39.038934+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:33:30.817733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.028220+0000","last_change":"2023-10-06T02:23:39.025148+0000","last_active":"2023-10-06T02:23:39.028220+0000","last_peered":"2023-10-06T02:23:39.028220+0000","last_clean":"2023-10-06T02:23:39.028220+0000","last_became_active":"2023-10-06T02:23:39.024843+0000","last_became_peered":"2023-10-06T02:23:39.024843+0000","last_unstale":"2023-10-06T02:23:39.028220+0000","last_undegraded":"2023-10-06T02:23:39.028220+0000","last_fullsized":"2023-10-06T02:23:39.028220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:27.680925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.027919+0000","last_change":"2023-10-06T02:23:39.027919+0000","last_active":"2023-10-06T02:23:39.027919+0000","last_peered":"2023-10-06T02:23:39.027919+0000","last_clean":"2023-10-06T02:23:39.027919+0000","last_became_active":"2023-10-06T02:23:39.027627+0000","last_became_peered":"2023-10-06T02:23:39.027627+0000","last_unstale":"2023-10-06T02:23:39.027919+0000","last_undegraded":"2023-10-06T02:23:39.027919+0000","last_fullsized":"2023-10-06T02:23:39.027919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:48.852768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034657+0000","last_change":"2023-10-06T02:23:39.030911+0000","last_active":"2023-10-06T02:23:39.034657+0000","last_peered":"2023-10-06T02:23:39.034657+0000","last_clean":"2023-10-06T02:23:39.034657+0000","last_became_active":"2023-10-06T02:23:39.030613+0000","last_became_peered":"2023-10-06T02:23:39.030613+0000","last_unstale":"2023-10-06T02:23:39.034657+0000","last_undegraded":"2023-10-06T02:23:39.034657+0000","last_fullsized":"2023-10-06T02:23:39.034657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:50.746389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034568+0000","last_change":"2023-10-06T02:23:39.029653+0000","last_active":"2023-10-06T02:23:39.034568+0000","last_peered":"2023-10-06T02:23:39.034568+0000","last_clean":"2023-10-06T02:23:39.034568+0000","last_became_active":"2023-10-06T02:23:39.029361+0000","last_became_peered":"2023-10-06T02:23:39.029361+0000","last_unstale":"2023-10-06T02:23:39.034568+0000","last_undegraded":"2023-10-06T02:23:39.034568+0000","last_fullsized":"2023-10-06T02:23:39.034568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:36.795095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.027725+0000","last_change":"2023-10-06T02:23:39.027725+0000","last_active":"2023-10-06T02:23:39.027725+0000","last_peered":"2023-10-06T02:23:39.027725+0000","last_clean":"2023-10-06T02:23:39.027725+0000","last_became_active":"2023-10-06T02:23:39.027472+0000","last_became_peered":"2023-10-06T02:23:39.027472+0000","last_unstale":"2023-10-06T02:23:39.027725+0000","last_undegraded":"2023-10-06T02:23:39.027725+0000","last_fullsized":"2023-10-06T02:23:39.027725+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:15.077499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034509+0000","last_change":"2023-10-06T02:23:39.026394+0000","last_active":"2023-10-06T02:23:39.034509+0000","last_peered":"2023-10-06T02:23:39.034509+0000","last_clean":"2023-10-06T02:23:39.034509+0000","last_became_active":"2023-10-06T02:23:39.026130+0000","last_became_peered":"2023-10-06T02:23:39.026130+0000","last_unstale":"2023-10-06T02:23:39.034509+0000","last_undegraded":"2023-10-06T02:23:39.034509+0000","last_fullsized":"2023-10-06T02:23:39.034509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:01.113816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.028816+0000","last_change":"2023-10-06T02:23:39.028816+0000","last_active":"2023-10-06T02:23:39.028816+0000","last_peered":"2023-10-06T02:23:39.028816+0000","last_clean":"2023-10-06T02:23:39.028816+0000","last_became_active":"2023-10-06T02:23:39.028190+0000","last_became_peered":"2023-10-06T02:23:39.028190+0000","last_unstale":"2023-10-06T02:23:39.028816+0000","last_undegraded":"2023-10-06T02:23:39.028816+0000","last_fullsized":"2023-10-06T02:23:39.028816+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:32.115351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.027782+0000","last_change":"2023-10-06T02:23:39.027782+0000","last_active":"2023-10-06T02:23:39.027782+0000","last_peered":"2023-10-06T02:23:39.027782+0000","last_clean":"2023-10-06T02:23:39.027782+0000","last_became_active":"2023-10-06T02:23:39.027502+0000","last_became_peered":"2023-10-06T02:23:39.027502+0000","last_unstale":"2023-10-06T02:23:39.027782+0000","last_undegraded":"2023-10-06T02:23:39.027782+0000","last_fullsized":"2023-10-06T02:23:39.027782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:08.406504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.032114+0000","last_change":"2023-10-06T02:23:39.032114+0000","last_active":"2023-10-06T02:23:39.032114+0000","last_peered":"2023-10-06T02:23:39.032114+0000","last_clean":"2023-10-06T02:23:39.032114+0000","last_became_active":"2023-10-06T02:23:39.031615+0000","last_became_peered":"2023-10-06T02:23:39.031615+0000","last_unstale":"2023-10-06T02:23:39.032114+0000","last_undegraded":"2023-10-06T02:23:39.032114+0000","last_fullsized":"2023-10-06T02:23:39.032114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:20.524213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.026547+0000","last_change":"2023-10-06T02:23:39.026547+0000","last_active":"2023-10-06T02:23:39.026547+0000","last_peered":"2023-10-06T02:23:39.026547+0000","last_clean":"2023-10-06T02:23:39.026547+0000","last_became_active":"2023-10-06T02:23:39.026018+0000","last_became_peered":"2023-10-06T02:23:39.026018+0000","last_unstale":"2023-10-06T02:23:39.026547+0000","last_undegraded":"2023-10-06T02:23:39.026547+0000","last_fullsized":"2023-10-06T02:23:39.026547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:42.364794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.036084+0000","last_change":"2023-10-06T02:23:39.030507+0000","last_active":"2023-10-06T02:23:39.036084+0000","last_peered":"2023-10-06T02:23:39.036084+0000","last_clean":"2023-10-06T02:23:39.036084+0000","last_became_active":"2023-10-06T02:23:39.030212+0000","last_became_peered":"2023-10-06T02:23:39.030212+0000","last_unstale":"2023-10-06T02:23:39.036084+0000","last_undegraded":"2023-10-06T02:23:39.036084+0000","last_fullsized":"2023-10-06T02:23:39.036084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:42.161156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.037381+0000","last_change":"2023-10-06T02:23:39.032884+0000","last_active":"2023-10-06T02:23:39.037381+0000","last_peered":"2023-10-06T02:23:39.037381+0000","last_clean":"2023-10-06T02:23:39.037381+0000","last_became_active":"2023-10-06T02:23:39.032591+0000","last_became_peered":"2023-10-06T02:23:39.032591+0000","last_unstale":"2023-10-06T02:23:39.037381+0000","last_undegraded":"2023-10-06T02:23:39.037381+0000","last_fullsized":"2023-10-06T02:23:39.037381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:47.974451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.023758+0000","last_change":"2023-10-06T02:23:39.023758+0000","last_active":"2023-10-06T02:23:39.023758+0000","last_peered":"2023-10-06T02:23:39.023758+0000","last_clean":"2023-10-06T02:23:39.023758+0000","last_became_active":"2023-10-06T02:23:39.023488+0000","last_became_peered":"2023-10-06T02:23:39.023488+0000","last_unstale":"2023-10-06T02:23:39.023758+0000","last_undegraded":"2023-10-06T02:23:39.023758+0000","last_fullsized":"2023-10-06T02:23:39.023758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:29.787401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.040918+0000","last_change":"2023-10-06T02:23:39.030795+0000","last_active":"2023-10-06T02:23:39.040918+0000","last_peered":"2023-10-06T02:23:39.040918+0000","last_clean":"2023-10-06T02:23:39.040918+0000","last_became_active":"2023-10-06T02:23:39.030266+0000","last_became_peered":"2023-10-06T02:23:39.030266+0000","last_unstale":"2023-10-06T02:23:39.040918+0000","last_undegraded":"2023-10-06T02:23:39.040918+0000","last_fullsized":"2023-10-06T02:23:39.040918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:20.567762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.026472+0000","last_change":"2023-10-06T02:23:39.026472+0000","last_active":"2023-10-06T02:23:39.026472+0000","last_peered":"2023-10-06T02:23:39.026472+0000","last_clean":"2023-10-06T02:23:39.026472+0000","last_became_active":"2023-10-06T02:23:39.026202+0000","last_became_peered":"2023-10-06T02:23:39.026202+0000","last_unstale":"2023-10-06T02:23:39.026472+0000","last_undegraded":"2023-10-06T02:23:39.026472+0000","last_fullsized":"2023-10-06T02:23:39.026472+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:28.443740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.025908+0000","last_change":"2023-10-06T02:23:39.025908+0000","last_active":"2023-10-06T02:23:39.025908+0000","last_peered":"2023-10-06T02:23:39.025908+0000","last_clean":"2023-10-06T02:23:39.025908+0000","last_became_active":"2023-10-06T02:23:39.025617+0000","last_became_peered":"2023-10-06T02:23:39.025617+0000","last_unstale":"2023-10-06T02:23:39.025908+0000","last_undegraded":"2023-10-06T02:23:39.025908+0000","last_fullsized":"2023-10-06T02:23:39.025908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:11.145128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034874+0000","last_change":"2023-10-06T02:23:39.024961+0000","last_active":"2023-10-06T02:23:39.034874+0000","last_peered":"2023-10-06T02:23:39.034874+0000","last_clean":"2023-10-06T02:23:39.034874+0000","last_became_active":"2023-10-06T02:23:39.024708+0000","last_became_peered":"2023-10-06T02:23:39.024708+0000","last_unstale":"2023-10-06T02:23:39.034874+0000","last_undegraded":"2023-10-06T02:23:39.034874+0000","last_fullsized":"2023-10-06T02:23:39.034874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:36.274110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.028909+0000","last_change":"2023-10-06T02:23:39.028909+0000","last_active":"2023-10-06T02:23:39.028909+0000","last_peered":"2023-10-06T02:23:39.028909+0000","last_clean":"2023-10-06T02:23:39.028909+0000","last_became_active":"2023-10-06T02:23:39.028550+0000","last_became_peered":"2023-10-06T02:23:39.028550+0000","last_unstale":"2023-10-06T02:23:39.028909+0000","last_undegraded":"2023-10-06T02:23:39.028909+0000","last_fullsized":"2023-10-06T02:23:39.028909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:36.743640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.025640+0000","last_change":"2023-10-06T02:23:39.025640+0000","last_active":"2023-10-06T02:23:39.025640+0000","last_peered":"2023-10-06T02:23:39.025640+0000","last_clean":"2023-10-06T02:23:39.025640+0000","last_became_active":"2023-10-06T02:23:39.025406+0000","last_became_peered":"2023-10-06T02:23:39.025406+0000","last_unstale":"2023-10-06T02:23:39.025640+0000","last_undegraded":"2023-10-06T02:23:39.025640+0000","last_fullsized":"2023-10-06T02:23:39.025640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:06.194669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034116+0000","last_change":"2023-10-06T02:23:39.026408+0000","last_active":"2023-10-06T02:23:39.034116+0000","last_peered":"2023-10-06T02:23:39.034116+0000","last_clean":"2023-10-06T02:23:39.034116+0000","last_became_active":"2023-10-06T02:23:39.026149+0000","last_became_peered":"2023-10-06T02:23:39.026149+0000","last_unstale":"2023-10-06T02:23:39.034116+0000","last_undegraded":"2023-10-06T02:23:39.034116+0000","last_fullsized":"2023-10-06T02:23:39.034116+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:00.219364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.036857+0000","last_change":"2023-10-06T02:23:39.036857+0000","last_active":"2023-10-06T02:23:39.036857+0000","last_peered":"2023-10-06T02:23:39.036857+0000","last_clean":"2023-10-06T02:23:39.036857+0000","last_became_active":"2023-10-06T02:23:39.036563+0000","last_became_peered":"2023-10-06T02:23:39.036563+0000","last_unstale":"2023-10-06T02:23:39.036857+0000","last_undegraded":"2023-10-06T02:23:39.036857+0000","last_fullsized":"2023-10-06T02:23:39.036857+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:45.096265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.038462+0000","last_change":"2023-10-06T02:23:39.034000+0000","last_active":"2023-10-06T02:23:39.038462+0000","last_peered":"2023-10-06T02:23:39.038462+0000","last_clean":"2023-10-06T02:23:39.038462+0000","last_became_active":"2023-10-06T02:23:39.033292+0000","last_became_peered":"2023-10-06T02:23:39.033292+0000","last_unstale":"2023-10-06T02:23:39.038462+0000","last_undegraded":"2023-10-06T02:23:39.038462+0000","last_fullsized":"2023-10-06T02:23:39.038462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:12.471001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.030835+0000","last_change":"2023-10-06T02:23:39.030835+0000","last_active":"2023-10-06T02:23:39.030835+0000","last_peered":"2023-10-06T02:23:39.030835+0000","last_clean":"2023-10-06T02:23:39.030835+0000","last_became_active":"2023-10-06T02:23:39.028515+0000","last_became_peered":"2023-10-06T02:23:39.028515+0000","last_unstale":"2023-10-06T02:23:39.030835+0000","last_undegraded":"2023-10-06T02:23:39.030835+0000","last_fullsized":"2023-10-06T02:23:39.030835+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:17.464006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.036631+0000","last_change":"2023-10-06T02:23:39.031045+0000","last_active":"2023-10-06T02:23:39.036631+0000","last_peered":"2023-10-06T02:23:39.036631+0000","last_clean":"2023-10-06T02:23:39.036631+0000","last_became_active":"2023-10-06T02:23:39.030787+0000","last_became_peered":"2023-10-06T02:23:39.030787+0000","last_unstale":"2023-10-06T02:23:39.036631+0000","last_undegraded":"2023-10-06T02:23:39.036631+0000","last_fullsized":"2023-10-06T02:23:39.036631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:16.571833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034891+0000","last_change":"2023-10-06T02:23:39.027569+0000","last_active":"2023-10-06T02:23:39.034891+0000","last_peered":"2023-10-06T02:23:39.034891+0000","last_clean":"2023-10-06T02:23:39.034891+0000","last_became_active":"2023-10-06T02:23:39.027282+0000","last_became_peered":"2023-10-06T02:23:39.027282+0000","last_unstale":"2023-10-06T02:23:39.034891+0000","last_undegraded":"2023-10-06T02:23:39.034891+0000","last_fullsized":"2023-10-06T02:23:39.034891+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:28.864212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.037457+0000","last_change":"2023-10-06T02:23:39.033737+0000","last_active":"2023-10-06T02:23:39.037457+0000","last_peered":"2023-10-06T02:23:39.037457+0000","last_clean":"2023-10-06T02:23:39.037457+0000","last_became_active":"2023-10-06T02:23:39.033473+0000","last_became_peered":"2023-10-06T02:23:39.033473+0000","last_unstale":"2023-10-06T02:23:39.037457+0000","last_undegraded":"2023-10-06T02:23:39.037457+0000","last_fullsized":"2023-10-06T02:23:39.037457+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:01.922679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.040694+0000","last_change":"2023-10-06T02:23:39.040694+0000","last_active":"2023-10-06T02:23:39.040694+0000","last_peered":"2023-10-06T02:23:39.040694+0000","last_clean":"2023-10-06T02:23:39.040694+0000","last_became_active":"2023-10-06T02:23:39.040467+0000","last_became_peered":"2023-10-06T02:23:39.040467+0000","last_unstale":"2023-10-06T02:23:39.040694+0000","last_undegraded":"2023-10-06T02:23:39.040694+0000","last_fullsized":"2023-10-06T02:23:39.040694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:49.329206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.038466+0000","last_change":"2023-10-06T02:23:39.037113+0000","last_active":"2023-10-06T02:23:39.038466+0000","last_peered":"2023-10-06T02:23:39.038466+0000","last_clean":"2023-10-06T02:23:39.038466+0000","last_became_active":"2023-10-06T02:23:39.036850+0000","last_became_peered":"2023-10-06T02:23:39.036850+0000","last_unstale":"2023-10-06T02:23:39.038466+0000","last_undegraded":"2023-10-06T02:23:39.038466+0000","last_fullsized":"2023-10-06T02:23:39.038466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:06.600549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"81'4","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.051388+0000","last_change":"2023-10-06T02:23:38.015047+0000","last_active":"2023-10-06T02:23:39.051388+0000","last_peered":"2023-10-06T02:23:39.051388+0000","last_clean":"2023-10-06T02:23:39.051388+0000","last_became_active":"2023-10-06T02:23:38.014783+0000","last_became_peered":"2023-10-06T02:23:38.014783+0000","last_unstale":"2023-10-06T02:23:39.051388+0000","last_undegraded":"2023-10-06T02:23:39.051388+0000","last_fullsized":"2023-10-06T02:23:39.051388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:46.786081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.026191+0000","last_change":"2023-10-06T02:23:39.026191+0000","last_active":"2023-10-06T02:23:39.026191+0000","last_peered":"2023-10-06T02:23:39.026191+0000","last_clean":"2023-10-06T02:23:39.026191+0000","last_became_active":"2023-10-06T02:23:39.025930+0000","last_became_peered":"2023-10-06T02:23:39.025930+0000","last_unstale":"2023-10-06T02:23:39.026191+0000","last_undegraded":"2023-10-06T02:23:39.026191+0000","last_fullsized":"2023-10-06T02:23:39.026191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:38.840914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"81'1","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.047556+0000","last_change":"2023-10-06T02:23:38.008597+0000","last_active":"2023-10-06T02:23:39.047556+0000","last_peered":"2023-10-06T02:23:39.047556+0000","last_clean":"2023-10-06T02:23:39.047556+0000","last_became_active":"2023-10-06T02:23:38.008332+0000","last_became_peered":"2023-10-06T02:23:38.008332+0000","last_unstale":"2023-10-06T02:23:39.047556+0000","last_undegraded":"2023-10-06T02:23:39.047556+0000","last_fullsized":"2023-10-06T02:23:39.047556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:11.407845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.040730+0000","last_change":"2023-10-06T02:23:39.040730+0000","last_active":"2023-10-06T02:23:39.040730+0000","last_peered":"2023-10-06T02:23:39.040730+0000","last_clean":"2023-10-06T02:23:39.040730+0000","last_became_active":"2023-10-06T02:23:39.040282+0000","last_became_peered":"2023-10-06T02:23:39.040282+0000","last_unstale":"2023-10-06T02:23:39.040730+0000","last_undegraded":"2023-10-06T02:23:39.040730+0000","last_fullsized":"2023-10-06T02:23:39.040730+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:54.217856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.045791+0000","last_change":"2023-10-06T02:23:38.006325+0000","last_active":"2023-10-06T02:23:39.045791+0000","last_peered":"2023-10-06T02:23:39.045791+0000","last_clean":"2023-10-06T02:23:39.045791+0000","last_became_active":"2023-10-06T02:23:38.006062+0000","last_became_peered":"2023-10-06T02:23:38.006062+0000","last_unstale":"2023-10-06T02:23:39.045791+0000","last_undegraded":"2023-10-06T02:23:39.045791+0000","last_fullsized":"2023-10-06T02:23:39.045791+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:17.206782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034106+0000","last_change":"2023-10-06T02:23:39.034106+0000","last_active":"2023-10-06T02:23:39.034106+0000","last_peered":"2023-10-06T02:23:39.034106+0000","last_clean":"2023-10-06T02:23:39.034106+0000","last_became_active":"2023-10-06T02:23:39.033791+0000","last_became_peered":"2023-10-06T02:23:39.033791+0000","last_unstale":"2023-10-06T02:23:39.034106+0000","last_undegraded":"2023-10-06T02:23:39.034106+0000","last_fullsized":"2023-10-06T02:23:39.034106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:56.050015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.045830+0000","last_change":"2023-10-06T02:23:38.005596+0000","last_active":"2023-10-06T02:23:39.045830+0000","last_peered":"2023-10-06T02:23:39.045830+0000","last_clean":"2023-10-06T02:23:39.045830+0000","last_became_active":"2023-10-06T02:23:38.005321+0000","last_became_peered":"2023-10-06T02:23:38.005321+0000","last_unstale":"2023-10-06T02:23:39.045830+0000","last_undegraded":"2023-10-06T02:23:39.045830+0000","last_fullsized":"2023-10-06T02:23:39.045830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:17.279027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034852+0000","last_change":"2023-10-06T02:23:39.023502+0000","last_active":"2023-10-06T02:23:39.034852+0000","last_peered":"2023-10-06T02:23:39.034852+0000","last_clean":"2023-10-06T02:23:39.034852+0000","last_became_active":"2023-10-06T02:23:39.023236+0000","last_became_peered":"2023-10-06T02:23:39.023236+0000","last_unstale":"2023-10-06T02:23:39.034852+0000","last_undegraded":"2023-10-06T02:23:39.034852+0000","last_fullsized":"2023-10-06T02:23:39.034852+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:29:35.320679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"81'1","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.051500+0000","last_change":"2023-10-06T02:23:38.005130+0000","last_active":"2023-10-06T02:23:39.051500+0000","last_peered":"2023-10-06T02:23:39.051500+0000","last_clean":"2023-10-06T02:23:39.051500+0000","last_became_active":"2023-10-06T02:23:38.004830+0000","last_became_peered":"2023-10-06T02:23:38.004830+0000","last_unstale":"2023-10-06T02:23:39.051500+0000","last_undegraded":"2023-10-06T02:23:39.051500+0000","last_fullsized":"2023-10-06T02:23:39.051500+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:09.696172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.038448+0000","last_change":"2023-10-06T02:23:39.034504+0000","last_active":"2023-10-06T02:23:39.038448+0000","last_peered":"2023-10-06T02:23:39.038448+0000","last_clean":"2023-10-06T02:23:39.038448+0000","last_became_active":"2023-10-06T02:23:39.034103+0000","last_became_peered":"2023-10-06T02:23:39.034103+0000","last_unstale":"2023-10-06T02:23:39.038448+0000","last_undegraded":"2023-10-06T02:23:39.038448+0000","last_fullsized":"2023-10-06T02:23:39.038448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:33.894382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"81'1","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.047556+0000","last_change":"2023-10-06T02:23:38.010649+0000","last_active":"2023-10-06T02:23:39.047556+0000","last_peered":"2023-10-06T02:23:39.047556+0000","last_clean":"2023-10-06T02:23:39.047556+0000","last_became_active":"2023-10-06T02:23:38.010086+0000","last_became_peered":"2023-10-06T02:23:38.010086+0000","last_unstale":"2023-10-06T02:23:39.047556+0000","last_undegraded":"2023-10-06T02:23:39.047556+0000","last_fullsized":"2023-10-06T02:23:39.047556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:44.091736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.032819+0000","last_change":"2023-10-06T02:23:39.032819+0000","last_active":"2023-10-06T02:23:39.032819+0000","last_peered":"2023-10-06T02:23:39.032819+0000","last_clean":"2023-10-06T02:23:39.032819+0000","last_became_active":"2023-10-06T02:23:39.032554+0000","last_became_peered":"2023-10-06T02:23:39.032554+0000","last_unstale":"2023-10-06T02:23:39.032819+0000","last_undegraded":"2023-10-06T02:23:39.032819+0000","last_fullsized":"2023-10-06T02:23:39.032819+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:11:53.896892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.014884+0000","last_change":"2023-10-06T02:23:38.004534+0000","last_active":"2023-10-06T02:23:39.014884+0000","last_peered":"2023-10-06T02:23:39.014884+0000","last_clean":"2023-10-06T02:23:39.014884+0000","last_became_active":"2023-10-06T02:23:38.004234+0000","last_became_peered":"2023-10-06T02:23:38.004234+0000","last_unstale":"2023-10-06T02:23:39.014884+0000","last_undegraded":"2023-10-06T02:23:39.014884+0000","last_fullsized":"2023-10-06T02:23:39.014884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:17.504757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.026721+0000","last_change":"2023-10-06T02:23:39.026721+0000","last_active":"2023-10-06T02:23:39.026721+0000","last_peered":"2023-10-06T02:23:39.026721+0000","last_clean":"2023-10-06T02:23:39.026721+0000","last_became_active":"2023-10-06T02:23:39.026297+0000","last_became_peered":"2023-10-06T02:23:39.026297+0000","last_unstale":"2023-10-06T02:23:39.026721+0000","last_undegraded":"2023-10-06T02:23:39.026721+0000","last_fullsized":"2023-10-06T02:23:39.026721+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:18.766495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.012727+0000","last_change":"2023-10-06T02:23:38.001760+0000","last_active":"2023-10-06T02:23:39.012727+0000","last_peered":"2023-10-06T02:23:39.012727+0000","last_clean":"2023-10-06T02:23:39.012727+0000","last_became_active":"2023-10-06T02:23:38.001483+0000","last_became_peered":"2023-10-06T02:23:38.001483+0000","last_unstale":"2023-10-06T02:23:39.012727+0000","last_undegraded":"2023-10-06T02:23:39.012727+0000","last_fullsized":"2023-10-06T02:23:39.012727+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:05.190140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.037340+0000","last_change":"2023-10-06T02:23:39.037340+0000","last_active":"2023-10-06T02:23:39.037340+0000","last_peered":"2023-10-06T02:23:39.037340+0000","last_clean":"2023-10-06T02:23:39.037340+0000","last_became_active":"2023-10-06T02:23:39.037067+0000","last_became_peered":"2023-10-06T02:23:39.037067+0000","last_unstale":"2023-10-06T02:23:39.037340+0000","last_undegraded":"2023-10-06T02:23:39.037340+0000","last_fullsized":"2023-10-06T02:23:39.037340+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:47.974451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.015183+0000","last_change":"2023-10-06T02:23:38.014299+0000","last_active":"2023-10-06T02:23:38.015183+0000","last_peered":"2023-10-06T02:23:38.015183+0000","last_clean":"2023-10-06T02:23:38.015183+0000","last_became_active":"2023-10-06T02:23:38.014113+0000","last_became_peered":"2023-10-06T02:23:38.014113+0000","last_unstale":"2023-10-06T02:23:38.015183+0000","last_undegraded":"2023-10-06T02:23:38.015183+0000","last_fullsized":"2023-10-06T02:23:38.015183+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:41.396763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.029768+0000","last_change":"2023-10-06T02:23:39.026084+0000","last_active":"2023-10-06T02:23:39.029768+0000","last_peered":"2023-10-06T02:23:39.029768+0000","last_clean":"2023-10-06T02:23:39.029768+0000","last_became_active":"2023-10-06T02:23:39.025774+0000","last_became_peered":"2023-10-06T02:23:39.025774+0000","last_unstale":"2023-10-06T02:23:39.029768+0000","last_undegraded":"2023-10-06T02:23:39.029768+0000","last_fullsized":"2023-10-06T02:23:39.029768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:15.707312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.014615+0000","last_change":"2023-10-06T02:23:38.010406+0000","last_active":"2023-10-06T02:23:38.014615+0000","last_peered":"2023-10-06T02:23:38.014615+0000","last_clean":"2023-10-06T02:23:38.014615+0000","last_became_active":"2023-10-06T02:23:38.010155+0000","last_became_peered":"2023-10-06T02:23:38.010155+0000","last_unstale":"2023-10-06T02:23:38.014615+0000","last_undegraded":"2023-10-06T02:23:38.014615+0000","last_fullsized":"2023-10-06T02:23:38.014615+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:59.083799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.030548+0000","last_change":"2023-10-06T02:23:39.025305+0000","last_active":"2023-10-06T02:23:39.030548+0000","last_peered":"2023-10-06T02:23:39.030548+0000","last_clean":"2023-10-06T02:23:39.030548+0000","last_became_active":"2023-10-06T02:23:39.025003+0000","last_became_peered":"2023-10-06T02:23:39.025003+0000","last_unstale":"2023-10-06T02:23:39.030548+0000","last_undegraded":"2023-10-06T02:23:39.030548+0000","last_fullsized":"2023-10-06T02:23:39.030548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:11.615891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"81'3","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.051697+0000","last_change":"2023-10-06T02:23:38.016201+0000","last_active":"2023-10-06T02:23:39.051697+0000","last_peered":"2023-10-06T02:23:39.051697+0000","last_clean":"2023-10-06T02:23:39.051697+0000","last_became_active":"2023-10-06T02:23:38.015032+0000","last_became_peered":"2023-10-06T02:23:38.015032+0000","last_unstale":"2023-10-06T02:23:39.051697+0000","last_undegraded":"2023-10-06T02:23:39.051697+0000","last_fullsized":"2023-10-06T02:23:39.051697+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:15.567304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.038485+0000","last_change":"2023-10-06T02:23:39.034165+0000","last_active":"2023-10-06T02:23:39.038485+0000","last_peered":"2023-10-06T02:23:39.038485+0000","last_clean":"2023-10-06T02:23:39.038485+0000","last_became_active":"2023-10-06T02:23:39.033699+0000","last_became_peered":"2023-10-06T02:23:39.033699+0000","last_unstale":"2023-10-06T02:23:39.038485+0000","last_undegraded":"2023-10-06T02:23:39.038485+0000","last_fullsized":"2023-10-06T02:23:39.038485+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:11.615891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"81'6","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.052837+0000","last_change":"2023-10-06T02:23:38.004401+0000","last_active":"2023-10-06T02:23:39.052837+0000","last_peered":"2023-10-06T02:23:39.052837+0000","last_clean":"2023-10-06T02:23:39.052837+0000","last_became_active":"2023-10-06T02:23:38.004128+0000","last_became_peered":"2023-10-06T02:23:38.004128+0000","last_unstale":"2023-10-06T02:23:39.052837+0000","last_undegraded":"2023-10-06T02:23:39.052837+0000","last_fullsized":"2023-10-06T02:23:39.052837+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:46.786081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034137+0000","last_change":"2023-10-06T02:23:39.028535+0000","last_active":"2023-10-06T02:23:39.034137+0000","last_peered":"2023-10-06T02:23:39.034137+0000","last_clean":"2023-10-06T02:23:39.034137+0000","last_became_active":"2023-10-06T02:23:39.028257+0000","last_became_peered":"2023-10-06T02:23:39.028257+0000","last_unstale":"2023-10-06T02:23:39.034137+0000","last_undegraded":"2023-10-06T02:23:39.034137+0000","last_fullsized":"2023-10-06T02:23:39.034137+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:33.894382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.042737+0000","last_change":"2023-10-06T02:23:37.999510+0000","last_active":"2023-10-06T02:23:39.042737+0000","last_peered":"2023-10-06T02:23:39.042737+0000","last_clean":"2023-10-06T02:23:39.042737+0000","last_became_active":"2023-10-06T02:23:37.999194+0000","last_became_peered":"2023-10-06T02:23:37.999194+0000","last_unstale":"2023-10-06T02:23:39.042737+0000","last_undegraded":"2023-10-06T02:23:39.042737+0000","last_fullsized":"2023-10-06T02:23:39.042737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:53.382095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.036125+0000","last_change":"2023-10-06T02:23:39.036125+0000","last_active":"2023-10-06T02:23:39.036125+0000","last_peered":"2023-10-06T02:23:39.036125+0000","last_clean":"2023-10-06T02:23:39.036125+0000","last_became_active":"2023-10-06T02:23:39.035130+0000","last_became_peered":"2023-10-06T02:23:39.035130+0000","last_unstale":"2023-10-06T02:23:39.036125+0000","last_undegraded":"2023-10-06T02:23:39.036125+0000","last_fullsized":"2023-10-06T02:23:39.036125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:15.077499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.008121+0000","last_change":"2023-10-06T02:23:38.003234+0000","last_active":"2023-10-06T02:23:38.008121+0000","last_peered":"2023-10-06T02:23:38.008121+0000","last_clean":"2023-10-06T02:23:38.008121+0000","last_became_active":"2023-10-06T02:23:38.002979+0000","last_became_peered":"2023-10-06T02:23:38.002979+0000","last_unstale":"2023-10-06T02:23:38.008121+0000","last_undegraded":"2023-10-06T02:23:38.008121+0000","last_fullsized":"2023-10-06T02:23:38.008121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:32.315694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034689+0000","last_change":"2023-10-06T02:23:39.023083+0000","last_active":"2023-10-06T02:23:39.034689+0000","last_peered":"2023-10-06T02:23:39.034689+0000","last_clean":"2023-10-06T02:23:39.034689+0000","last_became_active":"2023-10-06T02:23:39.022682+0000","last_became_peered":"2023-10-06T02:23:39.022682+0000","last_unstale":"2023-10-06T02:23:39.034689+0000","last_undegraded":"2023-10-06T02:23:39.034689+0000","last_fullsized":"2023-10-06T02:23:39.034689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:00.088328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.017866+0000","last_change":"2023-10-06T02:23:38.006475+0000","last_active":"2023-10-06T02:23:39.017866+0000","last_peered":"2023-10-06T02:23:39.017866+0000","last_clean":"2023-10-06T02:23:39.017866+0000","last_became_active":"2023-10-06T02:23:38.006213+0000","last_became_peered":"2023-10-06T02:23:38.006213+0000","last_unstale":"2023-10-06T02:23:39.017866+0000","last_undegraded":"2023-10-06T02:23:39.017866+0000","last_fullsized":"2023-10-06T02:23:39.017866+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:59.214835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034257+0000","last_change":"2023-10-06T02:23:39.027297+0000","last_active":"2023-10-06T02:23:39.034257+0000","last_peered":"2023-10-06T02:23:39.034257+0000","last_clean":"2023-10-06T02:23:39.034257+0000","last_became_active":"2023-10-06T02:23:39.027039+0000","last_became_peered":"2023-10-06T02:23:39.027039+0000","last_unstale":"2023-10-06T02:23:39.034257+0000","last_undegraded":"2023-10-06T02:23:39.034257+0000","last_fullsized":"2023-10-06T02:23:39.034257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:42.401292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"81'8","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.045079+0000","last_change":"2023-10-06T02:23:37.998880+0000","last_active":"2023-10-06T02:23:39.045079+0000","last_peered":"2023-10-06T02:23:39.045079+0000","last_clean":"2023-10-06T02:23:39.045079+0000","last_became_active":"2023-10-06T02:23:37.998377+0000","last_became_peered":"2023-10-06T02:23:37.998377+0000","last_unstale":"2023-10-06T02:23:39.045079+0000","last_undegraded":"2023-10-06T02:23:39.045079+0000","last_fullsized":"2023-10-06T02:23:39.045079+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:07.401975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.033257+0000","last_change":"2023-10-06T02:23:39.028791+0000","last_active":"2023-10-06T02:23:39.033257+0000","last_peered":"2023-10-06T02:23:39.033257+0000","last_clean":"2023-10-06T02:23:39.033257+0000","last_became_active":"2023-10-06T02:23:39.028510+0000","last_became_peered":"2023-10-06T02:23:39.028510+0000","last_unstale":"2023-10-06T02:23:39.033257+0000","last_undegraded":"2023-10-06T02:23:39.033257+0000","last_fullsized":"2023-10-06T02:23:39.033257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:42.364794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.038995+0000","last_change":"2023-10-06T02:23:38.008280+0000","last_active":"2023-10-06T02:23:39.038995+0000","last_peered":"2023-10-06T02:23:39.038995+0000","last_clean":"2023-10-06T02:23:39.038995+0000","last_became_active":"2023-10-06T02:23:38.008032+0000","last_became_peered":"2023-10-06T02:23:38.008032+0000","last_unstale":"2023-10-06T02:23:39.038995+0000","last_undegraded":"2023-10-06T02:23:39.038995+0000","last_fullsized":"2023-10-06T02:23:39.038995+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:47.848239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034470+0000","last_change":"2023-10-06T02:23:39.034470+0000","last_active":"2023-10-06T02:23:39.034470+0000","last_peered":"2023-10-06T02:23:39.034470+0000","last_clean":"2023-10-06T02:23:39.034470+0000","last_became_active":"2023-10-06T02:23:39.034171+0000","last_became_peered":"2023-10-06T02:23:39.034171+0000","last_unstale":"2023-10-06T02:23:39.034470+0000","last_undegraded":"2023-10-06T02:23:39.034470+0000","last_fullsized":"2023-10-06T02:23:39.034470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:18.283557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.013485+0000","last_change":"2023-10-06T02:23:37.998331+0000","last_active":"2023-10-06T02:23:39.013485+0000","last_peered":"2023-10-06T02:23:39.013485+0000","last_clean":"2023-10-06T02:23:39.013485+0000","last_became_active":"2023-10-06T02:23:37.997994+0000","last_became_peered":"2023-10-06T02:23:37.997994+0000","last_unstale":"2023-10-06T02:23:39.013485+0000","last_undegraded":"2023-10-06T02:23:39.013485+0000","last_fullsized":"2023-10-06T02:23:39.013485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:27.439211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.036383+0000","last_change":"2023-10-06T02:23:39.036383+0000","last_active":"2023-10-06T02:23:39.036383+0000","last_peered":"2023-10-06T02:23:39.036383+0000","last_clean":"2023-10-06T02:23:39.036383+0000","last_became_active":"2023-10-06T02:23:39.036086+0000","last_became_peered":"2023-10-06T02:23:39.036086+0000","last_unstale":"2023-10-06T02:23:39.036383+0000","last_undegraded":"2023-10-06T02:23:39.036383+0000","last_fullsized":"2023-10-06T02:23:39.036383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:12.457199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.016685+0000","last_change":"2023-10-06T02:23:38.015995+0000","last_active":"2023-10-06T02:23:38.016685+0000","last_peered":"2023-10-06T02:23:38.016685+0000","last_clean":"2023-10-06T02:23:38.016685+0000","last_became_active":"2023-10-06T02:23:38.014929+0000","last_became_peered":"2023-10-06T02:23:38.014929+0000","last_unstale":"2023-10-06T02:23:38.016685+0000","last_undegraded":"2023-10-06T02:23:38.016685+0000","last_fullsized":"2023-10-06T02:23:38.016685+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:59.214835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.036131+0000","last_change":"2023-10-06T02:23:39.030196+0000","last_active":"2023-10-06T02:23:39.036131+0000","last_peered":"2023-10-06T02:23:39.036131+0000","last_clean":"2023-10-06T02:23:39.036131+0000","last_became_active":"2023-10-06T02:23:39.029908+0000","last_became_peered":"2023-10-06T02:23:39.029908+0000","last_unstale":"2023-10-06T02:23:39.036131+0000","last_undegraded":"2023-10-06T02:23:39.036131+0000","last_fullsized":"2023-10-06T02:23:39.036131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:32.059897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.014587+0000","last_change":"2023-10-06T02:23:38.009826+0000","last_active":"2023-10-06T02:23:38.014587+0000","last_peered":"2023-10-06T02:23:38.014587+0000","last_clean":"2023-10-06T02:23:38.014587+0000","last_became_active":"2023-10-06T02:23:38.009557+0000","last_became_peered":"2023-10-06T02:23:38.009557+0000","last_unstale":"2023-10-06T02:23:38.014587+0000","last_undegraded":"2023-10-06T02:23:38.014587+0000","last_fullsized":"2023-10-06T02:23:38.014587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:29:34.316149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034716+0000","last_change":"2023-10-06T02:23:39.031004+0000","last_active":"2023-10-06T02:23:39.034716+0000","last_peered":"2023-10-06T02:23:39.034716+0000","last_clean":"2023-10-06T02:23:39.034716+0000","last_became_active":"2023-10-06T02:23:39.030690+0000","last_became_peered":"2023-10-06T02:23:39.030690+0000","last_unstale":"2023-10-06T02:23:39.034716+0000","last_undegraded":"2023-10-06T02:23:39.034716+0000","last_fullsized":"2023-10-06T02:23:39.034716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:38.840914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.016336+0000","last_change":"2023-10-06T02:23:38.008082+0000","last_active":"2023-10-06T02:23:39.016336+0000","last_peered":"2023-10-06T02:23:39.016336+0000","last_clean":"2023-10-06T02:23:39.016336+0000","last_became_active":"2023-10-06T02:23:38.007800+0000","last_became_peered":"2023-10-06T02:23:38.007800+0000","last_unstale":"2023-10-06T02:23:39.016336+0000","last_undegraded":"2023-10-06T02:23:39.016336+0000","last_fullsized":"2023-10-06T02:23:39.016336+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:09.696172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034174+0000","last_change":"2023-10-06T02:23:39.028418+0000","last_active":"2023-10-06T02:23:39.034174+0000","last_peered":"2023-10-06T02:23:39.034174+0000","last_clean":"2023-10-06T02:23:39.034174+0000","last_became_active":"2023-10-06T02:23:39.028135+0000","last_became_peered":"2023-10-06T02:23:39.028135+0000","last_unstale":"2023-10-06T02:23:39.034174+0000","last_undegraded":"2023-10-06T02:23:39.034174+0000","last_fullsized":"2023-10-06T02:23:39.034174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:32.059897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.024656+0000","last_change":"2023-10-06T02:23:38.010172+0000","last_active":"2023-10-06T02:23:39.024656+0000","last_peered":"2023-10-06T02:23:39.024656+0000","last_clean":"2023-10-06T02:23:39.024656+0000","last_became_active":"2023-10-06T02:23:38.009721+0000","last_became_peered":"2023-10-06T02:23:38.009721+0000","last_unstale":"2023-10-06T02:23:39.024656+0000","last_undegraded":"2023-10-06T02:23:39.024656+0000","last_fullsized":"2023-10-06T02:23:39.024656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:16.459477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.035758+0000","last_change":"2023-10-06T02:23:39.035758+0000","last_active":"2023-10-06T02:23:39.035758+0000","last_peered":"2023-10-06T02:23:39.035758+0000","last_clean":"2023-10-06T02:23:39.035758+0000","last_became_active":"2023-10-06T02:23:39.035433+0000","last_became_peered":"2023-10-06T02:23:39.035433+0000","last_unstale":"2023-10-06T02:23:39.035758+0000","last_undegraded":"2023-10-06T02:23:39.035758+0000","last_fullsized":"2023-10-06T02:23:39.035758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:10.700701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.014179+0000","last_change":"2023-10-06T02:23:38.009991+0000","last_active":"2023-10-06T02:23:38.014179+0000","last_peered":"2023-10-06T02:23:38.014179+0000","last_clean":"2023-10-06T02:23:38.014179+0000","last_became_active":"2023-10-06T02:23:38.009732+0000","last_became_peered":"2023-10-06T02:23:38.009732+0000","last_unstale":"2023-10-06T02:23:38.014179+0000","last_undegraded":"2023-10-06T02:23:38.014179+0000","last_fullsized":"2023-10-06T02:23:38.014179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:00.291533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.023666+0000","last_change":"2023-10-06T02:23:39.023666+0000","last_active":"2023-10-06T02:23:39.023666+0000","last_peered":"2023-10-06T02:23:39.023666+0000","last_clean":"2023-10-06T02:23:39.023666+0000","last_became_active":"2023-10-06T02:23:39.023372+0000","last_became_peered":"2023-10-06T02:23:39.023372+0000","last_unstale":"2023-10-06T02:23:39.023666+0000","last_undegraded":"2023-10-06T02:23:39.023666+0000","last_fullsized":"2023-10-06T02:23:39.023666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:15.707312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.024334+0000","last_change":"2023-10-06T02:23:38.011348+0000","last_active":"2023-10-06T02:23:39.024334+0000","last_peered":"2023-10-06T02:23:39.024334+0000","last_clean":"2023-10-06T02:23:39.024334+0000","last_became_active":"2023-10-06T02:23:38.011074+0000","last_became_peered":"2023-10-06T02:23:38.011074+0000","last_unstale":"2023-10-06T02:23:39.024334+0000","last_undegraded":"2023-10-06T02:23:39.024334+0000","last_fullsized":"2023-10-06T02:23:39.024334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:53.213327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.033204+0000","last_change":"2023-10-06T02:23:39.027889+0000","last_active":"2023-10-06T02:23:39.033204+0000","last_peered":"2023-10-06T02:23:39.033204+0000","last_clean":"2023-10-06T02:23:39.033204+0000","last_became_active":"2023-10-06T02:23:39.027625+0000","last_became_peered":"2023-10-06T02:23:39.027625+0000","last_unstale":"2023-10-06T02:23:39.033204+0000","last_undegraded":"2023-10-06T02:23:39.033204+0000","last_fullsized":"2023-10-06T02:23:39.033204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:36.743640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.008244+0000","last_change":"2023-10-06T02:23:38.006895+0000","last_active":"2023-10-06T02:23:38.008244+0000","last_peered":"2023-10-06T02:23:38.008244+0000","last_clean":"2023-10-06T02:23:38.008244+0000","last_became_active":"2023-10-06T02:23:38.006631+0000","last_became_peered":"2023-10-06T02:23:38.006631+0000","last_unstale":"2023-10-06T02:23:38.008244+0000","last_undegraded":"2023-10-06T02:23:38.008244+0000","last_fullsized":"2023-10-06T02:23:38.008244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:17.206782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.025176+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:23:39.025176+0000","last_peered":"2023-10-06T02:23:39.025176+0000","last_clean":"2023-10-06T02:23:39.025176+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:23:39.025176+0000","last_undegraded":"2023-10-06T02:23:39.025176+0000","last_fullsized":"2023-10-06T02:23:39.025176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.023132+0000","last_change":"2023-10-06T02:23:39.023132+0000","last_active":"2023-10-06T02:23:39.023132+0000","last_peered":"2023-10-06T02:23:39.023132+0000","last_clean":"2023-10-06T02:23:39.023132+0000","last_became_active":"2023-10-06T02:23:39.020557+0000","last_became_peered":"2023-10-06T02:23:39.020557+0000","last_unstale":"2023-10-06T02:23:39.023132+0000","last_undegraded":"2023-10-06T02:23:39.023132+0000","last_fullsized":"2023-10-06T02:23:39.023132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:33:47.260759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.014493+0000","last_change":"2023-10-06T02:23:38.010775+0000","last_active":"2023-10-06T02:23:38.014493+0000","last_peered":"2023-10-06T02:23:38.014493+0000","last_clean":"2023-10-06T02:23:38.014493+0000","last_became_active":"2023-10-06T02:23:38.010483+0000","last_became_peered":"2023-10-06T02:23:38.010483+0000","last_unstale":"2023-10-06T02:23:38.014493+0000","last_undegraded":"2023-10-06T02:23:38.014493+0000","last_fullsized":"2023-10-06T02:23:38.014493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:18.860068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:37.998650+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:23:37.998650+0000","last_peered":"2023-10-06T02:23:37.998650+0000","last_clean":"2023-10-06T02:23:37.998650+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:23:37.998650+0000","last_undegraded":"2023-10-06T02:23:37.998650+0000","last_fullsized":"2023-10-06T02:23:37.998650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.026562+0000","last_change":"2023-10-06T02:23:39.026562+0000","last_active":"2023-10-06T02:23:39.026562+0000","last_peered":"2023-10-06T02:23:39.026562+0000","last_clean":"2023-10-06T02:23:39.026562+0000","last_became_active":"2023-10-06T02:23:39.026206+0000","last_became_peered":"2023-10-06T02:23:39.026206+0000","last_unstale":"2023-10-06T02:23:39.026562+0000","last_undegraded":"2023-10-06T02:23:39.026562+0000","last_fullsized":"2023-10-06T02:23:39.026562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:12.412374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.043954+0000","last_change":"2023-10-06T02:23:38.005053+0000","last_active":"2023-10-06T02:23:39.043954+0000","last_peered":"2023-10-06T02:23:39.043954+0000","last_clean":"2023-10-06T02:23:39.043954+0000","last_became_active":"2023-10-06T02:23:38.004779+0000","last_became_peered":"2023-10-06T02:23:38.004779+0000","last_unstale":"2023-10-06T02:23:39.043954+0000","last_undegraded":"2023-10-06T02:23:39.043954+0000","last_fullsized":"2023-10-06T02:23:39.043954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:32.315694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.014073+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:23:39.014073+0000","last_peered":"2023-10-06T02:23:39.014073+0000","last_clean":"2023-10-06T02:23:39.014073+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:23:39.014073+0000","last_undegraded":"2023-10-06T02:23:39.014073+0000","last_fullsized":"2023-10-06T02:23:39.014073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":216,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:37.998074+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:23:37.998074+0000","last_peered":"2023-10-06T02:23:37.998074+0000","last_clean":"2023-10-06T02:23:37.998074+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:23:37.998074+0000","last_undegraded":"2023-10-06T02:23:37.998074+0000","last_fullsized":"2023-10-06T02:23:37.998074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.025844+0000","last_change":"2023-10-06T02:23:39.025844+0000","last_active":"2023-10-06T02:23:39.025844+0000","last_peered":"2023-10-06T02:23:39.025844+0000","last_clean":"2023-10-06T02:23:39.025844+0000","last_became_active":"2023-10-06T02:23:39.025551+0000","last_became_peered":"2023-10-06T02:23:39.025551+0000","last_unstale":"2023-10-06T02:23:39.025844+0000","last_undegraded":"2023-10-06T02:23:39.025844+0000","last_fullsized":"2023-10-06T02:23:39.025844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:17.464006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"81'1","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.019857+0000","last_change":"2023-10-06T02:23:38.013844+0000","last_active":"2023-10-06T02:23:39.019857+0000","last_peered":"2023-10-06T02:23:39.019857+0000","last_clean":"2023-10-06T02:23:39.019857+0000","last_became_active":"2023-10-06T02:23:38.011236+0000","last_became_peered":"2023-10-06T02:23:38.011236+0000","last_unstale":"2023-10-06T02:23:39.019857+0000","last_undegraded":"2023-10-06T02:23:39.019857+0000","last_fullsized":"2023-10-06T02:23:39.019857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:55.185347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:37.997834+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:23:37.997834+0000","last_peered":"2023-10-06T02:23:37.997834+0000","last_clean":"2023-10-06T02:23:37.997834+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:23:37.997834+0000","last_undegraded":"2023-10-06T02:23:37.997834+0000","last_fullsized":"2023-10-06T02:23:37.997834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034389+0000","last_change":"2023-10-06T02:23:39.023058+0000","last_active":"2023-10-06T02:23:39.034389+0000","last_peered":"2023-10-06T02:23:39.034389+0000","last_clean":"2023-10-06T02:23:39.034389+0000","last_became_active":"2023-10-06T02:23:39.022343+0000","last_became_peered":"2023-10-06T02:23:39.022343+0000","last_unstale":"2023-10-06T02:23:39.034389+0000","last_undegraded":"2023-10-06T02:23:39.034389+0000","last_fullsized":"2023-10-06T02:23:39.034389+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:42.992590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"81'1","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.021462+0000","last_change":"2023-10-06T02:23:38.005914+0000","last_active":"2023-10-06T02:23:39.021462+0000","last_peered":"2023-10-06T02:23:39.021462+0000","last_clean":"2023-10-06T02:23:39.021462+0000","last_became_active":"2023-10-06T02:23:38.005612+0000","last_became_peered":"2023-10-06T02:23:38.005612+0000","last_unstale":"2023-10-06T02:23:39.021462+0000","last_undegraded":"2023-10-06T02:23:39.021462+0000","last_fullsized":"2023-10-06T02:23:39.021462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:25:38.782541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:37.997984+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:23:37.997984+0000","last_peered":"2023-10-06T02:23:37.997984+0000","last_clean":"2023-10-06T02:23:37.997984+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:23:37.997984+0000","last_undegraded":"2023-10-06T02:23:37.997984+0000","last_fullsized":"2023-10-06T02:23:37.997984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.038503+0000","last_change":"2023-10-06T02:23:39.035381+0000","last_active":"2023-10-06T02:23:39.038503+0000","last_peered":"2023-10-06T02:23:39.038503+0000","last_clean":"2023-10-06T02:23:39.038503+0000","last_became_active":"2023-10-06T02:23:39.035123+0000","last_became_peered":"2023-10-06T02:23:39.035123+0000","last_unstale":"2023-10-06T02:23:39.038503+0000","last_undegraded":"2023-10-06T02:23:39.038503+0000","last_fullsized":"2023-10-06T02:23:39.038503+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:19.377075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.015799+0000","last_change":"2023-10-06T02:23:38.004747+0000","last_active":"2023-10-06T02:23:39.015799+0000","last_peered":"2023-10-06T02:23:39.015799+0000","last_clean":"2023-10-06T02:23:39.015799+0000","last_became_active":"2023-10-06T02:23:38.003857+0000","last_became_peered":"2023-10-06T02:23:38.003857+0000","last_unstale":"2023-10-06T02:23:39.015799+0000","last_undegraded":"2023-10-06T02:23:39.015799+0000","last_fullsized":"2023-10-06T02:23:39.015799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:00.918150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.018441+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:23:39.018441+0000","last_peered":"2023-10-06T02:23:39.018441+0000","last_clean":"2023-10-06T02:23:39.018441+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:23:39.018441+0000","last_undegraded":"2023-10-06T02:23:39.018441+0000","last_fullsized":"2023-10-06T02:23:39.018441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.031947+0000","last_change":"2023-10-06T02:23:39.031947+0000","last_active":"2023-10-06T02:23:39.031947+0000","last_peered":"2023-10-06T02:23:39.031947+0000","last_clean":"2023-10-06T02:23:39.031947+0000","last_became_active":"2023-10-06T02:23:39.031300+0000","last_became_peered":"2023-10-06T02:23:39.031300+0000","last_unstale":"2023-10-06T02:23:39.031947+0000","last_undegraded":"2023-10-06T02:23:39.031947+0000","last_fullsized":"2023-10-06T02:23:39.031947+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:18.664186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"81'2","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.043707+0000","last_change":"2023-10-06T02:23:38.006130+0000","last_active":"2023-10-06T02:23:39.043707+0000","last_peered":"2023-10-06T02:23:39.043707+0000","last_clean":"2023-10-06T02:23:39.043707+0000","last_became_active":"2023-10-06T02:23:38.005851+0000","last_became_peered":"2023-10-06T02:23:38.005851+0000","last_unstale":"2023-10-06T02:23:39.043707+0000","last_undegraded":"2023-10-06T02:23:39.043707+0000","last_fullsized":"2023-10-06T02:23:39.043707+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:00.918150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":65,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.006734+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:23:38.006734+0000","last_peered":"2023-10-06T02:23:38.006734+0000","last_clean":"2023-10-06T02:23:38.006734+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:23:38.006734+0000","last_undegraded":"2023-10-06T02:23:38.006734+0000","last_fullsized":"2023-10-06T02:23:38.006734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034824+0000","last_change":"2023-10-06T02:23:39.031959+0000","last_active":"2023-10-06T02:23:39.034824+0000","last_peered":"2023-10-06T02:23:39.034824+0000","last_clean":"2023-10-06T02:23:39.034824+0000","last_became_active":"2023-10-06T02:23:39.031626+0000","last_became_peered":"2023-10-06T02:23:39.031626+0000","last_unstale":"2023-10-06T02:23:39.034824+0000","last_undegraded":"2023-10-06T02:23:39.034824+0000","last_fullsized":"2023-10-06T02:23:39.034824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:25:39.787070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.006935+0000","last_change":"2023-10-06T02:23:38.001773+0000","last_active":"2023-10-06T02:23:38.006935+0000","last_peered":"2023-10-06T02:23:38.006935+0000","last_clean":"2023-10-06T02:23:38.006935+0000","last_became_active":"2023-10-06T02:23:38.001504+0000","last_became_peered":"2023-10-06T02:23:38.001504+0000","last_unstale":"2023-10-06T02:23:38.006935+0000","last_undegraded":"2023-10-06T02:23:38.006935+0000","last_fullsized":"2023-10-06T02:23:38.006935+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:13.135563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":65,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.006853+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:23:38.006853+0000","last_peered":"2023-10-06T02:23:38.006853+0000","last_clean":"2023-10-06T02:23:38.006853+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:23:38.006853+0000","last_undegraded":"2023-10-06T02:23:38.006853+0000","last_fullsized":"2023-10-06T02:23:38.006853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298840,"kb_used_data":1552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073000,"statfs":{"total":96636764160,"available":96330752000,"internally_reserved":0,"allocated":1589248,"data_stored":1065658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.53900000000000003,"15min":0.501},"min":{"1min":0.45900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78100000000000003,"5min":1.111,"15min":1.111},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52700000000000002,"15min":0.49199999999999999},"min":{"1min":0.46400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70599999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.51500000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54800000000000004,"15min":0.51500000000000001},"min":{"1min":0.39500000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77500000000000002,"5min":1.008,"15min":1.008},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54300000000000004,"15min":0.51400000000000001},"min":{"1min":0.434,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74299999999999999,"5min":1.075,"15min":1.075},"last":0.53300000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.81899999999999995,"5min":1.149,"15min":1.149},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61099999999999999,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80800000000000005,"5min":1.048,"15min":1.048},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.53200000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.72799999999999998,"5min":1.175,"15min":1.175},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59799999999999998,"15min":0.57099999999999995},"min":{"1min":0.46500000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82299999999999995,"5min":1.03,"15min":1.03},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48199999999999998,"15min":0.48599999999999999},"min":{"1min":0.30599999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59799999999999998,"5min":0.873,"15min":0.873},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52600000000000002,"15min":0.53300000000000003},"min":{"1min":0.374,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68999999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.442}]},{"osd":5,"last update":"Fri Oct 6 02:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.33700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.64900000000000002,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71899999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.46000000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.67300000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.498},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298264,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073576,"statfs":{"total":96636764160,"available":96331341824,"internally_reserved":0,"allocated":999424,"data_stored":474933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.63100000000000001,"15min":0.80300000000000005},"min":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76200000000000001,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64200000000000002,"15min":0.81799999999999995},"min":{"1min":0.433,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73299999999999998,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.71299999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57199999999999995,"15min":0.52700000000000002},"min":{"1min":0.47999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.748,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53300000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.67800000000000005,"15min":0.96999999999999997},"min":{"1min":0.41699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82299999999999995,"5min":8.8659999999999997,"15min":8.8659999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.56799999999999995,"15min":0.55400000000000005},"min":{"1min":0.41399999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.72599999999999998,"15min":1.0700000000000001},"min":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81000000000000005,"5min":10.659000000000001,"15min":10.659000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.42699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77500000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59799999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48599999999999999,"15min":0.51200000000000001},"min":{"1min":0.312,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51900000000000002,"15min":0.54500000000000004},"min":{"1min":0.34599999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71999999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51600000000000001,"15min":0.55400000000000005},"min":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.316,"15min":0.316},"max":{"1min":0.82699999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.66600000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56599999999999995,"15min":0.58999999999999997},"min":{"1min":0.34999999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.749,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.755},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59899999999999998,"15min":0.63100000000000001},"min":{"1min":0.442,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.748,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.70399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298856,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072984,"statfs":{"total":96636764160,"available":96330735616,"internally_reserved":0,"allocated":1605632,"data_stored":1071790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.372,"15min":0.34999999999999998},"min":{"1min":0.314,"5min":0.19,"15min":0.19},"max":{"1min":0.52700000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.437},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.39200000000000002,"15min":0.35899999999999999},"min":{"1min":0.34699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.32500000000000001},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.40400000000000003,"15min":0.38300000000000001},"min":{"1min":0.29099999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.621}]},{"osd":3,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.42299999999999999,"15min":0.38300000000000001},"min":{"1min":0.42899999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.40600000000000003,"15min":0.38400000000000001},"min":{"1min":0.36499999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.58799999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.60099999999999998,"15min":0.56200000000000006},"min":{"1min":0.45300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.60799999999999998,"15min":0.57999999999999996},"min":{"1min":0.48599999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.59499999999999997},"min":{"1min":0.51600000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.65800000000000003,"15min":0.625},"min":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.629,"15min":0.59199999999999997},"min":{"1min":0.52900000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.628,"15min":0.59299999999999997},"min":{"1min":0.44400000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.81799999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.65000000000000002,"15min":0.621},"min":{"1min":0.55300000000000005,"5min":0.378,"15min":0.378},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.754},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.63400000000000001,"15min":0.60599999999999998},"min":{"1min":0.57499999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.70999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574924,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298260,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073580,"statfs":{"total":96636764160,"available":96331345920,"internally_reserved":0,"allocated":995328,"data_stored":475254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.309},"min":{"1min":0.255,"5min":0.183,"15min":0.183},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.38800000000000001,"15min":0.34599999999999997},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.40400000000000003,"15min":0.372},"min":{"1min":0.33300000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56899999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.36199999999999999,"15min":0.33000000000000002},"min":{"1min":0.317,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.45600000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40200000000000002,"15min":0.38300000000000001},"min":{"1min":0.29899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.441,"15min":0.41299999999999998},"min":{"1min":0.34799999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.65000000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.51100000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.621,"15min":0.60699999999999998},"min":{"1min":0.54800000000000004,"5min":0.371,"15min":0.371},"max":{"1min":0.88100000000000001,"5min":1.369,"15min":1.369},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.61299999999999999,"15min":0.56000000000000005},"min":{"1min":0.50800000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78800000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.71899999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63200000000000001,"15min":0.60599999999999998},"min":{"1min":0.52600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.96499999999999997,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.64200000000000002,"15min":0.59999999999999998},"min":{"1min":0.52400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.80500000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.64800000000000002,"15min":0.624},"min":{"1min":0.48999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95299999999999996,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.65300000000000002,"15min":0.60499999999999998},"min":{"1min":0.55500000000000005,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.75}]},{"osd":7,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75900000000000001,"15min":1.0449999999999999},"min":{"1min":0.55800000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94099999999999995,"5min":11.138,"15min":11.138},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.67300000000000004,"15min":0.63500000000000001},"min":{"1min":0.59199999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90600000000000003,"5min":1.429,"15min":1.429},"last":0.76600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574924,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298256,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073584,"statfs":{"total":96636764160,"available":96331350016,"internally_reserved":0,"allocated":991232,"data_stored":474821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.376,"15min":0.37},"min":{"1min":0.30499999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.63700000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.374},"min":{"1min":0.28899999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.66500000000000004,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.375}]},{"osd":1,"last update":"Fri Oct 6 02:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.41999999999999998,"15min":0.38400000000000001},"min":{"1min":0.318,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.72599999999999998,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.435},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.443,"15min":0.40200000000000002},"min":{"1min":0.34200000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.79000000000000004,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.41299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.40000000000000002,"15min":0.374},"min":{"1min":0.28599999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.69099999999999995,"5min":1.423,"15min":1.423},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.44600000000000001,"15min":0.42299999999999999},"min":{"1min":0.371,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77100000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.60899999999999999,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.61699999999999999},"min":{"1min":0.51600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.73899999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.624,"15min":0.60699999999999998},"min":{"1min":0.47899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85599999999999998,"5min":1.304,"15min":1.304},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.629,"15min":0.623},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88200000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.72999999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92300000000000004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.64700000000000002,"15min":0.628},"min":{"1min":0.56299999999999994,"5min":0.443,"15min":0.443},"max":{"1min":0.96699999999999997,"5min":1.347,"15min":1.347},"last":0.75}]},{"osd":7,"last update":"Fri Oct 6 02:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95299999999999996,"5min":1.206,"15min":1.206},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.68400000000000005,"15min":0.67200000000000004},"min":{"1min":0.51600000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1,"5min":1.385,"15min":1.385},"last":0.65400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574924,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298268,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073572,"statfs":{"total":96636764160,"available":96331337728,"internally_reserved":0,"allocated":1003520,"data_stored":476756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.36099999999999999,"15min":0.36299999999999999},"min":{"1min":0.26400000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.55500000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.38,"15min":0.38700000000000001},"min":{"1min":0.29099999999999998,"5min":0.22,"15min":0.22},"max":{"1min":0.55500000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39200000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.30299999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.316},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.307,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.60499999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.34699999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.39900000000000002,"15min":0.40400000000000003},"min":{"1min":0.317,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.60099999999999998,"5min":0.624,"15min":0.624},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.41899999999999998,"15min":0.40899999999999997},"min":{"1min":0.372,"5min":0.246,"15min":0.246},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.377}]},{"osd":4,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.60299999999999998,"15min":0.58499999999999996},"min":{"1min":0.48199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89700000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.5},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81299999999999994,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.44400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.40400000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86899999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.63400000000000001,"15min":0.61699999999999999},"min":{"1min":0.51800000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86799999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.46600000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.61799999999999999,"15min":0.59099999999999997},"min":{"1min":0.45700000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82799999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.54800000000000004,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84099999999999997,"5min":1.391,"15min":1.391},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.53800000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84099999999999997,"5min":1.121,"15min":1.121},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.64000000000000001,"15min":0.60999999999999999},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.81000000000000005,"5min":0.874,"15min":0.874},"last":0.57899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298256,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073584,"statfs":{"total":96636764160,"available":96331350016,"internally_reserved":0,"allocated":991232,"data_stored":475220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.58599999999999997,"15min":0.54400000000000004},"min":{"1min":0.48299999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.81299999999999994,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.621,"15min":0.58999999999999997},"min":{"1min":0.495,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80100000000000005,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":1.7290000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.73699999999999999,"15min":1.141},"min":{"1min":0.5,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":17.879999999999999,"15min":17.879999999999999},"last":1.77},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.72499999999999998,"15min":1.123},"min":{"1min":0.46899999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78600000000000003,"5min":18.010999999999999,"15min":18.010999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57499999999999996,"15min":0.53000000000000003},"min":{"1min":0.436,"5min":0.309,"15min":0.309},"max":{"1min":0.77700000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":1.619},{"interface":"front","average":{"1min":0.629,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.51900000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76000000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":1.6639999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.57899999999999996,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.59299999999999997,"15min":0.56499999999999995},"min":{"1min":0.498,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.751}]},{"osd":5,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.33500000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.73399999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":1.532},{"interface":"front","average":{"1min":0.5,"5min":0.52200000000000002,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.65300000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51000000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53300000000000003,"15min":0.55700000000000005},"min":{"1min":0.33900000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.76400000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":1.5700000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.379,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77100000000000002,"5min":0.876,"15min":0.876},"last":1.4319999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.74199999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59899999999999998,"15min":0.61899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.49099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298284,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073556,"statfs":{"total":96636764160,"available":96331321344,"internally_reserved":0,"allocated":1019904,"data_stored":483739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.50900000000000001},"min":{"1min":0.379,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72999999999999998,"5min":1.103,"15min":1.103},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.45300000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.66700000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.54800000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59499999999999997,"15min":0.55900000000000005},"min":{"1min":0.45400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78000000000000003,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.58999999999999997,"15min":0.55200000000000005},"min":{"1min":0.51000000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.52700000000000002},"min":{"1min":0.40100000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.755,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.52000000000000002},"min":{"1min":0.41299999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71699999999999997,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.72999999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56999999999999995,"15min":0.54200000000000004},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.752,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58499999999999996,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.755,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48599999999999999,"15min":0.51000000000000001},"min":{"1min":0.32800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.66000000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.49299999999999999,"15min":0.501},"min":{"1min":0.32100000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69599999999999995,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.622}]},{"osd":6,"last update":"Fri Oct 6 02:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.502,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.752},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55000000000000004,"15min":0.57599999999999996},"min":{"1min":0.39300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70099999999999996,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53500000000000003,"15min":0.54700000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.67400000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.60399999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72599999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:23:43.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:23:43.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.296+0000 7fa580f95700 1 Processor -- start 2023-10-06T02:23:43.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.296+0000 7fa580f95700 1 -- start start 2023-10-06T02:23:43.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.297+0000 7fa580f95700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa57c159400 0x7fa57c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.297+0000 7fa580f95700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa57c0cd030 0x7fa57c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.297+0000 7fa580f95700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa57c0b3560 con 0x7fa57c0cf1a0 2023-10-06T02:23:43.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.297+0000 7fa580f95700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57c0cf6f0 con 0x7fa57c0cd030 2023-10-06T02:23:43.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.297+0000 7fa580f95700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57c0cf9d0 con 0x7fa57c159400 2023-10-06T02:23:43.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.297+0000 7fa57affd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa57c0cd030 0x7fa57c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.297+0000 7fa57affd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa57c0cd030 0x7fa57c0cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40244/0 (socket says 172.21.15.6:40244) 2023-10-06T02:23:43.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.297+0000 7fa57affd700 1 -- 172.21.15.6:0/3571062350 learned_addr learned my addr 172.21.15.6:0/3571062350 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:43.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.297+0000 7fa57bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa57c0cf1a0 0x7fa57c0b5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36436/0 (socket says 172.21.15.6:36436) 2023-10-06T02:23:43.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.297+0000 7fa57b7fe700 1 --2- 172.21.15.6:0/3571062350 >> v2:172.21.15.175:3300/0 conn(0x7fa57c159400 0x7fa57c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.298+0000 7fa57affd700 1 -- 172.21.15.6:0/3571062350 >> v2:172.21.15.175:3300/0 conn(0x7fa57c159400 msgr2=0x7fa57c0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:43.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.298+0000 7fa57affd700 1 --2- 172.21.15.6:0/3571062350 >> v2:172.21.15.175:3300/0 conn(0x7fa57c159400 0x7fa57c0ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.298+0000 7fa57affd700 1 -- 172.21.15.6:0/3571062350 >> v1:172.21.15.6:6789/0 conn(0x7fa57c0cf1a0 legacy=0x7fa57c0b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.298+0000 7fa57a7fc700 1 -- 172.21.15.6:0/3571062350 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651978686 0 0) 0x7fa57c0b3560 con 0x7fa57c0cf1a0 2023-10-06T02:23:43.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.298+0000 7fa57affd700 1 -- 172.21.15.6:0/3571062350 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c0b2f10 con 0x7fa57c0cd030 2023-10-06T02:23:43.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.298+0000 7fa57affd700 1 --2- 172.21.15.6:0/3571062350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa57c0cd030 0x7fa57c0cfec0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fa57c067fc0 tx=0x7fa570009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7e99415908a89e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.298+0000 7fa57a7fc700 1 -- 172.21.15.6:0/3571062350 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57000b860 con 0x7fa57c0cd030 2023-10-06T02:23:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.298+0000 7fa57a7fc700 1 -- 172.21.15.6:0/3571062350 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57000b9c0 con 0x7fa57c0cd030 2023-10-06T02:23:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.298+0000 7fa57a7fc700 1 -- 172.21.15.6:0/3571062350 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57000bd60 con 0x7fa57c0cd030 2023-10-06T02:23:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.298+0000 7fa580f95700 1 -- 172.21.15.6:0/3571062350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa57c0cd030 msgr2=0x7fa57c0cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.298+0000 7fa580f95700 1 --2- 172.21.15.6:0/3571062350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa57c0cd030 0x7fa57c0cfec0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fa57c067fc0 tx=0x7fa570009250 comp rx=0 tx=0).stop 2023-10-06T02:23:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.298+0000 7fa580f95700 1 -- 172.21.15.6:0/3571062350 shutdown_connections 2023-10-06T02:23:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.298+0000 7fa580f95700 1 --2- 172.21.15.6:0/3571062350 >> v2:172.21.15.175:3300/0 conn(0x7fa57c159400 0x7fa57c0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.298+0000 7fa580f95700 1 --2- 172.21.15.6:0/3571062350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa57c0cd030 0x7fa57c0cfec0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.298+0000 7fa580f95700 1 -- 172.21.15.6:0/3571062350 >> 172.21.15.6:0/3571062350 conn(0x7fa57c06ac10 msgr2=0x7fa57c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.299+0000 7fa580f95700 1 -- 172.21.15.6:0/3571062350 shutdown_connections 2023-10-06T02:23:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.299+0000 7fa580f95700 1 -- 172.21.15.6:0/3571062350 wait complete. 2023-10-06T02:23:43.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.300+0000 7fa580f95700 1 Processor -- start 2023-10-06T02:23:43.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.300+0000 7fa580f95700 1 -- start start 2023-10-06T02:23:43.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.300+0000 7fa580f95700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa57c0cd030 0x7fa57c15db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.300+0000 7fa580f95700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa57c0cf1a0 0x7fa57c15e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.300+0000 7fa580f95700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa57c159400 0x7fa57c15c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa580f95700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c153570 con 0x7fa57c159400 2023-10-06T02:23:43.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa580f95700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c15e040 con 0x7fa57c0cf1a0 2023-10-06T02:23:43.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa580f95700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c16dac0 con 0x7fa57c0cd030 2023-10-06T02:23:43.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa57bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa57c159400 0x7fa57c15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa57bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa57c159400 0x7fa57c15c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40248/0 (socket says 172.21.15.6:40248) 2023-10-06T02:23:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa57bfff700 1 -- 172.21.15.6:0/2611818332 learned_addr learned my addr 172.21.15.6:0/2611818332 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa57affd700 1 --2- 172.21.15.6:0/2611818332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa57c0cf1a0 0x7fa57c15e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa57b7fe700 1 --2- 172.21.15.6:0/2611818332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa57c0cd030 0x7fa57c15db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa57bfff700 1 -- 172.21.15.6:0/2611818332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa57c0cd030 msgr2=0x7fa57c15db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa57bfff700 1 --2- 172.21.15.6:0/2611818332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa57c0cd030 0x7fa57c15db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa57bfff700 1 -- 172.21.15.6:0/2611818332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa57c0cf1a0 msgr2=0x7fa57c15e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa57bfff700 1 --2- 172.21.15.6:0/2611818332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa57c0cf1a0 0x7fa57c15e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa57bfff700 1 -- 172.21.15.6:0/2611818332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5700094f0 con 0x7fa57c159400 2023-10-06T02:23:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa57b7fe700 1 --2- 172.21.15.6:0/2611818332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa57c0cd030 0x7fa57c15db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa57bfff700 1 --2- 172.21.15.6:0/2611818332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa57c159400 0x7fa57c15c130 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fa57400cd50 tx=0x7fa574001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa5637fe700 1 -- 172.21.15.6:0/2611818332 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574005df0 con 0x7fa57c159400 2023-10-06T02:23:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa5637fe700 1 -- 172.21.15.6:0/2611818332 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57400a960 con 0x7fa57c159400 2023-10-06T02:23:43.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa580f95700 1 -- 172.21.15.6:0/2611818332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa57c16dda0 con 0x7fa57c159400 2023-10-06T02:23:43.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa5637fe700 1 -- 172.21.15.6:0/2611818332 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57400ad20 con 0x7fa57c159400 2023-10-06T02:23:43.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.301+0000 7fa580f95700 1 -- 172.21.15.6:0/2611818332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57c16e360 con 0x7fa57c159400 2023-10-06T02:23:43.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.302+0000 7fa580f95700 1 -- 172.21.15.6:0/2611818332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa57c0b31f0 con 0x7fa57c159400 2023-10-06T02:23:43.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.303+0000 7fa5637fe700 1 -- 172.21.15.6:0/2611818332 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa574007300 con 0x7fa57c159400 2023-10-06T02:23:43.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.303+0000 7fa5637fe700 1 --2- 172.21.15.6:0/2611818332 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa568066f30 0x7fa5680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.303+0000 7fa5637fe700 1 -- 172.21.15.6:0/2611818332 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa574084910 con 0x7fa57c159400 2023-10-06T02:23:43.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.303+0000 7fa57b7fe700 1 --2- 172.21.15.6:0/2611818332 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa568066f30 0x7fa5680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.304+0000 7fa57b7fe700 1 --2- 172.21.15.6:0/2611818332 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa568066f30 0x7fa5680693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa56c005fd0 tx=0x7fa56c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:43.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.307+0000 7fa5637fe700 1 -- 172.21.15.6:0/2611818332 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa574051960 con 0x7fa57c159400 2023-10-06T02:23:43.321 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-06T02:23:43.321+0000 7f38bd9ef700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:23:43.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.497+0000 7fa580f95700 1 -- 172.21.15.6:0/2611818332 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa57c0cdd30 con 0x7fa568066f30 2023-10-06T02:23:43.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.506+0000 7fa5637fe700 1 -- 172.21.15.6:0/2611818332 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311331 (secure 0 0 0) 0x7fa57c0cdd30 con 0x7fa568066f30 2023-10-06T02:23:43.512 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.509+0000 7fa580f95700 1 -- 172.21.15.6:0/2611818332 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa568066f30 msgr2=0x7fa5680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.509+0000 7fa580f95700 1 --2- 172.21.15.6:0/2611818332 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa568066f30 0x7fa5680693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa56c005fd0 tx=0x7fa56c008040 comp rx=0 tx=0).stop 2023-10-06T02:23:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.509+0000 7fa580f95700 1 -- 172.21.15.6:0/2611818332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa57c159400 msgr2=0x7fa57c15c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.509+0000 7fa580f95700 1 --2- 172.21.15.6:0/2611818332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa57c159400 0x7fa57c15c130 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fa57400cd50 tx=0x7fa574001b10 comp rx=0 tx=0).stop 2023-10-06T02:23:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.510+0000 7fa580f95700 1 -- 172.21.15.6:0/2611818332 shutdown_connections 2023-10-06T02:23:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.510+0000 7fa580f95700 1 --2- 172.21.15.6:0/2611818332 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa568066f30 0x7fa5680693e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.510+0000 7fa580f95700 1 --2- 172.21.15.6:0/2611818332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa57c159400 0x7fa57c15c130 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.510+0000 7fa580f95700 1 --2- 172.21.15.6:0/2611818332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa57c0cd030 0x7fa57c15db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.510+0000 7fa580f95700 1 --2- 172.21.15.6:0/2611818332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa57c0cf1a0 0x7fa57c15e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.510+0000 7fa580f95700 1 -- 172.21.15.6:0/2611818332 >> 172.21.15.6:0/2611818332 conn(0x7fa57c06ac10 msgr2=0x7fa57c158630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:43.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.510+0000 7fa580f95700 1 -- 172.21.15.6:0/2611818332 shutdown_connections 2023-10-06T02:23:43.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.510+0000 7fa580f95700 1 -- 172.21.15.6:0/2611818332 wait complete. 2023-10-06T02:23:43.516 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:23:43.522 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2023-10-06T02:23:42.649618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387284,"kb_used_data":8980,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752587436,"statfs":{"total":773094113280,"available":770649534464,"internally_reserved":0,"allocated":9195520,"data_stored":4998171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.660992"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.026897+0000","last_change":"2023-10-06T02:23:39.026897+0000","last_active":"2023-10-06T02:23:39.026897+0000","last_peered":"2023-10-06T02:23:39.026897+0000","last_clean":"2023-10-06T02:23:39.026897+0000","last_became_active":"2023-10-06T02:23:39.026596+0000","last_became_peered":"2023-10-06T02:23:39.026596+0000","last_unstale":"2023-10-06T02:23:39.026897+0000","last_undegraded":"2023-10-06T02:23:39.026897+0000","last_fullsized":"2023-10-06T02:23:39.026897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:45.096265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.035327+0000","last_change":"2023-10-06T02:23:39.023248+0000","last_active":"2023-10-06T02:23:39.035327+0000","last_peered":"2023-10-06T02:23:39.035327+0000","last_clean":"2023-10-06T02:23:39.035327+0000","last_became_active":"2023-10-06T02:23:39.022983+0000","last_became_peered":"2023-10-06T02:23:39.022983+0000","last_unstale":"2023-10-06T02:23:39.035327+0000","last_undegraded":"2023-10-06T02:23:39.035327+0000","last_fullsized":"2023-10-06T02:23:39.035327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:01.296062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.031529+0000","last_change":"2023-10-06T02:23:39.031529+0000","last_active":"2023-10-06T02:23:39.031529+0000","last_peered":"2023-10-06T02:23:39.031529+0000","last_clean":"2023-10-06T02:23:39.031529+0000","last_became_active":"2023-10-06T02:23:39.031268+0000","last_became_peered":"2023-10-06T02:23:39.031268+0000","last_unstale":"2023-10-06T02:23:39.031529+0000","last_undegraded":"2023-10-06T02:23:39.031529+0000","last_fullsized":"2023-10-06T02:23:39.031529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:15.116170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.024171+0000","last_change":"2023-10-06T02:23:39.024171+0000","last_active":"2023-10-06T02:23:39.024171+0000","last_peered":"2023-10-06T02:23:39.024171+0000","last_clean":"2023-10-06T02:23:39.024171+0000","last_became_active":"2023-10-06T02:23:39.023905+0000","last_became_peered":"2023-10-06T02:23:39.023905+0000","last_unstale":"2023-10-06T02:23:39.024171+0000","last_undegraded":"2023-10-06T02:23:39.024171+0000","last_fullsized":"2023-10-06T02:23:39.024171+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:54.386624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.038934+0000","last_change":"2023-10-06T02:23:39.037836+0000","last_active":"2023-10-06T02:23:39.038934+0000","last_peered":"2023-10-06T02:23:39.038934+0000","last_clean":"2023-10-06T02:23:39.038934+0000","last_became_active":"2023-10-06T02:23:39.037559+0000","last_became_peered":"2023-10-06T02:23:39.037559+0000","last_unstale":"2023-10-06T02:23:39.038934+0000","last_undegraded":"2023-10-06T02:23:39.038934+0000","last_fullsized":"2023-10-06T02:23:39.038934+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:33:30.817733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.028220+0000","last_change":"2023-10-06T02:23:39.025148+0000","last_active":"2023-10-06T02:23:39.028220+0000","last_peered":"2023-10-06T02:23:39.028220+0000","last_clean":"2023-10-06T02:23:39.028220+0000","last_became_active":"2023-10-06T02:23:39.024843+0000","last_became_peered":"2023-10-06T02:23:39.024843+0000","last_unstale":"2023-10-06T02:23:39.028220+0000","last_undegraded":"2023-10-06T02:23:39.028220+0000","last_fullsized":"2023-10-06T02:23:39.028220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:27.680925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.027919+0000","last_change":"2023-10-06T02:23:39.027919+0000","last_active":"2023-10-06T02:23:39.027919+0000","last_peered":"2023-10-06T02:23:39.027919+0000","last_clean":"2023-10-06T02:23:39.027919+0000","last_became_active":"2023-10-06T02:23:39.027627+0000","last_became_peered":"2023-10-06T02:23:39.027627+0000","last_unstale":"2023-10-06T02:23:39.027919+0000","last_undegraded":"2023-10-06T02:23:39.027919+0000","last_fullsized":"2023-10-06T02:23:39.027919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:48.852768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034657+0000","last_change":"2023-10-06T02:23:39.030911+0000","last_active":"2023-10-06T02:23:39.034657+0000","last_peered":"2023-10-06T02:23:39.034657+0000","last_clean":"2023-10-06T02:23:39.034657+0000","last_became_active":"2023-10-06T02:23:39.030613+0000","last_became_peered":"2023-10-06T02:23:39.030613+0000","last_unstale":"2023-10-06T02:23:39.034657+0000","last_undegraded":"2023-10-06T02:23:39.034657+0000","last_fullsized":"2023-10-06T02:23:39.034657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:50.746389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034568+0000","last_change":"2023-10-06T02:23:39.029653+0000","last_active":"2023-10-06T02:23:39.034568+0000","last_peered":"2023-10-06T02:23:39.034568+0000","last_clean":"2023-10-06T02:23:39.034568+0000","last_became_active":"2023-10-06T02:23:39.029361+0000","last_became_peered":"2023-10-06T02:23:39.029361+0000","last_unstale":"2023-10-06T02:23:39.034568+0000","last_undegraded":"2023-10-06T02:23:39.034568+0000","last_fullsized":"2023-10-06T02:23:39.034568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:36.795095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.027725+0000","last_change":"2023-10-06T02:23:39.027725+0000","last_active":"2023-10-06T02:23:39.027725+0000","last_peered":"2023-10-06T02:23:39.027725+0000","last_clean":"2023-10-06T02:23:39.027725+0000","last_became_active":"2023-10-06T02:23:39.027472+0000","last_became_peered":"2023-10-06T02:23:39.027472+0000","last_unstale":"2023-10-06T02:23:39.027725+0000","last_undegraded":"2023-10-06T02:23:39.027725+0000","last_fullsized":"2023-10-06T02:23:39.027725+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:15.077499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034509+0000","last_change":"2023-10-06T02:23:39.026394+0000","last_active":"2023-10-06T02:23:39.034509+0000","last_peered":"2023-10-06T02:23:39.034509+0000","last_clean":"2023-10-06T02:23:39.034509+0000","last_became_active":"2023-10-06T02:23:39.026130+0000","last_became_peered":"2023-10-06T02:23:39.026130+0000","last_unstale":"2023-10-06T02:23:39.034509+0000","last_undegraded":"2023-10-06T02:23:39.034509+0000","last_fullsized":"2023-10-06T02:23:39.034509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:01.113816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.028816+0000","last_change":"2023-10-06T02:23:39.028816+0000","last_active":"2023-10-06T02:23:39.028816+0000","last_peered":"2023-10-06T02:23:39.028816+0000","last_clean":"2023-10-06T02:23:39.028816+0000","last_became_active":"2023-10-06T02:23:39.028190+0000","last_became_peered":"2023-10-06T02:23:39.028190+0000","last_unstale":"2023-10-06T02:23:39.028816+0000","last_undegraded":"2023-10-06T02:23:39.028816+0000","last_fullsized":"2023-10-06T02:23:39.028816+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:32.115351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.027782+0000","last_change":"2023-10-06T02:23:39.027782+0000","last_active":"2023-10-06T02:23:39.027782+0000","last_peered":"2023-10-06T02:23:39.027782+0000","last_clean":"2023-10-06T02:23:39.027782+0000","last_became_active":"2023-10-06T02:23:39.027502+0000","last_became_peered":"2023-10-06T02:23:39.027502+0000","last_unstale":"2023-10-06T02:23:39.027782+0000","last_undegraded":"2023-10-06T02:23:39.027782+0000","last_fullsized":"2023-10-06T02:23:39.027782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:08.406504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.032114+0000","last_change":"2023-10-06T02:23:39.032114+0000","last_active":"2023-10-06T02:23:39.032114+0000","last_peered":"2023-10-06T02:23:39.032114+0000","last_clean":"2023-10-06T02:23:39.032114+0000","last_became_active":"2023-10-06T02:23:39.031615+0000","last_became_peered":"2023-10-06T02:23:39.031615+0000","last_unstale":"2023-10-06T02:23:39.032114+0000","last_undegraded":"2023-10-06T02:23:39.032114+0000","last_fullsized":"2023-10-06T02:23:39.032114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:20.524213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.026547+0000","last_change":"2023-10-06T02:23:39.026547+0000","last_active":"2023-10-06T02:23:39.026547+0000","last_peered":"2023-10-06T02:23:39.026547+0000","last_clean":"2023-10-06T02:23:39.026547+0000","last_became_active":"2023-10-06T02:23:39.026018+0000","last_became_peered":"2023-10-06T02:23:39.026018+0000","last_unstale":"2023-10-06T02:23:39.026547+0000","last_undegraded":"2023-10-06T02:23:39.026547+0000","last_fullsized":"2023-10-06T02:23:39.026547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:42.364794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.036084+0000","last_change":"2023-10-06T02:23:39.030507+0000","last_active":"2023-10-06T02:23:39.036084+0000","last_peered":"2023-10-06T02:23:39.036084+0000","last_clean":"2023-10-06T02:23:39.036084+0000","last_became_active":"2023-10-06T02:23:39.030212+0000","last_became_peered":"2023-10-06T02:23:39.030212+0000","last_unstale":"2023-10-06T02:23:39.036084+0000","last_undegraded":"2023-10-06T02:23:39.036084+0000","last_fullsized":"2023-10-06T02:23:39.036084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:42.161156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.037381+0000","last_change":"2023-10-06T02:23:39.032884+0000","last_active":"2023-10-06T02:23:39.037381+0000","last_peered":"2023-10-06T02:23:39.037381+0000","last_clean":"2023-10-06T02:23:39.037381+0000","last_became_active":"2023-10-06T02:23:39.032591+0000","last_became_peered":"2023-10-06T02:23:39.032591+0000","last_unstale":"2023-10-06T02:23:39.037381+0000","last_undegraded":"2023-10-06T02:23:39.037381+0000","last_fullsized":"2023-10-06T02:23:39.037381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:47.974451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.023758+0000","last_change":"2023-10-06T02:23:39.023758+0000","last_active":"2023-10-06T02:23:39.023758+0000","last_peered":"2023-10-06T02:23:39.023758+0000","last_clean":"2023-10-06T02:23:39.023758+0000","last_became_active":"2023-10-06T02:23:39.023488+0000","last_became_peered":"2023-10-06T02:23:39.023488+0000","last_unstale":"2023-10-06T02:23:39.023758+0000","last_undegraded":"2023-10-06T02:23:39.023758+0000","last_fullsized":"2023-10-06T02:23:39.023758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:29.787401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.040918+0000","last_change":"2023-10-06T02:23:39.030795+0000","last_active":"2023-10-06T02:23:39.040918+0000","last_peered":"2023-10-06T02:23:39.040918+0000","last_clean":"2023-10-06T02:23:39.040918+0000","last_became_active":"2023-10-06T02:23:39.030266+0000","last_became_peered":"2023-10-06T02:23:39.030266+0000","last_unstale":"2023-10-06T02:23:39.040918+0000","last_undegraded":"2023-10-06T02:23:39.040918+0000","last_fullsized":"2023-10-06T02:23:39.040918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:20.567762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.026472+0000","last_change":"2023-10-06T02:23:39.026472+0000","last_active":"2023-10-06T02:23:39.026472+0000","last_peered":"2023-10-06T02:23:39.026472+0000","last_clean":"2023-10-06T02:23:39.026472+0000","last_became_active":"2023-10-06T02:23:39.026202+0000","last_became_peered":"2023-10-06T02:23:39.026202+0000","last_unstale":"2023-10-06T02:23:39.026472+0000","last_undegraded":"2023-10-06T02:23:39.026472+0000","last_fullsized":"2023-10-06T02:23:39.026472+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:28.443740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.025908+0000","last_change":"2023-10-06T02:23:39.025908+0000","last_active":"2023-10-06T02:23:39.025908+0000","last_peered":"2023-10-06T02:23:39.025908+0000","last_clean":"2023-10-06T02:23:39.025908+0000","last_became_active":"2023-10-06T02:23:39.025617+0000","last_became_peered":"2023-10-06T02:23:39.025617+0000","last_unstale":"2023-10-06T02:23:39.025908+0000","last_undegraded":"2023-10-06T02:23:39.025908+0000","last_fullsized":"2023-10-06T02:23:39.025908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:11.145128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034874+0000","last_change":"2023-10-06T02:23:39.024961+0000","last_active":"2023-10-06T02:23:39.034874+0000","last_peered":"2023-10-06T02:23:39.034874+0000","last_clean":"2023-10-06T02:23:39.034874+0000","last_became_active":"2023-10-06T02:23:39.024708+0000","last_became_peered":"2023-10-06T02:23:39.024708+0000","last_unstale":"2023-10-06T02:23:39.034874+0000","last_undegraded":"2023-10-06T02:23:39.034874+0000","last_fullsized":"2023-10-06T02:23:39.034874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:36.274110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.028909+0000","last_change":"2023-10-06T02:23:39.028909+0000","last_active":"2023-10-06T02:23:39.028909+0000","last_peered":"2023-10-06T02:23:39.028909+0000","last_clean":"2023-10-06T02:23:39.028909+0000","last_became_active":"2023-10-06T02:23:39.028550+0000","last_became_peered":"2023-10-06T02:23:39.028550+0000","last_unstale":"2023-10-06T02:23:39.028909+0000","last_undegraded":"2023-10-06T02:23:39.028909+0000","last_fullsized":"2023-10-06T02:23:39.028909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:36.743640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.025640+0000","last_change":"2023-10-06T02:23:39.025640+0000","last_active":"2023-10-06T02:23:39.025640+0000","last_peered":"2023-10-06T02:23:39.025640+0000","last_clean":"2023-10-06T02:23:39.025640+0000","last_became_active":"2023-10-06T02:23:39.025406+0000","last_became_peered":"2023-10-06T02:23:39.025406+0000","last_unstale":"2023-10-06T02:23:39.025640+0000","last_undegraded":"2023-10-06T02:23:39.025640+0000","last_fullsized":"2023-10-06T02:23:39.025640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:06.194669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034116+0000","last_change":"2023-10-06T02:23:39.026408+0000","last_active":"2023-10-06T02:23:39.034116+0000","last_peered":"2023-10-06T02:23:39.034116+0000","last_clean":"2023-10-06T02:23:39.034116+0000","last_became_active":"2023-10-06T02:23:39.026149+0000","last_became_peered":"2023-10-06T02:23:39.026149+0000","last_unstale":"2023-10-06T02:23:39.034116+0000","last_undegraded":"2023-10-06T02:23:39.034116+0000","last_fullsized":"2023-10-06T02:23:39.034116+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:00.219364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.036857+0000","last_change":"2023-10-06T02:23:39.036857+0000","last_active":"2023-10-06T02:23:39.036857+0000","last_peered":"2023-10-06T02:23:39.036857+0000","last_clean":"2023-10-06T02:23:39.036857+0000","last_became_active":"2023-10-06T02:23:39.036563+0000","last_became_peered":"2023-10-06T02:23:39.036563+0000","last_unstale":"2023-10-06T02:23:39.036857+0000","last_undegraded":"2023-10-06T02:23:39.036857+0000","last_fullsized":"2023-10-06T02:23:39.036857+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:45.096265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.038462+0000","last_change":"2023-10-06T02:23:39.034000+0000","last_active":"2023-10-06T02:23:39.038462+0000","last_peered":"2023-10-06T02:23:39.038462+0000","last_clean":"2023-10-06T02:23:39.038462+0000","last_became_active":"2023-10-06T02:23:39.033292+0000","last_became_peered":"2023-10-06T02:23:39.033292+0000","last_unstale":"2023-10-06T02:23:39.038462+0000","last_undegraded":"2023-10-06T02:23:39.038462+0000","last_fullsized":"2023-10-06T02:23:39.038462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:12.471001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.030835+0000","last_change":"2023-10-06T02:23:39.030835+0000","last_active":"2023-10-06T02:23:39.030835+0000","last_peered":"2023-10-06T02:23:39.030835+0000","last_clean":"2023-10-06T02:23:39.030835+0000","last_became_active":"2023-10-06T02:23:39.028515+0000","last_became_peered":"2023-10-06T02:23:39.028515+0000","last_unstale":"2023-10-06T02:23:39.030835+0000","last_undegraded":"2023-10-06T02:23:39.030835+0000","last_fullsized":"2023-10-06T02:23:39.030835+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:17.464006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.036631+0000","last_change":"2023-10-06T02:23:39.031045+0000","last_active":"2023-10-06T02:23:39.036631+0000","last_peered":"2023-10-06T02:23:39.036631+0000","last_clean":"2023-10-06T02:23:39.036631+0000","last_became_active":"2023-10-06T02:23:39.030787+0000","last_became_peered":"2023-10-06T02:23:39.030787+0000","last_unstale":"2023-10-06T02:23:39.036631+0000","last_undegraded":"2023-10-06T02:23:39.036631+0000","last_fullsized":"2023-10-06T02:23:39.036631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:16.571833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034891+0000","last_change":"2023-10-06T02:23:39.027569+0000","last_active":"2023-10-06T02:23:39.034891+0000","last_peered":"2023-10-06T02:23:39.034891+0000","last_clean":"2023-10-06T02:23:39.034891+0000","last_became_active":"2023-10-06T02:23:39.027282+0000","last_became_peered":"2023-10-06T02:23:39.027282+0000","last_unstale":"2023-10-06T02:23:39.034891+0000","last_undegraded":"2023-10-06T02:23:39.034891+0000","last_fullsized":"2023-10-06T02:23:39.034891+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:28.864212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.037457+0000","last_change":"2023-10-06T02:23:39.033737+0000","last_active":"2023-10-06T02:23:39.037457+0000","last_peered":"2023-10-06T02:23:39.037457+0000","last_clean":"2023-10-06T02:23:39.037457+0000","last_became_active":"2023-10-06T02:23:39.033473+0000","last_became_peered":"2023-10-06T02:23:39.033473+0000","last_unstale":"2023-10-06T02:23:39.037457+0000","last_undegraded":"2023-10-06T02:23:39.037457+0000","last_fullsized":"2023-10-06T02:23:39.037457+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:01.922679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.040694+0000","last_change":"2023-10-06T02:23:39.040694+0000","last_active":"2023-10-06T02:23:39.040694+0000","last_peered":"2023-10-06T02:23:39.040694+0000","last_clean":"2023-10-06T02:23:39.040694+0000","last_became_active":"2023-10-06T02:23:39.040467+0000","last_became_peered":"2023-10-06T02:23:39.040467+0000","last_unstale":"2023-10-06T02:23:39.040694+0000","last_undegraded":"2023-10-06T02:23:39.040694+0000","last_fullsized":"2023-10-06T02:23:39.040694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:49.329206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.038466+0000","last_change":"2023-10-06T02:23:39.037113+0000","last_active":"2023-10-06T02:23:39.038466+0000","last_peered":"2023-10-06T02:23:39.038466+0000","last_clean":"2023-10-06T02:23:39.038466+0000","last_became_active":"2023-10-06T02:23:39.036850+0000","last_became_peered":"2023-10-06T02:23:39.036850+0000","last_unstale":"2023-10-06T02:23:39.038466+0000","last_undegraded":"2023-10-06T02:23:39.038466+0000","last_fullsized":"2023-10-06T02:23:39.038466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:06.600549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"81'4","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.051388+0000","last_change":"2023-10-06T02:23:38.015047+0000","last_active":"2023-10-06T02:23:39.051388+0000","last_peered":"2023-10-06T02:23:39.051388+0000","last_clean":"2023-10-06T02:23:39.051388+0000","last_became_active":"2023-10-06T02:23:38.014783+0000","last_became_peered":"2023-10-06T02:23:38.014783+0000","last_unstale":"2023-10-06T02:23:39.051388+0000","last_undegraded":"2023-10-06T02:23:39.051388+0000","last_fullsized":"2023-10-06T02:23:39.051388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:46.786081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.026191+0000","last_change":"2023-10-06T02:23:39.026191+0000","last_active":"2023-10-06T02:23:39.026191+0000","last_peered":"2023-10-06T02:23:39.026191+0000","last_clean":"2023-10-06T02:23:39.026191+0000","last_became_active":"2023-10-06T02:23:39.025930+0000","last_became_peered":"2023-10-06T02:23:39.025930+0000","last_unstale":"2023-10-06T02:23:39.026191+0000","last_undegraded":"2023-10-06T02:23:39.026191+0000","last_fullsized":"2023-10-06T02:23:39.026191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:38.840914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"81'1","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.047556+0000","last_change":"2023-10-06T02:23:38.008597+0000","last_active":"2023-10-06T02:23:39.047556+0000","last_peered":"2023-10-06T02:23:39.047556+0000","last_clean":"2023-10-06T02:23:39.047556+0000","last_became_active":"2023-10-06T02:23:38.008332+0000","last_became_peered":"2023-10-06T02:23:38.008332+0000","last_unstale":"2023-10-06T02:23:39.047556+0000","last_undegraded":"2023-10-06T02:23:39.047556+0000","last_fullsized":"2023-10-06T02:23:39.047556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:11.407845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.040730+0000","last_change":"2023-10-06T02:23:39.040730+0000","last_active":"2023-10-06T02:23:39.040730+0000","last_peered":"2023-10-06T02:23:39.040730+0000","last_clean":"2023-10-06T02:23:39.040730+0000","last_became_active":"2023-10-06T02:23:39.040282+0000","last_became_peered":"2023-10-06T02:23:39.040282+0000","last_unstale":"2023-10-06T02:23:39.040730+0000","last_undegraded":"2023-10-06T02:23:39.040730+0000","last_fullsized":"2023-10-06T02:23:39.040730+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:54.217856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.045791+0000","last_change":"2023-10-06T02:23:38.006325+0000","last_active":"2023-10-06T02:23:39.045791+0000","last_peered":"2023-10-06T02:23:39.045791+0000","last_clean":"2023-10-06T02:23:39.045791+0000","last_became_active":"2023-10-06T02:23:38.006062+0000","last_became_peered":"2023-10-06T02:23:38.006062+0000","last_unstale":"2023-10-06T02:23:39.045791+0000","last_undegraded":"2023-10-06T02:23:39.045791+0000","last_fullsized":"2023-10-06T02:23:39.045791+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:17.206782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034106+0000","last_change":"2023-10-06T02:23:39.034106+0000","last_active":"2023-10-06T02:23:39.034106+0000","last_peered":"2023-10-06T02:23:39.034106+0000","last_clean":"2023-10-06T02:23:39.034106+0000","last_became_active":"2023-10-06T02:23:39.033791+0000","last_became_peered":"2023-10-06T02:23:39.033791+0000","last_unstale":"2023-10-06T02:23:39.034106+0000","last_undegraded":"2023-10-06T02:23:39.034106+0000","last_fullsized":"2023-10-06T02:23:39.034106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:56.050015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.045830+0000","last_change":"2023-10-06T02:23:38.005596+0000","last_active":"2023-10-06T02:23:39.045830+0000","last_peered":"2023-10-06T02:23:39.045830+0000","last_clean":"2023-10-06T02:23:39.045830+0000","last_became_active":"2023-10-06T02:23:38.005321+0000","last_became_peered":"2023-10-06T02:23:38.005321+0000","last_unstale":"2023-10-06T02:23:39.045830+0000","last_undegraded":"2023-10-06T02:23:39.045830+0000","last_fullsized":"2023-10-06T02:23:39.045830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:17.279027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034852+0000","last_change":"2023-10-06T02:23:39.023502+0000","last_active":"2023-10-06T02:23:39.034852+0000","last_peered":"2023-10-06T02:23:39.034852+0000","last_clean":"2023-10-06T02:23:39.034852+0000","last_became_active":"2023-10-06T02:23:39.023236+0000","last_became_peered":"2023-10-06T02:23:39.023236+0000","last_unstale":"2023-10-06T02:23:39.034852+0000","last_undegraded":"2023-10-06T02:23:39.034852+0000","last_fullsized":"2023-10-06T02:23:39.034852+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:29:35.320679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"81'1","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.051500+0000","last_change":"2023-10-06T02:23:38.005130+0000","last_active":"2023-10-06T02:23:39.051500+0000","last_peered":"2023-10-06T02:23:39.051500+0000","last_clean":"2023-10-06T02:23:39.051500+0000","last_became_active":"2023-10-06T02:23:38.004830+0000","last_became_peered":"2023-10-06T02:23:38.004830+0000","last_unstale":"2023-10-06T02:23:39.051500+0000","last_undegraded":"2023-10-06T02:23:39.051500+0000","last_fullsized":"2023-10-06T02:23:39.051500+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:09.696172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.038448+0000","last_change":"2023-10-06T02:23:39.034504+0000","last_active":"2023-10-06T02:23:39.038448+0000","last_peered":"2023-10-06T02:23:39.038448+0000","last_clean":"2023-10-06T02:23:39.038448+0000","last_became_active":"2023-10-06T02:23:39.034103+0000","last_became_peered":"2023-10-06T02:23:39.034103+0000","last_unstale":"2023-10-06T02:23:39.038448+0000","last_undegraded":"2023-10-06T02:23:39.038448+0000","last_fullsized":"2023-10-06T02:23:39.038448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:33.894382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"81'1","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.047556+0000","last_change":"2023-10-06T02:23:38.010649+0000","last_active":"2023-10-06T02:23:39.047556+0000","last_peered":"2023-10-06T02:23:39.047556+0000","last_clean":"2023-10-06T02:23:39.047556+0000","last_became_active":"2023-10-06T02:23:38.010086+0000","last_became_peered":"2023-10-06T02:23:38.010086+0000","last_unstale":"2023-10-06T02:23:39.047556+0000","last_undegraded":"2023-10-06T02:23:39.047556+0000","last_fullsized":"2023-10-06T02:23:39.047556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:44.091736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.032819+0000","last_change":"2023-10-06T02:23:39.032819+0000","last_active":"2023-10-06T02:23:39.032819+0000","last_peered":"2023-10-06T02:23:39.032819+0000","last_clean":"2023-10-06T02:23:39.032819+0000","last_became_active":"2023-10-06T02:23:39.032554+0000","last_became_peered":"2023-10-06T02:23:39.032554+0000","last_unstale":"2023-10-06T02:23:39.032819+0000","last_undegraded":"2023-10-06T02:23:39.032819+0000","last_fullsized":"2023-10-06T02:23:39.032819+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:11:53.896892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.014884+0000","last_change":"2023-10-06T02:23:38.004534+0000","last_active":"2023-10-06T02:23:39.014884+0000","last_peered":"2023-10-06T02:23:39.014884+0000","last_clean":"2023-10-06T02:23:39.014884+0000","last_became_active":"2023-10-06T02:23:38.004234+0000","last_became_peered":"2023-10-06T02:23:38.004234+0000","last_unstale":"2023-10-06T02:23:39.014884+0000","last_undegraded":"2023-10-06T02:23:39.014884+0000","last_fullsized":"2023-10-06T02:23:39.014884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:17.504757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.026721+0000","last_change":"2023-10-06T02:23:39.026721+0000","last_active":"2023-10-06T02:23:39.026721+0000","last_peered":"2023-10-06T02:23:39.026721+0000","last_clean":"2023-10-06T02:23:39.026721+0000","last_became_active":"2023-10-06T02:23:39.026297+0000","last_became_peered":"2023-10-06T02:23:39.026297+0000","last_unstale":"2023-10-06T02:23:39.026721+0000","last_undegraded":"2023-10-06T02:23:39.026721+0000","last_fullsized":"2023-10-06T02:23:39.026721+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:18.766495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.012727+0000","last_change":"2023-10-06T02:23:38.001760+0000","last_active":"2023-10-06T02:23:39.012727+0000","last_peered":"2023-10-06T02:23:39.012727+0000","last_clean":"2023-10-06T02:23:39.012727+0000","last_became_active":"2023-10-06T02:23:38.001483+0000","last_became_peered":"2023-10-06T02:23:38.001483+0000","last_unstale":"2023-10-06T02:23:39.012727+0000","last_undegraded":"2023-10-06T02:23:39.012727+0000","last_fullsized":"2023-10-06T02:23:39.012727+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:05.190140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.037340+0000","last_change":"2023-10-06T02:23:39.037340+0000","last_active":"2023-10-06T02:23:39.037340+0000","last_peered":"2023-10-06T02:23:39.037340+0000","last_clean":"2023-10-06T02:23:39.037340+0000","last_became_active":"2023-10-06T02:23:39.037067+0000","last_became_peered":"2023-10-06T02:23:39.037067+0000","last_unstale":"2023-10-06T02:23:39.037340+0000","last_undegraded":"2023-10-06T02:23:39.037340+0000","last_fullsized":"2023-10-06T02:23:39.037340+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:47.974451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.015183+0000","last_change":"2023-10-06T02:23:38.014299+0000","last_active":"2023-10-06T02:23:38.015183+0000","last_peered":"2023-10-06T02:23:38.015183+0000","last_clean":"2023-10-06T02:23:38.015183+0000","last_became_active":"2023-10-06T02:23:38.014113+0000","last_became_peered":"2023-10-06T02:23:38.014113+0000","last_unstale":"2023-10-06T02:23:38.015183+0000","last_undegraded":"2023-10-06T02:23:38.015183+0000","last_fullsized":"2023-10-06T02:23:38.015183+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:41.396763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.029768+0000","last_change":"2023-10-06T02:23:39.026084+0000","last_active":"2023-10-06T02:23:39.029768+0000","last_peered":"2023-10-06T02:23:39.029768+0000","last_clean":"2023-10-06T02:23:39.029768+0000","last_became_active":"2023-10-06T02:23:39.025774+0000","last_became_peered":"2023-10-06T02:23:39.025774+0000","last_unstale":"2023-10-06T02:23:39.029768+0000","last_undegraded":"2023-10-06T02:23:39.029768+0000","last_fullsized":"2023-10-06T02:23:39.029768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:15.707312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.014615+0000","last_change":"2023-10-06T02:23:38.010406+0000","last_active":"2023-10-06T02:23:38.014615+0000","last_peered":"2023-10-06T02:23:38.014615+0000","last_clean":"2023-10-06T02:23:38.014615+0000","last_became_active":"2023-10-06T02:23:38.010155+0000","last_became_peered":"2023-10-06T02:23:38.010155+0000","last_unstale":"2023-10-06T02:23:38.014615+0000","last_undegraded":"2023-10-06T02:23:38.014615+0000","last_fullsized":"2023-10-06T02:23:38.014615+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:59.083799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.030548+0000","last_change":"2023-10-06T02:23:39.025305+0000","last_active":"2023-10-06T02:23:39.030548+0000","last_peered":"2023-10-06T02:23:39.030548+0000","last_clean":"2023-10-06T02:23:39.030548+0000","last_became_active":"2023-10-06T02:23:39.025003+0000","last_became_peered":"2023-10-06T02:23:39.025003+0000","last_unstale":"2023-10-06T02:23:39.030548+0000","last_undegraded":"2023-10-06T02:23:39.030548+0000","last_fullsized":"2023-10-06T02:23:39.030548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:11.615891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"81'3","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.051697+0000","last_change":"2023-10-06T02:23:38.016201+0000","last_active":"2023-10-06T02:23:39.051697+0000","last_peered":"2023-10-06T02:23:39.051697+0000","last_clean":"2023-10-06T02:23:39.051697+0000","last_became_active":"2023-10-06T02:23:38.015032+0000","last_became_peered":"2023-10-06T02:23:38.015032+0000","last_unstale":"2023-10-06T02:23:39.051697+0000","last_undegraded":"2023-10-06T02:23:39.051697+0000","last_fullsized":"2023-10-06T02:23:39.051697+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:15.567304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.038485+0000","last_change":"2023-10-06T02:23:39.034165+0000","last_active":"2023-10-06T02:23:39.038485+0000","last_peered":"2023-10-06T02:23:39.038485+0000","last_clean":"2023-10-06T02:23:39.038485+0000","last_became_active":"2023-10-06T02:23:39.033699+0000","last_became_peered":"2023-10-06T02:23:39.033699+0000","last_unstale":"2023-10-06T02:23:39.038485+0000","last_undegraded":"2023-10-06T02:23:39.038485+0000","last_fullsized":"2023-10-06T02:23:39.038485+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:11.615891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"81'6","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.052837+0000","last_change":"2023-10-06T02:23:38.004401+0000","last_active":"2023-10-06T02:23:39.052837+0000","last_peered":"2023-10-06T02:23:39.052837+0000","last_clean":"2023-10-06T02:23:39.052837+0000","last_became_active":"2023-10-06T02:23:38.004128+0000","last_became_peered":"2023-10-06T02:23:38.004128+0000","last_unstale":"2023-10-06T02:23:39.052837+0000","last_undegraded":"2023-10-06T02:23:39.052837+0000","last_fullsized":"2023-10-06T02:23:39.052837+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:46.786081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034137+0000","last_change":"2023-10-06T02:23:39.028535+0000","last_active":"2023-10-06T02:23:39.034137+0000","last_peered":"2023-10-06T02:23:39.034137+0000","last_clean":"2023-10-06T02:23:39.034137+0000","last_became_active":"2023-10-06T02:23:39.028257+0000","last_became_peered":"2023-10-06T02:23:39.028257+0000","last_unstale":"2023-10-06T02:23:39.034137+0000","last_undegraded":"2023-10-06T02:23:39.034137+0000","last_fullsized":"2023-10-06T02:23:39.034137+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:33.894382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.042737+0000","last_change":"2023-10-06T02:23:37.999510+0000","last_active":"2023-10-06T02:23:39.042737+0000","last_peered":"2023-10-06T02:23:39.042737+0000","last_clean":"2023-10-06T02:23:39.042737+0000","last_became_active":"2023-10-06T02:23:37.999194+0000","last_became_peered":"2023-10-06T02:23:37.999194+0000","last_unstale":"2023-10-06T02:23:39.042737+0000","last_undegraded":"2023-10-06T02:23:39.042737+0000","last_fullsized":"2023-10-06T02:23:39.042737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:50:53.382095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.036125+0000","last_change":"2023-10-06T02:23:39.036125+0000","last_active":"2023-10-06T02:23:39.036125+0000","last_peered":"2023-10-06T02:23:39.036125+0000","last_clean":"2023-10-06T02:23:39.036125+0000","last_became_active":"2023-10-06T02:23:39.035130+0000","last_became_peered":"2023-10-06T02:23:39.035130+0000","last_unstale":"2023-10-06T02:23:39.036125+0000","last_undegraded":"2023-10-06T02:23:39.036125+0000","last_fullsized":"2023-10-06T02:23:39.036125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:15.077499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.008121+0000","last_change":"2023-10-06T02:23:38.003234+0000","last_active":"2023-10-06T02:23:38.008121+0000","last_peered":"2023-10-06T02:23:38.008121+0000","last_clean":"2023-10-06T02:23:38.008121+0000","last_became_active":"2023-10-06T02:23:38.002979+0000","last_became_peered":"2023-10-06T02:23:38.002979+0000","last_unstale":"2023-10-06T02:23:38.008121+0000","last_undegraded":"2023-10-06T02:23:38.008121+0000","last_fullsized":"2023-10-06T02:23:38.008121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:32.315694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034689+0000","last_change":"2023-10-06T02:23:39.023083+0000","last_active":"2023-10-06T02:23:39.034689+0000","last_peered":"2023-10-06T02:23:39.034689+0000","last_clean":"2023-10-06T02:23:39.034689+0000","last_became_active":"2023-10-06T02:23:39.022682+0000","last_became_peered":"2023-10-06T02:23:39.022682+0000","last_unstale":"2023-10-06T02:23:39.034689+0000","last_undegraded":"2023-10-06T02:23:39.034689+0000","last_fullsized":"2023-10-06T02:23:39.034689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:00.088328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.017866+0000","last_change":"2023-10-06T02:23:38.006475+0000","last_active":"2023-10-06T02:23:39.017866+0000","last_peered":"2023-10-06T02:23:39.017866+0000","last_clean":"2023-10-06T02:23:39.017866+0000","last_became_active":"2023-10-06T02:23:38.006213+0000","last_became_peered":"2023-10-06T02:23:38.006213+0000","last_unstale":"2023-10-06T02:23:39.017866+0000","last_undegraded":"2023-10-06T02:23:39.017866+0000","last_fullsized":"2023-10-06T02:23:39.017866+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:59.214835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034257+0000","last_change":"2023-10-06T02:23:39.027297+0000","last_active":"2023-10-06T02:23:39.034257+0000","last_peered":"2023-10-06T02:23:39.034257+0000","last_clean":"2023-10-06T02:23:39.034257+0000","last_became_active":"2023-10-06T02:23:39.027039+0000","last_became_peered":"2023-10-06T02:23:39.027039+0000","last_unstale":"2023-10-06T02:23:39.034257+0000","last_undegraded":"2023-10-06T02:23:39.034257+0000","last_fullsized":"2023-10-06T02:23:39.034257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:42.401292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"81'8","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.045079+0000","last_change":"2023-10-06T02:23:37.998880+0000","last_active":"2023-10-06T02:23:39.045079+0000","last_peered":"2023-10-06T02:23:39.045079+0000","last_clean":"2023-10-06T02:23:39.045079+0000","last_became_active":"2023-10-06T02:23:37.998377+0000","last_became_peered":"2023-10-06T02:23:37.998377+0000","last_unstale":"2023-10-06T02:23:39.045079+0000","last_undegraded":"2023-10-06T02:23:39.045079+0000","last_fullsized":"2023-10-06T02:23:39.045079+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:07.401975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.033257+0000","last_change":"2023-10-06T02:23:39.028791+0000","last_active":"2023-10-06T02:23:39.033257+0000","last_peered":"2023-10-06T02:23:39.033257+0000","last_clean":"2023-10-06T02:23:39.033257+0000","last_became_active":"2023-10-06T02:23:39.028510+0000","last_became_peered":"2023-10-06T02:23:39.028510+0000","last_unstale":"2023-10-06T02:23:39.033257+0000","last_undegraded":"2023-10-06T02:23:39.033257+0000","last_fullsized":"2023-10-06T02:23:39.033257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:42.364794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.038995+0000","last_change":"2023-10-06T02:23:38.008280+0000","last_active":"2023-10-06T02:23:39.038995+0000","last_peered":"2023-10-06T02:23:39.038995+0000","last_clean":"2023-10-06T02:23:39.038995+0000","last_became_active":"2023-10-06T02:23:38.008032+0000","last_became_peered":"2023-10-06T02:23:38.008032+0000","last_unstale":"2023-10-06T02:23:39.038995+0000","last_undegraded":"2023-10-06T02:23:39.038995+0000","last_fullsized":"2023-10-06T02:23:39.038995+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:47.848239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034470+0000","last_change":"2023-10-06T02:23:39.034470+0000","last_active":"2023-10-06T02:23:39.034470+0000","last_peered":"2023-10-06T02:23:39.034470+0000","last_clean":"2023-10-06T02:23:39.034470+0000","last_became_active":"2023-10-06T02:23:39.034171+0000","last_became_peered":"2023-10-06T02:23:39.034171+0000","last_unstale":"2023-10-06T02:23:39.034470+0000","last_undegraded":"2023-10-06T02:23:39.034470+0000","last_fullsized":"2023-10-06T02:23:39.034470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:18.283557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.013485+0000","last_change":"2023-10-06T02:23:37.998331+0000","last_active":"2023-10-06T02:23:39.013485+0000","last_peered":"2023-10-06T02:23:39.013485+0000","last_clean":"2023-10-06T02:23:39.013485+0000","last_became_active":"2023-10-06T02:23:37.997994+0000","last_became_peered":"2023-10-06T02:23:37.997994+0000","last_unstale":"2023-10-06T02:23:39.013485+0000","last_undegraded":"2023-10-06T02:23:39.013485+0000","last_fullsized":"2023-10-06T02:23:39.013485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:27.439211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.036383+0000","last_change":"2023-10-06T02:23:39.036383+0000","last_active":"2023-10-06T02:23:39.036383+0000","last_peered":"2023-10-06T02:23:39.036383+0000","last_clean":"2023-10-06T02:23:39.036383+0000","last_became_active":"2023-10-06T02:23:39.036086+0000","last_became_peered":"2023-10-06T02:23:39.036086+0000","last_unstale":"2023-10-06T02:23:39.036383+0000","last_undegraded":"2023-10-06T02:23:39.036383+0000","last_fullsized":"2023-10-06T02:23:39.036383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:12.457199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.016685+0000","last_change":"2023-10-06T02:23:38.015995+0000","last_active":"2023-10-06T02:23:38.016685+0000","last_peered":"2023-10-06T02:23:38.016685+0000","last_clean":"2023-10-06T02:23:38.016685+0000","last_became_active":"2023-10-06T02:23:38.014929+0000","last_became_peered":"2023-10-06T02:23:38.014929+0000","last_unstale":"2023-10-06T02:23:38.016685+0000","last_undegraded":"2023-10-06T02:23:38.016685+0000","last_fullsized":"2023-10-06T02:23:38.016685+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:59.214835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.036131+0000","last_change":"2023-10-06T02:23:39.030196+0000","last_active":"2023-10-06T02:23:39.036131+0000","last_peered":"2023-10-06T02:23:39.036131+0000","last_clean":"2023-10-06T02:23:39.036131+0000","last_became_active":"2023-10-06T02:23:39.029908+0000","last_became_peered":"2023-10-06T02:23:39.029908+0000","last_unstale":"2023-10-06T02:23:39.036131+0000","last_undegraded":"2023-10-06T02:23:39.036131+0000","last_fullsized":"2023-10-06T02:23:39.036131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:32.059897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.014587+0000","last_change":"2023-10-06T02:23:38.009826+0000","last_active":"2023-10-06T02:23:38.014587+0000","last_peered":"2023-10-06T02:23:38.014587+0000","last_clean":"2023-10-06T02:23:38.014587+0000","last_became_active":"2023-10-06T02:23:38.009557+0000","last_became_peered":"2023-10-06T02:23:38.009557+0000","last_unstale":"2023-10-06T02:23:38.014587+0000","last_undegraded":"2023-10-06T02:23:38.014587+0000","last_fullsized":"2023-10-06T02:23:38.014587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:29:34.316149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034716+0000","last_change":"2023-10-06T02:23:39.031004+0000","last_active":"2023-10-06T02:23:39.034716+0000","last_peered":"2023-10-06T02:23:39.034716+0000","last_clean":"2023-10-06T02:23:39.034716+0000","last_became_active":"2023-10-06T02:23:39.030690+0000","last_became_peered":"2023-10-06T02:23:39.030690+0000","last_unstale":"2023-10-06T02:23:39.034716+0000","last_undegraded":"2023-10-06T02:23:39.034716+0000","last_fullsized":"2023-10-06T02:23:39.034716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:38.840914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.016336+0000","last_change":"2023-10-06T02:23:38.008082+0000","last_active":"2023-10-06T02:23:39.016336+0000","last_peered":"2023-10-06T02:23:39.016336+0000","last_clean":"2023-10-06T02:23:39.016336+0000","last_became_active":"2023-10-06T02:23:38.007800+0000","last_became_peered":"2023-10-06T02:23:38.007800+0000","last_unstale":"2023-10-06T02:23:39.016336+0000","last_undegraded":"2023-10-06T02:23:39.016336+0000","last_fullsized":"2023-10-06T02:23:39.016336+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:09.696172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034174+0000","last_change":"2023-10-06T02:23:39.028418+0000","last_active":"2023-10-06T02:23:39.034174+0000","last_peered":"2023-10-06T02:23:39.034174+0000","last_clean":"2023-10-06T02:23:39.034174+0000","last_became_active":"2023-10-06T02:23:39.028135+0000","last_became_peered":"2023-10-06T02:23:39.028135+0000","last_unstale":"2023-10-06T02:23:39.034174+0000","last_undegraded":"2023-10-06T02:23:39.034174+0000","last_fullsized":"2023-10-06T02:23:39.034174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:32.059897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.024656+0000","last_change":"2023-10-06T02:23:38.010172+0000","last_active":"2023-10-06T02:23:39.024656+0000","last_peered":"2023-10-06T02:23:39.024656+0000","last_clean":"2023-10-06T02:23:39.024656+0000","last_became_active":"2023-10-06T02:23:38.009721+0000","last_became_peered":"2023-10-06T02:23:38.009721+0000","last_unstale":"2023-10-06T02:23:39.024656+0000","last_undegraded":"2023-10-06T02:23:39.024656+0000","last_fullsized":"2023-10-06T02:23:39.024656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:16.459477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.035758+0000","last_change":"2023-10-06T02:23:39.035758+0000","last_active":"2023-10-06T02:23:39.035758+0000","last_peered":"2023-10-06T02:23:39.035758+0000","last_clean":"2023-10-06T02:23:39.035758+0000","last_became_active":"2023-10-06T02:23:39.035433+0000","last_became_peered":"2023-10-06T02:23:39.035433+0000","last_unstale":"2023-10-06T02:23:39.035758+0000","last_undegraded":"2023-10-06T02:23:39.035758+0000","last_fullsized":"2023-10-06T02:23:39.035758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:10.700701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.014179+0000","last_change":"2023-10-06T02:23:38.009991+0000","last_active":"2023-10-06T02:23:38.014179+0000","last_peered":"2023-10-06T02:23:38.014179+0000","last_clean":"2023-10-06T02:23:38.014179+0000","last_became_active":"2023-10-06T02:23:38.009732+0000","last_became_peered":"2023-10-06T02:23:38.009732+0000","last_unstale":"2023-10-06T02:23:38.014179+0000","last_undegraded":"2023-10-06T02:23:38.014179+0000","last_fullsized":"2023-10-06T02:23:38.014179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:00.291533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.023666+0000","last_change":"2023-10-06T02:23:39.023666+0000","last_active":"2023-10-06T02:23:39.023666+0000","last_peered":"2023-10-06T02:23:39.023666+0000","last_clean":"2023-10-06T02:23:39.023666+0000","last_became_active":"2023-10-06T02:23:39.023372+0000","last_became_peered":"2023-10-06T02:23:39.023372+0000","last_unstale":"2023-10-06T02:23:39.023666+0000","last_undegraded":"2023-10-06T02:23:39.023666+0000","last_fullsized":"2023-10-06T02:23:39.023666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:15.707312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.024334+0000","last_change":"2023-10-06T02:23:38.011348+0000","last_active":"2023-10-06T02:23:39.024334+0000","last_peered":"2023-10-06T02:23:39.024334+0000","last_clean":"2023-10-06T02:23:39.024334+0000","last_became_active":"2023-10-06T02:23:38.011074+0000","last_became_peered":"2023-10-06T02:23:38.011074+0000","last_unstale":"2023-10-06T02:23:39.024334+0000","last_undegraded":"2023-10-06T02:23:39.024334+0000","last_fullsized":"2023-10-06T02:23:39.024334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:53.213327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.033204+0000","last_change":"2023-10-06T02:23:39.027889+0000","last_active":"2023-10-06T02:23:39.033204+0000","last_peered":"2023-10-06T02:23:39.033204+0000","last_clean":"2023-10-06T02:23:39.033204+0000","last_became_active":"2023-10-06T02:23:39.027625+0000","last_became_peered":"2023-10-06T02:23:39.027625+0000","last_unstale":"2023-10-06T02:23:39.033204+0000","last_undegraded":"2023-10-06T02:23:39.033204+0000","last_fullsized":"2023-10-06T02:23:39.033204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:36.743640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.008244+0000","last_change":"2023-10-06T02:23:38.006895+0000","last_active":"2023-10-06T02:23:38.008244+0000","last_peered":"2023-10-06T02:23:38.008244+0000","last_clean":"2023-10-06T02:23:38.008244+0000","last_became_active":"2023-10-06T02:23:38.006631+0000","last_became_peered":"2023-10-06T02:23:38.006631+0000","last_unstale":"2023-10-06T02:23:38.008244+0000","last_undegraded":"2023-10-06T02:23:38.008244+0000","last_fullsized":"2023-10-06T02:23:38.008244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:17.206782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.025176+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:23:39.025176+0000","last_peered":"2023-10-06T02:23:39.025176+0000","last_clean":"2023-10-06T02:23:39.025176+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:23:39.025176+0000","last_undegraded":"2023-10-06T02:23:39.025176+0000","last_fullsized":"2023-10-06T02:23:39.025176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.023132+0000","last_change":"2023-10-06T02:23:39.023132+0000","last_active":"2023-10-06T02:23:39.023132+0000","last_peered":"2023-10-06T02:23:39.023132+0000","last_clean":"2023-10-06T02:23:39.023132+0000","last_became_active":"2023-10-06T02:23:39.020557+0000","last_became_peered":"2023-10-06T02:23:39.020557+0000","last_unstale":"2023-10-06T02:23:39.023132+0000","last_undegraded":"2023-10-06T02:23:39.023132+0000","last_fullsized":"2023-10-06T02:23:39.023132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:33:47.260759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.014493+0000","last_change":"2023-10-06T02:23:38.010775+0000","last_active":"2023-10-06T02:23:38.014493+0000","last_peered":"2023-10-06T02:23:38.014493+0000","last_clean":"2023-10-06T02:23:38.014493+0000","last_became_active":"2023-10-06T02:23:38.010483+0000","last_became_peered":"2023-10-06T02:23:38.010483+0000","last_unstale":"2023-10-06T02:23:38.014493+0000","last_undegraded":"2023-10-06T02:23:38.014493+0000","last_fullsized":"2023-10-06T02:23:38.014493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:18.860068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:37.998650+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:23:37.998650+0000","last_peered":"2023-10-06T02:23:37.998650+0000","last_clean":"2023-10-06T02:23:37.998650+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:23:37.998650+0000","last_undegraded":"2023-10-06T02:23:37.998650+0000","last_fullsized":"2023-10-06T02:23:37.998650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.026562+0000","last_change":"2023-10-06T02:23:39.026562+0000","last_active":"2023-10-06T02:23:39.026562+0000","last_peered":"2023-10-06T02:23:39.026562+0000","last_clean":"2023-10-06T02:23:39.026562+0000","last_became_active":"2023-10-06T02:23:39.026206+0000","last_became_peered":"2023-10-06T02:23:39.026206+0000","last_unstale":"2023-10-06T02:23:39.026562+0000","last_undegraded":"2023-10-06T02:23:39.026562+0000","last_fullsized":"2023-10-06T02:23:39.026562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:12.412374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.043954+0000","last_change":"2023-10-06T02:23:38.005053+0000","last_active":"2023-10-06T02:23:39.043954+0000","last_peered":"2023-10-06T02:23:39.043954+0000","last_clean":"2023-10-06T02:23:39.043954+0000","last_became_active":"2023-10-06T02:23:38.004779+0000","last_became_peered":"2023-10-06T02:23:38.004779+0000","last_unstale":"2023-10-06T02:23:39.043954+0000","last_undegraded":"2023-10-06T02:23:39.043954+0000","last_fullsized":"2023-10-06T02:23:39.043954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:32.315694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.014073+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:23:39.014073+0000","last_peered":"2023-10-06T02:23:39.014073+0000","last_clean":"2023-10-06T02:23:39.014073+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:23:39.014073+0000","last_undegraded":"2023-10-06T02:23:39.014073+0000","last_fullsized":"2023-10-06T02:23:39.014073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":216,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:37.998074+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:23:37.998074+0000","last_peered":"2023-10-06T02:23:37.998074+0000","last_clean":"2023-10-06T02:23:37.998074+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:23:37.998074+0000","last_undegraded":"2023-10-06T02:23:37.998074+0000","last_fullsized":"2023-10-06T02:23:37.998074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.025844+0000","last_change":"2023-10-06T02:23:39.025844+0000","last_active":"2023-10-06T02:23:39.025844+0000","last_peered":"2023-10-06T02:23:39.025844+0000","last_clean":"2023-10-06T02:23:39.025844+0000","last_became_active":"2023-10-06T02:23:39.025551+0000","last_became_peered":"2023-10-06T02:23:39.025551+0000","last_unstale":"2023-10-06T02:23:39.025844+0000","last_undegraded":"2023-10-06T02:23:39.025844+0000","last_fullsized":"2023-10-06T02:23:39.025844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:17.464006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"81'1","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.019857+0000","last_change":"2023-10-06T02:23:38.013844+0000","last_active":"2023-10-06T02:23:39.019857+0000","last_peered":"2023-10-06T02:23:39.019857+0000","last_clean":"2023-10-06T02:23:39.019857+0000","last_became_active":"2023-10-06T02:23:38.011236+0000","last_became_peered":"2023-10-06T02:23:38.011236+0000","last_unstale":"2023-10-06T02:23:39.019857+0000","last_undegraded":"2023-10-06T02:23:39.019857+0000","last_fullsized":"2023-10-06T02:23:39.019857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:55.185347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:37.997834+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:23:37.997834+0000","last_peered":"2023-10-06T02:23:37.997834+0000","last_clean":"2023-10-06T02:23:37.997834+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:23:37.997834+0000","last_undegraded":"2023-10-06T02:23:37.997834+0000","last_fullsized":"2023-10-06T02:23:37.997834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034389+0000","last_change":"2023-10-06T02:23:39.023058+0000","last_active":"2023-10-06T02:23:39.034389+0000","last_peered":"2023-10-06T02:23:39.034389+0000","last_clean":"2023-10-06T02:23:39.034389+0000","last_became_active":"2023-10-06T02:23:39.022343+0000","last_became_peered":"2023-10-06T02:23:39.022343+0000","last_unstale":"2023-10-06T02:23:39.034389+0000","last_undegraded":"2023-10-06T02:23:39.034389+0000","last_fullsized":"2023-10-06T02:23:39.034389+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:42.992590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"81'1","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.021462+0000","last_change":"2023-10-06T02:23:38.005914+0000","last_active":"2023-10-06T02:23:39.021462+0000","last_peered":"2023-10-06T02:23:39.021462+0000","last_clean":"2023-10-06T02:23:39.021462+0000","last_became_active":"2023-10-06T02:23:38.005612+0000","last_became_peered":"2023-10-06T02:23:38.005612+0000","last_unstale":"2023-10-06T02:23:39.021462+0000","last_undegraded":"2023-10-06T02:23:39.021462+0000","last_fullsized":"2023-10-06T02:23:39.021462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:25:38.782541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:37.997984+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:23:37.997984+0000","last_peered":"2023-10-06T02:23:37.997984+0000","last_clean":"2023-10-06T02:23:37.997984+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:23:37.997984+0000","last_undegraded":"2023-10-06T02:23:37.997984+0000","last_fullsized":"2023-10-06T02:23:37.997984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.038503+0000","last_change":"2023-10-06T02:23:39.035381+0000","last_active":"2023-10-06T02:23:39.038503+0000","last_peered":"2023-10-06T02:23:39.038503+0000","last_clean":"2023-10-06T02:23:39.038503+0000","last_became_active":"2023-10-06T02:23:39.035123+0000","last_became_peered":"2023-10-06T02:23:39.035123+0000","last_unstale":"2023-10-06T02:23:39.038503+0000","last_undegraded":"2023-10-06T02:23:39.038503+0000","last_fullsized":"2023-10-06T02:23:39.038503+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:19.377075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.015799+0000","last_change":"2023-10-06T02:23:38.004747+0000","last_active":"2023-10-06T02:23:39.015799+0000","last_peered":"2023-10-06T02:23:39.015799+0000","last_clean":"2023-10-06T02:23:39.015799+0000","last_became_active":"2023-10-06T02:23:38.003857+0000","last_became_peered":"2023-10-06T02:23:38.003857+0000","last_unstale":"2023-10-06T02:23:39.015799+0000","last_undegraded":"2023-10-06T02:23:39.015799+0000","last_fullsized":"2023-10-06T02:23:39.015799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:00.918150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.018441+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:23:39.018441+0000","last_peered":"2023-10-06T02:23:39.018441+0000","last_clean":"2023-10-06T02:23:39.018441+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:23:39.018441+0000","last_undegraded":"2023-10-06T02:23:39.018441+0000","last_fullsized":"2023-10-06T02:23:39.018441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.031947+0000","last_change":"2023-10-06T02:23:39.031947+0000","last_active":"2023-10-06T02:23:39.031947+0000","last_peered":"2023-10-06T02:23:39.031947+0000","last_clean":"2023-10-06T02:23:39.031947+0000","last_became_active":"2023-10-06T02:23:39.031300+0000","last_became_peered":"2023-10-06T02:23:39.031300+0000","last_unstale":"2023-10-06T02:23:39.031947+0000","last_undegraded":"2023-10-06T02:23:39.031947+0000","last_fullsized":"2023-10-06T02:23:39.031947+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:18.664186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"81'2","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.043707+0000","last_change":"2023-10-06T02:23:38.006130+0000","last_active":"2023-10-06T02:23:39.043707+0000","last_peered":"2023-10-06T02:23:39.043707+0000","last_clean":"2023-10-06T02:23:39.043707+0000","last_became_active":"2023-10-06T02:23:38.005851+0000","last_became_peered":"2023-10-06T02:23:38.005851+0000","last_unstale":"2023-10-06T02:23:39.043707+0000","last_undegraded":"2023-10-06T02:23:39.043707+0000","last_fullsized":"2023-10-06T02:23:39.043707+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:00.918150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":65,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.006734+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:23:38.006734+0000","last_peered":"2023-10-06T02:23:38.006734+0000","last_clean":"2023-10-06T02:23:38.006734+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:23:38.006734+0000","last_undegraded":"2023-10-06T02:23:38.006734+0000","last_fullsized":"2023-10-06T02:23:38.006734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:23:39.034824+0000","last_change":"2023-10-06T02:23:39.031959+0000","last_active":"2023-10-06T02:23:39.034824+0000","last_peered":"2023-10-06T02:23:39.034824+0000","last_clean":"2023-10-06T02:23:39.034824+0000","last_became_active":"2023-10-06T02:23:39.031626+0000","last_became_peered":"2023-10-06T02:23:39.031626+0000","last_unstale":"2023-10-06T02:23:39.034824+0000","last_undegraded":"2023-10-06T02:23:39.034824+0000","last_fullsized":"2023-10-06T02:23:39.034824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:37.985803+0000","last_clean_scrub_stamp":"2023-10-06T02:23:37.985803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:25:39.787070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.006935+0000","last_change":"2023-10-06T02:23:38.001773+0000","last_active":"2023-10-06T02:23:38.006935+0000","last_peered":"2023-10-06T02:23:38.006935+0000","last_clean":"2023-10-06T02:23:38.006935+0000","last_became_active":"2023-10-06T02:23:38.001504+0000","last_became_peered":"2023-10-06T02:23:38.001504+0000","last_unstale":"2023-10-06T02:23:38.006935+0000","last_undegraded":"2023-10-06T02:23:38.006935+0000","last_fullsized":"2023-10-06T02:23:38.006935+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:36.981274+0000","last_clean_scrub_stamp":"2023-10-06T02:23:36.981274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:13.135563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":65,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T02:23:38.006853+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:23:38.006853+0000","last_peered":"2023-10-06T02:23:38.006853+0000","last_clean":"2023-10-06T02:23:38.006853+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:23:38.006853+0000","last_undegraded":"2023-10-06T02:23:38.006853+0000","last_fullsized":"2023-10-06T02:23:38.006853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298840,"kb_used_data":1552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073000,"statfs":{"total":96636764160,"available":96330752000,"internally_reserved":0,"allocated":1589248,"data_stored":1065658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.53900000000000003,"15min":0.501},"min":{"1min":0.45900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78100000000000003,"5min":1.111,"15min":1.111},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52700000000000002,"15min":0.49199999999999999},"min":{"1min":0.46400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70599999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.51500000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54800000000000004,"15min":0.51500000000000001},"min":{"1min":0.39500000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77500000000000002,"5min":1.008,"15min":1.008},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54300000000000004,"15min":0.51400000000000001},"min":{"1min":0.434,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74299999999999999,"5min":1.075,"15min":1.075},"last":0.53300000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.81899999999999995,"5min":1.149,"15min":1.149},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61099999999999999,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80800000000000005,"5min":1.048,"15min":1.048},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.53200000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.72799999999999998,"5min":1.175,"15min":1.175},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59799999999999998,"15min":0.57099999999999995},"min":{"1min":0.46500000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82299999999999995,"5min":1.03,"15min":1.03},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48199999999999998,"15min":0.48599999999999999},"min":{"1min":0.30599999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59799999999999998,"5min":0.873,"15min":0.873},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52600000000000002,"15min":0.53300000000000003},"min":{"1min":0.374,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68999999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.442}]},{"osd":5,"last update":"Fri Oct 6 02:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.33700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.64900000000000002,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71899999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.46000000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:22:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.67300000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.498},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298264,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073576,"statfs":{"total":96636764160,"available":96331341824,"internally_reserved":0,"allocated":999424,"data_stored":474933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.63100000000000001,"15min":0.80300000000000005},"min":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76200000000000001,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64200000000000002,"15min":0.81799999999999995},"min":{"1min":0.433,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73299999999999998,"5min":5.7060000000000004,"15min":5.7060000000000004},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.71299999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57199999999999995,"15min":0.52700000000000002},"min":{"1min":0.47999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.748,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53300000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.67800000000000005,"15min":0.96999999999999997},"min":{"1min":0.41699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82299999999999995,"5min":8.8659999999999997,"15min":8.8659999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.56799999999999995,"15min":0.55400000000000005},"min":{"1min":0.41399999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.72599999999999998,"15min":1.0700000000000001},"min":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81000000000000005,"5min":10.659000000000001,"15min":10.659000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.42699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77500000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59799999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48599999999999999,"15min":0.51200000000000001},"min":{"1min":0.312,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51900000000000002,"15min":0.54500000000000004},"min":{"1min":0.34599999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71999999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51600000000000001,"15min":0.55400000000000005},"min":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.316,"15min":0.316},"max":{"1min":0.82699999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.66600000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56599999999999995,"15min":0.58999999999999997},"min":{"1min":0.34999999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.749,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.755},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59899999999999998,"15min":0.63100000000000001},"min":{"1min":0.442,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.748,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.70399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298856,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072984,"statfs":{"total":96636764160,"available":96330735616,"internally_reserved":0,"allocated":1605632,"data_stored":1071790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.372,"15min":0.34999999999999998},"min":{"1min":0.314,"5min":0.19,"15min":0.19},"max":{"1min":0.52700000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.437},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.39200000000000002,"15min":0.35899999999999999},"min":{"1min":0.34699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.32500000000000001},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.40400000000000003,"15min":0.38300000000000001},"min":{"1min":0.29099999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.621}]},{"osd":3,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.42299999999999999,"15min":0.38300000000000001},"min":{"1min":0.42899999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.40600000000000003,"15min":0.38400000000000001},"min":{"1min":0.36499999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.58799999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.60099999999999998,"15min":0.56200000000000006},"min":{"1min":0.45300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.60799999999999998,"15min":0.57999999999999996},"min":{"1min":0.48599999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.59499999999999997},"min":{"1min":0.51600000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.65800000000000003,"15min":0.625},"min":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.629,"15min":0.59199999999999997},"min":{"1min":0.52900000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.628,"15min":0.59299999999999997},"min":{"1min":0.44400000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.81799999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.65000000000000002,"15min":0.621},"min":{"1min":0.55300000000000005,"5min":0.378,"15min":0.378},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.754},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.63400000000000001,"15min":0.60599999999999998},"min":{"1min":0.57499999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.70999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574924,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298260,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073580,"statfs":{"total":96636764160,"available":96331345920,"internally_reserved":0,"allocated":995328,"data_stored":475254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.309},"min":{"1min":0.255,"5min":0.183,"15min":0.183},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.38800000000000001,"15min":0.34599999999999997},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.40400000000000003,"15min":0.372},"min":{"1min":0.33300000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56899999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.36199999999999999,"15min":0.33000000000000002},"min":{"1min":0.317,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.45600000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40200000000000002,"15min":0.38300000000000001},"min":{"1min":0.29899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.441,"15min":0.41299999999999998},"min":{"1min":0.34799999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.65000000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.51100000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.621,"15min":0.60699999999999998},"min":{"1min":0.54800000000000004,"5min":0.371,"15min":0.371},"max":{"1min":0.88100000000000001,"5min":1.369,"15min":1.369},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.61299999999999999,"15min":0.56000000000000005},"min":{"1min":0.50800000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78800000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.71899999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63200000000000001,"15min":0.60599999999999998},"min":{"1min":0.52600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.96499999999999997,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.64200000000000002,"15min":0.59999999999999998},"min":{"1min":0.52400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.80500000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.64800000000000002,"15min":0.624},"min":{"1min":0.48999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95299999999999996,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.65300000000000002,"15min":0.60499999999999998},"min":{"1min":0.55500000000000005,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.75}]},{"osd":7,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75900000000000001,"15min":1.0449999999999999},"min":{"1min":0.55800000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94099999999999995,"5min":11.138,"15min":11.138},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.67300000000000004,"15min":0.63500000000000001},"min":{"1min":0.59199999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90600000000000003,"5min":1.429,"15min":1.429},"last":0.76600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574924,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298256,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073584,"statfs":{"total":96636764160,"available":96331350016,"internally_reserved":0,"allocated":991232,"data_stored":474821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.376,"15min":0.37},"min":{"1min":0.30499999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.63700000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.374},"min":{"1min":0.28899999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.66500000000000004,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.375}]},{"osd":1,"last update":"Fri Oct 6 02:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.41999999999999998,"15min":0.38400000000000001},"min":{"1min":0.318,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.72599999999999998,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.435},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.443,"15min":0.40200000000000002},"min":{"1min":0.34200000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.79000000000000004,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.41299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.40000000000000002,"15min":0.374},"min":{"1min":0.28599999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.69099999999999995,"5min":1.423,"15min":1.423},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.44600000000000001,"15min":0.42299999999999999},"min":{"1min":0.371,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77100000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.60899999999999999,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.61699999999999999},"min":{"1min":0.51600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.73899999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.624,"15min":0.60699999999999998},"min":{"1min":0.47899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85599999999999998,"5min":1.304,"15min":1.304},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.629,"15min":0.623},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88200000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.72999999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92300000000000004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.64700000000000002,"15min":0.628},"min":{"1min":0.56299999999999994,"5min":0.443,"15min":0.443},"max":{"1min":0.96699999999999997,"5min":1.347,"15min":1.347},"last":0.75}]},{"osd":7,"last update":"Fri Oct 6 02:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95299999999999996,"5min":1.206,"15min":1.206},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.68400000000000005,"15min":0.67200000000000004},"min":{"1min":0.51600000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1,"5min":1.385,"15min":1.385},"last":0.65400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574924,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298268,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073572,"statfs":{"total":96636764160,"available":96331337728,"internally_reserved":0,"allocated":1003520,"data_stored":476756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.36099999999999999,"15min":0.36299999999999999},"min":{"1min":0.26400000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.55500000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.38,"15min":0.38700000000000001},"min":{"1min":0.29099999999999998,"5min":0.22,"15min":0.22},"max":{"1min":0.55500000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39200000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.30299999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.316},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.307,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.60499999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.34699999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.39900000000000002,"15min":0.40400000000000003},"min":{"1min":0.317,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.60099999999999998,"5min":0.624,"15min":0.624},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.41899999999999998,"15min":0.40899999999999997},"min":{"1min":0.372,"5min":0.246,"15min":0.246},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.377}]},{"osd":4,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.60299999999999998,"15min":0.58499999999999996},"min":{"1min":0.48199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89700000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.5},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81299999999999994,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.44400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.40400000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86899999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.63400000000000001,"15min":0.61699999999999999},"min":{"1min":0.51800000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86799999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.46600000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.61799999999999999,"15min":0.59099999999999997},"min":{"1min":0.45700000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82799999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.54800000000000004,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84099999999999997,"5min":1.391,"15min":1.391},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.53800000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84099999999999997,"5min":1.121,"15min":1.121},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.64000000000000001,"15min":0.60999999999999999},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.81000000000000005,"5min":0.874,"15min":0.874},"last":0.57899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298256,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073584,"statfs":{"total":96636764160,"available":96331350016,"internally_reserved":0,"allocated":991232,"data_stored":475220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.58599999999999997,"15min":0.54400000000000004},"min":{"1min":0.48299999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.81299999999999994,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.621,"15min":0.58999999999999997},"min":{"1min":0.495,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80100000000000005,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":1.7290000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.73699999999999999,"15min":1.141},"min":{"1min":0.5,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":17.879999999999999,"15min":17.879999999999999},"last":1.77},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.72499999999999998,"15min":1.123},"min":{"1min":0.46899999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78600000000000003,"5min":18.010999999999999,"15min":18.010999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57499999999999996,"15min":0.53000000000000003},"min":{"1min":0.436,"5min":0.309,"15min":0.309},"max":{"1min":0.77700000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":1.619},{"interface":"front","average":{"1min":0.629,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.51900000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76000000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":1.6639999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.57899999999999996,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.59299999999999997,"15min":0.56499999999999995},"min":{"1min":0.498,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.751}]},{"osd":5,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.33500000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.73399999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":1.532},{"interface":"front","average":{"1min":0.5,"5min":0.52200000000000002,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.65300000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51000000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53300000000000003,"15min":0.55700000000000005},"min":{"1min":0.33900000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.76400000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":1.5700000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.379,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77100000000000002,"5min":0.876,"15min":0.876},"last":1.4319999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.74199999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59899999999999998,"15min":0.61899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.49099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298284,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073556,"statfs":{"total":96636764160,"available":96331321344,"internally_reserved":0,"allocated":1019904,"data_stored":483739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.50900000000000001},"min":{"1min":0.379,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72999999999999998,"5min":1.103,"15min":1.103},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.45300000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.66700000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.54800000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59499999999999997,"15min":0.55900000000000005},"min":{"1min":0.45400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78000000000000003,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.58999999999999997,"15min":0.55200000000000005},"min":{"1min":0.51000000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.52700000000000002},"min":{"1min":0.40100000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.755,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.52000000000000002},"min":{"1min":0.41299999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71699999999999997,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.72999999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56999999999999995,"15min":0.54200000000000004},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.752,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58499999999999996,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.755,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48599999999999999,"15min":0.51000000000000001},"min":{"1min":0.32800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.66000000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.49299999999999999,"15min":0.501},"min":{"1min":0.32100000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69599999999999995,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.622}]},{"osd":6,"last update":"Fri Oct 6 02:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.502,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.752},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55000000000000004,"15min":0.57599999999999996},"min":{"1min":0.39300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70099999999999996,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:22:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53500000000000003,"15min":0.54700000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.67400000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.60399999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72599999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:23:43.528 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:23:43.529 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:23:43.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.688+0000 7f676548c700 1 Processor -- start 2023-10-06T02:23:43.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.688+0000 7f676548c700 1 -- start start 2023-10-06T02:23:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.689+0000 7f676548c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67600b2070 0x7f67600aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.689+0000 7f676548c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f67600aefe0 0x7f6760160d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.689+0000 7f676548c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67600af7f0 con 0x7f67601570e0 2023-10-06T02:23:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.689+0000 7f676548c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6760069570 con 0x7f67600b2070 2023-10-06T02:23:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.689+0000 7f676548c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67600687b0 con 0x7f67600aefe0 2023-10-06T02:23:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.689+0000 7f675f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67600b2070 0x7f67600aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.689+0000 7f675ffff700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f67601570e0 0x7f67600b1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:53640/0 (socket says 172.21.15.6:53640) 2023-10-06T02:23:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.689+0000 7f675f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67600b2070 0x7f67600aeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40256/0 (socket says 172.21.15.6:40256) 2023-10-06T02:23:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.689+0000 7f675ffff700 1 -- 172.21.15.6:0/3414316829 learned_addr learned my addr 172.21.15.6:0/3414316829 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.689+0000 7f6764c8b700 1 --2- 172.21.15.6:0/3414316829 >> v2:172.21.15.175:3300/0 conn(0x7f67600aefe0 0x7f6760160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.690+0000 7f675effd700 1 -- 172.21.15.6:0/3414316829 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952220053 0 0) 0x7f67600af7f0 con 0x7f67601570e0 2023-10-06T02:23:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.690+0000 7f675effd700 1 -- 172.21.15.6:0/3414316829 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f674c003570 con 0x7f67601570e0 2023-10-06T02:23:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.690+0000 7f675f7fe700 1 -- 172.21.15.6:0/3414316829 >> v2:172.21.15.175:3300/0 conn(0x7f67600aefe0 msgr2=0x7f6760160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.690+0000 7f675f7fe700 1 --2- 172.21.15.6:0/3414316829 >> v2:172.21.15.175:3300/0 conn(0x7f67600aefe0 0x7f6760160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.690+0000 7f675f7fe700 1 -- 172.21.15.6:0/3414316829 >> v1:172.21.15.175:6789/0 conn(0x7f67601570e0 legacy=0x7f67600b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.690+0000 7f675f7fe700 1 -- 172.21.15.6:0/3414316829 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6760068a90 con 0x7f67600b2070 2023-10-06T02:23:43.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.690+0000 7f675f7fe700 1 --2- 172.21.15.6:0/3414316829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67600b2070 0x7f67600aeaa0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f676006e650 tx=0x7f67480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9e51324951b5b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:43.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.690+0000 7f675effd700 1 -- 172.21.15.6:0/3414316829 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6748011630 con 0x7f67600b2070 2023-10-06T02:23:43.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.690+0000 7f675effd700 1 -- 172.21.15.6:0/3414316829 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67480117b0 con 0x7f67600b2070 2023-10-06T02:23:43.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.690+0000 7f675effd700 1 -- 172.21.15.6:0/3414316829 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6748011b70 con 0x7f67600b2070 2023-10-06T02:23:43.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.690+0000 7f676548c700 1 -- 172.21.15.6:0/3414316829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67600b2070 msgr2=0x7f67600aeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.690+0000 7f676548c700 1 --2- 172.21.15.6:0/3414316829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67600b2070 0x7f67600aeaa0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f676006e650 tx=0x7f67480091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.690+0000 7f676548c700 1 -- 172.21.15.6:0/3414316829 shutdown_connections 2023-10-06T02:23:43.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.690+0000 7f676548c700 1 --2- 172.21.15.6:0/3414316829 >> v2:172.21.15.175:3300/0 conn(0x7f67600aefe0 0x7f6760160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.690+0000 7f676548c700 1 --2- 172.21.15.6:0/3414316829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67600b2070 0x7f67600aeaa0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.690+0000 7f676548c700 1 -- 172.21.15.6:0/3414316829 >> 172.21.15.6:0/3414316829 conn(0x7f67600961e0 msgr2=0x7f6760069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:43.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.691+0000 7f676548c700 1 -- 172.21.15.6:0/3414316829 shutdown_connections 2023-10-06T02:23:43.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.691+0000 7f676548c700 1 -- 172.21.15.6:0/3414316829 wait complete. 2023-10-06T02:23:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.692+0000 7f676548c700 1 Processor -- start 2023-10-06T02:23:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.692+0000 7f676548c700 1 -- start start 2023-10-06T02:23:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.692+0000 7f676548c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67600aefe0 0x7f676014f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.692+0000 7f676548c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67600b2070 0x7f67601556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.692+0000 7f676548c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67601570e0 0x7f6760155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.692+0000 7f676548c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67600acdc0 con 0x7f67600b2070 2023-10-06T02:23:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.692+0000 7f676548c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67600ad0a0 con 0x7f67601570e0 2023-10-06T02:23:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.692+0000 7f676548c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67600ad380 con 0x7f67600aefe0 2023-10-06T02:23:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.693+0000 7f675f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67600b2070 0x7f67601556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.693+0000 7f675f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67600b2070 0x7f67601556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40262/0 (socket says 172.21.15.6:40262) 2023-10-06T02:23:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.693+0000 7f675f7fe700 1 -- 172.21.15.6:0/2879368903 learned_addr learned my addr 172.21.15.6:0/2879368903 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.693+0000 7f675ffff700 1 --2- 172.21.15.6:0/2879368903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67600aefe0 0x7f676014f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.693+0000 7f6764c8b700 1 --2- 172.21.15.6:0/2879368903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67601570e0 0x7f6760155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.693+0000 7f675f7fe700 1 -- 172.21.15.6:0/2879368903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67600aefe0 msgr2=0x7f676014f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.693+0000 7f675f7fe700 1 --2- 172.21.15.6:0/2879368903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67600aefe0 0x7f676014f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.693+0000 7f675f7fe700 1 -- 172.21.15.6:0/2879368903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67601570e0 msgr2=0x7f6760155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.693+0000 7f675f7fe700 1 --2- 172.21.15.6:0/2879368903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67601570e0 0x7f6760155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.693+0000 7f675f7fe700 1 -- 172.21.15.6:0/2879368903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6748009420 con 0x7f67600b2070 2023-10-06T02:23:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.693+0000 7f675f7fe700 1 --2- 172.21.15.6:0/2879368903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67600b2070 0x7f67601556d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f6748013000 tx=0x7f6748017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.693+0000 7f6757fff700 1 -- 172.21.15.6:0/2879368903 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674801f070 con 0x7f67600b2070 2023-10-06T02:23:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.693+0000 7f6757fff700 1 -- 172.21.15.6:0/2879368903 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6748011920 con 0x7f67600b2070 2023-10-06T02:23:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.693+0000 7f676548c700 1 -- 172.21.15.6:0/2879368903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67600ad660 con 0x7f67600b2070 2023-10-06T02:23:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.693+0000 7f6757fff700 1 -- 172.21.15.6:0/2879368903 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6748023410 con 0x7f67600b2070 2023-10-06T02:23:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.693+0000 7f676548c700 1 -- 172.21.15.6:0/2879368903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67600ac820 con 0x7f67600b2070 2023-10-06T02:23:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.694+0000 7f676548c700 1 -- 172.21.15.6:0/2879368903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6760064aa0 con 0x7f67600b2070 2023-10-06T02:23:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.695+0000 7f6757fff700 1 -- 172.21.15.6:0/2879368903 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f674802c440 con 0x7f67600b2070 2023-10-06T02:23:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.695+0000 7f6757fff700 1 --2- 172.21.15.6:0/2879368903 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6740066f30 0x7f67400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.695+0000 7f6757fff700 1 -- 172.21.15.6:0/2879368903 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6748085940 con 0x7f67600b2070 2023-10-06T02:23:43.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.695+0000 7f675ffff700 1 --2- 172.21.15.6:0/2879368903 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6740066f30 0x7f67400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.696+0000 7f675ffff700 1 --2- 172.21.15.6:0/2879368903 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6740066f30 0x7f67400693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6750004fd0 tx=0x7f6750007ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:43.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.700+0000 7f6757fff700 1 -- 172.21.15.6:0/2879368903 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6748052970 con 0x7f67600b2070 2023-10-06T02:23:43.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.971+0000 7f676548c700 1 -- 172.21.15.6:0/2879368903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6760068d70 con 0x7f67600b2070 2023-10-06T02:23:43.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.975+0000 7f6757fff700 1 -- 172.21.15.6:0/2879368903 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6748055f90 con 0x7f67600b2070 2023-10-06T02:23:43.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.977+0000 7f676548c700 1 -- 172.21.15.6:0/2879368903 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6740066f30 msgr2=0x7f67400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.977+0000 7f676548c700 1 --2- 172.21.15.6:0/2879368903 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6740066f30 0x7f67400693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6750004fd0 tx=0x7f6750007ce0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.977+0000 7f676548c700 1 -- 172.21.15.6:0/2879368903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67600b2070 msgr2=0x7f67601556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.977+0000 7f676548c700 1 --2- 172.21.15.6:0/2879368903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67600b2070 0x7f67601556d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f6748013000 tx=0x7f6748017000 comp rx=0 tx=0).stop 2023-10-06T02:23:43.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.977+0000 7f676548c700 1 -- 172.21.15.6:0/2879368903 shutdown_connections 2023-10-06T02:23:43.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.977+0000 7f676548c700 1 --2- 172.21.15.6:0/2879368903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67601570e0 0x7f6760155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.977+0000 7f676548c700 1 --2- 172.21.15.6:0/2879368903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67600aefe0 0x7f676014f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.977+0000 7f676548c700 1 --2- 172.21.15.6:0/2879368903 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6740066f30 0x7f67400693e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.977+0000 7f676548c700 1 --2- 172.21.15.6:0/2879368903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67600b2070 0x7f67601556d0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.977+0000 7f676548c700 1 -- 172.21.15.6:0/2879368903 >> 172.21.15.6:0/2879368903 conn(0x7f67600961e0 msgr2=0x7f67600b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:43.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.977+0000 7f676548c700 1 -- 172.21.15.6:0/2879368903 shutdown_connections 2023-10-06T02:23:43.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:43.977+0000 7f676548c700 1 -- 172.21.15.6:0/2879368903 wait complete. 2023-10-06T02:23:43.979 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-10-06T02:23:43.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:44.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.109+0000 7f916ab87700 1 Processor -- start 2023-10-06T02:23:44.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.109+0000 7f916ab87700 1 -- start start 2023-10-06T02:23:44.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.110+0000 7f916ab87700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91641593f0 0x7f916406de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.110+0000 7f916ab87700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91641597c0 0x7f916406e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.110+0000 7f916ab87700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f91640b3d30 0x7f916415d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.110+0000 7f916ab87700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91640b2850 con 0x7f91641597c0 2023-10-06T02:23:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.110+0000 7f916ab87700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9164069950 con 0x7f91640b3d30 2023-10-06T02:23:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.110+0000 7f916ab87700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91640b1fb0 con 0x7f91641593f0 2023-10-06T02:23:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.110+0000 7f9163fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91641597c0 0x7f916406e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.110+0000 7f9163fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91641597c0 0x7f916406e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40274/0 (socket says 172.21.15.6:40274) 2023-10-06T02:23:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.110+0000 7f9163fff700 1 -- 172.21.15.6:0/1871991843 learned_addr learned my addr 172.21.15.6:0/1871991843 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.111+0000 7f9168923700 1 --2- 172.21.15.6:0/1871991843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91641593f0 0x7f916406de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.111+0000 7f9169124700 1 --2- 172.21.15.6:0/1871991843 >> v2:172.21.15.175:3300/0 conn(0x7f91640b3d30 0x7f916415d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.111+0000 7f9163fff700 1 -- 172.21.15.6:0/1871991843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91641593f0 msgr2=0x7f916406de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:44.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.111+0000 7f9163fff700 1 --2- 172.21.15.6:0/1871991843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91641593f0 0x7f916406de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.111+0000 7f9163fff700 1 -- 172.21.15.6:0/1871991843 >> v2:172.21.15.175:3300/0 conn(0x7f91640b3d30 msgr2=0x7f916415d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:44.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.111+0000 7f9163fff700 1 --2- 172.21.15.6:0/1871991843 >> v2:172.21.15.175:3300/0 conn(0x7f91640b3d30 0x7f916415d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.111+0000 7f9163fff700 1 -- 172.21.15.6:0/1871991843 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91640b2290 con 0x7f91641597c0 2023-10-06T02:23:44.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.111+0000 7f9163fff700 1 --2- 172.21.15.6:0/1871991843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91641597c0 0x7f916406e350 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f91640b1ae0 tx=0x7f9154009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ada565dfd5074f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.111+0000 7f91637fe700 1 -- 172.21.15.6:0/1871991843 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9154005c10 con 0x7f91641597c0 2023-10-06T02:23:44.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.111+0000 7f91637fe700 1 -- 172.21.15.6:0/1871991843 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9154005d70 con 0x7f91641597c0 2023-10-06T02:23:44.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.111+0000 7f91637fe700 1 -- 172.21.15.6:0/1871991843 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915400b880 con 0x7f91641597c0 2023-10-06T02:23:44.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.112+0000 7f916ab87700 1 -- 172.21.15.6:0/1871991843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91641597c0 msgr2=0x7f916406e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.112+0000 7f916ab87700 1 --2- 172.21.15.6:0/1871991843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91641597c0 0x7f916406e350 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f91640b1ae0 tx=0x7f9154009220 comp rx=0 tx=0).stop 2023-10-06T02:23:44.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.112+0000 7f916ab87700 1 -- 172.21.15.6:0/1871991843 shutdown_connections 2023-10-06T02:23:44.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.112+0000 7f916ab87700 1 --2- 172.21.15.6:0/1871991843 >> v2:172.21.15.175:3300/0 conn(0x7f91640b3d30 0x7f916415d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.112+0000 7f916ab87700 1 --2- 172.21.15.6:0/1871991843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91641593f0 0x7f916406de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.112+0000 7f916ab87700 1 --2- 172.21.15.6:0/1871991843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91641597c0 0x7f916406e350 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.112+0000 7f916ab87700 1 -- 172.21.15.6:0/1871991843 >> 172.21.15.6:0/1871991843 conn(0x7f916406cff0 msgr2=0x7f91640afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:44.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.112+0000 7f916ab87700 1 -- 172.21.15.6:0/1871991843 shutdown_connections 2023-10-06T02:23:44.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.112+0000 7f916ab87700 1 -- 172.21.15.6:0/1871991843 wait complete. 2023-10-06T02:23:44.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.113+0000 7f916ab87700 1 Processor -- start 2023-10-06T02:23:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.113+0000 7f916ab87700 1 -- start start 2023-10-06T02:23:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f916ab87700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91640b3d30 0x7f9164146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f916ab87700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91641593f0 0x7f9164157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f916ab87700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91641597c0 0x7f9164158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f916ab87700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91640c9860 con 0x7f91641597c0 2023-10-06T02:23:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f916ab87700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91640ca100 con 0x7f91640b3d30 2023-10-06T02:23:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f916ab87700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91640c82e0 con 0x7f91641593f0 2023-10-06T02:23:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f9169124700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91641597c0 0x7f9164158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f9169124700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91641597c0 0x7f9164158450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40282/0 (socket says 172.21.15.6:40282) 2023-10-06T02:23:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f9169124700 1 -- 172.21.15.6:0/3849977759 learned_addr learned my addr 172.21.15.6:0/3849977759 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f9168923700 1 --2- 172.21.15.6:0/3849977759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91640b3d30 0x7f9164146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f9163fff700 1 --2- 172.21.15.6:0/3849977759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91641593f0 0x7f9164157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f9169124700 1 -- 172.21.15.6:0/3849977759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91641593f0 msgr2=0x7f9164157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f9169124700 1 --2- 172.21.15.6:0/3849977759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91641593f0 0x7f9164157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f9169124700 1 -- 172.21.15.6:0/3849977759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91640b3d30 msgr2=0x7f9164146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f9169124700 1 --2- 172.21.15.6:0/3849977759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91640b3d30 0x7f9164146b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f9169124700 1 -- 172.21.15.6:0/3849977759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9154009480 con 0x7f91641597c0 2023-10-06T02:23:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f9169124700 1 --2- 172.21.15.6:0/3849977759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91641597c0 0x7f9164158450 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f914c00d890 tx=0x7f914c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f9160ff9700 1 -- 172.21.15.6:0/3849977759 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c0125f0 con 0x7f91641597c0 2023-10-06T02:23:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f9160ff9700 1 -- 172.21.15.6:0/3849977759 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c012770 con 0x7f91641597c0 2023-10-06T02:23:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f916ab87700 1 -- 172.21.15.6:0/3849977759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91640c9ab0 con 0x7f91641597c0 2023-10-06T02:23:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f9160ff9700 1 -- 172.21.15.6:0/3849977759 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c012b30 con 0x7f91641597c0 2023-10-06T02:23:44.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.114+0000 7f916ab87700 1 -- 172.21.15.6:0/3849977759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91641470a0 con 0x7f91641597c0 2023-10-06T02:23:44.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.115+0000 7f916ab87700 1 -- 172.21.15.6:0/3849977759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91640ca270 con 0x7f91641597c0 2023-10-06T02:23:44.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.116+0000 7f9160ff9700 1 -- 172.21.15.6:0/3849977759 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f914c01e460 con 0x7f91641597c0 2023-10-06T02:23:44.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.116+0000 7f9160ff9700 1 --2- 172.21.15.6:0/3849977759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9144066f30 0x7f91440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.116+0000 7f9160ff9700 1 -- 172.21.15.6:0/3849977759 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f914c084c90 con 0x7f91641597c0 2023-10-06T02:23:44.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.116+0000 7f9168923700 1 --2- 172.21.15.6:0/3849977759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9144066f30 0x7f91440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.117+0000 7f9168923700 1 --2- 172.21.15.6:0/3849977759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9144066f30 0x7f91440693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f915c009fd0 tx=0x7f915c009880 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.120+0000 7f9160ff9700 1 -- 172.21.15.6:0/3849977759 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f914c051c60 con 0x7f91641597c0 2023-10-06T02:23:44.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.358+0000 7f916ab87700 1 -- 172.21.15.6:0/3849977759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f916406d3f0 con 0x7f91641597c0 2023-10-06T02:23:44.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.359+0000 7f9160ff9700 1 -- 172.21.15.6:0/3849977759 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f914c055280 con 0x7f91641597c0 2023-10-06T02:23:44.359 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:44.359 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2575759355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2575759355},{"type":"v1","addr":"172.21.15.175:6836","nonce":2575759355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2523304335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2523304335},{"type":"v1","addr":"172.21.15.175:6837","nonce":2523304335}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":6786,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/353268974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":353268974},{"type":"v1","addr":"172.21.15.6:6834","nonce":353268974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:38.399768+0000","modified":"2023-10-06T02:23:42.035051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6789":{"gid":6789,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1625434310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1625434310},{"type":"v1","addr":"172.21.15.6:6835","nonce":1625434310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:23:44.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.361+0000 7f916ab87700 1 -- 172.21.15.6:0/3849977759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9144066f30 msgr2=0x7f91440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.361+0000 7f916ab87700 1 --2- 172.21.15.6:0/3849977759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9144066f30 0x7f91440693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f915c009fd0 tx=0x7f915c009880 comp rx=0 tx=0).stop 2023-10-06T02:23:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.361+0000 7f916ab87700 1 -- 172.21.15.6:0/3849977759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91641597c0 msgr2=0x7f9164158450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.361+0000 7f916ab87700 1 --2- 172.21.15.6:0/3849977759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91641597c0 0x7f9164158450 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f914c00d890 tx=0x7f914c008040 comp rx=0 tx=0).stop 2023-10-06T02:23:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.361+0000 7f916ab87700 1 -- 172.21.15.6:0/3849977759 shutdown_connections 2023-10-06T02:23:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.361+0000 7f916ab87700 1 --2- 172.21.15.6:0/3849977759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9144066f30 0x7f91440693e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.361+0000 7f916ab87700 1 --2- 172.21.15.6:0/3849977759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91641597c0 0x7f9164158450 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.361+0000 7f916ab87700 1 --2- 172.21.15.6:0/3849977759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91640b3d30 0x7f9164146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.361+0000 7f916ab87700 1 --2- 172.21.15.6:0/3849977759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91641593f0 0x7f9164157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.361+0000 7f916ab87700 1 -- 172.21.15.6:0/3849977759 >> 172.21.15.6:0/3849977759 conn(0x7f916406cff0 msgr2=0x7f916415b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:44.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.361+0000 7f916ab87700 1 -- 172.21.15.6:0/3849977759 shutdown_connections 2023-10-06T02:23:44.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.361+0000 7f916ab87700 1 -- 172.21.15.6:0/3849977759 wait complete. 2023-10-06T02:23:44.363 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 70 2023-10-06T02:23:44.775 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:23:38.399768+0000', 'modified': '2023-10-06T02:23:42.035051+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6789}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6789': {'gid': 6789, 'name': 'c', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/1625434310', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 1625434310}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 1625434310}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:23:44.776 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:23:44.776 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:23:44.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.901+0000 7f57e4c30700 1 Processor -- start 2023-10-06T02:23:44.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.901+0000 7f57e4c30700 1 -- start start 2023-10-06T02:23:44.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.901+0000 7f57e4c30700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f57e00cf1a0 0x7f57e00cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57e4c30700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e00b3560 con 0x7f57e01597d0 2023-10-06T02:23:44.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57e4c30700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e00cf6f0 con 0x7f57e0159400 2023-10-06T02:23:44.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57e4c30700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e00cf9d0 con 0x7f57e00cf1a0 2023-10-06T02:23:44.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57dffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f57e01597d0 0x7f57e00b39f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36452/0 (socket says 172.21.15.6:36452) 2023-10-06T02:23:44.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57dffff700 1 -- 172.21.15.6:0/2107076793 learned_addr learned my addr 172.21.15.6:0/2107076793 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:44.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57deffd700 1 --2- 172.21.15.6:0/2107076793 >> v2:172.21.15.175:3300/0 conn(0x7f57e00cf1a0 0x7f57e00cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57de7fc700 1 -- 172.21.15.6:0/2107076793 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350451281 0 0) 0x7f57e00b3560 con 0x7f57e01597d0 2023-10-06T02:23:44.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57de7fc700 1 -- 172.21.15.6:0/2107076793 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57c8003570 con 0x7f57e01597d0 2023-10-06T02:23:44.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57de7fc700 1 -- 172.21.15.6:0/2107076793 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3237279524 0 0) 0x7f57c8003570 con 0x7f57e01597d0 2023-10-06T02:23:44.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57de7fc700 1 -- 172.21.15.6:0/2107076793 >> v2:172.21.15.175:3300/0 conn(0x7f57e00cf1a0 msgr2=0x7f57e00cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:44.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57de7fc700 1 --2- 172.21.15.6:0/2107076793 >> v2:172.21.15.175:3300/0 conn(0x7f57e00cf1a0 0x7f57e00cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57de7fc700 1 -- 172.21.15.6:0/2107076793 >> v1:172.21.15.175:6789/0 conn(0x7f57e0159400 legacy=0x7f57e00ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57de7fc700 1 -- 172.21.15.6:0/2107076793 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e00b2f10 con 0x7f57e01597d0 2023-10-06T02:23:44.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57de7fc700 1 -- 172.21.15.6:0/2107076793 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f57d80017f0 con 0x7f57e01597d0 2023-10-06T02:23:44.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57de7fc700 1 -- 172.21.15.6:0/2107076793 >> v1:172.21.15.6:6789/0 conn(0x7f57e01597d0 legacy=0x7f57e00b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57de7fc700 1 --2- 172.21.15.6:0/2107076793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57c8003a60 0x7f57c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57de7fc700 1 --2- 172.21.15.6:0/2107076793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57c8004810 0x7f57c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57de7fc700 1 --2- 172.21.15.6:0/2107076793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57c80051c0 0x7f57c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57de7fc700 1 -- 172.21.15.6:0/2107076793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e00cf9d0 con 0x7f57c80051c0 2023-10-06T02:23:44.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57de7fc700 1 -- 172.21.15.6:0/2107076793 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c800c0d0 con 0x7f57c8004810 2023-10-06T02:23:44.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57de7fc700 1 -- 172.21.15.6:0/2107076793 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c800c290 con 0x7f57c8003a60 2023-10-06T02:23:44.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.902+0000 7f57dffff700 1 --2- 172.21.15.6:0/2107076793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57c80051c0 0x7f57c800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.903+0000 7f57df7fe700 1 --2- 172.21.15.6:0/2107076793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57c8003a60 0x7f57c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.903+0000 7f57deffd700 1 --2- 172.21.15.6:0/2107076793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57c8004810 0x7f57c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.903+0000 7f57dffff700 1 -- 172.21.15.6:0/2107076793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57c8003a60 msgr2=0x7f57c8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:44.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.903+0000 7f57dffff700 1 --2- 172.21.15.6:0/2107076793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57c8003a60 0x7f57c8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.903+0000 7f57dffff700 1 -- 172.21.15.6:0/2107076793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57c8004810 msgr2=0x7f57c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:44.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.903+0000 7f57dffff700 1 --2- 172.21.15.6:0/2107076793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57c8004810 0x7f57c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.903+0000 7f57dffff700 1 -- 172.21.15.6:0/2107076793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c8003570 con 0x7f57c80051c0 2023-10-06T02:23:44.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.903+0000 7f57dffff700 1 -- 172.21.15.6:0/2107076793 reap_dead start 2023-10-06T02:23:44.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.903+0000 7f57dffff700 1 --2- 172.21.15.6:0/2107076793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57c80051c0 0x7f57c800ba60 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f57d800a930 tx=0x7f57d80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b808c0ddafc158 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.903+0000 7f57de7fc700 1 -- 172.21.15.6:0/2107076793 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80070d0 con 0x7f57c80051c0 2023-10-06T02:23:44.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.903+0000 7f57de7fc700 1 -- 172.21.15.6:0/2107076793 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d8007230 con 0x7f57c80051c0 2023-10-06T02:23:44.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.903+0000 7f57de7fc700 1 -- 172.21.15.6:0/2107076793 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80075d0 con 0x7f57c80051c0 2023-10-06T02:23:44.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.904+0000 7f57e4c30700 1 -- 172.21.15.6:0/2107076793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57c80051c0 msgr2=0x7f57c800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.904+0000 7f57e4c30700 1 --2- 172.21.15.6:0/2107076793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57c80051c0 0x7f57c800ba60 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f57d800a930 tx=0x7f57d80021d0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.904+0000 7f57e4c30700 1 -- 172.21.15.6:0/2107076793 shutdown_connections 2023-10-06T02:23:44.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.904+0000 7f57e4c30700 1 --2- 172.21.15.6:0/2107076793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57c80051c0 0x7f57c800ba60 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.904+0000 7f57e4c30700 1 -- 172.21.15.6:0/2107076793 >> 172.21.15.6:0/2107076793 conn(0x7f57e006ac10 msgr2=0x7f57e0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:44.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.904+0000 7f57e4c30700 1 -- 172.21.15.6:0/2107076793 shutdown_connections 2023-10-06T02:23:44.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.904+0000 7f57e4c30700 1 -- 172.21.15.6:0/2107076793 wait complete. 2023-10-06T02:23:44.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.905+0000 7f57e4c30700 1 Processor -- start 2023-10-06T02:23:44.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.905+0000 7f57e4c30700 1 -- start start 2023-10-06T02:23:44.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57e4c30700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57c80051c0 0x7f57e014ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57e4c30700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57e00b14a0 0x7f57e00b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57e4c30700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57e015e030 0x7f57e015e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57e4c30700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e00b1e50 con 0x7f57c80051c0 2023-10-06T02:23:44.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57e4c30700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e014f2a0 con 0x7f57e015e030 2023-10-06T02:23:44.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57e4c30700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e0169f90 con 0x7f57e00b14a0 2023-10-06T02:23:44.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57c80051c0 0x7f57e014ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57c80051c0 0x7f57e014ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40302/0 (socket says 172.21.15.6:40302) 2023-10-06T02:23:44.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57df7fe700 1 -- 172.21.15.6:0/3335539667 learned_addr learned my addr 172.21.15.6:0/3335539667 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:44.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57dffff700 1 --2- 172.21.15.6:0/3335539667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57e015e030 0x7f57e015e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57deffd700 1 --2- 172.21.15.6:0/3335539667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57e00b14a0 0x7f57e00b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57df7fe700 1 -- 172.21.15.6:0/3335539667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57e00b14a0 msgr2=0x7f57e00b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57df7fe700 1 --2- 172.21.15.6:0/3335539667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57e00b14a0 0x7f57e00b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57df7fe700 1 -- 172.21.15.6:0/3335539667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57e015e030 msgr2=0x7f57e015e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57df7fe700 1 --2- 172.21.15.6:0/3335539667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57e015e030 0x7f57e015e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57df7fe700 1 -- 172.21.15.6:0/3335539667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e016a270 con 0x7f57c80051c0 2023-10-06T02:23:44.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57df7fe700 1 --2- 172.21.15.6:0/3335539667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57c80051c0 0x7f57e014ed60 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f57d0002970 tx=0x7f57d0007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57c77fe700 1 -- 172.21.15.6:0/3335539667 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d0013600 con 0x7f57c80051c0 2023-10-06T02:23:44.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57c77fe700 1 -- 172.21.15.6:0/3335539667 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d0013760 con 0x7f57c80051c0 2023-10-06T02:23:44.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.906+0000 7f57e4c30700 1 -- 172.21.15.6:0/3335539667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e016a550 con 0x7f57c80051c0 2023-10-06T02:23:44.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.907+0000 7f57c77fe700 1 -- 172.21.15.6:0/3335539667 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d0013ae0 con 0x7f57c80051c0 2023-10-06T02:23:44.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.907+0000 7f57e4c30700 1 -- 172.21.15.6:0/3335539667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e016ab10 con 0x7f57c80051c0 2023-10-06T02:23:44.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.908+0000 7f57c77fe700 1 -- 172.21.15.6:0/3335539667 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57d001c400 con 0x7f57c80051c0 2023-10-06T02:23:44.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.908+0000 7f57c77fe700 1 --2- 172.21.15.6:0/3335539667 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f57cc066f30 0x7f57cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.908+0000 7f57c77fe700 1 -- 172.21.15.6:0/3335539667 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f57d0084c40 con 0x7f57c80051c0 2023-10-06T02:23:44.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.908+0000 7f57deffd700 1 --2- 172.21.15.6:0/3335539667 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f57cc066f30 0x7f57cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.909+0000 7f57deffd700 1 --2- 172.21.15.6:0/3335539667 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f57cc066f30 0x7f57cc0693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f57e0156b40 tx=0x7f57d40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.910+0000 7f57ef18ab80 1 Processor -- start 2023-10-06T02:23:44.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.910+0000 7f57ef18ab80 1 -- start start 2023-10-06T02:23:44.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.911+0000 7f57ef18ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82a3e50 0x563df827ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.911+0000 7f57ef18ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df82842c0 0x563df827f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.911+0000 7f57ef18ab80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df8285a10 0x563df827f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.911+0000 7f57ef18ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df81d9a70 con 0x563df82a3e50 2023-10-06T02:23:44.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.911+0000 7f57ef18ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df81d7270 con 0x563df82842c0 2023-10-06T02:23:44.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.911+0000 7f57ef18ab80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563df81d3060 con 0x563df8285a10 2023-10-06T02:23:44.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.911+0000 7f57df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82a3e50 0x563df827ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.911+0000 7f57df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82a3e50 0x563df827ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40314/0 (socket says 172.21.15.6:40314) 2023-10-06T02:23:44.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.911+0000 7f57df7fe700 1 -- 172.21.15.6:0/3764079186 learned_addr learned my addr 172.21.15.6:0/3764079186 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:44.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.911+0000 7f57deffd700 1 --2- 172.21.15.6:0/3764079186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df82842c0 0x563df827f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.911+0000 7f57dffff700 1 --2- 172.21.15.6:0/3764079186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df8285a10 0x563df827f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.911+0000 7f57df7fe700 1 -- 172.21.15.6:0/3764079186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df8285a10 msgr2=0x563df827f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:44.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.911+0000 7f57df7fe700 1 --2- 172.21.15.6:0/3764079186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df8285a10 0x563df827f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.911+0000 7f57df7fe700 1 -- 172.21.15.6:0/3764079186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df82842c0 msgr2=0x563df827f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:44.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.911+0000 7f57df7fe700 1 --2- 172.21.15.6:0/3764079186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df82842c0 0x563df827f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.911+0000 7f57df7fe700 1 -- 172.21.15.6:0/3764079186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563df806d270 con 0x563df82a3e50 2023-10-06T02:23:44.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.911+0000 7f57dffff700 1 --2- 172.21.15.6:0/3764079186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df8285a10 0x563df827f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:44.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.912+0000 7f57df7fe700 1 --2- 172.21.15.6:0/3764079186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82a3e50 0x563df827ecc0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f57d0051d80 tx=0x7f57d0082e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d911c8a958d62ca5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.912+0000 7f57c4ff9700 1 -- 172.21.15.6:0/3764079186 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d006b050 con 0x563df82a3e50 2023-10-06T02:23:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.912+0000 7f57c4ff9700 1 -- 172.21.15.6:0/3764079186 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d0058b20 con 0x563df82a3e50 2023-10-06T02:23:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.912+0000 7f57c4ff9700 1 -- 172.21.15.6:0/3764079186 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d005c870 con 0x563df82a3e50 2023-10-06T02:23:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.912+0000 7f57ef18ab80 1 -- 172.21.15.6:0/3764079186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82a3e50 msgr2=0x563df827ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.912+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/3764079186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82a3e50 0x563df827ecc0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f57d0051d80 tx=0x7f57d0082e20 comp rx=0 tx=0).stop 2023-10-06T02:23:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.912+0000 7f57ef18ab80 1 -- 172.21.15.6:0/3764079186 shutdown_connections 2023-10-06T02:23:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.912+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/3764079186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df8285a10 0x563df827f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.912+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/3764079186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82a3e50 0x563df827ecc0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.912+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/3764079186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df82842c0 0x563df827f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.912+0000 7f57ef18ab80 1 -- 172.21.15.6:0/3764079186 >> 172.21.15.6:0/3764079186 conn(0x563df8283e80 msgr2=0x563df82846b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.913+0000 7f57ef18ab80 1 -- 172.21.15.6:0/3764079186 shutdown_connections 2023-10-06T02:23:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.913+0000 7f57ef18ab80 1 -- 172.21.15.6:0/3764079186 wait complete. 2023-10-06T02:23:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.913+0000 7f57ef18ab80 1 -- start start 2023-10-06T02:23:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.913+0000 7f57ef18ab80 1 Processor -- start 2023-10-06T02:23:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57ef18ab80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df82842c0 0x563df82b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57ef18ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df8285a10 0x563df82a4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57ef18ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82a3e50 0x563df82a4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57ef18ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df817e890 con 0x563df82a3e50 2023-10-06T02:23:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57ef18ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df8199ea0 con 0x563df8285a10 2023-10-06T02:23:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57ef18ab80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563df8055e30 con 0x563df82842c0 2023-10-06T02:23:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57ef18ab80 10 client.0 _ll_register_callbacks cb 0x563df8246020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:23:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57dffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82a3e50 0x563df82a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57dffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82a3e50 0x563df82a4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40328/0 (socket says 172.21.15.6:40328) 2023-10-06T02:23:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57dffff700 1 -- 172.21.15.6:0/1366009 learned_addr learned my addr 172.21.15.6:0/1366009 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57deffd700 1 --2- 172.21.15.6:0/1366009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df8285a10 0x563df82a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57df7fe700 1 --2- 172.21.15.6:0/1366009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df82842c0 0x563df82b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57dffff700 1 -- 172.21.15.6:0/1366009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df82842c0 msgr2=0x563df82b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57dffff700 1 --2- 172.21.15.6:0/1366009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df82842c0 0x563df82b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57dffff700 1 -- 172.21.15.6:0/1366009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df8285a10 msgr2=0x563df82a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57dffff700 1 --2- 172.21.15.6:0/1366009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df8285a10 0x563df82a4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57dffff700 1 -- 172.21.15.6:0/1366009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e016ab10 con 0x563df82a3e50 2023-10-06T02:23:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57df7fe700 1 --2- 172.21.15.6:0/1366009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df82842c0 0x563df82b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57dffff700 1 --2- 172.21.15.6:0/1366009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82a3e50 0x563df82a4760 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f57e00b4fe0 tx=0x7f57d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28c43ba6337ce57 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.914+0000 7f57bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:23:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.915+0000 7f57bdffb700 1 -- 172.21.15.6:0/1366009 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8023070 con 0x563df82a3e50 2023-10-06T02:23:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.915+0000 7f57bdffb700 1 -- 172.21.15.6:0/1366009 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f57d80073a0 con 0x563df82a3e50 2023-10-06T02:23:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.915+0000 7f57ef18ab80 1 -- 172.21.15.6:0/1366009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563df8277940 con 0x563df82a3e50 2023-10-06T02:23:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.915+0000 7f57bdffb700 1 -- 172.21.15.6:0/1366009 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57d8007b50 con 0x563df82a3e50 2023-10-06T02:23:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.915+0000 7f57ef18ab80 10 client.6939 fetch_fsmap learned FSMap version 70 2023-10-06T02:23:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.915+0000 7f57ef18ab80 1 -- 172.21.15.6:0/1366009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x563df800ffe0 con 0x563df82a3e50 2023-10-06T02:23:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.915+0000 7f57bdffb700 1 -- 172.21.15.6:0/1366009 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563df8277940 con 0x563df82a3e50 2023-10-06T02:23:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.915+0000 7f57bdffb700 1 -- 172.21.15.6:0/1366009 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f57d800a960 con 0x563df82a3e50 2023-10-06T02:23:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.915+0000 7f57ef18ab80 10 client.6939 fetch_fsmap finished waiting for FSMap version 70 2023-10-06T02:23:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.915+0000 7f57ef18ab80 10 client.6939 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:23:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.915+0000 7f57ef18ab80 20 client.6939 populate_metadata read hostname 'smithi006' 2023-10-06T02:23:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.915+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/1366009 >> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] conn(0x563df82c9e40 0x563df82ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.915+0000 7f57ef18ab80 4 client.6939 mds_command: new command op to 6789 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:23:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.915+0000 7f57ef18ab80 1 -- 172.21.15.6:0/1366009 --> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563df8254870 con 0x563df82c9e40 2023-10-06T02:23:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.915+0000 7f57df7fe700 1 --2- 172.21.15.6:0/1366009 >> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] conn(0x563df82c9e40 0x563df82ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.916+0000 7f57bdffb700 10 client.6939 ms_handle_connect on v2:172.21.15.6:6833/1625434310 2023-10-06T02:23:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.916+0000 7f57df7fe700 1 --2- 172.21.15.6:0/1366009 >> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] conn(0x563df82c9e40 0x563df82ca210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbaaacf395daaed1 server_cookie=fbf1c56e8bee7202 in_seq=0 out_seq=0 2023-10-06T02:23:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.916+0000 7f57bdffb700 1 -- 172.21.15.6:0/1366009 <== mds.0 v2:172.21.15.6:6833/1625434310 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x563df8254870 con 0x563df82c9e40 2023-10-06T02:23:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.916+0000 7f57bdffb700 10 client.6939 handle_command_reply: tid=0 2023-10-06T02:23:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.916+0000 7f57ef18ab80 1 client.6939 shutdown 2023-10-06T02:23:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.916+0000 7f57ef18ab80 1 -- 172.21.15.6:0/1366009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82a3e50 msgr2=0x563df82a4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.916+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/1366009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82a3e50 0x563df82a4760 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f57e00b4fe0 tx=0x7f57d8016000 comp rx=0 tx=0).stop 2023-10-06T02:23:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.916+0000 7f57ef18ab80 1 -- 172.21.15.6:0/1366009 shutdown_connections 2023-10-06T02:23:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.916+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/1366009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82a3e50 0x563df82a4760 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.916+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/1366009 >> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] conn(0x563df82c9e40 0x563df82ca210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.916+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/1366009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df82842c0 0x563df82b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.916+0000 7f57bdffb700 0 client.6939 ms_handle_reset on v2:172.21.15.6:6833/1625434310 2023-10-06T02:23:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.916+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/1366009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df8285a10 0x563df82a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.916+0000 7f57ef18ab80 1 -- 172.21.15.6:0/1366009 >> 172.21.15.6:0/1366009 conn(0x563df8283e80 msgr2=0x563df8284d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.916+0000 7f57ef18ab80 1 -- 172.21.15.6:0/1366009 shutdown_connections 2023-10-06T02:23:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.916+0000 7f57ef18ab80 1 -- 172.21.15.6:0/1366009 wait complete. 2023-10-06T02:23:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.917+0000 7f57ef18ab80 20 client.6939 trim_cache size 0 max 16384 2023-10-06T02:23:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.933+0000 7f57ef18ab80 1 Processor -- start 2023-10-06T02:23:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.933+0000 7f57ef18ab80 1 -- start start 2023-10-06T02:23:44.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.934+0000 7f57ef18ab80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df8283e80 0x563df82db3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.934+0000 7f57ef18ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82842c0 0x563df82a4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.934+0000 7f57ef18ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df8285a10 0x563df82a4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.934+0000 7f57ef18ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df8280b80 con 0x563df82842c0 2023-10-06T02:23:44.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.934+0000 7f57ef18ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df82b0330 con 0x563df8285a10 2023-10-06T02:23:44.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.934+0000 7f57ef18ab80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563df82818b0 con 0x563df8283e80 2023-10-06T02:23:44.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.934+0000 7f57deffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82842c0 0x563df82a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.934+0000 7f57deffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82842c0 0x563df82a4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40338/0 (socket says 172.21.15.6:40338) 2023-10-06T02:23:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.934+0000 7f57deffd700 1 -- 172.21.15.6:0/380907709 learned_addr learned my addr 172.21.15.6:0/380907709 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.934+0000 7f57dffff700 1 --2- 172.21.15.6:0/380907709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df8285a10 0x563df82a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.934+0000 7f57deffd700 1 -- 172.21.15.6:0/380907709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df8283e80 msgr2=0x563df82db3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.934+0000 7f57deffd700 1 --2- 172.21.15.6:0/380907709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df8283e80 0x563df82db3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.934+0000 7f57deffd700 1 -- 172.21.15.6:0/380907709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df8285a10 msgr2=0x563df82a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.934+0000 7f57deffd700 1 --2- 172.21.15.6:0/380907709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df8285a10 0x563df82a4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.934+0000 7f57deffd700 1 -- 172.21.15.6:0/380907709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563df81a1780 con 0x563df82842c0 2023-10-06T02:23:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.934+0000 7f57deffd700 1 --2- 172.21.15.6:0/380907709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82842c0 0x563df82a4220 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f57d4014cf0 tx=0x7f57d401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce433fb6092818d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.935+0000 7f57c57fa700 1 -- 172.21.15.6:0/380907709 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4028070 con 0x563df82842c0 2023-10-06T02:23:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.935+0000 7f57c57fa700 1 -- 172.21.15.6:0/380907709 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d4019070 con 0x563df82842c0 2023-10-06T02:23:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.935+0000 7f57c57fa700 1 -- 172.21.15.6:0/380907709 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4014ea0 con 0x563df82842c0 2023-10-06T02:23:44.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.935+0000 7f57ef18ab80 1 -- 172.21.15.6:0/380907709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82842c0 msgr2=0x563df82a4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.935+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/380907709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82842c0 0x563df82a4220 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f57d4014cf0 tx=0x7f57d401c000 comp rx=0 tx=0).stop 2023-10-06T02:23:44.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.935+0000 7f57ef18ab80 1 -- 172.21.15.6:0/380907709 shutdown_connections 2023-10-06T02:23:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.935+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/380907709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df8285a10 0x563df82a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.935+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/380907709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df8283e80 0x563df82db3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.935+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/380907709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df82842c0 0x563df82a4220 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.935+0000 7f57ef18ab80 1 -- 172.21.15.6:0/380907709 >> 172.21.15.6:0/380907709 conn(0x563df8283610 msgr2=0x563df82cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.935+0000 7f57ef18ab80 1 -- 172.21.15.6:0/380907709 shutdown_connections 2023-10-06T02:23:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.935+0000 7f57ef18ab80 1 -- 172.21.15.6:0/380907709 wait complete. 2023-10-06T02:23:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.936+0000 7f57ef18ab80 1 -- start start 2023-10-06T02:23:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.936+0000 7f57ef18ab80 1 Processor -- start 2023-10-06T02:23:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.936+0000 7f57ef18ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df8283e80 0x563df8328880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.936+0000 7f57ef18ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df82842c0 0x563df8282870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.936+0000 7f57ef18ab80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df8285a10 0x563df8282db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.936+0000 7f57ef18ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df82a2450 con 0x563df8283e80 2023-10-06T02:23:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.936+0000 7f57ef18ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df832f3f0 con 0x563df82842c0 2023-10-06T02:23:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.936+0000 7f57ef18ab80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563df832f6d0 con 0x563df8285a10 2023-10-06T02:23:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57ef18ab80 10 client.0 _ll_register_callbacks cb 0x563df8246020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:23:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df8283e80 0x563df8328880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df8283e80 0x563df8328880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40350/0 (socket says 172.21.15.6:40350) 2023-10-06T02:23:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57df7fe700 1 -- 172.21.15.6:0/1972895362 learned_addr learned my addr 172.21.15.6:0/1972895362 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57deffd700 1 --2- 172.21.15.6:0/1972895362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df82842c0 0x563df8282870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57dffff700 1 --2- 172.21.15.6:0/1972895362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df8285a10 0x563df8282db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57df7fe700 1 -- 172.21.15.6:0/1972895362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df8285a10 msgr2=0x563df8282db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57df7fe700 1 --2- 172.21.15.6:0/1972895362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df8285a10 0x563df8282db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57df7fe700 1 -- 172.21.15.6:0/1972895362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df82842c0 msgr2=0x563df8282870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57df7fe700 1 --2- 172.21.15.6:0/1972895362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df82842c0 0x563df8282870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57df7fe700 1 -- 172.21.15.6:0/1972895362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d4014a20 con 0x563df8283e80 2023-10-06T02:23:44.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57deffd700 1 --2- 172.21.15.6:0/1972895362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df82842c0 0x563df8282870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:44.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57df7fe700 1 --2- 172.21.15.6:0/1972895362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df8283e80 0x563df8328880 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f57d0007e90 tx=0x7f57d007f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a74e443969934dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:23:44.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57bdffb700 1 -- 172.21.15.6:0/1972895362 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d0055b30 con 0x563df8283e80 2023-10-06T02:23:44.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57bdffb700 1 -- 172.21.15.6:0/1972895362 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f57d0055c90 con 0x563df8283e80 2023-10-06T02:23:44.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57ef18ab80 1 -- 172.21.15.6:0/1972895362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f57d0058b20 con 0x563df8283e80 2023-10-06T02:23:44.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57bdffb700 1 -- 172.21.15.6:0/1972895362 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57d0054fd0 con 0x563df8283e80 2023-10-06T02:23:44.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57ef18ab80 10 client.6945 fetch_fsmap learned FSMap version 70 2023-10-06T02:23:44.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57ef18ab80 1 -- 172.21.15.6:0/1972895362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x563df8188470 con 0x563df8283e80 2023-10-06T02:23:44.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.937+0000 7f57bdffb700 1 -- 172.21.15.6:0/1972895362 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d0058b20 con 0x563df8283e80 2023-10-06T02:23:44.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57bdffb700 1 -- 172.21.15.6:0/1972895362 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f57d005c3e0 con 0x563df8283e80 2023-10-06T02:23:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57ef18ab80 10 client.6945 fetch_fsmap finished waiting for FSMap version 70 2023-10-06T02:23:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57ef18ab80 10 client.6945 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:23:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57ef18ab80 20 client.6945 populate_metadata read hostname 'smithi006' 2023-10-06T02:23:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/1972895362 >> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] conn(0x563df82a3e50 0x563df8284690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57ef18ab80 4 client.6945 mds_command: new command op to 6789 tid=0[{"prefix": "status"}] 2023-10-06T02:23:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57ef18ab80 1 -- 172.21.15.6:0/1972895362 --> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563df8175e00 con 0x563df82a3e50 2023-10-06T02:23:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57deffd700 1 --2- 172.21.15.6:0/1972895362 >> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] conn(0x563df82a3e50 0x563df8284690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57bdffb700 10 client.6945 ms_handle_connect on v2:172.21.15.6:6833/1625434310 2023-10-06T02:23:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57deffd700 1 --2- 172.21.15.6:0/1972895362 >> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] conn(0x563df82a3e50 0x563df8284690 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f94f182e8a409ace server_cookie=a4e52b476f66cf80 in_seq=0 out_seq=0 2023-10-06T02:23:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57bdffb700 1 -- 172.21.15.6:0/1972895362 <== mds.0 v2:172.21.15.6:6833/1625434310 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x563df8175e00 con 0x563df82a3e50 2023-10-06T02:23:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57bdffb700 10 client.6945 handle_command_reply: tid=0 2023-10-06T02:23:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57ef18ab80 1 client.6945 shutdown 2023-10-06T02:23:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57ef18ab80 1 -- 172.21.15.6:0/1972895362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df8283e80 msgr2=0x563df8328880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/1972895362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df8283e80 0x563df8328880 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f57d0007e90 tx=0x7f57d007f040 comp rx=0 tx=0).stop 2023-10-06T02:23:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57ef18ab80 1 -- 172.21.15.6:0/1972895362 shutdown_connections 2023-10-06T02:23:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/1972895362 >> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] conn(0x563df82a3e50 0x563df8284690 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/1972895362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563df8285a10 0x563df8282db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57bdffb700 0 client.6945 ms_handle_reset on v2:172.21.15.6:6833/1625434310 2023-10-06T02:23:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/1972895362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563df8283e80 0x563df8328880 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57ef18ab80 1 --2- 172.21.15.6:0/1972895362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df82842c0 0x563df8282870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57ef18ab80 1 -- 172.21.15.6:0/1972895362 >> 172.21.15.6:0/1972895362 conn(0x563df8283610 msgr2=0x563df8279400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.938+0000 7f57ef18ab80 1 -- 172.21.15.6:0/1972895362 shutdown_connections 2023-10-06T02:23:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.939+0000 7f57ef18ab80 1 -- 172.21.15.6:0/1972895362 wait complete. 2023-10-06T02:23:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.939+0000 7f57ef18ab80 20 client.6945 trim_cache size 0 max 16384 2023-10-06T02:23:44.947 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:23:44.947 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:23:44.947 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:23:44.947 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 6789, 2023-10-06T02:23:44.947 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:23:44.947 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:23:44.947 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:23:44.947 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.9121946559999996, 2023-10-06T02:23:44.947 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 70, 2023-10-06T02:23:44.947 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 82, 2023-10-06T02:23:44.948 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 82, 2023-10-06T02:23:44.948 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 12.010664981 2023-10-06T02:23:44.948 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:23:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.939+0000 7f57e4c30700 1 -- 172.21.15.6:0/3335539667 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f57cc066f30 msgr2=0x7f57cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.939+0000 7f57e4c30700 1 --2- 172.21.15.6:0/3335539667 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f57cc066f30 0x7f57cc0693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f57e0156b40 tx=0x7f57d40091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.939+0000 7f57e4c30700 1 -- 172.21.15.6:0/3335539667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57c80051c0 msgr2=0x7f57e014ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.939+0000 7f57e4c30700 1 --2- 172.21.15.6:0/3335539667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57c80051c0 0x7f57e014ed60 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f57d0002970 tx=0x7f57d0007d80 comp rx=0 tx=0).stop 2023-10-06T02:23:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.939+0000 7f57e4c30700 1 -- 172.21.15.6:0/3335539667 shutdown_connections 2023-10-06T02:23:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.939+0000 7f57e4c30700 1 --2- 172.21.15.6:0/3335539667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57e015e030 0x7f57e015e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.939+0000 7f57e4c30700 1 --2- 172.21.15.6:0/3335539667 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f57cc066f30 0x7f57cc0693e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.939+0000 7f57e4c30700 1 --2- 172.21.15.6:0/3335539667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57c80051c0 0x7f57e014ed60 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.939+0000 7f57e4c30700 1 --2- 172.21.15.6:0/3335539667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57e00b14a0 0x7f57e00b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.939+0000 7f57e4c30700 1 -- 172.21.15.6:0/3335539667 >> 172.21.15.6:0/3335539667 conn(0x7f57e006ac10 msgr2=0x7f57e015f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.939+0000 7f57e4c30700 1 -- 172.21.15.6:0/3335539667 shutdown_connections 2023-10-06T02:23:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:44.939+0000 7f57e4c30700 1 -- 172.21.15.6:0/3335539667 wait complete. 2023-10-06T02:23:44.951 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:23:45.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.070+0000 7fbe46fa5700 1 Processor -- start 2023-10-06T02:23:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.070+0000 7fbe46fa5700 1 -- start start 2023-10-06T02:23:45.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.071+0000 7fbe46fa5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe40159400 0x7fbe400ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.071+0000 7fbe46fa5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbe400cd030 0x7fbe400cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.071+0000 7fbe46fa5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe400cf1a0 0x7fbe400d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.071+0000 7fbe46fa5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe400b3560 con 0x7fbe400cf1a0 2023-10-06T02:23:45.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.071+0000 7fbe46fa5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe400cf6f0 con 0x7fbe400cd030 2023-10-06T02:23:45.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.071+0000 7fbe46fa5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe400cf9d0 con 0x7fbe40159400 2023-10-06T02:23:45.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.071+0000 7fbe467a4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe400cf1a0 0x7fbe400d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.071+0000 7fbe467a4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe400cf1a0 0x7fbe400d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40352/0 (socket says 172.21.15.6:40352) 2023-10-06T02:23:45.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.071+0000 7fbe467a4700 1 -- 172.21.15.6:0/3445110694 learned_addr learned my addr 172.21.15.6:0/3445110694 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:45.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.071+0000 7fbe457a2700 1 --2- 172.21.15.6:0/3445110694 >> v2:172.21.15.175:3300/0 conn(0x7fbe400cd030 0x7fbe400cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.071+0000 7fbe45fa3700 1 --2- 172.21.15.6:0/3445110694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe40159400 0x7fbe400ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.071+0000 7fbe467a4700 1 -- 172.21.15.6:0/3445110694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe40159400 msgr2=0x7fbe400ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:45.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.071+0000 7fbe467a4700 1 --2- 172.21.15.6:0/3445110694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe40159400 0x7fbe400ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.071+0000 7fbe467a4700 1 -- 172.21.15.6:0/3445110694 >> v2:172.21.15.175:3300/0 conn(0x7fbe400cd030 msgr2=0x7fbe400cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:45.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.071+0000 7fbe467a4700 1 --2- 172.21.15.6:0/3445110694 >> v2:172.21.15.175:3300/0 conn(0x7fbe400cd030 0x7fbe400cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.071+0000 7fbe467a4700 1 -- 172.21.15.6:0/3445110694 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe400b2f10 con 0x7fbe400cf1a0 2023-10-06T02:23:45.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.071+0000 7fbe457a2700 1 --2- 172.21.15.6:0/3445110694 >> v2:172.21.15.175:3300/0 conn(0x7fbe400cd030 0x7fbe400cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:45.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.072+0000 7fbe467a4700 1 --2- 172.21.15.6:0/3445110694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe400cf1a0 0x7fbe400d0400 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fbe40067ec0 tx=0x7fbe38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb5ef1083ee9929 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:45.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.072+0000 7fbe44fa1700 1 -- 172.21.15.6:0/3445110694 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3800b860 con 0x7fbe400cf1a0 2023-10-06T02:23:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.072+0000 7fbe44fa1700 1 -- 172.21.15.6:0/3445110694 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3800b9c0 con 0x7fbe400cf1a0 2023-10-06T02:23:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.072+0000 7fbe44fa1700 1 -- 172.21.15.6:0/3445110694 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3800bd60 con 0x7fbe400cf1a0 2023-10-06T02:23:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.072+0000 7fbe46fa5700 1 -- 172.21.15.6:0/3445110694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe400cf1a0 msgr2=0x7fbe400d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.072+0000 7fbe46fa5700 1 --2- 172.21.15.6:0/3445110694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe400cf1a0 0x7fbe400d0400 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fbe40067ec0 tx=0x7fbe38009250 comp rx=0 tx=0).stop 2023-10-06T02:23:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.072+0000 7fbe46fa5700 1 -- 172.21.15.6:0/3445110694 shutdown_connections 2023-10-06T02:23:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.072+0000 7fbe46fa5700 1 --2- 172.21.15.6:0/3445110694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe400cf1a0 0x7fbe400d0400 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.072+0000 7fbe46fa5700 1 --2- 172.21.15.6:0/3445110694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe40159400 0x7fbe400ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.072+0000 7fbe46fa5700 1 --2- 172.21.15.6:0/3445110694 >> v2:172.21.15.175:3300/0 conn(0x7fbe400cd030 0x7fbe400cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.072+0000 7fbe46fa5700 1 -- 172.21.15.6:0/3445110694 >> 172.21.15.6:0/3445110694 conn(0x7fbe4006ac10 msgr2=0x7fbe40068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.072+0000 7fbe46fa5700 1 -- 172.21.15.6:0/3445110694 shutdown_connections 2023-10-06T02:23:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.072+0000 7fbe46fa5700 1 -- 172.21.15.6:0/3445110694 wait complete. 2023-10-06T02:23:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.073+0000 7fbe46fa5700 1 Processor -- start 2023-10-06T02:23:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.074+0000 7fbe46fa5700 1 -- start start 2023-10-06T02:23:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.074+0000 7fbe46fa5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe400cd030 0x7fbe4015acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.074+0000 7fbe46fa5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe400cf1a0 0x7fbe40152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.074+0000 7fbe46fa5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe40159400 0x7fbe400b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.074+0000 7fbe46fa5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4015b790 con 0x7fbe40159400 2023-10-06T02:23:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.074+0000 7fbe46fa5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4015b230 con 0x7fbe400cd030 2023-10-06T02:23:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.074+0000 7fbe46fa5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe40169a80 con 0x7fbe400cf1a0 2023-10-06T02:23:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.074+0000 7fbe467a4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe40159400 0x7fbe400b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.074+0000 7fbe467a4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe40159400 0x7fbe400b1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40358/0 (socket says 172.21.15.6:40358) 2023-10-06T02:23:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.074+0000 7fbe467a4700 1 -- 172.21.15.6:0/915287347 learned_addr learned my addr 172.21.15.6:0/915287347 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.075+0000 7fbe457a2700 1 --2- 172.21.15.6:0/915287347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe400cf1a0 0x7fbe40152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.075+0000 7fbe45fa3700 1 --2- 172.21.15.6:0/915287347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe400cd030 0x7fbe4015acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.075+0000 7fbe467a4700 1 -- 172.21.15.6:0/915287347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe400cf1a0 msgr2=0x7fbe40152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.075+0000 7fbe467a4700 1 --2- 172.21.15.6:0/915287347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe400cf1a0 0x7fbe40152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.075+0000 7fbe467a4700 1 -- 172.21.15.6:0/915287347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe400cd030 msgr2=0x7fbe4015acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.075+0000 7fbe467a4700 1 --2- 172.21.15.6:0/915287347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe400cd030 0x7fbe4015acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.075+0000 7fbe467a4700 1 -- 172.21.15.6:0/915287347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe380094f0 con 0x7fbe40159400 2023-10-06T02:23:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.075+0000 7fbe467a4700 1 --2- 172.21.15.6:0/915287347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe40159400 0x7fbe400b1b00 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fbe380090b0 tx=0x7fbe38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.075+0000 7fbe3dffb700 1 -- 172.21.15.6:0/915287347 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3801a640 con 0x7fbe40159400 2023-10-06T02:23:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.075+0000 7fbe3dffb700 1 -- 172.21.15.6:0/915287347 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3801f070 con 0x7fbe40159400 2023-10-06T02:23:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.075+0000 7fbe46fa5700 1 -- 172.21.15.6:0/915287347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe40159d40 con 0x7fbe40159400 2023-10-06T02:23:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.075+0000 7fbe3dffb700 1 -- 172.21.15.6:0/915287347 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3801aa10 con 0x7fbe40159400 2023-10-06T02:23:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.075+0000 7fbe46fa5700 1 -- 172.21.15.6:0/915287347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4015a300 con 0x7fbe40159400 2023-10-06T02:23:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.076+0000 7fbe46fa5700 1 -- 172.21.15.6:0/915287347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe400b31f0 con 0x7fbe40159400 2023-10-06T02:23:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.077+0000 7fbe3dffb700 1 -- 172.21.15.6:0/915287347 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe3801b430 con 0x7fbe40159400 2023-10-06T02:23:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.077+0000 7fbe3dffb700 1 --2- 172.21.15.6:0/915287347 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbe2c066f30 0x7fbe2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.077+0000 7fbe3dffb700 1 -- 172.21.15.6:0/915287347 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbe38021070 con 0x7fbe40159400 2023-10-06T02:23:45.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.077+0000 7fbe45fa3700 1 --2- 172.21.15.6:0/915287347 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbe2c066f30 0x7fbe2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.078+0000 7fbe45fa3700 1 --2- 172.21.15.6:0/915287347 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbe2c066f30 0x7fbe2c0693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbe30007460 tx=0x7fbe3000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:45.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.081+0000 7fbe3dffb700 1 -- 172.21.15.6:0/915287347 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe380538f0 con 0x7fbe40159400 2023-10-06T02:23:45.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.320+0000 7fbe46fa5700 1 -- 172.21.15.6:0/915287347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbe40069f10 con 0x7fbe40159400 2023-10-06T02:23:45.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.320+0000 7fbe3dffb700 1 -- 172.21.15.6:0/915287347 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbe3802b060 con 0x7fbe40159400 2023-10-06T02:23:45.321 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:23:45.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.323+0000 7fbe46fa5700 1 -- 172.21.15.6:0/915287347 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbe2c066f30 msgr2=0x7fbe2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.323+0000 7fbe46fa5700 1 --2- 172.21.15.6:0/915287347 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbe2c066f30 0x7fbe2c0693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbe30007460 tx=0x7fbe3000b040 comp rx=0 tx=0).stop 2023-10-06T02:23:45.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.323+0000 7fbe46fa5700 1 -- 172.21.15.6:0/915287347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe40159400 msgr2=0x7fbe400b1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.323+0000 7fbe46fa5700 1 --2- 172.21.15.6:0/915287347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe40159400 0x7fbe400b1b00 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fbe380090b0 tx=0x7fbe38017000 comp rx=0 tx=0).stop 2023-10-06T02:23:45.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.323+0000 7fbe46fa5700 1 -- 172.21.15.6:0/915287347 shutdown_connections 2023-10-06T02:23:45.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.323+0000 7fbe46fa5700 1 --2- 172.21.15.6:0/915287347 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbe2c066f30 0x7fbe2c0693e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.323+0000 7fbe46fa5700 1 --2- 172.21.15.6:0/915287347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe40159400 0x7fbe400b1b00 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.323+0000 7fbe46fa5700 1 --2- 172.21.15.6:0/915287347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe400cd030 0x7fbe4015acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.323+0000 7fbe46fa5700 1 --2- 172.21.15.6:0/915287347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe400cf1a0 0x7fbe40152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.323+0000 7fbe46fa5700 1 -- 172.21.15.6:0/915287347 >> 172.21.15.6:0/915287347 conn(0x7fbe4006ac10 msgr2=0x7fbe401584c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:45.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.323+0000 7fbe46fa5700 1 -- 172.21.15.6:0/915287347 shutdown_connections 2023-10-06T02:23:45.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:45.323+0000 7fbe46fa5700 1 -- 172.21.15.6:0/915287347 wait complete. 2023-10-06T02:23:45.335 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:23:45.335 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:23:45.335 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:23:45.336 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:23:45.336 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:45.336 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:23:45.336 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:23:45.336 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:23:45.336 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:23:45.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:45.336 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:23:45.351 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:23:45.352 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:23:45.352 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:23:45.352 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:45.352 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:23:45.352 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:45.352 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:45.352 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:45.352 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:23:45.352 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:45.352 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:45.352 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:23:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:23:45.353 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:45.353 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:23:45.353 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:23:45.353 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42121sec preferred_lft 42121sec 2023-10-06T02:23:45.353 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:23:45.353 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:45.353 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:45.353 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:23:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:23:45.353 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:45.354 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:23:45.354 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:45.354 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:23:45.354 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:45.354 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:23:45.354 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:23:45.354 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:23:45.354 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:45.354 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:23:45.354 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:23:45.354 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:23:45.354 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:45.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:45.355 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:23:45.416 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:23:45.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:45.417 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:23:45.473 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:23:45.474 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:23:45.474 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:23:45.474 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:23:45.474 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:23:45.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:45.474 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:23:45.474 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:23:45.474 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:23:45.475 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:23:45.475 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:23:45.475 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:23:45.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:45.577 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:23:45.591 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:23:45.591 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:23:45.591 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:23:45.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:45.592 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:23:45.656 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:23:45.656 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:23:45.657 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:45.711 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:23:45.711 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:23:45.711 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:45.765 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:23:45.830 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:23:45.830 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:23:45.895 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:23:45.896 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:23:45.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:45.897 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:23:45.952 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:23:45.952 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:23:45.994 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:23:46.020 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:23:46.020 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:23:46.080 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:23:46.080+0000 7f53b8bf4540 -1 init, newargv = 0x563ef26f2c60 newargc=15 2023-10-06T02:23:46.080 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[118617]: starting ceph client 2023-10-06T02:23:46.085 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[118617]: starting fuse 2023-10-06T02:23:46.085 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:23:46.087 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:23:46.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:46.087 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:23:46.142 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:23:46.142 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:23:46.142 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:23:46.142 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:23:46.142 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:23:46.143 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:23:46.143 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:23:46.143 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:23:46.143 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:23:46.143 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:23:46.143 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:23:46.143 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:23:46.143 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:23:46.143 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:23:46.143 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:23:46.143 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:23:46.143 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:23:46.143 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:23:46.144 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:23:46.144 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:23:46.144 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:23:46.144 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:23:46.144 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:23:46.144 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:23:46.144 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:23:46.144 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:23:46.144 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:23:46.144 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:23:46.144 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:23:46.265 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.118617.asok 2023-10-06T02:23:46.447 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.118617.asok 2023-10-06T02:23:46.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:46.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.118617.asok status 2023-10-06T02:23:46.604 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:23:46.604 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:23:46.604 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:23:46.604 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:23:46.604 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:23:46.604 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:23:46.604 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:23:46.605 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "118617", 2023-10-06T02:23:46.605 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:23:46.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:46.605 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:23:46.605 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:23:46.605 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 6957, 2023-10-06T02:23:46.605 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:23:46.605 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:23:46.605 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:23:46.605 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 6957 2023-10-06T02:23:46.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:46.605 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:23:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:23:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:23:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 753461490 2023-10-06T02:23:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:23:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:23:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:23:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:23:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 753461490 2023-10-06T02:23:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:23:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.6957 192.168.0.1:0/753461490", 2023-10-06T02:23:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/753461490", 2023-10-06T02:23:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:23:46.607 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 70, 2023-10-06T02:23:46.607 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 82, 2023-10-06T02:23:46.607 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:23:46.607 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:23:46.607 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:23:46.607 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:23:46.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:46.614 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:23:46.614 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:46.630 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:23:46.630 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:46.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:46.630 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:46.696 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:46.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.854+0000 7f724210c700 1 Processor -- start 2023-10-06T02:23:46.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.854+0000 7f724210c700 1 -- start start 2023-10-06T02:23:46.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.855+0000 7f724210c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f723c0af4e0 0x7f723c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.855+0000 7f724210c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f723c0af8b0 0x7f723c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.855+0000 7f724210c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723c15e190 con 0x7f723c15d460 2023-10-06T02:23:46.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.855+0000 7f724210c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f723c0b1910 con 0x7f723c0af4e0 2023-10-06T02:23:46.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.855+0000 7f724210c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f723c15dfa0 con 0x7f723c0af8b0 2023-10-06T02:23:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.855+0000 7f723b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f723c0af4e0 0x7f723c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.855+0000 7f723b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f723c0af4e0 0x7f723c0b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40360/0 (socket says 172.21.15.6:40360) 2023-10-06T02:23:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.855+0000 7f723b7fe700 1 -- 172.21.15.6:0/2454945156 learned_addr learned my addr 172.21.15.6:0/2454945156 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.856+0000 7f723b7fe700 1 -- 172.21.15.6:0/2454945156 >> v2:172.21.15.175:3300/0 conn(0x7f723c0af8b0 msgr2=0x7f723c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.856+0000 7f723b7fe700 1 --2- 172.21.15.6:0/2454945156 >> v2:172.21.15.175:3300/0 conn(0x7f723c0af8b0 0x7f723c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.856+0000 7f723b7fe700 1 -- 172.21.15.6:0/2454945156 >> v1:172.21.15.175:6789/0 conn(0x7f723c15d460 legacy=0x7f723c15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.856+0000 7f723b7fe700 1 -- 172.21.15.6:0/2454945156 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c0cb650 con 0x7f723c0af4e0 2023-10-06T02:23:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.856+0000 7f723b7fe700 1 --2- 172.21.15.6:0/2454945156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f723c0af4e0 0x7f723c0b20e0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f723c0cdd50 tx=0x7f722c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4dca3a7af8a13de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.856+0000 7f723a7fc700 1 -- 172.21.15.6:0/2454945156 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c00b820 con 0x7f723c0af4e0 2023-10-06T02:23:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.856+0000 7f723a7fc700 1 -- 172.21.15.6:0/2454945156 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722c00b980 con 0x7f723c0af4e0 2023-10-06T02:23:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.856+0000 7f723a7fc700 1 -- 172.21.15.6:0/2454945156 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c00bd20 con 0x7f723c0af4e0 2023-10-06T02:23:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.856+0000 7f724210c700 1 -- 172.21.15.6:0/2454945156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f723c0af4e0 msgr2=0x7f723c0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.856+0000 7f724210c700 1 --2- 172.21.15.6:0/2454945156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f723c0af4e0 0x7f723c0b20e0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f723c0cdd50 tx=0x7f722c009250 comp rx=0 tx=0).stop 2023-10-06T02:23:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.856+0000 7f724210c700 1 -- 172.21.15.6:0/2454945156 shutdown_connections 2023-10-06T02:23:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.856+0000 7f724210c700 1 --2- 172.21.15.6:0/2454945156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f723c0af4e0 0x7f723c0b20e0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.856+0000 7f724210c700 1 --2- 172.21.15.6:0/2454945156 >> v2:172.21.15.175:3300/0 conn(0x7f723c0af8b0 0x7f723c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.856+0000 7f724210c700 1 -- 172.21.15.6:0/2454945156 >> 172.21.15.6:0/2454945156 conn(0x7f723c068680 msgr2=0x7f723c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.856+0000 7f724210c700 1 -- 172.21.15.6:0/2454945156 shutdown_connections 2023-10-06T02:23:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.856+0000 7f724210c700 1 -- 172.21.15.6:0/2454945156 wait complete. 2023-10-06T02:23:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.858+0000 7f724210c700 1 Processor -- start 2023-10-06T02:23:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.858+0000 7f724210c700 1 -- start start 2023-10-06T02:23:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.858+0000 7f724210c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f723c0af4e0 0x7f723c0cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.858+0000 7f724210c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f723c0af8b0 0x7f723c158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.858+0000 7f724210c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f723c15d460 0x7f723c0a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.858+0000 7f724210c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723c0a76c0 con 0x7f723c0af4e0 2023-10-06T02:23:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.858+0000 7f724210c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723c0a79a0 con 0x7f723c15d460 2023-10-06T02:23:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.858+0000 7f724210c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723c0ce670 con 0x7f723c0af8b0 2023-10-06T02:23:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.859+0000 7f723b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f723c0af4e0 0x7f723c0cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.859+0000 7f723b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f723c0af4e0 0x7f723c0cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40368/0 (socket says 172.21.15.6:40368) 2023-10-06T02:23:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.859+0000 7f723b7fe700 1 -- 172.21.15.6:0/652191090 learned_addr learned my addr 172.21.15.6:0/652191090 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.859+0000 7f723affd700 1 --2- 172.21.15.6:0/652191090 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f723c0af8b0 0x7f723c158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.859+0000 7f723b7fe700 1 -- 172.21.15.6:0/652191090 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f723c0af8b0 msgr2=0x7f723c158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.859+0000 7f723b7fe700 1 --2- 172.21.15.6:0/652191090 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f723c0af8b0 0x7f723c158de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.859+0000 7f723b7fe700 1 -- 172.21.15.6:0/652191090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f723c15d460 msgr2=0x7f723c0a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.859+0000 7f723b7fe700 1 --2- 172.21.15.6:0/652191090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f723c15d460 0x7f723c0a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.859+0000 7f723b7fe700 1 -- 172.21.15.6:0/652191090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722c0094f0 con 0x7f723c0af4e0 2023-10-06T02:23:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.859+0000 7f723b7fe700 1 --2- 172.21.15.6:0/652191090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f723c0af4e0 0x7f723c0cde20 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f722c003080 tx=0x7f722c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.859+0000 7f72237fe700 1 -- 172.21.15.6:0/652191090 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c011e60 con 0x7f723c0af4e0 2023-10-06T02:23:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.859+0000 7f72237fe700 1 -- 172.21.15.6:0/652191090 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722c01a670 con 0x7f723c0af4e0 2023-10-06T02:23:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.859+0000 7f724210c700 1 -- 172.21.15.6:0/652191090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723c0ce950 con 0x7f723c0af4e0 2023-10-06T02:23:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.859+0000 7f72237fe700 1 -- 172.21.15.6:0/652191090 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c01aa10 con 0x7f723c0af4e0 2023-10-06T02:23:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.859+0000 7f724210c700 1 -- 172.21.15.6:0/652191090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723c0ce360 con 0x7f723c0af4e0 2023-10-06T02:23:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.860+0000 7f724210c700 1 -- 172.21.15.6:0/652191090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f723c0a7c80 con 0x7f723c0af4e0 2023-10-06T02:23:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.861+0000 7f72237fe700 1 -- 172.21.15.6:0/652191090 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f722c01b440 con 0x7f723c0af4e0 2023-10-06T02:23:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.861+0000 7f72237fe700 1 --2- 172.21.15.6:0/652191090 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7228066f30 0x7f72280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.861+0000 7f72237fe700 1 -- 172.21.15.6:0/652191090 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f722c086120 con 0x7f723c0af4e0 2023-10-06T02:23:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.861+0000 7f723affd700 1 --2- 172.21.15.6:0/652191090 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7228066f30 0x7f72280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.862+0000 7f723affd700 1 --2- 172.21.15.6:0/652191090 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7228066f30 0x7f72280693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7230006fd0 tx=0x7f7230008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:46.865+0000 7f72237fe700 1 -- 172.21.15.6:0/652191090 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f722c0530f0 con 0x7f723c0af4e0 2023-10-06T02:23:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.107+0000 7f724210c700 1 -- 172.21.15.6:0/652191090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f723c0b0910 con 0x7f723c0af4e0 2023-10-06T02:23:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.107+0000 7f72237fe700 1 -- 172.21.15.6:0/652191090 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f722c056710 con 0x7f723c0af4e0 2023-10-06T02:23:47.108 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:47.108 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2575759355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2575759355},{"type":"v1","addr":"172.21.15.175:6836","nonce":2575759355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2523304335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2523304335},{"type":"v1","addr":"172.21.15.175:6837","nonce":2523304335}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":6786,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/353268974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":353268974},{"type":"v1","addr":"172.21.15.6:6834","nonce":353268974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:38.399768+0000","modified":"2023-10-06T02:23:42.035051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6789":{"gid":6789,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1625434310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1625434310},{"type":"v1","addr":"172.21.15.6:6835","nonce":1625434310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:23:47.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.109+0000 7f724210c700 1 -- 172.21.15.6:0/652191090 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7228066f30 msgr2=0x7f72280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.109+0000 7f724210c700 1 --2- 172.21.15.6:0/652191090 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7228066f30 0x7f72280693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7230006fd0 tx=0x7f7230008040 comp rx=0 tx=0).stop 2023-10-06T02:23:47.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.109+0000 7f724210c700 1 -- 172.21.15.6:0/652191090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f723c0af4e0 msgr2=0x7f723c0cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.109+0000 7f724210c700 1 --2- 172.21.15.6:0/652191090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f723c0af4e0 0x7f723c0cde20 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f722c003080 tx=0x7f722c016000 comp rx=0 tx=0).stop 2023-10-06T02:23:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.109+0000 7f724210c700 1 -- 172.21.15.6:0/652191090 shutdown_connections 2023-10-06T02:23:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.109+0000 7f724210c700 1 --2- 172.21.15.6:0/652191090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f723c15d460 0x7f723c0a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.109+0000 7f724210c700 1 --2- 172.21.15.6:0/652191090 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7228066f30 0x7f72280693e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.109+0000 7f724210c700 1 --2- 172.21.15.6:0/652191090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f723c0af4e0 0x7f723c0cde20 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.109+0000 7f724210c700 1 --2- 172.21.15.6:0/652191090 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f723c0af8b0 0x7f723c158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.109+0000 7f724210c700 1 -- 172.21.15.6:0/652191090 >> 172.21.15.6:0/652191090 conn(0x7f723c068680 msgr2=0x7f723c0b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.110+0000 7f724210c700 1 -- 172.21.15.6:0/652191090 shutdown_connections 2023-10-06T02:23:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.110+0000 7f724210c700 1 -- 172.21.15.6:0/652191090 wait complete. 2023-10-06T02:23:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 70 2023-10-06T02:23:47.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 5:0 true 2023-10-06T02:23:47.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.243+0000 7f4919209700 1 Processor -- start 2023-10-06T02:23:47.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.243+0000 7f4919209700 1 -- start start 2023-10-06T02:23:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.243+0000 7f4919209700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49140cd180 0x7f4914159990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.243+0000 7f4919209700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49140af830 0x7f491415d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.243+0000 7f4919209700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49140ce870 con 0x7f49140af460 2023-10-06T02:23:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.243+0000 7f4919209700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491415dec0 con 0x7f49140cd180 2023-10-06T02:23:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.243+0000 7f4919209700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49140cfd10 con 0x7f49140af830 2023-10-06T02:23:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.244+0000 7f491259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49140cd180 0x7f4914159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.244+0000 7f491259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49140cd180 0x7f4914159990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40374/0 (socket says 172.21.15.6:40374) 2023-10-06T02:23:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.244+0000 7f491259c700 1 -- 172.21.15.6:0/3921763137 learned_addr learned my addr 172.21.15.6:0/3921763137 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.244+0000 7f491359e700 1 --2- 172.21.15.6:0/3921763137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49140af830 0x7f491415d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.244+0000 7f491259c700 1 -- 172.21.15.6:0/3921763137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49140af830 msgr2=0x7f491415d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.244+0000 7f491259c700 1 --2- 172.21.15.6:0/3921763137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49140af830 0x7f491415d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.244+0000 7f491259c700 1 -- 172.21.15.6:0/3921763137 >> v1:172.21.15.175:6789/0 conn(0x7f49140af460 legacy=0x7f49140cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.244+0000 7f491259c700 1 -- 172.21.15.6:0/3921763137 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49140cffb0 con 0x7f49140cd180 2023-10-06T02:23:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.244+0000 7f491259c700 1 --2- 172.21.15.6:0/3921763137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140cd180 0x7f4914159990 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0099b0 tx=0x7f48fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c26d7ae03d60ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.244+0000 7f4911d9b700 1 -- 172.21.15.6:0/3921763137 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc00b860 con 0x7f49140cd180 2023-10-06T02:23:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.244+0000 7f4911d9b700 1 -- 172.21.15.6:0/3921763137 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc00b9c0 con 0x7f49140cd180 2023-10-06T02:23:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.244+0000 7f4911d9b700 1 -- 172.21.15.6:0/3921763137 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc00bd60 con 0x7f49140cd180 2023-10-06T02:23:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.245+0000 7f4919209700 1 -- 172.21.15.6:0/3921763137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140cd180 msgr2=0x7f4914159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.245+0000 7f4919209700 1 --2- 172.21.15.6:0/3921763137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140cd180 0x7f4914159990 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0099b0 tx=0x7f48fc009250 comp rx=0 tx=0).stop 2023-10-06T02:23:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.245+0000 7f4919209700 1 -- 172.21.15.6:0/3921763137 shutdown_connections 2023-10-06T02:23:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.245+0000 7f4919209700 1 --2- 172.21.15.6:0/3921763137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49140af830 0x7f491415d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.245+0000 7f4919209700 1 --2- 172.21.15.6:0/3921763137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140cd180 0x7f4914159990 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.245+0000 7f4919209700 1 -- 172.21.15.6:0/3921763137 >> 172.21.15.6:0/3921763137 conn(0x7f4914068680 msgr2=0x7f4914068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.245+0000 7f4919209700 1 -- 172.21.15.6:0/3921763137 shutdown_connections 2023-10-06T02:23:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.245+0000 7f4919209700 1 -- 172.21.15.6:0/3921763137 wait complete. 2023-10-06T02:23:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.246+0000 7f4919209700 1 Processor -- start 2023-10-06T02:23:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.246+0000 7f4919209700 1 -- start start 2023-10-06T02:23:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.247+0000 7f4919209700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140af460 0x7f49140b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.247+0000 7f4919209700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49140af830 0x7f49140c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.247+0000 7f4919209700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49140cd180 0x7f49140b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.247+0000 7f4919209700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49140b38e0 con 0x7f49140af460 2023-10-06T02:23:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.247+0000 7f4919209700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49140b42b0 con 0x7f49140af830 2023-10-06T02:23:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.247+0000 7f4919209700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49140c7940 con 0x7f49140cd180 2023-10-06T02:23:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.247+0000 7f4912d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140af460 0x7f49140b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.247+0000 7f4912d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140af460 0x7f49140b3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40378/0 (socket says 172.21.15.6:40378) 2023-10-06T02:23:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.247+0000 7f4912d9d700 1 -- 172.21.15.6:0/3518062204 learned_addr learned my addr 172.21.15.6:0/3518062204 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.247+0000 7f491259c700 1 --2- 172.21.15.6:0/3518062204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49140af830 0x7f49140c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.247+0000 7f491359e700 1 --2- 172.21.15.6:0/3518062204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49140cd180 0x7f49140b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.247+0000 7f4912d9d700 1 -- 172.21.15.6:0/3518062204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49140cd180 msgr2=0x7f49140b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.247+0000 7f4912d9d700 1 --2- 172.21.15.6:0/3518062204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49140cd180 0x7f49140b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.247+0000 7f4912d9d700 1 -- 172.21.15.6:0/3518062204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49140af830 msgr2=0x7f49140c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.247+0000 7f4912d9d700 1 --2- 172.21.15.6:0/3518062204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49140af830 0x7f49140c7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.247+0000 7f4912d9d700 1 -- 172.21.15.6:0/3518062204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc0094f0 con 0x7f49140af460 2023-10-06T02:23:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.247+0000 7f4912d9d700 1 --2- 172.21.15.6:0/3518062204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140af460 0x7f49140b3d70 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f490c00c4e0 tx=0x7f490c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.248+0000 7f490affd700 1 -- 172.21.15.6:0/3518062204 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c011590 con 0x7f49140af460 2023-10-06T02:23:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.248+0000 7f490affd700 1 -- 172.21.15.6:0/3518062204 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490c011710 con 0x7f49140af460 2023-10-06T02:23:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.248+0000 7f4919209700 1 -- 172.21.15.6:0/3518062204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49140c8430 con 0x7f49140af460 2023-10-06T02:23:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.248+0000 7f490affd700 1 -- 172.21.15.6:0/3518062204 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c011ad0 con 0x7f49140af460 2023-10-06T02:23:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.248+0000 7f4919209700 1 -- 172.21.15.6:0/3518062204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49140b3290 con 0x7f49140af460 2023-10-06T02:23:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.248+0000 7f4919209700 1 -- 172.21.15.6:0/3518062204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4914088d10 con 0x7f49140af460 2023-10-06T02:23:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.249+0000 7f490affd700 1 -- 172.21.15.6:0/3518062204 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f490c01b3b0 con 0x7f49140af460 2023-10-06T02:23:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.249+0000 7f490affd700 1 --2- 172.21.15.6:0/3518062204 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f48f4066f30 0x7f48f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.249+0000 7f490affd700 1 -- 172.21.15.6:0/3518062204 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f490c083d00 con 0x7f49140af460 2023-10-06T02:23:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.249+0000 7f491259c700 1 --2- 172.21.15.6:0/3518062204 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f48f4066f30 0x7f48f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.250+0000 7f491259c700 1 --2- 172.21.15.6:0/3518062204 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f48f4066f30 0x7f48f40693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0099b0 tx=0x7f48fc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:47.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.254+0000 7f490affd700 1 -- 172.21.15.6:0/3518062204 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f490c050cd0 con 0x7f49140af460 2023-10-06T02:23:47.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:47.525+0000 7f4919209700 1 -- 172.21.15.6:0/3518062204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "5:0", "val": "true"} v 0) v1 -- 0x7f491415a010 con 0x7f49140af460 2023-10-06T02:23:48.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.062+0000 7f490affd700 1 -- 172.21.15.6:0/3518062204 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "5:0", "val": "true"}]=0 freezing mds.6789 v71) v1 ==== 112+0+0 (secure 0 0 0) 0x7f490c017070 con 0x7f49140af460 2023-10-06T02:23:48.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.064+0000 7f4919209700 1 -- 172.21.15.6:0/3518062204 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f48f4066f30 msgr2=0x7f48f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.064+0000 7f4919209700 1 --2- 172.21.15.6:0/3518062204 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f48f4066f30 0x7f48f40693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0099b0 tx=0x7f48fc017000 comp rx=0 tx=0).stop 2023-10-06T02:23:48.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.064+0000 7f4919209700 1 -- 172.21.15.6:0/3518062204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140af460 msgr2=0x7f49140b3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.064+0000 7f4919209700 1 --2- 172.21.15.6:0/3518062204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140af460 0x7f49140b3d70 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f490c00c4e0 tx=0x7f490c00c8a0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.064+0000 7f4919209700 1 -- 172.21.15.6:0/3518062204 shutdown_connections 2023-10-06T02:23:48.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.064+0000 7f4919209700 1 --2- 172.21.15.6:0/3518062204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49140cd180 0x7f49140b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.064+0000 7f4919209700 1 --2- 172.21.15.6:0/3518062204 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f48f4066f30 0x7f48f40693e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.064+0000 7f4919209700 1 --2- 172.21.15.6:0/3518062204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140af460 0x7f49140b3d70 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.064+0000 7f4919209700 1 --2- 172.21.15.6:0/3518062204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49140af830 0x7f49140c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.064+0000 7f4919209700 1 -- 172.21.15.6:0/3518062204 >> 172.21.15.6:0/3518062204 conn(0x7f4914068680 msgr2=0x7f49140c6240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:48.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.064+0000 7f4919209700 1 -- 172.21.15.6:0/3518062204 shutdown_connections 2023-10-06T02:23:48.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.064+0000 7f4919209700 1 -- 172.21.15.6:0/3518062204 wait complete. 2023-10-06T02:23:48.067 INFO:teuthology.orchestra.run.smithi006.stderr:freezing mds.6789 2023-10-06T02:23:48.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:48.078 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'mkdir -p a/{b,c}/d') 2023-10-06T02:23:48.123 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 flush journal 2023-10-06T02:23:48.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.285+0000 7fbc91731700 1 Processor -- start 2023-10-06T02:23:48.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.285+0000 7fbc91731700 1 -- start start 2023-10-06T02:23:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.286+0000 7fbc91731700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc8c0d07d0 0x7fbc8c0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.286+0000 7fbc91731700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8c15dd40 con 0x7fbc8c0d0400 2023-10-06T02:23:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.286+0000 7fbc91731700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8c15e020 con 0x7fbc8c0ccd40 2023-10-06T02:23:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.286+0000 7fbc91731700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0ceaa0 con 0x7fbc8c0d07d0 2023-10-06T02:23:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.286+0000 7fbc8affd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbc8c0d0400 0x7fbc8c0b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36466/0 (socket says 172.21.15.6:36466) 2023-10-06T02:23:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.286+0000 7fbc8affd700 1 -- 172.21.15.6:0/1758227776 learned_addr learned my addr 172.21.15.6:0/1758227776 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.286+0000 7fbc8b7fe700 1 --2- 172.21.15.6:0/1758227776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc8c0d07d0 0x7fbc8c0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.286+0000 7fbc89ffb700 1 -- 172.21.15.6:0/1758227776 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829103882 0 0) 0x7fbc8c15dd40 con 0x7fbc8c0d0400 2023-10-06T02:23:48.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.286+0000 7fbc89ffb700 1 -- 172.21.15.6:0/1758227776 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc78003570 con 0x7fbc8c0d0400 2023-10-06T02:23:48.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc89ffb700 1 -- 172.21.15.6:0/1758227776 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1187659789 0 0) 0x7fbc78003570 con 0x7fbc8c0d0400 2023-10-06T02:23:48.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc89ffb700 1 -- 172.21.15.6:0/1758227776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc8c0d07d0 msgr2=0x7fbc8c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:48.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc89ffb700 1 --2- 172.21.15.6:0/1758227776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc8c0d07d0 0x7fbc8c0b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc89ffb700 1 -- 172.21.15.6:0/1758227776 >> v1:172.21.15.175:6789/0 conn(0x7fbc8c0ccd40 legacy=0x7fbc8c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc89ffb700 1 -- 172.21.15.6:0/1758227776 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c0ced80 con 0x7fbc8c0d0400 2023-10-06T02:23:48.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc89ffb700 1 -- 172.21.15.6:0/1758227776 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fbc84001970 con 0x7fbc8c0d0400 2023-10-06T02:23:48.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc89ffb700 1 -- 172.21.15.6:0/1758227776 >> v1:172.21.15.6:6789/0 conn(0x7fbc8c0d0400 legacy=0x7fbc8c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc89ffb700 1 --2- 172.21.15.6:0/1758227776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc8c0d07d0 0x7fbc78003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc89ffb700 1 --2- 172.21.15.6:0/1758227776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc78003fd0 0x7fbc78004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc89ffb700 1 --2- 172.21.15.6:0/1758227776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc78004d50 0x7fbc780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc89ffb700 1 -- 172.21.15.6:0/1758227776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0ceaa0 con 0x7fbc78003fd0 2023-10-06T02:23:48.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc89ffb700 1 -- 172.21.15.6:0/1758227776 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7800bb40 con 0x7fbc78004d50 2023-10-06T02:23:48.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc89ffb700 1 -- 172.21.15.6:0/1758227776 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7800bd00 con 0x7fbc8c0d07d0 2023-10-06T02:23:48.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/1758227776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc78003fd0 0x7fbc78004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc8affd700 1 --2- 172.21.15.6:0/1758227776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc8c0d07d0 0x7fbc78003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc8b7fe700 1 --2- 172.21.15.6:0/1758227776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc78004d50 0x7fbc780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc8a7fc700 1 -- 172.21.15.6:0/1758227776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc8c0d07d0 msgr2=0x7fbc78003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:48.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/1758227776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc8c0d07d0 0x7fbc78003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc8a7fc700 1 -- 172.21.15.6:0/1758227776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc78004d50 msgr2=0x7fbc780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:48.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/1758227776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc78004d50 0x7fbc780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc8a7fc700 1 -- 172.21.15.6:0/1758227776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc78003570 con 0x7fbc78003fd0 2023-10-06T02:23:48.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.287+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/1758227776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc78003fd0 0x7fbc78004810 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fbc740019a0 tx=0x7fbc74007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6fd4e09e436b48 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.288+0000 7fbc89ffb700 1 -- 172.21.15.6:0/1758227776 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400c5d0 con 0x7fbc78003fd0 2023-10-06T02:23:48.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.288+0000 7fbc89ffb700 1 -- 172.21.15.6:0/1758227776 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7400c750 con 0x7fbc78003fd0 2023-10-06T02:23:48.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.288+0000 7fbc89ffb700 1 -- 172.21.15.6:0/1758227776 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400cb10 con 0x7fbc78003fd0 2023-10-06T02:23:48.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.288+0000 7fbc91731700 1 -- 172.21.15.6:0/1758227776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc78003fd0 msgr2=0x7fbc78004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.288+0000 7fbc91731700 1 --2- 172.21.15.6:0/1758227776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc78003fd0 0x7fbc78004810 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fbc740019a0 tx=0x7fbc74007d10 comp rx=0 tx=0).stop 2023-10-06T02:23:48.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.288+0000 7fbc8b7fe700 1 -- 172.21.15.6:0/1758227776 reap_dead start 2023-10-06T02:23:48.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.288+0000 7fbc91731700 1 -- 172.21.15.6:0/1758227776 shutdown_connections 2023-10-06T02:23:48.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.288+0000 7fbc91731700 1 -- 172.21.15.6:0/1758227776 >> 172.21.15.6:0/1758227776 conn(0x7fbc8c06a220 msgr2=0x7fbc8c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:48.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.288+0000 7fbc91731700 1 -- 172.21.15.6:0/1758227776 shutdown_connections 2023-10-06T02:23:48.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.288+0000 7fbc91731700 1 -- 172.21.15.6:0/1758227776 wait complete. 2023-10-06T02:23:48.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.289+0000 7fbc91731700 1 Processor -- start 2023-10-06T02:23:48.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.289+0000 7fbc91731700 1 -- start start 2023-10-06T02:23:48.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.290+0000 7fbc91731700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc78003fd0 0x7fbc8c153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.290+0000 7fbc91731700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8c0c5100 0x7fbc8c15cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.290+0000 7fbc91731700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc8c0b1d10 0x7fbc8c0b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.290+0000 7fbc91731700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0af7d0 con 0x7fbc8c0c5100 2023-10-06T02:23:48.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.290+0000 7fbc91731700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0b26a0 con 0x7fbc8c0b1d10 2023-10-06T02:23:48.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.290+0000 7fbc91731700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c16b140 con 0x7fbc78003fd0 2023-10-06T02:23:48.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.290+0000 7fbc8a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8c0c5100 0x7fbc8c15cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.290+0000 7fbc8a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8c0c5100 0x7fbc8c15cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40400/0 (socket says 172.21.15.6:40400) 2023-10-06T02:23:48.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.290+0000 7fbc8a7fc700 1 -- 172.21.15.6:0/1857741228 learned_addr learned my addr 172.21.15.6:0/1857741228 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:48.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.290+0000 7fbc8affd700 1 --2- 172.21.15.6:0/1857741228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc78003fd0 0x7fbc8c153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.290+0000 7fbc8b7fe700 1 --2- 172.21.15.6:0/1857741228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc8c0b1d10 0x7fbc8c0b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.290+0000 7fbc8a7fc700 1 -- 172.21.15.6:0/1857741228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc78003fd0 msgr2=0x7fbc8c153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.290+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/1857741228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc78003fd0 0x7fbc8c153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.290+0000 7fbc8a7fc700 1 -- 172.21.15.6:0/1857741228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc8c0b1d10 msgr2=0x7fbc8c0b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.290+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/1857741228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc8c0b1d10 0x7fbc8c0b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.290+0000 7fbc8a7fc700 1 -- 172.21.15.6:0/1857741228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c1537a0 con 0x7fbc8c0c5100 2023-10-06T02:23:48.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.291+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/1857741228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8c0c5100 0x7fbc8c15cc10 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800bb10 tx=0x7fbc74015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.291+0000 7fbc82ffd700 1 -- 172.21.15.6:0/1857741228 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74007af0 con 0x7fbc8c0c5100 2023-10-06T02:23:48.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.291+0000 7fbc82ffd700 1 -- 172.21.15.6:0/1857741228 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7400c5d0 con 0x7fbc8c0c5100 2023-10-06T02:23:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.291+0000 7fbc91731700 1 -- 172.21.15.6:0/1857741228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8c16a530 con 0x7fbc8c0c5100 2023-10-06T02:23:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.291+0000 7fbc82ffd700 1 -- 172.21.15.6:0/1857741228 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400cb10 con 0x7fbc8c0c5100 2023-10-06T02:23:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.291+0000 7fbc91731700 1 -- 172.21.15.6:0/1857741228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8c16aaf0 con 0x7fbc8c0c5100 2023-10-06T02:23:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.292+0000 7fbc82ffd700 1 -- 172.21.15.6:0/1857741228 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc74019030 con 0x7fbc8c0c5100 2023-10-06T02:23:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.293+0000 7fbc82ffd700 1 --2- 172.21.15.6:0/1857741228 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc6c066f30 0x7fbc6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.293+0000 7fbc82ffd700 1 -- 172.21.15.6:0/1857741228 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbc74085bd0 con 0x7fbc8c0c5100 2023-10-06T02:23:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.293+0000 7fbc8affd700 1 --2- 172.21.15.6:0/1857741228 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc6c066f30 0x7fbc6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.293+0000 7fbc8affd700 1 --2- 172.21.15.6:0/1857741228 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc6c066f30 0x7fbc6c0693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c06a0e0 tx=0x7fbc84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.295+0000 7fbc9aa29b80 1 Processor -- start 2023-10-06T02:23:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.295+0000 7fbc9aa29b80 1 -- start start 2023-10-06T02:23:48.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.295+0000 7fbc9aa29b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f1258890 0x55d8f1258c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.295+0000 7fbc9aa29b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1259d10 0x55d8f12a8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.295+0000 7fbc9aa29b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f12a8c50 0x55d8f12a90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.295+0000 7fbc9aa29b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f11afac0 con 0x55d8f1259d10 2023-10-06T02:23:48.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.295+0000 7fbc9aa29b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f11ad2c0 con 0x55d8f12a8c50 2023-10-06T02:23:48.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.295+0000 7fbc9aa29b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8f11a90b0 con 0x55d8f1258890 2023-10-06T02:23:48.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.296+0000 7fbc8a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1259d10 0x55d8f12a8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.296+0000 7fbc8a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1259d10 0x55d8f12a8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40416/0 (socket says 172.21.15.6:40416) 2023-10-06T02:23:48.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.296+0000 7fbc8a7fc700 1 -- 172.21.15.6:0/3121533028 learned_addr learned my addr 172.21.15.6:0/3121533028 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.296+0000 7fbc8b7fe700 1 --2- 172.21.15.6:0/3121533028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f12a8c50 0x55d8f12a90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.296+0000 7fbc8affd700 1 --2- 172.21.15.6:0/3121533028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f1258890 0x55d8f1258c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.296+0000 7fbc8a7fc700 1 -- 172.21.15.6:0/3121533028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f1258890 msgr2=0x55d8f1258c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.296+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/3121533028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f1258890 0x55d8f1258c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.296+0000 7fbc8a7fc700 1 -- 172.21.15.6:0/3121533028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f12a8c50 msgr2=0x55d8f12a90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.296+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/3121533028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f12a8c50 0x55d8f12a90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.296+0000 7fbc8a7fc700 1 -- 172.21.15.6:0/3121533028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8f10432c0 con 0x55d8f1259d10 2023-10-06T02:23:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.296+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/3121533028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1259d10 0x55d8f12a8710 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fbc74000e50 tx=0x7fbc74083db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc969968343476e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.296+0000 7fbc6bfff700 1 -- 172.21.15.6:0/3121533028 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74056920 con 0x55d8f1259d10 2023-10-06T02:23:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.296+0000 7fbc6bfff700 1 -- 172.21.15.6:0/3121533028 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc74059b70 con 0x55d8f1259d10 2023-10-06T02:23:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.296+0000 7fbc6bfff700 1 -- 172.21.15.6:0/3121533028 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7405d8c0 con 0x55d8f1259d10 2023-10-06T02:23:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.297+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3121533028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1259d10 msgr2=0x55d8f12a8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.297+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/3121533028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1259d10 0x55d8f12a8710 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fbc74000e50 tx=0x7fbc74083db0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.297+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3121533028 shutdown_connections 2023-10-06T02:23:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.297+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/3121533028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f12a8c50 0x55d8f12a90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.297+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/3121533028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f1258890 0x55d8f1258c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.297+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/3121533028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1259d10 0x55d8f12a8710 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.297+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3121533028 >> 172.21.15.6:0/3121533028 conn(0x55d8f125a1b0 msgr2=0x55d8f125a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.297+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3121533028 shutdown_connections 2023-10-06T02:23:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.297+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3121533028 wait complete. 2023-10-06T02:23:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.297+0000 7fbc9aa29b80 1 -- start start 2023-10-06T02:23:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.298+0000 7fbc9aa29b80 1 Processor -- start 2023-10-06T02:23:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.298+0000 7fbc9aa29b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f1258890 0x55d8f12a5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.298+0000 7fbc9aa29b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1259d10 0x55d8f129a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.298+0000 7fbc9aa29b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f12a8c50 0x55d8f129a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.298+0000 7fbc9aa29b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f11548e0 con 0x55d8f1259d10 2023-10-06T02:23:48.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.298+0000 7fbc9aa29b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f116fef0 con 0x55d8f1258890 2023-10-06T02:23:48.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc9aa29b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8f102be80 con 0x55d8f12a8c50 2023-10-06T02:23:48.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc8a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1259d10 0x55d8f129a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc9aa29b80 10 client.0 _ll_register_callbacks cb 0x55d8f121bec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:23:48.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc8a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1259d10 0x55d8f129a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40430/0 (socket says 172.21.15.6:40430) 2023-10-06T02:23:48.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc8a7fc700 1 -- 172.21.15.6:0/3201320661 learned_addr learned my addr 172.21.15.6:0/3201320661 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:48.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc8affd700 1 --2- 172.21.15.6:0/3201320661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f1258890 0x55d8f12a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc8b7fe700 1 --2- 172.21.15.6:0/3201320661 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f12a8c50 0x55d8f129a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc8a7fc700 1 -- 172.21.15.6:0/3201320661 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f12a8c50 msgr2=0x55d8f129a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/3201320661 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f12a8c50 0x55d8f129a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc8a7fc700 1 -- 172.21.15.6:0/3201320661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f1258890 msgr2=0x55d8f12a5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/3201320661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f1258890 0x55d8f12a5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc8a7fc700 1 -- 172.21.15.6:0/3201320661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8c16aaf0 con 0x55d8f1259d10 2023-10-06T02:23:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/3201320661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1259d10 0x55d8f129a010 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fbc74083f30 tx=0x7fbc74070000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46bc6191d862f7b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc697fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:23:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc697fa700 1 -- 172.21.15.6:0/3201320661 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7405d8c0 con 0x55d8f1259d10 2023-10-06T02:23:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc697fa700 1 -- 172.21.15.6:0/3201320661 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbc74056920 con 0x55d8f1259d10 2023-10-06T02:23:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3201320661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8f124d990 con 0x55d8f1259d10 2023-10-06T02:23:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc697fa700 1 -- 172.21.15.6:0/3201320661 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc740724c0 con 0x55d8f1259d10 2023-10-06T02:23:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc9aa29b80 10 client.6981 fetch_fsmap learned FSMap version 71 2023-10-06T02:23:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.299+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3201320661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55d8f0fe6030 con 0x55d8f1259d10 2023-10-06T02:23:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.300+0000 7fbc697fa700 1 -- 172.21.15.6:0/3201320661 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d8f124d990 con 0x55d8f1259d10 2023-10-06T02:23:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.300+0000 7fbc697fa700 1 -- 172.21.15.6:0/3201320661 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 71) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbc7407e1a0 con 0x55d8f1259d10 2023-10-06T02:23:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.300+0000 7fbc9aa29b80 10 client.6981 fetch_fsmap finished waiting for FSMap version 71 2023-10-06T02:23:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.300+0000 7fbc9aa29b80 10 client.6981 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-10-06T02:23:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.300+0000 7fbc9aa29b80 20 client.6981 populate_metadata read hostname 'smithi006' 2023-10-06T02:23:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.300+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/3201320661 >> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] conn(0x55d8f129aa90 0x55d8f12a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.300+0000 7fbc9aa29b80 4 client.6981 mds_command: new command op to 6789 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:23:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.300+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3201320661 --> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8f122a8c0 con 0x55d8f129aa90 2023-10-06T02:23:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.300+0000 7fbc8affd700 1 --2- 172.21.15.6:0/3201320661 >> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] conn(0x55d8f129aa90 0x55d8f12a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.300+0000 7fbc8affd700 1 --2- 172.21.15.6:0/3201320661 >> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] conn(0x55d8f129aa90 0x55d8f12a6cc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cacc396220691cd6 server_cookie=cbf3f58d4b2f8373 in_seq=0 out_seq=0 2023-10-06T02:23:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.300+0000 7fbc697fa700 10 client.6981 ms_handle_connect on v2:172.21.15.6:6833/1625434310 2023-10-06T02:23:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.301+0000 7fbc697fa700 1 -- 172.21.15.6:0/3201320661 <== mds.0 v2:172.21.15.6:6833/1625434310 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d8f122a8c0 con 0x55d8f129aa90 2023-10-06T02:23:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.301+0000 7fbc697fa700 10 client.6981 handle_command_reply: tid=0 2023-10-06T02:23:48.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.301+0000 7fbc9aa29b80 1 client.6981 shutdown 2023-10-06T02:23:48.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.301+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3201320661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1259d10 msgr2=0x55d8f129a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.301+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/3201320661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1259d10 0x55d8f129a010 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fbc74083f30 tx=0x7fbc74070000 comp rx=0 tx=0).stop 2023-10-06T02:23:48.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.301+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3201320661 shutdown_connections 2023-10-06T02:23:48.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.301+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/3201320661 >> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] conn(0x55d8f129aa90 0x55d8f12a6cc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.301+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/3201320661 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f12a8c50 0x55d8f129a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.301+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/3201320661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f1258890 0x55d8f12a5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.301+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/3201320661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1259d10 0x55d8f129a010 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.301+0000 7fbc697fa700 0 client.6981 ms_handle_reset on v2:172.21.15.6:6833/1625434310 2023-10-06T02:23:48.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.301+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3201320661 >> 172.21.15.6:0/3201320661 conn(0x55d8f125a1b0 msgr2=0x55d8f1259200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:48.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.301+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3201320661 shutdown_connections 2023-10-06T02:23:48.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.301+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3201320661 wait complete. 2023-10-06T02:23:48.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.301+0000 7fbc9aa29b80 20 client.6981 trim_cache size 0 max 16384 2023-10-06T02:23:48.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.315+0000 7fbc9aa29b80 1 Processor -- start 2023-10-06T02:23:48.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.315+0000 7fbc9aa29b80 1 -- start start 2023-10-06T02:23:48.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc9aa29b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f1258890 0x55d8f129d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc9aa29b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f1259d10 0x55d8f1258c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc9aa29b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f12a8c50 0x55d8f129afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc9aa29b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f12a4c40 con 0x55d8f12a8c50 2023-10-06T02:23:48.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc9aa29b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f125b360 con 0x55d8f1258890 2023-10-06T02:23:48.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc9aa29b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8f1259ae0 con 0x55d8f1259d10 2023-10-06T02:23:48.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc8b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f12a8c50 0x55d8f129afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc8b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f12a8c50 0x55d8f129afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40446/0 (socket says 172.21.15.6:40446) 2023-10-06T02:23:48.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc8b7fe700 1 -- 172.21.15.6:0/3134637149 learned_addr learned my addr 172.21.15.6:0/3134637149 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:48.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc8affd700 1 --2- 172.21.15.6:0/3134637149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f1258890 0x55d8f129d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/3134637149 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f1259d10 0x55d8f1258c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc8b7fe700 1 -- 172.21.15.6:0/3134637149 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f1259d10 msgr2=0x55d8f1258c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:48.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc8b7fe700 1 --2- 172.21.15.6:0/3134637149 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f1259d10 0x55d8f1258c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc8b7fe700 1 -- 172.21.15.6:0/3134637149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f1258890 msgr2=0x55d8f129d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:48.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc8b7fe700 1 --2- 172.21.15.6:0/3134637149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f1258890 0x55d8f129d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc8b7fe700 1 -- 172.21.15.6:0/3134637149 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8f129f140 con 0x55d8f12a8c50 2023-10-06T02:23:48.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc8affd700 1 --2- 172.21.15.6:0/3134637149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f1258890 0x55d8f129d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:48.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc8b7fe700 1 --2- 172.21.15.6:0/3134637149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f12a8c50 0x55d8f129afe0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c006f00 tx=0x7fbc7c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d6459b73916bd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.316+0000 7fbc80ff9700 1 -- 172.21.15.6:0/3134637149 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c01c070 con 0x55d8f12a8c50 2023-10-06T02:23:48.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.317+0000 7fbc80ff9700 1 -- 172.21.15.6:0/3134637149 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c017b10 con 0x55d8f12a8c50 2023-10-06T02:23:48.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.317+0000 7fbc80ff9700 1 -- 172.21.15.6:0/3134637149 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c021460 con 0x55d8f12a8c50 2023-10-06T02:23:48.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.317+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3134637149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f12a8c50 msgr2=0x55d8f129afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.317+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/3134637149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f12a8c50 0x55d8f129afe0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c006f00 tx=0x7fbc7c008040 comp rx=0 tx=0).stop 2023-10-06T02:23:48.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.317+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3134637149 shutdown_connections 2023-10-06T02:23:48.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.317+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/3134637149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f12a8c50 0x55d8f129afe0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.317+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/3134637149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f1258890 0x55d8f129d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.317+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/3134637149 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f1259d10 0x55d8f1258c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.317+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3134637149 >> 172.21.15.6:0/3134637149 conn(0x55d8f125a1b0 msgr2=0x55d8f12a25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:48.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.317+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3134637149 shutdown_connections 2023-10-06T02:23:48.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.317+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/3134637149 wait complete. 2023-10-06T02:23:48.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.318+0000 7fbc9aa29b80 1 -- start start 2023-10-06T02:23:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.318+0000 7fbc9aa29b80 1 Processor -- start 2023-10-06T02:23:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc9aa29b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1258890 0x55d8f12a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc9aa29b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f1259d10 0x55d8f1303950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc9aa29b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f12a8c50 0x55d8f1304a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc9aa29b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f1299970 con 0x55d8f1258890 2023-10-06T02:23:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc9aa29b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f1281b40 con 0x55d8f12a8c50 2023-10-06T02:23:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc9aa29b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8f1305770 con 0x55d8f1259d10 2023-10-06T02:23:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc9aa29b80 10 client.0 _ll_register_callbacks cb 0x55d8f121bec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:23:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc8affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1258890 0x55d8f12a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc8affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1258890 0x55d8f12a3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40448/0 (socket says 172.21.15.6:40448) 2023-10-06T02:23:48.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc8affd700 1 -- 172.21.15.6:0/764914063 learned_addr learned my addr 172.21.15.6:0/764914063 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:48.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc8b7fe700 1 --2- 172.21.15.6:0/764914063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f12a8c50 0x55d8f1304a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/764914063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f1259d10 0x55d8f1303950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc8affd700 1 -- 172.21.15.6:0/764914063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f1259d10 msgr2=0x55d8f1303950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:48.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc8affd700 1 --2- 172.21.15.6:0/764914063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f1259d10 0x55d8f1303950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc8affd700 1 -- 172.21.15.6:0/764914063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f12a8c50 msgr2=0x55d8f1304a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:48.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc8affd700 1 --2- 172.21.15.6:0/764914063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f12a8c50 0x55d8f1304a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc8affd700 1 -- 172.21.15.6:0/764914063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7c009b50 con 0x55d8f1258890 2023-10-06T02:23:48.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/764914063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f1259d10 0x55d8f1303950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:48.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc8affd700 1 --2- 172.21.15.6:0/764914063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1258890 0x55d8f12a3a50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fbc84007fd0 tx=0x7fbc84018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4dc99cd6a7c08bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc697fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:23:48.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc697fa700 1 -- 172.21.15.6:0/764914063 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc84030070 con 0x55d8f1258890 2023-10-06T02:23:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc697fa700 1 -- 172.21.15.6:0/764914063 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbc840234d0 con 0x55d8f1258890 2023-10-06T02:23:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/764914063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbc74059b70 con 0x55d8f1258890 2023-10-06T02:23:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc697fa700 1 -- 172.21.15.6:0/764914063 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc84006e60 con 0x55d8f1258890 2023-10-06T02:23:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc9aa29b80 10 client.6987 fetch_fsmap learned FSMap version 71 2023-10-06T02:23:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.319+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/764914063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55d8f11777d0 con 0x55d8f1258890 2023-10-06T02:23:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.320+0000 7fbc697fa700 1 -- 172.21.15.6:0/764914063 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc74059b70 con 0x55d8f1258890 2023-10-06T02:23:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.320+0000 7fbc697fa700 1 -- 172.21.15.6:0/764914063 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 71) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbc84033020 con 0x55d8f1258890 2023-10-06T02:23:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.320+0000 7fbc9aa29b80 10 client.6987 fetch_fsmap finished waiting for FSMap version 71 2023-10-06T02:23:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.320+0000 7fbc9aa29b80 10 client.6987 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-10-06T02:23:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.320+0000 7fbc9aa29b80 20 client.6987 populate_metadata read hostname 'smithi006' 2023-10-06T02:23:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.320+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/764914063 >> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] conn(0x55d8f12a27e0 0x55d8f1298a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.320+0000 7fbc9aa29b80 4 client.6987 mds_command: new command op to 6789 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:23:48.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.320+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/764914063 --> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d8f114be50 con 0x55d8f12a27e0 2023-10-06T02:23:48.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.320+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/764914063 >> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] conn(0x55d8f12a27e0 0x55d8f1298a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.320+0000 7fbc697fa700 10 client.6987 ms_handle_connect on v2:172.21.15.6:6833/1625434310 2023-10-06T02:23:48.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.320+0000 7fbc8a7fc700 1 --2- 172.21.15.6:0/764914063 >> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] conn(0x55d8f12a27e0 0x55d8f1298a10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6935d54cf5b7c36c server_cookie=3042e3222d90c2a1 in_seq=0 out_seq=0 2023-10-06T02:23:48.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.334+0000 7fbc697fa700 1 -- 172.21.15.6:0/764914063 <== mds.0 v2:172.21.15.6:6833/1625434310 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d8f114be50 con 0x55d8f12a27e0 2023-10-06T02:23:48.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.334+0000 7fbc697fa700 10 client.6987 handle_command_reply: tid=0 2023-10-06T02:23:48.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.334+0000 7fbc9aa29b80 1 client.6987 shutdown 2023-10-06T02:23:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.334+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/764914063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1258890 msgr2=0x55d8f12a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.334+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/764914063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1258890 0x55d8f12a3a50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fbc84007fd0 tx=0x7fbc84018000 comp rx=0 tx=0).stop 2023-10-06T02:23:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.334+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/764914063 shutdown_connections 2023-10-06T02:23:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.334+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/764914063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8f12a8c50 0x55d8f1304a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.334+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/764914063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8f1258890 0x55d8f12a3a50 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.334+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/764914063 >> [v2:172.21.15.6:6833/1625434310,v1:172.21.15.6:6835/1625434310] conn(0x55d8f12a27e0 0x55d8f1298a10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.334+0000 7fbc9aa29b80 1 --2- 172.21.15.6:0/764914063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d8f1259d10 0x55d8f1303950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.334+0000 7fbc697fa700 0 client.6987 ms_handle_reset on v2:172.21.15.6:6833/1625434310 2023-10-06T02:23:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.334+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/764914063 >> 172.21.15.6:0/764914063 conn(0x55d8f125a1b0 msgr2=0x55d8f129afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.334+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/764914063 shutdown_connections 2023-10-06T02:23:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.335+0000 7fbc9aa29b80 1 -- 172.21.15.6:0/764914063 wait complete. 2023-10-06T02:23:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.335+0000 7fbc9aa29b80 20 client.6987 trim_cache size 0 max 16384 2023-10-06T02:23:48.337 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:23:48.337 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "", 2023-10-06T02:23:48.337 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0 2023-10-06T02:23:48.337 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:23:48.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.335+0000 7fbc91731700 1 -- 172.21.15.6:0/1857741228 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc6c066f30 msgr2=0x7fbc6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.335+0000 7fbc91731700 1 --2- 172.21.15.6:0/1857741228 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc6c066f30 0x7fbc6c0693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c06a0e0 tx=0x7fbc84009040 comp rx=0 tx=0).stop 2023-10-06T02:23:48.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.335+0000 7fbc91731700 1 -- 172.21.15.6:0/1857741228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8c0c5100 msgr2=0x7fbc8c15cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.335+0000 7fbc91731700 1 --2- 172.21.15.6:0/1857741228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8c0c5100 0x7fbc8c15cc10 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800bb10 tx=0x7fbc74015000 comp rx=0 tx=0).stop 2023-10-06T02:23:48.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.335+0000 7fbc91731700 1 -- 172.21.15.6:0/1857741228 shutdown_connections 2023-10-06T02:23:48.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.335+0000 7fbc91731700 1 --2- 172.21.15.6:0/1857741228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc8c0b1d10 0x7fbc8c0b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.335+0000 7fbc91731700 1 --2- 172.21.15.6:0/1857741228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc78003fd0 0x7fbc8c153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.335+0000 7fbc91731700 1 --2- 172.21.15.6:0/1857741228 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbc6c066f30 0x7fbc6c0693e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.335+0000 7fbc91731700 1 --2- 172.21.15.6:0/1857741228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8c0c5100 0x7fbc8c15cc10 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.335+0000 7fbc91731700 1 -- 172.21.15.6:0/1857741228 >> 172.21.15.6:0/1857741228 conn(0x7fbc8c06a220 msgr2=0x7fbc8c1568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:48.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.335+0000 7fbc91731700 1 -- 172.21.15.6:0/1857741228 shutdown_connections 2023-10-06T02:23:48.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.335+0000 7fbc91731700 1 -- 172.21.15.6:0/1857741228 wait complete. 2023-10-06T02:23:48.347 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_inject_rename_corrupt_dentry_first 1.0 2023-10-06T02:23:48.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.468+0000 7f5deaaa7700 1 Processor -- start 2023-10-06T02:23:48.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.469+0000 7f5deaaa7700 1 -- start start 2023-10-06T02:23:48.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.469+0000 7f5deaaa7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de4086ff0 0x7f5de4087440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.469+0000 7f5deaaa7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5de40b21b0 0x7f5de40b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.469+0000 7f5deaaa7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de4087980 con 0x7f5de415a030 2023-10-06T02:23:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.469+0000 7f5deaaa7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de40b0cf0 con 0x7f5de40b21b0 2023-10-06T02:23:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.469+0000 7f5deaaa7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de40b2b30 con 0x7f5de4086ff0 2023-10-06T02:23:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.469+0000 7f5de9044700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5de40b21b0 0x7f5de40b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.470+0000 7f5de9044700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5de40b21b0 0x7f5de40b25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40454/0 (socket says 172.21.15.6:40454) 2023-10-06T02:23:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.470+0000 7f5de9044700 1 -- 172.21.15.6:0/3001664515 learned_addr learned my addr 172.21.15.6:0/3001664515 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.470+0000 7f5de3fff700 1 --2- 172.21.15.6:0/3001664515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de4086ff0 0x7f5de4087440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.470+0000 7f5de9044700 1 -- 172.21.15.6:0/3001664515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de4086ff0 msgr2=0x7f5de4087440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.470+0000 7f5de9044700 1 --2- 172.21.15.6:0/3001664515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de4086ff0 0x7f5de4087440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.470+0000 7f5de9044700 1 -- 172.21.15.6:0/3001664515 >> v1:172.21.15.175:6789/0 conn(0x7f5de415a030 legacy=0x7f5de415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.470+0000 7f5de9044700 1 -- 172.21.15.6:0/3001664515 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de40afc50 con 0x7f5de40b21b0 2023-10-06T02:23:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.470+0000 7f5de3fff700 1 --2- 172.21.15.6:0/3001664515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de4086ff0 0x7f5de4087440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.470+0000 7f5de9044700 1 --2- 172.21.15.6:0/3001664515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de40b21b0 0x7f5de40b25f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0099b0 tx=0x7f5dcc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270f8811bd1ef4ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.470+0000 7f5de37fe700 1 -- 172.21.15.6:0/3001664515 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00b860 con 0x7f5de40b21b0 2023-10-06T02:23:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.470+0000 7f5de37fe700 1 -- 172.21.15.6:0/3001664515 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc00b9c0 con 0x7f5de40b21b0 2023-10-06T02:23:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.470+0000 7f5de37fe700 1 -- 172.21.15.6:0/3001664515 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00bd60 con 0x7f5de40b21b0 2023-10-06T02:23:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.471+0000 7f5deaaa7700 1 -- 172.21.15.6:0/3001664515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de40b21b0 msgr2=0x7f5de40b25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.471+0000 7f5deaaa7700 1 --2- 172.21.15.6:0/3001664515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de40b21b0 0x7f5de40b25f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0099b0 tx=0x7f5dcc009250 comp rx=0 tx=0).stop 2023-10-06T02:23:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.471+0000 7f5deaaa7700 1 -- 172.21.15.6:0/3001664515 shutdown_connections 2023-10-06T02:23:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.471+0000 7f5deaaa7700 1 --2- 172.21.15.6:0/3001664515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de40b21b0 0x7f5de40b25f0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.471+0000 7f5deaaa7700 1 --2- 172.21.15.6:0/3001664515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de4086ff0 0x7f5de4087440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.471+0000 7f5deaaa7700 1 -- 172.21.15.6:0/3001664515 >> 172.21.15.6:0/3001664515 conn(0x7f5de4068680 msgr2=0x7f5de4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:48.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.471+0000 7f5deaaa7700 1 -- 172.21.15.6:0/3001664515 shutdown_connections 2023-10-06T02:23:48.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.471+0000 7f5deaaa7700 1 -- 172.21.15.6:0/3001664515 wait complete. 2023-10-06T02:23:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.472+0000 7f5deaaa7700 1 Processor -- start 2023-10-06T02:23:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.472+0000 7f5deaaa7700 1 -- start start 2023-10-06T02:23:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5deaaa7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de4086ff0 0x7f5de40ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5deaaa7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de40b21b0 0x7f5de414b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5deaaa7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5de415a030 0x7f5de40aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5deaaa7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de4156ae0 con 0x7f5de4086ff0 2023-10-06T02:23:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5deaaa7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de40cec00 con 0x7f5de415a030 2023-10-06T02:23:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5deaaa7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de416d180 con 0x7f5de40b21b0 2023-10-06T02:23:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5de8843700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de4086ff0 0x7f5de40ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5de8843700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de4086ff0 0x7f5de40ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40460/0 (socket says 172.21.15.6:40460) 2023-10-06T02:23:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5de8843700 1 -- 172.21.15.6:0/2003882653 learned_addr learned my addr 172.21.15.6:0/2003882653 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5de8843700 1 -- 172.21.15.6:0/2003882653 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de40b21b0 msgr2=0x7f5de414b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5de3fff700 1 --2- 172.21.15.6:0/2003882653 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de40b21b0 0x7f5de414b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5de9044700 1 --2- 172.21.15.6:0/2003882653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5de415a030 0x7f5de40aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5de8843700 1 --2- 172.21.15.6:0/2003882653 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de40b21b0 0x7f5de414b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5de8843700 1 -- 172.21.15.6:0/2003882653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5de415a030 msgr2=0x7f5de40aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5de8843700 1 --2- 172.21.15.6:0/2003882653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5de415a030 0x7f5de40aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5de8843700 1 -- 172.21.15.6:0/2003882653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dcc0094f0 con 0x7f5de4086ff0 2023-10-06T02:23:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5de8843700 1 --2- 172.21.15.6:0/2003882653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de4086ff0 0x7f5de40ce6c0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00c8e0 tx=0x7f5ddc001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.473+0000 7f5de0ff9700 1 -- 172.21.15.6:0/2003882653 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc00ce80 con 0x7f5de4086ff0 2023-10-06T02:23:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.474+0000 7f5de0ff9700 1 -- 172.21.15.6:0/2003882653 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc00a7e0 con 0x7f5de4086ff0 2023-10-06T02:23:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.474+0000 7f5de0ff9700 1 -- 172.21.15.6:0/2003882653 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc00aba0 con 0x7f5de4086ff0 2023-10-06T02:23:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.474+0000 7f5deaaa7700 1 -- 172.21.15.6:0/2003882653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de416d460 con 0x7f5de4086ff0 2023-10-06T02:23:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.474+0000 7f5deaaa7700 1 -- 172.21.15.6:0/2003882653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de416da20 con 0x7f5de4086ff0 2023-10-06T02:23:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.475+0000 7f5deaaa7700 1 -- 172.21.15.6:0/2003882653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de4088700 con 0x7f5de4086ff0 2023-10-06T02:23:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.475+0000 7f5de0ff9700 1 -- 172.21.15.6:0/2003882653 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ddc003030 con 0x7f5de4086ff0 2023-10-06T02:23:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.475+0000 7f5de0ff9700 1 --2- 172.21.15.6:0/2003882653 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5dc4066f30 0x7f5dc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.475+0000 7f5de0ff9700 1 -- 172.21.15.6:0/2003882653 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5ddc084830 con 0x7f5de4086ff0 2023-10-06T02:23:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.476+0000 7f5de3fff700 1 --2- 172.21.15.6:0/2003882653 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5dc4066f30 0x7f5dc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.476+0000 7f5de3fff700 1 --2- 172.21.15.6:0/2003882653 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5dc4066f30 0x7f5dc40693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4006f00 tx=0x7f5dd4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.480+0000 7f5de0ff9700 1 -- 172.21.15.6:0/2003882653 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ddc055290 con 0x7f5de4086ff0 2023-10-06T02:23:48.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.675+0000 7f5deaaa7700 1 -- 172.21.15.6:0/2003882653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_inject_rename_corrupt_dentry_first}] v 0) v1 -- 0x7f5de40c72f0 con 0x7f5de4086ff0 2023-10-06T02:23:48.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.679+0000 7f5de0ff9700 1 -- 172.21.15.6:0/2003882653 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_inject_rename_corrupt_dentry_first}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5ddc054e20 con 0x7f5de4086ff0 2023-10-06T02:23:48.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.681+0000 7f5deaaa7700 1 -- 172.21.15.6:0/2003882653 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5dc4066f30 msgr2=0x7f5dc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.681+0000 7f5deaaa7700 1 --2- 172.21.15.6:0/2003882653 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5dc4066f30 0x7f5dc40693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4006f00 tx=0x7f5dd4008040 comp rx=0 tx=0).stop 2023-10-06T02:23:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.681+0000 7f5deaaa7700 1 -- 172.21.15.6:0/2003882653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de4086ff0 msgr2=0x7f5de40ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.681+0000 7f5deaaa7700 1 --2- 172.21.15.6:0/2003882653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de4086ff0 0x7f5de40ce6c0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00c8e0 tx=0x7f5ddc001710 comp rx=0 tx=0).stop 2023-10-06T02:23:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.681+0000 7f5deaaa7700 1 -- 172.21.15.6:0/2003882653 shutdown_connections 2023-10-06T02:23:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.681+0000 7f5deaaa7700 1 --2- 172.21.15.6:0/2003882653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5de415a030 0x7f5de40aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.681+0000 7f5deaaa7700 1 --2- 172.21.15.6:0/2003882653 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5dc4066f30 0x7f5dc40693e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.681+0000 7f5deaaa7700 1 --2- 172.21.15.6:0/2003882653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de4086ff0 0x7f5de40ce6c0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.681+0000 7f5deaaa7700 1 --2- 172.21.15.6:0/2003882653 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de40b21b0 0x7f5de414b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.681+0000 7f5deaaa7700 1 -- 172.21.15.6:0/2003882653 >> 172.21.15.6:0/2003882653 conn(0x7f5de4068680 msgr2=0x7f5de4158c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.681+0000 7f5deaaa7700 1 -- 172.21.15.6:0/2003882653 shutdown_connections 2023-10-06T02:23:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:48.681+0000 7f5deaaa7700 1 -- 172.21.15.6:0/2003882653 wait complete. 2023-10-06T02:23:49.930 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:23:49.933 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:23:53.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:53.694 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'timeout 60 mv a/b a/z') 2023-10-06T02:23:53.697 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-10-06T02:23:53.735 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-06T02:23:53.734+0000 7f38c01f4700 -1 mds.0.cache.den(0x10000000000 z) newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by 0x5650592ec800) (dversion lock w=1 last_client=6957) pv=11 v=10 ap=2 ino=(nil) state=1073741888|bottomlru | request=1 lock=2 authpin=1 0x56505935ca00] 2023-10-06T02:23:53.823 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-06T02:23:53.734+0000 7f38c01f4700 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by 0x5650592ec800) (dversion lock w=1 last_client=6957) pv=11 v=10 ap=2 ino=(nil) state=1073741888|bottomlru | request=1 lock=2 authpin=1 0x56505935ca00] 2023-10-06T02:23:53.826 INFO:tasks.ceph.mds.c.smithi006.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.2.6-1296-g736ac5ba/rpm/el8/BUILD/ceph-17.2.6-1296-g736ac5ba/src/mds/CDentry.cc: In function 'bool CDentry::check_corruption(bool)' thread 7f38c01f4700 time 2023-10-06T02:23:53.735463+0000 2023-10-06T02:23:53.826 INFO:tasks.ceph.mds.c.smithi006.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.2.6-1296-g736ac5ba/rpm/el8/BUILD/ceph-17.2.6-1296-g736ac5ba/src/mds/CDentry.cc: 703: ceph_abort_msg("abort() called") 2023-10-06T02:23:53.827 INFO:tasks.ceph.mds.c.smithi006.stderr: ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable) 2023-10-06T02:23:53.827 INFO:tasks.ceph.mds.c.smithi006.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7f38c89faafd] 2023-10-06T02:23:53.827 INFO:tasks.ceph.mds.c.smithi006.stderr: 2: (CDentry::check_corruption(bool)+0x9a2) [0x5650573483d2] 2023-10-06T02:23:53.827 INFO:tasks.ceph.mds.c.smithi006.stderr: 3: (EMetaBlob::add_primary_dentry(EMetaBlob::dirlump&, CDentry*, CInode*, unsigned char)+0x47) [0x5650571a4c87] 2023-10-06T02:23:53.827 INFO:tasks.ceph.mds.c.smithi006.stderr: 4: (Server::_rename_prepare(boost::intrusive_ptr&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x2685) [0x5650571765b5] 2023-10-06T02:23:53.827 INFO:tasks.ceph.mds.c.smithi006.stderr: 5: (Server::handle_client_rename(boost::intrusive_ptr&)+0x25d4) [0x565057179c74] 2023-10-06T02:23:53.828 INFO:tasks.ceph.mds.c.smithi006.stderr: 6: (Server::handle_client_request(boost::intrusive_ptr const&)+0x6d5) [0x56505718d2f5] 2023-10-06T02:23:53.828 INFO:tasks.ceph.mds.c.smithi006.stderr: 7: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x565057191fcc] 2023-10-06T02:23:53.828 INFO:tasks.ceph.mds.c.smithi006.stderr: 8: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5db) [0x5650570da31b] 2023-10-06T02:23:53.828 INFO:tasks.ceph.mds.c.smithi006.stderr: 9: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5650570da95c] 2023-10-06T02:23:53.828 INFO:tasks.ceph.mds.c.smithi006.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5650570c3d5f] 2023-10-06T02:23:53.828 INFO:tasks.ceph.mds.c.smithi006.stderr: 11: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f38c8c75ef8] 2023-10-06T02:23:53.828 INFO:tasks.ceph.mds.c.smithi006.stderr: 12: (DispatchQueue::entry()+0x50f) [0x7f38c8c7333f] 2023-10-06T02:23:53.828 INFO:tasks.ceph.mds.c.smithi006.stderr: 13: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f38c8d3d751] 2023-10-06T02:23:53.828 INFO:tasks.ceph.mds.c.smithi006.stderr: 14: /lib64/libpthread.so.0(+0x814a) [0x7f38c79ed14a] 2023-10-06T02:23:53.829 INFO:tasks.ceph.mds.c.smithi006.stderr: 15: clone() 2023-10-06T02:23:53.829 INFO:tasks.ceph.mds.c.smithi006.stderr:*** Caught signal (Aborted) ** 2023-10-06T02:23:53.829 INFO:tasks.ceph.mds.c.smithi006.stderr: in thread 7f38c01f4700 thread_name:ms_dispatch 2023-10-06T02:23:53.829 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-06T02:23:53.736+0000 7f38c01f4700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.2.6-1296-g736ac5ba/rpm/el8/BUILD/ceph-17.2.6-1296-g736ac5ba/src/mds/CDentry.cc: In function 'bool CDentry::check_corruption(bool)' thread 7f38c01f4700 time 2023-10-06T02:23:53.735463+0000 2023-10-06T02:23:53.829 INFO:tasks.ceph.mds.c.smithi006.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.2.6-1296-g736ac5ba/rpm/el8/BUILD/ceph-17.2.6-1296-g736ac5ba/src/mds/CDentry.cc: 703: ceph_abort_msg("abort() called") 2023-10-06T02:23:53.829 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:23:53.829 INFO:tasks.ceph.mds.c.smithi006.stderr: ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable) 2023-10-06T02:23:53.829 INFO:tasks.ceph.mds.c.smithi006.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7f38c89faafd] 2023-10-06T02:23:53.829 INFO:tasks.ceph.mds.c.smithi006.stderr: 2: (CDentry::check_corruption(bool)+0x9a2) [0x5650573483d2] 2023-10-06T02:23:53.829 INFO:tasks.ceph.mds.c.smithi006.stderr: 3: (EMetaBlob::add_primary_dentry(EMetaBlob::dirlump&, CDentry*, CInode*, unsigned char)+0x47) [0x5650571a4c87] 2023-10-06T02:23:53.830 INFO:tasks.ceph.mds.c.smithi006.stderr: 4: (Server::_rename_prepare(boost::intrusive_ptr&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x2685) [0x5650571765b5] 2023-10-06T02:23:53.830 INFO:tasks.ceph.mds.c.smithi006.stderr: 5: (Server::handle_client_rename(boost::intrusive_ptr&)+0x25d4) [0x565057179c74] 2023-10-06T02:23:53.830 INFO:tasks.ceph.mds.c.smithi006.stderr: 6: (Server::handle_client_request(boost::intrusive_ptr const&)+0x6d5) [0x56505718d2f5] 2023-10-06T02:23:53.830 INFO:tasks.ceph.mds.c.smithi006.stderr: 7: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x565057191fcc] 2023-10-06T02:23:53.830 INFO:tasks.ceph.mds.c.smithi006.stderr: 8: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5db) [0x5650570da31b] 2023-10-06T02:23:53.830 INFO:tasks.ceph.mds.c.smithi006.stderr: 9: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5650570da95c] 2023-10-06T02:23:53.830 INFO:tasks.ceph.mds.c.smithi006.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5650570c3d5f] 2023-10-06T02:23:53.830 INFO:tasks.ceph.mds.c.smithi006.stderr: 11: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f38c8c75ef8] 2023-10-06T02:23:53.830 INFO:tasks.ceph.mds.c.smithi006.stderr: 12: (DispatchQueue::entry()+0x50f) [0x7f38c8c7333f] 2023-10-06T02:23:53.831 INFO:tasks.ceph.mds.c.smithi006.stderr: 13: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f38c8d3d751] 2023-10-06T02:23:53.831 INFO:tasks.ceph.mds.c.smithi006.stderr: 14: /lib64/libpthread.so.0(+0x814a) [0x7f38c79ed14a] 2023-10-06T02:23:53.831 INFO:tasks.ceph.mds.c.smithi006.stderr: 15: clone() 2023-10-06T02:23:53.831 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:23:53.831 INFO:tasks.ceph.mds.c.smithi006.stderr: ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable) 2023-10-06T02:23:53.831 INFO:tasks.ceph.mds.c.smithi006.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f38c79f7b20] 2023-10-06T02:23:53.832 INFO:tasks.ceph.mds.c.smithi006.stderr: 2: gsignal() 2023-10-06T02:23:53.832 INFO:tasks.ceph.mds.c.smithi006.stderr: 3: abort() 2023-10-06T02:23:53.832 INFO:tasks.ceph.mds.c.smithi006.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x7f38c89fabbd] 2023-10-06T02:23:53.832 INFO:tasks.ceph.mds.c.smithi006.stderr: 5: (CDentry::check_corruption(bool)+0x9a2) [0x5650573483d2] 2023-10-06T02:23:53.832 INFO:tasks.ceph.mds.c.smithi006.stderr: 6: (EMetaBlob::add_primary_dentry(EMetaBlob::dirlump&, CDentry*, CInode*, unsigned char)+0x47) [0x5650571a4c87] 2023-10-06T02:23:53.832 INFO:tasks.ceph.mds.c.smithi006.stderr: 7: (Server::_rename_prepare(boost::intrusive_ptr&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x2685) [0x5650571765b5] 2023-10-06T02:23:53.832 INFO:tasks.ceph.mds.c.smithi006.stderr: 8: (Server::handle_client_rename(boost::intrusive_ptr&)+0x25d4) [0x565057179c74] 2023-10-06T02:23:53.833 INFO:tasks.ceph.mds.c.smithi006.stderr: 9: (Server::handle_client_request(boost::intrusive_ptr const&)+0x6d5) [0x56505718d2f5] 2023-10-06T02:23:53.833 INFO:tasks.ceph.mds.c.smithi006.stderr: 10: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x565057191fcc] 2023-10-06T02:23:53.833 INFO:tasks.ceph.mds.c.smithi006.stderr: 11: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5db) [0x5650570da31b] 2023-10-06T02:23:53.833 INFO:tasks.ceph.mds.c.smithi006.stderr: 12: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5650570da95c] 2023-10-06T02:23:53.833 INFO:tasks.ceph.mds.c.smithi006.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5650570c3d5f] 2023-10-06T02:23:53.833 INFO:tasks.ceph.mds.c.smithi006.stderr: 14: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f38c8c75ef8] 2023-10-06T02:23:53.833 INFO:tasks.ceph.mds.c.smithi006.stderr: 15: (DispatchQueue::entry()+0x50f) [0x7f38c8c7333f] 2023-10-06T02:23:53.834 INFO:tasks.ceph.mds.c.smithi006.stderr: 16: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f38c8d3d751] 2023-10-06T02:23:53.834 INFO:tasks.ceph.mds.c.smithi006.stderr: 17: /lib64/libpthread.so.0(+0x814a) [0x7f38c79ed14a] 2023-10-06T02:23:53.834 INFO:tasks.ceph.mds.c.smithi006.stderr: 18: clone() 2023-10-06T02:23:53.834 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-06T02:23:53.737+0000 7f38c01f4700 -1 *** Caught signal (Aborted) ** 2023-10-06T02:23:53.834 INFO:tasks.ceph.mds.c.smithi006.stderr: in thread 7f38c01f4700 thread_name:ms_dispatch 2023-10-06T02:23:53.834 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:23:53.834 INFO:tasks.ceph.mds.c.smithi006.stderr: ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable) 2023-10-06T02:23:53.835 INFO:tasks.ceph.mds.c.smithi006.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f38c79f7b20] 2023-10-06T02:23:53.835 INFO:tasks.ceph.mds.c.smithi006.stderr: 2: gsignal() 2023-10-06T02:23:53.835 INFO:tasks.ceph.mds.c.smithi006.stderr: 3: abort() 2023-10-06T02:23:53.835 INFO:tasks.ceph.mds.c.smithi006.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x7f38c89fabbd] 2023-10-06T02:23:53.835 INFO:tasks.ceph.mds.c.smithi006.stderr: 5: (CDentry::check_corruption(bool)+0x9a2) [0x5650573483d2] 2023-10-06T02:23:53.835 INFO:tasks.ceph.mds.c.smithi006.stderr: 6: (EMetaBlob::add_primary_dentry(EMetaBlob::dirlump&, CDentry*, CInode*, unsigned char)+0x47) [0x5650571a4c87] 2023-10-06T02:23:53.835 INFO:tasks.ceph.mds.c.smithi006.stderr: 7: (Server::_rename_prepare(boost::intrusive_ptr&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x2685) [0x5650571765b5] 2023-10-06T02:23:53.835 INFO:tasks.ceph.mds.c.smithi006.stderr: 8: (Server::handle_client_rename(boost::intrusive_ptr&)+0x25d4) [0x565057179c74] 2023-10-06T02:23:53.835 INFO:tasks.ceph.mds.c.smithi006.stderr: 9: (Server::handle_client_request(boost::intrusive_ptr const&)+0x6d5) [0x56505718d2f5] 2023-10-06T02:23:53.835 INFO:tasks.ceph.mds.c.smithi006.stderr: 10: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x565057191fcc] 2023-10-06T02:23:53.836 INFO:tasks.ceph.mds.c.smithi006.stderr: 11: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5db) [0x5650570da31b] 2023-10-06T02:23:53.836 INFO:tasks.ceph.mds.c.smithi006.stderr: 12: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5650570da95c] 2023-10-06T02:23:53.836 INFO:tasks.ceph.mds.c.smithi006.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5650570c3d5f] 2023-10-06T02:23:53.836 INFO:tasks.ceph.mds.c.smithi006.stderr: 14: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f38c8c75ef8] 2023-10-06T02:23:53.836 INFO:tasks.ceph.mds.c.smithi006.stderr: 15: (DispatchQueue::entry()+0x50f) [0x7f38c8c7333f] 2023-10-06T02:23:53.836 INFO:tasks.ceph.mds.c.smithi006.stderr: 16: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f38c8d3d751] 2023-10-06T02:23:53.836 INFO:tasks.ceph.mds.c.smithi006.stderr: 17: /lib64/libpthread.so.0(+0x814a) [0x7f38c79ed14a] 2023-10-06T02:23:53.836 INFO:tasks.ceph.mds.c.smithi006.stderr: 18: clone() 2023-10-06T02:23:53.836 INFO:tasks.ceph.mds.c.smithi006.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-06T02:23:53.836 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:23:53.836 INFO:tasks.ceph.mds.c.smithi006.stderr: -2861> 2023-10-06T02:23:43.321+0000 7f38bd9ef700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:23:53.837 INFO:tasks.ceph.mds.c.smithi006.stderr: -4> 2023-10-06T02:23:53.734+0000 7f38c01f4700 -1 mds.0.cache.den(0x10000000000 z) newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by 0x5650592ec800) (dversion lock w=1 last_client=6957) pv=11 v=10 ap=2 ino=(nil) state=1073741888|bottomlru | request=1 lock=2 authpin=1 0x56505935ca00] 2023-10-06T02:23:53.837 INFO:tasks.ceph.mds.c.smithi006.stderr: -2> 2023-10-06T02:23:53.734+0000 7f38c01f4700 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by 0x5650592ec800) (dversion lock w=1 last_client=6957) pv=11 v=10 ap=2 ino=(nil) state=1073741888|bottomlru | request=1 lock=2 authpin=1 0x56505935ca00] 2023-10-06T02:23:53.837 INFO:tasks.ceph.mds.c.smithi006.stderr: -1> 2023-10-06T02:23:53.736+0000 7f38c01f4700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.2.6-1296-g736ac5ba/rpm/el8/BUILD/ceph-17.2.6-1296-g736ac5ba/src/mds/CDentry.cc: In function 'bool CDentry::check_corruption(bool)' thread 7f38c01f4700 time 2023-10-06T02:23:53.735463+0000 2023-10-06T02:23:53.837 INFO:tasks.ceph.mds.c.smithi006.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.2.6-1296-g736ac5ba/rpm/el8/BUILD/ceph-17.2.6-1296-g736ac5ba/src/mds/CDentry.cc: 703: ceph_abort_msg("abort() called") 2023-10-06T02:23:53.837 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:23:53.837 INFO:tasks.ceph.mds.c.smithi006.stderr: ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable) 2023-10-06T02:23:53.837 INFO:tasks.ceph.mds.c.smithi006.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7f38c89faafd] 2023-10-06T02:23:53.837 INFO:tasks.ceph.mds.c.smithi006.stderr: 2: (CDentry::check_corruption(bool)+0x9a2) [0x5650573483d2] 2023-10-06T02:23:53.837 INFO:tasks.ceph.mds.c.smithi006.stderr: 3: (EMetaBlob::add_primary_dentry(EMetaBlob::dirlump&, CDentry*, CInode*, unsigned char)+0x47) [0x5650571a4c87] 2023-10-06T02:23:53.837 INFO:tasks.ceph.mds.c.smithi006.stderr: 4: (Server::_rename_prepare(boost::intrusive_ptr&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x2685) [0x5650571765b5] 2023-10-06T02:23:53.838 INFO:tasks.ceph.mds.c.smithi006.stderr: 5: (Server::handle_client_rename(boost::intrusive_ptr&)+0x25d4) [0x565057179c74] 2023-10-06T02:23:53.838 INFO:tasks.ceph.mds.c.smithi006.stderr: 6: (Server::handle_client_request(boost::intrusive_ptr const&)+0x6d5) [0x56505718d2f5] 2023-10-06T02:23:53.838 INFO:tasks.ceph.mds.c.smithi006.stderr: 7: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x565057191fcc] 2023-10-06T02:23:53.838 INFO:tasks.ceph.mds.c.smithi006.stderr: 8: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5db) [0x5650570da31b] 2023-10-06T02:23:53.838 INFO:tasks.ceph.mds.c.smithi006.stderr: 9: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5650570da95c] 2023-10-06T02:23:53.838 INFO:tasks.ceph.mds.c.smithi006.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5650570c3d5f] 2023-10-06T02:23:53.838 INFO:tasks.ceph.mds.c.smithi006.stderr: 11: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f38c8c75ef8] 2023-10-06T02:23:53.838 INFO:tasks.ceph.mds.c.smithi006.stderr: 12: (DispatchQueue::entry()+0x50f) [0x7f38c8c7333f] 2023-10-06T02:23:53.838 INFO:tasks.ceph.mds.c.smithi006.stderr: 13: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f38c8d3d751] 2023-10-06T02:23:53.839 INFO:tasks.ceph.mds.c.smithi006.stderr: 14: /lib64/libpthread.so.0(+0x814a) [0x7f38c79ed14a] 2023-10-06T02:23:53.839 INFO:tasks.ceph.mds.c.smithi006.stderr: 15: clone() 2023-10-06T02:23:53.839 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:23:53.839 INFO:tasks.ceph.mds.c.smithi006.stderr: 0> 2023-10-06T02:23:53.737+0000 7f38c01f4700 -1 *** Caught signal (Aborted) ** 2023-10-06T02:23:53.839 INFO:tasks.ceph.mds.c.smithi006.stderr: in thread 7f38c01f4700 thread_name:ms_dispatch 2023-10-06T02:23:53.839 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:23:53.839 INFO:tasks.ceph.mds.c.smithi006.stderr: ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable) 2023-10-06T02:23:53.839 INFO:tasks.ceph.mds.c.smithi006.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f38c79f7b20] 2023-10-06T02:23:53.839 INFO:tasks.ceph.mds.c.smithi006.stderr: 2: gsignal() 2023-10-06T02:23:53.839 INFO:tasks.ceph.mds.c.smithi006.stderr: 3: abort() 2023-10-06T02:23:53.840 INFO:tasks.ceph.mds.c.smithi006.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x7f38c89fabbd] 2023-10-06T02:23:53.840 INFO:tasks.ceph.mds.c.smithi006.stderr: 5: (CDentry::check_corruption(bool)+0x9a2) [0x5650573483d2] 2023-10-06T02:23:53.840 INFO:tasks.ceph.mds.c.smithi006.stderr: 6: (EMetaBlob::add_primary_dentry(EMetaBlob::dirlump&, CDentry*, CInode*, unsigned char)+0x47) [0x5650571a4c87] 2023-10-06T02:23:53.840 INFO:tasks.ceph.mds.c.smithi006.stderr: 7: (Server::_rename_prepare(boost::intrusive_ptr&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x2685) [0x5650571765b5] 2023-10-06T02:23:53.840 INFO:tasks.ceph.mds.c.smithi006.stderr: 8: (Server::handle_client_rename(boost::intrusive_ptr&)+0x25d4) [0x565057179c74] 2023-10-06T02:23:53.840 INFO:tasks.ceph.mds.c.smithi006.stderr: 9: (Server::handle_client_request(boost::intrusive_ptr const&)+0x6d5) [0x56505718d2f5] 2023-10-06T02:23:53.840 INFO:tasks.ceph.mds.c.smithi006.stderr: 10: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x565057191fcc] 2023-10-06T02:23:53.840 INFO:tasks.ceph.mds.c.smithi006.stderr: 11: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5db) [0x5650570da31b] 2023-10-06T02:23:53.840 INFO:tasks.ceph.mds.c.smithi006.stderr: 12: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5650570da95c] 2023-10-06T02:23:53.840 INFO:tasks.ceph.mds.c.smithi006.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5650570c3d5f] 2023-10-06T02:23:53.840 INFO:tasks.ceph.mds.c.smithi006.stderr: 14: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f38c8c75ef8] 2023-10-06T02:23:53.841 INFO:tasks.ceph.mds.c.smithi006.stderr: 15: (DispatchQueue::entry()+0x50f) [0x7f38c8c7333f] 2023-10-06T02:23:53.841 INFO:tasks.ceph.mds.c.smithi006.stderr: 16: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f38c8d3d751] 2023-10-06T02:23:53.841 INFO:tasks.ceph.mds.c.smithi006.stderr: 17: /lib64/libpthread.so.0(+0x814a) [0x7f38c79ed14a] 2023-10-06T02:23:53.841 INFO:tasks.ceph.mds.c.smithi006.stderr: 18: clone() 2023-10-06T02:23:53.841 INFO:tasks.ceph.mds.c.smithi006.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-06T02:23:53.841 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:23:53.841 INFO:tasks.ceph.mds.c.smithi006.stderr: -2861> 2023-10-06T02:23:43.321+0000 7f38bd9ef700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:23:53.841 INFO:tasks.ceph.mds.c.smithi006.stderr: -4> 2023-10-06T02:23:53.734+0000 7f38c01f4700 -1 mds.0.cache.den(0x10000000000 z) newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by 0x5650592ec800) (dversion lock w=1 last_client=6957) pv=11 v=10 ap=2 ino=(nil) state=1073741888|bottomlru | request=1 lock=2 authpin=1 0x56505935ca00] 2023-10-06T02:23:53.841 INFO:tasks.ceph.mds.c.smithi006.stderr: -2> 2023-10-06T02:23:53.734+0000 7f38c01f4700 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a/z [fffffffffffffff6,head] auth NULL (dn xlock x=1 by 0x5650592ec800) (dversion lock w=1 last_client=6957) pv=11 v=10 ap=2 ino=(nil) state=1073741888|bottomlru | request=1 lock=2 authpin=1 0x56505935ca00] 2023-10-06T02:23:53.841 INFO:tasks.ceph.mds.c.smithi006.stderr: -1> 2023-10-06T02:23:53.736+0000 7f38c01f4700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.2.6-1296-g736ac5ba/rpm/el8/BUILD/ceph-17.2.6-1296-g736ac5ba/src/mds/CDentry.cc: In function 'bool CDentry::check_corruption(bool)' thread 7f38c01f4700 time 2023-10-06T02:23:53.735463+0000 2023-10-06T02:23:53.842 INFO:tasks.ceph.mds.c.smithi006.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.2.6-1296-g736ac5ba/rpm/el8/BUILD/ceph-17.2.6-1296-g736ac5ba/src/mds/CDentry.cc: 703: ceph_abort_msg("abort() called") 2023-10-06T02:23:53.842 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:23:53.842 INFO:tasks.ceph.mds.c.smithi006.stderr: ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable) 2023-10-06T02:23:53.842 INFO:tasks.ceph.mds.c.smithi006.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7f38c89faafd] 2023-10-06T02:23:53.842 INFO:tasks.ceph.mds.c.smithi006.stderr: 2: (CDentry::check_corruption(bool)+0x9a2) [0x5650573483d2] 2023-10-06T02:23:53.842 INFO:tasks.ceph.mds.c.smithi006.stderr: 3: (EMetaBlob::add_primary_dentry(EMetaBlob::dirlump&, CDentry*, CInode*, unsigned char)+0x47) [0x5650571a4c87] 2023-10-06T02:23:53.842 INFO:tasks.ceph.mds.c.smithi006.stderr: 4: (Server::_rename_prepare(boost::intrusive_ptr&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x2685) [0x5650571765b5] 2023-10-06T02:23:53.842 INFO:tasks.ceph.mds.c.smithi006.stderr: 5: (Server::handle_client_rename(boost::intrusive_ptr&)+0x25d4) [0x565057179c74] 2023-10-06T02:23:53.842 INFO:tasks.ceph.mds.c.smithi006.stderr: 6: (Server::handle_client_request(boost::intrusive_ptr const&)+0x6d5) [0x56505718d2f5] 2023-10-06T02:23:53.842 INFO:tasks.ceph.mds.c.smithi006.stderr: 7: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x565057191fcc] 2023-10-06T02:23:53.843 INFO:tasks.ceph.mds.c.smithi006.stderr: 8: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5db) [0x5650570da31b] 2023-10-06T02:23:53.843 INFO:tasks.ceph.mds.c.smithi006.stderr: 9: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5650570da95c] 2023-10-06T02:23:53.843 INFO:tasks.ceph.mds.c.smithi006.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5650570c3d5f] 2023-10-06T02:23:53.843 INFO:tasks.ceph.mds.c.smithi006.stderr: 11: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f38c8c75ef8] 2023-10-06T02:23:53.843 INFO:tasks.ceph.mds.c.smithi006.stderr: 12: (DispatchQueue::entry()+0x50f) [0x7f38c8c7333f] 2023-10-06T02:23:53.843 INFO:tasks.ceph.mds.c.smithi006.stderr: 13: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f38c8d3d751] 2023-10-06T02:23:53.843 INFO:tasks.ceph.mds.c.smithi006.stderr: 14: /lib64/libpthread.so.0(+0x814a) [0x7f38c79ed14a] 2023-10-06T02:23:53.843 INFO:tasks.ceph.mds.c.smithi006.stderr: 15: clone() 2023-10-06T02:23:53.843 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:23:53.843 INFO:tasks.ceph.mds.c.smithi006.stderr: 0> 2023-10-06T02:23:53.737+0000 7f38c01f4700 -1 *** Caught signal (Aborted) ** 2023-10-06T02:23:53.844 INFO:tasks.ceph.mds.c.smithi006.stderr: in thread 7f38c01f4700 thread_name:ms_dispatch 2023-10-06T02:23:53.844 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:23:53.844 INFO:tasks.ceph.mds.c.smithi006.stderr: ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable) 2023-10-06T02:23:53.844 INFO:tasks.ceph.mds.c.smithi006.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f38c79f7b20] 2023-10-06T02:23:53.844 INFO:tasks.ceph.mds.c.smithi006.stderr: 2: gsignal() 2023-10-06T02:23:53.844 INFO:tasks.ceph.mds.c.smithi006.stderr: 3: abort() 2023-10-06T02:23:53.844 INFO:tasks.ceph.mds.c.smithi006.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x7f38c89fabbd] 2023-10-06T02:23:53.844 INFO:tasks.ceph.mds.c.smithi006.stderr: 5: (CDentry::check_corruption(bool)+0x9a2) [0x5650573483d2] 2023-10-06T02:23:53.844 INFO:tasks.ceph.mds.c.smithi006.stderr: 6: (EMetaBlob::add_primary_dentry(EMetaBlob::dirlump&, CDentry*, CInode*, unsigned char)+0x47) [0x5650571a4c87] 2023-10-06T02:23:53.844 INFO:tasks.ceph.mds.c.smithi006.stderr: 7: (Server::_rename_prepare(boost::intrusive_ptr&, EMetaBlob*, ceph::buffer::v15_2_0::list*, CDentry*, CDentry*, std::basic_string_view >, CDentry*)+0x2685) [0x5650571765b5] 2023-10-06T02:23:53.845 INFO:tasks.ceph.mds.c.smithi006.stderr: 8: (Server::handle_client_rename(boost::intrusive_ptr&)+0x25d4) [0x565057179c74] 2023-10-06T02:23:53.845 INFO:tasks.ceph.mds.c.smithi006.stderr: 9: (Server::handle_client_request(boost::intrusive_ptr const&)+0x6d5) [0x56505718d2f5] 2023-10-06T02:23:53.845 INFO:tasks.ceph.mds.c.smithi006.stderr: 10: (Server::dispatch(boost::intrusive_ptr const&)+0x13c) [0x565057191fcc] 2023-10-06T02:23:53.845 INFO:tasks.ceph.mds.c.smithi006.stderr: 11: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5db) [0x5650570da31b] 2023-10-06T02:23:53.845 INFO:tasks.ceph.mds.c.smithi006.stderr: 12: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5650570da95c] 2023-10-06T02:23:53.845 INFO:tasks.ceph.mds.c.smithi006.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5650570c3d5f] 2023-10-06T02:23:53.845 INFO:tasks.ceph.mds.c.smithi006.stderr: 14: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f38c8c75ef8] 2023-10-06T02:23:53.845 INFO:tasks.ceph.mds.c.smithi006.stderr: 15: (DispatchQueue::entry()+0x50f) [0x7f38c8c7333f] 2023-10-06T02:23:53.845 INFO:tasks.ceph.mds.c.smithi006.stderr: 16: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f38c8d3d751] 2023-10-06T02:23:53.845 INFO:tasks.ceph.mds.c.smithi006.stderr: 17: /lib64/libpthread.so.0(+0x814a) [0x7f38c79ed14a] 2023-10-06T02:23:53.845 INFO:tasks.ceph.mds.c.smithi006.stderr: 18: clone() 2023-10-06T02:23:53.846 INFO:tasks.ceph.mds.c.smithi006.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-06T02:23:53.846 INFO:tasks.ceph.mds.c.smithi006.stderr: 2023-10-06T02:23:53.871 INFO:teuthology.orchestra.run.smithi006.stdout:{"mds_beacon_grace":"15.000000"} 2023-10-06T02:23:53.871 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-10-06T02:23:53.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.032+0000 7ff0bdb4d700 1 Processor -- start 2023-10-06T02:23:54.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.032+0000 7ff0bdb4d700 1 -- start start 2023-10-06T02:23:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.033+0000 7ff0bdb4d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff0b8159400 0x7ff0b80ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.033+0000 7ff0bdb4d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0b80d05d0 0x7ff0b80b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.033+0000 7ff0bdb4d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b80b3560 con 0x7ff0b80cd030 2023-10-06T02:23:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.033+0000 7ff0bdb4d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b80cf6f0 con 0x7ff0b8159400 2023-10-06T02:23:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.033+0000 7ff0bdb4d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b80cf9d0 con 0x7ff0b80d05d0 2023-10-06T02:23:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.033+0000 7ff0bcb4b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff0b8159400 0x7ff0b80ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.033+0000 7ff0bcb4b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff0b8159400 0x7ff0b80ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55086/0 (socket says 172.21.15.6:55086) 2023-10-06T02:23:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.033+0000 7ff0bcb4b700 1 -- 172.21.15.6:0/1819530686 learned_addr learned my addr 172.21.15.6:0/1819530686 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.033+0000 7ff0bd34c700 1 --2- 172.21.15.6:0/1819530686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0b80d05d0 0x7ff0b80b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.033+0000 7ff0bcb4b700 1 -- 172.21.15.6:0/1819530686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0b80d05d0 msgr2=0x7ff0b80b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.033+0000 7ff0bcb4b700 1 --2- 172.21.15.6:0/1819530686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0b80d05d0 0x7ff0b80b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.033+0000 7ff0bcb4b700 1 -- 172.21.15.6:0/1819530686 >> v1:172.21.15.175:6789/0 conn(0x7ff0b80cd030 legacy=0x7ff0b80cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.033+0000 7ff0bcb4b700 1 -- 172.21.15.6:0/1819530686 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b80b2f10 con 0x7ff0b8159400 2023-10-06T02:23:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.033+0000 7ff0bcb4b700 1 --2- 172.21.15.6:0/1819530686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b8159400 0x7ff0b80ccaf0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0009990 tx=0x7ff0b0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c8f57f3fb7f2e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.034+0000 7ff0b77fe700 1 -- 172.21.15.6:0/1819530686 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0005c10 con 0x7ff0b8159400 2023-10-06T02:23:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.034+0000 7ff0b77fe700 1 -- 172.21.15.6:0/1819530686 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b0005d70 con 0x7ff0b8159400 2023-10-06T02:23:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.034+0000 7ff0b77fe700 1 -- 172.21.15.6:0/1819530686 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b000b880 con 0x7ff0b8159400 2023-10-06T02:23:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.034+0000 7ff0bdb4d700 1 -- 172.21.15.6:0/1819530686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b8159400 msgr2=0x7ff0b80ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.034+0000 7ff0bdb4d700 1 --2- 172.21.15.6:0/1819530686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b8159400 0x7ff0b80ccaf0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0009990 tx=0x7ff0b0009220 comp rx=0 tx=0).stop 2023-10-06T02:23:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.034+0000 7ff0bdb4d700 1 -- 172.21.15.6:0/1819530686 shutdown_connections 2023-10-06T02:23:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.034+0000 7ff0bdb4d700 1 --2- 172.21.15.6:0/1819530686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0b80d05d0 0x7ff0b80b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.034+0000 7ff0bdb4d700 1 --2- 172.21.15.6:0/1819530686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b8159400 0x7ff0b80ccaf0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.034+0000 7ff0bdb4d700 1 -- 172.21.15.6:0/1819530686 >> 172.21.15.6:0/1819530686 conn(0x7ff0b806ac10 msgr2=0x7ff0b8068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.034+0000 7ff0bdb4d700 1 -- 172.21.15.6:0/1819530686 shutdown_connections 2023-10-06T02:23:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.034+0000 7ff0bdb4d700 1 -- 172.21.15.6:0/1819530686 wait complete. 2023-10-06T02:23:54.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.035+0000 7ff0bdb4d700 1 Processor -- start 2023-10-06T02:23:54.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.035+0000 7ff0bdb4d700 1 -- start start 2023-10-06T02:23:54.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.036+0000 7ff0bdb4d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b80cd030 0x7ff0b8152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.036+0000 7ff0bdb4d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b80d05d0 0x7ff0b80b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.036+0000 7ff0bdb4d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0b8159400 0x7ff0b8169ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.036+0000 7ff0bdb4d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b80b1e90 con 0x7ff0b80d05d0 2023-10-06T02:23:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.036+0000 7ff0bdb4d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b8152590 con 0x7ff0b80cd030 2023-10-06T02:23:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.036+0000 7ff0bdb4d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b80b1280 con 0x7ff0b8159400 2023-10-06T02:23:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.036+0000 7ff0b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b80d05d0 0x7ff0b80b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.036+0000 7ff0b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b80d05d0 0x7ff0b80b0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55094/0 (socket says 172.21.15.6:55094) 2023-10-06T02:23:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.036+0000 7ff0b7fff700 1 -- 172.21.15.6:0/3185093013 learned_addr learned my addr 172.21.15.6:0/3185093013 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.036+0000 7ff0bd34c700 1 --2- 172.21.15.6:0/3185093013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0b8159400 0x7ff0b8169ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.036+0000 7ff0bcb4b700 1 --2- 172.21.15.6:0/3185093013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b80cd030 0x7ff0b8152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.037+0000 7ff0b7fff700 1 -- 172.21.15.6:0/3185093013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0b8159400 msgr2=0x7ff0b8169ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.037+0000 7ff0b7fff700 1 --2- 172.21.15.6:0/3185093013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0b8159400 0x7ff0b8169ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.037+0000 7ff0b7fff700 1 -- 172.21.15.6:0/3185093013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b80cd030 msgr2=0x7ff0b8152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.037+0000 7ff0b7fff700 1 --2- 172.21.15.6:0/3185093013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b80cd030 0x7ff0b8152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.037+0000 7ff0b7fff700 1 -- 172.21.15.6:0/3185093013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b0009480 con 0x7ff0b80d05d0 2023-10-06T02:23:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.037+0000 7ff0b7fff700 1 --2- 172.21.15.6:0/3185093013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b80d05d0 0x7ff0b80b0a30 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800cb40 tx=0x7ff0a80017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.037+0000 7ff0b4ff9700 1 -- 172.21.15.6:0/3185093013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a800a7a0 con 0x7ff0b80d05d0 2023-10-06T02:23:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.037+0000 7ff0b4ff9700 1 -- 172.21.15.6:0/3185093013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a800a920 con 0x7ff0b80d05d0 2023-10-06T02:23:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.037+0000 7ff0bdb4d700 1 -- 172.21.15.6:0/3185093013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b80b1560 con 0x7ff0b80d05d0 2023-10-06T02:23:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.037+0000 7ff0b4ff9700 1 -- 172.21.15.6:0/3185093013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a800ace0 con 0x7ff0b80d05d0 2023-10-06T02:23:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.037+0000 7ff0bdb4d700 1 -- 172.21.15.6:0/3185093013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b80b1b20 con 0x7ff0b80d05d0 2023-10-06T02:23:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.038+0000 7ff0bdb4d700 1 -- 172.21.15.6:0/3185093013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b80cf230 con 0x7ff0b80d05d0 2023-10-06T02:23:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.038+0000 7ff0b4ff9700 1 -- 172.21.15.6:0/3185093013 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0a8003030 con 0x7ff0b80d05d0 2023-10-06T02:23:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.039+0000 7ff0b4ff9700 1 --2- 172.21.15.6:0/3185093013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff098066f30 0x7ff0980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.039+0000 7ff0b4ff9700 1 -- 172.21.15.6:0/3185093013 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff0a80848b0 con 0x7ff0b80d05d0 2023-10-06T02:23:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.039+0000 7ff0bcb4b700 1 --2- 172.21.15.6:0/3185093013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff098066f30 0x7ff0980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.040+0000 7ff0bcb4b700 1 --2- 172.21.15.6:0/3185093013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff098066f30 0x7ff0980693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0009260 tx=0x7ff0b0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.043+0000 7ff0b4ff9700 1 -- 172.21.15.6:0/3185093013 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0a8051880 con 0x7ff0b80d05d0 2023-10-06T02:23:54.136 INFO:tasks.ceph.mds.c.smithi006.stderr:daemon-helper: command crashed with signal 6 2023-10-06T02:23:54.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.282+0000 7ff0bdb4d700 1 -- 172.21.15.6:0/3185093013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0b80b31f0 con 0x7ff0b80d05d0 2023-10-06T02:23:54.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.283+0000 7ff0b4ff9700 1 -- 172.21.15.6:0/3185093013 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4596 (secure 0 0 0) 0x7ff0a8054ea0 con 0x7ff0b80d05d0 2023-10-06T02:23:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:54.283 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":71,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2575759355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2575759355},{"type":"v1","addr":"172.21.15.175:6836","nonce":2575759355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2523304335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2523304335},{"type":"v1","addr":"172.21.15.175:6837","nonce":2523304335}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":6786,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/353268974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":353268974},{"type":"v1","addr":"172.21.15.6:6834","nonce":353268974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:38.399768+0000","modified":"2023-10-06T02:23:48.056925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6789":{"gid":6789,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1625434310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1625434310},{"type":"v1","addr":"172.21.15.6:6835","nonce":1625434310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:23:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.285+0000 7ff0bdb4d700 1 -- 172.21.15.6:0/3185093013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff098066f30 msgr2=0x7ff0980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.285+0000 7ff0bdb4d700 1 --2- 172.21.15.6:0/3185093013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff098066f30 0x7ff0980693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0009260 tx=0x7ff0b0016000 comp rx=0 tx=0).stop 2023-10-06T02:23:54.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.285+0000 7ff0bdb4d700 1 -- 172.21.15.6:0/3185093013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b80d05d0 msgr2=0x7ff0b80b0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.285+0000 7ff0bdb4d700 1 --2- 172.21.15.6:0/3185093013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b80d05d0 0x7ff0b80b0a30 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800cb40 tx=0x7ff0a80017b0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.285+0000 7ff0bdb4d700 1 -- 172.21.15.6:0/3185093013 shutdown_connections 2023-10-06T02:23:54.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.285+0000 7ff0bdb4d700 1 --2- 172.21.15.6:0/3185093013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0b8159400 0x7ff0b8169ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.285+0000 7ff0bdb4d700 1 --2- 172.21.15.6:0/3185093013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b80cd030 0x7ff0b8152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.285+0000 7ff0bdb4d700 1 --2- 172.21.15.6:0/3185093013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff098066f30 0x7ff0980693e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.285+0000 7ff0bdb4d700 1 --2- 172.21.15.6:0/3185093013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b80d05d0 0x7ff0b80b0a30 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.285+0000 7ff0bdb4d700 1 -- 172.21.15.6:0/3185093013 >> 172.21.15.6:0/3185093013 conn(0x7ff0b806ac10 msgr2=0x7ff0b80cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:54.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.285+0000 7ff0bdb4d700 1 -- 172.21.15.6:0/3185093013 shutdown_connections 2023-10-06T02:23:54.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:54.285+0000 7ff0bdb4d700 1 -- 172.21.15.6:0/3185093013 wait complete. 2023-10-06T02:23:54.287 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 71 2023-10-06T02:23:54.297 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-10-06T02:23:55.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-06T02:23:59.299 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:59.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.432+0000 7fba8942d700 1 Processor -- start 2023-10-06T02:23:59.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.432+0000 7fba8942d700 1 -- start start 2023-10-06T02:23:59.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.433+0000 7fba8942d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fba840b3a90 0x7fba840b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:59.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.433+0000 7fba8942d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba84067f00 con 0x7fba8415a980 2023-10-06T02:23:59.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.433+0000 7fba8942d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba84097c30 con 0x7fba840b0f70 2023-10-06T02:23:59.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.433+0000 7fba8942d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba840af940 con 0x7fba840b3a90 2023-10-06T02:23:59.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.433+0000 7fba837fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fba8415a980 0x7fba840980c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52616/0 (socket says 172.21.15.6:52616) 2023-10-06T02:23:59.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.433+0000 7fba837fe700 1 -- 172.21.15.6:0/3468818044 learned_addr learned my addr 172.21.15.6:0/3468818044 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:23:59.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.433+0000 7fba88c2c700 1 --2- 172.21.15.6:0/3468818044 >> v2:172.21.15.175:3300/0 conn(0x7fba840b3a90 0x7fba840b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:59.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba82ffd700 1 -- 172.21.15.6:0/3468818044 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749575042 0 0) 0x7fba84067f00 con 0x7fba8415a980 2023-10-06T02:23:59.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba82ffd700 1 -- 172.21.15.6:0/3468818044 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba6c003570 con 0x7fba8415a980 2023-10-06T02:23:59.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba82ffd700 1 -- 172.21.15.6:0/3468818044 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1872567096 0 0) 0x7fba6c003570 con 0x7fba8415a980 2023-10-06T02:23:59.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba82ffd700 1 -- 172.21.15.6:0/3468818044 >> v2:172.21.15.175:3300/0 conn(0x7fba840b3a90 msgr2=0x7fba840b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:59.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba82ffd700 1 --2- 172.21.15.6:0/3468818044 >> v2:172.21.15.175:3300/0 conn(0x7fba840b3a90 0x7fba840b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba82ffd700 1 -- 172.21.15.6:0/3468818044 >> v1:172.21.15.175:6789/0 conn(0x7fba840b0f70 legacy=0x7fba8415a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:59.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba82ffd700 1 -- 172.21.15.6:0/3468818044 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba840afc00 con 0x7fba8415a980 2023-10-06T02:23:59.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba82ffd700 1 -- 172.21.15.6:0/3468818044 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fba78001470 con 0x7fba8415a980 2023-10-06T02:23:59.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba82ffd700 1 -- 172.21.15.6:0/3468818044 >> v1:172.21.15.6:6789/0 conn(0x7fba8415a980 legacy=0x7fba840980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:59.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba82ffd700 1 --2- 172.21.15.6:0/3468818044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c003a90 0x7fba6c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:59.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba82ffd700 1 --2- 172.21.15.6:0/3468818044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba6c004810 0x7fba6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:59.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba82ffd700 1 --2- 172.21.15.6:0/3468818044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba6c005210 0x7fba6c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:59.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba82ffd700 1 -- 172.21.15.6:0/3468818044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba840af940 con 0x7fba6c003a90 2023-10-06T02:23:59.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba82ffd700 1 -- 172.21.15.6:0/3468818044 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c00c130 con 0x7fba6c004810 2023-10-06T02:23:59.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba82ffd700 1 -- 172.21.15.6:0/3468818044 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c00c2c0 con 0x7fba6c005210 2023-10-06T02:23:59.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba83fff700 1 --2- 172.21.15.6:0/3468818044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c003a90 0x7fba6c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:59.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba837fe700 1 --2- 172.21.15.6:0/3468818044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba6c004810 0x7fba6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:59.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba88c2c700 1 --2- 172.21.15.6:0/3468818044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba6c005210 0x7fba6c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:59.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba83fff700 1 -- 172.21.15.6:0/3468818044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba6c005210 msgr2=0x7fba6c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:59.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba83fff700 1 --2- 172.21.15.6:0/3468818044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba6c005210 0x7fba6c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba83fff700 1 -- 172.21.15.6:0/3468818044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba6c004810 msgr2=0x7fba6c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:59.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba83fff700 1 --2- 172.21.15.6:0/3468818044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba6c004810 0x7fba6c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba83fff700 1 -- 172.21.15.6:0/3468818044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6c003570 con 0x7fba6c003a90 2023-10-06T02:23:59.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.434+0000 7fba88c2c700 1 -- 172.21.15.6:0/3468818044 reap_dead start 2023-10-06T02:23:59.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.435+0000 7fba83fff700 1 --2- 172.21.15.6:0/3468818044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c003a90 0x7fba6c003ea0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fba74001900 tx=0x7fba74007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb78599546e034f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:59.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.435+0000 7fba82ffd700 1 -- 172.21.15.6:0/3468818044 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74001290 con 0x7fba6c003a90 2023-10-06T02:23:59.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.435+0000 7fba82ffd700 1 -- 172.21.15.6:0/3468818044 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba74012420 con 0x7fba6c003a90 2023-10-06T02:23:59.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.435+0000 7fba82ffd700 1 -- 172.21.15.6:0/3468818044 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba740127c0 con 0x7fba6c003a90 2023-10-06T02:23:59.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.435+0000 7fba8942d700 1 -- 172.21.15.6:0/3468818044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c003a90 msgr2=0x7fba6c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:59.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.435+0000 7fba8942d700 1 --2- 172.21.15.6:0/3468818044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c003a90 0x7fba6c003ea0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fba74001900 tx=0x7fba74007d80 comp rx=0 tx=0).stop 2023-10-06T02:23:59.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.435+0000 7fba8942d700 1 -- 172.21.15.6:0/3468818044 shutdown_connections 2023-10-06T02:23:59.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.435+0000 7fba8942d700 1 --2- 172.21.15.6:0/3468818044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c003a90 0x7fba6c003ea0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.435+0000 7fba8942d700 1 -- 172.21.15.6:0/3468818044 >> 172.21.15.6:0/3468818044 conn(0x7fba84067910 msgr2=0x7fba840cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:59.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.435+0000 7fba8942d700 1 -- 172.21.15.6:0/3468818044 shutdown_connections 2023-10-06T02:23:59.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.435+0000 7fba8942d700 1 -- 172.21.15.6:0/3468818044 wait complete. 2023-10-06T02:23:59.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.437+0000 7fba8942d700 1 Processor -- start 2023-10-06T02:23:59.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.437+0000 7fba8942d700 1 -- start start 2023-10-06T02:23:59.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.437+0000 7fba8942d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c003a90 0x7fba8414a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:59.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.437+0000 7fba8942d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8406c420 0x7fba8406c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:59.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba8942d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba840aa830 0x7fba840aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:59.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba8942d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8414a970 con 0x7fba6c003a90 2023-10-06T02:23:59.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba8942d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8406cdd0 con 0x7fba8406c420 2023-10-06T02:23:59.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba8942d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba840ab560 con 0x7fba840aa830 2023-10-06T02:23:59.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c003a90 0x7fba8414a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:59.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c003a90 0x7fba8414a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60030/0 (socket says 172.21.15.6:60030) 2023-10-06T02:23:59.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba83fff700 1 -- 172.21.15.6:0/550390418 learned_addr learned my addr 172.21.15.6:0/550390418 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:23:59.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba88c2c700 1 --2- 172.21.15.6:0/550390418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba840aa830 0x7fba840aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:59.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba837fe700 1 --2- 172.21.15.6:0/550390418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8406c420 0x7fba8406c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:59.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba83fff700 1 -- 172.21.15.6:0/550390418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba840aa830 msgr2=0x7fba840aacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:59.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba83fff700 1 --2- 172.21.15.6:0/550390418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba840aa830 0x7fba840aacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba83fff700 1 -- 172.21.15.6:0/550390418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8406c420 msgr2=0x7fba8406c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:59.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba83fff700 1 --2- 172.21.15.6:0/550390418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8406c420 0x7fba8406c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba83fff700 1 -- 172.21.15.6:0/550390418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba840ab840 con 0x7fba6c003a90 2023-10-06T02:23:59.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba837fe700 1 --2- 172.21.15.6:0/550390418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8406c420 0x7fba8406c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:59.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba88c2c700 1 --2- 172.21.15.6:0/550390418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba840aa830 0x7fba840aacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:59.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba83fff700 1 --2- 172.21.15.6:0/550390418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c003a90 0x7fba8414a430 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fba74012ea0 tx=0x7fba74015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:59.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba6bfff700 1 -- 172.21.15.6:0/550390418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74006870 con 0x7fba6c003a90 2023-10-06T02:23:59.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba6bfff700 1 -- 172.21.15.6:0/550390418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba740069f0 con 0x7fba6c003a90 2023-10-06T02:23:59.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba8942d700 1 -- 172.21.15.6:0/550390418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba840abb20 con 0x7fba6c003a90 2023-10-06T02:23:59.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba6bfff700 1 -- 172.21.15.6:0/550390418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74006db0 con 0x7fba6c003a90 2023-10-06T02:23:59.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.438+0000 7fba8942d700 1 -- 172.21.15.6:0/550390418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba840abe00 con 0x7fba6c003a90 2023-10-06T02:23:59.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.439+0000 7fba8942d700 1 -- 172.21.15.6:0/550390418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba840afee0 con 0x7fba6c003a90 2023-10-06T02:23:59.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.440+0000 7fba6bfff700 1 -- 172.21.15.6:0/550390418 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba74007240 con 0x7fba6c003a90 2023-10-06T02:23:59.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.440+0000 7fba6bfff700 1 --2- 172.21.15.6:0/550390418 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba70066fb0 0x7fba70069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:59.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.440+0000 7fba6bfff700 1 -- 172.21.15.6:0/550390418 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fba740860d0 con 0x7fba6c003a90 2023-10-06T02:23:59.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.440+0000 7fba837fe700 1 --2- 172.21.15.6:0/550390418 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba70066fb0 0x7fba70069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:59.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.441+0000 7fba837fe700 1 --2- 172.21.15.6:0/550390418 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba70066fb0 0x7fba70069460 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fba78000e10 tx=0x7fba78009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:59.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.445+0000 7fba6bfff700 1 -- 172.21.15.6:0/550390418 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba74053000 con 0x7fba6c003a90 2023-10-06T02:23:59.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.686+0000 7fba8942d700 1 -- 172.21.15.6:0/550390418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba84067ce0 con 0x7fba6c003a90 2023-10-06T02:23:59.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.686+0000 7fba6bfff700 1 -- 172.21.15.6:0/550390418 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fba7402d090 con 0x7fba6c003a90 2023-10-06T02:23:59.687 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:23:59.687 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":71,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2575759355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2575759355},{"type":"v1","addr":"172.21.15.175:6836","nonce":2575759355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2523304335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2523304335},{"type":"v1","addr":"172.21.15.175:6837","nonce":2523304335}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":6786,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/353268974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":353268974},{"type":"v1","addr":"172.21.15.6:6834","nonce":353268974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:38.399768+0000","modified":"2023-10-06T02:23:48.056925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6789":{"gid":6789,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1625434310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1625434310},{"type":"v1","addr":"172.21.15.6:6835","nonce":1625434310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:23:59.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.689+0000 7fba8942d700 1 -- 172.21.15.6:0/550390418 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba70066fb0 msgr2=0x7fba70069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:59.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.689+0000 7fba8942d700 1 --2- 172.21.15.6:0/550390418 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba70066fb0 0x7fba70069460 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fba78000e10 tx=0x7fba78009040 comp rx=0 tx=0).stop 2023-10-06T02:23:59.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.689+0000 7fba8942d700 1 -- 172.21.15.6:0/550390418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c003a90 msgr2=0x7fba8414a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:59.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.689+0000 7fba8942d700 1 --2- 172.21.15.6:0/550390418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c003a90 0x7fba8414a430 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fba74012ea0 tx=0x7fba74015000 comp rx=0 tx=0).stop 2023-10-06T02:23:59.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.689+0000 7fba8942d700 1 -- 172.21.15.6:0/550390418 shutdown_connections 2023-10-06T02:23:59.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.689+0000 7fba8942d700 1 --2- 172.21.15.6:0/550390418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba840aa830 0x7fba840aacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.689+0000 7fba8942d700 1 --2- 172.21.15.6:0/550390418 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba70066fb0 0x7fba70069460 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.689+0000 7fba8942d700 1 --2- 172.21.15.6:0/550390418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c003a90 0x7fba8414a430 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.689+0000 7fba8942d700 1 --2- 172.21.15.6:0/550390418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8406c420 0x7fba8406c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.689+0000 7fba8942d700 1 -- 172.21.15.6:0/550390418 >> 172.21.15.6:0/550390418 conn(0x7fba84067910 msgr2=0x7fba841584f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:59.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.689+0000 7fba8942d700 1 -- 172.21.15.6:0/550390418 shutdown_connections 2023-10-06T02:23:59.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:23:59.689+0000 7fba8942d700 1 -- 172.21.15.6:0/550390418 wait complete. 2023-10-06T02:23:59.691 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 71 2023-10-06T02:23:59.701 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-10-06T02:24:02.078 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-10-06T02:24:04.702 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.857+0000 7f9a030af700 1 Processor -- start 2023-10-06T02:24:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.857+0000 7f9a030af700 1 -- start start 2023-10-06T02:24:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.858+0000 7f9a030af700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc140e70 0x7f99fc1585c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.858+0000 7f9a030af700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99fc158b00 con 0x7f99fc06e060 2023-10-06T02:24:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.858+0000 7f9a030af700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99fc0ccf80 con 0x7f99fc06e430 2023-10-06T02:24:04.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.858+0000 7f9a030af700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0cbdb0 con 0x7f99fc140e70 2023-10-06T02:24:04.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.858+0000 7f9a00e4b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f99fc06e060 0x7f99fc0cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52624/0 (socket says 172.21.15.6:52624) 2023-10-06T02:24:04.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.858+0000 7f9a00e4b700 1 -- 172.21.15.6:0/2646735443 learned_addr learned my addr 172.21.15.6:0/2646735443 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:04.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f99fb7fe700 1 -- 172.21.15.6:0/2646735443 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1350376563 0 0) 0x7f99fc158b00 con 0x7f99fc06e060 2023-10-06T02:24:04.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f9a0164c700 1 --2- 172.21.15.6:0/2646735443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc140e70 0x7f99fc1585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:04.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f99fb7fe700 1 -- 172.21.15.6:0/2646735443 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99e8003570 con 0x7f99fc06e060 2023-10-06T02:24:04.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f99fb7fe700 1 -- 172.21.15.6:0/2646735443 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3071226225 0 0) 0x7f99e8003570 con 0x7f99fc06e060 2023-10-06T02:24:04.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f99fb7fe700 1 -- 172.21.15.6:0/2646735443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc140e70 msgr2=0x7f99fc1585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:04.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f99fb7fe700 1 --2- 172.21.15.6:0/2646735443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc140e70 0x7f99fc1585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f99fb7fe700 1 -- 172.21.15.6:0/2646735443 >> v1:172.21.15.175:6789/0 conn(0x7f99fc06e430 legacy=0x7f99fc140760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:04.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f99fb7fe700 1 -- 172.21.15.6:0/2646735443 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc0cd250 con 0x7f99fc06e060 2023-10-06T02:24:04.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f99fb7fe700 1 -- 172.21.15.6:0/2646735443 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f99f4001470 con 0x7f99fc06e060 2023-10-06T02:24:04.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f99fb7fe700 1 -- 172.21.15.6:0/2646735443 >> v1:172.21.15.6:6789/0 conn(0x7f99fc06e060 legacy=0x7f99fc0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:04.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f99fb7fe700 1 --2- 172.21.15.6:0/2646735443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e8003a90 0x7f99e8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:04.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f99fb7fe700 1 --2- 172.21.15.6:0/2646735443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99e8004810 0x7f99e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:04.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f99fb7fe700 1 --2- 172.21.15.6:0/2646735443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc140e70 0x7f99e80051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:04.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f99fb7fe700 1 -- 172.21.15.6:0/2646735443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e800bb30 con 0x7f99e8003a90 2023-10-06T02:24:04.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f99fb7fe700 1 -- 172.21.15.6:0/2646735443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e800bca0 con 0x7f99e8004810 2023-10-06T02:24:04.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f99fb7fe700 1 -- 172.21.15.6:0/2646735443 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e800be60 con 0x7f99fc140e70 2023-10-06T02:24:04.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f9a00e4b700 1 --2- 172.21.15.6:0/2646735443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e8003a90 0x7f99e8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:04.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f9a0164c700 1 --2- 172.21.15.6:0/2646735443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc140e70 0x7f99e80051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:04.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f99fbfff700 1 --2- 172.21.15.6:0/2646735443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99e8004810 0x7f99e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:04.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f9a00e4b700 1 -- 172.21.15.6:0/2646735443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc140e70 msgr2=0x7f99e80051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:04.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.859+0000 7f9a00e4b700 1 --2- 172.21.15.6:0/2646735443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc140e70 0x7f99e80051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.860+0000 7f9a00e4b700 1 -- 172.21.15.6:0/2646735443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99e8004810 msgr2=0x7f99e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:04.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.860+0000 7f9a00e4b700 1 --2- 172.21.15.6:0/2646735443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99e8004810 0x7f99e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.860+0000 7f9a00e4b700 1 -- 172.21.15.6:0/2646735443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e8003570 con 0x7f99e8003a90 2023-10-06T02:24:04.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.860+0000 7f9a00e4b700 1 --2- 172.21.15.6:0/2646735443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e8003a90 0x7f99e8003ea0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f99f400c3c0 tx=0x7f99f4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562da1f443124d2c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:04.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.860+0000 7f99fb7fe700 1 -- 172.21.15.6:0/2646735443 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f400cc90 con 0x7f99e8003a90 2023-10-06T02:24:04.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.860+0000 7f99fb7fe700 1 -- 172.21.15.6:0/2646735443 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f400cdf0 con 0x7f99e8003a90 2023-10-06T02:24:04.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.860+0000 7f99fb7fe700 1 -- 172.21.15.6:0/2646735443 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4005b50 con 0x7f99e8003a90 2023-10-06T02:24:04.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.860+0000 7f9a030af700 1 -- 172.21.15.6:0/2646735443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e8003a90 msgr2=0x7f99e8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:04.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.860+0000 7f9a030af700 1 --2- 172.21.15.6:0/2646735443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e8003a90 0x7f99e8003ea0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f99f400c3c0 tx=0x7f99f4001e50 comp rx=0 tx=0).stop 2023-10-06T02:24:04.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.860+0000 7f9a0164c700 1 -- 172.21.15.6:0/2646735443 reap_dead start 2023-10-06T02:24:04.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.860+0000 7f9a030af700 1 -- 172.21.15.6:0/2646735443 shutdown_connections 2023-10-06T02:24:04.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.860+0000 7f9a030af700 1 -- 172.21.15.6:0/2646735443 >> 172.21.15.6:0/2646735443 conn(0x7f99fc06cff0 msgr2=0x7f99fc0afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:04.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.860+0000 7f9a030af700 1 -- 172.21.15.6:0/2646735443 shutdown_connections 2023-10-06T02:24:04.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.860+0000 7f9a030af700 1 -- 172.21.15.6:0/2646735443 wait complete. 2023-10-06T02:24:04.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.862+0000 7f9a030af700 1 Processor -- start 2023-10-06T02:24:04.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.862+0000 7f9a030af700 1 -- start start 2023-10-06T02:24:04.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.862+0000 7f9a030af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e8003a90 0x7f99fc138f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:04.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f9a030af700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99fc06a140 0x7f99fc137da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:04.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f9a030af700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc169a80 0x7f99fc1382e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:04.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f9a030af700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc06b190 con 0x7f99e8003a90 2023-10-06T02:24:04.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f9a030af700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc06a610 con 0x7f99fc06a140 2023-10-06T02:24:04.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f9a030af700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc06a8f0 con 0x7f99fc169a80 2023-10-06T02:24:04.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f9a00e4b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e8003a90 0x7f99fc138f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:04.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f9a00e4b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e8003a90 0x7f99fc138f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60054/0 (socket says 172.21.15.6:60054) 2023-10-06T02:24:04.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f9a00e4b700 1 -- 172.21.15.6:0/1437187449 learned_addr learned my addr 172.21.15.6:0/1437187449 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:04.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f99fbfff700 1 --2- 172.21.15.6:0/1437187449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99fc06a140 0x7f99fc137da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:04.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f9a0164c700 1 --2- 172.21.15.6:0/1437187449 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc169a80 0x7f99fc1382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:04.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f9a00e4b700 1 -- 172.21.15.6:0/1437187449 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc169a80 msgr2=0x7f99fc1382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f9a00e4b700 1 --2- 172.21.15.6:0/1437187449 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc169a80 0x7f99fc1382e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f9a00e4b700 1 -- 172.21.15.6:0/1437187449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99fc06a140 msgr2=0x7f99fc137da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f9a00e4b700 1 --2- 172.21.15.6:0/1437187449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99fc06a140 0x7f99fc137da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f9a00e4b700 1 -- 172.21.15.6:0/1437187449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc06abd0 con 0x7f99e8003a90 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f9a00e4b700 1 --2- 172.21.15.6:0/1437187449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e8003a90 0x7f99fc138f20 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f99e800bc70 tx=0x7f99f4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f99f8ff9700 1 -- 172.21.15.6:0/1437187449 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f400cc90 con 0x7f99e8003a90 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f99f8ff9700 1 -- 172.21.15.6:0/1437187449 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f40072e0 con 0x7f99e8003a90 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f99f8ff9700 1 -- 172.21.15.6:0/1437187449 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4007680 con 0x7f99e8003a90 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f9a030af700 1 -- 172.21.15.6:0/1437187449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99fc06aeb0 con 0x7f99e8003a90 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.863+0000 7f9a030af700 1 -- 172.21.15.6:0/1437187449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99fc138820 con 0x7f99e8003a90 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.864+0000 7f9a030af700 1 -- 172.21.15.6:0/1437187449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99fc06d3f0 con 0x7f99e8003a90 2023-10-06T02:24:04.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.865+0000 7f99f8ff9700 1 -- 172.21.15.6:0/1437187449 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99f4019030 con 0x7f99e8003a90 2023-10-06T02:24:04.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.865+0000 7f99f8ff9700 1 --2- 172.21.15.6:0/1437187449 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f99dc066f30 0x7f99dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:04.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.865+0000 7f99f8ff9700 1 -- 172.21.15.6:0/1437187449 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f99f4085a30 con 0x7f99e8003a90 2023-10-06T02:24:04.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.865+0000 7f99fbfff700 1 --2- 172.21.15.6:0/1437187449 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f99dc066f30 0x7f99dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:04.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.866+0000 7f99fbfff700 1 --2- 172.21.15.6:0/1437187449 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f99dc066f30 0x7f99dc0693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f99fc06d6d0 tx=0x7f99ec001a70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:04.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:04.870+0000 7f99f8ff9700 1 -- 172.21.15.6:0/1437187449 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99f4052a00 con 0x7f99e8003a90 2023-10-06T02:24:05.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:05.109+0000 7f9a030af700 1 -- 172.21.15.6:0/1437187449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99fc0cd530 con 0x7f99e8003a90 2023-10-06T02:24:05.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:05.109+0000 7f99f8ff9700 1 -- 172.21.15.6:0/1437187449 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f99f4017090 con 0x7f99e8003a90 2023-10-06T02:24:05.110 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:05.110 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":71,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2575759355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2575759355},{"type":"v1","addr":"172.21.15.175:6836","nonce":2575759355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2523304335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2523304335},{"type":"v1","addr":"172.21.15.175:6837","nonce":2523304335}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":6786,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/353268974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":353268974},{"type":"v1","addr":"172.21.15.6:6834","nonce":353268974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:38.399768+0000","modified":"2023-10-06T02:23:48.056925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6789":{"gid":6789,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1625434310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1625434310},{"type":"v1","addr":"172.21.15.6:6835","nonce":1625434310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:24:05.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:05.112+0000 7f9a030af700 1 -- 172.21.15.6:0/1437187449 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f99dc066f30 msgr2=0x7f99dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:05.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:05.112+0000 7f9a030af700 1 --2- 172.21.15.6:0/1437187449 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f99dc066f30 0x7f99dc0693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f99fc06d6d0 tx=0x7f99ec001a70 comp rx=0 tx=0).stop 2023-10-06T02:24:05.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:05.112+0000 7f9a030af700 1 -- 172.21.15.6:0/1437187449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e8003a90 msgr2=0x7f99fc138f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:05.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:05.112+0000 7f9a030af700 1 --2- 172.21.15.6:0/1437187449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e8003a90 0x7f99fc138f20 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f99e800bc70 tx=0x7f99f4015000 comp rx=0 tx=0).stop 2023-10-06T02:24:05.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:05.112+0000 7f9a030af700 1 -- 172.21.15.6:0/1437187449 shutdown_connections 2023-10-06T02:24:05.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:05.112+0000 7f9a030af700 1 --2- 172.21.15.6:0/1437187449 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc169a80 0x7f99fc1382e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:05.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:05.112+0000 7f9a030af700 1 --2- 172.21.15.6:0/1437187449 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f99dc066f30 0x7f99dc0693e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:05.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:05.112+0000 7f9a030af700 1 --2- 172.21.15.6:0/1437187449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e8003a90 0x7f99fc138f20 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:05.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:05.112+0000 7f9a030af700 1 --2- 172.21.15.6:0/1437187449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99fc06a140 0x7f99fc137da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:05.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:05.112+0000 7f9a030af700 1 -- 172.21.15.6:0/1437187449 >> 172.21.15.6:0/1437187449 conn(0x7f99fc06cff0 msgr2=0x7f99fc15a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:05.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:05.112+0000 7f9a030af700 1 -- 172.21.15.6:0/1437187449 shutdown_connections 2023-10-06T02:24:05.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:05.112+0000 7f9a030af700 1 -- 172.21.15.6:0/1437187449 wait complete. 2023-10-06T02:24:05.114 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 71 2023-10-06T02:24:05.124 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-10-06T02:24:08.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-10-06T02:24:10.125 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:10.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.258+0000 7fc133b5a700 1 Processor -- start 2023-10-06T02:24:10.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.258+0000 7fc133b5a700 1 -- start start 2023-10-06T02:24:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.259+0000 7fc133b5a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc12c0af8b0 0x7fc12c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.259+0000 7fc133b5a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0b27f0 0x7fc12c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.259+0000 7fc133b5a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc12c15e190 con 0x7fc12c0af4e0 2023-10-06T02:24:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.259+0000 7fc133b5a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12c0b1910 con 0x7fc12c0af8b0 2023-10-06T02:24:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.259+0000 7fc133b5a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c0cb650 con 0x7fc12c0b27f0 2023-10-06T02:24:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.259+0000 7fc1320f7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0b27f0 0x7fc12c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.259+0000 7fc1310f5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc12c0af8b0 0x7fc12c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.259+0000 7fc1318f6700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc12c0af4e0 0x7fc12c0b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:44520/0 (socket says 172.21.15.6:44520) 2023-10-06T02:24:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.259+0000 7fc1318f6700 1 -- 172.21.15.6:0/1424026993 learned_addr learned my addr 172.21.15.6:0/1424026993 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.259+0000 7fc1320f7700 1 -- 172.21.15.6:0/1424026993 >> v2:172.21.15.175:3300/0 conn(0x7fc12c0af8b0 msgr2=0x7fc12c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.259+0000 7fc1320f7700 1 --2- 172.21.15.6:0/1424026993 >> v2:172.21.15.175:3300/0 conn(0x7fc12c0af8b0 0x7fc12c15d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.259+0000 7fc1320f7700 1 -- 172.21.15.6:0/1424026993 >> v1:172.21.15.175:6789/0 conn(0x7fc12c0af4e0 legacy=0x7fc12c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.260+0000 7fc1320f7700 1 -- 172.21.15.6:0/1424026993 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c0ccaf0 con 0x7fc12c0b27f0 2023-10-06T02:24:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.260+0000 7fc1310f5700 1 --2- 172.21.15.6:0/1424026993 >> v2:172.21.15.175:3300/0 conn(0x7fc12c0af8b0 0x7fc12c15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.260+0000 7fc1320f7700 1 --2- 172.21.15.6:0/1424026993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0b27f0 0x7fc12c15d9a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009e60 tx=0x7fc11c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22f77bc0bfddee4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.260+0000 7fc1308f4700 1 -- 172.21.15.6:0/1424026993 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c00e070 con 0x7fc12c0b27f0 2023-10-06T02:24:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.260+0000 7fc1308f4700 1 -- 172.21.15.6:0/1424026993 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c00bb60 con 0x7fc12c0b27f0 2023-10-06T02:24:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.260+0000 7fc1308f4700 1 -- 172.21.15.6:0/1424026993 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c012430 con 0x7fc12c0b27f0 2023-10-06T02:24:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.260+0000 7fc133b5a700 1 -- 172.21.15.6:0/1424026993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0b27f0 msgr2=0x7fc12c15d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.260+0000 7fc133b5a700 1 --2- 172.21.15.6:0/1424026993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0b27f0 0x7fc12c15d9a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009e60 tx=0x7fc11c009780 comp rx=0 tx=0).stop 2023-10-06T02:24:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.261+0000 7fc133b5a700 1 -- 172.21.15.6:0/1424026993 shutdown_connections 2023-10-06T02:24:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.261+0000 7fc133b5a700 1 --2- 172.21.15.6:0/1424026993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0b27f0 0x7fc12c15d9a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.261+0000 7fc133b5a700 1 --2- 172.21.15.6:0/1424026993 >> v2:172.21.15.175:3300/0 conn(0x7fc12c0af8b0 0x7fc12c15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.261+0000 7fc133b5a700 1 -- 172.21.15.6:0/1424026993 >> 172.21.15.6:0/1424026993 conn(0x7fc12c068680 msgr2=0x7fc12c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.261+0000 7fc133b5a700 1 -- 172.21.15.6:0/1424026993 shutdown_connections 2023-10-06T02:24:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.261+0000 7fc133b5a700 1 -- 172.21.15.6:0/1424026993 wait complete. 2023-10-06T02:24:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.262+0000 7fc133b5a700 1 Processor -- start 2023-10-06T02:24:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.262+0000 7fc133b5a700 1 -- start start 2023-10-06T02:24:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc133b5a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0af4e0 0x7fc12c0a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc133b5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc12c0af8b0 0x7fc12c16d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc133b5a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c0b27f0 0x7fc12c16db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc133b5a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c16bb80 con 0x7fc12c0af8b0 2023-10-06T02:24:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc133b5a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c0c8c00 con 0x7fc12c0b27f0 2023-10-06T02:24:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc133b5a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c16b250 con 0x7fc12c0af4e0 2023-10-06T02:24:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc1310f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc12c0af8b0 0x7fc12c16d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc1310f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc12c0af8b0 0x7fc12c16d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38834/0 (socket says 172.21.15.6:38834) 2023-10-06T02:24:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc1310f5700 1 -- 172.21.15.6:0/80144399 learned_addr learned my addr 172.21.15.6:0/80144399 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc1318f6700 1 --2- 172.21.15.6:0/80144399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0af4e0 0x7fc12c0a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc1320f7700 1 --2- 172.21.15.6:0/80144399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c0b27f0 0x7fc12c16db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc1310f5700 1 -- 172.21.15.6:0/80144399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0af4e0 msgr2=0x7fc12c0a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc1310f5700 1 --2- 172.21.15.6:0/80144399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0af4e0 0x7fc12c0a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc1310f5700 1 -- 172.21.15.6:0/80144399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c0b27f0 msgr2=0x7fc12c16db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc1310f5700 1 --2- 172.21.15.6:0/80144399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c0b27f0 0x7fc12c16db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc1310f5700 1 -- 172.21.15.6:0/80144399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc120009420 con 0x7fc12c0af8b0 2023-10-06T02:24:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc1310f5700 1 --2- 172.21.15.6:0/80144399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc12c0af8b0 0x7fc12c16d5e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fc12000ec50 tx=0x7fc1200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc129ffb700 1 -- 172.21.15.6:0/80144399 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12000c9d0 con 0x7fc12c0af8b0 2023-10-06T02:24:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc129ffb700 1 -- 172.21.15.6:0/80144399 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12000cb30 con 0x7fc12c0af8b0 2023-10-06T02:24:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc133b5a700 1 -- 172.21.15.6:0/80144399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11c009a20 con 0x7fc12c0af8b0 2023-10-06T02:24:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.263+0000 7fc129ffb700 1 -- 172.21.15.6:0/80144399 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc120013470 con 0x7fc12c0af8b0 2023-10-06T02:24:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.264+0000 7fc133b5a700 1 -- 172.21.15.6:0/80144399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12c16b810 con 0x7fc12c0af8b0 2023-10-06T02:24:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.265+0000 7fc133b5a700 1 -- 172.21.15.6:0/80144399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12c16bcf0 con 0x7fc12c0af8b0 2023-10-06T02:24:10.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.265+0000 7fc129ffb700 1 -- 172.21.15.6:0/80144399 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1200137e0 con 0x7fc12c0af8b0 2023-10-06T02:24:10.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.266+0000 7fc129ffb700 1 --2- 172.21.15.6:0/80144399 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc118066f30 0x7fc1180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.266+0000 7fc129ffb700 1 -- 172.21.15.6:0/80144399 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc120084bc0 con 0x7fc12c0af8b0 2023-10-06T02:24:10.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.266+0000 7fc1318f6700 1 --2- 172.21.15.6:0/80144399 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc118066f30 0x7fc1180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.266+0000 7fc1318f6700 1 --2- 172.21.15.6:0/80144399 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc118066f30 0x7fc1180693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc124001780 tx=0x7fc124009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:10.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.270+0000 7fc129ffb700 1 -- 172.21.15.6:0/80144399 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc120051af0 con 0x7fc12c0af8b0 2023-10-06T02:24:10.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.508+0000 7fc133b5a700 1 -- 172.21.15.6:0/80144399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc12c0b0910 con 0x7fc12c0af8b0 2023-10-06T02:24:10.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.509+0000 7fc129ffb700 1 -- 172.21.15.6:0/80144399 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4644 (secure 0 0 0) 0x7fc120055110 con 0x7fc12c0af8b0 2023-10-06T02:24:10.509 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:10.509 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":72,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2575759355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2575759355},{"type":"v1","addr":"172.21.15.175:6836","nonce":2575759355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2523304335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2523304335},{"type":"v1","addr":"172.21.15.175:6837","nonce":2523304335}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":6786,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/353268974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":353268974},{"type":"v1","addr":"172.21.15.6:6834","nonce":353268974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:38.399768+0000","modified":"2023-10-06T02:24:09.797805+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6789":{"gid":6789,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1625434310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1625434310},{"type":"v1","addr":"172.21.15.6:6835","nonce":1625434310}]},"join_fscid":-1,"laggy_since":"2023-10-06T02:24:09.797770+0000","export_targets":[],"features":4540138320759226367,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:24:10.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.511+0000 7fc133b5a700 1 -- 172.21.15.6:0/80144399 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc118066f30 msgr2=0x7fc1180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.511+0000 7fc133b5a700 1 --2- 172.21.15.6:0/80144399 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc118066f30 0x7fc1180693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc124001780 tx=0x7fc124009040 comp rx=0 tx=0).stop 2023-10-06T02:24:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.511+0000 7fc133b5a700 1 -- 172.21.15.6:0/80144399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc12c0af8b0 msgr2=0x7fc12c16d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.511+0000 7fc133b5a700 1 --2- 172.21.15.6:0/80144399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc12c0af8b0 0x7fc12c16d5e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fc12000ec50 tx=0x7fc1200091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.511+0000 7fc133b5a700 1 -- 172.21.15.6:0/80144399 shutdown_connections 2023-10-06T02:24:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.511+0000 7fc133b5a700 1 --2- 172.21.15.6:0/80144399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c0b27f0 0x7fc12c16db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.511+0000 7fc133b5a700 1 --2- 172.21.15.6:0/80144399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0af4e0 0x7fc12c0a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.511+0000 7fc133b5a700 1 --2- 172.21.15.6:0/80144399 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc118066f30 0x7fc1180693e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.511+0000 7fc133b5a700 1 --2- 172.21.15.6:0/80144399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc12c0af8b0 0x7fc12c16d5e0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.511+0000 7fc133b5a700 1 -- 172.21.15.6:0/80144399 >> 172.21.15.6:0/80144399 conn(0x7fc12c068680 msgr2=0x7fc12c0b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.511+0000 7fc133b5a700 1 -- 172.21.15.6:0/80144399 shutdown_connections 2023-10-06T02:24:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.511+0000 7fc133b5a700 1 -- 172.21.15.6:0/80144399 wait complete. 2023-10-06T02:24:10.513 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 72 2023-10-06T02:24:10.523 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-10-06T02:24:10.524 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_rename_corrupt_dentry_first 2023-10-06T02:24:10.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.644+0000 7f0520816700 1 Processor -- start 2023-10-06T02:24:10.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.644+0000 7f0520816700 1 -- start start 2023-10-06T02:24:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.645+0000 7f0520816700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f051c0b2600 0x7f051c1623b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.645+0000 7f0520816700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f051c158270 con 0x7f051c0a8b90 2023-10-06T02:24:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.645+0000 7f0520816700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f051c0a8f60 con 0x7f051c159710 2023-10-06T02:24:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.645+0000 7f0520816700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051c0b0490 con 0x7f051c0b2600 2023-10-06T02:24:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.645+0000 7f051a59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f051c0a8b90 0x7f051c0afa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32912/0 (socket says 172.21.15.6:32912) 2023-10-06T02:24:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.645+0000 7f051a59c700 1 -- 172.21.15.6:0/2702594607 learned_addr learned my addr 172.21.15.6:0/2702594607 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.645+0000 7f051ad9d700 1 --2- 172.21.15.6:0/2702594607 >> v2:172.21.15.175:3300/0 conn(0x7f051c0b2600 0x7f051c1623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.645+0000 7f051959a700 1 -- 172.21.15.6:0/2702594607 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430342061 0 0) 0x7f051c158270 con 0x7f051c0a8b90 2023-10-06T02:24:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.645+0000 7f051959a700 1 -- 172.21.15.6:0/2702594607 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0504003570 con 0x7f051c0a8b90 2023-10-06T02:24:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.645+0000 7f051959a700 1 -- 172.21.15.6:0/2702594607 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330693780 0 0) 0x7f051c0a8f60 con 0x7f051c159710 2023-10-06T02:24:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.645+0000 7f051959a700 1 -- 172.21.15.6:0/2702594607 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f051c158270 con 0x7f051c159710 2023-10-06T02:24:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.645+0000 7f051ad9d700 1 -- 172.21.15.6:0/2702594607 >> v1:172.21.15.175:6789/0 conn(0x7f051c159710 legacy=0x7f051c0b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.645+0000 7f051ad9d700 1 -- 172.21.15.6:0/2702594607 >> v1:172.21.15.6:6789/0 conn(0x7f051c0a8b90 legacy=0x7f051c0afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.645+0000 7f051ad9d700 1 -- 172.21.15.6:0/2702594607 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c0b0770 con 0x7f051c0b2600 2023-10-06T02:24:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.645+0000 7f051ad9d700 1 --2- 172.21.15.6:0/2702594607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f051c0b2600 0x7f051c1623b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0514009e60 tx=0x7f0514009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87e7bb44ddd2863f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.646+0000 7f051959a700 1 -- 172.21.15.6:0/2702594607 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051400e070 con 0x7f051c0b2600 2023-10-06T02:24:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.646+0000 7f051959a700 1 -- 172.21.15.6:0/2702594607 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051400bab0 con 0x7f051c0b2600 2023-10-06T02:24:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.646+0000 7f051959a700 1 -- 172.21.15.6:0/2702594607 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051400be50 con 0x7f051c0b2600 2023-10-06T02:24:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.646+0000 7f0520816700 1 -- 172.21.15.6:0/2702594607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f051c0b2600 msgr2=0x7f051c1623b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.646+0000 7f0520816700 1 --2- 172.21.15.6:0/2702594607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f051c0b2600 0x7f051c1623b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0514009e60 tx=0x7f0514009780 comp rx=0 tx=0).stop 2023-10-06T02:24:10.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.646+0000 7f0520816700 1 -- 172.21.15.6:0/2702594607 shutdown_connections 2023-10-06T02:24:10.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.646+0000 7f0520816700 1 --2- 172.21.15.6:0/2702594607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f051c0b2600 0x7f051c1623b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.646+0000 7f0520816700 1 -- 172.21.15.6:0/2702594607 >> 172.21.15.6:0/2702594607 conn(0x7f051c067910 msgr2=0x7f051c0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:10.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.646+0000 7f0520816700 1 -- 172.21.15.6:0/2702594607 shutdown_connections 2023-10-06T02:24:10.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.646+0000 7f0520816700 1 -- 172.21.15.6:0/2702594607 wait complete. 2023-10-06T02:24:10.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.647+0000 7f0520816700 1 Processor -- start 2023-10-06T02:24:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.647+0000 7f0520816700 1 -- start start 2023-10-06T02:24:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.648+0000 7f0520816700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f051c0a8b90 0x7f051c14d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.648+0000 7f0520816700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f051c0b2600 0x7f051c0ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.648+0000 7f0520816700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f051c159710 0x7f051c0acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.648+0000 7f0520816700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051c0aba10 con 0x7f051c0b2600 2023-10-06T02:24:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.648+0000 7f0520816700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051c0aae00 con 0x7f051c159710 2023-10-06T02:24:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.648+0000 7f0520816700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051c0ab0e0 con 0x7f051c0a8b90 2023-10-06T02:24:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.648+0000 7f0519d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f051c0b2600 0x7f051c0ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.648+0000 7f0519d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f051c0b2600 0x7f051c0ac630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38844/0 (socket says 172.21.15.6:38844) 2023-10-06T02:24:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.648+0000 7f0519d9b700 1 -- 172.21.15.6:0/1341981024 learned_addr learned my addr 172.21.15.6:0/1341981024 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.648+0000 7f051ad9d700 1 --2- 172.21.15.6:0/1341981024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f051c159710 0x7f051c0acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.648+0000 7f051a59c700 1 --2- 172.21.15.6:0/1341981024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f051c0a8b90 0x7f051c14d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.649+0000 7f0519d9b700 1 -- 172.21.15.6:0/1341981024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f051c0a8b90 msgr2=0x7f051c14d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.649+0000 7f0519d9b700 1 --2- 172.21.15.6:0/1341981024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f051c0a8b90 0x7f051c14d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.649+0000 7f0519d9b700 1 -- 172.21.15.6:0/1341981024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f051c159710 msgr2=0x7f051c0acb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.649+0000 7f0519d9b700 1 --2- 172.21.15.6:0/1341981024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f051c159710 0x7f051c0acb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.649+0000 7f0519d9b700 1 -- 172.21.15.6:0/1341981024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0514009a20 con 0x7f051c0b2600 2023-10-06T02:24:10.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.649+0000 7f0519d9b700 1 --2- 172.21.15.6:0/1341981024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f051c0b2600 0x7f051c0ac630 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f051000c590 tx=0x7f0510007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:10.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.649+0000 7f050a7fc700 1 -- 172.21.15.6:0/1341981024 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510010510 con 0x7f051c0b2600 2023-10-06T02:24:10.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.649+0000 7f050a7fc700 1 -- 172.21.15.6:0/1341981024 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0510010670 con 0x7f051c0b2600 2023-10-06T02:24:10.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.649+0000 7f050a7fc700 1 -- 172.21.15.6:0/1341981024 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510010a30 con 0x7f051c0b2600 2023-10-06T02:24:10.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.649+0000 7f0520816700 1 -- 172.21.15.6:0/1341981024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f051c0ab3c0 con 0x7f051c0b2600 2023-10-06T02:24:10.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.649+0000 7f0520816700 1 -- 172.21.15.6:0/1341981024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051c14d9c0 con 0x7f051c0b2600 2023-10-06T02:24:10.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.650+0000 7f0520816700 1 -- 172.21.15.6:0/1341981024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051c087170 con 0x7f051c0b2600 2023-10-06T02:24:10.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.650+0000 7f050a7fc700 1 -- 172.21.15.6:0/1341981024 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f051001b400 con 0x7f051c0b2600 2023-10-06T02:24:10.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.651+0000 7f050a7fc700 1 --2- 172.21.15.6:0/1341981024 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f04fc066f30 0x7f04fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.651+0000 7f050a7fc700 1 -- 172.21.15.6:0/1341981024 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0510084400 con 0x7f051c0b2600 2023-10-06T02:24:10.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.651+0000 7f051a59c700 1 --2- 172.21.15.6:0/1341981024 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f04fc066f30 0x7f04fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.651+0000 7f051a59c700 1 --2- 172.21.15.6:0/1341981024 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f04fc066f30 0x7f04fc0693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f050c001360 tx=0x7f050c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:10.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.655+0000 7f050a7fc700 1 -- 172.21.15.6:0/1341981024 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05100513d0 con 0x7f051c0b2600 2023-10-06T02:24:10.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.851+0000 7f0520816700 1 -- 172.21.15.6:0/1341981024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"} v 0) v1 -- 0x7f051c06e5d0 con 0x7f051c0b2600 2023-10-06T02:24:10.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.853+0000 7f050a7fc700 1 -- 172.21.15.6:0/1341981024 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"}]=0 v24) v1 ==== 121+0+0 (secure 0 0 0) 0x7f05100549f0 con 0x7f051c0b2600 2023-10-06T02:24:10.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.856+0000 7f0520816700 1 -- 172.21.15.6:0/1341981024 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f04fc066f30 msgr2=0x7f04fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.856+0000 7f0520816700 1 --2- 172.21.15.6:0/1341981024 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f04fc066f30 0x7f04fc0693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f050c001360 tx=0x7f050c009040 comp rx=0 tx=0).stop 2023-10-06T02:24:10.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.856+0000 7f0520816700 1 -- 172.21.15.6:0/1341981024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f051c0b2600 msgr2=0x7f051c0ac630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.856+0000 7f0520816700 1 --2- 172.21.15.6:0/1341981024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f051c0b2600 0x7f051c0ac630 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f051000c590 tx=0x7f0510007dc0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.856+0000 7f0520816700 1 -- 172.21.15.6:0/1341981024 shutdown_connections 2023-10-06T02:24:10.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.856+0000 7f0520816700 1 --2- 172.21.15.6:0/1341981024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f051c159710 0x7f051c0acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.856+0000 7f0520816700 1 --2- 172.21.15.6:0/1341981024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f051c0a8b90 0x7f051c14d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.856+0000 7f0520816700 1 --2- 172.21.15.6:0/1341981024 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f04fc066f30 0x7f04fc0693e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.856+0000 7f0520816700 1 --2- 172.21.15.6:0/1341981024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f051c0b2600 0x7f051c0ac630 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.856+0000 7f0520816700 1 -- 172.21.15.6:0/1341981024 >> 172.21.15.6:0/1341981024 conn(0x7f051c067910 msgr2=0x7f051c0b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:10.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.856+0000 7f0520816700 1 -- 172.21.15.6:0/1341981024 shutdown_connections 2023-10-06T02:24:10.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.856+0000 7f0520816700 1 -- 172.21.15.6:0/1341981024 wait complete. 2023-10-06T02:24:10.868 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 5:0 false 2023-10-06T02:24:10.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.989+0000 7f925c113700 1 Processor -- start 2023-10-06T02:24:10.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.989+0000 7f925c113700 1 -- start start 2023-10-06T02:24:10.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.990+0000 7f925c113700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f925406a750 0x7f925415d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.990+0000 7f925c113700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92540cae80 con 0x7f925415d770 2023-10-06T02:24:10.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.990+0000 7f925c113700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925415dcd0 con 0x7f925406a380 2023-10-06T02:24:10.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.990+0000 7f925c113700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92540cba20 con 0x7f925406a750 2023-10-06T02:24:10.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.990+0000 7f925a6b0700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f925415d770 0x7f9254159170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32928/0 (socket says 172.21.15.6:32928) 2023-10-06T02:24:10.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.990+0000 7f925a6b0700 1 -- 172.21.15.6:0/23140159 learned_addr learned my addr 172.21.15.6:0/23140159 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:10.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.990+0000 7f92596ae700 1 --2- 172.21.15.6:0/23140159 >> v2:172.21.15.175:3300/0 conn(0x7f925406a750 0x7f925415d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.990+0000 7f9258ead700 1 -- 172.21.15.6:0/23140159 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4258606486 0 0) 0x7f92540cae80 con 0x7f925415d770 2023-10-06T02:24:10.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.990+0000 7f9258ead700 1 -- 172.21.15.6:0/23140159 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9240003570 con 0x7f925415d770 2023-10-06T02:24:10.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9258ead700 1 -- 172.21.15.6:0/23140159 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2682979967 0 0) 0x7f9240003570 con 0x7f925415d770 2023-10-06T02:24:10.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9258ead700 1 -- 172.21.15.6:0/23140159 >> v2:172.21.15.175:3300/0 conn(0x7f925406a750 msgr2=0x7f925415d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:10.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9258ead700 1 --2- 172.21.15.6:0/23140159 >> v2:172.21.15.175:3300/0 conn(0x7f925406a750 0x7f925415d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9258ead700 1 -- 172.21.15.6:0/23140159 >> v1:172.21.15.175:6789/0 conn(0x7f925406a380 legacy=0x7f92540cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9258ead700 1 -- 172.21.15.6:0/23140159 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925415dfb0 con 0x7f925415d770 2023-10-06T02:24:10.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9258ead700 1 -- 172.21.15.6:0/23140159 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f924c0017f0 con 0x7f925415d770 2023-10-06T02:24:10.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9258ead700 1 -- 172.21.15.6:0/23140159 >> v1:172.21.15.6:6789/0 conn(0x7f925415d770 legacy=0x7f9254159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9258ead700 1 --2- 172.21.15.6:0/23140159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9240003a60 0x7f9240003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9258ead700 1 --2- 172.21.15.6:0/23140159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9240004810 0x7f9240004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9258ead700 1 --2- 172.21.15.6:0/23140159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92400051c0 0x7f924000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9258ead700 1 -- 172.21.15.6:0/23140159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92540cba20 con 0x7f9240003a60 2023-10-06T02:24:10.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9258ead700 1 -- 172.21.15.6:0/23140159 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924000c160 con 0x7f9240004810 2023-10-06T02:24:10.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9258ead700 1 -- 172.21.15.6:0/23140159 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924000c320 con 0x7f92400051c0 2023-10-06T02:24:10.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9259eaf700 1 --2- 172.21.15.6:0/23140159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9240003a60 0x7f9240003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f92596ae700 1 --2- 172.21.15.6:0/23140159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9240004810 0x7f9240004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f925a6b0700 1 --2- 172.21.15.6:0/23140159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92400051c0 0x7f924000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9259eaf700 1 -- 172.21.15.6:0/23140159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92400051c0 msgr2=0x7f924000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:10.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9259eaf700 1 --2- 172.21.15.6:0/23140159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92400051c0 0x7f924000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9259eaf700 1 -- 172.21.15.6:0/23140159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9240004810 msgr2=0x7f9240004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:10.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9259eaf700 1 --2- 172.21.15.6:0/23140159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9240004810 0x7f9240004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f925a6b0700 1 -- 172.21.15.6:0/23140159 reap_dead start 2023-10-06T02:24:10.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9259eaf700 1 -- 172.21.15.6:0/23140159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9240003570 con 0x7f9240003a60 2023-10-06T02:24:10.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f92596ae700 1 --2- 172.21.15.6:0/23140159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9240004810 0x7f9240004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:10.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9259eaf700 1 --2- 172.21.15.6:0/23140159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9240003a60 0x7f9240003e70 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f92500018b0 tx=0x7f9250007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f981b1cbfd7c9b09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:10.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9258ead700 1 -- 172.21.15.6:0/23140159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250012420 con 0x7f9240003a60 2023-10-06T02:24:10.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9258ead700 1 -- 172.21.15.6:0/23140159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92500125a0 con 0x7f9240003a60 2023-10-06T02:24:10.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.991+0000 7f9258ead700 1 -- 172.21.15.6:0/23140159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250012960 con 0x7f9240003a60 2023-10-06T02:24:10.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.992+0000 7f925c113700 1 -- 172.21.15.6:0/23140159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9240003a60 msgr2=0x7f9240003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.992+0000 7f925c113700 1 --2- 172.21.15.6:0/23140159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9240003a60 0x7f9240003e70 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f92500018b0 tx=0x7f9250007d30 comp rx=0 tx=0).stop 2023-10-06T02:24:10.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.992+0000 7f925c113700 1 -- 172.21.15.6:0/23140159 shutdown_connections 2023-10-06T02:24:10.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.992+0000 7f925c113700 1 --2- 172.21.15.6:0/23140159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9240003a60 0x7f9240003e70 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.992+0000 7f925c113700 1 -- 172.21.15.6:0/23140159 >> 172.21.15.6:0/23140159 conn(0x7f92540d0350 msgr2=0x7f92540d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:10.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.992+0000 7f925c113700 1 -- 172.21.15.6:0/23140159 shutdown_connections 2023-10-06T02:24:10.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.992+0000 7f925c113700 1 -- 172.21.15.6:0/23140159 wait complete. 2023-10-06T02:24:10.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.993+0000 7f925c113700 1 Processor -- start 2023-10-06T02:24:10.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.993+0000 7f925c113700 1 -- start start 2023-10-06T02:24:10.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.994+0000 7f925c113700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9240003a60 0x7f925415b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.994+0000 7f925c113700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9254159190 0x7f92540c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.994+0000 7f925c113700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9254159600 0x7f9254155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.994+0000 7f925c113700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92540b0840 con 0x7f9254159190 2023-10-06T02:24:11.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.994+0000 7f925c113700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92540c9500 con 0x7f9254159600 2023-10-06T02:24:11.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.994+0000 7f925c113700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92540aff10 con 0x7f9240003a60 2023-10-06T02:24:11.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.994+0000 7f92596ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9254159190 0x7f92540c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.994+0000 7f92596ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9254159190 0x7f92540c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38856/0 (socket says 172.21.15.6:38856) 2023-10-06T02:24:11.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.994+0000 7f92596ae700 1 -- 172.21.15.6:0/3261625419 learned_addr learned my addr 172.21.15.6:0/3261625419 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:11.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.994+0000 7f9259eaf700 1 --2- 172.21.15.6:0/3261625419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9240003a60 0x7f925415b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.994+0000 7f925a6b0700 1 --2- 172.21.15.6:0/3261625419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9254159600 0x7f9254155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.994+0000 7f92596ae700 1 -- 172.21.15.6:0/3261625419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9240003a60 msgr2=0x7f925415b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.994+0000 7f92596ae700 1 --2- 172.21.15.6:0/3261625419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9240003a60 0x7f925415b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.994+0000 7f92596ae700 1 -- 172.21.15.6:0/3261625419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9254159600 msgr2=0x7f9254155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.994+0000 7f92596ae700 1 --2- 172.21.15.6:0/3261625419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9254159600 0x7f9254155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.994+0000 7f92596ae700 1 -- 172.21.15.6:0/3261625419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92540b01f0 con 0x7f9254159190 2023-10-06T02:24:11.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.994+0000 7f925a6b0700 1 --2- 172.21.15.6:0/3261625419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9254159600 0x7f9254155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:11.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.995+0000 7f92596ae700 1 --2- 172.21.15.6:0/3261625419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9254159190 0x7f92540c8a80 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f9244011d20 tx=0x7f92440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:11.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.995+0000 7f9249ffb700 1 -- 172.21.15.6:0/3261625419 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9244011ed0 con 0x7f9254159190 2023-10-06T02:24:11.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.995+0000 7f9249ffb700 1 -- 172.21.15.6:0/3261625419 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924400fcd0 con 0x7f9254159190 2023-10-06T02:24:11.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.995+0000 7f9249ffb700 1 -- 172.21.15.6:0/3261625419 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924401d6b0 con 0x7f9254159190 2023-10-06T02:24:11.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.995+0000 7f925c113700 1 -- 172.21.15.6:0/3261625419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92540b04d0 con 0x7f9254159190 2023-10-06T02:24:11.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.995+0000 7f925c113700 1 -- 172.21.15.6:0/3261625419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92540ca1d0 con 0x7f9254159190 2023-10-06T02:24:11.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.996+0000 7f925c113700 1 -- 172.21.15.6:0/3261625419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9254088a40 con 0x7f9254159190 2023-10-06T02:24:11.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.996+0000 7f9249ffb700 1 -- 172.21.15.6:0/3261625419 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f924401daa0 con 0x7f9254159190 2023-10-06T02:24:11.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.997+0000 7f9249ffb700 1 --2- 172.21.15.6:0/3261625419 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9238066f30 0x7f92380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.997+0000 7f9249ffb700 1 -- 172.21.15.6:0/3261625419 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9244018070 con 0x7f9254159190 2023-10-06T02:24:11.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.997+0000 7f9259eaf700 1 --2- 172.21.15.6:0/3261625419 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9238066f30 0x7f92380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:10.997+0000 7f9259eaf700 1 --2- 172.21.15.6:0/3261625419 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9238066f30 0x7f92380693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f92500018b0 tx=0x7f9250015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:11.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:11.001+0000 7f9249ffb700 1 -- 172.21.15.6:0/3261625419 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92440525b0 con 0x7f9254159190 2023-10-06T02:24:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:11.280+0000 7f925c113700 1 -- 172.21.15.6:0/3261625419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "5:0", "val": "false"} v 0) v1 -- 0x7f92540b1eb0 con 0x7f9254159190 2023-10-06T02:24:11.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:11.855+0000 7f9249ffb700 1 -- 172.21.15.6:0/3261625419 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "5:0", "val": "false"}]=0 unfreezing mds.6789 v73) v1 ==== 115+0+0 (secure 0 0 0) 0x7f9244055bd0 con 0x7f9254159190 2023-10-06T02:24:11.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:11.858+0000 7f925c113700 1 -- 172.21.15.6:0/3261625419 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9238066f30 msgr2=0x7f92380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:11.858+0000 7f925c113700 1 --2- 172.21.15.6:0/3261625419 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9238066f30 0x7f92380693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f92500018b0 tx=0x7f9250015000 comp rx=0 tx=0).stop 2023-10-06T02:24:11.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:11.858+0000 7f925c113700 1 -- 172.21.15.6:0/3261625419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9254159190 msgr2=0x7f92540c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:11.858+0000 7f925c113700 1 --2- 172.21.15.6:0/3261625419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9254159190 0x7f92540c8a80 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f9244011d20 tx=0x7f92440091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:11.858+0000 7f925c113700 1 -- 172.21.15.6:0/3261625419 shutdown_connections 2023-10-06T02:24:11.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:11.858+0000 7f925c113700 1 --2- 172.21.15.6:0/3261625419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9254159600 0x7f9254155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:11.858+0000 7f925c113700 1 --2- 172.21.15.6:0/3261625419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9240003a60 0x7f925415b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:11.858+0000 7f925c113700 1 --2- 172.21.15.6:0/3261625419 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9238066f30 0x7f92380693e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:11.858+0000 7f925c113700 1 --2- 172.21.15.6:0/3261625419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9254159190 0x7f92540c8a80 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:11.858+0000 7f925c113700 1 -- 172.21.15.6:0/3261625419 >> 172.21.15.6:0/3261625419 conn(0x7f92540d0350 msgr2=0x7f9254157fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:11.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:11.859+0000 7f925c113700 1 -- 172.21.15.6:0/3261625419 shutdown_connections 2023-10-06T02:24:11.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:11.859+0000 7f925c113700 1 -- 172.21.15.6:0/3261625419 wait complete. 2023-10-06T02:24:11.861 INFO:teuthology.orchestra.run.smithi006.stderr:unfreezing mds.6789 2023-10-06T02:24:11.877 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -n kernel.core_pattern 2023-10-06T02:24:11.903 INFO:teuthology.orchestra.run.smithi006.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:24:11.905 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-10-06T02:24:11.905 DEBUG:teuthology.orchestra.run.smithi006:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-10-06T02:24:11.975 INFO:teuthology.orchestra.run.smithi006.stdout:1696559033.117430.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-10-06T02:24:11.977 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1696559033.117430.core'] 2023-10-06T02:24:11.977 INFO:tasks.cephfs.cephfs_test_case:Found core file 1696559033.117430.core, deleting it 2023-10-06T02:24:11.977 DEBUG:teuthology.orchestra.run.smithi006:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1696559033.117430.core 2023-10-06T02:24:12.047 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:24:12.047 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:24:12.047 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:24:12.047 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:24:12.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:24:12.047 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-10-06T02:24:12.048 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:24:12.048 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:24:12.089 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:24:12.089 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:12.165 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-06T02:24:12.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.210+0000 7fd5265d5700 1 Processor -- start 2023-10-06T02:24:12.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.210+0000 7fd5265d5700 1 -- start start 2023-10-06T02:24:12.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.211+0000 7fd5265d5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd520153a10 0x7fd5200cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.211+0000 7fd5265d5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5200ceea0 con 0x7fd5200cf870 2023-10-06T02:24:12.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.211+0000 7fd5265d5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52015a690 con 0x7fd5200d05a0 2023-10-06T02:24:12.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.211+0000 7fd5265d5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd520069140 con 0x7fd520153a10 2023-10-06T02:24:12.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.211+0000 7fd524dd2700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd5200cf870 0x7fd5200cfe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32932/0 (socket says 172.21.15.6:32932) 2023-10-06T02:24:12.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.211+0000 7fd524dd2700 1 -- 172.21.15.6:0/2226873865 learned_addr learned my addr 172.21.15.6:0/2226873865 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:12.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.211+0000 7fd5255d3700 1 --2- 172.21.15.6:0/2226873865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd520153a10 0x7fd5200cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.211+0000 7fd51ffff700 1 -- 172.21.15.6:0/2226873865 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773619035 0 0) 0x7fd5200ceea0 con 0x7fd5200cf870 2023-10-06T02:24:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.211+0000 7fd51ffff700 1 -- 172.21.15.6:0/2226873865 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd508003570 con 0x7fd5200cf870 2023-10-06T02:24:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.212+0000 7fd51ffff700 1 -- 172.21.15.6:0/2226873865 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002068871 0 0) 0x7fd52015a690 con 0x7fd5200d05a0 2023-10-06T02:24:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.212+0000 7fd5255d3700 1 -- 172.21.15.6:0/2226873865 >> v1:172.21.15.175:6789/0 conn(0x7fd5200d05a0 legacy=0x7fd52015abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.212+0000 7fd5255d3700 1 -- 172.21.15.6:0/2226873865 >> v1:172.21.15.6:6789/0 conn(0x7fd5200cf870 legacy=0x7fd5200cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.212+0000 7fd5255d3700 1 -- 172.21.15.6:0/2226873865 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5200ce850 con 0x7fd520153a10 2023-10-06T02:24:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.212+0000 7fd5255d3700 1 --2- 172.21.15.6:0/2226873865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd520153a10 0x7fd5200cf330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd518009910 tx=0x7fd5180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3216a6d791ed3778 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.212+0000 7fd51ffff700 1 -- 172.21.15.6:0/2226873865 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51800b680 con 0x7fd520153a10 2023-10-06T02:24:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.212+0000 7fd51ffff700 1 -- 172.21.15.6:0/2226873865 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51800b7e0 con 0x7fd520153a10 2023-10-06T02:24:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.212+0000 7fd51ffff700 1 -- 172.21.15.6:0/2226873865 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51800bba0 con 0x7fd520153a10 2023-10-06T02:24:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.212+0000 7fd5265d5700 1 -- 172.21.15.6:0/2226873865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd520153a10 msgr2=0x7fd5200cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.212+0000 7fd5265d5700 1 --2- 172.21.15.6:0/2226873865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd520153a10 0x7fd5200cf330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd518009910 tx=0x7fd5180091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.213+0000 7fd5265d5700 1 -- 172.21.15.6:0/2226873865 shutdown_connections 2023-10-06T02:24:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.213+0000 7fd5265d5700 1 --2- 172.21.15.6:0/2226873865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd520153a10 0x7fd5200cf330 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.213+0000 7fd5265d5700 1 -- 172.21.15.6:0/2226873865 >> 172.21.15.6:0/2226873865 conn(0x7fd52006ac00 msgr2=0x7fd520068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.213+0000 7fd5265d5700 1 -- 172.21.15.6:0/2226873865 shutdown_connections 2023-10-06T02:24:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.213+0000 7fd5265d5700 1 -- 172.21.15.6:0/2226873865 wait complete. 2023-10-06T02:24:12.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.214+0000 7fd5265d5700 1 Processor -- start 2023-10-06T02:24:12.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.214+0000 7fd5265d5700 1 -- start start 2023-10-06T02:24:12.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd5265d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5200cf870 0x7fd5200a6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd5265d5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5200d05a0 0x7fd5200a70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd5265d5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd520153a10 0x7fd5201552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd5265d5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5201560b0 con 0x7fd5200cf870 2023-10-06T02:24:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd5265d5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd520156390 con 0x7fd5200d05a0 2023-10-06T02:24:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd5265d5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd520156670 con 0x7fd520153a10 2023-10-06T02:24:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd5255d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5200cf870 0x7fd5200a6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd5255d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5200cf870 0x7fd5200a6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38882/0 (socket says 172.21.15.6:38882) 2023-10-06T02:24:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd5255d3700 1 -- 172.21.15.6:0/1444288885 learned_addr learned my addr 172.21.15.6:0/1444288885 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd524dd2700 1 --2- 172.21.15.6:0/1444288885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5200d05a0 0x7fd5200a70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd525dd4700 1 --2- 172.21.15.6:0/1444288885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd520153a10 0x7fd5201552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd5255d3700 1 -- 172.21.15.6:0/1444288885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd520153a10 msgr2=0x7fd5201552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd5255d3700 1 --2- 172.21.15.6:0/1444288885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd520153a10 0x7fd5201552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd5255d3700 1 -- 172.21.15.6:0/1444288885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5200d05a0 msgr2=0x7fd5200a70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd5255d3700 1 --2- 172.21.15.6:0/1444288885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5200d05a0 0x7fd5200a70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd5255d3700 1 -- 172.21.15.6:0/1444288885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd518009420 con 0x7fd5200cf870 2023-10-06T02:24:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd524dd2700 1 --2- 172.21.15.6:0/1444288885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5200d05a0 0x7fd5200a70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.215+0000 7fd5255d3700 1 --2- 172.21.15.6:0/1444288885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5200cf870 0x7fd5200a6ba0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fd52006b050 tx=0x7fd518017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.216+0000 7fd51d7fa700 1 -- 172.21.15.6:0/1444288885 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51800bb60 con 0x7fd5200cf870 2023-10-06T02:24:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.216+0000 7fd51d7fa700 1 -- 172.21.15.6:0/1444288885 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd518027450 con 0x7fd5200cf870 2023-10-06T02:24:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.216+0000 7fd5265d5700 1 -- 172.21.15.6:0/1444288885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd520156950 con 0x7fd5200cf870 2023-10-06T02:24:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.216+0000 7fd51d7fa700 1 -- 172.21.15.6:0/1444288885 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5180277f0 con 0x7fd5200cf870 2023-10-06T02:24:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.216+0000 7fd5265d5700 1 -- 172.21.15.6:0/1444288885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5200ae940 con 0x7fd5200cf870 2023-10-06T02:24:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.217+0000 7fd5265d5700 1 -- 172.21.15.6:0/1444288885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd520153de0 con 0x7fd5200cf870 2023-10-06T02:24:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.217+0000 7fd51d7fa700 1 -- 172.21.15.6:0/1444288885 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd51801a430 con 0x7fd5200cf870 2023-10-06T02:24:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.218+0000 7fd51d7fa700 1 --2- 172.21.15.6:0/1444288885 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd50c066f30 0x7fd50c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.218+0000 7fd51d7fa700 1 -- 172.21.15.6:0/1444288885 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fd518086670 con 0x7fd5200cf870 2023-10-06T02:24:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.218+0000 7fd524dd2700 1 --2- 172.21.15.6:0/1444288885 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd50c066f30 0x7fd50c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.218+0000 7fd524dd2700 1 --2- 172.21.15.6:0/1444288885 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd50c066f30 0x7fd50c0693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd5200cd0e0 tx=0x7fd514009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.222+0000 7fd51d7fa700 1 -- 172.21.15.6:0/1444288885 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5180536a0 con 0x7fd5200cf870 2023-10-06T02:24:12.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.459+0000 7fd5265d5700 1 -- 172.21.15.6:0/1444288885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5200ceb30 con 0x7fd5200cf870 2023-10-06T02:24:12.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.459+0000 7fd51d7fa700 1 -- 172.21.15.6:0/1444288885 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+3843 (secure 0 0 0) 0x7fd518056cc0 con 0x7fd5200cf870 2023-10-06T02:24:12.460 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:12.460 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":74,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2575759355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2575759355},{"type":"v1","addr":"172.21.15.175:6836","nonce":2575759355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2523304335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2523304335},{"type":"v1","addr":"172.21.15.175:6837","nonce":2523304335}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:38.399768+0000","modified":"2023-10-06T02:24:11.856056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6786},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6786":{"gid":6786,"name":"a","rank":0,"incarnation":74,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6834/353268974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":353268974},{"type":"v1","addr":"172.21.15.6:6834","nonce":353268974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:24:12.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.461+0000 7fd5265d5700 1 -- 172.21.15.6:0/1444288885 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd50c066f30 msgr2=0x7fd50c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.461+0000 7fd5265d5700 1 --2- 172.21.15.6:0/1444288885 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd50c066f30 0x7fd50c0693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd5200cd0e0 tx=0x7fd514009040 comp rx=0 tx=0).stop 2023-10-06T02:24:12.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.461+0000 7fd5265d5700 1 -- 172.21.15.6:0/1444288885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5200cf870 msgr2=0x7fd5200a6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.461+0000 7fd5265d5700 1 --2- 172.21.15.6:0/1444288885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5200cf870 0x7fd5200a6ba0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fd52006b050 tx=0x7fd518017000 comp rx=0 tx=0).stop 2023-10-06T02:24:12.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.462+0000 7fd5265d5700 1 -- 172.21.15.6:0/1444288885 shutdown_connections 2023-10-06T02:24:12.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.462+0000 7fd5265d5700 1 --2- 172.21.15.6:0/1444288885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd520153a10 0x7fd5201552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.462+0000 7fd5265d5700 1 --2- 172.21.15.6:0/1444288885 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd50c066f30 0x7fd50c0693e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.462+0000 7fd5265d5700 1 --2- 172.21.15.6:0/1444288885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5200cf870 0x7fd5200a6ba0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.462+0000 7fd5265d5700 1 --2- 172.21.15.6:0/1444288885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5200d05a0 0x7fd5200a70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.462+0000 7fd5265d5700 1 -- 172.21.15.6:0/1444288885 >> 172.21.15.6:0/1444288885 conn(0x7fd52006ac00 msgr2=0x7fd5200b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:12.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.462+0000 7fd5265d5700 1 -- 172.21.15.6:0/1444288885 shutdown_connections 2023-10-06T02:24:12.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:12.462+0000 7fd5265d5700 1 -- 172.21.15.6:0/1444288885 wait complete. 2023-10-06T02:24:12.464 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 74 2023-10-06T02:24:12.876 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:23:38.399768+0000', 'modified': '2023-10-06T02:24:11.856056+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 83, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6786}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6786': {'gid': 6786, 'name': 'a', 'rank': 0, 'incarnation': 74, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.6:6834/353268974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 353268974}, {'type': 'v1', 'addr': '172.21.15.6:6834', 'nonce': 353268974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:24:12.876 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6786:up:replay 2023-10-06T02:24:13.877 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.008+0000 7fa554835700 1 Processor -- start 2023-10-06T02:24:14.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.008+0000 7fa554835700 1 -- start start 2023-10-06T02:24:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.009+0000 7fa554835700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa550069fc0 0x7fa55006a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.009+0000 7fa554835700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa55015d2d0 0x7fa55015d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.009+0000 7fa554835700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5500b16c0 con 0x7fa550069bf0 2023-10-06T02:24:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.009+0000 7fa554835700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5500b1f40 con 0x7fa550069fc0 2023-10-06T02:24:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.009+0000 7fa554835700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55006aac0 con 0x7fa55015d2d0 2023-10-06T02:24:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.009+0000 7fa54effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa550069fc0 0x7fa55006a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.009+0000 7fa54f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa550069bf0 0x7fa5500b0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32936/0 (socket says 172.21.15.6:32936) 2023-10-06T02:24:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.009+0000 7fa54f7fe700 1 -- 172.21.15.6:0/1138252346 learned_addr learned my addr 172.21.15.6:0/1138252346 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.009+0000 7fa54ffff700 1 --2- 172.21.15.6:0/1138252346 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa55015d2d0 0x7fa55015d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.009+0000 7fa54effd700 1 -- 172.21.15.6:0/1138252346 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa55015d2d0 msgr2=0x7fa55015d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.009+0000 7fa54effd700 1 --2- 172.21.15.6:0/1138252346 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa55015d2d0 0x7fa55015d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.009+0000 7fa54effd700 1 -- 172.21.15.6:0/1138252346 >> v1:172.21.15.6:6789/0 conn(0x7fa550069bf0 legacy=0x7fa5500b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.010+0000 7fa54effd700 1 -- 172.21.15.6:0/1138252346 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5500b18f0 con 0x7fa550069fc0 2023-10-06T02:24:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.009+0000 7fa54e7fc700 1 -- 172.21.15.6:0/1138252346 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498718351 0 0) 0x7fa5500b16c0 con 0x7fa550069bf0 2023-10-06T02:24:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.010+0000 7fa54effd700 1 --2- 172.21.15.6:0/1138252346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa550069fc0 0x7fa55006a460 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fa5440098e0 tx=0x7fa5440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3048f8394c591ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.010+0000 7fa54e7fc700 1 -- 172.21.15.6:0/1138252346 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa544009e80 con 0x7fa550069fc0 2023-10-06T02:24:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.010+0000 7fa54e7fc700 1 -- 172.21.15.6:0/1138252346 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54400b860 con 0x7fa550069fc0 2023-10-06T02:24:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.010+0000 7fa54e7fc700 1 -- 172.21.15.6:0/1138252346 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54400bbe0 con 0x7fa550069fc0 2023-10-06T02:24:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.010+0000 7fa554835700 1 -- 172.21.15.6:0/1138252346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa550069fc0 msgr2=0x7fa55006a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.010+0000 7fa554835700 1 --2- 172.21.15.6:0/1138252346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa550069fc0 0x7fa55006a460 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fa5440098e0 tx=0x7fa5440091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.010+0000 7fa554835700 1 -- 172.21.15.6:0/1138252346 shutdown_connections 2023-10-06T02:24:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.010+0000 7fa554835700 1 --2- 172.21.15.6:0/1138252346 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa55015d2d0 0x7fa55015d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.010+0000 7fa554835700 1 --2- 172.21.15.6:0/1138252346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa550069fc0 0x7fa55006a460 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.010+0000 7fa554835700 1 -- 172.21.15.6:0/1138252346 >> 172.21.15.6:0/1138252346 conn(0x7fa550067910 msgr2=0x7fa5500cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.010+0000 7fa554835700 1 -- 172.21.15.6:0/1138252346 shutdown_connections 2023-10-06T02:24:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.010+0000 7fa554835700 1 -- 172.21.15.6:0/1138252346 wait complete. 2023-10-06T02:24:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.012+0000 7fa554835700 1 Processor -- start 2023-10-06T02:24:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.012+0000 7fa554835700 1 -- start start 2023-10-06T02:24:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.012+0000 7fa554835700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa550069bf0 0x7fa55014e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.012+0000 7fa554835700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa550069fc0 0x7fa5500aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.012+0000 7fa554835700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa55015d2d0 0x7fa5500af350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.012+0000 7fa554835700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa550153fa0 con 0x7fa550069bf0 2023-10-06T02:24:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.012+0000 7fa554835700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa550150090 con 0x7fa55015d2d0 2023-10-06T02:24:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.012+0000 7fa554835700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5501531d0 con 0x7fa550069fc0 2023-10-06T02:24:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.013+0000 7fa54f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa550069bf0 0x7fa55014e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.013+0000 7fa54f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa550069bf0 0x7fa55014e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38888/0 (socket says 172.21.15.6:38888) 2023-10-06T02:24:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.013+0000 7fa54f7fe700 1 -- 172.21.15.6:0/225379512 learned_addr learned my addr 172.21.15.6:0/225379512 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.013+0000 7fa54effd700 1 --2- 172.21.15.6:0/225379512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa550069fc0 0x7fa5500aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.013+0000 7fa54ffff700 1 --2- 172.21.15.6:0/225379512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa55015d2d0 0x7fa5500af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.013+0000 7fa54f7fe700 1 -- 172.21.15.6:0/225379512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa550069fc0 msgr2=0x7fa5500aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.013+0000 7fa54f7fe700 1 --2- 172.21.15.6:0/225379512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa550069fc0 0x7fa5500aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.013+0000 7fa54f7fe700 1 -- 172.21.15.6:0/225379512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa55015d2d0 msgr2=0x7fa5500af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.013+0000 7fa54f7fe700 1 --2- 172.21.15.6:0/225379512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa55015d2d0 0x7fa5500af350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.013+0000 7fa54f7fe700 1 -- 172.21.15.6:0/225379512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa544009420 con 0x7fa550069bf0 2023-10-06T02:24:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.013+0000 7fa54f7fe700 1 --2- 172.21.15.6:0/225379512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa550069bf0 0x7fa55014e840 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fa54000c7e0 tx=0x7fa540007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.013+0000 7fa5377fe700 1 -- 172.21.15.6:0/225379512 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa540007300 con 0x7fa550069bf0 2023-10-06T02:24:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.013+0000 7fa5377fe700 1 -- 172.21.15.6:0/225379512 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa540007460 con 0x7fa550069bf0 2023-10-06T02:24:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.013+0000 7fa554835700 1 -- 172.21.15.6:0/225379512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa550153480 con 0x7fa550069bf0 2023-10-06T02:24:14.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.013+0000 7fa5377fe700 1 -- 172.21.15.6:0/225379512 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5400057f0 con 0x7fa550069bf0 2023-10-06T02:24:14.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.013+0000 7fa554835700 1 -- 172.21.15.6:0/225379512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa550153cc0 con 0x7fa550069bf0 2023-10-06T02:24:14.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.014+0000 7fa554835700 1 -- 172.21.15.6:0/225379512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5500b1bd0 con 0x7fa550069bf0 2023-10-06T02:24:14.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.015+0000 7fa5377fe700 1 -- 172.21.15.6:0/225379512 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa540005c00 con 0x7fa550069bf0 2023-10-06T02:24:14.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.015+0000 7fa5377fe700 1 --2- 172.21.15.6:0/225379512 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa53c066f30 0x7fa53c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:14.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.015+0000 7fa5377fe700 1 -- 172.21.15.6:0/225379512 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fa540084300 con 0x7fa550069bf0 2023-10-06T02:24:14.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.015+0000 7fa54effd700 1 --2- 172.21.15.6:0/225379512 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa53c066f30 0x7fa53c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.016+0000 7fa54effd700 1 --2- 172.21.15.6:0/225379512 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa53c066f30 0x7fa53c0693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa5440091e0 tx=0x7fa544017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.019+0000 7fa5377fe700 1 -- 172.21.15.6:0/225379512 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa540051300 con 0x7fa550069bf0 2023-10-06T02:24:14.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.256+0000 7fa554835700 1 -- 172.21.15.6:0/225379512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5500a8860 con 0x7fa550069bf0 2023-10-06T02:24:14.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.256+0000 7fa5377fe700 1 -- 172.21.15.6:0/225379512 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4598 (secure 0 0 0) 0x7fa540054920 con 0x7fa550069bf0 2023-10-06T02:24:14.257 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:14.257 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":76,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2575759355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2575759355},{"type":"v1","addr":"172.21.15.175:6836","nonce":2575759355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2523304335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2523304335},{"type":"v1","addr":"172.21.15.175:6837","nonce":2523304335}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7032,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1331184347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1331184347},{"type":"v1","addr":"172.21.15.6:6835","nonce":1331184347}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:38.399768+0000","modified":"2023-10-06T02:24:13.869840+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6786},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6786":{"gid":6786,"name":"a","rank":0,"incarnation":74,"state":"up:rejoin","state_seq":12,"addr":"172.21.15.6:6834/353268974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":353268974},{"type":"v1","addr":"172.21.15.6:6834","nonce":353268974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:24:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.258+0000 7fa554835700 1 -- 172.21.15.6:0/225379512 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa53c066f30 msgr2=0x7fa53c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.258+0000 7fa554835700 1 --2- 172.21.15.6:0/225379512 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa53c066f30 0x7fa53c0693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa5440091e0 tx=0x7fa544017000 comp rx=0 tx=0).stop 2023-10-06T02:24:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.258+0000 7fa554835700 1 -- 172.21.15.6:0/225379512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa550069bf0 msgr2=0x7fa55014e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.259+0000 7fa554835700 1 --2- 172.21.15.6:0/225379512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa550069bf0 0x7fa55014e840 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fa54000c7e0 tx=0x7fa540007c80 comp rx=0 tx=0).stop 2023-10-06T02:24:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.259+0000 7fa554835700 1 -- 172.21.15.6:0/225379512 shutdown_connections 2023-10-06T02:24:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.259+0000 7fa554835700 1 --2- 172.21.15.6:0/225379512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa55015d2d0 0x7fa5500af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.259+0000 7fa554835700 1 --2- 172.21.15.6:0/225379512 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa53c066f30 0x7fa53c0693e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.259+0000 7fa554835700 1 --2- 172.21.15.6:0/225379512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa550069bf0 0x7fa55014e840 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.259+0000 7fa554835700 1 --2- 172.21.15.6:0/225379512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa550069fc0 0x7fa5500aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.259+0000 7fa554835700 1 -- 172.21.15.6:0/225379512 >> 172.21.15.6:0/225379512 conn(0x7fa550067910 msgr2=0x7fa55006d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.259+0000 7fa554835700 1 -- 172.21.15.6:0/225379512 shutdown_connections 2023-10-06T02:24:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:14.259+0000 7fa554835700 1 -- 172.21.15.6:0/225379512 wait complete. 2023-10-06T02:24:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 76 2023-10-06T02:24:14.675 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:23:38.399768+0000', 'modified': '2023-10-06T02:24:13.869840+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 83, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6786}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6786': {'gid': 6786, 'name': 'a', 'rank': 0, 'incarnation': 74, 'state': 'up:rejoin', 'state_seq': 12, 'addr': '172.21.15.6:6834/353268974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 353268974}, {'type': 'v1', 'addr': '172.21.15.6:6834', 'nonce': 353268974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:24:14.675 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6786:up:rejoin 2023-10-06T02:24:15.402 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-06T02:24:15.676 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:15.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.808+0000 7f19fe125700 1 Processor -- start 2023-10-06T02:24:15.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.809+0000 7f19fe125700 1 -- start start 2023-10-06T02:24:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.809+0000 7f19fe125700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f815b3c0 0x7f19f8097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.809+0000 7f19fe125700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f80afb90 con 0x7f19f80b3c50 2023-10-06T02:24:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.809+0000 7f19fe125700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f80b2310 con 0x7f19f815a590 2023-10-06T02:24:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.809+0000 7f19fe125700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f80b25f0 con 0x7f19f815b3c0 2023-10-06T02:24:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.809+0000 7f19f6ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f19f80b3c50 0x7f19f815b790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32940/0 (socket says 172.21.15.6:32940) 2023-10-06T02:24:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.810+0000 7f19f6ffd700 1 -- 172.21.15.6:0/137925821 learned_addr learned my addr 172.21.15.6:0/137925821 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.810+0000 7f19f77fe700 1 --2- 172.21.15.6:0/137925821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f815b3c0 0x7f19f8097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.810+0000 7f19f67fc700 1 -- 172.21.15.6:0/137925821 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474607961 0 0) 0x7f19f80afb90 con 0x7f19f80b3c50 2023-10-06T02:24:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.810+0000 7f19f67fc700 1 -- 172.21.15.6:0/137925821 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19e0003570 con 0x7f19f80b3c50 2023-10-06T02:24:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.810+0000 7f19f67fc700 1 -- 172.21.15.6:0/137925821 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701453855 0 0) 0x7f19f80b2310 con 0x7f19f815a590 2023-10-06T02:24:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.810+0000 7f19f67fc700 1 -- 172.21.15.6:0/137925821 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19f80afb90 con 0x7f19f815a590 2023-10-06T02:24:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.810+0000 7f19f77fe700 1 -- 172.21.15.6:0/137925821 >> v1:172.21.15.175:6789/0 conn(0x7f19f815a590 legacy=0x7f19f815a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.810+0000 7f19f77fe700 1 -- 172.21.15.6:0/137925821 >> v1:172.21.15.6:6789/0 conn(0x7f19f80b3c50 legacy=0x7f19f815b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.810+0000 7f19f67fc700 1 -- 172.21.15.6:0/137925821 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2021794538 0 0) 0x7f19e0003570 con 0x7f19f80b3c50 2023-10-06T02:24:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.810+0000 7f19f77fe700 1 -- 172.21.15.6:0/137925821 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f80af820 con 0x7f19f815b3c0 2023-10-06T02:24:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.810+0000 7f19f77fe700 1 --2- 172.21.15.6:0/137925821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f815b3c0 0x7f19f8097d70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009900 tx=0x7f19e8009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8728164f15033604 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.811+0000 7f19f67fc700 1 -- 172.21.15.6:0/137925821 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ec001470 con 0x7f19f815b3c0 2023-10-06T02:24:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.811+0000 7f19f67fc700 1 -- 172.21.15.6:0/137925821 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e8011420 con 0x7f19f815b3c0 2023-10-06T02:24:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.811+0000 7f19f67fc700 1 -- 172.21.15.6:0/137925821 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e80117c0 con 0x7f19f815b3c0 2023-10-06T02:24:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.811+0000 7f19fe125700 1 -- 172.21.15.6:0/137925821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f815b3c0 msgr2=0x7f19f8097d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.811+0000 7f19fe125700 1 --2- 172.21.15.6:0/137925821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f815b3c0 0x7f19f8097d70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009900 tx=0x7f19e8009120 comp rx=0 tx=0).stop 2023-10-06T02:24:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.811+0000 7f19fe125700 1 -- 172.21.15.6:0/137925821 shutdown_connections 2023-10-06T02:24:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.811+0000 7f19fe125700 1 --2- 172.21.15.6:0/137925821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f815b3c0 0x7f19f8097d70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.811+0000 7f19fe125700 1 -- 172.21.15.6:0/137925821 >> 172.21.15.6:0/137925821 conn(0x7f19f8067910 msgr2=0x7f19f80ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.811+0000 7f19fe125700 1 -- 172.21.15.6:0/137925821 shutdown_connections 2023-10-06T02:24:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.811+0000 7f19fe125700 1 -- 172.21.15.6:0/137925821 wait complete. 2023-10-06T02:24:15.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.812+0000 7f19fe125700 1 Processor -- start 2023-10-06T02:24:15.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.812+0000 7f19fe125700 1 -- start start 2023-10-06T02:24:15.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.813+0000 7f19fe125700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80b3c50 0x7f19f80ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:15.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.813+0000 7f19fe125700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19f815a590 0x7f19f8098ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:15.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.813+0000 7f19fe125700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19f815b3c0 0x7f19f8098ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:15.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.813+0000 7f19fe125700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f81573d0 con 0x7f19f815a590 2023-10-06T02:24:15.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.813+0000 7f19fe125700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f809a2a0 con 0x7f19f815b3c0 2023-10-06T02:24:15.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.813+0000 7f19fe125700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f8099690 con 0x7f19f80b3c50 2023-10-06T02:24:15.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.813+0000 7f19f6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19f815a590 0x7f19f8098ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:15.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.813+0000 7f19f6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19f815a590 0x7f19f8098ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38894/0 (socket says 172.21.15.6:38894) 2023-10-06T02:24:15.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.813+0000 7f19f6ffd700 1 -- 172.21.15.6:0/1369435022 learned_addr learned my addr 172.21.15.6:0/1369435022 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:15.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.813+0000 7f19f77fe700 1 --2- 172.21.15.6:0/1369435022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80b3c50 0x7f19f80ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:15.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.813+0000 7f19f7fff700 1 --2- 172.21.15.6:0/1369435022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19f815b3c0 0x7f19f8098ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:15.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.814+0000 7f19f6ffd700 1 -- 172.21.15.6:0/1369435022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80b3c50 msgr2=0x7f19f80ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:15.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.814+0000 7f19f6ffd700 1 --2- 172.21.15.6:0/1369435022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80b3c50 0x7f19f80ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:15.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.814+0000 7f19f6ffd700 1 -- 172.21.15.6:0/1369435022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19f815b3c0 msgr2=0x7f19f8098ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:15.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.814+0000 7f19f6ffd700 1 --2- 172.21.15.6:0/1369435022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19f815b3c0 0x7f19f8098ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:15.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.814+0000 7f19f6ffd700 1 -- 172.21.15.6:0/1369435022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e80093c0 con 0x7f19f815a590 2023-10-06T02:24:15.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.814+0000 7f19f6ffd700 1 --2- 172.21.15.6:0/1369435022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19f815a590 0x7f19f8098ab0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00cb70 tx=0x7f19ec001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:15.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.814+0000 7f19df7fe700 1 -- 172.21.15.6:0/1369435022 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ec007150 con 0x7f19f815a590 2023-10-06T02:24:15.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.814+0000 7f19df7fe700 1 -- 172.21.15.6:0/1369435022 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ec0072b0 con 0x7f19f815a590 2023-10-06T02:24:15.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.814+0000 7f19df7fe700 1 -- 172.21.15.6:0/1369435022 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ec007670 con 0x7f19f815a590 2023-10-06T02:24:15.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.814+0000 7f19fe125700 1 -- 172.21.15.6:0/1369435022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f8099970 con 0x7f19f815a590 2023-10-06T02:24:15.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.814+0000 7f19fe125700 1 -- 172.21.15.6:0/1369435022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f8099f30 con 0x7f19f815a590 2023-10-06T02:24:15.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.815+0000 7f19fe125700 1 -- 172.21.15.6:0/1369435022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f8067f20 con 0x7f19f815a590 2023-10-06T02:24:15.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.816+0000 7f19df7fe700 1 -- 172.21.15.6:0/1369435022 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19ec004a40 con 0x7f19f815a590 2023-10-06T02:24:15.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.816+0000 7f19df7fe700 1 --2- 172.21.15.6:0/1369435022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f19e4066f30 0x7f19e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:15.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.816+0000 7f19df7fe700 1 -- 172.21.15.6:0/1369435022 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f19ec083a60 con 0x7f19f815a590 2023-10-06T02:24:15.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.816+0000 7f19f77fe700 1 --2- 172.21.15.6:0/1369435022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f19e4066f30 0x7f19e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:15.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.817+0000 7f19f77fe700 1 --2- 172.21.15.6:0/1369435022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f19e4066f30 0x7f19e40693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009160 tx=0x7f19e8016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:15.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:15.820+0000 7f19df7fe700 1 -- 172.21.15.6:0/1369435022 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19ec050a60 con 0x7f19f815a590 2023-10-06T02:24:16.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.062+0000 7f19fe125700 1 -- 172.21.15.6:0/1369435022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19f809a410 con 0x7f19f815a590 2023-10-06T02:24:16.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.062+0000 7f19df7fe700 1 -- 172.21.15.6:0/1369435022 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f19ec018020 con 0x7f19f815a590 2023-10-06T02:24:16.063 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:16.063 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":77,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2575759355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2575759355},{"type":"v1","addr":"172.21.15.175:6836","nonce":2575759355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2523304335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2523304335},{"type":"v1","addr":"172.21.15.175:6837","nonce":2523304335}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7032,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1331184347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1331184347},{"type":"v1","addr":"172.21.15.6:6835","nonce":1331184347}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:38.399768+0000","modified":"2023-10-06T02:24:14.877092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6786},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6786":{"gid":6786,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":13,"addr":"172.21.15.6:6834/353268974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":353268974},{"type":"v1","addr":"172.21.15.6:6834","nonce":353268974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:24:16.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.064+0000 7f19fe125700 1 -- 172.21.15.6:0/1369435022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f19e4066f30 msgr2=0x7f19e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.064+0000 7f19fe125700 1 --2- 172.21.15.6:0/1369435022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f19e4066f30 0x7f19e40693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009160 tx=0x7f19e8016000 comp rx=0 tx=0).stop 2023-10-06T02:24:16.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.064+0000 7f19fe125700 1 -- 172.21.15.6:0/1369435022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19f815a590 msgr2=0x7f19f8098ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.064+0000 7f19fe125700 1 --2- 172.21.15.6:0/1369435022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19f815a590 0x7f19f8098ab0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00cb70 tx=0x7f19ec001ab0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.064+0000 7f19fe125700 1 -- 172.21.15.6:0/1369435022 shutdown_connections 2023-10-06T02:24:16.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.064+0000 7f19fe125700 1 --2- 172.21.15.6:0/1369435022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19f815b3c0 0x7f19f8098ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.064+0000 7f19fe125700 1 --2- 172.21.15.6:0/1369435022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80b3c50 0x7f19f80ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.064+0000 7f19fe125700 1 --2- 172.21.15.6:0/1369435022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f19e4066f30 0x7f19e40693e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.064+0000 7f19fe125700 1 --2- 172.21.15.6:0/1369435022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19f815a590 0x7f19f8098ab0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.064+0000 7f19fe125700 1 -- 172.21.15.6:0/1369435022 >> 172.21.15.6:0/1369435022 conn(0x7f19f8067910 msgr2=0x7f19f8158fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:16.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.064+0000 7f19fe125700 1 -- 172.21.15.6:0/1369435022 shutdown_connections 2023-10-06T02:24:16.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.064+0000 7f19fe125700 1 -- 172.21.15.6:0/1369435022 wait complete. 2023-10-06T02:24:16.066 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 77 2023-10-06T02:24:16.479 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 77, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:23:38.399768+0000', 'modified': '2023-10-06T02:24:14.877092+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 83, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6786}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6786': {'gid': 6786, 'name': 'a', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.6:6834/353268974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 353268974}, {'type': 'v1', 'addr': '172.21.15.6:6834', 'nonce': 353268974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:24:16.479 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:24:16.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:24:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.602+0000 7f7c41c73700 1 Processor -- start 2023-10-06T02:24:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.603+0000 7f7c41c73700 1 -- start start 2023-10-06T02:24:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.603+0000 7f7c41c73700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c3c0b28c0 0x7f7c3c087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.603+0000 7f7c41c73700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c0afc50 con 0x7f7c3c15a030 2023-10-06T02:24:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.603+0000 7f7c41c73700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c0aff30 con 0x7f7c3c086ff0 2023-10-06T02:24:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.603+0000 7f7c41c73700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0b0cf0 con 0x7f7c3c0b28c0 2023-10-06T02:24:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.603+0000 7f7c3b7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7c3c15a030 0x7f7c3c15a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32944/0 (socket says 172.21.15.6:32944) 2023-10-06T02:24:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.603+0000 7f7c3b7fe700 1 -- 172.21.15.6:0/1914695456 learned_addr learned my addr 172.21.15.6:0/1914695456 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3bfff700 1 --2- 172.21.15.6:0/1914695456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c3c0b28c0 0x7f7c3c087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3a7fc700 1 -- 172.21.15.6:0/1914695456 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619152907 0 0) 0x7f7c3c0afc50 con 0x7f7c3c15a030 2023-10-06T02:24:16.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3a7fc700 1 -- 172.21.15.6:0/1914695456 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c24003570 con 0x7f7c3c15a030 2023-10-06T02:24:16.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3a7fc700 1 -- 172.21.15.6:0/1914695456 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1120590353 0 0) 0x7f7c24003570 con 0x7f7c3c15a030 2023-10-06T02:24:16.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3a7fc700 1 -- 172.21.15.6:0/1914695456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c3c0b28c0 msgr2=0x7f7c3c087470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3a7fc700 1 --2- 172.21.15.6:0/1914695456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c3c0b28c0 0x7f7c3c087470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3a7fc700 1 -- 172.21.15.6:0/1914695456 >> v1:172.21.15.175:6789/0 conn(0x7f7c3c086ff0 legacy=0x7f7c3c0b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3a7fc700 1 -- 172.21.15.6:0/1914695456 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0b0210 con 0x7f7c3c15a030 2023-10-06T02:24:16.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3a7fc700 1 -- 172.21.15.6:0/1914695456 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f7c2c001470 con 0x7f7c3c15a030 2023-10-06T02:24:16.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3a7fc700 1 -- 172.21.15.6:0/1914695456 >> v1:172.21.15.6:6789/0 conn(0x7f7c3c15a030 legacy=0x7f7c3c15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3a7fc700 1 --2- 172.21.15.6:0/1914695456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c3c0b28c0 0x7f7c24003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3a7fc700 1 --2- 172.21.15.6:0/1914695456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c24003fd0 0x7f7c24004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3a7fc700 1 --2- 172.21.15.6:0/1914695456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c24004d50 0x7f7c240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3a7fc700 1 -- 172.21.15.6:0/1914695456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0b0cf0 con 0x7f7c24004d50 2023-10-06T02:24:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3a7fc700 1 -- 172.21.15.6:0/1914695456 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2400bb40 con 0x7f7c24003fd0 2023-10-06T02:24:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3a7fc700 1 -- 172.21.15.6:0/1914695456 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2400bd00 con 0x7f7c3c0b28c0 2023-10-06T02:24:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3bfff700 1 --2- 172.21.15.6:0/1914695456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c24004d50 0x7f7c240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3b7fe700 1 --2- 172.21.15.6:0/1914695456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c3c0b28c0 0x7f7c24003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.604+0000 7f7c3affd700 1 --2- 172.21.15.6:0/1914695456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c24003fd0 0x7f7c24004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.605+0000 7f7c3bfff700 1 -- 172.21.15.6:0/1914695456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c3c0b28c0 msgr2=0x7f7c24003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.605+0000 7f7c3bfff700 1 --2- 172.21.15.6:0/1914695456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c3c0b28c0 0x7f7c24003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.605+0000 7f7c3bfff700 1 -- 172.21.15.6:0/1914695456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c24003fd0 msgr2=0x7f7c24004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.605+0000 7f7c3bfff700 1 --2- 172.21.15.6:0/1914695456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c24003fd0 0x7f7c24004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.605+0000 7f7c3bfff700 1 -- 172.21.15.6:0/1914695456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c24003570 con 0x7f7c24004d50 2023-10-06T02:24:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.605+0000 7f7c3bfff700 1 --2- 172.21.15.6:0/1914695456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c24004d50 0x7f7c240051c0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400e210 tx=0x7f7c3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eacd3574e1c4581 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.605+0000 7f7c3a7fc700 1 -- 172.21.15.6:0/1914695456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3400eac0 con 0x7f7c24004d50 2023-10-06T02:24:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.605+0000 7f7c3a7fc700 1 -- 172.21.15.6:0/1914695456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3400f040 con 0x7f7c24004d50 2023-10-06T02:24:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.605+0000 7f7c3a7fc700 1 -- 172.21.15.6:0/1914695456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3400ee70 con 0x7f7c24004d50 2023-10-06T02:24:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.605+0000 7f7c41c73700 1 -- 172.21.15.6:0/1914695456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c24004d50 msgr2=0x7f7c240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.605+0000 7f7c41c73700 1 --2- 172.21.15.6:0/1914695456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c24004d50 0x7f7c240051c0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400e210 tx=0x7f7c3400b040 comp rx=0 tx=0).stop 2023-10-06T02:24:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.605+0000 7f7c3bfff700 1 -- 172.21.15.6:0/1914695456 reap_dead start 2023-10-06T02:24:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.605+0000 7f7c41c73700 1 -- 172.21.15.6:0/1914695456 shutdown_connections 2023-10-06T02:24:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.605+0000 7f7c41c73700 1 -- 172.21.15.6:0/1914695456 >> 172.21.15.6:0/1914695456 conn(0x7f7c3c068680 msgr2=0x7f7c3c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.605+0000 7f7c41c73700 1 -- 172.21.15.6:0/1914695456 shutdown_connections 2023-10-06T02:24:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.605+0000 7f7c41c73700 1 -- 172.21.15.6:0/1914695456 wait complete. 2023-10-06T02:24:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.607+0000 7f7c41c73700 1 Processor -- start 2023-10-06T02:24:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.607+0000 7f7c41c73700 1 -- start start 2023-10-06T02:24:16.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.607+0000 7f7c41c73700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c3c156600 0x7f7c3c0c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.607+0000 7f7c41c73700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c3c1569d0 0x7f7c3c0b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.607+0000 7f7c41c73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c3c0b5c50 0x7f7c3c154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.607+0000 7f7c41c73700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0b60a0 con 0x7f7c3c0b5c50 2023-10-06T02:24:16.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.607+0000 7f7c41c73700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c156e40 con 0x7f7c3c1569d0 2023-10-06T02:24:16.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.607+0000 7f7c41c73700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0c6360 con 0x7f7c3c156600 2023-10-06T02:24:16.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.607+0000 7f7c3bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c3c0b5c50 0x7f7c3c154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.607+0000 7f7c3bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c3c0b5c50 0x7f7c3c154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38904/0 (socket says 172.21.15.6:38904) 2023-10-06T02:24:16.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.607+0000 7f7c3bfff700 1 -- 172.21.15.6:0/1389440843 learned_addr learned my addr 172.21.15.6:0/1389440843 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:16.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.608+0000 7f7c3affd700 1 --2- 172.21.15.6:0/1389440843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c3c1569d0 0x7f7c3c0b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.608+0000 7f7c3b7fe700 1 --2- 172.21.15.6:0/1389440843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c3c156600 0x7f7c3c0c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.608+0000 7f7c3bfff700 1 -- 172.21.15.6:0/1389440843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c3c156600 msgr2=0x7f7c3c0c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.608+0000 7f7c3bfff700 1 --2- 172.21.15.6:0/1389440843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c3c156600 0x7f7c3c0c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.608+0000 7f7c3bfff700 1 -- 172.21.15.6:0/1389440843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c3c1569d0 msgr2=0x7f7c3c0b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.608+0000 7f7c3bfff700 1 --2- 172.21.15.6:0/1389440843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c3c1569d0 0x7f7c3c0b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.608+0000 7f7c3bfff700 1 -- 172.21.15.6:0/1389440843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0c5790 con 0x7f7c3c0b5c50 2023-10-06T02:24:16.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.608+0000 7f7c3b7fe700 1 --2- 172.21.15.6:0/1389440843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c3c156600 0x7f7c3c0c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:16.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.608+0000 7f7c3bfff700 1 --2- 172.21.15.6:0/1389440843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c3c0b5c50 0x7f7c3c154a20 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f7c34002230 tx=0x7f7c3401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:16.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.608+0000 7f7c237fe700 1 -- 172.21.15.6:0/1389440843 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3401d630 con 0x7f7c3c0b5c50 2023-10-06T02:24:16.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.608+0000 7f7c237fe700 1 -- 172.21.15.6:0/1389440843 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3401d790 con 0x7f7c3c0b5c50 2023-10-06T02:24:16.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.608+0000 7f7c237fe700 1 -- 172.21.15.6:0/1389440843 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3401db50 con 0x7f7c3c0b5c50 2023-10-06T02:24:16.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.608+0000 7f7c41c73700 1 -- 172.21.15.6:0/1389440843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3c0c5a30 con 0x7f7c3c0b5c50 2023-10-06T02:24:16.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.608+0000 7f7c41c73700 1 -- 172.21.15.6:0/1389440843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c0c5ff0 con 0x7f7c3c0b5c50 2023-10-06T02:24:16.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.609+0000 7f7c237fe700 1 -- 172.21.15.6:0/1389440843 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c34003040 con 0x7f7c3c0b5c50 2023-10-06T02:24:16.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.610+0000 7f7c237fe700 1 --2- 172.21.15.6:0/1389440843 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c28066f30 0x7f7c280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.610+0000 7f7c237fe700 1 -- 172.21.15.6:0/1389440843 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7c34085db0 con 0x7f7c3c0b5c50 2023-10-06T02:24:16.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.610+0000 7f7c3b7fe700 1 --2- 172.21.15.6:0/1389440843 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c28066f30 0x7f7c280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.611+0000 7f7c3b7fe700 1 --2- 172.21.15.6:0/1389440843 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c28066f30 0x7f7c280693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0010e0 tx=0x7f7c2c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:16.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.612+0000 7f7c4af6bb80 1 Processor -- start 2023-10-06T02:24:16.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.612+0000 7f7c4af6bb80 1 -- start start 2023-10-06T02:24:16.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c4af6bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c4af6bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac3cecc0 0x55c0ac41d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c4af6bb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac41dc00 0x55c0ac41e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c4af6bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ac324a70 con 0x55c0ac3cd840 2023-10-06T02:24:16.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c4af6bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ac322270 con 0x55c0ac3cecc0 2023-10-06T02:24:16.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c4af6bb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0ac31e060 con 0x55c0ac41dc00 2023-10-06T02:24:16.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c3b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c3b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38908/0 (socket says 172.21.15.6:38908) 2023-10-06T02:24:16.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c3b7fe700 1 -- 172.21.15.6:0/1004320718 learned_addr learned my addr 172.21.15.6:0/1004320718 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:16.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c3affd700 1 --2- 172.21.15.6:0/1004320718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac3cecc0 0x55c0ac41d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c3bfff700 1 --2- 172.21.15.6:0/1004320718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac41dc00 0x55c0ac41e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c3b7fe700 1 -- 172.21.15.6:0/1004320718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac41dc00 msgr2=0x55c0ac41e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c3b7fe700 1 --2- 172.21.15.6:0/1004320718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac41dc00 0x55c0ac41e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c3b7fe700 1 -- 172.21.15.6:0/1004320718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac3cecc0 msgr2=0x55c0ac41d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c3b7fe700 1 --2- 172.21.15.6:0/1004320718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac3cecc0 0x55c0ac41d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c3b7fe700 1 -- 172.21.15.6:0/1004320718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0ac1b8270 con 0x55c0ac3cd840 2023-10-06T02:24:16.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c3bfff700 1 --2- 172.21.15.6:0/1004320718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac41dc00 0x55c0ac41e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:16.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c3b7fe700 1 --2- 172.21.15.6:0/1004320718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3cdc10 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0073d0 tx=0x7f7c2c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b751a61045973b80 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:16.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c20ff9700 1 -- 172.21.15.6:0/1004320718 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c007bc0 con 0x55c0ac3cd840 2023-10-06T02:24:16.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c20ff9700 1 -- 172.21.15.6:0/1004320718 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c0158f0 con 0x55c0ac3cd840 2023-10-06T02:24:16.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.613+0000 7f7c20ff9700 1 -- 172.21.15.6:0/1004320718 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c015c70 con 0x55c0ac3cd840 2023-10-06T02:24:16.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.614+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/1004320718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 msgr2=0x55c0ac3cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.614+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/1004320718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3cdc10 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0073d0 tx=0x7f7c2c016000 comp rx=0 tx=0).stop 2023-10-06T02:24:16.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.614+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/1004320718 shutdown_connections 2023-10-06T02:24:16.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.614+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/1004320718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac41dc00 0x55c0ac41e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.614+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/1004320718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3cdc10 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.614+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/1004320718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac3cecc0 0x55c0ac41d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.614+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/1004320718 >> 172.21.15.6:0/1004320718 conn(0x55c0ac3cf160 msgr2=0x55c0ac3cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:16.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.614+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/1004320718 shutdown_connections 2023-10-06T02:24:16.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.614+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/1004320718 wait complete. 2023-10-06T02:24:16.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.615+0000 7f7c4af6bb80 1 -- start start 2023-10-06T02:24:16.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.615+0000 7f7c4af6bb80 1 Processor -- start 2023-10-06T02:24:16.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c4af6bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c4af6bb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac3cecc0 0x55c0ac3f8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c4af6bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac41dc00 0x55c0ac3f9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c4af6bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ac2c9890 con 0x55c0ac3cd840 2023-10-06T02:24:16.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c4af6bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ac2e4ea0 con 0x55c0ac41dc00 2023-10-06T02:24:16.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c4af6bb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0ac1a0e30 con 0x55c0ac3cecc0 2023-10-06T02:24:16.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c4af6bb80 10 client.0 _ll_register_callbacks cb 0x55c0ac390e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:24:16.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c3b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c3b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3f87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38922/0 (socket says 172.21.15.6:38922) 2023-10-06T02:24:16.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c3b7fe700 1 -- 172.21.15.6:0/2004698526 learned_addr learned my addr 172.21.15.6:0/2004698526 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:16.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c3bfff700 1 --2- 172.21.15.6:0/2004698526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac41dc00 0x55c0ac3f9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c3affd700 1 --2- 172.21.15.6:0/2004698526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac3cecc0 0x55c0ac3f8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c3b7fe700 1 -- 172.21.15.6:0/2004698526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac3cecc0 msgr2=0x55c0ac3f8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c3b7fe700 1 --2- 172.21.15.6:0/2004698526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac3cecc0 0x55c0ac3f8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c3b7fe700 1 -- 172.21.15.6:0/2004698526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac41dc00 msgr2=0x55c0ac3f9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c3b7fe700 1 --2- 172.21.15.6:0/2004698526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac41dc00 0x55c0ac3f9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c3b7fe700 1 -- 172.21.15.6:0/2004698526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c00f040 con 0x55c0ac3cd840 2023-10-06T02:24:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c3affd700 1 --2- 172.21.15.6:0/2004698526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac3cecc0 0x55c0ac3f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c3b7fe700 1 --2- 172.21.15.6:0/2004698526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3f87e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009010 tx=0x7f7c2c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d5e27fcabc09b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c19ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:24:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c19ffb700 1 -- 172.21.15.6:0/2004698526 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c0216f0 con 0x55c0ac3cd840 2023-10-06T02:24:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c19ffb700 1 -- 172.21.15.6:0/2004698526 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7c2c01d040 con 0x55c0ac3cd840 2023-10-06T02:24:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/2004698526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c0ac3c2940 con 0x55c0ac3cd840 2023-10-06T02:24:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c19ffb700 1 -- 172.21.15.6:0/2004698526 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c2c021a60 con 0x55c0ac3cd840 2023-10-06T02:24:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.616+0000 7f7c4af6bb80 10 client.7065 fetch_fsmap learned FSMap version 77 2023-10-06T02:24:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.617+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/2004698526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x55c0ac15afe0 con 0x55c0ac3cd840 2023-10-06T02:24:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.617+0000 7f7c19ffb700 1 -- 172.21.15.6:0/2004698526 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c0ac3c2940 con 0x55c0ac3cd840 2023-10-06T02:24:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.617+0000 7f7c19ffb700 1 -- 172.21.15.6:0/2004698526 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 77) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7c2c021bc0 con 0x55c0ac3cd840 2023-10-06T02:24:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.617+0000 7f7c4af6bb80 10 client.7065 fetch_fsmap finished waiting for FSMap version 77 2023-10-06T02:24:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.617+0000 7f7c4af6bb80 10 client.7065 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:24:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.617+0000 7f7c4af6bb80 20 client.7065 populate_metadata read hostname 'smithi006' 2023-10-06T02:24:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.617+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/2004698526 >> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] conn(0x55c0ac4150e0 0x55c0ac4154b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.617+0000 7f7c4af6bb80 4 client.7065 mds_command: new command op to 6786 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:24:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.617+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/2004698526 --> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c0ac39f870 con 0x55c0ac4150e0 2023-10-06T02:24:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.617+0000 7f7c3affd700 1 --2- 172.21.15.6:0/2004698526 >> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] conn(0x55c0ac4150e0 0x55c0ac4154b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.617+0000 7f7c19ffb700 10 client.7065 ms_handle_connect on v2:172.21.15.6:6832/353268974 2023-10-06T02:24:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.617+0000 7f7c3affd700 1 --2- 172.21.15.6:0/2004698526 >> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] conn(0x55c0ac4150e0 0x55c0ac4154b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77799fc845ed8c41 server_cookie=dd78c352d0df62a8 in_seq=0 out_seq=0 2023-10-06T02:24:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.618+0000 7f7c19ffb700 1 -- 172.21.15.6:0/2004698526 <== mds.0 v2:172.21.15.6:6832/353268974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c0ac39f870 con 0x55c0ac4150e0 2023-10-06T02:24:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.618+0000 7f7c19ffb700 10 client.7065 handle_command_reply: tid=0 2023-10-06T02:24:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.618+0000 7f7c4af6bb80 1 client.7065 shutdown 2023-10-06T02:24:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.618+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/2004698526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 msgr2=0x55c0ac3f87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.618+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/2004698526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3f87e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009010 tx=0x7f7c2c01a000 comp rx=0 tx=0).stop 2023-10-06T02:24:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.618+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/2004698526 shutdown_connections 2023-10-06T02:24:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.618+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/2004698526 >> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] conn(0x55c0ac4150e0 0x55c0ac4154b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.618+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/2004698526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac41dc00 0x55c0ac3f9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.618+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/2004698526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3f87e0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.618+0000 7f7c19ffb700 0 client.7065 ms_handle_reset on v2:172.21.15.6:6832/353268974 2023-10-06T02:24:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.618+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/2004698526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac3cecc0 0x55c0ac3f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.618+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/2004698526 >> 172.21.15.6:0/2004698526 conn(0x55c0ac3cf160 msgr2=0x55c0ac3ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.618+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/2004698526 shutdown_connections 2023-10-06T02:24:16.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.618+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/2004698526 wait complete. 2023-10-06T02:24:16.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.618+0000 7f7c4af6bb80 20 client.7065 trim_cache size 0 max 16384 2023-10-06T02:24:16.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.635+0000 7f7c4af6bb80 1 Processor -- start 2023-10-06T02:24:16.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.635+0000 7f7c4af6bb80 1 -- start start 2023-10-06T02:24:16.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.636+0000 7f7c4af6bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3fdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.636+0000 7f7c4af6bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac3cecc0 0x55c0ac3ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.636+0000 7f7c4af6bb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac41dc00 0x55c0ac4116f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.636+0000 7f7c4af6bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ac3d00a0 con 0x55c0ac3cd840 2023-10-06T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.636+0000 7f7c4af6bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ac3faf60 con 0x55c0ac3cecc0 2023-10-06T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.636+0000 7f7c4af6bb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0ac42d900 con 0x55c0ac41dc00 2023-10-06T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.636+0000 7f7c3b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3fdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.636+0000 7f7c3b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3fdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38926/0 (socket says 172.21.15.6:38926) 2023-10-06T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.636+0000 7f7c3b7fe700 1 -- 172.21.15.6:0/281164777 learned_addr learned my addr 172.21.15.6:0/281164777 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.636+0000 7f7c3bfff700 1 --2- 172.21.15.6:0/281164777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac41dc00 0x55c0ac4116f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.636+0000 7f7c3affd700 1 --2- 172.21.15.6:0/281164777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac3cecc0 0x55c0ac3ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.636+0000 7f7c3b7fe700 1 -- 172.21.15.6:0/281164777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac41dc00 msgr2=0x55c0ac4116f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.636+0000 7f7c3b7fe700 1 --2- 172.21.15.6:0/281164777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac41dc00 0x55c0ac4116f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.636+0000 7f7c3b7fe700 1 -- 172.21.15.6:0/281164777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac3cecc0 msgr2=0x55c0ac3ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.636+0000 7f7c3b7fe700 1 --2- 172.21.15.6:0/281164777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac3cecc0 0x55c0ac3ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.636+0000 7f7c3b7fe700 1 -- 172.21.15.6:0/281164777 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0ac2ec780 con 0x55c0ac3cd840 2023-10-06T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.637+0000 7f7c3b7fe700 1 --2- 172.21.15.6:0/281164777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3fdb70 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0158c0 tx=0x7f7c2c02a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2ef9f1e57b737d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.637+0000 7f7c217fa700 1 -- 172.21.15.6:0/281164777 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c021620 con 0x55c0ac3cd840 2023-10-06T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.637+0000 7f7c217fa700 1 -- 172.21.15.6:0/281164777 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c021a60 con 0x55c0ac3cd840 2023-10-06T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.637+0000 7f7c217fa700 1 -- 172.21.15.6:0/281164777 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c02a400 con 0x55c0ac3cd840 2023-10-06T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.637+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/281164777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 msgr2=0x55c0ac3fdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.637+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/281164777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3fdb70 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0158c0 tx=0x7f7c2c02a000 comp rx=0 tx=0).stop 2023-10-06T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.637+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/281164777 shutdown_connections 2023-10-06T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.637+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/281164777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac41dc00 0x55c0ac4116f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.637+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/281164777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cd840 0x55c0ac3fdb70 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.637+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/281164777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac3cecc0 0x55c0ac3ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.637+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/281164777 >> 172.21.15.6:0/281164777 conn(0x55c0ac3cf160 msgr2=0x55c0ac3c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.637+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/281164777 shutdown_connections 2023-10-06T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.637+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/281164777 wait complete. 2023-10-06T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.638+0000 7f7c4af6bb80 1 -- start start 2023-10-06T02:24:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.638+0000 7f7c4af6bb80 1 Processor -- start 2023-10-06T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c4af6bb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac3cd840 0x55c0ac4738f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c4af6bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cecc0 0x55c0ac3cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c4af6bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac41dc00 0x55c0ac3ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c4af6bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ac40df00 con 0x55c0ac3cecc0 2023-10-06T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c4af6bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ac41bc60 con 0x55c0ac41dc00 2023-10-06T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c4af6bb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0ac40dcb0 con 0x55c0ac3cd840 2023-10-06T02:24:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c4af6bb80 10 client.0 _ll_register_callbacks cb 0x55c0ac390e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c3affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cecc0 0x55c0ac3cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c3affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cecc0 0x55c0ac3cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38940/0 (socket says 172.21.15.6:38940) 2023-10-06T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c3affd700 1 -- 172.21.15.6:0/3539404607 learned_addr learned my addr 172.21.15.6:0/3539404607 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c3b7fe700 1 --2- 172.21.15.6:0/3539404607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac3cd840 0x55c0ac4738f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c3bfff700 1 --2- 172.21.15.6:0/3539404607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac41dc00 0x55c0ac3ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c3affd700 1 -- 172.21.15.6:0/3539404607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac3cd840 msgr2=0x55c0ac4738f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c3affd700 1 --2- 172.21.15.6:0/3539404607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac3cd840 0x55c0ac4738f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c3affd700 1 -- 172.21.15.6:0/3539404607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac41dc00 msgr2=0x55c0ac3ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c3affd700 1 --2- 172.21.15.6:0/3539404607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac41dc00 0x55c0ac3ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c3affd700 1 -- 172.21.15.6:0/3539404607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0ac15afe0 con 0x55c0ac3cecc0 2023-10-06T02:24:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c3bfff700 1 --2- 172.21.15.6:0/3539404607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac41dc00 0x55c0ac3ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c3affd700 1 --2- 172.21.15.6:0/3539404607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cecc0 0x55c0ac3cdfd0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0b3610 tx=0x7f7c30007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b602b5707fa3cbe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c19ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:24:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c19ffb700 1 -- 172.21.15.6:0/3539404607 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c300205c0 con 0x55c0ac3cecc0 2023-10-06T02:24:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c19ffb700 1 -- 172.21.15.6:0/3539404607 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7c30022e00 con 0x55c0ac3cecc0 2023-10-06T02:24:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.639+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/3539404607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c2c0158f0 con 0x55c0ac3cecc0 2023-10-06T02:24:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.640+0000 7f7c19ffb700 1 -- 172.21.15.6:0/3539404607 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c30020930 con 0x55c0ac3cecc0 2023-10-06T02:24:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.640+0000 7f7c4af6bb80 10 client.7071 fetch_fsmap learned FSMap version 77 2023-10-06T02:24:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.640+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/3539404607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x55c0ac2d3470 con 0x55c0ac3cecc0 2023-10-06T02:24:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.640+0000 7f7c19ffb700 1 -- 172.21.15.6:0/3539404607 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c0158f0 con 0x55c0ac3cecc0 2023-10-06T02:24:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.640+0000 7f7c19ffb700 1 -- 172.21.15.6:0/3539404607 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 77) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7c30020a90 con 0x55c0ac3cecc0 2023-10-06T02:24:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.640+0000 7f7c4af6bb80 10 client.7071 fetch_fsmap finished waiting for FSMap version 77 2023-10-06T02:24:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.640+0000 7f7c4af6bb80 10 client.7071 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:24:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.640+0000 7f7c4af6bb80 20 client.7071 populate_metadata read hostname 'smithi006' 2023-10-06T02:24:16.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.640+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/3539404607 >> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] conn(0x55c0ac3f5bb0 0x55c0ac3f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.640+0000 7f7c4af6bb80 4 client.7071 mds_command: new command op to 6786 tid=0[{"prefix": "status"}] 2023-10-06T02:24:16.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.640+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/3539404607 --> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c0ac2c0e00 con 0x55c0ac3f5bb0 2023-10-06T02:24:16.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.640+0000 7f7c3b7fe700 1 --2- 172.21.15.6:0/3539404607 >> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] conn(0x55c0ac3f5bb0 0x55c0ac3f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.640+0000 7f7c19ffb700 10 client.7071 ms_handle_connect on v2:172.21.15.6:6832/353268974 2023-10-06T02:24:16.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.640+0000 7f7c3b7fe700 1 --2- 172.21.15.6:0/3539404607 >> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] conn(0x55c0ac3f5bb0 0x55c0ac3f5f80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e52e81c40bdc8be0 server_cookie=29dd15d33c13f63b in_seq=0 out_seq=0 2023-10-06T02:24:16.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.640+0000 7f7c19ffb700 1 -- 172.21.15.6:0/3539404607 <== mds.0 v2:172.21.15.6:6832/353268974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55c0ac2c0e00 con 0x55c0ac3f5bb0 2023-10-06T02:24:16.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.640+0000 7f7c19ffb700 10 client.7071 handle_command_reply: tid=0 2023-10-06T02:24:16.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.640+0000 7f7c4af6bb80 1 client.7071 shutdown 2023-10-06T02:24:16.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/3539404607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cecc0 msgr2=0x55c0ac3cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/3539404607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cecc0 0x55c0ac3cdfd0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0b3610 tx=0x7f7c30007d10 comp rx=0 tx=0).stop 2023-10-06T02:24:16.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/3539404607 shutdown_connections 2023-10-06T02:24:16.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/3539404607 >> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] conn(0x55c0ac3f5bb0 0x55c0ac3f5f80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/3539404607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0ac41dc00 0x55c0ac3ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/3539404607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c0ac3cd840 0x55c0ac4738f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c4af6bb80 1 --2- 172.21.15.6:0/3539404607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0ac3cecc0 0x55c0ac3cdfd0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c19ffb700 0 client.7071 ms_handle_reset on v2:172.21.15.6:6832/353268974 2023-10-06T02:24:16.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/3539404607 >> 172.21.15.6:0/3539404607 conn(0x55c0ac3cf160 msgr2=0x55c0ac412f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:16.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/3539404607 shutdown_connections 2023-10-06T02:24:16.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c4af6bb80 1 -- 172.21.15.6:0/3539404607 wait complete. 2023-10-06T02:24:16.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c4af6bb80 20 client.7071 trim_cache size 0 max 16384 2023-10-06T02:24:16.649 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:24:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:24:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:24:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 6786, 2023-10-06T02:24:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:24:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:24:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:24:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 4.7840075610000001, 2023-10-06T02:24:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 77, 2023-10-06T02:24:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 83, 2023-10-06T02:24:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 83, 2023-10-06T02:24:16.650 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 43.713435791000002 2023-10-06T02:24:16.650 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:24:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c41c73700 1 -- 172.21.15.6:0/1389440843 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c28066f30 msgr2=0x7f7c280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c41c73700 1 --2- 172.21.15.6:0/1389440843 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c28066f30 0x7f7c280693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0010e0 tx=0x7f7c2c009040 comp rx=0 tx=0).stop 2023-10-06T02:24:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c41c73700 1 -- 172.21.15.6:0/1389440843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c3c0b5c50 msgr2=0x7f7c3c154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c41c73700 1 --2- 172.21.15.6:0/1389440843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c3c0b5c50 0x7f7c3c154a20 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f7c34002230 tx=0x7f7c3401a000 comp rx=0 tx=0).stop 2023-10-06T02:24:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c41c73700 1 -- 172.21.15.6:0/1389440843 shutdown_connections 2023-10-06T02:24:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c41c73700 1 --2- 172.21.15.6:0/1389440843 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c28066f30 0x7f7c280693e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c41c73700 1 --2- 172.21.15.6:0/1389440843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c3c0b5c50 0x7f7c3c154a20 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c41c73700 1 --2- 172.21.15.6:0/1389440843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c3c156600 0x7f7c3c0c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c41c73700 1 --2- 172.21.15.6:0/1389440843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c3c1569d0 0x7f7c3c0b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c41c73700 1 -- 172.21.15.6:0/1389440843 >> 172.21.15.6:0/1389440843 conn(0x7f7c3c068680 msgr2=0x7f7c3c0cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c41c73700 1 -- 172.21.15.6:0/1389440843 shutdown_connections 2023-10-06T02:24:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.641+0000 7f7c41c73700 1 -- 172.21.15.6:0/1389440843 wait complete. 2023-10-06T02:24:16.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:16.653 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat a/ && find a/') 2023-10-06T02:24:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: File: a/ 2023-10-06T02:24:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 0 Blocks: 1 IO Block: 4096 directory 2023-10-06T02:24:16.684 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 2fh/47d Inode: 1099511627776 Links: 4 2023-10-06T02:24:16.684 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0775/drwxrwxr-x) Uid: ( 1000/ ubuntu) Gid: ( 1275/ ubuntu) 2023-10-06T02:24:16.684 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:fusefs_t:s0 2023-10-06T02:24:16.684 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-10-06 02:23:48.111157139 +0000 2023-10-06T02:24:16.684 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-10-06 02:23:53.734304747 +0000 2023-10-06T02:24:16.684 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-10-06 02:23:53.734304747 +0000 2023-10-06T02:24:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-10-06T02:24:16.696 INFO:teuthology.orchestra.run.smithi006.stdout:a/ 2023-10-06T02:24:16.696 INFO:teuthology.orchestra.run.smithi006.stdout:a/z 2023-10-06T02:24:16.696 INFO:teuthology.orchestra.run.smithi006.stdout:a/z/d 2023-10-06T02:24:16.696 INFO:teuthology.orchestra.run.smithi006.stdout:a/c 2023-10-06T02:24:16.697 INFO:teuthology.orchestra.run.smithi006.stdout:a/c/d 2023-10-06T02:24:16.697 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 flush journal 2023-10-06T02:24:16.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.859+0000 7f0d48a4c700 1 Processor -- start 2023-10-06T02:24:16.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.859+0000 7f0d48a4c700 1 -- start start 2023-10-06T02:24:16.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.860+0000 7f0d48a4c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d440cd400 0x7f0d440b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.860+0000 7f0d48a4c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d440cd7d0 0x7f0d440b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.860+0000 7f0d48a4c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d440b29a0 con 0x7f0d440b0810 2023-10-06T02:24:16.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.860+0000 7f0d48a4c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d440af770 con 0x7f0d440cd7d0 2023-10-06T02:24:16.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.860+0000 7f0d48a4c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440afa50 con 0x7f0d440cd400 2023-10-06T02:24:16.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.860+0000 7f0d42ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d440cd7d0 0x7f0d440b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.860+0000 7f0d42ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d440cd7d0 0x7f0d440b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38944/0 (socket says 172.21.15.6:38944) 2023-10-06T02:24:16.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.860+0000 7f0d42ffd700 1 -- 172.21.15.6:0/1542240743 learned_addr learned my addr 172.21.15.6:0/1542240743 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:16.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.860+0000 7f0d437fe700 1 --2- 172.21.15.6:0/1542240743 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d440cd400 0x7f0d440b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.861+0000 7f0d42ffd700 1 -- 172.21.15.6:0/1542240743 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d440cd400 msgr2=0x7f0d440b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.861+0000 7f0d42ffd700 1 --2- 172.21.15.6:0/1542240743 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d440cd400 0x7f0d440b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.861+0000 7f0d42ffd700 1 -- 172.21.15.6:0/1542240743 >> v1:172.21.15.175:6789/0 conn(0x7f0d440b0810 legacy=0x7f0d440d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.861+0000 7f0d42ffd700 1 -- 172.21.15.6:0/1542240743 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d440afd30 con 0x7f0d440cd7d0 2023-10-06T02:24:16.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.861+0000 7f0d42ffd700 1 --2- 172.21.15.6:0/1542240743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d440cd7d0 0x7f0d440b2460 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0d340099b0 tx=0x7f0d34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34777afc4ea1be7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:16.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.861+0000 7f0d427fc700 1 -- 172.21.15.6:0/1542240743 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3400b860 con 0x7f0d440cd7d0 2023-10-06T02:24:16.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.861+0000 7f0d427fc700 1 -- 172.21.15.6:0/1542240743 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3400b9c0 con 0x7f0d440cd7d0 2023-10-06T02:24:16.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.861+0000 7f0d427fc700 1 -- 172.21.15.6:0/1542240743 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3400bd80 con 0x7f0d440cd7d0 2023-10-06T02:24:16.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.861+0000 7f0d48a4c700 1 -- 172.21.15.6:0/1542240743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d440cd7d0 msgr2=0x7f0d440b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.861+0000 7f0d48a4c700 1 --2- 172.21.15.6:0/1542240743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d440cd7d0 0x7f0d440b2460 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0d340099b0 tx=0x7f0d34009250 comp rx=0 tx=0).stop 2023-10-06T02:24:16.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.861+0000 7f0d48a4c700 1 -- 172.21.15.6:0/1542240743 shutdown_connections 2023-10-06T02:24:16.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.861+0000 7f0d48a4c700 1 --2- 172.21.15.6:0/1542240743 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d440cd400 0x7f0d440b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.861+0000 7f0d48a4c700 1 --2- 172.21.15.6:0/1542240743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d440cd7d0 0x7f0d440b2460 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.862+0000 7f0d48a4c700 1 -- 172.21.15.6:0/1542240743 >> 172.21.15.6:0/1542240743 conn(0x7f0d4406a110 msgr2=0x7f0d4406a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:16.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.862+0000 7f0d48a4c700 1 -- 172.21.15.6:0/1542240743 shutdown_connections 2023-10-06T02:24:16.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.862+0000 7f0d48a4c700 1 -- 172.21.15.6:0/1542240743 wait complete. 2023-10-06T02:24:16.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.863+0000 7f0d48a4c700 1 Processor -- start 2023-10-06T02:24:16.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.863+0000 7f0d48a4c700 1 -- start start 2023-10-06T02:24:16.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.863+0000 7f0d48a4c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d440b0810 0x7f0d44157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.863+0000 7f0d48a4c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d440cd400 0x7f0d440c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.863+0000 7f0d48a4c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d44157d90 0x7f0d440c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d48a4c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d44152800 con 0x7f0d440b0810 2023-10-06T02:24:16.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d48a4c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d44158ab0 con 0x7f0d440cd400 2023-10-06T02:24:16.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d48a4c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d44158210 con 0x7f0d44157d90 2023-10-06T02:24:16.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d440b0810 0x7f0d44157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d440b0810 0x7f0d44157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38946/0 (socket says 172.21.15.6:38946) 2023-10-06T02:24:16.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d437fe700 1 -- 172.21.15.6:0/1490253264 learned_addr learned my addr 172.21.15.6:0/1490253264 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:16.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d42ffd700 1 --2- 172.21.15.6:0/1490253264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d440cd400 0x7f0d440c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d43fff700 1 --2- 172.21.15.6:0/1490253264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d44157d90 0x7f0d440c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d437fe700 1 -- 172.21.15.6:0/1490253264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d44157d90 msgr2=0x7f0d440c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d437fe700 1 --2- 172.21.15.6:0/1490253264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d44157d90 0x7f0d440c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d437fe700 1 -- 172.21.15.6:0/1490253264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d440cd400 msgr2=0x7f0d440c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d437fe700 1 --2- 172.21.15.6:0/1490253264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d440cd400 0x7f0d440c7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d437fe700 1 -- 172.21.15.6:0/1490253264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d340094f0 con 0x7f0d440b0810 2023-10-06T02:24:16.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d43fff700 1 --2- 172.21.15.6:0/1490253264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d44157d90 0x7f0d440c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:16.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d437fe700 1 --2- 172.21.15.6:0/1490253264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d440b0810 0x7f0d44157850 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00d810 tx=0x7f0d2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:16.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d3b7fe700 1 -- 172.21.15.6:0/1490253264 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0125f0 con 0x7f0d440b0810 2023-10-06T02:24:16.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d3b7fe700 1 -- 172.21.15.6:0/1490253264 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c012750 con 0x7f0d440b0810 2023-10-06T02:24:16.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d48a4c700 1 -- 172.21.15.6:0/1490253264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d441584f0 con 0x7f0d440b0810 2023-10-06T02:24:16.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d3b7fe700 1 -- 172.21.15.6:0/1490253264 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c012af0 con 0x7f0d440b0810 2023-10-06T02:24:16.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.864+0000 7f0d48a4c700 1 -- 172.21.15.6:0/1490253264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4414e950 con 0x7f0d440b0810 2023-10-06T02:24:16.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.866+0000 7f0d3b7fe700 1 -- 172.21.15.6:0/1490253264 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d2c01e460 con 0x7f0d440b0810 2023-10-06T02:24:16.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.866+0000 7f0d3b7fe700 1 --2- 172.21.15.6:0/1490253264 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0d24066f30 0x7f0d240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.866+0000 7f0d3b7fe700 1 -- 172.21.15.6:0/1490253264 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f0d2c084e80 con 0x7f0d440b0810 2023-10-06T02:24:16.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.866+0000 7f0d42ffd700 1 --2- 172.21.15.6:0/1490253264 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0d24066f30 0x7f0d240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.867+0000 7f0d42ffd700 1 --2- 172.21.15.6:0/1490253264 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0d24066f30 0x7f0d240693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0d340099b0 tx=0x7f0d34017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:16.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.868+0000 7f0d52fa6b80 1 Processor -- start 2023-10-06T02:24:16.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.868+0000 7f0d52fa6b80 1 -- start start 2023-10-06T02:24:16.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.869+0000 7f0d52fa6b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8383ea0 0x5578f835ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.869+0000 7f0d52fa6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8364310 0x5578f835f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.869+0000 7f0d52fa6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8365a60 0x5578f835f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.869+0000 7f0d52fa6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578f82b9ac0 con 0x5578f8364310 2023-10-06T02:24:16.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.869+0000 7f0d52fa6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578f82b72c0 con 0x5578f8365a60 2023-10-06T02:24:16.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.869+0000 7f0d52fa6b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578f82b30b0 con 0x5578f8383ea0 2023-10-06T02:24:16.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.869+0000 7f0d42ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8364310 0x5578f835f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.869+0000 7f0d42ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8364310 0x5578f835f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38960/0 (socket says 172.21.15.6:38960) 2023-10-06T02:24:16.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.869+0000 7f0d42ffd700 1 -- 172.21.15.6:0/2331901495 learned_addr learned my addr 172.21.15.6:0/2331901495 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:16.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.869+0000 7f0d43fff700 1 --2- 172.21.15.6:0/2331901495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8365a60 0x5578f835f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.869+0000 7f0d437fe700 1 --2- 172.21.15.6:0/2331901495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8383ea0 0x5578f835ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.869+0000 7f0d42ffd700 1 -- 172.21.15.6:0/2331901495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8383ea0 msgr2=0x5578f835ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.869+0000 7f0d42ffd700 1 --2- 172.21.15.6:0/2331901495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8383ea0 0x5578f835ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.869+0000 7f0d42ffd700 1 -- 172.21.15.6:0/2331901495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8365a60 msgr2=0x5578f835f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.869+0000 7f0d42ffd700 1 --2- 172.21.15.6:0/2331901495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8365a60 0x5578f835f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.869+0000 7f0d42ffd700 1 -- 172.21.15.6:0/2331901495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578f814d2c0 con 0x5578f8364310 2023-10-06T02:24:16.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.870+0000 7f0d42ffd700 1 --2- 172.21.15.6:0/2331901495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8364310 0x5578f835f250 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400b3c0 tx=0x7f0d34022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fb02db8d06e736 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:16.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.870+0000 7f0d38ff9700 1 -- 172.21.15.6:0/2331901495 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34011880 con 0x5578f8364310 2023-10-06T02:24:16.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.870+0000 7f0d38ff9700 1 -- 172.21.15.6:0/2331901495 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d34021040 con 0x5578f8364310 2023-10-06T02:24:16.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.870+0000 7f0d38ff9700 1 -- 172.21.15.6:0/2331901495 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34011bf0 con 0x5578f8364310 2023-10-06T02:24:16.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.870+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/2331901495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8364310 msgr2=0x5578f835f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.870+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/2331901495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8364310 0x5578f835f250 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400b3c0 tx=0x7f0d34022000 comp rx=0 tx=0).stop 2023-10-06T02:24:16.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.870+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/2331901495 shutdown_connections 2023-10-06T02:24:16.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.870+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/2331901495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8365a60 0x5578f835f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.870+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/2331901495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8383ea0 0x5578f835ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.870+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/2331901495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8364310 0x5578f835f250 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.870+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/2331901495 >> 172.21.15.6:0/2331901495 conn(0x5578f8363ed0 msgr2=0x5578f8364700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:16.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.871+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/2331901495 shutdown_connections 2023-10-06T02:24:16.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.871+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/2331901495 wait complete. 2023-10-06T02:24:16.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.871+0000 7f0d52fa6b80 1 -- start start 2023-10-06T02:24:16.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.871+0000 7f0d52fa6b80 1 Processor -- start 2023-10-06T02:24:16.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d52fa6b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8364310 0x5578f838bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d52fa6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8365a60 0x5578f8359c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d52fa6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8383ea0 0x5578f8384270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d52fa6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578f825e8e0 con 0x5578f8365a60 2023-10-06T02:24:16.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d52fa6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578f8279ef0 con 0x5578f8383ea0 2023-10-06T02:24:16.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d52fa6b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578f8135e80 con 0x5578f8364310 2023-10-06T02:24:16.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d52fa6b80 10 client.0 _ll_register_callbacks cb 0x5578f8326070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:24:16.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d42ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8365a60 0x5578f8359c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d42ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8365a60 0x5578f8359c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38962/0 (socket says 172.21.15.6:38962) 2023-10-06T02:24:16.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d42ffd700 1 -- 172.21.15.6:0/736421248 learned_addr learned my addr 172.21.15.6:0/736421248 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:16.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d43fff700 1 --2- 172.21.15.6:0/736421248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8383ea0 0x5578f8384270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d437fe700 1 --2- 172.21.15.6:0/736421248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8364310 0x5578f838bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d42ffd700 1 -- 172.21.15.6:0/736421248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8364310 msgr2=0x5578f838bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d42ffd700 1 --2- 172.21.15.6:0/736421248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8364310 0x5578f838bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d42ffd700 1 -- 172.21.15.6:0/736421248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8383ea0 msgr2=0x5578f8384270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d42ffd700 1 --2- 172.21.15.6:0/736421248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8383ea0 0x5578f8384270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d42ffd700 1 -- 172.21.15.6:0/736421248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d440afd30 con 0x5578f8365a60 2023-10-06T02:24:16.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.872+0000 7f0d43fff700 1 --2- 172.21.15.6:0/736421248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8383ea0 0x5578f8384270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:16.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.873+0000 7f0d42ffd700 1 --2- 172.21.15.6:0/736421248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8365a60 0x5578f8359c20 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0d34028000 tx=0x7f0d3402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f948377a036d7ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:16.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.873+0000 7f0d21ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:24:16.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.873+0000 7f0d21ffb700 1 -- 172.21.15.6:0/736421248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34038070 con 0x5578f8365a60 2023-10-06T02:24:16.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.873+0000 7f0d21ffb700 1 -- 172.21.15.6:0/736421248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f0d34011df0 con 0x5578f8365a60 2023-10-06T02:24:16.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.873+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/736421248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5578f8357990 con 0x5578f8365a60 2023-10-06T02:24:16.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.873+0000 7f0d21ffb700 1 -- 172.21.15.6:0/736421248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d340338a0 con 0x5578f8365a60 2023-10-06T02:24:16.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.873+0000 7f0d52fa6b80 10 client.7083 fetch_fsmap learned FSMap version 77 2023-10-06T02:24:16.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.873+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/736421248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x5578f80f0030 con 0x5578f8365a60 2023-10-06T02:24:16.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.873+0000 7f0d21ffb700 1 -- 172.21.15.6:0/736421248 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5578f8357990 con 0x5578f8365a60 2023-10-06T02:24:16.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.873+0000 7f0d21ffb700 1 -- 172.21.15.6:0/736421248 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 77) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0d34033a00 con 0x5578f8365a60 2023-10-06T02:24:16.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.873+0000 7f0d52fa6b80 10 client.7083 fetch_fsmap finished waiting for FSMap version 77 2023-10-06T02:24:16.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.873+0000 7f0d52fa6b80 10 client.7083 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-10-06T02:24:16.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.873+0000 7f0d52fa6b80 20 client.7083 populate_metadata read hostname 'smithi006' 2023-10-06T02:24:16.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.873+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/736421248 >> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] conn(0x5578f83ba7b0 0x5578f83bab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.873+0000 7f0d52fa6b80 4 client.7083 mds_command: new command op to 6786 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:24:16.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.873+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/736421248 --> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5578f83348c0 con 0x5578f83ba7b0 2023-10-06T02:24:16.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.873+0000 7f0d437fe700 1 --2- 172.21.15.6:0/736421248 >> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] conn(0x5578f83ba7b0 0x5578f83bab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.874+0000 7f0d437fe700 1 --2- 172.21.15.6:0/736421248 >> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] conn(0x5578f83ba7b0 0x5578f83bab80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c03ed3d938949d69 server_cookie=13fd3b005c683cf in_seq=0 out_seq=0 2023-10-06T02:24:16.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.874+0000 7f0d21ffb700 10 client.7083 ms_handle_connect on v2:172.21.15.6:6832/353268974 2023-10-06T02:24:16.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.874+0000 7f0d21ffb700 1 -- 172.21.15.6:0/736421248 <== mds.0 v2:172.21.15.6:6832/353268974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5578f83348c0 con 0x5578f83ba7b0 2023-10-06T02:24:16.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.874+0000 7f0d21ffb700 10 client.7083 handle_command_reply: tid=0 2023-10-06T02:24:16.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.874+0000 7f0d52fa6b80 1 client.7083 shutdown 2023-10-06T02:24:16.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.874+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/736421248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8365a60 msgr2=0x5578f8359c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.874+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/736421248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8365a60 0x5578f8359c20 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0d34028000 tx=0x7f0d3402c040 comp rx=0 tx=0).stop 2023-10-06T02:24:16.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.874+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/736421248 shutdown_connections 2023-10-06T02:24:16.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.874+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/736421248 >> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] conn(0x5578f83ba7b0 0x5578f83bab80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.874+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/736421248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8383ea0 0x5578f8384270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.874+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/736421248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8364310 0x5578f838bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.874+0000 7f0d21ffb700 0 client.7083 ms_handle_reset on v2:172.21.15.6:6832/353268974 2023-10-06T02:24:16.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.874+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/736421248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8365a60 0x5578f8359c20 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.874+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/736421248 >> 172.21.15.6:0/736421248 conn(0x5578f8363ed0 msgr2=0x5578f83ad030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:16.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.874+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/736421248 shutdown_connections 2023-10-06T02:24:16.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.874+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/736421248 wait complete. 2023-10-06T02:24:16.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.875+0000 7f0d52fa6b80 20 client.7083 trim_cache size 0 max 16384 2023-10-06T02:24:16.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.889+0000 7f0d52fa6b80 1 Processor -- start 2023-10-06T02:24:16.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.889+0000 7f0d52fa6b80 1 -- start start 2023-10-06T02:24:16.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d52fa6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8364310 0x5578f835fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d52fa6b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8365a60 0x5578f83b8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d52fa6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8383ea0 0x5578f835eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d52fa6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578f8383620 con 0x5578f8383ea0 2023-10-06T02:24:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d52fa6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578f8362350 con 0x5578f8364310 2023-10-06T02:24:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d52fa6b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578f83c24d0 con 0x5578f8365a60 2023-10-06T02:24:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d43fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8383ea0 0x5578f835eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d43fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8383ea0 0x5578f835eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38972/0 (socket says 172.21.15.6:38972) 2023-10-06T02:24:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d43fff700 1 -- 172.21.15.6:0/3887493543 learned_addr learned my addr 172.21.15.6:0/3887493543 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d437fe700 1 --2- 172.21.15.6:0/3887493543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8364310 0x5578f835fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d42ffd700 1 --2- 172.21.15.6:0/3887493543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8365a60 0x5578f83b8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d43fff700 1 -- 172.21.15.6:0/3887493543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8365a60 msgr2=0x5578f83b8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d43fff700 1 --2- 172.21.15.6:0/3887493543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8365a60 0x5578f83b8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d43fff700 1 -- 172.21.15.6:0/3887493543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8364310 msgr2=0x5578f835fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d43fff700 1 --2- 172.21.15.6:0/3887493543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8364310 0x5578f835fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d43fff700 1 -- 172.21.15.6:0/3887493543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578f82817d0 con 0x5578f8383ea0 2023-10-06T02:24:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d43fff700 1 --2- 172.21.15.6:0/3887493543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8383ea0 0x5578f835eb20 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c001c80 tx=0x7f0d3c003040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b32baf9727d140 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d397fa700 1 -- 172.21.15.6:0/3887493543 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c012820 con 0x5578f8383ea0 2023-10-06T02:24:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d397fa700 1 -- 172.21.15.6:0/3887493543 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3c012980 con 0x5578f8383ea0 2023-10-06T02:24:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.890+0000 7f0d397fa700 1 -- 172.21.15.6:0/3887493543 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c012d40 con 0x5578f8383ea0 2023-10-06T02:24:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.891+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/3887493543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8383ea0 msgr2=0x5578f835eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.891+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/3887493543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8383ea0 0x5578f835eb20 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c001c80 tx=0x7f0d3c003040 comp rx=0 tx=0).stop 2023-10-06T02:24:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.891+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/3887493543 shutdown_connections 2023-10-06T02:24:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.891+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/3887493543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8383ea0 0x5578f835eb20 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.891+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/3887493543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8364310 0x5578f835fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.891+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/3887493543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8365a60 0x5578f83b8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.891+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/3887493543 >> 172.21.15.6:0/3887493543 conn(0x5578f8363ed0 msgr2=0x5578f83ab920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.891+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/3887493543 shutdown_connections 2023-10-06T02:24:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.891+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/3887493543 wait complete. 2023-10-06T02:24:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.892+0000 7f0d52fa6b80 1 -- start start 2023-10-06T02:24:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.892+0000 7f0d52fa6b80 1 Processor -- start 2023-10-06T02:24:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.892+0000 7f0d52fa6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8364310 0x5578f8362760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.892+0000 7f0d52fa6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8365a60 0x5578f840e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.892+0000 7f0d52fa6b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8383ea0 0x5578f83ab920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d52fa6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578f840fc80 con 0x5578f8364310 2023-10-06T02:24:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d52fa6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578f838fa10 con 0x5578f8365a60 2023-10-06T02:24:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d52fa6b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578f835f870 con 0x5578f8383ea0 2023-10-06T02:24:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d52fa6b80 10 client.0 _ll_register_callbacks cb 0x5578f8326070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:24:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8364310 0x5578f8362760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8364310 0x5578f8362760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38986/0 (socket says 172.21.15.6:38986) 2023-10-06T02:24:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d437fe700 1 -- 172.21.15.6:0/2291805229 learned_addr learned my addr 172.21.15.6:0/2291805229 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d42ffd700 1 --2- 172.21.15.6:0/2291805229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8365a60 0x5578f840e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d43fff700 1 --2- 172.21.15.6:0/2291805229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8383ea0 0x5578f83ab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d437fe700 1 -- 172.21.15.6:0/2291805229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8383ea0 msgr2=0x5578f83ab920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d437fe700 1 --2- 172.21.15.6:0/2291805229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8383ea0 0x5578f83ab920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d437fe700 1 -- 172.21.15.6:0/2291805229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8365a60 msgr2=0x5578f840e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d437fe700 1 --2- 172.21.15.6:0/2291805229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8365a60 0x5578f840e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d437fe700 1 -- 172.21.15.6:0/2291805229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3c001a30 con 0x5578f8364310 2023-10-06T02:24:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d42ffd700 1 --2- 172.21.15.6:0/2291805229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8365a60 0x5578f840e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d43fff700 1 --2- 172.21.15.6:0/2291805229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8383ea0 0x5578f83ab920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d437fe700 1 --2- 172.21.15.6:0/2291805229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8364310 0x5578f8362760 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0557c0 tx=0x7f0d2c020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe798df5c305753 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d21ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:24:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d21ffb700 1 -- 172.21.15.6:0/2291805229 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c053e60 con 0x5578f8364310 2023-10-06T02:24:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d21ffb700 1 -- 172.21.15.6:0/2291805229 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f0d2c055d20 con 0x5578f8364310 2023-10-06T02:24:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/2291805229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d34021040 con 0x5578f8364310 2023-10-06T02:24:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d21ffb700 1 -- 172.21.15.6:0/2291805229 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d2c054fb0 con 0x5578f8364310 2023-10-06T02:24:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d52fa6b80 10 client.7089 fetch_fsmap learned FSMap version 77 2023-10-06T02:24:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/2291805229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x5578f82684c0 con 0x5578f8364310 2023-10-06T02:24:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.893+0000 7f0d21ffb700 1 -- 172.21.15.6:0/2291805229 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d34021040 con 0x5578f8364310 2023-10-06T02:24:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.894+0000 7f0d21ffb700 1 -- 172.21.15.6:0/2291805229 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 77) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0d2c05c5d0 con 0x5578f8364310 2023-10-06T02:24:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.894+0000 7f0d52fa6b80 10 client.7089 fetch_fsmap finished waiting for FSMap version 77 2023-10-06T02:24:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.894+0000 7f0d52fa6b80 10 client.7089 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-10-06T02:24:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.894+0000 7f0d52fa6b80 20 client.7089 populate_metadata read hostname 'smithi006' 2023-10-06T02:24:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.894+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/2291805229 >> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] conn(0x5578f83abe60 0x5578f840e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.894+0000 7f0d52fa6b80 4 client.7089 mds_command: new command op to 6786 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:24:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.894+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/2291805229 --> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5578f8255e50 con 0x5578f83abe60 2023-10-06T02:24:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.894+0000 7f0d42ffd700 1 --2- 172.21.15.6:0/2291805229 >> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] conn(0x5578f83abe60 0x5578f840e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.894+0000 7f0d42ffd700 1 --2- 172.21.15.6:0/2291805229 >> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] conn(0x5578f83abe60 0x5578f840e910 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dd3ebf69101faa6 server_cookie=b572304be1bba147 in_seq=0 out_seq=0 2023-10-06T02:24:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.894+0000 7f0d21ffb700 10 client.7089 ms_handle_connect on v2:172.21.15.6:6832/353268974 2023-10-06T02:24:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.911+0000 7f0d21ffb700 1 -- 172.21.15.6:0/2291805229 <== mds.0 v2:172.21.15.6:6832/353268974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5578f8255e50 con 0x5578f83abe60 2023-10-06T02:24:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.911+0000 7f0d21ffb700 10 client.7089 handle_command_reply: tid=0 2023-10-06T02:24:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.911+0000 7f0d52fa6b80 1 client.7089 shutdown 2023-10-06T02:24:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.911+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/2291805229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8364310 msgr2=0x5578f8362760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.911+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/2291805229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8364310 0x5578f8362760 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0557c0 tx=0x7f0d2c020040 comp rx=0 tx=0).stop 2023-10-06T02:24:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.911+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/2291805229 shutdown_connections 2023-10-06T02:24:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.911+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/2291805229 >> [v2:172.21.15.6:6832/353268974,v1:172.21.15.6:6834/353268974] conn(0x5578f83abe60 0x5578f840e910 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.911+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/2291805229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578f8383ea0 0x5578f83ab920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.911+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/2291805229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578f8364310 0x5578f8362760 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.911+0000 7f0d52fa6b80 1 --2- 172.21.15.6:0/2291805229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578f8365a60 0x5578f840e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.911+0000 7f0d21ffb700 0 client.7089 ms_handle_reset on v2:172.21.15.6:6832/353268974 2023-10-06T02:24:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.911+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/2291805229 >> 172.21.15.6:0/2291805229 conn(0x5578f8363ed0 msgr2=0x5578f8364980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.911+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/2291805229 shutdown_connections 2023-10-06T02:24:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.911+0000 7f0d52fa6b80 1 -- 172.21.15.6:0/2291805229 wait complete. 2023-10-06T02:24:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.911+0000 7f0d52fa6b80 20 client.7089 trim_cache size 0 max 16384 2023-10-06T02:24:16.914 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:24:16.914 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "", 2023-10-06T02:24:16.914 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0 2023-10-06T02:24:16.914 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:24:16.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.912+0000 7f0d48a4c700 1 -- 172.21.15.6:0/1490253264 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0d24066f30 msgr2=0x7f0d240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.912+0000 7f0d48a4c700 1 --2- 172.21.15.6:0/1490253264 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0d24066f30 0x7f0d240693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0d340099b0 tx=0x7f0d34017000 comp rx=0 tx=0).stop 2023-10-06T02:24:16.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.912+0000 7f0d48a4c700 1 -- 172.21.15.6:0/1490253264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d440b0810 msgr2=0x7f0d44157850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:16.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.912+0000 7f0d48a4c700 1 --2- 172.21.15.6:0/1490253264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d440b0810 0x7f0d44157850 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00d810 tx=0x7f0d2c008040 comp rx=0 tx=0).stop 2023-10-06T02:24:16.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.912+0000 7f0d48a4c700 1 -- 172.21.15.6:0/1490253264 shutdown_connections 2023-10-06T02:24:16.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.912+0000 7f0d48a4c700 1 --2- 172.21.15.6:0/1490253264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d44157d90 0x7f0d440c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.912+0000 7f0d48a4c700 1 --2- 172.21.15.6:0/1490253264 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0d24066f30 0x7f0d240693e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.912+0000 7f0d48a4c700 1 --2- 172.21.15.6:0/1490253264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d440b0810 0x7f0d44157850 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.912+0000 7f0d48a4c700 1 --2- 172.21.15.6:0/1490253264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d440cd400 0x7f0d440c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.912+0000 7f0d48a4c700 1 -- 172.21.15.6:0/1490253264 >> 172.21.15.6:0/1490253264 conn(0x7f0d4406a110 msgr2=0x7f0d440cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.912+0000 7f0d48a4c700 1 -- 172.21.15.6:0/1490253264 shutdown_connections 2023-10-06T02:24:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:16.912+0000 7f0d48a4c700 1 -- 172.21.15.6:0/1490253264 wait complete. 2023-10-06T02:24:16.924 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:24:16.924 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:24:16.964 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:24:17.014 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:24:17.014 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:24:17.014 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:24:17.014 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:17.047 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[118617]: fuse finished with error 0 and tester_r 0 2023-10-06T02:24:17.049 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:24:17.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:17.049 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:24:17.113 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:24:17.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:17.114 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:24:17.131 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:24:17.131 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T02:24:17.132 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:24:17.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:17.132 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T02:24:17.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:24:17.169 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T02:24:17.169 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:24:17.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:17.169 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T02:24:17.188 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T02:24:17.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:24:17.189 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:17.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.327+0000 7f4f64472700 1 Processor -- start 2023-10-06T02:24:17.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.327+0000 7f4f64472700 1 -- start start 2023-10-06T02:24:17.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.328+0000 7f4f64472700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4f5c142de0 0x7f4f5c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:17.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.328+0000 7f4f64472700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5c0cf8a0 con 0x7f4f5c0d0950 2023-10-06T02:24:17.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.328+0000 7f4f64472700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5c0cec90 con 0x7f4f5c0cd270 2023-10-06T02:24:17.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.328+0000 7f4f64472700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5c0cef70 con 0x7f4f5c142de0 2023-10-06T02:24:17.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f62a0f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4f5c0d0950 0x7f4f5c0b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32952/0 (socket says 172.21.15.6:32952) 2023-10-06T02:24:17.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f62a0f700 1 -- 172.21.15.6:0/1230573925 learned_addr learned my addr 172.21.15.6:0/1230573925 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6220e700 1 --2- 172.21.15.6:0/1230573925 >> v2:172.21.15.175:3300/0 conn(0x7f4f5c142de0 0x7f4f5c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6120c700 1 -- 172.21.15.6:0/1230573925 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246661461 0 0) 0x7f4f5c0cf8a0 con 0x7f4f5c0d0950 2023-10-06T02:24:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6120c700 1 -- 172.21.15.6:0/1230573925 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f44003570 con 0x7f4f5c0d0950 2023-10-06T02:24:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6120c700 1 -- 172.21.15.6:0/1230573925 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422928038 0 0) 0x7f4f5c0cec90 con 0x7f4f5c0cd270 2023-10-06T02:24:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6120c700 1 -- 172.21.15.6:0/1230573925 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f5c0cf8a0 con 0x7f4f5c0cd270 2023-10-06T02:24:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6120c700 1 -- 172.21.15.6:0/1230573925 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1078896628 0 0) 0x7f4f44003570 con 0x7f4f5c0d0950 2023-10-06T02:24:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6120c700 1 -- 172.21.15.6:0/1230573925 >> v2:172.21.15.175:3300/0 conn(0x7f4f5c142de0 msgr2=0x7f4f5c0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6120c700 1 --2- 172.21.15.6:0/1230573925 >> v2:172.21.15.175:3300/0 conn(0x7f4f5c142de0 0x7f4f5c0ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6120c700 1 -- 172.21.15.6:0/1230573925 >> v1:172.21.15.175:6789/0 conn(0x7f4f5c0cd270 legacy=0x7f4f5c0d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6120c700 1 -- 172.21.15.6:0/1230573925 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c0cf250 con 0x7f4f5c0d0950 2023-10-06T02:24:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6120c700 1 -- 172.21.15.6:0/1230573925 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f4f4c0017f0 con 0x7f4f5c0d0950 2023-10-06T02:24:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6120c700 1 -- 172.21.15.6:0/1230573925 >> v1:172.21.15.6:6789/0 conn(0x7f4f5c0d0950 legacy=0x7f4f5c0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6120c700 1 --2- 172.21.15.6:0/1230573925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f44003bf0 0x7f4f44003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6120c700 1 --2- 172.21.15.6:0/1230573925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f44004810 0x7f4f44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6120c700 1 --2- 172.21.15.6:0/1230573925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f440051c0 0x7f4f4400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6120c700 1 -- 172.21.15.6:0/1230573925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0cef70 con 0x7f4f440051c0 2023-10-06T02:24:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6120c700 1 -- 172.21.15.6:0/1230573925 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4400c0b0 con 0x7f4f44003bf0 2023-10-06T02:24:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f6120c700 1 -- 172.21.15.6:0/1230573925 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4400c270 con 0x7f4f44004810 2023-10-06T02:24:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.329+0000 7f4f62a0f700 1 --2- 172.21.15.6:0/1230573925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f440051c0 0x7f4f4400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.330+0000 7f4f6220e700 1 --2- 172.21.15.6:0/1230573925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f44003bf0 0x7f4f44003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.330+0000 7f4f61a0d700 1 --2- 172.21.15.6:0/1230573925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f44004810 0x7f4f44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.330+0000 7f4f62a0f700 1 -- 172.21.15.6:0/1230573925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f44004810 msgr2=0x7f4f44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:17.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.330+0000 7f4f62a0f700 1 --2- 172.21.15.6:0/1230573925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f44004810 0x7f4f44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.330+0000 7f4f62a0f700 1 -- 172.21.15.6:0/1230573925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f44003bf0 msgr2=0x7f4f44003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:17.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.330+0000 7f4f62a0f700 1 --2- 172.21.15.6:0/1230573925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f44003bf0 0x7f4f44003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.330+0000 7f4f62a0f700 1 -- 172.21.15.6:0/1230573925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f44003570 con 0x7f4f440051c0 2023-10-06T02:24:17.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.330+0000 7f4f62a0f700 1 -- 172.21.15.6:0/1230573925 reap_dead start 2023-10-06T02:24:17.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.330+0000 7f4f62a0f700 1 --2- 172.21.15.6:0/1230573925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f440051c0 0x7f4f4400ba60 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00a8c0 tx=0x7f4f4c002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac151a908ab6289 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:17.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.330+0000 7f4f6120c700 1 -- 172.21.15.6:0/1230573925 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0070d0 con 0x7f4f440051c0 2023-10-06T02:24:17.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.330+0000 7f4f6120c700 1 -- 172.21.15.6:0/1230573925 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4c007230 con 0x7f4f440051c0 2023-10-06T02:24:17.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.330+0000 7f4f6120c700 1 -- 172.21.15.6:0/1230573925 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0075f0 con 0x7f4f440051c0 2023-10-06T02:24:17.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.331+0000 7f4f64472700 1 -- 172.21.15.6:0/1230573925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f440051c0 msgr2=0x7f4f4400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:17.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.331+0000 7f4f64472700 1 --2- 172.21.15.6:0/1230573925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f440051c0 0x7f4f4400ba60 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00a8c0 tx=0x7f4f4c002190 comp rx=0 tx=0).stop 2023-10-06T02:24:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.331+0000 7f4f64472700 1 -- 172.21.15.6:0/1230573925 shutdown_connections 2023-10-06T02:24:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.331+0000 7f4f64472700 1 --2- 172.21.15.6:0/1230573925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f440051c0 0x7f4f4400ba60 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.331+0000 7f4f64472700 1 -- 172.21.15.6:0/1230573925 >> 172.21.15.6:0/1230573925 conn(0x7f4f5c069110 msgr2=0x7f4f5c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.331+0000 7f4f64472700 1 -- 172.21.15.6:0/1230573925 shutdown_connections 2023-10-06T02:24:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.331+0000 7f4f64472700 1 -- 172.21.15.6:0/1230573925 wait complete. 2023-10-06T02:24:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.332+0000 7f4f64472700 1 Processor -- start 2023-10-06T02:24:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.332+0000 7f4f64472700 1 -- start start 2023-10-06T02:24:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f64472700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f440051c0 0x7f4f5c13fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f64472700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f5c13e880 0x7f4f5c0cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f64472700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f5c0c8850 0x7f4f5c13dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f64472700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c13f9c0 con 0x7f4f5c0c8850 2023-10-06T02:24:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f64472700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c13edb0 con 0x7f4f440051c0 2023-10-06T02:24:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f64472700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c13f090 con 0x7f4f5c13e880 2023-10-06T02:24:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f62a0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f5c0c8850 0x7f4f5c13dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f62a0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f5c0c8850 0x7f4f5c13dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39004/0 (socket says 172.21.15.6:39004) 2023-10-06T02:24:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f62a0f700 1 -- 172.21.15.6:0/1230982758 learned_addr learned my addr 172.21.15.6:0/1230982758 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f6220e700 1 --2- 172.21.15.6:0/1230982758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f440051c0 0x7f4f5c13fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f61a0d700 1 --2- 172.21.15.6:0/1230982758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f5c13e880 0x7f4f5c0cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f62a0f700 1 -- 172.21.15.6:0/1230982758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f5c13e880 msgr2=0x7f4f5c0cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f62a0f700 1 --2- 172.21.15.6:0/1230982758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f5c13e880 0x7f4f5c0cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f62a0f700 1 -- 172.21.15.6:0/1230982758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f440051c0 msgr2=0x7f4f5c13fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f62a0f700 1 --2- 172.21.15.6:0/1230982758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f440051c0 0x7f4f5c13fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f62a0f700 1 -- 172.21.15.6:0/1230982758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c13f370 con 0x7f4f5c0c8850 2023-10-06T02:24:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f6220e700 1 --2- 172.21.15.6:0/1230982758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f440051c0 0x7f4f5c13fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f62a0f700 1 --2- 172.21.15.6:0/1230982758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f5c0c8850 0x7f4f5c13dad0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c069660 tx=0x7f4f4c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f5a7fc700 1 -- 172.21.15.6:0/1230982758 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c001250 con 0x7f4f5c0c8850 2023-10-06T02:24:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f5a7fc700 1 -- 172.21.15.6:0/1230982758 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4c007960 con 0x7f4f5c0c8850 2023-10-06T02:24:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f64472700 1 -- 172.21.15.6:0/1230982758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5c13f650 con 0x7f4f5c0c8850 2023-10-06T02:24:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f5a7fc700 1 -- 172.21.15.6:0/1230982758 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0075f0 con 0x7f4f5c0c8850 2023-10-06T02:24:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.333+0000 7f4f64472700 1 -- 172.21.15.6:0/1230982758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5c0c8cd0 con 0x7f4f5c0c8850 2023-10-06T02:24:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.334+0000 7f4f64472700 1 -- 172.21.15.6:0/1230982758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5c13fb30 con 0x7f4f5c0c8850 2023-10-06T02:24:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.335+0000 7f4f5a7fc700 1 -- 172.21.15.6:0/1230982758 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f4c01d420 con 0x7f4f5c0c8850 2023-10-06T02:24:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.335+0000 7f4f5a7fc700 1 --2- 172.21.15.6:0/1230982758 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f48066f30 0x7f4f480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.335+0000 7f4f5a7fc700 1 -- 172.21.15.6:0/1230982758 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f4f4c086070 con 0x7f4f5c0c8850 2023-10-06T02:24:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.335+0000 7f4f6220e700 1 --2- 172.21.15.6:0/1230982758 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f48066f30 0x7f4f480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.336+0000 7f4f6220e700 1 --2- 172.21.15.6:0/1230982758 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f48066f30 0x7f4f480693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4f54006f00 tx=0x7f4f54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.340+0000 7f4f5a7fc700 1 -- 172.21.15.6:0/1230982758 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f4c052ff0 con 0x7f4f5c0c8850 2023-10-06T02:24:17.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.576+0000 7f4f64472700 1 -- 172.21.15.6:0/1230982758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f5c088ac0 con 0x7f4f5c0c8850 2023-10-06T02:24:17.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.576+0000 7f4f5a7fc700 1 -- 172.21.15.6:0/1230982758 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f4f4c056610 con 0x7f4f5c0c8850 2023-10-06T02:24:17.577 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:17.577 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":77,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2575759355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2575759355},{"type":"v1","addr":"172.21.15.175:6836","nonce":2575759355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2523304335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2523304335},{"type":"v1","addr":"172.21.15.175:6837","nonce":2523304335}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7032,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1331184347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1331184347},{"type":"v1","addr":"172.21.15.6:6835","nonce":1331184347}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:38.399768+0000","modified":"2023-10-06T02:24:14.877092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6786},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6786":{"gid":6786,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":13,"addr":"172.21.15.6:6834/353268974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":353268974},{"type":"v1","addr":"172.21.15.6:6834","nonce":353268974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:24:17.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.578+0000 7f4f64472700 1 -- 172.21.15.6:0/1230982758 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f48066f30 msgr2=0x7f4f480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:17.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.578+0000 7f4f64472700 1 --2- 172.21.15.6:0/1230982758 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f48066f30 0x7f4f480693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4f54006f00 tx=0x7f4f54008040 comp rx=0 tx=0).stop 2023-10-06T02:24:17.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.578+0000 7f4f64472700 1 -- 172.21.15.6:0/1230982758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f5c0c8850 msgr2=0x7f4f5c13dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.578+0000 7f4f64472700 1 --2- 172.21.15.6:0/1230982758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f5c0c8850 0x7f4f5c13dad0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c069660 tx=0x7f4f4c016000 comp rx=0 tx=0).stop 2023-10-06T02:24:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.578+0000 7f4f64472700 1 -- 172.21.15.6:0/1230982758 shutdown_connections 2023-10-06T02:24:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.578+0000 7f4f64472700 1 --2- 172.21.15.6:0/1230982758 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4f48066f30 0x7f4f480693e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.578+0000 7f4f64472700 1 --2- 172.21.15.6:0/1230982758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f5c0c8850 0x7f4f5c13dad0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.578+0000 7f4f64472700 1 --2- 172.21.15.6:0/1230982758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f440051c0 0x7f4f5c13fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.578+0000 7f4f64472700 1 --2- 172.21.15.6:0/1230982758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f5c13e880 0x7f4f5c0cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.578+0000 7f4f64472700 1 -- 172.21.15.6:0/1230982758 >> 172.21.15.6:0/1230982758 conn(0x7f4f5c069110 msgr2=0x7f4f5c0d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.579+0000 7f4f64472700 1 -- 172.21.15.6:0/1230982758 shutdown_connections 2023-10-06T02:24:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.579+0000 7f4f64472700 1 -- 172.21.15.6:0/1230982758 wait complete. 2023-10-06T02:24:17.581 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 77 2023-10-06T02:24:17.592 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:17.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.710+0000 7f1d839ad700 1 Processor -- start 2023-10-06T02:24:17.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.710+0000 7f1d839ad700 1 -- start start 2023-10-06T02:24:17.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.711+0000 7f1d839ad700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d7c142de0 0x7f1d7c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:17.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.711+0000 7f1d839ad700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d7c0cd270 0x7f1d7c0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:17.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.711+0000 7f1d839ad700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c0cf8a0 con 0x7f1d7c1431b0 2023-10-06T02:24:17.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.711+0000 7f1d839ad700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c0b4100 con 0x7f1d7c0cd270 2023-10-06T02:24:17.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.711+0000 7f1d839ad700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0cec90 con 0x7f1d7c142de0 2023-10-06T02:24:17.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.711+0000 7f1d80f48700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d7c0cd270 0x7f1d7c0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:17.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.712+0000 7f1d80f48700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d7c0cd270 0x7f1d7c0d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39020/0 (socket says 172.21.15.6:39020) 2023-10-06T02:24:17.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.712+0000 7f1d80f48700 1 -- 172.21.15.6:0/2712186883 learned_addr learned my addr 172.21.15.6:0/2712186883 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:17.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.712+0000 7f1d81749700 1 --2- 172.21.15.6:0/2712186883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d7c142de0 0x7f1d7c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:17.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.712+0000 7f1d80f48700 1 -- 172.21.15.6:0/2712186883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d7c142de0 msgr2=0x7f1d7c0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:17.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.712+0000 7f1d80f48700 1 --2- 172.21.15.6:0/2712186883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d7c142de0 0x7f1d7c0ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.712+0000 7f1d80f48700 1 -- 172.21.15.6:0/2712186883 >> v1:172.21.15.175:6789/0 conn(0x7f1d7c1431b0 legacy=0x7f1d7c15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:17.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.712+0000 7f1d80f48700 1 -- 172.21.15.6:0/2712186883 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0cef70 con 0x7f1d7c0cd270 2023-10-06T02:24:17.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.712+0000 7f1d80f48700 1 --2- 172.21.15.6:0/2712186883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c0cd270 0x7f1d7c0d0240 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f1d700099b0 tx=0x7f1d70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc58f6f0982fae7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:17.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.712+0000 7f1d7bfff700 1 -- 172.21.15.6:0/2712186883 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7000b860 con 0x7f1d7c0cd270 2023-10-06T02:24:17.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.712+0000 7f1d7bfff700 1 -- 172.21.15.6:0/2712186883 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7000b9c0 con 0x7f1d7c0cd270 2023-10-06T02:24:17.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.712+0000 7f1d7bfff700 1 -- 172.21.15.6:0/2712186883 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7000bd60 con 0x7f1d7c0cd270 2023-10-06T02:24:17.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.713+0000 7f1d839ad700 1 -- 172.21.15.6:0/2712186883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c0cd270 msgr2=0x7f1d7c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:17.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.713+0000 7f1d839ad700 1 --2- 172.21.15.6:0/2712186883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c0cd270 0x7f1d7c0d0240 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f1d700099b0 tx=0x7f1d70009250 comp rx=0 tx=0).stop 2023-10-06T02:24:17.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.713+0000 7f1d839ad700 1 -- 172.21.15.6:0/2712186883 shutdown_connections 2023-10-06T02:24:17.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.713+0000 7f1d839ad700 1 --2- 172.21.15.6:0/2712186883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d7c142de0 0x7f1d7c0ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.713+0000 7f1d839ad700 1 --2- 172.21.15.6:0/2712186883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c0cd270 0x7f1d7c0d0240 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.713+0000 7f1d839ad700 1 -- 172.21.15.6:0/2712186883 >> 172.21.15.6:0/2712186883 conn(0x7f1d7c069110 msgr2=0x7f1d7c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:17.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.713+0000 7f1d839ad700 1 -- 172.21.15.6:0/2712186883 shutdown_connections 2023-10-06T02:24:17.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.713+0000 7f1d839ad700 1 -- 172.21.15.6:0/2712186883 wait complete. 2023-10-06T02:24:17.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.714+0000 7f1d839ad700 1 Processor -- start 2023-10-06T02:24:17.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.714+0000 7f1d839ad700 1 -- start start 2023-10-06T02:24:17.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d839ad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c0cd270 0x7f1d7c16ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:17.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d839ad700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d7c142de0 0x7f1d7c0b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:17.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d839ad700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c1431b0 0x7f1d7c0b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:17.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d839ad700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0b1e20 con 0x7f1d7c0cd270 2023-10-06T02:24:17.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d839ad700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0b1090 con 0x7f1d7c1431b0 2023-10-06T02:24:17.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d839ad700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0b12a0 con 0x7f1d7c142de0 2023-10-06T02:24:17.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d81749700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c0cd270 0x7f1d7c16ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:17.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d81749700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c0cd270 0x7f1d7c16ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39032/0 (socket says 172.21.15.6:39032) 2023-10-06T02:24:17.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d81749700 1 -- 172.21.15.6:0/152787545 learned_addr learned my addr 172.21.15.6:0/152787545 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:17.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d80f48700 1 --2- 172.21.15.6:0/152787545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d7c142de0 0x7f1d7c0b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:17.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d81f4a700 1 --2- 172.21.15.6:0/152787545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c1431b0 0x7f1d7c0b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:17.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d81749700 1 -- 172.21.15.6:0/152787545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d7c142de0 msgr2=0x7f1d7c0b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:17.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d81749700 1 --2- 172.21.15.6:0/152787545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d7c142de0 0x7f1d7c0b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d81749700 1 -- 172.21.15.6:0/152787545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c1431b0 msgr2=0x7f1d7c0b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:17.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d81749700 1 --2- 172.21.15.6:0/152787545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c1431b0 0x7f1d7c0b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d81749700 1 -- 172.21.15.6:0/152787545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d700094f0 con 0x7f1d7c0cd270 2023-10-06T02:24:17.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d81749700 1 --2- 172.21.15.6:0/152787545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c0cd270 0x7f1d7c16ac70 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400d890 tx=0x7f1d74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:17.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d797fa700 1 -- 172.21.15.6:0/152787545 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d740125f0 con 0x7f1d7c0cd270 2023-10-06T02:24:17.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.715+0000 7f1d797fa700 1 -- 172.21.15.6:0/152787545 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d74012770 con 0x7f1d7c0cd270 2023-10-06T02:24:17.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.716+0000 7f1d839ad700 1 -- 172.21.15.6:0/152787545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c0b1580 con 0x7f1d7c0cd270 2023-10-06T02:24:17.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.716+0000 7f1d797fa700 1 -- 172.21.15.6:0/152787545 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74012b30 con 0x7f1d7c0cd270 2023-10-06T02:24:17.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.716+0000 7f1d839ad700 1 -- 172.21.15.6:0/152787545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c0b1b40 con 0x7f1d7c0cd270 2023-10-06T02:24:17.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.717+0000 7f1d839ad700 1 -- 172.21.15.6:0/152787545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c088ac0 con 0x7f1d7c0cd270 2023-10-06T02:24:17.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.717+0000 7f1d797fa700 1 -- 172.21.15.6:0/152787545 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d7401e460 con 0x7f1d7c0cd270 2023-10-06T02:24:17.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.717+0000 7f1d797fa700 1 --2- 172.21.15.6:0/152787545 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d68066f30 0x7f1d680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:17.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.717+0000 7f1d797fa700 1 -- 172.21.15.6:0/152787545 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f1d74084ec0 con 0x7f1d7c0cd270 2023-10-06T02:24:17.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.718+0000 7f1d80f48700 1 --2- 172.21.15.6:0/152787545 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d68066f30 0x7f1d680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:17.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.718+0000 7f1d80f48700 1 --2- 172.21.15.6:0/152787545 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d68066f30 0x7f1d680693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1d700099b0 tx=0x7f1d70017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:17.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.722+0000 7f1d797fa700 1 -- 172.21.15.6:0/152787545 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d74051e40 con 0x7f1d7c0cd270 2023-10-06T02:24:17.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.915+0000 7f1d839ad700 1 -- 172.21.15.6:0/152787545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d7c0cf520 con 0x7f1d7c0cd270 2023-10-06T02:24:17.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.916+0000 7f1d797fa700 1 -- 172.21.15.6:0/152787545 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+17153 (secure 0 0 0) 0x7f1d74055460 con 0x7f1d7c0cd270 2023-10-06T02:24:17.916 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:17.917 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":83,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:24:11.855878+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:36.143952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:37.374144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/1625434310":"2023-10-07T02:24:11.855798+0000","172.21.15.6:6833/1625434310":"2023-10-07T02:24:11.855798+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:17.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.918+0000 7f1d839ad700 1 -- 172.21.15.6:0/152787545 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d68066f30 msgr2=0x7f1d680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:17.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.918+0000 7f1d839ad700 1 --2- 172.21.15.6:0/152787545 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d68066f30 0x7f1d680693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1d700099b0 tx=0x7f1d70017000 comp rx=0 tx=0).stop 2023-10-06T02:24:17.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.918+0000 7f1d839ad700 1 -- 172.21.15.6:0/152787545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c0cd270 msgr2=0x7f1d7c16ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:17.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.918+0000 7f1d839ad700 1 --2- 172.21.15.6:0/152787545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c0cd270 0x7f1d7c16ac70 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400d890 tx=0x7f1d74008040 comp rx=0 tx=0).stop 2023-10-06T02:24:17.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.918+0000 7f1d839ad700 1 -- 172.21.15.6:0/152787545 shutdown_connections 2023-10-06T02:24:17.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.918+0000 7f1d839ad700 1 --2- 172.21.15.6:0/152787545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c1431b0 0x7f1d7c0b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.918+0000 7f1d839ad700 1 --2- 172.21.15.6:0/152787545 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d68066f30 0x7f1d680693e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.918+0000 7f1d839ad700 1 --2- 172.21.15.6:0/152787545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c0cd270 0x7f1d7c16ac70 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.918+0000 7f1d839ad700 1 --2- 172.21.15.6:0/152787545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d7c142de0 0x7f1d7c0b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:17.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.918+0000 7f1d839ad700 1 -- 172.21.15.6:0/152787545 >> 172.21.15.6:0/152787545 conn(0x7f1d7c069110 msgr2=0x7f1d7c141ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:17.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.918+0000 7f1d839ad700 1 -- 172.21.15.6:0/152787545 shutdown_connections 2023-10-06T02:24:17.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:17.918+0000 7f1d839ad700 1 -- 172.21.15.6:0/152787545 wait complete. 2023-10-06T02:24:17.931 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:23:36.143952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:23:37.374144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:24:17.931 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:24:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.054+0000 7f4d36ced700 1 Processor -- start 2023-10-06T02:24:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.054+0000 7f4d36ced700 1 -- start start 2023-10-06T02:24:18.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.055+0000 7f4d36ced700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4d30067570 0x7f4d300cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.055+0000 7f4d36ced700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d300caf30 con 0x7f4d30159590 2023-10-06T02:24:18.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.055+0000 7f4d36ced700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d300cd340 con 0x7f4d300cb900 2023-10-06T02:24:18.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.055+0000 7f4d36ced700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d300ca600 con 0x7f4d30067570 2023-10-06T02:24:18.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.055+0000 7f4d34a89700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4d30159590 0x7f4d300cca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32964/0 (socket says 172.21.15.6:32964) 2023-10-06T02:24:18.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.055+0000 7f4d34a89700 1 -- 172.21.15.6:0/3592265675 learned_addr learned my addr 172.21.15.6:0/3592265675 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:18.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.055+0000 7f4d2ffff700 1 --2- 172.21.15.6:0/3592265675 >> v2:172.21.15.175:3300/0 conn(0x7f4d30067570 0x7f4d300cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.055+0000 7f4d2f7fe700 1 -- 172.21.15.6:0/3592265675 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613122542 0 0) 0x7f4d300caf30 con 0x7f4d30159590 2023-10-06T02:24:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.055+0000 7f4d2f7fe700 1 -- 172.21.15.6:0/3592265675 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d1c003570 con 0x7f4d30159590 2023-10-06T02:24:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2f7fe700 1 -- 172.21.15.6:0/3592265675 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 695709787 0 0) 0x7f4d1c003570 con 0x7f4d30159590 2023-10-06T02:24:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2f7fe700 1 -- 172.21.15.6:0/3592265675 >> v2:172.21.15.175:3300/0 conn(0x7f4d30067570 msgr2=0x7f4d300cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2f7fe700 1 --2- 172.21.15.6:0/3592265675 >> v2:172.21.15.175:3300/0 conn(0x7f4d30067570 0x7f4d300cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2f7fe700 1 -- 172.21.15.6:0/3592265675 >> v1:172.21.15.175:6789/0 conn(0x7f4d300cb900 legacy=0x7f4d30068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2f7fe700 1 -- 172.21.15.6:0/3592265675 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d300ca8e0 con 0x7f4d30159590 2023-10-06T02:24:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2f7fe700 1 -- 172.21.15.6:0/3592265675 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f4d18001470 con 0x7f4d30159590 2023-10-06T02:24:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2f7fe700 1 -- 172.21.15.6:0/3592265675 >> v1:172.21.15.6:6789/0 conn(0x7f4d30159590 legacy=0x7f4d300cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2f7fe700 1 --2- 172.21.15.6:0/3592265675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1c003a60 0x7f4d1c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2f7fe700 1 --2- 172.21.15.6:0/3592265675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d1c004810 0x7f4d1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2f7fe700 1 --2- 172.21.15.6:0/3592265675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d1c0051c0 0x7f4d1c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2f7fe700 1 -- 172.21.15.6:0/3592265675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300ca600 con 0x7f4d1c0051c0 2023-10-06T02:24:18.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2f7fe700 1 -- 172.21.15.6:0/3592265675 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c00c0d0 con 0x7f4d1c004810 2023-10-06T02:24:18.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2f7fe700 1 -- 172.21.15.6:0/3592265675 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c00c290 con 0x7f4d1c003a60 2023-10-06T02:24:18.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d3528a700 1 --2- 172.21.15.6:0/3592265675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d1c0051c0 0x7f4d1c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d34a89700 1 --2- 172.21.15.6:0/3592265675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1c003a60 0x7f4d1c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2ffff700 1 --2- 172.21.15.6:0/3592265675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d1c004810 0x7f4d1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d3528a700 1 -- 172.21.15.6:0/3592265675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1c003a60 msgr2=0x7f4d1c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:18.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d3528a700 1 --2- 172.21.15.6:0/3592265675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1c003a60 0x7f4d1c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d3528a700 1 -- 172.21.15.6:0/3592265675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d1c004810 msgr2=0x7f4d1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:18.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d3528a700 1 --2- 172.21.15.6:0/3592265675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d1c004810 0x7f4d1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d3528a700 1 -- 172.21.15.6:0/3592265675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c003570 con 0x7f4d1c0051c0 2023-10-06T02:24:18.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2ffff700 1 --2- 172.21.15.6:0/3592265675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d1c004810 0x7f4d1c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d3528a700 1 -- 172.21.15.6:0/3592265675 reap_dead start 2023-10-06T02:24:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d3528a700 1 --2- 172.21.15.6:0/3592265675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d1c0051c0 0x7f4d1c00ba60 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f4d28001f90 tx=0x7f4d28001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ccb23dca635624 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2f7fe700 1 -- 172.21.15.6:0/3592265675 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28001950 con 0x7f4d1c0051c0 2023-10-06T02:24:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2f7fe700 1 -- 172.21.15.6:0/3592265675 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2800c8b0 con 0x7f4d1c0051c0 2023-10-06T02:24:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.056+0000 7f4d2f7fe700 1 -- 172.21.15.6:0/3592265675 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2800cc50 con 0x7f4d1c0051c0 2023-10-06T02:24:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.057+0000 7f4d36ced700 1 -- 172.21.15.6:0/3592265675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d1c0051c0 msgr2=0x7f4d1c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.057+0000 7f4d36ced700 1 --2- 172.21.15.6:0/3592265675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d1c0051c0 0x7f4d1c00ba60 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f4d28001f90 tx=0x7f4d28001640 comp rx=0 tx=0).stop 2023-10-06T02:24:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.057+0000 7f4d36ced700 1 -- 172.21.15.6:0/3592265675 shutdown_connections 2023-10-06T02:24:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.057+0000 7f4d36ced700 1 --2- 172.21.15.6:0/3592265675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d1c0051c0 0x7f4d1c00ba60 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.057+0000 7f4d36ced700 1 -- 172.21.15.6:0/3592265675 >> 172.21.15.6:0/3592265675 conn(0x7f4d30095d00 msgr2=0x7f4d300af850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.057+0000 7f4d36ced700 1 -- 172.21.15.6:0/3592265675 shutdown_connections 2023-10-06T02:24:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.057+0000 7f4d36ced700 1 -- 172.21.15.6:0/3592265675 wait complete. 2023-10-06T02:24:18.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.058+0000 7f4d36ced700 1 Processor -- start 2023-10-06T02:24:18.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.058+0000 7f4d36ced700 1 -- start start 2023-10-06T02:24:18.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.059+0000 7f4d36ced700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1c0051c0 0x7f4d3014c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.059+0000 7f4d36ced700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d300990c0 0x7f4d30099530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.059+0000 7f4d36ced700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d300693e0 0x7f4d30069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.059+0000 7f4d36ced700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d30069d90 con 0x7f4d300693e0 2023-10-06T02:24:18.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.059+0000 7f4d36ced700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300a9460 con 0x7f4d300990c0 2023-10-06T02:24:18.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.059+0000 7f4d36ced700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300a9d00 con 0x7f4d1c0051c0 2023-10-06T02:24:18.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.059+0000 7f4d3528a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d300693e0 0x7f4d30069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.059+0000 7f4d3528a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d300693e0 0x7f4d30069850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39042/0 (socket says 172.21.15.6:39042) 2023-10-06T02:24:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.059+0000 7f4d3528a700 1 -- 172.21.15.6:0/1457815759 learned_addr learned my addr 172.21.15.6:0/1457815759 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.059+0000 7f4d34a89700 1 --2- 172.21.15.6:0/1457815759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1c0051c0 0x7f4d3014c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.059+0000 7f4d2ffff700 1 --2- 172.21.15.6:0/1457815759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d300990c0 0x7f4d30099530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.059+0000 7f4d3528a700 1 -- 172.21.15.6:0/1457815759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1c0051c0 msgr2=0x7f4d3014c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.059+0000 7f4d3528a700 1 --2- 172.21.15.6:0/1457815759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1c0051c0 0x7f4d3014c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.059+0000 7f4d3528a700 1 -- 172.21.15.6:0/1457815759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d300990c0 msgr2=0x7f4d30099530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.059+0000 7f4d3528a700 1 --2- 172.21.15.6:0/1457815759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d300990c0 0x7f4d30099530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.059+0000 7f4d3528a700 1 -- 172.21.15.6:0/1457815759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d30099b80 con 0x7f4d300693e0 2023-10-06T02:24:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.059+0000 7f4d2ffff700 1 --2- 172.21.15.6:0/1457815759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d300990c0 0x7f4d30099530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.060+0000 7f4d3528a700 1 --2- 172.21.15.6:0/1457815759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d300693e0 0x7f4d30069850 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800c6a0 tx=0x7f4d28015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.060+0000 7f4d2cff9700 1 -- 172.21.15.6:0/1457815759 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28001950 con 0x7f4d300693e0 2023-10-06T02:24:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.060+0000 7f4d2cff9700 1 -- 172.21.15.6:0/1457815759 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2800cea0 con 0x7f4d300693e0 2023-10-06T02:24:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.060+0000 7f4d36ced700 1 -- 172.21.15.6:0/1457815759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d300a96b0 con 0x7f4d300693e0 2023-10-06T02:24:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.060+0000 7f4d2cff9700 1 -- 172.21.15.6:0/1457815759 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2801e850 con 0x7f4d300693e0 2023-10-06T02:24:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.060+0000 7f4d36ced700 1 -- 172.21.15.6:0/1457815759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d30157cb0 con 0x7f4d300693e0 2023-10-06T02:24:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.061+0000 7f4d36ced700 1 -- 172.21.15.6:0/1457815759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d300a9e90 con 0x7f4d300693e0 2023-10-06T02:24:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.061+0000 7f4d2cff9700 1 -- 172.21.15.6:0/1457815759 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d280273b0 con 0x7f4d300693e0 2023-10-06T02:24:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.061+0000 7f4d2cff9700 1 --2- 172.21.15.6:0/1457815759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d10066f30 0x7f4d100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.062+0000 7f4d2cff9700 1 -- 172.21.15.6:0/1457815759 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f4d28085680 con 0x7f4d300693e0 2023-10-06T02:24:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.062+0000 7f4d34a89700 1 --2- 172.21.15.6:0/1457815759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d10066f30 0x7f4d100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.062+0000 7f4d34a89700 1 --2- 172.21.15.6:0/1457815759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d10066f30 0x7f4d100693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4d18001ce0 tx=0x7f4d18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:18.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.066+0000 7f4d2cff9700 1 -- 172.21.15.6:0/1457815759 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d280526b0 con 0x7f4d300693e0 2023-10-06T02:24:18.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.257+0000 7f4d36ced700 1 -- 172.21.15.6:0/1457815759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4d3006d070 con 0x7f4d300693e0 2023-10-06T02:24:18.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.257+0000 7f4d2cff9700 1 -- 172.21.15.6:0/1457815759 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v83) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4d28055cd0 con 0x7f4d300693e0 2023-10-06T02:24:18.258 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:24:18.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.259+0000 7f4d36ced700 1 -- 172.21.15.6:0/1457815759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d10066f30 msgr2=0x7f4d100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.259+0000 7f4d36ced700 1 --2- 172.21.15.6:0/1457815759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d10066f30 0x7f4d100693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4d18001ce0 tx=0x7f4d18009040 comp rx=0 tx=0).stop 2023-10-06T02:24:18.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.259+0000 7f4d36ced700 1 -- 172.21.15.6:0/1457815759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d300693e0 msgr2=0x7f4d30069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.259+0000 7f4d36ced700 1 --2- 172.21.15.6:0/1457815759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d300693e0 0x7f4d30069850 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800c6a0 tx=0x7f4d28015000 comp rx=0 tx=0).stop 2023-10-06T02:24:18.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.259+0000 7f4d36ced700 1 -- 172.21.15.6:0/1457815759 shutdown_connections 2023-10-06T02:24:18.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.259+0000 7f4d36ced700 1 --2- 172.21.15.6:0/1457815759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d10066f30 0x7f4d100693e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.259+0000 7f4d36ced700 1 --2- 172.21.15.6:0/1457815759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d300693e0 0x7f4d30069850 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.259+0000 7f4d36ced700 1 --2- 172.21.15.6:0/1457815759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1c0051c0 0x7f4d3014c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.259+0000 7f4d36ced700 1 --2- 172.21.15.6:0/1457815759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d300990c0 0x7f4d30099530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.259+0000 7f4d36ced700 1 -- 172.21.15.6:0/1457815759 >> 172.21.15.6:0/1457815759 conn(0x7f4d30095d00 msgr2=0x7f4d3015ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:18.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.259+0000 7f4d36ced700 1 -- 172.21.15.6:0/1457815759 shutdown_connections 2023-10-06T02:24:18.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.259+0000 7f4d36ced700 1 -- 172.21.15.6:0/1457815759 wait complete. 2023-10-06T02:24:18.272 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:24:18.323 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:24:18.323+0000 7f5b78c53700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:24:18.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.392+0000 7f306070f700 1 Processor -- start 2023-10-06T02:24:18.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.392+0000 7f306070f700 1 -- start start 2023-10-06T02:24:18.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.393+0000 7f306070f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f30581574b0 0x7f30580b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.393+0000 7f306070f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30580b13f0 0x7f30580c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.393+0000 7f306070f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30580c3b40 con 0x7f30580c4510 2023-10-06T02:24:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.393+0000 7f306070f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30580c4990 con 0x7f30581574b0 2023-10-06T02:24:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.393+0000 7f306070f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30580c2f30 con 0x7f30580b13f0 2023-10-06T02:24:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.394+0000 7f305ecac700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f30580c4510 0x7f30580cbcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32968/0 (socket says 172.21.15.6:32968) 2023-10-06T02:24:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.394+0000 7f305ecac700 1 -- 172.21.15.6:0/1809181220 learned_addr learned my addr 172.21.15.6:0/1809181220 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.394+0000 7f305e4ab700 1 --2- 172.21.15.6:0/1809181220 >> v2:172.21.15.175:3300/0 conn(0x7f30581574b0 0x7f30580b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.394+0000 7f305dcaa700 1 --2- 172.21.15.6:0/1809181220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30580b13f0 0x7f30580c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.394+0000 7f305d4a9700 1 -- 172.21.15.6:0/1809181220 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458794120 0 0) 0x7f30580c3b40 con 0x7f30580c4510 2023-10-06T02:24:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.394+0000 7f305d4a9700 1 -- 172.21.15.6:0/1809181220 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3040003570 con 0x7f30580c4510 2023-10-06T02:24:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.394+0000 7f305e4ab700 1 -- 172.21.15.6:0/1809181220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30580b13f0 msgr2=0x7f30580c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.394+0000 7f305d4a9700 1 -- 172.21.15.6:0/1809181220 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2969528008 0 0) 0x7f3040003570 con 0x7f30580c4510 2023-10-06T02:24:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.394+0000 7f305e4ab700 1 --2- 172.21.15.6:0/1809181220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30580b13f0 0x7f30580c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.394+0000 7f305e4ab700 1 -- 172.21.15.6:0/1809181220 >> v1:172.21.15.6:6789/0 conn(0x7f30580c4510 legacy=0x7f30580cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.394+0000 7f305e4ab700 1 -- 172.21.15.6:0/1809181220 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580c3210 con 0x7f30581574b0 2023-10-06T02:24:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.394+0000 7f305dcaa700 1 --2- 172.21.15.6:0/1809181220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30580b13f0 0x7f30580c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.394+0000 7f305e4ab700 1 --2- 172.21.15.6:0/1809181220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30581574b0 0x7f30580b0eb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f30500098d0 tx=0x7f3050009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c42ef3a33c422fd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.395+0000 7f305d4a9700 1 -- 172.21.15.6:0/1809181220 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30480017f0 con 0x7f30581574b0 2023-10-06T02:24:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.395+0000 7f305d4a9700 1 -- 172.21.15.6:0/1809181220 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3050011420 con 0x7f30581574b0 2023-10-06T02:24:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.395+0000 7f305d4a9700 1 -- 172.21.15.6:0/1809181220 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30500117c0 con 0x7f30581574b0 2023-10-06T02:24:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.395+0000 7f306070f700 1 -- 172.21.15.6:0/1809181220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30581574b0 msgr2=0x7f30580b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.395+0000 7f306070f700 1 --2- 172.21.15.6:0/1809181220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30581574b0 0x7f30580b0eb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f30500098d0 tx=0x7f3050009120 comp rx=0 tx=0).stop 2023-10-06T02:24:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.395+0000 7f306070f700 1 -- 172.21.15.6:0/1809181220 shutdown_connections 2023-10-06T02:24:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.395+0000 7f306070f700 1 --2- 172.21.15.6:0/1809181220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30581574b0 0x7f30580b0eb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.395+0000 7f306070f700 1 --2- 172.21.15.6:0/1809181220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30580b13f0 0x7f30580c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.395+0000 7f306070f700 1 -- 172.21.15.6:0/1809181220 >> 172.21.15.6:0/1809181220 conn(0x7f3058067910 msgr2=0x7f30580ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.395+0000 7f306070f700 1 -- 172.21.15.6:0/1809181220 shutdown_connections 2023-10-06T02:24:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.395+0000 7f306070f700 1 -- 172.21.15.6:0/1809181220 wait complete. 2023-10-06T02:24:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.396+0000 7f306070f700 1 Processor -- start 2023-10-06T02:24:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.396+0000 7f306070f700 1 -- start start 2023-10-06T02:24:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.397+0000 7f306070f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580b13f0 0x7f30581535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.397+0000 7f306070f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30580c4510 0x7f305816a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.397+0000 7f306070f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30581574b0 0x7f30580c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.397+0000 7f306070f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3058151240 con 0x7f30580b13f0 2023-10-06T02:24:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.397+0000 7f306070f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3058154890 con 0x7f30581574b0 2023-10-06T02:24:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.397+0000 7f306070f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3058153c80 con 0x7f30580c4510 2023-10-06T02:24:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.397+0000 7f305e4ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580b13f0 0x7f30581535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.397+0000 7f305e4ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580b13f0 0x7f30581535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39046/0 (socket says 172.21.15.6:39046) 2023-10-06T02:24:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.397+0000 7f305e4ab700 1 -- 172.21.15.6:0/2343441691 learned_addr learned my addr 172.21.15.6:0/2343441691 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.397+0000 7f305ecac700 1 --2- 172.21.15.6:0/2343441691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30581574b0 0x7f30580c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.397+0000 7f305dcaa700 1 --2- 172.21.15.6:0/2343441691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30580c4510 0x7f305816a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.397+0000 7f305e4ab700 1 -- 172.21.15.6:0/2343441691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30580c4510 msgr2=0x7f305816a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.397+0000 7f305e4ab700 1 --2- 172.21.15.6:0/2343441691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30580c4510 0x7f305816a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.397+0000 7f305e4ab700 1 -- 172.21.15.6:0/2343441691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30581574b0 msgr2=0x7f30580c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.397+0000 7f305e4ab700 1 --2- 172.21.15.6:0/2343441691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30581574b0 0x7f30580c71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.397+0000 7f305e4ab700 1 -- 172.21.15.6:0/2343441691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c009420 con 0x7f30580b13f0 2023-10-06T02:24:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.398+0000 7f305e4ab700 1 --2- 172.21.15.6:0/2343441691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580b13f0 0x7f30581535a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f3050009390 tx=0x7f3050016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.398+0000 7f30567fc700 1 -- 172.21.15.6:0/2343441691 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305001cd60 con 0x7f30580b13f0 2023-10-06T02:24:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.398+0000 7f30567fc700 1 -- 172.21.15.6:0/2343441691 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305001a450 con 0x7f30580b13f0 2023-10-06T02:24:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.398+0000 7f306070f700 1 -- 172.21.15.6:0/2343441691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30500093c0 con 0x7f30580b13f0 2023-10-06T02:24:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.398+0000 7f30567fc700 1 -- 172.21.15.6:0/2343441691 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305001a810 con 0x7f30580b13f0 2023-10-06T02:24:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.398+0000 7f306070f700 1 -- 172.21.15.6:0/2343441691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3058154240 con 0x7f30580b13f0 2023-10-06T02:24:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.399+0000 7f306070f700 1 -- 172.21.15.6:0/2343441691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305806e590 con 0x7f30580b13f0 2023-10-06T02:24:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.399+0000 7f30567fc700 1 -- 172.21.15.6:0/2343441691 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f305001abc0 con 0x7f30580b13f0 2023-10-06T02:24:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.400+0000 7f30567fc700 1 --2- 172.21.15.6:0/2343441691 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3044066f30 0x7f30440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.400+0000 7f30567fc700 1 -- 172.21.15.6:0/2343441691 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f3050086220 con 0x7f30580b13f0 2023-10-06T02:24:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.400+0000 7f305dcaa700 1 --2- 172.21.15.6:0/2343441691 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3044066f30 0x7f30440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.400+0000 7f305dcaa700 1 --2- 172.21.15.6:0/2343441691 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3044066f30 0x7f30440693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f304c0093f0 tx=0x7f304c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.404+0000 7f30567fc700 1 -- 172.21.15.6:0/2343441691 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30500531a0 con 0x7f30580b13f0 2023-10-06T02:24:18.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.595+0000 7f306070f700 1 -- 172.21.15.6:0/2343441691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30580c34f0 con 0x7f30580b13f0 2023-10-06T02:24:18.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.596+0000 7f30567fc700 1 -- 172.21.15.6:0/2343441691 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f30500567c0 con 0x7f30580b13f0 2023-10-06T02:24:18.596 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:24:18.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.598+0000 7f306070f700 1 -- 172.21.15.6:0/2343441691 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3044066f30 msgr2=0x7f30440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.598+0000 7f306070f700 1 --2- 172.21.15.6:0/2343441691 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3044066f30 0x7f30440693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f304c0093f0 tx=0x7f304c008040 comp rx=0 tx=0).stop 2023-10-06T02:24:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.598+0000 7f306070f700 1 -- 172.21.15.6:0/2343441691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580b13f0 msgr2=0x7f30581535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.598+0000 7f306070f700 1 --2- 172.21.15.6:0/2343441691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580b13f0 0x7f30581535a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f3050009390 tx=0x7f3050016000 comp rx=0 tx=0).stop 2023-10-06T02:24:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.598+0000 7f306070f700 1 -- 172.21.15.6:0/2343441691 shutdown_connections 2023-10-06T02:24:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.598+0000 7f306070f700 1 --2- 172.21.15.6:0/2343441691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30581574b0 0x7f30580c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.598+0000 7f306070f700 1 --2- 172.21.15.6:0/2343441691 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3044066f30 0x7f30440693e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.598+0000 7f306070f700 1 --2- 172.21.15.6:0/2343441691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580b13f0 0x7f30581535a0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.598+0000 7f306070f700 1 --2- 172.21.15.6:0/2343441691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30580c4510 0x7f305816a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.598+0000 7f306070f700 1 -- 172.21.15.6:0/2343441691 >> 172.21.15.6:0/2343441691 conn(0x7f3058067910 msgr2=0x7f3058152a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.598+0000 7f306070f700 1 -- 172.21.15.6:0/2343441691 shutdown_connections 2023-10-06T02:24:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.598+0000 7f306070f700 1 -- 172.21.15.6:0/2343441691 wait complete. 2023-10-06T02:24:18.610 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:24:18.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.732+0000 7fd906d21700 1 Processor -- start 2023-10-06T02:24:18.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.732+0000 7fd906d21700 1 -- start start 2023-10-06T02:24:18.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.733+0000 7fd906d21700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd9000cd400 0x7fd9000b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.733+0000 7fd906d21700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9000af770 con 0x7fd9000b0810 2023-10-06T02:24:18.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.733+0000 7fd906d21700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9000afa50 con 0x7fd9000cd7d0 2023-10-06T02:24:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.733+0000 7fd906d21700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9000afd30 con 0x7fd9000cd400 2023-10-06T02:24:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.733+0000 7fd906520700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd9000b0810 0x7fd90015a8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52886/0 (socket says 172.21.15.6:52886) 2023-10-06T02:24:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.733+0000 7fd906520700 1 -- 172.21.15.6:0/3528217524 learned_addr learned my addr 172.21.15.6:0/3528217524 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.733+0000 7fd905d1f700 1 --2- 172.21.15.6:0/3528217524 >> v2:172.21.15.175:3300/0 conn(0x7fd9000cd400 0x7fd9000b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.733+0000 7fd904d1d700 1 -- 172.21.15.6:0/3528217524 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143347540 0 0) 0x7fd9000af770 con 0x7fd9000b0810 2023-10-06T02:24:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.733+0000 7fd904d1d700 1 -- 172.21.15.6:0/3528217524 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8e8003570 con 0x7fd9000b0810 2023-10-06T02:24:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.734+0000 7fd904d1d700 1 -- 172.21.15.6:0/3528217524 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768414740 0 0) 0x7fd9000afa50 con 0x7fd9000cd7d0 2023-10-06T02:24:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.734+0000 7fd904d1d700 1 -- 172.21.15.6:0/3528217524 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9000af770 con 0x7fd9000cd7d0 2023-10-06T02:24:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.734+0000 7fd905d1f700 1 -- 172.21.15.6:0/3528217524 >> v1:172.21.15.175:6789/0 conn(0x7fd9000cd7d0 legacy=0x7fd9000d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.734+0000 7fd904d1d700 1 -- 172.21.15.6:0/3528217524 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4279263986 0 0) 0x7fd8e8003570 con 0x7fd9000b0810 2023-10-06T02:24:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.734+0000 7fd905d1f700 1 -- 172.21.15.6:0/3528217524 >> v1:172.21.15.6:6789/0 conn(0x7fd9000b0810 legacy=0x7fd90015a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.734+0000 7fd905d1f700 1 -- 172.21.15.6:0/3528217524 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9000b0010 con 0x7fd9000cd400 2023-10-06T02:24:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.734+0000 7fd905d1f700 1 --2- 172.21.15.6:0/3528217524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9000cd400 0x7fd9000b1f20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009ee0 tx=0x7fd8f8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71c40243afd2eef3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.734+0000 7fd904d1d700 1 -- 172.21.15.6:0/3528217524 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f800e070 con 0x7fd9000cd400 2023-10-06T02:24:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.734+0000 7fd904d1d700 1 -- 172.21.15.6:0/3528217524 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f800b870 con 0x7fd9000cd400 2023-10-06T02:24:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.734+0000 7fd904d1d700 1 -- 172.21.15.6:0/3528217524 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0001470 con 0x7fd9000cd400 2023-10-06T02:24:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.735+0000 7fd906d21700 1 -- 172.21.15.6:0/3528217524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9000cd400 msgr2=0x7fd9000b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.735+0000 7fd906d21700 1 --2- 172.21.15.6:0/3528217524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9000cd400 0x7fd9000b1f20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009ee0 tx=0x7fd8f8009780 comp rx=0 tx=0).stop 2023-10-06T02:24:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.735+0000 7fd906d21700 1 -- 172.21.15.6:0/3528217524 shutdown_connections 2023-10-06T02:24:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.735+0000 7fd906d21700 1 --2- 172.21.15.6:0/3528217524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9000cd400 0x7fd9000b1f20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.735+0000 7fd906d21700 1 -- 172.21.15.6:0/3528217524 >> 172.21.15.6:0/3528217524 conn(0x7fd90006a110 msgr2=0x7fd90006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.735+0000 7fd906d21700 1 -- 172.21.15.6:0/3528217524 shutdown_connections 2023-10-06T02:24:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.735+0000 7fd906d21700 1 -- 172.21.15.6:0/3528217524 wait complete. 2023-10-06T02:24:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.736+0000 7fd906d21700 1 Processor -- start 2023-10-06T02:24:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.736+0000 7fd906d21700 1 -- start start 2023-10-06T02:24:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.736+0000 7fd906d21700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9000b0810 0x7fd9001548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd906d21700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9000cd400 0x7fd9000c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd906d21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9000c6210 0x7fd90015a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd906d21700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000c66b0 con 0x7fd9000c6210 2023-10-06T02:24:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd906d21700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000b2ee0 con 0x7fd9000cd400 2023-10-06T02:24:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd906d21700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000b34a0 con 0x7fd9000b0810 2023-10-06T02:24:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd906520700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9000c6210 0x7fd90015a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd906520700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9000c6210 0x7fd90015a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52076/0 (socket says 172.21.15.6:52076) 2023-10-06T02:24:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd906520700 1 -- 172.21.15.6:0/3713786100 learned_addr learned my addr 172.21.15.6:0/3713786100 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd90551e700 1 --2- 172.21.15.6:0/3713786100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9000cd400 0x7fd9000c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd905d1f700 1 --2- 172.21.15.6:0/3713786100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9000b0810 0x7fd9001548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd906520700 1 -- 172.21.15.6:0/3713786100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9000b0810 msgr2=0x7fd9001548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd906520700 1 --2- 172.21.15.6:0/3713786100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9000b0810 0x7fd9001548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd906520700 1 -- 172.21.15.6:0/3713786100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9000cd400 msgr2=0x7fd9000c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd906520700 1 --2- 172.21.15.6:0/3713786100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9000cd400 0x7fd9000c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd906520700 1 -- 172.21.15.6:0/3713786100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f8009a20 con 0x7fd9000c6210 2023-10-06T02:24:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd90551e700 1 --2- 172.21.15.6:0/3713786100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9000cd400 0x7fd9000c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd906520700 1 --2- 172.21.15.6:0/3713786100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9000c6210 0x7fd90015a8a0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000cba0 tx=0x7fd8f0001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd8fdffb700 1 -- 172.21.15.6:0/3713786100 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0007360 con 0x7fd9000c6210 2023-10-06T02:24:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd8fdffb700 1 -- 172.21.15.6:0/3713786100 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f00074e0 con 0x7fd9000c6210 2023-10-06T02:24:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd906d21700 1 -- 172.21.15.6:0/3713786100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90015b610 con 0x7fd9000c6210 2023-10-06T02:24:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.737+0000 7fd8fdffb700 1 -- 172.21.15.6:0/3713786100 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0004830 con 0x7fd9000c6210 2023-10-06T02:24:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.738+0000 7fd906d21700 1 -- 172.21.15.6:0/3713786100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9000b3130 con 0x7fd9000c6210 2023-10-06T02:24:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.738+0000 7fd906d21700 1 -- 172.21.15.6:0/3713786100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd900064aa0 con 0x7fd9000c6210 2023-10-06T02:24:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.739+0000 7fd8fdffb700 1 -- 172.21.15.6:0/3713786100 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8f0004be0 con 0x7fd9000c6210 2023-10-06T02:24:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.739+0000 7fd8fdffb700 1 --2- 172.21.15.6:0/3713786100 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8ec066f30 0x7fd8ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.739+0000 7fd8fdffb700 1 -- 172.21.15.6:0/3713786100 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fd8f0083c60 con 0x7fd9000c6210 2023-10-06T02:24:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.739+0000 7fd905d1f700 1 --2- 172.21.15.6:0/3713786100 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8ec066f30 0x7fd8ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.740+0000 7fd905d1f700 1 --2- 172.21.15.6:0/3713786100 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8ec066f30 0x7fd8ec0693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009eb0 tx=0x7fd8f8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.743+0000 7fd8fdffb700 1 -- 172.21.15.6:0/3713786100 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8f0050b60 con 0x7fd9000c6210 2023-10-06T02:24:18.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.935+0000 7fd906d21700 1 -- 172.21.15.6:0/3713786100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd9000b02f0 con 0x7fd9000c6210 2023-10-06T02:24:18.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.935+0000 7fd8fdffb700 1 -- 172.21.15.6:0/3713786100 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd8f00180a0 con 0x7fd9000c6210 2023-10-06T02:24:18.936 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:24:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.938+0000 7fd906d21700 1 -- 172.21.15.6:0/3713786100 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8ec066f30 msgr2=0x7fd8ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.938+0000 7fd906d21700 1 --2- 172.21.15.6:0/3713786100 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8ec066f30 0x7fd8ec0693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009eb0 tx=0x7fd8f8017000 comp rx=0 tx=0).stop 2023-10-06T02:24:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.938+0000 7fd906d21700 1 -- 172.21.15.6:0/3713786100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9000c6210 msgr2=0x7fd90015a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.938+0000 7fd906d21700 1 --2- 172.21.15.6:0/3713786100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9000c6210 0x7fd90015a8a0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000cba0 tx=0x7fd8f0001a30 comp rx=0 tx=0).stop 2023-10-06T02:24:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.938+0000 7fd906d21700 1 -- 172.21.15.6:0/3713786100 shutdown_connections 2023-10-06T02:24:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.938+0000 7fd906d21700 1 --2- 172.21.15.6:0/3713786100 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8ec066f30 0x7fd8ec0693e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.938+0000 7fd906d21700 1 --2- 172.21.15.6:0/3713786100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9000c6210 0x7fd90015a8a0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.938+0000 7fd906d21700 1 --2- 172.21.15.6:0/3713786100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9000b0810 0x7fd9001548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.938+0000 7fd906d21700 1 --2- 172.21.15.6:0/3713786100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9000cd400 0x7fd9000c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:18.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.938+0000 7fd906d21700 1 -- 172.21.15.6:0/3713786100 >> 172.21.15.6:0/3713786100 conn(0x7fd90006a110 msgr2=0x7fd9000cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:18.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.938+0000 7fd906d21700 1 -- 172.21.15.6:0/3713786100 shutdown_connections 2023-10-06T02:24:18.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:18.938+0000 7fd906d21700 1 -- 172.21.15.6:0/3713786100 wait complete. 2023-10-06T02:24:18.950 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:24:19.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.074+0000 7fe30ffb9700 1 Processor -- start 2023-10-06T02:24:19.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.075+0000 7fe30ffb9700 1 -- start start 2023-10-06T02:24:19.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.075+0000 7fe30ffb9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe30806c460 0x7fe30815da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.075+0000 7fe30ffb9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3080c7840 0x7fe308158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.075+0000 7fe30ffb9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe30806c830 0x7fe3081594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.075+0000 7fe30ffb9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30815dfc0 con 0x7fe30806c460 2023-10-06T02:24:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.075+0000 7fe30ffb9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3081599e0 con 0x7fe30806c830 2023-10-06T02:24:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.075+0000 7fe30ffb9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080c7cb0 con 0x7fe3080c7840 2023-10-06T02:24:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.076+0000 7fe30dd55700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe30806c460 0x7fe30815da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.076+0000 7fe30dd55700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe30806c460 0x7fe30815da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52088/0 (socket says 172.21.15.6:52088) 2023-10-06T02:24:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.076+0000 7fe30dd55700 1 -- 172.21.15.6:0/3414882281 learned_addr learned my addr 172.21.15.6:0/3414882281 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.076+0000 7fe30e556700 1 --2- 172.21.15.6:0/3414882281 >> v2:172.21.15.175:3300/0 conn(0x7fe30806c830 0x7fe3081594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.076+0000 7fe30d554700 1 --2- 172.21.15.6:0/3414882281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3080c7840 0x7fe308158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.076+0000 7fe30dd55700 1 -- 172.21.15.6:0/3414882281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3080c7840 msgr2=0x7fe308158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:19.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.076+0000 7fe30dd55700 1 --2- 172.21.15.6:0/3414882281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3080c7840 0x7fe308158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.076+0000 7fe30dd55700 1 -- 172.21.15.6:0/3414882281 >> v2:172.21.15.175:3300/0 conn(0x7fe30806c830 msgr2=0x7fe3081594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:19.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.076+0000 7fe30dd55700 1 --2- 172.21.15.6:0/3414882281 >> v2:172.21.15.175:3300/0 conn(0x7fe30806c830 0x7fe3081594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.076+0000 7fe30dd55700 1 -- 172.21.15.6:0/3414882281 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3080c7f90 con 0x7fe30806c460 2023-10-06T02:24:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.076+0000 7fe30dd55700 1 --2- 172.21.15.6:0/3414882281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe30806c460 0x7fe30815da80 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fe3080c70a0 tx=0x7fe300009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a8c328eaa875cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.076+0000 7fe30cd53700 1 -- 172.21.15.6:0/3414882281 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30000e070 con 0x7fe30806c460 2023-10-06T02:24:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.076+0000 7fe30cd53700 1 -- 172.21.15.6:0/3414882281 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30000ba50 con 0x7fe30806c460 2023-10-06T02:24:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.076+0000 7fe30cd53700 1 -- 172.21.15.6:0/3414882281 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3000092e0 con 0x7fe30806c460 2023-10-06T02:24:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.077+0000 7fe30ffb9700 1 -- 172.21.15.6:0/3414882281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe30806c460 msgr2=0x7fe30815da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.077+0000 7fe30ffb9700 1 --2- 172.21.15.6:0/3414882281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe30806c460 0x7fe30815da80 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fe3080c70a0 tx=0x7fe300009840 comp rx=0 tx=0).stop 2023-10-06T02:24:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.077+0000 7fe30ffb9700 1 -- 172.21.15.6:0/3414882281 shutdown_connections 2023-10-06T02:24:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.077+0000 7fe30ffb9700 1 --2- 172.21.15.6:0/3414882281 >> v2:172.21.15.175:3300/0 conn(0x7fe30806c830 0x7fe3081594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.077+0000 7fe30ffb9700 1 --2- 172.21.15.6:0/3414882281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe30806c460 0x7fe30815da80 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.077+0000 7fe30ffb9700 1 --2- 172.21.15.6:0/3414882281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3080c7840 0x7fe308158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.077+0000 7fe30ffb9700 1 -- 172.21.15.6:0/3414882281 >> 172.21.15.6:0/3414882281 conn(0x7fe3080c9cc0 msgr2=0x7fe30806acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:19.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.077+0000 7fe30ffb9700 1 -- 172.21.15.6:0/3414882281 shutdown_connections 2023-10-06T02:24:19.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.077+0000 7fe30ffb9700 1 -- 172.21.15.6:0/3414882281 wait complete. 2023-10-06T02:24:19.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.078+0000 7fe30ffb9700 1 Processor -- start 2023-10-06T02:24:19.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.078+0000 7fe30ffb9700 1 -- start start 2023-10-06T02:24:19.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30ffb9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe30806c460 0x7fe30816b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30ffb9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe30806c830 0x7fe308155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30ffb9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3080c7840 0x7fe3080b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30ffb9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30816b7a0 con 0x7fe3080c7840 2023-10-06T02:24:19.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30ffb9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080c38d0 con 0x7fe30806c830 2023-10-06T02:24:19.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30ffb9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080c3bb0 con 0x7fe30806c460 2023-10-06T02:24:19.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30e556700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3080c7840 0x7fe3080b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30e556700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3080c7840 0x7fe3080b0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52098/0 (socket says 172.21.15.6:52098) 2023-10-06T02:24:19.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30e556700 1 -- 172.21.15.6:0/4176057709 learned_addr learned my addr 172.21.15.6:0/4176057709 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:19.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30d554700 1 --2- 172.21.15.6:0/4176057709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe30806c830 0x7fe308155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30dd55700 1 --2- 172.21.15.6:0/4176057709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe30806c460 0x7fe30816b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30e556700 1 -- 172.21.15.6:0/4176057709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe30806c460 msgr2=0x7fe30816b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:19.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30e556700 1 --2- 172.21.15.6:0/4176057709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe30806c460 0x7fe30816b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30e556700 1 -- 172.21.15.6:0/4176057709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe30806c830 msgr2=0x7fe308155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30e556700 1 --2- 172.21.15.6:0/4176057709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe30806c830 0x7fe308155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30e556700 1 -- 172.21.15.6:0/4176057709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe300009ae0 con 0x7fe3080c7840 2023-10-06T02:24:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30e556700 1 --2- 172.21.15.6:0/4176057709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3080c7840 0x7fe3080b0f20 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800d890 tx=0x7fe2f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe305ffb700 1 -- 172.21.15.6:0/4176057709 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80125f0 con 0x7fe3080c7840 2023-10-06T02:24:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe305ffb700 1 -- 172.21.15.6:0/4176057709 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f8012770 con 0x7fe3080c7840 2023-10-06T02:24:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe30ffb9700 1 -- 172.21.15.6:0/4176057709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3080c3e90 con 0x7fe3080c7840 2023-10-06T02:24:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.079+0000 7fe305ffb700 1 -- 172.21.15.6:0/4176057709 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8012b30 con 0x7fe3080c7840 2023-10-06T02:24:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.080+0000 7fe30ffb9700 1 -- 172.21.15.6:0/4176057709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3080c4450 con 0x7fe3080c7840 2023-10-06T02:24:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.080+0000 7fe30ffb9700 1 -- 172.21.15.6:0/4176057709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3080c4670 con 0x7fe3080c7840 2023-10-06T02:24:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.081+0000 7fe305ffb700 1 -- 172.21.15.6:0/4176057709 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2f801e460 con 0x7fe3080c7840 2023-10-06T02:24:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.081+0000 7fe305ffb700 1 --2- 172.21.15.6:0/4176057709 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe2f4066f30 0x7fe2f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.081+0000 7fe305ffb700 1 -- 172.21.15.6:0/4176057709 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fe2f8084df0 con 0x7fe3080c7840 2023-10-06T02:24:19.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.082+0000 7fe30dd55700 1 --2- 172.21.15.6:0/4176057709 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe2f4066f30 0x7fe2f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.082+0000 7fe30dd55700 1 --2- 172.21.15.6:0/4176057709 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe2f4066f30 0x7fe2f40693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe300009880 tx=0x7fe300018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:19.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.086+0000 7fe305ffb700 1 -- 172.21.15.6:0/4176057709 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2f8051cf0 con 0x7fe3080c7840 2023-10-06T02:24:19.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.281+0000 7fe30ffb9700 1 -- 172.21.15.6:0/4176057709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe3080c8270 con 0x7fe3080c7840 2023-10-06T02:24:19.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.281+0000 7fe305ffb700 1 -- 172.21.15.6:0/4176057709 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe2f8055310 con 0x7fe3080c7840 2023-10-06T02:24:19.282 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-06T02:24:19.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.283+0000 7fe30ffb9700 1 -- 172.21.15.6:0/4176057709 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe2f4066f30 msgr2=0x7fe2f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:19.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.283+0000 7fe30ffb9700 1 --2- 172.21.15.6:0/4176057709 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe2f4066f30 0x7fe2f40693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe300009880 tx=0x7fe300018000 comp rx=0 tx=0).stop 2023-10-06T02:24:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.283+0000 7fe30ffb9700 1 -- 172.21.15.6:0/4176057709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3080c7840 msgr2=0x7fe3080b0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.283+0000 7fe30ffb9700 1 --2- 172.21.15.6:0/4176057709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3080c7840 0x7fe3080b0f20 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800d890 tx=0x7fe2f8008040 comp rx=0 tx=0).stop 2023-10-06T02:24:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.283+0000 7fe30ffb9700 1 -- 172.21.15.6:0/4176057709 shutdown_connections 2023-10-06T02:24:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.283+0000 7fe30ffb9700 1 --2- 172.21.15.6:0/4176057709 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe2f4066f30 0x7fe2f40693e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.283+0000 7fe30ffb9700 1 --2- 172.21.15.6:0/4176057709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3080c7840 0x7fe3080b0f20 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.283+0000 7fe30ffb9700 1 --2- 172.21.15.6:0/4176057709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe30806c460 0x7fe30816b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.283+0000 7fe30ffb9700 1 --2- 172.21.15.6:0/4176057709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe30806c830 0x7fe308155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.283+0000 7fe30ffb9700 1 -- 172.21.15.6:0/4176057709 >> 172.21.15.6:0/4176057709 conn(0x7fe3080c9cc0 msgr2=0x7fe308158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.283+0000 7fe30ffb9700 1 -- 172.21.15.6:0/4176057709 shutdown_connections 2023-10-06T02:24:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.284+0000 7fe30ffb9700 1 -- 172.21.15.6:0/4176057709 wait complete. 2023-10-06T02:24:19.296 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.416+0000 7f20821b5700 1 Processor -- start 2023-10-06T02:24:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.416+0000 7f20821b5700 1 -- start start 2023-10-06T02:24:19.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f20821b5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f207c155fb0 0x7f207c159d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f20821b5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207c0cb650 con 0x7f207c06b370 2023-10-06T02:24:19.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f20821b5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207c0caa40 con 0x7f207c156380 2023-10-06T02:24:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f20821b5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f207c06b7f0 con 0x7f207c155fb0 2023-10-06T02:24:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f207bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f207c06b370 0x7f207c0af440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52892/0 (socket says 172.21.15.6:52892) 2023-10-06T02:24:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f207bfff700 1 -- 172.21.15.6:0/2487823587 learned_addr learned my addr 172.21.15.6:0/2487823587 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f207b7fe700 1 --2- 172.21.15.6:0/2487823587 >> v2:172.21.15.175:3300/0 conn(0x7f207c155fb0 0x7f207c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f207a7fc700 1 -- 172.21.15.6:0/2487823587 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195402333 0 0) 0x7f207c0cb650 con 0x7f207c06b370 2023-10-06T02:24:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f207a7fc700 1 -- 172.21.15.6:0/2487823587 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2064003570 con 0x7f207c06b370 2023-10-06T02:24:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f207a7fc700 1 -- 172.21.15.6:0/2487823587 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3000319541 0 0) 0x7f2064003570 con 0x7f207c06b370 2023-10-06T02:24:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f207a7fc700 1 -- 172.21.15.6:0/2487823587 >> v2:172.21.15.175:3300/0 conn(0x7f207c155fb0 msgr2=0x7f207c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f207a7fc700 1 --2- 172.21.15.6:0/2487823587 >> v2:172.21.15.175:3300/0 conn(0x7f207c155fb0 0x7f207c159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f207a7fc700 1 -- 172.21.15.6:0/2487823587 >> v1:172.21.15.175:6789/0 conn(0x7f207c156380 legacy=0x7f207c0aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f207a7fc700 1 -- 172.21.15.6:0/2487823587 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c0cad20 con 0x7f207c06b370 2023-10-06T02:24:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f207b7fe700 1 --2- 172.21.15.6:0/2487823587 >> v2:172.21.15.175:3300/0 conn(0x7f207c155fb0 0x7f207c159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f207a7fc700 1 -- 172.21.15.6:0/2487823587 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f20740017f0 con 0x7f207c06b370 2023-10-06T02:24:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f207a7fc700 1 -- 172.21.15.6:0/2487823587 >> v1:172.21.15.6:6789/0 conn(0x7f207c06b370 legacy=0x7f207c0af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f207a7fc700 1 --2- 172.21.15.6:0/2487823587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2064003a60 0x7f2064003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f207a7fc700 1 --2- 172.21.15.6:0/2487823587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2064004810 0x7f2064004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.417+0000 7f207a7fc700 1 --2- 172.21.15.6:0/2487823587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20640051c0 0x7f206400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.418+0000 7f207a7fc700 1 -- 172.21.15.6:0/2487823587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207c06b7f0 con 0x7f20640051c0 2023-10-06T02:24:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.418+0000 7f207a7fc700 1 -- 172.21.15.6:0/2487823587 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206400c0d0 con 0x7f2064003a60 2023-10-06T02:24:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.418+0000 7f207a7fc700 1 -- 172.21.15.6:0/2487823587 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206400c290 con 0x7f2064004810 2023-10-06T02:24:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.418+0000 7f207bfff700 1 --2- 172.21.15.6:0/2487823587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20640051c0 0x7f206400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.418+0000 7f207b7fe700 1 --2- 172.21.15.6:0/2487823587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2064003a60 0x7f2064003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.418+0000 7f207affd700 1 --2- 172.21.15.6:0/2487823587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2064004810 0x7f2064004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.418+0000 7f207bfff700 1 -- 172.21.15.6:0/2487823587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2064004810 msgr2=0x7f2064004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:19.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.418+0000 7f207bfff700 1 --2- 172.21.15.6:0/2487823587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2064004810 0x7f2064004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.418+0000 7f207bfff700 1 -- 172.21.15.6:0/2487823587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2064003a60 msgr2=0x7f2064003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:19.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.418+0000 7f207bfff700 1 --2- 172.21.15.6:0/2487823587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2064003a60 0x7f2064003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.418+0000 7f207bfff700 1 -- 172.21.15.6:0/2487823587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2064003570 con 0x7f20640051c0 2023-10-06T02:24:19.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.418+0000 7f207bfff700 1 -- 172.21.15.6:0/2487823587 reap_dead start 2023-10-06T02:24:19.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.418+0000 7f207bfff700 1 --2- 172.21.15.6:0/2487823587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20640051c0 0x7f206400ba60 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f207400a930 tx=0x7f20740021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87b062727b87648 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:19.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.418+0000 7f207a7fc700 1 -- 172.21.15.6:0/2487823587 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20740070d0 con 0x7f20640051c0 2023-10-06T02:24:19.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.418+0000 7f207a7fc700 1 -- 172.21.15.6:0/2487823587 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2074007270 con 0x7f20640051c0 2023-10-06T02:24:19.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.418+0000 7f207a7fc700 1 -- 172.21.15.6:0/2487823587 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2074007630 con 0x7f20640051c0 2023-10-06T02:24:19.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.419+0000 7f20821b5700 1 -- 172.21.15.6:0/2487823587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20640051c0 msgr2=0x7f206400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:19.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.419+0000 7f20821b5700 1 --2- 172.21.15.6:0/2487823587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20640051c0 0x7f206400ba60 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f207400a930 tx=0x7f20740021d0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.419+0000 7f20821b5700 1 -- 172.21.15.6:0/2487823587 shutdown_connections 2023-10-06T02:24:19.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.419+0000 7f20821b5700 1 --2- 172.21.15.6:0/2487823587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20640051c0 0x7f206400ba60 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.419+0000 7f20821b5700 1 -- 172.21.15.6:0/2487823587 >> 172.21.15.6:0/2487823587 conn(0x7f207c069100 msgr2=0x7f207c0ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:19.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.419+0000 7f20821b5700 1 -- 172.21.15.6:0/2487823587 shutdown_connections 2023-10-06T02:24:19.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.419+0000 7f20821b5700 1 -- 172.21.15.6:0/2487823587 wait complete. 2023-10-06T02:24:19.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.420+0000 7f20821b5700 1 Processor -- start 2023-10-06T02:24:19.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.420+0000 7f20821b5700 1 -- start start 2023-10-06T02:24:19.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f20821b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20640051c0 0x7f207c0a8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f20821b5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f207c0ab990 0x7f207c0abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f20821b5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f207c150510 0x7f207c150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f20821b5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207c14f540 con 0x7f20640051c0 2023-10-06T02:24:19.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f20821b5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207c14f750 con 0x7f207c150510 2023-10-06T02:24:19.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f20821b5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207c14fa30 con 0x7f207c0ab990 2023-10-06T02:24:19.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f207b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20640051c0 0x7f207c0a8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f207b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20640051c0 0x7f207c0a8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52126/0 (socket says 172.21.15.6:52126) 2023-10-06T02:24:19.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f207b7fe700 1 -- 172.21.15.6:0/1043475933 learned_addr learned my addr 172.21.15.6:0/1043475933 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:19.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f207bfff700 1 --2- 172.21.15.6:0/1043475933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f207c150510 0x7f207c150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f207affd700 1 --2- 172.21.15.6:0/1043475933 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f207c0ab990 0x7f207c0abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f207b7fe700 1 -- 172.21.15.6:0/1043475933 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f207c0ab990 msgr2=0x7f207c0abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:19.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f207b7fe700 1 --2- 172.21.15.6:0/1043475933 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f207c0ab990 0x7f207c0abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f207b7fe700 1 -- 172.21.15.6:0/1043475933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f207c150510 msgr2=0x7f207c150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:19.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f207b7fe700 1 --2- 172.21.15.6:0/1043475933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f207c150510 0x7f207c150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f207b7fe700 1 -- 172.21.15.6:0/1043475933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c14fd10 con 0x7f20640051c0 2023-10-06T02:24:19.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f207b7fe700 1 --2- 172.21.15.6:0/1043475933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20640051c0 0x7f207c0a8b20 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f206c011d70 tx=0x7f206c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:19.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f20637fe700 1 -- 172.21.15.6:0/1043475933 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c011e70 con 0x7f20640051c0 2023-10-06T02:24:19.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f20637fe700 1 -- 172.21.15.6:0/1043475933 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206c00fc20 con 0x7f20640051c0 2023-10-06T02:24:19.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f20637fe700 1 -- 172.21.15.6:0/1043475933 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c01d480 con 0x7f20640051c0 2023-10-06T02:24:19.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.421+0000 7f20821b5700 1 -- 172.21.15.6:0/1043475933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207c14fff0 con 0x7f20640051c0 2023-10-06T02:24:19.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.422+0000 7f20821b5700 1 -- 172.21.15.6:0/1043475933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207c0a9220 con 0x7f20640051c0 2023-10-06T02:24:19.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.422+0000 7f20821b5700 1 -- 172.21.15.6:0/1043475933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f207c1501e0 con 0x7f20640051c0 2023-10-06T02:24:19.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.423+0000 7f20637fe700 1 -- 172.21.15.6:0/1043475933 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f206c01d870 con 0x7f20640051c0 2023-10-06T02:24:19.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.423+0000 7f20637fe700 1 --2- 172.21.15.6:0/1043475933 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2068066f60 0x7f2068069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.423+0000 7f20637fe700 1 -- 172.21.15.6:0/1043475933 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f206c018070 con 0x7f20640051c0 2023-10-06T02:24:19.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.424+0000 7f207affd700 1 --2- 172.21.15.6:0/1043475933 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2068066f60 0x7f2068069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.424+0000 7f207affd700 1 --2- 172.21.15.6:0/1043475933 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2068066f60 0x7f2068069410 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f207c147650 tx=0x7f207000c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:19.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.428+0000 7f20637fe700 1 -- 172.21.15.6:0/1043475933 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f206c052530 con 0x7f20640051c0 2023-10-06T02:24:19.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.667+0000 7f20821b5700 1 -- 172.21.15.6:0/1043475933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f207c0cb000 con 0x7f20640051c0 2023-10-06T02:24:19.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.667+0000 7f20637fe700 1 -- 172.21.15.6:0/1043475933 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f206c055b50 con 0x7f20640051c0 2023-10-06T02:24:19.668 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:19.668 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":77,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2575759355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2575759355},{"type":"v1","addr":"172.21.15.175:6836","nonce":2575759355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2523304335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2523304335},{"type":"v1","addr":"172.21.15.175:6837","nonce":2523304335}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7032,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1331184347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1331184347},{"type":"v1","addr":"172.21.15.6:6835","nonce":1331184347}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:38.399768+0000","modified":"2023-10-06T02:24:14.877092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6786},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6786":{"gid":6786,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":13,"addr":"172.21.15.6:6834/353268974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":353268974},{"type":"v1","addr":"172.21.15.6:6834","nonce":353268974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:24:19.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.669+0000 7f20821b5700 1 -- 172.21.15.6:0/1043475933 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2068066f60 msgr2=0x7f2068069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:19.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.669+0000 7f20821b5700 1 --2- 172.21.15.6:0/1043475933 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2068066f60 0x7f2068069410 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f207c147650 tx=0x7f207000c040 comp rx=0 tx=0).stop 2023-10-06T02:24:19.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.669+0000 7f20821b5700 1 -- 172.21.15.6:0/1043475933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20640051c0 msgr2=0x7f207c0a8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:19.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.669+0000 7f20821b5700 1 --2- 172.21.15.6:0/1043475933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20640051c0 0x7f207c0a8b20 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f206c011d70 tx=0x7f206c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.669+0000 7f20821b5700 1 -- 172.21.15.6:0/1043475933 shutdown_connections 2023-10-06T02:24:19.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.669+0000 7f20821b5700 1 --2- 172.21.15.6:0/1043475933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f207c150510 0x7f207c150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.669+0000 7f20821b5700 1 --2- 172.21.15.6:0/1043475933 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2068066f60 0x7f2068069410 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.669+0000 7f20821b5700 1 --2- 172.21.15.6:0/1043475933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20640051c0 0x7f207c0a8b20 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.669+0000 7f20821b5700 1 --2- 172.21.15.6:0/1043475933 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f207c0ab990 0x7f207c0abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.669+0000 7f20821b5700 1 -- 172.21.15.6:0/1043475933 >> 172.21.15.6:0/1043475933 conn(0x7f207c069100 msgr2=0x7f207c147810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:19.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.670+0000 7f20821b5700 1 -- 172.21.15.6:0/1043475933 shutdown_connections 2023-10-06T02:24:19.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.670+0000 7f20821b5700 1 -- 172.21.15.6:0/1043475933 wait complete. 2023-10-06T02:24:19.672 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 77 2023-10-06T02:24:19.682 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:19.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.800+0000 7f041ed83700 1 Processor -- start 2023-10-06T02:24:19.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.800+0000 7f041ed83700 1 -- start start 2023-10-06T02:24:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.801+0000 7f041ed83700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f04180abd80 0x7f041815a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.801+0000 7f041ed83700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04180c3220 con 0x7f04180ac150 2023-10-06T02:24:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.801+0000 7f041ed83700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041815aed0 con 0x7f04180c1de0 2023-10-06T02:24:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.801+0000 7f041ed83700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04181582c0 con 0x7f04180abd80 2023-10-06T02:24:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.801+0000 7f0417fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f04180ac150 0x7f0418157bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52898/0 (socket says 172.21.15.6:52898) 2023-10-06T02:24:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.801+0000 7f0417fff700 1 -- 172.21.15.6:0/820607995 learned_addr learned my addr 172.21.15.6:0/820607995 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.801+0000 7f041cb1f700 1 --2- 172.21.15.6:0/820607995 >> v2:172.21.15.175:3300/0 conn(0x7f04180abd80 0x7f041815a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.802+0000 7f041cb1f700 1 -- 172.21.15.6:0/820607995 >> v1:172.21.15.175:6789/0 conn(0x7f04180c1de0 legacy=0x7f0418068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.802+0000 7f041cb1f700 1 -- 172.21.15.6:0/820607995 >> v1:172.21.15.6:6789/0 conn(0x7f04180ac150 legacy=0x7f0418157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.802+0000 7f041cb1f700 1 -- 172.21.15.6:0/820607995 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0418159dd0 con 0x7f04180abd80 2023-10-06T02:24:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.802+0000 7f041cb1f700 1 --2- 172.21.15.6:0/820607995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04180abd80 0x7f041815a990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f040c0098e0 tx=0x7f040c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2539277a01b980bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:19.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.805+0000 7f04177fe700 1 -- 172.21.15.6:0/820607995 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c009e80 con 0x7f04180abd80 2023-10-06T02:24:19.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.805+0000 7f04177fe700 1 -- 172.21.15.6:0/820607995 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c00b860 con 0x7f04180abd80 2023-10-06T02:24:19.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.805+0000 7f04177fe700 1 -- 172.21.15.6:0/820607995 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c00bbe0 con 0x7f04180abd80 2023-10-06T02:24:19.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.805+0000 7f041ed83700 1 -- 172.21.15.6:0/820607995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04180abd80 msgr2=0x7f041815a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:19.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.805+0000 7f041ed83700 1 --2- 172.21.15.6:0/820607995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04180abd80 0x7f041815a990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f040c0098e0 tx=0x7f040c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.805+0000 7f041ed83700 1 -- 172.21.15.6:0/820607995 shutdown_connections 2023-10-06T02:24:19.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.805+0000 7f041ed83700 1 --2- 172.21.15.6:0/820607995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04180abd80 0x7f041815a990 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.805+0000 7f041ed83700 1 -- 172.21.15.6:0/820607995 >> 172.21.15.6:0/820607995 conn(0x7f0418069790 msgr2=0x7f0418069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:19.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.805+0000 7f041ed83700 1 -- 172.21.15.6:0/820607995 shutdown_connections 2023-10-06T02:24:19.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.805+0000 7f041ed83700 1 -- 172.21.15.6:0/820607995 wait complete. 2023-10-06T02:24:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.806+0000 7f041ed83700 1 Processor -- start 2023-10-06T02:24:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.807+0000 7f041ed83700 1 -- start start 2023-10-06T02:24:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.807+0000 7f041ed83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04180abd80 0x7f041815da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.807+0000 7f041ed83700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04180ac150 0x7f041816b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.807+0000 7f041ed83700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04180c1de0 0x7f041815bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.807+0000 7f041ed83700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041815b720 con 0x7f04180abd80 2023-10-06T02:24:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.807+0000 7f041ed83700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041815b140 con 0x7f04180c1de0 2023-10-06T02:24:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.807+0000 7f041ed83700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04180c53d0 con 0x7f04180ac150 2023-10-06T02:24:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.807+0000 7f041cb1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04180abd80 0x7f041815da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.807+0000 7f041cb1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04180abd80 0x7f041815da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52140/0 (socket says 172.21.15.6:52140) 2023-10-06T02:24:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.807+0000 7f041cb1f700 1 -- 172.21.15.6:0/3227626300 learned_addr learned my addr 172.21.15.6:0/3227626300 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.808+0000 7f041d320700 1 --2- 172.21.15.6:0/3227626300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04180c1de0 0x7f041815bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.808+0000 7f041cb1f700 1 -- 172.21.15.6:0/3227626300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04180ac150 msgr2=0x7f041816b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.808+0000 7f0417fff700 1 --2- 172.21.15.6:0/3227626300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04180ac150 0x7f041816b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.808+0000 7f041cb1f700 1 --2- 172.21.15.6:0/3227626300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04180ac150 0x7f041816b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.808+0000 7f041cb1f700 1 -- 172.21.15.6:0/3227626300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04180c1de0 msgr2=0x7f041815bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.808+0000 7f041cb1f700 1 --2- 172.21.15.6:0/3227626300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04180c1de0 0x7f041815bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.808+0000 7f041cb1f700 1 -- 172.21.15.6:0/3227626300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c009420 con 0x7f04180abd80 2023-10-06T02:24:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.808+0000 7f041d320700 1 --2- 172.21.15.6:0/3227626300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04180c1de0 0x7f041815bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.808+0000 7f0417fff700 1 --2- 172.21.15.6:0/3227626300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04180ac150 0x7f041816b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.808+0000 7f041cb1f700 1 --2- 172.21.15.6:0/3227626300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04180abd80 0x7f041815da30 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f04180c33b0 tx=0x7f040c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.808+0000 7f0414ff9700 1 -- 172.21.15.6:0/3227626300 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c00bb20 con 0x7f04180abd80 2023-10-06T02:24:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.808+0000 7f0414ff9700 1 -- 172.21.15.6:0/3227626300 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c025420 con 0x7f04180abd80 2023-10-06T02:24:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.808+0000 7f041ed83700 1 -- 172.21.15.6:0/3227626300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041815b3b0 con 0x7f04180abd80 2023-10-06T02:24:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.808+0000 7f0414ff9700 1 -- 172.21.15.6:0/3227626300 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0257c0 con 0x7f04180abd80 2023-10-06T02:24:19.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.808+0000 7f041ed83700 1 -- 172.21.15.6:0/3227626300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04180c4c30 con 0x7f04180abd80 2023-10-06T02:24:19.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.809+0000 7f041ed83700 1 -- 172.21.15.6:0/3227626300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04180c73c0 con 0x7f04180abd80 2023-10-06T02:24:19.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.809+0000 7f0414ff9700 1 -- 172.21.15.6:0/3227626300 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f040c023070 con 0x7f04180abd80 2023-10-06T02:24:19.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.810+0000 7f0414ff9700 1 --2- 172.21.15.6:0/3227626300 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f03fc066f30 0x7f03fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:19.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.810+0000 7f0414ff9700 1 -- 172.21.15.6:0/3227626300 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f040c085de0 con 0x7f04180abd80 2023-10-06T02:24:19.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.810+0000 7f0417fff700 1 --2- 172.21.15.6:0/3227626300 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f03fc066f30 0x7f03fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:19.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.811+0000 7f0417fff700 1 --2- 172.21.15.6:0/3227626300 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f03fc066f30 0x7f03fc0693e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f04180ca910 tx=0x7f0404009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:19.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:19.814+0000 7f0414ff9700 1 -- 172.21.15.6:0/3227626300 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f040c052d60 con 0x7f04180abd80 2023-10-06T02:24:19.996 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:24:19.998 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:24:20.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.009+0000 7f041ed83700 1 -- 172.21.15.6:0/3227626300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f041804bb80 con 0x7f04180abd80 2023-10-06T02:24:20.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.010+0000 7f0414ff9700 1 -- 172.21.15.6:0/3227626300 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+17153 (secure 0 0 0) 0x7f040c056380 con 0x7f04180abd80 2023-10-06T02:24:20.011 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:20.011 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":83,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:24:11.855878+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:36.143952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:37.374144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/1625434310":"2023-10-07T02:24:11.855798+0000","172.21.15.6:6833/1625434310":"2023-10-07T02:24:11.855798+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:20.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.013+0000 7f041ed83700 1 -- 172.21.15.6:0/3227626300 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f03fc066f30 msgr2=0x7f03fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.013+0000 7f041ed83700 1 --2- 172.21.15.6:0/3227626300 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f03fc066f30 0x7f03fc0693e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f04180ca910 tx=0x7f0404009040 comp rx=0 tx=0).stop 2023-10-06T02:24:20.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.013+0000 7f041ed83700 1 -- 172.21.15.6:0/3227626300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04180abd80 msgr2=0x7f041815da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.013+0000 7f041ed83700 1 --2- 172.21.15.6:0/3227626300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04180abd80 0x7f041815da30 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f04180c33b0 tx=0x7f040c017000 comp rx=0 tx=0).stop 2023-10-06T02:24:20.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.013+0000 7f041ed83700 1 -- 172.21.15.6:0/3227626300 shutdown_connections 2023-10-06T02:24:20.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.013+0000 7f041ed83700 1 --2- 172.21.15.6:0/3227626300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04180c1de0 0x7f041815bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.013+0000 7f041ed83700 1 --2- 172.21.15.6:0/3227626300 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f03fc066f30 0x7f03fc0693e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.013+0000 7f041ed83700 1 --2- 172.21.15.6:0/3227626300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04180abd80 0x7f041815da30 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.013+0000 7f041ed83700 1 --2- 172.21.15.6:0/3227626300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04180ac150 0x7f041816b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.013+0000 7f041ed83700 1 -- 172.21.15.6:0/3227626300 >> 172.21.15.6:0/3227626300 conn(0x7f0418069790 msgr2=0x7f04180c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:20.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.013+0000 7f041ed83700 1 -- 172.21.15.6:0/3227626300 shutdown_connections 2023-10-06T02:24:20.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.013+0000 7f041ed83700 1 -- 172.21.15.6:0/3227626300 wait complete. 2023-10-06T02:24:20.028 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:24:20.029 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:20.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.212+0000 7ffb84beb700 1 Processor -- start 2023-10-06T02:24:20.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.212+0000 7ffb84beb700 1 -- start start 2023-10-06T02:24:20.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb84beb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffb80069bf0 0x7ffb800b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb84beb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffb80069fc0 0x7ffb8006a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb84beb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb800ae930 0x7ffb800aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb84beb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb800b16c0 con 0x7ffb80069bf0 2023-10-06T02:24:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb84beb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb800b1f40 con 0x7ffb80069fc0 2023-10-06T02:24:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb84beb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800b08c0 con 0x7ffb800ae930 2023-10-06T02:24:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb7f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffb80069bf0 0x7ffb800b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb7f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffb80069bf0 0x7ffb800b0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52150/0 (socket says 172.21.15.6:52150) 2023-10-06T02:24:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb7f7fe700 1 -- 172.21.15.6:0/2766216151 learned_addr learned my addr 172.21.15.6:0/2766216151 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb7ffff700 1 --2- 172.21.15.6:0/2766216151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb800ae930 0x7ffb800aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb7effd700 1 --2- 172.21.15.6:0/2766216151 >> v2:172.21.15.175:3300/0 conn(0x7ffb80069fc0 0x7ffb8006a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb7f7fe700 1 -- 172.21.15.6:0/2766216151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb800ae930 msgr2=0x7ffb800aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb7f7fe700 1 --2- 172.21.15.6:0/2766216151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb800ae930 0x7ffb800aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb7f7fe700 1 -- 172.21.15.6:0/2766216151 >> v2:172.21.15.175:3300/0 conn(0x7ffb80069fc0 msgr2=0x7ffb8006a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb7f7fe700 1 --2- 172.21.15.6:0/2766216151 >> v2:172.21.15.175:3300/0 conn(0x7ffb80069fc0 0x7ffb8006a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb7f7fe700 1 -- 172.21.15.6:0/2766216151 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8006aac0 con 0x7ffb80069bf0 2023-10-06T02:24:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb7ffff700 1 --2- 172.21.15.6:0/2766216151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb800ae930 0x7ffb800aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.213+0000 7ffb7effd700 1 --2- 172.21.15.6:0/2766216151 >> v2:172.21.15.175:3300/0 conn(0x7ffb80069fc0 0x7ffb8006a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.214+0000 7ffb7f7fe700 1 --2- 172.21.15.6:0/2766216151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb80069bf0 0x7ffb800b0380 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ffb80088290 tx=0x7ffb70009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d4d9a6a4e7c8c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.214+0000 7ffb7e7fc700 1 -- 172.21.15.6:0/2766216151 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70005c10 con 0x7ffb80069bf0 2023-10-06T02:24:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.214+0000 7ffb7e7fc700 1 -- 172.21.15.6:0/2766216151 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb70005d70 con 0x7ffb80069bf0 2023-10-06T02:24:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.214+0000 7ffb7e7fc700 1 -- 172.21.15.6:0/2766216151 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7000b880 con 0x7ffb80069bf0 2023-10-06T02:24:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.214+0000 7ffb84beb700 1 -- 172.21.15.6:0/2766216151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb80069bf0 msgr2=0x7ffb800b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.214+0000 7ffb84beb700 1 --2- 172.21.15.6:0/2766216151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb80069bf0 0x7ffb800b0380 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ffb80088290 tx=0x7ffb70009220 comp rx=0 tx=0).stop 2023-10-06T02:24:20.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.214+0000 7ffb84beb700 1 -- 172.21.15.6:0/2766216151 shutdown_connections 2023-10-06T02:24:20.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.214+0000 7ffb84beb700 1 --2- 172.21.15.6:0/2766216151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb800ae930 0x7ffb800aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.214+0000 7ffb84beb700 1 --2- 172.21.15.6:0/2766216151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb80069bf0 0x7ffb800b0380 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.214+0000 7ffb84beb700 1 --2- 172.21.15.6:0/2766216151 >> v2:172.21.15.175:3300/0 conn(0x7ffb80069fc0 0x7ffb8006a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.214+0000 7ffb84beb700 1 -- 172.21.15.6:0/2766216151 >> 172.21.15.6:0/2766216151 conn(0x7ffb80067910 msgr2=0x7ffb800cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:20.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.214+0000 7ffb84beb700 1 -- 172.21.15.6:0/2766216151 shutdown_connections 2023-10-06T02:24:20.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.214+0000 7ffb84beb700 1 -- 172.21.15.6:0/2766216151 wait complete. 2023-10-06T02:24:20.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.216+0000 7ffb84beb700 1 Processor -- start 2023-10-06T02:24:20.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.216+0000 7ffb84beb700 1 -- start start 2023-10-06T02:24:20.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.216+0000 7ffb84beb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb80069bf0 0x7ffb80153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.216+0000 7ffb84beb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb80069fc0 0x7ffb80152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.216+0000 7ffb84beb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb800ae930 0x7ffb800b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.216+0000 7ffb84beb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb80153ab0 con 0x7ffb800ae930 2023-10-06T02:24:20.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.216+0000 7ffb84beb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb80152ea0 con 0x7ffb80069fc0 2023-10-06T02:24:20.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.216+0000 7ffb84beb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb80153180 con 0x7ffb80069bf0 2023-10-06T02:24:20.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.217+0000 7ffb7ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb800ae930 0x7ffb800b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.217+0000 7ffb7ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb800ae930 0x7ffb800b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52156/0 (socket says 172.21.15.6:52156) 2023-10-06T02:24:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.217+0000 7ffb7ffff700 1 -- 172.21.15.6:0/2413392122 learned_addr learned my addr 172.21.15.6:0/2413392122 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.217+0000 7ffb7effd700 1 --2- 172.21.15.6:0/2413392122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb80069fc0 0x7ffb80152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.217+0000 7ffb7f7fe700 1 --2- 172.21.15.6:0/2413392122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb80069bf0 0x7ffb80153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.217+0000 7ffb7ffff700 1 -- 172.21.15.6:0/2413392122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb80069bf0 msgr2=0x7ffb80153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.217+0000 7ffb7ffff700 1 --2- 172.21.15.6:0/2413392122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb80069bf0 0x7ffb80153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.217+0000 7ffb7ffff700 1 -- 172.21.15.6:0/2413392122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb80069fc0 msgr2=0x7ffb80152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.217+0000 7ffb7ffff700 1 --2- 172.21.15.6:0/2413392122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb80069fc0 0x7ffb80152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.217+0000 7ffb7ffff700 1 -- 172.21.15.6:0/2413392122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb70009480 con 0x7ffb800ae930 2023-10-06T02:24:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.217+0000 7ffb7ffff700 1 --2- 172.21.15.6:0/2413392122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb800ae930 0x7ffb800b2440 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800cef0 tx=0x7ffb78007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.217+0000 7ffb677fe700 1 -- 172.21.15.6:0/2413392122 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7800ae00 con 0x7ffb800ae930 2023-10-06T02:24:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.217+0000 7ffb677fe700 1 -- 172.21.15.6:0/2413392122 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb78016420 con 0x7ffb800ae930 2023-10-06T02:24:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.217+0000 7ffb677fe700 1 -- 172.21.15.6:0/2413392122 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb780167e0 con 0x7ffb800ae930 2023-10-06T02:24:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.217+0000 7ffb84beb700 1 -- 172.21.15.6:0/2413392122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb80153460 con 0x7ffb800ae930 2023-10-06T02:24:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.217+0000 7ffb84beb700 1 -- 172.21.15.6:0/2413392122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb80152c40 con 0x7ffb800ae930 2023-10-06T02:24:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.218+0000 7ffb84beb700 1 -- 172.21.15.6:0/2413392122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb80069750 con 0x7ffb800ae930 2023-10-06T02:24:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.219+0000 7ffb677fe700 1 -- 172.21.15.6:0/2413392122 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb78016bd0 con 0x7ffb800ae930 2023-10-06T02:24:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.219+0000 7ffb677fe700 1 --2- 172.21.15.6:0/2413392122 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffb6c066f30 0x7ffb6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.219+0000 7ffb677fe700 1 -- 172.21.15.6:0/2413392122 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ffb78012070 con 0x7ffb800ae930 2023-10-06T02:24:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.219+0000 7ffb7f7fe700 1 --2- 172.21.15.6:0/2413392122 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffb6c066f30 0x7ffb6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.220+0000 7ffb7f7fe700 1 --2- 172.21.15.6:0/2413392122 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffb6c066f30 0x7ffb6c0693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ffb70009260 tx=0x7ffb70016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:20.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.223+0000 7ffb677fe700 1 -- 172.21.15.6:0/2413392122 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb7804e5a0 con 0x7ffb800ae930 2023-10-06T02:24:20.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.462+0000 7ffb84beb700 1 -- 172.21.15.6:0/2413392122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb80154480 con 0x7ffb800ae930 2023-10-06T02:24:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.463+0000 7ffb677fe700 1 -- 172.21.15.6:0/2413392122 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4598 (secure 0 0 0) 0x7ffb78052140 con 0x7ffb800ae930 2023-10-06T02:24:20.463 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:20.463 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":77,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2575759355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2575759355},{"type":"v1","addr":"172.21.15.175:6836","nonce":2575759355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2523304335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2523304335},{"type":"v1","addr":"172.21.15.175:6837","nonce":2523304335}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7032,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1331184347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1331184347},{"type":"v1","addr":"172.21.15.6:6835","nonce":1331184347}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:38.399768+0000","modified":"2023-10-06T02:24:14.877092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6786},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6786":{"gid":6786,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":13,"addr":"172.21.15.6:6834/353268974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":353268974},{"type":"v1","addr":"172.21.15.6:6834","nonce":353268974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:24:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.465+0000 7ffb84beb700 1 -- 172.21.15.6:0/2413392122 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffb6c066f30 msgr2=0x7ffb6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.465+0000 7ffb84beb700 1 --2- 172.21.15.6:0/2413392122 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffb6c066f30 0x7ffb6c0693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ffb70009260 tx=0x7ffb70016000 comp rx=0 tx=0).stop 2023-10-06T02:24:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.465+0000 7ffb84beb700 1 -- 172.21.15.6:0/2413392122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb800ae930 msgr2=0x7ffb800b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.465+0000 7ffb84beb700 1 --2- 172.21.15.6:0/2413392122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb800ae930 0x7ffb800b2440 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800cef0 tx=0x7ffb78007860 comp rx=0 tx=0).stop 2023-10-06T02:24:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.465+0000 7ffb84beb700 1 -- 172.21.15.6:0/2413392122 shutdown_connections 2023-10-06T02:24:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.465+0000 7ffb84beb700 1 --2- 172.21.15.6:0/2413392122 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffb6c066f30 0x7ffb6c0693e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.465+0000 7ffb84beb700 1 --2- 172.21.15.6:0/2413392122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb800ae930 0x7ffb800b2440 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.465+0000 7ffb84beb700 1 --2- 172.21.15.6:0/2413392122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb80069bf0 0x7ffb80153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.465+0000 7ffb84beb700 1 --2- 172.21.15.6:0/2413392122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb80069fc0 0x7ffb80152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.465+0000 7ffb84beb700 1 -- 172.21.15.6:0/2413392122 >> 172.21.15.6:0/2413392122 conn(0x7ffb80067910 msgr2=0x7ffb8006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.465+0000 7ffb84beb700 1 -- 172.21.15.6:0/2413392122 shutdown_connections 2023-10-06T02:24:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.465+0000 7ffb84beb700 1 -- 172.21.15.6:0/2413392122 wait complete. 2023-10-06T02:24:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 77 2023-10-06T02:24:20.478 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:20.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.596+0000 7f02d4034700 1 Processor -- start 2023-10-06T02:24:20.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.597+0000 7f02d4034700 1 -- start start 2023-10-06T02:24:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.597+0000 7f02d4034700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f02cc0af8b0 0x7f02cc15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.597+0000 7f02d4034700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02cc15e190 con 0x7f02cc0b27f0 2023-10-06T02:24:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.597+0000 7f02d4034700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02cc0cb650 con 0x7f02cc0af4e0 2023-10-06T02:24:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.597+0000 7f02d4034700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02cc0b1910 con 0x7f02cc0af8b0 2023-10-06T02:24:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.597+0000 7f02d25d1700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f02cc0b27f0 0x7f02cc15d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52908/0 (socket says 172.21.15.6:52908) 2023-10-06T02:24:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.597+0000 7f02d25d1700 1 -- 172.21.15.6:0/3484312366 learned_addr learned my addr 172.21.15.6:0/3484312366 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.598+0000 7f02d15cf700 1 --2- 172.21.15.6:0/3484312366 >> v2:172.21.15.175:3300/0 conn(0x7f02cc0af8b0 0x7f02cc15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.598+0000 7f02d0dce700 1 -- 172.21.15.6:0/3484312366 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049578649 0 0) 0x7f02cc15e190 con 0x7f02cc0b27f0 2023-10-06T02:24:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.598+0000 7f02d0dce700 1 -- 172.21.15.6:0/3484312366 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02b4003570 con 0x7f02cc0b27f0 2023-10-06T02:24:20.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.598+0000 7f02d15cf700 1 -- 172.21.15.6:0/3484312366 >> v1:172.21.15.175:6789/0 conn(0x7f02cc0af4e0 legacy=0x7f02cc0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.598+0000 7f02d15cf700 1 -- 172.21.15.6:0/3484312366 >> v1:172.21.15.6:6789/0 conn(0x7f02cc0b27f0 legacy=0x7f02cc15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.598+0000 7f02d0dce700 1 -- 172.21.15.6:0/3484312366 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 283944036 0 0) 0x7f02b4003570 con 0x7f02cc0b27f0 2023-10-06T02:24:20.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.598+0000 7f02d15cf700 1 -- 172.21.15.6:0/3484312366 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc0ccaf0 con 0x7f02cc0af8b0 2023-10-06T02:24:20.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.598+0000 7f02d15cf700 1 --2- 172.21.15.6:0/3484312366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02cc0af8b0 0x7f02cc15d460 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f02c00098e0 tx=0x7f02c00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cff9c01aebb91d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:20.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.598+0000 7f02d0dce700 1 -- 172.21.15.6:0/3484312366 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc001470 con 0x7f02cc0af8b0 2023-10-06T02:24:20.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.598+0000 7f02d0dce700 1 -- 172.21.15.6:0/3484312366 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c0011420 con 0x7f02cc0af8b0 2023-10-06T02:24:20.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.598+0000 7f02d0dce700 1 -- 172.21.15.6:0/3484312366 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c00117a0 con 0x7f02cc0af8b0 2023-10-06T02:24:20.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.599+0000 7f02d4034700 1 -- 172.21.15.6:0/3484312366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02cc0af8b0 msgr2=0x7f02cc15d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.599+0000 7f02d4034700 1 --2- 172.21.15.6:0/3484312366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02cc0af8b0 0x7f02cc15d460 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f02c00098e0 tx=0x7f02c00091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.599+0000 7f02d4034700 1 -- 172.21.15.6:0/3484312366 shutdown_connections 2023-10-06T02:24:20.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.599+0000 7f02d4034700 1 --2- 172.21.15.6:0/3484312366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02cc0af8b0 0x7f02cc15d460 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.599+0000 7f02d4034700 1 -- 172.21.15.6:0/3484312366 >> 172.21.15.6:0/3484312366 conn(0x7f02cc068680 msgr2=0x7f02cc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:20.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.599+0000 7f02d4034700 1 -- 172.21.15.6:0/3484312366 shutdown_connections 2023-10-06T02:24:20.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.599+0000 7f02d4034700 1 -- 172.21.15.6:0/3484312366 wait complete. 2023-10-06T02:24:20.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.600+0000 7f02d4034700 1 Processor -- start 2023-10-06T02:24:20.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.600+0000 7f02d4034700 1 -- start start 2023-10-06T02:24:20.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.601+0000 7f02d4034700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02cc0af4e0 0x7f02cc143fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.601+0000 7f02d4034700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02cc0af8b0 0x7f02cc16d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.601+0000 7f02d4034700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02cc0b27f0 0x7f02cc159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.601+0000 7f02d4034700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc1444f0 con 0x7f02cc0af8b0 2023-10-06T02:24:20.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.601+0000 7f02d4034700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc169db0 con 0x7f02cc0b27f0 2023-10-06T02:24:20.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.601+0000 7f02d4034700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc0d0460 con 0x7f02cc0af4e0 2023-10-06T02:24:20.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.601+0000 7f02d15cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02cc0af8b0 0x7f02cc16d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.601+0000 7f02d15cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02cc0af8b0 0x7f02cc16d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52172/0 (socket says 172.21.15.6:52172) 2023-10-06T02:24:20.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.601+0000 7f02d15cf700 1 -- 172.21.15.6:0/2922927166 learned_addr learned my addr 172.21.15.6:0/2922927166 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:20.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.601+0000 7f02d1dd0700 1 --2- 172.21.15.6:0/2922927166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02cc0af4e0 0x7f02cc143fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.601+0000 7f02d25d1700 1 --2- 172.21.15.6:0/2922927166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02cc0b27f0 0x7f02cc159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.601+0000 7f02d15cf700 1 -- 172.21.15.6:0/2922927166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02cc0af4e0 msgr2=0x7f02cc143fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.601+0000 7f02d15cf700 1 --2- 172.21.15.6:0/2922927166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02cc0af4e0 0x7f02cc143fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.601+0000 7f02d15cf700 1 -- 172.21.15.6:0/2922927166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02cc0b27f0 msgr2=0x7f02cc159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.601+0000 7f02d15cf700 1 --2- 172.21.15.6:0/2922927166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02cc0b27f0 0x7f02cc159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.601+0000 7f02d15cf700 1 -- 172.21.15.6:0/2922927166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c0009420 con 0x7f02cc0af8b0 2023-10-06T02:24:20.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.601+0000 7f02d15cf700 1 --2- 172.21.15.6:0/2922927166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02cc0af8b0 0x7f02cc16d620 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f02c0002000 tx=0x7f02c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:20.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.602+0000 7f02c9ffb700 1 -- 172.21.15.6:0/2922927166 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c001cce0 con 0x7f02cc0af8b0 2023-10-06T02:24:20.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.602+0000 7f02c9ffb700 1 -- 172.21.15.6:0/2922927166 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c001ce40 con 0x7f02cc0af8b0 2023-10-06T02:24:20.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.602+0000 7f02d4034700 1 -- 172.21.15.6:0/2922927166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02cc0d0740 con 0x7f02cc0af8b0 2023-10-06T02:24:20.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.602+0000 7f02c9ffb700 1 -- 172.21.15.6:0/2922927166 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c001a6a0 con 0x7f02cc0af8b0 2023-10-06T02:24:20.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.602+0000 7f02d4034700 1 -- 172.21.15.6:0/2922927166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02cc1417b0 con 0x7f02cc0af8b0 2023-10-06T02:24:20.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.603+0000 7f02d4034700 1 -- 172.21.15.6:0/2922927166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02cc1419a0 con 0x7f02cc0af8b0 2023-10-06T02:24:20.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.603+0000 7f02c9ffb700 1 -- 172.21.15.6:0/2922927166 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f02c001aa90 con 0x7f02cc0af8b0 2023-10-06T02:24:20.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.604+0000 7f02c9ffb700 1 --2- 172.21.15.6:0/2922927166 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f02b8066f30 0x7f02b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.604+0000 7f02c9ffb700 1 -- 172.21.15.6:0/2922927166 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f02c0086170 con 0x7f02cc0af8b0 2023-10-06T02:24:20.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.604+0000 7f02d1dd0700 1 --2- 172.21.15.6:0/2922927166 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f02b8066f30 0x7f02b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.604+0000 7f02d1dd0700 1 --2- 172.21.15.6:0/2922927166 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f02b8066f30 0x7f02b80693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f02c4007fd0 tx=0x7f02c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:20.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.608+0000 7f02c9ffb700 1 -- 172.21.15.6:0/2922927166 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02c00530f0 con 0x7f02cc0af8b0 2023-10-06T02:24:20.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.849+0000 7f02d4034700 1 -- 172.21.15.6:0/2922927166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02cc0cad20 con 0x7f02cc0af8b0 2023-10-06T02:24:20.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.849+0000 7f02c9ffb700 1 -- 172.21.15.6:0/2922927166 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f02c0056710 con 0x7f02cc0af8b0 2023-10-06T02:24:20.850 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:20.850 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":77,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2575759355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2575759355},{"type":"v1","addr":"172.21.15.175:6836","nonce":2575759355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2523304335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2523304335},{"type":"v1","addr":"172.21.15.175:6837","nonce":2523304335}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7032,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1331184347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1331184347},{"type":"v1","addr":"172.21.15.6:6835","nonce":1331184347}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:38.399768+0000","modified":"2023-10-06T02:24:14.877092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6786},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6786":{"gid":6786,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":13,"addr":"172.21.15.6:6834/353268974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":353268974},{"type":"v1","addr":"172.21.15.6:6834","nonce":353268974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:24:20.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.851+0000 7f02d4034700 1 -- 172.21.15.6:0/2922927166 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f02b8066f30 msgr2=0x7f02b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.851+0000 7f02d4034700 1 --2- 172.21.15.6:0/2922927166 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f02b8066f30 0x7f02b80693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f02c4007fd0 tx=0x7f02c4009040 comp rx=0 tx=0).stop 2023-10-06T02:24:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.851+0000 7f02d4034700 1 -- 172.21.15.6:0/2922927166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02cc0af8b0 msgr2=0x7f02cc16d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.851+0000 7f02d4034700 1 --2- 172.21.15.6:0/2922927166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02cc0af8b0 0x7f02cc16d620 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f02c0002000 tx=0x7f02c0016000 comp rx=0 tx=0).stop 2023-10-06T02:24:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.851+0000 7f02d4034700 1 -- 172.21.15.6:0/2922927166 shutdown_connections 2023-10-06T02:24:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.851+0000 7f02d4034700 1 --2- 172.21.15.6:0/2922927166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02cc0b27f0 0x7f02cc159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.851+0000 7f02d4034700 1 --2- 172.21.15.6:0/2922927166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02cc0af4e0 0x7f02cc143fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.851+0000 7f02d4034700 1 --2- 172.21.15.6:0/2922927166 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f02b8066f30 0x7f02b80693e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.851+0000 7f02d4034700 1 --2- 172.21.15.6:0/2922927166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02cc0af8b0 0x7f02cc16d620 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.851+0000 7f02d4034700 1 -- 172.21.15.6:0/2922927166 >> 172.21.15.6:0/2922927166 conn(0x7f02cc068680 msgr2=0x7f02cc0b4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.851+0000 7f02d4034700 1 -- 172.21.15.6:0/2922927166 shutdown_connections 2023-10-06T02:24:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.852+0000 7f02d4034700 1 -- 172.21.15.6:0/2922927166 wait complete. 2023-10-06T02:24:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 77 2023-10-06T02:24:20.864 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:20.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.984+0000 7fa829913700 1 Processor -- start 2023-10-06T02:24:20.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.984+0000 7fa829913700 1 -- start start 2023-10-06T02:24:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa829913700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8240af4e0 0x7fa8240b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa829913700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa82415db70 0x7fa8240b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa829913700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82415e190 con 0x7fa8240af8b0 2023-10-06T02:24:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa829913700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8240b1910 con 0x7fa8240af4e0 2023-10-06T02:24:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa829913700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82415dfa0 con 0x7fa82415db70 2023-10-06T02:24:20.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa822ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8240af4e0 0x7fa8240b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa8227fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa8240af8b0 0x7fa82415d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52918/0 (socket says 172.21.15.6:52918) 2023-10-06T02:24:20.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa822ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8240af4e0 0x7fa8240b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52174/0 (socket says 172.21.15.6:52174) 2023-10-06T02:24:20.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa8227fc700 1 -- 172.21.15.6:0/2310164155 learned_addr learned my addr 172.21.15.6:0/2310164155 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:20.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa8237fe700 1 --2- 172.21.15.6:0/2310164155 >> v2:172.21.15.175:3300/0 conn(0x7fa82415db70 0x7fa8240b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa822ffd700 1 -- 172.21.15.6:0/2310164155 >> v2:172.21.15.175:3300/0 conn(0x7fa82415db70 msgr2=0x7fa8240b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:20.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa822ffd700 1 --2- 172.21.15.6:0/2310164155 >> v2:172.21.15.175:3300/0 conn(0x7fa82415db70 0x7fa8240b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa822ffd700 1 -- 172.21.15.6:0/2310164155 >> v1:172.21.15.6:6789/0 conn(0x7fa8240af8b0 legacy=0x7fa82415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa821ffb700 1 -- 172.21.15.6:0/2310164155 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259810822 0 0) 0x7fa82415e190 con 0x7fa8240af8b0 2023-10-06T02:24:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa822ffd700 1 -- 172.21.15.6:0/2310164155 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8240cb650 con 0x7fa8240af4e0 2023-10-06T02:24:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa822ffd700 1 --2- 172.21.15.6:0/2310164155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8240af4e0 0x7fa8240b20e0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fa8240c7280 tx=0x7fa81c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d5d2257c5baa27 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa821ffb700 1 -- 172.21.15.6:0/2310164155 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c00e070 con 0x7fa8240af4e0 2023-10-06T02:24:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa821ffb700 1 -- 172.21.15.6:0/2310164155 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c00bb60 con 0x7fa8240af4e0 2023-10-06T02:24:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.985+0000 7fa821ffb700 1 -- 172.21.15.6:0/2310164155 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c012430 con 0x7fa8240af4e0 2023-10-06T02:24:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.986+0000 7fa829913700 1 -- 172.21.15.6:0/2310164155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8240af4e0 msgr2=0x7fa8240b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.986+0000 7fa829913700 1 --2- 172.21.15.6:0/2310164155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8240af4e0 0x7fa8240b20e0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fa8240c7280 tx=0x7fa81c009780 comp rx=0 tx=0).stop 2023-10-06T02:24:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.986+0000 7fa829913700 1 -- 172.21.15.6:0/2310164155 shutdown_connections 2023-10-06T02:24:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.986+0000 7fa829913700 1 --2- 172.21.15.6:0/2310164155 >> v2:172.21.15.175:3300/0 conn(0x7fa82415db70 0x7fa8240b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.986+0000 7fa829913700 1 --2- 172.21.15.6:0/2310164155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8240af4e0 0x7fa8240b20e0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.986+0000 7fa829913700 1 -- 172.21.15.6:0/2310164155 >> 172.21.15.6:0/2310164155 conn(0x7fa824068680 msgr2=0x7fa824068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.986+0000 7fa829913700 1 -- 172.21.15.6:0/2310164155 shutdown_connections 2023-10-06T02:24:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.986+0000 7fa829913700 1 -- 172.21.15.6:0/2310164155 wait complete. 2023-10-06T02:24:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.987+0000 7fa829913700 1 Processor -- start 2023-10-06T02:24:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.987+0000 7fa829913700 1 -- start start 2023-10-06T02:24:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.988+0000 7fa829913700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8240af4e0 0x7fa8240c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.988+0000 7fa829913700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8240af8b0 0x7fa82416d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.988+0000 7fa829913700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa82415db70 0x7fa82416db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.988+0000 7fa829913700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8240cf090 con 0x7fa8240af4e0 2023-10-06T02:24:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.988+0000 7fa829913700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8240c8e90 con 0x7fa8240af8b0 2023-10-06T02:24:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.988+0000 7fa829913700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8240c85f0 con 0x7fa82415db70 2023-10-06T02:24:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.988+0000 7fa822ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8240af4e0 0x7fa8240c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.988+0000 7fa822ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8240af4e0 0x7fa8240c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52184/0 (socket says 172.21.15.6:52184) 2023-10-06T02:24:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.988+0000 7fa822ffd700 1 -- 172.21.15.6:0/179781255 learned_addr learned my addr 172.21.15.6:0/179781255 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.988+0000 7fa8227fc700 1 --2- 172.21.15.6:0/179781255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8240af8b0 0x7fa82416d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.988+0000 7fa8237fe700 1 --2- 172.21.15.6:0/179781255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa82415db70 0x7fa82416db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.988+0000 7fa822ffd700 1 -- 172.21.15.6:0/179781255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa82415db70 msgr2=0x7fa82416db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.988+0000 7fa822ffd700 1 --2- 172.21.15.6:0/179781255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa82415db70 0x7fa82416db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.988+0000 7fa822ffd700 1 -- 172.21.15.6:0/179781255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8240af8b0 msgr2=0x7fa82416d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.988+0000 7fa822ffd700 1 --2- 172.21.15.6:0/179781255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8240af8b0 0x7fa82416d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.988+0000 7fa822ffd700 1 -- 172.21.15.6:0/179781255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c009a20 con 0x7fa8240af4e0 2023-10-06T02:24:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.988+0000 7fa8227fc700 1 --2- 172.21.15.6:0/179781255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8240af8b0 0x7fa82416d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.989+0000 7fa822ffd700 1 --2- 172.21.15.6:0/179781255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8240af4e0 0x7fa8240c9ac0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0099f0 tx=0x7fa81c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.989+0000 7fa81affd700 1 -- 172.21.15.6:0/179781255 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c027470 con 0x7fa8240af4e0 2023-10-06T02:24:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.989+0000 7fa81affd700 1 -- 172.21.15.6:0/179781255 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c027610 con 0x7fa8240af4e0 2023-10-06T02:24:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.989+0000 7fa81affd700 1 -- 172.21.15.6:0/179781255 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c0279d0 con 0x7fa8240af4e0 2023-10-06T02:24:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.989+0000 7fa829913700 1 -- 172.21.15.6:0/179781255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8240c88d0 con 0x7fa8240af4e0 2023-10-06T02:24:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.989+0000 7fa829913700 1 -- 172.21.15.6:0/179781255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8240ca000 con 0x7fa8240af4e0 2023-10-06T02:24:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.990+0000 7fa829913700 1 -- 172.21.15.6:0/179781255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa824088aa0 con 0x7fa8240af4e0 2023-10-06T02:24:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.990+0000 7fa81affd700 1 -- 172.21.15.6:0/179781255 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa81c024070 con 0x7fa8240af4e0 2023-10-06T02:24:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.991+0000 7fa81affd700 1 --2- 172.21.15.6:0/179781255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa804066f30 0x7fa8040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.991+0000 7fa81affd700 1 -- 172.21.15.6:0/179781255 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fa81c086f50 con 0x7fa8240af4e0 2023-10-06T02:24:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.991+0000 7fa8227fc700 1 --2- 172.21.15.6:0/179781255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa804066f30 0x7fa8040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.991+0000 7fa8227fc700 1 --2- 172.21.15.6:0/179781255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa804066f30 0x7fa8040693e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa8240c6d60 tx=0x7fa80c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:20.995+0000 7fa81affd700 1 -- 172.21.15.6:0/179781255 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa81c053e40 con 0x7fa8240af4e0 2023-10-06T02:24:21.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.191+0000 7fa829913700 1 -- 172.21.15.6:0/179781255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa824068ef0 con 0x7fa8240af4e0 2023-10-06T02:24:21.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.192+0000 7fa81affd700 1 -- 172.21.15.6:0/179781255 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+17153 (secure 0 0 0) 0x7fa81c057460 con 0x7fa8240af4e0 2023-10-06T02:24:21.193 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:21.193 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":83,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:24:11.855878+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:36.143952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:37.374144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/1625434310":"2023-10-07T02:24:11.855798+0000","172.21.15.6:6833/1625434310":"2023-10-07T02:24:11.855798+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.194+0000 7fa829913700 1 -- 172.21.15.6:0/179781255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa804066f30 msgr2=0x7fa8040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.194+0000 7fa829913700 1 --2- 172.21.15.6:0/179781255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa804066f30 0x7fa8040693e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa8240c6d60 tx=0x7fa80c009040 comp rx=0 tx=0).stop 2023-10-06T02:24:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.194+0000 7fa829913700 1 -- 172.21.15.6:0/179781255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8240af4e0 msgr2=0x7fa8240c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.194+0000 7fa829913700 1 --2- 172.21.15.6:0/179781255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8240af4e0 0x7fa8240c9ac0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0099f0 tx=0x7fa81c019000 comp rx=0 tx=0).stop 2023-10-06T02:24:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.194+0000 7fa829913700 1 -- 172.21.15.6:0/179781255 shutdown_connections 2023-10-06T02:24:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.194+0000 7fa829913700 1 --2- 172.21.15.6:0/179781255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa82415db70 0x7fa82416db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.194+0000 7fa829913700 1 --2- 172.21.15.6:0/179781255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa804066f30 0x7fa8040693e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.194+0000 7fa829913700 1 --2- 172.21.15.6:0/179781255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8240af4e0 0x7fa8240c9ac0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.194+0000 7fa829913700 1 --2- 172.21.15.6:0/179781255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8240af8b0 0x7fa82416d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.194+0000 7fa829913700 1 -- 172.21.15.6:0/179781255 >> 172.21.15.6:0/179781255 conn(0x7fa824068680 msgr2=0x7fa8240b54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.194+0000 7fa829913700 1 -- 172.21.15.6:0/179781255 shutdown_connections 2023-10-06T02:24:21.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.194+0000 7fa829913700 1 -- 172.21.15.6:0/179781255 wait complete. 2023-10-06T02:24:21.207 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:24:21.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.327+0000 7fe68ef20700 1 Processor -- start 2023-10-06T02:24:21.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.327+0000 7fe68ef20700 1 -- start start 2023-10-06T02:24:21.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.328+0000 7fe68ef20700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe688086ff0 0x7fe688087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:21.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.328+0000 7fe68ef20700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6880afc50 con 0x7fe68815a030 2023-10-06T02:24:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.328+0000 7fe68ef20700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6880aff30 con 0x7fe6880b21b0 2023-10-06T02:24:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.328+0000 7fe68ef20700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6880b0cf0 con 0x7fe688086ff0 2023-10-06T02:24:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.328+0000 7fe687fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe688086ff0 0x7fe688087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.328+0000 7fe687fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe688086ff0 0x7fe688087470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52188/0 (socket says 172.21.15.6:52188) 2023-10-06T02:24:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.328+0000 7fe68ccbc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe68815a030 0x7fe68815a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52920/0 (socket says 172.21.15.6:52920) 2023-10-06T02:24:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.328+0000 7fe687fff700 1 -- 172.21.15.6:0/3475989799 learned_addr learned my addr 172.21.15.6:0/3475989799 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.328+0000 7fe687fff700 1 -- 172.21.15.6:0/3475989799 >> v1:172.21.15.175:6789/0 conn(0x7fe6880b21b0 legacy=0x7fe6880b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.328+0000 7fe687fff700 1 -- 172.21.15.6:0/3475989799 >> v1:172.21.15.6:6789/0 conn(0x7fe68815a030 legacy=0x7fe68815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.328+0000 7fe687fff700 1 -- 172.21.15.6:0/3475989799 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6880b0210 con 0x7fe688086ff0 2023-10-06T02:24:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.328+0000 7fe6877fe700 1 -- 172.21.15.6:0/3475989799 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233215262 0 0) 0x7fe6880afc50 con 0x7fe68815a030 2023-10-06T02:24:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.328+0000 7fe687fff700 1 --2- 172.21.15.6:0/3475989799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe688086ff0 0x7fe688087470 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fe6780099b0 tx=0x7fe678009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6316cc5f4f58b4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.328+0000 7fe6877fe700 1 -- 172.21.15.6:0/3475989799 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67800b860 con 0x7fe688086ff0 2023-10-06T02:24:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.328+0000 7fe6877fe700 1 -- 172.21.15.6:0/3475989799 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67800b9c0 con 0x7fe688086ff0 2023-10-06T02:24:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.328+0000 7fe6877fe700 1 -- 172.21.15.6:0/3475989799 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67800bd60 con 0x7fe688086ff0 2023-10-06T02:24:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.329+0000 7fe68ef20700 1 -- 172.21.15.6:0/3475989799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe688086ff0 msgr2=0x7fe688087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.329+0000 7fe68ef20700 1 --2- 172.21.15.6:0/3475989799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe688086ff0 0x7fe688087470 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fe6780099b0 tx=0x7fe678009250 comp rx=0 tx=0).stop 2023-10-06T02:24:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.329+0000 7fe68ef20700 1 -- 172.21.15.6:0/3475989799 shutdown_connections 2023-10-06T02:24:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.329+0000 7fe68ef20700 1 --2- 172.21.15.6:0/3475989799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe688086ff0 0x7fe688087470 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.329+0000 7fe68ef20700 1 -- 172.21.15.6:0/3475989799 >> 172.21.15.6:0/3475989799 conn(0x7fe688068680 msgr2=0x7fe688068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.329+0000 7fe68ef20700 1 -- 172.21.15.6:0/3475989799 shutdown_connections 2023-10-06T02:24:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.329+0000 7fe68ef20700 1 -- 172.21.15.6:0/3475989799 wait complete. 2023-10-06T02:24:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.330+0000 7fe68ef20700 1 Processor -- start 2023-10-06T02:24:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.330+0000 7fe68ef20700 1 -- start start 2023-10-06T02:24:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.331+0000 7fe68ef20700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe688086ff0 0x7fe6880c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.331+0000 7fe68ef20700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6880b21b0 0x7fe6880c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.331+0000 7fe68ef20700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe68815a030 0x7fe68815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.331+0000 7fe68ef20700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68815b3d0 con 0x7fe688086ff0 2023-10-06T02:24:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.331+0000 7fe68ef20700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6880ca480 con 0x7fe6880b21b0 2023-10-06T02:24:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.331+0000 7fe68ef20700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68815b620 con 0x7fe68815a030 2023-10-06T02:24:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.331+0000 7fe68ccbc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe688086ff0 0x7fe6880c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.331+0000 7fe68ccbc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe688086ff0 0x7fe6880c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52200/0 (socket says 172.21.15.6:52200) 2023-10-06T02:24:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.331+0000 7fe68ccbc700 1 -- 172.21.15.6:0/1569395088 learned_addr learned my addr 172.21.15.6:0/1569395088 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.331+0000 7fe68ccbc700 1 -- 172.21.15.6:0/1569395088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe68815a030 msgr2=0x7fe68815c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.331+0000 7fe68ccbc700 1 --2- 172.21.15.6:0/1569395088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe68815a030 0x7fe68815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.331+0000 7fe687fff700 1 --2- 172.21.15.6:0/1569395088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6880b21b0 0x7fe6880c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.331+0000 7fe68ccbc700 1 -- 172.21.15.6:0/1569395088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6880b21b0 msgr2=0x7fe6880c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.331+0000 7fe68ccbc700 1 --2- 172.21.15.6:0/1569395088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6880b21b0 0x7fe6880c4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.331+0000 7fe68ccbc700 1 -- 172.21.15.6:0/1569395088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6780094f0 con 0x7fe688086ff0 2023-10-06T02:24:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.332+0000 7fe68ccbc700 1 --2- 172.21.15.6:0/1569395088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe688086ff0 0x7fe6880c9f40 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe67000c810 tx=0x7fe670007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.332+0000 7fe684ff9700 1 -- 172.21.15.6:0/1569395088 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6700073d0 con 0x7fe688086ff0 2023-10-06T02:24:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.332+0000 7fe684ff9700 1 -- 172.21.15.6:0/1569395088 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe670007550 con 0x7fe688086ff0 2023-10-06T02:24:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.332+0000 7fe68ef20700 1 -- 172.21.15.6:0/1569395088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68815b900 con 0x7fe688086ff0 2023-10-06T02:24:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.332+0000 7fe684ff9700 1 -- 172.21.15.6:0/1569395088 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe670004a80 con 0x7fe688086ff0 2023-10-06T02:24:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.332+0000 7fe68ef20700 1 -- 172.21.15.6:0/1569395088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68815bec0 con 0x7fe688086ff0 2023-10-06T02:24:21.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.333+0000 7fe68ef20700 1 -- 172.21.15.6:0/1569395088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe688088700 con 0x7fe688086ff0 2023-10-06T02:24:21.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.333+0000 7fe684ff9700 1 -- 172.21.15.6:0/1569395088 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe67001c3b0 con 0x7fe688086ff0 2023-10-06T02:24:21.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.333+0000 7fe684ff9700 1 --2- 172.21.15.6:0/1569395088 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe668066f30 0x7fe6680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:21.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.334+0000 7fe684ff9700 1 -- 172.21.15.6:0/1569395088 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fe670083d20 con 0x7fe688086ff0 2023-10-06T02:24:21.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.334+0000 7fe687fff700 1 --2- 172.21.15.6:0/1569395088 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe668066f30 0x7fe6680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:21.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.334+0000 7fe687fff700 1 --2- 172.21.15.6:0/1569395088 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe668066f30 0x7fe6680693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe6780099b0 tx=0x7fe678017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:21.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.338+0000 7fe684ff9700 1 -- 172.21.15.6:0/1569395088 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe670050d20 con 0x7fe688086ff0 2023-10-06T02:24:21.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.575+0000 7fe68ef20700 1 -- 172.21.15.6:0/1569395088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe688068420 con 0x7fe688086ff0 2023-10-06T02:24:21.576 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:24:21.575+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:24:21.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.582+0000 7fe684ff9700 1 -- 172.21.15.6:0/1569395088 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v78) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe670018090 con 0x7fe688086ff0 2023-10-06T02:24:21.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.584+0000 7fe68ef20700 1 -- 172.21.15.6:0/1569395088 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe668066f30 msgr2=0x7fe6680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:21.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.584+0000 7fe68ef20700 1 --2- 172.21.15.6:0/1569395088 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe668066f30 0x7fe6680693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe6780099b0 tx=0x7fe678017000 comp rx=0 tx=0).stop 2023-10-06T02:24:21.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.584+0000 7fe68ef20700 1 -- 172.21.15.6:0/1569395088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe688086ff0 msgr2=0x7fe6880c9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:21.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.584+0000 7fe68ef20700 1 --2- 172.21.15.6:0/1569395088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe688086ff0 0x7fe6880c9f40 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe67000c810 tx=0x7fe670007d90 comp rx=0 tx=0).stop 2023-10-06T02:24:21.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.584+0000 7fe68ef20700 1 -- 172.21.15.6:0/1569395088 shutdown_connections 2023-10-06T02:24:21.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.584+0000 7fe68ef20700 1 --2- 172.21.15.6:0/1569395088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe68815a030 0x7fe68815c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:21.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.584+0000 7fe68ef20700 1 --2- 172.21.15.6:0/1569395088 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe668066f30 0x7fe6680693e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:21.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.584+0000 7fe68ef20700 1 --2- 172.21.15.6:0/1569395088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe688086ff0 0x7fe6880c9f40 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:21.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.584+0000 7fe68ef20700 1 --2- 172.21.15.6:0/1569395088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6880b21b0 0x7fe6880c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:21.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.584+0000 7fe68ef20700 1 -- 172.21.15.6:0/1569395088 >> 172.21.15.6:0/1569395088 conn(0x7fe688068680 msgr2=0x7fe6880b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:21.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.584+0000 7fe68ef20700 1 -- 172.21.15.6:0/1569395088 shutdown_connections 2023-10-06T02:24:21.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.584+0000 7fe68ef20700 1 -- 172.21.15.6:0/1569395088 wait complete. 2023-10-06T02:24:21.586 INFO:tasks.ceph.mds.a.smithi006.stderr: -70> 2023-10-06T02:24:18.323+0000 7f5b78c53700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:24:21.586 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:24:21.598 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:24:21.608 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:24:21.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.719+0000 7fb4b2942700 1 Processor -- start 2023-10-06T02:24:21.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.719+0000 7fb4b2942700 1 -- start start 2023-10-06T02:24:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.720+0000 7fb4b2942700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb4ac0cd7d0 0x7fb4ac0d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.720+0000 7fb4b2942700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4ac0b0810 0x7fb4ac0d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.720+0000 7fb4b2942700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ac0d0c20 con 0x7fb4ac0cd400 2023-10-06T02:24:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.720+0000 7fb4b2942700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ac0af770 con 0x7fb4ac0b0810 2023-10-06T02:24:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.720+0000 7fb4b2942700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ac0afa50 con 0x7fb4ac0cd7d0 2023-10-06T02:24:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.720+0000 7fb4b2141700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4ac0b0810 0x7fb4ac0d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.720+0000 7fb4b2141700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4ac0b0810 0x7fb4ac0d06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52214/0 (socket says 172.21.15.6:52214) 2023-10-06T02:24:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.720+0000 7fb4b2141700 1 -- 172.21.15.6:0/2691310435 learned_addr learned my addr 172.21.15.6:0/2691310435 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:21.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.720+0000 7fb4b113f700 1 --2- 172.21.15.6:0/2691310435 >> v2:172.21.15.175:3300/0 conn(0x7fb4ac0cd7d0 0x7fb4ac0d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:21.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.720+0000 7fb4b2141700 1 -- 172.21.15.6:0/2691310435 >> v2:172.21.15.175:3300/0 conn(0x7fb4ac0cd7d0 msgr2=0x7fb4ac0d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:21.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.720+0000 7fb4b2141700 1 --2- 172.21.15.6:0/2691310435 >> v2:172.21.15.175:3300/0 conn(0x7fb4ac0cd7d0 0x7fb4ac0d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:21.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.720+0000 7fb4b2141700 1 -- 172.21.15.6:0/2691310435 >> v1:172.21.15.175:6789/0 conn(0x7fb4ac0cd400 legacy=0x7fb4ac0b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:21.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.721+0000 7fb4b2141700 1 -- 172.21.15.6:0/2691310435 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac0afd30 con 0x7fb4ac0b0810 2023-10-06T02:24:21.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.721+0000 7fb4b2141700 1 --2- 172.21.15.6:0/2691310435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac0b0810 0x7fb4ac0d06e0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009f20 tx=0x7fb49c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f8119782b6e68f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:21.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.721+0000 7fb4b093e700 1 -- 172.21.15.6:0/2691310435 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00e070 con 0x7fb4ac0b0810 2023-10-06T02:24:21.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.721+0000 7fb4b093e700 1 -- 172.21.15.6:0/2691310435 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c00ba40 con 0x7fb4ac0b0810 2023-10-06T02:24:21.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.721+0000 7fb4b093e700 1 -- 172.21.15.6:0/2691310435 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c0092e0 con 0x7fb4ac0b0810 2023-10-06T02:24:21.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.721+0000 7fb4b2942700 1 -- 172.21.15.6:0/2691310435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac0b0810 msgr2=0x7fb4ac0d06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:21.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.721+0000 7fb4b2942700 1 --2- 172.21.15.6:0/2691310435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac0b0810 0x7fb4ac0d06e0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009f20 tx=0x7fb49c009840 comp rx=0 tx=0).stop 2023-10-06T02:24:21.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.721+0000 7fb4b2942700 1 -- 172.21.15.6:0/2691310435 shutdown_connections 2023-10-06T02:24:21.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.721+0000 7fb4b2942700 1 --2- 172.21.15.6:0/2691310435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac0b0810 0x7fb4ac0d06e0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:21.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.721+0000 7fb4b2942700 1 --2- 172.21.15.6:0/2691310435 >> v2:172.21.15.175:3300/0 conn(0x7fb4ac0cd7d0 0x7fb4ac0d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:21.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.721+0000 7fb4b2942700 1 -- 172.21.15.6:0/2691310435 >> 172.21.15.6:0/2691310435 conn(0x7fb4ac06a110 msgr2=0x7fb4ac06a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:21.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.722+0000 7fb4b2942700 1 -- 172.21.15.6:0/2691310435 shutdown_connections 2023-10-06T02:24:21.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.722+0000 7fb4b2942700 1 -- 172.21.15.6:0/2691310435 wait complete. 2023-10-06T02:24:21.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.723+0000 7fb4b2942700 1 Processor -- start 2023-10-06T02:24:21.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.723+0000 7fb4b2942700 1 -- start start 2023-10-06T02:24:21.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.723+0000 7fb4b2942700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4ac0b0810 0x7fb4ac14d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:21.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.723+0000 7fb4b2942700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac0cd400 0x7fb4ac157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:21.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.723+0000 7fb4b2942700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4ac154190 0x7fb4ac154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:21.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.723+0000 7fb4b2942700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac15d2a0 con 0x7fb4ac0cd400 2023-10-06T02:24:21.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.723+0000 7fb4b2942700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac14d7b0 con 0x7fb4ac0b0810 2023-10-06T02:24:21.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.723+0000 7fb4b2942700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac15cc90 con 0x7fb4ac154190 2023-10-06T02:24:21.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.723+0000 7fb4b113f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac0cd400 0x7fb4ac157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:21.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.724+0000 7fb4b113f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac0cd400 0x7fb4ac157d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52230/0 (socket says 172.21.15.6:52230) 2023-10-06T02:24:21.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.724+0000 7fb4b113f700 1 -- 172.21.15.6:0/2310247404 learned_addr learned my addr 172.21.15.6:0/2310247404 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:21.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.724+0000 7fb4b2141700 1 --2- 172.21.15.6:0/2310247404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4ac154190 0x7fb4ac154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:21.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.724+0000 7fb4b1940700 1 --2- 172.21.15.6:0/2310247404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4ac0b0810 0x7fb4ac14d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:21.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.724+0000 7fb4b113f700 1 -- 172.21.15.6:0/2310247404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4ac154190 msgr2=0x7fb4ac154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:21.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.724+0000 7fb4b113f700 1 --2- 172.21.15.6:0/2310247404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4ac154190 0x7fb4ac154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:21.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.724+0000 7fb4b113f700 1 -- 172.21.15.6:0/2310247404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4ac0b0810 msgr2=0x7fb4ac14d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:21.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.724+0000 7fb4b113f700 1 --2- 172.21.15.6:0/2310247404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4ac0b0810 0x7fb4ac14d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:21.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.724+0000 7fb4b113f700 1 -- 172.21.15.6:0/2310247404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49c009ae0 con 0x7fb4ac0cd400 2023-10-06T02:24:21.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.724+0000 7fb4b113f700 1 --2- 172.21.15.6:0/2310247404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac0cd400 0x7fb4ac157d10 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000d890 tx=0x7fb4a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:21.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.724+0000 7fb4a9ffb700 1 -- 172.21.15.6:0/2310247404 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0018070 con 0x7fb4ac0cd400 2023-10-06T02:24:21.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.724+0000 7fb4a9ffb700 1 -- 172.21.15.6:0/2310247404 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a00125f0 con 0x7fb4ac0cd400 2023-10-06T02:24:21.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.724+0000 7fb4b2942700 1 -- 172.21.15.6:0/2310247404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ac1546f0 con 0x7fb4ac0cd400 2023-10-06T02:24:21.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.724+0000 7fb4a9ffb700 1 -- 172.21.15.6:0/2310247404 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0012990 con 0x7fb4ac0cd400 2023-10-06T02:24:21.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.724+0000 7fb4b2942700 1 -- 172.21.15.6:0/2310247404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ac0c7280 con 0x7fb4ac0cd400 2023-10-06T02:24:21.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.725+0000 7fb4b2942700 1 -- 172.21.15.6:0/2310247404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ac15d450 con 0x7fb4ac0cd400 2023-10-06T02:24:21.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.726+0000 7fb4a9ffb700 1 -- 172.21.15.6:0/2310247404 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4a0012d40 con 0x7fb4ac0cd400 2023-10-06T02:24:21.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.726+0000 7fb4a9ffb700 1 --2- 172.21.15.6:0/2310247404 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb498066fb0 0x7fb498069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:21.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.726+0000 7fb4a9ffb700 1 -- 172.21.15.6:0/2310247404 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fb4a0084ae0 con 0x7fb4ac0cd400 2023-10-06T02:24:21.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.726+0000 7fb4b1940700 1 --2- 172.21.15.6:0/2310247404 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb498066fb0 0x7fb498069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:21.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.727+0000 7fb4b1940700 1 --2- 172.21.15.6:0/2310247404 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb498066fb0 0x7fb498069460 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4007fd0 tx=0x7fb4a4007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:21.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.730+0000 7fb4a9ffb700 1 -- 172.21.15.6:0/2310247404 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4ac15d450 con 0x7fb4ac0cd400 2023-10-06T02:24:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:21.967+0000 7fb4b2942700 1 -- 172.21.15.6:0/2310247404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb4ac15d450 con 0x7fb4ac0cd400 2023-10-06T02:24:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.580+0000 7fb4a9ffb700 1 -- 172.21.15.6:0/2310247404 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v79) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb4ac15d450 con 0x7fb4ac0cd400 2023-10-06T02:24:22.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.583+0000 7fb4b2942700 1 -- 172.21.15.6:0/2310247404 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb498066fb0 msgr2=0x7fb498069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:22.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.583+0000 7fb4b2942700 1 --2- 172.21.15.6:0/2310247404 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb498066fb0 0x7fb498069460 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4007fd0 tx=0x7fb4a4007eb0 comp rx=0 tx=0).stop 2023-10-06T02:24:22.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.583+0000 7fb4b2942700 1 -- 172.21.15.6:0/2310247404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac0cd400 msgr2=0x7fb4ac157d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:22.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.583+0000 7fb4b2942700 1 --2- 172.21.15.6:0/2310247404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac0cd400 0x7fb4ac157d10 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000d890 tx=0x7fb4a0008040 comp rx=0 tx=0).stop 2023-10-06T02:24:22.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.583+0000 7fb4b2942700 1 -- 172.21.15.6:0/2310247404 shutdown_connections 2023-10-06T02:24:22.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.583+0000 7fb4b2942700 1 --2- 172.21.15.6:0/2310247404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4ac154190 0x7fb4ac154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:22.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.583+0000 7fb4b2942700 1 --2- 172.21.15.6:0/2310247404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4ac0b0810 0x7fb4ac14d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:22.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.583+0000 7fb4b2942700 1 --2- 172.21.15.6:0/2310247404 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb498066fb0 0x7fb498069460 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:22.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.583+0000 7fb4b2942700 1 --2- 172.21.15.6:0/2310247404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac0cd400 0x7fb4ac157d10 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:22.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.583+0000 7fb4b2942700 1 -- 172.21.15.6:0/2310247404 >> 172.21.15.6:0/2310247404 conn(0x7fb4ac06a110 msgr2=0x7fb4ac14f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:22.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.583+0000 7fb4b2942700 1 -- 172.21.15.6:0/2310247404 shutdown_connections 2023-10-06T02:24:22.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.583+0000 7fb4b2942700 1 -- 172.21.15.6:0/2310247404 wait complete. 2023-10-06T02:24:22.599 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:24:22.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.769+0000 7fa3f6c50700 1 Processor -- start 2023-10-06T02:24:22.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.769+0000 7fa3f6c50700 1 -- start start 2023-10-06T02:24:22.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.770+0000 7fa3f6c50700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa3f0156d10 0x7fa3f015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:22.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.770+0000 7fa3f6c50700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3f00cc350 0x7fa3f00d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:22.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.770+0000 7fa3f6c50700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f00cd440 con 0x7fa3f01570e0 2023-10-06T02:24:22.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.770+0000 7fa3f6c50700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f006afd0 con 0x7fa3f00cc350 2023-10-06T02:24:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.770+0000 7fa3f6c50700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f00cc830 con 0x7fa3f0156d10 2023-10-06T02:24:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.770+0000 7fa3effff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3f00cc350 0x7fa3f00d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.770+0000 7fa3effff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3f00cc350 0x7fa3f00d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52242/0 (socket says 172.21.15.6:52242) 2023-10-06T02:24:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.770+0000 7fa3effff700 1 -- 172.21.15.6:0/59154260 learned_addr learned my addr 172.21.15.6:0/59154260 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.770+0000 7fa3f49ec700 1 --2- 172.21.15.6:0/59154260 >> v2:172.21.15.175:3300/0 conn(0x7fa3f0156d10 0x7fa3f015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.770+0000 7fa3effff700 1 -- 172.21.15.6:0/59154260 >> v2:172.21.15.175:3300/0 conn(0x7fa3f0156d10 msgr2=0x7fa3f015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.770+0000 7fa3effff700 1 --2- 172.21.15.6:0/59154260 >> v2:172.21.15.175:3300/0 conn(0x7fa3f0156d10 0x7fa3f015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.770+0000 7fa3effff700 1 -- 172.21.15.6:0/59154260 >> v1:172.21.15.175:6789/0 conn(0x7fa3f01570e0 legacy=0x7fa3f015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.770+0000 7fa3effff700 1 -- 172.21.15.6:0/59154260 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f00ccb10 con 0x7fa3f00cc350 2023-10-06T02:24:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.770+0000 7fa3f49ec700 1 --2- 172.21.15.6:0/59154260 >> v2:172.21.15.175:3300/0 conn(0x7fa3f0156d10 0x7fa3f015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.770+0000 7fa3effff700 1 --2- 172.21.15.6:0/59154260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f00cc350 0x7fa3f00d0260 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00892a0 tx=0x7fa3e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80da61267ed91858 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.771+0000 7fa3ef7fe700 1 -- 172.21.15.6:0/59154260 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e000b820 con 0x7fa3f00cc350 2023-10-06T02:24:22.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.771+0000 7fa3ef7fe700 1 -- 172.21.15.6:0/59154260 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e000b980 con 0x7fa3f00cc350 2023-10-06T02:24:22.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.771+0000 7fa3ef7fe700 1 -- 172.21.15.6:0/59154260 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e000bd20 con 0x7fa3f00cc350 2023-10-06T02:24:22.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.771+0000 7fa3f6c50700 1 -- 172.21.15.6:0/59154260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f00cc350 msgr2=0x7fa3f00d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:22.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.771+0000 7fa3f6c50700 1 --2- 172.21.15.6:0/59154260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f00cc350 0x7fa3f00d0260 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00892a0 tx=0x7fa3e0009250 comp rx=0 tx=0).stop 2023-10-06T02:24:22.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.771+0000 7fa3f6c50700 1 -- 172.21.15.6:0/59154260 shutdown_connections 2023-10-06T02:24:22.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.771+0000 7fa3f6c50700 1 --2- 172.21.15.6:0/59154260 >> v2:172.21.15.175:3300/0 conn(0x7fa3f0156d10 0x7fa3f015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:22.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.771+0000 7fa3f6c50700 1 --2- 172.21.15.6:0/59154260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f00cc350 0x7fa3f00d0260 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:22.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.771+0000 7fa3f6c50700 1 -- 172.21.15.6:0/59154260 >> 172.21.15.6:0/59154260 conn(0x7fa3f0069150 msgr2=0x7fa3f006a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:22.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.771+0000 7fa3f6c50700 1 -- 172.21.15.6:0/59154260 shutdown_connections 2023-10-06T02:24:22.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.771+0000 7fa3f6c50700 1 -- 172.21.15.6:0/59154260 wait complete. 2023-10-06T02:24:22.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.772+0000 7fa3f6c50700 1 Processor -- start 2023-10-06T02:24:22.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.773+0000 7fa3f6c50700 1 -- start start 2023-10-06T02:24:22.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.773+0000 7fa3f6c50700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f00cc350 0x7fa3f01515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:22.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.773+0000 7fa3f6c50700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3f0156d10 0x7fa3f00b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:22.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.773+0000 7fa3f6c50700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3f01570e0 0x7fa3f00b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:22.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.773+0000 7fa3f6c50700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f014b900 con 0x7fa3f00cc350 2023-10-06T02:24:22.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.773+0000 7fa3f6c50700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f0150870 con 0x7fa3f01570e0 2023-10-06T02:24:22.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.773+0000 7fa3f6c50700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f00b3fb0 con 0x7fa3f0156d10 2023-10-06T02:24:22.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.773+0000 7fa3f49ec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f00cc350 0x7fa3f01515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:22.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.774+0000 7fa3f49ec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f00cc350 0x7fa3f01515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52246/0 (socket says 172.21.15.6:52246) 2023-10-06T02:24:22.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.774+0000 7fa3f49ec700 1 -- 172.21.15.6:0/1902801236 learned_addr learned my addr 172.21.15.6:0/1902801236 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:22.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.774+0000 7fa3effff700 1 --2- 172.21.15.6:0/1902801236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3f0156d10 0x7fa3f00b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:22.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.774+0000 7fa3f51ed700 1 --2- 172.21.15.6:0/1902801236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3f01570e0 0x7fa3f00b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:22.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.774+0000 7fa3f49ec700 1 -- 172.21.15.6:0/1902801236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3f0156d10 msgr2=0x7fa3f00b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:22.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.774+0000 7fa3f49ec700 1 --2- 172.21.15.6:0/1902801236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3f0156d10 0x7fa3f00b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:22.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.774+0000 7fa3f49ec700 1 -- 172.21.15.6:0/1902801236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3f01570e0 msgr2=0x7fa3f00b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:22.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.774+0000 7fa3f49ec700 1 --2- 172.21.15.6:0/1902801236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3f01570e0 0x7fa3f00b14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:22.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.774+0000 7fa3f49ec700 1 -- 172.21.15.6:0/1902801236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e00094f0 con 0x7fa3f00cc350 2023-10-06T02:24:22.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.774+0000 7fa3effff700 1 --2- 172.21.15.6:0/1902801236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3f0156d10 0x7fa3f00b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:22.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.774+0000 7fa3f51ed700 1 --2- 172.21.15.6:0/1902801236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3f01570e0 0x7fa3f00b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:22.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.774+0000 7fa3f49ec700 1 --2- 172.21.15.6:0/1902801236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f00cc350 0x7fa3f01515f0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800a400 tx=0x7fa3e8007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:22.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.774+0000 7fa3ecff9700 1 -- 172.21.15.6:0/1902801236 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e800d650 con 0x7fa3f00cc350 2023-10-06T02:24:22.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.774+0000 7fa3ecff9700 1 -- 172.21.15.6:0/1902801236 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e800d7b0 con 0x7fa3f00cc350 2023-10-06T02:24:22.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.774+0000 7fa3f6c50700 1 -- 172.21.15.6:0/1902801236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f0150b10 con 0x7fa3f00cc350 2023-10-06T02:24:22.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.774+0000 7fa3ecff9700 1 -- 172.21.15.6:0/1902801236 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e800db50 con 0x7fa3f00cc350 2023-10-06T02:24:22.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.774+0000 7fa3f6c50700 1 -- 172.21.15.6:0/1902801236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f01510d0 con 0x7fa3f00cc350 2023-10-06T02:24:22.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.775+0000 7fa3f6c50700 1 -- 172.21.15.6:0/1902801236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f0088ad0 con 0x7fa3f00cc350 2023-10-06T02:24:22.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.775+0000 7fa3ecff9700 1 -- 172.21.15.6:0/1902801236 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3e8015440 con 0x7fa3f00cc350 2023-10-06T02:24:22.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.776+0000 7fa3ecff9700 1 --2- 172.21.15.6:0/1902801236 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa3d0066f30 0x7fa3d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:22.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.776+0000 7fa3ecff9700 1 -- 172.21.15.6:0/1902801236 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fa3e8085130 con 0x7fa3f00cc350 2023-10-06T02:24:22.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.776+0000 7fa3effff700 1 --2- 172.21.15.6:0/1902801236 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa3d0066f30 0x7fa3d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:22.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.777+0000 7fa3effff700 1 --2- 172.21.15.6:0/1902801236 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa3d0066f30 0x7fa3d00693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0068200 tx=0x7fa3e0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:22.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.780+0000 7fa3ecff9700 1 -- 172.21.15.6:0/1902801236 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3e804e5a0 con 0x7fa3f00cc350 2023-10-06T02:24:22.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:22.975+0000 7fa3f6c50700 1 -- 172.21.15.6:0/1902801236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa3f00ccdf0 con 0x7fa3f00cc350 2023-10-06T02:24:23.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:23.924+0000 7fa3ecff9700 1 -- 172.21.15.6:0/1902801236 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v85) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa3e8052100 con 0x7fa3f00cc350 2023-10-06T02:24:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:23.931+0000 7fa3f6c50700 1 -- 172.21.15.6:0/1902801236 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa3d0066f30 msgr2=0x7fa3d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:23.931+0000 7fa3f6c50700 1 --2- 172.21.15.6:0/1902801236 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa3d0066f30 0x7fa3d00693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0068200 tx=0x7fa3e0016000 comp rx=0 tx=0).stop 2023-10-06T02:24:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:23.931+0000 7fa3f6c50700 1 -- 172.21.15.6:0/1902801236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f00cc350 msgr2=0x7fa3f01515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:23.931+0000 7fa3f6c50700 1 --2- 172.21.15.6:0/1902801236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f00cc350 0x7fa3f01515f0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800a400 tx=0x7fa3e8007910 comp rx=0 tx=0).stop 2023-10-06T02:24:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:23.931+0000 7fa3f6c50700 1 -- 172.21.15.6:0/1902801236 shutdown_connections 2023-10-06T02:24:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:23.931+0000 7fa3f6c50700 1 --2- 172.21.15.6:0/1902801236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3f01570e0 0x7fa3f00b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:23.931+0000 7fa3f6c50700 1 --2- 172.21.15.6:0/1902801236 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa3d0066f30 0x7fa3d00693e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:23.931+0000 7fa3f6c50700 1 --2- 172.21.15.6:0/1902801236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f00cc350 0x7fa3f01515f0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:23.931+0000 7fa3f6c50700 1 --2- 172.21.15.6:0/1902801236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3f0156d10 0x7fa3f00b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:23.931+0000 7fa3f6c50700 1 -- 172.21.15.6:0/1902801236 >> 172.21.15.6:0/1902801236 conn(0x7fa3f0069150 msgr2=0x7fa3f0154950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:23.931+0000 7fa3f6c50700 1 -- 172.21.15.6:0/1902801236 shutdown_connections 2023-10-06T02:24:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:23.931+0000 7fa3f6c50700 1 -- 172.21.15.6:0/1902801236 wait complete. 2023-10-06T02:24:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:24:23.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:24:24.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.081+0000 7fcbcb488700 1 Processor -- start 2023-10-06T02:24:24.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.081+0000 7fcbcb488700 1 -- start start 2023-10-06T02:24:24.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.082+0000 7fcbcb488700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcbc40cfa90 0x7fcbc40d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:24.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.082+0000 7fcbcb488700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcbc40d07a0 0x7fcbc4163060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:24.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.082+0000 7fcbcb488700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc415a710 con 0x7fcbc4142df0 2023-10-06T02:24:24.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.082+0000 7fcbcb488700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc40d0be0 con 0x7fcbc40d07a0 2023-10-06T02:24:24.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.082+0000 7fcbcb488700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc4159b40 con 0x7fcbc40cfa90 2023-10-06T02:24:24.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.082+0000 7fcbc9a25700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcbc40d07a0 0x7fcbc4163060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:24.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.082+0000 7fcbc9a25700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcbc40d07a0 0x7fcbc4163060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52262/0 (socket says 172.21.15.6:52262) 2023-10-06T02:24:24.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.082+0000 7fcbc9a25700 1 -- 172.21.15.6:0/2290373405 learned_addr learned my addr 172.21.15.6:0/2290373405 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.082+0000 7fcbc8a23700 1 --2- 172.21.15.6:0/2290373405 >> v2:172.21.15.175:3300/0 conn(0x7fcbc40cfa90 0x7fcbc40d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.082+0000 7fcbc9a25700 1 -- 172.21.15.6:0/2290373405 >> v2:172.21.15.175:3300/0 conn(0x7fcbc40cfa90 msgr2=0x7fcbc40d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.082+0000 7fcbc9a25700 1 --2- 172.21.15.6:0/2290373405 >> v2:172.21.15.175:3300/0 conn(0x7fcbc40cfa90 0x7fcbc40d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.082+0000 7fcbc9a25700 1 -- 172.21.15.6:0/2290373405 >> v1:172.21.15.175:6789/0 conn(0x7fcbc4142df0 legacy=0x7fcbc40cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.082+0000 7fcbc9a25700 1 -- 172.21.15.6:0/2290373405 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc4159de0 con 0x7fcbc40d07a0 2023-10-06T02:24:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.082+0000 7fcbc8a23700 1 --2- 172.21.15.6:0/2290373405 >> v2:172.21.15.175:3300/0 conn(0x7fcbc40cfa90 0x7fcbc40d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.082+0000 7fcbc9a25700 1 --2- 172.21.15.6:0/2290373405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc40d07a0 0x7fcbc4163060 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40099b0 tx=0x7fcbb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f68e38660c152e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.083+0000 7fcbc3fff700 1 -- 172.21.15.6:0/2290373405 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb400b820 con 0x7fcbc40d07a0 2023-10-06T02:24:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.083+0000 7fcbc3fff700 1 -- 172.21.15.6:0/2290373405 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb400b980 con 0x7fcbc40d07a0 2023-10-06T02:24:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.083+0000 7fcbc3fff700 1 -- 172.21.15.6:0/2290373405 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb400bd20 con 0x7fcbc40d07a0 2023-10-06T02:24:24.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.083+0000 7fcbcb488700 1 -- 172.21.15.6:0/2290373405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc40d07a0 msgr2=0x7fcbc4163060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:24.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.083+0000 7fcbcb488700 1 --2- 172.21.15.6:0/2290373405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc40d07a0 0x7fcbc4163060 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40099b0 tx=0x7fcbb4009250 comp rx=0 tx=0).stop 2023-10-06T02:24:24.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.083+0000 7fcbcb488700 1 -- 172.21.15.6:0/2290373405 shutdown_connections 2023-10-06T02:24:24.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.083+0000 7fcbcb488700 1 --2- 172.21.15.6:0/2290373405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc40d07a0 0x7fcbc4163060 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:24.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.083+0000 7fcbcb488700 1 --2- 172.21.15.6:0/2290373405 >> v2:172.21.15.175:3300/0 conn(0x7fcbc40cfa90 0x7fcbc40d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:24.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.083+0000 7fcbcb488700 1 -- 172.21.15.6:0/2290373405 >> 172.21.15.6:0/2290373405 conn(0x7fcbc40690f0 msgr2=0x7fcbc406a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:24.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.083+0000 7fcbcb488700 1 -- 172.21.15.6:0/2290373405 shutdown_connections 2023-10-06T02:24:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.083+0000 7fcbcb488700 1 -- 172.21.15.6:0/2290373405 wait complete. 2023-10-06T02:24:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.084+0000 7fcbcb488700 1 Processor -- start 2023-10-06T02:24:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.084+0000 7fcbcb488700 1 -- start start 2023-10-06T02:24:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.085+0000 7fcbcb488700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbc40cfa90 0x7fcbc416a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.085+0000 7fcbcb488700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbc40d07a0 0x7fcbc4141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.085+0000 7fcbcb488700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc4142df0 0x7fcbc41550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.085+0000 7fcbcb488700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc415d220 con 0x7fcbc4142df0 2023-10-06T02:24:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.085+0000 7fcbcb488700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc416a860 con 0x7fcbc40cfa90 2023-10-06T02:24:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.085+0000 7fcbcb488700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc415d6e0 con 0x7fcbc40d07a0 2023-10-06T02:24:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.085+0000 7fcbc9a25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc4142df0 0x7fcbc41550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.085+0000 7fcbc9a25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc4142df0 0x7fcbc41550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52264/0 (socket says 172.21.15.6:52264) 2023-10-06T02:24:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.085+0000 7fcbc9a25700 1 -- 172.21.15.6:0/114859916 learned_addr learned my addr 172.21.15.6:0/114859916 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.085+0000 7fcbc9224700 1 --2- 172.21.15.6:0/114859916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbc40cfa90 0x7fcbc416a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.085+0000 7fcbc8a23700 1 --2- 172.21.15.6:0/114859916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbc40d07a0 0x7fcbc4141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.085+0000 7fcbc9a25700 1 -- 172.21.15.6:0/114859916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbc40d07a0 msgr2=0x7fcbc4141490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.085+0000 7fcbc9a25700 1 --2- 172.21.15.6:0/114859916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbc40d07a0 0x7fcbc4141490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.085+0000 7fcbc9a25700 1 -- 172.21.15.6:0/114859916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbc40cfa90 msgr2=0x7fcbc416a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.085+0000 7fcbc9a25700 1 --2- 172.21.15.6:0/114859916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbc40cfa90 0x7fcbc416a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.085+0000 7fcbc9a25700 1 -- 172.21.15.6:0/114859916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb40094f0 con 0x7fcbc4142df0 2023-10-06T02:24:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.086+0000 7fcbc9a25700 1 --2- 172.21.15.6:0/114859916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc4142df0 0x7fcbc41550b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40094c0 tx=0x7fcbb4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.086+0000 7fcbc17fa700 1 -- 172.21.15.6:0/114859916 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb401a640 con 0x7fcbc4142df0 2023-10-06T02:24:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.086+0000 7fcbc17fa700 1 -- 172.21.15.6:0/114859916 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb401f070 con 0x7fcbc4142df0 2023-10-06T02:24:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.086+0000 7fcbcb488700 1 -- 172.21.15.6:0/114859916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc415bf30 con 0x7fcbc4142df0 2023-10-06T02:24:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.086+0000 7fcbc17fa700 1 -- 172.21.15.6:0/114859916 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb401a9d0 con 0x7fcbc4142df0 2023-10-06T02:24:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.086+0000 7fcbcb488700 1 -- 172.21.15.6:0/114859916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc415d9e0 con 0x7fcbc4142df0 2023-10-06T02:24:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.087+0000 7fcbcb488700 1 -- 172.21.15.6:0/114859916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc4088ad0 con 0x7fcbc4142df0 2023-10-06T02:24:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.087+0000 7fcbc17fa700 1 -- 172.21.15.6:0/114859916 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcbb401b430 con 0x7fcbc4142df0 2023-10-06T02:24:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.087+0000 7fcbc17fa700 1 --2- 172.21.15.6:0/114859916 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcbb0066f30 0x7fcbb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.088+0000 7fcbc17fa700 1 -- 172.21.15.6:0/114859916 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6112+0+0 (secure 0 0 0) 0x7fcbb4021070 con 0x7fcbc4142df0 2023-10-06T02:24:24.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.088+0000 7fcbc9224700 1 --2- 172.21.15.6:0/114859916 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcbb0066f30 0x7fcbb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:24.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.088+0000 7fcbc9224700 1 --2- 172.21.15.6:0/114859916 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcbb0066f30 0x7fcbb00693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc007fd0 tx=0x7fcbbc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:24.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.092+0000 7fcbc17fa700 1 -- 172.21.15.6:0/114859916 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcbb40538e0 con 0x7fcbc4142df0 2023-10-06T02:24:24.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.287+0000 7fcbcb488700 1 -- 172.21.15.6:0/114859916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcbc415a0c0 con 0x7fcbc4142df0 2023-10-06T02:24:24.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.926+0000 7fcbc17fa700 1 -- 172.21.15.6:0/114859916 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v86) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcbb4056f00 con 0x7fcbc4142df0 2023-10-06T02:24:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.929+0000 7fcbcb488700 1 -- 172.21.15.6:0/114859916 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcbb0066f30 msgr2=0x7fcbb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.929+0000 7fcbcb488700 1 --2- 172.21.15.6:0/114859916 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcbb0066f30 0x7fcbb00693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc007fd0 tx=0x7fcbbc009040 comp rx=0 tx=0).stop 2023-10-06T02:24:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.929+0000 7fcbcb488700 1 -- 172.21.15.6:0/114859916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc4142df0 msgr2=0x7fcbc41550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.929+0000 7fcbcb488700 1 --2- 172.21.15.6:0/114859916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc4142df0 0x7fcbc41550b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40094c0 tx=0x7fcbb4017000 comp rx=0 tx=0).stop 2023-10-06T02:24:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.929+0000 7fcbcb488700 1 -- 172.21.15.6:0/114859916 shutdown_connections 2023-10-06T02:24:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.929+0000 7fcbcb488700 1 --2- 172.21.15.6:0/114859916 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcbb0066f30 0x7fcbb00693e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.929+0000 7fcbcb488700 1 --2- 172.21.15.6:0/114859916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc4142df0 0x7fcbc41550b0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.929+0000 7fcbcb488700 1 --2- 172.21.15.6:0/114859916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbc40cfa90 0x7fcbc416a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:24.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.929+0000 7fcbcb488700 1 --2- 172.21.15.6:0/114859916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbc40d07a0 0x7fcbc4141490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:24.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.929+0000 7fcbcb488700 1 -- 172.21.15.6:0/114859916 >> 172.21.15.6:0/114859916 conn(0x7fcbc40690f0 msgr2=0x7fcbc40af230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:24.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.931+0000 7fcbcb488700 1 -- 172.21.15.6:0/114859916 shutdown_connections 2023-10-06T02:24:24.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:24.932+0000 7fcbcb488700 1 -- 172.21.15.6:0/114859916 wait complete. 2023-10-06T02:24:24.933 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-06T02:24:24.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_inject_rename_corrupt_dentry_first 2023-10-06T02:24:25.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.069+0000 7f89c6cb3700 1 Processor -- start 2023-10-06T02:24:25.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.069+0000 7f89c6cb3700 1 -- start start 2023-10-06T02:24:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.069+0000 7f89c6cb3700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f89c015a030 0x7f89c015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.069+0000 7f89c6cb3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c00afc50 con 0x7f89c0087700 2023-10-06T02:24:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89c6cb3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c00aff30 con 0x7f89c015a940 2023-10-06T02:24:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89c6cb3700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c00b0cf0 con 0x7f89c015a030 2023-10-06T02:24:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89c5250700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f89c0087700 0x7f89c00b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52938/0 (socket says 172.21.15.6:52938) 2023-10-06T02:24:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89c5250700 1 -- 172.21.15.6:0/833655608 learned_addr learned my addr 172.21.15.6:0/833655608 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89c4a4f700 1 --2- 172.21.15.6:0/833655608 >> v2:172.21.15.175:3300/0 conn(0x7f89c015a030 0x7f89c015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bf7fe700 1 -- 172.21.15.6:0/833655608 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217167887 0 0) 0x7f89c00afc50 con 0x7f89c0087700 2023-10-06T02:24:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bf7fe700 1 -- 172.21.15.6:0/833655608 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89ac003570 con 0x7f89c0087700 2023-10-06T02:24:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bf7fe700 1 -- 172.21.15.6:0/833655608 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542368290 0 0) 0x7f89c00aff30 con 0x7f89c015a940 2023-10-06T02:24:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bf7fe700 1 -- 172.21.15.6:0/833655608 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89c00afc50 con 0x7f89c015a940 2023-10-06T02:24:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bf7fe700 1 -- 172.21.15.6:0/833655608 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3437773430 0 0) 0x7f89ac003570 con 0x7f89c0087700 2023-10-06T02:24:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bf7fe700 1 -- 172.21.15.6:0/833655608 >> v2:172.21.15.175:3300/0 conn(0x7f89c015a030 msgr2=0x7f89c015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bf7fe700 1 --2- 172.21.15.6:0/833655608 >> v2:172.21.15.175:3300/0 conn(0x7f89c015a030 0x7f89c015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bf7fe700 1 -- 172.21.15.6:0/833655608 >> v1:172.21.15.175:6789/0 conn(0x7f89c015a940 legacy=0x7f89c0086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bf7fe700 1 -- 172.21.15.6:0/833655608 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c00b0210 con 0x7f89c0087700 2023-10-06T02:24:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bf7fe700 1 -- 172.21.15.6:0/833655608 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f89a8001470 con 0x7f89c0087700 2023-10-06T02:24:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89c4a4f700 1 --2- 172.21.15.6:0/833655608 >> v2:172.21.15.175:3300/0 conn(0x7f89c015a030 0x7f89c015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bf7fe700 1 -- 172.21.15.6:0/833655608 >> v1:172.21.15.6:6789/0 conn(0x7f89c0087700 legacy=0x7f89c00b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bf7fe700 1 --2- 172.21.15.6:0/833655608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89ac003bf0 0x7f89ac003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bf7fe700 1 --2- 172.21.15.6:0/833655608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89ac004810 0x7f89ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bf7fe700 1 --2- 172.21.15.6:0/833655608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89ac0051c0 0x7f89ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bf7fe700 1 -- 172.21.15.6:0/833655608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c00b0cf0 con 0x7f89ac004810 2023-10-06T02:24:25.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bf7fe700 1 -- 172.21.15.6:0/833655608 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac00c0b0 con 0x7f89ac0051c0 2023-10-06T02:24:25.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bf7fe700 1 -- 172.21.15.6:0/833655608 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac00c270 con 0x7f89ac003bf0 2023-10-06T02:24:25.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.070+0000 7f89bffff700 1 --2- 172.21.15.6:0/833655608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89ac004810 0x7f89ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.071+0000 7f89c4a4f700 1 --2- 172.21.15.6:0/833655608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89ac003bf0 0x7f89ac003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.071+0000 7f89c5250700 1 --2- 172.21.15.6:0/833655608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89ac0051c0 0x7f89ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.071+0000 7f89bffff700 1 -- 172.21.15.6:0/833655608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89ac003bf0 msgr2=0x7f89ac003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:25.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.071+0000 7f89bffff700 1 --2- 172.21.15.6:0/833655608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89ac003bf0 0x7f89ac003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.071+0000 7f89bffff700 1 -- 172.21.15.6:0/833655608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89ac0051c0 msgr2=0x7f89ac00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:25.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.071+0000 7f89bffff700 1 --2- 172.21.15.6:0/833655608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89ac0051c0 0x7f89ac00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.071+0000 7f89c5250700 1 -- 172.21.15.6:0/833655608 reap_dead start 2023-10-06T02:24:25.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.071+0000 7f89bffff700 1 -- 172.21.15.6:0/833655608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac003570 con 0x7f89ac004810 2023-10-06T02:24:25.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.071+0000 7f89bffff700 1 --2- 172.21.15.6:0/833655608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89ac004810 0x7f89ac004c80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f89c015ad30 tx=0x7f89b0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e5240c4bb23bfb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:25.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.071+0000 7f89bf7fe700 1 -- 172.21.15.6:0/833655608 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b000c5d0 con 0x7f89ac004810 2023-10-06T02:24:25.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.071+0000 7f89bf7fe700 1 -- 172.21.15.6:0/833655608 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b000c730 con 0x7f89ac004810 2023-10-06T02:24:25.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.071+0000 7f89bf7fe700 1 -- 172.21.15.6:0/833655608 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b000c8c0 con 0x7f89ac004810 2023-10-06T02:24:25.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.072+0000 7f89c6cb3700 1 -- 172.21.15.6:0/833655608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89ac004810 msgr2=0x7f89ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:25.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.072+0000 7f89c6cb3700 1 --2- 172.21.15.6:0/833655608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89ac004810 0x7f89ac004c80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f89c015ad30 tx=0x7f89b0007d30 comp rx=0 tx=0).stop 2023-10-06T02:24:25.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.072+0000 7f89c6cb3700 1 -- 172.21.15.6:0/833655608 shutdown_connections 2023-10-06T02:24:25.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.072+0000 7f89c6cb3700 1 --2- 172.21.15.6:0/833655608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89ac004810 0x7f89ac004c80 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.072+0000 7f89c6cb3700 1 -- 172.21.15.6:0/833655608 >> 172.21.15.6:0/833655608 conn(0x7f89c0068680 msgr2=0x7f89c0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:25.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.072+0000 7f89c6cb3700 1 -- 172.21.15.6:0/833655608 shutdown_connections 2023-10-06T02:24:25.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.072+0000 7f89c6cb3700 1 -- 172.21.15.6:0/833655608 wait complete. 2023-10-06T02:24:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.073+0000 7f89c6cb3700 1 Processor -- start 2023-10-06T02:24:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.073+0000 7f89c6cb3700 1 -- start start 2023-10-06T02:24:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89c6cb3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89ac004810 0x7f89c00c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89c6cb3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c00c4600 0x7f89c0155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89c6cb3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89c00cc690 0x7f89c00ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89c6cb3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c00c4da0 con 0x7f89c00c4600 2023-10-06T02:24:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89c6cb3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c015b730 con 0x7f89c00cc690 2023-10-06T02:24:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89c6cb3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c00cd020 con 0x7f89ac004810 2023-10-06T02:24:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89bffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c00c4600 0x7f89c0155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89bffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c00c4600 0x7f89c0155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52284/0 (socket says 172.21.15.6:52284) 2023-10-06T02:24:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89bffff700 1 -- 172.21.15.6:0/2181242858 learned_addr learned my addr 172.21.15.6:0/2181242858 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89c4a4f700 1 --2- 172.21.15.6:0/2181242858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89ac004810 0x7f89c00c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89c5250700 1 --2- 172.21.15.6:0/2181242858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89c00cc690 0x7f89c00ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89bffff700 1 -- 172.21.15.6:0/2181242858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89ac004810 msgr2=0x7f89c00c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89bffff700 1 --2- 172.21.15.6:0/2181242858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89ac004810 0x7f89c00c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89bffff700 1 -- 172.21.15.6:0/2181242858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89c00cc690 msgr2=0x7f89c00ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89bffff700 1 --2- 172.21.15.6:0/2181242858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89c00cc690 0x7f89c00ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89bffff700 1 -- 172.21.15.6:0/2181242858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c015ae00 con 0x7f89c00c4600 2023-10-06T02:24:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89bffff700 1 --2- 172.21.15.6:0/2181242858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c00c4600 0x7f89c0155790 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f89b000d010 tx=0x7f89b0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89bcff9700 1 -- 172.21.15.6:0/2181242858 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b000c5d0 con 0x7f89c00c4600 2023-10-06T02:24:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89bcff9700 1 -- 172.21.15.6:0/2181242858 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b000c8a0 con 0x7f89c00c4600 2023-10-06T02:24:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.074+0000 7f89bcff9700 1 -- 172.21.15.6:0/2181242858 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b0007b10 con 0x7f89c00c4600 2023-10-06T02:24:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.075+0000 7f89c6cb3700 1 -- 172.21.15.6:0/2181242858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c015b0e0 con 0x7f89c00c4600 2023-10-06T02:24:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.075+0000 7f89c6cb3700 1 -- 172.21.15.6:0/2181242858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c00c4a70 con 0x7f89c00c4600 2023-10-06T02:24:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.075+0000 7f89c6cb3700 1 -- 172.21.15.6:0/2181242858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c00c4da0 con 0x7f89c00c4600 2023-10-06T02:24:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.076+0000 7f89bcff9700 1 -- 172.21.15.6:0/2181242858 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89b0019030 con 0x7f89c00c4600 2023-10-06T02:24:25.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.076+0000 7f89bcff9700 1 --2- 172.21.15.6:0/2181242858 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f89a0066f30 0x7f89a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.076+0000 7f89bcff9700 1 -- 172.21.15.6:0/2181242858 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f89b0085d30 con 0x7f89c00c4600 2023-10-06T02:24:25.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.076+0000 7f89c4a4f700 1 --2- 172.21.15.6:0/2181242858 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f89a0066f30 0x7f89a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.077+0000 7f89c4a4f700 1 --2- 172.21.15.6:0/2181242858 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f89a0066f30 0x7f89a00693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f89b80094d0 tx=0x7f89b800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:25.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.081+0000 7f89bcff9700 1 -- 172.21.15.6:0/2181242858 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89b0052f00 con 0x7f89c00c4600 2023-10-06T02:24:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.277+0000 7f89c6cb3700 1 -- 172.21.15.6:0/2181242858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"} v 0) v1 -- 0x7f89c00b04f0 con 0x7f89c00c4600 2023-10-06T02:24:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.277+0000 7f89bcff9700 1 -- 172.21.15.6:0/2181242858 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_inject_rename_corrupt_dentry_first"}]=0 v24) v1 ==== 121+0+0 (secure 0 0 0) 0x7f89b00170c0 con 0x7f89c00c4600 2023-10-06T02:24:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.279+0000 7f89c6cb3700 1 -- 172.21.15.6:0/2181242858 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f89a0066f30 msgr2=0x7f89a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.279+0000 7f89c6cb3700 1 --2- 172.21.15.6:0/2181242858 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f89a0066f30 0x7f89a00693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f89b80094d0 tx=0x7f89b800b040 comp rx=0 tx=0).stop 2023-10-06T02:24:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.279+0000 7f89c6cb3700 1 -- 172.21.15.6:0/2181242858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c00c4600 msgr2=0x7f89c0155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.279+0000 7f89c6cb3700 1 --2- 172.21.15.6:0/2181242858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c00c4600 0x7f89c0155790 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f89b000d010 tx=0x7f89b0015000 comp rx=0 tx=0).stop 2023-10-06T02:24:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.279+0000 7f89c6cb3700 1 -- 172.21.15.6:0/2181242858 shutdown_connections 2023-10-06T02:24:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.279+0000 7f89c6cb3700 1 --2- 172.21.15.6:0/2181242858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89c00cc690 0x7f89c00ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.279+0000 7f89c6cb3700 1 --2- 172.21.15.6:0/2181242858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89ac004810 0x7f89c00c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.279+0000 7f89c6cb3700 1 --2- 172.21.15.6:0/2181242858 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f89a0066f30 0x7f89a00693e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.279+0000 7f89c6cb3700 1 --2- 172.21.15.6:0/2181242858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c00c4600 0x7f89c0155790 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.279+0000 7f89c6cb3700 1 -- 172.21.15.6:0/2181242858 >> 172.21.15.6:0/2181242858 conn(0x7f89c0068680 msgr2=0x7f89c00aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:25.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.279+0000 7f89c6cb3700 1 -- 172.21.15.6:0/2181242858 shutdown_connections 2023-10-06T02:24:25.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.279+0000 7f89c6cb3700 1 -- 172.21.15.6:0/2181242858 wait complete. 2023-10-06T02:24:25.292 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:24:25.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.412+0000 7f0cc2fd4700 1 Processor -- start 2023-10-06T02:24:25.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.412+0000 7f0cc2fd4700 1 -- start start 2023-10-06T02:24:25.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cc2fd4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0cbc086ff0 0x7f0cbc087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cc2fd4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cbc0b21b0 0x7f0cbc0b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cc2fd4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cbc0b2b70 con 0x7f0cbc15a030 2023-10-06T02:24:25.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cc2fd4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cbc0b0cf0 con 0x7f0cbc086ff0 2023-10-06T02:24:25.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cc2fd4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc0879b0 con 0x7f0cbc0b21b0 2023-10-06T02:24:25.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cbbfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0cbc086ff0 0x7f0cbc087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cbbfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0cbc086ff0 0x7f0cbc087470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52292/0 (socket says 172.21.15.6:52292) 2023-10-06T02:24:25.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cbbfff700 1 -- 172.21.15.6:0/3685181858 learned_addr learned my addr 172.21.15.6:0/3685181858 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:25.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cc0d70700 1 --1- 172.21.15.6:0/3685181858 >> v1:172.21.15.6:6789/0 conn(0x7f0cbc15a030 0x7f0cbc15a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52946/0 (socket says 172.21.15.6:52946) 2023-10-06T02:24:25.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cc1571700 1 --2- 172.21.15.6:0/3685181858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cbc0b21b0 0x7f0cbc0b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cbbfff700 1 -- 172.21.15.6:0/3685181858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cbc0b21b0 msgr2=0x7f0cbc0b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:25.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cbbfff700 1 --2- 172.21.15.6:0/3685181858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cbc0b21b0 0x7f0cbc0b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cbbfff700 1 -- 172.21.15.6:0/3685181858 >> v1:172.21.15.6:6789/0 conn(0x7f0cbc15a030 legacy=0x7f0cbc15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:25.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cbbfff700 1 -- 172.21.15.6:0/3685181858 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc0afc50 con 0x7f0cbc086ff0 2023-10-06T02:24:25.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cbb7fe700 1 -- 172.21.15.6:0/3685181858 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947253825 0 0) 0x7f0cbc0b2b70 con 0x7f0cbc15a030 2023-10-06T02:24:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cc1571700 1 --2- 172.21.15.6:0/3685181858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cbc0b21b0 0x7f0cbc0b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cbbfff700 1 --2- 172.21.15.6:0/3685181858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc086ff0 0x7f0cbc087470 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80099b0 tx=0x7f0ca8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7496a2fcc8f453f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cbb7fe700 1 -- 172.21.15.6:0/3685181858 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca800b860 con 0x7f0cbc086ff0 2023-10-06T02:24:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.413+0000 7f0cbb7fe700 1 -- 172.21.15.6:0/3685181858 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca800b9c0 con 0x7f0cbc086ff0 2023-10-06T02:24:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.414+0000 7f0cbb7fe700 1 -- 172.21.15.6:0/3685181858 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca800bd60 con 0x7f0cbc086ff0 2023-10-06T02:24:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.414+0000 7f0cc2fd4700 1 -- 172.21.15.6:0/3685181858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc086ff0 msgr2=0x7f0cbc087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.414+0000 7f0cc2fd4700 1 --2- 172.21.15.6:0/3685181858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc086ff0 0x7f0cbc087470 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80099b0 tx=0x7f0ca8009250 comp rx=0 tx=0).stop 2023-10-06T02:24:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.414+0000 7f0cc2fd4700 1 -- 172.21.15.6:0/3685181858 shutdown_connections 2023-10-06T02:24:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.414+0000 7f0cc2fd4700 1 --2- 172.21.15.6:0/3685181858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cbc0b21b0 0x7f0cbc0b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.414+0000 7f0cc2fd4700 1 --2- 172.21.15.6:0/3685181858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc086ff0 0x7f0cbc087470 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.414+0000 7f0cc2fd4700 1 -- 172.21.15.6:0/3685181858 >> 172.21.15.6:0/3685181858 conn(0x7f0cbc068680 msgr2=0x7f0cbc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:25.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.414+0000 7f0cc2fd4700 1 -- 172.21.15.6:0/3685181858 shutdown_connections 2023-10-06T02:24:25.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.414+0000 7f0cc2fd4700 1 -- 172.21.15.6:0/3685181858 wait complete. 2023-10-06T02:24:25.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.415+0000 7f0cc2fd4700 1 Processor -- start 2023-10-06T02:24:25.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.415+0000 7f0cc2fd4700 1 -- start start 2023-10-06T02:24:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.416+0000 7f0cc2fd4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cbc086ff0 0x7f0cbc0c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.416+0000 7f0cc2fd4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cbc0b21b0 0x7f0cbc0c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.416+0000 7f0cc2fd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc15a030 0x7f0cbc158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.416+0000 7f0cc2fd4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc0c4bd0 con 0x7f0cbc15a030 2023-10-06T02:24:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.416+0000 7f0cc2fd4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc0c56c0 con 0x7f0cbc0b21b0 2023-10-06T02:24:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.416+0000 7f0cc2fd4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc0c4e20 con 0x7f0cbc086ff0 2023-10-06T02:24:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.416+0000 7f0cc1571700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc15a030 0x7f0cbc158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.416+0000 7f0cc1571700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc15a030 0x7f0cbc158a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52306/0 (socket says 172.21.15.6:52306) 2023-10-06T02:24:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.416+0000 7f0cc1571700 1 -- 172.21.15.6:0/3996219248 learned_addr learned my addr 172.21.15.6:0/3996219248 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.416+0000 7f0cbbfff700 1 --2- 172.21.15.6:0/3996219248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cbc0b21b0 0x7f0cbc0c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.416+0000 7f0cc0d70700 1 --2- 172.21.15.6:0/3996219248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cbc086ff0 0x7f0cbc0c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.417+0000 7f0cc1571700 1 -- 172.21.15.6:0/3996219248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cbc086ff0 msgr2=0x7f0cbc0c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.417+0000 7f0cc1571700 1 --2- 172.21.15.6:0/3996219248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cbc086ff0 0x7f0cbc0c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.417+0000 7f0cc1571700 1 -- 172.21.15.6:0/3996219248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cbc0b21b0 msgr2=0x7f0cbc0c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.417+0000 7f0cc1571700 1 --2- 172.21.15.6:0/3996219248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cbc0b21b0 0x7f0cbc0c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.417+0000 7f0cc1571700 1 -- 172.21.15.6:0/3996219248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca80094f0 con 0x7f0cbc15a030 2023-10-06T02:24:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.417+0000 7f0cc0d70700 1 --2- 172.21.15.6:0/3996219248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cbc086ff0 0x7f0cbc0c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.417+0000 7f0cbbfff700 1 --2- 172.21.15.6:0/3996219248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cbc0b21b0 0x7f0cbc0c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.417+0000 7f0cc1571700 1 --2- 172.21.15.6:0/3996219248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc15a030 0x7f0cbc158a10 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400a380 tx=0x7f0cb4007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.417+0000 7f0cb8ff9700 1 -- 172.21.15.6:0/3996219248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb400ae10 con 0x7f0cbc15a030 2023-10-06T02:24:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.417+0000 7f0cb8ff9700 1 -- 172.21.15.6:0/3996219248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb400d650 con 0x7f0cbc15a030 2023-10-06T02:24:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.417+0000 7f0cb8ff9700 1 -- 172.21.15.6:0/3996219248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb400da10 con 0x7f0cbc15a030 2023-10-06T02:24:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.417+0000 7f0cc2fd4700 1 -- 172.21.15.6:0/3996219248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cbc0c5100 con 0x7f0cbc15a030 2023-10-06T02:24:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.417+0000 7f0cc2fd4700 1 -- 172.21.15.6:0/3996219248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cbc0c7830 con 0x7f0cbc15a030 2023-10-06T02:24:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.418+0000 7f0cc2fd4700 1 -- 172.21.15.6:0/3996219248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cbc088700 con 0x7f0cbc15a030 2023-10-06T02:24:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.418+0000 7f0cb8ff9700 1 -- 172.21.15.6:0/3996219248 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0cb401e3b0 con 0x7f0cbc15a030 2023-10-06T02:24:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.419+0000 7f0cb8ff9700 1 --2- 172.21.15.6:0/3996219248 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ca0066f30 0x7f0ca00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.419+0000 7f0cb8ff9700 1 -- 172.21.15.6:0/3996219248 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f0cb4084fe0 con 0x7f0cbc15a030 2023-10-06T02:24:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.419+0000 7f0cc0d70700 1 --2- 172.21.15.6:0/3996219248 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ca0066f30 0x7f0ca00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.419+0000 7f0cc0d70700 1 --2- 172.21.15.6:0/3996219248 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ca0066f30 0x7f0ca00693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0007fd0 tx=0x7f0cb0007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.423+0000 7f0cb8ff9700 1 -- 172.21.15.6:0/3996219248 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0cb40521f0 con 0x7f0cbc15a030 2023-10-06T02:24:25.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.615+0000 7f0cc2fd4700 1 -- 172.21.15.6:0/3996219248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0cbc0aff30 con 0x7f0cbc15a030 2023-10-06T02:24:25.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.619+0000 7f0cb8ff9700 1 -- 172.21.15.6:0/3996219248 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0cb4055810 con 0x7f0cbc15a030 2023-10-06T02:24:25.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.621+0000 7f0cc2fd4700 1 -- 172.21.15.6:0/3996219248 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ca0066f30 msgr2=0x7f0ca00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:25.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.621+0000 7f0cc2fd4700 1 --2- 172.21.15.6:0/3996219248 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ca0066f30 0x7f0ca00693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0007fd0 tx=0x7f0cb0007e30 comp rx=0 tx=0).stop 2023-10-06T02:24:25.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.621+0000 7f0cc2fd4700 1 -- 172.21.15.6:0/3996219248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc15a030 msgr2=0x7f0cbc158a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:25.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.621+0000 7f0cc2fd4700 1 --2- 172.21.15.6:0/3996219248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc15a030 0x7f0cbc158a10 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400a380 tx=0x7f0cb4007900 comp rx=0 tx=0).stop 2023-10-06T02:24:25.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.621+0000 7f0cc2fd4700 1 -- 172.21.15.6:0/3996219248 shutdown_connections 2023-10-06T02:24:25.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.621+0000 7f0cc2fd4700 1 --2- 172.21.15.6:0/3996219248 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ca0066f30 0x7f0ca00693e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.621+0000 7f0cc2fd4700 1 --2- 172.21.15.6:0/3996219248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc15a030 0x7f0cbc158a10 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.621+0000 7f0cc2fd4700 1 --2- 172.21.15.6:0/3996219248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cbc086ff0 0x7f0cbc0c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.621+0000 7f0cc2fd4700 1 --2- 172.21.15.6:0/3996219248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cbc0b21b0 0x7f0cbc0c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.621+0000 7f0cc2fd4700 1 -- 172.21.15.6:0/3996219248 >> 172.21.15.6:0/3996219248 conn(0x7f0cbc068680 msgr2=0x7f0cbc0cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:25.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.621+0000 7f0cc2fd4700 1 -- 172.21.15.6:0/3996219248 shutdown_connections 2023-10-06T02:24:25.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.621+0000 7f0cc2fd4700 1 -- 172.21.15.6:0/3996219248 wait complete. 2023-10-06T02:24:25.634 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush' 2023-10-06T02:24:25.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.756+0000 7ff941a06700 1 Processor -- start 2023-10-06T02:24:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.756+0000 7ff941a06700 1 -- start start 2023-10-06T02:24:25.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.757+0000 7ff941a06700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff93c0cb920 0x7ff93c15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.757+0000 7ff941a06700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff93c153f40 0x7ff93c15a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.757+0000 7ff941a06700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c0ce7b0 con 0x7ff93c153b70 2023-10-06T02:24:25.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.757+0000 7ff941a06700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93c15e350 con 0x7ff93c153f40 2023-10-06T02:24:25.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.757+0000 7ff941a06700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93c15adb0 con 0x7ff93c0cb920 2023-10-06T02:24:25.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.757+0000 7ff93b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff93c153f40 0x7ff93c15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.757+0000 7ff93b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff93c153f40 0x7ff93c15a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52318/0 (socket says 172.21.15.6:52318) 2023-10-06T02:24:25.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.757+0000 7ff93b7fe700 1 -- 172.21.15.6:0/1701846570 learned_addr learned my addr 172.21.15.6:0/1701846570 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:25.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.757+0000 7ff93a7fc700 1 --2- 172.21.15.6:0/1701846570 >> v2:172.21.15.175:3300/0 conn(0x7ff93c0cb920 0x7ff93c15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.757+0000 7ff93b7fe700 1 -- 172.21.15.6:0/1701846570 >> v2:172.21.15.175:3300/0 conn(0x7ff93c0cb920 msgr2=0x7ff93c15d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:25.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.757+0000 7ff93b7fe700 1 --2- 172.21.15.6:0/1701846570 >> v2:172.21.15.175:3300/0 conn(0x7ff93c0cb920 0x7ff93c15d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.757+0000 7ff93b7fe700 1 -- 172.21.15.6:0/1701846570 >> v1:172.21.15.175:6789/0 conn(0x7ff93c153b70 legacy=0x7ff93c0cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:25.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.757+0000 7ff93b7fe700 1 -- 172.21.15.6:0/1701846570 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c15dab0 con 0x7ff93c153f40 2023-10-06T02:24:25.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.757+0000 7ff93b7fe700 1 --2- 172.21.15.6:0/1701846570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff93c153f40 0x7ff93c15a870 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ff93c06b3e0 tx=0x7ff92c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d683a4b15f63e9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:25.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.758+0000 7ff939ffb700 1 -- 172.21.15.6:0/1701846570 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c00e070 con 0x7ff93c153f40 2023-10-06T02:24:25.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.758+0000 7ff939ffb700 1 -- 172.21.15.6:0/1701846570 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c00ba50 con 0x7ff93c153f40 2023-10-06T02:24:25.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.758+0000 7ff939ffb700 1 -- 172.21.15.6:0/1701846570 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0092e0 con 0x7ff93c153f40 2023-10-06T02:24:25.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.758+0000 7ff941a06700 1 -- 172.21.15.6:0/1701846570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff93c153f40 msgr2=0x7ff93c15a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:25.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.758+0000 7ff941a06700 1 --2- 172.21.15.6:0/1701846570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff93c153f40 0x7ff93c15a870 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ff93c06b3e0 tx=0x7ff92c009840 comp rx=0 tx=0).stop 2023-10-06T02:24:25.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.758+0000 7ff941a06700 1 -- 172.21.15.6:0/1701846570 shutdown_connections 2023-10-06T02:24:25.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.758+0000 7ff941a06700 1 --2- 172.21.15.6:0/1701846570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff93c153f40 0x7ff93c15a870 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.758+0000 7ff941a06700 1 --2- 172.21.15.6:0/1701846570 >> v2:172.21.15.175:3300/0 conn(0x7ff93c0cb920 0x7ff93c15d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.758+0000 7ff941a06700 1 -- 172.21.15.6:0/1701846570 >> 172.21.15.6:0/1701846570 conn(0x7ff93c068680 msgr2=0x7ff93c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:25.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.758+0000 7ff941a06700 1 -- 172.21.15.6:0/1701846570 shutdown_connections 2023-10-06T02:24:25.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.758+0000 7ff941a06700 1 -- 172.21.15.6:0/1701846570 wait complete. 2023-10-06T02:24:25.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.760+0000 7ff941a06700 1 Processor -- start 2023-10-06T02:24:25.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.760+0000 7ff941a06700 1 -- start start 2023-10-06T02:24:25.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.760+0000 7ff941a06700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff93c0cb920 0x7ff93c151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.760+0000 7ff941a06700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff93c153b70 0x7ff93c16a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.760+0000 7ff941a06700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff93c153f40 0x7ff93c15f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.760+0000 7ff941a06700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0b0e30 con 0x7ff93c0cb920 2023-10-06T02:24:25.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.760+0000 7ff941a06700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c169b10 con 0x7ff93c153f40 2023-10-06T02:24:25.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.760+0000 7ff941a06700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c169d70 con 0x7ff93c153b70 2023-10-06T02:24:25.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.760+0000 7ff93affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff93c0cb920 0x7ff93c151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.760+0000 7ff93affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff93c0cb920 0x7ff93c151d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52326/0 (socket says 172.21.15.6:52326) 2023-10-06T02:24:25.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.760+0000 7ff93affd700 1 -- 172.21.15.6:0/2877953493 learned_addr learned my addr 172.21.15.6:0/2877953493 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:25.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.761+0000 7ff93affd700 1 -- 172.21.15.6:0/2877953493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff93c153b70 msgr2=0x7ff93c16a250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T02:24:25.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.761+0000 7ff93affd700 1 --2- 172.21.15.6:0/2877953493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff93c153b70 0x7ff93c16a250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.761+0000 7ff93affd700 1 -- 172.21.15.6:0/2877953493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff93c153f40 msgr2=0x7ff93c15f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:25.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.761+0000 7ff93affd700 1 --2- 172.21.15.6:0/2877953493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff93c153f40 0x7ff93c15f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:25.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.761+0000 7ff93affd700 1 -- 172.21.15.6:0/2877953493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c009ae0 con 0x7ff93c0cb920 2023-10-06T02:24:25.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.761+0000 7ff93affd700 1 --2- 172.21.15.6:0/2877953493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff93c0cb920 0x7ff93c151d00 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c590 tx=0x7ff93400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:25.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.761+0000 7ff932ffd700 1 -- 172.21.15.6:0/2877953493 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934011590 con 0x7ff93c0cb920 2023-10-06T02:24:25.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.761+0000 7ff932ffd700 1 -- 172.21.15.6:0/2877953493 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9340116f0 con 0x7ff93c0cb920 2023-10-06T02:24:25.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.761+0000 7ff932ffd700 1 -- 172.21.15.6:0/2877953493 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934011ab0 con 0x7ff93c0cb920 2023-10-06T02:24:25.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.761+0000 7ff941a06700 1 -- 172.21.15.6:0/2877953493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93c0b0590 con 0x7ff93c0cb920 2023-10-06T02:24:25.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.761+0000 7ff941a06700 1 -- 172.21.15.6:0/2877953493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93c0b0b50 con 0x7ff93c0cb920 2023-10-06T02:24:25.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.763+0000 7ff941a06700 1 -- 172.21.15.6:0/2877953493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93c169f30 con 0x7ff93c0cb920 2023-10-06T02:24:25.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.768+0000 7ff932ffd700 1 -- 172.21.15.6:0/2877953493 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff93401c440 con 0x7ff93c0cb920 2023-10-06T02:24:25.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.768+0000 7ff932ffd700 1 --2- 172.21.15.6:0/2877953493 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff91c066f30 0x7ff91c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:25.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.768+0000 7ff932ffd700 1 -- 172.21.15.6:0/2877953493 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5698+0+0 (secure 0 0 0) 0x7ff9340841d0 con 0x7ff93c0cb920 2023-10-06T02:24:25.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.769+0000 7ff93a7fc700 1 --2- 172.21.15.6:0/2877953493 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff91c066f30 0x7ff91c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:25.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.770+0000 7ff93a7fc700 1 --2- 172.21.15.6:0/2877953493 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff91c066f30 0x7ff91c0693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff924009a60 tx=0x7ff924008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:25.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:25.771+0000 7ff932ffd700 1 -- 172.21.15.6:0/2877953493 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9340514c0 con 0x7ff93c0cb920 2023-10-06T02:24:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:26.048+0000 7ff941a06700 1 -- 172.21.15.6:0/2877953493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush"]} v 0) v1 -- 0x7ff93c068420 con 0x7ff93c0cb920 2023-10-06T02:24:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:26.934+0000 7ff932ffd700 1 -- 172.21.15.6:0/2877953493 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_dentry_first_preflush"]}]=0 v320) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff9340170d0 con 0x7ff93c0cb920 2023-10-06T02:24:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:26.937+0000 7ff941a06700 1 -- 172.21.15.6:0/2877953493 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff91c066f30 msgr2=0x7ff91c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:26.937+0000 7ff941a06700 1 --2- 172.21.15.6:0/2877953493 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff91c066f30 0x7ff91c0693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff924009a60 tx=0x7ff924008040 comp rx=0 tx=0).stop 2023-10-06T02:24:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:26.937+0000 7ff941a06700 1 -- 172.21.15.6:0/2877953493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff93c0cb920 msgr2=0x7ff93c151d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:26.937+0000 7ff941a06700 1 --2- 172.21.15.6:0/2877953493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff93c0cb920 0x7ff93c151d00 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c590 tx=0x7ff93400c950 comp rx=0 tx=0).stop 2023-10-06T02:24:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:26.937+0000 7ff941a06700 1 -- 172.21.15.6:0/2877953493 shutdown_connections 2023-10-06T02:24:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:26.937+0000 7ff941a06700 1 --2- 172.21.15.6:0/2877953493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff93c153f40 0x7ff93c15f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:26.937+0000 7ff941a06700 1 --2- 172.21.15.6:0/2877953493 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff91c066f30 0x7ff91c0693e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:26.937+0000 7ff941a06700 1 --2- 172.21.15.6:0/2877953493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff93c0cb920 0x7ff93c151d00 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:26.937+0000 7ff941a06700 1 --2- 172.21.15.6:0/2877953493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff93c153b70 0x7ff93c16a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:26.937+0000 7ff941a06700 1 -- 172.21.15.6:0/2877953493 >> 172.21.15.6:0/2877953493 conn(0x7ff93c068680 msgr2=0x7ff93c086ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:26.937+0000 7ff941a06700 1 -- 172.21.15.6:0/2877953493 shutdown_connections 2023-10-06T02:24:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:26.937+0000 7ff941a06700 1 -- 172.21.15.6:0/2877953493 wait complete. 2023-10-06T02:24:26.952 INFO:tasks.cephfs_test_runner:That the MDS won't write a dentry with new damage to CDentry::first ... ok 2023-10-06T02:24:26.952 INFO:tasks.cephfs_test_runner:Starting test: test_object_deletion (tasks.cephfs.test_damage.TestDamage) That the MDS has a clean 'damaged' response to loss of any single metadata object 2023-10-06T02:24:26.953 INFO:tasks.cephfs_test_runner:test_object_deletion (tasks.cephfs.test_damage.TestDamage) 2023-10-06T02:24:26.953 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_object_deletion' 2023-10-06T02:24:27.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.079+0000 7f2250da3700 1 Processor -- start 2023-10-06T02:24:27.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.079+0000 7f2250da3700 1 -- start start 2023-10-06T02:24:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.080+0000 7f2250da3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f224c159150 0x7f224c15de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.080+0000 7f2250da3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f224c0cccf0 0x7f224c0b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.080+0000 7f2250da3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f224c0afbc0 con 0x7f224c0b08f0 2023-10-06T02:24:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.080+0000 7f2250da3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224c0cd620 con 0x7f224c159150 2023-10-06T02:24:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.080+0000 7f2250da3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c0afe10 con 0x7f224c0cccf0 2023-10-06T02:24:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.080+0000 7f224a59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f224c159150 0x7f224c15de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.081+0000 7f2249d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f224c0b08f0 0x7f224c159520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52958/0 (socket says 172.21.15.6:52958) 2023-10-06T02:24:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.081+0000 7f2249d9b700 1 -- 172.21.15.6:0/1306080739 learned_addr learned my addr 172.21.15.6:0/1306080739 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.081+0000 7f224ad9d700 1 --2- 172.21.15.6:0/1306080739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f224c0cccf0 0x7f224c0b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.081+0000 7f224a59c700 1 -- 172.21.15.6:0/1306080739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f224c0cccf0 msgr2=0x7f224c0b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.081+0000 7f224a59c700 1 --2- 172.21.15.6:0/1306080739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f224c0cccf0 0x7f224c0b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.081+0000 7f224a59c700 1 -- 172.21.15.6:0/1306080739 >> v1:172.21.15.6:6789/0 conn(0x7f224c0b08f0 legacy=0x7f224c159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.081+0000 7f224a59c700 1 -- 172.21.15.6:0/1306080739 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c0b00f0 con 0x7f224c159150 2023-10-06T02:24:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.081+0000 7f224959a700 1 -- 172.21.15.6:0/1306080739 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129197953 0 0) 0x7f224c0afbc0 con 0x7f224c0b08f0 2023-10-06T02:24:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.081+0000 7f224ad9d700 1 --2- 172.21.15.6:0/1306080739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f224c0cccf0 0x7f224c0b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.081+0000 7f224a59c700 1 --2- 172.21.15.6:0/1306080739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224c159150 0x7f224c15de30 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f2244009e60 tx=0x7f2244009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592a438666c6ba70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.081+0000 7f224959a700 1 -- 172.21.15.6:0/1306080739 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224400e070 con 0x7f224c159150 2023-10-06T02:24:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.081+0000 7f224959a700 1 -- 172.21.15.6:0/1306080739 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224400bc30 con 0x7f224c159150 2023-10-06T02:24:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.081+0000 7f224959a700 1 -- 172.21.15.6:0/1306080739 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244012430 con 0x7f224c159150 2023-10-06T02:24:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.082+0000 7f2250da3700 1 -- 172.21.15.6:0/1306080739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224c159150 msgr2=0x7f224c15de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.082+0000 7f2250da3700 1 --2- 172.21.15.6:0/1306080739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224c159150 0x7f224c15de30 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f2244009e60 tx=0x7f2244009780 comp rx=0 tx=0).stop 2023-10-06T02:24:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.082+0000 7f2250da3700 1 -- 172.21.15.6:0/1306080739 shutdown_connections 2023-10-06T02:24:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.082+0000 7f2250da3700 1 --2- 172.21.15.6:0/1306080739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f224c0cccf0 0x7f224c0b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.082+0000 7f2250da3700 1 --2- 172.21.15.6:0/1306080739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224c159150 0x7f224c15de30 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.082+0000 7f2250da3700 1 -- 172.21.15.6:0/1306080739 >> 172.21.15.6:0/1306080739 conn(0x7f224c068680 msgr2=0x7f224c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.082+0000 7f2250da3700 1 -- 172.21.15.6:0/1306080739 shutdown_connections 2023-10-06T02:24:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.082+0000 7f2250da3700 1 -- 172.21.15.6:0/1306080739 wait complete. 2023-10-06T02:24:27.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.083+0000 7f2250da3700 1 Processor -- start 2023-10-06T02:24:27.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.083+0000 7f2250da3700 1 -- start start 2023-10-06T02:24:27.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.084+0000 7f2250da3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f224c0b08f0 0x7f224c0b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:27.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.084+0000 7f2250da3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224c0cccf0 0x7f224c0c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.084+0000 7f2250da3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f224c159150 0x7f224c15c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.084+0000 7f2250da3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c0b4af0 con 0x7f224c0cccf0 2023-10-06T02:24:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.084+0000 7f2250da3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c15c090 con 0x7f224c159150 2023-10-06T02:24:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.084+0000 7f2250da3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c15b480 con 0x7f224c0b08f0 2023-10-06T02:24:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.084+0000 7f2249d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224c0cccf0 0x7f224c0c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.084+0000 7f2249d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224c0cccf0 0x7f224c0c4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52334/0 (socket says 172.21.15.6:52334) 2023-10-06T02:24:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.084+0000 7f2249d9b700 1 -- 172.21.15.6:0/1727380445 learned_addr learned my addr 172.21.15.6:0/1727380445 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.084+0000 7f224ad9d700 1 --2- 172.21.15.6:0/1727380445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f224c159150 0x7f224c15c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.084+0000 7f224a59c700 1 --2- 172.21.15.6:0/1727380445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f224c0b08f0 0x7f224c0b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.084+0000 7f2249d9b700 1 -- 172.21.15.6:0/1727380445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f224c0b08f0 msgr2=0x7f224c0b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.084+0000 7f2249d9b700 1 --2- 172.21.15.6:0/1727380445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f224c0b08f0 0x7f224c0b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.084+0000 7f2249d9b700 1 -- 172.21.15.6:0/1727380445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f224c159150 msgr2=0x7f224c15c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.084+0000 7f2249d9b700 1 --2- 172.21.15.6:0/1727380445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f224c159150 0x7f224c15c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.084+0000 7f2249d9b700 1 -- 172.21.15.6:0/1727380445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2244009a20 con 0x7f224c0cccf0 2023-10-06T02:24:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.084+0000 7f2249d9b700 1 --2- 172.21.15.6:0/1727380445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224c0cccf0 0x7f224c0c4b30 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f223400c5b0 tx=0x7f2234001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.085+0000 7f22427fc700 1 -- 172.21.15.6:0/1727380445 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234005b30 con 0x7f224c0cccf0 2023-10-06T02:24:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.085+0000 7f22427fc700 1 -- 172.21.15.6:0/1727380445 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2234005c90 con 0x7f224c0cccf0 2023-10-06T02:24:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.085+0000 7f2250da3700 1 -- 172.21.15.6:0/1727380445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224c15b760 con 0x7f224c0cccf0 2023-10-06T02:24:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.085+0000 7f22427fc700 1 -- 172.21.15.6:0/1727380445 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234007300 con 0x7f224c0cccf0 2023-10-06T02:24:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.085+0000 7f2250da3700 1 -- 172.21.15.6:0/1727380445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224c15bd20 con 0x7f224c0cccf0 2023-10-06T02:24:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.086+0000 7f2250da3700 1 -- 172.21.15.6:0/1727380445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224c088aa0 con 0x7f224c0cccf0 2023-10-06T02:24:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.086+0000 7f22427fc700 1 -- 172.21.15.6:0/1727380445 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f223401b3b0 con 0x7f224c0cccf0 2023-10-06T02:24:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.086+0000 7f22427fc700 1 --2- 172.21.15.6:0/1727380445 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f222c066f30 0x7f222c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.086+0000 7f22427fc700 1 -- 172.21.15.6:0/1727380445 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f2234083960 con 0x7f224c0cccf0 2023-10-06T02:24:27.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.087+0000 7f224a59c700 1 --2- 172.21.15.6:0/1727380445 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f222c066f30 0x7f222c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:27.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.087+0000 7f224a59c700 1 --2- 172.21.15.6:0/1727380445 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f222c066f30 0x7f222c0693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2244009e60 tx=0x7f2244019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:27.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.091+0000 7f22427fc700 1 -- 172.21.15.6:0/1727380445 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2234050bd0 con 0x7f224c0cccf0 2023-10-06T02:24:27.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.362+0000 7f2250da3700 1 -- 172.21.15.6:0/1727380445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_object_deletion"]} v 0) v1 -- 0x7f224c15c1d0 con 0x7f224c0cccf0 2023-10-06T02:24:27.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.936+0000 7f22427fc700 1 -- 172.21.15.6:0/1727380445 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_object_deletion"]}]=0 v321) v1 ==== 138+0+0 (secure 0 0 0) 0x7f22340170d0 con 0x7f224c0cccf0 2023-10-06T02:24:27.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.939+0000 7f2250da3700 1 -- 172.21.15.6:0/1727380445 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f222c066f30 msgr2=0x7f222c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:27.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.939+0000 7f2250da3700 1 --2- 172.21.15.6:0/1727380445 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f222c066f30 0x7f222c0693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2244009e60 tx=0x7f2244019000 comp rx=0 tx=0).stop 2023-10-06T02:24:27.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.939+0000 7f2250da3700 1 -- 172.21.15.6:0/1727380445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224c0cccf0 msgr2=0x7f224c0c4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:27.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.939+0000 7f2250da3700 1 --2- 172.21.15.6:0/1727380445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224c0cccf0 0x7f224c0c4b30 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f223400c5b0 tx=0x7f2234001070 comp rx=0 tx=0).stop 2023-10-06T02:24:27.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.939+0000 7f2250da3700 1 -- 172.21.15.6:0/1727380445 shutdown_connections 2023-10-06T02:24:27.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.939+0000 7f2250da3700 1 --2- 172.21.15.6:0/1727380445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f224c159150 0x7f224c15c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:27.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.939+0000 7f2250da3700 1 --2- 172.21.15.6:0/1727380445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f224c0b08f0 0x7f224c0b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:27.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.939+0000 7f2250da3700 1 --2- 172.21.15.6:0/1727380445 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f222c066f30 0x7f222c0693e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:27.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.939+0000 7f2250da3700 1 --2- 172.21.15.6:0/1727380445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224c0cccf0 0x7f224c0c4b30 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:27.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.939+0000 7f2250da3700 1 -- 172.21.15.6:0/1727380445 >> 172.21.15.6:0/1727380445 conn(0x7f224c068680 msgr2=0x7f224c0cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:27.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.939+0000 7f2250da3700 1 -- 172.21.15.6:0/1727380445 shutdown_connections 2023-10-06T02:24:27.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:27.939+0000 7f2250da3700 1 -- 172.21.15.6:0/1727380445 wait complete. 2023-10-06T02:24:27.955 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:24:28.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.082+0000 7f45dcfb9700 1 Processor -- start 2023-10-06T02:24:28.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.082+0000 7f45dcfb9700 1 -- start start 2023-10-06T02:24:28.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.083+0000 7f45dcfb9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f45d815cae0 0x7f45d80c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:28.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.083+0000 7f45dcfb9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d806a1a0 con 0x7f45d806a910 2023-10-06T02:24:28.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.083+0000 7f45dcfb9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d806a480 con 0x7f45d80cc740 2023-10-06T02:24:28.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.083+0000 7f45dcfb9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d80c3f40 con 0x7f45d815cae0 2023-10-06T02:24:28.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.083+0000 7f45d5d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f45d806a910 0x7f45d806ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52974/0 (socket says 172.21.15.6:52974) 2023-10-06T02:24:28.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.083+0000 7f45d5d9b700 1 -- 172.21.15.6:0/1262507430 learned_addr learned my addr 172.21.15.6:0/1262507430 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:28.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d659c700 1 --2- 172.21.15.6:0/1262507430 >> v2:172.21.15.175:3300/0 conn(0x7f45d815cae0 0x7f45d80c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:28.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d559a700 1 -- 172.21.15.6:0/1262507430 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018873949 0 0) 0x7f45d806a1a0 con 0x7f45d806a910 2023-10-06T02:24:28.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d559a700 1 -- 172.21.15.6:0/1262507430 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45c4003570 con 0x7f45d806a910 2023-10-06T02:24:28.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d559a700 1 -- 172.21.15.6:0/1262507430 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1178603648 0 0) 0x7f45c4003570 con 0x7f45d806a910 2023-10-06T02:24:28.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d559a700 1 -- 172.21.15.6:0/1262507430 >> v2:172.21.15.175:3300/0 conn(0x7f45d815cae0 msgr2=0x7f45d80c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:28.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d559a700 1 --2- 172.21.15.6:0/1262507430 >> v2:172.21.15.175:3300/0 conn(0x7f45d815cae0 0x7f45d80c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d559a700 1 -- 172.21.15.6:0/1262507430 >> v1:172.21.15.175:6789/0 conn(0x7f45d80cc740 legacy=0x7f45d80ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:28.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d559a700 1 -- 172.21.15.6:0/1262507430 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d80c4220 con 0x7f45d806a910 2023-10-06T02:24:28.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d559a700 1 -- 172.21.15.6:0/1262507430 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f45c0001470 con 0x7f45d806a910 2023-10-06T02:24:28.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d559a700 1 -- 172.21.15.6:0/1262507430 >> v1:172.21.15.6:6789/0 conn(0x7f45d806a910 legacy=0x7f45d806ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:28.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d559a700 1 --2- 172.21.15.6:0/1262507430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c4003a60 0x7f45c4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:28.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d559a700 1 --2- 172.21.15.6:0/1262507430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c4004810 0x7f45c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:28.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d559a700 1 --2- 172.21.15.6:0/1262507430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c40051c0 0x7f45c400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:28.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d559a700 1 -- 172.21.15.6:0/1262507430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80c3f40 con 0x7f45c4003a60 2023-10-06T02:24:28.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d559a700 1 -- 172.21.15.6:0/1262507430 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c400c050 con 0x7f45c4004810 2023-10-06T02:24:28.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d559a700 1 -- 172.21.15.6:0/1262507430 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c400c210 con 0x7f45c40051c0 2023-10-06T02:24:28.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d659c700 1 --2- 172.21.15.6:0/1262507430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c4003a60 0x7f45c4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:28.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d5d9b700 1 --2- 172.21.15.6:0/1262507430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c4004810 0x7f45c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:28.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d6d9d700 1 --2- 172.21.15.6:0/1262507430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c40051c0 0x7f45c400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:28.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d659c700 1 -- 172.21.15.6:0/1262507430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c40051c0 msgr2=0x7f45c400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:28.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d659c700 1 --2- 172.21.15.6:0/1262507430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c40051c0 0x7f45c400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.084+0000 7f45d659c700 1 -- 172.21.15.6:0/1262507430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c4004810 msgr2=0x7f45c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:28.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.085+0000 7f45d659c700 1 --2- 172.21.15.6:0/1262507430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c4004810 0x7f45c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.085+0000 7f45d6d9d700 1 -- 172.21.15.6:0/1262507430 reap_dead start 2023-10-06T02:24:28.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.085+0000 7f45d659c700 1 -- 172.21.15.6:0/1262507430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c4003570 con 0x7f45c4003a60 2023-10-06T02:24:28.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.085+0000 7f45d659c700 1 --2- 172.21.15.6:0/1262507430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c4003a60 0x7f45c4003e30 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f45d000e2d0 tx=0x7f45d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0f7bc306d256b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:28.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.085+0000 7f45d559a700 1 -- 172.21.15.6:0/1262507430 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d000eb20 con 0x7f45c4003a60 2023-10-06T02:24:28.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.085+0000 7f45d559a700 1 -- 172.21.15.6:0/1262507430 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d000f040 con 0x7f45c4003a60 2023-10-06T02:24:28.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.085+0000 7f45d559a700 1 -- 172.21.15.6:0/1262507430 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d000eeb0 con 0x7f45c4003a60 2023-10-06T02:24:28.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.085+0000 7f45dcfb9700 1 -- 172.21.15.6:0/1262507430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c4003a60 msgr2=0x7f45c4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:28.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.085+0000 7f45dcfb9700 1 --2- 172.21.15.6:0/1262507430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c4003a60 0x7f45c4003e30 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f45d000e2d0 tx=0x7f45d000b040 comp rx=0 tx=0).stop 2023-10-06T02:24:28.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.085+0000 7f45dcfb9700 1 -- 172.21.15.6:0/1262507430 shutdown_connections 2023-10-06T02:24:28.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.085+0000 7f45dcfb9700 1 --2- 172.21.15.6:0/1262507430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c4003a60 0x7f45c4003e30 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.085+0000 7f45dcfb9700 1 -- 172.21.15.6:0/1262507430 >> 172.21.15.6:0/1262507430 conn(0x7f45d8067910 msgr2=0x7f45d80ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:28.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.086+0000 7f45dcfb9700 1 -- 172.21.15.6:0/1262507430 shutdown_connections 2023-10-06T02:24:28.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.086+0000 7f45dcfb9700 1 -- 172.21.15.6:0/1262507430 wait complete. 2023-10-06T02:24:28.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.087+0000 7f45dcfb9700 1 Processor -- start 2023-10-06T02:24:28.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.087+0000 7f45dcfb9700 1 -- start start 2023-10-06T02:24:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.087+0000 7f45dcfb9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c4003a60 0x7f45d814d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.087+0000 7f45dcfb9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d81572e0 0x7f45d8158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.087+0000 7f45dcfb9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45d815abe0 0x7f45d815b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.087+0000 7f45dcfb9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80b3070 con 0x7f45c4003a60 2023-10-06T02:24:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.087+0000 7f45dcfb9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d815b590 con 0x7f45d81572e0 2023-10-06T02:24:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.087+0000 7f45dcfb9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80b24a0 con 0x7f45d815abe0 2023-10-06T02:24:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.088+0000 7f45d659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c4003a60 0x7f45d814d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.088+0000 7f45d659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c4003a60 0x7f45d814d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52362/0 (socket says 172.21.15.6:52362) 2023-10-06T02:24:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.088+0000 7f45d659c700 1 -- 172.21.15.6:0/1804528045 learned_addr learned my addr 172.21.15.6:0/1804528045 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.088+0000 7f45d5d9b700 1 --2- 172.21.15.6:0/1804528045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d81572e0 0x7f45d8158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.088+0000 7f45d6d9d700 1 --2- 172.21.15.6:0/1804528045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45d815abe0 0x7f45d815b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.088+0000 7f45d659c700 1 -- 172.21.15.6:0/1804528045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45d815abe0 msgr2=0x7f45d815b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.088+0000 7f45d659c700 1 --2- 172.21.15.6:0/1804528045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45d815abe0 0x7f45d815b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.088+0000 7f45d659c700 1 -- 172.21.15.6:0/1804528045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d81572e0 msgr2=0x7f45d8158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.088+0000 7f45d659c700 1 --2- 172.21.15.6:0/1804528045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d81572e0 0x7f45d8158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.088+0000 7f45d659c700 1 -- 172.21.15.6:0/1804528045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d80b2740 con 0x7f45c4003a60 2023-10-06T02:24:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.088+0000 7f45d6d9d700 1 --2- 172.21.15.6:0/1804528045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45d815abe0 0x7f45d815b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.088+0000 7f45d659c700 1 --2- 172.21.15.6:0/1804528045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c4003a60 0x7f45d814d420 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f45d00094a0 tx=0x7f45d001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.088+0000 7f45ce7fc700 1 -- 172.21.15.6:0/1804528045 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d001d450 con 0x7f45c4003a60 2023-10-06T02:24:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.088+0000 7f45ce7fc700 1 -- 172.21.15.6:0/1804528045 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d001d5b0 con 0x7f45c4003a60 2023-10-06T02:24:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.088+0000 7f45dcfb9700 1 -- 172.21.15.6:0/1804528045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d80b2a20 con 0x7f45c4003a60 2023-10-06T02:24:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.088+0000 7f45ce7fc700 1 -- 172.21.15.6:0/1804528045 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d001d9b0 con 0x7f45c4003a60 2023-10-06T02:24:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.088+0000 7f45dcfb9700 1 -- 172.21.15.6:0/1804528045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d80b3500 con 0x7f45c4003a60 2023-10-06T02:24:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.089+0000 7f45dcfb9700 1 -- 172.21.15.6:0/1804528045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d8151840 con 0x7f45c4003a60 2023-10-06T02:24:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.089+0000 7f45ce7fc700 1 -- 172.21.15.6:0/1804528045 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45d0003040 con 0x7f45c4003a60 2023-10-06T02:24:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.090+0000 7f45ce7fc700 1 --2- 172.21.15.6:0/1804528045 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f45b8066f30 0x7f45b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.090+0000 7f45ce7fc700 1 -- 172.21.15.6:0/1804528045 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f45d0086560 con 0x7f45c4003a60 2023-10-06T02:24:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.090+0000 7f45d5d9b700 1 --2- 172.21.15.6:0/1804528045 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f45b8066f30 0x7f45b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.091+0000 7f45d5d9b700 1 --2- 172.21.15.6:0/1804528045 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f45b8066f30 0x7f45b80693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f45d81504b0 tx=0x7f45c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.094+0000 7f45ce7fc700 1 -- 172.21.15.6:0/1804528045 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45d00537d0 con 0x7f45c4003a60 2023-10-06T02:24:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.286+0000 7f45dcfb9700 1 -- 172.21.15.6:0/1804528045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f45d8068420 con 0x7f45c4003a60 2023-10-06T02:24:28.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.291+0000 7f45ce7fc700 1 -- 172.21.15.6:0/1804528045 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f45d0009e60 con 0x7f45c4003a60 2023-10-06T02:24:28.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.293+0000 7f45dcfb9700 1 -- 172.21.15.6:0/1804528045 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f45b8066f30 msgr2=0x7f45b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:28.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.293+0000 7f45dcfb9700 1 --2- 172.21.15.6:0/1804528045 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f45b8066f30 0x7f45b80693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f45d81504b0 tx=0x7f45c0009040 comp rx=0 tx=0).stop 2023-10-06T02:24:28.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.293+0000 7f45dcfb9700 1 -- 172.21.15.6:0/1804528045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c4003a60 msgr2=0x7f45d814d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:28.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.293+0000 7f45dcfb9700 1 --2- 172.21.15.6:0/1804528045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c4003a60 0x7f45d814d420 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f45d00094a0 tx=0x7f45d001a000 comp rx=0 tx=0).stop 2023-10-06T02:24:28.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.293+0000 7f45dcfb9700 1 -- 172.21.15.6:0/1804528045 shutdown_connections 2023-10-06T02:24:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.293+0000 7f45dcfb9700 1 --2- 172.21.15.6:0/1804528045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45d815abe0 0x7f45d815b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.293+0000 7f45dcfb9700 1 --2- 172.21.15.6:0/1804528045 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f45b8066f30 0x7f45b80693e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.293+0000 7f45dcfb9700 1 --2- 172.21.15.6:0/1804528045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c4003a60 0x7f45d814d420 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.293+0000 7f45dcfb9700 1 --2- 172.21.15.6:0/1804528045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d81572e0 0x7f45d8158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.293+0000 7f45dcfb9700 1 -- 172.21.15.6:0/1804528045 >> 172.21.15.6:0/1804528045 conn(0x7f45d8067910 msgr2=0x7f45d814f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.293+0000 7f45dcfb9700 1 -- 172.21.15.6:0/1804528045 shutdown_connections 2023-10-06T02:24:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.293+0000 7f45dcfb9700 1 -- 172.21.15.6:0/1804528045 wait complete. 2023-10-06T02:24:28.306 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:24:28.306 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:24:28.353 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:24:28.402 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:24:28.402 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:24:28.402 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:28.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.520+0000 7f5c9691e700 1 Processor -- start 2023-10-06T02:24:28.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.520+0000 7f5c9691e700 1 -- start start 2023-10-06T02:24:28.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.521+0000 7f5c9691e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c9015a5d0 0x7f5c900b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:28.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.521+0000 7f5c9691e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5c9006efc0 0x7f5c900c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.521+0000 7f5c9691e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9006eb30 con 0x7f5c9015a9a0 2023-10-06T02:24:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.521+0000 7f5c9691e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c900c9760 con 0x7f5c9006efc0 2023-10-06T02:24:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.521+0000 7f5c9691e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c900c9480 con 0x7f5c9015a5d0 2023-10-06T02:24:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.522+0000 7f5c8ffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c9015a5d0 0x7f5c900b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.522+0000 7f5c94ebb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5c9006efc0 0x7f5c900c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.522+0000 7f5c8ffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c9015a5d0 0x7f5c900b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:44686/0 (socket says 172.21.15.6:44686) 2023-10-06T02:24:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.522+0000 7f5c8f7fe700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5c9015a9a0 0x7f5c900c8770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:36320/0 (socket says 172.21.15.6:36320) 2023-10-06T02:24:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.522+0000 7f5c94ebb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5c9006efc0 0x7f5c900c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:53426/0 (socket says 172.21.15.6:53426) 2023-10-06T02:24:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.522+0000 7f5c8ffff700 1 -- 172.21.15.6:0/3688562386 learned_addr learned my addr 172.21.15.6:0/3688562386 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.522+0000 7f5c8ffff700 1 -- 172.21.15.6:0/3688562386 >> v2:172.21.15.175:3300/0 conn(0x7f5c9006efc0 msgr2=0x7f5c900c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.522+0000 7f5c8ffff700 1 --2- 172.21.15.6:0/3688562386 >> v2:172.21.15.175:3300/0 conn(0x7f5c9006efc0 0x7f5c900c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.522+0000 7f5c8ffff700 1 -- 172.21.15.6:0/3688562386 >> v1:172.21.15.175:6789/0 conn(0x7f5c9015a9a0 legacy=0x7f5c900c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:28.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.522+0000 7f5c8ffff700 1 -- 172.21.15.6:0/3688562386 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9006e4e0 con 0x7f5c9015a5d0 2023-10-06T02:24:28.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.522+0000 7f5c94ebb700 1 --2- 172.21.15.6:0/3688562386 >> v2:172.21.15.175:3300/0 conn(0x7f5c9006efc0 0x7f5c900c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:28.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.522+0000 7f5c8ffff700 1 --2- 172.21.15.6:0/3688562386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c9015a5d0 0x7f5c900b1040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5c800099b0 tx=0x7f5c80009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e64eaf90d6b1075 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.523+0000 7f5c8effd700 1 -- 172.21.15.6:0/3688562386 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c80009ea0 con 0x7f5c9015a5d0 2023-10-06T02:24:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.523+0000 7f5c8effd700 1 -- 172.21.15.6:0/3688562386 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8000b860 con 0x7f5c9015a5d0 2023-10-06T02:24:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.523+0000 7f5c8effd700 1 -- 172.21.15.6:0/3688562386 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8000bc00 con 0x7f5c9015a5d0 2023-10-06T02:24:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.523+0000 7f5c9691e700 1 -- 172.21.15.6:0/3688562386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c9015a5d0 msgr2=0x7f5c900b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.523+0000 7f5c9691e700 1 --2- 172.21.15.6:0/3688562386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c9015a5d0 0x7f5c900b1040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5c800099b0 tx=0x7f5c80009250 comp rx=0 tx=0).stop 2023-10-06T02:24:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.523+0000 7f5c9691e700 1 -- 172.21.15.6:0/3688562386 shutdown_connections 2023-10-06T02:24:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.523+0000 7f5c9691e700 1 --2- 172.21.15.6:0/3688562386 >> v2:172.21.15.175:3300/0 conn(0x7f5c9006efc0 0x7f5c900c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.523+0000 7f5c9691e700 1 --2- 172.21.15.6:0/3688562386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c9015a5d0 0x7f5c900b1040 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.523+0000 7f5c9691e700 1 -- 172.21.15.6:0/3688562386 >> 172.21.15.6:0/3688562386 conn(0x7f5c90069100 msgr2=0x7f5c900ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.523+0000 7f5c9691e700 1 -- 172.21.15.6:0/3688562386 shutdown_connections 2023-10-06T02:24:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.523+0000 7f5c9691e700 1 -- 172.21.15.6:0/3688562386 wait complete. 2023-10-06T02:24:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.524+0000 7f5c9691e700 1 Processor -- start 2023-10-06T02:24:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.525+0000 7f5c9691e700 1 -- start start 2023-10-06T02:24:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.525+0000 7f5c9691e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c9006efc0 0x7f5c9016a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.525+0000 7f5c9691e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c9015a5d0 0x7f5c9006aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.525+0000 7f5c9691e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c9015a9a0 0x7f5c9006aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.525+0000 7f5c9691e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c90167860 con 0x7f5c9015a9a0 2023-10-06T02:24:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.525+0000 7f5c9691e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c90167a50 con 0x7f5c9015a5d0 2023-10-06T02:24:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.525+0000 7f5c9691e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c90167d30 con 0x7f5c9006efc0 2023-10-06T02:24:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.525+0000 7f5c94ebb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c9015a9a0 0x7f5c9006aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.525+0000 7f5c94ebb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c9015a9a0 0x7f5c9006aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52372/0 (socket says 172.21.15.6:52372) 2023-10-06T02:24:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.525+0000 7f5c94ebb700 1 -- 172.21.15.6:0/1666298468 learned_addr learned my addr 172.21.15.6:0/1666298468 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.526+0000 7f5c8ffff700 1 --2- 172.21.15.6:0/1666298468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c9006efc0 0x7f5c9016a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.526+0000 7f5c8f7fe700 1 --2- 172.21.15.6:0/1666298468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c9015a5d0 0x7f5c9006aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.526+0000 7f5c94ebb700 1 -- 172.21.15.6:0/1666298468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c9006efc0 msgr2=0x7f5c9016a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.526+0000 7f5c94ebb700 1 --2- 172.21.15.6:0/1666298468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c9006efc0 0x7f5c9016a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.526+0000 7f5c94ebb700 1 -- 172.21.15.6:0/1666298468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c9015a5d0 msgr2=0x7f5c9006aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.526+0000 7f5c94ebb700 1 --2- 172.21.15.6:0/1666298468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c9015a5d0 0x7f5c9006aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.526+0000 7f5c94ebb700 1 -- 172.21.15.6:0/1666298468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c88009a20 con 0x7f5c9015a9a0 2023-10-06T02:24:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.526+0000 7f5c8ffff700 1 --2- 172.21.15.6:0/1666298468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c9006efc0 0x7f5c9016a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.526+0000 7f5c8f7fe700 1 --2- 172.21.15.6:0/1666298468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c9015a5d0 0x7f5c9006aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.526+0000 7f5c94ebb700 1 --2- 172.21.15.6:0/1666298468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c9015a9a0 0x7f5c9006aff0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f5c88009fc0 tx=0x7f5c8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.526+0000 7f5c77fff700 1 -- 172.21.15.6:0/1666298468 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8800cd30 con 0x7f5c9015a9a0 2023-10-06T02:24:28.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.526+0000 7f5c9691e700 1 -- 172.21.15.6:0/1666298468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c800094f0 con 0x7f5c9015a9a0 2023-10-06T02:24:28.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.526+0000 7f5c9691e700 1 -- 172.21.15.6:0/1666298468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c90168370 con 0x7f5c9015a9a0 2023-10-06T02:24:28.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.526+0000 7f5c77fff700 1 -- 172.21.15.6:0/1666298468 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8800f040 con 0x7f5c9015a9a0 2023-10-06T02:24:28.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.526+0000 7f5c77fff700 1 -- 172.21.15.6:0/1666298468 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c880146d0 con 0x7f5c9015a9a0 2023-10-06T02:24:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.527+0000 7f5c9691e700 1 -- 172.21.15.6:0/1666298468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c9006d580 con 0x7f5c9015a9a0 2023-10-06T02:24:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.528+0000 7f5c77fff700 1 -- 172.21.15.6:0/1666298468 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c88003020 con 0x7f5c9015a9a0 2023-10-06T02:24:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.528+0000 7f5c77fff700 1 --2- 172.21.15.6:0/1666298468 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c7c066f30 0x7f5c7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.528+0000 7f5c77fff700 1 -- 172.21.15.6:0/1666298468 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f5c88085040 con 0x7f5c9015a9a0 2023-10-06T02:24:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.528+0000 7f5c8ffff700 1 --2- 172.21.15.6:0/1666298468 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c7c066f30 0x7f5c7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.529+0000 7f5c8ffff700 1 --2- 172.21.15.6:0/1666298468 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c7c066f30 0x7f5c7c0693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5c800099b0 tx=0x7f5c80017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:28.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.532+0000 7f5c77fff700 1 -- 172.21.15.6:0/1666298468 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c880522b0 con 0x7f5c9015a9a0 2023-10-06T02:24:28.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.775+0000 7f5c9691e700 1 -- 172.21.15.6:0/1666298468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c9006e7c0 con 0x7f5c9015a9a0 2023-10-06T02:24:28.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.776+0000 7f5c77fff700 1 -- 172.21.15.6:0/1666298468 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f5c880558d0 con 0x7f5c9015a9a0 2023-10-06T02:24:28.776 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:28.776 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":79,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2575759355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2575759355},{"type":"v1","addr":"172.21.15.175:6836","nonce":2575759355}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":5828,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2523304335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2523304335},{"type":"v1","addr":"172.21.15.175:6837","nonce":2523304335}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7032,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1331184347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1331184347},{"type":"v1","addr":"172.21.15.6:6835","nonce":1331184347}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":7170,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3644434987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3644434987},{"type":"v1","addr":"172.21.15.6:6834","nonce":3644434987}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[]} 2023-10-06T02:24:28.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.778+0000 7f5c9691e700 1 -- 172.21.15.6:0/1666298468 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c7c066f30 msgr2=0x7f5c7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:28.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.778+0000 7f5c9691e700 1 --2- 172.21.15.6:0/1666298468 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c7c066f30 0x7f5c7c0693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5c800099b0 tx=0x7f5c80017000 comp rx=0 tx=0).stop 2023-10-06T02:24:28.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.778+0000 7f5c9691e700 1 -- 172.21.15.6:0/1666298468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c9015a9a0 msgr2=0x7f5c9006aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:28.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.778+0000 7f5c9691e700 1 --2- 172.21.15.6:0/1666298468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c9015a9a0 0x7f5c9006aff0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f5c88009fc0 tx=0x7f5c8800b040 comp rx=0 tx=0).stop 2023-10-06T02:24:28.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.778+0000 7f5c9691e700 1 -- 172.21.15.6:0/1666298468 shutdown_connections 2023-10-06T02:24:28.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.778+0000 7f5c9691e700 1 --2- 172.21.15.6:0/1666298468 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c7c066f30 0x7f5c7c0693e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.778+0000 7f5c9691e700 1 --2- 172.21.15.6:0/1666298468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c9015a9a0 0x7f5c9006aff0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.778+0000 7f5c9691e700 1 --2- 172.21.15.6:0/1666298468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c9006efc0 0x7f5c9016a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.778+0000 7f5c9691e700 1 --2- 172.21.15.6:0/1666298468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c9015a5d0 0x7f5c9006aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:28.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.778+0000 7f5c9691e700 1 -- 172.21.15.6:0/1666298468 >> 172.21.15.6:0/1666298468 conn(0x7f5c90069100 msgr2=0x7f5c901580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:28.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.778+0000 7f5c9691e700 1 -- 172.21.15.6:0/1666298468 shutdown_connections 2023-10-06T02:24:28.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:28.778+0000 7f5c9691e700 1 -- 172.21.15.6:0/1666298468 wait complete. 2023-10-06T02:24:28.780 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 79 2023-10-06T02:24:28.791 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:24:28.791 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:24:28.791 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:24:28.791 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:24:28.792 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:24:28.792 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:24:28.792 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:24:28.792 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:24:28.792 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:24:28.792 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:24:28.792 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:24:28.793 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:24:28.793 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:24:28.793 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:24:28.793 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:24:28.793 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:24:28.800 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:24:28.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:24:28.801 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:24:28.801 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:24:28.804 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:24:28.804 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:24:28.842 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:24:28.842 DEBUG:teuthology.parallel:result is None 2023-10-06T02:24:28.843 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:24:28.843 DEBUG:teuthology.parallel:result is None 2023-10-06T02:24:28.846 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:24:28.847 DEBUG:teuthology.parallel:result is None 2023-10-06T02:24:28.917 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-06T02:24:28.917 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:24:28.926 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-10-06T02:24:34.804 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:24:34.804 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:24:34.807 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:24:34.807 DEBUG:teuthology.parallel:result is None 2023-10-06T02:24:34.808 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:24:34.886 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-10-06T02:24:34.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.939+0000 7f0af6aed700 1 Processor -- start 2023-10-06T02:24:34.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.940+0000 7f0af6aed700 1 -- start start 2023-10-06T02:24:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.940+0000 7f0af6aed700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af0159590 0x7f0af00cca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.940+0000 7f0af6aed700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0af0159960 0x7f0af0068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.940+0000 7f0af6aed700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af00caf30 con 0x7f0af0067570 2023-10-06T02:24:34.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.940+0000 7f0af6aed700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af00cd340 con 0x7f0af0159960 2023-10-06T02:24:34.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.940+0000 7f0af6aed700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00cbad0 con 0x7f0af0159590 2023-10-06T02:24:34.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.941+0000 7f0aeffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0af0067570 0x7f0af00cb3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50344/0 (socket says 172.21.15.6:50344) 2023-10-06T02:24:34.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.941+0000 7f0aeffff700 1 -- 172.21.15.6:0/4012455296 learned_addr learned my addr 172.21.15.6:0/4012455296 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:34.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.941+0000 7f0af4889700 1 --2- 172.21.15.6:0/4012455296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af0159590 0x7f0af00cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.941+0000 7f0af508a700 1 --2- 172.21.15.6:0/4012455296 >> v2:172.21.15.175:3300/0 conn(0x7f0af0159960 0x7f0af0068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.941+0000 7f0aef7fe700 1 -- 172.21.15.6:0/4012455296 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527678395 0 0) 0x7f0af00caf30 con 0x7f0af0067570 2023-10-06T02:24:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.941+0000 7f0aef7fe700 1 -- 172.21.15.6:0/4012455296 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ae0003570 con 0x7f0af0067570 2023-10-06T02:24:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.941+0000 7f0af4889700 1 -- 172.21.15.6:0/4012455296 >> v2:172.21.15.175:3300/0 conn(0x7f0af0159960 msgr2=0x7f0af0068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.941+0000 7f0af4889700 1 --2- 172.21.15.6:0/4012455296 >> v2:172.21.15.175:3300/0 conn(0x7f0af0159960 0x7f0af0068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.941+0000 7f0aef7fe700 1 -- 172.21.15.6:0/4012455296 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2193301871 0 0) 0x7f0ae0003570 con 0x7f0af0067570 2023-10-06T02:24:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.941+0000 7f0af4889700 1 -- 172.21.15.6:0/4012455296 >> v1:172.21.15.6:6789/0 conn(0x7f0af0067570 legacy=0x7f0af00cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.941+0000 7f0af4889700 1 -- 172.21.15.6:0/4012455296 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af00ca600 con 0x7f0af0159590 2023-10-06T02:24:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.941+0000 7f0af508a700 1 --2- 172.21.15.6:0/4012455296 >> v2:172.21.15.175:3300/0 conn(0x7f0af0159960 0x7f0af0068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.941+0000 7f0af4889700 1 --2- 172.21.15.6:0/4012455296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af0159590 0x7f0af00cca60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40098e0 tx=0x7f0ae40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3957360e340c270 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.941+0000 7f0aef7fe700 1 -- 172.21.15.6:0/4012455296 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc001470 con 0x7f0af0159590 2023-10-06T02:24:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.942+0000 7f0aef7fe700 1 -- 172.21.15.6:0/4012455296 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae4011420 con 0x7f0af0159590 2023-10-06T02:24:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.942+0000 7f0aef7fe700 1 -- 172.21.15.6:0/4012455296 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40117c0 con 0x7f0af0159590 2023-10-06T02:24:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.942+0000 7f0af6aed700 1 -- 172.21.15.6:0/4012455296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af0159590 msgr2=0x7f0af00cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.942+0000 7f0af6aed700 1 --2- 172.21.15.6:0/4012455296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af0159590 0x7f0af00cca60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40098e0 tx=0x7f0ae40091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.942+0000 7f0af6aed700 1 -- 172.21.15.6:0/4012455296 shutdown_connections 2023-10-06T02:24:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.942+0000 7f0af6aed700 1 --2- 172.21.15.6:0/4012455296 >> v2:172.21.15.175:3300/0 conn(0x7f0af0159960 0x7f0af0068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.942+0000 7f0af6aed700 1 --2- 172.21.15.6:0/4012455296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af0159590 0x7f0af00cca60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.942+0000 7f0af6aed700 1 -- 172.21.15.6:0/4012455296 >> 172.21.15.6:0/4012455296 conn(0x7f0af0095d00 msgr2=0x7f0af00af850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.942+0000 7f0af6aed700 1 -- 172.21.15.6:0/4012455296 shutdown_connections 2023-10-06T02:24:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.942+0000 7f0af6aed700 1 -- 172.21.15.6:0/4012455296 wait complete. 2023-10-06T02:24:34.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.943+0000 7f0af6aed700 1 Processor -- start 2023-10-06T02:24:34.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.943+0000 7f0af6aed700 1 -- start start 2023-10-06T02:24:34.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.944+0000 7f0af6aed700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0af0067570 0x7f0af014ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.944+0000 7f0af6aed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0af0159590 0x7f0af014e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.944+0000 7f0af6aed700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af0159960 0x7f0af016d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.944+0000 7f0af6aed700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00c54c0 con 0x7f0af0159590 2023-10-06T02:24:34.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.944+0000 7f0af6aed700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00c57a0 con 0x7f0af0067570 2023-10-06T02:24:34.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.944+0000 7f0af6aed700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af016df30 con 0x7f0af0159960 2023-10-06T02:24:34.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.944+0000 7f0aeffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0af0159590 0x7f0af014e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.944+0000 7f0aeffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0af0159590 0x7f0af014e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56292/0 (socket says 172.21.15.6:56292) 2023-10-06T02:24:34.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.944+0000 7f0aeffff700 1 -- 172.21.15.6:0/2991804617 learned_addr learned my addr 172.21.15.6:0/2991804617 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:34.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.944+0000 7f0af4889700 1 --2- 172.21.15.6:0/2991804617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0af0067570 0x7f0af014ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.945+0000 7f0af508a700 1 --2- 172.21.15.6:0/2991804617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af0159960 0x7f0af016d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.945+0000 7f0aeffff700 1 -- 172.21.15.6:0/2991804617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af0159960 msgr2=0x7f0af016d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.945+0000 7f0aeffff700 1 --2- 172.21.15.6:0/2991804617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af0159960 0x7f0af016d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.945+0000 7f0aeffff700 1 -- 172.21.15.6:0/2991804617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0af0067570 msgr2=0x7f0af014ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.945+0000 7f0aeffff700 1 --2- 172.21.15.6:0/2991804617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0af0067570 0x7f0af014ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.945+0000 7f0aeffff700 1 -- 172.21.15.6:0/2991804617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae8009a20 con 0x7f0af0159590 2023-10-06T02:24:34.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.945+0000 7f0af4889700 1 --2- 172.21.15.6:0/2991804617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0af0067570 0x7f0af014ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:34.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.945+0000 7f0aeffff700 1 --2- 172.21.15.6:0/2991804617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0af0159590 0x7f0af014e6f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00cbc0 tx=0x7f0adc001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.946+0000 7f0aecff9700 1 -- 172.21.15.6:0/2991804617 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc007360 con 0x7f0af0159590 2023-10-06T02:24:34.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.946+0000 7f0af6aed700 1 -- 172.21.15.6:0/2991804617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae4009420 con 0x7f0af0159590 2023-10-06T02:24:34.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.946+0000 7f0aecff9700 1 -- 172.21.15.6:0/2991804617 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc0074e0 con 0x7f0af0159590 2023-10-06T02:24:34.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.946+0000 7f0aecff9700 1 -- 172.21.15.6:0/2991804617 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc004830 con 0x7f0af0159590 2023-10-06T02:24:34.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.946+0000 7f0af6aed700 1 -- 172.21.15.6:0/2991804617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af016e4b0 con 0x7f0af0159590 2023-10-06T02:24:34.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.947+0000 7f0af6aed700 1 -- 172.21.15.6:0/2991804617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af00c3490 con 0x7f0af0159590 2023-10-06T02:24:34.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.948+0000 7f0aecff9700 1 -- 172.21.15.6:0/2991804617 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0adc004ba0 con 0x7f0af0159590 2023-10-06T02:24:34.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.948+0000 7f0aecff9700 1 --2- 172.21.15.6:0/2991804617 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ad4066f30 0x7f0ad40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.948+0000 7f0aecff9700 1 -- 172.21.15.6:0/2991804617 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f0adc083d00 con 0x7f0af0159590 2023-10-06T02:24:34.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.948+0000 7f0af4889700 1 --2- 172.21.15.6:0/2991804617 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ad4066f30 0x7f0ad40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.949+0000 7f0af4889700 1 --2- 172.21.15.6:0/2991804617 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ad4066f30 0x7f0ad40693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40030c0 tx=0x7f0ae4016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:34.953+0000 7f0aecff9700 1 -- 172.21.15.6:0/2991804617 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0adc051030 con 0x7f0af0159590 2023-10-06T02:24:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:35.159+0000 7f0af6aed700 1 -- 172.21.15.6:0/2991804617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0af006d070 con 0x7f0af0159590 2023-10-06T02:24:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:35.947+0000 7f0aecff9700 1 -- 172.21.15.6:0/2991804617 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v91) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0adc018020 con 0x7f0af0159590 2023-10-06T02:24:35.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:35.950+0000 7f0af6aed700 1 -- 172.21.15.6:0/2991804617 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ad4066f30 msgr2=0x7f0ad40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:35.950+0000 7f0af6aed700 1 --2- 172.21.15.6:0/2991804617 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ad4066f30 0x7f0ad40693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40030c0 tx=0x7f0ae4016000 comp rx=0 tx=0).stop 2023-10-06T02:24:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:35.950+0000 7f0af6aed700 1 -- 172.21.15.6:0/2991804617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0af0159590 msgr2=0x7f0af014e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:35.950+0000 7f0af6aed700 1 --2- 172.21.15.6:0/2991804617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0af0159590 0x7f0af014e6f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00cbc0 tx=0x7f0adc001b50 comp rx=0 tx=0).stop 2023-10-06T02:24:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:35.950+0000 7f0af6aed700 1 -- 172.21.15.6:0/2991804617 shutdown_connections 2023-10-06T02:24:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:35.950+0000 7f0af6aed700 1 --2- 172.21.15.6:0/2991804617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0af0159960 0x7f0af016d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:35.950+0000 7f0af6aed700 1 --2- 172.21.15.6:0/2991804617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0af0067570 0x7f0af014ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:35.950+0000 7f0af6aed700 1 --2- 172.21.15.6:0/2991804617 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ad4066f30 0x7f0ad40693e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:35.950+0000 7f0af6aed700 1 --2- 172.21.15.6:0/2991804617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0af0159590 0x7f0af014e6f0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:35.950+0000 7f0af6aed700 1 -- 172.21.15.6:0/2991804617 >> 172.21.15.6:0/2991804617 conn(0x7f0af0095d00 msgr2=0x7f0af01538a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:35.950+0000 7f0af6aed700 1 -- 172.21.15.6:0/2991804617 shutdown_connections 2023-10-06T02:24:35.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:35.950+0000 7f0af6aed700 1 -- 172.21.15.6:0/2991804617 wait complete. 2023-10-06T02:24:35.952 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-10-06T02:24:35.965 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:24:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.090+0000 7fc29a47f700 1 Processor -- start 2023-10-06T02:24:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.090+0000 7fc29a47f700 1 -- start start 2023-10-06T02:24:36.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc29a47f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2941593f0 0x7fc29406de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc29a47f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc294069950 con 0x7fc29406adf0 2023-10-06T02:24:36.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc29a47f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29415dfd0 con 0x7fc2941597c0 2023-10-06T02:24:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc29a47f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2940b2850 con 0x7fc2941593f0 2023-10-06T02:24:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc298a1c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc29406adf0 0x7fc29415d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50348/0 (socket says 172.21.15.6:50348) 2023-10-06T02:24:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc298a1c700 1 -- 172.21.15.6:0/306736879 learned_addr learned my addr 172.21.15.6:0/306736879 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc293fff700 1 --2- 172.21.15.6:0/306736879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2941593f0 0x7fc29406de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc292ffd700 1 -- 172.21.15.6:0/306736879 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169354381 0 0) 0x7fc294069950 con 0x7fc29406adf0 2023-10-06T02:24:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc292ffd700 1 -- 172.21.15.6:0/306736879 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc280003570 con 0x7fc29406adf0 2023-10-06T02:24:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc292ffd700 1 -- 172.21.15.6:0/306736879 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288322954 0 0) 0x7fc29415dfd0 con 0x7fc2941597c0 2023-10-06T02:24:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc292ffd700 1 -- 172.21.15.6:0/306736879 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc294069950 con 0x7fc2941597c0 2023-10-06T02:24:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc292ffd700 1 -- 172.21.15.6:0/306736879 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1364404915 0 0) 0x7fc280003570 con 0x7fc29406adf0 2023-10-06T02:24:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc292ffd700 1 -- 172.21.15.6:0/306736879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2941593f0 msgr2=0x7fc29406de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc292ffd700 1 --2- 172.21.15.6:0/306736879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2941593f0 0x7fc29406de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc292ffd700 1 -- 172.21.15.6:0/306736879 >> v1:172.21.15.175:6789/0 conn(0x7fc2941597c0 legacy=0x7fc29415d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc292ffd700 1 -- 172.21.15.6:0/306736879 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2940b1fb0 con 0x7fc29406adf0 2023-10-06T02:24:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc292ffd700 1 -- 172.21.15.6:0/306736879 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fc28c0017f0 con 0x7fc29406adf0 2023-10-06T02:24:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc292ffd700 1 -- 172.21.15.6:0/306736879 >> v1:172.21.15.6:6789/0 conn(0x7fc29406adf0 legacy=0x7fc29415d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc292ffd700 1 --2- 172.21.15.6:0/306736879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc280003c20 0x7fc280004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.091+0000 7fc292ffd700 1 --2- 172.21.15.6:0/306736879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc280004810 0x7fc280004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.092+0000 7fc292ffd700 1 --2- 172.21.15.6:0/306736879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2941593f0 0x7fc2800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.092+0000 7fc292ffd700 1 -- 172.21.15.6:0/306736879 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2940b2850 con 0x7fc280003c20 2023-10-06T02:24:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.092+0000 7fc292ffd700 1 -- 172.21.15.6:0/306736879 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28000bb40 con 0x7fc280004810 2023-10-06T02:24:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.092+0000 7fc292ffd700 1 -- 172.21.15.6:0/306736879 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28000bd00 con 0x7fc2941593f0 2023-10-06T02:24:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.092+0000 7fc293fff700 1 --2- 172.21.15.6:0/306736879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc280003c20 0x7fc280004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.092+0000 7fc2937fe700 1 --2- 172.21.15.6:0/306736879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc280004810 0x7fc280004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.092+0000 7fc298a1c700 1 --2- 172.21.15.6:0/306736879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2941593f0 0x7fc2800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.092+0000 7fc293fff700 1 -- 172.21.15.6:0/306736879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2941593f0 msgr2=0x7fc2800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.092+0000 7fc293fff700 1 --2- 172.21.15.6:0/306736879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2941593f0 0x7fc2800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.092+0000 7fc293fff700 1 -- 172.21.15.6:0/306736879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc280004810 msgr2=0x7fc280004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.092+0000 7fc293fff700 1 --2- 172.21.15.6:0/306736879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc280004810 0x7fc280004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.092+0000 7fc293fff700 1 -- 172.21.15.6:0/306736879 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc280003570 con 0x7fc280003c20 2023-10-06T02:24:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.092+0000 7fc2937fe700 1 --2- 172.21.15.6:0/306736879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc280004810 0x7fc280004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.092+0000 7fc293fff700 1 --2- 172.21.15.6:0/306736879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc280003c20 0x7fc280004010 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fc284009c00 tx=0x7fc2840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3b83b6079ae64e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.092+0000 7fc292ffd700 1 -- 172.21.15.6:0/306736879 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28400e710 con 0x7fc280003c20 2023-10-06T02:24:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.092+0000 7fc292ffd700 1 -- 172.21.15.6:0/306736879 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28400e870 con 0x7fc280003c20 2023-10-06T02:24:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.092+0000 7fc292ffd700 1 -- 172.21.15.6:0/306736879 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28400ec30 con 0x7fc280003c20 2023-10-06T02:24:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.093+0000 7fc29a47f700 1 -- 172.21.15.6:0/306736879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc280003c20 msgr2=0x7fc280004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.093+0000 7fc29a47f700 1 --2- 172.21.15.6:0/306736879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc280003c20 0x7fc280004010 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fc284009c00 tx=0x7fc2840091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.093+0000 7fc298a1c700 1 -- 172.21.15.6:0/306736879 reap_dead start 2023-10-06T02:24:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.093+0000 7fc29a47f700 1 -- 172.21.15.6:0/306736879 shutdown_connections 2023-10-06T02:24:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.093+0000 7fc29a47f700 1 -- 172.21.15.6:0/306736879 >> 172.21.15.6:0/306736879 conn(0x7fc29406cff0 msgr2=0x7fc2940afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.093+0000 7fc29a47f700 1 -- 172.21.15.6:0/306736879 shutdown_connections 2023-10-06T02:24:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.093+0000 7fc29a47f700 1 -- 172.21.15.6:0/306736879 wait complete. 2023-10-06T02:24:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.094+0000 7fc29a47f700 1 Processor -- start 2023-10-06T02:24:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.094+0000 7fc29a47f700 1 -- start start 2023-10-06T02:24:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc29a47f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc294154270 0x7fc2940cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc29a47f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2940c72d0 0x7fc29416a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc29a47f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc294157550 0x7fc2941579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc29a47f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2940c9d00 con 0x7fc294157550 2023-10-06T02:24:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc29a47f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc294157f10 con 0x7fc294154270 2023-10-06T02:24:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc29a47f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29416ac00 con 0x7fc2940c72d0 2023-10-06T02:24:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc298a1c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc294157550 0x7fc2941579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc298a1c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc294157550 0x7fc2941579d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56312/0 (socket says 172.21.15.6:56312) 2023-10-06T02:24:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc298a1c700 1 -- 172.21.15.6:0/1567320972 learned_addr learned my addr 172.21.15.6:0/1567320972 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc293fff700 1 --2- 172.21.15.6:0/1567320972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc294154270 0x7fc2940cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc2937fe700 1 --2- 172.21.15.6:0/1567320972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2940c72d0 0x7fc29416a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc298a1c700 1 -- 172.21.15.6:0/1567320972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2940c72d0 msgr2=0x7fc29416a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc298a1c700 1 --2- 172.21.15.6:0/1567320972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2940c72d0 0x7fc29416a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc298a1c700 1 -- 172.21.15.6:0/1567320972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc294154270 msgr2=0x7fc2940cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc298a1c700 1 --2- 172.21.15.6:0/1567320972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc294154270 0x7fc2940cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc298a1c700 1 -- 172.21.15.6:0/1567320972 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2940cc920 con 0x7fc294157550 2023-10-06T02:24:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc298a1c700 1 --2- 172.21.15.6:0/1567320972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc294157550 0x7fc2941579d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fc28c000f80 tx=0x7fc28c001450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.095+0000 7fc28bfff700 1 -- 172.21.15.6:0/1567320972 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c00ee20 con 0x7fc294157550 2023-10-06T02:24:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.096+0000 7fc28bfff700 1 -- 172.21.15.6:0/1567320972 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c013420 con 0x7fc294157550 2023-10-06T02:24:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.096+0000 7fc29a47f700 1 -- 172.21.15.6:0/1567320972 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2940ccc00 con 0x7fc294157550 2023-10-06T02:24:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.096+0000 7fc28bfff700 1 -- 172.21.15.6:0/1567320972 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c0137e0 con 0x7fc294157550 2023-10-06T02:24:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.096+0000 7fc29a47f700 1 -- 172.21.15.6:0/1567320972 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2940cd1c0 con 0x7fc294157550 2023-10-06T02:24:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.096+0000 7fc29a47f700 1 -- 172.21.15.6:0/1567320972 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29406d3f0 con 0x7fc294157550 2023-10-06T02:24:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.097+0000 7fc28bfff700 1 -- 172.21.15.6:0/1567320972 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc28c013b50 con 0x7fc294157550 2023-10-06T02:24:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.097+0000 7fc28bfff700 1 --2- 172.21.15.6:0/1567320972 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc274066f30 0x7fc2740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.097+0000 7fc28bfff700 1 -- 172.21.15.6:0/1567320972 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc28c084c50 con 0x7fc294157550 2023-10-06T02:24:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.097+0000 7fc293fff700 1 --2- 172.21.15.6:0/1567320972 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc274066f30 0x7fc2740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.098+0000 7fc293fff700 1 --2- 172.21.15.6:0/1567320972 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc274066f30 0x7fc2740693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc294087140 tx=0x7fc28401a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.102+0000 7fc28bfff700 1 -- 172.21.15.6:0/1567320972 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc28c051f70 con 0x7fc294157550 2023-10-06T02:24:36.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.370+0000 7fc29a47f700 1 -- 172.21.15.6:0/1567320972 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc2940b2290 con 0x7fc294157550 2023-10-06T02:24:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.370+0000 7fc28bfff700 1 -- 172.21.15.6:0/1567320972 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc28c001f90 con 0x7fc294157550 2023-10-06T02:24:36.371 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:36.371 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:24:36.371 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-10-06T02:24:36.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.371 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-10-06T02:24:36.371 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9l3UdFFRAAahVHXJW+fzPcTwa/MxOW7A==", 2023-10-06T02:24:36.371 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.372 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:24:36.372 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:24:36.372 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:24:36.372 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:24:36.372 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.372 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-10-06T02:24:36.372 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lcq7HIBAA/3Gaa7gNbUHq176zcCFgjA==", 2023-10-06T02:24:36.372 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.372 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:24:36.373 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:24:36.373 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:24:36.373 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:24:36.373 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.373 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-10-06T02:24:36.373 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9ls7FDHBAA746JdAc0gr6+qLK9tuWCZg==", 2023-10-06T02:24:36.373 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.373 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:24:36.373 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:24:36.374 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:24:36.374 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:24:36.374 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.374 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-10-06T02:24:36.374 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9llEyZJxAAKXcHXIywnLQVZlbOGKdTTg==", 2023-10-06T02:24:36.374 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.374 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:24:36.374 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:24:36.374 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:24:36.374 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:24:36.375 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.375 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-10-06T02:24:36.375 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAXbh9lLVWHERAAoYIaMicUCppJKlSwl1K8UQ==", 2023-10-06T02:24:36.375 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.375 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:36.375 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:24:36.375 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:24:36.375 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.376 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-10-06T02:24:36.376 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAabh9lgpbHDxAAXOwtusarMKccKIu9+SmmHg==", 2023-10-06T02:24:36.376 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.376 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:36.376 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:24:36.376 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:24:36.376 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.376 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-10-06T02:24:36.376 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAdbh9lG/ZcFBAA3WpHCcm2R2+IyFMK460CYw==", 2023-10-06T02:24:36.376 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.377 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:36.377 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:24:36.377 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:24:36.377 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.377 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-10-06T02:24:36.377 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAgbh9lz8J4ExAAggyFHpD2wvM/b+WKLvVneA==", 2023-10-06T02:24:36.377 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.377 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:36.377 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:24:36.377 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:24:36.377 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.378 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-10-06T02:24:36.378 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAmbh9lpSX1ERAA1vkI0SvrJb6mAciDTIGZtA==", 2023-10-06T02:24:36.378 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.378 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:36.378 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:24:36.378 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:24:36.378 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.378 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-10-06T02:24:36.379 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQApbh9ljSxwDxAACjsHigTRkZIY+lHrr9/17g==", 2023-10-06T02:24:36.379 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.379 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:36.379 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:24:36.379 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:24:36.379 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.379 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-10-06T02:24:36.379 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAsbh9l6vlZDxAAfff29OvnP+8zxQFDDt8SFA==", 2023-10-06T02:24:36.379 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.379 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:36.380 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:24:36.380 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:24:36.380 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.380 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-10-06T02:24:36.380 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAvbh9lz+1sDBAANCvbv4nJUuaVde42koP8fA==", 2023-10-06T02:24:36.380 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.380 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:36.380 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:24:36.380 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:24:36.380 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.381 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-10-06T02:24:36.381 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lO6GJKxAASfNnkG3FXno1BWm5XiqIMA==", 2023-10-06T02:24:36.381 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.381 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:24:36.381 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-10-06T02:24:36.381 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:24:36.381 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.381 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-10-06T02:24:36.381 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lpRgFNBAAYE7yue5MPAzdm5k3EOcvcg==", 2023-10-06T02:24:36.381 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.382 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:24:36.382 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:24:36.382 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:24:36.382 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:24:36.382 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.382 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-10-06T02:24:36.382 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9l1hsHMRAANI0CeqE+ZB7uQ9ZB4cF/Ig==", 2023-10-06T02:24:36.382 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.382 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:24:36.382 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:24:36.382 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:24:36.383 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:24:36.383 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.383 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-10-06T02:24:36.383 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lAV9fORAAXCO4NdIb62PH2IX0y1siCw==", 2023-10-06T02:24:36.383 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.383 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:24:36.383 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:24:36.383 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:24:36.383 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:24:36.383 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.384 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-10-06T02:24:36.384 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQASbh9lIiB6NBAAvHP4z7yHub2TXCgRAAFy5A==", 2023-10-06T02:24:36.384 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.384 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:24:36.384 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:24:36.384 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:24:36.384 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:24:36.384 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.384 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-10-06T02:24:36.385 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lMk4mEhAAbIAiSwyo+ygZRqxKBKRxuQ==", 2023-10-06T02:24:36.385 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.385 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:24:36.385 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-06T02:24:36.385 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:24:36.385 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:36.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:36.385 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-10-06T02:24:36.385 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lxXZSDRAALw3s8FP+gOrz+VIDN7tkuw==", 2023-10-06T02:24:36.385 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:24:36.385 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:24:36.385 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-06T02:24:36.386 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:24:36.386 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.386 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:36.386 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-06T02:24:36.386 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:24:36.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.372+0000 7fc29a47f700 1 -- 172.21.15.6:0/1567320972 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc274066f30 msgr2=0x7fc2740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.372+0000 7fc29a47f700 1 --2- 172.21.15.6:0/1567320972 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc274066f30 0x7fc2740693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc294087140 tx=0x7fc28401a000 comp rx=0 tx=0).stop 2023-10-06T02:24:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.372+0000 7fc29a47f700 1 -- 172.21.15.6:0/1567320972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc294157550 msgr2=0x7fc2941579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.372+0000 7fc29a47f700 1 --2- 172.21.15.6:0/1567320972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc294157550 0x7fc2941579d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fc28c000f80 tx=0x7fc28c001450 comp rx=0 tx=0).stop 2023-10-06T02:24:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.372+0000 7fc29a47f700 1 -- 172.21.15.6:0/1567320972 shutdown_connections 2023-10-06T02:24:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.372+0000 7fc29a47f700 1 --2- 172.21.15.6:0/1567320972 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc274066f30 0x7fc2740693e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.372+0000 7fc29a47f700 1 --2- 172.21.15.6:0/1567320972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc294157550 0x7fc2941579d0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.372+0000 7fc29a47f700 1 --2- 172.21.15.6:0/1567320972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc294154270 0x7fc2940cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.372+0000 7fc29a47f700 1 --2- 172.21.15.6:0/1567320972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2940c72d0 0x7fc29416a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.372+0000 7fc29a47f700 1 -- 172.21.15.6:0/1567320972 >> 172.21.15.6:0/1567320972 conn(0x7fc29406cff0 msgr2=0x7fc2940ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.372+0000 7fc29a47f700 1 -- 172.21.15.6:0/1567320972 shutdown_connections 2023-10-06T02:24:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.372+0000 7fc29a47f700 1 -- 172.21.15.6:0/1567320972 wait complete. 2023-10-06T02:24:36.389 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:36.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.507+0000 7f496b93b700 1 Processor -- start 2023-10-06T02:24:36.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.507+0000 7f496b93b700 1 -- start start 2023-10-06T02:24:36.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.508+0000 7f496b93b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49640cd6e0 0x7f496413f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.508+0000 7f496b93b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49640ca3e0 con 0x7f49640c7ca0 2023-10-06T02:24:36.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.508+0000 7f496b93b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49640c97d0 con 0x7f49640c78d0 2023-10-06T02:24:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.508+0000 7f496b93b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49640c95c0 con 0x7f49640cd6e0 2023-10-06T02:24:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.508+0000 7f4968ed6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49640cd6e0 0x7f496413f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.508+0000 7f4968ed6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49640cd6e0 0x7f496413f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56326/0 (socket says 172.21.15.6:56326) 2023-10-06T02:24:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.508+0000 7f4969ed8700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f49640c7ca0 0x7f49640c2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50360/0 (socket says 172.21.15.6:50360) 2023-10-06T02:24:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.508+0000 7f4968ed6700 1 -- 172.21.15.6:0/1335709174 learned_addr learned my addr 172.21.15.6:0/1335709174 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.509+0000 7f4968ed6700 1 -- 172.21.15.6:0/1335709174 >> v1:172.21.15.175:6789/0 conn(0x7f49640c78d0 legacy=0x7f49640ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.509+0000 7f4968ed6700 1 -- 172.21.15.6:0/1335709174 >> v1:172.21.15.6:6789/0 conn(0x7f49640c7ca0 legacy=0x7f49640c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.509+0000 7f4968ed6700 1 -- 172.21.15.6:0/1335709174 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49640c9ab0 con 0x7f49640cd6e0 2023-10-06T02:24:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.509+0000 7f4968ed6700 1 --2- 172.21.15.6:0/1335709174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640cd6e0 0x7f496413f930 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f495800bc50 tx=0x7f495800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79dd2613646ac162 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.509+0000 7f4963fff700 1 -- 172.21.15.6:0/1335709174 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495800be60 con 0x7f49640cd6e0 2023-10-06T02:24:36.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.509+0000 7f4963fff700 1 -- 172.21.15.6:0/1335709174 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495800de00 con 0x7f49640cd6e0 2023-10-06T02:24:36.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.509+0000 7f4963fff700 1 -- 172.21.15.6:0/1335709174 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49580196b0 con 0x7f49640cd6e0 2023-10-06T02:24:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.510+0000 7f496b93b700 1 -- 172.21.15.6:0/1335709174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640cd6e0 msgr2=0x7f496413f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.510+0000 7f496b93b700 1 --2- 172.21.15.6:0/1335709174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640cd6e0 0x7f496413f930 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f495800bc50 tx=0x7f495800b4f0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.510+0000 7f496b93b700 1 -- 172.21.15.6:0/1335709174 shutdown_connections 2023-10-06T02:24:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.510+0000 7f496b93b700 1 --2- 172.21.15.6:0/1335709174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640cd6e0 0x7f496413f930 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.510+0000 7f496b93b700 1 -- 172.21.15.6:0/1335709174 >> 172.21.15.6:0/1335709174 conn(0x7f4964069790 msgr2=0x7f4964069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.510+0000 7f496b93b700 1 -- 172.21.15.6:0/1335709174 shutdown_connections 2023-10-06T02:24:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.510+0000 7f496b93b700 1 -- 172.21.15.6:0/1335709174 wait complete. 2023-10-06T02:24:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.511+0000 7f496b93b700 1 Processor -- start 2023-10-06T02:24:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.511+0000 7f496b93b700 1 -- start start 2023-10-06T02:24:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f496b93b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49640c78d0 0x7f49641544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f496b93b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49640c7ca0 0x7f49640c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f496b93b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640cd6e0 0x7f49640ab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f496b93b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49640a8bc0 con 0x7f49640cd6e0 2023-10-06T02:24:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f496b93b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49640a9110 con 0x7f49640c78d0 2023-10-06T02:24:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f496b93b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49640c6570 con 0x7f49640c7ca0 2023-10-06T02:24:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f4969ed8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640cd6e0 0x7f49640ab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f4969ed8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640cd6e0 0x7f49640ab3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56336/0 (socket says 172.21.15.6:56336) 2023-10-06T02:24:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f4969ed8700 1 -- 172.21.15.6:0/575356092 learned_addr learned my addr 172.21.15.6:0/575356092 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f49696d7700 1 --2- 172.21.15.6:0/575356092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49640c78d0 0x7f49641544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f4968ed6700 1 --2- 172.21.15.6:0/575356092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49640c7ca0 0x7f49640c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f4969ed8700 1 -- 172.21.15.6:0/575356092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49640c7ca0 msgr2=0x7f49640c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f4969ed8700 1 --2- 172.21.15.6:0/575356092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49640c7ca0 0x7f49640c5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f4969ed8700 1 -- 172.21.15.6:0/575356092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49640c78d0 msgr2=0x7f49641544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f4969ed8700 1 --2- 172.21.15.6:0/575356092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49640c78d0 0x7f49641544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f4969ed8700 1 -- 172.21.15.6:0/575356092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495800b790 con 0x7f49640cd6e0 2023-10-06T02:24:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f4969ed8700 1 --2- 172.21.15.6:0/575356092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640cd6e0 0x7f49640ab3b0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f495400c590 tx=0x7f4954007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.512+0000 7f49617fa700 1 -- 172.21.15.6:0/575356092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4954005a70 con 0x7f49640cd6e0 2023-10-06T02:24:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.513+0000 7f49617fa700 1 -- 172.21.15.6:0/575356092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4954005bf0 con 0x7f49640cd6e0 2023-10-06T02:24:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.513+0000 7f49617fa700 1 -- 172.21.15.6:0/575356092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49540070d0 con 0x7f49640cd6e0 2023-10-06T02:24:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.513+0000 7f496b93b700 1 -- 172.21.15.6:0/575356092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49640c6850 con 0x7f49640cd6e0 2023-10-06T02:24:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.513+0000 7f496b93b700 1 -- 172.21.15.6:0/575356092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496413dfd0 con 0x7f49640cd6e0 2023-10-06T02:24:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.513+0000 7f496b93b700 1 -- 172.21.15.6:0/575356092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49640a9280 con 0x7f49640cd6e0 2023-10-06T02:24:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.514+0000 7f49617fa700 1 -- 172.21.15.6:0/575356092 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4954007480 con 0x7f49640cd6e0 2023-10-06T02:24:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.514+0000 7f49617fa700 1 --2- 172.21.15.6:0/575356092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4950066f30 0x7f49500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.514+0000 7f49617fa700 1 -- 172.21.15.6:0/575356092 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f4954083810 con 0x7f49640cd6e0 2023-10-06T02:24:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.514+0000 7f49696d7700 1 --2- 172.21.15.6:0/575356092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4950066f30 0x7f49500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.515+0000 7f49696d7700 1 --2- 172.21.15.6:0/575356092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4950066f30 0x7f49500693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f495c007fd0 tx=0x7f495c000f40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.518+0000 7f49617fa700 1 -- 172.21.15.6:0/575356092 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4954050b30 con 0x7f49640cd6e0 2023-10-06T02:24:36.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.716+0000 7f496b93b700 1 -- 172.21.15.6:0/575356092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49640c6a40 con 0x7f49640cd6e0 2023-10-06T02:24:36.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.717+0000 7f49617fa700 1 -- 172.21.15.6:0/575356092 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+13808 (secure 0 0 0) 0x7f4954017070 con 0x7f49640cd6e0 2023-10-06T02:24:36.718 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:36.718 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":91,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:24:35.944759+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.719+0000 7f496b93b700 1 -- 172.21.15.6:0/575356092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4950066f30 msgr2=0x7f49500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.719+0000 7f496b93b700 1 --2- 172.21.15.6:0/575356092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4950066f30 0x7f49500693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f495c007fd0 tx=0x7f495c000f40 comp rx=0 tx=0).stop 2023-10-06T02:24:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.719+0000 7f496b93b700 1 -- 172.21.15.6:0/575356092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640cd6e0 msgr2=0x7f49640ab3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.719+0000 7f496b93b700 1 --2- 172.21.15.6:0/575356092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640cd6e0 0x7f49640ab3b0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f495400c590 tx=0x7f4954007ef0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.719+0000 7f496b93b700 1 -- 172.21.15.6:0/575356092 shutdown_connections 2023-10-06T02:24:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.719+0000 7f496b93b700 1 --2- 172.21.15.6:0/575356092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4950066f30 0x7f49500693e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.719+0000 7f496b93b700 1 --2- 172.21.15.6:0/575356092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640cd6e0 0x7f49640ab3b0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.719+0000 7f496b93b700 1 --2- 172.21.15.6:0/575356092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49640c78d0 0x7f49641544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.719+0000 7f496b93b700 1 --2- 172.21.15.6:0/575356092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49640c7ca0 0x7f49640c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.719+0000 7f496b93b700 1 -- 172.21.15.6:0/575356092 >> 172.21.15.6:0/575356092 conn(0x7f4964069790 msgr2=0x7f49640c2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.719+0000 7f496b93b700 1 -- 172.21.15.6:0/575356092 shutdown_connections 2023-10-06T02:24:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.719+0000 7f496b93b700 1 -- 172.21.15.6:0/575356092 wait complete. 2023-10-06T02:24:36.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T02:24:36.732 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:24:36.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.853+0000 7f0101c29700 1 Processor -- start 2023-10-06T02:24:36.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.853+0000 7f0101c29700 1 -- start start 2023-10-06T02:24:36.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.854+0000 7f0101c29700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00fc159190 0x7f00fc0ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.854+0000 7f0101c29700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f00fc0ceed0 0x7f00fc06a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.854+0000 7f0101c29700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00fc0b4e20 con 0x7f00fc0cc370 2023-10-06T02:24:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.854+0000 7f0101c29700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00fc0cd5a0 con 0x7f00fc0ceed0 2023-10-06T02:24:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.854+0000 7f0101c29700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc0b4570 con 0x7f00fc159190 2023-10-06T02:24:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.855+0000 7f00faffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f00fc0ceed0 0x7f00fc06a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.855+0000 7f00fb7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00fc159190 0x7f00fc0ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.855+0000 7f00fbfff700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f00fc0cc370 0x7f00fc0b52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:42146/0 (socket says 172.21.15.6:42146) 2023-10-06T02:24:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.855+0000 7f00fbfff700 1 -- 172.21.15.6:0/66079849 learned_addr learned my addr 172.21.15.6:0/66079849 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.855+0000 7f00faffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f00fc0ceed0 0x7f00fc06a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:49158/0 (socket says 172.21.15.6:49158) 2023-10-06T02:24:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.855+0000 7f00fb7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00fc159190 0x7f00fc0ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:35304/0 (socket says 172.21.15.6:35304) 2023-10-06T02:24:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.855+0000 7f00faffd700 1 -- 172.21.15.6:0/66079849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00fc159190 msgr2=0x7f00fc0ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.855+0000 7f00faffd700 1 --2- 172.21.15.6:0/66079849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00fc159190 0x7f00fc0ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.855+0000 7f00faffd700 1 -- 172.21.15.6:0/66079849 >> v1:172.21.15.175:6789/0 conn(0x7f00fc0cc370 legacy=0x7f00fc0b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.855+0000 7f00faffd700 1 -- 172.21.15.6:0/66079849 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00fc0cd2c0 con 0x7f00fc0ceed0 2023-10-06T02:24:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.855+0000 7f00fb7fe700 1 --2- 172.21.15.6:0/66079849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00fc159190 0x7f00fc0ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.855+0000 7f00faffd700 1 --2- 172.21.15.6:0/66079849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00fc0ceed0 0x7f00fc06a1f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f00f00098e0 tx=0x7f00f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=620bab44d0053c1d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.856+0000 7f00fa7fc700 1 -- 172.21.15.6:0/66079849 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f000b640 con 0x7f00fc0ceed0 2023-10-06T02:24:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.856+0000 7f00fa7fc700 1 -- 172.21.15.6:0/66079849 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f000b7a0 con 0x7f00fc0ceed0 2023-10-06T02:24:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.856+0000 7f00fa7fc700 1 -- 172.21.15.6:0/66079849 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f000bb40 con 0x7f00fc0ceed0 2023-10-06T02:24:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.856+0000 7f0101c29700 1 -- 172.21.15.6:0/66079849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00fc0ceed0 msgr2=0x7f00fc06a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.856+0000 7f0101c29700 1 --2- 172.21.15.6:0/66079849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00fc0ceed0 0x7f00fc06a1f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f00f00098e0 tx=0x7f00f00091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.856+0000 7f0101c29700 1 -- 172.21.15.6:0/66079849 shutdown_connections 2023-10-06T02:24:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.856+0000 7f0101c29700 1 --2- 172.21.15.6:0/66079849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00fc159190 0x7f00fc0ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.856+0000 7f0101c29700 1 --2- 172.21.15.6:0/66079849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00fc0ceed0 0x7f00fc06a1f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.856+0000 7f0101c29700 1 -- 172.21.15.6:0/66079849 >> 172.21.15.6:0/66079849 conn(0x7f00fc087340 msgr2=0x7f00fc087710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.856+0000 7f0101c29700 1 -- 172.21.15.6:0/66079849 shutdown_connections 2023-10-06T02:24:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.856+0000 7f0101c29700 1 -- 172.21.15.6:0/66079849 wait complete. 2023-10-06T02:24:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.857+0000 7f0101c29700 1 Processor -- start 2023-10-06T02:24:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.857+0000 7f0101c29700 1 -- start start 2023-10-06T02:24:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.858+0000 7f0101c29700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00fc0cc370 0x7f00fc1527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.858+0000 7f0101c29700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00fc0ceed0 0x7f00fc15a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.858+0000 7f0101c29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00fc159190 0x7f00fc0c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.858+0000 7f0101c29700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc15bed0 con 0x7f00fc159190 2023-10-06T02:24:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.858+0000 7f0101c29700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc152d20 con 0x7f00fc0cc370 2023-10-06T02:24:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.858+0000 7f0101c29700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc15ae30 con 0x7f00fc0ceed0 2023-10-06T02:24:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.858+0000 7f00fbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00fc159190 0x7f00fc0c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.858+0000 7f00fbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00fc159190 0x7f00fc0c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56338/0 (socket says 172.21.15.6:56338) 2023-10-06T02:24:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.858+0000 7f00fbfff700 1 -- 172.21.15.6:0/82014382 learned_addr learned my addr 172.21.15.6:0/82014382 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.858+0000 7f00fb7fe700 1 --2- 172.21.15.6:0/82014382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00fc0cc370 0x7f00fc1527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.859+0000 7f00faffd700 1 --2- 172.21.15.6:0/82014382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00fc0ceed0 0x7f00fc15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.859+0000 7f00fbfff700 1 -- 172.21.15.6:0/82014382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00fc0ceed0 msgr2=0x7f00fc15a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.859+0000 7f00fbfff700 1 --2- 172.21.15.6:0/82014382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00fc0ceed0 0x7f00fc15a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.859+0000 7f00fbfff700 1 -- 172.21.15.6:0/82014382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00fc0cc370 msgr2=0x7f00fc1527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.859+0000 7f00fbfff700 1 --2- 172.21.15.6:0/82014382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00fc0cc370 0x7f00fc1527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.859+0000 7f00fbfff700 1 -- 172.21.15.6:0/82014382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec009420 con 0x7f00fc159190 2023-10-06T02:24:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.859+0000 7f00fb7fe700 1 --2- 172.21.15.6:0/82014382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00fc0cc370 0x7f00fc1527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.859+0000 7f00fbfff700 1 --2- 172.21.15.6:0/82014382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00fc159190 0x7f00fc0c50c0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f00f400cc40 tx=0x7f00f4001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.859+0000 7f00e37fe700 1 -- 172.21.15.6:0/82014382 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f400a9c0 con 0x7f00fc159190 2023-10-06T02:24:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.859+0000 7f00e37fe700 1 -- 172.21.15.6:0/82014382 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f400ab20 con 0x7f00fc159190 2023-10-06T02:24:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.859+0000 7f0101c29700 1 -- 172.21.15.6:0/82014382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f0009420 con 0x7f00fc159190 2023-10-06T02:24:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.859+0000 7f00e37fe700 1 -- 172.21.15.6:0/82014382 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f40070f0 con 0x7f00fc159190 2023-10-06T02:24:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.859+0000 7f0101c29700 1 -- 172.21.15.6:0/82014382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00fc15b3f0 con 0x7f00fc159190 2023-10-06T02:24:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.860+0000 7f0101c29700 1 -- 172.21.15.6:0/82014382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00fc088a20 con 0x7f00fc159190 2023-10-06T02:24:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.861+0000 7f00e37fe700 1 -- 172.21.15.6:0/82014382 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00f40074a0 con 0x7f00fc159190 2023-10-06T02:24:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.861+0000 7f00e37fe700 1 --2- 172.21.15.6:0/82014382 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f00e8066f30 0x7f00e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.861+0000 7f00e37fe700 1 -- 172.21.15.6:0/82014382 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f00f4084850 con 0x7f00fc159190 2023-10-06T02:24:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.861+0000 7f00fb7fe700 1 --2- 172.21.15.6:0/82014382 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f00e8066f30 0x7f00e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.862+0000 7f00fb7fe700 1 --2- 172.21.15.6:0/82014382 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f00e8066f30 0x7f00e80693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0093f0 tx=0x7f00ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:36.865+0000 7f00e37fe700 1 -- 172.21.15.6:0/82014382 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00f4051bf0 con 0x7f00fc159190 2023-10-06T02:24:37.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.059+0000 7f0101c29700 1 -- 172.21.15.6:0/82014382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f00fc0b47d0 con 0x7f00fc159190 2023-10-06T02:24:37.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.059+0000 7f00e37fe700 1 -- 172.21.15.6:0/82014382 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v91) v1 ==== 92+0+10 (secure 0 0 0) 0x7f00f4055210 con 0x7f00fc159190 2023-10-06T02:24:37.060 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:24:37.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.061+0000 7f0101c29700 1 -- 172.21.15.6:0/82014382 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f00e8066f30 msgr2=0x7f00e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.061+0000 7f0101c29700 1 --2- 172.21.15.6:0/82014382 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f00e8066f30 0x7f00e80693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0093f0 tx=0x7f00ec008040 comp rx=0 tx=0).stop 2023-10-06T02:24:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.061+0000 7f0101c29700 1 -- 172.21.15.6:0/82014382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00fc159190 msgr2=0x7f00fc0c50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.061+0000 7f0101c29700 1 --2- 172.21.15.6:0/82014382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00fc159190 0x7f00fc0c50c0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f00f400cc40 tx=0x7f00f4001a50 comp rx=0 tx=0).stop 2023-10-06T02:24:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.061+0000 7f0101c29700 1 -- 172.21.15.6:0/82014382 shutdown_connections 2023-10-06T02:24:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.061+0000 7f0101c29700 1 --2- 172.21.15.6:0/82014382 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f00e8066f30 0x7f00e80693e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.061+0000 7f0101c29700 1 --2- 172.21.15.6:0/82014382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00fc159190 0x7f00fc0c50c0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.061+0000 7f0101c29700 1 --2- 172.21.15.6:0/82014382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00fc0cc370 0x7f00fc1527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.061+0000 7f0101c29700 1 --2- 172.21.15.6:0/82014382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00fc0ceed0 0x7f00fc15a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.061+0000 7f0101c29700 1 -- 172.21.15.6:0/82014382 >> 172.21.15.6:0/82014382 conn(0x7f00fc087340 msgr2=0x7f00fc0b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:37.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.061+0000 7f0101c29700 1 -- 172.21.15.6:0/82014382 shutdown_connections 2023-10-06T02:24:37.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.061+0000 7f0101c29700 1 -- 172.21.15.6:0/82014382 wait complete. 2023-10-06T02:24:37.074 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:24:37.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.195+0000 7fb06e3ab700 1 Processor -- start 2023-10-06T02:24:37.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.195+0000 7fb06e3ab700 1 -- start start 2023-10-06T02:24:37.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.196+0000 7fb06e3ab700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb06806a910 0x7fb06806ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.196+0000 7fb06e3ab700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb0680cc740 0x7fb0680ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.196+0000 7fb06e3ab700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06806a1a0 con 0x7fb06815cae0 2023-10-06T02:24:37.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.196+0000 7fb06e3ab700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06806a480 con 0x7fb0680cc740 2023-10-06T02:24:37.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.196+0000 7fb06e3ab700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680c8e40 con 0x7fb06806a910 2023-10-06T02:24:37.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.196+0000 7fb067fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb06815cae0 0x7fb0680c8730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50364/0 (socket says 172.21.15.6:50364) 2023-10-06T02:24:37.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.196+0000 7fb067fff700 1 -- 172.21.15.6:0/295820885 learned_addr learned my addr 172.21.15.6:0/295820885 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:37.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb0677fe700 1 --2- 172.21.15.6:0/295820885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb06806a910 0x7fb06806ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb066ffd700 1 -- 172.21.15.6:0/295820885 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1092196701 0 0) 0x7fb06806a1a0 con 0x7fb06815cae0 2023-10-06T02:24:37.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb06c948700 1 --2- 172.21.15.6:0/295820885 >> v2:172.21.15.175:3300/0 conn(0x7fb0680cc740 0x7fb0680ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb066ffd700 1 -- 172.21.15.6:0/295820885 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb050003570 con 0x7fb06815cae0 2023-10-06T02:24:37.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb066ffd700 1 -- 172.21.15.6:0/295820885 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 922230394 0 0) 0x7fb050003570 con 0x7fb06815cae0 2023-10-06T02:24:37.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb066ffd700 1 -- 172.21.15.6:0/295820885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb06806a910 msgr2=0x7fb06806ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:37.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb066ffd700 1 --2- 172.21.15.6:0/295820885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb06806a910 0x7fb06806ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb066ffd700 1 -- 172.21.15.6:0/295820885 >> v2:172.21.15.175:3300/0 conn(0x7fb0680cc740 msgr2=0x7fb0680ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:37.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb066ffd700 1 --2- 172.21.15.6:0/295820885 >> v2:172.21.15.175:3300/0 conn(0x7fb0680cc740 0x7fb0680ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb066ffd700 1 -- 172.21.15.6:0/295820885 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0680c3f40 con 0x7fb06815cae0 2023-10-06T02:24:37.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb066ffd700 1 -- 172.21.15.6:0/295820885 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fb0580015f0 con 0x7fb06815cae0 2023-10-06T02:24:37.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb066ffd700 1 -- 172.21.15.6:0/295820885 >> v1:172.21.15.6:6789/0 conn(0x7fb06815cae0 legacy=0x7fb0680c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb066ffd700 1 --2- 172.21.15.6:0/295820885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb050003a60 0x7fb050003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb066ffd700 1 --2- 172.21.15.6:0/295820885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb06806a910 0x7fb050004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb066ffd700 1 --2- 172.21.15.6:0/295820885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb050004d50 0x7fb0500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb066ffd700 1 -- 172.21.15.6:0/295820885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06806a480 con 0x7fb050004d50 2023-10-06T02:24:37.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb066ffd700 1 -- 172.21.15.6:0/295820885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680c8e40 con 0x7fb050003a60 2023-10-06T02:24:37.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb066ffd700 1 -- 172.21.15.6:0/295820885 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05000ba60 con 0x7fb06806a910 2023-10-06T02:24:37.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb06c948700 1 --2- 172.21.15.6:0/295820885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb050004d50 0x7fb0500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb067fff700 1 --2- 172.21.15.6:0/295820885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb050003a60 0x7fb050003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb0677fe700 1 --2- 172.21.15.6:0/295820885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb06806a910 0x7fb050004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb06c948700 1 -- 172.21.15.6:0/295820885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb06806a910 msgr2=0x7fb050004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:37.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb06c948700 1 --2- 172.21.15.6:0/295820885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb06806a910 0x7fb050004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb06c948700 1 -- 172.21.15.6:0/295820885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb050003a60 msgr2=0x7fb050003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:37.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.197+0000 7fb06c948700 1 --2- 172.21.15.6:0/295820885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb050003a60 0x7fb050003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.198+0000 7fb06c948700 1 -- 172.21.15.6:0/295820885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb050003570 con 0x7fb050004d50 2023-10-06T02:24:37.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.198+0000 7fb06c948700 1 --2- 172.21.15.6:0/295820885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb050004d50 0x7fb0500051c0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fb06000e210 tx=0x7fb06000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11af645fdd4cbaf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.198+0000 7fb066ffd700 1 -- 172.21.15.6:0/295820885 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06000ea60 con 0x7fb050004d50 2023-10-06T02:24:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.198+0000 7fb066ffd700 1 -- 172.21.15.6:0/295820885 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06000f040 con 0x7fb050004d50 2023-10-06T02:24:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.198+0000 7fb066ffd700 1 -- 172.21.15.6:0/295820885 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06000ee10 con 0x7fb050004d50 2023-10-06T02:24:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.198+0000 7fb06e3ab700 1 -- 172.21.15.6:0/295820885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb050004d50 msgr2=0x7fb0500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.198+0000 7fb06e3ab700 1 --2- 172.21.15.6:0/295820885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb050004d50 0x7fb0500051c0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fb06000e210 tx=0x7fb06000b040 comp rx=0 tx=0).stop 2023-10-06T02:24:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.198+0000 7fb06c948700 1 -- 172.21.15.6:0/295820885 reap_dead start 2023-10-06T02:24:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.198+0000 7fb06e3ab700 1 -- 172.21.15.6:0/295820885 shutdown_connections 2023-10-06T02:24:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.198+0000 7fb06e3ab700 1 -- 172.21.15.6:0/295820885 >> 172.21.15.6:0/295820885 conn(0x7fb068067910 msgr2=0x7fb0680ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.198+0000 7fb06e3ab700 1 -- 172.21.15.6:0/295820885 shutdown_connections 2023-10-06T02:24:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.198+0000 7fb06e3ab700 1 -- 172.21.15.6:0/295820885 wait complete. 2023-10-06T02:24:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.199+0000 7fb06e3ab700 1 Processor -- start 2023-10-06T02:24:37.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.200+0000 7fb06e3ab700 1 -- start start 2023-10-06T02:24:37.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.200+0000 7fb06e3ab700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb06806d760 0x7fb0680b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.200+0000 7fb06e3ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0680b0eb0 0x7fb068149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.200+0000 7fb06e3ab700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb06806db30 0x7fb06814a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.200+0000 7fb06e3ab700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680b1340 con 0x7fb0680b0eb0 2023-10-06T02:24:37.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.200+0000 7fb06e3ab700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680b1620 con 0x7fb06806d760 2023-10-06T02:24:37.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.200+0000 7fb06e3ab700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680b1900 con 0x7fb06806db30 2023-10-06T02:24:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.200+0000 7fb0677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0680b0eb0 0x7fb068149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.200+0000 7fb0677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0680b0eb0 0x7fb068149c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56360/0 (socket says 172.21.15.6:56360) 2023-10-06T02:24:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.200+0000 7fb0677fe700 1 -- 172.21.15.6:0/3315651110 learned_addr learned my addr 172.21.15.6:0/3315651110 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.201+0000 7fb067fff700 1 --2- 172.21.15.6:0/3315651110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb06806d760 0x7fb0680b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.201+0000 7fb06c948700 1 --2- 172.21.15.6:0/3315651110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb06806db30 0x7fb06814a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.201+0000 7fb0677fe700 1 -- 172.21.15.6:0/3315651110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb06806db30 msgr2=0x7fb06814a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.201+0000 7fb0677fe700 1 --2- 172.21.15.6:0/3315651110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb06806db30 0x7fb06814a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.201+0000 7fb0677fe700 1 -- 172.21.15.6:0/3315651110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb06806d760 msgr2=0x7fb0680b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.201+0000 7fb0677fe700 1 --2- 172.21.15.6:0/3315651110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb06806d760 0x7fb0680b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.201+0000 7fb0677fe700 1 -- 172.21.15.6:0/3315651110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0680b1be0 con 0x7fb0680b0eb0 2023-10-06T02:24:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.201+0000 7fb06c948700 1 --2- 172.21.15.6:0/3315651110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb06806db30 0x7fb06814a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.201+0000 7fb0677fe700 1 --2- 172.21.15.6:0/3315651110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0680b0eb0 0x7fb068149c10 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fb05c006ac0 tx=0x7fb05c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.201+0000 7fb04ffff700 1 -- 172.21.15.6:0/3315651110 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c00fa10 con 0x7fb0680b0eb0 2023-10-06T02:24:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.201+0000 7fb04ffff700 1 -- 172.21.15.6:0/3315651110 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05c00fb70 con 0x7fb0680b0eb0 2023-10-06T02:24:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.201+0000 7fb06e3ab700 1 -- 172.21.15.6:0/3315651110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0680b1ec0 con 0x7fb0680b0eb0 2023-10-06T02:24:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.201+0000 7fb04ffff700 1 -- 172.21.15.6:0/3315651110 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c014440 con 0x7fb0680b0eb0 2023-10-06T02:24:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.201+0000 7fb06e3ab700 1 -- 172.21.15.6:0/3315651110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0680b35c0 con 0x7fb0680b0eb0 2023-10-06T02:24:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.202+0000 7fb06e3ab700 1 -- 172.21.15.6:0/3315651110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06806e590 con 0x7fb0680b0eb0 2023-10-06T02:24:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.203+0000 7fb04ffff700 1 -- 172.21.15.6:0/3315651110 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb05c014870 con 0x7fb0680b0eb0 2023-10-06T02:24:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.203+0000 7fb04ffff700 1 --2- 172.21.15.6:0/3315651110 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb054066f30 0x7fb0540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.203+0000 7fb04ffff700 1 -- 172.21.15.6:0/3315651110 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fb05c018030 con 0x7fb0680b0eb0 2023-10-06T02:24:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.203+0000 7fb067fff700 1 --2- 172.21.15.6:0/3315651110 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb054066f30 0x7fb0540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.204+0000 7fb067fff700 1 --2- 172.21.15.6:0/3315651110 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb054066f30 0x7fb0540693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb058001150 tx=0x7fb058009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.207+0000 7fb04ffff700 1 -- 172.21.15.6:0/3315651110 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb05c052270 con 0x7fb0680b0eb0 2023-10-06T02:24:37.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.398+0000 7fb06e3ab700 1 -- 172.21.15.6:0/3315651110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb068068420 con 0x7fb0680b0eb0 2023-10-06T02:24:37.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.399+0000 7fb04ffff700 1 -- 172.21.15.6:0/3315651110 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb05c0220a0 con 0x7fb0680b0eb0 2023-10-06T02:24:37.400 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:24:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.401+0000 7fb06e3ab700 1 -- 172.21.15.6:0/3315651110 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb054066f30 msgr2=0x7fb0540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.401+0000 7fb06e3ab700 1 --2- 172.21.15.6:0/3315651110 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb054066f30 0x7fb0540693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb058001150 tx=0x7fb058009040 comp rx=0 tx=0).stop 2023-10-06T02:24:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.401+0000 7fb06e3ab700 1 -- 172.21.15.6:0/3315651110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0680b0eb0 msgr2=0x7fb068149c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.401+0000 7fb06e3ab700 1 --2- 172.21.15.6:0/3315651110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0680b0eb0 0x7fb068149c10 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fb05c006ac0 tx=0x7fb05c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.401+0000 7fb06e3ab700 1 -- 172.21.15.6:0/3315651110 shutdown_connections 2023-10-06T02:24:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.401+0000 7fb06e3ab700 1 --2- 172.21.15.6:0/3315651110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb06806db30 0x7fb06814a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.401+0000 7fb06e3ab700 1 --2- 172.21.15.6:0/3315651110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb06806d760 0x7fb0680b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.401+0000 7fb06e3ab700 1 --2- 172.21.15.6:0/3315651110 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb054066f30 0x7fb0540693e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.401+0000 7fb06e3ab700 1 --2- 172.21.15.6:0/3315651110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0680b0eb0 0x7fb068149c10 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.401+0000 7fb06e3ab700 1 -- 172.21.15.6:0/3315651110 >> 172.21.15.6:0/3315651110 conn(0x7fb068067910 msgr2=0x7fb06815a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.401+0000 7fb06e3ab700 1 -- 172.21.15.6:0/3315651110 shutdown_connections 2023-10-06T02:24:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.401+0000 7fb06e3ab700 1 -- 172.21.15.6:0/3315651110 wait complete. 2023-10-06T02:24:37.413 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:24:37.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.531+0000 7efcab4cb700 1 Processor -- start 2023-10-06T02:24:37.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.532+0000 7efcab4cb700 1 -- start start 2023-10-06T02:24:37.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.532+0000 7efcab4cb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efca41593f0 0x7efca406de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.532+0000 7efcab4cb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca4069950 con 0x7efca41597c0 2023-10-06T02:24:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.532+0000 7efcab4cb700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca415dfd0 con 0x7efca406adf0 2023-10-06T02:24:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.532+0000 7efcab4cb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca40b2850 con 0x7efca41593f0 2023-10-06T02:24:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca8a66700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efca41597c0 0x7efca415d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50376/0 (socket says 172.21.15.6:50376) 2023-10-06T02:24:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca8a66700 1 -- 172.21.15.6:0/874182797 learned_addr learned my addr 172.21.15.6:0/874182797 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca3fff700 1 -- 172.21.15.6:0/874182797 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484043439 0 0) 0x7efca4069950 con 0x7efca41597c0 2023-10-06T02:24:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca3fff700 1 -- 172.21.15.6:0/874182797 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc8c003570 con 0x7efca41597c0 2023-10-06T02:24:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca9267700 1 --2- 172.21.15.6:0/874182797 >> v2:172.21.15.175:3300/0 conn(0x7efca41593f0 0x7efca406de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca3fff700 1 -- 172.21.15.6:0/874182797 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3097515130 0 0) 0x7efc8c003570 con 0x7efca41597c0 2023-10-06T02:24:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca3fff700 1 -- 172.21.15.6:0/874182797 >> v2:172.21.15.175:3300/0 conn(0x7efca41593f0 msgr2=0x7efca406de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca3fff700 1 --2- 172.21.15.6:0/874182797 >> v2:172.21.15.175:3300/0 conn(0x7efca41593f0 0x7efca406de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca3fff700 1 -- 172.21.15.6:0/874182797 >> v1:172.21.15.175:6789/0 conn(0x7efca406adf0 legacy=0x7efca415d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca3fff700 1 -- 172.21.15.6:0/874182797 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca40b1fb0 con 0x7efca41597c0 2023-10-06T02:24:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca3fff700 1 -- 172.21.15.6:0/874182797 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7efc980015f0 con 0x7efca41597c0 2023-10-06T02:24:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca3fff700 1 -- 172.21.15.6:0/874182797 >> v1:172.21.15.6:6789/0 conn(0x7efca41597c0 legacy=0x7efca415d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca3fff700 1 --2- 172.21.15.6:0/874182797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc8c003a60 0x7efc8c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca3fff700 1 --2- 172.21.15.6:0/874182797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc8c004810 0x7efc8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca3fff700 1 --2- 172.21.15.6:0/874182797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc8c0051c0 0x7efc8c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca3fff700 1 -- 172.21.15.6:0/874182797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca40b2850 con 0x7efc8c0051c0 2023-10-06T02:24:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca3fff700 1 -- 172.21.15.6:0/874182797 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c00c160 con 0x7efc8c004810 2023-10-06T02:24:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca3fff700 1 -- 172.21.15.6:0/874182797 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c00c320 con 0x7efc8c003a60 2023-10-06T02:24:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.533+0000 7efca9a68700 1 --2- 172.21.15.6:0/874182797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc8c0051c0 0x7efc8c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.534+0000 7efca9267700 1 --2- 172.21.15.6:0/874182797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc8c003a60 0x7efc8c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.534+0000 7efca8a66700 1 --2- 172.21.15.6:0/874182797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc8c004810 0x7efc8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.534+0000 7efca9a68700 1 -- 172.21.15.6:0/874182797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc8c003a60 msgr2=0x7efc8c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.534+0000 7efca9a68700 1 --2- 172.21.15.6:0/874182797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc8c003a60 0x7efc8c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.534+0000 7efca9a68700 1 -- 172.21.15.6:0/874182797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc8c004810 msgr2=0x7efc8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.534+0000 7efca9a68700 1 --2- 172.21.15.6:0/874182797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc8c004810 0x7efc8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.534+0000 7efca9a68700 1 -- 172.21.15.6:0/874182797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c003570 con 0x7efc8c0051c0 2023-10-06T02:24:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.534+0000 7efca9267700 1 --2- 172.21.15.6:0/874182797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc8c003a60 0x7efc8c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.534+0000 7efca9a68700 1 -- 172.21.15.6:0/874182797 reap_dead start 2023-10-06T02:24:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.534+0000 7efca9a68700 1 --2- 172.21.15.6:0/874182797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc8c0051c0 0x7efc8c00ba60 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7efc94001fc0 tx=0x7efc94001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc04e3a4d9e9878 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.534+0000 7efca3fff700 1 -- 172.21.15.6:0/874182797 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc94001950 con 0x7efc8c0051c0 2023-10-06T02:24:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.534+0000 7efca3fff700 1 -- 172.21.15.6:0/874182797 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9400c8b0 con 0x7efc8c0051c0 2023-10-06T02:24:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.534+0000 7efca3fff700 1 -- 172.21.15.6:0/874182797 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9400cc90 con 0x7efc8c0051c0 2023-10-06T02:24:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.534+0000 7efcab4cb700 1 -- 172.21.15.6:0/874182797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc8c0051c0 msgr2=0x7efc8c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.534+0000 7efcab4cb700 1 --2- 172.21.15.6:0/874182797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc8c0051c0 0x7efc8c00ba60 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7efc94001fc0 tx=0x7efc94001640 comp rx=0 tx=0).stop 2023-10-06T02:24:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.535+0000 7efcab4cb700 1 -- 172.21.15.6:0/874182797 shutdown_connections 2023-10-06T02:24:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.535+0000 7efcab4cb700 1 --2- 172.21.15.6:0/874182797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc8c0051c0 0x7efc8c00ba60 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.535+0000 7efcab4cb700 1 -- 172.21.15.6:0/874182797 >> 172.21.15.6:0/874182797 conn(0x7efca406cff0 msgr2=0x7efca40afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.535+0000 7efcab4cb700 1 -- 172.21.15.6:0/874182797 shutdown_connections 2023-10-06T02:24:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.535+0000 7efcab4cb700 1 -- 172.21.15.6:0/874182797 wait complete. 2023-10-06T02:24:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.536+0000 7efcab4cb700 1 Processor -- start 2023-10-06T02:24:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.536+0000 7efcab4cb700 1 -- start start 2023-10-06T02:24:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efcab4cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc8c0051c0 0x7efca40cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efcab4cb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efca4152590 0x7efca40c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efcab4cb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efca4152a00 0x7efca4153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efcab4cb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca40ca350 con 0x7efc8c0051c0 2023-10-06T02:24:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efcab4cb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca40ca910 con 0x7efca4152a00 2023-10-06T02:24:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efcab4cb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca40c8d60 con 0x7efca4152590 2023-10-06T02:24:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efca9267700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc8c0051c0 0x7efca40cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efca9267700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc8c0051c0 0x7efca40cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56370/0 (socket says 172.21.15.6:56370) 2023-10-06T02:24:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efca9267700 1 -- 172.21.15.6:0/2345227812 learned_addr learned my addr 172.21.15.6:0/2345227812 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efca8a66700 1 --2- 172.21.15.6:0/2345227812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efca4152590 0x7efca40c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efca9a68700 1 --2- 172.21.15.6:0/2345227812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efca4152a00 0x7efca4153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efca9267700 1 -- 172.21.15.6:0/2345227812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efca4152590 msgr2=0x7efca40c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efca9267700 1 --2- 172.21.15.6:0/2345227812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efca4152590 0x7efca40c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efca9267700 1 -- 172.21.15.6:0/2345227812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efca4152a00 msgr2=0x7efca4153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efca9267700 1 --2- 172.21.15.6:0/2345227812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efca4152a00 0x7efca4153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efca9267700 1 -- 172.21.15.6:0/2345227812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca40c9040 con 0x7efc8c0051c0 2023-10-06T02:24:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efca9a68700 1 --2- 172.21.15.6:0/2345227812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efca4152a00 0x7efca4153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efca9267700 1 --2- 172.21.15.6:0/2345227812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc8c0051c0 0x7efca40cada0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009fd0 tx=0x7efc9c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efca17fa700 1 -- 172.21.15.6:0/2345227812 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c015740 con 0x7efc8c0051c0 2023-10-06T02:24:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efca17fa700 1 -- 172.21.15.6:0/2345227812 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c0158a0 con 0x7efc8c0051c0 2023-10-06T02:24:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efca17fa700 1 -- 172.21.15.6:0/2345227812 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c015c40 con 0x7efc8c0051c0 2023-10-06T02:24:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.537+0000 7efcab4cb700 1 -- 172.21.15.6:0/2345227812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca40ca5a0 con 0x7efc8c0051c0 2023-10-06T02:24:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.538+0000 7efcab4cb700 1 -- 172.21.15.6:0/2345227812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca40cb2e0 con 0x7efc8c0051c0 2023-10-06T02:24:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.538+0000 7efcab4cb700 1 -- 172.21.15.6:0/2345227812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca40cabf0 con 0x7efc8c0051c0 2023-10-06T02:24:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.539+0000 7efca17fa700 1 -- 172.21.15.6:0/2345227812 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc9c013410 con 0x7efc8c0051c0 2023-10-06T02:24:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.539+0000 7efca17fa700 1 --2- 172.21.15.6:0/2345227812 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc90066f30 0x7efc900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.539+0000 7efca17fa700 1 -- 172.21.15.6:0/2345227812 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5526+0+0 (secure 0 0 0) 0x7efc9c084840 con 0x7efc8c0051c0 2023-10-06T02:24:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.539+0000 7efca8a66700 1 --2- 172.21.15.6:0/2345227812 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc90066f30 0x7efc900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.540+0000 7efca8a66700 1 --2- 172.21.15.6:0/2345227812 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc90066f30 0x7efc900693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efc98007a30 tx=0x7efc98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.543+0000 7efca17fa700 1 -- 172.21.15.6:0/2345227812 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc9c051b60 con 0x7efc8c0051c0 2023-10-06T02:24:37.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.742+0000 7efcab4cb700 1 -- 172.21.15.6:0/2345227812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efca406d3f0 con 0x7efc8c0051c0 2023-10-06T02:24:37.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.743+0000 7efca17fa700 1 -- 172.21.15.6:0/2345227812 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v91) v1 ==== 84+0+126 (secure 0 0 0) 0x7efc9c019090 con 0x7efc8c0051c0 2023-10-06T02:24:37.743 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:37.743 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-06T02:24:37.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:37.744 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-06T02:24:37.744 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-10-06T02:24:37.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:37.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:24:37.744 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-10-06T02:24:37.744 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-06T02:24:37.744 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:37.744 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-06T02:24:37.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.745+0000 7efcab4cb700 1 -- 172.21.15.6:0/2345227812 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc90066f30 msgr2=0x7efc900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.745+0000 7efcab4cb700 1 --2- 172.21.15.6:0/2345227812 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc90066f30 0x7efc900693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efc98007a30 tx=0x7efc98009040 comp rx=0 tx=0).stop 2023-10-06T02:24:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.745+0000 7efcab4cb700 1 -- 172.21.15.6:0/2345227812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc8c0051c0 msgr2=0x7efca40cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.745+0000 7efcab4cb700 1 --2- 172.21.15.6:0/2345227812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc8c0051c0 0x7efca40cada0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009fd0 tx=0x7efc9c008040 comp rx=0 tx=0).stop 2023-10-06T02:24:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.745+0000 7efcab4cb700 1 -- 172.21.15.6:0/2345227812 shutdown_connections 2023-10-06T02:24:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.745+0000 7efcab4cb700 1 --2- 172.21.15.6:0/2345227812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efca4152a00 0x7efca4153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.745+0000 7efcab4cb700 1 --2- 172.21.15.6:0/2345227812 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc90066f30 0x7efc900693e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.745+0000 7efcab4cb700 1 --2- 172.21.15.6:0/2345227812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc8c0051c0 0x7efca40cada0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.745+0000 7efcab4cb700 1 --2- 172.21.15.6:0/2345227812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efca4152590 0x7efca40c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.745+0000 7efcab4cb700 1 -- 172.21.15.6:0/2345227812 >> 172.21.15.6:0/2345227812 conn(0x7efca406cff0 msgr2=0x7efca4159c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.745+0000 7efcab4cb700 1 -- 172.21.15.6:0/2345227812 shutdown_connections 2023-10-06T02:24:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.745+0000 7efcab4cb700 1 -- 172.21.15.6:0/2345227812 wait complete. 2023-10-06T02:24:37.757 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:24:37.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:24:37.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.880+0000 7f2c96608700 1 Processor -- start 2023-10-06T02:24:37.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.880+0000 7f2c96608700 1 -- start start 2023-10-06T02:24:37.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.881+0000 7f2c96608700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c90142df0 0x7f2c900cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.881+0000 7f2c96608700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2c900cc890 0x7f2c900d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.881+0000 7f2c96608700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2c900d07a0 0x7f2c900cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.881+0000 7f2c96608700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c900d0c40 con 0x7f2c900d07a0 2023-10-06T02:24:37.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.881+0000 7f2c96608700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c9015a710 con 0x7f2c900cc890 2023-10-06T02:24:37.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.881+0000 7f2c96608700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c90159b40 con 0x7f2c90142df0 2023-10-06T02:24:37.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.881+0000 7f2c94ba5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2c900d07a0 0x7f2c900cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.881+0000 7f2c94ba5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2c900d07a0 0x7f2c900cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56376/0 (socket says 172.21.15.6:56376) 2023-10-06T02:24:37.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.881+0000 7f2c94ba5700 1 -- 172.21.15.6:0/2634880471 learned_addr learned my addr 172.21.15.6:0/2634880471 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:37.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.881+0000 7f2c8f7fe700 1 --2- 172.21.15.6:0/2634880471 >> v2:172.21.15.175:3300/0 conn(0x7f2c900cc890 0x7f2c900d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.881+0000 7f2c8ffff700 1 --2- 172.21.15.6:0/2634880471 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c90142df0 0x7f2c900cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.882+0000 7f2c94ba5700 1 -- 172.21.15.6:0/2634880471 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c90142df0 msgr2=0x7f2c900cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:37.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.882+0000 7f2c94ba5700 1 --2- 172.21.15.6:0/2634880471 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c90142df0 0x7f2c900cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.882+0000 7f2c94ba5700 1 -- 172.21.15.6:0/2634880471 >> v2:172.21.15.175:3300/0 conn(0x7f2c900cc890 msgr2=0x7f2c900d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:37.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.882+0000 7f2c94ba5700 1 --2- 172.21.15.6:0/2634880471 >> v2:172.21.15.175:3300/0 conn(0x7f2c900cc890 0x7f2c900d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.882+0000 7f2c94ba5700 1 -- 172.21.15.6:0/2634880471 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c90159de0 con 0x7f2c900d07a0 2023-10-06T02:24:37.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.882+0000 7f2c8ffff700 1 --2- 172.21.15.6:0/2634880471 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c90142df0 0x7f2c900cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:37.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.882+0000 7f2c94ba5700 1 --2- 172.21.15.6:0/2634880471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c900d07a0 0x7f2c900cea80 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f2c90067c40 tx=0x7f2c88009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3036f9c612e76b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.882+0000 7f2c8effd700 1 -- 172.21.15.6:0/2634880471 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8800e070 con 0x7f2c900d07a0 2023-10-06T02:24:37.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.882+0000 7f2c8effd700 1 -- 172.21.15.6:0/2634880471 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8800ba20 con 0x7f2c900d07a0 2023-10-06T02:24:37.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.882+0000 7f2c8effd700 1 -- 172.21.15.6:0/2634880471 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c880092e0 con 0x7f2c900d07a0 2023-10-06T02:24:37.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.882+0000 7f2c96608700 1 -- 172.21.15.6:0/2634880471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c900d07a0 msgr2=0x7f2c900cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.882+0000 7f2c96608700 1 --2- 172.21.15.6:0/2634880471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c900d07a0 0x7f2c900cea80 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f2c90067c40 tx=0x7f2c88009840 comp rx=0 tx=0).stop 2023-10-06T02:24:37.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.882+0000 7f2c96608700 1 -- 172.21.15.6:0/2634880471 shutdown_connections 2023-10-06T02:24:37.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.882+0000 7f2c96608700 1 --2- 172.21.15.6:0/2634880471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c900d07a0 0x7f2c900cea80 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.882+0000 7f2c96608700 1 --2- 172.21.15.6:0/2634880471 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c90142df0 0x7f2c900cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.882+0000 7f2c96608700 1 --2- 172.21.15.6:0/2634880471 >> v2:172.21.15.175:3300/0 conn(0x7f2c900cc890 0x7f2c900d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.882+0000 7f2c96608700 1 -- 172.21.15.6:0/2634880471 >> 172.21.15.6:0/2634880471 conn(0x7f2c900690f0 msgr2=0x7f2c9006a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:37.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.883+0000 7f2c96608700 1 -- 172.21.15.6:0/2634880471 shutdown_connections 2023-10-06T02:24:37.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.883+0000 7f2c96608700 1 -- 172.21.15.6:0/2634880471 wait complete. 2023-10-06T02:24:37.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.884+0000 7f2c96608700 1 Processor -- start 2023-10-06T02:24:37.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.884+0000 7f2c96608700 1 -- start start 2023-10-06T02:24:37.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.884+0000 7f2c96608700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c900cc890 0x7f2c90169260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.884+0000 7f2c96608700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c900d07a0 0x7f2c9015db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.884+0000 7f2c96608700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c90142df0 0x7f2c9015e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c96608700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c901697a0 con 0x7f2c90142df0 2023-10-06T02:24:37.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c96608700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9015b4d0 con 0x7f2c900cc890 2023-10-06T02:24:37.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c96608700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9015e900 con 0x7f2c900d07a0 2023-10-06T02:24:37.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c94ba5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c90142df0 0x7f2c9015e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c94ba5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c90142df0 0x7f2c9015e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56390/0 (socket says 172.21.15.6:56390) 2023-10-06T02:24:37.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c94ba5700 1 -- 172.21.15.6:0/409124266 learned_addr learned my addr 172.21.15.6:0/409124266 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:37.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c8ffff700 1 --2- 172.21.15.6:0/409124266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c900cc890 0x7f2c90169260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c8f7fe700 1 --2- 172.21.15.6:0/409124266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c900d07a0 0x7f2c9015db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c94ba5700 1 -- 172.21.15.6:0/409124266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c900d07a0 msgr2=0x7f2c9015db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c94ba5700 1 --2- 172.21.15.6:0/409124266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c900d07a0 0x7f2c9015db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c94ba5700 1 -- 172.21.15.6:0/409124266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c900cc890 msgr2=0x7f2c90169260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c94ba5700 1 --2- 172.21.15.6:0/409124266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c900cc890 0x7f2c90169260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c94ba5700 1 -- 172.21.15.6:0/409124266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c88009ae0 con 0x7f2c90142df0 2023-10-06T02:24:37.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c94ba5700 1 --2- 172.21.15.6:0/409124266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c90142df0 0x7f2c9015e0d0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f2c90067c10 tx=0x7f2c88018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c77fff700 1 -- 172.21.15.6:0/409124266 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c880032f0 con 0x7f2c90142df0 2023-10-06T02:24:37.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c77fff700 1 -- 172.21.15.6:0/409124266 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c88008db0 con 0x7f2c90142df0 2023-10-06T02:24:37.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c77fff700 1 -- 172.21.15.6:0/409124266 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88026690 con 0x7f2c90142df0 2023-10-06T02:24:37.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c96608700 1 -- 172.21.15.6:0/409124266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9015aba0 con 0x7f2c90142df0 2023-10-06T02:24:37.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.885+0000 7f2c96608700 1 -- 172.21.15.6:0/409124266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9015b160 con 0x7f2c90142df0 2023-10-06T02:24:37.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.886+0000 7f2c96608700 1 -- 172.21.15.6:0/409124266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c9015e670 con 0x7f2c90142df0 2023-10-06T02:24:37.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.887+0000 7f2c77fff700 1 -- 172.21.15.6:0/409124266 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c88003040 con 0x7f2c90142df0 2023-10-06T02:24:37.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.887+0000 7f2c77fff700 1 --2- 172.21.15.6:0/409124266 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c7c066f30 0x7f2c7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.887+0000 7f2c77fff700 1 -- 172.21.15.6:0/409124266 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f2c88086460 con 0x7f2c90142df0 2023-10-06T02:24:37.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.887+0000 7f2c8ffff700 1 --2- 172.21.15.6:0/409124266 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c7c066f30 0x7f2c7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.888+0000 7f2c8ffff700 1 --2- 172.21.15.6:0/409124266 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c7c066f30 0x7f2c7c0693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2c80006f00 tx=0x7f2c80008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:37.891+0000 7f2c77fff700 1 -- 172.21.15.6:0/409124266 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c88053780 con 0x7f2c90142df0 2023-10-06T02:24:38.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:38.086+0000 7f2c96608700 1 -- 172.21.15.6:0/409124266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2c9015b640 con 0x7f2c90142df0 2023-10-06T02:24:38.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:38.956+0000 7f2c77fff700 1 -- 172.21.15.6:0/409124266 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v92) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2c88056da0 con 0x7f2c90142df0 2023-10-06T02:24:38.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:38.961+0000 7f2c96608700 1 -- 172.21.15.6:0/409124266 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c7c066f30 msgr2=0x7f2c7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:38.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:38.961+0000 7f2c96608700 1 --2- 172.21.15.6:0/409124266 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c7c066f30 0x7f2c7c0693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2c80006f00 tx=0x7f2c80008040 comp rx=0 tx=0).stop 2023-10-06T02:24:38.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:38.961+0000 7f2c96608700 1 -- 172.21.15.6:0/409124266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c90142df0 msgr2=0x7f2c9015e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:38.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:38.961+0000 7f2c96608700 1 --2- 172.21.15.6:0/409124266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c90142df0 0x7f2c9015e0d0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f2c90067c10 tx=0x7f2c88018000 comp rx=0 tx=0).stop 2023-10-06T02:24:38.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:38.962+0000 7f2c96608700 1 -- 172.21.15.6:0/409124266 shutdown_connections 2023-10-06T02:24:38.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:38.962+0000 7f2c96608700 1 --2- 172.21.15.6:0/409124266 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c7c066f30 0x7f2c7c0693e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:38.962+0000 7f2c96608700 1 --2- 172.21.15.6:0/409124266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c90142df0 0x7f2c9015e0d0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:38.962+0000 7f2c96608700 1 --2- 172.21.15.6:0/409124266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c900cc890 0x7f2c90169260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:38.962+0000 7f2c96608700 1 --2- 172.21.15.6:0/409124266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c900d07a0 0x7f2c9015db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:38.962+0000 7f2c96608700 1 -- 172.21.15.6:0/409124266 >> 172.21.15.6:0/409124266 conn(0x7f2c900690f0 msgr2=0x7f2c90141c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:38.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:38.962+0000 7f2c96608700 1 -- 172.21.15.6:0/409124266 shutdown_connections 2023-10-06T02:24:38.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:38.962+0000 7f2c96608700 1 -- 172.21.15.6:0/409124266 wait complete. 2023-10-06T02:24:38.965 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-06T02:24:38.979 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:24:39.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.112+0000 7f3fe51bc700 1 Processor -- start 2023-10-06T02:24:39.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.112+0000 7f3fe51bc700 1 -- start start 2023-10-06T02:24:39.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.112+0000 7f3fe51bc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3fe01598d0 0x7f3fe0069790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:39.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.112+0000 7f3fe51bc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3fe00c9740 0x7f3fe00c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:39.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.112+0000 7f3fe51bc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fe00ca0f0 0x7f3fe00c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.112+0000 7f3fe51bc700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe0159ca0 con 0x7f3fe01598d0 2023-10-06T02:24:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.112+0000 7f3fe51bc700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe00ad620 con 0x7f3fe00c9740 2023-10-06T02:24:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.112+0000 7f3fe51bc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe00c86a0 con 0x7f3fe00ca0f0 2023-10-06T02:24:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.113+0000 7f3fdffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3fe01598d0 0x7f3fe0069790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.113+0000 7f3fdffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3fe01598d0 0x7f3fe0069790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46146/0 (socket says 172.21.15.6:46146) 2023-10-06T02:24:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.113+0000 7f3fdffff700 1 -- 172.21.15.6:0/2377964459 learned_addr learned my addr 172.21.15.6:0/2377964459 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.113+0000 7f3fdffff700 1 -- 172.21.15.6:0/2377964459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fe00ca0f0 msgr2=0x7f3fe00c2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.113+0000 7f3fdf7fe700 1 --2- 172.21.15.6:0/2377964459 >> v2:172.21.15.175:3300/0 conn(0x7f3fe00c9740 0x7f3fe00c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.113+0000 7f3fe49bb700 1 --2- 172.21.15.6:0/2377964459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fe00ca0f0 0x7f3fe00c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.113+0000 7f3fdffff700 1 --2- 172.21.15.6:0/2377964459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fe00ca0f0 0x7f3fe00c2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.113+0000 7f3fdffff700 1 -- 172.21.15.6:0/2377964459 >> v2:172.21.15.175:3300/0 conn(0x7f3fe00c9740 msgr2=0x7f3fe00c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.113+0000 7f3fdffff700 1 --2- 172.21.15.6:0/2377964459 >> v2:172.21.15.175:3300/0 conn(0x7f3fe00c9740 0x7f3fe00c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.113+0000 7f3fdffff700 1 -- 172.21.15.6:0/2377964459 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe00c8980 con 0x7f3fe01598d0 2023-10-06T02:24:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.113+0000 7f3fdf7fe700 1 --2- 172.21.15.6:0/2377964459 >> v2:172.21.15.175:3300/0 conn(0x7f3fe00c9740 0x7f3fe00c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.113+0000 7f3fe49bb700 1 --2- 172.21.15.6:0/2377964459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fe00ca0f0 0x7f3fe00c2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.113+0000 7f3fdffff700 1 --2- 172.21.15.6:0/2377964459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe01598d0 0x7f3fe0069790 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f3fe006ee20 tx=0x7f3fd0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5449bb891848ada8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.113+0000 7f3fdeffd700 1 -- 172.21.15.6:0/2377964459 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0005c10 con 0x7f3fe01598d0 2023-10-06T02:24:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.113+0000 7f3fdeffd700 1 -- 172.21.15.6:0/2377964459 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd0005d70 con 0x7f3fe01598d0 2023-10-06T02:24:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.113+0000 7f3fdeffd700 1 -- 172.21.15.6:0/2377964459 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000b880 con 0x7f3fe01598d0 2023-10-06T02:24:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.114+0000 7f3fe51bc700 1 -- 172.21.15.6:0/2377964459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe01598d0 msgr2=0x7f3fe0069790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.114+0000 7f3fe51bc700 1 --2- 172.21.15.6:0/2377964459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe01598d0 0x7f3fe0069790 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f3fe006ee20 tx=0x7f3fd0009220 comp rx=0 tx=0).stop 2023-10-06T02:24:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.114+0000 7f3fe51bc700 1 -- 172.21.15.6:0/2377964459 shutdown_connections 2023-10-06T02:24:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.114+0000 7f3fe51bc700 1 --2- 172.21.15.6:0/2377964459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fe00ca0f0 0x7f3fe00c2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.114+0000 7f3fe51bc700 1 --2- 172.21.15.6:0/2377964459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe01598d0 0x7f3fe0069790 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.114+0000 7f3fe51bc700 1 --2- 172.21.15.6:0/2377964459 >> v2:172.21.15.175:3300/0 conn(0x7f3fe00c9740 0x7f3fe00c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.114+0000 7f3fe51bc700 1 -- 172.21.15.6:0/2377964459 >> 172.21.15.6:0/2377964459 conn(0x7f3fe0067910 msgr2=0x7f3fe00cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.114+0000 7f3fe51bc700 1 -- 172.21.15.6:0/2377964459 shutdown_connections 2023-10-06T02:24:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.114+0000 7f3fe51bc700 1 -- 172.21.15.6:0/2377964459 wait complete. 2023-10-06T02:24:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.115+0000 7f3fe51bc700 1 Processor -- start 2023-10-06T02:24:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.115+0000 7f3fe51bc700 1 -- start start 2023-10-06T02:24:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fe51bc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe00c9740 0x7f3fe00b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fe51bc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fe00ca0f0 0x7f3fe00c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fe51bc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe01598d0 0x7f3fe01567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fe51bc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe00ad990 con 0x7f3fe00c9740 2023-10-06T02:24:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fe51bc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe00b2920 con 0x7f3fe01598d0 2023-10-06T02:24:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fe51bc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe00c70c0 con 0x7f3fe00ca0f0 2023-10-06T02:24:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fdffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe00c9740 0x7f3fe00b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fdffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe00c9740 0x7f3fe00b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46154/0 (socket says 172.21.15.6:46154) 2023-10-06T02:24:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fdffff700 1 -- 172.21.15.6:0/3505892413 learned_addr learned my addr 172.21.15.6:0/3505892413 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fdf7fe700 1 --2- 172.21.15.6:0/3505892413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fe00ca0f0 0x7f3fe00c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fe49bb700 1 --2- 172.21.15.6:0/3505892413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe01598d0 0x7f3fe01567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fdffff700 1 -- 172.21.15.6:0/3505892413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fe00ca0f0 msgr2=0x7f3fe00c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fdffff700 1 --2- 172.21.15.6:0/3505892413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fe00ca0f0 0x7f3fe00c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fdffff700 1 -- 172.21.15.6:0/3505892413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe01598d0 msgr2=0x7f3fe01567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fdffff700 1 --2- 172.21.15.6:0/3505892413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe01598d0 0x7f3fe01567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fdffff700 1 -- 172.21.15.6:0/3505892413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd0009480 con 0x7f3fe00c9740 2023-10-06T02:24:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fdf7fe700 1 --2- 172.21.15.6:0/3505892413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fe00ca0f0 0x7f3fe00c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fe49bb700 1 --2- 172.21.15.6:0/3505892413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe01598d0 0x7f3fe01567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.116+0000 7f3fdffff700 1 --2- 172.21.15.6:0/3505892413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe00c9740 0x7f3fe00b1720 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000b3c0 tx=0x7f3fd0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.117+0000 7f3fc7fff700 1 -- 172.21.15.6:0/3505892413 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0011920 con 0x7f3fe00c9740 2023-10-06T02:24:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.117+0000 7f3fc7fff700 1 -- 172.21.15.6:0/3505892413 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd0020070 con 0x7f3fe00c9740 2023-10-06T02:24:39.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.117+0000 7f3fe51bc700 1 -- 172.21.15.6:0/3505892413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe00b1d10 con 0x7f3fe00c9740 2023-10-06T02:24:39.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.117+0000 7f3fc7fff700 1 -- 172.21.15.6:0/3505892413 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0011cb0 con 0x7f3fe00c9740 2023-10-06T02:24:39.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.117+0000 7f3fe51bc700 1 -- 172.21.15.6:0/3505892413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe00b22d0 con 0x7f3fe00c9740 2023-10-06T02:24:39.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.118+0000 7f3fe51bc700 1 -- 172.21.15.6:0/3505892413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe0086ff0 con 0x7f3fe00c9740 2023-10-06T02:24:39.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.118+0000 7f3fc7fff700 1 -- 172.21.15.6:0/3505892413 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fd0022030 con 0x7f3fe00c9740 2023-10-06T02:24:39.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.119+0000 7f3fc7fff700 1 --2- 172.21.15.6:0/3505892413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3fcc066f30 0x7f3fcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:39.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.119+0000 7f3fc7fff700 1 -- 172.21.15.6:0/3505892413 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f3fd0086300 con 0x7f3fe00c9740 2023-10-06T02:24:39.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.119+0000 7f3fdf7fe700 1 --2- 172.21.15.6:0/3505892413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3fcc066f30 0x7f3fcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:39.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.119+0000 7f3fdf7fe700 1 --2- 172.21.15.6:0/3505892413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3fcc066f30 0x7f3fcc0693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00b0860 tx=0x7f3fd4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:39.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.123+0000 7f3fc7fff700 1 -- 172.21.15.6:0/3505892413 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fd00534b0 con 0x7f3fe00c9740 2023-10-06T02:24:39.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.315+0000 7f3fe51bc700 1 -- 172.21.15.6:0/3505892413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3fe0064aa0 con 0x7f3fe00c9740 2023-10-06T02:24:39.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.960+0000 7f3fc7fff700 1 -- 172.21.15.6:0/3505892413 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v93) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3fd0056ad0 con 0x7f3fe00c9740 2023-10-06T02:24:39.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.966+0000 7f3fe51bc700 1 -- 172.21.15.6:0/3505892413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3fcc066f30 msgr2=0x7f3fcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:39.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.966+0000 7f3fe51bc700 1 --2- 172.21.15.6:0/3505892413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3fcc066f30 0x7f3fcc0693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00b0860 tx=0x7f3fd4008040 comp rx=0 tx=0).stop 2023-10-06T02:24:39.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.966+0000 7f3fe51bc700 1 -- 172.21.15.6:0/3505892413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe00c9740 msgr2=0x7f3fe00b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:39.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.966+0000 7f3fe51bc700 1 --2- 172.21.15.6:0/3505892413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe00c9740 0x7f3fe00b1720 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000b3c0 tx=0x7f3fd0016000 comp rx=0 tx=0).stop 2023-10-06T02:24:39.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.967+0000 7f3fe51bc700 1 -- 172.21.15.6:0/3505892413 shutdown_connections 2023-10-06T02:24:39.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.967+0000 7f3fe51bc700 1 --2- 172.21.15.6:0/3505892413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe01598d0 0x7f3fe01567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.967+0000 7f3fe51bc700 1 --2- 172.21.15.6:0/3505892413 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3fcc066f30 0x7f3fcc0693e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.967+0000 7f3fe51bc700 1 --2- 172.21.15.6:0/3505892413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe00c9740 0x7f3fe00b1720 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.967+0000 7f3fe51bc700 1 --2- 172.21.15.6:0/3505892413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fe00ca0f0 0x7f3fe00c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.967+0000 7f3fe51bc700 1 -- 172.21.15.6:0/3505892413 >> 172.21.15.6:0/3505892413 conn(0x7f3fe0067910 msgr2=0x7f3fe0069d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:39.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.968+0000 7f3fe51bc700 1 -- 172.21.15.6:0/3505892413 shutdown_connections 2023-10-06T02:24:39.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:39.968+0000 7f3fe51bc700 1 -- 172.21.15.6:0/3505892413 wait complete. 2023-10-06T02:24:39.978 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-06T02:24:39.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:24:40.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.115+0000 7f130c898700 1 Processor -- start 2023-10-06T02:24:40.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.115+0000 7f130c898700 1 -- start start 2023-10-06T02:24:40.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f130c898700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13081570f0 0x7f13080c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:40.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f130c898700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f130806e8a0 0x7f13081584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:40.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f130c898700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13081574c0 0x7f130806d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:40.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f130c898700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1308158050 con 0x7f13081570f0 2023-10-06T02:24:40.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f130c898700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13080c93e0 con 0x7f130806e8a0 2023-10-06T02:24:40.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f130c898700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13080c9940 con 0x7f13081574c0 2023-10-06T02:24:40.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f13077fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13081570f0 0x7f13080c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:40.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f1306ffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f130806e8a0 0x7f13081584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:40.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f13077fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13081570f0 0x7f13080c8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46156/0 (socket says 172.21.15.6:46156) 2023-10-06T02:24:40.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f13077fe700 1 -- 172.21.15.6:0/368530224 learned_addr learned my addr 172.21.15.6:0/368530224 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:40.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f1307fff700 1 --2- 172.21.15.6:0/368530224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13081574c0 0x7f130806d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:40.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f13077fe700 1 -- 172.21.15.6:0/368530224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13081574c0 msgr2=0x7f130806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:40.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f13077fe700 1 --2- 172.21.15.6:0/368530224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13081574c0 0x7f130806d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f13077fe700 1 -- 172.21.15.6:0/368530224 >> v2:172.21.15.175:3300/0 conn(0x7f130806e8a0 msgr2=0x7f13081584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:40.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f13077fe700 1 --2- 172.21.15.6:0/368530224 >> v2:172.21.15.175:3300/0 conn(0x7f130806e8a0 0x7f13081584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f13077fe700 1 -- 172.21.15.6:0/368530224 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13080c9660 con 0x7f13081570f0 2023-10-06T02:24:40.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f13077fe700 1 --2- 172.21.15.6:0/368530224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13081570f0 0x7f13080c8ea0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f12f80099b0 tx=0x7f12f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe6eabd22e1a550 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:40.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f13067fc700 1 -- 172.21.15.6:0/368530224 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f800b640 con 0x7f13081570f0 2023-10-06T02:24:40.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f13067fc700 1 -- 172.21.15.6:0/368530224 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f800b7a0 con 0x7f13081570f0 2023-10-06T02:24:40.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.116+0000 7f13067fc700 1 -- 172.21.15.6:0/368530224 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f800bb40 con 0x7f13081570f0 2023-10-06T02:24:40.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.117+0000 7f130c898700 1 -- 172.21.15.6:0/368530224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13081570f0 msgr2=0x7f13080c8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:40.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.117+0000 7f130c898700 1 --2- 172.21.15.6:0/368530224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13081570f0 0x7f13080c8ea0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f12f80099b0 tx=0x7f12f8009250 comp rx=0 tx=0).stop 2023-10-06T02:24:40.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.117+0000 7f130c898700 1 -- 172.21.15.6:0/368530224 shutdown_connections 2023-10-06T02:24:40.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.117+0000 7f130c898700 1 --2- 172.21.15.6:0/368530224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13081574c0 0x7f130806d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.117+0000 7f130c898700 1 --2- 172.21.15.6:0/368530224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13081570f0 0x7f13080c8ea0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.117+0000 7f130c898700 1 --2- 172.21.15.6:0/368530224 >> v2:172.21.15.175:3300/0 conn(0x7f130806e8a0 0x7f13081584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.117+0000 7f130c898700 1 -- 172.21.15.6:0/368530224 >> 172.21.15.6:0/368530224 conn(0x7f13080cea20 msgr2=0x7f130806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:40.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.117+0000 7f130c898700 1 -- 172.21.15.6:0/368530224 shutdown_connections 2023-10-06T02:24:40.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.117+0000 7f130c898700 1 -- 172.21.15.6:0/368530224 wait complete. 2023-10-06T02:24:40.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.118+0000 7f130c898700 1 Processor -- start 2023-10-06T02:24:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.118+0000 7f130c898700 1 -- start start 2023-10-06T02:24:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.119+0000 7f130c898700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f130806e8a0 0x7f13080c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.119+0000 7f130c898700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13081570f0 0x7f13080c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.119+0000 7f130c898700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13081574c0 0x7f13080c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.119+0000 7f130c898700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13080b13c0 con 0x7f130806e8a0 2023-10-06T02:24:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.119+0000 7f130c898700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13080b1f40 con 0x7f13081574c0 2023-10-06T02:24:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.119+0000 7f130c898700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13080b1610 con 0x7f13081570f0 2023-10-06T02:24:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.119+0000 7f13077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f130806e8a0 0x7f13080c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.119+0000 7f13077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f130806e8a0 0x7f13080c5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46162/0 (socket says 172.21.15.6:46162) 2023-10-06T02:24:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.119+0000 7f13077fe700 1 -- 172.21.15.6:0/237288009 learned_addr learned my addr 172.21.15.6:0/237288009 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.119+0000 7f1306ffd700 1 --2- 172.21.15.6:0/237288009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13081570f0 0x7f13080c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.119+0000 7f1307fff700 1 --2- 172.21.15.6:0/237288009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13081574c0 0x7f13080c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.119+0000 7f13077fe700 1 -- 172.21.15.6:0/237288009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13081570f0 msgr2=0x7f13080c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.119+0000 7f13077fe700 1 --2- 172.21.15.6:0/237288009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13081570f0 0x7f13080c5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.120+0000 7f13077fe700 1 -- 172.21.15.6:0/237288009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13081574c0 msgr2=0x7f13080c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.120+0000 7f13077fe700 1 --2- 172.21.15.6:0/237288009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13081574c0 0x7f13080c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.120+0000 7f13077fe700 1 -- 172.21.15.6:0/237288009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f80094f0 con 0x7f130806e8a0 2023-10-06T02:24:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.120+0000 7f1307fff700 1 --2- 172.21.15.6:0/237288009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13081574c0 0x7f13080c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.120+0000 7f13077fe700 1 --2- 172.21.15.6:0/237288009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f130806e8a0 0x7f13080c5000 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f13080cba70 tx=0x7f12f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.120+0000 7f12ef7fe700 1 -- 172.21.15.6:0/237288009 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f800bb20 con 0x7f130806e8a0 2023-10-06T02:24:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.120+0000 7f12ef7fe700 1 -- 172.21.15.6:0/237288009 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f8011420 con 0x7f130806e8a0 2023-10-06T02:24:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.120+0000 7f130c898700 1 -- 172.21.15.6:0/237288009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13080b18f0 con 0x7f130806e8a0 2023-10-06T02:24:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.120+0000 7f12ef7fe700 1 -- 172.21.15.6:0/237288009 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f80117c0 con 0x7f130806e8a0 2023-10-06T02:24:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.120+0000 7f130c898700 1 -- 172.21.15.6:0/237288009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13080c74c0 con 0x7f130806e8a0 2023-10-06T02:24:40.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.121+0000 7f130c898700 1 -- 172.21.15.6:0/237288009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1308064ee0 con 0x7f130806e8a0 2023-10-06T02:24:40.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.121+0000 7f12ef7fe700 1 -- 172.21.15.6:0/237288009 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12f8011bb0 con 0x7f130806e8a0 2023-10-06T02:24:40.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.122+0000 7f12ef7fe700 1 --2- 172.21.15.6:0/237288009 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f12f4066f30 0x7f12f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:40.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.122+0000 7f12ef7fe700 1 -- 172.21.15.6:0/237288009 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f12f8085c40 con 0x7f130806e8a0 2023-10-06T02:24:40.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.122+0000 7f1306ffd700 1 --2- 172.21.15.6:0/237288009 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f12f4066f30 0x7f12f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:40.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.122+0000 7f1306ffd700 1 --2- 172.21.15.6:0/237288009 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f12f4066f30 0x7f12f40693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f13080ada40 tx=0x7f12fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:40.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.126+0000 7f12ef7fe700 1 -- 172.21.15.6:0/237288009 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12f8052cf0 con 0x7f130806e8a0 2023-10-06T02:24:40.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.364+0000 7f130c898700 1 -- 172.21.15.6:0/237288009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1308064aa0 con 0x7f130806e8a0 2023-10-06T02:24:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.978+0000 7f12ef7fe700 1 -- 172.21.15.6:0/237288009 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v82) v1 ==== 174+0+0 (secure 0 0 0) 0x7f12f8011e60 con 0x7f130806e8a0 2023-10-06T02:24:40.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.988+0000 7f130c898700 1 -- 172.21.15.6:0/237288009 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f12f4066f30 msgr2=0x7f12f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:40.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.988+0000 7f130c898700 1 --2- 172.21.15.6:0/237288009 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f12f4066f30 0x7f12f40693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f13080ada40 tx=0x7f12fc008040 comp rx=0 tx=0).stop 2023-10-06T02:24:40.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.988+0000 7f130c898700 1 -- 172.21.15.6:0/237288009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f130806e8a0 msgr2=0x7f13080c5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:40.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.988+0000 7f130c898700 1 --2- 172.21.15.6:0/237288009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f130806e8a0 0x7f13080c5000 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f13080cba70 tx=0x7f12f8017000 comp rx=0 tx=0).stop 2023-10-06T02:24:40.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.989+0000 7f130c898700 1 -- 172.21.15.6:0/237288009 shutdown_connections 2023-10-06T02:24:40.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.989+0000 7f130c898700 1 --2- 172.21.15.6:0/237288009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13081574c0 0x7f13080c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.989+0000 7f130c898700 1 --2- 172.21.15.6:0/237288009 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f12f4066f30 0x7f12f40693e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.989+0000 7f130c898700 1 --2- 172.21.15.6:0/237288009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f130806e8a0 0x7f13080c5000 secure :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f13080cba70 tx=0x7f12f8017000 comp rx=0 tx=0).stop 2023-10-06T02:24:40.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.989+0000 7f130c898700 1 --2- 172.21.15.6:0/237288009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13081570f0 0x7f13080c5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.989+0000 7f130c898700 1 -- 172.21.15.6:0/237288009 >> 172.21.15.6:0/237288009 conn(0x7f13080cea20 msgr2=0x7f13081562d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:40.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.989+0000 7f130c898700 1 -- 172.21.15.6:0/237288009 shutdown_connections 2023-10-06T02:24:40.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:40.990+0000 7f130c898700 1 -- 172.21.15.6:0/237288009 wait complete. 2023-10-06T02:24:40.997 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 14 and data pool 15 2023-10-06T02:24:41.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:41.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.126+0000 7fcf29210700 1 Processor -- start 2023-10-06T02:24:41.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.126+0000 7fcf29210700 1 -- start start 2023-10-06T02:24:41.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.127+0000 7fcf29210700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcf240af4e0 0x7fcf240b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.127+0000 7fcf29210700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2415e190 con 0x7fcf2415db70 2023-10-06T02:24:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.127+0000 7fcf29210700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf240cb650 con 0x7fcf240af8b0 2023-10-06T02:24:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.127+0000 7fcf29210700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf240b1910 con 0x7fcf240af4e0 2023-10-06T02:24:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.127+0000 7fcf2359e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcf2415db70 0x7fcf240cbae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43796/0 (socket says 172.21.15.6:43796) 2023-10-06T02:24:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.127+0000 7fcf2359e700 1 -- 172.21.15.6:0/428879918 learned_addr learned my addr 172.21.15.6:0/428879918 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.127+0000 7fcf22d9d700 1 --2- 172.21.15.6:0/428879918 >> v2:172.21.15.175:3300/0 conn(0x7fcf240af4e0 0x7fcf240b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.127+0000 7fcf21d9b700 1 -- 172.21.15.6:0/428879918 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973650391 0 0) 0x7fcf2415e190 con 0x7fcf2415db70 2023-10-06T02:24:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.127+0000 7fcf21d9b700 1 -- 172.21.15.6:0/428879918 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf10003570 con 0x7fcf2415db70 2023-10-06T02:24:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf21d9b700 1 -- 172.21.15.6:0/428879918 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288979905 0 0) 0x7fcf240cb650 con 0x7fcf240af8b0 2023-10-06T02:24:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf21d9b700 1 -- 172.21.15.6:0/428879918 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf2415e190 con 0x7fcf240af8b0 2023-10-06T02:24:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf21d9b700 1 -- 172.21.15.6:0/428879918 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3219389560 0 0) 0x7fcf10003570 con 0x7fcf2415db70 2023-10-06T02:24:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf21d9b700 1 -- 172.21.15.6:0/428879918 >> v2:172.21.15.175:3300/0 conn(0x7fcf240af4e0 msgr2=0x7fcf240b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf21d9b700 1 --2- 172.21.15.6:0/428879918 >> v2:172.21.15.175:3300/0 conn(0x7fcf240af4e0 0x7fcf240b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf21d9b700 1 -- 172.21.15.6:0/428879918 >> v1:172.21.15.175:6789/0 conn(0x7fcf240af8b0 legacy=0x7fcf2415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf21d9b700 1 -- 172.21.15.6:0/428879918 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf240cad20 con 0x7fcf2415db70 2023-10-06T02:24:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf21d9b700 1 -- 172.21.15.6:0/428879918 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fcf140017f0 con 0x7fcf2415db70 2023-10-06T02:24:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf21d9b700 1 -- 172.21.15.6:0/428879918 >> v1:172.21.15.6:6789/0 conn(0x7fcf2415db70 legacy=0x7fcf240cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf21d9b700 1 --2- 172.21.15.6:0/428879918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c40 0x7fcf10004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf21d9b700 1 --2- 172.21.15.6:0/428879918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf10004810 0x7fcf10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf21d9b700 1 --2- 172.21.15.6:0/428879918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf10005210 0x7fcf1000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf21d9b700 1 -- 172.21.15.6:0/428879918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf240b1910 con 0x7fcf10003c40 2023-10-06T02:24:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf21d9b700 1 -- 172.21.15.6:0/428879918 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1000c1b0 con 0x7fcf10005210 2023-10-06T02:24:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf21d9b700 1 -- 172.21.15.6:0/428879918 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1000c370 con 0x7fcf10004810 2023-10-06T02:24:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf22d9d700 1 --2- 172.21.15.6:0/428879918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c40 0x7fcf10004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf2259c700 1 --2- 172.21.15.6:0/428879918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf10004810 0x7fcf10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf2359e700 1 --2- 172.21.15.6:0/428879918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf10005210 0x7fcf1000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf22d9d700 1 -- 172.21.15.6:0/428879918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf10004810 msgr2=0x7fcf10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf22d9d700 1 --2- 172.21.15.6:0/428879918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf10004810 0x7fcf10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf22d9d700 1 -- 172.21.15.6:0/428879918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf10005210 msgr2=0x7fcf1000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf22d9d700 1 --2- 172.21.15.6:0/428879918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf10005210 0x7fcf1000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf22d9d700 1 -- 172.21.15.6:0/428879918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10003570 con 0x7fcf10003c40 2023-10-06T02:24:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf2359e700 1 --2- 172.21.15.6:0/428879918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf10005210 0x7fcf1000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf2359e700 1 -- 172.21.15.6:0/428879918 reap_dead start 2023-10-06T02:24:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf22d9d700 1 --2- 172.21.15.6:0/428879918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c40 0x7fcf10004030 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c006f00 tx=0x7fcf1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59786aa0fb6097e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.128+0000 7fcf21d9b700 1 -- 172.21.15.6:0/428879918 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c00e710 con 0x7fcf10003c40 2023-10-06T02:24:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.129+0000 7fcf21d9b700 1 -- 172.21.15.6:0/428879918 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c00e870 con 0x7fcf10003c40 2023-10-06T02:24:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.129+0000 7fcf21d9b700 1 -- 172.21.15.6:0/428879918 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c00ec30 con 0x7fcf10003c40 2023-10-06T02:24:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.129+0000 7fcf29210700 1 -- 172.21.15.6:0/428879918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c40 msgr2=0x7fcf10004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.129+0000 7fcf29210700 1 --2- 172.21.15.6:0/428879918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c40 0x7fcf10004030 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c006f00 tx=0x7fcf1c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.129+0000 7fcf29210700 1 -- 172.21.15.6:0/428879918 shutdown_connections 2023-10-06T02:24:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.129+0000 7fcf29210700 1 --2- 172.21.15.6:0/428879918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c40 0x7fcf10004030 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.129+0000 7fcf29210700 1 -- 172.21.15.6:0/428879918 >> 172.21.15.6:0/428879918 conn(0x7fcf24068680 msgr2=0x7fcf24068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.129+0000 7fcf29210700 1 -- 172.21.15.6:0/428879918 shutdown_connections 2023-10-06T02:24:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.129+0000 7fcf29210700 1 -- 172.21.15.6:0/428879918 wait complete. 2023-10-06T02:24:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.130+0000 7fcf29210700 1 Processor -- start 2023-10-06T02:24:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.130+0000 7fcf29210700 1 -- start start 2023-10-06T02:24:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.131+0000 7fcf29210700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c40 0x7fcf240c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.131+0000 7fcf29210700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf240c9e60 0x7fcf2416d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.131+0000 7fcf29210700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf240cc890 0x7fcf240c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.131+0000 7fcf29210700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf24157540 con 0x7fcf10003c40 2023-10-06T02:24:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.131+0000 7fcf29210700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf24157210 con 0x7fcf240c9e60 2023-10-06T02:24:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.131+0000 7fcf29210700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf240c7840 con 0x7fcf240cc890 2023-10-06T02:24:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.131+0000 7fcf22d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c40 0x7fcf240c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.131+0000 7fcf22d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c40 0x7fcf240c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46182/0 (socket says 172.21.15.6:46182) 2023-10-06T02:24:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.131+0000 7fcf22d9d700 1 -- 172.21.15.6:0/3072150339 learned_addr learned my addr 172.21.15.6:0/3072150339 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.131+0000 7fcf2359e700 1 --2- 172.21.15.6:0/3072150339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf240cc890 0x7fcf240c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.131+0000 7fcf2259c700 1 --2- 172.21.15.6:0/3072150339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf240c9e60 0x7fcf2416d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.132+0000 7fcf22d9d700 1 -- 172.21.15.6:0/3072150339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf240cc890 msgr2=0x7fcf240c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.132+0000 7fcf22d9d700 1 --2- 172.21.15.6:0/3072150339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf240cc890 0x7fcf240c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.132+0000 7fcf22d9d700 1 -- 172.21.15.6:0/3072150339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf240c9e60 msgr2=0x7fcf2416d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.132+0000 7fcf22d9d700 1 --2- 172.21.15.6:0/3072150339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf240c9e60 0x7fcf2416d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.132+0000 7fcf22d9d700 1 -- 172.21.15.6:0/3072150339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2416df80 con 0x7fcf10003c40 2023-10-06T02:24:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.132+0000 7fcf2359e700 1 --2- 172.21.15.6:0/3072150339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf240cc890 0x7fcf240c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.132+0000 7fcf2259c700 1 --2- 172.21.15.6:0/3072150339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf240c9e60 0x7fcf2416d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.132+0000 7fcf22d9d700 1 --2- 172.21.15.6:0/3072150339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c40 0x7fcf240c7300 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000c180 tx=0x7fcf1c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.132+0000 7fcf1affd700 1 -- 172.21.15.6:0/3072150339 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c022070 con 0x7fcf10003c40 2023-10-06T02:24:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.132+0000 7fcf1affd700 1 -- 172.21.15.6:0/3072150339 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c00e9e0 con 0x7fcf10003c40 2023-10-06T02:24:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.132+0000 7fcf29210700 1 -- 172.21.15.6:0/3072150339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2416e260 con 0x7fcf10003c40 2023-10-06T02:24:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.132+0000 7fcf1affd700 1 -- 172.21.15.6:0/3072150339 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c01c450 con 0x7fcf10003c40 2023-10-06T02:24:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.132+0000 7fcf29210700 1 -- 172.21.15.6:0/3072150339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2416dbc0 con 0x7fcf10003c40 2023-10-06T02:24:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.133+0000 7fcf29210700 1 -- 172.21.15.6:0/3072150339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2416dd50 con 0x7fcf10003c40 2023-10-06T02:24:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.133+0000 7fcf1affd700 1 -- 172.21.15.6:0/3072150339 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf1c01c880 con 0x7fcf10003c40 2023-10-06T02:24:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.134+0000 7fcf1affd700 1 --2- 172.21.15.6:0/3072150339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf04066f30 0x7fcf040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.134+0000 7fcf1affd700 1 -- 172.21.15.6:0/3072150339 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcf1c085f60 con 0x7fcf10003c40 2023-10-06T02:24:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.134+0000 7fcf2259c700 1 --2- 172.21.15.6:0/3072150339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf04066f30 0x7fcf040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.134+0000 7fcf2259c700 1 --2- 172.21.15.6:0/3072150339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf04066f30 0x7fcf040693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c007fd0 tx=0x7fcf0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.138+0000 7fcf1affd700 1 -- 172.21.15.6:0/3072150339 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf1c052fe0 con 0x7fcf10003c40 2023-10-06T02:24:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.333+0000 7fcf29210700 1 -- 172.21.15.6:0/3072150339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf24157070 con 0x7fcf10003c40 2023-10-06T02:24:41.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.334+0000 7fcf1affd700 1 -- 172.21.15.6:0/3072150339 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+17039 (secure 0 0 0) 0x7fcf24157070 con 0x7fcf10003c40 2023-10-06T02:24:41.334 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:41.334 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":94,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:24:40.365873+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:38.117438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:39.346545+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:41.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.335+0000 7fcf29210700 1 -- 172.21.15.6:0/3072150339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf04066f30 msgr2=0x7fcf040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.335+0000 7fcf29210700 1 --2- 172.21.15.6:0/3072150339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf04066f30 0x7fcf040693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c007fd0 tx=0x7fcf0c009040 comp rx=0 tx=0).stop 2023-10-06T02:24:41.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.335+0000 7fcf29210700 1 -- 172.21.15.6:0/3072150339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c40 msgr2=0x7fcf240c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.335+0000 7fcf29210700 1 --2- 172.21.15.6:0/3072150339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c40 0x7fcf240c7300 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000c180 tx=0x7fcf1c01a000 comp rx=0 tx=0).stop 2023-10-06T02:24:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.336+0000 7fcf29210700 1 -- 172.21.15.6:0/3072150339 shutdown_connections 2023-10-06T02:24:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.336+0000 7fcf29210700 1 --2- 172.21.15.6:0/3072150339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf240cc890 0x7fcf240c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.336+0000 7fcf29210700 1 --2- 172.21.15.6:0/3072150339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf04066f30 0x7fcf040693e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.336+0000 7fcf29210700 1 --2- 172.21.15.6:0/3072150339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c40 0x7fcf240c7300 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.336+0000 7fcf29210700 1 --2- 172.21.15.6:0/3072150339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf240c9e60 0x7fcf2416d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.336+0000 7fcf29210700 1 -- 172.21.15.6:0/3072150339 >> 172.21.15.6:0/3072150339 conn(0x7fcf24068680 msgr2=0x7fcf240b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.336+0000 7fcf29210700 1 -- 172.21.15.6:0/3072150339 shutdown_connections 2023-10-06T02:24:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.336+0000 7fcf29210700 1 -- 172.21.15.6:0/3072150339 wait complete. 2023-10-06T02:24:41.349 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:41.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.466+0000 7f289f636700 1 Processor -- start 2023-10-06T02:24:41.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.466+0000 7f289f636700 1 -- start start 2023-10-06T02:24:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.467+0000 7f289f636700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28980af8b0 0x7f289815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.467+0000 7f289f636700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28980b27f0 0x7f289815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.467+0000 7f289f636700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289815e190 con 0x7f28980af4e0 2023-10-06T02:24:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.467+0000 7f289f636700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28980b1910 con 0x7f28980af8b0 2023-10-06T02:24:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.467+0000 7f289f636700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28980cb650 con 0x7f28980b27f0 2023-10-06T02:24:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.467+0000 7f289cbd1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28980af8b0 0x7f289815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.467+0000 7f289d3d2700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f28980af4e0 0x7f28980b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43810/0 (socket says 172.21.15.6:43810) 2023-10-06T02:24:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.467+0000 7f289cbd1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28980af8b0 0x7f289815d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46198/0 (socket says 172.21.15.6:46198) 2023-10-06T02:24:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.467+0000 7f289d3d2700 1 -- 172.21.15.6:0/3239223742 learned_addr learned my addr 172.21.15.6:0/3239223742 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.467+0000 7f289dbd3700 1 --2- 172.21.15.6:0/3239223742 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28980b27f0 0x7f289815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.467+0000 7f289cbd1700 1 -- 172.21.15.6:0/3239223742 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28980b27f0 msgr2=0x7f289815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.467+0000 7f289cbd1700 1 --2- 172.21.15.6:0/3239223742 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28980b27f0 0x7f289815d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.467+0000 7f289cbd1700 1 -- 172.21.15.6:0/3239223742 >> v1:172.21.15.6:6789/0 conn(0x7f28980af4e0 legacy=0x7f28980b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.467+0000 7f289cbd1700 1 -- 172.21.15.6:0/3239223742 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28980ccaf0 con 0x7f28980af8b0 2023-10-06T02:24:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.467+0000 7f288ffff700 1 -- 172.21.15.6:0/3239223742 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245677280 0 0) 0x7f289815e190 con 0x7f28980af4e0 2023-10-06T02:24:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.467+0000 7f289cbd1700 1 --2- 172.21.15.6:0/3239223742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980af8b0 0x7f289815d460 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f28880098e0 tx=0x7f28880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e027a8bf96d47deb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.467+0000 7f288ffff700 1 -- 172.21.15.6:0/3239223742 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2888009e80 con 0x7f28980af8b0 2023-10-06T02:24:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.468+0000 7f288ffff700 1 -- 172.21.15.6:0/3239223742 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288800b860 con 0x7f28980af8b0 2023-10-06T02:24:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.468+0000 7f288ffff700 1 -- 172.21.15.6:0/3239223742 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288800bbe0 con 0x7f28980af8b0 2023-10-06T02:24:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.468+0000 7f289f636700 1 -- 172.21.15.6:0/3239223742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980af8b0 msgr2=0x7f289815d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.468+0000 7f289f636700 1 --2- 172.21.15.6:0/3239223742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980af8b0 0x7f289815d460 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f28880098e0 tx=0x7f28880091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.468+0000 7f289f636700 1 -- 172.21.15.6:0/3239223742 shutdown_connections 2023-10-06T02:24:41.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.468+0000 7f289f636700 1 --2- 172.21.15.6:0/3239223742 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28980b27f0 0x7f289815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.468+0000 7f289f636700 1 --2- 172.21.15.6:0/3239223742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980af8b0 0x7f289815d460 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.468+0000 7f289f636700 1 -- 172.21.15.6:0/3239223742 >> 172.21.15.6:0/3239223742 conn(0x7f2898068680 msgr2=0x7f2898068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:41.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.468+0000 7f289f636700 1 -- 172.21.15.6:0/3239223742 shutdown_connections 2023-10-06T02:24:41.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.468+0000 7f289f636700 1 -- 172.21.15.6:0/3239223742 wait complete. 2023-10-06T02:24:41.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.469+0000 7f289f636700 1 Processor -- start 2023-10-06T02:24:41.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.469+0000 7f289f636700 1 -- start start 2023-10-06T02:24:41.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.470+0000 7f289f636700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28980af4e0 0x7f28980c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.470+0000 7f289f636700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28980af8b0 0x7f2898154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.470+0000 7f289f636700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980b27f0 0x7f289815b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.470+0000 7f289f636700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2898154600 con 0x7f28980b27f0 2023-10-06T02:24:41.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.470+0000 7f289f636700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28981554e0 con 0x7f28980af4e0 2023-10-06T02:24:41.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.470+0000 7f289f636700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289816d100 con 0x7f28980af8b0 2023-10-06T02:24:41.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.470+0000 7f289dbd3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980b27f0 0x7f289815b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.470+0000 7f289dbd3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980b27f0 0x7f289815b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46208/0 (socket says 172.21.15.6:46208) 2023-10-06T02:24:41.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.470+0000 7f289dbd3700 1 -- 172.21.15.6:0/4180020935 learned_addr learned my addr 172.21.15.6:0/4180020935 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:41.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.470+0000 7f289cbd1700 1 --2- 172.21.15.6:0/4180020935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28980af8b0 0x7f2898154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.470+0000 7f289d3d2700 1 --2- 172.21.15.6:0/4180020935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28980af4e0 0x7f28980c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.471+0000 7f289dbd3700 1 -- 172.21.15.6:0/4180020935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28980af8b0 msgr2=0x7f2898154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.471+0000 7f289dbd3700 1 --2- 172.21.15.6:0/4180020935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28980af8b0 0x7f2898154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.471+0000 7f289dbd3700 1 -- 172.21.15.6:0/4180020935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28980af4e0 msgr2=0x7f28980c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.471+0000 7f289dbd3700 1 --2- 172.21.15.6:0/4180020935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28980af4e0 0x7f28980c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.471+0000 7f289dbd3700 1 -- 172.21.15.6:0/4180020935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2888009420 con 0x7f28980b27f0 2023-10-06T02:24:41.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.471+0000 7f289cbd1700 1 --2- 172.21.15.6:0/4180020935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28980af8b0 0x7f2898154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:41.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.471+0000 7f289dbd3700 1 --2- 172.21.15.6:0/4180020935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980b27f0 0x7f289815b1f0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f2890009fa0 tx=0x7f2890009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:41.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.471+0000 7f288d7fa700 1 -- 172.21.15.6:0/4180020935 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289000ec70 con 0x7f28980b27f0 2023-10-06T02:24:41.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.471+0000 7f288d7fa700 1 -- 172.21.15.6:0/4180020935 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289000edd0 con 0x7f28980b27f0 2023-10-06T02:24:41.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.471+0000 7f288d7fa700 1 -- 172.21.15.6:0/4180020935 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890014670 con 0x7f28980b27f0 2023-10-06T02:24:41.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.471+0000 7f289f636700 1 -- 172.21.15.6:0/4180020935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289816d3e0 con 0x7f28980b27f0 2023-10-06T02:24:41.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.471+0000 7f289f636700 1 -- 172.21.15.6:0/4180020935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289816da20 con 0x7f28980b27f0 2023-10-06T02:24:41.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.472+0000 7f289f636700 1 -- 172.21.15.6:0/4180020935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2898088aa0 con 0x7f28980b27f0 2023-10-06T02:24:41.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.472+0000 7f288d7fa700 1 -- 172.21.15.6:0/4180020935 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28900149e0 con 0x7f28980b27f0 2023-10-06T02:24:41.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.473+0000 7f288d7fa700 1 --2- 172.21.15.6:0/4180020935 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f287c066f30 0x7f287c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.473+0000 7f288d7fa700 1 -- 172.21.15.6:0/4180020935 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2890084f10 con 0x7f28980b27f0 2023-10-06T02:24:41.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.473+0000 7f289d3d2700 1 --2- 172.21.15.6:0/4180020935 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f287c066f30 0x7f287c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.473+0000 7f289d3d2700 1 --2- 172.21.15.6:0/4180020935 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f287c066f30 0x7f287c0693e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2894007160 tx=0x7f2894007f50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:41.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.477+0000 7f288d7fa700 1 -- 172.21.15.6:0/4180020935 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2890051ee0 con 0x7f28980b27f0 2023-10-06T02:24:41.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.672+0000 7f289f636700 1 -- 172.21.15.6:0/4180020935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28980b0910 con 0x7f28980b27f0 2023-10-06T02:24:41.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.672+0000 7f288d7fa700 1 -- 172.21.15.6:0/4180020935 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+17039 (secure 0 0 0) 0x7f2890055500 con 0x7f28980b27f0 2023-10-06T02:24:41.674 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:41.674 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":94,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:24:40.365873+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:38.117438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:39.346545+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:41.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.675+0000 7f289f636700 1 -- 172.21.15.6:0/4180020935 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f287c066f30 msgr2=0x7f287c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.675+0000 7f289f636700 1 --2- 172.21.15.6:0/4180020935 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f287c066f30 0x7f287c0693e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2894007160 tx=0x7f2894007f50 comp rx=0 tx=0).stop 2023-10-06T02:24:41.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.675+0000 7f289f636700 1 -- 172.21.15.6:0/4180020935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980b27f0 msgr2=0x7f289815b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.675+0000 7f289f636700 1 --2- 172.21.15.6:0/4180020935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980b27f0 0x7f289815b1f0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f2890009fa0 tx=0x7f2890009900 comp rx=0 tx=0).stop 2023-10-06T02:24:41.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.675+0000 7f289f636700 1 -- 172.21.15.6:0/4180020935 shutdown_connections 2023-10-06T02:24:41.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.675+0000 7f289f636700 1 --2- 172.21.15.6:0/4180020935 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f287c066f30 0x7f287c0693e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.675+0000 7f289f636700 1 --2- 172.21.15.6:0/4180020935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980b27f0 0x7f289815b1f0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.675+0000 7f289f636700 1 --2- 172.21.15.6:0/4180020935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28980af4e0 0x7f28980c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.675+0000 7f289f636700 1 --2- 172.21.15.6:0/4180020935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28980af8b0 0x7f2898154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.675+0000 7f289f636700 1 -- 172.21.15.6:0/4180020935 >> 172.21.15.6:0/4180020935 conn(0x7f2898068680 msgr2=0x7f289815d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:41.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.675+0000 7f289f636700 1 -- 172.21.15.6:0/4180020935 shutdown_connections 2023-10-06T02:24:41.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.675+0000 7f289f636700 1 -- 172.21.15.6:0/4180020935 wait complete. 2023-10-06T02:24:41.688 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:24:41.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.809+0000 7f3696c0a700 1 Processor -- start 2023-10-06T02:24:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.809+0000 7f3696c0a700 1 -- start start 2023-10-06T02:24:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f3696c0a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f36900a8d90 0x7f36900af200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f3696c0a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f36900b3820 0x7f3690069790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f3696c0a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369006b030 con 0x7f36900a89c0 2023-10-06T02:24:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f3696c0a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36900b1ab0 con 0x7f36900a8d90 2023-10-06T02:24:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f3696c0a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f369006ad50 con 0x7f36900b3820 2023-10-06T02:24:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f368ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f36900a8d90 0x7f36900af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f36949a6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f36900a89c0 0x7f36900aeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43814/0 (socket says 172.21.15.6:43814) 2023-10-06T02:24:41.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f368ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f36900a8d90 0x7f36900af200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46224/0 (socket says 172.21.15.6:46224) 2023-10-06T02:24:41.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f36949a6700 1 -- 172.21.15.6:0/3370498010 learned_addr learned my addr 172.21.15.6:0/3370498010 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:41.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f36951a7700 1 --2- 172.21.15.6:0/3370498010 >> v2:172.21.15.175:3300/0 conn(0x7f36900b3820 0x7f3690069790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f368ffff700 1 -- 172.21.15.6:0/3370498010 >> v2:172.21.15.175:3300/0 conn(0x7f36900b3820 msgr2=0x7f3690069790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:41.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f368ffff700 1 --2- 172.21.15.6:0/3370498010 >> v2:172.21.15.175:3300/0 conn(0x7f36900b3820 0x7f3690069790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f368ffff700 1 -- 172.21.15.6:0/3370498010 >> v1:172.21.15.6:6789/0 conn(0x7f36900a89c0 legacy=0x7f36900aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f368f7fe700 1 -- 172.21.15.6:0/3370498010 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903505266 0 0) 0x7f369006b030 con 0x7f36900a89c0 2023-10-06T02:24:41.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f368ffff700 1 -- 172.21.15.6:0/3370498010 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36900b1d30 con 0x7f36900a8d90 2023-10-06T02:24:41.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f36951a7700 1 --2- 172.21.15.6:0/3370498010 >> v2:172.21.15.175:3300/0 conn(0x7f36900b3820 0x7f3690069790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:41.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f368ffff700 1 --2- 172.21.15.6:0/3370498010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36900a8d90 0x7f36900af200 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f36900b1070 tx=0x7f3680009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee28074b53af7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:41.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.810+0000 7f368f7fe700 1 -- 172.21.15.6:0/3370498010 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368000e070 con 0x7f36900a8d90 2023-10-06T02:24:41.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.811+0000 7f368f7fe700 1 -- 172.21.15.6:0/3370498010 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368000bc30 con 0x7f36900a8d90 2023-10-06T02:24:41.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.811+0000 7f368f7fe700 1 -- 172.21.15.6:0/3370498010 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680012430 con 0x7f36900a8d90 2023-10-06T02:24:41.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.811+0000 7f3696c0a700 1 -- 172.21.15.6:0/3370498010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36900a8d90 msgr2=0x7f36900af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.811+0000 7f3696c0a700 1 --2- 172.21.15.6:0/3370498010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36900a8d90 0x7f36900af200 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f36900b1070 tx=0x7f3680009780 comp rx=0 tx=0).stop 2023-10-06T02:24:41.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.811+0000 7f3696c0a700 1 -- 172.21.15.6:0/3370498010 shutdown_connections 2023-10-06T02:24:41.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.811+0000 7f3696c0a700 1 --2- 172.21.15.6:0/3370498010 >> v2:172.21.15.175:3300/0 conn(0x7f36900b3820 0x7f3690069790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.811+0000 7f3696c0a700 1 --2- 172.21.15.6:0/3370498010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36900a8d90 0x7f36900af200 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.811+0000 7f3696c0a700 1 -- 172.21.15.6:0/3370498010 >> 172.21.15.6:0/3370498010 conn(0x7f3690067910 msgr2=0x7f36900ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:41.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.811+0000 7f3696c0a700 1 -- 172.21.15.6:0/3370498010 shutdown_connections 2023-10-06T02:24:41.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.811+0000 7f3696c0a700 1 -- 172.21.15.6:0/3370498010 wait complete. 2023-10-06T02:24:41.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.812+0000 7f3696c0a700 1 Processor -- start 2023-10-06T02:24:41.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.812+0000 7f3696c0a700 1 -- start start 2023-10-06T02:24:41.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.813+0000 7f3696c0a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36900a89c0 0x7f369014fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.813+0000 7f3696c0a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36900a8d90 0x7f3690152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.813+0000 7f3696c0a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36900b3820 0x7f369015c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.813+0000 7f3696c0a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3690150180 con 0x7f36900a89c0 2023-10-06T02:24:41.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.813+0000 7f3696c0a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3690154620 con 0x7f36900a8d90 2023-10-06T02:24:41.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.813+0000 7f3696c0a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3690153a10 con 0x7f36900b3820 2023-10-06T02:24:41.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.813+0000 7f36949a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36900a89c0 0x7f369014fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.813+0000 7f36949a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36900a89c0 0x7f369014fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46228/0 (socket says 172.21.15.6:46228) 2023-10-06T02:24:41.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.813+0000 7f36949a6700 1 -- 172.21.15.6:0/2679447780 learned_addr learned my addr 172.21.15.6:0/2679447780 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:41.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.813+0000 7f368ffff700 1 --2- 172.21.15.6:0/2679447780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36900a8d90 0x7f3690152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.813+0000 7f36951a7700 1 --2- 172.21.15.6:0/2679447780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36900b3820 0x7f369015c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.814+0000 7f36949a6700 1 -- 172.21.15.6:0/2679447780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36900b3820 msgr2=0x7f369015c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.814+0000 7f36949a6700 1 --2- 172.21.15.6:0/2679447780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36900b3820 0x7f369015c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.814+0000 7f36949a6700 1 -- 172.21.15.6:0/2679447780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36900a8d90 msgr2=0x7f3690152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.814+0000 7f36949a6700 1 --2- 172.21.15.6:0/2679447780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36900a8d90 0x7f3690152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.814+0000 7f36949a6700 1 -- 172.21.15.6:0/2679447780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3680009a20 con 0x7f36900a89c0 2023-10-06T02:24:41.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.814+0000 7f36951a7700 1 --2- 172.21.15.6:0/2679447780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36900b3820 0x7f369015c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:41.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.814+0000 7f36949a6700 1 --2- 172.21.15.6:0/2679447780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36900a89c0 0x7f369014fc40 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f368800c5e0 tx=0x7f3688007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:41.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.814+0000 7f368cff9700 1 -- 172.21.15.6:0/2679447780 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880072e0 con 0x7f36900a89c0 2023-10-06T02:24:41.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.814+0000 7f368cff9700 1 -- 172.21.15.6:0/2679447780 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3688007440 con 0x7f36900a89c0 2023-10-06T02:24:41.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.814+0000 7f3696c0a700 1 -- 172.21.15.6:0/2679447780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3690153cf0 con 0x7f36900a89c0 2023-10-06T02:24:41.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.814+0000 7f368cff9700 1 -- 172.21.15.6:0/2679447780 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880057f0 con 0x7f36900a89c0 2023-10-06T02:24:41.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.814+0000 7f3696c0a700 1 -- 172.21.15.6:0/2679447780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36901542b0 con 0x7f36900a89c0 2023-10-06T02:24:41.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.815+0000 7f3696c0a700 1 -- 172.21.15.6:0/2679447780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3690087170 con 0x7f36900a89c0 2023-10-06T02:24:41.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.815+0000 7f368cff9700 1 -- 172.21.15.6:0/2679447780 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3688005c00 con 0x7f36900a89c0 2023-10-06T02:24:41.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.816+0000 7f368cff9700 1 --2- 172.21.15.6:0/2679447780 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3670066f30 0x7f36700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.816+0000 7f368cff9700 1 -- 172.21.15.6:0/2679447780 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3688083d70 con 0x7f36900a89c0 2023-10-06T02:24:41.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.816+0000 7f368ffff700 1 --2- 172.21.15.6:0/2679447780 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3670066f30 0x7f36700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.816+0000 7f368ffff700 1 --2- 172.21.15.6:0/2679447780 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3670066f30 0x7f36700693e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f36900883f0 tx=0x7f3680019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:41.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:41.820+0000 7f368cff9700 1 -- 172.21.15.6:0/2679447780 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3688050d40 con 0x7f36900a89c0 2023-10-06T02:24:42.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:42.063+0000 7f3696c0a700 1 -- 172.21.15.6:0/2679447780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f369006e5d0 con 0x7f36900a89c0 2023-10-06T02:24:42.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:42.984+0000 7f368cff9700 1 -- 172.21.15.6:0/2679447780 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v85) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3688017070 con 0x7f36900a89c0 2023-10-06T02:24:42.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:42.986+0000 7f3696c0a700 1 -- 172.21.15.6:0/2679447780 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3670066f30 msgr2=0x7f36700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:42.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:42.986+0000 7f3696c0a700 1 --2- 172.21.15.6:0/2679447780 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3670066f30 0x7f36700693e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f36900883f0 tx=0x7f3680019000 comp rx=0 tx=0).stop 2023-10-06T02:24:42.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:42.986+0000 7f3696c0a700 1 -- 172.21.15.6:0/2679447780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36900a89c0 msgr2=0x7f369014fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:42.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:42.986+0000 7f3696c0a700 1 --2- 172.21.15.6:0/2679447780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36900a89c0 0x7f369014fc40 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f368800c5e0 tx=0x7f3688007e80 comp rx=0 tx=0).stop 2023-10-06T02:24:42.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:42.986+0000 7f3696c0a700 1 -- 172.21.15.6:0/2679447780 shutdown_connections 2023-10-06T02:24:42.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:42.986+0000 7f3696c0a700 1 --2- 172.21.15.6:0/2679447780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36900b3820 0x7f369015c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:42.986+0000 7f3696c0a700 1 --2- 172.21.15.6:0/2679447780 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3670066f30 0x7f36700693e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:42.986+0000 7f3696c0a700 1 --2- 172.21.15.6:0/2679447780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36900a89c0 0x7f369014fc40 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:42.986+0000 7f3696c0a700 1 --2- 172.21.15.6:0/2679447780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36900a8d90 0x7f3690152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:42.986+0000 7f3696c0a700 1 -- 172.21.15.6:0/2679447780 >> 172.21.15.6:0/2679447780 conn(0x7f3690067910 msgr2=0x7f36900ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:42.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:42.986+0000 7f3696c0a700 1 -- 172.21.15.6:0/2679447780 shutdown_connections 2023-10-06T02:24:42.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:42.986+0000 7f3696c0a700 1 -- 172.21.15.6:0/2679447780 wait complete. 2023-10-06T02:24:43.002 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:24:43.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.127+0000 7f658e8ed700 1 Processor -- start 2023-10-06T02:24:43.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.127+0000 7f658e8ed700 1 -- start start 2023-10-06T02:24:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.128+0000 7f658e8ed700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6588086ff0 0x7f6588087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.128+0000 7f658e8ed700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f65880b21b0 0x7f65880b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.128+0000 7f658e8ed700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65880b2b70 con 0x7f658815a030 2023-10-06T02:24:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.128+0000 7f658e8ed700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65880b0cf0 con 0x7f6588086ff0 2023-10-06T02:24:43.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.128+0000 7f658e8ed700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65880879b0 con 0x7f65880b21b0 2023-10-06T02:24:43.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.128+0000 7f65877fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6588086ff0 0x7f6588087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:43.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.128+0000 7f65877fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6588086ff0 0x7f6588087470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46230/0 (socket says 172.21.15.6:46230) 2023-10-06T02:24:43.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.128+0000 7f65877fe700 1 -- 172.21.15.6:0/3218603874 learned_addr learned my addr 172.21.15.6:0/3218603874 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:43.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.128+0000 7f658ce8a700 1 --2- 172.21.15.6:0/3218603874 >> v2:172.21.15.175:3300/0 conn(0x7f65880b21b0 0x7f65880b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:43.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.128+0000 7f65877fe700 1 -- 172.21.15.6:0/3218603874 >> v2:172.21.15.175:3300/0 conn(0x7f65880b21b0 msgr2=0x7f65880b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:43.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.128+0000 7f65877fe700 1 --2- 172.21.15.6:0/3218603874 >> v2:172.21.15.175:3300/0 conn(0x7f65880b21b0 0x7f65880b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.128+0000 7f65877fe700 1 -- 172.21.15.6:0/3218603874 >> v1:172.21.15.175:6789/0 conn(0x7f658815a030 legacy=0x7f658815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:43.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.128+0000 7f65877fe700 1 -- 172.21.15.6:0/3218603874 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65880afc50 con 0x7f6588086ff0 2023-10-06T02:24:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.128+0000 7f65877fe700 1 --2- 172.21.15.6:0/3218603874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588086ff0 0x7f6588087470 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f6588157800 tx=0x7f657c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede7495b9f68cd1d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.128+0000 7f6586ffd700 1 -- 172.21.15.6:0/3218603874 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c00b7e0 con 0x7f6588086ff0 2023-10-06T02:24:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.128+0000 7f6586ffd700 1 -- 172.21.15.6:0/3218603874 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657c00b940 con 0x7f6588086ff0 2023-10-06T02:24:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.128+0000 7f6586ffd700 1 -- 172.21.15.6:0/3218603874 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c00bce0 con 0x7f6588086ff0 2023-10-06T02:24:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.129+0000 7f658e8ed700 1 -- 172.21.15.6:0/3218603874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588086ff0 msgr2=0x7f6588087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.129+0000 7f658e8ed700 1 --2- 172.21.15.6:0/3218603874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588086ff0 0x7f6588087470 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f6588157800 tx=0x7f657c009250 comp rx=0 tx=0).stop 2023-10-06T02:24:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.129+0000 7f658e8ed700 1 -- 172.21.15.6:0/3218603874 shutdown_connections 2023-10-06T02:24:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.129+0000 7f658e8ed700 1 --2- 172.21.15.6:0/3218603874 >> v2:172.21.15.175:3300/0 conn(0x7f65880b21b0 0x7f65880b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.129+0000 7f658e8ed700 1 --2- 172.21.15.6:0/3218603874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588086ff0 0x7f6588087470 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.129+0000 7f658e8ed700 1 -- 172.21.15.6:0/3218603874 >> 172.21.15.6:0/3218603874 conn(0x7f6588068680 msgr2=0x7f6588068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:43.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.129+0000 7f658e8ed700 1 -- 172.21.15.6:0/3218603874 shutdown_connections 2023-10-06T02:24:43.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.129+0000 7f658e8ed700 1 -- 172.21.15.6:0/3218603874 wait complete. 2023-10-06T02:24:43.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.130+0000 7f658e8ed700 1 Processor -- start 2023-10-06T02:24:43.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.130+0000 7f658e8ed700 1 -- start start 2023-10-06T02:24:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.131+0000 7f658e8ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588086ff0 0x7f6588145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.131+0000 7f658e8ed700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65880b21b0 0x7f6588158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.131+0000 7f658e8ed700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f658815a030 0x7f6588158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.131+0000 7f658e8ed700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658816aa40 con 0x7f6588086ff0 2023-10-06T02:24:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.131+0000 7f658e8ed700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658816b3c0 con 0x7f658815a030 2023-10-06T02:24:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.131+0000 7f658e8ed700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658816a760 con 0x7f65880b21b0 2023-10-06T02:24:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.131+0000 7f6587fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588086ff0 0x7f6588145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.131+0000 7f6587fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588086ff0 0x7f6588145000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46240/0 (socket says 172.21.15.6:46240) 2023-10-06T02:24:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.131+0000 7f6587fff700 1 -- 172.21.15.6:0/1928166078 learned_addr learned my addr 172.21.15.6:0/1928166078 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.131+0000 7f658ce8a700 1 --2- 172.21.15.6:0/1928166078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f658815a030 0x7f6588158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.131+0000 7f65877fe700 1 --2- 172.21.15.6:0/1928166078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65880b21b0 0x7f6588158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.132+0000 7f6587fff700 1 -- 172.21.15.6:0/1928166078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65880b21b0 msgr2=0x7f6588158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.132+0000 7f6587fff700 1 --2- 172.21.15.6:0/1928166078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65880b21b0 0x7f6588158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.132+0000 7f6587fff700 1 -- 172.21.15.6:0/1928166078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f658815a030 msgr2=0x7f6588158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.132+0000 7f6587fff700 1 --2- 172.21.15.6:0/1928166078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f658815a030 0x7f6588158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.132+0000 7f6587fff700 1 -- 172.21.15.6:0/1928166078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c0094f0 con 0x7f6588086ff0 2023-10-06T02:24:43.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.132+0000 7f65877fe700 1 --2- 172.21.15.6:0/1928166078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65880b21b0 0x7f6588158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:43.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.132+0000 7f6587fff700 1 --2- 172.21.15.6:0/1928166078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588086ff0 0x7f6588145000 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f657800b610 tx=0x7f6578009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:43.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.132+0000 7f656ffff700 1 -- 172.21.15.6:0/1928166078 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657800f510 con 0x7f6588086ff0 2023-10-06T02:24:43.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.132+0000 7f656ffff700 1 -- 172.21.15.6:0/1928166078 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657800f6b0 con 0x7f6588086ff0 2023-10-06T02:24:43.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.132+0000 7f656ffff700 1 -- 172.21.15.6:0/1928166078 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657800fa70 con 0x7f6588086ff0 2023-10-06T02:24:43.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.132+0000 7f658e8ed700 1 -- 172.21.15.6:0/1928166078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f658816ad70 con 0x7f6588086ff0 2023-10-06T02:24:43.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.132+0000 7f658e8ed700 1 -- 172.21.15.6:0/1928166078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6588145540 con 0x7f6588086ff0 2023-10-06T02:24:43.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.133+0000 7f658e8ed700 1 -- 172.21.15.6:0/1928166078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6588088700 con 0x7f6588086ff0 2023-10-06T02:24:43.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.133+0000 7f656ffff700 1 -- 172.21.15.6:0/1928166078 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f657801a400 con 0x7f6588086ff0 2023-10-06T02:24:43.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.134+0000 7f656ffff700 1 --2- 172.21.15.6:0/1928166078 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6574066f30 0x7f65740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:43.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.134+0000 7f656ffff700 1 -- 172.21.15.6:0/1928166078 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6578084240 con 0x7f6588086ff0 2023-10-06T02:24:43.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.134+0000 7f65877fe700 1 --2- 172.21.15.6:0/1928166078 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6574066f30 0x7f65740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:43.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.135+0000 7f65877fe700 1 --2- 172.21.15.6:0/1928166078 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6574066f30 0x7f65740693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6588157800 tx=0x7f657c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:43.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.138+0000 7f656ffff700 1 -- 172.21.15.6:0/1928166078 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6578051290 con 0x7f6588086ff0 2023-10-06T02:24:43.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.377+0000 7f658e8ed700 1 -- 172.21.15.6:0/1928166078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f65880aff30 con 0x7f6588086ff0 2023-10-06T02:24:43.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.985+0000 7f656ffff700 1 -- 172.21.15.6:0/1928166078 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v86) v1 ==== 122+0+0 (secure 0 0 0) 0x7f65780548b0 con 0x7f6588086ff0 2023-10-06T02:24:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.988+0000 7f658e8ed700 1 -- 172.21.15.6:0/1928166078 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6574066f30 msgr2=0x7f65740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.988+0000 7f658e8ed700 1 --2- 172.21.15.6:0/1928166078 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6574066f30 0x7f65740693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6588157800 tx=0x7f657c016000 comp rx=0 tx=0).stop 2023-10-06T02:24:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.988+0000 7f658e8ed700 1 -- 172.21.15.6:0/1928166078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588086ff0 msgr2=0x7f6588145000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.988+0000 7f658e8ed700 1 --2- 172.21.15.6:0/1928166078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588086ff0 0x7f6588145000 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f657800b610 tx=0x7f6578009120 comp rx=0 tx=0).stop 2023-10-06T02:24:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.988+0000 7f658e8ed700 1 -- 172.21.15.6:0/1928166078 shutdown_connections 2023-10-06T02:24:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.988+0000 7f658e8ed700 1 --2- 172.21.15.6:0/1928166078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f658815a030 0x7f6588158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.988+0000 7f658e8ed700 1 --2- 172.21.15.6:0/1928166078 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6574066f30 0x7f65740693e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.988+0000 7f658e8ed700 1 --2- 172.21.15.6:0/1928166078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588086ff0 0x7f6588145000 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.988+0000 7f658e8ed700 1 --2- 172.21.15.6:0/1928166078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65880b21b0 0x7f6588158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.988+0000 7f658e8ed700 1 -- 172.21.15.6:0/1928166078 >> 172.21.15.6:0/1928166078 conn(0x7f6588068680 msgr2=0x7f65880cbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.988+0000 7f658e8ed700 1 -- 172.21.15.6:0/1928166078 shutdown_connections 2023-10-06T02:24:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:43.988+0000 7f658e8ed700 1 -- 172.21.15.6:0/1928166078 wait complete. 2023-10-06T02:24:44.004 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:44.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.128+0000 7f9e2c2ee700 1 Processor -- start 2023-10-06T02:24:44.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.128+0000 7f9e2c2ee700 1 -- start start 2023-10-06T02:24:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.128+0000 7f9e2c2ee700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e240af4e0 0x7f9e240b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.128+0000 7f9e2c2ee700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e2415e190 con 0x7f9e240af8b0 2023-10-06T02:24:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.128+0000 7f9e2c2ee700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e240cb650 con 0x7f9e2415db70 2023-10-06T02:24:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.128+0000 7f9e2c2ee700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e240b1910 con 0x7f9e240af4e0 2023-10-06T02:24:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.129+0000 7f9e29889700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9e240af8b0 0x7f9e2415d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43816/0 (socket says 172.21.15.6:43816) 2023-10-06T02:24:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.129+0000 7f9e29889700 1 -- 172.21.15.6:0/647356291 learned_addr learned my addr 172.21.15.6:0/647356291 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.129+0000 7f9e2a08a700 1 --2- 172.21.15.6:0/647356291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e240af4e0 0x7f9e240b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.129+0000 7f9e29088700 1 -- 172.21.15.6:0/647356291 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277095673 0 0) 0x7f9e2415e190 con 0x7f9e240af8b0 2023-10-06T02:24:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.129+0000 7f9e29088700 1 -- 172.21.15.6:0/647356291 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e0c003570 con 0x7f9e240af8b0 2023-10-06T02:24:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.129+0000 7f9e29088700 1 -- 172.21.15.6:0/647356291 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759811977 0 0) 0x7f9e240cb650 con 0x7f9e2415db70 2023-10-06T02:24:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.129+0000 7f9e29088700 1 -- 172.21.15.6:0/647356291 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e2415e190 con 0x7f9e2415db70 2023-10-06T02:24:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.129+0000 7f9e2a08a700 1 -- 172.21.15.6:0/647356291 >> v1:172.21.15.175:6789/0 conn(0x7f9e2415db70 legacy=0x7f9e240cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.129+0000 7f9e2a08a700 1 -- 172.21.15.6:0/647356291 >> v1:172.21.15.6:6789/0 conn(0x7f9e240af8b0 legacy=0x7f9e2415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.129+0000 7f9e29088700 1 -- 172.21.15.6:0/647356291 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4219008716 0 0) 0x7f9e0c003570 con 0x7f9e240af8b0 2023-10-06T02:24:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.129+0000 7f9e2a08a700 1 -- 172.21.15.6:0/647356291 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e240cad20 con 0x7f9e240af4e0 2023-10-06T02:24:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.129+0000 7f9e2a08a700 1 --2- 172.21.15.6:0/647356291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e240af4e0 0x7f9e240b20e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009910 tx=0x7f9e1c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaff16a676567c38 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.130+0000 7f9e29088700 1 -- 172.21.15.6:0/647356291 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18001470 con 0x7f9e240af4e0 2023-10-06T02:24:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.130+0000 7f9e29088700 1 -- 172.21.15.6:0/647356291 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c011420 con 0x7f9e240af4e0 2023-10-06T02:24:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.130+0000 7f9e29088700 1 -- 172.21.15.6:0/647356291 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c0117c0 con 0x7f9e240af4e0 2023-10-06T02:24:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.130+0000 7f9e2c2ee700 1 -- 172.21.15.6:0/647356291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e240af4e0 msgr2=0x7f9e240b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.130+0000 7f9e2c2ee700 1 --2- 172.21.15.6:0/647356291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e240af4e0 0x7f9e240b20e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009910 tx=0x7f9e1c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.130+0000 7f9e2c2ee700 1 -- 172.21.15.6:0/647356291 shutdown_connections 2023-10-06T02:24:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.130+0000 7f9e2c2ee700 1 --2- 172.21.15.6:0/647356291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e240af4e0 0x7f9e240b20e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.130+0000 7f9e2c2ee700 1 -- 172.21.15.6:0/647356291 >> 172.21.15.6:0/647356291 conn(0x7f9e24068680 msgr2=0x7f9e24068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.130+0000 7f9e2c2ee700 1 -- 172.21.15.6:0/647356291 shutdown_connections 2023-10-06T02:24:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.130+0000 7f9e2c2ee700 1 -- 172.21.15.6:0/647356291 wait complete. 2023-10-06T02:24:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.131+0000 7f9e2c2ee700 1 Processor -- start 2023-10-06T02:24:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.131+0000 7f9e2c2ee700 1 -- start start 2023-10-06T02:24:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.132+0000 7f9e2c2ee700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e240af4e0 0x7f9e240cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.132+0000 7f9e2c2ee700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e240af8b0 0x7f9e240ce360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.132+0000 7f9e2c2ee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2415db70 0x7f9e240cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.132+0000 7f9e2c2ee700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2415dfb0 con 0x7f9e2415db70 2023-10-06T02:24:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.132+0000 7f9e2c2ee700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e240ce8a0 con 0x7f9e240af8b0 2023-10-06T02:24:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.132+0000 7f9e2c2ee700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e240c8900 con 0x7f9e240af4e0 2023-10-06T02:24:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.132+0000 7f9e2a88b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2415db70 0x7f9e240cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.132+0000 7f9e2a88b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2415db70 0x7f9e240cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46244/0 (socket says 172.21.15.6:46244) 2023-10-06T02:24:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.132+0000 7f9e2a88b700 1 -- 172.21.15.6:0/172725053 learned_addr learned my addr 172.21.15.6:0/172725053 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.132+0000 7f9e29889700 1 --2- 172.21.15.6:0/172725053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e240af8b0 0x7f9e240ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.132+0000 7f9e2a08a700 1 --2- 172.21.15.6:0/172725053 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e240af4e0 0x7f9e240cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.132+0000 7f9e2a88b700 1 -- 172.21.15.6:0/172725053 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e240af4e0 msgr2=0x7f9e240cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.132+0000 7f9e2a88b700 1 --2- 172.21.15.6:0/172725053 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e240af4e0 0x7f9e240cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.132+0000 7f9e2a88b700 1 -- 172.21.15.6:0/172725053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e240af8b0 msgr2=0x7f9e240ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.132+0000 7f9e2a88b700 1 --2- 172.21.15.6:0/172725053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e240af8b0 0x7f9e240ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.132+0000 7f9e2a88b700 1 -- 172.21.15.6:0/172725053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c009420 con 0x7f9e2415db70 2023-10-06T02:24:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.133+0000 7f9e2a88b700 1 --2- 172.21.15.6:0/172725053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2415db70 0x7f9e240cfc90 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f9e1400c860 tx=0x7f9e14002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.133+0000 7f9e227fc700 1 -- 172.21.15.6:0/172725053 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e14002030 con 0x7f9e2415db70 2023-10-06T02:24:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.133+0000 7f9e227fc700 1 -- 172.21.15.6:0/172725053 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e140021b0 con 0x7f9e2415db70 2023-10-06T02:24:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.133+0000 7f9e2c2ee700 1 -- 172.21.15.6:0/172725053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e240c7cf0 con 0x7f9e2415db70 2023-10-06T02:24:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.133+0000 7f9e227fc700 1 -- 172.21.15.6:0/172725053 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e14012630 con 0x7f9e2415db70 2023-10-06T02:24:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.133+0000 7f9e2c2ee700 1 -- 172.21.15.6:0/172725053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e240c82b0 con 0x7f9e2415db70 2023-10-06T02:24:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.134+0000 7f9e2c2ee700 1 -- 172.21.15.6:0/172725053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e24088aa0 con 0x7f9e2415db70 2023-10-06T02:24:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.134+0000 7f9e227fc700 1 -- 172.21.15.6:0/172725053 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e14012a20 con 0x7f9e2415db70 2023-10-06T02:24:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.135+0000 7f9e227fc700 1 --2- 172.21.15.6:0/172725053 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e10066f30 0x7f9e100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.135+0000 7f9e227fc700 1 -- 172.21.15.6:0/172725053 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9e14084750 con 0x7f9e2415db70 2023-10-06T02:24:44.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.135+0000 7f9e2a08a700 1 --2- 172.21.15.6:0/172725053 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e10066f30 0x7f9e100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.135+0000 7f9e2a08a700 1 --2- 172.21.15.6:0/172725053 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e10066f30 0x7f9e100693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0030c0 tx=0x7f9e1c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.139+0000 7f9e227fc700 1 -- 172.21.15.6:0/172725053 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e14051720 con 0x7f9e2415db70 2023-10-06T02:24:44.299 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:24:44.298+0000 7f0aa0b2b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:24:44.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.377+0000 7f9e2c2ee700 1 -- 172.21.15.6:0/172725053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e240c8a40 con 0x7f9e2415db70 2023-10-06T02:24:44.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.377+0000 7f9e227fc700 1 -- 172.21.15.6:0/172725053 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f9e14054d40 con 0x7f9e2415db70 2023-10-06T02:24:44.379 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:44.379 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:24:43.983823+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7242":{"gid":7242,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":5,"addr":"172.21.15.6:6835/2846199049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2846199049},{"type":"v1","addr":"172.21.15.6:6835","nonce":2846199049}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:24:44.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.380+0000 7f9e2c2ee700 1 -- 172.21.15.6:0/172725053 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e10066f30 msgr2=0x7f9e100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.380+0000 7f9e2c2ee700 1 --2- 172.21.15.6:0/172725053 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e10066f30 0x7f9e100693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0030c0 tx=0x7f9e1c016000 comp rx=0 tx=0).stop 2023-10-06T02:24:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.380+0000 7f9e2c2ee700 1 -- 172.21.15.6:0/172725053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2415db70 msgr2=0x7f9e240cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.380+0000 7f9e2c2ee700 1 --2- 172.21.15.6:0/172725053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2415db70 0x7f9e240cfc90 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f9e1400c860 tx=0x7f9e14002700 comp rx=0 tx=0).stop 2023-10-06T02:24:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.380+0000 7f9e2c2ee700 1 -- 172.21.15.6:0/172725053 shutdown_connections 2023-10-06T02:24:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.380+0000 7f9e2c2ee700 1 --2- 172.21.15.6:0/172725053 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9e10066f30 0x7f9e100693e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.380+0000 7f9e2c2ee700 1 --2- 172.21.15.6:0/172725053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2415db70 0x7f9e240cfc90 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.380+0000 7f9e2c2ee700 1 --2- 172.21.15.6:0/172725053 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e240af4e0 0x7f9e240cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.380+0000 7f9e2c2ee700 1 --2- 172.21.15.6:0/172725053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e240af8b0 0x7f9e240ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.380+0000 7f9e2c2ee700 1 -- 172.21.15.6:0/172725053 >> 172.21.15.6:0/172725053 conn(0x7f9e24068680 msgr2=0x7f9e240b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.380+0000 7f9e2c2ee700 1 -- 172.21.15.6:0/172725053 shutdown_connections 2023-10-06T02:24:44.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.380+0000 7f9e2c2ee700 1 -- 172.21.15.6:0/172725053 wait complete. 2023-10-06T02:24:44.383 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 86 2023-10-06T02:24:44.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:44.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.510+0000 7eff0b81b700 1 Processor -- start 2023-10-06T02:24:44.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.511+0000 7eff0b81b700 1 -- start start 2023-10-06T02:24:44.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.511+0000 7eff0b81b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7eff040b3c50 0x7eff0415b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.511+0000 7eff0b81b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff0415bcd0 0x7eff0415a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.511+0000 7eff0b81b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff040afb90 con 0x7eff0415b3c0 2023-10-06T02:24:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.511+0000 7eff0b81b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff040b2310 con 0x7eff0415bcd0 2023-10-06T02:24:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.511+0000 7eff0b81b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff040b25f0 con 0x7eff040b3c50 2023-10-06T02:24:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.512+0000 7eff095b7700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7eff0415b3c0 0x7eff04097d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43818/0 (socket says 172.21.15.6:43818) 2023-10-06T02:24:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.512+0000 7eff09db8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff0415bcd0 0x7eff0415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.512+0000 7eff095b7700 1 -- 172.21.15.6:0/2002655447 learned_addr learned my addr 172.21.15.6:0/2002655447 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.512+0000 7eff08db6700 1 --2- 172.21.15.6:0/2002655447 >> v2:172.21.15.175:3300/0 conn(0x7eff040b3c50 0x7eff0415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.512+0000 7eff09db8700 1 -- 172.21.15.6:0/2002655447 >> v2:172.21.15.175:3300/0 conn(0x7eff040b3c50 msgr2=0x7eff0415b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.512+0000 7eff09db8700 1 --2- 172.21.15.6:0/2002655447 >> v2:172.21.15.175:3300/0 conn(0x7eff040b3c50 0x7eff0415b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.512+0000 7eff09db8700 1 -- 172.21.15.6:0/2002655447 >> v1:172.21.15.6:6789/0 conn(0x7eff0415b3c0 legacy=0x7eff04097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.512+0000 7eff03fff700 1 -- 172.21.15.6:0/2002655447 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1726839136 0 0) 0x7eff040afb90 con 0x7eff0415b3c0 2023-10-06T02:24:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.512+0000 7eff09db8700 1 -- 172.21.15.6:0/2002655447 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff040af820 con 0x7eff0415bcd0 2023-10-06T02:24:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.512+0000 7eff09db8700 1 --2- 172.21.15.6:0/2002655447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff0415bcd0 0x7eff0415a590 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7eff0406f9c0 tx=0x7efef40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bd0e0004d3ccde server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.512+0000 7eff03fff700 1 -- 172.21.15.6:0/2002655447 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef4011630 con 0x7eff0415bcd0 2023-10-06T02:24:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.512+0000 7eff03fff700 1 -- 172.21.15.6:0/2002655447 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef4011790 con 0x7eff0415bcd0 2023-10-06T02:24:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.512+0000 7eff03fff700 1 -- 172.21.15.6:0/2002655447 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef4011b30 con 0x7eff0415bcd0 2023-10-06T02:24:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.513+0000 7eff0b81b700 1 -- 172.21.15.6:0/2002655447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff0415bcd0 msgr2=0x7eff0415a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.513+0000 7eff0b81b700 1 --2- 172.21.15.6:0/2002655447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff0415bcd0 0x7eff0415a590 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7eff0406f9c0 tx=0x7efef40091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.513+0000 7eff0b81b700 1 -- 172.21.15.6:0/2002655447 shutdown_connections 2023-10-06T02:24:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.513+0000 7eff0b81b700 1 --2- 172.21.15.6:0/2002655447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff0415bcd0 0x7eff0415a590 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.513+0000 7eff0b81b700 1 --2- 172.21.15.6:0/2002655447 >> v2:172.21.15.175:3300/0 conn(0x7eff040b3c50 0x7eff0415b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.513+0000 7eff0b81b700 1 -- 172.21.15.6:0/2002655447 >> 172.21.15.6:0/2002655447 conn(0x7eff04067910 msgr2=0x7eff040ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.513+0000 7eff0b81b700 1 -- 172.21.15.6:0/2002655447 shutdown_connections 2023-10-06T02:24:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.513+0000 7eff0b81b700 1 -- 172.21.15.6:0/2002655447 wait complete. 2023-10-06T02:24:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.514+0000 7eff0b81b700 1 Processor -- start 2023-10-06T02:24:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.514+0000 7eff0b81b700 1 -- start start 2023-10-06T02:24:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff0b81b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff040b3c50 0x7eff040ce640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff0b81b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff0415b3c0 0x7eff04157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff0b81b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff0415bcd0 0x7eff040aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff0b81b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0409b010 con 0x7eff0415b3c0 2023-10-06T02:24:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff0b81b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0409bc50 con 0x7eff0415bcd0 2023-10-06T02:24:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff0b81b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0416b700 con 0x7eff040b3c50 2023-10-06T02:24:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff08db6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff0415b3c0 0x7eff04157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff08db6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff0415b3c0 0x7eff04157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46258/0 (socket says 172.21.15.6:46258) 2023-10-06T02:24:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff08db6700 1 -- 172.21.15.6:0/1594380672 learned_addr learned my addr 172.21.15.6:0/1594380672 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff095b7700 1 --2- 172.21.15.6:0/1594380672 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff040b3c50 0x7eff040ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff09db8700 1 --2- 172.21.15.6:0/1594380672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff0415bcd0 0x7eff040aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff08db6700 1 -- 172.21.15.6:0/1594380672 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff040b3c50 msgr2=0x7eff040ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff08db6700 1 --2- 172.21.15.6:0/1594380672 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff040b3c50 0x7eff040ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff08db6700 1 -- 172.21.15.6:0/1594380672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff0415bcd0 msgr2=0x7eff040aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff08db6700 1 --2- 172.21.15.6:0/1594380672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff0415bcd0 0x7eff040aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff08db6700 1 -- 172.21.15.6:0/1594380672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef4009420 con 0x7eff0415b3c0 2023-10-06T02:24:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff095b7700 1 --2- 172.21.15.6:0/1594380672 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff040b3c50 0x7eff040ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff09db8700 1 --2- 172.21.15.6:0/1594380672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff0415bcd0 0x7eff040aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.515+0000 7eff08db6700 1 --2- 172.21.15.6:0/1594380672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff0415b3c0 0x7eff04157600 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7efef800e930 tx=0x7efef80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.516+0000 7eff017fa700 1 -- 172.21.15.6:0/1594380672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef800eed0 con 0x7eff0415b3c0 2023-10-06T02:24:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.516+0000 7eff017fa700 1 -- 172.21.15.6:0/1594380672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef800c850 con 0x7eff0415b3c0 2023-10-06T02:24:44.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.516+0000 7eff0b81b700 1 -- 172.21.15.6:0/1594380672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0409a6e0 con 0x7eff0415b3c0 2023-10-06T02:24:44.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.516+0000 7eff017fa700 1 -- 172.21.15.6:0/1594380672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef800cbf0 con 0x7eff0415b3c0 2023-10-06T02:24:44.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.516+0000 7eff0b81b700 1 -- 172.21.15.6:0/1594380672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0409aca0 con 0x7eff0415b3c0 2023-10-06T02:24:44.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.517+0000 7eff0b81b700 1 -- 172.21.15.6:0/1594380672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0409ae60 con 0x7eff0415b3c0 2023-10-06T02:24:44.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.517+0000 7eff017fa700 1 -- 172.21.15.6:0/1594380672 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efef8013470 con 0x7eff0415b3c0 2023-10-06T02:24:44.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.517+0000 7eff017fa700 1 --2- 172.21.15.6:0/1594380672 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efef0066f30 0x7efef00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.517+0000 7eff017fa700 1 -- 172.21.15.6:0/1594380672 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6378+0+0 (secure 0 0 0) 0x7efef80849b0 con 0x7eff0415b3c0 2023-10-06T02:24:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.518+0000 7eff095b7700 1 --2- 172.21.15.6:0/1594380672 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efef0066f30 0x7efef00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.518+0000 7eff095b7700 1 --2- 172.21.15.6:0/1594380672 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efef0066f30 0x7efef00693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7efefc001f90 tx=0x7efefc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.522+0000 7eff017fa700 1 -- 172.21.15.6:0/1594380672 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efef8051980 con 0x7eff0415b3c0 2023-10-06T02:24:44.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.717+0000 7eff0b81b700 1 -- 172.21.15.6:0/1594380672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff0406e8d0 con 0x7eff0415b3c0 2023-10-06T02:24:44.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.718+0000 7eff017fa700 1 -- 172.21.15.6:0/1594380672 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+17026 (secure 0 0 0) 0x7efef8054fa0 con 0x7eff0415b3c0 2023-10-06T02:24:44.719 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:44.719 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":95,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:24:41.959791+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:38.117438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:39.346545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:44.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.720+0000 7eff0b81b700 1 -- 172.21.15.6:0/1594380672 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efef0066f30 msgr2=0x7efef00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.720+0000 7eff0b81b700 1 --2- 172.21.15.6:0/1594380672 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efef0066f30 0x7efef00693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7efefc001f90 tx=0x7efefc009040 comp rx=0 tx=0).stop 2023-10-06T02:24:44.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.720+0000 7eff0b81b700 1 -- 172.21.15.6:0/1594380672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff0415b3c0 msgr2=0x7eff04157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.720+0000 7eff0b81b700 1 --2- 172.21.15.6:0/1594380672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff0415b3c0 0x7eff04157600 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7efef800e930 tx=0x7efef80091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.720+0000 7eff0b81b700 1 -- 172.21.15.6:0/1594380672 shutdown_connections 2023-10-06T02:24:44.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.720+0000 7eff0b81b700 1 --2- 172.21.15.6:0/1594380672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff0415bcd0 0x7eff040aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.720+0000 7eff0b81b700 1 --2- 172.21.15.6:0/1594380672 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff040b3c50 0x7eff040ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.720+0000 7eff0b81b700 1 --2- 172.21.15.6:0/1594380672 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efef0066f30 0x7efef00693e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.720+0000 7eff0b81b700 1 --2- 172.21.15.6:0/1594380672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff0415b3c0 0x7eff04157600 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.720+0000 7eff0b81b700 1 -- 172.21.15.6:0/1594380672 >> 172.21.15.6:0/1594380672 conn(0x7eff04067910 msgr2=0x7eff0406cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:44.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.720+0000 7eff0b81b700 1 -- 172.21.15.6:0/1594380672 shutdown_connections 2023-10-06T02:24:44.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.720+0000 7eff0b81b700 1 -- 172.21.15.6:0/1594380672 wait complete. 2023-10-06T02:24:44.733 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:24:44.734 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:24:44.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.851+0000 7fc8279ae700 1 Processor -- start 2023-10-06T02:24:44.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.852+0000 7fc8279ae700 1 -- start start 2023-10-06T02:24:44.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.852+0000 7fc8279ae700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc8200b3c50 0x7fc82015b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.852+0000 7fc8279ae700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8200afb90 con 0x7fc82015b3c0 2023-10-06T02:24:44.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.852+0000 7fc8279ae700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8200b2310 con 0x7fc82015bcd0 2023-10-06T02:24:44.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.852+0000 7fc8279ae700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8200b25f0 con 0x7fc8200b3c50 2023-10-06T02:24:44.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.852+0000 7fc82574a700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc82015b3c0 0x7fc820097d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43820/0 (socket says 172.21.15.6:43820) 2023-10-06T02:24:44.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.852+0000 7fc82574a700 1 -- 172.21.15.6:0/1054330048 learned_addr learned my addr 172.21.15.6:0/1054330048 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:44.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc81ffff700 1 -- 172.21.15.6:0/1054330048 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4182151753 0 0) 0x7fc8200afb90 con 0x7fc82015b3c0 2023-10-06T02:24:44.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc824f49700 1 --2- 172.21.15.6:0/1054330048 >> v2:172.21.15.175:3300/0 conn(0x7fc8200b3c50 0x7fc82015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc81ffff700 1 -- 172.21.15.6:0/1054330048 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc808003570 con 0x7fc82015b3c0 2023-10-06T02:24:44.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc81ffff700 1 -- 172.21.15.6:0/1054330048 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 161038234 0 0) 0x7fc808003570 con 0x7fc82015b3c0 2023-10-06T02:24:44.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc81ffff700 1 -- 172.21.15.6:0/1054330048 >> v2:172.21.15.175:3300/0 conn(0x7fc8200b3c50 msgr2=0x7fc82015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:44.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc81ffff700 1 --2- 172.21.15.6:0/1054330048 >> v2:172.21.15.175:3300/0 conn(0x7fc8200b3c50 0x7fc82015b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc81ffff700 1 -- 172.21.15.6:0/1054330048 >> v1:172.21.15.175:6789/0 conn(0x7fc82015bcd0 legacy=0x7fc82015a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc81ffff700 1 -- 172.21.15.6:0/1054330048 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8200af820 con 0x7fc82015b3c0 2023-10-06T02:24:44.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc81ffff700 1 -- 172.21.15.6:0/1054330048 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fc8180015f0 con 0x7fc82015b3c0 2023-10-06T02:24:44.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc81ffff700 1 -- 172.21.15.6:0/1054330048 >> v1:172.21.15.6:6789/0 conn(0x7fc82015b3c0 legacy=0x7fc820097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc81ffff700 1 --2- 172.21.15.6:0/1054330048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc808003a60 0x7fc808003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc81ffff700 1 --2- 172.21.15.6:0/1054330048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc808004810 0x7fc808004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc81ffff700 1 --2- 172.21.15.6:0/1054330048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8080052e0 0x7fc80800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc81ffff700 1 -- 172.21.15.6:0/1054330048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8200b25f0 con 0x7fc808004810 2023-10-06T02:24:44.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc81ffff700 1 -- 172.21.15.6:0/1054330048 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80800c2a0 con 0x7fc8080052e0 2023-10-06T02:24:44.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc81ffff700 1 -- 172.21.15.6:0/1054330048 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80800c460 con 0x7fc808003a60 2023-10-06T02:24:44.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc824f49700 1 --2- 172.21.15.6:0/1054330048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc808004810 0x7fc808004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc825f4b700 1 --2- 172.21.15.6:0/1054330048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8080052e0 0x7fc80800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc82574a700 1 --2- 172.21.15.6:0/1054330048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc808003a60 0x7fc808003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc824f49700 1 -- 172.21.15.6:0/1054330048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc808003a60 msgr2=0x7fc808003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:44.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc824f49700 1 --2- 172.21.15.6:0/1054330048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc808003a60 0x7fc808003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc824f49700 1 -- 172.21.15.6:0/1054330048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8080052e0 msgr2=0x7fc80800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:44.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc824f49700 1 --2- 172.21.15.6:0/1054330048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8080052e0 0x7fc80800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc824f49700 1 -- 172.21.15.6:0/1054330048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc808003570 con 0x7fc808004810 2023-10-06T02:24:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.853+0000 7fc825f4b700 1 -- 172.21.15.6:0/1054330048 reap_dead start 2023-10-06T02:24:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.854+0000 7fc824f49700 1 --2- 172.21.15.6:0/1054330048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc808004810 0x7fc808004c80 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc814009c00 tx=0x7fc8140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540ec20a5990d35b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.854+0000 7fc81ffff700 1 -- 172.21.15.6:0/1054330048 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81400e710 con 0x7fc808004810 2023-10-06T02:24:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.854+0000 7fc81ffff700 1 -- 172.21.15.6:0/1054330048 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81400e870 con 0x7fc808004810 2023-10-06T02:24:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.854+0000 7fc81ffff700 1 -- 172.21.15.6:0/1054330048 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81400ec30 con 0x7fc808004810 2023-10-06T02:24:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.854+0000 7fc8279ae700 1 -- 172.21.15.6:0/1054330048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc808004810 msgr2=0x7fc808004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.854+0000 7fc8279ae700 1 --2- 172.21.15.6:0/1054330048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc808004810 0x7fc808004c80 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc814009c00 tx=0x7fc8140091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.854+0000 7fc8279ae700 1 -- 172.21.15.6:0/1054330048 shutdown_connections 2023-10-06T02:24:44.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.854+0000 7fc8279ae700 1 --2- 172.21.15.6:0/1054330048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc808004810 0x7fc808004c80 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.854+0000 7fc8279ae700 1 -- 172.21.15.6:0/1054330048 >> 172.21.15.6:0/1054330048 conn(0x7fc820067910 msgr2=0x7fc8200ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:44.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.854+0000 7fc8279ae700 1 -- 172.21.15.6:0/1054330048 shutdown_connections 2023-10-06T02:24:44.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.855+0000 7fc8279ae700 1 -- 172.21.15.6:0/1054330048 wait complete. 2023-10-06T02:24:44.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.856+0000 7fc8279ae700 1 Processor -- start 2023-10-06T02:24:44.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.856+0000 7fc8279ae700 1 -- start start 2023-10-06T02:24:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.856+0000 7fc8279ae700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc808004810 0x7fc82016b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.856+0000 7fc8279ae700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8200ce790 0x7fc82006d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.856+0000 7fc8279ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc82006dd60 0x7fc8200abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.856+0000 7fc8279ae700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82016bef0 con 0x7fc82006dd60 2023-10-06T02:24:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.856+0000 7fc8279ae700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82006e1e0 con 0x7fc808004810 2023-10-06T02:24:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.856+0000 7fc8279ae700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc820099600 con 0x7fc8200ce790 2023-10-06T02:24:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.857+0000 7fc825f4b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc82006dd60 0x7fc8200abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.857+0000 7fc825f4b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc82006dd60 0x7fc8200abef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46280/0 (socket says 172.21.15.6:46280) 2023-10-06T02:24:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.857+0000 7fc825f4b700 1 -- 172.21.15.6:0/231357446 learned_addr learned my addr 172.21.15.6:0/231357446 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.857+0000 7fc82574a700 1 --2- 172.21.15.6:0/231357446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc808004810 0x7fc82016b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.857+0000 7fc824f49700 1 --2- 172.21.15.6:0/231357446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8200ce790 0x7fc82006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.857+0000 7fc825f4b700 1 -- 172.21.15.6:0/231357446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8200ce790 msgr2=0x7fc82006d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.857+0000 7fc825f4b700 1 --2- 172.21.15.6:0/231357446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8200ce790 0x7fc82006d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.857+0000 7fc825f4b700 1 -- 172.21.15.6:0/231357446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc808004810 msgr2=0x7fc82016b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.857+0000 7fc825f4b700 1 --2- 172.21.15.6:0/231357446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc808004810 0x7fc82016b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.857+0000 7fc825f4b700 1 -- 172.21.15.6:0/231357446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8200998e0 con 0x7fc82006dd60 2023-10-06T02:24:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.857+0000 7fc825f4b700 1 --2- 172.21.15.6:0/231357446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc82006dd60 0x7fc8200abef0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fc8200ad650 tx=0x7fc810009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.857+0000 7fc81d7fa700 1 -- 172.21.15.6:0/231357446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810006db0 con 0x7fc82006dd60 2023-10-06T02:24:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.857+0000 7fc81d7fa700 1 -- 172.21.15.6:0/231357446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc810003030 con 0x7fc82006dd60 2023-10-06T02:24:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.857+0000 7fc8279ae700 1 -- 172.21.15.6:0/231357446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc820099bc0 con 0x7fc82006dd60 2023-10-06T02:24:44.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.857+0000 7fc81d7fa700 1 -- 172.21.15.6:0/231357446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8100033d0 con 0x7fc82006dd60 2023-10-06T02:24:44.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.857+0000 7fc8279ae700 1 -- 172.21.15.6:0/231357446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82009a180 con 0x7fc82006dd60 2023-10-06T02:24:44.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.858+0000 7fc8279ae700 1 -- 172.21.15.6:0/231357446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82009a3a0 con 0x7fc82006dd60 2023-10-06T02:24:44.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.859+0000 7fc81d7fa700 1 -- 172.21.15.6:0/231357446 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc810001790 con 0x7fc82006dd60 2023-10-06T02:24:44.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.859+0000 7fc81d7fa700 1 --2- 172.21.15.6:0/231357446 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc80c066f30 0x7fc80c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.859+0000 7fc81d7fa700 1 -- 172.21.15.6:0/231357446 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc810083a90 con 0x7fc82006dd60 2023-10-06T02:24:44.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.859+0000 7fc82574a700 1 --2- 172.21.15.6:0/231357446 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc80c066f30 0x7fc80c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.860+0000 7fc82574a700 1 --2- 172.21.15.6:0/231357446 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc80c066f30 0x7fc80c0693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc818000ef0 tx=0x7fc818009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:44.863+0000 7fc81d7fa700 1 -- 172.21.15.6:0/231357446 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc810050a60 con 0x7fc82006dd60 2023-10-06T02:24:45.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.051+0000 7fc8279ae700 1 -- 172.21.15.6:0/231357446 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc82006e8d0 con 0x7fc80c066f30 2023-10-06T02:24:45.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.060+0000 7fc81d7fa700 1 -- 172.21.15.6:0/231357446 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308642 (secure 0 0 0) 0x7fc82006e8d0 con 0x7fc80c066f30 2023-10-06T02:24:45.067 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:45.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.064+0000 7fc8279ae700 1 -- 172.21.15.6:0/231357446 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc80c066f30 msgr2=0x7fc80c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:45.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.064+0000 7fc8279ae700 1 --2- 172.21.15.6:0/231357446 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc80c066f30 0x7fc80c0693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc818000ef0 tx=0x7fc818009040 comp rx=0 tx=0).stop 2023-10-06T02:24:45.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.064+0000 7fc8279ae700 1 -- 172.21.15.6:0/231357446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc82006dd60 msgr2=0x7fc8200abef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:45.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.064+0000 7fc8279ae700 1 --2- 172.21.15.6:0/231357446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc82006dd60 0x7fc8200abef0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fc8200ad650 tx=0x7fc810009040 comp rx=0 tx=0).stop 2023-10-06T02:24:45.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.064+0000 7fc8279ae700 1 -- 172.21.15.6:0/231357446 shutdown_connections 2023-10-06T02:24:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.064+0000 7fc8279ae700 1 --2- 172.21.15.6:0/231357446 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc80c066f30 0x7fc80c0693e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.064+0000 7fc8279ae700 1 --2- 172.21.15.6:0/231357446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc82006dd60 0x7fc8200abef0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.064+0000 7fc8279ae700 1 --2- 172.21.15.6:0/231357446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc808004810 0x7fc82016b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.064+0000 7fc8279ae700 1 --2- 172.21.15.6:0/231357446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8200ce790 0x7fc82006d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.064+0000 7fc8279ae700 1 -- 172.21.15.6:0/231357446 >> 172.21.15.6:0/231357446 conn(0x7fc820067910 msgr2=0x7fc8201580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.064+0000 7fc8279ae700 1 -- 172.21.15.6:0/231357446 shutdown_connections 2023-10-06T02:24:45.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.064+0000 7fc8279ae700 1 -- 172.21.15.6:0/231357446 wait complete. 2023-10-06T02:24:45.072 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:24:45.077 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2023-10-06T02:24:44.664828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2388388,"kb_used_data":10084,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752586332,"statfs":{"total":773094113280,"available":770648403968,"internally_reserved":0,"allocated":10326016,"data_stored":5577165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.710250"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962840+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:35.595154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966341+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.611329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962972+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:08.104824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.970819+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.968616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966809+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:48.691542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.967399+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:48.691542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964865+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:25.853328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962939+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:18.986033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.969406+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:25.296557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965643+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:16.889594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968341+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:05.568051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966059+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:54.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.972145+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:07.298300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.967417+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:58:10.688548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965936+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:56.221122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964954+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:09.927108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962853+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:07.518324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966367+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:31.150685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.969657+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:54.410478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964850+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:56.733610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964892+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:57.079752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962667+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:35.995255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.961747+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:24.399041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964471+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:16.889594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964276+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:39.056675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964670+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:35:37.491221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.969221+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:31.150685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.969607+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:51.110568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.963406+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:21.894393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966049+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.756486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965429+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:56.791580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964023+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:45.635203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.967322+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:05.195018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.975085+0000","last_change":"2023-10-06T02:24:39.975085+0000","last_active":"2023-10-06T02:24:39.975085+0000","last_peered":"2023-10-06T02:24:39.975085+0000","last_clean":"2023-10-06T02:24:39.975085+0000","last_became_active":"2023-10-06T02:24:39.974819+0000","last_became_peered":"2023-10-06T02:24:39.974819+0000","last_unstale":"2023-10-06T02:24:39.975085+0000","last_undegraded":"2023-10-06T02:24:39.975085+0000","last_fullsized":"2023-10-06T02:24:39.975085+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:22.010699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.970382+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:56.817052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.974072+0000","last_change":"2023-10-06T02:24:39.974072+0000","last_active":"2023-10-06T02:24:39.974072+0000","last_peered":"2023-10-06T02:24:39.974072+0000","last_clean":"2023-10-06T02:24:39.974072+0000","last_became_active":"2023-10-06T02:24:39.973802+0000","last_became_peered":"2023-10-06T02:24:39.973802+0000","last_unstale":"2023-10-06T02:24:39.974072+0000","last_undegraded":"2023-10-06T02:24:39.974072+0000","last_fullsized":"2023-10-06T02:24:39.974072+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:43.496803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962729+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:05.211450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.980152+0000","last_change":"2023-10-06T02:24:39.980152+0000","last_active":"2023-10-06T02:24:39.980152+0000","last_peered":"2023-10-06T02:24:39.980152+0000","last_clean":"2023-10-06T02:24:39.980152+0000","last_became_active":"2023-10-06T02:24:39.979853+0000","last_became_peered":"2023-10-06T02:24:39.979853+0000","last_unstale":"2023-10-06T02:24:39.980152+0000","last_undegraded":"2023-10-06T02:24:39.980152+0000","last_fullsized":"2023-10-06T02:24:39.980152+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:59.113041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964790+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:04.227594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976301+0000","last_change":"2023-10-06T02:24:39.976301+0000","last_active":"2023-10-06T02:24:39.976301+0000","last_peered":"2023-10-06T02:24:39.976301+0000","last_clean":"2023-10-06T02:24:39.976301+0000","last_became_active":"2023-10-06T02:24:39.976036+0000","last_became_peered":"2023-10-06T02:24:39.976036+0000","last_unstale":"2023-10-06T02:24:39.976301+0000","last_undegraded":"2023-10-06T02:24:39.976301+0000","last_fullsized":"2023-10-06T02:24:39.976301+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:23.302126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.963756+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:49.244903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973206+0000","last_change":"2023-10-06T02:24:39.973206+0000","last_active":"2023-10-06T02:24:39.973206+0000","last_peered":"2023-10-06T02:24:39.973206+0000","last_clean":"2023-10-06T02:24:39.973206+0000","last_became_active":"2023-10-06T02:24:39.972964+0000","last_became_peered":"2023-10-06T02:24:39.972964+0000","last_unstale":"2023-10-06T02:24:39.973206+0000","last_undegraded":"2023-10-06T02:24:39.973206+0000","last_fullsized":"2023-10-06T02:24:39.973206+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:52.898248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964280+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:17.082986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.972655+0000","last_change":"2023-10-06T02:24:39.972655+0000","last_active":"2023-10-06T02:24:39.972655+0000","last_peered":"2023-10-06T02:24:39.972655+0000","last_clean":"2023-10-06T02:24:39.972655+0000","last_became_active":"2023-10-06T02:24:39.972305+0000","last_became_peered":"2023-10-06T02:24:39.972305+0000","last_unstale":"2023-10-06T02:24:39.972655+0000","last_undegraded":"2023-10-06T02:24:39.972655+0000","last_fullsized":"2023-10-06T02:24:39.972655+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:24.291593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965608+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:34:44.335946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.971205+0000","last_change":"2023-10-06T02:24:39.971205+0000","last_active":"2023-10-06T02:24:39.971205+0000","last_peered":"2023-10-06T02:24:39.971205+0000","last_clean":"2023-10-06T02:24:39.971205+0000","last_became_active":"2023-10-06T02:24:39.970966+0000","last_became_peered":"2023-10-06T02:24:39.970966+0000","last_unstale":"2023-10-06T02:24:39.971205+0000","last_undegraded":"2023-10-06T02:24:39.971205+0000","last_fullsized":"2023-10-06T02:24:39.971205+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:18.974316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964043+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:23.015663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.981399+0000","last_change":"2023-10-06T02:24:39.981399+0000","last_active":"2023-10-06T02:24:39.981399+0000","last_peered":"2023-10-06T02:24:39.981399+0000","last_clean":"2023-10-06T02:24:39.981399+0000","last_became_active":"2023-10-06T02:24:39.979589+0000","last_became_peered":"2023-10-06T02:24:39.979589+0000","last_unstale":"2023-10-06T02:24:39.981399+0000","last_undegraded":"2023-10-06T02:24:39.981399+0000","last_fullsized":"2023-10-06T02:24:39.981399+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:11.530446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965410+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:27.723364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.971985+0000","last_change":"2023-10-06T02:24:39.971985+0000","last_active":"2023-10-06T02:24:39.971985+0000","last_peered":"2023-10-06T02:24:39.971985+0000","last_clean":"2023-10-06T02:24:39.971985+0000","last_became_active":"2023-10-06T02:24:39.971728+0000","last_became_peered":"2023-10-06T02:24:39.971728+0000","last_unstale":"2023-10-06T02:24:39.971985+0000","last_undegraded":"2023-10-06T02:24:39.971985+0000","last_fullsized":"2023-10-06T02:24:39.971985+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:09.608799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968917+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:40.143074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.980911+0000","last_change":"2023-10-06T02:24:39.980911+0000","last_active":"2023-10-06T02:24:39.980911+0000","last_peered":"2023-10-06T02:24:39.980911+0000","last_clean":"2023-10-06T02:24:39.980911+0000","last_became_active":"2023-10-06T02:24:39.980544+0000","last_became_peered":"2023-10-06T02:24:39.980544+0000","last_unstale":"2023-10-06T02:24:39.980911+0000","last_undegraded":"2023-10-06T02:24:39.980911+0000","last_fullsized":"2023-10-06T02:24:39.980911+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:50.105604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966347+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:09.927108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976365+0000","last_change":"2023-10-06T02:24:39.976365+0000","last_active":"2023-10-06T02:24:39.976365+0000","last_peered":"2023-10-06T02:24:39.976365+0000","last_clean":"2023-10-06T02:24:39.976365+0000","last_became_active":"2023-10-06T02:24:39.976088+0000","last_became_peered":"2023-10-06T02:24:39.976088+0000","last_unstale":"2023-10-06T02:24:39.976365+0000","last_undegraded":"2023-10-06T02:24:39.976365+0000","last_fullsized":"2023-10-06T02:24:39.976365+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:24.102710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968759+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:16.842155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.979144+0000","last_change":"2023-10-06T02:24:39.979144+0000","last_active":"2023-10-06T02:24:39.979144+0000","last_peered":"2023-10-06T02:24:39.979144+0000","last_clean":"2023-10-06T02:24:39.979144+0000","last_became_active":"2023-10-06T02:24:39.978902+0000","last_became_peered":"2023-10-06T02:24:39.978902+0000","last_unstale":"2023-10-06T02:24:39.979144+0000","last_undegraded":"2023-10-06T02:24:39.979144+0000","last_fullsized":"2023-10-06T02:24:39.979144+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:13.533579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966425+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:03.453032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976840+0000","last_change":"2023-10-06T02:24:39.976840+0000","last_active":"2023-10-06T02:24:39.976840+0000","last_peered":"2023-10-06T02:24:39.976840+0000","last_clean":"2023-10-06T02:24:39.976840+0000","last_became_active":"2023-10-06T02:24:39.976430+0000","last_became_peered":"2023-10-06T02:24:39.976430+0000","last_unstale":"2023-10-06T02:24:39.976840+0000","last_undegraded":"2023-10-06T02:24:39.976840+0000","last_fullsized":"2023-10-06T02:24:39.976840+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:07.627361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.961747+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:48.724533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.984134+0000","last_change":"2023-10-06T02:24:39.984134+0000","last_active":"2023-10-06T02:24:39.984134+0000","last_peered":"2023-10-06T02:24:39.984134+0000","last_clean":"2023-10-06T02:24:39.984134+0000","last_became_active":"2023-10-06T02:24:39.983937+0000","last_became_peered":"2023-10-06T02:24:39.983937+0000","last_unstale":"2023-10-06T02:24:39.984134+0000","last_undegraded":"2023-10-06T02:24:39.984134+0000","last_fullsized":"2023-10-06T02:24:39.984134+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:00.166209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968317+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:24.307089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.975251+0000","last_change":"2023-10-06T02:24:39.975251+0000","last_active":"2023-10-06T02:24:39.975251+0000","last_peered":"2023-10-06T02:24:39.975251+0000","last_clean":"2023-10-06T02:24:39.975251+0000","last_became_active":"2023-10-06T02:24:39.974945+0000","last_became_peered":"2023-10-06T02:24:39.974945+0000","last_unstale":"2023-10-06T02:24:39.975251+0000","last_undegraded":"2023-10-06T02:24:39.975251+0000","last_fullsized":"2023-10-06T02:24:39.975251+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:06.293337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964527+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:24.682393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.970516+0000","last_change":"2023-10-06T02:24:39.970516+0000","last_active":"2023-10-06T02:24:39.970516+0000","last_peered":"2023-10-06T02:24:39.970516+0000","last_clean":"2023-10-06T02:24:39.970516+0000","last_became_active":"2023-10-06T02:24:39.970272+0000","last_became_peered":"2023-10-06T02:24:39.970272+0000","last_unstale":"2023-10-06T02:24:39.970516+0000","last_undegraded":"2023-10-06T02:24:39.970516+0000","last_fullsized":"2023-10-06T02:24:39.970516+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:17.651579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965916+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:33.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976424+0000","last_change":"2023-10-06T02:24:39.976424+0000","last_active":"2023-10-06T02:24:39.976424+0000","last_peered":"2023-10-06T02:24:39.976424+0000","last_clean":"2023-10-06T02:24:39.976424+0000","last_became_active":"2023-10-06T02:24:39.976136+0000","last_became_peered":"2023-10-06T02:24:39.976136+0000","last_unstale":"2023-10-06T02:24:39.976424+0000","last_undegraded":"2023-10-06T02:24:39.976424+0000","last_fullsized":"2023-10-06T02:24:39.976424+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:42.794495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962345+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:32.991704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.979586+0000","last_change":"2023-10-06T02:24:39.979586+0000","last_active":"2023-10-06T02:24:39.979586+0000","last_peered":"2023-10-06T02:24:39.979586+0000","last_clean":"2023-10-06T02:24:39.979586+0000","last_became_active":"2023-10-06T02:24:39.979318+0000","last_became_peered":"2023-10-06T02:24:39.979318+0000","last_unstale":"2023-10-06T02:24:39.979586+0000","last_undegraded":"2023-10-06T02:24:39.979586+0000","last_fullsized":"2023-10-06T02:24:39.979586+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:03.222631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962263+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:54.104551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976072+0000","last_change":"2023-10-06T02:24:39.976072+0000","last_active":"2023-10-06T02:24:39.976072+0000","last_peered":"2023-10-06T02:24:39.976072+0000","last_clean":"2023-10-06T02:24:39.976072+0000","last_became_active":"2023-10-06T02:24:39.975779+0000","last_became_peered":"2023-10-06T02:24:39.975779+0000","last_unstale":"2023-10-06T02:24:39.976072+0000","last_undegraded":"2023-10-06T02:24:39.976072+0000","last_fullsized":"2023-10-06T02:24:39.976072+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:39.138110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966116+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:25.853328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973897+0000","last_change":"2023-10-06T02:24:39.973897+0000","last_active":"2023-10-06T02:24:39.973897+0000","last_peered":"2023-10-06T02:24:39.973897+0000","last_clean":"2023-10-06T02:24:39.973897+0000","last_became_active":"2023-10-06T02:24:39.973571+0000","last_became_peered":"2023-10-06T02:24:39.973571+0000","last_unstale":"2023-10-06T02:24:39.973897+0000","last_undegraded":"2023-10-06T02:24:39.973897+0000","last_fullsized":"2023-10-06T02:24:39.973897+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:29.040516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966502+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:30.709839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.974701+0000","last_change":"2023-10-06T02:24:39.974701+0000","last_active":"2023-10-06T02:24:39.974701+0000","last_peered":"2023-10-06T02:24:39.974701+0000","last_clean":"2023-10-06T02:24:39.974701+0000","last_became_active":"2023-10-06T02:24:39.974430+0000","last_became_peered":"2023-10-06T02:24:39.974430+0000","last_unstale":"2023-10-06T02:24:39.974701+0000","last_undegraded":"2023-10-06T02:24:39.974701+0000","last_fullsized":"2023-10-06T02:24:39.974701+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:48.940881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964494+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:00.118004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973724+0000","last_change":"2023-10-06T02:24:39.973724+0000","last_active":"2023-10-06T02:24:39.973724+0000","last_peered":"2023-10-06T02:24:39.973724+0000","last_clean":"2023-10-06T02:24:39.973724+0000","last_became_active":"2023-10-06T02:24:39.973431+0000","last_became_peered":"2023-10-06T02:24:39.973431+0000","last_unstale":"2023-10-06T02:24:39.973724+0000","last_undegraded":"2023-10-06T02:24:39.973724+0000","last_fullsized":"2023-10-06T02:24:39.973724+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:06.522727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968695+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:10:33.809744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.985278+0000","last_change":"2023-10-06T02:24:39.985278+0000","last_active":"2023-10-06T02:24:39.985278+0000","last_peered":"2023-10-06T02:24:39.985278+0000","last_clean":"2023-10-06T02:24:39.985278+0000","last_became_active":"2023-10-06T02:24:39.985020+0000","last_became_peered":"2023-10-06T02:24:39.985020+0000","last_unstale":"2023-10-06T02:24:39.985278+0000","last_undegraded":"2023-10-06T02:24:39.985278+0000","last_fullsized":"2023-10-06T02:24:39.985278+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:04.563087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.963647+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:46.230022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976021+0000","last_change":"2023-10-06T02:24:39.976021+0000","last_active":"2023-10-06T02:24:39.976021+0000","last_peered":"2023-10-06T02:24:39.976021+0000","last_clean":"2023-10-06T02:24:39.976021+0000","last_became_active":"2023-10-06T02:24:39.975772+0000","last_became_peered":"2023-10-06T02:24:39.975772+0000","last_unstale":"2023-10-06T02:24:39.976021+0000","last_undegraded":"2023-10-06T02:24:39.976021+0000","last_fullsized":"2023-10-06T02:24:39.976021+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:19.298438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965960+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:31.994955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973641+0000","last_change":"2023-10-06T02:24:39.973641+0000","last_active":"2023-10-06T02:24:39.973641+0000","last_peered":"2023-10-06T02:24:39.973641+0000","last_clean":"2023-10-06T02:24:39.973641+0000","last_became_active":"2023-10-06T02:24:39.973198+0000","last_became_peered":"2023-10-06T02:24:39.973198+0000","last_unstale":"2023-10-06T02:24:39.973641+0000","last_undegraded":"2023-10-06T02:24:39.973641+0000","last_fullsized":"2023-10-06T02:24:39.973641+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:14.807923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.962764+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:24:38.962764+0000","last_peered":"2023-10-06T02:24:38.962764+0000","last_clean":"2023-10-06T02:24:38.962764+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:24:38.962764+0000","last_undegraded":"2023-10-06T02:24:38.962764+0000","last_fullsized":"2023-10-06T02:24:38.962764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966929+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:11.588397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.979843+0000","last_change":"2023-10-06T02:24:39.979843+0000","last_active":"2023-10-06T02:24:39.979843+0000","last_peered":"2023-10-06T02:24:39.979843+0000","last_clean":"2023-10-06T02:24:39.979843+0000","last_became_active":"2023-10-06T02:24:39.979522+0000","last_became_peered":"2023-10-06T02:24:39.979522+0000","last_unstale":"2023-10-06T02:24:39.979843+0000","last_undegraded":"2023-10-06T02:24:39.979843+0000","last_fullsized":"2023-10-06T02:24:39.979843+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:55.728646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.955617+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:24:38.955617+0000","last_peered":"2023-10-06T02:24:38.955617+0000","last_clean":"2023-10-06T02:24:38.955617+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:24:38.955617+0000","last_undegraded":"2023-10-06T02:24:38.955617+0000","last_fullsized":"2023-10-06T02:24:38.955617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.967822+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:34.541182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976127+0000","last_change":"2023-10-06T02:24:39.976127+0000","last_active":"2023-10-06T02:24:39.976127+0000","last_peered":"2023-10-06T02:24:39.976127+0000","last_clean":"2023-10-06T02:24:39.976127+0000","last_became_active":"2023-10-06T02:24:39.975820+0000","last_became_peered":"2023-10-06T02:24:39.975820+0000","last_unstale":"2023-10-06T02:24:39.976127+0000","last_undegraded":"2023-10-06T02:24:39.976127+0000","last_fullsized":"2023-10-06T02:24:39.976127+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:53.313940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":78,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.963345+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:24:38.963345+0000","last_peered":"2023-10-06T02:24:38.963345+0000","last_clean":"2023-10-06T02:24:38.963345+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:24:38.963345+0000","last_undegraded":"2023-10-06T02:24:38.963345+0000","last_fullsized":"2023-10-06T02:24:38.963345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":227,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.958954+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:24:38.958954+0000","last_peered":"2023-10-06T02:24:38.958954+0000","last_clean":"2023-10-06T02:24:38.958954+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:24:38.958954+0000","last_undegraded":"2023-10-06T02:24:38.958954+0000","last_fullsized":"2023-10-06T02:24:38.958954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965674+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:54.235961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.974456+0000","last_change":"2023-10-06T02:24:39.974456+0000","last_active":"2023-10-06T02:24:39.974456+0000","last_peered":"2023-10-06T02:24:39.974456+0000","last_clean":"2023-10-06T02:24:39.974456+0000","last_became_active":"2023-10-06T02:24:39.974171+0000","last_became_peered":"2023-10-06T02:24:39.974171+0000","last_unstale":"2023-10-06T02:24:39.974456+0000","last_undegraded":"2023-10-06T02:24:39.974456+0000","last_fullsized":"2023-10-06T02:24:39.974456+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:24.102710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.958886+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:24:38.958886+0000","last_peered":"2023-10-06T02:24:38.958886+0000","last_clean":"2023-10-06T02:24:38.958886+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:24:38.958886+0000","last_undegraded":"2023-10-06T02:24:38.958886+0000","last_fullsized":"2023-10-06T02:24:38.958886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966875+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.386207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.974763+0000","last_change":"2023-10-06T02:24:39.974763+0000","last_active":"2023-10-06T02:24:39.974763+0000","last_peered":"2023-10-06T02:24:39.974763+0000","last_clean":"2023-10-06T02:24:39.974763+0000","last_became_active":"2023-10-06T02:24:39.974488+0000","last_became_peered":"2023-10-06T02:24:39.974488+0000","last_unstale":"2023-10-06T02:24:39.974763+0000","last_undegraded":"2023-10-06T02:24:39.974763+0000","last_fullsized":"2023-10-06T02:24:39.974763+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:06.522727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.958855+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:24:38.958855+0000","last_peered":"2023-10-06T02:24:38.958855+0000","last_clean":"2023-10-06T02:24:38.958855+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:24:38.958855+0000","last_undegraded":"2023-10-06T02:24:38.958855+0000","last_fullsized":"2023-10-06T02:24:38.958855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966207+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:17.082986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.978145+0000","last_change":"2023-10-06T02:24:39.978145+0000","last_active":"2023-10-06T02:24:39.978145+0000","last_peered":"2023-10-06T02:24:39.978145+0000","last_clean":"2023-10-06T02:24:39.978145+0000","last_became_active":"2023-10-06T02:24:39.977744+0000","last_became_peered":"2023-10-06T02:24:39.977744+0000","last_unstale":"2023-10-06T02:24:39.978145+0000","last_undegraded":"2023-10-06T02:24:39.978145+0000","last_fullsized":"2023-10-06T02:24:39.978145+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:49.822349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.965535+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:24:38.965535+0000","last_peered":"2023-10-06T02:24:38.965535+0000","last_clean":"2023-10-06T02:24:38.965535+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:24:38.965535+0000","last_undegraded":"2023-10-06T02:24:38.965535+0000","last_fullsized":"2023-10-06T02:24:38.965535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968249+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:15.763729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.977321+0000","last_change":"2023-10-06T02:24:39.977321+0000","last_active":"2023-10-06T02:24:39.977321+0000","last_peered":"2023-10-06T02:24:39.977321+0000","last_clean":"2023-10-06T02:24:39.977321+0000","last_became_active":"2023-10-06T02:24:39.977039+0000","last_became_peered":"2023-10-06T02:24:39.977039+0000","last_unstale":"2023-10-06T02:24:39.977321+0000","last_undegraded":"2023-10-06T02:24:39.977321+0000","last_fullsized":"2023-10-06T02:24:39.977321+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:56.670718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.960197+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:24:38.960197+0000","last_peered":"2023-10-06T02:24:38.960197+0000","last_clean":"2023-10-06T02:24:38.960197+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:24:38.960197+0000","last_undegraded":"2023-10-06T02:24:38.960197+0000","last_fullsized":"2023-10-06T02:24:38.960197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965895+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:34.541182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973325+0000","last_change":"2023-10-06T02:24:39.973325+0000","last_active":"2023-10-06T02:24:39.973325+0000","last_peered":"2023-10-06T02:24:39.973325+0000","last_clean":"2023-10-06T02:24:39.973325+0000","last_became_active":"2023-10-06T02:24:39.973093+0000","last_became_peered":"2023-10-06T02:24:39.973093+0000","last_unstale":"2023-10-06T02:24:39.973325+0000","last_undegraded":"2023-10-06T02:24:39.973325+0000","last_fullsized":"2023-10-06T02:24:39.973325+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:57.861496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.960200+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:24:38.960200+0000","last_peered":"2023-10-06T02:24:38.960200+0000","last_clean":"2023-10-06T02:24:38.960200+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:24:38.960200+0000","last_undegraded":"2023-10-06T02:24:38.960200+0000","last_fullsized":"2023-10-06T02:24:38.960200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298988,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072852,"statfs":{"total":96636764160,"available":96330600448,"internally_reserved":0,"allocated":1740800,"data_stored":1142013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.505},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70899999999999996,"5min":0.79700000000000004,"15min":1.111},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.495},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.83299999999999996,"15min":0.97899999999999998},"last":0.75700000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55600000000000005,"15min":0.51800000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.86299999999999999,"15min":1.008},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.51700000000000002},"min":{"1min":0.371,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79100000000000004,"5min":0.81000000000000005,"15min":1.075},"last":0.58599999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":0.83499999999999996,"15min":1.149},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.623,"15min":0.58299999999999996},"min":{"1min":0.443,"5min":0.41199999999999998,"15min":0.38800000000000001},"max":{"1min":0.80300000000000005,"5min":0.81399999999999995,"15min":1.048},"last":0.73599999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.41199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.75800000000000001,"5min":0.79200000000000004,"15min":1.175},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60499999999999998,"15min":0.57299999999999995},"min":{"1min":0.44900000000000001,"5min":0.41199999999999998,"15min":0.36799999999999999},"max":{"1min":0.70799999999999996,"5min":0.83799999999999997,"15min":1.03},"last":0.77600000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48299999999999998,"15min":0.48599999999999999},"min":{"1min":0.33900000000000002,"5min":0.30399999999999999,"15min":0.29299999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.873},"last":0.437},{"interface":"front","average":{"1min":0.497,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33700000000000002},"max":{"1min":0.67900000000000005,"5min":0.80300000000000005,"15min":0.85299999999999998},"last":0.501}]},{"osd":5,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.378,"5min":0.318,"15min":0.318},"max":{"1min":0.66500000000000004,"5min":0.749,"15min":0.81899999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.40500000000000003,"5min":0.35599999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.38700000000000001},"max":{"1min":0.754,"5min":0.84799999999999998,"15min":0.91700000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.47699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77300000000000002,"5min":0.78600000000000003,"15min":0.89800000000000002},"last":0.622}]}]},{"osd":6,"up_from":13,"seq":55834574937,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298404,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073436,"statfs":{"total":96636764160,"available":96331198464,"internally_reserved":0,"allocated":1142784,"data_stored":550692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56499999999999995,"15min":0.78100000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.752,"5min":0.82399999999999995,"15min":5.6929999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57499999999999996,"15min":0.79500000000000004},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76300000000000001,"5min":0.82799999999999996,"15min":5.7060000000000004},"last":0.48999999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.32500000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.76300000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58199999999999996,"15min":0.53000000000000003},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":0.77200000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56699999999999995,"15min":0.93300000000000005},"min":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.751,"5min":0.82299999999999995,"15min":8.8659999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73099999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58999999999999997,"15min":1.0249999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77000000000000002,"5min":0.86799999999999999,"15min":10.659000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72399999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46700000000000003,"15min":0.50600000000000001},"min":{"1min":0.30599999999999999,"5min":0.30199999999999999,"15min":0.27400000000000002},"max":{"1min":0.52800000000000002,"5min":0.76100000000000001,"15min":0.79600000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.54100000000000004},"min":{"1min":0.32400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.76100000000000001,"15min":0.76500000000000001},"last":0.34100000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.49399999999999999,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68400000000000005,"5min":0.746,"15min":0.78300000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.51800000000000002,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.69799999999999995,"5min":0.82699999999999996,"15min":0.84399999999999997},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54800000000000004,"15min":0.58399999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.312},"max":{"1min":0.755,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58299999999999996,"15min":0.626},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.752,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.47299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298984,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072856,"statfs":{"total":96636764160,"available":96330604544,"internally_reserved":0,"allocated":1736704,"data_stored":1141060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.377,"15min":0.35099999999999998},"min":{"1min":0.20300000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.497,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.39900000000000002,"15min":0.36099999999999999},"min":{"1min":0.28199999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51000000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35599999999999998,"15min":0.32700000000000001},"min":{"1min":0.22500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.46100000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41399999999999998,"15min":0.38600000000000001},"min":{"1min":0.252,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.621,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.27200000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.434,"15min":0.38700000000000001},"min":{"1min":0.26900000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.57399999999999995,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40999999999999998,"15min":0.38600000000000001},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.58799999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.28399999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60999999999999999,"15min":0.56499999999999995},"min":{"1min":0.46500000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81499999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.443},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.47299999999999998,"5min":0.38700000000000001,"15min":0.376},"max":{"1min":0.77000000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47699999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.501,"5min":0.37,"15min":0.37},"max":{"1min":0.746,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66700000000000004,"15min":0.628},"min":{"1min":0.48999999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85799999999999998,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.55000000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.59399999999999997},"min":{"1min":0.47199999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85199999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64300000000000002,"15min":0.59799999999999998},"min":{"1min":0.52900000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.81799999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.43099999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66000000000000003,"15min":0.624},"min":{"1min":0.51300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.78700000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.64100000000000001,"15min":0.60899999999999999},"min":{"1min":0.48599999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78300000000000003,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.46500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574936,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1134592,"data_stored":544709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.314},"min":{"1min":0.25600000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.35099999999999998},"min":{"1min":0.28599999999999998,"5min":0.26600000000000001,"15min":0.246},"max":{"1min":0.58799999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.35699999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41899999999999998,"15min":0.377},"min":{"1min":0.29299999999999998,"5min":0.26500000000000001,"15min":0.20599999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.371,"5min":0.373,"15min":0.33400000000000002},"min":{"1min":0.26400000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.53100000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.30499999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41299999999999998,"15min":0.38700000000000001},"min":{"1min":0.25800000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.63100000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.41599999999999998},"min":{"1min":0.317,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.84799999999999998,"5min":0.92100000000000004,"15min":1.369},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.629,"15min":0.56499999999999995},"min":{"1min":0.51500000000000001,"5min":0.42699999999999999,"15min":0.41099999999999998},"max":{"1min":0.83799999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.502}]},{"osd":5,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63900000000000001,"15min":0.60899999999999999},"min":{"1min":0.52100000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88400000000000001,"5min":0.98999999999999999,"15min":1.3320000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.65000000000000002,"15min":0.60299999999999998},"min":{"1min":0.47999999999999998,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.80500000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65300000000000002,"15min":0.626},"min":{"1min":0.45300000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91700000000000004,"5min":0.95299999999999996,"15min":1.3999999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66400000000000003,"15min":0.60899999999999999},"min":{"1min":0.50800000000000001,"5min":0.46700000000000003,"15min":0.39800000000000002},"max":{"1min":1.0249999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64900000000000002,"15min":1.0089999999999999},"min":{"1min":0.47899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":11.138},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68000000000000005,"15min":0.63800000000000001},"min":{"1min":0.503,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.429},"last":0.47699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574936,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298404,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073436,"statfs":{"total":96636764160,"available":96331198464,"internally_reserved":0,"allocated":1142784,"data_stored":550692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.374,"15min":0.36899999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.52000000000000002,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40300000000000002,"15min":0.376},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42799999999999999,"15min":0.38700000000000001},"min":{"1min":0.247,"5min":0.24299999999999999,"15min":0.23000000000000001},"max":{"1min":0.59599999999999997,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.45300000000000001,"15min":0.40500000000000003},"min":{"1min":0.28799999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.58299999999999996,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40699999999999997,"15min":0.377},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55000000000000004,"5min":1.423,"15min":1.423},"last":0.443},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45400000000000001,"15min":0.42599999999999999},"min":{"1min":0.33300000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66500000000000004,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.625,"15min":0.58499999999999996},"min":{"1min":0.439,"5min":0.38600000000000001,"15min":0.377},"max":{"1min":0.80300000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.63100000000000001,"15min":0.61799999999999999},"min":{"1min":0.44700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.60899999999999999},"min":{"1min":0.438,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83699999999999997,"5min":1.304,"15min":1.304},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.42299999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73899999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.42499999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96099999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.66100000000000003,"15min":0.63300000000000001},"min":{"1min":0.51600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.89200000000000002,"5min":1.347,"15min":1.347},"last":0.77300000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67100000000000004,"15min":0.66200000000000003},"min":{"1min":0.47499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98599999999999999,"5min":1.206,"15min":1.206},"last":0.625},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68700000000000006,"15min":0.67300000000000004},"min":{"1min":0.47799999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.87,"5min":1.385,"15min":1.385},"last":0.67000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298408,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073432,"statfs":{"total":96636764160,"available":96331194368,"internally_reserved":0,"allocated":1146880,"data_stored":551645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.23300000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.54900000000000004,"5min":0.55500000000000005,"15min":0.61299999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.38200000000000001,"15min":0.38800000000000001},"min":{"1min":0.26500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.78100000000000003},"last":0.32600000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.379,"15min":0.371},"min":{"1min":0.28299999999999997,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58399999999999996,"5min":0.66100000000000003,"15min":0.66700000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.40200000000000002},"min":{"1min":0.29099999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.40400000000000003},"min":{"1min":0.26700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.41099999999999998},"min":{"1min":0.34999999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.36499999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.58799999999999997},"min":{"1min":0.438,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.441},{"interface":"front","average":{"1min":0.624,"5min":0.62,"15min":0.59899999999999998},"min":{"1min":0.44400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91400000000000003,"5min":0.96599999999999997,"15min":1.1539999999999999},"last":0.48799999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.623,"15min":0.623},"min":{"1min":0.44800000000000001,"5min":0.40400000000000003,"15min":0.36399999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.2110000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.46400000000000002,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":1.0129999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.41999999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63100000000000001,"15min":0.59499999999999997},"min":{"1min":0.45300000000000001,"5min":0.42999999999999999,"15min":0.40600000000000003},"max":{"1min":0.879,"5min":0.91100000000000003,"15min":1.0700000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.53300000000000003,"5min":0.442,"15min":0.38600000000000001},"max":{"1min":0.91200000000000003,"5min":0.996,"15min":1.391},"last":0.40799999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.39500000000000002},"max":{"1min":0.97199999999999998,"5min":1.121,"15min":1.121},"last":0.5},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65500000000000003,"15min":0.61499999999999999},"min":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.42799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574936,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1134592,"data_stored":544709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.54800000000000004},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.217},"max":{"1min":0.68600000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64100000000000001,"15min":0.59699999999999998},"min":{"1min":0.39700000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.74199999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58999999999999997,"15min":1.0920000000000001},"min":{"1min":0.42899999999999999,"5min":0.38600000000000001,"15min":0.34899999999999998},"max":{"1min":1.77,"5min":1.77,"15min":17.879999999999999},"last":0.63},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57499999999999996,"15min":1.073},"min":{"1min":0.44,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71199999999999997,"5min":0.84699999999999998,"15min":18.010999999999999},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.53600000000000003},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.59899999999999998,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.69399999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59299999999999997,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.29899999999999999},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.56799999999999995},"min":{"1min":0.45700000000000002,"5min":0.373,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56299999999999994}]},{"osd":5,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.30499999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41699999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.53800000000000003,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.38200000000000001,"5min":0.36799999999999999,"15min":0.36199999999999999},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.504}]},{"osd":7,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.42299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.72899999999999998,"5min":0.81399999999999995,"15min":0.83999999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58999999999999997,"15min":0.61599999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78700000000000003,"5min":0.82099999999999995,"15min":0.83299999999999996},"last":0.48799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574935,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298408,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073432,"statfs":{"total":96636764160,"available":96331194368,"internally_reserved":0,"allocated":1146880,"data_stored":551645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55000000000000004,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.80300000000000005,"5min":1.103,"15min":1.103},"last":0.499},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54400000000000004,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.56499999999999995},"min":{"1min":0.47199999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81699999999999995,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.55500000000000005},"min":{"1min":0.40699999999999997,"5min":0.35899999999999999,"15min":0.33900000000000002},"max":{"1min":0.85499999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.38500000000000001,"15min":0.30399999999999999},"max":{"1min":0.78100000000000003,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.745,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.54500000000000004},"min":{"1min":0.443,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70799999999999996,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.57199999999999995},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.67900000000000005}]},{"osd":4,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47999999999999998,"15min":0.50800000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.49299999999999999,"15min":0.501},"min":{"1min":0.33700000000000002,"5min":0.308,"15min":0.26500000000000001},"max":{"1min":0.65700000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39800000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.504,"15min":0.51600000000000001},"min":{"1min":0.42399999999999999,"5min":0.29299999999999998,"15min":0.28299999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.57099999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.73999999999999999},"last":0.47099999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.54700000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68100000000000005,"5min":0.73799999999999999,"15min":0.78400000000000003},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57299999999999995,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:24:45.086 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:24:45.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.235+0000 7f3dff9b9700 1 Processor -- start 2023-10-06T02:24:45.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.235+0000 7f3dff9b9700 1 -- start start 2023-10-06T02:24:45.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.236+0000 7f3dff9b9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3df8159380 0x7f3df8159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:45.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.236+0000 7f3dff9b9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3df80b20e0 0x7f3df80b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:45.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.236+0000 7f3dff9b9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df80cb6c0 con 0x7f3df815d4d0 2023-10-06T02:24:45.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.236+0000 7f3dff9b9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df815e200 con 0x7f3df8159380 2023-10-06T02:24:45.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.236+0000 7f3dff9b9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80ccb60 con 0x7f3df80b20e0 2023-10-06T02:24:45.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.236+0000 7f3dfd755700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3df8159380 0x7f3df8159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:45.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.236+0000 7f3dfd755700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3df8159380 0x7f3df8159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46294/0 (socket says 172.21.15.6:46294) 2023-10-06T02:24:45.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.236+0000 7f3dfd755700 1 -- 172.21.15.6:0/2562737553 learned_addr learned my addr 172.21.15.6:0/2562737553 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:45.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.236+0000 7f3dfcf54700 1 --2- 172.21.15.6:0/2562737553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3df80b20e0 0x7f3df80b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:45.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.236+0000 7f3dfd755700 1 -- 172.21.15.6:0/2562737553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3df80b20e0 msgr2=0x7f3df80b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:45.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.236+0000 7f3dfd755700 1 --2- 172.21.15.6:0/2562737553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3df80b20e0 0x7f3df80b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.236+0000 7f3dfd755700 1 -- 172.21.15.6:0/2562737553 >> v1:172.21.15.175:6789/0 conn(0x7f3df815d4d0 legacy=0x7f3df815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:45.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.236+0000 7f3dfd755700 1 -- 172.21.15.6:0/2562737553 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df80c3ef0 con 0x7f3df8159380 2023-10-06T02:24:45.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.236+0000 7f3dfd755700 1 --2- 172.21.15.6:0/2562737553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3df8159380 0x7f3df8159750 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f3df40099e0 tx=0x7f3df4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df45e4054dff92d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:45.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.236+0000 7f3deffff700 1 -- 172.21.15.6:0/2562737553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df400b7e0 con 0x7f3df8159380 2023-10-06T02:24:45.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.236+0000 7f3deffff700 1 -- 172.21.15.6:0/2562737553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df400b940 con 0x7f3df8159380 2023-10-06T02:24:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.236+0000 7f3deffff700 1 -- 172.21.15.6:0/2562737553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df400bd00 con 0x7f3df8159380 2023-10-06T02:24:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.237+0000 7f3dff9b9700 1 -- 172.21.15.6:0/2562737553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3df8159380 msgr2=0x7f3df8159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.237+0000 7f3dff9b9700 1 --2- 172.21.15.6:0/2562737553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3df8159380 0x7f3df8159750 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f3df40099e0 tx=0x7f3df4009250 comp rx=0 tx=0).stop 2023-10-06T02:24:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.237+0000 7f3dff9b9700 1 -- 172.21.15.6:0/2562737553 shutdown_connections 2023-10-06T02:24:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.237+0000 7f3dff9b9700 1 --2- 172.21.15.6:0/2562737553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3df8159380 0x7f3df8159750 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.237+0000 7f3dff9b9700 1 --2- 172.21.15.6:0/2562737553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3df80b20e0 0x7f3df80b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.237+0000 7f3dff9b9700 1 -- 172.21.15.6:0/2562737553 >> 172.21.15.6:0/2562737553 conn(0x7f3df8068680 msgr2=0x7f3df8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.237+0000 7f3dff9b9700 1 -- 172.21.15.6:0/2562737553 shutdown_connections 2023-10-06T02:24:45.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.237+0000 7f3dff9b9700 1 -- 172.21.15.6:0/2562737553 wait complete. 2023-10-06T02:24:45.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.238+0000 7f3dff9b9700 1 Processor -- start 2023-10-06T02:24:45.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.238+0000 7f3dff9b9700 1 -- start start 2023-10-06T02:24:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.239+0000 7f3dff9b9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3df80b20e0 0x7f3df80c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.239+0000 7f3dff9b9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3df8159380 0x7f3df80c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.239+0000 7f3dff9b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3df815d4d0 0x7f3df814b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.239+0000 7f3dff9b9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df8169cf0 con 0x7f3df815d4d0 2023-10-06T02:24:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.239+0000 7f3dff9b9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df816aae0 con 0x7f3df8159380 2023-10-06T02:24:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.239+0000 7f3dff9b9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df8169ed0 con 0x7f3df80b20e0 2023-10-06T02:24:45.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.239+0000 7f3dfdf56700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3df815d4d0 0x7f3df814b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:45.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.239+0000 7f3dfdf56700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3df815d4d0 0x7f3df814b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46296/0 (socket says 172.21.15.6:46296) 2023-10-06T02:24:45.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.239+0000 7f3dfdf56700 1 -- 172.21.15.6:0/2414238693 learned_addr learned my addr 172.21.15.6:0/2414238693 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:45.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.239+0000 7f3dfd755700 1 --2- 172.21.15.6:0/2414238693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3df80b20e0 0x7f3df80c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:45.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.239+0000 7f3dfdf56700 1 -- 172.21.15.6:0/2414238693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3df80b20e0 msgr2=0x7f3df80c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:45.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.239+0000 7f3dfdf56700 1 --2- 172.21.15.6:0/2414238693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3df80b20e0 0x7f3df80c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.239+0000 7f3dfcf54700 1 --2- 172.21.15.6:0/2414238693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3df8159380 0x7f3df80c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:45.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.239+0000 7f3dfdf56700 1 -- 172.21.15.6:0/2414238693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3df8159380 msgr2=0x7f3df80c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:45.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.239+0000 7f3dfdf56700 1 --2- 172.21.15.6:0/2414238693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3df8159380 0x7f3df80c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.239+0000 7f3dfdf56700 1 -- 172.21.15.6:0/2414238693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df40094f0 con 0x7f3df815d4d0 2023-10-06T02:24:45.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.240+0000 7f3dfdf56700 1 --2- 172.21.15.6:0/2414238693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3df815d4d0 0x7f3df814b690 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f3df000c930 tx=0x7f3df00026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:45.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.240+0000 7f3ded7fa700 1 -- 172.21.15.6:0/2414238693 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df000ce70 con 0x7f3df815d4d0 2023-10-06T02:24:45.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.240+0000 7f3ded7fa700 1 -- 172.21.15.6:0/2414238693 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df000a7e0 con 0x7f3df815d4d0 2023-10-06T02:24:45.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.240+0000 7f3ded7fa700 1 -- 172.21.15.6:0/2414238693 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df000aba0 con 0x7f3df815d4d0 2023-10-06T02:24:45.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.240+0000 7f3dff9b9700 1 -- 172.21.15.6:0/2414238693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df816a1b0 con 0x7f3df815d4d0 2023-10-06T02:24:45.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.240+0000 7f3dff9b9700 1 -- 172.21.15.6:0/2414238693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df816a770 con 0x7f3df815d4d0 2023-10-06T02:24:45.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.241+0000 7f3dff9b9700 1 -- 172.21.15.6:0/2414238693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df816ac50 con 0x7f3df815d4d0 2023-10-06T02:24:45.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.241+0000 7f3ded7fa700 1 -- 172.21.15.6:0/2414238693 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3df0012420 con 0x7f3df815d4d0 2023-10-06T02:24:45.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.242+0000 7f3ded7fa700 1 --2- 172.21.15.6:0/2414238693 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3ddc066f30 0x7f3ddc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:45.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.242+0000 7f3ded7fa700 1 -- 172.21.15.6:0/2414238693 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3df0084c40 con 0x7f3df815d4d0 2023-10-06T02:24:45.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.242+0000 7f3dfd755700 1 --2- 172.21.15.6:0/2414238693 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3ddc066f30 0x7f3ddc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:45.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.242+0000 7f3dfd755700 1 --2- 172.21.15.6:0/2414238693 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3ddc066f30 0x7f3ddc0693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3df40099e0 tx=0x7f3df4016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:45.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.246+0000 7f3ded7fa700 1 -- 172.21.15.6:0/2414238693 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3df00556b0 con 0x7f3df815d4d0 2023-10-06T02:24:45.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.433+0000 7f3dff9b9700 1 -- 172.21.15.6:0/2414238693 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3df80cad90 con 0x7f3ddc066f30 2023-10-06T02:24:45.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.442+0000 7f3ded7fa700 1 -- 172.21.15.6:0/2414238693 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308642 (secure 0 0 0) 0x7f3df80cad90 con 0x7f3ddc066f30 2023-10-06T02:24:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:45.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.445+0000 7f3dff9b9700 1 -- 172.21.15.6:0/2414238693 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3ddc066f30 msgr2=0x7f3ddc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:45.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.445+0000 7f3dff9b9700 1 --2- 172.21.15.6:0/2414238693 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3ddc066f30 0x7f3ddc0693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3df40099e0 tx=0x7f3df4016000 comp rx=0 tx=0).stop 2023-10-06T02:24:45.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.445+0000 7f3dff9b9700 1 -- 172.21.15.6:0/2414238693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3df815d4d0 msgr2=0x7f3df814b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.445+0000 7f3dff9b9700 1 --2- 172.21.15.6:0/2414238693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3df815d4d0 0x7f3df814b690 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f3df000c930 tx=0x7f3df00026e0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.445+0000 7f3dff9b9700 1 -- 172.21.15.6:0/2414238693 shutdown_connections 2023-10-06T02:24:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.445+0000 7f3dff9b9700 1 --2- 172.21.15.6:0/2414238693 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3ddc066f30 0x7f3ddc0693e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.445+0000 7f3dff9b9700 1 --2- 172.21.15.6:0/2414238693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3df815d4d0 0x7f3df814b690 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.445+0000 7f3dff9b9700 1 --2- 172.21.15.6:0/2414238693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3df80b20e0 0x7f3df80c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.445+0000 7f3dff9b9700 1 --2- 172.21.15.6:0/2414238693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3df8159380 0x7f3df80c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.445+0000 7f3dff9b9700 1 -- 172.21.15.6:0/2414238693 >> 172.21.15.6:0/2414238693 conn(0x7f3df8068680 msgr2=0x7f3df80c5790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:45.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.445+0000 7f3dff9b9700 1 -- 172.21.15.6:0/2414238693 shutdown_connections 2023-10-06T02:24:45.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.445+0000 7f3dff9b9700 1 -- 172.21.15.6:0/2414238693 wait complete. 2023-10-06T02:24:45.453 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:24:45.459 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2023-10-06T02:24:44.664828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2388388,"kb_used_data":10084,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752586332,"statfs":{"total":773094113280,"available":770648403968,"internally_reserved":0,"allocated":10326016,"data_stored":5577165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.710250"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962840+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:35.595154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966341+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.611329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962972+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:08.104824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.970819+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.968616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966809+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:48.691542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.967399+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:48.691542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964865+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:25.853328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962939+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:18.986033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.969406+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:25.296557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965643+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:16.889594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968341+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:05.568051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966059+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:54.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.972145+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:07.298300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.967417+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:58:10.688548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965936+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:56.221122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964954+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:09.927108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962853+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:07.518324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966367+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:31.150685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.969657+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:54.410478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964850+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:56.733610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964892+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:57.079752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962667+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:35.995255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.961747+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:24.399041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964471+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:16.889594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964276+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:39.056675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964670+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:35:37.491221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.969221+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:31.150685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.969607+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:51.110568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.963406+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:21.894393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966049+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.756486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965429+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:56.791580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964023+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:45.635203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.967322+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:05.195018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.975085+0000","last_change":"2023-10-06T02:24:39.975085+0000","last_active":"2023-10-06T02:24:39.975085+0000","last_peered":"2023-10-06T02:24:39.975085+0000","last_clean":"2023-10-06T02:24:39.975085+0000","last_became_active":"2023-10-06T02:24:39.974819+0000","last_became_peered":"2023-10-06T02:24:39.974819+0000","last_unstale":"2023-10-06T02:24:39.975085+0000","last_undegraded":"2023-10-06T02:24:39.975085+0000","last_fullsized":"2023-10-06T02:24:39.975085+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:22.010699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.970382+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:56.817052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.974072+0000","last_change":"2023-10-06T02:24:39.974072+0000","last_active":"2023-10-06T02:24:39.974072+0000","last_peered":"2023-10-06T02:24:39.974072+0000","last_clean":"2023-10-06T02:24:39.974072+0000","last_became_active":"2023-10-06T02:24:39.973802+0000","last_became_peered":"2023-10-06T02:24:39.973802+0000","last_unstale":"2023-10-06T02:24:39.974072+0000","last_undegraded":"2023-10-06T02:24:39.974072+0000","last_fullsized":"2023-10-06T02:24:39.974072+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:43.496803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962729+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:05.211450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.980152+0000","last_change":"2023-10-06T02:24:39.980152+0000","last_active":"2023-10-06T02:24:39.980152+0000","last_peered":"2023-10-06T02:24:39.980152+0000","last_clean":"2023-10-06T02:24:39.980152+0000","last_became_active":"2023-10-06T02:24:39.979853+0000","last_became_peered":"2023-10-06T02:24:39.979853+0000","last_unstale":"2023-10-06T02:24:39.980152+0000","last_undegraded":"2023-10-06T02:24:39.980152+0000","last_fullsized":"2023-10-06T02:24:39.980152+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:59.113041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964790+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:04.227594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976301+0000","last_change":"2023-10-06T02:24:39.976301+0000","last_active":"2023-10-06T02:24:39.976301+0000","last_peered":"2023-10-06T02:24:39.976301+0000","last_clean":"2023-10-06T02:24:39.976301+0000","last_became_active":"2023-10-06T02:24:39.976036+0000","last_became_peered":"2023-10-06T02:24:39.976036+0000","last_unstale":"2023-10-06T02:24:39.976301+0000","last_undegraded":"2023-10-06T02:24:39.976301+0000","last_fullsized":"2023-10-06T02:24:39.976301+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:23.302126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.963756+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:49.244903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973206+0000","last_change":"2023-10-06T02:24:39.973206+0000","last_active":"2023-10-06T02:24:39.973206+0000","last_peered":"2023-10-06T02:24:39.973206+0000","last_clean":"2023-10-06T02:24:39.973206+0000","last_became_active":"2023-10-06T02:24:39.972964+0000","last_became_peered":"2023-10-06T02:24:39.972964+0000","last_unstale":"2023-10-06T02:24:39.973206+0000","last_undegraded":"2023-10-06T02:24:39.973206+0000","last_fullsized":"2023-10-06T02:24:39.973206+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:52.898248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964280+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:17.082986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.972655+0000","last_change":"2023-10-06T02:24:39.972655+0000","last_active":"2023-10-06T02:24:39.972655+0000","last_peered":"2023-10-06T02:24:39.972655+0000","last_clean":"2023-10-06T02:24:39.972655+0000","last_became_active":"2023-10-06T02:24:39.972305+0000","last_became_peered":"2023-10-06T02:24:39.972305+0000","last_unstale":"2023-10-06T02:24:39.972655+0000","last_undegraded":"2023-10-06T02:24:39.972655+0000","last_fullsized":"2023-10-06T02:24:39.972655+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:24.291593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965608+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:34:44.335946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.971205+0000","last_change":"2023-10-06T02:24:39.971205+0000","last_active":"2023-10-06T02:24:39.971205+0000","last_peered":"2023-10-06T02:24:39.971205+0000","last_clean":"2023-10-06T02:24:39.971205+0000","last_became_active":"2023-10-06T02:24:39.970966+0000","last_became_peered":"2023-10-06T02:24:39.970966+0000","last_unstale":"2023-10-06T02:24:39.971205+0000","last_undegraded":"2023-10-06T02:24:39.971205+0000","last_fullsized":"2023-10-06T02:24:39.971205+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:18.974316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964043+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:23.015663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.981399+0000","last_change":"2023-10-06T02:24:39.981399+0000","last_active":"2023-10-06T02:24:39.981399+0000","last_peered":"2023-10-06T02:24:39.981399+0000","last_clean":"2023-10-06T02:24:39.981399+0000","last_became_active":"2023-10-06T02:24:39.979589+0000","last_became_peered":"2023-10-06T02:24:39.979589+0000","last_unstale":"2023-10-06T02:24:39.981399+0000","last_undegraded":"2023-10-06T02:24:39.981399+0000","last_fullsized":"2023-10-06T02:24:39.981399+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:11.530446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965410+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:27.723364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.971985+0000","last_change":"2023-10-06T02:24:39.971985+0000","last_active":"2023-10-06T02:24:39.971985+0000","last_peered":"2023-10-06T02:24:39.971985+0000","last_clean":"2023-10-06T02:24:39.971985+0000","last_became_active":"2023-10-06T02:24:39.971728+0000","last_became_peered":"2023-10-06T02:24:39.971728+0000","last_unstale":"2023-10-06T02:24:39.971985+0000","last_undegraded":"2023-10-06T02:24:39.971985+0000","last_fullsized":"2023-10-06T02:24:39.971985+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:09.608799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968917+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:40.143074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.980911+0000","last_change":"2023-10-06T02:24:39.980911+0000","last_active":"2023-10-06T02:24:39.980911+0000","last_peered":"2023-10-06T02:24:39.980911+0000","last_clean":"2023-10-06T02:24:39.980911+0000","last_became_active":"2023-10-06T02:24:39.980544+0000","last_became_peered":"2023-10-06T02:24:39.980544+0000","last_unstale":"2023-10-06T02:24:39.980911+0000","last_undegraded":"2023-10-06T02:24:39.980911+0000","last_fullsized":"2023-10-06T02:24:39.980911+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:50.105604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966347+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:09.927108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976365+0000","last_change":"2023-10-06T02:24:39.976365+0000","last_active":"2023-10-06T02:24:39.976365+0000","last_peered":"2023-10-06T02:24:39.976365+0000","last_clean":"2023-10-06T02:24:39.976365+0000","last_became_active":"2023-10-06T02:24:39.976088+0000","last_became_peered":"2023-10-06T02:24:39.976088+0000","last_unstale":"2023-10-06T02:24:39.976365+0000","last_undegraded":"2023-10-06T02:24:39.976365+0000","last_fullsized":"2023-10-06T02:24:39.976365+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:24.102710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968759+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:16.842155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.979144+0000","last_change":"2023-10-06T02:24:39.979144+0000","last_active":"2023-10-06T02:24:39.979144+0000","last_peered":"2023-10-06T02:24:39.979144+0000","last_clean":"2023-10-06T02:24:39.979144+0000","last_became_active":"2023-10-06T02:24:39.978902+0000","last_became_peered":"2023-10-06T02:24:39.978902+0000","last_unstale":"2023-10-06T02:24:39.979144+0000","last_undegraded":"2023-10-06T02:24:39.979144+0000","last_fullsized":"2023-10-06T02:24:39.979144+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:13.533579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966425+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:03.453032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976840+0000","last_change":"2023-10-06T02:24:39.976840+0000","last_active":"2023-10-06T02:24:39.976840+0000","last_peered":"2023-10-06T02:24:39.976840+0000","last_clean":"2023-10-06T02:24:39.976840+0000","last_became_active":"2023-10-06T02:24:39.976430+0000","last_became_peered":"2023-10-06T02:24:39.976430+0000","last_unstale":"2023-10-06T02:24:39.976840+0000","last_undegraded":"2023-10-06T02:24:39.976840+0000","last_fullsized":"2023-10-06T02:24:39.976840+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:07.627361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.961747+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:48.724533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.984134+0000","last_change":"2023-10-06T02:24:39.984134+0000","last_active":"2023-10-06T02:24:39.984134+0000","last_peered":"2023-10-06T02:24:39.984134+0000","last_clean":"2023-10-06T02:24:39.984134+0000","last_became_active":"2023-10-06T02:24:39.983937+0000","last_became_peered":"2023-10-06T02:24:39.983937+0000","last_unstale":"2023-10-06T02:24:39.984134+0000","last_undegraded":"2023-10-06T02:24:39.984134+0000","last_fullsized":"2023-10-06T02:24:39.984134+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:00.166209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968317+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:24.307089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.975251+0000","last_change":"2023-10-06T02:24:39.975251+0000","last_active":"2023-10-06T02:24:39.975251+0000","last_peered":"2023-10-06T02:24:39.975251+0000","last_clean":"2023-10-06T02:24:39.975251+0000","last_became_active":"2023-10-06T02:24:39.974945+0000","last_became_peered":"2023-10-06T02:24:39.974945+0000","last_unstale":"2023-10-06T02:24:39.975251+0000","last_undegraded":"2023-10-06T02:24:39.975251+0000","last_fullsized":"2023-10-06T02:24:39.975251+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:06.293337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964527+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:24.682393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.970516+0000","last_change":"2023-10-06T02:24:39.970516+0000","last_active":"2023-10-06T02:24:39.970516+0000","last_peered":"2023-10-06T02:24:39.970516+0000","last_clean":"2023-10-06T02:24:39.970516+0000","last_became_active":"2023-10-06T02:24:39.970272+0000","last_became_peered":"2023-10-06T02:24:39.970272+0000","last_unstale":"2023-10-06T02:24:39.970516+0000","last_undegraded":"2023-10-06T02:24:39.970516+0000","last_fullsized":"2023-10-06T02:24:39.970516+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:17.651579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965916+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:33.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976424+0000","last_change":"2023-10-06T02:24:39.976424+0000","last_active":"2023-10-06T02:24:39.976424+0000","last_peered":"2023-10-06T02:24:39.976424+0000","last_clean":"2023-10-06T02:24:39.976424+0000","last_became_active":"2023-10-06T02:24:39.976136+0000","last_became_peered":"2023-10-06T02:24:39.976136+0000","last_unstale":"2023-10-06T02:24:39.976424+0000","last_undegraded":"2023-10-06T02:24:39.976424+0000","last_fullsized":"2023-10-06T02:24:39.976424+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:42.794495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962345+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:32.991704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.979586+0000","last_change":"2023-10-06T02:24:39.979586+0000","last_active":"2023-10-06T02:24:39.979586+0000","last_peered":"2023-10-06T02:24:39.979586+0000","last_clean":"2023-10-06T02:24:39.979586+0000","last_became_active":"2023-10-06T02:24:39.979318+0000","last_became_peered":"2023-10-06T02:24:39.979318+0000","last_unstale":"2023-10-06T02:24:39.979586+0000","last_undegraded":"2023-10-06T02:24:39.979586+0000","last_fullsized":"2023-10-06T02:24:39.979586+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:03.222631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962263+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:54.104551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976072+0000","last_change":"2023-10-06T02:24:39.976072+0000","last_active":"2023-10-06T02:24:39.976072+0000","last_peered":"2023-10-06T02:24:39.976072+0000","last_clean":"2023-10-06T02:24:39.976072+0000","last_became_active":"2023-10-06T02:24:39.975779+0000","last_became_peered":"2023-10-06T02:24:39.975779+0000","last_unstale":"2023-10-06T02:24:39.976072+0000","last_undegraded":"2023-10-06T02:24:39.976072+0000","last_fullsized":"2023-10-06T02:24:39.976072+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:39.138110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966116+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:25.853328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973897+0000","last_change":"2023-10-06T02:24:39.973897+0000","last_active":"2023-10-06T02:24:39.973897+0000","last_peered":"2023-10-06T02:24:39.973897+0000","last_clean":"2023-10-06T02:24:39.973897+0000","last_became_active":"2023-10-06T02:24:39.973571+0000","last_became_peered":"2023-10-06T02:24:39.973571+0000","last_unstale":"2023-10-06T02:24:39.973897+0000","last_undegraded":"2023-10-06T02:24:39.973897+0000","last_fullsized":"2023-10-06T02:24:39.973897+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:29.040516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966502+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:30.709839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.974701+0000","last_change":"2023-10-06T02:24:39.974701+0000","last_active":"2023-10-06T02:24:39.974701+0000","last_peered":"2023-10-06T02:24:39.974701+0000","last_clean":"2023-10-06T02:24:39.974701+0000","last_became_active":"2023-10-06T02:24:39.974430+0000","last_became_peered":"2023-10-06T02:24:39.974430+0000","last_unstale":"2023-10-06T02:24:39.974701+0000","last_undegraded":"2023-10-06T02:24:39.974701+0000","last_fullsized":"2023-10-06T02:24:39.974701+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:48.940881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964494+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:00.118004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973724+0000","last_change":"2023-10-06T02:24:39.973724+0000","last_active":"2023-10-06T02:24:39.973724+0000","last_peered":"2023-10-06T02:24:39.973724+0000","last_clean":"2023-10-06T02:24:39.973724+0000","last_became_active":"2023-10-06T02:24:39.973431+0000","last_became_peered":"2023-10-06T02:24:39.973431+0000","last_unstale":"2023-10-06T02:24:39.973724+0000","last_undegraded":"2023-10-06T02:24:39.973724+0000","last_fullsized":"2023-10-06T02:24:39.973724+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:06.522727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968695+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:10:33.809744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.985278+0000","last_change":"2023-10-06T02:24:39.985278+0000","last_active":"2023-10-06T02:24:39.985278+0000","last_peered":"2023-10-06T02:24:39.985278+0000","last_clean":"2023-10-06T02:24:39.985278+0000","last_became_active":"2023-10-06T02:24:39.985020+0000","last_became_peered":"2023-10-06T02:24:39.985020+0000","last_unstale":"2023-10-06T02:24:39.985278+0000","last_undegraded":"2023-10-06T02:24:39.985278+0000","last_fullsized":"2023-10-06T02:24:39.985278+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:04.563087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.963647+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:46.230022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976021+0000","last_change":"2023-10-06T02:24:39.976021+0000","last_active":"2023-10-06T02:24:39.976021+0000","last_peered":"2023-10-06T02:24:39.976021+0000","last_clean":"2023-10-06T02:24:39.976021+0000","last_became_active":"2023-10-06T02:24:39.975772+0000","last_became_peered":"2023-10-06T02:24:39.975772+0000","last_unstale":"2023-10-06T02:24:39.976021+0000","last_undegraded":"2023-10-06T02:24:39.976021+0000","last_fullsized":"2023-10-06T02:24:39.976021+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:19.298438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965960+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:31.994955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973641+0000","last_change":"2023-10-06T02:24:39.973641+0000","last_active":"2023-10-06T02:24:39.973641+0000","last_peered":"2023-10-06T02:24:39.973641+0000","last_clean":"2023-10-06T02:24:39.973641+0000","last_became_active":"2023-10-06T02:24:39.973198+0000","last_became_peered":"2023-10-06T02:24:39.973198+0000","last_unstale":"2023-10-06T02:24:39.973641+0000","last_undegraded":"2023-10-06T02:24:39.973641+0000","last_fullsized":"2023-10-06T02:24:39.973641+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:14.807923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.962764+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:24:38.962764+0000","last_peered":"2023-10-06T02:24:38.962764+0000","last_clean":"2023-10-06T02:24:38.962764+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:24:38.962764+0000","last_undegraded":"2023-10-06T02:24:38.962764+0000","last_fullsized":"2023-10-06T02:24:38.962764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966929+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:11.588397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.979843+0000","last_change":"2023-10-06T02:24:39.979843+0000","last_active":"2023-10-06T02:24:39.979843+0000","last_peered":"2023-10-06T02:24:39.979843+0000","last_clean":"2023-10-06T02:24:39.979843+0000","last_became_active":"2023-10-06T02:24:39.979522+0000","last_became_peered":"2023-10-06T02:24:39.979522+0000","last_unstale":"2023-10-06T02:24:39.979843+0000","last_undegraded":"2023-10-06T02:24:39.979843+0000","last_fullsized":"2023-10-06T02:24:39.979843+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:55.728646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.955617+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:24:38.955617+0000","last_peered":"2023-10-06T02:24:38.955617+0000","last_clean":"2023-10-06T02:24:38.955617+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:24:38.955617+0000","last_undegraded":"2023-10-06T02:24:38.955617+0000","last_fullsized":"2023-10-06T02:24:38.955617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.967822+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:34.541182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976127+0000","last_change":"2023-10-06T02:24:39.976127+0000","last_active":"2023-10-06T02:24:39.976127+0000","last_peered":"2023-10-06T02:24:39.976127+0000","last_clean":"2023-10-06T02:24:39.976127+0000","last_became_active":"2023-10-06T02:24:39.975820+0000","last_became_peered":"2023-10-06T02:24:39.975820+0000","last_unstale":"2023-10-06T02:24:39.976127+0000","last_undegraded":"2023-10-06T02:24:39.976127+0000","last_fullsized":"2023-10-06T02:24:39.976127+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:53.313940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":78,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.963345+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:24:38.963345+0000","last_peered":"2023-10-06T02:24:38.963345+0000","last_clean":"2023-10-06T02:24:38.963345+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:24:38.963345+0000","last_undegraded":"2023-10-06T02:24:38.963345+0000","last_fullsized":"2023-10-06T02:24:38.963345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":227,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.958954+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:24:38.958954+0000","last_peered":"2023-10-06T02:24:38.958954+0000","last_clean":"2023-10-06T02:24:38.958954+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:24:38.958954+0000","last_undegraded":"2023-10-06T02:24:38.958954+0000","last_fullsized":"2023-10-06T02:24:38.958954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965674+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:54.235961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.974456+0000","last_change":"2023-10-06T02:24:39.974456+0000","last_active":"2023-10-06T02:24:39.974456+0000","last_peered":"2023-10-06T02:24:39.974456+0000","last_clean":"2023-10-06T02:24:39.974456+0000","last_became_active":"2023-10-06T02:24:39.974171+0000","last_became_peered":"2023-10-06T02:24:39.974171+0000","last_unstale":"2023-10-06T02:24:39.974456+0000","last_undegraded":"2023-10-06T02:24:39.974456+0000","last_fullsized":"2023-10-06T02:24:39.974456+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:24.102710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.958886+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:24:38.958886+0000","last_peered":"2023-10-06T02:24:38.958886+0000","last_clean":"2023-10-06T02:24:38.958886+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:24:38.958886+0000","last_undegraded":"2023-10-06T02:24:38.958886+0000","last_fullsized":"2023-10-06T02:24:38.958886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966875+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.386207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.974763+0000","last_change":"2023-10-06T02:24:39.974763+0000","last_active":"2023-10-06T02:24:39.974763+0000","last_peered":"2023-10-06T02:24:39.974763+0000","last_clean":"2023-10-06T02:24:39.974763+0000","last_became_active":"2023-10-06T02:24:39.974488+0000","last_became_peered":"2023-10-06T02:24:39.974488+0000","last_unstale":"2023-10-06T02:24:39.974763+0000","last_undegraded":"2023-10-06T02:24:39.974763+0000","last_fullsized":"2023-10-06T02:24:39.974763+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:06.522727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.958855+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:24:38.958855+0000","last_peered":"2023-10-06T02:24:38.958855+0000","last_clean":"2023-10-06T02:24:38.958855+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:24:38.958855+0000","last_undegraded":"2023-10-06T02:24:38.958855+0000","last_fullsized":"2023-10-06T02:24:38.958855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966207+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:17.082986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.978145+0000","last_change":"2023-10-06T02:24:39.978145+0000","last_active":"2023-10-06T02:24:39.978145+0000","last_peered":"2023-10-06T02:24:39.978145+0000","last_clean":"2023-10-06T02:24:39.978145+0000","last_became_active":"2023-10-06T02:24:39.977744+0000","last_became_peered":"2023-10-06T02:24:39.977744+0000","last_unstale":"2023-10-06T02:24:39.978145+0000","last_undegraded":"2023-10-06T02:24:39.978145+0000","last_fullsized":"2023-10-06T02:24:39.978145+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:49.822349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.965535+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:24:38.965535+0000","last_peered":"2023-10-06T02:24:38.965535+0000","last_clean":"2023-10-06T02:24:38.965535+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:24:38.965535+0000","last_undegraded":"2023-10-06T02:24:38.965535+0000","last_fullsized":"2023-10-06T02:24:38.965535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968249+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:15.763729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.977321+0000","last_change":"2023-10-06T02:24:39.977321+0000","last_active":"2023-10-06T02:24:39.977321+0000","last_peered":"2023-10-06T02:24:39.977321+0000","last_clean":"2023-10-06T02:24:39.977321+0000","last_became_active":"2023-10-06T02:24:39.977039+0000","last_became_peered":"2023-10-06T02:24:39.977039+0000","last_unstale":"2023-10-06T02:24:39.977321+0000","last_undegraded":"2023-10-06T02:24:39.977321+0000","last_fullsized":"2023-10-06T02:24:39.977321+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:56.670718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.960197+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:24:38.960197+0000","last_peered":"2023-10-06T02:24:38.960197+0000","last_clean":"2023-10-06T02:24:38.960197+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:24:38.960197+0000","last_undegraded":"2023-10-06T02:24:38.960197+0000","last_fullsized":"2023-10-06T02:24:38.960197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965895+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:34.541182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973325+0000","last_change":"2023-10-06T02:24:39.973325+0000","last_active":"2023-10-06T02:24:39.973325+0000","last_peered":"2023-10-06T02:24:39.973325+0000","last_clean":"2023-10-06T02:24:39.973325+0000","last_became_active":"2023-10-06T02:24:39.973093+0000","last_became_peered":"2023-10-06T02:24:39.973093+0000","last_unstale":"2023-10-06T02:24:39.973325+0000","last_undegraded":"2023-10-06T02:24:39.973325+0000","last_fullsized":"2023-10-06T02:24:39.973325+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:57.861496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.960200+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:24:38.960200+0000","last_peered":"2023-10-06T02:24:38.960200+0000","last_clean":"2023-10-06T02:24:38.960200+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:24:38.960200+0000","last_undegraded":"2023-10-06T02:24:38.960200+0000","last_fullsized":"2023-10-06T02:24:38.960200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298988,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072852,"statfs":{"total":96636764160,"available":96330600448,"internally_reserved":0,"allocated":1740800,"data_stored":1142013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.505},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70899999999999996,"5min":0.79700000000000004,"15min":1.111},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.495},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.83299999999999996,"15min":0.97899999999999998},"last":0.75700000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55600000000000005,"15min":0.51800000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.86299999999999999,"15min":1.008},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.51700000000000002},"min":{"1min":0.371,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79100000000000004,"5min":0.81000000000000005,"15min":1.075},"last":0.58599999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":0.83499999999999996,"15min":1.149},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.623,"15min":0.58299999999999996},"min":{"1min":0.443,"5min":0.41199999999999998,"15min":0.38800000000000001},"max":{"1min":0.80300000000000005,"5min":0.81399999999999995,"15min":1.048},"last":0.73599999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.41199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.75800000000000001,"5min":0.79200000000000004,"15min":1.175},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60499999999999998,"15min":0.57299999999999995},"min":{"1min":0.44900000000000001,"5min":0.41199999999999998,"15min":0.36799999999999999},"max":{"1min":0.70799999999999996,"5min":0.83799999999999997,"15min":1.03},"last":0.77600000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48299999999999998,"15min":0.48599999999999999},"min":{"1min":0.33900000000000002,"5min":0.30399999999999999,"15min":0.29299999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.873},"last":0.437},{"interface":"front","average":{"1min":0.497,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33700000000000002},"max":{"1min":0.67900000000000005,"5min":0.80300000000000005,"15min":0.85299999999999998},"last":0.501}]},{"osd":5,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.378,"5min":0.318,"15min":0.318},"max":{"1min":0.66500000000000004,"5min":0.749,"15min":0.81899999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.40500000000000003,"5min":0.35599999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.38700000000000001},"max":{"1min":0.754,"5min":0.84799999999999998,"15min":0.91700000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.47699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77300000000000002,"5min":0.78600000000000003,"15min":0.89800000000000002},"last":0.622}]}]},{"osd":6,"up_from":13,"seq":55834574937,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298404,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073436,"statfs":{"total":96636764160,"available":96331198464,"internally_reserved":0,"allocated":1142784,"data_stored":550692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56499999999999995,"15min":0.78100000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.752,"5min":0.82399999999999995,"15min":5.6929999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57499999999999996,"15min":0.79500000000000004},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76300000000000001,"5min":0.82799999999999996,"15min":5.7060000000000004},"last":0.48999999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.32500000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.76300000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58199999999999996,"15min":0.53000000000000003},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":0.77200000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56699999999999995,"15min":0.93300000000000005},"min":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.751,"5min":0.82299999999999995,"15min":8.8659999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73099999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58999999999999997,"15min":1.0249999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77000000000000002,"5min":0.86799999999999999,"15min":10.659000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72399999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46700000000000003,"15min":0.50600000000000001},"min":{"1min":0.30599999999999999,"5min":0.30199999999999999,"15min":0.27400000000000002},"max":{"1min":0.52800000000000002,"5min":0.76100000000000001,"15min":0.79600000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.54100000000000004},"min":{"1min":0.32400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.76100000000000001,"15min":0.76500000000000001},"last":0.34100000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.49399999999999999,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68400000000000005,"5min":0.746,"15min":0.78300000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.51800000000000002,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.69799999999999995,"5min":0.82699999999999996,"15min":0.84399999999999997},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54800000000000004,"15min":0.58399999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.312},"max":{"1min":0.755,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58299999999999996,"15min":0.626},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.752,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.47299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298984,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072856,"statfs":{"total":96636764160,"available":96330604544,"internally_reserved":0,"allocated":1736704,"data_stored":1141060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.377,"15min":0.35099999999999998},"min":{"1min":0.20300000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.497,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.39900000000000002,"15min":0.36099999999999999},"min":{"1min":0.28199999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51000000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35599999999999998,"15min":0.32700000000000001},"min":{"1min":0.22500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.46100000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41399999999999998,"15min":0.38600000000000001},"min":{"1min":0.252,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.621,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.27200000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.434,"15min":0.38700000000000001},"min":{"1min":0.26900000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.57399999999999995,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40999999999999998,"15min":0.38600000000000001},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.58799999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.28399999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60999999999999999,"15min":0.56499999999999995},"min":{"1min":0.46500000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81499999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.443},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.47299999999999998,"5min":0.38700000000000001,"15min":0.376},"max":{"1min":0.77000000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47699999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.501,"5min":0.37,"15min":0.37},"max":{"1min":0.746,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66700000000000004,"15min":0.628},"min":{"1min":0.48999999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85799999999999998,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.55000000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.59399999999999997},"min":{"1min":0.47199999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85199999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64300000000000002,"15min":0.59799999999999998},"min":{"1min":0.52900000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.81799999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.43099999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66000000000000003,"15min":0.624},"min":{"1min":0.51300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.78700000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.64100000000000001,"15min":0.60899999999999999},"min":{"1min":0.48599999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78300000000000003,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.46500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574936,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1134592,"data_stored":544709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.314},"min":{"1min":0.25600000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.35099999999999998},"min":{"1min":0.28599999999999998,"5min":0.26600000000000001,"15min":0.246},"max":{"1min":0.58799999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.35699999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41899999999999998,"15min":0.377},"min":{"1min":0.29299999999999998,"5min":0.26500000000000001,"15min":0.20599999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.371,"5min":0.373,"15min":0.33400000000000002},"min":{"1min":0.26400000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.53100000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.30499999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41299999999999998,"15min":0.38700000000000001},"min":{"1min":0.25800000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.63100000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.41599999999999998},"min":{"1min":0.317,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.84799999999999998,"5min":0.92100000000000004,"15min":1.369},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.629,"15min":0.56499999999999995},"min":{"1min":0.51500000000000001,"5min":0.42699999999999999,"15min":0.41099999999999998},"max":{"1min":0.83799999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.502}]},{"osd":5,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63900000000000001,"15min":0.60899999999999999},"min":{"1min":0.52100000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88400000000000001,"5min":0.98999999999999999,"15min":1.3320000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.65000000000000002,"15min":0.60299999999999998},"min":{"1min":0.47999999999999998,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.80500000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65300000000000002,"15min":0.626},"min":{"1min":0.45300000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91700000000000004,"5min":0.95299999999999996,"15min":1.3999999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66400000000000003,"15min":0.60899999999999999},"min":{"1min":0.50800000000000001,"5min":0.46700000000000003,"15min":0.39800000000000002},"max":{"1min":1.0249999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64900000000000002,"15min":1.0089999999999999},"min":{"1min":0.47899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":11.138},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68000000000000005,"15min":0.63800000000000001},"min":{"1min":0.503,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.429},"last":0.47699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574936,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298404,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073436,"statfs":{"total":96636764160,"available":96331198464,"internally_reserved":0,"allocated":1142784,"data_stored":550692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.374,"15min":0.36899999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.52000000000000002,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40300000000000002,"15min":0.376},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42799999999999999,"15min":0.38700000000000001},"min":{"1min":0.247,"5min":0.24299999999999999,"15min":0.23000000000000001},"max":{"1min":0.59599999999999997,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.45300000000000001,"15min":0.40500000000000003},"min":{"1min":0.28799999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.58299999999999996,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40699999999999997,"15min":0.377},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55000000000000004,"5min":1.423,"15min":1.423},"last":0.443},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45400000000000001,"15min":0.42599999999999999},"min":{"1min":0.33300000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66500000000000004,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.625,"15min":0.58499999999999996},"min":{"1min":0.439,"5min":0.38600000000000001,"15min":0.377},"max":{"1min":0.80300000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.63100000000000001,"15min":0.61799999999999999},"min":{"1min":0.44700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.60899999999999999},"min":{"1min":0.438,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83699999999999997,"5min":1.304,"15min":1.304},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.42299999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73899999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.42499999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96099999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.66100000000000003,"15min":0.63300000000000001},"min":{"1min":0.51600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.89200000000000002,"5min":1.347,"15min":1.347},"last":0.77300000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67100000000000004,"15min":0.66200000000000003},"min":{"1min":0.47499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98599999999999999,"5min":1.206,"15min":1.206},"last":0.625},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68700000000000006,"15min":0.67300000000000004},"min":{"1min":0.47799999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.87,"5min":1.385,"15min":1.385},"last":0.67000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298408,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073432,"statfs":{"total":96636764160,"available":96331194368,"internally_reserved":0,"allocated":1146880,"data_stored":551645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.23300000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.54900000000000004,"5min":0.55500000000000005,"15min":0.61299999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.38200000000000001,"15min":0.38800000000000001},"min":{"1min":0.26500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.78100000000000003},"last":0.32600000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.379,"15min":0.371},"min":{"1min":0.28299999999999997,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58399999999999996,"5min":0.66100000000000003,"15min":0.66700000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.40200000000000002},"min":{"1min":0.29099999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.40400000000000003},"min":{"1min":0.26700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.41099999999999998},"min":{"1min":0.34999999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.36499999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.58799999999999997},"min":{"1min":0.438,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.441},{"interface":"front","average":{"1min":0.624,"5min":0.62,"15min":0.59899999999999998},"min":{"1min":0.44400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91400000000000003,"5min":0.96599999999999997,"15min":1.1539999999999999},"last":0.48799999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.623,"15min":0.623},"min":{"1min":0.44800000000000001,"5min":0.40400000000000003,"15min":0.36399999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.2110000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.46400000000000002,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":1.0129999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.41999999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63100000000000001,"15min":0.59499999999999997},"min":{"1min":0.45300000000000001,"5min":0.42999999999999999,"15min":0.40600000000000003},"max":{"1min":0.879,"5min":0.91100000000000003,"15min":1.0700000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.53300000000000003,"5min":0.442,"15min":0.38600000000000001},"max":{"1min":0.91200000000000003,"5min":0.996,"15min":1.391},"last":0.40799999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.39500000000000002},"max":{"1min":0.97199999999999998,"5min":1.121,"15min":1.121},"last":0.5},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65500000000000003,"15min":0.61499999999999999},"min":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.42799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574936,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1134592,"data_stored":544709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.54800000000000004},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.217},"max":{"1min":0.68600000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64100000000000001,"15min":0.59699999999999998},"min":{"1min":0.39700000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.74199999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58999999999999997,"15min":1.0920000000000001},"min":{"1min":0.42899999999999999,"5min":0.38600000000000001,"15min":0.34899999999999998},"max":{"1min":1.77,"5min":1.77,"15min":17.879999999999999},"last":0.63},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57499999999999996,"15min":1.073},"min":{"1min":0.44,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71199999999999997,"5min":0.84699999999999998,"15min":18.010999999999999},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.53600000000000003},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.59899999999999998,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.69399999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59299999999999997,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.29899999999999999},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.56799999999999995},"min":{"1min":0.45700000000000002,"5min":0.373,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56299999999999994}]},{"osd":5,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.30499999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41699999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.53800000000000003,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.38200000000000001,"5min":0.36799999999999999,"15min":0.36199999999999999},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.504}]},{"osd":7,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.42299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.72899999999999998,"5min":0.81399999999999995,"15min":0.83999999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58999999999999997,"15min":0.61599999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78700000000000003,"5min":0.82099999999999995,"15min":0.83299999999999996},"last":0.48799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574935,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298408,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073432,"statfs":{"total":96636764160,"available":96331194368,"internally_reserved":0,"allocated":1146880,"data_stored":551645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55000000000000004,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.80300000000000005,"5min":1.103,"15min":1.103},"last":0.499},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54400000000000004,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.56499999999999995},"min":{"1min":0.47199999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81699999999999995,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.55500000000000005},"min":{"1min":0.40699999999999997,"5min":0.35899999999999999,"15min":0.33900000000000002},"max":{"1min":0.85499999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.38500000000000001,"15min":0.30399999999999999},"max":{"1min":0.78100000000000003,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.745,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.54500000000000004},"min":{"1min":0.443,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70799999999999996,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.57199999999999995},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.67900000000000005}]},{"osd":4,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47999999999999998,"15min":0.50800000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.49299999999999999,"15min":0.501},"min":{"1min":0.33700000000000002,"5min":0.308,"15min":0.26500000000000001},"max":{"1min":0.65700000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39800000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.504,"15min":0.51600000000000001},"min":{"1min":0.42399999999999999,"5min":0.29299999999999998,"15min":0.28299999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.57099999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.73999999999999999},"last":0.47099999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.54700000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68100000000000005,"5min":0.73799999999999999,"15min":0.78400000000000003},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57299999999999995,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:24:45.467 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:24:45.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.617+0000 7f4161a96700 1 Processor -- start 2023-10-06T02:24:45.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.617+0000 7f4161a96700 1 -- start start 2023-10-06T02:24:45.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.618+0000 7f4161a96700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f415c155fb0 0x7f415c159d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:45.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.618+0000 7f4161a96700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f415c06b370 0x7f415c15a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:45.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.618+0000 7f4161a96700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415c0cb650 con 0x7f415c156380 2023-10-06T02:24:45.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.618+0000 7f4161a96700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415c06b810 con 0x7f415c155fb0 2023-10-06T02:24:45.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.618+0000 7f4161a96700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0caa40 con 0x7f415c06b370 2023-10-06T02:24:45.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.618+0000 7f415affd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f415c156380 0x7f415c0aed30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43828/0 (socket says 172.21.15.6:43828) 2023-10-06T02:24:45.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.618+0000 7f415affd700 1 -- 172.21.15.6:0/4006908603 learned_addr learned my addr 172.21.15.6:0/4006908603 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:45.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415bfff700 1 --2- 172.21.15.6:0/4006908603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f415c06b370 0x7f415c15a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:45.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415b7fe700 1 --2- 172.21.15.6:0/4006908603 >> v2:172.21.15.175:3300/0 conn(0x7f415c155fb0 0x7f415c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415a7fc700 1 -- 172.21.15.6:0/4006908603 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765469856 0 0) 0x7f415c0cb650 con 0x7f415c156380 2023-10-06T02:24:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415a7fc700 1 -- 172.21.15.6:0/4006908603 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4144003570 con 0x7f415c156380 2023-10-06T02:24:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415a7fc700 1 -- 172.21.15.6:0/4006908603 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 366866003 0 0) 0x7f4144003570 con 0x7f415c156380 2023-10-06T02:24:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415a7fc700 1 -- 172.21.15.6:0/4006908603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f415c06b370 msgr2=0x7f415c15a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415a7fc700 1 --2- 172.21.15.6:0/4006908603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f415c06b370 0x7f415c15a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415a7fc700 1 -- 172.21.15.6:0/4006908603 >> v2:172.21.15.175:3300/0 conn(0x7f415c155fb0 msgr2=0x7f415c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415a7fc700 1 --2- 172.21.15.6:0/4006908603 >> v2:172.21.15.175:3300/0 conn(0x7f415c155fb0 0x7f415c159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415a7fc700 1 -- 172.21.15.6:0/4006908603 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415c0cad20 con 0x7f415c156380 2023-10-06T02:24:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415a7fc700 1 -- 172.21.15.6:0/4006908603 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f4150001470 con 0x7f415c156380 2023-10-06T02:24:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415a7fc700 1 -- 172.21.15.6:0/4006908603 >> v1:172.21.15.6:6789/0 conn(0x7f415c156380 legacy=0x7f415c0aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415a7fc700 1 --2- 172.21.15.6:0/4006908603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f415c06b370 0x7f4144003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415a7fc700 1 --2- 172.21.15.6:0/4006908603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4144003fe0 0x7f4144004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415a7fc700 1 --2- 172.21.15.6:0/4006908603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4144004d50 0x7f41440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415a7fc700 1 -- 172.21.15.6:0/4006908603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c06b810 con 0x7f4144004d50 2023-10-06T02:24:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415a7fc700 1 -- 172.21.15.6:0/4006908603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0caa40 con 0x7f4144003fe0 2023-10-06T02:24:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415a7fc700 1 -- 172.21.15.6:0/4006908603 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414400dca0 con 0x7f415c06b370 2023-10-06T02:24:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415bfff700 1 --2- 172.21.15.6:0/4006908603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4144004d50 0x7f41440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415b7fe700 1 --2- 172.21.15.6:0/4006908603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f415c06b370 0x7f4144003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415affd700 1 --2- 172.21.15.6:0/4006908603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4144003fe0 0x7f4144004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415bfff700 1 -- 172.21.15.6:0/4006908603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f415c06b370 msgr2=0x7f4144003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415bfff700 1 --2- 172.21.15.6:0/4006908603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f415c06b370 0x7f4144003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415bfff700 1 -- 172.21.15.6:0/4006908603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4144003fe0 msgr2=0x7f4144004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415bfff700 1 --2- 172.21.15.6:0/4006908603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4144003fe0 0x7f4144004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415bfff700 1 -- 172.21.15.6:0/4006908603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4144003570 con 0x7f4144004d50 2023-10-06T02:24:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.619+0000 7f415affd700 1 --2- 172.21.15.6:0/4006908603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4144003fe0 0x7f4144004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.620+0000 7f415bfff700 1 --2- 172.21.15.6:0/4006908603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4144004d50 0x7f41440051c0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f415400e210 tx=0x7f415400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6713e2b578c41af1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.620+0000 7f415a7fc700 1 -- 172.21.15.6:0/4006908603 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415400ea60 con 0x7f4144004d50 2023-10-06T02:24:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.620+0000 7f415a7fc700 1 -- 172.21.15.6:0/4006908603 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415400f040 con 0x7f4144004d50 2023-10-06T02:24:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.620+0000 7f415a7fc700 1 -- 172.21.15.6:0/4006908603 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415400ee10 con 0x7f4144004d50 2023-10-06T02:24:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.620+0000 7f4161a96700 1 -- 172.21.15.6:0/4006908603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4144004d50 msgr2=0x7f41440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.620+0000 7f4161a96700 1 --2- 172.21.15.6:0/4006908603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4144004d50 0x7f41440051c0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f415400e210 tx=0x7f415400b040 comp rx=0 tx=0).stop 2023-10-06T02:24:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.620+0000 7f415bfff700 1 -- 172.21.15.6:0/4006908603 reap_dead start 2023-10-06T02:24:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.620+0000 7f4161a96700 1 -- 172.21.15.6:0/4006908603 shutdown_connections 2023-10-06T02:24:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.620+0000 7f4161a96700 1 -- 172.21.15.6:0/4006908603 >> 172.21.15.6:0/4006908603 conn(0x7f415c069100 msgr2=0x7f415c0ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.620+0000 7f4161a96700 1 -- 172.21.15.6:0/4006908603 shutdown_connections 2023-10-06T02:24:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.620+0000 7f4161a96700 1 -- 172.21.15.6:0/4006908603 wait complete. 2023-10-06T02:24:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.621+0000 7f4161a96700 1 Processor -- start 2023-10-06T02:24:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.621+0000 7f4161a96700 1 -- start start 2023-10-06T02:24:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.622+0000 7f4161a96700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f415c14ee00 0x7f415c0c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.622+0000 7f4161a96700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f415c0b06c0 0x7f415c154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.622+0000 7f4161a96700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f415c1548d0 0x7f415c152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.622+0000 7f4161a96700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c154d70 con 0x7f415c0b06c0 2023-10-06T02:24:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.622+0000 7f4161a96700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0b0ba0 con 0x7f415c14ee00 2023-10-06T02:24:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.622+0000 7f4161a96700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0b0e80 con 0x7f415c1548d0 2023-10-06T02:24:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.622+0000 7f415affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f415c0b06c0 0x7f415c154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.622+0000 7f415affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f415c0b06c0 0x7f415c154390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46314/0 (socket says 172.21.15.6:46314) 2023-10-06T02:24:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.622+0000 7f415affd700 1 -- 172.21.15.6:0/3670155900 learned_addr learned my addr 172.21.15.6:0/3670155900 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.622+0000 7f415bfff700 1 --2- 172.21.15.6:0/3670155900 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f415c1548d0 0x7f415c152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.623+0000 7f415b7fe700 1 --2- 172.21.15.6:0/3670155900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f415c14ee00 0x7f415c0c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.623+0000 7f415affd700 1 -- 172.21.15.6:0/3670155900 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f415c1548d0 msgr2=0x7f415c152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.623+0000 7f415affd700 1 --2- 172.21.15.6:0/3670155900 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f415c1548d0 0x7f415c152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.623+0000 7f415affd700 1 -- 172.21.15.6:0/3670155900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f415c14ee00 msgr2=0x7f415c0c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.623+0000 7f415affd700 1 --2- 172.21.15.6:0/3670155900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f415c14ee00 0x7f415c0c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.623+0000 7f415affd700 1 -- 172.21.15.6:0/3670155900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415c0b1160 con 0x7f415c0b06c0 2023-10-06T02:24:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.623+0000 7f415b7fe700 1 --2- 172.21.15.6:0/3670155900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f415c14ee00 0x7f415c0c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.623+0000 7f415affd700 1 --2- 172.21.15.6:0/3670155900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f415c0b06c0 0x7f415c154390 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f415000eb30 tx=0x7f415c0c9400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.623+0000 7f41437fe700 1 -- 172.21.15.6:0/3670155900 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415000a7d0 con 0x7f415c0b06c0 2023-10-06T02:24:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.623+0000 7f41437fe700 1 -- 172.21.15.6:0/3670155900 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4150010040 con 0x7f415c0b06c0 2023-10-06T02:24:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.623+0000 7f41437fe700 1 -- 172.21.15.6:0/3670155900 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415000ab40 con 0x7f415c0b06c0 2023-10-06T02:24:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.623+0000 7f4161a96700 1 -- 172.21.15.6:0/3670155900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415c0b1440 con 0x7f415c0b06c0 2023-10-06T02:24:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.623+0000 7f4161a96700 1 -- 172.21.15.6:0/3670155900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415c0c79f0 con 0x7f415c0b06c0 2023-10-06T02:24:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.624+0000 7f4161a96700 1 -- 172.21.15.6:0/3670155900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415c06d580 con 0x7f415c0b06c0 2023-10-06T02:24:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.624+0000 7f41437fe700 1 -- 172.21.15.6:0/3670155900 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41500143f0 con 0x7f415c0b06c0 2023-10-06T02:24:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.625+0000 7f41437fe700 1 --2- 172.21.15.6:0/3670155900 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4148066f30 0x7f41480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.625+0000 7f41437fe700 1 -- 172.21.15.6:0/3670155900 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4150083d70 con 0x7f415c0b06c0 2023-10-06T02:24:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.625+0000 7f415b7fe700 1 --2- 172.21.15.6:0/3670155900 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4148066f30 0x7f41480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.626+0000 7f415b7fe700 1 --2- 172.21.15.6:0/3670155900 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4148066f30 0x7f41480693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f414c006f00 tx=0x7f414c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.629+0000 7f41437fe700 1 -- 172.21.15.6:0/3670155900 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f415004d5a0 con 0x7f415c0b06c0 2023-10-06T02:24:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.820+0000 7f4161a96700 1 -- 172.21.15.6:0/3670155900 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f415c0cb000 con 0x7f4148066f30 2023-10-06T02:24:45.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.828+0000 7f41437fe700 1 -- 172.21.15.6:0/3670155900 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308642 (secure 0 0 0) 0x7f415c0cb000 con 0x7f4148066f30 2023-10-06T02:24:45.833 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.832+0000 7f4161a96700 1 -- 172.21.15.6:0/3670155900 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4148066f30 msgr2=0x7f41480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.832+0000 7f4161a96700 1 --2- 172.21.15.6:0/3670155900 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4148066f30 0x7f41480693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f414c006f00 tx=0x7f414c008040 comp rx=0 tx=0).stop 2023-10-06T02:24:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.832+0000 7f4161a96700 1 -- 172.21.15.6:0/3670155900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f415c0b06c0 msgr2=0x7f415c154390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.832+0000 7f4161a96700 1 --2- 172.21.15.6:0/3670155900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f415c0b06c0 0x7f415c154390 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f415000eb30 tx=0x7f415c0c9400 comp rx=0 tx=0).stop 2023-10-06T02:24:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.832+0000 7f4161a96700 1 -- 172.21.15.6:0/3670155900 shutdown_connections 2023-10-06T02:24:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.832+0000 7f4161a96700 1 --2- 172.21.15.6:0/3670155900 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f415c1548d0 0x7f415c152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.832+0000 7f4161a96700 1 --2- 172.21.15.6:0/3670155900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f415c14ee00 0x7f415c0c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.832+0000 7f4161a96700 1 --2- 172.21.15.6:0/3670155900 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4148066f30 0x7f41480693e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.832+0000 7f4161a96700 1 --2- 172.21.15.6:0/3670155900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f415c0b06c0 0x7f415c154390 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.832+0000 7f4161a96700 1 -- 172.21.15.6:0/3670155900 >> 172.21.15.6:0/3670155900 conn(0x7f415c069100 msgr2=0x7f415c150b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:45.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.832+0000 7f4161a96700 1 -- 172.21.15.6:0/3670155900 shutdown_connections 2023-10-06T02:24:45.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:45.832+0000 7f4161a96700 1 -- 172.21.15.6:0/3670155900 wait complete. 2023-10-06T02:24:45.837 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:24:45.845 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2023-10-06T02:24:44.664828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2388388,"kb_used_data":10084,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752586332,"statfs":{"total":773094113280,"available":770648403968,"internally_reserved":0,"allocated":10326016,"data_stored":5577165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.710250"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962840+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:35.595154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966341+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.611329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962972+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:08.104824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.970819+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.968616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966809+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:48.691542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.967399+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:48.691542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964865+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:25.853328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962939+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:18.986033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.969406+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:25.296557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965643+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:16.889594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968341+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:05.568051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966059+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:54.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.972145+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:07.298300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.967417+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:58:10.688548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965936+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:56.221122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964954+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:09.927108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962853+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:07.518324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966367+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:31.150685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.969657+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:54.410478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964850+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:56.733610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964892+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:57.079752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962667+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:35.995255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.961747+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:24.399041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964471+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:16.889594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964276+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:39.056675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964670+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:35:37.491221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.969221+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:31.150685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.969607+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:51.110568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.963406+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:21.894393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966049+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.756486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965429+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:56.791580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964023+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:45.635203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.967322+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:05.195018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.975085+0000","last_change":"2023-10-06T02:24:39.975085+0000","last_active":"2023-10-06T02:24:39.975085+0000","last_peered":"2023-10-06T02:24:39.975085+0000","last_clean":"2023-10-06T02:24:39.975085+0000","last_became_active":"2023-10-06T02:24:39.974819+0000","last_became_peered":"2023-10-06T02:24:39.974819+0000","last_unstale":"2023-10-06T02:24:39.975085+0000","last_undegraded":"2023-10-06T02:24:39.975085+0000","last_fullsized":"2023-10-06T02:24:39.975085+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:22.010699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.970382+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:56.817052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.974072+0000","last_change":"2023-10-06T02:24:39.974072+0000","last_active":"2023-10-06T02:24:39.974072+0000","last_peered":"2023-10-06T02:24:39.974072+0000","last_clean":"2023-10-06T02:24:39.974072+0000","last_became_active":"2023-10-06T02:24:39.973802+0000","last_became_peered":"2023-10-06T02:24:39.973802+0000","last_unstale":"2023-10-06T02:24:39.974072+0000","last_undegraded":"2023-10-06T02:24:39.974072+0000","last_fullsized":"2023-10-06T02:24:39.974072+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:43.496803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962729+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:05.211450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.980152+0000","last_change":"2023-10-06T02:24:39.980152+0000","last_active":"2023-10-06T02:24:39.980152+0000","last_peered":"2023-10-06T02:24:39.980152+0000","last_clean":"2023-10-06T02:24:39.980152+0000","last_became_active":"2023-10-06T02:24:39.979853+0000","last_became_peered":"2023-10-06T02:24:39.979853+0000","last_unstale":"2023-10-06T02:24:39.980152+0000","last_undegraded":"2023-10-06T02:24:39.980152+0000","last_fullsized":"2023-10-06T02:24:39.980152+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:59.113041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964790+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:04.227594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976301+0000","last_change":"2023-10-06T02:24:39.976301+0000","last_active":"2023-10-06T02:24:39.976301+0000","last_peered":"2023-10-06T02:24:39.976301+0000","last_clean":"2023-10-06T02:24:39.976301+0000","last_became_active":"2023-10-06T02:24:39.976036+0000","last_became_peered":"2023-10-06T02:24:39.976036+0000","last_unstale":"2023-10-06T02:24:39.976301+0000","last_undegraded":"2023-10-06T02:24:39.976301+0000","last_fullsized":"2023-10-06T02:24:39.976301+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:23.302126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.963756+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:49.244903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973206+0000","last_change":"2023-10-06T02:24:39.973206+0000","last_active":"2023-10-06T02:24:39.973206+0000","last_peered":"2023-10-06T02:24:39.973206+0000","last_clean":"2023-10-06T02:24:39.973206+0000","last_became_active":"2023-10-06T02:24:39.972964+0000","last_became_peered":"2023-10-06T02:24:39.972964+0000","last_unstale":"2023-10-06T02:24:39.973206+0000","last_undegraded":"2023-10-06T02:24:39.973206+0000","last_fullsized":"2023-10-06T02:24:39.973206+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:52.898248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964280+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:17.082986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.972655+0000","last_change":"2023-10-06T02:24:39.972655+0000","last_active":"2023-10-06T02:24:39.972655+0000","last_peered":"2023-10-06T02:24:39.972655+0000","last_clean":"2023-10-06T02:24:39.972655+0000","last_became_active":"2023-10-06T02:24:39.972305+0000","last_became_peered":"2023-10-06T02:24:39.972305+0000","last_unstale":"2023-10-06T02:24:39.972655+0000","last_undegraded":"2023-10-06T02:24:39.972655+0000","last_fullsized":"2023-10-06T02:24:39.972655+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:24.291593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965608+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:34:44.335946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.971205+0000","last_change":"2023-10-06T02:24:39.971205+0000","last_active":"2023-10-06T02:24:39.971205+0000","last_peered":"2023-10-06T02:24:39.971205+0000","last_clean":"2023-10-06T02:24:39.971205+0000","last_became_active":"2023-10-06T02:24:39.970966+0000","last_became_peered":"2023-10-06T02:24:39.970966+0000","last_unstale":"2023-10-06T02:24:39.971205+0000","last_undegraded":"2023-10-06T02:24:39.971205+0000","last_fullsized":"2023-10-06T02:24:39.971205+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:18.974316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964043+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:23.015663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.981399+0000","last_change":"2023-10-06T02:24:39.981399+0000","last_active":"2023-10-06T02:24:39.981399+0000","last_peered":"2023-10-06T02:24:39.981399+0000","last_clean":"2023-10-06T02:24:39.981399+0000","last_became_active":"2023-10-06T02:24:39.979589+0000","last_became_peered":"2023-10-06T02:24:39.979589+0000","last_unstale":"2023-10-06T02:24:39.981399+0000","last_undegraded":"2023-10-06T02:24:39.981399+0000","last_fullsized":"2023-10-06T02:24:39.981399+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:11.530446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965410+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:27.723364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.971985+0000","last_change":"2023-10-06T02:24:39.971985+0000","last_active":"2023-10-06T02:24:39.971985+0000","last_peered":"2023-10-06T02:24:39.971985+0000","last_clean":"2023-10-06T02:24:39.971985+0000","last_became_active":"2023-10-06T02:24:39.971728+0000","last_became_peered":"2023-10-06T02:24:39.971728+0000","last_unstale":"2023-10-06T02:24:39.971985+0000","last_undegraded":"2023-10-06T02:24:39.971985+0000","last_fullsized":"2023-10-06T02:24:39.971985+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:09.608799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968917+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:40.143074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.980911+0000","last_change":"2023-10-06T02:24:39.980911+0000","last_active":"2023-10-06T02:24:39.980911+0000","last_peered":"2023-10-06T02:24:39.980911+0000","last_clean":"2023-10-06T02:24:39.980911+0000","last_became_active":"2023-10-06T02:24:39.980544+0000","last_became_peered":"2023-10-06T02:24:39.980544+0000","last_unstale":"2023-10-06T02:24:39.980911+0000","last_undegraded":"2023-10-06T02:24:39.980911+0000","last_fullsized":"2023-10-06T02:24:39.980911+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:50.105604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966347+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:09.927108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976365+0000","last_change":"2023-10-06T02:24:39.976365+0000","last_active":"2023-10-06T02:24:39.976365+0000","last_peered":"2023-10-06T02:24:39.976365+0000","last_clean":"2023-10-06T02:24:39.976365+0000","last_became_active":"2023-10-06T02:24:39.976088+0000","last_became_peered":"2023-10-06T02:24:39.976088+0000","last_unstale":"2023-10-06T02:24:39.976365+0000","last_undegraded":"2023-10-06T02:24:39.976365+0000","last_fullsized":"2023-10-06T02:24:39.976365+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:24.102710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968759+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:16.842155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.979144+0000","last_change":"2023-10-06T02:24:39.979144+0000","last_active":"2023-10-06T02:24:39.979144+0000","last_peered":"2023-10-06T02:24:39.979144+0000","last_clean":"2023-10-06T02:24:39.979144+0000","last_became_active":"2023-10-06T02:24:39.978902+0000","last_became_peered":"2023-10-06T02:24:39.978902+0000","last_unstale":"2023-10-06T02:24:39.979144+0000","last_undegraded":"2023-10-06T02:24:39.979144+0000","last_fullsized":"2023-10-06T02:24:39.979144+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:13.533579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966425+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:03.453032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976840+0000","last_change":"2023-10-06T02:24:39.976840+0000","last_active":"2023-10-06T02:24:39.976840+0000","last_peered":"2023-10-06T02:24:39.976840+0000","last_clean":"2023-10-06T02:24:39.976840+0000","last_became_active":"2023-10-06T02:24:39.976430+0000","last_became_peered":"2023-10-06T02:24:39.976430+0000","last_unstale":"2023-10-06T02:24:39.976840+0000","last_undegraded":"2023-10-06T02:24:39.976840+0000","last_fullsized":"2023-10-06T02:24:39.976840+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:07.627361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.961747+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:48.724533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.984134+0000","last_change":"2023-10-06T02:24:39.984134+0000","last_active":"2023-10-06T02:24:39.984134+0000","last_peered":"2023-10-06T02:24:39.984134+0000","last_clean":"2023-10-06T02:24:39.984134+0000","last_became_active":"2023-10-06T02:24:39.983937+0000","last_became_peered":"2023-10-06T02:24:39.983937+0000","last_unstale":"2023-10-06T02:24:39.984134+0000","last_undegraded":"2023-10-06T02:24:39.984134+0000","last_fullsized":"2023-10-06T02:24:39.984134+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:00.166209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968317+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:24.307089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.975251+0000","last_change":"2023-10-06T02:24:39.975251+0000","last_active":"2023-10-06T02:24:39.975251+0000","last_peered":"2023-10-06T02:24:39.975251+0000","last_clean":"2023-10-06T02:24:39.975251+0000","last_became_active":"2023-10-06T02:24:39.974945+0000","last_became_peered":"2023-10-06T02:24:39.974945+0000","last_unstale":"2023-10-06T02:24:39.975251+0000","last_undegraded":"2023-10-06T02:24:39.975251+0000","last_fullsized":"2023-10-06T02:24:39.975251+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:06.293337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964527+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:24.682393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.970516+0000","last_change":"2023-10-06T02:24:39.970516+0000","last_active":"2023-10-06T02:24:39.970516+0000","last_peered":"2023-10-06T02:24:39.970516+0000","last_clean":"2023-10-06T02:24:39.970516+0000","last_became_active":"2023-10-06T02:24:39.970272+0000","last_became_peered":"2023-10-06T02:24:39.970272+0000","last_unstale":"2023-10-06T02:24:39.970516+0000","last_undegraded":"2023-10-06T02:24:39.970516+0000","last_fullsized":"2023-10-06T02:24:39.970516+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:17.651579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965916+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:33.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976424+0000","last_change":"2023-10-06T02:24:39.976424+0000","last_active":"2023-10-06T02:24:39.976424+0000","last_peered":"2023-10-06T02:24:39.976424+0000","last_clean":"2023-10-06T02:24:39.976424+0000","last_became_active":"2023-10-06T02:24:39.976136+0000","last_became_peered":"2023-10-06T02:24:39.976136+0000","last_unstale":"2023-10-06T02:24:39.976424+0000","last_undegraded":"2023-10-06T02:24:39.976424+0000","last_fullsized":"2023-10-06T02:24:39.976424+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:42.794495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962345+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:32.991704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.979586+0000","last_change":"2023-10-06T02:24:39.979586+0000","last_active":"2023-10-06T02:24:39.979586+0000","last_peered":"2023-10-06T02:24:39.979586+0000","last_clean":"2023-10-06T02:24:39.979586+0000","last_became_active":"2023-10-06T02:24:39.979318+0000","last_became_peered":"2023-10-06T02:24:39.979318+0000","last_unstale":"2023-10-06T02:24:39.979586+0000","last_undegraded":"2023-10-06T02:24:39.979586+0000","last_fullsized":"2023-10-06T02:24:39.979586+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:03.222631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962263+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:54.104551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976072+0000","last_change":"2023-10-06T02:24:39.976072+0000","last_active":"2023-10-06T02:24:39.976072+0000","last_peered":"2023-10-06T02:24:39.976072+0000","last_clean":"2023-10-06T02:24:39.976072+0000","last_became_active":"2023-10-06T02:24:39.975779+0000","last_became_peered":"2023-10-06T02:24:39.975779+0000","last_unstale":"2023-10-06T02:24:39.976072+0000","last_undegraded":"2023-10-06T02:24:39.976072+0000","last_fullsized":"2023-10-06T02:24:39.976072+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:39.138110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966116+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:25.853328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973897+0000","last_change":"2023-10-06T02:24:39.973897+0000","last_active":"2023-10-06T02:24:39.973897+0000","last_peered":"2023-10-06T02:24:39.973897+0000","last_clean":"2023-10-06T02:24:39.973897+0000","last_became_active":"2023-10-06T02:24:39.973571+0000","last_became_peered":"2023-10-06T02:24:39.973571+0000","last_unstale":"2023-10-06T02:24:39.973897+0000","last_undegraded":"2023-10-06T02:24:39.973897+0000","last_fullsized":"2023-10-06T02:24:39.973897+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:29.040516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966502+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:30.709839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.974701+0000","last_change":"2023-10-06T02:24:39.974701+0000","last_active":"2023-10-06T02:24:39.974701+0000","last_peered":"2023-10-06T02:24:39.974701+0000","last_clean":"2023-10-06T02:24:39.974701+0000","last_became_active":"2023-10-06T02:24:39.974430+0000","last_became_peered":"2023-10-06T02:24:39.974430+0000","last_unstale":"2023-10-06T02:24:39.974701+0000","last_undegraded":"2023-10-06T02:24:39.974701+0000","last_fullsized":"2023-10-06T02:24:39.974701+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:48.940881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964494+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:00.118004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973724+0000","last_change":"2023-10-06T02:24:39.973724+0000","last_active":"2023-10-06T02:24:39.973724+0000","last_peered":"2023-10-06T02:24:39.973724+0000","last_clean":"2023-10-06T02:24:39.973724+0000","last_became_active":"2023-10-06T02:24:39.973431+0000","last_became_peered":"2023-10-06T02:24:39.973431+0000","last_unstale":"2023-10-06T02:24:39.973724+0000","last_undegraded":"2023-10-06T02:24:39.973724+0000","last_fullsized":"2023-10-06T02:24:39.973724+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:06.522727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968695+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:10:33.809744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.985278+0000","last_change":"2023-10-06T02:24:39.985278+0000","last_active":"2023-10-06T02:24:39.985278+0000","last_peered":"2023-10-06T02:24:39.985278+0000","last_clean":"2023-10-06T02:24:39.985278+0000","last_became_active":"2023-10-06T02:24:39.985020+0000","last_became_peered":"2023-10-06T02:24:39.985020+0000","last_unstale":"2023-10-06T02:24:39.985278+0000","last_undegraded":"2023-10-06T02:24:39.985278+0000","last_fullsized":"2023-10-06T02:24:39.985278+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:04.563087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.963647+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:46.230022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976021+0000","last_change":"2023-10-06T02:24:39.976021+0000","last_active":"2023-10-06T02:24:39.976021+0000","last_peered":"2023-10-06T02:24:39.976021+0000","last_clean":"2023-10-06T02:24:39.976021+0000","last_became_active":"2023-10-06T02:24:39.975772+0000","last_became_peered":"2023-10-06T02:24:39.975772+0000","last_unstale":"2023-10-06T02:24:39.976021+0000","last_undegraded":"2023-10-06T02:24:39.976021+0000","last_fullsized":"2023-10-06T02:24:39.976021+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:19.298438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965960+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:31.994955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973641+0000","last_change":"2023-10-06T02:24:39.973641+0000","last_active":"2023-10-06T02:24:39.973641+0000","last_peered":"2023-10-06T02:24:39.973641+0000","last_clean":"2023-10-06T02:24:39.973641+0000","last_became_active":"2023-10-06T02:24:39.973198+0000","last_became_peered":"2023-10-06T02:24:39.973198+0000","last_unstale":"2023-10-06T02:24:39.973641+0000","last_undegraded":"2023-10-06T02:24:39.973641+0000","last_fullsized":"2023-10-06T02:24:39.973641+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:14.807923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.962764+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:24:38.962764+0000","last_peered":"2023-10-06T02:24:38.962764+0000","last_clean":"2023-10-06T02:24:38.962764+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:24:38.962764+0000","last_undegraded":"2023-10-06T02:24:38.962764+0000","last_fullsized":"2023-10-06T02:24:38.962764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966929+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:11.588397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.979843+0000","last_change":"2023-10-06T02:24:39.979843+0000","last_active":"2023-10-06T02:24:39.979843+0000","last_peered":"2023-10-06T02:24:39.979843+0000","last_clean":"2023-10-06T02:24:39.979843+0000","last_became_active":"2023-10-06T02:24:39.979522+0000","last_became_peered":"2023-10-06T02:24:39.979522+0000","last_unstale":"2023-10-06T02:24:39.979843+0000","last_undegraded":"2023-10-06T02:24:39.979843+0000","last_fullsized":"2023-10-06T02:24:39.979843+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:55.728646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.955617+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:24:38.955617+0000","last_peered":"2023-10-06T02:24:38.955617+0000","last_clean":"2023-10-06T02:24:38.955617+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:24:38.955617+0000","last_undegraded":"2023-10-06T02:24:38.955617+0000","last_fullsized":"2023-10-06T02:24:38.955617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.967822+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:34.541182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976127+0000","last_change":"2023-10-06T02:24:39.976127+0000","last_active":"2023-10-06T02:24:39.976127+0000","last_peered":"2023-10-06T02:24:39.976127+0000","last_clean":"2023-10-06T02:24:39.976127+0000","last_became_active":"2023-10-06T02:24:39.975820+0000","last_became_peered":"2023-10-06T02:24:39.975820+0000","last_unstale":"2023-10-06T02:24:39.976127+0000","last_undegraded":"2023-10-06T02:24:39.976127+0000","last_fullsized":"2023-10-06T02:24:39.976127+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:53.313940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":78,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.963345+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:24:38.963345+0000","last_peered":"2023-10-06T02:24:38.963345+0000","last_clean":"2023-10-06T02:24:38.963345+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:24:38.963345+0000","last_undegraded":"2023-10-06T02:24:38.963345+0000","last_fullsized":"2023-10-06T02:24:38.963345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":227,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.958954+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:24:38.958954+0000","last_peered":"2023-10-06T02:24:38.958954+0000","last_clean":"2023-10-06T02:24:38.958954+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:24:38.958954+0000","last_undegraded":"2023-10-06T02:24:38.958954+0000","last_fullsized":"2023-10-06T02:24:38.958954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965674+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:54.235961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.974456+0000","last_change":"2023-10-06T02:24:39.974456+0000","last_active":"2023-10-06T02:24:39.974456+0000","last_peered":"2023-10-06T02:24:39.974456+0000","last_clean":"2023-10-06T02:24:39.974456+0000","last_became_active":"2023-10-06T02:24:39.974171+0000","last_became_peered":"2023-10-06T02:24:39.974171+0000","last_unstale":"2023-10-06T02:24:39.974456+0000","last_undegraded":"2023-10-06T02:24:39.974456+0000","last_fullsized":"2023-10-06T02:24:39.974456+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:24.102710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.958886+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:24:38.958886+0000","last_peered":"2023-10-06T02:24:38.958886+0000","last_clean":"2023-10-06T02:24:38.958886+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:24:38.958886+0000","last_undegraded":"2023-10-06T02:24:38.958886+0000","last_fullsized":"2023-10-06T02:24:38.958886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966875+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.386207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.974763+0000","last_change":"2023-10-06T02:24:39.974763+0000","last_active":"2023-10-06T02:24:39.974763+0000","last_peered":"2023-10-06T02:24:39.974763+0000","last_clean":"2023-10-06T02:24:39.974763+0000","last_became_active":"2023-10-06T02:24:39.974488+0000","last_became_peered":"2023-10-06T02:24:39.974488+0000","last_unstale":"2023-10-06T02:24:39.974763+0000","last_undegraded":"2023-10-06T02:24:39.974763+0000","last_fullsized":"2023-10-06T02:24:39.974763+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:06.522727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.958855+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:24:38.958855+0000","last_peered":"2023-10-06T02:24:38.958855+0000","last_clean":"2023-10-06T02:24:38.958855+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:24:38.958855+0000","last_undegraded":"2023-10-06T02:24:38.958855+0000","last_fullsized":"2023-10-06T02:24:38.958855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966207+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:17.082986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.978145+0000","last_change":"2023-10-06T02:24:39.978145+0000","last_active":"2023-10-06T02:24:39.978145+0000","last_peered":"2023-10-06T02:24:39.978145+0000","last_clean":"2023-10-06T02:24:39.978145+0000","last_became_active":"2023-10-06T02:24:39.977744+0000","last_became_peered":"2023-10-06T02:24:39.977744+0000","last_unstale":"2023-10-06T02:24:39.978145+0000","last_undegraded":"2023-10-06T02:24:39.978145+0000","last_fullsized":"2023-10-06T02:24:39.978145+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:49.822349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.965535+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:24:38.965535+0000","last_peered":"2023-10-06T02:24:38.965535+0000","last_clean":"2023-10-06T02:24:38.965535+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:24:38.965535+0000","last_undegraded":"2023-10-06T02:24:38.965535+0000","last_fullsized":"2023-10-06T02:24:38.965535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968249+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:15.763729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.977321+0000","last_change":"2023-10-06T02:24:39.977321+0000","last_active":"2023-10-06T02:24:39.977321+0000","last_peered":"2023-10-06T02:24:39.977321+0000","last_clean":"2023-10-06T02:24:39.977321+0000","last_became_active":"2023-10-06T02:24:39.977039+0000","last_became_peered":"2023-10-06T02:24:39.977039+0000","last_unstale":"2023-10-06T02:24:39.977321+0000","last_undegraded":"2023-10-06T02:24:39.977321+0000","last_fullsized":"2023-10-06T02:24:39.977321+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:56.670718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.960197+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:24:38.960197+0000","last_peered":"2023-10-06T02:24:38.960197+0000","last_clean":"2023-10-06T02:24:38.960197+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:24:38.960197+0000","last_undegraded":"2023-10-06T02:24:38.960197+0000","last_fullsized":"2023-10-06T02:24:38.960197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965895+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:34.541182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973325+0000","last_change":"2023-10-06T02:24:39.973325+0000","last_active":"2023-10-06T02:24:39.973325+0000","last_peered":"2023-10-06T02:24:39.973325+0000","last_clean":"2023-10-06T02:24:39.973325+0000","last_became_active":"2023-10-06T02:24:39.973093+0000","last_became_peered":"2023-10-06T02:24:39.973093+0000","last_unstale":"2023-10-06T02:24:39.973325+0000","last_undegraded":"2023-10-06T02:24:39.973325+0000","last_fullsized":"2023-10-06T02:24:39.973325+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:57.861496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.960200+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:24:38.960200+0000","last_peered":"2023-10-06T02:24:38.960200+0000","last_clean":"2023-10-06T02:24:38.960200+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:24:38.960200+0000","last_undegraded":"2023-10-06T02:24:38.960200+0000","last_fullsized":"2023-10-06T02:24:38.960200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298988,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072852,"statfs":{"total":96636764160,"available":96330600448,"internally_reserved":0,"allocated":1740800,"data_stored":1142013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.505},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70899999999999996,"5min":0.79700000000000004,"15min":1.111},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.495},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.83299999999999996,"15min":0.97899999999999998},"last":0.75700000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55600000000000005,"15min":0.51800000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.86299999999999999,"15min":1.008},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.51700000000000002},"min":{"1min":0.371,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79100000000000004,"5min":0.81000000000000005,"15min":1.075},"last":0.58599999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":0.83499999999999996,"15min":1.149},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.623,"15min":0.58299999999999996},"min":{"1min":0.443,"5min":0.41199999999999998,"15min":0.38800000000000001},"max":{"1min":0.80300000000000005,"5min":0.81399999999999995,"15min":1.048},"last":0.73599999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.41199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.75800000000000001,"5min":0.79200000000000004,"15min":1.175},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60499999999999998,"15min":0.57299999999999995},"min":{"1min":0.44900000000000001,"5min":0.41199999999999998,"15min":0.36799999999999999},"max":{"1min":0.70799999999999996,"5min":0.83799999999999997,"15min":1.03},"last":0.77600000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48299999999999998,"15min":0.48599999999999999},"min":{"1min":0.33900000000000002,"5min":0.30399999999999999,"15min":0.29299999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.873},"last":0.437},{"interface":"front","average":{"1min":0.497,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33700000000000002},"max":{"1min":0.67900000000000005,"5min":0.80300000000000005,"15min":0.85299999999999998},"last":0.501}]},{"osd":5,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.378,"5min":0.318,"15min":0.318},"max":{"1min":0.66500000000000004,"5min":0.749,"15min":0.81899999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.40500000000000003,"5min":0.35599999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.38700000000000001},"max":{"1min":0.754,"5min":0.84799999999999998,"15min":0.91700000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.47699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77300000000000002,"5min":0.78600000000000003,"15min":0.89800000000000002},"last":0.622}]}]},{"osd":6,"up_from":13,"seq":55834574937,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298404,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073436,"statfs":{"total":96636764160,"available":96331198464,"internally_reserved":0,"allocated":1142784,"data_stored":550692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56499999999999995,"15min":0.78100000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.752,"5min":0.82399999999999995,"15min":5.6929999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57499999999999996,"15min":0.79500000000000004},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76300000000000001,"5min":0.82799999999999996,"15min":5.7060000000000004},"last":0.48999999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.32500000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.76300000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58199999999999996,"15min":0.53000000000000003},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":0.77200000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56699999999999995,"15min":0.93300000000000005},"min":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.751,"5min":0.82299999999999995,"15min":8.8659999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73099999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58999999999999997,"15min":1.0249999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77000000000000002,"5min":0.86799999999999999,"15min":10.659000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72399999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46700000000000003,"15min":0.50600000000000001},"min":{"1min":0.30599999999999999,"5min":0.30199999999999999,"15min":0.27400000000000002},"max":{"1min":0.52800000000000002,"5min":0.76100000000000001,"15min":0.79600000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.54100000000000004},"min":{"1min":0.32400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.76100000000000001,"15min":0.76500000000000001},"last":0.34100000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.49399999999999999,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68400000000000005,"5min":0.746,"15min":0.78300000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.51800000000000002,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.69799999999999995,"5min":0.82699999999999996,"15min":0.84399999999999997},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54800000000000004,"15min":0.58399999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.312},"max":{"1min":0.755,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58299999999999996,"15min":0.626},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.752,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.47299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298984,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072856,"statfs":{"total":96636764160,"available":96330604544,"internally_reserved":0,"allocated":1736704,"data_stored":1141060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.377,"15min":0.35099999999999998},"min":{"1min":0.20300000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.497,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.39900000000000002,"15min":0.36099999999999999},"min":{"1min":0.28199999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51000000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35599999999999998,"15min":0.32700000000000001},"min":{"1min":0.22500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.46100000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41399999999999998,"15min":0.38600000000000001},"min":{"1min":0.252,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.621,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.27200000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.434,"15min":0.38700000000000001},"min":{"1min":0.26900000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.57399999999999995,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40999999999999998,"15min":0.38600000000000001},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.58799999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.28399999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60999999999999999,"15min":0.56499999999999995},"min":{"1min":0.46500000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81499999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.443},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.47299999999999998,"5min":0.38700000000000001,"15min":0.376},"max":{"1min":0.77000000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47699999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.501,"5min":0.37,"15min":0.37},"max":{"1min":0.746,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66700000000000004,"15min":0.628},"min":{"1min":0.48999999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85799999999999998,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.55000000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.59399999999999997},"min":{"1min":0.47199999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85199999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64300000000000002,"15min":0.59799999999999998},"min":{"1min":0.52900000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.81799999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.43099999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66000000000000003,"15min":0.624},"min":{"1min":0.51300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.78700000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.64100000000000001,"15min":0.60899999999999999},"min":{"1min":0.48599999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78300000000000003,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.46500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574936,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1134592,"data_stored":544709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.314},"min":{"1min":0.25600000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.35099999999999998},"min":{"1min":0.28599999999999998,"5min":0.26600000000000001,"15min":0.246},"max":{"1min":0.58799999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.35699999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41899999999999998,"15min":0.377},"min":{"1min":0.29299999999999998,"5min":0.26500000000000001,"15min":0.20599999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.371,"5min":0.373,"15min":0.33400000000000002},"min":{"1min":0.26400000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.53100000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.30499999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41299999999999998,"15min":0.38700000000000001},"min":{"1min":0.25800000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.63100000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.41599999999999998},"min":{"1min":0.317,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.84799999999999998,"5min":0.92100000000000004,"15min":1.369},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.629,"15min":0.56499999999999995},"min":{"1min":0.51500000000000001,"5min":0.42699999999999999,"15min":0.41099999999999998},"max":{"1min":0.83799999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.502}]},{"osd":5,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63900000000000001,"15min":0.60899999999999999},"min":{"1min":0.52100000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88400000000000001,"5min":0.98999999999999999,"15min":1.3320000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.65000000000000002,"15min":0.60299999999999998},"min":{"1min":0.47999999999999998,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.80500000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65300000000000002,"15min":0.626},"min":{"1min":0.45300000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91700000000000004,"5min":0.95299999999999996,"15min":1.3999999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66400000000000003,"15min":0.60899999999999999},"min":{"1min":0.50800000000000001,"5min":0.46700000000000003,"15min":0.39800000000000002},"max":{"1min":1.0249999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64900000000000002,"15min":1.0089999999999999},"min":{"1min":0.47899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":11.138},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68000000000000005,"15min":0.63800000000000001},"min":{"1min":0.503,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.429},"last":0.47699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574936,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298404,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073436,"statfs":{"total":96636764160,"available":96331198464,"internally_reserved":0,"allocated":1142784,"data_stored":550692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.374,"15min":0.36899999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.52000000000000002,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40300000000000002,"15min":0.376},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42799999999999999,"15min":0.38700000000000001},"min":{"1min":0.247,"5min":0.24299999999999999,"15min":0.23000000000000001},"max":{"1min":0.59599999999999997,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.45300000000000001,"15min":0.40500000000000003},"min":{"1min":0.28799999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.58299999999999996,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40699999999999997,"15min":0.377},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55000000000000004,"5min":1.423,"15min":1.423},"last":0.443},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45400000000000001,"15min":0.42599999999999999},"min":{"1min":0.33300000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66500000000000004,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.625,"15min":0.58499999999999996},"min":{"1min":0.439,"5min":0.38600000000000001,"15min":0.377},"max":{"1min":0.80300000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.63100000000000001,"15min":0.61799999999999999},"min":{"1min":0.44700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.60899999999999999},"min":{"1min":0.438,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83699999999999997,"5min":1.304,"15min":1.304},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.42299999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73899999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.42499999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96099999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.66100000000000003,"15min":0.63300000000000001},"min":{"1min":0.51600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.89200000000000002,"5min":1.347,"15min":1.347},"last":0.77300000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67100000000000004,"15min":0.66200000000000003},"min":{"1min":0.47499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98599999999999999,"5min":1.206,"15min":1.206},"last":0.625},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68700000000000006,"15min":0.67300000000000004},"min":{"1min":0.47799999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.87,"5min":1.385,"15min":1.385},"last":0.67000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298408,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073432,"statfs":{"total":96636764160,"available":96331194368,"internally_reserved":0,"allocated":1146880,"data_stored":551645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.23300000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.54900000000000004,"5min":0.55500000000000005,"15min":0.61299999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.38200000000000001,"15min":0.38800000000000001},"min":{"1min":0.26500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.78100000000000003},"last":0.32600000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.379,"15min":0.371},"min":{"1min":0.28299999999999997,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58399999999999996,"5min":0.66100000000000003,"15min":0.66700000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.40200000000000002},"min":{"1min":0.29099999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.40400000000000003},"min":{"1min":0.26700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.41099999999999998},"min":{"1min":0.34999999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.36499999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.58799999999999997},"min":{"1min":0.438,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.441},{"interface":"front","average":{"1min":0.624,"5min":0.62,"15min":0.59899999999999998},"min":{"1min":0.44400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91400000000000003,"5min":0.96599999999999997,"15min":1.1539999999999999},"last":0.48799999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.623,"15min":0.623},"min":{"1min":0.44800000000000001,"5min":0.40400000000000003,"15min":0.36399999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.2110000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.46400000000000002,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":1.0129999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.41999999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63100000000000001,"15min":0.59499999999999997},"min":{"1min":0.45300000000000001,"5min":0.42999999999999999,"15min":0.40600000000000003},"max":{"1min":0.879,"5min":0.91100000000000003,"15min":1.0700000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.53300000000000003,"5min":0.442,"15min":0.38600000000000001},"max":{"1min":0.91200000000000003,"5min":0.996,"15min":1.391},"last":0.40799999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.39500000000000002},"max":{"1min":0.97199999999999998,"5min":1.121,"15min":1.121},"last":0.5},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65500000000000003,"15min":0.61499999999999999},"min":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.42799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574936,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1134592,"data_stored":544709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.54800000000000004},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.217},"max":{"1min":0.68600000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64100000000000001,"15min":0.59699999999999998},"min":{"1min":0.39700000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.74199999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58999999999999997,"15min":1.0920000000000001},"min":{"1min":0.42899999999999999,"5min":0.38600000000000001,"15min":0.34899999999999998},"max":{"1min":1.77,"5min":1.77,"15min":17.879999999999999},"last":0.63},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57499999999999996,"15min":1.073},"min":{"1min":0.44,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71199999999999997,"5min":0.84699999999999998,"15min":18.010999999999999},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.53600000000000003},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.59899999999999998,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.69399999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59299999999999997,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.29899999999999999},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.56799999999999995},"min":{"1min":0.45700000000000002,"5min":0.373,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56299999999999994}]},{"osd":5,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.30499999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41699999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.53800000000000003,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.38200000000000001,"5min":0.36799999999999999,"15min":0.36199999999999999},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.504}]},{"osd":7,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.42299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.72899999999999998,"5min":0.81399999999999995,"15min":0.83999999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58999999999999997,"15min":0.61599999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78700000000000003,"5min":0.82099999999999995,"15min":0.83299999999999996},"last":0.48799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574935,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298408,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073432,"statfs":{"total":96636764160,"available":96331194368,"internally_reserved":0,"allocated":1146880,"data_stored":551645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55000000000000004,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.80300000000000005,"5min":1.103,"15min":1.103},"last":0.499},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54400000000000004,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.56499999999999995},"min":{"1min":0.47199999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81699999999999995,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.55500000000000005},"min":{"1min":0.40699999999999997,"5min":0.35899999999999999,"15min":0.33900000000000002},"max":{"1min":0.85499999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.38500000000000001,"15min":0.30399999999999999},"max":{"1min":0.78100000000000003,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.745,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.54500000000000004},"min":{"1min":0.443,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70799999999999996,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.57199999999999995},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.67900000000000005}]},{"osd":4,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47999999999999998,"15min":0.50800000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.49299999999999999,"15min":0.501},"min":{"1min":0.33700000000000002,"5min":0.308,"15min":0.26500000000000001},"max":{"1min":0.65700000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39800000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.504,"15min":0.51600000000000001},"min":{"1min":0.42399999999999999,"5min":0.29299999999999998,"15min":0.28299999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.57099999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.73999999999999999},"last":0.47099999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.54700000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68100000000000005,"5min":0.73799999999999999,"15min":0.78400000000000003},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57299999999999995,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:24:45.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2023-10-06T02:24:45.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.962840+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:23:35.595154+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:24:45.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2023-10-06T02:24:45.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.966341+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:52:04.611329+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:24:45.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2023-10-06T02:24:45.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.962972+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:45:08.104824+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:24:45.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2023-10-06T02:24:45.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.970819+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:03:14.968616+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:24:45.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2023-10-06T02:24:45.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.966809+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:31:48.691542+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:24:45.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2023-10-06T02:24:45.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.967399+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:31:48.691542+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:24:45.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2023-10-06T02:24:45.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.964865+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:58:25.853328+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:24:45.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2023-10-06T02:24:45.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.962939+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:17:18.986033+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:24:45.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2023-10-06T02:24:45.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.969406+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:41:25.296557+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:24:45.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2023-10-06T02:24:45.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.965643+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:55:16.889594+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:24:45.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2023-10-06T02:24:45.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.968341+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:45:05.568051+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:24:45.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2023-10-06T02:24:45.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.966059+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:58:54.318904+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:24:45.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2023-10-06T02:24:45.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.972145+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:18:07.298300+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:24:45.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2023-10-06T02:24:45.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.967417+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:58:10.688548+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:24:45.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2023-10-06T02:24:45.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.965936+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:34:56.221122+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:24:45.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2023-10-06T02:24:45.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.964954+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:46:09.927108+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:24:45.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2023-10-06T02:24:45.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.962853+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:14:07.518324+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:24:45.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2023-10-06T02:24:45.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.966367+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:28:31.150685+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:24:45.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2023-10-06T02:24:45.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.969657+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:03:54.410478+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:24:45.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2023-10-06T02:24:45.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.964850+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:30:56.733610+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:24:45.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2023-10-06T02:24:45.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.964892+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:57:57.079752+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:24:45.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2023-10-06T02:24:45.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.962667+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:31:35.995255+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:24:45.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2023-10-06T02:24:45.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.961747+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:40:24.399041+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:24:45.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2023-10-06T02:24:45.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.964471+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:55:16.889594+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:24:45.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2023-10-06T02:24:45.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.964276+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:23:39.056675+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:24:45.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2023-10-06T02:24:45.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.964670+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:35:37.491221+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:24:45.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2023-10-06T02:24:45.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.969221+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:28:31.150685+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:24:45.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2023-10-06T02:24:45.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.969607+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:57:51.110568+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:24:45.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2023-10-06T02:24:45.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.963406+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:05:21.894393+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:24:45.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2023-10-06T02:24:45.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.966049+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:16:18.756486+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:24:45.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2023-10-06T02:24:45.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.965429+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:25:56.791580+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:24:45.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2023-10-06T02:24:45.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.964023+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:52:45.635203+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:24:45.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2023-10-06T02:24:45.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.967322+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:27:05.195018+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:24:45.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2023-10-06T02:24:45.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.970382+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:43:56.817052+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:24:45.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2023-10-06T02:24:45.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.962729+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:24:05.211450+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:24:45.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2023-10-06T02:24:45.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.964790+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:13:04.227594+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:24:45.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2023-10-06T02:24:45.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.963756+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:09:49.244903+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:24:45.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2023-10-06T02:24:45.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.964280+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:32:17.082986+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:24:45.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2023-10-06T02:24:45.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.965608+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:34:44.335946+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:24:45.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2023-10-06T02:24:45.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.964043+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:27:23.015663+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:24:45.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2023-10-06T02:24:45.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.965410+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:24:27.723364+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:24:45.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2023-10-06T02:24:45.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.968917+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:13:40.143074+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:24:45.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2023-10-06T02:24:45.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.966347+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:46:09.927108+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:24:45.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2023-10-06T02:24:45.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.968759+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:52:16.842155+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:24:45.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2023-10-06T02:24:45.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.966425+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:43:03.453032+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:24:45.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2023-10-06T02:24:45.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.961747+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:50:48.724533+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:24:45.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2023-10-06T02:24:45.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.968317+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:20:24.307089+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:24:45.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2023-10-06T02:24:45.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.964527+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:51:24.682393+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:24:45.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2023-10-06T02:24:45.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.965916+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:38:33.050770+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:24:45.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2023-10-06T02:24:45.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.962345+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:15:32.991704+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:24:45.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2023-10-06T02:24:45.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.962263+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:54:54.104551+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:24:45.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2023-10-06T02:24:45.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.966116+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:58:25.853328+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:24:45.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2023-10-06T02:24:45.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.966502+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:43:30.709839+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:24:45.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2023-10-06T02:24:45.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.964494+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:55:00.118004+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:24:45.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2023-10-06T02:24:45.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.968695+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:10:33.809744+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:24:45.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2023-10-06T02:24:45.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.963647+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:47:46.230022+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:24:45.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2023-10-06T02:24:45.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.965960+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:56:31.994955+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:24:45.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2023-10-06T02:24:45.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.966929+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:26:11.588397+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:24:45.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2023-10-06T02:24:45.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.967822+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:01:34.541182+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:24:45.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2023-10-06T02:24:45.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.965674+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:52:54.235961+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:24:45.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2023-10-06T02:24:45.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.966875+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:03:13.386207+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:24:45.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2023-10-06T02:24:45.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.966207+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:32:17.082986+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:24:45.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2023-10-06T02:24:45.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.968249+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:42:15.763729+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:24:45.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2023-10-06T02:24:45.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:24:39.954191+0000', 'last_change': '2023-10-06T02:24:39.965895+0000', 'last_active': '2023-10-06T02:24:39.954191+0000', 'last_peered': '2023-10-06T02:24:39.954191+0000', 'last_clean': '2023-10-06T02:24:39.954191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:24:39.954191+0000', 'last_undegraded': '2023-10-06T02:24:39.954191+0000', 'last_fullsized': '2023-10-06T02:24:39.954191+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'last_clean_scrub_stamp': '2023-10-06T02:24:39.954191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:01:34.541182+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:24:45.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:24:46.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.002+0000 7f48ed5ef700 1 Processor -- start 2023-10-06T02:24:46.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.002+0000 7f48ed5ef700 1 -- start start 2023-10-06T02:24:46.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.003+0000 7f48ed5ef700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f48e8159070 0x7f48e80b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.003+0000 7f48ed5ef700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48e8159440 0x7f48e80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.003+0000 7f48ed5ef700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48e8069fc0 0x7f48e806a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.003+0000 7f48ed5ef700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e80b38a0 con 0x7f48e8159440 2023-10-06T02:24:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.003+0000 7f48ed5ef700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e806a910 con 0x7f48e8159070 2023-10-06T02:24:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.003+0000 7f48ed5ef700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e80b2f90 con 0x7f48e8069fc0 2023-10-06T02:24:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.003+0000 7f48e67fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48e8159440 0x7f48e80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.003+0000 7f48e67fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48e8159440 0x7f48e80cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46318/0 (socket says 172.21.15.6:46318) 2023-10-06T02:24:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.003+0000 7f48e67fc700 1 -- 172.21.15.6:0/3486952506 learned_addr learned my addr 172.21.15.6:0/3486952506 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.003+0000 7f48e77fe700 1 --2- 172.21.15.6:0/3486952506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48e8069fc0 0x7f48e806a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.003+0000 7f48e6ffd700 1 --2- 172.21.15.6:0/3486952506 >> v2:172.21.15.175:3300/0 conn(0x7f48e8159070 0x7f48e80b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.003+0000 7f48e67fc700 1 -- 172.21.15.6:0/3486952506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48e8069fc0 msgr2=0x7f48e806a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.003+0000 7f48e67fc700 1 --2- 172.21.15.6:0/3486952506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48e8069fc0 0x7f48e806a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.003+0000 7f48e67fc700 1 -- 172.21.15.6:0/3486952506 >> v2:172.21.15.175:3300/0 conn(0x7f48e8159070 msgr2=0x7f48e80b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.003+0000 7f48e67fc700 1 --2- 172.21.15.6:0/3486952506 >> v2:172.21.15.175:3300/0 conn(0x7f48e8159070 0x7f48e80b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.003+0000 7f48e67fc700 1 -- 172.21.15.6:0/3486952506 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e80cfab0 con 0x7f48e8159440 2023-10-06T02:24:46.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.004+0000 7f48e67fc700 1 --2- 172.21.15.6:0/3486952506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e8159440 0x7f48e80cf290 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f48e8089290 tx=0x7f48dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877de54816ba7556 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:46.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.004+0000 7f48e5ffb700 1 -- 172.21.15.6:0/3486952506 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc00b640 con 0x7f48e8159440 2023-10-06T02:24:46.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.004+0000 7f48e5ffb700 1 -- 172.21.15.6:0/3486952506 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48dc00b7a0 con 0x7f48e8159440 2023-10-06T02:24:46.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.004+0000 7f48e5ffb700 1 -- 172.21.15.6:0/3486952506 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc00bb60 con 0x7f48e8159440 2023-10-06T02:24:46.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.004+0000 7f48ed5ef700 1 -- 172.21.15.6:0/3486952506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e8159440 msgr2=0x7f48e80cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.004+0000 7f48ed5ef700 1 --2- 172.21.15.6:0/3486952506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e8159440 0x7f48e80cf290 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f48e8089290 tx=0x7f48dc009250 comp rx=0 tx=0).stop 2023-10-06T02:24:46.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.004+0000 7f48ed5ef700 1 -- 172.21.15.6:0/3486952506 shutdown_connections 2023-10-06T02:24:46.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.004+0000 7f48ed5ef700 1 --2- 172.21.15.6:0/3486952506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48e8069fc0 0x7f48e806a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.004+0000 7f48ed5ef700 1 --2- 172.21.15.6:0/3486952506 >> v2:172.21.15.175:3300/0 conn(0x7f48e8159070 0x7f48e80b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.004+0000 7f48ed5ef700 1 --2- 172.21.15.6:0/3486952506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e8159440 0x7f48e80cf290 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.004+0000 7f48ed5ef700 1 -- 172.21.15.6:0/3486952506 >> 172.21.15.6:0/3486952506 conn(0x7f48e8087c90 msgr2=0x7f48e80b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.004+0000 7f48ed5ef700 1 -- 172.21.15.6:0/3486952506 shutdown_connections 2023-10-06T02:24:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.004+0000 7f48ed5ef700 1 -- 172.21.15.6:0/3486952506 wait complete. 2023-10-06T02:24:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.006+0000 7f48ed5ef700 1 Processor -- start 2023-10-06T02:24:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.006+0000 7f48ed5ef700 1 -- start start 2023-10-06T02:24:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.006+0000 7f48ed5ef700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48e8069fc0 0x7f48e8153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.006+0000 7f48ed5ef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e8159070 0x7f48e816a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.006+0000 7f48ed5ef700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48e8159440 0x7f48e80cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.006+0000 7f48ed5ef700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e816a860 con 0x7f48e8159070 2023-10-06T02:24:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48ed5ef700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e80c9690 con 0x7f48e8069fc0 2023-10-06T02:24:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48ed5ef700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e80c9970 con 0x7f48e8159440 2023-10-06T02:24:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48e67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e8159070 0x7f48e816a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48e67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e8159070 0x7f48e816a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46326/0 (socket says 172.21.15.6:46326) 2023-10-06T02:24:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48e67fc700 1 -- 172.21.15.6:0/3190454784 learned_addr learned my addr 172.21.15.6:0/3190454784 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48e6ffd700 1 --2- 172.21.15.6:0/3190454784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48e8069fc0 0x7f48e8153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48e77fe700 1 --2- 172.21.15.6:0/3190454784 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48e8159440 0x7f48e80cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48e67fc700 1 -- 172.21.15.6:0/3190454784 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48e8159440 msgr2=0x7f48e80cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48e67fc700 1 --2- 172.21.15.6:0/3190454784 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48e8159440 0x7f48e80cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48e67fc700 1 -- 172.21.15.6:0/3190454784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48e8069fc0 msgr2=0x7f48e8153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48e67fc700 1 --2- 172.21.15.6:0/3190454784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48e8069fc0 0x7f48e8153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48e67fc700 1 -- 172.21.15.6:0/3190454784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc0094f0 con 0x7f48e8159070 2023-10-06T02:24:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48e67fc700 1 --2- 172.21.15.6:0/3190454784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e8159070 0x7f48e816a320 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f48e80650b0 tx=0x7f48dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48ceffd700 1 -- 172.21.15.6:0/3190454784 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc00b910 con 0x7f48e8159070 2023-10-06T02:24:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48ceffd700 1 -- 172.21.15.6:0/3190454784 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48dc00ba70 con 0x7f48e8159070 2023-10-06T02:24:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48ed5ef700 1 -- 172.21.15.6:0/3190454784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e80c9c50 con 0x7f48e8159070 2023-10-06T02:24:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48ceffd700 1 -- 172.21.15.6:0/3190454784 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc011630 con 0x7f48e8159070 2023-10-06T02:24:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.007+0000 7f48ed5ef700 1 -- 172.21.15.6:0/3190454784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e80ca210 con 0x7f48e8159070 2023-10-06T02:24:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.008+0000 7f48ed5ef700 1 -- 172.21.15.6:0/3190454784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e80ca400 con 0x7f48e8159070 2023-10-06T02:24:46.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.009+0000 7f48ceffd700 1 -- 172.21.15.6:0/3190454784 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48dc0119a0 con 0x7f48e8159070 2023-10-06T02:24:46.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.009+0000 7f48ceffd700 1 --2- 172.21.15.6:0/3190454784 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f48d4066f30 0x7f48d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.009+0000 7f48ceffd700 1 -- 172.21.15.6:0/3190454784 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f48dc085db0 con 0x7f48e8159070 2023-10-06T02:24:46.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.009+0000 7f48e6ffd700 1 --2- 172.21.15.6:0/3190454784 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f48d4066f30 0x7f48d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.010+0000 7f48e6ffd700 1 --2- 172.21.15.6:0/3190454784 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f48d4066f30 0x7f48d40693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f48d8009db0 tx=0x7f48d80091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:46.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.013+0000 7f48ceffd700 1 -- 172.21.15.6:0/3190454784 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48dc052d80 con 0x7f48e8159070 2023-10-06T02:24:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.288+0000 7f48ed5ef700 1 -- 172.21.15.6:0/3190454784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f48e80b3250 con 0x7f48e8159070 2023-10-06T02:24:46.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.289+0000 7f48ceffd700 1 -- 172.21.15.6:0/3190454784 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1457 (secure 0 0 0) 0x7f48dc0563a0 con 0x7f48e8159070 2023-10-06T02:24:46.290 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:46.290 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"c557bd13-0401-4965-a08f-5579f545617e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":441,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1696558654,"num_in_osds":8,"osd_in_since":1696558647,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":2445709312,"bytes_avail":770648403968,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":86,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7242}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2023-10-06T02:24:34.662671+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T02:24:46.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.291+0000 7f48ed5ef700 1 -- 172.21.15.6:0/3190454784 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f48d4066f30 msgr2=0x7f48d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.291+0000 7f48ed5ef700 1 --2- 172.21.15.6:0/3190454784 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f48d4066f30 0x7f48d40693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f48d8009db0 tx=0x7f48d80091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.291+0000 7f48ed5ef700 1 -- 172.21.15.6:0/3190454784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e8159070 msgr2=0x7f48e816a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.291+0000 7f48ed5ef700 1 --2- 172.21.15.6:0/3190454784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e8159070 0x7f48e816a320 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f48e80650b0 tx=0x7f48dc017000 comp rx=0 tx=0).stop 2023-10-06T02:24:46.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.291+0000 7f48ed5ef700 1 -- 172.21.15.6:0/3190454784 shutdown_connections 2023-10-06T02:24:46.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.291+0000 7f48ed5ef700 1 --2- 172.21.15.6:0/3190454784 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48e8159440 0x7f48e80cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.291+0000 7f48ed5ef700 1 --2- 172.21.15.6:0/3190454784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48e8069fc0 0x7f48e8153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.291+0000 7f48ed5ef700 1 --2- 172.21.15.6:0/3190454784 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f48d4066f30 0x7f48d40693e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.291+0000 7f48ed5ef700 1 --2- 172.21.15.6:0/3190454784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e8159070 0x7f48e816a320 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.291+0000 7f48ed5ef700 1 -- 172.21.15.6:0/3190454784 >> 172.21.15.6:0/3190454784 conn(0x7f48e8087c90 msgr2=0x7f48e815b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:46.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.291+0000 7f48ed5ef700 1 -- 172.21.15.6:0/3190454784 shutdown_connections 2023-10-06T02:24:46.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.291+0000 7f48ed5ef700 1 -- 172.21.15.6:0/3190454784 wait complete. 2023-10-06T02:24:46.304 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T02:24:46.304 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:24:46.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.422+0000 7f0a557d6700 1 Processor -- start 2023-10-06T02:24:46.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.422+0000 7f0a557d6700 1 -- start start 2023-10-06T02:24:46.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.423+0000 7f0a557d6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a500b27f0 0x7f0a5015db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.423+0000 7f0a557d6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5015e190 con 0x7f0a500af4e0 2023-10-06T02:24:46.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.423+0000 7f0a557d6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a500cb650 con 0x7f0a500af8b0 2023-10-06T02:24:46.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.423+0000 7f0a557d6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a500b1910 con 0x7f0a500b27f0 2023-10-06T02:24:46.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.423+0000 7f0a4f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a500b27f0 0x7f0a5015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.423+0000 7f0a4effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0a500af4e0 0x7f0a500b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43836/0 (socket says 172.21.15.6:43836) 2023-10-06T02:24:46.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.423+0000 7f0a4f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a500b27f0 0x7f0a5015db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46338/0 (socket says 172.21.15.6:46338) 2023-10-06T02:24:46.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.423+0000 7f0a4effd700 1 -- 172.21.15.6:0/1374067804 learned_addr learned my addr 172.21.15.6:0/1374067804 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:46.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.423+0000 7f0a4f7fe700 1 -- 172.21.15.6:0/1374067804 >> v1:172.21.15.175:6789/0 conn(0x7f0a500af8b0 legacy=0x7f0a5015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:46.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.423+0000 7f0a4f7fe700 1 -- 172.21.15.6:0/1374067804 >> v1:172.21.15.6:6789/0 conn(0x7f0a500af4e0 legacy=0x7f0a500b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.423+0000 7f0a4f7fe700 1 -- 172.21.15.6:0/1374067804 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a500ccaf0 con 0x7f0a500b27f0 2023-10-06T02:24:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.423+0000 7f0a4f7fe700 1 --2- 172.21.15.6:0/1374067804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a500b27f0 0x7f0a5015db70 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009e60 tx=0x7f0a48009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308f1448c0bded36 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.423+0000 7f0a4dffb700 1 -- 172.21.15.6:0/1374067804 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4800e070 con 0x7f0a500b27f0 2023-10-06T02:24:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.423+0000 7f0a4dffb700 1 -- 172.21.15.6:0/1374067804 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4800bbf0 con 0x7f0a500b27f0 2023-10-06T02:24:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.423+0000 7f0a4dffb700 1 -- 172.21.15.6:0/1374067804 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a48012430 con 0x7f0a500b27f0 2023-10-06T02:24:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.424+0000 7f0a557d6700 1 -- 172.21.15.6:0/1374067804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a500b27f0 msgr2=0x7f0a5015db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.424+0000 7f0a557d6700 1 --2- 172.21.15.6:0/1374067804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a500b27f0 0x7f0a5015db70 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009e60 tx=0x7f0a48009780 comp rx=0 tx=0).stop 2023-10-06T02:24:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.424+0000 7f0a557d6700 1 -- 172.21.15.6:0/1374067804 shutdown_connections 2023-10-06T02:24:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.424+0000 7f0a557d6700 1 --2- 172.21.15.6:0/1374067804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a500b27f0 0x7f0a5015db70 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.424+0000 7f0a557d6700 1 -- 172.21.15.6:0/1374067804 >> 172.21.15.6:0/1374067804 conn(0x7f0a50068680 msgr2=0x7f0a50068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.424+0000 7f0a557d6700 1 -- 172.21.15.6:0/1374067804 shutdown_connections 2023-10-06T02:24:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.424+0000 7f0a557d6700 1 -- 172.21.15.6:0/1374067804 wait complete. 2023-10-06T02:24:46.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.425+0000 7f0a557d6700 1 Processor -- start 2023-10-06T02:24:46.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.425+0000 7f0a557d6700 1 -- start start 2023-10-06T02:24:46.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.426+0000 7f0a557d6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a500af4e0 0x7f0a500ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.426+0000 7f0a557d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a500af8b0 0x7f0a5016a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.426+0000 7f0a557d6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a500b27f0 0x7f0a5016ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.426+0000 7f0a557d6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500c7c10 con 0x7f0a500af8b0 2023-10-06T02:24:46.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.426+0000 7f0a557d6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500c7300 con 0x7f0a500b27f0 2023-10-06T02:24:46.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.426+0000 7f0a557d6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500cf770 con 0x7f0a500af4e0 2023-10-06T02:24:46.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.426+0000 7f0a4e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a500af8b0 0x7f0a5016a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.426+0000 7f0a4e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a500af8b0 0x7f0a5016a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46350/0 (socket says 172.21.15.6:46350) 2023-10-06T02:24:46.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.426+0000 7f0a4e7fc700 1 -- 172.21.15.6:0/623306749 learned_addr learned my addr 172.21.15.6:0/623306749 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:46.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.426+0000 7f0a4effd700 1 --2- 172.21.15.6:0/623306749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a500af4e0 0x7f0a500ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.426+0000 7f0a4f7fe700 1 --2- 172.21.15.6:0/623306749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a500b27f0 0x7f0a5016ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.426+0000 7f0a4e7fc700 1 -- 172.21.15.6:0/623306749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a500af4e0 msgr2=0x7f0a500ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.426+0000 7f0a4e7fc700 1 --2- 172.21.15.6:0/623306749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a500af4e0 0x7f0a500ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.426+0000 7f0a4e7fc700 1 -- 172.21.15.6:0/623306749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a500b27f0 msgr2=0x7f0a5016ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.426+0000 7f0a4e7fc700 1 --2- 172.21.15.6:0/623306749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a500b27f0 0x7f0a5016ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.426+0000 7f0a4e7fc700 1 -- 172.21.15.6:0/623306749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a48009a20 con 0x7f0a500af8b0 2023-10-06T02:24:46.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.426+0000 7f0a4e7fc700 1 --2- 172.21.15.6:0/623306749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a500af8b0 0x7f0a5016a800 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400c590 tx=0x7f0a44007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:46.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.427+0000 7f0a36ffd700 1 -- 172.21.15.6:0/623306749 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a44011590 con 0x7f0a500af8b0 2023-10-06T02:24:46.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.427+0000 7f0a36ffd700 1 -- 172.21.15.6:0/623306749 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a44011730 con 0x7f0a500af8b0 2023-10-06T02:24:46.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.427+0000 7f0a36ffd700 1 -- 172.21.15.6:0/623306749 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a44011af0 con 0x7f0a500af8b0 2023-10-06T02:24:46.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.427+0000 7f0a557d6700 1 -- 172.21.15.6:0/623306749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a500c75c0 con 0x7f0a500af8b0 2023-10-06T02:24:46.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.427+0000 7f0a557d6700 1 -- 172.21.15.6:0/623306749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a500c80a0 con 0x7f0a500af8b0 2023-10-06T02:24:46.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.428+0000 7f0a557d6700 1 -- 172.21.15.6:0/623306749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a50088aa0 con 0x7f0a500af8b0 2023-10-06T02:24:46.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.428+0000 7f0a36ffd700 1 -- 172.21.15.6:0/623306749 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a4401c460 con 0x7f0a500af8b0 2023-10-06T02:24:46.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.428+0000 7f0a36ffd700 1 --2- 172.21.15.6:0/623306749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a3c066f30 0x7f0a3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.428+0000 7f0a36ffd700 1 -- 172.21.15.6:0/623306749 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0a44084610 con 0x7f0a500af8b0 2023-10-06T02:24:46.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.429+0000 7f0a4effd700 1 --2- 172.21.15.6:0/623306749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a3c066f30 0x7f0a3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.429+0000 7f0a4effd700 1 --2- 172.21.15.6:0/623306749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a3c066f30 0x7f0a3c0693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0a500b5bc0 tx=0x7f0a40009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:46.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.433+0000 7f0a36ffd700 1 -- 172.21.15.6:0/623306749 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a440515e0 con 0x7f0a500af8b0 2023-10-06T02:24:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.620+0000 7f0a557d6700 1 -- 172.21.15.6:0/623306749 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a500c7d50 con 0x7f0a3c066f30 2023-10-06T02:24:46.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.629+0000 7f0a36ffd700 1 -- 172.21.15.6:0/623306749 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308642 (secure 0 0 0) 0x7f0a500c7d50 con 0x7f0a3c066f30 2023-10-06T02:24:46.634 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.632+0000 7f0a557d6700 1 -- 172.21.15.6:0/623306749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a3c066f30 msgr2=0x7f0a3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.632+0000 7f0a557d6700 1 --2- 172.21.15.6:0/623306749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a3c066f30 0x7f0a3c0693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0a500b5bc0 tx=0x7f0a40009040 comp rx=0 tx=0).stop 2023-10-06T02:24:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.632+0000 7f0a557d6700 1 -- 172.21.15.6:0/623306749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a500af8b0 msgr2=0x7f0a5016a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.632+0000 7f0a557d6700 1 --2- 172.21.15.6:0/623306749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a500af8b0 0x7f0a5016a800 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400c590 tx=0x7f0a44007f30 comp rx=0 tx=0).stop 2023-10-06T02:24:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.632+0000 7f0a557d6700 1 -- 172.21.15.6:0/623306749 shutdown_connections 2023-10-06T02:24:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.632+0000 7f0a557d6700 1 --2- 172.21.15.6:0/623306749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a500b27f0 0x7f0a5016ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.632+0000 7f0a557d6700 1 --2- 172.21.15.6:0/623306749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a500af4e0 0x7f0a500ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.632+0000 7f0a557d6700 1 --2- 172.21.15.6:0/623306749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a3c066f30 0x7f0a3c0693e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.632+0000 7f0a557d6700 1 --2- 172.21.15.6:0/623306749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a500af8b0 0x7f0a5016a800 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.632+0000 7f0a557d6700 1 -- 172.21.15.6:0/623306749 >> 172.21.15.6:0/623306749 conn(0x7f0a50068680 msgr2=0x7f0a5015af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.632+0000 7f0a557d6700 1 -- 172.21.15.6:0/623306749 shutdown_connections 2023-10-06T02:24:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:46.632+0000 7f0a557d6700 1 -- 172.21.15.6:0/623306749 wait complete. 2023-10-06T02:24:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:24:46.646 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2023-10-06T02:24:44.664828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2388388,"kb_used_data":10084,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752586332,"statfs":{"total":773094113280,"available":770648403968,"internally_reserved":0,"allocated":10326016,"data_stored":5577165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.710250"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962840+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:35.595154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966341+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.611329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962972+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:08.104824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.970819+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.968616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966809+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:48.691542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.967399+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:48.691542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964865+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:25.853328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962939+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:18.986033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.969406+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:25.296557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965643+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:16.889594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968341+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:05.568051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966059+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:54.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.972145+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:07.298300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.967417+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:58:10.688548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965936+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:56.221122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964954+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:09.927108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962853+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:07.518324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966367+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:31.150685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.969657+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:54.410478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964850+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:56.733610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964892+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:57.079752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962667+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:35.995255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.961747+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:24.399041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964471+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:16.889594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964276+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:39.056675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964670+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:35:37.491221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.969221+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:31.150685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.969607+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:51.110568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.963406+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:21.894393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966049+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.756486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965429+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:56.791580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964023+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:45.635203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.967322+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:05.195018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.975085+0000","last_change":"2023-10-06T02:24:39.975085+0000","last_active":"2023-10-06T02:24:39.975085+0000","last_peered":"2023-10-06T02:24:39.975085+0000","last_clean":"2023-10-06T02:24:39.975085+0000","last_became_active":"2023-10-06T02:24:39.974819+0000","last_became_peered":"2023-10-06T02:24:39.974819+0000","last_unstale":"2023-10-06T02:24:39.975085+0000","last_undegraded":"2023-10-06T02:24:39.975085+0000","last_fullsized":"2023-10-06T02:24:39.975085+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:22.010699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.970382+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:56.817052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.974072+0000","last_change":"2023-10-06T02:24:39.974072+0000","last_active":"2023-10-06T02:24:39.974072+0000","last_peered":"2023-10-06T02:24:39.974072+0000","last_clean":"2023-10-06T02:24:39.974072+0000","last_became_active":"2023-10-06T02:24:39.973802+0000","last_became_peered":"2023-10-06T02:24:39.973802+0000","last_unstale":"2023-10-06T02:24:39.974072+0000","last_undegraded":"2023-10-06T02:24:39.974072+0000","last_fullsized":"2023-10-06T02:24:39.974072+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:43.496803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962729+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:05.211450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.980152+0000","last_change":"2023-10-06T02:24:39.980152+0000","last_active":"2023-10-06T02:24:39.980152+0000","last_peered":"2023-10-06T02:24:39.980152+0000","last_clean":"2023-10-06T02:24:39.980152+0000","last_became_active":"2023-10-06T02:24:39.979853+0000","last_became_peered":"2023-10-06T02:24:39.979853+0000","last_unstale":"2023-10-06T02:24:39.980152+0000","last_undegraded":"2023-10-06T02:24:39.980152+0000","last_fullsized":"2023-10-06T02:24:39.980152+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:59.113041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964790+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:04.227594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976301+0000","last_change":"2023-10-06T02:24:39.976301+0000","last_active":"2023-10-06T02:24:39.976301+0000","last_peered":"2023-10-06T02:24:39.976301+0000","last_clean":"2023-10-06T02:24:39.976301+0000","last_became_active":"2023-10-06T02:24:39.976036+0000","last_became_peered":"2023-10-06T02:24:39.976036+0000","last_unstale":"2023-10-06T02:24:39.976301+0000","last_undegraded":"2023-10-06T02:24:39.976301+0000","last_fullsized":"2023-10-06T02:24:39.976301+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:23.302126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.963756+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:49.244903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973206+0000","last_change":"2023-10-06T02:24:39.973206+0000","last_active":"2023-10-06T02:24:39.973206+0000","last_peered":"2023-10-06T02:24:39.973206+0000","last_clean":"2023-10-06T02:24:39.973206+0000","last_became_active":"2023-10-06T02:24:39.972964+0000","last_became_peered":"2023-10-06T02:24:39.972964+0000","last_unstale":"2023-10-06T02:24:39.973206+0000","last_undegraded":"2023-10-06T02:24:39.973206+0000","last_fullsized":"2023-10-06T02:24:39.973206+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:52.898248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964280+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:17.082986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.972655+0000","last_change":"2023-10-06T02:24:39.972655+0000","last_active":"2023-10-06T02:24:39.972655+0000","last_peered":"2023-10-06T02:24:39.972655+0000","last_clean":"2023-10-06T02:24:39.972655+0000","last_became_active":"2023-10-06T02:24:39.972305+0000","last_became_peered":"2023-10-06T02:24:39.972305+0000","last_unstale":"2023-10-06T02:24:39.972655+0000","last_undegraded":"2023-10-06T02:24:39.972655+0000","last_fullsized":"2023-10-06T02:24:39.972655+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:24.291593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965608+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:34:44.335946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.971205+0000","last_change":"2023-10-06T02:24:39.971205+0000","last_active":"2023-10-06T02:24:39.971205+0000","last_peered":"2023-10-06T02:24:39.971205+0000","last_clean":"2023-10-06T02:24:39.971205+0000","last_became_active":"2023-10-06T02:24:39.970966+0000","last_became_peered":"2023-10-06T02:24:39.970966+0000","last_unstale":"2023-10-06T02:24:39.971205+0000","last_undegraded":"2023-10-06T02:24:39.971205+0000","last_fullsized":"2023-10-06T02:24:39.971205+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:18.974316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964043+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:23.015663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.981399+0000","last_change":"2023-10-06T02:24:39.981399+0000","last_active":"2023-10-06T02:24:39.981399+0000","last_peered":"2023-10-06T02:24:39.981399+0000","last_clean":"2023-10-06T02:24:39.981399+0000","last_became_active":"2023-10-06T02:24:39.979589+0000","last_became_peered":"2023-10-06T02:24:39.979589+0000","last_unstale":"2023-10-06T02:24:39.981399+0000","last_undegraded":"2023-10-06T02:24:39.981399+0000","last_fullsized":"2023-10-06T02:24:39.981399+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:11.530446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965410+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:27.723364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.971985+0000","last_change":"2023-10-06T02:24:39.971985+0000","last_active":"2023-10-06T02:24:39.971985+0000","last_peered":"2023-10-06T02:24:39.971985+0000","last_clean":"2023-10-06T02:24:39.971985+0000","last_became_active":"2023-10-06T02:24:39.971728+0000","last_became_peered":"2023-10-06T02:24:39.971728+0000","last_unstale":"2023-10-06T02:24:39.971985+0000","last_undegraded":"2023-10-06T02:24:39.971985+0000","last_fullsized":"2023-10-06T02:24:39.971985+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:09.608799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968917+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:40.143074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.980911+0000","last_change":"2023-10-06T02:24:39.980911+0000","last_active":"2023-10-06T02:24:39.980911+0000","last_peered":"2023-10-06T02:24:39.980911+0000","last_clean":"2023-10-06T02:24:39.980911+0000","last_became_active":"2023-10-06T02:24:39.980544+0000","last_became_peered":"2023-10-06T02:24:39.980544+0000","last_unstale":"2023-10-06T02:24:39.980911+0000","last_undegraded":"2023-10-06T02:24:39.980911+0000","last_fullsized":"2023-10-06T02:24:39.980911+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:50.105604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966347+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:09.927108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976365+0000","last_change":"2023-10-06T02:24:39.976365+0000","last_active":"2023-10-06T02:24:39.976365+0000","last_peered":"2023-10-06T02:24:39.976365+0000","last_clean":"2023-10-06T02:24:39.976365+0000","last_became_active":"2023-10-06T02:24:39.976088+0000","last_became_peered":"2023-10-06T02:24:39.976088+0000","last_unstale":"2023-10-06T02:24:39.976365+0000","last_undegraded":"2023-10-06T02:24:39.976365+0000","last_fullsized":"2023-10-06T02:24:39.976365+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:24.102710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968759+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:16.842155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.979144+0000","last_change":"2023-10-06T02:24:39.979144+0000","last_active":"2023-10-06T02:24:39.979144+0000","last_peered":"2023-10-06T02:24:39.979144+0000","last_clean":"2023-10-06T02:24:39.979144+0000","last_became_active":"2023-10-06T02:24:39.978902+0000","last_became_peered":"2023-10-06T02:24:39.978902+0000","last_unstale":"2023-10-06T02:24:39.979144+0000","last_undegraded":"2023-10-06T02:24:39.979144+0000","last_fullsized":"2023-10-06T02:24:39.979144+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:13.533579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966425+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:03.453032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976840+0000","last_change":"2023-10-06T02:24:39.976840+0000","last_active":"2023-10-06T02:24:39.976840+0000","last_peered":"2023-10-06T02:24:39.976840+0000","last_clean":"2023-10-06T02:24:39.976840+0000","last_became_active":"2023-10-06T02:24:39.976430+0000","last_became_peered":"2023-10-06T02:24:39.976430+0000","last_unstale":"2023-10-06T02:24:39.976840+0000","last_undegraded":"2023-10-06T02:24:39.976840+0000","last_fullsized":"2023-10-06T02:24:39.976840+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:07.627361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.961747+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:48.724533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.984134+0000","last_change":"2023-10-06T02:24:39.984134+0000","last_active":"2023-10-06T02:24:39.984134+0000","last_peered":"2023-10-06T02:24:39.984134+0000","last_clean":"2023-10-06T02:24:39.984134+0000","last_became_active":"2023-10-06T02:24:39.983937+0000","last_became_peered":"2023-10-06T02:24:39.983937+0000","last_unstale":"2023-10-06T02:24:39.984134+0000","last_undegraded":"2023-10-06T02:24:39.984134+0000","last_fullsized":"2023-10-06T02:24:39.984134+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:00.166209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968317+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:24.307089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.975251+0000","last_change":"2023-10-06T02:24:39.975251+0000","last_active":"2023-10-06T02:24:39.975251+0000","last_peered":"2023-10-06T02:24:39.975251+0000","last_clean":"2023-10-06T02:24:39.975251+0000","last_became_active":"2023-10-06T02:24:39.974945+0000","last_became_peered":"2023-10-06T02:24:39.974945+0000","last_unstale":"2023-10-06T02:24:39.975251+0000","last_undegraded":"2023-10-06T02:24:39.975251+0000","last_fullsized":"2023-10-06T02:24:39.975251+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:06.293337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964527+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:24.682393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.970516+0000","last_change":"2023-10-06T02:24:39.970516+0000","last_active":"2023-10-06T02:24:39.970516+0000","last_peered":"2023-10-06T02:24:39.970516+0000","last_clean":"2023-10-06T02:24:39.970516+0000","last_became_active":"2023-10-06T02:24:39.970272+0000","last_became_peered":"2023-10-06T02:24:39.970272+0000","last_unstale":"2023-10-06T02:24:39.970516+0000","last_undegraded":"2023-10-06T02:24:39.970516+0000","last_fullsized":"2023-10-06T02:24:39.970516+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:17.651579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965916+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:33.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976424+0000","last_change":"2023-10-06T02:24:39.976424+0000","last_active":"2023-10-06T02:24:39.976424+0000","last_peered":"2023-10-06T02:24:39.976424+0000","last_clean":"2023-10-06T02:24:39.976424+0000","last_became_active":"2023-10-06T02:24:39.976136+0000","last_became_peered":"2023-10-06T02:24:39.976136+0000","last_unstale":"2023-10-06T02:24:39.976424+0000","last_undegraded":"2023-10-06T02:24:39.976424+0000","last_fullsized":"2023-10-06T02:24:39.976424+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:42.794495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962345+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:32.991704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.979586+0000","last_change":"2023-10-06T02:24:39.979586+0000","last_active":"2023-10-06T02:24:39.979586+0000","last_peered":"2023-10-06T02:24:39.979586+0000","last_clean":"2023-10-06T02:24:39.979586+0000","last_became_active":"2023-10-06T02:24:39.979318+0000","last_became_peered":"2023-10-06T02:24:39.979318+0000","last_unstale":"2023-10-06T02:24:39.979586+0000","last_undegraded":"2023-10-06T02:24:39.979586+0000","last_fullsized":"2023-10-06T02:24:39.979586+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:03.222631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.962263+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:54.104551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976072+0000","last_change":"2023-10-06T02:24:39.976072+0000","last_active":"2023-10-06T02:24:39.976072+0000","last_peered":"2023-10-06T02:24:39.976072+0000","last_clean":"2023-10-06T02:24:39.976072+0000","last_became_active":"2023-10-06T02:24:39.975779+0000","last_became_peered":"2023-10-06T02:24:39.975779+0000","last_unstale":"2023-10-06T02:24:39.976072+0000","last_undegraded":"2023-10-06T02:24:39.976072+0000","last_fullsized":"2023-10-06T02:24:39.976072+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:39.138110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966116+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:25.853328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973897+0000","last_change":"2023-10-06T02:24:39.973897+0000","last_active":"2023-10-06T02:24:39.973897+0000","last_peered":"2023-10-06T02:24:39.973897+0000","last_clean":"2023-10-06T02:24:39.973897+0000","last_became_active":"2023-10-06T02:24:39.973571+0000","last_became_peered":"2023-10-06T02:24:39.973571+0000","last_unstale":"2023-10-06T02:24:39.973897+0000","last_undegraded":"2023-10-06T02:24:39.973897+0000","last_fullsized":"2023-10-06T02:24:39.973897+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:29.040516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966502+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:30.709839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.974701+0000","last_change":"2023-10-06T02:24:39.974701+0000","last_active":"2023-10-06T02:24:39.974701+0000","last_peered":"2023-10-06T02:24:39.974701+0000","last_clean":"2023-10-06T02:24:39.974701+0000","last_became_active":"2023-10-06T02:24:39.974430+0000","last_became_peered":"2023-10-06T02:24:39.974430+0000","last_unstale":"2023-10-06T02:24:39.974701+0000","last_undegraded":"2023-10-06T02:24:39.974701+0000","last_fullsized":"2023-10-06T02:24:39.974701+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:48.940881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.964494+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:00.118004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973724+0000","last_change":"2023-10-06T02:24:39.973724+0000","last_active":"2023-10-06T02:24:39.973724+0000","last_peered":"2023-10-06T02:24:39.973724+0000","last_clean":"2023-10-06T02:24:39.973724+0000","last_became_active":"2023-10-06T02:24:39.973431+0000","last_became_peered":"2023-10-06T02:24:39.973431+0000","last_unstale":"2023-10-06T02:24:39.973724+0000","last_undegraded":"2023-10-06T02:24:39.973724+0000","last_fullsized":"2023-10-06T02:24:39.973724+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:06.522727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968695+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:10:33.809744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.985278+0000","last_change":"2023-10-06T02:24:39.985278+0000","last_active":"2023-10-06T02:24:39.985278+0000","last_peered":"2023-10-06T02:24:39.985278+0000","last_clean":"2023-10-06T02:24:39.985278+0000","last_became_active":"2023-10-06T02:24:39.985020+0000","last_became_peered":"2023-10-06T02:24:39.985020+0000","last_unstale":"2023-10-06T02:24:39.985278+0000","last_undegraded":"2023-10-06T02:24:39.985278+0000","last_fullsized":"2023-10-06T02:24:39.985278+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:04.563087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.963647+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:46.230022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976021+0000","last_change":"2023-10-06T02:24:39.976021+0000","last_active":"2023-10-06T02:24:39.976021+0000","last_peered":"2023-10-06T02:24:39.976021+0000","last_clean":"2023-10-06T02:24:39.976021+0000","last_became_active":"2023-10-06T02:24:39.975772+0000","last_became_peered":"2023-10-06T02:24:39.975772+0000","last_unstale":"2023-10-06T02:24:39.976021+0000","last_undegraded":"2023-10-06T02:24:39.976021+0000","last_fullsized":"2023-10-06T02:24:39.976021+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:19.298438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965960+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:31.994955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973641+0000","last_change":"2023-10-06T02:24:39.973641+0000","last_active":"2023-10-06T02:24:39.973641+0000","last_peered":"2023-10-06T02:24:39.973641+0000","last_clean":"2023-10-06T02:24:39.973641+0000","last_became_active":"2023-10-06T02:24:39.973198+0000","last_became_peered":"2023-10-06T02:24:39.973198+0000","last_unstale":"2023-10-06T02:24:39.973641+0000","last_undegraded":"2023-10-06T02:24:39.973641+0000","last_fullsized":"2023-10-06T02:24:39.973641+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:14.807923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.962764+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:24:38.962764+0000","last_peered":"2023-10-06T02:24:38.962764+0000","last_clean":"2023-10-06T02:24:38.962764+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:24:38.962764+0000","last_undegraded":"2023-10-06T02:24:38.962764+0000","last_fullsized":"2023-10-06T02:24:38.962764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966929+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:11.588397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.979843+0000","last_change":"2023-10-06T02:24:39.979843+0000","last_active":"2023-10-06T02:24:39.979843+0000","last_peered":"2023-10-06T02:24:39.979843+0000","last_clean":"2023-10-06T02:24:39.979843+0000","last_became_active":"2023-10-06T02:24:39.979522+0000","last_became_peered":"2023-10-06T02:24:39.979522+0000","last_unstale":"2023-10-06T02:24:39.979843+0000","last_undegraded":"2023-10-06T02:24:39.979843+0000","last_fullsized":"2023-10-06T02:24:39.979843+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:55.728646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.955617+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:24:38.955617+0000","last_peered":"2023-10-06T02:24:38.955617+0000","last_clean":"2023-10-06T02:24:38.955617+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:24:38.955617+0000","last_undegraded":"2023-10-06T02:24:38.955617+0000","last_fullsized":"2023-10-06T02:24:38.955617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.967822+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:34.541182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.976127+0000","last_change":"2023-10-06T02:24:39.976127+0000","last_active":"2023-10-06T02:24:39.976127+0000","last_peered":"2023-10-06T02:24:39.976127+0000","last_clean":"2023-10-06T02:24:39.976127+0000","last_became_active":"2023-10-06T02:24:39.975820+0000","last_became_peered":"2023-10-06T02:24:39.975820+0000","last_unstale":"2023-10-06T02:24:39.976127+0000","last_undegraded":"2023-10-06T02:24:39.976127+0000","last_fullsized":"2023-10-06T02:24:39.976127+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:53.313940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":78,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.963345+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:24:38.963345+0000","last_peered":"2023-10-06T02:24:38.963345+0000","last_clean":"2023-10-06T02:24:38.963345+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:24:38.963345+0000","last_undegraded":"2023-10-06T02:24:38.963345+0000","last_fullsized":"2023-10-06T02:24:38.963345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":227,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.958954+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:24:38.958954+0000","last_peered":"2023-10-06T02:24:38.958954+0000","last_clean":"2023-10-06T02:24:38.958954+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:24:38.958954+0000","last_undegraded":"2023-10-06T02:24:38.958954+0000","last_fullsized":"2023-10-06T02:24:38.958954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965674+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:54.235961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.974456+0000","last_change":"2023-10-06T02:24:39.974456+0000","last_active":"2023-10-06T02:24:39.974456+0000","last_peered":"2023-10-06T02:24:39.974456+0000","last_clean":"2023-10-06T02:24:39.974456+0000","last_became_active":"2023-10-06T02:24:39.974171+0000","last_became_peered":"2023-10-06T02:24:39.974171+0000","last_unstale":"2023-10-06T02:24:39.974456+0000","last_undegraded":"2023-10-06T02:24:39.974456+0000","last_fullsized":"2023-10-06T02:24:39.974456+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:24.102710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.958886+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:24:38.958886+0000","last_peered":"2023-10-06T02:24:38.958886+0000","last_clean":"2023-10-06T02:24:38.958886+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:24:38.958886+0000","last_undegraded":"2023-10-06T02:24:38.958886+0000","last_fullsized":"2023-10-06T02:24:38.958886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966875+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:13.386207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.974763+0000","last_change":"2023-10-06T02:24:39.974763+0000","last_active":"2023-10-06T02:24:39.974763+0000","last_peered":"2023-10-06T02:24:39.974763+0000","last_clean":"2023-10-06T02:24:39.974763+0000","last_became_active":"2023-10-06T02:24:39.974488+0000","last_became_peered":"2023-10-06T02:24:39.974488+0000","last_unstale":"2023-10-06T02:24:39.974763+0000","last_undegraded":"2023-10-06T02:24:39.974763+0000","last_fullsized":"2023-10-06T02:24:39.974763+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:06.522727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.958855+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:24:38.958855+0000","last_peered":"2023-10-06T02:24:38.958855+0000","last_clean":"2023-10-06T02:24:38.958855+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:24:38.958855+0000","last_undegraded":"2023-10-06T02:24:38.958855+0000","last_fullsized":"2023-10-06T02:24:38.958855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.966207+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:17.082986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.978145+0000","last_change":"2023-10-06T02:24:39.978145+0000","last_active":"2023-10-06T02:24:39.978145+0000","last_peered":"2023-10-06T02:24:39.978145+0000","last_clean":"2023-10-06T02:24:39.978145+0000","last_became_active":"2023-10-06T02:24:39.977744+0000","last_became_peered":"2023-10-06T02:24:39.977744+0000","last_unstale":"2023-10-06T02:24:39.978145+0000","last_undegraded":"2023-10-06T02:24:39.978145+0000","last_fullsized":"2023-10-06T02:24:39.978145+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:49.822349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.965535+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:24:38.965535+0000","last_peered":"2023-10-06T02:24:38.965535+0000","last_clean":"2023-10-06T02:24:38.965535+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:24:38.965535+0000","last_undegraded":"2023-10-06T02:24:38.965535+0000","last_fullsized":"2023-10-06T02:24:38.965535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.968249+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:15.763729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.977321+0000","last_change":"2023-10-06T02:24:39.977321+0000","last_active":"2023-10-06T02:24:39.977321+0000","last_peered":"2023-10-06T02:24:39.977321+0000","last_clean":"2023-10-06T02:24:39.977321+0000","last_became_active":"2023-10-06T02:24:39.977039+0000","last_became_peered":"2023-10-06T02:24:39.977039+0000","last_unstale":"2023-10-06T02:24:39.977321+0000","last_undegraded":"2023-10-06T02:24:39.977321+0000","last_fullsized":"2023-10-06T02:24:39.977321+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:56.670718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.960197+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:24:38.960197+0000","last_peered":"2023-10-06T02:24:38.960197+0000","last_clean":"2023-10-06T02:24:38.960197+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:24:38.960197+0000","last_undegraded":"2023-10-06T02:24:38.960197+0000","last_fullsized":"2023-10-06T02:24:38.960197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:24:39.954191+0000","last_change":"2023-10-06T02:24:39.965895+0000","last_active":"2023-10-06T02:24:39.954191+0000","last_peered":"2023-10-06T02:24:39.954191+0000","last_clean":"2023-10-06T02:24:39.954191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:24:39.954191+0000","last_undegraded":"2023-10-06T02:24:39.954191+0000","last_fullsized":"2023-10-06T02:24:39.954191+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:34.541182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T02:24:39.973325+0000","last_change":"2023-10-06T02:24:39.973325+0000","last_active":"2023-10-06T02:24:39.973325+0000","last_peered":"2023-10-06T02:24:39.973325+0000","last_clean":"2023-10-06T02:24:39.973325+0000","last_became_active":"2023-10-06T02:24:39.973093+0000","last_became_peered":"2023-10-06T02:24:39.973093+0000","last_unstale":"2023-10-06T02:24:39.973325+0000","last_undegraded":"2023-10-06T02:24:39.973325+0000","last_fullsized":"2023-10-06T02:24:39.973325+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:57.861496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T02:24:38.960200+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:24:38.960200+0000","last_peered":"2023-10-06T02:24:38.960200+0000","last_clean":"2023-10-06T02:24:38.960200+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:24:38.960200+0000","last_undegraded":"2023-10-06T02:24:38.960200+0000","last_fullsized":"2023-10-06T02:24:38.960200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298988,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072852,"statfs":{"total":96636764160,"available":96330600448,"internally_reserved":0,"allocated":1740800,"data_stored":1142013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.505},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70899999999999996,"5min":0.79700000000000004,"15min":1.111},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.495},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.83299999999999996,"15min":0.97899999999999998},"last":0.75700000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55600000000000005,"15min":0.51800000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.86299999999999999,"15min":1.008},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.51700000000000002},"min":{"1min":0.371,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79100000000000004,"5min":0.81000000000000005,"15min":1.075},"last":0.58599999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":0.83499999999999996,"15min":1.149},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.623,"15min":0.58299999999999996},"min":{"1min":0.443,"5min":0.41199999999999998,"15min":0.38800000000000001},"max":{"1min":0.80300000000000005,"5min":0.81399999999999995,"15min":1.048},"last":0.73599999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.41199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.75800000000000001,"5min":0.79200000000000004,"15min":1.175},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60499999999999998,"15min":0.57299999999999995},"min":{"1min":0.44900000000000001,"5min":0.41199999999999998,"15min":0.36799999999999999},"max":{"1min":0.70799999999999996,"5min":0.83799999999999997,"15min":1.03},"last":0.77600000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48299999999999998,"15min":0.48599999999999999},"min":{"1min":0.33900000000000002,"5min":0.30399999999999999,"15min":0.29299999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.873},"last":0.437},{"interface":"front","average":{"1min":0.497,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33700000000000002},"max":{"1min":0.67900000000000005,"5min":0.80300000000000005,"15min":0.85299999999999998},"last":0.501}]},{"osd":5,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.378,"5min":0.318,"15min":0.318},"max":{"1min":0.66500000000000004,"5min":0.749,"15min":0.81899999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.40500000000000003,"5min":0.35599999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.38700000000000001},"max":{"1min":0.754,"5min":0.84799999999999998,"15min":0.91700000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.47699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77300000000000002,"5min":0.78600000000000003,"15min":0.89800000000000002},"last":0.622}]}]},{"osd":6,"up_from":13,"seq":55834574937,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298404,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073436,"statfs":{"total":96636764160,"available":96331198464,"internally_reserved":0,"allocated":1142784,"data_stored":550692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56499999999999995,"15min":0.78100000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.752,"5min":0.82399999999999995,"15min":5.6929999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57499999999999996,"15min":0.79500000000000004},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76300000000000001,"5min":0.82799999999999996,"15min":5.7060000000000004},"last":0.48999999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.32500000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.76300000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58199999999999996,"15min":0.53000000000000003},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":0.77200000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56699999999999995,"15min":0.93300000000000005},"min":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.751,"5min":0.82299999999999995,"15min":8.8659999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73099999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58999999999999997,"15min":1.0249999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77000000000000002,"5min":0.86799999999999999,"15min":10.659000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72399999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46700000000000003,"15min":0.50600000000000001},"min":{"1min":0.30599999999999999,"5min":0.30199999999999999,"15min":0.27400000000000002},"max":{"1min":0.52800000000000002,"5min":0.76100000000000001,"15min":0.79600000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.54100000000000004},"min":{"1min":0.32400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.76100000000000001,"15min":0.76500000000000001},"last":0.34100000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.49399999999999999,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68400000000000005,"5min":0.746,"15min":0.78300000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.51800000000000002,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.69799999999999995,"5min":0.82699999999999996,"15min":0.84399999999999997},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54800000000000004,"15min":0.58399999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.312},"max":{"1min":0.755,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58299999999999996,"15min":0.626},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.752,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.47299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298984,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072856,"statfs":{"total":96636764160,"available":96330604544,"internally_reserved":0,"allocated":1736704,"data_stored":1141060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.377,"15min":0.35099999999999998},"min":{"1min":0.20300000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.497,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.39900000000000002,"15min":0.36099999999999999},"min":{"1min":0.28199999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51000000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35599999999999998,"15min":0.32700000000000001},"min":{"1min":0.22500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.46100000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41399999999999998,"15min":0.38600000000000001},"min":{"1min":0.252,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.621,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.27200000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.434,"15min":0.38700000000000001},"min":{"1min":0.26900000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.57399999999999995,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40999999999999998,"15min":0.38600000000000001},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.58799999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.28399999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60999999999999999,"15min":0.56499999999999995},"min":{"1min":0.46500000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81499999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.443},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.47299999999999998,"5min":0.38700000000000001,"15min":0.376},"max":{"1min":0.77000000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47699999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.501,"5min":0.37,"15min":0.37},"max":{"1min":0.746,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66700000000000004,"15min":0.628},"min":{"1min":0.48999999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85799999999999998,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.55000000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.59399999999999997},"min":{"1min":0.47199999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85199999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64300000000000002,"15min":0.59799999999999998},"min":{"1min":0.52900000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.81799999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.43099999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66000000000000003,"15min":0.624},"min":{"1min":0.51300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.78700000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.64100000000000001,"15min":0.60899999999999999},"min":{"1min":0.48599999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78300000000000003,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.46500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574936,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1134592,"data_stored":544709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.314},"min":{"1min":0.25600000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.35099999999999998},"min":{"1min":0.28599999999999998,"5min":0.26600000000000001,"15min":0.246},"max":{"1min":0.58799999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.35699999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41899999999999998,"15min":0.377},"min":{"1min":0.29299999999999998,"5min":0.26500000000000001,"15min":0.20599999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.371,"5min":0.373,"15min":0.33400000000000002},"min":{"1min":0.26400000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.53100000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.30499999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41299999999999998,"15min":0.38700000000000001},"min":{"1min":0.25800000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.63100000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.41599999999999998},"min":{"1min":0.317,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.84799999999999998,"5min":0.92100000000000004,"15min":1.369},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.629,"15min":0.56499999999999995},"min":{"1min":0.51500000000000001,"5min":0.42699999999999999,"15min":0.41099999999999998},"max":{"1min":0.83799999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.502}]},{"osd":5,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63900000000000001,"15min":0.60899999999999999},"min":{"1min":0.52100000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88400000000000001,"5min":0.98999999999999999,"15min":1.3320000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.65000000000000002,"15min":0.60299999999999998},"min":{"1min":0.47999999999999998,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.80500000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65300000000000002,"15min":0.626},"min":{"1min":0.45300000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91700000000000004,"5min":0.95299999999999996,"15min":1.3999999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66400000000000003,"15min":0.60899999999999999},"min":{"1min":0.50800000000000001,"5min":0.46700000000000003,"15min":0.39800000000000002},"max":{"1min":1.0249999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64900000000000002,"15min":1.0089999999999999},"min":{"1min":0.47899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":11.138},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68000000000000005,"15min":0.63800000000000001},"min":{"1min":0.503,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.429},"last":0.47699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574936,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298404,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073436,"statfs":{"total":96636764160,"available":96331198464,"internally_reserved":0,"allocated":1142784,"data_stored":550692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.374,"15min":0.36899999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.52000000000000002,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40300000000000002,"15min":0.376},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42799999999999999,"15min":0.38700000000000001},"min":{"1min":0.247,"5min":0.24299999999999999,"15min":0.23000000000000001},"max":{"1min":0.59599999999999997,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.45300000000000001,"15min":0.40500000000000003},"min":{"1min":0.28799999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.58299999999999996,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40699999999999997,"15min":0.377},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55000000000000004,"5min":1.423,"15min":1.423},"last":0.443},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45400000000000001,"15min":0.42599999999999999},"min":{"1min":0.33300000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66500000000000004,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.625,"15min":0.58499999999999996},"min":{"1min":0.439,"5min":0.38600000000000001,"15min":0.377},"max":{"1min":0.80300000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.63100000000000001,"15min":0.61799999999999999},"min":{"1min":0.44700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.60899999999999999},"min":{"1min":0.438,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83699999999999997,"5min":1.304,"15min":1.304},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.42299999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73899999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.42499999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96099999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.66100000000000003,"15min":0.63300000000000001},"min":{"1min":0.51600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.89200000000000002,"5min":1.347,"15min":1.347},"last":0.77300000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67100000000000004,"15min":0.66200000000000003},"min":{"1min":0.47499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98599999999999999,"5min":1.206,"15min":1.206},"last":0.625},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68700000000000006,"15min":0.67300000000000004},"min":{"1min":0.47799999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.87,"5min":1.385,"15min":1.385},"last":0.67000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298408,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073432,"statfs":{"total":96636764160,"available":96331194368,"internally_reserved":0,"allocated":1146880,"data_stored":551645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.23300000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.54900000000000004,"5min":0.55500000000000005,"15min":0.61299999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.38200000000000001,"15min":0.38800000000000001},"min":{"1min":0.26500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.78100000000000003},"last":0.32600000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.379,"15min":0.371},"min":{"1min":0.28299999999999997,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58399999999999996,"5min":0.66100000000000003,"15min":0.66700000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.40200000000000002},"min":{"1min":0.29099999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.40400000000000003},"min":{"1min":0.26700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.41099999999999998},"min":{"1min":0.34999999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.36499999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.58799999999999997},"min":{"1min":0.438,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.441},{"interface":"front","average":{"1min":0.624,"5min":0.62,"15min":0.59899999999999998},"min":{"1min":0.44400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91400000000000003,"5min":0.96599999999999997,"15min":1.1539999999999999},"last":0.48799999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.623,"15min":0.623},"min":{"1min":0.44800000000000001,"5min":0.40400000000000003,"15min":0.36399999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.2110000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.46400000000000002,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":1.0129999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.41999999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63100000000000001,"15min":0.59499999999999997},"min":{"1min":0.45300000000000001,"5min":0.42999999999999999,"15min":0.40600000000000003},"max":{"1min":0.879,"5min":0.91100000000000003,"15min":1.0700000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.53300000000000003,"5min":0.442,"15min":0.38600000000000001},"max":{"1min":0.91200000000000003,"5min":0.996,"15min":1.391},"last":0.40799999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.39500000000000002},"max":{"1min":0.97199999999999998,"5min":1.121,"15min":1.121},"last":0.5},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65500000000000003,"15min":0.61499999999999999},"min":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.42799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574936,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1134592,"data_stored":544709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.54800000000000004},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.217},"max":{"1min":0.68600000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64100000000000001,"15min":0.59699999999999998},"min":{"1min":0.39700000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.74199999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58999999999999997,"15min":1.0920000000000001},"min":{"1min":0.42899999999999999,"5min":0.38600000000000001,"15min":0.34899999999999998},"max":{"1min":1.77,"5min":1.77,"15min":17.879999999999999},"last":0.63},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57499999999999996,"15min":1.073},"min":{"1min":0.44,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71199999999999997,"5min":0.84699999999999998,"15min":18.010999999999999},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.53600000000000003},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.59899999999999998,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.69399999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59299999999999997,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.29899999999999999},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.56799999999999995},"min":{"1min":0.45700000000000002,"5min":0.373,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56299999999999994}]},{"osd":5,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.30499999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41699999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.53800000000000003,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.38200000000000001,"5min":0.36799999999999999,"15min":0.36199999999999999},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.504}]},{"osd":7,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.42299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.72899999999999998,"5min":0.81399999999999995,"15min":0.83999999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58999999999999997,"15min":0.61599999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78700000000000003,"5min":0.82099999999999995,"15min":0.83299999999999996},"last":0.48799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574935,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298408,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073432,"statfs":{"total":96636764160,"available":96331194368,"internally_reserved":0,"allocated":1146880,"data_stored":551645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55000000000000004,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.80300000000000005,"5min":1.103,"15min":1.103},"last":0.499},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54400000000000004,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.56499999999999995},"min":{"1min":0.47199999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81699999999999995,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.55500000000000005},"min":{"1min":0.40699999999999997,"5min":0.35899999999999999,"15min":0.33900000000000002},"max":{"1min":0.85499999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.38500000000000001,"15min":0.30399999999999999},"max":{"1min":0.78100000000000003,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.745,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.54500000000000004},"min":{"1min":0.443,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70799999999999996,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.57199999999999995},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.67900000000000005}]},{"osd":4,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47999999999999998,"15min":0.50800000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.49299999999999999,"15min":0.501},"min":{"1min":0.33700000000000002,"5min":0.308,"15min":0.26500000000000001},"max":{"1min":0.65700000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39800000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.504,"15min":0.51600000000000001},"min":{"1min":0.42399999999999999,"5min":0.29299999999999998,"15min":0.28299999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.57099999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.73999999999999999},"last":0.47099999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.54700000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68100000000000005,"5min":0.73799999999999999,"15min":0.78400000000000003},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57299999999999995,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:24:49.653 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:24:49.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.784+0000 7f737935a700 1 Processor -- start 2023-10-06T02:24:49.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.784+0000 7f737935a700 1 -- start start 2023-10-06T02:24:49.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.785+0000 7f737935a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f73740cf1a0 0x7f73740cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:49.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.785+0000 7f737935a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f73741597d0 0x7f73740d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:49.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.785+0000 7f737935a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73740b3560 con 0x7f7374159400 2023-10-06T02:24:49.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.785+0000 7f737935a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73740cf6f0 con 0x7f73741597d0 2023-10-06T02:24:49.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.785+0000 7f737935a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73740cf9d0 con 0x7f73740cf1a0 2023-10-06T02:24:49.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.785+0000 7f7378b59700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f73741597d0 0x7f73740d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:49.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.785+0000 7f7378b59700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f73741597d0 0x7f73740d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58458/0 (socket says 172.21.15.6:58458) 2023-10-06T02:24:49.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.785+0000 7f7378b59700 1 -- 172.21.15.6:0/3409214533 learned_addr learned my addr 172.21.15.6:0/3409214533 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:49.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.785+0000 7f73737fe700 1 --2- 172.21.15.6:0/3409214533 >> v2:172.21.15.175:3300/0 conn(0x7f73740cf1a0 0x7f73740cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:49.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.785+0000 7f7378b59700 1 -- 172.21.15.6:0/3409214533 >> v2:172.21.15.175:3300/0 conn(0x7f73740cf1a0 msgr2=0x7f73740cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:49.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.785+0000 7f7378b59700 1 --2- 172.21.15.6:0/3409214533 >> v2:172.21.15.175:3300/0 conn(0x7f73740cf1a0 0x7f73740cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:49.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.785+0000 7f7378b59700 1 -- 172.21.15.6:0/3409214533 >> v1:172.21.15.175:6789/0 conn(0x7f7374159400 legacy=0x7f73740ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:49.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.785+0000 7f7378b59700 1 -- 172.21.15.6:0/3409214533 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73740b2f10 con 0x7f73741597d0 2023-10-06T02:24:49.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.785+0000 7f73737fe700 1 --2- 172.21.15.6:0/3409214533 >> v2:172.21.15.175:3300/0 conn(0x7f73740cf1a0 0x7f73740cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:49.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.786+0000 7f7378b59700 1 --2- 172.21.15.6:0/3409214533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73741597d0 0x7f73740d0400 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f737415d0f0 tx=0x7f736c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d86172be6c7bf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:49.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.786+0000 7f7372ffd700 1 -- 172.21.15.6:0/3409214533 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c00e070 con 0x7f73741597d0 2023-10-06T02:24:49.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.786+0000 7f7372ffd700 1 -- 172.21.15.6:0/3409214533 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736c00ba50 con 0x7f73741597d0 2023-10-06T02:24:49.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.786+0000 7f7372ffd700 1 -- 172.21.15.6:0/3409214533 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c0092e0 con 0x7f73741597d0 2023-10-06T02:24:49.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.786+0000 7f737935a700 1 -- 172.21.15.6:0/3409214533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73741597d0 msgr2=0x7f73740d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:49.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.786+0000 7f737935a700 1 --2- 172.21.15.6:0/3409214533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73741597d0 0x7f73740d0400 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f737415d0f0 tx=0x7f736c009840 comp rx=0 tx=0).stop 2023-10-06T02:24:49.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.786+0000 7f737935a700 1 -- 172.21.15.6:0/3409214533 shutdown_connections 2023-10-06T02:24:49.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.786+0000 7f737935a700 1 --2- 172.21.15.6:0/3409214533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73741597d0 0x7f73740d0400 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:49.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.786+0000 7f737935a700 1 --2- 172.21.15.6:0/3409214533 >> v2:172.21.15.175:3300/0 conn(0x7f73740cf1a0 0x7f73740cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:49.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.786+0000 7f737935a700 1 -- 172.21.15.6:0/3409214533 >> 172.21.15.6:0/3409214533 conn(0x7f737406ac10 msgr2=0x7f7374068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:49.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.786+0000 7f737935a700 1 -- 172.21.15.6:0/3409214533 shutdown_connections 2023-10-06T02:24:49.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.786+0000 7f737935a700 1 -- 172.21.15.6:0/3409214533 wait complete. 2023-10-06T02:24:49.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.787+0000 7f737935a700 1 Processor -- start 2023-10-06T02:24:49.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.788+0000 7f737935a700 1 -- start start 2023-10-06T02:24:49.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.788+0000 7f737935a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73740cf1a0 0x7f737415b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.788+0000 7f737935a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7374159400 0x7f73740c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.788+0000 7f737935a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73741597d0 0x7f7374153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.788+0000 7f737935a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73740c61e0 con 0x7f73740cf1a0 2023-10-06T02:24:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.788+0000 7f737935a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7374154280 con 0x7f73741597d0 2023-10-06T02:24:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.788+0000 7f737935a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73740c55d0 con 0x7f7374159400 2023-10-06T02:24:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.789+0000 7f7373fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73740cf1a0 0x7f737415b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.789+0000 7f7373fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73740cf1a0 0x7f737415b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58468/0 (socket says 172.21.15.6:58468) 2023-10-06T02:24:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.789+0000 7f7373fff700 1 -- 172.21.15.6:0/752086320 learned_addr learned my addr 172.21.15.6:0/752086320 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.789+0000 7f7378b59700 1 --2- 172.21.15.6:0/752086320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73741597d0 0x7f7374153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.789+0000 7f73737fe700 1 --2- 172.21.15.6:0/752086320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7374159400 0x7f73740c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.789+0000 7f7373fff700 1 -- 172.21.15.6:0/752086320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7374159400 msgr2=0x7f73740c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.789+0000 7f7373fff700 1 --2- 172.21.15.6:0/752086320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7374159400 0x7f73740c4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.789+0000 7f7373fff700 1 -- 172.21.15.6:0/752086320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73741597d0 msgr2=0x7f7374153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.789+0000 7f7373fff700 1 --2- 172.21.15.6:0/752086320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73741597d0 0x7f7374153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.789+0000 7f7373fff700 1 -- 172.21.15.6:0/752086320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c009ae0 con 0x7f73740cf1a0 2023-10-06T02:24:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.789+0000 7f7373fff700 1 --2- 172.21.15.6:0/752086320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73740cf1a0 0x7f737415b870 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f736400c7c0 tx=0x7f7364007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.789+0000 7f736bfff700 1 -- 172.21.15.6:0/752086320 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364011590 con 0x7f73740cf1a0 2023-10-06T02:24:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.789+0000 7f736bfff700 1 -- 172.21.15.6:0/752086320 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73640116f0 con 0x7f73740cf1a0 2023-10-06T02:24:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.789+0000 7f737935a700 1 -- 172.21.15.6:0/752086320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73740c58b0 con 0x7f73740cf1a0 2023-10-06T02:24:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.789+0000 7f736bfff700 1 -- 172.21.15.6:0/752086320 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364011ab0 con 0x7f73740cf1a0 2023-10-06T02:24:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.789+0000 7f737935a700 1 -- 172.21.15.6:0/752086320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73740c5e70 con 0x7f73740cf1a0 2023-10-06T02:24:49.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.790+0000 7f737935a700 1 -- 172.21.15.6:0/752086320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73740b31f0 con 0x7f73740cf1a0 2023-10-06T02:24:49.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.791+0000 7f736bfff700 1 -- 172.21.15.6:0/752086320 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f736401b3b0 con 0x7f73740cf1a0 2023-10-06T02:24:49.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.791+0000 7f736bfff700 1 --2- 172.21.15.6:0/752086320 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7354066f30 0x7f73540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:49.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.791+0000 7f736bfff700 1 -- 172.21.15.6:0/752086320 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7364083bd0 con 0x7f73740cf1a0 2023-10-06T02:24:49.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.791+0000 7f73737fe700 1 --2- 172.21.15.6:0/752086320 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7354066f30 0x7f73540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:49.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.792+0000 7f73737fe700 1 --2- 172.21.15.6:0/752086320 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7354066f30 0x7f73540693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f73740cc950 tx=0x7f735c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:49.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.795+0000 7f736bfff700 1 -- 172.21.15.6:0/752086320 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7364050c50 con 0x7f73740cf1a0 2023-10-06T02:24:49.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.986+0000 7f737935a700 1 -- 172.21.15.6:0/752086320 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73740c6000 con 0x7f7354066f30 2023-10-06T02:24:49.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.995+0000 7f736bfff700 1 -- 172.21.15.6:0/752086320 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311488 (secure 0 0 0) 0x7f73740c6000 con 0x7f7354066f30 2023-10-06T02:24:50.000 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:50.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.998+0000 7f737935a700 1 -- 172.21.15.6:0/752086320 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7354066f30 msgr2=0x7f73540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.998+0000 7f737935a700 1 --2- 172.21.15.6:0/752086320 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7354066f30 0x7f73540693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f73740cc950 tx=0x7f735c008040 comp rx=0 tx=0).stop 2023-10-06T02:24:50.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.998+0000 7f737935a700 1 -- 172.21.15.6:0/752086320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73740cf1a0 msgr2=0x7f737415b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.998+0000 7f737935a700 1 --2- 172.21.15.6:0/752086320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73740cf1a0 0x7f737415b870 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f736400c7c0 tx=0x7f7364007f70 comp rx=0 tx=0).stop 2023-10-06T02:24:50.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.998+0000 7f737935a700 1 -- 172.21.15.6:0/752086320 shutdown_connections 2023-10-06T02:24:50.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.998+0000 7f737935a700 1 --2- 172.21.15.6:0/752086320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73741597d0 0x7f7374153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.998+0000 7f737935a700 1 --2- 172.21.15.6:0/752086320 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7354066f30 0x7f73540693e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.998+0000 7f737935a700 1 --2- 172.21.15.6:0/752086320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73740cf1a0 0x7f737415b870 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.998+0000 7f737935a700 1 --2- 172.21.15.6:0/752086320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7374159400 0x7f73740c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.998+0000 7f737935a700 1 -- 172.21.15.6:0/752086320 >> 172.21.15.6:0/752086320 conn(0x7f737406ac10 msgr2=0x7f7374154a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:50.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.998+0000 7f737935a700 1 -- 172.21.15.6:0/752086320 shutdown_connections 2023-10-06T02:24:50.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:49.998+0000 7f737935a700 1 -- 172.21.15.6:0/752086320 wait complete. 2023-10-06T02:24:50.004 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:24:50.012 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2023-10-06T02:24:48.665809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2388668,"kb_used_data":10364,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752586052,"statfs":{"total":773094113280,"available":770648117248,"internally_reserved":0,"allocated":10612736,"data_stored":5710825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001983"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.986565+0000","last_change":"2023-10-06T02:24:40.979702+0000","last_active":"2023-10-06T02:24:40.986565+0000","last_peered":"2023-10-06T02:24:40.986565+0000","last_clean":"2023-10-06T02:24:40.986565+0000","last_became_active":"2023-10-06T02:24:40.979370+0000","last_became_peered":"2023-10-06T02:24:40.979370+0000","last_unstale":"2023-10-06T02:24:40.986565+0000","last_undegraded":"2023-10-06T02:24:40.986565+0000","last_fullsized":"2023-10-06T02:24:40.986565+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:19.333158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.990234+0000","last_change":"2023-10-06T02:24:40.985092+0000","last_active":"2023-10-06T02:24:40.990234+0000","last_peered":"2023-10-06T02:24:40.990234+0000","last_clean":"2023-10-06T02:24:40.990234+0000","last_became_active":"2023-10-06T02:24:40.982398+0000","last_became_peered":"2023-10-06T02:24:40.982398+0000","last_unstale":"2023-10-06T02:24:40.990234+0000","last_undegraded":"2023-10-06T02:24:40.990234+0000","last_fullsized":"2023-10-06T02:24:40.990234+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:20.878241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.985812+0000","last_change":"2023-10-06T02:24:40.979316+0000","last_active":"2023-10-06T02:24:40.985812+0000","last_peered":"2023-10-06T02:24:40.985812+0000","last_clean":"2023-10-06T02:24:40.985812+0000","last_became_active":"2023-10-06T02:24:40.978775+0000","last_became_peered":"2023-10-06T02:24:40.978775+0000","last_unstale":"2023-10-06T02:24:40.985812+0000","last_undegraded":"2023-10-06T02:24:40.985812+0000","last_fullsized":"2023-10-06T02:24:40.985812+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:18.722086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.995704+0000","last_change":"2023-10-06T02:24:40.989171+0000","last_active":"2023-10-06T02:24:40.995704+0000","last_peered":"2023-10-06T02:24:40.995704+0000","last_clean":"2023-10-06T02:24:40.995704+0000","last_became_active":"2023-10-06T02:24:40.988617+0000","last_became_peered":"2023-10-06T02:24:40.988617+0000","last_unstale":"2023-10-06T02:24:40.995704+0000","last_undegraded":"2023-10-06T02:24:40.995704+0000","last_fullsized":"2023-10-06T02:24:40.995704+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:49.945844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:41.001069+0000","last_change":"2023-10-06T02:24:40.995888+0000","last_active":"2023-10-06T02:24:41.001069+0000","last_peered":"2023-10-06T02:24:41.001069+0000","last_clean":"2023-10-06T02:24:41.001069+0000","last_became_active":"2023-10-06T02:24:40.995622+0000","last_became_peered":"2023-10-06T02:24:40.995622+0000","last_unstale":"2023-10-06T02:24:41.001069+0000","last_undegraded":"2023-10-06T02:24:41.001069+0000","last_fullsized":"2023-10-06T02:24:41.001069+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:56.817052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.990765+0000","last_change":"2023-10-06T02:24:40.985008+0000","last_active":"2023-10-06T02:24:40.990765+0000","last_peered":"2023-10-06T02:24:40.990765+0000","last_clean":"2023-10-06T02:24:40.990765+0000","last_became_active":"2023-10-06T02:24:40.984638+0000","last_became_peered":"2023-10-06T02:24:40.984638+0000","last_unstale":"2023-10-06T02:24:40.990765+0000","last_undegraded":"2023-10-06T02:24:40.990765+0000","last_fullsized":"2023-10-06T02:24:40.990765+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:56.791580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.988068+0000","last_change":"2023-10-06T02:24:40.984153+0000","last_active":"2023-10-06T02:24:40.988068+0000","last_peered":"2023-10-06T02:24:40.988068+0000","last_clean":"2023-10-06T02:24:40.988068+0000","last_became_active":"2023-10-06T02:24:40.983842+0000","last_became_peered":"2023-10-06T02:24:40.983842+0000","last_unstale":"2023-10-06T02:24:40.988068+0000","last_undegraded":"2023-10-06T02:24:40.988068+0000","last_fullsized":"2023-10-06T02:24:40.988068+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:51.110568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.990529+0000","last_change":"2023-10-06T02:24:40.982332+0000","last_active":"2023-10-06T02:24:40.990529+0000","last_peered":"2023-10-06T02:24:40.990529+0000","last_clean":"2023-10-06T02:24:40.990529+0000","last_became_active":"2023-10-06T02:24:40.982024+0000","last_became_peered":"2023-10-06T02:24:40.982024+0000","last_unstale":"2023-10-06T02:24:40.990529+0000","last_undegraded":"2023-10-06T02:24:40.990529+0000","last_fullsized":"2023-10-06T02:24:40.990529+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:37.741102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.989032+0000","last_change":"2023-10-06T02:24:40.981593+0000","last_active":"2023-10-06T02:24:40.989032+0000","last_peered":"2023-10-06T02:24:40.989032+0000","last_clean":"2023-10-06T02:24:40.989032+0000","last_became_active":"2023-10-06T02:24:40.981146+0000","last_became_peered":"2023-10-06T02:24:40.981146+0000","last_unstale":"2023-10-06T02:24:40.989032+0000","last_undegraded":"2023-10-06T02:24:40.989032+0000","last_fullsized":"2023-10-06T02:24:40.989032+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:21.894393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.988209+0000","last_change":"2023-10-06T02:24:40.982949+0000","last_active":"2023-10-06T02:24:40.988209+0000","last_peered":"2023-10-06T02:24:40.988209+0000","last_clean":"2023-10-06T02:24:40.988209+0000","last_became_active":"2023-10-06T02:24:40.981499+0000","last_became_peered":"2023-10-06T02:24:40.981499+0000","last_unstale":"2023-10-06T02:24:40.988209+0000","last_undegraded":"2023-10-06T02:24:40.988209+0000","last_fullsized":"2023-10-06T02:24:40.988209+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:05.568051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.997802+0000","last_change":"2023-10-06T02:24:40.989092+0000","last_active":"2023-10-06T02:24:40.997802+0000","last_peered":"2023-10-06T02:24:40.997802+0000","last_clean":"2023-10-06T02:24:40.997802+0000","last_became_active":"2023-10-06T02:24:40.988791+0000","last_became_peered":"2023-10-06T02:24:40.988791+0000","last_unstale":"2023-10-06T02:24:40.997802+0000","last_undegraded":"2023-10-06T02:24:40.997802+0000","last_fullsized":"2023-10-06T02:24:40.997802+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:07.298300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.989062+0000","last_change":"2023-10-06T02:24:40.978486+0000","last_active":"2023-10-06T02:24:40.989062+0000","last_peered":"2023-10-06T02:24:40.989062+0000","last_clean":"2023-10-06T02:24:40.989062+0000","last_became_active":"2023-10-06T02:24:40.978207+0000","last_became_peered":"2023-10-06T02:24:40.978207+0000","last_unstale":"2023-10-06T02:24:40.989062+0000","last_undegraded":"2023-10-06T02:24:40.989062+0000","last_fullsized":"2023-10-06T02:24:40.989062+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:18.986033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.995342+0000","last_change":"2023-10-06T02:24:40.990072+0000","last_active":"2023-10-06T02:24:40.995342+0000","last_peered":"2023-10-06T02:24:40.995342+0000","last_clean":"2023-10-06T02:24:40.995342+0000","last_became_active":"2023-10-06T02:24:40.982919+0000","last_became_peered":"2023-10-06T02:24:40.982919+0000","last_unstale":"2023-10-06T02:24:40.995342+0000","last_undegraded":"2023-10-06T02:24:40.995342+0000","last_fullsized":"2023-10-06T02:24:40.995342+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:00.118004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.995628+0000","last_change":"2023-10-06T02:24:40.986604+0000","last_active":"2023-10-06T02:24:40.995628+0000","last_peered":"2023-10-06T02:24:40.995628+0000","last_clean":"2023-10-06T02:24:40.995628+0000","last_became_active":"2023-10-06T02:24:40.986344+0000","last_became_peered":"2023-10-06T02:24:40.986344+0000","last_unstale":"2023-10-06T02:24:40.995628+0000","last_undegraded":"2023-10-06T02:24:40.995628+0000","last_fullsized":"2023-10-06T02:24:40.995628+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:48.724533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.993400+0000","last_change":"2023-10-06T02:24:40.980021+0000","last_active":"2023-10-06T02:24:40.993400+0000","last_peered":"2023-10-06T02:24:40.993400+0000","last_clean":"2023-10-06T02:24:40.993400+0000","last_became_active":"2023-10-06T02:24:40.978773+0000","last_became_peered":"2023-10-06T02:24:40.978773+0000","last_unstale":"2023-10-06T02:24:40.993400+0000","last_undegraded":"2023-10-06T02:24:40.993400+0000","last_fullsized":"2023-10-06T02:24:40.993400+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:40.143074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.997810+0000","last_change":"2023-10-06T02:24:40.990001+0000","last_active":"2023-10-06T02:24:40.997810+0000","last_peered":"2023-10-06T02:24:40.997810+0000","last_clean":"2023-10-06T02:24:40.997810+0000","last_became_active":"2023-10-06T02:24:40.989696+0000","last_became_peered":"2023-10-06T02:24:40.989696+0000","last_unstale":"2023-10-06T02:24:40.997810+0000","last_undegraded":"2023-10-06T02:24:40.997810+0000","last_fullsized":"2023-10-06T02:24:40.997810+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:34:44.335946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.986644+0000","last_change":"2023-10-06T02:24:40.978167+0000","last_active":"2023-10-06T02:24:40.986644+0000","last_peered":"2023-10-06T02:24:40.986644+0000","last_clean":"2023-10-06T02:24:40.986644+0000","last_became_active":"2023-10-06T02:24:40.977864+0000","last_became_peered":"2023-10-06T02:24:40.977864+0000","last_unstale":"2023-10-06T02:24:40.986644+0000","last_undegraded":"2023-10-06T02:24:40.986644+0000","last_fullsized":"2023-10-06T02:24:40.986644+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:58.329788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.995037+0000","last_change":"2023-10-06T02:24:40.982909+0000","last_active":"2023-10-06T02:24:40.995037+0000","last_peered":"2023-10-06T02:24:40.995037+0000","last_clean":"2023-10-06T02:24:40.995037+0000","last_became_active":"2023-10-06T02:24:40.982562+0000","last_became_peered":"2023-10-06T02:24:40.982562+0000","last_unstale":"2023-10-06T02:24:40.995037+0000","last_undegraded":"2023-10-06T02:24:40.995037+0000","last_fullsized":"2023-10-06T02:24:40.995037+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:14.538543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.990389+0000","last_change":"2023-10-06T02:24:40.984349+0000","last_active":"2023-10-06T02:24:40.990389+0000","last_peered":"2023-10-06T02:24:40.990389+0000","last_clean":"2023-10-06T02:24:40.990389+0000","last_became_active":"2023-10-06T02:24:40.984098+0000","last_became_peered":"2023-10-06T02:24:40.984098+0000","last_unstale":"2023-10-06T02:24:40.990389+0000","last_undegraded":"2023-10-06T02:24:40.990389+0000","last_fullsized":"2023-10-06T02:24:40.990389+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:54.104551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.989103+0000","last_change":"2023-10-06T02:24:40.981357+0000","last_active":"2023-10-06T02:24:40.989103+0000","last_peered":"2023-10-06T02:24:40.989103+0000","last_clean":"2023-10-06T02:24:40.989103+0000","last_became_active":"2023-10-06T02:24:40.981073+0000","last_became_peered":"2023-10-06T02:24:40.981073+0000","last_unstale":"2023-10-06T02:24:40.989103+0000","last_undegraded":"2023-10-06T02:24:40.989103+0000","last_fullsized":"2023-10-06T02:24:40.989103+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:35:37.491221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.981875+0000","last_change":"2023-10-06T02:24:40.979058+0000","last_active":"2023-10-06T02:24:40.981875+0000","last_peered":"2023-10-06T02:24:40.981875+0000","last_clean":"2023-10-06T02:24:40.981875+0000","last_became_active":"2023-10-06T02:24:40.978758+0000","last_became_peered":"2023-10-06T02:24:40.978758+0000","last_unstale":"2023-10-06T02:24:40.981875+0000","last_undegraded":"2023-10-06T02:24:40.981875+0000","last_fullsized":"2023-10-06T02:24:40.981875+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:45.082584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.991069+0000","last_change":"2023-10-06T02:24:40.984847+0000","last_active":"2023-10-06T02:24:40.991069+0000","last_peered":"2023-10-06T02:24:40.991069+0000","last_clean":"2023-10-06T02:24:40.991069+0000","last_became_active":"2023-10-06T02:24:40.984558+0000","last_became_peered":"2023-10-06T02:24:40.984558+0000","last_unstale":"2023-10-06T02:24:40.991069+0000","last_undegraded":"2023-10-06T02:24:40.991069+0000","last_fullsized":"2023-10-06T02:24:40.991069+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:49.888139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.990272+0000","last_change":"2023-10-06T02:24:40.982328+0000","last_active":"2023-10-06T02:24:40.990272+0000","last_peered":"2023-10-06T02:24:40.990272+0000","last_clean":"2023-10-06T02:24:40.990272+0000","last_became_active":"2023-10-06T02:24:40.982009+0000","last_became_peered":"2023-10-06T02:24:40.982009+0000","last_unstale":"2023-10-06T02:24:40.990272+0000","last_undegraded":"2023-10-06T02:24:40.990272+0000","last_fullsized":"2023-10-06T02:24:40.990272+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:03.105102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.991016+0000","last_change":"2023-10-06T02:24:40.985398+0000","last_active":"2023-10-06T02:24:40.991016+0000","last_peered":"2023-10-06T02:24:40.991016+0000","last_clean":"2023-10-06T02:24:40.991016+0000","last_became_active":"2023-10-06T02:24:40.985113+0000","last_became_peered":"2023-10-06T02:24:40.985113+0000","last_unstale":"2023-10-06T02:24:40.991016+0000","last_undegraded":"2023-10-06T02:24:40.991016+0000","last_fullsized":"2023-10-06T02:24:40.991016+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:56.221122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.988240+0000","last_change":"2023-10-06T02:24:40.982736+0000","last_active":"2023-10-06T02:24:40.988240+0000","last_peered":"2023-10-06T02:24:40.988240+0000","last_clean":"2023-10-06T02:24:40.988240+0000","last_became_active":"2023-10-06T02:24:40.982470+0000","last_became_peered":"2023-10-06T02:24:40.982470+0000","last_unstale":"2023-10-06T02:24:40.988240+0000","last_undegraded":"2023-10-06T02:24:40.988240+0000","last_fullsized":"2023-10-06T02:24:40.988240+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:56.791580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.972706+0000","last_change":"2023-10-06T02:24:40.970442+0000","last_active":"2023-10-06T02:24:40.972706+0000","last_peered":"2023-10-06T02:24:40.972706+0000","last_clean":"2023-10-06T02:24:40.972706+0000","last_became_active":"2023-10-06T02:24:40.970144+0000","last_became_peered":"2023-10-06T02:24:40.970144+0000","last_unstale":"2023-10-06T02:24:40.972706+0000","last_undegraded":"2023-10-06T02:24:40.972706+0000","last_fullsized":"2023-10-06T02:24:40.972706+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:30.985678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.992985+0000","last_change":"2023-10-06T02:24:40.984896+0000","last_active":"2023-10-06T02:24:40.992985+0000","last_peered":"2023-10-06T02:24:40.992985+0000","last_clean":"2023-10-06T02:24:40.992985+0000","last_became_active":"2023-10-06T02:24:40.984537+0000","last_became_peered":"2023-10-06T02:24:40.984537+0000","last_unstale":"2023-10-06T02:24:40.992985+0000","last_undegraded":"2023-10-06T02:24:40.992985+0000","last_fullsized":"2023-10-06T02:24:40.992985+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:14.538543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:41.001109+0000","last_change":"2023-10-06T02:24:40.994282+0000","last_active":"2023-10-06T02:24:41.001109+0000","last_peered":"2023-10-06T02:24:41.001109+0000","last_clean":"2023-10-06T02:24:41.001109+0000","last_became_active":"2023-10-06T02:24:40.994035+0000","last_became_peered":"2023-10-06T02:24:40.994035+0000","last_unstale":"2023-10-06T02:24:41.001109+0000","last_undegraded":"2023-10-06T02:24:41.001109+0000","last_fullsized":"2023-10-06T02:24:41.001109+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:03.453032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.978574+0000","last_change":"2023-10-06T02:24:40.971622+0000","last_active":"2023-10-06T02:24:40.978574+0000","last_peered":"2023-10-06T02:24:40.978574+0000","last_clean":"2023-10-06T02:24:40.978574+0000","last_became_active":"2023-10-06T02:24:40.971345+0000","last_became_peered":"2023-10-06T02:24:40.971345+0000","last_unstale":"2023-10-06T02:24:40.978574+0000","last_undegraded":"2023-10-06T02:24:40.978574+0000","last_fullsized":"2023-10-06T02:24:40.978574+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:07.486857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.998320+0000","last_change":"2023-10-06T02:24:40.991346+0000","last_active":"2023-10-06T02:24:40.998320+0000","last_peered":"2023-10-06T02:24:40.998320+0000","last_clean":"2023-10-06T02:24:40.998320+0000","last_became_active":"2023-10-06T02:24:40.991038+0000","last_became_peered":"2023-10-06T02:24:40.991038+0000","last_unstale":"2023-10-06T02:24:40.998320+0000","last_undegraded":"2023-10-06T02:24:40.998320+0000","last_fullsized":"2023-10-06T02:24:40.998320+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:12.535409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.995031+0000","last_change":"2023-10-06T02:24:40.986629+0000","last_active":"2023-10-06T02:24:40.995031+0000","last_peered":"2023-10-06T02:24:40.995031+0000","last_clean":"2023-10-06T02:24:40.995031+0000","last_became_active":"2023-10-06T02:24:40.986366+0000","last_became_peered":"2023-10-06T02:24:40.986366+0000","last_unstale":"2023-10-06T02:24:40.995031+0000","last_undegraded":"2023-10-06T02:24:40.995031+0000","last_fullsized":"2023-10-06T02:24:40.995031+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:04.227594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.972669+0000","last_change":"2023-10-06T02:24:40.970732+0000","last_active":"2023-10-06T02:24:40.972669+0000","last_peered":"2023-10-06T02:24:40.972669+0000","last_clean":"2023-10-06T02:24:40.972669+0000","last_became_active":"2023-10-06T02:24:40.970472+0000","last_became_peered":"2023-10-06T02:24:40.970472+0000","last_unstale":"2023-10-06T02:24:40.972669+0000","last_undegraded":"2023-10-06T02:24:40.972669+0000","last_fullsized":"2023-10-06T02:24:40.972669+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:14.313316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.994255+0000","last_change":"2023-10-06T02:24:40.986389+0000","last_active":"2023-10-06T02:24:40.994255+0000","last_peered":"2023-10-06T02:24:40.994255+0000","last_clean":"2023-10-06T02:24:40.994255+0000","last_became_active":"2023-10-06T02:24:40.986116+0000","last_became_peered":"2023-10-06T02:24:40.986116+0000","last_unstale":"2023-10-06T02:24:40.994255+0000","last_undegraded":"2023-10-06T02:24:40.994255+0000","last_fullsized":"2023-10-06T02:24:40.994255+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:53.903212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"94'4","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.994530+0000","last_change":"2023-10-06T02:24:39.975085+0000","last_active":"2023-10-06T02:24:40.994530+0000","last_peered":"2023-10-06T02:24:40.994530+0000","last_clean":"2023-10-06T02:24:40.994530+0000","last_became_active":"2023-10-06T02:24:39.974819+0000","last_became_peered":"2023-10-06T02:24:39.974819+0000","last_unstale":"2023-10-06T02:24:40.994530+0000","last_undegraded":"2023-10-06T02:24:40.994530+0000","last_fullsized":"2023-10-06T02:24:40.994530+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:22.010699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.995182+0000","last_change":"2023-10-06T02:24:40.986036+0000","last_active":"2023-10-06T02:24:40.995182+0000","last_peered":"2023-10-06T02:24:40.995182+0000","last_clean":"2023-10-06T02:24:40.995182+0000","last_became_active":"2023-10-06T02:24:40.985794+0000","last_became_peered":"2023-10-06T02:24:40.985794+0000","last_unstale":"2023-10-06T02:24:40.995182+0000","last_undegraded":"2023-10-06T02:24:40.995182+0000","last_fullsized":"2023-10-06T02:24:40.995182+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:23.015663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:41.000646+0000","last_change":"2023-10-06T02:24:39.974072+0000","last_active":"2023-10-06T02:24:41.000646+0000","last_peered":"2023-10-06T02:24:41.000646+0000","last_clean":"2023-10-06T02:24:41.000646+0000","last_became_active":"2023-10-06T02:24:39.973802+0000","last_became_peered":"2023-10-06T02:24:39.973802+0000","last_unstale":"2023-10-06T02:24:41.000646+0000","last_undegraded":"2023-10-06T02:24:41.000646+0000","last_fullsized":"2023-10-06T02:24:41.000646+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:43.496803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.983939+0000","last_change":"2023-10-06T02:24:40.979072+0000","last_active":"2023-10-06T02:24:40.983939+0000","last_peered":"2023-10-06T02:24:40.983939+0000","last_clean":"2023-10-06T02:24:40.983939+0000","last_became_active":"2023-10-06T02:24:40.978410+0000","last_became_peered":"2023-10-06T02:24:40.978410+0000","last_unstale":"2023-10-06T02:24:40.983939+0000","last_undegraded":"2023-10-06T02:24:40.983939+0000","last_fullsized":"2023-10-06T02:24:40.983939+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:59.071277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.996612+0000","last_change":"2023-10-06T02:24:39.980152+0000","last_active":"2023-10-06T02:24:40.996612+0000","last_peered":"2023-10-06T02:24:40.996612+0000","last_clean":"2023-10-06T02:24:40.996612+0000","last_became_active":"2023-10-06T02:24:39.979853+0000","last_became_peered":"2023-10-06T02:24:39.979853+0000","last_unstale":"2023-10-06T02:24:40.996612+0000","last_undegraded":"2023-10-06T02:24:40.996612+0000","last_fullsized":"2023-10-06T02:24:40.996612+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:59.113041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.994915+0000","last_change":"2023-10-06T02:24:40.983015+0000","last_active":"2023-10-06T02:24:40.994915+0000","last_peered":"2023-10-06T02:24:40.994915+0000","last_clean":"2023-10-06T02:24:40.994915+0000","last_became_active":"2023-10-06T02:24:40.982072+0000","last_became_peered":"2023-10-06T02:24:40.982072+0000","last_unstale":"2023-10-06T02:24:40.994915+0000","last_undegraded":"2023-10-06T02:24:40.994915+0000","last_fullsized":"2023-10-06T02:24:40.994915+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:24.399041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.998660+0000","last_change":"2023-10-06T02:24:39.976301+0000","last_active":"2023-10-06T02:24:40.998660+0000","last_peered":"2023-10-06T02:24:40.998660+0000","last_clean":"2023-10-06T02:24:40.998660+0000","last_became_active":"2023-10-06T02:24:39.976036+0000","last_became_peered":"2023-10-06T02:24:39.976036+0000","last_unstale":"2023-10-06T02:24:40.998660+0000","last_undegraded":"2023-10-06T02:24:40.998660+0000","last_fullsized":"2023-10-06T02:24:40.998660+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:23.302126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.992011+0000","last_change":"2023-10-06T02:24:40.987184+0000","last_active":"2023-10-06T02:24:40.992011+0000","last_peered":"2023-10-06T02:24:40.992011+0000","last_clean":"2023-10-06T02:24:40.992011+0000","last_became_active":"2023-10-06T02:24:40.986923+0000","last_became_peered":"2023-10-06T02:24:40.986923+0000","last_unstale":"2023-10-06T02:24:40.992011+0000","last_undegraded":"2023-10-06T02:24:40.992011+0000","last_fullsized":"2023-10-06T02:24:40.992011+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:28:13.672137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.994961+0000","last_change":"2023-10-06T02:24:39.973206+0000","last_active":"2023-10-06T02:24:40.994961+0000","last_peered":"2023-10-06T02:24:40.994961+0000","last_clean":"2023-10-06T02:24:40.994961+0000","last_became_active":"2023-10-06T02:24:39.972964+0000","last_became_peered":"2023-10-06T02:24:39.972964+0000","last_unstale":"2023-10-06T02:24:40.994961+0000","last_undegraded":"2023-10-06T02:24:40.994961+0000","last_fullsized":"2023-10-06T02:24:40.994961+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:52.898248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.997750+0000","last_change":"2023-10-06T02:24:40.988018+0000","last_active":"2023-10-06T02:24:40.997750+0000","last_peered":"2023-10-06T02:24:40.997750+0000","last_clean":"2023-10-06T02:24:40.997750+0000","last_became_active":"2023-10-06T02:24:40.987750+0000","last_became_peered":"2023-10-06T02:24:40.987750+0000","last_unstale":"2023-10-06T02:24:40.997750+0000","last_undegraded":"2023-10-06T02:24:40.997750+0000","last_fullsized":"2023-10-06T02:24:40.997750+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:56.817052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.997756+0000","last_change":"2023-10-06T02:24:39.972655+0000","last_active":"2023-10-06T02:24:40.997756+0000","last_peered":"2023-10-06T02:24:40.997756+0000","last_clean":"2023-10-06T02:24:40.997756+0000","last_became_active":"2023-10-06T02:24:39.972305+0000","last_became_peered":"2023-10-06T02:24:39.972305+0000","last_unstale":"2023-10-06T02:24:40.997756+0000","last_undegraded":"2023-10-06T02:24:40.997756+0000","last_fullsized":"2023-10-06T02:24:40.997756+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:24.291593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.995201+0000","last_change":"2023-10-06T02:24:40.983167+0000","last_active":"2023-10-06T02:24:40.995201+0000","last_peered":"2023-10-06T02:24:40.995201+0000","last_clean":"2023-10-06T02:24:40.995201+0000","last_became_active":"2023-10-06T02:24:40.978851+0000","last_became_peered":"2023-10-06T02:24:40.978851+0000","last_unstale":"2023-10-06T02:24:40.995201+0000","last_undegraded":"2023-10-06T02:24:40.995201+0000","last_fullsized":"2023-10-06T02:24:40.995201+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:56.733610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.977557+0000","last_change":"2023-10-06T02:24:39.971205+0000","last_active":"2023-10-06T02:24:40.977557+0000","last_peered":"2023-10-06T02:24:40.977557+0000","last_clean":"2023-10-06T02:24:40.977557+0000","last_became_active":"2023-10-06T02:24:39.970966+0000","last_became_peered":"2023-10-06T02:24:39.970966+0000","last_unstale":"2023-10-06T02:24:40.977557+0000","last_undegraded":"2023-10-06T02:24:40.977557+0000","last_fullsized":"2023-10-06T02:24:40.977557+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:18.974316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.993360+0000","last_change":"2023-10-06T02:24:40.986273+0000","last_active":"2023-10-06T02:24:40.993360+0000","last_peered":"2023-10-06T02:24:40.993360+0000","last_clean":"2023-10-06T02:24:40.993360+0000","last_became_active":"2023-10-06T02:24:40.982136+0000","last_became_peered":"2023-10-06T02:24:40.982136+0000","last_unstale":"2023-10-06T02:24:40.993360+0000","last_undegraded":"2023-10-06T02:24:40.993360+0000","last_fullsized":"2023-10-06T02:24:40.993360+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.866460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.964311+0000","last_change":"2023-10-06T02:24:39.981399+0000","last_active":"2023-10-06T02:24:40.964311+0000","last_peered":"2023-10-06T02:24:40.964311+0000","last_clean":"2023-10-06T02:24:40.964311+0000","last_became_active":"2023-10-06T02:24:39.979589+0000","last_became_peered":"2023-10-06T02:24:39.979589+0000","last_unstale":"2023-10-06T02:24:40.964311+0000","last_undegraded":"2023-10-06T02:24:40.964311+0000","last_fullsized":"2023-10-06T02:24:40.964311+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:11.530446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.984600+0000","last_change":"2023-10-06T02:24:40.978653+0000","last_active":"2023-10-06T02:24:40.984600+0000","last_peered":"2023-10-06T02:24:40.984600+0000","last_clean":"2023-10-06T02:24:40.984600+0000","last_became_active":"2023-10-06T02:24:40.978368+0000","last_became_peered":"2023-10-06T02:24:40.978368+0000","last_unstale":"2023-10-06T02:24:40.984600+0000","last_undegraded":"2023-10-06T02:24:40.984600+0000","last_fullsized":"2023-10-06T02:24:40.984600+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:22:16.099060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.964838+0000","last_change":"2023-10-06T02:24:39.971985+0000","last_active":"2023-10-06T02:24:40.964838+0000","last_peered":"2023-10-06T02:24:40.964838+0000","last_clean":"2023-10-06T02:24:40.964838+0000","last_became_active":"2023-10-06T02:24:39.971728+0000","last_became_peered":"2023-10-06T02:24:39.971728+0000","last_unstale":"2023-10-06T02:24:40.964838+0000","last_undegraded":"2023-10-06T02:24:40.964838+0000","last_fullsized":"2023-10-06T02:24:40.964838+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:09.608799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.993328+0000","last_change":"2023-10-06T02:24:40.983196+0000","last_active":"2023-10-06T02:24:40.993328+0000","last_peered":"2023-10-06T02:24:40.993328+0000","last_clean":"2023-10-06T02:24:40.993328+0000","last_became_active":"2023-10-06T02:24:40.982938+0000","last_became_peered":"2023-10-06T02:24:40.982938+0000","last_unstale":"2023-10-06T02:24:40.993328+0000","last_undegraded":"2023-10-06T02:24:40.993328+0000","last_fullsized":"2023-10-06T02:24:40.993328+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:35.995255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.970379+0000","last_change":"2023-10-06T02:24:39.980911+0000","last_active":"2023-10-06T02:24:40.970379+0000","last_peered":"2023-10-06T02:24:40.970379+0000","last_clean":"2023-10-06T02:24:40.970379+0000","last_became_active":"2023-10-06T02:24:39.980544+0000","last_became_peered":"2023-10-06T02:24:39.980544+0000","last_unstale":"2023-10-06T02:24:40.970379+0000","last_undegraded":"2023-10-06T02:24:40.970379+0000","last_fullsized":"2023-10-06T02:24:40.970379+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:50.105604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.988063+0000","last_change":"2023-10-06T02:24:40.981965+0000","last_active":"2023-10-06T02:24:40.988063+0000","last_peered":"2023-10-06T02:24:40.988063+0000","last_clean":"2023-10-06T02:24:40.988063+0000","last_became_active":"2023-10-06T02:24:40.981544+0000","last_became_peered":"2023-10-06T02:24:40.981544+0000","last_unstale":"2023-10-06T02:24:40.988063+0000","last_undegraded":"2023-10-06T02:24:40.988063+0000","last_fullsized":"2023-10-06T02:24:40.988063+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:34:44.335946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"94'3","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:41.001443+0000","last_change":"2023-10-06T02:24:39.976365+0000","last_active":"2023-10-06T02:24:41.001443+0000","last_peered":"2023-10-06T02:24:41.001443+0000","last_clean":"2023-10-06T02:24:41.001443+0000","last_became_active":"2023-10-06T02:24:39.976088+0000","last_became_peered":"2023-10-06T02:24:39.976088+0000","last_unstale":"2023-10-06T02:24:41.001443+0000","last_undegraded":"2023-10-06T02:24:41.001443+0000","last_fullsized":"2023-10-06T02:24:41.001443+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:24.102710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.993005+0000","last_change":"2023-10-06T02:24:40.985058+0000","last_active":"2023-10-06T02:24:40.993005+0000","last_peered":"2023-10-06T02:24:40.993005+0000","last_clean":"2023-10-06T02:24:40.993005+0000","last_became_active":"2023-10-06T02:24:40.984624+0000","last_became_peered":"2023-10-06T02:24:40.984624+0000","last_unstale":"2023-10-06T02:24:40.993005+0000","last_undegraded":"2023-10-06T02:24:40.993005+0000","last_fullsized":"2023-10-06T02:24:40.993005+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:03.453032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"94'6","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:41.002475+0000","last_change":"2023-10-06T02:24:39.979144+0000","last_active":"2023-10-06T02:24:41.002475+0000","last_peered":"2023-10-06T02:24:41.002475+0000","last_clean":"2023-10-06T02:24:41.002475+0000","last_became_active":"2023-10-06T02:24:39.978902+0000","last_became_peered":"2023-10-06T02:24:39.978902+0000","last_unstale":"2023-10-06T02:24:41.002475+0000","last_undegraded":"2023-10-06T02:24:41.002475+0000","last_fullsized":"2023-10-06T02:24:41.002475+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:13.533579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.995064+0000","last_change":"2023-10-06T02:24:40.981894+0000","last_active":"2023-10-06T02:24:40.995064+0000","last_peered":"2023-10-06T02:24:40.995064+0000","last_clean":"2023-10-06T02:24:40.995064+0000","last_became_active":"2023-10-06T02:24:40.981625+0000","last_became_peered":"2023-10-06T02:24:40.981625+0000","last_unstale":"2023-10-06T02:24:40.995064+0000","last_undegraded":"2023-10-06T02:24:40.995064+0000","last_fullsized":"2023-10-06T02:24:40.995064+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:50.827312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.998368+0000","last_change":"2023-10-06T02:24:39.976840+0000","last_active":"2023-10-06T02:24:40.998368+0000","last_peered":"2023-10-06T02:24:40.998368+0000","last_clean":"2023-10-06T02:24:40.998368+0000","last_became_active":"2023-10-06T02:24:39.976430+0000","last_became_peered":"2023-10-06T02:24:39.976430+0000","last_unstale":"2023-10-06T02:24:40.998368+0000","last_undegraded":"2023-10-06T02:24:40.998368+0000","last_fullsized":"2023-10-06T02:24:40.998368+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:07.627361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.984592+0000","last_change":"2023-10-06T02:24:40.982415+0000","last_active":"2023-10-06T02:24:40.984592+0000","last_peered":"2023-10-06T02:24:40.984592+0000","last_clean":"2023-10-06T02:24:40.984592+0000","last_became_active":"2023-10-06T02:24:40.982172+0000","last_became_peered":"2023-10-06T02:24:40.982172+0000","last_unstale":"2023-10-06T02:24:40.984592+0000","last_undegraded":"2023-10-06T02:24:40.984592+0000","last_fullsized":"2023-10-06T02:24:40.984592+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:23.772122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.975176+0000","last_change":"2023-10-06T02:24:39.984134+0000","last_active":"2023-10-06T02:24:40.975176+0000","last_peered":"2023-10-06T02:24:40.975176+0000","last_clean":"2023-10-06T02:24:40.975176+0000","last_became_active":"2023-10-06T02:24:39.983937+0000","last_became_peered":"2023-10-06T02:24:39.983937+0000","last_unstale":"2023-10-06T02:24:40.975176+0000","last_undegraded":"2023-10-06T02:24:40.975176+0000","last_fullsized":"2023-10-06T02:24:40.975176+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:00.166209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.993200+0000","last_change":"2023-10-06T02:24:40.983128+0000","last_active":"2023-10-06T02:24:40.993200+0000","last_peered":"2023-10-06T02:24:40.993200+0000","last_clean":"2023-10-06T02:24:40.993200+0000","last_became_active":"2023-10-06T02:24:40.982188+0000","last_became_peered":"2023-10-06T02:24:40.982188+0000","last_unstale":"2023-10-06T02:24:40.993200+0000","last_undegraded":"2023-10-06T02:24:40.993200+0000","last_fullsized":"2023-10-06T02:24:40.993200+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:07.518324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.968311+0000","last_change":"2023-10-06T02:24:39.975251+0000","last_active":"2023-10-06T02:24:40.968311+0000","last_peered":"2023-10-06T02:24:40.968311+0000","last_clean":"2023-10-06T02:24:40.968311+0000","last_became_active":"2023-10-06T02:24:39.974945+0000","last_became_peered":"2023-10-06T02:24:39.974945+0000","last_unstale":"2023-10-06T02:24:40.968311+0000","last_undegraded":"2023-10-06T02:24:40.968311+0000","last_fullsized":"2023-10-06T02:24:40.968311+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:06.293337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.997919+0000","last_change":"2023-10-06T02:24:40.991039+0000","last_active":"2023-10-06T02:24:40.997919+0000","last_peered":"2023-10-06T02:24:40.997919+0000","last_clean":"2023-10-06T02:24:40.997919+0000","last_became_active":"2023-10-06T02:24:40.990759+0000","last_became_peered":"2023-10-06T02:24:40.990759+0000","last_unstale":"2023-10-06T02:24:40.997919+0000","last_undegraded":"2023-10-06T02:24:40.997919+0000","last_fullsized":"2023-10-06T02:24:40.997919+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:10.613763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"94'8","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:41.001651+0000","last_change":"2023-10-06T02:24:39.970516+0000","last_active":"2023-10-06T02:24:41.001651+0000","last_peered":"2023-10-06T02:24:41.001651+0000","last_clean":"2023-10-06T02:24:41.001651+0000","last_became_active":"2023-10-06T02:24:39.970272+0000","last_became_peered":"2023-10-06T02:24:39.970272+0000","last_unstale":"2023-10-06T02:24:41.001651+0000","last_undegraded":"2023-10-06T02:24:41.001651+0000","last_fullsized":"2023-10-06T02:24:41.001651+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:17.651579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.990212+0000","last_change":"2023-10-06T02:24:40.984487+0000","last_active":"2023-10-06T02:24:40.990212+0000","last_peered":"2023-10-06T02:24:40.990212+0000","last_clean":"2023-10-06T02:24:40.990212+0000","last_became_active":"2023-10-06T02:24:40.981944+0000","last_became_peered":"2023-10-06T02:24:40.981944+0000","last_unstale":"2023-10-06T02:24:40.990212+0000","last_undegraded":"2023-10-06T02:24:40.990212+0000","last_fullsized":"2023-10-06T02:24:40.990212+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:41.084634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.998487+0000","last_change":"2023-10-06T02:24:39.976424+0000","last_active":"2023-10-06T02:24:40.998487+0000","last_peered":"2023-10-06T02:24:40.998487+0000","last_clean":"2023-10-06T02:24:40.998487+0000","last_became_active":"2023-10-06T02:24:39.976136+0000","last_became_peered":"2023-10-06T02:24:39.976136+0000","last_unstale":"2023-10-06T02:24:40.998487+0000","last_undegraded":"2023-10-06T02:24:40.998487+0000","last_fullsized":"2023-10-06T02:24:40.998487+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:42.794495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.986585+0000","last_change":"2023-10-06T02:24:40.983241+0000","last_active":"2023-10-06T02:24:40.986585+0000","last_peered":"2023-10-06T02:24:40.986585+0000","last_clean":"2023-10-06T02:24:40.986585+0000","last_became_active":"2023-10-06T02:24:40.982969+0000","last_became_peered":"2023-10-06T02:24:40.982969+0000","last_unstale":"2023-10-06T02:24:40.986585+0000","last_undegraded":"2023-10-06T02:24:40.986585+0000","last_fullsized":"2023-10-06T02:24:40.986585+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:43.799459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-06T02:24:41.967506+0000","last_change":"2023-10-06T02:24:39.979586+0000","last_active":"2023-10-06T02:24:41.967506+0000","last_peered":"2023-10-06T02:24:41.967506+0000","last_clean":"2023-10-06T02:24:41.967506+0000","last_became_active":"2023-10-06T02:24:39.979318+0000","last_became_peered":"2023-10-06T02:24:39.979318+0000","last_unstale":"2023-10-06T02:24:41.967506+0000","last_undegraded":"2023-10-06T02:24:41.967506+0000","last_fullsized":"2023-10-06T02:24:41.967506+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:03.222631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.994062+0000","last_change":"2023-10-06T02:24:40.988029+0000","last_active":"2023-10-06T02:24:40.994062+0000","last_peered":"2023-10-06T02:24:40.994062+0000","last_clean":"2023-10-06T02:24:40.994062+0000","last_became_active":"2023-10-06T02:24:40.987746+0000","last_became_peered":"2023-10-06T02:24:40.987746+0000","last_unstale":"2023-10-06T02:24:40.994062+0000","last_undegraded":"2023-10-06T02:24:40.994062+0000","last_fullsized":"2023-10-06T02:24:40.994062+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:40.550120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.964818+0000","last_change":"2023-10-06T02:24:39.976072+0000","last_active":"2023-10-06T02:24:40.964818+0000","last_peered":"2023-10-06T02:24:40.964818+0000","last_clean":"2023-10-06T02:24:40.964818+0000","last_became_active":"2023-10-06T02:24:39.975779+0000","last_became_peered":"2023-10-06T02:24:39.975779+0000","last_unstale":"2023-10-06T02:24:40.964818+0000","last_undegraded":"2023-10-06T02:24:40.964818+0000","last_fullsized":"2023-10-06T02:24:40.964818+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:39.138110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:41.000809+0000","last_change":"2023-10-06T02:24:40.994187+0000","last_active":"2023-10-06T02:24:41.000809+0000","last_peered":"2023-10-06T02:24:41.000809+0000","last_clean":"2023-10-06T02:24:41.000809+0000","last_became_active":"2023-10-06T02:24:40.993928+0000","last_became_peered":"2023-10-06T02:24:40.993928+0000","last_unstale":"2023-10-06T02:24:41.000809+0000","last_undegraded":"2023-10-06T02:24:41.000809+0000","last_fullsized":"2023-10-06T02:24:41.000809+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:31.150685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.979081+0000","last_change":"2023-10-06T02:24:39.973897+0000","last_active":"2023-10-06T02:24:40.979081+0000","last_peered":"2023-10-06T02:24:40.979081+0000","last_clean":"2023-10-06T02:24:40.979081+0000","last_became_active":"2023-10-06T02:24:39.973571+0000","last_became_peered":"2023-10-06T02:24:39.973571+0000","last_unstale":"2023-10-06T02:24:40.979081+0000","last_undegraded":"2023-10-06T02:24:40.979081+0000","last_fullsized":"2023-10-06T02:24:40.979081+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:29.040516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.995647+0000","last_change":"2023-10-06T02:24:40.989984+0000","last_active":"2023-10-06T02:24:40.995647+0000","last_peered":"2023-10-06T02:24:40.995647+0000","last_clean":"2023-10-06T02:24:40.995647+0000","last_became_active":"2023-10-06T02:24:40.989735+0000","last_became_peered":"2023-10-06T02:24:40.989735+0000","last_unstale":"2023-10-06T02:24:40.995647+0000","last_undegraded":"2023-10-06T02:24:40.995647+0000","last_fullsized":"2023-10-06T02:24:40.995647+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:32.991704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.966779+0000","last_change":"2023-10-06T02:24:39.974701+0000","last_active":"2023-10-06T02:24:40.966779+0000","last_peered":"2023-10-06T02:24:40.966779+0000","last_clean":"2023-10-06T02:24:40.966779+0000","last_became_active":"2023-10-06T02:24:39.974430+0000","last_became_peered":"2023-10-06T02:24:39.974430+0000","last_unstale":"2023-10-06T02:24:40.966779+0000","last_undegraded":"2023-10-06T02:24:40.966779+0000","last_fullsized":"2023-10-06T02:24:40.966779+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:48.940881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.998060+0000","last_change":"2023-10-06T02:24:40.987850+0000","last_active":"2023-10-06T02:24:40.998060+0000","last_peered":"2023-10-06T02:24:40.998060+0000","last_clean":"2023-10-06T02:24:40.998060+0000","last_became_active":"2023-10-06T02:24:40.987601+0000","last_became_peered":"2023-10-06T02:24:40.987601+0000","last_unstale":"2023-10-06T02:24:40.998060+0000","last_undegraded":"2023-10-06T02:24:40.998060+0000","last_fullsized":"2023-10-06T02:24:40.998060+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:43:30.582921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.972567+0000","last_change":"2023-10-06T02:24:39.973724+0000","last_active":"2023-10-06T02:24:40.972567+0000","last_peered":"2023-10-06T02:24:40.972567+0000","last_clean":"2023-10-06T02:24:40.972567+0000","last_became_active":"2023-10-06T02:24:39.973431+0000","last_became_peered":"2023-10-06T02:24:39.973431+0000","last_unstale":"2023-10-06T02:24:40.972567+0000","last_undegraded":"2023-10-06T02:24:40.972567+0000","last_fullsized":"2023-10-06T02:24:40.972567+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:06.522727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.998079+0000","last_change":"2023-10-06T02:24:40.991237+0000","last_active":"2023-10-06T02:24:40.998079+0000","last_peered":"2023-10-06T02:24:40.998079+0000","last_clean":"2023-10-06T02:24:40.998079+0000","last_became_active":"2023-10-06T02:24:40.990837+0000","last_became_peered":"2023-10-06T02:24:40.990837+0000","last_unstale":"2023-10-06T02:24:40.998079+0000","last_undegraded":"2023-10-06T02:24:40.998079+0000","last_fullsized":"2023-10-06T02:24:40.998079+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:35.438698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.970291+0000","last_change":"2023-10-06T02:24:39.985278+0000","last_active":"2023-10-06T02:24:40.970291+0000","last_peered":"2023-10-06T02:24:40.970291+0000","last_clean":"2023-10-06T02:24:40.970291+0000","last_became_active":"2023-10-06T02:24:39.985020+0000","last_became_peered":"2023-10-06T02:24:39.985020+0000","last_unstale":"2023-10-06T02:24:40.970291+0000","last_undegraded":"2023-10-06T02:24:40.970291+0000","last_fullsized":"2023-10-06T02:24:40.970291+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:04.563087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:41.000890+0000","last_change":"2023-10-06T02:24:40.993974+0000","last_active":"2023-10-06T02:24:41.000890+0000","last_peered":"2023-10-06T02:24:41.000890+0000","last_clean":"2023-10-06T02:24:41.000890+0000","last_became_active":"2023-10-06T02:24:40.993694+0000","last_became_peered":"2023-10-06T02:24:40.993694+0000","last_unstale":"2023-10-06T02:24:41.000890+0000","last_undegraded":"2023-10-06T02:24:41.000890+0000","last_fullsized":"2023-10-06T02:24:41.000890+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.968616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.973762+0000","last_change":"2023-10-06T02:24:39.976021+0000","last_active":"2023-10-06T02:24:40.973762+0000","last_peered":"2023-10-06T02:24:40.973762+0000","last_clean":"2023-10-06T02:24:40.973762+0000","last_became_active":"2023-10-06T02:24:39.975772+0000","last_became_peered":"2023-10-06T02:24:39.975772+0000","last_unstale":"2023-10-06T02:24:40.973762+0000","last_undegraded":"2023-10-06T02:24:40.973762+0000","last_fullsized":"2023-10-06T02:24:40.973762+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:19.298438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.983976+0000","last_change":"2023-10-06T02:24:40.981536+0000","last_active":"2023-10-06T02:24:40.983976+0000","last_peered":"2023-10-06T02:24:40.983976+0000","last_clean":"2023-10-06T02:24:40.983976+0000","last_became_active":"2023-10-06T02:24:40.981271+0000","last_became_peered":"2023-10-06T02:24:40.981271+0000","last_unstale":"2023-10-06T02:24:40.983976+0000","last_undegraded":"2023-10-06T02:24:40.983976+0000","last_fullsized":"2023-10-06T02:24:40.983976+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:18.656542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.974659+0000","last_change":"2023-10-06T02:24:39.973641+0000","last_active":"2023-10-06T02:24:40.974659+0000","last_peered":"2023-10-06T02:24:40.974659+0000","last_clean":"2023-10-06T02:24:40.974659+0000","last_became_active":"2023-10-06T02:24:39.973198+0000","last_became_peered":"2023-10-06T02:24:39.973198+0000","last_unstale":"2023-10-06T02:24:40.974659+0000","last_undegraded":"2023-10-06T02:24:40.974659+0000","last_fullsized":"2023-10-06T02:24:40.974659+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:14.807923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":79,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.968884+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:24:40.968884+0000","last_peered":"2023-10-06T02:24:40.968884+0000","last_clean":"2023-10-06T02:24:40.968884+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:24:40.968884+0000","last_undegraded":"2023-10-06T02:24:40.968884+0000","last_fullsized":"2023-10-06T02:24:40.968884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.998342+0000","last_change":"2023-10-06T02:24:40.992342+0000","last_active":"2023-10-06T02:24:40.998342+0000","last_peered":"2023-10-06T02:24:40.998342+0000","last_clean":"2023-10-06T02:24:40.998342+0000","last_became_active":"2023-10-06T02:24:40.992082+0000","last_became_peered":"2023-10-06T02:24:40.992082+0000","last_unstale":"2023-10-06T02:24:40.998342+0000","last_undegraded":"2023-10-06T02:24:40.998342+0000","last_fullsized":"2023-10-06T02:24:40.998342+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:35.595154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.996011+0000","last_change":"2023-10-06T02:24:39.979843+0000","last_active":"2023-10-06T02:24:40.996011+0000","last_peered":"2023-10-06T02:24:40.996011+0000","last_clean":"2023-10-06T02:24:40.996011+0000","last_became_active":"2023-10-06T02:24:39.979522+0000","last_became_peered":"2023-10-06T02:24:39.979522+0000","last_unstale":"2023-10-06T02:24:40.996011+0000","last_undegraded":"2023-10-06T02:24:40.996011+0000","last_fullsized":"2023-10-06T02:24:40.996011+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:55.728646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":81,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.970666+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:24:40.970666+0000","last_peered":"2023-10-06T02:24:40.970666+0000","last_clean":"2023-10-06T02:24:40.970666+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:24:40.970666+0000","last_undegraded":"2023-10-06T02:24:40.970666+0000","last_fullsized":"2023-10-06T02:24:40.970666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:41.000635+0000","last_change":"2023-10-06T02:24:40.991385+0000","last_active":"2023-10-06T02:24:41.000635+0000","last_peered":"2023-10-06T02:24:41.000635+0000","last_clean":"2023-10-06T02:24:41.000635+0000","last_became_active":"2023-10-06T02:24:40.990467+0000","last_became_peered":"2023-10-06T02:24:40.990467+0000","last_unstale":"2023-10-06T02:24:41.000635+0000","last_undegraded":"2023-10-06T02:24:41.000635+0000","last_fullsized":"2023-10-06T02:24:41.000635+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:14.968616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.964740+0000","last_change":"2023-10-06T02:24:39.976127+0000","last_active":"2023-10-06T02:24:40.964740+0000","last_peered":"2023-10-06T02:24:40.964740+0000","last_clean":"2023-10-06T02:24:40.964740+0000","last_became_active":"2023-10-06T02:24:39.975820+0000","last_became_peered":"2023-10-06T02:24:39.975820+0000","last_unstale":"2023-10-06T02:24:40.964740+0000","last_undegraded":"2023-10-06T02:24:40.964740+0000","last_fullsized":"2023-10-06T02:24:40.964740+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:53.313940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":80,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.964681+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:24:40.964681+0000","last_peered":"2023-10-06T02:24:40.964681+0000","last_clean":"2023-10-06T02:24:40.964681+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:24:40.964681+0000","last_undegraded":"2023-10-06T02:24:40.964681+0000","last_fullsized":"2023-10-06T02:24:40.964681+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":229,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.977267+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:24:40.977267+0000","last_peered":"2023-10-06T02:24:40.977267+0000","last_clean":"2023-10-06T02:24:40.977267+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:24:40.977267+0000","last_undegraded":"2023-10-06T02:24:40.977267+0000","last_fullsized":"2023-10-06T02:24:40.977267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.992594+0000","last_change":"2023-10-06T02:24:40.986275+0000","last_active":"2023-10-06T02:24:40.992594+0000","last_peered":"2023-10-06T02:24:40.992594+0000","last_clean":"2023-10-06T02:24:40.992594+0000","last_became_active":"2023-10-06T02:24:40.985836+0000","last_became_peered":"2023-10-06T02:24:40.985836+0000","last_unstale":"2023-10-06T02:24:40.992594+0000","last_undegraded":"2023-10-06T02:24:40.992594+0000","last_fullsized":"2023-10-06T02:24:40.992594+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:19.979280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.994163+0000","last_change":"2023-10-06T02:24:39.974456+0000","last_active":"2023-10-06T02:24:40.994163+0000","last_peered":"2023-10-06T02:24:40.994163+0000","last_clean":"2023-10-06T02:24:40.994163+0000","last_became_active":"2023-10-06T02:24:39.974171+0000","last_became_peered":"2023-10-06T02:24:39.974171+0000","last_unstale":"2023-10-06T02:24:40.994163+0000","last_undegraded":"2023-10-06T02:24:40.994163+0000","last_fullsized":"2023-10-06T02:24:40.994163+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:24.102710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":79,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.976269+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:24:40.976269+0000","last_peered":"2023-10-06T02:24:40.976269+0000","last_clean":"2023-10-06T02:24:40.976269+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:24:40.976269+0000","last_undegraded":"2023-10-06T02:24:40.976269+0000","last_fullsized":"2023-10-06T02:24:40.976269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.998143+0000","last_change":"2023-10-06T02:24:40.992351+0000","last_active":"2023-10-06T02:24:40.998143+0000","last_peered":"2023-10-06T02:24:40.998143+0000","last_clean":"2023-10-06T02:24:40.998143+0000","last_became_active":"2023-10-06T02:24:40.992140+0000","last_became_peered":"2023-10-06T02:24:40.992140+0000","last_unstale":"2023-10-06T02:24:40.998143+0000","last_undegraded":"2023-10-06T02:24:40.998143+0000","last_fullsized":"2023-10-06T02:24:40.998143+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:08.104824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:41.000715+0000","last_change":"2023-10-06T02:24:39.974763+0000","last_active":"2023-10-06T02:24:41.000715+0000","last_peered":"2023-10-06T02:24:41.000715+0000","last_clean":"2023-10-06T02:24:41.000715+0000","last_became_active":"2023-10-06T02:24:39.974488+0000","last_became_peered":"2023-10-06T02:24:39.974488+0000","last_unstale":"2023-10-06T02:24:41.000715+0000","last_undegraded":"2023-10-06T02:24:41.000715+0000","last_fullsized":"2023-10-06T02:24:41.000715+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:06.522727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":79,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.977095+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:24:40.977095+0000","last_peered":"2023-10-06T02:24:40.977095+0000","last_clean":"2023-10-06T02:24:40.977095+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:24:40.977095+0000","last_undegraded":"2023-10-06T02:24:40.977095+0000","last_fullsized":"2023-10-06T02:24:40.977095+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.993541+0000","last_change":"2023-10-06T02:24:40.988004+0000","last_active":"2023-10-06T02:24:40.993541+0000","last_peered":"2023-10-06T02:24:40.993541+0000","last_clean":"2023-10-06T02:24:40.993541+0000","last_became_active":"2023-10-06T02:24:40.987426+0000","last_became_peered":"2023-10-06T02:24:40.987426+0000","last_unstale":"2023-10-06T02:24:40.993541+0000","last_undegraded":"2023-10-06T02:24:40.993541+0000","last_fullsized":"2023-10-06T02:24:40.993541+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:56.221122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:41.001070+0000","last_change":"2023-10-06T02:24:39.978145+0000","last_active":"2023-10-06T02:24:41.001070+0000","last_peered":"2023-10-06T02:24:41.001070+0000","last_clean":"2023-10-06T02:24:41.001070+0000","last_became_active":"2023-10-06T02:24:39.977744+0000","last_became_peered":"2023-10-06T02:24:39.977744+0000","last_unstale":"2023-10-06T02:24:41.001070+0000","last_undegraded":"2023-10-06T02:24:41.001070+0000","last_fullsized":"2023-10-06T02:24:41.001070+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:49.822349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":77,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.975094+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:24:40.975094+0000","last_peered":"2023-10-06T02:24:40.975094+0000","last_clean":"2023-10-06T02:24:40.975094+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:24:40.975094+0000","last_undegraded":"2023-10-06T02:24:40.975094+0000","last_fullsized":"2023-10-06T02:24:40.975094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.998102+0000","last_change":"2023-10-06T02:24:40.992444+0000","last_active":"2023-10-06T02:24:40.998102+0000","last_peered":"2023-10-06T02:24:40.998102+0000","last_clean":"2023-10-06T02:24:40.998102+0000","last_became_active":"2023-10-06T02:24:40.992159+0000","last_became_peered":"2023-10-06T02:24:40.992159+0000","last_unstale":"2023-10-06T02:24:40.998102+0000","last_undegraded":"2023-10-06T02:24:40.998102+0000","last_fullsized":"2023-10-06T02:24:40.998102+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:05.211450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.975027+0000","last_change":"2023-10-06T02:24:39.977321+0000","last_active":"2023-10-06T02:24:40.975027+0000","last_peered":"2023-10-06T02:24:40.975027+0000","last_clean":"2023-10-06T02:24:40.975027+0000","last_became_active":"2023-10-06T02:24:39.977039+0000","last_became_peered":"2023-10-06T02:24:39.977039+0000","last_unstale":"2023-10-06T02:24:40.975027+0000","last_undegraded":"2023-10-06T02:24:40.975027+0000","last_fullsized":"2023-10-06T02:24:40.975027+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:56.670718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":77,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.973821+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:24:40.973821+0000","last_peered":"2023-10-06T02:24:40.973821+0000","last_clean":"2023-10-06T02:24:40.973821+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:24:40.973821+0000","last_undegraded":"2023-10-06T02:24:40.973821+0000","last_fullsized":"2023-10-06T02:24:40.973821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.988206+0000","last_change":"2023-10-06T02:24:40.982212+0000","last_active":"2023-10-06T02:24:40.988206+0000","last_peered":"2023-10-06T02:24:40.988206+0000","last_clean":"2023-10-06T02:24:40.988206+0000","last_became_active":"2023-10-06T02:24:40.981907+0000","last_became_peered":"2023-10-06T02:24:40.981907+0000","last_unstale":"2023-10-06T02:24:40.988206+0000","last_undegraded":"2023-10-06T02:24:40.988206+0000","last_fullsized":"2023-10-06T02:24:40.988206+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:39.954191+0000","last_clean_scrub_stamp":"2023-10-06T02:24:39.954191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:16.842155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.965376+0000","last_change":"2023-10-06T02:24:39.973325+0000","last_active":"2023-10-06T02:24:40.965376+0000","last_peered":"2023-10-06T02:24:40.965376+0000","last_clean":"2023-10-06T02:24:40.965376+0000","last_became_active":"2023-10-06T02:24:39.973093+0000","last_became_peered":"2023-10-06T02:24:39.973093+0000","last_unstale":"2023-10-06T02:24:40.965376+0000","last_undegraded":"2023-10-06T02:24:40.965376+0000","last_fullsized":"2023-10-06T02:24:40.965376+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:38.949227+0000","last_clean_scrub_stamp":"2023-10-06T02:24:38.949227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:57.861496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":77,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T02:24:40.978628+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:24:40.978628+0000","last_peered":"2023-10-06T02:24:40.978628+0000","last_clean":"2023-10-06T02:24:40.978628+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:24:40.978628+0000","last_undegraded":"2023-10-06T02:24:40.978628+0000","last_fullsized":"2023-10-06T02:24:40.978628+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574937,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299020,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072820,"statfs":{"total":96636764160,"available":96330567680,"internally_reserved":0,"allocated":1773568,"data_stored":1156522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.505},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70899999999999996,"5min":0.79700000000000004,"15min":1.111},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.495},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.83299999999999996,"15min":0.97899999999999998},"last":0.33800000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55600000000000005,"15min":0.51800000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.86299999999999999,"15min":1.008},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.51700000000000002},"min":{"1min":0.371,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79100000000000004,"5min":0.81000000000000005,"15min":1.075},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":0.83499999999999996,"15min":1.149},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.623,"15min":0.58299999999999996},"min":{"1min":0.443,"5min":0.41199999999999998,"15min":0.38800000000000001},"max":{"1min":0.80300000000000005,"5min":0.81399999999999995,"15min":1.048},"last":0.42799999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.41199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.75800000000000001,"5min":0.79200000000000004,"15min":1.175},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60499999999999998,"15min":0.57299999999999995},"min":{"1min":0.44900000000000001,"5min":0.41199999999999998,"15min":0.36799999999999999},"max":{"1min":0.70799999999999996,"5min":0.83799999999999997,"15min":1.03},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48299999999999998,"15min":0.48599999999999999},"min":{"1min":0.33900000000000002,"5min":0.30399999999999999,"15min":0.29299999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.873},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33700000000000002},"max":{"1min":0.67900000000000005,"5min":0.80300000000000005,"15min":0.85299999999999998},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.378,"5min":0.318,"15min":0.318},"max":{"1min":0.66500000000000004,"5min":0.749,"15min":0.81899999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.40500000000000003,"5min":0.35599999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.40300000000000002,"5min":0.40200000000000002,"15min":0.38700000000000001},"max":{"1min":0.754,"5min":0.84799999999999998,"15min":0.91700000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.47699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77300000000000002,"5min":0.78600000000000003,"15min":0.89800000000000002},"last":0.59699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298436,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073404,"statfs":{"total":96636764160,"available":96331165696,"internally_reserved":0,"allocated":1175552,"data_stored":565713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56499999999999995,"15min":0.78100000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.752,"5min":0.82399999999999995,"15min":5.6929999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57499999999999996,"15min":0.79500000000000004},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76300000000000001,"5min":0.82799999999999996,"15min":5.7060000000000004},"last":0.55700000000000005}]},{"osd":1,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.32500000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.76300000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58199999999999996,"15min":0.53000000000000003},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":0.77200000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.68799999999999994}]},{"osd":2,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56699999999999995,"15min":0.93300000000000005},"min":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.751,"5min":0.82299999999999995,"15min":8.8659999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73099999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53100000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58999999999999997,"15min":1.0249999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77000000000000002,"5min":0.86799999999999999,"15min":10.659000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72399999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46700000000000003,"15min":0.50600000000000001},"min":{"1min":0.30599999999999999,"5min":0.30199999999999999,"15min":0.27400000000000002},"max":{"1min":0.52800000000000002,"5min":0.76100000000000001,"15min":0.79600000000000004},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.54100000000000004},"min":{"1min":0.32400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.76100000000000001,"15min":0.76500000000000001},"last":0.63}]},{"osd":5,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.49399999999999999,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68400000000000005,"5min":0.746,"15min":0.78300000000000003},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.51800000000000002,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.69799999999999995,"5min":0.82699999999999996,"15min":0.84399999999999997},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54800000000000004,"15min":0.58399999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.312},"max":{"1min":0.755,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58299999999999996,"15min":0.626},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.752,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.70399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299008,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072832,"statfs":{"total":96636764160,"available":96330579968,"internally_reserved":0,"allocated":1761280,"data_stored":1155457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.377,"15min":0.35099999999999998},"min":{"1min":0.20300000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.497,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.39900000000000002,"15min":0.36099999999999999},"min":{"1min":0.28199999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51000000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35599999999999998,"15min":0.32700000000000001},"min":{"1min":0.22500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.46100000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41399999999999998,"15min":0.38600000000000001},"min":{"1min":0.252,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.621,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.31900000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.434,"15min":0.38700000000000001},"min":{"1min":0.26900000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.57399999999999995,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40999999999999998,"15min":0.38600000000000001},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.58799999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.36599999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60999999999999999,"15min":0.56499999999999995},"min":{"1min":0.46500000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81499999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.47299999999999998,"5min":0.38700000000000001,"15min":0.376},"max":{"1min":0.77000000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.501,"5min":0.37,"15min":0.37},"max":{"1min":0.746,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66700000000000004,"15min":0.628},"min":{"1min":0.48999999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85799999999999998,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.745}]},{"osd":6,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.59399999999999997},"min":{"1min":0.47199999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85199999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64300000000000002,"15min":0.59799999999999998},"min":{"1min":0.52900000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.81799999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66000000000000003,"15min":0.624},"min":{"1min":0.51300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.78700000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.64100000000000001,"15min":0.60899999999999999},"min":{"1min":0.48599999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78300000000000003,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.59599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574937,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298436,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073404,"statfs":{"total":96636764160,"available":96331165696,"internally_reserved":0,"allocated":1175552,"data_stored":566596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.314},"min":{"1min":0.25600000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.375},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.35099999999999998},"min":{"1min":0.28599999999999998,"5min":0.26600000000000001,"15min":0.246},"max":{"1min":0.58799999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.26900000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41899999999999998,"15min":0.377},"min":{"1min":0.29299999999999998,"5min":0.26500000000000001,"15min":0.20599999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.373,"15min":0.33400000000000002},"min":{"1min":0.26400000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.53100000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.255}]},{"osd":3,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41299999999999998,"15min":0.38700000000000001},"min":{"1min":0.25800000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.63100000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.41599999999999998},"min":{"1min":0.317,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.84799999999999998,"5min":0.92100000000000004,"15min":1.369},"last":0.746},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.629,"15min":0.56499999999999995},"min":{"1min":0.51500000000000001,"5min":0.42699999999999999,"15min":0.41099999999999998},"max":{"1min":0.83799999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63900000000000001,"15min":0.60899999999999999},"min":{"1min":0.52100000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88400000000000001,"5min":0.98999999999999999,"15min":1.3320000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.65000000000000002,"15min":0.60299999999999998},"min":{"1min":0.47999999999999998,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.80500000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.72999999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65300000000000002,"15min":0.626},"min":{"1min":0.45300000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91700000000000004,"5min":0.95299999999999996,"15min":1.3999999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66400000000000003,"15min":0.60899999999999999},"min":{"1min":0.50800000000000001,"5min":0.46700000000000003,"15min":0.39800000000000002},"max":{"1min":1.0249999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.60799999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64900000000000002,"15min":1.0089999999999999},"min":{"1min":0.47899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":11.138},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68000000000000005,"15min":0.63800000000000001},"min":{"1min":0.503,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.429},"last":0.68500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298432,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073408,"statfs":{"total":96636764160,"available":96331169792,"internally_reserved":0,"allocated":1171456,"data_stored":565123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.374,"15min":0.36899999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.52000000000000002,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40300000000000002,"15min":0.376},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.29799999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42799999999999999,"15min":0.38700000000000001},"min":{"1min":0.247,"5min":0.24299999999999999,"15min":0.23000000000000001},"max":{"1min":0.59599999999999997,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.45300000000000001,"15min":0.40500000000000003},"min":{"1min":0.28799999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.58299999999999996,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.24299999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40699999999999997,"15min":0.377},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55000000000000004,"5min":1.423,"15min":1.423},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45400000000000001,"15min":0.42599999999999999},"min":{"1min":0.33300000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66500000000000004,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.625,"15min":0.58499999999999996},"min":{"1min":0.439,"5min":0.38600000000000001,"15min":0.377},"max":{"1min":0.80300000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.63100000000000001,"15min":0.61799999999999999},"min":{"1min":0.44700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.60899999999999999},"min":{"1min":0.438,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83699999999999997,"5min":1.304,"15min":1.304},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.42299999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.42499999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96099999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.66100000000000003,"15min":0.63300000000000001},"min":{"1min":0.51600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.89200000000000002,"5min":1.347,"15min":1.347},"last":0.501}]},{"osd":7,"last update":"Fri Oct 6 02:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67100000000000004,"15min":0.66200000000000003},"min":{"1min":0.47499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98599999999999999,"5min":1.206,"15min":1.206},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68700000000000006,"15min":0.67300000000000004},"min":{"1min":0.47799999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.87,"5min":1.385,"15min":1.385},"last":0.58499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574937,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298448,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073392,"statfs":{"total":96636764160,"available":96331153408,"internally_reserved":0,"allocated":1187840,"data_stored":567600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.23300000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.54900000000000004,"5min":0.55500000000000005,"15min":0.61299999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.38200000000000001,"15min":0.38800000000000001},"min":{"1min":0.26500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.78100000000000003},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.379,"15min":0.371},"min":{"1min":0.28299999999999997,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58399999999999996,"5min":0.66100000000000003,"15min":0.66700000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.40200000000000002},"min":{"1min":0.29099999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.38800000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.40400000000000003},"min":{"1min":0.26700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.41099999999999998},"min":{"1min":0.34999999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.42499999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.58799999999999997},"min":{"1min":0.438,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.62,"15min":0.59899999999999998},"min":{"1min":0.44400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91400000000000003,"5min":0.96599999999999997,"15min":1.1539999999999999},"last":0.627}]},{"osd":5,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.623,"15min":0.623},"min":{"1min":0.44800000000000001,"5min":0.40400000000000003,"15min":0.36399999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.2110000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.46400000000000002,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":1.0129999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63800000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63100000000000001,"15min":0.59499999999999997},"min":{"1min":0.45300000000000001,"5min":0.42999999999999999,"15min":0.40600000000000003},"max":{"1min":0.879,"5min":0.91100000000000003,"15min":1.0700000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.53300000000000003,"5min":0.442,"15min":0.38600000000000001},"max":{"1min":0.91200000000000003,"5min":0.996,"15min":1.391},"last":0.77100000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.39500000000000002},"max":{"1min":0.97199999999999998,"5min":1.121,"15min":1.121},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65500000000000003,"15min":0.61499999999999999},"min":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.70099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":567702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.54800000000000004},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.217},"max":{"1min":0.68600000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64100000000000001,"15min":0.59699999999999998},"min":{"1min":0.39700000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58999999999999997,"15min":1.0920000000000001},"min":{"1min":0.42899999999999999,"5min":0.38600000000000001,"15min":0.34899999999999998},"max":{"1min":1.77,"5min":1.77,"15min":17.879999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57499999999999996,"15min":1.073},"min":{"1min":0.44,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71199999999999997,"5min":0.84699999999999998,"15min":18.010999999999999},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.53600000000000003},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.59899999999999998,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59299999999999997,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.29899999999999999},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.378},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.56799999999999995},"min":{"1min":0.45700000000000002,"5min":0.373,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54200000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.30499999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.53800000000000003,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.38200000000000001,"5min":0.36799999999999999,"15min":0.36199999999999999},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.44600000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.42299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.72899999999999998,"5min":0.81399999999999995,"15min":0.83999999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58999999999999997,"15min":0.61599999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78700000000000003,"5min":0.82099999999999995,"15min":0.83299999999999996},"last":0.621}]}]},{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298436,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073404,"statfs":{"total":96636764160,"available":96331165696,"internally_reserved":0,"allocated":1175552,"data_stored":566112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69899999999999995,"5min":1.103,"15min":1.103},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.36499999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.73399999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.48699999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61799999999999999,"15min":0.56999999999999995},"min":{"1min":0.45800000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60799999999999998,"15min":0.56100000000000005},"min":{"1min":0.42199999999999999,"5min":0.35899999999999999,"15min":0.33900000000000002},"max":{"1min":0.73999999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56899999999999995,"15min":0.53400000000000003},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.30399999999999999},"max":{"1min":0.68200000000000005,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56399999999999995,"15min":0.52900000000000003},"min":{"1min":0.41399999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69399999999999995,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.55200000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58299999999999996,"15min":0.54900000000000004},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59399999999999997,"15min":0.57499999999999996},"min":{"1min":0.41699999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.70299999999999996,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.41699999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.504},"min":{"1min":0.36299999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.72499999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.49299999999999999,"15min":0.501},"min":{"1min":0.35399999999999998,"5min":0.308,"15min":0.26500000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.75700000000000001},"last":0.379}]},{"osd":6,"last update":"Fri Oct 6 02:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.499,"15min":0.51500000000000001},"min":{"1min":0.373,"5min":0.29299999999999998,"15min":0.28299999999999997},"max":{"1min":0.751,"5min":0.752,"15min":0.752},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53600000000000003,"15min":0.56799999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.54600000000000004},"min":{"1min":0.39400000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.78400000000000003},"last":0.439},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57599999999999996,"15min":0.60099999999999998},"min":{"1min":0.432,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:24:50.019 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:24:50.020 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:24:50.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:24:50.097 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:24:50.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.179+0000 7f60bf08d700 1 Processor -- start 2023-10-06T02:24:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.179+0000 7f60bf08d700 1 -- start start 2023-10-06T02:24:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.180+0000 7f60bf08d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f60b8157c30 0x7f60b8158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.180+0000 7f60bf08d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f60b806e9a0 0x7f60b80c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.180+0000 7f60bf08d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b80cb510 con 0x7f60b80c8f00 2023-10-06T02:24:50.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.180+0000 7f60bf08d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b806f260 con 0x7f60b806e9a0 2023-10-06T02:24:50.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.180+0000 7f60bf08d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b806f540 con 0x7f60b8157c30 2023-10-06T02:24:50.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.180+0000 7f60bd88a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f60b806e9a0 0x7f60b80c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:50.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.180+0000 7f60be88c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f60b80c8f00 0x7f60b80cb9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42188/0 (socket says 172.21.15.6:42188) 2023-10-06T02:24:50.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.180+0000 7f60be88c700 1 -- 172.21.15.6:0/1288542109 learned_addr learned my addr 172.21.15.6:0/1288542109 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:50.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.180+0000 7f60be08b700 1 --2- 172.21.15.6:0/1288542109 >> v2:172.21.15.175:3300/0 conn(0x7f60b8157c30 0x7f60b8158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:50.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.180+0000 7f60bd88a700 1 -- 172.21.15.6:0/1288542109 >> v2:172.21.15.175:3300/0 conn(0x7f60b8157c30 msgr2=0x7f60b8158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:50.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.180+0000 7f60bd88a700 1 --2- 172.21.15.6:0/1288542109 >> v2:172.21.15.175:3300/0 conn(0x7f60b8157c30 0x7f60b8158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.180+0000 7f60bd88a700 1 -- 172.21.15.6:0/1288542109 >> v1:172.21.15.6:6789/0 conn(0x7f60b80c8f00 legacy=0x7f60b80cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.180+0000 7f60bd089700 1 -- 172.21.15.6:0/1288542109 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117345198 0 0) 0x7f60b80cb510 con 0x7f60b80c8f00 2023-10-06T02:24:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.180+0000 7f60bd88a700 1 -- 172.21.15.6:0/1288542109 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b806f820 con 0x7f60b806e9a0 2023-10-06T02:24:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.180+0000 7f60be08b700 1 --2- 172.21.15.6:0/1288542109 >> v2:172.21.15.175:3300/0 conn(0x7f60b8157c30 0x7f60b8158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.181+0000 7f60bd88a700 1 --2- 172.21.15.6:0/1288542109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b806e9a0 0x7f60b80c89c0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f60b806bc90 tx=0x7f60ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29dd368c4d049b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.181+0000 7f60bd089700 1 -- 172.21.15.6:0/1288542109 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00b6b0 con 0x7f60b806e9a0 2023-10-06T02:24:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.181+0000 7f60bd089700 1 -- 172.21.15.6:0/1288542109 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac00b810 con 0x7f60b806e9a0 2023-10-06T02:24:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.181+0000 7f60bd089700 1 -- 172.21.15.6:0/1288542109 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00bbb0 con 0x7f60b806e9a0 2023-10-06T02:24:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.181+0000 7f60bf08d700 1 -- 172.21.15.6:0/1288542109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b806e9a0 msgr2=0x7f60b80c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.181+0000 7f60bf08d700 1 --2- 172.21.15.6:0/1288542109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b806e9a0 0x7f60b80c89c0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f60b806bc90 tx=0x7f60ac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.181+0000 7f60bf08d700 1 -- 172.21.15.6:0/1288542109 shutdown_connections 2023-10-06T02:24:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.181+0000 7f60bf08d700 1 --2- 172.21.15.6:0/1288542109 >> v2:172.21.15.175:3300/0 conn(0x7f60b8157c30 0x7f60b8158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.181+0000 7f60bf08d700 1 --2- 172.21.15.6:0/1288542109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b806e9a0 0x7f60b80c89c0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.181+0000 7f60bf08d700 1 -- 172.21.15.6:0/1288542109 >> 172.21.15.6:0/1288542109 conn(0x7f60b806c2b0 msgr2=0x7f60b806c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:50.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.181+0000 7f60bf08d700 1 -- 172.21.15.6:0/1288542109 shutdown_connections 2023-10-06T02:24:50.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.181+0000 7f60bf08d700 1 -- 172.21.15.6:0/1288542109 wait complete. 2023-10-06T02:24:50.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.182+0000 7f60bf08d700 1 Processor -- start 2023-10-06T02:24:50.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.183+0000 7f60bf08d700 1 -- start start 2023-10-06T02:24:50.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.183+0000 7f60bf08d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b806e9a0 0x7f60b8154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:50.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.183+0000 7f60bf08d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60b80c8f00 0x7f60b81546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:50.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.183+0000 7f60bf08d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b8157c30 0x7f60b816d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:50.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.183+0000 7f60bf08d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b80af630 con 0x7f60b8157c30 2023-10-06T02:24:50.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.183+0000 7f60bf08d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b80af910 con 0x7f60b80c8f00 2023-10-06T02:24:50.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.183+0000 7f60bf08d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b80afbf0 con 0x7f60b806e9a0 2023-10-06T02:24:50.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.183+0000 7f60be88c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b8157c30 0x7f60b816d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:50.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.183+0000 7f60be88c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b8157c30 0x7f60b816d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58494/0 (socket says 172.21.15.6:58494) 2023-10-06T02:24:50.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.183+0000 7f60be88c700 1 -- 172.21.15.6:0/1357992907 learned_addr learned my addr 172.21.15.6:0/1357992907 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:50.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.184+0000 7f60bd88a700 1 --2- 172.21.15.6:0/1357992907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60b80c8f00 0x7f60b81546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:50.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.184+0000 7f60be08b700 1 --2- 172.21.15.6:0/1357992907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b806e9a0 0x7f60b8154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:50.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.184+0000 7f60be88c700 1 -- 172.21.15.6:0/1357992907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b806e9a0 msgr2=0x7f60b8154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.184+0000 7f60be88c700 1 --2- 172.21.15.6:0/1357992907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b806e9a0 0x7f60b8154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.184+0000 7f60be88c700 1 -- 172.21.15.6:0/1357992907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60b80c8f00 msgr2=0x7f60b81546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.184+0000 7f60be88c700 1 --2- 172.21.15.6:0/1357992907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60b80c8f00 0x7f60b81546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.184+0000 7f60be88c700 1 -- 172.21.15.6:0/1357992907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac009420 con 0x7f60b8157c30 2023-10-06T02:24:50.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.184+0000 7f60be08b700 1 --2- 172.21.15.6:0/1357992907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b806e9a0 0x7f60b8154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:50.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.184+0000 7f60be88c700 1 --2- 172.21.15.6:0/1357992907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b8157c30 0x7f60b816d2d0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f60a800cc90 tx=0x7f60a8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:50.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.184+0000 7f60b67fc700 1 -- 172.21.15.6:0/1357992907 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a800cea0 con 0x7f60b8157c30 2023-10-06T02:24:50.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.184+0000 7f60b67fc700 1 -- 172.21.15.6:0/1357992907 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a800ab70 con 0x7f60b8157c30 2023-10-06T02:24:50.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.184+0000 7f60bf08d700 1 -- 172.21.15.6:0/1357992907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b80afed0 con 0x7f60b8157c30 2023-10-06T02:24:50.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.184+0000 7f60b67fc700 1 -- 172.21.15.6:0/1357992907 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a80070f0 con 0x7f60b8157c30 2023-10-06T02:24:50.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.184+0000 7f60bf08d700 1 -- 172.21.15.6:0/1357992907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b816da50 con 0x7f60b8157c30 2023-10-06T02:24:50.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.185+0000 7f60bf08d700 1 -- 172.21.15.6:0/1357992907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b80af770 con 0x7f60b8157c30 2023-10-06T02:24:50.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.185+0000 7f60b67fc700 1 -- 172.21.15.6:0/1357992907 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60a80074a0 con 0x7f60b8157c30 2023-10-06T02:24:50.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.186+0000 7f60b67fc700 1 --2- 172.21.15.6:0/1357992907 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60a4066f30 0x7f60a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:50.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.186+0000 7f60b67fc700 1 -- 172.21.15.6:0/1357992907 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f60a8084c50 con 0x7f60b8157c30 2023-10-06T02:24:50.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.186+0000 7f60be08b700 1 --2- 172.21.15.6:0/1357992907 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60a4066f30 0x7f60a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:50.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.186+0000 7f60be08b700 1 --2- 172.21.15.6:0/1357992907 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60a4066f30 0x7f60a40693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f60b0008b20 tx=0x7f60b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:50.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.190+0000 7f60b67fc700 1 -- 172.21.15.6:0/1357992907 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60b80af770 con 0x7f60b8157c30 2023-10-06T02:24:50.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.469+0000 7f60bf08d700 1 -- 172.21.15.6:0/1357992907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f60b80af770 con 0x7f60b8157c30 2023-10-06T02:24:50.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.472+0000 7f60b67fc700 1 -- 172.21.15.6:0/1357992907 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f60b80af770 con 0x7f60b8157c30 2023-10-06T02:24:50.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.474+0000 7f60bf08d700 1 -- 172.21.15.6:0/1357992907 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60a4066f30 msgr2=0x7f60a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.474+0000 7f60bf08d700 1 --2- 172.21.15.6:0/1357992907 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60a4066f30 0x7f60a40693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f60b0008b20 tx=0x7f60b0008040 comp rx=0 tx=0).stop 2023-10-06T02:24:50.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.474+0000 7f60bf08d700 1 -- 172.21.15.6:0/1357992907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b8157c30 msgr2=0x7f60b816d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.474+0000 7f60bf08d700 1 --2- 172.21.15.6:0/1357992907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b8157c30 0x7f60b816d2d0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f60a800cc90 tx=0x7f60a8001a80 comp rx=0 tx=0).stop 2023-10-06T02:24:50.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.474+0000 7f60bf08d700 1 -- 172.21.15.6:0/1357992907 shutdown_connections 2023-10-06T02:24:50.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.474+0000 7f60bf08d700 1 --2- 172.21.15.6:0/1357992907 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60a4066f30 0x7f60a40693e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.474+0000 7f60bf08d700 1 --2- 172.21.15.6:0/1357992907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b8157c30 0x7f60b816d2d0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.474+0000 7f60bf08d700 1 --2- 172.21.15.6:0/1357992907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b806e9a0 0x7f60b8154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.474+0000 7f60bf08d700 1 --2- 172.21.15.6:0/1357992907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60b80c8f00 0x7f60b81546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.474+0000 7f60bf08d700 1 -- 172.21.15.6:0/1357992907 >> 172.21.15.6:0/1357992907 conn(0x7f60b806c2b0 msgr2=0x7f60b815abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:50.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.474+0000 7f60bf08d700 1 -- 172.21.15.6:0/1357992907 shutdown_connections 2023-10-06T02:24:50.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.474+0000 7f60bf08d700 1 -- 172.21.15.6:0/1357992907 wait complete. 2023-10-06T02:24:50.478 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-10-06T02:24:50.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:50.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.645+0000 7f262f829700 1 Processor -- start 2023-10-06T02:24:50.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.646+0000 7f262f829700 1 -- start start 2023-10-06T02:24:50.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.646+0000 7f262f829700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26280af8b0 0x7f262815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:50.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.647+0000 7f262f829700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26280b27f0 0x7f262815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.647+0000 7f262f829700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262815e190 con 0x7f26280af4e0 2023-10-06T02:24:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.647+0000 7f262f829700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26280b1910 con 0x7f26280b27f0 2023-10-06T02:24:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.647+0000 7f262f829700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26280cb650 con 0x7f26280af8b0 2023-10-06T02:24:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.647+0000 7f262ddc6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26280b27f0 0x7f262815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.647+0000 7f262ddc6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26280b27f0 0x7f262815d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58510/0 (socket says 172.21.15.6:58510) 2023-10-06T02:24:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.647+0000 7f262ddc6700 1 -- 172.21.15.6:0/1073599434 learned_addr learned my addr 172.21.15.6:0/1073599434 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.647+0000 7f262cdc4700 1 --2- 172.21.15.6:0/1073599434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26280af8b0 0x7f262815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.647+0000 7f262ddc6700 1 -- 172.21.15.6:0/1073599434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26280af8b0 msgr2=0x7f262815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.647+0000 7f262ddc6700 1 --2- 172.21.15.6:0/1073599434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26280af8b0 0x7f262815d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.647+0000 7f262ddc6700 1 -- 172.21.15.6:0/1073599434 >> v1:172.21.15.175:6789/0 conn(0x7f26280af4e0 legacy=0x7f26280b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.647+0000 7f262ddc6700 1 -- 172.21.15.6:0/1073599434 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26280ccaf0 con 0x7f26280b27f0 2023-10-06T02:24:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.647+0000 7f262ddc6700 1 --2- 172.21.15.6:0/1073599434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26280b27f0 0x7f262815d9a0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f2618009f20 tx=0x7f2618009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83eec8f5d3de0a56 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.647+0000 7f2627fff700 1 -- 172.21.15.6:0/1073599434 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261800e070 con 0x7f26280b27f0 2023-10-06T02:24:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.647+0000 7f2627fff700 1 -- 172.21.15.6:0/1073599434 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261800b9d0 con 0x7f26280b27f0 2023-10-06T02:24:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.647+0000 7f2627fff700 1 -- 172.21.15.6:0/1073599434 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26180092e0 con 0x7f26280b27f0 2023-10-06T02:24:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.648+0000 7f262f829700 1 -- 172.21.15.6:0/1073599434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26280b27f0 msgr2=0x7f262815d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.648+0000 7f262f829700 1 --2- 172.21.15.6:0/1073599434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26280b27f0 0x7f262815d9a0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f2618009f20 tx=0x7f2618009840 comp rx=0 tx=0).stop 2023-10-06T02:24:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.648+0000 7f262f829700 1 -- 172.21.15.6:0/1073599434 shutdown_connections 2023-10-06T02:24:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.648+0000 7f262f829700 1 --2- 172.21.15.6:0/1073599434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26280b27f0 0x7f262815d9a0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.648+0000 7f262f829700 1 --2- 172.21.15.6:0/1073599434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26280af8b0 0x7f262815d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.648+0000 7f262f829700 1 -- 172.21.15.6:0/1073599434 >> 172.21.15.6:0/1073599434 conn(0x7f2628068680 msgr2=0x7f2628068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.648+0000 7f262f829700 1 -- 172.21.15.6:0/1073599434 shutdown_connections 2023-10-06T02:24:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.648+0000 7f262f829700 1 -- 172.21.15.6:0/1073599434 wait complete. 2023-10-06T02:24:50.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.649+0000 7f262f829700 1 Processor -- start 2023-10-06T02:24:50.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.649+0000 7f262f829700 1 -- start start 2023-10-06T02:24:50.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.650+0000 7f262f829700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26280af4e0 0x7f26280c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:50.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.650+0000 7f262f829700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26280af8b0 0x7f26280d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:50.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.650+0000 7f262f829700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26280b27f0 0x7f26280ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.650+0000 7f262f829700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280cfe30 con 0x7f26280af8b0 2023-10-06T02:24:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.650+0000 7f262f829700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280d06d0 con 0x7f26280b27f0 2023-10-06T02:24:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.650+0000 7f262f829700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26280cf810 con 0x7f26280af4e0 2023-10-06T02:24:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.650+0000 7f262cdc4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26280af8b0 0x7f26280d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.650+0000 7f262cdc4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26280af8b0 0x7f26280d0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58512/0 (socket says 172.21.15.6:58512) 2023-10-06T02:24:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.650+0000 7f262cdc4700 1 -- 172.21.15.6:0/3703903922 learned_addr learned my addr 172.21.15.6:0/3703903922 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.650+0000 7f262ddc6700 1 --2- 172.21.15.6:0/3703903922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26280b27f0 0x7f26280ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.650+0000 7f262cdc4700 1 -- 172.21.15.6:0/3703903922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26280af4e0 msgr2=0x7f26280c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.650+0000 7f262d5c5700 1 --2- 172.21.15.6:0/3703903922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26280af4e0 0x7f26280c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.651+0000 7f262cdc4700 1 --2- 172.21.15.6:0/3703903922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26280af4e0 0x7f26280c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.651+0000 7f262cdc4700 1 -- 172.21.15.6:0/3703903922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26280b27f0 msgr2=0x7f26280ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.651+0000 7f262cdc4700 1 --2- 172.21.15.6:0/3703903922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26280b27f0 0x7f26280ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.651+0000 7f262cdc4700 1 -- 172.21.15.6:0/3703903922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2618009ae0 con 0x7f26280af8b0 2023-10-06T02:24:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.651+0000 7f262ddc6700 1 --2- 172.21.15.6:0/3703903922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26280b27f0 0x7f26280ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.651+0000 7f262d5c5700 1 --2- 172.21.15.6:0/3703903922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26280af4e0 0x7f26280c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.651+0000 7f262cdc4700 1 --2- 172.21.15.6:0/3703903922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26280af8b0 0x7f26280d0b60 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f261c00ec80 tx=0x7f261c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.651+0000 7f26257fa700 1 -- 172.21.15.6:0/3703903922 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c00c9d0 con 0x7f26280af8b0 2023-10-06T02:24:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.651+0000 7f26257fa700 1 -- 172.21.15.6:0/3703903922 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c00cb30 con 0x7f26280af8b0 2023-10-06T02:24:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.651+0000 7f262f829700 1 -- 172.21.15.6:0/3703903922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26280d0080 con 0x7f26280af8b0 2023-10-06T02:24:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.651+0000 7f26257fa700 1 -- 172.21.15.6:0/3703903922 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c013470 con 0x7f26280af8b0 2023-10-06T02:24:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.651+0000 7f262f829700 1 -- 172.21.15.6:0/3703903922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26280d10a0 con 0x7f26280af8b0 2023-10-06T02:24:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.652+0000 7f262f829700 1 -- 172.21.15.6:0/3703903922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26280d0840 con 0x7f26280af8b0 2023-10-06T02:24:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.652+0000 7f26257fa700 1 -- 172.21.15.6:0/3703903922 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f261c013820 con 0x7f26280af8b0 2023-10-06T02:24:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.653+0000 7f26257fa700 1 --2- 172.21.15.6:0/3703903922 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2614066f30 0x7f26140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.653+0000 7f26257fa700 1 -- 172.21.15.6:0/3703903922 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f261c084b60 con 0x7f26280af8b0 2023-10-06T02:24:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.653+0000 7f262d5c5700 1 --2- 172.21.15.6:0/3703903922 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2614066f30 0x7f26140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.653+0000 7f262d5c5700 1 --2- 172.21.15.6:0/3703903922 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2614066f30 0x7f26140693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2620001840 tx=0x7f2620009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:50.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.657+0000 7f26257fa700 1 -- 172.21.15.6:0/3703903922 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f261c051b30 con 0x7f26280af8b0 2023-10-06T02:24:50.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.897+0000 7f262f829700 1 -- 172.21.15.6:0/3703903922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26280b0910 con 0x7f26280af8b0 2023-10-06T02:24:50.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.897+0000 7f26257fa700 1 -- 172.21.15.6:0/3703903922 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f261c055150 con 0x7f26280af8b0 2023-10-06T02:24:50.899 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:50.899 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:24:43.983823+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7242":{"gid":7242,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":5,"addr":"172.21.15.6:6835/2846199049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2846199049},{"type":"v1","addr":"172.21.15.6:6835","nonce":2846199049}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:24:50.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.899+0000 7f262f829700 1 -- 172.21.15.6:0/3703903922 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2614066f30 msgr2=0x7f26140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.899+0000 7f262f829700 1 --2- 172.21.15.6:0/3703903922 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2614066f30 0x7f26140693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2620001840 tx=0x7f2620009040 comp rx=0 tx=0).stop 2023-10-06T02:24:50.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.899+0000 7f262f829700 1 -- 172.21.15.6:0/3703903922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26280af8b0 msgr2=0x7f26280d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.899+0000 7f262f829700 1 --2- 172.21.15.6:0/3703903922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26280af8b0 0x7f26280d0b60 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f261c00ec80 tx=0x7f261c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.899+0000 7f262f829700 1 -- 172.21.15.6:0/3703903922 shutdown_connections 2023-10-06T02:24:50.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.899+0000 7f262f829700 1 --2- 172.21.15.6:0/3703903922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26280b27f0 0x7f26280ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.899+0000 7f262f829700 1 --2- 172.21.15.6:0/3703903922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26280af4e0 0x7f26280c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.899+0000 7f262f829700 1 --2- 172.21.15.6:0/3703903922 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2614066f30 0x7f26140693e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.899+0000 7f262f829700 1 --2- 172.21.15.6:0/3703903922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26280af8b0 0x7f26280d0b60 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.899+0000 7f262f829700 1 -- 172.21.15.6:0/3703903922 >> 172.21.15.6:0/3703903922 conn(0x7f2628068680 msgr2=0x7f26280afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:50.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.899+0000 7f262f829700 1 -- 172.21.15.6:0/3703903922 shutdown_connections 2023-10-06T02:24:50.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:50.899+0000 7f262f829700 1 -- 172.21.15.6:0/3703903922 wait complete. 2023-10-06T02:24:50.903 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 86 2023-10-06T02:24:51.315 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:24:43.983823+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7242}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7242': {'gid': 7242, 'name': 'a', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.6:6835/2846199049', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 2846199049}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 2846199049}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:24:51.315 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:24:51.315 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:24:51.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.436+0000 7f595cb6c700 1 Processor -- start 2023-10-06T02:24:51.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.436+0000 7f595cb6c700 1 -- start start 2023-10-06T02:24:51.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.437+0000 7f595cb6c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595815a030 0x7f595815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.437+0000 7f595cb6c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59580afc50 con 0x7f5958087700 2023-10-06T02:24:51.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.437+0000 7f595cb6c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59580aff30 con 0x7f595815a940 2023-10-06T02:24:51.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.437+0000 7f595cb6c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59580b0cf0 con 0x7f595815a030 2023-10-06T02:24:51.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.437+0000 7f5956d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5958087700 0x7f59580b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42192/0 (socket says 172.21.15.6:42192) 2023-10-06T02:24:51.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.437+0000 7f5956d9d700 1 -- 172.21.15.6:0/2614490906 learned_addr learned my addr 172.21.15.6:0/2614490906 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f595659c700 1 --2- 172.21.15.6:0/2614490906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595815a030 0x7f595815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f595559a700 1 -- 172.21.15.6:0/2614490906 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122777783 0 0) 0x7f59580afc50 con 0x7f5958087700 2023-10-06T02:24:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f595559a700 1 -- 172.21.15.6:0/2614490906 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5944003570 con 0x7f5958087700 2023-10-06T02:24:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f595559a700 1 -- 172.21.15.6:0/2614490906 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1787625688 0 0) 0x7f5944003570 con 0x7f5958087700 2023-10-06T02:24:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f595559a700 1 -- 172.21.15.6:0/2614490906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595815a030 msgr2=0x7f595815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f595559a700 1 --2- 172.21.15.6:0/2614490906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595815a030 0x7f595815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f595559a700 1 -- 172.21.15.6:0/2614490906 >> v1:172.21.15.175:6789/0 conn(0x7f595815a940 legacy=0x7f5958086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f595559a700 1 -- 172.21.15.6:0/2614490906 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59580b0210 con 0x7f5958087700 2023-10-06T02:24:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f595559a700 1 -- 172.21.15.6:0/2614490906 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f59480017f0 con 0x7f5958087700 2023-10-06T02:24:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f595559a700 1 -- 172.21.15.6:0/2614490906 >> v1:172.21.15.6:6789/0 conn(0x7f5958087700 legacy=0x7f59580b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f595559a700 1 --2- 172.21.15.6:0/2614490906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595815a030 0x7f5944003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f595559a700 1 --2- 172.21.15.6:0/2614490906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5944004010 0x7f5944004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f595559a700 1 --2- 172.21.15.6:0/2614490906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5944004d50 0x7f59440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f595559a700 1 -- 172.21.15.6:0/2614490906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59580b0cf0 con 0x7f5944004d50 2023-10-06T02:24:51.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f595559a700 1 -- 172.21.15.6:0/2614490906 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594400bbf0 con 0x7f5944004010 2023-10-06T02:24:51.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f595559a700 1 -- 172.21.15.6:0/2614490906 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594400bdb0 con 0x7f595815a030 2023-10-06T02:24:51.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f5956d9d700 1 --2- 172.21.15.6:0/2614490906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5944004d50 0x7f59440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f595659c700 1 --2- 172.21.15.6:0/2614490906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595815a030 0x7f5944003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f5955d9b700 1 --2- 172.21.15.6:0/2614490906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5944004010 0x7f5944004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f5956d9d700 1 -- 172.21.15.6:0/2614490906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595815a030 msgr2=0x7f5944003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f5956d9d700 1 --2- 172.21.15.6:0/2614490906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595815a030 0x7f5944003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f5956d9d700 1 -- 172.21.15.6:0/2614490906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5944004010 msgr2=0x7f5944004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f5956d9d700 1 --2- 172.21.15.6:0/2614490906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5944004010 0x7f5944004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f5956d9d700 1 -- 172.21.15.6:0/2614490906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5944003570 con 0x7f5944004d50 2023-10-06T02:24:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.438+0000 7f5955d9b700 1 --2- 172.21.15.6:0/2614490906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5944004010 0x7f5944004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.439+0000 7f5956d9d700 1 --2- 172.21.15.6:0/2614490906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5944004d50 0x7f59440051c0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f594800a900 tx=0x7f59480021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae46a2b485e7481 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.439+0000 7f595559a700 1 -- 172.21.15.6:0/2614490906 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59480070d0 con 0x7f5944004d50 2023-10-06T02:24:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.439+0000 7f595559a700 1 -- 172.21.15.6:0/2614490906 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5948007230 con 0x7f5944004d50 2023-10-06T02:24:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.439+0000 7f595559a700 1 -- 172.21.15.6:0/2614490906 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59480075f0 con 0x7f5944004d50 2023-10-06T02:24:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.439+0000 7f595cb6c700 1 -- 172.21.15.6:0/2614490906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5944004d50 msgr2=0x7f59440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.439+0000 7f595cb6c700 1 --2- 172.21.15.6:0/2614490906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5944004d50 0x7f59440051c0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f594800a900 tx=0x7f59480021d0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.439+0000 7f5956d9d700 1 -- 172.21.15.6:0/2614490906 reap_dead start 2023-10-06T02:24:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.439+0000 7f595cb6c700 1 -- 172.21.15.6:0/2614490906 shutdown_connections 2023-10-06T02:24:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.439+0000 7f595cb6c700 1 -- 172.21.15.6:0/2614490906 >> 172.21.15.6:0/2614490906 conn(0x7f5958068680 msgr2=0x7f5958068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.439+0000 7f595cb6c700 1 -- 172.21.15.6:0/2614490906 shutdown_connections 2023-10-06T02:24:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.439+0000 7f595cb6c700 1 -- 172.21.15.6:0/2614490906 wait complete. 2023-10-06T02:24:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.440+0000 7f595cb6c700 1 Processor -- start 2023-10-06T02:24:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.440+0000 7f595cb6c700 1 -- start start 2023-10-06T02:24:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.441+0000 7f595cb6c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5944004d50 0x7f595815dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.441+0000 7f595cb6c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f595815b050 0x7f595815b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.441+0000 7f595cb6c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59580b4fc0 0x7f59580b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.441+0000 7f595cb6c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59580ca660 con 0x7f5944004d50 2023-10-06T02:24:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.441+0000 7f595cb6c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59580b4200 con 0x7f595815b050 2023-10-06T02:24:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.441+0000 7f595cb6c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59580b44e0 con 0x7f59580b4fc0 2023-10-06T02:24:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.441+0000 7f595659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5944004d50 0x7f595815dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.441+0000 7f595659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5944004d50 0x7f595815dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58530/0 (socket says 172.21.15.6:58530) 2023-10-06T02:24:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.441+0000 7f595659c700 1 -- 172.21.15.6:0/771530221 learned_addr learned my addr 172.21.15.6:0/771530221 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.441+0000 7f5956d9d700 1 --2- 172.21.15.6:0/771530221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59580b4fc0 0x7f59580b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.441+0000 7f5955d9b700 1 --2- 172.21.15.6:0/771530221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f595815b050 0x7f595815b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.442+0000 7f595659c700 1 -- 172.21.15.6:0/771530221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59580b4fc0 msgr2=0x7f59580b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.442+0000 7f595659c700 1 --2- 172.21.15.6:0/771530221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59580b4fc0 0x7f59580b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.442+0000 7f595659c700 1 -- 172.21.15.6:0/771530221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f595815b050 msgr2=0x7f595815b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.442+0000 7f595659c700 1 --2- 172.21.15.6:0/771530221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f595815b050 0x7f595815b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.442+0000 7f595659c700 1 -- 172.21.15.6:0/771530221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59580b47c0 con 0x7f5944004d50 2023-10-06T02:24:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.442+0000 7f5955d9b700 1 --2- 172.21.15.6:0/771530221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f595815b050 0x7f595815b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.442+0000 7f595659c700 1 --2- 172.21.15.6:0/771530221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5944004d50 0x7f595815dbc0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f5950006ac0 tx=0x7f59500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.442+0000 7f594e7fc700 1 -- 172.21.15.6:0/771530221 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595000f940 con 0x7f5944004d50 2023-10-06T02:24:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.442+0000 7f594e7fc700 1 -- 172.21.15.6:0/771530221 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595000faa0 con 0x7f5944004d50 2023-10-06T02:24:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.442+0000 7f595cb6c700 1 -- 172.21.15.6:0/771530221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59580b4aa0 con 0x7f5944004d50 2023-10-06T02:24:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.442+0000 7f594e7fc700 1 -- 172.21.15.6:0/771530221 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595000fe20 con 0x7f5944004d50 2023-10-06T02:24:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.442+0000 7f595cb6c700 1 -- 172.21.15.6:0/771530221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595815b4c0 con 0x7f5944004d50 2023-10-06T02:24:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.443+0000 7f594e7fc700 1 -- 172.21.15.6:0/771530221 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5950014650 con 0x7f5944004d50 2023-10-06T02:24:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.444+0000 7f594e7fc700 1 --2- 172.21.15.6:0/771530221 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5938066f30 0x7f59380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.444+0000 7f594e7fc700 1 -- 172.21.15.6:0/771530221 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5950018030 con 0x7f5944004d50 2023-10-06T02:24:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.444+0000 7f5955d9b700 1 --2- 172.21.15.6:0/771530221 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5938066f30 0x7f59380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.445+0000 7f5955d9b700 1 --2- 172.21.15.6:0/771530221 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5938066f30 0x7f59380693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f59580cb820 tx=0x7f5940009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.446+0000 7f5965e64b80 1 Processor -- start 2023-10-06T02:24:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.446+0000 7f5965e64b80 1 -- start start 2023-10-06T02:24:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f5965e64b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447e840 0x55e0d447ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f5965e64b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d447fcc0 0x55e0d44ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f5965e64b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f5965e64b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d43d5a70 con 0x55e0d44cec00 2023-10-06T02:24:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f5965e64b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d43d3270 con 0x55e0d447fcc0 2023-10-06T02:24:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f5965e64b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0d43cf060 con 0x55e0d447e840 2023-10-06T02:24:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f5956d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f5956d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58546/0 (socket says 172.21.15.6:58546) 2023-10-06T02:24:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f5956d9d700 1 -- 172.21.15.6:0/1389321186 learned_addr learned my addr 172.21.15.6:0/1389321186 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f5955d9b700 1 --2- 172.21.15.6:0/1389321186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d447fcc0 0x55e0d44ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f595659c700 1 --2- 172.21.15.6:0/1389321186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447e840 0x55e0d447ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f5956d9d700 1 -- 172.21.15.6:0/1389321186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447e840 msgr2=0x55e0d447ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f5956d9d700 1 --2- 172.21.15.6:0/1389321186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447e840 0x55e0d447ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f5956d9d700 1 -- 172.21.15.6:0/1389321186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d447fcc0 msgr2=0x55e0d44ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f5956d9d700 1 --2- 172.21.15.6:0/1389321186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d447fcc0 0x55e0d44ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f5956d9d700 1 -- 172.21.15.6:0/1389321186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0d4269270 con 0x55e0d44cec00 2023-10-06T02:24:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f5956d9d700 1 --2- 172.21.15.6:0/1389321186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44cf050 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f59440057d0 tx=0x7f5948016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96bc0b4fcc5c2d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f59377fe700 1 -- 172.21.15.6:0/1389321186 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948001ef0 con 0x55e0d44cec00 2023-10-06T02:24:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f59377fe700 1 -- 172.21.15.6:0/1389321186 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594800a1e0 con 0x55e0d44cec00 2023-10-06T02:24:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.447+0000 7f59377fe700 1 -- 172.21.15.6:0/1389321186 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948001a90 con 0x55e0d44cec00 2023-10-06T02:24:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.448+0000 7f5965e64b80 1 -- 172.21.15.6:0/1389321186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 msgr2=0x55e0d44cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.448+0000 7f5965e64b80 1 --2- 172.21.15.6:0/1389321186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44cf050 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f59440057d0 tx=0x7f5948016000 comp rx=0 tx=0).stop 2023-10-06T02:24:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.448+0000 7f5965e64b80 1 -- 172.21.15.6:0/1389321186 shutdown_connections 2023-10-06T02:24:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.448+0000 7f5965e64b80 1 --2- 172.21.15.6:0/1389321186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44cf050 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.448+0000 7f5965e64b80 1 --2- 172.21.15.6:0/1389321186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447e840 0x55e0d447ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.448+0000 7f5965e64b80 1 --2- 172.21.15.6:0/1389321186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d447fcc0 0x55e0d44ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.448+0000 7f5965e64b80 1 -- 172.21.15.6:0/1389321186 >> 172.21.15.6:0/1389321186 conn(0x55e0d4480160 msgr2=0x55e0d4480530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.448+0000 7f5965e64b80 1 -- 172.21.15.6:0/1389321186 shutdown_connections 2023-10-06T02:24:51.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.448+0000 7f5965e64b80 1 -- 172.21.15.6:0/1389321186 wait complete. 2023-10-06T02:24:51.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.449+0000 7f5965e64b80 1 -- start start 2023-10-06T02:24:51.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.449+0000 7f5965e64b80 1 Processor -- start 2023-10-06T02:24:51.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5965e64b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447e840 0x55e0d44be520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5965e64b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d447fcc0 0x55e0d44bea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5965e64b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44c08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5965e64b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d437a890 con 0x55e0d44cec00 2023-10-06T02:24:51.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5965e64b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d4395ea0 con 0x55e0d447fcc0 2023-10-06T02:24:51.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5965e64b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0d4251e30 con 0x55e0d447e840 2023-10-06T02:24:51.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5965e64b80 10 client.0 _ll_register_callbacks cb 0x55e0d4441e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:24:51.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5956d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44c08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5956d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44c08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58558/0 (socket says 172.21.15.6:58558) 2023-10-06T02:24:51.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5956d9d700 1 -- 172.21.15.6:0/2245915404 learned_addr learned my addr 172.21.15.6:0/2245915404 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:51.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f595659c700 1 --2- 172.21.15.6:0/2245915404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447e840 0x55e0d44be520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5955d9b700 1 --2- 172.21.15.6:0/2245915404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d447fcc0 0x55e0d44bea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5956d9d700 1 -- 172.21.15.6:0/2245915404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447e840 msgr2=0x55e0d44be520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5956d9d700 1 --2- 172.21.15.6:0/2245915404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447e840 0x55e0d44be520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5956d9d700 1 -- 172.21.15.6:0/2245915404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d447fcc0 msgr2=0x55e0d44bea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5956d9d700 1 --2- 172.21.15.6:0/2245915404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d447fcc0 0x55e0d44bea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5956d9d700 1 -- 172.21.15.6:0/2245915404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5944003570 con 0x55e0d44cec00 2023-10-06T02:24:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5955d9b700 1 --2- 172.21.15.6:0/2245915404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d447fcc0 0x55e0d44bea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5956d9d700 1 --2- 172.21.15.6:0/2245915404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44c08f0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f594800aef0 tx=0x7f5948021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea442c1e1a4bdd1b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.450+0000 7f5934ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:24:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.451+0000 7f5934ff9700 1 -- 172.21.15.6:0/2245915404 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948001a00 con 0x55e0d44cec00 2023-10-06T02:24:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.451+0000 7f5934ff9700 1 -- 172.21.15.6:0/2245915404 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5948028470 con 0x55e0d44cec00 2023-10-06T02:24:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.451+0000 7f5965e64b80 1 -- 172.21.15.6:0/2245915404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0d4473940 con 0x55e0d44cec00 2023-10-06T02:24:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.451+0000 7f5934ff9700 1 -- 172.21.15.6:0/2245915404 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5948001b60 con 0x55e0d44cec00 2023-10-06T02:24:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.451+0000 7f5965e64b80 10 client.7419 fetch_fsmap learned FSMap version 86 2023-10-06T02:24:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.451+0000 7f5965e64b80 1 -- 172.21.15.6:0/2245915404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x55e0d420bfe0 con 0x55e0d44cec00 2023-10-06T02:24:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.451+0000 7f5934ff9700 1 -- 172.21.15.6:0/2245915404 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0d4473940 con 0x55e0d44cec00 2023-10-06T02:24:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.451+0000 7f5934ff9700 1 -- 172.21.15.6:0/2245915404 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 86) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f594802f070 con 0x55e0d44cec00 2023-10-06T02:24:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.451+0000 7f5965e64b80 10 client.7419 fetch_fsmap finished waiting for FSMap version 86 2023-10-06T02:24:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.451+0000 7f5965e64b80 10 client.7419 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:24:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.451+0000 7f5965e64b80 20 client.7419 populate_metadata read hostname 'smithi006' 2023-10-06T02:24:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.451+0000 7f5965e64b80 1 --2- 172.21.15.6:0/2245915404 >> [v2:172.21.15.6:6833/2846199049,v1:172.21.15.6:6835/2846199049] conn(0x55e0d44a97e0 0x55e0d44c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.451+0000 7f5965e64b80 4 client.7419 mds_command: new command op to 7242 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:24:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.451+0000 7f5965e64b80 1 -- 172.21.15.6:0/2245915404 --> [v2:172.21.15.6:6833/2846199049,v1:172.21.15.6:6835/2846199049] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0d4450870 con 0x55e0d44a97e0 2023-10-06T02:24:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.451+0000 7f595659c700 1 --2- 172.21.15.6:0/2245915404 >> [v2:172.21.15.6:6833/2846199049,v1:172.21.15.6:6835/2846199049] conn(0x55e0d44a97e0 0x55e0d44c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.452+0000 7f5934ff9700 10 client.7419 ms_handle_connect on v2:172.21.15.6:6833/2846199049 2023-10-06T02:24:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.452+0000 7f595659c700 1 --2- 172.21.15.6:0/2245915404 >> [v2:172.21.15.6:6833/2846199049,v1:172.21.15.6:6835/2846199049] conn(0x55e0d44a97e0 0x55e0d44c1320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfdb5b61752ec4cb server_cookie=218692ef8e17ad6b in_seq=0 out_seq=0 2023-10-06T02:24:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.452+0000 7f5934ff9700 1 -- 172.21.15.6:0/2245915404 <== mds.0 v2:172.21.15.6:6833/2846199049 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e0d4450870 con 0x55e0d44a97e0 2023-10-06T02:24:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.452+0000 7f5934ff9700 10 client.7419 handle_command_reply: tid=0 2023-10-06T02:24:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.452+0000 7f5965e64b80 1 client.7419 shutdown 2023-10-06T02:24:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.452+0000 7f5965e64b80 1 -- 172.21.15.6:0/2245915404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 msgr2=0x55e0d44c08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.452+0000 7f5965e64b80 1 --2- 172.21.15.6:0/2245915404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44c08f0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f594800aef0 tx=0x7f5948021070 comp rx=0 tx=0).stop 2023-10-06T02:24:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.452+0000 7f5965e64b80 1 -- 172.21.15.6:0/2245915404 shutdown_connections 2023-10-06T02:24:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.452+0000 7f5965e64b80 1 --2- 172.21.15.6:0/2245915404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44c08f0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.452+0000 7f5965e64b80 1 --2- 172.21.15.6:0/2245915404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447e840 0x55e0d44be520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.452+0000 7f5965e64b80 1 --2- 172.21.15.6:0/2245915404 >> [v2:172.21.15.6:6833/2846199049,v1:172.21.15.6:6835/2846199049] conn(0x55e0d44a97e0 0x55e0d44c1320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.452+0000 7f5965e64b80 1 --2- 172.21.15.6:0/2245915404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d447fcc0 0x55e0d44bea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.452+0000 7f5965e64b80 1 -- 172.21.15.6:0/2245915404 >> 172.21.15.6:0/2245915404 conn(0x55e0d4480160 msgr2=0x55e0d4479a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.452+0000 7f5934ff9700 0 client.7419 ms_handle_reset on v2:172.21.15.6:6833/2846199049 2023-10-06T02:24:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.452+0000 7f5965e64b80 1 -- 172.21.15.6:0/2245915404 shutdown_connections 2023-10-06T02:24:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.452+0000 7f5965e64b80 1 -- 172.21.15.6:0/2245915404 wait complete. 2023-10-06T02:24:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.453+0000 7f5965e64b80 20 client.7419 trim_cache size 0 max 16384 2023-10-06T02:24:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.469+0000 7f5965e64b80 1 Processor -- start 2023-10-06T02:24:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.470+0000 7f5965e64b80 1 -- start start 2023-10-06T02:24:51.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.470+0000 7f5965e64b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447e840 0x55e0d44bf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.470+0000 7f5965e64b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d447fcc0 0x55e0d44c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.470+0000 7f5965e64b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d44cec00 0x55e0d44ae450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.470+0000 7f5965e64b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d447bce0 con 0x55e0d447fcc0 2023-10-06T02:24:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.470+0000 7f5965e64b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d44c0340 con 0x55e0d44cec00 2023-10-06T02:24:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.470+0000 7f5965e64b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0d437a810 con 0x55e0d447e840 2023-10-06T02:24:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.470+0000 7f5955d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d447fcc0 0x55e0d44c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.470+0000 7f5955d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d447fcc0 0x55e0d44c1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58564/0 (socket says 172.21.15.6:58564) 2023-10-06T02:24:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.470+0000 7f5955d9b700 1 -- 172.21.15.6:0/3680554577 learned_addr learned my addr 172.21.15.6:0/3680554577 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.470+0000 7f5956d9d700 1 --2- 172.21.15.6:0/3680554577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d44cec00 0x55e0d44ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.471+0000 7f595659c700 1 --2- 172.21.15.6:0/3680554577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447e840 0x55e0d44bf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.471+0000 7f5955d9b700 1 -- 172.21.15.6:0/3680554577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447e840 msgr2=0x55e0d44bf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.471+0000 7f5955d9b700 1 --2- 172.21.15.6:0/3680554577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447e840 0x55e0d44bf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.471+0000 7f5955d9b700 1 -- 172.21.15.6:0/3680554577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d44cec00 msgr2=0x55e0d44ae450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.471+0000 7f5955d9b700 1 --2- 172.21.15.6:0/3680554577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d44cec00 0x55e0d44ae450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.471+0000 7f5955d9b700 1 -- 172.21.15.6:0/3680554577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0d439d780 con 0x55e0d447fcc0 2023-10-06T02:24:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.471+0000 7f595659c700 1 --2- 172.21.15.6:0/3680554577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447e840 0x55e0d44bf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.471+0000 7f5955d9b700 1 --2- 172.21.15.6:0/3680554577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d447fcc0 0x55e0d44c1f90 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f5940001800 tx=0x7f5940019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f558565c9fbe1a09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.471+0000 7f5937fff700 1 -- 172.21.15.6:0/3680554577 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5940016570 con 0x55e0d447fcc0 2023-10-06T02:24:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.471+0000 7f5937fff700 1 -- 172.21.15.6:0/3680554577 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59400166d0 con 0x55e0d447fcc0 2023-10-06T02:24:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.471+0000 7f5937fff700 1 -- 172.21.15.6:0/3680554577 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5940016a50 con 0x55e0d447fcc0 2023-10-06T02:24:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.472+0000 7f5965e64b80 1 -- 172.21.15.6:0/3680554577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d447fcc0 msgr2=0x55e0d44c1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.472+0000 7f5965e64b80 1 --2- 172.21.15.6:0/3680554577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d447fcc0 0x55e0d44c1f90 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f5940001800 tx=0x7f5940019040 comp rx=0 tx=0).stop 2023-10-06T02:24:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.472+0000 7f5965e64b80 1 -- 172.21.15.6:0/3680554577 shutdown_connections 2023-10-06T02:24:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.472+0000 7f5965e64b80 1 --2- 172.21.15.6:0/3680554577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d44cec00 0x55e0d44ae450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.472+0000 7f5965e64b80 1 --2- 172.21.15.6:0/3680554577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447e840 0x55e0d44bf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.472+0000 7f5965e64b80 1 --2- 172.21.15.6:0/3680554577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d447fcc0 0x55e0d44c1f90 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.472+0000 7f5965e64b80 1 -- 172.21.15.6:0/3680554577 >> 172.21.15.6:0/3680554577 conn(0x55e0d4480160 msgr2=0x55e0d4477280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.472+0000 7f5965e64b80 1 -- 172.21.15.6:0/3680554577 shutdown_connections 2023-10-06T02:24:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.472+0000 7f5965e64b80 1 -- 172.21.15.6:0/3680554577 wait complete. 2023-10-06T02:24:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.472+0000 7f5965e64b80 1 -- start start 2023-10-06T02:24:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.472+0000 7f5965e64b80 1 Processor -- start 2023-10-06T02:24:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.473+0000 7f5965e64b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d447e840 0x55e0d44bcad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.473+0000 7f5965e64b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447fcc0 0x55e0d4529410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.473+0000 7f5965e64b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.473+0000 7f5965e64b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d44c77d0 con 0x55e0d44cec00 2023-10-06T02:24:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.473+0000 7f5965e64b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d44bc680 con 0x55e0d447e840 2023-10-06T02:24:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.473+0000 7f5965e64b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0d44bd010 con 0x55e0d447fcc0 2023-10-06T02:24:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.473+0000 7f5965e64b80 10 client.0 _ll_register_callbacks cb 0x55e0d4441e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:24:51.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.473+0000 7f5956d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.473+0000 7f5956d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44d35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58578/0 (socket says 172.21.15.6:58578) 2023-10-06T02:24:51.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.473+0000 7f5956d9d700 1 -- 172.21.15.6:0/1548876833 learned_addr learned my addr 172.21.15.6:0/1548876833 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:51.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.473+0000 7f595659c700 1 --2- 172.21.15.6:0/1548876833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d447e840 0x55e0d44bcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.473+0000 7f5955d9b700 1 --2- 172.21.15.6:0/1548876833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447fcc0 0x55e0d4529410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.474+0000 7f5956d9d700 1 -- 172.21.15.6:0/1548876833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447fcc0 msgr2=0x55e0d4529410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.474+0000 7f5956d9d700 1 --2- 172.21.15.6:0/1548876833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447fcc0 0x55e0d4529410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.474+0000 7f5956d9d700 1 -- 172.21.15.6:0/1548876833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d447e840 msgr2=0x55e0d44bcad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.474+0000 7f5956d9d700 1 --2- 172.21.15.6:0/1548876833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d447e840 0x55e0d44bcad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.474+0000 7f5956d9d700 1 -- 172.21.15.6:0/1548876833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594001f040 con 0x55e0d44cec00 2023-10-06T02:24:51.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.474+0000 7f5956d9d700 1 --2- 172.21.15.6:0/1548876833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44d35b0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x55e0d447bf30 tx=0x7f594802d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f2ee71923dac8f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.474+0000 7f5934ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:24:51.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.474+0000 7f5934ff9700 1 -- 172.21.15.6:0/1548876833 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948028b10 con 0x55e0d44cec00 2023-10-06T02:24:51.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.474+0000 7f5934ff9700 1 -- 172.21.15.6:0/1548876833 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5948028470 con 0x55e0d44cec00 2023-10-06T02:24:51.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.474+0000 7f5965e64b80 1 -- 172.21.15.6:0/1548876833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f594800a1e0 con 0x55e0d44cec00 2023-10-06T02:24:51.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.474+0000 7f5934ff9700 1 -- 172.21.15.6:0/1548876833 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5948028930 con 0x55e0d44cec00 2023-10-06T02:24:51.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.474+0000 7f5965e64b80 10 client.7425 fetch_fsmap learned FSMap version 86 2023-10-06T02:24:51.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.474+0000 7f5965e64b80 1 -- 172.21.15.6:0/1548876833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x55e0d4384470 con 0x55e0d44cec00 2023-10-06T02:24:51.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.474+0000 7f5934ff9700 1 -- 172.21.15.6:0/1548876833 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594800a1e0 con 0x55e0d44cec00 2023-10-06T02:24:51.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5934ff9700 1 -- 172.21.15.6:0/1548876833 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 86) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f594800a930 con 0x55e0d44cec00 2023-10-06T02:24:51.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5965e64b80 10 client.7425 fetch_fsmap finished waiting for FSMap version 86 2023-10-06T02:24:51.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5965e64b80 10 client.7425 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:24:51.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5965e64b80 20 client.7425 populate_metadata read hostname 'smithi006' 2023-10-06T02:24:51.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5965e64b80 1 --2- 172.21.15.6:0/1548876833 >> [v2:172.21.15.6:6833/2846199049,v1:172.21.15.6:6835/2846199049] conn(0x55e0d44a47a0 0x55e0d44a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5965e64b80 4 client.7425 mds_command: new command op to 7242 tid=0[{"prefix": "status"}] 2023-10-06T02:24:51.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5965e64b80 1 -- 172.21.15.6:0/1548876833 --> [v2:172.21.15.6:6833/2846199049,v1:172.21.15.6:6835/2846199049] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e0d4371e00 con 0x55e0d44a47a0 2023-10-06T02:24:51.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f595659c700 1 --2- 172.21.15.6:0/1548876833 >> [v2:172.21.15.6:6833/2846199049,v1:172.21.15.6:6835/2846199049] conn(0x55e0d44a47a0 0x55e0d44a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5934ff9700 10 client.7425 ms_handle_connect on v2:172.21.15.6:6833/2846199049 2023-10-06T02:24:51.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f595659c700 1 --2- 172.21.15.6:0/1548876833 >> [v2:172.21.15.6:6833/2846199049,v1:172.21.15.6:6835/2846199049] conn(0x55e0d44a47a0 0x55e0d44a4b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa9fa9f2a6224c75 server_cookie=e90cadb5da91d826 in_seq=0 out_seq=0 2023-10-06T02:24:51.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5934ff9700 1 -- 172.21.15.6:0/1548876833 <== mds.0 v2:172.21.15.6:6833/2846199049 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55e0d4371e00 con 0x55e0d44a47a0 2023-10-06T02:24:51.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5934ff9700 10 client.7425 handle_command_reply: tid=0 2023-10-06T02:24:51.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5965e64b80 1 client.7425 shutdown 2023-10-06T02:24:51.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5965e64b80 1 -- 172.21.15.6:0/1548876833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 msgr2=0x55e0d44d35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5965e64b80 1 --2- 172.21.15.6:0/1548876833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44d35b0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x55e0d447bf30 tx=0x7f594802d000 comp rx=0 tx=0).stop 2023-10-06T02:24:51.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5965e64b80 1 -- 172.21.15.6:0/1548876833 shutdown_connections 2023-10-06T02:24:51.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5965e64b80 1 --2- 172.21.15.6:0/1548876833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0d44cec00 0x55e0d44d35b0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5965e64b80 1 --2- 172.21.15.6:0/1548876833 >> [v2:172.21.15.6:6833/2846199049,v1:172.21.15.6:6835/2846199049] conn(0x55e0d44a47a0 0x55e0d44a4b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5965e64b80 1 --2- 172.21.15.6:0/1548876833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0d447e840 0x55e0d44bcad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5965e64b80 1 --2- 172.21.15.6:0/1548876833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e0d447fcc0 0x55e0d4529410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5934ff9700 0 client.7425 ms_handle_reset on v2:172.21.15.6:6833/2846199049 2023-10-06T02:24:51.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.475+0000 7f5965e64b80 1 -- 172.21.15.6:0/1548876833 >> 172.21.15.6:0/1548876833 conn(0x55e0d4480160 msgr2=0x55e0d44c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:51.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.476+0000 7f5965e64b80 1 -- 172.21.15.6:0/1548876833 shutdown_connections 2023-10-06T02:24:51.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.476+0000 7f5965e64b80 1 -- 172.21.15.6:0/1548876833 wait complete. 2023-10-06T02:24:51.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.476+0000 7f5965e64b80 20 client.7425 trim_cache size 0 max 16384 2023-10-06T02:24:51.485 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:24:51.485 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:24:51.485 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:24:51.485 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 7242, 2023-10-06T02:24:51.485 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:24:51.485 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:24:51.485 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:24:51.485 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.504135228999999, 2023-10-06T02:24:51.486 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 86, 2023-10-06T02:24:51.486 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 95, 2023-10-06T02:24:51.486 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 95, 2023-10-06T02:24:51.486 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 22.558133860000002 2023-10-06T02:24:51.486 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:24:51.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.476+0000 7f595cb6c700 1 -- 172.21.15.6:0/771530221 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5938066f30 msgr2=0x7f59380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.476+0000 7f595cb6c700 1 --2- 172.21.15.6:0/771530221 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5938066f30 0x7f59380693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f59580cb820 tx=0x7f5940009040 comp rx=0 tx=0).stop 2023-10-06T02:24:51.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.476+0000 7f595cb6c700 1 -- 172.21.15.6:0/771530221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5944004d50 msgr2=0x7f595815dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.476+0000 7f595cb6c700 1 --2- 172.21.15.6:0/771530221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5944004d50 0x7f595815dbc0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f5950006ac0 tx=0x7f59500091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.476+0000 7f595cb6c700 1 -- 172.21.15.6:0/771530221 shutdown_connections 2023-10-06T02:24:51.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.476+0000 7f595cb6c700 1 --2- 172.21.15.6:0/771530221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59580b4fc0 0x7f59580b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.476+0000 7f595cb6c700 1 --2- 172.21.15.6:0/771530221 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5938066f30 0x7f59380693e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.476+0000 7f595cb6c700 1 --2- 172.21.15.6:0/771530221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5944004d50 0x7f595815dbc0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.476+0000 7f595cb6c700 1 --2- 172.21.15.6:0/771530221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f595815b050 0x7f595815b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.476+0000 7f595cb6c700 1 -- 172.21.15.6:0/771530221 >> 172.21.15.6:0/771530221 conn(0x7f5958068680 msgr2=0x7f59580c6680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:51.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.476+0000 7f595cb6c700 1 -- 172.21.15.6:0/771530221 shutdown_connections 2023-10-06T02:24:51.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.476+0000 7f595cb6c700 1 -- 172.21.15.6:0/771530221 wait complete. 2023-10-06T02:24:51.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:24:51.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.607+0000 7f10f028e700 1 Processor -- start 2023-10-06T02:24:51.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.607+0000 7f10f028e700 1 -- start start 2023-10-06T02:24:51.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10f028e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f10e8142cf0 0x7f10e80ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10f028e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f10e80ce9f0 0x7f10e80d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10f028e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10e81430c0 0x7f10e80d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10f028e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e80cee60 con 0x7f10e8142cf0 2023-10-06T02:24:51.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10f028e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e80cf140 con 0x7f10e80ce9f0 2023-10-06T02:24:51.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10f028e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e80cf420 con 0x7f10e81430c0 2023-10-06T02:24:51.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10ee02a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f10e8142cf0 0x7f10e80ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10ee02a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f10e8142cf0 0x7f10e80ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58586/0 (socket says 172.21.15.6:58586) 2023-10-06T02:24:51.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10ee02a700 1 -- 172.21.15.6:0/3059914664 learned_addr learned my addr 172.21.15.6:0/3059914664 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:51.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10ed829700 1 --2- 172.21.15.6:0/3059914664 >> v2:172.21.15.175:3300/0 conn(0x7f10e80ce9f0 0x7f10e80d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10ee02a700 1 -- 172.21.15.6:0/3059914664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10e81430c0 msgr2=0x7f10e80d07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10ee82b700 1 --2- 172.21.15.6:0/3059914664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10e81430c0 0x7f10e80d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10ee02a700 1 --2- 172.21.15.6:0/3059914664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10e81430c0 0x7f10e80d07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10ee02a700 1 -- 172.21.15.6:0/3059914664 >> v2:172.21.15.175:3300/0 conn(0x7f10e80ce9f0 msgr2=0x7f10e80d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10ee02a700 1 --2- 172.21.15.6:0/3059914664 >> v2:172.21.15.175:3300/0 conn(0x7f10e80ce9f0 0x7f10e80d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10ee02a700 1 -- 172.21.15.6:0/3059914664 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e80cf700 con 0x7f10e8142cf0 2023-10-06T02:24:51.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10ed829700 1 --2- 172.21.15.6:0/3059914664 >> v2:172.21.15.175:3300/0 conn(0x7f10e80ce9f0 0x7f10e80d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:51.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10ee82b700 1 --2- 172.21.15.6:0/3059914664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10e81430c0 0x7f10e80d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:51.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10ee02a700 1 --2- 172.21.15.6:0/3059914664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e8142cf0 0x7f10e80ccd30 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f10e8070690 tx=0x7f10e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2013c8896592354 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10ed028700 1 -- 172.21.15.6:0/3059914664 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e000e070 con 0x7f10e8142cf0 2023-10-06T02:24:51.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10ed028700 1 -- 172.21.15.6:0/3059914664 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e000ba50 con 0x7f10e8142cf0 2023-10-06T02:24:51.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.608+0000 7f10ed028700 1 -- 172.21.15.6:0/3059914664 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e00092e0 con 0x7f10e8142cf0 2023-10-06T02:24:51.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.609+0000 7f10f028e700 1 -- 172.21.15.6:0/3059914664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e8142cf0 msgr2=0x7f10e80ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.609+0000 7f10f028e700 1 --2- 172.21.15.6:0/3059914664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e8142cf0 0x7f10e80ccd30 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f10e8070690 tx=0x7f10e0009840 comp rx=0 tx=0).stop 2023-10-06T02:24:51.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.609+0000 7f10f028e700 1 -- 172.21.15.6:0/3059914664 shutdown_connections 2023-10-06T02:24:51.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.609+0000 7f10f028e700 1 --2- 172.21.15.6:0/3059914664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10e81430c0 0x7f10e80d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.609+0000 7f10f028e700 1 --2- 172.21.15.6:0/3059914664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e8142cf0 0x7f10e80ccd30 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.609+0000 7f10f028e700 1 --2- 172.21.15.6:0/3059914664 >> v2:172.21.15.175:3300/0 conn(0x7f10e80ce9f0 0x7f10e80d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.609+0000 7f10f028e700 1 -- 172.21.15.6:0/3059914664 >> 172.21.15.6:0/3059914664 conn(0x7f10e80690f0 msgr2=0x7f10e806a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:51.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.609+0000 7f10f028e700 1 -- 172.21.15.6:0/3059914664 shutdown_connections 2023-10-06T02:24:51.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.609+0000 7f10f028e700 1 -- 172.21.15.6:0/3059914664 wait complete. 2023-10-06T02:24:51.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.610+0000 7f10f028e700 1 Processor -- start 2023-10-06T02:24:51.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.610+0000 7f10f028e700 1 -- start start 2023-10-06T02:24:51.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.611+0000 7f10f028e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e80ce9f0 0x7f10e816ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.611+0000 7f10f028e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10e8142cf0 0x7f10e816a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.611+0000 7f10f028e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10e81430c0 0x7f10e816c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.611+0000 7f10f028e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e80caeb0 con 0x7f10e80ce9f0 2023-10-06T02:24:51.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.611+0000 7f10f028e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e80c9330 con 0x7f10e81430c0 2023-10-06T02:24:51.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.611+0000 7f10f028e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e816b1c0 con 0x7f10e8142cf0 2023-10-06T02:24:51.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.611+0000 7f10ee02a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e80ce9f0 0x7f10e816ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.611+0000 7f10ee02a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e80ce9f0 0x7f10e816ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58596/0 (socket says 172.21.15.6:58596) 2023-10-06T02:24:51.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.611+0000 7f10ee02a700 1 -- 172.21.15.6:0/850030732 learned_addr learned my addr 172.21.15.6:0/850030732 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:51.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.611+0000 7f10ee02a700 1 -- 172.21.15.6:0/850030732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10e8142cf0 msgr2=0x7f10e816a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.611+0000 7f10ee02a700 1 --2- 172.21.15.6:0/850030732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10e8142cf0 0x7f10e816a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.611+0000 7f10ee02a700 1 -- 172.21.15.6:0/850030732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10e81430c0 msgr2=0x7f10e816c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.611+0000 7f10ee02a700 1 --2- 172.21.15.6:0/850030732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10e81430c0 0x7f10e816c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.611+0000 7f10ee02a700 1 -- 172.21.15.6:0/850030732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e0009ae0 con 0x7f10e80ce9f0 2023-10-06T02:24:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.611+0000 7f10ee02a700 1 --2- 172.21.15.6:0/850030732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e80ce9f0 0x7f10e816ac80 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f10e8065f80 tx=0x7f10e0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.611+0000 7f10e67fc700 1 -- 172.21.15.6:0/850030732 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0008b70 con 0x7f10e80ce9f0 2023-10-06T02:24:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.612+0000 7f10e67fc700 1 -- 172.21.15.6:0/850030732 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e0008cf0 con 0x7f10e80ce9f0 2023-10-06T02:24:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.612+0000 7f10f028e700 1 -- 172.21.15.6:0/850030732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e816aa20 con 0x7f10e80ce9f0 2023-10-06T02:24:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.612+0000 7f10e67fc700 1 -- 172.21.15.6:0/850030732 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e00266b0 con 0x7f10e80ce9f0 2023-10-06T02:24:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.612+0000 7f10f028e700 1 -- 172.21.15.6:0/850030732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e80c8a00 con 0x7f10e80ce9f0 2023-10-06T02:24:51.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.613+0000 7f10f028e700 1 -- 172.21.15.6:0/850030732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e8088ad0 con 0x7f10e80ce9f0 2023-10-06T02:24:51.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.613+0000 7f10e67fc700 1 -- 172.21.15.6:0/850030732 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10e0003040 con 0x7f10e80ce9f0 2023-10-06T02:24:51.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.613+0000 7f10e67fc700 1 --2- 172.21.15.6:0/850030732 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f10d4066f30 0x7f10d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.613+0000 7f10e67fc700 1 -- 172.21.15.6:0/850030732 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f10e0086280 con 0x7f10e80ce9f0 2023-10-06T02:24:51.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.614+0000 7f10ed829700 1 --2- 172.21.15.6:0/850030732 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f10d4066f30 0x7f10d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.614+0000 7f10ed829700 1 --2- 172.21.15.6:0/850030732 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f10d4066f30 0x7f10d40693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f10e81676a0 tx=0x7f10dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.618+0000 7f10e67fc700 1 -- 172.21.15.6:0/850030732 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10e0053300 con 0x7f10e80ce9f0 2023-10-06T02:24:51.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.856+0000 7f10f028e700 1 -- 172.21.15.6:0/850030732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f10e80cf9e0 con 0x7f10e80ce9f0 2023-10-06T02:24:51.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.856+0000 7f10e67fc700 1 -- 172.21.15.6:0/850030732 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v86) v1 ==== 53+0+73 (secure 0 0 0) 0x7f10e0056920 con 0x7f10e80ce9f0 2023-10-06T02:24:51.858 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:24:51.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.858+0000 7f10f028e700 1 -- 172.21.15.6:0/850030732 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f10d4066f30 msgr2=0x7f10d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.858+0000 7f10f028e700 1 --2- 172.21.15.6:0/850030732 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f10d4066f30 0x7f10d40693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f10e81676a0 tx=0x7f10dc008040 comp rx=0 tx=0).stop 2023-10-06T02:24:51.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.858+0000 7f10f028e700 1 -- 172.21.15.6:0/850030732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e80ce9f0 msgr2=0x7f10e816ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.858+0000 7f10f028e700 1 --2- 172.21.15.6:0/850030732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e80ce9f0 0x7f10e816ac80 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f10e8065f80 tx=0x7f10e0018000 comp rx=0 tx=0).stop 2023-10-06T02:24:51.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.858+0000 7f10f028e700 1 -- 172.21.15.6:0/850030732 shutdown_connections 2023-10-06T02:24:51.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.858+0000 7f10f028e700 1 --2- 172.21.15.6:0/850030732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10e81430c0 0x7f10e816c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.858+0000 7f10f028e700 1 --2- 172.21.15.6:0/850030732 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f10d4066f30 0x7f10d40693e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.858+0000 7f10f028e700 1 --2- 172.21.15.6:0/850030732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e80ce9f0 0x7f10e816ac80 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.858+0000 7f10f028e700 1 --2- 172.21.15.6:0/850030732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10e8142cf0 0x7f10e816a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.858+0000 7f10f028e700 1 -- 172.21.15.6:0/850030732 >> 172.21.15.6:0/850030732 conn(0x7f10e80690f0 msgr2=0x7f10e80b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:51.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.858+0000 7f10f028e700 1 -- 172.21.15.6:0/850030732 shutdown_connections 2023-10-06T02:24:51.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:51.858+0000 7f10f028e700 1 -- 172.21.15.6:0/850030732 wait complete. 2023-10-06T02:24:51.872 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:24:51.872 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:24:51.872 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:24:51.872 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:24:51.872 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:51.872 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:24:51.872 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:24:51.872 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:24:51.872 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:24:51.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:51.873 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:24:51.888 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:24:51.888 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:24:51.888 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:24:51.888 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:51.888 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:24:51.888 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:51.889 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:24:51.889 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:24:51.889 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:24:51.889 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:24:51.889 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:24:51.889 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:24:51.889 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:24:51.889 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:24:51.889 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:24:51.889 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:24:51.889 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42054sec preferred_lft 42054sec 2023-10-06T02:24:51.890 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:24:51.890 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:51.890 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:24:51.890 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:24:51.890 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:24:51.890 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:24:51.890 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:24:51.890 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:24:51.890 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:51.890 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:24:51.890 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:51.891 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:24:51.891 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:24:51.891 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:24:51.891 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:51.891 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:24:51.891 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:24:51.891 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:24:51.891 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:51.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:51.892 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:24:51.952 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:24:51.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:51.953 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:24:52.009 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:24:52.009 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:24:52.009 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:24:52.010 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:24:52.010 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:24:52.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:52.010 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:24:52.010 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:24:52.010 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:24:52.010 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:24:52.010 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:24:52.011 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:24:52.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:52.112 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:24:52.126 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:24:52.127 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:24:52.127 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:24:52.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:52.127 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:24:52.192 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:24:52.193 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:24:52.193 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:52.248 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:24:52.249 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:24:52.249 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:52.303 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:24:52.369 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:24:52.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:24:52.433 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:24:52.434 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:24:52.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:52.435 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:24:52.490 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:24:52.491 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:24:52.532 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:24:52.557 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:24:52.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:24:52.615 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:24:52.613+0000 7f92ff31f540 -1 init, newargv = 0x5585590598d0 newargc=15 2023-10-06T02:24:52.615 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[122129]: starting ceph client 2023-10-06T02:24:52.619 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[122129]: starting fuse 2023-10-06T02:24:52.624 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:24:52.625 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:24:52.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:52.626 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:24:52.681 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:24:52.682 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:24:52.682 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:24:52.682 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:24:52.682 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:24:52.682 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:24:52.683 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:24:52.683 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:24:52.683 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:24:52.683 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:24:52.683 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:24:52.683 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:24:52.683 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:24:52.683 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:24:52.684 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:24:52.684 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:24:52.684 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:24:52.684 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:24:52.684 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:24:52.684 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:24:52.684 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:24:52.684 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:24:52.685 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:24:52.685 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:24:52.685 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:24:52.685 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:24:52.685 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:24:52.685 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:24:52.685 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:24:52.804 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.122129.asok 2023-10-06T02:24:52.986 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.122129.asok 2023-10-06T02:24:52.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:52.986 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.122129.asok status 2023-10-06T02:24:53.143 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:24:53.143 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:24:53.143 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:24:53.143 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:24:53.143 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:24:53.143 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:24:53.143 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:24:53.143 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "122129", 2023-10-06T02:24:53.144 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:24:53.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:53.144 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:24:53.144 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:24:53.144 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 7437, 2023-10-06T02:24:53.144 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:24:53.144 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:24:53.144 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:24:53.144 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 7437 2023-10-06T02:24:53.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:53.144 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:24:53.145 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:24:53.145 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:24:53.145 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1979895584 2023-10-06T02:24:53.145 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:24:53.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:53.145 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:24:53.145 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:24:53.145 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:24:53.145 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1979895584 2023-10-06T02:24:53.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:24:53.145 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.7437 192.168.0.1:0/1979895584", 2023-10-06T02:24:53.145 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/1979895584", 2023-10-06T02:24:53.146 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:24:53.146 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 86, 2023-10-06T02:24:53.146 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 95, 2023-10-06T02:24:53.146 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:24:53.146 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:24:53.146 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:24:53.146 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:24:53.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:53.153 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:24:53.153 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:53.168 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:24:53.168 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:53.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:53.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:53.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:53.234 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2023-10-06T02:24:53.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:53.295 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2023-10-06T02:24:53.408 INFO:teuthology.orchestra.run.smithi006.stderr:6+0 records in 2023-10-06T02:24:53.408 INFO:teuthology.orchestra.run.smithi006.stderr:6+0 records out 2023-10-06T02:24:53.408 INFO:teuthology.orchestra.run.smithi006.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0552966 s, 114 MB/s 2023-10-06T02:24:53.408 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:24:53.409 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:24:53.409 DEBUG:teuthology.orchestra.run.smithi006:> import stat 2023-10-06T02:24:53.409 DEBUG:teuthology.orchestra.run.smithi006:> import json 2023-10-06T02:24:53.409 DEBUG:teuthology.orchestra.run.smithi006:> import sys 2023-10-06T02:24:53.409 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:24:53.409 DEBUG:teuthology.orchestra.run.smithi006:> try: 2023-10-06T02:24:53.409 DEBUG:teuthology.orchestra.run.smithi006:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2023-10-06T02:24:53.409 DEBUG:teuthology.orchestra.run.smithi006:> except OSError as e: 2023-10-06T02:24:53.409 DEBUG:teuthology.orchestra.run.smithi006:> sys.exit(e.errno) 2023-10-06T02:24:53.409 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:24:53.409 DEBUG:teuthology.orchestra.run.smithi006:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-10-06T02:24:53.410 DEBUG:teuthology.orchestra.run.smithi006:> print(json.dumps( 2023-10-06T02:24:53.410 DEBUG:teuthology.orchestra.run.smithi006:> dict([(a, getattr(s, a)) for a in attrs]), 2023-10-06T02:24:53.410 DEBUG:teuthology.orchestra.run.smithi006:> indent=2)) 2023-10-06T02:24:53.410 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:24:53.479 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:24:53.479 INFO:teuthology.orchestra.run.smithi006.stdout: "st_mode": 33204, 2023-10-06T02:24:53.479 INFO:teuthology.orchestra.run.smithi006.stdout: "st_ino": 1099511627777, 2023-10-06T02:24:53.480 INFO:teuthology.orchestra.run.smithi006.stdout: "st_dev": 47, 2023-10-06T02:24:53.480 INFO:teuthology.orchestra.run.smithi006.stdout: "st_nlink": 1, 2023-10-06T02:24:53.480 INFO:teuthology.orchestra.run.smithi006.stdout: "st_uid": 1000, 2023-10-06T02:24:53.480 INFO:teuthology.orchestra.run.smithi006.stdout: "st_gid": 1275, 2023-10-06T02:24:53.480 INFO:teuthology.orchestra.run.smithi006.stdout: "st_size": 6291456, 2023-10-06T02:24:53.480 INFO:teuthology.orchestra.run.smithi006.stdout: "st_atime": 1696559093.3517, 2023-10-06T02:24:53.480 INFO:teuthology.orchestra.run.smithi006.stdout: "st_mtime": 1696559093.390514, 2023-10-06T02:24:53.480 INFO:teuthology.orchestra.run.smithi006.stdout: "st_ctime": 1696559093.390514 2023-10-06T02:24:53.480 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:24:53.664 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:24:53.664 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:24:53.664 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:53.741 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[122129]: fuse finished with error 0 and tester_r 0 2023-10-06T02:24:53.743 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:24:53.807 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:24:53.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:53.808 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:24:53.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:53.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.981+0000 7f61c847c700 1 Processor -- start 2023-10-06T02:24:53.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.981+0000 7f61c847c700 1 -- start start 2023-10-06T02:24:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.982+0000 7f61c847c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61c015ca10 0x7f61c0069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.982+0000 7f61c847c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c00b1ed0 con 0x7f61c015cde0 2023-10-06T02:24:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.982+0000 7f61c847c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c00879c0 con 0x7f61c0067d10 2023-10-06T02:24:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.982+0000 7f61c847c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00cec50 con 0x7f61c015ca10 2023-10-06T02:24:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.982+0000 7f61c6a19700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f61c015cde0 0x7f61c00b2360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42208/0 (socket says 172.21.15.6:42208) 2023-10-06T02:24:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.982+0000 7f61c6a19700 1 -- 172.21.15.6:0/1491099560 learned_addr learned my addr 172.21.15.6:0/1491099560 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c6218700 1 --2- 172.21.15.6:0/1491099560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61c015ca10 0x7f61c0069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5216700 1 -- 172.21.15.6:0/1491099560 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321861089 0 0) 0x7f61c00b1ed0 con 0x7f61c015cde0 2023-10-06T02:24:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5216700 1 -- 172.21.15.6:0/1491099560 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61a8003570 con 0x7f61c015cde0 2023-10-06T02:24:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5216700 1 -- 172.21.15.6:0/1491099560 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1933590421 0 0) 0x7f61a8003570 con 0x7f61c015cde0 2023-10-06T02:24:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5216700 1 -- 172.21.15.6:0/1491099560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61c015ca10 msgr2=0x7f61c0069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5216700 1 --2- 172.21.15.6:0/1491099560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61c015ca10 0x7f61c0069f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5216700 1 -- 172.21.15.6:0/1491099560 >> v1:172.21.15.175:6789/0 conn(0x7f61c0067d10 legacy=0x7f61c006a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5216700 1 -- 172.21.15.6:0/1491099560 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c00cef30 con 0x7f61c015cde0 2023-10-06T02:24:53.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5216700 1 -- 172.21.15.6:0/1491099560 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f61b0001470 con 0x7f61c015cde0 2023-10-06T02:24:53.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5216700 1 -- 172.21.15.6:0/1491099560 >> v1:172.21.15.6:6789/0 conn(0x7f61c015cde0 legacy=0x7f61c00b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:53.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5216700 1 --2- 172.21.15.6:0/1491099560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61c015ca10 0x7f61a8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:53.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5216700 1 --2- 172.21.15.6:0/1491099560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a8003fd0 0x7f61a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:53.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5216700 1 --2- 172.21.15.6:0/1491099560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61a8004d50 0x7f61a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:53.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5216700 1 -- 172.21.15.6:0/1491099560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00cec50 con 0x7f61a8003fd0 2023-10-06T02:24:53.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5216700 1 -- 172.21.15.6:0/1491099560 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a800bb40 con 0x7f61a8004d50 2023-10-06T02:24:53.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5216700 1 -- 172.21.15.6:0/1491099560 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a800bd00 con 0x7f61c015ca10 2023-10-06T02:24:53.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5a17700 1 --2- 172.21.15.6:0/1491099560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a8003fd0 0x7f61a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:53.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c6218700 1 --2- 172.21.15.6:0/1491099560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61c015ca10 0x7f61a8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:53.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c6a19700 1 --2- 172.21.15.6:0/1491099560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61a8004d50 0x7f61a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:53.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5a17700 1 -- 172.21.15.6:0/1491099560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61c015ca10 msgr2=0x7f61a8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:53.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5a17700 1 --2- 172.21.15.6:0/1491099560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61c015ca10 0x7f61a8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:53.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5a17700 1 -- 172.21.15.6:0/1491099560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61a8004d50 msgr2=0x7f61a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:53.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5a17700 1 --2- 172.21.15.6:0/1491099560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61a8004d50 0x7f61a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:53.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.983+0000 7f61c5a17700 1 -- 172.21.15.6:0/1491099560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a8003570 con 0x7f61a8003fd0 2023-10-06T02:24:53.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.984+0000 7f61c5a17700 1 --2- 172.21.15.6:0/1491099560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a8003fd0 0x7f61a8004810 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f61b40019a0 tx=0x7f61b4007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399715aa75c34128 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:53.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.984+0000 7f61c5216700 1 -- 172.21.15.6:0/1491099560 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b400c5d0 con 0x7f61a8003fd0 2023-10-06T02:24:53.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.984+0000 7f61c5216700 1 -- 172.21.15.6:0/1491099560 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b400c750 con 0x7f61a8003fd0 2023-10-06T02:24:53.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.984+0000 7f61c5216700 1 -- 172.21.15.6:0/1491099560 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b400cb10 con 0x7f61a8003fd0 2023-10-06T02:24:53.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.984+0000 7f61c847c700 1 -- 172.21.15.6:0/1491099560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a8003fd0 msgr2=0x7f61a8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:53.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.984+0000 7f61c847c700 1 --2- 172.21.15.6:0/1491099560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a8003fd0 0x7f61a8004810 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f61b40019a0 tx=0x7f61b4007d10 comp rx=0 tx=0).stop 2023-10-06T02:24:53.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.984+0000 7f61c6a19700 1 -- 172.21.15.6:0/1491099560 reap_dead start 2023-10-06T02:24:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.984+0000 7f61c847c700 1 -- 172.21.15.6:0/1491099560 shutdown_connections 2023-10-06T02:24:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.984+0000 7f61c847c700 1 -- 172.21.15.6:0/1491099560 >> 172.21.15.6:0/1491099560 conn(0x7f61c0067910 msgr2=0x7f61c00ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.984+0000 7f61c847c700 1 -- 172.21.15.6:0/1491099560 shutdown_connections 2023-10-06T02:24:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.984+0000 7f61c847c700 1 -- 172.21.15.6:0/1491099560 wait complete. 2023-10-06T02:24:53.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.985+0000 7f61c847c700 1 Processor -- start 2023-10-06T02:24:53.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.986+0000 7f61c847c700 1 -- start start 2023-10-06T02:24:53.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.986+0000 7f61c847c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a8003fd0 0x7f61c014ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:53.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.986+0000 7f61c847c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61c0153490 0x7f61c0153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:53.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.986+0000 7f61c847c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61c0157610 0x7f61c0157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.986+0000 7f61c847c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c0157fd0 con 0x7f61a8003fd0 2023-10-06T02:24:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.986+0000 7f61c847c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c0155ed0 con 0x7f61c0153490 2023-10-06T02:24:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.986+0000 7f61c847c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c0155630 con 0x7f61c0157610 2023-10-06T02:24:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.986+0000 7f61c6218700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a8003fd0 0x7f61c014ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.986+0000 7f61c6218700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a8003fd0 0x7f61c014ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58620/0 (socket says 172.21.15.6:58620) 2023-10-06T02:24:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.986+0000 7f61c6218700 1 -- 172.21.15.6:0/2511342605 learned_addr learned my addr 172.21.15.6:0/2511342605 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.987+0000 7f61c5a17700 1 --2- 172.21.15.6:0/2511342605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61c0153490 0x7f61c0153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.987+0000 7f61c6a19700 1 --2- 172.21.15.6:0/2511342605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61c0157610 0x7f61c0157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.987+0000 7f61c6218700 1 -- 172.21.15.6:0/2511342605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61c0157610 msgr2=0x7f61c0157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.987+0000 7f61c6218700 1 --2- 172.21.15.6:0/2511342605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61c0157610 0x7f61c0157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.987+0000 7f61c6218700 1 -- 172.21.15.6:0/2511342605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61c0153490 msgr2=0x7f61c0153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.987+0000 7f61c6218700 1 --2- 172.21.15.6:0/2511342605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61c0153490 0x7f61c0153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:53.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.987+0000 7f61c6218700 1 -- 172.21.15.6:0/2511342605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c0155910 con 0x7f61a8003fd0 2023-10-06T02:24:53.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.987+0000 7f61c6218700 1 --2- 172.21.15.6:0/2511342605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a8003fd0 0x7f61c014ed50 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f61b8009fd0 tx=0x7f61b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:53.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.987+0000 7f61be7fc700 1 -- 172.21.15.6:0/2511342605 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b800e040 con 0x7f61a8003fd0 2023-10-06T02:24:53.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.987+0000 7f61be7fc700 1 -- 172.21.15.6:0/2511342605 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b800f040 con 0x7f61a8003fd0 2023-10-06T02:24:53.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.987+0000 7f61be7fc700 1 -- 172.21.15.6:0/2511342605 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8015430 con 0x7f61a8003fd0 2023-10-06T02:24:53.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.987+0000 7f61c847c700 1 -- 172.21.15.6:0/2511342605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c0155bf0 con 0x7f61a8003fd0 2023-10-06T02:24:53.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.987+0000 7f61c847c700 1 -- 172.21.15.6:0/2511342605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c014f290 con 0x7f61a8003fd0 2023-10-06T02:24:53.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.988+0000 7f61c847c700 1 -- 172.21.15.6:0/2511342605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c0150930 con 0x7f61a8003fd0 2023-10-06T02:24:53.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.988+0000 7f61be7fc700 1 -- 172.21.15.6:0/2511342605 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61b80157e0 con 0x7f61a8003fd0 2023-10-06T02:24:53.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.989+0000 7f61be7fc700 1 --2- 172.21.15.6:0/2511342605 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f61ac066f60 0x7f61ac069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:53.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.989+0000 7f61be7fc700 1 -- 172.21.15.6:0/2511342605 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f61b8085550 con 0x7f61a8003fd0 2023-10-06T02:24:53.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.989+0000 7f61c5a17700 1 --2- 172.21.15.6:0/2511342605 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f61ac066f60 0x7f61ac069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:53.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.989+0000 7f61c5a17700 1 --2- 172.21.15.6:0/2511342605 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f61ac066f60 0x7f61ac069410 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f61b4008fd0 tx=0x7f61b4015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:53.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:53.993+0000 7f61be7fc700 1 -- 172.21.15.6:0/2511342605 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61c0150930 con 0x7f61a8003fd0 2023-10-06T02:24:54.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.234+0000 7f61c847c700 1 -- 172.21.15.6:0/2511342605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61c0150930 con 0x7f61a8003fd0 2023-10-06T02:24:54.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.234+0000 7f61be7fc700 1 -- 172.21.15.6:0/2511342605 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f61c0150930 con 0x7f61a8003fd0 2023-10-06T02:24:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:54.237 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:24:43.983823+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7242":{"gid":7242,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":5,"addr":"172.21.15.6:6835/2846199049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2846199049},{"type":"v1","addr":"172.21.15.6:6835","nonce":2846199049}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:24:54.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.236+0000 7f61c847c700 1 -- 172.21.15.6:0/2511342605 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f61ac066f60 msgr2=0x7f61ac069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.236+0000 7f61c847c700 1 --2- 172.21.15.6:0/2511342605 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f61ac066f60 0x7f61ac069410 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f61b4008fd0 tx=0x7f61b4015000 comp rx=0 tx=0).stop 2023-10-06T02:24:54.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.236+0000 7f61c847c700 1 -- 172.21.15.6:0/2511342605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a8003fd0 msgr2=0x7f61c014ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.236+0000 7f61c847c700 1 --2- 172.21.15.6:0/2511342605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a8003fd0 0x7f61c014ed50 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f61b8009fd0 tx=0x7f61b800b040 comp rx=0 tx=0).stop 2023-10-06T02:24:54.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.236+0000 7f61c847c700 1 -- 172.21.15.6:0/2511342605 shutdown_connections 2023-10-06T02:24:54.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.236+0000 7f61c847c700 1 --2- 172.21.15.6:0/2511342605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61c0157610 0x7f61c0157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.236+0000 7f61c847c700 1 --2- 172.21.15.6:0/2511342605 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f61ac066f60 0x7f61ac069410 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.236+0000 7f61c847c700 1 --2- 172.21.15.6:0/2511342605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a8003fd0 0x7f61c014ed50 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.236+0000 7f61c847c700 1 --2- 172.21.15.6:0/2511342605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61c0153490 0x7f61c0153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.236+0000 7f61c847c700 1 -- 172.21.15.6:0/2511342605 >> 172.21.15.6:0/2511342605 conn(0x7f61c0067910 msgr2=0x7f61c0158540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:54.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.237+0000 7f61c847c700 1 -- 172.21.15.6:0/2511342605 shutdown_connections 2023-10-06T02:24:54.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.237+0000 7f61c847c700 1 -- 172.21.15.6:0/2511342605 wait complete. 2023-10-06T02:24:54.240 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 86 2023-10-06T02:24:54.250 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-10-06T02:24:54.395 INFO:teuthology.orchestra.run.smithi006.stdout:{"message":"","return_code":0} 2023-10-06T02:24:54.395 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T02:24:54.395 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:24:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.513+0000 7f6184dbe700 1 Processor -- start 2023-10-06T02:24:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.513+0000 7f6184dbe700 1 -- start start 2023-10-06T02:24:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.514+0000 7f6184dbe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f618015a030 0x7f618015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.514+0000 7f6184dbe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f618015a940 0x7f6180086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.514+0000 7f6184dbe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6180087530 0x7f61800b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.514+0000 7f6184dbe700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61800b0cf0 con 0x7f6180087530 2023-10-06T02:24:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.514+0000 7f6184dbe700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61800879b0 con 0x7f618015a030 2023-10-06T02:24:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.514+0000 7f6184dbe700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61800afc50 con 0x7f618015a940 2023-10-06T02:24:54.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.514+0000 7f617ed9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6180087530 0x7f61800b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.515+0000 7f617ed9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6180087530 0x7f61800b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58628/0 (socket says 172.21.15.6:58628) 2023-10-06T02:24:54.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.515+0000 7f617ed9d700 1 -- 172.21.15.6:0/436797543 learned_addr learned my addr 172.21.15.6:0/436797543 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:54.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.515+0000 7f617e59c700 1 --2- 172.21.15.6:0/436797543 >> v2:172.21.15.175:3300/0 conn(0x7f618015a030 0x7f618015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.515+0000 7f617dd9b700 1 --2- 172.21.15.6:0/436797543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f618015a940 0x7f6180086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.515+0000 7f617ed9d700 1 -- 172.21.15.6:0/436797543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f618015a940 msgr2=0x7f6180086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.515+0000 7f617ed9d700 1 --2- 172.21.15.6:0/436797543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f618015a940 0x7f6180086ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.515+0000 7f617ed9d700 1 -- 172.21.15.6:0/436797543 >> v2:172.21.15.175:3300/0 conn(0x7f618015a030 msgr2=0x7f618015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.515+0000 7f617ed9d700 1 --2- 172.21.15.6:0/436797543 >> v2:172.21.15.175:3300/0 conn(0x7f618015a030 0x7f618015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.515+0000 7f617ed9d700 1 -- 172.21.15.6:0/436797543 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61800aff30 con 0x7f6180087530 2023-10-06T02:24:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.515+0000 7f617e59c700 1 --2- 172.21.15.6:0/436797543 >> v2:172.21.15.175:3300/0 conn(0x7f618015a030 0x7f618015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.515+0000 7f617ed9d700 1 --2- 172.21.15.6:0/436797543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6180087530 0x7f61800b21b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f61800cddc0 tx=0x7f6170009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c47a47955e11ce0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.515+0000 7f617d59a700 1 -- 172.21.15.6:0/436797543 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617000e070 con 0x7f6180087530 2023-10-06T02:24:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.515+0000 7f617d59a700 1 -- 172.21.15.6:0/436797543 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617000ba40 con 0x7f6180087530 2023-10-06T02:24:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.515+0000 7f617d59a700 1 -- 172.21.15.6:0/436797543 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61700092e0 con 0x7f6180087530 2023-10-06T02:24:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.516+0000 7f6184dbe700 1 -- 172.21.15.6:0/436797543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6180087530 msgr2=0x7f61800b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.516+0000 7f6184dbe700 1 --2- 172.21.15.6:0/436797543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6180087530 0x7f61800b21b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f61800cddc0 tx=0x7f6170009840 comp rx=0 tx=0).stop 2023-10-06T02:24:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.516+0000 7f6184dbe700 1 -- 172.21.15.6:0/436797543 shutdown_connections 2023-10-06T02:24:54.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.516+0000 7f6184dbe700 1 --2- 172.21.15.6:0/436797543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6180087530 0x7f61800b21b0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.516+0000 7f6184dbe700 1 --2- 172.21.15.6:0/436797543 >> v2:172.21.15.175:3300/0 conn(0x7f618015a030 0x7f618015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.516+0000 7f6184dbe700 1 --2- 172.21.15.6:0/436797543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f618015a940 0x7f6180086ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.516+0000 7f6184dbe700 1 -- 172.21.15.6:0/436797543 >> 172.21.15.6:0/436797543 conn(0x7f6180068680 msgr2=0x7f6180068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:54.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.516+0000 7f6184dbe700 1 -- 172.21.15.6:0/436797543 shutdown_connections 2023-10-06T02:24:54.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.516+0000 7f6184dbe700 1 -- 172.21.15.6:0/436797543 wait complete. 2023-10-06T02:24:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.517+0000 7f6184dbe700 1 Processor -- start 2023-10-06T02:24:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.517+0000 7f6184dbe700 1 -- start start 2023-10-06T02:24:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f6184dbe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6180087530 0x7f618016d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f6184dbe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f618015a030 0x7f618016da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f6184dbe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f618015a940 0x7f61800b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f6184dbe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618016b880 con 0x7f6180087530 2023-10-06T02:24:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f6184dbe700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61800c55e0 con 0x7f618015a940 2023-10-06T02:24:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f6184dbe700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618016b230 con 0x7f618015a030 2023-10-06T02:24:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f617e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6180087530 0x7f618016d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f617e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6180087530 0x7f618016d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58644/0 (socket says 172.21.15.6:58644) 2023-10-06T02:24:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f617e59c700 1 -- 172.21.15.6:0/3509072827 learned_addr learned my addr 172.21.15.6:0/3509072827 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f617dd9b700 1 --2- 172.21.15.6:0/3509072827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f618015a030 0x7f618016da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f617ed9d700 1 --2- 172.21.15.6:0/3509072827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f618015a940 0x7f61800b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f617e59c700 1 -- 172.21.15.6:0/3509072827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f618015a030 msgr2=0x7f618016da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f617e59c700 1 --2- 172.21.15.6:0/3509072827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f618015a030 0x7f618016da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f617e59c700 1 -- 172.21.15.6:0/3509072827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f618015a940 msgr2=0x7f61800b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f617e59c700 1 --2- 172.21.15.6:0/3509072827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f618015a940 0x7f61800b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f617e59c700 1 -- 172.21.15.6:0/3509072827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6170009ae0 con 0x7f6180087530 2023-10-06T02:24:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f617dd9b700 1 --2- 172.21.15.6:0/3509072827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f618015a030 0x7f618016da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f617ed9d700 1 --2- 172.21.15.6:0/3509072827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f618015a940 0x7f61800b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f617e59c700 1 --2- 172.21.15.6:0/3509072827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6180087530 0x7f618016d4c0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f617800e8d0 tx=0x7f6178008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f61767fc700 1 -- 172.21.15.6:0/3509072827 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617800ee70 con 0x7f6180087530 2023-10-06T02:24:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f61767fc700 1 -- 172.21.15.6:0/3509072827 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617800c5e0 con 0x7f6180087530 2023-10-06T02:24:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f6184dbe700 1 -- 172.21.15.6:0/3509072827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618016b510 con 0x7f6180087530 2023-10-06T02:24:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f61767fc700 1 -- 172.21.15.6:0/3509072827 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617800c980 con 0x7f6180087530 2023-10-06T02:24:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.518+0000 7f6184dbe700 1 -- 172.21.15.6:0/3509072827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61800b5830 con 0x7f6180087530 2023-10-06T02:24:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.519+0000 7f6184dbe700 1 -- 172.21.15.6:0/3509072827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618016bb60 con 0x7f6180087530 2023-10-06T02:24:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.520+0000 7f61767fc700 1 -- 172.21.15.6:0/3509072827 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6178013410 con 0x7f6180087530 2023-10-06T02:24:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.520+0000 7f61767fc700 1 --2- 172.21.15.6:0/3509072827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6160066f30 0x7f61600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.520+0000 7f61767fc700 1 -- 172.21.15.6:0/3509072827 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f61780845c0 con 0x7f6180087530 2023-10-06T02:24:54.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.520+0000 7f617dd9b700 1 --2- 172.21.15.6:0/3509072827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6160066f30 0x7f61600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.521+0000 7f617dd9b700 1 --2- 172.21.15.6:0/3509072827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6160066f30 0x7f61600693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f61800af890 tx=0x7f6168008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.524+0000 7f61767fc700 1 -- 172.21.15.6:0/3509072827 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6178051590 con 0x7f6180087530 2023-10-06T02:24:54.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.764+0000 7f6184dbe700 1 -- 172.21.15.6:0/3509072827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f618016b090 con 0x7f6180087530 2023-10-06T02:24:54.766 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:24:54.765+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:24:54.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.769+0000 7f61767fc700 1 -- 172.21.15.6:0/3509072827 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v87) v1 ==== 161+0+0 (secure 0 0 0) 0x7f618016b090 con 0x7f6180087530 2023-10-06T02:24:54.772 INFO:tasks.ceph.mds.a.smithi006.stderr: -3017> 2023-10-06T02:24:44.298+0000 7f0aa0b2b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:24:54.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.772+0000 7f6184dbe700 1 -- 172.21.15.6:0/3509072827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6160066f30 msgr2=0x7f61600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.772+0000 7f6184dbe700 1 --2- 172.21.15.6:0/3509072827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6160066f30 0x7f61600693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f61800af890 tx=0x7f6168008040 comp rx=0 tx=0).stop 2023-10-06T02:24:54.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.772+0000 7f6184dbe700 1 -- 172.21.15.6:0/3509072827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6180087530 msgr2=0x7f618016d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.772+0000 7f6184dbe700 1 --2- 172.21.15.6:0/3509072827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6180087530 0x7f618016d4c0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f617800e8d0 tx=0x7f6178008040 comp rx=0 tx=0).stop 2023-10-06T02:24:54.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.772+0000 7f6184dbe700 1 -- 172.21.15.6:0/3509072827 shutdown_connections 2023-10-06T02:24:54.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.772+0000 7f6184dbe700 1 --2- 172.21.15.6:0/3509072827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f618015a940 0x7f61800b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.772+0000 7f6184dbe700 1 --2- 172.21.15.6:0/3509072827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6160066f30 0x7f61600693e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.772+0000 7f6184dbe700 1 --2- 172.21.15.6:0/3509072827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6180087530 0x7f618016d4c0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.772+0000 7f6184dbe700 1 --2- 172.21.15.6:0/3509072827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f618015a030 0x7f618016da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.772+0000 7f6184dbe700 1 -- 172.21.15.6:0/3509072827 >> 172.21.15.6:0/3509072827 conn(0x7f6180068680 msgr2=0x7f6180156930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:54.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.772+0000 7f6184dbe700 1 -- 172.21.15.6:0/3509072827 shutdown_connections 2023-10-06T02:24:54.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.772+0000 7f6184dbe700 1 -- 172.21.15.6:0/3509072827 wait complete. 2023-10-06T02:24:54.775 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:24:54.786 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata export - 2023-10-06T02:24:54.797 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:24:54.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.824+0000 7f7618131000 1 Processor -- start 2023-10-06T02:24:54.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.824+0000 7f7618131000 1 -- start start 2023-10-06T02:24:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.824+0000 7f7618131000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af6c253330 0x55af6c311690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.824+0000 7f7618131000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55af6c3148b0 0x55af6c32dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.824+0000 7f7618131000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af6c314c80 0x55af6c2988d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.824+0000 7f7618131000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af6c19f980 con 0x55af6c314c80 2023-10-06T02:24:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.824+0000 7f7618131000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af6c19f620 con 0x55af6c253330 2023-10-06T02:24:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.824+0000 7f7618131000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af6c196400 con 0x55af6c3148b0 2023-10-06T02:24:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.825+0000 7f7611b6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af6c314c80 0x55af6c2988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.825+0000 7f7611b6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af6c314c80 0x55af6c2988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58664/0 (socket says 172.21.15.6:58664) 2023-10-06T02:24:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.825+0000 7f7611b6d700 1 -- 172.21.15.6:0/2325790194 learned_addr learned my addr 172.21.15.6:0/2325790194 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.825+0000 7f761136c700 1 --2- 172.21.15.6:0/2325790194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af6c253330 0x55af6c311690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.825+0000 7f760bfff700 1 --2- 172.21.15.6:0/2325790194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55af6c3148b0 0x55af6c32dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.825+0000 7f7611b6d700 1 -- 172.21.15.6:0/2325790194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55af6c3148b0 msgr2=0x55af6c32dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.825+0000 7f7611b6d700 1 --2- 172.21.15.6:0/2325790194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55af6c3148b0 0x55af6c32dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.825+0000 7f7611b6d700 1 -- 172.21.15.6:0/2325790194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af6c253330 msgr2=0x55af6c311690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.825+0000 7f7611b6d700 1 --2- 172.21.15.6:0/2325790194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af6c253330 0x55af6c311690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.825+0000 7f7611b6d700 1 -- 172.21.15.6:0/2325790194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7604005db0 con 0x55af6c314c80 2023-10-06T02:24:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.825+0000 7f760bfff700 1 --2- 172.21.15.6:0/2325790194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55af6c3148b0 0x55af6c32dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.825+0000 7f761136c700 1 --2- 172.21.15.6:0/2325790194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af6c253330 0x55af6c311690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.825+0000 7f7611b6d700 1 --2- 172.21.15.6:0/2325790194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af6c314c80 0x55af6c2988d0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f760c002920 tx=0x7f760c005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee6e86497ae5154 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.825+0000 7f760b7fe700 1 -- 172.21.15.6:0/2325790194 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c00d900 con 0x55af6c314c80 2023-10-06T02:24:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.825+0000 7f760b7fe700 1 -- 172.21.15.6:0/2325790194 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c00da60 con 0x55af6c314c80 2023-10-06T02:24:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.825+0000 7f760b7fe700 1 -- 172.21.15.6:0/2325790194 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c00de20 con 0x55af6c314c80 2023-10-06T02:24:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.826+0000 7f7618131000 1 -- 172.21.15.6:0/2325790194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af6c314c80 msgr2=0x55af6c2988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.826+0000 7f7618131000 1 --2- 172.21.15.6:0/2325790194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af6c314c80 0x55af6c2988d0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f760c002920 tx=0x7f760c005d40 comp rx=0 tx=0).stop 2023-10-06T02:24:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.826+0000 7f7618131000 1 -- 172.21.15.6:0/2325790194 shutdown_connections 2023-10-06T02:24:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.826+0000 7f7618131000 1 --2- 172.21.15.6:0/2325790194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af6c314c80 0x55af6c2988d0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.826+0000 7f7618131000 1 --2- 172.21.15.6:0/2325790194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af6c253330 0x55af6c311690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.826+0000 7f7618131000 1 --2- 172.21.15.6:0/2325790194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55af6c3148b0 0x55af6c32dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.826+0000 7f7618131000 1 -- 172.21.15.6:0/2325790194 >> 172.21.15.6:0/2325790194 conn(0x55af6c29bbd0 msgr2=0x55af6c32c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.826+0000 7f7618131000 1 -- 172.21.15.6:0/2325790194 shutdown_connections 2023-10-06T02:24:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.826+0000 7f7618131000 1 -- 172.21.15.6:0/2325790194 wait complete. 2023-10-06T02:24:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.826+0000 7f7618131000 1 Processor -- start 2023-10-06T02:24:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.826+0000 7f7618131000 1 -- start start 2023-10-06T02:24:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.827+0000 7f7618131000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af6c253330 0x55af6c313910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.827+0000 7f7618131000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af6c3148b0 0x55af6c30f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.827+0000 7f7618131000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55af6c314c80 0x55af6c32ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.827+0000 7f7618131000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af6c32a960 con 0x55af6c253330 2023-10-06T02:24:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.827+0000 7f7618131000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af6c32a6c0 con 0x55af6c3148b0 2023-10-06T02:24:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.827+0000 7f7618131000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af6c312f30 con 0x55af6c314c80 2023-10-06T02:24:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.827+0000 7f761136c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af6c253330 0x55af6c313910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.827+0000 7f761136c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af6c253330 0x55af6c313910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58672/0 (socket says 172.21.15.6:58672) 2023-10-06T02:24:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.827+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 learned_addr learned my addr 172.21.15.6:0/3497398039 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.827+0000 7f760bfff700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af6c3148b0 0x55af6c30f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.827+0000 7f7611b6d700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55af6c314c80 0x55af6c32ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.828+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55af6c314c80 msgr2=0x55af6c32ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.828+0000 7f761136c700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55af6c314c80 0x55af6c32ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.828+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af6c3148b0 msgr2=0x55af6c30f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.828+0000 7f761136c700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af6c3148b0 0x55af6c30f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.828+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c002600 con 0x55af6c253330 2023-10-06T02:24:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.828+0000 7f7611b6d700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55af6c314c80 0x55af6c32ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.828+0000 7f761136c700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af6c253330 0x55af6c313910 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f7604008fd0 tx=0x7f7604016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.828+0000 7f7609ffb700 1 -- 172.21.15.6:0/3497398039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604000bc0 con 0x55af6c253330 2023-10-06T02:24:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.828+0000 7f7609ffb700 1 -- 172.21.15.6:0/3497398039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7604022070 con 0x55af6c253330 2023-10-06T02:24:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.828+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55af6c1ae3d0 con 0x55af6c253330 2023-10-06T02:24:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.828+0000 7f7609ffb700 1 -- 172.21.15.6:0/3497398039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604000d20 con 0x55af6c253330 2023-10-06T02:24:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.828+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55af6c1a1ae0 con 0x55af6c253330 2023-10-06T02:24:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.829+0000 7f7609ffb700 1 -- 172.21.15.6:0/3497398039 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7604024030 con 0x55af6c253330 2023-10-06T02:24:54.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.830+0000 7f7609ffb700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f75f4065890 0x7f75f4067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.830+0000 7f7609ffb700 1 -- 172.21.15.6:0/3497398039 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7604085790 con 0x55af6c253330 2023-10-06T02:24:54.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.830+0000 7f760bfff700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f75f4065890 0x7f75f4067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.836 INFO:teuthology.orchestra.run.smithi006.stdout:���� 2023-10-06T02:24:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: �� 2023-10-06T02:24:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:54.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.830+0000 7f7618131000 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55af6c32f860 0x55af6c326770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.830+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:1 14.0 14:00000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x55af6c32f860 2023-10-06T02:24:54.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.830+0000 7f7611b6d700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55af6c32f860 0x55af6c326770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.830+0000 7f760bfff700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f75f4065890 0x7f75f4067d40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f75fc001ed0 tx=0x7f75fc001800 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.830+0000 7f7611b6d700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55af6c32f860 0x55af6c326770 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.831+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(1 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f760c018070 con 0x55af6c32f860 2023-10-06T02:24:54.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.831+0000 7f7611b6d700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7f760c012b70 0x7f760c01b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.831+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:08000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f760c012b70 2023-10-06T02:24:54.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.831+0000 7f761136c700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7f760c012b70 0x7f760c01b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.831+0000 7f761136c700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7f760c012b70 0x7f760c01b930 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.831+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(2 [pgnls start_epoch 96 out=177b] v95'10 uv10 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x7f7604054770 con 0x7f760c012b70 2023-10-06T02:24:54.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.831+0000 7f761136c700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7f7604030070 0x7f7604055330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.832+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:3 14.8 14:10000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f7604030070 2023-10-06T02:24:54.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.832+0000 7f760bfff700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7f7604030070 0x7f7604055330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.832+0000 7f760bfff700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7f7604030070 0x7f7604055330 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.832+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(3 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.832+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.18 14:18000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f760c012b70 2023-10-06T02:24:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.832+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(4 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7604054770 con 0x7f760c012b70 2023-10-06T02:24:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.833+0000 7f761136c700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7f7604007030 0x7f7604056d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.833+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:5 14.4 14:20000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f7604007030 2023-10-06T02:24:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.833+0000 7f7611b6d700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7f7604007030 0x7f7604056d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.833+0000 7f7611b6d700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7f7604007030 0x7f7604056d60 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.834+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(5 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f760c026040 con 0x7f7604007030 2023-10-06T02:24:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.834+0000 7f7611b6d700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7f760c02c040 0x7f760c02c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.834+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:6 14.14 14:28000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f760c02c040 2023-10-06T02:24:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.834+0000 7f761136c700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7f760c02c040 0x7f760c02c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.834+0000 7f761136c700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7f760c02c040 0x7f760c02c920 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.834+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(6 [pgnls start_epoch 96 out=149b] v95'18 uv18 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x7f7604054770 con 0x7f760c02c040 2023-10-06T02:24:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.834+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:7 14.c 14:30000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f7604030070 2023-10-06T02:24:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.835+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(7 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.835+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:8 14.1c 14:38000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f7604030070 2023-10-06T02:24:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.835+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(8 [pgnls start_epoch 96 out=73b] v94'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.835+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:9 14.2 14:40000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f7604007030 2023-10-06T02:24:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.835+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(9 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f760c026040 con 0x7f7604007030 2023-10-06T02:24:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.835+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:10 14.12 14:48000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x55af6c32f860 2023-10-06T02:24:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.836+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(10 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f760c026040 con 0x55af6c32f860 2023-10-06T02:24:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.836+0000 7f7611b6d700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7f760c0118e0 0x7f760c01a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.836+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:11 14.a 14:50000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f760c0118e0 2023-10-06T02:24:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.836+0000 7f760bfff700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7f760c0118e0 0x7f760c01a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.836+0000 7f760bfff700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7f760c0118e0 0x7f760c01a3b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.836+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(11 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75fc015040 con 0x7f760c0118e0 2023-10-06T02:24:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.837+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:12 14.1a 14:58000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f7604030070 2023-10-06T02:24:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.837+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(12 [pgnls start_epoch 96 out=49b] v94'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.837+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:13 14.6 14:60000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f7604030070 2023-10-06T02:24:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.837+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(13 [pgnls start_epoch 96 out=77b] v95'2 uv2 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.837+0000 7f760bfff700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7f75fc01c3c0 0x7f75fc01c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.837+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] -- osd_op(unknown.0.0:14 14.16 14:68000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f75fc01c3c0 2023-10-06T02:24:54.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.837+0000 7f7611b6d700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7f75fc01c3c0 0x7f75fc01c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.838+0000 7f7611b6d700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7f75fc01c3c0 0x7f75fc01c830 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.838+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.3 v2:172.21.15.6:6824/90683 1 ==== osd_op_reply(14 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f760c037040 con 0x7f75fc01c3c0 2023-10-06T02:24:54.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.838+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:15 14.e 14:70000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f760c02c040 2023-10-06T02:24:54.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.838+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(15 [pgnls start_epoch 96 out=73b] v94'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f7604054770 con 0x7f760c02c040 2023-10-06T02:24:54.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.838+0000 7f761136c700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7f7604056630 0x7f760406c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.838+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:16 14.1e 14:78000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f7604056630 2023-10-06T02:24:54.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.838+0000 7f761136c700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7f7604056630 0x7f760406c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.839+0000 7f761136c700 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7f7604056630 0x7f760406c9f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.839+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(16 [pgnls start_epoch 96 out=49b] v94'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7604054770 con 0x7f7604056630 2023-10-06T02:24:54.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.839+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] -- osd_op(unknown.0.0:17 14.1 14:80000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f75fc01c3c0 2023-10-06T02:24:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.839+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.3 v2:172.21.15.6:6824/90683 2 ==== osd_op_reply(17 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f760c037040 con 0x7f75fc01c3c0 2023-10-06T02:24:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.839+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:18 14.11 14:88000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f760c02c040 2023-10-06T02:24:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.840+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(18 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7604054770 con 0x7f760c02c040 2023-10-06T02:24:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.840+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:19 14.9 14:90000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f760c0118e0 2023-10-06T02:24:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.840+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(19 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75fc015040 con 0x7f760c0118e0 2023-10-06T02:24:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.840+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:20 14.19 14:98000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f7604007030 2023-10-06T02:24:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.840+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(20 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f760c037040 con 0x7f7604007030 2023-10-06T02:24:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.840+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:21 14.5 14:a0000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f7604030070 2023-10-06T02:24:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.841+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(21 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.841+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:22 14.15 14:a8000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f7604056630 2023-10-06T02:24:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.841+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(22 [pgnls start_epoch 96 out=97b] v94'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7f7604054770 con 0x7f7604056630 2023-10-06T02:24:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.841+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:23 14.d 14:b0000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f7604007030 2023-10-06T02:24:54.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.841+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(23 [pgnls start_epoch 96 out=74b] v94'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f760c037040 con 0x7f7604007030 2023-10-06T02:24:54.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.841+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:24 14.1d 14:b8000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f7604030070 2023-10-06T02:24:54.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.842+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(24 [pgnls start_epoch 96 out=73b] v94'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.842+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:25 14.3 14:c0000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f7604030070 2023-10-06T02:24:54.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.842+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(25 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.842+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:26 14.13 14:c8000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x55af6c32f860 2023-10-06T02:24:54.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.842+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(26 [pgnls start_epoch 96 out=98b] v95'3 uv3 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x7f760c037040 con 0x55af6c32f860 2023-10-06T02:24:54.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.842+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:27 14.b 14:d0000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f7604030070 2023-10-06T02:24:54.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.843+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(27 [pgnls start_epoch 96 out=76b] v95'3 uv3 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.843+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.1b 14:d8000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f760c012b70 2023-10-06T02:24:54.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.843+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(28 [pgnls start_epoch 96 out=49b] v94'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7604054770 con 0x7f760c012b70 2023-10-06T02:24:54.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.843+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:29 14.7 14:e0000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f760c0118e0 2023-10-06T02:24:54.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.843+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(29 [pgnls start_epoch 96 out=73b] v94'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f75fc015040 con 0x7f760c0118e0 2023-10-06T02:24:54.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.843+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.17 14:e8000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f760c012b70 2023-10-06T02:24:54.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.844+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(30 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7604054770 con 0x7f760c012b70 2023-10-06T02:24:54.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.844+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:31 14.f 14:f0000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f7604056630 2023-10-06T02:24:54.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.844+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(31 [pgnls start_epoch 96 out=73b] v94'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f7604054770 con 0x7f7604056630 2023-10-06T02:24:54.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.844+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:32 14.1f 14:f8000000:%01:::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c32a120 con 0x7f7604030070 2023-10-06T02:24:54.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.844+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(32 [pgnls start_epoch 96 out=101b] v95'6 uv6 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.844+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:33 14.10 14:09401a81:::601.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c326cb0 con 0x7f760c012b70 2023-10-06T02:24:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.844+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(33 601.00000000 [read 0~0] v0'0 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7604054770 con 0x7f760c012b70 2023-10-06T02:24:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.845+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:34 14.10 14:09401a81:::601.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c327060 con 0x7f760c012b70 2023-10-06T02:24:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.845+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(34 601.00000000 [getxattrs out=124b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+124 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.845+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:35 14.10 14:09401a81:::601.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c3279b0 con 0x7f760c012b70 2023-10-06T02:24:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.845+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(35 601.00000000 [omap-get-header out=274b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.845+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:36 14.10 14:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c327d60 con 0x7f760c012b70 2023-10-06T02:24:54.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.845+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(36 601.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.845+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:37 14.10 14:0bd6d154:::602.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c328160 con 0x7f760c012b70 2023-10-06T02:24:54.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.845+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(37 602.00000000 [read 0~0] v0'0 uv6 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.845+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:38 14.10 14:0bd6d154:::602.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c328590 con 0x7f760c012b70 2023-10-06T02:24:54.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.846+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(38 602.00000000 [getxattrs out=124b] v0'0 uv6 ondisk = 0) v8 ==== 156+0+124 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.846+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:39 14.10 14:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c012b70 2023-10-06T02:24:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.846+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(39 602.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.846+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:40 14.10 14:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349450 con 0x7f760c012b70 2023-10-06T02:24:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.846+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(40 602.00000000 [omap-get-vals out=5b] v0'0 uv6 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.846+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:41 14.10 14:0cf6ad0f:::10000000000.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c012b70 2023-10-06T02:24:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.846+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(41 10000000000.00000000 [read 0~0] v0'0 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.846+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:42 14.10 14:0cf6ad0f:::10000000000.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c012b70 2023-10-06T02:24:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.847+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(42 10000000000.00000000 [getxattrs out=124b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+124 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: ��*$- 601.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray1���� �� ((88���� �� ��*$- 602.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray2���� �� ((88���� �� ��2,510000000000.00000000�������������������!�������������������������� ���~_layout��������_parent>8subdir 2023-10-06T02:24:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.847+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:43 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c012b70 2023-10-06T02:24:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.847+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(43 10000000000.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.847+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:44 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349450 con 0x7f760c012b70 2023-10-06T02:24:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.847+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(44 10000000000.00000000 [omap-get-vals out=513b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+513 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.847+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:45 14.10 14:0d82a743:::600.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c012b70 2023-10-06T02:24:54.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.847+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(45 600.00000000 [read 0~0] v0'0 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.847+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:46 14.10 14:0d82a743:::600.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c012b70 2023-10-06T02:24:54.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.847+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(46 600.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+124 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.848+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:47 14.10 14:0d82a743:::600.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c012b70 2023-10-06T02:24:54.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.848+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(47 600.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.848+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:48 14.10 14:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349450 con 0x7f760c012b70 2023-10-06T02:24:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.848+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(48 600.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.848+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:49 14.10 14:0d89b25e:::603.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c012b70 2023-10-06T02:24:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.848+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(49 603.00000000 [read 0~0] v0'0 uv8 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.848+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:50 14.10 14:0d89b25e:::603.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c012b70 2023-10-06T02:24:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.848+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(50 603.00000000 [getxattrs out=124b] v0'0 uv8 ondisk = 0) v8 ==== 156+0+124 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.848+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:51 14.10 14:0d89b25e:::603.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c012b70 2023-10-06T02:24:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.849+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(51 603.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.849+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:52 14.10 14:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349450 con 0x7f760c012b70 2023-10-06T02:24:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.849+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(52 603.00000000 [omap-get-vals out=5b] v0'0 uv8 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7f760407c090 con 0x7f760c012b70 2023-10-06T02:24:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.849+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:53 14.14 14:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c02c040 2023-10-06T02:24:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.849+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(53 1.00000000.inode [read 0~554 out=554b] v0'0 uv15 ondisk = 0) v8 ==== 160+0+554 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.849+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:54 14.14 14:287034c4:::1.00000000.inode:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c02c040 2023-10-06T02:24:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.850+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(54 1.00000000.inode [getxattrs out=4b] v0'0 uv15 ondisk = 0) v8 ==== 160+0+4 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.868 INFO:teuthology.orchestra.run.smithi006.stdout:���� ��  (�oeZ��(�oeZ��8`�oeS�F8`�oeS�F���� �� sixmegs_head�i����oeS�F����@@`���������oeS�F�oeZ��(8`�oeS�F8`�oeS�F���������oeZ��0���������������� �� ��*$- 600.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray0���� �� ((88���� �� ��*$- 603.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray3���� �� ((88���� �� ��.(11.00000000.inode�������������������!�������������������������� ��D>**ceph fs volume v011 ��oe�.f�C@@���������oe�.f(�oe�.f8�oe�.f8�oe̶ :�oe̶ :����>8������������ �� 2023-10-06T02:24:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.850+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:55 14.14 14:287034c4:::1.00000000.inode:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c02c040 2023-10-06T02:24:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.850+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(55 1.00000000.inode [omap-get-header] v0'0 uv15 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.869 INFO:teuthology.orchestra.run.smithi006.stdout:���� �� 2023-10-06T02:24:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.850+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:56 14.14 14:287034c4:::1.00000000.inode:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349450 con 0x7f760c02c040 2023-10-06T02:24:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.850+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(56 1.00000000.inode [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 160+0+5 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.850+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:57 14.14 14:292cf221:::200.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c02c040 2023-10-06T02:24:54.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.850+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(57 200.00000000 [read 0~90 out=90b] v0'0 uv18 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.850+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:58 14.14 14:292cf221:::200.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c02c040 2023-10-06T02:24:54.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.851+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(58 200.00000000 [getxattrs out=4b] v0'0 uv18 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.871 INFO:teuthology.orchestra.run.smithi006.stdout:���� �� ��*$- 200.00000000�������������������!�������������������������� ��tnZZTceph fs volume v011@)/@)/@�6@@@���� �� 2023-10-06T02:24:54.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.851+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:59 14.14 14:292cf221:::200.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c02c040 2023-10-06T02:24:54.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.851+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(59 200.00000000 [omap-get-header] v0'0 uv18 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.872 INFO:teuthology.orchestra.run.smithi006.stdout:���� �� 2023-10-06T02:24:54.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.851+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:60 14.14 14:292cf221:::200.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349450 con 0x7f760c02c040 2023-10-06T02:24:54.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.851+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(60 200.00000000 [omap-get-vals out=5b] v0'0 uv18 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.851+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:61 14.14 14:2e2fa760:::200.00000001:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c02c040 2023-10-06T02:24:54.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.851+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(61 200.00000001 [read 0~14075 out=14075b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+14075 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.874 INFO:teuthology.orchestra.run.smithi006.stdout:���� �� ��*$- 200.00000001�������������������!�������������������������� ��77�6�6��XS&YA1h^T�oe�O-:2 ((88 2 ( 2023-10-06T02:24:54.874 INFO:teuthology.orchestra.run.smithi006.stdout:( 2023-10-06T02:24:54.874 INFO:teuthology.orchestra.run.smithi006.stdout:8 2023-10-06T02:24:54.874 INFO:teuthology.orchestra.run.smithi006.stdout:�oe�1&:8 2023-10-06T02:24:54.874 INFO:teuthology.orchestra.run.smithi006.stdout:�oe�1&: ��������@@��XS&YA1�� 2023-10-06T02:24:54.874 INFO:teuthology.orchestra.run.smithi006.stdout:��oe6��$  �v��C ceph_sha1(736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 ceph_version]ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable) entity_id0hostname smithi006 mount_point/home/ubuntu/cephtest/mnt.0pid122129root/�� ��|@��XS&YA1����oe��� setattr� '����������oeW�� �C@@���������oe̶ :(8�oeW�� 8�oe̶ :�oe̶ :����>8�������� ��������:@��XS&YA1����oe� nmkdirY' (�oe�.f(�oe�.f8�oe�.f8�oe�.f �subdir����������oe�.f�A�������������������oe�.f�oe�.f(88���������oe�.f������������2 ((88  '����������oe�.f�C@@���������oe�.f(�oe�.f8�oe�.f8�oe̶ :�oe̶ :����>8���������  ��������M@��XS&YA1}si�oeM�openc4' (�oe�.f(�oe�.f8�oeZ��8�oe�.f �subdir����������oeZ���A�������������������oeZ���oe�.f(�oeZ��8�oeZ��8�oeZ�����������oe�.f������������J (�oeZ��(�oeZ��8�oeZ��8�oeZ��$ sixmegs����������oeZ������@@���������oeZ���oeZ�� @(88���������oeZ��������������   ��������@��XS&YA1�xn�oer� 2023-10-06T02:24:54.874 INFO:teuthology.orchestra.run.smithi006.stdout:cap update4' (�oe�.f(�oe�.f8 �oe ��8�oe�.f �subdir����������oeZ���A�������������������oeZ���oe�.f(�oeZ��8 �oe ��8 �oe �����������oe�.f������������J (�oeZ��(�oeZ��8 �oe ��8 �oe ��$ sixmegs����������oe ������@@ ���������oe ���oeZ�� �(8 �oe ��8 �oe �����������oeZ���������������������� �@��XS&YA1�xn�oe�_� 2023-10-06T02:24:54.875 INFO:teuthology.orchestra.run.smithi006.stdout:cap update4'  (�oe�.f(�oe�.f8P�oeg��8�oe�.f �subdir����������oeZ���A�������������������oeZ���oe�.f(�oeZ��8P�oeg��8P�oeg�����������oe�.f������������J (�oeZ��(�oeZ��8P�oeg��8P�oeg��$ sixmegs����������oeg������@@P���������oeg���oeZ�� �(8P�oeg��8P�oeg�����������oeZ��'�������������������� *@��XS&YA1\RH�oet�I, 2023-10-06T02:24:54.875 INFO:teuthology.orchestra.run.smithi006.stdout:cap update'  (�oe�.f(�oe�.f8`�oeS�F8�oe�.f �subdir�������� 2023-10-06T02:24:54.875 INFO:teuthology.orchestra.run.smithi006.stdout:��oeZ���A�������������������oeZ���oe�.f(�oeZ��8`�oeS�F8`�oeS�F 2023-10-06T02:24:54.875 INFO:teuthology.orchestra.run.smithi006.stdout:���������oe�.f������������$  (�oeZ��(�oeZ��8`�oeS�F8`�oeS�F� �sixmegs����������oeS�F����@@`���������oeS�F�oeZ��(8`�oeS�F8`�oeS�F���������oeZ��0�������������������� �&@��XS&YA1�� 2023-10-06T02:24:54.875 INFO:teuthology.orchestra.run.smithi006.stdout:��oeQ_�,  �v�����0.@��XS&YA18.$��.@��XS&YA1h^T�oe7�l2  (�oe�.f(�oe�.f8`�oeS�F8�oe�.f 2 ( 2023-10-06T02:24:54.875 INFO:teuthology.orchestra.run.smithi006.stdout:( 2023-10-06T02:24:54.875 INFO:teuthology.orchestra.run.smithi006.stdout:8 2023-10-06T02:24:54.875 INFO:teuthology.orchestra.run.smithi006.stdout:�oe�1&:8 2023-10-06T02:24:54.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.851+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:62 14.14 14:2e2fa760:::200.00000001:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c02c040 2023-10-06T02:24:54.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.852+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(62 200.00000001 [getxattrs out=4b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.876 INFO:teuthology.orchestra.run.smithi006.stdout:�oe�1&: ��������@ )/@��XS&YA1B8.�oe���scatter_writebehind�2  (�oe�.f(�oe�.f8`�oeS�F8`�oeS�F  '����������oe�.f�C@@���������oe�.f(�oe�.f8`�oeS�F8�oe̶ :�oe̶ :����>8�����������������2@���� �� 2023-10-06T02:24:54.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.852+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.14 14:2e2fa760:::200.00000001:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c02c040 2023-10-06T02:24:54.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.852+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(63 200.00000001 [omap-get-header] v0'0 uv16 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.877 INFO:teuthology.orchestra.run.smithi006.stdout:���� �� 2023-10-06T02:24:54.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.852+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.14 14:2e2fa760:::200.00000001:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349450 con 0x7f760c02c040 2023-10-06T02:24:54.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.852+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(64 200.00000001 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.852+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.14 14:2f55791f:::606.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c02c040 2023-10-06T02:24:54.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.852+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(65 606.00000000 [read 0~0] v0'0 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.852+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.14 14:2f55791f:::606.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c02c040 2023-10-06T02:24:54.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.853+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(66 606.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+124 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.853+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.14 14:2f55791f:::606.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f760c02c040 2023-10-06T02:24:54.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.853+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(67 606.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.853+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.14 14:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349450 con 0x7f760c02c040 2023-10-06T02:24:54.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.853+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(68 606.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.853+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:69 14.1c 14:3ed09add:::607.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348440 con 0x7f7604030070 2023-10-06T02:24:54.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.854+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(69 607.00000000 [read 0~0] v0'0 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.854+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:70 14.1c 14:3ed09add:::607.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c3487f0 con 0x7f7604030070 2023-10-06T02:24:54.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.854+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(70 607.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+124 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.854+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:71 14.1c 14:3ed09add:::607.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348ba0 con 0x7f7604030070 2023-10-06T02:24:54.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.854+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(71 607.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.854+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:72 14.1c 14:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349f60 con 0x7f7604030070 2023-10-06T02:24:54.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.854+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(72 607.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.854+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:73 14.6 14:654134d2:::mds0_openfiles.0:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c348f50 con 0x7f7604030070 2023-10-06T02:24:54.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.855+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(73 mds0_openfiles.0 [read 0~0] v0'0 uv2 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.855+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:74 14.6 14:654134d2:::mds0_openfiles.0:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349350 con 0x7f7604030070 2023-10-06T02:24:54.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.855+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(74 mds0_openfiles.0 [getxattrs out=4b] v0'0 uv2 ondisk = 0) v8 ==== 160+0+4 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.884 INFO:teuthology.orchestra.run.smithi006.stdout:���� �� ��*$- 606.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray6���� �� ((88���� �� ��*$- 607.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray7���� �� ((88���� �� ��.(1mds0_openfiles.0�������������������!�������������������������� �� 2023-10-06T02:24:54.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.855+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:75 14.6 14:654134d2:::mds0_openfiles.0:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c3497a0 con 0x7f7604030070 2023-10-06T02:24:54.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.855+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(75 mds0_openfiles.0 [omap-get-header out=42b] v0'0 uv2 ondisk = 0) v8 ==== 160+0+42 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.855+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:76 14.6 14:654134d2:::mds0_openfiles.0:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c3497a0 con 0x7f7604030070 2023-10-06T02:24:54.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.855+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(76 mds0_openfiles.0 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 160+0+5 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.855+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:77 14.e 14:717a0223:::608.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349750 con 0x7f760c02c040 2023-10-06T02:24:54.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.856+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(77 608.00000000 [read 0~0] v0'0 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.856+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:78 14.e 14:717a0223:::608.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349750 con 0x7f760c02c040 2023-10-06T02:24:54.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.856+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(78 608.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+124 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.856+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:79 14.e 14:717a0223:::608.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349750 con 0x7f760c02c040 2023-10-06T02:24:54.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.856+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(79 608.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.856+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:80 14.e 14:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349750 con 0x7f760c02c040 2023-10-06T02:24:54.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.857+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(80 608.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7f760407c090 con 0x7f760c02c040 2023-10-06T02:24:54.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.857+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:81 14.15 14:a93a17c2:::604.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349750 con 0x7f7604056630 2023-10-06T02:24:54.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.857+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(81 604.00000000 [read 0~0] v0'0 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f760407c090 con 0x7f7604056630 2023-10-06T02:24:54.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.857+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:82 14.15 14:a93a17c2:::604.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349750 con 0x7f7604056630 2023-10-06T02:24:54.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.857+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(82 604.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+124 (crc 0 0 0) 0x7f760407c090 con 0x7f7604056630 2023-10-06T02:24:54.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.857+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:83 14.15 14:a93a17c2:::604.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349750 con 0x7f7604056630 2023-10-06T02:24:54.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.858+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(83 604.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x7f760407c090 con 0x7f7604056630 2023-10-06T02:24:54.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.858+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:84 14.15 14:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349750 con 0x7f7604056630 2023-10-06T02:24:54.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.858+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(84 604.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7f760407c090 con 0x7f7604056630 2023-10-06T02:24:54.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.858+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:85 14.15 14:aa448500:::500.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349750 con 0x7f7604056630 2023-10-06T02:24:54.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.859+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(85 500.00000000 [read 0~90 out=90b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x7f760407c090 con 0x7f7604056630 2023-10-06T02:24:54.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.859+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:86 14.15 14:aa448500:::500.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349750 con 0x7f7604056630 2023-10-06T02:24:54.891 INFO:teuthology.orchestra.run.smithi006.stdout:���� ��4.*ceph fs volume v011 ���� �� ��*$- 608.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray8���� �� ((88���� �� ��*$- 604.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray4���� �� ((88���� �� ��*$- 500.00000000�������������������!�������������������������� ��tnZZTceph fs volume v011@@@@@@���� �� 2023-10-06T02:24:54.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.859+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(86 500.00000000 [getxattrs out=4b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x7f760407c090 con 0x7f7604056630 2023-10-06T02:24:54.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.859+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:87 14.15 14:aa448500:::500.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349750 con 0x7f7604056630 2023-10-06T02:24:54.892 INFO:teuthology.orchestra.run.smithi006.stdout:���� �� 2023-10-06T02:24:54.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.859+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(87 500.00000000 [omap-get-header] v0'0 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f760407c090 con 0x7f7604056630 2023-10-06T02:24:54.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.859+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:88 14.15 14:aa448500:::500.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349750 con 0x7f7604056630 2023-10-06T02:24:54.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.860+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(88 500.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7f760407c090 con 0x7f7604056630 2023-10-06T02:24:54.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.860+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:89 14.d 14:b50e409b:::mds_snaptable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c349750 con 0x7f7604007030 2023-10-06T02:24:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.860+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(89 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x7f760c037040 con 0x7f7604007030 2023-10-06T02:24:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.860+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:90 14.d 14:b50e409b:::mds_snaptable:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34a310 con 0x7f7604007030 2023-10-06T02:24:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.860+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.6 v2:172.21.15.175:6813/90867 6 ==== osd_op_reply(90 mds_snaptable [getxattrs out=4b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+4 (crc 0 0 0) 0x7f760c037040 con 0x7f7604007030 2023-10-06T02:24:54.894 INFO:teuthology.orchestra.run.smithi006.stdout:���� �� ��+%. mds_snaptable�������������������!�������������������������� ��`ZFF4���� �� 2023-10-06T02:24:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.860+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:91 14.d 14:b50e409b:::mds_snaptable:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34a6c0 con 0x7f7604007030 2023-10-06T02:24:54.895 INFO:teuthology.orchestra.run.smithi006.stdout:���� �� 2023-10-06T02:24:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.861+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.6 v2:172.21.15.175:6813/90867 7 ==== osd_op_reply(91 mds_snaptable [omap-get-header] v0'0 uv1 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f760c037040 con 0x7f7604007030 2023-10-06T02:24:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.861+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:92 14.d 14:b50e409b:::mds_snaptable:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34ba80 con 0x7f7604007030 2023-10-06T02:24:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.861+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.6 v2:172.21.15.175:6813/90867 8 ==== osd_op_reply(92 mds_snaptable [omap-get-vals out=5b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+5 (crc 0 0 0) 0x7f760c037040 con 0x7f7604007030 2023-10-06T02:24:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.861+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:93 14.1d 14:b871830b:::605.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34aa70 con 0x7f7604030070 2023-10-06T02:24:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.862+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(93 605.00000000 [read 0~0] v0'0 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.862+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:94 14.1d 14:b871830b:::605.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34aa70 con 0x7f7604030070 2023-10-06T02:24:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.862+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(94 605.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+124 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.862+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:95 14.1d 14:b871830b:::605.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34aa70 con 0x7f7604030070 2023-10-06T02:24:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.862+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(95 605.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.862+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:96 14.1d 14:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34be30 con 0x7f7604030070 2023-10-06T02:24:54.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.862+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(96 605.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.862+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34be30 con 0x55af6c32f860 2023-10-06T02:24:54.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.863+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(97 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x7f760c037040 con 0x55af6c32f860 2023-10-06T02:24:54.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.863+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:c91d4a1d:::mds0_inotable:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34aa70 con 0x55af6c32f860 2023-10-06T02:24:54.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.863+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(98 mds0_inotable [getxattrs out=4b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+4 (crc 0 0 0) 0x7f760c037040 con 0x55af6c32f860 2023-10-06T02:24:54.900 INFO:teuthology.orchestra.run.smithi006.stdout:���� �� ��*$- 605.00000000�������������������!�������������������������� ���~_layout��������_parent>8stray5���� �� ((88���� �� ��+%. mds0_inotable�������������������!�������������������������� ��<6""��������� �� 2023-10-06T02:24:54.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.863+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:c91d4a1d:::mds0_inotable:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34aee0 con 0x55af6c32f860 2023-10-06T02:24:54.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.863+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(99 mds0_inotable [omap-get-header] v0'0 uv3 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f760c037040 con 0x55af6c32f860 2023-10-06T02:24:54.901 INFO:teuthology.orchestra.run.smithi006.stdout:���� �� 2023-10-06T02:24:54.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.863+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:c91d4a1d:::mds0_inotable:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b310 con 0x55af6c32f860 2023-10-06T02:24:54.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.863+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(100 mds0_inotable [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+5 (crc 0 0 0) 0x7f760c037040 con 0x55af6c32f860 2023-10-06T02:24:54.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.863+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:101 14.13 14:cd5a64a3:::100.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b310 con 0x55af6c32f860 2023-10-06T02:24:54.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.864+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(101 100.00000000 [read 0~0] v0'0 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f760c037040 con 0x55af6c32f860 2023-10-06T02:24:54.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.864+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:102 14.13 14:cd5a64a3:::100.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b310 con 0x55af6c32f860 2023-10-06T02:24:54.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.864+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(102 100.00000000 [getxattrs out=4b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x7f760c037040 con 0x55af6c32f860 2023-10-06T02:24:54.903 INFO:teuthology.orchestra.run.smithi006.stdout:���� �� ��*$- 100.00000000�������������������!�������������������������� �� 2023-10-06T02:24:54.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.864+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:103 14.13 14:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b310 con 0x55af6c32f860 2023-10-06T02:24:54.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.864+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(103 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x7f760c037040 con 0x55af6c32f860 2023-10-06T02:24:54.904 INFO:teuthology.orchestra.run.smithi006.stdout:���� �� ( 2023-10-06T02:24:54.904 INFO:teuthology.orchestra.run.smithi006.stdout:( 2023-10-06T02:24:54.904 INFO:teuthology.orchestra.run.smithi006.stdout:8 2023-10-06T02:24:54.904 INFO:teuthology.orchestra.run.smithi006.stdout:�oe�1&:8 2023-10-06T02:24:54.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.864+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:104 14.13 14:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x55af6c32f860 2023-10-06T02:24:54.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.864+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 <== osd.2 v2:172.21.15.6:6808/90680 11 ==== osd_op_reply(104 100.00000000 [omap-get-vals out=5075b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+5075 (crc 0 0 0) 0x7f760c037040 con 0x55af6c32f860 2023-10-06T02:24:54.905 INFO:teuthology.orchestra.run.smithi006.stdout:�oe�1&:���� ���� 2023-10-06T02:24:54.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.864+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:105 14.b 14:d0630e4c:::mds0_sessionmap:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f7604030070 2023-10-06T02:24:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.865+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(105 mds0_sessionmap [read 0~0] v0'0 uv3 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.865+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:106 14.b 14:d0630e4c:::mds0_sessionmap:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f7604030070 2023-10-06T02:24:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: stray0_head�i����oe�::@A�����������������oe�::(8�oe�::8�oe�::�oe�::������������ stray1_head�i����oe�<:@A�����������������oe�<:(8�oe�<:8�oe�<:�oe�<:������������ stray2_head�i����oeg�:@A�����������������oeg�:(8�oeg�:8�oeg�:�oeg�:������������ stray3_head�i����oe�,:@A�����������������oe�,:(8�oe�,:8�oe�,:�oe�,:������������ stray4_head�i����oe�[:@A�����������������oe�[:(8�oe�[:8�oe�[:�oe�[:������������ stray5_head�i����oe��:@A�����������������oe��:(8�oe��:8�oe��:�oe��:������������ stray6_head�i����oe� :@A�����������������oe� :(8�oe� :8�oe� :�oe� :������������ stray7_head�i����oe}�!:@A�����������������oe}�!:(8�oe}�!:8�oe}�!:�oe}�!:������������ stray8_head�i����oe:W#:@A�����������������oe:W#:(8�oe:W#:8�oe:W#:�oe:W#:������������ stray9_head�i��� �oe�1&:@A�����������������oe�1&:(8�oe�1&:8�oe�1&:�oe�1&:���������������� �� ��-'0mds0_sessionmap�������������������!�������������������������� �� 2023-10-06T02:24:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.865+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(106 mds0_sessionmap [getxattrs out=4b] v0'0 uv3 ondisk = 0) v8 ==== 159+0+4 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.865+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:107 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f7604030070 2023-10-06T02:24:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.865+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(107 mds0_sessionmap [omap-get-header out=14b] v0'0 uv3 ondisk = 0) v8 ==== 159+0+14 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.865+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:108 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f7604030070 2023-10-06T02:24:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.866+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(108 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 159+0+5 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.866+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f760c0118e0 2023-10-06T02:24:54.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.866+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(109 609.00000000 [read 0~0] v0'0 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f75fc015040 con 0x7f760c0118e0 2023-10-06T02:24:54.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.866+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f760c0118e0 2023-10-06T02:24:54.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.866+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(110 609.00000000 [getxattrs out=124b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+124 (crc 0 0 0) 0x7f75fc015040 con 0x7f760c0118e0 2023-10-06T02:24:54.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.866+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:111 14.7 14:e0b41d06:::609.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f760c0118e0 2023-10-06T02:24:54.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.866+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(111 609.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x7f75fc015040 con 0x7f760c0118e0 2023-10-06T02:24:54.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.867+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:112 14.7 14:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f760c0118e0 2023-10-06T02:24:54.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.867+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.5 v2:172.21.15.175:6800/90866 7 ==== osd_op_reply(112 609.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7f75fc015040 con 0x7f760c0118e0 2023-10-06T02:24:54.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.867+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f7604056630 2023-10-06T02:24:54.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.867+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(113 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x7f760407c090 con 0x7f7604056630 2023-10-06T02:24:54.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.867+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f7604056630 2023-10-06T02:24:54.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.868+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(114 400.00000000 [getxattrs out=4b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x7f760407c090 con 0x7f7604056630 2023-10-06T02:24:54.913 INFO:teuthology.orchestra.run.smithi006.stdout:���� ������ �� ��*$- 609.00000000�������������������!�������������������������� ���~_layout��������_parent>8 stray9���� �� ((88���� �� ��*$- 400.00000000�������������������!�������������������������� ��0*���� �� 2023-10-06T02:24:54.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.868+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f7604056630 2023-10-06T02:24:54.914 INFO:teuthology.orchestra.run.smithi006.stdout:���� �� 2023-10-06T02:24:54.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.868+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(115 400.00000000 [omap-get-header] v0'0 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f760407c090 con 0x7f7604056630 2023-10-06T02:24:54.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.868+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:116 14.f 14:f1f69726:::400.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f7604056630 2023-10-06T02:24:54.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.868+0000 7f761136c700 1 -- 172.21.15.6:0/3497398039 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(116 400.00000000 [omap-get-vals out=5b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7f760407c090 con 0x7f7604056630 2023-10-06T02:24:54.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.868+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f7604030070 2023-10-06T02:24:54.915 INFO:teuthology.orchestra.run.smithi006.stdout:���� �� ��0*3100.00000000.inode�������������������!�������������������������� ��D>**ceph fs volume v011 ��oe��:@A�����������������oe��:( 2023-10-06T02:24:54.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.869+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(117 100.00000000.inode [read 0~554 out=554b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+554 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.869+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f7604030070 2023-10-06T02:24:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.869+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(118 100.00000000.inode [getxattrs out=4b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+4 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.916 INFO:teuthology.orchestra.run.smithi006.stdout:8 �oe�1&:8 �oe�1&:�oe��:����>8������������ �� 2023-10-06T02:24:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.869+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f7604030070 2023-10-06T02:24:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.869+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(119 100.00000000.inode [omap-get-header] v0'0 uv3 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.917 INFO:teuthology.orchestra.run.smithi006.stdout:���� �� 2023-10-06T02:24:54.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.869+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f7604030070 2023-10-06T02:24:54.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.869+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(120 100.00000000.inode [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+5 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.917 INFO:teuthology.orchestra.run.smithi006.stdout:���� �� ��("+ 2023-10-06T02:24:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.870+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f7604030070 2023-10-06T02:24:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.870+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(121 1.00000000 [read 0~0] v0'0 uv6 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.870+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f7604030070 2023-10-06T02:24:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.870+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(122 1.00000000 [getxattrs out=92b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+92 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.870+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f7604030070 2023-10-06T02:24:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.870+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 33 ==== osd_op_reply(123 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.870+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55af6c34b290 con 0x7f7604030070 2023-10-06T02:24:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.870+0000 7f760bfff700 1 -- 172.21.15.6:0/3497398039 <== osd.0 v2:172.21.15.6:6816/90679 34 ==== osd_op_reply(124 1.00000000 [omap-get-vals out=512b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+512 (crc 0 0 0) 0x7f75fc015040 con 0x7f7604030070 2023-10-06T02:24:54.920 INFO:teuthology.orchestra.run.smithi006.stdout:1.00000000�������������������!�������������������������� ��d^_layout@@_parent���� ��  (�oe�.f(�oe�.f8`�oeS�F8�oe�.f���� ��� subdir_head�i����oeZ���A�������������������oeZ���oe�.f(�oeZ��8`�oeS�F8`�oeS�F 2023-10-06T02:24:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7f7604030070 msgr2=0x7f7604055330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7f7604030070 0x7f7604055330 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7f760c012b70 msgr2=0x7f760c01b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7f760c012b70 0x7f760c01b930 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55af6c32f860 msgr2=0x55af6c326770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55af6c32f860 0x55af6c326770 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7f75fc01c3c0 msgr2=0x7f75fc01c830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7f75fc01c3c0 0x7f75fc01c830 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7f760c02c040 msgr2=0x7f760c02c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 reap_dead start 2023-10-06T02:24:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7f760c02c040 0x7f760c02c920 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 reap_dead start 2023-10-06T02:24:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7f760c0118e0 msgr2=0x7f760c01a3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7f760c0118e0 0x7f760c01a3b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7f7604007030 msgr2=0x7f7604056d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7f7604007030 0x7f7604056d60 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7f7604056630 msgr2=0x7f760406c9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7f7604056630 0x7f760406c9f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f75f4065890 msgr2=0x7f75f4067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f75f4065890 0x7f75f4067d40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f75fc001ed0 tx=0x7f75fc001800 comp rx=0 tx=0).stop 2023-10-06T02:24:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af6c253330 msgr2=0x55af6c313910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 --2- 172.21.15.6:0/3497398039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af6c253330 0x55af6c313910 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f7604008fd0 tx=0x7f7604016000 comp rx=0 tx=0).stop 2023-10-06T02:24:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7611b6d700 1 -- 172.21.15.6:0/3497398039 reap_dead start 2023-10-06T02:24:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 shutdown_connections 2023-10-06T02:24:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 >> 172.21.15.6:0/3497398039 conn(0x55af6c29bbd0 msgr2=0x55af6c310300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 shutdown_connections 2023-10-06T02:24:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.871+0000 7f7618131000 1 -- 172.21.15.6:0/3497398039 wait complete. 2023-10-06T02:24:54.924 INFO:teuthology.orchestra.run.smithi006.stdout:���������oe�.f���������������� �� �� 2023-10-06T02:24:54.925 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2023-10-06T02:24:54.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.997+0000 7faf84432000 1 Processor -- start 2023-10-06T02:24:54.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.997+0000 7faf84432000 1 -- start start 2023-10-06T02:24:55.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf84432000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558994a224c0 0x558994ac2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf84432000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558994a262f0 0x5589949f8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf84432000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558994a3fba0 0x558994a204c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf84432000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558994941980 con 0x558994a224c0 2023-10-06T02:24:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf84432000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558994941620 con 0x558994a3fba0 2023-10-06T02:24:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf84432000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x558994938400 con 0x558994a262f0 2023-10-06T02:24:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf7d66d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558994a224c0 0x558994ac2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf7d66d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558994a224c0 0x558994ac2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58688/0 (socket says 172.21.15.6:58688) 2023-10-06T02:24:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf7d66d700 1 -- 172.21.15.6:0/3031174459 learned_addr learned my addr 172.21.15.6:0/3031174459 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf7de6e700 1 --2- 172.21.15.6:0/3031174459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558994a3fba0 0x558994a204c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf7ce6c700 1 --2- 172.21.15.6:0/3031174459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558994a262f0 0x5589949f8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf7d66d700 1 -- 172.21.15.6:0/3031174459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558994a262f0 msgr2=0x5589949f8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf7d66d700 1 --2- 172.21.15.6:0/3031174459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558994a262f0 0x5589949f8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf7d66d700 1 -- 172.21.15.6:0/3031174459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558994a3fba0 msgr2=0x558994a204c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf7d66d700 1 --2- 172.21.15.6:0/3031174459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558994a3fba0 0x558994a204c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf7d66d700 1 -- 172.21.15.6:0/3031174459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf74005db0 con 0x558994a224c0 2023-10-06T02:24:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf7ce6c700 1 --2- 172.21.15.6:0/3031174459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558994a262f0 0x5589949f8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.998+0000 7faf7d66d700 1 --2- 172.21.15.6:0/3031174459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558994a224c0 0x558994ac2580 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x5589949fa490 tx=0x7faf74016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b135ecc9d1c59a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.999+0000 7faf6f7fe700 1 -- 172.21.15.6:0/3031174459 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf740054f0 con 0x558994a224c0 2023-10-06T02:24:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.999+0000 7faf6f7fe700 1 -- 172.21.15.6:0/3031174459 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf74000bc0 con 0x558994a224c0 2023-10-06T02:24:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.999+0000 7faf6f7fe700 1 -- 172.21.15.6:0/3031174459 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74008c20 con 0x558994a224c0 2023-10-06T02:24:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.999+0000 7faf84432000 1 -- 172.21.15.6:0/3031174459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558994a224c0 msgr2=0x558994ac2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.999+0000 7faf84432000 1 --2- 172.21.15.6:0/3031174459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558994a224c0 0x558994ac2580 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x5589949fa490 tx=0x7faf74016000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.999+0000 7faf84432000 1 -- 172.21.15.6:0/3031174459 shutdown_connections 2023-10-06T02:24:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.999+0000 7faf84432000 1 --2- 172.21.15.6:0/3031174459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558994a3fba0 0x558994a204c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.999+0000 7faf84432000 1 --2- 172.21.15.6:0/3031174459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558994a224c0 0x558994ac2580 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.999+0000 7faf84432000 1 --2- 172.21.15.6:0/3031174459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558994a262f0 0x5589949f8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.999+0000 7faf84432000 1 -- 172.21.15.6:0/3031174459 >> 172.21.15.6:0/3031174459 conn(0x5589949f6d30 msgr2=0x558994ac55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.999+0000 7faf84432000 1 -- 172.21.15.6:0/3031174459 shutdown_connections 2023-10-06T02:24:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:54.999+0000 7faf84432000 1 -- 172.21.15.6:0/3031174459 wait complete. 2023-10-06T02:24:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.000+0000 7faf84432000 1 Processor -- start 2023-10-06T02:24:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.000+0000 7faf84432000 1 -- start start 2023-10-06T02:24:55.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.000+0000 7faf84432000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558994a224c0 0x558994ac07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.000+0000 7faf84432000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558994a262f0 0x558994a204c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.000+0000 7faf84432000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558994a3fba0 0x558994a20a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.000+0000 7faf84432000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558994abbb50 con 0x558994a262f0 2023-10-06T02:24:55.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.000+0000 7faf84432000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558994ac1900 con 0x558994a224c0 2023-10-06T02:24:55.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.000+0000 7faf84432000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x558994ac1120 con 0x558994a3fba0 2023-10-06T02:24:55.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.001+0000 7faf7ce6c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558994a262f0 0x558994a204c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.001+0000 7faf7ce6c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558994a262f0 0x558994a204c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58696/0 (socket says 172.21.15.6:58696) 2023-10-06T02:24:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.001+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 learned_addr learned my addr 172.21.15.6:0/3553627320 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.001+0000 7faf7de6e700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558994a3fba0 0x558994a20a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.001+0000 7faf7d66d700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558994a224c0 0x558994ac07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.001+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558994a3fba0 msgr2=0x558994a20a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.001+0000 7faf7ce6c700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558994a3fba0 0x558994a20a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.001+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558994a224c0 msgr2=0x558994ac07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.001+0000 7faf7ce6c700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558994a224c0 0x558994ac07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.001+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55899496a1c0 con 0x558994a262f0 2023-10-06T02:24:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.001+0000 7faf7ce6c700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558994a262f0 0x558994a204c0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7faf7000a2a0 tx=0x7faf70001960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.001+0000 7faf6dffb700 1 -- 172.21.15.6:0/3553627320 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7000ade0 con 0x558994a262f0 2023-10-06T02:24:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.001+0000 7faf6dffb700 1 -- 172.21.15.6:0/3553627320 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7000f420 con 0x558994a262f0 2023-10-06T02:24:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.001+0000 7faf6dffb700 1 -- 172.21.15.6:0/3553627320 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7000f7c0 con 0x558994a262f0 2023-10-06T02:24:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.001+0000 7faf84432000 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5589949503d0 con 0x558994a262f0 2023-10-06T02:24:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.001+0000 7faf84432000 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558994943ae0 con 0x558994a262f0 2023-10-06T02:24:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.003+0000 7faf6dffb700 1 -- 172.21.15.6:0/3553627320 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf7000fbb0 con 0x558994a262f0 2023-10-06T02:24:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.003+0000 7faf6dffb700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faf600658c0 0x7faf60067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.003+0000 7faf6dffb700 1 -- 172.21.15.6:0/3553627320 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7faf70008040 con 0x558994a262f0 2023-10-06T02:24:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.003+0000 7faf7d66d700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faf600658c0 0x7faf60067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.003+0000 7faf84432000 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x558994a24ec0 0x558994ae9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.003+0000 7faf84432000 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:1 14.0 14:00000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x558994a24ec0 2023-10-06T02:24:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.003+0000 7faf7de6e700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x558994a24ec0 0x558994ae9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.004+0000 7faf7d66d700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faf600658c0 0x7faf60067d70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x5589949fa490 tx=0x7faf7401d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.004+0000 7faf7de6e700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x558994a24ec0 0x558994ae9680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.004+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(1 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf78014420 con 0x558994a24ec0 2023-10-06T02:24:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.004+0000 7faf7de6e700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7faf78014b60 0x7faf780138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.004+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:08000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf78014b60 2023-10-06T02:24:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.004+0000 7faf7d66d700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7faf78014b60 0x7faf780138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.005+0000 7faf7d66d700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7faf78014b60 0x7faf780138c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.005+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(2 [pgnls start_epoch 96 out=177b] v95'10 uv10 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x7faf7400a040 con 0x7faf78014b60 2023-10-06T02:24:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.005+0000 7faf7d66d700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7faf7401c040 0x7faf74009940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.005+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:3 14.8 14:10000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf7401c040 2023-10-06T02:24:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.005+0000 7faf7ce6c700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7faf7401c040 0x7faf74009940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.005+0000 7faf7ce6c700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7faf7401c040 0x7faf74009940 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.006+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(3 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf7000b040 con 0x7faf7401c040 2023-10-06T02:24:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.006+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.18 14:18000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf78014b60 2023-10-06T02:24:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.006+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(4 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf7400a040 con 0x7faf78014b60 2023-10-06T02:24:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.006+0000 7faf7d66d700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7faf74007030 0x7faf74034930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.006+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:5 14.4 14:20000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf74007030 2023-10-06T02:24:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.006+0000 7faf7de6e700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7faf74007030 0x7faf74034930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.007+0000 7faf7de6e700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7faf74007030 0x7faf74034930 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.007+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(5 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf78014420 con 0x7faf74007030 2023-10-06T02:24:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.007+0000 7faf7de6e700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7faf78020320 0x7faf78020770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.007+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:6 14.14 14:28000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf78020320 2023-10-06T02:24:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.007+0000 7faf7d66d700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7faf78020320 0x7faf78020770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.008+0000 7faf7d66d700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7faf78020320 0x7faf78020770 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.008+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(6 [pgnls start_epoch 96 out=149b] v95'18 uv18 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x7faf7400a040 con 0x7faf78020320 2023-10-06T02:24:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.008+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:7 14.c 14:30000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf7401c040 2023-10-06T02:24:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.008+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(7 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf7000b040 con 0x7faf7401c040 2023-10-06T02:24:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.008+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:8 14.1c 14:38000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf7401c040 2023-10-06T02:24:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.008+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(8 [pgnls start_epoch 96 out=73b] v94'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7faf7000b040 con 0x7faf7401c040 2023-10-06T02:24:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.008+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:9 14.2 14:40000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf74007030 2023-10-06T02:24:55.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.009+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(9 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf78014420 con 0x7faf74007030 2023-10-06T02:24:55.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.009+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:10 14.12 14:48000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x558994a24ec0 2023-10-06T02:24:55.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.009+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(10 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf78014420 con 0x558994a24ec0 2023-10-06T02:24:55.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.009+0000 7faf7de6e700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7faf78012850 0x7faf780102c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.009+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:11 14.a 14:50000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf78012850 2023-10-06T02:24:55.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.009+0000 7faf7ce6c700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7faf78012850 0x7faf780102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.010+0000 7faf7ce6c700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7faf78012850 0x7faf780102c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.010+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(11 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf7000b040 con 0x7faf78012850 2023-10-06T02:24:55.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.010+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:12 14.1a 14:58000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf7401c040 2023-10-06T02:24:55.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.010+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(12 [pgnls start_epoch 96 out=49b] v94'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf7000b040 con 0x7faf7401c040 2023-10-06T02:24:55.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.010+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:13 14.6 14:60000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf7401c040 2023-10-06T02:24:55.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.010+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(13 [pgnls start_epoch 96 out=77b] v95'2 uv2 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x7faf7000b040 con 0x7faf7401c040 2023-10-06T02:24:55.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.010+0000 7faf7ce6c700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7faf70054340 0x7faf70053040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.010+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] -- osd_op(unknown.0.0:14 14.16 14:68000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf70054340 2023-10-06T02:24:55.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.011+0000 7faf7de6e700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7faf70054340 0x7faf70053040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.011+0000 7faf7de6e700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7faf70054340 0x7faf70053040 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.011+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 <== osd.3 v2:172.21.15.6:6824/90683 1 ==== osd_op_reply(14 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf78014420 con 0x7faf70054340 2023-10-06T02:24:55.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.011+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:15 14.e 14:70000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf78020320 2023-10-06T02:24:55.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.012+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(15 [pgnls start_epoch 96 out=73b] v94'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7faf7400a040 con 0x7faf78020320 2023-10-06T02:24:55.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.012+0000 7faf7d66d700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7faf74027460 0x7faf74027890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.012+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:16 14.1e 14:78000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf74027460 2023-10-06T02:24:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.012+0000 7faf7d66d700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7faf74027460 0x7faf74027890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.012+0000 7faf7d66d700 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7faf74027460 0x7faf74027890 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.013+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(16 [pgnls start_epoch 96 out=49b] v94'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf7400a040 con 0x7faf74027460 2023-10-06T02:24:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.013+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] -- osd_op(unknown.0.0:17 14.1 14:80000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf70054340 2023-10-06T02:24:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.013+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 <== osd.3 v2:172.21.15.6:6824/90683 2 ==== osd_op_reply(17 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf78014420 con 0x7faf70054340 2023-10-06T02:24:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.013+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:18 14.11 14:88000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf78020320 2023-10-06T02:24:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.013+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(18 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf7400a040 con 0x7faf78020320 2023-10-06T02:24:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.013+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:19 14.9 14:90000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf78012850 2023-10-06T02:24:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.014+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(19 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf70081040 con 0x7faf78012850 2023-10-06T02:24:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.014+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:20 14.19 14:98000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf74007030 2023-10-06T02:24:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.014+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(20 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf78014420 con 0x7faf74007030 2023-10-06T02:24:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.014+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:21 14.5 14:a0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf7401c040 2023-10-06T02:24:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.014+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(21 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf70081040 con 0x7faf7401c040 2023-10-06T02:24:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.014+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:22 14.15 14:a8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf74027460 2023-10-06T02:24:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.015+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(22 [pgnls start_epoch 96 out=97b] v94'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7faf7400a040 con 0x7faf74027460 2023-10-06T02:24:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.015+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:23 14.d 14:b0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf74007030 2023-10-06T02:24:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.015+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(23 [pgnls start_epoch 96 out=74b] v94'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7faf78014420 con 0x7faf74007030 2023-10-06T02:24:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.015+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:24 14.1d 14:b8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf7401c040 2023-10-06T02:24:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.015+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(24 [pgnls start_epoch 96 out=73b] v94'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7faf70081040 con 0x7faf7401c040 2023-10-06T02:24:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.015+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:25 14.3 14:c0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf7401c040 2023-10-06T02:24:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.015+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(25 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf70081040 con 0x7faf7401c040 2023-10-06T02:24:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.015+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:26 14.13 14:c8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x558994a24ec0 2023-10-06T02:24:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.016+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(26 [pgnls start_epoch 96 out=98b] v95'3 uv3 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x7faf78038070 con 0x558994a24ec0 2023-10-06T02:24:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.016+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:27 14.b 14:d0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf7401c040 2023-10-06T02:24:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.016+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(27 [pgnls start_epoch 96 out=76b] v95'3 uv3 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x7faf70081040 con 0x7faf7401c040 2023-10-06T02:24:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.016+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.1b 14:d8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf78014b60 2023-10-06T02:24:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.016+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(28 [pgnls start_epoch 96 out=49b] v94'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf7400a040 con 0x7faf78014b60 2023-10-06T02:24:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.016+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:29 14.7 14:e0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf78012850 2023-10-06T02:24:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.017+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(29 [pgnls start_epoch 96 out=73b] v94'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7faf70081040 con 0x7faf78012850 2023-10-06T02:24:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.017+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.17 14:e8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf78014b60 2023-10-06T02:24:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.017+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(30 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf7400a040 con 0x7faf78014b60 2023-10-06T02:24:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.017+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:31 14.f 14:f0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf74027460 2023-10-06T02:24:55.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.017+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(31 [pgnls start_epoch 96 out=73b] v94'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7faf7400a040 con 0x7faf74027460 2023-10-06T02:24:55.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.017+0000 7faf7d66d700 1 -- 172.21.15.6:0/3553627320 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:32 14.1f 14:f8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v8 -- 0x558994ae9bc0 con 0x7faf7401c040 2023-10-06T02:24:55.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf7ce6c700 1 -- 172.21.15.6:0/3553627320 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(32 [pgnls start_epoch 96 out=101b] v95'6 uv6 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x7faf70081040 con 0x7faf7401c040 2023-10-06T02:24:55.031 INFO:teuthology.orchestra.run.smithi006.stdout:601.00000000 2023-10-06T02:24:55.031 INFO:teuthology.orchestra.run.smithi006.stdout:602.00000000 2023-10-06T02:24:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:10000000000.00000000 2023-10-06T02:24:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:600.00000000 2023-10-06T02:24:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:603.00000000 2023-10-06T02:24:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:1.00000000.inode 2023-10-06T02:24:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:200.00000000 2023-10-06T02:24:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:200.00000001 2023-10-06T02:24:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:606.00000000 2023-10-06T02:24:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:607.00000000 2023-10-06T02:24:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:mds0_openfiles.0 2023-10-06T02:24:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:608.00000000 2023-10-06T02:24:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:604.00000000 2023-10-06T02:24:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:500.00000000 2023-10-06T02:24:55.033 INFO:teuthology.orchestra.run.smithi006.stdout:mds_snaptable 2023-10-06T02:24:55.033 INFO:teuthology.orchestra.run.smithi006.stdout:605.00000000 2023-10-06T02:24:55.033 INFO:teuthology.orchestra.run.smithi006.stdout:mds0_inotable 2023-10-06T02:24:55.033 INFO:teuthology.orchestra.run.smithi006.stdout:100.00000000 2023-10-06T02:24:55.033 INFO:teuthology.orchestra.run.smithi006.stdout:mds0_sessionmap 2023-10-06T02:24:55.033 INFO:teuthology.orchestra.run.smithi006.stdout:609.00000000 2023-10-06T02:24:55.033 INFO:teuthology.orchestra.run.smithi006.stdout:400.00000000 2023-10-06T02:24:55.033 INFO:teuthology.orchestra.run.smithi006.stdout:100.00000000.inode 2023-10-06T02:24:55.033 INFO:teuthology.orchestra.run.smithi006.stdout:1.00000000 2023-10-06T02:24:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 -- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7faf7401c040 msgr2=0x7faf74009940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7faf7401c040 0x7faf74009940 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 -- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7faf78014b60 msgr2=0x7faf780138c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7faf78014b60 0x7faf780138c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 -- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x558994a24ec0 msgr2=0x558994ae9680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x558994a24ec0 0x558994ae9680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 -- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7faf70054340 msgr2=0x7faf70053040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7faf70054340 0x7faf70053040 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 -- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7faf78020320 msgr2=0x7faf78020770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7faf78020320 0x7faf78020770 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 reap_dead start 2023-10-06T02:24:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 -- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7faf78012850 msgr2=0x7faf780102c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7faf78012850 0x7faf780102c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 reap_dead start 2023-10-06T02:24:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 -- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7faf74007030 msgr2=0x7faf74034930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7faf74007030 0x7faf74034930 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 -- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7faf74027460 msgr2=0x7faf74027890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7faf74027460 0x7faf74027890 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf7de6e700 1 -- 172.21.15.6:0/3553627320 reap_dead start 2023-10-06T02:24:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 -- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faf600658c0 msgr2=0x7faf60067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faf600658c0 0x7faf60067d70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x5589949fa490 tx=0x7faf7401d000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 -- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558994a262f0 msgr2=0x558994a204c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558994a262f0 0x558994a204c0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7faf7000a2a0 tx=0x7faf70001960 comp rx=0 tx=0).stop 2023-10-06T02:24:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 -- 172.21.15.6:0/3553627320 shutdown_connections 2023-10-06T02:24:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558994a262f0 0x558994a204c0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 --2- 172.21.15.6:0/3553627320 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faf600658c0 0x7faf60067d70 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 -- 172.21.15.6:0/3553627320 >> 172.21.15.6:0/3553627320 conn(0x5589949f6d30 msgr2=0x558994ac55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 -- 172.21.15.6:0/3553627320 shutdown_connections 2023-10-06T02:24:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.018+0000 7faf84432000 1 -- 172.21.15.6:0/3553627320 wait complete. 2023-10-06T02:24:55.039 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 10000000000.00000000 2023-10-06T02:24:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.112+0000 7f34f0fe3000 1 Processor -- start 2023-10-06T02:24:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.112+0000 7f34f0fe3000 1 -- start start 2023-10-06T02:24:55.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.113+0000 7f34f0fe3000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56024e312850 0x56024e312140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.113+0000 7f34f0fe3000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024e314ab0 0x56024e3b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.113+0000 7f34f0fe3000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56024e314e80 0x56024e3b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.113+0000 7f34f0fe3000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56024e230980 con 0x56024e312850 2023-10-06T02:24:55.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.113+0000 7f34f0fe3000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56024e230620 con 0x56024e314ab0 2023-10-06T02:24:55.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.113+0000 7f34f0fe3000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56024e227400 con 0x56024e314e80 2023-10-06T02:24:55.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.113+0000 7f34ea21e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56024e312850 0x56024e312140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.113+0000 7f34ea21e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56024e312850 0x56024e312140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58706/0 (socket says 172.21.15.6:58706) 2023-10-06T02:24:55.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.113+0000 7f34ea21e700 1 -- 172.21.15.6:0/1224932052 learned_addr learned my addr 172.21.15.6:0/1224932052 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.113+0000 7f34e9a1d700 1 --2- 172.21.15.6:0/1224932052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024e314ab0 0x56024e3b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.113+0000 7f34eaa1f700 1 --2- 172.21.15.6:0/1224932052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56024e314e80 0x56024e3b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.113+0000 7f34ea21e700 1 -- 172.21.15.6:0/1224932052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56024e314e80 msgr2=0x56024e3b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.113+0000 7f34ea21e700 1 --2- 172.21.15.6:0/1224932052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56024e314e80 0x56024e3b97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.113+0000 7f34ea21e700 1 -- 172.21.15.6:0/1224932052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024e314ab0 msgr2=0x56024e3b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.113+0000 7f34ea21e700 1 --2- 172.21.15.6:0/1224932052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024e314ab0 0x56024e3b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.113+0000 7f34ea21e700 1 -- 172.21.15.6:0/1224932052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc00a180 con 0x56024e312850 2023-10-06T02:24:55.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.114+0000 7f34ea21e700 1 --2- 172.21.15.6:0/1224932052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56024e312850 0x56024e312140 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f34e400a7b0 tx=0x7f34e4005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34d813e5d8cca9e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.114+0000 7f34e8a1b700 1 -- 172.21.15.6:0/1224932052 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e400f070 con 0x56024e312850 2023-10-06T02:24:55.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.114+0000 7f34e8a1b700 1 -- 172.21.15.6:0/1224932052 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e4008800 con 0x56024e312850 2023-10-06T02:24:55.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.114+0000 7f34e8a1b700 1 -- 172.21.15.6:0/1224932052 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e4008ba0 con 0x56024e312850 2023-10-06T02:24:55.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.114+0000 7f34f0fe3000 1 -- 172.21.15.6:0/1224932052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56024e312850 msgr2=0x56024e312140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.114+0000 7f34f0fe3000 1 --2- 172.21.15.6:0/1224932052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56024e312850 0x56024e312140 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f34e400a7b0 tx=0x7f34e4005c80 comp rx=0 tx=0).stop 2023-10-06T02:24:55.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.114+0000 7f34f0fe3000 1 -- 172.21.15.6:0/1224932052 shutdown_connections 2023-10-06T02:24:55.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.114+0000 7f34f0fe3000 1 --2- 172.21.15.6:0/1224932052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56024e314e80 0x56024e3b97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.114+0000 7f34f0fe3000 1 --2- 172.21.15.6:0/1224932052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56024e312850 0x56024e312140 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.114+0000 7f34f0fe3000 1 --2- 172.21.15.6:0/1224932052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024e314ab0 0x56024e3b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.114+0000 7f34f0fe3000 1 -- 172.21.15.6:0/1224932052 >> 172.21.15.6:0/1224932052 conn(0x56024e32cbd0 msgr2=0x56024e2e72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.114+0000 7f34f0fe3000 1 -- 172.21.15.6:0/1224932052 shutdown_connections 2023-10-06T02:24:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.114+0000 7f34f0fe3000 1 -- 172.21.15.6:0/1224932052 wait complete. 2023-10-06T02:24:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.115+0000 7f34f0fe3000 1 Processor -- start 2023-10-06T02:24:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.115+0000 7f34f0fe3000 1 -- start start 2023-10-06T02:24:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34f0fe3000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024e312850 0x56024e2e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34f0fe3000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56024e314ab0 0x56024e311a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34f0fe3000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56024e314e80 0x56024e3bc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34f0fe3000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56024e311f60 con 0x56024e314ab0 2023-10-06T02:24:55.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34f0fe3000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56024e3b8d30 con 0x56024e312850 2023-10-06T02:24:55.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34f0fe3000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56024e3b8fd0 con 0x56024e314e80 2023-10-06T02:24:55.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34e9a1d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56024e314ab0 0x56024e311a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34e9a1d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56024e314ab0 0x56024e311a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58716/0 (socket says 172.21.15.6:58716) 2023-10-06T02:24:55.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34e9a1d700 1 -- 172.21.15.6:0/2942376993 learned_addr learned my addr 172.21.15.6:0/2942376993 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34ea21e700 1 --2- 172.21.15.6:0/2942376993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024e312850 0x56024e2e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34eaa1f700 1 --2- 172.21.15.6:0/2942376993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56024e314e80 0x56024e3bc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34e9a1d700 1 -- 172.21.15.6:0/2942376993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56024e314e80 msgr2=0x56024e3bc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34e9a1d700 1 --2- 172.21.15.6:0/2942376993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56024e314e80 0x56024e3bc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34e9a1d700 1 -- 172.21.15.6:0/2942376993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024e312850 msgr2=0x56024e2e40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34e9a1d700 1 --2- 172.21.15.6:0/2942376993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56024e312850 0x56024e2e40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34e9a1d700 1 -- 172.21.15.6:0/2942376993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e400a440 con 0x56024e314ab0 2023-10-06T02:24:55.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34e9a1d700 1 --2- 172.21.15.6:0/2942376993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56024e314ab0 0x56024e311a20 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f34d400a650 tx=0x7f34d4005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34e2ffd700 1 -- 172.21.15.6:0/2942376993 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d400ae50 con 0x56024e314ab0 2023-10-06T02:24:55.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34e2ffd700 1 -- 172.21.15.6:0/2942376993 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d400d620 con 0x56024e314ab0 2023-10-06T02:24:55.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34e2ffd700 1 -- 172.21.15.6:0/2942376993 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d400d9e0 con 0x56024e314ab0 2023-10-06T02:24:55.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34f0fe3000 1 -- 172.21.15.6:0/2942376993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56024e23f3d0 con 0x56024e314ab0 2023-10-06T02:24:55.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.116+0000 7f34f0fe3000 1 -- 172.21.15.6:0/2942376993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56024e232ae0 con 0x56024e314ab0 2023-10-06T02:24:55.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.118+0000 7f34e2ffd700 1 -- 172.21.15.6:0/2942376993 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34d4013070 con 0x56024e314ab0 2023-10-06T02:24:55.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.118+0000 7f34e2ffd700 1 --2- 172.21.15.6:0/2942376993 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f34cc065890 0x7f34cc067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.118+0000 7f34e2ffd700 1 -- 172.21.15.6:0/2942376993 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f34d4083580 con 0x56024e314ab0 2023-10-06T02:24:55.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.118+0000 7f34ea21e700 1 --2- 172.21.15.6:0/2942376993 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f34cc065890 0x7f34cc067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.118+0000 7f34f0fe3000 1 --2- 172.21.15.6:0/2942376993 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56024e3bcef0 0x56024e3b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.118+0000 7f34f0fe3000 1 -- 172.21.15.6:0/2942376993 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x56024e3d0860 con 0x56024e3bcef0 2023-10-06T02:24:55.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.118+0000 7f34eaa1f700 1 --2- 172.21.15.6:0/2942376993 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56024e3bcef0 0x56024e3b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.119+0000 7f34eaa1f700 1 --2- 172.21.15.6:0/2942376993 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56024e3bcef0 0x56024e3b2440 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.119+0000 7f34ea21e700 1 --2- 172.21.15.6:0/2942376993 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f34cc065890 0x7f34cc067d40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f34e4005ce0 tx=0x7f34e4019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.119+0000 7f34eaa1f700 1 -- 172.21.15.6:0/2942376993 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x7f34dc00e7e0 con 0x56024e3bcef0 2023-10-06T02:24:55.132 INFO:teuthology.orchestra.run.smithi006.stdout:header (274 bytes) : 2023-10-06T02:24:55.132 INFO:teuthology.orchestra.run.smithi006.stdout:00000000 04 03 0c 01 00 00 09 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.132 INFO:teuthology.orchestra.run.smithi006.stdout:00000010 00 00 00 00 00 00 03 02 28 00 00 00 00 00 00 00 |........(.......| 2023-10-06T02:24:55.132 INFO:teuthology.orchestra.run.smithi006.stdout:00000020 00 00 00 00 f5 6f 1f 65 5a 84 f6 14 01 00 00 00 |.....o.eZ.......| 2023-10-06T02:24:55.133 INFO:teuthology.orchestra.run.smithi006.stdout:00000030 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00 |................| 2023-10-06T02:24:55.133 INFO:teuthology.orchestra.run.smithi006.stdout:00000040 00 00 00 00 03 02 28 00 00 00 00 00 00 00 00 00 |......(.........| 2023-10-06T02:24:55.133 INFO:teuthology.orchestra.run.smithi006.stdout:00000050 00 00 f5 6f 1f 65 5a 84 f6 14 01 00 00 00 00 00 |...o.eZ.........| 2023-10-06T02:24:55.133 INFO:teuthology.orchestra.run.smithi006.stdout:00000060 00 00 00 00 00 00 00 00 00 00 01 00 00 00 00 00 |................| 2023-10-06T02:24:55.134 INFO:teuthology.orchestra.run.smithi006.stdout:00000070 00 00 03 02 38 00 00 00 00 00 00 00 00 00 00 00 |....8...........| 2023-10-06T02:24:55.134 INFO:teuthology.orchestra.run.smithi006.stdout:00000080 00 00 60 00 00 00 00 00 01 00 00 00 00 00 00 00 |..`.............| 2023-10-06T02:24:55.134 INFO:teuthology.orchestra.run.smithi006.stdout:00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.134 INFO:teuthology.orchestra.run.smithi006.stdout:000000a0 00 00 00 00 00 00 00 00 f5 6f 1f 65 53 c5 46 17 |.........o.eS.F.| 2023-10-06T02:24:55.134 INFO:teuthology.orchestra.run.smithi006.stdout:000000b0 03 02 38 00 00 00 00 00 00 00 00 00 00 00 00 00 |..8.............| 2023-10-06T02:24:55.134 INFO:teuthology.orchestra.run.smithi006.stdout:000000c0 60 00 00 00 00 00 01 00 00 00 00 00 00 00 00 00 |`...............| 2023-10-06T02:24:55.135 INFO:teuthology.orchestra.run.smithi006.stdout:000000d0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.135 INFO:teuthology.orchestra.run.smithi006.stdout:000000e0 00 00 00 00 00 00 f5 6f 1f 65 53 c5 46 17 00 00 |.......o.eS.F...| 2023-10-06T02:24:55.135 INFO:teuthology.orchestra.run.smithi006.stdout:000000f0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.135 INFO:teuthology.orchestra.run.smithi006.stdout:* 2023-10-06T02:24:55.135 INFO:teuthology.orchestra.run.smithi006.stdout:00000110 00 00 |..| 2023-10-06T02:24:55.135 INFO:teuthology.orchestra.run.smithi006.stdout:00000112 2023-10-06T02:24:55.136 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:55.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.119+0000 7f34f0fe3000 1 -- 172.21.15.6:0/2942376993 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56024e3bcef0 msgr2=0x56024e3b2440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.119+0000 7f34f0fe3000 1 --2- 172.21.15.6:0/2942376993 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56024e3bcef0 0x56024e3b2440 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.119+0000 7f34f0fe3000 1 -- 172.21.15.6:0/2942376993 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f34cc065890 msgr2=0x7f34cc067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.119+0000 7f34f0fe3000 1 --2- 172.21.15.6:0/2942376993 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f34cc065890 0x7f34cc067d40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f34e4005ce0 tx=0x7f34e4019000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.119+0000 7f34f0fe3000 1 -- 172.21.15.6:0/2942376993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56024e314ab0 msgr2=0x56024e311a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.119+0000 7f34f0fe3000 1 --2- 172.21.15.6:0/2942376993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56024e314ab0 0x56024e311a20 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f34d400a650 tx=0x7f34d4005b20 comp rx=0 tx=0).stop 2023-10-06T02:24:55.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.119+0000 7f34eaa1f700 1 -- 172.21.15.6:0/2942376993 reap_dead start 2023-10-06T02:24:55.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.119+0000 7f34f0fe3000 1 -- 172.21.15.6:0/2942376993 shutdown_connections 2023-10-06T02:24:55.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.119+0000 7f34f0fe3000 1 -- 172.21.15.6:0/2942376993 >> 172.21.15.6:0/2942376993 conn(0x56024e32cbd0 msgr2=0x56024e2e72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.119+0000 7f34f0fe3000 1 -- 172.21.15.6:0/2942376993 shutdown_connections 2023-10-06T02:24:55.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.119+0000 7f34f0fe3000 1 -- 172.21.15.6:0/2942376993 wait complete. 2023-10-06T02:24:55.141 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 600.00000000 2023-10-06T02:24:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.215+0000 7f8f7943b000 1 Processor -- start 2023-10-06T02:24:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.215+0000 7f8f7943b000 1 -- start start 2023-10-06T02:24:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.216+0000 7f8f7943b000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5639f630c710 0x5639f62e2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.216+0000 7f8f7943b000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5639f63ae2f0 0x5639f63a7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.216+0000 7f8f7943b000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639f63ae6c0 0x5639f63a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.216+0000 7f8f7943b000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639f622b980 con 0x5639f63ae6c0 2023-10-06T02:24:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.216+0000 7f8f7943b000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639f622b620 con 0x5639f630c710 2023-10-06T02:24:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.216+0000 7f8f7943b000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639f6222400 con 0x5639f63ae2f0 2023-10-06T02:24:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.216+0000 7f8f72e77700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639f63ae6c0 0x5639f63a78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.216+0000 7f8f72e77700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639f63ae6c0 0x5639f63a78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58730/0 (socket says 172.21.15.6:58730) 2023-10-06T02:24:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.216+0000 7f8f72e77700 1 -- 172.21.15.6:0/1134202593 learned_addr learned my addr 172.21.15.6:0/1134202593 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.216+0000 7f8f71e75700 1 --2- 172.21.15.6:0/1134202593 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5639f63ae2f0 0x5639f63a7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.216+0000 7f8f72676700 1 --2- 172.21.15.6:0/1134202593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5639f630c710 0x5639f62e2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f72e77700 1 -- 172.21.15.6:0/1134202593 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5639f63ae2f0 msgr2=0x5639f63a7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f72e77700 1 --2- 172.21.15.6:0/1134202593 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5639f63ae2f0 0x5639f63a7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f72e77700 1 -- 172.21.15.6:0/1134202593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5639f630c710 msgr2=0x5639f62e2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f72e77700 1 --2- 172.21.15.6:0/1134202593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5639f630c710 0x5639f62e2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f72e77700 1 -- 172.21.15.6:0/1134202593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c00c370 con 0x5639f63ae6c0 2023-10-06T02:24:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f71e75700 1 --2- 172.21.15.6:0/1134202593 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5639f63ae2f0 0x5639f63a7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f72e77700 1 --2- 172.21.15.6:0/1134202593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639f63ae6c0 0x5639f63a78d0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00cf50 tx=0x7f8f6c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159c52d73d94909d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f70e73700 1 -- 172.21.15.6:0/1134202593 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c003300 con 0x5639f63ae6c0 2023-10-06T02:24:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f70e73700 1 -- 172.21.15.6:0/1134202593 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c00ab80 con 0x5639f63ae6c0 2023-10-06T02:24:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f70e73700 1 -- 172.21.15.6:0/1134202593 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c00f680 con 0x5639f63ae6c0 2023-10-06T02:24:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f7943b000 1 -- 172.21.15.6:0/1134202593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639f63ae6c0 msgr2=0x5639f63a78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f7943b000 1 --2- 172.21.15.6:0/1134202593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639f63ae6c0 0x5639f63a78d0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00cf50 tx=0x7f8f6c019000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f7943b000 1 -- 172.21.15.6:0/1134202593 shutdown_connections 2023-10-06T02:24:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f7943b000 1 --2- 172.21.15.6:0/1134202593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639f63ae6c0 0x5639f63a78d0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f7943b000 1 --2- 172.21.15.6:0/1134202593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5639f630c710 0x5639f62e2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f7943b000 1 --2- 172.21.15.6:0/1134202593 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5639f63ae2f0 0x5639f63a7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f7943b000 1 -- 172.21.15.6:0/1134202593 >> 172.21.15.6:0/1134202593 conn(0x5639f62e15d0 msgr2=0x5639f630fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f7943b000 1 -- 172.21.15.6:0/1134202593 shutdown_connections 2023-10-06T02:24:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.217+0000 7f8f7943b000 1 -- 172.21.15.6:0/1134202593 wait complete. 2023-10-06T02:24:55.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.218+0000 7f8f7943b000 1 Processor -- start 2023-10-06T02:24:55.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.218+0000 7f8f7943b000 1 -- start start 2023-10-06T02:24:55.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.219+0000 7f8f7943b000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5639f630c710 0x5639f63b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.219+0000 7f8f7943b000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5639f63ae2f0 0x5639f63a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.219+0000 7f8f7943b000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639f63ae6c0 0x5639f630f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.219+0000 7f8f7943b000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639f63c5a20 con 0x5639f63ae6c0 2023-10-06T02:24:55.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.219+0000 7f8f7943b000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639f63c5cc0 con 0x5639f630c710 2023-10-06T02:24:55.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.219+0000 7f8f7943b000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639f63c5f60 con 0x5639f63ae2f0 2023-10-06T02:24:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.219+0000 7f8f72e77700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639f63ae6c0 0x5639f630f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.219+0000 7f8f72e77700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639f63ae6c0 0x5639f630f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58746/0 (socket says 172.21.15.6:58746) 2023-10-06T02:24:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.219+0000 7f8f72e77700 1 -- 172.21.15.6:0/2495706542 learned_addr learned my addr 172.21.15.6:0/2495706542 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.219+0000 7f8f71e75700 1 --2- 172.21.15.6:0/2495706542 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5639f63ae2f0 0x5639f63a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.219+0000 7f8f72676700 1 --2- 172.21.15.6:0/2495706542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5639f630c710 0x5639f63b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.219+0000 7f8f72e77700 1 -- 172.21.15.6:0/2495706542 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5639f63ae2f0 msgr2=0x5639f63a5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.219+0000 7f8f72e77700 1 --2- 172.21.15.6:0/2495706542 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5639f63ae2f0 0x5639f63a5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.219+0000 7f8f72e77700 1 -- 172.21.15.6:0/2495706542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5639f630c710 msgr2=0x5639f63b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.219+0000 7f8f72e77700 1 --2- 172.21.15.6:0/2495706542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5639f630c710 0x5639f63b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.219+0000 7f8f72e77700 1 -- 172.21.15.6:0/2495706542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639f62541c0 con 0x5639f63ae6c0 2023-10-06T02:24:55.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.219+0000 7f8f72e77700 1 --2- 172.21.15.6:0/2495706542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639f63ae6c0 0x5639f630f670 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c01b040 tx=0x7f8f6c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.220+0000 7f8f62ffd700 1 -- 172.21.15.6:0/2495706542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c00fde0 con 0x5639f63ae6c0 2023-10-06T02:24:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.220+0000 7f8f62ffd700 1 -- 172.21.15.6:0/2495706542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c023430 con 0x5639f63ae6c0 2023-10-06T02:24:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.220+0000 7f8f7943b000 1 -- 172.21.15.6:0/2495706542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5639f623a3d0 con 0x5639f63ae6c0 2023-10-06T02:24:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.220+0000 7f8f62ffd700 1 -- 172.21.15.6:0/2495706542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c0237f0 con 0x5639f63ae6c0 2023-10-06T02:24:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.220+0000 7f8f7943b000 1 -- 172.21.15.6:0/2495706542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5639f622dae0 con 0x5639f63ae6c0 2023-10-06T02:24:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.221+0000 7f8f62ffd700 1 -- 172.21.15.6:0/2495706542 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f6c003050 con 0x5639f63ae6c0 2023-10-06T02:24:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.221+0000 7f8f62ffd700 1 --2- 172.21.15.6:0/2495706542 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8f54065890 0x7f8f54067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.221+0000 7f8f62ffd700 1 -- 172.21.15.6:0/2495706542 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f8f6c088b20 con 0x5639f63ae6c0 2023-10-06T02:24:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.221+0000 7f8f7943b000 1 --2- 172.21.15.6:0/2495706542 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5639f63c6940 0x5639f63af980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.221+0000 7f8f7943b000 1 -- 172.21.15.6:0/2495706542 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:0d82a743:::600.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x5639f63c54a0 con 0x5639f63c6940 2023-10-06T02:24:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.221+0000 7f8f72676700 1 --2- 172.21.15.6:0/2495706542 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8f54065890 0x7f8f54067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.222+0000 7f8f71e75700 1 --2- 172.21.15.6:0/2495706542 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5639f63c6940 0x5639f63af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.222+0000 7f8f72676700 1 --2- 172.21.15.6:0/2495706542 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8f54065890 0x7f8f54067d40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8f64005fd0 tx=0x7f8f64005be0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.222+0000 7f8f71e75700 1 --2- 172.21.15.6:0/2495706542 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5639f63c6940 0x5639f63af980 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.222+0000 7f8f71e75700 1 -- 172.21.15.6:0/2495706542 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 600.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x7f8f6800e980 con 0x5639f63c6940 2023-10-06T02:24:55.230 INFO:teuthology.orchestra.run.smithi006.stdout:header (274 bytes) : 2023-10-06T02:24:55.230 INFO:teuthology.orchestra.run.smithi006.stdout:00000000 04 03 0c 01 00 00 01 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.231 INFO:teuthology.orchestra.run.smithi006.stdout:00000010 00 00 00 00 00 00 03 02 28 00 00 00 00 00 00 00 |........(.......| 2023-10-06T02:24:55.231 INFO:teuthology.orchestra.run.smithi006.stdout:00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.231 INFO:teuthology.orchestra.run.smithi006.stdout:* 2023-10-06T02:24:55.231 INFO:teuthology.orchestra.run.smithi006.stdout:00000040 00 00 00 00 03 02 28 00 00 00 00 00 00 00 00 00 |......(.........| 2023-10-06T02:24:55.231 INFO:teuthology.orchestra.run.smithi006.stdout:00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.231 INFO:teuthology.orchestra.run.smithi006.stdout:* 2023-10-06T02:24:55.231 INFO:teuthology.orchestra.run.smithi006.stdout:00000070 00 00 03 02 38 00 00 00 00 00 00 00 00 00 00 00 |....8...........| 2023-10-06T02:24:55.231 INFO:teuthology.orchestra.run.smithi006.stdout:00000080 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.231 INFO:teuthology.orchestra.run.smithi006.stdout:* 2023-10-06T02:24:55.231 INFO:teuthology.orchestra.run.smithi006.stdout:000000b0 03 02 38 00 00 00 00 00 00 00 00 00 00 00 00 00 |..8.............| 2023-10-06T02:24:55.231 INFO:teuthology.orchestra.run.smithi006.stdout:000000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.231 INFO:teuthology.orchestra.run.smithi006.stdout:* 2023-10-06T02:24:55.232 INFO:teuthology.orchestra.run.smithi006.stdout:00000110 00 00 |..| 2023-10-06T02:24:55.232 INFO:teuthology.orchestra.run.smithi006.stdout:00000112 2023-10-06T02:24:55.232 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.222+0000 7f8f7943b000 1 -- 172.21.15.6:0/2495706542 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5639f63c6940 msgr2=0x5639f63af980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.222+0000 7f8f7943b000 1 --2- 172.21.15.6:0/2495706542 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5639f63c6940 0x5639f63af980 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.222+0000 7f8f7943b000 1 -- 172.21.15.6:0/2495706542 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8f54065890 msgr2=0x7f8f54067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.222+0000 7f8f7943b000 1 --2- 172.21.15.6:0/2495706542 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8f54065890 0x7f8f54067d40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8f64005fd0 tx=0x7f8f64005be0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.222+0000 7f8f7943b000 1 -- 172.21.15.6:0/2495706542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639f63ae6c0 msgr2=0x5639f630f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.222+0000 7f8f7943b000 1 --2- 172.21.15.6:0/2495706542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639f63ae6c0 0x5639f630f670 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c01b040 tx=0x7f8f6c020000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.222+0000 7f8f72e77700 1 -- 172.21.15.6:0/2495706542 reap_dead start 2023-10-06T02:24:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.222+0000 7f8f7943b000 1 -- 172.21.15.6:0/2495706542 shutdown_connections 2023-10-06T02:24:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.222+0000 7f8f7943b000 1 -- 172.21.15.6:0/2495706542 >> 172.21.15.6:0/2495706542 conn(0x5639f62e15d0 msgr2=0x5639f62e19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.222+0000 7f8f7943b000 1 -- 172.21.15.6:0/2495706542 shutdown_connections 2023-10-06T02:24:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.222+0000 7f8f7943b000 1 -- 172.21.15.6:0/2495706542 wait complete. 2023-10-06T02:24:55.235 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 1.00000000.inode 2023-10-06T02:24:55.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.310+0000 7fb592f0d000 1 Processor -- start 2023-10-06T02:24:55.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.310+0000 7fb592f0d000 1 -- start start 2023-10-06T02:24:55.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb592f0d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa4f06fd60 0x55aa4f115330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb592f0d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa4f08b410 0x55aa4f11d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb592f0d000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa4f11af90 0x55aa4f0742b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb592f0d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa4ef8f620 con 0x55aa4f06fd60 2023-10-06T02:24:55.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb592f0d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa4ef86400 con 0x55aa4f08b410 2023-10-06T02:24:55.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb592f0d000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa4f11ab70 con 0x55aa4f11af90 2023-10-06T02:24:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb58c148700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa4f06fd60 0x55aa4f115330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb58c148700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa4f06fd60 0x55aa4f115330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58770/0 (socket says 172.21.15.6:58770) 2023-10-06T02:24:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb58c148700 1 -- 172.21.15.6:0/2690465579 learned_addr learned my addr 172.21.15.6:0/2690465579 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb58b947700 1 --2- 172.21.15.6:0/2690465579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa4f08b410 0x55aa4f11d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb58c949700 1 --2- 172.21.15.6:0/2690465579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa4f11af90 0x55aa4f0742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb58c148700 1 -- 172.21.15.6:0/2690465579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa4f11af90 msgr2=0x55aa4f0742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb58c148700 1 --2- 172.21.15.6:0/2690465579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa4f11af90 0x55aa4f0742b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb58c148700 1 -- 172.21.15.6:0/2690465579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa4f08b410 msgr2=0x55aa4f11d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb58c148700 1 --2- 172.21.15.6:0/2690465579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa4f08b410 0x55aa4f11d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb58c148700 1 -- 172.21.15.6:0/2690465579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c005db0 con 0x55aa4f06fd60 2023-10-06T02:24:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb58c949700 1 --2- 172.21.15.6:0/2690465579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa4f11af90 0x55aa4f0742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb58b947700 1 --2- 172.21.15.6:0/2690465579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa4f08b410 0x55aa4f11d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb58c148700 1 --2- 172.21.15.6:0/2690465579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa4f06fd60 0x55aa4f115330 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fb58400b830 tx=0x7fb584005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae51d30bc2a8a3d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb58a945700 1 -- 172.21.15.6:0/2690465579 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58400d6f0 con 0x55aa4f06fd60 2023-10-06T02:24:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb58a945700 1 -- 172.21.15.6:0/2690465579 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58400d850 con 0x55aa4f06fd60 2023-10-06T02:24:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.311+0000 7fb58a945700 1 -- 172.21.15.6:0/2690465579 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58400dc10 con 0x55aa4f06fd60 2023-10-06T02:24:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.312+0000 7fb592f0d000 1 -- 172.21.15.6:0/2690465579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa4f06fd60 msgr2=0x55aa4f115330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.312+0000 7fb592f0d000 1 --2- 172.21.15.6:0/2690465579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa4f06fd60 0x55aa4f115330 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fb58400b830 tx=0x7fb584005d40 comp rx=0 tx=0).stop 2023-10-06T02:24:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.312+0000 7fb592f0d000 1 -- 172.21.15.6:0/2690465579 shutdown_connections 2023-10-06T02:24:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.312+0000 7fb592f0d000 1 --2- 172.21.15.6:0/2690465579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa4f11af90 0x55aa4f0742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.312+0000 7fb592f0d000 1 --2- 172.21.15.6:0/2690465579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa4f06fd60 0x55aa4f115330 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.312+0000 7fb592f0d000 1 --2- 172.21.15.6:0/2690465579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa4f08b410 0x55aa4f11d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.312+0000 7fb592f0d000 1 -- 172.21.15.6:0/2690465579 >> 172.21.15.6:0/2690465579 conn(0x55aa4f044d50 msgr2=0x55aa4f0456a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.312+0000 7fb592f0d000 1 -- 172.21.15.6:0/2690465579 shutdown_connections 2023-10-06T02:24:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.312+0000 7fb592f0d000 1 -- 172.21.15.6:0/2690465579 wait complete. 2023-10-06T02:24:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.312+0000 7fb592f0d000 1 Processor -- start 2023-10-06T02:24:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.312+0000 7fb592f0d000 1 -- start start 2023-10-06T02:24:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.313+0000 7fb592f0d000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa4f06fd60 0x55aa4f114e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.313+0000 7fb592f0d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa4f08b410 0x55aa4f118530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.313+0000 7fb592f0d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa4f11af90 0x55aa4f065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.313+0000 7fb592f0d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa4f072b70 con 0x55aa4f11af90 2023-10-06T02:24:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.313+0000 7fb592f0d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa4f0732e0 con 0x55aa4f08b410 2023-10-06T02:24:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.313+0000 7fb592f0d000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa4f072da0 con 0x55aa4f06fd60 2023-10-06T02:24:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.313+0000 7fb58c949700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa4f11af90 0x55aa4f065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.313+0000 7fb58c949700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa4f11af90 0x55aa4f065fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58778/0 (socket says 172.21.15.6:58778) 2023-10-06T02:24:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.313+0000 7fb58c949700 1 -- 172.21.15.6:0/4047692644 learned_addr learned my addr 172.21.15.6:0/4047692644 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.313+0000 7fb58c148700 1 --2- 172.21.15.6:0/4047692644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa4f06fd60 0x55aa4f114e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.313+0000 7fb58b947700 1 --2- 172.21.15.6:0/4047692644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa4f08b410 0x55aa4f118530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.314+0000 7fb58c949700 1 -- 172.21.15.6:0/4047692644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa4f06fd60 msgr2=0x55aa4f114e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.314+0000 7fb58c949700 1 --2- 172.21.15.6:0/4047692644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa4f06fd60 0x55aa4f114e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.314+0000 7fb58c949700 1 -- 172.21.15.6:0/4047692644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa4f08b410 msgr2=0x55aa4f118530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.314+0000 7fb58c949700 1 --2- 172.21.15.6:0/4047692644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa4f08b410 0x55aa4f118530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.314+0000 7fb58c949700 1 -- 172.21.15.6:0/4047692644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58400b430 con 0x55aa4f11af90 2023-10-06T02:24:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.314+0000 7fb58c949700 1 --2- 172.21.15.6:0/4047692644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa4f11af90 0x55aa4f065fd0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x55aa4f044b10 tx=0x7fb57c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.314+0000 7fb589142700 1 -- 172.21.15.6:0/4047692644 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0086a0 con 0x55aa4f11af90 2023-10-06T02:24:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.314+0000 7fb589142700 1 -- 172.21.15.6:0/4047692644 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c008970 con 0x55aa4f11af90 2023-10-06T02:24:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.314+0000 7fb592f0d000 1 -- 172.21.15.6:0/4047692644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55aa4efb81c0 con 0x55aa4f11af90 2023-10-06T02:24:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.314+0000 7fb589142700 1 -- 172.21.15.6:0/4047692644 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c026470 con 0x55aa4f11af90 2023-10-06T02:24:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.314+0000 7fb592f0d000 1 -- 172.21.15.6:0/4047692644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aa4ef9e3d0 con 0x55aa4f11af90 2023-10-06T02:24:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.315+0000 7fb589142700 1 -- 172.21.15.6:0/4047692644 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb57c023070 con 0x55aa4f11af90 2023-10-06T02:24:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.316+0000 7fb589142700 1 --2- 172.21.15.6:0/4047692644 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb56c0658b0 0x7fb56c067d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.316+0000 7fb589142700 1 -- 172.21.15.6:0/4047692644 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fb57c085790 con 0x55aa4f11af90 2023-10-06T02:24:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.316+0000 7fb592f0d000 1 --2- 172.21.15.6:0/4047692644 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55aa4f115360 0x55aa4f12bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.316+0000 7fb58c148700 1 --2- 172.21.15.6:0/4047692644 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb56c0658b0 0x7fb56c067d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.316+0000 7fb592f0d000 1 -- 172.21.15.6:0/4047692644 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:287034c4:::1.00000000.inode:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa4f118a70 con 0x55aa4f115360 2023-10-06T02:24:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.316+0000 7fb58b947700 1 --2- 172.21.15.6:0/4047692644 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55aa4f115360 0x55aa4f12bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.316+0000 7fb58c148700 1 --2- 172.21.15.6:0/4047692644 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb56c0658b0 0x7fb56c067d60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb584005d80 tx=0x7fb584018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.317+0000 7fb58b947700 1 --2- 172.21.15.6:0/4047692644 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55aa4f115360 0x55aa4f12bbc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.326 INFO:teuthology.orchestra.run.smithi006.stdout:header (0 bytes) : 2023-10-06T02:24:55.326 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:55.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.317+0000 7fb58b947700 1 -- 172.21.15.6:0/4047692644 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 1.00000000.inode [omap-get-header] v0'0 uv15 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fb574009be0 con 0x55aa4f115360 2023-10-06T02:24:55.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.317+0000 7fb592f0d000 1 -- 172.21.15.6:0/4047692644 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55aa4f115360 msgr2=0x55aa4f12bbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.317+0000 7fb592f0d000 1 --2- 172.21.15.6:0/4047692644 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55aa4f115360 0x55aa4f12bbc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.317+0000 7fb592f0d000 1 -- 172.21.15.6:0/4047692644 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb56c0658b0 msgr2=0x7fb56c067d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.317+0000 7fb592f0d000 1 --2- 172.21.15.6:0/4047692644 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb56c0658b0 0x7fb56c067d60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb584005d80 tx=0x7fb584018000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.317+0000 7fb592f0d000 1 -- 172.21.15.6:0/4047692644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa4f11af90 msgr2=0x55aa4f065fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.317+0000 7fb592f0d000 1 --2- 172.21.15.6:0/4047692644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa4f11af90 0x55aa4f065fd0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x55aa4f044b10 tx=0x7fb57c016000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.317+0000 7fb58c949700 1 -- 172.21.15.6:0/4047692644 reap_dead start 2023-10-06T02:24:55.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.317+0000 7fb592f0d000 1 -- 172.21.15.6:0/4047692644 shutdown_connections 2023-10-06T02:24:55.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.317+0000 7fb592f0d000 1 -- 172.21.15.6:0/4047692644 >> 172.21.15.6:0/4047692644 conn(0x55aa4f044d50 msgr2=0x55aa4f11d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.317+0000 7fb592f0d000 1 -- 172.21.15.6:0/4047692644 shutdown_connections 2023-10-06T02:24:55.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.317+0000 7fb592f0d000 1 -- 172.21.15.6:0/4047692644 wait complete. 2023-10-06T02:24:55.329 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 200.00000000 2023-10-06T02:24:55.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.404+0000 7f3619823000 1 Processor -- start 2023-10-06T02:24:55.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.404+0000 7f3619823000 1 -- start start 2023-10-06T02:24:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.405+0000 7f3619823000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432d55680 0x55b432d71980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.405+0000 7f3619823000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b432d57ab0 0x55b432d724b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.405+0000 7f3619823000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b432d57e80 0x55b432df6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.405+0000 7f3619823000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432c73980 con 0x55b432d55680 2023-10-06T02:24:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.405+0000 7f3619823000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432c73620 con 0x55b432d57ab0 2023-10-06T02:24:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.405+0000 7f3619823000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b432c6a400 con 0x55b432d57e80 2023-10-06T02:24:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.405+0000 7f3612a5e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432d55680 0x55b432d71980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.405+0000 7f3612a5e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432d55680 0x55b432d71980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58780/0 (socket says 172.21.15.6:58780) 2023-10-06T02:24:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.405+0000 7f3612a5e700 1 -- 172.21.15.6:0/631992350 learned_addr learned my addr 172.21.15.6:0/631992350 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.405+0000 7f361225d700 1 --2- 172.21.15.6:0/631992350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b432d57ab0 0x55b432d724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.405+0000 7f361325f700 1 --2- 172.21.15.6:0/631992350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b432d57e80 0x55b432df6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.405+0000 7f3612a5e700 1 -- 172.21.15.6:0/631992350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b432d57e80 msgr2=0x55b432df6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.405+0000 7f3612a5e700 1 --2- 172.21.15.6:0/631992350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b432d57e80 0x55b432df6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.405+0000 7f3612a5e700 1 -- 172.21.15.6:0/631992350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b432d57ab0 msgr2=0x55b432d724b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.405+0000 7f3612a5e700 1 --2- 172.21.15.6:0/631992350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b432d57ab0 0x55b432d724b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.406+0000 7f3612a5e700 1 -- 172.21.15.6:0/631992350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c005cf0 con 0x55b432d55680 2023-10-06T02:24:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.406+0000 7f361325f700 1 --2- 172.21.15.6:0/631992350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b432d57e80 0x55b432df6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.406+0000 7f3612a5e700 1 --2- 172.21.15.6:0/631992350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432d55680 0x55b432d71980 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f360c009a70 tx=0x7f360c00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633128e95426bc57 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.406+0000 7f361125b700 1 -- 172.21.15.6:0/631992350 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c00f040 con 0x55b432d55680 2023-10-06T02:24:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.406+0000 7f361125b700 1 -- 172.21.15.6:0/631992350 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c008ac0 con 0x55b432d55680 2023-10-06T02:24:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.406+0000 7f361125b700 1 -- 172.21.15.6:0/631992350 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c008e60 con 0x55b432d55680 2023-10-06T02:24:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.406+0000 7f3619823000 1 -- 172.21.15.6:0/631992350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432d55680 msgr2=0x55b432d71980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.406+0000 7f3619823000 1 --2- 172.21.15.6:0/631992350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432d55680 0x55b432d71980 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f360c009a70 tx=0x7f360c00c040 comp rx=0 tx=0).stop 2023-10-06T02:24:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.406+0000 7f3619823000 1 -- 172.21.15.6:0/631992350 shutdown_connections 2023-10-06T02:24:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.406+0000 7f3619823000 1 --2- 172.21.15.6:0/631992350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b432d57e80 0x55b432df6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.406+0000 7f3619823000 1 --2- 172.21.15.6:0/631992350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432d55680 0x55b432d71980 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.406+0000 7f3619823000 1 --2- 172.21.15.6:0/631992350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b432d57ab0 0x55b432d724b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.406+0000 7f3619823000 1 -- 172.21.15.6:0/631992350 >> 172.21.15.6:0/631992350 conn(0x55b432d6fbd0 msgr2=0x55b432d2a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.406+0000 7f3619823000 1 -- 172.21.15.6:0/631992350 shutdown_connections 2023-10-06T02:24:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.406+0000 7f3619823000 1 -- 172.21.15.6:0/631992350 wait complete. 2023-10-06T02:24:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.407+0000 7f3619823000 1 Processor -- start 2023-10-06T02:24:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.407+0000 7f3619823000 1 -- start start 2023-10-06T02:24:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f3619823000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432d55680 0x55b432e03280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f3619823000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b432d57ab0 0x55b432e06d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f3619823000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b432d57e80 0x55b432df0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f3619823000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432e07490 con 0x55b432d55680 2023-10-06T02:24:55.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f3619823000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432e07730 con 0x55b432d57e80 2023-10-06T02:24:55.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f3619823000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b432e079d0 con 0x55b432d57ab0 2023-10-06T02:24:55.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f3612a5e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432d55680 0x55b432e03280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f3612a5e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432d55680 0x55b432e03280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58786/0 (socket says 172.21.15.6:58786) 2023-10-06T02:24:55.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f3612a5e700 1 -- 172.21.15.6:0/3201771174 learned_addr learned my addr 172.21.15.6:0/3201771174 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f361225d700 1 --2- 172.21.15.6:0/3201771174 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b432d57ab0 0x55b432e06d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f361325f700 1 --2- 172.21.15.6:0/3201771174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b432d57e80 0x55b432df0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f3612a5e700 1 -- 172.21.15.6:0/3201771174 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b432d57ab0 msgr2=0x55b432e06d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f3612a5e700 1 --2- 172.21.15.6:0/3201771174 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b432d57ab0 0x55b432e06d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f3612a5e700 1 -- 172.21.15.6:0/3201771174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b432d57e80 msgr2=0x55b432df0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f3612a5e700 1 --2- 172.21.15.6:0/3201771174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b432d57e80 0x55b432df0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f3612a5e700 1 -- 172.21.15.6:0/3201771174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c009670 con 0x55b432d55680 2023-10-06T02:24:55.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f3612a5e700 1 --2- 172.21.15.6:0/3201771174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432d55680 0x55b432e03280 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f360c0086a0 tx=0x7f360c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f360b7fe700 1 -- 172.21.15.6:0/3201771174 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c00f040 con 0x55b432d55680 2023-10-06T02:24:55.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f360b7fe700 1 -- 172.21.15.6:0/3201771174 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c014d50 con 0x55b432d55680 2023-10-06T02:24:55.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f360b7fe700 1 -- 172.21.15.6:0/3201771174 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c01f650 con 0x55b432d55680 2023-10-06T02:24:55.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.408+0000 7f3619823000 1 -- 172.21.15.6:0/3201771174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc005cf0 con 0x55b432d55680 2023-10-06T02:24:55.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.409+0000 7f3619823000 1 -- 172.21.15.6:0/3201771174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b432c823d0 con 0x55b432d55680 2023-10-06T02:24:55.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.410+0000 7f360b7fe700 1 -- 172.21.15.6:0/3201771174 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f360c01fa80 con 0x55b432d55680 2023-10-06T02:24:55.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.410+0000 7f360b7fe700 1 --2- 172.21.15.6:0/3201771174 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f35f4065890 0x7f35f4067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.410+0000 7f360b7fe700 1 -- 172.21.15.6:0/3201771174 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f360c085820 con 0x55b432d55680 2023-10-06T02:24:55.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.410+0000 7f3619823000 1 --2- 172.21.15.6:0/3201771174 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b432df6dc0 0x55b432e083b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.410+0000 7f361225d700 1 --2- 172.21.15.6:0/3201771174 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f35f4065890 0x7f35f4067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.410+0000 7f3619823000 1 -- 172.21.15.6:0/3201771174 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:292cf221:::200.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55b432e088f0 con 0x55b432df6dc0 2023-10-06T02:24:55.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.411+0000 7f361325f700 1 --2- 172.21.15.6:0/3201771174 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b432df6dc0 0x55b432e083b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.411+0000 7f361225d700 1 --2- 172.21.15.6:0/3201771174 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f35f4065890 0x7f35f4067d40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f35fc005a90 tx=0x7f35fc015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.411+0000 7f361325f700 1 --2- 172.21.15.6:0/3201771174 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b432df6dc0 0x55b432e083b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.411+0000 7f361325f700 1 -- 172.21.15.6:0/3201771174 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 200.00000000 [omap-get-header] v0'0 uv18 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f3604001b40 con 0x55b432df6dc0 2023-10-06T02:24:55.418 INFO:teuthology.orchestra.run.smithi006.stdout:header (0 bytes) : 2023-10-06T02:24:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:55.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.411+0000 7f3619823000 1 -- 172.21.15.6:0/3201771174 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b432df6dc0 msgr2=0x55b432e083b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.411+0000 7f3619823000 1 --2- 172.21.15.6:0/3201771174 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b432df6dc0 0x55b432e083b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.411+0000 7f3619823000 1 -- 172.21.15.6:0/3201771174 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f35f4065890 msgr2=0x7f35f4067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.411+0000 7f3619823000 1 --2- 172.21.15.6:0/3201771174 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f35f4065890 0x7f35f4067d40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f35fc005a90 tx=0x7f35fc015000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.411+0000 7f3619823000 1 -- 172.21.15.6:0/3201771174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432d55680 msgr2=0x55b432e03280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.411+0000 7f3619823000 1 --2- 172.21.15.6:0/3201771174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432d55680 0x55b432e03280 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f360c0086a0 tx=0x7f360c017000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.411+0000 7f361325f700 1 -- 172.21.15.6:0/3201771174 reap_dead start 2023-10-06T02:24:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.411+0000 7f3619823000 1 -- 172.21.15.6:0/3201771174 shutdown_connections 2023-10-06T02:24:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.411+0000 7f3619823000 1 -- 172.21.15.6:0/3201771174 >> 172.21.15.6:0/3201771174 conn(0x55b432d6fbd0 msgr2=0x55b432d2a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.412+0000 7f3619823000 1 -- 172.21.15.6:0/3201771174 shutdown_connections 2023-10-06T02:24:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.412+0000 7f3619823000 1 -- 172.21.15.6:0/3201771174 wait complete. 2023-10-06T02:24:55.420 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 200.00000001 2023-10-06T02:24:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.496+0000 7f5bcbf3f000 1 Processor -- start 2023-10-06T02:24:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.496+0000 7f5bcbf3f000 1 -- start start 2023-10-06T02:24:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.497+0000 7f5bcbf3f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55828e87b160 0x55828e954460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.497+0000 7f5bcbf3f000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55828e93c8b0 0x55828e9550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.497+0000 7f5bcbf3f000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55828e93cc80 0x55828e93bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.497+0000 7f5bcbf3f000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828e7c7980 con 0x55828e93cc80 2023-10-06T02:24:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.497+0000 7f5bcbf3f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828e7c7620 con 0x55828e87b160 2023-10-06T02:24:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.497+0000 7f5bcbf3f000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55828e7be400 con 0x55828e93c8b0 2023-10-06T02:24:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.497+0000 7f5bc597b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55828e93cc80 0x55828e93bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.497+0000 7f5bc597b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55828e93cc80 0x55828e93bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58804/0 (socket says 172.21.15.6:58804) 2023-10-06T02:24:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.497+0000 7f5bc597b700 1 -- 172.21.15.6:0/1850377714 learned_addr learned my addr 172.21.15.6:0/1850377714 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.497+0000 7f5bc517a700 1 --2- 172.21.15.6:0/1850377714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55828e87b160 0x55828e954460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.497+0000 7f5bc4979700 1 --2- 172.21.15.6:0/1850377714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55828e93c8b0 0x55828e9550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.497+0000 7f5bc597b700 1 -- 172.21.15.6:0/1850377714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55828e93c8b0 msgr2=0x55828e9550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.497+0000 7f5bc597b700 1 --2- 172.21.15.6:0/1850377714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55828e93c8b0 0x55828e9550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.497+0000 7f5bc597b700 1 -- 172.21.15.6:0/1850377714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55828e87b160 msgr2=0x55828e954460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.497+0000 7f5bc597b700 1 --2- 172.21.15.6:0/1850377714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55828e87b160 0x55828e954460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.497+0000 7f5bc597b700 1 -- 172.21.15.6:0/1850377714 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb0005db0 con 0x55828e93cc80 2023-10-06T02:24:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.497+0000 7f5bc597b700 1 --2- 172.21.15.6:0/1850377714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55828e93cc80 0x55828e93bab0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800c500 tx=0x7f5bb8007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768eeddee90ba151 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.498+0000 7f5bbf7fe700 1 -- 172.21.15.6:0/1850377714 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8010590 con 0x55828e93cc80 2023-10-06T02:24:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.498+0000 7f5bbf7fe700 1 -- 172.21.15.6:0/1850377714 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb80106f0 con 0x55828e93cc80 2023-10-06T02:24:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.498+0000 7f5bbf7fe700 1 -- 172.21.15.6:0/1850377714 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8010ab0 con 0x55828e93cc80 2023-10-06T02:24:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.498+0000 7f5bcbf3f000 1 -- 172.21.15.6:0/1850377714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55828e93cc80 msgr2=0x55828e93bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.498+0000 7f5bcbf3f000 1 --2- 172.21.15.6:0/1850377714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55828e93cc80 0x55828e93bab0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800c500 tx=0x7f5bb8007040 comp rx=0 tx=0).stop 2023-10-06T02:24:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.498+0000 7f5bcbf3f000 1 -- 172.21.15.6:0/1850377714 shutdown_connections 2023-10-06T02:24:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.498+0000 7f5bcbf3f000 1 --2- 172.21.15.6:0/1850377714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55828e93cc80 0x55828e93bab0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.498+0000 7f5bcbf3f000 1 --2- 172.21.15.6:0/1850377714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55828e87b160 0x55828e954460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.498+0000 7f5bcbf3f000 1 --2- 172.21.15.6:0/1850377714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55828e93c8b0 0x55828e9550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.498+0000 7f5bcbf3f000 1 -- 172.21.15.6:0/1850377714 >> 172.21.15.6:0/1850377714 conn(0x55828e8c3bd0 msgr2=0x55828e938de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.498+0000 7f5bcbf3f000 1 -- 172.21.15.6:0/1850377714 shutdown_connections 2023-10-06T02:24:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.498+0000 7f5bcbf3f000 1 -- 172.21.15.6:0/1850377714 wait complete. 2023-10-06T02:24:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.499+0000 7f5bcbf3f000 1 Processor -- start 2023-10-06T02:24:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.499+0000 7f5bcbf3f000 1 -- start start 2023-10-06T02:24:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.499+0000 7f5bcbf3f000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55828e87b160 0x55828e9649c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.499+0000 7f5bcbf3f000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55828e93c8b0 0x55828e9665f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.499+0000 7f5bcbf3f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55828e93cc80 0x55828e935bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.499+0000 7f5bcbf3f000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828e963890 con 0x55828e93c8b0 2023-10-06T02:24:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.499+0000 7f5bcbf3f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828e963d10 con 0x55828e93cc80 2023-10-06T02:24:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.499+0000 7f5bcbf3f000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55828e8ac6b0 con 0x55828e87b160 2023-10-06T02:24:55.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.500+0000 7f5bc4979700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55828e93c8b0 0x55828e9665f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.500+0000 7f5bc4979700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55828e93c8b0 0x55828e9665f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58820/0 (socket says 172.21.15.6:58820) 2023-10-06T02:24:55.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.500+0000 7f5bc4979700 1 -- 172.21.15.6:0/2653961467 learned_addr learned my addr 172.21.15.6:0/2653961467 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.500+0000 7f5bc517a700 1 --2- 172.21.15.6:0/2653961467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55828e87b160 0x55828e9649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.500+0000 7f5bc597b700 1 --2- 172.21.15.6:0/2653961467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55828e93cc80 0x55828e935bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.500+0000 7f5bc4979700 1 -- 172.21.15.6:0/2653961467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55828e87b160 msgr2=0x55828e9649c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.500+0000 7f5bc4979700 1 --2- 172.21.15.6:0/2653961467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55828e87b160 0x55828e9649c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.500+0000 7f5bc4979700 1 -- 172.21.15.6:0/2653961467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55828e93cc80 msgr2=0x55828e935bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.500+0000 7f5bc4979700 1 --2- 172.21.15.6:0/2653961467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55828e93cc80 0x55828e935bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.500+0000 7f5bc4979700 1 -- 172.21.15.6:0/2653961467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb800d040 con 0x55828e93c8b0 2023-10-06T02:24:55.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.500+0000 7f5bc4979700 1 --2- 172.21.15.6:0/2653961467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55828e93c8b0 0x55828e9665f0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000c010 tx=0x7f5bb0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.500+0000 7f5bbdffb700 1 -- 172.21.15.6:0/2653961467 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0012ac0 con 0x55828e93c8b0 2023-10-06T02:24:55.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.500+0000 7f5bbdffb700 1 -- 172.21.15.6:0/2653961467 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb0012c60 con 0x55828e93c8b0 2023-10-06T02:24:55.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.500+0000 7f5bbdffb700 1 -- 172.21.15.6:0/2653961467 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb001c440 con 0x55828e93c8b0 2023-10-06T02:24:55.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.500+0000 7f5bcbf3f000 1 -- 172.21.15.6:0/2653961467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55828e7d63d0 con 0x55828e93c8b0 2023-10-06T02:24:55.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.500+0000 7f5bcbf3f000 1 -- 172.21.15.6:0/2653961467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55828e7c9ae0 con 0x55828e93c8b0 2023-10-06T02:24:55.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.502+0000 7f5bbdffb700 1 -- 172.21.15.6:0/2653961467 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bb0019040 con 0x55828e93c8b0 2023-10-06T02:24:55.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.502+0000 7f5bbdffb700 1 --2- 172.21.15.6:0/2653961467 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ba80658c0 0x7f5ba8067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.502+0000 7f5bbdffb700 1 -- 172.21.15.6:0/2653961467 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f5bb0085120 con 0x55828e93c8b0 2023-10-06T02:24:55.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.502+0000 7f5bc517a700 1 --2- 172.21.15.6:0/2653961467 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ba80658c0 0x7f5ba8067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.502+0000 7f5bcbf3f000 1 --2- 172.21.15.6:0/2653961467 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55828e8ab670 0x55828e933690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.502+0000 7f5bcbf3f000 1 -- 172.21.15.6:0/2653961467 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:2e2fa760:::200.00000001:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55828e933bd0 con 0x55828e8ab670 2023-10-06T02:24:55.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.502+0000 7f5bc597b700 1 --2- 172.21.15.6:0/2653961467 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55828e8ab670 0x55828e933690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.503+0000 7f5bc517a700 1 --2- 172.21.15.6:0/2653961467 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ba80658c0 0x7f5ba8067d70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000f7c0 tx=0x7f5bc00027f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.503+0000 7f5bc597b700 1 --2- 172.21.15.6:0/2653961467 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55828e8ab670 0x55828e933690 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.503+0000 7f5bc597b700 1 -- 172.21.15.6:0/2653961467 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 200.00000001 [omap-get-header] v0'0 uv16 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5bb8017020 con 0x55828e8ab670 2023-10-06T02:24:55.512 INFO:teuthology.orchestra.run.smithi006.stdout:header (0 bytes) : 2023-10-06T02:24:55.513 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:55.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.503+0000 7f5bcbf3f000 1 -- 172.21.15.6:0/2653961467 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55828e8ab670 msgr2=0x55828e933690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.503+0000 7f5bcbf3f000 1 --2- 172.21.15.6:0/2653961467 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55828e8ab670 0x55828e933690 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.503+0000 7f5bcbf3f000 1 -- 172.21.15.6:0/2653961467 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ba80658c0 msgr2=0x7f5ba8067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.503+0000 7f5bcbf3f000 1 --2- 172.21.15.6:0/2653961467 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ba80658c0 0x7f5ba8067d70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000f7c0 tx=0x7f5bc00027f0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.503+0000 7f5bcbf3f000 1 -- 172.21.15.6:0/2653961467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55828e93c8b0 msgr2=0x55828e9665f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.503+0000 7f5bcbf3f000 1 --2- 172.21.15.6:0/2653961467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55828e93c8b0 0x55828e9665f0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000c010 tx=0x7f5bb0012000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.503+0000 7f5bc597b700 1 -- 172.21.15.6:0/2653961467 reap_dead start 2023-10-06T02:24:55.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.503+0000 7f5bcbf3f000 1 -- 172.21.15.6:0/2653961467 shutdown_connections 2023-10-06T02:24:55.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.503+0000 7f5bcbf3f000 1 -- 172.21.15.6:0/2653961467 >> 172.21.15.6:0/2653961467 conn(0x55828e8c3bd0 msgr2=0x55828e93bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.503+0000 7f5bcbf3f000 1 -- 172.21.15.6:0/2653961467 shutdown_connections 2023-10-06T02:24:55.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.503+0000 7f5bcbf3f000 1 -- 172.21.15.6:0/2653961467 wait complete. 2023-10-06T02:24:55.515 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader mds0_openfiles.0 2023-10-06T02:24:55.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.590+0000 7f60149e6000 1 Processor -- start 2023-10-06T02:24:55.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.590+0000 7f60149e6000 1 -- start start 2023-10-06T02:24:55.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.591+0000 7f60149e6000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55594df23710 0x55594df25c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.591+0000 7f60149e6000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55594dfc52f0 0x55594dfc5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.591+0000 7f60149e6000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55594dfc56c0 0x55594dfc60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.591+0000 7f60149e6000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594de42980 con 0x55594dfc56c0 2023-10-06T02:24:55.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.591+0000 7f60149e6000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594de42620 con 0x55594df23710 2023-10-06T02:24:55.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.591+0000 7f60149e6000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55594de39400 con 0x55594dfc52f0 2023-10-06T02:24:55.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.591+0000 7f600e422700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55594dfc56c0 0x55594dfc60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.591+0000 7f600e422700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55594dfc56c0 0x55594dfc60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58824/0 (socket says 172.21.15.6:58824) 2023-10-06T02:24:55.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.591+0000 7f600e422700 1 -- 172.21.15.6:0/3486115351 learned_addr learned my addr 172.21.15.6:0/3486115351 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.591+0000 7f600d420700 1 --2- 172.21.15.6:0/3486115351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55594dfc52f0 0x55594dfc5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.591+0000 7f600dc21700 1 --2- 172.21.15.6:0/3486115351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55594df23710 0x55594df25c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.591+0000 7f600e422700 1 -- 172.21.15.6:0/3486115351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55594dfc52f0 msgr2=0x55594dfc5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.591+0000 7f600e422700 1 --2- 172.21.15.6:0/3486115351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55594dfc52f0 0x55594dfc5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.591+0000 7f600e422700 1 -- 172.21.15.6:0/3486115351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55594df23710 msgr2=0x55594df25c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.591+0000 7f600e422700 1 --2- 172.21.15.6:0/3486115351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55594df23710 0x55594df25c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.591+0000 7f600e422700 1 -- 172.21.15.6:0/3486115351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff8005cf0 con 0x55594dfc56c0 2023-10-06T02:24:55.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.592+0000 7f600e422700 1 --2- 172.21.15.6:0/3486115351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55594dfc56c0 0x55594dfc60d0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f6008001e60 tx=0x7f6008001730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5a95e30ce3e1f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.592+0000 7f6007fff700 1 -- 172.21.15.6:0/3486115351 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600800be20 con 0x55594dfc56c0 2023-10-06T02:24:55.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.592+0000 7f6007fff700 1 -- 172.21.15.6:0/3486115351 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600800e470 con 0x55594dfc56c0 2023-10-06T02:24:55.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.592+0000 7f6007fff700 1 -- 172.21.15.6:0/3486115351 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600800e830 con 0x55594dfc56c0 2023-10-06T02:24:55.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.592+0000 7f60149e6000 1 -- 172.21.15.6:0/3486115351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55594dfc56c0 msgr2=0x55594dfc60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.592+0000 7f60149e6000 1 --2- 172.21.15.6:0/3486115351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55594dfc56c0 0x55594dfc60d0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f6008001e60 tx=0x7f6008001730 comp rx=0 tx=0).stop 2023-10-06T02:24:55.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.592+0000 7f60149e6000 1 -- 172.21.15.6:0/3486115351 shutdown_connections 2023-10-06T02:24:55.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.592+0000 7f60149e6000 1 --2- 172.21.15.6:0/3486115351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55594dfc56c0 0x55594dfc60d0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.592+0000 7f60149e6000 1 --2- 172.21.15.6:0/3486115351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55594df23710 0x55594df25c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.592+0000 7f60149e6000 1 --2- 172.21.15.6:0/3486115351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55594dfc52f0 0x55594dfc5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.592+0000 7f60149e6000 1 -- 172.21.15.6:0/3486115351 >> 172.21.15.6:0/3486115351 conn(0x55594def85d0 msgr2=0x55594df272d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.592+0000 7f60149e6000 1 -- 172.21.15.6:0/3486115351 shutdown_connections 2023-10-06T02:24:55.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.592+0000 7f60149e6000 1 -- 172.21.15.6:0/3486115351 wait complete. 2023-10-06T02:24:55.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.593+0000 7f60149e6000 1 Processor -- start 2023-10-06T02:24:55.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.593+0000 7f60149e6000 1 -- start start 2023-10-06T02:24:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f60149e6000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55594df23710 0x55594dfc7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f60149e6000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55594dfc52f0 0x55594dfc97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f60149e6000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55594dfc56c0 0x55594dfc9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f60149e6000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594dfc7510 con 0x55594dfc56c0 2023-10-06T02:24:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f60149e6000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594df3d7c0 con 0x55594dfc52f0 2023-10-06T02:24:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f60149e6000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55594df3da60 con 0x55594df23710 2023-10-06T02:24:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f600e422700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55594dfc56c0 0x55594dfc9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f600e422700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55594dfc56c0 0x55594dfc9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58830/0 (socket says 172.21.15.6:58830) 2023-10-06T02:24:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f600e422700 1 -- 172.21.15.6:0/4153539361 learned_addr learned my addr 172.21.15.6:0/4153539361 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f600dc21700 1 --2- 172.21.15.6:0/4153539361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55594df23710 0x55594dfc7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f600d420700 1 --2- 172.21.15.6:0/4153539361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55594dfc52f0 0x55594dfc97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f600e422700 1 -- 172.21.15.6:0/4153539361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55594df23710 msgr2=0x55594dfc7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f600e422700 1 --2- 172.21.15.6:0/4153539361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55594df23710 0x55594dfc7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f600e422700 1 -- 172.21.15.6:0/4153539361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55594dfc52f0 msgr2=0x55594dfc97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f600e422700 1 --2- 172.21.15.6:0/4153539361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55594dfc52f0 0x55594dfc97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f600e422700 1 -- 172.21.15.6:0/4153539361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6008001a10 con 0x55594dfc56c0 2023-10-06T02:24:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f600e422700 1 --2- 172.21.15.6:0/4153539361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55594dfc56c0 0x55594dfc9cf0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f6008000c00 tx=0x7f6008016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f60067fc700 1 -- 172.21.15.6:0/4153539361 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600801f070 con 0x55594dfc56c0 2023-10-06T02:24:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f60067fc700 1 -- 172.21.15.6:0/4153539361 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600801a2e0 con 0x55594dfc56c0 2023-10-06T02:24:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f60149e6000 1 -- 172.21.15.6:0/4153539361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55594de513d0 con 0x55594dfc56c0 2023-10-06T02:24:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f60067fc700 1 -- 172.21.15.6:0/4153539361 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600801a7e0 con 0x55594dfc56c0 2023-10-06T02:24:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.594+0000 7f60149e6000 1 -- 172.21.15.6:0/4153539361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55594de44ae0 con 0x55594dfc56c0 2023-10-06T02:24:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.596+0000 7f60067fc700 1 -- 172.21.15.6:0/4153539361 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f600801ab50 con 0x55594dfc56c0 2023-10-06T02:24:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.596+0000 7f60067fc700 1 --2- 172.21.15.6:0/4153539361 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ff00658c0 0x7f5ff0067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.596+0000 7f60067fc700 1 -- 172.21.15.6:0/4153539361 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f60080854d0 con 0x55594dfc56c0 2023-10-06T02:24:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.597+0000 7f60149e6000 1 --2- 172.21.15.6:0/4153539361 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55594dfc8120 0x55594dfbdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.597+0000 7f60149e6000 1 -- 172.21.15.6:0/4153539361 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.6 14:654134d2:::mds0_openfiles.0:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55594defab10 con 0x55594dfc8120 2023-10-06T02:24:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.597+0000 7f600dc21700 1 --2- 172.21.15.6:0/4153539361 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ff00658c0 0x7f5ff0067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.597+0000 7f600d420700 1 --2- 172.21.15.6:0/4153539361 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55594dfc8120 0x55594dfbdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.597+0000 7f600d420700 1 --2- 172.21.15.6:0/4153539361 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55594dfc8120 0x55594dfbdfe0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.597+0000 7f600dc21700 1 --2- 172.21.15.6:0/4153539361 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ff00658c0 0x7f5ff0067d70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6000002d20 tx=0x7f6000007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.597+0000 7f600d420700 1 -- 172.21.15.6:0/4153539361 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 mds0_openfiles.0 [omap-get-header out=42b] v0'0 uv2 ondisk = 0) v8 ==== 160+0+42 (crc 0 0 0) 0x7f5ff8008970 con 0x55594dfc8120 2023-10-06T02:24:55.604 INFO:teuthology.orchestra.run.smithi006.stdout:header (42 bytes) : 2023-10-06T02:24:55.604 INFO:teuthology.orchestra.run.smithi006.stdout:00000000 13 00 00 00 63 65 70 68 20 66 73 20 76 6f 6c 75 |....ceph fs volu| 2023-10-06T02:24:55.604 INFO:teuthology.orchestra.run.smithi006.stdout:00000010 6d 65 20 76 30 31 31 01 01 0d 00 00 00 02 00 00 |me v011.........| 2023-10-06T02:24:55.604 INFO:teuthology.orchestra.run.smithi006.stdout:00000020 00 00 00 00 00 01 00 00 00 00 |..........| 2023-10-06T02:24:55.604 INFO:teuthology.orchestra.run.smithi006.stdout:0000002a 2023-10-06T02:24:55.604 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.597+0000 7f60149e6000 1 -- 172.21.15.6:0/4153539361 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55594dfc8120 msgr2=0x55594dfbdfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.597+0000 7f60149e6000 1 --2- 172.21.15.6:0/4153539361 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55594dfc8120 0x55594dfbdfe0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.597+0000 7f60149e6000 1 -- 172.21.15.6:0/4153539361 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ff00658c0 msgr2=0x7f5ff0067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.597+0000 7f60149e6000 1 --2- 172.21.15.6:0/4153539361 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ff00658c0 0x7f5ff0067d70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6000002d20 tx=0x7f6000007040 comp rx=0 tx=0).stop 2023-10-06T02:24:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.597+0000 7f60149e6000 1 -- 172.21.15.6:0/4153539361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55594dfc56c0 msgr2=0x55594dfc9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.598+0000 7f60149e6000 1 --2- 172.21.15.6:0/4153539361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55594dfc56c0 0x55594dfc9cf0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f6008000c00 tx=0x7f6008016000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.598+0000 7f600e422700 1 -- 172.21.15.6:0/4153539361 reap_dead start 2023-10-06T02:24:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.598+0000 7f60149e6000 1 -- 172.21.15.6:0/4153539361 shutdown_connections 2023-10-06T02:24:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.598+0000 7f60149e6000 1 -- 172.21.15.6:0/4153539361 >> 172.21.15.6:0/4153539361 conn(0x55594def85d0 msgr2=0x55594df26a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.598+0000 7f60149e6000 1 -- 172.21.15.6:0/4153539361 shutdown_connections 2023-10-06T02:24:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.598+0000 7f60149e6000 1 -- 172.21.15.6:0/4153539361 wait complete. 2023-10-06T02:24:55.607 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 500.00000000 2023-10-06T02:24:55.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.682+0000 7f71a6635000 1 Processor -- start 2023-10-06T02:24:55.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.682+0000 7f71a6635000 1 -- start start 2023-10-06T02:24:55.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.683+0000 7f71a6635000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3413c490 0x564f341c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.683+0000 7f71a6635000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f341b2a80 0x564f341ae130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.683+0000 7f71a6635000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f341b2e50 0x564f341ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.683+0000 7f71a6635000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3403d980 con 0x564f341b2a80 2023-10-06T02:24:55.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.683+0000 7f71a6635000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3403d620 con 0x564f3413c490 2023-10-06T02:24:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.683+0000 7f71a6635000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564f34034400 con 0x564f341b2e50 2023-10-06T02:24:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.683+0000 7f719f06f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f341b2a80 0x564f341ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.683+0000 7f719f06f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f341b2a80 0x564f341ae130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58848/0 (socket says 172.21.15.6:58848) 2023-10-06T02:24:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.683+0000 7f719f06f700 1 -- 172.21.15.6:0/1961539936 learned_addr learned my addr 172.21.15.6:0/1961539936 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.683+0000 7f719f870700 1 --2- 172.21.15.6:0/1961539936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3413c490 0x564f341c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.683+0000 7f71a0071700 1 --2- 172.21.15.6:0/1961539936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f341b2e50 0x564f341ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.683+0000 7f719f06f700 1 -- 172.21.15.6:0/1961539936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f341b2e50 msgr2=0x564f341ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.683+0000 7f719f06f700 1 --2- 172.21.15.6:0/1961539936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f341b2e50 0x564f341ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.683+0000 7f719f06f700 1 -- 172.21.15.6:0/1961539936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3413c490 msgr2=0x564f341c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.683+0000 7f719f06f700 1 --2- 172.21.15.6:0/1961539936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3413c490 0x564f341c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.683+0000 7f719f06f700 1 -- 172.21.15.6:0/1961539936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7194005db0 con 0x564f341b2a80 2023-10-06T02:24:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.683+0000 7f71a0071700 1 --2- 172.21.15.6:0/1961539936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f341b2e50 0x564f341ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.684+0000 7f719f06f700 1 --2- 172.21.15.6:0/1961539936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f341b2a80 0x564f341ae130 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f719400adf0 tx=0x7f7194015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6ade8d5cca916e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.684+0000 7f719e06d700 1 -- 172.21.15.6:0/1961539936 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194008a30 con 0x564f341b2a80 2023-10-06T02:24:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.684+0000 7f719e06d700 1 -- 172.21.15.6:0/1961539936 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7194008bd0 con 0x564f341b2a80 2023-10-06T02:24:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.684+0000 7f719e06d700 1 -- 172.21.15.6:0/1961539936 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71940126a0 con 0x564f341b2a80 2023-10-06T02:24:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.684+0000 7f71a6635000 1 -- 172.21.15.6:0/1961539936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f341b2a80 msgr2=0x564f341ae130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.684+0000 7f71a6635000 1 --2- 172.21.15.6:0/1961539936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f341b2a80 0x564f341ae130 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f719400adf0 tx=0x7f7194015000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.684+0000 7f71a6635000 1 -- 172.21.15.6:0/1961539936 shutdown_connections 2023-10-06T02:24:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.684+0000 7f71a6635000 1 --2- 172.21.15.6:0/1961539936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f341b2e50 0x564f341ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.684+0000 7f71a6635000 1 --2- 172.21.15.6:0/1961539936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f3413c490 0x564f341c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.684+0000 7f71a6635000 1 --2- 172.21.15.6:0/1961539936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f341b2a80 0x564f341ae130 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.684+0000 7f71a6635000 1 -- 172.21.15.6:0/1961539936 >> 172.21.15.6:0/1961539936 conn(0x564f340f35d0 msgr2=0x564f341b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.684+0000 7f71a6635000 1 -- 172.21.15.6:0/1961539936 shutdown_connections 2023-10-06T02:24:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.684+0000 7f71a6635000 1 -- 172.21.15.6:0/1961539936 wait complete. 2023-10-06T02:24:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.685+0000 7f71a6635000 1 Processor -- start 2023-10-06T02:24:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.685+0000 7f71a6635000 1 -- start start 2023-10-06T02:24:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f71a6635000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f3413c490 0x564f3419e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f71a6635000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f341b2a80 0x564f341a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f71a6635000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f341b2e50 0x564f341c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f71a6635000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f341c6e60 con 0x564f3413c490 2023-10-06T02:24:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f71a6635000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f341c7100 con 0x564f341b2a80 2023-10-06T02:24:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f71a6635000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564f341c73a0 con 0x564f341b2e50 2023-10-06T02:24:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f719f870700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f3413c490 0x564f3419e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f719f870700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f3413c490 0x564f3419e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58850/0 (socket says 172.21.15.6:58850) 2023-10-06T02:24:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f719f870700 1 -- 172.21.15.6:0/1109896157 learned_addr learned my addr 172.21.15.6:0/1109896157 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f719f06f700 1 --2- 172.21.15.6:0/1109896157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f341b2a80 0x564f341a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f71a0071700 1 --2- 172.21.15.6:0/1109896157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f341b2e50 0x564f341c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f719f870700 1 -- 172.21.15.6:0/1109896157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f341b2e50 msgr2=0x564f341c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f719f870700 1 --2- 172.21.15.6:0/1109896157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f341b2e50 0x564f341c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f719f870700 1 -- 172.21.15.6:0/1109896157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f341b2a80 msgr2=0x564f341a9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f719f870700 1 --2- 172.21.15.6:0/1109896157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f341b2a80 0x564f341a9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f719f870700 1 -- 172.21.15.6:0/1109896157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f340661c0 con 0x564f3413c490 2023-10-06T02:24:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f71a0071700 1 --2- 172.21.15.6:0/1109896157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f341b2e50 0x564f341c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f719f870700 1 --2- 172.21.15.6:0/1109896157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f3413c490 0x564f3419e1d0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f719000c280 tx=0x7f71900027f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f719c86a700 1 -- 172.21.15.6:0/1109896157 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719000ce70 con 0x564f3413c490 2023-10-06T02:24:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f719c86a700 1 -- 172.21.15.6:0/1109896157 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7190008030 con 0x564f3413c490 2023-10-06T02:24:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f71a6635000 1 -- 172.21.15.6:0/1109896157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f3404c3d0 con 0x564f3413c490 2023-10-06T02:24:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f719c86a700 1 -- 172.21.15.6:0/1109896157 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190011660 con 0x564f3413c490 2023-10-06T02:24:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.686+0000 7f71a6635000 1 -- 172.21.15.6:0/1109896157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f3403fae0 con 0x564f3413c490 2023-10-06T02:24:55.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.688+0000 7f719c86a700 1 -- 172.21.15.6:0/1109896157 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7190011a10 con 0x564f3413c490 2023-10-06T02:24:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.688+0000 7f719c86a700 1 --2- 172.21.15.6:0/1109896157 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f718c065890 0x7f718c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.688+0000 7f719c86a700 1 -- 172.21.15.6:0/1109896157 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7190083720 con 0x564f3413c490 2023-10-06T02:24:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.688+0000 7f71a6635000 1 --2- 172.21.15.6:0/1109896157 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564f34139740 0x564f341c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.688+0000 7f719f06f700 1 --2- 172.21.15.6:0/1109896157 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f718c065890 0x7f718c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.688+0000 7f71a6635000 1 -- 172.21.15.6:0/1109896157 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:1 14.15 14:aa448500:::500.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x564f341c82c0 con 0x564f34139740 2023-10-06T02:24:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.688+0000 7f71a0071700 1 --2- 172.21.15.6:0/1109896157 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564f34139740 0x564f341c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.689+0000 7f719f06f700 1 --2- 172.21.15.6:0/1109896157 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f718c065890 0x7f718c067d40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f719400adf0 tx=0x7f7194003050 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.689+0000 7f71a0071700 1 --2- 172.21.15.6:0/1109896157 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564f34139740 0x564f341c7d80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.689+0000 7f71a0071700 1 -- 172.21.15.6:0/1109896157 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(1 500.00000000 [omap-get-header] v0'0 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f719800ca30 con 0x564f34139740 2023-10-06T02:24:55.696 INFO:teuthology.orchestra.run.smithi006.stdout:header (0 bytes) : 2023-10-06T02:24:55.696 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.689+0000 7f71a6635000 1 -- 172.21.15.6:0/1109896157 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564f34139740 msgr2=0x564f341c7d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.689+0000 7f71a6635000 1 --2- 172.21.15.6:0/1109896157 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564f34139740 0x564f341c7d80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.689+0000 7f71a6635000 1 -- 172.21.15.6:0/1109896157 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f718c065890 msgr2=0x7f718c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.689+0000 7f71a6635000 1 --2- 172.21.15.6:0/1109896157 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f718c065890 0x7f718c067d40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f719400adf0 tx=0x7f7194003050 comp rx=0 tx=0).stop 2023-10-06T02:24:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.689+0000 7f71a6635000 1 -- 172.21.15.6:0/1109896157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f3413c490 msgr2=0x564f3419e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.689+0000 7f71a6635000 1 --2- 172.21.15.6:0/1109896157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f3413c490 0x564f3419e1d0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f719000c280 tx=0x7f71900027f0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.689+0000 7f71a0071700 1 -- 172.21.15.6:0/1109896157 reap_dead start 2023-10-06T02:24:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.689+0000 7f71a6635000 1 -- 172.21.15.6:0/1109896157 shutdown_connections 2023-10-06T02:24:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.689+0000 7f71a6635000 1 -- 172.21.15.6:0/1109896157 >> 172.21.15.6:0/1109896157 conn(0x564f340f35d0 msgr2=0x564f341b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.689+0000 7f71a6635000 1 -- 172.21.15.6:0/1109896157 shutdown_connections 2023-10-06T02:24:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.689+0000 7f71a6635000 1 -- 172.21.15.6:0/1109896157 wait complete. 2023-10-06T02:24:55.698 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader mds_snaptable 2023-10-06T02:24:55.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.774+0000 7f75025de000 1 Processor -- start 2023-10-06T02:24:55.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.775+0000 7f75025de000 1 -- start start 2023-10-06T02:24:55.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.775+0000 7f75025de000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9426ede30 0x55c942794ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.775+0000 7f75025de000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9426f09e0 0x55c94270b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.775+0000 7f75025de000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c942796f50 0x55c94270b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.775+0000 7f75025de000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c94260d980 con 0x55c9426ede30 2023-10-06T02:24:55.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.775+0000 7f75025de000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c94260d620 con 0x55c942796f50 2023-10-06T02:24:55.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.775+0000 7f75025de000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c942604400 con 0x55c9426f09e0 2023-10-06T02:24:55.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.775+0000 7f74fb819700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9426ede30 0x55c942794ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.775+0000 7f74fb819700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9426ede30 0x55c942794ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58870/0 (socket says 172.21.15.6:58870) 2023-10-06T02:24:55.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.775+0000 7f74fb819700 1 -- 172.21.15.6:0/3926287941 learned_addr learned my addr 172.21.15.6:0/3926287941 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.775+0000 7f74fb018700 1 --2- 172.21.15.6:0/3926287941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9426f09e0 0x55c94270b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f74fb819700 1 -- 172.21.15.6:0/3926287941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9426f09e0 msgr2=0x55c94270b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f74fb819700 1 --2- 172.21.15.6:0/3926287941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9426f09e0 0x55c94270b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f74fc01a700 1 --2- 172.21.15.6:0/3926287941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c942796f50 0x55c94270b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f74fb819700 1 -- 172.21.15.6:0/3926287941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c942796f50 msgr2=0x55c94270b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f74fb819700 1 --2- 172.21.15.6:0/3926287941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c942796f50 0x55c94270b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f74fb819700 1 -- 172.21.15.6:0/3926287941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f400a0e0 con 0x55c9426ede30 2023-10-06T02:24:55.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f74fb018700 1 --2- 172.21.15.6:0/3926287941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9426f09e0 0x55c94270b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:55.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f74fb819700 1 --2- 172.21.15.6:0/3926287941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9426ede30 0x55c942794ab0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f74ec00b3a0 tx=0x7f74ec0017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149858ac696a3e24 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f74fa016700 1 -- 172.21.15.6:0/3926287941 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec00bd70 con 0x55c9426ede30 2023-10-06T02:24:55.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f74fa016700 1 -- 172.21.15.6:0/3926287941 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec00e470 con 0x55c9426ede30 2023-10-06T02:24:55.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f74fa016700 1 -- 172.21.15.6:0/3926287941 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec00e830 con 0x55c9426ede30 2023-10-06T02:24:55.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f75025de000 1 -- 172.21.15.6:0/3926287941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9426ede30 msgr2=0x55c942794ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f75025de000 1 --2- 172.21.15.6:0/3926287941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9426ede30 0x55c942794ab0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f74ec00b3a0 tx=0x7f74ec0017f0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f75025de000 1 -- 172.21.15.6:0/3926287941 shutdown_connections 2023-10-06T02:24:55.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f75025de000 1 --2- 172.21.15.6:0/3926287941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c942796f50 0x55c94270b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f75025de000 1 --2- 172.21.15.6:0/3926287941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9426ede30 0x55c942794ab0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f75025de000 1 --2- 172.21.15.6:0/3926287941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9426f09e0 0x55c94270b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.776+0000 7f75025de000 1 -- 172.21.15.6:0/3926287941 >> 172.21.15.6:0/3926287941 conn(0x55c942709bd0 msgr2=0x55c94270c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.777+0000 7f75025de000 1 -- 172.21.15.6:0/3926287941 shutdown_connections 2023-10-06T02:24:55.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.777+0000 7f75025de000 1 -- 172.21.15.6:0/3926287941 wait complete. 2023-10-06T02:24:55.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.777+0000 7f75025de000 1 Processor -- start 2023-10-06T02:24:55.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.777+0000 7f75025de000 1 -- start start 2023-10-06T02:24:55.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f75025de000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9426ede30 0x55c94278c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f75025de000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9426f09e0 0x55c94270c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f75025de000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c942796f50 0x55c942795b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f75025de000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c94278e0c0 con 0x55c9426f09e0 2023-10-06T02:24:55.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f75025de000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c94278e360 con 0x55c942796f50 2023-10-06T02:24:55.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f75025de000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c94278e600 con 0x55c9426ede30 2023-10-06T02:24:55.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f74fb018700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9426f09e0 0x55c94270c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f74fb018700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9426f09e0 0x55c94270c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58882/0 (socket says 172.21.15.6:58882) 2023-10-06T02:24:55.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f74fb018700 1 -- 172.21.15.6:0/2911340957 learned_addr learned my addr 172.21.15.6:0/2911340957 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f74fc01a700 1 --2- 172.21.15.6:0/2911340957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c942796f50 0x55c942795b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f74fb819700 1 --2- 172.21.15.6:0/2911340957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9426ede30 0x55c94278c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f74fb018700 1 -- 172.21.15.6:0/2911340957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9426ede30 msgr2=0x55c94278c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f74fb018700 1 --2- 172.21.15.6:0/2911340957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9426ede30 0x55c94278c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f74fb018700 1 -- 172.21.15.6:0/2911340957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c942796f50 msgr2=0x55c942795b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f74fb018700 1 --2- 172.21.15.6:0/2911340957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c942796f50 0x55c942795b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f74fb018700 1 -- 172.21.15.6:0/2911340957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec001ad0 con 0x55c9426f09e0 2023-10-06T02:24:55.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f74fb819700 1 --2- 172.21.15.6:0/2911340957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9426ede30 0x55c94278c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:55.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.778+0000 7f74fb018700 1 --2- 172.21.15.6:0/2911340957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9426f09e0 0x55c94270c290 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f74f0007860 tx=0x7f74f0005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.779+0000 7f74f8813700 1 -- 172.21.15.6:0/2911340957 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f0010070 con 0x55c9426f09e0 2023-10-06T02:24:55.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.779+0000 7f74f8813700 1 -- 172.21.15.6:0/2911340957 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f000b2e0 con 0x55c9426f09e0 2023-10-06T02:24:55.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.779+0000 7f75025de000 1 -- 172.21.15.6:0/2911340957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c94261c3d0 con 0x55c9426f09e0 2023-10-06T02:24:55.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.779+0000 7f74f8813700 1 -- 172.21.15.6:0/2911340957 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f0006840 con 0x55c9426f09e0 2023-10-06T02:24:55.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.779+0000 7f75025de000 1 -- 172.21.15.6:0/2911340957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c94260fae0 con 0x55c9426f09e0 2023-10-06T02:24:55.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.780+0000 7f74f8813700 1 -- 172.21.15.6:0/2911340957 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74f0006bb0 con 0x55c9426f09e0 2023-10-06T02:24:55.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.780+0000 7f74f8813700 1 --2- 172.21.15.6:0/2911340957 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f74e8065890 0x7f74e8067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.780+0000 7f74f8813700 1 -- 172.21.15.6:0/2911340957 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f74f0082ee0 con 0x55c9426f09e0 2023-10-06T02:24:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.780+0000 7f74fb819700 1 --2- 172.21.15.6:0/2911340957 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f74e8065890 0x7f74e8067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.780+0000 7f75025de000 1 --2- 172.21.15.6:0/2911340957 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55c94278cea0 0x55c94278f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.780+0000 7f75025de000 1 -- 172.21.15.6:0/2911340957 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:1 14.d 14:b50e409b:::mds_snaptable:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55c94270c7d0 con 0x55c94278cea0 2023-10-06T02:24:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.781+0000 7f74fc01a700 1 --2- 172.21.15.6:0/2911340957 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55c94278cea0 0x55c94278f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.781+0000 7f74fb819700 1 --2- 172.21.15.6:0/2911340957 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f74e8065890 0x7f74e8067d40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f74ec001ed0 tx=0x7f74ec016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.781+0000 7f74fc01a700 1 --2- 172.21.15.6:0/2911340957 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55c94278cea0 0x55c94278f250 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.781+0000 7f74fc01a700 1 -- 172.21.15.6:0/2911340957 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(1 mds_snaptable [omap-get-header] v0'0 uv1 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f74f4016020 con 0x55c94278cea0 2023-10-06T02:24:55.787 INFO:teuthology.orchestra.run.smithi006.stdout:header (0 bytes) : 2023-10-06T02:24:55.788 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:55.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.781+0000 7f75025de000 1 -- 172.21.15.6:0/2911340957 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55c94278cea0 msgr2=0x55c94278f250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.781+0000 7f75025de000 1 --2- 172.21.15.6:0/2911340957 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55c94278cea0 0x55c94278f250 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.782+0000 7f75025de000 1 -- 172.21.15.6:0/2911340957 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f74e8065890 msgr2=0x7f74e8067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.782+0000 7f75025de000 1 --2- 172.21.15.6:0/2911340957 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f74e8065890 0x7f74e8067d40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f74ec001ed0 tx=0x7f74ec016000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.782+0000 7f75025de000 1 -- 172.21.15.6:0/2911340957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9426f09e0 msgr2=0x55c94270c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.782+0000 7f75025de000 1 --2- 172.21.15.6:0/2911340957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9426f09e0 0x55c94270c290 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f74f0007860 tx=0x7f74f0005d80 comp rx=0 tx=0).stop 2023-10-06T02:24:55.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.782+0000 7f74fc01a700 1 -- 172.21.15.6:0/2911340957 reap_dead start 2023-10-06T02:24:55.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.782+0000 7f75025de000 1 -- 172.21.15.6:0/2911340957 shutdown_connections 2023-10-06T02:24:55.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.782+0000 7f75025de000 1 -- 172.21.15.6:0/2911340957 >> 172.21.15.6:0/2911340957 conn(0x55c942709bd0 msgr2=0x55c942792480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.782+0000 7f75025de000 1 -- 172.21.15.6:0/2911340957 shutdown_connections 2023-10-06T02:24:55.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.782+0000 7f75025de000 1 -- 172.21.15.6:0/2911340957 wait complete. 2023-10-06T02:24:55.790 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader mds0_inotable 2023-10-06T02:24:55.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.866+0000 7feea4fcb000 1 Processor -- start 2023-10-06T02:24:55.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.866+0000 7feea4fcb000 1 -- start start 2023-10-06T02:24:55.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.867+0000 7feea4fcb000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee8c002330 0x559ae9e6c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.867+0000 7feea4fcb000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae9e6c9a0 0x559ae9f2b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.867+0000 7feea4fcb000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ae9f2bac0 0x559ae9e95c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.867+0000 7feea4fcb000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae9db6980 con 0x559ae9f2bac0 2023-10-06T02:24:55.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.867+0000 7feea4fcb000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae9db6620 con 0x559ae9e6c9a0 2023-10-06T02:24:55.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.867+0000 7feea4fcb000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ae9dad400 con 0x7fee8c002330 2023-10-06T02:24:55.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.867+0000 7fee9ea07700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ae9f2bac0 0x559ae9e95c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.867+0000 7fee9e206700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee8c002330 0x559ae9e6c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.867+0000 7fee9ea07700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ae9f2bac0 0x559ae9e95c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58908/0 (socket says 172.21.15.6:58908) 2023-10-06T02:24:55.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.867+0000 7fee9ea07700 1 -- 172.21.15.6:0/266069938 learned_addr learned my addr 172.21.15.6:0/266069938 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.867+0000 7fee9da05700 1 --2- 172.21.15.6:0/266069938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae9e6c9a0 0x559ae9f2b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.867+0000 7fee9ea07700 1 -- 172.21.15.6:0/266069938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee8c002330 msgr2=0x559ae9e6c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.867+0000 7fee9ea07700 1 --2- 172.21.15.6:0/266069938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee8c002330 0x559ae9e6c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.867+0000 7fee9ea07700 1 -- 172.21.15.6:0/266069938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae9e6c9a0 msgr2=0x559ae9f2b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.867+0000 7fee9ea07700 1 --2- 172.21.15.6:0/266069938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae9e6c9a0 0x559ae9f2b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.867+0000 7fee9ea07700 1 -- 172.21.15.6:0/266069938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ae9dc53d0 con 0x559ae9f2bac0 2023-10-06T02:24:55.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.867+0000 7fee9ea07700 1 --2- 172.21.15.6:0/266069938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ae9f2bac0 0x559ae9e95c40 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fee900013d0 tx=0x7fee900021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e0c60c6c540c72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.868+0000 7fee9ca03700 1 -- 172.21.15.6:0/266069938 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90006e80 con 0x559ae9f2bac0 2023-10-06T02:24:55.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.868+0000 7fee9ca03700 1 -- 172.21.15.6:0/266069938 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee90003450 con 0x559ae9f2bac0 2023-10-06T02:24:55.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.868+0000 7fee9ca03700 1 -- 172.21.15.6:0/266069938 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee900037f0 con 0x559ae9f2bac0 2023-10-06T02:24:55.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.868+0000 7feea4fcb000 1 -- 172.21.15.6:0/266069938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ae9f2bac0 msgr2=0x559ae9e95c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.868+0000 7feea4fcb000 1 --2- 172.21.15.6:0/266069938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ae9f2bac0 0x559ae9e95c40 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fee900013d0 tx=0x7fee900021d0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.868+0000 7feea4fcb000 1 -- 172.21.15.6:0/266069938 shutdown_connections 2023-10-06T02:24:55.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.868+0000 7feea4fcb000 1 --2- 172.21.15.6:0/266069938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ae9f2bac0 0x559ae9e95c40 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.868+0000 7feea4fcb000 1 --2- 172.21.15.6:0/266069938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee8c002330 0x559ae9e6c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.868+0000 7feea4fcb000 1 --2- 172.21.15.6:0/266069938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae9e6c9a0 0x559ae9f2b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.868+0000 7feea4fcb000 1 -- 172.21.15.6:0/266069938 >> 172.21.15.6:0/266069938 conn(0x559ae9e6bd50 msgr2=0x559ae9f3eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.868+0000 7feea4fcb000 1 -- 172.21.15.6:0/266069938 shutdown_connections 2023-10-06T02:24:55.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.868+0000 7feea4fcb000 1 -- 172.21.15.6:0/266069938 wait complete. 2023-10-06T02:24:55.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.869+0000 7feea4fcb000 1 Processor -- start 2023-10-06T02:24:55.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.869+0000 7feea4fcb000 1 -- start start 2023-10-06T02:24:55.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.869+0000 7feea4fcb000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ae9e6c9a0 0x559ae9e6c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.869+0000 7feea4fcb000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559ae9f2bac0 0x559ae9f2cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.869+0000 7feea4fcb000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee8c002330 0x559ae9f2af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.869+0000 7feea4fcb000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae9f352a0 con 0x559ae9e6c9a0 2023-10-06T02:24:55.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.869+0000 7feea4fcb000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae9f2c0a0 con 0x7fee8c002330 2023-10-06T02:24:55.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.869+0000 7feea4fcb000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ae9f2c340 con 0x559ae9f2bac0 2023-10-06T02:24:55.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.870+0000 7fee9e206700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ae9e6c9a0 0x559ae9e6c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.870+0000 7fee9e206700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ae9e6c9a0 0x559ae9e6c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58920/0 (socket says 172.21.15.6:58920) 2023-10-06T02:24:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.870+0000 7fee9e206700 1 -- 172.21.15.6:0/2215734992 learned_addr learned my addr 172.21.15.6:0/2215734992 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.870+0000 7fee9da05700 1 --2- 172.21.15.6:0/2215734992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559ae9f2bac0 0x559ae9f2cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.870+0000 7fee9ea07700 1 --2- 172.21.15.6:0/2215734992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee8c002330 0x559ae9f2af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.870+0000 7fee9e206700 1 -- 172.21.15.6:0/2215734992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559ae9f2bac0 msgr2=0x559ae9f2cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.870+0000 7fee9e206700 1 --2- 172.21.15.6:0/2215734992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559ae9f2bac0 0x559ae9f2cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.870+0000 7fee9e206700 1 -- 172.21.15.6:0/2215734992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee8c002330 msgr2=0x559ae9f2af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.870+0000 7fee9e206700 1 --2- 172.21.15.6:0/2215734992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee8c002330 0x559ae9f2af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.870+0000 7fee9e206700 1 -- 172.21.15.6:0/2215734992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ae9ddf1c0 con 0x559ae9e6c9a0 2023-10-06T02:24:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.870+0000 7fee9ea07700 1 --2- 172.21.15.6:0/2215734992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee8c002330 0x559ae9f2af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.870+0000 7fee9e206700 1 --2- 172.21.15.6:0/2215734992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ae9e6c9a0 0x559ae9e6c150 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fee98009dd0 tx=0x7fee98018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.870+0000 7fee96ffd700 1 -- 172.21.15.6:0/2215734992 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9800e040 con 0x559ae9e6c9a0 2023-10-06T02:24:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.870+0000 7fee96ffd700 1 -- 172.21.15.6:0/2215734992 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee98008ea0 con 0x559ae9e6c9a0 2023-10-06T02:24:55.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.870+0000 7feea4fcb000 1 -- 172.21.15.6:0/2215734992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559ae9db8ae0 con 0x559ae9e6c9a0 2023-10-06T02:24:55.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.870+0000 7fee96ffd700 1 -- 172.21.15.6:0/2215734992 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98013650 con 0x559ae9e6c9a0 2023-10-06T02:24:55.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.870+0000 7feea4fcb000 1 -- 172.21.15.6:0/2215734992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ae9db8540 con 0x559ae9e6c9a0 2023-10-06T02:24:55.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.871+0000 7fee96ffd700 1 -- 172.21.15.6:0/2215734992 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee98013a40 con 0x559ae9e6c9a0 2023-10-06T02:24:55.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.872+0000 7fee96ffd700 1 --2- 172.21.15.6:0/2215734992 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fee80065890 0x7fee80067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.872+0000 7fee96ffd700 1 -- 172.21.15.6:0/2215734992 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fee98084b80 con 0x559ae9e6c9a0 2023-10-06T02:24:55.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.872+0000 7fee9da05700 1 --2- 172.21.15.6:0/2215734992 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fee80065890 0x7fee80067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.872+0000 7feea4fcb000 1 --2- 172.21.15.6:0/2215734992 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x559ae9f322d0 0x559ae9f326a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.872+0000 7feea4fcb000 1 -- 172.21.15.6:0/2215734992 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x559ae9f308e0 con 0x559ae9f322d0 2023-10-06T02:24:55.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.872+0000 7fee9ea07700 1 --2- 172.21.15.6:0/2215734992 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x559ae9f322d0 0x559ae9f326a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.872+0000 7fee9da05700 1 --2- 172.21.15.6:0/2215734992 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fee80065890 0x7fee80067d40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fee88005fd0 tx=0x7fee8800c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.873+0000 7fee9ea07700 1 --2- 172.21.15.6:0/2215734992 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x559ae9f322d0 0x559ae9f326a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.873+0000 7fee9ea07700 1 -- 172.21.15.6:0/2215734992 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(1 mds0_inotable [omap-get-header] v0'0 uv3 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fee900035c0 con 0x559ae9f322d0 2023-10-06T02:24:55.879 INFO:teuthology.orchestra.run.smithi006.stdout:header (0 bytes) : 2023-10-06T02:24:55.879 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:55.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.873+0000 7feea4fcb000 1 -- 172.21.15.6:0/2215734992 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x559ae9f322d0 msgr2=0x559ae9f326a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.873+0000 7feea4fcb000 1 --2- 172.21.15.6:0/2215734992 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x559ae9f322d0 0x559ae9f326a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.873+0000 7feea4fcb000 1 -- 172.21.15.6:0/2215734992 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fee80065890 msgr2=0x7fee80067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.873+0000 7feea4fcb000 1 --2- 172.21.15.6:0/2215734992 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fee80065890 0x7fee80067d40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fee88005fd0 tx=0x7fee8800c040 comp rx=0 tx=0).stop 2023-10-06T02:24:55.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.873+0000 7feea4fcb000 1 -- 172.21.15.6:0/2215734992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ae9e6c9a0 msgr2=0x559ae9e6c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.873+0000 7feea4fcb000 1 --2- 172.21.15.6:0/2215734992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ae9e6c9a0 0x559ae9e6c150 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fee98009dd0 tx=0x7fee98018000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.873+0000 7fee9ea07700 1 -- 172.21.15.6:0/2215734992 reap_dead start 2023-10-06T02:24:55.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.873+0000 7feea4fcb000 1 -- 172.21.15.6:0/2215734992 shutdown_connections 2023-10-06T02:24:55.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.873+0000 7feea4fcb000 1 -- 172.21.15.6:0/2215734992 >> 172.21.15.6:0/2215734992 conn(0x559ae9e6bd50 msgr2=0x559ae9f301d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.873+0000 7feea4fcb000 1 -- 172.21.15.6:0/2215734992 shutdown_connections 2023-10-06T02:24:55.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.873+0000 7feea4fcb000 1 -- 172.21.15.6:0/2215734992 wait complete. 2023-10-06T02:24:55.882 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 100.00000000 2023-10-06T02:24:55.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.957+0000 7ff944ad2000 1 Processor -- start 2023-10-06T02:24:55.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.957+0000 7ff944ad2000 1 -- start start 2023-10-06T02:24:55.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.958+0000 7ff944ad2000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1e2062e30 0x55c1e210a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.958+0000 7ff944ad2000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1e210bf50 0x55c1e2067570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.958+0000 7ff944ad2000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c1e210f260 0x55c1e2063290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.958+0000 7ff944ad2000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e1f82980 con 0x55c1e210bf50 2023-10-06T02:24:55.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.958+0000 7ff944ad2000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e1f82620 con 0x55c1e2062e30 2023-10-06T02:24:55.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.958+0000 7ff944ad2000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1e1f79400 con 0x55c1e210f260 2023-10-06T02:24:55.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.958+0000 7ff93d50c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1e210bf50 0x55c1e2067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.958+0000 7ff93d50c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1e210bf50 0x55c1e2067570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58930/0 (socket says 172.21.15.6:58930) 2023-10-06T02:24:55.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.958+0000 7ff93d50c700 1 -- 172.21.15.6:0/2837735308 learned_addr learned my addr 172.21.15.6:0/2837735308 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.958+0000 7ff93e50e700 1 --2- 172.21.15.6:0/2837735308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c1e210f260 0x55c1e2063290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.958+0000 7ff93dd0d700 1 --2- 172.21.15.6:0/2837735308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1e2062e30 0x55c1e210a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff93d50c700 1 -- 172.21.15.6:0/2837735308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c1e210f260 msgr2=0x55c1e2063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff93d50c700 1 --2- 172.21.15.6:0/2837735308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c1e210f260 0x55c1e2063290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff93d50c700 1 -- 172.21.15.6:0/2837735308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1e2062e30 msgr2=0x55c1e210a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff93d50c700 1 --2- 172.21.15.6:0/2837735308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1e2062e30 0x55c1e210a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff93d50c700 1 -- 172.21.15.6:0/2837735308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff938005db0 con 0x55c1e210bf50 2023-10-06T02:24:55.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff93d50c700 1 --2- 172.21.15.6:0/2837735308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1e210bf50 0x55c1e2067570 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7ff92800a450 tx=0x7ff9280059d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42bcb84f5cdefee3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff937fff700 1 -- 172.21.15.6:0/2837735308 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92800ae90 con 0x55c1e210bf50 2023-10-06T02:24:55.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff937fff700 1 -- 172.21.15.6:0/2837735308 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92800c610 con 0x55c1e210bf50 2023-10-06T02:24:55.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff937fff700 1 -- 172.21.15.6:0/2837735308 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92800c9b0 con 0x55c1e210bf50 2023-10-06T02:24:55.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff944ad2000 1 -- 172.21.15.6:0/2837735308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1e210bf50 msgr2=0x55c1e2067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff944ad2000 1 --2- 172.21.15.6:0/2837735308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1e210bf50 0x55c1e2067570 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7ff92800a450 tx=0x7ff9280059d0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff944ad2000 1 -- 172.21.15.6:0/2837735308 shutdown_connections 2023-10-06T02:24:55.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff944ad2000 1 --2- 172.21.15.6:0/2837735308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c1e210f260 0x55c1e2063290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff944ad2000 1 --2- 172.21.15.6:0/2837735308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1e2062e30 0x55c1e210a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff944ad2000 1 --2- 172.21.15.6:0/2837735308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1e210bf50 0x55c1e2067570 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff944ad2000 1 -- 172.21.15.6:0/2837735308 >> 172.21.15.6:0/2837735308 conn(0x55c1e207ebd0 msgr2=0x55c1e207efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff944ad2000 1 -- 172.21.15.6:0/2837735308 shutdown_connections 2023-10-06T02:24:55.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.959+0000 7ff944ad2000 1 -- 172.21.15.6:0/2837735308 wait complete. 2023-10-06T02:24:55.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.960+0000 7ff944ad2000 1 Processor -- start 2023-10-06T02:24:55.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.960+0000 7ff944ad2000 1 -- start start 2023-10-06T02:24:55.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff944ad2000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1e2062e30 0x55c1e20fb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff944ad2000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1e210bf50 0x55c1e2079460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff944ad2000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c1e210f260 0x55c1e20799a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff944ad2000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e20fd2d0 con 0x55c1e210bf50 2023-10-06T02:24:55.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff944ad2000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e2106fb0 con 0x55c1e2062e30 2023-10-06T02:24:55.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff944ad2000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1e20fd530 con 0x55c1e210f260 2023-10-06T02:24:55.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff93d50c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1e210bf50 0x55c1e2079460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff93d50c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1e210bf50 0x55c1e2079460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58934/0 (socket says 172.21.15.6:58934) 2023-10-06T02:24:55.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff93d50c700 1 -- 172.21.15.6:0/321067338 learned_addr learned my addr 172.21.15.6:0/321067338 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:55.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff93dd0d700 1 --2- 172.21.15.6:0/321067338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1e2062e30 0x55c1e20fb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff93e50e700 1 --2- 172.21.15.6:0/321067338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c1e210f260 0x55c1e20799a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff93d50c700 1 -- 172.21.15.6:0/321067338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c1e210f260 msgr2=0x55c1e20799a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff93d50c700 1 --2- 172.21.15.6:0/321067338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c1e210f260 0x55c1e20799a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff93d50c700 1 -- 172.21.15.6:0/321067338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1e2062e30 msgr2=0x55c1e20fb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff93d50c700 1 --2- 172.21.15.6:0/321067338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1e2062e30 0x55c1e20fb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff93d50c700 1 -- 172.21.15.6:0/321067338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff928005c90 con 0x55c1e210bf50 2023-10-06T02:24:55.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff93d50c700 1 --2- 172.21.15.6:0/321067338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1e210bf50 0x55c1e2079460 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7ff92800aa40 tx=0x7ff928015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.961+0000 7ff9367fc700 1 -- 172.21.15.6:0/321067338 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9280166f0 con 0x55c1e210bf50 2023-10-06T02:24:55.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.962+0000 7ff9367fc700 1 -- 172.21.15.6:0/321067338 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff928016850 con 0x55c1e210bf50 2023-10-06T02:24:55.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.962+0000 7ff9367fc700 1 -- 172.21.15.6:0/321067338 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff928016c10 con 0x55c1e210bf50 2023-10-06T02:24:55.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.962+0000 7ff944ad2000 1 -- 172.21.15.6:0/321067338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c1e1f913d0 con 0x55c1e210bf50 2023-10-06T02:24:55.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.962+0000 7ff944ad2000 1 -- 172.21.15.6:0/321067338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c1e1f84ae0 con 0x55c1e210bf50 2023-10-06T02:24:55.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.963+0000 7ff9367fc700 1 -- 172.21.15.6:0/321067338 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff928007050 con 0x55c1e210bf50 2023-10-06T02:24:55.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.963+0000 7ff9367fc700 1 --2- 172.21.15.6:0/321067338 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff9200658c0 0x7ff920067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.963+0000 7ff9367fc700 1 -- 172.21.15.6:0/321067338 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff928084700 con 0x55c1e210bf50 2023-10-06T02:24:55.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.963+0000 7ff93dd0d700 1 --2- 172.21.15.6:0/321067338 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff9200658c0 0x7ff920067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.963+0000 7ff944ad2000 1 --2- 172.21.15.6:0/321067338 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55c1e2067e10 0x55c1e20fe670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.964+0000 7ff944ad2000 1 -- 172.21.15.6:0/321067338 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:1 14.13 14:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55c1e20fbd40 con 0x55c1e2067e10 2023-10-06T02:24:55.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.964+0000 7ff93e50e700 1 --2- 172.21.15.6:0/321067338 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55c1e2067e10 0x55c1e20fe670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.964+0000 7ff93dd0d700 1 --2- 172.21.15.6:0/321067338 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff9200658c0 0x7ff920067d70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff938008410 tx=0x7ff938012000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.964+0000 7ff93e50e700 1 --2- 172.21.15.6:0/321067338 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55c1e2067e10 0x55c1e20fe670 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.964+0000 7ff93e50e700 1 -- 172.21.15.6:0/321067338 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(1 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x7ff93000cb20 con 0x55c1e2067e10 2023-10-06T02:24:55.973 INFO:teuthology.orchestra.run.smithi006.stdout:header (274 bytes) : 2023-10-06T02:24:55.973 INFO:teuthology.orchestra.run.smithi006.stdout:00000000 04 03 0c 01 00 00 01 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.973 INFO:teuthology.orchestra.run.smithi006.stdout:00000010 00 00 00 00 00 00 03 02 28 00 00 00 00 00 00 00 |........(.......| 2023-10-06T02:24:55.973 INFO:teuthology.orchestra.run.smithi006.stdout:00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.973 INFO:teuthology.orchestra.run.smithi006.stdout:00000030 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.973 INFO:teuthology.orchestra.run.smithi006.stdout:00000040 00 00 00 00 03 02 28 00 00 00 00 00 00 00 00 00 |......(.........| 2023-10-06T02:24:55.973 INFO:teuthology.orchestra.run.smithi006.stdout:00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.974 INFO:teuthology.orchestra.run.smithi006.stdout:00000060 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.975 INFO:teuthology.orchestra.run.smithi006.stdout:00000070 00 00 03 02 38 00 00 00 00 00 00 00 00 00 00 00 |....8...........| 2023-10-06T02:24:55.975 INFO:teuthology.orchestra.run.smithi006.stdout:00000080 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.975 INFO:teuthology.orchestra.run.smithi006.stdout:00000090 0a 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.975 INFO:teuthology.orchestra.run.smithi006.stdout:000000a0 00 00 00 00 00 00 00 00 e8 6f 1f 65 f6 31 26 3a |.........o.e.1&:| 2023-10-06T02:24:55.975 INFO:teuthology.orchestra.run.smithi006.stdout:000000b0 03 02 38 00 00 00 00 00 00 00 00 00 00 00 00 00 |..8.............| 2023-10-06T02:24:55.975 INFO:teuthology.orchestra.run.smithi006.stdout:000000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 0a 00 |................| 2023-10-06T02:24:55.976 INFO:teuthology.orchestra.run.smithi006.stdout:000000d0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.976 INFO:teuthology.orchestra.run.smithi006.stdout:000000e0 00 00 00 00 00 00 e8 6f 1f 65 f6 31 26 3a 00 00 |.......o.e.1&:..| 2023-10-06T02:24:55.976 INFO:teuthology.orchestra.run.smithi006.stdout:000000f0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:55.976 INFO:teuthology.orchestra.run.smithi006.stdout:* 2023-10-06T02:24:55.976 INFO:teuthology.orchestra.run.smithi006.stdout:00000110 00 00 |..| 2023-10-06T02:24:55.976 INFO:teuthology.orchestra.run.smithi006.stdout:00000112 2023-10-06T02:24:55.976 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:55.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.964+0000 7ff944ad2000 1 -- 172.21.15.6:0/321067338 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55c1e2067e10 msgr2=0x55c1e20fe670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.964+0000 7ff944ad2000 1 --2- 172.21.15.6:0/321067338 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55c1e2067e10 0x55c1e20fe670 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.964+0000 7ff944ad2000 1 -- 172.21.15.6:0/321067338 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff9200658c0 msgr2=0x7ff920067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.964+0000 7ff944ad2000 1 --2- 172.21.15.6:0/321067338 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff9200658c0 0x7ff920067d70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff938008410 tx=0x7ff938012000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.964+0000 7ff944ad2000 1 -- 172.21.15.6:0/321067338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1e210bf50 msgr2=0x55c1e2079460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.964+0000 7ff944ad2000 1 --2- 172.21.15.6:0/321067338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1e210bf50 0x55c1e2079460 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7ff92800aa40 tx=0x7ff928015000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.965+0000 7ff93e50e700 1 -- 172.21.15.6:0/321067338 reap_dead start 2023-10-06T02:24:55.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.965+0000 7ff944ad2000 1 -- 172.21.15.6:0/321067338 shutdown_connections 2023-10-06T02:24:55.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.965+0000 7ff944ad2000 1 -- 172.21.15.6:0/321067338 >> 172.21.15.6:0/321067338 conn(0x55c1e207ebd0 msgr2=0x55c1e2081950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.965+0000 7ff944ad2000 1 -- 172.21.15.6:0/321067338 shutdown_connections 2023-10-06T02:24:55.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:55.965+0000 7ff944ad2000 1 -- 172.21.15.6:0/321067338 wait complete. 2023-10-06T02:24:55.979 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader mds0_sessionmap 2023-10-06T02:24:56.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.054+0000 7f46c603e000 1 Processor -- start 2023-10-06T02:24:56.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.054+0000 7f46c603e000 1 -- start start 2023-10-06T02:24:56.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.055+0000 7f46c603e000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562555553e30 0x5625555f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.055+0000 7f46c603e000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625555fcf50 0x5625555fbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.055+0000 7f46c603e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625555ffb50 0x5625555facd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.055+0000 7f46c603e000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562555473620 con 0x5625555fcf50 2023-10-06T02:24:56.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.055+0000 7f46c603e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56255546a400 con 0x5625555ffb50 2023-10-06T02:24:56.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.055+0000 7f46c603e000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625555f8a90 con 0x562555553e30 2023-10-06T02:24:56.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.055+0000 7f46bea78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625555fcf50 0x5625555fbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.055+0000 7f46bea78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625555fcf50 0x5625555fbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58958/0 (socket says 172.21.15.6:58958) 2023-10-06T02:24:56.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.055+0000 7f46bea78700 1 -- 172.21.15.6:0/1002350057 learned_addr learned my addr 172.21.15.6:0/1002350057 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.055+0000 7f46bf279700 1 --2- 172.21.15.6:0/1002350057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562555553e30 0x5625555f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.055+0000 7f46bfa7a700 1 --2- 172.21.15.6:0/1002350057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625555ffb50 0x5625555facd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.055+0000 7f46bea78700 1 -- 172.21.15.6:0/1002350057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562555553e30 msgr2=0x5625555f7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.055+0000 7f46bea78700 1 --2- 172.21.15.6:0/1002350057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562555553e30 0x5625555f7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.055+0000 7f46bea78700 1 -- 172.21.15.6:0/1002350057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625555ffb50 msgr2=0x5625555facd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.055+0000 7f46bea78700 1 --2- 172.21.15.6:0/1002350057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625555ffb50 0x5625555facd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.055+0000 7f46bea78700 1 -- 172.21.15.6:0/1002350057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b0005db0 con 0x5625555fcf50 2023-10-06T02:24:56.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.055+0000 7f46bea78700 1 --2- 172.21.15.6:0/1002350057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625555fcf50 0x5625555fbc30 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009980 tx=0x7f46b400c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d8440a3158755a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.056+0000 7f46bda76700 1 -- 172.21.15.6:0/1002350057 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b400f040 con 0x5625555fcf50 2023-10-06T02:24:56.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.056+0000 7f46bda76700 1 -- 172.21.15.6:0/1002350057 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b4008af0 con 0x5625555fcf50 2023-10-06T02:24:56.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.056+0000 7f46bda76700 1 -- 172.21.15.6:0/1002350057 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4008e90 con 0x5625555fcf50 2023-10-06T02:24:56.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.056+0000 7f46c603e000 1 -- 172.21.15.6:0/1002350057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625555fcf50 msgr2=0x5625555fbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.056+0000 7f46c603e000 1 --2- 172.21.15.6:0/1002350057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625555fcf50 0x5625555fbc30 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009980 tx=0x7f46b400c040 comp rx=0 tx=0).stop 2023-10-06T02:24:56.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.056+0000 7f46c603e000 1 -- 172.21.15.6:0/1002350057 shutdown_connections 2023-10-06T02:24:56.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.056+0000 7f46c603e000 1 --2- 172.21.15.6:0/1002350057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625555ffb50 0x5625555facd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.056+0000 7f46c603e000 1 --2- 172.21.15.6:0/1002350057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562555553e30 0x5625555f7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.056+0000 7f46c603e000 1 --2- 172.21.15.6:0/1002350057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625555fcf50 0x5625555fbc30 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.056+0000 7f46c603e000 1 -- 172.21.15.6:0/1002350057 >> 172.21.15.6:0/1002350057 conn(0x56255556fbd0 msgr2=0x56255556ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.056+0000 7f46c603e000 1 -- 172.21.15.6:0/1002350057 shutdown_connections 2023-10-06T02:24:56.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.056+0000 7f46c603e000 1 -- 172.21.15.6:0/1002350057 wait complete. 2023-10-06T02:24:56.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.057+0000 7f46c603e000 1 Processor -- start 2023-10-06T02:24:56.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.057+0000 7f46c603e000 1 -- start start 2023-10-06T02:24:56.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.057+0000 7f46c603e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562555553e30 0x5625555f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.057+0000 7f46c603e000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625555fcf50 0x5625555722b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.057+0000 7f46c603e000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5625555ffb50 0x5625555f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.057+0000 7f46c603e000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625555f43d0 con 0x5625555fcf50 2023-10-06T02:24:56.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.057+0000 7f46c603e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625555f5bb0 con 0x562555553e30 2023-10-06T02:24:56.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.057+0000 7f46c603e000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625555f3e90 con 0x5625555ffb50 2023-10-06T02:24:56.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.058+0000 7f46bea78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625555fcf50 0x5625555722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.058+0000 7f46bea78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625555fcf50 0x5625555722b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58972/0 (socket says 172.21.15.6:58972) 2023-10-06T02:24:56.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.058+0000 7f46bea78700 1 -- 172.21.15.6:0/939771257 learned_addr learned my addr 172.21.15.6:0/939771257 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.058+0000 7f46bf279700 1 --2- 172.21.15.6:0/939771257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562555553e30 0x5625555f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.058+0000 7f46bfa7a700 1 --2- 172.21.15.6:0/939771257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5625555ffb50 0x5625555f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.058+0000 7f46bea78700 1 -- 172.21.15.6:0/939771257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5625555ffb50 msgr2=0x5625555f2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.058+0000 7f46bea78700 1 --2- 172.21.15.6:0/939771257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5625555ffb50 0x5625555f2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.058+0000 7f46bea78700 1 -- 172.21.15.6:0/939771257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562555553e30 msgr2=0x5625555f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.058+0000 7f46bea78700 1 --2- 172.21.15.6:0/939771257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562555553e30 0x5625555f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.058+0000 7f46bea78700 1 -- 172.21.15.6:0/939771257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4009580 con 0x5625555fcf50 2023-10-06T02:24:56.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.058+0000 7f46bea78700 1 --2- 172.21.15.6:0/939771257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625555fcf50 0x5625555722b0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f46b40086a0 tx=0x7f46b4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.058+0000 7f46a7fff700 1 -- 172.21.15.6:0/939771257 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b400f030 con 0x5625555fcf50 2023-10-06T02:24:56.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.058+0000 7f46a7fff700 1 -- 172.21.15.6:0/939771257 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b4013b10 con 0x5625555fcf50 2023-10-06T02:24:56.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.058+0000 7f46c603e000 1 -- 172.21.15.6:0/939771257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56255549c1c0 con 0x5625555fcf50 2023-10-06T02:24:56.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.058+0000 7f46a7fff700 1 -- 172.21.15.6:0/939771257 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b401c420 con 0x5625555fcf50 2023-10-06T02:24:56.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.058+0000 7f46c603e000 1 -- 172.21.15.6:0/939771257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625554823d0 con 0x5625555fcf50 2023-10-06T02:24:56.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.060+0000 7f46a7fff700 1 -- 172.21.15.6:0/939771257 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46b401c850 con 0x5625555fcf50 2023-10-06T02:24:56.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.060+0000 7f46a7fff700 1 --2- 172.21.15.6:0/939771257 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f46ac065890 0x7f46ac067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.060+0000 7f46a7fff700 1 -- 172.21.15.6:0/939771257 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f46b4085200 con 0x5625555fcf50 2023-10-06T02:24:56.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.060+0000 7f46bf279700 1 --2- 172.21.15.6:0/939771257 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f46ac065890 0x7f46ac067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.060+0000 7f46c603e000 1 --2- 172.21.15.6:0/939771257 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5625555f2e60 0x56255560fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.060+0000 7f46c603e000 1 -- 172.21.15.6:0/939771257 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x5625555f29c0 con 0x5625555f2e60 2023-10-06T02:24:56.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.060+0000 7f46bfa7a700 1 --2- 172.21.15.6:0/939771257 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5625555f2e60 0x56255560fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.061+0000 7f46bf279700 1 --2- 172.21.15.6:0/939771257 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f46ac065890 0x7f46ac067d40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f46b0008fd0 tx=0x7f46b0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.061+0000 7f46bfa7a700 1 --2- 172.21.15.6:0/939771257 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5625555f2e60 0x56255560fd70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.061+0000 7f46bfa7a700 1 -- 172.21.15.6:0/939771257 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv3 ondisk = 0) v8 ==== 159+0+14 (crc 0 0 0) 0x7f46b800bc10 con 0x5625555f2e60 2023-10-06T02:24:56.068 INFO:teuthology.orchestra.run.smithi006.stdout:header (14 bytes) : 2023-10-06T02:24:56.068 INFO:teuthology.orchestra.run.smithi006.stdout:00000000 01 01 08 00 00 00 04 00 00 00 00 00 00 00 |..............| 2023-10-06T02:24:56.068 INFO:teuthology.orchestra.run.smithi006.stdout:0000000e 2023-10-06T02:24:56.068 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.061+0000 7f46c603e000 1 -- 172.21.15.6:0/939771257 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5625555f2e60 msgr2=0x56255560fd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.061+0000 7f46c603e000 1 --2- 172.21.15.6:0/939771257 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5625555f2e60 0x56255560fd70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.061+0000 7f46c603e000 1 -- 172.21.15.6:0/939771257 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f46ac065890 msgr2=0x7f46ac067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.061+0000 7f46c603e000 1 --2- 172.21.15.6:0/939771257 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f46ac065890 0x7f46ac067d40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f46b0008fd0 tx=0x7f46b0016000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.061+0000 7f46c603e000 1 -- 172.21.15.6:0/939771257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625555fcf50 msgr2=0x5625555722b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.061+0000 7f46c603e000 1 --2- 172.21.15.6:0/939771257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625555fcf50 0x5625555722b0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f46b40086a0 tx=0x7f46b4018000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.061+0000 7f46bfa7a700 1 -- 172.21.15.6:0/939771257 reap_dead start 2023-10-06T02:24:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.061+0000 7f46c603e000 1 -- 172.21.15.6:0/939771257 shutdown_connections 2023-10-06T02:24:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.061+0000 7f46c603e000 1 -- 172.21.15.6:0/939771257 >> 172.21.15.6:0/939771257 conn(0x56255556fbd0 msgr2=0x56255556ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.061+0000 7f46c603e000 1 -- 172.21.15.6:0/939771257 shutdown_connections 2023-10-06T02:24:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.061+0000 7f46c603e000 1 -- 172.21.15.6:0/939771257 wait complete. 2023-10-06T02:24:56.071 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 400.00000000 2023-10-06T02:24:56.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.147+0000 7f40c5222000 1 Processor -- start 2023-10-06T02:24:56.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.147+0000 7f40c5222000 1 -- start start 2023-10-06T02:24:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.147+0000 7f40c5222000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c89762e680 0x55c8975ff600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.147+0000 7f40c5222000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c897630ab0 0x55c89764b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.147+0000 7f40c5222000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c897630e80 0x55c89762bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.148+0000 7f40c5222000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89754c980 con 0x55c89762e680 2023-10-06T02:24:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.148+0000 7f40c5222000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89754c620 con 0x55c897630e80 2023-10-06T02:24:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.148+0000 7f40c5222000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c897543400 con 0x55c897630ab0 2023-10-06T02:24:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.148+0000 7f40be45d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c89762e680 0x55c8975ff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.148+0000 7f40be45d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c89762e680 0x55c8975ff600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58990/0 (socket says 172.21.15.6:58990) 2023-10-06T02:24:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.148+0000 7f40be45d700 1 -- 172.21.15.6:0/2624124305 learned_addr learned my addr 172.21.15.6:0/2624124305 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.148+0000 7f40be45d700 1 -- 172.21.15.6:0/2624124305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c897630ab0 msgr2=0x55c89764b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.148+0000 7f40be45d700 1 --2- 172.21.15.6:0/2624124305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c897630ab0 0x55c89764b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.148+0000 7f40be45d700 1 -- 172.21.15.6:0/2624124305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c897630e80 msgr2=0x55c89762bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.148+0000 7f40be45d700 1 --2- 172.21.15.6:0/2624124305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c897630e80 0x55c89762bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.148+0000 7f40be45d700 1 -- 172.21.15.6:0/2624124305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b0005cf0 con 0x55c89762e680 2023-10-06T02:24:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.148+0000 7f40be45d700 1 --2- 172.21.15.6:0/2624124305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c89762e680 0x55c8975ff600 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f40b0005a90 tx=0x7f40b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abdc9c1411a61742 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.148+0000 7f40bcc5a700 1 -- 172.21.15.6:0/2624124305 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b0000bc0 con 0x55c89762e680 2023-10-06T02:24:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.148+0000 7f40bcc5a700 1 -- 172.21.15.6:0/2624124305 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b00089d0 con 0x55c89762e680 2023-10-06T02:24:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.148+0000 7f40bcc5a700 1 -- 172.21.15.6:0/2624124305 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b0000d20 con 0x55c89762e680 2023-10-06T02:24:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.149+0000 7f40c5222000 1 -- 172.21.15.6:0/2624124305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c89762e680 msgr2=0x55c8975ff600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.149+0000 7f40c5222000 1 --2- 172.21.15.6:0/2624124305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c89762e680 0x55c8975ff600 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f40b0005a90 tx=0x7f40b0016000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.149+0000 7f40c5222000 1 -- 172.21.15.6:0/2624124305 shutdown_connections 2023-10-06T02:24:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.149+0000 7f40c5222000 1 --2- 172.21.15.6:0/2624124305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c897630e80 0x55c89762bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.149+0000 7f40c5222000 1 --2- 172.21.15.6:0/2624124305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c89762e680 0x55c8975ff600 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.149+0000 7f40c5222000 1 --2- 172.21.15.6:0/2624124305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c897630ab0 0x55c89764b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.149+0000 7f40c5222000 1 -- 172.21.15.6:0/2624124305 >> 172.21.15.6:0/2624124305 conn(0x55c897648bd0 msgr2=0x55c8976002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.149+0000 7f40c5222000 1 -- 172.21.15.6:0/2624124305 shutdown_connections 2023-10-06T02:24:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.149+0000 7f40c5222000 1 -- 172.21.15.6:0/2624124305 wait complete. 2023-10-06T02:24:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.149+0000 7f40c5222000 1 Processor -- start 2023-10-06T02:24:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.149+0000 7f40c5222000 1 -- start start 2023-10-06T02:24:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.150+0000 7f40c5222000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c89762e680 0x55c8976cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.150+0000 7f40c5222000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c897630ab0 0x55c89762d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.150+0000 7f40c5222000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c897630e80 0x55c89762d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.150+0000 7f40c5222000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8976e0db0 con 0x55c897630ab0 2023-10-06T02:24:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.150+0000 7f40c5222000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8976e1050 con 0x55c897630e80 2023-10-06T02:24:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.150+0000 7f40c5222000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8976e1c80 con 0x55c89762e680 2023-10-06T02:24:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.150+0000 7f40bdc5c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c897630ab0 0x55c89762d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.150+0000 7f40bdc5c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c897630ab0 0x55c89762d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58992/0 (socket says 172.21.15.6:58992) 2023-10-06T02:24:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.150+0000 7f40bdc5c700 1 -- 172.21.15.6:0/962356142 learned_addr learned my addr 172.21.15.6:0/962356142 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.150+0000 7f40bec5e700 1 --2- 172.21.15.6:0/962356142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c897630e80 0x55c89762d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.150+0000 7f40be45d700 1 --2- 172.21.15.6:0/962356142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c89762e680 0x55c8976cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.150+0000 7f40bdc5c700 1 -- 172.21.15.6:0/962356142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c89762e680 msgr2=0x55c8976cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.150+0000 7f40bdc5c700 1 --2- 172.21.15.6:0/962356142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c89762e680 0x55c8976cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.150+0000 7f40bdc5c700 1 -- 172.21.15.6:0/962356142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c897630e80 msgr2=0x55c89762d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.150+0000 7f40bdc5c700 1 --2- 172.21.15.6:0/962356142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c897630e80 0x55c89762d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.150+0000 7f40bdc5c700 1 -- 172.21.15.6:0/962356142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8975751c0 con 0x55c897630ab0 2023-10-06T02:24:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.151+0000 7f40bdc5c700 1 --2- 172.21.15.6:0/962356142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c897630ab0 0x55c89762d410 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f40b4008780 tx=0x7f40b4005ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.151+0000 7f40aeffd700 1 -- 172.21.15.6:0/962356142 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b400f070 con 0x55c897630ab0 2023-10-06T02:24:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.151+0000 7f40aeffd700 1 -- 172.21.15.6:0/962356142 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b4006470 con 0x55c897630ab0 2023-10-06T02:24:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.151+0000 7f40aeffd700 1 -- 172.21.15.6:0/962356142 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4006830 con 0x55c897630ab0 2023-10-06T02:24:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.151+0000 7f40c5222000 1 -- 172.21.15.6:0/962356142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c89755b3d0 con 0x55c897630ab0 2023-10-06T02:24:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.151+0000 7f40c5222000 1 -- 172.21.15.6:0/962356142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c89754eae0 con 0x55c897630ab0 2023-10-06T02:24:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.152+0000 7f40aeffd700 1 -- 172.21.15.6:0/962356142 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40b4013070 con 0x55c897630ab0 2023-10-06T02:24:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.152+0000 7f40aeffd700 1 --2- 172.21.15.6:0/962356142 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f40a0065890 0x7f40a0067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.153+0000 7f40aeffd700 1 -- 172.21.15.6:0/962356142 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f40b4082d70 con 0x55c897630ab0 2023-10-06T02:24:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.153+0000 7f40be45d700 1 --2- 172.21.15.6:0/962356142 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f40a0065890 0x7f40a0067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.153+0000 7f40c5222000 1 --2- 172.21.15.6:0/962356142 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c8976e08c0 0x55c8976df7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.153+0000 7f40c5222000 1 -- 172.21.15.6:0/962356142 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55c897648fa0 con 0x55c8976e08c0 2023-10-06T02:24:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.153+0000 7f40bec5e700 1 --2- 172.21.15.6:0/962356142 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c8976e08c0 0x55c8976df7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.153+0000 7f40be45d700 1 --2- 172.21.15.6:0/962356142 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f40a0065890 0x7f40a0067d40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f40b0025000 tx=0x7f40b001e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.153+0000 7f40bec5e700 1 --2- 172.21.15.6:0/962356142 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c8976e08c0 0x55c8976df7f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.154+0000 7f40bec5e700 1 -- 172.21.15.6:0/962356142 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(1 400.00000000 [omap-get-header] v0'0 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f40b8001940 con 0x55c8976e08c0 2023-10-06T02:24:56.161 INFO:teuthology.orchestra.run.smithi006.stdout:header (0 bytes) : 2023-10-06T02:24:56.162 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.154+0000 7f40c5222000 1 -- 172.21.15.6:0/962356142 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c8976e08c0 msgr2=0x55c8976df7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.154+0000 7f40c5222000 1 --2- 172.21.15.6:0/962356142 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c8976e08c0 0x55c8976df7f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.154+0000 7f40c5222000 1 -- 172.21.15.6:0/962356142 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f40a0065890 msgr2=0x7f40a0067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.154+0000 7f40c5222000 1 --2- 172.21.15.6:0/962356142 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f40a0065890 0x7f40a0067d40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f40b0025000 tx=0x7f40b001e000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.154+0000 7f40c5222000 1 -- 172.21.15.6:0/962356142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c897630ab0 msgr2=0x55c89762d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.154+0000 7f40c5222000 1 --2- 172.21.15.6:0/962356142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c897630ab0 0x55c89762d410 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f40b4008780 tx=0x7f40b4005ba0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.154+0000 7f40bec5e700 1 -- 172.21.15.6:0/962356142 reap_dead start 2023-10-06T02:24:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.154+0000 7f40c5222000 1 -- 172.21.15.6:0/962356142 shutdown_connections 2023-10-06T02:24:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.154+0000 7f40c5222000 1 -- 172.21.15.6:0/962356142 >> 172.21.15.6:0/962356142 conn(0x55c897648bd0 msgr2=0x55c89764b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.154+0000 7f40c5222000 1 -- 172.21.15.6:0/962356142 shutdown_connections 2023-10-06T02:24:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.154+0000 7f40c5222000 1 -- 172.21.15.6:0/962356142 wait complete. 2023-10-06T02:24:56.165 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 100.00000000.inode 2023-10-06T02:24:56.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.239+0000 7f7bde2df000 1 Processor -- start 2023-10-06T02:24:56.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.239+0000 7f7bde2df000 1 -- start start 2023-10-06T02:24:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.240+0000 7f7bde2df000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558841705d60 0x558841708840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.240+0000 7f7bde2df000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558841721410 0x5588417b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.240+0000 7f7bde2df000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5588417b0f90 0x558841706c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.240+0000 7f7bde2df000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558841625980 con 0x558841705d60 2023-10-06T02:24:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.240+0000 7f7bde2df000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558841625620 con 0x558841721410 2023-10-06T02:24:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.240+0000 7f7bde2df000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55884161c400 con 0x5588417b0f90 2023-10-06T02:24:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.240+0000 7f7bd751a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558841705d60 0x558841708840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.240+0000 7f7bd751a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558841705d60 0x558841708840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59000/0 (socket says 172.21.15.6:59000) 2023-10-06T02:24:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.240+0000 7f7bd751a700 1 -- 172.21.15.6:0/1196454578 learned_addr learned my addr 172.21.15.6:0/1196454578 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.240+0000 7f7bd7d1b700 1 --2- 172.21.15.6:0/1196454578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5588417b0f90 0x558841706c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.240+0000 7f7bd6d19700 1 --2- 172.21.15.6:0/1196454578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558841721410 0x5588417b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bd751a700 1 -- 172.21.15.6:0/1196454578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5588417b0f90 msgr2=0x558841706c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bd751a700 1 --2- 172.21.15.6:0/1196454578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5588417b0f90 0x558841706c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bd751a700 1 -- 172.21.15.6:0/1196454578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558841721410 msgr2=0x5588417b84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bd751a700 1 --2- 172.21.15.6:0/1196454578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558841721410 0x5588417b84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bd751a700 1 -- 172.21.15.6:0/1196454578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc0005cf0 con 0x558841705d60 2023-10-06T02:24:56.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bd7d1b700 1 --2- 172.21.15.6:0/1196454578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5588417b0f90 0x558841706c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:56.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bd751a700 1 --2- 172.21.15.6:0/1196454578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558841705d60 0x558841708840 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00055b0 tx=0x7f7bd0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19c1ba339483015 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bd5d17700 1 -- 172.21.15.6:0/1196454578 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0000bc0 con 0x558841705d60 2023-10-06T02:24:56.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bd5d17700 1 -- 172.21.15.6:0/1196454578 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd00078e0 con 0x558841705d60 2023-10-06T02:24:56.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bd5d17700 1 -- 172.21.15.6:0/1196454578 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd001c410 con 0x558841705d60 2023-10-06T02:24:56.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bde2df000 1 -- 172.21.15.6:0/1196454578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558841705d60 msgr2=0x558841708840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bde2df000 1 --2- 172.21.15.6:0/1196454578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558841705d60 0x558841708840 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00055b0 tx=0x7f7bd0015000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bde2df000 1 -- 172.21.15.6:0/1196454578 shutdown_connections 2023-10-06T02:24:56.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bde2df000 1 --2- 172.21.15.6:0/1196454578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5588417b0f90 0x558841706c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bde2df000 1 --2- 172.21.15.6:0/1196454578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558841705d60 0x558841708840 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bde2df000 1 --2- 172.21.15.6:0/1196454578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558841721410 0x5588417b84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bde2df000 1 -- 172.21.15.6:0/1196454578 >> 172.21.15.6:0/1196454578 conn(0x5588416dad50 msgr2=0x5588417b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bde2df000 1 -- 172.21.15.6:0/1196454578 shutdown_connections 2023-10-06T02:24:56.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.241+0000 7f7bde2df000 1 -- 172.21.15.6:0/1196454578 wait complete. 2023-10-06T02:24:56.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.242+0000 7f7bde2df000 1 Processor -- start 2023-10-06T02:24:56.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.242+0000 7f7bde2df000 1 -- start start 2023-10-06T02:24:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.243+0000 7f7bde2df000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558841705d60 0x5588417b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.243+0000 7f7bde2df000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558841721410 0x5588417c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.243+0000 7f7bde2df000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5588417b0f90 0x558841706c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.243+0000 7f7bde2df000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588417a7ed0 con 0x558841721410 2023-10-06T02:24:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.243+0000 7f7bde2df000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588417b7310 con 0x558841705d60 2023-10-06T02:24:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.243+0000 7f7bde2df000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588417b75b0 con 0x5588417b0f90 2023-10-06T02:24:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.243+0000 7f7bd6d19700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558841721410 0x5588417c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.243+0000 7f7bd6d19700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558841721410 0x5588417c27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59004/0 (socket says 172.21.15.6:59004) 2023-10-06T02:24:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.243+0000 7f7bd6d19700 1 -- 172.21.15.6:0/693504091 learned_addr learned my addr 172.21.15.6:0/693504091 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.243+0000 7f7bd751a700 1 --2- 172.21.15.6:0/693504091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558841705d60 0x5588417b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.243+0000 7f7bd7d1b700 1 --2- 172.21.15.6:0/693504091 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5588417b0f90 0x558841706c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.243+0000 7f7bd6d19700 1 -- 172.21.15.6:0/693504091 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5588417b0f90 msgr2=0x558841706c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.243+0000 7f7bd6d19700 1 --2- 172.21.15.6:0/693504091 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5588417b0f90 0x558841706c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.243+0000 7f7bd6d19700 1 -- 172.21.15.6:0/693504091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558841705d60 msgr2=0x5588417b6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.243+0000 7f7bd6d19700 1 --2- 172.21.15.6:0/693504091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558841705d60 0x5588417b6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.243+0000 7f7bd6d19700 1 -- 172.21.15.6:0/693504091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55884164e1c0 con 0x558841721410 2023-10-06T02:24:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.243+0000 7f7bd6d19700 1 --2- 172.21.15.6:0/693504091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558841721410 0x5588417c27a0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0008bc0 tx=0x7f7bc000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.244+0000 7f7bcffff700 1 -- 172.21.15.6:0/693504091 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc000f040 con 0x558841721410 2023-10-06T02:24:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.244+0000 7f7bcffff700 1 -- 172.21.15.6:0/693504091 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc00108b0 con 0x558841721410 2023-10-06T02:24:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.244+0000 7f7bde2df000 1 -- 172.21.15.6:0/693504091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd0005cf0 con 0x558841721410 2023-10-06T02:24:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.244+0000 7f7bcffff700 1 -- 172.21.15.6:0/693504091 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0010c30 con 0x558841721410 2023-10-06T02:24:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.244+0000 7f7bde2df000 1 -- 172.21.15.6:0/693504091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588416343d0 con 0x558841721410 2023-10-06T02:24:56.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.245+0000 7f7bcffff700 1 -- 172.21.15.6:0/693504091 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bc0010d90 con 0x558841721410 2023-10-06T02:24:56.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.245+0000 7f7bcffff700 1 --2- 172.21.15.6:0/693504091 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bb80658c0 0x7f7bb8067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.245+0000 7f7bcffff700 1 -- 172.21.15.6:0/693504091 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7bc0084040 con 0x558841721410 2023-10-06T02:24:56.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.245+0000 7f7bd751a700 1 --2- 172.21.15.6:0/693504091 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bb80658c0 0x7f7bb8067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.245+0000 7f7bde2df000 1 --2- 172.21.15.6:0/693504091 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5588417aa1d0 0x5588417b8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.246+0000 7f7bde2df000 1 -- 172.21.15.6:0/693504091 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x5588417b8770 con 0x5588417aa1d0 2023-10-06T02:24:56.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.246+0000 7f7bd7d1b700 1 --2- 172.21.15.6:0/693504091 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5588417aa1d0 0x5588417b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.246+0000 7f7bd7d1b700 1 --2- 172.21.15.6:0/693504091 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5588417aa1d0 0x5588417b8230 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.246+0000 7f7bd751a700 1 --2- 172.21.15.6:0/693504091 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bb80658c0 0x7f7bb8067d70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00055b0 tx=0x7f7bd001c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.246+0000 7f7bd7d1b700 1 -- 172.21.15.6:0/693504091 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 100.00000000.inode [omap-get-header] v0'0 uv3 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f7bc8001b40 con 0x5588417aa1d0 2023-10-06T02:24:56.254 INFO:teuthology.orchestra.run.smithi006.stdout:header (0 bytes) : 2023-10-06T02:24:56.254 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:56.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.246+0000 7f7bde2df000 1 -- 172.21.15.6:0/693504091 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5588417aa1d0 msgr2=0x5588417b8230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.246+0000 7f7bde2df000 1 --2- 172.21.15.6:0/693504091 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5588417aa1d0 0x5588417b8230 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.246+0000 7f7bde2df000 1 -- 172.21.15.6:0/693504091 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bb80658c0 msgr2=0x7f7bb8067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.246+0000 7f7bde2df000 1 --2- 172.21.15.6:0/693504091 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7bb80658c0 0x7f7bb8067d70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00055b0 tx=0x7f7bd001c000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.246+0000 7f7bde2df000 1 -- 172.21.15.6:0/693504091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558841721410 msgr2=0x5588417c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.246+0000 7f7bde2df000 1 --2- 172.21.15.6:0/693504091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558841721410 0x5588417c27a0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0008bc0 tx=0x7f7bc000c040 comp rx=0 tx=0).stop 2023-10-06T02:24:56.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.246+0000 7f7bd7d1b700 1 -- 172.21.15.6:0/693504091 reap_dead start 2023-10-06T02:24:56.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.246+0000 7f7bde2df000 1 -- 172.21.15.6:0/693504091 shutdown_connections 2023-10-06T02:24:56.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.246+0000 7f7bde2df000 1 -- 172.21.15.6:0/693504091 >> 172.21.15.6:0/693504091 conn(0x5588416dad50 msgr2=0x5588416dbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.246+0000 7f7bde2df000 1 -- 172.21.15.6:0/693504091 shutdown_connections 2023-10-06T02:24:56.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.246+0000 7f7bde2df000 1 -- 172.21.15.6:0/693504091 wait complete. 2023-10-06T02:24:56.260 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapheader 1.00000000 2023-10-06T02:24:56.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.335+0000 7f6958de5000 1 Processor -- start 2023-10-06T02:24:56.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.336+0000 7f6958de5000 1 -- start start 2023-10-06T02:24:56.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.336+0000 7f6958de5000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564336724850 0x564336740bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.336+0000 7f6958de5000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564336726ab0 0x5643367d8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.336+0000 7f6958de5000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564336726e80 0x5643367d9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.336+0000 7f6958de5000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56433669e320 con 0x564336726ab0 2023-10-06T02:24:56.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.336+0000 7f6958de5000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564336642980 con 0x564336724850 2023-10-06T02:24:56.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.336+0000 7f6958de5000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564336642620 con 0x564336726e80 2023-10-06T02:24:56.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.336+0000 7f695181f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564336726ab0 0x5643367d8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.336+0000 7f695181f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564336726ab0 0x5643367d8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59018/0 (socket says 172.21.15.6:59018) 2023-10-06T02:24:56.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.336+0000 7f695181f700 1 -- 172.21.15.6:0/1271660451 learned_addr learned my addr 172.21.15.6:0/1271660451 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f6952020700 1 --2- 172.21.15.6:0/1271660451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564336724850 0x564336740bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f6952821700 1 --2- 172.21.15.6:0/1271660451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564336726e80 0x5643367d9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f695181f700 1 -- 172.21.15.6:0/1271660451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564336726e80 msgr2=0x5643367d9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f695181f700 1 --2- 172.21.15.6:0/1271660451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564336726e80 0x5643367d9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f695181f700 1 -- 172.21.15.6:0/1271660451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564336724850 msgr2=0x564336740bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f695181f700 1 --2- 172.21.15.6:0/1271660451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564336724850 0x564336740bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f695181f700 1 -- 172.21.15.6:0/1271660451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6944005cf0 con 0x564336726ab0 2023-10-06T02:24:56.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f695181f700 1 --2- 172.21.15.6:0/1271660451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564336726ab0 0x5643367d8f30 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f693c001dc0 tx=0x7f693c001860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37191ad445fd3abe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f695081d700 1 -- 172.21.15.6:0/1271660451 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c014070 con 0x564336726ab0 2023-10-06T02:24:56.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f695081d700 1 -- 172.21.15.6:0/1271660451 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693c008030 con 0x564336726ab0 2023-10-06T02:24:56.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f695081d700 1 -- 172.21.15.6:0/1271660451 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c00bdc0 con 0x564336726ab0 2023-10-06T02:24:56.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f6958de5000 1 -- 172.21.15.6:0/1271660451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564336726ab0 msgr2=0x5643367d8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f6958de5000 1 --2- 172.21.15.6:0/1271660451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564336726ab0 0x5643367d8f30 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f693c001dc0 tx=0x7f693c001860 comp rx=0 tx=0).stop 2023-10-06T02:24:56.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f6958de5000 1 -- 172.21.15.6:0/1271660451 shutdown_connections 2023-10-06T02:24:56.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f6958de5000 1 --2- 172.21.15.6:0/1271660451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564336726e80 0x5643367d9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f6958de5000 1 --2- 172.21.15.6:0/1271660451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564336724850 0x564336740bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f6958de5000 1 --2- 172.21.15.6:0/1271660451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564336726ab0 0x5643367d8f30 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f6958de5000 1 -- 172.21.15.6:0/1271660451 >> 172.21.15.6:0/1271660451 conn(0x56433673ebd0 msgr2=0x5643367416e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f6958de5000 1 -- 172.21.15.6:0/1271660451 shutdown_connections 2023-10-06T02:24:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.337+0000 7f6958de5000 1 -- 172.21.15.6:0/1271660451 wait complete. 2023-10-06T02:24:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.338+0000 7f6958de5000 1 Processor -- start 2023-10-06T02:24:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.338+0000 7f6958de5000 1 -- start start 2023-10-06T02:24:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f6958de5000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564336724850 0x5643367c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f6958de5000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564336726ab0 0x5643367d8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f6958de5000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564336726e80 0x5643367d9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f6958de5000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564336639400 con 0x564336726e80 2023-10-06T02:24:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f6958de5000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643366faed0 con 0x564336724850 2023-10-06T02:24:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f6958de5000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643367d3800 con 0x564336726ab0 2023-10-06T02:24:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f6952821700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564336726e80 0x5643367d9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f6952821700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564336726e80 0x5643367d9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59034/0 (socket says 172.21.15.6:59034) 2023-10-06T02:24:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f6952821700 1 -- 172.21.15.6:0/621322039 learned_addr learned my addr 172.21.15.6:0/621322039 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f6952020700 1 --2- 172.21.15.6:0/621322039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564336724850 0x5643367c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f695181f700 1 --2- 172.21.15.6:0/621322039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564336726ab0 0x5643367d8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f6952821700 1 -- 172.21.15.6:0/621322039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564336726ab0 msgr2=0x5643367d8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f6952821700 1 --2- 172.21.15.6:0/621322039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564336726ab0 0x5643367d8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f6952821700 1 -- 172.21.15.6:0/621322039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564336724850 msgr2=0x5643367c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f6952821700 1 --2- 172.21.15.6:0/621322039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564336724850 0x5643367c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f6952821700 1 -- 172.21.15.6:0/621322039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c00a040 con 0x564336726e80 2023-10-06T02:24:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f695181f700 1 --2- 172.21.15.6:0/621322039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564336726ab0 0x5643367d8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.339+0000 7f6952821700 1 --2- 172.21.15.6:0/621322039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564336726e80 0x5643367d9400 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f694c00d590 tx=0x7f694c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.340+0000 7f694affd700 1 -- 172.21.15.6:0/621322039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c0104f0 con 0x564336726e80 2023-10-06T02:24:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.340+0000 7f694affd700 1 -- 172.21.15.6:0/621322039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c010650 con 0x564336726e80 2023-10-06T02:24:56.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.340+0000 7f6958de5000 1 -- 172.21.15.6:0/621322039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564336644ae0 con 0x564336726e80 2023-10-06T02:24:56.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.340+0000 7f694affd700 1 -- 172.21.15.6:0/621322039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c0109d0 con 0x564336726e80 2023-10-06T02:24:56.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.340+0000 7f6958de5000 1 -- 172.21.15.6:0/621322039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564336644540 con 0x564336726e80 2023-10-06T02:24:56.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.341+0000 7f694affd700 1 -- 172.21.15.6:0/621322039 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f694c010d40 con 0x564336726e80 2023-10-06T02:24:56.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.341+0000 7f694affd700 1 --2- 172.21.15.6:0/621322039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6934065890 0x7f6934067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.341+0000 7f694affd700 1 -- 172.21.15.6:0/621322039 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f694c082e80 con 0x564336726e80 2023-10-06T02:24:56.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.341+0000 7f6952020700 1 --2- 172.21.15.6:0/621322039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6934065890 0x7f6934067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.341+0000 7f6958de5000 1 --2- 172.21.15.6:0/621322039 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5643366fa950 0x5643367d4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.342+0000 7f6958de5000 1 -- 172.21.15.6:0/621322039 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.1f 14:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x5643367d53c0 con 0x5643366fa950 2023-10-06T02:24:56.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.342+0000 7f695181f700 1 --2- 172.21.15.6:0/621322039 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5643366fa950 0x5643367d4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.342+0000 7f695181f700 1 --2- 172.21.15.6:0/621322039 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5643366fa950 0x5643367d4e80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.342+0000 7f6952020700 1 --2- 172.21.15.6:0/621322039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6934065890 0x7f6934067d40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6944003080 tx=0x7f6944013000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.342+0000 7f695181f700 1 -- 172.21.15.6:0/621322039 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x7f693c016070 con 0x5643366fa950 2023-10-06T02:24:56.350 INFO:teuthology.orchestra.run.smithi006.stdout:header (274 bytes) : 2023-10-06T02:24:56.350 INFO:teuthology.orchestra.run.smithi006.stdout:00000000 04 03 0c 01 00 00 0b 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:56.350 INFO:teuthology.orchestra.run.smithi006.stdout:00000010 00 00 00 00 00 00 03 02 28 00 00 00 00 00 00 00 |........(.......| 2023-10-06T02:24:56.350 INFO:teuthology.orchestra.run.smithi006.stdout:00000020 00 00 00 00 f5 6f 1f 65 81 2e 66 11 00 00 00 00 |.....o.e..f.....| 2023-10-06T02:24:56.350 INFO:teuthology.orchestra.run.smithi006.stdout:00000030 00 00 00 00 01 00 00 00 00 00 00 00 01 00 00 00 |................| 2023-10-06T02:24:56.351 INFO:teuthology.orchestra.run.smithi006.stdout:00000040 00 00 00 00 03 02 28 00 00 00 00 00 00 00 00 00 |......(.........| 2023-10-06T02:24:56.351 INFO:teuthology.orchestra.run.smithi006.stdout:00000050 00 00 f5 6f 1f 65 81 2e 66 11 00 00 00 00 00 00 |...o.e..f.......| 2023-10-06T02:24:56.351 INFO:teuthology.orchestra.run.smithi006.stdout:00000060 00 00 01 00 00 00 00 00 00 00 01 00 00 00 00 00 |................| 2023-10-06T02:24:56.351 INFO:teuthology.orchestra.run.smithi006.stdout:00000070 00 00 03 02 38 00 00 00 00 00 00 00 00 00 00 00 |....8...........| 2023-10-06T02:24:56.351 INFO:teuthology.orchestra.run.smithi006.stdout:00000080 00 00 60 00 00 00 00 00 01 00 00 00 00 00 00 00 |..`.............| 2023-10-06T02:24:56.351 INFO:teuthology.orchestra.run.smithi006.stdout:00000090 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:56.351 INFO:teuthology.orchestra.run.smithi006.stdout:000000a0 00 00 00 00 00 00 00 00 f5 6f 1f 65 53 c5 46 17 |.........o.eS.F.| 2023-10-06T02:24:56.351 INFO:teuthology.orchestra.run.smithi006.stdout:000000b0 03 02 38 00 00 00 00 00 00 00 00 00 00 00 00 00 |..8.............| 2023-10-06T02:24:56.351 INFO:teuthology.orchestra.run.smithi006.stdout:000000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 00 |................| 2023-10-06T02:24:56.351 INFO:teuthology.orchestra.run.smithi006.stdout:000000d0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:56.351 INFO:teuthology.orchestra.run.smithi006.stdout:000000e0 00 00 00 00 00 00 f5 6f 1f 65 81 2e 66 11 00 00 |.......o.e..f...| 2023-10-06T02:24:56.351 INFO:teuthology.orchestra.run.smithi006.stdout:000000f0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2023-10-06T02:24:56.352 INFO:teuthology.orchestra.run.smithi006.stdout:* 2023-10-06T02:24:56.352 INFO:teuthology.orchestra.run.smithi006.stdout:00000110 00 00 |..| 2023-10-06T02:24:56.352 INFO:teuthology.orchestra.run.smithi006.stdout:00000112 2023-10-06T02:24:56.352 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:24:56.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.342+0000 7f6958de5000 1 -- 172.21.15.6:0/621322039 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5643366fa950 msgr2=0x5643367d4e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.342+0000 7f6958de5000 1 --2- 172.21.15.6:0/621322039 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5643366fa950 0x5643367d4e80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.342+0000 7f6958de5000 1 -- 172.21.15.6:0/621322039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6934065890 msgr2=0x7f6934067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.342+0000 7f6958de5000 1 --2- 172.21.15.6:0/621322039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6934065890 0x7f6934067d40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6944003080 tx=0x7f6944013000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.342+0000 7f6958de5000 1 -- 172.21.15.6:0/621322039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564336726e80 msgr2=0x5643367d9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.342+0000 7f6958de5000 1 --2- 172.21.15.6:0/621322039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564336726e80 0x5643367d9400 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f694c00d590 tx=0x7f694c000f40 comp rx=0 tx=0).stop 2023-10-06T02:24:56.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.342+0000 7f6952821700 1 -- 172.21.15.6:0/621322039 reap_dead start 2023-10-06T02:24:56.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.342+0000 7f6958de5000 1 -- 172.21.15.6:0/621322039 shutdown_connections 2023-10-06T02:24:56.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.342+0000 7f6958de5000 1 -- 172.21.15.6:0/621322039 >> 172.21.15.6:0/621322039 conn(0x56433673ebd0 msgr2=0x564336740bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.343+0000 7f6958de5000 1 -- 172.21.15.6:0/621322039 shutdown_connections 2023-10-06T02:24:56.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.343+0000 7f6958de5000 1 -- 172.21.15.6:0/621322039 wait complete. 2023-10-06T02:24:56.354 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000 2023-10-06T02:24:56.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.431+0000 7f32de475000 1 Processor -- start 2023-10-06T02:24:56.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.431+0000 7f32de475000 1 -- start start 2023-10-06T02:24:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.432+0000 7f32de475000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55827a24b410 0x55827a2055a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.432+0000 7f32de475000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55827a24b810 0x55827a2dc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.432+0000 7f32de475000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55827a2daf90 0x55827a2dcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.432+0000 7f32de475000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55827a14f980 con 0x55827a24b410 2023-10-06T02:24:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.432+0000 7f32de475000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55827a14f620 con 0x55827a24b810 2023-10-06T02:24:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.432+0000 7f32de475000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55827a146400 con 0x55827a2daf90 2023-10-06T02:24:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.432+0000 7f32d76b0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55827a24b410 0x55827a2055a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.432+0000 7f32d76b0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55827a24b410 0x55827a2055a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59040/0 (socket says 172.21.15.6:59040) 2023-10-06T02:24:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.432+0000 7f32d76b0700 1 -- 172.21.15.6:0/145212474 learned_addr learned my addr 172.21.15.6:0/145212474 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.432+0000 7f32d76b0700 1 -- 172.21.15.6:0/145212474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55827a2daf90 msgr2=0x55827a2dcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.432+0000 7f32d6eaf700 1 --2- 172.21.15.6:0/145212474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55827a24b810 0x55827a2dc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.432+0000 7f32d76b0700 1 --2- 172.21.15.6:0/145212474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55827a2daf90 0x55827a2dcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.432+0000 7f32d76b0700 1 -- 172.21.15.6:0/145212474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55827a24b810 msgr2=0x55827a2dc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.432+0000 7f32d76b0700 1 --2- 172.21.15.6:0/145212474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55827a24b810 0x55827a2dc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.432+0000 7f32d76b0700 1 -- 172.21.15.6:0/145212474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc005cf0 con 0x55827a24b410 2023-10-06T02:24:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.432+0000 7f32d76b0700 1 --2- 172.21.15.6:0/145212474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55827a24b410 0x55827a2055a0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f32c800b690 tx=0x7f32c8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ffed32da5bf5a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.432+0000 7f32d5ead700 1 -- 172.21.15.6:0/145212474 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8014070 con 0x55827a24b410 2023-10-06T02:24:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.433+0000 7f32d5ead700 1 -- 172.21.15.6:0/145212474 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c800d5d0 con 0x55827a24b410 2023-10-06T02:24:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.433+0000 7f32d5ead700 1 -- 172.21.15.6:0/145212474 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c800d9b0 con 0x55827a24b410 2023-10-06T02:24:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.433+0000 7f32de475000 1 -- 172.21.15.6:0/145212474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55827a24b410 msgr2=0x55827a2055a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.433+0000 7f32de475000 1 --2- 172.21.15.6:0/145212474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55827a24b410 0x55827a2055a0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f32c800b690 tx=0x7f32c8001ae0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.433+0000 7f32de475000 1 -- 172.21.15.6:0/145212474 shutdown_connections 2023-10-06T02:24:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.433+0000 7f32de475000 1 --2- 172.21.15.6:0/145212474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55827a2daf90 0x55827a2dcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.433+0000 7f32de475000 1 --2- 172.21.15.6:0/145212474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55827a24b410 0x55827a2055a0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.433+0000 7f32de475000 1 --2- 172.21.15.6:0/145212474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55827a24b810 0x55827a2dc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.433+0000 7f32de475000 1 -- 172.21.15.6:0/145212474 >> 172.21.15.6:0/145212474 conn(0x55827a204d50 msgr2=0x55827a232840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.433+0000 7f32de475000 1 -- 172.21.15.6:0/145212474 shutdown_connections 2023-10-06T02:24:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.433+0000 7f32de475000 1 -- 172.21.15.6:0/145212474 wait complete. 2023-10-06T02:24:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.434+0000 7f32de475000 1 Processor -- start 2023-10-06T02:24:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.434+0000 7f32de475000 1 -- start start 2023-10-06T02:24:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.434+0000 7f32de475000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55827a24b410 0x55827a2055a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.434+0000 7f32de475000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55827a24b810 0x55827a205ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.434+0000 7f32de475000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55827a2daf90 0x55827a2ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.434+0000 7f32de475000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55827a233140 con 0x55827a2daf90 2023-10-06T02:24:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.434+0000 7f32de475000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55827a2cfe20 con 0x55827a24b410 2023-10-06T02:24:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.434+0000 7f32de475000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55827a2d00c0 con 0x55827a24b810 2023-10-06T02:24:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.434+0000 7f32d7eb1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55827a2daf90 0x55827a2ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.435+0000 7f32d7eb1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55827a2daf90 0x55827a2ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59044/0 (socket says 172.21.15.6:59044) 2023-10-06T02:24:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.435+0000 7f32d7eb1700 1 -- 172.21.15.6:0/3537881960 learned_addr learned my addr 172.21.15.6:0/3537881960 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.435+0000 7f32d76b0700 1 --2- 172.21.15.6:0/3537881960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55827a24b410 0x55827a2055a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.435+0000 7f32d6eaf700 1 --2- 172.21.15.6:0/3537881960 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55827a24b810 0x55827a205ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.435+0000 7f32d7eb1700 1 -- 172.21.15.6:0/3537881960 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55827a24b810 msgr2=0x55827a205ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.435+0000 7f32d7eb1700 1 --2- 172.21.15.6:0/3537881960 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55827a24b810 0x55827a205ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.435+0000 7f32d7eb1700 1 -- 172.21.15.6:0/3537881960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55827a24b410 msgr2=0x55827a2055a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.435+0000 7f32d7eb1700 1 --2- 172.21.15.6:0/3537881960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55827a24b410 0x55827a2055a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.435+0000 7f32d7eb1700 1 -- 172.21.15.6:0/3537881960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c800b210 con 0x55827a2daf90 2023-10-06T02:24:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.435+0000 7f32d7eb1700 1 --2- 172.21.15.6:0/3537881960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55827a2daf90 0x55827a2ccdb0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f32d000d8d0 tx=0x7f32d0005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.435+0000 7f32bffff700 1 -- 172.21.15.6:0/3537881960 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d00023f0 con 0x55827a2daf90 2023-10-06T02:24:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.435+0000 7f32bffff700 1 -- 172.21.15.6:0/3537881960 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d0012680 con 0x55827a2daf90 2023-10-06T02:24:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.435+0000 7f32de475000 1 -- 172.21.15.6:0/3537881960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55827a15e3d0 con 0x55827a2daf90 2023-10-06T02:24:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.435+0000 7f32bffff700 1 -- 172.21.15.6:0/3537881960 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0012a40 con 0x55827a2daf90 2023-10-06T02:24:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.435+0000 7f32de475000 1 -- 172.21.15.6:0/3537881960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55827a151ae0 con 0x55827a2daf90 2023-10-06T02:24:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.436+0000 7f32bffff700 1 -- 172.21.15.6:0/3537881960 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32d0003040 con 0x55827a2daf90 2023-10-06T02:24:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.437+0000 7f32bffff700 1 --2- 172.21.15.6:0/3537881960 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f32c40658c0 0x7f32c4067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.437+0000 7f32bffff700 1 -- 172.21.15.6:0/3537881960 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f32d00834d0 con 0x55827a2daf90 2023-10-06T02:24:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.437+0000 7f32d76b0700 1 --2- 172.21.15.6:0/3537881960 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f32c40658c0 0x7f32c4067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.437+0000 7f32de475000 1 --2- 172.21.15.6:0/3537881960 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55827a2d4650 0x55827a2d4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.437+0000 7f32de475000 1 -- 172.21.15.6:0/3537881960 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55827a231040 con 0x55827a2d4650 2023-10-06T02:24:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.437+0000 7f32d6eaf700 1 --2- 172.21.15.6:0/3537881960 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55827a2d4650 0x55827a2d4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.437+0000 7f32d76b0700 1 --2- 172.21.15.6:0/3537881960 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f32c40658c0 0x7f32c4067d70 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f32c8001b20 tx=0x7f32c8014000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.437+0000 7f32d6eaf700 1 --2- 172.21.15.6:0/3537881960 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55827a2d4650 0x55827a2d4a50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.438+0000 7f32d6eaf700 1 -- 172.21.15.6:0/3537881960 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-keys out=21b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+21 (crc 0 0 0) 0x7f32cc000bc0 con 0x55827a2d4650 2023-10-06T02:24:56.443 INFO:teuthology.orchestra.run.smithi006.stdout:sixmegs_head 2023-10-06T02:24:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.438+0000 7f32de475000 1 -- 172.21.15.6:0/3537881960 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55827a2d4650 msgr2=0x55827a2d4a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.438+0000 7f32de475000 1 --2- 172.21.15.6:0/3537881960 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55827a2d4650 0x55827a2d4a50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.438+0000 7f32de475000 1 -- 172.21.15.6:0/3537881960 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f32c40658c0 msgr2=0x7f32c4067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.438+0000 7f32de475000 1 --2- 172.21.15.6:0/3537881960 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f32c40658c0 0x7f32c4067d70 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f32c8001b20 tx=0x7f32c8014000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.438+0000 7f32de475000 1 -- 172.21.15.6:0/3537881960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55827a2daf90 msgr2=0x55827a2ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.438+0000 7f32de475000 1 --2- 172.21.15.6:0/3537881960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55827a2daf90 0x55827a2ccdb0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f32d000d8d0 tx=0x7f32d0005d40 comp rx=0 tx=0).stop 2023-10-06T02:24:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.438+0000 7f32d7eb1700 1 -- 172.21.15.6:0/3537881960 reap_dead start 2023-10-06T02:24:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.438+0000 7f32de475000 1 -- 172.21.15.6:0/3537881960 shutdown_connections 2023-10-06T02:24:56.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.438+0000 7f32de475000 1 -- 172.21.15.6:0/3537881960 >> 172.21.15.6:0/3537881960 conn(0x55827a204d50 msgr2=0x55827a2340c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.438+0000 7f32de475000 1 -- 172.21.15.6:0/3537881960 shutdown_connections 2023-10-06T02:24:56.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.438+0000 7f32de475000 1 -- 172.21.15.6:0/3537881960 wait complete. 2023-10-06T02:24:56.446 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 600.00000000 2023-10-06T02:24:56.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.522+0000 7f8b5c922000 1 Processor -- start 2023-10-06T02:24:56.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.522+0000 7f8b5c922000 1 -- start start 2023-10-06T02:24:56.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.523+0000 7f8b5c922000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565074386e30 0x56507438be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.523+0000 7f8b5c922000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5650743899e0 0x56507442dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.523+0000 7f8b5c922000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56507442ff50 0x5650743a4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.523+0000 7f8b5c922000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650742a6980 con 0x56507442ff50 2023-10-06T02:24:56.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.523+0000 7f8b5c922000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650742a6620 con 0x565074386e30 2023-10-06T02:24:56.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.523+0000 7f8b5c922000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56507429d400 con 0x5650743899e0 2023-10-06T02:24:56.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.523+0000 7f8b5635e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56507442ff50 0x5650743a4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.523+0000 7f8b5635e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56507442ff50 0x5650743a4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59054/0 (socket says 172.21.15.6:59054) 2023-10-06T02:24:56.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.523+0000 7f8b5635e700 1 -- 172.21.15.6:0/2064594196 learned_addr learned my addr 172.21.15.6:0/2064594196 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.523+0000 7f8b5535c700 1 --2- 172.21.15.6:0/2064594196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5650743899e0 0x56507442dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.523+0000 7f8b55b5d700 1 --2- 172.21.15.6:0/2064594196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565074386e30 0x56507438be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.523+0000 7f8b5635e700 1 -- 172.21.15.6:0/2064594196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5650743899e0 msgr2=0x56507442dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.523+0000 7f8b5635e700 1 --2- 172.21.15.6:0/2064594196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5650743899e0 0x56507442dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.523+0000 7f8b5635e700 1 -- 172.21.15.6:0/2064594196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565074386e30 msgr2=0x56507438be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.523+0000 7f8b5635e700 1 --2- 172.21.15.6:0/2064594196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565074386e30 0x56507438be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.524+0000 7f8b5635e700 1 -- 172.21.15.6:0/2064594196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4800a180 con 0x56507442ff50 2023-10-06T02:24:56.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.524+0000 7f8b5635e700 1 --2- 172.21.15.6:0/2064594196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56507442ff50 0x5650743a4250 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800ad90 tx=0x7f8b48013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a63ae45c32bc18 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.524+0000 7f8b4ffff700 1 -- 172.21.15.6:0/2064594196 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48005960 con 0x56507442ff50 2023-10-06T02:24:56.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.524+0000 7f8b4ffff700 1 -- 172.21.15.6:0/2064594196 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4800eda0 con 0x56507442ff50 2023-10-06T02:24:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.524+0000 7f8b4ffff700 1 -- 172.21.15.6:0/2064594196 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4800e9f0 con 0x56507442ff50 2023-10-06T02:24:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.524+0000 7f8b5c922000 1 -- 172.21.15.6:0/2064594196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56507442ff50 msgr2=0x5650743a4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.524+0000 7f8b5c922000 1 --2- 172.21.15.6:0/2064594196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56507442ff50 0x5650743a4250 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800ad90 tx=0x7f8b48013000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.524+0000 7f8b5c922000 1 -- 172.21.15.6:0/2064594196 shutdown_connections 2023-10-06T02:24:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.524+0000 7f8b5c922000 1 --2- 172.21.15.6:0/2064594196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56507442ff50 0x5650743a4250 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.524+0000 7f8b5c922000 1 --2- 172.21.15.6:0/2064594196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565074386e30 0x56507438be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.524+0000 7f8b5c922000 1 --2- 172.21.15.6:0/2064594196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5650743899e0 0x56507442dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.524+0000 7f8b5c922000 1 -- 172.21.15.6:0/2064594196 >> 172.21.15.6:0/2064594196 conn(0x5650743a2bd0 msgr2=0x5650743892d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.524+0000 7f8b5c922000 1 -- 172.21.15.6:0/2064594196 shutdown_connections 2023-10-06T02:24:56.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.524+0000 7f8b5c922000 1 -- 172.21.15.6:0/2064594196 wait complete. 2023-10-06T02:24:56.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.525+0000 7f8b5c922000 1 Processor -- start 2023-10-06T02:24:56.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.525+0000 7f8b5c922000 1 -- start start 2023-10-06T02:24:56.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b5c922000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x565074386e30 0x56507442e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b5c922000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650743899e0 0x5650744260c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b5c922000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56507442ff50 0x56507439b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b5c922000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56507442e940 con 0x5650743899e0 2023-10-06T02:24:56.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b5c922000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56507442eb90 con 0x56507442ff50 2023-10-06T02:24:56.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b5c922000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56507442ee30 con 0x565074386e30 2023-10-06T02:24:56.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b5535c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650743899e0 0x5650744260c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b5535c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650743899e0 0x5650744260c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59058/0 (socket says 172.21.15.6:59058) 2023-10-06T02:24:56.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b5535c700 1 -- 172.21.15.6:0/245934894 learned_addr learned my addr 172.21.15.6:0/245934894 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b55b5d700 1 --2- 172.21.15.6:0/245934894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x565074386e30 0x56507442e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b5635e700 1 --2- 172.21.15.6:0/245934894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56507442ff50 0x56507439b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b5535c700 1 -- 172.21.15.6:0/245934894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x565074386e30 msgr2=0x56507442e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b5535c700 1 --2- 172.21.15.6:0/245934894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x565074386e30 0x56507442e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b5535c700 1 -- 172.21.15.6:0/245934894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56507442ff50 msgr2=0x56507439b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b5535c700 1 --2- 172.21.15.6:0/245934894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56507442ff50 0x56507439b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b5535c700 1 -- 172.21.15.6:0/245934894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650742cf1c0 con 0x5650743899e0 2023-10-06T02:24:56.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b5635e700 1 --2- 172.21.15.6:0/245934894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56507442ff50 0x56507439b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:56.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b5535c700 1 --2- 172.21.15.6:0/245934894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650743899e0 0x5650744260c0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f8b40006750 tx=0x7f8b40005cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b4e7fc700 1 -- 172.21.15.6:0/245934894 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b40011500 con 0x5650743899e0 2023-10-06T02:24:56.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.526+0000 7f8b4e7fc700 1 -- 172.21.15.6:0/245934894 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4000f040 con 0x5650743899e0 2023-10-06T02:24:56.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.527+0000 7f8b4e7fc700 1 -- 172.21.15.6:0/245934894 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b400118b0 con 0x5650743899e0 2023-10-06T02:24:56.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.527+0000 7f8b5c922000 1 -- 172.21.15.6:0/245934894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5650742b53d0 con 0x5650743899e0 2023-10-06T02:24:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.527+0000 7f8b5c922000 1 -- 172.21.15.6:0/245934894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650742a8ae0 con 0x5650743899e0 2023-10-06T02:24:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.528+0000 7f8b4e7fc700 1 -- 172.21.15.6:0/245934894 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b40011c20 con 0x5650743899e0 2023-10-06T02:24:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.528+0000 7f8b4e7fc700 1 --2- 172.21.15.6:0/245934894 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8b38065890 0x7f8b38067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.528+0000 7f8b4e7fc700 1 -- 172.21.15.6:0/245934894 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f8b40083130 con 0x5650743899e0 2023-10-06T02:24:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.528+0000 7f8b5c922000 1 --2- 172.21.15.6:0/245934894 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56507442afc0 0x5650744274c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.528+0000 7f8b5c922000 1 -- 172.21.15.6:0/245934894 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:0d82a743:::600.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x565074427a00 con 0x56507442afc0 2023-10-06T02:24:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.529+0000 7f8b5635e700 1 --2- 172.21.15.6:0/245934894 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56507442afc0 0x5650744274c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.529+0000 7f8b55b5d700 1 --2- 172.21.15.6:0/245934894 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8b38065890 0x7f8b38067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.529+0000 7f8b5635e700 1 --2- 172.21.15.6:0/245934894 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56507442afc0 0x5650744274c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.529+0000 7f8b55b5d700 1 --2- 172.21.15.6:0/245934894 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8b38065890 0x7f8b38067d40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000e6f0 tx=0x7f8b50003970 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.529+0000 7f8b5635e700 1 -- 172.21.15.6:0/245934894 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 600.00000000 [omap-get-keys out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7f8b48022020 con 0x56507442afc0 2023-10-06T02:24:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.529+0000 7f8b5c922000 1 -- 172.21.15.6:0/245934894 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56507442afc0 msgr2=0x5650744274c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.529+0000 7f8b5c922000 1 --2- 172.21.15.6:0/245934894 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56507442afc0 0x5650744274c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.529+0000 7f8b5c922000 1 -- 172.21.15.6:0/245934894 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8b38065890 msgr2=0x7f8b38067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.529+0000 7f8b5c922000 1 --2- 172.21.15.6:0/245934894 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8b38065890 0x7f8b38067d40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000e6f0 tx=0x7f8b50003970 comp rx=0 tx=0).stop 2023-10-06T02:24:56.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.529+0000 7f8b5c922000 1 -- 172.21.15.6:0/245934894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650743899e0 msgr2=0x5650744260c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.529+0000 7f8b5c922000 1 --2- 172.21.15.6:0/245934894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5650743899e0 0x5650744260c0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f8b40006750 tx=0x7f8b40005cd0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.529+0000 7f8b5635e700 1 -- 172.21.15.6:0/245934894 reap_dead start 2023-10-06T02:24:56.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.529+0000 7f8b5c922000 1 -- 172.21.15.6:0/245934894 shutdown_connections 2023-10-06T02:24:56.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.529+0000 7f8b5c922000 1 -- 172.21.15.6:0/245934894 >> 172.21.15.6:0/245934894 conn(0x5650743a2bd0 msgr2=0x56507442f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.529+0000 7f8b5c922000 1 -- 172.21.15.6:0/245934894 shutdown_connections 2023-10-06T02:24:56.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.529+0000 7f8b5c922000 1 -- 172.21.15.6:0/245934894 wait complete. 2023-10-06T02:24:56.550 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000.inode 2023-10-06T02:24:56.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.613+0000 7fc70bccf000 1 Processor -- start 2023-10-06T02:24:56.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.613+0000 7fc70bccf000 1 -- start start 2023-10-06T02:24:56.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.614+0000 7fc70bccf000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616b8e0a410 0x5616b8dc5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.614+0000 7fc70bccf000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616b8e0a810 0x5616b8df0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.614+0000 7fc70bccf000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616b8e99f90 0x5616b8e9b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.614+0000 7fc70bccf000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b8d0e980 con 0x5616b8e99f90 2023-10-06T02:24:56.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.614+0000 7fc70bccf000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b8d0e620 con 0x5616b8e0a810 2023-10-06T02:24:56.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.614+0000 7fc70bccf000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616b8d05400 con 0x5616b8e0a410 2023-10-06T02:24:56.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.614+0000 7fc70570b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616b8e99f90 0x5616b8e9b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.614+0000 7fc70570b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616b8e99f90 0x5616b8e9b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59072/0 (socket says 172.21.15.6:59072) 2023-10-06T02:24:56.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.614+0000 7fc70570b700 1 -- 172.21.15.6:0/1485515462 learned_addr learned my addr 172.21.15.6:0/1485515462 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.614+0000 7fc704709700 1 --2- 172.21.15.6:0/1485515462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616b8e0a810 0x5616b8df0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.614+0000 7fc704f0a700 1 --2- 172.21.15.6:0/1485515462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616b8e0a410 0x5616b8dc5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc70570b700 1 -- 172.21.15.6:0/1485515462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616b8e0a410 msgr2=0x5616b8dc5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc70570b700 1 --2- 172.21.15.6:0/1485515462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616b8e0a410 0x5616b8dc5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc70570b700 1 -- 172.21.15.6:0/1485515462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616b8e0a810 msgr2=0x5616b8df0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc70570b700 1 --2- 172.21.15.6:0/1485515462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616b8e0a810 0x5616b8df0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc70570b700 1 -- 172.21.15.6:0/1485515462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f400a180 con 0x5616b8e99f90 2023-10-06T02:24:56.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc70570b700 1 --2- 172.21.15.6:0/1485515462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616b8e99f90 0x5616b8e9b890 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x5616b8dc3b10 tx=0x7fc6f4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d8fd15623c7b10 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc703707700 1 -- 172.21.15.6:0/1485515462 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f400ed60 con 0x5616b8e99f90 2023-10-06T02:24:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc703707700 1 -- 172.21.15.6:0/1485515462 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f400e7e0 con 0x5616b8e99f90 2023-10-06T02:24:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc703707700 1 -- 172.21.15.6:0/1485515462 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f401c680 con 0x5616b8e99f90 2023-10-06T02:24:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc70bccf000 1 -- 172.21.15.6:0/1485515462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616b8e99f90 msgr2=0x5616b8e9b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc70bccf000 1 --2- 172.21.15.6:0/1485515462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616b8e99f90 0x5616b8e9b890 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x5616b8dc3b10 tx=0x7fc6f4014000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc70bccf000 1 -- 172.21.15.6:0/1485515462 shutdown_connections 2023-10-06T02:24:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc70bccf000 1 --2- 172.21.15.6:0/1485515462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616b8e99f90 0x5616b8e9b890 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc70bccf000 1 --2- 172.21.15.6:0/1485515462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616b8e0a410 0x5616b8dc5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc70bccf000 1 --2- 172.21.15.6:0/1485515462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616b8e0a810 0x5616b8df0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc70bccf000 1 -- 172.21.15.6:0/1485515462 >> 172.21.15.6:0/1485515462 conn(0x5616b8dc3d50 msgr2=0x5616b8dc4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc70bccf000 1 -- 172.21.15.6:0/1485515462 shutdown_connections 2023-10-06T02:24:56.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.615+0000 7fc70bccf000 1 -- 172.21.15.6:0/1485515462 wait complete. 2023-10-06T02:24:56.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.616+0000 7fc70bccf000 1 Processor -- start 2023-10-06T02:24:56.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.616+0000 7fc70bccf000 1 -- start start 2023-10-06T02:24:56.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc70bccf000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616b8e0a410 0x5616b8e96250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc70bccf000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616b8e0a810 0x5616b8ea07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc70bccf000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616b8e99f90 0x5616b8e94010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc70bccf000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b8e96d90 con 0x5616b8e0a410 2023-10-06T02:24:56.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc70bccf000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b8e97030 con 0x5616b8e0a810 2023-10-06T02:24:56.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc70bccf000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616b8e972d0 con 0x5616b8e99f90 2023-10-06T02:24:56.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc704f0a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616b8e0a410 0x5616b8e96250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc704f0a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616b8e0a410 0x5616b8e96250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59074/0 (socket says 172.21.15.6:59074) 2023-10-06T02:24:56.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc704f0a700 1 -- 172.21.15.6:0/1624746850 learned_addr learned my addr 172.21.15.6:0/1624746850 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc704709700 1 --2- 172.21.15.6:0/1624746850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616b8e0a810 0x5616b8ea07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc70570b700 1 --2- 172.21.15.6:0/1624746850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616b8e99f90 0x5616b8e94010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc704f0a700 1 -- 172.21.15.6:0/1624746850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616b8e99f90 msgr2=0x5616b8e94010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc704f0a700 1 --2- 172.21.15.6:0/1624746850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616b8e99f90 0x5616b8e94010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc704f0a700 1 -- 172.21.15.6:0/1624746850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616b8e0a810 msgr2=0x5616b8ea07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc704f0a700 1 --2- 172.21.15.6:0/1624746850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616b8e0a810 0x5616b8ea07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc704f0a700 1 -- 172.21.15.6:0/1624746850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616b8d371c0 con 0x5616b8e0a410 2023-10-06T02:24:56.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc70570b700 1 --2- 172.21.15.6:0/1624746850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616b8e99f90 0x5616b8e94010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:56.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc704f0a700 1 --2- 172.21.15.6:0/1624746850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616b8e0a410 0x5616b8e96250 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc002ea0 tx=0x7fc6fc001780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc701f04700 1 -- 172.21.15.6:0/1624746850 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc00cc80 con 0x5616b8e0a410 2023-10-06T02:24:56.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc701f04700 1 -- 172.21.15.6:0/1624746850 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc008030 con 0x5616b8e0a410 2023-10-06T02:24:56.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc70bccf000 1 -- 172.21.15.6:0/1624746850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5616b8d1d3d0 con 0x5616b8e0a410 2023-10-06T02:24:56.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.617+0000 7fc701f04700 1 -- 172.21.15.6:0/1624746850 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc011450 con 0x5616b8e0a410 2023-10-06T02:24:56.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.618+0000 7fc70bccf000 1 -- 172.21.15.6:0/1624746850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616b8d10ae0 con 0x5616b8e0a410 2023-10-06T02:24:56.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.619+0000 7fc701f04700 1 -- 172.21.15.6:0/1624746850 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6fc0117c0 con 0x5616b8e0a410 2023-10-06T02:24:56.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.619+0000 7fc701f04700 1 --2- 172.21.15.6:0/1624746850 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc6e4065890 0x7fc6e4067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.619+0000 7fc701f04700 1 -- 172.21.15.6:0/1624746850 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fc6fc083840 con 0x5616b8e0a410 2023-10-06T02:24:56.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.619+0000 7fc70bccf000 1 --2- 172.21.15.6:0/1624746850 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5616b8e94550 0x5616b8e97a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.619+0000 7fc70bccf000 1 -- 172.21.15.6:0/1624746850 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:287034c4:::1.00000000.inode:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x5616b8e9f040 con 0x5616b8e94550 2023-10-06T02:24:56.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.619+0000 7fc704709700 1 --2- 172.21.15.6:0/1624746850 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc6e4065890 0x7fc6e4067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.620+0000 7fc70570b700 1 --2- 172.21.15.6:0/1624746850 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5616b8e94550 0x5616b8e97a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.620+0000 7fc704709700 1 --2- 172.21.15.6:0/1624746850 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc6e4065890 0x7fc6e4067d40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec005fd0 tx=0x7fc6ec00c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.620+0000 7fc70570b700 1 --2- 172.21.15.6:0/1624746850 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5616b8e94550 0x5616b8e97a10 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.620+0000 7fc70570b700 1 -- 172.21.15.6:0/1624746850 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 1.00000000.inode [omap-get-keys out=5b] v0'0 uv15 ondisk = 0) v8 ==== 160+0+5 (crc 0 0 0) 0x7fc6f401c430 con 0x5616b8e94550 2023-10-06T02:24:56.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.620+0000 7fc70bccf000 1 -- 172.21.15.6:0/1624746850 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5616b8e94550 msgr2=0x5616b8e97a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.620+0000 7fc70bccf000 1 --2- 172.21.15.6:0/1624746850 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5616b8e94550 0x5616b8e97a10 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.621+0000 7fc70bccf000 1 -- 172.21.15.6:0/1624746850 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc6e4065890 msgr2=0x7fc6e4067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.621+0000 7fc70bccf000 1 --2- 172.21.15.6:0/1624746850 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc6e4065890 0x7fc6e4067d40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec005fd0 tx=0x7fc6ec00c040 comp rx=0 tx=0).stop 2023-10-06T02:24:56.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.621+0000 7fc70bccf000 1 -- 172.21.15.6:0/1624746850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616b8e0a410 msgr2=0x5616b8e96250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.621+0000 7fc70bccf000 1 --2- 172.21.15.6:0/1624746850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616b8e0a410 0x5616b8e96250 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc002ea0 tx=0x7fc6fc001780 comp rx=0 tx=0).stop 2023-10-06T02:24:56.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.621+0000 7fc70570b700 1 -- 172.21.15.6:0/1624746850 reap_dead start 2023-10-06T02:24:56.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.621+0000 7fc70bccf000 1 -- 172.21.15.6:0/1624746850 shutdown_connections 2023-10-06T02:24:56.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.621+0000 7fc70bccf000 1 -- 172.21.15.6:0/1624746850 >> 172.21.15.6:0/1624746850 conn(0x5616b8dc3d50 msgr2=0x5616b8dc4280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.621+0000 7fc70bccf000 1 -- 172.21.15.6:0/1624746850 shutdown_connections 2023-10-06T02:24:56.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.621+0000 7fc70bccf000 1 -- 172.21.15.6:0/1624746850 wait complete. 2023-10-06T02:24:56.634 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 200.00000000 2023-10-06T02:24:56.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.703+0000 7fe2fccd2000 1 Processor -- start 2023-10-06T02:24:56.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.703+0000 7fe2fccd2000 1 -- start start 2023-10-06T02:24:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2fccd2000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2e0003b80 0x564bd9f40390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2fccd2000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564bd9f6ecb0 0x564bda011e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2fccd2000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bda0123b0 0x564bd9f8afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2fccd2000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bd9ee9320 con 0x7fe2e0003b80 2023-10-06T02:24:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2fccd2000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bd9e8d980 con 0x564bda0123b0 2023-10-06T02:24:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2fccd2000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564bd9e8d620 con 0x564bd9f6ecb0 2023-10-06T02:24:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2f5f0d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2e0003b80 0x564bd9f40390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2f5f0d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2e0003b80 0x564bd9f40390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59098/0 (socket says 172.21.15.6:59098) 2023-10-06T02:24:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2f5f0d700 1 -- 172.21.15.6:0/672437748 learned_addr learned my addr 172.21.15.6:0/672437748 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2f570c700 1 --2- 172.21.15.6:0/672437748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564bd9f6ecb0 0x564bda011e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2f670e700 1 --2- 172.21.15.6:0/672437748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bda0123b0 0x564bd9f8afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2f5f0d700 1 -- 172.21.15.6:0/672437748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564bd9f6ecb0 msgr2=0x564bda011e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2f5f0d700 1 --2- 172.21.15.6:0/672437748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564bd9f6ecb0 0x564bda011e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2f5f0d700 1 -- 172.21.15.6:0/672437748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bda0123b0 msgr2=0x564bd9f8afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2f5f0d700 1 --2- 172.21.15.6:0/672437748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bda0123b0 0x564bd9f8afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2f5f0d700 1 -- 172.21.15.6:0/672437748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bd9e8fae0 con 0x7fe2e0003b80 2023-10-06T02:24:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2f670e700 1 --2- 172.21.15.6:0/672437748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bda0123b0 0x564bd9f8afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2f5f0d700 1 --2- 172.21.15.6:0/672437748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2e0003b80 0x564bd9f40390 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009780 tx=0x7fe2f000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64241c5d6cf578d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2e7fff700 1 -- 172.21.15.6:0/672437748 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f000f040 con 0x7fe2e0003b80 2023-10-06T02:24:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2e7fff700 1 -- 172.21.15.6:0/672437748 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f0008700 con 0x7fe2e0003b80 2023-10-06T02:24:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.704+0000 7fe2e7fff700 1 -- 172.21.15.6:0/672437748 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0008a80 con 0x7fe2e0003b80 2023-10-06T02:24:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.705+0000 7fe2fccd2000 1 -- 172.21.15.6:0/672437748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2e0003b80 msgr2=0x564bd9f40390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.705+0000 7fe2fccd2000 1 --2- 172.21.15.6:0/672437748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2e0003b80 0x564bd9f40390 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009780 tx=0x7fe2f000c040 comp rx=0 tx=0).stop 2023-10-06T02:24:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.705+0000 7fe2fccd2000 1 -- 172.21.15.6:0/672437748 shutdown_connections 2023-10-06T02:24:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.705+0000 7fe2fccd2000 1 --2- 172.21.15.6:0/672437748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bda0123b0 0x564bd9f8afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.705+0000 7fe2fccd2000 1 --2- 172.21.15.6:0/672437748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2e0003b80 0x564bd9f40390 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.705+0000 7fe2fccd2000 1 --2- 172.21.15.6:0/672437748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564bd9f6ecb0 0x564bda011e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.705+0000 7fe2fccd2000 1 -- 172.21.15.6:0/672437748 >> 172.21.15.6:0/672437748 conn(0x564bd9f89bd0 msgr2=0x564bd9f72390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.705+0000 7fe2fccd2000 1 -- 172.21.15.6:0/672437748 shutdown_connections 2023-10-06T02:24:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.705+0000 7fe2fccd2000 1 -- 172.21.15.6:0/672437748 wait complete. 2023-10-06T02:24:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.706+0000 7fe2fccd2000 1 Processor -- start 2023-10-06T02:24:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.706+0000 7fe2fccd2000 1 -- start start 2023-10-06T02:24:56.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.706+0000 7fe2fccd2000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bd9f6ecb0 0x564bd9ffa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.706+0000 7fe2fccd2000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564bda0123b0 0x564bd9f72570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.706+0000 7fe2fccd2000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2e0003b80 0x564bd9f8c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.706+0000 7fe2fccd2000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bd9e84400 con 0x7fe2e0003b80 2023-10-06T02:24:56.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.706+0000 7fe2fccd2000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bd9f8b560 con 0x564bd9f6ecb0 2023-10-06T02:24:56.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.706+0000 7fe2fccd2000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564bd9f8b800 con 0x564bda0123b0 2023-10-06T02:24:56.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.706+0000 7fe2f670e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2e0003b80 0x564bd9f8c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.706+0000 7fe2f670e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2e0003b80 0x564bd9f8c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59110/0 (socket says 172.21.15.6:59110) 2023-10-06T02:24:56.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.706+0000 7fe2f670e700 1 -- 172.21.15.6:0/3650745024 learned_addr learned my addr 172.21.15.6:0/3650745024 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.706+0000 7fe2f570c700 1 --2- 172.21.15.6:0/3650745024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564bda0123b0 0x564bd9f72570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.706+0000 7fe2f5f0d700 1 --2- 172.21.15.6:0/3650745024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bd9f6ecb0 0x564bd9ffa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.707+0000 7fe2f670e700 1 -- 172.21.15.6:0/3650745024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564bda0123b0 msgr2=0x564bd9f72570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.707+0000 7fe2f670e700 1 --2- 172.21.15.6:0/3650745024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564bda0123b0 0x564bd9f72570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.707+0000 7fe2f670e700 1 -- 172.21.15.6:0/3650745024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bd9f6ecb0 msgr2=0x564bd9ffa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.707+0000 7fe2f670e700 1 --2- 172.21.15.6:0/3650745024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564bd9f6ecb0 0x564bd9ffa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.707+0000 7fe2f670e700 1 -- 172.21.15.6:0/3650745024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f0009430 con 0x7fe2e0003b80 2023-10-06T02:24:56.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.707+0000 7fe2f670e700 1 --2- 172.21.15.6:0/3650745024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2e0003b80 0x564bd9f8c480 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8002250 tx=0x7fe2e8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.707+0000 7fe2e67fc700 1 -- 172.21.15.6:0/3650745024 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8006470 con 0x7fe2e0003b80 2023-10-06T02:24:56.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.707+0000 7fe2e67fc700 1 -- 172.21.15.6:0/3650745024 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e801e470 con 0x7fe2e0003b80 2023-10-06T02:24:56.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.707+0000 7fe2e67fc700 1 -- 172.21.15.6:0/3650745024 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e801e810 con 0x7fe2e0003b80 2023-10-06T02:24:56.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.707+0000 7fe2fccd2000 1 -- 172.21.15.6:0/3650745024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564bd9e8f540 con 0x7fe2e0003b80 2023-10-06T02:24:56.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.707+0000 7fe2fccd2000 1 -- 172.21.15.6:0/3650745024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564bd9f8bd40 con 0x7fe2e0003b80 2023-10-06T02:24:56.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.708+0000 7fe2e67fc700 1 -- 172.21.15.6:0/3650745024 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2e8003450 con 0x7fe2e0003b80 2023-10-06T02:24:56.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.709+0000 7fe2e67fc700 1 --2- 172.21.15.6:0/3650745024 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe2d80658c0 0x7fe2d8067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.709+0000 7fe2e67fc700 1 -- 172.21.15.6:0/3650745024 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fe2e8084840 con 0x7fe2e0003b80 2023-10-06T02:24:56.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.709+0000 7fe2f5f0d700 1 --2- 172.21.15.6:0/3650745024 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe2d80658c0 0x7fe2d8067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.709+0000 7fe2fccd2000 1 --2- 172.21.15.6:0/3650745024 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x564bd9f72ab0 0x564bda029ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.709+0000 7fe2fccd2000 1 -- 172.21.15.6:0/3650745024 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:292cf221:::200.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x564bd9ffa6f0 con 0x564bd9f72ab0 2023-10-06T02:24:56.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.709+0000 7fe2f570c700 1 --2- 172.21.15.6:0/3650745024 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x564bd9f72ab0 0x564bda029ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.709+0000 7fe2f5f0d700 1 --2- 172.21.15.6:0/3650745024 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe2d80658c0 0x7fe2d8067d70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0005cc0 tx=0x7fe2f001a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.710+0000 7fe2f570c700 1 --2- 172.21.15.6:0/3650745024 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x564bd9f72ab0 0x564bda029ab0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.710+0000 7fe2f570c700 1 -- 172.21.15.6:0/3650745024 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 200.00000000 [omap-get-keys out=5b] v0'0 uv18 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7fe2ec012970 con 0x564bd9f72ab0 2023-10-06T02:24:56.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.710+0000 7fe2fccd2000 1 -- 172.21.15.6:0/3650745024 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x564bd9f72ab0 msgr2=0x564bda029ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.710+0000 7fe2fccd2000 1 --2- 172.21.15.6:0/3650745024 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x564bd9f72ab0 0x564bda029ab0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.710+0000 7fe2fccd2000 1 -- 172.21.15.6:0/3650745024 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe2d80658c0 msgr2=0x7fe2d8067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.710+0000 7fe2fccd2000 1 --2- 172.21.15.6:0/3650745024 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe2d80658c0 0x7fe2d8067d70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0005cc0 tx=0x7fe2f001a000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.710+0000 7fe2fccd2000 1 -- 172.21.15.6:0/3650745024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2e0003b80 msgr2=0x564bd9f8c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.710+0000 7fe2fccd2000 1 --2- 172.21.15.6:0/3650745024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2e0003b80 0x564bd9f8c480 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8002250 tx=0x7fe2e8012000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.710+0000 7fe2f670e700 1 -- 172.21.15.6:0/3650745024 reap_dead start 2023-10-06T02:24:56.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.710+0000 7fe2fccd2000 1 -- 172.21.15.6:0/3650745024 shutdown_connections 2023-10-06T02:24:56.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.710+0000 7fe2fccd2000 1 -- 172.21.15.6:0/3650745024 >> 172.21.15.6:0/3650745024 conn(0x564bd9f89bd0 msgr2=0x564bda0112a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.710+0000 7fe2fccd2000 1 -- 172.21.15.6:0/3650745024 shutdown_connections 2023-10-06T02:24:56.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.710+0000 7fe2fccd2000 1 -- 172.21.15.6:0/3650745024 wait complete. 2023-10-06T02:24:56.718 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 200.00000001 2023-10-06T02:24:56.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.792+0000 7f44cd6d5000 1 Processor -- start 2023-10-06T02:24:56.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.792+0000 7f44cd6d5000 1 -- start start 2023-10-06T02:24:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.793+0000 7f44cd6d5000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56165eafae30 0x56165eb19970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.793+0000 7f44cd6d5000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165eafd9e0 0x56165eb180c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.793+0000 7f44cd6d5000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56165eba3f50 0x56165eafb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.793+0000 7f44cd6d5000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56165ea76320 con 0x56165eba3f50 2023-10-06T02:24:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.793+0000 7f44cd6d5000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56165ea1a980 con 0x56165eafd9e0 2023-10-06T02:24:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.793+0000 7f44cd6d5000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56165ea1a620 con 0x56165eafae30 2023-10-06T02:24:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.793+0000 7f44c7111700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56165eba3f50 0x56165eafb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.793+0000 7f44c7111700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56165eba3f50 0x56165eafb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59122/0 (socket says 172.21.15.6:59122) 2023-10-06T02:24:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.793+0000 7f44c7111700 1 -- 172.21.15.6:0/2114631638 learned_addr learned my addr 172.21.15.6:0/2114631638 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.793+0000 7f44c7111700 1 -- 172.21.15.6:0/2114631638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56165eafae30 msgr2=0x56165eb19970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.793+0000 7f44c7111700 1 --2- 172.21.15.6:0/2114631638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56165eafae30 0x56165eb19970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.793+0000 7f44c7111700 1 -- 172.21.15.6:0/2114631638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165eafd9e0 msgr2=0x56165eb180c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.793+0000 7f44c7111700 1 --2- 172.21.15.6:0/2114631638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165eafd9e0 0x56165eb180c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.793+0000 7f44c7111700 1 -- 172.21.15.6:0/2114631638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c0005cf0 con 0x56165eba3f50 2023-10-06T02:24:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.793+0000 7f44c7111700 1 --2- 172.21.15.6:0/2114631638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56165eba3f50 0x56165eafb500 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f44c0015040 tx=0x7f44c0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118f008b409dde7d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.794+0000 7f44c510d700 1 -- 172.21.15.6:0/2114631638 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c00086a0 con 0x56165eba3f50 2023-10-06T02:24:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.794+0000 7f44c510d700 1 -- 172.21.15.6:0/2114631638 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c0008970 con 0x56165eba3f50 2023-10-06T02:24:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.794+0000 7f44c510d700 1 -- 172.21.15.6:0/2114631638 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c001e450 con 0x56165eba3f50 2023-10-06T02:24:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.794+0000 7f44cd6d5000 1 -- 172.21.15.6:0/2114631638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56165eba3f50 msgr2=0x56165eafb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.794+0000 7f44cd6d5000 1 --2- 172.21.15.6:0/2114631638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56165eba3f50 0x56165eafb500 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f44c0015040 tx=0x7f44c0012000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.794+0000 7f44cd6d5000 1 -- 172.21.15.6:0/2114631638 shutdown_connections 2023-10-06T02:24:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.794+0000 7f44cd6d5000 1 --2- 172.21.15.6:0/2114631638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56165eba3f50 0x56165eafb500 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.794+0000 7f44cd6d5000 1 --2- 172.21.15.6:0/2114631638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56165eafae30 0x56165eb19970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.794+0000 7f44cd6d5000 1 --2- 172.21.15.6:0/2114631638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165eafd9e0 0x56165eb180c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.794+0000 7f44cd6d5000 1 -- 172.21.15.6:0/2114631638 >> 172.21.15.6:0/2114631638 conn(0x56165eb16bd0 msgr2=0x56165eba2300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.794+0000 7f44cd6d5000 1 -- 172.21.15.6:0/2114631638 shutdown_connections 2023-10-06T02:24:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.794+0000 7f44cd6d5000 1 -- 172.21.15.6:0/2114631638 wait complete. 2023-10-06T02:24:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.795+0000 7f44cd6d5000 1 Processor -- start 2023-10-06T02:24:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.795+0000 7f44cd6d5000 1 -- start start 2023-10-06T02:24:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44cd6d5000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56165eafae30 0x56165eb8b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44cd6d5000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56165eafd9e0 0x56165eb9ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44cd6d5000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165eba3f50 0x56165eb9f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44cd6d5000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56165ea11400 con 0x56165eafd9e0 2023-10-06T02:24:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44cd6d5000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56165eb16470 con 0x56165eba3f50 2023-10-06T02:24:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44cd6d5000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56165eb16710 con 0x56165eafae30 2023-10-06T02:24:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44c610f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56165eafd9e0 0x56165eb9ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44c610f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56165eafd9e0 0x56165eb9ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59134/0 (socket says 172.21.15.6:59134) 2023-10-06T02:24:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44c610f700 1 -- 172.21.15.6:0/4054416719 learned_addr learned my addr 172.21.15.6:0/4054416719 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44c6910700 1 --2- 172.21.15.6:0/4054416719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56165eafae30 0x56165eb8b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44c7111700 1 --2- 172.21.15.6:0/4054416719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165eba3f50 0x56165eb9f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44c610f700 1 -- 172.21.15.6:0/4054416719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56165eafae30 msgr2=0x56165eb8b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44c610f700 1 --2- 172.21.15.6:0/4054416719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56165eafae30 0x56165eb8b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44c610f700 1 -- 172.21.15.6:0/4054416719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165eba3f50 msgr2=0x56165eb9f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44c610f700 1 --2- 172.21.15.6:0/4054416719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165eba3f50 0x56165eb9f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44c610f700 1 -- 172.21.15.6:0/4054416719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56165ea293d0 con 0x56165eafd9e0 2023-10-06T02:24:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44c610f700 1 --2- 172.21.15.6:0/4054416719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56165eafd9e0 0x56165eb9ebe0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f44b000bd70 tx=0x7f44b00017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44bf7fe700 1 -- 172.21.15.6:0/4054416719 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0009d80 con 0x56165eafd9e0 2023-10-06T02:24:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44bf7fe700 1 -- 172.21.15.6:0/4054416719 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b000e470 con 0x56165eafd9e0 2023-10-06T02:24:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44cd6d5000 1 -- 172.21.15.6:0/4054416719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56165ea1cae0 con 0x56165eafd9e0 2023-10-06T02:24:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44bf7fe700 1 -- 172.21.15.6:0/4054416719 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b000e870 con 0x56165eafd9e0 2023-10-06T02:24:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.796+0000 7f44cd6d5000 1 -- 172.21.15.6:0/4054416719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56165ea1c540 con 0x56165eafd9e0 2023-10-06T02:24:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.798+0000 7f44bf7fe700 1 -- 172.21.15.6:0/4054416719 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44b000eca0 con 0x56165eafd9e0 2023-10-06T02:24:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.798+0000 7f44bf7fe700 1 --2- 172.21.15.6:0/4054416719 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44a8065890 0x7f44a8067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.798+0000 7f44bf7fe700 1 -- 172.21.15.6:0/4054416719 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f44b00835f0 con 0x56165eafd9e0 2023-10-06T02:24:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.798+0000 7f44c6910700 1 --2- 172.21.15.6:0/4054416719 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44a8065890 0x7f44a8067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.798+0000 7f44cd6d5000 1 --2- 172.21.15.6:0/4054416719 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56165eb19900 0x56165ebb2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.798+0000 7f44cd6d5000 1 -- 172.21.15.6:0/4054416719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:2e2fa760:::200.00000001:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x56165ebb2680 con 0x56165eb19900 2023-10-06T02:24:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.798+0000 7f44c7111700 1 --2- 172.21.15.6:0/4054416719 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56165eb19900 0x56165ebb2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.799+0000 7f44c6910700 1 --2- 172.21.15.6:0/4054416719 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44a8065890 0x7f44a8067d40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f44b800a580 tx=0x7f44b8007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.799+0000 7f44c7111700 1 --2- 172.21.15.6:0/4054416719 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56165eb19900 0x56165ebb2140 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.799+0000 7f44c7111700 1 -- 172.21.15.6:0/4054416719 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 200.00000001 [omap-get-keys out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7f44c0019040 con 0x56165eb19900 2023-10-06T02:24:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.799+0000 7f44cd6d5000 1 -- 172.21.15.6:0/4054416719 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56165eb19900 msgr2=0x56165ebb2140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.799+0000 7f44cd6d5000 1 --2- 172.21.15.6:0/4054416719 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56165eb19900 0x56165ebb2140 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.799+0000 7f44cd6d5000 1 -- 172.21.15.6:0/4054416719 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44a8065890 msgr2=0x7f44a8067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.799+0000 7f44cd6d5000 1 --2- 172.21.15.6:0/4054416719 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44a8065890 0x7f44a8067d40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f44b800a580 tx=0x7f44b8007040 comp rx=0 tx=0).stop 2023-10-06T02:24:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.799+0000 7f44cd6d5000 1 -- 172.21.15.6:0/4054416719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56165eafd9e0 msgr2=0x56165eb9ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.799+0000 7f44cd6d5000 1 --2- 172.21.15.6:0/4054416719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56165eafd9e0 0x56165eb9ebe0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f44b000bd70 tx=0x7f44b00017b0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.799+0000 7f44c7111700 1 -- 172.21.15.6:0/4054416719 reap_dead start 2023-10-06T02:24:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.799+0000 7f44cd6d5000 1 -- 172.21.15.6:0/4054416719 shutdown_connections 2023-10-06T02:24:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.799+0000 7f44cd6d5000 1 -- 172.21.15.6:0/4054416719 >> 172.21.15.6:0/4054416719 conn(0x56165eb16bd0 msgr2=0x56165eba2300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.799+0000 7f44cd6d5000 1 -- 172.21.15.6:0/4054416719 shutdown_connections 2023-10-06T02:24:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.799+0000 7f44cd6d5000 1 -- 172.21.15.6:0/4054416719 wait complete. 2023-10-06T02:24:56.806 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys mds0_openfiles.0 2023-10-06T02:24:56.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.879+0000 7f87a893b000 1 Processor -- start 2023-10-06T02:24:56.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.880+0000 7f87a893b000 1 -- start start 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.880+0000 7f87a893b000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a3ff3e30 0x5616a3fcccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.880+0000 7f87a893b000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616a3ff69e0 0x5616a40998e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.880+0000 7f87a893b000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616a409cf50 0x5616a3fc72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.880+0000 7f87a893b000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616a3f13980 con 0x5616a409cf50 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.880+0000 7f87a893b000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616a3f13620 con 0x5616a3ff3e30 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.880+0000 7f87a893b000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616a3f0a400 con 0x5616a3ff69e0 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.880+0000 7f87a2377700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616a409cf50 0x5616a3fc72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.880+0000 7f87a2377700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616a409cf50 0x5616a3fc72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59146/0 (socket says 172.21.15.6:59146) 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.880+0000 7f87a2377700 1 -- 172.21.15.6:0/3952433412 learned_addr learned my addr 172.21.15.6:0/3952433412 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.881+0000 7f87a1b76700 1 --2- 172.21.15.6:0/3952433412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a3ff3e30 0x5616a3fcccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.881+0000 7f87a1375700 1 --2- 172.21.15.6:0/3952433412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616a3ff69e0 0x5616a40998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.881+0000 7f87a2377700 1 -- 172.21.15.6:0/3952433412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616a3ff69e0 msgr2=0x5616a40998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.881+0000 7f87a2377700 1 --2- 172.21.15.6:0/3952433412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616a3ff69e0 0x5616a40998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.881+0000 7f87a2377700 1 -- 172.21.15.6:0/3952433412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a3ff3e30 msgr2=0x5616a3fcccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.881+0000 7f87a2377700 1 --2- 172.21.15.6:0/3952433412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a3ff3e30 0x5616a3fcccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.881+0000 7f87a2377700 1 -- 172.21.15.6:0/3952433412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c005cf0 con 0x5616a409cf50 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.881+0000 7f87a1b76700 1 --2- 172.21.15.6:0/3952433412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a3ff3e30 0x5616a3fcccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.881+0000 7f87a1375700 1 --2- 172.21.15.6:0/3952433412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616a3ff69e0 0x5616a40998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.881+0000 7f87a2377700 1 --2- 172.21.15.6:0/3952433412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616a409cf50 0x5616a3fc72b0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f879400ace0 tx=0x7f8794014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139542cb0a53856b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.881+0000 7f879bfff700 1 -- 172.21.15.6:0/3952433412 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794005870 con 0x5616a409cf50 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.881+0000 7f879bfff700 1 -- 172.21.15.6:0/3952433412 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879400eda0 con 0x5616a409cf50 2023-10-06T02:24:56.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.881+0000 7f879bfff700 1 -- 172.21.15.6:0/3952433412 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879400ea10 con 0x5616a409cf50 2023-10-06T02:24:56.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.881+0000 7f87a893b000 1 -- 172.21.15.6:0/3952433412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616a409cf50 msgr2=0x5616a3fc72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.881+0000 7f87a893b000 1 --2- 172.21.15.6:0/3952433412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616a409cf50 0x5616a3fc72b0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f879400ace0 tx=0x7f8794014000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.882+0000 7f87a893b000 1 -- 172.21.15.6:0/3952433412 shutdown_connections 2023-10-06T02:24:56.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.882+0000 7f87a893b000 1 --2- 172.21.15.6:0/3952433412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616a409cf50 0x5616a3fc72b0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.882+0000 7f87a893b000 1 --2- 172.21.15.6:0/3952433412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a3ff3e30 0x5616a3fcccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.882+0000 7f87a893b000 1 --2- 172.21.15.6:0/3952433412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616a3ff69e0 0x5616a40998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.882+0000 7f87a893b000 1 -- 172.21.15.6:0/3952433412 >> 172.21.15.6:0/3952433412 conn(0x5616a400fbd0 msgr2=0x5616a3fc6760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.882+0000 7f87a893b000 1 -- 172.21.15.6:0/3952433412 shutdown_connections 2023-10-06T02:24:56.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.882+0000 7f87a893b000 1 -- 172.21.15.6:0/3952433412 wait complete. 2023-10-06T02:24:56.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.882+0000 7f87a893b000 1 Processor -- start 2023-10-06T02:24:56.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.882+0000 7f87a893b000 1 -- start start 2023-10-06T02:24:56.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.883+0000 7f87a893b000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616a3ff3e30 0x5616a4098710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.883+0000 7f87a893b000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a3ff69e0 0x5616a408bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.883+0000 7f87a893b000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616a409cf50 0x5616a408c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.883+0000 7f87a893b000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616a4092ad0 con 0x5616a3ff3e30 2023-10-06T02:24:56.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.883+0000 7f87a893b000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616a4092d00 con 0x5616a3ff69e0 2023-10-06T02:24:56.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.883+0000 7f87a893b000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616a4092fa0 con 0x5616a409cf50 2023-10-06T02:24:56.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.883+0000 7f87a1b76700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616a3ff3e30 0x5616a4098710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.883+0000 7f87a1b76700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616a3ff3e30 0x5616a4098710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59158/0 (socket says 172.21.15.6:59158) 2023-10-06T02:24:56.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.883+0000 7f87a1b76700 1 -- 172.21.15.6:0/2994869270 learned_addr learned my addr 172.21.15.6:0/2994869270 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.883+0000 7f87a1375700 1 --2- 172.21.15.6:0/2994869270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a3ff69e0 0x5616a408bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.883+0000 7f87a2377700 1 --2- 172.21.15.6:0/2994869270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616a409cf50 0x5616a408c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.883+0000 7f87a1b76700 1 -- 172.21.15.6:0/2994869270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616a409cf50 msgr2=0x5616a408c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.883+0000 7f87a1b76700 1 --2- 172.21.15.6:0/2994869270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5616a409cf50 0x5616a408c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.883+0000 7f87a1b76700 1 -- 172.21.15.6:0/2994869270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a3ff69e0 msgr2=0x5616a408bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.883+0000 7f87a1b76700 1 --2- 172.21.15.6:0/2994869270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a3ff69e0 0x5616a408bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.883+0000 7f87a1b76700 1 -- 172.21.15.6:0/2994869270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616a3f3c1c0 con 0x5616a3ff3e30 2023-10-06T02:24:56.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.883+0000 7f87a1375700 1 --2- 172.21.15.6:0/2994869270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616a3ff69e0 0x5616a408bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:56.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.884+0000 7f87a1b76700 1 --2- 172.21.15.6:0/2994869270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616a3ff3e30 0x5616a4098710 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f879c00b5b0 tx=0x7f879c001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.884+0000 7f879a7fc700 1 -- 172.21.15.6:0/2994869270 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c00be40 con 0x5616a3ff3e30 2023-10-06T02:24:56.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.884+0000 7f879a7fc700 1 -- 172.21.15.6:0/2994869270 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c010430 con 0x5616a3ff3e30 2023-10-06T02:24:56.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.884+0000 7f87a893b000 1 -- 172.21.15.6:0/2994869270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879400a180 con 0x5616a3ff3e30 2023-10-06T02:24:56.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.884+0000 7f879a7fc700 1 -- 172.21.15.6:0/2994869270 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0107d0 con 0x5616a3ff3e30 2023-10-06T02:24:56.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.884+0000 7f87a893b000 1 -- 172.21.15.6:0/2994869270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616a3f223d0 con 0x5616a3ff3e30 2023-10-06T02:24:56.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.885+0000 7f879a7fc700 1 -- 172.21.15.6:0/2994869270 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f879c010b80 con 0x5616a3ff3e30 2023-10-06T02:24:56.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.885+0000 7f879a7fc700 1 --2- 172.21.15.6:0/2994869270 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8784065890 0x7f8784067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.885+0000 7f879a7fc700 1 -- 172.21.15.6:0/2994869270 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f879c008030 con 0x5616a3ff3e30 2023-10-06T02:24:56.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.886+0000 7f87a1375700 1 --2- 172.21.15.6:0/2994869270 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8784065890 0x7f8784067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.886+0000 7f87a893b000 1 --2- 172.21.15.6:0/2994869270 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5616a4098c50 0x5616a40b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.886+0000 7f87a893b000 1 -- 172.21.15.6:0/2994869270 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.6 14:654134d2:::mds0_openfiles.0:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x5616a4011990 con 0x5616a4098c50 2023-10-06T02:24:56.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.886+0000 7f87a2377700 1 --2- 172.21.15.6:0/2994869270 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5616a4098c50 0x5616a40b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.886+0000 7f87a2377700 1 --2- 172.21.15.6:0/2994869270 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5616a4098c50 0x5616a40b0090 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.886+0000 7f87a1375700 1 --2- 172.21.15.6:0/2994869270 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8784065890 0x7f8784067d40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f878c005cc0 tx=0x7f878c00c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.886+0000 7f87a2377700 1 -- 172.21.15.6:0/2994869270 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 mds0_openfiles.0 [omap-get-keys out=5b] v0'0 uv2 ondisk = 0) v8 ==== 160+0+5 (crc 0 0 0) 0x7f8794005870 con 0x5616a4098c50 2023-10-06T02:24:56.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.886+0000 7f87a893b000 1 -- 172.21.15.6:0/2994869270 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5616a4098c50 msgr2=0x5616a40b0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.886+0000 7f87a893b000 1 --2- 172.21.15.6:0/2994869270 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5616a4098c50 0x5616a40b0090 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.887+0000 7f87a893b000 1 -- 172.21.15.6:0/2994869270 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8784065890 msgr2=0x7f8784067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.887+0000 7f87a893b000 1 --2- 172.21.15.6:0/2994869270 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8784065890 0x7f8784067d40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f878c005cc0 tx=0x7f878c00c040 comp rx=0 tx=0).stop 2023-10-06T02:24:56.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.887+0000 7f87a893b000 1 -- 172.21.15.6:0/2994869270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616a3ff3e30 msgr2=0x5616a4098710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.887+0000 7f87a893b000 1 --2- 172.21.15.6:0/2994869270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5616a3ff3e30 0x5616a4098710 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f879c00b5b0 tx=0x7f879c001a60 comp rx=0 tx=0).stop 2023-10-06T02:24:56.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.887+0000 7f87a2377700 1 -- 172.21.15.6:0/2994869270 reap_dead start 2023-10-06T02:24:56.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.887+0000 7f87a893b000 1 -- 172.21.15.6:0/2994869270 shutdown_connections 2023-10-06T02:24:56.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.887+0000 7f87a893b000 1 -- 172.21.15.6:0/2994869270 >> 172.21.15.6:0/2994869270 conn(0x5616a400fbd0 msgr2=0x5616a4011280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.887+0000 7f87a893b000 1 -- 172.21.15.6:0/2994869270 shutdown_connections 2023-10-06T02:24:56.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.887+0000 7f87a893b000 1 -- 172.21.15.6:0/2994869270 wait complete. 2023-10-06T02:24:56.894 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 500.00000000 2023-10-06T02:24:56.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.966+0000 7f85b5d64000 1 Processor -- start 2023-10-06T02:24:56.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.966+0000 7f85b5d64000 1 -- start start 2023-10-06T02:24:56.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.967+0000 7f85b5d64000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd2bd86710 0x55cd2be2b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.967+0000 7f85b5d64000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd2be282f0 0x55cd2be3aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.967+0000 7f85b5d64000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd2be286c0 0x55cd2be3afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.967+0000 7f85b5d64000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd2bca5980 con 0x55cd2bd86710 2023-10-06T02:24:56.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.967+0000 7f85b5d64000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd2bca5620 con 0x55cd2be282f0 2023-10-06T02:24:56.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.967+0000 7f85b5d64000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd2bc9c400 con 0x55cd2be286c0 2023-10-06T02:24:56.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.967+0000 7f85aef9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd2bd86710 0x55cd2be2b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.967+0000 7f85aef9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd2bd86710 0x55cd2be2b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59180/0 (socket says 172.21.15.6:59180) 2023-10-06T02:24:56.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.967+0000 7f85aef9f700 1 -- 172.21.15.6:0/1396320562 learned_addr learned my addr 172.21.15.6:0/1396320562 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.967+0000 7f85ae79e700 1 --2- 172.21.15.6:0/1396320562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd2be282f0 0x55cd2be3aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.967+0000 7f85af7a0700 1 --2- 172.21.15.6:0/1396320562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd2be286c0 0x55cd2be3afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.967+0000 7f85aef9f700 1 -- 172.21.15.6:0/1396320562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd2be286c0 msgr2=0x55cd2be3afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.967+0000 7f85aef9f700 1 --2- 172.21.15.6:0/1396320562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd2be286c0 0x55cd2be3afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.967+0000 7f85aef9f700 1 -- 172.21.15.6:0/1396320562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd2be282f0 msgr2=0x55cd2be3aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.967+0000 7f85aef9f700 1 --2- 172.21.15.6:0/1396320562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd2be282f0 0x55cd2be3aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.967+0000 7f85aef9f700 1 -- 172.21.15.6:0/1396320562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a000a180 con 0x55cd2bd86710 2023-10-06T02:24:56.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.968+0000 7f85aef9f700 1 --2- 172.21.15.6:0/1396320562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd2bd86710 0x55cd2be2b250 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009980 tx=0x7f85a800c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9670e4b141df22b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.968+0000 7f85ad79c700 1 -- 172.21.15.6:0/1396320562 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a800f040 con 0x55cd2bd86710 2023-10-06T02:24:56.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.968+0000 7f85ad79c700 1 -- 172.21.15.6:0/1396320562 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a8008b50 con 0x55cd2bd86710 2023-10-06T02:24:56.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.968+0000 7f85ad79c700 1 -- 172.21.15.6:0/1396320562 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8013420 con 0x55cd2bd86710 2023-10-06T02:24:56.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.968+0000 7f85b5d64000 1 -- 172.21.15.6:0/1396320562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd2bd86710 msgr2=0x55cd2be2b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.968+0000 7f85b5d64000 1 --2- 172.21.15.6:0/1396320562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd2bd86710 0x55cd2be2b250 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009980 tx=0x7f85a800c040 comp rx=0 tx=0).stop 2023-10-06T02:24:56.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.968+0000 7f85b5d64000 1 -- 172.21.15.6:0/1396320562 shutdown_connections 2023-10-06T02:24:56.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.968+0000 7f85b5d64000 1 --2- 172.21.15.6:0/1396320562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd2be286c0 0x55cd2be3afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.968+0000 7f85b5d64000 1 --2- 172.21.15.6:0/1396320562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd2bd86710 0x55cd2be2b250 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.968+0000 7f85b5d64000 1 --2- 172.21.15.6:0/1396320562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd2be282f0 0x55cd2be3aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.968+0000 7f85b5d64000 1 -- 172.21.15.6:0/1396320562 >> 172.21.15.6:0/1396320562 conn(0x55cd2bd5b5d0 msgr2=0x55cd2be34ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.968+0000 7f85b5d64000 1 -- 172.21.15.6:0/1396320562 shutdown_connections 2023-10-06T02:24:56.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.968+0000 7f85b5d64000 1 -- 172.21.15.6:0/1396320562 wait complete. 2023-10-06T02:24:56.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.969+0000 7f85b5d64000 1 Processor -- start 2023-10-06T02:24:56.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.969+0000 7f85b5d64000 1 -- start start 2023-10-06T02:24:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85b5d64000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd2bd86710 0x55cd2be3a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85b5d64000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd2be282f0 0x55cd2bd9a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85b5d64000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd2be286c0 0x55cd2bd9ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85b5d64000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd2be39700 con 0x55cd2bd86710 2023-10-06T02:24:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85b5d64000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd2bda18c0 con 0x55cd2be282f0 2023-10-06T02:24:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85b5d64000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd2be39960 con 0x55cd2be286c0 2023-10-06T02:24:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85aef9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd2bd86710 0x55cd2be3a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85aef9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd2bd86710 0x55cd2be3a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59184/0 (socket says 172.21.15.6:59184) 2023-10-06T02:24:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85aef9f700 1 -- 172.21.15.6:0/1200626670 learned_addr learned my addr 172.21.15.6:0/1200626670 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85af7a0700 1 --2- 172.21.15.6:0/1200626670 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd2be286c0 0x55cd2bd9ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85ae79e700 1 --2- 172.21.15.6:0/1200626670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd2be282f0 0x55cd2bd9a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85aef9f700 1 -- 172.21.15.6:0/1200626670 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd2be286c0 msgr2=0x55cd2bd9ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85aef9f700 1 --2- 172.21.15.6:0/1200626670 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd2be286c0 0x55cd2bd9ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85aef9f700 1 -- 172.21.15.6:0/1200626670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd2be282f0 msgr2=0x55cd2bd9a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85aef9f700 1 --2- 172.21.15.6:0/1200626670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd2be282f0 0x55cd2bd9a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85aef9f700 1 -- 172.21.15.6:0/1200626670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a8009580 con 0x55cd2bd86710 2023-10-06T02:24:56.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85aef9f700 1 --2- 172.21.15.6:0/1200626670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd2bd86710 0x55cd2be3a340 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f85a8005fe0 tx=0x7f85a8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85a77fe700 1 -- 172.21.15.6:0/1200626670 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a800f040 con 0x55cd2bd86710 2023-10-06T02:24:56.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.970+0000 7f85a77fe700 1 -- 172.21.15.6:0/1200626670 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a801d430 con 0x55cd2bd86710 2023-10-06T02:24:56.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.971+0000 7f85b5d64000 1 -- 172.21.15.6:0/1200626670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cd2bcb43d0 con 0x55cd2bd86710 2023-10-06T02:24:56.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.971+0000 7f85a77fe700 1 -- 172.21.15.6:0/1200626670 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a801d810 con 0x55cd2bd86710 2023-10-06T02:24:56.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.971+0000 7f85b5d64000 1 -- 172.21.15.6:0/1200626670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd2bca7ae0 con 0x55cd2bd86710 2023-10-06T02:24:56.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.972+0000 7f85a77fe700 1 -- 172.21.15.6:0/1200626670 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85a801dc00 con 0x55cd2bd86710 2023-10-06T02:24:56.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.972+0000 7f85a77fe700 1 --2- 172.21.15.6:0/1200626670 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f85900658c0 0x7f8590067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.972+0000 7f85a77fe700 1 -- 172.21.15.6:0/1200626670 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f85a8085c20 con 0x55cd2bd86710 2023-10-06T02:24:56.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.972+0000 7f85b5d64000 1 --2- 172.21.15.6:0/1200626670 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55cd2bda1420 0x55cd2bd9c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.972+0000 7f85b5d64000 1 -- 172.21.15.6:0/1200626670 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:1 14.15 14:aa448500:::500.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55cd2bd9cde0 con 0x55cd2bda1420 2023-10-06T02:24:56.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.973+0000 7f85ae79e700 1 --2- 172.21.15.6:0/1200626670 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f85900658c0 0x7f8590067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.973+0000 7f85af7a0700 1 --2- 172.21.15.6:0/1200626670 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55cd2bda1420 0x55cd2bd9c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.973+0000 7f85af7a0700 1 --2- 172.21.15.6:0/1200626670 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55cd2bda1420 0x55cd2bd9c8a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.973+0000 7f85ae79e700 1 --2- 172.21.15.6:0/1200626670 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f85900658c0 0x7f8590067d70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8598000c00 tx=0x7f85980030e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.973+0000 7f85af7a0700 1 -- 172.21.15.6:0/1200626670 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(1 500.00000000 [omap-get-keys out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7f85a000e7e0 con 0x55cd2bda1420 2023-10-06T02:24:56.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.973+0000 7f85b5d64000 1 -- 172.21.15.6:0/1200626670 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55cd2bda1420 msgr2=0x55cd2bd9c8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.973+0000 7f85b5d64000 1 --2- 172.21.15.6:0/1200626670 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55cd2bda1420 0x55cd2bd9c8a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.973+0000 7f85b5d64000 1 -- 172.21.15.6:0/1200626670 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f85900658c0 msgr2=0x7f8590067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.973+0000 7f85b5d64000 1 --2- 172.21.15.6:0/1200626670 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f85900658c0 0x7f8590067d70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8598000c00 tx=0x7f85980030e0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.973+0000 7f85b5d64000 1 -- 172.21.15.6:0/1200626670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd2bd86710 msgr2=0x55cd2be3a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.973+0000 7f85b5d64000 1 --2- 172.21.15.6:0/1200626670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd2bd86710 0x55cd2be3a340 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f85a8005fe0 tx=0x7f85a8018000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.973+0000 7f85af7a0700 1 -- 172.21.15.6:0/1200626670 reap_dead start 2023-10-06T02:24:56.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.974+0000 7f85b5d64000 1 -- 172.21.15.6:0/1200626670 shutdown_connections 2023-10-06T02:24:56.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.974+0000 7f85b5d64000 1 -- 172.21.15.6:0/1200626670 >> 172.21.15.6:0/1200626670 conn(0x55cd2bd5b5d0 msgr2=0x55cd2be36c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.974+0000 7f85b5d64000 1 -- 172.21.15.6:0/1200626670 shutdown_connections 2023-10-06T02:24:56.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:56.974+0000 7f85b5d64000 1 -- 172.21.15.6:0/1200626670 wait complete. 2023-10-06T02:24:56.981 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys mds_snaptable 2023-10-06T02:24:57.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.053+0000 7f1c68b5e000 1 Processor -- start 2023-10-06T02:24:57.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.053+0000 7f1c68b5e000 1 -- start start 2023-10-06T02:24:57.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.054+0000 7f1c68b5e000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594819e8e30 0x559481a06050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.054+0000 7f1c68b5e000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559481a91f50 0x5594819ed600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.054+0000 7f1c68b5e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559481a95260 0x559481a84bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.054+0000 7f1c68b5e000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559481908980 con 0x5594819e8e30 2023-10-06T02:24:57.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.054+0000 7f1c68b5e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559481908620 con 0x559481a95260 2023-10-06T02:24:57.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.054+0000 7f1c68b5e000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594818ff400 con 0x559481a91f50 2023-10-06T02:24:57.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.054+0000 7f1c61d99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594819e8e30 0x559481a06050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.054+0000 7f1c61d99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594819e8e30 0x559481a06050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59206/0 (socket says 172.21.15.6:59206) 2023-10-06T02:24:57.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.054+0000 7f1c61d99700 1 -- 172.21.15.6:0/1043380605 learned_addr learned my addr 172.21.15.6:0/1043380605 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.054+0000 7f1c61598700 1 --2- 172.21.15.6:0/1043380605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559481a91f50 0x5594819ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.054+0000 7f1c6259a700 1 --2- 172.21.15.6:0/1043380605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559481a95260 0x559481a84bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.054+0000 7f1c61d99700 1 -- 172.21.15.6:0/1043380605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559481a91f50 msgr2=0x5594819ed600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.054+0000 7f1c61d99700 1 --2- 172.21.15.6:0/1043380605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559481a91f50 0x5594819ed600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.054+0000 7f1c61d99700 1 -- 172.21.15.6:0/1043380605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559481a95260 msgr2=0x559481a84bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.054+0000 7f1c61d99700 1 --2- 172.21.15.6:0/1043380605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559481a95260 0x559481a84bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.054+0000 7f1c61d99700 1 -- 172.21.15.6:0/1043380605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5400a0e0 con 0x5594819e8e30 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.055+0000 7f1c61d99700 1 --2- 172.21.15.6:0/1043380605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594819e8e30 0x559481a06050 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x5594819be300 tx=0x7f1c54015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6d8da953291cab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.055+0000 7f1c5bfff700 1 -- 172.21.15.6:0/1043380605 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400fe20 con 0x5594819e8e30 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.055+0000 7f1c5bfff700 1 -- 172.21.15.6:0/1043380605 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5401f070 con 0x5594819e8e30 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.055+0000 7f1c5bfff700 1 -- 172.21.15.6:0/1043380605 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54000f40 con 0x5594819e8e30 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.055+0000 7f1c68b5e000 1 -- 172.21.15.6:0/1043380605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594819e8e30 msgr2=0x559481a06050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.055+0000 7f1c68b5e000 1 --2- 172.21.15.6:0/1043380605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594819e8e30 0x559481a06050 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x5594819be300 tx=0x7f1c54015000 comp rx=0 tx=0).stop 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.055+0000 7f1c68b5e000 1 -- 172.21.15.6:0/1043380605 shutdown_connections 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.055+0000 7f1c68b5e000 1 --2- 172.21.15.6:0/1043380605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559481a95260 0x559481a84bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.055+0000 7f1c68b5e000 1 --2- 172.21.15.6:0/1043380605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594819e8e30 0x559481a06050 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.055+0000 7f1c68b5e000 1 --2- 172.21.15.6:0/1043380605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559481a91f50 0x5594819ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.055+0000 7f1c68b5e000 1 -- 172.21.15.6:0/1043380605 >> 172.21.15.6:0/1043380605 conn(0x559481a04bd0 msgr2=0x559481a04fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.055+0000 7f1c68b5e000 1 -- 172.21.15.6:0/1043380605 shutdown_connections 2023-10-06T02:24:57.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.055+0000 7f1c68b5e000 1 -- 172.21.15.6:0/1043380605 wait complete. 2023-10-06T02:24:57.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.056+0000 7f1c68b5e000 1 Processor -- start 2023-10-06T02:24:57.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.056+0000 7f1c68b5e000 1 -- start start 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c68b5e000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5594819e8e30 0x559481a82d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c68b5e000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559481a91f50 0x559481a939e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c68b5e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559481a95260 0x559481a80230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c68b5e000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559481a82390 con 0x559481a91f50 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c68b5e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559481a842f0 con 0x559481a95260 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c68b5e000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x559481a825c0 con 0x5594819e8e30 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c61598700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559481a91f50 0x559481a939e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c61598700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559481a91f50 0x559481a939e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59208/0 (socket says 172.21.15.6:59208) 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c61598700 1 -- 172.21.15.6:0/3510275029 learned_addr learned my addr 172.21.15.6:0/3510275029 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c6259a700 1 --2- 172.21.15.6:0/3510275029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559481a95260 0x559481a80230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c61d99700 1 --2- 172.21.15.6:0/3510275029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5594819e8e30 0x559481a82d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c61598700 1 -- 172.21.15.6:0/3510275029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5594819e8e30 msgr2=0x559481a82d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c61598700 1 --2- 172.21.15.6:0/3510275029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5594819e8e30 0x559481a82d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c61598700 1 -- 172.21.15.6:0/3510275029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559481a95260 msgr2=0x559481a80230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c61598700 1 --2- 172.21.15.6:0/3510275029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559481a95260 0x559481a80230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c61598700 1 -- 172.21.15.6:0/3510275029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594819311c0 con 0x559481a91f50 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c61598700 1 --2- 172.21.15.6:0/3510275029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559481a91f50 0x559481a939e0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00dec0 tx=0x7f1c4c001900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c5a7fc700 1 -- 172.21.15.6:0/3510275029 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c00bda0 con 0x559481a91f50 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c5a7fc700 1 -- 172.21.15.6:0/3510275029 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c00f450 con 0x559481a91f50 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c68b5e000 1 -- 172.21.15.6:0/3510275029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5594819173d0 con 0x559481a91f50 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.057+0000 7f1c5a7fc700 1 -- 172.21.15.6:0/3510275029 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c00f7d0 con 0x559481a91f50 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.058+0000 7f1c68b5e000 1 -- 172.21.15.6:0/3510275029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55948190aae0 con 0x559481a91f50 2023-10-06T02:24:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.059+0000 7f1c5a7fc700 1 -- 172.21.15.6:0/3510275029 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c4c00fb80 con 0x559481a91f50 2023-10-06T02:24:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.059+0000 7f1c5a7fc700 1 --2- 172.21.15.6:0/3510275029 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c44065890 0x7f1c44067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.059+0000 7f1c5a7fc700 1 -- 172.21.15.6:0/3510275029 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f1c4c083a60 con 0x559481a91f50 2023-10-06T02:24:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.059+0000 7f1c68b5e000 1 --2- 172.21.15.6:0/3510275029 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x559481a93f20 0x559481a01180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.060+0000 7f1c61d99700 1 --2- 172.21.15.6:0/3510275029 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c44065890 0x7f1c44067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.060+0000 7f1c68b5e000 1 -- 172.21.15.6:0/3510275029 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:1 14.d 14:b50e409b:::mds_snaptable:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x5594819ed6e0 con 0x559481a93f20 2023-10-06T02:24:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.060+0000 7f1c6259a700 1 --2- 172.21.15.6:0/3510275029 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x559481a93f20 0x559481a01180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.060+0000 7f1c61d99700 1 --2- 172.21.15.6:0/3510275029 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c44065890 0x7f1c44067d40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x5594819be300 tx=0x7f1c5401d070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.060+0000 7f1c6259a700 1 --2- 172.21.15.6:0/3510275029 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x559481a93f20 0x559481a01180 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.060+0000 7f1c6259a700 1 -- 172.21.15.6:0/3510275029 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(1 mds_snaptable [omap-get-keys out=5b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+5 (crc 0 0 0) 0x7f1c5c0099d0 con 0x559481a93f20 2023-10-06T02:24:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.060+0000 7f1c68b5e000 1 -- 172.21.15.6:0/3510275029 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x559481a93f20 msgr2=0x559481a01180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.060+0000 7f1c68b5e000 1 --2- 172.21.15.6:0/3510275029 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x559481a93f20 0x559481a01180 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.061+0000 7f1c68b5e000 1 -- 172.21.15.6:0/3510275029 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c44065890 msgr2=0x7f1c44067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.061+0000 7f1c68b5e000 1 --2- 172.21.15.6:0/3510275029 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c44065890 0x7f1c44067d40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x5594819be300 tx=0x7f1c5401d070 comp rx=0 tx=0).stop 2023-10-06T02:24:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.061+0000 7f1c68b5e000 1 -- 172.21.15.6:0/3510275029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559481a91f50 msgr2=0x559481a939e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.061+0000 7f1c68b5e000 1 --2- 172.21.15.6:0/3510275029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559481a91f50 0x559481a939e0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00dec0 tx=0x7f1c4c001900 comp rx=0 tx=0).stop 2023-10-06T02:24:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.061+0000 7f1c6259a700 1 -- 172.21.15.6:0/3510275029 reap_dead start 2023-10-06T02:24:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.061+0000 7f1c68b5e000 1 -- 172.21.15.6:0/3510275029 shutdown_connections 2023-10-06T02:24:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.061+0000 7f1c68b5e000 1 -- 172.21.15.6:0/3510275029 >> 172.21.15.6:0/3510275029 conn(0x559481a04bd0 msgr2=0x559481a04fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.061+0000 7f1c68b5e000 1 -- 172.21.15.6:0/3510275029 shutdown_connections 2023-10-06T02:24:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.061+0000 7f1c68b5e000 1 -- 172.21.15.6:0/3510275029 wait complete. 2023-10-06T02:24:57.067 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys mds0_inotable 2023-10-06T02:24:57.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.141+0000 7f9b6aadc000 1 Processor -- start 2023-10-06T02:24:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.141+0000 7f9b6aadc000 1 -- start start 2023-10-06T02:24:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b6aadc000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b50002300 0x56104213bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b6aadc000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5610420684f0 0x56104213c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b6aadc000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610420666b0 0x561042064d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b6aadc000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561041fb0980 con 0x7f9b50002300 2023-10-06T02:24:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b6aadc000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561041fb0620 con 0x5610420666b0 2023-10-06T02:24:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b6aadc000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561041fa7400 con 0x5610420684f0 2023-10-06T02:24:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b63d17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b50002300 0x56104213bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b63d17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b50002300 0x56104213bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59220/0 (socket says 172.21.15.6:59220) 2023-10-06T02:24:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b63d17700 1 -- 172.21.15.6:0/3894674689 learned_addr learned my addr 172.21.15.6:0/3894674689 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b64518700 1 --2- 172.21.15.6:0/3894674689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610420666b0 0x561042064d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b63516700 1 --2- 172.21.15.6:0/3894674689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5610420684f0 0x56104213c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b63d17700 1 -- 172.21.15.6:0/3894674689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5610420684f0 msgr2=0x56104213c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b63d17700 1 --2- 172.21.15.6:0/3894674689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5610420684f0 0x56104213c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b63d17700 1 -- 172.21.15.6:0/3894674689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610420666b0 msgr2=0x561042064d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b63d17700 1 --2- 172.21.15.6:0/3894674689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610420666b0 0x561042064d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b63d17700 1 -- 172.21.15.6:0/3894674689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561041fbf3d0 con 0x7f9b50002300 2023-10-06T02:24:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b63516700 1 --2- 172.21.15.6:0/3894674689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5610420684f0 0x56104213c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b64518700 1 --2- 172.21.15.6:0/3894674689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610420666b0 0x561042064d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b63d17700 1 --2- 172.21.15.6:0/3894674689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b50002300 0x56104213bae0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0094b0 tx=0x7f9b5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c2fcadfbaccc8b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b62514700 1 -- 172.21.15.6:0/3894674689 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c00e040 con 0x7f9b50002300 2023-10-06T02:24:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b62514700 1 -- 172.21.15.6:0/3894674689 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5c008800 con 0x7f9b50002300 2023-10-06T02:24:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.142+0000 7f9b62514700 1 -- 172.21.15.6:0/3894674689 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c008e30 con 0x7f9b50002300 2023-10-06T02:24:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.143+0000 7f9b6aadc000 1 -- 172.21.15.6:0/3894674689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b50002300 msgr2=0x56104213bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.143+0000 7f9b6aadc000 1 --2- 172.21.15.6:0/3894674689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b50002300 0x56104213bae0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0094b0 tx=0x7f9b5c017000 comp rx=0 tx=0).stop 2023-10-06T02:24:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.143+0000 7f9b6aadc000 1 -- 172.21.15.6:0/3894674689 shutdown_connections 2023-10-06T02:24:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.143+0000 7f9b6aadc000 1 --2- 172.21.15.6:0/3894674689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610420666b0 0x561042064d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.143+0000 7f9b6aadc000 1 --2- 172.21.15.6:0/3894674689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b50002300 0x56104213bae0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.143+0000 7f9b6aadc000 1 --2- 172.21.15.6:0/3894674689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5610420684f0 0x56104213c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.143+0000 7f9b6aadc000 1 -- 172.21.15.6:0/3894674689 >> 172.21.15.6:0/3894674689 conn(0x5610420646c0 msgr2=0x561042093490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.143+0000 7f9b6aadc000 1 -- 172.21.15.6:0/3894674689 shutdown_connections 2023-10-06T02:24:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.143+0000 7f9b6aadc000 1 -- 172.21.15.6:0/3894674689 wait complete. 2023-10-06T02:24:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.144+0000 7f9b6aadc000 1 Processor -- start 2023-10-06T02:24:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.144+0000 7f9b6aadc000 1 -- start start 2023-10-06T02:24:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.144+0000 7f9b6aadc000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5610420666b0 0x56104211dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.144+0000 7f9b6aadc000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5610420684f0 0x5610420932c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.144+0000 7f9b6aadc000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b50002300 0x561042093800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.144+0000 7f9b6aadc000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104211ed90 con 0x5610420666b0 2023-10-06T02:24:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.144+0000 7f9b6aadc000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561042120f50 con 0x7f9b50002300 2023-10-06T02:24:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.144+0000 7f9b6aadc000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610421211f0 con 0x5610420684f0 2023-10-06T02:24:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.144+0000 7f9b63d17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5610420666b0 0x56104211dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.144+0000 7f9b63d17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5610420666b0 0x56104211dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59234/0 (socket says 172.21.15.6:59234) 2023-10-06T02:24:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.144+0000 7f9b63d17700 1 -- 172.21.15.6:0/4064340443 learned_addr learned my addr 172.21.15.6:0/4064340443 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.145+0000 7f9b64518700 1 --2- 172.21.15.6:0/4064340443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b50002300 0x561042093800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.145+0000 7f9b63516700 1 --2- 172.21.15.6:0/4064340443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5610420684f0 0x5610420932c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.145+0000 7f9b63d17700 1 -- 172.21.15.6:0/4064340443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5610420684f0 msgr2=0x5610420932c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.145+0000 7f9b63d17700 1 --2- 172.21.15.6:0/4064340443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5610420684f0 0x5610420932c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.145+0000 7f9b63d17700 1 -- 172.21.15.6:0/4064340443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b50002300 msgr2=0x561042093800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.145+0000 7f9b63d17700 1 --2- 172.21.15.6:0/4064340443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b50002300 0x561042093800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.145+0000 7f9b63d17700 1 -- 172.21.15.6:0/4064340443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b50001e10 con 0x5610420666b0 2023-10-06T02:24:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.145+0000 7f9b63d17700 1 --2- 172.21.15.6:0/4064340443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5610420666b0 0x56104211dfa0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c005430 tx=0x7f9b5c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.145+0000 7f9b60d11700 1 -- 172.21.15.6:0/4064340443 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c00e040 con 0x5610420666b0 2023-10-06T02:24:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.145+0000 7f9b60d11700 1 -- 172.21.15.6:0/4064340443 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5c0056f0 con 0x5610420666b0 2023-10-06T02:24:57.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.145+0000 7f9b6aadc000 1 -- 172.21.15.6:0/4064340443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561041fb2ae0 con 0x5610420666b0 2023-10-06T02:24:57.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.145+0000 7f9b60d11700 1 -- 172.21.15.6:0/4064340443 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c01e860 con 0x5610420666b0 2023-10-06T02:24:57.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.145+0000 7f9b6aadc000 1 -- 172.21.15.6:0/4064340443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561041fb2540 con 0x5610420666b0 2023-10-06T02:24:57.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.146+0000 7f9b60d11700 1 -- 172.21.15.6:0/4064340443 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b5c02d030 con 0x5610420666b0 2023-10-06T02:24:57.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.147+0000 7f9b60d11700 1 --2- 172.21.15.6:0/4064340443 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9b44065890 0x7f9b44067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.147+0000 7f9b60d11700 1 -- 172.21.15.6:0/4064340443 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f9b5c02b070 con 0x5610420666b0 2023-10-06T02:24:57.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.147+0000 7f9b63516700 1 --2- 172.21.15.6:0/4064340443 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9b44065890 0x7f9b44067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.147+0000 7f9b6aadc000 1 --2- 172.21.15.6:0/4064340443 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x561042121930 0x5610420abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.147+0000 7f9b6aadc000 1 -- 172.21.15.6:0/4064340443 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x56104213b990 con 0x561042121930 2023-10-06T02:24:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.147+0000 7f9b64518700 1 --2- 172.21.15.6:0/4064340443 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x561042121930 0x5610420abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.147+0000 7f9b63516700 1 --2- 172.21.15.6:0/4064340443 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9b44065890 0x7f9b44067d40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c000e50 tx=0x7f9b4c001e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.147+0000 7f9b64518700 1 --2- 172.21.15.6:0/4064340443 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x561042121930 0x5610420abd20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.148+0000 7f9b64518700 1 -- 172.21.15.6:0/4064340443 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(1 mds0_inotable [omap-get-keys out=5b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+5 (crc 0 0 0) 0x7f9b5400ab10 con 0x561042121930 2023-10-06T02:24:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.148+0000 7f9b6aadc000 1 -- 172.21.15.6:0/4064340443 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x561042121930 msgr2=0x5610420abd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.148+0000 7f9b6aadc000 1 --2- 172.21.15.6:0/4064340443 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x561042121930 0x5610420abd20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.148+0000 7f9b6aadc000 1 -- 172.21.15.6:0/4064340443 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9b44065890 msgr2=0x7f9b44067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.148+0000 7f9b6aadc000 1 --2- 172.21.15.6:0/4064340443 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9b44065890 0x7f9b44067d40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c000e50 tx=0x7f9b4c001e90 comp rx=0 tx=0).stop 2023-10-06T02:24:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.148+0000 7f9b6aadc000 1 -- 172.21.15.6:0/4064340443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5610420666b0 msgr2=0x56104211dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.148+0000 7f9b6aadc000 1 --2- 172.21.15.6:0/4064340443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5610420666b0 0x56104211dfa0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c005430 tx=0x7f9b5c01d000 comp rx=0 tx=0).stop 2023-10-06T02:24:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.148+0000 7f9b64518700 1 -- 172.21.15.6:0/4064340443 reap_dead start 2023-10-06T02:24:57.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.148+0000 7f9b6aadc000 1 -- 172.21.15.6:0/4064340443 shutdown_connections 2023-10-06T02:24:57.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.148+0000 7f9b6aadc000 1 -- 172.21.15.6:0/4064340443 >> 172.21.15.6:0/4064340443 conn(0x5610420646c0 msgr2=0x561042122010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.148+0000 7f9b6aadc000 1 -- 172.21.15.6:0/4064340443 shutdown_connections 2023-10-06T02:24:57.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.148+0000 7f9b6aadc000 1 -- 172.21.15.6:0/4064340443 wait complete. 2023-10-06T02:24:57.156 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 100.00000000 2023-10-06T02:24:57.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.230+0000 7f31b7408000 1 Processor -- start 2023-10-06T02:24:57.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.230+0000 7f31b7408000 1 -- start start 2023-10-06T02:24:57.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.231+0000 7f31b7408000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352e23d470 0x56352e213660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.231+0000 7f31b7408000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e258410 0x56352e2ea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.231+0000 7f31b7408000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352e2e7f90 0x56352e2e6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.231+0000 7f31b7408000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352e1b8320 con 0x56352e23d470 2023-10-06T02:24:57.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.231+0000 7f31b7408000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352e15c980 con 0x56352e258410 2023-10-06T02:24:57.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.231+0000 7f31b7408000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56352e15c620 con 0x56352e2e7f90 2023-10-06T02:24:57.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.231+0000 7f31b0643700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352e23d470 0x56352e213660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.231+0000 7f31b0643700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352e23d470 0x56352e213660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59236/0 (socket says 172.21.15.6:59236) 2023-10-06T02:24:57.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.231+0000 7f31b0643700 1 -- 172.21.15.6:0/1992956992 learned_addr learned my addr 172.21.15.6:0/1992956992 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.231+0000 7f31afe42700 1 --2- 172.21.15.6:0/1992956992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e258410 0x56352e2ea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.231+0000 7f31b0e44700 1 --2- 172.21.15.6:0/1992956992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352e2e7f90 0x56352e2e6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31b0643700 1 -- 172.21.15.6:0/1992956992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352e2e7f90 msgr2=0x56352e2e6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31b0643700 1 --2- 172.21.15.6:0/1992956992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352e2e7f90 0x56352e2e6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31b0643700 1 -- 172.21.15.6:0/1992956992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e258410 msgr2=0x56352e2ea2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31b0643700 1 --2- 172.21.15.6:0/1992956992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e258410 0x56352e2ea2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31b0643700 1 -- 172.21.15.6:0/1992956992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a000a0e0 con 0x56352e23d470 2023-10-06T02:24:57.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31afe42700 1 --2- 172.21.15.6:0/1992956992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e258410 0x56352e2ea2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:57.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31b0643700 1 --2- 172.21.15.6:0/1992956992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352e23d470 0x56352e213660 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f31a8001da0 tx=0x7f31a8001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1ec33ed4cf73bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31aee40700 1 -- 172.21.15.6:0/1992956992 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8014070 con 0x56352e23d470 2023-10-06T02:24:57.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31aee40700 1 -- 172.21.15.6:0/1992956992 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a8008030 con 0x56352e23d470 2023-10-06T02:24:57.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31aee40700 1 -- 172.21.15.6:0/1992956992 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a800bd90 con 0x56352e23d470 2023-10-06T02:24:57.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31b7408000 1 -- 172.21.15.6:0/1992956992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352e23d470 msgr2=0x56352e213660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31b7408000 1 --2- 172.21.15.6:0/1992956992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352e23d470 0x56352e213660 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f31a8001da0 tx=0x7f31a8001810 comp rx=0 tx=0).stop 2023-10-06T02:24:57.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31b7408000 1 -- 172.21.15.6:0/1992956992 shutdown_connections 2023-10-06T02:24:57.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31b7408000 1 --2- 172.21.15.6:0/1992956992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352e2e7f90 0x56352e2e6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31b7408000 1 --2- 172.21.15.6:0/1992956992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352e23d470 0x56352e213660 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31b7408000 1 --2- 172.21.15.6:0/1992956992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e258410 0x56352e2ea2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31b7408000 1 -- 172.21.15.6:0/1992956992 >> 172.21.15.6:0/1992956992 conn(0x56352e211d50 msgr2=0x56352e23cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31b7408000 1 -- 172.21.15.6:0/1992956992 shutdown_connections 2023-10-06T02:24:57.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.232+0000 7f31b7408000 1 -- 172.21.15.6:0/1992956992 wait complete. 2023-10-06T02:24:57.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.233+0000 7f31b7408000 1 Processor -- start 2023-10-06T02:24:57.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.233+0000 7f31b7408000 1 -- start start 2023-10-06T02:24:57.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.234+0000 7f31b7408000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352e23d470 0x56352e2e5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.234+0000 7f31b7408000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352e258410 0x56352e2fc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.234+0000 7f31b7408000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e2e7f90 0x56352e2fc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.234+0000 7f31b7408000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352e153400 con 0x56352e258410 2023-10-06T02:24:57.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.234+0000 7f31b7408000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352e2f9cf0 con 0x56352e2e7f90 2023-10-06T02:24:57.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.234+0000 7f31b7408000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56352e2f2990 con 0x56352e23d470 2023-10-06T02:24:57.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.234+0000 7f31afe42700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352e258410 0x56352e2fc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.234+0000 7f31afe42700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352e258410 0x56352e2fc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59238/0 (socket says 172.21.15.6:59238) 2023-10-06T02:24:57.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.234+0000 7f31afe42700 1 -- 172.21.15.6:0/1657357028 learned_addr learned my addr 172.21.15.6:0/1657357028 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.234+0000 7f31b0643700 1 --2- 172.21.15.6:0/1657357028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352e23d470 0x56352e2e5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.234+0000 7f31b0e44700 1 --2- 172.21.15.6:0/1657357028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e2e7f90 0x56352e2fc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.234+0000 7f31afe42700 1 -- 172.21.15.6:0/1657357028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352e23d470 msgr2=0x56352e2e5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.234+0000 7f31afe42700 1 --2- 172.21.15.6:0/1657357028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352e23d470 0x56352e2e5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.234+0000 7f31afe42700 1 -- 172.21.15.6:0/1657357028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e2e7f90 msgr2=0x56352e2fc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.234+0000 7f31afe42700 1 --2- 172.21.15.6:0/1657357028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352e2e7f90 0x56352e2fc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.234+0000 7f31afe42700 1 -- 172.21.15.6:0/1657357028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a800a040 con 0x56352e258410 2023-10-06T02:24:57.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.234+0000 7f31afe42700 1 --2- 172.21.15.6:0/1657357028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352e258410 0x56352e2fc120 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f319800b640 tx=0x7f3198001c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.235+0000 7f31ad63d700 1 -- 172.21.15.6:0/1657357028 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198015030 con 0x56352e258410 2023-10-06T02:24:57.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.235+0000 7f31ad63d700 1 -- 172.21.15.6:0/1657357028 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319800f580 con 0x56352e258410 2023-10-06T02:24:57.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.235+0000 7f31ad63d700 1 -- 172.21.15.6:0/1657357028 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319800f900 con 0x56352e258410 2023-10-06T02:24:57.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.235+0000 7f31b7408000 1 -- 172.21.15.6:0/1657357028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56352e15eae0 con 0x56352e258410 2023-10-06T02:24:57.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.235+0000 7f31b7408000 1 -- 172.21.15.6:0/1657357028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56352e15e540 con 0x56352e258410 2023-10-06T02:24:57.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.236+0000 7f31ad63d700 1 -- 172.21.15.6:0/1657357028 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3198018070 con 0x56352e258410 2023-10-06T02:24:57.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.236+0000 7f31ad63d700 1 --2- 172.21.15.6:0/1657357028 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3190065890 0x7f3190067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.236+0000 7f31ad63d700 1 -- 172.21.15.6:0/1657357028 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f3198016070 con 0x56352e258410 2023-10-06T02:24:57.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.237+0000 7f31b0643700 1 --2- 172.21.15.6:0/1657357028 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3190065890 0x7f3190067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.237+0000 7f31b7408000 1 --2- 172.21.15.6:0/1657357028 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56352e2de780 0x56352e2f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.237+0000 7f31b7408000 1 -- 172.21.15.6:0/1657357028 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:1 14.13 14:cd5a64a3:::100.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x56352e2fa3f0 con 0x56352e2de780 2023-10-06T02:24:57.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.237+0000 7f31b0e44700 1 --2- 172.21.15.6:0/1657357028 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56352e2de780 0x56352e2f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.237+0000 7f31b0e44700 1 --2- 172.21.15.6:0/1657357028 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56352e2de780 0x56352e2f2160 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.237+0000 7f31b0643700 1 --2- 172.21.15.6:0/1657357028 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3190065890 0x7f3190067d40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f31a8001d40 tx=0x7f31a8016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.237+0000 7f31b0e44700 1 -- 172.21.15.6:0/1657357028 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(1 100.00000000 [omap-get-keys out=155b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+155 (crc 0 0 0) 0x7f31a0010b10 con 0x56352e2de780 2023-10-06T02:24:57.247 INFO:teuthology.orchestra.run.smithi006.stdout:stray0_head 2023-10-06T02:24:57.247 INFO:teuthology.orchestra.run.smithi006.stdout:stray1_head 2023-10-06T02:24:57.247 INFO:teuthology.orchestra.run.smithi006.stdout:stray2_head 2023-10-06T02:24:57.247 INFO:teuthology.orchestra.run.smithi006.stdout:stray3_head 2023-10-06T02:24:57.247 INFO:teuthology.orchestra.run.smithi006.stdout:stray4_head 2023-10-06T02:24:57.248 INFO:teuthology.orchestra.run.smithi006.stdout:stray5_head 2023-10-06T02:24:57.248 INFO:teuthology.orchestra.run.smithi006.stdout:stray6_head 2023-10-06T02:24:57.248 INFO:teuthology.orchestra.run.smithi006.stdout:stray7_head 2023-10-06T02:24:57.248 INFO:teuthology.orchestra.run.smithi006.stdout:stray8_head 2023-10-06T02:24:57.248 INFO:teuthology.orchestra.run.smithi006.stdout:stray9_head 2023-10-06T02:24:57.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.237+0000 7f31b7408000 1 -- 172.21.15.6:0/1657357028 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56352e2de780 msgr2=0x56352e2f2160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.237+0000 7f31b7408000 1 --2- 172.21.15.6:0/1657357028 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56352e2de780 0x56352e2f2160 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.237+0000 7f31b7408000 1 -- 172.21.15.6:0/1657357028 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3190065890 msgr2=0x7f3190067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.237+0000 7f31b7408000 1 --2- 172.21.15.6:0/1657357028 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3190065890 0x7f3190067d40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f31a8001d40 tx=0x7f31a8016000 comp rx=0 tx=0).stop 2023-10-06T02:24:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.237+0000 7f31b7408000 1 -- 172.21.15.6:0/1657357028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352e258410 msgr2=0x56352e2fc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.237+0000 7f31b7408000 1 --2- 172.21.15.6:0/1657357028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352e258410 0x56352e2fc120 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f319800b640 tx=0x7f3198001c90 comp rx=0 tx=0).stop 2023-10-06T02:24:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.238+0000 7f31b0e44700 1 -- 172.21.15.6:0/1657357028 reap_dead start 2023-10-06T02:24:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.238+0000 7f31b7408000 1 -- 172.21.15.6:0/1657357028 shutdown_connections 2023-10-06T02:24:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.238+0000 7f31b7408000 1 -- 172.21.15.6:0/1657357028 >> 172.21.15.6:0/1657357028 conn(0x56352e211d50 msgr2=0x56352e23cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.238+0000 7f31b7408000 1 -- 172.21.15.6:0/1657357028 shutdown_connections 2023-10-06T02:24:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.238+0000 7f31b7408000 1 -- 172.21.15.6:0/1657357028 wait complete. 2023-10-06T02:24:57.251 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys mds0_sessionmap 2023-10-06T02:24:57.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.326+0000 7f4349f23000 1 Processor -- start 2023-10-06T02:24:57.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.326+0000 7f4349f23000 1 -- start start 2023-10-06T02:24:57.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.326+0000 7f4349f23000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557f7389c710 0x557f73943f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.326+0000 7f4349f23000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f7393e2f0 0x557f73938280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.326+0000 7f4349f23000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557f7393e6c0 0x557f73941330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.326+0000 7f4349f23000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f737bb980 con 0x557f7393e6c0 2023-10-06T02:24:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.326+0000 7f4349f23000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f737bb620 con 0x557f7393e2f0 2023-10-06T02:24:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.326+0000 7f4349f23000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f737b2400 con 0x557f7389c710 2023-10-06T02:24:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.326+0000 7f434395f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557f7393e6c0 0x557f73941330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.326+0000 7f434395f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557f7393e6c0 0x557f73941330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59244/0 (socket says 172.21.15.6:59244) 2023-10-06T02:24:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.326+0000 7f434395f700 1 -- 172.21.15.6:0/3798198198 learned_addr learned my addr 172.21.15.6:0/3798198198 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.326+0000 7f434315e700 1 --2- 172.21.15.6:0/3798198198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557f7389c710 0x557f73943f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f434295d700 1 --2- 172.21.15.6:0/3798198198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f7393e2f0 0x557f73938280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f434395f700 1 -- 172.21.15.6:0/3798198198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557f7389c710 msgr2=0x557f73943f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f434395f700 1 --2- 172.21.15.6:0/3798198198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557f7389c710 0x557f73943f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f434395f700 1 -- 172.21.15.6:0/3798198198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f7393e2f0 msgr2=0x557f73938280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f434395f700 1 --2- 172.21.15.6:0/3798198198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f7393e2f0 0x557f73938280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f434395f700 1 -- 172.21.15.6:0/3798198198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433400a0e0 con 0x557f7393e6c0 2023-10-06T02:24:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f434315e700 1 --2- 172.21.15.6:0/3798198198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557f7389c710 0x557f73943f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f434395f700 1 --2- 172.21.15.6:0/3798198198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557f7393e6c0 0x557f73941330 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x557f739444b0 tx=0x7f4334015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd4d0d6266398c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f434195b700 1 -- 172.21.15.6:0/3798198198 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433400fe00 con 0x557f7393e6c0 2023-10-06T02:24:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f434195b700 1 -- 172.21.15.6:0/3798198198 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433401f070 con 0x557f7393e6c0 2023-10-06T02:24:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f434195b700 1 -- 172.21.15.6:0/3798198198 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433400f860 con 0x557f7393e6c0 2023-10-06T02:24:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f4349f23000 1 -- 172.21.15.6:0/3798198198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557f7393e6c0 msgr2=0x557f73941330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f4349f23000 1 --2- 172.21.15.6:0/3798198198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557f7393e6c0 0x557f73941330 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x557f739444b0 tx=0x7f4334015000 comp rx=0 tx=0).stop 2023-10-06T02:24:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f4349f23000 1 -- 172.21.15.6:0/3798198198 shutdown_connections 2023-10-06T02:24:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f4349f23000 1 --2- 172.21.15.6:0/3798198198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557f7393e6c0 0x557f73941330 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f4349f23000 1 --2- 172.21.15.6:0/3798198198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557f7389c710 0x557f73943f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f4349f23000 1 --2- 172.21.15.6:0/3798198198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f7393e2f0 0x557f73938280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.327+0000 7f4349f23000 1 -- 172.21.15.6:0/3798198198 >> 172.21.15.6:0/3798198198 conn(0x557f738715d0 msgr2=0x557f7393bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.328+0000 7f4349f23000 1 -- 172.21.15.6:0/3798198198 shutdown_connections 2023-10-06T02:24:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.328+0000 7f4349f23000 1 -- 172.21.15.6:0/3798198198 wait complete. 2023-10-06T02:24:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.328+0000 7f4349f23000 1 Processor -- start 2023-10-06T02:24:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.328+0000 7f4349f23000 1 -- start start 2023-10-06T02:24:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.329+0000 7f4349f23000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f7389c710 0x557f738b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.329+0000 7f4349f23000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557f7393e2f0 0x557f738719a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.329+0000 7f4349f23000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557f7393e6c0 0x557f73871ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.329+0000 7f4349f23000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f7393b270 con 0x557f7393e6c0 2023-10-06T02:24:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.329+0000 7f4349f23000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f7393b510 con 0x557f7389c710 2023-10-06T02:24:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.329+0000 7f4349f23000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f7393b7b0 con 0x557f7393e2f0 2023-10-06T02:24:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.329+0000 7f434395f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557f7393e6c0 0x557f73871ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.329+0000 7f434395f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557f7393e6c0 0x557f73871ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59258/0 (socket says 172.21.15.6:59258) 2023-10-06T02:24:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.329+0000 7f434395f700 1 -- 172.21.15.6:0/2395608275 learned_addr learned my addr 172.21.15.6:0/2395608275 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.329+0000 7f434315e700 1 --2- 172.21.15.6:0/2395608275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f7389c710 0x557f738b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.329+0000 7f434295d700 1 --2- 172.21.15.6:0/2395608275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557f7393e2f0 0x557f738719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.329+0000 7f434395f700 1 -- 172.21.15.6:0/2395608275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557f7393e2f0 msgr2=0x557f738719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.329+0000 7f434395f700 1 --2- 172.21.15.6:0/2395608275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557f7393e2f0 0x557f738719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.329+0000 7f434395f700 1 -- 172.21.15.6:0/2395608275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f7389c710 msgr2=0x557f738b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.329+0000 7f434395f700 1 --2- 172.21.15.6:0/2395608275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f7389c710 0x557f738b6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.329+0000 7f434395f700 1 -- 172.21.15.6:0/2395608275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f737e41c0 con 0x557f7393e6c0 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.329+0000 7f434395f700 1 --2- 172.21.15.6:0/2395608275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557f7393e6c0 0x557f73871ee0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f4334021000 tx=0x7f433401d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.330+0000 7f433bfff700 1 -- 172.21.15.6:0/2395608275 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334030070 con 0x557f7393e6c0 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.330+0000 7f433bfff700 1 -- 172.21.15.6:0/2395608275 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4334005020 con 0x557f7393e6c0 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.330+0000 7f433bfff700 1 -- 172.21.15.6:0/2395608275 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334005420 con 0x557f7393e6c0 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.330+0000 7f4349f23000 1 -- 172.21.15.6:0/2395608275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557f737ca3d0 con 0x557f7393e6c0 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.330+0000 7f4349f23000 1 -- 172.21.15.6:0/2395608275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f737bdae0 con 0x557f7393e6c0 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.331+0000 7f433bfff700 1 -- 172.21.15.6:0/2395608275 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4334003040 con 0x557f7393e6c0 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.331+0000 7f433bfff700 1 --2- 172.21.15.6:0/2395608275 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4324065890 0x7f4324067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.332+0000 7f433bfff700 1 -- 172.21.15.6:0/2395608275 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f43340865b0 con 0x557f7393e6c0 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.332+0000 7f4349f23000 1 --2- 172.21.15.6:0/2395608275 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x557f73938280 0x557f73956320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.332+0000 7f4349f23000 1 -- 172.21.15.6:0/2395608275 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x557f7393a040 con 0x557f73938280 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.332+0000 7f434315e700 1 --2- 172.21.15.6:0/2395608275 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4324065890 0x7f4324067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.332+0000 7f434295d700 1 --2- 172.21.15.6:0/2395608275 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x557f73938280 0x557f73956320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.332+0000 7f434295d700 1 --2- 172.21.15.6:0/2395608275 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x557f73938280 0x557f73956320 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.332+0000 7f434315e700 1 --2- 172.21.15.6:0/2395608275 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4324065890 0x7f4324067d40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f433c009c20 tx=0x7f433c00c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.332+0000 7f434295d700 1 -- 172.21.15.6:0/2395608275 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-keys out=5b] v0'0 uv3 ondisk = 0) v8 ==== 159+0+5 (crc 0 0 0) 0x7f432c0107f0 con 0x557f73938280 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.333+0000 7f4349f23000 1 -- 172.21.15.6:0/2395608275 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x557f73938280 msgr2=0x557f73956320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.333+0000 7f4349f23000 1 --2- 172.21.15.6:0/2395608275 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x557f73938280 0x557f73956320 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.333+0000 7f4349f23000 1 -- 172.21.15.6:0/2395608275 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4324065890 msgr2=0x7f4324067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.333+0000 7f4349f23000 1 --2- 172.21.15.6:0/2395608275 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4324065890 0x7f4324067d40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f433c009c20 tx=0x7f433c00c040 comp rx=0 tx=0).stop 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.333+0000 7f4349f23000 1 -- 172.21.15.6:0/2395608275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557f7393e6c0 msgr2=0x557f73871ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.333+0000 7f4349f23000 1 --2- 172.21.15.6:0/2395608275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557f7393e6c0 0x557f73871ee0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f4334021000 tx=0x7f433401d070 comp rx=0 tx=0).stop 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.333+0000 7f434395f700 1 -- 172.21.15.6:0/2395608275 reap_dead start 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.333+0000 7f4349f23000 1 -- 172.21.15.6:0/2395608275 shutdown_connections 2023-10-06T02:24:57.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.333+0000 7f4349f23000 1 -- 172.21.15.6:0/2395608275 >> 172.21.15.6:0/2395608275 conn(0x557f738715d0 msgr2=0x557f73941420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.333+0000 7f4349f23000 1 -- 172.21.15.6:0/2395608275 shutdown_connections 2023-10-06T02:24:57.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.333+0000 7f4349f23000 1 -- 172.21.15.6:0/2395608275 wait complete. 2023-10-06T02:24:57.344 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 400.00000000 2023-10-06T02:24:57.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.413+0000 7fd604ce4000 1 Processor -- start 2023-10-06T02:24:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.413+0000 7fd604ce4000 1 -- start start 2023-10-06T02:24:57.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd604ce4000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dce847cc0 0x558dce872440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd604ce4000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558dce88d130 0x558dce917d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd604ce4000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558dce902cc0 0x558dce9182b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd604ce4000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dce78f980 con 0x558dce847cc0 2023-10-06T02:24:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd604ce4000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dce78f620 con 0x558dce902cc0 2023-10-06T02:24:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd604ce4000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x558dce786400 con 0x558dce88d130 2023-10-06T02:24:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd5fdf1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dce847cc0 0x558dce872440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd5fdf1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dce847cc0 0x558dce872440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59282/0 (socket says 172.21.15.6:59282) 2023-10-06T02:24:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd5fdf1f700 1 -- 172.21.15.6:0/786744103 learned_addr learned my addr 172.21.15.6:0/786744103 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd5fdf1f700 1 -- 172.21.15.6:0/786744103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558dce88d130 msgr2=0x558dce917d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd5fd71e700 1 --2- 172.21.15.6:0/786744103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558dce88d130 0x558dce917d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd5fe720700 1 --2- 172.21.15.6:0/786744103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558dce902cc0 0x558dce9182b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd5fdf1f700 1 --2- 172.21.15.6:0/786744103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558dce88d130 0x558dce917d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd5fdf1f700 1 -- 172.21.15.6:0/786744103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558dce902cc0 msgr2=0x558dce9182b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd5fdf1f700 1 --2- 172.21.15.6:0/786744103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558dce902cc0 0x558dce9182b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd5fdf1f700 1 -- 172.21.15.6:0/786744103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e8005cf0 con 0x558dce847cc0 2023-10-06T02:24:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd5fd71e700 1 --2- 172.21.15.6:0/786744103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558dce88d130 0x558dce917d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd5fe720700 1 --2- 172.21.15.6:0/786744103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558dce902cc0 0x558dce9182b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.414+0000 7fd5fdf1f700 1 --2- 172.21.15.6:0/786744103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dce847cc0 0x558dce872440 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800ada0 tx=0x7fd5e8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa32413e0a17b8b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.415+0000 7fd5f7fff700 1 -- 172.21.15.6:0/786744103 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8000d10 con 0x558dce847cc0 2023-10-06T02:24:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.415+0000 7fd5f7fff700 1 -- 172.21.15.6:0/786744103 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e8008970 con 0x558dce847cc0 2023-10-06T02:24:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.415+0000 7fd5f7fff700 1 -- 172.21.15.6:0/786744103 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e801c440 con 0x558dce847cc0 2023-10-06T02:24:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.415+0000 7fd604ce4000 1 -- 172.21.15.6:0/786744103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dce847cc0 msgr2=0x558dce872440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.415+0000 7fd604ce4000 1 --2- 172.21.15.6:0/786744103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dce847cc0 0x558dce872440 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800ada0 tx=0x7fd5e8013000 comp rx=0 tx=0).stop 2023-10-06T02:24:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.415+0000 7fd604ce4000 1 -- 172.21.15.6:0/786744103 shutdown_connections 2023-10-06T02:24:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.415+0000 7fd604ce4000 1 --2- 172.21.15.6:0/786744103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558dce902cc0 0x558dce9182b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.415+0000 7fd604ce4000 1 --2- 172.21.15.6:0/786744103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dce847cc0 0x558dce872440 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.415+0000 7fd604ce4000 1 --2- 172.21.15.6:0/786744103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558dce88d130 0x558dce917d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.415+0000 7fd604ce4000 1 -- 172.21.15.6:0/786744103 >> 172.21.15.6:0/786744103 conn(0x558dce8436c0 msgr2=0x558dce874770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.415+0000 7fd604ce4000 1 -- 172.21.15.6:0/786744103 shutdown_connections 2023-10-06T02:24:57.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.415+0000 7fd604ce4000 1 -- 172.21.15.6:0/786744103 wait complete. 2023-10-06T02:24:57.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.416+0000 7fd604ce4000 1 Processor -- start 2023-10-06T02:24:57.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.416+0000 7fd604ce4000 1 -- start start 2023-10-06T02:24:57.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.416+0000 7fd604ce4000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558dce847cc0 0x558dce8fd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.416+0000 7fd604ce4000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558dce88d130 0x558dce870eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.416+0000 7fd604ce4000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dce902cc0 0x558dce91a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.416+0000 7fd604ce4000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dce8fb220 con 0x558dce902cc0 2023-10-06T02:24:57.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.416+0000 7fd604ce4000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dce8fb4c0 con 0x558dce88d130 2023-10-06T02:24:57.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.416+0000 7fd604ce4000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x558dce8fb760 con 0x558dce847cc0 2023-10-06T02:24:57.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.416+0000 7fd5fe720700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dce902cc0 0x558dce91a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.416+0000 7fd5fe720700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dce902cc0 0x558dce91a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59298/0 (socket says 172.21.15.6:59298) 2023-10-06T02:24:57.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.416+0000 7fd5fe720700 1 -- 172.21.15.6:0/2381605947 learned_addr learned my addr 172.21.15.6:0/2381605947 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.417+0000 7fd5fdf1f700 1 --2- 172.21.15.6:0/2381605947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558dce847cc0 0x558dce8fd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.417+0000 7fd5fd71e700 1 --2- 172.21.15.6:0/2381605947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558dce88d130 0x558dce870eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.417+0000 7fd5fe720700 1 -- 172.21.15.6:0/2381605947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558dce847cc0 msgr2=0x558dce8fd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.417+0000 7fd5fe720700 1 --2- 172.21.15.6:0/2381605947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558dce847cc0 0x558dce8fd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.417+0000 7fd5fe720700 1 -- 172.21.15.6:0/2381605947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558dce88d130 msgr2=0x558dce870eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.417+0000 7fd5fe720700 1 --2- 172.21.15.6:0/2381605947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558dce88d130 0x558dce870eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.417+0000 7fd5fe720700 1 -- 172.21.15.6:0/2381605947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558dce7b81c0 con 0x558dce902cc0 2023-10-06T02:24:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.417+0000 7fd5fe720700 1 --2- 172.21.15.6:0/2381605947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dce902cc0 0x558dce91a160 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800c4b0 tx=0x7fd5f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.417+0000 7fd5f67fc700 1 -- 172.21.15.6:0/2381605947 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f800a070 con 0x558dce902cc0 2023-10-06T02:24:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.417+0000 7fd5f67fc700 1 -- 172.21.15.6:0/2381605947 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f80060d0 con 0x558dce902cc0 2023-10-06T02:24:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.417+0000 7fd604ce4000 1 -- 172.21.15.6:0/2381605947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558dce79e3d0 con 0x558dce902cc0 2023-10-06T02:24:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.417+0000 7fd5f67fc700 1 -- 172.21.15.6:0/2381605947 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f80044f0 con 0x558dce902cc0 2023-10-06T02:24:57.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.417+0000 7fd604ce4000 1 -- 172.21.15.6:0/2381605947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558dce791ae0 con 0x558dce902cc0 2023-10-06T02:24:57.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.419+0000 7fd5f67fc700 1 -- 172.21.15.6:0/2381605947 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd5f8004920 con 0x558dce902cc0 2023-10-06T02:24:57.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.419+0000 7fd5f67fc700 1 --2- 172.21.15.6:0/2381605947 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd5e0065890 0x7fd5e0067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.419+0000 7fd5f67fc700 1 -- 172.21.15.6:0/2381605947 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fd5f8082a30 con 0x558dce902cc0 2023-10-06T02:24:57.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.419+0000 7fd5fdf1f700 1 --2- 172.21.15.6:0/2381605947 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd5e0065890 0x7fd5e0067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.419+0000 7fd604ce4000 1 --2- 172.21.15.6:0/2381605947 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x558dce8713f0 0x558dce92d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.419+0000 7fd604ce4000 1 -- 172.21.15.6:0/2381605947 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x558dce8fbea0 con 0x558dce8713f0 2023-10-06T02:24:57.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.419+0000 7fd5fd71e700 1 --2- 172.21.15.6:0/2381605947 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x558dce8713f0 0x558dce92d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.420+0000 7fd5fdf1f700 1 --2- 172.21.15.6:0/2381605947 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd5e0065890 0x7fd5e0067d40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800ada0 tx=0x7fd5e801c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.420+0000 7fd5fd71e700 1 --2- 172.21.15.6:0/2381605947 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x558dce8713f0 0x558dce92d070 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.420+0000 7fd5fd71e700 1 -- 172.21.15.6:0/2381605947 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(1 400.00000000 [omap-get-keys out=5b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x7fd5f0013040 con 0x558dce8713f0 2023-10-06T02:24:57.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.420+0000 7fd604ce4000 1 -- 172.21.15.6:0/2381605947 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x558dce8713f0 msgr2=0x558dce92d070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.420+0000 7fd604ce4000 1 --2- 172.21.15.6:0/2381605947 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x558dce8713f0 0x558dce92d070 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.420+0000 7fd604ce4000 1 -- 172.21.15.6:0/2381605947 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd5e0065890 msgr2=0x7fd5e0067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.420+0000 7fd604ce4000 1 --2- 172.21.15.6:0/2381605947 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd5e0065890 0x7fd5e0067d40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800ada0 tx=0x7fd5e801c000 comp rx=0 tx=0).stop 2023-10-06T02:24:57.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.420+0000 7fd604ce4000 1 -- 172.21.15.6:0/2381605947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dce902cc0 msgr2=0x558dce91a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.420+0000 7fd604ce4000 1 --2- 172.21.15.6:0/2381605947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dce902cc0 0x558dce91a160 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800c4b0 tx=0x7fd5f8008040 comp rx=0 tx=0).stop 2023-10-06T02:24:57.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.420+0000 7fd5fe720700 1 -- 172.21.15.6:0/2381605947 reap_dead start 2023-10-06T02:24:57.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.420+0000 7fd604ce4000 1 -- 172.21.15.6:0/2381605947 shutdown_connections 2023-10-06T02:24:57.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.420+0000 7fd604ce4000 1 -- 172.21.15.6:0/2381605947 >> 172.21.15.6:0/2381605947 conn(0x558dce8436c0 msgr2=0x558dce874770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.420+0000 7fd604ce4000 1 -- 172.21.15.6:0/2381605947 shutdown_connections 2023-10-06T02:24:57.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.420+0000 7fd604ce4000 1 -- 172.21.15.6:0/2381605947 wait complete. 2023-10-06T02:24:57.435 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 100.00000000.inode 2023-10-06T02:24:57.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.503+0000 7fcf58c6c000 1 Processor -- start 2023-10-06T02:24:57.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.503+0000 7fcf58c6c000 1 -- start start 2023-10-06T02:24:57.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.504+0000 7fcf58c6c000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbcd289680 0x55dbcd2a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.504+0000 7fcf58c6c000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55dbcd28bab0 0x55dbcd25a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.504+0000 7fcf58c6c000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbcd28be80 0x55dbcd32bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.504+0000 7fcf58c6c000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbcd1a7620 con 0x55dbcd289680 2023-10-06T02:24:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.504+0000 7fcf58c6c000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbcd19e400 con 0x55dbcd28be80 2023-10-06T02:24:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.504+0000 7fcf58c6c000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dbcd25b4e0 con 0x55dbcd28bab0 2023-10-06T02:24:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.504+0000 7fcf51ea7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbcd289680 0x55dbcd2a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.504+0000 7fcf51ea7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbcd289680 0x55dbcd2a58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59318/0 (socket says 172.21.15.6:59318) 2023-10-06T02:24:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.504+0000 7fcf51ea7700 1 -- 172.21.15.6:0/1859293748 learned_addr learned my addr 172.21.15.6:0/1859293748 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.504+0000 7fcf516a6700 1 --2- 172.21.15.6:0/1859293748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55dbcd28bab0 0x55dbcd25a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.504+0000 7fcf526a8700 1 --2- 172.21.15.6:0/1859293748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbcd28be80 0x55dbcd32bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.504+0000 7fcf51ea7700 1 -- 172.21.15.6:0/1859293748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55dbcd28bab0 msgr2=0x55dbcd25a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.504+0000 7fcf51ea7700 1 --2- 172.21.15.6:0/1859293748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55dbcd28bab0 0x55dbcd25a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.504+0000 7fcf51ea7700 1 -- 172.21.15.6:0/1859293748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbcd28be80 msgr2=0x55dbcd32bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.504+0000 7fcf51ea7700 1 --2- 172.21.15.6:0/1859293748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbcd28be80 0x55dbcd32bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.505+0000 7fcf51ea7700 1 -- 172.21.15.6:0/1859293748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf44005db0 con 0x55dbcd289680 2023-10-06T02:24:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.505+0000 7fcf51ea7700 1 --2- 172.21.15.6:0/1859293748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbcd289680 0x55dbcd2a58a0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fcf44005b50 tx=0x7fcf44016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0544432b744e3de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.505+0000 7fcf43fff700 1 -- 172.21.15.6:0/1859293748 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf44000c40 con 0x55dbcd289680 2023-10-06T02:24:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.505+0000 7fcf43fff700 1 -- 172.21.15.6:0/1859293748 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf44008a50 con 0x55dbcd289680 2023-10-06T02:24:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.505+0000 7fcf43fff700 1 -- 172.21.15.6:0/1859293748 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf44008e10 con 0x55dbcd289680 2023-10-06T02:24:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.505+0000 7fcf58c6c000 1 -- 172.21.15.6:0/1859293748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbcd289680 msgr2=0x55dbcd2a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.505+0000 7fcf58c6c000 1 --2- 172.21.15.6:0/1859293748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbcd289680 0x55dbcd2a58a0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fcf44005b50 tx=0x7fcf44016000 comp rx=0 tx=0).stop 2023-10-06T02:24:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.505+0000 7fcf58c6c000 1 -- 172.21.15.6:0/1859293748 shutdown_connections 2023-10-06T02:24:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.505+0000 7fcf58c6c000 1 --2- 172.21.15.6:0/1859293748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbcd28be80 0x55dbcd32bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.505+0000 7fcf58c6c000 1 --2- 172.21.15.6:0/1859293748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbcd289680 0x55dbcd2a58a0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.505+0000 7fcf58c6c000 1 --2- 172.21.15.6:0/1859293748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55dbcd28bab0 0x55dbcd25a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.505+0000 7fcf58c6c000 1 -- 172.21.15.6:0/1859293748 >> 172.21.15.6:0/1859293748 conn(0x55dbcd2a3bd0 msgr2=0x55dbcd333cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.505+0000 7fcf58c6c000 1 -- 172.21.15.6:0/1859293748 shutdown_connections 2023-10-06T02:24:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.505+0000 7fcf58c6c000 1 -- 172.21.15.6:0/1859293748 wait complete. 2023-10-06T02:24:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.506+0000 7fcf58c6c000 1 Processor -- start 2023-10-06T02:24:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.506+0000 7fcf58c6c000 1 -- start start 2023-10-06T02:24:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf58c6c000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55dbcd289680 0x55dbcd328040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf58c6c000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbcd28bab0 0x55dbcd2a6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf58c6c000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbcd28be80 0x55dbcd2a65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf58c6c000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbcd3397f0 con 0x55dbcd28be80 2023-10-06T02:24:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf58c6c000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbcd339a90 con 0x55dbcd28bab0 2023-10-06T02:24:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf58c6c000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dbcd339d30 con 0x55dbcd289680 2023-10-06T02:24:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf526a8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbcd28be80 0x55dbcd2a65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf526a8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbcd28be80 0x55dbcd2a65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59330/0 (socket says 172.21.15.6:59330) 2023-10-06T02:24:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf526a8700 1 -- 172.21.15.6:0/1997819653 learned_addr learned my addr 172.21.15.6:0/1997819653 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf51ea7700 1 --2- 172.21.15.6:0/1997819653 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55dbcd289680 0x55dbcd328040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf516a6700 1 --2- 172.21.15.6:0/1997819653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbcd28bab0 0x55dbcd2a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf526a8700 1 -- 172.21.15.6:0/1997819653 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55dbcd289680 msgr2=0x55dbcd328040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf526a8700 1 --2- 172.21.15.6:0/1997819653 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55dbcd289680 0x55dbcd328040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf526a8700 1 -- 172.21.15.6:0/1997819653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbcd28bab0 msgr2=0x55dbcd2a6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf526a8700 1 --2- 172.21.15.6:0/1997819653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbcd28bab0 0x55dbcd2a6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf526a8700 1 -- 172.21.15.6:0/1997819653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbcd1a9750 con 0x55dbcd28be80 2023-10-06T02:24:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf526a8700 1 --2- 172.21.15.6:0/1997819653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbcd28be80 0x55dbcd2a65a0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00d580 tx=0x7fcf4c007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf427fc700 1 -- 172.21.15.6:0/1997819653 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00de50 con 0x55dbcd28be80 2023-10-06T02:24:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf427fc700 1 -- 172.21.15.6:0/1997819653 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c00b050 con 0x55dbcd28be80 2023-10-06T02:24:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf58c6c000 1 -- 172.21.15.6:0/1997819653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dbcd1d01c0 con 0x55dbcd28be80 2023-10-06T02:24:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.507+0000 7fcf427fc700 1 -- 172.21.15.6:0/1997819653 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c0128b0 con 0x55dbcd28be80 2023-10-06T02:24:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.508+0000 7fcf58c6c000 1 -- 172.21.15.6:0/1997819653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dbcd1b63d0 con 0x55dbcd28be80 2023-10-06T02:24:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.509+0000 7fcf427fc700 1 -- 172.21.15.6:0/1997819653 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf4c012c20 con 0x55dbcd28be80 2023-10-06T02:24:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.509+0000 7fcf427fc700 1 --2- 172.21.15.6:0/1997819653 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf34065910 0x7fcf34067dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.509+0000 7fcf427fc700 1 -- 172.21.15.6:0/1997819653 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fcf4c083950 con 0x55dbcd28be80 2023-10-06T02:24:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.509+0000 7fcf51ea7700 1 --2- 172.21.15.6:0/1997819653 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf34065910 0x7fcf34067dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.509+0000 7fcf58c6c000 1 --2- 172.21.15.6:0/1997819653 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55dbcd333130 0x55dbcd32c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.509+0000 7fcf58c6c000 1 -- 172.21.15.6:0/1997819653 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55dbcd25b760 con 0x55dbcd333130 2023-10-06T02:24:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.510+0000 7fcf516a6700 1 --2- 172.21.15.6:0/1997819653 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55dbcd333130 0x55dbcd32c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.510+0000 7fcf51ea7700 1 --2- 172.21.15.6:0/1997819653 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf34065910 0x7fcf34067dc0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcf44020000 tx=0x7fcf4401c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.510+0000 7fcf516a6700 1 --2- 172.21.15.6:0/1997819653 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55dbcd333130 0x55dbcd32c2d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.510+0000 7fcf516a6700 1 -- 172.21.15.6:0/1997819653 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 100.00000000.inode [omap-get-keys out=5b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+5 (crc 0 0 0) 0x7fcf48007920 con 0x55dbcd333130 2023-10-06T02:24:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.510+0000 7fcf58c6c000 1 -- 172.21.15.6:0/1997819653 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55dbcd333130 msgr2=0x55dbcd32c2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.510+0000 7fcf58c6c000 1 --2- 172.21.15.6:0/1997819653 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55dbcd333130 0x55dbcd32c2d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.510+0000 7fcf58c6c000 1 -- 172.21.15.6:0/1997819653 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf34065910 msgr2=0x7fcf34067dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.510+0000 7fcf58c6c000 1 --2- 172.21.15.6:0/1997819653 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf34065910 0x7fcf34067dc0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcf44020000 tx=0x7fcf4401c000 comp rx=0 tx=0).stop 2023-10-06T02:24:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.510+0000 7fcf58c6c000 1 -- 172.21.15.6:0/1997819653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbcd28be80 msgr2=0x55dbcd2a65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.510+0000 7fcf58c6c000 1 --2- 172.21.15.6:0/1997819653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbcd28be80 0x55dbcd2a65a0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00d580 tx=0x7fcf4c007040 comp rx=0 tx=0).stop 2023-10-06T02:24:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.510+0000 7fcf526a8700 1 -- 172.21.15.6:0/1997819653 reap_dead start 2023-10-06T02:24:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.510+0000 7fcf58c6c000 1 -- 172.21.15.6:0/1997819653 shutdown_connections 2023-10-06T02:24:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.510+0000 7fcf58c6c000 1 -- 172.21.15.6:0/1997819653 >> 172.21.15.6:0/1997819653 conn(0x55dbcd2a3bd0 msgr2=0x55dbcd25a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.511+0000 7fcf58c6c000 1 -- 172.21.15.6:0/1997819653 shutdown_connections 2023-10-06T02:24:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.511+0000 7fcf58c6c000 1 -- 172.21.15.6:0/1997819653 wait complete. 2023-10-06T02:24:57.518 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2023-10-06T02:24:57.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.590+0000 7f6bb8536000 1 Processor -- start 2023-10-06T02:24:57.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.591+0000 7f6bb8536000 1 -- start start 2023-10-06T02:24:57.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.591+0000 7f6bb8536000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ef38ead60 0x560ef38ebeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.591+0000 7f6bb8536000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ef3906410 0x560ef399af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.591+0000 7f6bb8536000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ef3995f90 0x560ef38c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.591+0000 7f6bb8536000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ef380a980 con 0x560ef3906410 2023-10-06T02:24:57.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.591+0000 7f6bb8536000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ef380a620 con 0x560ef38ead60 2023-10-06T02:24:57.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.591+0000 7f6bb8536000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560ef3801400 con 0x560ef3995f90 2023-10-06T02:24:57.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.591+0000 7f6bb0f70700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ef3906410 0x560ef399af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.591+0000 7f6bb0f70700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ef3906410 0x560ef399af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59344/0 (socket says 172.21.15.6:59344) 2023-10-06T02:24:57.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.591+0000 7f6bb0f70700 1 -- 172.21.15.6:0/14558179 learned_addr learned my addr 172.21.15.6:0/14558179 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.591+0000 7f6bb1f72700 1 --2- 172.21.15.6:0/14558179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ef3995f90 0x560ef38c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.591+0000 7f6bb1771700 1 --2- 172.21.15.6:0/14558179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ef38ead60 0x560ef38ebeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6bb0f70700 1 -- 172.21.15.6:0/14558179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ef3995f90 msgr2=0x560ef38c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6bb0f70700 1 --2- 172.21.15.6:0/14558179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ef3995f90 0x560ef38c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6bb0f70700 1 -- 172.21.15.6:0/14558179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ef38ead60 msgr2=0x560ef38ebeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6bb0f70700 1 --2- 172.21.15.6:0/14558179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ef38ead60 0x560ef38ebeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6bb0f70700 1 -- 172.21.15.6:0/14558179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba8005cf0 con 0x560ef3906410 2023-10-06T02:24:57.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6bb1f72700 1 --2- 172.21.15.6:0/14558179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ef3995f90 0x560ef38c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:57.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6bb0f70700 1 --2- 172.21.15.6:0/14558179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ef3906410 0x560ef399af00 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800ac40 tx=0x7f6ba8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8852a22e30e2c2ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6ba37fe700 1 -- 172.21.15.6:0/14558179 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba801a070 con 0x560ef3906410 2023-10-06T02:24:57.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6ba37fe700 1 -- 172.21.15.6:0/14558179 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba8000bc0 con 0x560ef3906410 2023-10-06T02:24:57.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6ba37fe700 1 -- 172.21.15.6:0/14558179 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8013c80 con 0x560ef3906410 2023-10-06T02:24:57.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6bb8536000 1 -- 172.21.15.6:0/14558179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ef3906410 msgr2=0x560ef399af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6bb8536000 1 --2- 172.21.15.6:0/14558179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ef3906410 0x560ef399af00 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800ac40 tx=0x7f6ba8013000 comp rx=0 tx=0).stop 2023-10-06T02:24:57.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6bb8536000 1 -- 172.21.15.6:0/14558179 shutdown_connections 2023-10-06T02:24:57.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6bb8536000 1 --2- 172.21.15.6:0/14558179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ef3995f90 0x560ef38c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6bb8536000 1 --2- 172.21.15.6:0/14558179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ef38ead60 0x560ef38ebeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6bb8536000 1 --2- 172.21.15.6:0/14558179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ef3906410 0x560ef399af00 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6bb8536000 1 -- 172.21.15.6:0/14558179 >> 172.21.15.6:0/14558179 conn(0x560ef38bfd50 msgr2=0x560ef38c0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6bb8536000 1 -- 172.21.15.6:0/14558179 shutdown_connections 2023-10-06T02:24:57.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.592+0000 7f6bb8536000 1 -- 172.21.15.6:0/14558179 wait complete. 2023-10-06T02:24:57.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.593+0000 7f6bb8536000 1 Processor -- start 2023-10-06T02:24:57.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.593+0000 7f6bb8536000 1 -- start start 2023-10-06T02:24:57.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6bb8536000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ef38ead60 0x560ef3903f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6bb8536000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ef3906410 0x560ef38eda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6bb8536000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ef3995f90 0x560ef3990010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6bb8536000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ef3904900 con 0x560ef38ead60 2023-10-06T02:24:57.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6bb8536000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ef3904ba0 con 0x560ef3995f90 2023-10-06T02:24:57.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6bb8536000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560ef3904e40 con 0x560ef3906410 2023-10-06T02:24:57.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6bb1771700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ef38ead60 0x560ef3903f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6bb1771700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ef38ead60 0x560ef3903f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59356/0 (socket says 172.21.15.6:59356) 2023-10-06T02:24:57.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6bb1771700 1 -- 172.21.15.6:0/2174706710 learned_addr learned my addr 172.21.15.6:0/2174706710 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6bb0f70700 1 --2- 172.21.15.6:0/2174706710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ef3906410 0x560ef38eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6bb1f72700 1 --2- 172.21.15.6:0/2174706710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ef3995f90 0x560ef3990010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6bb1771700 1 -- 172.21.15.6:0/2174706710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ef3906410 msgr2=0x560ef38eda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6bb1771700 1 --2- 172.21.15.6:0/2174706710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ef3906410 0x560ef38eda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6bb1771700 1 -- 172.21.15.6:0/2174706710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ef3995f90 msgr2=0x560ef3990010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6bb1771700 1 --2- 172.21.15.6:0/2174706710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ef3995f90 0x560ef3990010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6bb1771700 1 -- 172.21.15.6:0/2174706710 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ef38331c0 con 0x560ef38ead60 2023-10-06T02:24:57.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6bb1771700 1 --2- 172.21.15.6:0/2174706710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ef38ead60 0x560ef3903f10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00b390 tx=0x7f6bac001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.594+0000 7f6ba1ffb700 1 -- 172.21.15.6:0/2174706710 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac010410 con 0x560ef38ead60 2023-10-06T02:24:57.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.595+0000 7f6ba1ffb700 1 -- 172.21.15.6:0/2174706710 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac010570 con 0x560ef38ead60 2023-10-06T02:24:57.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.595+0000 7f6ba1ffb700 1 -- 172.21.15.6:0/2174706710 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac010910 con 0x560ef38ead60 2023-10-06T02:24:57.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.595+0000 7f6bb8536000 1 -- 172.21.15.6:0/2174706710 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560ef38193d0 con 0x560ef38ead60 2023-10-06T02:24:57.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.595+0000 7f6bb8536000 1 -- 172.21.15.6:0/2174706710 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ef380cae0 con 0x560ef38ead60 2023-10-06T02:24:57.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.596+0000 7f6ba1ffb700 1 -- 172.21.15.6:0/2174706710 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6bac010cc0 con 0x560ef38ead60 2023-10-06T02:24:57.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.596+0000 7f6ba1ffb700 1 --2- 172.21.15.6:0/2174706710 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6b94065890 0x7f6b94067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.596+0000 7f6ba1ffb700 1 -- 172.21.15.6:0/2174706710 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f6bac00a040 con 0x560ef38ead60 2023-10-06T02:24:57.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.596+0000 7f6bb0f70700 1 --2- 172.21.15.6:0/2174706710 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6b94065890 0x7f6b94067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.597+0000 7f6bb8536000 1 --2- 172.21.15.6:0/2174706710 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x560ef3904450 0x560ef399b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.597+0000 7f6bb8536000 1 -- 172.21.15.6:0/2174706710 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.1f 14:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x560ef38edf60 con 0x560ef3904450 2023-10-06T02:24:57.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.597+0000 7f6bb1f72700 1 --2- 172.21.15.6:0/2174706710 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x560ef3904450 0x560ef399b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.597+0000 7f6bb0f70700 1 --2- 172.21.15.6:0/2174706710 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6b94065890 0x7f6b94067d40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8020040 tx=0x7f6ba8017050 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.597+0000 7f6bb1f72700 1 --2- 172.21.15.6:0/2174706710 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x560ef3904450 0x560ef399b4f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.597+0000 7f6bb1f72700 1 -- 172.21.15.6:0/2174706710 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=20b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+20 (crc 0 0 0) 0x7f6ba4002ce0 con 0x560ef3904450 2023-10-06T02:24:57.603 INFO:teuthology.orchestra.run.smithi006.stdout:subdir_head 2023-10-06T02:24:57.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.597+0000 7f6bb8536000 1 -- 172.21.15.6:0/2174706710 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x560ef3904450 msgr2=0x560ef399b4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.597+0000 7f6bb8536000 1 --2- 172.21.15.6:0/2174706710 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x560ef3904450 0x560ef399b4f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.597+0000 7f6bb8536000 1 -- 172.21.15.6:0/2174706710 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6b94065890 msgr2=0x7f6b94067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.597+0000 7f6bb8536000 1 --2- 172.21.15.6:0/2174706710 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6b94065890 0x7f6b94067d40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8020040 tx=0x7f6ba8017050 comp rx=0 tx=0).stop 2023-10-06T02:24:57.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.597+0000 7f6bb8536000 1 -- 172.21.15.6:0/2174706710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ef38ead60 msgr2=0x560ef3903f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.597+0000 7f6bb8536000 1 --2- 172.21.15.6:0/2174706710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ef38ead60 0x560ef3903f10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00b390 tx=0x7f6bac001a30 comp rx=0 tx=0).stop 2023-10-06T02:24:57.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.597+0000 7f6bb1f72700 1 -- 172.21.15.6:0/2174706710 reap_dead start 2023-10-06T02:24:57.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.597+0000 7f6bb8536000 1 -- 172.21.15.6:0/2174706710 shutdown_connections 2023-10-06T02:24:57.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.597+0000 7f6bb8536000 1 -- 172.21.15.6:0/2174706710 >> 172.21.15.6:0/2174706710 conn(0x560ef38bfd50 msgr2=0x560ef38c06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.597+0000 7f6bb8536000 1 -- 172.21.15.6:0/2174706710 shutdown_connections 2023-10-06T02:24:57.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.598+0000 7f6bb8536000 1 -- 172.21.15.6:0/2174706710 wait complete. 2023-10-06T02:24:57.606 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 10000000000.00000000 2023-10-06T02:24:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.682+0000 7f9c45560000 1 Processor -- start 2023-10-06T02:24:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.682+0000 7f9c45560000 1 -- start start 2023-10-06T02:24:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.682+0000 7f9c45560000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55996597fcc0 0x559965a38540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.682+0000 7f9c45560000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599659c5130 0x5599659ac770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.682+0000 7f9c45560000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559965a3acc0 0x5599659accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.682+0000 7f9c45560000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599658c7980 con 0x5599659c5130 2023-10-06T02:24:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.682+0000 7f9c45560000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599658c7620 con 0x559965a3acc0 2023-10-06T02:24:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.682+0000 7f9c45560000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599658be400 con 0x55996597fcc0 2023-10-06T02:24:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.682+0000 7f9c3df9a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599659c5130 0x5599659ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.682+0000 7f9c3df9a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599659c5130 0x5599659ac770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59376/0 (socket says 172.21.15.6:59376) 2023-10-06T02:24:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.682+0000 7f9c3df9a700 1 -- 172.21.15.6:0/997134260 learned_addr learned my addr 172.21.15.6:0/997134260 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.683+0000 7f9c3e79b700 1 --2- 172.21.15.6:0/997134260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55996597fcc0 0x559965a38540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.683+0000 7f9c3ef9c700 1 --2- 172.21.15.6:0/997134260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559965a3acc0 0x5599659accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.683+0000 7f9c3df9a700 1 -- 172.21.15.6:0/997134260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55996597fcc0 msgr2=0x559965a38540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.683+0000 7f9c3df9a700 1 --2- 172.21.15.6:0/997134260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55996597fcc0 0x559965a38540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.683+0000 7f9c3df9a700 1 -- 172.21.15.6:0/997134260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559965a3acc0 msgr2=0x5599659accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.683+0000 7f9c3df9a700 1 --2- 172.21.15.6:0/997134260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559965a3acc0 0x5599659accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.683+0000 7f9c3df9a700 1 -- 172.21.15.6:0/997134260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c30005db0 con 0x5599659c5130 2023-10-06T02:24:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.683+0000 7f9c3df9a700 1 --2- 172.21.15.6:0/997134260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599659c5130 0x5599659ac770 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400a840 tx=0x7f9c34005d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926b3472aed62254 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.683+0000 7f9c3cf98700 1 -- 172.21.15.6:0/997134260 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3400f070 con 0x5599659c5130 2023-10-06T02:24:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.683+0000 7f9c3cf98700 1 -- 172.21.15.6:0/997134260 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c340085f0 con 0x5599659c5130 2023-10-06T02:24:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.683+0000 7f9c3cf98700 1 -- 172.21.15.6:0/997134260 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34008990 con 0x5599659c5130 2023-10-06T02:24:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.684+0000 7f9c45560000 1 -- 172.21.15.6:0/997134260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599659c5130 msgr2=0x5599659ac770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.684+0000 7f9c45560000 1 --2- 172.21.15.6:0/997134260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599659c5130 0x5599659ac770 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400a840 tx=0x7f9c34005d00 comp rx=0 tx=0).stop 2023-10-06T02:24:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.684+0000 7f9c45560000 1 -- 172.21.15.6:0/997134260 shutdown_connections 2023-10-06T02:24:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.684+0000 7f9c45560000 1 --2- 172.21.15.6:0/997134260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559965a3acc0 0x5599659accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.684+0000 7f9c45560000 1 --2- 172.21.15.6:0/997134260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55996597fcc0 0x559965a38540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.684+0000 7f9c45560000 1 --2- 172.21.15.6:0/997134260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599659c5130 0x5599659ac770 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.684+0000 7f9c45560000 1 -- 172.21.15.6:0/997134260 >> 172.21.15.6:0/997134260 conn(0x55996597b6c0 msgr2=0x5599659a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.684+0000 7f9c45560000 1 -- 172.21.15.6:0/997134260 shutdown_connections 2023-10-06T02:24:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.684+0000 7f9c45560000 1 -- 172.21.15.6:0/997134260 wait complete. 2023-10-06T02:24:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.684+0000 7f9c45560000 1 Processor -- start 2023-10-06T02:24:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.684+0000 7f9c45560000 1 -- start start 2023-10-06T02:24:57.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.685+0000 7f9c45560000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55996597fcc0 0x5599659c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.685+0000 7f9c45560000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5599659c5130 0x559965a54130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.685+0000 7f9c45560000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559965a3acc0 0x5599659c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.685+0000 7f9c45560000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559965a388f0 con 0x559965a3acc0 2023-10-06T02:24:57.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.685+0000 7f9c45560000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559965a66e90 con 0x55996597fcc0 2023-10-06T02:24:57.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.685+0000 7f9c45560000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x559965a67d70 con 0x5599659c5130 2023-10-06T02:24:57.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.685+0000 7f9c3ef9c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559965a3acc0 0x5599659c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.685+0000 7f9c3ef9c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559965a3acc0 0x5599659c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59380/0 (socket says 172.21.15.6:59380) 2023-10-06T02:24:57.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.685+0000 7f9c3ef9c700 1 -- 172.21.15.6:0/2717370201 learned_addr learned my addr 172.21.15.6:0/2717370201 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.685+0000 7f9c3df9a700 1 --2- 172.21.15.6:0/2717370201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5599659c5130 0x559965a54130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.685+0000 7f9c3e79b700 1 --2- 172.21.15.6:0/2717370201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55996597fcc0 0x5599659c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.686+0000 7f9c3ef9c700 1 -- 172.21.15.6:0/2717370201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5599659c5130 msgr2=0x559965a54130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.686+0000 7f9c3ef9c700 1 --2- 172.21.15.6:0/2717370201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5599659c5130 0x559965a54130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.686+0000 7f9c3ef9c700 1 -- 172.21.15.6:0/2717370201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55996597fcc0 msgr2=0x5599659c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.686+0000 7f9c3ef9c700 1 --2- 172.21.15.6:0/2717370201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55996597fcc0 0x5599659c43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.686+0000 7f9c3ef9c700 1 -- 172.21.15.6:0/2717370201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3400a440 con 0x559965a3acc0 2023-10-06T02:24:57.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.686+0000 7f9c3ef9c700 1 --2- 172.21.15.6:0/2717370201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559965a3acc0 0x5599659c7580 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f9c38004f10 tx=0x7f9c38006390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.686+0000 7f9c2effd700 1 -- 172.21.15.6:0/2717370201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38006780 con 0x559965a3acc0 2023-10-06T02:24:57.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.686+0000 7f9c2effd700 1 -- 172.21.15.6:0/2717370201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c38002010 con 0x559965a3acc0 2023-10-06T02:24:57.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.686+0000 7f9c45560000 1 -- 172.21.15.6:0/2717370201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5599658d63d0 con 0x559965a3acc0 2023-10-06T02:24:57.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.686+0000 7f9c2effd700 1 -- 172.21.15.6:0/2717370201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c380115d0 con 0x559965a3acc0 2023-10-06T02:24:57.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.686+0000 7f9c45560000 1 -- 172.21.15.6:0/2717370201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599658c9ae0 con 0x559965a3acc0 2023-10-06T02:24:57.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.687+0000 7f9c2effd700 1 -- 172.21.15.6:0/2717370201 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c38011980 con 0x559965a3acc0 2023-10-06T02:24:57.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.688+0000 7f9c2effd700 1 --2- 172.21.15.6:0/2717370201 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c20065890 0x7f9c20067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.688+0000 7f9c2effd700 1 -- 172.21.15.6:0/2717370201 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f9c38082930 con 0x559965a3acc0 2023-10-06T02:24:57.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.688+0000 7f9c3e79b700 1 --2- 172.21.15.6:0/2717370201 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c20065890 0x7f9c20067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.688+0000 7f9c45560000 1 --2- 172.21.15.6:0/2717370201 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5599659c1a50 0x5599659c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.688+0000 7f9c45560000 1 -- 172.21.15.6:0/2717370201 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:0cf6ad0f:::10000000000.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x5599659c2390 con 0x5599659c1a50 2023-10-06T02:24:57.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.688+0000 7f9c3df9a700 1 --2- 172.21.15.6:0/2717370201 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5599659c1a50 0x5599659c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.688+0000 7f9c3e79b700 1 --2- 172.21.15.6:0/2717370201 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c20065890 0x7f9c20067d40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000afd0 tx=0x7f9c30016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.688+0000 7f9c3df9a700 1 --2- 172.21.15.6:0/2717370201 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5599659c1a50 0x5599659c1e50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.689+0000 7f9c3df9a700 1 -- 172.21.15.6:0/2717370201 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 10000000000.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x7f9c34000bc0 con 0x5599659c1a50 2023-10-06T02:24:57.694 INFO:teuthology.orchestra.run.smithi006.stdout:cephfs_metadata/10000000000.00000000 mtime 2023-10-06T02:24:54.000000+0000, size 0 2023-10-06T02:24:57.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.689+0000 7f9c45560000 1 -- 172.21.15.6:0/2717370201 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5599659c1a50 msgr2=0x5599659c1e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.689+0000 7f9c45560000 1 --2- 172.21.15.6:0/2717370201 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5599659c1a50 0x5599659c1e50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.689+0000 7f9c45560000 1 -- 172.21.15.6:0/2717370201 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c20065890 msgr2=0x7f9c20067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.689+0000 7f9c45560000 1 --2- 172.21.15.6:0/2717370201 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c20065890 0x7f9c20067d40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000afd0 tx=0x7f9c30016000 comp rx=0 tx=0).stop 2023-10-06T02:24:57.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.689+0000 7f9c45560000 1 -- 172.21.15.6:0/2717370201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559965a3acc0 msgr2=0x5599659c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.689+0000 7f9c45560000 1 --2- 172.21.15.6:0/2717370201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559965a3acc0 0x5599659c7580 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f9c38004f10 tx=0x7f9c38006390 comp rx=0 tx=0).stop 2023-10-06T02:24:57.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.689+0000 7f9c3ef9c700 1 -- 172.21.15.6:0/2717370201 reap_dead start 2023-10-06T02:24:57.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.689+0000 7f9c45560000 1 -- 172.21.15.6:0/2717370201 shutdown_connections 2023-10-06T02:24:57.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.689+0000 7f9c45560000 1 -- 172.21.15.6:0/2717370201 >> 172.21.15.6:0/2717370201 conn(0x55996597b6c0 msgr2=0x559965a395f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.689+0000 7f9c45560000 1 -- 172.21.15.6:0/2717370201 shutdown_connections 2023-10-06T02:24:57.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.689+0000 7f9c45560000 1 -- 172.21.15.6:0/2717370201 wait complete. 2023-10-06T02:24:57.697 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 600.00000000 2023-10-06T02:24:57.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.773+0000 7f36900b8000 1 Processor -- start 2023-10-06T02:24:57.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.773+0000 7f36900b8000 1 -- start start 2023-10-06T02:24:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.774+0000 7f36900b8000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bf6f56330 0x560bf7030ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.774+0000 7f36900b8000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560bf70178b0 0x560bf6f9b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.774+0000 7f36900b8000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560bf7017c80 0x560bf6f9bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.774+0000 7f36900b8000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf6ea2980 con 0x560bf70178b0 2023-10-06T02:24:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.774+0000 7f36900b8000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf6ea2620 con 0x560bf6f56330 2023-10-06T02:24:57.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.774+0000 7f36900b8000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560bf6e99400 con 0x560bf7017c80 2023-10-06T02:24:57.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.774+0000 7f3688af2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560bf70178b0 0x560bf6f9b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.774+0000 7f3688af2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560bf70178b0 0x560bf6f9b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59386/0 (socket says 172.21.15.6:59386) 2023-10-06T02:24:57.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.774+0000 7f3688af2700 1 -- 172.21.15.6:0/1360064524 learned_addr learned my addr 172.21.15.6:0/1360064524 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.774+0000 7f3689af4700 1 --2- 172.21.15.6:0/1360064524 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560bf7017c80 0x560bf6f9bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.774+0000 7f36892f3700 1 --2- 172.21.15.6:0/1360064524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bf6f56330 0x560bf7030ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.774+0000 7f3688af2700 1 -- 172.21.15.6:0/1360064524 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560bf7017c80 msgr2=0x560bf6f9bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.774+0000 7f3688af2700 1 --2- 172.21.15.6:0/1360064524 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560bf7017c80 0x560bf6f9bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.774+0000 7f3688af2700 1 -- 172.21.15.6:0/1360064524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bf6f56330 msgr2=0x560bf7030ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.774+0000 7f3688af2700 1 --2- 172.21.15.6:0/1360064524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bf6f56330 0x560bf7030ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.774+0000 7f3688af2700 1 -- 172.21.15.6:0/1360064524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368400a180 con 0x560bf70178b0 2023-10-06T02:24:57.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.774+0000 7f3688af2700 1 --2- 172.21.15.6:0/1360064524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560bf70178b0 0x560bf6f9b660 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f3674001d70 tx=0x7f3674001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3538c4af725634 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.775+0000 7f36837fe700 1 -- 172.21.15.6:0/1360064524 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674014070 con 0x560bf70178b0 2023-10-06T02:24:57.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.775+0000 7f36837fe700 1 -- 172.21.15.6:0/1360064524 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3674008030 con 0x560bf70178b0 2023-10-06T02:24:57.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.775+0000 7f36837fe700 1 -- 172.21.15.6:0/1360064524 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367400bdd0 con 0x560bf70178b0 2023-10-06T02:24:57.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.775+0000 7f36900b8000 1 -- 172.21.15.6:0/1360064524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560bf70178b0 msgr2=0x560bf6f9b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.775+0000 7f36900b8000 1 --2- 172.21.15.6:0/1360064524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560bf70178b0 0x560bf6f9b660 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f3674001d70 tx=0x7f3674001810 comp rx=0 tx=0).stop 2023-10-06T02:24:57.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.775+0000 7f36900b8000 1 -- 172.21.15.6:0/1360064524 shutdown_connections 2023-10-06T02:24:57.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.775+0000 7f36900b8000 1 --2- 172.21.15.6:0/1360064524 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560bf7017c80 0x560bf6f9bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.775+0000 7f36900b8000 1 --2- 172.21.15.6:0/1360064524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bf6f56330 0x560bf7030ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.775+0000 7f36900b8000 1 --2- 172.21.15.6:0/1360064524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560bf70178b0 0x560bf6f9b660 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.775+0000 7f36900b8000 1 -- 172.21.15.6:0/1360064524 >> 172.21.15.6:0/1360064524 conn(0x560bf6f9ebd0 msgr2=0x560bf702f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.775+0000 7f36900b8000 1 -- 172.21.15.6:0/1360064524 shutdown_connections 2023-10-06T02:24:57.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.775+0000 7f36900b8000 1 -- 172.21.15.6:0/1360064524 wait complete. 2023-10-06T02:24:57.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.776+0000 7f36900b8000 1 Processor -- start 2023-10-06T02:24:57.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.776+0000 7f36900b8000 1 -- start start 2023-10-06T02:24:57.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.776+0000 7f36900b8000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560bf6f56330 0x560bf703fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.776+0000 7f36900b8000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bf70178b0 0x560bf7012d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.776+0000 7f36900b8000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560bf7017c80 0x560bf702f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.776+0000 7f36900b8000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf7015da0 con 0x560bf6f56330 2023-10-06T02:24:57.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.776+0000 7f36900b8000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf703faa0 con 0x560bf70178b0 2023-10-06T02:24:57.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.776+0000 7f36900b8000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560bf703f800 con 0x560bf7017c80 2023-10-06T02:24:57.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.776+0000 7f36892f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560bf6f56330 0x560bf703fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.777+0000 7f36892f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560bf6f56330 0x560bf703fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59398/0 (socket says 172.21.15.6:59398) 2023-10-06T02:24:57.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.777+0000 7f36892f3700 1 -- 172.21.15.6:0/2854913233 learned_addr learned my addr 172.21.15.6:0/2854913233 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.777+0000 7f3688af2700 1 --2- 172.21.15.6:0/2854913233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bf70178b0 0x560bf7012d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.777+0000 7f3689af4700 1 --2- 172.21.15.6:0/2854913233 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560bf7017c80 0x560bf702f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.777+0000 7f36892f3700 1 -- 172.21.15.6:0/2854913233 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560bf7017c80 msgr2=0x560bf702f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.777+0000 7f36892f3700 1 --2- 172.21.15.6:0/2854913233 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560bf7017c80 0x560bf702f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.777+0000 7f36892f3700 1 -- 172.21.15.6:0/2854913233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bf70178b0 msgr2=0x560bf7012d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.777+0000 7f36892f3700 1 --2- 172.21.15.6:0/2854913233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bf70178b0 0x560bf7012d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.777+0000 7f36892f3700 1 -- 172.21.15.6:0/2854913233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367400a040 con 0x560bf6f56330 2023-10-06T02:24:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.777+0000 7f36892f3700 1 --2- 172.21.15.6:0/2854913233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560bf6f56330 0x560bf703fc90 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f3684010000 tx=0x7f3684014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.777+0000 7f3681ffb700 1 -- 172.21.15.6:0/2854913233 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684000f40 con 0x560bf6f56330 2023-10-06T02:24:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.777+0000 7f3681ffb700 1 -- 172.21.15.6:0/2854913233 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368400e7e0 con 0x560bf6f56330 2023-10-06T02:24:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.777+0000 7f36900b8000 1 -- 172.21.15.6:0/2854913233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560bf6eb13d0 con 0x560bf6f56330 2023-10-06T02:24:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.777+0000 7f3681ffb700 1 -- 172.21.15.6:0/2854913233 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36840010a0 con 0x560bf6f56330 2023-10-06T02:24:57.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.777+0000 7f36900b8000 1 -- 172.21.15.6:0/2854913233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560bf6ea4ae0 con 0x560bf6f56330 2023-10-06T02:24:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.779+0000 7f3681ffb700 1 -- 172.21.15.6:0/2854913233 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3684023070 con 0x560bf6f56330 2023-10-06T02:24:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.779+0000 7f3681ffb700 1 --2- 172.21.15.6:0/2854913233 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f366c0658c0 0x7f366c067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.779+0000 7f3681ffb700 1 -- 172.21.15.6:0/2854913233 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f3684085a00 con 0x560bf6f56330 2023-10-06T02:24:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.779+0000 7f3688af2700 1 --2- 172.21.15.6:0/2854913233 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f366c0658c0 0x7f366c067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.779+0000 7f36900b8000 1 --2- 172.21.15.6:0/2854913233 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x560bf70132c0 0x560bf7016c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.779+0000 7f36900b8000 1 -- 172.21.15.6:0/2854913233 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:0d82a743:::600.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x560bf70401d0 con 0x560bf70132c0 2023-10-06T02:24:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.779+0000 7f3689af4700 1 --2- 172.21.15.6:0/2854913233 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x560bf70132c0 0x560bf7016c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.780+0000 7f3688af2700 1 --2- 172.21.15.6:0/2854913233 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f366c0658c0 0x7f366c067d70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3674001870 tx=0x7f3674016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.780+0000 7f3689af4700 1 --2- 172.21.15.6:0/2854913233 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x560bf70132c0 0x560bf7016c50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.780+0000 7f3689af4700 1 -- 172.21.15.6:0/2854913233 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 600.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x7f367c012040 con 0x560bf70132c0 2023-10-06T02:24:57.786 INFO:teuthology.orchestra.run.smithi006.stdout:cephfs_metadata/600.00000000 mtime 2023-10-06T02:24:40.000000+0000, size 0 2023-10-06T02:24:57.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.780+0000 7f36900b8000 1 -- 172.21.15.6:0/2854913233 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x560bf70132c0 msgr2=0x560bf7016c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.780+0000 7f36900b8000 1 --2- 172.21.15.6:0/2854913233 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x560bf70132c0 0x560bf7016c50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.780+0000 7f36900b8000 1 -- 172.21.15.6:0/2854913233 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f366c0658c0 msgr2=0x7f366c067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.780+0000 7f36900b8000 1 --2- 172.21.15.6:0/2854913233 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f366c0658c0 0x7f366c067d70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3674001870 tx=0x7f3674016000 comp rx=0 tx=0).stop 2023-10-06T02:24:57.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.780+0000 7f36900b8000 1 -- 172.21.15.6:0/2854913233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560bf6f56330 msgr2=0x560bf703fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.780+0000 7f36900b8000 1 --2- 172.21.15.6:0/2854913233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560bf6f56330 0x560bf703fc90 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f3684010000 tx=0x7f3684014000 comp rx=0 tx=0).stop 2023-10-06T02:24:57.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.780+0000 7f3689af4700 1 -- 172.21.15.6:0/2854913233 reap_dead start 2023-10-06T02:24:57.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.780+0000 7f36900b8000 1 -- 172.21.15.6:0/2854913233 shutdown_connections 2023-10-06T02:24:57.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.780+0000 7f36900b8000 1 -- 172.21.15.6:0/2854913233 >> 172.21.15.6:0/2854913233 conn(0x560bf6f9ebd0 msgr2=0x560bf6f9efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.780+0000 7f36900b8000 1 -- 172.21.15.6:0/2854913233 shutdown_connections 2023-10-06T02:24:57.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.780+0000 7f36900b8000 1 -- 172.21.15.6:0/2854913233 wait complete. 2023-10-06T02:24:57.788 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 1.00000000.inode 2023-10-06T02:24:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.864+0000 7f722f65c000 1 Processor -- start 2023-10-06T02:24:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.864+0000 7f722f65c000 1 -- start start 2023-10-06T02:24:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.865+0000 7f722f65c000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b7d67cdd0 0x561b7d6957d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.865+0000 7f722f65c000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b7d7053b0 0x561b7d721470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.865+0000 7f722f65c000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b7d7239b0 0x561b7d7219b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.865+0000 7f722f65c000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7d598980 con 0x561b7d67cdd0 2023-10-06T02:24:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.865+0000 7f722f65c000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7d598620 con 0x561b7d7053b0 2023-10-06T02:24:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.865+0000 7f722f65c000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b7d58f400 con 0x561b7d7239b0 2023-10-06T02:24:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.865+0000 7f7228897700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b7d67cdd0 0x561b7d6957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.865+0000 7f7228897700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b7d67cdd0 0x561b7d6957d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59416/0 (socket says 172.21.15.6:59416) 2023-10-06T02:24:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.865+0000 7f7228897700 1 -- 172.21.15.6:0/1644798389 learned_addr learned my addr 172.21.15.6:0/1644798389 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.865+0000 7f7229098700 1 --2- 172.21.15.6:0/1644798389 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b7d7239b0 0x561b7d7219b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.865+0000 7f7228096700 1 --2- 172.21.15.6:0/1644798389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b7d7053b0 0x561b7d721470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.865+0000 7f7228897700 1 -- 172.21.15.6:0/1644798389 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b7d7239b0 msgr2=0x561b7d7219b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.865+0000 7f7228897700 1 --2- 172.21.15.6:0/1644798389 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b7d7239b0 0x561b7d7219b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.865+0000 7f7228897700 1 -- 172.21.15.6:0/1644798389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b7d7053b0 msgr2=0x561b7d721470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.865+0000 7f7228897700 1 --2- 172.21.15.6:0/1644798389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b7d7053b0 0x561b7d721470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.865+0000 7f7228897700 1 -- 172.21.15.6:0/1644798389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7220005cf0 con 0x561b7d67cdd0 2023-10-06T02:24:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.865+0000 7f7229098700 1 --2- 172.21.15.6:0/1644798389 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b7d7239b0 0x561b7d7219b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.866+0000 7f7228897700 1 --2- 172.21.15.6:0/1644798389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b7d67cdd0 0x561b7d6957d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f722000ad20 tx=0x7f7220016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41828492399251ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.866+0000 7f7227094700 1 -- 172.21.15.6:0/1644798389 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7220000bc0 con 0x561b7d67cdd0 2023-10-06T02:24:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.866+0000 7f7227094700 1 -- 172.21.15.6:0/1644798389 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7220008970 con 0x561b7d67cdd0 2023-10-06T02:24:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.866+0000 7f7227094700 1 -- 172.21.15.6:0/1644798389 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7220000d20 con 0x561b7d67cdd0 2023-10-06T02:24:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.866+0000 7f722f65c000 1 -- 172.21.15.6:0/1644798389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b7d67cdd0 msgr2=0x561b7d6957d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.866+0000 7f722f65c000 1 --2- 172.21.15.6:0/1644798389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b7d67cdd0 0x561b7d6957d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f722000ad20 tx=0x7f7220016000 comp rx=0 tx=0).stop 2023-10-06T02:24:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.866+0000 7f722f65c000 1 -- 172.21.15.6:0/1644798389 shutdown_connections 2023-10-06T02:24:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.866+0000 7f722f65c000 1 --2- 172.21.15.6:0/1644798389 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b7d7239b0 0x561b7d7219b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.866+0000 7f722f65c000 1 --2- 172.21.15.6:0/1644798389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b7d67cdd0 0x561b7d6957d0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.866+0000 7f722f65c000 1 --2- 172.21.15.6:0/1644798389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b7d7053b0 0x561b7d721470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.866+0000 7f722f65c000 1 -- 172.21.15.6:0/1644798389 >> 172.21.15.6:0/1644798389 conn(0x561b7d64dd50 msgr2=0x561b7d7227e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.866+0000 7f722f65c000 1 -- 172.21.15.6:0/1644798389 shutdown_connections 2023-10-06T02:24:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.866+0000 7f722f65c000 1 -- 172.21.15.6:0/1644798389 wait complete. 2023-10-06T02:24:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.867+0000 7f722f65c000 1 Processor -- start 2023-10-06T02:24:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.867+0000 7f722f65c000 1 -- start start 2023-10-06T02:24:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f722f65c000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b7d67cdd0 0x561b7d71d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f722f65c000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b7d7053b0 0x561b7d703910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f722f65c000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b7d7239b0 0x561b7d7068d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f722f65c000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7d7046c0 con 0x561b7d7053b0 2023-10-06T02:24:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f722f65c000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7d721ac0 con 0x561b7d67cdd0 2023-10-06T02:24:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f722f65c000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b7d704420 con 0x561b7d7239b0 2023-10-06T02:24:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f7228096700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b7d7053b0 0x561b7d703910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f7228096700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b7d7053b0 0x561b7d703910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59424/0 (socket says 172.21.15.6:59424) 2023-10-06T02:24:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f7228096700 1 -- 172.21.15.6:0/1311925770 learned_addr learned my addr 172.21.15.6:0/1311925770 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f7229098700 1 --2- 172.21.15.6:0/1311925770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b7d7239b0 0x561b7d7068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f7228897700 1 --2- 172.21.15.6:0/1311925770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b7d67cdd0 0x561b7d71d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f7228096700 1 -- 172.21.15.6:0/1311925770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b7d7239b0 msgr2=0x561b7d7068d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f7228096700 1 --2- 172.21.15.6:0/1311925770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b7d7239b0 0x561b7d7068d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f7228096700 1 -- 172.21.15.6:0/1311925770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b7d67cdd0 msgr2=0x561b7d71d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f7228096700 1 --2- 172.21.15.6:0/1311925770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b7d67cdd0 0x561b7d71d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f7228096700 1 -- 172.21.15.6:0/1311925770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b7d5c11c0 con 0x561b7d7053b0 2023-10-06T02:24:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f7228096700 1 --2- 172.21.15.6:0/1311925770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b7d7053b0 0x561b7d703910 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f721000df10 tx=0x7f7210000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f7225891700 1 -- 172.21.15.6:0/1311925770 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721000bda0 con 0x561b7d7053b0 2023-10-06T02:24:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f7225891700 1 -- 172.21.15.6:0/1311925770 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721000f450 con 0x561b7d7053b0 2023-10-06T02:24:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.868+0000 7f722f65c000 1 -- 172.21.15.6:0/1311925770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b7d5a73d0 con 0x561b7d7053b0 2023-10-06T02:24:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.869+0000 7f7225891700 1 -- 172.21.15.6:0/1311925770 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721000f810 con 0x561b7d7053b0 2023-10-06T02:24:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.869+0000 7f722f65c000 1 -- 172.21.15.6:0/1311925770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b7d59aae0 con 0x561b7d7053b0 2023-10-06T02:24:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.870+0000 7f7225891700 1 -- 172.21.15.6:0/1311925770 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f721000fb80 con 0x561b7d7053b0 2023-10-06T02:24:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.870+0000 7f7225891700 1 --2- 172.21.15.6:0/1311925770 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f72080658c0 0x7f7208067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.870+0000 7f7225891700 1 -- 172.21.15.6:0/1311925770 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7210083bc0 con 0x561b7d7053b0 2023-10-06T02:24:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.870+0000 7f7228897700 1 --2- 172.21.15.6:0/1311925770 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f72080658c0 0x7f7208067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.871+0000 7f722f65c000 1 --2- 172.21.15.6:0/1311925770 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x561b7d71f1e0 0x561b7d71f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.871+0000 7f722f65c000 1 -- 172.21.15.6:0/1311925770 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x561b7d71faf0 con 0x561b7d71f1e0 2023-10-06T02:24:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.871+0000 7f7229098700 1 --2- 172.21.15.6:0/1311925770 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x561b7d71f1e0 0x561b7d71f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.871+0000 7f7228897700 1 --2- 172.21.15.6:0/1311925770 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f72080658c0 0x7f7208067d70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7220005c70 tx=0x7f722001e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.871+0000 7f7229098700 1 --2- 172.21.15.6:0/1311925770 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x561b7d71f1e0 0x561b7d71f5b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.872+0000 7f7229098700 1 -- 172.21.15.6:0/1311925770 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x7f721800caa0 con 0x561b7d71f1e0 2023-10-06T02:24:57.879 INFO:teuthology.orchestra.run.smithi006.stdout:cephfs_metadata/1.00000000.inode mtime 2023-10-06T02:24:54.000000+0000, size 554 2023-10-06T02:24:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.872+0000 7f722f65c000 1 -- 172.21.15.6:0/1311925770 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x561b7d71f1e0 msgr2=0x561b7d71f5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.872+0000 7f722f65c000 1 --2- 172.21.15.6:0/1311925770 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x561b7d71f1e0 0x561b7d71f5b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.872+0000 7f722f65c000 1 -- 172.21.15.6:0/1311925770 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f72080658c0 msgr2=0x7f7208067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.872+0000 7f722f65c000 1 --2- 172.21.15.6:0/1311925770 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f72080658c0 0x7f7208067d70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7220005c70 tx=0x7f722001e000 comp rx=0 tx=0).stop 2023-10-06T02:24:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.872+0000 7f722f65c000 1 -- 172.21.15.6:0/1311925770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b7d7053b0 msgr2=0x561b7d703910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.872+0000 7f722f65c000 1 --2- 172.21.15.6:0/1311925770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b7d7053b0 0x561b7d703910 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f721000df10 tx=0x7f7210000bc0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.872+0000 7f7229098700 1 -- 172.21.15.6:0/1311925770 reap_dead start 2023-10-06T02:24:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.872+0000 7f722f65c000 1 -- 172.21.15.6:0/1311925770 shutdown_connections 2023-10-06T02:24:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.872+0000 7f722f65c000 1 -- 172.21.15.6:0/1311925770 >> 172.21.15.6:0/1311925770 conn(0x561b7d64dd50 msgr2=0x561b7d71da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.872+0000 7f722f65c000 1 -- 172.21.15.6:0/1311925770 shutdown_connections 2023-10-06T02:24:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.872+0000 7f722f65c000 1 -- 172.21.15.6:0/1311925770 wait complete. 2023-10-06T02:24:57.882 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 200.00000000 2023-10-06T02:24:57.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.958+0000 7f8b9a164000 1 Processor -- start 2023-10-06T02:24:57.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.958+0000 7f8b9a164000 1 -- start start 2023-10-06T02:24:57.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.958+0000 7f8b9a164000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560db7ff8dd0 0x560db80129d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.958+0000 7f8b9a164000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560db80813b0 0x560db809e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.958+0000 7f8b9a164000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db809f9b0 0x560db800f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.958+0000 7f8b9a164000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db7f14620 con 0x560db809f9b0 2023-10-06T02:24:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.958+0000 7f8b9a164000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db7f0b400 con 0x560db7ff8dd0 2023-10-06T02:24:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.958+0000 7f8b9a164000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560db800e3a0 con 0x560db80813b0 2023-10-06T02:24:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.958+0000 7f8b93ba0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db809f9b0 0x560db800f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.958+0000 7f8b93ba0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db809f9b0 0x560db800f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59440/0 (socket says 172.21.15.6:59440) 2023-10-06T02:24:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.958+0000 7f8b93ba0700 1 -- 172.21.15.6:0/2100946877 learned_addr learned my addr 172.21.15.6:0/2100946877 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.959+0000 7f8b92b9e700 1 --2- 172.21.15.6:0/2100946877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560db80813b0 0x560db809e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.959+0000 7f8b9339f700 1 --2- 172.21.15.6:0/2100946877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560db7ff8dd0 0x560db80129d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.959+0000 7f8b93ba0700 1 -- 172.21.15.6:0/2100946877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560db80813b0 msgr2=0x560db809e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.959+0000 7f8b93ba0700 1 --2- 172.21.15.6:0/2100946877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560db80813b0 0x560db809e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.959+0000 7f8b93ba0700 1 -- 172.21.15.6:0/2100946877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560db7ff8dd0 msgr2=0x560db80129d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.959+0000 7f8b93ba0700 1 --2- 172.21.15.6:0/2100946877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560db7ff8dd0 0x560db80129d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.959+0000 7f8b93ba0700 1 -- 172.21.15.6:0/2100946877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b88005db0 con 0x560db809f9b0 2023-10-06T02:24:57.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.959+0000 7f8b92b9e700 1 --2- 172.21.15.6:0/2100946877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560db80813b0 0x560db809e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:57.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.959+0000 7f8b93ba0700 1 --2- 172.21.15.6:0/2100946877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db809f9b0 0x560db800f2c0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00b670 tx=0x7f8b8c007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efeb20402b7bdabb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.959+0000 7f8b91b9c700 1 -- 172.21.15.6:0/2100946877 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c0106f0 con 0x560db809f9b0 2023-10-06T02:24:57.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.959+0000 7f8b91b9c700 1 -- 172.21.15.6:0/2100946877 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c00b050 con 0x560db809f9b0 2023-10-06T02:24:57.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.959+0000 7f8b91b9c700 1 -- 172.21.15.6:0/2100946877 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c010aa0 con 0x560db809f9b0 2023-10-06T02:24:57.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.959+0000 7f8b9a164000 1 -- 172.21.15.6:0/2100946877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db809f9b0 msgr2=0x560db800f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.959+0000 7f8b9a164000 1 --2- 172.21.15.6:0/2100946877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db809f9b0 0x560db800f2c0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00b670 tx=0x7f8b8c007040 comp rx=0 tx=0).stop 2023-10-06T02:24:57.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.959+0000 7f8b9a164000 1 -- 172.21.15.6:0/2100946877 shutdown_connections 2023-10-06T02:24:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.959+0000 7f8b9a164000 1 --2- 172.21.15.6:0/2100946877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db809f9b0 0x560db800f2c0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.959+0000 7f8b9a164000 1 --2- 172.21.15.6:0/2100946877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560db7ff8dd0 0x560db80129d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.960+0000 7f8b9a164000 1 --2- 172.21.15.6:0/2100946877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560db80813b0 0x560db809e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.960+0000 7f8b9a164000 1 -- 172.21.15.6:0/2100946877 >> 172.21.15.6:0/2100946877 conn(0x560db7fc9d50 msgr2=0x560db80818a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.960+0000 7f8b9a164000 1 -- 172.21.15.6:0/2100946877 shutdown_connections 2023-10-06T02:24:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.960+0000 7f8b9a164000 1 -- 172.21.15.6:0/2100946877 wait complete. 2023-10-06T02:24:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.960+0000 7f8b9a164000 1 Processor -- start 2023-10-06T02:24:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.960+0000 7f8b9a164000 1 -- start start 2023-10-06T02:24:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b9a164000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db7ff8dd0 0x560db809de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b9a164000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560db80813b0 0x560db7ff1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b9a164000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560db809f9b0 0x560db800f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b9a164000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db7ff1580 con 0x560db7ff8dd0 2023-10-06T02:24:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b9a164000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db7ff1820 con 0x560db80813b0 2023-10-06T02:24:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b9a164000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560db7fec120 con 0x560db809f9b0 2023-10-06T02:24:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b9339f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db7ff8dd0 0x560db809de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b9339f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db7ff8dd0 0x560db809de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59456/0 (socket says 172.21.15.6:59456) 2023-10-06T02:24:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b9339f700 1 -- 172.21.15.6:0/3052431029 learned_addr learned my addr 172.21.15.6:0/3052431029 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b92b9e700 1 --2- 172.21.15.6:0/3052431029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560db80813b0 0x560db7ff1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b93ba0700 1 --2- 172.21.15.6:0/3052431029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560db809f9b0 0x560db800f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b9339f700 1 -- 172.21.15.6:0/3052431029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560db809f9b0 msgr2=0x560db800f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b9339f700 1 --2- 172.21.15.6:0/3052431029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560db809f9b0 0x560db800f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b9339f700 1 -- 172.21.15.6:0/3052431029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560db80813b0 msgr2=0x560db7ff1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b9339f700 1 --2- 172.21.15.6:0/3052431029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560db80813b0 0x560db7ff1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b9339f700 1 -- 172.21.15.6:0/3052431029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c00b270 con 0x560db7ff8dd0 2023-10-06T02:24:57.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b93ba0700 1 --2- 172.21.15.6:0/3052431029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560db809f9b0 0x560db800f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:57.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.961+0000 7f8b9339f700 1 --2- 172.21.15.6:0/3052431029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db7ff8dd0 0x560db809de60 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f8b840067a0 tx=0x7f8b84005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.962+0000 7f8b7bfff700 1 -- 172.21.15.6:0/3052431029 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84012560 con 0x560db7ff8dd0 2023-10-06T02:24:57.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.962+0000 7f8b7bfff700 1 -- 172.21.15.6:0/3052431029 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8400f040 con 0x560db7ff8dd0 2023-10-06T02:24:57.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.962+0000 7f8b9a164000 1 -- 172.21.15.6:0/3052431029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560db7f3d1c0 con 0x560db7ff8dd0 2023-10-06T02:24:57.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.962+0000 7f8b7bfff700 1 -- 172.21.15.6:0/3052431029 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b840128d0 con 0x560db7ff8dd0 2023-10-06T02:24:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.962+0000 7f8b9a164000 1 -- 172.21.15.6:0/3052431029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560db7f233d0 con 0x560db7ff8dd0 2023-10-06T02:24:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.963+0000 7f8b7bfff700 1 -- 172.21.15.6:0/3052431029 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b84012c80 con 0x560db7ff8dd0 2023-10-06T02:24:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.963+0000 7f8b7bfff700 1 --2- 172.21.15.6:0/3052431029 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8b80065890 0x7f8b80067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.963+0000 7f8b7bfff700 1 -- 172.21.15.6:0/3052431029 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f8b84083450 con 0x560db7ff8dd0 2023-10-06T02:24:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.964+0000 7f8b9a164000 1 --2- 172.21.15.6:0/3052431029 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x560db7ff10f0 0x560db80b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.964+0000 7f8b9a164000 1 -- 172.21.15.6:0/3052431029 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:292cf221:::200.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x560db80b4f90 con 0x560db7ff10f0 2023-10-06T02:24:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.964+0000 7f8b92b9e700 1 --2- 172.21.15.6:0/3052431029 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8b80065890 0x7f8b80067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.964+0000 7f8b93ba0700 1 --2- 172.21.15.6:0/3052431029 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x560db7ff10f0 0x560db80b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.964+0000 7f8b92b9e700 1 --2- 172.21.15.6:0/3052431029 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8b80065890 0x7f8b80067d40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8b88005b50 tx=0x7f8b88016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.964+0000 7f8b93ba0700 1 --2- 172.21.15.6:0/3052431029 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x560db7ff10f0 0x560db80b4a50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.965+0000 7f8b93ba0700 1 -- 172.21.15.6:0/3052431029 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 200.00000000 [stat out=16b] v0'0 uv18 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x7f8b8c016070 con 0x560db7ff10f0 2023-10-06T02:24:57.973 INFO:teuthology.orchestra.run.smithi006.stdout:cephfs_metadata/200.00000000 mtime 2023-10-06T02:24:54.000000+0000, size 90 2023-10-06T02:24:57.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.965+0000 7f8b9a164000 1 -- 172.21.15.6:0/3052431029 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x560db7ff10f0 msgr2=0x560db80b4a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.965+0000 7f8b9a164000 1 --2- 172.21.15.6:0/3052431029 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x560db7ff10f0 0x560db80b4a50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.965+0000 7f8b9a164000 1 -- 172.21.15.6:0/3052431029 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8b80065890 msgr2=0x7f8b80067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.965+0000 7f8b9a164000 1 --2- 172.21.15.6:0/3052431029 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8b80065890 0x7f8b80067d40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8b88005b50 tx=0x7f8b88016000 comp rx=0 tx=0).stop 2023-10-06T02:24:57.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.965+0000 7f8b9a164000 1 -- 172.21.15.6:0/3052431029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db7ff8dd0 msgr2=0x560db809de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.965+0000 7f8b9a164000 1 --2- 172.21.15.6:0/3052431029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560db7ff8dd0 0x560db809de60 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f8b840067a0 tx=0x7f8b84005d10 comp rx=0 tx=0).stop 2023-10-06T02:24:57.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.965+0000 7f8b93ba0700 1 -- 172.21.15.6:0/3052431029 reap_dead start 2023-10-06T02:24:57.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.965+0000 7f8b9a164000 1 -- 172.21.15.6:0/3052431029 shutdown_connections 2023-10-06T02:24:57.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.965+0000 7f8b9a164000 1 -- 172.21.15.6:0/3052431029 >> 172.21.15.6:0/3052431029 conn(0x560db7fc9d50 msgr2=0x560db800e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.965+0000 7f8b9a164000 1 -- 172.21.15.6:0/3052431029 shutdown_connections 2023-10-06T02:24:57.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:57.965+0000 7f8b9a164000 1 -- 172.21.15.6:0/3052431029 wait complete. 2023-10-06T02:24:57.975 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 200.00000001 2023-10-06T02:24:58.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.051+0000 7f2d7860f000 1 Processor -- start 2023-10-06T02:24:58.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.051+0000 7f2d7860f000 1 -- start start 2023-10-06T02:24:58.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.052+0000 7f2d7860f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f87e24cc0 0x561f87ee0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.052+0000 7f2d7860f000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561f87e504b0 0x561f87e671e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.052+0000 7f2d7860f000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f87ee1ce0 0x561f87e69040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.052+0000 7f2d7860f000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f87d6c980 con 0x561f87ee1ce0 2023-10-06T02:24:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.052+0000 7f2d7860f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f87d6c620 con 0x561f87e24cc0 2023-10-06T02:24:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.052+0000 7f2d7860f000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f87d63400 con 0x561f87e504b0 2023-10-06T02:24:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.052+0000 7f2d7204b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f87ee1ce0 0x561f87e69040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.052+0000 7f2d7204b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f87ee1ce0 0x561f87e69040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59472/0 (socket says 172.21.15.6:59472) 2023-10-06T02:24:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.052+0000 7f2d7204b700 1 -- 172.21.15.6:0/2236040720 learned_addr learned my addr 172.21.15.6:0/2236040720 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.052+0000 7f2d71049700 1 --2- 172.21.15.6:0/2236040720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561f87e504b0 0x561f87e671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.052+0000 7f2d7204b700 1 -- 172.21.15.6:0/2236040720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561f87e504b0 msgr2=0x561f87e671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.052+0000 7f2d7204b700 1 --2- 172.21.15.6:0/2236040720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561f87e504b0 0x561f87e671e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.052+0000 7f2d7204b700 1 -- 172.21.15.6:0/2236040720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f87e24cc0 msgr2=0x561f87ee0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.052+0000 7f2d7184a700 1 --2- 172.21.15.6:0/2236040720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f87e24cc0 0x561f87ee0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.053+0000 7f2d7204b700 1 --2- 172.21.15.6:0/2236040720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f87e24cc0 0x561f87ee0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.053+0000 7f2d7204b700 1 -- 172.21.15.6:0/2236040720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c005cf0 con 0x561f87ee1ce0 2023-10-06T02:24:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.053+0000 7f2d7204b700 1 --2- 172.21.15.6:0/2236040720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f87ee1ce0 0x561f87e69040 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c001ce0 tx=0x7f2d6c001760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf8250410af72ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.053+0000 7f2d6bfff700 1 -- 172.21.15.6:0/2236040720 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c00bcb0 con 0x561f87ee1ce0 2023-10-06T02:24:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.053+0000 7f2d6bfff700 1 -- 172.21.15.6:0/2236040720 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c00be30 con 0x561f87ee1ce0 2023-10-06T02:24:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.053+0000 7f2d6bfff700 1 -- 172.21.15.6:0/2236040720 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c00e6c0 con 0x561f87ee1ce0 2023-10-06T02:24:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.053+0000 7f2d7860f000 1 -- 172.21.15.6:0/2236040720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f87ee1ce0 msgr2=0x561f87e69040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.053+0000 7f2d7860f000 1 --2- 172.21.15.6:0/2236040720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f87ee1ce0 0x561f87e69040 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c001ce0 tx=0x7f2d6c001760 comp rx=0 tx=0).stop 2023-10-06T02:24:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.053+0000 7f2d7860f000 1 -- 172.21.15.6:0/2236040720 shutdown_connections 2023-10-06T02:24:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.053+0000 7f2d7860f000 1 --2- 172.21.15.6:0/2236040720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f87ee1ce0 0x561f87e69040 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.053+0000 7f2d7860f000 1 --2- 172.21.15.6:0/2236040720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f87e24cc0 0x561f87ee0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.053+0000 7f2d7860f000 1 --2- 172.21.15.6:0/2236040720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561f87e504b0 0x561f87e671e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.053+0000 7f2d7860f000 1 -- 172.21.15.6:0/2236040720 >> 172.21.15.6:0/2236040720 conn(0x561f87e206c0 msgr2=0x561f87ee0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.053+0000 7f2d7860f000 1 -- 172.21.15.6:0/2236040720 shutdown_connections 2023-10-06T02:24:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.053+0000 7f2d7860f000 1 -- 172.21.15.6:0/2236040720 wait complete. 2023-10-06T02:24:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.054+0000 7f2d7860f000 1 Processor -- start 2023-10-06T02:24:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.054+0000 7f2d7860f000 1 -- start start 2023-10-06T02:24:58.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d7860f000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f87e24cc0 0x561f87e68310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d7860f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f87e504b0 0x561f87ed8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d7860f000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561f87ee1ce0 0x561f87edc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d7860f000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f87ed8460 con 0x561f87e24cc0 2023-10-06T02:24:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d7860f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f87ed8700 con 0x561f87e504b0 2023-10-06T02:24:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d7860f000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f87ed89a0 con 0x561f87ee1ce0 2023-10-06T02:24:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d7184a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f87e24cc0 0x561f87e68310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d7184a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f87e24cc0 0x561f87e68310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59488/0 (socket says 172.21.15.6:59488) 2023-10-06T02:24:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d7184a700 1 -- 172.21.15.6:0/832314903 learned_addr learned my addr 172.21.15.6:0/832314903 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d71049700 1 --2- 172.21.15.6:0/832314903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f87e504b0 0x561f87ed8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d7204b700 1 --2- 172.21.15.6:0/832314903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561f87ee1ce0 0x561f87edc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d7184a700 1 -- 172.21.15.6:0/832314903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561f87ee1ce0 msgr2=0x561f87edc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d7184a700 1 --2- 172.21.15.6:0/832314903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561f87ee1ce0 0x561f87edc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d7184a700 1 -- 172.21.15.6:0/832314903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f87e504b0 msgr2=0x561f87ed8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d7184a700 1 --2- 172.21.15.6:0/832314903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f87e504b0 0x561f87ed8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d7184a700 1 -- 172.21.15.6:0/832314903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f87d6e750 con 0x561f87e24cc0 2023-10-06T02:24:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d7184a700 1 --2- 172.21.15.6:0/832314903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f87e24cc0 0x561f87e68310 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f2d640084d0 tx=0x7f2d64007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d6a7fc700 1 -- 172.21.15.6:0/832314903 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6400b070 con 0x561f87e24cc0 2023-10-06T02:24:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d6a7fc700 1 -- 172.21.15.6:0/832314903 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d64008da0 con 0x561f87e24cc0 2023-10-06T02:24:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d7860f000 1 -- 172.21.15.6:0/832314903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561f87d7b3d0 con 0x561f87e24cc0 2023-10-06T02:24:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.055+0000 7f2d6a7fc700 1 -- 172.21.15.6:0/832314903 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64012640 con 0x561f87e24cc0 2023-10-06T02:24:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.056+0000 7f2d7860f000 1 -- 172.21.15.6:0/832314903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f87d6eae0 con 0x561f87e24cc0 2023-10-06T02:24:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.057+0000 7f2d6a7fc700 1 -- 172.21.15.6:0/832314903 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d640129b0 con 0x561f87e24cc0 2023-10-06T02:24:58.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.057+0000 7f2d6a7fc700 1 --2- 172.21.15.6:0/832314903 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2d540658c0 0x7f2d54067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.057+0000 7f2d6a7fc700 1 -- 172.21.15.6:0/832314903 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f2d640830a0 con 0x561f87e24cc0 2023-10-06T02:24:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.057+0000 7f2d71049700 1 --2- 172.21.15.6:0/832314903 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2d540658c0 0x7f2d54067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.057+0000 7f2d7860f000 1 --2- 172.21.15.6:0/832314903 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x561f87edc600 0x561f87ed6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.057+0000 7f2d7860f000 1 -- 172.21.15.6:0/832314903 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x561f87ed6e70 con 0x561f87edc600 2023-10-06T02:24:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.058+0000 7f2d7204b700 1 --2- 172.21.15.6:0/832314903 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x561f87edc600 0x561f87ed6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.058+0000 7f2d71049700 1 --2- 172.21.15.6:0/832314903 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2d540658c0 0x7f2d54067d70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00a520 tx=0x7f2d5c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.058+0000 7f2d7204b700 1 --2- 172.21.15.6:0/832314903 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x561f87edc600 0x561f87ed6930 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.058+0000 7f2d7204b700 1 -- 172.21.15.6:0/832314903 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 200.00000001 [stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x7f2d6c014070 con 0x561f87edc600 2023-10-06T02:24:58.063 INFO:teuthology.orchestra.run.smithi006.stdout:cephfs_metadata/200.00000001 mtime 2023-10-06T02:24:54.000000+0000, size 14075 2023-10-06T02:24:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.058+0000 7f2d7860f000 1 -- 172.21.15.6:0/832314903 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x561f87edc600 msgr2=0x561f87ed6930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.058+0000 7f2d7860f000 1 --2- 172.21.15.6:0/832314903 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x561f87edc600 0x561f87ed6930 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.058+0000 7f2d7860f000 1 -- 172.21.15.6:0/832314903 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2d540658c0 msgr2=0x7f2d54067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.058+0000 7f2d7860f000 1 --2- 172.21.15.6:0/832314903 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2d540658c0 0x7f2d54067d70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00a520 tx=0x7f2d5c016000 comp rx=0 tx=0).stop 2023-10-06T02:24:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.058+0000 7f2d7860f000 1 -- 172.21.15.6:0/832314903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f87e24cc0 msgr2=0x561f87e68310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.058+0000 7f2d7860f000 1 --2- 172.21.15.6:0/832314903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f87e24cc0 0x561f87e68310 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f2d640084d0 tx=0x7f2d64007040 comp rx=0 tx=0).stop 2023-10-06T02:24:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.058+0000 7f2d7204b700 1 -- 172.21.15.6:0/832314903 reap_dead start 2023-10-06T02:24:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.059+0000 7f2d7860f000 1 -- 172.21.15.6:0/832314903 shutdown_connections 2023-10-06T02:24:58.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.059+0000 7f2d7860f000 1 -- 172.21.15.6:0/832314903 >> 172.21.15.6:0/832314903 conn(0x561f87e206c0 msgr2=0x561f87ee0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.059+0000 7f2d7860f000 1 -- 172.21.15.6:0/832314903 shutdown_connections 2023-10-06T02:24:58.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.059+0000 7f2d7860f000 1 -- 172.21.15.6:0/832314903 wait complete. 2023-10-06T02:24:58.066 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat mds0_openfiles.0 2023-10-06T02:24:58.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.142+0000 7f72545fa000 1 Processor -- start 2023-10-06T02:24:58.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.142+0000 7f72545fa000 1 -- start start 2023-10-06T02:24:58.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.142+0000 7f72545fa000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352d7e8650 0x56352d7b9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.142+0000 7f72545fa000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352d876a60 0x56352d7daea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.142+0000 7f72545fa000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352d890310 0x56352d7db3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.142+0000 7f72545fa000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352d75f320 con 0x56352d7e8650 2023-10-06T02:24:58.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.142+0000 7f72545fa000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352d703980 con 0x56352d876a60 2023-10-06T02:24:58.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.142+0000 7f72545fa000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56352d703620 con 0x56352d890310 2023-10-06T02:24:58.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.142+0000 7f724d835700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352d7e8650 0x56352d7b9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.142+0000 7f724d835700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352d7e8650 0x56352d7b9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59494/0 (socket says 172.21.15.6:59494) 2023-10-06T02:24:58.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.142+0000 7f724d835700 1 -- 172.21.15.6:0/3783397444 learned_addr learned my addr 172.21.15.6:0/3783397444 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f724e036700 1 --2- 172.21.15.6:0/3783397444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352d890310 0x56352d7db3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f724d034700 1 --2- 172.21.15.6:0/3783397444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352d876a60 0x56352d7daea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f724d835700 1 -- 172.21.15.6:0/3783397444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352d890310 msgr2=0x56352d7db3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f724d835700 1 --2- 172.21.15.6:0/3783397444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352d890310 0x56352d7db3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f724d835700 1 -- 172.21.15.6:0/3783397444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352d876a60 msgr2=0x56352d7daea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f724d835700 1 --2- 172.21.15.6:0/3783397444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352d876a60 0x56352d7daea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f724d835700 1 -- 172.21.15.6:0/3783397444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7238005cf0 con 0x56352d7e8650 2023-10-06T02:24:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f724e036700 1 --2- 172.21.15.6:0/3783397444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352d890310 0x56352d7db3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f724d034700 1 --2- 172.21.15.6:0/3783397444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352d876a60 0x56352d7daea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f724d835700 1 --2- 172.21.15.6:0/3783397444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352d7e8650 0x56352d7b9cb0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f7240001600 tx=0x7f7240006ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ef18d35ed4deda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f7247fff700 1 -- 172.21.15.6:0/3783397444 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724000e470 con 0x56352d7e8650 2023-10-06T02:24:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f7247fff700 1 -- 172.21.15.6:0/3783397444 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724000e5d0 con 0x56352d7e8650 2023-10-06T02:24:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f7247fff700 1 -- 172.21.15.6:0/3783397444 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724000e970 con 0x56352d7e8650 2023-10-06T02:24:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f72545fa000 1 -- 172.21.15.6:0/3783397444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352d7e8650 msgr2=0x56352d7b9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f72545fa000 1 --2- 172.21.15.6:0/3783397444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352d7e8650 0x56352d7b9cb0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f7240001600 tx=0x7f7240006ba0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f72545fa000 1 -- 172.21.15.6:0/3783397444 shutdown_connections 2023-10-06T02:24:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f72545fa000 1 --2- 172.21.15.6:0/3783397444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352d890310 0x56352d7db3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f72545fa000 1 --2- 172.21.15.6:0/3783397444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352d7e8650 0x56352d7b9cb0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f72545fa000 1 --2- 172.21.15.6:0/3783397444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352d876a60 0x56352d7daea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.143+0000 7f72545fa000 1 -- 172.21.15.6:0/3783397444 >> 172.21.15.6:0/3783397444 conn(0x56352d7b95d0 msgr2=0x56352d88e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.144+0000 7f72545fa000 1 -- 172.21.15.6:0/3783397444 shutdown_connections 2023-10-06T02:24:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.144+0000 7f72545fa000 1 -- 172.21.15.6:0/3783397444 wait complete. 2023-10-06T02:24:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.144+0000 7f72545fa000 1 Processor -- start 2023-10-06T02:24:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.144+0000 7f72545fa000 1 -- start start 2023-10-06T02:24:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.145+0000 7f72545fa000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352d7e8650 0x56352d870c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.145+0000 7f72545fa000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352d876a60 0x56352d7e6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.145+0000 7f72545fa000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352d890310 0x56352d7e6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.145+0000 7f72545fa000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352d6fa400 con 0x56352d890310 2023-10-06T02:24:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.145+0000 7f72545fa000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352d801260 con 0x56352d7e8650 2023-10-06T02:24:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.145+0000 7f72545fa000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56352d874550 con 0x56352d876a60 2023-10-06T02:24:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.145+0000 7f724e036700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352d890310 0x56352d7e6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.145+0000 7f724e036700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352d890310 0x56352d7e6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59496/0 (socket says 172.21.15.6:59496) 2023-10-06T02:24:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.145+0000 7f724e036700 1 -- 172.21.15.6:0/21484081 learned_addr learned my addr 172.21.15.6:0/21484081 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.145+0000 7f724d034700 1 --2- 172.21.15.6:0/21484081 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352d876a60 0x56352d7e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.145+0000 7f724d835700 1 --2- 172.21.15.6:0/21484081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352d7e8650 0x56352d870c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.145+0000 7f724e036700 1 -- 172.21.15.6:0/21484081 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352d876a60 msgr2=0x56352d7e6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.145+0000 7f724e036700 1 --2- 172.21.15.6:0/21484081 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56352d876a60 0x56352d7e6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.145+0000 7f724e036700 1 -- 172.21.15.6:0/21484081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352d7e8650 msgr2=0x56352d870c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.145+0000 7f724e036700 1 --2- 172.21.15.6:0/21484081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56352d7e8650 0x56352d870c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.145+0000 7f724e036700 1 -- 172.21.15.6:0/21484081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56352d72c1c0 con 0x56352d890310 2023-10-06T02:24:58.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.145+0000 7f724e036700 1 --2- 172.21.15.6:0/21484081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352d890310 0x56352d7e6980 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f724800b5c0 tx=0x7f7248000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.146+0000 7f72467fc700 1 -- 172.21.15.6:0/21484081 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800be30 con 0x56352d890310 2023-10-06T02:24:58.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.146+0000 7f72467fc700 1 -- 172.21.15.6:0/21484081 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7248010620 con 0x56352d890310 2023-10-06T02:24:58.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.146+0000 7f72545fa000 1 -- 172.21.15.6:0/21484081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56352d705ae0 con 0x56352d890310 2023-10-06T02:24:58.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.146+0000 7f72467fc700 1 -- 172.21.15.6:0/21484081 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72480109e0 con 0x56352d890310 2023-10-06T02:24:58.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.146+0000 7f72545fa000 1 -- 172.21.15.6:0/21484081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56352d705540 con 0x56352d890310 2023-10-06T02:24:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.147+0000 7f72467fc700 1 -- 172.21.15.6:0/21484081 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7248019400 con 0x56352d890310 2023-10-06T02:24:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.147+0000 7f72467fc700 1 --2- 172.21.15.6:0/21484081 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7230065890 0x7f7230067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.147+0000 7f72467fc700 1 -- 172.21.15.6:0/21484081 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f724800a040 con 0x56352d890310 2023-10-06T02:24:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.148+0000 7f72545fa000 1 --2- 172.21.15.6:0/21484081 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56352d88f220 0x56352d8753f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.148+0000 7f724d835700 1 --2- 172.21.15.6:0/21484081 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7230065890 0x7f7230067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.148+0000 7f72545fa000 1 -- 172.21.15.6:0/21484081 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.6 14:654134d2:::mds0_openfiles.0:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x56352d7e1970 con 0x56352d88f220 2023-10-06T02:24:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.148+0000 7f724d034700 1 --2- 172.21.15.6:0/21484081 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56352d88f220 0x56352d8753f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.148+0000 7f724d034700 1 --2- 172.21.15.6:0/21484081 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56352d88f220 0x56352d8753f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.148+0000 7f724d835700 1 --2- 172.21.15.6:0/21484081 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7230065890 0x7f7230067d40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7240006c00 tx=0x7f7240014000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.148+0000 7f724d034700 1 -- 172.21.15.6:0/21484081 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 mds0_openfiles.0 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x7f72380135f0 con 0x56352d88f220 2023-10-06T02:24:58.155 INFO:teuthology.orchestra.run.smithi006.stdout:cephfs_metadata/mds0_openfiles.0 mtime 2023-10-06T02:24:54.000000+0000, size 0 2023-10-06T02:24:58.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.148+0000 7f72545fa000 1 -- 172.21.15.6:0/21484081 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56352d88f220 msgr2=0x56352d8753f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.148+0000 7f72545fa000 1 --2- 172.21.15.6:0/21484081 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56352d88f220 0x56352d8753f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.148+0000 7f72545fa000 1 -- 172.21.15.6:0/21484081 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7230065890 msgr2=0x7f7230067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.148+0000 7f72545fa000 1 --2- 172.21.15.6:0/21484081 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7230065890 0x7f7230067d40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7240006c00 tx=0x7f7240014000 comp rx=0 tx=0).stop 2023-10-06T02:24:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.148+0000 7f72545fa000 1 -- 172.21.15.6:0/21484081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352d890310 msgr2=0x56352d7e6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.148+0000 7f72545fa000 1 --2- 172.21.15.6:0/21484081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56352d890310 0x56352d7e6980 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f724800b5c0 tx=0x7f7248000bc0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.148+0000 7f724e036700 1 -- 172.21.15.6:0/21484081 reap_dead start 2023-10-06T02:24:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.148+0000 7f72545fa000 1 -- 172.21.15.6:0/21484081 shutdown_connections 2023-10-06T02:24:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.148+0000 7f72545fa000 1 -- 172.21.15.6:0/21484081 >> 172.21.15.6:0/21484081 conn(0x56352d7b95d0 msgr2=0x56352d88e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.149+0000 7f72545fa000 1 -- 172.21.15.6:0/21484081 shutdown_connections 2023-10-06T02:24:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.149+0000 7f72545fa000 1 -- 172.21.15.6:0/21484081 wait complete. 2023-10-06T02:24:58.158 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 500.00000000 2023-10-06T02:24:58.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.233+0000 7fe2d569c000 1 Processor -- start 2023-10-06T02:24:58.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.234+0000 7fe2d569c000 1 -- start start 2023-10-06T02:24:58.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.234+0000 7fe2d569c000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55eec600f710 0x55eec60bc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.234+0000 7fe2d569c000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eec60b12f0 0x55eec60b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.234+0000 7fe2d569c000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eec60b16c0 0x55eec60c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.234+0000 7fe2d569c000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec5f2e980 con 0x55eec60b12f0 2023-10-06T02:24:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.234+0000 7fe2d569c000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec5f2e620 con 0x55eec60b16c0 2023-10-06T02:24:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.234+0000 7fe2d569c000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eec5f25400 con 0x55eec600f710 2023-10-06T02:24:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.234+0000 7fe2ce0d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eec60b12f0 0x55eec60b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.234+0000 7fe2ce0d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eec60b12f0 0x55eec60b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59506/0 (socket says 172.21.15.6:59506) 2023-10-06T02:24:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.234+0000 7fe2ce0d6700 1 -- 172.21.15.6:0/1068061690 learned_addr learned my addr 172.21.15.6:0/1068061690 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.234+0000 7fe2cf0d8700 1 --2- 172.21.15.6:0/1068061690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eec60b16c0 0x55eec60c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.234+0000 7fe2ce8d7700 1 --2- 172.21.15.6:0/1068061690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55eec600f710 0x55eec60bc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2ce0d6700 1 -- 172.21.15.6:0/1068061690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55eec600f710 msgr2=0x55eec60bc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2ce0d6700 1 --2- 172.21.15.6:0/1068061690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55eec600f710 0x55eec60bc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2ce0d6700 1 -- 172.21.15.6:0/1068061690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eec60b16c0 msgr2=0x55eec60c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2ce0d6700 1 --2- 172.21.15.6:0/1068061690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eec60b16c0 0x55eec60c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2ce0d6700 1 -- 172.21.15.6:0/1068061690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b8005db0 con 0x55eec60b12f0 2023-10-06T02:24:58.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2ce0d6700 1 --2- 172.21.15.6:0/1068061690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eec60b12f0 0x55eec60b2060 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800ad70 tx=0x7fe2b8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29e65f5aff8dddf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2cd0d4700 1 -- 172.21.15.6:0/1068061690 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b80055f0 con 0x55eec60b12f0 2023-10-06T02:24:58.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2cd0d4700 1 -- 172.21.15.6:0/1068061690 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b8000bc0 con 0x55eec60b12f0 2023-10-06T02:24:58.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2cd0d4700 1 -- 172.21.15.6:0/1068061690 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8008c20 con 0x55eec60b12f0 2023-10-06T02:24:58.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2d569c000 1 -- 172.21.15.6:0/1068061690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eec60b12f0 msgr2=0x55eec60b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2d569c000 1 --2- 172.21.15.6:0/1068061690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eec60b12f0 0x55eec60b2060 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800ad70 tx=0x7fe2b8016000 comp rx=0 tx=0).stop 2023-10-06T02:24:58.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2d569c000 1 -- 172.21.15.6:0/1068061690 shutdown_connections 2023-10-06T02:24:58.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2d569c000 1 --2- 172.21.15.6:0/1068061690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eec60b16c0 0x55eec60c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2d569c000 1 --2- 172.21.15.6:0/1068061690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55eec600f710 0x55eec60bc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2d569c000 1 --2- 172.21.15.6:0/1068061690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eec60b12f0 0x55eec60b2060 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2d569c000 1 -- 172.21.15.6:0/1068061690 >> 172.21.15.6:0/1068061690 conn(0x55eec5fe45d0 msgr2=0x55eec5fe69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2d569c000 1 -- 172.21.15.6:0/1068061690 shutdown_connections 2023-10-06T02:24:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.235+0000 7fe2d569c000 1 -- 172.21.15.6:0/1068061690 wait complete. 2023-10-06T02:24:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.236+0000 7fe2d569c000 1 Processor -- start 2023-10-06T02:24:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.236+0000 7fe2d569c000 1 -- start start 2023-10-06T02:24:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2d569c000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eec600f710 0x55eec5fe5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2d569c000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eec60b12f0 0x55eec60ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2d569c000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55eec60b16c0 0x55eec60ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2d569c000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec60b9290 con 0x55eec600f710 2023-10-06T02:24:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2d569c000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec60c0150 con 0x55eec60b12f0 2023-10-06T02:24:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2d569c000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eec60bc600 con 0x55eec60b16c0 2023-10-06T02:24:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2ce8d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eec600f710 0x55eec5fe5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2ce8d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eec600f710 0x55eec5fe5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59508/0 (socket says 172.21.15.6:59508) 2023-10-06T02:24:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2ce8d7700 1 -- 172.21.15.6:0/1756957708 learned_addr learned my addr 172.21.15.6:0/1756957708 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2cf0d8700 1 --2- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55eec60b16c0 0x55eec60ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2ce0d6700 1 --2- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eec60b12f0 0x55eec60ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2ce8d7700 1 -- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55eec60b16c0 msgr2=0x55eec60ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2ce8d7700 1 --2- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55eec60b16c0 0x55eec60ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2ce8d7700 1 -- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eec60b12f0 msgr2=0x55eec60ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2ce8d7700 1 --2- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eec60b12f0 0x55eec60ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2ce8d7700 1 -- 172.21.15.6:0/1756957708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eec5f571c0 con 0x55eec600f710 2023-10-06T02:24:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2ce0d6700 1 --2- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eec60b12f0 0x55eec60ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2cf0d8700 1 --2- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55eec60b16c0 0x55eec60ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2ce8d7700 1 --2- 172.21.15.6:0/1756957708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eec600f710 0x55eec5fe5d00 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000e690 tx=0x7fe2c0006b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2c77fe700 1 -- 172.21.15.6:0/1756957708 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0010720 con 0x55eec600f710 2023-10-06T02:24:58.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2c77fe700 1 -- 172.21.15.6:0/1756957708 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c0010880 con 0x55eec600f710 2023-10-06T02:24:58.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.237+0000 7fe2d569c000 1 -- 172.21.15.6:0/1756957708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eec5f3d3d0 con 0x55eec600f710 2023-10-06T02:24:58.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.238+0000 7fe2c77fe700 1 -- 172.21.15.6:0/1756957708 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0010c20 con 0x55eec600f710 2023-10-06T02:24:58.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.238+0000 7fe2d569c000 1 -- 172.21.15.6:0/1756957708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eec5f30ae0 con 0x55eec600f710 2023-10-06T02:24:58.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.239+0000 7fe2c77fe700 1 -- 172.21.15.6:0/1756957708 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2c0018400 con 0x55eec600f710 2023-10-06T02:24:58.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.239+0000 7fe2c77fe700 1 --2- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe2b00658c0 0x7fe2b0067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.239+0000 7fe2c77fe700 1 -- 172.21.15.6:0/1756957708 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fe2c0085b70 con 0x55eec600f710 2023-10-06T02:24:58.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.239+0000 7fe2d569c000 1 --2- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55eec5fe6240 0x55eec60ba5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.239+0000 7fe2d569c000 1 -- 172.21.15.6:0/1756957708 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:1 14.15 14:aa448500:::500.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55eec60b7ed0 con 0x55eec5fe6240 2023-10-06T02:24:58.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.240+0000 7fe2ce0d6700 1 --2- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe2b00658c0 0x7fe2b0067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.240+0000 7fe2cf0d8700 1 --2- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55eec5fe6240 0x55eec60ba5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.240+0000 7fe2ce0d6700 1 --2- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe2b00658c0 0x7fe2b0067d70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800ad70 tx=0x7fe2b801e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.240+0000 7fe2cf0d8700 1 --2- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55eec5fe6240 0x55eec60ba5d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.240+0000 7fe2cf0d8700 1 -- 172.21.15.6:0/1756957708 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(1 500.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x7fe2c8009ae0 con 0x55eec5fe6240 2023-10-06T02:24:58.246 INFO:teuthology.orchestra.run.smithi006.stdout:cephfs_metadata/500.00000000 mtime 2023-10-06T02:24:40.000000+0000, size 90 2023-10-06T02:24:58.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.240+0000 7fe2d569c000 1 -- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55eec5fe6240 msgr2=0x55eec60ba5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.240+0000 7fe2d569c000 1 --2- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55eec5fe6240 0x55eec60ba5d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.241+0000 7fe2d569c000 1 -- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe2b00658c0 msgr2=0x7fe2b0067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.241+0000 7fe2d569c000 1 --2- 172.21.15.6:0/1756957708 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe2b00658c0 0x7fe2b0067d70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800ad70 tx=0x7fe2b801e000 comp rx=0 tx=0).stop 2023-10-06T02:24:58.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.241+0000 7fe2d569c000 1 -- 172.21.15.6:0/1756957708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eec600f710 msgr2=0x55eec5fe5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.241+0000 7fe2d569c000 1 --2- 172.21.15.6:0/1756957708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eec600f710 0x55eec5fe5d00 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000e690 tx=0x7fe2c0006b00 comp rx=0 tx=0).stop 2023-10-06T02:24:58.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.241+0000 7fe2cf0d8700 1 -- 172.21.15.6:0/1756957708 reap_dead start 2023-10-06T02:24:58.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.241+0000 7fe2d569c000 1 -- 172.21.15.6:0/1756957708 shutdown_connections 2023-10-06T02:24:58.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.241+0000 7fe2d569c000 1 -- 172.21.15.6:0/1756957708 >> 172.21.15.6:0/1756957708 conn(0x55eec5fe45d0 msgr2=0x55eec60b63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.241+0000 7fe2d569c000 1 -- 172.21.15.6:0/1756957708 shutdown_connections 2023-10-06T02:24:58.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.241+0000 7fe2d569c000 1 -- 172.21.15.6:0/1756957708 wait complete. 2023-10-06T02:24:58.249 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat mds_snaptable 2023-10-06T02:24:58.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.324+0000 7f012106f000 1 Processor -- start 2023-10-06T02:24:58.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.325+0000 7f012106f000 1 -- start start 2023-10-06T02:24:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.325+0000 7f012106f000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5609660641b0 0x5609660eebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.325+0000 7f012106f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609660f0500 0x5609660e2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.325+0000 7f012106f000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609660f0e10 0x5609660464d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.325+0000 7f012106f000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560965f67980 con 0x5609660641b0 2023-10-06T02:24:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.325+0000 7f012106f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560965f67620 con 0x5609660f0500 2023-10-06T02:24:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.325+0000 7f012106f000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560965f5e400 con 0x5609660f0e10 2023-10-06T02:24:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.325+0000 7f011a2aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5609660641b0 0x5609660eebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.325+0000 7f011a2aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5609660641b0 0x5609660eebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59516/0 (socket says 172.21.15.6:59516) 2023-10-06T02:24:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.325+0000 7f011a2aa700 1 -- 172.21.15.6:0/3215022791 learned_addr learned my addr 172.21.15.6:0/3215022791 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.325+0000 7f0119aa9700 1 --2- 172.21.15.6:0/3215022791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609660f0500 0x5609660e2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f011aaab700 1 --2- 172.21.15.6:0/3215022791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609660f0e10 0x5609660464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f011a2aa700 1 -- 172.21.15.6:0/3215022791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609660f0e10 msgr2=0x5609660464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f011a2aa700 1 --2- 172.21.15.6:0/3215022791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609660f0e10 0x5609660464d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f011a2aa700 1 -- 172.21.15.6:0/3215022791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609660f0500 msgr2=0x5609660e2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f011a2aa700 1 --2- 172.21.15.6:0/3215022791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609660f0500 0x5609660e2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f011a2aa700 1 -- 172.21.15.6:0/3215022791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0104005cf0 con 0x5609660641b0 2023-10-06T02:24:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f011aaab700 1 --2- 172.21.15.6:0/3215022791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609660f0e10 0x5609660464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f011a2aa700 1 --2- 172.21.15.6:0/3215022791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5609660641b0 0x5609660eebe0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f0114009950 tx=0x7f011400c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296344e342f2c05e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f0118aa7700 1 -- 172.21.15.6:0/3215022791 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011400f040 con 0x5609660641b0 2023-10-06T02:24:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f0118aa7700 1 -- 172.21.15.6:0/3215022791 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0114008a10 con 0x5609660641b0 2023-10-06T02:24:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f0118aa7700 1 -- 172.21.15.6:0/3215022791 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0114008db0 con 0x5609660641b0 2023-10-06T02:24:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f012106f000 1 -- 172.21.15.6:0/3215022791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5609660641b0 msgr2=0x5609660eebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f012106f000 1 --2- 172.21.15.6:0/3215022791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5609660641b0 0x5609660eebe0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f0114009950 tx=0x7f011400c040 comp rx=0 tx=0).stop 2023-10-06T02:24:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f012106f000 1 -- 172.21.15.6:0/3215022791 shutdown_connections 2023-10-06T02:24:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f012106f000 1 --2- 172.21.15.6:0/3215022791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609660f0e10 0x5609660464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f012106f000 1 --2- 172.21.15.6:0/3215022791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5609660641b0 0x5609660eebe0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f012106f000 1 --2- 172.21.15.6:0/3215022791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609660f0500 0x5609660e2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.326+0000 7f012106f000 1 -- 172.21.15.6:0/3215022791 >> 172.21.15.6:0/3215022791 conn(0x56096601cd50 msgr2=0x560966046f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.327+0000 7f012106f000 1 -- 172.21.15.6:0/3215022791 shutdown_connections 2023-10-06T02:24:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.327+0000 7f012106f000 1 -- 172.21.15.6:0/3215022791 wait complete. 2023-10-06T02:24:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.327+0000 7f012106f000 1 Processor -- start 2023-10-06T02:24:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.327+0000 7f012106f000 1 -- start start 2023-10-06T02:24:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.328+0000 7f012106f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609660641b0 0x5609660d8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.328+0000 7f012106f000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5609660f0500 0x560966063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.328+0000 7f012106f000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609660f0e10 0x5609660639b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.328+0000 7f012106f000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609660e64a0 con 0x5609660f0500 2023-10-06T02:24:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.328+0000 7f012106f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609660e6740 con 0x5609660641b0 2023-10-06T02:24:58.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.328+0000 7f012106f000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56096605d2f0 con 0x5609660f0e10 2023-10-06T02:24:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.328+0000 7f0119aa9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5609660f0500 0x560966063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.328+0000 7f0119aa9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5609660f0500 0x560966063470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59518/0 (socket says 172.21.15.6:59518) 2023-10-06T02:24:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.328+0000 7f0119aa9700 1 -- 172.21.15.6:0/3941724888 learned_addr learned my addr 172.21.15.6:0/3941724888 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.328+0000 7f011a2aa700 1 --2- 172.21.15.6:0/3941724888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609660641b0 0x5609660d8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.328+0000 7f011aaab700 1 --2- 172.21.15.6:0/3941724888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609660f0e10 0x5609660639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.328+0000 7f0119aa9700 1 -- 172.21.15.6:0/3941724888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609660f0e10 msgr2=0x5609660639b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.328+0000 7f0119aa9700 1 --2- 172.21.15.6:0/3941724888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609660f0e10 0x5609660639b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.328+0000 7f0119aa9700 1 -- 172.21.15.6:0/3941724888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609660641b0 msgr2=0x5609660d8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.328+0000 7f0119aa9700 1 --2- 172.21.15.6:0/3941724888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609660641b0 0x5609660d8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.328+0000 7f0119aa9700 1 -- 172.21.15.6:0/3941724888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0114009580 con 0x5609660f0500 2023-10-06T02:24:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.328+0000 7f0119aa9700 1 --2- 172.21.15.6:0/3941724888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5609660f0500 0x560966063470 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f0104012000 tx=0x7f0104016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.329+0000 7f0112ffd700 1 -- 172.21.15.6:0/3941724888 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104002f70 con 0x5609660f0500 2023-10-06T02:24:58.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.329+0000 7f0112ffd700 1 -- 172.21.15.6:0/3941724888 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01040054f0 con 0x5609660f0500 2023-10-06T02:24:58.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.329+0000 7f012106f000 1 -- 172.21.15.6:0/3941724888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560965f763d0 con 0x5609660f0500 2023-10-06T02:24:58.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.329+0000 7f0112ffd700 1 -- 172.21.15.6:0/3941724888 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104008b80 con 0x5609660f0500 2023-10-06T02:24:58.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.329+0000 7f012106f000 1 -- 172.21.15.6:0/3941724888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560965f69ae0 con 0x5609660f0500 2023-10-06T02:24:58.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.330+0000 7f0112ffd700 1 -- 172.21.15.6:0/3941724888 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0104012620 con 0x5609660f0500 2023-10-06T02:24:58.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.330+0000 7f0112ffd700 1 --2- 172.21.15.6:0/3941724888 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f00fc065890 0x7f00fc067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.330+0000 7f0112ffd700 1 -- 172.21.15.6:0/3941724888 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f01040859d0 con 0x5609660f0500 2023-10-06T02:24:58.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.331+0000 7f012106f000 1 --2- 172.21.15.6:0/3941724888 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5609660e5a30 0x5609660e4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.331+0000 7f011a2aa700 1 --2- 172.21.15.6:0/3941724888 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f00fc065890 0x7f00fc067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.331+0000 7f012106f000 1 -- 172.21.15.6:0/3941724888 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:1 14.d 14:b50e409b:::mds_snaptable:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x5609660d89b0 con 0x5609660e5a30 2023-10-06T02:24:58.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.331+0000 7f011aaab700 1 --2- 172.21.15.6:0/3941724888 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5609660e5a30 0x5609660e4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.331+0000 7f011a2aa700 1 --2- 172.21.15.6:0/3941724888 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f00fc065890 0x7f00fc067d40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0114009950 tx=0x7f0114018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.331+0000 7f011aaab700 1 --2- 172.21.15.6:0/3941724888 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5609660e5a30 0x5609660e4a60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.331+0000 7f011aaab700 1 -- 172.21.15.6:0/3941724888 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(1 mds_snaptable [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+16 (crc 0 0 0) 0x7f010c004630 con 0x5609660e5a30 2023-10-06T02:24:58.337 INFO:teuthology.orchestra.run.smithi006.stdout:cephfs_metadata/mds_snaptable mtime 2023-10-06T02:24:40.000000+0000, size 70 2023-10-06T02:24:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.332+0000 7f012106f000 1 -- 172.21.15.6:0/3941724888 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5609660e5a30 msgr2=0x5609660e4a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.332+0000 7f012106f000 1 --2- 172.21.15.6:0/3941724888 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5609660e5a30 0x5609660e4a60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.332+0000 7f012106f000 1 -- 172.21.15.6:0/3941724888 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f00fc065890 msgr2=0x7f00fc067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.332+0000 7f012106f000 1 --2- 172.21.15.6:0/3941724888 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f00fc065890 0x7f00fc067d40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0114009950 tx=0x7f0114018000 comp rx=0 tx=0).stop 2023-10-06T02:24:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.332+0000 7f012106f000 1 -- 172.21.15.6:0/3941724888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5609660f0500 msgr2=0x560966063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.332+0000 7f012106f000 1 --2- 172.21.15.6:0/3941724888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5609660f0500 0x560966063470 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f0104012000 tx=0x7f0104016000 comp rx=0 tx=0).stop 2023-10-06T02:24:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.332+0000 7f011aaab700 1 -- 172.21.15.6:0/3941724888 reap_dead start 2023-10-06T02:24:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.332+0000 7f012106f000 1 -- 172.21.15.6:0/3941724888 shutdown_connections 2023-10-06T02:24:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.332+0000 7f012106f000 1 -- 172.21.15.6:0/3941724888 >> 172.21.15.6:0/3941724888 conn(0x56096601cd50 msgr2=0x56096601d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.332+0000 7f012106f000 1 -- 172.21.15.6:0/3941724888 shutdown_connections 2023-10-06T02:24:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.332+0000 7f012106f000 1 -- 172.21.15.6:0/3941724888 wait complete. 2023-10-06T02:24:58.340 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat mds0_inotable 2023-10-06T02:24:58.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.415+0000 7f564be1e000 1 Processor -- start 2023-10-06T02:24:58.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.416+0000 7f564be1e000 1 -- start start 2023-10-06T02:24:58.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.416+0000 7f564be1e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb7c04ddd0 0x55cb7c0671c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.416+0000 7f564be1e000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cb7c0d63b0 0x55cb7c0f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.416+0000 7f564be1e000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb7c0f49b0 0x55cb7c0ed2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.416+0000 7f564be1e000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb7bfc5320 con 0x55cb7c0f49b0 2023-10-06T02:24:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.416+0000 7f564be1e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb7bf69980 con 0x55cb7c04ddd0 2023-10-06T02:24:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.416+0000 7f564be1e000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb7bf69620 con 0x55cb7c0d63b0 2023-10-06T02:24:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.416+0000 7f564585a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb7c0f49b0 0x55cb7c0ed2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.416+0000 7f564585a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb7c0f49b0 0x55cb7c0ed2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59524/0 (socket says 172.21.15.6:59524) 2023-10-06T02:24:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.416+0000 7f564585a700 1 -- 172.21.15.6:0/3036055485 learned_addr learned my addr 172.21.15.6:0/3036055485 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.416+0000 7f5644858700 1 --2- 172.21.15.6:0/3036055485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cb7c0d63b0 0x55cb7c0f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.416+0000 7f5645059700 1 --2- 172.21.15.6:0/3036055485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb7c04ddd0 0x55cb7c0671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.417+0000 7f564585a700 1 -- 172.21.15.6:0/3036055485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cb7c0d63b0 msgr2=0x55cb7c0f42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.417+0000 7f564585a700 1 --2- 172.21.15.6:0/3036055485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cb7c0d63b0 0x55cb7c0f42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.417+0000 7f564585a700 1 -- 172.21.15.6:0/3036055485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb7c04ddd0 msgr2=0x55cb7c0671c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.417+0000 7f564585a700 1 --2- 172.21.15.6:0/3036055485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb7c04ddd0 0x55cb7c0671c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.417+0000 7f564585a700 1 -- 172.21.15.6:0/3036055485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563800a0e0 con 0x55cb7c0f49b0 2023-10-06T02:24:58.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.417+0000 7f564585a700 1 --2- 172.21.15.6:0/3036055485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb7c0f49b0 0x55cb7c0ed2f0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f5640001c70 tx=0x7f5640001750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4276301b30c90393 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.417+0000 7f56377fe700 1 -- 172.21.15.6:0/3036055485 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564000bbb0 con 0x55cb7c0f49b0 2023-10-06T02:24:58.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.417+0000 7f56377fe700 1 -- 172.21.15.6:0/3036055485 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564000bd10 con 0x55cb7c0f49b0 2023-10-06T02:24:58.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.417+0000 7f56377fe700 1 -- 172.21.15.6:0/3036055485 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564000e680 con 0x55cb7c0f49b0 2023-10-06T02:24:58.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.417+0000 7f564be1e000 1 -- 172.21.15.6:0/3036055485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb7c0f49b0 msgr2=0x55cb7c0ed2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.417+0000 7f564be1e000 1 --2- 172.21.15.6:0/3036055485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb7c0f49b0 0x55cb7c0ed2f0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f5640001c70 tx=0x7f5640001750 comp rx=0 tx=0).stop 2023-10-06T02:24:58.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.417+0000 7f564be1e000 1 -- 172.21.15.6:0/3036055485 shutdown_connections 2023-10-06T02:24:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.417+0000 7f564be1e000 1 --2- 172.21.15.6:0/3036055485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb7c0f49b0 0x55cb7c0ed2f0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.417+0000 7f564be1e000 1 --2- 172.21.15.6:0/3036055485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb7c04ddd0 0x55cb7c0671c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.417+0000 7f564be1e000 1 --2- 172.21.15.6:0/3036055485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cb7c0d63b0 0x55cb7c0f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.417+0000 7f564be1e000 1 -- 172.21.15.6:0/3036055485 >> 172.21.15.6:0/3036055485 conn(0x55cb7c01ed50 msgr2=0x55cb7c020970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.418+0000 7f564be1e000 1 -- 172.21.15.6:0/3036055485 shutdown_connections 2023-10-06T02:24:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.418+0000 7f564be1e000 1 -- 172.21.15.6:0/3036055485 wait complete. 2023-10-06T02:24:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.418+0000 7f564be1e000 1 Processor -- start 2023-10-06T02:24:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.418+0000 7f564be1e000 1 -- start start 2023-10-06T02:24:58.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.419+0000 7f564be1e000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb7c04ddd0 0x55cb7c0ef850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.419+0000 7f564be1e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb7c0d63b0 0x55cb7c0ea660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.419+0000 7f564be1e000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cb7c0f49b0 0x55cb7c0eaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.419+0000 7f564be1e000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb7bf60400 con 0x55cb7c04ddd0 2023-10-06T02:24:58.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.419+0000 7f564be1e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb7c062810 con 0x55cb7c0d63b0 2023-10-06T02:24:58.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.419+0000 7f564be1e000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb7c062ab0 con 0x55cb7c0f49b0 2023-10-06T02:24:58.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.419+0000 7f5645059700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb7c04ddd0 0x55cb7c0ef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.419+0000 7f5645059700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb7c04ddd0 0x55cb7c0ef850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59534/0 (socket says 172.21.15.6:59534) 2023-10-06T02:24:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.419+0000 7f5645059700 1 -- 172.21.15.6:0/4081465099 learned_addr learned my addr 172.21.15.6:0/4081465099 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.419+0000 7f564585a700 1 --2- 172.21.15.6:0/4081465099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cb7c0f49b0 0x55cb7c0eaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.419+0000 7f5644858700 1 --2- 172.21.15.6:0/4081465099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb7c0d63b0 0x55cb7c0ea660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.419+0000 7f5645059700 1 -- 172.21.15.6:0/4081465099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cb7c0f49b0 msgr2=0x55cb7c0eaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.419+0000 7f5645059700 1 --2- 172.21.15.6:0/4081465099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cb7c0f49b0 0x55cb7c0eaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.419+0000 7f5645059700 1 -- 172.21.15.6:0/4081465099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb7c0d63b0 msgr2=0x55cb7c0ea660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.419+0000 7f5645059700 1 --2- 172.21.15.6:0/4081465099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cb7c0d63b0 0x55cb7c0ea660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.419+0000 7f5645059700 1 -- 172.21.15.6:0/4081465099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5630001e10 con 0x55cb7c04ddd0 2023-10-06T02:24:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.419+0000 7f5645059700 1 --2- 172.21.15.6:0/4081465099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb7c04ddd0 0x55cb7c0ef850 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f5638005d80 tx=0x7f5638015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.420+0000 7f5635ffb700 1 -- 172.21.15.6:0/4081465099 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638000f40 con 0x55cb7c04ddd0 2023-10-06T02:24:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.420+0000 7f5635ffb700 1 -- 172.21.15.6:0/4081465099 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563800f860 con 0x55cb7c04ddd0 2023-10-06T02:24:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.420+0000 7f5635ffb700 1 -- 172.21.15.6:0/4081465099 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56380010a0 con 0x55cb7c04ddd0 2023-10-06T02:24:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.420+0000 7f564be1e000 1 -- 172.21.15.6:0/4081465099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cb7bf6bae0 con 0x55cb7c04ddd0 2023-10-06T02:24:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.420+0000 7f564be1e000 1 -- 172.21.15.6:0/4081465099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb7bf6b540 con 0x55cb7c04ddd0 2023-10-06T02:24:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.421+0000 7f5635ffb700 1 -- 172.21.15.6:0/4081465099 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5638003040 con 0x55cb7c04ddd0 2023-10-06T02:24:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.421+0000 7f5635ffb700 1 --2- 172.21.15.6:0/4081465099 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5628065890 0x7f5628067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.421+0000 7f5635ffb700 1 -- 172.21.15.6:0/4081465099 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f5638085400 con 0x55cb7c04ddd0 2023-10-06T02:24:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.421+0000 7f5644858700 1 --2- 172.21.15.6:0/4081465099 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5628065890 0x7f5628067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.422+0000 7f564be1e000 1 --2- 172.21.15.6:0/4081465099 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55cb7c061860 0x55cb7c061c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.422+0000 7f564be1e000 1 -- 172.21.15.6:0/4081465099 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55cb7c063490 con 0x55cb7c061860 2023-10-06T02:24:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.422+0000 7f564585a700 1 --2- 172.21.15.6:0/4081465099 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55cb7c061860 0x55cb7c061c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.422+0000 7f5644858700 1 --2- 172.21.15.6:0/4081465099 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5628065890 0x7f5628067d40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f563c003c70 tx=0x7f563c000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.422+0000 7f564585a700 1 --2- 172.21.15.6:0/4081465099 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55cb7c061860 0x55cb7c061c60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.422+0000 7f564585a700 1 -- 172.21.15.6:0/4081465099 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(1 mds0_inotable [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+16 (crc 0 0 0) 0x7f5640014070 con 0x55cb7c061860 2023-10-06T02:24:58.428 INFO:teuthology.orchestra.run.smithi006.stdout:cephfs_metadata/mds0_inotable mtime 2023-10-06T02:24:54.000000+0000, size 34 2023-10-06T02:24:58.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.422+0000 7f564be1e000 1 -- 172.21.15.6:0/4081465099 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55cb7c061860 msgr2=0x55cb7c061c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.422+0000 7f564be1e000 1 --2- 172.21.15.6:0/4081465099 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55cb7c061860 0x55cb7c061c60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.423+0000 7f564be1e000 1 -- 172.21.15.6:0/4081465099 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5628065890 msgr2=0x7f5628067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.423+0000 7f564be1e000 1 --2- 172.21.15.6:0/4081465099 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5628065890 0x7f5628067d40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f563c003c70 tx=0x7f563c000bc0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.423+0000 7f564be1e000 1 -- 172.21.15.6:0/4081465099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb7c04ddd0 msgr2=0x55cb7c0ef850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.423+0000 7f564be1e000 1 --2- 172.21.15.6:0/4081465099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb7c04ddd0 0x55cb7c0ef850 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f5638005d80 tx=0x7f5638015000 comp rx=0 tx=0).stop 2023-10-06T02:24:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.423+0000 7f564585a700 1 -- 172.21.15.6:0/4081465099 reap_dead start 2023-10-06T02:24:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.423+0000 7f564be1e000 1 -- 172.21.15.6:0/4081465099 shutdown_connections 2023-10-06T02:24:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.423+0000 7f564be1e000 1 -- 172.21.15.6:0/4081465099 >> 172.21.15.6:0/4081465099 conn(0x55cb7c01ed50 msgr2=0x55cb7c01f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.423+0000 7f564be1e000 1 -- 172.21.15.6:0/4081465099 shutdown_connections 2023-10-06T02:24:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.423+0000 7f564be1e000 1 -- 172.21.15.6:0/4081465099 wait complete. 2023-10-06T02:24:58.430 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 100.00000000 2023-10-06T02:24:58.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.505+0000 7ff1e151e000 1 Processor -- start 2023-10-06T02:24:58.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.505+0000 7ff1e151e000 1 -- start start 2023-10-06T02:24:58.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1e151e000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556e15533680 0x556e155500c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1e151e000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e15535ab0 0x556e155e8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1e151e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e15535e80 0x556e155e86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1e151e000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e15451980 con 0x556e15535ab0 2023-10-06T02:24:58.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1e151e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e15451620 con 0x556e15535e80 2023-10-06T02:24:58.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1e151e000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e15448400 con 0x556e15533680 2023-10-06T02:24:58.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1d9f58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e15535ab0 0x556e155e8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1d9f58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e15535ab0 0x556e155e8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59552/0 (socket says 172.21.15.6:59552) 2023-10-06T02:24:58.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1d9f58700 1 -- 172.21.15.6:0/3297058370 learned_addr learned my addr 172.21.15.6:0/3297058370 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1da759700 1 --2- 172.21.15.6:0/3297058370 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556e15533680 0x556e155500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1daf5a700 1 --2- 172.21.15.6:0/3297058370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e15535e80 0x556e155e86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1d9f58700 1 -- 172.21.15.6:0/3297058370 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556e15533680 msgr2=0x556e155500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1d9f58700 1 --2- 172.21.15.6:0/3297058370 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556e15533680 0x556e155500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1d9f58700 1 -- 172.21.15.6:0/3297058370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e15535e80 msgr2=0x556e155e86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1d9f58700 1 --2- 172.21.15.6:0/3297058370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e15535e80 0x556e155e86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1d9f58700 1 -- 172.21.15.6:0/3297058370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc00a180 con 0x556e15535ab0 2023-10-06T02:24:58.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1da759700 1 --2- 172.21.15.6:0/3297058370 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556e15533680 0x556e155500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:58.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.506+0000 7ff1daf5a700 1 --2- 172.21.15.6:0/3297058370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e15535e80 0x556e155e86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:58.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.507+0000 7ff1d9f58700 1 --2- 172.21.15.6:0/3297058370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e15535ab0 0x556e155e8160 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00095e0 tx=0x7ff1d0005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c616b95ce5f5c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.507+0000 7ff1d8f56700 1 -- 172.21.15.6:0/3297058370 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d000e070 con 0x556e15535ab0 2023-10-06T02:24:58.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.507+0000 7ff1d8f56700 1 -- 172.21.15.6:0/3297058370 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d0012410 con 0x556e15535ab0 2023-10-06T02:24:58.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.507+0000 7ff1d8f56700 1 -- 172.21.15.6:0/3297058370 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d00127d0 con 0x556e15535ab0 2023-10-06T02:24:58.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.507+0000 7ff1e151e000 1 -- 172.21.15.6:0/3297058370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e15535ab0 msgr2=0x556e155e8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.507+0000 7ff1e151e000 1 --2- 172.21.15.6:0/3297058370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e15535ab0 0x556e155e8160 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00095e0 tx=0x7ff1d0005b00 comp rx=0 tx=0).stop 2023-10-06T02:24:58.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.507+0000 7ff1e151e000 1 -- 172.21.15.6:0/3297058370 shutdown_connections 2023-10-06T02:24:58.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.507+0000 7ff1e151e000 1 --2- 172.21.15.6:0/3297058370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e15535e80 0x556e155e86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.507+0000 7ff1e151e000 1 --2- 172.21.15.6:0/3297058370 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556e15533680 0x556e155500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.507+0000 7ff1e151e000 1 --2- 172.21.15.6:0/3297058370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e15535ab0 0x556e155e8160 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.507+0000 7ff1e151e000 1 -- 172.21.15.6:0/3297058370 >> 172.21.15.6:0/3297058370 conn(0x556e1554dbd0 msgr2=0x556e155082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.507+0000 7ff1e151e000 1 -- 172.21.15.6:0/3297058370 shutdown_connections 2023-10-06T02:24:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.507+0000 7ff1e151e000 1 -- 172.21.15.6:0/3297058370 wait complete. 2023-10-06T02:24:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.508+0000 7ff1e151e000 1 Processor -- start 2023-10-06T02:24:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.508+0000 7ff1e151e000 1 -- start start 2023-10-06T02:24:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1e151e000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e15533680 0x556e155de040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1e151e000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556e15535ab0 0x556e155cd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1e151e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e15535e80 0x556e15504390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1e151e000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e155dc7c0 con 0x556e15533680 2023-10-06T02:24:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1e151e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e155dca60 con 0x556e15535e80 2023-10-06T02:24:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1e151e000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e155dcd00 con 0x556e15535ab0 2023-10-06T02:24:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1da759700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e15533680 0x556e155de040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1da759700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e15533680 0x556e155de040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59564/0 (socket says 172.21.15.6:59564) 2023-10-06T02:24:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1da759700 1 -- 172.21.15.6:0/3539101443 learned_addr learned my addr 172.21.15.6:0/3539101443 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1daf5a700 1 --2- 172.21.15.6:0/3539101443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e15535e80 0x556e15504390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1d9f58700 1 --2- 172.21.15.6:0/3539101443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556e15535ab0 0x556e155cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1da759700 1 -- 172.21.15.6:0/3539101443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556e15535ab0 msgr2=0x556e155cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1da759700 1 --2- 172.21.15.6:0/3539101443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556e15535ab0 0x556e155cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1da759700 1 -- 172.21.15.6:0/3539101443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e15535e80 msgr2=0x556e15504390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1da759700 1 --2- 172.21.15.6:0/3539101443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e15535e80 0x556e15504390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1da759700 1 -- 172.21.15.6:0/3539101443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d0005da0 con 0x556e15533680 2023-10-06T02:24:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1da759700 1 --2- 172.21.15.6:0/3539101443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e15533680 0x556e155de040 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc003000 tx=0x7ff1cc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1caffd700 1 -- 172.21.15.6:0/3539101443 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc000f40 con 0x556e15533680 2023-10-06T02:24:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1caffd700 1 -- 172.21.15.6:0/3539101443 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1cc00e7e0 con 0x556e15533680 2023-10-06T02:24:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1caffd700 1 -- 172.21.15.6:0/3539101443 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc0010a0 con 0x556e15533680 2023-10-06T02:24:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1e151e000 1 -- 172.21.15.6:0/3539101443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556e154603d0 con 0x556e15533680 2023-10-06T02:24:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.509+0000 7ff1e151e000 1 -- 172.21.15.6:0/3539101443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e15453ae0 con 0x556e15533680 2023-10-06T02:24:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.511+0000 7ff1caffd700 1 -- 172.21.15.6:0/3539101443 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1cc017070 con 0x556e15533680 2023-10-06T02:24:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.511+0000 7ff1caffd700 1 --2- 172.21.15.6:0/3539101443 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff1bc0658c0 0x7ff1bc067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.511+0000 7ff1caffd700 1 -- 172.21.15.6:0/3539101443 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff1cc0851d0 con 0x556e15533680 2023-10-06T02:24:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.511+0000 7ff1d9f58700 1 --2- 172.21.15.6:0/3539101443 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff1bc0658c0 0x7ff1bc067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.511+0000 7ff1e151e000 1 --2- 172.21.15.6:0/3539101443 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x556e15531440 0x556e15531810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.511+0000 7ff1e151e000 1 -- 172.21.15.6:0/3539101443 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:1 14.13 14:cd5a64a3:::100.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x556e155d0380 con 0x556e15531440 2023-10-06T02:24:58.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.511+0000 7ff1daf5a700 1 --2- 172.21.15.6:0/3539101443 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x556e15531440 0x556e15531810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.512+0000 7ff1d9f58700 1 --2- 172.21.15.6:0/3539101443 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff1bc0658c0 0x7ff1bc067d70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009fd0 tx=0x7ff1d0014000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.512+0000 7ff1daf5a700 1 --2- 172.21.15.6:0/3539101443 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x556e15531440 0x556e15531810 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.512+0000 7ff1daf5a700 1 -- 172.21.15.6:0/3539101443 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(1 100.00000000 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x7ff1d400f620 con 0x556e15531440 2023-10-06T02:24:58.518 INFO:teuthology.orchestra.run.smithi006.stdout:cephfs_metadata/100.00000000 mtime 2023-10-06T02:24:40.000000+0000, size 0 2023-10-06T02:24:58.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.512+0000 7ff1e151e000 1 -- 172.21.15.6:0/3539101443 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x556e15531440 msgr2=0x556e15531810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.512+0000 7ff1e151e000 1 --2- 172.21.15.6:0/3539101443 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x556e15531440 0x556e15531810 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.512+0000 7ff1e151e000 1 -- 172.21.15.6:0/3539101443 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff1bc0658c0 msgr2=0x7ff1bc067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.512+0000 7ff1e151e000 1 --2- 172.21.15.6:0/3539101443 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff1bc0658c0 0x7ff1bc067d70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009fd0 tx=0x7ff1d0014000 comp rx=0 tx=0).stop 2023-10-06T02:24:58.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.512+0000 7ff1e151e000 1 -- 172.21.15.6:0/3539101443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e15533680 msgr2=0x556e155de040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.512+0000 7ff1e151e000 1 --2- 172.21.15.6:0/3539101443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e15533680 0x556e155de040 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc003000 tx=0x7ff1cc013000 comp rx=0 tx=0).stop 2023-10-06T02:24:58.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.512+0000 7ff1daf5a700 1 -- 172.21.15.6:0/3539101443 reap_dead start 2023-10-06T02:24:58.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.512+0000 7ff1e151e000 1 -- 172.21.15.6:0/3539101443 shutdown_connections 2023-10-06T02:24:58.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.512+0000 7ff1e151e000 1 -- 172.21.15.6:0/3539101443 >> 172.21.15.6:0/3539101443 conn(0x556e1554dbd0 msgr2=0x556e155082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.512+0000 7ff1e151e000 1 -- 172.21.15.6:0/3539101443 shutdown_connections 2023-10-06T02:24:58.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.512+0000 7ff1e151e000 1 -- 172.21.15.6:0/3539101443 wait complete. 2023-10-06T02:24:58.521 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat mds0_sessionmap 2023-10-06T02:24:58.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.597+0000 7f7ba4a45000 1 Processor -- start 2023-10-06T02:24:58.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.597+0000 7f7ba4a45000 1 -- start start 2023-10-06T02:24:58.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7ba4a45000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6e9de56f0 0x55c6e9de68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7ba4a45000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e9d42340 0x55c6e9de6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7ba4a45000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6e9de4690 0x55c6e9de7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7ba4a45000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6e9c5f980 con 0x55c6e9de56f0 2023-10-06T02:24:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7ba4a45000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6e9c5f620 con 0x55c6e9d42340 2023-10-06T02:24:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7ba4a45000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c6e9c56400 con 0x55c6e9de4690 2023-10-06T02:24:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7b9dc80700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6e9de56f0 0x55c6e9de68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7b9dc80700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6e9de56f0 0x55c6e9de68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59582/0 (socket says 172.21.15.6:59582) 2023-10-06T02:24:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7b9dc80700 1 -- 172.21.15.6:0/3871440642 learned_addr learned my addr 172.21.15.6:0/3871440642 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7b9dc80700 1 -- 172.21.15.6:0/3871440642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6e9de4690 msgr2=0x55c6e9de7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7b9dc80700 1 --2- 172.21.15.6:0/3871440642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6e9de4690 0x55c6e9de7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7b9dc80700 1 -- 172.21.15.6:0/3871440642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e9d42340 msgr2=0x55c6e9de6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7b9dc80700 1 --2- 172.21.15.6:0/3871440642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e9d42340 0x55c6e9de6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7b9dc80700 1 -- 172.21.15.6:0/3871440642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6e9c6e3d0 con 0x55c6e9de56f0 2023-10-06T02:24:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7b9dc80700 1 --2- 172.21.15.6:0/3871440642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6e9de56f0 0x55c6e9de68f0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000b5d0 tx=0x7f7b90016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de68188b8eaa3118 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7b9cc7e700 1 -- 172.21.15.6:0/3871440642 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b90001960 con 0x55c6e9de56f0 2023-10-06T02:24:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7b9cc7e700 1 -- 172.21.15.6:0/3871440642 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9000bab0 con 0x55c6e9de56f0 2023-10-06T02:24:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.598+0000 7f7b9cc7e700 1 -- 172.21.15.6:0/3871440642 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9000be60 con 0x55c6e9de56f0 2023-10-06T02:24:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.599+0000 7f7ba4a45000 1 -- 172.21.15.6:0/3871440642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6e9de56f0 msgr2=0x55c6e9de68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.599+0000 7f7ba4a45000 1 --2- 172.21.15.6:0/3871440642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6e9de56f0 0x55c6e9de68f0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000b5d0 tx=0x7f7b90016000 comp rx=0 tx=0).stop 2023-10-06T02:24:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.599+0000 7f7ba4a45000 1 -- 172.21.15.6:0/3871440642 shutdown_connections 2023-10-06T02:24:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.599+0000 7f7ba4a45000 1 --2- 172.21.15.6:0/3871440642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6e9de4690 0x55c6e9de7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.599+0000 7f7ba4a45000 1 --2- 172.21.15.6:0/3871440642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6e9de56f0 0x55c6e9de68f0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.599+0000 7f7ba4a45000 1 --2- 172.21.15.6:0/3871440642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e9d42340 0x55c6e9de6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.599+0000 7f7ba4a45000 1 -- 172.21.15.6:0/3871440642 >> 172.21.15.6:0/3871440642 conn(0x55c6e9d5bbd0 msgr2=0x55c6e9d5bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.599+0000 7f7ba4a45000 1 -- 172.21.15.6:0/3871440642 shutdown_connections 2023-10-06T02:24:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.599+0000 7f7ba4a45000 1 -- 172.21.15.6:0/3871440642 wait complete. 2023-10-06T02:24:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.600+0000 7f7ba4a45000 1 Processor -- start 2023-10-06T02:24:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.600+0000 7f7ba4a45000 1 -- start start 2023-10-06T02:24:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.600+0000 7f7ba4a45000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e9d42340 0x55c6e9d57640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.600+0000 7f7ba4a45000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6e9de4690 0x55c6e9de2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.600+0000 7f7ba4a45000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6e9de56f0 0x55c6e9de5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.600+0000 7f7ba4a45000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6e9d59ee0 con 0x55c6e9de56f0 2023-10-06T02:24:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.600+0000 7f7ba4a45000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6e9de87a0 con 0x55c6e9d42340 2023-10-06T02:24:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.600+0000 7f7ba4a45000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c6e9de3a20 con 0x55c6e9de4690 2023-10-06T02:24:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.600+0000 7f7b9e481700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6e9de56f0 0x55c6e9de5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.600+0000 7f7b9e481700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6e9de56f0 0x55c6e9de5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59588/0 (socket says 172.21.15.6:59588) 2023-10-06T02:24:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.600+0000 7f7b9e481700 1 -- 172.21.15.6:0/1219064485 learned_addr learned my addr 172.21.15.6:0/1219064485 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.601+0000 7f7b97fff700 1 --2- 172.21.15.6:0/1219064485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6e9de4690 0x55c6e9de2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.601+0000 7f7b9dc80700 1 --2- 172.21.15.6:0/1219064485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e9d42340 0x55c6e9d57640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.601+0000 7f7b9e481700 1 -- 172.21.15.6:0/1219064485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6e9de4690 msgr2=0x55c6e9de2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.601+0000 7f7b9e481700 1 --2- 172.21.15.6:0/1219064485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6e9de4690 0x55c6e9de2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.601+0000 7f7b9e481700 1 -- 172.21.15.6:0/1219064485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e9d42340 msgr2=0x55c6e9d57640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.601+0000 7f7b9e481700 1 --2- 172.21.15.6:0/1219064485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e9d42340 0x55c6e9d57640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.601+0000 7f7b9e481700 1 -- 172.21.15.6:0/1219064485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c001e10 con 0x55c6e9de56f0 2023-10-06T02:24:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.601+0000 7f7b9dc80700 1 --2- 172.21.15.6:0/1219064485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e9d42340 0x55c6e9d57640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.601+0000 7f7b9e481700 1 --2- 172.21.15.6:0/1219064485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6e9de56f0 0x55c6e9de5ac0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x55c6e9d3fdc0 tx=0x7f7b98007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.601+0000 7f7b967fc700 1 -- 172.21.15.6:0/1219064485 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9800fee0 con 0x55c6e9de56f0 2023-10-06T02:24:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.601+0000 7f7b967fc700 1 -- 172.21.15.6:0/1219064485 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b98013640 con 0x55c6e9de56f0 2023-10-06T02:24:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.601+0000 7f7b967fc700 1 -- 172.21.15.6:0/1219064485 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b98013a00 con 0x55c6e9de56f0 2023-10-06T02:24:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.601+0000 7f7ba4a45000 1 -- 172.21.15.6:0/1219064485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c6e9c61ae0 con 0x55c6e9de56f0 2023-10-06T02:24:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.601+0000 7f7ba4a45000 1 -- 172.21.15.6:0/1219064485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c6e9c61540 con 0x55c6e9de56f0 2023-10-06T02:24:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.602+0000 7f7b967fc700 1 -- 172.21.15.6:0/1219064485 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b98003040 con 0x55c6e9de56f0 2023-10-06T02:24:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.603+0000 7f7b967fc700 1 --2- 172.21.15.6:0/1219064485 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7b800658c0 0x7f7b80067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.603+0000 7f7b967fc700 1 -- 172.21.15.6:0/1219064485 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7b98083420 con 0x55c6e9de56f0 2023-10-06T02:24:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.603+0000 7f7b9dc80700 1 --2- 172.21.15.6:0/1219064485 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7b800658c0 0x7f7b80067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.603+0000 7f7ba4a45000 1 --2- 172.21.15.6:0/1219064485 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55c6e9d5ea50 0x55c6e9d5aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.603+0000 7f7ba4a45000 1 -- 172.21.15.6:0/1219064485 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.b 14:d0630e4c:::mds0_sessionmap:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55c6e9d58a50 con 0x55c6e9d5ea50 2023-10-06T02:24:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.603+0000 7f7b97fff700 1 --2- 172.21.15.6:0/1219064485 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55c6e9d5ea50 0x55c6e9d5aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.603+0000 7f7b97fff700 1 --2- 172.21.15.6:0/1219064485 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55c6e9d5ea50 0x55c6e9d5aaf0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.603+0000 7f7b9dc80700 1 --2- 172.21.15.6:0/1219064485 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7b800658c0 0x7f7b80067d70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7b9001a040 tx=0x7f7b9001f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.604+0000 7f7b97fff700 1 -- 172.21.15.6:0/1219064485 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 mds0_sessionmap [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 159+0+16 (crc 0 0 0) 0x7f7b88009a20 con 0x55c6e9d5ea50 2023-10-06T02:24:58.611 INFO:teuthology.orchestra.run.smithi006.stdout:cephfs_metadata/mds0_sessionmap mtime 2023-10-06T02:24:54.000000+0000, size 0 2023-10-06T02:24:58.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.604+0000 7f7ba4a45000 1 -- 172.21.15.6:0/1219064485 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55c6e9d5ea50 msgr2=0x55c6e9d5aaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.604+0000 7f7ba4a45000 1 --2- 172.21.15.6:0/1219064485 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55c6e9d5ea50 0x55c6e9d5aaf0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.604+0000 7f7ba4a45000 1 -- 172.21.15.6:0/1219064485 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7b800658c0 msgr2=0x7f7b80067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.604+0000 7f7ba4a45000 1 --2- 172.21.15.6:0/1219064485 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7b800658c0 0x7f7b80067d70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7b9001a040 tx=0x7f7b9001f000 comp rx=0 tx=0).stop 2023-10-06T02:24:58.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.604+0000 7f7ba4a45000 1 -- 172.21.15.6:0/1219064485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6e9de56f0 msgr2=0x55c6e9de5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.604+0000 7f7ba4a45000 1 --2- 172.21.15.6:0/1219064485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6e9de56f0 0x55c6e9de5ac0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x55c6e9d3fdc0 tx=0x7f7b98007040 comp rx=0 tx=0).stop 2023-10-06T02:24:58.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.604+0000 7f7b9e481700 1 -- 172.21.15.6:0/1219064485 reap_dead start 2023-10-06T02:24:58.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.604+0000 7f7ba4a45000 1 -- 172.21.15.6:0/1219064485 shutdown_connections 2023-10-06T02:24:58.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.604+0000 7f7ba4a45000 1 -- 172.21.15.6:0/1219064485 >> 172.21.15.6:0/1219064485 conn(0x55c6e9d5bbd0 msgr2=0x55c6e9d5bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.604+0000 7f7ba4a45000 1 -- 172.21.15.6:0/1219064485 shutdown_connections 2023-10-06T02:24:58.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.604+0000 7f7ba4a45000 1 -- 172.21.15.6:0/1219064485 wait complete. 2023-10-06T02:24:58.614 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 400.00000000 2023-10-06T02:24:58.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.690+0000 7fa1c72ee000 1 Processor -- start 2023-10-06T02:24:58.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.690+0000 7fa1c72ee000 1 -- start start 2023-10-06T02:24:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.690+0000 7fa1c72ee000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd2984be90 0x55cd29900ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.690+0000 7fa1c72ee000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd29891130 0x55cd29905a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.690+0000 7fa1c72ee000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd29906cc0 0x55cd29905fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.690+0000 7fa1c72ee000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd29793980 con 0x55cd29891130 2023-10-06T02:24:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.690+0000 7fa1c72ee000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd29793620 con 0x55cd29906cc0 2023-10-06T02:24:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.690+0000 7fa1c72ee000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd2978a400 con 0x55cd2984be90 2023-10-06T02:24:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.690+0000 7fa1bfd28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd29891130 0x55cd29905a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.690+0000 7fa1bfd28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd29891130 0x55cd29905a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53596/0 (socket says 172.21.15.6:53596) 2023-10-06T02:24:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.690+0000 7fa1bfd28700 1 -- 172.21.15.6:0/4281741741 learned_addr learned my addr 172.21.15.6:0/4281741741 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.691+0000 7fa1c0d2a700 1 --2- 172.21.15.6:0/4281741741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd29906cc0 0x55cd29905fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.691+0000 7fa1c0529700 1 --2- 172.21.15.6:0/4281741741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd2984be90 0x55cd29900ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.691+0000 7fa1bfd28700 1 -- 172.21.15.6:0/4281741741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd2984be90 msgr2=0x55cd29900ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.691+0000 7fa1bfd28700 1 --2- 172.21.15.6:0/4281741741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd2984be90 0x55cd29900ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.691+0000 7fa1bfd28700 1 -- 172.21.15.6:0/4281741741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd29906cc0 msgr2=0x55cd29905fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.691+0000 7fa1bfd28700 1 --2- 172.21.15.6:0/4281741741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd29906cc0 0x55cd29905fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.691+0000 7fa1bfd28700 1 -- 172.21.15.6:0/4281741741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b8005cf0 con 0x55cd29891130 2023-10-06T02:24:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.691+0000 7fa1bfd28700 1 --2- 172.21.15.6:0/4281741741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd29891130 0x55cd29905a60 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8001eb0 tx=0x7fa1a8001900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3577efc6d45edeab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.691+0000 7fa1bed26700 1 -- 172.21.15.6:0/4281741741 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8014070 con 0x55cd29891130 2023-10-06T02:24:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.691+0000 7fa1bed26700 1 -- 172.21.15.6:0/4281741741 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a8008030 con 0x55cd29891130 2023-10-06T02:24:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.691+0000 7fa1bed26700 1 -- 172.21.15.6:0/4281741741 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a800bd10 con 0x55cd29891130 2023-10-06T02:24:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.692+0000 7fa1c72ee000 1 -- 172.21.15.6:0/4281741741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd29891130 msgr2=0x55cd29905a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.692+0000 7fa1c72ee000 1 --2- 172.21.15.6:0/4281741741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd29891130 0x55cd29905a60 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8001eb0 tx=0x7fa1a8001900 comp rx=0 tx=0).stop 2023-10-06T02:24:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.692+0000 7fa1c72ee000 1 -- 172.21.15.6:0/4281741741 shutdown_connections 2023-10-06T02:24:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.692+0000 7fa1c72ee000 1 --2- 172.21.15.6:0/4281741741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd29906cc0 0x55cd29905fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.692+0000 7fa1c72ee000 1 --2- 172.21.15.6:0/4281741741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd2984be90 0x55cd29900ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.692+0000 7fa1c72ee000 1 --2- 172.21.15.6:0/4281741741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd29891130 0x55cd29905a60 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.692+0000 7fa1c72ee000 1 -- 172.21.15.6:0/4281741741 >> 172.21.15.6:0/4281741741 conn(0x55cd298476c0 msgr2=0x55cd2991d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.692+0000 7fa1c72ee000 1 -- 172.21.15.6:0/4281741741 shutdown_connections 2023-10-06T02:24:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.692+0000 7fa1c72ee000 1 -- 172.21.15.6:0/4281741741 wait complete. 2023-10-06T02:24:58.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.692+0000 7fa1c72ee000 1 Processor -- start 2023-10-06T02:24:58.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.692+0000 7fa1c72ee000 1 -- start start 2023-10-06T02:24:58.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.693+0000 7fa1c72ee000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd2984be90 0x55cd299035c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.693+0000 7fa1c72ee000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd29891130 0x55cd2991cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.693+0000 7fa1c72ee000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd29906cc0 0x55cd2988fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.693+0000 7fa1c72ee000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd299026a0 con 0x55cd29906cc0 2023-10-06T02:24:58.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.693+0000 7fa1c72ee000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd29902940 con 0x55cd2984be90 2023-10-06T02:24:58.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.693+0000 7fa1c72ee000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd29902be0 con 0x55cd29891130 2023-10-06T02:24:58.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.693+0000 7fa1c0d2a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd29906cc0 0x55cd2988fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.693+0000 7fa1c0d2a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd29906cc0 0x55cd2988fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53608/0 (socket says 172.21.15.6:53608) 2023-10-06T02:24:58.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.693+0000 7fa1c0d2a700 1 -- 172.21.15.6:0/1068183165 learned_addr learned my addr 172.21.15.6:0/1068183165 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.693+0000 7fa1bfd28700 1 --2- 172.21.15.6:0/1068183165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd29891130 0x55cd2991cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.693+0000 7fa1c0529700 1 --2- 172.21.15.6:0/1068183165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd2984be90 0x55cd299035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.694+0000 7fa1c0d2a700 1 -- 172.21.15.6:0/1068183165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd29891130 msgr2=0x55cd2991cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.694+0000 7fa1c0d2a700 1 --2- 172.21.15.6:0/1068183165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55cd29891130 0x55cd2991cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.694+0000 7fa1c0d2a700 1 -- 172.21.15.6:0/1068183165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd2984be90 msgr2=0x55cd299035c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.694+0000 7fa1c0d2a700 1 --2- 172.21.15.6:0/1068183165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd2984be90 0x55cd299035c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.694+0000 7fa1c0d2a700 1 -- 172.21.15.6:0/1068183165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a800a040 con 0x55cd29906cc0 2023-10-06T02:24:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.694+0000 7fa1c0d2a700 1 --2- 172.21.15.6:0/1068183165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd29906cc0 0x55cd2988fd70 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0005e40 tx=0x7fa1b0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.694+0000 7fa1bd523700 1 -- 172.21.15.6:0/1068183165 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b000ed80 con 0x55cd29906cc0 2023-10-06T02:24:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.694+0000 7fa1bd523700 1 -- 172.21.15.6:0/1068183165 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b000e7e0 con 0x55cd29906cc0 2023-10-06T02:24:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.694+0000 7fa1c72ee000 1 -- 172.21.15.6:0/1068183165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b000a180 con 0x55cd29906cc0 2023-10-06T02:24:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.694+0000 7fa1bd523700 1 -- 172.21.15.6:0/1068183165 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0025660 con 0x55cd29906cc0 2023-10-06T02:24:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.694+0000 7fa1c72ee000 1 -- 172.21.15.6:0/1068183165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd297a23d0 con 0x55cd29906cc0 2023-10-06T02:24:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.695+0000 7fa1bd523700 1 -- 172.21.15.6:0/1068183165 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa1b0003040 con 0x55cd29906cc0 2023-10-06T02:24:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.696+0000 7fa1bd523700 1 --2- 172.21.15.6:0/1068183165 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa1a0065890 0x7fa1a0067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.696+0000 7fa1bd523700 1 -- 172.21.15.6:0/1068183165 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fa1b0085490 con 0x55cd29906cc0 2023-10-06T02:24:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.696+0000 7fa1c0529700 1 --2- 172.21.15.6:0/1068183165 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa1a0065890 0x7fa1a0067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.696+0000 7fa1c72ee000 1 --2- 172.21.15.6:0/1068183165 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55cd2991dc20 0x55cd2992d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.696+0000 7fa1c72ee000 1 -- 172.21.15.6:0/1068183165 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55cd29900ea0 con 0x55cd2991dc20 2023-10-06T02:24:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.696+0000 7fa1bfd28700 1 --2- 172.21.15.6:0/1068183165 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55cd2991dc20 0x55cd2992d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.696+0000 7fa1c0529700 1 --2- 172.21.15.6:0/1068183165 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa1a0065890 0x7fa1a0067d40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8005c60 tx=0x7fa1b800c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.697+0000 7fa1bfd28700 1 --2- 172.21.15.6:0/1068183165 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55cd2991dc20 0x55cd2992d9e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.704 INFO:teuthology.orchestra.run.smithi006.stdout:cephfs_metadata/400.00000000 mtime 2023-10-06T02:24:40.000000+0000, size 22 2023-10-06T02:24:58.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.697+0000 7fa1bfd28700 1 -- 172.21.15.6:0/1068183165 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(1 400.00000000 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x7fa1a8016070 con 0x55cd2991dc20 2023-10-06T02:24:58.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.697+0000 7fa1c72ee000 1 -- 172.21.15.6:0/1068183165 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55cd2991dc20 msgr2=0x55cd2992d9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.697+0000 7fa1c72ee000 1 --2- 172.21.15.6:0/1068183165 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55cd2991dc20 0x55cd2992d9e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.697+0000 7fa1c72ee000 1 -- 172.21.15.6:0/1068183165 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa1a0065890 msgr2=0x7fa1a0067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.697+0000 7fa1c72ee000 1 --2- 172.21.15.6:0/1068183165 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa1a0065890 0x7fa1a0067d40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8005c60 tx=0x7fa1b800c040 comp rx=0 tx=0).stop 2023-10-06T02:24:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.697+0000 7fa1c72ee000 1 -- 172.21.15.6:0/1068183165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd29906cc0 msgr2=0x55cd2988fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.697+0000 7fa1c72ee000 1 --2- 172.21.15.6:0/1068183165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cd29906cc0 0x55cd2988fd70 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0005e40 tx=0x7fa1b0014000 comp rx=0 tx=0).stop 2023-10-06T02:24:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.697+0000 7fa1c0d2a700 1 -- 172.21.15.6:0/1068183165 reap_dead start 2023-10-06T02:24:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.697+0000 7fa1c72ee000 1 -- 172.21.15.6:0/1068183165 shutdown_connections 2023-10-06T02:24:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.697+0000 7fa1c72ee000 1 -- 172.21.15.6:0/1068183165 >> 172.21.15.6:0/1068183165 conn(0x55cd298476c0 msgr2=0x55cd29878e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.697+0000 7fa1c72ee000 1 -- 172.21.15.6:0/1068183165 shutdown_connections 2023-10-06T02:24:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.697+0000 7fa1c72ee000 1 -- 172.21.15.6:0/1068183165 wait complete. 2023-10-06T02:24:58.708 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 100.00000000.inode 2023-10-06T02:24:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.783+0000 7f50a63f6000 1 Processor -- start 2023-10-06T02:24:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.783+0000 7f50a63f6000 1 -- start start 2023-10-06T02:24:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.783+0000 7f50a63f6000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9ad6cc850 0x55b9ad6e9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.783+0000 7f50a63f6000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ad6ceab0 0x55b9ad768c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.783+0000 7f50a63f6000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ad6cee80 0x55b9ad7691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.783+0000 7f50a63f6000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9ad5ea980 con 0x55b9ad6cc850 2023-10-06T02:24:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.783+0000 7f50a63f6000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9ad5ea620 con 0x55b9ad6ceab0 2023-10-06T02:24:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.783+0000 7f50a63f6000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9ad5e1400 con 0x55b9ad6cee80 2023-10-06T02:24:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.783+0000 7f509f631700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9ad6cc850 0x55b9ad6e9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.783+0000 7f509f631700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9ad6cc850 0x55b9ad6e9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53622/0 (socket says 172.21.15.6:53622) 2023-10-06T02:24:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.783+0000 7f509f631700 1 -- 172.21.15.6:0/379989944 learned_addr learned my addr 172.21.15.6:0/379989944 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f509fe32700 1 --2- 172.21.15.6:0/379989944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ad6cee80 0x55b9ad7691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f509ee30700 1 --2- 172.21.15.6:0/379989944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ad6ceab0 0x55b9ad768c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f509f631700 1 -- 172.21.15.6:0/379989944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ad6cee80 msgr2=0x55b9ad7691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f509f631700 1 --2- 172.21.15.6:0/379989944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ad6cee80 0x55b9ad7691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f509f631700 1 -- 172.21.15.6:0/379989944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ad6ceab0 msgr2=0x55b9ad768c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f509f631700 1 --2- 172.21.15.6:0/379989944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ad6ceab0 0x55b9ad768c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f509f631700 1 -- 172.21.15.6:0/379989944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509800a0e0 con 0x55b9ad6cc850 2023-10-06T02:24:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f509f631700 1 --2- 172.21.15.6:0/379989944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9ad6cc850 0x55b9ad6e9440 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f5090001d50 tx=0x7f50900017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694eb2da3646f547 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f509de2e700 1 -- 172.21.15.6:0/379989944 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509000bbf0 con 0x55b9ad6cc850 2023-10-06T02:24:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f509de2e700 1 -- 172.21.15.6:0/379989944 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509000bd70 con 0x55b9ad6cc850 2023-10-06T02:24:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f509de2e700 1 -- 172.21.15.6:0/379989944 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509000e6c0 con 0x55b9ad6cc850 2023-10-06T02:24:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f50a63f6000 1 -- 172.21.15.6:0/379989944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9ad6cc850 msgr2=0x55b9ad6e9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f50a63f6000 1 --2- 172.21.15.6:0/379989944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9ad6cc850 0x55b9ad6e9440 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f5090001d50 tx=0x7f50900017a0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f50a63f6000 1 -- 172.21.15.6:0/379989944 shutdown_connections 2023-10-06T02:24:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f50a63f6000 1 --2- 172.21.15.6:0/379989944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ad6cee80 0x55b9ad7691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f50a63f6000 1 --2- 172.21.15.6:0/379989944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9ad6cc850 0x55b9ad6e9440 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f50a63f6000 1 --2- 172.21.15.6:0/379989944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ad6ceab0 0x55b9ad768c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.784+0000 7f50a63f6000 1 -- 172.21.15.6:0/379989944 >> 172.21.15.6:0/379989944 conn(0x55b9ad6e6bd0 msgr2=0x55b9ad69e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.785+0000 7f50a63f6000 1 -- 172.21.15.6:0/379989944 shutdown_connections 2023-10-06T02:24:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.785+0000 7f50a63f6000 1 -- 172.21.15.6:0/379989944 wait complete. 2023-10-06T02:24:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.785+0000 7f50a63f6000 1 Processor -- start 2023-10-06T02:24:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.785+0000 7f50a63f6000 1 -- start start 2023-10-06T02:24:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.786+0000 7f50a63f6000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ad6cc850 0x55b9ad767cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.786+0000 7f50a63f6000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9ad6ceab0 0x55b9ad77b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.786+0000 7f50a63f6000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ad6cee80 0x55b9ad77bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.786+0000 7f50a63f6000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9ad7808c0 con 0x55b9ad6ceab0 2023-10-06T02:24:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.786+0000 7f50a63f6000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9ad77fe40 con 0x55b9ad6cc850 2023-10-06T02:24:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.786+0000 7f50a63f6000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9ad7800e0 con 0x55b9ad6cee80 2023-10-06T02:24:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.786+0000 7f509ee30700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9ad6ceab0 0x55b9ad77b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.786+0000 7f509ee30700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9ad6ceab0 0x55b9ad77b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53624/0 (socket says 172.21.15.6:53624) 2023-10-06T02:24:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.786+0000 7f509ee30700 1 -- 172.21.15.6:0/819506645 learned_addr learned my addr 172.21.15.6:0/819506645 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.786+0000 7f509fe32700 1 --2- 172.21.15.6:0/819506645 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ad6cee80 0x55b9ad77bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.786+0000 7f509f631700 1 --2- 172.21.15.6:0/819506645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ad6cc850 0x55b9ad767cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.786+0000 7f509ee30700 1 -- 172.21.15.6:0/819506645 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ad6cee80 msgr2=0x55b9ad77bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.786+0000 7f509ee30700 1 --2- 172.21.15.6:0/819506645 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ad6cee80 0x55b9ad77bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.786+0000 7f509ee30700 1 -- 172.21.15.6:0/819506645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ad6cc850 msgr2=0x55b9ad767cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.786+0000 7f509ee30700 1 --2- 172.21.15.6:0/819506645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ad6cc850 0x55b9ad767cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.786+0000 7f509ee30700 1 -- 172.21.15.6:0/819506645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9ad5ec750 con 0x55b9ad6ceab0 2023-10-06T02:24:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.786+0000 7f509ee30700 1 --2- 172.21.15.6:0/819506645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9ad6ceab0 0x55b9ad77b9b0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f5094008940 tx=0x7f5094005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.787+0000 7f5087fff700 1 -- 172.21.15.6:0/819506645 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50940067c0 con 0x55b9ad6ceab0 2023-10-06T02:24:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.787+0000 7f5087fff700 1 -- 172.21.15.6:0/819506645 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5094010040 con 0x55b9ad6ceab0 2023-10-06T02:24:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.787+0000 7f50a63f6000 1 -- 172.21.15.6:0/819506645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b9ad5f93d0 con 0x55b9ad6ceab0 2023-10-06T02:24:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.787+0000 7f5087fff700 1 -- 172.21.15.6:0/819506645 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094006b70 con 0x55b9ad6ceab0 2023-10-06T02:24:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.787+0000 7f50a63f6000 1 -- 172.21.15.6:0/819506645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b9ad5ecae0 con 0x55b9ad6ceab0 2023-10-06T02:24:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.788+0000 7f5087fff700 1 -- 172.21.15.6:0/819506645 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f509401e460 con 0x55b9ad6ceab0 2023-10-06T02:24:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.788+0000 7f5087fff700 1 --2- 172.21.15.6:0/819506645 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f508c0658c0 0x7f508c067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.788+0000 7f5087fff700 1 -- 172.21.15.6:0/819506645 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f50940837e0 con 0x55b9ad6ceab0 2023-10-06T02:24:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.788+0000 7f50a63f6000 1 --2- 172.21.15.6:0/819506645 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b9ad77a5a0 0x55b9ad77a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.789+0000 7f50a63f6000 1 -- 172.21.15.6:0/819506645 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.1f 14:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55b9ad69dbc0 con 0x55b9ad77a5a0 2023-10-06T02:24:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.789+0000 7f509f631700 1 --2- 172.21.15.6:0/819506645 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f508c0658c0 0x7f508c067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.789+0000 7f509fe32700 1 --2- 172.21.15.6:0/819506645 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b9ad77a5a0 0x55b9ad77a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.789+0000 7f509f631700 1 --2- 172.21.15.6:0/819506645 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f508c0658c0 0x7f508c067d70 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5090001d50 tx=0x7f5090016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.789+0000 7f509fe32700 1 --2- 172.21.15.6:0/819506645 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b9ad77a5a0 0x55b9ad77a9a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.789+0000 7f509fe32700 1 -- 172.21.15.6:0/819506645 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x7f5098016020 con 0x55b9ad77a5a0 2023-10-06T02:24:58.796 INFO:teuthology.orchestra.run.smithi006.stdout:cephfs_metadata/100.00000000.inode mtime 2023-10-06T02:24:40.000000+0000, size 554 2023-10-06T02:24:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.789+0000 7f50a63f6000 1 -- 172.21.15.6:0/819506645 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b9ad77a5a0 msgr2=0x55b9ad77a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.789+0000 7f50a63f6000 1 --2- 172.21.15.6:0/819506645 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b9ad77a5a0 0x55b9ad77a9a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.789+0000 7f50a63f6000 1 -- 172.21.15.6:0/819506645 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f508c0658c0 msgr2=0x7f508c067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.789+0000 7f50a63f6000 1 --2- 172.21.15.6:0/819506645 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f508c0658c0 0x7f508c067d70 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5090001d50 tx=0x7f5090016000 comp rx=0 tx=0).stop 2023-10-06T02:24:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.789+0000 7f50a63f6000 1 -- 172.21.15.6:0/819506645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9ad6ceab0 msgr2=0x55b9ad77b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.789+0000 7f50a63f6000 1 --2- 172.21.15.6:0/819506645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9ad6ceab0 0x55b9ad77b9b0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f5094008940 tx=0x7f5094005e20 comp rx=0 tx=0).stop 2023-10-06T02:24:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.789+0000 7f509fe32700 1 -- 172.21.15.6:0/819506645 reap_dead start 2023-10-06T02:24:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.789+0000 7f50a63f6000 1 -- 172.21.15.6:0/819506645 shutdown_connections 2023-10-06T02:24:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.789+0000 7f50a63f6000 1 -- 172.21.15.6:0/819506645 >> 172.21.15.6:0/819506645 conn(0x55b9ad6e6bd0 msgr2=0x55b9ad69d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.790+0000 7f50a63f6000 1 -- 172.21.15.6:0/819506645 shutdown_connections 2023-10-06T02:24:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.790+0000 7f50a63f6000 1 -- 172.21.15.6:0/819506645 wait complete. 2023-10-06T02:24:58.798 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 1.00000000 2023-10-06T02:24:58.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.873+0000 7f3b576c4000 1 Processor -- start 2023-10-06T02:24:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.873+0000 7f3b576c4000 1 -- start start 2023-10-06T02:24:58.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b576c4000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2c2aa5490 0x55d2c2a9f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b576c4000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2c2b1ba80 0x55d2c2a8a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b576c4000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c2b1be50 0x55d2c2b15b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b576c4000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c29a6980 con 0x55d2c2b1be50 2023-10-06T02:24:58.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b576c4000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c29a6620 con 0x55d2c2aa5490 2023-10-06T02:24:58.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b576c4000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2c299d400 con 0x55d2c2b1ba80 2023-10-06T02:24:58.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b51100700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c2b1be50 0x55d2c2b15b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b51100700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c2b1be50 0x55d2c2b15b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53640/0 (socket says 172.21.15.6:53640) 2023-10-06T02:24:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b51100700 1 -- 172.21.15.6:0/2370855514 learned_addr learned my addr 172.21.15.6:0/2370855514 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b508ff700 1 --2- 172.21.15.6:0/2370855514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2c2aa5490 0x55d2c2a9f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b4bfff700 1 --2- 172.21.15.6:0/2370855514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2c2b1ba80 0x55d2c2a8a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b51100700 1 -- 172.21.15.6:0/2370855514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2c2b1ba80 msgr2=0x55d2c2a8a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b51100700 1 --2- 172.21.15.6:0/2370855514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2c2b1ba80 0x55d2c2a8a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b51100700 1 -- 172.21.15.6:0/2370855514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2c2aa5490 msgr2=0x55d2c2a9f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b51100700 1 --2- 172.21.15.6:0/2370855514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2c2aa5490 0x55d2c2a9f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b51100700 1 -- 172.21.15.6:0/2370855514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b44005db0 con 0x55d2c2b1be50 2023-10-06T02:24:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b4bfff700 1 --2- 172.21.15.6:0/2370855514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2c2b1ba80 0x55d2c2a8a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b508ff700 1 --2- 172.21.15.6:0/2370855514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2c2aa5490 0x55d2c2a9f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b51100700 1 --2- 172.21.15.6:0/2370855514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c2b1be50 0x55d2c2b15b90 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00a540 tx=0x7f3b4c007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549f4623f6f00fce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b4affd700 1 -- 172.21.15.6:0/2370855514 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0115f0 con 0x55d2c2b1be50 2023-10-06T02:24:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b4affd700 1 -- 172.21.15.6:0/2370855514 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c011750 con 0x55d2c2b1be50 2023-10-06T02:24:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.874+0000 7f3b4affd700 1 -- 172.21.15.6:0/2370855514 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c011af0 con 0x55d2c2b1be50 2023-10-06T02:24:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.875+0000 7f3b576c4000 1 -- 172.21.15.6:0/2370855514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c2b1be50 msgr2=0x55d2c2b15b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.875+0000 7f3b576c4000 1 --2- 172.21.15.6:0/2370855514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c2b1be50 0x55d2c2b15b90 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00a540 tx=0x7f3b4c007040 comp rx=0 tx=0).stop 2023-10-06T02:24:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.875+0000 7f3b576c4000 1 -- 172.21.15.6:0/2370855514 shutdown_connections 2023-10-06T02:24:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.875+0000 7f3b576c4000 1 --2- 172.21.15.6:0/2370855514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c2b1be50 0x55d2c2b15b90 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.875+0000 7f3b576c4000 1 --2- 172.21.15.6:0/2370855514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2c2aa5490 0x55d2c2a9f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.875+0000 7f3b576c4000 1 --2- 172.21.15.6:0/2370855514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2c2b1ba80 0x55d2c2a8a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.875+0000 7f3b576c4000 1 -- 172.21.15.6:0/2370855514 >> 172.21.15.6:0/2370855514 conn(0x55d2c2a5c5d0 msgr2=0x55d2c2a59390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.875+0000 7f3b576c4000 1 -- 172.21.15.6:0/2370855514 shutdown_connections 2023-10-06T02:24:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.875+0000 7f3b576c4000 1 -- 172.21.15.6:0/2370855514 wait complete. 2023-10-06T02:24:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.875+0000 7f3b576c4000 1 Processor -- start 2023-10-06T02:24:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.876+0000 7f3b576c4000 1 -- start start 2023-10-06T02:24:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.876+0000 7f3b576c4000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2c2aa5490 0x55d2c2b19bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.876+0000 7f3b576c4000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2c2b1ba80 0x55d2c2b46310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.876+0000 7f3b576c4000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c2b1be50 0x55d2c2b46850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.876+0000 7f3b576c4000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c2b14c70 con 0x55d2c2b1be50 2023-10-06T02:24:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.876+0000 7f3b576c4000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c2a5d970 con 0x55d2c2b1ba80 2023-10-06T02:24:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.876+0000 7f3b576c4000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2c2b17360 con 0x55d2c2aa5490 2023-10-06T02:24:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.876+0000 7f3b51100700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c2b1be50 0x55d2c2b46850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.876+0000 7f3b51100700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c2b1be50 0x55d2c2b46850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53644/0 (socket says 172.21.15.6:53644) 2023-10-06T02:24:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.876+0000 7f3b51100700 1 -- 172.21.15.6:0/477133440 learned_addr learned my addr 172.21.15.6:0/477133440 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.876+0000 7f3b4bfff700 1 --2- 172.21.15.6:0/477133440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2c2b1ba80 0x55d2c2b46310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.876+0000 7f3b508ff700 1 --2- 172.21.15.6:0/477133440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2c2aa5490 0x55d2c2b19bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.877+0000 7f3b51100700 1 -- 172.21.15.6:0/477133440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2c2aa5490 msgr2=0x55d2c2b19bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.877+0000 7f3b51100700 1 --2- 172.21.15.6:0/477133440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2c2aa5490 0x55d2c2b19bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.877+0000 7f3b51100700 1 -- 172.21.15.6:0/477133440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2c2b1ba80 msgr2=0x55d2c2b46310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.877+0000 7f3b51100700 1 --2- 172.21.15.6:0/477133440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2c2b1ba80 0x55d2c2b46310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.877+0000 7f3b51100700 1 -- 172.21.15.6:0/477133440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c00d040 con 0x55d2c2b1be50 2023-10-06T02:24:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.877+0000 7f3b51100700 1 --2- 172.21.15.6:0/477133440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c2b1be50 0x55d2c2b46850 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c011ca0 tx=0x7f3b4c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.877+0000 7f3b497fa700 1 -- 172.21.15.6:0/477133440 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0115f0 con 0x55d2c2b1be50 2023-10-06T02:24:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.877+0000 7f3b497fa700 1 -- 172.21.15.6:0/477133440 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c005c70 con 0x55d2c2b1be50 2023-10-06T02:24:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.877+0000 7f3b497fa700 1 -- 172.21.15.6:0/477133440 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c01d670 con 0x55d2c2b1be50 2023-10-06T02:24:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.877+0000 7f3b576c4000 1 -- 172.21.15.6:0/477133440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d2c29b53d0 con 0x55d2c2b1be50 2023-10-06T02:24:58.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.877+0000 7f3b576c4000 1 -- 172.21.15.6:0/477133440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2c29a8ae0 con 0x55d2c2b1be50 2023-10-06T02:24:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.878+0000 7f3b497fa700 1 -- 172.21.15.6:0/477133440 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b4c01daa0 con 0x55d2c2b1be50 2023-10-06T02:24:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.879+0000 7f3b497fa700 1 --2- 172.21.15.6:0/477133440 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3b340658c0 0x7f3b34067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.879+0000 7f3b497fa700 1 -- 172.21.15.6:0/477133440 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f3b4c085930 con 0x55d2c2b1be50 2023-10-06T02:24:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.879+0000 7f3b508ff700 1 --2- 172.21.15.6:0/477133440 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3b340658c0 0x7f3b34067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.879+0000 7f3b576c4000 1 --2- 172.21.15.6:0/477133440 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55d2c2a5ece0 0x55d2c2b18230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.879+0000 7f3b576c4000 1 -- 172.21.15.6:0/477133440 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.1f 14:ff5b34d6:::1.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v8 -- 0x55d2c2b1a130 con 0x55d2c2a5ece0 2023-10-06T02:24:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.879+0000 7f3b4bfff700 1 --2- 172.21.15.6:0/477133440 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55d2c2a5ece0 0x55d2c2b18230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.879+0000 7f3b508ff700 1 --2- 172.21.15.6:0/477133440 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3b340658c0 0x7f3b34067d70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3b44005860 tx=0x7f3b44016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.879+0000 7f3b4bfff700 1 --2- 172.21.15.6:0/477133440 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55d2c2a5ece0 0x55d2c2b18230 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.880+0000 7f3b4bfff700 1 -- 172.21.15.6:0/477133440 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 1.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+16 (crc 0 0 0) 0x7f3b3c002b60 con 0x55d2c2a5ece0 2023-10-06T02:24:58.886 INFO:teuthology.orchestra.run.smithi006.stdout:cephfs_metadata/1.00000000 mtime 2023-10-06T02:24:54.000000+0000, size 0 2023-10-06T02:24:58.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.880+0000 7f3b576c4000 1 -- 172.21.15.6:0/477133440 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55d2c2a5ece0 msgr2=0x55d2c2b18230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.880+0000 7f3b576c4000 1 --2- 172.21.15.6:0/477133440 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55d2c2a5ece0 0x55d2c2b18230 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.880+0000 7f3b576c4000 1 -- 172.21.15.6:0/477133440 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3b340658c0 msgr2=0x7f3b34067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.880+0000 7f3b576c4000 1 --2- 172.21.15.6:0/477133440 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3b340658c0 0x7f3b34067d70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3b44005860 tx=0x7f3b44016000 comp rx=0 tx=0).stop 2023-10-06T02:24:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.880+0000 7f3b576c4000 1 -- 172.21.15.6:0/477133440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c2b1be50 msgr2=0x55d2c2b46850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.880+0000 7f3b576c4000 1 --2- 172.21.15.6:0/477133440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c2b1be50 0x55d2c2b46850 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c011ca0 tx=0x7f3b4c018000 comp rx=0 tx=0).stop 2023-10-06T02:24:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.880+0000 7f3b51100700 1 -- 172.21.15.6:0/477133440 reap_dead start 2023-10-06T02:24:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.880+0000 7f3b576c4000 1 -- 172.21.15.6:0/477133440 shutdown_connections 2023-10-06T02:24:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.880+0000 7f3b576c4000 1 -- 172.21.15.6:0/477133440 >> 172.21.15.6:0/477133440 conn(0x55d2c2a5c5d0 msgr2=0x55d2c2b33230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.880+0000 7f3b576c4000 1 -- 172.21.15.6:0/477133440 shutdown_connections 2023-10-06T02:24:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:58.880+0000 7f3b576c4000 1 -- 172.21.15.6:0/477133440 wait complete. 2023-10-06T02:24:58.889 INFO:tasks.cephfs.test_damage:Expectation on rm '10000000000.00000000' will be 'no damage' 2023-10-06T02:24:58.889 INFO:tasks.cephfs.test_damage:Expectation on rm '600.00000000' will be 'damaged_on_start' 2023-10-06T02:24:58.889 INFO:tasks.cephfs.test_damage:Expectation on rm '1.00000000.inode' will be 'damaged_on_start' 2023-10-06T02:24:58.889 INFO:tasks.cephfs.test_damage:Expectation on rm '200.00000000' will be 'damaged_on_start' 2023-10-06T02:24:58.889 INFO:tasks.cephfs.test_damage:Expectation on rm '200.00000001' will be 'damaged_on_start' 2023-10-06T02:24:58.889 INFO:tasks.cephfs.test_damage:Expectation on rm 'mds0_openfiles.0' will be 'no damage' 2023-10-06T02:24:58.889 INFO:tasks.cephfs.test_damage:Expectation on rm '500.00000000' will be 'no damage' 2023-10-06T02:24:58.889 INFO:tasks.cephfs.test_damage:Expectation on rm 'mds_snaptable' will be 'damaged_on_start' 2023-10-06T02:24:58.889 INFO:tasks.cephfs.test_damage:Expectation on rm 'mds0_inotable' will be 'damaged_on_start' 2023-10-06T02:24:58.890 INFO:tasks.cephfs.test_damage:Expectation on rm '100.00000000' will be 'damaged_on_start' 2023-10-06T02:24:58.890 INFO:tasks.cephfs.test_damage:Expectation on rm 'mds0_sessionmap' will be 'damaged_on_start' 2023-10-06T02:24:58.890 INFO:tasks.cephfs.test_damage:Expectation on rm '400.00000000' will be 'no damage' 2023-10-06T02:24:58.890 INFO:tasks.cephfs.test_damage:Expectation on rm '100.00000000.inode' will be 'damaged_on_start' 2023-10-06T02:24:58.890 INFO:tasks.cephfs.test_damage:Expectation on rm '1.00000000' will be 'damaged_on_start' 2023-10-06T02:24:58.890 INFO:tasks.cephfs.test_damage:Expectation on corrupt header '10000000000.00000000' will be 'no damage' 2023-10-06T02:24:58.890 INFO:tasks.cephfs.test_damage:Expectation on corrupt header '600.00000000' will be 'damaged_on_start' 2023-10-06T02:24:58.890 INFO:tasks.cephfs.test_damage:Expectation on corrupt header 'mds0_openfiles.0' will be 'no damage' 2023-10-06T02:24:58.890 INFO:tasks.cephfs.test_damage:Expectation on corrupt header '100.00000000' will be 'damaged_on_start' 2023-10-06T02:24:58.890 INFO:tasks.cephfs.test_damage:Expectation on corrupt header 'mds0_sessionmap' will be 'damaged_on_start' 2023-10-06T02:24:58.890 INFO:tasks.cephfs.test_damage:Expectation on corrupt header '1.00000000' will be 'damaged_on_start' 2023-10-06T02:24:58.891 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 10000000000.00000000' 2023-10-06T02:24:58.891 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:58.891 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:24:58.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:58.891 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:24:58.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:24:58.944 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:24:58.944 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:24:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.104+0000 7f0f9ccfc700 1 Processor -- start 2023-10-06T02:24:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.105+0000 7f0f9ccfc700 1 -- start start 2023-10-06T02:24:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.105+0000 7f0f9ccfc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f98068d90 0x7f0f98164320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.105+0000 7f0f9ccfc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f980c8340 con 0x7f0f98159650 2023-10-06T02:24:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.105+0000 7f0f9ccfc700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f980c7a10 con 0x7f0f98159280 2023-10-06T02:24:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.105+0000 7f0f9ccfc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f980c7cf0 con 0x7f0f98068d90 2023-10-06T02:24:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.106+0000 7f0f96ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0f98159650 0x7f0f98068680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56686/0 (socket says 172.21.15.6:56686) 2023-10-06T02:24:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.106+0000 7f0f96ffd700 1 -- 172.21.15.6:0/2738752927 learned_addr learned my addr 172.21.15.6:0/2738752927 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:24:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.106+0000 7f0f97fff700 1 --2- 172.21.15.6:0/2738752927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f98068d90 0x7f0f98164320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.106+0000 7f0f967fc700 1 -- 172.21.15.6:0/2738752927 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739839676 0 0) 0x7f0f980c8340 con 0x7f0f98159650 2023-10-06T02:24:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.106+0000 7f0f967fc700 1 -- 172.21.15.6:0/2738752927 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f80003570 con 0x7f0f98159650 2023-10-06T02:24:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.106+0000 7f0f967fc700 1 -- 172.21.15.6:0/2738752927 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541612027 0 0) 0x7f0f980c7a10 con 0x7f0f98159280 2023-10-06T02:24:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.106+0000 7f0f967fc700 1 -- 172.21.15.6:0/2738752927 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f980c8340 con 0x7f0f98159280 2023-10-06T02:24:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.106+0000 7f0f97fff700 1 -- 172.21.15.6:0/2738752927 >> v1:172.21.15.175:6789/0 conn(0x7f0f98159280 legacy=0x7f0f9806f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.106+0000 7f0f967fc700 1 -- 172.21.15.6:0/2738752927 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2790991571 0 0) 0x7f0f80003570 con 0x7f0f98159650 2023-10-06T02:24:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.106+0000 7f0f97fff700 1 -- 172.21.15.6:0/2738752927 >> v1:172.21.15.6:6789/0 conn(0x7f0f98159650 legacy=0x7f0f98068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.106+0000 7f0f97fff700 1 -- 172.21.15.6:0/2738752927 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f980c7fd0 con 0x7f0f98068d90 2023-10-06T02:24:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.106+0000 7f0f97fff700 1 --2- 172.21.15.6:0/2738752927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f98068d90 0x7f0f98164320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009e90 tx=0x7f0f90009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1a5c12aabc55932 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:59.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.107+0000 7f0f967fc700 1 -- 172.21.15.6:0/2738752927 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9000e070 con 0x7f0f98068d90 2023-10-06T02:24:59.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.107+0000 7f0f967fc700 1 -- 172.21.15.6:0/2738752927 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9000b870 con 0x7f0f98068d90 2023-10-06T02:24:59.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.107+0000 7f0f967fc700 1 -- 172.21.15.6:0/2738752927 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c001470 con 0x7f0f98068d90 2023-10-06T02:24:59.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.107+0000 7f0f9ccfc700 1 -- 172.21.15.6:0/2738752927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f98068d90 msgr2=0x7f0f98164320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.107+0000 7f0f9ccfc700 1 --2- 172.21.15.6:0/2738752927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f98068d90 0x7f0f98164320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009e90 tx=0x7f0f90009780 comp rx=0 tx=0).stop 2023-10-06T02:24:59.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.107+0000 7f0f9ccfc700 1 -- 172.21.15.6:0/2738752927 shutdown_connections 2023-10-06T02:24:59.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.107+0000 7f0f9ccfc700 1 --2- 172.21.15.6:0/2738752927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f98068d90 0x7f0f98164320 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.107+0000 7f0f9ccfc700 1 -- 172.21.15.6:0/2738752927 >> 172.21.15.6:0/2738752927 conn(0x7f0f980c9070 msgr2=0x7f0f980c9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:59.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.107+0000 7f0f9ccfc700 1 -- 172.21.15.6:0/2738752927 shutdown_connections 2023-10-06T02:24:59.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.107+0000 7f0f9ccfc700 1 -- 172.21.15.6:0/2738752927 wait complete. 2023-10-06T02:24:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.108+0000 7f0f9ccfc700 1 Processor -- start 2023-10-06T02:24:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.108+0000 7f0f9ccfc700 1 -- start start 2023-10-06T02:24:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.109+0000 7f0f9ccfc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f98068d90 0x7f0f98169a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.109+0000 7f0f9ccfc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f98159280 0x7f0f98151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.109+0000 7f0f9ccfc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f980b0520 0x7f0f980b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.109+0000 7f0f9ccfc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f980c45b0 con 0x7f0f98159280 2023-10-06T02:24:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.109+0000 7f0f9ccfc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f980c4e50 con 0x7f0f980b0520 2023-10-06T02:24:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.109+0000 7f0f9ccfc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f98154370 con 0x7f0f98068d90 2023-10-06T02:24:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.109+0000 7f0f96ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f98159280 0x7f0f98151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.109+0000 7f0f96ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f98159280 0x7f0f98151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53648/0 (socket says 172.21.15.6:53648) 2023-10-06T02:24:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.109+0000 7f0f96ffd700 1 -- 172.21.15.6:0/3283906356 learned_addr learned my addr 172.21.15.6:0/3283906356 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:24:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.110+0000 7f0f97fff700 1 --2- 172.21.15.6:0/3283906356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f980b0520 0x7f0f980b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.110+0000 7f0f977fe700 1 --2- 172.21.15.6:0/3283906356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f98068d90 0x7f0f98169a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.110+0000 7f0f96ffd700 1 -- 172.21.15.6:0/3283906356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f98068d90 msgr2=0x7f0f98169a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.110+0000 7f0f96ffd700 1 --2- 172.21.15.6:0/3283906356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f98068d90 0x7f0f98169a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.110+0000 7f0f96ffd700 1 -- 172.21.15.6:0/3283906356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f980b0520 msgr2=0x7f0f980b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.110+0000 7f0f96ffd700 1 --2- 172.21.15.6:0/3283906356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f980b0520 0x7f0f980b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.110+0000 7f0f96ffd700 1 -- 172.21.15.6:0/3283906356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f90009a20 con 0x7f0f98159280 2023-10-06T02:24:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.110+0000 7f0f97fff700 1 --2- 172.21.15.6:0/3283906356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f980b0520 0x7f0f980b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.110+0000 7f0f977fe700 1 --2- 172.21.15.6:0/3283906356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f98068d90 0x7f0f98169a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.110+0000 7f0f96ffd700 1 --2- 172.21.15.6:0/3283906356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f98159280 0x7f0f98151620 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00cbc0 tx=0x7f0f8c001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.110+0000 7f0f7f7fe700 1 -- 172.21.15.6:0/3283906356 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c007360 con 0x7f0f98159280 2023-10-06T02:24:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.110+0000 7f0f7f7fe700 1 -- 172.21.15.6:0/3283906356 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c0074e0 con 0x7f0f98159280 2023-10-06T02:24:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.110+0000 7f0f9ccfc700 1 -- 172.21.15.6:0/3283906356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f980c4800 con 0x7f0f98159280 2023-10-06T02:24:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.110+0000 7f0f7f7fe700 1 -- 172.21.15.6:0/3283906356 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c004830 con 0x7f0f98159280 2023-10-06T02:24:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.110+0000 7f0f9ccfc700 1 -- 172.21.15.6:0/3283906356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f980b0ee0 con 0x7f0f98159280 2023-10-06T02:24:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.111+0000 7f0f9ccfc700 1 -- 172.21.15.6:0/3283906356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f980c4ca0 con 0x7f0f98159280 2023-10-06T02:24:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.111+0000 7f0f7f7fe700 1 -- 172.21.15.6:0/3283906356 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f8c004ba0 con 0x7f0f98159280 2023-10-06T02:24:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.112+0000 7f0f7f7fe700 1 --2- 172.21.15.6:0/3283906356 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f84066f30 0x7f0f840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.112+0000 7f0f7f7fe700 1 -- 172.21.15.6:0/3283906356 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f0f8c083ec0 con 0x7f0f98159280 2023-10-06T02:24:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.112+0000 7f0f977fe700 1 --2- 172.21.15.6:0/3283906356 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f84066f30 0x7f0f840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.112+0000 7f0f977fe700 1 --2- 172.21.15.6:0/3283906356 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f84066f30 0x7f0f840693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0f88007fd0 tx=0x7f0f88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:59.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.116+0000 7f0f7f7fe700 1 -- 172.21.15.6:0/3283906356 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f8c050ec0 con 0x7f0f98159280 2023-10-06T02:24:59.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:24:59.354+0000 7f0f9ccfc700 1 -- 172.21.15.6:0/3283906356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0f980c4f90 con 0x7f0f98159280 2023-10-06T02:25:00.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.022+0000 7f0f7f7fe700 1 -- 172.21.15.6:0/3283906356 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v89) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0f8c018090 con 0x7f0f98159280 2023-10-06T02:25:00.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.025+0000 7f0f9ccfc700 1 -- 172.21.15.6:0/3283906356 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f84066f30 msgr2=0x7f0f840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.025+0000 7f0f9ccfc700 1 --2- 172.21.15.6:0/3283906356 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f84066f30 0x7f0f840693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0f88007fd0 tx=0x7f0f88009040 comp rx=0 tx=0).stop 2023-10-06T02:25:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.025+0000 7f0f9ccfc700 1 -- 172.21.15.6:0/3283906356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f98159280 msgr2=0x7f0f98151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.025+0000 7f0f9ccfc700 1 --2- 172.21.15.6:0/3283906356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f98159280 0x7f0f98151620 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00cbc0 tx=0x7f0f8c001b50 comp rx=0 tx=0).stop 2023-10-06T02:25:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.025+0000 7f0f9ccfc700 1 -- 172.21.15.6:0/3283906356 shutdown_connections 2023-10-06T02:25:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.025+0000 7f0f9ccfc700 1 --2- 172.21.15.6:0/3283906356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f980b0520 0x7f0f980b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.025+0000 7f0f9ccfc700 1 --2- 172.21.15.6:0/3283906356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f98068d90 0x7f0f98169a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.025+0000 7f0f9ccfc700 1 --2- 172.21.15.6:0/3283906356 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f84066f30 0x7f0f840693e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.025+0000 7f0f9ccfc700 1 --2- 172.21.15.6:0/3283906356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f98159280 0x7f0f98151620 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.025+0000 7f0f9ccfc700 1 -- 172.21.15.6:0/3283906356 >> 172.21.15.6:0/3283906356 conn(0x7f0f980c9070 msgr2=0x7f0f9806f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.025+0000 7f0f9ccfc700 1 -- 172.21.15.6:0/3283906356 shutdown_connections 2023-10-06T02:25:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.025+0000 7f0f9ccfc700 1 -- 172.21.15.6:0/3283906356 wait complete. 2023-10-06T02:25:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:25:00.041 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:25:00.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.166+0000 7fc4440a4700 1 Processor -- start 2023-10-06T02:25:00.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.167+0000 7fc4440a4700 1 -- start start 2023-10-06T02:25:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.168+0000 7fc4440a4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc43c086ff0 0x7fc43c087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.168+0000 7fc4440a4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc43c0b21b0 0x7fc43c0b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.168+0000 7fc4440a4700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43c0b2b70 con 0x7fc43c15a030 2023-10-06T02:25:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.168+0000 7fc4440a4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43c0b0cf0 con 0x7fc43c086ff0 2023-10-06T02:25:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.168+0000 7fc4440a4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c0879b0 con 0x7fc43c0b21b0 2023-10-06T02:25:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.168+0000 7fc442641700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc43c0b21b0 0x7fc43c0b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.168+0000 7fc44163f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc43c086ff0 0x7fc43c087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.168+0000 7fc441e40700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc43c15a030 0x7fc43c15a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:57066/0 (socket says 172.21.15.6:57066) 2023-10-06T02:25:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.168+0000 7fc441e40700 1 -- 172.21.15.6:0/4275928292 learned_addr learned my addr 172.21.15.6:0/4275928292 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.168+0000 7fc442641700 1 --2- 172.21.15.6:0/4275928292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc43c0b21b0 0x7fc43c0b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:53410/0 (socket says 172.21.15.6:53410) 2023-10-06T02:25:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.168+0000 7fc44163f700 1 --2- 172.21.15.6:0/4275928292 >> v2:172.21.15.175:3300/0 conn(0x7fc43c086ff0 0x7fc43c087470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:34522/0 (socket says 172.21.15.6:34522) 2023-10-06T02:25:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.168+0000 7fc442641700 1 -- 172.21.15.6:0/4275928292 >> v2:172.21.15.175:3300/0 conn(0x7fc43c086ff0 msgr2=0x7fc43c087470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.168+0000 7fc442641700 1 --2- 172.21.15.6:0/4275928292 >> v2:172.21.15.175:3300/0 conn(0x7fc43c086ff0 0x7fc43c087470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.168+0000 7fc442641700 1 -- 172.21.15.6:0/4275928292 >> v1:172.21.15.175:6789/0 conn(0x7fc43c15a030 legacy=0x7fc43c15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.168+0000 7fc442641700 1 -- 172.21.15.6:0/4275928292 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c0afc50 con 0x7fc43c0b21b0 2023-10-06T02:25:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.168+0000 7fc440e3e700 1 -- 172.21.15.6:0/4275928292 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3575393577 0 0) 0x7fc43c0b2b70 con 0x7fc43c15a030 2023-10-06T02:25:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.168+0000 7fc44163f700 1 --2- 172.21.15.6:0/4275928292 >> v2:172.21.15.175:3300/0 conn(0x7fc43c086ff0 0x7fc43c087470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:25:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.169+0000 7fc442641700 1 --2- 172.21.15.6:0/4275928292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc43c0b21b0 0x7fc43c0b2630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009e60 tx=0x7fc42c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeb747ab4aab4113 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.169+0000 7fc440e3e700 1 -- 172.21.15.6:0/4275928292 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c00e070 con 0x7fc43c0b21b0 2023-10-06T02:25:00.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.169+0000 7fc440e3e700 1 -- 172.21.15.6:0/4275928292 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42c00bb60 con 0x7fc43c0b21b0 2023-10-06T02:25:00.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.169+0000 7fc440e3e700 1 -- 172.21.15.6:0/4275928292 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c012430 con 0x7fc43c0b21b0 2023-10-06T02:25:00.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.169+0000 7fc4440a4700 1 -- 172.21.15.6:0/4275928292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc43c0b21b0 msgr2=0x7fc43c0b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.169+0000 7fc4440a4700 1 --2- 172.21.15.6:0/4275928292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc43c0b21b0 0x7fc43c0b2630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009e60 tx=0x7fc42c009780 comp rx=0 tx=0).stop 2023-10-06T02:25:00.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.169+0000 7fc4440a4700 1 -- 172.21.15.6:0/4275928292 shutdown_connections 2023-10-06T02:25:00.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.169+0000 7fc4440a4700 1 --2- 172.21.15.6:0/4275928292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc43c0b21b0 0x7fc43c0b2630 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.169+0000 7fc4440a4700 1 --2- 172.21.15.6:0/4275928292 >> v2:172.21.15.175:3300/0 conn(0x7fc43c086ff0 0x7fc43c087470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.169+0000 7fc4440a4700 1 -- 172.21.15.6:0/4275928292 >> 172.21.15.6:0/4275928292 conn(0x7fc43c068680 msgr2=0x7fc43c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:00.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.169+0000 7fc4440a4700 1 -- 172.21.15.6:0/4275928292 shutdown_connections 2023-10-06T02:25:00.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.169+0000 7fc4440a4700 1 -- 172.21.15.6:0/4275928292 wait complete. 2023-10-06T02:25:00.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.170+0000 7fc4440a4700 1 Processor -- start 2023-10-06T02:25:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.170+0000 7fc4440a4700 1 -- start start 2023-10-06T02:25:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.171+0000 7fc4440a4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc43c086ff0 0x7fc43c15c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.171+0000 7fc4440a4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc43c0b21b0 0x7fc43c158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.171+0000 7fc4440a4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc43c15a030 0x7fc43c159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.171+0000 7fc4440a4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c15c8b0 con 0x7fc43c15a030 2023-10-06T02:25:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.171+0000 7fc4440a4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c15c040 con 0x7fc43c0b21b0 2023-10-06T02:25:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.171+0000 7fc4440a4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c0c4000 con 0x7fc43c086ff0 2023-10-06T02:25:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.171+0000 7fc442641700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc43c15a030 0x7fc43c159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.171+0000 7fc442641700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc43c15a030 0x7fc43c159020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53664/0 (socket says 172.21.15.6:53664) 2023-10-06T02:25:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.171+0000 7fc442641700 1 -- 172.21.15.6:0/961771121 learned_addr learned my addr 172.21.15.6:0/961771121 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.171+0000 7fc44163f700 1 --2- 172.21.15.6:0/961771121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc43c0b21b0 0x7fc43c158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.171+0000 7fc441e40700 1 --2- 172.21.15.6:0/961771121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc43c086ff0 0x7fc43c15c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.172+0000 7fc442641700 1 -- 172.21.15.6:0/961771121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc43c086ff0 msgr2=0x7fc43c15c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.172+0000 7fc442641700 1 --2- 172.21.15.6:0/961771121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc43c086ff0 0x7fc43c15c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.172+0000 7fc442641700 1 -- 172.21.15.6:0/961771121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc43c0b21b0 msgr2=0x7fc43c158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.172+0000 7fc442641700 1 --2- 172.21.15.6:0/961771121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc43c0b21b0 0x7fc43c158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.172+0000 7fc442641700 1 -- 172.21.15.6:0/961771121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc430009420 con 0x7fc43c15a030 2023-10-06T02:25:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.172+0000 7fc44163f700 1 --2- 172.21.15.6:0/961771121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc43c0b21b0 0x7fc43c158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.172+0000 7fc442641700 1 --2- 172.21.15.6:0/961771121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc43c15a030 0x7fc43c159020 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00b6c0 tx=0x7fc42c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.172+0000 7fc439ffb700 1 -- 172.21.15.6:0/961771121 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c027470 con 0x7fc43c15a030 2023-10-06T02:25:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.172+0000 7fc439ffb700 1 -- 172.21.15.6:0/961771121 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42c0275d0 con 0x7fc43c15a030 2023-10-06T02:25:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.172+0000 7fc439ffb700 1 -- 172.21.15.6:0/961771121 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c027990 con 0x7fc43c15a030 2023-10-06T02:25:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.172+0000 7fc4440a4700 1 -- 172.21.15.6:0/961771121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc42c009a20 con 0x7fc43c15a030 2023-10-06T02:25:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.172+0000 7fc4440a4700 1 -- 172.21.15.6:0/961771121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c0c45c0 con 0x7fc43c15a030 2023-10-06T02:25:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.173+0000 7fc4440a4700 1 -- 172.21.15.6:0/961771121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43c088700 con 0x7fc43c15a030 2023-10-06T02:25:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.173+0000 7fc439ffb700 1 -- 172.21.15.6:0/961771121 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc42c024070 con 0x7fc43c15a030 2023-10-06T02:25:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.174+0000 7fc439ffb700 1 --2- 172.21.15.6:0/961771121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc428066f30 0x7fc4280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.174+0000 7fc439ffb700 1 -- 172.21.15.6:0/961771121 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fc42c0872b0 con 0x7fc43c15a030 2023-10-06T02:25:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.174+0000 7fc441e40700 1 --2- 172.21.15.6:0/961771121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc428066f30 0x7fc4280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.175+0000 7fc441e40700 1 --2- 172.21.15.6:0/961771121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc428066f30 0x7fc4280693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc43c1597a0 tx=0x7fc434009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.178+0000 7fc439ffb700 1 -- 172.21.15.6:0/961771121 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc42c054230 con 0x7fc43c15a030 2023-10-06T02:25:00.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:00.455+0000 7fc4440a4700 1 -- 172.21.15.6:0/961771121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fc43c0aff30 con 0x7fc43c15a030 2023-10-06T02:25:01.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.031+0000 7fc439ffb700 1 -- 172.21.15.6:0/961771121 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v90) v1 ==== 107+0+0 (secure 0 0 0) 0x7fc42c057850 con 0x7fc43c15a030 2023-10-06T02:25:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.033+0000 7fc4440a4700 1 -- 172.21.15.6:0/961771121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc428066f30 msgr2=0x7fc4280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.033+0000 7fc4440a4700 1 --2- 172.21.15.6:0/961771121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc428066f30 0x7fc4280693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc43c1597a0 tx=0x7fc434009040 comp rx=0 tx=0).stop 2023-10-06T02:25:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.033+0000 7fc4440a4700 1 -- 172.21.15.6:0/961771121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc43c15a030 msgr2=0x7fc43c159020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.033+0000 7fc4440a4700 1 --2- 172.21.15.6:0/961771121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc43c15a030 0x7fc43c159020 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00b6c0 tx=0x7fc42c019000 comp rx=0 tx=0).stop 2023-10-06T02:25:01.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.033+0000 7fc4440a4700 1 -- 172.21.15.6:0/961771121 shutdown_connections 2023-10-06T02:25:01.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.033+0000 7fc4440a4700 1 --2- 172.21.15.6:0/961771121 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc428066f30 0x7fc4280693e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.033+0000 7fc4440a4700 1 --2- 172.21.15.6:0/961771121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc43c15a030 0x7fc43c159020 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.033+0000 7fc4440a4700 1 --2- 172.21.15.6:0/961771121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc43c086ff0 0x7fc43c15c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.033+0000 7fc4440a4700 1 --2- 172.21.15.6:0/961771121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc43c0b21b0 0x7fc43c158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.033+0000 7fc4440a4700 1 -- 172.21.15.6:0/961771121 >> 172.21.15.6:0/961771121 conn(0x7fc43c068680 msgr2=0x7fc43c0cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:01.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.034+0000 7fc4440a4700 1 -- 172.21.15.6:0/961771121 shutdown_connections 2023-10-06T02:25:01.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.034+0000 7fc4440a4700 1 -- 172.21.15.6:0/961771121 wait complete. 2023-10-06T02:25:01.036 INFO:teuthology.orchestra.run.smithi006.stderr:nothing to do: rank is not damaged 2023-10-06T02:25:01.050 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:25:01.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.089+0000 7fe80585d000 1 Processor -- start 2023-10-06T02:25:01.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.089+0000 7fe80585d000 1 -- start start 2023-10-06T02:25:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.090+0000 7fe80585d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa56957c00 0x55aa5695d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.090+0000 7fe80585d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa5695dae0 0x55aa56957fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.090+0000 7fe80585d000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa56958510 0x55aa56894950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.090+0000 7fe80585d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa567dd980 con 0x55aa56957c00 2023-10-06T02:25:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.090+0000 7fe80585d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa567dd620 con 0x55aa5695dae0 2023-10-06T02:25:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.090+0000 7fe80585d000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa567d4400 con 0x55aa56958510 2023-10-06T02:25:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.090+0000 7fe7fea98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa56957c00 0x55aa5695d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.090+0000 7fe7fea98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa56957c00 0x55aa5695d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53690/0 (socket says 172.21.15.6:53690) 2023-10-06T02:25:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.090+0000 7fe7fea98700 1 -- 172.21.15.6:0/3805504103 learned_addr learned my addr 172.21.15.6:0/3805504103 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.090+0000 7fe7ff299700 1 --2- 172.21.15.6:0/3805504103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa56958510 0x55aa56894950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.090+0000 7fe7fe297700 1 --2- 172.21.15.6:0/3805504103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa5695dae0 0x55aa56957fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.090+0000 7fe7fea98700 1 -- 172.21.15.6:0/3805504103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa56958510 msgr2=0x55aa56894950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.090+0000 7fe7fea98700 1 --2- 172.21.15.6:0/3805504103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa56958510 0x55aa56894950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.090+0000 7fe7fea98700 1 -- 172.21.15.6:0/3805504103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa5695dae0 msgr2=0x55aa56957fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.090+0000 7fe7fea98700 1 --2- 172.21.15.6:0/3805504103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa5695dae0 0x55aa56957fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.090+0000 7fe7fea98700 1 -- 172.21.15.6:0/3805504103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa567ec3d0 con 0x55aa56957c00 2023-10-06T02:25:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.091+0000 7fe7fea98700 1 --2- 172.21.15.6:0/3805504103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa56957c00 0x55aa5695d4c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800a870 tx=0x7fe7f8007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b79ded1ae44883 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.091+0000 7fe7fd295700 1 -- 172.21.15.6:0/3805504103 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f80107b0 con 0x55aa56957c00 2023-10-06T02:25:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.091+0000 7fe7fd295700 1 -- 172.21.15.6:0/3805504103 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f8010910 con 0x55aa56957c00 2023-10-06T02:25:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.091+0000 7fe7fd295700 1 -- 172.21.15.6:0/3805504103 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8010cb0 con 0x55aa56957c00 2023-10-06T02:25:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.091+0000 7fe80585d000 1 -- 172.21.15.6:0/3805504103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa56957c00 msgr2=0x55aa5695d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.091+0000 7fe80585d000 1 --2- 172.21.15.6:0/3805504103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa56957c00 0x55aa5695d4c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800a870 tx=0x7fe7f8007040 comp rx=0 tx=0).stop 2023-10-06T02:25:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.091+0000 7fe80585d000 1 -- 172.21.15.6:0/3805504103 shutdown_connections 2023-10-06T02:25:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.091+0000 7fe80585d000 1 --2- 172.21.15.6:0/3805504103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa56958510 0x55aa56894950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.091+0000 7fe80585d000 1 --2- 172.21.15.6:0/3805504103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa56957c00 0x55aa5695d4c0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.091+0000 7fe80585d000 1 --2- 172.21.15.6:0/3805504103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa5695dae0 0x55aa56957fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.091+0000 7fe80585d000 1 -- 172.21.15.6:0/3805504103 >> 172.21.15.6:0/3805504103 conn(0x55aa56892d50 msgr2=0x55aa56893b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.091+0000 7fe80585d000 1 -- 172.21.15.6:0/3805504103 shutdown_connections 2023-10-06T02:25:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.091+0000 7fe80585d000 1 -- 172.21.15.6:0/3805504103 wait complete. 2023-10-06T02:25:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.092+0000 7fe80585d000 1 Processor -- start 2023-10-06T02:25:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.092+0000 7fe80585d000 1 -- start start 2023-10-06T02:25:01.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.093+0000 7fe80585d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa56957c00 0x55aa568940b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.093+0000 7fe80585d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa56958510 0x55aa56958ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.093+0000 7fe80585d000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa5695dae0 0x55aa5694c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.093+0000 7fe80585d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa56959370 con 0x55aa56957c00 2023-10-06T02:25:01.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.093+0000 7fe80585d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa56959610 con 0x55aa56958510 2023-10-06T02:25:01.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.093+0000 7fe80585d000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa569598b0 con 0x55aa5695dae0 2023-10-06T02:25:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.093+0000 7fe7fea98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa56957c00 0x55aa568940b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.093+0000 7fe7fea98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa56957c00 0x55aa568940b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53698/0 (socket says 172.21.15.6:53698) 2023-10-06T02:25:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.093+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 learned_addr learned my addr 172.21.15.6:0/3950112831 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.093+0000 7fe7ff299700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa5695dae0 0x55aa5694c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.093+0000 7fe7fe297700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa56958510 0x55aa56958ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.093+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa5695dae0 msgr2=0x55aa5694c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.093+0000 7fe7fea98700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa5695dae0 0x55aa5694c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.093+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa56958510 msgr2=0x55aa56958ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.093+0000 7fe7fea98700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa56958510 0x55aa56958ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.093+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f800a4c0 con 0x55aa56957c00 2023-10-06T02:25:01.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.093+0000 7fe7fea98700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa56957c00 0x55aa568940b0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8010570 tx=0x7fe7f801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:01.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.094+0000 7fe7f77fe700 1 -- 172.21.15.6:0/3950112831 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8010a80 con 0x55aa56957c00 2023-10-06T02:25:01.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.094+0000 7fe7f77fe700 1 -- 172.21.15.6:0/3950112831 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f8010c20 con 0x55aa56957c00 2023-10-06T02:25:01.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.094+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55aa567dfae0 con 0x55aa56957c00 2023-10-06T02:25:01.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.094+0000 7fe7f77fe700 1 -- 172.21.15.6:0/3950112831 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f801c660 con 0x55aa56957c00 2023-10-06T02:25:01.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.094+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aa567df540 con 0x55aa56957c00 2023-10-06T02:25:01.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.095+0000 7fe7f77fe700 1 -- 172.21.15.6:0/3950112831 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7f8003040 con 0x55aa56957c00 2023-10-06T02:25:01.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.095+0000 7fe7f77fe700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7e0065890 0x7fe7e0067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.095+0000 7fe7f77fe700 1 -- 172.21.15.6:0/3950112831 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fe7f80850e0 con 0x55aa56957c00 2023-10-06T02:25:01.108 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:25:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.096+0000 7fe7fe297700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7e0065890 0x7fe7e0067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.096+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55aa56976250 0x55aa56976650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.096+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56976b90 con 0x55aa56976250 2023-10-06T02:25:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.096+0000 7fe7ff299700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55aa56976250 0x55aa56976650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.096+0000 7fe7ff299700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55aa56976250 0x55aa56976650 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.096+0000 7fe7fe297700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7e0065890 0x7fe7e0067d40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe7e80057a0 tx=0x7fe7e800c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.097+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v96'11 uv4 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001710 con 0x55aa56976250 2023-10-06T02:25:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.097+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56976f70 con 0x55aa56976250 2023-10-06T02:25:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.099+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v96'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.099+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56982880 con 0x55aa56976250 2023-10-06T02:25:01.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.101+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v96'13 uv13 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.111 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:25:01.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.101+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56983c40 con 0x55aa56976250 2023-10-06T02:25:01.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.102+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v96'14 uv14 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.102+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56983ff0 con 0x55aa56976250 2023-10-06T02:25:01.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.105+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v96'15 uv15 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.105+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56982c30 con 0x55aa56976250 2023-10-06T02:25:01.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.107+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v96'16 uv16 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.107+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56983030 con 0x55aa56976250 2023-10-06T02:25:01.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.110+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v96'17 uv6 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.110+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569833e0 con 0x55aa56976250 2023-10-06T02:25:01.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.113+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v96'18 uv18 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.113+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569833e0 con 0x55aa56976250 2023-10-06T02:25:01.116 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:25:01.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.115+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v96'19 uv19 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.115+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569833e0 con 0x55aa56976250 2023-10-06T02:25:01.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.117+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v96'20 uv20 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.117+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569833e0 con 0x55aa56976250 2023-10-06T02:25:01.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.119+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v96'21 uv21 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.119+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569833e0 con 0x55aa56976250 2023-10-06T02:25:01.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.122+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v96'22 uv22 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.122+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569833e0 con 0x55aa56976250 2023-10-06T02:25:01.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.124+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v96'23 uv10 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.124+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569833e0 con 0x55aa56976250 2023-10-06T02:25:01.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.127+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v96'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.127+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569833e0 con 0x55aa56976250 2023-10-06T02:25:01.131 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:25:01.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.130+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v96'25 uv25 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.130+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569833e0 con 0x55aa56976250 2023-10-06T02:25:01.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.131+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v96'26 uv26 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.131+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569833e0 con 0x55aa56976250 2023-10-06T02:25:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.133+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v96'27 uv27 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.133+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569833e0 con 0x55aa56976250 2023-10-06T02:25:01.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.136+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v96'28 uv28 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.136+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569837c0 con 0x55aa56976250 2023-10-06T02:25:01.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.138+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v96'29 uv29 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.138+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569837c0 con 0x55aa56976250 2023-10-06T02:25:01.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.141+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v96'30 uv2 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.141+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569837c0 con 0x55aa56976250 2023-10-06T02:25:01.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.144+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v96'31 uv31 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.144+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569837c0 con 0x55aa56976250 2023-10-06T02:25:01.148 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:25:01.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.146+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v96'32 uv32 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.146+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569837c0 con 0x55aa56976250 2023-10-06T02:25:01.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.149+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v96'33 uv33 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.149+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569837c0 con 0x55aa56976250 2023-10-06T02:25:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.150+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v96'34 uv34 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.150+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569837c0 con 0x55aa56976250 2023-10-06T02:25:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.151+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v96'35 uv35 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.151+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569837c0 con 0x55aa56976250 2023-10-06T02:25:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.152+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v96'36 uv8 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.152+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569837c0 con 0x55aa56976250 2023-10-06T02:25:01.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.153+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v96'37 uv37 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.153+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569837c0 con 0x55aa56976250 2023-10-06T02:25:01.156 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:25:01.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.154+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v96'38 uv38 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.155+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569837c0 con 0x55aa56976250 2023-10-06T02:25:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.156+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v96'39 uv39 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.156+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569837c0 con 0x55aa56976250 2023-10-06T02:25:01.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.156+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v96'40 uv40 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.156+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569837c0 con 0x55aa56976250 2023-10-06T02:25:01.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.158+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v96'41 uv41 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa56976250 2023-10-06T02:25:01.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.158+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55aa569837c0 0x55aa569868c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.158+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56986e00 con 0x55aa569837c0 2023-10-06T02:25:01.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.158+0000 7fe7fea98700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55aa569837c0 0x55aa569868c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.158+0000 7fe7fea98700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55aa569837c0 0x55aa569868c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.159+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v96'19 uv15 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.159+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569871b0 con 0x55aa569837c0 2023-10-06T02:25:01.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.160+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v96'20 uv20 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.160+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56987560 con 0x55aa569837c0 2023-10-06T02:25:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.161+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v96'21 uv21 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.163 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:25:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.161+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56987e00 con 0x55aa569837c0 2023-10-06T02:25:01.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.163+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v96'22 uv22 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.163+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569881b0 con 0x55aa569837c0 2023-10-06T02:25:01.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.164+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v96'23 uv23 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.164+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56988560 con 0x55aa569837c0 2023-10-06T02:25:01.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.164+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v96'24 uv18 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.164+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56988910 con 0x55aa569837c0 2023-10-06T02:25:01.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.165+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v96'25 uv25 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.165+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56988cc0 con 0x55aa569837c0 2023-10-06T02:25:01.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.166+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v96'26 uv26 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.168 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:25:01.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.166+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56988cc0 con 0x55aa569837c0 2023-10-06T02:25:01.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.167+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v96'27 uv27 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.167+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56988cc0 con 0x55aa569837c0 2023-10-06T02:25:01.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.168+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v96'28 uv28 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.168+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56988cc0 con 0x55aa569837c0 2023-10-06T02:25:01.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.169+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v96'29 uv16 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.169+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56988cc0 con 0x55aa569837c0 2023-10-06T02:25:01.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.170+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v96'30 uv30 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.170+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56988cc0 con 0x55aa569837c0 2023-10-06T02:25:01.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.171+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v96'31 uv31 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.172 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:25:01.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.171+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698c3e0 con 0x55aa569837c0 2023-10-06T02:25:01.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.172+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v96'32 uv32 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.172+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698c3e0 con 0x55aa569837c0 2023-10-06T02:25:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.175+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v96'33 uv33 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.175+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56988cc0 con 0x55aa569837c0 2023-10-06T02:25:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.176+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v96'34 uv2 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.176+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56988cc0 con 0x55aa569837c0 2023-10-06T02:25:01.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.179+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v96'35 uv35 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.179+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56988cc0 con 0x55aa569837c0 2023-10-06T02:25:01.183 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:25:01.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.182+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v96'36 uv36 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.182+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56989cd0 con 0x55aa569837c0 2023-10-06T02:25:01.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.184+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v96'37 uv37 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.184+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56989cd0 con 0x55aa569837c0 2023-10-06T02:25:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.185+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v96'38 uv38 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.185+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56988cc0 con 0x55aa569837c0 2023-10-06T02:25:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.186+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v96'39 uv39 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.186+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55aa569891d0 0x55aa5698b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.186+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698baf0 con 0x55aa569891d0 2023-10-06T02:25:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.186+0000 7fe7fe297700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55aa569891d0 0x55aa5698b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.187+0000 7fe7fe297700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55aa569891d0 0x55aa5698b5b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:01.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.188+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v96'3 uv2 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.188+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698bf60 con 0x55aa569891d0 2023-10-06T02:25:01.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.189+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v96'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.189+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56987a00 con 0x55aa569891d0 2023-10-06T02:25:01.191 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:25:01.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.190+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v96'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.190+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698de30 con 0x55aa569891d0 2023-10-06T02:25:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.191+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v96'6 uv6 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.191+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698e1e0 con 0x55aa569891d0 2023-10-06T02:25:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.192+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v96'7 uv7 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.192+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698ce20 con 0x55aa569891d0 2023-10-06T02:25:01.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.193+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v96'8 uv8 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.193+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698d220 con 0x55aa569891d0 2023-10-06T02:25:01.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.194+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v96'3 uv2 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.194+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698d220 con 0x55aa569891d0 2023-10-06T02:25:01.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.195+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v96'4 uv4 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.195+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698d220 con 0x55aa569891d0 2023-10-06T02:25:01.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.196+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v96'5 uv5 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.197 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:25:01.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.196+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698d220 con 0x55aa569891d0 2023-10-06T02:25:01.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.198+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v96'6 uv6 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.198+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698d220 con 0x55aa569837c0 2023-10-06T02:25:01.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.201+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v96'3 uv2 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.201+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698d220 con 0x55aa569837c0 2023-10-06T02:25:01.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.203+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v96'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.203+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698d220 con 0x55aa569837c0 2023-10-06T02:25:01.205 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:25:01.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.203+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v96'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.204+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698d220 con 0x55aa569837c0 2023-10-06T02:25:01.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.204+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v96'6 uv6 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.205+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698d220 con 0x55aa569837c0 2023-10-06T02:25:01.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.205+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v96'7 uv7 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.206+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698d220 con 0x55aa569837c0 2023-10-06T02:25:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.207+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v96'8 uv8 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa569837c0 2023-10-06T02:25:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.207+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55aa5698e590 0x55aa56990970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.207+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56990eb0 con 0x55aa5698e590 2023-10-06T02:25:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.207+0000 7fe7ff299700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55aa5698e590 0x55aa56990970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.207+0000 7fe7ff299700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55aa5698e590 0x55aa56990970 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:01.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.208+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v96'4 uv2 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa5698e590 2023-10-06T02:25:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.208+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56990eb0 con 0x55aa5698e590 2023-10-06T02:25:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.209+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v96'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa5698e590 2023-10-06T02:25:01.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.209+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56990eb0 con 0x55aa5698e590 2023-10-06T02:25:01.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.210+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v96'6 uv6 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa5698e590 2023-10-06T02:25:01.212 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:25:01.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.210+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56991ec0 con 0x55aa5698e590 2023-10-06T02:25:01.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.211+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v96'7 uv7 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa5698e590 2023-10-06T02:25:01.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.212+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56991ec0 con 0x55aa5698e590 2023-10-06T02:25:01.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.213+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v96'8 uv8 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa5698e590 2023-10-06T02:25:01.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.213+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56990eb0 con 0x55aa5698e590 2023-10-06T02:25:01.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.214+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v96'9 uv9 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa5698e590 2023-10-06T02:25:01.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.214+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56990eb0 con 0x55aa5698e590 2023-10-06T02:25:01.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.215+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v96'10 uv3 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa5698e590 2023-10-06T02:25:01.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.215+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56990eb0 con 0x55aa5698e590 2023-10-06T02:25:01.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.216+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v96'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa5698e590 2023-10-06T02:25:01.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.216+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56990eb0 con 0x55aa5698e590 2023-10-06T02:25:01.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.217+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v96'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa5698e590 2023-10-06T02:25:01.219 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:25:01.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.217+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56990eb0 con 0x55aa5698e590 2023-10-06T02:25:01.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.218+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v96'13 uv13 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa5698e590 2023-10-06T02:25:01.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.218+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56990eb0 con 0x55aa5698e590 2023-10-06T02:25:01.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.219+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v96'14 uv14 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa5698e590 2023-10-06T02:25:01.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.220+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55aa56991530 0x55aa56993910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.220+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56993ee0 con 0x55aa56991530 2023-10-06T02:25:01.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.220+0000 7fe7fea98700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55aa56991530 0x55aa56993910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.220+0000 7fe7fea98700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55aa56991530 0x55aa56993910 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:01.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.221+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v96'2 uv1 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa56991530 2023-10-06T02:25:01.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.221+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569942c0 con 0x55aa56991530 2023-10-06T02:25:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.222+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v96'3 uv3 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa56991530 2023-10-06T02:25:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.222+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569942c0 con 0x55aa56991530 2023-10-06T02:25:01.226 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:25:01.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.225+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v96'4 uv4 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa56991530 2023-10-06T02:25:01.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.225+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569942c0 con 0x55aa56991530 2023-10-06T02:25:01.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.227+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v96'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa56991530 2023-10-06T02:25:01.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.227+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569942c0 con 0x55aa56991530 2023-10-06T02:25:01.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.230+0000 7fe7fea98700 1 -- 172.21.15.6:0/3950112831 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v96'6 uv6 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe7f8054170 con 0x55aa56991530 2023-10-06T02:25:01.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.230+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569942c0 con 0x55aa569891d0 2023-10-06T02:25:01.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.231+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v96'3 uv2 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.231+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569942c0 con 0x55aa569891d0 2023-10-06T02:25:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.233+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v96'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.233+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569942c0 con 0x55aa569891d0 2023-10-06T02:25:01.238 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:25:01.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.237+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v96'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.237+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569952d0 con 0x55aa569891d0 2023-10-06T02:25:01.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.240+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v96'6 uv6 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.240+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569952d0 con 0x55aa569891d0 2023-10-06T02:25:01.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.243+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v96'7 uv7 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.243+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569942c0 con 0x55aa569891d0 2023-10-06T02:25:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.245+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v96'8 uv8 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.245+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55aa56994940 0x55aa56994d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.245+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569976e0 con 0x55aa56994940 2023-10-06T02:25:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.245+0000 7fe7fe297700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55aa56994940 0x55aa56994d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.246+0000 7fe7fe297700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55aa56994940 0x55aa56994d10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:01.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.248+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v96'4 uv3 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa56994940 2023-10-06T02:25:01.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.248+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569976e0 con 0x55aa56994940 2023-10-06T02:25:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.250+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v96'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa56994940 2023-10-06T02:25:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.250+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569976e0 con 0x55aa56994940 2023-10-06T02:25:01.254 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:25:01.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.253+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v96'6 uv6 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa56994940 2023-10-06T02:25:01.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.253+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa569976e0 con 0x55aa56994940 2023-10-06T02:25:01.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.256+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v96'7 uv7 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa56994940 2023-10-06T02:25:01.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.256+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698c9b0 con 0x55aa56994940 2023-10-06T02:25:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.259+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v96'8 uv8 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa56994940 2023-10-06T02:25:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.259+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698c9b0 con 0x55aa56994940 2023-10-06T02:25:01.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.261+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v96'9 uv1 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa56994940 2023-10-06T02:25:01.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.261+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698c930 con 0x55aa56994940 2023-10-06T02:25:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.264+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v96'10 uv10 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa56994940 2023-10-06T02:25:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.264+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698c930 con 0x55aa56994940 2023-10-06T02:25:01.268 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:25:01.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.266+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v96'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa56994940 2023-10-06T02:25:01.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.266+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5698c930 con 0x55aa56994940 2023-10-06T02:25:01.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.269+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v96'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa56994940 2023-10-06T02:25:01.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.269+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5699a450 con 0x55aa56994940 2023-10-06T02:25:01.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.274+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v96'13 uv13 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa56994940 2023-10-06T02:25:01.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.274+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56997bd0 con 0x55aa569891d0 2023-10-06T02:25:01.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.275+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v96'4 uv3 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.275+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56997bd0 con 0x55aa569891d0 2023-10-06T02:25:01.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.278+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v96'5 uv5 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.278+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56997bd0 con 0x55aa569891d0 2023-10-06T02:25:01.282 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:25:01.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.281+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v96'6 uv6 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.281+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56997bd0 con 0x55aa569891d0 2023-10-06T02:25:01.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.283+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v96'7 uv7 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.283+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55aa569984e0 0x55aa5699aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.283+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56997bd0 con 0x55aa569984e0 2023-10-06T02:25:01.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.284+0000 7fe7ff299700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55aa569984e0 0x55aa5699aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.284+0000 7fe7ff299700 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55aa569984e0 0x55aa5699aba0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.285+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v96'3 uv2 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa569984e0 2023-10-06T02:25:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.285+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56997bd0 con 0x55aa569984e0 2023-10-06T02:25:01.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.286+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v96'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa569984e0 2023-10-06T02:25:01.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.286+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56997bd0 con 0x55aa569984e0 2023-10-06T02:25:01.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.287+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v96'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa569984e0 2023-10-06T02:25:01.288 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:25:01.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.287+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56997bd0 con 0x55aa569984e0 2023-10-06T02:25:01.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.288+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v96'6 uv6 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa569984e0 2023-10-06T02:25:01.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.288+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56997bd0 con 0x55aa569984e0 2023-10-06T02:25:01.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.289+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v96'7 uv7 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa569984e0 2023-10-06T02:25:01.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.289+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56997bd0 con 0x55aa569984e0 2023-10-06T02:25:01.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.290+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v96'8 uv8 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa569984e0 2023-10-06T02:25:01.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.290+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56997bd0 con 0x55aa5698e590 2023-10-06T02:25:01.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.291+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v96'2 uv1 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa5698e590 2023-10-06T02:25:01.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.291+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56997bd0 con 0x55aa5698e590 2023-10-06T02:25:01.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.292+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v96'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa5698e590 2023-10-06T02:25:01.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.292+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56997bd0 con 0x55aa5698e590 2023-10-06T02:25:01.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.293+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v96'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa5698e590 2023-10-06T02:25:01.295 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:25:01.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.293+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa56997bd0 con 0x55aa5698e590 2023-10-06T02:25:01.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.294+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v96'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa5698e590 2023-10-06T02:25:01.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.294+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5699b0e0 con 0x55aa5698e590 2023-10-06T02:25:01.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.295+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v96'6 uv6 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe7f0001430 con 0x55aa5698e590 2023-10-06T02:25:01.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.295+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5699b0e0 con 0x55aa569891d0 2023-10-06T02:25:01.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.296+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v96'7 uv3 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.296+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5699b0e0 con 0x55aa569891d0 2023-10-06T02:25:01.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.297+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v96'8 uv8 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.297+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5699b0e0 con 0x55aa569891d0 2023-10-06T02:25:01.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.299+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v96'9 uv9 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.300 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:25:01.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.299+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5699b0e0 con 0x55aa569891d0 2023-10-06T02:25:01.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.301+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v96'10 uv10 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.301+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5699b0e0 con 0x55aa569891d0 2023-10-06T02:25:01.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.304+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v96'11 uv11 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.304+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5699b0e0 con 0x55aa569891d0 2023-10-06T02:25:01.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.306+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v96'12 uv6 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.306+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5699b0e0 con 0x55aa569891d0 2023-10-06T02:25:01.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.309+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v96'13 uv13 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.309+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5699b0e0 con 0x55aa569891d0 2023-10-06T02:25:01.313 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:25:01.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.311+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v96'14 uv14 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.311+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5699c0f0 con 0x55aa569891d0 2023-10-06T02:25:01.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.314+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v96'15 uv15 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.314+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5699c0f0 con 0x55aa569891d0 2023-10-06T02:25:01.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.317+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v96'16 uv16 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.317+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5699b0e0 con 0x55aa569891d0 2023-10-06T02:25:01.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.319+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v96'17 uv17 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.319+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v8 -- 0x55aa5699b5d0 con 0x55aa569891d0 2023-10-06T02:25:01.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.320+0000 7fe7fe297700 1 -- 172.21.15.6:0/3950112831 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v96'18 uv18 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe7e8008d80 con 0x55aa569891d0 2023-10-06T02:25:01.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.320+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55aa569891d0 msgr2=0x55aa5698b5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.320+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55aa569891d0 0x55aa5698b5b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.320+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55aa56976250 msgr2=0x55aa56976650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.320+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55aa56976250 0x55aa56976650 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.320+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55aa56994940 msgr2=0x55aa56994d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.320+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55aa56994940 0x55aa56994d10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.320+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55aa569837c0 msgr2=0x55aa569868c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.320+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55aa569837c0 0x55aa569868c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55aa569984e0 msgr2=0x55aa5699aba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55aa569984e0 0x55aa5699aba0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55aa56991530 msgr2=0x55aa56993910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55aa56991530 0x55aa56993910 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 reap_dead start 2023-10-06T02:25:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe7ff299700 1 -- 172.21.15.6:0/3950112831 reap_dead start 2023-10-06T02:25:01.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55aa5698e590 msgr2=0x55aa56990970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55aa5698e590 0x55aa56990970 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7e0065890 msgr2=0x7fe7e0067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7e0065890 0x7fe7e0067d40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe7e80057a0 tx=0x7fe7e800c040 comp rx=0 tx=0).stop 2023-10-06T02:25:01.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa56957c00 msgr2=0x55aa568940b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa56957c00 0x55aa568940b0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8010570 tx=0x7fe7f801b000 comp rx=0 tx=0).stop 2023-10-06T02:25:01.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 shutdown_connections 2023-10-06T02:25:01.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa56957c00 0x55aa568940b0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7e0065890 0x7fe7e0067d40 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe80585d000 1 --2- 172.21.15.6:0/3950112831 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55aa5698e590 0x55aa56990970 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 >> 172.21.15.6:0/3950112831 conn(0x55aa56892d50 msgr2=0x55aa5695c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:01.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 shutdown_connections 2023-10-06T02:25:01.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.321+0000 7fe80585d000 1 -- 172.21.15.6:0/3950112831 wait complete. 2023-10-06T02:25:01.327 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 10000000000.00000000 2023-10-06T02:25:01.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.404+0000 7f793e020000 1 Processor -- start 2023-10-06T02:25:01.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.404+0000 7f793e020000 1 -- start start 2023-10-06T02:25:01.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.404+0000 7f793e020000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e715f96850 0x55e716040bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.404+0000 7f793e020000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e715f98ab0 0x55e71604b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.404+0000 7f793e020000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e715f98e80 0x55e71604b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.404+0000 7f793e020000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e715eb4980 con 0x55e715f98e80 2023-10-06T02:25:01.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.404+0000 7f793e020000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e715eb4620 con 0x55e715f98ab0 2023-10-06T02:25:01.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.404+0000 7f793e020000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e715eab400 con 0x55e715f96850 2023-10-06T02:25:01.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.404+0000 7f7937a5c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e715f98e80 0x55e71604b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.404+0000 7f7937a5c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e715f98e80 0x55e71604b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53716/0 (socket says 172.21.15.6:53716) 2023-10-06T02:25:01.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.404+0000 7f7937a5c700 1 -- 172.21.15.6:0/1466614566 learned_addr learned my addr 172.21.15.6:0/1466614566 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:01.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.404+0000 7f7936a5a700 1 --2- 172.21.15.6:0/1466614566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e715f98ab0 0x55e71604b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.404+0000 7f793725b700 1 --2- 172.21.15.6:0/1466614566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e715f96850 0x55e716040bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f7937a5c700 1 -- 172.21.15.6:0/1466614566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e715f96850 msgr2=0x55e716040bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:01.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f7937a5c700 1 --2- 172.21.15.6:0/1466614566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e715f96850 0x55e716040bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f7937a5c700 1 -- 172.21.15.6:0/1466614566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e715f98ab0 msgr2=0x55e71604b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:01.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f7937a5c700 1 --2- 172.21.15.6:0/1466614566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e715f98ab0 0x55e71604b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f7937a5c700 1 -- 172.21.15.6:0/1466614566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c005db0 con 0x55e715f98e80 2023-10-06T02:25:01.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f793725b700 1 --2- 172.21.15.6:0/1466614566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e715f96850 0x55e716040bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:01.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f7937a5c700 1 --2- 172.21.15.6:0/1466614566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e715f98e80 0x55e71604b870 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f793000b620 tx=0x7f7930007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bd1e6cbd3e7fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:01.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f7935a58700 1 -- 172.21.15.6:0/1466614566 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930014070 con 0x55e715f98e80 2023-10-06T02:25:01.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f7935a58700 1 -- 172.21.15.6:0/1466614566 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793000b050 con 0x55e715f98e80 2023-10-06T02:25:01.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f7935a58700 1 -- 172.21.15.6:0/1466614566 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793000f8a0 con 0x55e715f98e80 2023-10-06T02:25:01.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f793e020000 1 -- 172.21.15.6:0/1466614566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e715f98e80 msgr2=0x55e71604b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f793e020000 1 --2- 172.21.15.6:0/1466614566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e715f98e80 0x55e71604b870 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f793000b620 tx=0x7f7930007040 comp rx=0 tx=0).stop 2023-10-06T02:25:01.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f793e020000 1 -- 172.21.15.6:0/1466614566 shutdown_connections 2023-10-06T02:25:01.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f793e020000 1 --2- 172.21.15.6:0/1466614566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e715f98e80 0x55e71604b870 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f793e020000 1 --2- 172.21.15.6:0/1466614566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e715f96850 0x55e716040bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f793e020000 1 --2- 172.21.15.6:0/1466614566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e715f98ab0 0x55e71604b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f793e020000 1 -- 172.21.15.6:0/1466614566 >> 172.21.15.6:0/1466614566 conn(0x55e715fb0bd0 msgr2=0x55e715f96140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:01.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f793e020000 1 -- 172.21.15.6:0/1466614566 shutdown_connections 2023-10-06T02:25:01.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.405+0000 7f793e020000 1 -- 172.21.15.6:0/1466614566 wait complete. 2023-10-06T02:25:01.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.406+0000 7f793e020000 1 Processor -- start 2023-10-06T02:25:01.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.406+0000 7f793e020000 1 -- start start 2023-10-06T02:25:01.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.407+0000 7f793e020000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e715f96850 0x55e716034800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.407+0000 7f793e020000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e715f98ab0 0x55e71604f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.407+0000 7f793e020000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e715f98e80 0x55e7160409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.407+0000 7f793e020000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e716034d40 con 0x55e715f98ab0 2023-10-06T02:25:01.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.407+0000 7f793e020000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e71603de90 con 0x55e715f98e80 2023-10-06T02:25:01.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.407+0000 7f793e020000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e71603bed0 con 0x55e715f96850 2023-10-06T02:25:01.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.407+0000 7f7936a5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e715f98ab0 0x55e71604f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.407+0000 7f7936a5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e715f98ab0 0x55e71604f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53728/0 (socket says 172.21.15.6:53728) 2023-10-06T02:25:01.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.407+0000 7f793725b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e715f96850 0x55e716034800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.407+0000 7f7936a5a700 1 -- 172.21.15.6:0/358947995 learned_addr learned my addr 172.21.15.6:0/358947995 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:01.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.407+0000 7f7937a5c700 1 --2- 172.21.15.6:0/358947995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e715f98e80 0x55e7160409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.407+0000 7f7936a5a700 1 -- 172.21.15.6:0/358947995 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e715f96850 msgr2=0x55e716034800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.407+0000 7f7936a5a700 1 --2- 172.21.15.6:0/358947995 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e715f96850 0x55e716034800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.407+0000 7f7936a5a700 1 -- 172.21.15.6:0/358947995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e715f98e80 msgr2=0x55e7160409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.407+0000 7f7936a5a700 1 --2- 172.21.15.6:0/358947995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e715f98e80 0x55e7160409a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.407+0000 7f7936a5a700 1 -- 172.21.15.6:0/358947995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793000b1f0 con 0x55e715f98ab0 2023-10-06T02:25:01.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.407+0000 7f7936a5a700 1 --2- 172.21.15.6:0/358947995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e715f98ab0 0x55e71604f260 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f792c00ae50 tx=0x7f792c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:01.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.408+0000 7f791ffff700 1 -- 172.21.15.6:0/358947995 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c000c40 con 0x55e715f98ab0 2023-10-06T02:25:01.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.408+0000 7f791ffff700 1 -- 172.21.15.6:0/358947995 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c021070 con 0x55e715f98ab0 2023-10-06T02:25:01.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.408+0000 7f793e020000 1 -- 172.21.15.6:0/358947995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e715ec33d0 con 0x55e715f98ab0 2023-10-06T02:25:01.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.408+0000 7f791ffff700 1 -- 172.21.15.6:0/358947995 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c008c80 con 0x55e715f98ab0 2023-10-06T02:25:01.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.408+0000 7f793e020000 1 -- 172.21.15.6:0/358947995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e715eb6ae0 con 0x55e715f98ab0 2023-10-06T02:25:01.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.409+0000 7f791ffff700 1 -- 172.21.15.6:0/358947995 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f792c023030 con 0x55e715f98ab0 2023-10-06T02:25:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.409+0000 7f791ffff700 1 --2- 172.21.15.6:0/358947995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f79240658c0 0x7f7924067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.409+0000 7f791ffff700 1 -- 172.21.15.6:0/358947995 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f792c085410 con 0x55e715f98ab0 2023-10-06T02:25:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.409+0000 7f793725b700 1 --2- 172.21.15.6:0/358947995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f79240658c0 0x7f7924067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.409+0000 7f793e020000 1 --2- 172.21.15.6:0/358947995 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55e716044b10 0x55e715fb3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.410+0000 7f793e020000 1 -- 172.21.15.6:0/358947995 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e96) v8 -- 0x55e715fb39c0 con 0x55e716044b10 2023-10-06T02:25:01.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.410+0000 7f7937a5c700 1 --2- 172.21.15.6:0/358947995 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55e716044b10 0x55e715fb3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.410+0000 7f793725b700 1 --2- 172.21.15.6:0/358947995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f79240658c0 0x7f7924067d70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f792800e770 tx=0x7f79280029c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:01.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.410+0000 7f7937a5c700 1 --2- 172.21.15.6:0/358947995 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55e716044b10 0x55e715fb3480 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:01.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.411+0000 7f7937a5c700 1 -- 172.21.15.6:0/358947995 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 10000000000.00000000 [delete] v96'42 uv42 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f7930016070 con 0x55e716044b10 2023-10-06T02:25:01.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.411+0000 7f793e020000 1 -- 172.21.15.6:0/358947995 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55e716044b10 msgr2=0x55e715fb3480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.411+0000 7f793e020000 1 --2- 172.21.15.6:0/358947995 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55e716044b10 0x55e715fb3480 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.411+0000 7f793e020000 1 -- 172.21.15.6:0/358947995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f79240658c0 msgr2=0x7f7924067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.411+0000 7f793e020000 1 --2- 172.21.15.6:0/358947995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f79240658c0 0x7f7924067d70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f792800e770 tx=0x7f79280029c0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.411+0000 7f793e020000 1 -- 172.21.15.6:0/358947995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e715f98ab0 msgr2=0x55e71604f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.411+0000 7f793e020000 1 --2- 172.21.15.6:0/358947995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e715f98ab0 0x55e71604f260 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f792c00ae50 tx=0x7f792c015000 comp rx=0 tx=0).stop 2023-10-06T02:25:01.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.411+0000 7f7937a5c700 1 -- 172.21.15.6:0/358947995 reap_dead start 2023-10-06T02:25:01.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.411+0000 7f793e020000 1 -- 172.21.15.6:0/358947995 shutdown_connections 2023-10-06T02:25:01.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.411+0000 7f793e020000 1 -- 172.21.15.6:0/358947995 >> 172.21.15.6:0/358947995 conn(0x55e715fb0bd0 msgr2=0x55e715f96140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:01.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.411+0000 7f793e020000 1 -- 172.21.15.6:0/358947995 shutdown_connections 2023-10-06T02:25:01.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.411+0000 7f793e020000 1 -- 172.21.15.6:0/358947995 wait complete. 2023-10-06T02:25:01.422 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:25:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.582+0000 7f7d24715700 1 Processor -- start 2023-10-06T02:25:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.582+0000 7f7d24715700 1 -- start start 2023-10-06T02:25:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.582+0000 7f7d24715700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d1c0a89c0 0x7f7d1c0aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.582+0000 7f7d24715700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d1c0a8d90 0x7f7d1c0af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.582+0000 7f7d24715700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1c06b030 con 0x7f7d1c0af570 2023-10-06T02:25:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.582+0000 7f7d24715700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d1c0af9b0 con 0x7f7d1c0a8d90 2023-10-06T02:25:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.582+0000 7f7d24715700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c0b1ab0 con 0x7f7d1c0a89c0 2023-10-06T02:25:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.583+0000 7f7d21cb0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d1c0a8d90 0x7f7d1c0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.583+0000 7f7d21cb0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d1c0a8d90 0x7f7d1c0af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53732/0 (socket says 172.21.15.6:53732) 2023-10-06T02:25:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.583+0000 7f7d21cb0700 1 -- 172.21.15.6:0/689321630 learned_addr learned my addr 172.21.15.6:0/689321630 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.583+0000 7f7d224b1700 1 --2- 172.21.15.6:0/689321630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d1c0a89c0 0x7f7d1c0aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.583+0000 7f7d21cb0700 1 -- 172.21.15.6:0/689321630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d1c0a89c0 msgr2=0x7f7d1c0aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.583+0000 7f7d21cb0700 1 --2- 172.21.15.6:0/689321630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d1c0a89c0 0x7f7d1c0aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.583+0000 7f7d21cb0700 1 -- 172.21.15.6:0/689321630 >> v1:172.21.15.175:6789/0 conn(0x7f7d1c0af570 legacy=0x7f7d1c0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.583+0000 7f7d21cb0700 1 -- 172.21.15.6:0/689321630 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c06ad50 con 0x7f7d1c0a8d90 2023-10-06T02:25:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.583+0000 7f7d21cb0700 1 --2- 172.21.15.6:0/689321630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d1c0a8d90 0x7f7d1c0af030 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f7d100099b0 tx=0x7f7d10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc7891602d743e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.583+0000 7f7d214af700 1 -- 172.21.15.6:0/689321630 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10009ea0 con 0x7f7d1c0a8d90 2023-10-06T02:25:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.583+0000 7f7d214af700 1 -- 172.21.15.6:0/689321630 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1000b860 con 0x7f7d1c0a8d90 2023-10-06T02:25:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.583+0000 7f7d214af700 1 -- 172.21.15.6:0/689321630 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1000bc00 con 0x7f7d1c0a8d90 2023-10-06T02:25:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.584+0000 7f7d24715700 1 -- 172.21.15.6:0/689321630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d1c0a8d90 msgr2=0x7f7d1c0af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.584+0000 7f7d24715700 1 --2- 172.21.15.6:0/689321630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d1c0a8d90 0x7f7d1c0af030 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f7d100099b0 tx=0x7f7d10009250 comp rx=0 tx=0).stop 2023-10-06T02:25:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.584+0000 7f7d24715700 1 -- 172.21.15.6:0/689321630 shutdown_connections 2023-10-06T02:25:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.584+0000 7f7d24715700 1 --2- 172.21.15.6:0/689321630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d1c0a89c0 0x7f7d1c0aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.584+0000 7f7d24715700 1 --2- 172.21.15.6:0/689321630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d1c0a8d90 0x7f7d1c0af030 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.584+0000 7f7d24715700 1 -- 172.21.15.6:0/689321630 >> 172.21.15.6:0/689321630 conn(0x7f7d1c067910 msgr2=0x7f7d1c0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:01.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.584+0000 7f7d24715700 1 -- 172.21.15.6:0/689321630 shutdown_connections 2023-10-06T02:25:01.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.584+0000 7f7d24715700 1 -- 172.21.15.6:0/689321630 wait complete. 2023-10-06T02:25:01.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.585+0000 7f7d24715700 1 Processor -- start 2023-10-06T02:25:01.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.585+0000 7f7d24715700 1 -- start start 2023-10-06T02:25:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d24715700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d1c0a89c0 0x7f7d1c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d24715700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d1c0a8d90 0x7f7d1c0c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d24715700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d1c0af570 0x7f7d1c0c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d24715700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c0c71e0 con 0x7f7d1c0af570 2023-10-06T02:25:01.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d24715700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c0c65d0 con 0x7f7d1c0a89c0 2023-10-06T02:25:01.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d24715700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c0c68b0 con 0x7f7d1c0a8d90 2023-10-06T02:25:01.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d22cb2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d1c0af570 0x7f7d1c0c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d22cb2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d1c0af570 0x7f7d1c0c4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53740/0 (socket says 172.21.15.6:53740) 2023-10-06T02:25:01.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d22cb2700 1 -- 172.21.15.6:0/3528560142 learned_addr learned my addr 172.21.15.6:0/3528560142 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:01.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d21cb0700 1 --2- 172.21.15.6:0/3528560142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d1c0a8d90 0x7f7d1c0c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d224b1700 1 --2- 172.21.15.6:0/3528560142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d1c0a89c0 0x7f7d1c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d22cb2700 1 -- 172.21.15.6:0/3528560142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d1c0a8d90 msgr2=0x7f7d1c0c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d22cb2700 1 --2- 172.21.15.6:0/3528560142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d1c0a8d90 0x7f7d1c0c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d22cb2700 1 -- 172.21.15.6:0/3528560142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d1c0a89c0 msgr2=0x7f7d1c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d22cb2700 1 --2- 172.21.15.6:0/3528560142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d1c0a89c0 0x7f7d1c0c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d22cb2700 1 -- 172.21.15.6:0/3528560142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d100094f0 con 0x7f7d1c0af570 2023-10-06T02:25:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d22cb2700 1 --2- 172.21.15.6:0/3528560142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d1c0af570 0x7f7d1c0c4b60 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00c840 tx=0x7f7d0c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d1a7fc700 1 -- 172.21.15.6:0/3528560142 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c012630 con 0x7f7d1c0af570 2023-10-06T02:25:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.586+0000 7f7d1a7fc700 1 -- 172.21.15.6:0/3528560142 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c0127b0 con 0x7f7d1c0af570 2023-10-06T02:25:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.587+0000 7f7d24715700 1 -- 172.21.15.6:0/3528560142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1c0c6b90 con 0x7f7d1c0af570 2023-10-06T02:25:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.587+0000 7f7d1a7fc700 1 -- 172.21.15.6:0/3528560142 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c012b70 con 0x7f7d1c0af570 2023-10-06T02:25:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.587+0000 7f7d24715700 1 -- 172.21.15.6:0/3528560142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1c0ca9e0 con 0x7f7d1c0af570 2023-10-06T02:25:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.587+0000 7f7d24715700 1 -- 172.21.15.6:0/3528560142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1c087170 con 0x7f7d1c0af570 2023-10-06T02:25:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.588+0000 7f7d1a7fc700 1 -- 172.21.15.6:0/3528560142 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d0c01a3a0 con 0x7f7d1c0af570 2023-10-06T02:25:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.588+0000 7f7d1a7fc700 1 --2- 172.21.15.6:0/3528560142 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d08066f30 0x7f7d080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:01.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.588+0000 7f7d1a7fc700 1 -- 172.21.15.6:0/3528560142 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7d0c0849d0 con 0x7f7d1c0af570 2023-10-06T02:25:01.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.588+0000 7f7d224b1700 1 --2- 172.21.15.6:0/3528560142 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d08066f30 0x7f7d080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:01.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.589+0000 7f7d224b1700 1 --2- 172.21.15.6:0/3528560142 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d08066f30 0x7f7d080693e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7d14009da0 tx=0x7f7d14009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:01.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.593+0000 7f7d1a7fc700 1 -- 172.21.15.6:0/3528560142 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d0c0518d0 con 0x7f7d1c0af570 2023-10-06T02:25:01.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:01.834+0000 7f7d24715700 1 -- 172.21.15.6:0/3528560142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f7d1c06e5d0 con 0x7f7d1c0af570 2023-10-06T02:25:02.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.035+0000 7f7d1a7fc700 1 -- 172.21.15.6:0/3528560142 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v91) v1 ==== 162+0+0 (secure 0 0 0) 0x7f7d0c054ef0 con 0x7f7d1c0af570 2023-10-06T02:25:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.037+0000 7f7d24715700 1 -- 172.21.15.6:0/3528560142 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d08066f30 msgr2=0x7f7d080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.037+0000 7f7d24715700 1 --2- 172.21.15.6:0/3528560142 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d08066f30 0x7f7d080693e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7d14009da0 tx=0x7f7d14009120 comp rx=0 tx=0).stop 2023-10-06T02:25:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.037+0000 7f7d24715700 1 -- 172.21.15.6:0/3528560142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d1c0af570 msgr2=0x7f7d1c0c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.037+0000 7f7d24715700 1 --2- 172.21.15.6:0/3528560142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d1c0af570 0x7f7d1c0c4b60 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00c840 tx=0x7f7d0c001670 comp rx=0 tx=0).stop 2023-10-06T02:25:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.037+0000 7f7d24715700 1 -- 172.21.15.6:0/3528560142 shutdown_connections 2023-10-06T02:25:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.037+0000 7f7d24715700 1 --2- 172.21.15.6:0/3528560142 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d08066f30 0x7f7d080693e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.037+0000 7f7d24715700 1 --2- 172.21.15.6:0/3528560142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d1c0af570 0x7f7d1c0c4b60 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.037+0000 7f7d24715700 1 --2- 172.21.15.6:0/3528560142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d1c0a89c0 0x7f7d1c0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.037+0000 7f7d24715700 1 --2- 172.21.15.6:0/3528560142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d1c0a8d90 0x7f7d1c0c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.037+0000 7f7d24715700 1 -- 172.21.15.6:0/3528560142 >> 172.21.15.6:0/3528560142 conn(0x7f7d1c067910 msgr2=0x7f7d1c0b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.037+0000 7f7d24715700 1 -- 172.21.15.6:0/3528560142 shutdown_connections 2023-10-06T02:25:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.037+0000 7f7d24715700 1 -- 172.21.15.6:0/3528560142 wait complete. 2023-10-06T02:25:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:25:02.457 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:02.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.583+0000 7feed04e4700 1 Processor -- start 2023-10-06T02:25:02.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.583+0000 7feed04e4700 1 -- start start 2023-10-06T02:25:02.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.584+0000 7feed04e4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feec80af1d0 0x7feec80af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:02.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.584+0000 7feed04e4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feec8068d90 0x7feec8159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:02.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.584+0000 7feed04e4700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec806d5b0 con 0x7feec806da40 2023-10-06T02:25:02.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.584+0000 7feed04e4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec80caf90 con 0x7feec8068d90 2023-10-06T02:25:02.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.584+0000 7feed04e4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec806de90 con 0x7feec80af1d0 2023-10-06T02:25:02.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.584+0000 7feecea81700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feec8068d90 0x7feec8159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:02.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.584+0000 7feecea81700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feec8068d90 0x7feec8159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53742/0 (socket says 172.21.15.6:53742) 2023-10-06T02:25:02.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.584+0000 7feecea81700 1 -- 172.21.15.6:0/1929623859 learned_addr learned my addr 172.21.15.6:0/1929623859 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:02.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.585+0000 7feece280700 1 --2- 172.21.15.6:0/1929623859 >> v2:172.21.15.175:3300/0 conn(0x7feec80af1d0 0x7feec80af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:02.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.585+0000 7feecea81700 1 -- 172.21.15.6:0/1929623859 >> v2:172.21.15.175:3300/0 conn(0x7feec80af1d0 msgr2=0x7feec80af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:02.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.585+0000 7feecea81700 1 --2- 172.21.15.6:0/1929623859 >> v2:172.21.15.175:3300/0 conn(0x7feec80af1d0 0x7feec80af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:02.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.585+0000 7feecea81700 1 -- 172.21.15.6:0/1929623859 >> v1:172.21.15.175:6789/0 conn(0x7feec806da40 legacy=0x7feec8068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:02.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.585+0000 7feecea81700 1 -- 172.21.15.6:0/1929623859 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec815a9a0 con 0x7feec8068d90 2023-10-06T02:25:02.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.585+0000 7feece280700 1 --2- 172.21.15.6:0/1929623859 >> v2:172.21.15.175:3300/0 conn(0x7feec80af1d0 0x7feec80af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:02.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.585+0000 7feecea81700 1 --2- 172.21.15.6:0/1929623859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec8068d90 0x7feec8159a40 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7feec80ce120 tx=0x7feeb8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84ac949eaa2cdcd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:02.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.585+0000 7feecd27e700 1 -- 172.21.15.6:0/1929623859 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb800e070 con 0x7feec8068d90 2023-10-06T02:25:02.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.585+0000 7feecd27e700 1 -- 172.21.15.6:0/1929623859 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb800ba10 con 0x7feec8068d90 2023-10-06T02:25:02.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.585+0000 7feecd27e700 1 -- 172.21.15.6:0/1929623859 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb80092e0 con 0x7feec8068d90 2023-10-06T02:25:02.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.586+0000 7feed04e4700 1 -- 172.21.15.6:0/1929623859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec8068d90 msgr2=0x7feec8159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:02.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.586+0000 7feed04e4700 1 --2- 172.21.15.6:0/1929623859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec8068d90 0x7feec8159a40 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7feec80ce120 tx=0x7feeb8009840 comp rx=0 tx=0).stop 2023-10-06T02:25:02.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.586+0000 7feed04e4700 1 -- 172.21.15.6:0/1929623859 shutdown_connections 2023-10-06T02:25:02.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.586+0000 7feed04e4700 1 --2- 172.21.15.6:0/1929623859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec8068d90 0x7feec8159a40 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:02.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.586+0000 7feed04e4700 1 --2- 172.21.15.6:0/1929623859 >> v2:172.21.15.175:3300/0 conn(0x7feec80af1d0 0x7feec80af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:02.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.586+0000 7feed04e4700 1 -- 172.21.15.6:0/1929623859 >> 172.21.15.6:0/1929623859 conn(0x7feec806a220 msgr2=0x7feec806b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:02.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.586+0000 7feed04e4700 1 -- 172.21.15.6:0/1929623859 shutdown_connections 2023-10-06T02:25:02.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.586+0000 7feed04e4700 1 -- 172.21.15.6:0/1929623859 wait complete. 2023-10-06T02:25:02.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.587+0000 7feed04e4700 1 Processor -- start 2023-10-06T02:25:02.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.587+0000 7feed04e4700 1 -- start start 2023-10-06T02:25:02.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.587+0000 7feed04e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec8068d90 0x7feec8149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:02.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.587+0000 7feed04e4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec806da40 0x7feec80c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:02.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.587+0000 7feed04e4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec80af1d0 0x7feec80c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:02.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.587+0000 7feed04e4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec815d850 con 0x7feec8068d90 2023-10-06T02:25:02.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.587+0000 7feed04e4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec815cc40 con 0x7feec80af1d0 2023-10-06T02:25:02.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.587+0000 7feed04e4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec815cf20 con 0x7feec806da40 2023-10-06T02:25:02.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.588+0000 7feece280700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec8068d90 0x7feec8149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:02.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.588+0000 7feece280700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec8068d90 0x7feec8149a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53744/0 (socket says 172.21.15.6:53744) 2023-10-06T02:25:02.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.588+0000 7feece280700 1 -- 172.21.15.6:0/593493135 learned_addr learned my addr 172.21.15.6:0/593493135 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:02.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.588+0000 7feecea81700 1 --2- 172.21.15.6:0/593493135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec80af1d0 0x7feec80c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:02.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.588+0000 7feecda7f700 1 --2- 172.21.15.6:0/593493135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec806da40 0x7feec80c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:02.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.588+0000 7feece280700 1 -- 172.21.15.6:0/593493135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec806da40 msgr2=0x7feec80c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:02.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.588+0000 7feece280700 1 --2- 172.21.15.6:0/593493135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec806da40 0x7feec80c2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:02.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.588+0000 7feece280700 1 -- 172.21.15.6:0/593493135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec80af1d0 msgr2=0x7feec80c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:02.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.588+0000 7feece280700 1 --2- 172.21.15.6:0/593493135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec80af1d0 0x7feec80c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.588+0000 7feece280700 1 -- 172.21.15.6:0/593493135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb8009ae0 con 0x7feec8068d90 2023-10-06T02:25:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.588+0000 7feecea81700 1 --2- 172.21.15.6:0/593493135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec80af1d0 0x7feec80c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.588+0000 7feece280700 1 --2- 172.21.15.6:0/593493135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec8068d90 0x7feec8149a90 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7feec000c830 tx=0x7feec0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.588+0000 7feec67fc700 1 -- 172.21.15.6:0/593493135 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0011600 con 0x7feec8068d90 2023-10-06T02:25:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.588+0000 7feec67fc700 1 -- 172.21.15.6:0/593493135 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec0011760 con 0x7feec8068d90 2023-10-06T02:25:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.588+0000 7feed04e4700 1 -- 172.21.15.6:0/593493135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec815d200 con 0x7feec8068d90 2023-10-06T02:25:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.588+0000 7feec67fc700 1 -- 172.21.15.6:0/593493135 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0011b20 con 0x7feec8068d90 2023-10-06T02:25:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.588+0000 7feed04e4700 1 -- 172.21.15.6:0/593493135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec8149fd0 con 0x7feec8068d90 2023-10-06T02:25:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.589+0000 7feed04e4700 1 -- 172.21.15.6:0/593493135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec806e720 con 0x7feec8068d90 2023-10-06T02:25:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.590+0000 7feec67fc700 1 -- 172.21.15.6:0/593493135 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feec000a3e0 con 0x7feec8068d90 2023-10-06T02:25:02.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.590+0000 7feec67fc700 1 --2- 172.21.15.6:0/593493135 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feeb4066f30 0x7feeb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:02.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.590+0000 7feec67fc700 1 -- 172.21.15.6:0/593493135 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7feec0084db0 con 0x7feec8068d90 2023-10-06T02:25:02.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.590+0000 7feecda7f700 1 --2- 172.21.15.6:0/593493135 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feeb4066f30 0x7feeb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:02.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.591+0000 7feecda7f700 1 --2- 172.21.15.6:0/593493135 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feeb4066f30 0x7feeb40693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7feec80aecb0 tx=0x7feebc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:02.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.594+0000 7feec67fc700 1 -- 172.21.15.6:0/593493135 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feec0051d30 con 0x7feec8068d90 2023-10-06T02:25:02.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.834+0000 7feed04e4700 1 -- 172.21.15.6:0/593493135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feec815a6c0 con 0x7feec8068d90 2023-10-06T02:25:02.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.834+0000 7feec67fc700 1 -- 172.21.15.6:0/593493135 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4600 (secure 0 0 0) 0x7feec0015090 con 0x7feec8068d90 2023-10-06T02:25:02.836 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:02.836 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:02.037192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":92,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/2298587443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2298587443},{"type":"v1","addr":"172.21.15.6:6835","nonce":2298587443}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:02.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.836+0000 7feed04e4700 1 -- 172.21.15.6:0/593493135 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feeb4066f30 msgr2=0x7feeb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:02.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.836+0000 7feed04e4700 1 --2- 172.21.15.6:0/593493135 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feeb4066f30 0x7feeb40693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7feec80aecb0 tx=0x7feebc009040 comp rx=0 tx=0).stop 2023-10-06T02:25:02.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.836+0000 7feed04e4700 1 -- 172.21.15.6:0/593493135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec8068d90 msgr2=0x7feec8149a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:02.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.836+0000 7feed04e4700 1 --2- 172.21.15.6:0/593493135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec8068d90 0x7feec8149a90 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7feec000c830 tx=0x7feec0008040 comp rx=0 tx=0).stop 2023-10-06T02:25:02.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.836+0000 7feed04e4700 1 -- 172.21.15.6:0/593493135 shutdown_connections 2023-10-06T02:25:02.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.836+0000 7feed04e4700 1 --2- 172.21.15.6:0/593493135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec80af1d0 0x7feec80c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:02.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.836+0000 7feed04e4700 1 --2- 172.21.15.6:0/593493135 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feeb4066f30 0x7feeb40693e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:02.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.836+0000 7feed04e4700 1 --2- 172.21.15.6:0/593493135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec8068d90 0x7feec8149a90 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:02.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.836+0000 7feed04e4700 1 --2- 172.21.15.6:0/593493135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec806da40 0x7feec80c2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:02.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.836+0000 7feed04e4700 1 -- 172.21.15.6:0/593493135 >> 172.21.15.6:0/593493135 conn(0x7feec806a220 msgr2=0x7feec80cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:02.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.836+0000 7feed04e4700 1 -- 172.21.15.6:0/593493135 shutdown_connections 2023-10-06T02:25:02.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:02.836+0000 7feed04e4700 1 -- 172.21.15.6:0/593493135 wait complete. 2023-10-06T02:25:02.839 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 92 2023-10-06T02:25:02.850 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 92, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:25:02.037192+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 96, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7452}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7452': {'gid': 7452, 'name': 'a', 'rank': 0, 'incarnation': 92, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.6:6835/2298587443', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 2298587443}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 2298587443}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:25:02.850 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7452:up:replay 2023-10-06T02:25:02.850 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2023-10-06T02:25:05.814 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:25:05.813+0000 7f17f0ed2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:25:08.254 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.386+0000 7f52fbb62700 1 Processor -- start 2023-10-06T02:25:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.386+0000 7f52fbb62700 1 -- start start 2023-10-06T02:25:08.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.387+0000 7f52fbb62700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52f40af4e0 0x7f52f40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.387+0000 7f52fbb62700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f415db70 0x7f52f40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.387+0000 7f52fbb62700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f415e190 con 0x7f52f40af8b0 2023-10-06T02:25:08.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.387+0000 7f52fbb62700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f40b1910 con 0x7f52f40af4e0 2023-10-06T02:25:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.387+0000 7f52fbb62700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f415dfa0 con 0x7f52f415db70 2023-10-06T02:25:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.387+0000 7f52f98fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52f40af4e0 0x7f52f40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.387+0000 7f52f90fd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f52f40af8b0 0x7f52f415d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56704/0 (socket says 172.21.15.6:56704) 2023-10-06T02:25:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.387+0000 7f52f98fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52f40af4e0 0x7f52f40b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53748/0 (socket says 172.21.15.6:53748) 2023-10-06T02:25:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.387+0000 7f52f90fd700 1 -- 172.21.15.6:0/196324781 learned_addr learned my addr 172.21.15.6:0/196324781 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.387+0000 7f52fa0ff700 1 --2- 172.21.15.6:0/196324781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f415db70 0x7f52f40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.387+0000 7f52f98fe700 1 -- 172.21.15.6:0/196324781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f415db70 msgr2=0x7f52f40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.388+0000 7f52f98fe700 1 --2- 172.21.15.6:0/196324781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f415db70 0x7f52f40b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.388+0000 7f52f98fe700 1 -- 172.21.15.6:0/196324781 >> v1:172.21.15.6:6789/0 conn(0x7f52f40af8b0 legacy=0x7f52f415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.388+0000 7f52f98fe700 1 -- 172.21.15.6:0/196324781 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f40cb650 con 0x7f52f40af4e0 2023-10-06T02:25:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.388+0000 7f52f88fc700 1 -- 172.21.15.6:0/196324781 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016459695 0 0) 0x7f52f415e190 con 0x7f52f40af8b0 2023-10-06T02:25:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.388+0000 7f52fa0ff700 1 --2- 172.21.15.6:0/196324781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f415db70 0x7f52f40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.388+0000 7f52f98fe700 1 --2- 172.21.15.6:0/196324781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f40af4e0 0x7f52f40b20e0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0098e0 tx=0x7f52ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e694bbd0c31ec11 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.388+0000 7f52f88fc700 1 -- 172.21.15.6:0/196324781 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec009e80 con 0x7f52f40af4e0 2023-10-06T02:25:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.388+0000 7f52f88fc700 1 -- 172.21.15.6:0/196324781 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec00b860 con 0x7f52f40af4e0 2023-10-06T02:25:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.388+0000 7f52f88fc700 1 -- 172.21.15.6:0/196324781 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00bbe0 con 0x7f52f40af4e0 2023-10-06T02:25:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.388+0000 7f52fbb62700 1 -- 172.21.15.6:0/196324781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f40af4e0 msgr2=0x7f52f40b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.388+0000 7f52fbb62700 1 --2- 172.21.15.6:0/196324781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f40af4e0 0x7f52f40b20e0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0098e0 tx=0x7f52ec0091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.388+0000 7f52fbb62700 1 -- 172.21.15.6:0/196324781 shutdown_connections 2023-10-06T02:25:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.388+0000 7f52fbb62700 1 --2- 172.21.15.6:0/196324781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f415db70 0x7f52f40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.388+0000 7f52fbb62700 1 --2- 172.21.15.6:0/196324781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f40af4e0 0x7f52f40b20e0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.388+0000 7f52fbb62700 1 -- 172.21.15.6:0/196324781 >> 172.21.15.6:0/196324781 conn(0x7f52f4068680 msgr2=0x7f52f4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.389+0000 7f52fbb62700 1 -- 172.21.15.6:0/196324781 shutdown_connections 2023-10-06T02:25:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.389+0000 7f52fbb62700 1 -- 172.21.15.6:0/196324781 wait complete. 2023-10-06T02:25:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.390+0000 7f52fbb62700 1 Processor -- start 2023-10-06T02:25:08.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.390+0000 7f52fbb62700 1 -- start start 2023-10-06T02:25:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.390+0000 7f52fbb62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f40af4e0 0x7f52f4169910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.390+0000 7f52fbb62700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f40af8b0 0x7f52f41560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.390+0000 7f52fbb62700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52f415db70 0x7f52f40c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.390+0000 7f52fbb62700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f4157b20 con 0x7f52f40af4e0 2023-10-06T02:25:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.390+0000 7f52fbb62700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f4156a80 con 0x7f52f415db70 2023-10-06T02:25:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.390+0000 7f52fbb62700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f4156d60 con 0x7f52f40af8b0 2023-10-06T02:25:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.390+0000 7f52f98fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f40af4e0 0x7f52f4169910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.390+0000 7f52f98fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f40af4e0 0x7f52f4169910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53762/0 (socket says 172.21.15.6:53762) 2023-10-06T02:25:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.391+0000 7f52f98fe700 1 -- 172.21.15.6:0/3964944406 learned_addr learned my addr 172.21.15.6:0/3964944406 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.391+0000 7f52f90fd700 1 --2- 172.21.15.6:0/3964944406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f40af8b0 0x7f52f41560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.391+0000 7f52fa0ff700 1 --2- 172.21.15.6:0/3964944406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52f415db70 0x7f52f40c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.391+0000 7f52f98fe700 1 -- 172.21.15.6:0/3964944406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f40af8b0 msgr2=0x7f52f41560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.391+0000 7f52f98fe700 1 --2- 172.21.15.6:0/3964944406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f40af8b0 0x7f52f41560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.391+0000 7f52f98fe700 1 -- 172.21.15.6:0/3964944406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52f415db70 msgr2=0x7f52f40c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.391+0000 7f52f98fe700 1 --2- 172.21.15.6:0/3964944406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52f415db70 0x7f52f40c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.391+0000 7f52f98fe700 1 -- 172.21.15.6:0/3964944406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec009420 con 0x7f52f40af4e0 2023-10-06T02:25:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.391+0000 7f52f98fe700 1 --2- 172.21.15.6:0/3964944406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f40af4e0 0x7f52f4169910 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f52f4089520 tx=0x7f52ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.391+0000 7f52f1ffb700 1 -- 172.21.15.6:0/3964944406 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00bbe0 con 0x7f52f40af4e0 2023-10-06T02:25:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.391+0000 7f52f1ffb700 1 -- 172.21.15.6:0/3964944406 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec011420 con 0x7f52f40af4e0 2023-10-06T02:25:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.391+0000 7f52fbb62700 1 -- 172.21.15.6:0/3964944406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f4157040 con 0x7f52f40af4e0 2023-10-06T02:25:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.391+0000 7f52f1ffb700 1 -- 172.21.15.6:0/3964944406 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0117c0 con 0x7f52f40af4e0 2023-10-06T02:25:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.391+0000 7f52fbb62700 1 -- 172.21.15.6:0/3964944406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f4157600 con 0x7f52f40af4e0 2023-10-06T02:25:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.392+0000 7f52fbb62700 1 -- 172.21.15.6:0/3964944406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f40af040 con 0x7f52f40af4e0 2023-10-06T02:25:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.393+0000 7f52f1ffb700 1 -- 172.21.15.6:0/3964944406 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52ec011bb0 con 0x7f52f40af4e0 2023-10-06T02:25:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.393+0000 7f52f1ffb700 1 --2- 172.21.15.6:0/3964944406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52e0066f30 0x7f52e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.393+0000 7f52f1ffb700 1 -- 172.21.15.6:0/3964944406 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f52ec085f50 con 0x7f52f40af4e0 2023-10-06T02:25:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.393+0000 7f52f90fd700 1 --2- 172.21.15.6:0/3964944406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52e0066f30 0x7f52e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.394+0000 7f52f90fd700 1 --2- 172.21.15.6:0/3964944406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52e0066f30 0x7f52e00693e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f52f40c9730 tx=0x7f52e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:08.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.398+0000 7f52f1ffb700 1 -- 172.21.15.6:0/3964944406 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52ec052ed0 con 0x7f52f40af4e0 2023-10-06T02:25:08.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.633+0000 7f52fbb62700 1 -- 172.21.15.6:0/3964944406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52f40b5380 con 0x7f52f40af4e0 2023-10-06T02:25:08.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.634+0000 7f52f1ffb700 1 -- 172.21.15.6:0/3964944406 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f52ec011e60 con 0x7f52f40af4e0 2023-10-06T02:25:08.635 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:08.636 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:05.049261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":92,"state":"up:active","state_seq":5,"addr":"172.21.15.6:6835/2298587443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2298587443},{"type":"v1","addr":"172.21.15.6:6835","nonce":2298587443}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.636+0000 7f52fbb62700 1 -- 172.21.15.6:0/3964944406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52e0066f30 msgr2=0x7f52e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.636+0000 7f52fbb62700 1 --2- 172.21.15.6:0/3964944406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52e0066f30 0x7f52e00693e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f52f40c9730 tx=0x7f52e8009040 comp rx=0 tx=0).stop 2023-10-06T02:25:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.636+0000 7f52fbb62700 1 -- 172.21.15.6:0/3964944406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f40af4e0 msgr2=0x7f52f4169910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.636+0000 7f52fbb62700 1 --2- 172.21.15.6:0/3964944406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f40af4e0 0x7f52f4169910 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f52f4089520 tx=0x7f52ec017000 comp rx=0 tx=0).stop 2023-10-06T02:25:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.636+0000 7f52fbb62700 1 -- 172.21.15.6:0/3964944406 shutdown_connections 2023-10-06T02:25:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.636+0000 7f52fbb62700 1 --2- 172.21.15.6:0/3964944406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52f415db70 0x7f52f40c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.636+0000 7f52fbb62700 1 --2- 172.21.15.6:0/3964944406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52e0066f30 0x7f52e00693e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.636+0000 7f52fbb62700 1 --2- 172.21.15.6:0/3964944406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f40af4e0 0x7f52f4169910 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.636+0000 7f52fbb62700 1 --2- 172.21.15.6:0/3964944406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f40af8b0 0x7f52f41560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.636+0000 7f52fbb62700 1 -- 172.21.15.6:0/3964944406 >> 172.21.15.6:0/3964944406 conn(0x7f52f4068680 msgr2=0x7f52f415a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:08.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.636+0000 7f52fbb62700 1 -- 172.21.15.6:0/3964944406 shutdown_connections 2023-10-06T02:25:08.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.636+0000 7f52fbb62700 1 -- 172.21.15.6:0/3964944406 wait complete. 2023-10-06T02:25:08.639 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 95 2023-10-06T02:25:08.649 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 95, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:25:05.049261+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 96, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7452}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7452': {'gid': 7452, 'name': 'a', 'rank': 0, 'incarnation': 92, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.6:6835/2298587443', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 2298587443}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 2298587443}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:25:08.650 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:25:08.650 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:25:08.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.770+0000 7f8507853700 1 Processor -- start 2023-10-06T02:25:08.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.771+0000 7f8507853700 1 -- start start 2023-10-06T02:25:08.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.771+0000 7f8507853700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8500086ff0 0x7f8500087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.771+0000 7f8507853700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85000afc50 con 0x7f85000b21b0 2023-10-06T02:25:08.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.771+0000 7f8507853700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85000aff30 con 0x7f850015a030 2023-10-06T02:25:08.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.771+0000 7f8507853700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85000b0cf0 con 0x7f8500086ff0 2023-10-06T02:25:08.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.772+0000 7f8505df0700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f85000b21b0 0x7f85000b2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35484/0 (socket says 172.21.15.6:35484) 2023-10-06T02:25:08.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.772+0000 7f8504dee700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8500086ff0 0x7f8500087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.772+0000 7f8505df0700 1 -- 172.21.15.6:0/2867811251 learned_addr learned my addr 172.21.15.6:0/2867811251 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:08.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.772+0000 7f84fffff700 1 -- 172.21.15.6:0/2867811251 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492573955 0 0) 0x7f85000afc50 con 0x7f85000b21b0 2023-10-06T02:25:08.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.772+0000 7f84fffff700 1 -- 172.21.15.6:0/2867811251 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84e8003570 con 0x7f85000b21b0 2023-10-06T02:25:08.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.772+0000 7f8504dee700 1 -- 172.21.15.6:0/2867811251 >> v1:172.21.15.175:6789/0 conn(0x7f850015a030 legacy=0x7f850015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.772+0000 7f8504dee700 1 -- 172.21.15.6:0/2867811251 >> v1:172.21.15.6:6789/0 conn(0x7f85000b21b0 legacy=0x7f85000b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.772+0000 7f8504dee700 1 -- 172.21.15.6:0/2867811251 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85000b0210 con 0x7f8500086ff0 2023-10-06T02:25:08.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.772+0000 7f8504dee700 1 --2- 172.21.15.6:0/2867811251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8500086ff0 0x7f8500087470 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f84f40098e0 tx=0x7f84f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61809f6900c4ca8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.772+0000 7f84fffff700 1 -- 172.21.15.6:0/2867811251 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f400b640 con 0x7f8500086ff0 2023-10-06T02:25:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.772+0000 7f84fffff700 1 -- 172.21.15.6:0/2867811251 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f400b7a0 con 0x7f8500086ff0 2023-10-06T02:25:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.772+0000 7f84fffff700 1 -- 172.21.15.6:0/2867811251 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f400bb40 con 0x7f8500086ff0 2023-10-06T02:25:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.773+0000 7f8507853700 1 -- 172.21.15.6:0/2867811251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8500086ff0 msgr2=0x7f8500087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.773+0000 7f8507853700 1 --2- 172.21.15.6:0/2867811251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8500086ff0 0x7f8500087470 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f84f40098e0 tx=0x7f84f40091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.773+0000 7f8507853700 1 -- 172.21.15.6:0/2867811251 shutdown_connections 2023-10-06T02:25:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.773+0000 7f8507853700 1 --2- 172.21.15.6:0/2867811251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8500086ff0 0x7f8500087470 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.773+0000 7f8507853700 1 -- 172.21.15.6:0/2867811251 >> 172.21.15.6:0/2867811251 conn(0x7f8500068680 msgr2=0x7f8500068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.773+0000 7f8507853700 1 -- 172.21.15.6:0/2867811251 shutdown_connections 2023-10-06T02:25:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.773+0000 7f8507853700 1 -- 172.21.15.6:0/2867811251 wait complete. 2023-10-06T02:25:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.774+0000 7f8507853700 1 Processor -- start 2023-10-06T02:25:08.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.774+0000 7f8507853700 1 -- start start 2023-10-06T02:25:08.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.775+0000 7f8507853700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8500086ff0 0x7f85000c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.775+0000 7f8507853700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85000b21b0 0x7f85000c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.775+0000 7f8507853700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850015a030 0x7f85000c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.775+0000 7f8507853700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8500145870 con 0x7f850015a030 2023-10-06T02:25:08.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.775+0000 7f8507853700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85000c76b0 con 0x7f85000b21b0 2023-10-06T02:25:08.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.775+0000 7f8507853700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85000c7990 con 0x7f8500086ff0 2023-10-06T02:25:08.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.775+0000 7f8505df0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850015a030 0x7f85000c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.775+0000 7f8505df0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850015a030 0x7f85000c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43586/0 (socket says 172.21.15.6:43586) 2023-10-06T02:25:08.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.775+0000 7f8505df0700 1 -- 172.21.15.6:0/609831705 learned_addr learned my addr 172.21.15.6:0/609831705 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:08.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.775+0000 7f8504dee700 1 --2- 172.21.15.6:0/609831705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85000b21b0 0x7f85000c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.775+0000 7f85055ef700 1 --2- 172.21.15.6:0/609831705 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8500086ff0 0x7f85000c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.775+0000 7f8505df0700 1 -- 172.21.15.6:0/609831705 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8500086ff0 msgr2=0x7f85000c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.775+0000 7f8505df0700 1 --2- 172.21.15.6:0/609831705 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8500086ff0 0x7f85000c4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.775+0000 7f8505df0700 1 -- 172.21.15.6:0/609831705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85000b21b0 msgr2=0x7f85000c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.775+0000 7f8505df0700 1 --2- 172.21.15.6:0/609831705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85000b21b0 0x7f85000c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.775+0000 7f8505df0700 1 -- 172.21.15.6:0/609831705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f4009420 con 0x7f850015a030 2023-10-06T02:25:08.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.776+0000 7f8505df0700 1 --2- 172.21.15.6:0/609831705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850015a030 0x7f85000c4180 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f84f00010e0 tx=0x7f84f0007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:08.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.776+0000 7f84fd7fa700 1 -- 172.21.15.6:0/609831705 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f0005c00 con 0x7f850015a030 2023-10-06T02:25:08.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.776+0000 7f84fd7fa700 1 -- 172.21.15.6:0/609831705 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f0005d60 con 0x7f850015a030 2023-10-06T02:25:08.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.776+0000 7f8507853700 1 -- 172.21.15.6:0/609831705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85000c7c70 con 0x7f850015a030 2023-10-06T02:25:08.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.776+0000 7f84fd7fa700 1 -- 172.21.15.6:0/609831705 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f00072e0 con 0x7f850015a030 2023-10-06T02:25:08.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.776+0000 7f8507853700 1 -- 172.21.15.6:0/609831705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85000c8230 con 0x7f850015a030 2023-10-06T02:25:08.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.777+0000 7f84fd7fa700 1 -- 172.21.15.6:0/609831705 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84f0007650 con 0x7f850015a030 2023-10-06T02:25:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.778+0000 7f84fd7fa700 1 --2- 172.21.15.6:0/609831705 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84ec066f30 0x7f84ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.778+0000 7f84fd7fa700 1 -- 172.21.15.6:0/609831705 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f84f0083c80 con 0x7f850015a030 2023-10-06T02:25:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.778+0000 7f85055ef700 1 --2- 172.21.15.6:0/609831705 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84ec066f30 0x7f84ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.778+0000 7f85055ef700 1 --2- 172.21.15.6:0/609831705 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84ec066f30 0x7f84ec0693e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f84f8007fd0 tx=0x7f84f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:08.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.780+0000 7f8510b4bb80 1 Processor -- start 2023-10-06T02:25:08.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.780+0000 7f8510b4bb80 1 -- start start 2023-10-06T02:25:08.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.780+0000 7f8510b4bb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f53840 0x558128f53c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.780+0000 7f8510b4bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f54cc0 0x558128fa36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.780+0000 7f8510b4bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128fa3c00 0x558128fa4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.780+0000 7f8510b4bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558128eaaa70 con 0x558128f54cc0 2023-10-06T02:25:08.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.780+0000 7f8510b4bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558128ea8270 con 0x558128fa3c00 2023-10-06T02:25:08.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.780+0000 7f8510b4bb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x558128ea4060 con 0x558128f53840 2023-10-06T02:25:08.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.780+0000 7f8504dee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f54cc0 0x558128fa36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.780+0000 7f8504dee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f54cc0 0x558128fa36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43588/0 (socket says 172.21.15.6:43588) 2023-10-06T02:25:08.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.780+0000 7f8504dee700 1 -- 172.21.15.6:0/2241713331 learned_addr learned my addr 172.21.15.6:0/2241713331 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:08.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.781+0000 7f8505df0700 1 --2- 172.21.15.6:0/2241713331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128fa3c00 0x558128fa4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.781+0000 7f85055ef700 1 --2- 172.21.15.6:0/2241713331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f53840 0x558128f53c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.781+0000 7f8504dee700 1 -- 172.21.15.6:0/2241713331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f53840 msgr2=0x558128f53c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:08.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.781+0000 7f8504dee700 1 --2- 172.21.15.6:0/2241713331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f53840 0x558128f53c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.781+0000 7f8504dee700 1 -- 172.21.15.6:0/2241713331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128fa3c00 msgr2=0x558128fa4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:08.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.781+0000 7f8504dee700 1 --2- 172.21.15.6:0/2241713331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128fa3c00 0x558128fa4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.781+0000 7f8504dee700 1 -- 172.21.15.6:0/2241713331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558128d3e270 con 0x558128f54cc0 2023-10-06T02:25:08.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.781+0000 7f8504dee700 1 --2- 172.21.15.6:0/2241713331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f54cc0 0x558128fa36c0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f84f40091e0 tx=0x7f84f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1f824e2aca4621 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:08.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.781+0000 7f84e67fc700 1 -- 172.21.15.6:0/2241713331 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4020070 con 0x558128f54cc0 2023-10-06T02:25:08.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.781+0000 7f84e67fc700 1 -- 172.21.15.6:0/2241713331 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f4000bc0 con 0x558128f54cc0 2023-10-06T02:25:08.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.781+0000 7f84e67fc700 1 -- 172.21.15.6:0/2241713331 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f400bb20 con 0x558128f54cc0 2023-10-06T02:25:08.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.782+0000 7f8510b4bb80 1 -- 172.21.15.6:0/2241713331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f54cc0 msgr2=0x558128fa36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.782+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/2241713331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f54cc0 0x558128fa36c0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f84f40091e0 tx=0x7f84f4017000 comp rx=0 tx=0).stop 2023-10-06T02:25:08.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.782+0000 7f8510b4bb80 1 -- 172.21.15.6:0/2241713331 shutdown_connections 2023-10-06T02:25:08.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.782+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/2241713331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128fa3c00 0x558128fa4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.782+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/2241713331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f53840 0x558128f53c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.782+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/2241713331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f54cc0 0x558128fa36c0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.782+0000 7f8510b4bb80 1 -- 172.21.15.6:0/2241713331 >> 172.21.15.6:0/2241713331 conn(0x558128f55160 msgr2=0x558128f55530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:08.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.782+0000 7f8510b4bb80 1 -- 172.21.15.6:0/2241713331 shutdown_connections 2023-10-06T02:25:08.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.782+0000 7f8510b4bb80 1 -- 172.21.15.6:0/2241713331 wait complete. 2023-10-06T02:25:08.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.782+0000 7f8510b4bb80 1 -- start start 2023-10-06T02:25:08.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.782+0000 7f8510b4bb80 1 Processor -- start 2023-10-06T02:25:08.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.783+0000 7f8510b4bb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f53840 0x558128f940c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.783+0000 7f8510b4bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f54cc0 0x558128f94600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.783+0000 7f8510b4bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128fa3c00 0x558128f92ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.783+0000 7f8510b4bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558128e4f890 con 0x558128f54cc0 2023-10-06T02:25:08.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.783+0000 7f8510b4bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558128e6aea0 con 0x558128fa3c00 2023-10-06T02:25:08.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.783+0000 7f8510b4bb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x558128d26e30 con 0x558128f53840 2023-10-06T02:25:08.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.783+0000 7f8510b4bb80 10 client.0 _ll_register_callbacks cb 0x558128f16e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:25:08.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.783+0000 7f8504dee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f54cc0 0x558128f94600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.783+0000 7f8504dee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f54cc0 0x558128f94600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43602/0 (socket says 172.21.15.6:43602) 2023-10-06T02:25:08.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.783+0000 7f8504dee700 1 -- 172.21.15.6:0/3017378458 learned_addr learned my addr 172.21.15.6:0/3017378458 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:08.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.783+0000 7f85055ef700 1 --2- 172.21.15.6:0/3017378458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f53840 0x558128f940c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.783+0000 7f8505df0700 1 --2- 172.21.15.6:0/3017378458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128fa3c00 0x558128f92ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f8504dee700 1 -- 172.21.15.6:0/3017378458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f53840 msgr2=0x558128f940c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f8504dee700 1 --2- 172.21.15.6:0/3017378458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f53840 0x558128f940c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f8504dee700 1 -- 172.21.15.6:0/3017378458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128fa3c00 msgr2=0x558128f92ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f8504dee700 1 --2- 172.21.15.6:0/3017378458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128fa3c00 0x558128f92ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f8504dee700 1 -- 172.21.15.6:0/3017378458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85000b0210 con 0x558128f54cc0 2023-10-06T02:25:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f8504dee700 1 --2- 172.21.15.6:0/3017378458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f54cc0 0x558128f94600 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f84f4028040 tx=0x7f84f401d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4c8ac48d2670df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f84df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:25:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f84df7fe700 1 -- 172.21.15.6:0/3017378458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4020040 con 0x558128f54cc0 2023-10-06T02:25:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f84df7fe700 1 -- 172.21.15.6:0/3017378458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f84f4032ac0 con 0x558128f54cc0 2023-10-06T02:25:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f8510b4bb80 1 -- 172.21.15.6:0/3017378458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558128f48940 con 0x558128f54cc0 2023-10-06T02:25:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f84df7fe700 1 -- 172.21.15.6:0/3017378458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84f400bb30 con 0x558128f54cc0 2023-10-06T02:25:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f8510b4bb80 10 client.7941 fetch_fsmap learned FSMap version 95 2023-10-06T02:25:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f8510b4bb80 1 -- 172.21.15.6:0/3017378458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) v3 -- 0x558128ce0fe0 con 0x558128f54cc0 2023-10-06T02:25:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f84df7fe700 1 -- 172.21.15.6:0/3017378458 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558128f48940 con 0x558128f54cc0 2023-10-06T02:25:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f84df7fe700 1 -- 172.21.15.6:0/3017378458 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 95) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f84f4038020 con 0x558128f54cc0 2023-10-06T02:25:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f8510b4bb80 10 client.7941 fetch_fsmap finished waiting for FSMap version 95 2023-10-06T02:25:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f8510b4bb80 10 client.7941 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:25:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f8510b4bb80 20 client.7941 populate_metadata read hostname 'smithi006' 2023-10-06T02:25:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/3017378458 >> [v2:172.21.15.6:6833/2298587443,v1:172.21.15.6:6835/2298587443] conn(0x558128f9bf00 0x558128f9c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f8510b4bb80 4 client.7941 mds_command: new command op to 7452 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:25:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.784+0000 7f8510b4bb80 1 -- 172.21.15.6:0/3017378458 --> [v2:172.21.15.6:6833/2298587443,v1:172.21.15.6:6835/2298587443] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558128f25870 con 0x558128f9bf00 2023-10-06T02:25:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.785+0000 7f85055ef700 1 --2- 172.21.15.6:0/3017378458 >> [v2:172.21.15.6:6833/2298587443,v1:172.21.15.6:6835/2298587443] conn(0x558128f9bf00 0x558128f9c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.785+0000 7f85055ef700 1 --2- 172.21.15.6:0/3017378458 >> [v2:172.21.15.6:6833/2298587443,v1:172.21.15.6:6835/2298587443] conn(0x558128f9bf00 0x558128f9c2d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a033b28ec3533a35 server_cookie=d1244057016a852a in_seq=0 out_seq=0 2023-10-06T02:25:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.785+0000 7f84df7fe700 10 client.7941 ms_handle_connect on v2:172.21.15.6:6833/2298587443 2023-10-06T02:25:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.785+0000 7f84df7fe700 1 -- 172.21.15.6:0/3017378458 <== mds.0 v2:172.21.15.6:6833/2298587443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x558128f25870 con 0x558128f9bf00 2023-10-06T02:25:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.785+0000 7f84df7fe700 10 client.7941 handle_command_reply: tid=0 2023-10-06T02:25:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.785+0000 7f8510b4bb80 1 client.7941 shutdown 2023-10-06T02:25:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.786+0000 7f8510b4bb80 1 -- 172.21.15.6:0/3017378458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f54cc0 msgr2=0x558128f94600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.786+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/3017378458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f54cc0 0x558128f94600 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f84f4028040 tx=0x7f84f401d070 comp rx=0 tx=0).stop 2023-10-06T02:25:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.786+0000 7f8510b4bb80 1 -- 172.21.15.6:0/3017378458 shutdown_connections 2023-10-06T02:25:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.786+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/3017378458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128fa3c00 0x558128f92ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.786+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/3017378458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f53840 0x558128f940c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.786+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/3017378458 >> [v2:172.21.15.6:6833/2298587443,v1:172.21.15.6:6835/2298587443] conn(0x558128f9bf00 0x558128f9c2d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.786+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/3017378458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f54cc0 0x558128f94600 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.786+0000 7f8510b4bb80 1 -- 172.21.15.6:0/3017378458 >> 172.21.15.6:0/3017378458 conn(0x558128f55160 msgr2=0x558128f96fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.786+0000 7f84df7fe700 0 client.7941 ms_handle_reset on v2:172.21.15.6:6833/2298587443 2023-10-06T02:25:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.786+0000 7f8510b4bb80 1 -- 172.21.15.6:0/3017378458 shutdown_connections 2023-10-06T02:25:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.786+0000 7f8510b4bb80 1 -- 172.21.15.6:0/3017378458 wait complete. 2023-10-06T02:25:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.786+0000 7f8510b4bb80 20 client.7941 trim_cache size 0 max 16384 2023-10-06T02:25:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.803+0000 7f8510b4bb80 1 Processor -- start 2023-10-06T02:25:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.803+0000 7f8510b4bb80 1 -- start start 2023-10-06T02:25:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.803+0000 7f8510b4bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f53840 0x558128f4edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.803+0000 7f8510b4bb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f54cc0 0x558128fac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.804+0000 7f8510b4bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128fa3c00 0x558128f55700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.804+0000 7f8510b4bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558128f4ebd0 con 0x558128f53840 2023-10-06T02:25:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.804+0000 7f8510b4bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558128f2c1e0 con 0x558128fa3c00 2023-10-06T02:25:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.804+0000 7f8510b4bb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x558128f9db30 con 0x558128f54cc0 2023-10-06T02:25:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.804+0000 7f85055ef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f53840 0x558128f4edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.804+0000 7f85055ef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f53840 0x558128f4edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43608/0 (socket says 172.21.15.6:43608) 2023-10-06T02:25:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.804+0000 7f85055ef700 1 -- 172.21.15.6:0/1400600173 learned_addr learned my addr 172.21.15.6:0/1400600173 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.804+0000 7f85055ef700 1 -- 172.21.15.6:0/1400600173 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f54cc0 msgr2=0x558128fac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.804+0000 7f85055ef700 1 --2- 172.21.15.6:0/1400600173 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f54cc0 0x558128fac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.804+0000 7f85055ef700 1 -- 172.21.15.6:0/1400600173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128fa3c00 msgr2=0x558128f55700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.804+0000 7f85055ef700 1 --2- 172.21.15.6:0/1400600173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128fa3c00 0x558128f55700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.804+0000 7f85055ef700 1 -- 172.21.15.6:0/1400600173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558128f51b30 con 0x558128f53840 2023-10-06T02:25:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.804+0000 7f85055ef700 1 --2- 172.21.15.6:0/1400600173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f53840 0x558128f4edf0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f84f80038b0 tx=0x7f84f8015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256038d40ae592eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.804+0000 7f84e6ffd700 1 -- 172.21.15.6:0/1400600173 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f800ee30 con 0x558128f53840 2023-10-06T02:25:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.804+0000 7f84e6ffd700 1 -- 172.21.15.6:0/1400600173 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f8001880 con 0x558128f53840 2023-10-06T02:25:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.804+0000 7f84e6ffd700 1 -- 172.21.15.6:0/1400600173 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8001a10 con 0x558128f53840 2023-10-06T02:25:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.805+0000 7f8510b4bb80 1 -- 172.21.15.6:0/1400600173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f53840 msgr2=0x558128f4edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.805+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/1400600173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f53840 0x558128f4edf0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f84f80038b0 tx=0x7f84f8015040 comp rx=0 tx=0).stop 2023-10-06T02:25:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.805+0000 7f8510b4bb80 1 -- 172.21.15.6:0/1400600173 shutdown_connections 2023-10-06T02:25:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.805+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/1400600173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128fa3c00 0x558128f55700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.805+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/1400600173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128f53840 0x558128f4edf0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.805+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/1400600173 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f54cc0 0x558128fac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.805+0000 7f8510b4bb80 1 -- 172.21.15.6:0/1400600173 >> 172.21.15.6:0/1400600173 conn(0x558128f55160 msgr2=0x558128f96fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:08.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.805+0000 7f8510b4bb80 1 -- 172.21.15.6:0/1400600173 shutdown_connections 2023-10-06T02:25:08.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.805+0000 7f8510b4bb80 1 -- 172.21.15.6:0/1400600173 wait complete. 2023-10-06T02:25:08.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.805+0000 7f8510b4bb80 1 -- start start 2023-10-06T02:25:08.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.806+0000 7f8510b4bb80 1 Processor -- start 2023-10-06T02:25:08.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.806+0000 7f8510b4bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128f53840 0x558128f97a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.806+0000 7f8510b4bb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f54cc0 0x558128f97fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.806+0000 7f8510b4bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128fa3c00 0x558128fff920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.806+0000 7f8510b4bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558129000c90 con 0x558128fa3c00 2023-10-06T02:25:08.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.806+0000 7f8510b4bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558128f94320 con 0x558128f53840 2023-10-06T02:25:08.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.806+0000 7f8510b4bb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x558128f94570 con 0x558128f54cc0 2023-10-06T02:25:08.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.806+0000 7f8510b4bb80 10 client.0 _ll_register_callbacks cb 0x558128f16e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:25:08.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.806+0000 7f8505df0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128fa3c00 0x558128fff920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.806+0000 7f8505df0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128fa3c00 0x558128fff920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43620/0 (socket says 172.21.15.6:43620) 2023-10-06T02:25:08.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.806+0000 7f8505df0700 1 -- 172.21.15.6:0/1019783372 learned_addr learned my addr 172.21.15.6:0/1019783372 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:08.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f85055ef700 1 --2- 172.21.15.6:0/1019783372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128f53840 0x558128f97a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f8504dee700 1 --2- 172.21.15.6:0/1019783372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f54cc0 0x558128f97fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f8505df0700 1 -- 172.21.15.6:0/1019783372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f54cc0 msgr2=0x558128f97fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f8505df0700 1 --2- 172.21.15.6:0/1019783372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f54cc0 0x558128f97fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f8505df0700 1 -- 172.21.15.6:0/1019783372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128f53840 msgr2=0x558128f97a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f8505df0700 1 --2- 172.21.15.6:0/1019783372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128f53840 0x558128f97a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f8505df0700 1 -- 172.21.15.6:0/1019783372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f801d040 con 0x558128fa3c00 2023-10-06T02:25:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f8505df0700 1 --2- 172.21.15.6:0/1019783372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128fa3c00 0x558128fff920 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f84f00011e0 tx=0x7f84f0057040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0eee0fa622ffa97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f84df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:25:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f84df7fe700 1 -- 172.21.15.6:0/1019783372 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f0057b10 con 0x558128fa3c00 2023-10-06T02:25:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f84df7fe700 1 -- 172.21.15.6:0/1019783372 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f84f005b860 con 0x558128fa3c00 2023-10-06T02:25:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f8510b4bb80 1 -- 172.21.15.6:0/1019783372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f84f4000bc0 con 0x558128fa3c00 2023-10-06T02:25:08.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f84df7fe700 1 -- 172.21.15.6:0/1019783372 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84f00704d0 con 0x558128fa3c00 2023-10-06T02:25:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f8510b4bb80 10 client.7947 fetch_fsmap learned FSMap version 95 2023-10-06T02:25:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f8510b4bb80 1 -- 172.21.15.6:0/1019783372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) v3 -- 0x558128e72780 con 0x558128fa3c00 2023-10-06T02:25:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f84df7fe700 1 -- 172.21.15.6:0/1019783372 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f4000bc0 con 0x558128fa3c00 2023-10-06T02:25:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f84df7fe700 1 -- 172.21.15.6:0/1019783372 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 95) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f84f005b3d0 con 0x558128fa3c00 2023-10-06T02:25:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f8510b4bb80 10 client.7947 fetch_fsmap finished waiting for FSMap version 95 2023-10-06T02:25:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f8510b4bb80 10 client.7947 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:25:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f8510b4bb80 20 client.7947 populate_metadata read hostname 'smithi006' 2023-10-06T02:25:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/1019783372 >> [v2:172.21.15.6:6833/2298587443,v1:172.21.15.6:6835/2298587443] conn(0x558128fffe60 0x558128f7b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f8510b4bb80 4 client.7947 mds_command: new command op to 7452 tid=0[{"prefix": "status"}] 2023-10-06T02:25:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.807+0000 7f8510b4bb80 1 -- 172.21.15.6:0/1019783372 --> [v2:172.21.15.6:6833/2298587443,v1:172.21.15.6:6835/2298587443] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558128e46e00 con 0x558128fffe60 2023-10-06T02:25:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.808+0000 7f85055ef700 1 --2- 172.21.15.6:0/1019783372 >> [v2:172.21.15.6:6833/2298587443,v1:172.21.15.6:6835/2298587443] conn(0x558128fffe60 0x558128f7b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.808+0000 7f84df7fe700 10 client.7947 ms_handle_connect on v2:172.21.15.6:6833/2298587443 2023-10-06T02:25:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.808+0000 7f85055ef700 1 --2- 172.21.15.6:0/1019783372 >> [v2:172.21.15.6:6833/2298587443,v1:172.21.15.6:6835/2298587443] conn(0x558128fffe60 0x558128f7b7b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbed53ad64722c8 server_cookie=2c3aa816ccf90c6 in_seq=0 out_seq=0 2023-10-06T02:25:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.808+0000 7f84df7fe700 1 -- 172.21.15.6:0/1019783372 <== mds.0 v2:172.21.15.6:6833/2298587443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x558128e46e00 con 0x558128fffe60 2023-10-06T02:25:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.808+0000 7f84df7fe700 10 client.7947 handle_command_reply: tid=0 2023-10-06T02:25:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.808+0000 7f8510b4bb80 1 client.7947 shutdown 2023-10-06T02:25:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.808+0000 7f8510b4bb80 1 -- 172.21.15.6:0/1019783372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128fa3c00 msgr2=0x558128fff920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.808+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/1019783372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128fa3c00 0x558128fff920 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f84f00011e0 tx=0x7f84f0057040 comp rx=0 tx=0).stop 2023-10-06T02:25:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.808+0000 7f8510b4bb80 1 -- 172.21.15.6:0/1019783372 shutdown_connections 2023-10-06T02:25:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.808+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/1019783372 >> [v2:172.21.15.6:6833/2298587443,v1:172.21.15.6:6835/2298587443] conn(0x558128fffe60 0x558128f7b7b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.808+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/1019783372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558128fa3c00 0x558128fff920 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.808+0000 7f84df7fe700 0 client.7947 ms_handle_reset on v2:172.21.15.6:6833/2298587443 2023-10-06T02:25:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.808+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/1019783372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558128f53840 0x558128f97a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.808+0000 7f8510b4bb80 1 --2- 172.21.15.6:0/1019783372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558128f54cc0 0x558128f97fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.808+0000 7f8510b4bb80 1 -- 172.21.15.6:0/1019783372 >> 172.21.15.6:0/1019783372 conn(0x558128f55160 msgr2=0x558128f96fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:08.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.808+0000 7f8510b4bb80 1 -- 172.21.15.6:0/1019783372 shutdown_connections 2023-10-06T02:25:08.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.808+0000 7f8510b4bb80 1 -- 172.21.15.6:0/1019783372 wait complete. 2023-10-06T02:25:08.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.809+0000 7f8510b4bb80 20 client.7947 trim_cache size 0 max 16384 2023-10-06T02:25:08.817 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:25:08.817 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:25:08.817 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:25:08.817 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 7452, 2023-10-06T02:25:08.817 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:25:08.817 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:25:08.817 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:25:08.818 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 6.7711079449999998, 2023-10-06T02:25:08.818 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 95, 2023-10-06T02:25:08.818 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 96, 2023-10-06T02:25:08.818 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 96, 2023-10-06T02:25:08.818 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 14.010481781999999 2023-10-06T02:25:08.818 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:25:08.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.809+0000 7f8507853700 1 -- 172.21.15.6:0/609831705 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84ec066f30 msgr2=0x7f84ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.809+0000 7f8507853700 1 --2- 172.21.15.6:0/609831705 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84ec066f30 0x7f84ec0693e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f84f8007fd0 tx=0x7f84f8009040 comp rx=0 tx=0).stop 2023-10-06T02:25:08.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.809+0000 7f8507853700 1 -- 172.21.15.6:0/609831705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850015a030 msgr2=0x7f85000c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.809+0000 7f8507853700 1 --2- 172.21.15.6:0/609831705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850015a030 0x7f85000c4180 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f84f00010e0 tx=0x7f84f0007dd0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.809+0000 7f8507853700 1 -- 172.21.15.6:0/609831705 shutdown_connections 2023-10-06T02:25:08.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.809+0000 7f8507853700 1 --2- 172.21.15.6:0/609831705 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84ec066f30 0x7f84ec0693e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.809+0000 7f8507853700 1 --2- 172.21.15.6:0/609831705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850015a030 0x7f85000c4180 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.809+0000 7f8507853700 1 --2- 172.21.15.6:0/609831705 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8500086ff0 0x7f85000c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.809+0000 7f8507853700 1 --2- 172.21.15.6:0/609831705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85000b21b0 0x7f85000c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.809+0000 7f8507853700 1 -- 172.21.15.6:0/609831705 >> 172.21.15.6:0/609831705 conn(0x7f8500068680 msgr2=0x7f85000cb730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:08.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.809+0000 7f8507853700 1 -- 172.21.15.6:0/609831705 shutdown_connections 2023-10-06T02:25:08.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.809+0000 7f8507853700 1 -- 172.21.15.6:0/609831705 wait complete. 2023-10-06T02:25:08.822 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:25:08.822 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Delete 10000000000.00000000', proceeding to ls 2023-10-06T02:25:08.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:25:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.940+0000 7f5b5d2e7700 1 Processor -- start 2023-10-06T02:25:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.940+0000 7f5b5d2e7700 1 -- start start 2023-10-06T02:25:08.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.940+0000 7f5b5d2e7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5b58159380 0x7f5b58159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.940+0000 7f5b5d2e7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b5815d4d0 0x7f5b5815d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.940+0000 7f5b5d2e7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b580cb6c0 con 0x7f5b580b20e0 2023-10-06T02:25:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.941+0000 7f5b5d2e7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5815e200 con 0x7f5b5815d4d0 2023-10-06T02:25:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.941+0000 7f5b5d2e7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b580ccb60 con 0x7f5b58159380 2023-10-06T02:25:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.941+0000 7f5b577fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b5815d4d0 0x7f5b5815d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.941+0000 7f5b577fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b5815d4d0 0x7f5b5815d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43634/0 (socket says 172.21.15.6:43634) 2023-10-06T02:25:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.941+0000 7f5b577fe700 1 -- 172.21.15.6:0/2898819552 learned_addr learned my addr 172.21.15.6:0/2898819552 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.941+0000 7f5b56ffd700 1 --2- 172.21.15.6:0/2898819552 >> v2:172.21.15.175:3300/0 conn(0x7f5b58159380 0x7f5b58159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.941+0000 7f5b577fe700 1 -- 172.21.15.6:0/2898819552 >> v2:172.21.15.175:3300/0 conn(0x7f5b58159380 msgr2=0x7f5b58159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.941+0000 7f5b577fe700 1 --2- 172.21.15.6:0/2898819552 >> v2:172.21.15.175:3300/0 conn(0x7f5b58159380 0x7f5b58159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.941+0000 7f5b577fe700 1 -- 172.21.15.6:0/2898819552 >> v1:172.21.15.175:6789/0 conn(0x7f5b580b20e0 legacy=0x7f5b580b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.941+0000 7f5b577fe700 1 -- 172.21.15.6:0/2898819552 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b580c3ef0 con 0x7f5b5815d4d0 2023-10-06T02:25:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.941+0000 7f5b577fe700 1 --2- 172.21.15.6:0/2898819552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b5815d4d0 0x7f5b5815d930 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f5b58089550 tx=0x7f5b48009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730ec823d2b204ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.941+0000 7f5b55ffb700 1 -- 172.21.15.6:0/2898819552 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4800e070 con 0x7f5b5815d4d0 2023-10-06T02:25:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.941+0000 7f5b55ffb700 1 -- 172.21.15.6:0/2898819552 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4800ba00 con 0x7f5b5815d4d0 2023-10-06T02:25:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.941+0000 7f5b55ffb700 1 -- 172.21.15.6:0/2898819552 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b480092e0 con 0x7f5b5815d4d0 2023-10-06T02:25:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.942+0000 7f5b5d2e7700 1 -- 172.21.15.6:0/2898819552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b5815d4d0 msgr2=0x7f5b5815d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.942+0000 7f5b5d2e7700 1 --2- 172.21.15.6:0/2898819552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b5815d4d0 0x7f5b5815d930 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f5b58089550 tx=0x7f5b48009840 comp rx=0 tx=0).stop 2023-10-06T02:25:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.942+0000 7f5b5d2e7700 1 -- 172.21.15.6:0/2898819552 shutdown_connections 2023-10-06T02:25:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.942+0000 7f5b5d2e7700 1 --2- 172.21.15.6:0/2898819552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b5815d4d0 0x7f5b5815d930 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.942+0000 7f5b5d2e7700 1 --2- 172.21.15.6:0/2898819552 >> v2:172.21.15.175:3300/0 conn(0x7f5b58159380 0x7f5b58159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.942+0000 7f5b5d2e7700 1 -- 172.21.15.6:0/2898819552 >> 172.21.15.6:0/2898819552 conn(0x7f5b58068680 msgr2=0x7f5b58068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.942+0000 7f5b5d2e7700 1 -- 172.21.15.6:0/2898819552 shutdown_connections 2023-10-06T02:25:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.942+0000 7f5b5d2e7700 1 -- 172.21.15.6:0/2898819552 wait complete. 2023-10-06T02:25:08.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.943+0000 7f5b5d2e7700 1 Processor -- start 2023-10-06T02:25:08.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.943+0000 7f5b5d2e7700 1 -- start start 2023-10-06T02:25:08.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.944+0000 7f5b5d2e7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b580b20e0 0x7f5b581567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.944+0000 7f5b5d2e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b58159380 0x7f5b58156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.944+0000 7f5b5d2e7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b5815d4d0 0x7f5b5816cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.944+0000 7f5b5d2e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b580cf8b0 con 0x7f5b58159380 2023-10-06T02:25:08.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.944+0000 7f5b5d2e7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b580ceca0 con 0x7f5b5815d4d0 2023-10-06T02:25:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.944+0000 7f5b5d2e7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b580cef80 con 0x7f5b580b20e0 2023-10-06T02:25:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.944+0000 7f5b567fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b58159380 0x7f5b58156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.944+0000 7f5b567fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b58159380 0x7f5b58156cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43636/0 (socket says 172.21.15.6:43636) 2023-10-06T02:25:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.944+0000 7f5b567fc700 1 -- 172.21.15.6:0/176555736 learned_addr learned my addr 172.21.15.6:0/176555736 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.944+0000 7f5b56ffd700 1 --2- 172.21.15.6:0/176555736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b580b20e0 0x7f5b581567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.944+0000 7f5b577fe700 1 --2- 172.21.15.6:0/176555736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b5815d4d0 0x7f5b5816cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.944+0000 7f5b567fc700 1 -- 172.21.15.6:0/176555736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b580b20e0 msgr2=0x7f5b581567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.944+0000 7f5b567fc700 1 --2- 172.21.15.6:0/176555736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b580b20e0 0x7f5b581567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.944+0000 7f5b567fc700 1 -- 172.21.15.6:0/176555736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b5815d4d0 msgr2=0x7f5b5816cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.944+0000 7f5b567fc700 1 --2- 172.21.15.6:0/176555736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b5815d4d0 0x7f5b5816cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.944+0000 7f5b567fc700 1 -- 172.21.15.6:0/176555736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b48009ae0 con 0x7f5b58159380 2023-10-06T02:25:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.945+0000 7f5b567fc700 1 --2- 172.21.15.6:0/176555736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b58159380 0x7f5b58156cf0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f5b4000b5e0 tx=0x7f5b40009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.945+0000 7f5b4effd700 1 -- 172.21.15.6:0/176555736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4000f510 con 0x7f5b58159380 2023-10-06T02:25:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.945+0000 7f5b4effd700 1 -- 172.21.15.6:0/176555736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4000f690 con 0x7f5b58159380 2023-10-06T02:25:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.945+0000 7f5b5d2e7700 1 -- 172.21.15.6:0/176555736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b580cf260 con 0x7f5b58159380 2023-10-06T02:25:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.945+0000 7f5b4effd700 1 -- 172.21.15.6:0/176555736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4000fa50 con 0x7f5b58159380 2023-10-06T02:25:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.945+0000 7f5b5d2e7700 1 -- 172.21.15.6:0/176555736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b580ce830 con 0x7f5b58159380 2023-10-06T02:25:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.946+0000 7f5b5d2e7700 1 -- 172.21.15.6:0/176555736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b58088aa0 con 0x7f5b58159380 2023-10-06T02:25:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.946+0000 7f5b4effd700 1 -- 172.21.15.6:0/176555736 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b4001a400 con 0x7f5b58159380 2023-10-06T02:25:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.947+0000 7f5b4effd700 1 --2- 172.21.15.6:0/176555736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5b38066f30 0x7f5b380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.947+0000 7f5b4effd700 1 -- 172.21.15.6:0/176555736 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f5b40084110 con 0x7f5b58159380 2023-10-06T02:25:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.947+0000 7f5b56ffd700 1 --2- 172.21.15.6:0/176555736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5b38066f30 0x7f5b380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:08.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.947+0000 7f5b56ffd700 1 --2- 172.21.15.6:0/176555736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5b38066f30 0x7f5b380693e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000acb0 tx=0x7f5b50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:08.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:08.951+0000 7f5b4effd700 1 -- 172.21.15.6:0/176555736 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b40051110 con 0x7f5b58159380 2023-10-06T02:25:09.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:09.194+0000 7f5b5d2e7700 1 -- 172.21.15.6:0/176555736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5b580cad90 con 0x7f5b58159380 2023-10-06T02:25:09.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:09.195+0000 7f5b4effd700 1 -- 172.21.15.6:0/176555736 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v95) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5b40054730 con 0x7f5b58159380 2023-10-06T02:25:09.196 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:25:09.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:09.197+0000 7f5b5d2e7700 1 -- 172.21.15.6:0/176555736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5b38066f30 msgr2=0x7f5b380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:09.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:09.197+0000 7f5b5d2e7700 1 --2- 172.21.15.6:0/176555736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5b38066f30 0x7f5b380693e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000acb0 tx=0x7f5b50008040 comp rx=0 tx=0).stop 2023-10-06T02:25:09.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:09.197+0000 7f5b5d2e7700 1 -- 172.21.15.6:0/176555736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b58159380 msgr2=0x7f5b58156cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:09.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:09.197+0000 7f5b5d2e7700 1 --2- 172.21.15.6:0/176555736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b58159380 0x7f5b58156cf0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f5b4000b5e0 tx=0x7f5b40009120 comp rx=0 tx=0).stop 2023-10-06T02:25:09.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:09.197+0000 7f5b5d2e7700 1 -- 172.21.15.6:0/176555736 shutdown_connections 2023-10-06T02:25:09.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:09.197+0000 7f5b5d2e7700 1 --2- 172.21.15.6:0/176555736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b5815d4d0 0x7f5b5816cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:09.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:09.197+0000 7f5b5d2e7700 1 --2- 172.21.15.6:0/176555736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b580b20e0 0x7f5b581567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:09.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:09.197+0000 7f5b5d2e7700 1 --2- 172.21.15.6:0/176555736 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5b38066f30 0x7f5b380693e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:09.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:09.197+0000 7f5b5d2e7700 1 --2- 172.21.15.6:0/176555736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b58159380 0x7f5b58156cf0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:09.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:09.197+0000 7f5b5d2e7700 1 -- 172.21.15.6:0/176555736 >> 172.21.15.6:0/176555736 conn(0x7f5b58068680 msgr2=0x7f5b580c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:09.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:09.197+0000 7f5b5d2e7700 1 -- 172.21.15.6:0/176555736 shutdown_connections 2023-10-06T02:25:09.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:09.197+0000 7f5b5d2e7700 1 -- 172.21.15.6:0/176555736 wait complete. 2023-10-06T02:25:09.210 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:25:09.210 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:25:09.210 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:25:09.210 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:25:09.210 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:09.210 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:25:09.211 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:25:09.211 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:25:09.211 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:25:09.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:09.211 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:25:09.226 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:25:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:25:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:25:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:25:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:09.227 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:25:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:25:09.227 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:25:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:25:09.227 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:25:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:25:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:25:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42037sec preferred_lft 42037sec 2023-10-06T02:25:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:25:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:09.228 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:25:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:25:09.228 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:25:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:25:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:25:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:09.228 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:25:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:25:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:25:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:09.229 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:25:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:25:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:25:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:09.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:09.229 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:25:09.290 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:25:09.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:09.291 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:25:09.348 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:25:09.348 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:25:09.348 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:25:09.348 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:25:09.348 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:25:09.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:09.349 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:25:09.349 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:25:09.349 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:25:09.349 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:25:09.349 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:25:09.349 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:25:09.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:09.450 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:25:09.465 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:25:09.465 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:25:09.465 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:25:09.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:09.466 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:25:09.531 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:25:09.531 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:25:09.531 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:09.586 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:25:09.587 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:25:09.587 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:09.642 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:25:09.707 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:25:09.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:25:09.771 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:25:09.772 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:25:09.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:09.773 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:25:09.829 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:25:09.829 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:25:09.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:25:09.896 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:25:09.896 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:25:09.954 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:25:09.953+0000 7f611815f540 -1 init, newargv = 0x560c5766e850 newargc=15 2023-10-06T02:25:09.954 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[124708]: starting ceph client 2023-10-06T02:25:09.960 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[124708]: starting fuse 2023-10-06T02:25:09.964 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:25:09.965 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:25:09.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:09.966 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:25:10.021 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:25:10.022 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:25:10.022 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:25:10.022 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:25:10.022 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:25:10.022 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:25:10.022 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:25:10.022 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:25:10.022 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:25:10.023 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:25:10.023 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:25:10.023 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:25:10.023 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:25:10.023 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:25:10.023 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:25:10.023 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:25:10.023 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:25:10.023 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:25:10.023 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:25:10.023 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:25:10.023 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:25:10.023 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:25:10.024 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:25:10.024 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:25:10.024 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:25:10.024 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:25:10.024 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:25:10.024 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:25:10.025 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:25:10.145 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.124708.asok 2023-10-06T02:25:10.327 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.124708.asok 2023-10-06T02:25:10.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:10.327 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.124708.asok status 2023-10-06T02:25:10.483 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:25:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:25:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:25:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:25:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:25:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:25:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:25:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "124708", 2023-10-06T02:25:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:25:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:25:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:25:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:25:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 7959, 2023-10-06T02:25:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:25:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:25:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:25:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 7959 2023-10-06T02:25:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:25:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:25:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:25:10.486 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:25:10.486 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 624773120 2023-10-06T02:25:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:25:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:25:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:25:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:25:10.758 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:25:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 624773120 2023-10-06T02:25:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:25:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.7959 192.168.0.1:0/624773120", 2023-10-06T02:25:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/624773120", 2023-10-06T02:25:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:25:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 95, 2023-10-06T02:25:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 96, 2023-10-06T02:25:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:25:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:25:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:25:10.760 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:25:10.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:10.761 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:25:10.761 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:10.778 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:25:11.254 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:11.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:11.254 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:11.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:11.284 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2023-10-06T02:25:11.327 INFO:teuthology.orchestra.run:waiting for 20 2023-10-06T02:25:11.346 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:25:11.345+0000 7f17ed6cb700 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/subdir) 2023-10-06T02:25:11.392 INFO:teuthology.orchestra.run.smithi006.stdout:.: 2023-10-06T02:25:11.392 INFO:teuthology.orchestra.run.smithi006.stdout:subdir 2023-10-06T02:25:11.392 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:11.392 INFO:teuthology.orchestra.run.smithi006.stdout:./subdir: 2023-10-06T02:25:11.392 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 10000000000.00000000' did not caused DAMAGED state 2023-10-06T02:25:11.392 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 600.00000000' 2023-10-06T02:25:11.393 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:25:11.393 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:25:11.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:11.475 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:25:11.475 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:25:11.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:11.475 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:25:11.533 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:25:11.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.700+0000 7fa37d5ec700 1 Processor -- start 2023-10-06T02:25:11.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.700+0000 7fa37d5ec700 1 -- start start 2023-10-06T02:25:11.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.700+0000 7fa37d5ec700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3780a8d90 0x7fa3780af200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.700+0000 7fa37d5ec700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3780b3820 0x7fa378069790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.700+0000 7fa37d5ec700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37806b030 con 0x7fa3780a89c0 2023-10-06T02:25:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.700+0000 7fa37d5ec700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3780b1ab0 con 0x7fa3780a8d90 2023-10-06T02:25:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.700+0000 7fa37d5ec700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37806ad50 con 0x7fa3780b3820 2023-10-06T02:25:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.700+0000 7fa3767fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3780a8d90 0x7fa3780af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.701+0000 7fa3767fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3780a8d90 0x7fa3780af200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43638/0 (socket says 172.21.15.6:43638) 2023-10-06T02:25:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.701+0000 7fa3767fc700 1 -- 172.21.15.6:0/4276683007 learned_addr learned my addr 172.21.15.6:0/4276683007 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.701+0000 7fa3777fe700 1 --2- 172.21.15.6:0/4276683007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3780b3820 0x7fa378069790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.701+0000 7fa3767fc700 1 -- 172.21.15.6:0/4276683007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3780b3820 msgr2=0x7fa378069790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.701+0000 7fa3767fc700 1 --2- 172.21.15.6:0/4276683007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3780b3820 0x7fa378069790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.701+0000 7fa3767fc700 1 -- 172.21.15.6:0/4276683007 >> v1:172.21.15.175:6789/0 conn(0x7fa3780a89c0 legacy=0x7fa3780aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.701+0000 7fa3767fc700 1 -- 172.21.15.6:0/4276683007 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3780b1d30 con 0x7fa3780a8d90 2023-10-06T02:25:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.701+0000 7fa3777fe700 1 --2- 172.21.15.6:0/4276683007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3780b3820 0x7fa378069790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.701+0000 7fa3767fc700 1 --2- 172.21.15.6:0/4276683007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780a8d90 0x7fa3780af200 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fa3600099b0 tx=0x7fa360009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eeb4a0af6e7bb9b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.701+0000 7fa375ffb700 1 -- 172.21.15.6:0/4276683007 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36000b820 con 0x7fa3780a8d90 2023-10-06T02:25:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.701+0000 7fa375ffb700 1 -- 172.21.15.6:0/4276683007 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36000b980 con 0x7fa3780a8d90 2023-10-06T02:25:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.701+0000 7fa375ffb700 1 -- 172.21.15.6:0/4276683007 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36000bd20 con 0x7fa3780a8d90 2023-10-06T02:25:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.702+0000 7fa37d5ec700 1 -- 172.21.15.6:0/4276683007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780a8d90 msgr2=0x7fa3780af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.702+0000 7fa37d5ec700 1 --2- 172.21.15.6:0/4276683007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780a8d90 0x7fa3780af200 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fa3600099b0 tx=0x7fa360009250 comp rx=0 tx=0).stop 2023-10-06T02:25:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.702+0000 7fa37d5ec700 1 -- 172.21.15.6:0/4276683007 shutdown_connections 2023-10-06T02:25:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.702+0000 7fa37d5ec700 1 --2- 172.21.15.6:0/4276683007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3780b3820 0x7fa378069790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.702+0000 7fa37d5ec700 1 --2- 172.21.15.6:0/4276683007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780a8d90 0x7fa3780af200 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.702+0000 7fa37d5ec700 1 -- 172.21.15.6:0/4276683007 >> 172.21.15.6:0/4276683007 conn(0x7fa378067910 msgr2=0x7fa3780ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.702+0000 7fa37d5ec700 1 -- 172.21.15.6:0/4276683007 shutdown_connections 2023-10-06T02:25:11.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.702+0000 7fa37d5ec700 1 -- 172.21.15.6:0/4276683007 wait complete. 2023-10-06T02:25:11.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.703+0000 7fa37d5ec700 1 Processor -- start 2023-10-06T02:25:11.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.703+0000 7fa37d5ec700 1 -- start start 2023-10-06T02:25:11.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.704+0000 7fa37d5ec700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3780a89c0 0x7fa37816a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:11.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.704+0000 7fa37d5ec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780a8d90 0x7fa378157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:11.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.704+0000 7fa37d5ec700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3780b3820 0x7fa3780c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.704+0000 7fa37d5ec700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3780ccbd0 con 0x7fa3780a8d90 2023-10-06T02:25:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.704+0000 7fa37d5ec700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa378097bb0 con 0x7fa3780a89c0 2023-10-06T02:25:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.704+0000 7fa37d5ec700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa378098450 con 0x7fa3780b3820 2023-10-06T02:25:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.704+0000 7fa3767fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780a8d90 0x7fa378157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.704+0000 7fa3767fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780a8d90 0x7fa378157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43650/0 (socket says 172.21.15.6:43650) 2023-10-06T02:25:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.704+0000 7fa3767fc700 1 -- 172.21.15.6:0/2402175206 learned_addr learned my addr 172.21.15.6:0/2402175206 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.704+0000 7fa376ffd700 1 --2- 172.21.15.6:0/2402175206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3780a89c0 0x7fa37816a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.704+0000 7fa3777fe700 1 --2- 172.21.15.6:0/2402175206 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3780b3820 0x7fa3780c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.704+0000 7fa3767fc700 1 -- 172.21.15.6:0/2402175206 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3780b3820 msgr2=0x7fa3780c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.704+0000 7fa3767fc700 1 --2- 172.21.15.6:0/2402175206 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3780b3820 0x7fa3780c3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.704+0000 7fa3767fc700 1 -- 172.21.15.6:0/2402175206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3780a89c0 msgr2=0x7fa37816a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.704+0000 7fa3767fc700 1 --2- 172.21.15.6:0/2402175206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3780a89c0 0x7fa37816a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.704+0000 7fa3767fc700 1 -- 172.21.15.6:0/2402175206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3600094f0 con 0x7fa3780a8d90 2023-10-06T02:25:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.704+0000 7fa3767fc700 1 --2- 172.21.15.6:0/2402175206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780a8d90 0x7fa378157980 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fa3600030c0 tx=0x7fa360016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.705+0000 7fa36effd700 1 -- 172.21.15.6:0/2402175206 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa360011bf0 con 0x7fa3780a8d90 2023-10-06T02:25:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.705+0000 7fa36effd700 1 -- 172.21.15.6:0/2402175206 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa360020070 con 0x7fa3780a8d90 2023-10-06T02:25:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.705+0000 7fa37d5ec700 1 -- 172.21.15.6:0/2402175206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3780c3410 con 0x7fa3780a8d90 2023-10-06T02:25:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.705+0000 7fa36effd700 1 -- 172.21.15.6:0/2402175206 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36001b450 con 0x7fa3780a8d90 2023-10-06T02:25:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.705+0000 7fa37d5ec700 1 -- 172.21.15.6:0/2402175206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3780980e0 con 0x7fa3780a8d90 2023-10-06T02:25:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.706+0000 7fa37d5ec700 1 -- 172.21.15.6:0/2402175206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa378087170 con 0x7fa3780a8d90 2023-10-06T02:25:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.706+0000 7fa36effd700 1 -- 172.21.15.6:0/2402175206 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa360022030 con 0x7fa3780a8d90 2023-10-06T02:25:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.706+0000 7fa36effd700 1 --2- 172.21.15.6:0/2402175206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa358066f30 0x7fa3580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.707+0000 7fa36effd700 1 -- 172.21.15.6:0/2402175206 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fa3600865f0 con 0x7fa3780a8d90 2023-10-06T02:25:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.707+0000 7fa376ffd700 1 --2- 172.21.15.6:0/2402175206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa358066f30 0x7fa3580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.707+0000 7fa376ffd700 1 --2- 172.21.15.6:0/2402175206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa358066f30 0x7fa3580693e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa3781676c0 tx=0x7fa370009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.711+0000 7fa36effd700 1 -- 172.21.15.6:0/2402175206 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa360053570 con 0x7fa3780a8d90 2023-10-06T02:25:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.949+0000 7fa37d5ec700 1 -- 172.21.15.6:0/2402175206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa378087170 con 0x7fa3780a8d90 2023-10-06T02:25:11.951 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:25:11.950+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:25:11.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.954+0000 7fa36effd700 1 -- 172.21.15.6:0/2402175206 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v96) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa360056b90 con 0x7fa3780a8d90 2023-10-06T02:25:11.956 INFO:tasks.ceph.mds.a.smithi006.stderr: -637> 2023-10-06T02:25:05.813+0000 7f17f0ed2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:25:11.958 INFO:tasks.ceph.mds.a.smithi006.stderr: -66> 2023-10-06T02:25:11.345+0000 7f17ed6cb700 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/subdir) 2023-10-06T02:25:11.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.957+0000 7fa37d5ec700 1 -- 172.21.15.6:0/2402175206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa358066f30 msgr2=0x7fa3580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:11.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.957+0000 7fa37d5ec700 1 --2- 172.21.15.6:0/2402175206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa358066f30 0x7fa3580693e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa3781676c0 tx=0x7fa370009060 comp rx=0 tx=0).stop 2023-10-06T02:25:11.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.957+0000 7fa37d5ec700 1 -- 172.21.15.6:0/2402175206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780a8d90 msgr2=0x7fa378157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:11.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.957+0000 7fa37d5ec700 1 --2- 172.21.15.6:0/2402175206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780a8d90 0x7fa378157980 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fa3600030c0 tx=0x7fa360016000 comp rx=0 tx=0).stop 2023-10-06T02:25:11.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.957+0000 7fa37d5ec700 1 -- 172.21.15.6:0/2402175206 shutdown_connections 2023-10-06T02:25:11.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.957+0000 7fa37d5ec700 1 --2- 172.21.15.6:0/2402175206 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3780b3820 0x7fa3780c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:11.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.957+0000 7fa37d5ec700 1 --2- 172.21.15.6:0/2402175206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3780a89c0 0x7fa37816a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:11.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.957+0000 7fa37d5ec700 1 --2- 172.21.15.6:0/2402175206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa358066f30 0x7fa3580693e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:11.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.957+0000 7fa37d5ec700 1 --2- 172.21.15.6:0/2402175206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780a8d90 0x7fa378157980 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:11.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.957+0000 7fa37d5ec700 1 -- 172.21.15.6:0/2402175206 >> 172.21.15.6:0/2402175206 conn(0x7fa378067910 msgr2=0x7fa378069750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:11.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.957+0000 7fa37d5ec700 1 -- 172.21.15.6:0/2402175206 shutdown_connections 2023-10-06T02:25:11.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:11.957+0000 7fa37d5ec700 1 -- 172.21.15.6:0/2402175206 wait complete. 2023-10-06T02:25:11.962 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:25:11.976 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:25:11.983 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:25:12.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.097+0000 7f63ef43c700 1 Processor -- start 2023-10-06T02:25:12.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.097+0000 7f63ef43c700 1 -- start start 2023-10-06T02:25:12.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.098+0000 7f63ef43c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f63e80cd750 0x7f63e81642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:12.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.098+0000 7f63ef43c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e806a1a0 con 0x7f63e806a910 2023-10-06T02:25:12.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.098+0000 7f63ef43c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e806a480 con 0x7f63e815cae0 2023-10-06T02:25:12.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.098+0000 7f63ef43c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e80cdbd0 con 0x7f63e80cd750 2023-10-06T02:25:12.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.098+0000 7f63ec9d7700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f63e806a910 0x7f63e806ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35498/0 (socket says 172.21.15.6:35498) 2023-10-06T02:25:12.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.098+0000 7f63ec9d7700 1 -- 172.21.15.6:0/2877644111 learned_addr learned my addr 172.21.15.6:0/2877644111 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:12.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63ed9d9700 1 --2- 172.21.15.6:0/2877644111 >> v2:172.21.15.175:3300/0 conn(0x7f63e80cd750 0x7f63e81642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:12.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63e7fff700 1 -- 172.21.15.6:0/2877644111 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523479833 0 0) 0x7f63e806a1a0 con 0x7f63e806a910 2023-10-06T02:25:12.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63e7fff700 1 -- 172.21.15.6:0/2877644111 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63d0003570 con 0x7f63e806a910 2023-10-06T02:25:12.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63e7fff700 1 -- 172.21.15.6:0/2877644111 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4271514197 0 0) 0x7f63d0003570 con 0x7f63e806a910 2023-10-06T02:25:12.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63e7fff700 1 -- 172.21.15.6:0/2877644111 >> v2:172.21.15.175:3300/0 conn(0x7f63e80cd750 msgr2=0x7f63e81642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:12.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63e7fff700 1 --2- 172.21.15.6:0/2877644111 >> v2:172.21.15.175:3300/0 conn(0x7f63e80cd750 0x7f63e81642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:12.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63e7fff700 1 -- 172.21.15.6:0/2877644111 >> v1:172.21.15.175:6789/0 conn(0x7f63e815cae0 legacy=0x7f63e80c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:12.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63e7fff700 1 -- 172.21.15.6:0/2877644111 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e80c8e40 con 0x7f63e806a910 2023-10-06T02:25:12.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63e7fff700 1 -- 172.21.15.6:0/2877644111 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f63dc001470 con 0x7f63e806a910 2023-10-06T02:25:12.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63e7fff700 1 -- 172.21.15.6:0/2877644111 >> v1:172.21.15.6:6789/0 conn(0x7f63e806a910 legacy=0x7f63e806ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:12.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63e7fff700 1 --2- 172.21.15.6:0/2877644111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63d0003a60 0x7f63d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:12.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63e7fff700 1 --2- 172.21.15.6:0/2877644111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63d0004810 0x7f63d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:12.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63e7fff700 1 --2- 172.21.15.6:0/2877644111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63d00051c0 0x7f63d000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:12.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63e7fff700 1 -- 172.21.15.6:0/2877644111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80cdbd0 con 0x7f63d00051c0 2023-10-06T02:25:12.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63e7fff700 1 -- 172.21.15.6:0/2877644111 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d000c0d0 con 0x7f63d0003a60 2023-10-06T02:25:12.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63e7fff700 1 -- 172.21.15.6:0/2877644111 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d000c290 con 0x7f63d0004810 2023-10-06T02:25:12.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63ed9d9700 1 --2- 172.21.15.6:0/2877644111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63d00051c0 0x7f63d000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:12.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63ed1d8700 1 --2- 172.21.15.6:0/2877644111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63d0003a60 0x7f63d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:12.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.099+0000 7f63ec9d7700 1 --2- 172.21.15.6:0/2877644111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63d0004810 0x7f63d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:12.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.100+0000 7f63ed9d9700 1 -- 172.21.15.6:0/2877644111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63d0004810 msgr2=0x7f63d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:12.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.100+0000 7f63ed9d9700 1 --2- 172.21.15.6:0/2877644111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63d0004810 0x7f63d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:12.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.100+0000 7f63ed9d9700 1 -- 172.21.15.6:0/2877644111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63d0003a60 msgr2=0x7f63d0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:12.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.100+0000 7f63ed9d9700 1 --2- 172.21.15.6:0/2877644111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63d0003a60 0x7f63d0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:12.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.100+0000 7f63ed9d9700 1 -- 172.21.15.6:0/2877644111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d0003570 con 0x7f63d00051c0 2023-10-06T02:25:12.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.100+0000 7f63ed1d8700 1 --2- 172.21.15.6:0/2877644111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63d0003a60 0x7f63d0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:25:12.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.100+0000 7f63ed9d9700 1 -- 172.21.15.6:0/2877644111 reap_dead start 2023-10-06T02:25:12.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.100+0000 7f63ed9d9700 1 --2- 172.21.15.6:0/2877644111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63d00051c0 0x7f63d000ba60 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f63d8016a20 tx=0x7f63d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d11331e542213d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:12.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.100+0000 7f63e7fff700 1 -- 172.21.15.6:0/2877644111 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800c530 con 0x7f63d00051c0 2023-10-06T02:25:12.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.100+0000 7f63e7fff700 1 -- 172.21.15.6:0/2877644111 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d800c690 con 0x7f63d00051c0 2023-10-06T02:25:12.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.100+0000 7f63e7fff700 1 -- 172.21.15.6:0/2877644111 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800ca50 con 0x7f63d00051c0 2023-10-06T02:25:12.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.100+0000 7f63ef43c700 1 -- 172.21.15.6:0/2877644111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63d00051c0 msgr2=0x7f63d000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:12.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.100+0000 7f63ef43c700 1 --2- 172.21.15.6:0/2877644111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63d00051c0 0x7f63d000ba60 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f63d8016a20 tx=0x7f63d800b040 comp rx=0 tx=0).stop 2023-10-06T02:25:12.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.100+0000 7f63ef43c700 1 -- 172.21.15.6:0/2877644111 shutdown_connections 2023-10-06T02:25:12.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.100+0000 7f63ef43c700 1 --2- 172.21.15.6:0/2877644111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63d00051c0 0x7f63d000ba60 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:12.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.100+0000 7f63ef43c700 1 -- 172.21.15.6:0/2877644111 >> 172.21.15.6:0/2877644111 conn(0x7f63e8067910 msgr2=0x7f63e80ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:12.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.101+0000 7f63ef43c700 1 -- 172.21.15.6:0/2877644111 shutdown_connections 2023-10-06T02:25:12.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.101+0000 7f63ef43c700 1 -- 172.21.15.6:0/2877644111 wait complete. 2023-10-06T02:25:12.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.102+0000 7f63ef43c700 1 Processor -- start 2023-10-06T02:25:12.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.102+0000 7f63ef43c700 1 -- start start 2023-10-06T02:25:12.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.102+0000 7f63ef43c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63d00051c0 0x7f63e81525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:12.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.102+0000 7f63ef43c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e80c51a0 0x7f63e80c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:12.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63ef43c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63e80c77b0 0x7f63e80c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:12.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63ef43c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e8153f50 con 0x7f63e80c51a0 2023-10-06T02:25:12.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63ef43c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80c5b50 con 0x7f63d00051c0 2023-10-06T02:25:12.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63ef43c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e8152eb0 con 0x7f63e80c77b0 2023-10-06T02:25:12.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63ec9d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e80c51a0 0x7f63e80c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:12.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63ec9d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e80c51a0 0x7f63e80c5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43692/0 (socket says 172.21.15.6:43692) 2023-10-06T02:25:12.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63ec9d7700 1 -- 172.21.15.6:0/2359529921 learned_addr learned my addr 172.21.15.6:0/2359529921 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:12.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63ed1d8700 1 --2- 172.21.15.6:0/2359529921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63d00051c0 0x7f63e81525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:12.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63ed9d9700 1 --2- 172.21.15.6:0/2359529921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63e80c77b0 0x7f63e80c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:12.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63ec9d7700 1 -- 172.21.15.6:0/2359529921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63e80c77b0 msgr2=0x7f63e80c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:12.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63ec9d7700 1 --2- 172.21.15.6:0/2359529921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63e80c77b0 0x7f63e80c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:12.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63ec9d7700 1 -- 172.21.15.6:0/2359529921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63d00051c0 msgr2=0x7f63e81525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:12.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63ec9d7700 1 --2- 172.21.15.6:0/2359529921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63d00051c0 0x7f63e81525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:12.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63ec9d7700 1 -- 172.21.15.6:0/2359529921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e8153190 con 0x7f63e80c51a0 2023-10-06T02:25:12.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63ec9d7700 1 --2- 172.21.15.6:0/2359529921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e80c51a0 0x7f63e80c5610 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f63dc007390 tx=0x7f63dc001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:12.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63e57fa700 1 -- 172.21.15.6:0/2359529921 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc018030 con 0x7f63e80c51a0 2023-10-06T02:25:12.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63e57fa700 1 -- 172.21.15.6:0/2359529921 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc00f670 con 0x7f63e80c51a0 2023-10-06T02:25:12.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63ef43c700 1 -- 172.21.15.6:0/2359529921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e8153470 con 0x7f63e80c51a0 2023-10-06T02:25:12.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63e57fa700 1 -- 172.21.15.6:0/2359529921 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc00fa30 con 0x7f63e80c51a0 2023-10-06T02:25:12.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.103+0000 7f63ef43c700 1 -- 172.21.15.6:0/2359529921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e8153a30 con 0x7f63e80c51a0 2023-10-06T02:25:12.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.104+0000 7f63ef43c700 1 -- 172.21.15.6:0/2359529921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e8153c50 con 0x7f63e80c51a0 2023-10-06T02:25:12.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.105+0000 7f63e57fa700 1 -- 172.21.15.6:0/2359529921 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63dc01b070 con 0x7f63e80c51a0 2023-10-06T02:25:12.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.105+0000 7f63e57fa700 1 --2- 172.21.15.6:0/2359529921 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f63d4066f30 0x7f63d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:12.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.105+0000 7f63e57fa700 1 -- 172.21.15.6:0/2359529921 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f63dc019070 con 0x7f63e80c51a0 2023-10-06T02:25:12.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.105+0000 7f63ed1d8700 1 --2- 172.21.15.6:0/2359529921 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f63d4066f30 0x7f63d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:12.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.106+0000 7f63ed1d8700 1 --2- 172.21.15.6:0/2359529921 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f63d4066f30 0x7f63d40693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f63e00013c0 tx=0x7f63e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:12.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.109+0000 7f63e57fa700 1 -- 172.21.15.6:0/2359529921 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63dc051570 con 0x7f63e80c51a0 2023-10-06T02:25:12.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.386+0000 7f63ef43c700 1 -- 172.21.15.6:0/2359529921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f63e806e590 con 0x7f63e80c51a0 2023-10-06T02:25:12.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.955+0000 7f63e57fa700 1 -- 172.21.15.6:0/2359529921 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v97) v1 ==== 107+0+0 (secure 0 0 0) 0x7f63dc054b90 con 0x7f63e80c51a0 2023-10-06T02:25:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.958+0000 7f63ef43c700 1 -- 172.21.15.6:0/2359529921 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f63d4066f30 msgr2=0x7f63d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.958+0000 7f63ef43c700 1 --2- 172.21.15.6:0/2359529921 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f63d4066f30 0x7f63d40693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f63e00013c0 tx=0x7f63e0009040 comp rx=0 tx=0).stop 2023-10-06T02:25:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.958+0000 7f63ef43c700 1 -- 172.21.15.6:0/2359529921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e80c51a0 msgr2=0x7f63e80c5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.958+0000 7f63ef43c700 1 --2- 172.21.15.6:0/2359529921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e80c51a0 0x7f63e80c5610 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f63dc007390 tx=0x7f63dc001e50 comp rx=0 tx=0).stop 2023-10-06T02:25:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.959+0000 7f63ef43c700 1 -- 172.21.15.6:0/2359529921 shutdown_connections 2023-10-06T02:25:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.959+0000 7f63ef43c700 1 --2- 172.21.15.6:0/2359529921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63e80c77b0 0x7f63e80c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.959+0000 7f63ef43c700 1 --2- 172.21.15.6:0/2359529921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63d00051c0 0x7f63e81525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.959+0000 7f63ef43c700 1 --2- 172.21.15.6:0/2359529921 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f63d4066f30 0x7f63d40693e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.959+0000 7f63ef43c700 1 --2- 172.21.15.6:0/2359529921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63e80c51a0 0x7f63e80c5610 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.959+0000 7f63ef43c700 1 -- 172.21.15.6:0/2359529921 >> 172.21.15.6:0/2359529921 conn(0x7f63e8067910 msgr2=0x7f63e806c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.959+0000 7f63ef43c700 1 -- 172.21.15.6:0/2359529921 shutdown_connections 2023-10-06T02:25:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:12.959+0000 7f63ef43c700 1 -- 172.21.15.6:0/2359529921 wait complete. 2023-10-06T02:25:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:nothing to do: rank is not damaged 2023-10-06T02:25:12.975 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:25:13.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.056+0000 7fcd4a242000 1 Processor -- start 2023-10-06T02:25:13.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.056+0000 7fcd4a242000 1 -- start start 2023-10-06T02:25:13.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd4a242000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd30002330 0x562d2728b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd4a242000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d273301b0 0x562d27289330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd4a242000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d2729d250 0x562d2725b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd4a242000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d27204320 con 0x562d273301b0 2023-10-06T02:25:13.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd4a242000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d271a8980 con 0x562d2729d250 2023-10-06T02:25:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd4a242000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d271a8620 con 0x7fcd30002330 2023-10-06T02:25:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd42c7c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d273301b0 0x562d27289330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd42c7c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d273301b0 0x562d27289330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43716/0 (socket says 172.21.15.6:43716) 2023-10-06T02:25:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd42c7c700 1 -- 172.21.15.6:0/1178421659 learned_addr learned my addr 172.21.15.6:0/1178421659 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd4347d700 1 --2- 172.21.15.6:0/1178421659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd30002330 0x562d2728b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd43c7e700 1 --2- 172.21.15.6:0/1178421659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d2729d250 0x562d2725b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd42c7c700 1 -- 172.21.15.6:0/1178421659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd30002330 msgr2=0x562d2728b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd42c7c700 1 --2- 172.21.15.6:0/1178421659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd30002330 0x562d2728b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd42c7c700 1 -- 172.21.15.6:0/1178421659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d2729d250 msgr2=0x562d2725b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd42c7c700 1 --2- 172.21.15.6:0/1178421659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d2729d250 0x562d2725b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd42c7c700 1 -- 172.21.15.6:0/1178421659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d271aaae0 con 0x562d273301b0 2023-10-06T02:25:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd42c7c700 1 --2- 172.21.15.6:0/1178421659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d273301b0 0x562d27289330 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c0010e0 tx=0x7fcd2c009270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e898611eb5c26f09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:13.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd41c7a700 1 -- 172.21.15.6:0/1178421659 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c009d10 con 0x562d273301b0 2023-10-06T02:25:13.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd41c7a700 1 -- 172.21.15.6:0/1178421659 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c005030 con 0x562d273301b0 2023-10-06T02:25:13.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.057+0000 7fcd41c7a700 1 -- 172.21.15.6:0/1178421659 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c009e90 con 0x562d273301b0 2023-10-06T02:25:13.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.058+0000 7fcd4a242000 1 -- 172.21.15.6:0/1178421659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d273301b0 msgr2=0x562d27289330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.058+0000 7fcd4a242000 1 --2- 172.21.15.6:0/1178421659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d273301b0 0x562d27289330 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c0010e0 tx=0x7fcd2c009270 comp rx=0 tx=0).stop 2023-10-06T02:25:13.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.058+0000 7fcd4a242000 1 -- 172.21.15.6:0/1178421659 shutdown_connections 2023-10-06T02:25:13.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.058+0000 7fcd4a242000 1 --2- 172.21.15.6:0/1178421659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d2729d250 0x562d2725b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.058+0000 7fcd4a242000 1 --2- 172.21.15.6:0/1178421659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd30002330 0x562d2728b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.058+0000 7fcd4a242000 1 --2- 172.21.15.6:0/1178421659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d273301b0 0x562d27289330 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.058+0000 7fcd4a242000 1 -- 172.21.15.6:0/1178421659 >> 172.21.15.6:0/1178421659 conn(0x562d272a4bd0 msgr2=0x562d2732e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:13.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.058+0000 7fcd4a242000 1 -- 172.21.15.6:0/1178421659 shutdown_connections 2023-10-06T02:25:13.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.058+0000 7fcd4a242000 1 -- 172.21.15.6:0/1178421659 wait complete. 2023-10-06T02:25:13.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.059+0000 7fcd4a242000 1 Processor -- start 2023-10-06T02:25:13.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.059+0000 7fcd4a242000 1 -- start start 2023-10-06T02:25:13.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd4a242000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562d2729d250 0x562d27340ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd4a242000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d273301b0 0x562d272a2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd4a242000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd30002330 0x562d2732c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd4a242000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d2719f400 con 0x562d273301b0 2023-10-06T02:25:13.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd4a242000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d27342b30 con 0x7fcd30002330 2023-10-06T02:25:13.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd4a242000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d27342dd0 con 0x562d2729d250 2023-10-06T02:25:13.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd42c7c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d273301b0 0x562d272a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd42c7c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d273301b0 0x562d272a2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43730/0 (socket says 172.21.15.6:43730) 2023-10-06T02:25:13.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 learned_addr learned my addr 172.21.15.6:0/3285333610 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:13.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd43c7e700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd30002330 0x562d2732c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd4347d700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562d2729d250 0x562d27340ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562d2729d250 msgr2=0x562d27340ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd42c7c700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562d2729d250 0x562d27340ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd30002330 msgr2=0x562d2732c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd42c7c700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd30002330 0x562d2732c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d271b73d0 con 0x562d273301b0 2023-10-06T02:25:13.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd42c7c700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d273301b0 0x562d272a2180 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c0092d0 tx=0x7fcd2c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:13.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd3bfff700 1 -- 172.21.15.6:0/3285333610 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c018420 con 0x562d273301b0 2023-10-06T02:25:13.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd3bfff700 1 -- 172.21.15.6:0/3285333610 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c018580 con 0x562d273301b0 2023-10-06T02:25:13.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd3bfff700 1 -- 172.21.15.6:0/3285333610 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c018900 con 0x562d273301b0 2023-10-06T02:25:13.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.060+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562d271aa540 con 0x562d273301b0 2023-10-06T02:25:13.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.061+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d27343310 con 0x562d273301b0 2023-10-06T02:25:13.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.062+0000 7fcd3bfff700 1 -- 172.21.15.6:0/3285333610 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd2c015020 con 0x562d273301b0 2023-10-06T02:25:13.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.062+0000 7fcd3bfff700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcd240658c0 0x7fcd24067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.062+0000 7fcd3bfff700 1 -- 172.21.15.6:0/3285333610 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fcd2c084ff0 con 0x562d273301b0 2023-10-06T02:25:13.069 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:25:13.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.062+0000 7fcd4347d700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcd240658c0 0x7fcd24067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.063+0000 7fcd4a242000 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x562d272a26c0 0x562d273437b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.063+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27342380 con 0x562d272a26c0 2023-10-06T02:25:13.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.063+0000 7fcd43c7e700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x562d272a26c0 0x562d273437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.063+0000 7fcd4347d700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcd240658c0 0x7fcd24067d70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fcd34001350 tx=0x7fcd34016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:13.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.063+0000 7fcd43c7e700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x562d272a26c0 0x562d273437b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:13.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.065+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v97'43 uv16 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.065+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2732cb40 con 0x562d272a26c0 2023-10-06T02:25:13.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.066+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v97'44 uv44 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.066+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27343cf0 con 0x562d272a26c0 2023-10-06T02:25:13.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.068+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v97'45 uv45 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.072 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:25:13.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.068+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734e4e0 con 0x562d272a26c0 2023-10-06T02:25:13.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.071+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v97'46 uv46 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.071+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734e890 con 0x562d272a26c0 2023-10-06T02:25:13.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.073+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v97'47 uv47 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.073+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734d4d0 con 0x562d272a26c0 2023-10-06T02:25:13.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.076+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v97'48 uv48 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.076+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734d8d0 con 0x562d272a26c0 2023-10-06T02:25:13.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.077+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v97'49 uv22 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.077+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734dc80 con 0x562d272a26c0 2023-10-06T02:25:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.079+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v97'50 uv50 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.079+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734dc80 con 0x562d272a26c0 2023-10-06T02:25:13.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.082+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v97'51 uv51 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.083 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:25:13.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.082+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734dc80 con 0x562d272a26c0 2023-10-06T02:25:13.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.083+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v97'52 uv52 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.083+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734dc80 con 0x562d272a26c0 2023-10-06T02:25:13.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.086+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v97'53 uv53 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.086+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734dc80 con 0x562d272a26c0 2023-10-06T02:25:13.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.088+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v97'54 uv54 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.088+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734dc80 con 0x562d272a26c0 2023-10-06T02:25:13.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.090+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v97'55 uv55 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.091 INFO:teuthology.orchestra.run.smithi006.stdout:Write #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:25:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.090+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734dc80 con 0x562d272a26c0 2023-10-06T02:25:13.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.092+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [setxattr (30)] v97'56 uv56 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.092+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734dc80 con 0x562d272a26c0 2023-10-06T02:25:13.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.094+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [setxattr (62)] v97'57 uv57 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.094+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734dc80 con 0x562d272a26c0 2023-10-06T02:25:13.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.095+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [omap-set-header] v97'58 uv58 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.095+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734ec40 con 0x562d272a26c0 2023-10-06T02:25:13.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.096+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [omap-set-vals] v97'59 uv59 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.096+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734ec40 con 0x562d272a26c0 2023-10-06T02:25:13.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.097+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 600.00000000 [create] v97'60 uv35 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.097+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734ec40 con 0x562d272a26c0 2023-10-06T02:25:13.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.098+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 600.00000000 [delete] v97'61 uv61 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.098+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734ec40 con 0x562d272a26c0 2023-10-06T02:25:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.099+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v97'62 uv62 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.101 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:25:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.099+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734fc50 con 0x562d272a26c0 2023-10-06T02:25:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.101+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [setxattr (30)] v97'63 uv63 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.101+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734fc50 con 0x562d272a26c0 2023-10-06T02:25:13.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.102+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [setxattr (62)] v97'64 uv64 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.102+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734ec40 con 0x562d272a26c0 2023-10-06T02:25:13.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.103+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [omap-set-header] v97'65 uv65 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.103+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734ec40 con 0x562d272a26c0 2023-10-06T02:25:13.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.104+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 603.00000000 [create] v97'66 uv41 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.104+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734ec40 con 0x562d272a26c0 2023-10-06T02:25:13.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.105+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 603.00000000 [delete] v97'67 uv67 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.105+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734ec40 con 0x562d272a26c0 2023-10-06T02:25:13.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.106+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v97'68 uv68 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.108 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:25:13.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.106+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734fc50 con 0x562d272a26c0 2023-10-06T02:25:13.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.107+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [setxattr (30)] v97'69 uv69 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.107+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734fc50 con 0x562d272a26c0 2023-10-06T02:25:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.108+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [setxattr (62)] v97'70 uv70 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.108+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2734ec40 con 0x562d272a26c0 2023-10-06T02:25:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.109+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [omap-set-header] v97'71 uv71 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d272a26c0 2023-10-06T02:25:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.109+0000 7fcd4a242000 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x562d2734f150 0x562d27351530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.109+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:30 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27351a70 con 0x562d2734f150 2023-10-06T02:25:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.110+0000 7fcd4347d700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x562d2734f150 0x562d27351530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.110+0000 7fcd4347d700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x562d2734f150 0x562d27351530 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:13.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.111+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(30 1.00000000.inode [create] v97'43 uv23 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.111+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:31 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27351e20 con 0x562d2734f150 2023-10-06T02:25:13.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.113+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(31 1.00000000.inode [delete] v97'44 uv44 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.113+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d273521d0 con 0x562d2734f150 2023-10-06T02:25:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.114+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(32 1.00000000.inode [create] v97'45 uv45 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.115 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:25:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.114+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27352a70 con 0x562d2734f150 2023-10-06T02:25:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.115+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(33 1.00000000.inode [write 0~554] v97'46 uv46 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.115+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27352e20 con 0x562d2734f150 2023-10-06T02:25:13.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.116+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(34 1.00000000.inode [omap-set-header] v97'47 uv47 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.116+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d273531d0 con 0x562d2734f150 2023-10-06T02:25:13.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.117+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(35 200.00000000 [create] v97'48 uv42 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.117+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27353580 con 0x562d2734f150 2023-10-06T02:25:13.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.118+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(36 200.00000000 [delete] v97'49 uv49 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.118+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27353580 con 0x562d2734f150 2023-10-06T02:25:13.120 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:25:13.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.119+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(37 200.00000000 [create] v97'50 uv50 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.119+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27353580 con 0x562d2734f150 2023-10-06T02:25:13.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.120+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(38 200.00000000 [write 0~90] v97'51 uv51 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.120+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27353580 con 0x562d2734f150 2023-10-06T02:25:13.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.122+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(39 200.00000000 [omap-set-header] v97'52 uv52 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.122+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27353580 con 0x562d2734f150 2023-10-06T02:25:13.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.123+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(40 200.00000001 [create] v97'53 uv41 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.123+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27353580 con 0x562d2734f150 2023-10-06T02:25:13.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.124+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(41 200.00000001 [delete] v97'54 uv54 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.124+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27353580 con 0x562d2734f150 2023-10-06T02:25:13.126 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:25:13.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.125+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(42 200.00000001 [create] v97'55 uv55 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.125+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27356ca0 con 0x562d2734f150 2023-10-06T02:25:13.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.127+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(43 200.00000001 [write 0~14075] v97'56 uv56 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.127+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27356ca0 con 0x562d2734f150 2023-10-06T02:25:13.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.128+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(44 200.00000001 [omap-set-header] v97'57 uv57 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.128+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27353580 con 0x562d2734f150 2023-10-06T02:25:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.129+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(45 606.00000000 [create] v97'58 uv39 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.129+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27353580 con 0x562d2734f150 2023-10-06T02:25:13.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.130+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(46 606.00000000 [delete] v97'59 uv59 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.131+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27353580 con 0x562d2734f150 2023-10-06T02:25:13.133 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:25:13.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.132+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(47 606.00000000 [create] v97'60 uv60 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.132+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27354590 con 0x562d2734f150 2023-10-06T02:25:13.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.133+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(48 606.00000000 [setxattr (30)] v97'61 uv61 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.133+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27354590 con 0x562d2734f150 2023-10-06T02:25:13.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.134+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(49 606.00000000 [setxattr (62)] v97'62 uv62 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.134+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27353580 con 0x562d2734f150 2023-10-06T02:25:13.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.135+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(50 606.00000000 [omap-set-header] v97'63 uv63 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.135+0000 7fcd4a242000 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x562d27353a90 0x562d27355e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.135+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:51 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d273563b0 con 0x562d27353a90 2023-10-06T02:25:13.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.135+0000 7fcd42c7c700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x562d27353a90 0x562d27355e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.136+0000 7fcd42c7c700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x562d27353a90 0x562d27355e70 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:13.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.139+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(51 607.00000000 [create] v97'9 uv8 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.139+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:52 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27356760 con 0x562d27353a90 2023-10-06T02:25:13.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.140+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(52 607.00000000 [delete] v97'10 uv10 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.140+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27356b10 con 0x562d27353a90 2023-10-06T02:25:13.144 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:25:13.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.143+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(53 607.00000000 [create] v97'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.143+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d273583c0 con 0x562d27353a90 2023-10-06T02:25:13.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.147+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(54 607.00000000 [setxattr (30)] v97'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.147+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27358770 con 0x562d27353a90 2023-10-06T02:25:13.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.147+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(55 607.00000000 [setxattr (62)] v97'13 uv13 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.147+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d273573b0 con 0x562d27353a90 2023-10-06T02:25:13.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.150+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(56 607.00000000 [omap-set-header] v97'14 uv14 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.150+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d273577d0 con 0x562d27353a90 2023-10-06T02:25:13.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.151+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(57 mds0_openfiles.0 [create] v97'8 uv7 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.151+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27357c20 con 0x562d27353a90 2023-10-06T02:25:13.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.157+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(58 mds0_openfiles.0 [delete] v97'9 uv9 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.157+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27357c20 con 0x562d27353a90 2023-10-06T02:25:13.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.157+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(59 mds0_openfiles.0 [create] v97'10 uv10 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.158 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:25:13.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.157+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27357bd0 con 0x562d27353a90 2023-10-06T02:25:13.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.160+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(60 mds0_openfiles.0 [omap-set-header] v97'11 uv11 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.160+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:61 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27357ba0 con 0x562d2734f150 2023-10-06T02:25:13.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.165+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(61 608.00000000 [create] v97'9 uv8 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.165+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:62 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27357ba0 con 0x562d2734f150 2023-10-06T02:25:13.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.166+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(62 608.00000000 [delete] v97'10 uv10 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.166+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27357ba0 con 0x562d2734f150 2023-10-06T02:25:13.170 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:25:13.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.169+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(63 608.00000000 [create] v97'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.169+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27357ba0 con 0x562d2734f150 2023-10-06T02:25:13.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.172+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(64 608.00000000 [setxattr (30)] v97'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.172+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27357ba0 con 0x562d2734f150 2023-10-06T02:25:13.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.172+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(65 608.00000000 [setxattr (62)] v97'13 uv13 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.172+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27357ba0 con 0x562d2734f150 2023-10-06T02:25:13.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.176+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(66 608.00000000 [omap-set-header] v97'14 uv14 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2734f150 2023-10-06T02:25:13.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.176+0000 7fcd4a242000 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x562d27357fe0 0x562d2735b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.176+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:67 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735b580 con 0x562d27357fe0 2023-10-06T02:25:13.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.176+0000 7fcd43c7e700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x562d27357fe0 0x562d2735b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.176+0000 7fcd43c7e700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x562d27357fe0 0x562d2735b040 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:13.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.178+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(67 604.00000000 [create] v97'15 uv9 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27357fe0 2023-10-06T02:25:13.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.178+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:68 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735b580 con 0x562d27357fe0 2023-10-06T02:25:13.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.180+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(68 604.00000000 [delete] v97'16 uv16 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27357fe0 2023-10-06T02:25:13.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.180+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735b580 con 0x562d27357fe0 2023-10-06T02:25:13.183 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:25:13.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.183+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(69 604.00000000 [create] v97'17 uv17 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27357fe0 2023-10-06T02:25:13.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.183+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735c5d0 con 0x562d27357fe0 2023-10-06T02:25:13.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.184+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(70 604.00000000 [setxattr (30)] v97'18 uv18 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27357fe0 2023-10-06T02:25:13.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.184+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735c590 con 0x562d27357fe0 2023-10-06T02:25:13.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.186+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(71 604.00000000 [setxattr (62)] v97'19 uv19 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27357fe0 2023-10-06T02:25:13.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.186+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735b580 con 0x562d27357fe0 2023-10-06T02:25:13.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.189+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(72 604.00000000 [omap-set-header] v97'20 uv20 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27357fe0 2023-10-06T02:25:13.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.189+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735b580 con 0x562d27357fe0 2023-10-06T02:25:13.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.192+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(73 500.00000000 [create] v97'21 uv14 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27357fe0 2023-10-06T02:25:13.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.192+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735b580 con 0x562d27357fe0 2023-10-06T02:25:13.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.196+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(74 500.00000000 [delete] v97'22 uv22 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27357fe0 2023-10-06T02:25:13.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.196+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735b580 con 0x562d27357fe0 2023-10-06T02:25:13.197 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:25:13.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.197+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(75 500.00000000 [create] v97'23 uv23 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27357fe0 2023-10-06T02:25:13.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.197+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735b580 con 0x562d27357fe0 2023-10-06T02:25:13.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.198+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(76 500.00000000 [write 0~90] v97'24 uv24 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27357fe0 2023-10-06T02:25:13.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.198+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735b9a0 con 0x562d27357fe0 2023-10-06T02:25:13.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.201+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(77 500.00000000 [omap-set-header] v97'25 uv25 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27357fe0 2023-10-06T02:25:13.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.201+0000 7fcd4a242000 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x562d2735beb0 0x562d2735c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.201+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:78 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735e990 con 0x562d2735beb0 2023-10-06T02:25:13.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.201+0000 7fcd4347d700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x562d2735beb0 0x562d2735c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.201+0000 7fcd4347d700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x562d2735beb0 0x562d2735c2a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:13.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.202+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(78 mds_snaptable [create] v97'7 uv6 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2735beb0 2023-10-06T02:25:13.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.202+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:79 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735e990 con 0x562d2735beb0 2023-10-06T02:25:13.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.203+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(79 mds_snaptable [delete] v97'8 uv8 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2735beb0 2023-10-06T02:25:13.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.203+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735e990 con 0x562d2735beb0 2023-10-06T02:25:13.207 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:25:13.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.206+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(80 mds_snaptable [create] v97'9 uv9 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2735beb0 2023-10-06T02:25:13.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.206+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735ed90 con 0x562d2735beb0 2023-10-06T02:25:13.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.208+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(81 mds_snaptable [write 0~70] v97'10 uv10 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2735beb0 2023-10-06T02:25:13.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.208+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735ed90 con 0x562d2735beb0 2023-10-06T02:25:13.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.209+0000 7fcd4347d700 1 -- 172.21.15.6:0/3285333610 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v97'11 uv11 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcd34016070 con 0x562d2735beb0 2023-10-06T02:25:13.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.209+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:83 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735ed90 con 0x562d27353a90 2023-10-06T02:25:13.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.209+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(83 605.00000000 [create] v97'9 uv8 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.209+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:84 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735ed90 con 0x562d27353a90 2023-10-06T02:25:13.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.210+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(84 605.00000000 [delete] v97'10 uv10 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.210+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735ed90 con 0x562d27353a90 2023-10-06T02:25:13.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.211+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(85 605.00000000 [create] v97'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.212 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:25:13.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.211+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735fda0 con 0x562d27353a90 2023-10-06T02:25:13.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.212+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v97'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.212+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735fda0 con 0x562d27353a90 2023-10-06T02:25:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.212+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v97'13 uv13 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.212+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d2735ed90 con 0x562d27353a90 2023-10-06T02:25:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.213+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(88 605.00000000 [omap-set-header] v97'14 uv14 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.213+0000 7fcd4a242000 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x562d2735f2a0 0x562d27361680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.214+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:89 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27361ca0 con 0x562d2735f2a0 2023-10-06T02:25:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.214+0000 7fcd42c7c700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x562d2735f2a0 0x562d27361680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.214+0000 7fcd42c7c700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x562d2735f2a0 0x562d27361680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:13.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.215+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(89 mds0_inotable [create] v97'14 uv8 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d2735f2a0 2023-10-06T02:25:13.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.215+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:90 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362080 con 0x562d2735f2a0 2023-10-06T02:25:13.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.216+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(90 mds0_inotable [delete] v97'15 uv15 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d2735f2a0 2023-10-06T02:25:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.216+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362080 con 0x562d2735f2a0 2023-10-06T02:25:13.218 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:25:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.217+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(91 mds0_inotable [create] v97'16 uv16 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d2735f2a0 2023-10-06T02:25:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.217+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362080 con 0x562d2735f2a0 2023-10-06T02:25:13.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.218+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(92 mds0_inotable [write 0~34] v97'17 uv17 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d2735f2a0 2023-10-06T02:25:13.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.218+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362080 con 0x562d2735f2a0 2023-10-06T02:25:13.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.219+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v97'18 uv18 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d2735f2a0 2023-10-06T02:25:13.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.220+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362080 con 0x562d2735f2a0 2023-10-06T02:25:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.220+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(94 100.00000000 [create] v97'19 uv13 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d2735f2a0 2023-10-06T02:25:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.220+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362080 con 0x562d2735f2a0 2023-10-06T02:25:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.221+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(95 100.00000000 [delete] v97'20 uv20 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d2735f2a0 2023-10-06T02:25:13.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.221+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362080 con 0x562d2735f2a0 2023-10-06T02:25:13.223 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:25:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.222+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(96 100.00000000 [create] v97'21 uv21 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d2735f2a0 2023-10-06T02:25:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.222+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362080 con 0x562d2735f2a0 2023-10-06T02:25:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.223+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(97 100.00000000 [omap-set-header] v97'22 uv22 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d2735f2a0 2023-10-06T02:25:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.223+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27364df0 con 0x562d2735f2a0 2023-10-06T02:25:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.226+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v97'23 uv23 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d2735f2a0 2023-10-06T02:25:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.226+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:99 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362570 con 0x562d27353a90 2023-10-06T02:25:13.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.227+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(99 mds0_sessionmap [create] v97'9 uv7 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.227+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:100 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362570 con 0x562d27353a90 2023-10-06T02:25:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.228+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(100 mds0_sessionmap [delete] v97'10 uv10 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.228+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362570 con 0x562d27353a90 2023-10-06T02:25:13.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.229+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(101 mds0_sessionmap [create] v97'11 uv11 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.230 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:25:13.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.229+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362570 con 0x562d27353a90 2023-10-06T02:25:13.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.230+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v97'12 uv12 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.230+0000 7fcd4a242000 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x562d27362a80 0x562d27362e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.230+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:103 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27365540 con 0x562d27362a80 2023-10-06T02:25:13.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.230+0000 7fcd43c7e700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x562d27362a80 0x562d27362e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.230+0000 7fcd43c7e700 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x562d27362a80 0x562d27362e50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:13.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.231+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(103 609.00000000 [create] v97'9 uv8 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27362a80 2023-10-06T02:25:13.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.231+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:104 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27365540 con 0x562d27362a80 2023-10-06T02:25:13.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.232+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(104 609.00000000 [delete] v97'10 uv10 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27362a80 2023-10-06T02:25:13.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.232+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27365540 con 0x562d27362a80 2023-10-06T02:25:13.235 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:25:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.233+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(105 609.00000000 [create] v97'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27362a80 2023-10-06T02:25:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.233+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27366550 con 0x562d27362a80 2023-10-06T02:25:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.234+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v97'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27362a80 2023-10-06T02:25:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.235+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27366550 con 0x562d27362a80 2023-10-06T02:25:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.235+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v97'13 uv13 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27362a80 2023-10-06T02:25:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.237+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27365540 con 0x562d27362a80 2023-10-06T02:25:13.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.238+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(108 609.00000000 [omap-set-header] v97'14 uv14 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27362a80 2023-10-06T02:25:13.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.238+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:109 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27365540 con 0x562d27357fe0 2023-10-06T02:25:13.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.238+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(109 400.00000000 [create] v97'7 uv6 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27357fe0 2023-10-06T02:25:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.238+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:110 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27365540 con 0x562d27357fe0 2023-10-06T02:25:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.239+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(110 400.00000000 [delete] v97'8 uv8 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27357fe0 2023-10-06T02:25:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.239+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27365540 con 0x562d27357fe0 2023-10-06T02:25:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.240+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(111 400.00000000 [create] v97'9 uv9 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27357fe0 2023-10-06T02:25:13.242 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:25:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.240+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27365540 con 0x562d27357fe0 2023-10-06T02:25:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.241+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(112 400.00000000 [write 0~22] v97'10 uv10 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27357fe0 2023-10-06T02:25:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.241+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362100 con 0x562d27357fe0 2023-10-06T02:25:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.242+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(113 400.00000000 [omap-set-header] v97'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fcd3c012040 con 0x562d27357fe0 2023-10-06T02:25:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.242+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:114 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362100 con 0x562d27353a90 2023-10-06T02:25:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.243+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(114 100.00000000.inode [create] v97'20 uv11 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.243+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:115 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362100 con 0x562d27353a90 2023-10-06T02:25:13.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.244+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(115 100.00000000.inode [delete] v97'21 uv21 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.244+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362100 con 0x562d27353a90 2023-10-06T02:25:13.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.245+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(116 100.00000000.inode [create] v97'22 uv22 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.246 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:25:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.245+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362100 con 0x562d27353a90 2023-10-06T02:25:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.246+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(117 100.00000000.inode [write 0~554] v97'23 uv23 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.246+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362100 con 0x562d27353a90 2023-10-06T02:25:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.247+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v97'24 uv24 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.247+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362100 con 0x562d27353a90 2023-10-06T02:25:13.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.248+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(119 1.00000000 [create] v97'25 uv18 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.248+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362100 con 0x562d27353a90 2023-10-06T02:25:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.249+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(120 1.00000000 [delete] v97'26 uv26 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.249+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362100 con 0x562d27353a90 2023-10-06T02:25:13.251 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:25:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.250+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(121 1.00000000 [create] v97'27 uv27 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.250+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362100 con 0x562d27353a90 2023-10-06T02:25:13.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.251+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v97'28 uv28 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.251+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27362100 con 0x562d27353a90 2023-10-06T02:25:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.252+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v97'29 uv29 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.252+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27365a30 con 0x562d27353a90 2023-10-06T02:25:13.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.252+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(124 1.00000000 [omap-set-header] v97'30 uv30 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.253+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x562d27365ca0 con 0x562d27353a90 2023-10-06T02:25:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd42c7c700 1 -- 172.21.15.6:0/3285333610 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v97'31 uv31 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fcd2c053f80 con 0x562d27353a90 2023-10-06T02:25:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x562d27353a90 msgr2=0x562d27355e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x562d27353a90 0x562d27355e70 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x562d272a26c0 msgr2=0x562d273437b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x562d272a26c0 0x562d273437b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x562d2735f2a0 msgr2=0x562d27361680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x562d2735f2a0 0x562d27361680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x562d2734f150 msgr2=0x562d27351530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x562d2734f150 0x562d27351530 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x562d27362a80 msgr2=0x562d27362e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 reap_dead start 2023-10-06T02:25:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x562d27362a80 0x562d27362e50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x562d2735beb0 msgr2=0x562d2735c2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x562d2735beb0 0x562d2735c2a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x562d27357fe0 msgr2=0x562d2735b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x562d27357fe0 0x562d2735b040 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcd240658c0 msgr2=0x7fcd24067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcd240658c0 0x7fcd24067d70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fcd34001350 tx=0x7fcd34016000 comp rx=0 tx=0).stop 2023-10-06T02:25:13.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d273301b0 msgr2=0x562d272a2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 --2- 172.21.15.6:0/3285333610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d273301b0 0x562d272a2180 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c0092d0 tx=0x7fcd2c017000 comp rx=0 tx=0).stop 2023-10-06T02:25:13.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd43c7e700 1 -- 172.21.15.6:0/3285333610 reap_dead start 2023-10-06T02:25:13.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 shutdown_connections 2023-10-06T02:25:13.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 >> 172.21.15.6:0/3285333610 conn(0x562d272a4bd0 msgr2=0x562d2728d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:13.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 shutdown_connections 2023-10-06T02:25:13.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.254+0000 7fcd4a242000 1 -- 172.21.15.6:0/3285333610 wait complete. 2023-10-06T02:25:13.259 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 600.00000000 2023-10-06T02:25:13.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.336+0000 7f51a77d3000 1 Processor -- start 2023-10-06T02:25:13.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.336+0000 7f51a77d3000 1 -- start start 2023-10-06T02:25:13.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.337+0000 7f51a77d3000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e53f49e30 0x562e53ff2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.337+0000 7f51a77d3000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562e53f4c9e0 0x562e53f1d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.337+0000 7f51a77d3000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e53ff2f50 0x562e53ff0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.337+0000 7f51a77d3000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e53ec5320 con 0x562e53ff2f50 2023-10-06T02:25:13.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.337+0000 7f51a77d3000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e53e69980 con 0x562e53f49e30 2023-10-06T02:25:13.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.337+0000 7f51a77d3000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x562e53e69620 con 0x562e53f4c9e0 2023-10-06T02:25:13.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.337+0000 7f51a120f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e53ff2f50 0x562e53ff0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.337+0000 7f51a120f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e53ff2f50 0x562e53ff0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43734/0 (socket says 172.21.15.6:43734) 2023-10-06T02:25:13.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.337+0000 7f51a120f700 1 -- 172.21.15.6:0/1013165307 learned_addr learned my addr 172.21.15.6:0/1013165307 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:13.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.337+0000 7f51a0a0e700 1 --2- 172.21.15.6:0/1013165307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e53f49e30 0x562e53ff2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.337+0000 7f51a020d700 1 --2- 172.21.15.6:0/1013165307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562e53f4c9e0 0x562e53f1d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f51a120f700 1 -- 172.21.15.6:0/1013165307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562e53f4c9e0 msgr2=0x562e53f1d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:13.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f51a120f700 1 --2- 172.21.15.6:0/1013165307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562e53f4c9e0 0x562e53f1d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f51a120f700 1 -- 172.21.15.6:0/1013165307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e53f49e30 msgr2=0x562e53ff2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:13.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f51a120f700 1 --2- 172.21.15.6:0/1013165307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e53f49e30 0x562e53ff2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f51a120f700 1 -- 172.21.15.6:0/1013165307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5194005cf0 con 0x562e53ff2f50 2023-10-06T02:25:13.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f51a020d700 1 --2- 172.21.15.6:0/1013165307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562e53f4c9e0 0x562e53f1d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f51a120f700 1 --2- 172.21.15.6:0/1013165307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e53ff2f50 0x562e53ff0fd0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f5190001730 tx=0x7f5190006ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba191670a1c0a5b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f519f20b700 1 -- 172.21.15.6:0/1013165307 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519000e470 con 0x562e53ff2f50 2023-10-06T02:25:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f519f20b700 1 -- 172.21.15.6:0/1013165307 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519000e5f0 con 0x562e53ff2f50 2023-10-06T02:25:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f519f20b700 1 -- 172.21.15.6:0/1013165307 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519000e9b0 con 0x562e53ff2f50 2023-10-06T02:25:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f51a77d3000 1 -- 172.21.15.6:0/1013165307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e53ff2f50 msgr2=0x562e53ff0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f51a77d3000 1 --2- 172.21.15.6:0/1013165307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e53ff2f50 0x562e53ff0fd0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f5190001730 tx=0x7f5190006ac0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f51a77d3000 1 -- 172.21.15.6:0/1013165307 shutdown_connections 2023-10-06T02:25:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f51a77d3000 1 --2- 172.21.15.6:0/1013165307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e53ff2f50 0x562e53ff0fd0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f51a77d3000 1 --2- 172.21.15.6:0/1013165307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e53f49e30 0x562e53ff2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f51a77d3000 1 --2- 172.21.15.6:0/1013165307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562e53f4c9e0 0x562e53f1d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f51a77d3000 1 -- 172.21.15.6:0/1013165307 >> 172.21.15.6:0/1013165307 conn(0x562e53f65bd0 msgr2=0x562e53ff1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f51a77d3000 1 -- 172.21.15.6:0/1013165307 shutdown_connections 2023-10-06T02:25:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.338+0000 7f51a77d3000 1 -- 172.21.15.6:0/1013165307 wait complete. 2023-10-06T02:25:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.339+0000 7f51a77d3000 1 Processor -- start 2023-10-06T02:25:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.339+0000 7f51a77d3000 1 -- start start 2023-10-06T02:25:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.340+0000 7f51a77d3000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e53f49e30 0x562e53fe6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.340+0000 7f51a77d3000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e53f4c9e0 0x562e53fe6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.340+0000 7f51a77d3000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562e53ff2f50 0x562e53fe7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.340+0000 7f51a77d3000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e53e60400 con 0x562e53f49e30 2023-10-06T02:25:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.340+0000 7f51a77d3000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e53f68410 con 0x562e53f4c9e0 2023-10-06T02:25:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.340+0000 7f51a77d3000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x562e53f1d740 con 0x562e53ff2f50 2023-10-06T02:25:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.340+0000 7f51a0a0e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e53f49e30 0x562e53fe6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.340+0000 7f51a0a0e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e53f49e30 0x562e53fe6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43744/0 (socket says 172.21.15.6:43744) 2023-10-06T02:25:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.340+0000 7f51a0a0e700 1 -- 172.21.15.6:0/927963886 learned_addr learned my addr 172.21.15.6:0/927963886 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.340+0000 7f51a120f700 1 --2- 172.21.15.6:0/927963886 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562e53ff2f50 0x562e53fe7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.340+0000 7f51a020d700 1 --2- 172.21.15.6:0/927963886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e53f4c9e0 0x562e53fe6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.340+0000 7f51a0a0e700 1 -- 172.21.15.6:0/927963886 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562e53ff2f50 msgr2=0x562e53fe7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.340+0000 7f51a0a0e700 1 --2- 172.21.15.6:0/927963886 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562e53ff2f50 0x562e53fe7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.340+0000 7f51a0a0e700 1 -- 172.21.15.6:0/927963886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e53f4c9e0 msgr2=0x562e53fe6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.340+0000 7f51a0a0e700 1 --2- 172.21.15.6:0/927963886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e53f4c9e0 0x562e53fe6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.340+0000 7f51a0a0e700 1 -- 172.21.15.6:0/927963886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5190006d80 con 0x562e53f49e30 2023-10-06T02:25:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.340+0000 7f51a0a0e700 1 --2- 172.21.15.6:0/927963886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e53f49e30 0x562e53fe6560 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f5198001200 tx=0x7f5198000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.341+0000 7f519da08700 1 -- 172.21.15.6:0/927963886 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51980106f0 con 0x562e53f49e30 2023-10-06T02:25:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.341+0000 7f519da08700 1 -- 172.21.15.6:0/927963886 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5198005050 con 0x562e53f49e30 2023-10-06T02:25:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.341+0000 7f519da08700 1 -- 172.21.15.6:0/927963886 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5198010ac0 con 0x562e53f49e30 2023-10-06T02:25:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.341+0000 7f51a77d3000 1 -- 172.21.15.6:0/927963886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562e53e6bae0 con 0x562e53f49e30 2023-10-06T02:25:13.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.341+0000 7f51a77d3000 1 -- 172.21.15.6:0/927963886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e53e6b540 con 0x562e53f49e30 2023-10-06T02:25:13.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.342+0000 7f519da08700 1 -- 172.21.15.6:0/927963886 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f519800d040 con 0x562e53f49e30 2023-10-06T02:25:13.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.342+0000 7f519da08700 1 --2- 172.21.15.6:0/927963886 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f518c065890 0x7f518c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.342+0000 7f519da08700 1 -- 172.21.15.6:0/927963886 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f519800a040 con 0x562e53f49e30 2023-10-06T02:25:13.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.342+0000 7f51a020d700 1 --2- 172.21.15.6:0/927963886 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f518c065890 0x7f518c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.342+0000 7f51a77d3000 1 --2- 172.21.15.6:0/927963886 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x562e53ff23f0 0x562e540108d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.342+0000 7f51a77d3000 1 -- 172.21.15.6:0/927963886 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x562e54010e10 con 0x562e53ff23f0 2023-10-06T02:25:13.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.343+0000 7f51a120f700 1 --2- 172.21.15.6:0/927963886 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x562e53ff23f0 0x562e540108d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.343+0000 7f51a020d700 1 --2- 172.21.15.6:0/927963886 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f518c065890 0x7f518c067d40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5194003080 tx=0x7f5194013000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.343+0000 7f51a120f700 1 --2- 172.21.15.6:0/927963886 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x562e53ff23f0 0x562e540108d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.344+0000 7f51a120f700 1 -- 172.21.15.6:0/927963886 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 600.00000000 [delete] v97'72 uv72 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f519000eda0 con 0x562e53ff23f0 2023-10-06T02:25:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.344+0000 7f51a77d3000 1 -- 172.21.15.6:0/927963886 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x562e53ff23f0 msgr2=0x562e540108d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.344+0000 7f51a77d3000 1 --2- 172.21.15.6:0/927963886 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x562e53ff23f0 0x562e540108d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.345+0000 7f51a77d3000 1 -- 172.21.15.6:0/927963886 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f518c065890 msgr2=0x7f518c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.345+0000 7f51a77d3000 1 --2- 172.21.15.6:0/927963886 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f518c065890 0x7f518c067d40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5194003080 tx=0x7f5194013000 comp rx=0 tx=0).stop 2023-10-06T02:25:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.345+0000 7f51a77d3000 1 -- 172.21.15.6:0/927963886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e53f49e30 msgr2=0x562e53fe6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.345+0000 7f51a77d3000 1 --2- 172.21.15.6:0/927963886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e53f49e30 0x562e53fe6560 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f5198001200 tx=0x7f5198000bc0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.345+0000 7f51a120f700 1 -- 172.21.15.6:0/927963886 reap_dead start 2023-10-06T02:25:13.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.345+0000 7f51a77d3000 1 -- 172.21.15.6:0/927963886 shutdown_connections 2023-10-06T02:25:13.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.345+0000 7f51a77d3000 1 -- 172.21.15.6:0/927963886 >> 172.21.15.6:0/927963886 conn(0x562e53f65bd0 msgr2=0x562e53f21800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:13.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.345+0000 7f51a77d3000 1 -- 172.21.15.6:0/927963886 shutdown_connections 2023-10-06T02:25:13.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.345+0000 7f51a77d3000 1 -- 172.21.15.6:0/927963886 wait complete. 2023-10-06T02:25:13.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:25:13.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.512+0000 7fc07d254700 1 Processor -- start 2023-10-06T02:25:13.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.512+0000 7fc07d254700 1 -- start start 2023-10-06T02:25:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.513+0000 7fc07d254700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc0780d07d0 0x7fc0780b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.513+0000 7fc07d254700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07815dd40 con 0x7fc0780d0400 2023-10-06T02:25:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.513+0000 7fc07d254700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07815e020 con 0x7fc0780ccd40 2023-10-06T02:25:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.513+0000 7fc07d254700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0780ceaa0 con 0x7fc0780d07d0 2023-10-06T02:25:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.513+0000 7fc076d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc0780d0400 0x7fc0780b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35522/0 (socket says 172.21.15.6:35522) 2023-10-06T02:25:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.513+0000 7fc076d9d700 1 -- 172.21.15.6:0/1573614912 learned_addr learned my addr 172.21.15.6:0/1573614912 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.513+0000 7fc07759e700 1 --2- 172.21.15.6:0/1573614912 >> v2:172.21.15.175:3300/0 conn(0x7fc0780d07d0 0x7fc0780b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.513+0000 7fc075d9b700 1 -- 172.21.15.6:0/1573614912 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183561547 0 0) 0x7fc07815dd40 con 0x7fc0780d0400 2023-10-06T02:25:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.513+0000 7fc075d9b700 1 -- 172.21.15.6:0/1573614912 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc064003570 con 0x7fc0780d0400 2023-10-06T02:25:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.513+0000 7fc075d9b700 1 -- 172.21.15.6:0/1573614912 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193560582 0 0) 0x7fc07815e020 con 0x7fc0780ccd40 2023-10-06T02:25:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.513+0000 7fc075d9b700 1 -- 172.21.15.6:0/1573614912 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc07815dd40 con 0x7fc0780ccd40 2023-10-06T02:25:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.513+0000 7fc075d9b700 1 -- 172.21.15.6:0/1573614912 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2709362100 0 0) 0x7fc064003570 con 0x7fc0780d0400 2023-10-06T02:25:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.513+0000 7fc075d9b700 1 -- 172.21.15.6:0/1573614912 >> v2:172.21.15.175:3300/0 conn(0x7fc0780d07d0 msgr2=0x7fc0780b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.513+0000 7fc075d9b700 1 --2- 172.21.15.6:0/1573614912 >> v2:172.21.15.175:3300/0 conn(0x7fc0780d07d0 0x7fc0780b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.513+0000 7fc075d9b700 1 -- 172.21.15.6:0/1573614912 >> v1:172.21.15.175:6789/0 conn(0x7fc0780ccd40 legacy=0x7fc0780cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.513+0000 7fc075d9b700 1 -- 172.21.15.6:0/1573614912 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0780ced80 con 0x7fc0780d0400 2023-10-06T02:25:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc075d9b700 1 -- 172.21.15.6:0/1573614912 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fc0680015f0 con 0x7fc0780d0400 2023-10-06T02:25:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc075d9b700 1 -- 172.21.15.6:0/1573614912 >> v1:172.21.15.6:6789/0 conn(0x7fc0780d0400 legacy=0x7fc0780b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc075d9b700 1 --2- 172.21.15.6:0/1573614912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc064003c40 0x7fc064004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc075d9b700 1 --2- 172.21.15.6:0/1573614912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc064004810 0x7fc064004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc075d9b700 1 --2- 172.21.15.6:0/1573614912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc064005210 0x7fc06400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc075d9b700 1 -- 172.21.15.6:0/1573614912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0780ceaa0 con 0x7fc064004810 2023-10-06T02:25:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc075d9b700 1 -- 172.21.15.6:0/1573614912 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06400c130 con 0x7fc064003c40 2023-10-06T02:25:13.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc075d9b700 1 -- 172.21.15.6:0/1573614912 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06400c2c0 con 0x7fc064005210 2023-10-06T02:25:13.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc07659c700 1 --2- 172.21.15.6:0/1573614912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc064004810 0x7fc064004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc076d9d700 1 --2- 172.21.15.6:0/1573614912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc064003c40 0x7fc064004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc07759e700 1 --2- 172.21.15.6:0/1573614912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc064005210 0x7fc06400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc07659c700 1 -- 172.21.15.6:0/1573614912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc064005210 msgr2=0x7fc06400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:13.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc07659c700 1 --2- 172.21.15.6:0/1573614912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc064005210 0x7fc06400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc07659c700 1 -- 172.21.15.6:0/1573614912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc064003c40 msgr2=0x7fc064004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:13.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc07659c700 1 --2- 172.21.15.6:0/1573614912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc064003c40 0x7fc064004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc07759e700 1 -- 172.21.15.6:0/1573614912 reap_dead start 2023-10-06T02:25:13.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc07659c700 1 -- 172.21.15.6:0/1573614912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc064003570 con 0x7fc064004810 2023-10-06T02:25:13.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc07659c700 1 --2- 172.21.15.6:0/1573614912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc064004810 0x7fc064004c80 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fc0600019e0 tx=0x7fc060007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba398fd4c9405ec8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:13.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc075d9b700 1 -- 172.21.15.6:0/1573614912 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06000c550 con 0x7fc064004810 2023-10-06T02:25:13.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc075d9b700 1 -- 172.21.15.6:0/1573614912 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06000c6b0 con 0x7fc064004810 2023-10-06T02:25:13.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.514+0000 7fc075d9b700 1 -- 172.21.15.6:0/1573614912 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06000ca50 con 0x7fc064004810 2023-10-06T02:25:13.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.515+0000 7fc07d254700 1 -- 172.21.15.6:0/1573614912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc064004810 msgr2=0x7fc064004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.515+0000 7fc07d254700 1 --2- 172.21.15.6:0/1573614912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc064004810 0x7fc064004c80 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fc0600019e0 tx=0x7fc060007d30 comp rx=0 tx=0).stop 2023-10-06T02:25:13.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.515+0000 7fc07d254700 1 -- 172.21.15.6:0/1573614912 shutdown_connections 2023-10-06T02:25:13.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.515+0000 7fc07d254700 1 --2- 172.21.15.6:0/1573614912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc064004810 0x7fc064004c80 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.515+0000 7fc07d254700 1 -- 172.21.15.6:0/1573614912 >> 172.21.15.6:0/1573614912 conn(0x7fc07806a220 msgr2=0x7fc07806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:13.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.515+0000 7fc07d254700 1 -- 172.21.15.6:0/1573614912 shutdown_connections 2023-10-06T02:25:13.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.515+0000 7fc07d254700 1 -- 172.21.15.6:0/1573614912 wait complete. 2023-10-06T02:25:13.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.516+0000 7fc07d254700 1 Processor -- start 2023-10-06T02:25:13.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.516+0000 7fc07d254700 1 -- start start 2023-10-06T02:25:13.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.517+0000 7fc07d254700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc064004810 0x7fc0780b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.517+0000 7fc07d254700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0780b1970 0x7fc0780b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.517+0000 7fc07d254700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0780b0810 0x7fc0780b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.517+0000 7fc07d254700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc078151d40 con 0x7fc0780b0810 2023-10-06T02:25:13.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.517+0000 7fc07d254700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc078151130 con 0x7fc064004810 2023-10-06T02:25:13.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.517+0000 7fc07d254700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc078151410 con 0x7fc0780b1970 2023-10-06T02:25:13.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.517+0000 7fc07759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0780b0810 0x7fc0780b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.517+0000 7fc07759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0780b0810 0x7fc0780b0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43766/0 (socket says 172.21.15.6:43766) 2023-10-06T02:25:13.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.517+0000 7fc07759e700 1 -- 172.21.15.6:0/2322413834 learned_addr learned my addr 172.21.15.6:0/2322413834 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:13.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.517+0000 7fc07659c700 1 --2- 172.21.15.6:0/2322413834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0780b1970 0x7fc0780b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.517+0000 7fc076d9d700 1 --2- 172.21.15.6:0/2322413834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc064004810 0x7fc0780b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.517+0000 7fc07759e700 1 -- 172.21.15.6:0/2322413834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0780b1970 msgr2=0x7fc0780b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.517+0000 7fc07759e700 1 --2- 172.21.15.6:0/2322413834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0780b1970 0x7fc0780b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.517+0000 7fc07759e700 1 -- 172.21.15.6:0/2322413834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc064004810 msgr2=0x7fc0780b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.517+0000 7fc07759e700 1 --2- 172.21.15.6:0/2322413834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc064004810 0x7fc0780b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.517+0000 7fc07759e700 1 -- 172.21.15.6:0/2322413834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0781516f0 con 0x7fc0780b0810 2023-10-06T02:25:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.518+0000 7fc07759e700 1 --2- 172.21.15.6:0/2322413834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0780b0810 0x7fc0780b0c80 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fc0780b3860 tx=0x7fc07000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.518+0000 7fc06effd700 1 -- 172.21.15.6:0/2322413834 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07000e040 con 0x7fc0780b0810 2023-10-06T02:25:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.518+0000 7fc06effd700 1 -- 172.21.15.6:0/2322413834 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07000f040 con 0x7fc0780b0810 2023-10-06T02:25:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.518+0000 7fc07d254700 1 -- 172.21.15.6:0/2322413834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0781519d0 con 0x7fc0780b0810 2023-10-06T02:25:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.518+0000 7fc06effd700 1 -- 172.21.15.6:0/2322413834 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07000fd90 con 0x7fc0780b0810 2023-10-06T02:25:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.518+0000 7fc07d254700 1 -- 172.21.15.6:0/2322413834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07814ba70 con 0x7fc0780b0810 2023-10-06T02:25:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.519+0000 7fc07d254700 1 -- 172.21.15.6:0/2322413834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc078151ed0 con 0x7fc0780b0810 2023-10-06T02:25:13.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.519+0000 7fc06effd700 1 -- 172.21.15.6:0/2322413834 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc070015640 con 0x7fc0780b0810 2023-10-06T02:25:13.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.520+0000 7fc06effd700 1 --2- 172.21.15.6:0/2322413834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc058066f30 0x7fc0580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:13.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.520+0000 7fc076d9d700 1 --2- 172.21.15.6:0/2322413834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc058066f30 0x7fc0580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:13.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.520+0000 7fc06effd700 1 -- 172.21.15.6:0/2322413834 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fc070085100 con 0x7fc0780b0810 2023-10-06T02:25:13.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.520+0000 7fc076d9d700 1 --2- 172.21.15.6:0/2322413834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc058066f30 0x7fc0580693e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc0780665a0 tx=0x7fc068009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:13.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.525+0000 7fc06effd700 1 -- 172.21.15.6:0/2322413834 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc070052020 con 0x7fc0780b0810 2023-10-06T02:25:13.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:13.762+0000 7fc07d254700 1 -- 172.21.15.6:0/2322413834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fc0780ce6c0 con 0x7fc0780b0810 2023-10-06T02:25:14.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.077+0000 7fc06effd700 1 -- 172.21.15.6:0/2322413834 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v98) v1 ==== 162+0+0 (secure 0 0 0) 0x7fc070055640 con 0x7fc0780b0810 2023-10-06T02:25:14.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.079+0000 7fc07d254700 1 -- 172.21.15.6:0/2322413834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc058066f30 msgr2=0x7fc0580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:14.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.079+0000 7fc07d254700 1 --2- 172.21.15.6:0/2322413834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc058066f30 0x7fc0580693e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc0780665a0 tx=0x7fc068009040 comp rx=0 tx=0).stop 2023-10-06T02:25:14.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.079+0000 7fc07d254700 1 -- 172.21.15.6:0/2322413834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0780b0810 msgr2=0x7fc0780b0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:14.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.079+0000 7fc07d254700 1 --2- 172.21.15.6:0/2322413834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0780b0810 0x7fc0780b0c80 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fc0780b3860 tx=0x7fc07000b040 comp rx=0 tx=0).stop 2023-10-06T02:25:14.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.079+0000 7fc07d254700 1 -- 172.21.15.6:0/2322413834 shutdown_connections 2023-10-06T02:25:14.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.079+0000 7fc07d254700 1 --2- 172.21.15.6:0/2322413834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc058066f30 0x7fc0580693e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:14.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.079+0000 7fc07d254700 1 --2- 172.21.15.6:0/2322413834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0780b0810 0x7fc0780b0c80 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:14.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.079+0000 7fc07d254700 1 --2- 172.21.15.6:0/2322413834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc064004810 0x7fc0780b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:14.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.079+0000 7fc07d254700 1 --2- 172.21.15.6:0/2322413834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0780b1970 0x7fc0780b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:14.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.079+0000 7fc07d254700 1 -- 172.21.15.6:0/2322413834 >> 172.21.15.6:0/2322413834 conn(0x7fc07806a220 msgr2=0x7fc0780b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:14.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.079+0000 7fc07d254700 1 -- 172.21.15.6:0/2322413834 shutdown_connections 2023-10-06T02:25:14.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.079+0000 7fc07d254700 1 -- 172.21.15.6:0/2322413834 wait complete. 2023-10-06T02:25:14.083 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:25:14.096 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:14.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.215+0000 7f029ac55700 1 Processor -- start 2023-10-06T02:25:14.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.215+0000 7f029ac55700 1 -- start start 2023-10-06T02:25:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f029ac55700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02940cf1a0 0x7f02940cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f029ac55700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02941597d0 0x7f02940d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f029ac55700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02940b3560 con 0x7f0294159400 2023-10-06T02:25:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f029ac55700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02940cf6f0 con 0x7f02940cf1a0 2023-10-06T02:25:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f029ac55700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02940cf9d0 con 0x7f02941597d0 2023-10-06T02:25:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f0299452700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02940cf1a0 0x7f02940cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f0299452700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02940cf1a0 0x7f02940cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43774/0 (socket says 172.21.15.6:43774) 2023-10-06T02:25:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f0299452700 1 -- 172.21.15.6:0/4242938454 learned_addr learned my addr 172.21.15.6:0/4242938454 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f029a454700 1 --2- 172.21.15.6:0/4242938454 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02941597d0 0x7f02940d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f0299452700 1 -- 172.21.15.6:0/4242938454 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02941597d0 msgr2=0x7f02940d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f0299452700 1 --2- 172.21.15.6:0/4242938454 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02941597d0 0x7f02940d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f0299452700 1 -- 172.21.15.6:0/4242938454 >> v1:172.21.15.175:6789/0 conn(0x7f0294159400 legacy=0x7f02940ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f0299452700 1 -- 172.21.15.6:0/4242938454 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02940b2f10 con 0x7f02940cf1a0 2023-10-06T02:25:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f0299452700 1 --2- 172.21.15.6:0/4242938454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02940cf1a0 0x7f02940cfec0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f02880099b0 tx=0x7f0288009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f85eb19243f1d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f0298c51700 1 -- 172.21.15.6:0/4242938454 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288009ea0 con 0x7f02940cf1a0 2023-10-06T02:25:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f0298c51700 1 -- 172.21.15.6:0/4242938454 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028800b860 con 0x7f02940cf1a0 2023-10-06T02:25:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f0298c51700 1 -- 172.21.15.6:0/4242938454 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028800bc00 con 0x7f02940cf1a0 2023-10-06T02:25:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f029ac55700 1 -- 172.21.15.6:0/4242938454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02940cf1a0 msgr2=0x7f02940cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f029ac55700 1 --2- 172.21.15.6:0/4242938454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02940cf1a0 0x7f02940cfec0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f02880099b0 tx=0x7f0288009250 comp rx=0 tx=0).stop 2023-10-06T02:25:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f029ac55700 1 -- 172.21.15.6:0/4242938454 shutdown_connections 2023-10-06T02:25:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f029ac55700 1 --2- 172.21.15.6:0/4242938454 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02941597d0 0x7f02940d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f029ac55700 1 --2- 172.21.15.6:0/4242938454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02940cf1a0 0x7f02940cfec0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f029ac55700 1 -- 172.21.15.6:0/4242938454 >> 172.21.15.6:0/4242938454 conn(0x7f029406ac10 msgr2=0x7f0294068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f029ac55700 1 -- 172.21.15.6:0/4242938454 shutdown_connections 2023-10-06T02:25:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.217+0000 7f029ac55700 1 -- 172.21.15.6:0/4242938454 wait complete. 2023-10-06T02:25:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.218+0000 7f029ac55700 1 Processor -- start 2023-10-06T02:25:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.219+0000 7f029ac55700 1 -- start start 2023-10-06T02:25:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.219+0000 7f029ac55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02940cf1a0 0x7f0294152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.219+0000 7f029ac55700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0294159400 0x7f02940cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.219+0000 7f029ac55700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02941597d0 0x7f02941582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.219+0000 7f029ac55700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0294157e40 con 0x7f02940cf1a0 2023-10-06T02:25:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.219+0000 7f029ac55700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0294157230 con 0x7f0294159400 2023-10-06T02:25:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.219+0000 7f029ac55700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0294157510 con 0x7f02941597d0 2023-10-06T02:25:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.219+0000 7f0299c53700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02940cf1a0 0x7f0294152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.219+0000 7f0299c53700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02940cf1a0 0x7f0294152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43790/0 (socket says 172.21.15.6:43790) 2023-10-06T02:25:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.219+0000 7f0299c53700 1 -- 172.21.15.6:0/1070909326 learned_addr learned my addr 172.21.15.6:0/1070909326 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.219+0000 7f029a454700 1 --2- 172.21.15.6:0/1070909326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02941597d0 0x7f02941582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.219+0000 7f0299452700 1 --2- 172.21.15.6:0/1070909326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0294159400 0x7f02940cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.220+0000 7f0299c53700 1 -- 172.21.15.6:0/1070909326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02941597d0 msgr2=0x7f02941582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.220+0000 7f0299c53700 1 --2- 172.21.15.6:0/1070909326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02941597d0 0x7f02941582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.220+0000 7f0299c53700 1 -- 172.21.15.6:0/1070909326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0294159400 msgr2=0x7f02940cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:14.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.220+0000 7f0299c53700 1 --2- 172.21.15.6:0/1070909326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0294159400 0x7f02940cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:14.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.220+0000 7f0299c53700 1 -- 172.21.15.6:0/1070909326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02880094f0 con 0x7f02940cf1a0 2023-10-06T02:25:14.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.220+0000 7f029a454700 1 --2- 172.21.15.6:0/1070909326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02941597d0 0x7f02941582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:14.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.220+0000 7f0299c53700 1 --2- 172.21.15.6:0/1070909326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02940cf1a0 0x7f0294152c10 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f028c00c7c0 tx=0x7f028c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:14.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.220+0000 7f0291ffb700 1 -- 172.21.15.6:0/1070909326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c011590 con 0x7f02940cf1a0 2023-10-06T02:25:14.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.220+0000 7f0291ffb700 1 -- 172.21.15.6:0/1070909326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028c011710 con 0x7f02940cf1a0 2023-10-06T02:25:14.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.220+0000 7f029ac55700 1 -- 172.21.15.6:0/1070909326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02941577f0 con 0x7f02940cf1a0 2023-10-06T02:25:14.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.220+0000 7f0291ffb700 1 -- 172.21.15.6:0/1070909326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c011ad0 con 0x7f02940cf1a0 2023-10-06T02:25:14.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.220+0000 7f029ac55700 1 -- 172.21.15.6:0/1070909326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02940cbbe0 con 0x7f02940cf1a0 2023-10-06T02:25:14.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.221+0000 7f029ac55700 1 -- 172.21.15.6:0/1070909326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0294069210 con 0x7f02940cf1a0 2023-10-06T02:25:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.221+0000 7f0291ffb700 1 -- 172.21.15.6:0/1070909326 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f028c01b3b0 con 0x7f02940cf1a0 2023-10-06T02:25:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.222+0000 7f0291ffb700 1 --2- 172.21.15.6:0/1070909326 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0280066f30 0x7f02800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.222+0000 7f0291ffb700 1 -- 172.21.15.6:0/1070909326 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f028c083d80 con 0x7f02940cf1a0 2023-10-06T02:25:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.222+0000 7f0299452700 1 --2- 172.21.15.6:0/1070909326 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0280066f30 0x7f02800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.223+0000 7f0299452700 1 --2- 172.21.15.6:0/1070909326 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0280066f30 0x7f02800693e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f02880099b0 tx=0x7f0288017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.227+0000 7f0291ffb700 1 -- 172.21.15.6:0/1070909326 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f028c050d50 con 0x7f02940cf1a0 2023-10-06T02:25:14.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.462+0000 7f029ac55700 1 -- 172.21.15.6:0/1070909326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02940ccaf0 con 0x7f02940cf1a0 2023-10-06T02:25:14.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.463+0000 7f0291ffb700 1 -- 172.21.15.6:0/1070909326 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f028c017070 con 0x7f02940cf1a0 2023-10-06T02:25:14.465 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:14.465 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":99,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:14.078533+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7971":{"gid":7971,"name":"a","rank":0,"incarnation":99,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/1622379942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1622379942},{"type":"v1","addr":"172.21.15.6:6835","nonce":1622379942}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.465+0000 7f029ac55700 1 -- 172.21.15.6:0/1070909326 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0280066f30 msgr2=0x7f02800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.465+0000 7f029ac55700 1 --2- 172.21.15.6:0/1070909326 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0280066f30 0x7f02800693e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f02880099b0 tx=0x7f0288017000 comp rx=0 tx=0).stop 2023-10-06T02:25:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.465+0000 7f029ac55700 1 -- 172.21.15.6:0/1070909326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02940cf1a0 msgr2=0x7f0294152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.465+0000 7f029ac55700 1 --2- 172.21.15.6:0/1070909326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02940cf1a0 0x7f0294152c10 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f028c00c7c0 tx=0x7f028c007f70 comp rx=0 tx=0).stop 2023-10-06T02:25:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.465+0000 7f029ac55700 1 -- 172.21.15.6:0/1070909326 shutdown_connections 2023-10-06T02:25:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.465+0000 7f029ac55700 1 --2- 172.21.15.6:0/1070909326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02941597d0 0x7f02941582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.465+0000 7f029ac55700 1 --2- 172.21.15.6:0/1070909326 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0280066f30 0x7f02800693e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.465+0000 7f029ac55700 1 --2- 172.21.15.6:0/1070909326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02940cf1a0 0x7f0294152c10 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.465+0000 7f029ac55700 1 --2- 172.21.15.6:0/1070909326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0294159400 0x7f02940cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.465+0000 7f029ac55700 1 -- 172.21.15.6:0/1070909326 >> 172.21.15.6:0/1070909326 conn(0x7f029406ac10 msgr2=0x7f0294155f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.465+0000 7f029ac55700 1 -- 172.21.15.6:0/1070909326 shutdown_connections 2023-10-06T02:25:14.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:14.465+0000 7f029ac55700 1 -- 172.21.15.6:0/1070909326 wait complete. 2023-10-06T02:25:14.468 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 99 2023-10-06T02:25:14.479 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2023-10-06T02:25:17.097 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:25:17.097+0000 7fe6fea26700 -1 log_channel(cluster) log [ERR] : dir 0x600 object missing on disk; some files may be lost (~mds0/stray0) 2023-10-06T02:25:17.097 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:25:17.097+0000 7fe6fea26700 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x600 is fatal because it is a system directory for this rank 2023-10-06T02:25:17.098 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:25:17.097+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:25:17.098 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:25:17.097+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:25:17.104 INFO:tasks.ceph.mds.a.smithi006.stderr: -15> 2023-10-06T02:25:17.097+0000 7fe6fea26700 -1 log_channel(cluster) log [ERR] : dir 0x600 object missing on disk; some files may be lost (~mds0/stray0) 2023-10-06T02:25:17.105 INFO:tasks.ceph.mds.a.smithi006.stderr: -13> 2023-10-06T02:25:17.097+0000 7fe6fea26700 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x600 is fatal because it is a system directory for this rank 2023-10-06T02:25:17.127 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:25:19.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:19.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.611+0000 7fac608c5700 1 Processor -- start 2023-10-06T02:25:19.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.611+0000 7fac608c5700 1 -- start start 2023-10-06T02:25:19.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.612+0000 7fac608c5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac5c0af4e0 0x7fac5c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:19.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.612+0000 7fac608c5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fac5c15db70 0x7fac5c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:19.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.612+0000 7fac608c5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5c15e190 con 0x7fac5c0af8b0 2023-10-06T02:25:19.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.612+0000 7fac608c5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c0b1910 con 0x7fac5c15db70 2023-10-06T02:25:19.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.612+0000 7fac608c5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c15dfb0 con 0x7fac5c0af4e0 2023-10-06T02:25:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.612+0000 7fac5ad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fac5c15db70 0x7fac5c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.612+0000 7fac5ad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fac5c15db70 0x7fac5c0b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53474/0 (socket says 172.21.15.6:53474) 2023-10-06T02:25:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.612+0000 7fac5ad9d700 1 -- 172.21.15.6:0/722929619 learned_addr learned my addr 172.21.15.6:0/722929619 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.612+0000 7fac5a59c700 1 --2- 172.21.15.6:0/722929619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac5c0af4e0 0x7fac5c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.612+0000 7fac5ad9d700 1 -- 172.21.15.6:0/722929619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac5c0af4e0 msgr2=0x7fac5c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.612+0000 7fac5ad9d700 1 --2- 172.21.15.6:0/722929619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac5c0af4e0 0x7fac5c0b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.612+0000 7fac5ad9d700 1 -- 172.21.15.6:0/722929619 >> v1:172.21.15.175:6789/0 conn(0x7fac5c0af8b0 legacy=0x7fac5c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.612+0000 7fac5ad9d700 1 -- 172.21.15.6:0/722929619 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c0cb650 con 0x7fac5c15db70 2023-10-06T02:25:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.613+0000 7fac5ad9d700 1 --2- 172.21.15.6:0/722929619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac5c15db70 0x7fac5c0b2620 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009f20 tx=0x7fac4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664252f57fa14c9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.613+0000 7fac5959a700 1 -- 172.21.15.6:0/722929619 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c00e070 con 0x7fac5c15db70 2023-10-06T02:25:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.613+0000 7fac5959a700 1 -- 172.21.15.6:0/722929619 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c00ba80 con 0x7fac5c15db70 2023-10-06T02:25:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.613+0000 7fac5959a700 1 -- 172.21.15.6:0/722929619 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c0092e0 con 0x7fac5c15db70 2023-10-06T02:25:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.613+0000 7fac608c5700 1 -- 172.21.15.6:0/722929619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac5c15db70 msgr2=0x7fac5c0b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.613+0000 7fac608c5700 1 --2- 172.21.15.6:0/722929619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac5c15db70 0x7fac5c0b2620 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009f20 tx=0x7fac4c009840 comp rx=0 tx=0).stop 2023-10-06T02:25:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.613+0000 7fac608c5700 1 -- 172.21.15.6:0/722929619 shutdown_connections 2023-10-06T02:25:19.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.613+0000 7fac608c5700 1 --2- 172.21.15.6:0/722929619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac5c15db70 0x7fac5c0b2620 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:19.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.613+0000 7fac608c5700 1 --2- 172.21.15.6:0/722929619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac5c0af4e0 0x7fac5c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:19.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.613+0000 7fac608c5700 1 -- 172.21.15.6:0/722929619 >> 172.21.15.6:0/722929619 conn(0x7fac5c068680 msgr2=0x7fac5c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:19.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.613+0000 7fac608c5700 1 -- 172.21.15.6:0/722929619 shutdown_connections 2023-10-06T02:25:19.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.613+0000 7fac608c5700 1 -- 172.21.15.6:0/722929619 wait complete. 2023-10-06T02:25:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.615+0000 7fac608c5700 1 Processor -- start 2023-10-06T02:25:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.615+0000 7fac608c5700 1 -- start start 2023-10-06T02:25:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.615+0000 7fac608c5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac5c0af4e0 0x7fac5c0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.615+0000 7fac608c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac5c0af8b0 0x7fac5c150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.615+0000 7fac608c5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac5c15db70 0x7fac5c0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.615+0000 7fac608c5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c151040 con 0x7fac5c0af8b0 2023-10-06T02:25:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.615+0000 7fac608c5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0c79d0 con 0x7fac5c15db70 2023-10-06T02:25:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.615+0000 7fac608c5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0ca2c0 con 0x7fac5c0af4e0 2023-10-06T02:25:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.615+0000 7fac59d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac5c0af8b0 0x7fac5c150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.615+0000 7fac59d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac5c0af8b0 0x7fac5c150b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53480/0 (socket says 172.21.15.6:53480) 2023-10-06T02:25:19.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.615+0000 7fac59d9b700 1 -- 172.21.15.6:0/3782703577 learned_addr learned my addr 172.21.15.6:0/3782703577 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:19.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.616+0000 7fac5ad9d700 1 --2- 172.21.15.6:0/3782703577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac5c15db70 0x7fac5c0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:19.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.616+0000 7fac59d9b700 1 -- 172.21.15.6:0/3782703577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac5c0af4e0 msgr2=0x7fac5c0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:19.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.616+0000 7fac5a59c700 1 --2- 172.21.15.6:0/3782703577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac5c0af4e0 0x7fac5c0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:19.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.616+0000 7fac59d9b700 1 --2- 172.21.15.6:0/3782703577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac5c0af4e0 0x7fac5c0c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:19.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.616+0000 7fac59d9b700 1 -- 172.21.15.6:0/3782703577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac5c15db70 msgr2=0x7fac5c0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:19.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.616+0000 7fac59d9b700 1 --2- 172.21.15.6:0/3782703577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac5c15db70 0x7fac5c0c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:19.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.616+0000 7fac59d9b700 1 -- 172.21.15.6:0/3782703577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c009ae0 con 0x7fac5c0af8b0 2023-10-06T02:25:19.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.616+0000 7fac5a59c700 1 --2- 172.21.15.6:0/3782703577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac5c0af4e0 0x7fac5c0c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:19.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.616+0000 7fac59d9b700 1 --2- 172.21.15.6:0/3782703577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac5c0af8b0 0x7fac5c150b00 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fac4400c790 tx=0x7fac44007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.616+0000 7fac527fc700 1 -- 172.21.15.6:0/3782703577 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44011590 con 0x7fac5c0af8b0 2023-10-06T02:25:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.616+0000 7fac527fc700 1 -- 172.21.15.6:0/3782703577 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac44011710 con 0x7fac5c0af8b0 2023-10-06T02:25:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.616+0000 7fac608c5700 1 -- 172.21.15.6:0/3782703577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5c153a90 con 0x7fac5c0af8b0 2023-10-06T02:25:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.616+0000 7fac527fc700 1 -- 172.21.15.6:0/3782703577 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44011ad0 con 0x7fac5c0af8b0 2023-10-06T02:25:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.616+0000 7fac608c5700 1 -- 172.21.15.6:0/3782703577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5c154050 con 0x7fac5c0af8b0 2023-10-06T02:25:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.617+0000 7fac608c5700 1 -- 172.21.15.6:0/3782703577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5c088aa0 con 0x7fac5c0af8b0 2023-10-06T02:25:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.617+0000 7fac527fc700 1 -- 172.21.15.6:0/3782703577 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac4401b3b0 con 0x7fac5c0af8b0 2023-10-06T02:25:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.618+0000 7fac527fc700 1 --2- 172.21.15.6:0/3782703577 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fac3c066f30 0x7fac3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:19.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.618+0000 7fac527fc700 1 -- 172.21.15.6:0/3782703577 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6636+0+0 (secure 0 0 0) 0x7fac44083e90 con 0x7fac5c0af8b0 2023-10-06T02:25:19.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.618+0000 7fac5a59c700 1 --2- 172.21.15.6:0/3782703577 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fac3c066f30 0x7fac3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:19.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.619+0000 7fac5a59c700 1 --2- 172.21.15.6:0/3782703577 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fac3c066f30 0x7fac3c0693e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fac54006fd0 tx=0x7fac54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:19.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.622+0000 7fac527fc700 1 -- 172.21.15.6:0/3782703577 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac44050cc0 con 0x7fac5c0af8b0 2023-10-06T02:25:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.860+0000 7fac608c5700 1 -- 172.21.15.6:0/3782703577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac5c0afc80 con 0x7fac5c0af8b0 2023-10-06T02:25:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.860+0000 7fac527fc700 1 -- 172.21.15.6:0/3782703577 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4594 (secure 0 0 0) 0x7fac44017070 con 0x7fac5c0af8b0 2023-10-06T02:25:19.861 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:19.862 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2869895689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2869895689},{"type":"v1","addr":"172.21.15.6:6835","nonce":2869895689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:17.098496+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.862+0000 7fac608c5700 1 -- 172.21.15.6:0/3782703577 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fac3c066f30 msgr2=0x7fac3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:19.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.862+0000 7fac608c5700 1 --2- 172.21.15.6:0/3782703577 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fac3c066f30 0x7fac3c0693e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fac54006fd0 tx=0x7fac54008040 comp rx=0 tx=0).stop 2023-10-06T02:25:19.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.862+0000 7fac608c5700 1 -- 172.21.15.6:0/3782703577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac5c0af8b0 msgr2=0x7fac5c150b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:19.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.862+0000 7fac608c5700 1 --2- 172.21.15.6:0/3782703577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac5c0af8b0 0x7fac5c150b00 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fac4400c790 tx=0x7fac44007f40 comp rx=0 tx=0).stop 2023-10-06T02:25:19.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.862+0000 7fac608c5700 1 -- 172.21.15.6:0/3782703577 shutdown_connections 2023-10-06T02:25:19.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.862+0000 7fac608c5700 1 --2- 172.21.15.6:0/3782703577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac5c15db70 0x7fac5c0c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:19.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.862+0000 7fac608c5700 1 --2- 172.21.15.6:0/3782703577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac5c0af4e0 0x7fac5c0c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:19.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.862+0000 7fac608c5700 1 --2- 172.21.15.6:0/3782703577 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fac3c066f30 0x7fac3c0693e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:19.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.862+0000 7fac608c5700 1 --2- 172.21.15.6:0/3782703577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac5c0af8b0 0x7fac5c150b00 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:19.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.862+0000 7fac608c5700 1 -- 172.21.15.6:0/3782703577 >> 172.21.15.6:0/3782703577 conn(0x7fac5c068680 msgr2=0x7fac5c0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:19.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.862+0000 7fac608c5700 1 -- 172.21.15.6:0/3782703577 shutdown_connections 2023-10-06T02:25:19.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.862+0000 7fac608c5700 1 -- 172.21.15.6:0/3782703577 wait complete. 2023-10-06T02:25:19.865 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 104 2023-10-06T02:25:19.875 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:25:19.875 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:19.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.994+0000 7f0dbbdcd700 1 Processor -- start 2023-10-06T02:25:19.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.994+0000 7f0dbbdcd700 1 -- start start 2023-10-06T02:25:19.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.995+0000 7f0dbbdcd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0db4159380 0x7f0db4159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:19.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.995+0000 7f0dbbdcd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0db415d4d0 0x7f0db415d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:19.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.995+0000 7f0dbbdcd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db40cb6c0 con 0x7f0db40b20e0 2023-10-06T02:25:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.995+0000 7f0dbbdcd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db415e200 con 0x7f0db415d4d0 2023-10-06T02:25:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.995+0000 7f0dbbdcd700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db40ccb60 con 0x7f0db4159380 2023-10-06T02:25:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.995+0000 7f0dba36a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0db415d4d0 0x7f0db415d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.995+0000 7f0db9368700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0db40b20e0 0x7f0db40b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45956/0 (socket says 172.21.15.6:45956) 2023-10-06T02:25:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.995+0000 7f0db9368700 1 -- 172.21.15.6:0/734361858 learned_addr learned my addr 172.21.15.6:0/734361858 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.996+0000 7f0db9b69700 1 --2- 172.21.15.6:0/734361858 >> v2:172.21.15.175:3300/0 conn(0x7f0db4159380 0x7f0db4159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.996+0000 7f0dba36a700 1 -- 172.21.15.6:0/734361858 >> v2:172.21.15.175:3300/0 conn(0x7f0db4159380 msgr2=0x7f0db4159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.996+0000 7f0dba36a700 1 --2- 172.21.15.6:0/734361858 >> v2:172.21.15.175:3300/0 conn(0x7f0db4159380 0x7f0db4159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.996+0000 7f0dba36a700 1 -- 172.21.15.6:0/734361858 >> v1:172.21.15.6:6789/0 conn(0x7f0db40b20e0 legacy=0x7f0db40b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.996+0000 7f0dba36a700 1 -- 172.21.15.6:0/734361858 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db40c3ef0 con 0x7f0db415d4d0 2023-10-06T02:25:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.996+0000 7f0dba36a700 1 --2- 172.21.15.6:0/734361858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db415d4d0 0x7f0db415d930 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f0db4089550 tx=0x7f0dac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a900b492395b41 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.996+0000 7f0db8b67700 1 -- 172.21.15.6:0/734361858 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac009e80 con 0x7f0db415d4d0 2023-10-06T02:25:19.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.996+0000 7f0db8b67700 1 -- 172.21.15.6:0/734361858 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac00b820 con 0x7f0db415d4d0 2023-10-06T02:25:19.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.996+0000 7f0db8b67700 1 -- 172.21.15.6:0/734361858 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac00bba0 con 0x7f0db415d4d0 2023-10-06T02:25:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.996+0000 7f0dbbdcd700 1 -- 172.21.15.6:0/734361858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db415d4d0 msgr2=0x7f0db415d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.996+0000 7f0dbbdcd700 1 --2- 172.21.15.6:0/734361858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db415d4d0 0x7f0db415d930 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f0db4089550 tx=0x7f0dac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.996+0000 7f0dbbdcd700 1 -- 172.21.15.6:0/734361858 shutdown_connections 2023-10-06T02:25:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.996+0000 7f0dbbdcd700 1 --2- 172.21.15.6:0/734361858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db415d4d0 0x7f0db415d930 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.996+0000 7f0dbbdcd700 1 --2- 172.21.15.6:0/734361858 >> v2:172.21.15.175:3300/0 conn(0x7f0db4159380 0x7f0db4159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.996+0000 7f0dbbdcd700 1 -- 172.21.15.6:0/734361858 >> 172.21.15.6:0/734361858 conn(0x7f0db4068680 msgr2=0x7f0db4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.997+0000 7f0dbbdcd700 1 -- 172.21.15.6:0/734361858 shutdown_connections 2023-10-06T02:25:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.997+0000 7f0dbbdcd700 1 -- 172.21.15.6:0/734361858 wait complete. 2023-10-06T02:25:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.998+0000 7f0dbbdcd700 1 Processor -- start 2023-10-06T02:25:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.998+0000 7f0dbbdcd700 1 -- start start 2023-10-06T02:25:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.998+0000 7f0dbbdcd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0db40b20e0 0x7f0db40cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.998+0000 7f0dbbdcd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db4159380 0x7f0db40c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.998+0000 7f0dbbdcd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db415d4d0 0x7f0db415a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.998+0000 7f0dbbdcd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db415a120 con 0x7f0db4159380 2023-10-06T02:25:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.998+0000 7f0dbbdcd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40c8560 con 0x7f0db415d4d0 2023-10-06T02:25:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.998+0000 7f0dbbdcd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db41597f0 con 0x7f0db40b20e0 2023-10-06T02:25:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.998+0000 7f0db9368700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db4159380 0x7f0db40c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.999+0000 7f0db9368700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db4159380 0x7f0db40c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53490/0 (socket says 172.21.15.6:53490) 2023-10-06T02:25:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.999+0000 7f0db9368700 1 -- 172.21.15.6:0/3743834371 learned_addr learned my addr 172.21.15.6:0/3743834371 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.999+0000 7f0db9b69700 1 --2- 172.21.15.6:0/3743834371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0db40b20e0 0x7f0db40cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.999+0000 7f0dba36a700 1 --2- 172.21.15.6:0/3743834371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db415d4d0 0x7f0db415a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.999+0000 7f0db9368700 1 -- 172.21.15.6:0/3743834371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0db40b20e0 msgr2=0x7f0db40cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.999+0000 7f0db9368700 1 --2- 172.21.15.6:0/3743834371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0db40b20e0 0x7f0db40cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.999+0000 7f0db9368700 1 -- 172.21.15.6:0/3743834371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db415d4d0 msgr2=0x7f0db415a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.999+0000 7f0db9368700 1 --2- 172.21.15.6:0/3743834371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db415d4d0 0x7f0db415a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.999+0000 7f0db9368700 1 -- 172.21.15.6:0/3743834371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac009420 con 0x7f0db4159380 2023-10-06T02:25:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.999+0000 7f0dba36a700 1 --2- 172.21.15.6:0/3743834371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db415d4d0 0x7f0db415a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.999+0000 7f0db9368700 1 --2- 172.21.15.6:0/3743834371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db4159380 0x7f0db40c7cc0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f0da800c560 tx=0x7f0da8001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.999+0000 7f0db1ffb700 1 -- 172.21.15.6:0/3743834371 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8005b30 con 0x7f0db4159380 2023-10-06T02:25:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.999+0000 7f0db1ffb700 1 -- 172.21.15.6:0/3743834371 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da8005cb0 con 0x7f0db4159380 2023-10-06T02:25:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.999+0000 7f0dbbdcd700 1 -- 172.21.15.6:0/3743834371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db4159ad0 con 0x7f0db4159380 2023-10-06T02:25:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.999+0000 7f0db1ffb700 1 -- 172.21.15.6:0/3743834371 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8007320 con 0x7f0db4159380 2023-10-06T02:25:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:19.999+0000 7f0dbbdcd700 1 -- 172.21.15.6:0/3743834371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db40c8200 con 0x7f0db4159380 2023-10-06T02:25:20.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.000+0000 7f0dbbdcd700 1 -- 172.21.15.6:0/3743834371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db415a2d0 con 0x7f0db4159380 2023-10-06T02:25:20.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.001+0000 7f0db1ffb700 1 -- 172.21.15.6:0/3743834371 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0da801b3b0 con 0x7f0db4159380 2023-10-06T02:25:20.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.001+0000 7f0db1ffb700 1 --2- 172.21.15.6:0/3743834371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0da0066f30 0x7f0da00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:20.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.001+0000 7f0db1ffb700 1 -- 172.21.15.6:0/3743834371 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6636+0+0 (secure 0 0 0) 0x7f0da8083e10 con 0x7f0db4159380 2023-10-06T02:25:20.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.001+0000 7f0db9b69700 1 --2- 172.21.15.6:0/3743834371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0da0066f30 0x7f0da00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:20.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.002+0000 7f0db9b69700 1 --2- 172.21.15.6:0/3743834371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0da0066f30 0x7f0da00693e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0da400d390 tx=0x7f0da4007510 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:20.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.006+0000 7f0db1ffb700 1 -- 172.21.15.6:0/3743834371 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0db415a2d0 con 0x7f0db4159380 2023-10-06T02:25:20.177 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:25:20.180 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:25:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.247+0000 7f0dbbdcd700 1 -- 172.21.15.6:0/3743834371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0db415a260 con 0x7f0db4159380 2023-10-06T02:25:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.247+0000 7f0db1ffb700 1 -- 172.21.15.6:0/3743834371 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4594 (secure 0 0 0) 0x7f0da8017090 con 0x7f0db4159380 2023-10-06T02:25:20.248 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:20.248 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2869895689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2869895689},{"type":"v1","addr":"172.21.15.6:6835","nonce":2869895689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:17.098496+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:20.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.249+0000 7f0dbbdcd700 1 -- 172.21.15.6:0/3743834371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0da0066f30 msgr2=0x7f0da00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:20.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.249+0000 7f0dbbdcd700 1 --2- 172.21.15.6:0/3743834371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0da0066f30 0x7f0da00693e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0da400d390 tx=0x7f0da4007510 comp rx=0 tx=0).stop 2023-10-06T02:25:20.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.249+0000 7f0dbbdcd700 1 -- 172.21.15.6:0/3743834371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db4159380 msgr2=0x7f0db40c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:20.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.249+0000 7f0dbbdcd700 1 --2- 172.21.15.6:0/3743834371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db4159380 0x7f0db40c7cc0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f0da800c560 tx=0x7f0da8001020 comp rx=0 tx=0).stop 2023-10-06T02:25:20.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.249+0000 7f0dbbdcd700 1 -- 172.21.15.6:0/3743834371 shutdown_connections 2023-10-06T02:25:20.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.249+0000 7f0dbbdcd700 1 --2- 172.21.15.6:0/3743834371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db415d4d0 0x7f0db415a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.249+0000 7f0dbbdcd700 1 --2- 172.21.15.6:0/3743834371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0db40b20e0 0x7f0db40cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.249+0000 7f0dbbdcd700 1 --2- 172.21.15.6:0/3743834371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0da0066f30 0x7f0da00693e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.249+0000 7f0dbbdcd700 1 --2- 172.21.15.6:0/3743834371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db4159380 0x7f0db40c7cc0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.249+0000 7f0dbbdcd700 1 -- 172.21.15.6:0/3743834371 >> 172.21.15.6:0/3743834371 conn(0x7f0db4068680 msgr2=0x7f0db41586d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.249+0000 7f0dbbdcd700 1 -- 172.21.15.6:0/3743834371 shutdown_connections 2023-10-06T02:25:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.249+0000 7f0dbbdcd700 1 -- 172.21.15.6:0/3743834371 wait complete. 2023-10-06T02:25:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 104 2023-10-06T02:25:20.262 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:25:20.262 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:20.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.421+0000 7f4d15fc4700 1 Processor -- start 2023-10-06T02:25:20.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.421+0000 7f4d15fc4700 1 -- start start 2023-10-06T02:25:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.422+0000 7f4d15fc4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d100af4e0 0x7f4d100b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.422+0000 7f4d15fc4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4d100af8b0 0x7f4d100b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.422+0000 7f4d15fc4700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1015e190 con 0x7f4d1015d460 2023-10-06T02:25:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.422+0000 7f4d15fc4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d100b1910 con 0x7f4d100af8b0 2023-10-06T02:25:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.422+0000 7f4d15fc4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1015dfb0 con 0x7f4d100af4e0 2023-10-06T02:25:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.422+0000 7f4d0f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d100af4e0 0x7f4d100b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.422+0000 7f4d0effd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4d100af8b0 0x7f4d100b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.423+0000 7f4d0ffff700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4d1015d460 0x7f4d1015d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:47288/0 (socket says 172.21.15.6:47288) 2023-10-06T02:25:20.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.423+0000 7f4d0ffff700 1 -- 172.21.15.6:0/2629419839 learned_addr learned my addr 172.21.15.6:0/2629419839 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:20.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.423+0000 7f4d0f7fe700 1 -- 172.21.15.6:0/2629419839 >> v2:172.21.15.175:3300/0 conn(0x7f4d100af8b0 msgr2=0x7f4d100b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:20.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.423+0000 7f4d0f7fe700 1 --2- 172.21.15.6:0/2629419839 >> v2:172.21.15.175:3300/0 conn(0x7f4d100af8b0 0x7f4d100b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.423+0000 7f4d0f7fe700 1 -- 172.21.15.6:0/2629419839 >> v1:172.21.15.175:6789/0 conn(0x7f4d1015d460 legacy=0x7f4d1015d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:20.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.423+0000 7f4d0f7fe700 1 -- 172.21.15.6:0/2629419839 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d100cb650 con 0x7f4d100af4e0 2023-10-06T02:25:20.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.423+0000 7f4d0effd700 1 --2- 172.21.15.6:0/2629419839 >> v2:172.21.15.175:3300/0 conn(0x7f4d100af8b0 0x7f4d100b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:25:20.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.423+0000 7f4d0f7fe700 1 --2- 172.21.15.6:0/2629419839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d100af4e0 0x7f4d100b20e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4d000098e0 tx=0x7f4d000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97390b34673b8156 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:20.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.423+0000 7f4d0e7fc700 1 -- 172.21.15.6:0/2629419839 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0000b640 con 0x7f4d100af4e0 2023-10-06T02:25:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.423+0000 7f4d0e7fc700 1 -- 172.21.15.6:0/2629419839 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0000b7a0 con 0x7f4d100af4e0 2023-10-06T02:25:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.423+0000 7f4d0e7fc700 1 -- 172.21.15.6:0/2629419839 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0000bb40 con 0x7f4d100af4e0 2023-10-06T02:25:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.424+0000 7f4d15fc4700 1 -- 172.21.15.6:0/2629419839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d100af4e0 msgr2=0x7f4d100b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.424+0000 7f4d15fc4700 1 --2- 172.21.15.6:0/2629419839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d100af4e0 0x7f4d100b20e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4d000098e0 tx=0x7f4d000091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.424+0000 7f4d15fc4700 1 -- 172.21.15.6:0/2629419839 shutdown_connections 2023-10-06T02:25:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.424+0000 7f4d15fc4700 1 --2- 172.21.15.6:0/2629419839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d100af4e0 0x7f4d100b20e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.424+0000 7f4d15fc4700 1 --2- 172.21.15.6:0/2629419839 >> v2:172.21.15.175:3300/0 conn(0x7f4d100af8b0 0x7f4d100b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.424+0000 7f4d15fc4700 1 -- 172.21.15.6:0/2629419839 >> 172.21.15.6:0/2629419839 conn(0x7f4d10068680 msgr2=0x7f4d10068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.424+0000 7f4d15fc4700 1 -- 172.21.15.6:0/2629419839 shutdown_connections 2023-10-06T02:25:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.424+0000 7f4d15fc4700 1 -- 172.21.15.6:0/2629419839 wait complete. 2023-10-06T02:25:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.425+0000 7f4d15fc4700 1 Processor -- start 2023-10-06T02:25:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.425+0000 7f4d15fc4700 1 -- start start 2023-10-06T02:25:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.426+0000 7f4d15fc4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d100af4e0 0x7f4d1014ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.426+0000 7f4d15fc4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d100af8b0 0x7f4d100b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.426+0000 7f4d15fc4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1015d460 0x7f4d101501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.426+0000 7f4d15fc4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100b5f60 con 0x7f4d100af4e0 2023-10-06T02:25:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.426+0000 7f4d15fc4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100c8b70 con 0x7f4d100af8b0 2023-10-06T02:25:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.426+0000 7f4d15fc4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100c7cc0 con 0x7f4d1015d460 2023-10-06T02:25:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.426+0000 7f4d0f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d100af4e0 0x7f4d1014ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.426+0000 7f4d0f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d100af4e0 0x7f4d1014ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53504/0 (socket says 172.21.15.6:53504) 2023-10-06T02:25:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.426+0000 7f4d0f7fe700 1 -- 172.21.15.6:0/787678601 learned_addr learned my addr 172.21.15.6:0/787678601 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.426+0000 7f4d0effd700 1 --2- 172.21.15.6:0/787678601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d100af8b0 0x7f4d100b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.426+0000 7f4d0ffff700 1 --2- 172.21.15.6:0/787678601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1015d460 0x7f4d101501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.426+0000 7f4d0f7fe700 1 -- 172.21.15.6:0/787678601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1015d460 msgr2=0x7f4d101501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.426+0000 7f4d0f7fe700 1 --2- 172.21.15.6:0/787678601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1015d460 0x7f4d101501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.426+0000 7f4d0f7fe700 1 -- 172.21.15.6:0/787678601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d100af8b0 msgr2=0x7f4d100b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.426+0000 7f4d0f7fe700 1 --2- 172.21.15.6:0/787678601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d100af8b0 0x7f4d100b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.426+0000 7f4d0f7fe700 1 -- 172.21.15.6:0/787678601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d04009420 con 0x7f4d100af4e0 2023-10-06T02:25:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.426+0000 7f4d0ffff700 1 --2- 172.21.15.6:0/787678601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1015d460 0x7f4d101501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.427+0000 7f4d0f7fe700 1 --2- 172.21.15.6:0/787678601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d100af4e0 0x7f4d1014ea80 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000b6c0 tx=0x7f4d00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.427+0000 7f4cf77fe700 1 -- 172.21.15.6:0/787678601 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00000d10 con 0x7f4d100af4e0 2023-10-06T02:25:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.427+0000 7f4cf77fe700 1 -- 172.21.15.6:0/787678601 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0000bb20 con 0x7f4d100af4e0 2023-10-06T02:25:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.427+0000 7f4cf77fe700 1 -- 172.21.15.6:0/787678601 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00011670 con 0x7f4d100af4e0 2023-10-06T02:25:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.427+0000 7f4d15fc4700 1 -- 172.21.15.6:0/787678601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d00009420 con 0x7f4d100af4e0 2023-10-06T02:25:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.427+0000 7f4d15fc4700 1 -- 172.21.15.6:0/787678601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d100c7f60 con 0x7f4d100af4e0 2023-10-06T02:25:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.428+0000 7f4d15fc4700 1 -- 172.21.15.6:0/787678601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d100cd950 con 0x7f4d100af4e0 2023-10-06T02:25:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.428+0000 7f4cf77fe700 1 -- 172.21.15.6:0/787678601 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d00011aa0 con 0x7f4d100af4e0 2023-10-06T02:25:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.429+0000 7f4cf77fe700 1 --2- 172.21.15.6:0/787678601 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4cfc066f30 0x7f4cfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.429+0000 7f4cf77fe700 1 -- 172.21.15.6:0/787678601 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6636+0+0 (secure 0 0 0) 0x7f4d000864b0 con 0x7f4d100af4e0 2023-10-06T02:25:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.429+0000 7f4d0effd700 1 --2- 172.21.15.6:0/787678601 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4cfc066f30 0x7f4cfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:20.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.429+0000 7f4d0effd700 1 --2- 172.21.15.6:0/787678601 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4cfc066f30 0x7f4cfc0693e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4d10150ea0 tx=0x7f4d040091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:20.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.433+0000 7f4cf77fe700 1 -- 172.21.15.6:0/787678601 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d000532e0 con 0x7f4d100af4e0 2023-10-06T02:25:20.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.672+0000 7f4d15fc4700 1 -- 172.21.15.6:0/787678601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d100c8e50 con 0x7f4d100af4e0 2023-10-06T02:25:20.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.673+0000 7f4cf77fe700 1 -- 172.21.15.6:0/787678601 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4594 (secure 0 0 0) 0x7f4d00056900 con 0x7f4d100af4e0 2023-10-06T02:25:20.673 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:20.673 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2869895689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2869895689},{"type":"v1","addr":"172.21.15.6:6835","nonce":2869895689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:17.098496+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:20.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.675+0000 7f4d15fc4700 1 -- 172.21.15.6:0/787678601 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4cfc066f30 msgr2=0x7f4cfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:20.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.675+0000 7f4d15fc4700 1 --2- 172.21.15.6:0/787678601 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4cfc066f30 0x7f4cfc0693e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4d10150ea0 tx=0x7f4d040091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.675+0000 7f4d15fc4700 1 -- 172.21.15.6:0/787678601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d100af4e0 msgr2=0x7f4d1014ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:20.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.675+0000 7f4d15fc4700 1 --2- 172.21.15.6:0/787678601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d100af4e0 0x7f4d1014ea80 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000b6c0 tx=0x7f4d00017000 comp rx=0 tx=0).stop 2023-10-06T02:25:20.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.675+0000 7f4d15fc4700 1 -- 172.21.15.6:0/787678601 shutdown_connections 2023-10-06T02:25:20.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.675+0000 7f4d15fc4700 1 --2- 172.21.15.6:0/787678601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1015d460 0x7f4d101501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.675+0000 7f4d15fc4700 1 --2- 172.21.15.6:0/787678601 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4cfc066f30 0x7f4cfc0693e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.675+0000 7f4d15fc4700 1 --2- 172.21.15.6:0/787678601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d100af4e0 0x7f4d1014ea80 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.675+0000 7f4d15fc4700 1 --2- 172.21.15.6:0/787678601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d100af8b0 0x7f4d100b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.675+0000 7f4d15fc4700 1 -- 172.21.15.6:0/787678601 >> 172.21.15.6:0/787678601 conn(0x7f4d10068680 msgr2=0x7f4d100cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:20.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.675+0000 7f4d15fc4700 1 -- 172.21.15.6:0/787678601 shutdown_connections 2023-10-06T02:25:20.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.675+0000 7f4d15fc4700 1 -- 172.21.15.6:0/787678601 wait complete. 2023-10-06T02:25:20.677 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 104 2023-10-06T02:25:20.687 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 600.00000000' led to DAMAGED state 2023-10-06T02:25:20.687 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 1.00000000.inode' 2023-10-06T02:25:20.688 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:20.688 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:25:20.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:20.688 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:25:20.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:25:20.704 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:25:20.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:25:20.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.864+0000 7f3a346f8700 1 Processor -- start 2023-10-06T02:25:20.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.864+0000 7f3a346f8700 1 -- start start 2023-10-06T02:25:20.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.865+0000 7f3a346f8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3a2c0c3fd0 0x7f3a2c0c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:20.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.865+0000 7f3a346f8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2c0c3b40 con 0x7f3a2c1574b0 2023-10-06T02:25:20.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.865+0000 7f3a346f8700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2c0c2f30 con 0x7f3a2c0cbcc0 2023-10-06T02:25:20.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.865+0000 7f3a346f8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2c0c4980 con 0x7f3a2c0c3fd0 2023-10-06T02:25:20.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.865+0000 7f3a31c93700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3a2c0c3fd0 0x7f3a2c0c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:20.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.865+0000 7f3a32494700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3a2c1574b0 0x7f3a2c0b0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45972/0 (socket says 172.21.15.6:45972) 2023-10-06T02:25:20.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.865+0000 7f3a32494700 1 -- 172.21.15.6:0/1891506489 learned_addr learned my addr 172.21.15.6:0/1891506489 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:20.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.866+0000 7f3a31c93700 1 -- 172.21.15.6:0/1891506489 >> v1:172.21.15.175:6789/0 conn(0x7f3a2c0cbcc0 legacy=0x7f3a2c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:20.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.866+0000 7f3a31c93700 1 -- 172.21.15.6:0/1891506489 >> v1:172.21.15.6:6789/0 conn(0x7f3a2c1574b0 legacy=0x7f3a2c0b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:20.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.866+0000 7f3a31c93700 1 -- 172.21.15.6:0/1891506489 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c0c3210 con 0x7f3a2c0c3fd0 2023-10-06T02:25:20.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.866+0000 7f3a31492700 1 -- 172.21.15.6:0/1891506489 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415228371 0 0) 0x7f3a2c0c3b40 con 0x7f3a2c1574b0 2023-10-06T02:25:20.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.866+0000 7f3a31c93700 1 --2- 172.21.15.6:0/1891506489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c0c3fd0 0x7f3a2c0c4440 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f3a200098e0 tx=0x7f3a200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf5ef8558a93e82 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:20.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.866+0000 7f3a31492700 1 -- 172.21.15.6:0/1891506489 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20009e80 con 0x7f3a2c0c3fd0 2023-10-06T02:25:20.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.866+0000 7f3a31492700 1 -- 172.21.15.6:0/1891506489 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2000b860 con 0x7f3a2c0c3fd0 2023-10-06T02:25:20.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.866+0000 7f3a31492700 1 -- 172.21.15.6:0/1891506489 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2000bbe0 con 0x7f3a2c0c3fd0 2023-10-06T02:25:20.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.867+0000 7f3a346f8700 1 -- 172.21.15.6:0/1891506489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c0c3fd0 msgr2=0x7f3a2c0c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:20.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.867+0000 7f3a346f8700 1 --2- 172.21.15.6:0/1891506489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c0c3fd0 0x7f3a2c0c4440 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f3a200098e0 tx=0x7f3a200091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.867+0000 7f3a346f8700 1 -- 172.21.15.6:0/1891506489 shutdown_connections 2023-10-06T02:25:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.867+0000 7f3a346f8700 1 --2- 172.21.15.6:0/1891506489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c0c3fd0 0x7f3a2c0c4440 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.867+0000 7f3a346f8700 1 -- 172.21.15.6:0/1891506489 >> 172.21.15.6:0/1891506489 conn(0x7f3a2c067910 msgr2=0x7f3a2c0ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.867+0000 7f3a346f8700 1 -- 172.21.15.6:0/1891506489 shutdown_connections 2023-10-06T02:25:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.867+0000 7f3a346f8700 1 -- 172.21.15.6:0/1891506489 wait complete. 2023-10-06T02:25:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.868+0000 7f3a346f8700 1 Processor -- start 2023-10-06T02:25:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.868+0000 7f3a346f8700 1 -- start start 2023-10-06T02:25:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.868+0000 7f3a346f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c0c3fd0 0x7f3a2c0c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.868+0000 7f3a346f8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a2c0cbcc0 0x7f3a2c0b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.868+0000 7f3a346f8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c1574b0 0x7f3a2c159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.868+0000 7f3a346f8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0c76b0 con 0x7f3a2c0c3fd0 2023-10-06T02:25:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.868+0000 7f3a346f8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c159b40 con 0x7f3a2c1574b0 2023-10-06T02:25:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.868+0000 7f3a346f8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c158f30 con 0x7f3a2c0cbcc0 2023-10-06T02:25:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.869+0000 7f3a32494700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c0c3fd0 0x7f3a2c0c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.869+0000 7f3a32494700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c0c3fd0 0x7f3a2c0c51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53510/0 (socket says 172.21.15.6:53510) 2023-10-06T02:25:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.869+0000 7f3a32494700 1 -- 172.21.15.6:0/2741938187 learned_addr learned my addr 172.21.15.6:0/2741938187 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.869+0000 7f3a32c95700 1 --2- 172.21.15.6:0/2741938187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c1574b0 0x7f3a2c159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.869+0000 7f3a31c93700 1 --2- 172.21.15.6:0/2741938187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a2c0cbcc0 0x7f3a2c0b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.869+0000 7f3a32494700 1 -- 172.21.15.6:0/2741938187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a2c0cbcc0 msgr2=0x7f3a2c0b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.869+0000 7f3a32494700 1 --2- 172.21.15.6:0/2741938187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a2c0cbcc0 0x7f3a2c0b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.869+0000 7f3a32494700 1 -- 172.21.15.6:0/2741938187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c1574b0 msgr2=0x7f3a2c159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.869+0000 7f3a32494700 1 --2- 172.21.15.6:0/2741938187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c1574b0 0x7f3a2c159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.869+0000 7f3a32494700 1 -- 172.21.15.6:0/2741938187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a20009420 con 0x7f3a2c0c3fd0 2023-10-06T02:25:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.869+0000 7f3a32c95700 1 --2- 172.21.15.6:0/2741938187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c1574b0 0x7f3a2c159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.869+0000 7f3a32494700 1 --2- 172.21.15.6:0/2741938187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c0c3fd0 0x7f3a2c0c51a0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400c5e0 tx=0x7f3a24007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.869+0000 7f3a2a7fc700 1 -- 172.21.15.6:0/2741938187 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a240072e0 con 0x7f3a2c0c3fd0 2023-10-06T02:25:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.869+0000 7f3a2a7fc700 1 -- 172.21.15.6:0/2741938187 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a24007440 con 0x7f3a2c0c3fd0 2023-10-06T02:25:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.869+0000 7f3a346f8700 1 -- 172.21.15.6:0/2741938187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2c159210 con 0x7f3a2c0c3fd0 2023-10-06T02:25:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.869+0000 7f3a2a7fc700 1 -- 172.21.15.6:0/2741938187 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a240057f0 con 0x7f3a2c0c3fd0 2023-10-06T02:25:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.869+0000 7f3a346f8700 1 -- 172.21.15.6:0/2741938187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c1597d0 con 0x7f3a2c0c3fd0 2023-10-06T02:25:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.870+0000 7f3a346f8700 1 -- 172.21.15.6:0/2741938187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2c06e590 con 0x7f3a2c0c3fd0 2023-10-06T02:25:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.871+0000 7f3a2a7fc700 1 -- 172.21.15.6:0/2741938187 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a24005c00 con 0x7f3a2c0c3fd0 2023-10-06T02:25:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.871+0000 7f3a2a7fc700 1 --2- 172.21.15.6:0/2741938187 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a18066f30 0x7f3a180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.871+0000 7f3a2a7fc700 1 -- 172.21.15.6:0/2741938187 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6636+0+0 (secure 0 0 0) 0x7f3a24083e70 con 0x7f3a2c0c3fd0 2023-10-06T02:25:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.871+0000 7f3a31c93700 1 --2- 172.21.15.6:0/2741938187 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a18066f30 0x7f3a180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.872+0000 7f3a31c93700 1 --2- 172.21.15.6:0/2741938187 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a18066f30 0x7f3a180693e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3a200091e0 tx=0x7f3a20016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:20.875+0000 7f3a2a7fc700 1 -- 172.21.15.6:0/2741938187 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a24050d40 con 0x7f3a2c0c3fd0 2023-10-06T02:25:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.116+0000 7f3a346f8700 1 -- 172.21.15.6:0/2741938187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3a2c0c34f0 con 0x7f3a2c0c3fd0 2023-10-06T02:25:21.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.822+0000 7f3a2a7fc700 1 -- 172.21.15.6:0/2741938187 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v105) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3a24017070 con 0x7f3a2c0c3fd0 2023-10-06T02:25:21.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.825+0000 7f3a346f8700 1 -- 172.21.15.6:0/2741938187 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a18066f30 msgr2=0x7f3a180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:21.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.825+0000 7f3a346f8700 1 --2- 172.21.15.6:0/2741938187 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a18066f30 0x7f3a180693e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3a200091e0 tx=0x7f3a20016000 comp rx=0 tx=0).stop 2023-10-06T02:25:21.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.825+0000 7f3a346f8700 1 -- 172.21.15.6:0/2741938187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c0c3fd0 msgr2=0x7f3a2c0c51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:21.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.825+0000 7f3a346f8700 1 --2- 172.21.15.6:0/2741938187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c0c3fd0 0x7f3a2c0c51a0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400c5e0 tx=0x7f3a24007e80 comp rx=0 tx=0).stop 2023-10-06T02:25:21.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.825+0000 7f3a346f8700 1 -- 172.21.15.6:0/2741938187 shutdown_connections 2023-10-06T02:25:21.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.825+0000 7f3a346f8700 1 --2- 172.21.15.6:0/2741938187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c1574b0 0x7f3a2c159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:21.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.825+0000 7f3a346f8700 1 --2- 172.21.15.6:0/2741938187 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a18066f30 0x7f3a180693e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:21.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.825+0000 7f3a346f8700 1 --2- 172.21.15.6:0/2741938187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c0c3fd0 0x7f3a2c0c51a0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:21.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.825+0000 7f3a346f8700 1 --2- 172.21.15.6:0/2741938187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a2c0cbcc0 0x7f3a2c0b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:21.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.825+0000 7f3a346f8700 1 -- 172.21.15.6:0/2741938187 >> 172.21.15.6:0/2741938187 conn(0x7f3a2c067910 msgr2=0x7f3a2c06cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:21.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.825+0000 7f3a346f8700 1 -- 172.21.15.6:0/2741938187 shutdown_connections 2023-10-06T02:25:21.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.825+0000 7f3a346f8700 1 -- 172.21.15.6:0/2741938187 wait complete. 2023-10-06T02:25:21.828 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:25:21.839 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:25:21.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.961+0000 7fcda9849700 1 Processor -- start 2023-10-06T02:25:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.961+0000 7fcda9849700 1 -- start start 2023-10-06T02:25:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.962+0000 7fcda9849700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4069fc0 0x7fcda406a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.962+0000 7fcda9849700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda40b16c0 con 0x7fcda415d2d0 2023-10-06T02:25:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.962+0000 7fcda9849700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda40b1f40 con 0x7fcda4069bf0 2023-10-06T02:25:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.962+0000 7fcda9849700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda406aac0 con 0x7fcda4069fc0 2023-10-06T02:25:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.962+0000 7fcda9048700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcda415d2d0 0x7fcda415d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45976/0 (socket says 172.21.15.6:45976) 2023-10-06T02:25:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.962+0000 7fcda9048700 1 -- 172.21.15.6:0/3281808079 learned_addr learned my addr 172.21.15.6:0/3281808079 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.962+0000 7fcda3fff700 1 --2- 172.21.15.6:0/3281808079 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4069fc0 0x7fcda406a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.962+0000 7fcda37fe700 1 -- 172.21.15.6:0/3281808079 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257314491 0 0) 0x7fcda40b16c0 con 0x7fcda415d2d0 2023-10-06T02:25:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.962+0000 7fcda37fe700 1 -- 172.21.15.6:0/3281808079 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd94003570 con 0x7fcda415d2d0 2023-10-06T02:25:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.962+0000 7fcda37fe700 1 -- 172.21.15.6:0/3281808079 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 222334977 0 0) 0x7fcd94003570 con 0x7fcda415d2d0 2023-10-06T02:25:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.962+0000 7fcda37fe700 1 -- 172.21.15.6:0/3281808079 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4069fc0 msgr2=0x7fcda406a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.962+0000 7fcda37fe700 1 --2- 172.21.15.6:0/3281808079 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4069fc0 0x7fcda406a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.962+0000 7fcda37fe700 1 -- 172.21.15.6:0/3281808079 >> v1:172.21.15.175:6789/0 conn(0x7fcda4069bf0 legacy=0x7fcda40b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda37fe700 1 -- 172.21.15.6:0/3281808079 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda40b18f0 con 0x7fcda415d2d0 2023-10-06T02:25:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda37fe700 1 -- 172.21.15.6:0/3281808079 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fcd9c0017f0 con 0x7fcda415d2d0 2023-10-06T02:25:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda37fe700 1 -- 172.21.15.6:0/3281808079 >> v1:172.21.15.6:6789/0 conn(0x7fcda415d2d0 legacy=0x7fcda415d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda37fe700 1 --2- 172.21.15.6:0/3281808079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd94003a90 0x7fcd94003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda37fe700 1 --2- 172.21.15.6:0/3281808079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd94004810 0x7fcd94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda37fe700 1 --2- 172.21.15.6:0/3281808079 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4069fc0 0x7fcd940051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda37fe700 1 -- 172.21.15.6:0/3281808079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda406aac0 con 0x7fcd94004810 2023-10-06T02:25:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda37fe700 1 -- 172.21.15.6:0/3281808079 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9400bb90 con 0x7fcd94003a90 2023-10-06T02:25:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda37fe700 1 -- 172.21.15.6:0/3281808079 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9400bd50 con 0x7fcda4069fc0 2023-10-06T02:25:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda3fff700 1 --2- 172.21.15.6:0/3281808079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd94004810 0x7fcd94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda8847700 1 --2- 172.21.15.6:0/3281808079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd94003a90 0x7fcd94003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda9048700 1 --2- 172.21.15.6:0/3281808079 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4069fc0 0x7fcd940051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda3fff700 1 -- 172.21.15.6:0/3281808079 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4069fc0 msgr2=0x7fcd940051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda3fff700 1 --2- 172.21.15.6:0/3281808079 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4069fc0 0x7fcd940051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda3fff700 1 -- 172.21.15.6:0/3281808079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd94003a90 msgr2=0x7fcd94003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda3fff700 1 --2- 172.21.15.6:0/3281808079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd94003a90 0x7fcd94003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda3fff700 1 -- 172.21.15.6:0/3281808079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd94003570 con 0x7fcd94004810 2023-10-06T02:25:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda8847700 1 --2- 172.21.15.6:0/3281808079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd94003a90 0x7fcd94003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda9048700 1 --2- 172.21.15.6:0/3281808079 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4069fc0 0x7fcd940051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda3fff700 1 --2- 172.21.15.6:0/3281808079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd94004810 0x7fcd94004c80 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009c00 tx=0x7fcd900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311a61b5b1a0d4a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda37fe700 1 -- 172.21.15.6:0/3281808079 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9000e710 con 0x7fcd94004810 2023-10-06T02:25:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda37fe700 1 -- 172.21.15.6:0/3281808079 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9000e870 con 0x7fcd94004810 2023-10-06T02:25:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.963+0000 7fcda37fe700 1 -- 172.21.15.6:0/3281808079 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9000ec30 con 0x7fcd94004810 2023-10-06T02:25:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.964+0000 7fcda9849700 1 -- 172.21.15.6:0/3281808079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd94004810 msgr2=0x7fcd94004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.964+0000 7fcda9849700 1 --2- 172.21.15.6:0/3281808079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd94004810 0x7fcd94004c80 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009c00 tx=0x7fcd900091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.964+0000 7fcda9048700 1 -- 172.21.15.6:0/3281808079 reap_dead start 2023-10-06T02:25:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.964+0000 7fcda9849700 1 -- 172.21.15.6:0/3281808079 shutdown_connections 2023-10-06T02:25:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.964+0000 7fcda9849700 1 -- 172.21.15.6:0/3281808079 >> 172.21.15.6:0/3281808079 conn(0x7fcda4067910 msgr2=0x7fcda40cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.964+0000 7fcda9849700 1 -- 172.21.15.6:0/3281808079 shutdown_connections 2023-10-06T02:25:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.964+0000 7fcda9849700 1 -- 172.21.15.6:0/3281808079 wait complete. 2023-10-06T02:25:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.965+0000 7fcda9849700 1 Processor -- start 2023-10-06T02:25:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.965+0000 7fcda9849700 1 -- start start 2023-10-06T02:25:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda9849700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd94004810 0x7fcda414ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda9849700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda4151b70 0x7fcda414e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda9849700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcda414ed90 0x7fcda415f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda9849700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda41541d0 con 0x7fcda4151b70 2023-10-06T02:25:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda9849700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda4154470 con 0x7fcda414ed90 2023-10-06T02:25:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda9849700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda41520e0 con 0x7fcd94004810 2023-10-06T02:25:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda4151b70 0x7fcda414e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda4151b70 0x7fcda414e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53526/0 (socket says 172.21.15.6:53526) 2023-10-06T02:25:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda3fff700 1 -- 172.21.15.6:0/3014739376 learned_addr learned my addr 172.21.15.6:0/3014739376 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda9048700 1 --2- 172.21.15.6:0/3014739376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcda414ed90 0x7fcda415f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda8847700 1 --2- 172.21.15.6:0/3014739376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd94004810 0x7fcda414ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda3fff700 1 -- 172.21.15.6:0/3014739376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd94004810 msgr2=0x7fcda414ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda3fff700 1 --2- 172.21.15.6:0/3014739376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd94004810 0x7fcda414ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda3fff700 1 -- 172.21.15.6:0/3014739376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcda414ed90 msgr2=0x7fcda415f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda3fff700 1 --2- 172.21.15.6:0/3014739376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcda414ed90 0x7fcda415f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda3fff700 1 -- 172.21.15.6:0/3014739376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda41523c0 con 0x7fcda4151b70 2023-10-06T02:25:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda9048700 1 --2- 172.21.15.6:0/3014739376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcda414ed90 0x7fcda415f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.966+0000 7fcda3fff700 1 --2- 172.21.15.6:0/3014739376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda4151b70 0x7fcda414e850 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400bb60 tx=0x7fcd9001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.967+0000 7fcda0ff9700 1 -- 172.21.15.6:0/3014739376 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90022070 con 0x7fcda4151b70 2023-10-06T02:25:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.967+0000 7fcda0ff9700 1 -- 172.21.15.6:0/3014739376 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9000ebf0 con 0x7fcda4151b70 2023-10-06T02:25:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.967+0000 7fcda9849700 1 -- 172.21.15.6:0/3014739376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda41526a0 con 0x7fcda4151b70 2023-10-06T02:25:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.967+0000 7fcda0ff9700 1 -- 172.21.15.6:0/3014739376 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9001c6a0 con 0x7fcda4151b70 2023-10-06T02:25:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.967+0000 7fcda9849700 1 -- 172.21.15.6:0/3014739376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda415fd60 con 0x7fcda4151b70 2023-10-06T02:25:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.968+0000 7fcda9849700 1 -- 172.21.15.6:0/3014739376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda4152890 con 0x7fcda4151b70 2023-10-06T02:25:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.968+0000 7fcda0ff9700 1 -- 172.21.15.6:0/3014739376 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd9001ca90 con 0x7fcda4151b70 2023-10-06T02:25:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.968+0000 7fcda0ff9700 1 --2- 172.21.15.6:0/3014739376 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcd88066f30 0x7fcd880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.969+0000 7fcda0ff9700 1 -- 172.21.15.6:0/3014739376 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6636+0+0 (secure 0 0 0) 0x7fcd900861e0 con 0x7fcda4151b70 2023-10-06T02:25:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.969+0000 7fcda8847700 1 --2- 172.21.15.6:0/3014739376 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcd88066f30 0x7fcd880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.969+0000 7fcda8847700 1 --2- 172.21.15.6:0/3014739376 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcd88066f30 0x7fcd880693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcd98007c10 tx=0x7fcd98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:21.973+0000 7fcda0ff9700 1 -- 172.21.15.6:0/3014739376 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcda4152890 con 0x7fcda4151b70 2023-10-06T02:25:22.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.251+0000 7fcda9849700 1 -- 172.21.15.6:0/3014739376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fcda4152890 con 0x7fcda4151b70 2023-10-06T02:25:22.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.836+0000 7fcda0ff9700 1 -- 172.21.15.6:0/3014739376 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v106) v1 ==== 101+0+0 (secure 0 0 0) 0x7fcda4152890 con 0x7fcda4151b70 2023-10-06T02:25:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.838+0000 7fcda9849700 1 -- 172.21.15.6:0/3014739376 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcd88066f30 msgr2=0x7fcd880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.838+0000 7fcda9849700 1 --2- 172.21.15.6:0/3014739376 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcd88066f30 0x7fcd880693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcd98007c10 tx=0x7fcd98009040 comp rx=0 tx=0).stop 2023-10-06T02:25:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.838+0000 7fcda9849700 1 -- 172.21.15.6:0/3014739376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda4151b70 msgr2=0x7fcda414e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.838+0000 7fcda9849700 1 --2- 172.21.15.6:0/3014739376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda4151b70 0x7fcda414e850 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400bb60 tx=0x7fcd9001a000 comp rx=0 tx=0).stop 2023-10-06T02:25:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.838+0000 7fcda9849700 1 -- 172.21.15.6:0/3014739376 shutdown_connections 2023-10-06T02:25:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.838+0000 7fcda9849700 1 --2- 172.21.15.6:0/3014739376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcda414ed90 0x7fcda415f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.838+0000 7fcda9849700 1 --2- 172.21.15.6:0/3014739376 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd94004810 0x7fcda414ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.838+0000 7fcda9849700 1 --2- 172.21.15.6:0/3014739376 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcd88066f30 0x7fcd880693e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:22.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.838+0000 7fcda9849700 1 --2- 172.21.15.6:0/3014739376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda4151b70 0x7fcda414e850 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:22.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.838+0000 7fcda9849700 1 -- 172.21.15.6:0/3014739376 >> 172.21.15.6:0/3014739376 conn(0x7fcda4067910 msgr2=0x7fcda406c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:22.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.838+0000 7fcda9849700 1 -- 172.21.15.6:0/3014739376 shutdown_connections 2023-10-06T02:25:22.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.838+0000 7fcda9849700 1 -- 172.21.15.6:0/3014739376 wait complete. 2023-10-06T02:25:22.840 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:25:22.852 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:25:22.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.891+0000 7f913282a000 1 Processor -- start 2023-10-06T02:25:22.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.891+0000 7f913282a000 1 -- start start 2023-10-06T02:25:22.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f913282a000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55bf3a050160 0x55bf3a10c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:22.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f913282a000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf3a1118b0 0x55bf3a10ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:22.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f913282a000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf3a111c80 0x55bf3a1262f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:22.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f913282a000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf39f9c620 con 0x55bf3a111c80 2023-10-06T02:25:22.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f913282a000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf39f93400 con 0x55bf3a1118b0 2023-10-06T02:25:22.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f913282a000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf3a081de0 con 0x55bf3a050160 2023-10-06T02:25:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f912c266700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf3a111c80 0x55bf3a1262f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f912c266700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf3a111c80 0x55bf3a1262f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53542/0 (socket says 172.21.15.6:53542) 2023-10-06T02:25:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f912c266700 1 -- 172.21.15.6:0/1115143922 learned_addr learned my addr 172.21.15.6:0/1115143922 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f912ba65700 1 --2- 172.21.15.6:0/1115143922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55bf3a050160 0x55bf3a10c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f9123fff700 1 --2- 172.21.15.6:0/1115143922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf3a1118b0 0x55bf3a10ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f912c266700 1 -- 172.21.15.6:0/1115143922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55bf3a050160 msgr2=0x55bf3a10c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f912c266700 1 --2- 172.21.15.6:0/1115143922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55bf3a050160 0x55bf3a10c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f912c266700 1 -- 172.21.15.6:0/1115143922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf3a1118b0 msgr2=0x55bf3a10ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f912c266700 1 --2- 172.21.15.6:0/1115143922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf3a1118b0 0x55bf3a10ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f912c266700 1 -- 172.21.15.6:0/1115143922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9114005db0 con 0x55bf3a111c80 2023-10-06T02:25:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f912c266700 1 --2- 172.21.15.6:0/1115143922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf3a111c80 0x55bf3a1262f0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f912400c4c0 tx=0x7f9124007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79edf9f405b3e1d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:22.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f912aa63700 1 -- 172.21.15.6:0/1115143922 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91240115f0 con 0x55bf3a111c80 2023-10-06T02:25:22.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f912aa63700 1 -- 172.21.15.6:0/1115143922 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9124011750 con 0x55bf3a111c80 2023-10-06T02:25:22.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.892+0000 7f912aa63700 1 -- 172.21.15.6:0/1115143922 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124011b10 con 0x55bf3a111c80 2023-10-06T02:25:22.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.893+0000 7f913282a000 1 -- 172.21.15.6:0/1115143922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf3a111c80 msgr2=0x55bf3a1262f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:22.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.893+0000 7f913282a000 1 --2- 172.21.15.6:0/1115143922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf3a111c80 0x55bf3a1262f0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f912400c4c0 tx=0x7f9124007040 comp rx=0 tx=0).stop 2023-10-06T02:25:22.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.893+0000 7f913282a000 1 -- 172.21.15.6:0/1115143922 shutdown_connections 2023-10-06T02:25:22.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.893+0000 7f913282a000 1 --2- 172.21.15.6:0/1115143922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf3a111c80 0x55bf3a1262f0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:22.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.893+0000 7f913282a000 1 --2- 172.21.15.6:0/1115143922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55bf3a050160 0x55bf3a10c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:22.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.893+0000 7f913282a000 1 --2- 172.21.15.6:0/1115143922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf3a1118b0 0x55bf3a10ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:22.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.893+0000 7f913282a000 1 -- 172.21.15.6:0/1115143922 >> 172.21.15.6:0/1115143922 conn(0x55bf3a098bd0 msgr2=0x55bf3a097700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:22.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.893+0000 7f913282a000 1 -- 172.21.15.6:0/1115143922 shutdown_connections 2023-10-06T02:25:22.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.893+0000 7f913282a000 1 -- 172.21.15.6:0/1115143922 wait complete. 2023-10-06T02:25:22.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.893+0000 7f913282a000 1 Processor -- start 2023-10-06T02:25:22.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.894+0000 7f913282a000 1 -- start start 2023-10-06T02:25:22.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.894+0000 7f913282a000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55bf3a050160 0x55bf3a10c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:22.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.894+0000 7f913282a000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf3a1118b0 0x55bf3a10c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:22.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.894+0000 7f913282a000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf3a111c80 0x55bf3a13bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:22.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.894+0000 7f913282a000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf3a10f7c0 con 0x55bf3a1118b0 2023-10-06T02:25:22.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.894+0000 7f913282a000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf3a10cf90 con 0x55bf3a111c80 2023-10-06T02:25:22.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.894+0000 7f913282a000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf3a10a6e0 con 0x55bf3a050160 2023-10-06T02:25:22.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.894+0000 7f9123fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf3a1118b0 0x55bf3a10c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.894+0000 7f9123fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf3a1118b0 0x55bf3a10c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53556/0 (socket says 172.21.15.6:53556) 2023-10-06T02:25:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.894+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 learned_addr learned my addr 172.21.15.6:0/402450790 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.894+0000 7f912ba65700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55bf3a050160 0x55bf3a10c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.895+0000 7f912c266700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf3a111c80 0x55bf3a13bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.895+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55bf3a050160 msgr2=0x55bf3a10c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.895+0000 7f9123fff700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55bf3a050160 0x55bf3a10c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.895+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf3a111c80 msgr2=0x55bf3a13bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.895+0000 7f9123fff700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf3a111c80 0x55bf3a13bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.895+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912400d040 con 0x55bf3a1118b0 2023-10-06T02:25:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.895+0000 7f912c266700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf3a111c80 0x55bf3a13bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.895+0000 7f9123fff700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf3a1118b0 0x55bf3a10c660 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f911400c010 tx=0x7f9114016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.895+0000 7f9129260700 1 -- 172.21.15.6:0/402450790 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9114012b10 con 0x55bf3a1118b0 2023-10-06T02:25:22.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.895+0000 7f9129260700 1 -- 172.21.15.6:0/402450790 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114021070 con 0x55bf3a1118b0 2023-10-06T02:25:22.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.895+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bf39fc51c0 con 0x55bf3a1118b0 2023-10-06T02:25:22.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.895+0000 7f9129260700 1 -- 172.21.15.6:0/402450790 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9114028480 con 0x55bf3a1118b0 2023-10-06T02:25:22.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.895+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf39fab3d0 con 0x55bf3a1118b0 2023-10-06T02:25:22.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.896+0000 7f9129260700 1 -- 172.21.15.6:0/402450790 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9114028870 con 0x55bf3a1118b0 2023-10-06T02:25:22.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.897+0000 7f9129260700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f910c0658c0 0x7f910c067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:22.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.897+0000 7f9129260700 1 -- 172.21.15.6:0/402450790 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6636+0+0 (secure 0 0 0) 0x7f9114023070 con 0x55bf3a1118b0 2023-10-06T02:25:22.901 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:25:22.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.897+0000 7f912ba65700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f910c0658c0 0x7f910c067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:22.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.897+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55bf3a055e10 0x55bf3a10fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:22.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.897+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a110130 con 0x55bf3a055e10 2023-10-06T02:25:22.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.897+0000 7f912c266700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55bf3a055e10 0x55bf3a10fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:22.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.898+0000 7f912c266700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55bf3a055e10 0x55bf3a10fbf0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:22.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.898+0000 7f912ba65700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f910c0658c0 0x7f910c067d70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f911c005fd0 tx=0x7f911c005c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:22.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.899+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v98'73 uv48 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.899+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a110510 con 0x55bf3a055e10 2023-10-06T02:25:22.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.900+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v98'74 uv74 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.900+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1108f0 con 0x55bf3a055e10 2023-10-06T02:25:22.904 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:25:22.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.902+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v98'75 uv75 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.902+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a110ca0 con 0x55bf3a055e10 2023-10-06T02:25:22.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.903+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v98'76 uv76 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.903+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a146130 con 0x55bf3a055e10 2023-10-06T02:25:22.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.904+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v98'77 uv77 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.904+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a145120 con 0x55bf3a055e10 2023-10-06T02:25:22.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.905+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v98'78 uv78 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.905+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a145520 con 0x55bf3a055e10 2023-10-06T02:25:22.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.908+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v98'79 uv54 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.908+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1458d0 con 0x55bf3a055e10 2023-10-06T02:25:22.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.911+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v98'80 uv80 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.911+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1458d0 con 0x55bf3a055e10 2023-10-06T02:25:22.912 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:25:22.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.912+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v98'81 uv81 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.912+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1458d0 con 0x55bf3a055e10 2023-10-06T02:25:22.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.915+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v98'82 uv82 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.915+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1458d0 con 0x55bf3a055e10 2023-10-06T02:25:22.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.917+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v98'83 uv83 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.917+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1458d0 con 0x55bf3a055e10 2023-10-06T02:25:22.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.919+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v98'84 uv84 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.919+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1458d0 con 0x55bf3a055e10 2023-10-06T02:25:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.921+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v98'85 uv59 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.921+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1458d0 con 0x55bf3a055e10 2023-10-06T02:25:22.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.924+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v98'86 uv86 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.924+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1458d0 con 0x55bf3a055e10 2023-10-06T02:25:22.928 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:25:22.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.928+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v98'87 uv87 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.928+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1458d0 con 0x55bf3a055e10 2023-10-06T02:25:22.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.929+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v98'88 uv88 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.929+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1458d0 con 0x55bf3a055e10 2023-10-06T02:25:22.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.932+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v98'89 uv89 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.932+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1458d0 con 0x55bf3a055e10 2023-10-06T02:25:22.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.933+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v98'90 uv90 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.933+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a145b40 con 0x55bf3a055e10 2023-10-06T02:25:22.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.937+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v98'91 uv91 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.937+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a145b40 con 0x55bf3a055e10 2023-10-06T02:25:22.939 INFO:teuthology.orchestra.run.smithi006.stdout:Write #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:25:22.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.939+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v98'92 uv92 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.939+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a145b40 con 0x55bf3a055e10 2023-10-06T02:25:22.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.940+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [setxattr (30)] v98'93 uv93 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.940+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a145b40 con 0x55bf3a055e10 2023-10-06T02:25:22.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.943+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [setxattr (62)] v98'94 uv94 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.943+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a145b40 con 0x55bf3a055e10 2023-10-06T02:25:22.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.944+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [omap-set-header] v98'95 uv95 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.944+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a145b40 con 0x55bf3a055e10 2023-10-06T02:25:22.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.945+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 603.00000000 [create] v98'96 uv71 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.945+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a145b40 con 0x55bf3a055e10 2023-10-06T02:25:22.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.946+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 603.00000000 [delete] v98'97 uv97 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.947+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a145b40 con 0x55bf3a055e10 2023-10-06T02:25:22.948 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:25:22.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.948+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v98'98 uv98 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.948+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a145b40 con 0x55bf3a055e10 2023-10-06T02:25:22.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.949+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [setxattr (30)] v98'99 uv99 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.949+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a145b40 con 0x55bf3a055e10 2023-10-06T02:25:22.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.950+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [setxattr (62)] v98'100 uv100 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.950+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a145b40 con 0x55bf3a055e10 2023-10-06T02:25:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.951+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [omap-set-header] v98'101 uv101 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a055e10 2023-10-06T02:25:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.951+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55bf3a1469f0 0x55bf3a148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.951+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:30 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a145b40 con 0x55bf3a1469f0 2023-10-06T02:25:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.951+0000 7f912ba65700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55bf3a1469f0 0x55bf3a148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.952+0000 7f912ba65700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55bf3a1469f0 0x55bf3a148dd0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.953+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(30 1.00000000.inode [create] v98'65 uv47 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.953+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:31 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a149310 con 0x55bf3a1469f0 2023-10-06T02:25:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.954+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(31 1.00000000.inode [delete] v98'66 uv66 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.954+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a149780 con 0x55bf3a1469f0 2023-10-06T02:25:22.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.957+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(32 1.00000000.inode [create] v98'67 uv67 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.957 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:25:22.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.957+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14a090 con 0x55bf3a1469f0 2023-10-06T02:25:22.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.959+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(33 1.00000000.inode [write 0~554] v98'68 uv68 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.959+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a149c20 con 0x55bf3a1469f0 2023-10-06T02:25:22.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.960+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(34 1.00000000.inode [omap-set-header] v98'69 uv69 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.960+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14a930 con 0x55bf3a1469f0 2023-10-06T02:25:22.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.963+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(35 200.00000000 [create] v98'70 uv52 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.963+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14ace0 con 0x55bf3a1469f0 2023-10-06T02:25:22.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.966+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(36 200.00000000 [delete] v98'71 uv71 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.966+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14b090 con 0x55bf3a1469f0 2023-10-06T02:25:22.971 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:25:22.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.968+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(37 200.00000000 [create] v98'72 uv72 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.968+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14b090 con 0x55bf3a1469f0 2023-10-06T02:25:22.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.971+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(38 200.00000000 [write 0~90] v98'73 uv73 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.971+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14b4e0 con 0x55bf3a1469f0 2023-10-06T02:25:22.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.973+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(39 200.00000000 [omap-set-header] v98'74 uv74 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.973+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14b4e0 con 0x55bf3a1469f0 2023-10-06T02:25:22.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.974+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(40 200.00000001 [create] v98'75 uv57 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.975+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14b160 con 0x55bf3a1469f0 2023-10-06T02:25:22.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.976+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(41 200.00000001 [delete] v98'76 uv76 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.976+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14b160 con 0x55bf3a1469f0 2023-10-06T02:25:22.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.977+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(42 200.00000001 [create] v98'77 uv77 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.977 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:25:22.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.977+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14e830 con 0x55bf3a1469f0 2023-10-06T02:25:22.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.978+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(43 200.00000001 [write 0~14075] v98'78 uv78 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.978+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14a4c0 con 0x55bf3a1469f0 2023-10-06T02:25:22.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.980+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(44 200.00000001 [omap-set-header] v98'79 uv79 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.980+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14a4c0 con 0x55bf3a1469f0 2023-10-06T02:25:22.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.981+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(45 606.00000000 [create] v98'80 uv63 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.981+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14a440 con 0x55bf3a1469f0 2023-10-06T02:25:22.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.982+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(46 606.00000000 [delete] v98'81 uv81 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.982+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14a440 con 0x55bf3a1469f0 2023-10-06T02:25:22.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.983+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(47 606.00000000 [create] v98'82 uv82 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.984 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:25:22.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.983+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14a440 con 0x55bf3a1469f0 2023-10-06T02:25:22.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.984+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(48 606.00000000 [setxattr (30)] v98'83 uv83 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.984+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14a440 con 0x55bf3a1469f0 2023-10-06T02:25:22.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.986+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(49 606.00000000 [setxattr (62)] v98'84 uv84 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.986+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14a440 con 0x55bf3a1469f0 2023-10-06T02:25:22.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.987+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(50 606.00000000 [omap-set-header] v98'85 uv85 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.987+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55bf3a14ba90 0x55bf3a14de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:22.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.987+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:51 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14e3b0 con 0x55bf3a14ba90 2023-10-06T02:25:22.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.987+0000 7f9123fff700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55bf3a14ba90 0x55bf3a14de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:22.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.987+0000 7f9123fff700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55bf3a14ba90 0x55bf3a14de70 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:22.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.988+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(51 607.00000000 [create] v98'15 uv14 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:22.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.988+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:52 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14e760 con 0x55bf3a14ba90 2023-10-06T02:25:22.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.989+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(52 607.00000000 [delete] v98'16 uv16 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:22.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.989+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14eb10 con 0x55bf3a14ba90 2023-10-06T02:25:22.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.990+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(53 607.00000000 [create] v98'17 uv17 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:22.991 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:25:22.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.990+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14b1d0 con 0x55bf3a14ba90 2023-10-06T02:25:22.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.991+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(54 607.00000000 [setxattr (30)] v98'18 uv18 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:22.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.991+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a150570 con 0x55bf3a14ba90 2023-10-06T02:25:22.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.992+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(55 607.00000000 [setxattr (62)] v98'19 uv19 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:22.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.992+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14f480 con 0x55bf3a14ba90 2023-10-06T02:25:22.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.993+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(56 607.00000000 [omap-set-header] v98'20 uv20 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:22.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.993+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14f8a0 con 0x55bf3a14ba90 2023-10-06T02:25:22.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.994+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(57 mds0_openfiles.0 [create] v98'12 uv11 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:22.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.994+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14f8a0 con 0x55bf3a14ba90 2023-10-06T02:25:22.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.995+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(58 mds0_openfiles.0 [delete] v98'13 uv13 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:22.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.995+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14f8a0 con 0x55bf3a14ba90 2023-10-06T02:25:22.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.996+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(59 mds0_openfiles.0 [create] v98'14 uv14 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:22.996 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:25:22.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.996+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14fd70 con 0x55bf3a14ba90 2023-10-06T02:25:22.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.997+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(60 mds0_openfiles.0 [omap-set-header] v98'15 uv15 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:22.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.997+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:61 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14fd70 con 0x55bf3a1469f0 2023-10-06T02:25:22.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.998+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(61 608.00000000 [create] v98'15 uv14 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.998+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:62 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14fd70 con 0x55bf3a1469f0 2023-10-06T02:25:22.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.999+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(62 608.00000000 [delete] v98'16 uv16 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:22.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:22.999+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14fd70 con 0x55bf3a1469f0 2023-10-06T02:25:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.000+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(63 608.00000000 [create] v98'17 uv17 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:23.000 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:25:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.000+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14fd70 con 0x55bf3a1469f0 2023-10-06T02:25:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.001+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(64 608.00000000 [setxattr (30)] v98'18 uv18 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.001+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14fd70 con 0x55bf3a1469f0 2023-10-06T02:25:23.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.002+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(65 608.00000000 [setxattr (62)] v98'19 uv19 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:23.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.002+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a14fd70 con 0x55bf3a1469f0 2023-10-06T02:25:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.003+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(66 608.00000000 [omap-set-header] v98'20 uv20 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a1469f0 2023-10-06T02:25:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.003+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55bf3a14f8a0 0x55bf3a152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.003+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:67 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1533d0 con 0x55bf3a14f8a0 2023-10-06T02:25:23.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.003+0000 7f912c266700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55bf3a14f8a0 0x55bf3a152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.003+0000 7f912c266700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55bf3a14f8a0 0x55bf3a152e90 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:23.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.004+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(67 604.00000000 [create] v98'26 uv20 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a14f8a0 2023-10-06T02:25:23.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.005+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:68 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1533d0 con 0x55bf3a14f8a0 2023-10-06T02:25:23.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.006+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(68 604.00000000 [delete] v98'27 uv27 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a14f8a0 2023-10-06T02:25:23.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.006+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1533d0 con 0x55bf3a14f8a0 2023-10-06T02:25:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.007+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(69 604.00000000 [create] v98'28 uv28 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a14f8a0 2023-10-06T02:25:23.007 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:25:23.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.007+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1543e0 con 0x55bf3a14f8a0 2023-10-06T02:25:23.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.008+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(70 604.00000000 [setxattr (30)] v98'29 uv29 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a14f8a0 2023-10-06T02:25:23.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.008+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1543e0 con 0x55bf3a14f8a0 2023-10-06T02:25:23.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.009+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(71 604.00000000 [setxattr (62)] v98'30 uv30 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a14f8a0 2023-10-06T02:25:23.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.009+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1533d0 con 0x55bf3a14f8a0 2023-10-06T02:25:23.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.010+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(72 604.00000000 [omap-set-header] v98'31 uv31 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a14f8a0 2023-10-06T02:25:23.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.010+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1533d0 con 0x55bf3a14f8a0 2023-10-06T02:25:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.011+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(73 500.00000000 [create] v98'32 uv25 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a14f8a0 2023-10-06T02:25:23.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.011+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1533d0 con 0x55bf3a14f8a0 2023-10-06T02:25:23.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.012+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(74 500.00000000 [delete] v98'33 uv33 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a14f8a0 2023-10-06T02:25:23.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.012+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1533d0 con 0x55bf3a14f8a0 2023-10-06T02:25:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.013+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(75 500.00000000 [create] v98'34 uv34 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a14f8a0 2023-10-06T02:25:23.014 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:25:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.014+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1533d0 con 0x55bf3a14f8a0 2023-10-06T02:25:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.015+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(76 500.00000000 [write 0~90] v98'35 uv35 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a14f8a0 2023-10-06T02:25:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.015+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1533d0 con 0x55bf3a14f8a0 2023-10-06T02:25:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.016+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(77 500.00000000 [omap-set-header] v98'36 uv36 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a14f8a0 2023-10-06T02:25:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.016+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55bf3a153a50 0x55bf3a155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.016+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:78 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a156580 con 0x55bf3a153a50 2023-10-06T02:25:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.016+0000 7f912ba65700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55bf3a153a50 0x55bf3a155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.016+0000 7f912ba65700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55bf3a153a50 0x55bf3a155e30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:23.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.017+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(78 mds_snaptable [create] v98'12 uv11 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a153a50 2023-10-06T02:25:23.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.017+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:79 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a156580 con 0x55bf3a153a50 2023-10-06T02:25:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.021+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(79 mds_snaptable [delete] v98'13 uv13 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f911c007ce0 con 0x55bf3a153a50 2023-10-06T02:25:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.021+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a156580 con 0x55bf3a153a50 2023-10-06T02:25:23.022 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:25:23.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.022+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(80 mds_snaptable [create] v98'14 uv14 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f911c02c040 con 0x55bf3a153a50 2023-10-06T02:25:23.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.022+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a156a30 con 0x55bf3a153a50 2023-10-06T02:25:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.024+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(81 mds_snaptable [write 0~70] v98'15 uv15 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f911c02c040 con 0x55bf3a153a50 2023-10-06T02:25:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.024+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a156a30 con 0x55bf3a153a50 2023-10-06T02:25:23.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.027+0000 7f912ba65700 1 -- 172.21.15.6:0/402450790 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v98'16 uv16 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f911c02c040 con 0x55bf3a153a50 2023-10-06T02:25:23.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.027+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:83 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a156a30 con 0x55bf3a14ba90 2023-10-06T02:25:23.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.028+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(83 605.00000000 [create] v98'15 uv14 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.028+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:84 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a156a30 con 0x55bf3a14ba90 2023-10-06T02:25:23.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.029+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(84 605.00000000 [delete] v98'16 uv16 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.029+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a156a30 con 0x55bf3a14ba90 2023-10-06T02:25:23.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.030+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(85 605.00000000 [create] v98'17 uv17 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.030 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:25:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.030+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a157a40 con 0x55bf3a14ba90 2023-10-06T02:25:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.031+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v98'18 uv18 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.031+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a157a40 con 0x55bf3a14ba90 2023-10-06T02:25:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.032+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v98'19 uv19 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.032+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a156a30 con 0x55bf3a14ba90 2023-10-06T02:25:23.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.033+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(88 605.00000000 [omap-set-header] v98'20 uv20 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.033+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55bf3a1570b0 0x55bf3a159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.033+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:89 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a1599d0 con 0x55bf3a1570b0 2023-10-06T02:25:23.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.033+0000 7f9123fff700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55bf3a1570b0 0x55bf3a159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.034+0000 7f9123fff700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55bf3a1570b0 0x55bf3a159490 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:23.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.035+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(89 mds0_inotable [create] v98'24 uv18 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a1570b0 2023-10-06T02:25:23.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.035+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:90 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159a90 con 0x55bf3a1570b0 2023-10-06T02:25:23.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.036+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(90 mds0_inotable [delete] v98'25 uv25 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a1570b0 2023-10-06T02:25:23.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.036+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159e90 con 0x55bf3a1570b0 2023-10-06T02:25:23.038 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:25:23.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.037+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(91 mds0_inotable [create] v98'26 uv26 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a1570b0 2023-10-06T02:25:23.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.037+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159e90 con 0x55bf3a1570b0 2023-10-06T02:25:23.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.038+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(92 mds0_inotable [write 0~34] v98'27 uv27 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a1570b0 2023-10-06T02:25:23.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.038+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159e90 con 0x55bf3a1570b0 2023-10-06T02:25:23.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.039+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v98'28 uv28 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a1570b0 2023-10-06T02:25:23.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.039+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159e90 con 0x55bf3a1570b0 2023-10-06T02:25:23.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.040+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(94 100.00000000 [create] v98'29 uv23 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a1570b0 2023-10-06T02:25:23.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.040+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159e90 con 0x55bf3a1570b0 2023-10-06T02:25:23.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.043+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(95 100.00000000 [delete] v98'30 uv30 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a1570b0 2023-10-06T02:25:23.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.043+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159e90 con 0x55bf3a1570b0 2023-10-06T02:25:23.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.046+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(96 100.00000000 [create] v98'31 uv31 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a1570b0 2023-10-06T02:25:23.046 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:25:23.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.046+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159e90 con 0x55bf3a1570b0 2023-10-06T02:25:23.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.051+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(97 100.00000000 [omap-set-header] v98'32 uv32 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a1570b0 2023-10-06T02:25:23.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.051+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a15cc00 con 0x55bf3a1570b0 2023-10-06T02:25:23.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.055+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v98'33 uv33 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a1570b0 2023-10-06T02:25:23.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.055+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:99 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a15a380 con 0x55bf3a14ba90 2023-10-06T02:25:23.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.056+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(99 mds0_sessionmap [create] v98'14 uv12 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.056+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:100 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a15a380 con 0x55bf3a14ba90 2023-10-06T02:25:23.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.059+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(100 mds0_sessionmap [delete] v98'15 uv15 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.059+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a15a380 con 0x55bf3a14ba90 2023-10-06T02:25:23.062 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:25:23.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.061+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(101 mds0_sessionmap [create] v98'16 uv16 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.062+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a15a380 con 0x55bf3a14ba90 2023-10-06T02:25:23.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.064+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v98'17 uv17 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.064+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55bf3a15a890 0x55bf3a15cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.064+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:103 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a15d1b0 con 0x55bf3a15a890 2023-10-06T02:25:23.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.064+0000 7f912c266700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55bf3a15a890 0x55bf3a15cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.065+0000 7f912c266700 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55bf3a15a890 0x55bf3a15cc70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:23.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.066+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(103 609.00000000 [create] v98'15 uv14 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a15a890 2023-10-06T02:25:23.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.066+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:104 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a15d1b0 con 0x55bf3a15a890 2023-10-06T02:25:23.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.069+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(104 609.00000000 [delete] v98'16 uv16 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a15a890 2023-10-06T02:25:23.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.069+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a15d1b0 con 0x55bf3a15a890 2023-10-06T02:25:23.071 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:25:23.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.071+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(105 609.00000000 [create] v98'17 uv17 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a15a890 2023-10-06T02:25:23.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.071+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a15e1c0 con 0x55bf3a15a890 2023-10-06T02:25:23.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.074+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v98'18 uv18 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a15a890 2023-10-06T02:25:23.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.074+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a15e1c0 con 0x55bf3a15a890 2023-10-06T02:25:23.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.077+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v98'19 uv19 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a15a890 2023-10-06T02:25:23.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.077+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a15d1b0 con 0x55bf3a15a890 2023-10-06T02:25:23.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.079+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(108 609.00000000 [omap-set-header] v98'20 uv20 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a15a890 2023-10-06T02:25:23.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.080+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:109 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a15d1b0 con 0x55bf3a14f8a0 2023-10-06T02:25:23.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.081+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(109 400.00000000 [create] v98'12 uv11 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a14f8a0 2023-10-06T02:25:23.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.081+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:110 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a15d1b0 con 0x55bf3a14f8a0 2023-10-06T02:25:23.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.083+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(110 400.00000000 [delete] v98'13 uv13 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a14f8a0 2023-10-06T02:25:23.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.083+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a15d1b0 con 0x55bf3a14f8a0 2023-10-06T02:25:23.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.083+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(111 400.00000000 [create] v98'14 uv14 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a14f8a0 2023-10-06T02:25:23.084 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:25:23.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.084+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a15d1b0 con 0x55bf3a14f8a0 2023-10-06T02:25:23.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.085+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(112 400.00000000 [write 0~22] v98'15 uv15 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a14f8a0 2023-10-06T02:25:23.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.085+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159f10 con 0x55bf3a14f8a0 2023-10-06T02:25:23.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.090+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(113 400.00000000 [omap-set-header] v98'16 uv16 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9124018020 con 0x55bf3a14f8a0 2023-10-06T02:25:23.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.090+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:114 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159f10 con 0x55bf3a14ba90 2023-10-06T02:25:23.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.091+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(114 100.00000000.inode [create] v98'33 uv24 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.091+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:115 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159f10 con 0x55bf3a14ba90 2023-10-06T02:25:23.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.092+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(115 100.00000000.inode [delete] v98'34 uv34 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.092+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159f10 con 0x55bf3a14ba90 2023-10-06T02:25:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.093+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(116 100.00000000.inode [create] v98'35 uv35 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.093 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:25:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.093+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159f10 con 0x55bf3a14ba90 2023-10-06T02:25:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.094+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(117 100.00000000.inode [write 0~554] v98'36 uv36 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.094+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159f10 con 0x55bf3a14ba90 2023-10-06T02:25:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.095+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v98'37 uv37 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.095+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159f10 con 0x55bf3a14ba90 2023-10-06T02:25:23.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.096+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(119 1.00000000 [create] v98'38 uv31 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.096+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159f10 con 0x55bf3a14ba90 2023-10-06T02:25:23.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.099+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(120 1.00000000 [delete] v98'39 uv39 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.099+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159f10 con 0x55bf3a14ba90 2023-10-06T02:25:23.100 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:25:23.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.100+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(121 1.00000000 [create] v98'40 uv40 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.100+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159f10 con 0x55bf3a14ba90 2023-10-06T02:25:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.101+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v98'41 uv41 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.101+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159f10 con 0x55bf3a14ba90 2023-10-06T02:25:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.102+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v98'42 uv42 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.102+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a159f10 con 0x55bf3a14ba90 2023-10-06T02:25:23.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.103+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(124 1.00000000 [omap-set-header] v98'43 uv43 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.103+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x55bf3a15d6a0 con 0x55bf3a14ba90 2023-10-06T02:25:23.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f9123fff700 1 -- 172.21.15.6:0/402450790 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v98'44 uv44 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9114054c30 con 0x55bf3a14ba90 2023-10-06T02:25:23.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55bf3a14ba90 msgr2=0x55bf3a14de70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55bf3a14ba90 0x55bf3a14de70 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55bf3a055e10 msgr2=0x55bf3a10fbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55bf3a055e10 0x55bf3a10fbf0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55bf3a1570b0 msgr2=0x55bf3a159490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55bf3a1570b0 0x55bf3a159490 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55bf3a1469f0 msgr2=0x55bf3a148dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55bf3a1469f0 0x55bf3a148dd0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55bf3a15a890 msgr2=0x55bf3a15cc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55bf3a15a890 0x55bf3a15cc70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55bf3a153a50 msgr2=0x55bf3a155e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55bf3a153a50 0x55bf3a155e30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55bf3a14f8a0 msgr2=0x55bf3a152e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 reap_dead start 2023-10-06T02:25:23.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55bf3a14f8a0 0x55bf3a152e90 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 reap_dead start 2023-10-06T02:25:23.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 reap_dead start 2023-10-06T02:25:23.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f912c266700 1 -- 172.21.15.6:0/402450790 reap_dead start 2023-10-06T02:25:23.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f910c0658c0 msgr2=0x7f910c067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f910c0658c0 0x7f910c067d70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f911c005fd0 tx=0x7f911c005c60 comp rx=0 tx=0).stop 2023-10-06T02:25:23.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf3a1118b0 msgr2=0x55bf3a10c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf3a1118b0 0x55bf3a10c660 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f911400c010 tx=0x7f9114016000 comp rx=0 tx=0).stop 2023-10-06T02:25:23.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 shutdown_connections 2023-10-06T02:25:23.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf3a1118b0 0x55bf3a10c660 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 --2- 172.21.15.6:0/402450790 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f910c0658c0 0x7f910c067d70 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 >> 172.21.15.6:0/402450790 conn(0x55bf3a098bd0 msgr2=0x55bf3a129300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:23.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 shutdown_connections 2023-10-06T02:25:23.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.104+0000 7f913282a000 1 -- 172.21.15.6:0/402450790 wait complete. 2023-10-06T02:25:23.109 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 1.00000000.inode 2023-10-06T02:25:23.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.186+0000 7fc29f167000 1 Processor -- start 2023-10-06T02:25:23.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.186+0000 7fc29f167000 1 -- start start 2023-10-06T02:25:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.187+0000 7fc29f167000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56407db5f710 0x56407dbfde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.187+0000 7fc29f167000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56407dc012f0 0x56407dc02570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.187+0000 7fc29f167000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56407dc016c0 0x56407db61610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.187+0000 7fc29f167000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56407da7e620 con 0x56407db5f710 2023-10-06T02:25:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.187+0000 7fc29f167000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56407da75400 con 0x56407dc016c0 2023-10-06T02:25:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.187+0000 7fc29f167000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56407dc03970 con 0x56407dc012f0 2023-10-06T02:25:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.187+0000 7fc2983a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56407db5f710 0x56407dbfde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.187+0000 7fc2983a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56407db5f710 0x56407dbfde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53574/0 (socket says 172.21.15.6:53574) 2023-10-06T02:25:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.187+0000 7fc2983a2700 1 -- 172.21.15.6:0/1731926238 learned_addr learned my addr 172.21.15.6:0/1731926238 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.187+0000 7fc297ba1700 1 --2- 172.21.15.6:0/1731926238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56407dc012f0 0x56407dc02570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.187+0000 7fc298ba3700 1 --2- 172.21.15.6:0/1731926238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56407dc016c0 0x56407db61610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.187+0000 7fc2983a2700 1 -- 172.21.15.6:0/1731926238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56407dc012f0 msgr2=0x56407dc02570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:23.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.187+0000 7fc2983a2700 1 --2- 172.21.15.6:0/1731926238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56407dc012f0 0x56407dc02570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.187+0000 7fc2983a2700 1 -- 172.21.15.6:0/1731926238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56407dc016c0 msgr2=0x56407db61610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:23.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.187+0000 7fc2983a2700 1 --2- 172.21.15.6:0/1731926238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56407dc016c0 0x56407db61610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.187+0000 7fc2983a2700 1 -- 172.21.15.6:0/1731926238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc290005db0 con 0x56407db5f710 2023-10-06T02:25:23.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.187+0000 7fc298ba3700 1 --2- 172.21.15.6:0/1731926238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56407dc016c0 0x56407db61610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:23.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.188+0000 7fc2983a2700 1 --2- 172.21.15.6:0/1731926238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56407db5f710 0x56407dbfde50 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fc29000a5a0 tx=0x7fc290013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cded5701fa24904c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:23.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.188+0000 7fc296b9f700 1 -- 172.21.15.6:0/1731926238 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290000c40 con 0x56407db5f710 2023-10-06T02:25:23.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.188+0000 7fc296b9f700 1 -- 172.21.15.6:0/1731926238 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc290008a50 con 0x56407db5f710 2023-10-06T02:25:23.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.188+0000 7fc296b9f700 1 -- 172.21.15.6:0/1731926238 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290008e10 con 0x56407db5f710 2023-10-06T02:25:23.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.188+0000 7fc29f167000 1 -- 172.21.15.6:0/1731926238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56407db5f710 msgr2=0x56407dbfde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.188+0000 7fc29f167000 1 --2- 172.21.15.6:0/1731926238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56407db5f710 0x56407dbfde50 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fc29000a5a0 tx=0x7fc290013000 comp rx=0 tx=0).stop 2023-10-06T02:25:23.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.188+0000 7fc29f167000 1 -- 172.21.15.6:0/1731926238 shutdown_connections 2023-10-06T02:25:23.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.188+0000 7fc29f167000 1 --2- 172.21.15.6:0/1731926238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56407dc016c0 0x56407db61610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.188+0000 7fc29f167000 1 --2- 172.21.15.6:0/1731926238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56407db5f710 0x56407dbfde50 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.188+0000 7fc29f167000 1 --2- 172.21.15.6:0/1731926238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56407dc012f0 0x56407dc02570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.188+0000 7fc29f167000 1 -- 172.21.15.6:0/1731926238 >> 172.21.15.6:0/1731926238 conn(0x56407db345d0 msgr2=0x56407db369b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:23.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.188+0000 7fc29f167000 1 -- 172.21.15.6:0/1731926238 shutdown_connections 2023-10-06T02:25:23.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.188+0000 7fc29f167000 1 -- 172.21.15.6:0/1731926238 wait complete. 2023-10-06T02:25:23.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.189+0000 7fc29f167000 1 Processor -- start 2023-10-06T02:25:23.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.189+0000 7fc29f167000 1 -- start start 2023-10-06T02:25:23.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc29f167000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56407db5f710 0x56407db36a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc29f167000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56407dc012f0 0x56407db35360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc29f167000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56407dc016c0 0x56407dbfaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc29f167000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56407db36f90 con 0x56407db5f710 2023-10-06T02:25:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc29f167000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56407db358a0 con 0x56407dc012f0 2023-10-06T02:25:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc29f167000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56407db35b30 con 0x56407dc016c0 2023-10-06T02:25:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc2983a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56407db5f710 0x56407db36a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc2983a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56407db5f710 0x56407db36a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53586/0 (socket says 172.21.15.6:53586) 2023-10-06T02:25:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc2983a2700 1 -- 172.21.15.6:0/3228843222 learned_addr learned my addr 172.21.15.6:0/3228843222 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc298ba3700 1 --2- 172.21.15.6:0/3228843222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56407dc016c0 0x56407dbfaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc297ba1700 1 --2- 172.21.15.6:0/3228843222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56407dc012f0 0x56407db35360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc2983a2700 1 -- 172.21.15.6:0/3228843222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56407dc016c0 msgr2=0x56407dbfaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc2983a2700 1 --2- 172.21.15.6:0/3228843222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56407dc016c0 0x56407dbfaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc2983a2700 1 -- 172.21.15.6:0/3228843222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56407dc012f0 msgr2=0x56407db35360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc2983a2700 1 --2- 172.21.15.6:0/3228843222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56407dc012f0 0x56407db35360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc2983a2700 1 -- 172.21.15.6:0/3228843222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56407da80750 con 0x56407db5f710 2023-10-06T02:25:23.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc2983a2700 1 --2- 172.21.15.6:0/3228843222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56407db5f710 0x56407db36a50 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fc29000a5a0 tx=0x7fc29001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:23.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc29539c700 1 -- 172.21.15.6:0/3228843222 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290013c70 con 0x56407db5f710 2023-10-06T02:25:23.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc29539c700 1 -- 172.21.15.6:0/3228843222 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc290013dd0 con 0x56407db5f710 2023-10-06T02:25:23.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc29f167000 1 -- 172.21.15.6:0/3228843222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56407daa71c0 con 0x56407db5f710 2023-10-06T02:25:23.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc29539c700 1 -- 172.21.15.6:0/3228843222 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29001c670 con 0x56407db5f710 2023-10-06T02:25:23.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.190+0000 7fc29f167000 1 -- 172.21.15.6:0/3228843222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56407da8d3d0 con 0x56407db5f710 2023-10-06T02:25:23.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.192+0000 7fc29539c700 1 -- 172.21.15.6:0/3228843222 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc29001ca20 con 0x56407db5f710 2023-10-06T02:25:23.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.192+0000 7fc29539c700 1 --2- 172.21.15.6:0/3228843222 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc2780658c0 0x7fc278067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.192+0000 7fc29539c700 1 -- 172.21.15.6:0/3228843222 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6636+0+0 (secure 0 0 0) 0x7fc2900866e0 con 0x56407db5f710 2023-10-06T02:25:23.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.192+0000 7fc29f167000 1 --2- 172.21.15.6:0/3228843222 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56407dc07ed0 0x56407dbe8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.192+0000 7fc29f167000 1 -- 172.21.15.6:0/3228843222 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e98) v8 -- 0x56407dbe92b0 con 0x56407dc07ed0 2023-10-06T02:25:23.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.192+0000 7fc297ba1700 1 --2- 172.21.15.6:0/3228843222 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc2780658c0 0x7fc278067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.193+0000 7fc298ba3700 1 --2- 172.21.15.6:0/3228843222 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56407dc07ed0 0x56407dbe8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.193+0000 7fc297ba1700 1 --2- 172.21.15.6:0/3228843222 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc2780658c0 0x7fc278067d70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc280009b00 tx=0x7fc280005d20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:23.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.193+0000 7fc298ba3700 1 --2- 172.21.15.6:0/3228843222 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56407dc07ed0 0x56407dbe8d70 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:23.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.194+0000 7fc298ba3700 1 -- 172.21.15.6:0/3228843222 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 1.00000000.inode [delete] v98'86 uv86 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fc2880028a0 con 0x56407dc07ed0 2023-10-06T02:25:23.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.194+0000 7fc29f167000 1 -- 172.21.15.6:0/3228843222 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56407dc07ed0 msgr2=0x56407dbe8d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.194+0000 7fc29f167000 1 --2- 172.21.15.6:0/3228843222 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56407dc07ed0 0x56407dbe8d70 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.194+0000 7fc29f167000 1 -- 172.21.15.6:0/3228843222 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc2780658c0 msgr2=0x7fc278067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.194+0000 7fc29f167000 1 --2- 172.21.15.6:0/3228843222 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc2780658c0 0x7fc278067d70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc280009b00 tx=0x7fc280005d20 comp rx=0 tx=0).stop 2023-10-06T02:25:23.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.194+0000 7fc29f167000 1 -- 172.21.15.6:0/3228843222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56407db5f710 msgr2=0x56407db36a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.194+0000 7fc29f167000 1 --2- 172.21.15.6:0/3228843222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56407db5f710 0x56407db36a50 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fc29000a5a0 tx=0x7fc29001c000 comp rx=0 tx=0).stop 2023-10-06T02:25:23.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.194+0000 7fc298ba3700 1 -- 172.21.15.6:0/3228843222 reap_dead start 2023-10-06T02:25:23.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.194+0000 7fc29f167000 1 -- 172.21.15.6:0/3228843222 shutdown_connections 2023-10-06T02:25:23.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.194+0000 7fc29f167000 1 -- 172.21.15.6:0/3228843222 >> 172.21.15.6:0/3228843222 conn(0x56407db345d0 msgr2=0x56407dc01ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:23.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.194+0000 7fc29f167000 1 -- 172.21.15.6:0/3228843222 shutdown_connections 2023-10-06T02:25:23.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.194+0000 7fc29f167000 1 -- 172.21.15.6:0/3228843222 wait complete. 2023-10-06T02:25:23.201 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:25:23.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.361+0000 7fd80969d700 1 Processor -- start 2023-10-06T02:25:23.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.361+0000 7fd80969d700 1 -- start start 2023-10-06T02:25:23.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.362+0000 7fd80969d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8040c3fd0 0x7fd8040c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.362+0000 7fd80969d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd8040cbcc0 0x7fd8040cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.362+0000 7fd80969d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8040c3b40 con 0x7fd8041574b0 2023-10-06T02:25:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.362+0000 7fd80969d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8040c4980 con 0x7fd8040c3fd0 2023-10-06T02:25:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.362+0000 7fd80969d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8040cc640 con 0x7fd8040cbcc0 2023-10-06T02:25:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.362+0000 7fd8027fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8040c3fd0 0x7fd8040c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.362+0000 7fd8027fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8040c3fd0 0x7fd8040c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53588/0 (socket says 172.21.15.6:53588) 2023-10-06T02:25:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.362+0000 7fd8027fc700 1 -- 172.21.15.6:0/1354724859 learned_addr learned my addr 172.21.15.6:0/1354724859 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.363+0000 7fd8037fe700 1 --2- 172.21.15.6:0/1354724859 >> v2:172.21.15.175:3300/0 conn(0x7fd8040cbcc0 0x7fd8040cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.363+0000 7fd8027fc700 1 -- 172.21.15.6:0/1354724859 >> v2:172.21.15.175:3300/0 conn(0x7fd8040cbcc0 msgr2=0x7fd8040cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.363+0000 7fd8027fc700 1 --2- 172.21.15.6:0/1354724859 >> v2:172.21.15.175:3300/0 conn(0x7fd8040cbcc0 0x7fd8040cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.363+0000 7fd8027fc700 1 -- 172.21.15.6:0/1354724859 >> v1:172.21.15.175:6789/0 conn(0x7fd8041574b0 legacy=0x7fd8040b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.363+0000 7fd8027fc700 1 -- 172.21.15.6:0/1354724859 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8040c2f30 con 0x7fd8040c3fd0 2023-10-06T02:25:23.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.363+0000 7fd8037fe700 1 --2- 172.21.15.6:0/1354724859 >> v2:172.21.15.175:3300/0 conn(0x7fd8040cbcc0 0x7fd8040cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:25:23.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.363+0000 7fd8027fc700 1 --2- 172.21.15.6:0/1354724859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8040c3fd0 0x7fd8040c4440 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fd804087570 tx=0x7fd7ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cefd492d71c73e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:23.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.363+0000 7fd801ffb700 1 -- 172.21.15.6:0/1354724859 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec009e70 con 0x7fd8040c3fd0 2023-10-06T02:25:23.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.363+0000 7fd801ffb700 1 -- 172.21.15.6:0/1354724859 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ec00b860 con 0x7fd8040c3fd0 2023-10-06T02:25:23.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.363+0000 7fd801ffb700 1 -- 172.21.15.6:0/1354724859 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec00bc00 con 0x7fd8040c3fd0 2023-10-06T02:25:23.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.364+0000 7fd80969d700 1 -- 172.21.15.6:0/1354724859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8040c3fd0 msgr2=0x7fd8040c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.364+0000 7fd80969d700 1 --2- 172.21.15.6:0/1354724859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8040c3fd0 0x7fd8040c4440 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fd804087570 tx=0x7fd7ec009250 comp rx=0 tx=0).stop 2023-10-06T02:25:23.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.364+0000 7fd80969d700 1 -- 172.21.15.6:0/1354724859 shutdown_connections 2023-10-06T02:25:23.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.364+0000 7fd80969d700 1 --2- 172.21.15.6:0/1354724859 >> v2:172.21.15.175:3300/0 conn(0x7fd8040cbcc0 0x7fd8040cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.364+0000 7fd80969d700 1 --2- 172.21.15.6:0/1354724859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8040c3fd0 0x7fd8040c4440 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.364+0000 7fd80969d700 1 -- 172.21.15.6:0/1354724859 >> 172.21.15.6:0/1354724859 conn(0x7fd804067910 msgr2=0x7fd8040ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:23.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.364+0000 7fd80969d700 1 -- 172.21.15.6:0/1354724859 shutdown_connections 2023-10-06T02:25:23.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.364+0000 7fd80969d700 1 -- 172.21.15.6:0/1354724859 wait complete. 2023-10-06T02:25:23.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.365+0000 7fd80969d700 1 Processor -- start 2023-10-06T02:25:23.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.365+0000 7fd80969d700 1 -- start start 2023-10-06T02:25:23.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd80969d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8040c3fd0 0x7fd8040b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd80969d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8040cbcc0 0x7fd8041517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd80969d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8041574b0 0x7fd804144680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd80969d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8040b2840 con 0x7fd8041574b0 2023-10-06T02:25:23.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd80969d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80416b150 con 0x7fd8040cbcc0 2023-10-06T02:25:23.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd80969d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80416b430 con 0x7fd8040c3fd0 2023-10-06T02:25:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd8037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8041574b0 0x7fd804144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd8037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8041574b0 0x7fd804144680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53590/0 (socket says 172.21.15.6:53590) 2023-10-06T02:25:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd8037fe700 1 -- 172.21.15.6:0/2178112645 learned_addr learned my addr 172.21.15.6:0/2178112645 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd802ffd700 1 --2- 172.21.15.6:0/2178112645 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8040c3fd0 0x7fd8040b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd8027fc700 1 --2- 172.21.15.6:0/2178112645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8040cbcc0 0x7fd8041517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd8037fe700 1 -- 172.21.15.6:0/2178112645 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8040c3fd0 msgr2=0x7fd8040b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd8037fe700 1 --2- 172.21.15.6:0/2178112645 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8040c3fd0 0x7fd8040b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd8037fe700 1 -- 172.21.15.6:0/2178112645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8040cbcc0 msgr2=0x7fd8041517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd8037fe700 1 --2- 172.21.15.6:0/2178112645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8040cbcc0 0x7fd8041517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd8037fe700 1 -- 172.21.15.6:0/2178112645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f4009420 con 0x7fd8041574b0 2023-10-06T02:25:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd8037fe700 1 --2- 172.21.15.6:0/2178112645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8041574b0 0x7fd804144680 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400ec80 tx=0x7fd7f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd7faffd700 1 -- 172.21.15.6:0/2178112645 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f400c850 con 0x7fd8041574b0 2023-10-06T02:25:23.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.366+0000 7fd7faffd700 1 -- 172.21.15.6:0/2178112645 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f400c9b0 con 0x7fd8041574b0 2023-10-06T02:25:23.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.367+0000 7fd7faffd700 1 -- 172.21.15.6:0/2178112645 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f400cd50 con 0x7fd8041574b0 2023-10-06T02:25:23.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.367+0000 7fd80969d700 1 -- 172.21.15.6:0/2178112645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ec0094f0 con 0x7fd8041574b0 2023-10-06T02:25:23.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.367+0000 7fd80969d700 1 -- 172.21.15.6:0/2178112645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80416b9f0 con 0x7fd8041574b0 2023-10-06T02:25:23.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.368+0000 7fd80969d700 1 -- 172.21.15.6:0/2178112645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80406e590 con 0x7fd8041574b0 2023-10-06T02:25:23.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.368+0000 7fd7faffd700 1 -- 172.21.15.6:0/2178112645 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd7f4013680 con 0x7fd8041574b0 2023-10-06T02:25:23.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.368+0000 7fd7faffd700 1 --2- 172.21.15.6:0/2178112645 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd7e4066f30 0x7fd7e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.369+0000 7fd7faffd700 1 -- 172.21.15.6:0/2178112645 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6636+0+0 (secure 0 0 0) 0x7fd7f4084900 con 0x7fd8041574b0 2023-10-06T02:25:23.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.369+0000 7fd802ffd700 1 --2- 172.21.15.6:0/2178112645 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd7e4066f30 0x7fd7e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.369+0000 7fd802ffd700 1 --2- 172.21.15.6:0/2178112645 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd7e4066f30 0x7fd7e40693e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c580 tx=0x7fd7fc001a80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:23.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.373+0000 7fd7faffd700 1 -- 172.21.15.6:0/2178112645 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7f40517d0 con 0x7fd8041574b0 2023-10-06T02:25:23.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.608+0000 7fd80969d700 1 -- 172.21.15.6:0/2178112645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fd8040c3210 con 0x7fd8041574b0 2023-10-06T02:25:23.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.842+0000 7fd7faffd700 1 -- 172.21.15.6:0/2178112645 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v107) v1 ==== 162+0+0 (secure 0 0 0) 0x7fd7f4054df0 con 0x7fd8041574b0 2023-10-06T02:25:23.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.844+0000 7fd80969d700 1 -- 172.21.15.6:0/2178112645 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd7e4066f30 msgr2=0x7fd7e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.844+0000 7fd80969d700 1 --2- 172.21.15.6:0/2178112645 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd7e4066f30 0x7fd7e40693e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c580 tx=0x7fd7fc001a80 comp rx=0 tx=0).stop 2023-10-06T02:25:23.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.844+0000 7fd80969d700 1 -- 172.21.15.6:0/2178112645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8041574b0 msgr2=0x7fd804144680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.844+0000 7fd80969d700 1 --2- 172.21.15.6:0/2178112645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8041574b0 0x7fd804144680 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400ec80 tx=0x7fd7f40091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.844+0000 7fd80969d700 1 -- 172.21.15.6:0/2178112645 shutdown_connections 2023-10-06T02:25:23.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.844+0000 7fd80969d700 1 --2- 172.21.15.6:0/2178112645 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd7e4066f30 0x7fd7e40693e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.844+0000 7fd80969d700 1 --2- 172.21.15.6:0/2178112645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8041574b0 0x7fd804144680 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.844+0000 7fd80969d700 1 --2- 172.21.15.6:0/2178112645 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8040c3fd0 0x7fd8040b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.844+0000 7fd80969d700 1 --2- 172.21.15.6:0/2178112645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8040cbcc0 0x7fd8041517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.844+0000 7fd80969d700 1 -- 172.21.15.6:0/2178112645 >> 172.21.15.6:0/2178112645 conn(0x7fd804067910 msgr2=0x7fd8040c9220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:23.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.844+0000 7fd80969d700 1 -- 172.21.15.6:0/2178112645 shutdown_connections 2023-10-06T02:25:23.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.844+0000 7fd80969d700 1 -- 172.21.15.6:0/2178112645 wait complete. 2023-10-06T02:25:23.846 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:25:23.852 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:25:23.852+0000 7f5a5c977700 -1 mds.0.cache.ino(0x1) No data while reading inode 0x1 2023-10-06T02:25:23.852 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:25:23.852+0000 7f5a5c977700 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2023-10-06T02:25:23.853 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:25:23.852+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:25:23.853 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:25:23.852+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:25:23.859 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:23.862 INFO:tasks.ceph.mds.a.smithi006.stderr: -15> 2023-10-06T02:25:23.852+0000 7f5a5c977700 -1 mds.0.cache.ino(0x1) No data while reading inode 0x1 2023-10-06T02:25:23.862 INFO:tasks.ceph.mds.a.smithi006.stderr: -13> 2023-10-06T02:25:23.852+0000 7f5a5c977700 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2023-10-06T02:25:23.881 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:25:23.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.981+0000 7f95d2d4d700 1 Processor -- start 2023-10-06T02:25:23.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.981+0000 7f95d2d4d700 1 -- start start 2023-10-06T02:25:23.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.981+0000 7f95d2d4d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f95cc0c78d0 0x7f95cc0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.981+0000 7f95d2d4d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f95cc0c7ca0 0x7f95cc0cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.981+0000 7f95d2d4d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95cc0ca3e0 con 0x7f95cc13f930 2023-10-06T02:25:23.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.981+0000 7f95d2d4d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95cc0c95c0 con 0x7f95cc0c7ca0 2023-10-06T02:25:23.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.981+0000 7f95d2d4d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95cc0c3140 con 0x7f95cc0c78d0 2023-10-06T02:25:23.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.982+0000 7f95cbfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f95cc0c7ca0 0x7f95cc0cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.982+0000 7f95cbfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f95cc0c7ca0 0x7f95cc0cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53610/0 (socket says 172.21.15.6:53610) 2023-10-06T02:25:23.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.982+0000 7f95cbfff700 1 -- 172.21.15.6:0/5720193 learned_addr learned my addr 172.21.15.6:0/5720193 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:23.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.982+0000 7f95d0ae9700 1 --2- 172.21.15.6:0/5720193 >> v2:172.21.15.175:3300/0 conn(0x7f95cc0c78d0 0x7f95cc0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.982+0000 7f95cbfff700 1 -- 172.21.15.6:0/5720193 >> v2:172.21.15.175:3300/0 conn(0x7f95cc0c78d0 msgr2=0x7f95cc0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:23.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.982+0000 7f95cbfff700 1 --2- 172.21.15.6:0/5720193 >> v2:172.21.15.175:3300/0 conn(0x7f95cc0c78d0 0x7f95cc0ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.982+0000 7f95cbfff700 1 -- 172.21.15.6:0/5720193 >> v1:172.21.15.175:6789/0 conn(0x7f95cc13f930 legacy=0x7f95cc15a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.982+0000 7f95cbfff700 1 -- 172.21.15.6:0/5720193 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc0c97d0 con 0x7f95cc0c7ca0 2023-10-06T02:25:23.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.982+0000 7f95d0ae9700 1 --2- 172.21.15.6:0/5720193 >> v2:172.21.15.175:3300/0 conn(0x7f95cc0c78d0 0x7f95cc0ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:23.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.982+0000 7f95cbfff700 1 --2- 172.21.15.6:0/5720193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc0c7ca0 0x7f95cc0cd510 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f95cc06ec90 tx=0x7f95bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c3aa043e9135e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:23.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.982+0000 7f95cb7fe700 1 -- 172.21.15.6:0/5720193 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc00b860 con 0x7f95cc0c7ca0 2023-10-06T02:25:23.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.982+0000 7f95cb7fe700 1 -- 172.21.15.6:0/5720193 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc00b9c0 con 0x7f95cc0c7ca0 2023-10-06T02:25:23.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.982+0000 7f95cb7fe700 1 -- 172.21.15.6:0/5720193 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc00bd60 con 0x7f95cc0c7ca0 2023-10-06T02:25:23.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.983+0000 7f95d2d4d700 1 -- 172.21.15.6:0/5720193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc0c7ca0 msgr2=0x7f95cc0cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.983+0000 7f95d2d4d700 1 --2- 172.21.15.6:0/5720193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc0c7ca0 0x7f95cc0cd510 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f95cc06ec90 tx=0x7f95bc009250 comp rx=0 tx=0).stop 2023-10-06T02:25:23.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.983+0000 7f95d2d4d700 1 -- 172.21.15.6:0/5720193 shutdown_connections 2023-10-06T02:25:23.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.983+0000 7f95d2d4d700 1 --2- 172.21.15.6:0/5720193 >> v2:172.21.15.175:3300/0 conn(0x7f95cc0c78d0 0x7f95cc0ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.983+0000 7f95d2d4d700 1 --2- 172.21.15.6:0/5720193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc0c7ca0 0x7f95cc0cd510 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.983+0000 7f95d2d4d700 1 -- 172.21.15.6:0/5720193 >> 172.21.15.6:0/5720193 conn(0x7f95cc069790 msgr2=0x7f95cc069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:23.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.983+0000 7f95d2d4d700 1 -- 172.21.15.6:0/5720193 shutdown_connections 2023-10-06T02:25:23.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.983+0000 7f95d2d4d700 1 -- 172.21.15.6:0/5720193 wait complete. 2023-10-06T02:25:23.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.984+0000 7f95d2d4d700 1 Processor -- start 2023-10-06T02:25:23.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.984+0000 7f95d2d4d700 1 -- start start 2023-10-06T02:25:23.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.985+0000 7f95d2d4d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95cc0c78d0 0x7f95cc0aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.985+0000 7f95d2d4d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95cc0c7ca0 0x7f95cc169d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.985+0000 7f95d2d4d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc13f930 0x7f95cc156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.985+0000 7f95d2d4d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc16b460 con 0x7f95cc13f930 2023-10-06T02:25:23.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.985+0000 7f95d2d4d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc0af1c0 con 0x7f95cc0c7ca0 2023-10-06T02:25:23.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.985+0000 7f95d2d4d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc16a830 con 0x7f95cc0c78d0 2023-10-06T02:25:23.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.985+0000 7f95d12ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc13f930 0x7f95cc156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.985+0000 7f95d12ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc13f930 0x7f95cc156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53614/0 (socket says 172.21.15.6:53614) 2023-10-06T02:25:23.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.985+0000 7f95d0ae9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95cc0c78d0 0x7f95cc0aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.985+0000 7f95d12ea700 1 -- 172.21.15.6:0/1543459973 learned_addr learned my addr 172.21.15.6:0/1543459973 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:23.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.985+0000 7f95cbfff700 1 --2- 172.21.15.6:0/1543459973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95cc0c7ca0 0x7f95cc169d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.985+0000 7f95d12ea700 1 -- 172.21.15.6:0/1543459973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95cc0c78d0 msgr2=0x7f95cc0aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.985+0000 7f95d12ea700 1 --2- 172.21.15.6:0/1543459973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95cc0c78d0 0x7f95cc0aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.985+0000 7f95d12ea700 1 -- 172.21.15.6:0/1543459973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95cc0c7ca0 msgr2=0x7f95cc169d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:23.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.985+0000 7f95d12ea700 1 --2- 172.21.15.6:0/1543459973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95cc0c7ca0 0x7f95cc169d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:23.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.985+0000 7f95d12ea700 1 -- 172.21.15.6:0/1543459973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc0094f0 con 0x7f95cc13f930 2023-10-06T02:25:23.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.985+0000 7f95d12ea700 1 --2- 172.21.15.6:0/1543459973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc13f930 0x7f95cc156380 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f95b400c560 tx=0x7f95b4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:23.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.986+0000 7f95c8ff9700 1 -- 172.21.15.6:0/1543459973 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4011590 con 0x7f95cc13f930 2023-10-06T02:25:23.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.986+0000 7f95c8ff9700 1 -- 172.21.15.6:0/1543459973 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b40116f0 con 0x7f95cc13f930 2023-10-06T02:25:23.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.986+0000 7f95c8ff9700 1 -- 172.21.15.6:0/1543459973 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4011ab0 con 0x7f95cc13f930 2023-10-06T02:25:23.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.986+0000 7f95d2d4d700 1 -- 172.21.15.6:0/1543459973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95cc16ab10 con 0x7f95cc13f930 2023-10-06T02:25:23.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.986+0000 7f95d2d4d700 1 -- 172.21.15.6:0/1543459973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95cc16adf0 con 0x7f95cc13f930 2023-10-06T02:25:23.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.987+0000 7f95d2d4d700 1 -- 172.21.15.6:0/1543459973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95cc16b5d0 con 0x7f95cc13f930 2023-10-06T02:25:23.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.987+0000 7f95c8ff9700 1 -- 172.21.15.6:0/1543459973 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95b401b3b0 con 0x7f95cc13f930 2023-10-06T02:25:23.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.987+0000 7f95c8ff9700 1 --2- 172.21.15.6:0/1543459973 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f95ac066f30 0x7f95ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:23.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.988+0000 7f95c8ff9700 1 -- 172.21.15.6:0/1543459973 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6722+0+0 (secure 0 0 0) 0x7f95b4083cf0 con 0x7f95cc13f930 2023-10-06T02:25:23.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.988+0000 7f95d0ae9700 1 --2- 172.21.15.6:0/1543459973 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f95ac066f30 0x7f95ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:23.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.988+0000 7f95d0ae9700 1 --2- 172.21.15.6:0/1543459973 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f95ac066f30 0x7f95ac0693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0c6d40 tx=0x7f95c4009930 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:23.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:23.992+0000 7f95c8ff9700 1 -- 172.21.15.6:0/1543459973 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95b4088070 con 0x7f95cc13f930 2023-10-06T02:25:24.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.228+0000 7f95d2d4d700 1 -- 172.21.15.6:0/1543459973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95cc0cdf60 con 0x7f95cc13f930 2023-10-06T02:25:24.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.228+0000 7f95c8ff9700 1 -- 172.21.15.6:0/1543459973 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+3839 (secure 0 0 0) 0x7f95b4017070 con 0x7f95cc13f930 2023-10-06T02:25:24.229 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:24.229 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":109,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:23.853457+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.230+0000 7f95d2d4d700 1 -- 172.21.15.6:0/1543459973 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f95ac066f30 msgr2=0x7f95ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.230+0000 7f95d2d4d700 1 --2- 172.21.15.6:0/1543459973 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f95ac066f30 0x7f95ac0693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0c6d40 tx=0x7f95c4009930 comp rx=0 tx=0).stop 2023-10-06T02:25:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.230+0000 7f95d2d4d700 1 -- 172.21.15.6:0/1543459973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc13f930 msgr2=0x7f95cc156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.230+0000 7f95d2d4d700 1 --2- 172.21.15.6:0/1543459973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc13f930 0x7f95cc156380 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f95b400c560 tx=0x7f95b4007ef0 comp rx=0 tx=0).stop 2023-10-06T02:25:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.230+0000 7f95d2d4d700 1 -- 172.21.15.6:0/1543459973 shutdown_connections 2023-10-06T02:25:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.230+0000 7f95d2d4d700 1 --2- 172.21.15.6:0/1543459973 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f95ac066f30 0x7f95ac0693e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.230+0000 7f95d2d4d700 1 --2- 172.21.15.6:0/1543459973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc13f930 0x7f95cc156380 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.230+0000 7f95d2d4d700 1 --2- 172.21.15.6:0/1543459973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95cc0c78d0 0x7f95cc0aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.230+0000 7f95d2d4d700 1 --2- 172.21.15.6:0/1543459973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95cc0c7ca0 0x7f95cc169d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.230+0000 7f95d2d4d700 1 -- 172.21.15.6:0/1543459973 >> 172.21.15.6:0/1543459973 conn(0x7f95cc069790 msgr2=0x7f95cc0caf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.231+0000 7f95d2d4d700 1 -- 172.21.15.6:0/1543459973 shutdown_connections 2023-10-06T02:25:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.231+0000 7f95d2d4d700 1 -- 172.21.15.6:0/1543459973 wait complete. 2023-10-06T02:25:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 109 2023-10-06T02:25:24.243 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:25:24.243 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:24.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.402+0000 7ff02a1b0700 1 Processor -- start 2023-10-06T02:25:24.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.402+0000 7ff02a1b0700 1 -- start start 2023-10-06T02:25:24.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.402+0000 7ff02a1b0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0240b3c50 0x7ff02415b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:24.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.402+0000 7ff02a1b0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff02415bcd0 0x7ff02415a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:24.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.402+0000 7ff02a1b0700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0240afb90 con 0x7ff02415b3c0 2023-10-06T02:25:24.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.402+0000 7ff02a1b0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0240b2310 con 0x7ff02415bcd0 2023-10-06T02:25:24.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.402+0000 7ff02a1b0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240b25f0 con 0x7ff0240b3c50 2023-10-06T02:25:24.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.403+0000 7ff023fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff02415bcd0 0x7ff02415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:24.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.403+0000 7ff023fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff02415bcd0 0x7ff02415a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53630/0 (socket says 172.21.15.6:53630) 2023-10-06T02:25:24.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.403+0000 7ff023fff700 1 -- 172.21.15.6:0/2327737649 learned_addr learned my addr 172.21.15.6:0/2327737649 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:24.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.403+0000 7ff022ffd700 1 --2- 172.21.15.6:0/2327737649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0240b3c50 0x7ff02415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:24.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.403+0000 7ff023fff700 1 -- 172.21.15.6:0/2327737649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0240b3c50 msgr2=0x7ff02415b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:24.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.403+0000 7ff023fff700 1 --2- 172.21.15.6:0/2327737649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0240b3c50 0x7ff02415b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:24.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.403+0000 7ff023fff700 1 -- 172.21.15.6:0/2327737649 >> v1:172.21.15.175:6789/0 conn(0x7ff02415b3c0 legacy=0x7ff024097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:24.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.403+0000 7ff023fff700 1 -- 172.21.15.6:0/2327737649 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0240af820 con 0x7ff02415bcd0 2023-10-06T02:25:24.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.403+0000 7ff022ffd700 1 --2- 172.21.15.6:0/2327737649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0240b3c50 0x7ff02415b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:24.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.403+0000 7ff023fff700 1 --2- 172.21.15.6:0/2327737649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff02415bcd0 0x7ff02415a590 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009f20 tx=0x7ff01c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331272aa34031c79 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:24.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.403+0000 7ff0227fc700 1 -- 172.21.15.6:0/2327737649 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c00e070 con 0x7ff02415bcd0 2023-10-06T02:25:24.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.403+0000 7ff0227fc700 1 -- 172.21.15.6:0/2327737649 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c00ba80 con 0x7ff02415bcd0 2023-10-06T02:25:24.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.403+0000 7ff0227fc700 1 -- 172.21.15.6:0/2327737649 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c0092e0 con 0x7ff02415bcd0 2023-10-06T02:25:24.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.404+0000 7ff02a1b0700 1 -- 172.21.15.6:0/2327737649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff02415bcd0 msgr2=0x7ff02415a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:24.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.404+0000 7ff02a1b0700 1 --2- 172.21.15.6:0/2327737649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff02415bcd0 0x7ff02415a590 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009f20 tx=0x7ff01c009840 comp rx=0 tx=0).stop 2023-10-06T02:25:24.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.404+0000 7ff02a1b0700 1 -- 172.21.15.6:0/2327737649 shutdown_connections 2023-10-06T02:25:24.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.404+0000 7ff02a1b0700 1 --2- 172.21.15.6:0/2327737649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff02415bcd0 0x7ff02415a590 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:24.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.404+0000 7ff02a1b0700 1 --2- 172.21.15.6:0/2327737649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0240b3c50 0x7ff02415b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:24.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.404+0000 7ff02a1b0700 1 -- 172.21.15.6:0/2327737649 >> 172.21.15.6:0/2327737649 conn(0x7ff024067910 msgr2=0x7ff0240ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:24.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.404+0000 7ff02a1b0700 1 -- 172.21.15.6:0/2327737649 shutdown_connections 2023-10-06T02:25:24.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.404+0000 7ff02a1b0700 1 -- 172.21.15.6:0/2327737649 wait complete. 2023-10-06T02:25:24.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.405+0000 7ff02a1b0700 1 Processor -- start 2023-10-06T02:25:24.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.405+0000 7ff02a1b0700 1 -- start start 2023-10-06T02:25:24.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff02a1b0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0240b3c50 0x7ff0240c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:24.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff02a1b0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff02415b3c0 0x7ff024155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:24.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff02a1b0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff02415bcd0 0x7ff024156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:24.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff02a1b0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff024156530 con 0x7ff02415b3c0 2023-10-06T02:25:24.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff02a1b0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240a9a80 con 0x7ff0240b3c50 2023-10-06T02:25:24.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff02a1b0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240aecd0 con 0x7ff02415bcd0 2023-10-06T02:25:24.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff022ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff02415b3c0 0x7ff024155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:24.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff022ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff02415b3c0 0x7ff024155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53642/0 (socket says 172.21.15.6:53642) 2023-10-06T02:25:24.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff022ffd700 1 -- 172.21.15.6:0/3703383301 learned_addr learned my addr 172.21.15.6:0/3703383301 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:24.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff0237fe700 1 --2- 172.21.15.6:0/3703383301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0240b3c50 0x7ff0240c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:24.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff023fff700 1 --2- 172.21.15.6:0/3703383301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff02415bcd0 0x7ff024156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:24.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff022ffd700 1 -- 172.21.15.6:0/3703383301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff02415bcd0 msgr2=0x7ff024156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:24.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff022ffd700 1 --2- 172.21.15.6:0/3703383301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff02415bcd0 0x7ff024156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:24.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff022ffd700 1 -- 172.21.15.6:0/3703383301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0240b3c50 msgr2=0x7ff0240c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:24.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff022ffd700 1 --2- 172.21.15.6:0/3703383301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0240b3c50 0x7ff0240c2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:24.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff022ffd700 1 -- 172.21.15.6:0/3703383301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c009ae0 con 0x7ff02415b3c0 2023-10-06T02:25:24.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff0237fe700 1 --2- 172.21.15.6:0/3703383301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0240b3c50 0x7ff0240c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:24.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.406+0000 7ff022ffd700 1 --2- 172.21.15.6:0/3703383301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff02415b3c0 0x7ff024155ff0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7ff01800d860 tx=0x7ff018008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:24.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.407+0000 7ff00b7fe700 1 -- 172.21.15.6:0/3703383301 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0180125f0 con 0x7ff02415b3c0 2023-10-06T02:25:24.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.407+0000 7ff00b7fe700 1 -- 172.21.15.6:0/3703383301 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff018012750 con 0x7ff02415b3c0 2023-10-06T02:25:24.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.407+0000 7ff02a1b0700 1 -- 172.21.15.6:0/3703383301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0240aef70 con 0x7ff02415b3c0 2023-10-06T02:25:24.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.407+0000 7ff00b7fe700 1 -- 172.21.15.6:0/3703383301 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff018012ad0 con 0x7ff02415b3c0 2023-10-06T02:25:24.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.407+0000 7ff02a1b0700 1 -- 172.21.15.6:0/3703383301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff024156fd0 con 0x7ff02415b3c0 2023-10-06T02:25:24.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.408+0000 7ff02a1b0700 1 -- 172.21.15.6:0/3703383301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0240a9c30 con 0x7ff02415b3c0 2023-10-06T02:25:24.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.408+0000 7ff00b7fe700 1 -- 172.21.15.6:0/3703383301 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff018014430 con 0x7ff02415b3c0 2023-10-06T02:25:24.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.408+0000 7ff00b7fe700 1 --2- 172.21.15.6:0/3703383301 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff010066f30 0x7ff0100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:24.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.409+0000 7ff00b7fe700 1 -- 172.21.15.6:0/3703383301 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6722+0+0 (secure 0 0 0) 0x7ff018084d30 con 0x7ff02415b3c0 2023-10-06T02:25:24.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.409+0000 7ff0237fe700 1 --2- 172.21.15.6:0/3703383301 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff010066f30 0x7ff0100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:24.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.409+0000 7ff0237fe700 1 --2- 172.21.15.6:0/3703383301 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff010066f30 0x7ff0100693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff0240ac4c0 tx=0x7ff014009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:24.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.413+0000 7ff00b7fe700 1 -- 172.21.15.6:0/3703383301 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0240a9c30 con 0x7ff02415b3c0 2023-10-06T02:25:24.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.653+0000 7ff02a1b0700 1 -- 172.21.15.6:0/3703383301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0240a9bf0 con 0x7ff02415b3c0 2023-10-06T02:25:24.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.653+0000 7ff00b7fe700 1 -- 172.21.15.6:0/3703383301 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+3839 (secure 0 0 0) 0x7ff018055630 con 0x7ff02415b3c0 2023-10-06T02:25:24.654 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:24.654 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":109,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:23.853457+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:24.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.655+0000 7ff02a1b0700 1 -- 172.21.15.6:0/3703383301 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff010066f30 msgr2=0x7ff0100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:24.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.655+0000 7ff02a1b0700 1 --2- 172.21.15.6:0/3703383301 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff010066f30 0x7ff0100693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff0240ac4c0 tx=0x7ff014009040 comp rx=0 tx=0).stop 2023-10-06T02:25:24.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.655+0000 7ff02a1b0700 1 -- 172.21.15.6:0/3703383301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff02415b3c0 msgr2=0x7ff024155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:24.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.655+0000 7ff02a1b0700 1 --2- 172.21.15.6:0/3703383301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff02415b3c0 0x7ff024155ff0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7ff01800d860 tx=0x7ff018008040 comp rx=0 tx=0).stop 2023-10-06T02:25:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.655+0000 7ff02a1b0700 1 -- 172.21.15.6:0/3703383301 shutdown_connections 2023-10-06T02:25:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.655+0000 7ff02a1b0700 1 --2- 172.21.15.6:0/3703383301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff02415bcd0 0x7ff024156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.655+0000 7ff02a1b0700 1 --2- 172.21.15.6:0/3703383301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0240b3c50 0x7ff0240c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.655+0000 7ff02a1b0700 1 --2- 172.21.15.6:0/3703383301 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff010066f30 0x7ff0100693e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.655+0000 7ff02a1b0700 1 --2- 172.21.15.6:0/3703383301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff02415b3c0 0x7ff024155ff0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.655+0000 7ff02a1b0700 1 -- 172.21.15.6:0/3703383301 >> 172.21.15.6:0/3703383301 conn(0x7ff024067910 msgr2=0x7ff0241576e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.656+0000 7ff02a1b0700 1 -- 172.21.15.6:0/3703383301 shutdown_connections 2023-10-06T02:25:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.656+0000 7ff02a1b0700 1 -- 172.21.15.6:0/3703383301 wait complete. 2023-10-06T02:25:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 109 2023-10-06T02:25:24.668 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:25:24.669 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:24.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.788+0000 7fd6ad001700 1 Processor -- start 2023-10-06T02:25:24.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.788+0000 7fd6ad001700 1 -- start start 2023-10-06T02:25:24.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.789+0000 7fd6ad001700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6a8157870 0x7fd6a81626b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:24.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.789+0000 7fd6ad001700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a80b1570 con 0x7fd6a80c8600 2023-10-06T02:25:24.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.789+0000 7fd6ad001700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a8157c90 con 0x7fd6a81574a0 2023-10-06T02:25:24.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.789+0000 7fd6ad001700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a80c3b80 con 0x7fd6a8157870 2023-10-06T02:25:24.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.789+0000 7fd6a759e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6a8157870 0x7fd6a81626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:24.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.789+0000 7fd6a659c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd6a80c8600 0x7fd6a80c3470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45986/0 (socket says 172.21.15.6:45986) 2023-10-06T02:25:24.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.789+0000 7fd6a759e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6a8157870 0x7fd6a81626b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53652/0 (socket says 172.21.15.6:53652) 2023-10-06T02:25:24.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.789+0000 7fd6a659c700 1 -- 172.21.15.6:0/2097397163 learned_addr learned my addr 172.21.15.6:0/2097397163 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:24.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.790+0000 7fd6a759e700 1 -- 172.21.15.6:0/2097397163 >> v1:172.21.15.175:6789/0 conn(0x7fd6a81574a0 legacy=0x7fd6a80c2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:24.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.790+0000 7fd6a759e700 1 -- 172.21.15.6:0/2097397163 >> v1:172.21.15.6:6789/0 conn(0x7fd6a80c8600 legacy=0x7fd6a80c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:24.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.790+0000 7fd6a759e700 1 -- 172.21.15.6:0/2097397163 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a80c4c60 con 0x7fd6a8157870 2023-10-06T02:25:24.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.790+0000 7fd6a5d9b700 1 -- 172.21.15.6:0/2097397163 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327307456 0 0) 0x7fd6a80b1570 con 0x7fd6a80c8600 2023-10-06T02:25:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.790+0000 7fd6a759e700 1 --2- 172.21.15.6:0/2097397163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a8157870 0x7fd6a81626b0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fd698009e60 tx=0x7fd698009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8f79b856c4f595 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.790+0000 7fd6a5d9b700 1 -- 172.21.15.6:0/2097397163 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69800e070 con 0x7fd6a8157870 2023-10-06T02:25:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.790+0000 7fd6a5d9b700 1 -- 172.21.15.6:0/2097397163 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69800bc30 con 0x7fd6a8157870 2023-10-06T02:25:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.790+0000 7fd6a5d9b700 1 -- 172.21.15.6:0/2097397163 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd698012430 con 0x7fd6a8157870 2023-10-06T02:25:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.790+0000 7fd6ad001700 1 -- 172.21.15.6:0/2097397163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a8157870 msgr2=0x7fd6a81626b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.790+0000 7fd6ad001700 1 --2- 172.21.15.6:0/2097397163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a8157870 0x7fd6a81626b0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fd698009e60 tx=0x7fd698009780 comp rx=0 tx=0).stop 2023-10-06T02:25:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.791+0000 7fd6ad001700 1 -- 172.21.15.6:0/2097397163 shutdown_connections 2023-10-06T02:25:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.791+0000 7fd6ad001700 1 --2- 172.21.15.6:0/2097397163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a8157870 0x7fd6a81626b0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.791+0000 7fd6ad001700 1 -- 172.21.15.6:0/2097397163 >> 172.21.15.6:0/2097397163 conn(0x7fd6a8067ba0 msgr2=0x7fd6a80cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.791+0000 7fd6ad001700 1 -- 172.21.15.6:0/2097397163 shutdown_connections 2023-10-06T02:25:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.791+0000 7fd6ad001700 1 -- 172.21.15.6:0/2097397163 wait complete. 2023-10-06T02:25:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.792+0000 7fd6ad001700 1 Processor -- start 2023-10-06T02:25:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.792+0000 7fd6ad001700 1 -- start start 2023-10-06T02:25:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.792+0000 7fd6ad001700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a80c8600 0x7fd6a814ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.792+0000 7fd6ad001700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6a81574a0 0x7fd6a80c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.792+0000 7fd6ad001700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a8157870 0x7fd6a80c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.792+0000 7fd6ad001700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a80c5070 con 0x7fd6a80c8600 2023-10-06T02:25:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd6ad001700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a80c52c0 con 0x7fd6a8157870 2023-10-06T02:25:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd6ad001700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a80c55a0 con 0x7fd6a81574a0 2023-10-06T02:25:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd6a6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a80c8600 0x7fd6a814ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd6a6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a80c8600 0x7fd6a814ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53668/0 (socket says 172.21.15.6:53668) 2023-10-06T02:25:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd6a6d9d700 1 -- 172.21.15.6:0/3357613022 learned_addr learned my addr 172.21.15.6:0/3357613022 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd6a759e700 1 --2- 172.21.15.6:0/3357613022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a8157870 0x7fd6a80c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd6a659c700 1 --2- 172.21.15.6:0/3357613022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6a81574a0 0x7fd6a80c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd6a6d9d700 1 -- 172.21.15.6:0/3357613022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6a81574a0 msgr2=0x7fd6a80c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd6a6d9d700 1 --2- 172.21.15.6:0/3357613022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6a81574a0 0x7fd6a80c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd6a6d9d700 1 -- 172.21.15.6:0/3357613022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a8157870 msgr2=0x7fd6a80c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd6a6d9d700 1 --2- 172.21.15.6:0/3357613022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a8157870 0x7fd6a80c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd6a6d9d700 1 -- 172.21.15.6:0/3357613022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd698009a20 con 0x7fd6a80c8600 2023-10-06T02:25:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd6a659c700 1 --2- 172.21.15.6:0/3357613022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6a81574a0 0x7fd6a80c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd6a759e700 1 --2- 172.21.15.6:0/3357613022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a8157870 0x7fd6a80c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd6a6d9d700 1 --2- 172.21.15.6:0/3357613022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a80c8600 0x7fd6a814ce30 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000c540 tx=0x7fd6a0001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd69effd700 1 -- 172.21.15.6:0/3357613022 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0011590 con 0x7fd6a80c8600 2023-10-06T02:25:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd69effd700 1 -- 172.21.15.6:0/3357613022 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a00116f0 con 0x7fd6a80c8600 2023-10-06T02:25:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd6ad001700 1 -- 172.21.15.6:0/3357613022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a80c5880 con 0x7fd6a80c8600 2023-10-06T02:25:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd69effd700 1 -- 172.21.15.6:0/3357613022 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0011ab0 con 0x7fd6a80c8600 2023-10-06T02:25:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.793+0000 7fd6ad001700 1 -- 172.21.15.6:0/3357613022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a80c5e40 con 0x7fd6a80c8600 2023-10-06T02:25:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.794+0000 7fd6ad001700 1 -- 172.21.15.6:0/3357613022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a8064ee0 con 0x7fd6a80c8600 2023-10-06T02:25:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.795+0000 7fd69effd700 1 -- 172.21.15.6:0/3357613022 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6a001b3b0 con 0x7fd6a80c8600 2023-10-06T02:25:24.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.795+0000 7fd69effd700 1 --2- 172.21.15.6:0/3357613022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd688066f30 0x7fd6880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:24.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.795+0000 7fd69effd700 1 -- 172.21.15.6:0/3357613022 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6722+0+0 (secure 0 0 0) 0x7fd6a0083d50 con 0x7fd6a80c8600 2023-10-06T02:25:24.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.795+0000 7fd6a659c700 1 --2- 172.21.15.6:0/3357613022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd688066f30 0x7fd6880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:24.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.796+0000 7fd6a659c700 1 --2- 172.21.15.6:0/3357613022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd688066f30 0x7fd6880693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80c6840 tx=0x7fd690009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:24.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:24.799+0000 7fd69effd700 1 -- 172.21.15.6:0/3357613022 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6a0087030 con 0x7fd6a80c8600 2023-10-06T02:25:25.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.040+0000 7fd6ad001700 1 -- 172.21.15.6:0/3357613022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6a80b0f20 con 0x7fd6a80c8600 2023-10-06T02:25:25.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.041+0000 7fd69effd700 1 -- 172.21.15.6:0/3357613022 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4594 (secure 0 0 0) 0x7fd6a0017020 con 0x7fd6a80c8600 2023-10-06T02:25:25.042 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:25.042 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":110,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8082,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2220056807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2220056807},{"type":"v1","addr":"172.21.15.6:6835","nonce":2220056807}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:23.853457+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.043+0000 7fd6ad001700 1 -- 172.21.15.6:0/3357613022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd688066f30 msgr2=0x7fd6880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.043+0000 7fd6ad001700 1 --2- 172.21.15.6:0/3357613022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd688066f30 0x7fd6880693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80c6840 tx=0x7fd690009040 comp rx=0 tx=0).stop 2023-10-06T02:25:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.043+0000 7fd6ad001700 1 -- 172.21.15.6:0/3357613022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a80c8600 msgr2=0x7fd6a814ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.043+0000 7fd6ad001700 1 --2- 172.21.15.6:0/3357613022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a80c8600 0x7fd6a814ce30 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000c540 tx=0x7fd6a0001070 comp rx=0 tx=0).stop 2023-10-06T02:25:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.043+0000 7fd6ad001700 1 -- 172.21.15.6:0/3357613022 shutdown_connections 2023-10-06T02:25:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.043+0000 7fd6ad001700 1 --2- 172.21.15.6:0/3357613022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a8157870 0x7fd6a80c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.043+0000 7fd6ad001700 1 --2- 172.21.15.6:0/3357613022 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd688066f30 0x7fd6880693e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.043+0000 7fd6ad001700 1 --2- 172.21.15.6:0/3357613022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a80c8600 0x7fd6a814ce30 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.043+0000 7fd6ad001700 1 --2- 172.21.15.6:0/3357613022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6a81574a0 0x7fd6a80c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.043+0000 7fd6ad001700 1 -- 172.21.15.6:0/3357613022 >> 172.21.15.6:0/3357613022 conn(0x7fd6a8067ba0 msgr2=0x7fd6a8156c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.043+0000 7fd6ad001700 1 -- 172.21.15.6:0/3357613022 shutdown_connections 2023-10-06T02:25:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.043+0000 7fd6ad001700 1 -- 172.21.15.6:0/3357613022 wait complete. 2023-10-06T02:25:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 110 2023-10-06T02:25:25.055 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 1.00000000.inode' led to DAMAGED state 2023-10-06T02:25:25.055 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 200.00000000' 2023-10-06T02:25:25.055 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:25.056 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:25:25.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:25.056 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:25:25.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:25:25.071 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:25:25.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:25:25.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.231+0000 7f222d21a700 1 Processor -- start 2023-10-06T02:25:25.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.231+0000 7f222d21a700 1 -- start start 2023-10-06T02:25:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.231+0000 7f222d21a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2228086ff0 0x7f2228087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.231+0000 7f222d21a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22280b21b0 0x7f22280b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.231+0000 7f222d21a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22280b2b70 con 0x7f222815a030 2023-10-06T02:25:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.231+0000 7f222d21a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22280b0cf0 con 0x7f2228086ff0 2023-10-06T02:25:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.231+0000 7f222d21a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22280879b0 con 0x7f22280b21b0 2023-10-06T02:25:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.232+0000 7f222759e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22280b21b0 0x7f22280b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.232+0000 7f221e59c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2228086ff0 0x7f2228087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.232+0000 7f2226d9d700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f222815a030 0x7f222815a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:47348/0 (socket says 172.21.15.6:47348) 2023-10-06T02:25:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.232+0000 7f221e59c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2228086ff0 0x7f2228087470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:42490/0 (socket says 172.21.15.6:42490) 2023-10-06T02:25:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.232+0000 7f2226d9d700 1 -- 172.21.15.6:0/2320256406 learned_addr learned my addr 172.21.15.6:0/2320256406 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.232+0000 7f222759e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22280b21b0 0x7f22280b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:48246/0 (socket says 172.21.15.6:48246) 2023-10-06T02:25:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.232+0000 7f222759e700 1 -- 172.21.15.6:0/2320256406 >> v2:172.21.15.175:3300/0 conn(0x7f2228086ff0 msgr2=0x7f2228087470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.232+0000 7f222759e700 1 --2- 172.21.15.6:0/2320256406 >> v2:172.21.15.175:3300/0 conn(0x7f2228086ff0 0x7f2228087470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.232+0000 7f222759e700 1 -- 172.21.15.6:0/2320256406 >> v1:172.21.15.175:6789/0 conn(0x7f222815a030 legacy=0x7f222815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.232+0000 7f222759e700 1 -- 172.21.15.6:0/2320256406 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22280afc50 con 0x7f22280b21b0 2023-10-06T02:25:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.232+0000 7f221e59c700 1 --2- 172.21.15.6:0/2320256406 >> v2:172.21.15.175:3300/0 conn(0x7f2228086ff0 0x7f2228087470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:25:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.232+0000 7f222659c700 1 -- 172.21.15.6:0/2320256406 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077485910 0 0) 0x7f22280b2b70 con 0x7f222815a030 2023-10-06T02:25:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.232+0000 7f222759e700 1 --2- 172.21.15.6:0/2320256406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22280b21b0 0x7f22280b2630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2220009e60 tx=0x7f2220009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deff480a97abe969 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:25.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.233+0000 7f222659c700 1 -- 172.21.15.6:0/2320256406 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222000e070 con 0x7f22280b21b0 2023-10-06T02:25:25.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.233+0000 7f222659c700 1 -- 172.21.15.6:0/2320256406 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222000bb60 con 0x7f22280b21b0 2023-10-06T02:25:25.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.233+0000 7f222659c700 1 -- 172.21.15.6:0/2320256406 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220012430 con 0x7f22280b21b0 2023-10-06T02:25:25.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.233+0000 7f222d21a700 1 -- 172.21.15.6:0/2320256406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22280b21b0 msgr2=0x7f22280b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:25.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.233+0000 7f222d21a700 1 --2- 172.21.15.6:0/2320256406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22280b21b0 0x7f22280b2630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2220009e60 tx=0x7f2220009780 comp rx=0 tx=0).stop 2023-10-06T02:25:25.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.233+0000 7f222d21a700 1 -- 172.21.15.6:0/2320256406 shutdown_connections 2023-10-06T02:25:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.233+0000 7f222d21a700 1 --2- 172.21.15.6:0/2320256406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22280b21b0 0x7f22280b2630 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.233+0000 7f222d21a700 1 --2- 172.21.15.6:0/2320256406 >> v2:172.21.15.175:3300/0 conn(0x7f2228086ff0 0x7f2228087470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.233+0000 7f222d21a700 1 -- 172.21.15.6:0/2320256406 >> 172.21.15.6:0/2320256406 conn(0x7f2228068680 msgr2=0x7f2228068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.233+0000 7f222d21a700 1 -- 172.21.15.6:0/2320256406 shutdown_connections 2023-10-06T02:25:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.233+0000 7f222d21a700 1 -- 172.21.15.6:0/2320256406 wait complete. 2023-10-06T02:25:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.234+0000 7f222d21a700 1 Processor -- start 2023-10-06T02:25:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.234+0000 7f222d21a700 1 -- start start 2023-10-06T02:25:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.235+0000 7f222d21a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2228086ff0 0x7f22280c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.235+0000 7f222d21a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22280b21b0 0x7f22280c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.235+0000 7f222d21a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f222815a030 0x7f222816ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.235+0000 7f222d21a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22280b3f80 con 0x7f222815a030 2023-10-06T02:25:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.235+0000 7f222d21a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22280b3af0 con 0x7f2228086ff0 2023-10-06T02:25:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.235+0000 7f222d21a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22280c59d0 con 0x7f22280b21b0 2023-10-06T02:25:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.235+0000 7f222759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f222815a030 0x7f222816ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.235+0000 7f222759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f222815a030 0x7f222816ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53672/0 (socket says 172.21.15.6:53672) 2023-10-06T02:25:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.235+0000 7f222759e700 1 -- 172.21.15.6:0/2825884625 learned_addr learned my addr 172.21.15.6:0/2825884625 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.235+0000 7f221e59c700 1 --2- 172.21.15.6:0/2825884625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22280b21b0 0x7f22280c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.235+0000 7f2226d9d700 1 --2- 172.21.15.6:0/2825884625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2228086ff0 0x7f22280c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.236+0000 7f222759e700 1 -- 172.21.15.6:0/2825884625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22280b21b0 msgr2=0x7f22280c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.236+0000 7f222759e700 1 --2- 172.21.15.6:0/2825884625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22280b21b0 0x7f22280c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.236+0000 7f222759e700 1 -- 172.21.15.6:0/2825884625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2228086ff0 msgr2=0x7f22280c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.236+0000 7f222759e700 1 --2- 172.21.15.6:0/2825884625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2228086ff0 0x7f22280c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.236+0000 7f222759e700 1 -- 172.21.15.6:0/2825884625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2210009420 con 0x7f222815a030 2023-10-06T02:25:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.236+0000 7f2226d9d700 1 --2- 172.21.15.6:0/2825884625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2228086ff0 0x7f22280c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.236+0000 7f222759e700 1 --2- 172.21.15.6:0/2825884625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f222815a030 0x7f222816ea10 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f222000b6c0 tx=0x7f2220019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.236+0000 7f221f7fe700 1 -- 172.21.15.6:0/2825884625 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220027470 con 0x7f222815a030 2023-10-06T02:25:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.236+0000 7f221f7fe700 1 -- 172.21.15.6:0/2825884625 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2220027610 con 0x7f222815a030 2023-10-06T02:25:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.236+0000 7f221f7fe700 1 -- 172.21.15.6:0/2825884625 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22200279d0 con 0x7f222815a030 2023-10-06T02:25:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.236+0000 7f222d21a700 1 -- 172.21.15.6:0/2825884625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2220009a20 con 0x7f222815a030 2023-10-06T02:25:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.236+0000 7f222d21a700 1 -- 172.21.15.6:0/2825884625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22280c5c50 con 0x7f222815a030 2023-10-06T02:25:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.237+0000 7f222d21a700 1 -- 172.21.15.6:0/2825884625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2228088700 con 0x7f222815a030 2023-10-06T02:25:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.237+0000 7f221f7fe700 1 -- 172.21.15.6:0/2825884625 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2220024070 con 0x7f222815a030 2023-10-06T02:25:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.238+0000 7f221f7fe700 1 --2- 172.21.15.6:0/2825884625 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2208066f30 0x7f22080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.238+0000 7f221f7fe700 1 -- 172.21.15.6:0/2825884625 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6722+0+0 (secure 0 0 0) 0x7f2220087310 con 0x7f222815a030 2023-10-06T02:25:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.238+0000 7f2226d9d700 1 --2- 172.21.15.6:0/2825884625 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2208066f30 0x7f22080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.239+0000 7f2226d9d700 1 --2- 172.21.15.6:0/2825884625 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2208066f30 0x7f22080693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2218001890 tx=0x7f2218009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.243+0000 7f221f7fe700 1 -- 172.21.15.6:0/2825884625 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2220054180 con 0x7f222815a030 2023-10-06T02:25:25.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.478+0000 7f222d21a700 1 -- 172.21.15.6:0/2825884625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f22280aff30 con 0x7f222815a030 2023-10-06T02:25:25.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.866+0000 7f221f7fe700 1 -- 172.21.15.6:0/2825884625 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v111) v1 ==== 161+0+0 (secure 0 0 0) 0x7f22200577a0 con 0x7f222815a030 2023-10-06T02:25:25.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.868+0000 7f222d21a700 1 -- 172.21.15.6:0/2825884625 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2208066f30 msgr2=0x7f22080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.868+0000 7f222d21a700 1 --2- 172.21.15.6:0/2825884625 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2208066f30 0x7f22080693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2218001890 tx=0x7f2218009040 comp rx=0 tx=0).stop 2023-10-06T02:25:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.868+0000 7f222d21a700 1 -- 172.21.15.6:0/2825884625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f222815a030 msgr2=0x7f222816ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.868+0000 7f222d21a700 1 --2- 172.21.15.6:0/2825884625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f222815a030 0x7f222816ea10 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f222000b6c0 tx=0x7f2220019000 comp rx=0 tx=0).stop 2023-10-06T02:25:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.868+0000 7f222d21a700 1 -- 172.21.15.6:0/2825884625 shutdown_connections 2023-10-06T02:25:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.868+0000 7f222d21a700 1 --2- 172.21.15.6:0/2825884625 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2208066f30 0x7f22080693e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.868+0000 7f222d21a700 1 --2- 172.21.15.6:0/2825884625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f222815a030 0x7f222816ea10 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.868+0000 7f222d21a700 1 --2- 172.21.15.6:0/2825884625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2228086ff0 0x7f22280c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.868+0000 7f222d21a700 1 --2- 172.21.15.6:0/2825884625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22280b21b0 0x7f22280c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.868+0000 7f222d21a700 1 -- 172.21.15.6:0/2825884625 >> 172.21.15.6:0/2825884625 conn(0x7f2228068680 msgr2=0x7f222815d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.868+0000 7f222d21a700 1 -- 172.21.15.6:0/2825884625 shutdown_connections 2023-10-06T02:25:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:25.868+0000 7f222d21a700 1 -- 172.21.15.6:0/2825884625 wait complete. 2023-10-06T02:25:25.870 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:25:25.881 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:25:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.001+0000 7f1e9301d700 1 Processor -- start 2023-10-06T02:25:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.001+0000 7f1e9301d700 1 -- start start 2023-10-06T02:25:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.002+0000 7f1e9301d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1e8c15a030 0x7f1e8c15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.002+0000 7f1e9301d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1e8c15a940 0x7f1e8c086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.002+0000 7f1e9301d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8c0afc50 con 0x7f1e8c087530 2023-10-06T02:25:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.002+0000 7f1e9301d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8c0879d0 con 0x7f1e8c15a940 2023-10-06T02:25:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.002+0000 7f1e9301d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8c0b0cf0 con 0x7f1e8c15a030 2023-10-06T02:25:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.002+0000 7f1e8bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1e8c15a940 0x7f1e8c086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.002+0000 7f1e915ba700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1e8c087530 0x7f1e8c0b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46000/0 (socket says 172.21.15.6:46000) 2023-10-06T02:25:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.002+0000 7f1e8bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1e8c15a940 0x7f1e8c086ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53678/0 (socket says 172.21.15.6:53678) 2023-10-06T02:25:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.002+0000 7f1e915ba700 1 -- 172.21.15.6:0/3750345726 learned_addr learned my addr 172.21.15.6:0/3750345726 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.002+0000 7f1e90db9700 1 --2- 172.21.15.6:0/3750345726 >> v2:172.21.15.175:3300/0 conn(0x7f1e8c15a030 0x7f1e8c15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.003+0000 7f1e8bfff700 1 -- 172.21.15.6:0/3750345726 >> v2:172.21.15.175:3300/0 conn(0x7f1e8c15a030 msgr2=0x7f1e8c15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.003+0000 7f1e8bfff700 1 --2- 172.21.15.6:0/3750345726 >> v2:172.21.15.175:3300/0 conn(0x7f1e8c15a030 0x7f1e8c15a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.003+0000 7f1e8bfff700 1 -- 172.21.15.6:0/3750345726 >> v1:172.21.15.6:6789/0 conn(0x7f1e8c087530 legacy=0x7f1e8c0b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.003+0000 7f1e8bfff700 1 -- 172.21.15.6:0/3750345726 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c0aff30 con 0x7f1e8c15a940 2023-10-06T02:25:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.003+0000 7f1e8b7fe700 1 -- 172.21.15.6:0/3750345726 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979296408 0 0) 0x7f1e8c0afc50 con 0x7f1e8c087530 2023-10-06T02:25:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.003+0000 7f1e8bfff700 1 --2- 172.21.15.6:0/3750345726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e8c15a940 0x7f1e8c086ff0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0cddc0 tx=0x7f1e7c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f9f30dd7a27e58 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.003+0000 7f1e8b7fe700 1 -- 172.21.15.6:0/3750345726 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c00e070 con 0x7f1e8c15a940 2023-10-06T02:25:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.003+0000 7f1e8b7fe700 1 -- 172.21.15.6:0/3750345726 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c00bbf0 con 0x7f1e8c15a940 2023-10-06T02:25:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.003+0000 7f1e8b7fe700 1 -- 172.21.15.6:0/3750345726 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c012430 con 0x7f1e8c15a940 2023-10-06T02:25:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.003+0000 7f1e9301d700 1 -- 172.21.15.6:0/3750345726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e8c15a940 msgr2=0x7f1e8c086ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.003+0000 7f1e9301d700 1 --2- 172.21.15.6:0/3750345726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e8c15a940 0x7f1e8c086ff0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0cddc0 tx=0x7f1e7c009780 comp rx=0 tx=0).stop 2023-10-06T02:25:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.003+0000 7f1e9301d700 1 -- 172.21.15.6:0/3750345726 shutdown_connections 2023-10-06T02:25:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.003+0000 7f1e9301d700 1 --2- 172.21.15.6:0/3750345726 >> v2:172.21.15.175:3300/0 conn(0x7f1e8c15a030 0x7f1e8c15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.003+0000 7f1e9301d700 1 --2- 172.21.15.6:0/3750345726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e8c15a940 0x7f1e8c086ff0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.003+0000 7f1e9301d700 1 -- 172.21.15.6:0/3750345726 >> 172.21.15.6:0/3750345726 conn(0x7f1e8c068680 msgr2=0x7f1e8c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.003+0000 7f1e9301d700 1 -- 172.21.15.6:0/3750345726 shutdown_connections 2023-10-06T02:25:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.003+0000 7f1e9301d700 1 -- 172.21.15.6:0/3750345726 wait complete. 2023-10-06T02:25:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.005+0000 7f1e9301d700 1 Processor -- start 2023-10-06T02:25:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.005+0000 7f1e9301d700 1 -- start start 2023-10-06T02:25:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.005+0000 7f1e9301d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e8c087530 0x7f1e8c14b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.005+0000 7f1e9301d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e8c15a030 0x7f1e8c0cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e9301d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e8c15a940 0x7f1e8c0cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e9301d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0c5910 con 0x7f1e8c087530 2023-10-06T02:25:26.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e9301d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0c5bf0 con 0x7f1e8c15a940 2023-10-06T02:25:26.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e9301d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c15ae00 con 0x7f1e8c15a030 2023-10-06T02:25:26.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e90db9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e8c087530 0x7f1e8c14b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:26.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e90db9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e8c087530 0x7f1e8c14b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53692/0 (socket says 172.21.15.6:53692) 2023-10-06T02:25:26.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e90db9700 1 -- 172.21.15.6:0/1271639381 learned_addr learned my addr 172.21.15.6:0/1271639381 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:26.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e915ba700 1 --2- 172.21.15.6:0/1271639381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e8c15a940 0x7f1e8c0cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:26.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e8bfff700 1 --2- 172.21.15.6:0/1271639381 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e8c15a030 0x7f1e8c0cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:26.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e90db9700 1 -- 172.21.15.6:0/1271639381 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e8c15a030 msgr2=0x7f1e8c0cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:26.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e90db9700 1 --2- 172.21.15.6:0/1271639381 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e8c15a030 0x7f1e8c0cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:26.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e90db9700 1 -- 172.21.15.6:0/1271639381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e8c15a940 msgr2=0x7f1e8c0cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:26.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e90db9700 1 --2- 172.21.15.6:0/1271639381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e8c15a940 0x7f1e8c0cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:26.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e90db9700 1 -- 172.21.15.6:0/1271639381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c009a20 con 0x7f1e8c087530 2023-10-06T02:25:26.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e8bfff700 1 --2- 172.21.15.6:0/1271639381 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e8c15a030 0x7f1e8c0cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:26.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e90db9700 1 --2- 172.21.15.6:0/1271639381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e8c087530 0x7f1e8c14b8b0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400d890 tx=0x7f1e84008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:26.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e88ff9700 1 -- 172.21.15.6:0/1271639381 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8400b600 con 0x7f1e8c087530 2023-10-06T02:25:26.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e88ff9700 1 -- 172.21.15.6:0/1271639381 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8400b760 con 0x7f1e8c087530 2023-10-06T02:25:26.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e9301d700 1 -- 172.21.15.6:0/1271639381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8c15b0e0 con 0x7f1e8c087530 2023-10-06T02:25:26.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e88ff9700 1 -- 172.21.15.6:0/1271639381 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8400bae0 con 0x7f1e8c087530 2023-10-06T02:25:26.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.006+0000 7f1e9301d700 1 -- 172.21.15.6:0/1271639381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8c0c81c0 con 0x7f1e8c087530 2023-10-06T02:25:26.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.007+0000 7f1e9301d700 1 -- 172.21.15.6:0/1271639381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8c0c83b0 con 0x7f1e8c087530 2023-10-06T02:25:26.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.008+0000 7f1e88ff9700 1 -- 172.21.15.6:0/1271639381 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e8401e460 con 0x7f1e8c087530 2023-10-06T02:25:26.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.008+0000 7f1e88ff9700 1 --2- 172.21.15.6:0/1271639381 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1e6c066f30 0x7f1e6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:26.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.008+0000 7f1e88ff9700 1 -- 172.21.15.6:0/1271639381 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6722+0+0 (secure 0 0 0) 0x7f1e84084fe0 con 0x7f1e8c087530 2023-10-06T02:25:26.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.008+0000 7f1e8bfff700 1 --2- 172.21.15.6:0/1271639381 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1e6c066f30 0x7f1e6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:26.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.009+0000 7f1e8bfff700 1 --2- 172.21.15.6:0/1271639381 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1e6c066f30 0x7f1e6c0693e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0cddc0 tx=0x7f1e7c019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:26.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.012+0000 7f1e88ff9700 1 -- 172.21.15.6:0/1271639381 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e84051e50 con 0x7f1e8c087530 2023-10-06T02:25:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.287+0000 7f1e9301d700 1 -- 172.21.15.6:0/1271639381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f1e8c0b0210 con 0x7f1e8c087530 2023-10-06T02:25:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.870+0000 7f1e88ff9700 1 -- 172.21.15.6:0/1271639381 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v112) v1 ==== 101+0+0 (secure 0 0 0) 0x7f1e84055470 con 0x7f1e8c087530 2023-10-06T02:25:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.873+0000 7f1e9301d700 1 -- 172.21.15.6:0/1271639381 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1e6c066f30 msgr2=0x7f1e6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.873+0000 7f1e9301d700 1 --2- 172.21.15.6:0/1271639381 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1e6c066f30 0x7f1e6c0693e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0cddc0 tx=0x7f1e7c019000 comp rx=0 tx=0).stop 2023-10-06T02:25:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.873+0000 7f1e9301d700 1 -- 172.21.15.6:0/1271639381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e8c087530 msgr2=0x7f1e8c14b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.873+0000 7f1e9301d700 1 --2- 172.21.15.6:0/1271639381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e8c087530 0x7f1e8c14b8b0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400d890 tx=0x7f1e84008040 comp rx=0 tx=0).stop 2023-10-06T02:25:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.873+0000 7f1e9301d700 1 -- 172.21.15.6:0/1271639381 shutdown_connections 2023-10-06T02:25:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.873+0000 7f1e9301d700 1 --2- 172.21.15.6:0/1271639381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e8c15a940 0x7f1e8c0cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.873+0000 7f1e9301d700 1 --2- 172.21.15.6:0/1271639381 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1e6c066f30 0x7f1e6c0693e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.873+0000 7f1e9301d700 1 --2- 172.21.15.6:0/1271639381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e8c087530 0x7f1e8c14b8b0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.873+0000 7f1e9301d700 1 --2- 172.21.15.6:0/1271639381 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e8c15a030 0x7f1e8c0cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.873+0000 7f1e9301d700 1 -- 172.21.15.6:0/1271639381 >> 172.21.15.6:0/1271639381 conn(0x7f1e8c068680 msgr2=0x7f1e8c0b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.873+0000 7f1e9301d700 1 -- 172.21.15.6:0/1271639381 shutdown_connections 2023-10-06T02:25:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.873+0000 7f1e9301d700 1 -- 172.21.15.6:0/1271639381 wait complete. 2023-10-06T02:25:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:25:26.887 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:25:26.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.925+0000 7f974aa77000 1 Processor -- start 2023-10-06T02:25:26.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.925+0000 7f974aa77000 1 -- start start 2023-10-06T02:25:26.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.925+0000 7f974aa77000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619f74904e0 0x5619f753e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:26.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.925+0000 7f974aa77000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5619f74a9db0 0x5619f7540e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:26.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.925+0000 7f974aa77000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619f752f590 0x5619f752e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:26.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.925+0000 7f974aa77000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619f73ab980 con 0x5619f752f590 2023-10-06T02:25:26.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.925+0000 7f974aa77000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619f73ab620 con 0x5619f74904e0 2023-10-06T02:25:26.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.925+0000 7f974aa77000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5619f73a2400 con 0x5619f74a9db0 2023-10-06T02:25:26.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.926+0000 7f97444b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619f752f590 0x5619f752e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:26.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.926+0000 7f97444b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619f752f590 0x5619f752e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53718/0 (socket says 172.21.15.6:53718) 2023-10-06T02:25:26.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.926+0000 7f97444b3700 1 -- 172.21.15.6:0/3704733255 learned_addr learned my addr 172.21.15.6:0/3704733255 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:26.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.926+0000 7f973bfff700 1 --2- 172.21.15.6:0/3704733255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5619f74a9db0 0x5619f7540e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:26.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.926+0000 7f9743cb2700 1 --2- 172.21.15.6:0/3704733255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619f74904e0 0x5619f753e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:26.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.926+0000 7f97444b3700 1 -- 172.21.15.6:0/3704733255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5619f74a9db0 msgr2=0x5619f7540e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:26.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.926+0000 7f97444b3700 1 --2- 172.21.15.6:0/3704733255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5619f74a9db0 0x5619f7540e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:26.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.926+0000 7f97444b3700 1 -- 172.21.15.6:0/3704733255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619f74904e0 msgr2=0x5619f753e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:26.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.926+0000 7f97444b3700 1 --2- 172.21.15.6:0/3704733255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619f74904e0 0x5619f753e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:26.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.926+0000 7f97444b3700 1 -- 172.21.15.6:0/3704733255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c00a0e0 con 0x5619f752f590 2023-10-06T02:25:26.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.926+0000 7f973bfff700 1 --2- 172.21.15.6:0/3704733255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5619f74a9db0 0x5619f7540e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:26.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.926+0000 7f97444b3700 1 --2- 172.21.15.6:0/3704733255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619f752f590 0x5619f752e190 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f973c005970 tx=0x7f973c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d858183a1de01d2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:26.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.926+0000 7f9742cb0700 1 -- 172.21.15.6:0/3704733255 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c00f860 con 0x5619f752f590 2023-10-06T02:25:26.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.926+0000 7f9742cb0700 1 -- 172.21.15.6:0/3704733255 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c00f9c0 con 0x5619f752f590 2023-10-06T02:25:26.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.926+0000 7f9742cb0700 1 -- 172.21.15.6:0/3704733255 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c0246c0 con 0x5619f752f590 2023-10-06T02:25:26.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.927+0000 7f974aa77000 1 -- 172.21.15.6:0/3704733255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619f752f590 msgr2=0x5619f752e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:26.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.927+0000 7f974aa77000 1 --2- 172.21.15.6:0/3704733255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619f752f590 0x5619f752e190 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f973c005970 tx=0x7f973c015000 comp rx=0 tx=0).stop 2023-10-06T02:25:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.927+0000 7f974aa77000 1 -- 172.21.15.6:0/3704733255 shutdown_connections 2023-10-06T02:25:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.927+0000 7f974aa77000 1 --2- 172.21.15.6:0/3704733255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619f752f590 0x5619f752e190 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.927+0000 7f974aa77000 1 --2- 172.21.15.6:0/3704733255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619f74904e0 0x5619f753e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.927+0000 7f974aa77000 1 --2- 172.21.15.6:0/3704733255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5619f74a9db0 0x5619f7540e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.927+0000 7f974aa77000 1 -- 172.21.15.6:0/3704733255 >> 172.21.15.6:0/3704733255 conn(0x5619f7460d50 msgr2=0x5619f74a80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.927+0000 7f974aa77000 1 -- 172.21.15.6:0/3704733255 shutdown_connections 2023-10-06T02:25:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.927+0000 7f974aa77000 1 -- 172.21.15.6:0/3704733255 wait complete. 2023-10-06T02:25:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.927+0000 7f974aa77000 1 Processor -- start 2023-10-06T02:25:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.927+0000 7f974aa77000 1 -- start start 2023-10-06T02:25:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.928+0000 7f974aa77000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619f74904e0 0x5619f752f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.928+0000 7f974aa77000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619f74a9db0 0x5619f75260f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.928+0000 7f974aa77000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5619f752f590 0x5619f752e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.928+0000 7f974aa77000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619f7529ca0 con 0x5619f74a9db0 2023-10-06T02:25:26.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.928+0000 7f974aa77000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619f752b200 con 0x5619f74904e0 2023-10-06T02:25:26.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.928+0000 7f974aa77000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5619f752b4a0 con 0x5619f752f590 2023-10-06T02:25:26.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.928+0000 7f973bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619f74a9db0 0x5619f75260f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:26.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.928+0000 7f973bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619f74a9db0 0x5619f75260f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53720/0 (socket says 172.21.15.6:53720) 2023-10-06T02:25:26.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.928+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 learned_addr learned my addr 172.21.15.6:0/1602208807 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:26.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.928+0000 7f9743cb2700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619f74904e0 0x5619f752f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:26.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.928+0000 7f97444b3700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5619f752f590 0x5619f752e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:26.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.928+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5619f752f590 msgr2=0x5619f752e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:26.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.928+0000 7f973bfff700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5619f752f590 0x5619f752e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:26.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.928+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619f74904e0 msgr2=0x5619f752f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:26.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.928+0000 7f973bfff700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619f74904e0 0x5619f752f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:26.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.928+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619f73d41c0 con 0x5619f74a9db0 2023-10-06T02:25:26.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.928+0000 7f9743cb2700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619f74904e0 0x5619f752f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:26.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.929+0000 7f973bfff700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619f74a9db0 0x5619f75260f0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f972c00dfb0 tx=0x7f972c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:26.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.929+0000 7f97414ad700 1 -- 172.21.15.6:0/1602208807 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c00be50 con 0x5619f74a9db0 2023-10-06T02:25:26.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.929+0000 7f97414ad700 1 -- 172.21.15.6:0/1602208807 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c00f450 con 0x5619f74a9db0 2023-10-06T02:25:26.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.929+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5619f73ba3d0 con 0x5619f74a9db0 2023-10-06T02:25:26.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.929+0000 7f97414ad700 1 -- 172.21.15.6:0/1602208807 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c00f7f0 con 0x5619f74a9db0 2023-10-06T02:25:26.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.929+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619f73adae0 con 0x5619f74a9db0 2023-10-06T02:25:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.930+0000 7f97414ad700 1 -- 172.21.15.6:0/1602208807 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f972c00fba0 con 0x5619f74a9db0 2023-10-06T02:25:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.931+0000 7f97414ad700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9724065890 0x7f9724067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.931+0000 7f97414ad700 1 -- 172.21.15.6:0/1602208807 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6722+0+0 (secure 0 0 0) 0x7f972c083e40 con 0x5619f74a9db0 2023-10-06T02:25:26.935 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:25:26.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.931+0000 7f9743cb2700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9724065890 0x7f9724067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:26.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.931+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5619f752e8b0 0x5619f7531050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:26.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.931+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7531590 con 0x5619f752e8b0 2023-10-06T02:25:26.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.931+0000 7f97444b3700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5619f752e8b0 0x5619f7531050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:26.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.931+0000 7f9743cb2700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9724065890 0x7f9724067d40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9734005fd0 tx=0x7f9734005bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:26.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.931+0000 7f97444b3700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5619f752e8b0 0x5619f7531050 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:26.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.933+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v99'102 uv78 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c020030 con 0x5619f752e8b0 2023-10-06T02:25:26.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.933+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7548ef0 con 0x5619f752e8b0 2023-10-06T02:25:26.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.934+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v99'103 uv103 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.934+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f75492d0 con 0x5619f752e8b0 2023-10-06T02:25:26.938 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:25:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.935+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v99'104 uv104 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.935+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7549680 con 0x5619f752e8b0 2023-10-06T02:25:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.936+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v99'105 uv105 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.936+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7549a70 con 0x5619f752e8b0 2023-10-06T02:25:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.937+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v99'106 uv106 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.937+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f75526c0 con 0x5619f752e8b0 2023-10-06T02:25:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.938+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v99'107 uv107 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.938+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7552a70 con 0x5619f752e8b0 2023-10-06T02:25:26.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.939+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v99'108 uv84 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.939+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7552a70 con 0x5619f752e8b0 2023-10-06T02:25:26.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.940+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v99'109 uv109 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.940+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7552a70 con 0x5619f752e8b0 2023-10-06T02:25:26.942 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:25:26.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.941+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v99'110 uv110 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.942+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7553a80 con 0x5619f752e8b0 2023-10-06T02:25:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.943+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v99'111 uv111 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.943+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7553a80 con 0x5619f752e8b0 2023-10-06T02:25:26.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.944+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v99'112 uv112 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.944+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7552a70 con 0x5619f752e8b0 2023-10-06T02:25:26.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.945+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v99'113 uv113 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.945+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7552a70 con 0x5619f752e8b0 2023-10-06T02:25:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.946+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v99'114 uv91 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.946+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7552a70 con 0x5619f752e8b0 2023-10-06T02:25:26.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.947+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v99'115 uv115 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.947+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7552a70 con 0x5619f752e8b0 2023-10-06T02:25:26.949 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:25:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.948+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v99'116 uv116 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.948+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7553a80 con 0x5619f752e8b0 2023-10-06T02:25:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.949+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v99'117 uv117 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.949+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7553a80 con 0x5619f752e8b0 2023-10-06T02:25:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.950+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v99'118 uv118 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.950+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7552a70 con 0x5619f752e8b0 2023-10-06T02:25:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.951+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v99'119 uv119 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.951+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7552f60 con 0x5619f752e8b0 2023-10-06T02:25:26.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.952+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v99'120 uv120 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.952+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7552f60 con 0x5619f752e8b0 2023-10-06T02:25:26.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.953+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v99'121 uv95 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.953+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7552f60 con 0x5619f752e8b0 2023-10-06T02:25:26.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.954+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v99'122 uv122 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.954+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7552f60 con 0x5619f752e8b0 2023-10-06T02:25:26.955 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:25:26.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.955+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v99'123 uv123 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.955+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7553f70 con 0x5619f752e8b0 2023-10-06T02:25:26.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.956+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v99'124 uv124 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.956+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7553f70 con 0x5619f752e8b0 2023-10-06T02:25:26.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.957+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v99'125 uv125 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.957+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7552f60 con 0x5619f752e8b0 2023-10-06T02:25:26.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.958+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v99'126 uv126 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.958+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7552f60 con 0x5619f752e8b0 2023-10-06T02:25:26.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.959+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v99'127 uv101 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.959+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7552f60 con 0x5619f752e8b0 2023-10-06T02:25:26.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.960+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v99'128 uv128 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.960+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7552f60 con 0x5619f752e8b0 2023-10-06T02:25:26.961 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:25:26.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.961+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v99'129 uv129 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.961+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7553f70 con 0x5619f752e8b0 2023-10-06T02:25:26.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.962+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v99'130 uv130 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.962+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7553f70 con 0x5619f752e8b0 2023-10-06T02:25:26.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.963+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v99'131 uv131 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.963+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7552f60 con 0x5619f752e8b0 2023-10-06T02:25:26.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.964+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v99'132 uv132 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f752e8b0 2023-10-06T02:25:26.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.964+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5619f7553470 0x5619f7555850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:26.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.964+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7555d90 con 0x5619f7553470 2023-10-06T02:25:26.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.964+0000 7f9743cb2700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5619f7553470 0x5619f7555850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:26.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.965+0000 7f9743cb2700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5619f7553470 0x5619f7555850 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:26.966 INFO:teuthology.orchestra.run.smithi006.stdout:Write #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:25:26.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.966+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v99'87 uv87 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:26.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.966+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7556630 con 0x5619f7553470 2023-10-06T02:25:26.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.970+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [write 0~554] v99'88 uv88 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:26.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.970+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f75569e0 con 0x5619f7553470 2023-10-06T02:25:26.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.971+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [omap-set-header] v99'89 uv89 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:26.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.971+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7556d90 con 0x5619f7553470 2023-10-06T02:25:26.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.974+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 200.00000000 [create] v99'90 uv74 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:26.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.974+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7557140 con 0x5619f7553470 2023-10-06T02:25:26.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.977+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 200.00000000 [delete] v99'91 uv91 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:26.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.977+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f75574f0 con 0x5619f7553470 2023-10-06T02:25:26.980 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:25:26.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.980+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v99'92 uv92 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:26.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.980+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f75578a0 con 0x5619f7553470 2023-10-06T02:25:26.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.982+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [write 0~90] v99'93 uv93 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:26.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.982+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f75578a0 con 0x5619f7553470 2023-10-06T02:25:26.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.985+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [omap-set-header] v99'94 uv94 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:26.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.985+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f75578a0 con 0x5619f7553470 2023-10-06T02:25:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.988+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000001 [create] v99'95 uv79 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.988+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f75578a0 con 0x5619f7553470 2023-10-06T02:25:26.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.990+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000001 [delete] v99'96 uv96 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:26.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.991+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f75578a0 con 0x5619f7553470 2023-10-06T02:25:26.992 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:25:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.991+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v99'97 uv97 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.992+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755afc0 con 0x5619f7553470 2023-10-06T02:25:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.994+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [write 0~14075] v99'98 uv98 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:26.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.994+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755afc0 con 0x5619f7553470 2023-10-06T02:25:26.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.997+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [omap-set-header] v99'99 uv99 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:26.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:26.997+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f75578a0 con 0x5619f7553470 2023-10-06T02:25:27.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.000+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 606.00000000 [create] v99'100 uv85 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:27.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.000+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f75578a0 con 0x5619f7553470 2023-10-06T02:25:27.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.003+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 606.00000000 [delete] v99'101 uv101 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:27.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.003+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f75578a0 con 0x5619f7553470 2023-10-06T02:25:27.006 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:25:27.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.005+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v99'102 uv102 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:27.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.005+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f75588b0 con 0x5619f7553470 2023-10-06T02:25:27.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.006+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [setxattr (30)] v99'103 uv103 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:27.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.007+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f75588b0 con 0x5619f7553470 2023-10-06T02:25:27.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.009+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [setxattr (62)] v99'104 uv104 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:27.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.009+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f75578a0 con 0x5619f7553470 2023-10-06T02:25:27.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.012+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [omap-set-header] v99'105 uv105 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:27.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.012+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5619f7557db0 0x5619f755a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.012+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:51 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755a6d0 con 0x5619f7557db0 2023-10-06T02:25:27.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.012+0000 7f973bfff700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5619f7557db0 0x5619f755a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.012+0000 7f973bfff700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5619f7557db0 0x5619f755a190 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:27.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.014+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(51 607.00000000 [create] v99'21 uv20 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.014+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:52 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755aa80 con 0x5619f7557db0 2023-10-06T02:25:27.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.017+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(52 607.00000000 [delete] v99'22 uv22 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.017+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755ae70 con 0x5619f7557db0 2023-10-06T02:25:27.020 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:25:27.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.020+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(53 607.00000000 [create] v99'23 uv23 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.020+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755c770 con 0x5619f7557db0 2023-10-06T02:25:27.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.022+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(54 607.00000000 [setxattr (30)] v99'24 uv24 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.022+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755cb20 con 0x5619f7557db0 2023-10-06T02:25:27.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.025+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(55 607.00000000 [setxattr (62)] v99'25 uv25 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.025+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755b760 con 0x5619f7557db0 2023-10-06T02:25:27.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.028+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(56 607.00000000 [omap-set-header] v99'26 uv26 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.028+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755bb80 con 0x5619f7557db0 2023-10-06T02:25:27.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.029+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(57 mds0_openfiles.0 [create] v99'16 uv15 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.029+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755bfd0 con 0x5619f7557db0 2023-10-06T02:25:27.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.029+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(58 mds0_openfiles.0 [delete] v99'17 uv17 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.030+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755bfd0 con 0x5619f7557db0 2023-10-06T02:25:27.032 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:25:27.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.030+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(59 mds0_openfiles.0 [create] v99'18 uv18 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.030+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755bf80 con 0x5619f7557db0 2023-10-06T02:25:27.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.031+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(60 mds0_openfiles.0 [omap-set-header] v99'19 uv19 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.031+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:61 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755c3a0 con 0x5619f7553470 2023-10-06T02:25:27.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.032+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(61 608.00000000 [create] v99'21 uv20 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:27.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.032+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:62 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755c3a0 con 0x5619f7553470 2023-10-06T02:25:27.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.033+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(62 608.00000000 [delete] v99'22 uv22 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:27.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.033+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755c3a0 con 0x5619f7553470 2023-10-06T02:25:27.035 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:25:27.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.035+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v99'23 uv23 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:27.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.035+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755c3a0 con 0x5619f7553470 2023-10-06T02:25:27.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.036+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [setxattr (30)] v99'24 uv24 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:27.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.036+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755c3a0 con 0x5619f7553470 2023-10-06T02:25:27.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.037+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [setxattr (62)] v99'25 uv25 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:27.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.037+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755c3a0 con 0x5619f7553470 2023-10-06T02:25:27.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.038+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [omap-set-header] v99'26 uv26 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7553470 2023-10-06T02:25:27.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.038+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5619f755bf30 0x5619f755f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.038+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:67 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755f930 con 0x5619f755bf30 2023-10-06T02:25:27.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.038+0000 7f97444b3700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5619f755bf30 0x5619f755f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.038+0000 7f97444b3700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5619f755bf30 0x5619f755f3f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:27.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.040+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(67 604.00000000 [create] v99'37 uv31 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f755bf30 2023-10-06T02:25:27.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.040+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:68 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755f930 con 0x5619f755bf30 2023-10-06T02:25:27.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.043+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(68 604.00000000 [delete] v99'38 uv38 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f755bf30 2023-10-06T02:25:27.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.043+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755f930 con 0x5619f755bf30 2023-10-06T02:25:27.046 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:25:27.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.046+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(69 604.00000000 [create] v99'39 uv39 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f755bf30 2023-10-06T02:25:27.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.046+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f75609c0 con 0x5619f755bf30 2023-10-06T02:25:27.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.048+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(70 604.00000000 [setxattr (30)] v99'40 uv40 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c02d040 con 0x5619f755bf30 2023-10-06T02:25:27.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.048+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7560980 con 0x5619f755bf30 2023-10-06T02:25:27.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.051+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(71 604.00000000 [setxattr (62)] v99'41 uv41 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f755bf30 2023-10-06T02:25:27.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.051+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7560980 con 0x5619f755bf30 2023-10-06T02:25:27.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.054+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(72 604.00000000 [omap-set-header] v99'42 uv42 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f755bf30 2023-10-06T02:25:27.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.054+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7560980 con 0x5619f755bf30 2023-10-06T02:25:27.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.056+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(73 500.00000000 [create] v99'43 uv36 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f755bf30 2023-10-06T02:25:27.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.056+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7560980 con 0x5619f755bf30 2023-10-06T02:25:27.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.061+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(74 500.00000000 [delete] v99'44 uv44 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f755bf30 2023-10-06T02:25:27.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.062+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7560980 con 0x5619f755bf30 2023-10-06T02:25:27.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.063+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(75 500.00000000 [create] v99'45 uv45 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f755bf30 2023-10-06T02:25:27.063 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:25:27.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.063+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755f930 con 0x5619f755bf30 2023-10-06T02:25:27.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.065+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(76 500.00000000 [write 0~90] v99'46 uv46 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f755bf30 2023-10-06T02:25:27.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.065+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755f930 con 0x5619f755bf30 2023-10-06T02:25:27.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.068+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(77 500.00000000 [omap-set-header] v99'47 uv47 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f755bf30 2023-10-06T02:25:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.068+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5619f7560240 0x5619f7562dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.068+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:78 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755f930 con 0x5619f7560240 2023-10-06T02:25:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.068+0000 7f9743cb2700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5619f7560240 0x5619f7562dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.069+0000 7f9743cb2700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5619f7560240 0x5619f7562dc0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:27.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.070+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(78 mds_snaptable [create] v99'17 uv16 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7560240 2023-10-06T02:25:27.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.070+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:79 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755f930 con 0x5619f7560240 2023-10-06T02:25:27.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.071+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(79 mds_snaptable [delete] v99'18 uv18 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7560240 2023-10-06T02:25:27.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.071+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755f930 con 0x5619f7560240 2023-10-06T02:25:27.074 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:25:27.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.073+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(80 mds_snaptable [create] v99'19 uv19 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7560240 2023-10-06T02:25:27.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.074+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f755f930 con 0x5619f7560240 2023-10-06T02:25:27.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.079+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(81 mds_snaptable [write 0~70] v99'20 uv20 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7560240 2023-10-06T02:25:27.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.079+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7563300 con 0x5619f7560240 2023-10-06T02:25:27.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.080+0000 7f9743cb2700 1 -- 172.21.15.6:0/1602208807 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v99'21 uv21 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9734008c70 con 0x5619f7560240 2023-10-06T02:25:27.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.080+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:83 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7563300 con 0x5619f7557db0 2023-10-06T02:25:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.081+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(83 605.00000000 [create] v99'21 uv20 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.081+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:84 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7563300 con 0x5619f7557db0 2023-10-06T02:25:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.082+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(84 605.00000000 [delete] v99'22 uv22 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.082+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7563300 con 0x5619f7557db0 2023-10-06T02:25:27.084 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:25:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.084+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(85 605.00000000 [create] v99'23 uv23 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.084+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7564310 con 0x5619f7557db0 2023-10-06T02:25:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.085+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v99'24 uv24 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.085+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7564310 con 0x5619f7557db0 2023-10-06T02:25:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.086+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v99'25 uv25 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.086+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7563300 con 0x5619f7557db0 2023-10-06T02:25:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.087+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(88 605.00000000 [omap-set-header] v99'26 uv26 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.087+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5619f7563810 0x5619f7565bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.087+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:89 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7566130 con 0x5619f7563810 2023-10-06T02:25:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.087+0000 7f973bfff700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5619f7563810 0x5619f7565bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.087+0000 7f973bfff700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5619f7563810 0x5619f7565bf0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.089+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(89 mds0_inotable [create] v99'34 uv28 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7563810 2023-10-06T02:25:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.089+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:90 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7566130 con 0x5619f7563810 2023-10-06T02:25:27.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.090+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(90 mds0_inotable [delete] v99'35 uv35 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7563810 2023-10-06T02:25:27.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.090+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7566590 con 0x5619f7563810 2023-10-06T02:25:27.093 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:25:27.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.092+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(91 mds0_inotable [create] v99'36 uv36 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7563810 2023-10-06T02:25:27.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.092+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7566590 con 0x5619f7563810 2023-10-06T02:25:27.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.095+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(92 mds0_inotable [write 0~34] v99'37 uv37 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7563810 2023-10-06T02:25:27.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.095+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7566590 con 0x5619f7563810 2023-10-06T02:25:27.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.098+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v99'38 uv38 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7563810 2023-10-06T02:25:27.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.098+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7566590 con 0x5619f7563810 2023-10-06T02:25:27.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.100+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(94 100.00000000 [create] v99'39 uv33 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7563810 2023-10-06T02:25:27.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.100+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7566590 con 0x5619f7563810 2023-10-06T02:25:27.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.103+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(95 100.00000000 [delete] v99'40 uv40 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7563810 2023-10-06T02:25:27.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.103+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7566590 con 0x5619f7563810 2023-10-06T02:25:27.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.108+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(96 100.00000000 [create] v99'41 uv41 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7563810 2023-10-06T02:25:27.109 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:25:27.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.108+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7566590 con 0x5619f7563810 2023-10-06T02:25:27.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.109+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(97 100.00000000 [omap-set-header] v99'42 uv42 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7563810 2023-10-06T02:25:27.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.109+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569300 con 0x5619f7563810 2023-10-06T02:25:27.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.112+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v99'43 uv43 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7563810 2023-10-06T02:25:27.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.112+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:99 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7566a80 con 0x5619f7557db0 2023-10-06T02:25:27.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.113+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(99 mds0_sessionmap [create] v99'18 uv17 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.113+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:100 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7566a80 con 0x5619f7557db0 2023-10-06T02:25:27.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.114+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(100 mds0_sessionmap [delete] v99'19 uv19 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.114+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7566a80 con 0x5619f7557db0 2023-10-06T02:25:27.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.115+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(101 mds0_sessionmap [create] v99'20 uv20 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.115 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:25:27.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.115+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7566a80 con 0x5619f7557db0 2023-10-06T02:25:27.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.116+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v99'21 uv21 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.116+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5619f7566f90 0x5619f7567360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.116+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:103 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569a50 con 0x5619f7566f90 2023-10-06T02:25:27.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.116+0000 7f97444b3700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5619f7566f90 0x5619f7567360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.117+0000 7f97444b3700 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5619f7566f90 0x5619f7567360 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:27.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.117+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(103 609.00000000 [create] v99'21 uv20 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f7566f90 2023-10-06T02:25:27.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.118+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:104 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569a50 con 0x5619f7566f90 2023-10-06T02:25:27.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.120+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(104 609.00000000 [delete] v99'22 uv22 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f7566f90 2023-10-06T02:25:27.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.120+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569a50 con 0x5619f7566f90 2023-10-06T02:25:27.123 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:25:27.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.123+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(105 609.00000000 [create] v99'23 uv23 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f7566f90 2023-10-06T02:25:27.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.123+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f756aa60 con 0x5619f7566f90 2023-10-06T02:25:27.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.126+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v99'24 uv24 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f7566f90 2023-10-06T02:25:27.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.126+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f756aa60 con 0x5619f7566f90 2023-10-06T02:25:27.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.128+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v99'25 uv25 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f7566f90 2023-10-06T02:25:27.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.128+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569a50 con 0x5619f7566f90 2023-10-06T02:25:27.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.131+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(108 609.00000000 [omap-set-header] v99'26 uv26 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f7566f90 2023-10-06T02:25:27.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.131+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:109 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569a50 con 0x5619f755bf30 2023-10-06T02:25:27.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.132+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(109 400.00000000 [create] v99'17 uv16 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f755bf30 2023-10-06T02:25:27.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.132+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:110 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569a50 con 0x5619f755bf30 2023-10-06T02:25:27.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.133+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(110 400.00000000 [delete] v99'18 uv18 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f755bf30 2023-10-06T02:25:27.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.133+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569a50 con 0x5619f755bf30 2023-10-06T02:25:27.134 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:25:27.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.134+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(111 400.00000000 [create] v99'19 uv19 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f755bf30 2023-10-06T02:25:27.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.134+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569a50 con 0x5619f755bf30 2023-10-06T02:25:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.137+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(112 400.00000000 [write 0~22] v99'20 uv20 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f755bf30 2023-10-06T02:25:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.137+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569a50 con 0x5619f755bf30 2023-10-06T02:25:27.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.139+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(113 400.00000000 [omap-set-header] v99'21 uv21 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f973c03b040 con 0x5619f755bf30 2023-10-06T02:25:27.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.139+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:114 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569a50 con 0x5619f7557db0 2023-10-06T02:25:27.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.140+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(114 100.00000000.inode [create] v99'45 uv37 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.140+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:115 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569a50 con 0x5619f7557db0 2023-10-06T02:25:27.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.142+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(115 100.00000000.inode [delete] v99'46 uv46 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.142+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569a50 con 0x5619f7557db0 2023-10-06T02:25:27.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.143+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(116 100.00000000.inode [create] v99'47 uv47 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.143 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:25:27.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.143+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569a50 con 0x5619f7557db0 2023-10-06T02:25:27.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.144+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(117 100.00000000.inode [write 0~554] v99'48 uv48 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.144+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569e50 con 0x5619f7557db0 2023-10-06T02:25:27.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.146+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v99'49 uv49 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.146+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569e50 con 0x5619f7557db0 2023-10-06T02:25:27.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.147+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(119 1.00000000 [create] v99'50 uv44 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.147+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569a50 con 0x5619f7557db0 2023-10-06T02:25:27.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.148+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(120 1.00000000 [delete] v99'51 uv51 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.148+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569a50 con 0x5619f7557db0 2023-10-06T02:25:27.151 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:25:27.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.151+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(121 1.00000000 [create] v99'52 uv52 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.151+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f756aa60 con 0x5619f7557db0 2023-10-06T02:25:27.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.153+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v99'53 uv53 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.153+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f756aa60 con 0x5619f7557db0 2023-10-06T02:25:27.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.154+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v99'54 uv54 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.154+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569f40 con 0x5619f7557db0 2023-10-06T02:25:27.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.160+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(124 1.00000000 [omap-set-header] v99'55 uv55 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.160+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99) v8 -- 0x5619f7569f40 con 0x5619f7557db0 2023-10-06T02:25:27.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f973bfff700 1 -- 172.21.15.6:0/1602208807 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v99'56 uv56 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f972c052c70 con 0x5619f7557db0 2023-10-06T02:25:27.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5619f7557db0 msgr2=0x5619f755a190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5619f7557db0 0x5619f755a190 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5619f752e8b0 msgr2=0x5619f7531050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5619f752e8b0 0x5619f7531050 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5619f7563810 msgr2=0x5619f7565bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5619f7563810 0x5619f7565bf0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5619f7553470 msgr2=0x5619f7555850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5619f7553470 0x5619f7555850 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5619f7566f90 msgr2=0x5619f7567360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5619f7566f90 0x5619f7567360 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5619f7560240 msgr2=0x5619f7562dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5619f7560240 0x5619f7562dc0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5619f755bf30 msgr2=0x5619f755f3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5619f755bf30 0x5619f755f3f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 reap_dead start 2023-10-06T02:25:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 reap_dead start 2023-10-06T02:25:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 reap_dead start 2023-10-06T02:25:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.161+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 reap_dead start 2023-10-06T02:25:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.162+0000 7f97444b3700 1 -- 172.21.15.6:0/1602208807 reap_dead start 2023-10-06T02:25:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.162+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9724065890 msgr2=0x7f9724067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.162+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9724065890 0x7f9724067d40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9734005fd0 tx=0x7f9734005bb0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.162+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619f74a9db0 msgr2=0x5619f75260f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.162+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619f74a9db0 0x5619f75260f0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f972c00dfb0 tx=0x7f972c000bc0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.162+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 shutdown_connections 2023-10-06T02:25:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.162+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619f74a9db0 0x5619f75260f0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.162+0000 7f974aa77000 1 --2- 172.21.15.6:0/1602208807 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9724065890 0x7f9724067d40 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.162+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 >> 172.21.15.6:0/1602208807 conn(0x5619f7460d50 msgr2=0x5619f7535070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.162+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 shutdown_connections 2023-10-06T02:25:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.162+0000 7f974aa77000 1 -- 172.21.15.6:0/1602208807 wait complete. 2023-10-06T02:25:27.166 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 200.00000000 2023-10-06T02:25:27.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.244+0000 7f3f90b46000 1 Processor -- start 2023-10-06T02:25:27.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.244+0000 7f3f90b46000 1 -- start start 2023-10-06T02:25:27.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.244+0000 7f3f90b46000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55782633c7a0 0x55782633b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.244+0000 7f3f90b46000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578263c7cb0 0x5578262f5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.244+0000 7f3f90b46000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578263cbaa0 0x5578263c4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.244+0000 7f3f90b46000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782629b320 con 0x5578263c7cb0 2023-10-06T02:25:27.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.244+0000 7f3f90b46000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782623f980 con 0x55782633c7a0 2023-10-06T02:25:27.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.244+0000 7f3f90b46000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55782623f620 con 0x5578263cbaa0 2023-10-06T02:25:27.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.245+0000 7f3f89580700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578263c7cb0 0x5578262f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.245+0000 7f3f89580700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578263c7cb0 0x5578262f5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53734/0 (socket says 172.21.15.6:53734) 2023-10-06T02:25:27.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.245+0000 7f3f89580700 1 -- 172.21.15.6:0/2874556038 learned_addr learned my addr 172.21.15.6:0/2874556038 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:27.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.245+0000 7f3f89d81700 1 --2- 172.21.15.6:0/2874556038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55782633c7a0 0x55782633b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.245+0000 7f3f8a582700 1 --2- 172.21.15.6:0/2874556038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578263cbaa0 0x5578263c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.245+0000 7f3f89580700 1 -- 172.21.15.6:0/2874556038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578263cbaa0 msgr2=0x5578263c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:27.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.245+0000 7f3f89580700 1 --2- 172.21.15.6:0/2874556038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578263cbaa0 0x5578263c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.245+0000 7f3f89580700 1 -- 172.21.15.6:0/2874556038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55782633c7a0 msgr2=0x55782633b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:27.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.245+0000 7f3f89580700 1 --2- 172.21.15.6:0/2874556038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55782633c7a0 0x55782633b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.245+0000 7f3f89580700 1 -- 172.21.15.6:0/2874556038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f74005cf0 con 0x5578263c7cb0 2023-10-06T02:25:27.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.245+0000 7f3f89d81700 1 --2- 172.21.15.6:0/2874556038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55782633c7a0 0x55782633b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:27.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.245+0000 7f3f8a582700 1 --2- 172.21.15.6:0/2874556038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578263cbaa0 0x5578263c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:27.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.245+0000 7f3f89580700 1 --2- 172.21.15.6:0/2874556038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578263c7cb0 0x5578262f5300 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x5578262f4b10 tx=0x7f3f74015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e78ed6d307511a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:27.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.245+0000 7f3f83fff700 1 -- 172.21.15.6:0/2874556038 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f74007610 con 0x5578263c7cb0 2023-10-06T02:25:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.245+0000 7f3f83fff700 1 -- 172.21.15.6:0/2874556038 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f74002f70 con 0x5578263c7cb0 2023-10-06T02:25:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.245+0000 7f3f83fff700 1 -- 172.21.15.6:0/2874556038 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f740078e0 con 0x5578263c7cb0 2023-10-06T02:25:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.246+0000 7f3f90b46000 1 -- 172.21.15.6:0/2874556038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578263c7cb0 msgr2=0x5578262f5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.246+0000 7f3f90b46000 1 --2- 172.21.15.6:0/2874556038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578263c7cb0 0x5578262f5300 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x5578262f4b10 tx=0x7f3f74015000 comp rx=0 tx=0).stop 2023-10-06T02:25:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.246+0000 7f3f90b46000 1 -- 172.21.15.6:0/2874556038 shutdown_connections 2023-10-06T02:25:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.246+0000 7f3f90b46000 1 --2- 172.21.15.6:0/2874556038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578263cbaa0 0x5578263c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.246+0000 7f3f90b46000 1 --2- 172.21.15.6:0/2874556038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55782633c7a0 0x55782633b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.246+0000 7f3f90b46000 1 --2- 172.21.15.6:0/2874556038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578263c7cb0 0x5578262f5300 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.246+0000 7f3f90b46000 1 -- 172.21.15.6:0/2874556038 >> 172.21.15.6:0/2874556038 conn(0x5578262f4d50 msgr2=0x557826320fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.246+0000 7f3f90b46000 1 -- 172.21.15.6:0/2874556038 shutdown_connections 2023-10-06T02:25:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.246+0000 7f3f90b46000 1 -- 172.21.15.6:0/2874556038 wait complete. 2023-10-06T02:25:27.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.246+0000 7f3f90b46000 1 Processor -- start 2023-10-06T02:25:27.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.246+0000 7f3f90b46000 1 -- start start 2023-10-06T02:25:27.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.247+0000 7f3f90b46000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55782633c7a0 0x5578263c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.247+0000 7f3f90b46000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578263c7cb0 0x5578263396e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.247+0000 7f3f90b46000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578263cbaa0 0x5578263bc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.247+0000 7f3f90b46000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557826236400 con 0x5578263cbaa0 2023-10-06T02:25:27.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.247+0000 7f3f90b46000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578263bc9c0 con 0x55782633c7a0 2023-10-06T02:25:27.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.247+0000 7f3f90b46000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578263238f0 con 0x5578263c7cb0 2023-10-06T02:25:27.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.247+0000 7f3f8a582700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578263cbaa0 0x5578263bc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.247+0000 7f3f8a582700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578263cbaa0 0x5578263bc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53738/0 (socket says 172.21.15.6:53738) 2023-10-06T02:25:27.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.247+0000 7f3f8a582700 1 -- 172.21.15.6:0/3612483392 learned_addr learned my addr 172.21.15.6:0/3612483392 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:27.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.247+0000 7f3f89580700 1 --2- 172.21.15.6:0/3612483392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578263c7cb0 0x5578263396e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.247+0000 7f3f89d81700 1 --2- 172.21.15.6:0/3612483392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55782633c7a0 0x5578263c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.247+0000 7f3f8a582700 1 -- 172.21.15.6:0/3612483392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578263c7cb0 msgr2=0x5578263396e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.247+0000 7f3f8a582700 1 --2- 172.21.15.6:0/3612483392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5578263c7cb0 0x5578263396e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.247+0000 7f3f8a582700 1 -- 172.21.15.6:0/3612483392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55782633c7a0 msgr2=0x5578263c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.247+0000 7f3f8a582700 1 --2- 172.21.15.6:0/3612483392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55782633c7a0 0x5578263c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.247+0000 7f3f8a582700 1 -- 172.21.15.6:0/3612483392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55782624e3d0 con 0x5578263cbaa0 2023-10-06T02:25:27.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.248+0000 7f3f8a582700 1 --2- 172.21.15.6:0/3612483392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578263cbaa0 0x5578263bc480 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400d210 tx=0x7f3f84008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:27.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.248+0000 7f3f827fc700 1 -- 172.21.15.6:0/3612483392 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400dd50 con 0x5578263cbaa0 2023-10-06T02:25:27.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.248+0000 7f3f827fc700 1 -- 172.21.15.6:0/3612483392 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f840030d0 con 0x5578263cbaa0 2023-10-06T02:25:27.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.248+0000 7f3f827fc700 1 -- 172.21.15.6:0/3612483392 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f84001590 con 0x5578263cbaa0 2023-10-06T02:25:27.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.248+0000 7f3f90b46000 1 -- 172.21.15.6:0/3612483392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557826241ae0 con 0x5578263cbaa0 2023-10-06T02:25:27.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.248+0000 7f3f90b46000 1 -- 172.21.15.6:0/3612483392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557826241540 con 0x5578263cbaa0 2023-10-06T02:25:27.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.249+0000 7f3f827fc700 1 -- 172.21.15.6:0/3612483392 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f84001900 con 0x5578263cbaa0 2023-10-06T02:25:27.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.250+0000 7f3f827fc700 1 --2- 172.21.15.6:0/3612483392 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3f6c0658c0 0x7f3f6c067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.250+0000 7f3f827fc700 1 -- 172.21.15.6:0/3612483392 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6722+0+0 (secure 0 0 0) 0x7f3f84082e50 con 0x5578263cbaa0 2023-10-06T02:25:27.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.250+0000 7f3f89d81700 1 --2- 172.21.15.6:0/3612483392 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3f6c0658c0 0x7f3f6c067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.250+0000 7f3f90b46000 1 --2- 172.21.15.6:0/3612483392 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x557826337e50 0x557826338250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.250+0000 7f3f90b46000 1 -- 172.21.15.6:0/3612483392 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e99) v8 -- 0x557826338790 con 0x557826337e50 2023-10-06T02:25:27.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.250+0000 7f3f89580700 1 --2- 172.21.15.6:0/3612483392 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x557826337e50 0x557826338250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.250+0000 7f3f89d81700 1 --2- 172.21.15.6:0/3612483392 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3f6c0658c0 0x7f3f6c067d70 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c000c00 tx=0x7f3f7c001920 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.250+0000 7f3f89580700 1 --2- 172.21.15.6:0/3612483392 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x557826337e50 0x557826338250 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.252+0000 7f3f89580700 1 -- 172.21.15.6:0/3612483392 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 200.00000000 [delete] v99'106 uv106 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f3f74007510 con 0x557826337e50 2023-10-06T02:25:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.252+0000 7f3f90b46000 1 -- 172.21.15.6:0/3612483392 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x557826337e50 msgr2=0x557826338250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.252+0000 7f3f90b46000 1 --2- 172.21.15.6:0/3612483392 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x557826337e50 0x557826338250 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.252+0000 7f3f90b46000 1 -- 172.21.15.6:0/3612483392 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3f6c0658c0 msgr2=0x7f3f6c067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.252+0000 7f3f90b46000 1 --2- 172.21.15.6:0/3612483392 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3f6c0658c0 0x7f3f6c067d70 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c000c00 tx=0x7f3f7c001920 comp rx=0 tx=0).stop 2023-10-06T02:25:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.252+0000 7f3f90b46000 1 -- 172.21.15.6:0/3612483392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578263cbaa0 msgr2=0x5578263bc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.252+0000 7f3f90b46000 1 --2- 172.21.15.6:0/3612483392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5578263cbaa0 0x5578263bc480 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400d210 tx=0x7f3f84008040 comp rx=0 tx=0).stop 2023-10-06T02:25:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.252+0000 7f3f8a582700 1 -- 172.21.15.6:0/3612483392 reap_dead start 2023-10-06T02:25:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.252+0000 7f3f90b46000 1 -- 172.21.15.6:0/3612483392 shutdown_connections 2023-10-06T02:25:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.252+0000 7f3f90b46000 1 -- 172.21.15.6:0/3612483392 >> 172.21.15.6:0/3612483392 conn(0x5578262f4d50 msgr2=0x5578262f5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.252+0000 7f3f90b46000 1 -- 172.21.15.6:0/3612483392 shutdown_connections 2023-10-06T02:25:27.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.252+0000 7f3f90b46000 1 -- 172.21.15.6:0/3612483392 wait complete. 2023-10-06T02:25:27.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:25:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.419+0000 7f9485e3b700 1 Processor -- start 2023-10-06T02:25:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.419+0000 7f9485e3b700 1 -- start start 2023-10-06T02:25:27.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.420+0000 7f9485e3b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94800cd7d0 0x7f94800d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.420+0000 7f9485e3b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f94800b0810 0x7f94800d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.420+0000 7f9485e3b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94800d0c20 con 0x7f94800cd400 2023-10-06T02:25:27.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.420+0000 7f9485e3b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94800af770 con 0x7f94800cd7d0 2023-10-06T02:25:27.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.420+0000 7f9485e3b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94800afa50 con 0x7f94800b0810 2023-10-06T02:25:27.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.420+0000 7f947ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94800cd7d0 0x7f94800d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.420+0000 7f947ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94800cd7d0 0x7f94800d01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53750/0 (socket says 172.21.15.6:53750) 2023-10-06T02:25:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.420+0000 7f947ffff700 1 -- 172.21.15.6:0/2165474694 learned_addr learned my addr 172.21.15.6:0/2165474694 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.420+0000 7f948563a700 1 --2- 172.21.15.6:0/2165474694 >> v2:172.21.15.175:3300/0 conn(0x7f94800b0810 0x7f94800d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.420+0000 7f947ffff700 1 -- 172.21.15.6:0/2165474694 >> v2:172.21.15.175:3300/0 conn(0x7f94800b0810 msgr2=0x7f94800d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.420+0000 7f947ffff700 1 --2- 172.21.15.6:0/2165474694 >> v2:172.21.15.175:3300/0 conn(0x7f94800b0810 0x7f94800d06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.420+0000 7f947ffff700 1 -- 172.21.15.6:0/2165474694 >> v1:172.21.15.175:6789/0 conn(0x7f94800cd400 legacy=0x7f94800b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.420+0000 7f947ffff700 1 -- 172.21.15.6:0/2165474694 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94800afd30 con 0x7f94800cd7d0 2023-10-06T02:25:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.420+0000 7f947ffff700 1 --2- 172.21.15.6:0/2165474694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94800cd7d0 0x7f94800d01a0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f9470009f20 tx=0x7f9470009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88308df5b6b000b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.421+0000 7f947f7fe700 1 -- 172.21.15.6:0/2165474694 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947000e070 con 0x7f94800cd7d0 2023-10-06T02:25:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.421+0000 7f947f7fe700 1 -- 172.21.15.6:0/2165474694 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947000b990 con 0x7f94800cd7d0 2023-10-06T02:25:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.421+0000 7f947f7fe700 1 -- 172.21.15.6:0/2165474694 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94700092e0 con 0x7f94800cd7d0 2023-10-06T02:25:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.421+0000 7f9485e3b700 1 -- 172.21.15.6:0/2165474694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94800cd7d0 msgr2=0x7f94800d01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.421+0000 7f9485e3b700 1 --2- 172.21.15.6:0/2165474694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94800cd7d0 0x7f94800d01a0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f9470009f20 tx=0x7f9470009840 comp rx=0 tx=0).stop 2023-10-06T02:25:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.421+0000 7f9485e3b700 1 -- 172.21.15.6:0/2165474694 shutdown_connections 2023-10-06T02:25:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.421+0000 7f9485e3b700 1 --2- 172.21.15.6:0/2165474694 >> v2:172.21.15.175:3300/0 conn(0x7f94800b0810 0x7f94800d06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.421+0000 7f9485e3b700 1 --2- 172.21.15.6:0/2165474694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94800cd7d0 0x7f94800d01a0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.421+0000 7f9485e3b700 1 -- 172.21.15.6:0/2165474694 >> 172.21.15.6:0/2165474694 conn(0x7f948006a110 msgr2=0x7f948006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.421+0000 7f9485e3b700 1 -- 172.21.15.6:0/2165474694 shutdown_connections 2023-10-06T02:25:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.421+0000 7f9485e3b700 1 -- 172.21.15.6:0/2165474694 wait complete. 2023-10-06T02:25:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.422+0000 7f9485e3b700 1 Processor -- start 2023-10-06T02:25:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.422+0000 7f9485e3b700 1 -- start start 2023-10-06T02:25:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.423+0000 7f9485e3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94800b0810 0x7f948015c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.423+0000 7f9485e3b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94800cd400 0x7f94800c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.423+0000 7f9485e3b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94800c68a0 0x7f948016ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.423+0000 7f9485e3b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9480157f30 con 0x7f94800b0810 2023-10-06T02:25:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.423+0000 7f9485e3b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9480157340 con 0x7f94800c68a0 2023-10-06T02:25:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.423+0000 7f9485e3b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9480157600 con 0x7f94800cd400 2023-10-06T02:25:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.423+0000 7f9484e39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94800b0810 0x7f948015c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.423+0000 7f9484e39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94800b0810 0x7f948015c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53758/0 (socket says 172.21.15.6:53758) 2023-10-06T02:25:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.423+0000 7f9484e39700 1 -- 172.21.15.6:0/2811072769 learned_addr learned my addr 172.21.15.6:0/2811072769 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.423+0000 7f948563a700 1 --2- 172.21.15.6:0/2811072769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94800c68a0 0x7f948016ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.423+0000 7f947ffff700 1 --2- 172.21.15.6:0/2811072769 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94800cd400 0x7f94800c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.424+0000 7f9484e39700 1 -- 172.21.15.6:0/2811072769 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94800cd400 msgr2=0x7f94800c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.424+0000 7f9484e39700 1 --2- 172.21.15.6:0/2811072769 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94800cd400 0x7f94800c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.424+0000 7f9484e39700 1 -- 172.21.15.6:0/2811072769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94800c68a0 msgr2=0x7f948016ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.424+0000 7f9484e39700 1 --2- 172.21.15.6:0/2811072769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94800c68a0 0x7f948016ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.424+0000 7f9484e39700 1 -- 172.21.15.6:0/2811072769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9470009ae0 con 0x7f94800b0810 2023-10-06T02:25:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.424+0000 7f9484e39700 1 --2- 172.21.15.6:0/2811072769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94800b0810 0x7f948015c020 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f947800c7c0 tx=0x7f9478007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.424+0000 7f947cff9700 1 -- 172.21.15.6:0/2811072769 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478011590 con 0x7f94800b0810 2023-10-06T02:25:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.424+0000 7f947cff9700 1 -- 172.21.15.6:0/2811072769 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9478011710 con 0x7f94800b0810 2023-10-06T02:25:27.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.424+0000 7f9485e3b700 1 -- 172.21.15.6:0/2811072769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94801578e0 con 0x7f94800b0810 2023-10-06T02:25:27.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.424+0000 7f947cff9700 1 -- 172.21.15.6:0/2811072769 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478011ad0 con 0x7f94800b0810 2023-10-06T02:25:27.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.424+0000 7f9485e3b700 1 -- 172.21.15.6:0/2811072769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948015c560 con 0x7f94800b0810 2023-10-06T02:25:27.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.425+0000 7f9485e3b700 1 -- 172.21.15.6:0/2811072769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9480157d80 con 0x7f94800b0810 2023-10-06T02:25:27.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.425+0000 7f947cff9700 1 -- 172.21.15.6:0/2811072769 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f947801b3b0 con 0x7f94800b0810 2023-10-06T02:25:27.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.426+0000 7f947cff9700 1 --2- 172.21.15.6:0/2811072769 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9460066f30 0x7f94600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:27.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.426+0000 7f947cff9700 1 -- 172.21.15.6:0/2811072769 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6722+0+0 (secure 0 0 0) 0x7f9478083e30 con 0x7f94800b0810 2023-10-06T02:25:27.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.426+0000 7f947ffff700 1 --2- 172.21.15.6:0/2811072769 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9460066f30 0x7f94600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:27.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.426+0000 7f947ffff700 1 --2- 172.21.15.6:0/2811072769 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9460066f30 0x7f94600693e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9470009f20 tx=0x7f9470018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:27.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.430+0000 7f947cff9700 1 -- 172.21.15.6:0/2811072769 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9478050d50 con 0x7f94800b0810 2023-10-06T02:25:27.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.671+0000 7f9485e3b700 1 -- 172.21.15.6:0/2811072769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f94800b0f40 con 0x7f94800b0810 2023-10-06T02:25:27.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.879+0000 7f947cff9700 1 -- 172.21.15.6:0/2811072769 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v113) v1 ==== 162+0+0 (secure 0 0 0) 0x7f9478017070 con 0x7f94800b0810 2023-10-06T02:25:27.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.881+0000 7f9485e3b700 1 -- 172.21.15.6:0/2811072769 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9460066f30 msgr2=0x7f94600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.881+0000 7f9485e3b700 1 --2- 172.21.15.6:0/2811072769 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9460066f30 0x7f94600693e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9470009f20 tx=0x7f9470018000 comp rx=0 tx=0).stop 2023-10-06T02:25:27.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.881+0000 7f9485e3b700 1 -- 172.21.15.6:0/2811072769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94800b0810 msgr2=0x7f948015c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:27.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.881+0000 7f9485e3b700 1 --2- 172.21.15.6:0/2811072769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94800b0810 0x7f948015c020 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f947800c7c0 tx=0x7f9478007f70 comp rx=0 tx=0).stop 2023-10-06T02:25:27.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.881+0000 7f9485e3b700 1 -- 172.21.15.6:0/2811072769 shutdown_connections 2023-10-06T02:25:27.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.881+0000 7f9485e3b700 1 --2- 172.21.15.6:0/2811072769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94800c68a0 0x7f948016ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.881+0000 7f9485e3b700 1 --2- 172.21.15.6:0/2811072769 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9460066f30 0x7f94600693e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.881+0000 7f9485e3b700 1 --2- 172.21.15.6:0/2811072769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94800b0810 0x7f948015c020 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.881+0000 7f9485e3b700 1 --2- 172.21.15.6:0/2811072769 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94800cd400 0x7f94800c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:27.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.881+0000 7f9485e3b700 1 -- 172.21.15.6:0/2811072769 >> 172.21.15.6:0/2811072769 conn(0x7f948006a110 msgr2=0x7f94800cc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:27.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.881+0000 7f9485e3b700 1 -- 172.21.15.6:0/2811072769 shutdown_connections 2023-10-06T02:25:27.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:27.881+0000 7f9485e3b700 1 -- 172.21.15.6:0/2811072769 wait complete. 2023-10-06T02:25:27.883 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:25:27.887 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:25:27.887+0000 7fd16bae1700 -1 log_channel(cluster) log [ERR] : Error recovering journal 0x200: (2) No such file or directory 2023-10-06T02:25:27.888 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:25:27.888+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:25:27.888 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:25:27.888+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:25:27.895 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:27.898 INFO:tasks.ceph.mds.a.smithi006.stderr: -14> 2023-10-06T02:25:27.887+0000 7fd16bae1700 -1 log_channel(cluster) log [ERR] : Error recovering journal 0x200: (2) No such file or directory 2023-10-06T02:25:27.918 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:25:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.016+0000 7f5c0746c700 1 Processor -- start 2023-10-06T02:25:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.017+0000 7f5c0746c700 1 -- start start 2023-10-06T02:25:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.017+0000 7f5c0746c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c0015b3c0 0x7f5c00097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.017+0000 7f5c0746c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c000b3c50 0x7f5c0015b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.017+0000 7f5c0746c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5c0015bcd0 0x7f5c0015a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.017+0000 7f5c0746c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c000afb90 con 0x7f5c000b3c50 2023-10-06T02:25:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.017+0000 7f5c0746c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c000b2310 con 0x7f5c0015bcd0 2023-10-06T02:25:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.017+0000 7f5c0746c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000b25f0 con 0x7f5c0015b3c0 2023-10-06T02:25:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.018+0000 7f5c04a07700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c000b3c50 0x7f5c0015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.018+0000 7f5c04a07700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c000b3c50 0x7f5c0015b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53800/0 (socket says 172.21.15.6:53800) 2023-10-06T02:25:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.018+0000 7f5c04a07700 1 -- 172.21.15.6:0/1319934470 learned_addr learned my addr 172.21.15.6:0/1319934470 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.018+0000 7f5c05a09700 1 --2- 172.21.15.6:0/1319934470 >> v2:172.21.15.175:3300/0 conn(0x7f5c0015bcd0 0x7f5c0015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.018+0000 7f5c05208700 1 --2- 172.21.15.6:0/1319934470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c0015b3c0 0x7f5c00097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.018+0000 7f5c04a07700 1 -- 172.21.15.6:0/1319934470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c0015b3c0 msgr2=0x7f5c00097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.018+0000 7f5c04a07700 1 --2- 172.21.15.6:0/1319934470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c0015b3c0 0x7f5c00097d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.018+0000 7f5c04a07700 1 -- 172.21.15.6:0/1319934470 >> v2:172.21.15.175:3300/0 conn(0x7f5c0015bcd0 msgr2=0x7f5c0015a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.018+0000 7f5c04a07700 1 --2- 172.21.15.6:0/1319934470 >> v2:172.21.15.175:3300/0 conn(0x7f5c0015bcd0 0x7f5c0015a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.018+0000 7f5c04a07700 1 -- 172.21.15.6:0/1319934470 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c000af820 con 0x7f5c000b3c50 2023-10-06T02:25:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.018+0000 7f5c05208700 1 --2- 172.21.15.6:0/1319934470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c0015b3c0 0x7f5c00097d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.018+0000 7f5c04a07700 1 --2- 172.21.15.6:0/1319934470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c000b3c50 0x7f5c0015b790 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f5c00087110 tx=0x7f5bf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13da8df193cff253 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.018+0000 7f5bfffff700 1 -- 172.21.15.6:0/1319934470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf400b860 con 0x7f5c000b3c50 2023-10-06T02:25:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.018+0000 7f5bfffff700 1 -- 172.21.15.6:0/1319934470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf400b9c0 con 0x7f5c000b3c50 2023-10-06T02:25:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.018+0000 7f5bfffff700 1 -- 172.21.15.6:0/1319934470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf400bd60 con 0x7f5c000b3c50 2023-10-06T02:25:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.019+0000 7f5c0746c700 1 -- 172.21.15.6:0/1319934470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c000b3c50 msgr2=0x7f5c0015b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.019+0000 7f5c0746c700 1 --2- 172.21.15.6:0/1319934470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c000b3c50 0x7f5c0015b790 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f5c00087110 tx=0x7f5bf4009250 comp rx=0 tx=0).stop 2023-10-06T02:25:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.019+0000 7f5c0746c700 1 -- 172.21.15.6:0/1319934470 shutdown_connections 2023-10-06T02:25:28.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.019+0000 7f5c0746c700 1 --2- 172.21.15.6:0/1319934470 >> v2:172.21.15.175:3300/0 conn(0x7f5c0015bcd0 0x7f5c0015a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.019+0000 7f5c0746c700 1 --2- 172.21.15.6:0/1319934470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c0015b3c0 0x7f5c00097d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.019+0000 7f5c0746c700 1 --2- 172.21.15.6:0/1319934470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c000b3c50 0x7f5c0015b790 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.019+0000 7f5c0746c700 1 -- 172.21.15.6:0/1319934470 >> 172.21.15.6:0/1319934470 conn(0x7f5c00067910 msgr2=0x7f5c000ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:28.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.019+0000 7f5c0746c700 1 -- 172.21.15.6:0/1319934470 shutdown_connections 2023-10-06T02:25:28.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.019+0000 7f5c0746c700 1 -- 172.21.15.6:0/1319934470 wait complete. 2023-10-06T02:25:28.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.020+0000 7f5c0746c700 1 Processor -- start 2023-10-06T02:25:28.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.020+0000 7f5c0746c700 1 -- start start 2023-10-06T02:25:28.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.021+0000 7f5c0746c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c000b3c50 0x7f5c00144270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.021+0000 7f5c0746c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c0015b3c0 0x7f5c000ac010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.021+0000 7f5c0746c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c0015bcd0 0x7f5c0015a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.021+0000 7f5c0746c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c00157ce0 con 0x7f5c0015b3c0 2023-10-06T02:25:28.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.021+0000 7f5c0746c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000aa8c0 con 0x7f5c0015bcd0 2023-10-06T02:25:28.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.021+0000 7f5c0746c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000a9cb0 con 0x7f5c000b3c50 2023-10-06T02:25:28.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.021+0000 7f5c04a07700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c0015b3c0 0x7f5c000ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.021+0000 7f5c04a07700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c0015b3c0 0x7f5c000ac010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53802/0 (socket says 172.21.15.6:53802) 2023-10-06T02:25:28.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.021+0000 7f5c04a07700 1 -- 172.21.15.6:0/1412638863 learned_addr learned my addr 172.21.15.6:0/1412638863 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:28.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.021+0000 7f5c05208700 1 --2- 172.21.15.6:0/1412638863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c000b3c50 0x7f5c00144270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.021+0000 7f5c05a09700 1 --2- 172.21.15.6:0/1412638863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c0015bcd0 0x7f5c0015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.021+0000 7f5c04a07700 1 -- 172.21.15.6:0/1412638863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c000b3c50 msgr2=0x7f5c00144270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:28.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.021+0000 7f5c04a07700 1 --2- 172.21.15.6:0/1412638863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c000b3c50 0x7f5c00144270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.021+0000 7f5c04a07700 1 -- 172.21.15.6:0/1412638863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c0015bcd0 msgr2=0x7f5c0015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:28.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.021+0000 7f5c04a07700 1 --2- 172.21.15.6:0/1412638863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c0015bcd0 0x7f5c0015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.021+0000 7f5c04a07700 1 -- 172.21.15.6:0/1412638863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf40094f0 con 0x7f5c0015b3c0 2023-10-06T02:25:28.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.021+0000 7f5c04a07700 1 --2- 172.21.15.6:0/1412638863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c0015b3c0 0x7f5c000ac010 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f5c0006f4d0 tx=0x7f5bf4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:28.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.022+0000 7f5bfd7fa700 1 -- 172.21.15.6:0/1412638863 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4011dc0 con 0x7f5c0015b3c0 2023-10-06T02:25:28.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.022+0000 7f5bfd7fa700 1 -- 172.21.15.6:0/1412638863 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf4024440 con 0x7f5c0015b3c0 2023-10-06T02:25:28.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.022+0000 7f5c0746c700 1 -- 172.21.15.6:0/1412638863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c000a9f90 con 0x7f5c0015b3c0 2023-10-06T02:25:28.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.022+0000 7f5bfd7fa700 1 -- 172.21.15.6:0/1412638863 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4024800 con 0x7f5c0015b3c0 2023-10-06T02:25:28.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.022+0000 7f5c0746c700 1 -- 172.21.15.6:0/1412638863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c000aa550 con 0x7f5c0015b3c0 2023-10-06T02:25:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.022+0000 7f5c0746c700 1 -- 172.21.15.6:0/1412638863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c000aaa50 con 0x7f5c0015b3c0 2023-10-06T02:25:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.023+0000 7f5bfd7fa700 1 -- 172.21.15.6:0/1412638863 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bf401a420 con 0x7f5c0015b3c0 2023-10-06T02:25:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.023+0000 7f5bfd7fa700 1 --2- 172.21.15.6:0/1412638863 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5bec066f30 0x7f5bec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.024+0000 7f5bfd7fa700 1 -- 172.21.15.6:0/1412638863 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6808+0+0 (secure 0 0 0) 0x7f5bf40867c0 con 0x7f5c0015b3c0 2023-10-06T02:25:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.024+0000 7f5c05208700 1 --2- 172.21.15.6:0/1412638863 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5bec066f30 0x7f5bec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.024+0000 7f5c05208700 1 --2- 172.21.15.6:0/1412638863 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5bec066f30 0x7f5bec0693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800d650 tx=0x7f5bf8007800 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.028+0000 7f5bfd7fa700 1 -- 172.21.15.6:0/1412638863 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bf4053660 con 0x7f5c0015b3c0 2023-10-06T02:25:28.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.271+0000 7f5c0746c700 1 -- 172.21.15.6:0/1412638863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c0006e8d0 con 0x7f5c0015b3c0 2023-10-06T02:25:28.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.271+0000 7f5bfd7fa700 1 -- 172.21.15.6:0/1412638863 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f5bf4056c80 con 0x7f5c0015b3c0 2023-10-06T02:25:28.272 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:28.272 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":115,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:27.888715+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:28.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.274+0000 7f5c0746c700 1 -- 172.21.15.6:0/1412638863 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5bec066f30 msgr2=0x7f5bec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:28.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.274+0000 7f5c0746c700 1 --2- 172.21.15.6:0/1412638863 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5bec066f30 0x7f5bec0693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800d650 tx=0x7f5bf8007800 comp rx=0 tx=0).stop 2023-10-06T02:25:28.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.274+0000 7f5c0746c700 1 -- 172.21.15.6:0/1412638863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c0015b3c0 msgr2=0x7f5c000ac010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:28.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.274+0000 7f5c0746c700 1 --2- 172.21.15.6:0/1412638863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c0015b3c0 0x7f5c000ac010 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f5c0006f4d0 tx=0x7f5bf4017000 comp rx=0 tx=0).stop 2023-10-06T02:25:28.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.274+0000 7f5c0746c700 1 -- 172.21.15.6:0/1412638863 shutdown_connections 2023-10-06T02:25:28.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.274+0000 7f5c0746c700 1 --2- 172.21.15.6:0/1412638863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c0015bcd0 0x7f5c0015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.274+0000 7f5c0746c700 1 --2- 172.21.15.6:0/1412638863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c000b3c50 0x7f5c00144270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.274+0000 7f5c0746c700 1 --2- 172.21.15.6:0/1412638863 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5bec066f30 0x7f5bec0693e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.274+0000 7f5c0746c700 1 --2- 172.21.15.6:0/1412638863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c0015b3c0 0x7f5c000ac010 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.274+0000 7f5c0746c700 1 -- 172.21.15.6:0/1412638863 >> 172.21.15.6:0/1412638863 conn(0x7f5c00067910 msgr2=0x7f5c00158310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:28.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.274+0000 7f5c0746c700 1 -- 172.21.15.6:0/1412638863 shutdown_connections 2023-10-06T02:25:28.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.274+0000 7f5c0746c700 1 -- 172.21.15.6:0/1412638863 wait complete. 2023-10-06T02:25:28.276 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 115 2023-10-06T02:25:28.286 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:25:28.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:28.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.444+0000 7ff9454e6700 1 Processor -- start 2023-10-06T02:25:28.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.444+0000 7ff9454e6700 1 -- start start 2023-10-06T02:25:28.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.445+0000 7ff9454e6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff94015b3c0 0x7ff940097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.445+0000 7ff9454e6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff9400b3c50 0x7ff94015b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.445+0000 7ff9454e6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9400afb90 con 0x7ff94015bcd0 2023-10-06T02:25:28.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.445+0000 7ff9454e6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9400b2310 con 0x7ff9400b3c50 2023-10-06T02:25:28.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.445+0000 7ff9454e6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9400b25f0 con 0x7ff94015b3c0 2023-10-06T02:25:28.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.445+0000 7ff93e7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff9400b3c50 0x7ff94015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.445+0000 7ff93e7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff9400b3c50 0x7ff94015b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53810/0 (socket says 172.21.15.6:53810) 2023-10-06T02:25:28.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.445+0000 7ff93e7fc700 1 -- 172.21.15.6:0/208073488 learned_addr learned my addr 172.21.15.6:0/208073488 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:28.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.446+0000 7ff93effd700 1 --2- 172.21.15.6:0/208073488 >> v2:172.21.15.175:3300/0 conn(0x7ff94015b3c0 0x7ff940097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.446+0000 7ff93e7fc700 1 -- 172.21.15.6:0/208073488 >> v2:172.21.15.175:3300/0 conn(0x7ff94015b3c0 msgr2=0x7ff940097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:28.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.446+0000 7ff93e7fc700 1 --2- 172.21.15.6:0/208073488 >> v2:172.21.15.175:3300/0 conn(0x7ff94015b3c0 0x7ff940097d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.446+0000 7ff93e7fc700 1 -- 172.21.15.6:0/208073488 >> v1:172.21.15.175:6789/0 conn(0x7ff94015bcd0 legacy=0x7ff94015a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:28.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.446+0000 7ff93e7fc700 1 -- 172.21.15.6:0/208073488 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9400af820 con 0x7ff9400b3c50 2023-10-06T02:25:28.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.446+0000 7ff93e7fc700 1 --2- 172.21.15.6:0/208073488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9400b3c50 0x7ff94015b790 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7ff9400874b0 tx=0x7ff928009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bf9d22cacd63aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:28.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.446+0000 7ff93dffb700 1 -- 172.21.15.6:0/208073488 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff928009e70 con 0x7ff9400b3c50 2023-10-06T02:25:28.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.446+0000 7ff93dffb700 1 -- 172.21.15.6:0/208073488 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92800b860 con 0x7ff9400b3c50 2023-10-06T02:25:28.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.446+0000 7ff93dffb700 1 -- 172.21.15.6:0/208073488 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92800bc20 con 0x7ff9400b3c50 2023-10-06T02:25:28.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.447+0000 7ff9454e6700 1 -- 172.21.15.6:0/208073488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9400b3c50 msgr2=0x7ff94015b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:28.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.447+0000 7ff9454e6700 1 --2- 172.21.15.6:0/208073488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9400b3c50 0x7ff94015b790 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7ff9400874b0 tx=0x7ff928009250 comp rx=0 tx=0).stop 2023-10-06T02:25:28.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.447+0000 7ff9454e6700 1 -- 172.21.15.6:0/208073488 shutdown_connections 2023-10-06T02:25:28.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.447+0000 7ff9454e6700 1 --2- 172.21.15.6:0/208073488 >> v2:172.21.15.175:3300/0 conn(0x7ff94015b3c0 0x7ff940097d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.447+0000 7ff9454e6700 1 --2- 172.21.15.6:0/208073488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9400b3c50 0x7ff94015b790 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.447+0000 7ff9454e6700 1 -- 172.21.15.6:0/208073488 >> 172.21.15.6:0/208073488 conn(0x7ff940067910 msgr2=0x7ff9400ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:28.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.447+0000 7ff9454e6700 1 -- 172.21.15.6:0/208073488 shutdown_connections 2023-10-06T02:25:28.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.447+0000 7ff9454e6700 1 -- 172.21.15.6:0/208073488 wait complete. 2023-10-06T02:25:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.448+0000 7ff9454e6700 1 Processor -- start 2023-10-06T02:25:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.448+0000 7ff9454e6700 1 -- start start 2023-10-06T02:25:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff9454e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9400b3c50 0x7ff9400a8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff9454e6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff94015b3c0 0x7ff940156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff9454e6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff94015bcd0 0x7ff94009ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff9454e6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff940167e70 con 0x7ff9400b3c50 2023-10-06T02:25:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff9454e6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9400aa000 con 0x7ff94015b3c0 2023-10-06T02:25:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff9454e6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9400aacc0 con 0x7ff94015bcd0 2023-10-06T02:25:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff93effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9400b3c50 0x7ff9400a8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff93effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9400b3c50 0x7ff9400a8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53814/0 (socket says 172.21.15.6:53814) 2023-10-06T02:25:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff93effd700 1 -- 172.21.15.6:0/1538968297 learned_addr learned my addr 172.21.15.6:0/1538968297 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff93e7fc700 1 --2- 172.21.15.6:0/1538968297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff94015b3c0 0x7ff940156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff93f7fe700 1 --2- 172.21.15.6:0/1538968297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff94015bcd0 0x7ff94009ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff93effd700 1 -- 172.21.15.6:0/1538968297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff94015bcd0 msgr2=0x7ff94009ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff93effd700 1 --2- 172.21.15.6:0/1538968297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff94015bcd0 0x7ff94009ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff93effd700 1 -- 172.21.15.6:0/1538968297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff94015b3c0 msgr2=0x7ff940156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff93effd700 1 --2- 172.21.15.6:0/1538968297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff94015b3c0 0x7ff940156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff93effd700 1 -- 172.21.15.6:0/1538968297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9280094f0 con 0x7ff9400b3c50 2023-10-06T02:25:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff93effd700 1 --2- 172.21.15.6:0/1538968297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9400b3c50 0x7ff9400a8f80 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7ff938009ed0 tx=0x7ff93800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:28.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff936ffd700 1 -- 172.21.15.6:0/1538968297 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93800cc20 con 0x7ff9400b3c50 2023-10-06T02:25:28.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff936ffd700 1 -- 172.21.15.6:0/1538968297 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93800f040 con 0x7ff9400b3c50 2023-10-06T02:25:28.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff9454e6700 1 -- 172.21.15.6:0/1538968297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9400a94c0 con 0x7ff9400b3c50 2023-10-06T02:25:28.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.449+0000 7ff936ffd700 1 -- 172.21.15.6:0/1538968297 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff938014480 con 0x7ff9400b3c50 2023-10-06T02:25:28.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.450+0000 7ff9454e6700 1 -- 172.21.15.6:0/1538968297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9400a9a40 con 0x7ff9400b3c50 2023-10-06T02:25:28.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.450+0000 7ff9454e6700 1 -- 172.21.15.6:0/1538968297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94006e8d0 con 0x7ff9400b3c50 2023-10-06T02:25:28.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.451+0000 7ff936ffd700 1 -- 172.21.15.6:0/1538968297 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9380147f0 con 0x7ff9400b3c50 2023-10-06T02:25:28.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.451+0000 7ff936ffd700 1 --2- 172.21.15.6:0/1538968297 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff920066f30 0x7ff9200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.451+0000 7ff936ffd700 1 -- 172.21.15.6:0/1538968297 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6808+0+0 (secure 0 0 0) 0x7ff938085180 con 0x7ff9400b3c50 2023-10-06T02:25:28.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.451+0000 7ff93e7fc700 1 --2- 172.21.15.6:0/1538968297 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff920066f30 0x7ff9200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.452+0000 7ff93e7fc700 1 --2- 172.21.15.6:0/1538968297 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff920066f30 0x7ff9200693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff9400874b0 tx=0x7ff928017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:28.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.455+0000 7ff936ffd700 1 -- 172.21.15.6:0/1538968297 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff938051f00 con 0x7ff9400b3c50 2023-10-06T02:25:28.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.694+0000 7ff9454e6700 1 -- 172.21.15.6:0/1538968297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9400a89a0 con 0x7ff9400b3c50 2023-10-06T02:25:28.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.695+0000 7ff936ffd700 1 -- 172.21.15.6:0/1538968297 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+3840 (secure 0 0 0) 0x7ff938055520 con 0x7ff9400b3c50 2023-10-06T02:25:28.695 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:28.696 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":115,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:27.888715+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.697+0000 7ff9454e6700 1 -- 172.21.15.6:0/1538968297 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff920066f30 msgr2=0x7ff9200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.697+0000 7ff9454e6700 1 --2- 172.21.15.6:0/1538968297 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff920066f30 0x7ff9200693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff9400874b0 tx=0x7ff928017000 comp rx=0 tx=0).stop 2023-10-06T02:25:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.697+0000 7ff9454e6700 1 -- 172.21.15.6:0/1538968297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9400b3c50 msgr2=0x7ff9400a8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.697+0000 7ff9454e6700 1 --2- 172.21.15.6:0/1538968297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9400b3c50 0x7ff9400a8f80 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7ff938009ed0 tx=0x7ff93800b040 comp rx=0 tx=0).stop 2023-10-06T02:25:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.697+0000 7ff9454e6700 1 -- 172.21.15.6:0/1538968297 shutdown_connections 2023-10-06T02:25:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.697+0000 7ff9454e6700 1 --2- 172.21.15.6:0/1538968297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff94015bcd0 0x7ff94009ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.697+0000 7ff9454e6700 1 --2- 172.21.15.6:0/1538968297 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff920066f30 0x7ff9200693e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.697+0000 7ff9454e6700 1 --2- 172.21.15.6:0/1538968297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9400b3c50 0x7ff9400a8f80 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.697+0000 7ff9454e6700 1 --2- 172.21.15.6:0/1538968297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff94015b3c0 0x7ff940156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.697+0000 7ff9454e6700 1 -- 172.21.15.6:0/1538968297 >> 172.21.15.6:0/1538968297 conn(0x7ff940067910 msgr2=0x7ff9401595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.697+0000 7ff9454e6700 1 -- 172.21.15.6:0/1538968297 shutdown_connections 2023-10-06T02:25:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.697+0000 7ff9454e6700 1 -- 172.21.15.6:0/1538968297 wait complete. 2023-10-06T02:25:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 115 2023-10-06T02:25:28.709 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:25:28.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:28.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.829+0000 7fa7b0061700 1 Processor -- start 2023-10-06T02:25:28.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.829+0000 7fa7b0061700 1 -- start start 2023-10-06T02:25:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7b0061700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7a806e520 0x7fa7a8069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7b0061700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa7a81597c0 0x7fa7a806a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7b0061700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a8069950 con 0x7fa7a81593f0 2023-10-06T02:25:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7b0061700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a80b2850 con 0x7fa7a81597c0 2023-10-06T02:25:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7b0061700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80b1fb0 con 0x7fa7a806e520 2023-10-06T02:25:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7addfd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa7a81593f0 0x7fa7a806de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35398/0 (socket says 172.21.15.6:35398) 2023-10-06T02:25:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7addfd700 1 -- 172.21.15.6:0/3041211448 learned_addr learned my addr 172.21.15.6:0/3041211448 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7ad5fc700 1 --2- 172.21.15.6:0/3041211448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7a806e520 0x7fa7a8069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7ae5fe700 1 --2- 172.21.15.6:0/3041211448 >> v2:172.21.15.175:3300/0 conn(0x7fa7a81597c0 0x7fa7a806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7acdfb700 1 -- 172.21.15.6:0/3041211448 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200338333 0 0) 0x7fa7a8069950 con 0x7fa7a81593f0 2023-10-06T02:25:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7acdfb700 1 -- 172.21.15.6:0/3041211448 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa790003570 con 0x7fa7a81593f0 2023-10-06T02:25:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7acdfb700 1 -- 172.21.15.6:0/3041211448 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3841641070 0 0) 0x7fa790003570 con 0x7fa7a81593f0 2023-10-06T02:25:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7acdfb700 1 -- 172.21.15.6:0/3041211448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7a806e520 msgr2=0x7fa7a8069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7acdfb700 1 --2- 172.21.15.6:0/3041211448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7a806e520 0x7fa7a8069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7acdfb700 1 -- 172.21.15.6:0/3041211448 >> v2:172.21.15.175:3300/0 conn(0x7fa7a81597c0 msgr2=0x7fa7a806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7acdfb700 1 --2- 172.21.15.6:0/3041211448 >> v2:172.21.15.175:3300/0 conn(0x7fa7a81597c0 0x7fa7a806a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7acdfb700 1 -- 172.21.15.6:0/3041211448 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a80b2290 con 0x7fa7a81593f0 2023-10-06T02:25:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7acdfb700 1 -- 172.21.15.6:0/3041211448 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fa7a0001470 con 0x7fa7a81593f0 2023-10-06T02:25:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7ae5fe700 1 --2- 172.21.15.6:0/3041211448 >> v2:172.21.15.175:3300/0 conn(0x7fa7a81597c0 0x7fa7a806a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:25:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7acdfb700 1 -- 172.21.15.6:0/3041211448 >> v1:172.21.15.6:6789/0 conn(0x7fa7a81593f0 legacy=0x7fa7a806de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7acdfb700 1 --2- 172.21.15.6:0/3041211448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7a806e520 0x7fa790003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7acdfb700 1 --2- 172.21.15.6:0/3041211448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa790003fe0 0x7fa790004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7acdfb700 1 --2- 172.21.15.6:0/3041211448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa790004d50 0x7fa7900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7acdfb700 1 -- 172.21.15.6:0/3041211448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80b2850 con 0x7fa790003fe0 2023-10-06T02:25:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7acdfb700 1 -- 172.21.15.6:0/3041211448 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80b1fb0 con 0x7fa790004d50 2023-10-06T02:25:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.830+0000 7fa7acdfb700 1 -- 172.21.15.6:0/3041211448 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79000ba90 con 0x7fa7a806e520 2023-10-06T02:25:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.831+0000 7fa7addfd700 1 --2- 172.21.15.6:0/3041211448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7a806e520 0x7fa790003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.831+0000 7fa7ad5fc700 1 --2- 172.21.15.6:0/3041211448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa790003fe0 0x7fa790004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.831+0000 7fa7ae5fe700 1 --2- 172.21.15.6:0/3041211448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa790004d50 0x7fa7900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.831+0000 7fa7ad5fc700 1 -- 172.21.15.6:0/3041211448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7a806e520 msgr2=0x7fa790003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.831+0000 7fa7ad5fc700 1 --2- 172.21.15.6:0/3041211448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7a806e520 0x7fa790003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.831+0000 7fa7ad5fc700 1 -- 172.21.15.6:0/3041211448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa790004d50 msgr2=0x7fa7900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.831+0000 7fa7ad5fc700 1 --2- 172.21.15.6:0/3041211448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa790004d50 0x7fa7900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.831+0000 7fa7ad5fc700 1 -- 172.21.15.6:0/3041211448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa790003570 con 0x7fa790003fe0 2023-10-06T02:25:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.831+0000 7fa7ad5fc700 1 --2- 172.21.15.6:0/3041211448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa790003fe0 0x7fa790004810 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009bf0 tx=0x7fa79c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d05b70d9054dc89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:28.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.831+0000 7fa7acdfb700 1 -- 172.21.15.6:0/3041211448 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c005a00 con 0x7fa790003fe0 2023-10-06T02:25:28.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.831+0000 7fa7acdfb700 1 -- 172.21.15.6:0/3041211448 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c005b60 con 0x7fa790003fe0 2023-10-06T02:25:28.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.831+0000 7fa7acdfb700 1 -- 172.21.15.6:0/3041211448 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c00e6b0 con 0x7fa790003fe0 2023-10-06T02:25:28.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.832+0000 7fa7b0061700 1 -- 172.21.15.6:0/3041211448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa790003fe0 msgr2=0x7fa790004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:28.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.832+0000 7fa7b0061700 1 --2- 172.21.15.6:0/3041211448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa790003fe0 0x7fa790004810 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009bf0 tx=0x7fa79c009120 comp rx=0 tx=0).stop 2023-10-06T02:25:28.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.832+0000 7fa7ae5fe700 1 -- 172.21.15.6:0/3041211448 reap_dead start 2023-10-06T02:25:28.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.832+0000 7fa7b0061700 1 -- 172.21.15.6:0/3041211448 shutdown_connections 2023-10-06T02:25:28.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.832+0000 7fa7b0061700 1 -- 172.21.15.6:0/3041211448 >> 172.21.15.6:0/3041211448 conn(0x7fa7a806cff0 msgr2=0x7fa7a80afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:28.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.832+0000 7fa7b0061700 1 -- 172.21.15.6:0/3041211448 shutdown_connections 2023-10-06T02:25:28.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.832+0000 7fa7b0061700 1 -- 172.21.15.6:0/3041211448 wait complete. 2023-10-06T02:25:28.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.833+0000 7fa7b0061700 1 Processor -- start 2023-10-06T02:25:28.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.833+0000 7fa7b0061700 1 -- start start 2023-10-06T02:25:28.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7b0061700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa790003fe0 0x7fa7a80c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7b0061700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a80cc6b0 0x7fa7a814a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7b0061700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7a80ccb20 0x7fa7a814abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7b0061700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a816af60 con 0x7fa7a80ccb20 2023-10-06T02:25:28.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7b0061700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a814b110 con 0x7fa7a80cc6b0 2023-10-06T02:25:28.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7b0061700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80ca560 con 0x7fa790003fe0 2023-10-06T02:25:28.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7ae5fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7a80ccb20 0x7fa7a814abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7ae5fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7a80ccb20 0x7fa7a814abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48032/0 (socket says 172.21.15.6:48032) 2023-10-06T02:25:28.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7ae5fe700 1 -- 172.21.15.6:0/3019692689 learned_addr learned my addr 172.21.15.6:0/3019692689 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:28.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7ad5fc700 1 --2- 172.21.15.6:0/3019692689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a80cc6b0 0x7fa7a814a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7addfd700 1 --2- 172.21.15.6:0/3019692689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa790003fe0 0x7fa7a80c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7ae5fe700 1 -- 172.21.15.6:0/3019692689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa790003fe0 msgr2=0x7fa7a80c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:28.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7ae5fe700 1 --2- 172.21.15.6:0/3019692689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa790003fe0 0x7fa7a80c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7ae5fe700 1 -- 172.21.15.6:0/3019692689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a80cc6b0 msgr2=0x7fa7a814a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:28.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7ae5fe700 1 --2- 172.21.15.6:0/3019692689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a80cc6b0 0x7fa7a814a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:28.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7ae5fe700 1 -- 172.21.15.6:0/3019692689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a80ca840 con 0x7fa7a80ccb20 2023-10-06T02:25:28.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7ae5fe700 1 --2- 172.21.15.6:0/3019692689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7a80ccb20 0x7fa7a814abd0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fa7a806d740 tx=0x7fa79800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:28.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7a5ffb700 1 -- 172.21.15.6:0/3019692689 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79800e040 con 0x7fa7a80ccb20 2023-10-06T02:25:28.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7a5ffb700 1 -- 172.21.15.6:0/3019692689 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79800f040 con 0x7fa7a80ccb20 2023-10-06T02:25:28.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.834+0000 7fa7b0061700 1 -- 172.21.15.6:0/3019692689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a80cab20 con 0x7fa7a80ccb20 2023-10-06T02:25:28.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.835+0000 7fa7a5ffb700 1 -- 172.21.15.6:0/3019692689 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79800fea0 con 0x7fa7a80ccb20 2023-10-06T02:25:28.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.835+0000 7fa7b0061700 1 -- 172.21.15.6:0/3019692689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a80cb0e0 con 0x7fa7a80ccb20 2023-10-06T02:25:28.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.836+0000 7fa7b0061700 1 -- 172.21.15.6:0/3019692689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a806d3f0 con 0x7fa7a80ccb20 2023-10-06T02:25:28.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.836+0000 7fa7a5ffb700 1 -- 172.21.15.6:0/3019692689 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa798015640 con 0x7fa7a80ccb20 2023-10-06T02:25:28.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.836+0000 7fa7a5ffb700 1 --2- 172.21.15.6:0/3019692689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa794066f30 0x7fa7940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:28.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.837+0000 7fa7a5ffb700 1 -- 172.21.15.6:0/3019692689 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6808+0+0 (secure 0 0 0) 0x7fa798085360 con 0x7fa7a80ccb20 2023-10-06T02:25:28.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.837+0000 7fa7addfd700 1 --2- 172.21.15.6:0/3019692689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa794066f30 0x7fa7940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:28.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.837+0000 7fa7addfd700 1 --2- 172.21.15.6:0/3019692689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa794066f30 0x7fa7940693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0000e50 tx=0x7fa7a0001e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:28.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:28.841+0000 7fa7a5ffb700 1 -- 172.21.15.6:0/3019692689 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7980520e0 con 0x7fa7a80ccb20 2023-10-06T02:25:29.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.085+0000 7fa7b0061700 1 -- 172.21.15.6:0/3019692689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7a80b2570 con 0x7fa7a80ccb20 2023-10-06T02:25:29.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.086+0000 7fa7a5ffb700 1 -- 172.21.15.6:0/3019692689 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4592 (secure 0 0 0) 0x7fa798055700 con 0x7fa7a80ccb20 2023-10-06T02:25:29.087 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:29.087 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":116,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/788286408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":788286408},{"type":"v1","addr":"172.21.15.6:6835","nonce":788286408}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:27.888715+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:29.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.088+0000 7fa7b0061700 1 -- 172.21.15.6:0/3019692689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa794066f30 msgr2=0x7fa7940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:29.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.088+0000 7fa7b0061700 1 --2- 172.21.15.6:0/3019692689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa794066f30 0x7fa7940693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0000e50 tx=0x7fa7a0001e90 comp rx=0 tx=0).stop 2023-10-06T02:25:29.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.088+0000 7fa7b0061700 1 -- 172.21.15.6:0/3019692689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7a80ccb20 msgr2=0x7fa7a814abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:29.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.088+0000 7fa7b0061700 1 --2- 172.21.15.6:0/3019692689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7a80ccb20 0x7fa7a814abd0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fa7a806d740 tx=0x7fa79800b040 comp rx=0 tx=0).stop 2023-10-06T02:25:29.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.088+0000 7fa7b0061700 1 -- 172.21.15.6:0/3019692689 shutdown_connections 2023-10-06T02:25:29.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.088+0000 7fa7b0061700 1 --2- 172.21.15.6:0/3019692689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa794066f30 0x7fa7940693e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:29.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.088+0000 7fa7b0061700 1 --2- 172.21.15.6:0/3019692689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7a80ccb20 0x7fa7a814abd0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:29.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.088+0000 7fa7b0061700 1 --2- 172.21.15.6:0/3019692689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa790003fe0 0x7fa7a80c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:29.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.088+0000 7fa7b0061700 1 --2- 172.21.15.6:0/3019692689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a80cc6b0 0x7fa7a814a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:29.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.088+0000 7fa7b0061700 1 -- 172.21.15.6:0/3019692689 >> 172.21.15.6:0/3019692689 conn(0x7fa7a806cff0 msgr2=0x7fa7a815a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:29.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.088+0000 7fa7b0061700 1 -- 172.21.15.6:0/3019692689 shutdown_connections 2023-10-06T02:25:29.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.088+0000 7fa7b0061700 1 -- 172.21.15.6:0/3019692689 wait complete. 2023-10-06T02:25:29.090 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 116 2023-10-06T02:25:29.100 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 200.00000000' led to DAMAGED state 2023-10-06T02:25:29.101 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 200.00000001' 2023-10-06T02:25:29.101 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:29.101 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:25:29.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:29.101 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:25:29.116 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:25:29.116 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:25:29.116 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:25:29.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.276+0000 7f8edd742700 1 Processor -- start 2023-10-06T02:25:29.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.276+0000 7f8edd742700 1 -- start start 2023-10-06T02:25:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.276+0000 7f8edd742700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ed8086ff0 0x7f8ed8087440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.276+0000 7f8edd742700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed8087980 con 0x7f8ed80b21b0 2023-10-06T02:25:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.276+0000 7f8edd742700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed80afc50 con 0x7f8ed815a030 2023-10-06T02:25:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.276+0000 7f8edd742700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80b0cf0 con 0x7f8ed8086ff0 2023-10-06T02:25:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8ed80b21b0 0x7f8ed80b25f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35410/0 (socket says 172.21.15.6:35410) 2023-10-06T02:25:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed77fe700 1 -- 172.21.15.6:0/616505917 learned_addr learned my addr 172.21.15.6:0/616505917 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed5ffb700 1 -- 172.21.15.6:0/616505917 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386056183 0 0) 0x7f8ed8087980 con 0x7f8ed80b21b0 2023-10-06T02:25:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed67fc700 1 --2- 172.21.15.6:0/616505917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ed8086ff0 0x7f8ed8087440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed5ffb700 1 -- 172.21.15.6:0/616505917 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ec4003570 con 0x7f8ed80b21b0 2023-10-06T02:25:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed5ffb700 1 -- 172.21.15.6:0/616505917 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3873745992 0 0) 0x7f8ec4003570 con 0x7f8ed80b21b0 2023-10-06T02:25:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed5ffb700 1 -- 172.21.15.6:0/616505917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ed8086ff0 msgr2=0x7f8ed8087440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed5ffb700 1 --2- 172.21.15.6:0/616505917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ed8086ff0 0x7f8ed8087440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed5ffb700 1 -- 172.21.15.6:0/616505917 >> v1:172.21.15.175:6789/0 conn(0x7f8ed815a030 legacy=0x7f8ed815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed5ffb700 1 -- 172.21.15.6:0/616505917 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed80aff30 con 0x7f8ed80b21b0 2023-10-06T02:25:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed5ffb700 1 -- 172.21.15.6:0/616505917 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f8ec8001470 con 0x7f8ed80b21b0 2023-10-06T02:25:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed5ffb700 1 -- 172.21.15.6:0/616505917 >> v1:172.21.15.6:6789/0 conn(0x7f8ed80b21b0 legacy=0x7f8ed80b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed5ffb700 1 --2- 172.21.15.6:0/616505917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ec4003a90 0x7f8ec4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed5ffb700 1 --2- 172.21.15.6:0/616505917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ed8086ff0 0x7f8ec4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed5ffb700 1 --2- 172.21.15.6:0/616505917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ec4004d50 0x7f8ec40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed5ffb700 1 -- 172.21.15.6:0/616505917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80b0cf0 con 0x7f8ec4003a90 2023-10-06T02:25:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed5ffb700 1 -- 172.21.15.6:0/616505917 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec400bb70 con 0x7f8ec4004d50 2023-10-06T02:25:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed5ffb700 1 -- 172.21.15.6:0/616505917 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec400bd30 con 0x7f8ed8086ff0 2023-10-06T02:25:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed6ffd700 1 --2- 172.21.15.6:0/616505917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ec4003a90 0x7f8ec4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed77fe700 1 --2- 172.21.15.6:0/616505917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ec4004d50 0x7f8ec40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.277+0000 7f8ed67fc700 1 --2- 172.21.15.6:0/616505917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ed8086ff0 0x7f8ec4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.278+0000 7f8ed6ffd700 1 -- 172.21.15.6:0/616505917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ed8086ff0 msgr2=0x7f8ec4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.278+0000 7f8ed6ffd700 1 --2- 172.21.15.6:0/616505917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ed8086ff0 0x7f8ec4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.278+0000 7f8ed6ffd700 1 -- 172.21.15.6:0/616505917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ec4004d50 msgr2=0x7f8ec40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.278+0000 7f8ed6ffd700 1 --2- 172.21.15.6:0/616505917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ec4004d50 0x7f8ec40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.278+0000 7f8ed6ffd700 1 -- 172.21.15.6:0/616505917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec4003570 con 0x7f8ec4003a90 2023-10-06T02:25:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.278+0000 7f8ed6ffd700 1 --2- 172.21.15.6:0/616505917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ec4003a90 0x7f8ec4003ea0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0001fc0 tx=0x7f8ed0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2298d14e3379d13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.278+0000 7f8ed5ffb700 1 -- 172.21.15.6:0/616505917 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0001950 con 0x7f8ec4003a90 2023-10-06T02:25:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.278+0000 7f8ed5ffb700 1 -- 172.21.15.6:0/616505917 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed000c8b0 con 0x7f8ec4003a90 2023-10-06T02:25:29.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.278+0000 7f8ed5ffb700 1 -- 172.21.15.6:0/616505917 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed000cc50 con 0x7f8ec4003a90 2023-10-06T02:25:29.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.278+0000 7f8edd742700 1 -- 172.21.15.6:0/616505917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ec4003a90 msgr2=0x7f8ec4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:29.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.278+0000 7f8edd742700 1 --2- 172.21.15.6:0/616505917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ec4003a90 0x7f8ec4003ea0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0001fc0 tx=0x7f8ed0001640 comp rx=0 tx=0).stop 2023-10-06T02:25:29.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.278+0000 7f8ed77fe700 1 -- 172.21.15.6:0/616505917 reap_dead start 2023-10-06T02:25:29.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.279+0000 7f8edd742700 1 -- 172.21.15.6:0/616505917 shutdown_connections 2023-10-06T02:25:29.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.279+0000 7f8edd742700 1 -- 172.21.15.6:0/616505917 >> 172.21.15.6:0/616505917 conn(0x7f8ed8068680 msgr2=0x7f8ed8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:29.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.279+0000 7f8edd742700 1 -- 172.21.15.6:0/616505917 shutdown_connections 2023-10-06T02:25:29.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.279+0000 7f8edd742700 1 -- 172.21.15.6:0/616505917 wait complete. 2023-10-06T02:25:29.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.280+0000 7f8edd742700 1 Processor -- start 2023-10-06T02:25:29.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.280+0000 7f8edd742700 1 -- start start 2023-10-06T02:25:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8edd742700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec4003a90 0x7f8ed80c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8edd742700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80c3c40 0x7f8ed80c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8edd742700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ed8147900 0x7f8ed815b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8edd742700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80c5fc0 con 0x7f8ed80c3c40 2023-10-06T02:25:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8edd742700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80c53b0 con 0x7f8ed8147900 2023-10-06T02:25:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8edd742700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80c5690 con 0x7f8ec4003a90 2023-10-06T02:25:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8ed67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80c3c40 0x7f8ed80c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8ed67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80c3c40 0x7f8ed80c4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48050/0 (socket says 172.21.15.6:48050) 2023-10-06T02:25:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8ed67fc700 1 -- 172.21.15.6:0/2635091772 learned_addr learned my addr 172.21.15.6:0/2635091772 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8ed77fe700 1 --2- 172.21.15.6:0/2635091772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ed8147900 0x7f8ed815b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8ed67fc700 1 -- 172.21.15.6:0/2635091772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec4003a90 msgr2=0x7f8ed80c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8ed6ffd700 1 --2- 172.21.15.6:0/2635091772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec4003a90 0x7f8ed80c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8ed67fc700 1 --2- 172.21.15.6:0/2635091772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec4003a90 0x7f8ed80c6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8ed67fc700 1 -- 172.21.15.6:0/2635091772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ed8147900 msgr2=0x7f8ed815b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8ed67fc700 1 --2- 172.21.15.6:0/2635091772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ed8147900 0x7f8ed815b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8ed67fc700 1 -- 172.21.15.6:0/2635091772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed80c5970 con 0x7f8ed80c3c40 2023-10-06T02:25:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8ed77fe700 1 --2- 172.21.15.6:0/2635091772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ed8147900 0x7f8ed815b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8ed67fc700 1 --2- 172.21.15.6:0/2635091772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80c3c40 0x7f8ed80c4b60 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0011d40 tx=0x7f8ec00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8eceffd700 1 -- 172.21.15.6:0/2635091772 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000fac0 con 0x7f8ed80c3c40 2023-10-06T02:25:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8eceffd700 1 -- 172.21.15.6:0/2635091772 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec000fc20 con 0x7f8ed80c3c40 2023-10-06T02:25:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8edd742700 1 -- 172.21.15.6:0/2635091772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed80c5c50 con 0x7f8ed80c3c40 2023-10-06T02:25:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8eceffd700 1 -- 172.21.15.6:0/2635091772 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0014440 con 0x7f8ed80c3c40 2023-10-06T02:25:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.281+0000 7f8edd742700 1 -- 172.21.15.6:0/2635091772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed80c50a0 con 0x7f8ed80c3c40 2023-10-06T02:25:29.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.282+0000 7f8edd742700 1 -- 172.21.15.6:0/2635091772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed8088700 con 0x7f8ed80c3c40 2023-10-06T02:25:29.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.283+0000 7f8eceffd700 1 -- 172.21.15.6:0/2635091772 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ec0014a80 con 0x7f8ed80c3c40 2023-10-06T02:25:29.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.283+0000 7f8eceffd700 1 --2- 172.21.15.6:0/2635091772 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8eb8066f30 0x7f8eb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:29.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.283+0000 7f8eceffd700 1 -- 172.21.15.6:0/2635091772 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6808+0+0 (secure 0 0 0) 0x7f8ec0018030 con 0x7f8ed80c3c40 2023-10-06T02:25:29.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.283+0000 7f8ed6ffd700 1 --2- 172.21.15.6:0/2635091772 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8eb8066f30 0x7f8eb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:29.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.284+0000 7f8ed6ffd700 1 --2- 172.21.15.6:0/2635091772 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8eb8066f30 0x7f8eb80693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80d11a0 tx=0x7f8ed0015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:29.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.287+0000 7f8eceffd700 1 -- 172.21.15.6:0/2635091772 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ec0052460 con 0x7f8ed80c3c40 2023-10-06T02:25:29.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.528+0000 7f8edd742700 1 -- 172.21.15.6:0/2635091772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8ed80b0210 con 0x7f8ed80c3c40 2023-10-06T02:25:29.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.901+0000 7f8eceffd700 1 -- 172.21.15.6:0/2635091772 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v117) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8ec0055a80 con 0x7f8ed80c3c40 2023-10-06T02:25:29.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.903+0000 7f8edd742700 1 -- 172.21.15.6:0/2635091772 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8eb8066f30 msgr2=0x7f8eb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:29.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.903+0000 7f8edd742700 1 --2- 172.21.15.6:0/2635091772 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8eb8066f30 0x7f8eb80693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80d11a0 tx=0x7f8ed0015000 comp rx=0 tx=0).stop 2023-10-06T02:25:29.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.903+0000 7f8edd742700 1 -- 172.21.15.6:0/2635091772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80c3c40 msgr2=0x7f8ed80c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.903+0000 7f8edd742700 1 --2- 172.21.15.6:0/2635091772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80c3c40 0x7f8ed80c4b60 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0011d40 tx=0x7f8ec00091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.903+0000 7f8edd742700 1 -- 172.21.15.6:0/2635091772 shutdown_connections 2023-10-06T02:25:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.903+0000 7f8edd742700 1 --2- 172.21.15.6:0/2635091772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ed8147900 0x7f8ed815b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.903+0000 7f8edd742700 1 --2- 172.21.15.6:0/2635091772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec4003a90 0x7f8ed80c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.903+0000 7f8edd742700 1 --2- 172.21.15.6:0/2635091772 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8eb8066f30 0x7f8eb80693e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.903+0000 7f8edd742700 1 --2- 172.21.15.6:0/2635091772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80c3c40 0x7f8ed80c4b60 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.903+0000 7f8edd742700 1 -- 172.21.15.6:0/2635091772 >> 172.21.15.6:0/2635091772 conn(0x7f8ed8068680 msgr2=0x7f8ed80aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.904+0000 7f8edd742700 1 -- 172.21.15.6:0/2635091772 shutdown_connections 2023-10-06T02:25:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:29.904+0000 7f8edd742700 1 -- 172.21.15.6:0/2635091772 wait complete. 2023-10-06T02:25:29.907 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:25:29.917 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:25:30.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.040+0000 7fb605e83700 1 Processor -- start 2023-10-06T02:25:30.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.040+0000 7fb605e83700 1 -- start start 2023-10-06T02:25:30.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.041+0000 7fb605e83700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb6001597b0 0x7fb6000b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.041+0000 7fb605e83700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6000ced80 con 0x7fb6001593e0 2023-10-06T02:25:30.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.041+0000 7fb605e83700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60015dd20 con 0x7fb6000b3fe0 2023-10-06T02:25:30.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.041+0000 7fb605e83700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb60015e000 con 0x7fb6001597b0 2023-10-06T02:25:30.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.041+0000 7fb5feffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb6001597b0 0x7fb6000b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.041+0000 7fb5ff7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb6001593e0 0x7fb6000b5bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35414/0 (socket says 172.21.15.6:35414) 2023-10-06T02:25:30.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.041+0000 7fb5ff7fe700 1 -- 172.21.15.6:0/2617459760 learned_addr learned my addr 172.21.15.6:0/2617459760 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:30.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.041+0000 7fb5feffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb6001597b0 0x7fb6000b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48062/0 (socket says 172.21.15.6:48062) 2023-10-06T02:25:30.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.042+0000 7fb5feffd700 1 -- 172.21.15.6:0/2617459760 >> v1:172.21.15.175:6789/0 conn(0x7fb6000b3fe0 legacy=0x7fb6000cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:30.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.042+0000 7fb5feffd700 1 -- 172.21.15.6:0/2617459760 >> v1:172.21.15.6:6789/0 conn(0x7fb6001593e0 legacy=0x7fb6000b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.042+0000 7fb5fe7fc700 1 -- 172.21.15.6:0/2617459760 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618062072 0 0) 0x7fb6000ced80 con 0x7fb6001593e0 2023-10-06T02:25:30.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.042+0000 7fb5feffd700 1 -- 172.21.15.6:0/2617459760 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6000cea10 con 0x7fb6001597b0 2023-10-06T02:25:30.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.042+0000 7fb5feffd700 1 --2- 172.21.15.6:0/2617459760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6001597b0 0x7fb6000b3aa0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40098e0 tx=0x7fb5f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e6dae7c4c0b486 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:30.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.042+0000 7fb5fe7fc700 1 -- 172.21.15.6:0/2617459760 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4009e80 con 0x7fb6001597b0 2023-10-06T02:25:30.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.042+0000 7fb5fe7fc700 1 -- 172.21.15.6:0/2617459760 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f400b860 con 0x7fb6001597b0 2023-10-06T02:25:30.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.042+0000 7fb5fe7fc700 1 -- 172.21.15.6:0/2617459760 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f400bbe0 con 0x7fb6001597b0 2023-10-06T02:25:30.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.042+0000 7fb605e83700 1 -- 172.21.15.6:0/2617459760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6001597b0 msgr2=0x7fb6000b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.042+0000 7fb605e83700 1 --2- 172.21.15.6:0/2617459760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6001597b0 0x7fb6000b3aa0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40098e0 tx=0x7fb5f40091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.042+0000 7fb605e83700 1 -- 172.21.15.6:0/2617459760 shutdown_connections 2023-10-06T02:25:30.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.042+0000 7fb605e83700 1 --2- 172.21.15.6:0/2617459760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6001597b0 0x7fb6000b3aa0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.042+0000 7fb605e83700 1 -- 172.21.15.6:0/2617459760 >> 172.21.15.6:0/2617459760 conn(0x7fb60006a220 msgr2=0x7fb60006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:30.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.043+0000 7fb605e83700 1 -- 172.21.15.6:0/2617459760 shutdown_connections 2023-10-06T02:25:30.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.043+0000 7fb605e83700 1 -- 172.21.15.6:0/2617459760 wait complete. 2023-10-06T02:25:30.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.044+0000 7fb605e83700 1 Processor -- start 2023-10-06T02:25:30.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.044+0000 7fb605e83700 1 -- start start 2023-10-06T02:25:30.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb605e83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6000b3fe0 0x7fb60014b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb605e83700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6001593e0 0x7fb60016d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb605e83700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6001597b0 0x7fb60016dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb605e83700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60016e580 con 0x7fb6000b3fe0 2023-10-06T02:25:30.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb605e83700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60014d250 con 0x7fb6001593e0 2023-10-06T02:25:30.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb605e83700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb600155040 con 0x7fb6001597b0 2023-10-06T02:25:30.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb5ff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6000b3fe0 0x7fb60014b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb5ff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6000b3fe0 0x7fb60014b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48078/0 (socket says 172.21.15.6:48078) 2023-10-06T02:25:30.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb5ff7fe700 1 -- 172.21.15.6:0/2095247839 learned_addr learned my addr 172.21.15.6:0/2095247839 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:30.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb5ff7fe700 1 -- 172.21.15.6:0/2095247839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6001597b0 msgr2=0x7fb60016dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb5ff7fe700 1 --2- 172.21.15.6:0/2095247839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6001597b0 0x7fb60016dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb5feffd700 1 --2- 172.21.15.6:0/2095247839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6001593e0 0x7fb60016d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb5ff7fe700 1 -- 172.21.15.6:0/2095247839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6001593e0 msgr2=0x7fb60016d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb5ff7fe700 1 --2- 172.21.15.6:0/2095247839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6001593e0 0x7fb60016d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb5ff7fe700 1 -- 172.21.15.6:0/2095247839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f4009420 con 0x7fb6000b3fe0 2023-10-06T02:25:30.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb5feffd700 1 --2- 172.21.15.6:0/2095247839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6001593e0 0x7fb60016d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:30.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb5ff7fe700 1 --2- 172.21.15.6:0/2095247839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6000b3fe0 0x7fb60014b7c0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c810 tx=0x7fb5f0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:30.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb5e77fe700 1 -- 172.21.15.6:0/2095247839 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0005c00 con 0x7fb6000b3fe0 2023-10-06T02:25:30.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb5e77fe700 1 -- 172.21.15.6:0/2095247839 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f0005d60 con 0x7fb6000b3fe0 2023-10-06T02:25:30.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb605e83700 1 -- 172.21.15.6:0/2095247839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb600155320 con 0x7fb6000b3fe0 2023-10-06T02:25:30.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb5e77fe700 1 -- 172.21.15.6:0/2095247839 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0007340 con 0x7fb6000b3fe0 2023-10-06T02:25:30.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.045+0000 7fb605e83700 1 -- 172.21.15.6:0/2095247839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60014cee0 con 0x7fb6000b3fe0 2023-10-06T02:25:30.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.046+0000 7fb605e83700 1 -- 172.21.15.6:0/2095247839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60014d5e0 con 0x7fb6000b3fe0 2023-10-06T02:25:30.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.047+0000 7fb5e77fe700 1 -- 172.21.15.6:0/2095247839 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5f001b400 con 0x7fb6000b3fe0 2023-10-06T02:25:30.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.047+0000 7fb5e77fe700 1 --2- 172.21.15.6:0/2095247839 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5ec066f30 0x7fb5ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.047+0000 7fb5e77fe700 1 -- 172.21.15.6:0/2095247839 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6808+0+0 (secure 0 0 0) 0x7fb5f0084460 con 0x7fb6000b3fe0 2023-10-06T02:25:30.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.048+0000 7fb5feffd700 1 --2- 172.21.15.6:0/2095247839 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5ec066f30 0x7fb5ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.048+0000 7fb5feffd700 1 --2- 172.21.15.6:0/2095247839 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5ec066f30 0x7fb5ec0693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40098e0 tx=0x7fb5f4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:30.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.052+0000 7fb5e77fe700 1 -- 172.21.15.6:0/2095247839 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb60014d5e0 con 0x7fb6000b3fe0 2023-10-06T02:25:30.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.332+0000 7fb605e83700 1 -- 172.21.15.6:0/2095247839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fb600088760 con 0x7fb6000b3fe0 2023-10-06T02:25:30.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.907+0000 7fb5e77fe700 1 -- 172.21.15.6:0/2095247839 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v118) v1 ==== 101+0+0 (secure 0 0 0) 0x7fb5f0051300 con 0x7fb6000b3fe0 2023-10-06T02:25:30.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.910+0000 7fb605e83700 1 -- 172.21.15.6:0/2095247839 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5ec066f30 msgr2=0x7fb5ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.910+0000 7fb605e83700 1 --2- 172.21.15.6:0/2095247839 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5ec066f30 0x7fb5ec0693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40098e0 tx=0x7fb5f4017000 comp rx=0 tx=0).stop 2023-10-06T02:25:30.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.910+0000 7fb605e83700 1 -- 172.21.15.6:0/2095247839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6000b3fe0 msgr2=0x7fb60014b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.910+0000 7fb605e83700 1 --2- 172.21.15.6:0/2095247839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6000b3fe0 0x7fb60014b7c0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c810 tx=0x7fb5f0007d90 comp rx=0 tx=0).stop 2023-10-06T02:25:30.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.910+0000 7fb605e83700 1 -- 172.21.15.6:0/2095247839 shutdown_connections 2023-10-06T02:25:30.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.910+0000 7fb605e83700 1 --2- 172.21.15.6:0/2095247839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6001597b0 0x7fb60016dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.910+0000 7fb605e83700 1 --2- 172.21.15.6:0/2095247839 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5ec066f30 0x7fb5ec0693e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.910+0000 7fb605e83700 1 --2- 172.21.15.6:0/2095247839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6000b3fe0 0x7fb60014b7c0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.910+0000 7fb605e83700 1 --2- 172.21.15.6:0/2095247839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6001593e0 0x7fb60016d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.910+0000 7fb605e83700 1 -- 172.21.15.6:0/2095247839 >> 172.21.15.6:0/2095247839 conn(0x7fb60006a220 msgr2=0x7fb6000afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:30.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.910+0000 7fb605e83700 1 -- 172.21.15.6:0/2095247839 shutdown_connections 2023-10-06T02:25:30.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.910+0000 7fb605e83700 1 -- 172.21.15.6:0/2095247839 wait complete. 2023-10-06T02:25:30.912 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:25:30.924 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:25:30.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.963+0000 7fadb86f9000 1 Processor -- start 2023-10-06T02:25:30.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.964+0000 7fadb86f9000 1 -- start start 2023-10-06T02:25:30.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.964+0000 7fadb86f9000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad9c002880 0x55dc73cfd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.964+0000 7fadb86f9000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73cf8600 0x55dc73d28340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.964+0000 7fadb86f9000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc73cf89d0 0x55dc73d28880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.964+0000 7fadb86f9000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc73c45980 con 0x55dc73cf89d0 2023-10-06T02:25:30.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.964+0000 7fadb86f9000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc73c45620 con 0x55dc73cf8600 2023-10-06T02:25:30.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.964+0000 7fadb86f9000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc73c3c400 con 0x7fad9c002880 2023-10-06T02:25:30.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.964+0000 7fadb2135700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc73cf89d0 0x55dc73d28880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.964+0000 7fadb2135700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc73cf89d0 0x55dc73d28880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48106/0 (socket says 172.21.15.6:48106) 2023-10-06T02:25:30.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.964+0000 7fadb2135700 1 -- 172.21.15.6:0/4192398226 learned_addr learned my addr 172.21.15.6:0/4192398226 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:30.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.964+0000 7fadb1133700 1 --2- 172.21.15.6:0/4192398226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73cf8600 0x55dc73d28340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.964+0000 7fadb1934700 1 --2- 172.21.15.6:0/4192398226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad9c002880 0x55dc73cfd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.965+0000 7fadb2135700 1 -- 172.21.15.6:0/4192398226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad9c002880 msgr2=0x55dc73cfd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:30.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.965+0000 7fadb2135700 1 --2- 172.21.15.6:0/4192398226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad9c002880 0x55dc73cfd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.965+0000 7fadb2135700 1 -- 172.21.15.6:0/4192398226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73cf8600 msgr2=0x55dc73d28340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:30.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.965+0000 7fadb2135700 1 --2- 172.21.15.6:0/4192398226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73cf8600 0x55dc73d28340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.965+0000 7fadb2135700 1 -- 172.21.15.6:0/4192398226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc73c543d0 con 0x55dc73cf89d0 2023-10-06T02:25:30.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.965+0000 7fadb2135700 1 --2- 172.21.15.6:0/4192398226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc73cf89d0 0x55dc73d28880 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fadac00a5e0 tx=0x7fadac007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3a168c8256215f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.965+0000 7fada3fff700 1 -- 172.21.15.6:0/4192398226 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac013650 con 0x55dc73cf89d0 2023-10-06T02:25:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.965+0000 7fada3fff700 1 -- 172.21.15.6:0/4192398226 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadac0137d0 con 0x55dc73cf89d0 2023-10-06T02:25:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.965+0000 7fada3fff700 1 -- 172.21.15.6:0/4192398226 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac013b90 con 0x55dc73cf89d0 2023-10-06T02:25:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.965+0000 7fadb86f9000 1 -- 172.21.15.6:0/4192398226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc73cf89d0 msgr2=0x55dc73d28880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.965+0000 7fadb86f9000 1 --2- 172.21.15.6:0/4192398226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc73cf89d0 0x55dc73d28880 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fadac00a5e0 tx=0x7fadac007040 comp rx=0 tx=0).stop 2023-10-06T02:25:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.965+0000 7fadb86f9000 1 -- 172.21.15.6:0/4192398226 shutdown_connections 2023-10-06T02:25:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.965+0000 7fadb86f9000 1 --2- 172.21.15.6:0/4192398226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc73cf89d0 0x55dc73d28880 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.965+0000 7fadb86f9000 1 --2- 172.21.15.6:0/4192398226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad9c002880 0x55dc73cfd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.965+0000 7fadb86f9000 1 --2- 172.21.15.6:0/4192398226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc73cf8600 0x55dc73d28340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.965+0000 7fadb86f9000 1 -- 172.21.15.6:0/4192398226 >> 172.21.15.6:0/4192398226 conn(0x55dc73cfb5d0 msgr2=0x55dc73db9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.966+0000 7fadb86f9000 1 -- 172.21.15.6:0/4192398226 shutdown_connections 2023-10-06T02:25:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.966+0000 7fadb86f9000 1 -- 172.21.15.6:0/4192398226 wait complete. 2023-10-06T02:25:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.966+0000 7fadb86f9000 1 Processor -- start 2023-10-06T02:25:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.966+0000 7fadb86f9000 1 -- start start 2023-10-06T02:25:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb86f9000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55dc73cf8600 0x55dc73db5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb86f9000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc73cf89d0 0x55dc73dd0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb86f9000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad9c002880 0x55dc73db3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb86f9000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc73d3f800 con 0x55dc73cf89d0 2023-10-06T02:25:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb86f9000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc73dd0470 con 0x7fad9c002880 2023-10-06T02:25:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb86f9000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc73dd0710 con 0x55dc73cf8600 2023-10-06T02:25:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb1133700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc73cf89d0 0x55dc73dd0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb1133700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc73cf89d0 0x55dc73dd0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48120/0 (socket says 172.21.15.6:48120) 2023-10-06T02:25:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 learned_addr learned my addr 172.21.15.6:0/605103234 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb1934700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55dc73cf8600 0x55dc73db5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb2135700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad9c002880 0x55dc73db3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55dc73cf8600 msgr2=0x55dc73db5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb1133700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55dc73cf8600 0x55dc73db5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad9c002880 msgr2=0x55dc73db3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb1133700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad9c002880 0x55dc73db3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac00a390 con 0x55dc73cf89d0 2023-10-06T02:25:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb2135700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad9c002880 0x55dc73db3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.967+0000 7fadb1133700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc73cf89d0 0x55dc73dd0e50 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fad9c002fd0 tx=0x7fada8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.968+0000 7fada27fc700 1 -- 172.21.15.6:0/605103234 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada800e040 con 0x55dc73cf89d0 2023-10-06T02:25:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.968+0000 7fada27fc700 1 -- 172.21.15.6:0/605103234 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada8013420 con 0x55dc73cf89d0 2023-10-06T02:25:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.968+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dc73c47ae0 con 0x55dc73cf89d0 2023-10-06T02:25:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.968+0000 7fada27fc700 1 -- 172.21.15.6:0/605103234 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada80137e0 con 0x55dc73cf89d0 2023-10-06T02:25:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.968+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc73c47540 con 0x55dc73cf89d0 2023-10-06T02:25:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.969+0000 7fada27fc700 1 -- 172.21.15.6:0/605103234 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fada8013b90 con 0x55dc73cf89d0 2023-10-06T02:25:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.969+0000 7fada27fc700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad940658c0 0x7fad94067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.969+0000 7fada27fc700 1 -- 172.21.15.6:0/605103234 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6808+0+0 (secure 0 0 0) 0x7fada80843b0 con 0x55dc73cf89d0 2023-10-06T02:25:30.975 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:25:30.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.970+0000 7fadb1934700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad940658c0 0x7fad94067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.970+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55dc73d3f0c0 0x55dc73cfbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.970+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73d41680 con 0x55dc73d3f0c0 2023-10-06T02:25:30.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.970+0000 7fadb2135700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55dc73d3f0c0 0x55dc73cfbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.970+0000 7fadb2135700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55dc73d3f0c0 0x55dc73cfbee0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:30.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.970+0000 7fadb1934700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad940658c0 0x7fad94067d70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fada4001620 tx=0x7fada4011040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.971+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v100'133 uv107 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.972+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73db57b0 con 0x55dc73d3f0c0 2023-10-06T02:25:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.973+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v100'134 uv134 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.973+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73cfc820 con 0x55dc73d3f0c0 2023-10-06T02:25:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.975+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v100'135 uv135 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.977 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:25:30.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.975+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73dd1390 con 0x55dc73d3f0c0 2023-10-06T02:25:30.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.976+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v100'136 uv136 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.976+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73def910 con 0x55dc73d3f0c0 2023-10-06T02:25:30.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.978+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v100'137 uv137 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.978+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73deedf0 con 0x55dc73d3f0c0 2023-10-06T02:25:30.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.981+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v100'138 uv138 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.981+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73def1f0 con 0x55dc73d3f0c0 2023-10-06T02:25:30.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.982+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v100'139 uv113 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.982+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73defcc0 con 0x55dc73d3f0c0 2023-10-06T02:25:30.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.983+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v100'140 uv140 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.983+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73defcc0 con 0x55dc73d3f0c0 2023-10-06T02:25:30.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.984+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v100'141 uv141 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.985 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:25:30.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.984+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df0cd0 con 0x55dc73d3f0c0 2023-10-06T02:25:30.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.985+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v100'142 uv142 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.985+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df0cd0 con 0x55dc73d3f0c0 2023-10-06T02:25:30.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.986+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v100'143 uv143 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.986+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73defcc0 con 0x55dc73d3f0c0 2023-10-06T02:25:30.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.987+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v100'144 uv144 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.987+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73defcc0 con 0x55dc73d3f0c0 2023-10-06T02:25:30.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.988+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v100'145 uv120 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.988+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73defcc0 con 0x55dc73d3f0c0 2023-10-06T02:25:30.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.989+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v100'146 uv146 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.989+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73defcc0 con 0x55dc73d3f0c0 2023-10-06T02:25:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.990+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v100'147 uv147 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.991 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:25:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.990+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df0cd0 con 0x55dc73d3f0c0 2023-10-06T02:25:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.993+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v100'148 uv148 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.993+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df0cd0 con 0x55dc73d3f0c0 2023-10-06T02:25:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.996+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v100'149 uv149 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.996+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73defcc0 con 0x55dc73d3f0c0 2023-10-06T02:25:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.997+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v100'150 uv150 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:30.997+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df01b0 con 0x55dc73d3f0c0 2023-10-06T02:25:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.000+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v100'151 uv151 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.000+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df01b0 con 0x55dc73d3f0c0 2023-10-06T02:25:31.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.002+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v100'152 uv126 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:31.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.002+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df01b0 con 0x55dc73d3f0c0 2023-10-06T02:25:31.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.006+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v100'153 uv153 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:31.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.006+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df01b0 con 0x55dc73d3f0c0 2023-10-06T02:25:31.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.008+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v100'154 uv154 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:31.008 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:25:31.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.008+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df11c0 con 0x55dc73d3f0c0 2023-10-06T02:25:31.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.010+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v100'155 uv155 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:31.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.010+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df11c0 con 0x55dc73d3f0c0 2023-10-06T02:25:31.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.011+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v100'156 uv156 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:31.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.011+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df01b0 con 0x55dc73d3f0c0 2023-10-06T02:25:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.014+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v100'157 uv157 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.014+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df01b0 con 0x55dc73d3f0c0 2023-10-06T02:25:31.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.015+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v100'158 uv132 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:31.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.015+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df01b0 con 0x55dc73d3f0c0 2023-10-06T02:25:31.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.016+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v100'159 uv159 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:31.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.016+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df01b0 con 0x55dc73d3f0c0 2023-10-06T02:25:31.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.018+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v100'160 uv160 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:31.018 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:25:31.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.018+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df11c0 con 0x55dc73d3f0c0 2023-10-06T02:25:31.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.019+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v100'161 uv161 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:31.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.019+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df11c0 con 0x55dc73d3f0c0 2023-10-06T02:25:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.020+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v100'162 uv162 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.020+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df01b0 con 0x55dc73d3f0c0 2023-10-06T02:25:31.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.021+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v100'163 uv163 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73d3f0c0 2023-10-06T02:25:31.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.021+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55dc73df06c0 0x55dc73df2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.021+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df2fe0 con 0x55dc73df06c0 2023-10-06T02:25:31.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.021+0000 7fadb1934700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55dc73df06c0 0x55dc73df2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.022+0000 7fadb1934700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55dc73df06c0 0x55dc73df2aa0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.023+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v100'107 uv89 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.023+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df3390 con 0x55dc73df06c0 2023-10-06T02:25:31.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.024+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v100'108 uv108 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.024+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df3740 con 0x55dc73df06c0 2023-10-06T02:25:31.027 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:25:31.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.027+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v100'109 uv109 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.027+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df3fe0 con 0x55dc73df06c0 2023-10-06T02:25:31.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.030+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v100'110 uv110 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.030+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df4390 con 0x55dc73df06c0 2023-10-06T02:25:31.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.032+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v100'111 uv111 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.032+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df4740 con 0x55dc73df06c0 2023-10-06T02:25:31.034 INFO:teuthology.orchestra.run.smithi006.stdout:Write #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:25:31.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.033+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v100'112 uv112 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.033+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df4af0 con 0x55dc73df06c0 2023-10-06T02:25:31.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.035+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [write 0~90] v100'113 uv113 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.035+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df4af0 con 0x55dc73df06c0 2023-10-06T02:25:31.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.036+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [omap-set-header] v100'114 uv114 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.036+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df4af0 con 0x55dc73df06c0 2023-10-06T02:25:31.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.037+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000001 [create] v100'115 uv99 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.037+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df4af0 con 0x55dc73df06c0 2023-10-06T02:25:31.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.038+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000001 [delete] v100'116 uv116 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.038+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df4af0 con 0x55dc73df06c0 2023-10-06T02:25:31.039 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:25:31.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.039+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v100'117 uv117 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.039+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df8210 con 0x55dc73df06c0 2023-10-06T02:25:31.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.040+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [write 0~14075] v100'118 uv118 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.040+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df8210 con 0x55dc73df06c0 2023-10-06T02:25:31.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.042+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [omap-set-header] v100'119 uv119 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.042+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df4af0 con 0x55dc73df06c0 2023-10-06T02:25:31.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.043+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 606.00000000 [create] v100'120 uv105 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.043+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df4af0 con 0x55dc73df06c0 2023-10-06T02:25:31.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.044+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 606.00000000 [delete] v100'121 uv121 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.044+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df4af0 con 0x55dc73df06c0 2023-10-06T02:25:31.047 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:25:31.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.046+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v100'122 uv122 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.046+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df5b00 con 0x55dc73df06c0 2023-10-06T02:25:31.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.047+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [setxattr (30)] v100'123 uv123 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.047+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df5b00 con 0x55dc73df06c0 2023-10-06T02:25:31.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.048+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [setxattr (62)] v100'124 uv124 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.048+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df4af0 con 0x55dc73df06c0 2023-10-06T02:25:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.050+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [omap-set-header] v100'125 uv125 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.050+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55dc73df5000 0x55dc73df73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.050+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:51 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df7920 con 0x55dc73df5000 2023-10-06T02:25:31.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.050+0000 7fadb1133700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55dc73df5000 0x55dc73df73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.050+0000 7fadb1133700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55dc73df5000 0x55dc73df73e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.051+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(51 607.00000000 [create] v100'27 uv26 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.051+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:52 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df7dd0 con 0x55dc73df5000 2023-10-06T02:25:31.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.052+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(52 607.00000000 [delete] v100'28 uv28 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.052+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df8350 con 0x55dc73df5000 2023-10-06T02:25:31.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.053+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(53 607.00000000 [create] v100'29 uv29 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.054 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:25:31.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.053+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df9c50 con 0x55dc73df5000 2023-10-06T02:25:31.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.056+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(54 607.00000000 [setxattr (30)] v100'30 uv30 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.056+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73dfa000 con 0x55dc73df5000 2023-10-06T02:25:31.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.058+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(55 607.00000000 [setxattr (62)] v100'31 uv31 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.058+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df8c40 con 0x55dc73df5000 2023-10-06T02:25:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.061+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(56 607.00000000 [omap-set-header] v100'32 uv32 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.061+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df9040 con 0x55dc73df5000 2023-10-06T02:25:31.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.064+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(57 mds0_openfiles.0 [create] v100'20 uv19 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.064+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df9040 con 0x55dc73df5000 2023-10-06T02:25:31.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.066+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(58 mds0_openfiles.0 [delete] v100'21 uv21 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.066+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df9040 con 0x55dc73df5000 2023-10-06T02:25:31.067 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:25:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.067+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(59 mds0_openfiles.0 [create] v100'22 uv22 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.067+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df9040 con 0x55dc73df5000 2023-10-06T02:25:31.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.070+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(60 mds0_openfiles.0 [omap-set-header] v100'23 uv23 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.070+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:61 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df9040 con 0x55dc73df06c0 2023-10-06T02:25:31.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.072+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(61 608.00000000 [create] v100'27 uv26 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.073+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:62 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df9040 con 0x55dc73df06c0 2023-10-06T02:25:31.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.074+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(62 608.00000000 [delete] v100'28 uv28 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.074+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df9040 con 0x55dc73df06c0 2023-10-06T02:25:31.075 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:25:31.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.074+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v100'29 uv29 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.075+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df9040 con 0x55dc73df06c0 2023-10-06T02:25:31.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.075+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [setxattr (30)] v100'30 uv30 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.075+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df9040 con 0x55dc73df06c0 2023-10-06T02:25:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.078+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [setxattr (62)] v100'31 uv31 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.078+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73df9040 con 0x55dc73df06c0 2023-10-06T02:25:31.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.081+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [omap-set-header] v100'32 uv32 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73df06c0 2023-10-06T02:25:31.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.081+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55dc73dfa3b0 0x55dc73dfc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.081+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:67 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73dfccd0 con 0x55dc73dfa3b0 2023-10-06T02:25:31.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.081+0000 7fadb2135700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55dc73dfa3b0 0x55dc73dfc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.082+0000 7fadb2135700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55dc73dfa3b0 0x55dc73dfc790 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.083+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(67 604.00000000 [create] v100'48 uv42 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73dfa3b0 2023-10-06T02:25:31.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.083+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:68 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73dfccd0 con 0x55dc73dfa3b0 2023-10-06T02:25:31.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.084+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(68 604.00000000 [delete] v100'49 uv49 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73dfa3b0 2023-10-06T02:25:31.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.084+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73dfccd0 con 0x55dc73dfa3b0 2023-10-06T02:25:31.086 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:25:31.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.086+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(69 604.00000000 [create] v100'50 uv50 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73dfa3b0 2023-10-06T02:25:31.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.086+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73dfdce0 con 0x55dc73dfa3b0 2023-10-06T02:25:31.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.087+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(70 604.00000000 [setxattr (30)] v100'51 uv51 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73dfa3b0 2023-10-06T02:25:31.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.087+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73dfdce0 con 0x55dc73dfa3b0 2023-10-06T02:25:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.088+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(71 604.00000000 [setxattr (62)] v100'52 uv52 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73dfa3b0 2023-10-06T02:25:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.088+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73dfccd0 con 0x55dc73dfa3b0 2023-10-06T02:25:31.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.090+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(72 604.00000000 [omap-set-header] v100'53 uv53 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73dfa3b0 2023-10-06T02:25:31.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.090+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73dfccd0 con 0x55dc73dfa3b0 2023-10-06T02:25:31.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.091+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(73 500.00000000 [create] v100'54 uv47 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73dfa3b0 2023-10-06T02:25:31.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.091+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73dfccd0 con 0x55dc73dfa3b0 2023-10-06T02:25:31.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.092+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(74 500.00000000 [delete] v100'55 uv55 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73dfa3b0 2023-10-06T02:25:31.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.092+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73dfccd0 con 0x55dc73dfa3b0 2023-10-06T02:25:31.093 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:25:31.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.093+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(75 500.00000000 [create] v100'56 uv56 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73dfa3b0 2023-10-06T02:25:31.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.093+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73dfccd0 con 0x55dc73dfa3b0 2023-10-06T02:25:31.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.095+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(76 500.00000000 [write 0~90] v100'57 uv57 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73dfa3b0 2023-10-06T02:25:31.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.095+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73dfccd0 con 0x55dc73dfa3b0 2023-10-06T02:25:31.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.096+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(77 500.00000000 [omap-set-header] v100'58 uv58 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73dfa3b0 2023-10-06T02:25:31.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.096+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55dc73dfd350 0x55dc73dff730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.096+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:78 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73dffd90 con 0x55dc73dfd350 2023-10-06T02:25:31.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.096+0000 7fadb1934700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55dc73dfd350 0x55dc73dff730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.097+0000 7fadb1934700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55dc73dfd350 0x55dc73dff730 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.098+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(78 mds_snaptable [create] v100'22 uv21 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73dfd350 2023-10-06T02:25:31.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.098+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:79 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e00170 con 0x55dc73dfd350 2023-10-06T02:25:31.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.099+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(79 mds_snaptable [delete] v100'23 uv23 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73dfd350 2023-10-06T02:25:31.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.099+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e00170 con 0x55dc73dfd350 2023-10-06T02:25:31.100 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:25:31.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.100+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(80 mds_snaptable [create] v100'24 uv24 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73dfd350 2023-10-06T02:25:31.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.100+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e00170 con 0x55dc73dfd350 2023-10-06T02:25:31.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.101+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(81 mds_snaptable [write 0~70] v100'25 uv25 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73dfd350 2023-10-06T02:25:31.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.101+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e00170 con 0x55dc73dfd350 2023-10-06T02:25:31.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.103+0000 7fadb1934700 1 -- 172.21.15.6:0/605103234 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v100'26 uv26 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fada4017070 con 0x55dc73dfd350 2023-10-06T02:25:31.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.103+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:83 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e00170 con 0x55dc73df5000 2023-10-06T02:25:31.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.104+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(83 605.00000000 [create] v100'27 uv26 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.104+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:84 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e00170 con 0x55dc73df5000 2023-10-06T02:25:31.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.106+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(84 605.00000000 [delete] v100'28 uv28 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.106+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e00170 con 0x55dc73df5000 2023-10-06T02:25:31.109 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:25:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.109+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(85 605.00000000 [create] v100'29 uv29 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.109+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e01180 con 0x55dc73df5000 2023-10-06T02:25:31.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.114+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v100'30 uv30 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.114+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e01180 con 0x55dc73df5000 2023-10-06T02:25:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.115+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v100'31 uv31 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.115+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e00170 con 0x55dc73df5000 2023-10-06T02:25:31.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.118+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(88 605.00000000 [omap-set-header] v100'32 uv32 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.118+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55dc73e007f0 0x55dc73e02bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.118+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:89 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e031e0 con 0x55dc73e007f0 2023-10-06T02:25:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.118+0000 7fadb1133700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55dc73e007f0 0x55dc73e02bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.118+0000 7fadb1133700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55dc73e007f0 0x55dc73e02bd0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.123+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(89 mds0_inotable [create] v100'44 uv38 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73e007f0 2023-10-06T02:25:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.123+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:90 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e032a0 con 0x55dc73e007f0 2023-10-06T02:25:31.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.124+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(90 mds0_inotable [delete] v100'45 uv45 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73e007f0 2023-10-06T02:25:31.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.124+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e036d0 con 0x55dc73e007f0 2023-10-06T02:25:31.126 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:25:31.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.126+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(91 mds0_inotable [create] v100'46 uv46 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73e007f0 2023-10-06T02:25:31.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.126+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e036d0 con 0x55dc73e007f0 2023-10-06T02:25:31.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.131+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(92 mds0_inotable [write 0~34] v100'47 uv47 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73e007f0 2023-10-06T02:25:31.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.131+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e036d0 con 0x55dc73e007f0 2023-10-06T02:25:31.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.132+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v100'48 uv48 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73e007f0 2023-10-06T02:25:31.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.132+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e036d0 con 0x55dc73e007f0 2023-10-06T02:25:31.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.135+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(94 100.00000000 [create] v100'49 uv43 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73e007f0 2023-10-06T02:25:31.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.135+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e036d0 con 0x55dc73e007f0 2023-10-06T02:25:31.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.140+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(95 100.00000000 [delete] v100'50 uv50 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73e007f0 2023-10-06T02:25:31.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.140+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e036d0 con 0x55dc73e007f0 2023-10-06T02:25:31.141 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:25:31.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.141+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(96 100.00000000 [create] v100'51 uv51 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73e007f0 2023-10-06T02:25:31.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.141+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e036d0 con 0x55dc73e007f0 2023-10-06T02:25:31.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.143+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(97 100.00000000 [omap-set-header] v100'52 uv52 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73e007f0 2023-10-06T02:25:31.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.143+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06440 con 0x55dc73e007f0 2023-10-06T02:25:31.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.148+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v100'53 uv53 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73e007f0 2023-10-06T02:25:31.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.148+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:99 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e03bc0 con 0x55dc73df5000 2023-10-06T02:25:31.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.149+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(99 mds0_sessionmap [create] v100'22 uv21 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.149+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:100 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e03bc0 con 0x55dc73df5000 2023-10-06T02:25:31.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.152+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(100 mds0_sessionmap [delete] v100'23 uv23 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.152+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e03bc0 con 0x55dc73df5000 2023-10-06T02:25:31.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.155+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(101 mds0_sessionmap [create] v100'24 uv24 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.155 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:25:31.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.155+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e03bc0 con 0x55dc73df5000 2023-10-06T02:25:31.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.157+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v100'25 uv25 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.157+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55dc73e040d0 0x55dc73e044a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.157+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:103 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06b90 con 0x55dc73e040d0 2023-10-06T02:25:31.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.158+0000 7fadb2135700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55dc73e040d0 0x55dc73e044a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.158+0000 7fadb2135700 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55dc73e040d0 0x55dc73e044a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.159+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(103 609.00000000 [create] v100'27 uv26 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73e040d0 2023-10-06T02:25:31.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.159+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:104 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06b90 con 0x55dc73e040d0 2023-10-06T02:25:31.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.162+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(104 609.00000000 [delete] v100'28 uv28 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73e040d0 2023-10-06T02:25:31.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.162+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06b90 con 0x55dc73e040d0 2023-10-06T02:25:31.163 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:25:31.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.163+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(105 609.00000000 [create] v100'29 uv29 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73e040d0 2023-10-06T02:25:31.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.163+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e07ba0 con 0x55dc73e040d0 2023-10-06T02:25:31.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.166+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v100'30 uv30 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73e040d0 2023-10-06T02:25:31.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.166+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e07ba0 con 0x55dc73e040d0 2023-10-06T02:25:31.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.169+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v100'31 uv31 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73e040d0 2023-10-06T02:25:31.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.169+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06b90 con 0x55dc73e040d0 2023-10-06T02:25:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.174+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(108 609.00000000 [omap-set-header] v100'32 uv32 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73e040d0 2023-10-06T02:25:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.174+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:109 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06b90 con 0x55dc73dfa3b0 2023-10-06T02:25:31.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.176+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(109 400.00000000 [create] v100'22 uv21 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73dfa3b0 2023-10-06T02:25:31.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.176+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:110 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06b90 con 0x55dc73dfa3b0 2023-10-06T02:25:31.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.177+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(110 400.00000000 [delete] v100'23 uv23 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73dfa3b0 2023-10-06T02:25:31.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.177+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06b90 con 0x55dc73dfa3b0 2023-10-06T02:25:31.178 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:25:31.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.178+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(111 400.00000000 [create] v100'24 uv24 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73dfa3b0 2023-10-06T02:25:31.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.178+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06b90 con 0x55dc73dfa3b0 2023-10-06T02:25:31.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.178+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(112 400.00000000 [write 0~22] v100'25 uv25 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73dfa3b0 2023-10-06T02:25:31.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.179+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06b90 con 0x55dc73dfa3b0 2023-10-06T02:25:31.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.181+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(113 400.00000000 [omap-set-header] v100'26 uv26 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fadac01b020 con 0x55dc73dfa3b0 2023-10-06T02:25:31.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.181+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:114 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06b90 con 0x55dc73df5000 2023-10-06T02:25:31.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.182+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(114 100.00000000.inode [create] v100'57 uv49 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.182+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:115 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06b90 con 0x55dc73df5000 2023-10-06T02:25:31.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.183+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(115 100.00000000.inode [delete] v100'58 uv58 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.183+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06b90 con 0x55dc73df5000 2023-10-06T02:25:31.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.184+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(116 100.00000000.inode [create] v100'59 uv59 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.184 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:25:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.184+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06b90 con 0x55dc73df5000 2023-10-06T02:25:31.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.186+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(117 100.00000000.inode [write 0~554] v100'60 uv60 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.186+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06b90 con 0x55dc73df5000 2023-10-06T02:25:31.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.187+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v100'61 uv61 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.187+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06b90 con 0x55dc73df5000 2023-10-06T02:25:31.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.188+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(119 1.00000000 [create] v100'62 uv56 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.188+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06b90 con 0x55dc73df5000 2023-10-06T02:25:31.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.189+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(120 1.00000000 [delete] v100'63 uv63 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.189+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e06b90 con 0x55dc73df5000 2023-10-06T02:25:31.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.190+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(121 1.00000000 [create] v100'64 uv64 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.190 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:25:31.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.190+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e07ba0 con 0x55dc73df5000 2023-10-06T02:25:31.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.192+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v100'65 uv65 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.192+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e07ba0 con 0x55dc73df5000 2023-10-06T02:25:31.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.193+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v100'66 uv66 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.193+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e07080 con 0x55dc73df5000 2023-10-06T02:25:31.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.194+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(124 1.00000000 [omap-set-header] v100'67 uv67 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.194+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) v8 -- 0x55dc73e07080 con 0x55dc73df5000 2023-10-06T02:25:31.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb1133700 1 -- 172.21.15.6:0/605103234 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v100'68 uv68 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fada8019020 con 0x55dc73df5000 2023-10-06T02:25:31.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55dc73df5000 msgr2=0x55dc73df73e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55dc73df5000 0x55dc73df73e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55dc73d3f0c0 msgr2=0x55dc73cfbee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55dc73d3f0c0 0x55dc73cfbee0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55dc73e007f0 msgr2=0x55dc73e02bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55dc73e007f0 0x55dc73e02bd0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55dc73df06c0 msgr2=0x55dc73df2aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55dc73df06c0 0x55dc73df2aa0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55dc73e040d0 msgr2=0x55dc73e044a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55dc73e040d0 0x55dc73e044a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 reap_dead start 2023-10-06T02:25:31.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55dc73dfd350 msgr2=0x55dc73dff730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55dc73dfd350 0x55dc73dff730 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb2135700 1 -- 172.21.15.6:0/605103234 reap_dead start 2023-10-06T02:25:31.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55dc73dfa3b0 msgr2=0x55dc73dfc790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55dc73dfa3b0 0x55dc73dfc790 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad940658c0 msgr2=0x7fad94067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad940658c0 0x7fad94067d70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fada4001620 tx=0x7fada4011040 comp rx=0 tx=0).stop 2023-10-06T02:25:31.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc73cf89d0 msgr2=0x55dc73dd0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc73cf89d0 0x55dc73dd0e50 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fad9c002fd0 tx=0x7fada8018000 comp rx=0 tx=0).stop 2023-10-06T02:25:31.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 shutdown_connections 2023-10-06T02:25:31.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc73cf89d0 0x55dc73dd0e50 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad940658c0 0x7fad94067d70 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 --2- 172.21.15.6:0/605103234 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55dc73dfa3b0 0x55dc73dfc790 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 >> 172.21.15.6:0/605103234 conn(0x55dc73cfb5d0 msgr2=0x55dc73db9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:31.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 shutdown_connections 2023-10-06T02:25:31.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.196+0000 7fadb86f9000 1 -- 172.21.15.6:0/605103234 wait complete. 2023-10-06T02:25:31.201 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 200.00000001 2023-10-06T02:25:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.278+0000 7f13a5874000 1 Processor -- start 2023-10-06T02:25:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.278+0000 7f13a5874000 1 -- start start 2023-10-06T02:25:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.279+0000 7f13a5874000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce89938330 0x55ce89980300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.279+0000 7f13a5874000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce899f98b0 0x55ce89968c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.279+0000 7f13a5874000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce899f9c80 0x55ce899f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.279+0000 7f13a5874000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce89884980 con 0x55ce899f98b0 2023-10-06T02:25:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.279+0000 7f13a5874000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce89884620 con 0x55ce899f9c80 2023-10-06T02:25:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.279+0000 7f13a5874000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce8987b400 con 0x55ce89938330 2023-10-06T02:25:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.279+0000 7f139e2ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce899f98b0 0x55ce89968c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.279+0000 7f139e2ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce899f98b0 0x55ce89968c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48132/0 (socket says 172.21.15.6:48132) 2023-10-06T02:25:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.279+0000 7f139e2ae700 1 -- 172.21.15.6:0/2926454052 learned_addr learned my addr 172.21.15.6:0/2926454052 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.279+0000 7f139eaaf700 1 --2- 172.21.15.6:0/2926454052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce89938330 0x55ce89980300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.279+0000 7f139f2b0700 1 --2- 172.21.15.6:0/2926454052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce899f9c80 0x55ce899f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.279+0000 7f139e2ae700 1 -- 172.21.15.6:0/2926454052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce89938330 msgr2=0x55ce89980300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.279+0000 7f139e2ae700 1 --2- 172.21.15.6:0/2926454052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce89938330 0x55ce89980300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.279+0000 7f139e2ae700 1 -- 172.21.15.6:0/2926454052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce899f9c80 msgr2=0x55ce899f7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.279+0000 7f139e2ae700 1 --2- 172.21.15.6:0/2926454052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce899f9c80 0x55ce899f7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.279+0000 7f139e2ae700 1 -- 172.21.15.6:0/2926454052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139000a180 con 0x55ce899f98b0 2023-10-06T02:25:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.279+0000 7f139f2b0700 1 --2- 172.21.15.6:0/2926454052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce899f9c80 0x55ce899f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.280+0000 7f139e2ae700 1 --2- 172.21.15.6:0/2926454052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce899f98b0 0x55ce89968c70 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f1388001e30 tx=0x7f1388001850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fbb78df5b30bf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.280+0000 7f139d2ac700 1 -- 172.21.15.6:0/2926454052 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388014070 con 0x55ce899f98b0 2023-10-06T02:25:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.280+0000 7f139d2ac700 1 -- 172.21.15.6:0/2926454052 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1388008030 con 0x55ce899f98b0 2023-10-06T02:25:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.280+0000 7f139d2ac700 1 -- 172.21.15.6:0/2926454052 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138800bd60 con 0x55ce899f98b0 2023-10-06T02:25:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.280+0000 7f13a5874000 1 -- 172.21.15.6:0/2926454052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce899f98b0 msgr2=0x55ce89968c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.280+0000 7f13a5874000 1 --2- 172.21.15.6:0/2926454052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce899f98b0 0x55ce89968c70 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f1388001e30 tx=0x7f1388001850 comp rx=0 tx=0).stop 2023-10-06T02:25:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.280+0000 7f13a5874000 1 -- 172.21.15.6:0/2926454052 shutdown_connections 2023-10-06T02:25:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.280+0000 7f13a5874000 1 --2- 172.21.15.6:0/2926454052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce899f9c80 0x55ce899f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.280+0000 7f13a5874000 1 --2- 172.21.15.6:0/2926454052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce89938330 0x55ce89980300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.280+0000 7f13a5874000 1 --2- 172.21.15.6:0/2926454052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce899f98b0 0x55ce89968c70 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.280+0000 7f13a5874000 1 -- 172.21.15.6:0/2926454052 >> 172.21.15.6:0/2926454052 conn(0x55ce89980bd0 msgr2=0x55ce89a12940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.280+0000 7f13a5874000 1 -- 172.21.15.6:0/2926454052 shutdown_connections 2023-10-06T02:25:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.280+0000 7f13a5874000 1 -- 172.21.15.6:0/2926454052 wait complete. 2023-10-06T02:25:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.281+0000 7f13a5874000 1 Processor -- start 2023-10-06T02:25:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.281+0000 7f13a5874000 1 -- start start 2023-10-06T02:25:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f13a5874000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce89938330 0x55ce89a0aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f13a5874000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce899f98b0 0x55ce899f13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f13a5874000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce899f9c80 0x55ce89982fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f13a5874000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce89a08660 con 0x55ce899f98b0 2023-10-06T02:25:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f13a5874000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce89a08900 con 0x55ce899f9c80 2023-10-06T02:25:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f13a5874000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce89a08ba0 con 0x55ce89938330 2023-10-06T02:25:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f139e2ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce899f98b0 0x55ce899f13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f139e2ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce899f98b0 0x55ce899f13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48134/0 (socket says 172.21.15.6:48134) 2023-10-06T02:25:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f139e2ae700 1 -- 172.21.15.6:0/728447666 learned_addr learned my addr 172.21.15.6:0/728447666 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f139eaaf700 1 --2- 172.21.15.6:0/728447666 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce89938330 0x55ce89a0aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f139f2b0700 1 --2- 172.21.15.6:0/728447666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce899f9c80 0x55ce89982fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f139e2ae700 1 -- 172.21.15.6:0/728447666 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce89938330 msgr2=0x55ce89a0aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f139e2ae700 1 --2- 172.21.15.6:0/728447666 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ce89938330 0x55ce89a0aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f139e2ae700 1 -- 172.21.15.6:0/728447666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce899f9c80 msgr2=0x55ce89982fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f139e2ae700 1 --2- 172.21.15.6:0/728447666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce899f9c80 0x55ce89982fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f139e2ae700 1 -- 172.21.15.6:0/728447666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138800a040 con 0x55ce899f98b0 2023-10-06T02:25:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f139e2ae700 1 --2- 172.21.15.6:0/728447666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce899f98b0 0x55ce899f13d0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f13880018b0 tx=0x7f1388016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f13977fe700 1 -- 172.21.15.6:0/728447666 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388001970 con 0x55ce899f98b0 2023-10-06T02:25:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f13977fe700 1 -- 172.21.15.6:0/728447666 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1388021070 con 0x55ce899f98b0 2023-10-06T02:25:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f13a5874000 1 -- 172.21.15.6:0/728447666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ce898933d0 con 0x55ce899f98b0 2023-10-06T02:25:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.282+0000 7f13977fe700 1 -- 172.21.15.6:0/728447666 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388001590 con 0x55ce899f98b0 2023-10-06T02:25:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.283+0000 7f13a5874000 1 -- 172.21.15.6:0/728447666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce89886ae0 con 0x55ce899f98b0 2023-10-06T02:25:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.284+0000 7f13977fe700 1 -- 172.21.15.6:0/728447666 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f138801a480 con 0x55ce899f98b0 2023-10-06T02:25:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.284+0000 7f13977fe700 1 --2- 172.21.15.6:0/728447666 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1380065890 0x7f1380067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.284+0000 7f13977fe700 1 -- 172.21.15.6:0/728447666 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6808+0+0 (secure 0 0 0) 0x7f1388084c80 con 0x55ce899f98b0 2023-10-06T02:25:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.284+0000 7f13a5874000 1 --2- 172.21.15.6:0/728447666 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55ce89a0afa0 0x55ce89a09a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.284+0000 7f13a5874000 1 -- 172.21.15.6:0/728447666 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e100) v8 -- 0x55ce899f1910 con 0x55ce89a0afa0 2023-10-06T02:25:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.284+0000 7f139eaaf700 1 --2- 172.21.15.6:0/728447666 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1380065890 0x7f1380067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.285+0000 7f139f2b0700 1 --2- 172.21.15.6:0/728447666 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55ce89a0afa0 0x55ce89a09a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.285+0000 7f139eaaf700 1 --2- 172.21.15.6:0/728447666 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1380065890 0x7f1380067d40 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1390007000 tx=0x7f1390014000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.285+0000 7f139f2b0700 1 --2- 172.21.15.6:0/728447666 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55ce89a0afa0 0x55ce89a09a90 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.286+0000 7f139f2b0700 1 -- 172.21.15.6:0/728447666 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 200.00000001 [delete] v100'126 uv126 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1398009be0 con 0x55ce89a0afa0 2023-10-06T02:25:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.286+0000 7f13a5874000 1 -- 172.21.15.6:0/728447666 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55ce89a0afa0 msgr2=0x55ce89a09a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.286+0000 7f13a5874000 1 --2- 172.21.15.6:0/728447666 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55ce89a0afa0 0x55ce89a09a90 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.286+0000 7f13a5874000 1 -- 172.21.15.6:0/728447666 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1380065890 msgr2=0x7f1380067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.286+0000 7f13a5874000 1 --2- 172.21.15.6:0/728447666 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1380065890 0x7f1380067d40 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1390007000 tx=0x7f1390014000 comp rx=0 tx=0).stop 2023-10-06T02:25:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.286+0000 7f13a5874000 1 -- 172.21.15.6:0/728447666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce899f98b0 msgr2=0x55ce899f13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.286+0000 7f13a5874000 1 --2- 172.21.15.6:0/728447666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce899f98b0 0x55ce899f13d0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f13880018b0 tx=0x7f1388016000 comp rx=0 tx=0).stop 2023-10-06T02:25:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.286+0000 7f139f2b0700 1 -- 172.21.15.6:0/728447666 reap_dead start 2023-10-06T02:25:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.286+0000 7f13a5874000 1 -- 172.21.15.6:0/728447666 shutdown_connections 2023-10-06T02:25:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.286+0000 7f13a5874000 1 -- 172.21.15.6:0/728447666 >> 172.21.15.6:0/728447666 conn(0x55ce89980bd0 msgr2=0x55ce89968c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.286+0000 7f13a5874000 1 -- 172.21.15.6:0/728447666 shutdown_connections 2023-10-06T02:25:31.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.286+0000 7f13a5874000 1 -- 172.21.15.6:0/728447666 wait complete. 2023-10-06T02:25:31.292 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:25:31.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.455+0000 7facb978a700 1 Processor -- start 2023-10-06T02:25:31.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.455+0000 7facb978a700 1 -- start start 2023-10-06T02:25:31.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.456+0000 7facb978a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7facb40cd7d0 0x7facb40d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.456+0000 7facb978a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facb40b0810 0x7facb40d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.456+0000 7facb978a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb40d0c20 con 0x7facb40cd400 2023-10-06T02:25:31.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.456+0000 7facb978a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb40af770 con 0x7facb40cd7d0 2023-10-06T02:25:31.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.456+0000 7facb978a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb40afa50 con 0x7facb40b0810 2023-10-06T02:25:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.456+0000 7facb3fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7facb40cd400 0x7facb40b1f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35438/0 (socket says 172.21.15.6:35438) 2023-10-06T02:25:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.456+0000 7facb3fff700 1 -- 172.21.15.6:0/26696387 learned_addr learned my addr 172.21.15.6:0/26696387 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.456+0000 7facb2ffd700 1 -- 172.21.15.6:0/26696387 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87783935 0 0) 0x7facb40d0c20 con 0x7facb40cd400 2023-10-06T02:25:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.456+0000 7facb37fe700 1 --2- 172.21.15.6:0/26696387 >> v2:172.21.15.175:3300/0 conn(0x7facb40cd7d0 0x7facb40d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.456+0000 7facb8f89700 1 --2- 172.21.15.6:0/26696387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facb40b0810 0x7facb40d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.456+0000 7facb2ffd700 1 -- 172.21.15.6:0/26696387 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac9c003570 con 0x7facb40cd400 2023-10-06T02:25:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.456+0000 7facb2ffd700 1 -- 172.21.15.6:0/26696387 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2640834403 0 0) 0x7fac9c003570 con 0x7facb40cd400 2023-10-06T02:25:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb2ffd700 1 -- 172.21.15.6:0/26696387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facb40b0810 msgr2=0x7facb40d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb2ffd700 1 --2- 172.21.15.6:0/26696387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facb40b0810 0x7facb40d06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb2ffd700 1 -- 172.21.15.6:0/26696387 >> v2:172.21.15.175:3300/0 conn(0x7facb40cd7d0 msgr2=0x7facb40d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb2ffd700 1 --2- 172.21.15.6:0/26696387 >> v2:172.21.15.175:3300/0 conn(0x7facb40cd7d0 0x7facb40d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb2ffd700 1 -- 172.21.15.6:0/26696387 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb40afd30 con 0x7facb40cd400 2023-10-06T02:25:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb2ffd700 1 -- 172.21.15.6:0/26696387 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7faca40015f0 con 0x7facb40cd400 2023-10-06T02:25:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb2ffd700 1 -- 172.21.15.6:0/26696387 >> v1:172.21.15.6:6789/0 conn(0x7facb40cd400 legacy=0x7facb40b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb2ffd700 1 --2- 172.21.15.6:0/26696387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac9c003ae0 0x7fac9c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb2ffd700 1 --2- 172.21.15.6:0/26696387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facb40b0810 0x7fac9c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb2ffd700 1 --2- 172.21.15.6:0/26696387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c004d50 0x7fac9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb2ffd700 1 -- 172.21.15.6:0/26696387 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb40af770 con 0x7fac9c003ae0 2023-10-06T02:25:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb2ffd700 1 -- 172.21.15.6:0/26696387 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb40afa50 con 0x7fac9c004d50 2023-10-06T02:25:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb2ffd700 1 -- 172.21.15.6:0/26696387 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c00bbc0 con 0x7facb40b0810 2023-10-06T02:25:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb3fff700 1 --2- 172.21.15.6:0/26696387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac9c003ae0 0x7fac9c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb8f89700 1 --2- 172.21.15.6:0/26696387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c004d50 0x7fac9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb37fe700 1 --2- 172.21.15.6:0/26696387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facb40b0810 0x7fac9c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb3fff700 1 -- 172.21.15.6:0/26696387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facb40b0810 msgr2=0x7fac9c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb3fff700 1 --2- 172.21.15.6:0/26696387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facb40b0810 0x7fac9c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb3fff700 1 -- 172.21.15.6:0/26696387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c004d50 msgr2=0x7fac9c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb3fff700 1 --2- 172.21.15.6:0/26696387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c004d50 0x7fac9c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb3fff700 1 -- 172.21.15.6:0/26696387 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c003570 con 0x7fac9c003ae0 2023-10-06T02:25:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb3fff700 1 --2- 172.21.15.6:0/26696387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac9c003ae0 0x7fac9c003ef0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7faca400c210 tx=0x7faca4007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6bd7563a5f4c6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb2ffd700 1 -- 172.21.15.6:0/26696387 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca400cb40 con 0x7fac9c003ae0 2023-10-06T02:25:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb2ffd700 1 -- 172.21.15.6:0/26696387 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca400cca0 con 0x7fac9c003ae0 2023-10-06T02:25:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.457+0000 7facb2ffd700 1 -- 172.21.15.6:0/26696387 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca4007320 con 0x7fac9c003ae0 2023-10-06T02:25:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.458+0000 7facb978a700 1 -- 172.21.15.6:0/26696387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac9c003ae0 msgr2=0x7fac9c003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.458+0000 7facb978a700 1 --2- 172.21.15.6:0/26696387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac9c003ae0 0x7fac9c003ef0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7faca400c210 tx=0x7faca4007810 comp rx=0 tx=0).stop 2023-10-06T02:25:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.458+0000 7facb8f89700 1 -- 172.21.15.6:0/26696387 reap_dead start 2023-10-06T02:25:31.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.458+0000 7facb978a700 1 -- 172.21.15.6:0/26696387 shutdown_connections 2023-10-06T02:25:31.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.458+0000 7facb978a700 1 -- 172.21.15.6:0/26696387 >> 172.21.15.6:0/26696387 conn(0x7facb406a110 msgr2=0x7facb406a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:31.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.458+0000 7facb978a700 1 -- 172.21.15.6:0/26696387 shutdown_connections 2023-10-06T02:25:31.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.458+0000 7facb978a700 1 -- 172.21.15.6:0/26696387 wait complete. 2023-10-06T02:25:31.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.459+0000 7facb978a700 1 Processor -- start 2023-10-06T02:25:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.459+0000 7facb978a700 1 -- start start 2023-10-06T02:25:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.460+0000 7facb978a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb4158a90 0x7facb416cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.460+0000 7facb978a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facb4158e60 0x7facb416a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.460+0000 7facb978a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facb41597f0 0x7facb4153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.460+0000 7facb978a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb416a790 con 0x7facb4158a90 2023-10-06T02:25:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.460+0000 7facb978a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb416d490 con 0x7facb41597f0 2023-10-06T02:25:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.460+0000 7facb978a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb416d770 con 0x7facb4158e60 2023-10-06T02:25:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.460+0000 7facb3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb4158a90 0x7facb416cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.460+0000 7facb3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb4158a90 0x7facb416cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48158/0 (socket says 172.21.15.6:48158) 2023-10-06T02:25:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.460+0000 7facb3fff700 1 -- 172.21.15.6:0/740823834 learned_addr learned my addr 172.21.15.6:0/740823834 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.460+0000 7facb37fe700 1 --2- 172.21.15.6:0/740823834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facb4158e60 0x7facb416a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.460+0000 7facb8f89700 1 --2- 172.21.15.6:0/740823834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facb41597f0 0x7facb4153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.460+0000 7facb3fff700 1 -- 172.21.15.6:0/740823834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facb4158e60 msgr2=0x7facb416a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.460+0000 7facb3fff700 1 --2- 172.21.15.6:0/740823834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facb4158e60 0x7facb416a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.460+0000 7facb3fff700 1 -- 172.21.15.6:0/740823834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facb41597f0 msgr2=0x7facb4153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.460+0000 7facb3fff700 1 --2- 172.21.15.6:0/740823834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facb41597f0 0x7facb4153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.460+0000 7facb3fff700 1 -- 172.21.15.6:0/740823834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb416da50 con 0x7facb4158a90 2023-10-06T02:25:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.460+0000 7facb8f89700 1 --2- 172.21.15.6:0/740823834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facb41597f0 0x7facb4153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.461+0000 7facb3fff700 1 --2- 172.21.15.6:0/740823834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb4158a90 0x7facb416cdd0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7faca4000ef0 tx=0x7faca4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.461+0000 7fac9bfff700 1 -- 172.21.15.6:0/740823834 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca4001700 con 0x7facb4158a90 2023-10-06T02:25:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.461+0000 7fac9bfff700 1 -- 172.21.15.6:0/740823834 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca4001880 con 0x7facb4158a90 2023-10-06T02:25:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.461+0000 7facb978a700 1 -- 172.21.15.6:0/740823834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb40c3cd0 con 0x7facb4158a90 2023-10-06T02:25:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.461+0000 7fac9bfff700 1 -- 172.21.15.6:0/740823834 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca4001d10 con 0x7facb4158a90 2023-10-06T02:25:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.461+0000 7facb978a700 1 -- 172.21.15.6:0/740823834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb4154480 con 0x7facb4158a90 2023-10-06T02:25:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.462+0000 7facb978a700 1 -- 172.21.15.6:0/740823834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb4064aa0 con 0x7facb4158a90 2023-10-06T02:25:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.462+0000 7fac9bfff700 1 -- 172.21.15.6:0/740823834 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faca4005a00 con 0x7facb4158a90 2023-10-06T02:25:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.463+0000 7fac9bfff700 1 --2- 172.21.15.6:0/740823834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faca0066f60 0x7faca0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.463+0000 7fac9bfff700 1 -- 172.21.15.6:0/740823834 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6808+0+0 (secure 0 0 0) 0x7faca40853c0 con 0x7facb4158a90 2023-10-06T02:25:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.463+0000 7facb37fe700 1 --2- 172.21.15.6:0/740823834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faca0066f60 0x7faca0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.463+0000 7facb37fe700 1 --2- 172.21.15.6:0/740823834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faca0066f60 0x7faca0069410 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7facb40c7090 tx=0x7faca80091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.467+0000 7fac9bfff700 1 -- 172.21.15.6:0/740823834 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faca40521e0 con 0x7facb4158a90 2023-10-06T02:25:31.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.705+0000 7facb978a700 1 -- 172.21.15.6:0/740823834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7facb40b0010 con 0x7facb4158a90 2023-10-06T02:25:31.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.913+0000 7fac9bfff700 1 -- 172.21.15.6:0/740823834 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v119) v1 ==== 162+0+0 (secure 0 0 0) 0x7faca4005cb0 con 0x7facb4158a90 2023-10-06T02:25:31.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.916+0000 7facb978a700 1 -- 172.21.15.6:0/740823834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faca0066f60 msgr2=0x7faca0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.916+0000 7facb978a700 1 --2- 172.21.15.6:0/740823834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faca0066f60 0x7faca0069410 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7facb40c7090 tx=0x7faca80091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.916+0000 7facb978a700 1 -- 172.21.15.6:0/740823834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb4158a90 msgr2=0x7facb416cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.916+0000 7facb978a700 1 --2- 172.21.15.6:0/740823834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb4158a90 0x7facb416cdd0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7faca4000ef0 tx=0x7faca4015000 comp rx=0 tx=0).stop 2023-10-06T02:25:31.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.916+0000 7facb978a700 1 -- 172.21.15.6:0/740823834 shutdown_connections 2023-10-06T02:25:31.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.916+0000 7facb978a700 1 --2- 172.21.15.6:0/740823834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facb41597f0 0x7facb4153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.916+0000 7facb978a700 1 --2- 172.21.15.6:0/740823834 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faca0066f60 0x7faca0069410 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.916+0000 7facb978a700 1 --2- 172.21.15.6:0/740823834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb4158a90 0x7facb416cdd0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.916+0000 7facb978a700 1 --2- 172.21.15.6:0/740823834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facb4158e60 0x7facb416a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.916+0000 7facb978a700 1 -- 172.21.15.6:0/740823834 >> 172.21.15.6:0/740823834 conn(0x7facb406a110 msgr2=0x7facb40cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:31.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.916+0000 7facb978a700 1 -- 172.21.15.6:0/740823834 shutdown_connections 2023-10-06T02:25:31.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:31.916+0000 7facb978a700 1 -- 172.21.15.6:0/740823834 wait complete. 2023-10-06T02:25:31.918 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:25:31.921 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:25:31.921+0000 7f9cfd6e9700 -1 log_channel(cluster) log [ERR] : missing journal object 2023-10-06T02:25:31.922 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:25:31.922+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:25:31.922 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:25:31.922+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:25:31.927 INFO:tasks.ceph.mds.a.smithi006.stderr: -13> 2023-10-06T02:25:31.921+0000 7f9cfd6e9700 -1 log_channel(cluster) log [ERR] : missing journal object 2023-10-06T02:25:31.932 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:31.947 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:25:32.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.051+0000 7f81c7f9c700 1 Processor -- start 2023-10-06T02:25:32.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.051+0000 7f81c7f9c700 1 -- start start 2023-10-06T02:25:32.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.052+0000 7f81c7f9c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f81c00af250 0x7f81c00ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.052+0000 7f81c7f9c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81c00af620 0x7f81c00cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.052+0000 7f81c7f9c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c0069550 con 0x7f81c00c9f40 2023-10-06T02:25:32.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.052+0000 7f81c7f9c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c00adb30 con 0x7f81c00af620 2023-10-06T02:25:32.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.052+0000 7f81c7f9c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c00add80 con 0x7f81c00af250 2023-10-06T02:25:32.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.052+0000 7f81c6539700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81c00af620 0x7f81c00cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.052+0000 7f81c6539700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81c00af620 0x7f81c00cd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48172/0 (socket says 172.21.15.6:48172) 2023-10-06T02:25:32.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.052+0000 7f81c6539700 1 -- 172.21.15.6:0/640277089 learned_addr learned my addr 172.21.15.6:0/640277089 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:32.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.053+0000 7f81c5d38700 1 --2- 172.21.15.6:0/640277089 >> v2:172.21.15.175:3300/0 conn(0x7f81c00af250 0x7f81c00ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.053+0000 7f81c6539700 1 -- 172.21.15.6:0/640277089 >> v2:172.21.15.175:3300/0 conn(0x7f81c00af250 msgr2=0x7f81c00ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:32.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.053+0000 7f81c6539700 1 --2- 172.21.15.6:0/640277089 >> v2:172.21.15.175:3300/0 conn(0x7f81c00af250 0x7f81c00ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.053+0000 7f81c6539700 1 -- 172.21.15.6:0/640277089 >> v1:172.21.15.6:6789/0 conn(0x7f81c00c9f40 legacy=0x7f81c00ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.053+0000 7f81c4d36700 1 -- 172.21.15.6:0/640277089 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247661759 0 0) 0x7f81c0069550 con 0x7f81c00c9f40 2023-10-06T02:25:32.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.053+0000 7f81c6539700 1 -- 172.21.15.6:0/640277089 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c00ae060 con 0x7f81c00af620 2023-10-06T02:25:32.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.053+0000 7f81c6539700 1 --2- 172.21.15.6:0/640277089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c00af620 0x7f81c00cd6e0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f81c0063ba0 tx=0x7f81b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e4924414ee8092 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.053+0000 7f81c4d36700 1 -- 172.21.15.6:0/640277089 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b000b860 con 0x7f81c00af620 2023-10-06T02:25:32.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.053+0000 7f81c4d36700 1 -- 172.21.15.6:0/640277089 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b000b9c0 con 0x7f81c00af620 2023-10-06T02:25:32.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.053+0000 7f81c4d36700 1 -- 172.21.15.6:0/640277089 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b000bd60 con 0x7f81c00af620 2023-10-06T02:25:32.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.054+0000 7f81c7f9c700 1 -- 172.21.15.6:0/640277089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c00af620 msgr2=0x7f81c00cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.054+0000 7f81c7f9c700 1 --2- 172.21.15.6:0/640277089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c00af620 0x7f81c00cd6e0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f81c0063ba0 tx=0x7f81b0009250 comp rx=0 tx=0).stop 2023-10-06T02:25:32.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.054+0000 7f81c7f9c700 1 -- 172.21.15.6:0/640277089 shutdown_connections 2023-10-06T02:25:32.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.054+0000 7f81c7f9c700 1 --2- 172.21.15.6:0/640277089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c00af620 0x7f81c00cd6e0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.054+0000 7f81c7f9c700 1 --2- 172.21.15.6:0/640277089 >> v2:172.21.15.175:3300/0 conn(0x7f81c00af250 0x7f81c00ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.054+0000 7f81c7f9c700 1 -- 172.21.15.6:0/640277089 >> 172.21.15.6:0/640277089 conn(0x7f81c0069790 msgr2=0x7f81c0069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:32.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.054+0000 7f81c7f9c700 1 -- 172.21.15.6:0/640277089 shutdown_connections 2023-10-06T02:25:32.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.054+0000 7f81c7f9c700 1 -- 172.21.15.6:0/640277089 wait complete. 2023-10-06T02:25:32.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.055+0000 7f81c7f9c700 1 Processor -- start 2023-10-06T02:25:32.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.055+0000 7f81c7f9c700 1 -- start start 2023-10-06T02:25:32.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c7f9c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c00af250 0x7f81c014f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c7f9c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c00af620 0x7f81c00caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c7f9c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c00c9f40 0x7f81c00b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c7f9c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c0167f30 con 0x7f81c00c9f40 2023-10-06T02:25:32.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c7f9c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c0168790 con 0x7f81c00af620 2023-10-06T02:25:32.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c7f9c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00cdf80 con 0x7f81c00af250 2023-10-06T02:25:32.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c6539700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c00c9f40 0x7f81c00b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c6539700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c00c9f40 0x7f81c00b1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48180/0 (socket says 172.21.15.6:48180) 2023-10-06T02:25:32.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c6539700 1 -- 172.21.15.6:0/971708895 learned_addr learned my addr 172.21.15.6:0/971708895 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:32.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c5d38700 1 --2- 172.21.15.6:0/971708895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c00af250 0x7f81c014f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c5537700 1 --2- 172.21.15.6:0/971708895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c00af620 0x7f81c00caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c6539700 1 -- 172.21.15.6:0/971708895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c00af250 msgr2=0x7f81c014f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c6539700 1 --2- 172.21.15.6:0/971708895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c00af250 0x7f81c014f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c6539700 1 -- 172.21.15.6:0/971708895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c00af620 msgr2=0x7f81c00caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c6539700 1 --2- 172.21.15.6:0/971708895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c00af620 0x7f81c00caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c6539700 1 -- 172.21.15.6:0/971708895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b00094f0 con 0x7f81c00c9f40 2023-10-06T02:25:32.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c6539700 1 --2- 172.21.15.6:0/971708895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c00c9f40 0x7f81c00b1500 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f81c0063db0 tx=0x7f81b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81bdffb700 1 -- 172.21.15.6:0/971708895 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0011ea0 con 0x7f81c00c9f40 2023-10-06T02:25:32.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81bdffb700 1 -- 172.21.15.6:0/971708895 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b001a630 con 0x7f81c00c9f40 2023-10-06T02:25:32.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81bdffb700 1 -- 172.21.15.6:0/971708895 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b001a9f0 con 0x7f81c00c9f40 2023-10-06T02:25:32.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.056+0000 7f81c7f9c700 1 -- 172.21.15.6:0/971708895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c0168140 con 0x7f81c00c9f40 2023-10-06T02:25:32.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.057+0000 7f81c7f9c700 1 -- 172.21.15.6:0/971708895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c00cb480 con 0x7f81c00c9f40 2023-10-06T02:25:32.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.058+0000 7f81c7f9c700 1 -- 172.21.15.6:0/971708895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c0168940 con 0x7f81c00c9f40 2023-10-06T02:25:32.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.058+0000 7f81bdffb700 1 -- 172.21.15.6:0/971708895 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81b002d440 con 0x7f81c00c9f40 2023-10-06T02:25:32.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.058+0000 7f81bdffb700 1 --2- 172.21.15.6:0/971708895 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81ac066f30 0x7f81ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.058+0000 7f81bdffb700 1 -- 172.21.15.6:0/971708895 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f81b00865c0 con 0x7f81c00c9f40 2023-10-06T02:25:32.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.059+0000 7f81c5d38700 1 --2- 172.21.15.6:0/971708895 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81ac066f30 0x7f81ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.059+0000 7f81c5d38700 1 --2- 172.21.15.6:0/971708895 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81ac066f30 0x7f81ac0693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f81b80075a0 tx=0x7f81b80097e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.063+0000 7f81bdffb700 1 -- 172.21.15.6:0/971708895 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81b0053390 con 0x7f81c00c9f40 2023-10-06T02:25:32.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.305+0000 7f81c7f9c700 1 -- 172.21.15.6:0/971708895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81c006fa50 con 0x7f81c00c9f40 2023-10-06T02:25:32.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.306+0000 7f81bdffb700 1 -- 172.21.15.6:0/971708895 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f81b00569b0 con 0x7f81c00c9f40 2023-10-06T02:25:32.307 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:32.307 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":121,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:31.922701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:32.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.308+0000 7f81c7f9c700 1 -- 172.21.15.6:0/971708895 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81ac066f30 msgr2=0x7f81ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.308+0000 7f81c7f9c700 1 --2- 172.21.15.6:0/971708895 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81ac066f30 0x7f81ac0693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f81b80075a0 tx=0x7f81b80097e0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.308+0000 7f81c7f9c700 1 -- 172.21.15.6:0/971708895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c00c9f40 msgr2=0x7f81c00b1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.308+0000 7f81c7f9c700 1 --2- 172.21.15.6:0/971708895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c00c9f40 0x7f81c00b1500 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f81c0063db0 tx=0x7f81b0017000 comp rx=0 tx=0).stop 2023-10-06T02:25:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.308+0000 7f81c7f9c700 1 -- 172.21.15.6:0/971708895 shutdown_connections 2023-10-06T02:25:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.308+0000 7f81c7f9c700 1 --2- 172.21.15.6:0/971708895 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81ac066f30 0x7f81ac0693e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.308+0000 7f81c7f9c700 1 --2- 172.21.15.6:0/971708895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c00c9f40 0x7f81c00b1500 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.308+0000 7f81c7f9c700 1 --2- 172.21.15.6:0/971708895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c00af250 0x7f81c014f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.308+0000 7f81c7f9c700 1 --2- 172.21.15.6:0/971708895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c00af620 0x7f81c00caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.308+0000 7f81c7f9c700 1 -- 172.21.15.6:0/971708895 >> 172.21.15.6:0/971708895 conn(0x7f81c0069790 msgr2=0x7f81c00c7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.308+0000 7f81c7f9c700 1 -- 172.21.15.6:0/971708895 shutdown_connections 2023-10-06T02:25:32.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.308+0000 7f81c7f9c700 1 -- 172.21.15.6:0/971708895 wait complete. 2023-10-06T02:25:32.310 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 121 2023-10-06T02:25:32.320 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:25:32.320 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:32.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.478+0000 7f5b40585700 1 Processor -- start 2023-10-06T02:25:32.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.478+0000 7f5b40585700 1 -- start start 2023-10-06T02:25:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.479+0000 7f5b40585700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b3815ca10 0x7f5b38069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.479+0000 7f5b40585700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b38067d10 0x7f5b3806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.479+0000 7f5b40585700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5b3815cde0 0x7f5b380aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.479+0000 7f5b40585700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b380b1ed0 con 0x7f5b3815ca10 2023-10-06T02:25:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.479+0000 7f5b40585700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b380879c0 con 0x7f5b3815cde0 2023-10-06T02:25:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.479+0000 7f5b40585700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380cec50 con 0x7f5b38067d10 2023-10-06T02:25:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.479+0000 7f5b3e321700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b3815ca10 0x7f5b38069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.479+0000 7f5b3e321700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b3815ca10 0x7f5b38069f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48186/0 (socket says 172.21.15.6:48186) 2023-10-06T02:25:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.480+0000 7f5b3e321700 1 -- 172.21.15.6:0/3567725511 learned_addr learned my addr 172.21.15.6:0/3567725511 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.480+0000 7f5b3db20700 1 --2- 172.21.15.6:0/3567725511 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b38067d10 0x7f5b3806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.480+0000 7f5b3eb22700 1 --2- 172.21.15.6:0/3567725511 >> v2:172.21.15.175:3300/0 conn(0x7f5b3815cde0 0x7f5b380aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.480+0000 7f5b3e321700 1 -- 172.21.15.6:0/3567725511 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b38067d10 msgr2=0x7f5b3806a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.480+0000 7f5b3e321700 1 --2- 172.21.15.6:0/3567725511 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b38067d10 0x7f5b3806a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.480+0000 7f5b3e321700 1 -- 172.21.15.6:0/3567725511 >> v2:172.21.15.175:3300/0 conn(0x7f5b3815cde0 msgr2=0x7f5b380aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.480+0000 7f5b3e321700 1 --2- 172.21.15.6:0/3567725511 >> v2:172.21.15.175:3300/0 conn(0x7f5b3815cde0 0x7f5b380aeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.480+0000 7f5b3e321700 1 -- 172.21.15.6:0/3567725511 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b380cef30 con 0x7f5b3815ca10 2023-10-06T02:25:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.480+0000 7f5b3db20700 1 --2- 172.21.15.6:0/3567725511 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b38067d10 0x7f5b3806a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.480+0000 7f5b3eb22700 1 --2- 172.21.15.6:0/3567725511 >> v2:172.21.15.175:3300/0 conn(0x7f5b3815cde0 0x7f5b380aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.480+0000 7f5b3e321700 1 --2- 172.21.15.6:0/3567725511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3815ca10 0x7f5b38069f70 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f5b3806f1f0 tx=0x7f5b30009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b786363e3a907302 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.480+0000 7f5b3d31f700 1 -- 172.21.15.6:0/3567725511 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b30005c10 con 0x7f5b3815ca10 2023-10-06T02:25:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.480+0000 7f5b3d31f700 1 -- 172.21.15.6:0/3567725511 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b30005d70 con 0x7f5b3815ca10 2023-10-06T02:25:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.480+0000 7f5b3d31f700 1 -- 172.21.15.6:0/3567725511 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3000b880 con 0x7f5b3815ca10 2023-10-06T02:25:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.481+0000 7f5b40585700 1 -- 172.21.15.6:0/3567725511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3815ca10 msgr2=0x7f5b38069f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.481+0000 7f5b40585700 1 --2- 172.21.15.6:0/3567725511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3815ca10 0x7f5b38069f70 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f5b3806f1f0 tx=0x7f5b30009220 comp rx=0 tx=0).stop 2023-10-06T02:25:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.481+0000 7f5b40585700 1 -- 172.21.15.6:0/3567725511 shutdown_connections 2023-10-06T02:25:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.481+0000 7f5b40585700 1 --2- 172.21.15.6:0/3567725511 >> v2:172.21.15.175:3300/0 conn(0x7f5b3815cde0 0x7f5b380aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.481+0000 7f5b40585700 1 --2- 172.21.15.6:0/3567725511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3815ca10 0x7f5b38069f70 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.481+0000 7f5b40585700 1 --2- 172.21.15.6:0/3567725511 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b38067d10 0x7f5b3806a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.481+0000 7f5b40585700 1 -- 172.21.15.6:0/3567725511 >> 172.21.15.6:0/3567725511 conn(0x7f5b38067910 msgr2=0x7f5b380ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.481+0000 7f5b40585700 1 -- 172.21.15.6:0/3567725511 shutdown_connections 2023-10-06T02:25:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.481+0000 7f5b40585700 1 -- 172.21.15.6:0/3567725511 wait complete. 2023-10-06T02:25:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.482+0000 7f5b40585700 1 Processor -- start 2023-10-06T02:25:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.482+0000 7f5b40585700 1 -- start start 2023-10-06T02:25:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.482+0000 7f5b40585700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b38067d10 0x7f5b38154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b40585700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3815ca10 0x7f5b38098680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b40585700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b3815cde0 0x7f5b38098bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b40585700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380af5c0 con 0x7f5b3815ca10 2023-10-06T02:25:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b40585700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3815dc20 con 0x7f5b3815cde0 2023-10-06T02:25:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b40585700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3815e1a0 con 0x7f5b38067d10 2023-10-06T02:25:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b3db20700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3815ca10 0x7f5b38098680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b3db20700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3815ca10 0x7f5b38098680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48196/0 (socket says 172.21.15.6:48196) 2023-10-06T02:25:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b3db20700 1 -- 172.21.15.6:0/168044585 learned_addr learned my addr 172.21.15.6:0/168044585 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b3e321700 1 --2- 172.21.15.6:0/168044585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b38067d10 0x7f5b38154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b3eb22700 1 --2- 172.21.15.6:0/168044585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b3815cde0 0x7f5b38098bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b3db20700 1 -- 172.21.15.6:0/168044585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b38067d10 msgr2=0x7f5b38154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b3db20700 1 --2- 172.21.15.6:0/168044585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b38067d10 0x7f5b38154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b3db20700 1 -- 172.21.15.6:0/168044585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b3815cde0 msgr2=0x7f5b38098bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b3db20700 1 --2- 172.21.15.6:0/168044585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b3815cde0 0x7f5b38098bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b3db20700 1 -- 172.21.15.6:0/168044585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b30009480 con 0x7f5b3815ca10 2023-10-06T02:25:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b3db20700 1 --2- 172.21.15.6:0/168044585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3815ca10 0x7f5b38098680 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00c880 tx=0x7f5b2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b367fc700 1 -- 172.21.15.6:0/168044585 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c011600 con 0x7f5b3815ca10 2023-10-06T02:25:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b367fc700 1 -- 172.21.15.6:0/168044585 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c011760 con 0x7f5b3815ca10 2023-10-06T02:25:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b40585700 1 -- 172.21.15.6:0/168044585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b380af7d0 con 0x7f5b3815ca10 2023-10-06T02:25:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b367fc700 1 -- 172.21.15.6:0/168044585 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c011ae0 con 0x7f5b3815ca10 2023-10-06T02:25:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.483+0000 7f5b40585700 1 -- 172.21.15.6:0/168044585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3815de30 con 0x7f5b3815ca10 2023-10-06T02:25:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.484+0000 7f5b40585700 1 -- 172.21.15.6:0/168044585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3815e310 con 0x7f5b3815ca10 2023-10-06T02:25:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.485+0000 7f5b367fc700 1 -- 172.21.15.6:0/168044585 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b2c022350 con 0x7f5b3815ca10 2023-10-06T02:25:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.485+0000 7f5b367fc700 1 --2- 172.21.15.6:0/168044585 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5b24066f30 0x7f5b240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.485+0000 7f5b367fc700 1 -- 172.21.15.6:0/168044585 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f5b2c084900 con 0x7f5b3815ca10 2023-10-06T02:25:32.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.485+0000 7f5b3e321700 1 --2- 172.21.15.6:0/168044585 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5b24066f30 0x7f5b240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.486+0000 7f5b3e321700 1 --2- 172.21.15.6:0/168044585 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5b24066f30 0x7f5b240693e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009260 tx=0x7f5b30016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.489+0000 7f5b367fc700 1 -- 172.21.15.6:0/168044585 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b2c051630 con 0x7f5b3815ca10 2023-10-06T02:25:32.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.726+0000 7f5b40585700 1 -- 172.21.15.6:0/168044585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b3806e8d0 con 0x7f5b3815ca10 2023-10-06T02:25:32.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.727+0000 7f5b367fc700 1 -- 172.21.15.6:0/168044585 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f5b2c054c50 con 0x7f5b3815ca10 2023-10-06T02:25:32.727 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:32.728 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":121,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:31.922701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:32.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.729+0000 7f5b40585700 1 -- 172.21.15.6:0/168044585 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5b24066f30 msgr2=0x7f5b240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.729+0000 7f5b40585700 1 --2- 172.21.15.6:0/168044585 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5b24066f30 0x7f5b240693e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009260 tx=0x7f5b30016000 comp rx=0 tx=0).stop 2023-10-06T02:25:32.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.729+0000 7f5b40585700 1 -- 172.21.15.6:0/168044585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3815ca10 msgr2=0x7f5b38098680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.729+0000 7f5b40585700 1 --2- 172.21.15.6:0/168044585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3815ca10 0x7f5b38098680 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00c880 tx=0x7f5b2c008040 comp rx=0 tx=0).stop 2023-10-06T02:25:32.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.729+0000 7f5b40585700 1 -- 172.21.15.6:0/168044585 shutdown_connections 2023-10-06T02:25:32.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.729+0000 7f5b40585700 1 --2- 172.21.15.6:0/168044585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b3815cde0 0x7f5b38098bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.729+0000 7f5b40585700 1 --2- 172.21.15.6:0/168044585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b38067d10 0x7f5b38154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.729+0000 7f5b40585700 1 --2- 172.21.15.6:0/168044585 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5b24066f30 0x7f5b240693e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.729+0000 7f5b40585700 1 --2- 172.21.15.6:0/168044585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3815ca10 0x7f5b38098680 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.729+0000 7f5b40585700 1 -- 172.21.15.6:0/168044585 >> 172.21.15.6:0/168044585 conn(0x7f5b38067910 msgr2=0x7f5b38158770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:32.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.729+0000 7f5b40585700 1 -- 172.21.15.6:0/168044585 shutdown_connections 2023-10-06T02:25:32.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.729+0000 7f5b40585700 1 -- 172.21.15.6:0/168044585 wait complete. 2023-10-06T02:25:32.731 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 121 2023-10-06T02:25:32.741 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:25:32.742 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:32.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.862+0000 7f3a21f67700 1 Processor -- start 2023-10-06T02:25:32.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.862+0000 7f3a21f67700 1 -- start start 2023-10-06T02:25:32.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a21f67700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a1c0af8b0 0x7f3a1c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a21f67700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1c15e190 con 0x7f3a1c0b27f0 2023-10-06T02:25:32.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a21f67700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1c0cb650 con 0x7f3a1c0af4e0 2023-10-06T02:25:32.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a21f67700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c0b1910 con 0x7f3a1c0af8b0 2023-10-06T02:25:32.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3a1c0b27f0 0x7f3a1c15d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35470/0 (socket says 172.21.15.6:35470) 2023-10-06T02:25:32.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1bfff700 1 -- 172.21.15.6:0/1565026989 learned_addr learned my addr 172.21.15.6:0/1565026989 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:32.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1affd700 1 --2- 172.21.15.6:0/1565026989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a1c0af8b0 0x7f3a1c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1a7fc700 1 -- 172.21.15.6:0/1565026989 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828279655 0 0) 0x7f3a1c15e190 con 0x7f3a1c0b27f0 2023-10-06T02:25:32.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1a7fc700 1 -- 172.21.15.6:0/1565026989 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a04003570 con 0x7f3a1c0b27f0 2023-10-06T02:25:32.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1a7fc700 1 -- 172.21.15.6:0/1565026989 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488612804 0 0) 0x7f3a1c0cb650 con 0x7f3a1c0af4e0 2023-10-06T02:25:32.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1a7fc700 1 -- 172.21.15.6:0/1565026989 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a1c15e190 con 0x7f3a1c0af4e0 2023-10-06T02:25:32.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1a7fc700 1 -- 172.21.15.6:0/1565026989 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3649303197 0 0) 0x7f3a04003570 con 0x7f3a1c0b27f0 2023-10-06T02:25:32.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1a7fc700 1 -- 172.21.15.6:0/1565026989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a1c0af8b0 msgr2=0x7f3a1c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:32.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1a7fc700 1 --2- 172.21.15.6:0/1565026989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a1c0af8b0 0x7f3a1c15d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1a7fc700 1 -- 172.21.15.6:0/1565026989 >> v1:172.21.15.175:6789/0 conn(0x7f3a1c0af4e0 legacy=0x7f3a1c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1a7fc700 1 -- 172.21.15.6:0/1565026989 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c0ccaf0 con 0x7f3a1c0b27f0 2023-10-06T02:25:32.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1a7fc700 1 -- 172.21.15.6:0/1565026989 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f3a140017f0 con 0x7f3a1c0b27f0 2023-10-06T02:25:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1a7fc700 1 -- 172.21.15.6:0/1565026989 >> v1:172.21.15.6:6789/0 conn(0x7f3a1c0b27f0 legacy=0x7f3a1c15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1a7fc700 1 --2- 172.21.15.6:0/1565026989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a04003c20 0x7f3a04004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1a7fc700 1 --2- 172.21.15.6:0/1565026989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a04004810 0x7f3a04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1a7fc700 1 --2- 172.21.15.6:0/1565026989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a1c0af8b0 0x7f3a040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1a7fc700 1 -- 172.21.15.6:0/1565026989 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c0b1910 con 0x7f3a04003c20 2023-10-06T02:25:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1a7fc700 1 -- 172.21.15.6:0/1565026989 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0400bba0 con 0x7f3a04004810 2023-10-06T02:25:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.863+0000 7f3a1a7fc700 1 -- 172.21.15.6:0/1565026989 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0400bd60 con 0x7f3a1c0af8b0 2023-10-06T02:25:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.864+0000 7f3a1b7fe700 1 --2- 172.21.15.6:0/1565026989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a04003c20 0x7f3a04004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.864+0000 7f3a1affd700 1 --2- 172.21.15.6:0/1565026989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a04004810 0x7f3a04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.864+0000 7f3a1bfff700 1 --2- 172.21.15.6:0/1565026989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a1c0af8b0 0x7f3a040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.864+0000 7f3a1b7fe700 1 -- 172.21.15.6:0/1565026989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a1c0af8b0 msgr2=0x7f3a040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.864+0000 7f3a1b7fe700 1 --2- 172.21.15.6:0/1565026989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a1c0af8b0 0x7f3a040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.864+0000 7f3a1b7fe700 1 -- 172.21.15.6:0/1565026989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a04004810 msgr2=0x7f3a04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.864+0000 7f3a1b7fe700 1 --2- 172.21.15.6:0/1565026989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a04004810 0x7f3a04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.864+0000 7f3a1b7fe700 1 -- 172.21.15.6:0/1565026989 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a04003570 con 0x7f3a04003c20 2023-10-06T02:25:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.864+0000 7f3a1b7fe700 1 --2- 172.21.15.6:0/1565026989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a04003c20 0x7f3a04004010 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c001a10 tx=0x7f3a0c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89c4c11581dbc1d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.864+0000 7f3a1a7fc700 1 -- 172.21.15.6:0/1565026989 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c00c5d0 con 0x7f3a04003c20 2023-10-06T02:25:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.864+0000 7f3a1a7fc700 1 -- 172.21.15.6:0/1565026989 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c00c730 con 0x7f3a04003c20 2023-10-06T02:25:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.864+0000 7f3a1a7fc700 1 -- 172.21.15.6:0/1565026989 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c00cad0 con 0x7f3a04003c20 2023-10-06T02:25:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.865+0000 7f3a21f67700 1 -- 172.21.15.6:0/1565026989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a04003c20 msgr2=0x7f3a04004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.865+0000 7f3a21f67700 1 --2- 172.21.15.6:0/1565026989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a04003c20 0x7f3a04004010 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c001a10 tx=0x7f3a0c007d30 comp rx=0 tx=0).stop 2023-10-06T02:25:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.865+0000 7f3a1bfff700 1 -- 172.21.15.6:0/1565026989 reap_dead start 2023-10-06T02:25:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.865+0000 7f3a21f67700 1 -- 172.21.15.6:0/1565026989 shutdown_connections 2023-10-06T02:25:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.865+0000 7f3a21f67700 1 -- 172.21.15.6:0/1565026989 >> 172.21.15.6:0/1565026989 conn(0x7f3a1c068680 msgr2=0x7f3a1c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.865+0000 7f3a21f67700 1 -- 172.21.15.6:0/1565026989 shutdown_connections 2023-10-06T02:25:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.865+0000 7f3a21f67700 1 -- 172.21.15.6:0/1565026989 wait complete. 2023-10-06T02:25:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.866+0000 7f3a21f67700 1 Processor -- start 2023-10-06T02:25:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.866+0000 7f3a21f67700 1 -- start start 2023-10-06T02:25:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a21f67700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a04003c20 0x7f3a1c0c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a21f67700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a1c16e090 0x7f3a1c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a21f67700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a1c16d430 0x7f3a1c16d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a21f67700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c16dda0 con 0x7f3a04003c20 2023-10-06T02:25:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a21f67700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c0c85e0 con 0x7f3a1c16e090 2023-10-06T02:25:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a21f67700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c0c88c0 con 0x7f3a1c16d430 2023-10-06T02:25:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a04003c20 0x7f3a1c0c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a04003c20 0x7f3a1c0c7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48216/0 (socket says 172.21.15.6:48216) 2023-10-06T02:25:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a1b7fe700 1 -- 172.21.15.6:0/1575470871 learned_addr learned my addr 172.21.15.6:0/1575470871 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a1affd700 1 --2- 172.21.15.6:0/1575470871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a1c16e090 0x7f3a1c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a1bfff700 1 --2- 172.21.15.6:0/1575470871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a1c16d430 0x7f3a1c16d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a1b7fe700 1 -- 172.21.15.6:0/1575470871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a1c16d430 msgr2=0x7f3a1c16d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a1b7fe700 1 --2- 172.21.15.6:0/1575470871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a1c16d430 0x7f3a1c16d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a1b7fe700 1 -- 172.21.15.6:0/1575470871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a1c16e090 msgr2=0x7f3a1c150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a1b7fe700 1 --2- 172.21.15.6:0/1575470871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a1c16e090 0x7f3a1c150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a1b7fe700 1 -- 172.21.15.6:0/1575470871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c0c8ba0 con 0x7f3a04003c20 2023-10-06T02:25:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a1b7fe700 1 --2- 172.21.15.6:0/1575470871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a04003c20 0x7f3a1c0c7d40 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00c3c0 tx=0x7f3a0c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a037fe700 1 -- 172.21.15.6:0/1575470871 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c023070 con 0x7f3a04003c20 2023-10-06T02:25:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a037fe700 1 -- 172.21.15.6:0/1575470871 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c000fe0 con 0x7f3a04003c20 2023-10-06T02:25:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a21f67700 1 -- 172.21.15.6:0/1575470871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c0c8e80 con 0x7f3a04003c20 2023-10-06T02:25:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a037fe700 1 -- 172.21.15.6:0/1575470871 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c00c5d0 con 0x7f3a04003c20 2023-10-06T02:25:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.867+0000 7f3a21f67700 1 -- 172.21.15.6:0/1575470871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c0c9680 con 0x7f3a04003c20 2023-10-06T02:25:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.868+0000 7f3a21f67700 1 -- 172.21.15.6:0/1575470871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c088aa0 con 0x7f3a04003c20 2023-10-06T02:25:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.869+0000 7f3a037fe700 1 -- 172.21.15.6:0/1575470871 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a0c019070 con 0x7f3a04003c20 2023-10-06T02:25:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.869+0000 7f3a037fe700 1 --2- 172.21.15.6:0/1575470871 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a08066f30 0x7f3a080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.869+0000 7f3a037fe700 1 -- 172.21.15.6:0/1575470871 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f3a0c085760 con 0x7f3a04003c20 2023-10-06T02:25:32.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.869+0000 7f3a1affd700 1 --2- 172.21.15.6:0/1575470871 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a08066f30 0x7f3a080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.870+0000 7f3a1affd700 1 --2- 172.21.15.6:0/1575470871 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a08066f30 0x7f3a080693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c155320 tx=0x7f3a100091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:32.873+0000 7f3a037fe700 1 -- 172.21.15.6:0/1575470871 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a0c052530 con 0x7f3a04003c20 2023-10-06T02:25:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.116+0000 7f3a21f67700 1 -- 172.21.15.6:0/1575470871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a1c0cad20 con 0x7f3a04003c20 2023-10-06T02:25:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.117+0000 7f3a037fe700 1 -- 172.21.15.6:0/1575470871 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 122 v122) v1 ==== 95+0+4595 (secure 0 0 0) 0x7f3a0c017020 con 0x7f3a04003c20 2023-10-06T02:25:33.118 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:33.118 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":122,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2951290545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2951290545},{"type":"v1","addr":"172.21.15.6:6835","nonce":2951290545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":122}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:31.922701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.119+0000 7f3a21f67700 1 -- 172.21.15.6:0/1575470871 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a08066f30 msgr2=0x7f3a080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.119+0000 7f3a21f67700 1 --2- 172.21.15.6:0/1575470871 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a08066f30 0x7f3a080693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c155320 tx=0x7f3a100091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.119+0000 7f3a21f67700 1 -- 172.21.15.6:0/1575470871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a04003c20 msgr2=0x7f3a1c0c7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.119+0000 7f3a21f67700 1 --2- 172.21.15.6:0/1575470871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a04003c20 0x7f3a1c0c7d40 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00c3c0 tx=0x7f3a0c015000 comp rx=0 tx=0).stop 2023-10-06T02:25:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.119+0000 7f3a21f67700 1 -- 172.21.15.6:0/1575470871 shutdown_connections 2023-10-06T02:25:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.119+0000 7f3a21f67700 1 --2- 172.21.15.6:0/1575470871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a1c16d430 0x7f3a1c16d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.119+0000 7f3a21f67700 1 --2- 172.21.15.6:0/1575470871 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3a08066f30 0x7f3a080693e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.119+0000 7f3a21f67700 1 --2- 172.21.15.6:0/1575470871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a04003c20 0x7f3a1c0c7d40 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.119+0000 7f3a21f67700 1 --2- 172.21.15.6:0/1575470871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a1c16e090 0x7f3a1c150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.119+0000 7f3a21f67700 1 -- 172.21.15.6:0/1575470871 >> 172.21.15.6:0/1575470871 conn(0x7f3a1c068680 msgr2=0x7f3a1c0b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:33.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.119+0000 7f3a21f67700 1 -- 172.21.15.6:0/1575470871 shutdown_connections 2023-10-06T02:25:33.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.119+0000 7f3a21f67700 1 -- 172.21.15.6:0/1575470871 wait complete. 2023-10-06T02:25:33.121 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 122 2023-10-06T02:25:33.131 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 200.00000001' led to DAMAGED state 2023-10-06T02:25:33.132 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete mds0_openfiles.0' 2023-10-06T02:25:33.132 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:33.132 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:25:33.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:33.132 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:25:33.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:25:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:25:33.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:25:33.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.308+0000 7f4c8efc2700 1 Processor -- start 2023-10-06T02:25:33.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.308+0000 7f4c8efc2700 1 -- start start 2023-10-06T02:25:33.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.308+0000 7f4c8efc2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4c881574b0 0x7f4c880b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.308+0000 7f4c8efc2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c880b13f0 0x7f4c880c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.308+0000 7f4c8efc2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c880c3b40 con 0x7f4c880c4510 2023-10-06T02:25:33.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.308+0000 7f4c8efc2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c880c4990 con 0x7f4c881574b0 2023-10-06T02:25:33.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.308+0000 7f4c8efc2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c880c2f30 con 0x7f4c880b13f0 2023-10-06T02:25:33.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.309+0000 7f4c87fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c880b13f0 0x7f4c880c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.309+0000 7f4c8cd5e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4c881574b0 0x7f4c880b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.309+0000 7f4c8cd5e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4c881574b0 0x7f4c880b0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:41324/0 (socket says 172.21.15.6:41324) 2023-10-06T02:25:33.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.309+0000 7f4c87fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c880b13f0 0x7f4c880c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:34270/0 (socket says 172.21.15.6:34270) 2023-10-06T02:25:33.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.309+0000 7f4c8cd5e700 1 -- 172.21.15.6:0/220011944 learned_addr learned my addr 172.21.15.6:0/220011944 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:33.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.309+0000 7f4c8d55f700 1 --1- 172.21.15.6:0/220011944 >> v1:172.21.15.175:6789/0 conn(0x7f4c880c4510 0x7f4c880cbcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:39262/0 (socket says 172.21.15.6:39262) 2023-10-06T02:25:33.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.309+0000 7f4c8cd5e700 1 -- 172.21.15.6:0/220011944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c880b13f0 msgr2=0x7f4c880c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:33.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.309+0000 7f4c8cd5e700 1 --2- 172.21.15.6:0/220011944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c880b13f0 0x7f4c880c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.309+0000 7f4c8cd5e700 1 -- 172.21.15.6:0/220011944 >> v1:172.21.15.175:6789/0 conn(0x7f4c880c4510 legacy=0x7f4c880cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.309+0000 7f4c8cd5e700 1 -- 172.21.15.6:0/220011944 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c880c3210 con 0x7f4c881574b0 2023-10-06T02:25:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.309+0000 7f4c877fe700 1 -- 172.21.15.6:0/220011944 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621038564 0 0) 0x7f4c880c3b40 con 0x7f4c880c4510 2023-10-06T02:25:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.309+0000 7f4c8cd5e700 1 --2- 172.21.15.6:0/220011944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c881574b0 0x7f4c880b0eb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009f70 tx=0x7f4c80009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aab0326100b8ef50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.309+0000 7f4c877fe700 1 -- 172.21.15.6:0/220011944 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8000e070 con 0x7f4c881574b0 2023-10-06T02:25:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.309+0000 7f4c877fe700 1 -- 172.21.15.6:0/220011944 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8000ba20 con 0x7f4c881574b0 2023-10-06T02:25:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.309+0000 7f4c877fe700 1 -- 172.21.15.6:0/220011944 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c800092e0 con 0x7f4c881574b0 2023-10-06T02:25:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.310+0000 7f4c8efc2700 1 -- 172.21.15.6:0/220011944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c881574b0 msgr2=0x7f4c880b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.310+0000 7f4c8efc2700 1 --2- 172.21.15.6:0/220011944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c881574b0 0x7f4c880b0eb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009f70 tx=0x7f4c80009840 comp rx=0 tx=0).stop 2023-10-06T02:25:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.310+0000 7f4c8efc2700 1 -- 172.21.15.6:0/220011944 shutdown_connections 2023-10-06T02:25:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.310+0000 7f4c8efc2700 1 --2- 172.21.15.6:0/220011944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c881574b0 0x7f4c880b0eb0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.310+0000 7f4c8efc2700 1 --2- 172.21.15.6:0/220011944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c880b13f0 0x7f4c880c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.310+0000 7f4c8efc2700 1 -- 172.21.15.6:0/220011944 >> 172.21.15.6:0/220011944 conn(0x7f4c88067910 msgr2=0x7f4c880ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.310+0000 7f4c8efc2700 1 -- 172.21.15.6:0/220011944 shutdown_connections 2023-10-06T02:25:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.310+0000 7f4c8efc2700 1 -- 172.21.15.6:0/220011944 wait complete. 2023-10-06T02:25:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.311+0000 7f4c8efc2700 1 Processor -- start 2023-10-06T02:25:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.311+0000 7f4c8efc2700 1 -- start start 2023-10-06T02:25:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.312+0000 7f4c8efc2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c880b13f0 0x7f4c8806b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.312+0000 7f4c8efc2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c880c4510 0x7f4c8814f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.312+0000 7f4c8efc2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c881574b0 0x7f4c881599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.312+0000 7f4c8efc2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8806ae60 con 0x7f4c881574b0 2023-10-06T02:25:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.312+0000 7f4c8efc2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8806a1a0 con 0x7f4c880c4510 2023-10-06T02:25:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.312+0000 7f4c8efc2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8814f640 con 0x7f4c880b13f0 2023-10-06T02:25:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.312+0000 7f4c8d55f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c881574b0 0x7f4c881599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.312+0000 7f4c8d55f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c881574b0 0x7f4c881599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48222/0 (socket says 172.21.15.6:48222) 2023-10-06T02:25:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.312+0000 7f4c8d55f700 1 -- 172.21.15.6:0/2313420331 learned_addr learned my addr 172.21.15.6:0/2313420331 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.312+0000 7f4c87fff700 1 --2- 172.21.15.6:0/2313420331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c880c4510 0x7f4c8814f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.312+0000 7f4c8cd5e700 1 --2- 172.21.15.6:0/2313420331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c880b13f0 0x7f4c8806b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.312+0000 7f4c8d55f700 1 -- 172.21.15.6:0/2313420331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c880b13f0 msgr2=0x7f4c8806b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.312+0000 7f4c8d55f700 1 --2- 172.21.15.6:0/2313420331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c880b13f0 0x7f4c8806b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.312+0000 7f4c8d55f700 1 -- 172.21.15.6:0/2313420331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c880c4510 msgr2=0x7f4c8814f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.312+0000 7f4c8d55f700 1 --2- 172.21.15.6:0/2313420331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c880c4510 0x7f4c8814f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.313+0000 7f4c8d55f700 1 -- 172.21.15.6:0/2313420331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c80009ae0 con 0x7f4c881574b0 2023-10-06T02:25:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.313+0000 7f4c87fff700 1 --2- 172.21.15.6:0/2313420331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c880c4510 0x7f4c8814f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.313+0000 7f4c8d55f700 1 --2- 172.21.15.6:0/2313420331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c881574b0 0x7f4c881599d0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000c5b0 tx=0x7f4c70007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.313+0000 7f4c84ff9700 1 -- 172.21.15.6:0/2313420331 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c70005a70 con 0x7f4c881574b0 2023-10-06T02:25:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.313+0000 7f4c84ff9700 1 -- 172.21.15.6:0/2313420331 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c70005bd0 con 0x7f4c881574b0 2023-10-06T02:25:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.313+0000 7f4c8efc2700 1 -- 172.21.15.6:0/2313420331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8809b870 con 0x7f4c881574b0 2023-10-06T02:25:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.313+0000 7f4c84ff9700 1 -- 172.21.15.6:0/2313420331 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c700070d0 con 0x7f4c881574b0 2023-10-06T02:25:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.313+0000 7f4c8efc2700 1 -- 172.21.15.6:0/2313420331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8806a3f0 con 0x7f4c881574b0 2023-10-06T02:25:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.314+0000 7f4c8efc2700 1 -- 172.21.15.6:0/2313420331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c8806e590 con 0x7f4c881574b0 2023-10-06T02:25:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.314+0000 7f4c84ff9700 1 -- 172.21.15.6:0/2313420331 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c70007480 con 0x7f4c881574b0 2023-10-06T02:25:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.315+0000 7f4c84ff9700 1 --2- 172.21.15.6:0/2313420331 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c68066f30 0x7f4c680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.315+0000 7f4c84ff9700 1 -- 172.21.15.6:0/2313420331 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f4c70083f00 con 0x7f4c881574b0 2023-10-06T02:25:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.315+0000 7f4c8cd5e700 1 --2- 172.21.15.6:0/2313420331 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c68066f30 0x7f4c680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.316+0000 7f4c8cd5e700 1 --2- 172.21.15.6:0/2313420331 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c68066f30 0x7f4c680693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009880 tx=0x7f4c80018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.319+0000 7f4c84ff9700 1 -- 172.21.15.6:0/2313420331 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c70050cd0 con 0x7f4c881574b0 2023-10-06T02:25:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.560+0000 7f4c8efc2700 1 -- 172.21.15.6:0/2313420331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4c880c34f0 con 0x7f4c881574b0 2023-10-06T02:25:33.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.933+0000 7f4c84ff9700 1 -- 172.21.15.6:0/2313420331 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v123) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4c70017070 con 0x7f4c881574b0 2023-10-06T02:25:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.935+0000 7f4c8efc2700 1 -- 172.21.15.6:0/2313420331 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c68066f30 msgr2=0x7f4c680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.935+0000 7f4c8efc2700 1 --2- 172.21.15.6:0/2313420331 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c68066f30 0x7f4c680693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009880 tx=0x7f4c80018000 comp rx=0 tx=0).stop 2023-10-06T02:25:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.935+0000 7f4c8efc2700 1 -- 172.21.15.6:0/2313420331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c881574b0 msgr2=0x7f4c881599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.935+0000 7f4c8efc2700 1 --2- 172.21.15.6:0/2313420331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c881574b0 0x7f4c881599d0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000c5b0 tx=0x7f4c70007d10 comp rx=0 tx=0).stop 2023-10-06T02:25:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.935+0000 7f4c8efc2700 1 -- 172.21.15.6:0/2313420331 shutdown_connections 2023-10-06T02:25:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.935+0000 7f4c8efc2700 1 --2- 172.21.15.6:0/2313420331 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c68066f30 0x7f4c680693e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.935+0000 7f4c8efc2700 1 --2- 172.21.15.6:0/2313420331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c881574b0 0x7f4c881599d0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.935+0000 7f4c8efc2700 1 --2- 172.21.15.6:0/2313420331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c880b13f0 0x7f4c8806b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.935+0000 7f4c8efc2700 1 --2- 172.21.15.6:0/2313420331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c880c4510 0x7f4c8814f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.935+0000 7f4c8efc2700 1 -- 172.21.15.6:0/2313420331 >> 172.21.15.6:0/2313420331 conn(0x7f4c88067910 msgr2=0x7f4c880b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.936+0000 7f4c8efc2700 1 -- 172.21.15.6:0/2313420331 shutdown_connections 2023-10-06T02:25:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:33.936+0000 7f4c8efc2700 1 -- 172.21.15.6:0/2313420331 wait complete. 2023-10-06T02:25:33.938 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:25:33.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:25:34.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.070+0000 7fdc6bbe1700 1 Processor -- start 2023-10-06T02:25:34.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.070+0000 7fdc6bbe1700 1 -- start start 2023-10-06T02:25:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.071+0000 7fdc6bbe1700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdc6415a030 0x7fdc6415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.071+0000 7fdc6bbe1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc640afc50 con 0x7fdc6415a940 2023-10-06T02:25:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.071+0000 7fdc6bbe1700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc640aff30 con 0x7fdc64087700 2023-10-06T02:25:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.071+0000 7fdc6bbe1700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc640b0cf0 con 0x7fdc6415a030 2023-10-06T02:25:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.071+0000 7fdc6917c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdc6415a940 0x7fdc64086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35478/0 (socket says 172.21.15.6:35478) 2023-10-06T02:25:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.071+0000 7fdc6917c700 1 -- 172.21.15.6:0/1619958382 learned_addr learned my addr 172.21.15.6:0/1619958382 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:34.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6997d700 1 --2- 172.21.15.6:0/1619958382 >> v2:172.21.15.175:3300/0 conn(0x7fdc6415a030 0x7fdc6415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6897b700 1 -- 172.21.15.6:0/1619958382 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063528976 0 0) 0x7fdc640afc50 con 0x7fdc6415a940 2023-10-06T02:25:34.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6897b700 1 -- 172.21.15.6:0/1619958382 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc4c003570 con 0x7fdc6415a940 2023-10-06T02:25:34.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6897b700 1 -- 172.21.15.6:0/1619958382 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3056878847 0 0) 0x7fdc4c003570 con 0x7fdc6415a940 2023-10-06T02:25:34.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6897b700 1 -- 172.21.15.6:0/1619958382 >> v2:172.21.15.175:3300/0 conn(0x7fdc6415a030 msgr2=0x7fdc6415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:34.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6897b700 1 --2- 172.21.15.6:0/1619958382 >> v2:172.21.15.175:3300/0 conn(0x7fdc6415a030 0x7fdc6415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6897b700 1 -- 172.21.15.6:0/1619958382 >> v1:172.21.15.175:6789/0 conn(0x7fdc64087700 legacy=0x7fdc640b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6897b700 1 -- 172.21.15.6:0/1619958382 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc640b0210 con 0x7fdc6415a940 2023-10-06T02:25:34.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6897b700 1 -- 172.21.15.6:0/1619958382 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fdc58001470 con 0x7fdc6415a940 2023-10-06T02:25:34.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6897b700 1 -- 172.21.15.6:0/1619958382 >> v1:172.21.15.6:6789/0 conn(0x7fdc6415a940 legacy=0x7fdc64086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6897b700 1 --2- 172.21.15.6:0/1619958382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc4c003a60 0x7fdc4c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6897b700 1 --2- 172.21.15.6:0/1619958382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc4c004810 0x7fdc4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6897b700 1 --2- 172.21.15.6:0/1619958382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc4c0051c0 0x7fdc4c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6897b700 1 -- 172.21.15.6:0/1619958382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640b0cf0 con 0x7fdc4c0051c0 2023-10-06T02:25:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6897b700 1 -- 172.21.15.6:0/1619958382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c00c0d0 con 0x7fdc4c004810 2023-10-06T02:25:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6897b700 1 -- 172.21.15.6:0/1619958382 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c00c290 con 0x7fdc4c003a60 2023-10-06T02:25:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6a17e700 1 --2- 172.21.15.6:0/1619958382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc4c0051c0 0x7fdc4c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6997d700 1 --2- 172.21.15.6:0/1619958382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc4c003a60 0x7fdc4c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.072+0000 7fdc6917c700 1 --2- 172.21.15.6:0/1619958382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc4c004810 0x7fdc4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.073+0000 7fdc6a17e700 1 -- 172.21.15.6:0/1619958382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc4c003a60 msgr2=0x7fdc4c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.073+0000 7fdc6a17e700 1 --2- 172.21.15.6:0/1619958382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc4c003a60 0x7fdc4c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.073+0000 7fdc6a17e700 1 -- 172.21.15.6:0/1619958382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc4c004810 msgr2=0x7fdc4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.073+0000 7fdc6a17e700 1 --2- 172.21.15.6:0/1619958382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc4c004810 0x7fdc4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.073+0000 7fdc6a17e700 1 -- 172.21.15.6:0/1619958382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c003570 con 0x7fdc4c0051c0 2023-10-06T02:25:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.073+0000 7fdc6a17e700 1 -- 172.21.15.6:0/1619958382 reap_dead start 2023-10-06T02:25:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.073+0000 7fdc6a17e700 1 --2- 172.21.15.6:0/1619958382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc4c0051c0 0x7fdc4c00ba60 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fdc64087b00 tx=0x7fdc54001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0bfb773d29d33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.073+0000 7fdc6897b700 1 -- 172.21.15.6:0/1619958382 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54001950 con 0x7fdc4c0051c0 2023-10-06T02:25:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.073+0000 7fdc6897b700 1 -- 172.21.15.6:0/1619958382 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc54004030 con 0x7fdc4c0051c0 2023-10-06T02:25:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.073+0000 7fdc6897b700 1 -- 172.21.15.6:0/1619958382 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5400cae0 con 0x7fdc4c0051c0 2023-10-06T02:25:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.073+0000 7fdc6bbe1700 1 -- 172.21.15.6:0/1619958382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc4c0051c0 msgr2=0x7fdc4c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.073+0000 7fdc6bbe1700 1 --2- 172.21.15.6:0/1619958382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc4c0051c0 0x7fdc4c00ba60 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fdc64087b00 tx=0x7fdc54001640 comp rx=0 tx=0).stop 2023-10-06T02:25:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.073+0000 7fdc6bbe1700 1 -- 172.21.15.6:0/1619958382 shutdown_connections 2023-10-06T02:25:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.073+0000 7fdc6bbe1700 1 --2- 172.21.15.6:0/1619958382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc4c0051c0 0x7fdc4c00ba60 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.073+0000 7fdc6bbe1700 1 -- 172.21.15.6:0/1619958382 >> 172.21.15.6:0/1619958382 conn(0x7fdc64068680 msgr2=0x7fdc64068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.074+0000 7fdc6bbe1700 1 -- 172.21.15.6:0/1619958382 shutdown_connections 2023-10-06T02:25:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.074+0000 7fdc6bbe1700 1 -- 172.21.15.6:0/1619958382 wait complete. 2023-10-06T02:25:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.075+0000 7fdc6bbe1700 1 Processor -- start 2023-10-06T02:25:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.075+0000 7fdc6bbe1700 1 -- start start 2023-10-06T02:25:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.075+0000 7fdc6bbe1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc4c0051c0 0x7fdc640c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.075+0000 7fdc6bbe1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc640c9ff0 0x7fdc6415d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.075+0000 7fdc6bbe1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc64169810 0x7fdc6416d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.075+0000 7fdc6bbe1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640c9b60 con 0x7fdc4c0051c0 2023-10-06T02:25:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.075+0000 7fdc6bbe1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640c8f50 con 0x7fdc64169810 2023-10-06T02:25:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.075+0000 7fdc6bbe1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640c9230 con 0x7fdc640c9ff0 2023-10-06T02:25:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.075+0000 7fdc6997d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc4c0051c0 0x7fdc640c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.075+0000 7fdc6997d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc4c0051c0 0x7fdc640c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48248/0 (socket says 172.21.15.6:48248) 2023-10-06T02:25:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.075+0000 7fdc6997d700 1 -- 172.21.15.6:0/3998606343 learned_addr learned my addr 172.21.15.6:0/3998606343 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.076+0000 7fdc6a17e700 1 --2- 172.21.15.6:0/3998606343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc64169810 0x7fdc6416d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.076+0000 7fdc6917c700 1 --2- 172.21.15.6:0/3998606343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc640c9ff0 0x7fdc6415d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.076+0000 7fdc6997d700 1 -- 172.21.15.6:0/3998606343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc640c9ff0 msgr2=0x7fdc6415d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.076+0000 7fdc6997d700 1 --2- 172.21.15.6:0/3998606343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc640c9ff0 0x7fdc6415d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.076+0000 7fdc6997d700 1 -- 172.21.15.6:0/3998606343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc64169810 msgr2=0x7fdc6416d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.076+0000 7fdc6997d700 1 --2- 172.21.15.6:0/3998606343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc64169810 0x7fdc6416d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.076+0000 7fdc6997d700 1 -- 172.21.15.6:0/3998606343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc640c9510 con 0x7fdc4c0051c0 2023-10-06T02:25:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.076+0000 7fdc6917c700 1 --2- 172.21.15.6:0/3998606343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc640c9ff0 0x7fdc6415d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.076+0000 7fdc6a17e700 1 --2- 172.21.15.6:0/3998606343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc64169810 0x7fdc6416d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.076+0000 7fdc6997d700 1 --2- 172.21.15.6:0/3998606343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc4c0051c0 0x7fdc640c8940 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c006ac0 tx=0x7fdc5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.076+0000 7fdc61ffb700 1 -- 172.21.15.6:0/3998606343 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c00fa10 con 0x7fdc4c0051c0 2023-10-06T02:25:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.076+0000 7fdc61ffb700 1 -- 172.21.15.6:0/3998606343 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c00fb70 con 0x7fdc4c0051c0 2023-10-06T02:25:34.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.076+0000 7fdc6bbe1700 1 -- 172.21.15.6:0/3998606343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc640c97f0 con 0x7fdc4c0051c0 2023-10-06T02:25:34.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.076+0000 7fdc61ffb700 1 -- 172.21.15.6:0/3998606343 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c014440 con 0x7fdc4c0051c0 2023-10-06T02:25:34.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.076+0000 7fdc6bbe1700 1 -- 172.21.15.6:0/3998606343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc640ca460 con 0x7fdc4c0051c0 2023-10-06T02:25:34.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.077+0000 7fdc6bbe1700 1 -- 172.21.15.6:0/3998606343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc64088700 con 0x7fdc4c0051c0 2023-10-06T02:25:34.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.078+0000 7fdc61ffb700 1 -- 172.21.15.6:0/3998606343 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc5c014830 con 0x7fdc4c0051c0 2023-10-06T02:25:34.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.078+0000 7fdc61ffb700 1 --2- 172.21.15.6:0/3998606343 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc50066f60 0x7fdc50069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.078+0000 7fdc61ffb700 1 -- 172.21.15.6:0/3998606343 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6894+0+0 (secure 0 0 0) 0x7fdc5c018030 con 0x7fdc4c0051c0 2023-10-06T02:25:34.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.078+0000 7fdc6917c700 1 --2- 172.21.15.6:0/3998606343 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc50066f60 0x7fdc50069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.079+0000 7fdc6917c700 1 --2- 172.21.15.6:0/3998606343 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc50066f60 0x7fdc50069410 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fdc58001ce0 tx=0x7fdc58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:34.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.082+0000 7fdc61ffb700 1 -- 172.21.15.6:0/3998606343 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc5c052180 con 0x7fdc4c0051c0 2023-10-06T02:25:34.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.364+0000 7fdc6bbe1700 1 -- 172.21.15.6:0/3998606343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fdc640c9e40 con 0x7fdc4c0051c0 2023-10-06T02:25:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.941+0000 7fdc61ffb700 1 -- 172.21.15.6:0/3998606343 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v124) v1 ==== 101+0+0 (secure 0 0 0) 0x7fdc5c0557a0 con 0x7fdc4c0051c0 2023-10-06T02:25:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.944+0000 7fdc6bbe1700 1 -- 172.21.15.6:0/3998606343 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc50066f60 msgr2=0x7fdc50069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.944+0000 7fdc6bbe1700 1 --2- 172.21.15.6:0/3998606343 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc50066f60 0x7fdc50069410 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fdc58001ce0 tx=0x7fdc58009040 comp rx=0 tx=0).stop 2023-10-06T02:25:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.944+0000 7fdc6bbe1700 1 -- 172.21.15.6:0/3998606343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc4c0051c0 msgr2=0x7fdc640c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.944+0000 7fdc6bbe1700 1 --2- 172.21.15.6:0/3998606343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc4c0051c0 0x7fdc640c8940 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c006ac0 tx=0x7fdc5c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.944+0000 7fdc6bbe1700 1 -- 172.21.15.6:0/3998606343 shutdown_connections 2023-10-06T02:25:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.944+0000 7fdc6bbe1700 1 --2- 172.21.15.6:0/3998606343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc64169810 0x7fdc6416d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.944+0000 7fdc6bbe1700 1 --2- 172.21.15.6:0/3998606343 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc50066f60 0x7fdc50069410 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.944+0000 7fdc6bbe1700 1 --2- 172.21.15.6:0/3998606343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc4c0051c0 0x7fdc640c8940 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.944+0000 7fdc6bbe1700 1 --2- 172.21.15.6:0/3998606343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc640c9ff0 0x7fdc6415d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.944+0000 7fdc6bbe1700 1 -- 172.21.15.6:0/3998606343 >> 172.21.15.6:0/3998606343 conn(0x7fdc64068680 msgr2=0x7fdc64158bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.944+0000 7fdc6bbe1700 1 -- 172.21.15.6:0/3998606343 shutdown_connections 2023-10-06T02:25:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.944+0000 7fdc6bbe1700 1 -- 172.21.15.6:0/3998606343 wait complete. 2023-10-06T02:25:34.946 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:25:34.957 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:25:34.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.996+0000 7f25c66f6000 1 Processor -- start 2023-10-06T02:25:34.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.996+0000 7f25c66f6000 1 -- start start 2023-10-06T02:25:34.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.997+0000 7f25c66f6000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5558d91f1160 0x5558d92c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.997+0000 7f25c66f6000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d92b28b0 0x5558d92c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.997+0000 7f25c66f6000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558d92b2c80 0x5558d92af670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.997+0000 7f25c66f6000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d913d980 con 0x5558d92b28b0 2023-10-06T02:25:35.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.997+0000 7f25c66f6000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d913d620 con 0x5558d92b2c80 2023-10-06T02:25:35.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.997+0000 7f25c66f6000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558d9134400 con 0x5558d91f1160 2023-10-06T02:25:35.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.997+0000 7f25bf130700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d92b28b0 0x5558d92c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.997+0000 7f25bf130700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d92b28b0 0x5558d92c8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48266/0 (socket says 172.21.15.6:48266) 2023-10-06T02:25:35.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.997+0000 7f25bf130700 1 -- 172.21.15.6:0/3272220416 learned_addr learned my addr 172.21.15.6:0/3272220416 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:35.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.997+0000 7f25bf931700 1 --2- 172.21.15.6:0/3272220416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5558d91f1160 0x5558d92c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.997+0000 7f25c0132700 1 --2- 172.21.15.6:0/3272220416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558d92b2c80 0x5558d92af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.997+0000 7f25bf130700 1 -- 172.21.15.6:0/3272220416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5558d91f1160 msgr2=0x5558d92c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:35.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.997+0000 7f25bf130700 1 --2- 172.21.15.6:0/3272220416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5558d91f1160 0x5558d92c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.997+0000 7f25bf130700 1 -- 172.21.15.6:0/3272220416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558d92b2c80 msgr2=0x5558d92af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:35.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.997+0000 7f25bf130700 1 --2- 172.21.15.6:0/3272220416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558d92b2c80 0x5558d92af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.997+0000 7f25bf130700 1 -- 172.21.15.6:0/3272220416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b000a180 con 0x5558d92b28b0 2023-10-06T02:25:35.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.998+0000 7f25bf130700 1 --2- 172.21.15.6:0/3272220416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d92b28b0 0x5558d92c8730 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f25b400a870 tx=0x7f25b4005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea61f94562e46125 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.998+0000 7f25be12e700 1 -- 172.21.15.6:0/3272220416 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b400f070 con 0x5558d92b28b0 2023-10-06T02:25:35.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.998+0000 7f25be12e700 1 -- 172.21.15.6:0/3272220416 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4008920 con 0x5558d92b28b0 2023-10-06T02:25:35.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.998+0000 7f25be12e700 1 -- 172.21.15.6:0/3272220416 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4008cc0 con 0x5558d92b28b0 2023-10-06T02:25:35.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.998+0000 7f25c66f6000 1 -- 172.21.15.6:0/3272220416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d92b28b0 msgr2=0x5558d92c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.998+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3272220416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d92b28b0 0x5558d92c8730 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f25b400a870 tx=0x7f25b4005c60 comp rx=0 tx=0).stop 2023-10-06T02:25:35.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.998+0000 7f25c66f6000 1 -- 172.21.15.6:0/3272220416 shutdown_connections 2023-10-06T02:25:35.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.998+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3272220416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558d92b2c80 0x5558d92af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.998+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3272220416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5558d91f1160 0x5558d92c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.998+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3272220416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d92b28b0 0x5558d92c8730 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.998+0000 7f25c66f6000 1 -- 172.21.15.6:0/3272220416 >> 172.21.15.6:0/3272220416 conn(0x5558d9239bd0 msgr2=0x5558d92ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:35.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.998+0000 7f25c66f6000 1 -- 172.21.15.6:0/3272220416 shutdown_connections 2023-10-06T02:25:35.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.998+0000 7f25c66f6000 1 -- 172.21.15.6:0/3272220416 wait complete. 2023-10-06T02:25:35.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.999+0000 7f25c66f6000 1 Processor -- start 2023-10-06T02:25:35.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:34.999+0000 7f25c66f6000 1 -- start start 2023-10-06T02:25:35.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25c66f6000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558d91f1160 0x5558d92adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25c66f6000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5558d92b28b0 0x5558d92afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25c66f6000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d92b2c80 0x5558d92380f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25c66f6000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d92b07a0 con 0x5558d92b2c80 2023-10-06T02:25:35.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25c66f6000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d92b0a40 con 0x5558d91f1160 2023-10-06T02:25:35.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25c66f6000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558d92b0ce0 con 0x5558d92b28b0 2023-10-06T02:25:35.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25c0132700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d92b2c80 0x5558d92380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25c0132700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d92b2c80 0x5558d92380f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48268/0 (socket says 172.21.15.6:48268) 2023-10-06T02:25:35.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 learned_addr learned my addr 172.21.15.6:0/3082945574 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:35.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25bf931700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558d91f1160 0x5558d92adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25bf130700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5558d92b28b0 0x5558d92afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5558d92b28b0 msgr2=0x5558d92afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25c0132700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5558d92b28b0 0x5558d92afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558d91f1160 msgr2=0x5558d92adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25c0132700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558d91f1160 0x5558d92adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b400a440 con 0x5558d92b2c80 2023-10-06T02:25:35.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25bf130700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5558d92b28b0 0x5558d92afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:35.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25c0132700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d92b2c80 0x5558d92380f0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f25b8003c90 tx=0x7f25b8003930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25bc92b700 1 -- 172.21.15.6:0/3082945574 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b80032e0 con 0x5558d92b2c80 2023-10-06T02:25:35.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25bc92b700 1 -- 172.21.15.6:0/3082945574 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b8008040 con 0x5558d92b2c80 2023-10-06T02:25:35.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5558d914c3d0 con 0x5558d92b2c80 2023-10-06T02:25:35.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25bc92b700 1 -- 172.21.15.6:0/3082945574 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b800bcb0 con 0x5558d92b2c80 2023-10-06T02:25:35.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.000+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558d913fae0 con 0x5558d92b2c80 2023-10-06T02:25:35.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.002+0000 7f25bc92b700 1 -- 172.21.15.6:0/3082945574 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25b8001760 con 0x5558d92b2c80 2023-10-06T02:25:35.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.002+0000 7f25bc92b700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f25ac0658c0 0x7f25ac067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.002+0000 7f25bc92b700 1 -- 172.21.15.6:0/3082945574 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f25b8083330 con 0x5558d92b2c80 2023-10-06T02:25:35.007 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:25:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.002+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5558d92da4f0 0x5558d92da8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.002+0000 7f25bf931700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f25ac0658c0 0x7f25ac067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.002+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92dae30 con 0x5558d92da4f0 2023-10-06T02:25:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.003+0000 7f25bf130700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5558d92da4f0 0x5558d92da8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.003+0000 7f25bf130700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5558d92da4f0 0x5558d92da8f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.003+0000 7f25bf931700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f25ac0658c0 0x7f25ac067d70 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f25b0005e40 tx=0x7f25b0011000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.004+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v101'164 uv138 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.004+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e5ec0 con 0x5558d92da4f0 2023-10-06T02:25:35.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.006+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v101'165 uv165 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.006+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e6270 con 0x5558d92da4f0 2023-10-06T02:25:35.009 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:25:35.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.007+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v101'166 uv166 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.007+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e7630 con 0x5558d92da4f0 2023-10-06T02:25:35.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.008+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v101'167 uv167 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.008+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e79e0 con 0x5558d92da4f0 2023-10-06T02:25:35.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.009+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v101'168 uv168 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.009+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e6620 con 0x5558d92da4f0 2023-10-06T02:25:35.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.010+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v101'169 uv169 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.010+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e6a20 con 0x5558d92da4f0 2023-10-06T02:25:35.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.011+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v101'170 uv144 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.011+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e6dd0 con 0x5558d92da4f0 2023-10-06T02:25:35.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.012+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v101'171 uv171 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.012+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e6dd0 con 0x5558d92da4f0 2023-10-06T02:25:35.014 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:25:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.014+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v101'172 uv172 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.014+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e6dd0 con 0x5558d92da4f0 2023-10-06T02:25:35.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.015+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v101'173 uv173 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.015+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e6dd0 con 0x5558d92da4f0 2023-10-06T02:25:35.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.016+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v101'174 uv174 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.016+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e6dd0 con 0x5558d92da4f0 2023-10-06T02:25:35.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.017+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v101'175 uv175 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.017+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e6dd0 con 0x5558d92da4f0 2023-10-06T02:25:35.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.018+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v101'176 uv151 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.018+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e6dd0 con 0x5558d92da4f0 2023-10-06T02:25:35.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.019+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v101'177 uv177 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.020+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e6dd0 con 0x5558d92da4f0 2023-10-06T02:25:35.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.021+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v101'178 uv178 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.021 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:25:35.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.021+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e6dd0 con 0x5558d92da4f0 2023-10-06T02:25:35.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.022+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v101'179 uv179 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.022+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e6dd0 con 0x5558d92da4f0 2023-10-06T02:25:35.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.023+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v101'180 uv180 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.023+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e6dd0 con 0x5558d92da4f0 2023-10-06T02:25:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.024+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v101'181 uv181 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.024+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e7d90 con 0x5558d92da4f0 2023-10-06T02:25:35.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.025+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v101'182 uv182 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.025+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e7d90 con 0x5558d92da4f0 2023-10-06T02:25:35.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.026+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v101'183 uv157 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.026+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e7d90 con 0x5558d92da4f0 2023-10-06T02:25:35.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.028+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v101'184 uv184 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.028+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e7d90 con 0x5558d92da4f0 2023-10-06T02:25:35.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.029+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v101'185 uv185 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.029 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:25:35.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.029+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e8da0 con 0x5558d92da4f0 2023-10-06T02:25:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.030+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v101'186 uv186 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.030+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e8da0 con 0x5558d92da4f0 2023-10-06T02:25:35.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.031+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v101'187 uv187 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.031+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e7d90 con 0x5558d92da4f0 2023-10-06T02:25:35.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.032+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v101'188 uv188 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.032+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e7d90 con 0x5558d92da4f0 2023-10-06T02:25:35.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.033+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v101'189 uv163 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.033+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e7d90 con 0x5558d92da4f0 2023-10-06T02:25:35.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.034+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v101'190 uv190 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.034+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e7d90 con 0x5558d92da4f0 2023-10-06T02:25:35.040 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:25:35.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.035+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v101'191 uv191 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.035+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e8da0 con 0x5558d92da4f0 2023-10-06T02:25:35.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.037+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v101'192 uv192 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.037+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e8da0 con 0x5558d92da4f0 2023-10-06T02:25:35.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.038+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v101'193 uv193 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.038+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e7d90 con 0x5558d92da4f0 2023-10-06T02:25:35.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.039+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v101'194 uv194 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92da4f0 2023-10-06T02:25:35.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.039+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5558d92e82a0 0x5558d92ea680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.039+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92eabc0 con 0x5558d92e82a0 2023-10-06T02:25:35.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.039+0000 7f25bf931700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5558d92e82a0 0x5558d92ea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.040+0000 7f25bf931700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5558d92e82a0 0x5558d92ea680 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.041+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v101'127 uv111 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.041+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92eaf70 con 0x5558d92e82a0 2023-10-06T02:25:35.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.042+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v101'128 uv128 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.042+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92eb320 con 0x5558d92e82a0 2023-10-06T02:25:35.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.043+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v101'129 uv129 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.044 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:25:35.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.043+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92eb6d0 con 0x5558d92e82a0 2023-10-06T02:25:35.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.046+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v101'130 uv130 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.046+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92eba80 con 0x5558d92e82a0 2023-10-06T02:25:35.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.051+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v101'131 uv131 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.051+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ebe30 con 0x5558d92e82a0 2023-10-06T02:25:35.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.052+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v101'132 uv114 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.052+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ec230 con 0x5558d92e82a0 2023-10-06T02:25:35.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.055+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v101'133 uv133 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.055+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ec230 con 0x5558d92e82a0 2023-10-06T02:25:35.074 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:25:35.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.057+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v101'134 uv134 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.057+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ec230 con 0x5558d92e82a0 2023-10-06T02:25:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.060+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v101'135 uv135 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.060+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e7100 con 0x5558d92e82a0 2023-10-06T02:25:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.063+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v101'136 uv136 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.063+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92e7100 con 0x5558d92e82a0 2023-10-06T02:25:35.075 INFO:teuthology.orchestra.run.smithi006.stdout:Write #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:25:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.065+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v101'137 uv137 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.065+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ef950 con 0x5558d92e82a0 2023-10-06T02:25:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.068+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [write 0~14075] v101'138 uv138 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.068+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92efd50 con 0x5558d92e82a0 2023-10-06T02:25:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.069+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [omap-set-header] v101'139 uv139 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.069+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ec230 con 0x5558d92e82a0 2023-10-06T02:25:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.070+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 606.00000000 [create] v101'140 uv125 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.070+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ec230 con 0x5558d92e82a0 2023-10-06T02:25:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.071+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 606.00000000 [delete] v101'141 uv141 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.071+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ec230 con 0x5558d92e82a0 2023-10-06T02:25:35.077 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:25:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.073+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v101'142 uv142 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.073+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ed280 con 0x5558d92e82a0 2023-10-06T02:25:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.074+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [setxattr (30)] v101'143 uv143 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.074+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ed240 con 0x5558d92e82a0 2023-10-06T02:25:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.075+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [setxattr (62)] v101'144 uv144 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.075+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ec230 con 0x5558d92e82a0 2023-10-06T02:25:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.076+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [omap-set-header] v101'145 uv145 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.076+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5558d92ec740 0x5558d92ecb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.076+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:51 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ed110 con 0x5558d92ec740 2023-10-06T02:25:35.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.076+0000 7f25bf130700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5558d92ec740 0x5558d92ecb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.077+0000 7f25bf130700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5558d92ec740 0x5558d92ecb10 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.078+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(51 607.00000000 [create] v101'33 uv32 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.078+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:52 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ed1d0 con 0x5558d92ec740 2023-10-06T02:25:35.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.079+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(52 607.00000000 [delete] v101'34 uv34 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.079+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ef6a0 con 0x5558d92ec740 2023-10-06T02:25:35.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.080+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(53 607.00000000 [create] v101'35 uv35 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.081 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:25:35.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.080+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f06b0 con 0x5558d92ec740 2023-10-06T02:25:35.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.081+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(54 607.00000000 [setxattr (30)] v101'36 uv36 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.081+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f06b0 con 0x5558d92ec740 2023-10-06T02:25:35.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.082+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(55 607.00000000 [setxattr (62)] v101'37 uv37 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.082+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ef6a0 con 0x5558d92ec740 2023-10-06T02:25:35.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.083+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(56 607.00000000 [omap-set-header] v101'38 uv38 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.083+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ef6a0 con 0x5558d92ec740 2023-10-06T02:25:35.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.084+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(57 mds0_openfiles.0 [create] v101'24 uv23 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.084+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ef6a0 con 0x5558d92ec740 2023-10-06T02:25:35.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.085+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(58 mds0_openfiles.0 [delete] v101'25 uv25 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.085+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ef6a0 con 0x5558d92ec740 2023-10-06T02:25:35.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.086+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(59 mds0_openfiles.0 [create] v101'26 uv26 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.087 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:25:35.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.086+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ef6a0 con 0x5558d92ec740 2023-10-06T02:25:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.089+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(60 mds0_openfiles.0 [omap-set-header] v101'27 uv27 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.089+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:61 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ef6a0 con 0x5558d92e82a0 2023-10-06T02:25:35.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.092+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(61 608.00000000 [create] v101'33 uv32 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.092+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:62 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ef6a0 con 0x5558d92e82a0 2023-10-06T02:25:35.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.094+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(62 608.00000000 [delete] v101'34 uv34 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.094+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ef6a0 con 0x5558d92e82a0 2023-10-06T02:25:35.097 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:25:35.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.097+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v101'35 uv35 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.097+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f06b0 con 0x5558d92e82a0 2023-10-06T02:25:35.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.100+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [setxattr (30)] v101'36 uv36 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.100+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f06b0 con 0x5558d92e82a0 2023-10-06T02:25:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.102+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [setxattr (62)] v101'37 uv37 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.102+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ef6a0 con 0x5558d92e82a0 2023-10-06T02:25:35.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.108+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [omap-set-header] v101'38 uv38 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92e82a0 2023-10-06T02:25:35.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.108+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5558d92efd20 0x5558d92f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.108+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:67 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f2640 con 0x5558d92efd20 2023-10-06T02:25:35.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.108+0000 7f25c0132700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5558d92efd20 0x5558d92f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.108+0000 7f25c0132700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5558d92efd20 0x5558d92f2100 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.109+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(67 604.00000000 [create] v101'59 uv53 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92efd20 2023-10-06T02:25:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.109+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:68 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f2b20 con 0x5558d92efd20 2023-10-06T02:25:35.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.110+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(68 604.00000000 [delete] v101'60 uv60 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92efd20 2023-10-06T02:25:35.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.111+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f3010 con 0x5558d92efd20 2023-10-06T02:25:35.112 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:25:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.112+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(69 604.00000000 [create] v101'61 uv61 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92efd20 2023-10-06T02:25:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.112+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f4910 con 0x5558d92efd20 2023-10-06T02:25:35.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.113+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(70 604.00000000 [setxattr (30)] v101'62 uv62 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92efd20 2023-10-06T02:25:35.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.113+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f4cc0 con 0x5558d92efd20 2023-10-06T02:25:35.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.114+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(71 604.00000000 [setxattr (62)] v101'63 uv63 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92efd20 2023-10-06T02:25:35.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.114+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f3900 con 0x5558d92efd20 2023-10-06T02:25:35.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.115+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(72 604.00000000 [omap-set-header] v101'64 uv64 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92efd20 2023-10-06T02:25:35.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.115+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f3d00 con 0x5558d92efd20 2023-10-06T02:25:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.116+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(73 500.00000000 [create] v101'65 uv58 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92efd20 2023-10-06T02:25:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.116+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f4100 con 0x5558d92efd20 2023-10-06T02:25:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.117+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(74 500.00000000 [delete] v101'66 uv66 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92efd20 2023-10-06T02:25:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.117+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f4100 con 0x5558d92efd20 2023-10-06T02:25:35.118 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:25:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.118+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(75 500.00000000 [create] v101'67 uv67 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92efd20 2023-10-06T02:25:35.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.118+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f40b0 con 0x5558d92efd20 2023-10-06T02:25:35.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.119+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(76 500.00000000 [write 0~90] v101'68 uv68 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92efd20 2023-10-06T02:25:35.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.119+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f40b0 con 0x5558d92efd20 2023-10-06T02:25:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.120+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(77 500.00000000 [omap-set-header] v101'69 uv69 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92efd20 2023-10-06T02:25:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.120+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5558d92f4500 0x5558d92f7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.120+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:78 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f7ad0 con 0x5558d92f4500 2023-10-06T02:25:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.121+0000 7f25bf931700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5558d92f4500 0x5558d92f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.121+0000 7f25bf931700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5558d92f4500 0x5558d92f7590 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.122+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(78 mds_snaptable [create] v101'27 uv26 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92f4500 2023-10-06T02:25:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.122+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:79 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f7ad0 con 0x5558d92f4500 2023-10-06T02:25:35.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.123+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(79 mds_snaptable [delete] v101'28 uv28 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92f4500 2023-10-06T02:25:35.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.123+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f7ad0 con 0x5558d92f4500 2023-10-06T02:25:35.126 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:25:35.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.126+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(80 mds_snaptable [create] v101'29 uv29 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92f4500 2023-10-06T02:25:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.126+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f7ad0 con 0x5558d92f4500 2023-10-06T02:25:35.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.129+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(81 mds_snaptable [write 0~70] v101'30 uv30 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92f4500 2023-10-06T02:25:35.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.129+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f3490 con 0x5558d92f4500 2023-10-06T02:25:35.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.131+0000 7f25bf931700 1 -- 172.21.15.6:0/3082945574 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v101'31 uv31 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b000e860 con 0x5558d92f4500 2023-10-06T02:25:35.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.131+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:83 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f3490 con 0x5558d92ec740 2023-10-06T02:25:35.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.132+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(83 605.00000000 [create] v101'33 uv32 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.132+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:84 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f3490 con 0x5558d92ec740 2023-10-06T02:25:35.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.135+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(84 605.00000000 [delete] v101'34 uv34 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.135+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f3490 con 0x5558d92ec740 2023-10-06T02:25:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.138+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(85 605.00000000 [create] v101'35 uv35 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.138 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:25:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.138+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f3490 con 0x5558d92ec740 2023-10-06T02:25:35.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.140+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v101'36 uv36 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.140+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f3490 con 0x5558d92ec740 2023-10-06T02:25:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.143+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v101'37 uv37 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.143+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92f7fc0 con 0x5558d92ec740 2023-10-06T02:25:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.145+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(88 605.00000000 [omap-set-header] v101'38 uv38 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.146+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5558d92f84d0 0x5558d92fa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.146+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:89 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fadf0 con 0x5558d92f84d0 2023-10-06T02:25:35.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.146+0000 7f25bf130700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5558d92f84d0 0x5558d92fa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.146+0000 7f25bf130700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5558d92f84d0 0x5558d92fa8b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.148+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(89 mds0_inotable [create] v101'54 uv48 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92f84d0 2023-10-06T02:25:35.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.148+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:90 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fae30 con 0x5558d92f84d0 2023-10-06T02:25:35.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.151+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(90 mds0_inotable [delete] v101'55 uv55 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92f84d0 2023-10-06T02:25:35.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.151+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fae30 con 0x5558d92f84d0 2023-10-06T02:25:35.153 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:25:35.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.153+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(91 mds0_inotable [create] v101'56 uv56 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92f84d0 2023-10-06T02:25:35.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.153+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fb2b0 con 0x5558d92f84d0 2023-10-06T02:25:35.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.156+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(92 mds0_inotable [write 0~34] v101'57 uv57 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92f84d0 2023-10-06T02:25:35.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.156+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fb2b0 con 0x5558d92f84d0 2023-10-06T02:25:35.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.160+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v101'58 uv58 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92f84d0 2023-10-06T02:25:35.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.160+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fb2b0 con 0x5558d92f84d0 2023-10-06T02:25:35.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.161+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(94 100.00000000 [create] v101'59 uv53 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92f84d0 2023-10-06T02:25:35.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.161+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fb2b0 con 0x5558d92f84d0 2023-10-06T02:25:35.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.164+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(95 100.00000000 [delete] v101'60 uv60 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92f84d0 2023-10-06T02:25:35.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.164+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fb2b0 con 0x5558d92f84d0 2023-10-06T02:25:35.167 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:25:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.167+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(96 100.00000000 [create] v101'61 uv61 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92f84d0 2023-10-06T02:25:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.167+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fb2b0 con 0x5558d92f84d0 2023-10-06T02:25:35.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.171+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(97 100.00000000 [omap-set-header] v101'62 uv62 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92f84d0 2023-10-06T02:25:35.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.171+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fe020 con 0x5558d92f84d0 2023-10-06T02:25:35.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.172+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v101'63 uv63 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92f84d0 2023-10-06T02:25:35.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.172+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:99 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fb7a0 con 0x5558d92ec740 2023-10-06T02:25:35.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.173+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(99 mds0_sessionmap [create] v101'26 uv25 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.173+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:100 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fb7a0 con 0x5558d92ec740 2023-10-06T02:25:35.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.174+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(100 mds0_sessionmap [delete] v101'27 uv27 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.174+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fb7a0 con 0x5558d92ec740 2023-10-06T02:25:35.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.175+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(101 mds0_sessionmap [create] v101'28 uv28 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.175 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:25:35.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.175+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fb7a0 con 0x5558d92ec740 2023-10-06T02:25:35.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.176+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v101'29 uv29 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.176+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5558d92fbcb0 0x5558d92fc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.176+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:103 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fe770 con 0x5558d92fbcb0 2023-10-06T02:25:35.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.177+0000 7f25c0132700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5558d92fbcb0 0x5558d92fc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.177+0000 7f25c0132700 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5558d92fbcb0 0x5558d92fc0c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.178+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(103 609.00000000 [create] v101'33 uv32 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92fbcb0 2023-10-06T02:25:35.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.178+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:104 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fe770 con 0x5558d92fbcb0 2023-10-06T02:25:35.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.181+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(104 609.00000000 [delete] v101'34 uv34 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92fbcb0 2023-10-06T02:25:35.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.181+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fe770 con 0x5558d92fbcb0 2023-10-06T02:25:35.184 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:25:35.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.184+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(105 609.00000000 [create] v101'35 uv35 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92fbcb0 2023-10-06T02:25:35.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.184+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ff780 con 0x5558d92fbcb0 2023-10-06T02:25:35.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.187+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v101'36 uv36 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92fbcb0 2023-10-06T02:25:35.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.187+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ff780 con 0x5558d92fbcb0 2023-10-06T02:25:35.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.189+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v101'37 uv37 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92fbcb0 2023-10-06T02:25:35.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.189+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fe770 con 0x5558d92fbcb0 2023-10-06T02:25:35.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.192+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(108 609.00000000 [omap-set-header] v101'38 uv38 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92fbcb0 2023-10-06T02:25:35.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.192+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:109 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fe770 con 0x5558d92efd20 2023-10-06T02:25:35.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.193+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(109 400.00000000 [create] v101'27 uv26 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92efd20 2023-10-06T02:25:35.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.193+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:110 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fe770 con 0x5558d92efd20 2023-10-06T02:25:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.195+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(110 400.00000000 [delete] v101'28 uv28 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92efd20 2023-10-06T02:25:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.195+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fe770 con 0x5558d92efd20 2023-10-06T02:25:35.198 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:25:35.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.198+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(111 400.00000000 [create] v101'29 uv29 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92efd20 2023-10-06T02:25:35.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.198+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fe770 con 0x5558d92efd20 2023-10-06T02:25:35.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.200+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(112 400.00000000 [write 0~22] v101'30 uv30 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92efd20 2023-10-06T02:25:35.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.200+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fe770 con 0x5558d92efd20 2023-10-06T02:25:35.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.201+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(113 400.00000000 [omap-set-header] v101'31 uv31 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f25b8017020 con 0x5558d92efd20 2023-10-06T02:25:35.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.201+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:114 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fe770 con 0x5558d92ec740 2023-10-06T02:25:35.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.202+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(114 100.00000000.inode [create] v101'69 uv61 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.202+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:115 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fe770 con 0x5558d92ec740 2023-10-06T02:25:35.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.204+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(115 100.00000000.inode [delete] v101'70 uv70 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.204+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fe770 con 0x5558d92ec740 2023-10-06T02:25:35.205 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:25:35.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.205+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(116 100.00000000.inode [create] v101'71 uv71 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.205+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fe770 con 0x5558d92ec740 2023-10-06T02:25:35.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.206+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(117 100.00000000.inode [write 0~554] v101'72 uv72 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.206+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fb330 con 0x5558d92ec740 2023-10-06T02:25:35.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.209+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v101'73 uv73 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.209+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fb330 con 0x5558d92ec740 2023-10-06T02:25:35.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.210+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(119 1.00000000 [create] v101'74 uv68 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.210+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fe770 con 0x5558d92ec740 2023-10-06T02:25:35.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.215+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(120 1.00000000 [delete] v101'75 uv75 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.215+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fe770 con 0x5558d92ec740 2023-10-06T02:25:35.219 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:25:35.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.219+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(121 1.00000000 [create] v101'76 uv76 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.219+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ff780 con 0x5558d92ec740 2023-10-06T02:25:35.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.220+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v101'77 uv77 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.220+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92ff780 con 0x5558d92ec740 2023-10-06T02:25:35.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.223+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v101'78 uv78 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.223+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fec60 con 0x5558d92ec740 2023-10-06T02:25:35.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.229+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(124 1.00000000 [omap-set-header] v101'79 uv79 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.229+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v8 -- 0x5558d92fec60 con 0x5558d92ec740 2023-10-06T02:25:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25bf130700 1 -- 172.21.15.6:0/3082945574 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v101'80 uv80 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f25b4008db0 con 0x5558d92ec740 2023-10-06T02:25:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5558d92ec740 msgr2=0x5558d92ecb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5558d92ec740 0x5558d92ecb10 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5558d92da4f0 msgr2=0x5558d92da8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5558d92da4f0 0x5558d92da8f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5558d92f84d0 msgr2=0x5558d92fa8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5558d92f84d0 0x5558d92fa8b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5558d92e82a0 msgr2=0x5558d92ea680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5558d92e82a0 0x5558d92ea680 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 reap_dead start 2023-10-06T02:25:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5558d92fbcb0 msgr2=0x5558d92fc0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5558d92fbcb0 0x5558d92fc0c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5558d92f4500 msgr2=0x5558d92f7590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5558d92f4500 0x5558d92f7590 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5558d92efd20 msgr2=0x5558d92f2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5558d92efd20 0x5558d92f2100 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f25ac0658c0 msgr2=0x7f25ac067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f25ac0658c0 0x7f25ac067d70 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f25b0005e40 tx=0x7f25b0011000 comp rx=0 tx=0).stop 2023-10-06T02:25:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d92b2c80 msgr2=0x5558d92380f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c0132700 1 -- 172.21.15.6:0/3082945574 reap_dead start 2023-10-06T02:25:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d92b2c80 0x5558d92380f0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f25b8003c90 tx=0x7f25b8003930 comp rx=0 tx=0).stop 2023-10-06T02:25:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 shutdown_connections 2023-10-06T02:25:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 --2- 172.21.15.6:0/3082945574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d92b2c80 0x5558d92380f0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 >> 172.21.15.6:0/3082945574 conn(0x5558d9239bd0 msgr2=0x5558d91f5630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.230+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 shutdown_connections 2023-10-06T02:25:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.231+0000 7f25c66f6000 1 -- 172.21.15.6:0/3082945574 wait complete. 2023-10-06T02:25:35.235 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds0_openfiles.0 2023-10-06T02:25:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.313+0000 7fed7de51000 1 Processor -- start 2023-10-06T02:25:35.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.313+0000 7fed7de51000 1 -- start start 2023-10-06T02:25:35.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.314+0000 7fed7de51000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55580d68f3c0 0x55580d6d4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.314+0000 7fed7de51000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55580d763fe0 0x55580d771ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.314+0000 7fed7de51000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55580d6be630 0x55580d772010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.314+0000 7fed7de51000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55580d635320 con 0x55580d68f3c0 2023-10-06T02:25:35.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.314+0000 7fed7de51000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55580d5d9980 con 0x55580d763fe0 2023-10-06T02:25:35.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.314+0000 7fed7de51000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55580d5d9620 con 0x55580d6be630 2023-10-06T02:25:35.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.314+0000 7fed7708c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55580d68f3c0 0x55580d6d4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.314+0000 7fed7708c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55580d68f3c0 0x55580d6d4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48292/0 (socket says 172.21.15.6:48292) 2023-10-06T02:25:35.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.314+0000 7fed7708c700 1 -- 172.21.15.6:0/2845084984 learned_addr learned my addr 172.21.15.6:0/2845084984 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:35.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.314+0000 7fed7788d700 1 --2- 172.21.15.6:0/2845084984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55580d6be630 0x55580d772010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.314+0000 7fed7688b700 1 --2- 172.21.15.6:0/2845084984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55580d763fe0 0x55580d771ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.314+0000 7fed7708c700 1 -- 172.21.15.6:0/2845084984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55580d6be630 msgr2=0x55580d772010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:35.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.314+0000 7fed7708c700 1 --2- 172.21.15.6:0/2845084984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55580d6be630 0x55580d772010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.314+0000 7fed7708c700 1 -- 172.21.15.6:0/2845084984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55580d763fe0 msgr2=0x55580d771ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:35.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.314+0000 7fed7708c700 1 --2- 172.21.15.6:0/2845084984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55580d763fe0 0x55580d771ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.314+0000 7fed7708c700 1 -- 172.21.15.6:0/2845084984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55580d5dbae0 con 0x55580d68f3c0 2023-10-06T02:25:35.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.315+0000 7fed7688b700 1 --2- 172.21.15.6:0/2845084984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55580d763fe0 0x55580d771ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:35.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.315+0000 7fed7708c700 1 --2- 172.21.15.6:0/2845084984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55580d68f3c0 0x55580d6d4920 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fed7000e3b0 tx=0x7fed70001830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b24661a18fa54b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.315+0000 7fed75889700 1 -- 172.21.15.6:0/2845084984 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7000edc0 con 0x55580d68f3c0 2023-10-06T02:25:35.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.315+0000 7fed75889700 1 -- 172.21.15.6:0/2845084984 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed70008030 con 0x55580d68f3c0 2023-10-06T02:25:35.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.315+0000 7fed75889700 1 -- 172.21.15.6:0/2845084984 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed700116a0 con 0x55580d68f3c0 2023-10-06T02:25:35.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.315+0000 7fed7de51000 1 -- 172.21.15.6:0/2845084984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55580d68f3c0 msgr2=0x55580d6d4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.315+0000 7fed7de51000 1 --2- 172.21.15.6:0/2845084984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55580d68f3c0 0x55580d6d4920 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fed7000e3b0 tx=0x7fed70001830 comp rx=0 tx=0).stop 2023-10-06T02:25:35.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.315+0000 7fed7de51000 1 -- 172.21.15.6:0/2845084984 shutdown_connections 2023-10-06T02:25:35.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.315+0000 7fed7de51000 1 --2- 172.21.15.6:0/2845084984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55580d6be630 0x55580d772010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.315+0000 7fed7de51000 1 --2- 172.21.15.6:0/2845084984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55580d68f3c0 0x55580d6d4920 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.315+0000 7fed7de51000 1 --2- 172.21.15.6:0/2845084984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55580d763fe0 0x55580d771ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.315+0000 7fed7de51000 1 -- 172.21.15.6:0/2845084984 >> 172.21.15.6:0/2845084984 conn(0x55580d68ed50 msgr2=0x55580d6bc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:35.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.315+0000 7fed7de51000 1 -- 172.21.15.6:0/2845084984 shutdown_connections 2023-10-06T02:25:35.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.315+0000 7fed7de51000 1 -- 172.21.15.6:0/2845084984 wait complete. 2023-10-06T02:25:35.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.316+0000 7fed7de51000 1 Processor -- start 2023-10-06T02:25:35.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.316+0000 7fed7de51000 1 -- start start 2023-10-06T02:25:35.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7de51000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55580d68f3c0 0x55580d76a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7de51000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55580d6be630 0x55580d6bae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7de51000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55580d763fe0 0x55580d76db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7de51000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55580d5d0400 con 0x55580d763fe0 2023-10-06T02:25:35.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7de51000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55580d691180 con 0x55580d6be630 2023-10-06T02:25:35.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7de51000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55580d690ee0 con 0x55580d68f3c0 2023-10-06T02:25:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7788d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55580d763fe0 0x55580d76db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7708c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55580d68f3c0 0x55580d76a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7688b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55580d6be630 0x55580d6bae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7708c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55580d68f3c0 0x55580d76a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:34332/0 (socket says 172.21.15.6:34332) 2023-10-06T02:25:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7788d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55580d763fe0 0x55580d76db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48302/0 (socket says 172.21.15.6:48302) 2023-10-06T02:25:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7708c700 1 -- 172.21.15.6:0/3004662504 learned_addr learned my addr 172.21.15.6:0/3004662504 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7788d700 1 -- 172.21.15.6:0/3004662504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55580d68f3c0 msgr2=0x55580d76a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7788d700 1 --2- 172.21.15.6:0/3004662504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55580d68f3c0 0x55580d76a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7788d700 1 -- 172.21.15.6:0/3004662504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55580d6be630 msgr2=0x55580d6bae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7788d700 1 --2- 172.21.15.6:0/3004662504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55580d6be630 0x55580d6bae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7788d700 1 -- 172.21.15.6:0/3004662504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7000a040 con 0x55580d763fe0 2023-10-06T02:25:35.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7688b700 1 --2- 172.21.15.6:0/3004662504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55580d6be630 0x55580d6bae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:25:35.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7788d700 1 --2- 172.21.15.6:0/3004662504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55580d763fe0 0x55580d76db10 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fed68013000 tx=0x7fed68014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed5ffff700 1 -- 172.21.15.6:0/3004662504 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6800b8b0 con 0x55580d763fe0 2023-10-06T02:25:35.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed5ffff700 1 -- 172.21.15.6:0/3004662504 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed68003510 con 0x55580d763fe0 2023-10-06T02:25:35.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7de51000 1 -- 172.21.15.6:0/3004662504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55580d5db540 con 0x55580d763fe0 2023-10-06T02:25:35.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed5ffff700 1 -- 172.21.15.6:0/3004662504 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed680060d0 con 0x55580d763fe0 2023-10-06T02:25:35.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.317+0000 7fed7de51000 1 -- 172.21.15.6:0/3004662504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55580d769d50 con 0x55580d763fe0 2023-10-06T02:25:35.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.319+0000 7fed5ffff700 1 -- 172.21.15.6:0/3004662504 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed68003b60 con 0x55580d763fe0 2023-10-06T02:25:35.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.319+0000 7fed5ffff700 1 --2- 172.21.15.6:0/3004662504 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fed640658c0 0x7fed64067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.319+0000 7fed5ffff700 1 -- 172.21.15.6:0/3004662504 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6894+0+0 (secure 0 0 0) 0x7fed68084200 con 0x55580d763fe0 2023-10-06T02:25:35.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.319+0000 7fed7708c700 1 --2- 172.21.15.6:0/3004662504 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fed640658c0 0x7fed64067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.319+0000 7fed7de51000 1 --2- 172.21.15.6:0/3004662504 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55580d6bb360 0x55580d767b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.319+0000 7fed7de51000 1 -- 172.21.15.6:0/3004662504 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e101) v8 -- 0x55580d76e540 con 0x55580d6bb360 2023-10-06T02:25:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.319+0000 7fed7688b700 1 --2- 172.21.15.6:0/3004662504 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55580d6bb360 0x55580d767b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.320+0000 7fed7708c700 1 --2- 172.21.15.6:0/3004662504 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fed640658c0 0x7fed64067d70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fed70001870 tx=0x7fed70019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.320+0000 7fed7688b700 1 --2- 172.21.15.6:0/3004662504 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55580d6bb360 0x55580d767b60 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.323+0000 7fed7688b700 1 -- 172.21.15.6:0/3004662504 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 mds0_openfiles.0 [delete] v101'28 uv28 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fed6c007410 con 0x55580d6bb360 2023-10-06T02:25:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.323+0000 7fed7de51000 1 -- 172.21.15.6:0/3004662504 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55580d6bb360 msgr2=0x55580d767b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.323+0000 7fed7de51000 1 --2- 172.21.15.6:0/3004662504 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55580d6bb360 0x55580d767b60 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.324+0000 7fed7de51000 1 -- 172.21.15.6:0/3004662504 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fed640658c0 msgr2=0x7fed64067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.324+0000 7fed7de51000 1 --2- 172.21.15.6:0/3004662504 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fed640658c0 0x7fed64067d70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fed70001870 tx=0x7fed70019000 comp rx=0 tx=0).stop 2023-10-06T02:25:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.324+0000 7fed7de51000 1 -- 172.21.15.6:0/3004662504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55580d763fe0 msgr2=0x55580d76db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.324+0000 7fed7de51000 1 --2- 172.21.15.6:0/3004662504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55580d763fe0 0x55580d76db10 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fed68013000 tx=0x7fed68014000 comp rx=0 tx=0).stop 2023-10-06T02:25:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.324+0000 7fed7788d700 1 -- 172.21.15.6:0/3004662504 reap_dead start 2023-10-06T02:25:35.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.324+0000 7fed7de51000 1 -- 172.21.15.6:0/3004662504 shutdown_connections 2023-10-06T02:25:35.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.324+0000 7fed7de51000 1 -- 172.21.15.6:0/3004662504 >> 172.21.15.6:0/3004662504 conn(0x55580d68ed50 msgr2=0x55580d6bc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:35.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.324+0000 7fed7de51000 1 -- 172.21.15.6:0/3004662504 shutdown_connections 2023-10-06T02:25:35.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.324+0000 7fed7de51000 1 -- 172.21.15.6:0/3004662504 wait complete. 2023-10-06T02:25:35.392 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:25:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.547+0000 7f399c667700 1 Processor -- start 2023-10-06T02:25:35.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.547+0000 7f399c667700 1 -- start start 2023-10-06T02:25:35.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.548+0000 7f399c667700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39940af460 0x7f3994159990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.548+0000 7f399c667700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39940ce870 con 0x7f39940cd180 2023-10-06T02:25:35.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.548+0000 7f399c667700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39940cffb0 con 0x7f39940af830 2023-10-06T02:25:35.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.548+0000 7f399c667700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399415a010 con 0x7f39940af460 2023-10-06T02:25:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.549+0000 7f399ac04700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f39940cd180 0x7f39940ced00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35508/0 (socket says 172.21.15.6:35508) 2023-10-06T02:25:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.549+0000 7f399ac04700 1 -- 172.21.15.6:0/1213109318 learned_addr learned my addr 172.21.15.6:0/1213109318 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.549+0000 7f399a403700 1 --2- 172.21.15.6:0/1213109318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39940af460 0x7f3994159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.549+0000 7f399a403700 1 -- 172.21.15.6:0/1213109318 >> v1:172.21.15.175:6789/0 conn(0x7f39940af830 legacy=0x7f39940cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.549+0000 7f399a403700 1 -- 172.21.15.6:0/1213109318 >> v1:172.21.15.6:6789/0 conn(0x7f39940cd180 legacy=0x7f39940ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.549+0000 7f399a403700 1 -- 172.21.15.6:0/1213109318 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399415a2f0 con 0x7f39940af460 2023-10-06T02:25:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.549+0000 7f3999401700 1 -- 172.21.15.6:0/1213109318 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2089995508 0 0) 0x7f39940cffb0 con 0x7f39940af830 2023-10-06T02:25:35.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.549+0000 7f399a403700 1 --2- 172.21.15.6:0/1213109318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39940af460 0x7f3994159990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3984009910 tx=0x7f39840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a34f4922c75a802d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.549+0000 7f3999401700 1 -- 172.21.15.6:0/1213109318 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398400b760 con 0x7f39940af460 2023-10-06T02:25:35.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.549+0000 7f3999401700 1 -- 172.21.15.6:0/1213109318 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398400b8c0 con 0x7f39940af460 2023-10-06T02:25:35.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.549+0000 7f3999401700 1 -- 172.21.15.6:0/1213109318 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398400bc60 con 0x7f39940af460 2023-10-06T02:25:35.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.550+0000 7f399c667700 1 -- 172.21.15.6:0/1213109318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39940af460 msgr2=0x7f3994159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.550+0000 7f399c667700 1 --2- 172.21.15.6:0/1213109318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39940af460 0x7f3994159990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3984009910 tx=0x7f39840091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.550+0000 7f399c667700 1 -- 172.21.15.6:0/1213109318 shutdown_connections 2023-10-06T02:25:35.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.550+0000 7f399c667700 1 --2- 172.21.15.6:0/1213109318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39940af460 0x7f3994159990 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.550+0000 7f399c667700 1 -- 172.21.15.6:0/1213109318 >> 172.21.15.6:0/1213109318 conn(0x7f3994068680 msgr2=0x7f3994068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:35.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.550+0000 7f399c667700 1 -- 172.21.15.6:0/1213109318 shutdown_connections 2023-10-06T02:25:35.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.550+0000 7f399c667700 1 -- 172.21.15.6:0/1213109318 wait complete. 2023-10-06T02:25:35.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.551+0000 7f399c667700 1 Processor -- start 2023-10-06T02:25:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.551+0000 7f399c667700 1 -- start start 2023-10-06T02:25:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.552+0000 7f399c667700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39940af460 0x7f3994144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.552+0000 7f399c667700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39940af830 0x7f39940c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.552+0000 7f399c667700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39940cd180 0x7f39940c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.552+0000 7f399c667700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39940b10f0 con 0x7f39940af830 2023-10-06T02:25:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.552+0000 7f399c667700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39940ca750 con 0x7f39940cd180 2023-10-06T02:25:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.552+0000 7f399c667700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39940c9eb0 con 0x7f39940af460 2023-10-06T02:25:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.552+0000 7f3999c02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39940af830 0x7f39940c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.552+0000 7f3999c02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39940af830 0x7f39940c9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48306/0 (socket says 172.21.15.6:48306) 2023-10-06T02:25:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.552+0000 7f3999c02700 1 -- 172.21.15.6:0/1136306182 learned_addr learned my addr 172.21.15.6:0/1136306182 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.553+0000 7f399a403700 1 --2- 172.21.15.6:0/1136306182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39940af460 0x7f3994144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.553+0000 7f399ac04700 1 --2- 172.21.15.6:0/1136306182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39940cd180 0x7f39940c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.553+0000 7f3999c02700 1 -- 172.21.15.6:0/1136306182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39940af460 msgr2=0x7f3994144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.553+0000 7f3999c02700 1 --2- 172.21.15.6:0/1136306182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39940af460 0x7f3994144990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.553+0000 7f3999c02700 1 -- 172.21.15.6:0/1136306182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39940cd180 msgr2=0x7f39940c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.553+0000 7f3999c02700 1 --2- 172.21.15.6:0/1136306182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39940cd180 0x7f39940c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.553+0000 7f3999c02700 1 -- 172.21.15.6:0/1136306182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3984009420 con 0x7f39940af830 2023-10-06T02:25:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.553+0000 7f3999c02700 1 --2- 172.21.15.6:0/1136306182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39940af830 0x7f39940c9380 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f398800c7e0 tx=0x7f3988007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.553+0000 7f39927fc700 1 -- 172.21.15.6:0/1136306182 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3988012700 con 0x7f39940af830 2023-10-06T02:25:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.553+0000 7f39927fc700 1 -- 172.21.15.6:0/1136306182 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3988012880 con 0x7f39940af830 2023-10-06T02:25:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.553+0000 7f399c667700 1 -- 172.21.15.6:0/1136306182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39940ca190 con 0x7f39940af830 2023-10-06T02:25:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.553+0000 7f39927fc700 1 -- 172.21.15.6:0/1136306182 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3988012c40 con 0x7f39940af830 2023-10-06T02:25:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.553+0000 7f399c667700 1 -- 172.21.15.6:0/1136306182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3994144ed0 con 0x7f39940af830 2023-10-06T02:25:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.554+0000 7f399c667700 1 -- 172.21.15.6:0/1136306182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3994088d10 con 0x7f39940af830 2023-10-06T02:25:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.554+0000 7f39927fc700 1 -- 172.21.15.6:0/1136306182 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f398801b400 con 0x7f39940af830 2023-10-06T02:25:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.555+0000 7f39927fc700 1 --2- 172.21.15.6:0/1136306182 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3980066f30 0x7f39800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.555+0000 7f39927fc700 1 -- 172.21.15.6:0/1136306182 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f39880845d0 con 0x7f39940af830 2023-10-06T02:25:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.555+0000 7f399a403700 1 --2- 172.21.15.6:0/1136306182 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3980066f30 0x7f39800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.555+0000 7f399a403700 1 --2- 172.21.15.6:0/1136306182 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3980066f30 0x7f39800693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f39840030c0 tx=0x7f3984016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.559+0000 7f39927fc700 1 -- 172.21.15.6:0/1136306182 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39880513a0 con 0x7f39940af830 2023-10-06T02:25:35.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.798+0000 7f399c667700 1 -- 172.21.15.6:0/1136306182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f399415a5d0 con 0x7f39940af830 2023-10-06T02:25:35.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.945+0000 7f39927fc700 1 -- 172.21.15.6:0/1136306182 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v125) v1 ==== 162+0+0 (secure 0 0 0) 0x7f39880549c0 con 0x7f39940af830 2023-10-06T02:25:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.947+0000 7f399c667700 1 -- 172.21.15.6:0/1136306182 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3980066f30 msgr2=0x7f39800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.947+0000 7f399c667700 1 --2- 172.21.15.6:0/1136306182 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3980066f30 0x7f39800693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f39840030c0 tx=0x7f3984016000 comp rx=0 tx=0).stop 2023-10-06T02:25:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.947+0000 7f399c667700 1 -- 172.21.15.6:0/1136306182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39940af830 msgr2=0x7f39940c9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.947+0000 7f399c667700 1 --2- 172.21.15.6:0/1136306182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39940af830 0x7f39940c9380 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f398800c7e0 tx=0x7f3988007df0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.947+0000 7f399c667700 1 -- 172.21.15.6:0/1136306182 shutdown_connections 2023-10-06T02:25:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.947+0000 7f399c667700 1 --2- 172.21.15.6:0/1136306182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39940cd180 0x7f39940c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.947+0000 7f399c667700 1 --2- 172.21.15.6:0/1136306182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39940af460 0x7f3994144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.947+0000 7f399c667700 1 --2- 172.21.15.6:0/1136306182 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3980066f30 0x7f39800693e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.947+0000 7f399c667700 1 --2- 172.21.15.6:0/1136306182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39940af830 0x7f39940c9380 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.947+0000 7f399c667700 1 -- 172.21.15.6:0/1136306182 >> 172.21.15.6:0/1136306182 conn(0x7f3994068680 msgr2=0x7f3994086ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:35.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.947+0000 7f399c667700 1 -- 172.21.15.6:0/1136306182 shutdown_connections 2023-10-06T02:25:35.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:35.947+0000 7f399c667700 1 -- 172.21.15.6:0/1136306182 wait complete. 2023-10-06T02:25:35.949 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:25:35.950 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:25:35.949+0000 7ff070acb700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2023-10-06T02:25:36.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:36.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.489+0000 7f8bfd3b4700 1 Processor -- start 2023-10-06T02:25:36.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.489+0000 7f8bfd3b4700 1 -- start start 2023-10-06T02:25:36.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bfd3b4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8bf80af4e0 0x7f8bf80b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bfd3b4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8bf80af8b0 0x7f8bf80b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bfd3b4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bf815d460 0x7f8bf815d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bfd3b4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf80b1910 con 0x7f8bf80af4e0 2023-10-06T02:25:36.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bfd3b4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf815e190 con 0x7f8bf80af8b0 2023-10-06T02:25:36.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bfd3b4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf80cb650 con 0x7f8bf815d460 2023-10-06T02:25:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bf6ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8bf80af4e0 0x7f8bf80b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bf6ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8bf80af4e0 0x7f8bf80b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48316/0 (socket says 172.21.15.6:48316) 2023-10-06T02:25:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bf6ffd700 1 -- 172.21.15.6:0/1352977135 learned_addr learned my addr 172.21.15.6:0/1352977135 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bf67fc700 1 --2- 172.21.15.6:0/1352977135 >> v2:172.21.15.175:3300/0 conn(0x7f8bf80af8b0 0x7f8bf80b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bf77fe700 1 --2- 172.21.15.6:0/1352977135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bf815d460 0x7f8bf815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bf6ffd700 1 -- 172.21.15.6:0/1352977135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bf815d460 msgr2=0x7f8bf815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bf6ffd700 1 --2- 172.21.15.6:0/1352977135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bf815d460 0x7f8bf815d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bf6ffd700 1 -- 172.21.15.6:0/1352977135 >> v2:172.21.15.175:3300/0 conn(0x7f8bf80af8b0 msgr2=0x7f8bf80b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bf6ffd700 1 --2- 172.21.15.6:0/1352977135 >> v2:172.21.15.175:3300/0 conn(0x7f8bf80af8b0 0x7f8bf80b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bf6ffd700 1 -- 172.21.15.6:0/1352977135 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf80b2b60 con 0x7f8bf80af4e0 2023-10-06T02:25:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bf6ffd700 1 --2- 172.21.15.6:0/1352977135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf80af4e0 0x7f8bf80b20e0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80cdd50 tx=0x7f8be8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb370cf949ad342 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bf5ffb700 1 -- 172.21.15.6:0/1352977135 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be800b860 con 0x7f8bf80af4e0 2023-10-06T02:25:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bf5ffb700 1 -- 172.21.15.6:0/1352977135 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be800b9c0 con 0x7f8bf80af4e0 2023-10-06T02:25:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.490+0000 7f8bf5ffb700 1 -- 172.21.15.6:0/1352977135 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be800bd60 con 0x7f8bf80af4e0 2023-10-06T02:25:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.491+0000 7f8bfd3b4700 1 -- 172.21.15.6:0/1352977135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf80af4e0 msgr2=0x7f8bf80b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.491+0000 7f8bfd3b4700 1 --2- 172.21.15.6:0/1352977135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf80af4e0 0x7f8bf80b20e0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80cdd50 tx=0x7f8be8009250 comp rx=0 tx=0).stop 2023-10-06T02:25:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.491+0000 7f8bfd3b4700 1 -- 172.21.15.6:0/1352977135 shutdown_connections 2023-10-06T02:25:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.491+0000 7f8bfd3b4700 1 --2- 172.21.15.6:0/1352977135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bf815d460 0x7f8bf815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.491+0000 7f8bfd3b4700 1 --2- 172.21.15.6:0/1352977135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf80af4e0 0x7f8bf80b20e0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.491+0000 7f8bfd3b4700 1 --2- 172.21.15.6:0/1352977135 >> v2:172.21.15.175:3300/0 conn(0x7f8bf80af8b0 0x7f8bf80b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.491+0000 7f8bfd3b4700 1 -- 172.21.15.6:0/1352977135 >> 172.21.15.6:0/1352977135 conn(0x7f8bf8068680 msgr2=0x7f8bf8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.491+0000 7f8bfd3b4700 1 -- 172.21.15.6:0/1352977135 shutdown_connections 2023-10-06T02:25:36.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.491+0000 7f8bfd3b4700 1 -- 172.21.15.6:0/1352977135 wait complete. 2023-10-06T02:25:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.492+0000 7f8bfd3b4700 1 Processor -- start 2023-10-06T02:25:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.492+0000 7f8bfd3b4700 1 -- start start 2023-10-06T02:25:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.493+0000 7f8bfd3b4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bf80af4e0 0x7f8bf8154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.493+0000 7f8bfd3b4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bf80af8b0 0x7f8bf816ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.493+0000 7f8bfd3b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815d460 0x7f8bf8150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.493+0000 7f8bfd3b4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf816e300 con 0x7f8bf815d460 2023-10-06T02:25:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.493+0000 7f8bfd3b4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf8155480 con 0x7f8bf80af8b0 2023-10-06T02:25:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.493+0000 7f8bfd3b4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf8153810 con 0x7f8bf80af4e0 2023-10-06T02:25:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.493+0000 7f8bf77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815d460 0x7f8bf8150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.493+0000 7f8bf77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815d460 0x7f8bf8150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48330/0 (socket says 172.21.15.6:48330) 2023-10-06T02:25:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.493+0000 7f8bf77fe700 1 -- 172.21.15.6:0/507152664 learned_addr learned my addr 172.21.15.6:0/507152664 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.493+0000 7f8bf67fc700 1 --2- 172.21.15.6:0/507152664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bf80af8b0 0x7f8bf816ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.493+0000 7f8bf6ffd700 1 --2- 172.21.15.6:0/507152664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bf80af4e0 0x7f8bf8154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.493+0000 7f8bf77fe700 1 -- 172.21.15.6:0/507152664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bf80af4e0 msgr2=0x7f8bf8154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.493+0000 7f8bf77fe700 1 --2- 172.21.15.6:0/507152664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bf80af4e0 0x7f8bf8154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.494+0000 7f8bf77fe700 1 -- 172.21.15.6:0/507152664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bf80af8b0 msgr2=0x7f8bf816ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.494+0000 7f8bf77fe700 1 --2- 172.21.15.6:0/507152664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bf80af8b0 0x7f8bf816ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.494+0000 7f8bf77fe700 1 -- 172.21.15.6:0/507152664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be80094f0 con 0x7f8bf815d460 2023-10-06T02:25:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.494+0000 7f8bf77fe700 1 --2- 172.21.15.6:0/507152664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815d460 0x7f8bf8150aa0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0007f50 tx=0x7f8bf0009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.494+0000 7f8bdeffd700 1 -- 172.21.15.6:0/507152664 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000eb70 con 0x7f8bf815d460 2023-10-06T02:25:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.494+0000 7f8bdeffd700 1 -- 172.21.15.6:0/507152664 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf000ecf0 con 0x7f8bf815d460 2023-10-06T02:25:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.494+0000 7f8bfd3b4700 1 -- 172.21.15.6:0/507152664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf8152c80 con 0x7f8bf815d460 2023-10-06T02:25:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.494+0000 7f8bdeffd700 1 -- 172.21.15.6:0/507152664 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0014670 con 0x7f8bf815d460 2023-10-06T02:25:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.494+0000 7f8bfd3b4700 1 -- 172.21.15.6:0/507152664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf81531c0 con 0x7f8bf815d460 2023-10-06T02:25:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.495+0000 7f8bfd3b4700 1 -- 172.21.15.6:0/507152664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf8153980 con 0x7f8bf815d460 2023-10-06T02:25:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.495+0000 7f8bdeffd700 1 -- 172.21.15.6:0/507152664 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8bf00149e0 con 0x7f8bf815d460 2023-10-06T02:25:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.496+0000 7f8bdeffd700 1 --2- 172.21.15.6:0/507152664 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8be4066f30 0x7f8be40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.496+0000 7f8bdeffd700 1 -- 172.21.15.6:0/507152664 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f8bf0084f20 con 0x7f8bf815d460 2023-10-06T02:25:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.496+0000 7f8bf6ffd700 1 --2- 172.21.15.6:0/507152664 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8be4066f30 0x7f8be40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.496+0000 7f8bf6ffd700 1 --2- 172.21.15.6:0/507152664 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8be4066f30 0x7f8be40693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80cdd50 tx=0x7f8be8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:36.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.500+0000 7f8bdeffd700 1 -- 172.21.15.6:0/507152664 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8bf0051cf0 con 0x7f8bf815d460 2023-10-06T02:25:36.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.737+0000 7f8bfd3b4700 1 -- 172.21.15.6:0/507152664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bf80cad20 con 0x7f8bf815d460 2023-10-06T02:25:36.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.737+0000 7f8bdeffd700 1 -- 172.21.15.6:0/507152664 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f8bf0055310 con 0x7f8bf815d460 2023-10-06T02:25:36.738 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:36.738 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":126,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":126,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:35.945899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8214":{"gid":8214,"name":"a","rank":0,"incarnation":126,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/2951290545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2951290545},{"type":"v1","addr":"172.21.15.6:6835","nonce":2951290545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.739+0000 7f8bfd3b4700 1 -- 172.21.15.6:0/507152664 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8be4066f30 msgr2=0x7f8be40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.739+0000 7f8bfd3b4700 1 --2- 172.21.15.6:0/507152664 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8be4066f30 0x7f8be40693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80cdd50 tx=0x7f8be8017000 comp rx=0 tx=0).stop 2023-10-06T02:25:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.739+0000 7f8bfd3b4700 1 -- 172.21.15.6:0/507152664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815d460 msgr2=0x7f8bf8150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.739+0000 7f8bfd3b4700 1 --2- 172.21.15.6:0/507152664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815d460 0x7f8bf8150aa0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0007f50 tx=0x7f8bf0009860 comp rx=0 tx=0).stop 2023-10-06T02:25:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.739+0000 7f8bfd3b4700 1 -- 172.21.15.6:0/507152664 shutdown_connections 2023-10-06T02:25:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.739+0000 7f8bfd3b4700 1 --2- 172.21.15.6:0/507152664 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8be4066f30 0x7f8be40693e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.739+0000 7f8bfd3b4700 1 --2- 172.21.15.6:0/507152664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815d460 0x7f8bf8150aa0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.739+0000 7f8bfd3b4700 1 --2- 172.21.15.6:0/507152664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bf80af4e0 0x7f8bf8154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.739+0000 7f8bfd3b4700 1 --2- 172.21.15.6:0/507152664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bf80af8b0 0x7f8bf816ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.739+0000 7f8bfd3b4700 1 -- 172.21.15.6:0/507152664 >> 172.21.15.6:0/507152664 conn(0x7f8bf8068680 msgr2=0x7f8bf815c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.739+0000 7f8bfd3b4700 1 -- 172.21.15.6:0/507152664 shutdown_connections 2023-10-06T02:25:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:36.739+0000 7f8bfd3b4700 1 -- 172.21.15.6:0/507152664 wait complete. 2023-10-06T02:25:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 126 2023-10-06T02:25:36.752 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 126, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:25:35.945899+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8214}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8214': {'gid': 8214, 'name': 'a', 'rank': 0, 'incarnation': 126, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.6:6835/2951290545', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 2951290545}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 2951290545}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:25:36.752 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8214:up:replay 2023-10-06T02:25:36.752 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2023-10-06T02:25:42.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:42.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.289+0000 7fd5fb04a700 1 Processor -- start 2023-10-06T02:25:42.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.289+0000 7fd5fb04a700 1 -- start start 2023-10-06T02:25:42.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.290+0000 7fd5fb04a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5f4150370 0x7fd5f40c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.290+0000 7fd5fb04a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f406c950 con 0x7fd5f4150740 2023-10-06T02:25:42.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.290+0000 7fd5fb04a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f4069830 con 0x7fd5f406cde0 2023-10-06T02:25:42.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.290+0000 7fd5fb04a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f4069b10 con 0x7fd5f4150370 2023-10-06T02:25:42.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.290+0000 7fd5f8de6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5f4150370 0x7fd5f40c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.290+0000 7fd5f8de6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5f4150370 0x7fd5f40c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35884/0 (socket says 172.21.15.6:35884) 2023-10-06T02:25:42.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.290+0000 7fd5f8de6700 1 -- 172.21.15.6:0/241893248 learned_addr learned my addr 172.21.15.6:0/241893248 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:42.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.290+0000 7fd5f3fff700 1 --1- 172.21.15.6:0/241893248 >> v1:172.21.15.6:6789/0 conn(0x7fd5f4150740 0x7fd5f4069040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45504/0 (socket says 172.21.15.6:45504) 2023-10-06T02:25:42.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.291+0000 7fd5f8de6700 1 -- 172.21.15.6:0/241893248 >> v1:172.21.15.175:6789/0 conn(0x7fd5f406cde0 legacy=0x7fd5f40af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.291+0000 7fd5f8de6700 1 -- 172.21.15.6:0/241893248 >> v1:172.21.15.6:6789/0 conn(0x7fd5f4150740 legacy=0x7fd5f4069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.291+0000 7fd5f8de6700 1 -- 172.21.15.6:0/241893248 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f406c300 con 0x7fd5f4150370 2023-10-06T02:25:42.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.291+0000 7fd5f37fe700 1 -- 172.21.15.6:0/241893248 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193576115 0 0) 0x7fd5f406c950 con 0x7fd5f4150740 2023-10-06T02:25:42.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.291+0000 7fd5f8de6700 1 --2- 172.21.15.6:0/241893248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f4150370 0x7fd5f40c8b40 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0099b0 tx=0x7fd5ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6548936f6a9971d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.291+0000 7fd5f37fe700 1 -- 172.21.15.6:0/241893248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec00b860 con 0x7fd5f4150370 2023-10-06T02:25:42.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.291+0000 7fd5f37fe700 1 -- 172.21.15.6:0/241893248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ec00b9c0 con 0x7fd5f4150370 2023-10-06T02:25:42.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.291+0000 7fd5f37fe700 1 -- 172.21.15.6:0/241893248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec00bd60 con 0x7fd5f4150370 2023-10-06T02:25:42.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.292+0000 7fd5fb04a700 1 -- 172.21.15.6:0/241893248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f4150370 msgr2=0x7fd5f40c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.292+0000 7fd5fb04a700 1 --2- 172.21.15.6:0/241893248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f4150370 0x7fd5f40c8b40 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0099b0 tx=0x7fd5ec009250 comp rx=0 tx=0).stop 2023-10-06T02:25:42.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.292+0000 7fd5fb04a700 1 -- 172.21.15.6:0/241893248 shutdown_connections 2023-10-06T02:25:42.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.292+0000 7fd5fb04a700 1 --2- 172.21.15.6:0/241893248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f4150370 0x7fd5f40c8b40 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.292+0000 7fd5fb04a700 1 -- 172.21.15.6:0/241893248 >> 172.21.15.6:0/241893248 conn(0x7fd5f406b6e0 msgr2=0x7fd5f40ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:42.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.292+0000 7fd5fb04a700 1 -- 172.21.15.6:0/241893248 shutdown_connections 2023-10-06T02:25:42.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.292+0000 7fd5fb04a700 1 -- 172.21.15.6:0/241893248 wait complete. 2023-10-06T02:25:42.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.293+0000 7fd5fb04a700 1 Processor -- start 2023-10-06T02:25:42.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.293+0000 7fd5fb04a700 1 -- start start 2023-10-06T02:25:42.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.294+0000 7fd5fb04a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5f406cde0 0x7fd5f40af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.294+0000 7fd5fb04a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f4150370 0x7fd5f414e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.294+0000 7fd5fb04a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5f414e670 0x7fd5f4150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.294+0000 7fd5fb04a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f40b0850 con 0x7fd5f4150370 2023-10-06T02:25:42.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.294+0000 7fd5fb04a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f4152d40 con 0x7fd5f414e670 2023-10-06T02:25:42.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.294+0000 7fd5fb04a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f40afbd0 con 0x7fd5f406cde0 2023-10-06T02:25:42.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.294+0000 7fd5f3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f4150370 0x7fd5f414e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.294+0000 7fd5f3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f4150370 0x7fd5f414e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35894/0 (socket says 172.21.15.6:35894) 2023-10-06T02:25:42.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.294+0000 7fd5f3fff700 1 -- 172.21.15.6:0/2320640492 learned_addr learned my addr 172.21.15.6:0/2320640492 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:42.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.294+0000 7fd5f8de6700 1 --2- 172.21.15.6:0/2320640492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5f406cde0 0x7fd5f40af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.294+0000 7fd5f95e7700 1 --2- 172.21.15.6:0/2320640492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5f414e670 0x7fd5f4150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.294+0000 7fd5f3fff700 1 -- 172.21.15.6:0/2320640492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5f406cde0 msgr2=0x7fd5f40af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.294+0000 7fd5f3fff700 1 --2- 172.21.15.6:0/2320640492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5f406cde0 0x7fd5f40af540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.294+0000 7fd5f3fff700 1 -- 172.21.15.6:0/2320640492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5f414e670 msgr2=0x7fd5f4150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.294+0000 7fd5f3fff700 1 --2- 172.21.15.6:0/2320640492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5f414e670 0x7fd5f4150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.294+0000 7fd5f3fff700 1 -- 172.21.15.6:0/2320640492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ec0094f0 con 0x7fd5f4150370 2023-10-06T02:25:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.294+0000 7fd5f95e7700 1 --2- 172.21.15.6:0/2320640492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5f414e670 0x7fd5f4150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.295+0000 7fd5f3fff700 1 --2- 172.21.15.6:0/2320640492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f4150370 0x7fd5f414e130 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400cd80 tx=0x7fd5e4001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.295+0000 7fd5f0ff9700 1 -- 172.21.15.6:0/2320640492 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4005df0 con 0x7fd5f4150370 2023-10-06T02:25:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.295+0000 7fd5f0ff9700 1 -- 172.21.15.6:0/2320640492 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e400a960 con 0x7fd5f4150370 2023-10-06T02:25:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.295+0000 7fd5fb04a700 1 -- 172.21.15.6:0/2320640492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f40afeb0 con 0x7fd5f4150370 2023-10-06T02:25:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.295+0000 7fd5f0ff9700 1 -- 172.21.15.6:0/2320640492 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e400ad20 con 0x7fd5f4150370 2023-10-06T02:25:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.295+0000 7fd5fb04a700 1 -- 172.21.15.6:0/2320640492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f40b0470 con 0x7fd5f4150370 2023-10-06T02:25:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.296+0000 7fd5fb04a700 1 -- 172.21.15.6:0/2320640492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f406db40 con 0x7fd5f4150370 2023-10-06T02:25:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.296+0000 7fd5f0ff9700 1 -- 172.21.15.6:0/2320640492 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd5e4007300 con 0x7fd5f4150370 2023-10-06T02:25:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.297+0000 7fd5f0ff9700 1 --2- 172.21.15.6:0/2320640492 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd5d4066f30 0x7fd5d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.297+0000 7fd5f0ff9700 1 -- 172.21.15.6:0/2320640492 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6894+0+0 (secure 0 0 0) 0x7fd5e4084bc0 con 0x7fd5f4150370 2023-10-06T02:25:42.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.297+0000 7fd5f8de6700 1 --2- 172.21.15.6:0/2320640492 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd5d4066f30 0x7fd5d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.297+0000 7fd5f8de6700 1 --2- 172.21.15.6:0/2320640492 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd5d4066f30 0x7fd5d40693e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0099b0 tx=0x7fd5ec017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.301+0000 7fd5f0ff9700 1 -- 172.21.15.6:0/2320640492 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5e4051a10 con 0x7fd5f4150370 2023-10-06T02:25:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.538+0000 7fd5fb04a700 1 -- 172.21.15.6:0/2320640492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5f406c5e0 con 0x7fd5f4150370 2023-10-06T02:25:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.539+0000 7fd5f0ff9700 1 -- 172.21.15.6:0/2320640492 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) v1 ==== 95+0+4604 (secure 0 0 0) 0x7fd5e4055030 con 0x7fd5f4150370 2023-10-06T02:25:42.540 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:42.540 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":129,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:38.960386+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8214":{"gid":8214,"name":"a","rank":0,"incarnation":126,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/2951290545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2951290545},{"type":"v1","addr":"172.21.15.6:6835","nonce":2951290545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:42.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.541+0000 7fd5fb04a700 1 -- 172.21.15.6:0/2320640492 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd5d4066f30 msgr2=0x7fd5d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.541+0000 7fd5fb04a700 1 --2- 172.21.15.6:0/2320640492 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd5d4066f30 0x7fd5d40693e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0099b0 tx=0x7fd5ec017000 comp rx=0 tx=0).stop 2023-10-06T02:25:42.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.541+0000 7fd5fb04a700 1 -- 172.21.15.6:0/2320640492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f4150370 msgr2=0x7fd5f414e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.541+0000 7fd5fb04a700 1 --2- 172.21.15.6:0/2320640492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f4150370 0x7fd5f414e130 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400cd80 tx=0x7fd5e4001aa0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.541+0000 7fd5fb04a700 1 -- 172.21.15.6:0/2320640492 shutdown_connections 2023-10-06T02:25:42.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.541+0000 7fd5fb04a700 1 --2- 172.21.15.6:0/2320640492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5f414e670 0x7fd5f4150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.541+0000 7fd5fb04a700 1 --2- 172.21.15.6:0/2320640492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5f406cde0 0x7fd5f40af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.541+0000 7fd5fb04a700 1 --2- 172.21.15.6:0/2320640492 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd5d4066f30 0x7fd5d40693e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.541+0000 7fd5fb04a700 1 --2- 172.21.15.6:0/2320640492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f4150370 0x7fd5f414e130 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.541+0000 7fd5fb04a700 1 -- 172.21.15.6:0/2320640492 >> 172.21.15.6:0/2320640492 conn(0x7fd5f406b6e0 msgr2=0x7fd5f414f010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:42.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.541+0000 7fd5fb04a700 1 -- 172.21.15.6:0/2320640492 shutdown_connections 2023-10-06T02:25:42.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.541+0000 7fd5fb04a700 1 -- 172.21.15.6:0/2320640492 wait complete. 2023-10-06T02:25:42.543 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 129 2023-10-06T02:25:42.553 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 129, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:25:38.960386+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8214}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8214': {'gid': 8214, 'name': 'a', 'rank': 0, 'incarnation': 126, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.6:6835/2951290545', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 2951290545}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 2951290545}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:25:42.553 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:25:42.554 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:25:42.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.673+0000 7f423e77b700 1 Processor -- start 2023-10-06T02:25:42.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.673+0000 7f423e77b700 1 -- start start 2023-10-06T02:25:42.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.674+0000 7f423e77b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f42381574b0 0x7f42380b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.674+0000 7f423e77b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f42380b13f0 0x7f42380c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.674+0000 7f423e77b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42380c3b40 con 0x7f42380c4510 2023-10-06T02:25:42.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.674+0000 7f423e77b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42380c4930 con 0x7f42381574b0 2023-10-06T02:25:42.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.674+0000 7f423e77b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42380c2f30 con 0x7f42380b13f0 2023-10-06T02:25:42.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.674+0000 7f4237fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f42381574b0 0x7f42380b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.674+0000 7f4237fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f42381574b0 0x7f42380b0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35896/0 (socket says 172.21.15.6:35896) 2023-10-06T02:25:42.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.674+0000 7f4237fff700 1 -- 172.21.15.6:0/3607745445 learned_addr learned my addr 172.21.15.6:0/3607745445 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:42.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.674+0000 7f422ffff700 1 --2- 172.21.15.6:0/3607745445 >> v2:172.21.15.175:3300/0 conn(0x7f42380b13f0 0x7f42380c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.674+0000 7f4237fff700 1 -- 172.21.15.6:0/3607745445 >> v2:172.21.15.175:3300/0 conn(0x7f42380b13f0 msgr2=0x7f42380c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:42.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.674+0000 7f4237fff700 1 --2- 172.21.15.6:0/3607745445 >> v2:172.21.15.175:3300/0 conn(0x7f42380b13f0 0x7f42380c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.674+0000 7f4237fff700 1 -- 172.21.15.6:0/3607745445 >> v1:172.21.15.175:6789/0 conn(0x7f42380c4510 legacy=0x7f42380cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.674+0000 7f4237fff700 1 -- 172.21.15.6:0/3607745445 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42380c3210 con 0x7f42381574b0 2023-10-06T02:25:42.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.674+0000 7f4237fff700 1 --2- 172.21.15.6:0/3607745445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42381574b0 0x7f42380b0eb0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f423806f050 tx=0x7f4228009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ef85057051a3b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.674+0000 7f42377fe700 1 -- 172.21.15.6:0/3607745445 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228005c10 con 0x7f42381574b0 2023-10-06T02:25:42.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.674+0000 7f42377fe700 1 -- 172.21.15.6:0/3607745445 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4228005d70 con 0x7f42381574b0 2023-10-06T02:25:42.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.674+0000 7f42377fe700 1 -- 172.21.15.6:0/3607745445 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228006260 con 0x7f42381574b0 2023-10-06T02:25:42.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.675+0000 7f423e77b700 1 -- 172.21.15.6:0/3607745445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42381574b0 msgr2=0x7f42380b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.675+0000 7f423e77b700 1 --2- 172.21.15.6:0/3607745445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42381574b0 0x7f42380b0eb0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f423806f050 tx=0x7f4228009220 comp rx=0 tx=0).stop 2023-10-06T02:25:42.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.675+0000 7f423e77b700 1 -- 172.21.15.6:0/3607745445 shutdown_connections 2023-10-06T02:25:42.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.675+0000 7f423e77b700 1 --2- 172.21.15.6:0/3607745445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42381574b0 0x7f42380b0eb0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.675+0000 7f423e77b700 1 --2- 172.21.15.6:0/3607745445 >> v2:172.21.15.175:3300/0 conn(0x7f42380b13f0 0x7f42380c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.675+0000 7f423e77b700 1 -- 172.21.15.6:0/3607745445 >> 172.21.15.6:0/3607745445 conn(0x7f4238067910 msgr2=0x7f42380ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.675+0000 7f423e77b700 1 -- 172.21.15.6:0/3607745445 shutdown_connections 2023-10-06T02:25:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.675+0000 7f423e77b700 1 -- 172.21.15.6:0/3607745445 wait complete. 2023-10-06T02:25:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.676+0000 7f423e77b700 1 Processor -- start 2023-10-06T02:25:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.676+0000 7f423e77b700 1 -- start start 2023-10-06T02:25:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.677+0000 7f423e77b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42380b13f0 0x7f4238153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.677+0000 7f423e77b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42380c4510 0x7f4238150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.677+0000 7f423e77b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42381574b0 0x7f42380b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.677+0000 7f423e77b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4238167920 con 0x7f42380b13f0 2023-10-06T02:25:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.677+0000 7f423e77b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4238153e80 con 0x7f42380c4510 2023-10-06T02:25:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.677+0000 7f423e77b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4238154160 con 0x7f42381574b0 2023-10-06T02:25:42.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.677+0000 7f4237fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42380b13f0 0x7f4238153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.677+0000 7f4237fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42380b13f0 0x7f4238153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35906/0 (socket says 172.21.15.6:35906) 2023-10-06T02:25:42.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.677+0000 7f4237fff700 1 -- 172.21.15.6:0/2314238490 learned_addr learned my addr 172.21.15.6:0/2314238490 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:42.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.677+0000 7f422ffff700 1 --2- 172.21.15.6:0/2314238490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42380c4510 0x7f4238150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.677+0000 7f423cd18700 1 --2- 172.21.15.6:0/2314238490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42381574b0 0x7f42380b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.677+0000 7f4237fff700 1 -- 172.21.15.6:0/2314238490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42381574b0 msgr2=0x7f42380b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.677+0000 7f4237fff700 1 --2- 172.21.15.6:0/2314238490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42381574b0 0x7f42380b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.677+0000 7f4237fff700 1 -- 172.21.15.6:0/2314238490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42380c4510 msgr2=0x7f4238150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.677+0000 7f4237fff700 1 --2- 172.21.15.6:0/2314238490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42380c4510 0x7f4238150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.677+0000 7f4237fff700 1 -- 172.21.15.6:0/2314238490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228009480 con 0x7f42380b13f0 2023-10-06T02:25:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.677+0000 7f4237fff700 1 --2- 172.21.15.6:0/2314238490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42380b13f0 0x7f4238153630 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f422800b0e0 tx=0x7f4228016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.678+0000 7f4234ff9700 1 -- 172.21.15.6:0/2314238490 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422800b850 con 0x7f42380b13f0 2023-10-06T02:25:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.678+0000 7f4234ff9700 1 -- 172.21.15.6:0/2314238490 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4228020070 con 0x7f42380b13f0 2023-10-06T02:25:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.678+0000 7f423e77b700 1 -- 172.21.15.6:0/2314238490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4238154440 con 0x7f42380b13f0 2023-10-06T02:25:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.678+0000 7f4234ff9700 1 -- 172.21.15.6:0/2314238490 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422800bbe0 con 0x7f42380b13f0 2023-10-06T02:25:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.678+0000 7f423e77b700 1 -- 172.21.15.6:0/2314238490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4238153b70 con 0x7f42380b13f0 2023-10-06T02:25:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.679+0000 7f4234ff9700 1 -- 172.21.15.6:0/2314238490 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4228022030 con 0x7f42380b13f0 2023-10-06T02:25:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.679+0000 7f4234ff9700 1 --2- 172.21.15.6:0/2314238490 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4218066f30 0x7f42180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.680+0000 7f4234ff9700 1 -- 172.21.15.6:0/2314238490 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f4228086650 con 0x7f42380b13f0 2023-10-06T02:25:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.680+0000 7f422ffff700 1 --2- 172.21.15.6:0/2314238490 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4218066f30 0x7f42180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.680+0000 7f422ffff700 1 --2- 172.21.15.6:0/2314238490 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4218066f30 0x7f42180693e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f42380ccfe0 tx=0x7f42200091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.681+0000 7f4247a73b80 1 Processor -- start 2023-10-06T02:25:42.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.681+0000 7f4247a73b80 1 -- start start 2023-10-06T02:25:42.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.682+0000 7f4247a73b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b599840 0x561d8b599c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.682+0000 7f4247a73b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b59acc0 0x561d8b5e96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.682+0000 7f4247a73b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b5e9c00 0x561d8b5ea050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.682+0000 7f4247a73b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8b4f0a70 con 0x561d8b5e9c00 2023-10-06T02:25:42.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.682+0000 7f4247a73b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8b4ee270 con 0x561d8b599840 2023-10-06T02:25:42.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.682+0000 7f4247a73b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d8b4ea060 con 0x561d8b59acc0 2023-10-06T02:25:42.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.682+0000 7f423cd18700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b5e9c00 0x561d8b5ea050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.682+0000 7f423cd18700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b5e9c00 0x561d8b5ea050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35922/0 (socket says 172.21.15.6:35922) 2023-10-06T02:25:42.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.682+0000 7f423cd18700 1 -- 172.21.15.6:0/1309865576 learned_addr learned my addr 172.21.15.6:0/1309865576 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:42.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.683+0000 7f4237fff700 1 --2- 172.21.15.6:0/1309865576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b599840 0x561d8b599c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.683+0000 7f422ffff700 1 --2- 172.21.15.6:0/1309865576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b59acc0 0x561d8b5e96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.683+0000 7f423cd18700 1 -- 172.21.15.6:0/1309865576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b59acc0 msgr2=0x561d8b5e96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:42.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.683+0000 7f423cd18700 1 --2- 172.21.15.6:0/1309865576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b59acc0 0x561d8b5e96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.683+0000 7f423cd18700 1 -- 172.21.15.6:0/1309865576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b599840 msgr2=0x561d8b599c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:42.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.683+0000 7f423cd18700 1 --2- 172.21.15.6:0/1309865576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b599840 0x561d8b599c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.683+0000 7f423cd18700 1 -- 172.21.15.6:0/1309865576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d8b384270 con 0x561d8b5e9c00 2023-10-06T02:25:42.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.683+0000 7f4237fff700 1 --2- 172.21.15.6:0/1309865576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b599840 0x561d8b599c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:42.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.683+0000 7f423cd18700 1 --2- 172.21.15.6:0/1309865576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b5e9c00 0x561d8b5ea050 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f4230003dc0 tx=0x7f4230009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515fa902f924bdef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.683+0000 7f422d7fa700 1 -- 172.21.15.6:0/1309865576 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42300032e0 con 0x561d8b5e9c00 2023-10-06T02:25:42.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.683+0000 7f422d7fa700 1 -- 172.21.15.6:0/1309865576 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423000e6c0 con 0x561d8b5e9c00 2023-10-06T02:25:42.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.683+0000 7f422d7fa700 1 -- 172.21.15.6:0/1309865576 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423000ea60 con 0x561d8b5e9c00 2023-10-06T02:25:42.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.684+0000 7f4247a73b80 1 -- 172.21.15.6:0/1309865576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b5e9c00 msgr2=0x561d8b5ea050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.684+0000 7f4247a73b80 1 --2- 172.21.15.6:0/1309865576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b5e9c00 0x561d8b5ea050 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f4230003dc0 tx=0x7f4230009040 comp rx=0 tx=0).stop 2023-10-06T02:25:42.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.684+0000 7f4247a73b80 1 -- 172.21.15.6:0/1309865576 shutdown_connections 2023-10-06T02:25:42.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.684+0000 7f4247a73b80 1 --2- 172.21.15.6:0/1309865576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b5e9c00 0x561d8b5ea050 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.684+0000 7f4247a73b80 1 --2- 172.21.15.6:0/1309865576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b599840 0x561d8b599c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.684+0000 7f4247a73b80 1 --2- 172.21.15.6:0/1309865576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b59acc0 0x561d8b5e96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.684+0000 7f4247a73b80 1 -- 172.21.15.6:0/1309865576 >> 172.21.15.6:0/1309865576 conn(0x561d8b59b160 msgr2=0x561d8b59b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:42.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.684+0000 7f4247a73b80 1 -- 172.21.15.6:0/1309865576 shutdown_connections 2023-10-06T02:25:42.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.684+0000 7f4247a73b80 1 -- 172.21.15.6:0/1309865576 wait complete. 2023-10-06T02:25:42.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.684+0000 7f4247a73b80 1 -- start start 2023-10-06T02:25:42.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.684+0000 7f4247a73b80 1 Processor -- start 2023-10-06T02:25:42.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.685+0000 7f4247a73b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b599840 0x561d8b5c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.685+0000 7f4247a73b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b59acc0 0x561d8b5c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.685+0000 7f4247a73b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b5e9c00 0x561d8b5da2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.685+0000 7f4247a73b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8b495890 con 0x561d8b599840 2023-10-06T02:25:42.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.685+0000 7f4247a73b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8b4b0ea0 con 0x561d8b59acc0 2023-10-06T02:25:42.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.685+0000 7f4247a73b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d8b36ce30 con 0x561d8b5e9c00 2023-10-06T02:25:42.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.685+0000 7f4247a73b80 10 client.0 _ll_register_callbacks cb 0x561d8b55ce70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:25:42.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.685+0000 7f4237fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b599840 0x561d8b5c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.685+0000 7f4237fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b599840 0x561d8b5c26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35928/0 (socket says 172.21.15.6:35928) 2023-10-06T02:25:42.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.685+0000 7f4237fff700 1 -- 172.21.15.6:0/518156264 learned_addr learned my addr 172.21.15.6:0/518156264 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:42.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.685+0000 7f422ffff700 1 --2- 172.21.15.6:0/518156264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b59acc0 0x561d8b5c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.685+0000 7f423cd18700 1 --2- 172.21.15.6:0/518156264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b5e9c00 0x561d8b5da2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.685+0000 7f4237fff700 1 -- 172.21.15.6:0/518156264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b5e9c00 msgr2=0x561d8b5da2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:42.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.685+0000 7f4237fff700 1 --2- 172.21.15.6:0/518156264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b5e9c00 0x561d8b5da2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.685+0000 7f4237fff700 1 -- 172.21.15.6:0/518156264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b59acc0 msgr2=0x561d8b5c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:42.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.685+0000 7f4237fff700 1 --2- 172.21.15.6:0/518156264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b59acc0 0x561d8b5c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f4237fff700 1 -- 172.21.15.6:0/518156264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423000f040 con 0x561d8b599840 2023-10-06T02:25:42.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f423cd18700 1 --2- 172.21.15.6:0/518156264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b5e9c00 0x561d8b5da2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:42.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f4237fff700 1 --2- 172.21.15.6:0/518156264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b599840 0x561d8b5c26f0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f422800c010 tx=0x7f422801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac40d3e4772deb6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f42167fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:25:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f42167fc700 1 -- 172.21.15.6:0/518156264 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228055480 con 0x561d8b599840 2023-10-06T02:25:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f42167fc700 1 -- 172.21.15.6:0/518156264 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f422805a050 con 0x561d8b599840 2023-10-06T02:25:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f4247a73b80 1 -- 172.21.15.6:0/518156264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d8b58e940 con 0x561d8b599840 2023-10-06T02:25:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f42167fc700 1 -- 172.21.15.6:0/518156264 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=129) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4228010590 con 0x561d8b599840 2023-10-06T02:25:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f4247a73b80 10 client.8295 fetch_fsmap learned FSMap version 129 2023-10-06T02:25:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f4247a73b80 1 -- 172.21.15.6:0/518156264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=129,monmap=2+}) v3 -- 0x561d8b326fe0 con 0x561d8b599840 2023-10-06T02:25:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f42167fc700 1 -- 172.21.15.6:0/518156264 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d8b58e940 con 0x561d8b599840 2023-10-06T02:25:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f42167fc700 1 -- 172.21.15.6:0/518156264 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 129) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4228057340 con 0x561d8b599840 2023-10-06T02:25:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f4247a73b80 10 client.8295 fetch_fsmap finished waiting for FSMap version 129 2023-10-06T02:25:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f4247a73b80 10 client.8295 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:25:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f4247a73b80 20 client.8295 populate_metadata read hostname 'smithi006' 2023-10-06T02:25:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f4247a73b80 1 --2- 172.21.15.6:0/518156264 >> [v2:172.21.15.6:6833/2951290545,v1:172.21.15.6:6835/2951290545] conn(0x561d8b5c8580 0x561d8b5c8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f4247a73b80 4 client.8295 mds_command: new command op to 8214 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:25:42.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f4247a73b80 1 -- 172.21.15.6:0/518156264 --> [v2:172.21.15.6:6833/2951290545,v1:172.21.15.6:6835/2951290545] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d8b56b870 con 0x561d8b5c8580 2023-10-06T02:25:42.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.686+0000 7f422ffff700 1 --2- 172.21.15.6:0/518156264 >> [v2:172.21.15.6:6833/2951290545,v1:172.21.15.6:6835/2951290545] conn(0x561d8b5c8580 0x561d8b5c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.687+0000 7f42167fc700 10 client.8295 ms_handle_connect on v2:172.21.15.6:6833/2951290545 2023-10-06T02:25:42.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.687+0000 7f422ffff700 1 --2- 172.21.15.6:0/518156264 >> [v2:172.21.15.6:6833/2951290545,v1:172.21.15.6:6835/2951290545] conn(0x561d8b5c8580 0x561d8b5c8950 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dece8d541a09c81 server_cookie=1041a1c548c125eb in_seq=0 out_seq=0 2023-10-06T02:25:42.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.687+0000 7f42167fc700 1 -- 172.21.15.6:0/518156264 <== mds.0 v2:172.21.15.6:6833/2951290545 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x561d8b56b870 con 0x561d8b5c8580 2023-10-06T02:25:42.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.687+0000 7f42167fc700 10 client.8295 handle_command_reply: tid=0 2023-10-06T02:25:42.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.687+0000 7f4247a73b80 1 client.8295 shutdown 2023-10-06T02:25:42.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.687+0000 7f4247a73b80 1 -- 172.21.15.6:0/518156264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b599840 msgr2=0x561d8b5c26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.687+0000 7f4247a73b80 1 --2- 172.21.15.6:0/518156264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b599840 0x561d8b5c26f0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f422800c010 tx=0x7f422801e040 comp rx=0 tx=0).stop 2023-10-06T02:25:42.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.688+0000 7f4247a73b80 1 -- 172.21.15.6:0/518156264 shutdown_connections 2023-10-06T02:25:42.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.688+0000 7f4247a73b80 1 --2- 172.21.15.6:0/518156264 >> [v2:172.21.15.6:6833/2951290545,v1:172.21.15.6:6835/2951290545] conn(0x561d8b5c8580 0x561d8b5c8950 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.688+0000 7f4247a73b80 1 --2- 172.21.15.6:0/518156264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b5e9c00 0x561d8b5da2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.688+0000 7f42167fc700 0 client.8295 ms_handle_reset on v2:172.21.15.6:6833/2951290545 2023-10-06T02:25:42.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.688+0000 7f4247a73b80 1 --2- 172.21.15.6:0/518156264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b599840 0x561d8b5c26f0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.688+0000 7f4247a73b80 1 --2- 172.21.15.6:0/518156264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b59acc0 0x561d8b5c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.688+0000 7f4247a73b80 1 -- 172.21.15.6:0/518156264 >> 172.21.15.6:0/518156264 conn(0x561d8b59b160 msgr2=0x561d8b59a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:42.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.688+0000 7f4247a73b80 1 -- 172.21.15.6:0/518156264 shutdown_connections 2023-10-06T02:25:42.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.688+0000 7f4247a73b80 1 -- 172.21.15.6:0/518156264 wait complete. 2023-10-06T02:25:42.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.688+0000 7f4247a73b80 20 client.8295 trim_cache size 0 max 16384 2023-10-06T02:25:42.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.705+0000 7f4247a73b80 1 Processor -- start 2023-10-06T02:25:42.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.705+0000 7f4247a73b80 1 -- start start 2023-10-06T02:25:42.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.705+0000 7f4247a73b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b599840 0x561d8b5e2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.705+0000 7f4247a73b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b59acc0 0x561d8b5c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.705+0000 7f4247a73b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b5e9c00 0x561d8b5c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.705+0000 7f4247a73b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8b594620 con 0x561d8b59acc0 2023-10-06T02:25:42.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.705+0000 7f4247a73b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8b594370 con 0x561d8b599840 2023-10-06T02:25:42.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.705+0000 7f4247a73b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d8b5c5be0 con 0x561d8b5e9c00 2023-10-06T02:25:42.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.706+0000 7f422ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b59acc0 0x561d8b5c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.706+0000 7f422ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b59acc0 0x561d8b5c9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35942/0 (socket says 172.21.15.6:35942) 2023-10-06T02:25:42.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.706+0000 7f422ffff700 1 -- 172.21.15.6:0/3554631862 learned_addr learned my addr 172.21.15.6:0/3554631862 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:42.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.706+0000 7f423cd18700 1 --2- 172.21.15.6:0/3554631862 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b5e9c00 0x561d8b5c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.706+0000 7f422ffff700 1 -- 172.21.15.6:0/3554631862 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b5e9c00 msgr2=0x561d8b5c4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:42.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.706+0000 7f4237fff700 1 --2- 172.21.15.6:0/3554631862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b599840 0x561d8b5e2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.706+0000 7f422ffff700 1 --2- 172.21.15.6:0/3554631862 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b5e9c00 0x561d8b5c4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.706+0000 7f422ffff700 1 -- 172.21.15.6:0/3554631862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b599840 msgr2=0x561d8b5e2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:42.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.706+0000 7f422ffff700 1 --2- 172.21.15.6:0/3554631862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b599840 0x561d8b5e2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.706+0000 7f422ffff700 1 -- 172.21.15.6:0/3554631862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d8b4b8780 con 0x561d8b59acc0 2023-10-06T02:25:42.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.706+0000 7f4237fff700 1 --2- 172.21.15.6:0/3554631862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b599840 0x561d8b5e2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:42.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.706+0000 7f422ffff700 1 --2- 172.21.15.6:0/3554631862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b59acc0 0x561d8b5c9a40 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f4220009fd0 tx=0x7f4220019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82f76a9477477bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.706+0000 7f422dffb700 1 -- 172.21.15.6:0/3554631862 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220028040 con 0x561d8b59acc0 2023-10-06T02:25:42.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.706+0000 7f422dffb700 1 -- 172.21.15.6:0/3554631862 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4220014bd0 con 0x561d8b59acc0 2023-10-06T02:25:42.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.706+0000 7f422dffb700 1 -- 172.21.15.6:0/3554631862 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422002c440 con 0x561d8b59acc0 2023-10-06T02:25:42.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.707+0000 7f4247a73b80 1 -- 172.21.15.6:0/3554631862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b59acc0 msgr2=0x561d8b5c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.707+0000 7f4247a73b80 1 --2- 172.21.15.6:0/3554631862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b59acc0 0x561d8b5c9a40 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f4220009fd0 tx=0x7f4220019000 comp rx=0 tx=0).stop 2023-10-06T02:25:42.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.707+0000 7f4247a73b80 1 -- 172.21.15.6:0/3554631862 shutdown_connections 2023-10-06T02:25:42.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.707+0000 7f4247a73b80 1 --2- 172.21.15.6:0/3554631862 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b5e9c00 0x561d8b5c4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.707+0000 7f4247a73b80 1 --2- 172.21.15.6:0/3554631862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b599840 0x561d8b5e2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.707+0000 7f4247a73b80 1 --2- 172.21.15.6:0/3554631862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b59acc0 0x561d8b5c9a40 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.707+0000 7f4247a73b80 1 -- 172.21.15.6:0/3554631862 >> 172.21.15.6:0/3554631862 conn(0x561d8b59b160 msgr2=0x561d8b5d9420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:42.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.707+0000 7f4247a73b80 1 -- 172.21.15.6:0/3554631862 shutdown_connections 2023-10-06T02:25:42.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.707+0000 7f4247a73b80 1 -- 172.21.15.6:0/3554631862 wait complete. 2023-10-06T02:25:42.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.707+0000 7f4247a73b80 1 -- start start 2023-10-06T02:25:42.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.708+0000 7f4247a73b80 1 Processor -- start 2023-10-06T02:25:42.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.708+0000 7f4247a73b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b599840 0x561d8b5c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.708+0000 7f4247a73b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b59acc0 0x561d8b59b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.708+0000 7f4247a73b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b5e9c00 0x561d8b5c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.708+0000 7f4247a73b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8b64adf0 con 0x561d8b599840 2023-10-06T02:25:42.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.708+0000 7f4247a73b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8b5c37e0 con 0x561d8b5e9c00 2023-10-06T02:25:42.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.708+0000 7f4247a73b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d8b5c3580 con 0x561d8b59acc0 2023-10-06T02:25:42.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.708+0000 7f4247a73b80 10 client.0 _ll_register_callbacks cb 0x561d8b55ce70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:25:42.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.708+0000 7f4237fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b599840 0x561d8b5c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.708+0000 7f4237fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b599840 0x561d8b5c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35952/0 (socket says 172.21.15.6:35952) 2023-10-06T02:25:42.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.708+0000 7f4237fff700 1 -- 172.21.15.6:0/2737130106 learned_addr learned my addr 172.21.15.6:0/2737130106 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:42.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f423cd18700 1 --2- 172.21.15.6:0/2737130106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b5e9c00 0x561d8b5c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f422ffff700 1 --2- 172.21.15.6:0/2737130106 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b59acc0 0x561d8b59b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f4237fff700 1 -- 172.21.15.6:0/2737130106 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b59acc0 msgr2=0x561d8b59b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:42.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f4237fff700 1 --2- 172.21.15.6:0/2737130106 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b59acc0 0x561d8b59b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f4237fff700 1 -- 172.21.15.6:0/2737130106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b5e9c00 msgr2=0x561d8b5c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:42.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f4237fff700 1 --2- 172.21.15.6:0/2737130106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b5e9c00 0x561d8b5c3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f4237fff700 1 -- 172.21.15.6:0/2737130106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4220014440 con 0x561d8b599840 2023-10-06T02:25:42.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f422ffff700 1 --2- 172.21.15.6:0/2737130106 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b59acc0 0x561d8b59b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:42.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f4237fff700 1 --2- 172.21.15.6:0/2737130106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b599840 0x561d8b5c9b80 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f4228006aa0 tx=0x7f422806a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceafb4f7286818e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f42167fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:25:42.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f42167fc700 1 -- 172.21.15.6:0/2737130106 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228010590 con 0x561d8b599840 2023-10-06T02:25:42.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f42167fc700 1 -- 172.21.15.6:0/2737130106 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f422805a040 con 0x561d8b599840 2023-10-06T02:25:42.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f4247a73b80 1 -- 172.21.15.6:0/2737130106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f423000e6c0 con 0x561d8b599840 2023-10-06T02:25:42.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f42167fc700 1 -- 172.21.15.6:0/2737130106 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=129) v2 ==== 24+0+0 (secure 0 0 0) 0x7f422805a330 con 0x561d8b599840 2023-10-06T02:25:42.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f4247a73b80 10 client.8301 fetch_fsmap learned FSMap version 129 2023-10-06T02:25:42.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f4247a73b80 1 -- 172.21.15.6:0/2737130106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=129,monmap=2+}) v3 -- 0x561d8b49f470 con 0x561d8b599840 2023-10-06T02:25:42.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f42167fc700 1 -- 172.21.15.6:0/2737130106 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423000e6c0 con 0x561d8b599840 2023-10-06T02:25:42.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f42167fc700 1 -- 172.21.15.6:0/2737130106 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 129) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4228057340 con 0x561d8b599840 2023-10-06T02:25:42.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f4247a73b80 10 client.8301 fetch_fsmap finished waiting for FSMap version 129 2023-10-06T02:25:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f4247a73b80 10 client.8301 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:25:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f4247a73b80 20 client.8301 populate_metadata read hostname 'smithi006' 2023-10-06T02:25:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f4247a73b80 1 --2- 172.21.15.6:0/2737130106 >> [v2:172.21.15.6:6833/2951290545,v1:172.21.15.6:6835/2951290545] conn(0x561d8b5c5190 0x561d8b649f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f4247a73b80 4 client.8301 mds_command: new command op to 8214 tid=0[{"prefix": "status"}] 2023-10-06T02:25:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.709+0000 7f4247a73b80 1 -- 172.21.15.6:0/2737130106 --> [v2:172.21.15.6:6833/2951290545,v1:172.21.15.6:6835/2951290545] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561d8b48ce00 con 0x561d8b5c5190 2023-10-06T02:25:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f422ffff700 1 --2- 172.21.15.6:0/2737130106 >> [v2:172.21.15.6:6833/2951290545,v1:172.21.15.6:6835/2951290545] conn(0x561d8b5c5190 0x561d8b649f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f42167fc700 10 client.8301 ms_handle_connect on v2:172.21.15.6:6833/2951290545 2023-10-06T02:25:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f422ffff700 1 --2- 172.21.15.6:0/2737130106 >> [v2:172.21.15.6:6833/2951290545,v1:172.21.15.6:6835/2951290545] conn(0x561d8b5c5190 0x561d8b649f20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a84b143d111c8fb server_cookie=1125b5f2c102447c in_seq=0 out_seq=0 2023-10-06T02:25:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f42167fc700 1 -- 172.21.15.6:0/2737130106 <== mds.0 v2:172.21.15.6:6833/2951290545 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x561d8b48ce00 con 0x561d8b5c5190 2023-10-06T02:25:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f42167fc700 10 client.8301 handle_command_reply: tid=0 2023-10-06T02:25:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f4247a73b80 1 client.8301 shutdown 2023-10-06T02:25:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f4247a73b80 1 -- 172.21.15.6:0/2737130106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b599840 msgr2=0x561d8b5c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f4247a73b80 1 --2- 172.21.15.6:0/2737130106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b599840 0x561d8b5c9b80 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f4228006aa0 tx=0x7f422806a000 comp rx=0 tx=0).stop 2023-10-06T02:25:42.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f4247a73b80 1 -- 172.21.15.6:0/2737130106 shutdown_connections 2023-10-06T02:25:42.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f4247a73b80 1 --2- 172.21.15.6:0/2737130106 >> [v2:172.21.15.6:6833/2951290545,v1:172.21.15.6:6835/2951290545] conn(0x561d8b5c5190 0x561d8b649f20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f4247a73b80 1 --2- 172.21.15.6:0/2737130106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d8b5e9c00 0x561d8b5c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f4247a73b80 1 --2- 172.21.15.6:0/2737130106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d8b599840 0x561d8b5c9b80 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f42167fc700 0 client.8301 ms_handle_reset on v2:172.21.15.6:6833/2951290545 2023-10-06T02:25:42.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f4247a73b80 1 --2- 172.21.15.6:0/2737130106 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d8b59acc0 0x561d8b59b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f4247a73b80 1 -- 172.21.15.6:0/2737130106 >> 172.21.15.6:0/2737130106 conn(0x561d8b59b160 msgr2=0x561d8b5dd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:42.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f4247a73b80 1 -- 172.21.15.6:0/2737130106 shutdown_connections 2023-10-06T02:25:42.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f4247a73b80 1 -- 172.21.15.6:0/2737130106 wait complete. 2023-10-06T02:25:42.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.710+0000 7f4247a73b80 20 client.8301 trim_cache size 0 max 16384 2023-10-06T02:25:42.721 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:25:42.721 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:25:42.721 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:25:42.721 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 8214, 2023-10-06T02:25:42.721 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:25:42.721 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:25:42.721 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:25:42.722 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 6.7635454099999999, 2023-10-06T02:25:42.722 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 129, 2023-10-06T02:25:42.722 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 101, 2023-10-06T02:25:42.722 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 101, 2023-10-06T02:25:42.722 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 10.761229666 2023-10-06T02:25:42.722 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:25:42.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.711+0000 7f423e77b700 1 -- 172.21.15.6:0/2314238490 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4218066f30 msgr2=0x7f42180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.711+0000 7f423e77b700 1 --2- 172.21.15.6:0/2314238490 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4218066f30 0x7f42180693e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f42380ccfe0 tx=0x7f42200091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.711+0000 7f423e77b700 1 -- 172.21.15.6:0/2314238490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42380b13f0 msgr2=0x7f4238153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.711+0000 7f423e77b700 1 --2- 172.21.15.6:0/2314238490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42380b13f0 0x7f4238153630 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f422800b0e0 tx=0x7f4228016000 comp rx=0 tx=0).stop 2023-10-06T02:25:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.711+0000 7f423e77b700 1 -- 172.21.15.6:0/2314238490 shutdown_connections 2023-10-06T02:25:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.711+0000 7f423e77b700 1 --2- 172.21.15.6:0/2314238490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42381574b0 0x7f42380b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.711+0000 7f423e77b700 1 --2- 172.21.15.6:0/2314238490 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4218066f30 0x7f42180693e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.711+0000 7f423e77b700 1 --2- 172.21.15.6:0/2314238490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42380b13f0 0x7f4238153630 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.711+0000 7f423e77b700 1 --2- 172.21.15.6:0/2314238490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42380c4510 0x7f4238150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.711+0000 7f423e77b700 1 -- 172.21.15.6:0/2314238490 >> 172.21.15.6:0/2314238490 conn(0x7f4238067910 msgr2=0x7f42380b3890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.711+0000 7f423e77b700 1 -- 172.21.15.6:0/2314238490 shutdown_connections 2023-10-06T02:25:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.711+0000 7f423e77b700 1 -- 172.21.15.6:0/2314238490 wait complete. 2023-10-06T02:25:42.725 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:25:42.725 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Delete mds0_openfiles.0', proceeding to ls 2023-10-06T02:25:42.725 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:25:42.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.843+0000 7fe4e7c55700 1 Processor -- start 2023-10-06T02:25:42.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.843+0000 7fe4e7c55700 1 -- start start 2023-10-06T02:25:42.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.844+0000 7fe4e7c55700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe4e015b3c0 0x7fe4e0097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.844+0000 7fe4e7c55700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe4e015a590 0x7fe4e015a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.844+0000 7fe4e7c55700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e00afb90 con 0x7fe4e00b3c50 2023-10-06T02:25:42.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.844+0000 7fe4e7c55700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e015aed0 con 0x7fe4e015b3c0 2023-10-06T02:25:42.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.844+0000 7fe4e7c55700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e00b2310 con 0x7fe4e015a590 2023-10-06T02:25:42.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.844+0000 7fe4e59f1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe4e015b3c0 0x7fe4e0097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.844+0000 7fe4e59f1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe4e015b3c0 0x7fe4e0097d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35964/0 (socket says 172.21.15.6:35964) 2023-10-06T02:25:42.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.844+0000 7fe4e59f1700 1 -- 172.21.15.6:0/2367219975 learned_addr learned my addr 172.21.15.6:0/2367219975 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:42.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.845+0000 7fe4e61f2700 1 --2- 172.21.15.6:0/2367219975 >> v2:172.21.15.175:3300/0 conn(0x7fe4e015a590 0x7fe4e015a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.845+0000 7fe4e59f1700 1 -- 172.21.15.6:0/2367219975 >> v2:172.21.15.175:3300/0 conn(0x7fe4e015a590 msgr2=0x7fe4e015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:42.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.845+0000 7fe4e59f1700 1 --2- 172.21.15.6:0/2367219975 >> v2:172.21.15.175:3300/0 conn(0x7fe4e015a590 0x7fe4e015a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.845+0000 7fe4e59f1700 1 -- 172.21.15.6:0/2367219975 >> v1:172.21.15.175:6789/0 conn(0x7fe4e00b3c50 legacy=0x7fe4e015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:42.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.845+0000 7fe4e59f1700 1 -- 172.21.15.6:0/2367219975 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e00b25f0 con 0x7fe4e015b3c0 2023-10-06T02:25:42.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.845+0000 7fe4e59f1700 1 --2- 172.21.15.6:0/2367219975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e015b3c0 0x7fe4e0097d70 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fe4e006f100 tx=0x7fe4dc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20058839164f2f9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.845+0000 7fe4e49ef700 1 -- 172.21.15.6:0/2367219975 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc005c10 con 0x7fe4e015b3c0 2023-10-06T02:25:42.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.845+0000 7fe4e49ef700 1 -- 172.21.15.6:0/2367219975 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4dc005d70 con 0x7fe4e015b3c0 2023-10-06T02:25:42.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.845+0000 7fe4e49ef700 1 -- 172.21.15.6:0/2367219975 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc00b860 con 0x7fe4e015b3c0 2023-10-06T02:25:42.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.845+0000 7fe4e7c55700 1 -- 172.21.15.6:0/2367219975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e015b3c0 msgr2=0x7fe4e0097d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.845+0000 7fe4e7c55700 1 --2- 172.21.15.6:0/2367219975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e015b3c0 0x7fe4e0097d70 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fe4e006f100 tx=0x7fe4dc009220 comp rx=0 tx=0).stop 2023-10-06T02:25:42.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.846+0000 7fe4e7c55700 1 -- 172.21.15.6:0/2367219975 shutdown_connections 2023-10-06T02:25:42.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.846+0000 7fe4e7c55700 1 --2- 172.21.15.6:0/2367219975 >> v2:172.21.15.175:3300/0 conn(0x7fe4e015a590 0x7fe4e015a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.846+0000 7fe4e7c55700 1 --2- 172.21.15.6:0/2367219975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e015b3c0 0x7fe4e0097d70 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.846+0000 7fe4e7c55700 1 -- 172.21.15.6:0/2367219975 >> 172.21.15.6:0/2367219975 conn(0x7fe4e0067910 msgr2=0x7fe4e00ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:42.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.846+0000 7fe4e7c55700 1 -- 172.21.15.6:0/2367219975 shutdown_connections 2023-10-06T02:25:42.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.846+0000 7fe4e7c55700 1 -- 172.21.15.6:0/2367219975 wait complete. 2023-10-06T02:25:42.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.847+0000 7fe4e7c55700 1 Processor -- start 2023-10-06T02:25:42.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.847+0000 7fe4e7c55700 1 -- start start 2023-10-06T02:25:42.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.847+0000 7fe4e7c55700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4e00b3c50 0x7fe4e01528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.847+0000 7fe4e7c55700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4e015a590 0x7fe4e0153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.847+0000 7fe4e7c55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e015b3c0 0x7fe4e0153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.847+0000 7fe4e7c55700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e0151f00 con 0x7fe4e015b3c0 2023-10-06T02:25:42.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.847+0000 7fe4e7c55700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e016bcf0 con 0x7fe4e015a590 2023-10-06T02:25:42.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.847+0000 7fe4e7c55700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e0099f50 con 0x7fe4e00b3c50 2023-10-06T02:25:42.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.848+0000 7fe4e61f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e015b3c0 0x7fe4e0153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.848+0000 7fe4e61f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e015b3c0 0x7fe4e0153760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35976/0 (socket says 172.21.15.6:35976) 2023-10-06T02:25:42.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.848+0000 7fe4e61f2700 1 -- 172.21.15.6:0/3542440783 learned_addr learned my addr 172.21.15.6:0/3542440783 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:42.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.848+0000 7fe4e51f0700 1 --2- 172.21.15.6:0/3542440783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4e015a590 0x7fe4e0153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.848+0000 7fe4e59f1700 1 --2- 172.21.15.6:0/3542440783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4e00b3c50 0x7fe4e01528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.848+0000 7fe4e61f2700 1 -- 172.21.15.6:0/3542440783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4e00b3c50 msgr2=0x7fe4e01528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.848+0000 7fe4e61f2700 1 --2- 172.21.15.6:0/3542440783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4e00b3c50 0x7fe4e01528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.848+0000 7fe4e61f2700 1 -- 172.21.15.6:0/3542440783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4e015a590 msgr2=0x7fe4e0153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.848+0000 7fe4e61f2700 1 --2- 172.21.15.6:0/3542440783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4e015a590 0x7fe4e0153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.848+0000 7fe4e61f2700 1 -- 172.21.15.6:0/3542440783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc009480 con 0x7fe4e015b3c0 2023-10-06T02:25:42.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.848+0000 7fe4e61f2700 1 --2- 172.21.15.6:0/3542440783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e015b3c0 0x7fe4e0153760 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8007f50 tx=0x7fe4d8009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.848+0000 7fe4d5ffb700 1 -- 172.21.15.6:0/3542440783 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d800eb70 con 0x7fe4e015b3c0 2023-10-06T02:25:42.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.848+0000 7fe4d5ffb700 1 -- 172.21.15.6:0/3542440783 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d800ecf0 con 0x7fe4e015b3c0 2023-10-06T02:25:42.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.848+0000 7fe4d5ffb700 1 -- 172.21.15.6:0/3542440783 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8014670 con 0x7fe4e015b3c0 2023-10-06T02:25:42.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.848+0000 7fe4e7c55700 1 -- 172.21.15.6:0/3542440783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e016af30 con 0x7fe4e015b3c0 2023-10-06T02:25:42.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.849+0000 7fe4e7c55700 1 -- 172.21.15.6:0/3542440783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e016b4f0 con 0x7fe4e015b3c0 2023-10-06T02:25:42.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.849+0000 7fe4e7c55700 1 -- 172.21.15.6:0/3542440783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e006e8d0 con 0x7fe4e015b3c0 2023-10-06T02:25:42.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.850+0000 7fe4d5ffb700 1 -- 172.21.15.6:0/3542440783 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe4d80149e0 con 0x7fe4e015b3c0 2023-10-06T02:25:42.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.850+0000 7fe4d5ffb700 1 --2- 172.21.15.6:0/3542440783 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe4c4066f30 0x7fe4c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.850+0000 7fe4d5ffb700 1 -- 172.21.15.6:0/3542440783 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6894+0+0 (secure 0 0 0) 0x7fe4d8084fc0 con 0x7fe4e015b3c0 2023-10-06T02:25:42.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.850+0000 7fe4e59f1700 1 --2- 172.21.15.6:0/3542440783 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe4c4066f30 0x7fe4c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.851+0000 7fe4e59f1700 1 --2- 172.21.15.6:0/3542440783 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe4c4066f30 0x7fe4c40693e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc007fd0 tx=0x7fe4dc015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:42.854+0000 7fe4d5ffb700 1 -- 172.21.15.6:0/3542440783 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4d8051d90 con 0x7fe4e015b3c0 2023-10-06T02:25:43.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:43.093+0000 7fe4e7c55700 1 -- 172.21.15.6:0/3542440783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe4e00af820 con 0x7fe4e015b3c0 2023-10-06T02:25:43.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:43.094+0000 7fe4d5ffb700 1 -- 172.21.15.6:0/3542440783 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v129) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe4d80553b0 con 0x7fe4e015b3c0 2023-10-06T02:25:43.094 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:25:43.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:43.095+0000 7fe4e7c55700 1 -- 172.21.15.6:0/3542440783 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe4c4066f30 msgr2=0x7fe4c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:43.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:43.095+0000 7fe4e7c55700 1 --2- 172.21.15.6:0/3542440783 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe4c4066f30 0x7fe4c40693e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc007fd0 tx=0x7fe4dc015000 comp rx=0 tx=0).stop 2023-10-06T02:25:43.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:43.095+0000 7fe4e7c55700 1 -- 172.21.15.6:0/3542440783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e015b3c0 msgr2=0x7fe4e0153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:43.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:43.095+0000 7fe4e7c55700 1 --2- 172.21.15.6:0/3542440783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e015b3c0 0x7fe4e0153760 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8007f50 tx=0x7fe4d8009860 comp rx=0 tx=0).stop 2023-10-06T02:25:43.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:43.096+0000 7fe4e7c55700 1 -- 172.21.15.6:0/3542440783 shutdown_connections 2023-10-06T02:25:43.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:43.096+0000 7fe4e7c55700 1 --2- 172.21.15.6:0/3542440783 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe4c4066f30 0x7fe4c40693e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:43.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:43.096+0000 7fe4e7c55700 1 --2- 172.21.15.6:0/3542440783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e015b3c0 0x7fe4e0153760 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:43.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:43.096+0000 7fe4e7c55700 1 --2- 172.21.15.6:0/3542440783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4e00b3c50 0x7fe4e01528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:43.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:43.096+0000 7fe4e7c55700 1 --2- 172.21.15.6:0/3542440783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4e015a590 0x7fe4e0153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:43.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:43.096+0000 7fe4e7c55700 1 -- 172.21.15.6:0/3542440783 >> 172.21.15.6:0/3542440783 conn(0x7fe4e0067910 msgr2=0x7fe4e0097f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:43.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:43.096+0000 7fe4e7c55700 1 -- 172.21.15.6:0/3542440783 shutdown_connections 2023-10-06T02:25:43.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:43.096+0000 7fe4e7c55700 1 -- 172.21.15.6:0/3542440783 wait complete. 2023-10-06T02:25:43.108 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:25:43.108 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:25:43.108 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:25:43.108 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:25:43.108 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:43.108 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:25:43.108 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:25:43.108 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:25:43.108 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:25:43.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:43.109 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:25:43.124 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:25:43.124 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:25:43.124 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:25:43.124 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:43.125 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:25:43.125 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:43.125 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:25:43.125 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:43.125 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:25:43.125 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:25:43.125 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:43.125 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:25:43.125 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:25:43.125 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:43.125 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:25:43.126 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:25:43.126 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42003sec preferred_lft 42003sec 2023-10-06T02:25:43.126 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:25:43.126 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:43.126 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:25:43.126 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:43.126 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:25:43.126 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:25:43.126 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:43.126 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:25:43.126 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:43.126 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:25:43.127 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:43.127 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:25:43.127 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:25:43.127 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:25:43.127 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:43.127 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:25:43.127 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:25:43.127 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:25:43.127 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:43.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:43.128 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:25:43.188 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:25:43.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:43.190 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:25:43.246 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:25:43.247 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:25:43.247 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:25:43.247 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:25:43.247 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:25:43.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:43.247 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:25:43.247 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:25:43.248 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:25:43.248 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:25:43.248 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:25:43.248 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:25:43.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:43.350 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:25:43.364 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:25:43.365 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:25:43.365 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:25:43.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:43.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:25:43.431 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:25:43.431 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:25:43.431 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:43.486 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:25:43.486 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:25:43.487 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:43.541 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:25:43.607 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:25:43.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:25:43.671 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:25:43.672 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:25:43.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:43.673 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:25:43.728 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:25:43.728 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:25:43.771 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:25:43.796 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:25:43.796 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:25:43.852 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:25:43.852+0000 7f86b6eec540 -1 init, newargv = 0x5627d092e900 newargc=15 2023-10-06T02:25:43.853 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[127093]: starting ceph client 2023-10-06T02:25:43.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[127093]: starting fuse 2023-10-06T02:25:43.862 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:25:43.863 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:25:43.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:43.864 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:25:43.919 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:25:43.920 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:25:43.920 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:25:43.920 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:25:43.920 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:25:43.920 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:25:43.920 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:25:43.920 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:25:43.920 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:25:43.920 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:25:43.921 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:25:43.921 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:25:43.921 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:25:43.921 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:25:43.921 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:25:43.921 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:25:43.921 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:25:43.921 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:25:43.921 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:25:43.921 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:25:43.921 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:25:43.921 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:25:43.921 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:25:43.922 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:25:43.922 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:25:43.922 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:25:43.922 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:25:43.922 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:25:43.922 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:25:43.932 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:25:43.932+0000 7ff0742d2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:25:44.016 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.127093.asok 2023-10-06T02:25:44.198 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.127093.asok 2023-10-06T02:25:44.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:44.198 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.127093.asok status 2023-10-06T02:25:44.352 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:25:44.352 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:25:44.352 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:25:44.352 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:25:44.353 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:25:44.353 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:25:44.353 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:25:44.353 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "127093", 2023-10-06T02:25:44.353 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:25:44.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:25:44.353 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:25:44.353 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:25:44.353 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 8313, 2023-10-06T02:25:44.353 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:25:44.353 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:25:44.354 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:25:44.354 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 8313 2023-10-06T02:25:44.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:25:44.354 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:25:44.354 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:25:44.354 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:25:44.354 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2562614152 2023-10-06T02:25:44.354 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:25:44.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:25:44.354 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:25:44.355 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:25:44.355 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:25:44.355 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2562614152 2023-10-06T02:25:44.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:25:44.355 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.8313 192.168.0.1:0/2562614152", 2023-10-06T02:25:44.355 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/2562614152", 2023-10-06T02:25:44.355 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:25:44.355 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 129, 2023-10-06T02:25:44.355 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 101, 2023-10-06T02:25:44.355 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:25:44.355 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:25:44.356 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:25:44.356 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:25:44.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:44.362 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:25:44.362 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:44.378 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:25:44.378 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:44.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:44.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:44.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:44.443 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2023-10-06T02:25:44.486 INFO:teuthology.orchestra.run:waiting for 20 2023-10-06T02:25:44.503 INFO:teuthology.orchestra.run.smithi006.stdout:.: 2023-10-06T02:25:44.504 INFO:teuthology.orchestra.run.smithi006.stdout:subdir 2023-10-06T02:25:44.504 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:44.504 INFO:teuthology.orchestra.run.smithi006.stdout:./subdir: 2023-10-06T02:25:44.504 INFO:teuthology.orchestra.run.smithi006.stdout:sixmegs 2023-10-06T02:25:44.504 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete mds0_openfiles.0' did not caused DAMAGED state 2023-10-06T02:25:44.505 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 500.00000000' 2023-10-06T02:25:44.505 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:25:44.505 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:25:44.505 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:44.581 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:25:44.582 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:25:44.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:44.582 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:25:44.636 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:25:44.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.796+0000 7fa04fc72700 1 Processor -- start 2023-10-06T02:25:44.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.797+0000 7fa04fc72700 1 -- start start 2023-10-06T02:25:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.797+0000 7fa04fc72700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa04815a030 0x7fa04815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.797+0000 7fa04fc72700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0480afc50 con 0x7fa04815a940 2023-10-06T02:25:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.797+0000 7fa04fc72700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0480aff30 con 0x7fa048087700 2023-10-06T02:25:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.797+0000 7fa04fc72700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0480b0cf0 con 0x7fa04815a030 2023-10-06T02:25:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.798+0000 7fa04da0e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa04815a030 0x7fa04815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.798+0000 7fa04d20d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa04815a940 0x7fa048086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45514/0 (socket says 172.21.15.6:45514) 2023-10-06T02:25:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.798+0000 7fa04d20d700 1 -- 172.21.15.6:0/3496263959 learned_addr learned my addr 172.21.15.6:0/3496263959 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.798+0000 7fa04da0e700 1 -- 172.21.15.6:0/3496263959 >> v1:172.21.15.175:6789/0 conn(0x7fa048087700 legacy=0x7fa0480b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.798+0000 7fa04da0e700 1 -- 172.21.15.6:0/3496263959 >> v1:172.21.15.6:6789/0 conn(0x7fa04815a940 legacy=0x7fa048086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.798+0000 7fa04da0e700 1 -- 172.21.15.6:0/3496263959 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0480b0210 con 0x7fa04815a030 2023-10-06T02:25:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.798+0000 7fa04ca0c700 1 -- 172.21.15.6:0/3496263959 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748552503 0 0) 0x7fa0480afc50 con 0x7fa04815a940 2023-10-06T02:25:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.798+0000 7fa04da0e700 1 --2- 172.21.15.6:0/3496263959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa04815a030 0x7fa04815a400 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fa040009e60 tx=0x7fa040009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0af36d89bb95618 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.798+0000 7fa04ca0c700 1 -- 172.21.15.6:0/3496263959 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04000e070 con 0x7fa04815a030 2023-10-06T02:25:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.798+0000 7fa04ca0c700 1 -- 172.21.15.6:0/3496263959 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04000bbf0 con 0x7fa04815a030 2023-10-06T02:25:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.798+0000 7fa04ca0c700 1 -- 172.21.15.6:0/3496263959 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040012430 con 0x7fa04815a030 2023-10-06T02:25:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.799+0000 7fa04fc72700 1 -- 172.21.15.6:0/3496263959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa04815a030 msgr2=0x7fa04815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.799+0000 7fa04fc72700 1 --2- 172.21.15.6:0/3496263959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa04815a030 0x7fa04815a400 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fa040009e60 tx=0x7fa040009780 comp rx=0 tx=0).stop 2023-10-06T02:25:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.799+0000 7fa04fc72700 1 -- 172.21.15.6:0/3496263959 shutdown_connections 2023-10-06T02:25:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.799+0000 7fa04fc72700 1 --2- 172.21.15.6:0/3496263959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa04815a030 0x7fa04815a400 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.799+0000 7fa04fc72700 1 -- 172.21.15.6:0/3496263959 >> 172.21.15.6:0/3496263959 conn(0x7fa048068680 msgr2=0x7fa048068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.799+0000 7fa04fc72700 1 -- 172.21.15.6:0/3496263959 shutdown_connections 2023-10-06T02:25:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.799+0000 7fa04fc72700 1 -- 172.21.15.6:0/3496263959 wait complete. 2023-10-06T02:25:44.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.800+0000 7fa04fc72700 1 Processor -- start 2023-10-06T02:25:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.800+0000 7fa04fc72700 1 -- start start 2023-10-06T02:25:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.801+0000 7fa04fc72700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa048087700 0x7fa0480ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.801+0000 7fa04fc72700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa04815a030 0x7fa0480c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.801+0000 7fa04fc72700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa04815a940 0x7fa0481569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.801+0000 7fa04fc72700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480c4c40 con 0x7fa04815a940 2023-10-06T02:25:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.801+0000 7fa04fc72700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480c7950 con 0x7fa048087700 2023-10-06T02:25:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.801+0000 7fa04fc72700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa048156f10 con 0x7fa04815a030 2023-10-06T02:25:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.801+0000 7fa04e20f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa04815a940 0x7fa0481569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.801+0000 7fa04e20f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa04815a940 0x7fa0481569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35996/0 (socket says 172.21.15.6:35996) 2023-10-06T02:25:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.801+0000 7fa04e20f700 1 -- 172.21.15.6:0/2084762132 learned_addr learned my addr 172.21.15.6:0/2084762132 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.801+0000 7fa04d20d700 1 --2- 172.21.15.6:0/2084762132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa04815a030 0x7fa0480c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.801+0000 7fa04da0e700 1 --2- 172.21.15.6:0/2084762132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa048087700 0x7fa0480ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.801+0000 7fa04e20f700 1 -- 172.21.15.6:0/2084762132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa04815a030 msgr2=0x7fa0480c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.801+0000 7fa04e20f700 1 --2- 172.21.15.6:0/2084762132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa04815a030 0x7fa0480c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.801+0000 7fa04e20f700 1 -- 172.21.15.6:0/2084762132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa048087700 msgr2=0x7fa0480ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.801+0000 7fa04e20f700 1 --2- 172.21.15.6:0/2084762132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa048087700 0x7fa0480ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.801+0000 7fa04e20f700 1 -- 172.21.15.6:0/2084762132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa040009a20 con 0x7fa04815a940 2023-10-06T02:25:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.801+0000 7fa04e20f700 1 --2- 172.21.15.6:0/2084762132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa04815a940 0x7fa0481569d0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa03800b5b0 tx=0x7fa0380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.802+0000 7fa045ffb700 1 -- 172.21.15.6:0/2084762132 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03800f510 con 0x7fa04815a940 2023-10-06T02:25:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.802+0000 7fa045ffb700 1 -- 172.21.15.6:0/2084762132 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03800f670 con 0x7fa04815a940 2023-10-06T02:25:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.802+0000 7fa04fc72700 1 -- 172.21.15.6:0/2084762132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0480c4310 con 0x7fa04815a940 2023-10-06T02:25:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.802+0000 7fa045ffb700 1 -- 172.21.15.6:0/2084762132 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03800fa30 con 0x7fa04815a940 2023-10-06T02:25:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.802+0000 7fa04fc72700 1 -- 172.21.15.6:0/2084762132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0480c48d0 con 0x7fa04815a940 2023-10-06T02:25:44.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.803+0000 7fa04fc72700 1 -- 172.21.15.6:0/2084762132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0480c4df0 con 0x7fa04815a940 2023-10-06T02:25:44.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.803+0000 7fa045ffb700 1 -- 172.21.15.6:0/2084762132 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa03801a400 con 0x7fa04815a940 2023-10-06T02:25:44.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.803+0000 7fa045ffb700 1 --2- 172.21.15.6:0/2084762132 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa034066f30 0x7fa0340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.804+0000 7fa045ffb700 1 -- 172.21.15.6:0/2084762132 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6894+0+0 (secure 0 0 0) 0x7fa0380842a0 con 0x7fa04815a940 2023-10-06T02:25:44.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.804+0000 7fa04da0e700 1 --2- 172.21.15.6:0/2084762132 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa034066f30 0x7fa0340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.804+0000 7fa04da0e700 1 --2- 172.21.15.6:0/2084762132 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa034066f30 0x7fa0340693e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa0400097c0 tx=0x7fa040018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:44.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:44.808+0000 7fa045ffb700 1 -- 172.21.15.6:0/2084762132 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0480c4df0 con 0x7fa04815a940 2023-10-06T02:25:45.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.051+0000 7fa04fc72700 1 -- 172.21.15.6:0/2084762132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa0480c4d80 con 0x7fa04815a940 2023-10-06T02:25:45.052 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:25:45.052+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:25:45.057 INFO:tasks.ceph.mds.a.smithi006.stderr: -1620> 2023-10-06T02:25:35.949+0000 7ff070acb700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2023-10-06T02:25:45.060 INFO:tasks.ceph.mds.a.smithi006.stderr: -393> 2023-10-06T02:25:43.932+0000 7ff0742d2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:25:45.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.060+0000 7fa045ffb700 1 -- 172.21.15.6:0/2084762132 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v130) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa038054b80 con 0x7fa04815a940 2023-10-06T02:25:45.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.062+0000 7fa04fc72700 1 -- 172.21.15.6:0/2084762132 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa034066f30 msgr2=0x7fa0340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:45.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.062+0000 7fa04fc72700 1 --2- 172.21.15.6:0/2084762132 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa034066f30 0x7fa0340693e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa0400097c0 tx=0x7fa040018000 comp rx=0 tx=0).stop 2023-10-06T02:25:45.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.062+0000 7fa04fc72700 1 -- 172.21.15.6:0/2084762132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa04815a940 msgr2=0x7fa0481569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:45.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.062+0000 7fa04fc72700 1 --2- 172.21.15.6:0/2084762132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa04815a940 0x7fa0481569d0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa03800b5b0 tx=0x7fa0380090f0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.062+0000 7fa04fc72700 1 -- 172.21.15.6:0/2084762132 shutdown_connections 2023-10-06T02:25:45.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.062+0000 7fa04fc72700 1 --2- 172.21.15.6:0/2084762132 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa034066f30 0x7fa0340693e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.062+0000 7fa04fc72700 1 --2- 172.21.15.6:0/2084762132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa04815a940 0x7fa0481569d0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.062+0000 7fa04fc72700 1 --2- 172.21.15.6:0/2084762132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa048087700 0x7fa0480ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.062+0000 7fa04fc72700 1 --2- 172.21.15.6:0/2084762132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa04815a030 0x7fa0480c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.062+0000 7fa04fc72700 1 -- 172.21.15.6:0/2084762132 >> 172.21.15.6:0/2084762132 conn(0x7fa048068680 msgr2=0x7fa048159080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:45.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.062+0000 7fa04fc72700 1 -- 172.21.15.6:0/2084762132 shutdown_connections 2023-10-06T02:25:45.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.062+0000 7fa04fc72700 1 -- 172.21.15.6:0/2084762132 wait complete. 2023-10-06T02:25:45.065 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:25:45.076 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:25:45.081 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:25:45.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.196+0000 7fecbb762700 1 Processor -- start 2023-10-06T02:25:45.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.196+0000 7fecbb762700 1 -- start start 2023-10-06T02:25:45.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.197+0000 7fecbb762700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb4086ff0 0x7fecb4087440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.197+0000 7fecbb762700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fecb40b21b0 0x7fecb40b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.197+0000 7fecbb762700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb4087980 con 0x7fecb415a030 2023-10-06T02:25:45.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.197+0000 7fecbb762700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb40b0cf0 con 0x7fecb40b21b0 2023-10-06T02:25:45.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.197+0000 7fecbb762700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40b2b30 con 0x7fecb4086ff0 2023-10-06T02:25:45.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.197+0000 7fecb9cff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fecb40b21b0 0x7fecb40b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.197+0000 7fecb8cfd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb4086ff0 0x7fecb4087440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.197+0000 7fecb94fe700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fecb415a030 0x7fecb415a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:58948/0 (socket says 172.21.15.6:58948) 2023-10-06T02:25:45.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.197+0000 7fecb94fe700 1 -- 172.21.15.6:0/1628245473 learned_addr learned my addr 172.21.15.6:0/1628245473 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.197+0000 7fecb8cfd700 1 -- 172.21.15.6:0/1628245473 >> v2:172.21.15.175:3300/0 conn(0x7fecb40b21b0 msgr2=0x7fecb40b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.197+0000 7fecb8cfd700 1 --2- 172.21.15.6:0/1628245473 >> v2:172.21.15.175:3300/0 conn(0x7fecb40b21b0 0x7fecb40b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.197+0000 7fecb8cfd700 1 -- 172.21.15.6:0/1628245473 >> v1:172.21.15.175:6789/0 conn(0x7fecb415a030 legacy=0x7fecb415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.197+0000 7fecabfff700 1 -- 172.21.15.6:0/1628245473 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779027607 0 0) 0x7fecb4087980 con 0x7fecb415a030 2023-10-06T02:25:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.197+0000 7fecb8cfd700 1 -- 172.21.15.6:0/1628245473 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb40afc50 con 0x7fecb4086ff0 2023-10-06T02:25:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.198+0000 7fecb9cff700 1 --2- 172.21.15.6:0/1628245473 >> v2:172.21.15.175:3300/0 conn(0x7fecb40b21b0 0x7fecb40b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:25:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.198+0000 7fecb8cfd700 1 --2- 172.21.15.6:0/1628245473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb4086ff0 0x7fecb4087440 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feca40098e0 tx=0x7feca40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98373b15c335be0a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.198+0000 7fecabfff700 1 -- 172.21.15.6:0/1628245473 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca400b640 con 0x7fecb4086ff0 2023-10-06T02:25:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.198+0000 7fecabfff700 1 -- 172.21.15.6:0/1628245473 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca400b7a0 con 0x7fecb4086ff0 2023-10-06T02:25:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.198+0000 7fecabfff700 1 -- 172.21.15.6:0/1628245473 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca400bb40 con 0x7fecb4086ff0 2023-10-06T02:25:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.198+0000 7fecbb762700 1 -- 172.21.15.6:0/1628245473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb4086ff0 msgr2=0x7fecb4087440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.198+0000 7fecbb762700 1 --2- 172.21.15.6:0/1628245473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb4086ff0 0x7fecb4087440 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feca40098e0 tx=0x7feca40091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.198+0000 7fecbb762700 1 -- 172.21.15.6:0/1628245473 shutdown_connections 2023-10-06T02:25:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.198+0000 7fecbb762700 1 --2- 172.21.15.6:0/1628245473 >> v2:172.21.15.175:3300/0 conn(0x7fecb40b21b0 0x7fecb40b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.198+0000 7fecbb762700 1 --2- 172.21.15.6:0/1628245473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb4086ff0 0x7fecb4087440 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.198+0000 7fecbb762700 1 -- 172.21.15.6:0/1628245473 >> 172.21.15.6:0/1628245473 conn(0x7fecb4068680 msgr2=0x7fecb4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.199+0000 7fecbb762700 1 -- 172.21.15.6:0/1628245473 shutdown_connections 2023-10-06T02:25:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.199+0000 7fecbb762700 1 -- 172.21.15.6:0/1628245473 wait complete. 2023-10-06T02:25:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.200+0000 7fecbb762700 1 Processor -- start 2023-10-06T02:25:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.200+0000 7fecbb762700 1 -- start start 2023-10-06T02:25:45.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.200+0000 7fecbb762700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb4086ff0 0x7fecb4155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecbb762700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb40b21b0 0x7fecb415ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecbb762700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecb415a030 0x7fecb4158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecbb762700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb415b860 con 0x7fecb4086ff0 2023-10-06T02:25:45.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecbb762700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb415bb40 con 0x7fecb415a030 2023-10-06T02:25:45.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecbb762700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb415be20 con 0x7fecb40b21b0 2023-10-06T02:25:45.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecb94fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb4086ff0 0x7fecb4155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecb94fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb4086ff0 0x7fecb4155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36016/0 (socket says 172.21.15.6:36016) 2023-10-06T02:25:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecb94fe700 1 -- 172.21.15.6:0/2032192848 learned_addr learned my addr 172.21.15.6:0/2032192848 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecb8cfd700 1 --2- 172.21.15.6:0/2032192848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb40b21b0 0x7fecb415ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecb9cff700 1 --2- 172.21.15.6:0/2032192848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecb415a030 0x7fecb4158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecb94fe700 1 -- 172.21.15.6:0/2032192848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb40b21b0 msgr2=0x7fecb415ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecb94fe700 1 --2- 172.21.15.6:0/2032192848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb40b21b0 0x7fecb415ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecb94fe700 1 -- 172.21.15.6:0/2032192848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecb415a030 msgr2=0x7fecb4158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecb94fe700 1 --2- 172.21.15.6:0/2032192848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecb415a030 0x7fecb4158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecb94fe700 1 -- 172.21.15.6:0/2032192848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac009a20 con 0x7fecb4086ff0 2023-10-06T02:25:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecb94fe700 1 --2- 172.21.15.6:0/2032192848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb4086ff0 0x7fecb4155e10 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c5b0 tx=0x7fecb0001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7feca97fa700 1 -- 172.21.15.6:0/2032192848 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0005b30 con 0x7fecb4086ff0 2023-10-06T02:25:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7feca97fa700 1 -- 172.21.15.6:0/2032192848 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb0005c90 con 0x7fecb4086ff0 2023-10-06T02:25:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecbb762700 1 -- 172.21.15.6:0/2032192848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca4009420 con 0x7fecb4086ff0 2023-10-06T02:25:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7feca97fa700 1 -- 172.21.15.6:0/2032192848 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0007300 con 0x7fecb4086ff0 2023-10-06T02:25:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.201+0000 7fecbb762700 1 -- 172.21.15.6:0/2032192848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb415c3e0 con 0x7fecb4086ff0 2023-10-06T02:25:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.202+0000 7fecbb762700 1 -- 172.21.15.6:0/2032192848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb415c600 con 0x7fecb4086ff0 2023-10-06T02:25:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.203+0000 7feca97fa700 1 -- 172.21.15.6:0/2032192848 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fecb001b3b0 con 0x7fecb4086ff0 2023-10-06T02:25:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.203+0000 7feca97fa700 1 --2- 172.21.15.6:0/2032192848 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec98066f30 0x7fec980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.203+0000 7feca97fa700 1 -- 172.21.15.6:0/2032192848 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6980+0+0 (secure 0 0 0) 0x7fecb0083f60 con 0x7fecb4086ff0 2023-10-06T02:25:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.203+0000 7fecb8cfd700 1 --2- 172.21.15.6:0/2032192848 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec98066f30 0x7fec980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.204+0000 7fecb8cfd700 1 --2- 172.21.15.6:0/2032192848 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec98066f30 0x7fec980693e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7feca40093f0 tx=0x7feca4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:45.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.208+0000 7feca97fa700 1 -- 172.21.15.6:0/2032192848 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fecb0050cd0 con 0x7fecb4086ff0 2023-10-06T02:25:45.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:45.483+0000 7fecbb762700 1 -- 172.21.15.6:0/2032192848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fecb40c7840 con 0x7fecb4086ff0 2023-10-06T02:25:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.058+0000 7feca97fa700 1 -- 172.21.15.6:0/2032192848 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v131) v1 ==== 107+0+0 (secure 0 0 0) 0x7fecb0017090 con 0x7fecb4086ff0 2023-10-06T02:25:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.061+0000 7fecbb762700 1 -- 172.21.15.6:0/2032192848 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec98066f30 msgr2=0x7fec980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.061+0000 7fecbb762700 1 --2- 172.21.15.6:0/2032192848 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec98066f30 0x7fec980693e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7feca40093f0 tx=0x7feca4017000 comp rx=0 tx=0).stop 2023-10-06T02:25:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.061+0000 7fecbb762700 1 -- 172.21.15.6:0/2032192848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb4086ff0 msgr2=0x7fecb4155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.061+0000 7fecbb762700 1 --2- 172.21.15.6:0/2032192848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb4086ff0 0x7fecb4155e10 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c5b0 tx=0x7fecb0001070 comp rx=0 tx=0).stop 2023-10-06T02:25:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.061+0000 7fecbb762700 1 -- 172.21.15.6:0/2032192848 shutdown_connections 2023-10-06T02:25:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.061+0000 7fecbb762700 1 --2- 172.21.15.6:0/2032192848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecb415a030 0x7fecb4158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.061+0000 7fecbb762700 1 --2- 172.21.15.6:0/2032192848 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec98066f30 0x7fec980693e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.061+0000 7fecbb762700 1 --2- 172.21.15.6:0/2032192848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb4086ff0 0x7fecb4155e10 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.061+0000 7fecbb762700 1 --2- 172.21.15.6:0/2032192848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb40b21b0 0x7fecb415ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.061+0000 7fecbb762700 1 -- 172.21.15.6:0/2032192848 >> 172.21.15.6:0/2032192848 conn(0x7fecb4068680 msgr2=0x7fecb40cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.061+0000 7fecbb762700 1 -- 172.21.15.6:0/2032192848 shutdown_connections 2023-10-06T02:25:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.061+0000 7fecbb762700 1 -- 172.21.15.6:0/2032192848 wait complete. 2023-10-06T02:25:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:nothing to do: rank is not damaged 2023-10-06T02:25:46.076 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:25:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.156+0000 7f244d258000 1 Processor -- start 2023-10-06T02:25:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.156+0000 7f244d258000 1 -- start start 2023-10-06T02:25:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.157+0000 7f244d258000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e5175470 0x5574e516b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.157+0000 7f244d258000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5574e5190410 0x5574e521e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.157+0000 7f244d258000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574e521ff90 0x5574e521da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.157+0000 7f244d258000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e5094980 con 0x5574e521ff90 2023-10-06T02:25:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.157+0000 7f244d258000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e5094620 con 0x5574e5175470 2023-10-06T02:25:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.157+0000 7f244d258000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574e508b400 con 0x5574e5190410 2023-10-06T02:25:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.157+0000 7f2446c94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574e521ff90 0x5574e521da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.157+0000 7f2446c94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574e521ff90 0x5574e521da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36046/0 (socket says 172.21.15.6:36046) 2023-10-06T02:25:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.157+0000 7f2446c94700 1 -- 172.21.15.6:0/1897725979 learned_addr learned my addr 172.21.15.6:0/1897725979 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.157+0000 7f2445c92700 1 --2- 172.21.15.6:0/1897725979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5574e5190410 0x5574e521e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.157+0000 7f2446493700 1 --2- 172.21.15.6:0/1897725979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e5175470 0x5574e516b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.158+0000 7f2446c94700 1 -- 172.21.15.6:0/1897725979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5574e5190410 msgr2=0x5574e521e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.158+0000 7f2446c94700 1 --2- 172.21.15.6:0/1897725979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5574e5190410 0x5574e521e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.158+0000 7f2446c94700 1 -- 172.21.15.6:0/1897725979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e5175470 msgr2=0x5574e516b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.158+0000 7f2446c94700 1 --2- 172.21.15.6:0/1897725979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e5175470 0x5574e516b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.158+0000 7f2446c94700 1 -- 172.21.15.6:0/1897725979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2440005db0 con 0x5574e521ff90 2023-10-06T02:25:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.158+0000 7f2446c94700 1 --2- 172.21.15.6:0/1897725979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574e521ff90 0x5574e521da50 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f24380096d0 tx=0x7f2438007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55af482176c8e81 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.158+0000 7f2444c90700 1 -- 172.21.15.6:0/1897725979 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438010620 con 0x5574e521ff90 2023-10-06T02:25:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.158+0000 7f2444c90700 1 -- 172.21.15.6:0/1897725979 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243800b050 con 0x5574e521ff90 2023-10-06T02:25:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.158+0000 7f2444c90700 1 -- 172.21.15.6:0/1897725979 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24380109d0 con 0x5574e521ff90 2023-10-06T02:25:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.159+0000 7f244d258000 1 -- 172.21.15.6:0/1897725979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574e521ff90 msgr2=0x5574e521da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.159+0000 7f244d258000 1 --2- 172.21.15.6:0/1897725979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574e521ff90 0x5574e521da50 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f24380096d0 tx=0x7f2438007040 comp rx=0 tx=0).stop 2023-10-06T02:25:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.159+0000 7f244d258000 1 -- 172.21.15.6:0/1897725979 shutdown_connections 2023-10-06T02:25:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.159+0000 7f244d258000 1 --2- 172.21.15.6:0/1897725979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574e521ff90 0x5574e521da50 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.159+0000 7f244d258000 1 --2- 172.21.15.6:0/1897725979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e5175470 0x5574e516b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.159+0000 7f244d258000 1 --2- 172.21.15.6:0/1897725979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5574e5190410 0x5574e521e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.159+0000 7f244d258000 1 -- 172.21.15.6:0/1897725979 >> 172.21.15.6:0/1897725979 conn(0x5574e5149d50 msgr2=0x5574e5179040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.159+0000 7f244d258000 1 -- 172.21.15.6:0/1897725979 shutdown_connections 2023-10-06T02:25:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.159+0000 7f244d258000 1 -- 172.21.15.6:0/1897725979 wait complete. 2023-10-06T02:25:46.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.159+0000 7f244d258000 1 Processor -- start 2023-10-06T02:25:46.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.159+0000 7f244d258000 1 -- start start 2023-10-06T02:25:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.160+0000 7f244d258000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e5175470 0x5574e5175e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.160+0000 7f244d258000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5574e5190410 0x5574e5234130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.160+0000 7f244d258000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574e521ff90 0x5574e5234670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.160+0000 7f244d258000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e521b740 con 0x5574e521ff90 2023-10-06T02:25:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.160+0000 7f244d258000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e5214d50 con 0x5574e5175470 2023-10-06T02:25:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.160+0000 7f244d258000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574e521b930 con 0x5574e5190410 2023-10-06T02:25:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.160+0000 7f2446c94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574e521ff90 0x5574e5234670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.160+0000 7f2446c94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574e521ff90 0x5574e5234670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36052/0 (socket says 172.21.15.6:36052) 2023-10-06T02:25:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.160+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 learned_addr learned my addr 172.21.15.6:0/4062757311 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.160+0000 7f2445c92700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5574e5190410 0x5574e5234130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.160+0000 7f2446493700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e5175470 0x5574e5175e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.160+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5574e5190410 msgr2=0x5574e5234130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.160+0000 7f2446c94700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5574e5190410 0x5574e5234130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.160+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e5175470 msgr2=0x5574e5175e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.160+0000 7f2446c94700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574e5175470 0x5574e5175e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.160+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24380092a0 con 0x5574e521ff90 2023-10-06T02:25:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.161+0000 7f2446c94700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574e521ff90 0x5574e5234670 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f2438009cc0 tx=0x7f2438016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.161+0000 7f243effd700 1 -- 172.21.15.6:0/4062757311 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438020070 con 0x5574e521ff90 2023-10-06T02:25:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.161+0000 7f243effd700 1 -- 172.21.15.6:0/4062757311 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2438005c90 con 0x5574e521ff90 2023-10-06T02:25:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.161+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5574e50a33d0 con 0x5574e521ff90 2023-10-06T02:25:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.161+0000 7f243effd700 1 -- 172.21.15.6:0/4062757311 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243801b2e0 con 0x5574e521ff90 2023-10-06T02:25:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.161+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5574e5096ae0 con 0x5574e521ff90 2023-10-06T02:25:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.162+0000 7f243effd700 1 -- 172.21.15.6:0/4062757311 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2438019420 con 0x5574e521ff90 2023-10-06T02:25:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.163+0000 7f243effd700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f24280658c0 0x7f2428067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.163+0000 7f243effd700 1 -- 172.21.15.6:0/4062757311 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6980+0+0 (secure 0 0 0) 0x7f2438084c60 con 0x5574e521ff90 2023-10-06T02:25:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.163+0000 7f2446493700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f24280658c0 0x7f2428067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.168 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:25:46.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.163+0000 7f244d258000 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5574e5176360 0x5574e5213eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.163+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5214e90 con 0x5574e5176360 2023-10-06T02:25:46.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.163+0000 7f2445c92700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5574e5176360 0x5574e5213eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.163+0000 7f2446493700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f24280658c0 0x7f2428067d70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f244000afd0 tx=0x7f2440016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.163+0000 7f2445c92700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5574e5176360 0x5574e5213eb0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.165+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v102'195 uv169 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.165+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5179110 con 0x5574e5176360 2023-10-06T02:25:46.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.166+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v102'196 uv196 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.166+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52143f0 con 0x5574e5176360 2023-10-06T02:25:46.170 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:25:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.169+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v102'197 uv197 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.169+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52147a0 con 0x5574e5176360 2023-10-06T02:25:46.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.172+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v102'198 uv198 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.172+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523e420 con 0x5574e5176360 2023-10-06T02:25:46.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.173+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v102'199 uv199 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.173+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523d410 con 0x5574e5176360 2023-10-06T02:25:46.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.176+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v102'200 uv200 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.176+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523d810 con 0x5574e5176360 2023-10-06T02:25:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.179+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v102'201 uv175 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.179+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523dc10 con 0x5574e5176360 2023-10-06T02:25:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.180+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v102'202 uv202 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.180+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523dc10 con 0x5574e5176360 2023-10-06T02:25:46.183 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:25:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.183+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v102'203 uv203 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.183+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523dbc0 con 0x5574e5176360 2023-10-06T02:25:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.185+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v102'204 uv204 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.185+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523dbc0 con 0x5574e5176360 2023-10-06T02:25:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.186+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v102'205 uv205 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.186+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523dbc0 con 0x5574e5176360 2023-10-06T02:25:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.189+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v102'206 uv206 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.189+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523dbc0 con 0x5574e5176360 2023-10-06T02:25:46.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.192+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v102'207 uv182 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.192+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523dbc0 con 0x5574e5176360 2023-10-06T02:25:46.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.195+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v102'208 uv208 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.195+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523dbc0 con 0x5574e5176360 2023-10-06T02:25:46.198 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:25:46.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.197+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v102'209 uv209 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.198+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523dbc0 con 0x5574e5176360 2023-10-06T02:25:46.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.200+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v102'210 uv210 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.200+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523dbc0 con 0x5574e5176360 2023-10-06T02:25:46.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.201+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v102'211 uv211 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.201+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523dbc0 con 0x5574e5176360 2023-10-06T02:25:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.204+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v102'212 uv212 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.204+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523e7d0 con 0x5574e5176360 2023-10-06T02:25:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.206+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v102'213 uv213 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.206+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523e7d0 con 0x5574e5176360 2023-10-06T02:25:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.208+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v102'214 uv188 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.208+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523e7d0 con 0x5574e5176360 2023-10-06T02:25:46.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.210+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v102'215 uv215 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.210+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523e7d0 con 0x5574e5176360 2023-10-06T02:25:46.213 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:25:46.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.213+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v102'216 uv216 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.213+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523f7e0 con 0x5574e5176360 2023-10-06T02:25:46.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.214+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v102'217 uv217 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.214+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523f7e0 con 0x5574e5176360 2023-10-06T02:25:46.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.217+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v102'218 uv218 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.217+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523e7d0 con 0x5574e5176360 2023-10-06T02:25:46.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.220+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v102'219 uv219 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.220+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523e7d0 con 0x5574e5176360 2023-10-06T02:25:46.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.222+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v102'220 uv194 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.222+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523e7d0 con 0x5574e5176360 2023-10-06T02:25:46.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.225+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v102'221 uv221 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.225+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523e7d0 con 0x5574e5176360 2023-10-06T02:25:46.227 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:25:46.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.226+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v102'222 uv222 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.226+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523f7e0 con 0x5574e5176360 2023-10-06T02:25:46.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.228+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v102'223 uv223 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.228+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523f7e0 con 0x5574e5176360 2023-10-06T02:25:46.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.230+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v102'224 uv224 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.230+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e523e7d0 con 0x5574e5176360 2023-10-06T02:25:46.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.233+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v102'225 uv225 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e5176360 2023-10-06T02:25:46.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.233+0000 7f244d258000 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5574e523ece0 0x5574e52410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.233+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5241600 con 0x5574e523ece0 2023-10-06T02:25:46.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.233+0000 7f2446493700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5574e523ece0 0x5574e52410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.233+0000 7f2446493700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5574e523ece0 0x5574e52410c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.235+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v102'149 uv131 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.235+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52419b0 con 0x5574e523ece0 2023-10-06T02:25:46.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.236+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v102'150 uv150 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.236+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5241d60 con 0x5574e523ece0 2023-10-06T02:25:46.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.237+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v102'151 uv151 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.237 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:25:46.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.237+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5242600 con 0x5574e523ece0 2023-10-06T02:25:46.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.238+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v102'152 uv152 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.238+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52429b0 con 0x5574e523ece0 2023-10-06T02:25:46.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.239+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v102'153 uv153 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.239+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5242d60 con 0x5574e523ece0 2023-10-06T02:25:46.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.240+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v102'154 uv148 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.240+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5243110 con 0x5574e523ece0 2023-10-06T02:25:46.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.241+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v102'155 uv155 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.241+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52434c0 con 0x5574e523ece0 2023-10-06T02:25:46.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.242+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v102'156 uv156 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.242 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:25:46.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.242+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52434c0 con 0x5574e523ece0 2023-10-06T02:25:46.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.243+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v102'157 uv157 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.243+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52434c0 con 0x5574e523ece0 2023-10-06T02:25:46.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.244+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v102'158 uv158 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.244+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52434c0 con 0x5574e523ece0 2023-10-06T02:25:46.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.245+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v102'159 uv147 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.245+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52434c0 con 0x5574e523ece0 2023-10-06T02:25:46.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.248+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v102'160 uv160 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.248+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52434c0 con 0x5574e523ece0 2023-10-06T02:25:46.249 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:25:46.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.249+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v102'161 uv161 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.249+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5246be0 con 0x5574e523ece0 2023-10-06T02:25:46.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.250+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v102'162 uv162 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.250+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5246be0 con 0x5574e523ece0 2023-10-06T02:25:46.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.251+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v102'163 uv163 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.251+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52434c0 con 0x5574e523ece0 2023-10-06T02:25:46.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.252+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v102'164 uv145 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.252+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52434c0 con 0x5574e523ece0 2023-10-06T02:25:46.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.253+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v102'165 uv165 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.253+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52434c0 con 0x5574e523ece0 2023-10-06T02:25:46.254 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:25:46.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.254+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v102'166 uv166 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.254+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52444d0 con 0x5574e523ece0 2023-10-06T02:25:46.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.255+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v102'167 uv167 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.255+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52444d0 con 0x5574e523ece0 2023-10-06T02:25:46.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.256+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v102'168 uv168 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.256+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52434c0 con 0x5574e523ece0 2023-10-06T02:25:46.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.257+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v102'169 uv169 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.257+0000 7f244d258000 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5574e52439d0 0x5574e5245db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.257+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52462f0 con 0x5574e52439d0 2023-10-06T02:25:46.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.257+0000 7f2445c92700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5574e52439d0 0x5574e5245db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.257+0000 7f2445c92700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5574e52439d0 0x5574e5245db0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.258+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v102'39 uv38 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.258+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52462f0 con 0x5574e52439d0 2023-10-06T02:25:46.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.259+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v102'40 uv40 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.259+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52462f0 con 0x5574e52439d0 2023-10-06T02:25:46.261 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:25:46.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.260+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v102'41 uv41 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.260+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5247300 con 0x5574e52439d0 2023-10-06T02:25:46.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.262+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v102'42 uv42 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.262+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5247300 con 0x5574e52439d0 2023-10-06T02:25:46.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.263+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v102'43 uv43 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.263+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52462f0 con 0x5574e52439d0 2023-10-06T02:25:46.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.264+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v102'44 uv44 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.264+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52462f0 con 0x5574e52439d0 2023-10-06T02:25:46.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.265+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v102'30 uv29 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.265+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52462f0 con 0x5574e52439d0 2023-10-06T02:25:46.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.266+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v102'31 uv31 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.266+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52462f0 con 0x5574e52439d0 2023-10-06T02:25:46.267 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:25:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.267+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v102'32 uv32 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.267+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52466f0 con 0x5574e52439d0 2023-10-06T02:25:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.268+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v102'33 uv33 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.268+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52466c0 con 0x5574e523ece0 2023-10-06T02:25:46.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.271+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v102'39 uv38 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.271+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52466c0 con 0x5574e523ece0 2023-10-06T02:25:46.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.276+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v102'40 uv40 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.276+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52466c0 con 0x5574e523ece0 2023-10-06T02:25:46.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.277+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v102'41 uv41 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.278 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:25:46.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.277+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52476d0 con 0x5574e523ece0 2023-10-06T02:25:46.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.280+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v102'42 uv42 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.280+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52476d0 con 0x5574e523ece0 2023-10-06T02:25:46.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.283+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v102'43 uv43 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.283+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52466c0 con 0x5574e523ece0 2023-10-06T02:25:46.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.286+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v102'44 uv44 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e523ece0 2023-10-06T02:25:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.286+0000 7f244d258000 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5574e5246bd0 0x5574e5248fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.286+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52494f0 con 0x5574e5246bd0 2023-10-06T02:25:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.286+0000 7f2446c94700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5574e5246bd0 0x5574e5248fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.287+0000 7f2446c94700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5574e5246bd0 0x5574e5248fb0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.288+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v102'70 uv64 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5246bd0 2023-10-06T02:25:46.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.288+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5249920 con 0x5574e5246bd0 2023-10-06T02:25:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.289+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v102'71 uv71 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5246bd0 2023-10-06T02:25:46.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.289+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5249e10 con 0x5574e5246bd0 2023-10-06T02:25:46.291 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:25:46.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.290+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v102'72 uv72 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5246bd0 2023-10-06T02:25:46.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.290+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524b710 con 0x5574e5246bd0 2023-10-06T02:25:46.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.292+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v102'73 uv73 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5246bd0 2023-10-06T02:25:46.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.292+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524bac0 con 0x5574e5246bd0 2023-10-06T02:25:46.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.293+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v102'74 uv74 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5246bd0 2023-10-06T02:25:46.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.293+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524a700 con 0x5574e5246bd0 2023-10-06T02:25:46.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.297+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v102'75 uv75 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5246bd0 2023-10-06T02:25:46.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.297+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524ab00 con 0x5574e5246bd0 2023-10-06T02:25:46.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.298+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v102'76 uv69 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5246bd0 2023-10-06T02:25:46.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.298+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524af00 con 0x5574e5246bd0 2023-10-06T02:25:46.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.301+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v102'77 uv77 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5246bd0 2023-10-06T02:25:46.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.301+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524af00 con 0x5574e5246bd0 2023-10-06T02:25:46.302 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:25:46.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.302+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v102'78 uv78 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5246bd0 2023-10-06T02:25:46.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.302+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524aeb0 con 0x5574e5246bd0 2023-10-06T02:25:46.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.304+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v102'79 uv79 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5246bd0 2023-10-06T02:25:46.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.304+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524aeb0 con 0x5574e5246bd0 2023-10-06T02:25:46.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.307+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v102'80 uv80 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5246bd0 2023-10-06T02:25:46.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.307+0000 7f244d258000 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5574e524b280 0x5574e524e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.307+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524e8d0 con 0x5574e524b280 2023-10-06T02:25:46.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.307+0000 7f2446493700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5574e524b280 0x5574e524e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.308+0000 7f2446493700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5574e524b280 0x5574e524e390 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.309+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v102'32 uv31 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e524b280 2023-10-06T02:25:46.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.309+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524e8d0 con 0x5574e524b280 2023-10-06T02:25:46.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.310+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v102'33 uv33 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e524b280 2023-10-06T02:25:46.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.310+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524e8d0 con 0x5574e524b280 2023-10-06T02:25:46.313 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:25:46.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.313+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v102'34 uv34 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e524b280 2023-10-06T02:25:46.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.313+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524ecd0 con 0x5574e524b280 2023-10-06T02:25:46.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.316+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v102'35 uv35 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e524b280 2023-10-06T02:25:46.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.316+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524ecd0 con 0x5574e524b280 2023-10-06T02:25:46.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.321+0000 7f2446493700 1 -- 172.21.15.6:0/4062757311 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v102'36 uv36 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2440008d60 con 0x5574e524b280 2023-10-06T02:25:46.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.321+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524ea20 con 0x5574e52439d0 2023-10-06T02:25:46.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.322+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v102'39 uv38 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.322+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524ea20 con 0x5574e52439d0 2023-10-06T02:25:46.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.325+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v102'40 uv40 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.325+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524ea20 con 0x5574e52439d0 2023-10-06T02:25:46.328 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:25:46.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.327+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v102'41 uv41 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.327+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524fa30 con 0x5574e52439d0 2023-10-06T02:25:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.332+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v102'42 uv42 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.332+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524fa30 con 0x5574e52439d0 2023-10-06T02:25:46.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.333+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v102'43 uv43 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.333+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e524ea20 con 0x5574e52439d0 2023-10-06T02:25:46.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.336+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v102'44 uv44 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.336+0000 7f244d258000 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5574e524f300 0x5574e524f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.336+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251f20 con 0x5574e524f300 2023-10-06T02:25:46.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.336+0000 7f2445c92700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5574e524f300 0x5574e524f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.337+0000 7f2445c92700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5574e524f300 0x5574e524f6f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.342+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v102'64 uv58 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e524f300 2023-10-06T02:25:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.342+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251f20 con 0x5574e524f300 2023-10-06T02:25:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.343+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v102'65 uv65 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e524f300 2023-10-06T02:25:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.343+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251f20 con 0x5574e524f300 2023-10-06T02:25:46.345 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:25:46.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.345+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v102'66 uv66 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e524f300 2023-10-06T02:25:46.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.345+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251f20 con 0x5574e524f300 2023-10-06T02:25:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.351+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v102'67 uv67 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e524f300 2023-10-06T02:25:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.351+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251f20 con 0x5574e524f300 2023-10-06T02:25:46.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.352+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v102'68 uv68 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e524f300 2023-10-06T02:25:46.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.352+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251f20 con 0x5574e524f300 2023-10-06T02:25:46.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.354+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v102'69 uv63 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e524f300 2023-10-06T02:25:46.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.354+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251f20 con 0x5574e524f300 2023-10-06T02:25:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.359+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v102'70 uv70 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e524f300 2023-10-06T02:25:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.359+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251f20 con 0x5574e524f300 2023-10-06T02:25:46.360 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:25:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.360+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v102'71 uv71 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e524f300 2023-10-06T02:25:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.360+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251f20 con 0x5574e524f300 2023-10-06T02:25:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.362+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v102'72 uv72 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e524f300 2023-10-06T02:25:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.362+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5254c90 con 0x5574e524f300 2023-10-06T02:25:46.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.367+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v102'73 uv73 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e524f300 2023-10-06T02:25:46.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.367+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5252410 con 0x5574e52439d0 2023-10-06T02:25:46.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.368+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v102'31 uv29 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.368+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5252410 con 0x5574e52439d0 2023-10-06T02:25:46.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.371+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v102'32 uv32 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.371+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5252410 con 0x5574e52439d0 2023-10-06T02:25:46.374 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:25:46.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.374+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v102'33 uv33 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.374+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5252410 con 0x5574e52439d0 2023-10-06T02:25:46.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.376+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v102'34 uv34 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.376+0000 7f244d258000 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5574e5252920 0x5574e5252cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.376+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52553e0 con 0x5574e5252920 2023-10-06T02:25:46.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.377+0000 7f2446c94700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5574e5252920 0x5574e5252cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.377+0000 7f2446c94700 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5574e5252920 0x5574e5252cf0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.378+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v102'39 uv38 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5252920 2023-10-06T02:25:46.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.378+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52553e0 con 0x5574e5252920 2023-10-06T02:25:46.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.379+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v102'40 uv40 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5252920 2023-10-06T02:25:46.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.379+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52553e0 con 0x5574e5252920 2023-10-06T02:25:46.381 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:25:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.381+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v102'41 uv41 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5252920 2023-10-06T02:25:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.381+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52563f0 con 0x5574e5252920 2023-10-06T02:25:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.384+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v102'42 uv42 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5252920 2023-10-06T02:25:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.384+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52563f0 con 0x5574e5252920 2023-10-06T02:25:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.387+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v102'43 uv43 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5252920 2023-10-06T02:25:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.387+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52553e0 con 0x5574e5252920 2023-10-06T02:25:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.388+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v102'44 uv44 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5252920 2023-10-06T02:25:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.388+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52553e0 con 0x5574e5246bd0 2023-10-06T02:25:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.389+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v102'32 uv31 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5246bd0 2023-10-06T02:25:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.389+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52553e0 con 0x5574e5246bd0 2023-10-06T02:25:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.390+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v102'33 uv33 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5246bd0 2023-10-06T02:25:46.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.390+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52553e0 con 0x5574e5246bd0 2023-10-06T02:25:46.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.391+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v102'34 uv34 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5246bd0 2023-10-06T02:25:46.392 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:25:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.391+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52553e0 con 0x5574e5246bd0 2023-10-06T02:25:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.392+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v102'35 uv35 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5246bd0 2023-10-06T02:25:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.392+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251fa0 con 0x5574e5246bd0 2023-10-06T02:25:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.393+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v102'36 uv36 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2438016070 con 0x5574e5246bd0 2023-10-06T02:25:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.393+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251fa0 con 0x5574e52439d0 2023-10-06T02:25:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.394+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v102'82 uv73 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.394+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251fa0 con 0x5574e52439d0 2023-10-06T02:25:46.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.395+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v102'83 uv83 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.395+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251fa0 con 0x5574e52439d0 2023-10-06T02:25:46.401 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:25:46.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.401+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v102'84 uv84 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.401+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251fa0 con 0x5574e52439d0 2023-10-06T02:25:46.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.402+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v102'85 uv85 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.402+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251fa0 con 0x5574e52439d0 2023-10-06T02:25:46.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.405+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v102'86 uv86 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.405+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251fa0 con 0x5574e52439d0 2023-10-06T02:25:46.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.408+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v102'87 uv80 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.408+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251fa0 con 0x5574e52439d0 2023-10-06T02:25:46.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.410+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v102'88 uv88 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.410+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251fa0 con 0x5574e52439d0 2023-10-06T02:25:46.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.413+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v102'89 uv89 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.414 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:25:46.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.413+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251fa0 con 0x5574e52439d0 2023-10-06T02:25:46.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.416+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v102'90 uv90 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.416+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5251fa0 con 0x5574e52439d0 2023-10-06T02:25:46.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.418+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v102'91 uv91 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.418+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e52558d0 con 0x5574e52439d0 2023-10-06T02:25:46.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.424+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v102'92 uv92 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.424+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102) v8 -- 0x5574e5255b40 con 0x5574e52439d0 2023-10-06T02:25:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f2445c92700 1 -- 172.21.15.6:0/4062757311 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v102'93 uv93 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f243000b040 con 0x5574e52439d0 2023-10-06T02:25:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5574e52439d0 msgr2=0x5574e5245db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5574e52439d0 0x5574e5245db0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5574e5176360 msgr2=0x5574e5213eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5574e5176360 0x5574e5213eb0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5574e524f300 msgr2=0x5574e524f6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5574e524f300 0x5574e524f6f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5574e523ece0 msgr2=0x5574e52410c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5574e523ece0 0x5574e52410c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 reap_dead start 2023-10-06T02:25:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5574e5252920 msgr2=0x5574e5252cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5574e5252920 0x5574e5252cf0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5574e524b280 msgr2=0x5574e524e390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5574e524b280 0x5574e524e390 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5574e5246bd0 msgr2=0x5574e5248fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5574e5246bd0 0x5574e5248fb0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f24280658c0 msgr2=0x7f2428067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f24280658c0 0x7f2428067d70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f244000afd0 tx=0x7f2440016000 comp rx=0 tx=0).stop 2023-10-06T02:25:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574e521ff90 msgr2=0x5574e5234670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f2446c94700 1 -- 172.21.15.6:0/4062757311 reap_dead start 2023-10-06T02:25:46.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574e521ff90 0x5574e5234670 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f2438009cc0 tx=0x7f2438016000 comp rx=0 tx=0).stop 2023-10-06T02:25:46.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 shutdown_connections 2023-10-06T02:25:46.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 --2- 172.21.15.6:0/4062757311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574e521ff90 0x5574e5234670 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 >> 172.21.15.6:0/4062757311 conn(0x5574e5149d50 msgr2=0x5574e5177a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:46.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 shutdown_connections 2023-10-06T02:25:46.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.425+0000 7f244d258000 1 -- 172.21.15.6:0/4062757311 wait complete. 2023-10-06T02:25:46.430 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 500.00000000 2023-10-06T02:25:46.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.508+0000 7fc1fbefd000 1 Processor -- start 2023-10-06T02:25:46.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.508+0000 7fc1fbefd000 1 -- start start 2023-10-06T02:25:46.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1fbefd000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df9edd41b0 0x55df9ee53e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1fbefd000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55df9ee60500 0x55df9edbbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1fbefd000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df9ee60e10 0x55df9edba280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1fbefd000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df9ecd7980 con 0x55df9edd41b0 2023-10-06T02:25:46.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1fbefd000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df9ecd7620 con 0x55df9ee60e10 2023-10-06T02:25:46.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1fbefd000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df9ecce400 con 0x55df9ee60500 2023-10-06T02:25:46.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1f5138700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df9edd41b0 0x55df9ee53e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1f5138700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df9edd41b0 0x55df9ee53e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36062/0 (socket says 172.21.15.6:36062) 2023-10-06T02:25:46.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1f5939700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df9ee60e10 0x55df9edba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1f5138700 1 -- 172.21.15.6:0/3232894624 learned_addr learned my addr 172.21.15.6:0/3232894624 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:46.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1f4937700 1 --2- 172.21.15.6:0/3232894624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55df9ee60500 0x55df9edbbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1f5138700 1 -- 172.21.15.6:0/3232894624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55df9ee60500 msgr2=0x55df9edbbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:46.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1f5138700 1 --2- 172.21.15.6:0/3232894624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55df9ee60500 0x55df9edbbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1f5138700 1 -- 172.21.15.6:0/3232894624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df9ee60e10 msgr2=0x55df9edba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:46.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1f5138700 1 --2- 172.21.15.6:0/3232894624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df9ee60e10 0x55df9edba280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1f5138700 1 -- 172.21.15.6:0/3232894624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f0005db0 con 0x55df9edd41b0 2023-10-06T02:25:46.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1f4937700 1 --2- 172.21.15.6:0/3232894624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55df9ee60500 0x55df9edbbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:25:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1f5138700 1 --2- 172.21.15.6:0/3232894624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df9edd41b0 0x55df9ee53e00 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009a30 tx=0x7fc1f000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14745118ef1f92dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1ef7fe700 1 -- 172.21.15.6:0/3232894624 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f000f040 con 0x55df9edd41b0 2023-10-06T02:25:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1ef7fe700 1 -- 172.21.15.6:0/3232894624 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f0009e70 con 0x55df9edd41b0 2023-10-06T02:25:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.509+0000 7fc1ef7fe700 1 -- 172.21.15.6:0/3232894624 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0008d60 con 0x55df9edd41b0 2023-10-06T02:25:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.510+0000 7fc1fbefd000 1 -- 172.21.15.6:0/3232894624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df9edd41b0 msgr2=0x55df9ee53e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.510+0000 7fc1fbefd000 1 --2- 172.21.15.6:0/3232894624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df9edd41b0 0x55df9ee53e00 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009a30 tx=0x7fc1f000c040 comp rx=0 tx=0).stop 2023-10-06T02:25:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.510+0000 7fc1fbefd000 1 -- 172.21.15.6:0/3232894624 shutdown_connections 2023-10-06T02:25:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.510+0000 7fc1fbefd000 1 --2- 172.21.15.6:0/3232894624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df9ee60e10 0x55df9edba280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.510+0000 7fc1fbefd000 1 --2- 172.21.15.6:0/3232894624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df9edd41b0 0x55df9ee53e00 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.510+0000 7fc1fbefd000 1 --2- 172.21.15.6:0/3232894624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55df9ee60500 0x55df9edbbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.510+0000 7fc1fbefd000 1 -- 172.21.15.6:0/3232894624 >> 172.21.15.6:0/3232894624 conn(0x55df9ed8cd50 msgr2=0x55df9edb6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.510+0000 7fc1fbefd000 1 -- 172.21.15.6:0/3232894624 shutdown_connections 2023-10-06T02:25:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.510+0000 7fc1fbefd000 1 -- 172.21.15.6:0/3232894624 wait complete. 2023-10-06T02:25:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.510+0000 7fc1fbefd000 1 Processor -- start 2023-10-06T02:25:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.511+0000 7fc1fbefd000 1 -- start start 2023-10-06T02:25:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.511+0000 7fc1fbefd000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df9edd41b0 0x55df9ee52f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.511+0000 7fc1fbefd000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55df9ee60500 0x55df9edb7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.511+0000 7fc1fbefd000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df9ee60e10 0x55df9edb8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.511+0000 7fc1fbefd000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df9edd4dd0 con 0x55df9edd41b0 2023-10-06T02:25:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.511+0000 7fc1fbefd000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df9ee69eb0 con 0x55df9ee60e10 2023-10-06T02:25:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.511+0000 7fc1fbefd000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df9ee6a380 con 0x55df9ee60500 2023-10-06T02:25:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.511+0000 7fc1f5138700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df9edd41b0 0x55df9ee52f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.511+0000 7fc1f5138700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df9edd41b0 0x55df9ee52f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36064/0 (socket says 172.21.15.6:36064) 2023-10-06T02:25:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.511+0000 7fc1f5138700 1 -- 172.21.15.6:0/3556299427 learned_addr learned my addr 172.21.15.6:0/3556299427 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.511+0000 7fc1f4937700 1 --2- 172.21.15.6:0/3556299427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55df9ee60500 0x55df9edb7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.511+0000 7fc1f5939700 1 --2- 172.21.15.6:0/3556299427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df9ee60e10 0x55df9edb8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.512+0000 7fc1f5138700 1 -- 172.21.15.6:0/3556299427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55df9ee60500 msgr2=0x55df9edb7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.512+0000 7fc1f5138700 1 --2- 172.21.15.6:0/3556299427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55df9ee60500 0x55df9edb7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.512+0000 7fc1f5138700 1 -- 172.21.15.6:0/3556299427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df9ee60e10 msgr2=0x55df9edb8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.512+0000 7fc1f5138700 1 --2- 172.21.15.6:0/3556299427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df9ee60e10 0x55df9edb8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.512+0000 7fc1f5138700 1 -- 172.21.15.6:0/3556299427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df9ed001c0 con 0x55df9edd41b0 2023-10-06T02:25:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.512+0000 7fc1f5138700 1 --2- 172.21.15.6:0/3556299427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df9edd41b0 0x55df9ee52f40 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00086a0 tx=0x7fc1f0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.512+0000 7fc1edffb700 1 -- 172.21.15.6:0/3556299427 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f000f070 con 0x55df9edd41b0 2023-10-06T02:25:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.512+0000 7fc1edffb700 1 -- 172.21.15.6:0/3556299427 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f0013940 con 0x55df9edd41b0 2023-10-06T02:25:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.512+0000 7fc1fbefd000 1 -- 172.21.15.6:0/3556299427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f0009630 con 0x55df9edd41b0 2023-10-06T02:25:46.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.512+0000 7fc1edffb700 1 -- 172.21.15.6:0/3556299427 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0013ce0 con 0x55df9edd41b0 2023-10-06T02:25:46.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.512+0000 7fc1fbefd000 1 -- 172.21.15.6:0/3556299427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e0005cf0 con 0x55df9edd41b0 2023-10-06T02:25:46.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.513+0000 7fc1edffb700 1 -- 172.21.15.6:0/3556299427 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1f0023070 con 0x55df9edd41b0 2023-10-06T02:25:46.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.514+0000 7fc1edffb700 1 --2- 172.21.15.6:0/3556299427 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc1d80658c0 0x7fc1d8067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.514+0000 7fc1edffb700 1 -- 172.21.15.6:0/3556299427 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6980+0+0 (secure 0 0 0) 0x7fc1f0085540 con 0x55df9edd41b0 2023-10-06T02:25:46.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.514+0000 7fc1f4937700 1 --2- 172.21.15.6:0/3556299427 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc1d80658c0 0x7fc1d8067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.514+0000 7fc1fbefd000 1 --2- 172.21.15.6:0/3556299427 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55df9ee50150 0x55df9ee6aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.514+0000 7fc1fbefd000 1 -- 172.21.15.6:0/3556299427 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:1 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102) v8 -- 0x55df9ee6b000 con 0x55df9ee50150 2023-10-06T02:25:46.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.514+0000 7fc1f5939700 1 --2- 172.21.15.6:0/3556299427 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55df9ee50150 0x55df9ee6aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.514+0000 7fc1f4937700 1 --2- 172.21.15.6:0/3556299427 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc1d80658c0 0x7fc1d8067d70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000a5d0 tx=0x7fc1e0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.514+0000 7fc1f5939700 1 --2- 172.21.15.6:0/3556299427 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55df9ee50150 0x55df9ee6aac0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.515+0000 7fc1f5939700 1 -- 172.21.15.6:0/3556299427 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(1 500.00000000 [delete] v102'81 uv81 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fc1e8003720 con 0x55df9ee50150 2023-10-06T02:25:46.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.515+0000 7fc1fbefd000 1 -- 172.21.15.6:0/3556299427 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55df9ee50150 msgr2=0x55df9ee6aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.516+0000 7fc1fbefd000 1 --2- 172.21.15.6:0/3556299427 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55df9ee50150 0x55df9ee6aac0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.516+0000 7fc1fbefd000 1 -- 172.21.15.6:0/3556299427 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc1d80658c0 msgr2=0x7fc1d8067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.516+0000 7fc1fbefd000 1 --2- 172.21.15.6:0/3556299427 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc1d80658c0 0x7fc1d8067d70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000a5d0 tx=0x7fc1e0016000 comp rx=0 tx=0).stop 2023-10-06T02:25:46.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.516+0000 7fc1fbefd000 1 -- 172.21.15.6:0/3556299427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df9edd41b0 msgr2=0x55df9ee52f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.516+0000 7fc1fbefd000 1 --2- 172.21.15.6:0/3556299427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df9edd41b0 0x55df9ee52f40 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00086a0 tx=0x7fc1f0018000 comp rx=0 tx=0).stop 2023-10-06T02:25:46.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.516+0000 7fc1f5939700 1 -- 172.21.15.6:0/3556299427 reap_dead start 2023-10-06T02:25:46.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.516+0000 7fc1fbefd000 1 -- 172.21.15.6:0/3556299427 shutdown_connections 2023-10-06T02:25:46.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.516+0000 7fc1fbefd000 1 -- 172.21.15.6:0/3556299427 >> 172.21.15.6:0/3556299427 conn(0x55df9ed8cd50 msgr2=0x55df9ee56470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:46.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.516+0000 7fc1fbefd000 1 -- 172.21.15.6:0/3556299427 shutdown_connections 2023-10-06T02:25:46.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.516+0000 7fc1fbefd000 1 -- 172.21.15.6:0/3556299427 wait complete. 2023-10-06T02:25:46.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:25:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.683+0000 7f13a76a3700 1 Processor -- start 2023-10-06T02:25:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.683+0000 7f13a76a3700 1 -- start start 2023-10-06T02:25:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.684+0000 7f13a76a3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13a00ccd40 0x7f13a00cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.684+0000 7f13a76a3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a015dd40 con 0x7f13a00d0400 2023-10-06T02:25:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.684+0000 7f13a76a3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a015e020 con 0x7f13a00cf7e0 2023-10-06T02:25:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.684+0000 7f13a76a3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a00ceaa0 con 0x7f13a00ccd40 2023-10-06T02:25:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.684+0000 7f13a4c3e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13a00ccd40 0x7f13a00cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.684+0000 7f13a543f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f13a00d0400 0x7f13a00b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45544/0 (socket says 172.21.15.6:45544) 2023-10-06T02:25:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.684+0000 7f13a543f700 1 -- 172.21.15.6:0/1329801477 learned_addr learned my addr 172.21.15.6:0/1329801477 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.684+0000 7f13a4c3e700 1 -- 172.21.15.6:0/1329801477 >> v1:172.21.15.175:6789/0 conn(0x7f13a00cf7e0 legacy=0x7f13a00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.684+0000 7f13a4c3e700 1 -- 172.21.15.6:0/1329801477 >> v1:172.21.15.6:6789/0 conn(0x7f13a00d0400 legacy=0x7f13a00b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.684+0000 7f13a4c3e700 1 -- 172.21.15.6:0/1329801477 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a00ced80 con 0x7f13a00ccd40 2023-10-06T02:25:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.684+0000 7f1397fff700 1 -- 172.21.15.6:0/1329801477 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1795089277 0 0) 0x7f13a015dd40 con 0x7f13a00d0400 2023-10-06T02:25:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.684+0000 7f13a4c3e700 1 --2- 172.21.15.6:0/1329801477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13a00ccd40 0x7f13a00cf2a0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f13900098e0 tx=0x7f13900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758250c1a7001d36 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.684+0000 7f1397fff700 1 -- 172.21.15.6:0/1329801477 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390009e80 con 0x7f13a00ccd40 2023-10-06T02:25:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.684+0000 7f1397fff700 1 -- 172.21.15.6:0/1329801477 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139000b820 con 0x7f13a00ccd40 2023-10-06T02:25:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.684+0000 7f1397fff700 1 -- 172.21.15.6:0/1329801477 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000bba0 con 0x7f13a00ccd40 2023-10-06T02:25:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.685+0000 7f13a76a3700 1 -- 172.21.15.6:0/1329801477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13a00ccd40 msgr2=0x7f13a00cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.685+0000 7f13a76a3700 1 --2- 172.21.15.6:0/1329801477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13a00ccd40 0x7f13a00cf2a0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f13900098e0 tx=0x7f13900091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.685+0000 7f13a76a3700 1 -- 172.21.15.6:0/1329801477 shutdown_connections 2023-10-06T02:25:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.685+0000 7f13a76a3700 1 --2- 172.21.15.6:0/1329801477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13a00ccd40 0x7f13a00cf2a0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.685+0000 7f13a76a3700 1 -- 172.21.15.6:0/1329801477 >> 172.21.15.6:0/1329801477 conn(0x7f13a006a220 msgr2=0x7f13a006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.685+0000 7f13a76a3700 1 -- 172.21.15.6:0/1329801477 shutdown_connections 2023-10-06T02:25:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.685+0000 7f13a76a3700 1 -- 172.21.15.6:0/1329801477 wait complete. 2023-10-06T02:25:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.686+0000 7f13a76a3700 1 Processor -- start 2023-10-06T02:25:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.686+0000 7f13a76a3700 1 -- start start 2023-10-06T02:25:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.687+0000 7f13a76a3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13a00ccd40 0x7f13a016d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.687+0000 7f13a76a3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13a00cf7e0 0x7f13a016d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.687+0000 7f13a76a3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13a00d0400 0x7f13a014d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.687+0000 7f13a76a3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a013cae0 con 0x7f13a00d0400 2023-10-06T02:25:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.687+0000 7f13a76a3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00b2680 con 0x7f13a00ccd40 2023-10-06T02:25:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.687+0000 7f13a76a3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a016af30 con 0x7f13a00cf7e0 2023-10-06T02:25:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.687+0000 7f13a5c40700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13a00d0400 0x7f13a014d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.687+0000 7f13a5c40700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13a00d0400 0x7f13a014d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36094/0 (socket says 172.21.15.6:36094) 2023-10-06T02:25:46.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.687+0000 7f13a5c40700 1 -- 172.21.15.6:0/2517618626 learned_addr learned my addr 172.21.15.6:0/2517618626 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:46.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.687+0000 7f13a4c3e700 1 --2- 172.21.15.6:0/2517618626 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13a00cf7e0 0x7f13a016d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.687+0000 7f13a5c40700 1 -- 172.21.15.6:0/2517618626 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13a00cf7e0 msgr2=0x7f13a016d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.687+0000 7f13a543f700 1 --2- 172.21.15.6:0/2517618626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13a00ccd40 0x7f13a016d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.687+0000 7f13a5c40700 1 --2- 172.21.15.6:0/2517618626 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13a00cf7e0 0x7f13a016d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.687+0000 7f13a5c40700 1 -- 172.21.15.6:0/2517618626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13a00ccd40 msgr2=0x7f13a016d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.687+0000 7f13a5c40700 1 --2- 172.21.15.6:0/2517618626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13a00ccd40 0x7f13a016d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.687+0000 7f13a5c40700 1 -- 172.21.15.6:0/2517618626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1390009420 con 0x7f13a00d0400 2023-10-06T02:25:46.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.687+0000 7f13a5c40700 1 --2- 172.21.15.6:0/2517618626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13a00d0400 0x7f13a014d7a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f139800c930 tx=0x7f13980026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.688+0000 7f13957fa700 1 -- 172.21.15.6:0/2517618626 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139800ce70 con 0x7f13a00d0400 2023-10-06T02:25:46.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.688+0000 7f13957fa700 1 -- 172.21.15.6:0/2517618626 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139800a7e0 con 0x7f13a00d0400 2023-10-06T02:25:46.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.688+0000 7f13a76a3700 1 -- 172.21.15.6:0/2517618626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a00b23a0 con 0x7f13a00d0400 2023-10-06T02:25:46.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.688+0000 7f13957fa700 1 -- 172.21.15.6:0/2517618626 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139800aba0 con 0x7f13a00d0400 2023-10-06T02:25:46.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.688+0000 7f13a76a3700 1 -- 172.21.15.6:0/2517618626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a016b4b0 con 0x7f13a00d0400 2023-10-06T02:25:46.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.689+0000 7f13a76a3700 1 -- 172.21.15.6:0/2517618626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a0088760 con 0x7f13a00d0400 2023-10-06T02:25:46.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.689+0000 7f13957fa700 1 -- 172.21.15.6:0/2517618626 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1398012420 con 0x7f13a00d0400 2023-10-06T02:25:46.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.689+0000 7f13957fa700 1 --2- 172.21.15.6:0/2517618626 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1384066f60 0x7f1384069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.689+0000 7f13957fa700 1 -- 172.21.15.6:0/2517618626 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6980+0+0 (secure 0 0 0) 0x7f1398084dc0 con 0x7f13a00d0400 2023-10-06T02:25:46.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.690+0000 7f13a543f700 1 --2- 172.21.15.6:0/2517618626 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1384066f60 0x7f1384069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.690+0000 7f13a543f700 1 --2- 172.21.15.6:0/2517618626 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1384066f60 0x7f1384069410 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f13a016adb0 tx=0x7f139c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.694+0000 7f13957fa700 1 -- 172.21.15.6:0/2517618626 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1398055670 con 0x7f13a00d0400 2023-10-06T02:25:46.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:46.934+0000 7f13a76a3700 1 -- 172.21.15.6:0/2517618626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f13a00ce6c0 con 0x7f13a00d0400 2023-10-06T02:25:47.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.063+0000 7f13957fa700 1 -- 172.21.15.6:0/2517618626 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v132) v1 ==== 162+0+0 (secure 0 0 0) 0x7f1398055200 con 0x7f13a00d0400 2023-10-06T02:25:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.065+0000 7f13a76a3700 1 -- 172.21.15.6:0/2517618626 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1384066f60 msgr2=0x7f1384069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.065+0000 7f13a76a3700 1 --2- 172.21.15.6:0/2517618626 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1384066f60 0x7f1384069410 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f13a016adb0 tx=0x7f139c009040 comp rx=0 tx=0).stop 2023-10-06T02:25:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.065+0000 7f13a76a3700 1 -- 172.21.15.6:0/2517618626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13a00d0400 msgr2=0x7f13a014d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.065+0000 7f13a76a3700 1 --2- 172.21.15.6:0/2517618626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13a00d0400 0x7f13a014d7a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f139800c930 tx=0x7f13980026e0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.065+0000 7f13a76a3700 1 -- 172.21.15.6:0/2517618626 shutdown_connections 2023-10-06T02:25:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.065+0000 7f13a76a3700 1 --2- 172.21.15.6:0/2517618626 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1384066f60 0x7f1384069410 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.065+0000 7f13a76a3700 1 --2- 172.21.15.6:0/2517618626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13a00d0400 0x7f13a014d7a0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.065+0000 7f13a76a3700 1 --2- 172.21.15.6:0/2517618626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13a00ccd40 0x7f13a016d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.065+0000 7f13a76a3700 1 --2- 172.21.15.6:0/2517618626 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13a00cf7e0 0x7f13a016d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.065+0000 7f13a76a3700 1 -- 172.21.15.6:0/2517618626 >> 172.21.15.6:0/2517618626 conn(0x7f13a006a220 msgr2=0x7f13a00b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.065+0000 7f13a76a3700 1 -- 172.21.15.6:0/2517618626 shutdown_connections 2023-10-06T02:25:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.065+0000 7f13a76a3700 1 -- 172.21.15.6:0/2517618626 wait complete. 2023-10-06T02:25:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:25:47.482 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:47.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.605+0000 7fc02f9d2700 1 Processor -- start 2023-10-06T02:25:47.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.606+0000 7fc02f9d2700 1 -- start start 2023-10-06T02:25:47.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.606+0000 7fc02f9d2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc02815b3c0 0x7fc028097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:47.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.606+0000 7fc02f9d2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0280b3c50 0x7fc02815b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:47.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.606+0000 7fc02f9d2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0280afb90 con 0x7fc02815bcd0 2023-10-06T02:25:47.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.606+0000 7fc02f9d2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0280b2310 con 0x7fc0280b3c50 2023-10-06T02:25:47.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.606+0000 7fc02f9d2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0280b25f0 con 0x7fc02815b3c0 2023-10-06T02:25:47.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.607+0000 7fc02cf6d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0280b3c50 0x7fc02815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:47.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.607+0000 7fc02cf6d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0280b3c50 0x7fc02815b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36106/0 (socket says 172.21.15.6:36106) 2023-10-06T02:25:47.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.607+0000 7fc02cf6d700 1 -- 172.21.15.6:0/3645781325 learned_addr learned my addr 172.21.15.6:0/3645781325 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:47.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.607+0000 7fc02d76e700 1 --2- 172.21.15.6:0/3645781325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc02815b3c0 0x7fc028097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:47.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.607+0000 7fc02cf6d700 1 -- 172.21.15.6:0/3645781325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc02815b3c0 msgr2=0x7fc028097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:47.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.607+0000 7fc02cf6d700 1 --2- 172.21.15.6:0/3645781325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc02815b3c0 0x7fc028097d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.607+0000 7fc02cf6d700 1 -- 172.21.15.6:0/3645781325 >> v1:172.21.15.175:6789/0 conn(0x7fc02815bcd0 legacy=0x7fc02815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:47.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.607+0000 7fc02cf6d700 1 -- 172.21.15.6:0/3645781325 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0280af820 con 0x7fc0280b3c50 2023-10-06T02:25:47.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.607+0000 7fc02cf6d700 1 --2- 172.21.15.6:0/3645781325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0280b3c50 0x7fc02815b790 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0099b0 tx=0x7fc01c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90713c6932a7910e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:47.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.607+0000 7fc027fff700 1 -- 172.21.15.6:0/3645781325 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c00b860 con 0x7fc0280b3c50 2023-10-06T02:25:47.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.607+0000 7fc027fff700 1 -- 172.21.15.6:0/3645781325 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c00b9c0 con 0x7fc0280b3c50 2023-10-06T02:25:47.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.607+0000 7fc027fff700 1 -- 172.21.15.6:0/3645781325 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c00bd60 con 0x7fc0280b3c50 2023-10-06T02:25:47.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.608+0000 7fc02f9d2700 1 -- 172.21.15.6:0/3645781325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0280b3c50 msgr2=0x7fc02815b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:47.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.608+0000 7fc02f9d2700 1 --2- 172.21.15.6:0/3645781325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0280b3c50 0x7fc02815b790 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0099b0 tx=0x7fc01c009250 comp rx=0 tx=0).stop 2023-10-06T02:25:47.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.608+0000 7fc02f9d2700 1 -- 172.21.15.6:0/3645781325 shutdown_connections 2023-10-06T02:25:47.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.608+0000 7fc02f9d2700 1 --2- 172.21.15.6:0/3645781325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc02815b3c0 0x7fc028097d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.608+0000 7fc02f9d2700 1 --2- 172.21.15.6:0/3645781325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0280b3c50 0x7fc02815b790 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.608+0000 7fc02f9d2700 1 -- 172.21.15.6:0/3645781325 >> 172.21.15.6:0/3645781325 conn(0x7fc028067910 msgr2=0x7fc0280ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:47.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.608+0000 7fc02f9d2700 1 -- 172.21.15.6:0/3645781325 shutdown_connections 2023-10-06T02:25:47.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.608+0000 7fc02f9d2700 1 -- 172.21.15.6:0/3645781325 wait complete. 2023-10-06T02:25:47.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.609+0000 7fc02f9d2700 1 Processor -- start 2023-10-06T02:25:47.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.609+0000 7fc02f9d2700 1 -- start start 2023-10-06T02:25:47.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02f9d2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0280b3c50 0x7fc0280ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:47.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02f9d2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc02815b3c0 0x7fc028155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:47.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02f9d2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc02815bcd0 0x7fc028099dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:47.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02f9d2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0280a9330 con 0x7fc02815bcd0 2023-10-06T02:25:47.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02f9d2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0280a8fe0 con 0x7fc02815b3c0 2023-10-06T02:25:47.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02f9d2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02806a6f0 con 0x7fc0280b3c50 2023-10-06T02:25:47.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02df6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc02815bcd0 0x7fc028099dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:47.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02df6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc02815bcd0 0x7fc028099dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36110/0 (socket says 172.21.15.6:36110) 2023-10-06T02:25:47.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02df6f700 1 -- 172.21.15.6:0/993091323 learned_addr learned my addr 172.21.15.6:0/993091323 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:47.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02d76e700 1 --2- 172.21.15.6:0/993091323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0280b3c50 0x7fc0280ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:47.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02cf6d700 1 --2- 172.21.15.6:0/993091323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc02815b3c0 0x7fc028155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:47.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02df6f700 1 -- 172.21.15.6:0/993091323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0280b3c50 msgr2=0x7fc0280ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:47.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02df6f700 1 --2- 172.21.15.6:0/993091323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0280b3c50 0x7fc0280ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02df6f700 1 -- 172.21.15.6:0/993091323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc02815b3c0 msgr2=0x7fc028155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:47.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02df6f700 1 --2- 172.21.15.6:0/993091323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc02815b3c0 0x7fc028155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02df6f700 1 -- 172.21.15.6:0/993091323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c0094f0 con 0x7fc02815bcd0 2023-10-06T02:25:47.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02d76e700 1 --2- 172.21.15.6:0/993091323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0280b3c50 0x7fc0280ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:47.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02cf6d700 1 --2- 172.21.15.6:0/993091323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc02815b3c0 0x7fc028155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:47.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.610+0000 7fc02df6f700 1 --2- 172.21.15.6:0/993091323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc02815bcd0 0x7fc028099dc0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fc01800c560 tx=0x7fc018007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:47.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.611+0000 7fc0257fa700 1 -- 172.21.15.6:0/993091323 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018011590 con 0x7fc02815bcd0 2023-10-06T02:25:47.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.611+0000 7fc0257fa700 1 -- 172.21.15.6:0/993091323 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0180116f0 con 0x7fc02815bcd0 2023-10-06T02:25:47.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.611+0000 7fc02f9d2700 1 -- 172.21.15.6:0/993091323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02806a9d0 con 0x7fc02815bcd0 2023-10-06T02:25:47.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.611+0000 7fc0257fa700 1 -- 172.21.15.6:0/993091323 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018011ab0 con 0x7fc02815bcd0 2023-10-06T02:25:47.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.611+0000 7fc02f9d2700 1 -- 172.21.15.6:0/993091323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02806acb0 con 0x7fc02815bcd0 2023-10-06T02:25:47.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.612+0000 7fc02f9d2700 1 -- 172.21.15.6:0/993091323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0280a94a0 con 0x7fc02815bcd0 2023-10-06T02:25:47.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.612+0000 7fc0257fa700 1 -- 172.21.15.6:0/993091323 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc01801b3b0 con 0x7fc02815bcd0 2023-10-06T02:25:47.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.612+0000 7fc0257fa700 1 --2- 172.21.15.6:0/993091323 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc014066f30 0x7fc0140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:47.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.613+0000 7fc0257fa700 1 -- 172.21.15.6:0/993091323 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6980+0+0 (secure 0 0 0) 0x7fc018083f50 con 0x7fc02815bcd0 2023-10-06T02:25:47.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.613+0000 7fc02d76e700 1 --2- 172.21.15.6:0/993091323 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc014066f30 0x7fc0140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:47.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.613+0000 7fc02d76e700 1 --2- 172.21.15.6:0/993091323 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc014066f30 0x7fc0140693e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc020007580 tx=0x7fc020009790 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:47.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.617+0000 7fc0257fa700 1 -- 172.21.15.6:0/993091323 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc018050cc0 con 0x7fc02815bcd0 2023-10-06T02:25:47.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.855+0000 7fc02f9d2700 1 -- 172.21.15.6:0/993091323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc02806e8d0 con 0x7fc02815bcd0 2023-10-06T02:25:47.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.856+0000 7fc0257fa700 1 -- 172.21.15.6:0/993091323 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 133 v133) v1 ==== 95+0+4604 (secure 0 0 0) 0x7fc018017070 con 0x7fc02815bcd0 2023-10-06T02:25:47.856 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:47.857 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":133,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":133,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:47.064152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8328":{"gid":8328,"name":"a","rank":0,"incarnation":133,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/1045457090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1045457090},{"type":"v1","addr":"172.21.15.6:6835","nonce":1045457090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:47.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.857+0000 7fc02f9d2700 1 -- 172.21.15.6:0/993091323 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc014066f30 msgr2=0x7fc0140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:47.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.857+0000 7fc02f9d2700 1 --2- 172.21.15.6:0/993091323 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc014066f30 0x7fc0140693e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc020007580 tx=0x7fc020009790 comp rx=0 tx=0).stop 2023-10-06T02:25:47.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.858+0000 7fc02f9d2700 1 -- 172.21.15.6:0/993091323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc02815bcd0 msgr2=0x7fc028099dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:47.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.858+0000 7fc02f9d2700 1 --2- 172.21.15.6:0/993091323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc02815bcd0 0x7fc028099dc0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fc01800c560 tx=0x7fc018007ef0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.858+0000 7fc02f9d2700 1 -- 172.21.15.6:0/993091323 shutdown_connections 2023-10-06T02:25:47.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.858+0000 7fc02f9d2700 1 --2- 172.21.15.6:0/993091323 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc014066f30 0x7fc0140693e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.858+0000 7fc02f9d2700 1 --2- 172.21.15.6:0/993091323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc02815bcd0 0x7fc028099dc0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.858+0000 7fc02f9d2700 1 --2- 172.21.15.6:0/993091323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0280b3c50 0x7fc0280ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.858+0000 7fc02f9d2700 1 --2- 172.21.15.6:0/993091323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc02815b3c0 0x7fc028155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.858+0000 7fc02f9d2700 1 -- 172.21.15.6:0/993091323 >> 172.21.15.6:0/993091323 conn(0x7fc028067910 msgr2=0x7fc028158c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:47.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.858+0000 7fc02f9d2700 1 -- 172.21.15.6:0/993091323 shutdown_connections 2023-10-06T02:25:47.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:47.858+0000 7fc02f9d2700 1 -- 172.21.15.6:0/993091323 wait complete. 2023-10-06T02:25:47.860 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 133 2023-10-06T02:25:47.870 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 133, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:25:47.064152+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8328}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8328': {'gid': 8328, 'name': 'a', 'rank': 0, 'incarnation': 133, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.6:6835/1045457090', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 1045457090}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 1045457090}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:25:47.870 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8328:up:replay 2023-10-06T02:25:47.871 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2023-10-06T02:25:50.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:25:50.259 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:25:51.063 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:25:51.062+0000 7f99cd275700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:25:53.275 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:53.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.407+0000 7ffaa2d60700 1 Processor -- start 2023-10-06T02:25:53.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.407+0000 7ffaa2d60700 1 -- start start 2023-10-06T02:25:53.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.408+0000 7ffaa2d60700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa9c0af4e0 0x7ffa9c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.408+0000 7ffaa2d60700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffa9c0af8b0 0x7ffa9c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.408+0000 7ffaa2d60700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9c15e190 con 0x7ffa9c15d460 2023-10-06T02:25:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.408+0000 7ffaa2d60700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9c0b1910 con 0x7ffa9c0af8b0 2023-10-06T02:25:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.408+0000 7ffaa2d60700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c15dfb0 con 0x7ffa9c0af4e0 2023-10-06T02:25:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.408+0000 7ffaa12fd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ffa9c15d460 0x7ffa9c15d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47740/0 (socket says 172.21.15.6:47740) 2023-10-06T02:25:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.408+0000 7ffaa12fd700 1 -- 172.21.15.6:0/2174205126 learned_addr learned my addr 172.21.15.6:0/2174205126 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9bfff700 1 --2- 172.21.15.6:0/2174205126 >> v2:172.21.15.175:3300/0 conn(0x7ffa9c0af8b0 0x7ffa9c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffaa0afc700 1 --2- 172.21.15.6:0/2174205126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa9c0af4e0 0x7ffa9c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9b7fe700 1 -- 172.21.15.6:0/2174205126 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356337305 0 0) 0x7ffa9c15e190 con 0x7ffa9c15d460 2023-10-06T02:25:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9b7fe700 1 -- 172.21.15.6:0/2174205126 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa88003570 con 0x7ffa9c15d460 2023-10-06T02:25:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9b7fe700 1 -- 172.21.15.6:0/2174205126 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4116106967 0 0) 0x7ffa88003570 con 0x7ffa9c15d460 2023-10-06T02:25:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9b7fe700 1 -- 172.21.15.6:0/2174205126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa9c0af4e0 msgr2=0x7ffa9c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9b7fe700 1 --2- 172.21.15.6:0/2174205126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa9c0af4e0 0x7ffa9c0b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9b7fe700 1 -- 172.21.15.6:0/2174205126 >> v2:172.21.15.175:3300/0 conn(0x7ffa9c0af8b0 msgr2=0x7ffa9c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9b7fe700 1 --2- 172.21.15.6:0/2174205126 >> v2:172.21.15.175:3300/0 conn(0x7ffa9c0af8b0 0x7ffa9c0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9b7fe700 1 -- 172.21.15.6:0/2174205126 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c0cb650 con 0x7ffa9c15d460 2023-10-06T02:25:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9b7fe700 1 -- 172.21.15.6:0/2174205126 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7ffa84001470 con 0x7ffa9c15d460 2023-10-06T02:25:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9b7fe700 1 -- 172.21.15.6:0/2174205126 >> v1:172.21.15.6:6789/0 conn(0x7ffa9c15d460 legacy=0x7ffa9c15d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9b7fe700 1 --2- 172.21.15.6:0/2174205126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa88003a60 0x7ffa88003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9b7fe700 1 --2- 172.21.15.6:0/2174205126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa88004810 0x7ffa88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9b7fe700 1 --2- 172.21.15.6:0/2174205126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa9c0af4e0 0x7ffa880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9b7fe700 1 -- 172.21.15.6:0/2174205126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0b1910 con 0x7ffa88003a60 2023-10-06T02:25:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9b7fe700 1 -- 172.21.15.6:0/2174205126 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c15dfb0 con 0x7ffa88004810 2023-10-06T02:25:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9b7fe700 1 -- 172.21.15.6:0/2174205126 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8800ba60 con 0x7ffa9c0af4e0 2023-10-06T02:25:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9bfff700 1 --2- 172.21.15.6:0/2174205126 >> v2:172.21.15.175:3300/0 conn(0x7ffa9c0af8b0 0x7ffa9c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:25:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffaa0afc700 1 --2- 172.21.15.6:0/2174205126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa88003a60 0x7ffa88003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffaa12fd700 1 --2- 172.21.15.6:0/2174205126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa9c0af4e0 0x7ffa880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffa9bfff700 1 --2- 172.21.15.6:0/2174205126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa88004810 0x7ffa88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffaa0afc700 1 -- 172.21.15.6:0/2174205126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa9c0af4e0 msgr2=0x7ffa880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffaa0afc700 1 --2- 172.21.15.6:0/2174205126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa9c0af4e0 0x7ffa880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffaa0afc700 1 -- 172.21.15.6:0/2174205126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa88004810 msgr2=0x7ffa88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffaa0afc700 1 --2- 172.21.15.6:0/2174205126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa88004810 0x7ffa88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.409+0000 7ffaa0afc700 1 -- 172.21.15.6:0/2174205126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa88003570 con 0x7ffa88003a60 2023-10-06T02:25:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.410+0000 7ffaa12fd700 1 --2- 172.21.15.6:0/2174205126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa9c0af4e0 0x7ffa880051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.410+0000 7ffaa0afc700 1 --2- 172.21.15.6:0/2174205126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa88003a60 0x7ffa88003e70 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009c10 tx=0x7ffa940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e75136ab6c8c56b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.410+0000 7ffa9b7fe700 1 -- 172.21.15.6:0/2174205126 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400e710 con 0x7ffa88003a60 2023-10-06T02:25:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.410+0000 7ffa9b7fe700 1 -- 172.21.15.6:0/2174205126 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9400e870 con 0x7ffa88003a60 2023-10-06T02:25:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.410+0000 7ffa9b7fe700 1 -- 172.21.15.6:0/2174205126 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400ec30 con 0x7ffa88003a60 2023-10-06T02:25:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.410+0000 7ffaa2d60700 1 -- 172.21.15.6:0/2174205126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa88003a60 msgr2=0x7ffa88003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.410+0000 7ffaa2d60700 1 --2- 172.21.15.6:0/2174205126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa88003a60 0x7ffa88003e70 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009c10 tx=0x7ffa940091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.410+0000 7ffaa12fd700 1 -- 172.21.15.6:0/2174205126 reap_dead start 2023-10-06T02:25:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.410+0000 7ffaa2d60700 1 -- 172.21.15.6:0/2174205126 shutdown_connections 2023-10-06T02:25:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.410+0000 7ffaa2d60700 1 -- 172.21.15.6:0/2174205126 >> 172.21.15.6:0/2174205126 conn(0x7ffa9c068680 msgr2=0x7ffa9c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.410+0000 7ffaa2d60700 1 -- 172.21.15.6:0/2174205126 shutdown_connections 2023-10-06T02:25:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.410+0000 7ffaa2d60700 1 -- 172.21.15.6:0/2174205126 wait complete. 2023-10-06T02:25:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.411+0000 7ffaa2d60700 1 Processor -- start 2023-10-06T02:25:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.412+0000 7ffaa2d60700 1 -- start start 2023-10-06T02:25:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.412+0000 7ffaa2d60700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa88003a60 0x7ffa9c159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.412+0000 7ffaa2d60700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa9c1698a0 0x7ffa9c0c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.412+0000 7ffaa2d60700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa9c0c7840 0x7ffa9c06a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.412+0000 7ffaa2d60700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0a6d20 con 0x7ffa9c1698a0 2023-10-06T02:25:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.412+0000 7ffaa2d60700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0c7d50 con 0x7ffa9c0c7840 2023-10-06T02:25:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.412+0000 7ffaa2d60700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0c8030 con 0x7ffa88003a60 2023-10-06T02:25:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.413+0000 7ffa9bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa9c1698a0 0x7ffa9c0c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.413+0000 7ffa9bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa9c1698a0 0x7ffa9c0c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40836/0 (socket says 172.21.15.6:40836) 2023-10-06T02:25:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.413+0000 7ffa9bfff700 1 -- 172.21.15.6:0/988026221 learned_addr learned my addr 172.21.15.6:0/988026221 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.413+0000 7ffaa0afc700 1 --2- 172.21.15.6:0/988026221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa88003a60 0x7ffa9c159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.413+0000 7ffaa12fd700 1 --2- 172.21.15.6:0/988026221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa9c0c7840 0x7ffa9c06a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.413+0000 7ffa9bfff700 1 -- 172.21.15.6:0/988026221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa88003a60 msgr2=0x7ffa9c159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.413+0000 7ffa9bfff700 1 --2- 172.21.15.6:0/988026221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa88003a60 0x7ffa9c159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.413+0000 7ffa9bfff700 1 -- 172.21.15.6:0/988026221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa9c0c7840 msgr2=0x7ffa9c06a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.413+0000 7ffa9bfff700 1 --2- 172.21.15.6:0/988026221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa9c0c7840 0x7ffa9c06a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.413+0000 7ffa9bfff700 1 -- 172.21.15.6:0/988026221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c0c8310 con 0x7ffa9c1698a0 2023-10-06T02:25:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.413+0000 7ffa9bfff700 1 --2- 172.21.15.6:0/988026221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa9c1698a0 0x7ffa9c0c7300 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c011580 tx=0x7ffa8c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.413+0000 7ffa98ff9700 1 -- 172.21.15.6:0/988026221 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c00e030 con 0x7ffa9c1698a0 2023-10-06T02:25:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.413+0000 7ffa98ff9700 1 -- 172.21.15.6:0/988026221 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8c016680 con 0x7ffa9c1698a0 2023-10-06T02:25:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.413+0000 7ffaa2d60700 1 -- 172.21.15.6:0/988026221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9c0a6f70 con 0x7ffa9c1698a0 2023-10-06T02:25:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.413+0000 7ffa98ff9700 1 -- 172.21.15.6:0/988026221 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c011ee0 con 0x7ffa9c1698a0 2023-10-06T02:25:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.413+0000 7ffaa2d60700 1 -- 172.21.15.6:0/988026221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9c0c91d0 con 0x7ffa9c1698a0 2023-10-06T02:25:53.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.414+0000 7ffaa2d60700 1 -- 172.21.15.6:0/988026221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa9c088aa0 con 0x7ffa9c1698a0 2023-10-06T02:25:53.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.415+0000 7ffa98ff9700 1 -- 172.21.15.6:0/988026221 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa8c016c90 con 0x7ffa9c1698a0 2023-10-06T02:25:53.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.415+0000 7ffa98ff9700 1 --2- 172.21.15.6:0/988026221 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffa7c066f30 0x7ffa7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.415+0000 7ffa98ff9700 1 -- 172.21.15.6:0/988026221 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6980+0+0 (secure 0 0 0) 0x7ffa8c00f070 con 0x7ffa9c1698a0 2023-10-06T02:25:53.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.415+0000 7ffaa0afc700 1 --2- 172.21.15.6:0/988026221 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffa7c066f30 0x7ffa7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.416+0000 7ffaa0afc700 1 --2- 172.21.15.6:0/988026221 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffa7c066f30 0x7ffa7c0693e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ffa940091e0 tx=0x7ffa94019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.420+0000 7ffa98ff9700 1 -- 172.21.15.6:0/988026221 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa8c052970 con 0x7ffa9c1698a0 2023-10-06T02:25:53.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.656+0000 7ffaa2d60700 1 -- 172.21.15.6:0/988026221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa9c0b0910 con 0x7ffa9c1698a0 2023-10-06T02:25:53.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.656+0000 7ffa98ff9700 1 -- 172.21.15.6:0/988026221 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) v1 ==== 95+0+4604 (secure 0 0 0) 0x7ffa8c055f90 con 0x7ffa9c1698a0 2023-10-06T02:25:53.657 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:53.657 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":136,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:50.071970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8328":{"gid":8328,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/1045457090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1045457090},{"type":"v1","addr":"172.21.15.6:6835","nonce":1045457090}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:53.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.658+0000 7ffaa2d60700 1 -- 172.21.15.6:0/988026221 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffa7c066f30 msgr2=0x7ffa7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.658+0000 7ffaa2d60700 1 --2- 172.21.15.6:0/988026221 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffa7c066f30 0x7ffa7c0693e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ffa940091e0 tx=0x7ffa94019000 comp rx=0 tx=0).stop 2023-10-06T02:25:53.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.658+0000 7ffaa2d60700 1 -- 172.21.15.6:0/988026221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa9c1698a0 msgr2=0x7ffa9c0c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.658+0000 7ffaa2d60700 1 --2- 172.21.15.6:0/988026221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa9c1698a0 0x7ffa9c0c7300 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c011580 tx=0x7ffa8c00b040 comp rx=0 tx=0).stop 2023-10-06T02:25:53.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.658+0000 7ffaa2d60700 1 -- 172.21.15.6:0/988026221 shutdown_connections 2023-10-06T02:25:53.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.658+0000 7ffaa2d60700 1 --2- 172.21.15.6:0/988026221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa9c0c7840 0x7ffa9c06a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.658+0000 7ffaa2d60700 1 --2- 172.21.15.6:0/988026221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa88003a60 0x7ffa9c159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.658+0000 7ffaa2d60700 1 --2- 172.21.15.6:0/988026221 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffa7c066f30 0x7ffa7c0693e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.658+0000 7ffaa2d60700 1 --2- 172.21.15.6:0/988026221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa9c1698a0 0x7ffa9c0c7300 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.658+0000 7ffaa2d60700 1 -- 172.21.15.6:0/988026221 >> 172.21.15.6:0/988026221 conn(0x7ffa9c068680 msgr2=0x7ffa9c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.658+0000 7ffaa2d60700 1 -- 172.21.15.6:0/988026221 shutdown_connections 2023-10-06T02:25:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.659+0000 7ffaa2d60700 1 -- 172.21.15.6:0/988026221 wait complete. 2023-10-06T02:25:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 136 2023-10-06T02:25:53.671 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 136, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:25:50.071970+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8328}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8328': {'gid': 8328, 'name': 'a', 'rank': 0, 'incarnation': 133, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.6:6835/1045457090', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 1045457090}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 1045457090}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:25:53.671 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:25:53.671 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:25:53.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.790+0000 7f765c8d6700 1 Processor -- start 2023-10-06T02:25:53.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.790+0000 7f765c8d6700 1 -- start start 2023-10-06T02:25:53.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.791+0000 7f765c8d6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f765815a030 0x7f765815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.791+0000 7f765c8d6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76580afc50 con 0x7f7658087700 2023-10-06T02:25:53.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.791+0000 7f765c8d6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76580aff30 con 0x7f765815a940 2023-10-06T02:25:53.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.791+0000 7f765c8d6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76580b0cf0 con 0x7f765815a030 2023-10-06T02:25:53.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.791+0000 7f765659c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f765815a030 0x7f765815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.791+0000 7f7656d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7658087700 0x7f76580b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47752/0 (socket says 172.21.15.6:47752) 2023-10-06T02:25:53.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.791+0000 7f7656d9d700 1 -- 172.21.15.6:0/3654112778 learned_addr learned my addr 172.21.15.6:0/3654112778 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:53.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.791+0000 7f765659c700 1 --2- 172.21.15.6:0/3654112778 >> v2:172.21.15.6:3300/0 conn(0x7f765815a030 0x7f765815a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40842/0 (socket says 172.21.15.6:40842) 2023-10-06T02:25:53.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.792+0000 7f765659c700 1 -- 172.21.15.6:0/3654112778 >> v1:172.21.15.175:6789/0 conn(0x7f765815a940 legacy=0x7f7658086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.792+0000 7f765659c700 1 -- 172.21.15.6:0/3654112778 >> v1:172.21.15.6:6789/0 conn(0x7f7658087700 legacy=0x7f76580b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.792+0000 7f765659c700 1 -- 172.21.15.6:0/3654112778 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76580b0210 con 0x7f765815a030 2023-10-06T02:25:53.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.792+0000 7f765559a700 1 -- 172.21.15.6:0/3654112778 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137081766 0 0) 0x7f76580afc50 con 0x7f7658087700 2023-10-06T02:25:53.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.792+0000 7f765659c700 1 --2- 172.21.15.6:0/3654112778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f765815a030 0x7f765815a400 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f76480098e0 tx=0x7f76480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e74d33595db1719 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.792+0000 7f765559a700 1 -- 172.21.15.6:0/3654112778 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648009e80 con 0x7f765815a030 2023-10-06T02:25:53.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.792+0000 7f765559a700 1 -- 172.21.15.6:0/3654112778 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764800b820 con 0x7f765815a030 2023-10-06T02:25:53.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.792+0000 7f765559a700 1 -- 172.21.15.6:0/3654112778 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764800bba0 con 0x7f765815a030 2023-10-06T02:25:53.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.792+0000 7f765c8d6700 1 -- 172.21.15.6:0/3654112778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f765815a030 msgr2=0x7f765815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.792+0000 7f765c8d6700 1 --2- 172.21.15.6:0/3654112778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f765815a030 0x7f765815a400 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f76480098e0 tx=0x7f76480091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.793+0000 7f765c8d6700 1 -- 172.21.15.6:0/3654112778 shutdown_connections 2023-10-06T02:25:53.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.793+0000 7f765c8d6700 1 --2- 172.21.15.6:0/3654112778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f765815a030 0x7f765815a400 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.793+0000 7f765c8d6700 1 -- 172.21.15.6:0/3654112778 >> 172.21.15.6:0/3654112778 conn(0x7f7658068680 msgr2=0x7f7658068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:53.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.793+0000 7f765c8d6700 1 -- 172.21.15.6:0/3654112778 shutdown_connections 2023-10-06T02:25:53.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.793+0000 7f765c8d6700 1 -- 172.21.15.6:0/3654112778 wait complete. 2023-10-06T02:25:53.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.794+0000 7f765c8d6700 1 Processor -- start 2023-10-06T02:25:53.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.794+0000 7f765c8d6700 1 -- start start 2023-10-06T02:25:53.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.794+0000 7f765c8d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7658087700 0x7f765815ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.794+0000 7f765c8d6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f765815a030 0x7f76580c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.794+0000 7f765c8d6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f765815a940 0x7f765815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.794+0000 7f765c8d6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765815bf50 con 0x7f7658087700 2023-10-06T02:25:53.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.794+0000 7f765c8d6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765815c3e0 con 0x7f765815a940 2023-10-06T02:25:53.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.794+0000 7f765c8d6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765815b340 con 0x7f765815a030 2023-10-06T02:25:53.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.795+0000 7f765659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7658087700 0x7f765815ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.795+0000 7f765659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7658087700 0x7f765815ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40854/0 (socket says 172.21.15.6:40854) 2023-10-06T02:25:53.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.795+0000 7f765659c700 1 -- 172.21.15.6:0/1339166708 learned_addr learned my addr 172.21.15.6:0/1339166708 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:53.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.795+0000 7f7656d9d700 1 --2- 172.21.15.6:0/1339166708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f765815a940 0x7f765815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.795+0000 7f7655d9b700 1 --2- 172.21.15.6:0/1339166708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f765815a030 0x7f76580c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.795+0000 7f765659c700 1 -- 172.21.15.6:0/1339166708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f765815a030 msgr2=0x7f76580c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.795+0000 7f765659c700 1 --2- 172.21.15.6:0/1339166708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f765815a030 0x7f76580c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.795+0000 7f765659c700 1 -- 172.21.15.6:0/1339166708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f765815a940 msgr2=0x7f765815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.795+0000 7f765659c700 1 --2- 172.21.15.6:0/1339166708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f765815a940 0x7f765815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.795+0000 7f765659c700 1 -- 172.21.15.6:0/1339166708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7648009420 con 0x7f7658087700 2023-10-06T02:25:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.795+0000 7f765659c700 1 --2- 172.21.15.6:0/1339166708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7658087700 0x7f765815ad60 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f76480030c0 tx=0x7f7648016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.795+0000 7f764e7fc700 1 -- 172.21.15.6:0/1339166708 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764800ba10 con 0x7f7658087700 2023-10-06T02:25:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.795+0000 7f764e7fc700 1 -- 172.21.15.6:0/1339166708 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7648020070 con 0x7f7658087700 2023-10-06T02:25:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.795+0000 7f765c8d6700 1 -- 172.21.15.6:0/1339166708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765815b620 con 0x7f7658087700 2023-10-06T02:25:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.795+0000 7f764e7fc700 1 -- 172.21.15.6:0/1339166708 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764801b6a0 con 0x7f7658087700 2023-10-06T02:25:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.795+0000 7f765c8d6700 1 -- 172.21.15.6:0/1339166708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765815bbe0 con 0x7f7658087700 2023-10-06T02:25:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.797+0000 7f764e7fc700 1 -- 172.21.15.6:0/1339166708 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7648022030 con 0x7f7658087700 2023-10-06T02:25:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.797+0000 7f764e7fc700 1 --2- 172.21.15.6:0/1339166708 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7638066f30 0x7f76380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.797+0000 7f764e7fc700 1 -- 172.21.15.6:0/1339166708 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6980+0+0 (secure 0 0 0) 0x7f7648086a50 con 0x7f7658087700 2023-10-06T02:25:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.797+0000 7f7655d9b700 1 --2- 172.21.15.6:0/1339166708 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7638066f30 0x7f76380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.798+0000 7f7655d9b700 1 --2- 172.21.15.6:0/1339166708 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7638066f30 0x7f76380693e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7640006fd0 tx=0x7f7640008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.799+0000 7f7665bceb80 1 Processor -- start 2023-10-06T02:25:53.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.799+0000 7f7665bceb80 1 -- start start 2023-10-06T02:25:53.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.800+0000 7f7665bceb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f5b8840 0x557a3f5b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.800+0000 7f7665bceb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6086c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.800+0000 7f7665bceb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f608c00 0x557a3f609050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.800+0000 7f7665bceb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3f50fa70 con 0x557a3f5b9cc0 2023-10-06T02:25:53.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.800+0000 7f7665bceb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3f50d270 con 0x557a3f5b8840 2023-10-06T02:25:53.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.800+0000 7f7665bceb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a3f509060 con 0x557a3f608c00 2023-10-06T02:25:53.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.800+0000 7f7655d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.800+0000 7f7655d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6086c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40860/0 (socket says 172.21.15.6:40860) 2023-10-06T02:25:53.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.800+0000 7f7655d9b700 1 -- 172.21.15.6:0/3245849530 learned_addr learned my addr 172.21.15.6:0/3245849530 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:53.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.800+0000 7f765659c700 1 --2- 172.21.15.6:0/3245849530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f5b8840 0x557a3f5b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.800+0000 7f7656d9d700 1 --2- 172.21.15.6:0/3245849530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f608c00 0x557a3f609050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.800+0000 7f7655d9b700 1 -- 172.21.15.6:0/3245849530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f608c00 msgr2=0x557a3f609050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.800+0000 7f7655d9b700 1 --2- 172.21.15.6:0/3245849530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f608c00 0x557a3f609050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.800+0000 7f7655d9b700 1 -- 172.21.15.6:0/3245849530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f5b8840 msgr2=0x557a3f5b8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.800+0000 7f7655d9b700 1 --2- 172.21.15.6:0/3245849530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f5b8840 0x557a3f5b8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.800+0000 7f7655d9b700 1 -- 172.21.15.6:0/3245849530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a3f3a3270 con 0x557a3f5b9cc0 2023-10-06T02:25:53.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.800+0000 7f7655d9b700 1 --2- 172.21.15.6:0/3245849530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6086c0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f764000d7f0 tx=0x7f7640012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528f476daef9096f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.801+0000 7f76377fe700 1 -- 172.21.15.6:0/3245849530 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640012630 con 0x557a3f5b9cc0 2023-10-06T02:25:53.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.801+0000 7f76377fe700 1 -- 172.21.15.6:0/3245849530 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7640012790 con 0x557a3f5b9cc0 2023-10-06T02:25:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.801+0000 7f76377fe700 1 -- 172.21.15.6:0/3245849530 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640012b10 con 0x557a3f5b9cc0 2023-10-06T02:25:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.801+0000 7f7665bceb80 1 -- 172.21.15.6:0/3245849530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 msgr2=0x557a3f6086c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.801+0000 7f7665bceb80 1 --2- 172.21.15.6:0/3245849530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6086c0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f764000d7f0 tx=0x7f7640012000 comp rx=0 tx=0).stop 2023-10-06T02:25:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.801+0000 7f7665bceb80 1 -- 172.21.15.6:0/3245849530 shutdown_connections 2023-10-06T02:25:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.801+0000 7f7665bceb80 1 --2- 172.21.15.6:0/3245849530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f608c00 0x557a3f609050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.801+0000 7f7665bceb80 1 --2- 172.21.15.6:0/3245849530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f5b8840 0x557a3f5b8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.801+0000 7f7665bceb80 1 --2- 172.21.15.6:0/3245849530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6086c0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.801+0000 7f7665bceb80 1 -- 172.21.15.6:0/3245849530 >> 172.21.15.6:0/3245849530 conn(0x557a3f5ba160 msgr2=0x557a3f5ba530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.801+0000 7f7665bceb80 1 -- 172.21.15.6:0/3245849530 shutdown_connections 2023-10-06T02:25:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.801+0000 7f7665bceb80 1 -- 172.21.15.6:0/3245849530 wait complete. 2023-10-06T02:25:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.802+0000 7f7665bceb80 1 -- start start 2023-10-06T02:25:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.802+0000 7f7665bceb80 1 Processor -- start 2023-10-06T02:25:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.803+0000 7f7665bceb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f5b8840 0x557a3f5e1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.803+0000 7f7665bceb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f605cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.803+0000 7f7665bceb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f608c00 0x557a3f5fb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.803+0000 7f7665bceb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3f4b4890 con 0x557a3f5b9cc0 2023-10-06T02:25:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.803+0000 7f7665bceb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3f4cfea0 con 0x557a3f5b8840 2023-10-06T02:25:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.803+0000 7f7665bceb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a3f38be30 con 0x557a3f608c00 2023-10-06T02:25:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.803+0000 7f7665bceb80 10 client.0 _ll_register_callbacks cb 0x557a3f57be70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:25:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.803+0000 7f7655d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f605cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.803+0000 7f7655d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f605cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40872/0 (socket says 172.21.15.6:40872) 2023-10-06T02:25:53.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.803+0000 7f7655d9b700 1 -- 172.21.15.6:0/3499135816 learned_addr learned my addr 172.21.15.6:0/3499135816 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:53.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.803+0000 7f765659c700 1 --2- 172.21.15.6:0/3499135816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f5b8840 0x557a3f5e1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.803+0000 7f7656d9d700 1 --2- 172.21.15.6:0/3499135816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f608c00 0x557a3f5fb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.803+0000 7f7655d9b700 1 -- 172.21.15.6:0/3499135816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f608c00 msgr2=0x557a3f5fb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.803+0000 7f7655d9b700 1 --2- 172.21.15.6:0/3499135816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f608c00 0x557a3f5fb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.803+0000 7f7655d9b700 1 -- 172.21.15.6:0/3499135816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f5b8840 msgr2=0x557a3f5e1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.803+0000 7f7655d9b700 1 --2- 172.21.15.6:0/3499135816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f5b8840 0x557a3f5e1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.803+0000 7f7655d9b700 1 -- 172.21.15.6:0/3499135816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764000e040 con 0x557a3f5b9cc0 2023-10-06T02:25:53.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.804+0000 7f7655d9b700 1 --2- 172.21.15.6:0/3499135816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f605cf0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f764000dde0 tx=0x7f7640013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7375858d8351c214 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.804+0000 7f7634ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:25:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.804+0000 7f7634ff9700 1 -- 172.21.15.6:0/3499135816 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640012b50 con 0x557a3f5b9cc0 2023-10-06T02:25:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.804+0000 7f7665bceb80 1 -- 172.21.15.6:0/3499135816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a3f5ad940 con 0x557a3f5b9cc0 2023-10-06T02:25:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.804+0000 7f7634ff9700 1 -- 172.21.15.6:0/3499135816 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 6980+0+0 (secure 0 0 0) 0x7f7640021630 con 0x557a3f5b9cc0 2023-10-06T02:25:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.804+0000 7f7634ff9700 1 -- 172.21.15.6:0/3499135816 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7640021a00 con 0x557a3f5b9cc0 2023-10-06T02:25:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.804+0000 7f7665bceb80 10 client.8385 fetch_fsmap learned FSMap version 136 2023-10-06T02:25:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.804+0000 7f7665bceb80 1 -- 172.21.15.6:0/3499135816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) v3 -- 0x557a3f345fe0 con 0x557a3f5b9cc0 2023-10-06T02:25:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.804+0000 7f7634ff9700 1 -- 172.21.15.6:0/3499135816 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557a3f5ad940 con 0x557a3f5b9cc0 2023-10-06T02:25:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.804+0000 7f7634ff9700 1 -- 172.21.15.6:0/3499135816 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 136) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7640021b60 con 0x557a3f5b9cc0 2023-10-06T02:25:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.804+0000 7f7665bceb80 10 client.8385 fetch_fsmap finished waiting for FSMap version 136 2023-10-06T02:25:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.804+0000 7f7665bceb80 10 client.8385 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:25:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.804+0000 7f7665bceb80 20 client.8385 populate_metadata read hostname 'smithi006' 2023-10-06T02:25:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.804+0000 7f7665bceb80 1 --2- 172.21.15.6:0/3499135816 >> [v2:172.21.15.6:6833/1045457090,v1:172.21.15.6:6835/1045457090] conn(0x557a3f5f7f40 0x557a3f61c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.804+0000 7f7665bceb80 4 client.8385 mds_command: new command op to 8328 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:25:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.804+0000 7f7665bceb80 1 -- 172.21.15.6:0/3499135816 --> [v2:172.21.15.6:6833/1045457090,v1:172.21.15.6:6835/1045457090] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a3f58a870 con 0x557a3f5f7f40 2023-10-06T02:25:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.804+0000 7f765659c700 1 --2- 172.21.15.6:0/3499135816 >> [v2:172.21.15.6:6833/1045457090,v1:172.21.15.6:6835/1045457090] conn(0x557a3f5f7f40 0x557a3f61c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.805+0000 7f7634ff9700 10 client.8385 ms_handle_connect on v2:172.21.15.6:6833/1045457090 2023-10-06T02:25:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.805+0000 7f765659c700 1 --2- 172.21.15.6:0/3499135816 >> [v2:172.21.15.6:6833/1045457090,v1:172.21.15.6:6835/1045457090] conn(0x557a3f5f7f40 0x557a3f61c530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdf0934502e9b0f7 server_cookie=125498df16aea1ea in_seq=0 out_seq=0 2023-10-06T02:25:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.805+0000 7f7634ff9700 1 -- 172.21.15.6:0/3499135816 <== mds.0 v2:172.21.15.6:6833/1045457090 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557a3f58a870 con 0x557a3f5f7f40 2023-10-06T02:25:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.805+0000 7f7634ff9700 10 client.8385 handle_command_reply: tid=0 2023-10-06T02:25:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.805+0000 7f7665bceb80 1 client.8385 shutdown 2023-10-06T02:25:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.805+0000 7f7665bceb80 1 -- 172.21.15.6:0/3499135816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 msgr2=0x557a3f605cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.805+0000 7f7665bceb80 1 --2- 172.21.15.6:0/3499135816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f605cf0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f764000dde0 tx=0x7f7640013000 comp rx=0 tx=0).stop 2023-10-06T02:25:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.805+0000 7f7665bceb80 1 -- 172.21.15.6:0/3499135816 shutdown_connections 2023-10-06T02:25:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.805+0000 7f7665bceb80 1 --2- 172.21.15.6:0/3499135816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f608c00 0x557a3f5fb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.805+0000 7f7665bceb80 1 --2- 172.21.15.6:0/3499135816 >> [v2:172.21.15.6:6833/1045457090,v1:172.21.15.6:6835/1045457090] conn(0x557a3f5f7f40 0x557a3f61c530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.805+0000 7f7665bceb80 1 --2- 172.21.15.6:0/3499135816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f5b8840 0x557a3f5e1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.805+0000 7f7634ff9700 0 client.8385 ms_handle_reset on v2:172.21.15.6:6833/1045457090 2023-10-06T02:25:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.805+0000 7f7665bceb80 1 --2- 172.21.15.6:0/3499135816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f605cf0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.805+0000 7f7665bceb80 1 -- 172.21.15.6:0/3499135816 >> 172.21.15.6:0/3499135816 conn(0x557a3f5ba160 msgr2=0x557a3f5b91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.806+0000 7f7665bceb80 1 -- 172.21.15.6:0/3499135816 shutdown_connections 2023-10-06T02:25:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.806+0000 7f7665bceb80 1 -- 172.21.15.6:0/3499135816 wait complete. 2023-10-06T02:25:53.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.806+0000 7f7665bceb80 20 client.8385 trim_cache size 0 max 16384 2023-10-06T02:25:53.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.823+0000 7f7665bceb80 1 Processor -- start 2023-10-06T02:25:53.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.823+0000 7f7665bceb80 1 -- start start 2023-10-06T02:25:53.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.823+0000 7f7665bceb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f5b8840 0x557a3f602170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.823+0000 7f7665bceb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6026b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.823+0000 7f7665bceb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f608c00 0x557a3f5e07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.823+0000 7f7665bceb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3f5e8bd0 con 0x557a3f5b9cc0 2023-10-06T02:25:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.823+0000 7f7665bceb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3f5ba5d0 con 0x557a3f5b8840 2023-10-06T02:25:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.823+0000 7f7665bceb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a3f5fb760 con 0x557a3f608c00 2023-10-06T02:25:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.823+0000 7f7655d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6026b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.823+0000 7f7655d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6026b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40886/0 (socket says 172.21.15.6:40886) 2023-10-06T02:25:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.823+0000 7f7655d9b700 1 -- 172.21.15.6:0/684576277 learned_addr learned my addr 172.21.15.6:0/684576277 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.824+0000 7f7656d9d700 1 --2- 172.21.15.6:0/684576277 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f608c00 0x557a3f5e07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.824+0000 7f765659c700 1 --2- 172.21.15.6:0/684576277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f5b8840 0x557a3f602170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.824+0000 7f7655d9b700 1 -- 172.21.15.6:0/684576277 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f608c00 msgr2=0x557a3f5e07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.824+0000 7f7655d9b700 1 --2- 172.21.15.6:0/684576277 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f608c00 0x557a3f5e07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.824+0000 7f7655d9b700 1 -- 172.21.15.6:0/684576277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f5b8840 msgr2=0x557a3f602170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.824+0000 7f7655d9b700 1 --2- 172.21.15.6:0/684576277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f5b8840 0x557a3f602170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.824+0000 7f7655d9b700 1 -- 172.21.15.6:0/684576277 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a3f4d7780 con 0x557a3f5b9cc0 2023-10-06T02:25:53.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.824+0000 7f765659c700 1 --2- 172.21.15.6:0/684576277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f5b8840 0x557a3f602170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:53.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.824+0000 7f7656d9d700 1 --2- 172.21.15.6:0/684576277 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f608c00 0x557a3f5e07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:53.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.824+0000 7f7655d9b700 1 --2- 172.21.15.6:0/684576277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6026b0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f76400092b0 tx=0x7f764002b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c234dc8c3026bc2a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.824+0000 7f7637fff700 1 -- 172.21.15.6:0/684576277 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640021630 con 0x557a3f5b9cc0 2023-10-06T02:25:53.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.824+0000 7f7637fff700 1 -- 172.21.15.6:0/684576277 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7640012420 con 0x557a3f5b9cc0 2023-10-06T02:25:53.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.824+0000 7f7637fff700 1 -- 172.21.15.6:0/684576277 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640012b90 con 0x557a3f5b9cc0 2023-10-06T02:25:53.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.825+0000 7f7665bceb80 1 -- 172.21.15.6:0/684576277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 msgr2=0x557a3f6026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.825+0000 7f7665bceb80 1 --2- 172.21.15.6:0/684576277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6026b0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f76400092b0 tx=0x7f764002b000 comp rx=0 tx=0).stop 2023-10-06T02:25:53.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.825+0000 7f7665bceb80 1 -- 172.21.15.6:0/684576277 shutdown_connections 2023-10-06T02:25:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.825+0000 7f7665bceb80 1 --2- 172.21.15.6:0/684576277 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f608c00 0x557a3f5e07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.825+0000 7f7665bceb80 1 --2- 172.21.15.6:0/684576277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f5b8840 0x557a3f602170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.825+0000 7f7665bceb80 1 --2- 172.21.15.6:0/684576277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6026b0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.825+0000 7f7665bceb80 1 -- 172.21.15.6:0/684576277 >> 172.21.15.6:0/684576277 conn(0x557a3f5ba160 msgr2=0x557a3f5b91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.825+0000 7f7665bceb80 1 -- 172.21.15.6:0/684576277 shutdown_connections 2023-10-06T02:25:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.825+0000 7f7665bceb80 1 -- 172.21.15.6:0/684576277 wait complete. 2023-10-06T02:25:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.825+0000 7f7665bceb80 1 -- start start 2023-10-06T02:25:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.825+0000 7f7665bceb80 1 Processor -- start 2023-10-06T02:25:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.826+0000 7f7665bceb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f5b8840 0x557a3f5b92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.826+0000 7f7665bceb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6025b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.826+0000 7f7665bceb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f608c00 0x557a3f664a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.826+0000 7f7665bceb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3f664650 con 0x557a3f5b9cc0 2023-10-06T02:25:53.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.826+0000 7f7665bceb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3f602af0 con 0x557a3f608c00 2023-10-06T02:25:53.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.826+0000 7f7665bceb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a3f5e4250 con 0x557a3f5b8840 2023-10-06T02:25:53.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.826+0000 7f7665bceb80 10 client.0 _ll_register_callbacks cb 0x557a3f57be70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:25:53.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.826+0000 7f7655d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.826+0000 7f7655d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6025b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40892/0 (socket says 172.21.15.6:40892) 2023-10-06T02:25:53.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.826+0000 7f7655d9b700 1 -- 172.21.15.6:0/1800559109 learned_addr learned my addr 172.21.15.6:0/1800559109 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:53.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.826+0000 7f765659c700 1 --2- 172.21.15.6:0/1800559109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f5b8840 0x557a3f5b92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.826+0000 7f7656d9d700 1 --2- 172.21.15.6:0/1800559109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f608c00 0x557a3f664a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.826+0000 7f7655d9b700 1 -- 172.21.15.6:0/1800559109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f5b8840 msgr2=0x557a3f5b92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.826+0000 7f7655d9b700 1 --2- 172.21.15.6:0/1800559109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f5b8840 0x557a3f5b92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7655d9b700 1 -- 172.21.15.6:0/1800559109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f608c00 msgr2=0x557a3f664a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7655d9b700 1 --2- 172.21.15.6:0/1800559109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f608c00 0x557a3f664a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7655d9b700 1 -- 172.21.15.6:0/1800559109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a3f345fe0 con 0x557a3f5b9cc0 2023-10-06T02:25:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f765659c700 1 --2- 172.21.15.6:0/1800559109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f5b8840 0x557a3f5b92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7656d9d700 1 --2- 172.21.15.6:0/1800559109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f608c00 0x557a3f664a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7655d9b700 1 --2- 172.21.15.6:0/1800559109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6025b0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f764000d7f0 tx=0x7f764002e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0bc1f29da5db27 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7634ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:25:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7634ff9700 1 -- 172.21.15.6:0/1800559109 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640012900 con 0x557a3f5b9cc0 2023-10-06T02:25:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7634ff9700 1 -- 172.21.15.6:0/1800559109 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 6980+0+0 (secure 0 0 0) 0x7f7640012a60 con 0x557a3f5b9cc0 2023-10-06T02:25:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7665bceb80 1 -- 172.21.15.6:0/1800559109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7640012790 con 0x557a3f5b9cc0 2023-10-06T02:25:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7634ff9700 1 -- 172.21.15.6:0/1800559109 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7640005b10 con 0x557a3f5b9cc0 2023-10-06T02:25:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7665bceb80 10 client.8391 fetch_fsmap learned FSMap version 136 2023-10-06T02:25:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7665bceb80 1 -- 172.21.15.6:0/1800559109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) v3 -- 0x557a3f4be470 con 0x557a3f5b9cc0 2023-10-06T02:25:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7634ff9700 1 -- 172.21.15.6:0/1800559109 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7640012790 con 0x557a3f5b9cc0 2023-10-06T02:25:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7634ff9700 1 -- 172.21.15.6:0/1800559109 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 136) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7640005e60 con 0x557a3f5b9cc0 2023-10-06T02:25:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7665bceb80 10 client.8391 fetch_fsmap finished waiting for FSMap version 136 2023-10-06T02:25:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7665bceb80 10 client.8391 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:25:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7665bceb80 20 client.8391 populate_metadata read hostname 'smithi006' 2023-10-06T02:25:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7665bceb80 1 --2- 172.21.15.6:0/1800559109 >> [v2:172.21.15.6:6833/1045457090,v1:172.21.15.6:6835/1045457090] conn(0x557a3f6650c0 0x557a3f602e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7665bceb80 4 client.8391 mds_command: new command op to 8328 tid=0[{"prefix": "status"}] 2023-10-06T02:25:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f7665bceb80 1 -- 172.21.15.6:0/1800559109 --> [v2:172.21.15.6:6833/1045457090,v1:172.21.15.6:6835/1045457090] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557a3f4abe00 con 0x557a3f6650c0 2023-10-06T02:25:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.827+0000 7f765659c700 1 --2- 172.21.15.6:0/1800559109 >> [v2:172.21.15.6:6833/1045457090,v1:172.21.15.6:6835/1045457090] conn(0x557a3f6650c0 0x557a3f602e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.828+0000 7f7634ff9700 10 client.8391 ms_handle_connect on v2:172.21.15.6:6833/1045457090 2023-10-06T02:25:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.828+0000 7f765659c700 1 --2- 172.21.15.6:0/1800559109 >> [v2:172.21.15.6:6833/1045457090,v1:172.21.15.6:6835/1045457090] conn(0x557a3f6650c0 0x557a3f602e80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c95e1c5f5dcfacd server_cookie=c609ffc85ccaa370 in_seq=0 out_seq=0 2023-10-06T02:25:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.828+0000 7f7634ff9700 1 -- 172.21.15.6:0/1800559109 <== mds.0 v2:172.21.15.6:6833/1045457090 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x557a3f4abe00 con 0x557a3f6650c0 2023-10-06T02:25:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.828+0000 7f7634ff9700 10 client.8391 handle_command_reply: tid=0 2023-10-06T02:25:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.828+0000 7f7665bceb80 1 client.8391 shutdown 2023-10-06T02:25:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.828+0000 7f7665bceb80 1 -- 172.21.15.6:0/1800559109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 msgr2=0x557a3f6025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.828+0000 7f7665bceb80 1 --2- 172.21.15.6:0/1800559109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6025b0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f764000d7f0 tx=0x7f764002e050 comp rx=0 tx=0).stop 2023-10-06T02:25:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.828+0000 7f7665bceb80 1 -- 172.21.15.6:0/1800559109 shutdown_connections 2023-10-06T02:25:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.828+0000 7f7665bceb80 1 --2- 172.21.15.6:0/1800559109 >> [v2:172.21.15.6:6833/1045457090,v1:172.21.15.6:6835/1045457090] conn(0x557a3f6650c0 0x557a3f602e80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.828+0000 7f7665bceb80 1 --2- 172.21.15.6:0/1800559109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a3f608c00 0x557a3f664a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.828+0000 7f7665bceb80 1 --2- 172.21.15.6:0/1800559109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557a3f5b8840 0x557a3f5b92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.828+0000 7f7665bceb80 1 --2- 172.21.15.6:0/1800559109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a3f5b9cc0 0x557a3f6025b0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.828+0000 7f7634ff9700 0 client.8391 ms_handle_reset on v2:172.21.15.6:6833/1045457090 2023-10-06T02:25:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.828+0000 7f7665bceb80 1 -- 172.21.15.6:0/1800559109 >> 172.21.15.6:0/1800559109 conn(0x557a3f5ba160 msgr2=0x557a3f604780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.828+0000 7f7665bceb80 1 -- 172.21.15.6:0/1800559109 shutdown_connections 2023-10-06T02:25:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.828+0000 7f7665bceb80 1 -- 172.21.15.6:0/1800559109 wait complete. 2023-10-06T02:25:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.828+0000 7f7665bceb80 20 client.8391 trim_cache size 0 max 16384 2023-10-06T02:25:53.841 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:25:53.841 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:25:53.841 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:25:53.841 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 8328, 2023-10-06T02:25:53.841 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:25:53.841 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:25:53.841 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:25:53.842 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 6.7631912109999996, 2023-10-06T02:25:53.842 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 136, 2023-10-06T02:25:53.842 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 102, 2023-10-06T02:25:53.842 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 102, 2023-10-06T02:25:53.842 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 8.7456411880000005 2023-10-06T02:25:53.842 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:25:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.829+0000 7f765c8d6700 1 -- 172.21.15.6:0/1339166708 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7638066f30 msgr2=0x7f76380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.829+0000 7f765c8d6700 1 --2- 172.21.15.6:0/1339166708 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7638066f30 0x7f76380693e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7640006fd0 tx=0x7f7640008040 comp rx=0 tx=0).stop 2023-10-06T02:25:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.829+0000 7f765c8d6700 1 -- 172.21.15.6:0/1339166708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7658087700 msgr2=0x7f765815ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.829+0000 7f765c8d6700 1 --2- 172.21.15.6:0/1339166708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7658087700 0x7f765815ad60 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f76480030c0 tx=0x7f7648016000 comp rx=0 tx=0).stop 2023-10-06T02:25:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.829+0000 7f765c8d6700 1 -- 172.21.15.6:0/1339166708 shutdown_connections 2023-10-06T02:25:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.829+0000 7f765c8d6700 1 --2- 172.21.15.6:0/1339166708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f765815a940 0x7f765815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.829+0000 7f765c8d6700 1 --2- 172.21.15.6:0/1339166708 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7638066f30 0x7f76380693e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.829+0000 7f765c8d6700 1 --2- 172.21.15.6:0/1339166708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7658087700 0x7f765815ad60 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.829+0000 7f765c8d6700 1 --2- 172.21.15.6:0/1339166708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f765815a030 0x7f76580c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.829+0000 7f765c8d6700 1 -- 172.21.15.6:0/1339166708 >> 172.21.15.6:0/1339166708 conn(0x7f7658068680 msgr2=0x7f7658086ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.829+0000 7f765c8d6700 1 -- 172.21.15.6:0/1339166708 shutdown_connections 2023-10-06T02:25:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.829+0000 7f765c8d6700 1 -- 172.21.15.6:0/1339166708 wait complete. 2023-10-06T02:25:53.845 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:25:53.845 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Delete 500.00000000', proceeding to ls 2023-10-06T02:25:53.845 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:25:53.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.964+0000 7fd54b1ef700 1 Processor -- start 2023-10-06T02:25:53.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.964+0000 7fd54b1ef700 1 -- start start 2023-10-06T02:25:53.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd54b1ef700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd544153a10 0x7fd5440cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd54b1ef700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5440cf870 0x7fd5440cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd54b1ef700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd5440d03d0 0x7fd54415abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd54b1ef700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd544069140 con 0x7fd5440cf870 2023-10-06T02:25:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd54b1ef700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5440ceea0 con 0x7fd5440d03d0 2023-10-06T02:25:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd54b1ef700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5440d07f0 con 0x7fd544153a10 2023-10-06T02:25:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd5499ec700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5440cf870 0x7fd5440cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd5499ec700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5440cf870 0x7fd5440cfe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40900/0 (socket says 172.21.15.6:40900) 2023-10-06T02:25:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd5499ec700 1 -- 172.21.15.6:0/1782506117 learned_addr learned my addr 172.21.15.6:0/1782506117 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd54a9ee700 1 --2- 172.21.15.6:0/1782506117 >> v2:172.21.15.175:3300/0 conn(0x7fd5440d03d0 0x7fd54415abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd54a1ed700 1 --2- 172.21.15.6:0/1782506117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd544153a10 0x7fd5440cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd5499ec700 1 -- 172.21.15.6:0/1782506117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd544153a10 msgr2=0x7fd5440cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd5499ec700 1 --2- 172.21.15.6:0/1782506117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd544153a10 0x7fd5440cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd5499ec700 1 -- 172.21.15.6:0/1782506117 >> v2:172.21.15.175:3300/0 conn(0x7fd5440d03d0 msgr2=0x7fd54415abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd5499ec700 1 --2- 172.21.15.6:0/1782506117 >> v2:172.21.15.175:3300/0 conn(0x7fd5440d03d0 0x7fd54415abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd5499ec700 1 -- 172.21.15.6:0/1782506117 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54415a690 con 0x7fd5440cf870 2023-10-06T02:25:53.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd5499ec700 1 --2- 172.21.15.6:0/1782506117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5440cf870 0x7fd5440cfe90 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fd5440d11c0 tx=0x7fd538009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53db8617931425e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd5491eb700 1 -- 172.21.15.6:0/1782506117 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53800b860 con 0x7fd5440cf870 2023-10-06T02:25:53.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd5491eb700 1 -- 172.21.15.6:0/1782506117 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53800b9c0 con 0x7fd5440cf870 2023-10-06T02:25:53.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.965+0000 7fd5491eb700 1 -- 172.21.15.6:0/1782506117 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53800bd60 con 0x7fd5440cf870 2023-10-06T02:25:53.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.966+0000 7fd54b1ef700 1 -- 172.21.15.6:0/1782506117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5440cf870 msgr2=0x7fd5440cfe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.966+0000 7fd54b1ef700 1 --2- 172.21.15.6:0/1782506117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5440cf870 0x7fd5440cfe90 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fd5440d11c0 tx=0x7fd538009250 comp rx=0 tx=0).stop 2023-10-06T02:25:53.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.966+0000 7fd54b1ef700 1 -- 172.21.15.6:0/1782506117 shutdown_connections 2023-10-06T02:25:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.966+0000 7fd54b1ef700 1 --2- 172.21.15.6:0/1782506117 >> v2:172.21.15.175:3300/0 conn(0x7fd5440d03d0 0x7fd54415abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.966+0000 7fd54b1ef700 1 --2- 172.21.15.6:0/1782506117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd544153a10 0x7fd5440cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.966+0000 7fd54b1ef700 1 --2- 172.21.15.6:0/1782506117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5440cf870 0x7fd5440cfe90 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.966+0000 7fd54b1ef700 1 -- 172.21.15.6:0/1782506117 >> 172.21.15.6:0/1782506117 conn(0x7fd54406ac00 msgr2=0x7fd544068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.966+0000 7fd54b1ef700 1 -- 172.21.15.6:0/1782506117 shutdown_connections 2023-10-06T02:25:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.966+0000 7fd54b1ef700 1 -- 172.21.15.6:0/1782506117 wait complete. 2023-10-06T02:25:53.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.967+0000 7fd54b1ef700 1 Processor -- start 2023-10-06T02:25:53.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.967+0000 7fd54b1ef700 1 -- start start 2023-10-06T02:25:53.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.968+0000 7fd54b1ef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5440cf870 0x7fd544156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.968+0000 7fd54b1ef700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5440d03d0 0x7fd544141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.968+0000 7fd54b1ef700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd544153a10 0x7fd54416a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.968+0000 7fd54b1ef700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54416aa20 con 0x7fd5440cf870 2023-10-06T02:25:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.968+0000 7fd54b1ef700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54416bc00 con 0x7fd544153a10 2023-10-06T02:25:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.968+0000 7fd54b1ef700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54416aff0 con 0x7fd5440d03d0 2023-10-06T02:25:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.968+0000 7fd54a1ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5440cf870 0x7fd544156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.968+0000 7fd54a1ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5440cf870 0x7fd544156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40912/0 (socket says 172.21.15.6:40912) 2023-10-06T02:25:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.968+0000 7fd54a1ed700 1 -- 172.21.15.6:0/3400726403 learned_addr learned my addr 172.21.15.6:0/3400726403 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.968+0000 7fd54a9ee700 1 --2- 172.21.15.6:0/3400726403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd544153a10 0x7fd54416a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.968+0000 7fd5499ec700 1 --2- 172.21.15.6:0/3400726403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5440d03d0 0x7fd544141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.968+0000 7fd54a1ed700 1 -- 172.21.15.6:0/3400726403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5440d03d0 msgr2=0x7fd544141cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.968+0000 7fd54a1ed700 1 --2- 172.21.15.6:0/3400726403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5440d03d0 0x7fd544141cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.968+0000 7fd54a1ed700 1 -- 172.21.15.6:0/3400726403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd544153a10 msgr2=0x7fd54416a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.968+0000 7fd54a1ed700 1 --2- 172.21.15.6:0/3400726403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd544153a10 0x7fd54416a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.968+0000 7fd54a1ed700 1 -- 172.21.15.6:0/3400726403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5380094f0 con 0x7fd5440cf870 2023-10-06T02:25:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.969+0000 7fd54a1ed700 1 --2- 172.21.15.6:0/3400726403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5440cf870 0x7fd544156000 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fd53c009fa0 tx=0x7fd53c009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.969+0000 7fd5427fc700 1 -- 172.21.15.6:0/3400726403 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00ed20 con 0x7fd5440cf870 2023-10-06T02:25:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.969+0000 7fd5427fc700 1 -- 172.21.15.6:0/3400726403 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c00ee80 con 0x7fd5440cf870 2023-10-06T02:25:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.969+0000 7fd54b1ef700 1 -- 172.21.15.6:0/3400726403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54416b2d0 con 0x7fd5440cf870 2023-10-06T02:25:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.969+0000 7fd5427fc700 1 -- 172.21.15.6:0/3400726403 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c014670 con 0x7fd5440cf870 2023-10-06T02:25:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.969+0000 7fd54b1ef700 1 -- 172.21.15.6:0/3400726403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54416b890 con 0x7fd5440cf870 2023-10-06T02:25:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.970+0000 7fd54b1ef700 1 -- 172.21.15.6:0/3400726403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54416ba20 con 0x7fd5440cf870 2023-10-06T02:25:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.970+0000 7fd5427fc700 1 -- 172.21.15.6:0/3400726403 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd53c0149e0 con 0x7fd5440cf870 2023-10-06T02:25:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.971+0000 7fd5427fc700 1 --2- 172.21.15.6:0/3400726403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd530066f30 0x7fd5300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.971+0000 7fd5427fc700 1 -- 172.21.15.6:0/3400726403 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6980+0+0 (secure 0 0 0) 0x7fd53c0851b0 con 0x7fd5440cf870 2023-10-06T02:25:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.971+0000 7fd5499ec700 1 --2- 172.21.15.6:0/3400726403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd530066f30 0x7fd5300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.971+0000 7fd5499ec700 1 --2- 172.21.15.6:0/3400726403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd530066f30 0x7fd5300693e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd5440d11c0 tx=0x7fd538017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:53.975+0000 7fd5427fc700 1 -- 172.21.15.6:0/3400726403 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd53c051f20 con 0x7fd5440cf870 2023-10-06T02:25:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:54.219+0000 7fd54b1ef700 1 -- 172.21.15.6:0/3400726403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd54415a970 con 0x7fd5440cf870 2023-10-06T02:25:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:54.219+0000 7fd5427fc700 1 -- 172.21.15.6:0/3400726403 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v136) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd53c0099c0 con 0x7fd5440cf870 2023-10-06T02:25:54.220 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:25:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:54.221+0000 7fd54b1ef700 1 -- 172.21.15.6:0/3400726403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd530066f30 msgr2=0x7fd5300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:54.221+0000 7fd54b1ef700 1 --2- 172.21.15.6:0/3400726403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd530066f30 0x7fd5300693e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd5440d11c0 tx=0x7fd538017000 comp rx=0 tx=0).stop 2023-10-06T02:25:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:54.221+0000 7fd54b1ef700 1 -- 172.21.15.6:0/3400726403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5440cf870 msgr2=0x7fd544156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:54.221+0000 7fd54b1ef700 1 --2- 172.21.15.6:0/3400726403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5440cf870 0x7fd544156000 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fd53c009fa0 tx=0x7fd53c009880 comp rx=0 tx=0).stop 2023-10-06T02:25:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:54.221+0000 7fd54b1ef700 1 -- 172.21.15.6:0/3400726403 shutdown_connections 2023-10-06T02:25:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:54.221+0000 7fd54b1ef700 1 --2- 172.21.15.6:0/3400726403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd544153a10 0x7fd54416a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:54.221+0000 7fd54b1ef700 1 --2- 172.21.15.6:0/3400726403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd530066f30 0x7fd5300693e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:54.221+0000 7fd54b1ef700 1 --2- 172.21.15.6:0/3400726403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5440cf870 0x7fd544156000 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:54.221+0000 7fd54b1ef700 1 --2- 172.21.15.6:0/3400726403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5440d03d0 0x7fd544141cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:54.221+0000 7fd54b1ef700 1 -- 172.21.15.6:0/3400726403 >> 172.21.15.6:0/3400726403 conn(0x7fd54406ac00 msgr2=0x7fd5441520f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:54.221+0000 7fd54b1ef700 1 -- 172.21.15.6:0/3400726403 shutdown_connections 2023-10-06T02:25:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:54.221+0000 7fd54b1ef700 1 -- 172.21.15.6:0/3400726403 wait complete. 2023-10-06T02:25:54.234 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:25:54.234 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:25:54.234 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:25:54.234 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:25:54.235 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:54.235 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:25:54.235 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:25:54.235 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:25:54.235 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:25:54.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:54.236 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:25:54.253 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:25:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:25:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:25:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:25:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:54.254 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:25:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:25:54.254 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:25:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:25:54.255 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:25:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:25:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:25:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41992sec preferred_lft 41992sec 2023-10-06T02:25:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:25:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:54.256 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:25:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:25:54.257 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:25:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:25:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:25:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:54.258 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:25:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:25:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:25:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:54.258 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:25:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:25:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:25:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:54.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:54.260 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:25:54.317 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:25:54.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:54.319 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:25:54.375 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:25:54.375 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:25:54.375 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:25:54.375 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:25:54.375 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:25:54.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:54.376 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:25:54.376 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:25:54.376 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:25:54.376 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:25:54.376 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:25:54.376 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:25:54.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:54.477 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:25:54.492 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:25:54.492 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:25:54.493 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:25:54.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:54.493 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:25:54.558 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:25:54.558 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:25:54.558 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:54.613 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:25:54.614 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:25:54.614 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:54.668 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:25:54.733 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:25:54.734 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:25:54.798 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:25:54.799 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:25:54.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:54.800 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:25:54.856 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:25:54.856 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:25:54.899 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:25:54.923 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:25:54.924 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:25:54.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:25:54.981+0000 7f17db389540 -1 init, newargv = 0x55cb3b9caf40 newargc=15 2023-10-06T02:25:54.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[127952]: starting ceph client 2023-10-06T02:25:54.986 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[127952]: starting fuse 2023-10-06T02:25:54.990 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:25:54.991 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:25:54.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:54.991 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:25:55.046 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:25:55.047 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:25:55.049 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:25:55.049 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:25:55.050 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:25:55.050 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:25:55.050 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:25:55.050 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:25:55.050 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:25:55.050 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:25:55.050 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:25:55.050 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:25:55.050 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:25:55.050 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:25:55.050 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:25:55.050 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:25:55.051 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:25:55.051 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:25:55.051 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:25:55.051 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:25:55.051 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:25:55.051 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:25:55.051 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:25:55.051 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:25:55.051 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:25:55.051 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:25:55.051 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:25:55.051 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:25:55.052 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:25:55.170 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.127952.asok 2023-10-06T02:25:55.352 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.127952.asok 2023-10-06T02:25:55.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:55.353 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.127952.asok status 2023-10-06T02:25:55.506 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:25:55.507 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:25:55.507 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:25:55.507 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:25:55.507 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:25:55.507 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:25:55.507 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:25:55.507 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "127952", 2023-10-06T02:25:55.507 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:25:55.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:25:55.507 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:25:55.508 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:25:55.508 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 8406, 2023-10-06T02:25:55.508 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:25:55.508 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:25:55.508 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:25:55.508 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 8406 2023-10-06T02:25:55.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:25:55.508 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:25:55.508 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:25:55.508 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:25:55.508 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3997396675 2023-10-06T02:25:55.508 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:25:55.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:25:55.509 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:25:55.509 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:25:55.509 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:25:55.509 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3997396675 2023-10-06T02:25:55.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:25:55.509 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.8406 192.168.0.1:0/3997396675", 2023-10-06T02:25:55.509 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/3997396675", 2023-10-06T02:25:55.509 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:25:55.509 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 136, 2023-10-06T02:25:55.509 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 102, 2023-10-06T02:25:55.509 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:25:55.509 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:25:55.510 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:25:55.510 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:25:55.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:55.517 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:25:55.517 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:55.532 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:25:55.533 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:55.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:55.533 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:55.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:25:55.597 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2023-10-06T02:25:55.640 INFO:teuthology.orchestra.run:waiting for 20 2023-10-06T02:25:55.657 INFO:teuthology.orchestra.run.smithi006.stdout:.: 2023-10-06T02:25:55.657 INFO:teuthology.orchestra.run.smithi006.stdout:subdir 2023-10-06T02:25:55.657 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:55.657 INFO:teuthology.orchestra.run.smithi006.stdout:./subdir: 2023-10-06T02:25:55.657 INFO:teuthology.orchestra.run.smithi006.stdout:sixmegs 2023-10-06T02:25:55.657 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 500.00000000' did not caused DAMAGED state 2023-10-06T02:25:55.657 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete mds_snaptable' 2023-10-06T02:25:55.658 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:25:55.658 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:25:55.658 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:55.732 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:25:55.732 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:25:55.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:55.732 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:25:55.788 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:25:55.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.947+0000 7fba41d8a700 1 Processor -- start 2023-10-06T02:25:55.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.947+0000 7fba41d8a700 1 -- start start 2023-10-06T02:25:55.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.948+0000 7fba41d8a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fba3c0d0400 0x7fba3c0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:55.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.948+0000 7fba41d8a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba3c0ccd40 0x7fba3c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:55.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.948+0000 7fba41d8a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba3c0b6170 con 0x7fba3c0cf7e0 2023-10-06T02:25:55.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.948+0000 7fba41d8a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba3c15dd40 con 0x7fba3c0ccd40 2023-10-06T02:25:55.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.948+0000 7fba41d8a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba3c15e020 con 0x7fba3c0d0400 2023-10-06T02:25:55.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.948+0000 7fba3affd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba3c0ccd40 0x7fba3c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.948+0000 7fba3bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fba3c0cf7e0 0x7fba3c0b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47758/0 (socket says 172.21.15.6:47758) 2023-10-06T02:25:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.948+0000 7fba3bfff700 1 -- 172.21.15.6:0/3506712455 learned_addr learned my addr 172.21.15.6:0/3506712455 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.948+0000 7fba3affd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba3c0ccd40 0x7fba3c0cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40928/0 (socket says 172.21.15.6:40928) 2023-10-06T02:25:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.949+0000 7fba3b7fe700 1 --2- 172.21.15.6:0/3506712455 >> v2:172.21.15.175:3300/0 conn(0x7fba3c0d0400 0x7fba3c0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.949+0000 7fba3affd700 1 -- 172.21.15.6:0/3506712455 >> v2:172.21.15.175:3300/0 conn(0x7fba3c0d0400 msgr2=0x7fba3c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.949+0000 7fba3affd700 1 --2- 172.21.15.6:0/3506712455 >> v2:172.21.15.175:3300/0 conn(0x7fba3c0d0400 0x7fba3c0b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.949+0000 7fba3affd700 1 -- 172.21.15.6:0/3506712455 >> v1:172.21.15.6:6789/0 conn(0x7fba3c0cf7e0 legacy=0x7fba3c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.949+0000 7fba3affd700 1 -- 172.21.15.6:0/3506712455 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c0ceaa0 con 0x7fba3c0ccd40 2023-10-06T02:25:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.949+0000 7fba3a7fc700 1 -- 172.21.15.6:0/3506712455 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262844795 0 0) 0x7fba3c0b6170 con 0x7fba3c0cf7e0 2023-10-06T02:25:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.949+0000 7fba3affd700 1 --2- 172.21.15.6:0/3506712455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba3c0ccd40 0x7fba3c0cf2a0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fba3c088f30 tx=0x7fba300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f878d567a825b912 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.949+0000 7fba3a7fc700 1 -- 172.21.15.6:0/3506712455 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3000b6b0 con 0x7fba3c0ccd40 2023-10-06T02:25:55.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.949+0000 7fba3a7fc700 1 -- 172.21.15.6:0/3506712455 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3000b810 con 0x7fba3c0ccd40 2023-10-06T02:25:55.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.949+0000 7fba3a7fc700 1 -- 172.21.15.6:0/3506712455 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3000bbb0 con 0x7fba3c0ccd40 2023-10-06T02:25:55.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.950+0000 7fba41d8a700 1 -- 172.21.15.6:0/3506712455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba3c0ccd40 msgr2=0x7fba3c0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:55.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.950+0000 7fba41d8a700 1 --2- 172.21.15.6:0/3506712455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba3c0ccd40 0x7fba3c0cf2a0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fba3c088f30 tx=0x7fba300091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:55.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.950+0000 7fba41d8a700 1 -- 172.21.15.6:0/3506712455 shutdown_connections 2023-10-06T02:25:55.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.950+0000 7fba41d8a700 1 --2- 172.21.15.6:0/3506712455 >> v2:172.21.15.175:3300/0 conn(0x7fba3c0d0400 0x7fba3c0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:55.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.950+0000 7fba41d8a700 1 --2- 172.21.15.6:0/3506712455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba3c0ccd40 0x7fba3c0cf2a0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:55.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.950+0000 7fba41d8a700 1 -- 172.21.15.6:0/3506712455 >> 172.21.15.6:0/3506712455 conn(0x7fba3c06a220 msgr2=0x7fba3c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:55.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.950+0000 7fba41d8a700 1 -- 172.21.15.6:0/3506712455 shutdown_connections 2023-10-06T02:25:55.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.950+0000 7fba41d8a700 1 -- 172.21.15.6:0/3506712455 wait complete. 2023-10-06T02:25:55.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.951+0000 7fba41d8a700 1 Processor -- start 2023-10-06T02:25:55.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.951+0000 7fba41d8a700 1 -- start start 2023-10-06T02:25:55.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba41d8a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba3c0ccd40 0x7fba3c154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:55.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba41d8a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba3c0cf7e0 0x7fba3c15bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:55.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba41d8a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba3c0d0400 0x7fba3c15c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:55.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba41d8a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c15ca20 con 0x7fba3c0cf7e0 2023-10-06T02:25:55.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba41d8a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c0cb990 con 0x7fba3c0ccd40 2023-10-06T02:25:55.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba41d8a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c0cbc30 con 0x7fba3c0d0400 2023-10-06T02:25:55.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba3affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba3c0cf7e0 0x7fba3c15bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:55.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba3affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba3c0cf7e0 0x7fba3c15bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40940/0 (socket says 172.21.15.6:40940) 2023-10-06T02:25:55.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba3affd700 1 -- 172.21.15.6:0/3556209151 learned_addr learned my addr 172.21.15.6:0/3556209151 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:55.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba3b7fe700 1 --2- 172.21.15.6:0/3556209151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba3c0ccd40 0x7fba3c154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:55.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba3bfff700 1 --2- 172.21.15.6:0/3556209151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba3c0d0400 0x7fba3c15c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:55.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba3affd700 1 -- 172.21.15.6:0/3556209151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba3c0d0400 msgr2=0x7fba3c15c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:55.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba3affd700 1 --2- 172.21.15.6:0/3556209151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba3c0d0400 0x7fba3c15c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:55.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba3affd700 1 -- 172.21.15.6:0/3556209151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba3c0ccd40 msgr2=0x7fba3c154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:55.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba3affd700 1 --2- 172.21.15.6:0/3556209151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba3c0ccd40 0x7fba3c154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:55.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba3affd700 1 -- 172.21.15.6:0/3556209151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba30009420 con 0x7fba3c0cf7e0 2023-10-06T02:25:55.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba3bfff700 1 --2- 172.21.15.6:0/3556209151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba3c0d0400 0x7fba3c15c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:55.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba3affd700 1 --2- 172.21.15.6:0/3556209151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba3c0cf7e0 0x7fba3c15bb10 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fba3c0883f0 tx=0x7fba30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:55.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba237fe700 1 -- 172.21.15.6:0/3556209151 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba30011420 con 0x7fba3c0cf7e0 2023-10-06T02:25:55.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba237fe700 1 -- 172.21.15.6:0/3556209151 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba30011580 con 0x7fba3c0cf7e0 2023-10-06T02:25:55.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba41d8a700 1 -- 172.21.15.6:0/3556209151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3c0cbf10 con 0x7fba3c0cf7e0 2023-10-06T02:25:55.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba237fe700 1 -- 172.21.15.6:0/3556209151 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba30011940 con 0x7fba3c0cf7e0 2023-10-06T02:25:55.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.952+0000 7fba41d8a700 1 -- 172.21.15.6:0/3556209151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3c15b5f0 con 0x7fba3c0cf7e0 2023-10-06T02:25:55.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.953+0000 7fba41d8a700 1 -- 172.21.15.6:0/3556209151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba3c15d880 con 0x7fba3c0cf7e0 2023-10-06T02:25:55.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.954+0000 7fba237fe700 1 -- 172.21.15.6:0/3556209151 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba30011d30 con 0x7fba3c0cf7e0 2023-10-06T02:25:55.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.954+0000 7fba237fe700 1 --2- 172.21.15.6:0/3556209151 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba28066f30 0x7fba280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:55.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.954+0000 7fba237fe700 1 -- 172.21.15.6:0/3556209151 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6980+0+0 (secure 0 0 0) 0x7fba300860d0 con 0x7fba3c0cf7e0 2023-10-06T02:25:55.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.954+0000 7fba3b7fe700 1 --2- 172.21.15.6:0/3556209151 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba28066f30 0x7fba280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:55.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.955+0000 7fba3b7fe700 1 --2- 172.21.15.6:0/3556209151 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba28066f30 0x7fba280693e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fba2c006520 tx=0x7fba2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:55.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:55.959+0000 7fba237fe700 1 -- 172.21.15.6:0/3556209151 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba30052e40 con 0x7fba3c0cf7e0 2023-10-06T02:25:56.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.199+0000 7fba41d8a700 1 -- 172.21.15.6:0/3556209151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fba3c15b810 con 0x7fba3c0cf7e0 2023-10-06T02:25:56.200 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:25:56.200+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:25:56.205 INFO:tasks.ceph.mds.a.smithi006.stderr: -625> 2023-10-06T02:25:51.062+0000 7f99cd275700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:25:56.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.206+0000 7fba237fe700 1 -- 172.21.15.6:0/3556209151 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v137) v1 ==== 161+0+0 (secure 0 0 0) 0x7fba30056460 con 0x7fba3c0cf7e0 2023-10-06T02:25:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.208+0000 7fba41d8a700 1 -- 172.21.15.6:0/3556209151 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba28066f30 msgr2=0x7fba280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.208+0000 7fba41d8a700 1 --2- 172.21.15.6:0/3556209151 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba28066f30 0x7fba280693e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fba2c006520 tx=0x7fba2c008040 comp rx=0 tx=0).stop 2023-10-06T02:25:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.208+0000 7fba41d8a700 1 -- 172.21.15.6:0/3556209151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba3c0cf7e0 msgr2=0x7fba3c15bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.208+0000 7fba41d8a700 1 --2- 172.21.15.6:0/3556209151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba3c0cf7e0 0x7fba3c15bb10 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fba3c0883f0 tx=0x7fba30017000 comp rx=0 tx=0).stop 2023-10-06T02:25:56.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.208+0000 7fba41d8a700 1 -- 172.21.15.6:0/3556209151 shutdown_connections 2023-10-06T02:25:56.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.208+0000 7fba41d8a700 1 --2- 172.21.15.6:0/3556209151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba3c0d0400 0x7fba3c15c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:56.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.208+0000 7fba41d8a700 1 --2- 172.21.15.6:0/3556209151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba3c0ccd40 0x7fba3c154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:56.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.208+0000 7fba41d8a700 1 --2- 172.21.15.6:0/3556209151 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba28066f30 0x7fba280693e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:56.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.208+0000 7fba41d8a700 1 --2- 172.21.15.6:0/3556209151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba3c0cf7e0 0x7fba3c15bb10 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:56.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.208+0000 7fba41d8a700 1 -- 172.21.15.6:0/3556209151 >> 172.21.15.6:0/3556209151 conn(0x7fba3c06a220 msgr2=0x7fba3c155460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:56.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.209+0000 7fba41d8a700 1 -- 172.21.15.6:0/3556209151 shutdown_connections 2023-10-06T02:25:56.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.209+0000 7fba41d8a700 1 -- 172.21.15.6:0/3556209151 wait complete. 2023-10-06T02:25:56.211 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:25:56.222 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:25:56.227 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:25:56.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.342+0000 7f2a467c6700 1 Processor -- start 2023-10-06T02:25:56.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.342+0000 7f2a467c6700 1 -- start start 2023-10-06T02:25:56.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.342+0000 7f2a467c6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a4015a030 0x7f2a4015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:56.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a467c6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2a4015a940 0x7f2a40086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:56.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a467c6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2a40087530 0x7f2a400b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:56.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a467c6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a400b0cf0 con 0x7f2a4015a940 2023-10-06T02:25:56.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a467c6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a40087960 con 0x7f2a40087530 2023-10-06T02:25:56.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a467c6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400afc50 con 0x7f2a4015a030 2023-10-06T02:25:56.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a3f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2a4015a940 0x7f2a40086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:56.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a3f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2a4015a940 0x7f2a40086ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40958/0 (socket says 172.21.15.6:40958) 2023-10-06T02:25:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a3f7fe700 1 -- 172.21.15.6:0/2491624483 learned_addr learned my addr 172.21.15.6:0/2491624483 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a44d63700 1 --2- 172.21.15.6:0/2491624483 >> v2:172.21.15.175:3300/0 conn(0x7f2a40087530 0x7f2a400b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a3ffff700 1 --2- 172.21.15.6:0/2491624483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a4015a030 0x7f2a4015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a3f7fe700 1 -- 172.21.15.6:0/2491624483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a4015a030 msgr2=0x7f2a4015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a3f7fe700 1 --2- 172.21.15.6:0/2491624483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a4015a030 0x7f2a4015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a3f7fe700 1 -- 172.21.15.6:0/2491624483 >> v2:172.21.15.175:3300/0 conn(0x7f2a40087530 msgr2=0x7f2a400b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a3f7fe700 1 --2- 172.21.15.6:0/2491624483 >> v2:172.21.15.175:3300/0 conn(0x7f2a40087530 0x7f2a400b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a3f7fe700 1 -- 172.21.15.6:0/2491624483 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a400aff30 con 0x7f2a4015a940 2023-10-06T02:25:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a44d63700 1 --2- 172.21.15.6:0/2491624483 >> v2:172.21.15.175:3300/0 conn(0x7f2a40087530 0x7f2a400b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a3f7fe700 1 --2- 172.21.15.6:0/2491624483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a4015a940 0x7f2a40086ff0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f2a401577d0 tx=0x7f2a34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9e1e880356356f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a3effd700 1 -- 172.21.15.6:0/2491624483 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400b860 con 0x7f2a4015a940 2023-10-06T02:25:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a3effd700 1 -- 172.21.15.6:0/2491624483 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3400b9c0 con 0x7f2a4015a940 2023-10-06T02:25:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.343+0000 7f2a3effd700 1 -- 172.21.15.6:0/2491624483 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400bd60 con 0x7f2a4015a940 2023-10-06T02:25:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.344+0000 7f2a467c6700 1 -- 172.21.15.6:0/2491624483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a4015a940 msgr2=0x7f2a40086ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.344+0000 7f2a467c6700 1 --2- 172.21.15.6:0/2491624483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a4015a940 0x7f2a40086ff0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f2a401577d0 tx=0x7f2a34009250 comp rx=0 tx=0).stop 2023-10-06T02:25:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.344+0000 7f2a467c6700 1 -- 172.21.15.6:0/2491624483 shutdown_connections 2023-10-06T02:25:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.344+0000 7f2a467c6700 1 --2- 172.21.15.6:0/2491624483 >> v2:172.21.15.175:3300/0 conn(0x7f2a40087530 0x7f2a400b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.344+0000 7f2a467c6700 1 --2- 172.21.15.6:0/2491624483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a4015a030 0x7f2a4015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.344+0000 7f2a467c6700 1 --2- 172.21.15.6:0/2491624483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a4015a940 0x7f2a40086ff0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.344+0000 7f2a467c6700 1 -- 172.21.15.6:0/2491624483 >> 172.21.15.6:0/2491624483 conn(0x7f2a40068680 msgr2=0x7f2a40068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.344+0000 7f2a467c6700 1 -- 172.21.15.6:0/2491624483 shutdown_connections 2023-10-06T02:25:56.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.344+0000 7f2a467c6700 1 -- 172.21.15.6:0/2491624483 wait complete. 2023-10-06T02:25:56.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.345+0000 7f2a467c6700 1 Processor -- start 2023-10-06T02:25:56.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.345+0000 7f2a467c6700 1 -- start start 2023-10-06T02:25:56.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.346+0000 7f2a467c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a40087530 0x7f2a400c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:56.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.346+0000 7f2a467c6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a4015a030 0x7f2a400c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:56.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.346+0000 7f2a467c6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a4015a940 0x7f2a400c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:56.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.346+0000 7f2a467c6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400c7f70 con 0x7f2a40087530 2023-10-06T02:25:56.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.346+0000 7f2a467c6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400c8250 con 0x7f2a4015a940 2023-10-06T02:25:56.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.346+0000 7f2a467c6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400c8530 con 0x7f2a4015a030 2023-10-06T02:25:56.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.346+0000 7f2a3ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a40087530 0x7f2a400c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:56.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.346+0000 7f2a3ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a40087530 0x7f2a400c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40962/0 (socket says 172.21.15.6:40962) 2023-10-06T02:25:56.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.346+0000 7f2a3ffff700 1 -- 172.21.15.6:0/4293747791 learned_addr learned my addr 172.21.15.6:0/4293747791 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:56.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.346+0000 7f2a44d63700 1 --2- 172.21.15.6:0/4293747791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a4015a940 0x7f2a400c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:56.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.346+0000 7f2a3f7fe700 1 --2- 172.21.15.6:0/4293747791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a4015a030 0x7f2a400c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:56.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.346+0000 7f2a3ffff700 1 -- 172.21.15.6:0/4293747791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a4015a030 msgr2=0x7f2a400c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:56.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.346+0000 7f2a3ffff700 1 --2- 172.21.15.6:0/4293747791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a4015a030 0x7f2a400c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:56.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.346+0000 7f2a3ffff700 1 -- 172.21.15.6:0/4293747791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a4015a940 msgr2=0x7f2a400c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:56.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.346+0000 7f2a3ffff700 1 --2- 172.21.15.6:0/4293747791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a4015a940 0x7f2a400c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:56.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.346+0000 7f2a3ffff700 1 -- 172.21.15.6:0/4293747791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a340094f0 con 0x7f2a40087530 2023-10-06T02:25:56.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.347+0000 7f2a3ffff700 1 --2- 172.21.15.6:0/4293747791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a40087530 0x7f2a400c8a90 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000d890 tx=0x7f2a30008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:56.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.347+0000 7f2a27fff700 1 -- 172.21.15.6:0/4293747791 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a300125f0 con 0x7f2a40087530 2023-10-06T02:25:56.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.347+0000 7f2a27fff700 1 -- 172.21.15.6:0/4293747791 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a30012750 con 0x7f2a40087530 2023-10-06T02:25:56.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.347+0000 7f2a467c6700 1 -- 172.21.15.6:0/4293747791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a400c3c40 con 0x7f2a40087530 2023-10-06T02:25:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.347+0000 7f2a27fff700 1 -- 172.21.15.6:0/4293747791 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30012af0 con 0x7f2a40087530 2023-10-06T02:25:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.347+0000 7f2a467c6700 1 -- 172.21.15.6:0/4293747791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a40155d80 con 0x7f2a40087530 2023-10-06T02:25:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.348+0000 7f2a467c6700 1 -- 172.21.15.6:0/4293747791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a40088700 con 0x7f2a40087530 2023-10-06T02:25:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.348+0000 7f2a27fff700 1 -- 172.21.15.6:0/4293747791 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a3001e460 con 0x7f2a40087530 2023-10-06T02:25:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.349+0000 7f2a27fff700 1 --2- 172.21.15.6:0/4293747791 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2a2c066f30 0x7f2a2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.349+0000 7f2a27fff700 1 -- 172.21.15.6:0/4293747791 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7066+0+0 (secure 0 0 0) 0x7f2a30085020 con 0x7f2a40087530 2023-10-06T02:25:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.349+0000 7f2a3f7fe700 1 --2- 172.21.15.6:0/4293747791 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2a2c066f30 0x7f2a2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.349+0000 7f2a3f7fe700 1 --2- 172.21.15.6:0/4293747791 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2a2c066f30 0x7f2a2c0693e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2a401577d0 tx=0x7f2a34017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:56.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.353+0000 7f2a27fff700 1 -- 172.21.15.6:0/4293747791 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a30051d40 con 0x7f2a40087530 2023-10-06T02:25:56.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:56.630+0000 7f2a467c6700 1 -- 172.21.15.6:0/4293747791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f2a400c4290 con 0x7f2a40087530 2023-10-06T02:25:57.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.211+0000 7f2a27fff700 1 -- 172.21.15.6:0/4293747791 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v138) v1 ==== 107+0+0 (secure 0 0 0) 0x7f2a30055360 con 0x7f2a40087530 2023-10-06T02:25:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.213+0000 7f2a467c6700 1 -- 172.21.15.6:0/4293747791 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2a2c066f30 msgr2=0x7f2a2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.213+0000 7f2a467c6700 1 --2- 172.21.15.6:0/4293747791 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2a2c066f30 0x7f2a2c0693e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2a401577d0 tx=0x7f2a34017000 comp rx=0 tx=0).stop 2023-10-06T02:25:57.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.213+0000 7f2a467c6700 1 -- 172.21.15.6:0/4293747791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a40087530 msgr2=0x7f2a400c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.213+0000 7f2a467c6700 1 --2- 172.21.15.6:0/4293747791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a40087530 0x7f2a400c8a90 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000d890 tx=0x7f2a30008040 comp rx=0 tx=0).stop 2023-10-06T02:25:57.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.213+0000 7f2a467c6700 1 -- 172.21.15.6:0/4293747791 shutdown_connections 2023-10-06T02:25:57.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.213+0000 7f2a467c6700 1 --2- 172.21.15.6:0/4293747791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a4015a940 0x7f2a400c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.213+0000 7f2a467c6700 1 --2- 172.21.15.6:0/4293747791 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2a2c066f30 0x7f2a2c0693e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.213+0000 7f2a467c6700 1 --2- 172.21.15.6:0/4293747791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a40087530 0x7f2a400c8a90 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.213+0000 7f2a467c6700 1 --2- 172.21.15.6:0/4293747791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a4015a030 0x7f2a400c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.214+0000 7f2a467c6700 1 -- 172.21.15.6:0/4293747791 >> 172.21.15.6:0/4293747791 conn(0x7f2a40068680 msgr2=0x7f2a40158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:57.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.214+0000 7f2a467c6700 1 -- 172.21.15.6:0/4293747791 shutdown_connections 2023-10-06T02:25:57.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.214+0000 7f2a467c6700 1 -- 172.21.15.6:0/4293747791 wait complete. 2023-10-06T02:25:57.216 INFO:teuthology.orchestra.run.smithi006.stderr:nothing to do: rank is not damaged 2023-10-06T02:25:57.227 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:25:57.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.306+0000 7f0ab3a61000 1 Processor -- start 2023-10-06T02:25:57.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.306+0000 7f0ab3a61000 1 -- start start 2023-10-06T02:25:57.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0ab3a61000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56201fda0710 0x56201fe42e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0ab3a61000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56201fe422f0 0x56201fe55e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0ab3a61000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56201fe426c0 0x56201fe563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0ab3a61000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56201fcbf980 con 0x56201fe426c0 2023-10-06T02:25:57.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0ab3a61000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56201fcbf620 con 0x56201fda0710 2023-10-06T02:25:57.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0ab3a61000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56201fcb6400 con 0x56201fe422f0 2023-10-06T02:25:57.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0aad49d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56201fe426c0 0x56201fe563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0aad49d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56201fe426c0 0x56201fe563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40984/0 (socket says 172.21.15.6:40984) 2023-10-06T02:25:57.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0aad49d700 1 -- 172.21.15.6:0/2456285060 learned_addr learned my addr 172.21.15.6:0/2456285060 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:57.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0aacc9c700 1 --2- 172.21.15.6:0/2456285060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56201fda0710 0x56201fe42e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0aac49b700 1 --2- 172.21.15.6:0/2456285060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56201fe422f0 0x56201fe55e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0aad49d700 1 -- 172.21.15.6:0/2456285060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56201fe422f0 msgr2=0x56201fe55e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:57.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0aad49d700 1 --2- 172.21.15.6:0/2456285060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56201fe422f0 0x56201fe55e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0aad49d700 1 -- 172.21.15.6:0/2456285060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56201fda0710 msgr2=0x56201fe42e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:57.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0aad49d700 1 --2- 172.21.15.6:0/2456285060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56201fda0710 0x56201fe42e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0aad49d700 1 -- 172.21.15.6:0/2456285060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a94005cf0 con 0x56201fe426c0 2023-10-06T02:25:57.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0aacc9c700 1 --2- 172.21.15.6:0/2456285060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56201fda0710 0x56201fe42e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:57.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0aac49b700 1 --2- 172.21.15.6:0/2456285060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56201fe422f0 0x56201fe55e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:57.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0aad49d700 1 --2- 172.21.15.6:0/2456285060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56201fe426c0 0x56201fe563a0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0016e0 tx=0x7f0a9c006950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e9975195f7c974 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0aab499700 1 -- 172.21.15.6:0/2456285060 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c006320 con 0x56201fe426c0 2023-10-06T02:25:57.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0aab499700 1 -- 172.21.15.6:0/2456285060 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c004520 con 0x56201fe426c0 2023-10-06T02:25:57.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.307+0000 7f0aab499700 1 -- 172.21.15.6:0/2456285060 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0048e0 con 0x56201fe426c0 2023-10-06T02:25:57.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.308+0000 7f0ab3a61000 1 -- 172.21.15.6:0/2456285060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56201fe426c0 msgr2=0x56201fe563a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.308+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/2456285060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56201fe426c0 0x56201fe563a0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0016e0 tx=0x7f0a9c006950 comp rx=0 tx=0).stop 2023-10-06T02:25:57.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.308+0000 7f0ab3a61000 1 -- 172.21.15.6:0/2456285060 shutdown_connections 2023-10-06T02:25:57.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.308+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/2456285060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56201fe426c0 0x56201fe563a0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.308+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/2456285060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56201fda0710 0x56201fe42e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.308+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/2456285060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56201fe422f0 0x56201fe55e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.308+0000 7f0ab3a61000 1 -- 172.21.15.6:0/2456285060 >> 172.21.15.6:0/2456285060 conn(0x56201fd755d0 msgr2=0x56201fda42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:57.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.308+0000 7f0ab3a61000 1 -- 172.21.15.6:0/2456285060 shutdown_connections 2023-10-06T02:25:57.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.308+0000 7f0ab3a61000 1 -- 172.21.15.6:0/2456285060 wait complete. 2023-10-06T02:25:57.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.309+0000 7f0ab3a61000 1 Processor -- start 2023-10-06T02:25:57.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.309+0000 7f0ab3a61000 1 -- start start 2023-10-06T02:25:57.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.309+0000 7f0ab3a61000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56201fda0710 0x56201fe36770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.309+0000 7f0ab3a61000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56201fe422f0 0x56201fe42e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.309+0000 7f0ab3a61000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56201fe426c0 0x56201fe43340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.309+0000 7f0ab3a61000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56201fdb8f60 con 0x56201fda0710 2023-10-06T02:25:57.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.309+0000 7f0ab3a61000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56201fe54160 con 0x56201fe426c0 2023-10-06T02:25:57.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.309+0000 7f0ab3a61000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56201fe54400 con 0x56201fe422f0 2023-10-06T02:25:57.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.310+0000 7f0aacc9c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56201fda0710 0x56201fe36770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.310+0000 7f0aacc9c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56201fda0710 0x56201fe36770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40996/0 (socket says 172.21.15.6:40996) 2023-10-06T02:25:57.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.310+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 learned_addr learned my addr 172.21.15.6:0/1402169130 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:57.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.310+0000 7f0aad49d700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56201fe426c0 0x56201fe43340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.310+0000 7f0aac49b700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56201fe422f0 0x56201fe42e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.310+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56201fe422f0 msgr2=0x56201fe42e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.310+0000 7f0aacc9c700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56201fe422f0 0x56201fe42e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.310+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56201fe426c0 msgr2=0x56201fe43340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.310+0000 7f0aacc9c700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56201fe426c0 0x56201fe43340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.310+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c006c30 con 0x56201fda0710 2023-10-06T02:25:57.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.310+0000 7f0aacc9c700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56201fda0710 0x56201fe36770 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4006820 tx=0x7f0aa4005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.310+0000 7f0aa9c96700 1 -- 172.21.15.6:0/1402169130 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4012560 con 0x56201fda0710 2023-10-06T02:25:57.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.310+0000 7f0aa9c96700 1 -- 172.21.15.6:0/1402169130 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa400f040 con 0x56201fda0710 2023-10-06T02:25:57.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.310+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56201fcce3d0 con 0x56201fda0710 2023-10-06T02:25:57.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.310+0000 7f0aa9c96700 1 -- 172.21.15.6:0/1402169130 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40128f0 con 0x56201fda0710 2023-10-06T02:25:57.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.310+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56201fcc1ae0 con 0x56201fda0710 2023-10-06T02:25:57.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.312+0000 7f0aa9c96700 1 -- 172.21.15.6:0/1402169130 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0aa4012c60 con 0x56201fda0710 2023-10-06T02:25:57.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.312+0000 7f0aa9c96700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a8c065890 0x7f0a8c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.312+0000 7f0aa9c96700 1 -- 172.21.15.6:0/1402169130 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7066+0+0 (secure 0 0 0) 0x7f0aa4083670 con 0x56201fda0710 2023-10-06T02:25:57.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.312+0000 7f0aac49b700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a8c065890 0x7f0a8c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.322 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:25:57.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.312+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56201fdb93c0 0x56201fdb97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.312+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fdb9d00 con 0x56201fdb93c0 2023-10-06T02:25:57.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.313+0000 7f0aad49d700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56201fdb93c0 0x56201fdb97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.313+0000 7f0aac49b700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a8c065890 0x7f0a8c067d40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400a520 tx=0x7f0a94016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.313+0000 7f0aad49d700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56201fdb93c0 0x56201fdb97c0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.314+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v103'226 uv200 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.314+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fdba0e0 con 0x56201fdb93c0 2023-10-06T02:25:57.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.316+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v103'227 uv227 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.316+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe681c0 con 0x56201fdb93c0 2023-10-06T02:25:57.324 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:25:57.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.317+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v103'228 uv228 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.317+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe69580 con 0x56201fdb93c0 2023-10-06T02:25:57.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.318+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v103'229 uv229 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.318+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe69930 con 0x56201fdb93c0 2023-10-06T02:25:57.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.319+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v103'230 uv230 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.319+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68570 con 0x56201fdb93c0 2023-10-06T02:25:57.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.320+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v103'231 uv231 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.321+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68970 con 0x56201fdb93c0 2023-10-06T02:25:57.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.322+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v103'232 uv206 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.322+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68d70 con 0x56201fdb93c0 2023-10-06T02:25:57.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.323+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v103'233 uv233 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.323+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68d70 con 0x56201fdb93c0 2023-10-06T02:25:57.327 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:25:57.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.324+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v103'234 uv234 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.324+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68d20 con 0x56201fdb93c0 2023-10-06T02:25:57.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.327+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v103'235 uv235 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.327+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68d20 con 0x56201fdb93c0 2023-10-06T02:25:57.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.330+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v103'236 uv236 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.330+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68d20 con 0x56201fdb93c0 2023-10-06T02:25:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.331+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v103'237 uv237 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.331+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68d20 con 0x56201fdb93c0 2023-10-06T02:25:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.334+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v103'238 uv213 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.334+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68d20 con 0x56201fdb93c0 2023-10-06T02:25:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.337+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v103'239 uv239 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.337+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68d20 con 0x56201fdb93c0 2023-10-06T02:25:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.338+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v103'240 uv240 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.339 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:25:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.338+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68d20 con 0x56201fdb93c0 2023-10-06T02:25:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.341+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v103'241 uv241 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.341+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68d20 con 0x56201fdb93c0 2023-10-06T02:25:57.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.343+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v103'242 uv242 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.343+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68d20 con 0x56201fdb93c0 2023-10-06T02:25:57.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.348+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v103'243 uv243 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.348+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe69170 con 0x56201fdb93c0 2023-10-06T02:25:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.349+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v103'244 uv244 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.349+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe69120 con 0x56201fdb93c0 2023-10-06T02:25:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.351+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v103'245 uv219 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.351+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe69120 con 0x56201fdb93c0 2023-10-06T02:25:57.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.354+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v103'246 uv246 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.354+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68f90 con 0x56201fdb93c0 2023-10-06T02:25:57.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.357+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v103'247 uv247 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.357 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:25:57.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.357+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68f90 con 0x56201fdb93c0 2023-10-06T02:25:57.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.359+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v103'248 uv248 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.360+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68f90 con 0x56201fdb93c0 2023-10-06T02:25:57.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.362+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v103'249 uv249 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.362+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68f90 con 0x56201fdb93c0 2023-10-06T02:25:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.363+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v103'250 uv250 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.363+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68f90 con 0x56201fdb93c0 2023-10-06T02:25:57.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.366+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v103'251 uv225 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.366+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68f90 con 0x56201fdb93c0 2023-10-06T02:25:57.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.369+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v103'252 uv252 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.369+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68f90 con 0x56201fdb93c0 2023-10-06T02:25:57.371 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:25:57.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.371+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v103'253 uv253 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.371+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68f90 con 0x56201fdb93c0 2023-10-06T02:25:57.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.373+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v103'254 uv254 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.373+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68f90 con 0x56201fdb93c0 2023-10-06T02:25:57.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.376+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v103'255 uv255 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.376+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68f90 con 0x56201fdb93c0 2023-10-06T02:25:57.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.377+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v103'256 uv256 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fdb93c0 2023-10-06T02:25:57.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.377+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56201fe6a1f0 0x56201fe6c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.377+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe68f90 con 0x56201fe6a1f0 2023-10-06T02:25:57.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.377+0000 7f0aacc9c700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56201fe6a1f0 0x56201fe6c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.378+0000 7f0aacc9c700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56201fe6a1f0 0x56201fe6c5d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.379+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v103'173 uv153 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.379+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6cb10 con 0x56201fe6a1f0 2023-10-06T02:25:57.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.383+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v103'174 uv174 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.383+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6cec0 con 0x56201fe6a1f0 2023-10-06T02:25:57.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.385+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v103'175 uv175 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.386 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:25:57.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.385+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6d760 con 0x56201fe6a1f0 2023-10-06T02:25:57.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.388+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v103'176 uv176 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.388+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6db10 con 0x56201fe6a1f0 2023-10-06T02:25:57.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.393+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v103'177 uv177 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.393+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6dec0 con 0x56201fe6a1f0 2023-10-06T02:25:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.394+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v103'178 uv172 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.394+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6e270 con 0x56201fe6a1f0 2023-10-06T02:25:57.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.397+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v103'179 uv179 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.397+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6e620 con 0x56201fe6a1f0 2023-10-06T02:25:57.402 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:25:57.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.402+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v103'180 uv180 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.402+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6e620 con 0x56201fe6a1f0 2023-10-06T02:25:57.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.403+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v103'181 uv181 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.403+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6e620 con 0x56201fe6a1f0 2023-10-06T02:25:57.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.406+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v103'182 uv182 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.406+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6e620 con 0x56201fe6a1f0 2023-10-06T02:25:57.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.409+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v103'183 uv171 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.409+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6e620 con 0x56201fe6a1f0 2023-10-06T02:25:57.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.411+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v103'184 uv184 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.411+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6e620 con 0x56201fe6a1f0 2023-10-06T02:25:57.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.414+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v103'185 uv185 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.414 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:25:57.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.414+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe71d40 con 0x56201fe6a1f0 2023-10-06T02:25:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.416+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v103'186 uv186 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.416+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe71d40 con 0x56201fe6a1f0 2023-10-06T02:25:57.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.419+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v103'187 uv187 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.419+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6e620 con 0x56201fe6a1f0 2023-10-06T02:25:57.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.422+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v103'188 uv169 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.422+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6e620 con 0x56201fe6a1f0 2023-10-06T02:25:57.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.424+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v103'189 uv189 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.424+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6e620 con 0x56201fe6a1f0 2023-10-06T02:25:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.427+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v103'190 uv190 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.428 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:25:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.427+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6f630 con 0x56201fe6a1f0 2023-10-06T02:25:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.432+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v103'191 uv191 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.432+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6f630 con 0x56201fe6a1f0 2023-10-06T02:25:57.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.433+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v103'192 uv192 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.433+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6e620 con 0x56201fe6a1f0 2023-10-06T02:25:57.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.436+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v103'193 uv193 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.436+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56201fe6eb30 0x56201fe70f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.436+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe71450 con 0x56201fe6eb30 2023-10-06T02:25:57.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.436+0000 7f0aac49b700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56201fe6eb30 0x56201fe70f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.437+0000 7f0aac49b700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56201fe6eb30 0x56201fe70f10 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.438+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v103'45 uv44 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.438+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe71800 con 0x56201fe6eb30 2023-10-06T02:25:57.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.439+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v103'46 uv46 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.439+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe71c70 con 0x56201fe6eb30 2023-10-06T02:25:57.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.441+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v103'47 uv47 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.442 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:25:57.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.441+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe6d3b0 con 0x56201fe6eb30 2023-10-06T02:25:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.444+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v103'48 uv48 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.444+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe736d0 con 0x56201fe6eb30 2023-10-06T02:25:57.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.445+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v103'49 uv49 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.445+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe72560 con 0x56201fe6eb30 2023-10-06T02:25:57.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.446+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v103'50 uv50 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.446+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe72980 con 0x56201fe6eb30 2023-10-06T02:25:57.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.447+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v103'35 uv34 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.447+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe72db0 con 0x56201fe6eb30 2023-10-06T02:25:57.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.448+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v103'36 uv36 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.448+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe72db0 con 0x56201fe6eb30 2023-10-06T02:25:57.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.450+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v103'37 uv37 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.451 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:25:57.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.450+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe73200 con 0x56201fe6eb30 2023-10-06T02:25:57.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.453+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v103'38 uv38 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.453+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe73200 con 0x56201fe6a1f0 2023-10-06T02:25:57.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.456+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v103'45 uv44 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.456+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe73200 con 0x56201fe6a1f0 2023-10-06T02:25:57.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.458+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v103'46 uv46 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.458+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe73200 con 0x56201fe6a1f0 2023-10-06T02:25:57.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.461+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v103'47 uv47 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.462 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:25:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.461+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe73200 con 0x56201fe6a1f0 2023-10-06T02:25:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.463+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v103'48 uv48 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.463+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe73200 con 0x56201fe6a1f0 2023-10-06T02:25:57.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.465+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v103'49 uv49 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.465+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe73200 con 0x56201fe6a1f0 2023-10-06T02:25:57.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.466+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v103'50 uv50 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe6a1f0 2023-10-06T02:25:57.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.466+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56201fe74000 0x56201fe763e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.466+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe73200 con 0x56201fe74000 2023-10-06T02:25:57.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.466+0000 7f0aad49d700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56201fe74000 0x56201fe763e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.466+0000 7f0aad49d700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56201fe74000 0x56201fe763e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.467+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v103'83 uv75 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe74000 2023-10-06T02:25:57.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.467+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe76920 con 0x56201fe74000 2023-10-06T02:25:57.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.468+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v103'84 uv84 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe74000 2023-10-06T02:25:57.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.468+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe76920 con 0x56201fe74000 2023-10-06T02:25:57.470 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:25:57.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.470+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v103'85 uv85 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe74000 2023-10-06T02:25:57.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.470+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe77930 con 0x56201fe74000 2023-10-06T02:25:57.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.471+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v103'86 uv86 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe74000 2023-10-06T02:25:57.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.471+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe77930 con 0x56201fe74000 2023-10-06T02:25:57.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.472+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v103'87 uv87 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe74000 2023-10-06T02:25:57.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.472+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe76920 con 0x56201fe74000 2023-10-06T02:25:57.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.473+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v103'88 uv88 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe74000 2023-10-06T02:25:57.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.473+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe76920 con 0x56201fe74000 2023-10-06T02:25:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.474+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v103'89 uv82 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe74000 2023-10-06T02:25:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.474+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe76920 con 0x56201fe74000 2023-10-06T02:25:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.475+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v103'90 uv90 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe74000 2023-10-06T02:25:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.475+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe76920 con 0x56201fe74000 2023-10-06T02:25:57.476 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:25:57.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.476+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v103'91 uv91 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe74000 2023-10-06T02:25:57.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.476+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe76920 con 0x56201fe74000 2023-10-06T02:25:57.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.477+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v103'92 uv92 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe74000 2023-10-06T02:25:57.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.477+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe76920 con 0x56201fe74000 2023-10-06T02:25:57.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.478+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v103'93 uv93 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe74000 2023-10-06T02:25:57.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.478+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56201fe76fa0 0x56201fe793a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.478+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe79a60 con 0x56201fe76fa0 2023-10-06T02:25:57.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.478+0000 7f0aacc9c700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56201fe76fa0 0x56201fe793a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.479+0000 7f0aacc9c700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56201fe76fa0 0x56201fe793a0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.481+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v103'37 uv36 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe76fa0 2023-10-06T02:25:57.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.481+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe79e40 con 0x56201fe76fa0 2023-10-06T02:25:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.483+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v103'38 uv38 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe76fa0 2023-10-06T02:25:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.483+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe79e40 con 0x56201fe76fa0 2023-10-06T02:25:57.484 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:25:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.484+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v103'39 uv39 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe76fa0 2023-10-06T02:25:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.484+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe79e40 con 0x56201fe76fa0 2023-10-06T02:25:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.486+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v103'40 uv40 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe76fa0 2023-10-06T02:25:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.486+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe79e40 con 0x56201fe76fa0 2023-10-06T02:25:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.488+0000 7f0aacc9c700 1 -- 172.21.15.6:0/1402169130 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v103'41 uv41 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0aa4019020 con 0x56201fe76fa0 2023-10-06T02:25:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.488+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe79e40 con 0x56201fe6eb30 2023-10-06T02:25:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.489+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v103'45 uv44 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.489+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe79e40 con 0x56201fe6eb30 2023-10-06T02:25:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.492+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v103'46 uv46 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.492+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe79e40 con 0x56201fe6eb30 2023-10-06T02:25:57.493 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:25:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.493+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v103'47 uv47 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.493+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe7ae50 con 0x56201fe6eb30 2023-10-06T02:25:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.494+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v103'48 uv48 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.494+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe7ae50 con 0x56201fe6eb30 2023-10-06T02:25:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.495+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v103'49 uv49 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.495+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe79e40 con 0x56201fe6eb30 2023-10-06T02:25:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.496+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v103'50 uv50 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.496+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56201fe7a4c0 0x56201fe7c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.496+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe7cf10 con 0x56201fe7a4c0 2023-10-06T02:25:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.497+0000 7f0aac49b700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56201fe7a4c0 0x56201fe7c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.497+0000 7f0aac49b700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56201fe7a4c0 0x56201fe7c8a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.498+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v103'74 uv68 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe7a4c0 2023-10-06T02:25:57.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.498+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe7cfd0 con 0x56201fe7a4c0 2023-10-06T02:25:57.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.499+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v103'75 uv75 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe7a4c0 2023-10-06T02:25:57.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.499+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe7d400 con 0x56201fe7a4c0 2023-10-06T02:25:57.500 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:25:57.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.500+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v103'76 uv76 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe7a4c0 2023-10-06T02:25:57.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.500+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe7d400 con 0x56201fe7a4c0 2023-10-06T02:25:57.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.501+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v103'77 uv77 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe7a4c0 2023-10-06T02:25:57.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.501+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe7d400 con 0x56201fe7a4c0 2023-10-06T02:25:57.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.502+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v103'78 uv78 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe7a4c0 2023-10-06T02:25:57.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.502+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe7d400 con 0x56201fe7a4c0 2023-10-06T02:25:57.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.503+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v103'79 uv73 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe7a4c0 2023-10-06T02:25:57.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.503+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe7d400 con 0x56201fe7a4c0 2023-10-06T02:25:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.504+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v103'80 uv80 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe7a4c0 2023-10-06T02:25:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.504+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe7d400 con 0x56201fe7a4c0 2023-10-06T02:25:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:25:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.507+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v103'81 uv81 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe7a4c0 2023-10-06T02:25:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.507+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe7d400 con 0x56201fe7a4c0 2023-10-06T02:25:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.508+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v103'82 uv82 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe7a4c0 2023-10-06T02:25:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.508+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe80170 con 0x56201fe7a4c0 2023-10-06T02:25:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.509+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v103'83 uv83 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe7a4c0 2023-10-06T02:25:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.509+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe7d8f0 con 0x56201fe6eb30 2023-10-06T02:25:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.510+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v103'36 uv34 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.510+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe7d8f0 con 0x56201fe6eb30 2023-10-06T02:25:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.511+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v103'37 uv37 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.511+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe7d8f0 con 0x56201fe6eb30 2023-10-06T02:25:57.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.512+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v103'38 uv38 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.512 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:25:57.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.512+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe7d8f0 con 0x56201fe6eb30 2023-10-06T02:25:57.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.513+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v103'39 uv39 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.513+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56201fe7de00 0x56201fe7e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.513+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe808c0 con 0x56201fe7de00 2023-10-06T02:25:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.513+0000 7f0aad49d700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56201fe7de00 0x56201fe7e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.514+0000 7f0aad49d700 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56201fe7de00 0x56201fe7e1d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.515+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v103'45 uv44 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe7de00 2023-10-06T02:25:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.515+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe808c0 con 0x56201fe7de00 2023-10-06T02:25:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.516+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v103'46 uv46 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe7de00 2023-10-06T02:25:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.516+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe808c0 con 0x56201fe7de00 2023-10-06T02:25:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.517+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v103'47 uv47 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe7de00 2023-10-06T02:25:57.518 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:25:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.517+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe818d0 con 0x56201fe7de00 2023-10-06T02:25:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.518+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v103'48 uv48 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe7de00 2023-10-06T02:25:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.518+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe818d0 con 0x56201fe7de00 2023-10-06T02:25:57.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.519+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v103'49 uv49 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe7de00 2023-10-06T02:25:57.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.519+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe808c0 con 0x56201fe7de00 2023-10-06T02:25:57.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.520+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v103'50 uv50 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe7de00 2023-10-06T02:25:57.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.520+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe808c0 con 0x56201fe74000 2023-10-06T02:25:57.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.521+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v103'37 uv36 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe74000 2023-10-06T02:25:57.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.521+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe808c0 con 0x56201fe74000 2023-10-06T02:25:57.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.522+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v103'38 uv38 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe74000 2023-10-06T02:25:57.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.522+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe808c0 con 0x56201fe74000 2023-10-06T02:25:57.523 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:25:57.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.523+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v103'39 uv39 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe74000 2023-10-06T02:25:57.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.523+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe808c0 con 0x56201fe74000 2023-10-06T02:25:57.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.524+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v103'40 uv40 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe74000 2023-10-06T02:25:57.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.524+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe808c0 con 0x56201fe74000 2023-10-06T02:25:57.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.525+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v103'41 uv41 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0a9c004c50 con 0x56201fe74000 2023-10-06T02:25:57.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.525+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe808c0 con 0x56201fe6eb30 2023-10-06T02:25:57.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.526+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v103'95 uv86 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.526+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe808c0 con 0x56201fe6eb30 2023-10-06T02:25:57.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.528+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v103'96 uv96 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.528+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe808c0 con 0x56201fe6eb30 2023-10-06T02:25:57.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.529+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v103'97 uv97 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.529 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:25:57.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.529+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe808c0 con 0x56201fe6eb30 2023-10-06T02:25:57.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.530+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v103'98 uv98 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.530+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe808c0 con 0x56201fe6eb30 2023-10-06T02:25:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.531+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v103'99 uv99 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.531+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe808c0 con 0x56201fe6eb30 2023-10-06T02:25:57.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.532+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v103'100 uv93 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.532+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe808c0 con 0x56201fe6eb30 2023-10-06T02:25:57.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.533+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v103'101 uv101 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.533+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe808c0 con 0x56201fe6eb30 2023-10-06T02:25:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.534+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v103'102 uv102 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.534 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:25:57.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.534+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe818d0 con 0x56201fe6eb30 2023-10-06T02:25:57.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.535+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v103'103 uv103 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.535+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe818d0 con 0x56201fe6eb30 2023-10-06T02:25:57.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.536+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v103'104 uv104 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.536+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe80db0 con 0x56201fe6eb30 2023-10-06T02:25:57.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.537+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v103'105 uv105 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.537+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v8 -- 0x56201fe80db0 con 0x56201fe6eb30 2023-10-06T02:25:57.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.538+0000 7f0aac49b700 1 -- 172.21.15.6:0/1402169130 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v103'106 uv106 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f0a9402a430 con 0x56201fe6eb30 2023-10-06T02:25:57.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56201fe6eb30 msgr2=0x56201fe70f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56201fe6eb30 0x56201fe70f10 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56201fdb93c0 msgr2=0x56201fdb97c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56201fdb93c0 0x56201fdb97c0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56201fe7a4c0 msgr2=0x56201fe7c8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56201fe7a4c0 0x56201fe7c8a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56201fe6a1f0 msgr2=0x56201fe6c5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56201fe6a1f0 0x56201fe6c5d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56201fe7de00 msgr2=0x56201fe7e1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56201fe7de00 0x56201fe7e1d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 reap_dead start 2023-10-06T02:25:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56201fe76fa0 msgr2=0x56201fe793a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56201fe76fa0 0x56201fe793a0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0aad49d700 1 -- 172.21.15.6:0/1402169130 reap_dead start 2023-10-06T02:25:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56201fe74000 msgr2=0x56201fe763e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56201fe74000 0x56201fe763e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a8c065890 msgr2=0x7f0a8c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a8c065890 0x7f0a8c067d40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400a520 tx=0x7f0a94016000 comp rx=0 tx=0).stop 2023-10-06T02:25:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56201fda0710 msgr2=0x56201fe36770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56201fda0710 0x56201fe36770 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4006820 tx=0x7f0aa4005d50 comp rx=0 tx=0).stop 2023-10-06T02:25:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 shutdown_connections 2023-10-06T02:25:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56201fe74000 0x56201fe763e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56201fda0710 0x56201fe36770 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 --2- 172.21.15.6:0/1402169130 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a8c065890 0x7f0a8c067d40 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 >> 172.21.15.6:0/1402169130 conn(0x56201fd755d0 msgr2=0x56201fda3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 shutdown_connections 2023-10-06T02:25:57.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.539+0000 7f0ab3a61000 1 -- 172.21.15.6:0/1402169130 wait complete. 2023-10-06T02:25:57.543 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds_snaptable 2023-10-06T02:25:57.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.620+0000 7f69428a5000 1 Processor -- start 2023-10-06T02:25:57.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.620+0000 7f69428a5000 1 -- start start 2023-10-06T02:25:57.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f69428a5000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e23cdf54e0 0x55e23ce935d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f69428a5000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ce0edb0 0x55e23cdf1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f69428a5000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e23ce94590 0x55e23cdc67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f69428a5000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23cd6c320 con 0x55e23ce0edb0 2023-10-06T02:25:57.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f69428a5000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23cd10980 con 0x55e23cdf54e0 2023-10-06T02:25:57.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f69428a5000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e23cd10620 con 0x55e23ce94590 2023-10-06T02:25:57.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f693b2df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ce0edb0 0x55e23cdf1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f693b2df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ce0edb0 0x55e23cdf1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41006/0 (socket says 172.21.15.6:41006) 2023-10-06T02:25:57.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f693b2df700 1 -- 172.21.15.6:0/1393714823 learned_addr learned my addr 172.21.15.6:0/1393714823 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:57.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f693bae0700 1 --2- 172.21.15.6:0/1393714823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e23cdf54e0 0x55e23ce935d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f693c2e1700 1 --2- 172.21.15.6:0/1393714823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e23ce94590 0x55e23cdc67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f693b2df700 1 -- 172.21.15.6:0/1393714823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e23ce94590 msgr2=0x55e23cdc67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f693b2df700 1 --2- 172.21.15.6:0/1393714823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e23ce94590 0x55e23cdc67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f693b2df700 1 -- 172.21.15.6:0/1393714823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e23cdf54e0 msgr2=0x55e23ce935d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f693b2df700 1 --2- 172.21.15.6:0/1393714823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e23cdf54e0 0x55e23ce935d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f693b2df700 1 -- 172.21.15.6:0/1393714823 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c00a0e0 con 0x55e23ce0edb0 2023-10-06T02:25:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f693c2e1700 1 --2- 172.21.15.6:0/1393714823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e23ce94590 0x55e23cdc67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f693b2df700 1 --2- 172.21.15.6:0/1393714823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ce0edb0 0x55e23cdf1990 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f6924002e30 tx=0x7f69240028b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253693e02f730838 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f693a2dd700 1 -- 172.21.15.6:0/1393714823 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692400bbf0 con 0x55e23ce0edb0 2023-10-06T02:25:57.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f693a2dd700 1 -- 172.21.15.6:0/1393714823 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6924008030 con 0x55e23ce0edb0 2023-10-06T02:25:57.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.621+0000 7f693a2dd700 1 -- 172.21.15.6:0/1393714823 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692400f400 con 0x55e23ce0edb0 2023-10-06T02:25:57.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.622+0000 7f69428a5000 1 -- 172.21.15.6:0/1393714823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ce0edb0 msgr2=0x55e23cdf1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.622+0000 7f69428a5000 1 --2- 172.21.15.6:0/1393714823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ce0edb0 0x55e23cdf1990 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f6924002e30 tx=0x7f69240028b0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.622+0000 7f69428a5000 1 -- 172.21.15.6:0/1393714823 shutdown_connections 2023-10-06T02:25:57.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.622+0000 7f69428a5000 1 --2- 172.21.15.6:0/1393714823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e23ce94590 0x55e23cdc67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.622+0000 7f69428a5000 1 --2- 172.21.15.6:0/1393714823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e23cdf54e0 0x55e23ce935d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.622+0000 7f69428a5000 1 --2- 172.21.15.6:0/1393714823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ce0edb0 0x55e23cdf1990 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.622+0000 7f69428a5000 1 -- 172.21.15.6:0/1393714823 >> 172.21.15.6:0/1393714823 conn(0x55e23cdc5d50 msgr2=0x55e23ce9d040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:57.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.622+0000 7f69428a5000 1 -- 172.21.15.6:0/1393714823 shutdown_connections 2023-10-06T02:25:57.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.622+0000 7f69428a5000 1 -- 172.21.15.6:0/1393714823 wait complete. 2023-10-06T02:25:57.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.623+0000 7f69428a5000 1 Processor -- start 2023-10-06T02:25:57.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.623+0000 7f69428a5000 1 -- start start 2023-10-06T02:25:57.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.623+0000 7f69428a5000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e23cdf54e0 0x55e23ce99df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.623+0000 7f69428a5000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ce0edb0 0x55e23cdc6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.623+0000 7f69428a5000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e23ce94590 0x55e23cea5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.623+0000 7f69428a5000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23cd07400 con 0x55e23ce0edb0 2023-10-06T02:25:57.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.623+0000 7f69428a5000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23ce0d950 con 0x55e23ce94590 2023-10-06T02:25:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.623+0000 7f69428a5000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e23ce907e0 con 0x55e23cdf54e0 2023-10-06T02:25:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.623+0000 7f693b2df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ce0edb0 0x55e23cdc6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.624+0000 7f693b2df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ce0edb0 0x55e23cdc6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41018/0 (socket says 172.21.15.6:41018) 2023-10-06T02:25:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.624+0000 7f693b2df700 1 -- 172.21.15.6:0/2272122564 learned_addr learned my addr 172.21.15.6:0/2272122564 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.624+0000 7f693bae0700 1 --2- 172.21.15.6:0/2272122564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e23cdf54e0 0x55e23ce99df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.624+0000 7f693c2e1700 1 --2- 172.21.15.6:0/2272122564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e23ce94590 0x55e23cea5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.624+0000 7f693b2df700 1 -- 172.21.15.6:0/2272122564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e23cdf54e0 msgr2=0x55e23ce99df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.624+0000 7f693b2df700 1 --2- 172.21.15.6:0/2272122564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e23cdf54e0 0x55e23ce99df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.624+0000 7f693b2df700 1 -- 172.21.15.6:0/2272122564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e23ce94590 msgr2=0x55e23cea5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.624+0000 7f693b2df700 1 --2- 172.21.15.6:0/2272122564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e23ce94590 0x55e23cea5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.624+0000 7f693b2df700 1 -- 172.21.15.6:0/2272122564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692400a040 con 0x55e23ce0edb0 2023-10-06T02:25:57.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.624+0000 7f693b2df700 1 --2- 172.21.15.6:0/2272122564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ce0edb0 0x55e23cdc6840 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f692400fe00 tx=0x7f6924017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.624+0000 7f6938ada700 1 -- 172.21.15.6:0/2272122564 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692401f070 con 0x55e23ce0edb0 2023-10-06T02:25:57.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.624+0000 7f6938ada700 1 -- 172.21.15.6:0/2272122564 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6924018630 con 0x55e23ce0edb0 2023-10-06T02:25:57.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.624+0000 7f69428a5000 1 -- 172.21.15.6:0/2272122564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e23cd12ae0 con 0x55e23ce0edb0 2023-10-06T02:25:57.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.624+0000 7f6938ada700 1 -- 172.21.15.6:0/2272122564 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692400f400 con 0x55e23ce0edb0 2023-10-06T02:25:57.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.624+0000 7f69428a5000 1 -- 172.21.15.6:0/2272122564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e23cd12540 con 0x55e23ce0edb0 2023-10-06T02:25:57.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.626+0000 7f6938ada700 1 -- 172.21.15.6:0/2272122564 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6924018c00 con 0x55e23ce0edb0 2023-10-06T02:25:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.626+0000 7f6938ada700 1 --2- 172.21.15.6:0/2272122564 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f691c0658c0 0x7f691c067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.626+0000 7f6938ada700 1 -- 172.21.15.6:0/2272122564 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7066+0+0 (secure 0 0 0) 0x7f69240845d0 con 0x55e23ce0edb0 2023-10-06T02:25:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.626+0000 7f693bae0700 1 --2- 172.21.15.6:0/2272122564 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f691c0658c0 0x7f691c067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.626+0000 7f69428a5000 1 --2- 172.21.15.6:0/2272122564 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55e23cdc6d80 0x55e23ceae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.626+0000 7f69428a5000 1 -- 172.21.15.6:0/2272122564 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:1 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e103) v8 -- 0x55e23ce0cf40 con 0x55e23cdc6d80 2023-10-06T02:25:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.626+0000 7f693c2e1700 1 --2- 172.21.15.6:0/2272122564 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55e23cdc6d80 0x55e23ceae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.627+0000 7f693bae0700 1 --2- 172.21.15.6:0/2272122564 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f691c0658c0 0x7f691c067d70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f693400f970 tx=0x7f6934000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.627+0000 7f693c2e1700 1 --2- 172.21.15.6:0/2272122564 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55e23cdc6d80 0x55e23ceae010 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.628+0000 7f693c2e1700 1 -- 172.21.15.6:0/2272122564 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(1 mds_snaptable [delete] v103'42 uv42 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f692c00f9b0 con 0x55e23cdc6d80 2023-10-06T02:25:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.628+0000 7f69428a5000 1 -- 172.21.15.6:0/2272122564 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55e23cdc6d80 msgr2=0x55e23ceae010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.628+0000 7f69428a5000 1 --2- 172.21.15.6:0/2272122564 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55e23cdc6d80 0x55e23ceae010 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.628+0000 7f69428a5000 1 -- 172.21.15.6:0/2272122564 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f691c0658c0 msgr2=0x7f691c067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.628+0000 7f69428a5000 1 --2- 172.21.15.6:0/2272122564 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f691c0658c0 0x7f691c067d70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f693400f970 tx=0x7f6934000bc0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.628+0000 7f69428a5000 1 -- 172.21.15.6:0/2272122564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ce0edb0 msgr2=0x55e23cdc6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.628+0000 7f69428a5000 1 --2- 172.21.15.6:0/2272122564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ce0edb0 0x55e23cdc6840 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f692400fe00 tx=0x7f6924017000 comp rx=0 tx=0).stop 2023-10-06T02:25:57.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.628+0000 7f693c2e1700 1 -- 172.21.15.6:0/2272122564 reap_dead start 2023-10-06T02:25:57.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.628+0000 7f69428a5000 1 -- 172.21.15.6:0/2272122564 shutdown_connections 2023-10-06T02:25:57.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.628+0000 7f69428a5000 1 -- 172.21.15.6:0/2272122564 >> 172.21.15.6:0/2272122564 conn(0x55e23cdc5d50 msgr2=0x55e23ce9d040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:57.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.628+0000 7f69428a5000 1 -- 172.21.15.6:0/2272122564 shutdown_connections 2023-10-06T02:25:57.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.628+0000 7f69428a5000 1 -- 172.21.15.6:0/2272122564 wait complete. 2023-10-06T02:25:57.635 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:25:57.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.797+0000 7f1af98f4700 1 Processor -- start 2023-10-06T02:25:57.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.797+0000 7f1af98f4700 1 -- start start 2023-10-06T02:25:57.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.797+0000 7f1af98f4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1af415a030 0x7f1af415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.797+0000 7f1af98f4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af40afc50 con 0x7f1af415a940 2023-10-06T02:25:57.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.797+0000 7f1af98f4700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af40aff30 con 0x7f1af4087700 2023-10-06T02:25:57.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.797+0000 7f1af98f4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af40b0cf0 con 0x7f1af415a030 2023-10-06T02:25:57.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.797+0000 7f1af2ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1af415a030 0x7f1af415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.798+0000 7f1af2ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1af415a030 0x7f1af415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41026/0 (socket says 172.21.15.6:41026) 2023-10-06T02:25:57.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.798+0000 7f1af27fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1af415a940 0x7f1af4086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47780/0 (socket says 172.21.15.6:47780) 2023-10-06T02:25:57.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.798+0000 7f1af2ffd700 1 -- 172.21.15.6:0/319550403 learned_addr learned my addr 172.21.15.6:0/319550403 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:57.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.798+0000 7f1af2ffd700 1 -- 172.21.15.6:0/319550403 >> v1:172.21.15.175:6789/0 conn(0x7f1af4087700 legacy=0x7f1af40b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.798+0000 7f1af2ffd700 1 -- 172.21.15.6:0/319550403 >> v1:172.21.15.6:6789/0 conn(0x7f1af415a940 legacy=0x7f1af4086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.798+0000 7f1af2ffd700 1 -- 172.21.15.6:0/319550403 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af40b0210 con 0x7f1af415a030 2023-10-06T02:25:57.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.798+0000 7f1af1ffb700 1 -- 172.21.15.6:0/319550403 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872828412 0 0) 0x7f1af40afc50 con 0x7f1af415a940 2023-10-06T02:25:57.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.798+0000 7f1af2ffd700 1 --2- 172.21.15.6:0/319550403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1af415a030 0x7f1af415a400 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0099b0 tx=0x7f1aec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44dc2cf492a76968 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.798+0000 7f1af1ffb700 1 -- 172.21.15.6:0/319550403 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00b860 con 0x7f1af415a030 2023-10-06T02:25:57.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.798+0000 7f1af1ffb700 1 -- 172.21.15.6:0/319550403 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec00b9c0 con 0x7f1af415a030 2023-10-06T02:25:57.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.798+0000 7f1af1ffb700 1 -- 172.21.15.6:0/319550403 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00bd60 con 0x7f1af415a030 2023-10-06T02:25:57.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.799+0000 7f1af98f4700 1 -- 172.21.15.6:0/319550403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1af415a030 msgr2=0x7f1af415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.799+0000 7f1af98f4700 1 --2- 172.21.15.6:0/319550403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1af415a030 0x7f1af415a400 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0099b0 tx=0x7f1aec009250 comp rx=0 tx=0).stop 2023-10-06T02:25:57.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.799+0000 7f1af98f4700 1 -- 172.21.15.6:0/319550403 shutdown_connections 2023-10-06T02:25:57.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.799+0000 7f1af98f4700 1 --2- 172.21.15.6:0/319550403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1af415a030 0x7f1af415a400 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.799+0000 7f1af98f4700 1 -- 172.21.15.6:0/319550403 >> 172.21.15.6:0/319550403 conn(0x7f1af4068680 msgr2=0x7f1af4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:57.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.799+0000 7f1af98f4700 1 -- 172.21.15.6:0/319550403 shutdown_connections 2023-10-06T02:25:57.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.799+0000 7f1af98f4700 1 -- 172.21.15.6:0/319550403 wait complete. 2023-10-06T02:25:57.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.800+0000 7f1af98f4700 1 Processor -- start 2023-10-06T02:25:57.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.800+0000 7f1af98f4700 1 -- start start 2023-10-06T02:25:57.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1af98f4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1af4087700 0x7f1af4169f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1af98f4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1af415a030 0x7f1af416cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1af98f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1af415a940 0x7f1af415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1af98f4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af416b3d0 con 0x7f1af415a940 2023-10-06T02:25:57.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1af98f4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af416b140 con 0x7f1af415a030 2023-10-06T02:25:57.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1af98f4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af416a530 con 0x7f1af4087700 2023-10-06T02:25:57.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1af37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1af415a940 0x7f1af415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1af37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1af415a940 0x7f1af415ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41036/0 (socket says 172.21.15.6:41036) 2023-10-06T02:25:57.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1af37fe700 1 -- 172.21.15.6:0/3136963355 learned_addr learned my addr 172.21.15.6:0/3136963355 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:57.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1af27fc700 1 --2- 172.21.15.6:0/3136963355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1af415a030 0x7f1af416cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1af2ffd700 1 --2- 172.21.15.6:0/3136963355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1af4087700 0x7f1af4169f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1af37fe700 1 -- 172.21.15.6:0/3136963355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1af4087700 msgr2=0x7f1af4169f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1af37fe700 1 --2- 172.21.15.6:0/3136963355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1af4087700 0x7f1af4169f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1af37fe700 1 -- 172.21.15.6:0/3136963355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1af415a030 msgr2=0x7f1af416cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1af37fe700 1 --2- 172.21.15.6:0/3136963355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1af415a030 0x7f1af416cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1af37fe700 1 -- 172.21.15.6:0/3136963355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0094f0 con 0x7f1af415a940 2023-10-06T02:25:57.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1af37fe700 1 --2- 172.21.15.6:0/3136963355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1af415a940 0x7f1af415ce00 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f1ae400c910 tx=0x7f1ae40016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.801+0000 7f1aeaffd700 1 -- 172.21.15.6:0/3136963355 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4012630 con 0x7f1af415a940 2023-10-06T02:25:57.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.802+0000 7f1aeaffd700 1 -- 172.21.15.6:0/3136963355 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae4012790 con 0x7f1af415a940 2023-10-06T02:25:57.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.802+0000 7f1af98f4700 1 -- 172.21.15.6:0/3136963355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af416a810 con 0x7f1af415a940 2023-10-06T02:25:57.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.802+0000 7f1aeaffd700 1 -- 172.21.15.6:0/3136963355 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4012b30 con 0x7f1af415a940 2023-10-06T02:25:57.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.802+0000 7f1af98f4700 1 -- 172.21.15.6:0/3136963355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af416add0 con 0x7f1af415a940 2023-10-06T02:25:57.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.803+0000 7f1af98f4700 1 -- 172.21.15.6:0/3136963355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af40c3c40 con 0x7f1af415a940 2023-10-06T02:25:57.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.803+0000 7f1aeaffd700 1 -- 172.21.15.6:0/3136963355 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ae401a3a0 con 0x7f1af415a940 2023-10-06T02:25:57.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.803+0000 7f1aeaffd700 1 --2- 172.21.15.6:0/3136963355 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ad4066f30 0x7f1ad40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.804+0000 7f1aeaffd700 1 -- 172.21.15.6:0/3136963355 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7066+0+0 (secure 0 0 0) 0x7f1ae4084d30 con 0x7f1af415a940 2023-10-06T02:25:57.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.804+0000 7f1af2ffd700 1 --2- 172.21.15.6:0/3136963355 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ad4066f30 0x7f1ad40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.804+0000 7f1af2ffd700 1 --2- 172.21.15.6:0/3136963355 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ad4066f30 0x7f1ad40693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0099b0 tx=0x7f1aec017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:57.808+0000 7f1aeaffd700 1 -- 172.21.15.6:0/3136963355 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1af40c3c40 con 0x7f1af415a940 2023-10-06T02:25:58.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.047+0000 7f1af98f4700 1 -- 172.21.15.6:0/3136963355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f1af40c3c40 con 0x7f1af415a940 2023-10-06T02:25:58.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.215+0000 7f1aeaffd700 1 -- 172.21.15.6:0/3136963355 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v139) v1 ==== 162+0+0 (secure 0 0 0) 0x7f1af40c3c40 con 0x7f1af415a940 2023-10-06T02:25:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.217+0000 7f1af98f4700 1 -- 172.21.15.6:0/3136963355 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ad4066f30 msgr2=0x7f1ad40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.217+0000 7f1af98f4700 1 --2- 172.21.15.6:0/3136963355 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ad4066f30 0x7f1ad40693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0099b0 tx=0x7f1aec017000 comp rx=0 tx=0).stop 2023-10-06T02:25:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.217+0000 7f1af98f4700 1 -- 172.21.15.6:0/3136963355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1af415a940 msgr2=0x7f1af415ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.217+0000 7f1af98f4700 1 --2- 172.21.15.6:0/3136963355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1af415a940 0x7f1af415ce00 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f1ae400c910 tx=0x7f1ae40016b0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.218+0000 7f1af98f4700 1 -- 172.21.15.6:0/3136963355 shutdown_connections 2023-10-06T02:25:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.218+0000 7f1af98f4700 1 --2- 172.21.15.6:0/3136963355 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ad4066f30 0x7f1ad40693e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.218+0000 7f1af98f4700 1 --2- 172.21.15.6:0/3136963355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1af415a940 0x7f1af415ce00 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.218+0000 7f1af98f4700 1 --2- 172.21.15.6:0/3136963355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1af4087700 0x7f1af4169f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.218+0000 7f1af98f4700 1 --2- 172.21.15.6:0/3136963355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1af415a030 0x7f1af416cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.218+0000 7f1af98f4700 1 -- 172.21.15.6:0/3136963355 >> 172.21.15.6:0/3136963355 conn(0x7f1af4068680 msgr2=0x7f1af4158b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.218+0000 7f1af98f4700 1 -- 172.21.15.6:0/3136963355 shutdown_connections 2023-10-06T02:25:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.218+0000 7f1af98f4700 1 -- 172.21.15.6:0/3136963355 wait complete. 2023-10-06T02:25:58.220 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:25:58.220 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:25:58.220+0000 7f172d0a5700 -1 mds.0.snaptable: load_2 could not read table: -2 2023-10-06T02:25:58.220 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:25:58.220+0000 7f172d0a5700 -1 log_channel(cluster) log [ERR] : error reading table object 'mds_snaptable' -2 ((2) No such file or directory) 2023-10-06T02:25:58.221 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:25:58.221+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:25:58.221 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:25:58.221+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:25:58.227 INFO:tasks.ceph.mds.a.smithi006.stderr: -27> 2023-10-06T02:25:58.220+0000 7f172d0a5700 -1 mds.0.snaptable: load_2 could not read table: -2 2023-10-06T02:25:58.227 INFO:tasks.ceph.mds.a.smithi006.stderr: -26> 2023-10-06T02:25:58.220+0000 7f172d0a5700 -1 log_channel(cluster) log [ERR] : error reading table object 'mds_snaptable' -2 ((2) No such file or directory) 2023-10-06T02:25:58.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:58.249 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:25:58.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.354+0000 7f1d99ae0700 1 Processor -- start 2023-10-06T02:25:58.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.354+0000 7f1d99ae0700 1 -- start start 2023-10-06T02:25:58.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.354+0000 7f1d99ae0700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d940a73e0 0x7f1d940c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.354+0000 7f1d99ae0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d940c9df0 0x7f1d940ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.354+0000 7f1d99ae0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d940cb270 con 0x7f1d940cb700 2023-10-06T02:25:58.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.354+0000 7f1d99ae0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d940ca660 con 0x7f1d940c9df0 2023-10-06T02:25:58.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.354+0000 7f1d99ae0700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d940ca940 con 0x7f1d940a73e0 2023-10-06T02:25:58.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.355+0000 7f1d92ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d940c9df0 0x7f1d940ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.355+0000 7f1d93fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1d940cb700 0x7f1d940cbb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47792/0 (socket says 172.21.15.6:47792) 2023-10-06T02:25:58.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.355+0000 7f1d93fff700 1 -- 172.21.15.6:0/649245397 learned_addr learned my addr 172.21.15.6:0/649245397 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:58.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.355+0000 7f1d937fe700 1 --2- 172.21.15.6:0/649245397 >> v2:172.21.15.175:3300/0 conn(0x7f1d940a73e0 0x7f1d940c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.355+0000 7f1d92ffd700 1 -- 172.21.15.6:0/649245397 >> v2:172.21.15.175:3300/0 conn(0x7f1d940a73e0 msgr2=0x7f1d940c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:58.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.355+0000 7f1d92ffd700 1 --2- 172.21.15.6:0/649245397 >> v2:172.21.15.175:3300/0 conn(0x7f1d940a73e0 0x7f1d940c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.355+0000 7f1d92ffd700 1 -- 172.21.15.6:0/649245397 >> v1:172.21.15.6:6789/0 conn(0x7f1d940cb700 legacy=0x7f1d940cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.355+0000 7f1d92ffd700 1 -- 172.21.15.6:0/649245397 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d940cac20 con 0x7f1d940c9df0 2023-10-06T02:25:58.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.355+0000 7f1d927fc700 1 -- 172.21.15.6:0/649245397 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 784924710 0 0) 0x7f1d940cb270 con 0x7f1d940cb700 2023-10-06T02:25:58.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.355+0000 7f1d92ffd700 1 --2- 172.21.15.6:0/649245397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d940c9df0 0x7f1d940ac050 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f1d940b1210 tx=0x7f1d7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efbb0c06033c53c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:58.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.355+0000 7f1d927fc700 1 -- 172.21.15.6:0/649245397 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c011630 con 0x7f1d940c9df0 2023-10-06T02:25:58.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.355+0000 7f1d927fc700 1 -- 172.21.15.6:0/649245397 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c011790 con 0x7f1d940c9df0 2023-10-06T02:25:58.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.355+0000 7f1d927fc700 1 -- 172.21.15.6:0/649245397 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c011b30 con 0x7f1d940c9df0 2023-10-06T02:25:58.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.356+0000 7f1d99ae0700 1 -- 172.21.15.6:0/649245397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d940c9df0 msgr2=0x7f1d940ac050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.356+0000 7f1d99ae0700 1 --2- 172.21.15.6:0/649245397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d940c9df0 0x7f1d940ac050 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f1d940b1210 tx=0x7f1d7c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.356+0000 7f1d99ae0700 1 -- 172.21.15.6:0/649245397 shutdown_connections 2023-10-06T02:25:58.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.356+0000 7f1d99ae0700 1 --2- 172.21.15.6:0/649245397 >> v2:172.21.15.175:3300/0 conn(0x7f1d940a73e0 0x7f1d940c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.356+0000 7f1d99ae0700 1 --2- 172.21.15.6:0/649245397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d940c9df0 0x7f1d940ac050 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.356+0000 7f1d99ae0700 1 -- 172.21.15.6:0/649245397 >> 172.21.15.6:0/649245397 conn(0x7f1d940cc790 msgr2=0x7f1d940ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:58.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.356+0000 7f1d99ae0700 1 -- 172.21.15.6:0/649245397 shutdown_connections 2023-10-06T02:25:58.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.356+0000 7f1d99ae0700 1 -- 172.21.15.6:0/649245397 wait complete. 2023-10-06T02:25:58.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.357+0000 7f1d99ae0700 1 Processor -- start 2023-10-06T02:25:58.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.357+0000 7f1d99ae0700 1 -- start start 2023-10-06T02:25:58.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.358+0000 7f1d99ae0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d940a73e0 0x7f1d94150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.358+0000 7f1d99ae0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d940c9df0 0x7f1d94098190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.358+0000 7f1d99ae0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d940cb700 0x7f1d940986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.358+0000 7f1d99ae0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940c6410 con 0x7f1d940c9df0 2023-10-06T02:25:58.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.358+0000 7f1d99ae0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940c66f0 con 0x7f1d940a73e0 2023-10-06T02:25:58.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.358+0000 7f1d99ae0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d941513e0 con 0x7f1d940cb700 2023-10-06T02:25:58.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.358+0000 7f1d92ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d940c9df0 0x7f1d94098190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.358+0000 7f1d92ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d940c9df0 0x7f1d94098190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41084/0 (socket says 172.21.15.6:41084) 2023-10-06T02:25:58.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.358+0000 7f1d92ffd700 1 -- 172.21.15.6:0/1252797636 learned_addr learned my addr 172.21.15.6:0/1252797636 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:58.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.358+0000 7f1d937fe700 1 --2- 172.21.15.6:0/1252797636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d940a73e0 0x7f1d94150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.358+0000 7f1d92ffd700 1 -- 172.21.15.6:0/1252797636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d940cb700 msgr2=0x7f1d940986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.358+0000 7f1d92ffd700 1 --2- 172.21.15.6:0/1252797636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d940cb700 0x7f1d940986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.358+0000 7f1d92ffd700 1 -- 172.21.15.6:0/1252797636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d940a73e0 msgr2=0x7f1d94150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.358+0000 7f1d92ffd700 1 --2- 172.21.15.6:0/1252797636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d940a73e0 0x7f1d94150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.358+0000 7f1d92ffd700 1 -- 172.21.15.6:0/1252797636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c009420 con 0x7f1d940c9df0 2023-10-06T02:25:58.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.358+0000 7f1d92ffd700 1 --2- 172.21.15.6:0/1252797636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d940c9df0 0x7f1d94098190 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009f50 tx=0x7f1d7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:58.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.359+0000 7f1d8b7fe700 1 -- 172.21.15.6:0/1252797636 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c011b10 con 0x7f1d940c9df0 2023-10-06T02:25:58.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.359+0000 7f1d8b7fe700 1 -- 172.21.15.6:0/1252797636 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c0253f0 con 0x7f1d940c9df0 2023-10-06T02:25:58.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.359+0000 7f1d99ae0700 1 -- 172.21.15.6:0/1252797636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d94098c10 con 0x7f1d940c9df0 2023-10-06T02:25:58.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.359+0000 7f1d8b7fe700 1 -- 172.21.15.6:0/1252797636 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c025790 con 0x7f1d940c9df0 2023-10-06T02:25:58.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.359+0000 7f1d99ae0700 1 -- 172.21.15.6:0/1252797636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d940991b0 con 0x7f1d940c9df0 2023-10-06T02:25:58.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.359+0000 7f1d99ae0700 1 -- 172.21.15.6:0/1252797636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d940c6880 con 0x7f1d940c9df0 2023-10-06T02:25:58.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.360+0000 7f1d8b7fe700 1 -- 172.21.15.6:0/1252797636 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d7c025bc0 con 0x7f1d940c9df0 2023-10-06T02:25:58.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.360+0000 7f1d8b7fe700 1 --2- 172.21.15.6:0/1252797636 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d74066f30 0x7f1d740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.361+0000 7f1d8b7fe700 1 -- 172.21.15.6:0/1252797636 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7152+0+0 (secure 0 0 0) 0x7f1d7c086330 con 0x7f1d940c9df0 2023-10-06T02:25:58.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.361+0000 7f1d937fe700 1 --2- 172.21.15.6:0/1252797636 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d74066f30 0x7f1d740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.361+0000 7f1d937fe700 1 --2- 172.21.15.6:0/1252797636 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d74066f30 0x7f1d740693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1d940ae730 tx=0x7f1d8400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:58.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.365+0000 7f1d8b7fe700 1 -- 172.21.15.6:0/1252797636 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d7c053000 con 0x7f1d940c9df0 2023-10-06T02:25:58.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.603+0000 7f1d99ae0700 1 -- 172.21.15.6:0/1252797636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d940caf00 con 0x7f1d940c9df0 2023-10-06T02:25:58.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.604+0000 7f1d8b7fe700 1 -- 172.21.15.6:0/1252797636 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f1d7c056620 con 0x7f1d940c9df0 2023-10-06T02:25:58.605 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:58.605 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":141,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":141,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:58.221680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.606+0000 7f1d99ae0700 1 -- 172.21.15.6:0/1252797636 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d74066f30 msgr2=0x7f1d740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.606+0000 7f1d99ae0700 1 --2- 172.21.15.6:0/1252797636 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d74066f30 0x7f1d740693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1d940ae730 tx=0x7f1d8400b040 comp rx=0 tx=0).stop 2023-10-06T02:25:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.606+0000 7f1d99ae0700 1 -- 172.21.15.6:0/1252797636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d940c9df0 msgr2=0x7f1d94098190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.606+0000 7f1d99ae0700 1 --2- 172.21.15.6:0/1252797636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d940c9df0 0x7f1d94098190 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009f50 tx=0x7f1d7c017000 comp rx=0 tx=0).stop 2023-10-06T02:25:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.606+0000 7f1d99ae0700 1 -- 172.21.15.6:0/1252797636 shutdown_connections 2023-10-06T02:25:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.606+0000 7f1d99ae0700 1 --2- 172.21.15.6:0/1252797636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d940cb700 0x7f1d940986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.606+0000 7f1d99ae0700 1 --2- 172.21.15.6:0/1252797636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d940a73e0 0x7f1d94150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.606+0000 7f1d99ae0700 1 --2- 172.21.15.6:0/1252797636 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d74066f30 0x7f1d740693e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.606+0000 7f1d99ae0700 1 --2- 172.21.15.6:0/1252797636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d940c9df0 0x7f1d94098190 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.606+0000 7f1d99ae0700 1 -- 172.21.15.6:0/1252797636 >> 172.21.15.6:0/1252797636 conn(0x7f1d940cc790 msgr2=0x7f1d9406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.606+0000 7f1d99ae0700 1 -- 172.21.15.6:0/1252797636 shutdown_connections 2023-10-06T02:25:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.606+0000 7f1d99ae0700 1 -- 172.21.15.6:0/1252797636 wait complete. 2023-10-06T02:25:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 141 2023-10-06T02:25:58.619 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:25:58.619 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:58.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.778+0000 7f0f90669700 1 Processor -- start 2023-10-06T02:25:58.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.778+0000 7f0f90669700 1 -- start start 2023-10-06T02:25:58.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.779+0000 7f0f90669700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0f880af8b0 0x7f0f8815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.779+0000 7f0f90669700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f880b27f0 0x7f0f8815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.779+0000 7f0f90669700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f8815e190 con 0x7f0f880af4e0 2023-10-06T02:25:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.779+0000 7f0f90669700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f880b1910 con 0x7f0f880af8b0 2023-10-06T02:25:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.779+0000 7f0f90669700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f880cb650 con 0x7f0f880b27f0 2023-10-06T02:25:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.779+0000 7f0f8e405700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0f880af4e0 0x7f0f880b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57776/0 (socket says 172.21.15.6:57776) 2023-10-06T02:25:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.779+0000 7f0f8e405700 1 -- 172.21.15.6:0/2619360460 learned_addr learned my addr 172.21.15.6:0/2619360460 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.779+0000 7f0f8dc04700 1 --2- 172.21.15.6:0/2619360460 >> v2:172.21.15.6:3300/0 conn(0x7f0f880af8b0 0x7f0f8815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.779+0000 7f0f8ec06700 1 --2- 172.21.15.6:0/2619360460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f880b27f0 0x7f0f8815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.779+0000 7f0f8d403700 1 -- 172.21.15.6:0/2619360460 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725203212 0 0) 0x7f0f8815e190 con 0x7f0f880af4e0 2023-10-06T02:25:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.780+0000 7f0f8d403700 1 -- 172.21.15.6:0/2619360460 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f70003570 con 0x7f0f880af4e0 2023-10-06T02:25:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.780+0000 7f0f8dc04700 1 -- 172.21.15.6:0/2619360460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f880b27f0 msgr2=0x7f0f8815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.780+0000 7f0f8dc04700 1 --2- 172.21.15.6:0/2619360460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f880b27f0 0x7f0f8815d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.780+0000 7f0f8dc04700 1 -- 172.21.15.6:0/2619360460 >> v1:172.21.15.6:6789/0 conn(0x7f0f880af4e0 legacy=0x7f0f880b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.780+0000 7f0f8dc04700 1 -- 172.21.15.6:0/2619360460 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f880ccaf0 con 0x7f0f880af8b0 2023-10-06T02:25:58.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.780+0000 7f0f8dc04700 1 --2- 172.21.15.6:0/2619360460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880af8b0 0x7f0f8815d460 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0098e0 tx=0x7f0f7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7023387b70174178 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:58.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.780+0000 7f0f8d403700 1 -- 172.21.15.6:0/2619360460 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c011630 con 0x7f0f880af8b0 2023-10-06T02:25:58.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.780+0000 7f0f8d403700 1 -- 172.21.15.6:0/2619360460 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c011790 con 0x7f0f880af8b0 2023-10-06T02:25:58.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.780+0000 7f0f8d403700 1 -- 172.21.15.6:0/2619360460 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c011b30 con 0x7f0f880af8b0 2023-10-06T02:25:58.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.780+0000 7f0f90669700 1 -- 172.21.15.6:0/2619360460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880af8b0 msgr2=0x7f0f8815d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.780+0000 7f0f90669700 1 --2- 172.21.15.6:0/2619360460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880af8b0 0x7f0f8815d460 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0098e0 tx=0x7f0f7c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.781+0000 7f0f90669700 1 -- 172.21.15.6:0/2619360460 shutdown_connections 2023-10-06T02:25:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.781+0000 7f0f90669700 1 --2- 172.21.15.6:0/2619360460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f880b27f0 0x7f0f8815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.781+0000 7f0f90669700 1 --2- 172.21.15.6:0/2619360460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880af8b0 0x7f0f8815d460 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.781+0000 7f0f90669700 1 -- 172.21.15.6:0/2619360460 >> 172.21.15.6:0/2619360460 conn(0x7f0f88068680 msgr2=0x7f0f88068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.781+0000 7f0f90669700 1 -- 172.21.15.6:0/2619360460 shutdown_connections 2023-10-06T02:25:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.781+0000 7f0f90669700 1 -- 172.21.15.6:0/2619360460 wait complete. 2023-10-06T02:25:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.782+0000 7f0f90669700 1 Processor -- start 2023-10-06T02:25:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.782+0000 7f0f90669700 1 -- start start 2023-10-06T02:25:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.782+0000 7f0f90669700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f880af4e0 0x7f0f8816cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.782+0000 7f0f90669700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f880af8b0 0x7f0f880a7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.782+0000 7f0f90669700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880b27f0 0x7f0f88169c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.782+0000 7f0f90669700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f880a8380 con 0x7f0f880b27f0 2023-10-06T02:25:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.782+0000 7f0f90669700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f880cdfc0 con 0x7f0f880af4e0 2023-10-06T02:25:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.782+0000 7f0f90669700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f880ce260 con 0x7f0f880af8b0 2023-10-06T02:25:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.783+0000 7f0f8ec06700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880b27f0 0x7f0f88169c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.783+0000 7f0f8ec06700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880b27f0 0x7f0f88169c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38238/0 (socket says 172.21.15.6:38238) 2023-10-06T02:25:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.783+0000 7f0f8ec06700 1 -- 172.21.15.6:0/1293058873 learned_addr learned my addr 172.21.15.6:0/1293058873 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.783+0000 7f0f8dc04700 1 --2- 172.21.15.6:0/1293058873 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f880af8b0 0x7f0f880a7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.783+0000 7f0f8e405700 1 --2- 172.21.15.6:0/1293058873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f880af4e0 0x7f0f8816cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.783+0000 7f0f8ec06700 1 -- 172.21.15.6:0/1293058873 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f880af8b0 msgr2=0x7f0f880a7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.783+0000 7f0f8ec06700 1 --2- 172.21.15.6:0/1293058873 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f880af8b0 0x7f0f880a7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.783+0000 7f0f8ec06700 1 -- 172.21.15.6:0/1293058873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f880af4e0 msgr2=0x7f0f8816cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.783+0000 7f0f8ec06700 1 --2- 172.21.15.6:0/1293058873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f880af4e0 0x7f0f8816cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.783+0000 7f0f8ec06700 1 -- 172.21.15.6:0/1293058873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c009420 con 0x7f0f880b27f0 2023-10-06T02:25:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.783+0000 7f0f8ec06700 1 --2- 172.21.15.6:0/1293058873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880b27f0 0x7f0f88169c70 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800ea50 tx=0x7f0f780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.783+0000 7f0f867fc700 1 -- 172.21.15.6:0/1293058873 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7800ee90 con 0x7f0f880b27f0 2023-10-06T02:25:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.783+0000 7f0f867fc700 1 -- 172.21.15.6:0/1293058873 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7800c850 con 0x7f0f880b27f0 2023-10-06T02:25:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.783+0000 7f0f90669700 1 -- 172.21.15.6:0/1293058873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f880ce540 con 0x7f0f880b27f0 2023-10-06T02:25:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.783+0000 7f0f867fc700 1 -- 172.21.15.6:0/1293058873 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7800cc10 con 0x7f0f880b27f0 2023-10-06T02:25:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.783+0000 7f0f90669700 1 -- 172.21.15.6:0/1293058873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f880a7fc0 con 0x7f0f880b27f0 2023-10-06T02:25:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.784+0000 7f0f90669700 1 -- 172.21.15.6:0/1293058873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f88088aa0 con 0x7f0f880b27f0 2023-10-06T02:25:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.785+0000 7f0f867fc700 1 -- 172.21.15.6:0/1293058873 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f78013470 con 0x7f0f880b27f0 2023-10-06T02:25:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.785+0000 7f0f867fc700 1 --2- 172.21.15.6:0/1293058873 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f74066f30 0x7f0f740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.785+0000 7f0f867fc700 1 -- 172.21.15.6:0/1293058873 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7152+0+0 (secure 0 0 0) 0x7f0f78084c90 con 0x7f0f880b27f0 2023-10-06T02:25:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.785+0000 7f0f8e405700 1 --2- 172.21.15.6:0/1293058873 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f74066f30 0x7f0f740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.786+0000 7f0f8e405700 1 --2- 172.21.15.6:0/1293058873 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f74066f30 0x7f0f740693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0f80005c50 tx=0x7f0f80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:58.789+0000 7f0f867fc700 1 -- 172.21.15.6:0/1293058873 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f78051960 con 0x7f0f880b27f0 2023-10-06T02:25:59.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.029+0000 7f0f90669700 1 -- 172.21.15.6:0/1293058873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f8815a530 con 0x7f0f880b27f0 2023-10-06T02:25:59.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.029+0000 7f0f867fc700 1 -- 172.21.15.6:0/1293058873 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f0f78054f80 con 0x7f0f880b27f0 2023-10-06T02:25:59.030 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:59.030 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":141,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":141,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:58.221680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:59.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.031+0000 7f0f90669700 1 -- 172.21.15.6:0/1293058873 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f74066f30 msgr2=0x7f0f740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.031+0000 7f0f90669700 1 --2- 172.21.15.6:0/1293058873 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f74066f30 0x7f0f740693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0f80005c50 tx=0x7f0f80009040 comp rx=0 tx=0).stop 2023-10-06T02:25:59.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.031+0000 7f0f90669700 1 -- 172.21.15.6:0/1293058873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880b27f0 msgr2=0x7f0f88169c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.031+0000 7f0f90669700 1 --2- 172.21.15.6:0/1293058873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880b27f0 0x7f0f88169c70 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800ea50 tx=0x7f0f780091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.031+0000 7f0f90669700 1 -- 172.21.15.6:0/1293058873 shutdown_connections 2023-10-06T02:25:59.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.031+0000 7f0f90669700 1 --2- 172.21.15.6:0/1293058873 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f74066f30 0x7f0f740693e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.031+0000 7f0f90669700 1 --2- 172.21.15.6:0/1293058873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880b27f0 0x7f0f88169c70 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.031+0000 7f0f90669700 1 --2- 172.21.15.6:0/1293058873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f880af4e0 0x7f0f8816cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.031+0000 7f0f90669700 1 --2- 172.21.15.6:0/1293058873 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f880af8b0 0x7f0f880a7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.031+0000 7f0f90669700 1 -- 172.21.15.6:0/1293058873 >> 172.21.15.6:0/1293058873 conn(0x7f0f88068680 msgr2=0x7f0f880afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:59.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.031+0000 7f0f90669700 1 -- 172.21.15.6:0/1293058873 shutdown_connections 2023-10-06T02:25:59.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.031+0000 7f0f90669700 1 -- 172.21.15.6:0/1293058873 wait complete. 2023-10-06T02:25:59.033 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 141 2023-10-06T02:25:59.043 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:25:59.043 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:59.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.162+0000 7f1262358700 1 Processor -- start 2023-10-06T02:25:59.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.162+0000 7f1262358700 1 -- start start 2023-10-06T02:25:59.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.162+0000 7f1262358700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f125c0b3c50 0x7f125c15b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.162+0000 7f1262358700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125c0afb90 con 0x7f125c15bcd0 2023-10-06T02:25:59.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.162+0000 7f1262358700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125c0b2310 con 0x7f125c15b3c0 2023-10-06T02:25:59.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.162+0000 7f1262358700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125c0b25f0 con 0x7f125c0b3c50 2023-10-06T02:25:59.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.163+0000 7f12608f5700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f125c15bcd0 0x7f125c15a590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57784/0 (socket says 172.21.15.6:57784) 2023-10-06T02:25:59.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.163+0000 7f12608f5700 1 -- 172.21.15.6:0/2119135774 learned_addr learned my addr 172.21.15.6:0/2119135774 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:59.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.163+0000 7f125b7fe700 1 --2- 172.21.15.6:0/2119135774 >> v2:172.21.15.175:3300/0 conn(0x7f125c0b3c50 0x7f125c15b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.163+0000 7f125affd700 1 -- 172.21.15.6:0/2119135774 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1448304784 0 0) 0x7f125c0afb90 con 0x7f125c15bcd0 2023-10-06T02:25:59.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.163+0000 7f125affd700 1 -- 172.21.15.6:0/2119135774 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1244003570 con 0x7f125c15bcd0 2023-10-06T02:25:59.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.163+0000 7f125b7fe700 1 -- 172.21.15.6:0/2119135774 >> v1:172.21.15.175:6789/0 conn(0x7f125c15b3c0 legacy=0x7f125c097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.163+0000 7f125b7fe700 1 -- 172.21.15.6:0/2119135774 >> v1:172.21.15.6:6789/0 conn(0x7f125c15bcd0 legacy=0x7f125c15a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.163+0000 7f125b7fe700 1 -- 172.21.15.6:0/2119135774 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c0af820 con 0x7f125c0b3c50 2023-10-06T02:25:59.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.163+0000 7f125b7fe700 1 --2- 172.21.15.6:0/2119135774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f125c0b3c50 0x7f125c15b790 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f12500098e0 tx=0x7f12500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a591bcbb6fdd6d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:59.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.163+0000 7f125affd700 1 -- 172.21.15.6:0/2119135774 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125000b640 con 0x7f125c0b3c50 2023-10-06T02:25:59.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.163+0000 7f125affd700 1 -- 172.21.15.6:0/2119135774 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125000b7a0 con 0x7f125c0b3c50 2023-10-06T02:25:59.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.163+0000 7f125affd700 1 -- 172.21.15.6:0/2119135774 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125000bb40 con 0x7f125c0b3c50 2023-10-06T02:25:59.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.164+0000 7f1262358700 1 -- 172.21.15.6:0/2119135774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f125c0b3c50 msgr2=0x7f125c15b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.164+0000 7f1262358700 1 --2- 172.21.15.6:0/2119135774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f125c0b3c50 0x7f125c15b790 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f12500098e0 tx=0x7f12500091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.164+0000 7f1262358700 1 -- 172.21.15.6:0/2119135774 shutdown_connections 2023-10-06T02:25:59.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.164+0000 7f1262358700 1 --2- 172.21.15.6:0/2119135774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f125c0b3c50 0x7f125c15b790 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.164+0000 7f1262358700 1 -- 172.21.15.6:0/2119135774 >> 172.21.15.6:0/2119135774 conn(0x7f125c067910 msgr2=0x7f125c0ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:59.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.164+0000 7f1262358700 1 -- 172.21.15.6:0/2119135774 shutdown_connections 2023-10-06T02:25:59.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.164+0000 7f1262358700 1 -- 172.21.15.6:0/2119135774 wait complete. 2023-10-06T02:25:59.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.165+0000 7f1262358700 1 Processor -- start 2023-10-06T02:25:59.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.165+0000 7f1262358700 1 -- start start 2023-10-06T02:25:59.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.166+0000 7f1262358700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f125c0b3c50 0x7f125c0abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.166+0000 7f1262358700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f125c15b3c0 0x7f125c0c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.166+0000 7f1262358700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f125c15bcd0 0x7f125c156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.166+0000 7f1262358700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c0c4090 con 0x7f125c15b3c0 2023-10-06T02:25:59.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.166+0000 7f1262358700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c0ad1c0 con 0x7f125c15bcd0 2023-10-06T02:25:59.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.166+0000 7f1262358700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125c0ac5b0 con 0x7f125c0b3c50 2023-10-06T02:25:59.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.166+0000 7f125b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f125c15b3c0 0x7f125c0c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.166+0000 7f125b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f125c15b3c0 0x7f125c0c3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38242/0 (socket says 172.21.15.6:38242) 2023-10-06T02:25:59.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.166+0000 7f125b7fe700 1 -- 172.21.15.6:0/2145451845 learned_addr learned my addr 172.21.15.6:0/2145451845 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:59.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.166+0000 7f12608f5700 1 --2- 172.21.15.6:0/2145451845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f125c15bcd0 0x7f125c156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.166+0000 7f125bfff700 1 --2- 172.21.15.6:0/2145451845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f125c0b3c50 0x7f125c0abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.166+0000 7f125b7fe700 1 -- 172.21.15.6:0/2145451845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f125c0b3c50 msgr2=0x7f125c0abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.166+0000 7f125b7fe700 1 --2- 172.21.15.6:0/2145451845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f125c0b3c50 0x7f125c0abf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.166+0000 7f125b7fe700 1 -- 172.21.15.6:0/2145451845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f125c15bcd0 msgr2=0x7f125c156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.166+0000 7f125b7fe700 1 --2- 172.21.15.6:0/2145451845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f125c15bcd0 0x7f125c156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.166+0000 7f125b7fe700 1 -- 172.21.15.6:0/2145451845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1250009420 con 0x7f125c15b3c0 2023-10-06T02:25:59.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.166+0000 7f12608f5700 1 --2- 172.21.15.6:0/2145451845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f125c15bcd0 0x7f125c156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:59.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.167+0000 7f125b7fe700 1 --2- 172.21.15.6:0/2145451845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f125c15b3c0 0x7f125c0c3b50 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f12500093f0 tx=0x7f1250017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:59.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.167+0000 7f1243fff700 1 -- 172.21.15.6:0/2145451845 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250000c40 con 0x7f125c15b3c0 2023-10-06T02:25:59.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.167+0000 7f1243fff700 1 -- 172.21.15.6:0/2145451845 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125000b910 con 0x7f125c15b3c0 2023-10-06T02:25:59.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.167+0000 7f1262358700 1 -- 172.21.15.6:0/2145451845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125c0ac890 con 0x7f125c15b3c0 2023-10-06T02:25:59.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.167+0000 7f1243fff700 1 -- 172.21.15.6:0/2145451845 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250025670 con 0x7f125c15b3c0 2023-10-06T02:25:59.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.167+0000 7f1262358700 1 -- 172.21.15.6:0/2145451845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125c0ace50 con 0x7f125c15b3c0 2023-10-06T02:25:59.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.168+0000 7f1262358700 1 -- 172.21.15.6:0/2145451845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125c0b0b30 con 0x7f125c15b3c0 2023-10-06T02:25:59.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.168+0000 7f1243fff700 1 -- 172.21.15.6:0/2145451845 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1250023070 con 0x7f125c15b3c0 2023-10-06T02:25:59.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.169+0000 7f1243fff700 1 --2- 172.21.15.6:0/2145451845 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1248066f30 0x7f12480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.169+0000 7f1243fff700 1 -- 172.21.15.6:0/2145451845 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7152+0+0 (secure 0 0 0) 0x7f1250085d10 con 0x7f125c15b3c0 2023-10-06T02:25:59.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.169+0000 7f125bfff700 1 --2- 172.21.15.6:0/2145451845 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1248066f30 0x7f12480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.169+0000 7f125bfff700 1 --2- 172.21.15.6:0/2145451845 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1248066f30 0x7f12480693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f124c003770 tx=0x7f124c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:59.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.173+0000 7f1243fff700 1 -- 172.21.15.6:0/2145451845 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12500529e0 con 0x7f125c15b3c0 2023-10-06T02:25:59.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.412+0000 7f1262358700 1 -- 172.21.15.6:0/2145451845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f125c06e8d0 con 0x7f125c15b3c0 2023-10-06T02:25:59.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.412+0000 7f1243fff700 1 -- 172.21.15.6:0/2145451845 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 142 v142) v1 ==== 95+0+4595 (secure 0 0 0) 0x7f1250015090 con 0x7f125c15b3c0 2023-10-06T02:25:59.413 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:25:59.413 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":142,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3306486265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3306486265},{"type":"v1","addr":"172.21.15.6:6835","nonce":3306486265}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":142}],"filesystems":[{"mdsmap":{"epoch":141,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:25:58.221680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:25:59.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.414+0000 7f1262358700 1 -- 172.21.15.6:0/2145451845 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1248066f30 msgr2=0x7f12480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.414+0000 7f1262358700 1 --2- 172.21.15.6:0/2145451845 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1248066f30 0x7f12480693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f124c003770 tx=0x7f124c009040 comp rx=0 tx=0).stop 2023-10-06T02:25:59.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.414+0000 7f1262358700 1 -- 172.21.15.6:0/2145451845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f125c15b3c0 msgr2=0x7f125c0c3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.414+0000 7f1262358700 1 --2- 172.21.15.6:0/2145451845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f125c15b3c0 0x7f125c0c3b50 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f12500093f0 tx=0x7f1250017000 comp rx=0 tx=0).stop 2023-10-06T02:25:59.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.414+0000 7f1262358700 1 -- 172.21.15.6:0/2145451845 shutdown_connections 2023-10-06T02:25:59.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.414+0000 7f1262358700 1 --2- 172.21.15.6:0/2145451845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f125c15bcd0 0x7f125c156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.414+0000 7f1262358700 1 --2- 172.21.15.6:0/2145451845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f125c0b3c50 0x7f125c0abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.414+0000 7f1262358700 1 --2- 172.21.15.6:0/2145451845 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1248066f30 0x7f12480693e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.414+0000 7f1262358700 1 --2- 172.21.15.6:0/2145451845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f125c15b3c0 0x7f125c0c3b50 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.414+0000 7f1262358700 1 -- 172.21.15.6:0/2145451845 >> 172.21.15.6:0/2145451845 conn(0x7f125c067910 msgr2=0x7f125c157850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:59.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.414+0000 7f1262358700 1 -- 172.21.15.6:0/2145451845 shutdown_connections 2023-10-06T02:25:59.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.414+0000 7f1262358700 1 -- 172.21.15.6:0/2145451845 wait complete. 2023-10-06T02:25:59.416 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 142 2023-10-06T02:25:59.427 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete mds_snaptable' led to DAMAGED state 2023-10-06T02:25:59.427 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete mds0_inotable' 2023-10-06T02:25:59.427 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:59.427 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:25:59.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:59.428 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:25:59.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:25:59.443 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:25:59.443 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:25:59.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.602+0000 7fe8973db700 1 Processor -- start 2023-10-06T02:25:59.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.602+0000 7fe8973db700 1 -- start start 2023-10-06T02:25:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.603+0000 7fe8973db700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe890086ff0 0x7fe890087440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.603+0000 7fe8973db700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe8900b21b0 0x7fe8900b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.603+0000 7fe8973db700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe890087980 con 0x7fe89015a030 2023-10-06T02:25:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.603+0000 7fe8973db700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8900b0cf0 con 0x7fe8900b21b0 2023-10-06T02:25:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.603+0000 7fe8973db700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900b2b30 con 0x7fe890086ff0 2023-10-06T02:25:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.603+0000 7fe895177700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe89015a030 0x7fe89015a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57788/0 (socket says 172.21.15.6:57788) 2023-10-06T02:25:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.603+0000 7fe895177700 1 -- 172.21.15.6:0/2246898048 learned_addr learned my addr 172.21.15.6:0/2246898048 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:25:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.603+0000 7fe894976700 1 --2- 172.21.15.6:0/2246898048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe890086ff0 0x7fe890087440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.603+0000 7fe895978700 1 --2- 172.21.15.6:0/2246898048 >> v2:172.21.15.175:3300/0 conn(0x7fe8900b21b0 0x7fe8900b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.603+0000 7fe88ffff700 1 -- 172.21.15.6:0/2246898048 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570761341 0 0) 0x7fe890087980 con 0x7fe89015a030 2023-10-06T02:25:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.603+0000 7fe88ffff700 1 -- 172.21.15.6:0/2246898048 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe878003570 con 0x7fe89015a030 2023-10-06T02:25:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe88ffff700 1 -- 172.21.15.6:0/2246898048 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2907370333 0 0) 0x7fe878003570 con 0x7fe89015a030 2023-10-06T02:25:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe88ffff700 1 -- 172.21.15.6:0/2246898048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe890086ff0 msgr2=0x7fe890087440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe88ffff700 1 --2- 172.21.15.6:0/2246898048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe890086ff0 0x7fe890087440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe88ffff700 1 -- 172.21.15.6:0/2246898048 >> v2:172.21.15.175:3300/0 conn(0x7fe8900b21b0 msgr2=0x7fe8900b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe88ffff700 1 --2- 172.21.15.6:0/2246898048 >> v2:172.21.15.175:3300/0 conn(0x7fe8900b21b0 0x7fe8900b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe88ffff700 1 -- 172.21.15.6:0/2246898048 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8900afc50 con 0x7fe89015a030 2023-10-06T02:25:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe88ffff700 1 -- 172.21.15.6:0/2246898048 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fe888001470 con 0x7fe89015a030 2023-10-06T02:25:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe88ffff700 1 -- 172.21.15.6:0/2246898048 >> v1:172.21.15.6:6789/0 conn(0x7fe89015a030 legacy=0x7fe89015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe88ffff700 1 --2- 172.21.15.6:0/2246898048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe890086ff0 0x7fe878003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe88ffff700 1 --2- 172.21.15.6:0/2246898048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe878003fe0 0x7fe878004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe88ffff700 1 --2- 172.21.15.6:0/2246898048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe878004d50 0x7fe8780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe88ffff700 1 -- 172.21.15.6:0/2246898048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900b0cf0 con 0x7fe878003fe0 2023-10-06T02:25:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe88ffff700 1 -- 172.21.15.6:0/2246898048 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900b2b30 con 0x7fe878004d50 2023-10-06T02:25:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe88ffff700 1 -- 172.21.15.6:0/2246898048 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87800ba90 con 0x7fe890086ff0 2023-10-06T02:25:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe894976700 1 --2- 172.21.15.6:0/2246898048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe878003fe0 0x7fe878004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe895177700 1 --2- 172.21.15.6:0/2246898048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe890086ff0 0x7fe878003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe895978700 1 --2- 172.21.15.6:0/2246898048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe878004d50 0x7fe8780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe894976700 1 -- 172.21.15.6:0/2246898048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe890086ff0 msgr2=0x7fe878003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe894976700 1 --2- 172.21.15.6:0/2246898048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe890086ff0 0x7fe878003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe894976700 1 -- 172.21.15.6:0/2246898048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe878004d50 msgr2=0x7fe8780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe894976700 1 --2- 172.21.15.6:0/2246898048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe878004d50 0x7fe8780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe894976700 1 -- 172.21.15.6:0/2246898048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe878003570 con 0x7fe878003fe0 2023-10-06T02:25:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe895978700 1 --2- 172.21.15.6:0/2246898048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe878004d50 0x7fe8780051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe894976700 1 --2- 172.21.15.6:0/2246898048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe878003fe0 0x7fe878004810 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fe884009c00 tx=0x7fe8840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87ced8c21af0f14 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe88ffff700 1 -- 172.21.15.6:0/2246898048 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88400e6b0 con 0x7fe878003fe0 2023-10-06T02:25:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe88ffff700 1 -- 172.21.15.6:0/2246898048 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88400e810 con 0x7fe878003fe0 2023-10-06T02:25:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.604+0000 7fe88ffff700 1 -- 172.21.15.6:0/2246898048 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88400ebd0 con 0x7fe878003fe0 2023-10-06T02:25:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.605+0000 7fe8973db700 1 -- 172.21.15.6:0/2246898048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe878003fe0 msgr2=0x7fe878004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.605+0000 7fe8973db700 1 --2- 172.21.15.6:0/2246898048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe878003fe0 0x7fe878004810 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fe884009c00 tx=0x7fe8840091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.605+0000 7fe895978700 1 -- 172.21.15.6:0/2246898048 reap_dead start 2023-10-06T02:25:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.605+0000 7fe8973db700 1 -- 172.21.15.6:0/2246898048 shutdown_connections 2023-10-06T02:25:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.605+0000 7fe8973db700 1 -- 172.21.15.6:0/2246898048 >> 172.21.15.6:0/2246898048 conn(0x7fe890068680 msgr2=0x7fe890068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:59.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.605+0000 7fe8973db700 1 -- 172.21.15.6:0/2246898048 shutdown_connections 2023-10-06T02:25:59.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.605+0000 7fe8973db700 1 -- 172.21.15.6:0/2246898048 wait complete. 2023-10-06T02:25:59.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.606+0000 7fe8973db700 1 Processor -- start 2023-10-06T02:25:59.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.606+0000 7fe8973db700 1 -- start start 2023-10-06T02:25:59.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.607+0000 7fe8973db700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe878003fe0 0x7fe89016ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.607+0000 7fe8973db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe89015cd00 0x7fe89016e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.607+0000 7fe8973db700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe8900c9950 0x7fe89015a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.607+0000 7fe8973db700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900c8c70 con 0x7fe89015cd00 2023-10-06T02:25:59.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.607+0000 7fe8973db700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900c94c0 con 0x7fe878003fe0 2023-10-06T02:25:59.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.607+0000 7fe8973db700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900c6a10 con 0x7fe8900c9950 2023-10-06T02:25:59.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.607+0000 7fe894976700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe89015cd00 0x7fe89016e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.607+0000 7fe894976700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe89015cd00 0x7fe89016e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38256/0 (socket says 172.21.15.6:38256) 2023-10-06T02:25:59.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.607+0000 7fe894976700 1 -- 172.21.15.6:0/352941947 learned_addr learned my addr 172.21.15.6:0/352941947 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:25:59.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.607+0000 7fe895177700 1 --2- 172.21.15.6:0/352941947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe878003fe0 0x7fe89016ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.607+0000 7fe895978700 1 --2- 172.21.15.6:0/352941947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe8900c9950 0x7fe89015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.607+0000 7fe894976700 1 -- 172.21.15.6:0/352941947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe8900c9950 msgr2=0x7fe89015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.607+0000 7fe894976700 1 --2- 172.21.15.6:0/352941947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe8900c9950 0x7fe89015a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.607+0000 7fe894976700 1 -- 172.21.15.6:0/352941947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe878003fe0 msgr2=0x7fe89016ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.607+0000 7fe894976700 1 --2- 172.21.15.6:0/352941947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe878003fe0 0x7fe89016ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.607+0000 7fe894976700 1 -- 172.21.15.6:0/352941947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8900c8e70 con 0x7fe89015cd00 2023-10-06T02:25:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.607+0000 7fe895177700 1 --2- 172.21.15.6:0/352941947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe878003fe0 0x7fe89016ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.608+0000 7fe894976700 1 --2- 172.21.15.6:0/352941947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe89015cd00 0x7fe89016e2f0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fe8840091e0 tx=0x7fe88401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.608+0000 7fe88d7fa700 1 -- 172.21.15.6:0/352941947 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884022070 con 0x7fe89015cd00 2023-10-06T02:25:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.608+0000 7fe88d7fa700 1 -- 172.21.15.6:0/352941947 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88400e980 con 0x7fe89015cd00 2023-10-06T02:25:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.608+0000 7fe8973db700 1 -- 172.21.15.6:0/352941947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8900c9150 con 0x7fe89015cd00 2023-10-06T02:25:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.608+0000 7fe88d7fa700 1 -- 172.21.15.6:0/352941947 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884027470 con 0x7fe89015cd00 2023-10-06T02:25:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.608+0000 7fe8973db700 1 -- 172.21.15.6:0/352941947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8900c3d20 con 0x7fe89015cd00 2023-10-06T02:25:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.609+0000 7fe8973db700 1 -- 172.21.15.6:0/352941947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8900c3f10 con 0x7fe89015cd00 2023-10-06T02:25:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.609+0000 7fe88d7fa700 1 -- 172.21.15.6:0/352941947 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe88401c450 con 0x7fe89015cd00 2023-10-06T02:25:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.609+0000 7fe88d7fa700 1 --2- 172.21.15.6:0/352941947 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe87c066f30 0x7fe87c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.610+0000 7fe88d7fa700 1 -- 172.21.15.6:0/352941947 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7152+0+0 (secure 0 0 0) 0x7fe8840865b0 con 0x7fe89015cd00 2023-10-06T02:25:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.610+0000 7fe895177700 1 --2- 172.21.15.6:0/352941947 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe87c066f30 0x7fe87c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.610+0000 7fe895177700 1 --2- 172.21.15.6:0/352941947 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe87c066f30 0x7fe87c0693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe888000e10 tx=0x7fe888009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.614+0000 7fe88d7fa700 1 -- 172.21.15.6:0/352941947 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8900c3f10 con 0x7fe89015cd00 2023-10-06T02:25:59.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:25:59.853+0000 7fe8973db700 1 -- 172.21.15.6:0/352941947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe8900c3f10 con 0x7fe89015cd00 2023-10-06T02:26:00.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.823+0000 7fe88d7fa700 1 -- 172.21.15.6:0/352941947 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v143) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe8900c3f10 con 0x7fe89015cd00 2023-10-06T02:26:00.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.826+0000 7fe8973db700 1 -- 172.21.15.6:0/352941947 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe87c066f30 msgr2=0x7fe87c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:00.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.826+0000 7fe8973db700 1 --2- 172.21.15.6:0/352941947 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe87c066f30 0x7fe87c0693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe888000e10 tx=0x7fe888009040 comp rx=0 tx=0).stop 2023-10-06T02:26:00.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.826+0000 7fe8973db700 1 -- 172.21.15.6:0/352941947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe89015cd00 msgr2=0x7fe89016e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:00.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.826+0000 7fe8973db700 1 --2- 172.21.15.6:0/352941947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe89015cd00 0x7fe89016e2f0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fe8840091e0 tx=0x7fe88401a000 comp rx=0 tx=0).stop 2023-10-06T02:26:00.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.826+0000 7fe8973db700 1 -- 172.21.15.6:0/352941947 shutdown_connections 2023-10-06T02:26:00.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.826+0000 7fe8973db700 1 --2- 172.21.15.6:0/352941947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe8900c9950 0x7fe89015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:00.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.826+0000 7fe8973db700 1 --2- 172.21.15.6:0/352941947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe878003fe0 0x7fe89016ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:00.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.826+0000 7fe8973db700 1 --2- 172.21.15.6:0/352941947 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe87c066f30 0x7fe87c0693e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:00.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.826+0000 7fe8973db700 1 --2- 172.21.15.6:0/352941947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe89015cd00 0x7fe89016e2f0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:00.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.826+0000 7fe8973db700 1 -- 172.21.15.6:0/352941947 >> 172.21.15.6:0/352941947 conn(0x7fe890068680 msgr2=0x7fe8900b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:00.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.826+0000 7fe8973db700 1 -- 172.21.15.6:0/352941947 shutdown_connections 2023-10-06T02:26:00.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.826+0000 7fe8973db700 1 -- 172.21.15.6:0/352941947 wait complete. 2023-10-06T02:26:00.828 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:26:00.841 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:26:00.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.967+0000 7f50b79bf700 1 Processor -- start 2023-10-06T02:26:00.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.968+0000 7f50b79bf700 1 -- start start 2023-10-06T02:26:00.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.968+0000 7f50b79bf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50b0069a20 0x7f50b015a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:00.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.968+0000 7f50b79bf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50b0069df0 0x7f50b0157110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:00.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.968+0000 7f50b79bf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b0150bd0 con 0x7f50b00cbb70 2023-10-06T02:26:00.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.968+0000 7f50b79bf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b0157650 con 0x7f50b0069a20 2023-10-06T02:26:00.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.968+0000 7f50b79bf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b00c7180 con 0x7f50b0069df0 2023-10-06T02:26:00.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.969+0000 7f50b575b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50b0069a20 0x7f50b015a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:00.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.969+0000 7f50b5f5c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f50b00cbb70 0x7f50b0068680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57798/0 (socket says 172.21.15.6:57798) 2023-10-06T02:26:00.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.969+0000 7f50b5f5c700 1 -- 172.21.15.6:0/3154179825 learned_addr learned my addr 172.21.15.6:0/3154179825 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:00.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.969+0000 7f50b575b700 1 -- 172.21.15.6:0/3154179825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50b0069df0 msgr2=0x7f50b0157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:00.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.969+0000 7f50b575b700 1 --2- 172.21.15.6:0/3154179825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50b0069df0 0x7f50b0157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:00.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.969+0000 7f50b575b700 1 -- 172.21.15.6:0/3154179825 >> v1:172.21.15.6:6789/0 conn(0x7f50b00cbb70 legacy=0x7f50b0068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:00.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.969+0000 7f50b575b700 1 -- 172.21.15.6:0/3154179825 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b0159d60 con 0x7f50b0069a20 2023-10-06T02:26:00.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.969+0000 7f50affff700 1 -- 172.21.15.6:0/3154179825 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743102244 0 0) 0x7f50a0001490 con 0x7f50b00cbb70 2023-10-06T02:26:00.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.969+0000 7f50b575b700 1 --2- 172.21.15.6:0/3154179825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b0069a20 0x7f50b015a840 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f50a80098e0 tx=0x7f50a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7355438078320331 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:00.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.969+0000 7f50affff700 1 -- 172.21.15.6:0/3154179825 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a8009e80 con 0x7f50b0069a20 2023-10-06T02:26:00.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.969+0000 7f50affff700 1 -- 172.21.15.6:0/3154179825 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a800b860 con 0x7f50b0069a20 2023-10-06T02:26:00.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.969+0000 7f50affff700 1 -- 172.21.15.6:0/3154179825 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800bbe0 con 0x7f50b0069a20 2023-10-06T02:26:00.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.970+0000 7f50b79bf700 1 -- 172.21.15.6:0/3154179825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b0069a20 msgr2=0x7f50b015a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:00.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.970+0000 7f50b79bf700 1 --2- 172.21.15.6:0/3154179825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b0069a20 0x7f50b015a840 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f50a80098e0 tx=0x7f50a80091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:00.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.970+0000 7f50b79bf700 1 -- 172.21.15.6:0/3154179825 shutdown_connections 2023-10-06T02:26:00.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.970+0000 7f50b79bf700 1 --2- 172.21.15.6:0/3154179825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b0069a20 0x7f50b015a840 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:00.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.970+0000 7f50b79bf700 1 --2- 172.21.15.6:0/3154179825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50b0069df0 0x7f50b0157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:00.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.970+0000 7f50b79bf700 1 -- 172.21.15.6:0/3154179825 >> 172.21.15.6:0/3154179825 conn(0x7f50b00c9cc0 msgr2=0x7f50b006acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:00.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.970+0000 7f50b79bf700 1 -- 172.21.15.6:0/3154179825 shutdown_connections 2023-10-06T02:26:00.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.970+0000 7f50b79bf700 1 -- 172.21.15.6:0/3154179825 wait complete. 2023-10-06T02:26:00.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.971+0000 7f50b79bf700 1 Processor -- start 2023-10-06T02:26:00.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.971+0000 7f50b79bf700 1 -- start start 2023-10-06T02:26:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.972+0000 7f50b79bf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50b0069a20 0x7f50b0141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.972+0000 7f50b79bf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b00cbb70 0x7f50b00abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.972+0000 7f50b79bf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50b00ae180 0x7f50b00c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.972+0000 7f50b79bf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b00c1930 con 0x7f50b00cbb70 2023-10-06T02:26:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.972+0000 7f50b79bf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b00ae6f0 con 0x7f50b00ae180 2023-10-06T02:26:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.972+0000 7f50b79bf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b00ae9d0 con 0x7f50b0069a20 2023-10-06T02:26:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.972+0000 7f50b4f5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b00cbb70 0x7f50b00abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.972+0000 7f50b4f5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b00cbb70 0x7f50b00abb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38278/0 (socket says 172.21.15.6:38278) 2023-10-06T02:26:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.972+0000 7f50b4f5a700 1 -- 172.21.15.6:0/851620274 learned_addr learned my addr 172.21.15.6:0/851620274 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.972+0000 7f50b575b700 1 --2- 172.21.15.6:0/851620274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50b0069a20 0x7f50b0141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.972+0000 7f50b4f5a700 1 -- 172.21.15.6:0/851620274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50b0069a20 msgr2=0x7f50b0141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.972+0000 7f50b4f5a700 1 --2- 172.21.15.6:0/851620274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50b0069a20 0x7f50b0141920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.972+0000 7f50b4f5a700 1 -- 172.21.15.6:0/851620274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50b00ae180 msgr2=0x7f50b00c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.972+0000 7f50b5f5c700 1 --2- 172.21.15.6:0/851620274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50b00ae180 0x7f50b00c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.972+0000 7f50b4f5a700 1 --2- 172.21.15.6:0/851620274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50b00ae180 0x7f50b00c5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.973+0000 7f50b4f5a700 1 -- 172.21.15.6:0/851620274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a8009420 con 0x7f50b00cbb70 2023-10-06T02:26:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.973+0000 7f50b4f5a700 1 --2- 172.21.15.6:0/851620274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b00cbb70 0x7f50b00abb50 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f50a400b810 tx=0x7f50a4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.973+0000 7f50ad7fa700 1 -- 172.21.15.6:0/851620274 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a400f5f0 con 0x7f50b00cbb70 2023-10-06T02:26:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.973+0000 7f50ad7fa700 1 -- 172.21.15.6:0/851620274 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a400f750 con 0x7f50b00cbb70 2023-10-06T02:26:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.973+0000 7f50b79bf700 1 -- 172.21.15.6:0/851620274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b00aecb0 con 0x7f50b00cbb70 2023-10-06T02:26:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.973+0000 7f50ad7fa700 1 -- 172.21.15.6:0/851620274 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a400fb10 con 0x7f50b00cbb70 2023-10-06T02:26:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.973+0000 7f50b79bf700 1 -- 172.21.15.6:0/851620274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b0141e60 con 0x7f50b00cbb70 2023-10-06T02:26:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.974+0000 7f50b79bf700 1 -- 172.21.15.6:0/851620274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b006e140 con 0x7f50b00cbb70 2023-10-06T02:26:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.974+0000 7f50ad7fa700 1 -- 172.21.15.6:0/851620274 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50a4010480 con 0x7f50b00cbb70 2023-10-06T02:26:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.975+0000 7f50ad7fa700 1 --2- 172.21.15.6:0/851620274 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f509c066f30 0x7f509c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.975+0000 7f50ad7fa700 1 -- 172.21.15.6:0/851620274 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7152+0+0 (secure 0 0 0) 0x7f50a40849e0 con 0x7f50b00cbb70 2023-10-06T02:26:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.975+0000 7f50b575b700 1 --2- 172.21.15.6:0/851620274 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f509c066f30 0x7f509c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:00.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.975+0000 7f50b575b700 1 --2- 172.21.15.6:0/851620274 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f509c066f30 0x7f509c0693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f50a800c010 tx=0x7f50a8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:00.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:00.979+0000 7f50ad7fa700 1 -- 172.21.15.6:0/851620274 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50a4051730 con 0x7f50b00cbb70 2023-10-06T02:26:01.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:01.258+0000 7f50b79bf700 1 -- 172.21.15.6:0/851620274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f50b00c1a70 con 0x7f50b00cbb70 2023-10-06T02:26:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.235+0000 7f50ad7fa700 1 -- 172.21.15.6:0/851620274 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v144) v1 ==== 101+0+0 (secure 0 0 0) 0x7f50a4054d50 con 0x7f50b00cbb70 2023-10-06T02:26:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.238+0000 7f50b79bf700 1 -- 172.21.15.6:0/851620274 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f509c066f30 msgr2=0x7f509c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.238+0000 7f50b79bf700 1 --2- 172.21.15.6:0/851620274 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f509c066f30 0x7f509c0693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f50a800c010 tx=0x7f50a8017000 comp rx=0 tx=0).stop 2023-10-06T02:26:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.238+0000 7f50b79bf700 1 -- 172.21.15.6:0/851620274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b00cbb70 msgr2=0x7f50b00abb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.238+0000 7f50b79bf700 1 --2- 172.21.15.6:0/851620274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b00cbb70 0x7f50b00abb50 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f50a400b810 tx=0x7f50a4009220 comp rx=0 tx=0).stop 2023-10-06T02:26:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.238+0000 7f50b79bf700 1 -- 172.21.15.6:0/851620274 shutdown_connections 2023-10-06T02:26:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.238+0000 7f50b79bf700 1 --2- 172.21.15.6:0/851620274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50b00ae180 0x7f50b00c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.238+0000 7f50b79bf700 1 --2- 172.21.15.6:0/851620274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50b0069a20 0x7f50b0141920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.238+0000 7f50b79bf700 1 --2- 172.21.15.6:0/851620274 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f509c066f30 0x7f509c0693e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.238+0000 7f50b79bf700 1 --2- 172.21.15.6:0/851620274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b00cbb70 0x7f50b00abb50 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.238+0000 7f50b79bf700 1 -- 172.21.15.6:0/851620274 >> 172.21.15.6:0/851620274 conn(0x7f50b00c9cc0 msgr2=0x7f50b0156b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.238+0000 7f50b79bf700 1 -- 172.21.15.6:0/851620274 shutdown_connections 2023-10-06T02:26:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.238+0000 7f50b79bf700 1 -- 172.21.15.6:0/851620274 wait complete. 2023-10-06T02:26:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:26:02.253 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:26:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.293+0000 7f1670adb000 1 Processor -- start 2023-10-06T02:26:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.293+0000 7f1670adb000 1 -- start start 2023-10-06T02:26:02.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.294+0000 7f1670adb000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c59acead60 0x55c59acecd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.294+0000 7f1670adb000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c59ad06410 0x55c59acc1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.294+0000 7f1670adb000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c59ad95f90 0x55c59ad8cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.294+0000 7f1670adb000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c59ac0a620 con 0x55c59ad06410 2023-10-06T02:26:02.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.294+0000 7f1670adb000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c59ac01400 con 0x55c59acead60 2023-10-06T02:26:02.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.294+0000 7f1670adb000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c59ad98b60 con 0x55c59ad95f90 2023-10-06T02:26:02.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.294+0000 7f1669515700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c59ad06410 0x55c59acc1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.294+0000 7f1669515700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c59ad06410 0x55c59acc1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38296/0 (socket says 172.21.15.6:38296) 2023-10-06T02:26:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.294+0000 7f1669515700 1 -- 172.21.15.6:0/898533641 learned_addr learned my addr 172.21.15.6:0/898533641 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.294+0000 7f1669d16700 1 --2- 172.21.15.6:0/898533641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c59acead60 0x55c59acecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.294+0000 7f166a517700 1 --2- 172.21.15.6:0/898533641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c59ad95f90 0x55c59ad8cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.295+0000 7f1669515700 1 -- 172.21.15.6:0/898533641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c59ad95f90 msgr2=0x55c59ad8cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.295+0000 7f1669515700 1 --2- 172.21.15.6:0/898533641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c59ad95f90 0x55c59ad8cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.295+0000 7f1669515700 1 -- 172.21.15.6:0/898533641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c59acead60 msgr2=0x55c59acecd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.295+0000 7f1669515700 1 --2- 172.21.15.6:0/898533641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c59acead60 0x55c59acecd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.295+0000 7f1669515700 1 -- 172.21.15.6:0/898533641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166400a180 con 0x55c59ad06410 2023-10-06T02:26:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.295+0000 7f1669515700 1 --2- 172.21.15.6:0/898533641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c59ad06410 0x55c59acc1a80 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f166000a840 tx=0x7f1660005d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cfbfb7cf2885a93 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.295+0000 7f165bfff700 1 -- 172.21.15.6:0/898533641 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166000f070 con 0x55c59ad06410 2023-10-06T02:26:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.295+0000 7f165bfff700 1 -- 172.21.15.6:0/898533641 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16600084f0 con 0x55c59ad06410 2023-10-06T02:26:02.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.295+0000 7f165bfff700 1 -- 172.21.15.6:0/898533641 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660008890 con 0x55c59ad06410 2023-10-06T02:26:02.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.296+0000 7f1670adb000 1 -- 172.21.15.6:0/898533641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c59ad06410 msgr2=0x55c59acc1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.296+0000 7f1670adb000 1 --2- 172.21.15.6:0/898533641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c59ad06410 0x55c59acc1a80 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f166000a840 tx=0x7f1660005d00 comp rx=0 tx=0).stop 2023-10-06T02:26:02.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.296+0000 7f1670adb000 1 -- 172.21.15.6:0/898533641 shutdown_connections 2023-10-06T02:26:02.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.296+0000 7f1670adb000 1 --2- 172.21.15.6:0/898533641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c59ad95f90 0x55c59ad8cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.296+0000 7f1670adb000 1 --2- 172.21.15.6:0/898533641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c59acead60 0x55c59acecd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.296+0000 7f1670adb000 1 --2- 172.21.15.6:0/898533641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c59ad06410 0x55c59acc1a80 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.296+0000 7f1670adb000 1 -- 172.21.15.6:0/898533641 >> 172.21.15.6:0/898533641 conn(0x55c59acbfd50 msgr2=0x55c59acef0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:02.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.296+0000 7f1670adb000 1 -- 172.21.15.6:0/898533641 shutdown_connections 2023-10-06T02:26:02.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.296+0000 7f1670adb000 1 -- 172.21.15.6:0/898533641 wait complete. 2023-10-06T02:26:02.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.296+0000 7f1670adb000 1 Processor -- start 2023-10-06T02:26:02.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.296+0000 7f1670adb000 1 -- start start 2023-10-06T02:26:02.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.297+0000 7f1670adb000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c59acead60 0x55c59ad8e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.297+0000 7f1670adb000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c59ad06410 0x55c59ad8d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.297+0000 7f1670adb000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c59ad95f90 0x55c59acc1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.297+0000 7f1670adb000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c59ad8f6e0 con 0x55c59ad06410 2023-10-06T02:26:02.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.297+0000 7f1670adb000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c59ad8edd0 con 0x55c59acead60 2023-10-06T02:26:02.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.297+0000 7f1670adb000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c59ad8f060 con 0x55c59ad95f90 2023-10-06T02:26:02.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.297+0000 7f1669515700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c59ad06410 0x55c59ad8d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.297+0000 7f1669515700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c59ad06410 0x55c59ad8d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38310/0 (socket says 172.21.15.6:38310) 2023-10-06T02:26:02.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.297+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 learned_addr learned my addr 172.21.15.6:0/4245148877 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:02.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.297+0000 7f166a517700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c59ad95f90 0x55c59acc1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.297+0000 7f1669d16700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c59acead60 0x55c59ad8e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.298+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c59ad95f90 msgr2=0x55c59acc1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.298+0000 7f1669515700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c59ad95f90 0x55c59acc1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.298+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c59acead60 msgr2=0x55c59ad8e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.298+0000 7f1669515700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c59acead60 0x55c59ad8e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.298+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166000a440 con 0x55c59ad06410 2023-10-06T02:26:02.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.298+0000 7f1669515700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c59ad06410 0x55c59ad8d610 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f166000ae30 tx=0x7f1660017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:02.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.298+0000 7f165a7fc700 1 -- 172.21.15.6:0/4245148877 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660005350 con 0x55c59ad06410 2023-10-06T02:26:02.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.298+0000 7f165a7fc700 1 -- 172.21.15.6:0/4245148877 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1660015720 con 0x55c59ad06410 2023-10-06T02:26:02.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.298+0000 7f165a7fc700 1 -- 172.21.15.6:0/4245148877 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660015ae0 con 0x55c59ad06410 2023-10-06T02:26:02.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.298+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c59ac331c0 con 0x55c59ad06410 2023-10-06T02:26:02.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.298+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c59ac193d0 con 0x55c59ad06410 2023-10-06T02:26:02.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.299+0000 7f165a7fc700 1 -- 172.21.15.6:0/4245148877 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1660013070 con 0x55c59ad06410 2023-10-06T02:26:02.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.300+0000 7f165a7fc700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f164c0658c0 0x7f164c067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.300+0000 7f165a7fc700 1 -- 172.21.15.6:0/4245148877 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7152+0+0 (secure 0 0 0) 0x7f1660085290 con 0x55c59ad06410 2023-10-06T02:26:02.303 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:26:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.300+0000 7f1669d16700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f164c0658c0 0x7f164c067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.300+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55c59acef590 0x55c59ad94000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.300+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59ad94540 con 0x55c59acef590 2023-10-06T02:26:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.300+0000 7f166a517700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55c59acef590 0x55c59ad94000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.301+0000 7f166a517700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55c59acef590 0x55c59ad94000 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.301+0000 7f1669d16700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f164c0658c0 0x7f164c067d70 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f165c005fd0 tx=0x7f165c005b10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.302+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v104'257 uv231 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.302+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59ad94920 con 0x55c59acef590 2023-10-06T02:26:02.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.303+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v104'258 uv258 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.303+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb2f60 con 0x55c59acef590 2023-10-06T02:26:02.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.306+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v104'259 uv259 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.306 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:26:02.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.306+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb4320 con 0x55c59acef590 2023-10-06T02:26:02.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.308+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v104'260 uv260 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.308+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb46d0 con 0x55c59acef590 2023-10-06T02:26:02.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.310+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v104'261 uv261 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.310+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb3310 con 0x55c59acef590 2023-10-06T02:26:02.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.313+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v104'262 uv262 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.313+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb3710 con 0x55c59acef590 2023-10-06T02:26:02.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.315+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v104'263 uv237 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.315+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb3b10 con 0x55c59acef590 2023-10-06T02:26:02.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.316+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v104'264 uv264 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.316+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb3b10 con 0x55c59acef590 2023-10-06T02:26:02.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.317+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v104'265 uv265 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.318 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:26:02.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.318+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb3b10 con 0x55c59acef590 2023-10-06T02:26:02.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.319+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v104'266 uv266 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.319+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb3b10 con 0x55c59acef590 2023-10-06T02:26:02.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.320+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v104'267 uv267 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.320+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb3b10 con 0x55c59acef590 2023-10-06T02:26:02.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.321+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v104'268 uv268 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.321+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb3b10 con 0x55c59acef590 2023-10-06T02:26:02.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.322+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v104'269 uv244 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.322+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb3b10 con 0x55c59acef590 2023-10-06T02:26:02.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.323+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v104'270 uv270 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.323+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb3b10 con 0x55c59acef590 2023-10-06T02:26:02.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.324+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v104'271 uv271 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.325 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:26:02.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.324+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb3b10 con 0x55c59acef590 2023-10-06T02:26:02.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.325+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v104'272 uv272 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.325+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb3b10 con 0x55c59acef590 2023-10-06T02:26:02.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.327+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v104'273 uv273 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.327+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb3b10 con 0x55c59acef590 2023-10-06T02:26:02.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.328+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v104'274 uv274 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.328+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb4a80 con 0x55c59acef590 2023-10-06T02:26:02.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.329+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v104'275 uv275 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.329+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb4a80 con 0x55c59acef590 2023-10-06T02:26:02.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.330+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v104'276 uv250 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.331+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb4a80 con 0x55c59acef590 2023-10-06T02:26:02.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.332+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v104'277 uv277 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.332+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb4a80 con 0x55c59acef590 2023-10-06T02:26:02.333 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:26:02.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.333+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v104'278 uv278 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.333+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb5a90 con 0x55c59acef590 2023-10-06T02:26:02.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.334+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v104'279 uv279 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.334+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb5a90 con 0x55c59acef590 2023-10-06T02:26:02.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.335+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v104'280 uv280 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.335+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb4a80 con 0x55c59acef590 2023-10-06T02:26:02.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.336+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v104'281 uv281 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.336+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb4a80 con 0x55c59acef590 2023-10-06T02:26:02.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.337+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v104'282 uv256 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.337+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb4a80 con 0x55c59acef590 2023-10-06T02:26:02.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.338+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v104'283 uv283 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.338+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb4a80 con 0x55c59acef590 2023-10-06T02:26:02.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.339+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v104'284 uv284 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.340 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:26:02.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.339+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb5a90 con 0x55c59acef590 2023-10-06T02:26:02.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.341+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v104'285 uv285 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.341+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb5a90 con 0x55c59acef590 2023-10-06T02:26:02.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.342+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v104'286 uv286 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.342+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb4a80 con 0x55c59acef590 2023-10-06T02:26:02.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.343+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v104'287 uv287 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59acef590 2023-10-06T02:26:02.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.343+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55c59adb4f90 0x55c59adb7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.343+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb78b0 con 0x55c59adb4f90 2023-10-06T02:26:02.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.343+0000 7f1669d16700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55c59adb4f90 0x55c59adb7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.344+0000 7f1669d16700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55c59adb4f90 0x55c59adb7370 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:02.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.345+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v104'194 uv177 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.345+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb7c60 con 0x55c59adb4f90 2023-10-06T02:26:02.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.346+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v104'195 uv195 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.346+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb8010 con 0x55c59adb4f90 2023-10-06T02:26:02.347 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:26:02.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.347+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v104'196 uv196 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.347+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb88b0 con 0x55c59adb4f90 2023-10-06T02:26:02.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.348+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v104'197 uv197 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.348+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb8c60 con 0x55c59adb4f90 2023-10-06T02:26:02.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.349+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v104'198 uv198 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.349+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb9010 con 0x55c59adb4f90 2023-10-06T02:26:02.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.350+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v104'199 uv182 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.350+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb93c0 con 0x55c59adb4f90 2023-10-06T02:26:02.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.351+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v104'200 uv200 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.351+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb93c0 con 0x55c59adb4f90 2023-10-06T02:26:02.353 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:26:02.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.352+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v104'201 uv201 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.352+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb93c0 con 0x55c59adb4f90 2023-10-06T02:26:02.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.353+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v104'202 uv202 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.353+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb93c0 con 0x55c59adb4f90 2023-10-06T02:26:02.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.354+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v104'203 uv203 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.354+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb93c0 con 0x55c59adb4f90 2023-10-06T02:26:02.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.355+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v104'204 uv187 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.355+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb93c0 con 0x55c59adb4f90 2023-10-06T02:26:02.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.356+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v104'205 uv205 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.357+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb93c0 con 0x55c59adb4f90 2023-10-06T02:26:02.358 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:26:02.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.357+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v104'206 uv206 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.358+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbcae0 con 0x55c59adb4f90 2023-10-06T02:26:02.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.359+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v104'207 uv207 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.359+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbcae0 con 0x55c59adb4f90 2023-10-06T02:26:02.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.360+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v104'208 uv208 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.360+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb93c0 con 0x55c59adb4f90 2023-10-06T02:26:02.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.361+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v104'209 uv193 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.361+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb93c0 con 0x55c59adb4f90 2023-10-06T02:26:02.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.362+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v104'210 uv210 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.362+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb93c0 con 0x55c59adb4f90 2023-10-06T02:26:02.363 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:26:02.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.363+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v104'211 uv211 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.363+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adba3d0 con 0x55c59adb4f90 2023-10-06T02:26:02.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.364+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v104'212 uv212 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.364+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adba3d0 con 0x55c59adb4f90 2023-10-06T02:26:02.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.365+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v104'213 uv213 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.365+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adb93c0 con 0x55c59adb4f90 2023-10-06T02:26:02.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.366+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v104'214 uv214 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.366+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55c59adb98d0 0x55c59adbbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.366+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbc1f0 con 0x55c59adb98d0 2023-10-06T02:26:02.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.366+0000 7f1669515700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55c59adb98d0 0x55c59adbbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.366+0000 7f1669515700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55c59adb98d0 0x55c59adbbcb0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:02.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.367+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v104'51 uv50 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.367+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbc5a0 con 0x55c59adb98d0 2023-10-06T02:26:02.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.368+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v104'52 uv52 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.368+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbc950 con 0x55c59adb98d0 2023-10-06T02:26:02.369 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:26:02.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.369+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v104'53 uv53 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.369+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbdd10 con 0x55c59adb98d0 2023-10-06T02:26:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.370+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v104'54 uv54 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.370+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbe0c0 con 0x55c59adb98d0 2023-10-06T02:26:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.371+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v104'55 uv55 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.371+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbcd00 con 0x55c59adb98d0 2023-10-06T02:26:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.372+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v104'56 uv56 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.372+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbd0b0 con 0x55c59adb98d0 2023-10-06T02:26:02.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.375+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v104'39 uv38 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.376+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbd520 con 0x55c59adb98d0 2023-10-06T02:26:02.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.377+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v104'40 uv40 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.377+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbd940 con 0x55c59adb98d0 2023-10-06T02:26:02.379 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:26:02.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.379+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v104'41 uv41 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.379+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbd940 con 0x55c59adb98d0 2023-10-06T02:26:02.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.381+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v104'42 uv42 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.382+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbd640 con 0x55c59adb4f90 2023-10-06T02:26:02.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.383+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v104'51 uv50 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.383+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbd640 con 0x55c59adb4f90 2023-10-06T02:26:02.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.384+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v104'52 uv52 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.384+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbd640 con 0x55c59adb4f90 2023-10-06T02:26:02.385 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:26:02.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.385+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v104'53 uv53 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.385+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbd640 con 0x55c59adb4f90 2023-10-06T02:26:02.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.386+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v104'54 uv54 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.386+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbd640 con 0x55c59adb4f90 2023-10-06T02:26:02.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.387+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v104'55 uv55 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.387+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbd640 con 0x55c59adb4f90 2023-10-06T02:26:02.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.388+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v104'56 uv56 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adb4f90 2023-10-06T02:26:02.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.388+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c59adbe980 0x55c59adc0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.388+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adbd640 con 0x55c59adbe980 2023-10-06T02:26:02.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.388+0000 7f166a517700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c59adbe980 0x55c59adc0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.388+0000 7f166a517700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c59adbe980 0x55c59adc0d60 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.389+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v104'94 uv88 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adbe980 2023-10-06T02:26:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.389+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc12a0 con 0x55c59adbe980 2023-10-06T02:26:02.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.390+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v104'95 uv95 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adbe980 2023-10-06T02:26:02.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.390+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc12a0 con 0x55c59adbe980 2023-10-06T02:26:02.392 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:26:02.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.391+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v104'96 uv96 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adbe980 2023-10-06T02:26:02.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.391+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc22b0 con 0x55c59adbe980 2023-10-06T02:26:02.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.392+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v104'97 uv97 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adbe980 2023-10-06T02:26:02.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.392+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc22b0 con 0x55c59adbe980 2023-10-06T02:26:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.393+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v104'98 uv98 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adbe980 2023-10-06T02:26:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.393+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc12a0 con 0x55c59adbe980 2023-10-06T02:26:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.394+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v104'99 uv99 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adbe980 2023-10-06T02:26:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.395+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc12a0 con 0x55c59adbe980 2023-10-06T02:26:02.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.395+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v104'100 uv93 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adbe980 2023-10-06T02:26:02.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.396+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc12a0 con 0x55c59adbe980 2023-10-06T02:26:02.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.396+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v104'101 uv101 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adbe980 2023-10-06T02:26:02.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.397+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc12a0 con 0x55c59adbe980 2023-10-06T02:26:02.398 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:26:02.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.398+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v104'102 uv102 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adbe980 2023-10-06T02:26:02.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.398+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc12a0 con 0x55c59adbe980 2023-10-06T02:26:02.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.399+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v104'103 uv103 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adbe980 2023-10-06T02:26:02.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.399+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc12a0 con 0x55c59adbe980 2023-10-06T02:26:02.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.400+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v104'104 uv104 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adbe980 2023-10-06T02:26:02.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.400+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55c59adc1920 0x55c59adc3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.400+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc4360 con 0x55c59adc1920 2023-10-06T02:26:02.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.400+0000 7f1669d16700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55c59adc1920 0x55c59adc3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.401+0000 7f1669d16700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55c59adc1920 0x55c59adc3d00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:02.402 INFO:teuthology.orchestra.run.smithi006.stdout:Write #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:26:02.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.402+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v104'43 uv43 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adc1920 2023-10-06T02:26:02.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.402+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc43e0 con 0x55c59adc1920 2023-10-06T02:26:02.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.403+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [write 0~70] v104'44 uv44 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adc1920 2023-10-06T02:26:02.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.403+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc4830 con 0x55c59adc1920 2023-10-06T02:26:02.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.405+0000 7f1669d16700 1 -- 172.21.15.6:0/4245148877 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [omap-set-header] v104'45 uv45 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f165c008910 con 0x55c59adc1920 2023-10-06T02:26:02.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.405+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:83 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc4830 con 0x55c59adb98d0 2023-10-06T02:26:02.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.406+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(83 605.00000000 [create] v104'51 uv50 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.406+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:84 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc4830 con 0x55c59adb98d0 2023-10-06T02:26:02.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.407+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(84 605.00000000 [delete] v104'52 uv52 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.407+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc4830 con 0x55c59adb98d0 2023-10-06T02:26:02.408 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:26:02.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.408+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(85 605.00000000 [create] v104'53 uv53 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.408+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc5840 con 0x55c59adb98d0 2023-10-06T02:26:02.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.409+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(86 605.00000000 [setxattr (30)] v104'54 uv54 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.409+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc5840 con 0x55c59adb98d0 2023-10-06T02:26:02.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.410+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(87 605.00000000 [setxattr (62)] v104'55 uv55 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.410+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc4830 con 0x55c59adb98d0 2023-10-06T02:26:02.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.411+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(88 605.00000000 [omap-set-header] v104'56 uv56 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.411+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55c59adc4d40 0x55c59adc7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.411+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:89 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc77d0 con 0x55c59adc4d40 2023-10-06T02:26:02.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.411+0000 7f1669515700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55c59adc4d40 0x55c59adc7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.412+0000 7f1669515700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55c59adc4d40 0x55c59adc7120 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:02.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.413+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(89 mds0_inotable [create] v104'84 uv78 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adc4d40 2023-10-06T02:26:02.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.413+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:90 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc7890 con 0x55c59adc4d40 2023-10-06T02:26:02.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.414+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(90 mds0_inotable [delete] v104'85 uv85 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adc4d40 2023-10-06T02:26:02.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.414+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc7cc0 con 0x55c59adc4d40 2023-10-06T02:26:02.415 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:26:02.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.415+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(91 mds0_inotable [create] v104'86 uv86 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adc4d40 2023-10-06T02:26:02.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.415+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc7cc0 con 0x55c59adc4d40 2023-10-06T02:26:02.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.416+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(92 mds0_inotable [write 0~34] v104'87 uv87 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adc4d40 2023-10-06T02:26:02.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.416+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc7cc0 con 0x55c59adc4d40 2023-10-06T02:26:02.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.417+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v104'88 uv88 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adc4d40 2023-10-06T02:26:02.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.417+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc7cc0 con 0x55c59adc4d40 2023-10-06T02:26:02.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.418+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(94 100.00000000 [create] v104'89 uv83 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adc4d40 2023-10-06T02:26:02.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.418+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc7cc0 con 0x55c59adc4d40 2023-10-06T02:26:02.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.418+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(95 100.00000000 [delete] v104'90 uv90 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adc4d40 2023-10-06T02:26:02.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.418+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc7cc0 con 0x55c59adc4d40 2023-10-06T02:26:02.419 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:26:02.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.419+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(96 100.00000000 [create] v104'91 uv91 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adc4d40 2023-10-06T02:26:02.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.419+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc7cc0 con 0x55c59adc4d40 2023-10-06T02:26:02.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.420+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(97 100.00000000 [omap-set-header] v104'92 uv92 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adc4d40 2023-10-06T02:26:02.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.420+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adcaa30 con 0x55c59adc4d40 2023-10-06T02:26:02.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.421+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v104'93 uv93 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adc4d40 2023-10-06T02:26:02.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.421+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:99 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adb98d0 2023-10-06T02:26:02.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.422+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(99 mds0_sessionmap [create] v104'40 uv39 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.422+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:100 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adb98d0 2023-10-06T02:26:02.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.423+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(100 mds0_sessionmap [delete] v104'41 uv41 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.423+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adb98d0 2023-10-06T02:26:02.424 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:26:02.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.424+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(101 mds0_sessionmap [create] v104'42 uv42 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.424+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adb98d0 2023-10-06T02:26:02.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.425+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v104'43 uv43 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.425+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55c59adc8ac0 0x55c59adcb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.425+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:103 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adc8ac0 2023-10-06T02:26:02.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.426+0000 7f166a517700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55c59adc8ac0 0x55c59adcb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.426+0000 7f166a517700 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55c59adc8ac0 0x55c59adcb180 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:02.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.427+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(103 609.00000000 [create] v104'51 uv50 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adc8ac0 2023-10-06T02:26:02.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.427+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:104 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adc8ac0 2023-10-06T02:26:02.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.428+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(104 609.00000000 [delete] v104'52 uv52 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adc8ac0 2023-10-06T02:26:02.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.428+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adc8ac0 2023-10-06T02:26:02.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.429+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(105 609.00000000 [create] v104'53 uv53 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adc8ac0 2023-10-06T02:26:02.430 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:26:02.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.429+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adc8ac0 2023-10-06T02:26:02.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.430+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v104'54 uv54 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adc8ac0 2023-10-06T02:26:02.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.430+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adc8ac0 2023-10-06T02:26:02.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.431+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v104'55 uv55 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adc8ac0 2023-10-06T02:26:02.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.432+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adc8ac0 2023-10-06T02:26:02.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.432+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(108 609.00000000 [omap-set-header] v104'56 uv56 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adc8ac0 2023-10-06T02:26:02.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.433+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:109 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adbe980 2023-10-06T02:26:02.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.434+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(109 400.00000000 [create] v104'42 uv41 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adbe980 2023-10-06T02:26:02.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.434+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:110 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adbe980 2023-10-06T02:26:02.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.435+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(110 400.00000000 [delete] v104'43 uv43 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adbe980 2023-10-06T02:26:02.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.435+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adbe980 2023-10-06T02:26:02.436 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:26:02.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.436+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(111 400.00000000 [create] v104'44 uv44 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adbe980 2023-10-06T02:26:02.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.436+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adbe980 2023-10-06T02:26:02.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.437+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(112 400.00000000 [write 0~22] v104'45 uv45 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adbe980 2023-10-06T02:26:02.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.437+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adbe980 2023-10-06T02:26:02.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.438+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(113 400.00000000 [omap-set-header] v104'46 uv46 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f166400ed60 con 0x55c59adbe980 2023-10-06T02:26:02.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.438+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:114 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adb98d0 2023-10-06T02:26:02.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.439+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(114 100.00000000.inode [create] v104'107 uv99 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.439+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:115 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adb98d0 2023-10-06T02:26:02.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.440+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(115 100.00000000.inode [delete] v104'108 uv108 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.440+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adb98d0 2023-10-06T02:26:02.444 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:26:02.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.443+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(116 100.00000000.inode [create] v104'109 uv109 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.444+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adb98d0 2023-10-06T02:26:02.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.446+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(117 100.00000000.inode [write 0~554] v104'110 uv110 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.446+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adb98d0 2023-10-06T02:26:02.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.449+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v104'111 uv111 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.449+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adb98d0 2023-10-06T02:26:02.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.454+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(119 1.00000000 [create] v104'112 uv106 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.454+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adb98d0 2023-10-06T02:26:02.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.455+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(120 1.00000000 [delete] v104'113 uv113 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.455+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adb98d0 2023-10-06T02:26:02.458 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:26:02.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.458+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(121 1.00000000 [create] v104'114 uv114 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.458+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adb98d0 2023-10-06T02:26:02.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.460+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v104'115 uv115 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.460+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adb98d0 2023-10-06T02:26:02.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.463+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v104'116 uv116 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.463+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adc81b0 con 0x55c59adb98d0 2023-10-06T02:26:02.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.467+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(124 1.00000000 [omap-set-header] v104'117 uv117 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.467+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55c59adcb6c0 con 0x55c59adb98d0 2023-10-06T02:26:02.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1669515700 1 -- 172.21.15.6:0/4245148877 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v104'118 uv118 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1660053fc0 con 0x55c59adb98d0 2023-10-06T02:26:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55c59adb98d0 msgr2=0x55c59adbbcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55c59adb98d0 0x55c59adbbcb0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55c59acef590 msgr2=0x55c59ad94000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55c59acef590 0x55c59ad94000 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55c59adc4d40 msgr2=0x55c59adc7120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55c59adc4d40 0x55c59adc7120 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55c59adb4f90 msgr2=0x55c59adb7370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55c59adb4f90 0x55c59adb7370 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55c59adc8ac0 msgr2=0x55c59adcb180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55c59adc8ac0 0x55c59adcb180 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55c59adc1920 msgr2=0x55c59adc3d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55c59adc1920 0x55c59adc3d00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c59adbe980 msgr2=0x55c59adc0d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c59adbe980 0x55c59adc0d60 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 reap_dead start 2023-10-06T02:26:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 reap_dead start 2023-10-06T02:26:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 reap_dead start 2023-10-06T02:26:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f166a517700 1 -- 172.21.15.6:0/4245148877 reap_dead start 2023-10-06T02:26:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f164c0658c0 msgr2=0x7f164c067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f164c0658c0 0x7f164c067d70 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f165c005fd0 tx=0x7f165c005b10 comp rx=0 tx=0).stop 2023-10-06T02:26:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c59ad06410 msgr2=0x55c59ad8d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c59ad06410 0x55c59ad8d610 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f166000ae30 tx=0x7f1660017000 comp rx=0 tx=0).stop 2023-10-06T02:26:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 shutdown_connections 2023-10-06T02:26:02.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c59ad06410 0x55c59ad8d610 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 --2- 172.21.15.6:0/4245148877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f164c0658c0 0x7f164c067d70 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 >> 172.21.15.6:0/4245148877 conn(0x55c59acbfd50 msgr2=0x55c59acc0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:02.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 shutdown_connections 2023-10-06T02:26:02.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.468+0000 7f1670adb000 1 -- 172.21.15.6:0/4245148877 wait complete. 2023-10-06T02:26:02.473 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds0_inotable 2023-10-06T02:26:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.551+0000 7f5910d87000 1 Processor -- start 2023-10-06T02:26:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.551+0000 7f5910d87000 1 -- start start 2023-10-06T02:26:02.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.551+0000 7f5910d87000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b4fe4b9680 0x55b4fe4b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.551+0000 7f5910d87000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4fe4bbab0 0x55b4fe4d5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.551+0000 7f5910d87000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b4fe4bbe80 0x55b4fe560290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.551+0000 7f5910d87000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4fe3d7980 con 0x55b4fe4bbe80 2023-10-06T02:26:02.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.551+0000 7f5910d87000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4fe3d7620 con 0x55b4fe4bbab0 2023-10-06T02:26:02.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.551+0000 7f5910d87000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4fe3ce400 con 0x55b4fe4b9680 2023-10-06T02:26:02.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.551+0000 7f590a7c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b4fe4bbe80 0x55b4fe560290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.551+0000 7f590a7c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b4fe4bbe80 0x55b4fe560290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38324/0 (socket says 172.21.15.6:38324) 2023-10-06T02:26:02.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.551+0000 7f590a7c3700 1 -- 172.21.15.6:0/190079902 learned_addr learned my addr 172.21.15.6:0/190079902 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.551+0000 7f5909fc2700 1 --2- 172.21.15.6:0/190079902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b4fe4b9680 0x55b4fe4b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.551+0000 7f59097c1700 1 --2- 172.21.15.6:0/190079902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4fe4bbab0 0x55b4fe4d5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f590a7c3700 1 -- 172.21.15.6:0/190079902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b4fe4b9680 msgr2=0x55b4fe4b6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f590a7c3700 1 --2- 172.21.15.6:0/190079902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b4fe4b9680 0x55b4fe4b6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f590a7c3700 1 -- 172.21.15.6:0/190079902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4fe4bbab0 msgr2=0x55b4fe4d5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f590a7c3700 1 --2- 172.21.15.6:0/190079902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4fe4bbab0 0x55b4fe4d5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f590a7c3700 1 -- 172.21.15.6:0/190079902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc005cf0 con 0x55b4fe4bbe80 2023-10-06T02:26:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f590a7c3700 1 --2- 172.21.15.6:0/190079902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b4fe4bbe80 0x55b4fe560290 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f5904006ec0 tx=0x7f5904006970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf7c6f9b673ed2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f5903fff700 1 -- 172.21.15.6:0/190079902 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5904006320 con 0x55b4fe4bbe80 2023-10-06T02:26:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f5903fff700 1 -- 172.21.15.6:0/190079902 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5904001e00 con 0x55b4fe4bbe80 2023-10-06T02:26:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f5903fff700 1 -- 172.21.15.6:0/190079902 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5904004520 con 0x55b4fe4bbe80 2023-10-06T02:26:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f5910d87000 1 -- 172.21.15.6:0/190079902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b4fe4bbe80 msgr2=0x55b4fe560290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f5910d87000 1 --2- 172.21.15.6:0/190079902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b4fe4bbe80 0x55b4fe560290 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f5904006ec0 tx=0x7f5904006970 comp rx=0 tx=0).stop 2023-10-06T02:26:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f5910d87000 1 -- 172.21.15.6:0/190079902 shutdown_connections 2023-10-06T02:26:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f5910d87000 1 --2- 172.21.15.6:0/190079902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b4fe4bbe80 0x55b4fe560290 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f5910d87000 1 --2- 172.21.15.6:0/190079902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b4fe4b9680 0x55b4fe4b6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f5910d87000 1 --2- 172.21.15.6:0/190079902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4fe4bbab0 0x55b4fe4d5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f5910d87000 1 -- 172.21.15.6:0/190079902 >> 172.21.15.6:0/190079902 conn(0x55b4fe4d3bd0 msgr2=0x55b4fe48e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f5910d87000 1 -- 172.21.15.6:0/190079902 shutdown_connections 2023-10-06T02:26:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.552+0000 7f5910d87000 1 -- 172.21.15.6:0/190079902 wait complete. 2023-10-06T02:26:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.553+0000 7f5910d87000 1 Processor -- start 2023-10-06T02:26:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.553+0000 7f5910d87000 1 -- start start 2023-10-06T02:26:02.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.554+0000 7f5910d87000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b4fe4b9680 0x55b4fe55aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.554+0000 7f5910d87000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4fe4bbab0 0x55b4fe559920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.554+0000 7f5910d87000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b4fe4bbe80 0x55b4fe559e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.554+0000 7f5910d87000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4fe56a220 con 0x55b4fe4bbe80 2023-10-06T02:26:02.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.554+0000 7f5910d87000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4fe56a4c0 con 0x55b4fe4bbab0 2023-10-06T02:26:02.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.554+0000 7f5910d87000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4fe56a760 con 0x55b4fe4b9680 2023-10-06T02:26:02.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.554+0000 7f590a7c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b4fe4bbe80 0x55b4fe559e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.554+0000 7f590a7c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b4fe4bbe80 0x55b4fe559e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38332/0 (socket says 172.21.15.6:38332) 2023-10-06T02:26:02.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.554+0000 7f5909fc2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b4fe4b9680 0x55b4fe55aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.554+0000 7f590a7c3700 1 -- 172.21.15.6:0/3946870979 learned_addr learned my addr 172.21.15.6:0/3946870979 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.554+0000 7f59097c1700 1 --2- 172.21.15.6:0/3946870979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4fe4bbab0 0x55b4fe559920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.554+0000 7f590a7c3700 1 -- 172.21.15.6:0/3946870979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b4fe4b9680 msgr2=0x55b4fe55aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.554+0000 7f590a7c3700 1 --2- 172.21.15.6:0/3946870979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b4fe4b9680 0x55b4fe55aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.554+0000 7f590a7c3700 1 -- 172.21.15.6:0/3946870979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4fe4bbab0 msgr2=0x55b4fe559920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.554+0000 7f590a7c3700 1 --2- 172.21.15.6:0/3946870979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4fe4bbab0 0x55b4fe559920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.554+0000 7f590a7c3700 1 -- 172.21.15.6:0/3946870979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f8001e10 con 0x55b4fe4bbe80 2023-10-06T02:26:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.554+0000 7f590a7c3700 1 --2- 172.21.15.6:0/3946870979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b4fe4bbe80 0x55b4fe559e60 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f59040069b0 tx=0x7f5904010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.555+0000 7f59027fc700 1 -- 172.21.15.6:0/3946870979 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5904004050 con 0x55b4fe4bbe80 2023-10-06T02:26:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.555+0000 7f59027fc700 1 -- 172.21.15.6:0/3946870979 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59040041d0 con 0x55b4fe4bbe80 2023-10-06T02:26:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.555+0000 7f5910d87000 1 -- 172.21.15.6:0/3946870979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b4fe3e63d0 con 0x55b4fe4bbe80 2023-10-06T02:26:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.555+0000 7f59027fc700 1 -- 172.21.15.6:0/3946870979 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59040036a0 con 0x55b4fe4bbe80 2023-10-06T02:26:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.555+0000 7f5910d87000 1 -- 172.21.15.6:0/3946870979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b4fe3d9ae0 con 0x55b4fe4bbe80 2023-10-06T02:26:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.556+0000 7f59027fc700 1 -- 172.21.15.6:0/3946870979 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5904003a90 con 0x55b4fe4bbe80 2023-10-06T02:26:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.556+0000 7f59027fc700 1 --2- 172.21.15.6:0/3946870979 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f58ec065890 0x7f58ec067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.556+0000 7f59027fc700 1 -- 172.21.15.6:0/3946870979 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7152+0+0 (secure 0 0 0) 0x7f5904083dc0 con 0x55b4fe4bbe80 2023-10-06T02:26:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.556+0000 7f5909fc2700 1 --2- 172.21.15.6:0/3946870979 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f58ec065890 0x7f58ec067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.556+0000 7f5910d87000 1 --2- 172.21.15.6:0/3946870979 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b4fe55b410 0x55b4fe569480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.556+0000 7f5910d87000 1 -- 172.21.15.6:0/3946870979 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e104) v8 -- 0x55b4fe4d5a10 con 0x55b4fe55b410 2023-10-06T02:26:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.557+0000 7f59097c1700 1 --2- 172.21.15.6:0/3946870979 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b4fe55b410 0x55b4fe569480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.557+0000 7f5909fc2700 1 --2- 172.21.15.6:0/3946870979 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f58ec065890 0x7f58ec067d40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f58fc005a90 tx=0x7f58fc015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.557+0000 7f59097c1700 1 --2- 172.21.15.6:0/3946870979 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b4fe55b410 0x55b4fe569480 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.558+0000 7f59097c1700 1 -- 172.21.15.6:0/3946870979 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(1 mds0_inotable [delete] v104'94 uv94 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f58f4012040 con 0x55b4fe55b410 2023-10-06T02:26:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.558+0000 7f5910d87000 1 -- 172.21.15.6:0/3946870979 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b4fe55b410 msgr2=0x55b4fe569480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.558+0000 7f5910d87000 1 --2- 172.21.15.6:0/3946870979 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b4fe55b410 0x55b4fe569480 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.558+0000 7f5910d87000 1 -- 172.21.15.6:0/3946870979 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f58ec065890 msgr2=0x7f58ec067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.558+0000 7f5910d87000 1 --2- 172.21.15.6:0/3946870979 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f58ec065890 0x7f58ec067d40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f58fc005a90 tx=0x7f58fc015000 comp rx=0 tx=0).stop 2023-10-06T02:26:02.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.558+0000 7f5910d87000 1 -- 172.21.15.6:0/3946870979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b4fe4bbe80 msgr2=0x55b4fe559e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.558+0000 7f5910d87000 1 --2- 172.21.15.6:0/3946870979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b4fe4bbe80 0x55b4fe559e60 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f59040069b0 tx=0x7f5904010000 comp rx=0 tx=0).stop 2023-10-06T02:26:02.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.558+0000 7f590a7c3700 1 -- 172.21.15.6:0/3946870979 reap_dead start 2023-10-06T02:26:02.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.558+0000 7f5910d87000 1 -- 172.21.15.6:0/3946870979 shutdown_connections 2023-10-06T02:26:02.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.558+0000 7f5910d87000 1 -- 172.21.15.6:0/3946870979 >> 172.21.15.6:0/3946870979 conn(0x55b4fe4d3bd0 msgr2=0x55b4fe560220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:02.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.558+0000 7f5910d87000 1 -- 172.21.15.6:0/3946870979 shutdown_connections 2023-10-06T02:26:02.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.558+0000 7f5910d87000 1 -- 172.21.15.6:0/3946870979 wait complete. 2023-10-06T02:26:02.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:26:02.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.726+0000 7f4157bb1700 1 Processor -- start 2023-10-06T02:26:02.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.727+0000 7f4157bb1700 1 -- start start 2023-10-06T02:26:02.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.727+0000 7f4157bb1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4150159960 0x7f4150068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.727+0000 7f4157bb1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415015a170 con 0x7f41500af3f0 2023-10-06T02:26:02.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.727+0000 7f4157bb1700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41500caeb0 con 0x7f41500af7c0 2023-10-06T02:26:02.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.727+0000 7f4157bb1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415015db80 con 0x7f4150159960 2023-10-06T02:26:02.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.728+0000 7f415594d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f41500af3f0 0x7f415015a600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57818/0 (socket says 172.21.15.6:57818) 2023-10-06T02:26:02.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.728+0000 7f415594d700 1 -- 172.21.15.6:0/921310703 learned_addr learned my addr 172.21.15.6:0/921310703 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:02.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.728+0000 7f415614e700 1 --2- 172.21.15.6:0/921310703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4150159960 0x7f4150068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.728+0000 7f415494b700 1 -- 172.21.15.6:0/921310703 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824163426 0 0) 0x7f415015a170 con 0x7f41500af3f0 2023-10-06T02:26:02.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.728+0000 7f415494b700 1 -- 172.21.15.6:0/921310703 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4138003570 con 0x7f41500af3f0 2023-10-06T02:26:02.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.728+0000 7f415494b700 1 -- 172.21.15.6:0/921310703 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4168657799 0 0) 0x7f41500caeb0 con 0x7f41500af7c0 2023-10-06T02:26:02.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.728+0000 7f415494b700 1 -- 172.21.15.6:0/921310703 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f415015a170 con 0x7f41500af7c0 2023-10-06T02:26:02.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.728+0000 7f415614e700 1 -- 172.21.15.6:0/921310703 >> v1:172.21.15.175:6789/0 conn(0x7f41500af7c0 legacy=0x7f415015d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.728+0000 7f415614e700 1 -- 172.21.15.6:0/921310703 >> v1:172.21.15.6:6789/0 conn(0x7f41500af3f0 legacy=0x7f415015a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.728+0000 7f415614e700 1 -- 172.21.15.6:0/921310703 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415015de60 con 0x7f4150159960 2023-10-06T02:26:02.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.728+0000 7f415614e700 1 --2- 172.21.15.6:0/921310703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4150159960 0x7f4150068680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4140009e90 tx=0x7f4140009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbf7bb26da648065 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:02.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.728+0000 7f415494b700 1 -- 172.21.15.6:0/921310703 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414000e070 con 0x7f4150159960 2023-10-06T02:26:02.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.728+0000 7f415494b700 1 -- 172.21.15.6:0/921310703 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414000bb80 con 0x7f4150159960 2023-10-06T02:26:02.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.728+0000 7f415494b700 1 -- 172.21.15.6:0/921310703 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140012430 con 0x7f4150159960 2023-10-06T02:26:02.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.729+0000 7f4157bb1700 1 -- 172.21.15.6:0/921310703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4150159960 msgr2=0x7f4150068680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.729+0000 7f4157bb1700 1 --2- 172.21.15.6:0/921310703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4150159960 0x7f4150068680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4140009e90 tx=0x7f4140009780 comp rx=0 tx=0).stop 2023-10-06T02:26:02.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.729+0000 7f4157bb1700 1 -- 172.21.15.6:0/921310703 shutdown_connections 2023-10-06T02:26:02.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.729+0000 7f4157bb1700 1 --2- 172.21.15.6:0/921310703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4150159960 0x7f4150068680 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.729+0000 7f4157bb1700 1 -- 172.21.15.6:0/921310703 >> 172.21.15.6:0/921310703 conn(0x7f415006a260 msgr2=0x7f41500cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:02.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.729+0000 7f4157bb1700 1 -- 172.21.15.6:0/921310703 shutdown_connections 2023-10-06T02:26:02.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.729+0000 7f4157bb1700 1 -- 172.21.15.6:0/921310703 wait complete. 2023-10-06T02:26:02.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.730+0000 7f4157bb1700 1 Processor -- start 2023-10-06T02:26:02.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.730+0000 7f4157bb1700 1 -- start start 2023-10-06T02:26:02.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f4157bb1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41500af3f0 0x7f415016a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f4157bb1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4150159960 0x7f4150156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f4157bb1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41500b2bd0 0x7f415014aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f4157bb1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4150169ff0 con 0x7f41500b2bd0 2023-10-06T02:26:02.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f4157bb1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4150157800 con 0x7f4150159960 2023-10-06T02:26:02.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f4157bb1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4150157ae0 con 0x7f41500af3f0 2023-10-06T02:26:02.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f415614e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41500b2bd0 0x7f415014aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f415614e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41500b2bd0 0x7f415014aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38338/0 (socket says 172.21.15.6:38338) 2023-10-06T02:26:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f415614e700 1 -- 172.21.15.6:0/103971785 learned_addr learned my addr 172.21.15.6:0/103971785 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f415594d700 1 --2- 172.21.15.6:0/103971785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41500af3f0 0x7f415016a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f415514c700 1 --2- 172.21.15.6:0/103971785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4150159960 0x7f4150156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f415614e700 1 -- 172.21.15.6:0/103971785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41500af3f0 msgr2=0x7f415016a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f415614e700 1 --2- 172.21.15.6:0/103971785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41500af3f0 0x7f415016a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f415614e700 1 -- 172.21.15.6:0/103971785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4150159960 msgr2=0x7f4150156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f415614e700 1 --2- 172.21.15.6:0/103971785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4150159960 0x7f4150156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f415614e700 1 -- 172.21.15.6:0/103971785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4140009a20 con 0x7f41500b2bd0 2023-10-06T02:26:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f415594d700 1 --2- 172.21.15.6:0/103971785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41500af3f0 0x7f415016a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f415514c700 1 --2- 172.21.15.6:0/103971785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4150159960 0x7f4150156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.731+0000 7f415614e700 1 --2- 172.21.15.6:0/103971785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41500b2bd0 0x7f415014aa30 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f415006c600 tx=0x7f4140019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:02.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.732+0000 7f414dffb700 1 -- 172.21.15.6:0/103971785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140012e40 con 0x7f41500b2bd0 2023-10-06T02:26:02.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.732+0000 7f414dffb700 1 -- 172.21.15.6:0/103971785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414001d630 con 0x7f41500b2bd0 2023-10-06T02:26:02.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.732+0000 7f4157bb1700 1 -- 172.21.15.6:0/103971785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4150169c80 con 0x7f41500b2bd0 2023-10-06T02:26:02.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.732+0000 7f414dffb700 1 -- 172.21.15.6:0/103971785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414001d9f0 con 0x7f41500b2bd0 2023-10-06T02:26:02.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.732+0000 7f4157bb1700 1 -- 172.21.15.6:0/103971785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4150157480 con 0x7f41500b2bd0 2023-10-06T02:26:02.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.733+0000 7f4157bb1700 1 -- 172.21.15.6:0/103971785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415006e700 con 0x7f41500b2bd0 2023-10-06T02:26:02.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.733+0000 7f414dffb700 1 -- 172.21.15.6:0/103971785 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4140024070 con 0x7f41500b2bd0 2023-10-06T02:26:02.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.734+0000 7f414dffb700 1 --2- 172.21.15.6:0/103971785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f413c066f30 0x7f413c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:02.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.734+0000 7f414dffb700 1 -- 172.21.15.6:0/103971785 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7152+0+0 (secure 0 0 0) 0x7f41400872e0 con 0x7f41500b2bd0 2023-10-06T02:26:02.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.734+0000 7f415594d700 1 --2- 172.21.15.6:0/103971785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f413c066f30 0x7f413c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:02.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.734+0000 7f415594d700 1 --2- 172.21.15.6:0/103971785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f413c066f30 0x7f413c0693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f41480058d0 tx=0x7f4148009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:02.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.738+0000 7f414dffb700 1 -- 172.21.15.6:0/103971785 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4140053fb0 con 0x7f41500b2bd0 2023-10-06T02:26:02.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:02.977+0000 7f4157bb1700 1 -- 172.21.15.6:0/103971785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f4150068420 con 0x7f41500b2bd0 2023-10-06T02:26:03.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.833+0000 7f414dffb700 1 -- 172.21.15.6:0/103971785 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v145) v1 ==== 162+0+0 (secure 0 0 0) 0x7f41400575d0 con 0x7f41500b2bd0 2023-10-06T02:26:03.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.836+0000 7f4157bb1700 1 -- 172.21.15.6:0/103971785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f413c066f30 msgr2=0x7f413c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:03.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.836+0000 7f4157bb1700 1 --2- 172.21.15.6:0/103971785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f413c066f30 0x7f413c0693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f41480058d0 tx=0x7f4148009040 comp rx=0 tx=0).stop 2023-10-06T02:26:03.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.836+0000 7f4157bb1700 1 -- 172.21.15.6:0/103971785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41500b2bd0 msgr2=0x7f415014aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:03.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.836+0000 7f4157bb1700 1 --2- 172.21.15.6:0/103971785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41500b2bd0 0x7f415014aa30 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f415006c600 tx=0x7f4140019000 comp rx=0 tx=0).stop 2023-10-06T02:26:03.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.836+0000 7f4157bb1700 1 -- 172.21.15.6:0/103971785 shutdown_connections 2023-10-06T02:26:03.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.836+0000 7f4157bb1700 1 --2- 172.21.15.6:0/103971785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f413c066f30 0x7f413c0693e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:03.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.836+0000 7f4157bb1700 1 --2- 172.21.15.6:0/103971785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41500b2bd0 0x7f415014aa30 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:03.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.836+0000 7f4157bb1700 1 --2- 172.21.15.6:0/103971785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41500af3f0 0x7f415016a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:03.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.836+0000 7f4157bb1700 1 --2- 172.21.15.6:0/103971785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4150159960 0x7f4150156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:03.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.836+0000 7f4157bb1700 1 -- 172.21.15.6:0/103971785 >> 172.21.15.6:0/103971785 conn(0x7f415006a260 msgr2=0x7f41500c8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:03.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.836+0000 7f4157bb1700 1 -- 172.21.15.6:0/103971785 shutdown_connections 2023-10-06T02:26:03.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.836+0000 7f4157bb1700 1 -- 172.21.15.6:0/103971785 wait complete. 2023-10-06T02:26:03.838 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:26:03.842 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:26:03.841+0000 7f9c18ef6700 -1 mds.0.inotable: load_2 could not read table: -2 2023-10-06T02:26:03.842 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:26:03.841+0000 7f9c18ef6700 -1 log_channel(cluster) log [ERR] : error reading table object 'mds0_inotable' -2 ((2) No such file or directory) 2023-10-06T02:26:03.842 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:26:03.842+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:26:03.842 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:26:03.842+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:26:03.850 INFO:tasks.ceph.mds.a.smithi006.stderr: -25> 2023-10-06T02:26:03.841+0000 7f9c18ef6700 -1 mds.0.inotable: load_2 could not read table: -2 2023-10-06T02:26:03.850 INFO:tasks.ceph.mds.a.smithi006.stderr: -24> 2023-10-06T02:26:03.841+0000 7f9c18ef6700 -1 log_channel(cluster) log [ERR] : error reading table object 'mds0_inotable' -2 ((2) No such file or directory) 2023-10-06T02:26:03.855 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:03.872 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:26:03.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.981+0000 7f2f1b7cb700 1 Processor -- start 2023-10-06T02:26:03.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.981+0000 7f2f1b7cb700 1 -- start start 2023-10-06T02:26:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.982+0000 7f2f1b7cb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2f140c78d0 0x7f2f140ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.982+0000 7f2f1b7cb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f140c7ca0 0x7f2f140cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.982+0000 7f2f1b7cb700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f140ca3e0 con 0x7f2f1413f930 2023-10-06T02:26:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.982+0000 7f2f1b7cb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f140c95c0 con 0x7f2f140c78d0 2023-10-06T02:26:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.982+0000 7f2f1b7cb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f140c3140 con 0x7f2f140c7ca0 2023-10-06T02:26:03.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.982+0000 7f2f18d66700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f140c7ca0 0x7f2f140cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.982+0000 7f2f19567700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2f140c78d0 0x7f2f140ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.982+0000 7f2f18d66700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f140c7ca0 0x7f2f140cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:34534/0 (socket says 172.21.15.6:34534) 2023-10-06T02:26:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.982+0000 7f2f19567700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2f140c78d0 0x7f2f140ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:52164/0 (socket says 172.21.15.6:52164) 2023-10-06T02:26:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.982+0000 7f2f19d68700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f2f1413f930 0x7f2f1413fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:35508/0 (socket says 172.21.15.6:35508) 2023-10-06T02:26:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.982+0000 7f2f18d66700 1 -- 172.21.15.6:0/589388044 learned_addr learned my addr 172.21.15.6:0/589388044 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.982+0000 7f2f19567700 1 -- 172.21.15.6:0/589388044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f140c7ca0 msgr2=0x7f2f140cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.982+0000 7f2f19567700 1 --2- 172.21.15.6:0/589388044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f140c7ca0 0x7f2f140cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.982+0000 7f2f19567700 1 -- 172.21.15.6:0/589388044 >> v1:172.21.15.175:6789/0 conn(0x7f2f1413f930 legacy=0x7f2f1413fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.982+0000 7f2f19567700 1 -- 172.21.15.6:0/589388044 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f140c97d0 con 0x7f2f140c78d0 2023-10-06T02:26:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.982+0000 7f2f0bfff700 1 -- 172.21.15.6:0/589388044 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521635884 0 0) 0x7f2f140ca3e0 con 0x7f2f1413f930 2023-10-06T02:26:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.982+0000 7f2f18d66700 1 --2- 172.21.15.6:0/589388044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f140c7ca0 0x7f2f140cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:26:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.983+0000 7f2f19567700 1 --2- 172.21.15.6:0/589388044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f140c78d0 0x7f2f140ccfd0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2f100098e0 tx=0x7f2f100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=604ebb3f2095083e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.983+0000 7f2f0bfff700 1 -- 172.21.15.6:0/589388044 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1000b640 con 0x7f2f140c78d0 2023-10-06T02:26:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.983+0000 7f2f0bfff700 1 -- 172.21.15.6:0/589388044 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1000b7a0 con 0x7f2f140c78d0 2023-10-06T02:26:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.983+0000 7f2f0bfff700 1 -- 172.21.15.6:0/589388044 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1000bb40 con 0x7f2f140c78d0 2023-10-06T02:26:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.983+0000 7f2f1b7cb700 1 -- 172.21.15.6:0/589388044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f140c78d0 msgr2=0x7f2f140ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.983+0000 7f2f1b7cb700 1 --2- 172.21.15.6:0/589388044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f140c78d0 0x7f2f140ccfd0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2f100098e0 tx=0x7f2f100091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.983+0000 7f2f1b7cb700 1 -- 172.21.15.6:0/589388044 shutdown_connections 2023-10-06T02:26:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.983+0000 7f2f1b7cb700 1 --2- 172.21.15.6:0/589388044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f140c78d0 0x7f2f140ccfd0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.983+0000 7f2f1b7cb700 1 --2- 172.21.15.6:0/589388044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f140c7ca0 0x7f2f140cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.983+0000 7f2f1b7cb700 1 -- 172.21.15.6:0/589388044 >> 172.21.15.6:0/589388044 conn(0x7f2f14069790 msgr2=0x7f2f14069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.983+0000 7f2f1b7cb700 1 -- 172.21.15.6:0/589388044 shutdown_connections 2023-10-06T02:26:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.984+0000 7f2f1b7cb700 1 -- 172.21.15.6:0/589388044 wait complete. 2023-10-06T02:26:03.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.985+0000 7f2f1b7cb700 1 Processor -- start 2023-10-06T02:26:03.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.985+0000 7f2f1b7cb700 1 -- start start 2023-10-06T02:26:03.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.985+0000 7f2f1b7cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f140c78d0 0x7f2f141569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:03.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.985+0000 7f2f1b7cb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f140c7ca0 0x7f2f14153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:03.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.985+0000 7f2f1b7cb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f1413f930 0x7f2f14150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.985+0000 7f2f1b7cb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f140c60e0 con 0x7f2f140c78d0 2023-10-06T02:26:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.985+0000 7f2f1b7cb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f141572d0 con 0x7f2f140c7ca0 2023-10-06T02:26:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.985+0000 7f2f1b7cb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f14156ff0 con 0x7f2f1413f930 2023-10-06T02:26:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.986+0000 7f2f19567700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f140c78d0 0x7f2f141569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.986+0000 7f2f19567700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f140c78d0 0x7f2f141569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38374/0 (socket says 172.21.15.6:38374) 2023-10-06T02:26:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.986+0000 7f2f19567700 1 -- 172.21.15.6:0/1370029435 learned_addr learned my addr 172.21.15.6:0/1370029435 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.986+0000 7f2f19d68700 1 --2- 172.21.15.6:0/1370029435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f1413f930 0x7f2f14150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.986+0000 7f2f18d66700 1 --2- 172.21.15.6:0/1370029435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f140c7ca0 0x7f2f14153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.986+0000 7f2f19567700 1 -- 172.21.15.6:0/1370029435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f1413f930 msgr2=0x7f2f14150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.986+0000 7f2f19567700 1 --2- 172.21.15.6:0/1370029435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f1413f930 0x7f2f14150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.986+0000 7f2f19567700 1 -- 172.21.15.6:0/1370029435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f140c7ca0 msgr2=0x7f2f14153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.986+0000 7f2f19567700 1 --2- 172.21.15.6:0/1370029435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f140c7ca0 0x7f2f14153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.986+0000 7f2f19567700 1 -- 172.21.15.6:0/1370029435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f040094f0 con 0x7f2f140c78d0 2023-10-06T02:26:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.986+0000 7f2f19567700 1 --2- 172.21.15.6:0/1370029435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f140c78d0 0x7f2f141569b0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f2f14063db0 tx=0x7f2f10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.986+0000 7f2f097fa700 1 -- 172.21.15.6:0/1370029435 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1000bb20 con 0x7f2f140c78d0 2023-10-06T02:26:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.986+0000 7f2f097fa700 1 -- 172.21.15.6:0/1370029435 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f10000c90 con 0x7f2f140c78d0 2023-10-06T02:26:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.986+0000 7f2f1b7cb700 1 -- 172.21.15.6:0/1370029435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f10009420 con 0x7f2f140c78d0 2023-10-06T02:26:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.986+0000 7f2f097fa700 1 -- 172.21.15.6:0/1370029435 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10011630 con 0x7f2f140c78d0 2023-10-06T02:26:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.986+0000 7f2f1b7cb700 1 -- 172.21.15.6:0/1370029435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f140c5d70 con 0x7f2f140c78d0 2023-10-06T02:26:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.987+0000 7f2f1b7cb700 1 -- 172.21.15.6:0/1370029435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f140cdf60 con 0x7f2f140c78d0 2023-10-06T02:26:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.988+0000 7f2f097fa700 1 -- 172.21.15.6:0/1370029435 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f100119a0 con 0x7f2f140c78d0 2023-10-06T02:26:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.988+0000 7f2f097fa700 1 --2- 172.21.15.6:0/1370029435 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2ef8066f30 0x7f2ef80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.988+0000 7f2f097fa700 1 -- 172.21.15.6:0/1370029435 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f2f10085dc0 con 0x7f2f140c78d0 2023-10-06T02:26:03.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.988+0000 7f2f18d66700 1 --2- 172.21.15.6:0/1370029435 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2ef8066f30 0x7f2ef80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:03.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.989+0000 7f2f18d66700 1 --2- 172.21.15.6:0/1370029435 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2ef8066f30 0x7f2ef80693e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2f14157cb0 tx=0x7f2f04009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:03.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:03.993+0000 7f2f097fa700 1 -- 172.21.15.6:0/1370029435 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f10052a30 con 0x7f2f140c78d0 2023-10-06T02:26:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.233+0000 7f2f1b7cb700 1 -- 172.21.15.6:0/1370029435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f1404bb80 con 0x7f2f140c78d0 2023-10-06T02:26:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.234+0000 7f2f097fa700 1 -- 172.21.15.6:0/1370029435 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 147 v147) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f2f10056050 con 0x7f2f140c78d0 2023-10-06T02:26:04.235 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:04.235 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":147,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":147,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:03.843149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:04.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.236+0000 7f2f1b7cb700 1 -- 172.21.15.6:0/1370029435 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2ef8066f30 msgr2=0x7f2ef80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:04.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.236+0000 7f2f1b7cb700 1 --2- 172.21.15.6:0/1370029435 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2ef8066f30 0x7f2ef80693e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2f14157cb0 tx=0x7f2f04009250 comp rx=0 tx=0).stop 2023-10-06T02:26:04.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.236+0000 7f2f1b7cb700 1 -- 172.21.15.6:0/1370029435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f140c78d0 msgr2=0x7f2f141569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:04.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.236+0000 7f2f1b7cb700 1 --2- 172.21.15.6:0/1370029435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f140c78d0 0x7f2f141569b0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f2f14063db0 tx=0x7f2f10017000 comp rx=0 tx=0).stop 2023-10-06T02:26:04.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.236+0000 7f2f1b7cb700 1 -- 172.21.15.6:0/1370029435 shutdown_connections 2023-10-06T02:26:04.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.236+0000 7f2f1b7cb700 1 --2- 172.21.15.6:0/1370029435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f1413f930 0x7f2f14150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.236+0000 7f2f1b7cb700 1 --2- 172.21.15.6:0/1370029435 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2ef8066f30 0x7f2ef80693e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.236+0000 7f2f1b7cb700 1 --2- 172.21.15.6:0/1370029435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f140c78d0 0x7f2f141569b0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.236+0000 7f2f1b7cb700 1 --2- 172.21.15.6:0/1370029435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f140c7ca0 0x7f2f14153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.236+0000 7f2f1b7cb700 1 -- 172.21.15.6:0/1370029435 >> 172.21.15.6:0/1370029435 conn(0x7f2f14069790 msgr2=0x7f2f140b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:04.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.236+0000 7f2f1b7cb700 1 -- 172.21.15.6:0/1370029435 shutdown_connections 2023-10-06T02:26:04.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.236+0000 7f2f1b7cb700 1 -- 172.21.15.6:0/1370029435 wait complete. 2023-10-06T02:26:04.238 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 147 2023-10-06T02:26:04.249 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:26:04.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:04.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.408+0000 7efedd53f700 1 Processor -- start 2023-10-06T02:26:04.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.408+0000 7efedd53f700 1 -- start start 2023-10-06T02:26:04.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.409+0000 7efedd53f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efed8153b70 0x7efed815d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:04.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.409+0000 7efedd53f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efed8153f40 0x7efed815a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:04.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.409+0000 7efedd53f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed80cb210 0x7efed80cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:04.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.409+0000 7efedd53f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed815e350 con 0x7efed8153f40 2023-10-06T02:26:04.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.409+0000 7efedd53f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed815adb0 con 0x7efed8153b70 2023-10-06T02:26:04.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.409+0000 7efedd53f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed80ce7b0 con 0x7efed80cb210 2023-10-06T02:26:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.409+0000 7efed67fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efed8153f40 0x7efed815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.409+0000 7efed67fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efed8153f40 0x7efed815a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38388/0 (socket says 172.21.15.6:38388) 2023-10-06T02:26:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.409+0000 7efed67fc700 1 -- 172.21.15.6:0/1352767250 learned_addr learned my addr 172.21.15.6:0/1352767250 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.409+0000 7efed6ffd700 1 --2- 172.21.15.6:0/1352767250 >> v2:172.21.15.175:3300/0 conn(0x7efed8153b70 0x7efed815d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.409+0000 7efed77fe700 1 --2- 172.21.15.6:0/1352767250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed80cb210 0x7efed80cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.409+0000 7efed67fc700 1 -- 172.21.15.6:0/1352767250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed80cb210 msgr2=0x7efed80cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.409+0000 7efed67fc700 1 --2- 172.21.15.6:0/1352767250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed80cb210 0x7efed80cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.409+0000 7efed67fc700 1 -- 172.21.15.6:0/1352767250 >> v2:172.21.15.175:3300/0 conn(0x7efed8153b70 msgr2=0x7efed815d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.409+0000 7efed67fc700 1 --2- 172.21.15.6:0/1352767250 >> v2:172.21.15.175:3300/0 conn(0x7efed8153b70 0x7efed815d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.409+0000 7efed67fc700 1 -- 172.21.15.6:0/1352767250 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed815dab0 con 0x7efed8153f40 2023-10-06T02:26:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.409+0000 7efed77fe700 1 --2- 172.21.15.6:0/1352767250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed80cb210 0x7efed80cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.410+0000 7efed67fc700 1 --2- 172.21.15.6:0/1352767250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed8153f40 0x7efed815a870 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7efed806b460 tx=0x7efec0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d855ef348267a02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:04.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.410+0000 7efed5ffb700 1 -- 172.21.15.6:0/1352767250 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec0009ea0 con 0x7efed8153f40 2023-10-06T02:26:04.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.410+0000 7efed5ffb700 1 -- 172.21.15.6:0/1352767250 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec000b820 con 0x7efed8153f40 2023-10-06T02:26:04.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.410+0000 7efed5ffb700 1 -- 172.21.15.6:0/1352767250 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec000bbc0 con 0x7efed8153f40 2023-10-06T02:26:04.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.410+0000 7efedd53f700 1 -- 172.21.15.6:0/1352767250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed8153f40 msgr2=0x7efed815a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:04.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.410+0000 7efedd53f700 1 --2- 172.21.15.6:0/1352767250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed8153f40 0x7efed815a870 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7efed806b460 tx=0x7efec0009250 comp rx=0 tx=0).stop 2023-10-06T02:26:04.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.410+0000 7efedd53f700 1 -- 172.21.15.6:0/1352767250 shutdown_connections 2023-10-06T02:26:04.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.410+0000 7efedd53f700 1 --2- 172.21.15.6:0/1352767250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed80cb210 0x7efed80cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.410+0000 7efedd53f700 1 --2- 172.21.15.6:0/1352767250 >> v2:172.21.15.175:3300/0 conn(0x7efed8153b70 0x7efed815d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.410+0000 7efedd53f700 1 --2- 172.21.15.6:0/1352767250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed8153f40 0x7efed815a870 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.410+0000 7efedd53f700 1 -- 172.21.15.6:0/1352767250 >> 172.21.15.6:0/1352767250 conn(0x7efed8068680 msgr2=0x7efed8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:04.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.410+0000 7efedd53f700 1 -- 172.21.15.6:0/1352767250 shutdown_connections 2023-10-06T02:26:04.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.410+0000 7efedd53f700 1 -- 172.21.15.6:0/1352767250 wait complete. 2023-10-06T02:26:04.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.412+0000 7efedd53f700 1 Processor -- start 2023-10-06T02:26:04.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.412+0000 7efedd53f700 1 -- start start 2023-10-06T02:26:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.412+0000 7efedd53f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed80cb210 0x7efed8151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.412+0000 7efedd53f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed8153b70 0x7efed80c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.412+0000 7efedd53f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed8153f40 0x7efed80c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.412+0000 7efedd53f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed80c8240 con 0x7efed8153b70 2023-10-06T02:26:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.412+0000 7efedd53f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed80b3750 con 0x7efed80cb210 2023-10-06T02:26:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.412+0000 7efedd53f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed8169ec0 con 0x7efed8153f40 2023-10-06T02:26:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.412+0000 7efed67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed8153b70 0x7efed80c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.412+0000 7efed67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed8153b70 0x7efed80c62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38400/0 (socket says 172.21.15.6:38400) 2023-10-06T02:26:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.412+0000 7efed67fc700 1 -- 172.21.15.6:0/2700475999 learned_addr learned my addr 172.21.15.6:0/2700475999 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.413+0000 7efed6ffd700 1 --2- 172.21.15.6:0/2700475999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed80cb210 0x7efed8151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.413+0000 7efed77fe700 1 --2- 172.21.15.6:0/2700475999 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed8153f40 0x7efed80c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.413+0000 7efed67fc700 1 -- 172.21.15.6:0/2700475999 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed8153f40 msgr2=0x7efed80c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.413+0000 7efed67fc700 1 --2- 172.21.15.6:0/2700475999 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed8153f40 0x7efed80c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.413+0000 7efed67fc700 1 -- 172.21.15.6:0/2700475999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed80cb210 msgr2=0x7efed8151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.413+0000 7efed67fc700 1 --2- 172.21.15.6:0/2700475999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed80cb210 0x7efed8151f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.413+0000 7efed67fc700 1 -- 172.21.15.6:0/2700475999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec00094f0 con 0x7efed8153b70 2023-10-06T02:26:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.413+0000 7efed67fc700 1 --2- 172.21.15.6:0/2700475999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed8153b70 0x7efed80c62d0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7efec00090b0 tx=0x7efec0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.413+0000 7efeceffd700 1 -- 172.21.15.6:0/2700475999 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec000bba0 con 0x7efed8153b70 2023-10-06T02:26:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.413+0000 7efeceffd700 1 -- 172.21.15.6:0/2700475999 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec001f070 con 0x7efed8153b70 2023-10-06T02:26:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.413+0000 7efedd53f700 1 -- 172.21.15.6:0/2700475999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed80c7f60 con 0x7efed8153b70 2023-10-06T02:26:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.413+0000 7efeceffd700 1 -- 172.21.15.6:0/2700475999 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec00266b0 con 0x7efed8153b70 2023-10-06T02:26:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.413+0000 7efedd53f700 1 -- 172.21.15.6:0/2700475999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed80b33e0 con 0x7efed8153b70 2023-10-06T02:26:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.414+0000 7efedd53f700 1 -- 172.21.15.6:0/2700475999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed80b2f60 con 0x7efed8153b70 2023-10-06T02:26:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.415+0000 7efeceffd700 1 -- 172.21.15.6:0/2700475999 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efec001a430 con 0x7efed8153b70 2023-10-06T02:26:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.415+0000 7efeceffd700 1 --2- 172.21.15.6:0/2700475999 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efeb8066f30 0x7efeb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.415+0000 7efeceffd700 1 -- 172.21.15.6:0/2700475999 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7238+0+0 (secure 0 0 0) 0x7efec0021070 con 0x7efed8153b70 2023-10-06T02:26:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.415+0000 7efed6ffd700 1 --2- 172.21.15.6:0/2700475999 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efeb8066f30 0x7efeb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.416+0000 7efed6ffd700 1 --2- 172.21.15.6:0/2700475999 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efeb8066f30 0x7efeb80693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efec80076a0 tx=0x7efec800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.419+0000 7efeceffd700 1 -- 172.21.15.6:0/2700475999 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efed80b2f60 con 0x7efed8153b70 2023-10-06T02:26:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.659+0000 7efedd53f700 1 -- 172.21.15.6:0/2700475999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efed80b2f60 con 0x7efed8153b70 2023-10-06T02:26:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.660+0000 7efeceffd700 1 -- 172.21.15.6:0/2700475999 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 147 v147) v1 ==== 95+0+3840 (secure 0 0 0) 0x7efed80b2f60 con 0x7efed8153b70 2023-10-06T02:26:04.661 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:04.661 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":147,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":147,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:03.843149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.662+0000 7efedd53f700 1 -- 172.21.15.6:0/2700475999 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efeb8066f30 msgr2=0x7efeb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.662+0000 7efedd53f700 1 --2- 172.21.15.6:0/2700475999 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efeb8066f30 0x7efeb80693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efec80076a0 tx=0x7efec800b040 comp rx=0 tx=0).stop 2023-10-06T02:26:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.662+0000 7efedd53f700 1 -- 172.21.15.6:0/2700475999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed8153b70 msgr2=0x7efed80c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.662+0000 7efedd53f700 1 --2- 172.21.15.6:0/2700475999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed8153b70 0x7efed80c62d0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7efec00090b0 tx=0x7efec0017000 comp rx=0 tx=0).stop 2023-10-06T02:26:04.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.662+0000 7efedd53f700 1 -- 172.21.15.6:0/2700475999 shutdown_connections 2023-10-06T02:26:04.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.662+0000 7efedd53f700 1 --2- 172.21.15.6:0/2700475999 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed8153f40 0x7efed80c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.662+0000 7efedd53f700 1 --2- 172.21.15.6:0/2700475999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed80cb210 0x7efed8151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.662+0000 7efedd53f700 1 --2- 172.21.15.6:0/2700475999 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efeb8066f30 0x7efeb80693e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.662+0000 7efedd53f700 1 --2- 172.21.15.6:0/2700475999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed8153b70 0x7efed80c62d0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.662+0000 7efedd53f700 1 -- 172.21.15.6:0/2700475999 >> 172.21.15.6:0/2700475999 conn(0x7efed8068680 msgr2=0x7efed815c270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:04.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.662+0000 7efedd53f700 1 -- 172.21.15.6:0/2700475999 shutdown_connections 2023-10-06T02:26:04.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.662+0000 7efedd53f700 1 -- 172.21.15.6:0/2700475999 wait complete. 2023-10-06T02:26:04.664 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 147 2023-10-06T02:26:04.675 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:26:04.675 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:04.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.793+0000 7f81df73c700 1 Processor -- start 2023-10-06T02:26:04.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.793+0000 7f81df73c700 1 -- start start 2023-10-06T02:26:04.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.794+0000 7f81df73c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f81d80af8b0 0x7f81d815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.794+0000 7f81df73c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d815e190 con 0x7f81d80af4e0 2023-10-06T02:26:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.794+0000 7f81df73c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d80cb650 con 0x7f81d80b27f0 2023-10-06T02:26:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.794+0000 7f81df73c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d80b1910 con 0x7f81d80af8b0 2023-10-06T02:26:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.794+0000 7f81dd4d8700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f81d80af4e0 0x7f81d80b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57830/0 (socket says 172.21.15.6:57830) 2023-10-06T02:26:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.794+0000 7f81dd4d8700 1 -- 172.21.15.6:0/1012388105 learned_addr learned my addr 172.21.15.6:0/1012388105 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.794+0000 7f81d7fff700 1 -- 172.21.15.6:0/1012388105 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638831310 0 0) 0x7f81d815e190 con 0x7f81d80af4e0 2023-10-06T02:26:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.794+0000 7f81dccd7700 1 --2- 172.21.15.6:0/1012388105 >> v2:172.21.15.175:3300/0 conn(0x7f81d80af8b0 0x7f81d815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.794+0000 7f81d7fff700 1 -- 172.21.15.6:0/1012388105 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c0003570 con 0x7f81d80af4e0 2023-10-06T02:26:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81d7fff700 1 -- 172.21.15.6:0/1012388105 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1805726990 0 0) 0x7f81c0003570 con 0x7f81d80af4e0 2023-10-06T02:26:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81d7fff700 1 -- 172.21.15.6:0/1012388105 >> v2:172.21.15.175:3300/0 conn(0x7f81d80af8b0 msgr2=0x7f81d815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81d7fff700 1 --2- 172.21.15.6:0/1012388105 >> v2:172.21.15.175:3300/0 conn(0x7f81d80af8b0 0x7f81d815d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81d7fff700 1 -- 172.21.15.6:0/1012388105 >> v1:172.21.15.175:6789/0 conn(0x7f81d80b27f0 legacy=0x7f81d815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81d7fff700 1 -- 172.21.15.6:0/1012388105 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d80ccaf0 con 0x7f81d80af4e0 2023-10-06T02:26:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81d7fff700 1 -- 172.21.15.6:0/1012388105 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f81c80017f0 con 0x7f81d80af4e0 2023-10-06T02:26:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81d7fff700 1 -- 172.21.15.6:0/1012388105 >> v1:172.21.15.6:6789/0 conn(0x7f81d80af4e0 legacy=0x7f81d80b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81d7fff700 1 --2- 172.21.15.6:0/1012388105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c0003a60 0x7f81c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81d7fff700 1 --2- 172.21.15.6:0/1012388105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c0004810 0x7f81c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81d7fff700 1 --2- 172.21.15.6:0/1012388105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c00051c0 0x7f81c000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81d7fff700 1 -- 172.21.15.6:0/1012388105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80b1910 con 0x7f81c0003a60 2023-10-06T02:26:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81d7fff700 1 -- 172.21.15.6:0/1012388105 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c000c160 con 0x7f81c0004810 2023-10-06T02:26:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81d7fff700 1 -- 172.21.15.6:0/1012388105 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c000c320 con 0x7f81c00051c0 2023-10-06T02:26:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81dd4d8700 1 --2- 172.21.15.6:0/1012388105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c0003a60 0x7f81c0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81dccd7700 1 --2- 172.21.15.6:0/1012388105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c0004810 0x7f81c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81ddcd9700 1 --2- 172.21.15.6:0/1012388105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c00051c0 0x7f81c000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81dd4d8700 1 -- 172.21.15.6:0/1012388105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c00051c0 msgr2=0x7f81c000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81dd4d8700 1 --2- 172.21.15.6:0/1012388105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c00051c0 0x7f81c000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81dd4d8700 1 -- 172.21.15.6:0/1012388105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c0004810 msgr2=0x7f81c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81dd4d8700 1 --2- 172.21.15.6:0/1012388105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c0004810 0x7f81c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81dd4d8700 1 -- 172.21.15.6:0/1012388105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c0003570 con 0x7f81c0003a60 2023-10-06T02:26:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81ddcd9700 1 -- 172.21.15.6:0/1012388105 reap_dead start 2023-10-06T02:26:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81dccd7700 1 --2- 172.21.15.6:0/1012388105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c0004810 0x7f81c0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81dd4d8700 1 --2- 172.21.15.6:0/1012388105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c0003a60 0x7f81c0003e70 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f81c800a900 tx=0x7f81d80ccc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5ae14931a9e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81d7fff700 1 -- 172.21.15.6:0/1012388105 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80070d0 con 0x7f81c0003a60 2023-10-06T02:26:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81d7fff700 1 -- 172.21.15.6:0/1012388105 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c8007230 con 0x7f81c0003a60 2023-10-06T02:26:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.795+0000 7f81d7fff700 1 -- 172.21.15.6:0/1012388105 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80075f0 con 0x7f81c0003a60 2023-10-06T02:26:04.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.796+0000 7f81df73c700 1 -- 172.21.15.6:0/1012388105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c0003a60 msgr2=0x7f81c0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:04.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.796+0000 7f81df73c700 1 --2- 172.21.15.6:0/1012388105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c0003a60 0x7f81c0003e70 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f81c800a900 tx=0x7f81d80ccc80 comp rx=0 tx=0).stop 2023-10-06T02:26:04.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.796+0000 7f81df73c700 1 -- 172.21.15.6:0/1012388105 shutdown_connections 2023-10-06T02:26:04.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.796+0000 7f81df73c700 1 --2- 172.21.15.6:0/1012388105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c0003a60 0x7f81c0003e70 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.796+0000 7f81df73c700 1 -- 172.21.15.6:0/1012388105 >> 172.21.15.6:0/1012388105 conn(0x7f81d8068680 msgr2=0x7f81d8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:04.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.796+0000 7f81df73c700 1 -- 172.21.15.6:0/1012388105 shutdown_connections 2023-10-06T02:26:04.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.796+0000 7f81df73c700 1 -- 172.21.15.6:0/1012388105 wait complete. 2023-10-06T02:26:04.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.797+0000 7f81df73c700 1 Processor -- start 2023-10-06T02:26:04.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.797+0000 7f81df73c700 1 -- start start 2023-10-06T02:26:04.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.798+0000 7f81df73c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c0003a60 0x7f81d80a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:04.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.798+0000 7f81df73c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d80a91f0 0x7f81d80a9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:04.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.798+0000 7f81df73c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81d816a630 0x7f81d816aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:04.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.798+0000 7f81df73c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80a8010 con 0x7f81c0003a60 2023-10-06T02:26:04.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.798+0000 7f81df73c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80a9b80 con 0x7f81d80a91f0 2023-10-06T02:26:04.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.798+0000 7f81df73c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80a7400 con 0x7f81d816a630 2023-10-06T02:26:04.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.798+0000 7f81dd4d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c0003a60 0x7f81d80a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:04.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.798+0000 7f81dd4d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c0003a60 0x7f81d80a6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38412/0 (socket says 172.21.15.6:38412) 2023-10-06T02:26:04.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.798+0000 7f81dd4d8700 1 -- 172.21.15.6:0/2914186559 learned_addr learned my addr 172.21.15.6:0/2914186559 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:04.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.798+0000 7f81dccd7700 1 --2- 172.21.15.6:0/2914186559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d80a91f0 0x7f81d80a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:04.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.798+0000 7f81ddcd9700 1 --2- 172.21.15.6:0/2914186559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81d816a630 0x7f81d816aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:04.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.798+0000 7f81dd4d8700 1 -- 172.21.15.6:0/2914186559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81d816a630 msgr2=0x7f81d816aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:04.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.798+0000 7f81dd4d8700 1 --2- 172.21.15.6:0/2914186559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81d816a630 0x7f81d816aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.798+0000 7f81dd4d8700 1 -- 172.21.15.6:0/2914186559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d80a91f0 msgr2=0x7f81d80a9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:04.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.798+0000 7f81dd4d8700 1 --2- 172.21.15.6:0/2914186559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d80a91f0 0x7f81d80a9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:04.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.798+0000 7f81dd4d8700 1 -- 172.21.15.6:0/2914186559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d80a76e0 con 0x7f81c0003a60 2023-10-06T02:26:04.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.798+0000 7f81dccd7700 1 --2- 172.21.15.6:0/2914186559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d80a91f0 0x7f81d80a9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:04.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.799+0000 7f81dd4d8700 1 --2- 172.21.15.6:0/2914186559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c0003a60 0x7f81d80a6d20 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f81c800a3f0 tx=0x7f81c8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:04.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.799+0000 7f81d57fa700 1 -- 172.21.15.6:0/2914186559 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8027420 con 0x7f81c0003a60 2023-10-06T02:26:04.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.799+0000 7f81d57fa700 1 -- 172.21.15.6:0/2914186559 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c8027580 con 0x7f81c0003a60 2023-10-06T02:26:04.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.799+0000 7f81df73c700 1 -- 172.21.15.6:0/2914186559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d80a79c0 con 0x7f81c0003a60 2023-10-06T02:26:04.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.799+0000 7f81d57fa700 1 -- 172.21.15.6:0/2914186559 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8027730 con 0x7f81c0003a60 2023-10-06T02:26:04.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.799+0000 7f81df73c700 1 -- 172.21.15.6:0/2914186559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d816aff0 con 0x7f81c0003a60 2023-10-06T02:26:04.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.800+0000 7f81df73c700 1 -- 172.21.15.6:0/2914186559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d816b210 con 0x7f81c0003a60 2023-10-06T02:26:04.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.800+0000 7f81d57fa700 1 -- 172.21.15.6:0/2914186559 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81c8024020 con 0x7f81c0003a60 2023-10-06T02:26:04.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.800+0000 7f81d57fa700 1 --2- 172.21.15.6:0/2914186559 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81c4066f30 0x7f81c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:04.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.801+0000 7f81d57fa700 1 -- 172.21.15.6:0/2914186559 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f81c8086950 con 0x7f81c0003a60 2023-10-06T02:26:04.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.801+0000 7f81dccd7700 1 --2- 172.21.15.6:0/2914186559 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81c4066f30 0x7f81c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:04.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.801+0000 7f81dccd7700 1 --2- 172.21.15.6:0/2914186559 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81c4066f30 0x7f81c40693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f81d802b6c0 tx=0x7f81cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:04.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:04.805+0000 7f81d57fa700 1 -- 172.21.15.6:0/2914186559 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81c80535c0 con 0x7f81c0003a60 2023-10-06T02:26:05.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.055+0000 7f81df73c700 1 -- 172.21.15.6:0/2914186559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81d80cad20 con 0x7f81c0003a60 2023-10-06T02:26:05.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.055+0000 7f81d57fa700 1 -- 172.21.15.6:0/2914186559 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 148 v148) v1 ==== 95+0+4595 (secure 0 0 0) 0x7f81c8056be0 con 0x7f81c0003a60 2023-10-06T02:26:05.056 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:05.056 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":148,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/4105967039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":4105967039},{"type":"v1","addr":"172.21.15.6:6835","nonce":4105967039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":148}],"filesystems":[{"mdsmap":{"epoch":147,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:03.843149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.057+0000 7f81df73c700 1 -- 172.21.15.6:0/2914186559 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81c4066f30 msgr2=0x7f81c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.057+0000 7f81df73c700 1 --2- 172.21.15.6:0/2914186559 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81c4066f30 0x7f81c40693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f81d802b6c0 tx=0x7f81cc008040 comp rx=0 tx=0).stop 2023-10-06T02:26:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.057+0000 7f81df73c700 1 -- 172.21.15.6:0/2914186559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c0003a60 msgr2=0x7f81d80a6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.057+0000 7f81df73c700 1 --2- 172.21.15.6:0/2914186559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c0003a60 0x7f81d80a6d20 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f81c800a3f0 tx=0x7f81c8015000 comp rx=0 tx=0).stop 2023-10-06T02:26:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.058+0000 7f81df73c700 1 -- 172.21.15.6:0/2914186559 shutdown_connections 2023-10-06T02:26:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.058+0000 7f81df73c700 1 --2- 172.21.15.6:0/2914186559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81d816a630 0x7f81d816aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.058+0000 7f81df73c700 1 --2- 172.21.15.6:0/2914186559 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81c4066f30 0x7f81c40693e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.058+0000 7f81df73c700 1 --2- 172.21.15.6:0/2914186559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81c0003a60 0x7f81d80a6d20 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.058+0000 7f81df73c700 1 --2- 172.21.15.6:0/2914186559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d80a91f0 0x7f81d80a9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.058+0000 7f81df73c700 1 -- 172.21.15.6:0/2914186559 >> 172.21.15.6:0/2914186559 conn(0x7f81d8068680 msgr2=0x7f81d8068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.058+0000 7f81df73c700 1 -- 172.21.15.6:0/2914186559 shutdown_connections 2023-10-06T02:26:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.058+0000 7f81df73c700 1 -- 172.21.15.6:0/2914186559 wait complete. 2023-10-06T02:26:05.060 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 148 2023-10-06T02:26:05.070 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete mds0_inotable' led to DAMAGED state 2023-10-06T02:26:05.070 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 100.00000000' 2023-10-06T02:26:05.070 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:05.071 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:26:05.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:05.071 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:26:05.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:26:05.086 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:26:05.086 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:26:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.246+0000 7fe14b59e700 1 Processor -- start 2023-10-06T02:26:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.246+0000 7fe14b59e700 1 -- start start 2023-10-06T02:26:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.247+0000 7fe14b59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe14c159400 0x7fe14c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.247+0000 7fe14b59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe14c0cd030 0x7fe14c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.247+0000 7fe14b59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14c0b3560 con 0x7fe14c0cf1a0 2023-10-06T02:26:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.247+0000 7fe14b59e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14c0cf6f0 con 0x7fe14c0cd030 2023-10-06T02:26:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.247+0000 7fe14b59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0cf9d0 con 0x7fe14c159400 2023-10-06T02:26:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.247+0000 7fe149d9b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe14c0cd030 0x7fe14c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.247+0000 7fe14a59c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe14c159400 0x7fe14c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.247+0000 7fe14a59c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe14c159400 0x7fe14c0ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:34582/0 (socket says 172.21.15.6:34582) 2023-10-06T02:26:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.247+0000 7fe14a59c700 1 -- 172.21.15.6:0/2874062561 learned_addr learned my addr 172.21.15.6:0/2874062561 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.247+0000 7fe149d9b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe14c0cd030 0x7fe14c0cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:52238/0 (socket says 172.21.15.6:52238) 2023-10-06T02:26:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.248+0000 7fe14a59c700 1 -- 172.21.15.6:0/2874062561 >> v2:172.21.15.175:3300/0 conn(0x7fe14c0cd030 msgr2=0x7fe14c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:05.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.248+0000 7fe14a59c700 1 --2- 172.21.15.6:0/2874062561 >> v2:172.21.15.175:3300/0 conn(0x7fe14c0cd030 0x7fe14c0cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:05.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.248+0000 7fe14a59c700 1 -- 172.21.15.6:0/2874062561 >> v1:172.21.15.175:6789/0 conn(0x7fe14c0cf1a0 legacy=0x7fe14c0b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:05.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.248+0000 7fe14a59c700 1 -- 172.21.15.6:0/2874062561 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0b2f10 con 0x7fe14c159400 2023-10-06T02:26:05.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.248+0000 7fe14959a700 1 -- 172.21.15.6:0/2874062561 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742827315 0 0) 0x7fe14c0b3560 con 0x7fe14c0cf1a0 2023-10-06T02:26:05.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.248+0000 7fe149d9b700 1 --2- 172.21.15.6:0/2874062561 >> v2:172.21.15.175:3300/0 conn(0x7fe14c0cd030 0x7fe14c0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:26:05.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.248+0000 7fe14a59c700 1 --2- 172.21.15.6:0/2874062561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe14c159400 0x7fe14c0ccaf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe144009f70 tx=0x7fe144009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9a19d8b9c599e32 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:05.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.248+0000 7fe14959a700 1 -- 172.21.15.6:0/2874062561 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14400e070 con 0x7fe14c159400 2023-10-06T02:26:05.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.248+0000 7fe14959a700 1 -- 172.21.15.6:0/2874062561 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14400ba20 con 0x7fe14c159400 2023-10-06T02:26:05.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.248+0000 7fe14959a700 1 -- 172.21.15.6:0/2874062561 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1440092e0 con 0x7fe14c159400 2023-10-06T02:26:05.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.249+0000 7fe14b59e700 1 -- 172.21.15.6:0/2874062561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe14c159400 msgr2=0x7fe14c0ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:05.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.249+0000 7fe14b59e700 1 --2- 172.21.15.6:0/2874062561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe14c159400 0x7fe14c0ccaf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe144009f70 tx=0x7fe144009840 comp rx=0 tx=0).stop 2023-10-06T02:26:05.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.249+0000 7fe14b59e700 1 -- 172.21.15.6:0/2874062561 shutdown_connections 2023-10-06T02:26:05.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.249+0000 7fe14b59e700 1 --2- 172.21.15.6:0/2874062561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe14c159400 0x7fe14c0ccaf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:05.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.249+0000 7fe14b59e700 1 --2- 172.21.15.6:0/2874062561 >> v2:172.21.15.175:3300/0 conn(0x7fe14c0cd030 0x7fe14c0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.249+0000 7fe14b59e700 1 -- 172.21.15.6:0/2874062561 >> 172.21.15.6:0/2874062561 conn(0x7fe14c06ac10 msgr2=0x7fe14c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.249+0000 7fe14b59e700 1 -- 172.21.15.6:0/2874062561 shutdown_connections 2023-10-06T02:26:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.249+0000 7fe14b59e700 1 -- 172.21.15.6:0/2874062561 wait complete. 2023-10-06T02:26:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.250+0000 7fe14b59e700 1 Processor -- start 2023-10-06T02:26:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.250+0000 7fe14b59e700 1 -- start start 2023-10-06T02:26:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.251+0000 7fe14b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14c0cd030 0x7fe14c16df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.251+0000 7fe14b59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe14c0cf1a0 0x7fe14c1419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.251+0000 7fe14b59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe14c159400 0x7fe14c158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.251+0000 7fe14b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c16e4d0 con 0x7fe14c0cd030 2023-10-06T02:26:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.251+0000 7fe14b59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c16d540 con 0x7fe14c159400 2023-10-06T02:26:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.251+0000 7fe14b59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c1560a0 con 0x7fe14c0cf1a0 2023-10-06T02:26:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.251+0000 7fe14a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14c0cd030 0x7fe14c16df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.251+0000 7fe14a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14c0cd030 0x7fe14c16df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38416/0 (socket says 172.21.15.6:38416) 2023-10-06T02:26:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.251+0000 7fe14a59c700 1 -- 172.21.15.6:0/314115392 learned_addr learned my addr 172.21.15.6:0/314115392 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.251+0000 7fe149d9b700 1 --2- 172.21.15.6:0/314115392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe14c0cf1a0 0x7fe14c1419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.251+0000 7fe14ad9d700 1 --2- 172.21.15.6:0/314115392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe14c159400 0x7fe14c158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.251+0000 7fe14a59c700 1 -- 172.21.15.6:0/314115392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe14c0cf1a0 msgr2=0x7fe14c1419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.251+0000 7fe14a59c700 1 --2- 172.21.15.6:0/314115392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe14c0cf1a0 0x7fe14c1419f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.251+0000 7fe14a59c700 1 -- 172.21.15.6:0/314115392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe14c159400 msgr2=0x7fe14c158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.251+0000 7fe14a59c700 1 --2- 172.21.15.6:0/314115392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe14c159400 0x7fe14c158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.251+0000 7fe14a59c700 1 -- 172.21.15.6:0/314115392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe134009420 con 0x7fe14c0cd030 2023-10-06T02:26:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.251+0000 7fe14a59c700 1 --2- 172.21.15.6:0/314115392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14c0cd030 0x7fe14c16df90 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fe14400b6c0 tx=0x7fe144018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.252+0000 7fe1427fc700 1 -- 172.21.15.6:0/314115392 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1440094e0 con 0x7fe14c0cd030 2023-10-06T02:26:05.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.252+0000 7fe1427fc700 1 -- 172.21.15.6:0/314115392 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe144007c20 con 0x7fe14c0cd030 2023-10-06T02:26:05.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.252+0000 7fe14b59e700 1 -- 172.21.15.6:0/314115392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe144009ae0 con 0x7fe14c0cd030 2023-10-06T02:26:05.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.252+0000 7fe1427fc700 1 -- 172.21.15.6:0/314115392 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14401d420 con 0x7fe14c0cd030 2023-10-06T02:26:05.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.252+0000 7fe14b59e700 1 -- 172.21.15.6:0/314115392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14c16d790 con 0x7fe14c0cd030 2023-10-06T02:26:05.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.252+0000 7fe14b59e700 1 -- 172.21.15.6:0/314115392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c159850 con 0x7fe14c0cd030 2023-10-06T02:26:05.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.253+0000 7fe1427fc700 1 -- 172.21.15.6:0/314115392 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe144003040 con 0x7fe14c0cd030 2023-10-06T02:26:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.253+0000 7fe1427fc700 1 --2- 172.21.15.6:0/314115392 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe12c066f30 0x7fe12c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.253+0000 7fe1427fc700 1 -- 172.21.15.6:0/314115392 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fe1440869a0 con 0x7fe14c0cd030 2023-10-06T02:26:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.253+0000 7fe149d9b700 1 --2- 172.21.15.6:0/314115392 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe12c066f30 0x7fe12c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.254+0000 7fe149d9b700 1 --2- 172.21.15.6:0/314115392 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe12c066f30 0x7fe12c0693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe1340093f0 tx=0x7fe134008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:05.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.258+0000 7fe1427fc700 1 -- 172.21.15.6:0/314115392 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe144053610 con 0x7fe14c0cd030 2023-10-06T02:26:05.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.495+0000 7fe14b59e700 1 -- 172.21.15.6:0/314115392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe14c0b31f0 con 0x7fe14c0cd030 2023-10-06T02:26:05.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.856+0000 7fe1427fc700 1 -- 172.21.15.6:0/314115392 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v149) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe144056c30 con 0x7fe14c0cd030 2023-10-06T02:26:05.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.858+0000 7fe14b59e700 1 -- 172.21.15.6:0/314115392 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe12c066f30 msgr2=0x7fe12c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:05.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.858+0000 7fe14b59e700 1 --2- 172.21.15.6:0/314115392 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe12c066f30 0x7fe12c0693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe1340093f0 tx=0x7fe134008040 comp rx=0 tx=0).stop 2023-10-06T02:26:05.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.858+0000 7fe14b59e700 1 -- 172.21.15.6:0/314115392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14c0cd030 msgr2=0x7fe14c16df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:05.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.858+0000 7fe14b59e700 1 --2- 172.21.15.6:0/314115392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14c0cd030 0x7fe14c16df90 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fe14400b6c0 tx=0x7fe144018000 comp rx=0 tx=0).stop 2023-10-06T02:26:05.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.858+0000 7fe14b59e700 1 -- 172.21.15.6:0/314115392 shutdown_connections 2023-10-06T02:26:05.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.858+0000 7fe14b59e700 1 --2- 172.21.15.6:0/314115392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe14c159400 0x7fe14c158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:05.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.858+0000 7fe14b59e700 1 --2- 172.21.15.6:0/314115392 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe12c066f30 0x7fe12c0693e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:05.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.858+0000 7fe14b59e700 1 --2- 172.21.15.6:0/314115392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14c0cd030 0x7fe14c16df90 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:05.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.858+0000 7fe14b59e700 1 --2- 172.21.15.6:0/314115392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe14c0cf1a0 0x7fe14c1419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:05.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.858+0000 7fe14b59e700 1 -- 172.21.15.6:0/314115392 >> 172.21.15.6:0/314115392 conn(0x7fe14c06ac10 msgr2=0x7fe14c15f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:05.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.858+0000 7fe14b59e700 1 -- 172.21.15.6:0/314115392 shutdown_connections 2023-10-06T02:26:05.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.858+0000 7fe14b59e700 1 -- 172.21.15.6:0/314115392 wait complete. 2023-10-06T02:26:05.860 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:26:05.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:26:05.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.992+0000 7f3d317dd700 1 Processor -- start 2023-10-06T02:26:05.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.992+0000 7f3d317dd700 1 -- start start 2023-10-06T02:26:05.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.993+0000 7f3d317dd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3d2c0cf1a0 0x7f3d2c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:05.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.993+0000 7f3d317dd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2c0b3560 con 0x7f3d2c159400 2023-10-06T02:26:05.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.993+0000 7f3d317dd700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2c0cf6f0 con 0x7f3d2c1597d0 2023-10-06T02:26:05.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.993+0000 7f3d317dd700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2c0cf9d0 con 0x7f3d2c0cf1a0 2023-10-06T02:26:05.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.993+0000 7f3d2bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3d2c159400 0x7f3d2c0ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57844/0 (socket says 172.21.15.6:57844) 2023-10-06T02:26:05.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.993+0000 7f3d2bfff700 1 -- 172.21.15.6:0/245169965 learned_addr learned my addr 172.21.15.6:0/245169965 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:05.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.993+0000 7f3d2affd700 1 -- 172.21.15.6:0/245169965 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421077622 0 0) 0x7f3d2c0b3560 con 0x7f3d2c159400 2023-10-06T02:26:05.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.993+0000 7f3d2affd700 1 -- 172.21.15.6:0/245169965 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d18003570 con 0x7f3d2c159400 2023-10-06T02:26:05.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.993+0000 7f3d2b7fe700 1 --2- 172.21.15.6:0/245169965 >> v2:172.21.15.175:3300/0 conn(0x7f3d2c0cf1a0 0x7f3d2c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:05.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d2affd700 1 -- 172.21.15.6:0/245169965 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3330790365 0 0) 0x7f3d18003570 con 0x7f3d2c159400 2023-10-06T02:26:05.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d2affd700 1 -- 172.21.15.6:0/245169965 >> v2:172.21.15.175:3300/0 conn(0x7f3d2c0cf1a0 msgr2=0x7f3d2c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:05.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d2affd700 1 --2- 172.21.15.6:0/245169965 >> v2:172.21.15.175:3300/0 conn(0x7f3d2c0cf1a0 0x7f3d2c0cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:05.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d2affd700 1 -- 172.21.15.6:0/245169965 >> v1:172.21.15.175:6789/0 conn(0x7f3d2c1597d0 legacy=0x7f3d2c0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:05.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d2affd700 1 -- 172.21.15.6:0/245169965 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c0b2f10 con 0x7f3d2c159400 2023-10-06T02:26:05.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d2affd700 1 -- 172.21.15.6:0/245169965 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f3d140015f0 con 0x7f3d2c159400 2023-10-06T02:26:05.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d2affd700 1 -- 172.21.15.6:0/245169965 >> v1:172.21.15.6:6789/0 conn(0x7f3d2c159400 legacy=0x7f3d2c0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:05.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d2affd700 1 --2- 172.21.15.6:0/245169965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d18003a60 0x7f3d18003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:05.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d2affd700 1 --2- 172.21.15.6:0/245169965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d18004810 0x7f3d18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:05.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d2affd700 1 --2- 172.21.15.6:0/245169965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d180051c0 0x7f3d1800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:05.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d2affd700 1 -- 172.21.15.6:0/245169965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c0cf9d0 con 0x7f3d180051c0 2023-10-06T02:26:05.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d2affd700 1 -- 172.21.15.6:0/245169965 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1800c0d0 con 0x7f3d18003a60 2023-10-06T02:26:05.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d2affd700 1 -- 172.21.15.6:0/245169965 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1800c290 con 0x7f3d18004810 2023-10-06T02:26:05.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d30fdc700 1 --2- 172.21.15.6:0/245169965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d180051c0 0x7f3d1800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:05.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d2bfff700 1 --2- 172.21.15.6:0/245169965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d18003a60 0x7f3d18003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:05.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d2b7fe700 1 --2- 172.21.15.6:0/245169965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d18004810 0x7f3d18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:05.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d30fdc700 1 -- 172.21.15.6:0/245169965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d18004810 msgr2=0x7f3d18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:05.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d30fdc700 1 --2- 172.21.15.6:0/245169965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d18004810 0x7f3d18004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:05.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d30fdc700 1 -- 172.21.15.6:0/245169965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d18003a60 msgr2=0x7f3d18003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:05.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d30fdc700 1 --2- 172.21.15.6:0/245169965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d18003a60 0x7f3d18003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:05.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d30fdc700 1 -- 172.21.15.6:0/245169965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d18003570 con 0x7f3d180051c0 2023-10-06T02:26:05.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d30fdc700 1 -- 172.21.15.6:0/245169965 reap_dead start 2023-10-06T02:26:05.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d30fdc700 1 --2- 172.21.15.6:0/245169965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d180051c0 0x7f3d1800ba60 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f3d24001fc0 tx=0x7f3d24001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d8eaeb0aea48924 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:05.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.994+0000 7f3d2affd700 1 -- 172.21.15.6:0/245169965 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d24001950 con 0x7f3d180051c0 2023-10-06T02:26:05.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.995+0000 7f3d2affd700 1 -- 172.21.15.6:0/245169965 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2400c8b0 con 0x7f3d180051c0 2023-10-06T02:26:05.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.995+0000 7f3d2affd700 1 -- 172.21.15.6:0/245169965 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2400cc50 con 0x7f3d180051c0 2023-10-06T02:26:05.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.995+0000 7f3d317dd700 1 -- 172.21.15.6:0/245169965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d180051c0 msgr2=0x7f3d1800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:05.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.995+0000 7f3d317dd700 1 --2- 172.21.15.6:0/245169965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d180051c0 0x7f3d1800ba60 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f3d24001fc0 tx=0x7f3d24001640 comp rx=0 tx=0).stop 2023-10-06T02:26:05.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.995+0000 7f3d317dd700 1 -- 172.21.15.6:0/245169965 shutdown_connections 2023-10-06T02:26:05.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.995+0000 7f3d317dd700 1 --2- 172.21.15.6:0/245169965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d180051c0 0x7f3d1800ba60 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:05.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.995+0000 7f3d317dd700 1 -- 172.21.15.6:0/245169965 >> 172.21.15.6:0/245169965 conn(0x7f3d2c06ac10 msgr2=0x7f3d2c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:05.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.995+0000 7f3d317dd700 1 -- 172.21.15.6:0/245169965 shutdown_connections 2023-10-06T02:26:05.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.995+0000 7f3d317dd700 1 -- 172.21.15.6:0/245169965 wait complete. 2023-10-06T02:26:06.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.996+0000 7f3d317dd700 1 Processor -- start 2023-10-06T02:26:06.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.996+0000 7f3d317dd700 1 -- start start 2023-10-06T02:26:06.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.997+0000 7f3d317dd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d180051c0 0x7f3d2c15e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:06.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.997+0000 7f3d317dd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d2c0c5e10 0x7f3d2c0c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:06.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.997+0000 7f3d317dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d2c0c6280 0x7f3d2c0c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:06.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.997+0000 7f3d317dd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c0c5190 con 0x7f3d2c0c6280 2023-10-06T02:26:06.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.997+0000 7f3d317dd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c15d020 con 0x7f3d180051c0 2023-10-06T02:26:06.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.997+0000 7f3d317dd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c15d2c0 con 0x7f3d2c0c5e10 2023-10-06T02:26:06.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.997+0000 7f3d30fdc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d2c0c6280 0x7f3d2c0c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:06.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.997+0000 7f3d30fdc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d2c0c6280 0x7f3d2c0c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38432/0 (socket says 172.21.15.6:38432) 2023-10-06T02:26:06.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.997+0000 7f3d30fdc700 1 -- 172.21.15.6:0/1900865289 learned_addr learned my addr 172.21.15.6:0/1900865289 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:06.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.998+0000 7f3d2b7fe700 1 --2- 172.21.15.6:0/1900865289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d2c0c5e10 0x7f3d2c0c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:06.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.998+0000 7f3d2bfff700 1 --2- 172.21.15.6:0/1900865289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d180051c0 0x7f3d2c15e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:06.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.998+0000 7f3d30fdc700 1 -- 172.21.15.6:0/1900865289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d2c0c5e10 msgr2=0x7f3d2c0c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:06.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.998+0000 7f3d30fdc700 1 --2- 172.21.15.6:0/1900865289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d2c0c5e10 0x7f3d2c0c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:06.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.998+0000 7f3d30fdc700 1 -- 172.21.15.6:0/1900865289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d180051c0 msgr2=0x7f3d2c15e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:06.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.998+0000 7f3d30fdc700 1 --2- 172.21.15.6:0/1900865289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d180051c0 0x7f3d2c15e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:06.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.998+0000 7f3d30fdc700 1 -- 172.21.15.6:0/1900865289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c15d5a0 con 0x7f3d2c0c6280 2023-10-06T02:26:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.998+0000 7f3d2bfff700 1 --2- 172.21.15.6:0/1900865289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d180051c0 0x7f3d2c15e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.998+0000 7f3d2b7fe700 1 --2- 172.21.15.6:0/1900865289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d2c0c5e10 0x7f3d2c0c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.998+0000 7f3d30fdc700 1 --2- 172.21.15.6:0/1900865289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d2c0c6280 0x7f3d2c0c9b30 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c0b4fe0 tx=0x7f3d24015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.998+0000 7f3d23fff700 1 -- 172.21.15.6:0/1900865289 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2400c6d0 con 0x7f3d2c0c6280 2023-10-06T02:26:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.998+0000 7f3d23fff700 1 -- 172.21.15.6:0/1900865289 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d24006ba0 con 0x7f3d2c0c6280 2023-10-06T02:26:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.998+0000 7f3d317dd700 1 -- 172.21.15.6:0/1900865289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2c15d880 con 0x7f3d2c0c6280 2023-10-06T02:26:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.998+0000 7f3d23fff700 1 -- 172.21.15.6:0/1900865289 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2401d420 con 0x7f3d2c0c6280 2023-10-06T02:26:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.998+0000 7f3d317dd700 1 -- 172.21.15.6:0/1900865289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2c15de40 con 0x7f3d2c0c6280 2023-10-06T02:26:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.999+0000 7f3d317dd700 1 -- 172.21.15.6:0/1900865289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2c0ccaf0 con 0x7f3d2c0c6280 2023-10-06T02:26:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:05.999+0000 7f3d23fff700 1 -- 172.21.15.6:0/1900865289 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d24007030 con 0x7f3d2c0c6280 2023-10-06T02:26:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.000+0000 7f3d23fff700 1 --2- 172.21.15.6:0/1900865289 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3d0c066f30 0x7f3d0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.000+0000 7f3d23fff700 1 -- 172.21.15.6:0/1900865289 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f3d240859d0 con 0x7f3d2c0c6280 2023-10-06T02:26:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.000+0000 7f3d2bfff700 1 --2- 172.21.15.6:0/1900865289 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3d0c066f30 0x7f3d0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.000+0000 7f3d2bfff700 1 --2- 172.21.15.6:0/1900865289 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3d0c066f30 0x7f3d0c0693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3d14000e10 tx=0x7f3d14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.004+0000 7f3d23fff700 1 -- 172.21.15.6:0/1900865289 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d24052640 con 0x7f3d2c0c6280 2023-10-06T02:26:06.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.279+0000 7f3d317dd700 1 -- 172.21.15.6:0/1900865289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f3d2c0b31f0 con 0x7f3d2c0c6280 2023-10-06T02:26:06.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.860+0000 7f3d23fff700 1 -- 172.21.15.6:0/1900865289 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v150) v1 ==== 101+0+0 (secure 0 0 0) 0x7f3d24017020 con 0x7f3d2c0c6280 2023-10-06T02:26:06.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.863+0000 7f3d317dd700 1 -- 172.21.15.6:0/1900865289 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3d0c066f30 msgr2=0x7f3d0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:06.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.863+0000 7f3d317dd700 1 --2- 172.21.15.6:0/1900865289 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3d0c066f30 0x7f3d0c0693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3d14000e10 tx=0x7f3d14009040 comp rx=0 tx=0).stop 2023-10-06T02:26:06.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.863+0000 7f3d317dd700 1 -- 172.21.15.6:0/1900865289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d2c0c6280 msgr2=0x7f3d2c0c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:06.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.863+0000 7f3d317dd700 1 --2- 172.21.15.6:0/1900865289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d2c0c6280 0x7f3d2c0c9b30 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c0b4fe0 tx=0x7f3d24015000 comp rx=0 tx=0).stop 2023-10-06T02:26:06.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.863+0000 7f3d317dd700 1 -- 172.21.15.6:0/1900865289 shutdown_connections 2023-10-06T02:26:06.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.863+0000 7f3d317dd700 1 --2- 172.21.15.6:0/1900865289 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3d0c066f30 0x7f3d0c0693e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:06.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.863+0000 7f3d317dd700 1 --2- 172.21.15.6:0/1900865289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d2c0c6280 0x7f3d2c0c9b30 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:06.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.863+0000 7f3d317dd700 1 --2- 172.21.15.6:0/1900865289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d180051c0 0x7f3d2c15e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:06.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.863+0000 7f3d317dd700 1 --2- 172.21.15.6:0/1900865289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d2c0c5e10 0x7f3d2c0c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:06.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.863+0000 7f3d317dd700 1 -- 172.21.15.6:0/1900865289 >> 172.21.15.6:0/1900865289 conn(0x7f3d2c06ac10 msgr2=0x7f3d2c157550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:06.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.863+0000 7f3d317dd700 1 -- 172.21.15.6:0/1900865289 shutdown_connections 2023-10-06T02:26:06.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.863+0000 7f3d317dd700 1 -- 172.21.15.6:0/1900865289 wait complete. 2023-10-06T02:26:06.865 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:26:06.876 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:26:06.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.915+0000 7fa462445000 1 Processor -- start 2023-10-06T02:26:06.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.915+0000 7fa462445000 1 -- start start 2023-10-06T02:26:06.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.915+0000 7fa462445000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb2db27160 0x55fb2db6d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:06.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.915+0000 7fa462445000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2dbe88b0 0x55fb2dc01c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:06.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.915+0000 7fa462445000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb2dbe8c80 0x55fb2dc009d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:06.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.915+0000 7fa462445000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2da73980 con 0x55fb2dbe8c80 2023-10-06T02:26:06.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.915+0000 7fa462445000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2da73620 con 0x55fb2dbe88b0 2023-10-06T02:26:06.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.915+0000 7fa462445000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb2da6a400 con 0x55fb2db27160 2023-10-06T02:26:06.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.916+0000 7fa45be81700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb2dbe8c80 0x55fb2dc009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:06.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.916+0000 7fa45be81700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb2dbe8c80 0x55fb2dc009d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38442/0 (socket says 172.21.15.6:38442) 2023-10-06T02:26:06.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.916+0000 7fa45be81700 1 -- 172.21.15.6:0/1919042362 learned_addr learned my addr 172.21.15.6:0/1919042362 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:06.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.916+0000 7fa45b680700 1 --2- 172.21.15.6:0/1919042362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb2db27160 0x55fb2db6d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:06.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.916+0000 7fa45ae7f700 1 --2- 172.21.15.6:0/1919042362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2dbe88b0 0x55fb2dc01c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:06.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.916+0000 7fa45be81700 1 -- 172.21.15.6:0/1919042362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb2db27160 msgr2=0x55fb2db6d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:06.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.916+0000 7fa45be81700 1 --2- 172.21.15.6:0/1919042362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb2db27160 0x55fb2db6d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.916+0000 7fa45be81700 1 -- 172.21.15.6:0/1919042362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2dbe88b0 msgr2=0x55fb2dc01c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.916+0000 7fa45be81700 1 --2- 172.21.15.6:0/1919042362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2dbe88b0 0x55fb2dc01c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.916+0000 7fa45be81700 1 -- 172.21.15.6:0/1919042362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa444005cf0 con 0x55fb2dbe8c80 2023-10-06T02:26:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.916+0000 7fa45be81700 1 --2- 172.21.15.6:0/1919042362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb2dbe8c80 0x55fb2dc009d0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00ac30 tx=0x7fa44c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39b29bdd1391058 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.916+0000 7fa459e7d700 1 -- 172.21.15.6:0/1919042362 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c00dde0 con 0x55fb2dbe8c80 2023-10-06T02:26:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.916+0000 7fa459e7d700 1 -- 172.21.15.6:0/1919042362 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44c00d810 con 0x55fb2dbe8c80 2023-10-06T02:26:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.916+0000 7fa459e7d700 1 -- 172.21.15.6:0/1919042362 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c01b670 con 0x55fb2dbe8c80 2023-10-06T02:26:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.917+0000 7fa462445000 1 -- 172.21.15.6:0/1919042362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb2dbe8c80 msgr2=0x55fb2dc009d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.917+0000 7fa462445000 1 --2- 172.21.15.6:0/1919042362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb2dbe8c80 0x55fb2dc009d0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00ac30 tx=0x7fa44c014000 comp rx=0 tx=0).stop 2023-10-06T02:26:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.917+0000 7fa462445000 1 -- 172.21.15.6:0/1919042362 shutdown_connections 2023-10-06T02:26:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.917+0000 7fa462445000 1 --2- 172.21.15.6:0/1919042362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb2dbe8c80 0x55fb2dc009d0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.917+0000 7fa462445000 1 --2- 172.21.15.6:0/1919042362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb2db27160 0x55fb2db6d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.917+0000 7fa462445000 1 --2- 172.21.15.6:0/1919042362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2dbe88b0 0x55fb2dc01c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.917+0000 7fa462445000 1 -- 172.21.15.6:0/1919042362 >> 172.21.15.6:0/1919042362 conn(0x55fb2db6fbd0 msgr2=0x55fb2dbff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.917+0000 7fa462445000 1 -- 172.21.15.6:0/1919042362 shutdown_connections 2023-10-06T02:26:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.917+0000 7fa462445000 1 -- 172.21.15.6:0/1919042362 wait complete. 2023-10-06T02:26:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.917+0000 7fa462445000 1 Processor -- start 2023-10-06T02:26:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.917+0000 7fa462445000 1 -- start start 2023-10-06T02:26:06.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.918+0000 7fa462445000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2db27160 0x55fb2dbdf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:06.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.918+0000 7fa462445000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb2dbe88b0 0x55fb2dbde900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:06.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.918+0000 7fa462445000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb2dbe8c80 0x55fb2dc009d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:06.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.918+0000 7fa462445000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2dbe1b40 con 0x55fb2dbe8c80 2023-10-06T02:26:06.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.918+0000 7fa462445000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2dbe0810 con 0x55fb2db27160 2023-10-06T02:26:06.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.918+0000 7fa462445000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb2dbdfdf0 con 0x55fb2dbe88b0 2023-10-06T02:26:06.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.918+0000 7fa45be81700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb2dbe8c80 0x55fb2dc009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:06.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.918+0000 7fa45be81700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb2dbe8c80 0x55fb2dc009d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38452/0 (socket says 172.21.15.6:38452) 2023-10-06T02:26:06.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.918+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 learned_addr learned my addr 172.21.15.6:0/4247962369 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:06.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.918+0000 7fa45ae7f700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb2dbe88b0 0x55fb2dbde900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:06.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.918+0000 7fa45b680700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2db27160 0x55fb2dbdf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:06.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.919+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb2dbe88b0 msgr2=0x55fb2dbde900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:06.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.919+0000 7fa45be81700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb2dbe88b0 0x55fb2dbde900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:06.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.919+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2db27160 msgr2=0x55fb2dbdf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:06.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.919+0000 7fa45be81700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2db27160 0x55fb2dbdf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:06.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.919+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb2da9c1c0 con 0x55fb2dbe8c80 2023-10-06T02:26:06.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.919+0000 7fa45be81700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb2dbe8c80 0x55fb2dc009d0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fa44c005e40 tx=0x7fa44c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:06.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.919+0000 7fa453fff700 1 -- 172.21.15.6:0/4247962369 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c01ba20 con 0x55fb2dbe8c80 2023-10-06T02:26:06.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.919+0000 7fa453fff700 1 -- 172.21.15.6:0/4247962369 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44c01bba0 con 0x55fb2dbe8c80 2023-10-06T02:26:06.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.919+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44c00a180 con 0x55fb2dbe8c80 2023-10-06T02:26:06.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.919+0000 7fa453fff700 1 -- 172.21.15.6:0/4247962369 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c030480 con 0x55fb2dbe8c80 2023-10-06T02:26:06.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.919+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb2da823d0 con 0x55fb2dbe8c80 2023-10-06T02:26:06.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.920+0000 7fa453fff700 1 -- 172.21.15.6:0/4247962369 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa44c003040 con 0x55fb2dbe8c80 2023-10-06T02:26:06.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.921+0000 7fa453fff700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa43c065890 0x7fa43c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:06.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.921+0000 7fa453fff700 1 -- 172.21.15.6:0/4247962369 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fa44c086630 con 0x55fb2dbe8c80 2023-10-06T02:26:06.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.921+0000 7fa45b680700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa43c065890 0x7fa43c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:06.927 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:26:06.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.921+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55fb2dbe21d0 0x55fb2dbe25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:06.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.921+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dbe2ae0 con 0x55fb2dbe21d0 2023-10-06T02:26:06.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.921+0000 7fa45ae7f700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55fb2dbe21d0 0x55fb2dbe25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:06.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.921+0000 7fa45b680700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa43c065890 0x7fa43c067d40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa454001ed0 tx=0x7fa454000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:06.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.921+0000 7fa45ae7f700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55fb2dbe21d0 0x55fb2dbe25a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:06.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.923+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v105'288 uv262 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.923+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dbe2ec0 con 0x55fb2dbe21d0 2023-10-06T02:26:06.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.924+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v105'289 uv289 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.924+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dbe3270 con 0x55fb2dbe21d0 2023-10-06T02:26:06.930 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:26:06.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.925+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v105'290 uv290 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.925+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1cf50 con 0x55fb2dbe21d0 2023-10-06T02:26:06.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.926+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v105'291 uv291 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.926+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1d300 con 0x55fb2dbe21d0 2023-10-06T02:26:06.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.927+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v105'292 uv292 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.928+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1bf40 con 0x55fb2dbe21d0 2023-10-06T02:26:06.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.928+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v105'293 uv293 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.929+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1c370 con 0x55fb2dbe21d0 2023-10-06T02:26:06.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.930+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v105'294 uv268 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.930+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1c370 con 0x55fb2dbe21d0 2023-10-06T02:26:06.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.931+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v105'295 uv295 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.931+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1c370 con 0x55fb2dbe21d0 2023-10-06T02:26:06.934 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:26:06.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.932+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v105'296 uv296 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.932+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1c370 con 0x55fb2dbe21d0 2023-10-06T02:26:06.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.933+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v105'297 uv297 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.933+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1c370 con 0x55fb2dbe21d0 2023-10-06T02:26:06.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.934+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v105'298 uv298 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.934+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1c370 con 0x55fb2dbe21d0 2023-10-06T02:26:06.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.935+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v105'299 uv299 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.935+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1c370 con 0x55fb2dbe21d0 2023-10-06T02:26:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.936+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v105'300 uv275 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.936+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1c370 con 0x55fb2dbe21d0 2023-10-06T02:26:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.937+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v105'301 uv301 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.937+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1c370 con 0x55fb2dbe21d0 2023-10-06T02:26:06.939 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:26:06.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.938+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v105'302 uv302 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.938+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1c370 con 0x55fb2dbe21d0 2023-10-06T02:26:06.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.939+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v105'303 uv303 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.939+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1c370 con 0x55fb2dbe21d0 2023-10-06T02:26:06.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.940+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v105'304 uv304 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.940+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1c370 con 0x55fb2dbe21d0 2023-10-06T02:26:06.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.942+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v105'305 uv305 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.942+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1d6b0 con 0x55fb2dbe21d0 2023-10-06T02:26:06.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.943+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v105'306 uv306 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.943+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1d6b0 con 0x55fb2dbe21d0 2023-10-06T02:26:06.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.944+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v105'307 uv281 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.944+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1d6b0 con 0x55fb2dbe21d0 2023-10-06T02:26:06.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.945+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v105'308 uv308 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.945+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1d6b0 con 0x55fb2dbe21d0 2023-10-06T02:26:06.947 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:26:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.946+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v105'309 uv309 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.946+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1cb20 con 0x55fb2dbe21d0 2023-10-06T02:26:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.948+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v105'310 uv310 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.948+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1cb20 con 0x55fb2dbe21d0 2023-10-06T02:26:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.949+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v105'311 uv311 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.949+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1cad0 con 0x55fb2dbe21d0 2023-10-06T02:26:06.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.950+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v105'312 uv312 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.950+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1cad0 con 0x55fb2dbe21d0 2023-10-06T02:26:06.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.951+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v105'313 uv287 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.951+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1cad0 con 0x55fb2dbe21d0 2023-10-06T02:26:06.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.953+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v105'314 uv314 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.953+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1cad0 con 0x55fb2dbe21d0 2023-10-06T02:26:06.954 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:26:06.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.954+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v105'315 uv315 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.954+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1cad0 con 0x55fb2dbe21d0 2023-10-06T02:26:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.955+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v105'316 uv316 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.955+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1cad0 con 0x55fb2dbe21d0 2023-10-06T02:26:06.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.956+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v105'317 uv317 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.956+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1cad0 con 0x55fb2dbe21d0 2023-10-06T02:26:06.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.957+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v105'318 uv318 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dbe21d0 2023-10-06T02:26:06.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.957+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55fb2dc1dbc0 0x55fb2dc1ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:06.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.957+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc1cad0 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.958+0000 7fa45b680700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55fb2dc1dbc0 0x55fb2dc1ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:06.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.958+0000 7fa45b680700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55fb2dc1dbc0 0x55fb2dc1ffa0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.959+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v105'215 uv198 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.959+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc204e0 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.960+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v105'216 uv216 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.961+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc20890 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.964 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:26:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.962+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v105'217 uv217 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.962+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc21130 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.963+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v105'218 uv218 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.963+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc214e0 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.964+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v105'219 uv219 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.964+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc21890 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.965+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v105'220 uv203 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.965+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc21c40 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.966+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v105'221 uv221 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.966+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc21ff0 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.967+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v105'222 uv222 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.967 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:26:06.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.967+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc21ff0 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.968+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v105'223 uv223 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.968+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc21ff0 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.969+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v105'224 uv224 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.969+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc21ff0 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.970+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v105'225 uv208 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.970+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc21ff0 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.971+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v105'226 uv226 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.971+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc21ff0 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.972+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v105'227 uv227 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.973 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:26:06.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.972+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc25710 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.973+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v105'228 uv228 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.973+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc25710 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.974+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v105'229 uv229 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.974+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc21ff0 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.975+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v105'230 uv214 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.975+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc21ff0 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.976+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v105'231 uv231 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.976+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc21ff0 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.979+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v105'232 uv232 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.979 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:26:06.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.979+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc23000 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.981+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v105'233 uv233 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.981+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc23000 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.982+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v105'234 uv234 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.982+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc21ff0 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.983+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v105'235 uv235 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.983+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55fb2dc22500 0x55fb2dc248e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:06.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.983+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc24e20 con 0x55fb2dc22500 2023-10-06T02:26:06.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.983+0000 7fa45ae7f700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55fb2dc22500 0x55fb2dc248e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:06.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.984+0000 7fa45ae7f700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55fb2dc22500 0x55fb2dc248e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:06.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.985+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v105'57 uv56 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:06.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.985+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc24e60 con 0x55fb2dc22500 2023-10-06T02:26:06.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.986+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v105'58 uv58 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:06.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.986+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc25290 con 0x55fb2dc22500 2023-10-06T02:26:06.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.987+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v105'59 uv59 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:06.988 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:26:06.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.987+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc262a0 con 0x55fb2dc22500 2023-10-06T02:26:06.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.988+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v105'60 uv60 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:06.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.988+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc262a0 con 0x55fb2dc22500 2023-10-06T02:26:06.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.989+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v105'61 uv61 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:06.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.989+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc25290 con 0x55fb2dc22500 2023-10-06T02:26:06.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.990+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v105'62 uv62 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:06.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.990+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc25290 con 0x55fb2dc22500 2023-10-06T02:26:06.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.991+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v105'43 uv42 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:06.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.991+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc25290 con 0x55fb2dc22500 2023-10-06T02:26:06.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.992+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v105'44 uv44 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:06.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.992+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc25290 con 0x55fb2dc22500 2023-10-06T02:26:06.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.994+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v105'45 uv45 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:06.995 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:26:06.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.994+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc25290 con 0x55fb2dc22500 2023-10-06T02:26:06.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.995+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v105'46 uv46 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:06.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.995+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc25290 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.996+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v105'57 uv56 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.996+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc25290 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.997+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v105'58 uv58 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.997+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc25290 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.999 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:26:06.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.998+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v105'59 uv59 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:06.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:06.998+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc25290 con 0x55fb2dc1dbc0 2023-10-06T02:26:07.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.000+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v105'60 uv60 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:07.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.000+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc25290 con 0x55fb2dc1dbc0 2023-10-06T02:26:07.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.001+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v105'61 uv61 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:07.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.001+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc25290 con 0x55fb2dc1dbc0 2023-10-06T02:26:07.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.002+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v105'62 uv62 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc1dbc0 2023-10-06T02:26:07.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.002+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55fb2dc25ba0 0x55fb2dc27f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.002+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc284c0 con 0x55fb2dc25ba0 2023-10-06T02:26:07.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.002+0000 7fa45be81700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55fb2dc25ba0 0x55fb2dc27f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.002+0000 7fa45be81700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55fb2dc25ba0 0x55fb2dc27f80 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:07.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.003+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v105'105 uv99 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc25ba0 2023-10-06T02:26:07.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.003+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc28870 con 0x55fb2dc25ba0 2023-10-06T02:26:07.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.004+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v105'106 uv106 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc25ba0 2023-10-06T02:26:07.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.004+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc28ce0 con 0x55fb2dc25ba0 2023-10-06T02:26:07.006 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:26:07.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.005+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v105'107 uv107 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc25ba0 2023-10-06T02:26:07.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.005+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc20d40 con 0x55fb2dc25ba0 2023-10-06T02:26:07.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.006+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v105'108 uv108 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc25ba0 2023-10-06T02:26:07.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.006+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc2a700 con 0x55fb2dc25ba0 2023-10-06T02:26:07.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.008+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v105'109 uv109 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc25ba0 2023-10-06T02:26:07.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.008+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc295d0 con 0x55fb2dc25ba0 2023-10-06T02:26:07.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.009+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v105'110 uv110 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc25ba0 2023-10-06T02:26:07.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.009+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc295d0 con 0x55fb2dc25ba0 2023-10-06T02:26:07.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.010+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v105'111 uv104 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc25ba0 2023-10-06T02:26:07.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.010+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc295d0 con 0x55fb2dc25ba0 2023-10-06T02:26:07.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.011+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v105'112 uv112 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc25ba0 2023-10-06T02:26:07.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.011+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc295d0 con 0x55fb2dc25ba0 2023-10-06T02:26:07.012 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:26:07.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.012+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v105'113 uv113 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc25ba0 2023-10-06T02:26:07.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.012+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc295d0 con 0x55fb2dc25ba0 2023-10-06T02:26:07.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.013+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v105'114 uv114 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc25ba0 2023-10-06T02:26:07.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.013+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc299d0 con 0x55fb2dc25ba0 2023-10-06T02:26:07.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.014+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v105'115 uv115 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc25ba0 2023-10-06T02:26:07.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.015+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55fb2dc29670 0x55fb2dc2cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.015+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc2d0b0 con 0x55fb2dc29670 2023-10-06T02:26:07.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.015+0000 7fa45b680700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55fb2dc29670 0x55fb2dc2cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.015+0000 7fa45b680700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55fb2dc29670 0x55fb2dc2cb70 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.016+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v105'46 uv45 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc29670 2023-10-06T02:26:07.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.016+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc2d0b0 con 0x55fb2dc29670 2023-10-06T02:26:07.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.017+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v105'47 uv47 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc29670 2023-10-06T02:26:07.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.017+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc2d0b0 con 0x55fb2dc29670 2023-10-06T02:26:07.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.018+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v105'48 uv48 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc29670 2023-10-06T02:26:07.019 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:26:07.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.018+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc2d0b0 con 0x55fb2dc29670 2023-10-06T02:26:07.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.020+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v105'49 uv49 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc29670 2023-10-06T02:26:07.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.020+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc29e50 con 0x55fb2dc29670 2023-10-06T02:26:07.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.021+0000 7fa45b680700 1 -- 172.21.15.6:0/4247962369 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v105'50 uv50 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa454016040 con 0x55fb2dc29670 2023-10-06T02:26:07.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.021+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc29e50 con 0x55fb2dc22500 2023-10-06T02:26:07.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.022+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v105'57 uv56 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.022+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc29e50 con 0x55fb2dc22500 2023-10-06T02:26:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.023+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v105'58 uv58 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.023+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc29e50 con 0x55fb2dc22500 2023-10-06T02:26:07.024 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:26:07.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.023+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v105'59 uv59 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.023+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc29e50 con 0x55fb2dc22500 2023-10-06T02:26:07.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.025+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v105'60 uv60 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.025+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc29e50 con 0x55fb2dc22500 2023-10-06T02:26:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.025+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v105'61 uv61 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.026+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc29e50 con 0x55fb2dc22500 2023-10-06T02:26:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.026+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v105'62 uv62 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.026+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55fb2dc2dab0 0x55fb2dc2fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.026+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc303d0 con 0x55fb2dc2dab0 2023-10-06T02:26:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.027+0000 7fa45ae7f700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55fb2dc2dab0 0x55fb2dc2fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.027+0000 7fa45ae7f700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55fb2dc2dab0 0x55fb2dc2fe90 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:07.028 INFO:teuthology.orchestra.run.smithi006.stdout:Write #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:26:07.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.028+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v105'95 uv95 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc2dab0 2023-10-06T02:26:07.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.028+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc303d0 con 0x55fb2dc2dab0 2023-10-06T02:26:07.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.029+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [write 0~34] v105'96 uv96 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc2dab0 2023-10-06T02:26:07.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.029+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc307d0 con 0x55fb2dc2dab0 2023-10-06T02:26:07.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.030+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [omap-set-header] v105'97 uv97 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc2dab0 2023-10-06T02:26:07.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.030+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc307d0 con 0x55fb2dc2dab0 2023-10-06T02:26:07.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.032+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 100.00000000 [create] v105'98 uv93 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc2dab0 2023-10-06T02:26:07.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.032+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc307d0 con 0x55fb2dc2dab0 2023-10-06T02:26:07.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.033+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 100.00000000 [delete] v105'99 uv99 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc2dab0 2023-10-06T02:26:07.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.033+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc307d0 con 0x55fb2dc2dab0 2023-10-06T02:26:07.034 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:26:07.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.034+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v105'100 uv100 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc2dab0 2023-10-06T02:26:07.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.034+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc307d0 con 0x55fb2dc2dab0 2023-10-06T02:26:07.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.035+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [omap-set-header] v105'101 uv101 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc2dab0 2023-10-06T02:26:07.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.035+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33540 con 0x55fb2dc2dab0 2023-10-06T02:26:07.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.036+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v105'102 uv102 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc2dab0 2023-10-06T02:26:07.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.036+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:99 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc30cc0 con 0x55fb2dc22500 2023-10-06T02:26:07.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.037+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(99 mds0_sessionmap [create] v105'44 uv43 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.037+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:100 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc30cc0 con 0x55fb2dc22500 2023-10-06T02:26:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.040+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(100 mds0_sessionmap [delete] v105'45 uv45 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.040+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc2d1c0 con 0x55fb2dc22500 2023-10-06T02:26:07.041 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:26:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.041+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(101 mds0_sessionmap [create] v105'46 uv46 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.041+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc2d1c0 con 0x55fb2dc22500 2023-10-06T02:26:07.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.044+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v105'47 uv47 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.044+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55fb2dc311d0 0x55fb2dc335b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.044+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:103 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33af0 con 0x55fb2dc311d0 2023-10-06T02:26:07.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.044+0000 7fa45be81700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55fb2dc311d0 0x55fb2dc335b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.045+0000 7fa45be81700 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55fb2dc311d0 0x55fb2dc335b0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:07.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.046+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(103 609.00000000 [create] v105'57 uv56 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc311d0 2023-10-06T02:26:07.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.046+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:104 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33af0 con 0x55fb2dc311d0 2023-10-06T02:26:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.049+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(104 609.00000000 [delete] v105'58 uv58 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc311d0 2023-10-06T02:26:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.049+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33af0 con 0x55fb2dc311d0 2023-10-06T02:26:07.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.051+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(105 609.00000000 [create] v105'59 uv59 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc311d0 2023-10-06T02:26:07.052 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:26:07.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.051+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc34b00 con 0x55fb2dc311d0 2023-10-06T02:26:07.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.054+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v105'60 uv60 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc311d0 2023-10-06T02:26:07.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.054+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc34b00 con 0x55fb2dc311d0 2023-10-06T02:26:07.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.055+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v105'61 uv61 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc311d0 2023-10-06T02:26:07.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.055+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33af0 con 0x55fb2dc311d0 2023-10-06T02:26:07.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.058+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(108 609.00000000 [omap-set-header] v105'62 uv62 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc311d0 2023-10-06T02:26:07.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.058+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:109 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33af0 con 0x55fb2dc25ba0 2023-10-06T02:26:07.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.059+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(109 400.00000000 [create] v105'47 uv46 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc25ba0 2023-10-06T02:26:07.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.059+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:110 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33af0 con 0x55fb2dc25ba0 2023-10-06T02:26:07.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.060+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(110 400.00000000 [delete] v105'48 uv48 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc25ba0 2023-10-06T02:26:07.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.060+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33af0 con 0x55fb2dc25ba0 2023-10-06T02:26:07.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.063+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(111 400.00000000 [create] v105'49 uv49 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc25ba0 2023-10-06T02:26:07.063 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:26:07.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.063+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33ef0 con 0x55fb2dc25ba0 2023-10-06T02:26:07.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.068+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(112 400.00000000 [write 0~22] v105'50 uv50 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc25ba0 2023-10-06T02:26:07.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.068+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33b90 con 0x55fb2dc25ba0 2023-10-06T02:26:07.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.069+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(113 400.00000000 [omap-set-header] v105'51 uv51 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa44c022020 con 0x55fb2dc25ba0 2023-10-06T02:26:07.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.069+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:114 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33bb0 con 0x55fb2dc22500 2023-10-06T02:26:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.070+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(114 100.00000000.inode [create] v105'119 uv111 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.070+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:115 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33bb0 con 0x55fb2dc22500 2023-10-06T02:26:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.074+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(115 100.00000000.inode [delete] v105'120 uv120 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.074+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33bb0 con 0x55fb2dc22500 2023-10-06T02:26:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.075+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(116 100.00000000.inode [create] v105'121 uv121 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.076 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:26:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.075+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33bb0 con 0x55fb2dc22500 2023-10-06T02:26:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.080+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(117 100.00000000.inode [write 0~554] v105'122 uv122 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.080+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc34070 con 0x55fb2dc22500 2023-10-06T02:26:07.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.084+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v105'123 uv123 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.084+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc34070 con 0x55fb2dc22500 2023-10-06T02:26:07.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.085+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(119 1.00000000 [create] v105'124 uv118 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.085+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33b90 con 0x55fb2dc22500 2023-10-06T02:26:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.088+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(120 1.00000000 [delete] v105'125 uv125 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.088+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33b90 con 0x55fb2dc22500 2023-10-06T02:26:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.091+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(121 1.00000000 [create] v105'126 uv126 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.091 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:26:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.091+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33bd0 con 0x55fb2dc22500 2023-10-06T02:26:07.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.093+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v105'127 uv127 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.093+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc34be0 con 0x55fb2dc22500 2023-10-06T02:26:07.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.099+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v105'128 uv128 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.099+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33bd0 con 0x55fb2dc22500 2023-10-06T02:26:07.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.100+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(124 1.00000000 [omap-set-header] v105'129 uv129 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.100+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105) v8 -- 0x55fb2dc33fd0 con 0x55fb2dc22500 2023-10-06T02:26:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa45ae7f700 1 -- 172.21.15.6:0/4247962369 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v105'130 uv130 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa444009d80 con 0x55fb2dc22500 2023-10-06T02:26:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55fb2dc22500 msgr2=0x55fb2dc248e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55fb2dc22500 0x55fb2dc248e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55fb2dbe21d0 msgr2=0x55fb2dbe25a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55fb2dbe21d0 0x55fb2dbe25a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55fb2dc2dab0 msgr2=0x55fb2dc2fe90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55fb2dc2dab0 0x55fb2dc2fe90 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55fb2dc1dbc0 msgr2=0x55fb2dc1ffa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55fb2dc1dbc0 0x55fb2dc1ffa0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55fb2dc311d0 msgr2=0x55fb2dc335b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55fb2dc311d0 0x55fb2dc335b0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 reap_dead start 2023-10-06T02:26:07.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55fb2dc29670 msgr2=0x55fb2dc2cb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55fb2dc29670 0x55fb2dc2cb70 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55fb2dc25ba0 msgr2=0x55fb2dc27f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55fb2dc25ba0 0x55fb2dc27f80 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa45be81700 1 -- 172.21.15.6:0/4247962369 reap_dead start 2023-10-06T02:26:07.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa43c065890 msgr2=0x7fa43c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa43c065890 0x7fa43c067d40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa454001ed0 tx=0x7fa454000bc0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb2dbe8c80 msgr2=0x55fb2dc009d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb2dbe8c80 0x55fb2dc009d0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fa44c005e40 tx=0x7fa44c01c000 comp rx=0 tx=0).stop 2023-10-06T02:26:07.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 shutdown_connections 2023-10-06T02:26:07.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55fb2dc25ba0 0x55fb2dc27f80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb2dbe8c80 0x55fb2dc009d0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 --2- 172.21.15.6:0/4247962369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa43c065890 0x7fa43c067d40 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 >> 172.21.15.6:0/4247962369 conn(0x55fb2db6fbd0 msgr2=0x55fb2dbff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:07.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 shutdown_connections 2023-10-06T02:26:07.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.105+0000 7fa462445000 1 -- 172.21.15.6:0/4247962369 wait complete. 2023-10-06T02:26:07.110 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 100.00000000 2023-10-06T02:26:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.187+0000 7ffbdc62e000 1 Processor -- start 2023-10-06T02:26:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.187+0000 7ffbdc62e000 1 -- start start 2023-10-06T02:26:07.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.188+0000 7ffbdc62e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9d502410 0x555c9d596620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.188+0000 7ffbdc62e000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555c9d502810 0x555c9d4bc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.188+0000 7ffbdc62e000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c9d591f90 0x555c9d59e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.188+0000 7ffbdc62e000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9d406980 con 0x555c9d591f90 2023-10-06T02:26:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.188+0000 7ffbdc62e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9d406620 con 0x555c9d502410 2023-10-06T02:26:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.188+0000 7ffbdc62e000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c9d3fd400 con 0x555c9d502810 2023-10-06T02:26:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.188+0000 7ffbd606a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c9d591f90 0x555c9d59e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.188+0000 7ffbd606a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c9d591f90 0x555c9d59e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38462/0 (socket says 172.21.15.6:38462) 2023-10-06T02:26:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.188+0000 7ffbd606a700 1 -- 172.21.15.6:0/1422888452 learned_addr learned my addr 172.21.15.6:0/1422888452 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.188+0000 7ffbd606a700 1 -- 172.21.15.6:0/1422888452 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555c9d502810 msgr2=0x555c9d4bc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.188+0000 7ffbd606a700 1 --2- 172.21.15.6:0/1422888452 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555c9d502810 0x555c9d4bc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.188+0000 7ffbd606a700 1 -- 172.21.15.6:0/1422888452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9d502410 msgr2=0x555c9d596620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:07.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.188+0000 7ffbd606a700 1 --2- 172.21.15.6:0/1422888452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9d502410 0x555c9d596620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.188+0000 7ffbd606a700 1 -- 172.21.15.6:0/1422888452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc800a0e0 con 0x555c9d591f90 2023-10-06T02:26:07.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.189+0000 7ffbd606a700 1 --2- 172.21.15.6:0/1422888452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c9d591f90 0x555c9d59e900 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800acf0 tx=0x7ffbc8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301bd161242fddaf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:07.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.189+0000 7ffbcffff700 1 -- 172.21.15.6:0/1422888452 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800fe00 con 0x555c9d591f90 2023-10-06T02:26:07.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.189+0000 7ffbcffff700 1 -- 172.21.15.6:0/1422888452 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc801f070 con 0x555c9d591f90 2023-10-06T02:26:07.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.189+0000 7ffbcffff700 1 -- 172.21.15.6:0/1422888452 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800f860 con 0x555c9d591f90 2023-10-06T02:26:07.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.189+0000 7ffbdc62e000 1 -- 172.21.15.6:0/1422888452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c9d591f90 msgr2=0x555c9d59e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.189+0000 7ffbdc62e000 1 --2- 172.21.15.6:0/1422888452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c9d591f90 0x555c9d59e900 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800acf0 tx=0x7ffbc8015000 comp rx=0 tx=0).stop 2023-10-06T02:26:07.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.189+0000 7ffbdc62e000 1 -- 172.21.15.6:0/1422888452 shutdown_connections 2023-10-06T02:26:07.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.189+0000 7ffbdc62e000 1 --2- 172.21.15.6:0/1422888452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c9d591f90 0x555c9d59e900 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.189+0000 7ffbdc62e000 1 --2- 172.21.15.6:0/1422888452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9d502410 0x555c9d596620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.189+0000 7ffbdc62e000 1 --2- 172.21.15.6:0/1422888452 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555c9d502810 0x555c9d4bc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.189+0000 7ffbdc62e000 1 -- 172.21.15.6:0/1422888452 >> 172.21.15.6:0/1422888452 conn(0x555c9d4bbd50 msgr2=0x555c9d4be130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:07.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.189+0000 7ffbdc62e000 1 -- 172.21.15.6:0/1422888452 shutdown_connections 2023-10-06T02:26:07.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.189+0000 7ffbdc62e000 1 -- 172.21.15.6:0/1422888452 wait complete. 2023-10-06T02:26:07.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.190+0000 7ffbdc62e000 1 Processor -- start 2023-10-06T02:26:07.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.190+0000 7ffbdc62e000 1 -- start start 2023-10-06T02:26:07.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.190+0000 7ffbdc62e000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555c9d502410 0x555c9d598f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.190+0000 7ffbdc62e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9d502810 0x555c9d4bc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.190+0000 7ffbdc62e000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c9d591f90 0x555c9d5975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.190+0000 7ffbdc62e000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9d598050 con 0x555c9d591f90 2023-10-06T02:26:07.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.190+0000 7ffbdc62e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9d5982f0 con 0x555c9d502810 2023-10-06T02:26:07.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.190+0000 7ffbdc62e000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c9d598590 con 0x555c9d502410 2023-10-06T02:26:07.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.191+0000 7ffbd606a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c9d591f90 0x555c9d5975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.191+0000 7ffbd606a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c9d591f90 0x555c9d5975f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38474/0 (socket says 172.21.15.6:38474) 2023-10-06T02:26:07.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.191+0000 7ffbd606a700 1 -- 172.21.15.6:0/3575557811 learned_addr learned my addr 172.21.15.6:0/3575557811 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:07.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.191+0000 7ffbd5068700 1 --2- 172.21.15.6:0/3575557811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9d502810 0x555c9d4bc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.191+0000 7ffbd5869700 1 --2- 172.21.15.6:0/3575557811 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555c9d502410 0x555c9d598f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.191+0000 7ffbd606a700 1 -- 172.21.15.6:0/3575557811 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555c9d502410 msgr2=0x555c9d598f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.191+0000 7ffbd606a700 1 --2- 172.21.15.6:0/3575557811 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555c9d502410 0x555c9d598f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.191+0000 7ffbd606a700 1 -- 172.21.15.6:0/3575557811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9d502810 msgr2=0x555c9d4bc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.191+0000 7ffbd606a700 1 --2- 172.21.15.6:0/3575557811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9d502810 0x555c9d4bc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.191+0000 7ffbd606a700 1 -- 172.21.15.6:0/3575557811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c9d42f1c0 con 0x555c9d591f90 2023-10-06T02:26:07.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.191+0000 7ffbd606a700 1 --2- 172.21.15.6:0/3575557811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c9d591f90 0x555c9d5975f0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800a520 tx=0x7ffbc801d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:07.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.191+0000 7ffbce7fc700 1 -- 172.21.15.6:0/3575557811 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8024710 con 0x555c9d591f90 2023-10-06T02:26:07.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.191+0000 7ffbce7fc700 1 -- 172.21.15.6:0/3575557811 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc8024890 con 0x555c9d591f90 2023-10-06T02:26:07.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.191+0000 7ffbce7fc700 1 -- 172.21.15.6:0/3575557811 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8024c90 con 0x555c9d591f90 2023-10-06T02:26:07.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.191+0000 7ffbdc62e000 1 -- 172.21.15.6:0/3575557811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555c9d4153d0 con 0x555c9d591f90 2023-10-06T02:26:07.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.191+0000 7ffbdc62e000 1 -- 172.21.15.6:0/3575557811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c9d408ae0 con 0x555c9d591f90 2023-10-06T02:26:07.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.193+0000 7ffbce7fc700 1 -- 172.21.15.6:0/3575557811 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffbc8021030 con 0x555c9d591f90 2023-10-06T02:26:07.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.193+0000 7ffbce7fc700 1 --2- 172.21.15.6:0/3575557811 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffbb8065890 0x7ffbb8067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.193+0000 7ffbce7fc700 1 -- 172.21.15.6:0/3575557811 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7238+0+0 (secure 0 0 0) 0x7ffbc8086000 con 0x555c9d591f90 2023-10-06T02:26:07.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.193+0000 7ffbdc62e000 1 --2- 172.21.15.6:0/3575557811 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x555c9d4bcd20 0x555c9d4dcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.193+0000 7ffbdc62e000 1 -- 172.21.15.6:0/3575557811 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:1 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105) v8 -- 0x555c9d597b30 con 0x555c9d4bcd20 2023-10-06T02:26:07.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.193+0000 7ffbd5869700 1 --2- 172.21.15.6:0/3575557811 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffbb8065890 0x7ffbb8067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.193+0000 7ffbd5068700 1 --2- 172.21.15.6:0/3575557811 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x555c9d4bcd20 0x555c9d4dcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.194+0000 7ffbd5068700 1 --2- 172.21.15.6:0/3575557811 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x555c9d4bcd20 0x555c9d4dcfd0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:07.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.194+0000 7ffbd5869700 1 --2- 172.21.15.6:0/3575557811 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffbb8065890 0x7ffbb8067d40 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0006fd0 tx=0x7ffbd0006860 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:07.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.195+0000 7ffbd5068700 1 -- 172.21.15.6:0/3575557811 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(1 100.00000000 [delete] v105'103 uv103 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ffbc0011040 con 0x555c9d4bcd20 2023-10-06T02:26:07.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.195+0000 7ffbdc62e000 1 -- 172.21.15.6:0/3575557811 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x555c9d4bcd20 msgr2=0x555c9d4dcfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.195+0000 7ffbdc62e000 1 --2- 172.21.15.6:0/3575557811 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x555c9d4bcd20 0x555c9d4dcfd0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.195+0000 7ffbdc62e000 1 -- 172.21.15.6:0/3575557811 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffbb8065890 msgr2=0x7ffbb8067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.195+0000 7ffbdc62e000 1 --2- 172.21.15.6:0/3575557811 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffbb8065890 0x7ffbb8067d40 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0006fd0 tx=0x7ffbd0006860 comp rx=0 tx=0).stop 2023-10-06T02:26:07.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.195+0000 7ffbdc62e000 1 -- 172.21.15.6:0/3575557811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c9d591f90 msgr2=0x555c9d5975f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.195+0000 7ffbdc62e000 1 --2- 172.21.15.6:0/3575557811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c9d591f90 0x555c9d5975f0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800a520 tx=0x7ffbc801d070 comp rx=0 tx=0).stop 2023-10-06T02:26:07.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.195+0000 7ffbd606a700 1 -- 172.21.15.6:0/3575557811 reap_dead start 2023-10-06T02:26:07.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.195+0000 7ffbdc62e000 1 -- 172.21.15.6:0/3575557811 shutdown_connections 2023-10-06T02:26:07.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.195+0000 7ffbdc62e000 1 -- 172.21.15.6:0/3575557811 >> 172.21.15.6:0/3575557811 conn(0x555c9d4bbd50 msgr2=0x555c9d4be080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:07.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.195+0000 7ffbdc62e000 1 -- 172.21.15.6:0/3575557811 shutdown_connections 2023-10-06T02:26:07.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.195+0000 7ffbdc62e000 1 -- 172.21.15.6:0/3575557811 wait complete. 2023-10-06T02:26:07.203 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:26:07.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.363+0000 7f8df1833700 1 Processor -- start 2023-10-06T02:26:07.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.363+0000 7f8df1833700 1 -- start start 2023-10-06T02:26:07.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.364+0000 7f8df1833700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8dec06a750 0x7f8dec15d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.364+0000 7f8df1833700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dec0cae80 con 0x7f8dec15d770 2023-10-06T02:26:07.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.364+0000 7f8df1833700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dec15dcd0 con 0x7f8dec06a380 2023-10-06T02:26:07.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.364+0000 7f8df1833700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dec0cba20 con 0x7f8dec06a750 2023-10-06T02:26:07.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.364+0000 7f8deb7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8dec15d770 0x7f8dec159170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57854/0 (socket says 172.21.15.6:57854) 2023-10-06T02:26:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.364+0000 7f8deb7fe700 1 -- 172.21.15.6:0/157179723 learned_addr learned my addr 172.21.15.6:0/157179723 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.364+0000 7f8dea7fc700 1 --2- 172.21.15.6:0/157179723 >> v2:172.21.15.175:3300/0 conn(0x7f8dec06a750 0x7f8dec15d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.364+0000 7f8de9ffb700 1 -- 172.21.15.6:0/157179723 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050602748 0 0) 0x7f8dec0cae80 con 0x7f8dec15d770 2023-10-06T02:26:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.364+0000 7f8de9ffb700 1 -- 172.21.15.6:0/157179723 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dd4003570 con 0x7f8dec15d770 2023-10-06T02:26:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.364+0000 7f8de9ffb700 1 -- 172.21.15.6:0/157179723 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738291602 0 0) 0x7f8dec15dcd0 con 0x7f8dec06a380 2023-10-06T02:26:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.364+0000 7f8de9ffb700 1 -- 172.21.15.6:0/157179723 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dec0cae80 con 0x7f8dec06a380 2023-10-06T02:26:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.364+0000 7f8dea7fc700 1 -- 172.21.15.6:0/157179723 >> v1:172.21.15.175:6789/0 conn(0x7f8dec06a380 legacy=0x7f8dec0cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.364+0000 7f8dea7fc700 1 -- 172.21.15.6:0/157179723 >> v1:172.21.15.6:6789/0 conn(0x7f8dec15d770 legacy=0x7f8dec159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.364+0000 7f8dea7fc700 1 -- 172.21.15.6:0/157179723 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dec15dfb0 con 0x7f8dec06a750 2023-10-06T02:26:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.364+0000 7f8dea7fc700 1 --2- 172.21.15.6:0/157179723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8dec06a750 0x7f8dec15d230 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8de00098e0 tx=0x7f8de00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2af5fa544a5c8c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.365+0000 7f8de9ffb700 1 -- 172.21.15.6:0/157179723 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0011630 con 0x7f8dec06a750 2023-10-06T02:26:07.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.365+0000 7f8de9ffb700 1 -- 172.21.15.6:0/157179723 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de0011790 con 0x7f8dec06a750 2023-10-06T02:26:07.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.365+0000 7f8de9ffb700 1 -- 172.21.15.6:0/157179723 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0011b30 con 0x7f8dec06a750 2023-10-06T02:26:07.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.365+0000 7f8df1833700 1 -- 172.21.15.6:0/157179723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8dec06a750 msgr2=0x7f8dec15d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.365+0000 7f8df1833700 1 --2- 172.21.15.6:0/157179723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8dec06a750 0x7f8dec15d230 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8de00098e0 tx=0x7f8de00091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.365+0000 7f8df1833700 1 -- 172.21.15.6:0/157179723 shutdown_connections 2023-10-06T02:26:07.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.365+0000 7f8df1833700 1 --2- 172.21.15.6:0/157179723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8dec06a750 0x7f8dec15d230 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.365+0000 7f8df1833700 1 -- 172.21.15.6:0/157179723 >> 172.21.15.6:0/157179723 conn(0x7f8dec0d0350 msgr2=0x7f8dec0d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:07.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.365+0000 7f8df1833700 1 -- 172.21.15.6:0/157179723 shutdown_connections 2023-10-06T02:26:07.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.365+0000 7f8df1833700 1 -- 172.21.15.6:0/157179723 wait complete. 2023-10-06T02:26:07.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.366+0000 7f8df1833700 1 Processor -- start 2023-10-06T02:26:07.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.367+0000 7f8df1833700 1 -- start start 2023-10-06T02:26:07.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.367+0000 7f8df1833700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8dec06a380 0x7f8dec1549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.367+0000 7f8df1833700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dec06a750 0x7f8dec0c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.367+0000 7f8df1833700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8dec15d770 0x7f8dec0b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.367+0000 7f8df1833700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec15a580 con 0x7f8dec06a750 2023-10-06T02:26:07.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.367+0000 7f8df1833700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec0c8320 con 0x7f8dec06a380 2023-10-06T02:26:07.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.367+0000 7f8df1833700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec0c8600 con 0x7f8dec15d770 2023-10-06T02:26:07.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.367+0000 7f8dea7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dec06a750 0x7f8dec0c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.367+0000 7f8dea7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dec06a750 0x7f8dec0c78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38488/0 (socket says 172.21.15.6:38488) 2023-10-06T02:26:07.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.367+0000 7f8dea7fc700 1 -- 172.21.15.6:0/1564936691 learned_addr learned my addr 172.21.15.6:0/1564936691 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.368+0000 7f8deb7fe700 1 --2- 172.21.15.6:0/1564936691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8dec15d770 0x7f8dec0b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.368+0000 7f8deaffd700 1 --2- 172.21.15.6:0/1564936691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8dec06a380 0x7f8dec1549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.368+0000 7f8dea7fc700 1 -- 172.21.15.6:0/1564936691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8dec15d770 msgr2=0x7f8dec0b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.368+0000 7f8dea7fc700 1 --2- 172.21.15.6:0/1564936691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8dec15d770 0x7f8dec0b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.368+0000 7f8dea7fc700 1 -- 172.21.15.6:0/1564936691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8dec06a380 msgr2=0x7f8dec1549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.368+0000 7f8dea7fc700 1 --2- 172.21.15.6:0/1564936691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8dec06a380 0x7f8dec1549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.368+0000 7f8dea7fc700 1 -- 172.21.15.6:0/1564936691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de0009420 con 0x7f8dec06a750 2023-10-06T02:26:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.368+0000 7f8dea7fc700 1 --2- 172.21.15.6:0/1564936691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dec06a750 0x7f8dec0c78d0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f8dec0883f0 tx=0x7f8de0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.368+0000 7f8dd2ffd700 1 -- 172.21.15.6:0/1564936691 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de001f070 con 0x7f8dec06a750 2023-10-06T02:26:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.368+0000 7f8dd2ffd700 1 -- 172.21.15.6:0/1564936691 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de0000bc0 con 0x7f8dec06a750 2023-10-06T02:26:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.368+0000 7f8dd2ffd700 1 -- 172.21.15.6:0/1564936691 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0025420 con 0x7f8dec06a750 2023-10-06T02:26:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.368+0000 7f8df1833700 1 -- 172.21.15.6:0/1564936691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dec0c88e0 con 0x7f8dec06a750 2023-10-06T02:26:07.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.368+0000 7f8df1833700 1 -- 172.21.15.6:0/1564936691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dec0b5ba0 con 0x7f8dec06a750 2023-10-06T02:26:07.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.369+0000 7f8df1833700 1 -- 172.21.15.6:0/1564936691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dec15a6f0 con 0x7f8dec06a750 2023-10-06T02:26:07.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.369+0000 7f8dd2ffd700 1 -- 172.21.15.6:0/1564936691 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8de0023070 con 0x7f8dec06a750 2023-10-06T02:26:07.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.370+0000 7f8dd2ffd700 1 --2- 172.21.15.6:0/1564936691 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8dd8066f30 0x7f8dd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.370+0000 7f8dd2ffd700 1 -- 172.21.15.6:0/1564936691 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f8de0085db0 con 0x7f8dec06a750 2023-10-06T02:26:07.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.370+0000 7f8deaffd700 1 --2- 172.21.15.6:0/1564936691 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8dd8066f30 0x7f8dd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.371+0000 7f8deaffd700 1 --2- 172.21.15.6:0/1564936691 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8dd8066f30 0x7f8dd80693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc007fd0 tx=0x7f8ddc007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:07.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.374+0000 7f8dd2ffd700 1 -- 172.21.15.6:0/1564936691 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8de0052a20 con 0x7f8dec06a750 2023-10-06T02:26:07.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.615+0000 7f8df1833700 1 -- 172.21.15.6:0/1564936691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f8dec0c9490 con 0x7f8dec06a750 2023-10-06T02:26:07.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.864+0000 7f8dd2ffd700 1 -- 172.21.15.6:0/1564936691 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v151) v1 ==== 162+0+0 (secure 0 0 0) 0x7f8de002a0b0 con 0x7f8dec06a750 2023-10-06T02:26:07.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.867+0000 7f8df1833700 1 -- 172.21.15.6:0/1564936691 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8dd8066f30 msgr2=0x7f8dd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.867+0000 7f8df1833700 1 --2- 172.21.15.6:0/1564936691 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8dd8066f30 0x7f8dd80693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc007fd0 tx=0x7f8ddc007d50 comp rx=0 tx=0).stop 2023-10-06T02:26:07.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.867+0000 7f8df1833700 1 -- 172.21.15.6:0/1564936691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dec06a750 msgr2=0x7f8dec0c78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.867+0000 7f8df1833700 1 --2- 172.21.15.6:0/1564936691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dec06a750 0x7f8dec0c78d0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f8dec0883f0 tx=0x7f8de0017000 comp rx=0 tx=0).stop 2023-10-06T02:26:07.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.867+0000 7f8df1833700 1 -- 172.21.15.6:0/1564936691 shutdown_connections 2023-10-06T02:26:07.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.867+0000 7f8df1833700 1 --2- 172.21.15.6:0/1564936691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8dec15d770 0x7f8dec0b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.867+0000 7f8df1833700 1 --2- 172.21.15.6:0/1564936691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8dec06a380 0x7f8dec1549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.867+0000 7f8df1833700 1 --2- 172.21.15.6:0/1564936691 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8dd8066f30 0x7f8dd80693e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.867+0000 7f8df1833700 1 --2- 172.21.15.6:0/1564936691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dec06a750 0x7f8dec0c78d0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.867+0000 7f8df1833700 1 -- 172.21.15.6:0/1564936691 >> 172.21.15.6:0/1564936691 conn(0x7f8dec0d0350 msgr2=0x7f8dec157e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:07.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.868+0000 7f8df1833700 1 -- 172.21.15.6:0/1564936691 shutdown_connections 2023-10-06T02:26:07.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:07.868+0000 7f8df1833700 1 -- 172.21.15.6:0/1564936691 wait complete. 2023-10-06T02:26:07.869 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:26:07.883 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:08.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.002+0000 7f8c90d19700 1 Processor -- start 2023-10-06T02:26:08.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.003+0000 7f8c90d19700 1 -- start start 2023-10-06T02:26:08.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.003+0000 7f8c90d19700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c8c0b27f0 0x7f8c8c15db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.003+0000 7f8c90d19700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c8c15e190 con 0x7f8c8c0af8b0 2023-10-06T02:26:08.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.003+0000 7f8c90d19700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c8c0cb650 con 0x7f8c8c0af4e0 2023-10-06T02:26:08.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.003+0000 7f8c90d19700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c8c0b1910 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.004+0000 7f8c8ad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c8c0b27f0 0x7f8c8c15db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.004+0000 7f8c89d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8c8c0af8b0 0x7f8c8c15d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57868/0 (socket says 172.21.15.6:57868) 2023-10-06T02:26:08.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.004+0000 7f8c89d9b700 1 -- 172.21.15.6:0/3565029328 learned_addr learned my addr 172.21.15.6:0/3565029328 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:08.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.004+0000 7f8c8ad9d700 1 -- 172.21.15.6:0/3565029328 >> v1:172.21.15.175:6789/0 conn(0x7f8c8c0af4e0 legacy=0x7f8c8c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:08.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.004+0000 7f8c8ad9d700 1 -- 172.21.15.6:0/3565029328 >> v1:172.21.15.6:6789/0 conn(0x7f8c8c0af8b0 legacy=0x7f8c8c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.004+0000 7f8c8ad9d700 1 -- 172.21.15.6:0/3565029328 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c0ccaf0 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.004+0000 7f8c8959a700 1 -- 172.21.15.6:0/3565029328 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166988377 0 0) 0x7f8c8c15e190 con 0x7f8c8c0af8b0 2023-10-06T02:26:08.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.004+0000 7f8c8ad9d700 1 --2- 172.21.15.6:0/3565029328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0b27f0 0x7f8c8c15db70 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f8c840098e0 tx=0x7f8c840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6d5aa0230027ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:08.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.004+0000 7f8c8959a700 1 -- 172.21.15.6:0/3565029328 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c84009e80 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.004+0000 7f8c8959a700 1 -- 172.21.15.6:0/3565029328 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8400b860 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.004+0000 7f8c8959a700 1 -- 172.21.15.6:0/3565029328 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400bbe0 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.005+0000 7f8c90d19700 1 -- 172.21.15.6:0/3565029328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0b27f0 msgr2=0x7f8c8c15db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.005+0000 7f8c90d19700 1 --2- 172.21.15.6:0/3565029328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0b27f0 0x7f8c8c15db70 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f8c840098e0 tx=0x7f8c840091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.005+0000 7f8c90d19700 1 -- 172.21.15.6:0/3565029328 shutdown_connections 2023-10-06T02:26:08.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.005+0000 7f8c90d19700 1 --2- 172.21.15.6:0/3565029328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0b27f0 0x7f8c8c15db70 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.005+0000 7f8c90d19700 1 -- 172.21.15.6:0/3565029328 >> 172.21.15.6:0/3565029328 conn(0x7f8c8c068680 msgr2=0x7f8c8c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:08.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.005+0000 7f8c90d19700 1 -- 172.21.15.6:0/3565029328 shutdown_connections 2023-10-06T02:26:08.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.005+0000 7f8c90d19700 1 -- 172.21.15.6:0/3565029328 wait complete. 2023-10-06T02:26:08.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.006+0000 7f8c90d19700 1 Processor -- start 2023-10-06T02:26:08.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.006+0000 7f8c90d19700 1 -- start start 2023-10-06T02:26:08.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.007+0000 7f8c90d19700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8c0af4e0 0x7f8c8c0d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.007+0000 7f8c90d19700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c8c0af8b0 0x7f8c8c1696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.007+0000 7f8c90d19700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0b27f0 0x7f8c8c16d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.007+0000 7f8c90d19700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c16e270 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.007+0000 7f8c90d19700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c0cf230 con 0x7f8c8c0af4e0 2023-10-06T02:26:08.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.007+0000 7f8c90d19700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c0cf510 con 0x7f8c8c0af8b0 2023-10-06T02:26:08.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.007+0000 7f8c8ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0b27f0 0x7f8c8c16d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.007+0000 7f8c8ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0b27f0 0x7f8c8c16d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38508/0 (socket says 172.21.15.6:38508) 2023-10-06T02:26:08.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.007+0000 7f8c8ad9d700 1 -- 172.21.15.6:0/4141417147 learned_addr learned my addr 172.21.15.6:0/4141417147 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:08.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.007+0000 7f8c8ad9d700 1 -- 172.21.15.6:0/4141417147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c8c0af8b0 msgr2=0x7f8c8c1696b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.007+0000 7f8c8ad9d700 1 --2- 172.21.15.6:0/4141417147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c8c0af8b0 0x7f8c8c1696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.007+0000 7f8c8ad9d700 1 -- 172.21.15.6:0/4141417147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8c0af4e0 msgr2=0x7f8c8c0d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.007+0000 7f8c8a59c700 1 --2- 172.21.15.6:0/4141417147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8c0af4e0 0x7f8c8c0d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.007+0000 7f8c8ad9d700 1 --2- 172.21.15.6:0/4141417147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8c0af4e0 0x7f8c8c0d02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.007+0000 7f8c8ad9d700 1 -- 172.21.15.6:0/4141417147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c84009420 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.007+0000 7f8c8a59c700 1 --2- 172.21.15.6:0/4141417147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8c0af4e0 0x7f8c8c0d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:08.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.007+0000 7f8c8ad9d700 1 --2- 172.21.15.6:0/4141417147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0b27f0 0x7f8c8c16d4d0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c089520 tx=0x7f8c84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.008+0000 7f8c827fc700 1 -- 172.21.15.6:0/4141417147 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8401f070 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.008+0000 7f8c827fc700 1 -- 172.21.15.6:0/4141417147 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c84011420 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.008+0000 7f8c90d19700 1 -- 172.21.15.6:0/4141417147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8c0cf7f0 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.008+0000 7f8c827fc700 1 -- 172.21.15.6:0/4141417147 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c840117e0 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.008+0000 7f8c90d19700 1 -- 172.21.15.6:0/4141417147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8c0cfdb0 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.009+0000 7f8c90d19700 1 -- 172.21.15.6:0/4141417147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c8c088aa0 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.009+0000 7f8c827fc700 1 -- 172.21.15.6:0/4141417147 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c84011b50 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.009+0000 7f8c827fc700 1 --2- 172.21.15.6:0/4141417147 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c6c066f30 0x7f8c6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.010+0000 7f8c827fc700 1 -- 172.21.15.6:0/4141417147 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f8c84086210 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.010+0000 7f8c8a59c700 1 --2- 172.21.15.6:0/4141417147 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c6c066f30 0x7f8c6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.010+0000 7f8c8a59c700 1 --2- 172.21.15.6:0/4141417147 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c6c066f30 0x7f8c6c0693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c007fd0 tx=0x7f8c7c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:08.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.014+0000 7f8c827fc700 1 -- 172.21.15.6:0/4141417147 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c84052e80 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.249+0000 7f8c90d19700 1 -- 172.21.15.6:0/4141417147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c8c0cad20 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.250+0000 7f8c827fc700 1 -- 172.21.15.6:0/4141417147 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f8c840564a0 con 0x7f8c8c0b27f0 2023-10-06T02:26:08.250 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:08.251 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":152,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:07.865613+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":152,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/4105967039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":4105967039},{"type":"v1","addr":"172.21.15.6:6835","nonce":4105967039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:08.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.252+0000 7f8c90d19700 1 -- 172.21.15.6:0/4141417147 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c6c066f30 msgr2=0x7f8c6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.252+0000 7f8c90d19700 1 --2- 172.21.15.6:0/4141417147 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c6c066f30 0x7f8c6c0693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c007fd0 tx=0x7f8c7c009040 comp rx=0 tx=0).stop 2023-10-06T02:26:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.252+0000 7f8c90d19700 1 -- 172.21.15.6:0/4141417147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0b27f0 msgr2=0x7f8c8c16d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.252+0000 7f8c90d19700 1 --2- 172.21.15.6:0/4141417147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0b27f0 0x7f8c8c16d4d0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c089520 tx=0x7f8c84017000 comp rx=0 tx=0).stop 2023-10-06T02:26:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.252+0000 7f8c90d19700 1 -- 172.21.15.6:0/4141417147 shutdown_connections 2023-10-06T02:26:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.252+0000 7f8c90d19700 1 --2- 172.21.15.6:0/4141417147 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8c6c066f30 0x7f8c6c0693e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.252+0000 7f8c90d19700 1 --2- 172.21.15.6:0/4141417147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0b27f0 0x7f8c8c16d4d0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.252+0000 7f8c90d19700 1 --2- 172.21.15.6:0/4141417147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8c0af4e0 0x7f8c8c0d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.252+0000 7f8c90d19700 1 --2- 172.21.15.6:0/4141417147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c8c0af8b0 0x7f8c8c1696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.252+0000 7f8c90d19700 1 -- 172.21.15.6:0/4141417147 >> 172.21.15.6:0/4141417147 conn(0x7f8c8c068680 msgr2=0x7f8c8c15c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.252+0000 7f8c90d19700 1 -- 172.21.15.6:0/4141417147 shutdown_connections 2023-10-06T02:26:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:08.252+0000 7f8c90d19700 1 -- 172.21.15.6:0/4141417147 wait complete. 2023-10-06T02:26:08.254 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 152 2023-10-06T02:26:08.264 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2023-10-06T02:26:10.884 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:26:10.884+0000 7f50d2463700 -1 log_channel(cluster) log [ERR] : dir 0x100 object missing on disk; some files may be lost (~mds0) 2023-10-06T02:26:10.886 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:26:10.886+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:26:10.886 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:26:10.886+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:26:10.901 INFO:tasks.ceph.mds.a.smithi006.stderr: -19> 2023-10-06T02:26:10.884+0000 7f50d2463700 -1 log_channel(cluster) log [ERR] : dir 0x100 object missing on disk; some files may be lost (~mds0) 2023-10-06T02:26:10.924 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:26:13.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:13.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.397+0000 7f84e9dec700 1 Processor -- start 2023-10-06T02:26:13.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.397+0000 7f84e9dec700 1 -- start start 2023-10-06T02:26:13.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.398+0000 7f84e9dec700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e40cf1a0 0x7f84e40cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:13.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.398+0000 7f84e9dec700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f84e41597d0 0x7f84e40d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:13.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.398+0000 7f84e9dec700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e40b3560 con 0x7f84e4159400 2023-10-06T02:26:13.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.398+0000 7f84e9dec700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e40cf6f0 con 0x7f84e41597d0 2023-10-06T02:26:13.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.398+0000 7f84e9dec700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40cf9d0 con 0x7f84e40cf1a0 2023-10-06T02:26:13.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.398+0000 7f84e95eb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f84e41597d0 0x7f84e40d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.398+0000 7f84e95eb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f84e41597d0 0x7f84e40d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59922/0 (socket says 172.21.15.6:59922) 2023-10-06T02:26:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.398+0000 7f84e95eb700 1 -- 172.21.15.6:0/1666415798 learned_addr learned my addr 172.21.15.6:0/1666415798 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.398+0000 7f84e3fff700 1 --2- 172.21.15.6:0/1666415798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e40cf1a0 0x7f84e40cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.398+0000 7f84e95eb700 1 -- 172.21.15.6:0/1666415798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e40cf1a0 msgr2=0x7f84e40cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.398+0000 7f84e95eb700 1 --2- 172.21.15.6:0/1666415798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e40cf1a0 0x7f84e40cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.399+0000 7f84e95eb700 1 -- 172.21.15.6:0/1666415798 >> v1:172.21.15.175:6789/0 conn(0x7f84e4159400 legacy=0x7f84e40ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.399+0000 7f84e95eb700 1 -- 172.21.15.6:0/1666415798 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e40b2f10 con 0x7f84e41597d0 2023-10-06T02:26:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.399+0000 7f84e95eb700 1 --2- 172.21.15.6:0/1666415798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e41597d0 0x7f84e40d0400 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009f20 tx=0x7f84dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5ba49583b776ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.399+0000 7f84e37fe700 1 -- 172.21.15.6:0/1666415798 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc00e070 con 0x7f84e41597d0 2023-10-06T02:26:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.399+0000 7f84e37fe700 1 -- 172.21.15.6:0/1666415798 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84dc00ba80 con 0x7f84e41597d0 2023-10-06T02:26:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.399+0000 7f84e37fe700 1 -- 172.21.15.6:0/1666415798 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0092e0 con 0x7f84e41597d0 2023-10-06T02:26:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.399+0000 7f84e9dec700 1 -- 172.21.15.6:0/1666415798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e41597d0 msgr2=0x7f84e40d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.399+0000 7f84e9dec700 1 --2- 172.21.15.6:0/1666415798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e41597d0 0x7f84e40d0400 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009f20 tx=0x7f84dc009840 comp rx=0 tx=0).stop 2023-10-06T02:26:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.399+0000 7f84e9dec700 1 -- 172.21.15.6:0/1666415798 shutdown_connections 2023-10-06T02:26:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.399+0000 7f84e9dec700 1 --2- 172.21.15.6:0/1666415798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e41597d0 0x7f84e40d0400 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.399+0000 7f84e9dec700 1 --2- 172.21.15.6:0/1666415798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e40cf1a0 0x7f84e40cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.399+0000 7f84e9dec700 1 -- 172.21.15.6:0/1666415798 >> 172.21.15.6:0/1666415798 conn(0x7f84e406ac10 msgr2=0x7f84e4068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.400+0000 7f84e9dec700 1 -- 172.21.15.6:0/1666415798 shutdown_connections 2023-10-06T02:26:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.400+0000 7f84e9dec700 1 -- 172.21.15.6:0/1666415798 wait complete. 2023-10-06T02:26:13.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.401+0000 7f84e9dec700 1 Processor -- start 2023-10-06T02:26:13.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.401+0000 7f84e9dec700 1 -- start start 2023-10-06T02:26:13.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.401+0000 7f84e9dec700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e40cf1a0 0x7f84e416b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:13.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e9dec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e4159400 0x7f84e40c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:13.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e9dec700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e41597d0 0x7f84e416a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:13.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e9dec700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40c9260 con 0x7f84e4159400 2023-10-06T02:26:13.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e9dec700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40ca660 con 0x7f84e41597d0 2023-10-06T02:26:13.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e9dec700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40cac00 con 0x7f84e40cf1a0 2023-10-06T02:26:13.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e4159400 0x7f84e40c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:13.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e4159400 0x7f84e40c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59932/0 (socket says 172.21.15.6:59932) 2023-10-06T02:26:13.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e3fff700 1 -- 172.21.15.6:0/4045541371 learned_addr learned my addr 172.21.15.6:0/4045541371 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:13.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e95eb700 1 --2- 172.21.15.6:0/4045541371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e41597d0 0x7f84e416a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:13.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e8dea700 1 --2- 172.21.15.6:0/4045541371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e40cf1a0 0x7f84e416b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:13.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e3fff700 1 -- 172.21.15.6:0/4045541371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e40cf1a0 msgr2=0x7f84e416b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:13.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e3fff700 1 --2- 172.21.15.6:0/4045541371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e40cf1a0 0x7f84e416b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:13.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e3fff700 1 -- 172.21.15.6:0/4045541371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e41597d0 msgr2=0x7f84e416a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:13.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e3fff700 1 --2- 172.21.15.6:0/4045541371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e41597d0 0x7f84e416a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:13.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e3fff700 1 -- 172.21.15.6:0/4045541371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84dc009ae0 con 0x7f84e4159400 2023-10-06T02:26:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e3fff700 1 --2- 172.21.15.6:0/4045541371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e4159400 0x7f84e40c8d20 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f84d800d890 tx=0x7f84d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e0ff9700 1 -- 172.21.15.6:0/4045541371 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d80125f0 con 0x7f84e4159400 2023-10-06T02:26:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.402+0000 7f84e0ff9700 1 -- 172.21.15.6:0/4045541371 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d8012750 con 0x7f84e4159400 2023-10-06T02:26:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.403+0000 7f84e9dec700 1 -- 172.21.15.6:0/4045541371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e416b170 con 0x7f84e4159400 2023-10-06T02:26:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.403+0000 7f84e0ff9700 1 -- 172.21.15.6:0/4045541371 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8012af0 con 0x7f84e4159400 2023-10-06T02:26:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.403+0000 7f84e9dec700 1 -- 172.21.15.6:0/4045541371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e416ac60 con 0x7f84e4159400 2023-10-06T02:26:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.403+0000 7f84e9dec700 1 -- 172.21.15.6:0/4045541371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e4158ae0 con 0x7f84e4159400 2023-10-06T02:26:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.404+0000 7f84e0ff9700 1 -- 172.21.15.6:0/4045541371 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84d801e460 con 0x7f84e4159400 2023-10-06T02:26:13.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.404+0000 7f84e0ff9700 1 --2- 172.21.15.6:0/4045541371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84d0066f30 0x7f84d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:13.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.404+0000 7f84e0ff9700 1 -- 172.21.15.6:0/4045541371 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7324+0+0 (secure 0 0 0) 0x7f84d80850c0 con 0x7f84e4159400 2023-10-06T02:26:13.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.405+0000 7f84e8dea700 1 --2- 172.21.15.6:0/4045541371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84d0066f30 0x7f84d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:13.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.405+0000 7f84e8dea700 1 --2- 172.21.15.6:0/4045541371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84d0066f30 0x7f84d00693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f84e40c7790 tx=0x7f84d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:13.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.409+0000 7f84e0ff9700 1 -- 172.21.15.6:0/4045541371 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84d8051ce0 con 0x7f84e4159400 2023-10-06T02:26:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.645+0000 7f84e9dec700 1 -- 172.21.15.6:0/4045541371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84e40b5120 con 0x7f84e4159400 2023-10-06T02:26:13.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.645+0000 7f84e0ff9700 1 -- 172.21.15.6:0/4045541371 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) v1 ==== 95+0+4595 (secure 0 0 0) 0x7f84d8055300 con 0x7f84e4159400 2023-10-06T02:26:13.646 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:13.646 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":157,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3364863394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3364863394},{"type":"v1","addr":"172.21.15.6:6835","nonce":3364863394}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":157}],"filesystems":[{"mdsmap":{"epoch":156,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:10.886957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:13.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.647+0000 7f84e9dec700 1 -- 172.21.15.6:0/4045541371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84d0066f30 msgr2=0x7f84d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:13.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.647+0000 7f84e9dec700 1 --2- 172.21.15.6:0/4045541371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84d0066f30 0x7f84d00693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f84e40c7790 tx=0x7f84d4009040 comp rx=0 tx=0).stop 2023-10-06T02:26:13.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.647+0000 7f84e9dec700 1 -- 172.21.15.6:0/4045541371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e4159400 msgr2=0x7f84e40c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:13.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.647+0000 7f84e9dec700 1 --2- 172.21.15.6:0/4045541371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e4159400 0x7f84e40c8d20 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f84d800d890 tx=0x7f84d8008040 comp rx=0 tx=0).stop 2023-10-06T02:26:13.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.648+0000 7f84e9dec700 1 -- 172.21.15.6:0/4045541371 shutdown_connections 2023-10-06T02:26:13.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.648+0000 7f84e9dec700 1 --2- 172.21.15.6:0/4045541371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e41597d0 0x7f84e416a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:13.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.648+0000 7f84e9dec700 1 --2- 172.21.15.6:0/4045541371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e40cf1a0 0x7f84e416b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:13.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.648+0000 7f84e9dec700 1 --2- 172.21.15.6:0/4045541371 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84d0066f30 0x7f84d00693e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:13.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.648+0000 7f84e9dec700 1 --2- 172.21.15.6:0/4045541371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e4159400 0x7f84e40c8d20 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:13.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.648+0000 7f84e9dec700 1 -- 172.21.15.6:0/4045541371 >> 172.21.15.6:0/4045541371 conn(0x7f84e406ac10 msgr2=0x7f84e4157c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:13.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.648+0000 7f84e9dec700 1 -- 172.21.15.6:0/4045541371 shutdown_connections 2023-10-06T02:26:13.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.648+0000 7f84e9dec700 1 -- 172.21.15.6:0/4045541371 wait complete. 2023-10-06T02:26:13.650 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 157 2023-10-06T02:26:13.660 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:26:13.660 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.779+0000 7f5eebbb2700 1 Processor -- start 2023-10-06T02:26:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.779+0000 7f5eebbb2700 1 -- start start 2023-10-06T02:26:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.779+0000 7f5eebbb2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5ee40af4e0 0x7f5ee40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.779+0000 7f5eebbb2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ee40af8b0 0x7f5ee40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.780+0000 7f5eebbb2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee415e190 con 0x7f5ee415d460 2023-10-06T02:26:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.780+0000 7f5eebbb2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee40b1910 con 0x7f5ee40af4e0 2023-10-06T02:26:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.780+0000 7f5eebbb2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee415dfb0 con 0x7f5ee40af8b0 2023-10-06T02:26:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.780+0000 7f5ee994e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5ee40af4e0 0x7f5ee40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.780+0000 7f5ee914d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ee40af8b0 0x7f5ee40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.780+0000 7f5eea14f700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5ee415d460 0x7f5ee415d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:58028/0 (socket says 172.21.15.6:58028) 2023-10-06T02:26:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.780+0000 7f5eea14f700 1 -- 172.21.15.6:0/2902695719 learned_addr learned my addr 172.21.15.6:0/2902695719 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.780+0000 7f5ee994e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5ee40af4e0 0x7f5ee40b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:33970/0 (socket says 172.21.15.6:33970) 2023-10-06T02:26:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.780+0000 7f5ee994e700 1 -- 172.21.15.6:0/2902695719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ee40af8b0 msgr2=0x7f5ee40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.780+0000 7f5ee994e700 1 --2- 172.21.15.6:0/2902695719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ee40af8b0 0x7f5ee40b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.780+0000 7f5ee994e700 1 -- 172.21.15.6:0/2902695719 >> v1:172.21.15.175:6789/0 conn(0x7f5ee415d460 legacy=0x7f5ee415d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.780+0000 7f5ee994e700 1 -- 172.21.15.6:0/2902695719 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee40cb650 con 0x7f5ee40af4e0 2023-10-06T02:26:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.780+0000 7f5ee994e700 1 --2- 172.21.15.6:0/2902695719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ee40af4e0 0x7f5ee40b20e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0098e0 tx=0x7f5edc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e109e8c11efbc3c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.781+0000 7f5ee894c700 1 -- 172.21.15.6:0/2902695719 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc00b640 con 0x7f5ee40af4e0 2023-10-06T02:26:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.781+0000 7f5ee894c700 1 -- 172.21.15.6:0/2902695719 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc00b7a0 con 0x7f5ee40af4e0 2023-10-06T02:26:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.781+0000 7f5ee894c700 1 -- 172.21.15.6:0/2902695719 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc00bb40 con 0x7f5ee40af4e0 2023-10-06T02:26:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.781+0000 7f5eebbb2700 1 -- 172.21.15.6:0/2902695719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ee40af4e0 msgr2=0x7f5ee40b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.781+0000 7f5eebbb2700 1 --2- 172.21.15.6:0/2902695719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ee40af4e0 0x7f5ee40b20e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0098e0 tx=0x7f5edc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.781+0000 7f5eebbb2700 1 -- 172.21.15.6:0/2902695719 shutdown_connections 2023-10-06T02:26:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.781+0000 7f5eebbb2700 1 --2- 172.21.15.6:0/2902695719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ee40af4e0 0x7f5ee40b20e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.781+0000 7f5eebbb2700 1 --2- 172.21.15.6:0/2902695719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ee40af8b0 0x7f5ee40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.781+0000 7f5eebbb2700 1 -- 172.21.15.6:0/2902695719 >> 172.21.15.6:0/2902695719 conn(0x7f5ee4068680 msgr2=0x7f5ee4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.781+0000 7f5eebbb2700 1 -- 172.21.15.6:0/2902695719 shutdown_connections 2023-10-06T02:26:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.781+0000 7f5eebbb2700 1 -- 172.21.15.6:0/2902695719 wait complete. 2023-10-06T02:26:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.782+0000 7f5eebbb2700 1 Processor -- start 2023-10-06T02:26:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.782+0000 7f5eebbb2700 1 -- start start 2023-10-06T02:26:13.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.783+0000 7f5eebbb2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ee40af4e0 0x7f5ee40a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:13.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.783+0000 7f5eebbb2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ee40af8b0 0x7f5ee40c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.783+0000 7f5eebbb2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ee415d460 0x7f5ee4159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.783+0000 7f5eebbb2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee40a8470 con 0x7f5ee415d460 2023-10-06T02:26:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.783+0000 7f5eebbb2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee40a7860 con 0x7f5ee40af4e0 2023-10-06T02:26:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.783+0000 7f5eebbb2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee40a7b40 con 0x7f5ee40af8b0 2023-10-06T02:26:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.783+0000 7f5eea14f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ee415d460 0x7f5ee4159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.783+0000 7f5eea14f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ee415d460 0x7f5ee4159990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59948/0 (socket says 172.21.15.6:59948) 2023-10-06T02:26:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.783+0000 7f5eea14f700 1 -- 172.21.15.6:0/3029378137 learned_addr learned my addr 172.21.15.6:0/3029378137 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.783+0000 7f5ee994e700 1 --2- 172.21.15.6:0/3029378137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ee40af4e0 0x7f5ee40a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.783+0000 7f5ee914d700 1 --2- 172.21.15.6:0/3029378137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ee40af8b0 0x7f5ee40c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.783+0000 7f5eea14f700 1 -- 172.21.15.6:0/3029378137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ee40af8b0 msgr2=0x7f5ee40c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.783+0000 7f5eea14f700 1 --2- 172.21.15.6:0/3029378137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ee40af8b0 0x7f5ee40c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.783+0000 7f5eea14f700 1 -- 172.21.15.6:0/3029378137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ee40af4e0 msgr2=0x7f5ee40a8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.783+0000 7f5eea14f700 1 --2- 172.21.15.6:0/3029378137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ee40af4e0 0x7f5ee40a8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.784+0000 7f5eea14f700 1 -- 172.21.15.6:0/3029378137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc009420 con 0x7f5ee415d460 2023-10-06T02:26:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.784+0000 7f5eea14f700 1 --2- 172.21.15.6:0/3029378137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ee415d460 0x7f5ee4159990 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f5ed400cc40 tx=0x7f5ed4001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.784+0000 7f5ee1ffb700 1 -- 172.21.15.6:0/3029378137 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed400a8b0 con 0x7f5ee415d460 2023-10-06T02:26:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.784+0000 7f5ee1ffb700 1 -- 172.21.15.6:0/3029378137 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed400aa10 con 0x7f5ee415d460 2023-10-06T02:26:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.784+0000 7f5ee1ffb700 1 -- 172.21.15.6:0/3029378137 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed400add0 con 0x7f5ee415d460 2023-10-06T02:26:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.784+0000 7f5eebbb2700 1 -- 172.21.15.6:0/3029378137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee40a7e20 con 0x7f5ee415d460 2023-10-06T02:26:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.784+0000 7f5eebbb2700 1 -- 172.21.15.6:0/3029378137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee40ae960 con 0x7f5ee415d460 2023-10-06T02:26:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.785+0000 7f5eebbb2700 1 -- 172.21.15.6:0/3029378137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee4088aa0 con 0x7f5ee415d460 2023-10-06T02:26:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.785+0000 7f5ee1ffb700 1 -- 172.21.15.6:0/3029378137 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ed4007300 con 0x7f5ee415d460 2023-10-06T02:26:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.786+0000 7f5ee1ffb700 1 --2- 172.21.15.6:0/3029378137 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ed0066f30 0x7f5ed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.786+0000 7f5ee1ffb700 1 -- 172.21.15.6:0/3029378137 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7324+0+0 (secure 0 0 0) 0x7f5ed4084ec0 con 0x7f5ee415d460 2023-10-06T02:26:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.786+0000 7f5ee994e700 1 --2- 172.21.15.6:0/3029378137 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ed0066f30 0x7f5ed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.786+0000 7f5ee994e700 1 --2- 172.21.15.6:0/3029378137 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ed0066f30 0x7f5ed00693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0093f0 tx=0x7f5edc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:13.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:13.790+0000 7f5ee1ffb700 1 -- 172.21.15.6:0/3029378137 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ed4051ae0 con 0x7f5ee415d460 2023-10-06T02:26:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.028+0000 7f5eebbb2700 1 -- 172.21.15.6:0/3029378137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ee415dd70 con 0x7f5ee415d460 2023-10-06T02:26:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.029+0000 7f5ee1ffb700 1 -- 172.21.15.6:0/3029378137 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) v1 ==== 95+0+4595 (secure 0 0 0) 0x7f5ed4055100 con 0x7f5ee415d460 2023-10-06T02:26:14.029 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:14.029 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":157,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3364863394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3364863394},{"type":"v1","addr":"172.21.15.6:6835","nonce":3364863394}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":157}],"filesystems":[{"mdsmap":{"epoch":156,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:10.886957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.031+0000 7f5eebbb2700 1 -- 172.21.15.6:0/3029378137 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ed0066f30 msgr2=0x7f5ed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.031+0000 7f5eebbb2700 1 --2- 172.21.15.6:0/3029378137 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ed0066f30 0x7f5ed00693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0093f0 tx=0x7f5edc017000 comp rx=0 tx=0).stop 2023-10-06T02:26:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.031+0000 7f5eebbb2700 1 -- 172.21.15.6:0/3029378137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ee415d460 msgr2=0x7f5ee4159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.031+0000 7f5eebbb2700 1 --2- 172.21.15.6:0/3029378137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ee415d460 0x7f5ee4159990 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f5ed400cc40 tx=0x7f5ed4001a50 comp rx=0 tx=0).stop 2023-10-06T02:26:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.031+0000 7f5eebbb2700 1 -- 172.21.15.6:0/3029378137 shutdown_connections 2023-10-06T02:26:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.031+0000 7f5eebbb2700 1 --2- 172.21.15.6:0/3029378137 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ed0066f30 0x7f5ed00693e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.031+0000 7f5eebbb2700 1 --2- 172.21.15.6:0/3029378137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ee415d460 0x7f5ee4159990 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.031+0000 7f5eebbb2700 1 --2- 172.21.15.6:0/3029378137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ee40af4e0 0x7f5ee40a8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:14.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.031+0000 7f5eebbb2700 1 --2- 172.21.15.6:0/3029378137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ee40af8b0 0x7f5ee40c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:14.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.031+0000 7f5eebbb2700 1 -- 172.21.15.6:0/3029378137 >> 172.21.15.6:0/3029378137 conn(0x7f5ee4068680 msgr2=0x7f5ee40b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:14.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.031+0000 7f5eebbb2700 1 -- 172.21.15.6:0/3029378137 shutdown_connections 2023-10-06T02:26:14.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.031+0000 7f5eebbb2700 1 -- 172.21.15.6:0/3029378137 wait complete. 2023-10-06T02:26:14.033 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 157 2023-10-06T02:26:14.043 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:26:14.044 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.162+0000 7f79555a0700 1 Processor -- start 2023-10-06T02:26:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.162+0000 7f79555a0700 1 -- start start 2023-10-06T02:26:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.163+0000 7f79555a0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79500b0ed0 0x7f795013f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.163+0000 7f79555a0700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7950068ca0 0x7f795013f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.163+0000 7f79555a0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79500b0350 con 0x7f79500688d0 2023-10-06T02:26:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.163+0000 7f79555a0700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795013fe40 con 0x7f7950068ca0 2023-10-06T02:26:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.163+0000 7f79555a0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79500b0590 con 0x7f79500b0ed0 2023-10-06T02:26:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.163+0000 7f794ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f79500688d0 0x7f79500afc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37404/0 (socket says 172.21.15.6:37404) 2023-10-06T02:26:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.163+0000 7f794ffff700 1 -- 172.21.15.6:0/1461658141 learned_addr learned my addr 172.21.15.6:0/1461658141 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.163+0000 7f794f7fe700 1 --2- 172.21.15.6:0/1461658141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79500b0ed0 0x7f795013f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.163+0000 7f7954d9f700 1 --2- 172.21.15.6:0/1461658141 >> v2:172.21.15.175:3300/0 conn(0x7f7950068ca0 0x7f795013f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794effd700 1 -- 172.21.15.6:0/1461658141 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039344935 0 0) 0x7f7940001110 con 0x7f79500688d0 2023-10-06T02:26:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794effd700 1 -- 172.21.15.6:0/1461658141 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7938003570 con 0x7f79500688d0 2023-10-06T02:26:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794effd700 1 -- 172.21.15.6:0/1461658141 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2453980683 0 0) 0x7f7938003570 con 0x7f79500688d0 2023-10-06T02:26:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794effd700 1 -- 172.21.15.6:0/1461658141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79500b0ed0 msgr2=0x7f795013f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794effd700 1 --2- 172.21.15.6:0/1461658141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79500b0ed0 0x7f795013f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794effd700 1 -- 172.21.15.6:0/1461658141 >> v2:172.21.15.175:3300/0 conn(0x7f7950068ca0 msgr2=0x7f795013f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794effd700 1 --2- 172.21.15.6:0/1461658141 >> v2:172.21.15.175:3300/0 conn(0x7f7950068ca0 0x7f795013f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794effd700 1 -- 172.21.15.6:0/1461658141 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79500b0870 con 0x7f79500688d0 2023-10-06T02:26:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794effd700 1 -- 172.21.15.6:0/1461658141 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f7940001600 con 0x7f79500688d0 2023-10-06T02:26:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794effd700 1 -- 172.21.15.6:0/1461658141 >> v1:172.21.15.6:6789/0 conn(0x7f79500688d0 legacy=0x7f79500afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794effd700 1 --2- 172.21.15.6:0/1461658141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7938003a60 0x7f7938003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794effd700 1 --2- 172.21.15.6:0/1461658141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79500b0ed0 0x7f7938004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794effd700 1 --2- 172.21.15.6:0/1461658141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7938004d50 0x7f79380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794effd700 1 -- 172.21.15.6:0/1461658141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795013fe40 con 0x7f7938003a60 2023-10-06T02:26:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794effd700 1 -- 172.21.15.6:0/1461658141 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500b0590 con 0x7f7938004d50 2023-10-06T02:26:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794effd700 1 -- 172.21.15.6:0/1461658141 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793800ba60 con 0x7f79500b0ed0 2023-10-06T02:26:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794ffff700 1 --2- 172.21.15.6:0/1461658141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7938003a60 0x7f7938003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794f7fe700 1 --2- 172.21.15.6:0/1461658141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79500b0ed0 0x7f7938004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f7954d9f700 1 --2- 172.21.15.6:0/1461658141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7938004d50 0x7f79380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794ffff700 1 -- 172.21.15.6:0/1461658141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79500b0ed0 msgr2=0x7f7938004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794ffff700 1 --2- 172.21.15.6:0/1461658141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79500b0ed0 0x7f7938004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794ffff700 1 -- 172.21.15.6:0/1461658141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7938004d50 msgr2=0x7f79380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794ffff700 1 --2- 172.21.15.6:0/1461658141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7938004d50 0x7f79380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f794ffff700 1 -- 172.21.15.6:0/1461658141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7938003570 con 0x7f7938003a60 2023-10-06T02:26:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.164+0000 7f7954d9f700 1 --2- 172.21.15.6:0/1461658141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7938004d50 0x7f79380051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.165+0000 7f794ffff700 1 --2- 172.21.15.6:0/1461658141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7938003a60 0x7f7938003e70 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f794000c5f0 tx=0x7f7940007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9231b2bfb113068 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.165+0000 7f794effd700 1 -- 172.21.15.6:0/1461658141 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794000cd90 con 0x7f7938003a60 2023-10-06T02:26:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.165+0000 7f794effd700 1 -- 172.21.15.6:0/1461658141 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7940005920 con 0x7f7938003a60 2023-10-06T02:26:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.165+0000 7f794effd700 1 -- 172.21.15.6:0/1461658141 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940005ce0 con 0x7f7938003a60 2023-10-06T02:26:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.165+0000 7f79555a0700 1 -- 172.21.15.6:0/1461658141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7938003a60 msgr2=0x7f7938003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.165+0000 7f79555a0700 1 --2- 172.21.15.6:0/1461658141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7938003a60 0x7f7938003e70 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f794000c5f0 tx=0x7f7940007a80 comp rx=0 tx=0).stop 2023-10-06T02:26:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.165+0000 7f7954d9f700 1 -- 172.21.15.6:0/1461658141 reap_dead start 2023-10-06T02:26:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.165+0000 7f79555a0700 1 -- 172.21.15.6:0/1461658141 shutdown_connections 2023-10-06T02:26:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.165+0000 7f79555a0700 1 -- 172.21.15.6:0/1461658141 >> 172.21.15.6:0/1461658141 conn(0x7f795006b320 msgr2=0x7f795006b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.165+0000 7f79555a0700 1 -- 172.21.15.6:0/1461658141 shutdown_connections 2023-10-06T02:26:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.165+0000 7f79555a0700 1 -- 172.21.15.6:0/1461658141 wait complete. 2023-10-06T02:26:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.166+0000 7f79555a0700 1 Processor -- start 2023-10-06T02:26:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.167+0000 7f79555a0700 1 -- start start 2023-10-06T02:26:14.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.167+0000 7f79555a0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7938003a60 0x7f79500cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:14.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.167+0000 7f79555a0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79500cbd70 0x7f79500c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.167+0000 7f79555a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79500c8bb0 0x7f79500ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.167+0000 7f79555a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500c6f50 con 0x7f79500c8bb0 2023-10-06T02:26:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.167+0000 7f79555a0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500cc370 con 0x7f79500cbd70 2023-10-06T02:26:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.167+0000 7f79555a0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79500cc650 con 0x7f7938003a60 2023-10-06T02:26:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.167+0000 7f7954d9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79500c8bb0 0x7f79500ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.167+0000 7f7954d9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79500c8bb0 0x7f79500ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59962/0 (socket says 172.21.15.6:59962) 2023-10-06T02:26:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.167+0000 7f7954d9f700 1 -- 172.21.15.6:0/76592954 learned_addr learned my addr 172.21.15.6:0/76592954 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.168+0000 7f794ffff700 1 --2- 172.21.15.6:0/76592954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7938003a60 0x7f79500cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.168+0000 7f7954d9f700 1 -- 172.21.15.6:0/76592954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7938003a60 msgr2=0x7f79500cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.168+0000 7f794f7fe700 1 --2- 172.21.15.6:0/76592954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79500cbd70 0x7f79500c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.168+0000 7f7954d9f700 1 --2- 172.21.15.6:0/76592954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7938003a60 0x7f79500cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.168+0000 7f7954d9f700 1 -- 172.21.15.6:0/76592954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79500cbd70 msgr2=0x7f79500c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.168+0000 7f7954d9f700 1 --2- 172.21.15.6:0/76592954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79500cbd70 0x7f79500c6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.168+0000 7f7954d9f700 1 -- 172.21.15.6:0/76592954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79500cc930 con 0x7f79500c8bb0 2023-10-06T02:26:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.168+0000 7f7954d9f700 1 --2- 172.21.15.6:0/76592954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79500c8bb0 0x7f79500ae000 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f795015ce80 tx=0x7f794800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.168+0000 7f7937fff700 1 -- 172.21.15.6:0/76592954 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794801b070 con 0x7f79500c8bb0 2023-10-06T02:26:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.168+0000 7f7937fff700 1 -- 172.21.15.6:0/76592954 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794800f040 con 0x7f79500c8bb0 2023-10-06T02:26:14.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.168+0000 7f79555a0700 1 -- 172.21.15.6:0/76592954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79500ccc10 con 0x7f79500c8bb0 2023-10-06T02:26:14.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.168+0000 7f7937fff700 1 -- 172.21.15.6:0/76592954 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794800e050 con 0x7f79500c8bb0 2023-10-06T02:26:14.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.168+0000 7f79555a0700 1 -- 172.21.15.6:0/76592954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79500c9050 con 0x7f79500c8bb0 2023-10-06T02:26:14.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.169+0000 7f79555a0700 1 -- 172.21.15.6:0/76592954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79500cc140 con 0x7f79500c8bb0 2023-10-06T02:26:14.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.169+0000 7f7937fff700 1 -- 172.21.15.6:0/76592954 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7948003020 con 0x7f79500c8bb0 2023-10-06T02:26:14.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.170+0000 7f7937fff700 1 --2- 172.21.15.6:0/76592954 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f793c066f30 0x7f793c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:14.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.170+0000 7f7937fff700 1 -- 172.21.15.6:0/76592954 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7324+0+0 (secure 0 0 0) 0x7f7948084fe0 con 0x7f79500c8bb0 2023-10-06T02:26:14.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.170+0000 7f794ffff700 1 --2- 172.21.15.6:0/76592954 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f793c066f30 0x7f793c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.170+0000 7f794ffff700 1 --2- 172.21.15.6:0/76592954 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f793c066f30 0x7f793c0693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7940008fd0 tx=0x7f7940015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.174+0000 7f7937fff700 1 -- 172.21.15.6:0/76592954 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7948051c00 con 0x7f79500c8bb0 2023-10-06T02:26:14.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.414+0000 7f79555a0700 1 -- 172.21.15.6:0/76592954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79500b0b50 con 0x7f79500c8bb0 2023-10-06T02:26:14.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.415+0000 7f7937fff700 1 -- 172.21.15.6:0/76592954 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) v1 ==== 95+0+4595 (secure 0 0 0) 0x7f7948010ea0 con 0x7f79500c8bb0 2023-10-06T02:26:14.415 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:14.416 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":157,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3364863394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3364863394},{"type":"v1","addr":"172.21.15.6:6835","nonce":3364863394}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":157}],"filesystems":[{"mdsmap":{"epoch":156,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:10.886957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:14.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.417+0000 7f79555a0700 1 -- 172.21.15.6:0/76592954 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f793c066f30 msgr2=0x7f793c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.417+0000 7f79555a0700 1 --2- 172.21.15.6:0/76592954 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f793c066f30 0x7f793c0693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7940008fd0 tx=0x7f7940015000 comp rx=0 tx=0).stop 2023-10-06T02:26:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.417+0000 7f79555a0700 1 -- 172.21.15.6:0/76592954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79500c8bb0 msgr2=0x7f79500ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.417+0000 7f79555a0700 1 --2- 172.21.15.6:0/76592954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79500c8bb0 0x7f79500ae000 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f795015ce80 tx=0x7f794800b040 comp rx=0 tx=0).stop 2023-10-06T02:26:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.417+0000 7f79555a0700 1 -- 172.21.15.6:0/76592954 shutdown_connections 2023-10-06T02:26:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.417+0000 7f79555a0700 1 --2- 172.21.15.6:0/76592954 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f793c066f30 0x7f793c0693e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.417+0000 7f79555a0700 1 --2- 172.21.15.6:0/76592954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79500c8bb0 0x7f79500ae000 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.417+0000 7f79555a0700 1 --2- 172.21.15.6:0/76592954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7938003a60 0x7f79500cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.417+0000 7f79555a0700 1 --2- 172.21.15.6:0/76592954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79500cbd70 0x7f79500c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.417+0000 7f79555a0700 1 -- 172.21.15.6:0/76592954 >> 172.21.15.6:0/76592954 conn(0x7f795006b320 msgr2=0x7f79501424f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.417+0000 7f79555a0700 1 -- 172.21.15.6:0/76592954 shutdown_connections 2023-10-06T02:26:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.417+0000 7f79555a0700 1 -- 172.21.15.6:0/76592954 wait complete. 2023-10-06T02:26:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 157 2023-10-06T02:26:14.430 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 100.00000000' led to DAMAGED state 2023-10-06T02:26:14.431 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete mds0_sessionmap' 2023-10-06T02:26:14.431 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:14.431 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:26:14.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:14.431 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:26:14.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:26:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:26:14.447 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:26:14.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.606+0000 7fe1af59e700 1 Processor -- start 2023-10-06T02:26:14.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.606+0000 7fe1af59e700 1 -- start start 2023-10-06T02:26:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.607+0000 7fe1af59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1b00af390 0x7fe1b0158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.607+0000 7fe1af59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b00b2330 con 0x7fe1b00688d0 2023-10-06T02:26:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.607+0000 7fe1af59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b00ac720 con 0x7fe1b0068ca0 2023-10-06T02:26:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.607+0000 7fe1af59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b00b0310 con 0x7fe1b00af390 2023-10-06T02:26:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.607+0000 7fe1ae59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe1b00688d0 0x7fe1b00afc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37416/0 (socket says 172.21.15.6:37416) 2023-10-06T02:26:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.607+0000 7fe1ae59c700 1 -- 172.21.15.6:0/3790745089 learned_addr learned my addr 172.21.15.6:0/3790745089 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.607+0000 7fe1add9b700 1 --2- 172.21.15.6:0/3790745089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1b00af390 0x7fe1b0158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.607+0000 7fe1ad59a700 1 -- 172.21.15.6:0/3790745089 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622025944 0 0) 0x7fe1b00b2330 con 0x7fe1b00688d0 2023-10-06T02:26:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.607+0000 7fe1ad59a700 1 -- 172.21.15.6:0/3790745089 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe19c003570 con 0x7fe1b00688d0 2023-10-06T02:26:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.607+0000 7fe1ad59a700 1 -- 172.21.15.6:0/3790745089 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148273620 0 0) 0x7fe1b00ac720 con 0x7fe1b0068ca0 2023-10-06T02:26:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.607+0000 7fe1add9b700 1 -- 172.21.15.6:0/3790745089 >> v1:172.21.15.175:6789/0 conn(0x7fe1b0068ca0 legacy=0x7fe1b01592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.607+0000 7fe1add9b700 1 -- 172.21.15.6:0/3790745089 >> v1:172.21.15.6:6789/0 conn(0x7fe1b00688d0 legacy=0x7fe1b00afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.607+0000 7fe1add9b700 1 -- 172.21.15.6:0/3790745089 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b00b25d0 con 0x7fe1b00af390 2023-10-06T02:26:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.607+0000 7fe1add9b700 1 --2- 172.21.15.6:0/3790745089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1b00af390 0x7fe1b0158db0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe198009900 tx=0x7fe198009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74dfcb1e4da31272 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.608+0000 7fe1ad59a700 1 -- 172.21.15.6:0/3790745089 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe198005c10 con 0x7fe1b00af390 2023-10-06T02:26:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.608+0000 7fe1ad59a700 1 -- 172.21.15.6:0/3790745089 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe198005d70 con 0x7fe1b00af390 2023-10-06T02:26:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.608+0000 7fe1ad59a700 1 -- 172.21.15.6:0/3790745089 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe198006260 con 0x7fe1b00af390 2023-10-06T02:26:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.608+0000 7fe1af59e700 1 -- 172.21.15.6:0/3790745089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1b00af390 msgr2=0x7fe1b0158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.608+0000 7fe1af59e700 1 --2- 172.21.15.6:0/3790745089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1b00af390 0x7fe1b0158db0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe198009900 tx=0x7fe198009120 comp rx=0 tx=0).stop 2023-10-06T02:26:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.608+0000 7fe1af59e700 1 -- 172.21.15.6:0/3790745089 shutdown_connections 2023-10-06T02:26:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.608+0000 7fe1af59e700 1 --2- 172.21.15.6:0/3790745089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1b00af390 0x7fe1b0158db0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:14.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.608+0000 7fe1af59e700 1 -- 172.21.15.6:0/3790745089 >> 172.21.15.6:0/3790745089 conn(0x7fe1b0096240 msgr2=0x7fe1b0069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:14.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.608+0000 7fe1af59e700 1 -- 172.21.15.6:0/3790745089 shutdown_connections 2023-10-06T02:26:14.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.608+0000 7fe1af59e700 1 -- 172.21.15.6:0/3790745089 wait complete. 2023-10-06T02:26:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.609+0000 7fe1af59e700 1 Processor -- start 2023-10-06T02:26:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.609+0000 7fe1af59e700 1 -- start start 2023-10-06T02:26:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.610+0000 7fe1af59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00688d0 0x7fe1b014c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.610+0000 7fe1af59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1b0068ca0 0x7fe1b00c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.610+0000 7fe1af59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b00af390 0x7fe1b00c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.610+0000 7fe1af59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0099100 con 0x7fe1b00688d0 2023-10-06T02:26:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.610+0000 7fe1af59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0099f60 con 0x7fe1b00af390 2023-10-06T02:26:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.610+0000 7fe1af59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b014c8a0 con 0x7fe1b0068ca0 2023-10-06T02:26:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.610+0000 7fe1ae59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00688d0 0x7fe1b014c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.610+0000 7fe1ae59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00688d0 0x7fe1b014c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59978/0 (socket says 172.21.15.6:59978) 2023-10-06T02:26:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.610+0000 7fe1ae59c700 1 -- 172.21.15.6:0/1993354614 learned_addr learned my addr 172.21.15.6:0/1993354614 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.610+0000 7fe1add9b700 1 --2- 172.21.15.6:0/1993354614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1b0068ca0 0x7fe1b00c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.610+0000 7fe1aed9d700 1 --2- 172.21.15.6:0/1993354614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b00af390 0x7fe1b00c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.610+0000 7fe1ae59c700 1 -- 172.21.15.6:0/1993354614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1b0068ca0 msgr2=0x7fe1b00c2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.610+0000 7fe1ae59c700 1 --2- 172.21.15.6:0/1993354614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1b0068ca0 0x7fe1b00c2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.610+0000 7fe1ae59c700 1 -- 172.21.15.6:0/1993354614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b00af390 msgr2=0x7fe1b00c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.610+0000 7fe1ae59c700 1 --2- 172.21.15.6:0/1993354614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b00af390 0x7fe1b00c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.610+0000 7fe1ae59c700 1 -- 172.21.15.6:0/1993354614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1980093c0 con 0x7fe1b00688d0 2023-10-06T02:26:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.610+0000 7fe1aed9d700 1 --2- 172.21.15.6:0/1993354614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b00af390 0x7fe1b00c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.611+0000 7fe1ae59c700 1 --2- 172.21.15.6:0/1993354614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00688d0 0x7fe1b014c360 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fe1a800c790 tx=0x7fe1a8007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.611+0000 7fe1a67fc700 1 -- 172.21.15.6:0/1993354614 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a80072e0 con 0x7fe1b00688d0 2023-10-06T02:26:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.611+0000 7fe1a67fc700 1 -- 172.21.15.6:0/1993354614 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a8007460 con 0x7fe1b00688d0 2023-10-06T02:26:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.611+0000 7fe1af59e700 1 -- 172.21.15.6:0/1993354614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b0099350 con 0x7fe1b00688d0 2023-10-06T02:26:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.611+0000 7fe1a67fc700 1 -- 172.21.15.6:0/1993354614 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a80057f0 con 0x7fe1b00688d0 2023-10-06T02:26:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.611+0000 7fe1af59e700 1 -- 172.21.15.6:0/1993354614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b0099910 con 0x7fe1b00688d0 2023-10-06T02:26:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.612+0000 7fe1af59e700 1 -- 172.21.15.6:0/1993354614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b00ac4f0 con 0x7fe1b00688d0 2023-10-06T02:26:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.612+0000 7fe1a67fc700 1 -- 172.21.15.6:0/1993354614 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1a8005ba0 con 0x7fe1b00688d0 2023-10-06T02:26:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.613+0000 7fe1a67fc700 1 --2- 172.21.15.6:0/1993354614 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe190066f30 0x7fe1900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.613+0000 7fe1a67fc700 1 -- 172.21.15.6:0/1993354614 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7324+0+0 (secure 0 0 0) 0x7fe1a8084120 con 0x7fe1b00688d0 2023-10-06T02:26:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.613+0000 7fe1add9b700 1 --2- 172.21.15.6:0/1993354614 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe190066f30 0x7fe1900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.614+0000 7fe1add9b700 1 --2- 172.21.15.6:0/1993354614 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe190066f30 0x7fe1900693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe198009fd0 tx=0x7fe198016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:14.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.617+0000 7fe1a67fc700 1 -- 172.21.15.6:0/1993354614 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1a8050d40 con 0x7fe1b00688d0 2023-10-06T02:26:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:14.854+0000 7fe1af59e700 1 -- 172.21.15.6:0/1993354614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe1b00b28b0 con 0x7fe1b00688d0 2023-10-06T02:26:15.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.827+0000 7fe1a67fc700 1 -- 172.21.15.6:0/1993354614 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v158) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe1a8054360 con 0x7fe1b00688d0 2023-10-06T02:26:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.830+0000 7fe1af59e700 1 -- 172.21.15.6:0/1993354614 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe190066f30 msgr2=0x7fe1900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.830+0000 7fe1af59e700 1 --2- 172.21.15.6:0/1993354614 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe190066f30 0x7fe1900693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe198009fd0 tx=0x7fe198016000 comp rx=0 tx=0).stop 2023-10-06T02:26:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.830+0000 7fe1af59e700 1 -- 172.21.15.6:0/1993354614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00688d0 msgr2=0x7fe1b014c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.830+0000 7fe1af59e700 1 --2- 172.21.15.6:0/1993354614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00688d0 0x7fe1b014c360 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fe1a800c790 tx=0x7fe1a8007c60 comp rx=0 tx=0).stop 2023-10-06T02:26:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.830+0000 7fe1af59e700 1 -- 172.21.15.6:0/1993354614 shutdown_connections 2023-10-06T02:26:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.830+0000 7fe1af59e700 1 --2- 172.21.15.6:0/1993354614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b00af390 0x7fe1b00c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:15.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.830+0000 7fe1af59e700 1 --2- 172.21.15.6:0/1993354614 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe190066f30 0x7fe1900693e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:15.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.830+0000 7fe1af59e700 1 --2- 172.21.15.6:0/1993354614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00688d0 0x7fe1b014c360 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:15.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.830+0000 7fe1af59e700 1 --2- 172.21.15.6:0/1993354614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1b0068ca0 0x7fe1b00c2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:15.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.830+0000 7fe1af59e700 1 -- 172.21.15.6:0/1993354614 >> 172.21.15.6:0/1993354614 conn(0x7fe1b0096240 msgr2=0x7fe1b006b340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:15.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.830+0000 7fe1af59e700 1 -- 172.21.15.6:0/1993354614 shutdown_connections 2023-10-06T02:26:15.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.830+0000 7fe1af59e700 1 -- 172.21.15.6:0/1993354614 wait complete. 2023-10-06T02:26:15.833 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:26:15.845 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:26:15.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.972+0000 7fdd964b4700 1 Processor -- start 2023-10-06T02:26:15.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.972+0000 7fdd964b4700 1 -- start start 2023-10-06T02:26:15.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.973+0000 7fdd964b4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd90157480 0x7fdd900ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:15.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.973+0000 7fdd964b4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdd9006c210 0x7fdd9006c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:15.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.973+0000 7fdd964b4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd900acf20 con 0x7fdd901570b0 2023-10-06T02:26:15.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.973+0000 7fdd964b4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd900c6dc0 con 0x7fdd9006c210 2023-10-06T02:26:15.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.973+0000 7fdd964b4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd900c7380 con 0x7fdd90157480 2023-10-06T02:26:15.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.973+0000 7fdd94a51700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdd9006c210 0x7fdd9006c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:15.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.973+0000 7fdd8ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdd901570b0 0x7fdd9015ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37422/0 (socket says 172.21.15.6:37422) 2023-10-06T02:26:15.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.973+0000 7fdd8ffff700 1 -- 172.21.15.6:0/541322047 learned_addr learned my addr 172.21.15.6:0/541322047 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:15.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.973+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/541322047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd90157480 0x7fdd900ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:15.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.973+0000 7fdd94a51700 1 -- 172.21.15.6:0/541322047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd90157480 msgr2=0x7fdd900ac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:15.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.973+0000 7fdd94a51700 1 --2- 172.21.15.6:0/541322047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd90157480 0x7fdd900ac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:15.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.973+0000 7fdd94a51700 1 -- 172.21.15.6:0/541322047 >> v1:172.21.15.6:6789/0 conn(0x7fdd901570b0 legacy=0x7fdd9015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:15.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.973+0000 7fdd94a51700 1 -- 172.21.15.6:0/541322047 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9006cba0 con 0x7fdd9006c210 2023-10-06T02:26:15.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.973+0000 7fdd8effd700 1 -- 172.21.15.6:0/541322047 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864561754 0 0) 0x7fdd900acf20 con 0x7fdd901570b0 2023-10-06T02:26:15.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.974+0000 7fdd94a51700 1 --2- 172.21.15.6:0/541322047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9006c210 0x7fdd9006c660 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fdd88009e60 tx=0x7fdd88009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff12da8a614be350 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:15.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.974+0000 7fdd8effd700 1 -- 172.21.15.6:0/541322047 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8800e070 con 0x7fdd9006c210 2023-10-06T02:26:15.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.974+0000 7fdd8effd700 1 -- 172.21.15.6:0/541322047 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8800bb60 con 0x7fdd9006c210 2023-10-06T02:26:15.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.974+0000 7fdd8effd700 1 -- 172.21.15.6:0/541322047 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd88012430 con 0x7fdd9006c210 2023-10-06T02:26:15.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.974+0000 7fdd964b4700 1 -- 172.21.15.6:0/541322047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9006c210 msgr2=0x7fdd9006c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:15.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.974+0000 7fdd964b4700 1 --2- 172.21.15.6:0/541322047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9006c210 0x7fdd9006c660 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fdd88009e60 tx=0x7fdd88009780 comp rx=0 tx=0).stop 2023-10-06T02:26:15.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.974+0000 7fdd964b4700 1 -- 172.21.15.6:0/541322047 shutdown_connections 2023-10-06T02:26:15.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.974+0000 7fdd964b4700 1 --2- 172.21.15.6:0/541322047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9006c210 0x7fdd9006c660 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:15.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.974+0000 7fdd964b4700 1 --2- 172.21.15.6:0/541322047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd90157480 0x7fdd900ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:15.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.974+0000 7fdd964b4700 1 -- 172.21.15.6:0/541322047 >> 172.21.15.6:0/541322047 conn(0x7fdd900c9cc0 msgr2=0x7fdd9006acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:15.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.974+0000 7fdd964b4700 1 -- 172.21.15.6:0/541322047 shutdown_connections 2023-10-06T02:26:15.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.974+0000 7fdd964b4700 1 -- 172.21.15.6:0/541322047 wait complete. 2023-10-06T02:26:15.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.976+0000 7fdd964b4700 1 Processor -- start 2023-10-06T02:26:15.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.976+0000 7fdd964b4700 1 -- start start 2023-10-06T02:26:15.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.977+0000 7fdd964b4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd9006c210 0x7fdd90152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:15.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.977+0000 7fdd964b4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd901570b0 0x7fdd900c3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:15.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.977+0000 7fdd964b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd90157480 0x7fdd900af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:15.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.977+0000 7fdd964b4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9015bf80 con 0x7fdd90157480 2023-10-06T02:26:15.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.977+0000 7fdd964b4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9015cac0 con 0x7fdd901570b0 2023-10-06T02:26:15.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.977+0000 7fdd964b4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9015c190 con 0x7fdd9006c210 2023-10-06T02:26:15.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.977+0000 7fdd94a51700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd90157480 0x7fdd900af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:15.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.977+0000 7fdd94a51700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd90157480 0x7fdd900af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59996/0 (socket says 172.21.15.6:59996) 2023-10-06T02:26:15.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.977+0000 7fdd94a51700 1 -- 172.21.15.6:0/383662339 learned_addr learned my addr 172.21.15.6:0/383662339 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:15.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.977+0000 7fdd8ffff700 1 --2- 172.21.15.6:0/383662339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd9006c210 0x7fdd90152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:15.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.977+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/383662339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd901570b0 0x7fdd900c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:15.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.977+0000 7fdd94a51700 1 -- 172.21.15.6:0/383662339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd9006c210 msgr2=0x7fdd90152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:15.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.977+0000 7fdd94a51700 1 --2- 172.21.15.6:0/383662339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd9006c210 0x7fdd90152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:15.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.977+0000 7fdd94a51700 1 -- 172.21.15.6:0/383662339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd901570b0 msgr2=0x7fdd900c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:15.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.977+0000 7fdd94a51700 1 --2- 172.21.15.6:0/383662339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd901570b0 0x7fdd900c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:15.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.977+0000 7fdd94a51700 1 -- 172.21.15.6:0/383662339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd88009a20 con 0x7fdd90157480 2023-10-06T02:26:15.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.977+0000 7fdd94a51700 1 --2- 172.21.15.6:0/383662339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd90157480 0x7fdd900af850 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fdd900ca0c0 tx=0x7fdd88019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:15.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.978+0000 7fdd77fff700 1 -- 172.21.15.6:0/383662339 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd88012e60 con 0x7fdd90157480 2023-10-06T02:26:15.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.978+0000 7fdd77fff700 1 -- 172.21.15.6:0/383662339 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd88027470 con 0x7fdd90157480 2023-10-06T02:26:15.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.978+0000 7fdd964b4700 1 -- 172.21.15.6:0/383662339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9015c470 con 0x7fdd90157480 2023-10-06T02:26:15.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.978+0000 7fdd77fff700 1 -- 172.21.15.6:0/383662339 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd88027850 con 0x7fdd90157480 2023-10-06T02:26:15.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.978+0000 7fdd964b4700 1 -- 172.21.15.6:0/383662339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd901531e0 con 0x7fdd90157480 2023-10-06T02:26:15.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.979+0000 7fdd964b4700 1 -- 172.21.15.6:0/383662339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9006e140 con 0x7fdd90157480 2023-10-06T02:26:15.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.979+0000 7fdd77fff700 1 -- 172.21.15.6:0/383662339 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd88024070 con 0x7fdd90157480 2023-10-06T02:26:15.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.980+0000 7fdd77fff700 1 --2- 172.21.15.6:0/383662339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdd7c066f30 0x7fdd7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:15.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.980+0000 7fdd77fff700 1 -- 172.21.15.6:0/383662339 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7324+0+0 (secure 0 0 0) 0x7fdd88087280 con 0x7fdd90157480 2023-10-06T02:26:15.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.980+0000 7fdd8ffff700 1 --2- 172.21.15.6:0/383662339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdd7c066f30 0x7fdd7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:15.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.980+0000 7fdd8ffff700 1 --2- 172.21.15.6:0/383662339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdd7c066f30 0x7fdd7c0693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fdd80007fd0 tx=0x7fdd80007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:15.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:15.984+0000 7fdd77fff700 1 -- 172.21.15.6:0/383662339 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd88053ea0 con 0x7fdd90157480 2023-10-06T02:26:16.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.260+0000 7fdd964b4700 1 -- 172.21.15.6:0/383662339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fdd9015cc00 con 0x7fdd90157480 2023-10-06T02:26:16.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.916+0000 7fdd77fff700 1 -- 172.21.15.6:0/383662339 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v159) v1 ==== 101+0+0 (secure 0 0 0) 0x7fdd880574c0 con 0x7fdd90157480 2023-10-06T02:26:16.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.919+0000 7fdd964b4700 1 -- 172.21.15.6:0/383662339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdd7c066f30 msgr2=0x7fdd7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:16.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.919+0000 7fdd964b4700 1 --2- 172.21.15.6:0/383662339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdd7c066f30 0x7fdd7c0693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fdd80007fd0 tx=0x7fdd80007d30 comp rx=0 tx=0).stop 2023-10-06T02:26:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.919+0000 7fdd964b4700 1 -- 172.21.15.6:0/383662339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd90157480 msgr2=0x7fdd900af850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.919+0000 7fdd964b4700 1 --2- 172.21.15.6:0/383662339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd90157480 0x7fdd900af850 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fdd900ca0c0 tx=0x7fdd88019000 comp rx=0 tx=0).stop 2023-10-06T02:26:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.919+0000 7fdd964b4700 1 -- 172.21.15.6:0/383662339 shutdown_connections 2023-10-06T02:26:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.919+0000 7fdd964b4700 1 --2- 172.21.15.6:0/383662339 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdd7c066f30 0x7fdd7c0693e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.919+0000 7fdd964b4700 1 --2- 172.21.15.6:0/383662339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd90157480 0x7fdd900af850 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.919+0000 7fdd964b4700 1 --2- 172.21.15.6:0/383662339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd9006c210 0x7fdd90152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.919+0000 7fdd964b4700 1 --2- 172.21.15.6:0/383662339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd901570b0 0x7fdd900c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.919+0000 7fdd964b4700 1 -- 172.21.15.6:0/383662339 >> 172.21.15.6:0/383662339 conn(0x7fdd900c9cc0 msgr2=0x7fdd900adaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.919+0000 7fdd964b4700 1 -- 172.21.15.6:0/383662339 shutdown_connections 2023-10-06T02:26:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.919+0000 7fdd964b4700 1 -- 172.21.15.6:0/383662339 wait complete. 2023-10-06T02:26:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:26:16.933 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:26:16.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.972+0000 7faedc4e7000 1 Processor -- start 2023-10-06T02:26:16.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.972+0000 7faedc4e7000 1 -- start start 2023-10-06T02:26:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faedc4e7000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b87a982490 0x55b87a964820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faedc4e7000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b87a9f8a80 0x55b87aa1bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faedc4e7000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b87a9f8e50 0x55b87aa1c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faedc4e7000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87a883980 con 0x55b87a982490 2023-10-06T02:26:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faedc4e7000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87a883620 con 0x55b87a9f8e50 2023-10-06T02:26:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faedc4e7000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b87a87a400 con 0x55b87a9f8a80 2023-10-06T02:26:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faed5722700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b87a982490 0x55b87a964820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faed5722700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b87a982490 0x55b87a964820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60014/0 (socket says 172.21.15.6:60014) 2023-10-06T02:26:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faed5722700 1 -- 172.21.15.6:0/2201011695 learned_addr learned my addr 172.21.15.6:0/2201011695 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faed4f21700 1 --2- 172.21.15.6:0/2201011695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b87a9f8a80 0x55b87aa1bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faed5f23700 1 --2- 172.21.15.6:0/2201011695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b87a9f8e50 0x55b87aa1c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faed5722700 1 -- 172.21.15.6:0/2201011695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b87a9f8a80 msgr2=0x55b87aa1bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faed5722700 1 --2- 172.21.15.6:0/2201011695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b87a9f8a80 0x55b87aa1bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faed5722700 1 -- 172.21.15.6:0/2201011695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b87a9f8e50 msgr2=0x55b87aa1c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faed5722700 1 --2- 172.21.15.6:0/2201011695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b87a9f8e50 0x55b87aa1c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faed5722700 1 -- 172.21.15.6:0/2201011695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec8005cf0 con 0x55b87a982490 2023-10-06T02:26:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faed4f21700 1 --2- 172.21.15.6:0/2201011695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b87a9f8a80 0x55b87aa1bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faed5722700 1 --2- 172.21.15.6:0/2201011695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b87a982490 0x55b87a964820 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7faec8005a90 tx=0x7faec8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5945e73713875d11 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faec77fe700 1 -- 172.21.15.6:0/2201011695 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8000bc0 con 0x55b87a982490 2023-10-06T02:26:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faec77fe700 1 -- 172.21.15.6:0/2201011695 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec80089d0 con 0x55b87a982490 2023-10-06T02:26:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.973+0000 7faec77fe700 1 -- 172.21.15.6:0/2201011695 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8000d20 con 0x55b87a982490 2023-10-06T02:26:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.974+0000 7faedc4e7000 1 -- 172.21.15.6:0/2201011695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b87a982490 msgr2=0x55b87a964820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.974+0000 7faedc4e7000 1 --2- 172.21.15.6:0/2201011695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b87a982490 0x55b87a964820 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7faec8005a90 tx=0x7faec8016000 comp rx=0 tx=0).stop 2023-10-06T02:26:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.974+0000 7faedc4e7000 1 -- 172.21.15.6:0/2201011695 shutdown_connections 2023-10-06T02:26:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.974+0000 7faedc4e7000 1 --2- 172.21.15.6:0/2201011695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b87a9f8e50 0x55b87aa1c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:16.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.974+0000 7faedc4e7000 1 --2- 172.21.15.6:0/2201011695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b87a982490 0x55b87a964820 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:16.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.974+0000 7faedc4e7000 1 --2- 172.21.15.6:0/2201011695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b87a9f8a80 0x55b87aa1bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:16.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.974+0000 7faedc4e7000 1 -- 172.21.15.6:0/2201011695 >> 172.21.15.6:0/2201011695 conn(0x55b87a9395d0 msgr2=0x55b87a967380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:16.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.974+0000 7faedc4e7000 1 -- 172.21.15.6:0/2201011695 shutdown_connections 2023-10-06T02:26:16.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.974+0000 7faedc4e7000 1 -- 172.21.15.6:0/2201011695 wait complete. 2023-10-06T02:26:16.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.975+0000 7faedc4e7000 1 Processor -- start 2023-10-06T02:26:16.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.975+0000 7faedc4e7000 1 -- start start 2023-10-06T02:26:16.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.975+0000 7faedc4e7000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b87a982490 0x55b87a9673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:16.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.975+0000 7faedc4e7000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b87a9f8a80 0x55b87aa0eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:16.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.975+0000 7faedc4e7000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b87a9f8e50 0x55b87a9ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:16.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.975+0000 7faedc4e7000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87aa13e50 con 0x55b87a9f8a80 2023-10-06T02:26:16.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.975+0000 7faedc4e7000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87aa0dbc0 con 0x55b87a9f8e50 2023-10-06T02:26:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.975+0000 7faedc4e7000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b87aa0de60 con 0x55b87a982490 2023-10-06T02:26:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.976+0000 7faed4f21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b87a9f8a80 0x55b87aa0eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.976+0000 7faed4f21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b87a9f8a80 0x55b87aa0eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60028/0 (socket says 172.21.15.6:60028) 2023-10-06T02:26:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.976+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 learned_addr learned my addr 172.21.15.6:0/3530146719 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.976+0000 7faed5722700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b87a982490 0x55b87a9673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.976+0000 7faed5f23700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b87a9f8e50 0x55b87a9ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.976+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b87a982490 msgr2=0x55b87a9673b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.976+0000 7faed4f21700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b87a982490 0x55b87a9673b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.976+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b87a9f8e50 msgr2=0x55b87a9ef6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.976+0000 7faed4f21700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b87a9f8e50 0x55b87a9ef6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.976+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b87a8ac1c0 con 0x55b87a9f8a80 2023-10-06T02:26:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.976+0000 7faed5f23700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b87a9f8e50 0x55b87a9ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.976+0000 7faed4f21700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b87a9f8a80 0x55b87aa0eb90 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7faecc0068a0 tx=0x7faecc005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.976+0000 7faec5ffb700 1 -- 172.21.15.6:0/3530146719 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc012560 con 0x55b87a9f8a80 2023-10-06T02:26:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.976+0000 7faec5ffb700 1 -- 172.21.15.6:0/3530146719 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc00f040 con 0x55b87a9f8a80 2023-10-06T02:26:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.976+0000 7faec5ffb700 1 -- 172.21.15.6:0/3530146719 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc012910 con 0x55b87a9f8a80 2023-10-06T02:26:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.976+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b87a8923d0 con 0x55b87a9f8a80 2023-10-06T02:26:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.976+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b87a885ae0 con 0x55b87a9f8a80 2023-10-06T02:26:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.978+0000 7faec5ffb700 1 -- 172.21.15.6:0/3530146719 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faecc012cc0 con 0x55b87a9f8a80 2023-10-06T02:26:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.978+0000 7faec5ffb700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faeb80658c0 0x7faeb8067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.978+0000 7faec5ffb700 1 -- 172.21.15.6:0/3530146719 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7324+0+0 (secure 0 0 0) 0x7faecc083730 con 0x55b87a9f8a80 2023-10-06T02:26:16.983 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:26:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.978+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55b87aa0d6f0 0x55b87aa147e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.978+0000 7faed5722700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faeb80658c0 0x7faeb8067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.978+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa0f0d0 con 0x55b87aa0d6f0 2023-10-06T02:26:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.978+0000 7faed5f23700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55b87aa0d6f0 0x55b87aa147e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.979+0000 7faed5f23700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55b87aa0d6f0 0x55b87aa147e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.979+0000 7faed5722700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faeb80658c0 0x7faeb8067d70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7faec8005a90 tx=0x7faec801e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.980+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v106'319 uv293 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.980+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa14d20 con 0x55b87aa0d6f0 2023-10-06T02:26:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.981+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v106'320 uv320 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.981+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87a9efc20 con 0x55b87aa0d6f0 2023-10-06T02:26:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.983+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v106'321 uv321 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:16.985 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:26:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.983+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2d440 con 0x55b87aa0d6f0 2023-10-06T02:26:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.984+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v106'322 uv322 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.984+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2d7f0 con 0x55b87aa0d6f0 2023-10-06T02:26:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.985+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v106'323 uv323 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.985+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2c430 con 0x55b87aa0d6f0 2023-10-06T02:26:16.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.986+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v106'324 uv324 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:16.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.986+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2c860 con 0x55b87aa0d6f0 2023-10-06T02:26:16.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.988+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v106'325 uv299 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:16.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.988+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc90 con 0x55b87aa0d6f0 2023-10-06T02:26:16.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.989+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v106'326 uv326 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:16.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.989+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc90 con 0x55b87aa0d6f0 2023-10-06T02:26:16.993 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:26:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.990+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v106'327 uv327 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.990+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc40 con 0x55b87aa0d6f0 2023-10-06T02:26:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.991+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v106'328 uv328 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.991+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc40 con 0x55b87aa0d6f0 2023-10-06T02:26:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.992+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v106'329 uv329 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.992+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2d070 con 0x55b87aa0d6f0 2023-10-06T02:26:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.993+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v106'330 uv330 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.993+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2d070 con 0x55b87aa0d6f0 2023-10-06T02:26:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.994+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v106'331 uv306 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.994+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc40 con 0x55b87aa0d6f0 2023-10-06T02:26:16.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.995+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v106'332 uv332 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:16.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.995+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc40 con 0x55b87aa0d6f0 2023-10-06T02:26:16.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.996+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v106'333 uv333 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:16.998 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:26:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.996+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc40 con 0x55b87aa0d6f0 2023-10-06T02:26:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.997+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v106'334 uv334 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.997+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc40 con 0x55b87aa0d6f0 2023-10-06T02:26:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.998+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v106'335 uv335 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:16.998+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2d070 con 0x55b87aa0d6f0 2023-10-06T02:26:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.000+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v106'336 uv336 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.000+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc40 con 0x55b87aa0d6f0 2023-10-06T02:26:17.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.001+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v106'337 uv337 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:17.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.001+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc10 con 0x55b87aa0d6f0 2023-10-06T02:26:17.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.002+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v106'338 uv312 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:17.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.002+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc10 con 0x55b87aa0d6f0 2023-10-06T02:26:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.003+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v106'339 uv339 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.003+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc10 con 0x55b87aa0d6f0 2023-10-06T02:26:17.004 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:26:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.004+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v106'340 uv340 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.004+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc10 con 0x55b87aa0d6f0 2023-10-06T02:26:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.005+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v106'341 uv341 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.005+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc10 con 0x55b87aa0d6f0 2023-10-06T02:26:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.006+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v106'342 uv342 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.006+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc10 con 0x55b87aa0d6f0 2023-10-06T02:26:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.007+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v106'343 uv343 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.007+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc10 con 0x55b87aa0d6f0 2023-10-06T02:26:17.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.008+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v106'344 uv318 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:17.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.008+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc10 con 0x55b87aa0d6f0 2023-10-06T02:26:17.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.009+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v106'345 uv345 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:17.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.009+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc10 con 0x55b87aa0d6f0 2023-10-06T02:26:17.010 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:26:17.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.010+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v106'346 uv346 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:17.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.010+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc10 con 0x55b87aa0d6f0 2023-10-06T02:26:17.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.011+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v106'347 uv347 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:17.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.011+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc10 con 0x55b87aa0d6f0 2023-10-06T02:26:17.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.012+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v106'348 uv348 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:17.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.012+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc10 con 0x55b87aa0d6f0 2023-10-06T02:26:17.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.013+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v106'349 uv349 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa0d6f0 2023-10-06T02:26:17.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.014+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b87aa2e0b0 0x55b87aa30490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.014+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa2cc10 con 0x55b87aa2e0b0 2023-10-06T02:26:17.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.014+0000 7faed5722700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b87aa2e0b0 0x55b87aa30490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.014+0000 7faed5722700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b87aa2e0b0 0x55b87aa30490 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:17.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.015+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v106'237 uv219 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.015+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa309d0 con 0x55b87aa2e0b0 2023-10-06T02:26:17.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.017+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v106'238 uv238 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.017+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa30d80 con 0x55b87aa2e0b0 2023-10-06T02:26:17.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.018+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v106'239 uv239 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.018 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:26:17.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.018+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa31620 con 0x55b87aa2e0b0 2023-10-06T02:26:17.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.019+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v106'240 uv240 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.019+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa319d0 con 0x55b87aa2e0b0 2023-10-06T02:26:17.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.020+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v106'241 uv241 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.020+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa31d80 con 0x55b87aa2e0b0 2023-10-06T02:26:17.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.021+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v106'242 uv224 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.021+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa32130 con 0x55b87aa2e0b0 2023-10-06T02:26:17.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.022+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v106'243 uv243 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.022+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa32130 con 0x55b87aa2e0b0 2023-10-06T02:26:17.024 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:26:17.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.023+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v106'244 uv244 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.023+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa32130 con 0x55b87aa2e0b0 2023-10-06T02:26:17.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.025+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v106'245 uv245 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.025+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa32580 con 0x55b87aa2e0b0 2023-10-06T02:26:17.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.026+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v106'246 uv246 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.026+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa32580 con 0x55b87aa2e0b0 2023-10-06T02:26:17.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.027+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v106'247 uv229 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.027+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa32130 con 0x55b87aa2e0b0 2023-10-06T02:26:17.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.028+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v106'248 uv248 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.028+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa32130 con 0x55b87aa2e0b0 2023-10-06T02:26:17.029 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:26:17.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.029+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v106'249 uv249 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.029+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa32130 con 0x55b87aa2e0b0 2023-10-06T02:26:17.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.031+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v106'250 uv250 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.031+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa35ca0 con 0x55b87aa2e0b0 2023-10-06T02:26:17.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.032+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v106'251 uv251 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.032+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa32200 con 0x55b87aa2e0b0 2023-10-06T02:26:17.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.033+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v106'252 uv235 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.033+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa32200 con 0x55b87aa2e0b0 2023-10-06T02:26:17.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.034+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v106'253 uv253 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.034+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa32130 con 0x55b87aa2e0b0 2023-10-06T02:26:17.035 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:26:17.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.035+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v106'254 uv254 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.035+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa32130 con 0x55b87aa2e0b0 2023-10-06T02:26:17.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.036+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v106'255 uv255 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.036+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa32130 con 0x55b87aa2e0b0 2023-10-06T02:26:17.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.037+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v106'256 uv256 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.037+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa32130 con 0x55b87aa2e0b0 2023-10-06T02:26:17.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.038+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v106'257 uv257 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.038+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b87aa32a60 0x55b87aa34e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.038+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa35380 con 0x55b87aa32a60 2023-10-06T02:26:17.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.038+0000 7faed4f21700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b87aa32a60 0x55b87aa34e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.039+0000 7faed4f21700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b87aa32a60 0x55b87aa34e40 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:17.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.040+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v106'63 uv62 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.040+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa35730 con 0x55b87aa32a60 2023-10-06T02:26:17.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.041+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v106'64 uv64 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.041+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa35b20 con 0x55b87aa32a60 2023-10-06T02:26:17.042 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:26:17.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.042+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v106'65 uv65 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.042+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa31270 con 0x55b87aa32a60 2023-10-06T02:26:17.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.043+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v106'66 uv66 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.043+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa37580 con 0x55b87aa32a60 2023-10-06T02:26:17.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.044+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v106'67 uv67 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.044+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa36490 con 0x55b87aa32a60 2023-10-06T02:26:17.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.045+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v106'68 uv68 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.045+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa368b0 con 0x55b87aa32a60 2023-10-06T02:26:17.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.046+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v106'47 uv46 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.046+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa36ce0 con 0x55b87aa32a60 2023-10-06T02:26:17.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.047+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v106'48 uv48 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.048+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa36ce0 con 0x55b87aa32a60 2023-10-06T02:26:17.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.049+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v106'49 uv49 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.049 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:26:17.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.049+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa36c90 con 0x55b87aa32a60 2023-10-06T02:26:17.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.051+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v106'50 uv50 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.051+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa36c60 con 0x55b87aa2e0b0 2023-10-06T02:26:17.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.053+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v106'63 uv62 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.053+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa36c60 con 0x55b87aa2e0b0 2023-10-06T02:26:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.054+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v106'64 uv64 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.054+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa36c60 con 0x55b87aa2e0b0 2023-10-06T02:26:17.055 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:26:17.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.055+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v106'65 uv65 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.055+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa36c60 con 0x55b87aa2e0b0 2023-10-06T02:26:17.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.056+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v106'66 uv66 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.056+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa36c60 con 0x55b87aa2e0b0 2023-10-06T02:26:17.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.059+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v106'67 uv67 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.059+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa36c60 con 0x55b87aa2e0b0 2023-10-06T02:26:17.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.062+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v106'68 uv68 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa2e0b0 2023-10-06T02:26:17.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.062+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b87aa37eb0 0x55b87aa3a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.062+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa36c60 con 0x55b87aa37eb0 2023-10-06T02:26:17.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.062+0000 7faed5f23700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b87aa37eb0 0x55b87aa3a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.063+0000 7faed5f23700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b87aa37eb0 0x55b87aa3a290 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.064+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v106'116 uv110 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa37eb0 2023-10-06T02:26:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.064+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3a850 con 0x55b87aa37eb0 2023-10-06T02:26:17.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.065+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v106'117 uv117 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa37eb0 2023-10-06T02:26:17.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.065+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3a850 con 0x55b87aa37eb0 2023-10-06T02:26:17.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.066+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v106'118 uv118 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa37eb0 2023-10-06T02:26:17.066 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:26:17.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.066+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3b860 con 0x55b87aa37eb0 2023-10-06T02:26:17.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.067+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v106'119 uv119 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa37eb0 2023-10-06T02:26:17.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.067+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3b860 con 0x55b87aa37eb0 2023-10-06T02:26:17.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.068+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v106'120 uv120 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa37eb0 2023-10-06T02:26:17.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.068+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3a850 con 0x55b87aa37eb0 2023-10-06T02:26:17.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.069+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v106'121 uv121 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa37eb0 2023-10-06T02:26:17.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.069+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3a850 con 0x55b87aa37eb0 2023-10-06T02:26:17.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.070+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v106'122 uv115 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa37eb0 2023-10-06T02:26:17.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.071+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3a850 con 0x55b87aa37eb0 2023-10-06T02:26:17.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.072+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v106'123 uv123 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa37eb0 2023-10-06T02:26:17.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.072+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3a850 con 0x55b87aa37eb0 2023-10-06T02:26:17.073 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:26:17.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.073+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v106'124 uv124 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa37eb0 2023-10-06T02:26:17.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.073+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3a850 con 0x55b87aa37eb0 2023-10-06T02:26:17.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.074+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v106'125 uv125 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa37eb0 2023-10-06T02:26:17.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.074+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3a850 con 0x55b87aa37eb0 2023-10-06T02:26:17.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.075+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v106'126 uv126 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa37eb0 2023-10-06T02:26:17.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.076+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55b87aa3aed0 0x55b87aa3d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.076+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3d9e0 con 0x55b87aa3aed0 2023-10-06T02:26:17.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.076+0000 7faed5722700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55b87aa3aed0 0x55b87aa3d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.076+0000 7faed5722700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55b87aa3aed0 0x55b87aa3d2b0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:17.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.077+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v106'51 uv50 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa3aed0 2023-10-06T02:26:17.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.077+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3ddc0 con 0x55b87aa3aed0 2023-10-06T02:26:17.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.080+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v106'52 uv52 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa3aed0 2023-10-06T02:26:17.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.080+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3ddc0 con 0x55b87aa3aed0 2023-10-06T02:26:17.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.081+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v106'53 uv53 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa3aed0 2023-10-06T02:26:17.082 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:26:17.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.081+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3ddc0 con 0x55b87aa3aed0 2023-10-06T02:26:17.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.084+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v106'54 uv54 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa3aed0 2023-10-06T02:26:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.084+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3ddc0 con 0x55b87aa3aed0 2023-10-06T02:26:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.085+0000 7faed5722700 1 -- 172.21.15.6:0/3530146719 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v106'55 uv55 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7faec8026670 con 0x55b87aa3aed0 2023-10-06T02:26:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.085+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3ddc0 con 0x55b87aa32a60 2023-10-06T02:26:17.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.086+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v106'63 uv62 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.086+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3ddc0 con 0x55b87aa32a60 2023-10-06T02:26:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.089+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v106'64 uv64 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.089+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3ddc0 con 0x55b87aa32a60 2023-10-06T02:26:17.091 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:26:17.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.091+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v106'65 uv65 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.091+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3edd0 con 0x55b87aa32a60 2023-10-06T02:26:17.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.094+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v106'66 uv66 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.094+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3edd0 con 0x55b87aa32a60 2023-10-06T02:26:17.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.097+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v106'67 uv67 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.097+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa3ddc0 con 0x55b87aa32a60 2023-10-06T02:26:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.099+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v106'68 uv68 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.099+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b87aa3e440 0x55b87aa40820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.100+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa40e50 con 0x55b87aa3e440 2023-10-06T02:26:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.100+0000 7faed4f21700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b87aa3e440 0x55b87aa40820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.100+0000 7faed4f21700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b87aa3e440 0x55b87aa40820 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:17.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.101+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v106'104 uv97 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa3e440 2023-10-06T02:26:17.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.101+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41230 con 0x55b87aa3e440 2023-10-06T02:26:17.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.102+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v106'105 uv105 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa3e440 2023-10-06T02:26:17.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.102+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41230 con 0x55b87aa3e440 2023-10-06T02:26:17.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.103+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v106'106 uv106 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa3e440 2023-10-06T02:26:17.103 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:26:17.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.103+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41230 con 0x55b87aa3e440 2023-10-06T02:26:17.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.104+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v106'107 uv107 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa3e440 2023-10-06T02:26:17.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.104+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41230 con 0x55b87aa3e440 2023-10-06T02:26:17.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.105+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v106'108 uv108 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa3e440 2023-10-06T02:26:17.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.105+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41230 con 0x55b87aa3e440 2023-10-06T02:26:17.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.106+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v106'109 uv109 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa3e440 2023-10-06T02:26:17.106 INFO:teuthology.orchestra.run.smithi006.stdout:Write #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:26:17.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.106+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41230 con 0x55b87aa3e440 2023-10-06T02:26:17.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.107+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [omap-set-header] v106'110 uv110 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa3e440 2023-10-06T02:26:17.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.107+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa43fa0 con 0x55b87aa3e440 2023-10-06T02:26:17.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.108+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [omap-set-vals] v106'111 uv111 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa3e440 2023-10-06T02:26:17.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.108+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:99 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41720 con 0x55b87aa32a60 2023-10-06T02:26:17.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.109+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(99 mds0_sessionmap [create] v106'49 uv47 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.109+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:100 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41720 con 0x55b87aa32a60 2023-10-06T02:26:17.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.111+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(100 mds0_sessionmap [delete] v106'50 uv50 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.111+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41720 con 0x55b87aa32a60 2023-10-06T02:26:17.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.112+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(101 mds0_sessionmap [create] v106'51 uv51 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.113 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:26:17.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.112+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41720 con 0x55b87aa32a60 2023-10-06T02:26:17.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.113+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v106'52 uv52 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.113+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55b87aa42030 0x55b87aa446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.113+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:103 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41720 con 0x55b87aa42030 2023-10-06T02:26:17.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.114+0000 7faed5f23700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55b87aa42030 0x55b87aa446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.114+0000 7faed5f23700 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55b87aa42030 0x55b87aa446f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:17.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.115+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(103 609.00000000 [create] v106'63 uv62 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa42030 2023-10-06T02:26:17.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.115+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:104 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41720 con 0x55b87aa42030 2023-10-06T02:26:17.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.117+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(104 609.00000000 [delete] v106'64 uv64 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa42030 2023-10-06T02:26:17.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.117+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41720 con 0x55b87aa42030 2023-10-06T02:26:17.119 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:26:17.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.119+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(105 609.00000000 [create] v106'65 uv65 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa42030 2023-10-06T02:26:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.119+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41720 con 0x55b87aa42030 2023-10-06T02:26:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.121+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v106'66 uv66 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa42030 2023-10-06T02:26:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.121+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41720 con 0x55b87aa42030 2023-10-06T02:26:17.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.123+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v106'67 uv67 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa42030 2023-10-06T02:26:17.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.123+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41720 con 0x55b87aa42030 2023-10-06T02:26:17.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.125+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(108 609.00000000 [omap-set-header] v106'68 uv68 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa42030 2023-10-06T02:26:17.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.125+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:109 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41720 con 0x55b87aa37eb0 2023-10-06T02:26:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.126+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(109 400.00000000 [create] v106'52 uv51 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa37eb0 2023-10-06T02:26:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.126+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:110 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41720 con 0x55b87aa37eb0 2023-10-06T02:26:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.127+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(110 400.00000000 [delete] v106'53 uv53 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa37eb0 2023-10-06T02:26:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.127+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41720 con 0x55b87aa37eb0 2023-10-06T02:26:17.128 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:26:17.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.128+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(111 400.00000000 [create] v106'54 uv54 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa37eb0 2023-10-06T02:26:17.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.128+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41720 con 0x55b87aa37eb0 2023-10-06T02:26:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.129+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(112 400.00000000 [write 0~22] v106'55 uv55 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa37eb0 2023-10-06T02:26:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.129+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41720 con 0x55b87aa37eb0 2023-10-06T02:26:17.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.130+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(113 400.00000000 [omap-set-header] v106'56 uv56 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7faed0001630 con 0x55b87aa37eb0 2023-10-06T02:26:17.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.130+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:114 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa41720 con 0x55b87aa32a60 2023-10-06T02:26:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.131+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(114 100.00000000.inode [create] v106'132 uv123 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.131+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:115 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa416f0 con 0x55b87aa32a60 2023-10-06T02:26:17.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.132+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(115 100.00000000.inode [delete] v106'133 uv133 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.132+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa416f0 con 0x55b87aa32a60 2023-10-06T02:26:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.134+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(116 100.00000000.inode [create] v106'134 uv134 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.135 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:26:17.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.134+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa416f0 con 0x55b87aa32a60 2023-10-06T02:26:17.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.136+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(117 100.00000000.inode [write 0~554] v106'135 uv135 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.136+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa44ca0 con 0x55b87aa32a60 2023-10-06T02:26:17.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.140+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v106'136 uv136 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.140+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa44ca0 con 0x55b87aa32a60 2023-10-06T02:26:17.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.141+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(119 1.00000000 [create] v106'137 uv130 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.141+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa416f0 con 0x55b87aa32a60 2023-10-06T02:26:17.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.143+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(120 1.00000000 [delete] v106'138 uv138 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.143+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa416f0 con 0x55b87aa32a60 2023-10-06T02:26:17.148 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:26:17.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.147+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(121 1.00000000 [create] v106'139 uv139 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.147+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa416f0 con 0x55b87aa32a60 2023-10-06T02:26:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.148+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v106'140 uv140 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.148+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa416f0 con 0x55b87aa32a60 2023-10-06T02:26:17.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.150+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v106'141 uv141 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.150+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa44c30 con 0x55b87aa32a60 2023-10-06T02:26:17.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.152+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(124 1.00000000 [omap-set-header] v106'142 uv142 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.152+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b87aa44c30 con 0x55b87aa32a60 2023-10-06T02:26:17.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faed4f21700 1 -- 172.21.15.6:0/3530146719 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v106'143 uv143 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7faecc019020 con 0x55b87aa32a60 2023-10-06T02:26:17.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b87aa32a60 msgr2=0x55b87aa34e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b87aa32a60 0x55b87aa34e40 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55b87aa0d6f0 msgr2=0x55b87aa147e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55b87aa0d6f0 0x55b87aa147e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b87aa3e440 msgr2=0x55b87aa40820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b87aa3e440 0x55b87aa40820 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b87aa2e0b0 msgr2=0x55b87aa30490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b87aa2e0b0 0x55b87aa30490 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55b87aa42030 msgr2=0x55b87aa446f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55b87aa42030 0x55b87aa446f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55b87aa3aed0 msgr2=0x55b87aa3d2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55b87aa3aed0 0x55b87aa3d2b0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b87aa37eb0 msgr2=0x55b87aa3a290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b87aa37eb0 0x55b87aa3a290 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 reap_dead start 2023-10-06T02:26:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 reap_dead start 2023-10-06T02:26:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.153+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 reap_dead start 2023-10-06T02:26:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.154+0000 7faed5f23700 1 -- 172.21.15.6:0/3530146719 reap_dead start 2023-10-06T02:26:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.154+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faeb80658c0 msgr2=0x7faeb8067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.154+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faeb80658c0 0x7faeb8067d70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7faec8005a90 tx=0x7faec801e000 comp rx=0 tx=0).stop 2023-10-06T02:26:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.154+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b87a9f8a80 msgr2=0x55b87aa0eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.154+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b87a9f8a80 0x55b87aa0eb90 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7faecc0068a0 tx=0x7faecc005ce0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.154+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 shutdown_connections 2023-10-06T02:26:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.154+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b87a9f8a80 0x55b87aa0eb90 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.154+0000 7faedc4e7000 1 --2- 172.21.15.6:0/3530146719 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faeb80658c0 0x7faeb8067d70 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.154+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 >> 172.21.15.6:0/3530146719 conn(0x55b87a9395d0 msgr2=0x55b87a9263f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:17.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.154+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 shutdown_connections 2023-10-06T02:26:17.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.154+0000 7faedc4e7000 1 -- 172.21.15.6:0/3530146719 wait complete. 2023-10-06T02:26:17.158 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds0_sessionmap 2023-10-06T02:26:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.236+0000 7fdcab41c000 1 Processor -- start 2023-10-06T02:26:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.236+0000 7fdcab41c000 1 -- start start 2023-10-06T02:26:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.237+0000 7fdcab41c000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b610b1ae90 0x55b610bd65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.237+0000 7fdcab41c000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b610b464b0 0x55b610b61750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.237+0000 7fdcab41c000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b610bd7ce0 0x55b610b3a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.237+0000 7fdcab41c000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b610a62980 con 0x55b610bd7ce0 2023-10-06T02:26:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.237+0000 7fdcab41c000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b610a62620 con 0x55b610b464b0 2023-10-06T02:26:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.237+0000 7fdcab41c000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b610a59400 con 0x55b610b1ae90 2023-10-06T02:26:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.237+0000 7fdca4e58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b610bd7ce0 0x55b610b3a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.237+0000 7fdca4e58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b610bd7ce0 0x55b610b3a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60058/0 (socket says 172.21.15.6:60058) 2023-10-06T02:26:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.237+0000 7fdca4e58700 1 -- 172.21.15.6:0/1188783332 learned_addr learned my addr 172.21.15.6:0/1188783332 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.237+0000 7fdca4657700 1 --2- 172.21.15.6:0/1188783332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b610b1ae90 0x55b610bd65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.237+0000 7fdca3e56700 1 --2- 172.21.15.6:0/1188783332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b610b464b0 0x55b610b61750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.237+0000 7fdca4e58700 1 -- 172.21.15.6:0/1188783332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b610b1ae90 msgr2=0x55b610bd65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.237+0000 7fdca4e58700 1 --2- 172.21.15.6:0/1188783332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b610b1ae90 0x55b610bd65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.237+0000 7fdca4e58700 1 -- 172.21.15.6:0/1188783332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b610b464b0 msgr2=0x55b610b61750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.237+0000 7fdca4e58700 1 --2- 172.21.15.6:0/1188783332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b610b464b0 0x55b610b61750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.237+0000 7fdca4e58700 1 -- 172.21.15.6:0/1188783332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c005cf0 con 0x55b610bd7ce0 2023-10-06T02:26:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.237+0000 7fdca4657700 1 --2- 172.21.15.6:0/1188783332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b610b1ae90 0x55b610bd65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.238+0000 7fdca4e58700 1 --2- 172.21.15.6:0/1188783332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b610bd7ce0 0x55b610b3a9c0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400c520 tx=0x7fdc94007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab7d3806a60a0f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.238+0000 7fdca2e54700 1 -- 172.21.15.6:0/1188783332 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc940115f0 con 0x55b610bd7ce0 2023-10-06T02:26:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.238+0000 7fdca2e54700 1 -- 172.21.15.6:0/1188783332 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc94011750 con 0x55b610bd7ce0 2023-10-06T02:26:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.238+0000 7fdca2e54700 1 -- 172.21.15.6:0/1188783332 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94011b10 con 0x55b610bd7ce0 2023-10-06T02:26:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.238+0000 7fdcab41c000 1 -- 172.21.15.6:0/1188783332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b610bd7ce0 msgr2=0x55b610b3a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.238+0000 7fdcab41c000 1 --2- 172.21.15.6:0/1188783332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b610bd7ce0 0x55b610b3a9c0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400c520 tx=0x7fdc94007040 comp rx=0 tx=0).stop 2023-10-06T02:26:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.238+0000 7fdcab41c000 1 -- 172.21.15.6:0/1188783332 shutdown_connections 2023-10-06T02:26:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.238+0000 7fdcab41c000 1 --2- 172.21.15.6:0/1188783332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b610bd7ce0 0x55b610b3a9c0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.238+0000 7fdcab41c000 1 --2- 172.21.15.6:0/1188783332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b610b1ae90 0x55b610bd65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.238+0000 7fdcab41c000 1 --2- 172.21.15.6:0/1188783332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b610b464b0 0x55b610b61750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.238+0000 7fdcab41c000 1 -- 172.21.15.6:0/1188783332 >> 172.21.15.6:0/1188783332 conn(0x55b610b166c0 msgr2=0x55b610bf1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.238+0000 7fdcab41c000 1 -- 172.21.15.6:0/1188783332 shutdown_connections 2023-10-06T02:26:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.238+0000 7fdcab41c000 1 -- 172.21.15.6:0/1188783332 wait complete. 2023-10-06T02:26:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.239+0000 7fdcab41c000 1 Processor -- start 2023-10-06T02:26:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.239+0000 7fdcab41c000 1 -- start start 2023-10-06T02:26:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdcab41c000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b610b1ae90 0x55b610bd4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdcab41c000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b610b464b0 0x55b610bf0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdcab41c000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b610bd7ce0 0x55b610bbb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdcab41c000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b610bd6820 con 0x55b610bd7ce0 2023-10-06T02:26:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdcab41c000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b610bd0eb0 con 0x55b610b1ae90 2023-10-06T02:26:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdcab41c000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b610bd3910 con 0x55b610b464b0 2023-10-06T02:26:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdca4e58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b610bd7ce0 0x55b610bbb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdca4e58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b610bd7ce0 0x55b610bbb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60062/0 (socket says 172.21.15.6:60062) 2023-10-06T02:26:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdca4e58700 1 -- 172.21.15.6:0/2854283208 learned_addr learned my addr 172.21.15.6:0/2854283208 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdca3e56700 1 --2- 172.21.15.6:0/2854283208 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b610b464b0 0x55b610bf0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdca4657700 1 --2- 172.21.15.6:0/2854283208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b610b1ae90 0x55b610bd4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdca4e58700 1 -- 172.21.15.6:0/2854283208 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b610b464b0 msgr2=0x55b610bf0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdca4e58700 1 --2- 172.21.15.6:0/2854283208 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b610b464b0 0x55b610bf0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdca4e58700 1 -- 172.21.15.6:0/2854283208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b610b1ae90 msgr2=0x55b610bd4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdca4e58700 1 --2- 172.21.15.6:0/2854283208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b610b1ae90 0x55b610bd4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdca4e58700 1 -- 172.21.15.6:0/2854283208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9400d040 con 0x55b610bd7ce0 2023-10-06T02:26:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdca4e58700 1 --2- 172.21.15.6:0/2854283208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b610bd7ce0 0x55b610bbb1b0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fdc94005ca0 tx=0x7fdc94019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdca1651700 1 -- 172.21.15.6:0/2854283208 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9400cea0 con 0x55b610bd7ce0 2023-10-06T02:26:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdca1651700 1 -- 172.21.15.6:0/2854283208 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc940118c0 con 0x55b610bd7ce0 2023-10-06T02:26:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdca1651700 1 -- 172.21.15.6:0/2854283208 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9401d410 con 0x55b610bd7ce0 2023-10-06T02:26:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.240+0000 7fdcab41c000 1 -- 172.21.15.6:0/2854283208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b610a713d0 con 0x55b610bd7ce0 2023-10-06T02:26:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.241+0000 7fdcab41c000 1 -- 172.21.15.6:0/2854283208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b610a64ae0 con 0x55b610bd7ce0 2023-10-06T02:26:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.242+0000 7fdca1651700 1 -- 172.21.15.6:0/2854283208 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc94003040 con 0x55b610bd7ce0 2023-10-06T02:26:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.242+0000 7fdca1651700 1 --2- 172.21.15.6:0/2854283208 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc84065890 0x7fdc84067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.242+0000 7fdca1651700 1 -- 172.21.15.6:0/2854283208 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7324+0+0 (secure 0 0 0) 0x7fdc94085600 con 0x55b610bd7ce0 2023-10-06T02:26:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.242+0000 7fdca4657700 1 --2- 172.21.15.6:0/2854283208 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc84065890 0x7fdc84067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.242+0000 7fdcab41c000 1 --2- 172.21.15.6:0/2854283208 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b610bf1510 0x55b610c02a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.242+0000 7fdcab41c000 1 -- 172.21.15.6:0/2854283208 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106) v8 -- 0x55b610bd5f10 con 0x55b610bf1510 2023-10-06T02:26:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.243+0000 7fdca3e56700 1 --2- 172.21.15.6:0/2854283208 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b610bf1510 0x55b610c02a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.243+0000 7fdca3e56700 1 --2- 172.21.15.6:0/2854283208 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b610bf1510 0x55b610c02a30 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.243+0000 7fdca4657700 1 --2- 172.21.15.6:0/2854283208 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc84065890 0x7fdc84067d40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c000c00 tx=0x7fdc9c006a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.244+0000 7fdca3e56700 1 -- 172.21.15.6:0/2854283208 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 mds0_sessionmap [delete] v106'53 uv53 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fdc8c008970 con 0x55b610bf1510 2023-10-06T02:26:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.244+0000 7fdcab41c000 1 -- 172.21.15.6:0/2854283208 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b610bf1510 msgr2=0x55b610c02a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.244+0000 7fdcab41c000 1 --2- 172.21.15.6:0/2854283208 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b610bf1510 0x55b610c02a30 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.244+0000 7fdcab41c000 1 -- 172.21.15.6:0/2854283208 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc84065890 msgr2=0x7fdc84067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.244+0000 7fdcab41c000 1 --2- 172.21.15.6:0/2854283208 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc84065890 0x7fdc84067d40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c000c00 tx=0x7fdc9c006a10 comp rx=0 tx=0).stop 2023-10-06T02:26:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.244+0000 7fdcab41c000 1 -- 172.21.15.6:0/2854283208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b610bd7ce0 msgr2=0x55b610bbb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.244+0000 7fdcab41c000 1 --2- 172.21.15.6:0/2854283208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b610bd7ce0 0x55b610bbb1b0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fdc94005ca0 tx=0x7fdc94019000 comp rx=0 tx=0).stop 2023-10-06T02:26:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.244+0000 7fdca4e58700 1 -- 172.21.15.6:0/2854283208 reap_dead start 2023-10-06T02:26:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.244+0000 7fdcab41c000 1 -- 172.21.15.6:0/2854283208 shutdown_connections 2023-10-06T02:26:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.244+0000 7fdcab41c000 1 -- 172.21.15.6:0/2854283208 >> 172.21.15.6:0/2854283208 conn(0x55b610b166c0 msgr2=0x55b610b60b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.244+0000 7fdcab41c000 1 -- 172.21.15.6:0/2854283208 shutdown_connections 2023-10-06T02:26:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.244+0000 7fdcab41c000 1 -- 172.21.15.6:0/2854283208 wait complete. 2023-10-06T02:26:17.252 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:26:17.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.412+0000 7fd7bd9ae700 1 Processor -- start 2023-10-06T02:26:17.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.412+0000 7fd7bd9ae700 1 -- start start 2023-10-06T02:26:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.413+0000 7fd7bd9ae700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd7b80b28c0 0x7fd7b8087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.413+0000 7fd7bd9ae700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b80afc50 con 0x7fd7b815a030 2023-10-06T02:26:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.413+0000 7fd7bd9ae700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b80aff30 con 0x7fd7b8086ff0 2023-10-06T02:26:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.413+0000 7fd7bd9ae700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b80b0cf0 con 0x7fd7b80b28c0 2023-10-06T02:26:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.413+0000 7fd7b6ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd7b815a030 0x7fd7b815a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37438/0 (socket says 172.21.15.6:37438) 2023-10-06T02:26:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.413+0000 7fd7b6ffd700 1 -- 172.21.15.6:0/886874379 learned_addr learned my addr 172.21.15.6:0/886874379 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.413+0000 7fd7b5ffb700 1 -- 172.21.15.6:0/886874379 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384648688 0 0) 0x7fd7b80afc50 con 0x7fd7b815a030 2023-10-06T02:26:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.413+0000 7fd7b77fe700 1 --2- 172.21.15.6:0/886874379 >> v2:172.21.15.175:3300/0 conn(0x7fd7b80b28c0 0x7fd7b8087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.413+0000 7fd7b5ffb700 1 -- 172.21.15.6:0/886874379 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7a4003570 con 0x7fd7b815a030 2023-10-06T02:26:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.413+0000 7fd7b5ffb700 1 -- 172.21.15.6:0/886874379 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1983582955 0 0) 0x7fd7a4003570 con 0x7fd7b815a030 2023-10-06T02:26:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.413+0000 7fd7b5ffb700 1 -- 172.21.15.6:0/886874379 >> v2:172.21.15.175:3300/0 conn(0x7fd7b80b28c0 msgr2=0x7fd7b8087470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.413+0000 7fd7b5ffb700 1 --2- 172.21.15.6:0/886874379 >> v2:172.21.15.175:3300/0 conn(0x7fd7b80b28c0 0x7fd7b8087470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.413+0000 7fd7b5ffb700 1 -- 172.21.15.6:0/886874379 >> v1:172.21.15.175:6789/0 conn(0x7fd7b8086ff0 legacy=0x7fd7b80b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.413+0000 7fd7b5ffb700 1 -- 172.21.15.6:0/886874379 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b80b0210 con 0x7fd7b815a030 2023-10-06T02:26:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.413+0000 7fd7b5ffb700 1 -- 172.21.15.6:0/886874379 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fd7a80017f0 con 0x7fd7b815a030 2023-10-06T02:26:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.413+0000 7fd7b5ffb700 1 -- 172.21.15.6:0/886874379 >> v1:172.21.15.6:6789/0 conn(0x7fd7b815a030 legacy=0x7fd7b815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b5ffb700 1 --2- 172.21.15.6:0/886874379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a4003a60 0x7fd7a4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b5ffb700 1 --2- 172.21.15.6:0/886874379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a4004810 0x7fd7a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b5ffb700 1 --2- 172.21.15.6:0/886874379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7a40051c0 0x7fd7a400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b5ffb700 1 -- 172.21.15.6:0/886874379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b80b0cf0 con 0x7fd7a40051c0 2023-10-06T02:26:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b5ffb700 1 -- 172.21.15.6:0/886874379 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a400c0d0 con 0x7fd7a4003a60 2023-10-06T02:26:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b5ffb700 1 -- 172.21.15.6:0/886874379 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a400c290 con 0x7fd7a4004810 2023-10-06T02:26:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b6ffd700 1 --2- 172.21.15.6:0/886874379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a4003a60 0x7fd7a4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b77fe700 1 --2- 172.21.15.6:0/886874379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7a40051c0 0x7fd7a400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b67fc700 1 --2- 172.21.15.6:0/886874379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a4004810 0x7fd7a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b77fe700 1 -- 172.21.15.6:0/886874379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a4004810 msgr2=0x7fd7a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b77fe700 1 --2- 172.21.15.6:0/886874379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a4004810 0x7fd7a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b77fe700 1 -- 172.21.15.6:0/886874379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a4003a60 msgr2=0x7fd7a4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b77fe700 1 --2- 172.21.15.6:0/886874379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a4003a60 0x7fd7a4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b77fe700 1 -- 172.21.15.6:0/886874379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a4003570 con 0x7fd7a40051c0 2023-10-06T02:26:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b6ffd700 1 --2- 172.21.15.6:0/886874379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a4003a60 0x7fd7a4003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:26:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b77fe700 1 -- 172.21.15.6:0/886874379 reap_dead start 2023-10-06T02:26:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b77fe700 1 --2- 172.21.15.6:0/886874379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7a40051c0 0x7fd7a400ba60 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009c00 tx=0x7fd7b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912bb9305669b9f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b5ffb700 1 -- 172.21.15.6:0/886874379 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b000e710 con 0x7fd7a40051c0 2023-10-06T02:26:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b5ffb700 1 -- 172.21.15.6:0/886874379 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b000e890 con 0x7fd7a40051c0 2023-10-06T02:26:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.414+0000 7fd7b5ffb700 1 -- 172.21.15.6:0/886874379 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b000ec50 con 0x7fd7a40051c0 2023-10-06T02:26:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.415+0000 7fd7bd9ae700 1 -- 172.21.15.6:0/886874379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7a40051c0 msgr2=0x7fd7a400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.415+0000 7fd7bd9ae700 1 --2- 172.21.15.6:0/886874379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7a40051c0 0x7fd7a400ba60 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009c00 tx=0x7fd7b00091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.415+0000 7fd7bd9ae700 1 -- 172.21.15.6:0/886874379 shutdown_connections 2023-10-06T02:26:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.415+0000 7fd7bd9ae700 1 --2- 172.21.15.6:0/886874379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7a40051c0 0x7fd7a400ba60 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.415+0000 7fd7bd9ae700 1 -- 172.21.15.6:0/886874379 >> 172.21.15.6:0/886874379 conn(0x7fd7b8068680 msgr2=0x7fd7b8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.415+0000 7fd7bd9ae700 1 -- 172.21.15.6:0/886874379 shutdown_connections 2023-10-06T02:26:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.415+0000 7fd7bd9ae700 1 -- 172.21.15.6:0/886874379 wait complete. 2023-10-06T02:26:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.416+0000 7fd7bd9ae700 1 Processor -- start 2023-10-06T02:26:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.416+0000 7fd7bd9ae700 1 -- start start 2023-10-06T02:26:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.417+0000 7fd7bd9ae700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a40051c0 0x7fd7b80c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.417+0000 7fd7bd9ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b815a5d0 0x7fd7b816a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.417+0000 7fd7bd9ae700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7b815c380 0x7fd7b815c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.417+0000 7fd7bd9ae700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b815cd60 con 0x7fd7b815a5d0 2023-10-06T02:26:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.417+0000 7fd7bd9ae700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b80c5b20 con 0x7fd7a40051c0 2023-10-06T02:26:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.417+0000 7fd7bd9ae700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b816aca0 con 0x7fd7b815c380 2023-10-06T02:26:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.417+0000 7fd7b67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b815a5d0 0x7fd7b816a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.417+0000 7fd7b67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b815a5d0 0x7fd7b816a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60084/0 (socket says 172.21.15.6:60084) 2023-10-06T02:26:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.417+0000 7fd7b67fc700 1 -- 172.21.15.6:0/1243729051 learned_addr learned my addr 172.21.15.6:0/1243729051 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.417+0000 7fd7b77fe700 1 --2- 172.21.15.6:0/1243729051 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7b815c380 0x7fd7b815c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.417+0000 7fd7b6ffd700 1 --2- 172.21.15.6:0/1243729051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a40051c0 0x7fd7b80c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.417+0000 7fd7b67fc700 1 -- 172.21.15.6:0/1243729051 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7b815c380 msgr2=0x7fd7b815c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.417+0000 7fd7b67fc700 1 --2- 172.21.15.6:0/1243729051 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7b815c380 0x7fd7b815c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.417+0000 7fd7b67fc700 1 -- 172.21.15.6:0/1243729051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a40051c0 msgr2=0x7fd7b80c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.417+0000 7fd7b67fc700 1 --2- 172.21.15.6:0/1243729051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a40051c0 0x7fd7b80c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.417+0000 7fd7b67fc700 1 -- 172.21.15.6:0/1243729051 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b815ab90 con 0x7fd7b815a5d0 2023-10-06T02:26:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.417+0000 7fd7b67fc700 1 --2- 172.21.15.6:0/1243729051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b815a5d0 0x7fd7b816a760 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0002950 tx=0x7fd7a0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.418+0000 7fd7aeffd700 1 -- 172.21.15.6:0/1243729051 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0003390 con 0x7fd7b815a5d0 2023-10-06T02:26:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.418+0000 7fd7aeffd700 1 -- 172.21.15.6:0/1243729051 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a0013600 con 0x7fd7b815a5d0 2023-10-06T02:26:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.418+0000 7fd7bd9ae700 1 -- 172.21.15.6:0/1243729051 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b815b000 con 0x7fd7b815a5d0 2023-10-06T02:26:17.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.418+0000 7fd7aeffd700 1 -- 172.21.15.6:0/1243729051 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a00139a0 con 0x7fd7b815a5d0 2023-10-06T02:26:17.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.418+0000 7fd7bd9ae700 1 -- 172.21.15.6:0/1243729051 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b815b5c0 con 0x7fd7b815a5d0 2023-10-06T02:26:17.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.419+0000 7fd7bd9ae700 1 -- 172.21.15.6:0/1243729051 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b815bc10 con 0x7fd7b815a5d0 2023-10-06T02:26:17.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.419+0000 7fd7aeffd700 1 -- 172.21.15.6:0/1243729051 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd7a0013d10 con 0x7fd7b815a5d0 2023-10-06T02:26:17.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.419+0000 7fd7aeffd700 1 --2- 172.21.15.6:0/1243729051 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd798066f30 0x7fd7980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.420+0000 7fd7aeffd700 1 -- 172.21.15.6:0/1243729051 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7324+0+0 (secure 0 0 0) 0x7fd7a0084d70 con 0x7fd7b815a5d0 2023-10-06T02:26:17.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.420+0000 7fd7b6ffd700 1 --2- 172.21.15.6:0/1243729051 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd798066f30 0x7fd7980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.420+0000 7fd7b6ffd700 1 --2- 172.21.15.6:0/1243729051 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd798066f30 0x7fd7980693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8001350 tx=0x7fd7a8006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:17.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.424+0000 7fd7aeffd700 1 -- 172.21.15.6:0/1243729051 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7a0055420 con 0x7fd7b815a5d0 2023-10-06T02:26:17.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.663+0000 7fd7bd9ae700 1 -- 172.21.15.6:0/1243729051 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fd7b80b04f0 con 0x7fd7b815a5d0 2023-10-06T02:26:17.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.917+0000 7fd7aeffd700 1 -- 172.21.15.6:0/1243729051 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v160) v1 ==== 162+0+0 (secure 0 0 0) 0x7fd7a0054fb0 con 0x7fd7b815a5d0 2023-10-06T02:26:17.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.920+0000 7fd7bd9ae700 1 -- 172.21.15.6:0/1243729051 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd798066f30 msgr2=0x7fd7980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.920+0000 7fd7bd9ae700 1 --2- 172.21.15.6:0/1243729051 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd798066f30 0x7fd7980693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8001350 tx=0x7fd7a8006040 comp rx=0 tx=0).stop 2023-10-06T02:26:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.920+0000 7fd7bd9ae700 1 -- 172.21.15.6:0/1243729051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b815a5d0 msgr2=0x7fd7b816a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.920+0000 7fd7bd9ae700 1 --2- 172.21.15.6:0/1243729051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b815a5d0 0x7fd7b816a760 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0002950 tx=0x7fd7a0007d30 comp rx=0 tx=0).stop 2023-10-06T02:26:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.920+0000 7fd7bd9ae700 1 -- 172.21.15.6:0/1243729051 shutdown_connections 2023-10-06T02:26:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.920+0000 7fd7bd9ae700 1 --2- 172.21.15.6:0/1243729051 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7b815c380 0x7fd7b815c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.920+0000 7fd7bd9ae700 1 --2- 172.21.15.6:0/1243729051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a40051c0 0x7fd7b80c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.920+0000 7fd7bd9ae700 1 --2- 172.21.15.6:0/1243729051 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd798066f30 0x7fd7980693e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.920+0000 7fd7bd9ae700 1 --2- 172.21.15.6:0/1243729051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b815a5d0 0x7fd7b816a760 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.920+0000 7fd7bd9ae700 1 -- 172.21.15.6:0/1243729051 >> 172.21.15.6:0/1243729051 conn(0x7fd7b8068680 msgr2=0x7fd7b80b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.920+0000 7fd7bd9ae700 1 -- 172.21.15.6:0/1243729051 shutdown_connections 2023-10-06T02:26:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:17.920+0000 7fd7bd9ae700 1 -- 172.21.15.6:0/1243729051 wait complete. 2023-10-06T02:26:17.922 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:26:17.922 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:26:17.922+0000 7f12df246700 -1 mds.0.sessionmap _load_finish got (2) No such file or directory 2023-10-06T02:26:17.922 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:26:17.922+0000 7f12df246700 -1 log_channel(cluster) log [ERR] : error reading sessionmap 'mds0_sessionmap' -2 ((2) No such file or directory) 2023-10-06T02:26:17.923 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:26:17.923+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:26:17.923 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:26:17.923+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:26:17.929 INFO:tasks.ceph.mds.a.smithi006.stderr: -32> 2023-10-06T02:26:17.922+0000 7f12df246700 -1 mds.0.sessionmap _load_finish got (2) No such file or directory 2023-10-06T02:26:17.929 INFO:tasks.ceph.mds.a.smithi006.stderr: -31> 2023-10-06T02:26:17.922+0000 7f12df246700 -1 log_channel(cluster) log [ERR] : error reading sessionmap 'mds0_sessionmap' -2 ((2) No such file or directory) 2023-10-06T02:26:17.936 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:17.952 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:26:18.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.055+0000 7fe297bb2700 1 Processor -- start 2023-10-06T02:26:18.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.056+0000 7fe297bb2700 1 -- start start 2023-10-06T02:26:18.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.056+0000 7fe297bb2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe290142de0 0x7fe2900ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.056+0000 7fe297bb2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2900d0950 0x7fe2900b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.056+0000 7fe297bb2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2900cf8a0 con 0x7fe2900cd270 2023-10-06T02:26:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.056+0000 7fe297bb2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2900cec90 con 0x7fe290142de0 2023-10-06T02:26:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.056+0000 7fe297bb2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900cef70 con 0x7fe2900d0950 2023-10-06T02:26:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.057+0000 7fe29594e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe290142de0 0x7fe2900ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.057+0000 7fe29614f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2900d0950 0x7fe2900b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.057+0000 7fe29594e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe290142de0 0x7fe2900ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:34116/0 (socket says 172.21.15.6:34116) 2023-10-06T02:26:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.057+0000 7fe29594e700 1 -- 172.21.15.6:0/37794237 learned_addr learned my addr 172.21.15.6:0/37794237 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.057+0000 7fe29514d700 1 --1- 172.21.15.6:0/37794237 >> v1:172.21.15.175:6789/0 conn(0x7fe2900cd270 0x7fe2900d0240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:58070/0 (socket says 172.21.15.6:58070) 2023-10-06T02:26:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.057+0000 7fe29594e700 1 -- 172.21.15.6:0/37794237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2900d0950 msgr2=0x7fe2900b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.057+0000 7fe29594e700 1 --2- 172.21.15.6:0/37794237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2900d0950 0x7fe2900b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.057+0000 7fe29594e700 1 -- 172.21.15.6:0/37794237 >> v1:172.21.15.175:6789/0 conn(0x7fe2900cd270 legacy=0x7fe2900d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.057+0000 7fe29594e700 1 -- 172.21.15.6:0/37794237 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2900cf250 con 0x7fe290142de0 2023-10-06T02:26:18.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.057+0000 7fe29494c700 1 -- 172.21.15.6:0/37794237 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756243699 0 0) 0x7fe2900cf8a0 con 0x7fe2900cd270 2023-10-06T02:26:18.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.057+0000 7fe29594e700 1 --2- 172.21.15.6:0/37794237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe290142de0 0x7fe2900ccd30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe280009f20 tx=0x7fe280009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9985353d0ac203a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.057+0000 7fe29494c700 1 -- 172.21.15.6:0/37794237 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28000e070 con 0x7fe290142de0 2023-10-06T02:26:18.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.058+0000 7fe29494c700 1 -- 172.21.15.6:0/37794237 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28000b9d0 con 0x7fe290142de0 2023-10-06T02:26:18.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.058+0000 7fe29494c700 1 -- 172.21.15.6:0/37794237 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2800092e0 con 0x7fe290142de0 2023-10-06T02:26:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.058+0000 7fe297bb2700 1 -- 172.21.15.6:0/37794237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe290142de0 msgr2=0x7fe2900ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.058+0000 7fe297bb2700 1 --2- 172.21.15.6:0/37794237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe290142de0 0x7fe2900ccd30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe280009f20 tx=0x7fe280009840 comp rx=0 tx=0).stop 2023-10-06T02:26:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.058+0000 7fe297bb2700 1 -- 172.21.15.6:0/37794237 shutdown_connections 2023-10-06T02:26:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.058+0000 7fe297bb2700 1 --2- 172.21.15.6:0/37794237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2900d0950 0x7fe2900b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.058+0000 7fe297bb2700 1 --2- 172.21.15.6:0/37794237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe290142de0 0x7fe2900ccd30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.058+0000 7fe297bb2700 1 -- 172.21.15.6:0/37794237 >> 172.21.15.6:0/37794237 conn(0x7fe290069110 msgr2=0x7fe29006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.058+0000 7fe297bb2700 1 -- 172.21.15.6:0/37794237 shutdown_connections 2023-10-06T02:26:18.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.058+0000 7fe297bb2700 1 -- 172.21.15.6:0/37794237 wait complete. 2023-10-06T02:26:18.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.059+0000 7fe297bb2700 1 Processor -- start 2023-10-06T02:26:18.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.059+0000 7fe297bb2700 1 -- start start 2023-10-06T02:26:18.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.060+0000 7fe297bb2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2900cd270 0x7fe29013d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.060+0000 7fe297bb2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2900d0950 0x7fe2900b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.060+0000 7fe297bb2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe290142de0 0x7fe2900b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.060+0000 7fe297bb2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2901584e0 con 0x7fe2900d0950 2023-10-06T02:26:18.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.060+0000 7fe297bb2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe290157680 con 0x7fe2900cd270 2023-10-06T02:26:18.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.060+0000 7fe297bb2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29013da60 con 0x7fe290142de0 2023-10-06T02:26:18.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.060+0000 7fe29514d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2900d0950 0x7fe2900b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.060+0000 7fe29514d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2900d0950 0x7fe2900b0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60120/0 (socket says 172.21.15.6:60120) 2023-10-06T02:26:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.060+0000 7fe29514d700 1 -- 172.21.15.6:0/149136791 learned_addr learned my addr 172.21.15.6:0/149136791 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.060+0000 7fe29614f700 1 --2- 172.21.15.6:0/149136791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe290142de0 0x7fe2900b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.060+0000 7fe29594e700 1 --2- 172.21.15.6:0/149136791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2900cd270 0x7fe29013d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.060+0000 7fe29514d700 1 -- 172.21.15.6:0/149136791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe290142de0 msgr2=0x7fe2900b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.060+0000 7fe29514d700 1 --2- 172.21.15.6:0/149136791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe290142de0 0x7fe2900b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.060+0000 7fe29514d700 1 -- 172.21.15.6:0/149136791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2900cd270 msgr2=0x7fe29013d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.060+0000 7fe29514d700 1 --2- 172.21.15.6:0/149136791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2900cd270 0x7fe29013d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.060+0000 7fe29514d700 1 -- 172.21.15.6:0/149136791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe280009ae0 con 0x7fe2900d0950 2023-10-06T02:26:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.061+0000 7fe29514d700 1 --2- 172.21.15.6:0/149136791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2900d0950 0x7fe2900b0e70 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fe2840011e0 tx=0x7fe284007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.061+0000 7fe28dffb700 1 -- 172.21.15.6:0/149136791 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284005a70 con 0x7fe2900d0950 2023-10-06T02:26:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.061+0000 7fe28dffb700 1 -- 172.21.15.6:0/149136791 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe284005bd0 con 0x7fe2900d0950 2023-10-06T02:26:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.061+0000 7fe297bb2700 1 -- 172.21.15.6:0/149136791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2901578d0 con 0x7fe2900d0950 2023-10-06T02:26:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.061+0000 7fe28dffb700 1 -- 172.21.15.6:0/149136791 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2840070d0 con 0x7fe2900d0950 2023-10-06T02:26:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.061+0000 7fe297bb2700 1 -- 172.21.15.6:0/149136791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe290157e90 con 0x7fe2900d0950 2023-10-06T02:26:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.062+0000 7fe297bb2700 1 -- 172.21.15.6:0/149136791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2900b2d00 con 0x7fe2900d0950 2023-10-06T02:26:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.062+0000 7fe28dffb700 1 -- 172.21.15.6:0/149136791 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe284007480 con 0x7fe2900d0950 2023-10-06T02:26:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.062+0000 7fe28dffb700 1 --2- 172.21.15.6:0/149136791 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe27c066f30 0x7fe27c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.063+0000 7fe28dffb700 1 -- 172.21.15.6:0/149136791 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7410+0+0 (secure 0 0 0) 0x7fe284084090 con 0x7fe2900d0950 2023-10-06T02:26:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.063+0000 7fe29594e700 1 --2- 172.21.15.6:0/149136791 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe27c066f30 0x7fe27c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.063+0000 7fe29594e700 1 --2- 172.21.15.6:0/149136791 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe27c066f30 0x7fe27c0693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe280009880 tx=0x7fe280018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.067+0000 7fe28dffb700 1 -- 172.21.15.6:0/149136791 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe284050c50 con 0x7fe2900d0950 2023-10-06T02:26:18.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.305+0000 7fe297bb2700 1 -- 172.21.15.6:0/149136791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe290088ac0 con 0x7fe2900d0950 2023-10-06T02:26:18.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.306+0000 7fe28dffb700 1 -- 172.21.15.6:0/149136791 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 162 v162) v1 ==== 95+0+3840 (secure 0 0 0) 0x7fe284017020 con 0x7fe2900d0950 2023-10-06T02:26:18.307 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:18.307 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":162,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":162,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:17.923573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:18.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.307+0000 7fe297bb2700 1 -- 172.21.15.6:0/149136791 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe27c066f30 msgr2=0x7fe27c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.307+0000 7fe297bb2700 1 --2- 172.21.15.6:0/149136791 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe27c066f30 0x7fe27c0693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe280009880 tx=0x7fe280018000 comp rx=0 tx=0).stop 2023-10-06T02:26:18.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.307+0000 7fe297bb2700 1 -- 172.21.15.6:0/149136791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2900d0950 msgr2=0x7fe2900b0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.307+0000 7fe297bb2700 1 --2- 172.21.15.6:0/149136791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2900d0950 0x7fe2900b0e70 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fe2840011e0 tx=0x7fe284007e10 comp rx=0 tx=0).stop 2023-10-06T02:26:18.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.307+0000 7fe297bb2700 1 -- 172.21.15.6:0/149136791 shutdown_connections 2023-10-06T02:26:18.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.307+0000 7fe297bb2700 1 --2- 172.21.15.6:0/149136791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe290142de0 0x7fe2900b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.308+0000 7fe297bb2700 1 --2- 172.21.15.6:0/149136791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2900cd270 0x7fe29013d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.308+0000 7fe297bb2700 1 --2- 172.21.15.6:0/149136791 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe27c066f30 0x7fe27c0693e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.308+0000 7fe297bb2700 1 --2- 172.21.15.6:0/149136791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2900d0950 0x7fe2900b0e70 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.308+0000 7fe297bb2700 1 -- 172.21.15.6:0/149136791 >> 172.21.15.6:0/149136791 conn(0x7fe290069110 msgr2=0x7fe29013fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.308+0000 7fe297bb2700 1 -- 172.21.15.6:0/149136791 shutdown_connections 2023-10-06T02:26:18.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.308+0000 7fe297bb2700 1 -- 172.21.15.6:0/149136791 wait complete. 2023-10-06T02:26:18.310 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 162 2023-10-06T02:26:18.320 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:26:18.320 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:18.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.479+0000 7fb4d26c6700 1 Processor -- start 2023-10-06T02:26:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.479+0000 7fb4d26c6700 1 -- start start 2023-10-06T02:26:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.480+0000 7fb4d26c6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4cc0cf1a0 0x7fb4cc0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.480+0000 7fb4d26c6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb4cc1597d0 0x7fb4cc0d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.480+0000 7fb4d26c6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4cc0b3560 con 0x7fb4cc159400 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.480+0000 7fb4d26c6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4cc0cf6f0 con 0x7fb4cc1597d0 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.480+0000 7fb4d26c6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc0cf9d0 con 0x7fb4cc0cf1a0 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.480+0000 7fb4d1ec5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb4cc1597d0 0x7fb4cc0d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.480+0000 7fb4d0ec3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4cc0cf1a0 0x7fb4cc0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.480+0000 7fb4d1ec5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb4cc1597d0 0x7fb4cc0d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:34132/0 (socket says 172.21.15.6:34132) 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.480+0000 7fb4d1ec5700 1 -- 172.21.15.6:0/1019097883 learned_addr learned my addr 172.21.15.6:0/1019097883 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.480+0000 7fb4d0ec3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4cc0cf1a0 0x7fb4cc0cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:40680/0 (socket says 172.21.15.6:40680) 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.480+0000 7fb4d16c4700 1 --1- 172.21.15.6:0/1019097883 >> v1:172.21.15.175:6789/0 conn(0x7fb4cc159400 0x7fb4cc0ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:58082/0 (socket says 172.21.15.6:58082) 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.481+0000 7fb4d1ec5700 1 -- 172.21.15.6:0/1019097883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4cc0cf1a0 msgr2=0x7fb4cc0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.481+0000 7fb4d1ec5700 1 --2- 172.21.15.6:0/1019097883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4cc0cf1a0 0x7fb4cc0cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.481+0000 7fb4d1ec5700 1 -- 172.21.15.6:0/1019097883 >> v1:172.21.15.175:6789/0 conn(0x7fb4cc159400 legacy=0x7fb4cc0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.481+0000 7fb4d1ec5700 1 -- 172.21.15.6:0/1019097883 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4cc0b2f10 con 0x7fb4cc1597d0 2023-10-06T02:26:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.481+0000 7fb4d1ec5700 1 --2- 172.21.15.6:0/1019097883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4cc1597d0 0x7fb4cc0d0400 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4009f20 tx=0x7fb4c4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a10a9596f7a0c59 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.481+0000 7fb4c3fff700 1 -- 172.21.15.6:0/1019097883 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c400e070 con 0x7fb4cc1597d0 2023-10-06T02:26:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.481+0000 7fb4c3fff700 1 -- 172.21.15.6:0/1019097883 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c400b9d0 con 0x7fb4cc1597d0 2023-10-06T02:26:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.481+0000 7fb4c3fff700 1 -- 172.21.15.6:0/1019097883 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c40092e0 con 0x7fb4cc1597d0 2023-10-06T02:26:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.481+0000 7fb4d26c6700 1 -- 172.21.15.6:0/1019097883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4cc1597d0 msgr2=0x7fb4cc0d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.481+0000 7fb4d26c6700 1 --2- 172.21.15.6:0/1019097883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4cc1597d0 0x7fb4cc0d0400 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4009f20 tx=0x7fb4c4009840 comp rx=0 tx=0).stop 2023-10-06T02:26:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.481+0000 7fb4d26c6700 1 -- 172.21.15.6:0/1019097883 shutdown_connections 2023-10-06T02:26:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.481+0000 7fb4d26c6700 1 --2- 172.21.15.6:0/1019097883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4cc1597d0 0x7fb4cc0d0400 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.481+0000 7fb4d26c6700 1 --2- 172.21.15.6:0/1019097883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4cc0cf1a0 0x7fb4cc0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.481+0000 7fb4d26c6700 1 -- 172.21.15.6:0/1019097883 >> 172.21.15.6:0/1019097883 conn(0x7fb4cc06ac10 msgr2=0x7fb4cc068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.482+0000 7fb4d26c6700 1 -- 172.21.15.6:0/1019097883 shutdown_connections 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.482+0000 7fb4d26c6700 1 -- 172.21.15.6:0/1019097883 wait complete. 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.483+0000 7fb4d26c6700 1 Processor -- start 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.483+0000 7fb4d26c6700 1 -- start start 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.483+0000 7fb4d26c6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4cc0cf1a0 0x7fb4cc16b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.483+0000 7fb4d26c6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4cc159400 0x7fb4cc0c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.483+0000 7fb4d26c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc1597d0 0x7fb4cc16a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.483+0000 7fb4d26c6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc0c9260 con 0x7fb4cc1597d0 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.483+0000 7fb4d26c6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc0ca660 con 0x7fb4cc159400 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.483+0000 7fb4d26c6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc0cac00 con 0x7fb4cc0cf1a0 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.484+0000 7fb4d1ec5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc1597d0 0x7fb4cc16a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.484+0000 7fb4d1ec5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc1597d0 0x7fb4cc16a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60126/0 (socket says 172.21.15.6:60126) 2023-10-06T02:26:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.484+0000 7fb4d1ec5700 1 -- 172.21.15.6:0/3678565569 learned_addr learned my addr 172.21.15.6:0/3678565569 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.484+0000 7fb4d0ec3700 1 --2- 172.21.15.6:0/3678565569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4cc159400 0x7fb4cc0c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.484+0000 7fb4d16c4700 1 --2- 172.21.15.6:0/3678565569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4cc0cf1a0 0x7fb4cc16b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.484+0000 7fb4d1ec5700 1 -- 172.21.15.6:0/3678565569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4cc0cf1a0 msgr2=0x7fb4cc16b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.484+0000 7fb4d1ec5700 1 --2- 172.21.15.6:0/3678565569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4cc0cf1a0 0x7fb4cc16b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.484+0000 7fb4d1ec5700 1 -- 172.21.15.6:0/3678565569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4cc159400 msgr2=0x7fb4cc0c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.484+0000 7fb4d1ec5700 1 --2- 172.21.15.6:0/3678565569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4cc159400 0x7fb4cc0c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.484+0000 7fb4d1ec5700 1 -- 172.21.15.6:0/3678565569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c4009ae0 con 0x7fb4cc1597d0 2023-10-06T02:26:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.484+0000 7fb4d0ec3700 1 --2- 172.21.15.6:0/3678565569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4cc159400 0x7fb4cc0c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.484+0000 7fb4d1ec5700 1 --2- 172.21.15.6:0/3678565569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc1597d0 0x7fb4cc16a1d0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0b2b80 tx=0x7fb4c4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.484+0000 7fb4c17fa700 1 -- 172.21.15.6:0/3678565569 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4008c30 con 0x7fb4cc1597d0 2023-10-06T02:26:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.484+0000 7fb4c17fa700 1 -- 172.21.15.6:0/3678565569 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c4008d90 con 0x7fb4cc1597d0 2023-10-06T02:26:18.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.484+0000 7fb4d26c6700 1 -- 172.21.15.6:0/3678565569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4cc16b170 con 0x7fb4cc1597d0 2023-10-06T02:26:18.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.484+0000 7fb4c17fa700 1 -- 172.21.15.6:0/3678565569 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c401c660 con 0x7fb4cc1597d0 2023-10-06T02:26:18.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.484+0000 7fb4d26c6700 1 -- 172.21.15.6:0/3678565569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4cc16ac60 con 0x7fb4cc1597d0 2023-10-06T02:26:18.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.485+0000 7fb4d26c6700 1 -- 172.21.15.6:0/3678565569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4cc158ae0 con 0x7fb4cc1597d0 2023-10-06T02:26:18.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.486+0000 7fb4c17fa700 1 -- 172.21.15.6:0/3678565569 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4c4003040 con 0x7fb4cc1597d0 2023-10-06T02:26:18.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.486+0000 7fb4c17fa700 1 --2- 172.21.15.6:0/3678565569 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4b0066f30 0x7fb4b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.486+0000 7fb4c17fa700 1 -- 172.21.15.6:0/3678565569 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7410+0+0 (secure 0 0 0) 0x7fb4c4086400 con 0x7fb4cc1597d0 2023-10-06T02:26:18.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.487+0000 7fb4d16c4700 1 --2- 172.21.15.6:0/3678565569 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4b0066f30 0x7fb4b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.487+0000 7fb4d16c4700 1 --2- 172.21.15.6:0/3678565569 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4b0066f30 0x7fb4b00693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0c7790 tx=0x7fb4c8007d20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.491+0000 7fb4c17fa700 1 -- 172.21.15.6:0/3678565569 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4c4052fc0 con 0x7fb4cc1597d0 2023-10-06T02:26:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.728+0000 7fb4d26c6700 1 -- 172.21.15.6:0/3678565569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4cc0b31f0 con 0x7fb4cc1597d0 2023-10-06T02:26:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.729+0000 7fb4c17fa700 1 -- 172.21.15.6:0/3678565569 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 162 v162) v1 ==== 95+0+3840 (secure 0 0 0) 0x7fb4c40565e0 con 0x7fb4cc1597d0 2023-10-06T02:26:18.729 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:18.730 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":162,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":162,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:17.923573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.731+0000 7fb4d26c6700 1 -- 172.21.15.6:0/3678565569 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4b0066f30 msgr2=0x7fb4b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.731+0000 7fb4d26c6700 1 --2- 172.21.15.6:0/3678565569 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4b0066f30 0x7fb4b00693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0c7790 tx=0x7fb4c8007d20 comp rx=0 tx=0).stop 2023-10-06T02:26:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.731+0000 7fb4d26c6700 1 -- 172.21.15.6:0/3678565569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc1597d0 msgr2=0x7fb4cc16a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.731+0000 7fb4d26c6700 1 --2- 172.21.15.6:0/3678565569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc1597d0 0x7fb4cc16a1d0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0b2b80 tx=0x7fb4c4018000 comp rx=0 tx=0).stop 2023-10-06T02:26:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.731+0000 7fb4d26c6700 1 -- 172.21.15.6:0/3678565569 shutdown_connections 2023-10-06T02:26:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.731+0000 7fb4d26c6700 1 --2- 172.21.15.6:0/3678565569 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4b0066f30 0x7fb4b00693e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.731+0000 7fb4d26c6700 1 --2- 172.21.15.6:0/3678565569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc1597d0 0x7fb4cc16a1d0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.731+0000 7fb4d26c6700 1 --2- 172.21.15.6:0/3678565569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4cc0cf1a0 0x7fb4cc16b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.731+0000 7fb4d26c6700 1 --2- 172.21.15.6:0/3678565569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4cc159400 0x7fb4cc0c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.731+0000 7fb4d26c6700 1 -- 172.21.15.6:0/3678565569 >> 172.21.15.6:0/3678565569 conn(0x7fb4cc06ac10 msgr2=0x7fb4cc157c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.731+0000 7fb4d26c6700 1 -- 172.21.15.6:0/3678565569 shutdown_connections 2023-10-06T02:26:18.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.731+0000 7fb4d26c6700 1 -- 172.21.15.6:0/3678565569 wait complete. 2023-10-06T02:26:18.733 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 162 2023-10-06T02:26:18.744 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:26:18.744 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:18.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.862+0000 7fbeff904700 1 Processor -- start 2023-10-06T02:26:18.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.862+0000 7fbeff904700 1 -- start start 2023-10-06T02:26:18.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbeff904700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbef8159150 0x7fbef815de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbeff904700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbef80b08f0 0x7fbef8159520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbeff904700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef80afbc0 con 0x7fbef80cccf0 2023-10-06T02:26:18.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbeff904700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef8159a60 con 0x7fbef8159150 2023-10-06T02:26:18.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbeff904700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80cd620 con 0x7fbef80b08f0 2023-10-06T02:26:18.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbefdea1700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbef80cccf0 0x7fbef80b20a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43236/0 (socket says 172.21.15.6:43236) 2023-10-06T02:26:18.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbefdea1700 1 -- 172.21.15.6:0/2894672929 learned_addr learned my addr 172.21.15.6:0/2894672929 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:18.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbef7fff700 1 -- 172.21.15.6:0/2894672929 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831359807 0 0) 0x7fbef80afbc0 con 0x7fbef80cccf0 2023-10-06T02:26:18.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbefce9f700 1 --2- 172.21.15.6:0/2894672929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbef80b08f0 0x7fbef8159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbefd6a0700 1 --2- 172.21.15.6:0/2894672929 >> v2:172.21.15.175:3300/0 conn(0x7fbef8159150 0x7fbef815de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbef7fff700 1 -- 172.21.15.6:0/2894672929 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbee0003570 con 0x7fbef80cccf0 2023-10-06T02:26:18.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbef7fff700 1 -- 172.21.15.6:0/2894672929 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 585208015 0 0) 0x7fbee0003570 con 0x7fbef80cccf0 2023-10-06T02:26:18.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbef7fff700 1 -- 172.21.15.6:0/2894672929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbef80b08f0 msgr2=0x7fbef8159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbef7fff700 1 --2- 172.21.15.6:0/2894672929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbef80b08f0 0x7fbef8159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbef7fff700 1 -- 172.21.15.6:0/2894672929 >> v2:172.21.15.175:3300/0 conn(0x7fbef8159150 msgr2=0x7fbef815de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbef7fff700 1 --2- 172.21.15.6:0/2894672929 >> v2:172.21.15.175:3300/0 conn(0x7fbef8159150 0x7fbef815de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbef7fff700 1 -- 172.21.15.6:0/2894672929 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef80afe10 con 0x7fbef80cccf0 2023-10-06T02:26:18.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbef7fff700 1 -- 172.21.15.6:0/2894672929 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fbee80017f0 con 0x7fbef80cccf0 2023-10-06T02:26:18.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbef7fff700 1 -- 172.21.15.6:0/2894672929 >> v1:172.21.15.6:6789/0 conn(0x7fbef80cccf0 legacy=0x7fbef80b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.863+0000 7fbef7fff700 1 --2- 172.21.15.6:0/2894672929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbef80b08f0 0x7fbee0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbef7fff700 1 --2- 172.21.15.6:0/2894672929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbee0003fe0 0x7fbee0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbef7fff700 1 --2- 172.21.15.6:0/2894672929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbee0004d50 0x7fbee00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbef7fff700 1 -- 172.21.15.6:0/2894672929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8159a60 con 0x7fbee0003fe0 2023-10-06T02:26:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbef7fff700 1 -- 172.21.15.6:0/2894672929 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80cd620 con 0x7fbee0004d50 2023-10-06T02:26:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbef7fff700 1 -- 172.21.15.6:0/2894672929 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee000ba90 con 0x7fbef80b08f0 2023-10-06T02:26:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbefce9f700 1 --2- 172.21.15.6:0/2894672929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbee0003fe0 0x7fbee0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbefd6a0700 1 --2- 172.21.15.6:0/2894672929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbef80b08f0 0x7fbee0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbefdea1700 1 --2- 172.21.15.6:0/2894672929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbee0004d50 0x7fbee00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbefce9f700 1 -- 172.21.15.6:0/2894672929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbef80b08f0 msgr2=0x7fbee0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbefce9f700 1 --2- 172.21.15.6:0/2894672929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbef80b08f0 0x7fbee0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbefce9f700 1 -- 172.21.15.6:0/2894672929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbee0004d50 msgr2=0x7fbee00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbefce9f700 1 --2- 172.21.15.6:0/2894672929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbee0004d50 0x7fbee00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbefce9f700 1 -- 172.21.15.6:0/2894672929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee0003570 con 0x7fbee0003fe0 2023-10-06T02:26:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbefdea1700 1 --2- 172.21.15.6:0/2894672929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbee0004d50 0x7fbee00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbefce9f700 1 --2- 172.21.15.6:0/2894672929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbee0003fe0 0x7fbee0004810 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fbeec009c00 tx=0x7fbeec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50780954af7b0e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbef7fff700 1 -- 172.21.15.6:0/2894672929 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec00e6b0 con 0x7fbee0003fe0 2023-10-06T02:26:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbef7fff700 1 -- 172.21.15.6:0/2894672929 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec00e810 con 0x7fbee0003fe0 2023-10-06T02:26:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.864+0000 7fbef7fff700 1 -- 172.21.15.6:0/2894672929 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec00ebd0 con 0x7fbee0003fe0 2023-10-06T02:26:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.865+0000 7fbeff904700 1 -- 172.21.15.6:0/2894672929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbee0003fe0 msgr2=0x7fbee0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.865+0000 7fbeff904700 1 --2- 172.21.15.6:0/2894672929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbee0003fe0 0x7fbee0004810 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fbeec009c00 tx=0x7fbeec0091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.865+0000 7fbefdea1700 1 -- 172.21.15.6:0/2894672929 reap_dead start 2023-10-06T02:26:18.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.865+0000 7fbeff904700 1 -- 172.21.15.6:0/2894672929 shutdown_connections 2023-10-06T02:26:18.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.865+0000 7fbeff904700 1 -- 172.21.15.6:0/2894672929 >> 172.21.15.6:0/2894672929 conn(0x7fbef8068680 msgr2=0x7fbef8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.865+0000 7fbeff904700 1 -- 172.21.15.6:0/2894672929 shutdown_connections 2023-10-06T02:26:18.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.865+0000 7fbeff904700 1 -- 172.21.15.6:0/2894672929 wait complete. 2023-10-06T02:26:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.866+0000 7fbeff904700 1 Processor -- start 2023-10-06T02:26:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.866+0000 7fbeff904700 1 -- start start 2023-10-06T02:26:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbeff904700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbee0003fe0 0x7fbef8156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbeff904700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbef80c7300 0x7fbef80c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbeff904700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbef80ceeb0 0x7fbef80cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbeff904700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80cf860 con 0x7fbee0003fe0 2023-10-06T02:26:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbeff904700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80c89d0 con 0x7fbef80ceeb0 2023-10-06T02:26:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbeff904700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80c7dc0 con 0x7fbef80c7300 2023-10-06T02:26:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbefd6a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbee0003fe0 0x7fbef8156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbefd6a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbee0003fe0 0x7fbef8156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43302/0 (socket says 172.21.15.6:43302) 2023-10-06T02:26:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbefd6a0700 1 -- 172.21.15.6:0/3982781163 learned_addr learned my addr 172.21.15.6:0/3982781163 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbefce9f700 1 --2- 172.21.15.6:0/3982781163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbef80c7300 0x7fbef80c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbefdea1700 1 --2- 172.21.15.6:0/3982781163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbef80ceeb0 0x7fbef80cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbefd6a0700 1 -- 172.21.15.6:0/3982781163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbef80c7300 msgr2=0x7fbef80c7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbefd6a0700 1 --2- 172.21.15.6:0/3982781163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbef80c7300 0x7fbef80c7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbefd6a0700 1 -- 172.21.15.6:0/3982781163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbef80ceeb0 msgr2=0x7fbef80cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbefd6a0700 1 --2- 172.21.15.6:0/3982781163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbef80ceeb0 0x7fbef80cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbefd6a0700 1 -- 172.21.15.6:0/3982781163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef80c80a0 con 0x7fbee0003fe0 2023-10-06T02:26:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbefce9f700 1 --2- 172.21.15.6:0/3982781163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbef80c7300 0x7fbef80c7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbefdea1700 1 --2- 172.21.15.6:0/3982781163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbef80ceeb0 0x7fbef80cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.867+0000 7fbefd6a0700 1 --2- 172.21.15.6:0/3982781163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbee0003fe0 0x7fbef8156990 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fbef0011d40 tx=0x7fbef00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.868+0000 7fbef57fa700 1 -- 172.21.15.6:0/3982781163 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef000fac0 con 0x7fbee0003fe0 2023-10-06T02:26:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.868+0000 7fbef57fa700 1 -- 172.21.15.6:0/3982781163 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef000fc20 con 0x7fbee0003fe0 2023-10-06T02:26:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.868+0000 7fbeff904700 1 -- 172.21.15.6:0/3982781163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef80c8380 con 0x7fbee0003fe0 2023-10-06T02:26:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.868+0000 7fbef57fa700 1 -- 172.21.15.6:0/3982781163 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0014440 con 0x7fbee0003fe0 2023-10-06T02:26:18.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.868+0000 7fbeff904700 1 -- 172.21.15.6:0/3982781163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef8156ed0 con 0x7fbee0003fe0 2023-10-06T02:26:18.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.869+0000 7fbeff904700 1 -- 172.21.15.6:0/3982781163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef8088aa0 con 0x7fbee0003fe0 2023-10-06T02:26:18.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.869+0000 7fbef57fa700 1 -- 172.21.15.6:0/3982781163 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbef0014a80 con 0x7fbee0003fe0 2023-10-06T02:26:18.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.869+0000 7fbef57fa700 1 --2- 172.21.15.6:0/3982781163 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbee4066f30 0x7fbee40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.870+0000 7fbef57fa700 1 -- 172.21.15.6:0/3982781163 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7410+0+0 (secure 0 0 0) 0x7fbef0018030 con 0x7fbee0003fe0 2023-10-06T02:26:18.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.870+0000 7fbefce9f700 1 --2- 172.21.15.6:0/3982781163 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbee4066f30 0x7fbee40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.870+0000 7fbefce9f700 1 --2- 172.21.15.6:0/3982781163 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbee4066f30 0x7fbee40693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fbeec0091e0 tx=0x7fbeec01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:18.874+0000 7fbef57fa700 1 -- 172.21.15.6:0/3982781163 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbef0052520 con 0x7fbee0003fe0 2023-10-06T02:26:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.111+0000 7fbeff904700 1 -- 172.21.15.6:0/3982781163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbef815b100 con 0x7fbee0003fe0 2023-10-06T02:26:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.112+0000 7fbef57fa700 1 -- 172.21.15.6:0/3982781163 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 163 v163) v1 ==== 95+0+4595 (secure 0 0 0) 0x7fbef005b070 con 0x7fbee0003fe0 2023-10-06T02:26:19.112 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:19.113 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":163,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3081379602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3081379602},{"type":"v1","addr":"172.21.15.6:6835","nonce":3081379602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":163}],"filesystems":[{"mdsmap":{"epoch":162,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:17.923573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:19.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.114+0000 7fbeff904700 1 -- 172.21.15.6:0/3982781163 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbee4066f30 msgr2=0x7fbee40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.114+0000 7fbeff904700 1 --2- 172.21.15.6:0/3982781163 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbee4066f30 0x7fbee40693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fbeec0091e0 tx=0x7fbeec01a000 comp rx=0 tx=0).stop 2023-10-06T02:26:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.114+0000 7fbeff904700 1 -- 172.21.15.6:0/3982781163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbee0003fe0 msgr2=0x7fbef8156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.114+0000 7fbeff904700 1 --2- 172.21.15.6:0/3982781163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbee0003fe0 0x7fbef8156990 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fbef0011d40 tx=0x7fbef00091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.114+0000 7fbeff904700 1 -- 172.21.15.6:0/3982781163 shutdown_connections 2023-10-06T02:26:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.114+0000 7fbeff904700 1 --2- 172.21.15.6:0/3982781163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbef80ceeb0 0x7fbef80cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.114+0000 7fbeff904700 1 --2- 172.21.15.6:0/3982781163 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbee4066f30 0x7fbee40693e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.114+0000 7fbeff904700 1 --2- 172.21.15.6:0/3982781163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbee0003fe0 0x7fbef8156990 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.114+0000 7fbeff904700 1 --2- 172.21.15.6:0/3982781163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbef80c7300 0x7fbef80c7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.114+0000 7fbeff904700 1 -- 172.21.15.6:0/3982781163 >> 172.21.15.6:0/3982781163 conn(0x7fbef8068680 msgr2=0x7fbef81581e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.114+0000 7fbeff904700 1 -- 172.21.15.6:0/3982781163 shutdown_connections 2023-10-06T02:26:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.114+0000 7fbeff904700 1 -- 172.21.15.6:0/3982781163 wait complete. 2023-10-06T02:26:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 163 2023-10-06T02:26:19.126 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete mds0_sessionmap' led to DAMAGED state 2023-10-06T02:26:19.126 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 400.00000000' 2023-10-06T02:26:19.126 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:19.127 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:26:19.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:19.127 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:26:19.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:26:19.142 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:26:19.142 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:26:19.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.301+0000 7f4ee8eb4700 1 Processor -- start 2023-10-06T02:26:19.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.302+0000 7f4ee8eb4700 1 -- start start 2023-10-06T02:26:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.302+0000 7f4ee8eb4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ee406bbb0 0x7f4ee41565f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.302+0000 7f4ee8eb4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee40c90d0 con 0x7f4ee406b7e0 2023-10-06T02:26:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.302+0000 7f4ee8eb4700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee40c7c60 con 0x7f4ee4156b30 2023-10-06T02:26:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.302+0000 7f4ee8eb4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee41576c0 con 0x7f4ee406bbb0 2023-10-06T02:26:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.303+0000 7f4ee259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4ee406b7e0 0x7f4ee40cac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43242/0 (socket says 172.21.15.6:43242) 2023-10-06T02:26:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.303+0000 7f4ee259c700 1 -- 172.21.15.6:0/3579935667 learned_addr learned my addr 172.21.15.6:0/3579935667 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.303+0000 7f4ee1d9b700 1 --2- 172.21.15.6:0/3579935667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ee406bbb0 0x7f4ee41565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.303+0000 7f4ee159a700 1 -- 172.21.15.6:0/3579935667 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205596912 0 0) 0x7f4ee40c90d0 con 0x7f4ee406b7e0 2023-10-06T02:26:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.303+0000 7f4ee159a700 1 -- 172.21.15.6:0/3579935667 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ed0003570 con 0x7f4ee406b7e0 2023-10-06T02:26:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.303+0000 7f4ee159a700 1 -- 172.21.15.6:0/3579935667 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456550805 0 0) 0x7f4ee40c7c60 con 0x7f4ee4156b30 2023-10-06T02:26:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.303+0000 7f4ee159a700 1 -- 172.21.15.6:0/3579935667 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ee40c90d0 con 0x7f4ee4156b30 2023-10-06T02:26:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.303+0000 7f4ee1d9b700 1 -- 172.21.15.6:0/3579935667 >> v1:172.21.15.175:6789/0 conn(0x7f4ee4156b30 legacy=0x7f4ee4156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.303+0000 7f4ee1d9b700 1 -- 172.21.15.6:0/3579935667 >> v1:172.21.15.6:6789/0 conn(0x7f4ee406b7e0 legacy=0x7f4ee40cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.303+0000 7f4ee1d9b700 1 -- 172.21.15.6:0/3579935667 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee40c7980 con 0x7f4ee406bbb0 2023-10-06T02:26:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.303+0000 7f4ee1d9b700 1 --2- 172.21.15.6:0/3579935667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ee406bbb0 0x7f4ee41565f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009940 tx=0x7f4ecc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d055a3220b44985 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.304+0000 7f4ee159a700 1 -- 172.21.15.6:0/3579935667 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc011630 con 0x7f4ee406bbb0 2023-10-06T02:26:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.304+0000 7f4ee159a700 1 -- 172.21.15.6:0/3579935667 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc011790 con 0x7f4ee406bbb0 2023-10-06T02:26:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.304+0000 7f4ee159a700 1 -- 172.21.15.6:0/3579935667 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc011b30 con 0x7f4ee406bbb0 2023-10-06T02:26:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.304+0000 7f4ee8eb4700 1 -- 172.21.15.6:0/3579935667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ee406bbb0 msgr2=0x7f4ee41565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.304+0000 7f4ee8eb4700 1 --2- 172.21.15.6:0/3579935667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ee406bbb0 0x7f4ee41565f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009940 tx=0x7f4ecc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.304+0000 7f4ee8eb4700 1 -- 172.21.15.6:0/3579935667 shutdown_connections 2023-10-06T02:26:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.304+0000 7f4ee8eb4700 1 --2- 172.21.15.6:0/3579935667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ee406bbb0 0x7f4ee41565f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.304+0000 7f4ee8eb4700 1 -- 172.21.15.6:0/3579935667 >> 172.21.15.6:0/3579935667 conn(0x7f4ee406a260 msgr2=0x7f4ee40cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.304+0000 7f4ee8eb4700 1 -- 172.21.15.6:0/3579935667 shutdown_connections 2023-10-06T02:26:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.304+0000 7f4ee8eb4700 1 -- 172.21.15.6:0/3579935667 wait complete. 2023-10-06T02:26:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.305+0000 7f4ee8eb4700 1 Processor -- start 2023-10-06T02:26:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.305+0000 7f4ee8eb4700 1 -- start start 2023-10-06T02:26:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee8eb4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ee406b7e0 0x7f4ee4169750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee8eb4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ee406bbb0 0x7f4ee415beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee8eb4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ee4156b30 0x7f4ee415c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee8eb4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee415c930 con 0x7f4ee4156b30 2023-10-06T02:26:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee8eb4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee40c2c90 con 0x7f4ee406b7e0 2023-10-06T02:26:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee8eb4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee40c2f70 con 0x7f4ee406bbb0 2023-10-06T02:26:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ee4156b30 0x7f4ee415c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ee4156b30 0x7f4ee415c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43312/0 (socket says 172.21.15.6:43312) 2023-10-06T02:26:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee2d9d700 1 -- 172.21.15.6:0/3414102880 learned_addr learned my addr 172.21.15.6:0/3414102880 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee259c700 1 --2- 172.21.15.6:0/3414102880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ee406b7e0 0x7f4ee4169750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee2d9d700 1 -- 172.21.15.6:0/3414102880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ee406bbb0 msgr2=0x7f4ee415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee1d9b700 1 --2- 172.21.15.6:0/3414102880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ee406bbb0 0x7f4ee415beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee2d9d700 1 --2- 172.21.15.6:0/3414102880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ee406bbb0 0x7f4ee415beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee2d9d700 1 -- 172.21.15.6:0/3414102880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ee406b7e0 msgr2=0x7f4ee4169750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee2d9d700 1 --2- 172.21.15.6:0/3414102880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ee406b7e0 0x7f4ee4169750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee2d9d700 1 -- 172.21.15.6:0/3414102880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc009420 con 0x7f4ee4156b30 2023-10-06T02:26:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee1d9b700 1 --2- 172.21.15.6:0/3414102880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ee406bbb0 0x7f4ee415beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.306+0000 7f4ee259c700 1 --2- 172.21.15.6:0/3414102880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ee406b7e0 0x7f4ee4169750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.307+0000 7f4ee2d9d700 1 --2- 172.21.15.6:0/3414102880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ee4156b30 0x7f4ee415c3f0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400c4e0 tx=0x7f4ed4007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.307+0000 7f4eda7fc700 1 -- 172.21.15.6:0/3414102880 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4011660 con 0x7f4ee4156b30 2023-10-06T02:26:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.307+0000 7f4eda7fc700 1 -- 172.21.15.6:0/3414102880 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed40117e0 con 0x7f4ee4156b30 2023-10-06T02:26:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.307+0000 7f4ee8eb4700 1 -- 172.21.15.6:0/3414102880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee40c3250 con 0x7f4ee4156b30 2023-10-06T02:26:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.307+0000 7f4eda7fc700 1 -- 172.21.15.6:0/3414102880 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4011ba0 con 0x7f4ee4156b30 2023-10-06T02:26:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.307+0000 7f4ee8eb4700 1 -- 172.21.15.6:0/3414102880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee40c64b0 con 0x7f4ee4156b30 2023-10-06T02:26:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.308+0000 7f4ee8eb4700 1 -- 172.21.15.6:0/3414102880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee406e700 con 0x7f4ee4156b30 2023-10-06T02:26:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.308+0000 7f4eda7fc700 1 -- 172.21.15.6:0/3414102880 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ed4012420 con 0x7f4ee4156b30 2023-10-06T02:26:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.309+0000 7f4eda7fc700 1 --2- 172.21.15.6:0/3414102880 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4ec4066f30 0x7f4ec40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.309+0000 7f4eda7fc700 1 -- 172.21.15.6:0/3414102880 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7410+0+0 (secure 0 0 0) 0x7f4ed4002030 con 0x7f4ee4156b30 2023-10-06T02:26:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.309+0000 7f4ee259c700 1 --2- 172.21.15.6:0/3414102880 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4ec4066f30 0x7f4ec40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:19.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.309+0000 7f4ee259c700 1 --2- 172.21.15.6:0/3414102880 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4ec4066f30 0x7f4ec40693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4edc005c50 tx=0x7f4edc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:19.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.313+0000 7f4eda7fc700 1 -- 172.21.15.6:0/3414102880 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ed40514d0 con 0x7f4ee4156b30 2023-10-06T02:26:19.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.551+0000 7f4ee8eb4700 1 -- 172.21.15.6:0/3414102880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4ee40c9350 con 0x7f4ee4156b30 2023-10-06T02:26:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.934+0000 7f4eda7fc700 1 -- 172.21.15.6:0/3414102880 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v164) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4ed4054af0 con 0x7f4ee4156b30 2023-10-06T02:26:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.936+0000 7f4ee8eb4700 1 -- 172.21.15.6:0/3414102880 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4ec4066f30 msgr2=0x7f4ec40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.936+0000 7f4ee8eb4700 1 --2- 172.21.15.6:0/3414102880 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4ec4066f30 0x7f4ec40693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4edc005c50 tx=0x7f4edc009040 comp rx=0 tx=0).stop 2023-10-06T02:26:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.936+0000 7f4ee8eb4700 1 -- 172.21.15.6:0/3414102880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ee4156b30 msgr2=0x7f4ee415c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.936+0000 7f4ee8eb4700 1 --2- 172.21.15.6:0/3414102880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ee4156b30 0x7f4ee415c3f0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400c4e0 tx=0x7f4ed4007d80 comp rx=0 tx=0).stop 2023-10-06T02:26:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.936+0000 7f4ee8eb4700 1 -- 172.21.15.6:0/3414102880 shutdown_connections 2023-10-06T02:26:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.936+0000 7f4ee8eb4700 1 --2- 172.21.15.6:0/3414102880 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4ec4066f30 0x7f4ec40693e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.936+0000 7f4ee8eb4700 1 --2- 172.21.15.6:0/3414102880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ee4156b30 0x7f4ee415c3f0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.936+0000 7f4ee8eb4700 1 --2- 172.21.15.6:0/3414102880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ee406b7e0 0x7f4ee4169750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.936+0000 7f4ee8eb4700 1 --2- 172.21.15.6:0/3414102880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ee406bbb0 0x7f4ee415beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.936+0000 7f4ee8eb4700 1 -- 172.21.15.6:0/3414102880 >> 172.21.15.6:0/3414102880 conn(0x7f4ee406a260 msgr2=0x7f4ee4152040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.936+0000 7f4ee8eb4700 1 -- 172.21.15.6:0/3414102880 shutdown_connections 2023-10-06T02:26:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:19.936+0000 7f4ee8eb4700 1 -- 172.21.15.6:0/3414102880 wait complete. 2023-10-06T02:26:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:26:19.950 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:26:20.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.072+0000 7f78d5285700 1 Processor -- start 2023-10-06T02:26:20.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.072+0000 7f78d5285700 1 -- start start 2023-10-06T02:26:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.073+0000 7f78d5285700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f78d006c830 0x7f78d0159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.073+0000 7f78d5285700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d00c7cb0 con 0x7f78d006c460 2023-10-06T02:26:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.073+0000 7f78d5285700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d00c7f90 con 0x7f78d00c7840 2023-10-06T02:26:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.073+0000 7f78d5285700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d00c8270 con 0x7f78d006c830 2023-10-06T02:26:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.073+0000 7f78ceffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f78d006c460 0x7f78d0158f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43244/0 (socket says 172.21.15.6:43244) 2023-10-06T02:26:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.073+0000 7f78ceffd700 1 -- 172.21.15.6:0/973134942 learned_addr learned my addr 172.21.15.6:0/973134942 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cdffb700 1 -- 172.21.15.6:0/973134942 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905639013 0 0) 0x7f78d00c7cb0 con 0x7f78d006c460 2023-10-06T02:26:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cf7fe700 1 --2- 172.21.15.6:0/973134942 >> v2:172.21.15.175:3300/0 conn(0x7f78d006c830 0x7f78d0159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cdffb700 1 -- 172.21.15.6:0/973134942 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78bc003570 con 0x7f78d006c460 2023-10-06T02:26:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cdffb700 1 -- 172.21.15.6:0/973134942 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 986924849 0 0) 0x7f78bc003570 con 0x7f78d006c460 2023-10-06T02:26:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cdffb700 1 -- 172.21.15.6:0/973134942 >> v2:172.21.15.175:3300/0 conn(0x7f78d006c830 msgr2=0x7f78d0159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cdffb700 1 --2- 172.21.15.6:0/973134942 >> v2:172.21.15.175:3300/0 conn(0x7f78d006c830 0x7f78d0159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cdffb700 1 -- 172.21.15.6:0/973134942 >> v1:172.21.15.175:6789/0 conn(0x7f78d00c7840 legacy=0x7f78d00ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cdffb700 1 -- 172.21.15.6:0/973134942 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d00c8550 con 0x7f78d006c460 2023-10-06T02:26:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cdffb700 1 -- 172.21.15.6:0/973134942 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f78c8001470 con 0x7f78d006c460 2023-10-06T02:26:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cdffb700 1 -- 172.21.15.6:0/973134942 >> v1:172.21.15.6:6789/0 conn(0x7f78d006c460 legacy=0x7f78d0158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cdffb700 1 --2- 172.21.15.6:0/973134942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78bc003a60 0x7f78bc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cdffb700 1 --2- 172.21.15.6:0/973134942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc004810 0x7f78bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cdffb700 1 --2- 172.21.15.6:0/973134942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78bc0051c0 0x7f78bc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cdffb700 1 -- 172.21.15.6:0/973134942 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d00c8270 con 0x7f78bc004810 2023-10-06T02:26:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cdffb700 1 -- 172.21.15.6:0/973134942 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc00c0d0 con 0x7f78bc003a60 2023-10-06T02:26:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cdffb700 1 -- 172.21.15.6:0/973134942 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc00c290 con 0x7f78bc0051c0 2023-10-06T02:26:20.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78ce7fc700 1 --2- 172.21.15.6:0/973134942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc004810 0x7f78bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:20.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78ceffd700 1 --2- 172.21.15.6:0/973134942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78bc003a60 0x7f78bc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:20.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cf7fe700 1 --2- 172.21.15.6:0/973134942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78bc0051c0 0x7f78bc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:20.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78ce7fc700 1 -- 172.21.15.6:0/973134942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78bc0051c0 msgr2=0x7f78bc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:20.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78ce7fc700 1 --2- 172.21.15.6:0/973134942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78bc0051c0 0x7f78bc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:20.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78ce7fc700 1 -- 172.21.15.6:0/973134942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78bc003a60 msgr2=0x7f78bc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:20.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78ce7fc700 1 --2- 172.21.15.6:0/973134942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78bc003a60 0x7f78bc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:20.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78ce7fc700 1 -- 172.21.15.6:0/973134942 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc003570 con 0x7f78bc004810 2023-10-06T02:26:20.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78cf7fe700 1 -- 172.21.15.6:0/973134942 reap_dead start 2023-10-06T02:26:20.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78ceffd700 1 --2- 172.21.15.6:0/973134942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78bc003a60 0x7f78bc003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:20.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.074+0000 7f78ce7fc700 1 --2- 172.21.15.6:0/973134942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc004810 0x7f78bc004c80 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f78b8001880 tx=0x7f78b8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86ed25885afe80c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:20.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.075+0000 7f78cdffb700 1 -- 172.21.15.6:0/973134942 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8012420 con 0x7f78bc004810 2023-10-06T02:26:20.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.075+0000 7f78cdffb700 1 -- 172.21.15.6:0/973134942 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b8012580 con 0x7f78bc004810 2023-10-06T02:26:20.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.075+0000 7f78cdffb700 1 -- 172.21.15.6:0/973134942 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8012920 con 0x7f78bc004810 2023-10-06T02:26:20.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.075+0000 7f78d5285700 1 -- 172.21.15.6:0/973134942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc004810 msgr2=0x7f78bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:20.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.075+0000 7f78d5285700 1 --2- 172.21.15.6:0/973134942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc004810 0x7f78bc004c80 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f78b8001880 tx=0x7f78b8007d30 comp rx=0 tx=0).stop 2023-10-06T02:26:20.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.075+0000 7f78d5285700 1 -- 172.21.15.6:0/973134942 shutdown_connections 2023-10-06T02:26:20.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.075+0000 7f78d5285700 1 --2- 172.21.15.6:0/973134942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc004810 0x7f78bc004c80 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:20.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.075+0000 7f78d5285700 1 -- 172.21.15.6:0/973134942 >> 172.21.15.6:0/973134942 conn(0x7f78d00c9cc0 msgr2=0x7f78d006acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:20.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.075+0000 7f78d5285700 1 -- 172.21.15.6:0/973134942 shutdown_connections 2023-10-06T02:26:20.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.075+0000 7f78d5285700 1 -- 172.21.15.6:0/973134942 wait complete. 2023-10-06T02:26:20.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.076+0000 7f78d5285700 1 Processor -- start 2023-10-06T02:26:20.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.076+0000 7f78d5285700 1 -- start start 2023-10-06T02:26:20.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.077+0000 7f78d5285700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78bc004810 0x7f78d01558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:20.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.077+0000 7f78d5285700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78d00ae130 0x7f78d0154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:20.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.077+0000 7f78d5285700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78d00c3830 0x7f78d015a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:20.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.077+0000 7f78d5285700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d00ae880 con 0x7f78d00c3830 2023-10-06T02:26:20.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.077+0000 7f78d5285700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d00ae5a0 con 0x7f78bc004810 2023-10-06T02:26:20.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.077+0000 7f78d5285700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d0158ed0 con 0x7f78d00ae130 2023-10-06T02:26:20.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.077+0000 7f78cf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78d00c3830 0x7f78d015a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:20.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.077+0000 7f78cf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78d00c3830 0x7f78d015a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43326/0 (socket says 172.21.15.6:43326) 2023-10-06T02:26:20.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.077+0000 7f78cf7fe700 1 -- 172.21.15.6:0/1216089474 learned_addr learned my addr 172.21.15.6:0/1216089474 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:20.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.077+0000 7f78ceffd700 1 --2- 172.21.15.6:0/1216089474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78bc004810 0x7f78d01558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:20.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.077+0000 7f78ce7fc700 1 --2- 172.21.15.6:0/1216089474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78d00ae130 0x7f78d0154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:20.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.078+0000 7f78cf7fe700 1 -- 172.21.15.6:0/1216089474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78d00ae130 msgr2=0x7f78d0154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:20.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.078+0000 7f78cf7fe700 1 --2- 172.21.15.6:0/1216089474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78d00ae130 0x7f78d0154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:20.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.078+0000 7f78cf7fe700 1 -- 172.21.15.6:0/1216089474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78bc004810 msgr2=0x7f78d01558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:20.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.078+0000 7f78cf7fe700 1 --2- 172.21.15.6:0/1216089474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78bc004810 0x7f78d01558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:20.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.078+0000 7f78cf7fe700 1 -- 172.21.15.6:0/1216089474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d01591b0 con 0x7f78d00c3830 2023-10-06T02:26:20.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.078+0000 7f78ceffd700 1 --2- 172.21.15.6:0/1216089474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78bc004810 0x7f78d01558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:20.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.078+0000 7f78cf7fe700 1 --2- 172.21.15.6:0/1216089474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78d00c3830 0x7f78d015a800 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f78d00c73b0 tx=0x7f78c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:20.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.078+0000 7f78c6ffd700 1 -- 172.21.15.6:0/1216089474 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c000e070 con 0x7f78d00c3830 2023-10-06T02:26:20.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.078+0000 7f78c6ffd700 1 -- 172.21.15.6:0/1216089474 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c0011d00 con 0x7f78d00c3830 2023-10-06T02:26:20.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.078+0000 7f78c6ffd700 1 -- 172.21.15.6:0/1216089474 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c00166c0 con 0x7f78d00c3830 2023-10-06T02:26:20.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.078+0000 7f78d5285700 1 -- 172.21.15.6:0/1216089474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d0159490 con 0x7f78d00c3830 2023-10-06T02:26:20.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.078+0000 7f78d5285700 1 -- 172.21.15.6:0/1216089474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d0155540 con 0x7f78d00c3830 2023-10-06T02:26:20.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.079+0000 7f78d5285700 1 -- 172.21.15.6:0/1216089474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d0158d30 con 0x7f78d00c3830 2023-10-06T02:26:20.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.079+0000 7f78c6ffd700 1 -- 172.21.15.6:0/1216089474 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78c0016ab0 con 0x7f78d00c3830 2023-10-06T02:26:20.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.080+0000 7f78c6ffd700 1 --2- 172.21.15.6:0/1216089474 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f78b0066f30 0x7f78b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:20.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.080+0000 7f78c6ffd700 1 -- 172.21.15.6:0/1216089474 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7410+0+0 (secure 0 0 0) 0x7f78c0085830 con 0x7f78d00c3830 2023-10-06T02:26:20.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.080+0000 7f78ceffd700 1 --2- 172.21.15.6:0/1216089474 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f78b0066f30 0x7f78b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:20.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.080+0000 7f78ceffd700 1 --2- 172.21.15.6:0/1216089474 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f78b0066f30 0x7f78b00693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f78c8001ce0 tx=0x7f78c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:20.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.084+0000 7f78c6ffd700 1 -- 172.21.15.6:0/1216089474 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78d0158d30 con 0x7f78d00c3830 2023-10-06T02:26:20.320 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:26:20.323 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:26:20.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.361+0000 7f78d5285700 1 -- 172.21.15.6:0/1216089474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f78d01596d0 con 0x7f78d00c3830 2023-10-06T02:26:20.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.949+0000 7f78c6ffd700 1 -- 172.21.15.6:0/1216089474 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v165) v1 ==== 101+0+0 (secure 0 0 0) 0x7f78d01596d0 con 0x7f78d00c3830 2023-10-06T02:26:20.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.951+0000 7f78d5285700 1 -- 172.21.15.6:0/1216089474 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f78b0066f30 msgr2=0x7f78b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:20.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.951+0000 7f78d5285700 1 --2- 172.21.15.6:0/1216089474 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f78b0066f30 0x7f78b00693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f78c8001ce0 tx=0x7f78c8009040 comp rx=0 tx=0).stop 2023-10-06T02:26:20.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.951+0000 7f78d5285700 1 -- 172.21.15.6:0/1216089474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78d00c3830 msgr2=0x7f78d015a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:20.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.951+0000 7f78d5285700 1 --2- 172.21.15.6:0/1216089474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78d00c3830 0x7f78d015a800 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f78d00c73b0 tx=0x7f78c000b040 comp rx=0 tx=0).stop 2023-10-06T02:26:20.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.951+0000 7f78d5285700 1 -- 172.21.15.6:0/1216089474 shutdown_connections 2023-10-06T02:26:20.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.951+0000 7f78d5285700 1 --2- 172.21.15.6:0/1216089474 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f78b0066f30 0x7f78b00693e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:20.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.951+0000 7f78d5285700 1 --2- 172.21.15.6:0/1216089474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78d00c3830 0x7f78d015a800 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:20.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.951+0000 7f78d5285700 1 --2- 172.21.15.6:0/1216089474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78bc004810 0x7f78d01558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:20.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.951+0000 7f78d5285700 1 --2- 172.21.15.6:0/1216089474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78d00ae130 0x7f78d0154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:20.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.951+0000 7f78d5285700 1 -- 172.21.15.6:0/1216089474 >> 172.21.15.6:0/1216089474 conn(0x7f78d00c9cc0 msgr2=0x7f78d00c2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:20.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.951+0000 7f78d5285700 1 -- 172.21.15.6:0/1216089474 shutdown_connections 2023-10-06T02:26:20.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:20.951+0000 7f78d5285700 1 -- 172.21.15.6:0/1216089474 wait complete. 2023-10-06T02:26:20.953 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:26:20.967 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:26:21.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.007+0000 7f8b15249000 1 Processor -- start 2023-10-06T02:26:21.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.007+0000 7f8b15249000 1 -- start start 2023-10-06T02:26:21.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b15249000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643da833e30 0x5643da852a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b15249000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643da8dcf50 0x5643da852060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b15249000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643da8e0260 0x5643da8072f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b15249000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643da753980 con 0x5643da8dcf50 2023-10-06T02:26:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b15249000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643da753620 con 0x5643da8e0260 2023-10-06T02:26:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b15249000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643da74a400 con 0x5643da833e30 2023-10-06T02:26:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b0dc83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643da8dcf50 0x5643da852060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b0dc83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643da8dcf50 0x5643da852060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43348/0 (socket says 172.21.15.6:43348) 2023-10-06T02:26:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b0dc83700 1 -- 172.21.15.6:0/737293439 learned_addr learned my addr 172.21.15.6:0/737293439 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b0e484700 1 --2- 172.21.15.6:0/737293439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643da833e30 0x5643da852a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b0ec85700 1 --2- 172.21.15.6:0/737293439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643da8e0260 0x5643da8072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b0dc83700 1 -- 172.21.15.6:0/737293439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643da833e30 msgr2=0x5643da852a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:21.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b0dc83700 1 --2- 172.21.15.6:0/737293439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643da833e30 0x5643da852a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b0dc83700 1 -- 172.21.15.6:0/737293439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643da8e0260 msgr2=0x5643da8072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:21.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b0dc83700 1 --2- 172.21.15.6:0/737293439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643da8e0260 0x5643da8072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b0dc83700 1 -- 172.21.15.6:0/737293439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0000c3d0 con 0x5643da8dcf50 2023-10-06T02:26:21.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b0e484700 1 --2- 172.21.15.6:0/737293439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643da833e30 0x5643da852a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:21.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.008+0000 7f8b0dc83700 1 --2- 172.21.15.6:0/737293439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643da8dcf50 0x5643da852060 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f8af8001e20 tx=0x7f8af80018c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3165ba9ad5e5f7c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:21.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.009+0000 7f8b0cc81700 1 -- 172.21.15.6:0/737293439 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8014070 con 0x5643da8dcf50 2023-10-06T02:26:21.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.009+0000 7f8b0cc81700 1 -- 172.21.15.6:0/737293439 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af8008030 con 0x5643da8dcf50 2023-10-06T02:26:21.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.009+0000 7f8b0cc81700 1 -- 172.21.15.6:0/737293439 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af800be70 con 0x5643da8dcf50 2023-10-06T02:26:21.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.009+0000 7f8b15249000 1 -- 172.21.15.6:0/737293439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643da8dcf50 msgr2=0x5643da852060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.009+0000 7f8b15249000 1 --2- 172.21.15.6:0/737293439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643da8dcf50 0x5643da852060 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f8af8001e20 tx=0x7f8af80018c0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.009+0000 7f8b15249000 1 -- 172.21.15.6:0/737293439 shutdown_connections 2023-10-06T02:26:21.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.009+0000 7f8b15249000 1 --2- 172.21.15.6:0/737293439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643da8e0260 0x5643da8072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.009+0000 7f8b15249000 1 --2- 172.21.15.6:0/737293439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643da833e30 0x5643da852a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.009+0000 7f8b15249000 1 --2- 172.21.15.6:0/737293439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643da8dcf50 0x5643da852060 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.009+0000 7f8b15249000 1 -- 172.21.15.6:0/737293439 >> 172.21.15.6:0/737293439 conn(0x5643da84fbd0 msgr2=0x5643da84ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:21.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.009+0000 7f8b15249000 1 -- 172.21.15.6:0/737293439 shutdown_connections 2023-10-06T02:26:21.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.009+0000 7f8b15249000 1 -- 172.21.15.6:0/737293439 wait complete. 2023-10-06T02:26:21.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.010+0000 7f8b15249000 1 Processor -- start 2023-10-06T02:26:21.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.010+0000 7f8b15249000 1 -- start start 2023-10-06T02:26:21.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.010+0000 7f8b15249000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643da833e30 0x5643da8d9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.010+0000 7f8b15249000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643da8dcf50 0x5643da8d80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b15249000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643da8e0260 0x5643da8db340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b15249000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643da84dfc0 con 0x5643da833e30 2023-10-06T02:26:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b15249000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643da84e260 con 0x5643da8dcf50 2023-10-06T02:26:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b15249000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643da84e500 con 0x5643da8e0260 2023-10-06T02:26:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b0e484700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643da833e30 0x5643da8d9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b0e484700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643da833e30 0x5643da8d9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43358/0 (socket says 172.21.15.6:43358) 2023-10-06T02:26:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 learned_addr learned my addr 172.21.15.6:0/3420110876 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b0dc83700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643da8dcf50 0x5643da8d80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b0ec85700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643da8e0260 0x5643da8db340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643da8e0260 msgr2=0x5643da8db340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b0e484700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643da8e0260 0x5643da8db340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643da8dcf50 msgr2=0x5643da8d80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b0e484700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643da8dcf50 0x5643da8d80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af800a040 con 0x5643da833e30 2023-10-06T02:26:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b0dc83700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643da8dcf50 0x5643da8d80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b0e484700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643da833e30 0x5643da8d9cf0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f8b08008b20 tx=0x7f8b08005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b06ffd700 1 -- 172.21.15.6:0/3420110876 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08006a20 con 0x5643da833e30 2023-10-06T02:26:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b06ffd700 1 -- 172.21.15.6:0/3420110876 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b08010040 con 0x5643da833e30 2023-10-06T02:26:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5643da7623d0 con 0x5643da833e30 2023-10-06T02:26:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b06ffd700 1 -- 172.21.15.6:0/3420110876 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08006d90 con 0x5643da833e30 2023-10-06T02:26:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.011+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643da755ae0 con 0x5643da833e30 2023-10-06T02:26:21.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.013+0000 7f8b06ffd700 1 -- 172.21.15.6:0/3420110876 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b08014600 con 0x5643da833e30 2023-10-06T02:26:21.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.013+0000 7f8b06ffd700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8af00658c0 0x7f8af0067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.013+0000 7f8b06ffd700 1 -- 172.21.15.6:0/3420110876 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7410+0+0 (secure 0 0 0) 0x7f8b08083b50 con 0x5643da833e30 2023-10-06T02:26:21.018 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:26:21.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.013+0000 7f8b0dc83700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8af00658c0 0x7f8af0067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.013+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5643da84a4d0 0x5643da8f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.013+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8d85f0 con 0x5643da84a4d0 2023-10-06T02:26:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.014+0000 7f8b0ec85700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5643da84a4d0 0x5643da8f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.014+0000 7f8b0dc83700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8af00658c0 0x7f8af0067d70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8af8001920 tx=0x7f8af8014000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.014+0000 7f8b0ec85700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5643da84a4d0 0x5643da8f6d90 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.015+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v107'350 uv324 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.016+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da84efa0 con 0x5643da84a4d0 2023-10-06T02:26:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.017+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v107'351 uv351 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.017+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f72d0 con 0x5643da84a4d0 2023-10-06T02:26:21.021 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:26:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.018+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v107'352 uv352 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.018+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f8690 con 0x5643da84a4d0 2023-10-06T02:26:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.019+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v107'353 uv353 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.019+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f8a40 con 0x5643da84a4d0 2023-10-06T02:26:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.020+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v107'354 uv354 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.021+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8dbad0 con 0x5643da84a4d0 2023-10-06T02:26:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.022+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v107'355 uv355 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.022+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f7b70 con 0x5643da84a4d0 2023-10-06T02:26:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.023+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v107'356 uv330 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.023+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f7f70 con 0x5643da84a4d0 2023-10-06T02:26:21.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.024+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v107'357 uv357 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.024+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f7f70 con 0x5643da84a4d0 2023-10-06T02:26:21.025 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:26:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.025+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v107'358 uv358 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.025+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f7f70 con 0x5643da84a4d0 2023-10-06T02:26:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.026+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v107'359 uv359 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.026+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f7f70 con 0x5643da84a4d0 2023-10-06T02:26:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.028+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v107'360 uv360 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.028+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f7f70 con 0x5643da84a4d0 2023-10-06T02:26:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.029+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v107'361 uv361 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.029+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f7f70 con 0x5643da84a4d0 2023-10-06T02:26:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.030+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v107'362 uv337 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.030+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f7f70 con 0x5643da84a4d0 2023-10-06T02:26:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.031+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v107'363 uv363 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.031+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f7f70 con 0x5643da84a4d0 2023-10-06T02:26:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.032+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v107'364 uv364 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.033 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:26:21.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.032+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f7f70 con 0x5643da84a4d0 2023-10-06T02:26:21.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.033+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v107'365 uv365 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.033+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f7f70 con 0x5643da84a4d0 2023-10-06T02:26:21.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.035+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v107'366 uv366 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.035+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f7f70 con 0x5643da84a4d0 2023-10-06T02:26:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.036+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v107'367 uv367 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.036+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f8df0 con 0x5643da84a4d0 2023-10-06T02:26:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.037+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v107'368 uv368 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.037+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f8df0 con 0x5643da84a4d0 2023-10-06T02:26:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.038+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v107'369 uv343 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.038+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f8df0 con 0x5643da84a4d0 2023-10-06T02:26:21.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.039+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v107'370 uv370 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.039+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f8df0 con 0x5643da84a4d0 2023-10-06T02:26:21.041 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:26:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.041+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v107'371 uv371 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.041+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f9e00 con 0x5643da84a4d0 2023-10-06T02:26:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.042+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v107'372 uv372 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.042+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f9e00 con 0x5643da84a4d0 2023-10-06T02:26:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.043+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v107'373 uv373 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.043+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f8df0 con 0x5643da84a4d0 2023-10-06T02:26:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.044+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v107'374 uv374 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.044+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f8df0 con 0x5643da84a4d0 2023-10-06T02:26:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.046+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v107'375 uv349 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.046+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f8df0 con 0x5643da84a4d0 2023-10-06T02:26:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.047+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v107'376 uv376 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.047+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f8df0 con 0x5643da84a4d0 2023-10-06T02:26:21.048 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:26:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.048+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v107'377 uv377 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.048+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f9e00 con 0x5643da84a4d0 2023-10-06T02:26:21.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.049+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v107'378 uv378 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.049+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f9e00 con 0x5643da84a4d0 2023-10-06T02:26:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.050+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v107'379 uv379 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.050+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8f8df0 con 0x5643da84a4d0 2023-10-06T02:26:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.051+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v107'380 uv380 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da84a4d0 2023-10-06T02:26:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.051+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5643da8f9300 0x5643da8fb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.051+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fbc20 con 0x5643da8f9300 2023-10-06T02:26:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.051+0000 7f8b0e484700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5643da8f9300 0x5643da8fb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.052+0000 7f8b0e484700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5643da8f9300 0x5643da8fb6e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.053+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v107'258 uv241 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.053+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fbfd0 con 0x5643da8f9300 2023-10-06T02:26:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.054+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v107'259 uv259 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.054+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fc380 con 0x5643da8f9300 2023-10-06T02:26:21.056 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:26:21.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.056+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v107'260 uv260 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.056+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fcc20 con 0x5643da8f9300 2023-10-06T02:26:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.057+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v107'261 uv261 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.058+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fcfd0 con 0x5643da8f9300 2023-10-06T02:26:21.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.059+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v107'262 uv262 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.059+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fd380 con 0x5643da8f9300 2023-10-06T02:26:21.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.060+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v107'263 uv246 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.060+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fd730 con 0x5643da8f9300 2023-10-06T02:26:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.061+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v107'264 uv264 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.061+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fdae0 con 0x5643da8f9300 2023-10-06T02:26:21.062 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:26:21.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.062+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v107'265 uv265 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.062+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fdae0 con 0x5643da8f9300 2023-10-06T02:26:21.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.063+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v107'266 uv266 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.064+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fdee0 con 0x5643da8f9300 2023-10-06T02:26:21.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.065+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v107'267 uv267 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.065+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fdee0 con 0x5643da8f9300 2023-10-06T02:26:21.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.066+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v107'268 uv251 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.066+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fdae0 con 0x5643da8f9300 2023-10-06T02:26:21.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.067+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v107'269 uv269 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.067+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fdae0 con 0x5643da8f9300 2023-10-06T02:26:21.069 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:26:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.069+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v107'270 uv270 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.069+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da901200 con 0x5643da8f9300 2023-10-06T02:26:21.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.070+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v107'271 uv271 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.070+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fc7b0 con 0x5643da8f9300 2023-10-06T02:26:21.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.071+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v107'272 uv272 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.071+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fc7b0 con 0x5643da8f9300 2023-10-06T02:26:21.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.072+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v107'273 uv257 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.072+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fc730 con 0x5643da8f9300 2023-10-06T02:26:21.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.073+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v107'274 uv274 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.073+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fdae0 con 0x5643da8f9300 2023-10-06T02:26:21.074 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:26:21.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.074+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v107'275 uv275 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.074+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8feaf0 con 0x5643da8f9300 2023-10-06T02:26:21.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.075+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v107'276 uv276 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.075+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8feaf0 con 0x5643da8f9300 2023-10-06T02:26:21.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.077+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v107'277 uv277 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.077+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da8fdae0 con 0x5643da8f9300 2023-10-06T02:26:21.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.078+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v107'278 uv278 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.078+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5643da8fdff0 0x5643da9003d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.078+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da9009e0 con 0x5643da8fdff0 2023-10-06T02:26:21.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.079+0000 7f8b0dc83700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5643da8fdff0 0x5643da9003d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.079+0000 7f8b0dc83700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5643da8fdff0 0x5643da9003d0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:21.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.080+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v107'69 uv68 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.080+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da900ea0 con 0x5643da8fdff0 2023-10-06T02:26:21.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.081+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v107'70 uv70 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.081+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da901420 con 0x5643da8fdff0 2023-10-06T02:26:21.082 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:26:21.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.082+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v107'71 uv71 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.082+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da902d20 con 0x5643da8fdff0 2023-10-06T02:26:21.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.083+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v107'72 uv72 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.083+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da9030d0 con 0x5643da8fdff0 2023-10-06T02:26:21.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.084+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v107'73 uv73 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.084+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da901d10 con 0x5643da8fdff0 2023-10-06T02:26:21.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.085+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v107'74 uv74 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.085+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da902110 con 0x5643da8fdff0 2023-10-06T02:26:21.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.086+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v107'51 uv50 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.086+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da902560 con 0x5643da8fdff0 2023-10-06T02:26:21.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.087+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v107'52 uv52 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.087+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da902560 con 0x5643da8fdff0 2023-10-06T02:26:21.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.088+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v107'53 uv53 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.089 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:26:21.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.088+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da902510 con 0x5643da8fdff0 2023-10-06T02:26:21.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.089+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v107'54 uv54 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.089+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da902930 con 0x5643da8f9300 2023-10-06T02:26:21.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.090+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v107'69 uv68 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.090+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da902930 con 0x5643da8f9300 2023-10-06T02:26:21.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.091+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v107'70 uv70 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.091+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da902930 con 0x5643da8f9300 2023-10-06T02:26:21.093 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:26:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.092+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v107'71 uv71 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.093+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da902930 con 0x5643da8f9300 2023-10-06T02:26:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.094+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v107'72 uv72 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.094+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da902930 con 0x5643da8f9300 2023-10-06T02:26:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.095+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v107'73 uv73 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.095+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da902930 con 0x5643da8f9300 2023-10-06T02:26:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.096+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v107'74 uv74 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da8f9300 2023-10-06T02:26:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.096+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5643da9024c0 0x5643da9059a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.096+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da905ee0 con 0x5643da9024c0 2023-10-06T02:26:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.096+0000 7f8b0ec85700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5643da9024c0 0x5643da9059a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.097+0000 7f8b0ec85700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5643da9024c0 0x5643da9059a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.098+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v107'127 uv121 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da9024c0 2023-10-06T02:26:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.098+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da905ee0 con 0x5643da9024c0 2023-10-06T02:26:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.099+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v107'128 uv128 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da9024c0 2023-10-06T02:26:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.099+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da905ee0 con 0x5643da9024c0 2023-10-06T02:26:21.100 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:26:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.100+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v107'129 uv129 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da9024c0 2023-10-06T02:26:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.100+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da906ef0 con 0x5643da9024c0 2023-10-06T02:26:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.101+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v107'130 uv130 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da9024c0 2023-10-06T02:26:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.101+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da906ef0 con 0x5643da9024c0 2023-10-06T02:26:21.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.102+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v107'131 uv131 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da9024c0 2023-10-06T02:26:21.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.102+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da905ee0 con 0x5643da9024c0 2023-10-06T02:26:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.103+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v107'132 uv132 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da9024c0 2023-10-06T02:26:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.103+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da905ee0 con 0x5643da9024c0 2023-10-06T02:26:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.104+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v107'133 uv126 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da9024c0 2023-10-06T02:26:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.104+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da905ee0 con 0x5643da9024c0 2023-10-06T02:26:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.105+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v107'134 uv134 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da9024c0 2023-10-06T02:26:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.105+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da905ee0 con 0x5643da9024c0 2023-10-06T02:26:21.106 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:26:21.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.106+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v107'135 uv135 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da9024c0 2023-10-06T02:26:21.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.106+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da905ee0 con 0x5643da9024c0 2023-10-06T02:26:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.109+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v107'136 uv136 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da9024c0 2023-10-06T02:26:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.109+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da905ee0 con 0x5643da9024c0 2023-10-06T02:26:21.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.110+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v107'137 uv137 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da9024c0 2023-10-06T02:26:21.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.110+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5643da9065b0 0x5643da9069c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.110+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da9092f0 con 0x5643da9065b0 2023-10-06T02:26:21.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.111+0000 7f8b0e484700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5643da9065b0 0x5643da9069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.111+0000 7f8b0e484700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5643da9065b0 0x5643da9069c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:21.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.112+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v107'56 uv55 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da9065b0 2023-10-06T02:26:21.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.112+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da9092f0 con 0x5643da9065b0 2023-10-06T02:26:21.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.113+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v107'57 uv57 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da9065b0 2023-10-06T02:26:21.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.113+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da9092f0 con 0x5643da9065b0 2023-10-06T02:26:21.115 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:26:21.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.114+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v107'58 uv58 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da9065b0 2023-10-06T02:26:21.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.114+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da9092f0 con 0x5643da9065b0 2023-10-06T02:26:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.116+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v107'59 uv59 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da9065b0 2023-10-06T02:26:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.116+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da9096f0 con 0x5643da9065b0 2023-10-06T02:26:21.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.117+0000 7f8b0e484700 1 -- 172.21.15.6:0/3420110876 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v107'60 uv60 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8b08052770 con 0x5643da9065b0 2023-10-06T02:26:21.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.117+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da9096f0 con 0x5643da8fdff0 2023-10-06T02:26:21.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.118+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v107'69 uv68 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.118+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da9096f0 con 0x5643da8fdff0 2023-10-06T02:26:21.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.119+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v107'70 uv70 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.119+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da9096f0 con 0x5643da8fdff0 2023-10-06T02:26:21.120 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:26:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.120+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v107'71 uv71 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.120+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90a700 con 0x5643da8fdff0 2023-10-06T02:26:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.122+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v107'72 uv72 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.122+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90a700 con 0x5643da8fdff0 2023-10-06T02:26:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.123+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v107'73 uv73 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.123+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da9096f0 con 0x5643da8fdff0 2023-10-06T02:26:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.124+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v107'74 uv74 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.124+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5643da909c00 0x5643da90bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.124+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90c520 con 0x5643da909c00 2023-10-06T02:26:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.124+0000 7f8b0dc83700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5643da909c00 0x5643da90bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.124+0000 7f8b0dc83700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5643da909c00 0x5643da90bfe0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.125+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v107'112 uv108 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da909c00 2023-10-06T02:26:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.126+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90c900 con 0x5643da909c00 2023-10-06T02:26:21.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.126+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v107'113 uv113 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da909c00 2023-10-06T02:26:21.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.126+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90c900 con 0x5643da909c00 2023-10-06T02:26:21.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.127+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v107'114 uv114 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da909c00 2023-10-06T02:26:21.128 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:26:21.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.127+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90c900 con 0x5643da909c00 2023-10-06T02:26:21.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.128+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v107'115 uv115 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da909c00 2023-10-06T02:26:21.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.129+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90c900 con 0x5643da909c00 2023-10-06T02:26:21.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.129+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v107'116 uv116 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da909c00 2023-10-06T02:26:21.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.129+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90c900 con 0x5643da909c00 2023-10-06T02:26:21.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.130+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v107'117 uv111 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da909c00 2023-10-06T02:26:21.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.130+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90c900 con 0x5643da909c00 2023-10-06T02:26:21.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.131+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v107'118 uv118 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da909c00 2023-10-06T02:26:21.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.131+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90c900 con 0x5643da909c00 2023-10-06T02:26:21.132 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:26:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.132+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v107'119 uv119 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da909c00 2023-10-06T02:26:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.132+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90c900 con 0x5643da909c00 2023-10-06T02:26:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.133+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v107'120 uv120 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da909c00 2023-10-06T02:26:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.133+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90f670 con 0x5643da909c00 2023-10-06T02:26:21.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.136+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v107'121 uv121 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da909c00 2023-10-06T02:26:21.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.136+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90cdf0 con 0x5643da8fdff0 2023-10-06T02:26:21.138 INFO:teuthology.orchestra.run.smithi006.stdout:Write #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:26:21.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.137+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v107'54 uv54 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.137+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90cdf0 con 0x5643da8fdff0 2023-10-06T02:26:21.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.140+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [omap-set-header] v107'55 uv55 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.140+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5643da90d300 0x5643da90d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.140+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:103 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90fdc0 con 0x5643da90d300 2023-10-06T02:26:21.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.140+0000 7f8b0ec85700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5643da90d300 0x5643da90d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.141+0000 7f8b0ec85700 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5643da90d300 0x5643da90d6d0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.142+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(103 609.00000000 [create] v107'69 uv68 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da90d300 2023-10-06T02:26:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.142+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:104 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90fdc0 con 0x5643da90d300 2023-10-06T02:26:21.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.146+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(104 609.00000000 [delete] v107'70 uv70 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da90d300 2023-10-06T02:26:21.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.146+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90fdc0 con 0x5643da90d300 2023-10-06T02:26:21.147 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:26:21.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.146+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(105 609.00000000 [create] v107'71 uv71 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da90d300 2023-10-06T02:26:21.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.147+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da910dd0 con 0x5643da90d300 2023-10-06T02:26:21.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.149+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(106 609.00000000 [setxattr (30)] v107'72 uv72 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da90d300 2023-10-06T02:26:21.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.149+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da910dd0 con 0x5643da90d300 2023-10-06T02:26:21.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.152+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(107 609.00000000 [setxattr (62)] v107'73 uv73 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da90d300 2023-10-06T02:26:21.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.152+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90fdc0 con 0x5643da90d300 2023-10-06T02:26:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.155+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(108 609.00000000 [omap-set-header] v107'74 uv74 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da90d300 2023-10-06T02:26:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.155+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:109 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90fdc0 con 0x5643da9024c0 2023-10-06T02:26:21.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.156+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(109 400.00000000 [create] v107'57 uv56 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da9024c0 2023-10-06T02:26:21.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.156+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:110 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90fdc0 con 0x5643da9024c0 2023-10-06T02:26:21.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.157+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(110 400.00000000 [delete] v107'58 uv58 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da9024c0 2023-10-06T02:26:21.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.157+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90fdc0 con 0x5643da9024c0 2023-10-06T02:26:21.160 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:26:21.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.160+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(111 400.00000000 [create] v107'59 uv59 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da9024c0 2023-10-06T02:26:21.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.160+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90fdc0 con 0x5643da9024c0 2023-10-06T02:26:21.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.162+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(112 400.00000000 [write 0~22] v107'60 uv60 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da9024c0 2023-10-06T02:26:21.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.162+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90fdc0 con 0x5643da9024c0 2023-10-06T02:26:21.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.165+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(113 400.00000000 [omap-set-header] v107'61 uv61 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f8b0000ab40 con 0x5643da9024c0 2023-10-06T02:26:21.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.165+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:114 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90fdc0 con 0x5643da8fdff0 2023-10-06T02:26:21.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.166+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(114 100.00000000.inode [create] v107'144 uv136 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.166+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:115 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90fdc0 con 0x5643da8fdff0 2023-10-06T02:26:21.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.167+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(115 100.00000000.inode [delete] v107'145 uv145 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.167+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90fdc0 con 0x5643da8fdff0 2023-10-06T02:26:21.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.168+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v107'146 uv146 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.169 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:26:21.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.168+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90fdc0 con 0x5643da8fdff0 2023-10-06T02:26:21.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.169+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [write 0~554] v107'147 uv147 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.169+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90fdc0 con 0x5643da8fdff0 2023-10-06T02:26:21.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.172+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v107'148 uv148 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.172+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90fdc0 con 0x5643da8fdff0 2023-10-06T02:26:21.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.174+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 1.00000000 [create] v107'149 uv143 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.175+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90fdc0 con 0x5643da8fdff0 2023-10-06T02:26:21.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.177+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 1.00000000 [delete] v107'150 uv150 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.177+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da90fdc0 con 0x5643da8fdff0 2023-10-06T02:26:21.180 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:26:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.180+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v107'151 uv151 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.180+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da910dd0 con 0x5643da8fdff0 2023-10-06T02:26:21.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.182+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v107'152 uv152 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.182+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da910dd0 con 0x5643da8fdff0 2023-10-06T02:26:21.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.185+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v107'153 uv153 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.185+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da9102b0 con 0x5643da8fdff0 2023-10-06T02:26:21.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.188+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [omap-set-header] v107'154 uv154 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.188+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5643da9102b0 con 0x5643da8fdff0 2023-10-06T02:26:21.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b0dc83700 1 -- 172.21.15.6:0/3420110876 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v107'155 uv155 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f8af8016070 con 0x5643da8fdff0 2023-10-06T02:26:21.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5643da8fdff0 msgr2=0x5643da9003d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5643da8fdff0 0x5643da9003d0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5643da84a4d0 msgr2=0x5643da8f6d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5643da84a4d0 0x5643da8f6d90 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5643da909c00 msgr2=0x5643da90bfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5643da909c00 0x5643da90bfe0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5643da8f9300 msgr2=0x5643da8fb6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5643da8f9300 0x5643da8fb6e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5643da90d300 msgr2=0x5643da90d6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5643da90d300 0x5643da90d6d0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 reap_dead start 2023-10-06T02:26:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5643da9065b0 msgr2=0x5643da9069c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5643da9065b0 0x5643da9069c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b0ec85700 1 -- 172.21.15.6:0/3420110876 reap_dead start 2023-10-06T02:26:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5643da9024c0 msgr2=0x5643da9059a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5643da9024c0 0x5643da9059a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8af00658c0 msgr2=0x7f8af0067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8af00658c0 0x7f8af0067d70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8af8001920 tx=0x7f8af8014000 comp rx=0 tx=0).stop 2023-10-06T02:26:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643da833e30 msgr2=0x5643da8d9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643da833e30 0x5643da8d9cf0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f8b08008b20 tx=0x7f8b08005e30 comp rx=0 tx=0).stop 2023-10-06T02:26:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 shutdown_connections 2023-10-06T02:26:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5643da9065b0 0x5643da9069c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643da833e30 0x5643da8d9cf0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8af00658c0 0x7f8af0067d70 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 --2- 172.21.15.6:0/3420110876 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5643da9024c0 0x5643da9059a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 >> 172.21.15.6:0/3420110876 conn(0x5643da84fbd0 msgr2=0x5643da84ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 shutdown_connections 2023-10-06T02:26:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.190+0000 7f8b15249000 1 -- 172.21.15.6:0/3420110876 wait complete. 2023-10-06T02:26:21.195 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 400.00000000 2023-10-06T02:26:21.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.272+0000 7fdf2a9e3000 1 Processor -- start 2023-10-06T02:26:21.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.272+0000 7fdf2a9e3000 1 -- start start 2023-10-06T02:26:21.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.273+0000 7fdf2a9e3000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c383aa77a0 0x55c383aa70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.273+0000 7fdf2a9e3000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c383b32cb0 0x55c383b34b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.273+0000 7fdf2a9e3000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c383b36aa0 0x55c383b29880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.273+0000 7fdf2a9e3000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c383a06320 con 0x55c383b36aa0 2023-10-06T02:26:21.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.273+0000 7fdf2a9e3000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3839aa980 con 0x55c383aa77a0 2023-10-06T02:26:21.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.273+0000 7fdf2a9e3000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3839aa620 con 0x55c383b32cb0 2023-10-06T02:26:21.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.273+0000 7fdf2441f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c383b36aa0 0x55c383b29880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.273+0000 7fdf2441f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c383b36aa0 0x55c383b29880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43376/0 (socket says 172.21.15.6:43376) 2023-10-06T02:26:21.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.273+0000 7fdf2441f700 1 -- 172.21.15.6:0/940900577 learned_addr learned my addr 172.21.15.6:0/940900577 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:21.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.273+0000 7fdf2341d700 1 --2- 172.21.15.6:0/940900577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c383b32cb0 0x55c383b34b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.273+0000 7fdf23c1e700 1 --2- 172.21.15.6:0/940900577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c383aa77a0 0x55c383aa70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2441f700 1 -- 172.21.15.6:0/940900577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c383b32cb0 msgr2=0x55c383b34b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2441f700 1 --2- 172.21.15.6:0/940900577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c383b32cb0 0x55c383b34b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2441f700 1 -- 172.21.15.6:0/940900577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c383aa77a0 msgr2=0x55c383aa70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2441f700 1 --2- 172.21.15.6:0/940900577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c383aa77a0 0x55c383aa70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2441f700 1 -- 172.21.15.6:0/940900577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c005cf0 con 0x55c383b36aa0 2023-10-06T02:26:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2441f700 1 --2- 172.21.15.6:0/940900577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c383b36aa0 0x55c383b29880 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fdf14001550 tx=0x7fdf14006b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9672b4042f6fb74 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2241b700 1 -- 172.21.15.6:0/940900577 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14004150 con 0x55c383b36aa0 2023-10-06T02:26:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2241b700 1 -- 172.21.15.6:0/940900577 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf14013460 con 0x55c383b36aa0 2023-10-06T02:26:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2241b700 1 -- 172.21.15.6:0/940900577 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14013800 con 0x55c383b36aa0 2023-10-06T02:26:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2a9e3000 1 -- 172.21.15.6:0/940900577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c383b36aa0 msgr2=0x55c383b29880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2a9e3000 1 --2- 172.21.15.6:0/940900577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c383b36aa0 0x55c383b29880 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fdf14001550 tx=0x7fdf14006b10 comp rx=0 tx=0).stop 2023-10-06T02:26:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2a9e3000 1 -- 172.21.15.6:0/940900577 shutdown_connections 2023-10-06T02:26:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2a9e3000 1 --2- 172.21.15.6:0/940900577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c383b36aa0 0x55c383b29880 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2a9e3000 1 --2- 172.21.15.6:0/940900577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c383aa77a0 0x55c383aa70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2a9e3000 1 --2- 172.21.15.6:0/940900577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c383b32cb0 0x55c383b34b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2a9e3000 1 -- 172.21.15.6:0/940900577 >> 172.21.15.6:0/940900577 conn(0x55c383a5fd50 msgr2=0x55c383b35820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2a9e3000 1 -- 172.21.15.6:0/940900577 shutdown_connections 2023-10-06T02:26:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.274+0000 7fdf2a9e3000 1 -- 172.21.15.6:0/940900577 wait complete. 2023-10-06T02:26:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.275+0000 7fdf2a9e3000 1 Processor -- start 2023-10-06T02:26:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.275+0000 7fdf2a9e3000 1 -- start start 2023-10-06T02:26:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.276+0000 7fdf2a9e3000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c383aa77a0 0x55c383b3e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.276+0000 7fdf2a9e3000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c383b32cb0 0x55c383b3c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.276+0000 7fdf2a9e3000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c383b36aa0 0x55c383b2c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.276+0000 7fdf2a9e3000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3839a1400 con 0x55c383b32cb0 2023-10-06T02:26:21.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.276+0000 7fdf2a9e3000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c383b2cac0 con 0x55c383b36aa0 2023-10-06T02:26:21.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.276+0000 7fdf2a9e3000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c383b30160 con 0x55c383aa77a0 2023-10-06T02:26:21.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.276+0000 7fdf2341d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c383b32cb0 0x55c383b3c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.276+0000 7fdf2341d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c383b32cb0 0x55c383b3c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43382/0 (socket says 172.21.15.6:43382) 2023-10-06T02:26:21.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.276+0000 7fdf2341d700 1 -- 172.21.15.6:0/699906007 learned_addr learned my addr 172.21.15.6:0/699906007 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:21.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.276+0000 7fdf23c1e700 1 --2- 172.21.15.6:0/699906007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c383aa77a0 0x55c383b3e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.276+0000 7fdf2441f700 1 --2- 172.21.15.6:0/699906007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c383b36aa0 0x55c383b2c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.276+0000 7fdf2341d700 1 -- 172.21.15.6:0/699906007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c383aa77a0 msgr2=0x55c383b3e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.276+0000 7fdf2341d700 1 --2- 172.21.15.6:0/699906007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c383aa77a0 0x55c383b3e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.276+0000 7fdf2341d700 1 -- 172.21.15.6:0/699906007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c383b36aa0 msgr2=0x55c383b2c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.276+0000 7fdf2341d700 1 --2- 172.21.15.6:0/699906007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c383b36aa0 0x55c383b2c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.276+0000 7fdf2341d700 1 -- 172.21.15.6:0/699906007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3839d31c0 con 0x55c383b32cb0 2023-10-06T02:26:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.276+0000 7fdf2341d700 1 --2- 172.21.15.6:0/699906007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c383b32cb0 0x55c383b3c980 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c012000 tx=0x7fdf0c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:21.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.277+0000 7fdf20c18700 1 -- 172.21.15.6:0/699906007 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c0054f0 con 0x55c383b32cb0 2023-10-06T02:26:21.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.277+0000 7fdf20c18700 1 -- 172.21.15.6:0/699906007 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0c0089d0 con 0x55c383b32cb0 2023-10-06T02:26:21.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.277+0000 7fdf20c18700 1 -- 172.21.15.6:0/699906007 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c012410 con 0x55c383b32cb0 2023-10-06T02:26:21.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.277+0000 7fdf2a9e3000 1 -- 172.21.15.6:0/699906007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c3839acae0 con 0x55c383b32cb0 2023-10-06T02:26:21.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.277+0000 7fdf2a9e3000 1 -- 172.21.15.6:0/699906007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c3839ac540 con 0x55c383b32cb0 2023-10-06T02:26:21.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.278+0000 7fdf20c18700 1 -- 172.21.15.6:0/699906007 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf0c012780 con 0x55c383b32cb0 2023-10-06T02:26:21.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.278+0000 7fdf20c18700 1 --2- 172.21.15.6:0/699906007 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdf040658c0 0x7fdf04067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.278+0000 7fdf20c18700 1 -- 172.21.15.6:0/699906007 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7410+0+0 (secure 0 0 0) 0x7fdf0c085e50 con 0x55c383b32cb0 2023-10-06T02:26:21.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.279+0000 7fdf23c1e700 1 --2- 172.21.15.6:0/699906007 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdf040658c0 0x7fdf04067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.279+0000 7fdf2a9e3000 1 --2- 172.21.15.6:0/699906007 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c383a8d2a0 0x55c383a8d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.279+0000 7fdf2a9e3000 1 -- 172.21.15.6:0/699906007 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e107) v8 -- 0x55c383a8dbe0 con 0x55c383a8d2a0 2023-10-06T02:26:21.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.279+0000 7fdf2441f700 1 --2- 172.21.15.6:0/699906007 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c383a8d2a0 0x55c383a8d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.279+0000 7fdf23c1e700 1 --2- 172.21.15.6:0/699906007 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdf040658c0 0x7fdf04067d70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0011e0 tx=0x7fdf1c001710 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:21.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.279+0000 7fdf2441f700 1 --2- 172.21.15.6:0/699906007 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c383a8d2a0 0x55c383a8d6a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:21.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.280+0000 7fdf2441f700 1 -- 172.21.15.6:0/699906007 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(1 400.00000000 [delete] v107'62 uv62 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fdf140135d0 con 0x55c383a8d2a0 2023-10-06T02:26:21.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.280+0000 7fdf2a9e3000 1 -- 172.21.15.6:0/699906007 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c383a8d2a0 msgr2=0x55c383a8d6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.280+0000 7fdf2a9e3000 1 --2- 172.21.15.6:0/699906007 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c383a8d2a0 0x55c383a8d6a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.280+0000 7fdf2a9e3000 1 -- 172.21.15.6:0/699906007 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdf040658c0 msgr2=0x7fdf04067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.280+0000 7fdf2a9e3000 1 --2- 172.21.15.6:0/699906007 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdf040658c0 0x7fdf04067d70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0011e0 tx=0x7fdf1c001710 comp rx=0 tx=0).stop 2023-10-06T02:26:21.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.280+0000 7fdf2a9e3000 1 -- 172.21.15.6:0/699906007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c383b32cb0 msgr2=0x55c383b3c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.280+0000 7fdf2a9e3000 1 --2- 172.21.15.6:0/699906007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c383b32cb0 0x55c383b3c980 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c012000 tx=0x7fdf0c016000 comp rx=0 tx=0).stop 2023-10-06T02:26:21.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.281+0000 7fdf2441f700 1 -- 172.21.15.6:0/699906007 reap_dead start 2023-10-06T02:26:21.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.281+0000 7fdf2a9e3000 1 -- 172.21.15.6:0/699906007 shutdown_connections 2023-10-06T02:26:21.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.281+0000 7fdf2a9e3000 1 -- 172.21.15.6:0/699906007 >> 172.21.15.6:0/699906007 conn(0x55c383a5fd50 msgr2=0x55c383a61620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:21.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.281+0000 7fdf2a9e3000 1 -- 172.21.15.6:0/699906007 shutdown_connections 2023-10-06T02:26:21.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.281+0000 7fdf2a9e3000 1 -- 172.21.15.6:0/699906007 wait complete. 2023-10-06T02:26:21.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:26:21.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.447+0000 7fd86d92e700 1 Processor -- start 2023-10-06T02:26:21.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.447+0000 7fd86d92e700 1 -- start start 2023-10-06T02:26:21.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.447+0000 7fd86d92e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8680d0400 0x7fd8680b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.448+0000 7fd86d92e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8680d07d0 0x7fd8680b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.448+0000 7fd86d92e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8680b6170 con 0x7fd8680ccd40 2023-10-06T02:26:21.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.448+0000 7fd86d92e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86815dd40 con 0x7fd8680d07d0 2023-10-06T02:26:21.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.448+0000 7fd86d92e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86815e020 con 0x7fd8680d0400 2023-10-06T02:26:21.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.448+0000 7fd8677fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8680d07d0 0x7fd8680b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.448+0000 7fd8677fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8680d07d0 0x7fd8680b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43384/0 (socket says 172.21.15.6:43384) 2023-10-06T02:26:21.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.448+0000 7fd8677fe700 1 -- 172.21.15.6:0/4007412259 learned_addr learned my addr 172.21.15.6:0/4007412259 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:21.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.448+0000 7fd866ffd700 1 --2- 172.21.15.6:0/4007412259 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8680d0400 0x7fd8680b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.448+0000 7fd8677fe700 1 -- 172.21.15.6:0/4007412259 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8680d0400 msgr2=0x7fd8680b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:21.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.448+0000 7fd8677fe700 1 --2- 172.21.15.6:0/4007412259 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8680d0400 0x7fd8680b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.448+0000 7fd8677fe700 1 -- 172.21.15.6:0/4007412259 >> v1:172.21.15.175:6789/0 conn(0x7fd8680ccd40 legacy=0x7fd8680cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.448+0000 7fd8677fe700 1 -- 172.21.15.6:0/4007412259 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8680ceaa0 con 0x7fd8680d07d0 2023-10-06T02:26:21.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.448+0000 7fd866ffd700 1 --2- 172.21.15.6:0/4007412259 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8680d0400 0x7fd8680b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:21.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.448+0000 7fd8677fe700 1 --2- 172.21.15.6:0/4007412259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680d07d0 0x7fd8680b3aa0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fd8600099b0 tx=0x7fd860009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca145306505f7181 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:21.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.448+0000 7fd865ffb700 1 -- 172.21.15.6:0/4007412259 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86000b860 con 0x7fd8680d07d0 2023-10-06T02:26:21.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.448+0000 7fd865ffb700 1 -- 172.21.15.6:0/4007412259 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86000b9c0 con 0x7fd8680d07d0 2023-10-06T02:26:21.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.448+0000 7fd865ffb700 1 -- 172.21.15.6:0/4007412259 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86000bd60 con 0x7fd8680d07d0 2023-10-06T02:26:21.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.449+0000 7fd86d92e700 1 -- 172.21.15.6:0/4007412259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680d07d0 msgr2=0x7fd8680b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.449+0000 7fd86d92e700 1 --2- 172.21.15.6:0/4007412259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680d07d0 0x7fd8680b3aa0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fd8600099b0 tx=0x7fd860009250 comp rx=0 tx=0).stop 2023-10-06T02:26:21.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.449+0000 7fd86d92e700 1 -- 172.21.15.6:0/4007412259 shutdown_connections 2023-10-06T02:26:21.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.449+0000 7fd86d92e700 1 --2- 172.21.15.6:0/4007412259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680d07d0 0x7fd8680b3aa0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.449+0000 7fd86d92e700 1 --2- 172.21.15.6:0/4007412259 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8680d0400 0x7fd8680b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.449+0000 7fd86d92e700 1 -- 172.21.15.6:0/4007412259 >> 172.21.15.6:0/4007412259 conn(0x7fd86806a220 msgr2=0x7fd86806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:21.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.449+0000 7fd86d92e700 1 -- 172.21.15.6:0/4007412259 shutdown_connections 2023-10-06T02:26:21.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.449+0000 7fd86d92e700 1 -- 172.21.15.6:0/4007412259 wait complete. 2023-10-06T02:26:21.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.450+0000 7fd86d92e700 1 Processor -- start 2023-10-06T02:26:21.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.450+0000 7fd86d92e700 1 -- start start 2023-10-06T02:26:21.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.451+0000 7fd86d92e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8680ccd40 0x7fd868148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.451+0000 7fd86d92e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680d0400 0x7fd86815b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.451+0000 7fd86d92e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8680d07d0 0x7fd8680b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.451+0000 7fd86d92e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd868145920 con 0x7fd8680d0400 2023-10-06T02:26:21.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.451+0000 7fd86d92e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86816d630 con 0x7fd8680ccd40 2023-10-06T02:26:21.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.451+0000 7fd86d92e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86816d910 con 0x7fd8680d07d0 2023-10-06T02:26:21.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.451+0000 7fd8667fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680d0400 0x7fd86815b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.451+0000 7fd8667fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680d0400 0x7fd86815b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43396/0 (socket says 172.21.15.6:43396) 2023-10-06T02:26:21.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.451+0000 7fd8667fc700 1 -- 172.21.15.6:0/1757419877 learned_addr learned my addr 172.21.15.6:0/1757419877 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:21.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.451+0000 7fd8677fe700 1 --2- 172.21.15.6:0/1757419877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8680d07d0 0x7fd8680b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.451+0000 7fd866ffd700 1 --2- 172.21.15.6:0/1757419877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8680ccd40 0x7fd868148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.452+0000 7fd8667fc700 1 -- 172.21.15.6:0/1757419877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8680d07d0 msgr2=0x7fd8680b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.452+0000 7fd8667fc700 1 --2- 172.21.15.6:0/1757419877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8680d07d0 0x7fd8680b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.452+0000 7fd8667fc700 1 -- 172.21.15.6:0/1757419877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8680ccd40 msgr2=0x7fd868148240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.452+0000 7fd8667fc700 1 --2- 172.21.15.6:0/1757419877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8680ccd40 0x7fd868148240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.452+0000 7fd8667fc700 1 -- 172.21.15.6:0/1757419877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8600094f0 con 0x7fd8680d0400 2023-10-06T02:26:21.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.452+0000 7fd8667fc700 1 --2- 172.21.15.6:0/1757419877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680d0400 0x7fd86815b120 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fd85000c590 tx=0x7fd85000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:21.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.452+0000 7fd85effd700 1 -- 172.21.15.6:0/1757419877 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850011590 con 0x7fd8680d0400 2023-10-06T02:26:21.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.452+0000 7fd85effd700 1 -- 172.21.15.6:0/1757419877 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8500116f0 con 0x7fd8680d0400 2023-10-06T02:26:21.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.452+0000 7fd86d92e700 1 -- 172.21.15.6:0/1757419877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86816dbf0 con 0x7fd8680d0400 2023-10-06T02:26:21.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.452+0000 7fd85effd700 1 -- 172.21.15.6:0/1757419877 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850011ab0 con 0x7fd8680d0400 2023-10-06T02:26:21.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.452+0000 7fd86d92e700 1 -- 172.21.15.6:0/1757419877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd868148780 con 0x7fd8680d0400 2023-10-06T02:26:21.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.453+0000 7fd86d92e700 1 -- 172.21.15.6:0/1757419877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd868088760 con 0x7fd8680d0400 2023-10-06T02:26:21.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.453+0000 7fd85effd700 1 -- 172.21.15.6:0/1757419877 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd85001b3b0 con 0x7fd8680d0400 2023-10-06T02:26:21.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.454+0000 7fd85effd700 1 --2- 172.21.15.6:0/1757419877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd848066f30 0x7fd8480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:21.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.454+0000 7fd85effd700 1 -- 172.21.15.6:0/1757419877 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7410+0+0 (secure 0 0 0) 0x7fd850084190 con 0x7fd8680d0400 2023-10-06T02:26:21.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.454+0000 7fd866ffd700 1 --2- 172.21.15.6:0/1757419877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd848066f30 0x7fd8480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:21.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.454+0000 7fd866ffd700 1 --2- 172.21.15.6:0/1757419877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd848066f30 0x7fd8480693e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd858009fd0 tx=0x7fd858009940 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:21.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.458+0000 7fd85effd700 1 -- 172.21.15.6:0/1757419877 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd850050d50 con 0x7fd8680d0400 2023-10-06T02:26:21.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.695+0000 7fd86d92e700 1 -- 172.21.15.6:0/1757419877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fd8680ced80 con 0x7fd8680d0400 2023-10-06T02:26:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.948+0000 7fd85effd700 1 -- 172.21.15.6:0/1757419877 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v166) v1 ==== 162+0+0 (secure 0 0 0) 0x7fd8500170b0 con 0x7fd8680d0400 2023-10-06T02:26:21.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.950+0000 7fd86d92e700 1 -- 172.21.15.6:0/1757419877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd848066f30 msgr2=0x7fd8480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.950+0000 7fd86d92e700 1 --2- 172.21.15.6:0/1757419877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd848066f30 0x7fd8480693e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd858009fd0 tx=0x7fd858009940 comp rx=0 tx=0).stop 2023-10-06T02:26:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.950+0000 7fd86d92e700 1 -- 172.21.15.6:0/1757419877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680d0400 msgr2=0x7fd86815b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.950+0000 7fd86d92e700 1 --2- 172.21.15.6:0/1757419877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680d0400 0x7fd86815b120 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fd85000c590 tx=0x7fd85000c950 comp rx=0 tx=0).stop 2023-10-06T02:26:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.950+0000 7fd86d92e700 1 -- 172.21.15.6:0/1757419877 shutdown_connections 2023-10-06T02:26:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.950+0000 7fd86d92e700 1 --2- 172.21.15.6:0/1757419877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8680d07d0 0x7fd8680b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.950+0000 7fd86d92e700 1 --2- 172.21.15.6:0/1757419877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8680ccd40 0x7fd868148240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.950+0000 7fd86d92e700 1 --2- 172.21.15.6:0/1757419877 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd848066f30 0x7fd8480693e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.950+0000 7fd86d92e700 1 --2- 172.21.15.6:0/1757419877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680d0400 0x7fd86815b120 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.950+0000 7fd86d92e700 1 -- 172.21.15.6:0/1757419877 >> 172.21.15.6:0/1757419877 conn(0x7fd86806a220 msgr2=0x7fd868155d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.950+0000 7fd86d92e700 1 -- 172.21.15.6:0/1757419877 shutdown_connections 2023-10-06T02:26:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:21.950+0000 7fd86d92e700 1 -- 172.21.15.6:0/1757419877 wait complete. 2023-10-06T02:26:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:26:22.367 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:22.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.497+0000 7f27059ea700 1 Processor -- start 2023-10-06T02:26:22.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.497+0000 7f27059ea700 1 -- start start 2023-10-06T02:26:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.498+0000 7f27059ea700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2700159400 0x7f27000ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.498+0000 7f27059ea700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f27000d05d0 0x7f27000b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.498+0000 7f27059ea700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27000b3560 con 0x7f27000cd030 2023-10-06T02:26:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.498+0000 7f27059ea700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27000cf6f0 con 0x7f27000d05d0 2023-10-06T02:26:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.498+0000 7f27059ea700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27000cf9d0 con 0x7f2700159400 2023-10-06T02:26:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.498+0000 7f27051e9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f27000d05d0 0x7f27000b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.498+0000 7f27049e8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2700159400 0x7f27000ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:22.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.498+0000 7f26fffff700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f27000cd030 0x7f27000cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:58112/0 (socket says 172.21.15.6:58112) 2023-10-06T02:26:22.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.498+0000 7f26fffff700 1 -- 172.21.15.6:0/3605639427 learned_addr learned my addr 172.21.15.6:0/3605639427 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:22.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.498+0000 7f27051e9700 1 -- 172.21.15.6:0/3605639427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2700159400 msgr2=0x7f27000ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:22.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.498+0000 7f27051e9700 1 --2- 172.21.15.6:0/3605639427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2700159400 0x7f27000ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:22.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.498+0000 7f27051e9700 1 -- 172.21.15.6:0/3605639427 >> v1:172.21.15.175:6789/0 conn(0x7f27000cd030 legacy=0x7f27000cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:22.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.498+0000 7f26ff7fe700 1 -- 172.21.15.6:0/3605639427 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837868485 0 0) 0x7f27000b3560 con 0x7f27000cd030 2023-10-06T02:26:22.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.498+0000 7f27051e9700 1 -- 172.21.15.6:0/3605639427 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27000b2f10 con 0x7f27000d05d0 2023-10-06T02:26:22.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.498+0000 7f27049e8700 1 --2- 172.21.15.6:0/3605639427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2700159400 0x7f27000ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:26:22.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.499+0000 7f27051e9700 1 --2- 172.21.15.6:0/3605639427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27000d05d0 0x7f27000b39f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f26f00098e0 tx=0x7f26f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d85b79f3d9dc8af3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:22.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.499+0000 7f26ff7fe700 1 -- 172.21.15.6:0/3605639427 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f000b640 con 0x7f27000d05d0 2023-10-06T02:26:22.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.499+0000 7f26ff7fe700 1 -- 172.21.15.6:0/3605639427 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f000b7a0 con 0x7f27000d05d0 2023-10-06T02:26:22.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.499+0000 7f26ff7fe700 1 -- 172.21.15.6:0/3605639427 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f000bb40 con 0x7f27000d05d0 2023-10-06T02:26:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.499+0000 7f27059ea700 1 -- 172.21.15.6:0/3605639427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27000d05d0 msgr2=0x7f27000b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.499+0000 7f27059ea700 1 --2- 172.21.15.6:0/3605639427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27000d05d0 0x7f27000b39f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f26f00098e0 tx=0x7f26f00091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.499+0000 7f27059ea700 1 -- 172.21.15.6:0/3605639427 shutdown_connections 2023-10-06T02:26:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.499+0000 7f27059ea700 1 --2- 172.21.15.6:0/3605639427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27000d05d0 0x7f27000b39f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.499+0000 7f27059ea700 1 --2- 172.21.15.6:0/3605639427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2700159400 0x7f27000ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.499+0000 7f27059ea700 1 -- 172.21.15.6:0/3605639427 >> 172.21.15.6:0/3605639427 conn(0x7f270006ac10 msgr2=0x7f2700068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.500+0000 7f27059ea700 1 -- 172.21.15.6:0/3605639427 shutdown_connections 2023-10-06T02:26:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.500+0000 7f27059ea700 1 -- 172.21.15.6:0/3605639427 wait complete. 2023-10-06T02:26:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.501+0000 7f27059ea700 1 Processor -- start 2023-10-06T02:26:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.501+0000 7f27059ea700 1 -- start start 2023-10-06T02:26:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f27059ea700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27000cd030 0x7f27000b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f27059ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27000d05d0 0x7f270015d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f27059ea700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2700159400 0x7f27000b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f27059ea700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27000b2600 con 0x7f27000d05d0 2023-10-06T02:26:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f27059ea700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27000b1c30 con 0x7f2700159400 2023-10-06T02:26:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f27059ea700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27000b1020 con 0x7f27000cd030 2023-10-06T02:26:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f26fffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27000d05d0 0x7f270015d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f26fffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27000d05d0 0x7f270015d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43412/0 (socket says 172.21.15.6:43412) 2023-10-06T02:26:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f26fffff700 1 -- 172.21.15.6:0/2007958846 learned_addr learned my addr 172.21.15.6:0/2007958846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f27051e9700 1 --2- 172.21.15.6:0/2007958846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2700159400 0x7f27000b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f27049e8700 1 --2- 172.21.15.6:0/2007958846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27000cd030 0x7f27000b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f26fffff700 1 -- 172.21.15.6:0/2007958846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27000cd030 msgr2=0x7f27000b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f26fffff700 1 --2- 172.21.15.6:0/2007958846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27000cd030 0x7f27000b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f26fffff700 1 -- 172.21.15.6:0/2007958846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2700159400 msgr2=0x7f27000b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f26fffff700 1 --2- 172.21.15.6:0/2007958846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2700159400 0x7f27000b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f26fffff700 1 -- 172.21.15.6:0/2007958846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f8009a20 con 0x7f27000d05d0 2023-10-06T02:26:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f26fffff700 1 --2- 172.21.15.6:0/2007958846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27000d05d0 0x7f270015d730 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f26f400c7e0 tx=0x7f26f4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f26fcff9700 1 -- 172.21.15.6:0/2007958846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4005b30 con 0x7f27000d05d0 2023-10-06T02:26:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f26fcff9700 1 -- 172.21.15.6:0/2007958846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f4005c90 con 0x7f27000d05d0 2023-10-06T02:26:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f27059ea700 1 -- 172.21.15.6:0/2007958846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f0009420 con 0x7f27000d05d0 2023-10-06T02:26:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f26fcff9700 1 -- 172.21.15.6:0/2007958846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4007300 con 0x7f27000d05d0 2023-10-06T02:26:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.502+0000 7f27059ea700 1 -- 172.21.15.6:0/2007958846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27000b18c0 con 0x7f27000d05d0 2023-10-06T02:26:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.503+0000 7f27059ea700 1 -- 172.21.15.6:0/2007958846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27000cc170 con 0x7f27000d05d0 2023-10-06T02:26:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.504+0000 7f26fcff9700 1 -- 172.21.15.6:0/2007958846 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26f40076b0 con 0x7f27000d05d0 2023-10-06T02:26:22.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.504+0000 7f26fcff9700 1 --2- 172.21.15.6:0/2007958846 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f26ec066f30 0x7f26ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:22.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.504+0000 7f26fcff9700 1 -- 172.21.15.6:0/2007958846 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7410+0+0 (secure 0 0 0) 0x7f26f4084720 con 0x7f27000d05d0 2023-10-06T02:26:22.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.504+0000 7f27049e8700 1 --2- 172.21.15.6:0/2007958846 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f26ec066f30 0x7f26ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:22.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.505+0000 7f27049e8700 1 --2- 172.21.15.6:0/2007958846 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f26ec066f30 0x7f26ec0693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f26f80099f0 tx=0x7f26f800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:22.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.508+0000 7f26fcff9700 1 -- 172.21.15.6:0/2007958846 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26f40512c0 con 0x7f27000d05d0 2023-10-06T02:26:22.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.748+0000 7f27059ea700 1 -- 172.21.15.6:0/2007958846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27000b1da0 con 0x7f27000d05d0 2023-10-06T02:26:22.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.748+0000 7f26fcff9700 1 -- 172.21.15.6:0/2007958846 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 167 v167) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f26f40548e0 con 0x7f27000d05d0 2023-10-06T02:26:22.749 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:22.749 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":167,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":167,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:21.948846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8661},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8661":{"gid":8661,"name":"a","rank":0,"incarnation":167,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/3081379602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3081379602},{"type":"v1","addr":"172.21.15.6:6835","nonce":3081379602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:22.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.751+0000 7f27059ea700 1 -- 172.21.15.6:0/2007958846 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f26ec066f30 msgr2=0x7f26ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:22.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.751+0000 7f27059ea700 1 --2- 172.21.15.6:0/2007958846 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f26ec066f30 0x7f26ec0693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f26f80099f0 tx=0x7f26f800b040 comp rx=0 tx=0).stop 2023-10-06T02:26:22.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.751+0000 7f27059ea700 1 -- 172.21.15.6:0/2007958846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27000d05d0 msgr2=0x7f270015d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.751+0000 7f27059ea700 1 --2- 172.21.15.6:0/2007958846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27000d05d0 0x7f270015d730 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f26f400c7e0 tx=0x7f26f4007df0 comp rx=0 tx=0).stop 2023-10-06T02:26:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.751+0000 7f27059ea700 1 -- 172.21.15.6:0/2007958846 shutdown_connections 2023-10-06T02:26:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.751+0000 7f27059ea700 1 --2- 172.21.15.6:0/2007958846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2700159400 0x7f27000b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.751+0000 7f27059ea700 1 --2- 172.21.15.6:0/2007958846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27000cd030 0x7f27000b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.751+0000 7f27059ea700 1 --2- 172.21.15.6:0/2007958846 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f26ec066f30 0x7f26ec0693e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.751+0000 7f27059ea700 1 --2- 172.21.15.6:0/2007958846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27000d05d0 0x7f270015d730 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.751+0000 7f27059ea700 1 -- 172.21.15.6:0/2007958846 >> 172.21.15.6:0/2007958846 conn(0x7f270006ac10 msgr2=0x7f2700155d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.751+0000 7f27059ea700 1 -- 172.21.15.6:0/2007958846 shutdown_connections 2023-10-06T02:26:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:22.751+0000 7f27059ea700 1 -- 172.21.15.6:0/2007958846 wait complete. 2023-10-06T02:26:22.753 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 167 2023-10-06T02:26:22.763 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 167, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:26:21.948846+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 107, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8661}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8661': {'gid': 8661, 'name': 'a', 'rank': 0, 'incarnation': 167, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.6:6835/3081379602', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 3081379602}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 3081379602}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:26:22.763 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8661:up:replay 2023-10-06T02:26:22.763 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2023-10-06T02:26:28.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.298+0000 7f7716b24700 1 Processor -- start 2023-10-06T02:26:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.298+0000 7f7716b24700 1 -- start start 2023-10-06T02:26:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.299+0000 7f7716b24700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f77100cf1a0 0x7f77100cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.299+0000 7f7716b24700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f77101597d0 0x7f77100d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.299+0000 7f7716b24700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77100b3560 con 0x7f7710159400 2023-10-06T02:26:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.299+0000 7f7716b24700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77100cf6f0 con 0x7f77101597d0 2023-10-06T02:26:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.299+0000 7f7716b24700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77100cf9d0 con 0x7f77100cf1a0 2023-10-06T02:26:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.299+0000 7f7716323700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f77101597d0 0x7f77100d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.299+0000 7f7715b22700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7710159400 0x7f77100ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43262/0 (socket says 172.21.15.6:43262) 2023-10-06T02:26:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.299+0000 7f7715b22700 1 -- 172.21.15.6:0/2238742081 learned_addr learned my addr 172.21.15.6:0/2238742081 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.299+0000 7f7715321700 1 --2- 172.21.15.6:0/2238742081 >> v2:172.21.15.175:3300/0 conn(0x7f77100cf1a0 0x7f77100cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.300+0000 7f7716323700 1 -- 172.21.15.6:0/2238742081 >> v2:172.21.15.175:3300/0 conn(0x7f77100cf1a0 msgr2=0x7f77100cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.300+0000 7f7716323700 1 --2- 172.21.15.6:0/2238742081 >> v2:172.21.15.175:3300/0 conn(0x7f77100cf1a0 0x7f77100cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.300+0000 7f7716323700 1 -- 172.21.15.6:0/2238742081 >> v1:172.21.15.6:6789/0 conn(0x7f7710159400 legacy=0x7f77100ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.300+0000 7f7714b20700 1 -- 172.21.15.6:0/2238742081 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677645658 0 0) 0x7f77100b3560 con 0x7f7710159400 2023-10-06T02:26:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.300+0000 7f7716323700 1 -- 172.21.15.6:0/2238742081 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77100b2f10 con 0x7f77101597d0 2023-10-06T02:26:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.300+0000 7f7715321700 1 --2- 172.21.15.6:0/2238742081 >> v2:172.21.15.175:3300/0 conn(0x7f77100cf1a0 0x7f77100cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.300+0000 7f7716323700 1 --2- 172.21.15.6:0/2238742081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77101597d0 0x7f77100d0400 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f771015d0f0 tx=0x7f7700009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6ec59db3271191 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.300+0000 7f7714b20700 1 -- 172.21.15.6:0/2238742081 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770000e070 con 0x7f77101597d0 2023-10-06T02:26:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.300+0000 7f7714b20700 1 -- 172.21.15.6:0/2238742081 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770000bc30 con 0x7f77101597d0 2023-10-06T02:26:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.300+0000 7f7714b20700 1 -- 172.21.15.6:0/2238742081 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7700012430 con 0x7f77101597d0 2023-10-06T02:26:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.300+0000 7f7716b24700 1 -- 172.21.15.6:0/2238742081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77101597d0 msgr2=0x7f77100d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.300+0000 7f7716b24700 1 --2- 172.21.15.6:0/2238742081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77101597d0 0x7f77100d0400 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f771015d0f0 tx=0x7f7700009780 comp rx=0 tx=0).stop 2023-10-06T02:26:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.300+0000 7f7716b24700 1 -- 172.21.15.6:0/2238742081 shutdown_connections 2023-10-06T02:26:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.300+0000 7f7716b24700 1 --2- 172.21.15.6:0/2238742081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77101597d0 0x7f77100d0400 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.300+0000 7f7716b24700 1 --2- 172.21.15.6:0/2238742081 >> v2:172.21.15.175:3300/0 conn(0x7f77100cf1a0 0x7f77100cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.300+0000 7f7716b24700 1 -- 172.21.15.6:0/2238742081 >> 172.21.15.6:0/2238742081 conn(0x7f771006ac10 msgr2=0x7f7710068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.301+0000 7f7716b24700 1 -- 172.21.15.6:0/2238742081 shutdown_connections 2023-10-06T02:26:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.301+0000 7f7716b24700 1 -- 172.21.15.6:0/2238742081 wait complete. 2023-10-06T02:26:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.302+0000 7f7716b24700 1 Processor -- start 2023-10-06T02:26:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.302+0000 7f7716b24700 1 -- start start 2023-10-06T02:26:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.302+0000 7f7716b24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77100cf1a0 0x7f77100cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.302+0000 7f7716b24700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7710159400 0x7f771015bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.302+0000 7f7716b24700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77101597d0 0x7f771015c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.302+0000 7f7716b24700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771016a670 con 0x7f77100cf1a0 2023-10-06T02:26:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.302+0000 7f7716b24700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7710142460 con 0x7f77101597d0 2023-10-06T02:26:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.302+0000 7f7716b24700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771015db80 con 0x7f7710159400 2023-10-06T02:26:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.303+0000 7f7715b22700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77100cf1a0 0x7f77100cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.303+0000 7f7715b22700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77100cf1a0 0x7f77100cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43432/0 (socket says 172.21.15.6:43432) 2023-10-06T02:26:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.303+0000 7f7715b22700 1 -- 172.21.15.6:0/62344900 learned_addr learned my addr 172.21.15.6:0/62344900 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.303+0000 7f7716323700 1 --2- 172.21.15.6:0/62344900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77101597d0 0x7f771015c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.303+0000 7f7715321700 1 --2- 172.21.15.6:0/62344900 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7710159400 0x7f771015bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.303+0000 7f7715b22700 1 -- 172.21.15.6:0/62344900 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7710159400 msgr2=0x7f771015bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.303+0000 7f7715b22700 1 --2- 172.21.15.6:0/62344900 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7710159400 0x7f771015bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.303+0000 7f7715b22700 1 -- 172.21.15.6:0/62344900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77101597d0 msgr2=0x7f771015c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.303+0000 7f7715b22700 1 --2- 172.21.15.6:0/62344900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77101597d0 0x7f771015c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.303+0000 7f7715b22700 1 -- 172.21.15.6:0/62344900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7700009a20 con 0x7f77100cf1a0 2023-10-06T02:26:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.303+0000 7f7715321700 1 --2- 172.21.15.6:0/62344900 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7710159400 0x7f771015bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.303+0000 7f7715b22700 1 --2- 172.21.15.6:0/62344900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77100cf1a0 0x7f77100cb8b0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f770800c790 tx=0x7f7708007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.303+0000 7f770dffb700 1 -- 172.21.15.6:0/62344900 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77080072e0 con 0x7f77100cf1a0 2023-10-06T02:26:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.303+0000 7f770dffb700 1 -- 172.21.15.6:0/62344900 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7708007460 con 0x7f77100cf1a0 2023-10-06T02:26:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.303+0000 7f7716b24700 1 -- 172.21.15.6:0/62344900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771015d250 con 0x7f77100cf1a0 2023-10-06T02:26:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.303+0000 7f770dffb700 1 -- 172.21.15.6:0/62344900 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77080057f0 con 0x7f77100cf1a0 2023-10-06T02:26:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.303+0000 7f7716b24700 1 -- 172.21.15.6:0/62344900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771015d810 con 0x7f77100cf1a0 2023-10-06T02:26:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.304+0000 7f7716b24700 1 -- 172.21.15.6:0/62344900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77100b31f0 con 0x7f77100cf1a0 2023-10-06T02:26:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.305+0000 7f770dffb700 1 -- 172.21.15.6:0/62344900 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7708005be0 con 0x7f77100cf1a0 2023-10-06T02:26:28.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.305+0000 7f770dffb700 1 --2- 172.21.15.6:0/62344900 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f76fc066f30 0x7f76fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.305+0000 7f770dffb700 1 -- 172.21.15.6:0/62344900 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7410+0+0 (secure 0 0 0) 0x7f7708084050 con 0x7f77100cf1a0 2023-10-06T02:26:28.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.305+0000 7f7715321700 1 --2- 172.21.15.6:0/62344900 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f76fc066f30 0x7f76fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.306+0000 7f7715321700 1 --2- 172.21.15.6:0/62344900 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f76fc066f30 0x7f76fc0693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7704006f00 tx=0x7f7704008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:28.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.310+0000 7f770dffb700 1 -- 172.21.15.6:0/62344900 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f770804b5a0 con 0x7f77100cf1a0 2023-10-06T02:26:28.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.549+0000 7f7716b24700 1 -- 172.21.15.6:0/62344900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7710068420 con 0x7f77100cf1a0 2023-10-06T02:26:28.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.550+0000 7f770dffb700 1 -- 172.21.15.6:0/62344900 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 170 v170) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f7708017020 con 0x7f77100cf1a0 2023-10-06T02:26:28.552 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:28.552 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":170,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":170,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:24.958046+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8661},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8661":{"gid":8661,"name":"a","rank":0,"incarnation":167,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/3081379602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3081379602},{"type":"v1","addr":"172.21.15.6:6835","nonce":3081379602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:28.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.552+0000 7f7716b24700 1 -- 172.21.15.6:0/62344900 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f76fc066f30 msgr2=0x7f76fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.552+0000 7f7716b24700 1 --2- 172.21.15.6:0/62344900 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f76fc066f30 0x7f76fc0693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7704006f00 tx=0x7f7704008040 comp rx=0 tx=0).stop 2023-10-06T02:26:28.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.552+0000 7f7716b24700 1 -- 172.21.15.6:0/62344900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77100cf1a0 msgr2=0x7f77100cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.552+0000 7f7716b24700 1 --2- 172.21.15.6:0/62344900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77100cf1a0 0x7f77100cb8b0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f770800c790 tx=0x7f7708007c80 comp rx=0 tx=0).stop 2023-10-06T02:26:28.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.552+0000 7f7716b24700 1 -- 172.21.15.6:0/62344900 shutdown_connections 2023-10-06T02:26:28.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.552+0000 7f7716b24700 1 --2- 172.21.15.6:0/62344900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77101597d0 0x7f771015c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.552+0000 7f7716b24700 1 --2- 172.21.15.6:0/62344900 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f76fc066f30 0x7f76fc0693e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.552+0000 7f7716b24700 1 --2- 172.21.15.6:0/62344900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77100cf1a0 0x7f77100cb8b0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.552+0000 7f7716b24700 1 --2- 172.21.15.6:0/62344900 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7710159400 0x7f771015bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.552+0000 7f7716b24700 1 -- 172.21.15.6:0/62344900 >> 172.21.15.6:0/62344900 conn(0x7f771006ac10 msgr2=0x7f7710157340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:28.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.552+0000 7f7716b24700 1 -- 172.21.15.6:0/62344900 shutdown_connections 2023-10-06T02:26:28.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.552+0000 7f7716b24700 1 -- 172.21.15.6:0/62344900 wait complete. 2023-10-06T02:26:28.555 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 170 2023-10-06T02:26:28.565 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 170, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:26:24.958046+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 107, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8661}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8661': {'gid': 8661, 'name': 'a', 'rank': 0, 'incarnation': 167, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.6:6835/3081379602', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 3081379602}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 3081379602}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:26:28.565 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:26:28.565 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:26:28.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.683+0000 7f9550801700 1 Processor -- start 2023-10-06T02:26:28.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.683+0000 7f9550801700 1 -- start start 2023-10-06T02:26:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f9550801700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f954c15c900 0x7f954c0b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f9550801700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f954c0d0530 0x7f954c15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f9550801700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954c0ce640 con 0x7f954c068d90 2023-10-06T02:26:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f9550801700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954c15a440 con 0x7f954c15c900 2023-10-06T02:26:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f9550801700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954c15a9c0 con 0x7f954c0d0530 2023-10-06T02:26:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f954ad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f954c15c900 0x7f954c0b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f954a59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f954c068d90 0x7f954c0cfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40912/0 (socket says 172.21.15.6:40912) 2023-10-06T02:26:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f954a59c700 1 -- 172.21.15.6:0/1911093571 learned_addr learned my addr 172.21.15.6:0/1911093571 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f954b59e700 1 --2- 172.21.15.6:0/1911093571 >> v2:172.21.15.175:3300/0 conn(0x7f954c0d0530 0x7f954c15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f954ad9d700 1 -- 172.21.15.6:0/1911093571 >> v2:172.21.15.175:3300/0 conn(0x7f954c0d0530 msgr2=0x7f954c15abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f954ad9d700 1 --2- 172.21.15.6:0/1911093571 >> v2:172.21.15.175:3300/0 conn(0x7f954c0d0530 0x7f954c15abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f954ad9d700 1 -- 172.21.15.6:0/1911093571 >> v1:172.21.15.6:6789/0 conn(0x7f954c068d90 legacy=0x7f954c0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f954ad9d700 1 -- 172.21.15.6:0/1911093571 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c0cccf0 con 0x7f954c15c900 2023-10-06T02:26:28.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f9549d9b700 1 -- 172.21.15.6:0/1911093571 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730240734 0 0) 0x7f954c0ce640 con 0x7f954c068d90 2023-10-06T02:26:28.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f954ad9d700 1 --2- 172.21.15.6:0/1911093571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c15c900 0x7f954c0b5c00 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f954c089180 tx=0x7f9544009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3550e455ce77c53 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:28.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f9549d9b700 1 -- 172.21.15.6:0/1911093571 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954400e070 con 0x7f954c15c900 2023-10-06T02:26:28.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f9549d9b700 1 -- 172.21.15.6:0/1911093571 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954400bc30 con 0x7f954c15c900 2023-10-06T02:26:28.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.684+0000 7f9549d9b700 1 -- 172.21.15.6:0/1911093571 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544012430 con 0x7f954c15c900 2023-10-06T02:26:28.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.685+0000 7f9550801700 1 -- 172.21.15.6:0/1911093571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c15c900 msgr2=0x7f954c0b5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.685+0000 7f9550801700 1 --2- 172.21.15.6:0/1911093571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c15c900 0x7f954c0b5c00 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f954c089180 tx=0x7f9544009780 comp rx=0 tx=0).stop 2023-10-06T02:26:28.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.685+0000 7f9550801700 1 -- 172.21.15.6:0/1911093571 shutdown_connections 2023-10-06T02:26:28.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.685+0000 7f9550801700 1 --2- 172.21.15.6:0/1911093571 >> v2:172.21.15.175:3300/0 conn(0x7f954c0d0530 0x7f954c15abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.685+0000 7f9550801700 1 --2- 172.21.15.6:0/1911093571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c15c900 0x7f954c0b5c00 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.685+0000 7f9550801700 1 -- 172.21.15.6:0/1911093571 >> 172.21.15.6:0/1911093571 conn(0x7f954c06ac00 msgr2=0x7f954c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:28.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.685+0000 7f9550801700 1 -- 172.21.15.6:0/1911093571 shutdown_connections 2023-10-06T02:26:28.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.685+0000 7f9550801700 1 -- 172.21.15.6:0/1911093571 wait complete. 2023-10-06T02:26:28.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.686+0000 7f9550801700 1 Processor -- start 2023-10-06T02:26:28.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.686+0000 7f9550801700 1 -- start start 2023-10-06T02:26:28.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.687+0000 7f9550801700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c068d90 0x7f954c0cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.687+0000 7f9550801700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f954c0d0530 0x7f954c0c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.687+0000 7f9550801700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f954c15c900 0x7f954c0ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.687+0000 7f9550801700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0c5e20 con 0x7f954c068d90 2023-10-06T02:26:28.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.687+0000 7f9550801700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0c6100 con 0x7f954c15c900 2023-10-06T02:26:28.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.687+0000 7f9550801700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0c63e0 con 0x7f954c0d0530 2023-10-06T02:26:28.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.687+0000 7f954ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c068d90 0x7f954c0cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.687+0000 7f954ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c068d90 0x7f954c0cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38486/0 (socket says 172.21.15.6:38486) 2023-10-06T02:26:28.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.687+0000 7f954ad9d700 1 -- 172.21.15.6:0/4089363749 learned_addr learned my addr 172.21.15.6:0/4089363749 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:28.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.687+0000 7f954a59c700 1 --2- 172.21.15.6:0/4089363749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f954c0d0530 0x7f954c0c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.687+0000 7f954ad9d700 1 -- 172.21.15.6:0/4089363749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f954c0d0530 msgr2=0x7f954c0c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.687+0000 7f954ad9d700 1 --2- 172.21.15.6:0/4089363749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f954c0d0530 0x7f954c0c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.687+0000 7f954ad9d700 1 -- 172.21.15.6:0/4089363749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f954c15c900 msgr2=0x7f954c0ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.687+0000 7f954b59e700 1 --2- 172.21.15.6:0/4089363749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f954c15c900 0x7f954c0ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.687+0000 7f954ad9d700 1 --2- 172.21.15.6:0/4089363749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f954c15c900 0x7f954c0ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.687+0000 7f954ad9d700 1 -- 172.21.15.6:0/4089363749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9544009a20 con 0x7f954c068d90 2023-10-06T02:26:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.687+0000 7f954ad9d700 1 --2- 172.21.15.6:0/4089363749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c068d90 0x7f954c0cc320 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f9544013000 tx=0x7f9544019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.688+0000 7f9542ffd700 1 -- 172.21.15.6:0/4089363749 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544027470 con 0x7f954c068d90 2023-10-06T02:26:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.688+0000 7f9542ffd700 1 -- 172.21.15.6:0/4089363749 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9544027610 con 0x7f954c068d90 2023-10-06T02:26:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.688+0000 7f9550801700 1 -- 172.21.15.6:0/4089363749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954c0c66c0 con 0x7f954c068d90 2023-10-06T02:26:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.688+0000 7f9542ffd700 1 -- 172.21.15.6:0/4089363749 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440279d0 con 0x7f954c068d90 2023-10-06T02:26:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.688+0000 7f9550801700 1 -- 172.21.15.6:0/4089363749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c0c50b0 con 0x7f954c068d90 2023-10-06T02:26:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.689+0000 7f9542ffd700 1 -- 172.21.15.6:0/4089363749 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9544024070 con 0x7f954c068d90 2023-10-06T02:26:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.689+0000 7f9542ffd700 1 --2- 172.21.15.6:0/4089363749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f952c066f30 0x7f952c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.689+0000 7f9542ffd700 1 -- 172.21.15.6:0/4089363749 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7410+0+0 (secure 0 0 0) 0x7f9544087330 con 0x7f954c068d90 2023-10-06T02:26:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.690+0000 7f954a59c700 1 --2- 172.21.15.6:0/4089363749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f952c066f30 0x7f952c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.690+0000 7f954a59c700 1 --2- 172.21.15.6:0/4089363749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f952c066f30 0x7f952c0693e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9534007fd0 tx=0x7f9534009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.691+0000 7f955a2fab80 1 Processor -- start 2023-10-06T02:26:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.691+0000 7f955a2fab80 1 -- start start 2023-10-06T02:26:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.692+0000 7f955a2fab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf315cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.692+0000 7f955a2fab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31b2c0 0x55a8cf316200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.692+0000 7f955a2fab80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf31ca10 0x55a8cf316740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.692+0000 7f955a2fab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8cf270a70 con 0x55a8cf33ae50 2023-10-06T02:26:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.692+0000 7f955a2fab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8cf26e270 con 0x55a8cf31b2c0 2023-10-06T02:26:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.692+0000 7f955a2fab80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8cf26a060 con 0x55a8cf31ca10 2023-10-06T02:26:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.692+0000 7f954ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf315cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.692+0000 7f954ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf315cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38496/0 (socket says 172.21.15.6:38496) 2023-10-06T02:26:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.692+0000 7f954ad9d700 1 -- 172.21.15.6:0/3381882776 learned_addr learned my addr 172.21.15.6:0/3381882776 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.693+0000 7f954a59c700 1 --2- 172.21.15.6:0/3381882776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31b2c0 0x55a8cf316200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.693+0000 7f954ad9d700 1 -- 172.21.15.6:0/3381882776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf31ca10 msgr2=0x55a8cf316740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.693+0000 7f954ad9d700 1 --2- 172.21.15.6:0/3381882776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf31ca10 0x55a8cf316740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.693+0000 7f954ad9d700 1 -- 172.21.15.6:0/3381882776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31b2c0 msgr2=0x55a8cf316200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.693+0000 7f954ad9d700 1 --2- 172.21.15.6:0/3381882776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31b2c0 0x55a8cf316200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.693+0000 7f954ad9d700 1 -- 172.21.15.6:0/3381882776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8cf104270 con 0x55a8cf33ae50 2023-10-06T02:26:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.693+0000 7f954ad9d700 1 --2- 172.21.15.6:0/3381882776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf315cc0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f95440097c0 tx=0x7f9544020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355ef58d051adbcd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.693+0000 7f952bfff700 1 -- 172.21.15.6:0/3381882776 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954400e040 con 0x55a8cf33ae50 2023-10-06T02:26:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.693+0000 7f952bfff700 1 -- 172.21.15.6:0/3381882776 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9544053ef0 con 0x55a8cf33ae50 2023-10-06T02:26:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.693+0000 7f952bfff700 1 -- 172.21.15.6:0/3381882776 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544057bb0 con 0x55a8cf33ae50 2023-10-06T02:26:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.694+0000 7f955a2fab80 1 -- 172.21.15.6:0/3381882776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 msgr2=0x55a8cf315cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.694+0000 7f955a2fab80 1 --2- 172.21.15.6:0/3381882776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf315cc0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f95440097c0 tx=0x7f9544020040 comp rx=0 tx=0).stop 2023-10-06T02:26:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.694+0000 7f955a2fab80 1 -- 172.21.15.6:0/3381882776 shutdown_connections 2023-10-06T02:26:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.694+0000 7f955a2fab80 1 --2- 172.21.15.6:0/3381882776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf31ca10 0x55a8cf316740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.694+0000 7f955a2fab80 1 --2- 172.21.15.6:0/3381882776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf315cc0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.694+0000 7f955a2fab80 1 --2- 172.21.15.6:0/3381882776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31b2c0 0x55a8cf316200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.694+0000 7f955a2fab80 1 -- 172.21.15.6:0/3381882776 >> 172.21.15.6:0/3381882776 conn(0x55a8cf31ae80 msgr2=0x55a8cf31b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.694+0000 7f955a2fab80 1 -- 172.21.15.6:0/3381882776 shutdown_connections 2023-10-06T02:26:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.694+0000 7f955a2fab80 1 -- 172.21.15.6:0/3381882776 wait complete. 2023-10-06T02:26:28.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.694+0000 7f955a2fab80 1 -- start start 2023-10-06T02:26:28.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.694+0000 7f955a2fab80 1 Processor -- start 2023-10-06T02:26:28.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.695+0000 7f955a2fab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31b2c0 0x55a8cf336120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.695+0000 7f955a2fab80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf31ca10 0x55a8cf333630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.695+0000 7f955a2fab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf333b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.695+0000 7f955a2fab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8cf215890 con 0x55a8cf33ae50 2023-10-06T02:26:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.695+0000 7f955a2fab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8cf230ea0 con 0x55a8cf31b2c0 2023-10-06T02:26:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.695+0000 7f955a2fab80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8cf0ece30 con 0x55a8cf31ca10 2023-10-06T02:26:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.695+0000 7f955a2fab80 10 client.0 _ll_register_callbacks cb 0x55a8cf2dd020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:26:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.695+0000 7f954b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf333b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f954b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf333b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38510/0 (socket says 172.21.15.6:38510) 2023-10-06T02:26:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f954b59e700 1 -- 172.21.15.6:0/3259986522 learned_addr learned my addr 172.21.15.6:0/3259986522 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f954ad9d700 1 --2- 172.21.15.6:0/3259986522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31b2c0 0x55a8cf336120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f954a59c700 1 --2- 172.21.15.6:0/3259986522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf31ca10 0x55a8cf333630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f954b59e700 1 -- 172.21.15.6:0/3259986522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf31ca10 msgr2=0x55a8cf333630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f954b59e700 1 --2- 172.21.15.6:0/3259986522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf31ca10 0x55a8cf333630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f954b59e700 1 -- 172.21.15.6:0/3259986522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31b2c0 msgr2=0x55a8cf336120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f954b59e700 1 --2- 172.21.15.6:0/3259986522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31b2c0 0x55a8cf336120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f954b59e700 1 -- 172.21.15.6:0/3259986522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c0c50b0 con 0x55a8cf33ae50 2023-10-06T02:26:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f954b59e700 1 --2- 172.21.15.6:0/3259986522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf333b70 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f953c00e270 tx=0x7f953c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4792b203c1808f86 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f95297fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:26:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f95297fa700 1 -- 172.21.15.6:0/3259986522 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c00c070 con 0x55a8cf33ae50 2023-10-06T02:26:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f95297fa700 1 -- 172.21.15.6:0/3259986522 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 7410+0+0 (secure 0 0 0) 0x7f953c00eae0 con 0x55a8cf33ae50 2023-10-06T02:26:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f955a2fab80 1 -- 172.21.15.6:0/3259986522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8cf30e940 con 0x55a8cf33ae50 2023-10-06T02:26:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f95297fa700 1 -- 172.21.15.6:0/3259986522 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=170) v2 ==== 24+0+0 (secure 0 0 0) 0x7f953c00eeb0 con 0x55a8cf33ae50 2023-10-06T02:26:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f955a2fab80 10 client.8739 fetch_fsmap learned FSMap version 170 2023-10-06T02:26:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f955a2fab80 1 -- 172.21.15.6:0/3259986522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=170,monmap=2+}) v3 -- 0x55a8cf0a6fe0 con 0x55a8cf33ae50 2023-10-06T02:26:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.696+0000 7f95297fa700 1 -- 172.21.15.6:0/3259986522 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a8cf30e940 con 0x55a8cf33ae50 2023-10-06T02:26:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.697+0000 7f95297fa700 1 -- 172.21.15.6:0/3259986522 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 170) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f953c013410 con 0x55a8cf33ae50 2023-10-06T02:26:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.697+0000 7f955a2fab80 10 client.8739 fetch_fsmap finished waiting for FSMap version 170 2023-10-06T02:26:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.697+0000 7f955a2fab80 10 client.8739 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:26:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.697+0000 7f955a2fab80 20 client.8739 populate_metadata read hostname 'smithi006' 2023-10-06T02:26:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.697+0000 7f955a2fab80 1 --2- 172.21.15.6:0/3259986522 >> [v2:172.21.15.6:6833/3081379602,v1:172.21.15.6:6835/3081379602] conn(0x55a8cf3311a0 0x55a8cf331570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.697+0000 7f955a2fab80 4 client.8739 mds_command: new command op to 8661 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:26:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.697+0000 7f955a2fab80 1 -- 172.21.15.6:0/3259986522 --> [v2:172.21.15.6:6833/3081379602,v1:172.21.15.6:6835/3081379602] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8cf2eb870 con 0x55a8cf3311a0 2023-10-06T02:26:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.697+0000 7f954ad9d700 1 --2- 172.21.15.6:0/3259986522 >> [v2:172.21.15.6:6833/3081379602,v1:172.21.15.6:6835/3081379602] conn(0x55a8cf3311a0 0x55a8cf331570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.697+0000 7f95297fa700 10 client.8739 ms_handle_connect on v2:172.21.15.6:6833/3081379602 2023-10-06T02:26:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.697+0000 7f954ad9d700 1 --2- 172.21.15.6:0/3259986522 >> [v2:172.21.15.6:6833/3081379602,v1:172.21.15.6:6835/3081379602] conn(0x55a8cf3311a0 0x55a8cf331570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=644e64509bffdfe7 server_cookie=f5b5ad7d7e4f2cf3 in_seq=0 out_seq=0 2023-10-06T02:26:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.698+0000 7f95297fa700 1 -- 172.21.15.6:0/3259986522 <== mds.0 v2:172.21.15.6:6833/3081379602 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a8cf2eb870 con 0x55a8cf3311a0 2023-10-06T02:26:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.698+0000 7f95297fa700 10 client.8739 handle_command_reply: tid=0 2023-10-06T02:26:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.698+0000 7f955a2fab80 1 client.8739 shutdown 2023-10-06T02:26:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.698+0000 7f955a2fab80 1 -- 172.21.15.6:0/3259986522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 msgr2=0x55a8cf333b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.698+0000 7f955a2fab80 1 --2- 172.21.15.6:0/3259986522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf333b70 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f953c00e270 tx=0x7f953c008040 comp rx=0 tx=0).stop 2023-10-06T02:26:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.698+0000 7f955a2fab80 1 -- 172.21.15.6:0/3259986522 shutdown_connections 2023-10-06T02:26:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.698+0000 7f955a2fab80 1 --2- 172.21.15.6:0/3259986522 >> [v2:172.21.15.6:6833/3081379602,v1:172.21.15.6:6835/3081379602] conn(0x55a8cf3311a0 0x55a8cf331570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.698+0000 7f955a2fab80 1 --2- 172.21.15.6:0/3259986522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf333b70 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.698+0000 7f955a2fab80 1 --2- 172.21.15.6:0/3259986522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31b2c0 0x55a8cf336120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.698+0000 7f955a2fab80 1 --2- 172.21.15.6:0/3259986522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf31ca10 0x55a8cf333630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.698+0000 7f95297fa700 0 client.8739 ms_handle_reset on v2:172.21.15.6:6833/3081379602 2023-10-06T02:26:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.698+0000 7f955a2fab80 1 -- 172.21.15.6:0/3259986522 >> 172.21.15.6:0/3259986522 conn(0x55a8cf31ae80 msgr2=0x55a8cf31bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.698+0000 7f955a2fab80 1 -- 172.21.15.6:0/3259986522 shutdown_connections 2023-10-06T02:26:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.698+0000 7f955a2fab80 1 -- 172.21.15.6:0/3259986522 wait complete. 2023-10-06T02:26:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.698+0000 7f955a2fab80 20 client.8739 trim_cache size 0 max 16384 2023-10-06T02:26:28.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.715+0000 7f955a2fab80 1 Processor -- start 2023-10-06T02:26:28.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.715+0000 7f955a2fab80 1 -- start start 2023-10-06T02:26:28.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f955a2fab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf31b2c0 0x55a8cf360010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f955a2fab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31ca10 0x55a8cf36f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f955a2fab80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf33ae50 0x55a8cf36f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f955a2fab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8cf345d30 con 0x55a8cf31b2c0 2023-10-06T02:26:28.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f955a2fab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8cf317160 con 0x55a8cf31ca10 2023-10-06T02:26:28.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f955a2fab80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8cf343910 con 0x55a8cf33ae50 2023-10-06T02:26:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f954ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf31b2c0 0x55a8cf360010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f954ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf31b2c0 0x55a8cf360010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38518/0 (socket says 172.21.15.6:38518) 2023-10-06T02:26:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f954ad9d700 1 -- 172.21.15.6:0/2711054665 learned_addr learned my addr 172.21.15.6:0/2711054665 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f954b59e700 1 --2- 172.21.15.6:0/2711054665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf33ae50 0x55a8cf36f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f954a59c700 1 --2- 172.21.15.6:0/2711054665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31ca10 0x55a8cf36f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f954ad9d700 1 -- 172.21.15.6:0/2711054665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf33ae50 msgr2=0x55a8cf36f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f954ad9d700 1 --2- 172.21.15.6:0/2711054665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf33ae50 0x55a8cf36f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f954ad9d700 1 -- 172.21.15.6:0/2711054665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31ca10 msgr2=0x55a8cf36f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f954ad9d700 1 --2- 172.21.15.6:0/2711054665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31ca10 0x55a8cf36f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f954ad9d700 1 -- 172.21.15.6:0/2711054665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8cf238780 con 0x55a8cf31b2c0 2023-10-06T02:26:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f954ad9d700 1 --2- 172.21.15.6:0/2711054665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf31b2c0 0x55a8cf360010 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f9544054060 tx=0x7f954405d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29593e209ed1fe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f9540ff9700 1 -- 172.21.15.6:0/2711054665 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954400e040 con 0x55a8cf31b2c0 2023-10-06T02:26:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f9540ff9700 1 -- 172.21.15.6:0/2711054665 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954405ae00 con 0x55a8cf31b2c0 2023-10-06T02:26:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.716+0000 7f9540ff9700 1 -- 172.21.15.6:0/2711054665 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544027b30 con 0x55a8cf31b2c0 2023-10-06T02:26:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.717+0000 7f955a2fab80 1 -- 172.21.15.6:0/2711054665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf31b2c0 msgr2=0x55a8cf360010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.717+0000 7f955a2fab80 1 --2- 172.21.15.6:0/2711054665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf31b2c0 0x55a8cf360010 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f9544054060 tx=0x7f954405d040 comp rx=0 tx=0).stop 2023-10-06T02:26:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.717+0000 7f955a2fab80 1 -- 172.21.15.6:0/2711054665 shutdown_connections 2023-10-06T02:26:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.717+0000 7f955a2fab80 1 --2- 172.21.15.6:0/2711054665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf33ae50 0x55a8cf36f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.717+0000 7f955a2fab80 1 --2- 172.21.15.6:0/2711054665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf31b2c0 0x55a8cf360010 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.717+0000 7f955a2fab80 1 --2- 172.21.15.6:0/2711054665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31ca10 0x55a8cf36f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.717+0000 7f955a2fab80 1 -- 172.21.15.6:0/2711054665 >> 172.21.15.6:0/2711054665 conn(0x55a8cf31ae80 msgr2=0x55a8cf330010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.717+0000 7f955a2fab80 1 -- 172.21.15.6:0/2711054665 shutdown_connections 2023-10-06T02:26:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.717+0000 7f955a2fab80 1 -- 172.21.15.6:0/2711054665 wait complete. 2023-10-06T02:26:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.718+0000 7f955a2fab80 1 -- start start 2023-10-06T02:26:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.718+0000 7f955a2fab80 1 Processor -- start 2023-10-06T02:26:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.718+0000 7f955a2fab80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf31b2c0 0x55a8cf339540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.718+0000 7f955a2fab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31ca10 0x55a8cf316050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.718+0000 7f955a2fab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf316590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.718+0000 7f955a2fab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8cf315c00 con 0x55a8cf33ae50 2023-10-06T02:26:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.718+0000 7f955a2fab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8cf361bc0 con 0x55a8cf31ca10 2023-10-06T02:26:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.718+0000 7f955a2fab80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8cf35e9b0 con 0x55a8cf31b2c0 2023-10-06T02:26:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f955a2fab80 10 client.0 _ll_register_callbacks cb 0x55a8cf2dd020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:26:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f954b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf316590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f954b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf316590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38528/0 (socket says 172.21.15.6:38528) 2023-10-06T02:26:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f954b59e700 1 -- 172.21.15.6:0/1070957390 learned_addr learned my addr 172.21.15.6:0/1070957390 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f954ad9d700 1 --2- 172.21.15.6:0/1070957390 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf31b2c0 0x55a8cf339540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f954a59c700 1 --2- 172.21.15.6:0/1070957390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31ca10 0x55a8cf316050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f954b59e700 1 -- 172.21.15.6:0/1070957390 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf31b2c0 msgr2=0x55a8cf339540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f954b59e700 1 --2- 172.21.15.6:0/1070957390 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf31b2c0 0x55a8cf339540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f954b59e700 1 -- 172.21.15.6:0/1070957390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31ca10 msgr2=0x55a8cf316050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f954b59e700 1 --2- 172.21.15.6:0/1070957390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31ca10 0x55a8cf316050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f954b59e700 1 -- 172.21.15.6:0/1070957390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a8cf104270 con 0x55a8cf33ae50 2023-10-06T02:26:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f954a59c700 1 --2- 172.21.15.6:0/1070957390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31ca10 0x55a8cf316050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f954b59e700 1 --2- 172.21.15.6:0/1070957390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf316590 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f953c0095b0 tx=0x7f953c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac00af6e11fabd6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f95297fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:26:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f95297fa700 1 -- 172.21.15.6:0/1070957390 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c000cc0 con 0x55a8cf33ae50 2023-10-06T02:26:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f95297fa700 1 -- 172.21.15.6:0/1070957390 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 7410+0+0 (secure 0 0 0) 0x7f953c013410 con 0x55a8cf33ae50 2023-10-06T02:26:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f955a2fab80 1 -- 172.21.15.6:0/1070957390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9544053ef0 con 0x55a8cf33ae50 2023-10-06T02:26:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f95297fa700 1 -- 172.21.15.6:0/1070957390 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=170) v2 ==== 24+0+0 (secure 0 0 0) 0x7f953c013b30 con 0x55a8cf33ae50 2023-10-06T02:26:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f955a2fab80 10 client.8745 fetch_fsmap learned FSMap version 170 2023-10-06T02:26:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.719+0000 7f955a2fab80 1 -- 172.21.15.6:0/1070957390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=170,monmap=2+}) v3 -- 0x55a8cf21f470 con 0x55a8cf33ae50 2023-10-06T02:26:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.720+0000 7f95297fa700 1 -- 172.21.15.6:0/1070957390 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9544053ef0 con 0x55a8cf33ae50 2023-10-06T02:26:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.720+0000 7f95297fa700 1 -- 172.21.15.6:0/1070957390 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 170) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f953c013c90 con 0x55a8cf33ae50 2023-10-06T02:26:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.720+0000 7f955a2fab80 10 client.8745 fetch_fsmap finished waiting for FSMap version 170 2023-10-06T02:26:28.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.720+0000 7f955a2fab80 10 client.8745 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:26:28.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.720+0000 7f955a2fab80 20 client.8745 populate_metadata read hostname 'smithi006' 2023-10-06T02:26:28.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.720+0000 7f955a2fab80 1 --2- 172.21.15.6:0/1070957390 >> [v2:172.21.15.6:6833/3081379602,v1:172.21.15.6:6835/3081379602] conn(0x55a8cf36f380 0x55a8cf36f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.720+0000 7f955a2fab80 4 client.8745 mds_command: new command op to 8661 tid=0[{"prefix": "status"}] 2023-10-06T02:26:28.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.720+0000 7f955a2fab80 1 -- 172.21.15.6:0/1070957390 --> [v2:172.21.15.6:6833/3081379602,v1:172.21.15.6:6835/3081379602] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a8cf20ce00 con 0x55a8cf36f380 2023-10-06T02:26:28.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.720+0000 7f954ad9d700 1 --2- 172.21.15.6:0/1070957390 >> [v2:172.21.15.6:6833/3081379602,v1:172.21.15.6:6835/3081379602] conn(0x55a8cf36f380 0x55a8cf36f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.720+0000 7f95297fa700 10 client.8745 ms_handle_connect on v2:172.21.15.6:6833/3081379602 2023-10-06T02:26:28.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.720+0000 7f954ad9d700 1 --2- 172.21.15.6:0/1070957390 >> [v2:172.21.15.6:6833/3081379602,v1:172.21.15.6:6835/3081379602] conn(0x55a8cf36f380 0x55a8cf36f750 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fd88a818378f1e6 server_cookie=79e1efb5d8fb31e0 in_seq=0 out_seq=0 2023-10-06T02:26:28.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.720+0000 7f95297fa700 1 -- 172.21.15.6:0/1070957390 <== mds.0 v2:172.21.15.6:6833/3081379602 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x55a8cf20ce00 con 0x55a8cf36f380 2023-10-06T02:26:28.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.720+0000 7f95297fa700 10 client.8745 handle_command_reply: tid=0 2023-10-06T02:26:28.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.720+0000 7f955a2fab80 1 client.8745 shutdown 2023-10-06T02:26:28.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.720+0000 7f955a2fab80 1 -- 172.21.15.6:0/1070957390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 msgr2=0x55a8cf316590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.720+0000 7f955a2fab80 1 --2- 172.21.15.6:0/1070957390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf316590 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f953c0095b0 tx=0x7f953c01f000 comp rx=0 tx=0).stop 2023-10-06T02:26:28.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.720+0000 7f955a2fab80 1 -- 172.21.15.6:0/1070957390 shutdown_connections 2023-10-06T02:26:28.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f955a2fab80 1 --2- 172.21.15.6:0/1070957390 >> [v2:172.21.15.6:6833/3081379602,v1:172.21.15.6:6835/3081379602] conn(0x55a8cf36f380 0x55a8cf36f750 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f955a2fab80 1 --2- 172.21.15.6:0/1070957390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8cf33ae50 0x55a8cf316590 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f955a2fab80 1 --2- 172.21.15.6:0/1070957390 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a8cf31b2c0 0x55a8cf339540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f955a2fab80 1 --2- 172.21.15.6:0/1070957390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a8cf31ca10 0x55a8cf316050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f95297fa700 0 client.8745 ms_handle_reset on v2:172.21.15.6:6833/3081379602 2023-10-06T02:26:28.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f955a2fab80 1 -- 172.21.15.6:0/1070957390 >> 172.21.15.6:0/1070957390 conn(0x55a8cf31ae80 msgr2=0x55a8cf3498d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:28.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f955a2fab80 1 -- 172.21.15.6:0/1070957390 shutdown_connections 2023-10-06T02:26:28.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f955a2fab80 1 -- 172.21.15.6:0/1070957390 wait complete. 2023-10-06T02:26:28.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f955a2fab80 20 client.8745 trim_cache size 0 max 16384 2023-10-06T02:26:28.730 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:26:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:26:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:26:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 8661, 2023-10-06T02:26:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:26:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:26:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:26:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 6.7720626450000001, 2023-10-06T02:26:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 170, 2023-10-06T02:26:28.731 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 107, 2023-10-06T02:26:28.731 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 107, 2023-10-06T02:26:28.731 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 10.767592393999999 2023-10-06T02:26:28.731 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:26:28.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f9550801700 1 -- 172.21.15.6:0/4089363749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f952c066f30 msgr2=0x7f952c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f9550801700 1 --2- 172.21.15.6:0/4089363749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f952c066f30 0x7f952c0693e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9534007fd0 tx=0x7f9534009040 comp rx=0 tx=0).stop 2023-10-06T02:26:28.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f9550801700 1 -- 172.21.15.6:0/4089363749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c068d90 msgr2=0x7f954c0cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f9550801700 1 --2- 172.21.15.6:0/4089363749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c068d90 0x7f954c0cc320 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f9544013000 tx=0x7f9544019000 comp rx=0 tx=0).stop 2023-10-06T02:26:28.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f9550801700 1 -- 172.21.15.6:0/4089363749 shutdown_connections 2023-10-06T02:26:28.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f9550801700 1 --2- 172.21.15.6:0/4089363749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f954c15c900 0x7f954c0ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f9550801700 1 --2- 172.21.15.6:0/4089363749 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f952c066f30 0x7f952c0693e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f9550801700 1 --2- 172.21.15.6:0/4089363749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c068d90 0x7f954c0cc320 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f9550801700 1 --2- 172.21.15.6:0/4089363749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f954c0d0530 0x7f954c0c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f9550801700 1 -- 172.21.15.6:0/4089363749 >> 172.21.15.6:0/4089363749 conn(0x7f954c06ac00 msgr2=0x7f954c157aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:28.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f9550801700 1 -- 172.21.15.6:0/4089363749 shutdown_connections 2023-10-06T02:26:28.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.721+0000 7f9550801700 1 -- 172.21.15.6:0/4089363749 wait complete. 2023-10-06T02:26:28.734 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:26:28.734 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Delete 400.00000000', proceeding to ls 2023-10-06T02:26:28.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:26:28.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.852+0000 7fa066ce3700 1 Processor -- start 2023-10-06T02:26:28.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.852+0000 7fa066ce3700 1 -- start start 2023-10-06T02:26:28.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.853+0000 7fa066ce3700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa060159150 0x7fa06015de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.853+0000 7fa066ce3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0600b08f0 0x7fa060159520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.853+0000 7fa066ce3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0600afbc0 con 0x7fa0600cccf0 2023-10-06T02:26:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.853+0000 7fa066ce3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa060159a60 con 0x7fa0600b08f0 2023-10-06T02:26:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.853+0000 7fa066ce3700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0600cd620 con 0x7fa060159150 2023-10-06T02:26:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.853+0000 7fa05ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0600b08f0 0x7fa060159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.853+0000 7fa065280700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa0600cccf0 0x7fa0600b20a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40920/0 (socket says 172.21.15.6:40920) 2023-10-06T02:26:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.853+0000 7fa05ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0600b08f0 0x7fa060159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38544/0 (socket says 172.21.15.6:38544) 2023-10-06T02:26:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.853+0000 7fa065280700 1 -- 172.21.15.6:0/3458362311 learned_addr learned my addr 172.21.15.6:0/3458362311 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.853+0000 7fa064a7f700 1 --2- 172.21.15.6:0/3458362311 >> v2:172.21.15.175:3300/0 conn(0x7fa060159150 0x7fa06015de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.854+0000 7fa05ffff700 1 -- 172.21.15.6:0/3458362311 >> v2:172.21.15.175:3300/0 conn(0x7fa060159150 msgr2=0x7fa06015de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.854+0000 7fa05ffff700 1 --2- 172.21.15.6:0/3458362311 >> v2:172.21.15.175:3300/0 conn(0x7fa060159150 0x7fa06015de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.854+0000 7fa05ffff700 1 -- 172.21.15.6:0/3458362311 >> v1:172.21.15.6:6789/0 conn(0x7fa0600cccf0 legacy=0x7fa0600b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.854+0000 7fa05ffff700 1 -- 172.21.15.6:0/3458362311 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0600afe10 con 0x7fa0600b08f0 2023-10-06T02:26:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.854+0000 7fa05f7fe700 1 -- 172.21.15.6:0/3458362311 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080891870 0 0) 0x7fa0600afbc0 con 0x7fa0600cccf0 2023-10-06T02:26:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.854+0000 7fa05ffff700 1 --2- 172.21.15.6:0/3458362311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0600b08f0 0x7fa060159520 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fa0600cddd0 tx=0x7fa0500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3bdffe02ee1702 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.854+0000 7fa05f7fe700 1 -- 172.21.15.6:0/3458362311 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05000b6b0 con 0x7fa0600b08f0 2023-10-06T02:26:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.854+0000 7fa05f7fe700 1 -- 172.21.15.6:0/3458362311 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05000b810 con 0x7fa0600b08f0 2023-10-06T02:26:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.854+0000 7fa05f7fe700 1 -- 172.21.15.6:0/3458362311 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05000bbb0 con 0x7fa0600b08f0 2023-10-06T02:26:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.854+0000 7fa066ce3700 1 -- 172.21.15.6:0/3458362311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0600b08f0 msgr2=0x7fa060159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.854+0000 7fa066ce3700 1 --2- 172.21.15.6:0/3458362311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0600b08f0 0x7fa060159520 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fa0600cddd0 tx=0x7fa0500091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.854+0000 7fa066ce3700 1 -- 172.21.15.6:0/3458362311 shutdown_connections 2023-10-06T02:26:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.854+0000 7fa066ce3700 1 --2- 172.21.15.6:0/3458362311 >> v2:172.21.15.175:3300/0 conn(0x7fa060159150 0x7fa06015de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.854+0000 7fa066ce3700 1 --2- 172.21.15.6:0/3458362311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0600b08f0 0x7fa060159520 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.854+0000 7fa066ce3700 1 -- 172.21.15.6:0/3458362311 >> 172.21.15.6:0/3458362311 conn(0x7fa060068680 msgr2=0x7fa060068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.855+0000 7fa066ce3700 1 -- 172.21.15.6:0/3458362311 shutdown_connections 2023-10-06T02:26:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.855+0000 7fa066ce3700 1 -- 172.21.15.6:0/3458362311 wait complete. 2023-10-06T02:26:28.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.856+0000 7fa066ce3700 1 Processor -- start 2023-10-06T02:26:28.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.856+0000 7fa066ce3700 1 -- start start 2023-10-06T02:26:28.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.856+0000 7fa066ce3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0600b08f0 0x7fa060156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.856+0000 7fa066ce3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0600cccf0 0x7fa0600c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.856+0000 7fa066ce3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa060159150 0x7fa0600c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.856+0000 7fa066ce3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600c7ff0 con 0x7fa060159150 2023-10-06T02:26:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.856+0000 7fa066ce3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600c6690 con 0x7fa0600cccf0 2023-10-06T02:26:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.856+0000 7fa066ce3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600c63b0 con 0x7fa0600b08f0 2023-10-06T02:26:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa065280700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa060159150 0x7fa0600c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa065280700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa060159150 0x7fa0600c5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38548/0 (socket says 172.21.15.6:38548) 2023-10-06T02:26:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa065280700 1 -- 172.21.15.6:0/2106847780 learned_addr learned my addr 172.21.15.6:0/2106847780 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa064a7f700 1 --2- 172.21.15.6:0/2106847780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0600b08f0 0x7fa060156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa05ffff700 1 --2- 172.21.15.6:0/2106847780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0600cccf0 0x7fa0600c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa065280700 1 -- 172.21.15.6:0/2106847780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0600b08f0 msgr2=0x7fa060156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa065280700 1 --2- 172.21.15.6:0/2106847780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0600b08f0 0x7fa060156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa065280700 1 -- 172.21.15.6:0/2106847780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0600cccf0 msgr2=0x7fa0600c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa065280700 1 --2- 172.21.15.6:0/2106847780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0600cccf0 0x7fa0600c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa065280700 1 -- 172.21.15.6:0/2106847780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa050009420 con 0x7fa060159150 2023-10-06T02:26:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa064a7f700 1 --2- 172.21.15.6:0/2106847780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0600b08f0 0x7fa060156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa05ffff700 1 --2- 172.21.15.6:0/2106847780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0600cccf0 0x7fa0600c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa065280700 1 --2- 172.21.15.6:0/2106847780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa060159150 0x7fa0600c5960 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fa0480011e0 tx=0x7fa048007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa05cff9700 1 -- 172.21.15.6:0/2106847780 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048005b30 con 0x7fa060159150 2023-10-06T02:26:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa05cff9700 1 -- 172.21.15.6:0/2106847780 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa048005c90 con 0x7fa060159150 2023-10-06T02:26:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa066ce3700 1 -- 172.21.15.6:0/2106847780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0600c8290 con 0x7fa060159150 2023-10-06T02:26:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa05cff9700 1 -- 172.21.15.6:0/2106847780 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048007300 con 0x7fa060159150 2023-10-06T02:26:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.857+0000 7fa066ce3700 1 -- 172.21.15.6:0/2106847780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0600c8850 con 0x7fa060159150 2023-10-06T02:26:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.858+0000 7fa066ce3700 1 -- 172.21.15.6:0/2106847780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0600c8a40 con 0x7fa060159150 2023-10-06T02:26:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.859+0000 7fa05cff9700 1 -- 172.21.15.6:0/2106847780 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa048007670 con 0x7fa060159150 2023-10-06T02:26:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.859+0000 7fa05cff9700 1 --2- 172.21.15.6:0/2106847780 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa040066f30 0x7fa0400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.859+0000 7fa05cff9700 1 -- 172.21.15.6:0/2106847780 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7410+0+0 (secure 0 0 0) 0x7fa0480841d0 con 0x7fa060159150 2023-10-06T02:26:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.859+0000 7fa064a7f700 1 --2- 172.21.15.6:0/2106847780 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa040066f30 0x7fa0400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.860+0000 7fa064a7f700 1 --2- 172.21.15.6:0/2106847780 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa040066f30 0x7fa0400693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa0580075e0 tx=0x7fa0580097e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:28.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:28.863+0000 7fa05cff9700 1 -- 172.21.15.6:0/2106847780 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa048050d00 con 0x7fa060159150 2023-10-06T02:26:28.935 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:26:28.933+0000 7f4fb4c70700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:26:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:29.105+0000 7fa066ce3700 1 -- 172.21.15.6:0/2106847780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa06004bb80 con 0x7fa060159150 2023-10-06T02:26:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:29.106+0000 7fa05cff9700 1 -- 172.21.15.6:0/2106847780 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v170) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa048017060 con 0x7fa060159150 2023-10-06T02:26:29.108 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:26:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:29.108+0000 7fa066ce3700 1 -- 172.21.15.6:0/2106847780 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa040066f30 msgr2=0x7fa0400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:29.108+0000 7fa066ce3700 1 --2- 172.21.15.6:0/2106847780 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa040066f30 0x7fa0400693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa0580075e0 tx=0x7fa0580097e0 comp rx=0 tx=0).stop 2023-10-06T02:26:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:29.108+0000 7fa066ce3700 1 -- 172.21.15.6:0/2106847780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa060159150 msgr2=0x7fa0600c5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:29.108+0000 7fa066ce3700 1 --2- 172.21.15.6:0/2106847780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa060159150 0x7fa0600c5960 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fa0480011e0 tx=0x7fa048007d30 comp rx=0 tx=0).stop 2023-10-06T02:26:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:29.108+0000 7fa066ce3700 1 -- 172.21.15.6:0/2106847780 shutdown_connections 2023-10-06T02:26:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:29.108+0000 7fa066ce3700 1 --2- 172.21.15.6:0/2106847780 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa040066f30 0x7fa0400693e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:29.108+0000 7fa066ce3700 1 --2- 172.21.15.6:0/2106847780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa060159150 0x7fa0600c5960 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:29.108+0000 7fa066ce3700 1 --2- 172.21.15.6:0/2106847780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0600b08f0 0x7fa060156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:29.108+0000 7fa066ce3700 1 --2- 172.21.15.6:0/2106847780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0600cccf0 0x7fa0600c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:29.108+0000 7fa066ce3700 1 -- 172.21.15.6:0/2106847780 >> 172.21.15.6:0/2106847780 conn(0x7fa060068680 msgr2=0x7fa0601589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:29.108+0000 7fa066ce3700 1 -- 172.21.15.6:0/2106847780 shutdown_connections 2023-10-06T02:26:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:29.108+0000 7fa066ce3700 1 -- 172.21.15.6:0/2106847780 wait complete. 2023-10-06T02:26:29.121 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:26:29.121 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:26:29.122 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:26:29.122 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:26:29.122 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:29.122 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:26:29.122 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:26:29.122 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:26:29.122 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:26:29.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:29.122 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:26:29.138 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:26:29.138 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:26:29.138 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:26:29.138 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:26:29.138 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:26:29.138 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:26:29.138 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:26:29.138 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:26:29.139 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:26:29.139 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:26:29.139 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:26:29.139 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:26:29.139 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:26:29.139 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:26:29.139 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:26:29.139 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:26:29.139 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41957sec preferred_lft 41957sec 2023-10-06T02:26:29.139 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:26:29.139 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:26:29.139 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:26:29.140 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:26:29.140 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:26:29.140 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:26:29.140 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:26:29.140 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:26:29.140 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:26:29.140 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:26:29.140 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:26:29.140 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:26:29.140 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:26:29.140 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:26:29.140 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:26:29.140 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:26:29.141 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:26:29.141 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:26:29.141 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:26:29.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:29.141 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:26:29.202 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:26:29.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:29.203 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:26:29.259 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:26:29.260 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:26:29.260 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:26:29.260 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:26:29.260 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:26:29.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:29.260 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:26:29.260 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:26:29.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:26:29.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:26:29.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:26:29.261 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:26:29.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:29.362 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:26:29.376 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:26:29.377 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:26:29.377 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:26:29.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:29.377 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:26:29.442 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:26:29.443 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:26:29.443 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:29.498 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:26:29.499 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:26:29.499 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:29.554 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:26:29.620 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:26:29.620 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:26:29.685 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:26:29.686 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:26:29.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:29.686 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:26:29.741 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:26:29.742 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:26:29.785 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:26:29.811 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:26:29.811 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:26:29.870 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:26:29.868+0000 7feac52ac540 -1 init, newargv = 0x559f7674b840 newargc=15 2023-10-06T02:26:29.870 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[130328]: starting ceph client 2023-10-06T02:26:29.875 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[130328]: starting fuse 2023-10-06T02:26:29.878 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:26:29.880 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:26:29.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:29.880 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:26:29.935 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:26:29.936 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:26:29.936 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:26:29.936 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:26:29.936 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:26:29.936 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:26:29.936 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:26:29.936 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:26:29.936 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:26:29.936 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:26:29.936 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:26:29.936 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:26:29.937 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:26:29.937 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:26:29.937 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:26:29.937 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:26:29.937 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:26:29.937 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:26:29.937 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:26:29.937 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:26:29.937 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:26:29.937 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:26:29.937 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:26:29.937 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:26:29.937 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:26:29.938 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:26:29.938 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:26:29.938 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:26:29.938 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:26:30.058 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.130328.asok 2023-10-06T02:26:30.240 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.130328.asok 2023-10-06T02:26:30.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:30.240 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.130328.asok status 2023-10-06T02:26:30.394 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:26:30.394 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:26:30.394 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:26:30.394 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:26:30.394 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:26:30.395 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:26:30.395 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:26:30.395 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "130328", 2023-10-06T02:26:30.395 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:26:30.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:26:30.395 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:26:30.395 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:26:30.395 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 8760, 2023-10-06T02:26:30.395 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:26:30.395 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:26:30.395 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:26:30.396 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 8760 2023-10-06T02:26:30.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:26:30.396 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:26:30.396 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:26:30.396 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:26:30.396 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3236477954 2023-10-06T02:26:30.396 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:26:30.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:26:30.397 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:26:30.397 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:26:30.397 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:26:30.397 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3236477954 2023-10-06T02:26:30.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:26:30.397 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.8760 192.168.0.1:0/3236477954", 2023-10-06T02:26:30.397 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/3236477954", 2023-10-06T02:26:30.397 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:26:30.397 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 170, 2023-10-06T02:26:30.397 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 107, 2023-10-06T02:26:30.397 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:26:30.397 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:26:30.397 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:26:30.398 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:26:30.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:30.405 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:26:30.405 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:30.421 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:26:30.421 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:30.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:30.421 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:30.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:30.486 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2023-10-06T02:26:30.529 INFO:teuthology.orchestra.run:waiting for 20 2023-10-06T02:26:30.545 INFO:teuthology.orchestra.run.smithi006.stdout:.: 2023-10-06T02:26:30.546 INFO:teuthology.orchestra.run.smithi006.stdout:subdir 2023-10-06T02:26:30.546 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:30.546 INFO:teuthology.orchestra.run.smithi006.stdout:./subdir: 2023-10-06T02:26:30.546 INFO:teuthology.orchestra.run.smithi006.stdout:sixmegs 2023-10-06T02:26:30.546 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 400.00000000' did not caused DAMAGED state 2023-10-06T02:26:30.546 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 100.00000000.inode' 2023-10-06T02:26:30.547 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:26:30.547 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:26:30.547 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:30.624 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:26:30.625 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:26:30.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:30.625 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:26:30.681 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:26:30.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.840+0000 7fce64858700 1 Processor -- start 2023-10-06T02:26:30.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.840+0000 7fce64858700 1 -- start start 2023-10-06T02:26:30.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.841+0000 7fce64858700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce60159400 0x7fce600ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:30.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.841+0000 7fce64858700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fce600d05d0 0x7fce600b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:30.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.841+0000 7fce64858700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce600b3560 con 0x7fce600cd030 2023-10-06T02:26:30.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.841+0000 7fce64858700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce600cf6f0 con 0x7fce600d05d0 2023-10-06T02:26:30.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.841+0000 7fce64858700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce600cf9d0 con 0x7fce60159400 2023-10-06T02:26:30.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.841+0000 7fce5ed9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce60159400 0x7fce600ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:30.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.841+0000 7fce5f59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fce600d05d0 0x7fce600b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:30.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.841+0000 7fce5ed9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce60159400 0x7fce600ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:52536/0 (socket says 172.21.15.6:52536) 2023-10-06T02:26:30.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.841+0000 7fce5ed9d700 1 -- 172.21.15.6:0/606074919 learned_addr learned my addr 172.21.15.6:0/606074919 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:30.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.842+0000 7fce5ed9d700 1 -- 172.21.15.6:0/606074919 >> v2:172.21.15.175:3300/0 conn(0x7fce600d05d0 msgr2=0x7fce600b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:30.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.842+0000 7fce5ed9d700 1 --2- 172.21.15.6:0/606074919 >> v2:172.21.15.175:3300/0 conn(0x7fce600d05d0 0x7fce600b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:30.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.842+0000 7fce5ed9d700 1 -- 172.21.15.6:0/606074919 >> v1:172.21.15.175:6789/0 conn(0x7fce600cd030 legacy=0x7fce600cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:30.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.842+0000 7fce5ed9d700 1 -- 172.21.15.6:0/606074919 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce600b2f10 con 0x7fce60159400 2023-10-06T02:26:30.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.842+0000 7fce5f59e700 1 --2- 172.21.15.6:0/606074919 >> v2:172.21.15.175:3300/0 conn(0x7fce600d05d0 0x7fce600b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:26:30.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.842+0000 7fce5ed9d700 1 --2- 172.21.15.6:0/606074919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce60159400 0x7fce600ccaf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fce58009990 tx=0x7fce58009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ac884ca39ec1a4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:30.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.842+0000 7fce5dd9b700 1 -- 172.21.15.6:0/606074919 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce58009e80 con 0x7fce60159400 2023-10-06T02:26:30.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.842+0000 7fce5dd9b700 1 -- 172.21.15.6:0/606074919 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce58005c10 con 0x7fce60159400 2023-10-06T02:26:30.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.842+0000 7fce5dd9b700 1 -- 172.21.15.6:0/606074919 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5800b650 con 0x7fce60159400 2023-10-06T02:26:30.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.842+0000 7fce64858700 1 -- 172.21.15.6:0/606074919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce60159400 msgr2=0x7fce600ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:30.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.842+0000 7fce64858700 1 --2- 172.21.15.6:0/606074919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce60159400 0x7fce600ccaf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fce58009990 tx=0x7fce58009220 comp rx=0 tx=0).stop 2023-10-06T02:26:30.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.843+0000 7fce64858700 1 -- 172.21.15.6:0/606074919 shutdown_connections 2023-10-06T02:26:30.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.843+0000 7fce64858700 1 --2- 172.21.15.6:0/606074919 >> v2:172.21.15.175:3300/0 conn(0x7fce600d05d0 0x7fce600b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:30.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.843+0000 7fce64858700 1 --2- 172.21.15.6:0/606074919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce60159400 0x7fce600ccaf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:30.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.843+0000 7fce64858700 1 -- 172.21.15.6:0/606074919 >> 172.21.15.6:0/606074919 conn(0x7fce6006ac10 msgr2=0x7fce60068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:30.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.843+0000 7fce64858700 1 -- 172.21.15.6:0/606074919 shutdown_connections 2023-10-06T02:26:30.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.843+0000 7fce64858700 1 -- 172.21.15.6:0/606074919 wait complete. 2023-10-06T02:26:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.844+0000 7fce64858700 1 Processor -- start 2023-10-06T02:26:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.844+0000 7fce64858700 1 -- start start 2023-10-06T02:26:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.844+0000 7fce64858700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce600cd030 0x7fce600c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.844+0000 7fce64858700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce600d05d0 0x7fce600c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:30.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce64858700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce60159400 0x7fce600c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:30.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce64858700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce600c83e0 con 0x7fce600cd030 2023-10-06T02:26:30.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce64858700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce600c9200 con 0x7fce60159400 2023-10-06T02:26:30.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce64858700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce600c85f0 con 0x7fce600d05d0 2023-10-06T02:26:30.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce5ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce600cd030 0x7fce600c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:30.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce5ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce600cd030 0x7fce600c6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38560/0 (socket says 172.21.15.6:38560) 2023-10-06T02:26:30.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce5ed9d700 1 -- 172.21.15.6:0/858981904 learned_addr learned my addr 172.21.15.6:0/858981904 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:30.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce5e59c700 1 --2- 172.21.15.6:0/858981904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce600d05d0 0x7fce600c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:30.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce5f59e700 1 --2- 172.21.15.6:0/858981904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce60159400 0x7fce600c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:30.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce5ed9d700 1 -- 172.21.15.6:0/858981904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce600d05d0 msgr2=0x7fce600c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:30.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce5ed9d700 1 --2- 172.21.15.6:0/858981904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce600d05d0 0x7fce600c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:30.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce5ed9d700 1 -- 172.21.15.6:0/858981904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce60159400 msgr2=0x7fce600c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:30.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce5ed9d700 1 --2- 172.21.15.6:0/858981904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce60159400 0x7fce600c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:30.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce5ed9d700 1 -- 172.21.15.6:0/858981904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce50009a20 con 0x7fce600cd030 2023-10-06T02:26:30.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce5ed9d700 1 --2- 172.21.15.6:0/858981904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce600cd030 0x7fce600c6640 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fce5800b3c0 tx=0x7fce58016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:30.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce56ffd700 1 -- 172.21.15.6:0/858981904 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce58011c40 con 0x7fce600cd030 2023-10-06T02:26:30.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce64858700 1 -- 172.21.15.6:0/858981904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce58009480 con 0x7fce600cd030 2023-10-06T02:26:30.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce56ffd700 1 -- 172.21.15.6:0/858981904 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce58011da0 con 0x7fce600cd030 2023-10-06T02:26:30.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce56ffd700 1 -- 172.21.15.6:0/858981904 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5801b660 con 0x7fce600cd030 2023-10-06T02:26:30.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.845+0000 7fce64858700 1 -- 172.21.15.6:0/858981904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce600c8bb0 con 0x7fce600cd030 2023-10-06T02:26:30.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.846+0000 7fce64858700 1 -- 172.21.15.6:0/858981904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce600c94e0 con 0x7fce600cd030 2023-10-06T02:26:30.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.847+0000 7fce56ffd700 1 -- 172.21.15.6:0/858981904 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce5801ba90 con 0x7fce600cd030 2023-10-06T02:26:30.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.847+0000 7fce56ffd700 1 --2- 172.21.15.6:0/858981904 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce40066f30 0x7fce400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:30.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.847+0000 7fce56ffd700 1 -- 172.21.15.6:0/858981904 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7410+0+0 (secure 0 0 0) 0x7fce58086410 con 0x7fce600cd030 2023-10-06T02:26:30.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.847+0000 7fce5e59c700 1 --2- 172.21.15.6:0/858981904 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce40066f30 0x7fce400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:30.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.848+0000 7fce5e59c700 1 --2- 172.21.15.6:0/858981904 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce40066f30 0x7fce400693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fce60158580 tx=0x7fce48007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:30.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:30.852+0000 7fce56ffd700 1 -- 172.21.15.6:0/858981904 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce58053090 con 0x7fce600cd030 2023-10-06T02:26:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.087+0000 7fce64858700 1 -- 172.21.15.6:0/858981904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fce600b31f0 con 0x7fce600cd030 2023-10-06T02:26:31.089 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:26:31.088+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:26:31.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.094+0000 7fce56ffd700 1 -- 172.21.15.6:0/858981904 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v171) v1 ==== 161+0+0 (secure 0 0 0) 0x7fce580566b0 con 0x7fce600cd030 2023-10-06T02:26:31.097 INFO:tasks.ceph.mds.a.smithi006.stderr: -521> 2023-10-06T02:26:28.933+0000 7f4fb4c70700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:26:31.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.098+0000 7fce64858700 1 -- 172.21.15.6:0/858981904 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce40066f30 msgr2=0x7fce400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:31.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.098+0000 7fce64858700 1 --2- 172.21.15.6:0/858981904 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce40066f30 0x7fce400693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fce60158580 tx=0x7fce48007ec0 comp rx=0 tx=0).stop 2023-10-06T02:26:31.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.098+0000 7fce64858700 1 -- 172.21.15.6:0/858981904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce600cd030 msgr2=0x7fce600c6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:31.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.098+0000 7fce64858700 1 --2- 172.21.15.6:0/858981904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce600cd030 0x7fce600c6640 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fce5800b3c0 tx=0x7fce58016000 comp rx=0 tx=0).stop 2023-10-06T02:26:31.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.098+0000 7fce64858700 1 -- 172.21.15.6:0/858981904 shutdown_connections 2023-10-06T02:26:31.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.098+0000 7fce64858700 1 --2- 172.21.15.6:0/858981904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce60159400 0x7fce600c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:31.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.098+0000 7fce64858700 1 --2- 172.21.15.6:0/858981904 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fce40066f30 0x7fce400693e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:31.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.098+0000 7fce64858700 1 --2- 172.21.15.6:0/858981904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce600cd030 0x7fce600c6640 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:31.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.098+0000 7fce64858700 1 --2- 172.21.15.6:0/858981904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce600d05d0 0x7fce600c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:31.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.098+0000 7fce64858700 1 -- 172.21.15.6:0/858981904 >> 172.21.15.6:0/858981904 conn(0x7fce6006ac10 msgr2=0x7fce600aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:31.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.099+0000 7fce64858700 1 -- 172.21.15.6:0/858981904 shutdown_connections 2023-10-06T02:26:31.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.099+0000 7fce64858700 1 -- 172.21.15.6:0/858981904 wait complete. 2023-10-06T02:26:31.102 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:26:31.112 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:26:31.119 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:26:31.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.232+0000 7f0c0a251700 1 Processor -- start 2023-10-06T02:26:31.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.232+0000 7f0c0a251700 1 -- start start 2023-10-06T02:26:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c0a251700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0c0415a030 0x7f0c0415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c0a251700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0415a940 0x7f0c04086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c0a251700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c04087530 0x7f0c040b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c0a251700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c040b0cf0 con 0x7f0c04087530 2023-10-06T02:26:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c0a251700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c040879b0 con 0x7f0c0415a030 2023-10-06T02:26:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c0a251700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c040afc50 con 0x7f0c0415a940 2023-10-06T02:26:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c03fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c04087530 0x7f0c040b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c03fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c04087530 0x7f0c040b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38588/0 (socket says 172.21.15.6:38588) 2023-10-06T02:26:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c03fff700 1 -- 172.21.15.6:0/2137355090 learned_addr learned my addr 172.21.15.6:0/2137355090 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c02ffd700 1 --2- 172.21.15.6:0/2137355090 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0415a940 0x7f0c04086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c03fff700 1 -- 172.21.15.6:0/2137355090 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0415a940 msgr2=0x7f0c04086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c03fff700 1 --2- 172.21.15.6:0/2137355090 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0415a940 0x7f0c04086ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c03fff700 1 -- 172.21.15.6:0/2137355090 >> v2:172.21.15.175:3300/0 conn(0x7f0c0415a030 msgr2=0x7f0c0415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c037fe700 1 --2- 172.21.15.6:0/2137355090 >> v2:172.21.15.175:3300/0 conn(0x7f0c0415a030 0x7f0c0415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c03fff700 1 --2- 172.21.15.6:0/2137355090 >> v2:172.21.15.175:3300/0 conn(0x7f0c0415a030 0x7f0c0415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c03fff700 1 -- 172.21.15.6:0/2137355090 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c040aff30 con 0x7f0c04087530 2023-10-06T02:26:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c03fff700 1 --2- 172.21.15.6:0/2137355090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c04087530 0x7f0c040b21b0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f0c040cddc0 tx=0x7f0bfc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25536a9a79d4d9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.233+0000 7f0c027fc700 1 -- 172.21.15.6:0/2137355090 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc00e070 con 0x7f0c04087530 2023-10-06T02:26:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.234+0000 7f0c027fc700 1 -- 172.21.15.6:0/2137355090 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bfc00ba40 con 0x7f0c04087530 2023-10-06T02:26:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.234+0000 7f0c027fc700 1 -- 172.21.15.6:0/2137355090 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc0092e0 con 0x7f0c04087530 2023-10-06T02:26:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.234+0000 7f0c0a251700 1 -- 172.21.15.6:0/2137355090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c04087530 msgr2=0x7f0c040b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.234+0000 7f0c0a251700 1 --2- 172.21.15.6:0/2137355090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c04087530 0x7f0c040b21b0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f0c040cddc0 tx=0x7f0bfc009840 comp rx=0 tx=0).stop 2023-10-06T02:26:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.234+0000 7f0c0a251700 1 -- 172.21.15.6:0/2137355090 shutdown_connections 2023-10-06T02:26:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.234+0000 7f0c0a251700 1 --2- 172.21.15.6:0/2137355090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c04087530 0x7f0c040b21b0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.234+0000 7f0c0a251700 1 --2- 172.21.15.6:0/2137355090 >> v2:172.21.15.175:3300/0 conn(0x7f0c0415a030 0x7f0c0415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.234+0000 7f0c0a251700 1 --2- 172.21.15.6:0/2137355090 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0415a940 0x7f0c04086ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.234+0000 7f0c0a251700 1 -- 172.21.15.6:0/2137355090 >> 172.21.15.6:0/2137355090 conn(0x7f0c04068680 msgr2=0x7f0c04068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.234+0000 7f0c0a251700 1 -- 172.21.15.6:0/2137355090 shutdown_connections 2023-10-06T02:26:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.234+0000 7f0c0a251700 1 -- 172.21.15.6:0/2137355090 wait complete. 2023-10-06T02:26:31.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.235+0000 7f0c0a251700 1 Processor -- start 2023-10-06T02:26:31.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.235+0000 7f0c0a251700 1 -- start start 2023-10-06T02:26:31.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.236+0000 7f0c0a251700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c04087530 0x7f0c04156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:31.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.236+0000 7f0c0a251700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c0415a030 0x7f0c040cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:31.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.236+0000 7f0c0a251700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0415a940 0x7f0c040cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:31.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.236+0000 7f0c0a251700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c040c4dc0 con 0x7f0c04087530 2023-10-06T02:26:31.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.236+0000 7f0c0a251700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c040c5010 con 0x7f0c0415a030 2023-10-06T02:26:31.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.236+0000 7f0c0a251700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c040c52f0 con 0x7f0c0415a940 2023-10-06T02:26:31.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.236+0000 7f0c037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c04087530 0x7f0c04156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:31.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.236+0000 7f0c037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c04087530 0x7f0c04156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38598/0 (socket says 172.21.15.6:38598) 2023-10-06T02:26:31.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.236+0000 7f0c037fe700 1 -- 172.21.15.6:0/2597160257 learned_addr learned my addr 172.21.15.6:0/2597160257 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:31.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.236+0000 7f0c03fff700 1 --2- 172.21.15.6:0/2597160257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0415a940 0x7f0c040cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:31.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.236+0000 7f0c02ffd700 1 --2- 172.21.15.6:0/2597160257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c0415a030 0x7f0c040cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:31.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.237+0000 7f0c037fe700 1 -- 172.21.15.6:0/2597160257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0415a940 msgr2=0x7f0c040cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:31.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.237+0000 7f0c037fe700 1 --2- 172.21.15.6:0/2597160257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0415a940 0x7f0c040cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:31.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.237+0000 7f0c037fe700 1 -- 172.21.15.6:0/2597160257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c0415a030 msgr2=0x7f0c040cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:31.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.237+0000 7f0c037fe700 1 --2- 172.21.15.6:0/2597160257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c0415a030 0x7f0c040cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:31.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.237+0000 7f0c037fe700 1 -- 172.21.15.6:0/2597160257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc009ae0 con 0x7f0c04087530 2023-10-06T02:26:31.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.237+0000 7f0c037fe700 1 --2- 172.21.15.6:0/2597160257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c04087530 0x7f0c04156960 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400c7d0 tx=0x7f0bf4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:31.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.237+0000 7f0beb7fe700 1 -- 172.21.15.6:0/2597160257 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4011600 con 0x7f0c04087530 2023-10-06T02:26:31.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.237+0000 7f0beb7fe700 1 -- 172.21.15.6:0/2597160257 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf4011760 con 0x7f0c04087530 2023-10-06T02:26:31.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.237+0000 7f0c0a251700 1 -- 172.21.15.6:0/2597160257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c040c55d0 con 0x7f0c04087530 2023-10-06T02:26:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.237+0000 7f0beb7fe700 1 -- 172.21.15.6:0/2597160257 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4011b20 con 0x7f0c04087530 2023-10-06T02:26:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.237+0000 7f0c0a251700 1 -- 172.21.15.6:0/2597160257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c040c5b90 con 0x7f0c04087530 2023-10-06T02:26:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.238+0000 7f0c0a251700 1 -- 172.21.15.6:0/2597160257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c040c5db0 con 0x7f0c04087530 2023-10-06T02:26:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.239+0000 7f0beb7fe700 1 -- 172.21.15.6:0/2597160257 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0bf40193f0 con 0x7f0c04087530 2023-10-06T02:26:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.239+0000 7f0beb7fe700 1 --2- 172.21.15.6:0/2597160257 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bf0066f30 0x7f0bf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.239+0000 7f0beb7fe700 1 -- 172.21.15.6:0/2597160257 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7496+0+0 (secure 0 0 0) 0x7f0bf4084f50 con 0x7f0c04087530 2023-10-06T02:26:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.239+0000 7f0c02ffd700 1 --2- 172.21.15.6:0/2597160257 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bf0066f30 0x7f0bf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:31.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.240+0000 7f0c02ffd700 1 --2- 172.21.15.6:0/2597160257 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bf0066f30 0x7f0bf00693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0c040c73a0 tx=0x7f0bf8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:31.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.244+0000 7f0beb7fe700 1 -- 172.21.15.6:0/2597160257 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bf4051ac0 con 0x7f0c04087530 2023-10-06T02:26:31.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:31.521+0000 7f0c0a251700 1 -- 172.21.15.6:0/2597160257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f0c040b0210 con 0x7f0c04087530 2023-10-06T02:26:32.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.094+0000 7f0beb7fe700 1 -- 172.21.15.6:0/2597160257 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v172) v1 ==== 107+0+0 (secure 0 0 0) 0x7f0bf40550e0 con 0x7f0c04087530 2023-10-06T02:26:32.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.096+0000 7f0c0a251700 1 -- 172.21.15.6:0/2597160257 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bf0066f30 msgr2=0x7f0bf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.096+0000 7f0c0a251700 1 --2- 172.21.15.6:0/2597160257 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bf0066f30 0x7f0bf00693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0c040c73a0 tx=0x7f0bf8008040 comp rx=0 tx=0).stop 2023-10-06T02:26:32.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.096+0000 7f0c0a251700 1 -- 172.21.15.6:0/2597160257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c04087530 msgr2=0x7f0c04156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.096+0000 7f0c0a251700 1 --2- 172.21.15.6:0/2597160257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c04087530 0x7f0c04156960 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400c7d0 tx=0x7f0bf4008040 comp rx=0 tx=0).stop 2023-10-06T02:26:32.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.097+0000 7f0c0a251700 1 -- 172.21.15.6:0/2597160257 shutdown_connections 2023-10-06T02:26:32.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.097+0000 7f0c0a251700 1 --2- 172.21.15.6:0/2597160257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0415a940 0x7f0c040cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.097+0000 7f0c0a251700 1 --2- 172.21.15.6:0/2597160257 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bf0066f30 0x7f0bf00693e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.097+0000 7f0c0a251700 1 --2- 172.21.15.6:0/2597160257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c04087530 0x7f0c04156960 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.097+0000 7f0c0a251700 1 --2- 172.21.15.6:0/2597160257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c0415a030 0x7f0c040cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.097+0000 7f0c0a251700 1 -- 172.21.15.6:0/2597160257 >> 172.21.15.6:0/2597160257 conn(0x7f0c04068680 msgr2=0x7f0c041577f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:32.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.097+0000 7f0c0a251700 1 -- 172.21.15.6:0/2597160257 shutdown_connections 2023-10-06T02:26:32.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.097+0000 7f0c0a251700 1 -- 172.21.15.6:0/2597160257 wait complete. 2023-10-06T02:26:32.099 INFO:teuthology.orchestra.run.smithi006.stderr:nothing to do: rank is not damaged 2023-10-06T02:26:32.112 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:26:32.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.191+0000 7f42d3f34000 1 Processor -- start 2023-10-06T02:26:32.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.191+0000 7f42d3f34000 1 -- start start 2023-10-06T02:26:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.191+0000 7f42d3f34000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39be02490 0x55d39be77080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.191+0000 7f42d3f34000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d39be78a80 0x55d39be775c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.191+0000 7f42d3f34000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d39be78e50 0x55d39be90dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.191+0000 7f42d3f34000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39bd03980 con 0x55d39be78a80 2023-10-06T02:26:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.191+0000 7f42d3f34000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39bd03620 con 0x55d39be02490 2023-10-06T02:26:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.191+0000 7f42d3f34000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d39bcfa400 con 0x55d39be78e50 2023-10-06T02:26:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.191+0000 7f42cc96e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d39be78a80 0x55d39be775c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.191+0000 7f42cc96e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d39be78a80 0x55d39be775c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38616/0 (socket says 172.21.15.6:38616) 2023-10-06T02:26:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.191+0000 7f42cc96e700 1 -- 172.21.15.6:0/2723901846 learned_addr learned my addr 172.21.15.6:0/2723901846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.191+0000 7f42cd16f700 1 --2- 172.21.15.6:0/2723901846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39be02490 0x55d39be77080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.192+0000 7f42cd970700 1 --2- 172.21.15.6:0/2723901846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d39be78e50 0x55d39be90dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.192+0000 7f42cc96e700 1 -- 172.21.15.6:0/2723901846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d39be78e50 msgr2=0x55d39be90dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.192+0000 7f42cc96e700 1 --2- 172.21.15.6:0/2723901846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d39be78e50 0x55d39be90dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.192+0000 7f42cc96e700 1 -- 172.21.15.6:0/2723901846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39be02490 msgr2=0x55d39be77080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.192+0000 7f42cc96e700 1 --2- 172.21.15.6:0/2723901846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39be02490 0x55d39be77080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.192+0000 7f42cc96e700 1 -- 172.21.15.6:0/2723901846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c000a180 con 0x55d39be78a80 2023-10-06T02:26:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.192+0000 7f42cc96e700 1 --2- 172.21.15.6:0/2723901846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d39be78a80 0x55d39be775c0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f42b800a4b0 tx=0x7f42b80059d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c82c690096b714c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.192+0000 7f42c77fe700 1 -- 172.21.15.6:0/2723901846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b800c610 con 0x55d39be78a80 2023-10-06T02:26:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.192+0000 7f42c77fe700 1 -- 172.21.15.6:0/2723901846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b800c790 con 0x55d39be78a80 2023-10-06T02:26:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.192+0000 7f42c77fe700 1 -- 172.21.15.6:0/2723901846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b800cb50 con 0x55d39be78a80 2023-10-06T02:26:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.193+0000 7f42d3f34000 1 -- 172.21.15.6:0/2723901846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d39be78a80 msgr2=0x55d39be775c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.193+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2723901846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d39be78a80 0x55d39be775c0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f42b800a4b0 tx=0x7f42b80059d0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.193+0000 7f42d3f34000 1 -- 172.21.15.6:0/2723901846 shutdown_connections 2023-10-06T02:26:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.193+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2723901846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d39be78e50 0x55d39be90dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.193+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2723901846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39be02490 0x55d39be77080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.193+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2723901846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d39be78a80 0x55d39be775c0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.193+0000 7f42d3f34000 1 -- 172.21.15.6:0/2723901846 >> 172.21.15.6:0/2723901846 conn(0x55d39bdb95d0 msgr2=0x55d39bdb6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.193+0000 7f42d3f34000 1 -- 172.21.15.6:0/2723901846 shutdown_connections 2023-10-06T02:26:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.193+0000 7f42d3f34000 1 -- 172.21.15.6:0/2723901846 wait complete. 2023-10-06T02:26:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.193+0000 7f42d3f34000 1 Processor -- start 2023-10-06T02:26:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.193+0000 7f42d3f34000 1 -- start start 2023-10-06T02:26:32.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.194+0000 7f42d3f34000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d39be02490 0x55d39be95230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.194+0000 7f42d3f34000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39be78a80 0x55d39bdfd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.194+0000 7f42d3f34000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d39be78e50 0x55d39bdfde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.194+0000 7f42d3f34000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39be9f970 con 0x55d39be02490 2023-10-06T02:26:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.194+0000 7f42d3f34000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39be95e50 con 0x55d39be78a80 2023-10-06T02:26:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.194+0000 7f42d3f34000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d39be960f0 con 0x55d39be78e50 2023-10-06T02:26:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.194+0000 7f42cd16f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d39be02490 0x55d39be95230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.194+0000 7f42cd16f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d39be02490 0x55d39be95230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38632/0 (socket says 172.21.15.6:38632) 2023-10-06T02:26:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.194+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 learned_addr learned my addr 172.21.15.6:0/2183103280 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.194+0000 7f42cc96e700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39be78a80 0x55d39bdfd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.194+0000 7f42cd970700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d39be78e50 0x55d39bdfde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.195+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d39be78e50 msgr2=0x55d39bdfde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.195+0000 7f42cd16f700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d39be78e50 0x55d39bdfde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.195+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39be78a80 msgr2=0x55d39bdfd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.195+0000 7f42cd16f700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39be78a80 0x55d39bdfd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.195+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b8005c90 con 0x55d39be02490 2023-10-06T02:26:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.195+0000 7f42cd16f700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d39be02490 0x55d39be95230 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f42c8008b50 tx=0x7f42c8005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.195+0000 7f42c5ffb700 1 -- 172.21.15.6:0/2183103280 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c800f050 con 0x55d39be02490 2023-10-06T02:26:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.195+0000 7f42c5ffb700 1 -- 172.21.15.6:0/2183103280 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c8010040 con 0x55d39be02490 2023-10-06T02:26:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.195+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d39bd123d0 con 0x55d39be02490 2023-10-06T02:26:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.195+0000 7f42c5ffb700 1 -- 172.21.15.6:0/2183103280 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8006cb0 con 0x55d39be02490 2023-10-06T02:26:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.195+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d39bd05ae0 con 0x55d39be02490 2023-10-06T02:26:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.196+0000 7f42c5ffb700 1 -- 172.21.15.6:0/2183103280 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42c8015670 con 0x55d39be02490 2023-10-06T02:26:32.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.197+0000 7f42c5ffb700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f42b0065890 0x7f42b0067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.197+0000 7f42c5ffb700 1 -- 172.21.15.6:0/2183103280 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7496+0+0 (secure 0 0 0) 0x7f42c80840b0 con 0x55d39be02490 2023-10-06T02:26:32.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.197+0000 7f42cc96e700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f42b0065890 0x7f42b0067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.202 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:26:32.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.197+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55d39be767f0 0x55d39beab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.197+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39be92df0 con 0x55d39be767f0 2023-10-06T02:26:32.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.197+0000 7f42cd970700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55d39be767f0 0x55d39beab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.198+0000 7f42cc96e700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f42b0065890 0x7f42b0067d40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f42b8005a10 tx=0x7f42b8015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:32.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.198+0000 7f42cd970700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55d39be767f0 0x55d39beab4c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:32.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.199+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v108'381 uv355 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.199+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bea0dd0 con 0x55d39be767f0 2023-10-06T02:26:32.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.200+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v108'382 uv382 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.200+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beaba00 con 0x55d39be767f0 2023-10-06T02:26:32.204 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:26:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.202+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v108'383 uv383 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.202+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beacdc0 con 0x55d39be767f0 2023-10-06T02:26:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.203+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v108'384 uv384 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.203+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bead170 con 0x55d39be767f0 2023-10-06T02:26:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.204+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v108'385 uv385 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.204+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beabdb0 con 0x55d39be767f0 2023-10-06T02:26:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.205+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v108'386 uv386 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.205+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beac1e0 con 0x55d39be767f0 2023-10-06T02:26:32.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.206+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v108'387 uv361 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.206+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beac5e0 con 0x55d39be767f0 2023-10-06T02:26:32.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.208+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v108'388 uv388 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.208+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beac5e0 con 0x55d39be767f0 2023-10-06T02:26:32.210 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:26:32.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.209+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v108'389 uv389 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.209+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beac5e0 con 0x55d39be767f0 2023-10-06T02:26:32.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.210+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v108'390 uv390 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.210+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beac5e0 con 0x55d39be767f0 2023-10-06T02:26:32.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.211+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v108'391 uv391 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.211+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beac590 con 0x55d39be767f0 2023-10-06T02:26:32.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.212+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v108'392 uv392 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.212+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beac590 con 0x55d39be767f0 2023-10-06T02:26:32.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.213+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v108'393 uv368 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.213+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beac590 con 0x55d39be767f0 2023-10-06T02:26:32.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.214+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v108'394 uv394 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.214+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beac590 con 0x55d39be767f0 2023-10-06T02:26:32.216 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:26:32.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.215+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v108'395 uv395 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.215+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beac590 con 0x55d39be767f0 2023-10-06T02:26:32.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.216+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v108'396 uv396 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.216+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beac590 con 0x55d39be767f0 2023-10-06T02:26:32.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.217+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v108'397 uv397 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.217+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beac590 con 0x55d39be767f0 2023-10-06T02:26:32.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.219+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v108'398 uv398 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.219+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bead520 con 0x55d39be767f0 2023-10-06T02:26:32.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.220+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v108'399 uv399 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.220+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bead520 con 0x55d39be767f0 2023-10-06T02:26:32.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.221+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v108'400 uv374 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.221+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bead520 con 0x55d39be767f0 2023-10-06T02:26:32.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.222+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v108'401 uv401 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.222+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bead520 con 0x55d39be767f0 2023-10-06T02:26:32.224 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:26:32.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.223+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v108'402 uv402 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.223+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beae530 con 0x55d39be767f0 2023-10-06T02:26:32.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.224+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v108'403 uv403 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.224+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beae530 con 0x55d39be767f0 2023-10-06T02:26:32.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.225+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v108'404 uv404 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.225+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bead520 con 0x55d39be767f0 2023-10-06T02:26:32.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.226+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v108'405 uv405 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.226+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bead520 con 0x55d39be767f0 2023-10-06T02:26:32.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.227+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v108'406 uv380 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.227+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bead520 con 0x55d39be767f0 2023-10-06T02:26:32.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.229+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v108'407 uv407 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.229+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bead520 con 0x55d39be767f0 2023-10-06T02:26:32.231 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:26:32.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.230+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v108'408 uv408 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.230+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beae530 con 0x55d39be767f0 2023-10-06T02:26:32.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.231+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v108'409 uv409 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.231+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beae530 con 0x55d39be767f0 2023-10-06T02:26:32.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.232+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v108'410 uv410 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.232+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bead520 con 0x55d39be767f0 2023-10-06T02:26:32.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.233+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v108'411 uv411 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39be767f0 2023-10-06T02:26:32.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.233+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55d39beada30 0x55d39beafe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.233+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb0350 con 0x55d39beada30 2023-10-06T02:26:32.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.233+0000 7f42cd16f700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55d39beada30 0x55d39beafe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.234+0000 7f42cd16f700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55d39beada30 0x55d39beafe10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.235+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v108'282 uv262 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.236+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb0700 con 0x55d39beada30 2023-10-06T02:26:32.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.237+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v108'283 uv283 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.237+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb0ab0 con 0x55d39beada30 2023-10-06T02:26:32.244 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:26:32.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.243+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v108'284 uv284 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.243+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb1350 con 0x55d39beada30 2023-10-06T02:26:32.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.244+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v108'285 uv285 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.244+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb1700 con 0x55d39beada30 2023-10-06T02:26:32.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.247+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v108'286 uv286 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.247+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb1ab0 con 0x55d39beada30 2023-10-06T02:26:32.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.249+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v108'287 uv281 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.249+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb1e60 con 0x55d39beada30 2023-10-06T02:26:32.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.252+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v108'288 uv288 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.252+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb2210 con 0x55d39beada30 2023-10-06T02:26:32.256 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:26:32.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.255+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v108'289 uv289 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.255+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb2210 con 0x55d39beada30 2023-10-06T02:26:32.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.257+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v108'290 uv290 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.257+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb2210 con 0x55d39beada30 2023-10-06T02:26:32.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.260+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v108'291 uv291 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.260+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb2210 con 0x55d39beada30 2023-10-06T02:26:32.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.263+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v108'292 uv280 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.263+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb2210 con 0x55d39beada30 2023-10-06T02:26:32.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.265+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v108'293 uv293 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.265+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb2210 con 0x55d39beada30 2023-10-06T02:26:32.269 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:26:32.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.268+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v108'294 uv294 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.268+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb5930 con 0x55d39beada30 2023-10-06T02:26:32.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.270+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v108'295 uv295 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.270+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb5930 con 0x55d39beada30 2023-10-06T02:26:32.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.276+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v108'296 uv296 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.276+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb2210 con 0x55d39beada30 2023-10-06T02:26:32.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.277+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v108'297 uv278 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.277+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb2210 con 0x55d39beada30 2023-10-06T02:26:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.280+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v108'298 uv298 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.280+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb2210 con 0x55d39beada30 2023-10-06T02:26:32.284 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:26:32.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.283+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v108'299 uv299 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.283+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb3220 con 0x55d39beada30 2023-10-06T02:26:32.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.284+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v108'300 uv300 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.284+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb3220 con 0x55d39beada30 2023-10-06T02:26:32.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.285+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v108'301 uv301 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.285+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb2210 con 0x55d39beada30 2023-10-06T02:26:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.288+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v108'302 uv302 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.288+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55d39beb2b20 0x55d39beb2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.288+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb2210 con 0x55d39beb2b20 2023-10-06T02:26:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.288+0000 7f42cc96e700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55d39beb2b20 0x55d39beb2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.288+0000 7f42cc96e700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55d39beb2b20 0x55d39beb2f10 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:32.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.289+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v108'75 uv74 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.289+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb5680 con 0x55d39beb2b20 2023-10-06T02:26:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.290+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v108'76 uv76 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.290+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb5bc0 con 0x55d39beb2b20 2023-10-06T02:26:32.292 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:26:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.291+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v108'77 uv77 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.291+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb74c0 con 0x55d39beb2b20 2023-10-06T02:26:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.292+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v108'78 uv78 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.292+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb7870 con 0x55d39beb2b20 2023-10-06T02:26:32.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.293+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v108'79 uv79 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.293+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb64b0 con 0x55d39beb2b20 2023-10-06T02:26:32.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.294+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v108'80 uv80 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.294+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb68b0 con 0x55d39beb2b20 2023-10-06T02:26:32.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.295+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v108'56 uv55 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.295+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb68b0 con 0x55d39beb2b20 2023-10-06T02:26:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.297+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v108'57 uv57 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.297+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb68b0 con 0x55d39beb2b20 2023-10-06T02:26:32.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.298+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v108'58 uv58 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.299 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:26:32.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.298+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb68b0 con 0x55d39beb2b20 2023-10-06T02:26:32.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.299+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v108'59 uv59 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.299+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb68b0 con 0x55d39beada30 2023-10-06T02:26:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.300+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v108'75 uv74 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.300+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb68b0 con 0x55d39beada30 2023-10-06T02:26:32.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.301+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v108'76 uv76 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.301+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb68b0 con 0x55d39beada30 2023-10-06T02:26:32.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.302+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v108'77 uv77 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.304 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:26:32.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.302+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb68b0 con 0x55d39beada30 2023-10-06T02:26:32.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.303+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v108'78 uv78 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.303+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb68b0 con 0x55d39beada30 2023-10-06T02:26:32.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.304+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v108'79 uv79 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.304+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beb68b0 con 0x55d39beada30 2023-10-06T02:26:32.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.306+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v108'80 uv80 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39beada30 2023-10-06T02:26:32.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.306+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55d39beb7c20 0x55d39beba000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.306+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beba540 con 0x55d39beb7c20 2023-10-06T02:26:32.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.307+0000 7f42cd970700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55d39beb7c20 0x55d39beba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.307+0000 7f42cd970700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55d39beb7c20 0x55d39beba000 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.308+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v108'138 uv132 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39beb7c20 2023-10-06T02:26:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.308+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beba540 con 0x55d39beb7c20 2023-10-06T02:26:32.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.309+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v108'139 uv139 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39beb7c20 2023-10-06T02:26:32.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.309+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beba540 con 0x55d39beb7c20 2023-10-06T02:26:32.311 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:26:32.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.310+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v108'140 uv140 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39beb7c20 2023-10-06T02:26:32.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.310+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bebb550 con 0x55d39beb7c20 2023-10-06T02:26:32.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.311+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v108'141 uv141 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39beb7c20 2023-10-06T02:26:32.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.311+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bebb550 con 0x55d39beb7c20 2023-10-06T02:26:32.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.312+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v108'142 uv142 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39beb7c20 2023-10-06T02:26:32.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.312+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beba540 con 0x55d39beb7c20 2023-10-06T02:26:32.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.313+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v108'143 uv143 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39beb7c20 2023-10-06T02:26:32.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.313+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beba540 con 0x55d39beb7c20 2023-10-06T02:26:32.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.314+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v108'144 uv137 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39beb7c20 2023-10-06T02:26:32.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.314+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beba540 con 0x55d39beb7c20 2023-10-06T02:26:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.315+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v108'145 uv145 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39beb7c20 2023-10-06T02:26:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.315+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beba540 con 0x55d39beb7c20 2023-10-06T02:26:32.318 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:26:32.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.316+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v108'146 uv146 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39beb7c20 2023-10-06T02:26:32.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.317+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beba540 con 0x55d39beb7c20 2023-10-06T02:26:32.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.318+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v108'147 uv147 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39beb7c20 2023-10-06T02:26:32.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.318+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39beba540 con 0x55d39beb7c20 2023-10-06T02:26:32.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.319+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v108'148 uv148 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39beb7c20 2023-10-06T02:26:32.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.319+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55d39bebaa50 0x55d39bebce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.319+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bebd560 con 0x55d39bebaa50 2023-10-06T02:26:32.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.319+0000 7f42cd16f700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55d39bebaa50 0x55d39bebce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.319+0000 7f42cd16f700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55d39bebaa50 0x55d39bebce30 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:32.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.320+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v108'61 uv60 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39bebaa50 2023-10-06T02:26:32.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.320+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bebd560 con 0x55d39bebaa50 2023-10-06T02:26:32.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.321+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v108'62 uv62 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39bebaa50 2023-10-06T02:26:32.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.322+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bebd9c0 con 0x55d39bebaa50 2023-10-06T02:26:32.325 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:26:32.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.324+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v108'63 uv63 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39bebaa50 2023-10-06T02:26:32.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.324+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bebd9c0 con 0x55d39bebaa50 2023-10-06T02:26:32.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.325+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v108'64 uv64 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39bebaa50 2023-10-06T02:26:32.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.325+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bebd9c0 con 0x55d39bebaa50 2023-10-06T02:26:32.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.326+0000 7f42cd16f700 1 -- 172.21.15.6:0/2183103280 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v108'65 uv65 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42c801b020 con 0x55d39bebaa50 2023-10-06T02:26:32.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.327+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bebd9c0 con 0x55d39beb2b20 2023-10-06T02:26:32.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.328+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v108'75 uv74 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.328+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bebd9c0 con 0x55d39beb2b20 2023-10-06T02:26:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.329+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v108'76 uv76 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.329+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bebd9c0 con 0x55d39beb2b20 2023-10-06T02:26:32.332 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:26:32.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.330+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v108'77 uv77 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.331+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bebe9d0 con 0x55d39beb2b20 2023-10-06T02:26:32.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.332+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v108'78 uv78 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.332+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bebe9d0 con 0x55d39beb2b20 2023-10-06T02:26:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.333+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v108'79 uv79 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.333+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bebd9c0 con 0x55d39beb2b20 2023-10-06T02:26:32.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.334+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v108'80 uv80 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.335+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55d39bebe040 0x55d39bec0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.335+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec09a0 con 0x55d39bebe040 2023-10-06T02:26:32.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.335+0000 7f42cc96e700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55d39bebe040 0x55d39bec0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.335+0000 7f42cc96e700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55d39bebe040 0x55d39bec0420 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:32.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.336+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v108'122 uv116 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39bebe040 2023-10-06T02:26:32.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.336+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec0d80 con 0x55d39bebe040 2023-10-06T02:26:32.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.337+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v108'123 uv123 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39bebe040 2023-10-06T02:26:32.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.337+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec0d80 con 0x55d39bebe040 2023-10-06T02:26:32.339 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:26:32.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.338+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v108'124 uv124 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39bebe040 2023-10-06T02:26:32.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.338+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec0d80 con 0x55d39bebe040 2023-10-06T02:26:32.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.339+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v108'125 uv125 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39bebe040 2023-10-06T02:26:32.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.339+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec0d80 con 0x55d39bebe040 2023-10-06T02:26:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.340+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v108'126 uv126 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39bebe040 2023-10-06T02:26:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.340+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec0d80 con 0x55d39bebe040 2023-10-06T02:26:32.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.341+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v108'127 uv121 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39bebe040 2023-10-06T02:26:32.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.341+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec0d80 con 0x55d39bebe040 2023-10-06T02:26:32.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.342+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v108'128 uv128 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39bebe040 2023-10-06T02:26:32.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.342+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec0d80 con 0x55d39bebe040 2023-10-06T02:26:32.344 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:26:32.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.343+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v108'129 uv129 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39bebe040 2023-10-06T02:26:32.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.343+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec0d80 con 0x55d39bebe040 2023-10-06T02:26:32.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.343+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v108'130 uv130 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39bebe040 2023-10-06T02:26:32.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.343+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec3af0 con 0x55d39bebe040 2023-10-06T02:26:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.344+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v108'131 uv131 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39bebe040 2023-10-06T02:26:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.345+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec1270 con 0x55d39beb2b20 2023-10-06T02:26:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.345+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v108'57 uv55 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.345+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec1270 con 0x55d39beb2b20 2023-10-06T02:26:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.346+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v108'58 uv58 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.346+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec1270 con 0x55d39beb2b20 2023-10-06T02:26:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.347+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v108'59 uv59 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.349 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:26:32.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.347+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec1270 con 0x55d39beb2b20 2023-10-06T02:26:32.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.348+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v108'60 uv60 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.348+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55d39bec1780 0x55d39bec1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.348+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4240 con 0x55d39bec1780 2023-10-06T02:26:32.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.348+0000 7f42cd970700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55d39bec1780 0x55d39bec1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.349+0000 7f42cd970700 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55d39bec1780 0x55d39bec1b90 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:32.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.350+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v108'75 uv74 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39bec1780 2023-10-06T02:26:32.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.350+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4240 con 0x55d39bec1780 2023-10-06T02:26:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.351+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v108'76 uv76 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39bec1780 2023-10-06T02:26:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.351+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4240 con 0x55d39bec1780 2023-10-06T02:26:32.353 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:26:32.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.352+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v108'77 uv77 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39bec1780 2023-10-06T02:26:32.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.352+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec5250 con 0x55d39bec1780 2023-10-06T02:26:32.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.353+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v108'78 uv78 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39bec1780 2023-10-06T02:26:32.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.353+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec5250 con 0x55d39bec1780 2023-10-06T02:26:32.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.354+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v108'79 uv79 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39bec1780 2023-10-06T02:26:32.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.354+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4240 con 0x55d39bec1780 2023-10-06T02:26:32.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.355+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v108'80 uv80 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39bec1780 2023-10-06T02:26:32.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.355+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4240 con 0x55d39beb7c20 2023-10-06T02:26:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.356+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v108'64 uv63 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39beb7c20 2023-10-06T02:26:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.356+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4240 con 0x55d39beb7c20 2023-10-06T02:26:32.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.357+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v108'65 uv65 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39beb7c20 2023-10-06T02:26:32.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.357+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4240 con 0x55d39beb7c20 2023-10-06T02:26:32.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.358+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v108'66 uv66 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39beb7c20 2023-10-06T02:26:32.360 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:26:32.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.358+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4240 con 0x55d39beb7c20 2023-10-06T02:26:32.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.359+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v108'67 uv67 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39beb7c20 2023-10-06T02:26:32.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.359+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4240 con 0x55d39beb7c20 2023-10-06T02:26:32.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.362+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v108'68 uv68 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f42c000e7e0 con 0x55d39beb7c20 2023-10-06T02:26:32.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.362+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4240 con 0x55d39beb2b20 2023-10-06T02:26:32.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.364+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v108'157 uv148 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.364+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4240 con 0x55d39beb2b20 2023-10-06T02:26:32.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.365+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v108'158 uv158 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.365+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4240 con 0x55d39beb2b20 2023-10-06T02:26:32.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.366+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v108'159 uv159 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.367 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:26:32.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.366+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4240 con 0x55d39beb2b20 2023-10-06T02:26:32.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.367+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v108'160 uv160 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.367+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4640 con 0x55d39beb2b20 2023-10-06T02:26:32.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.370+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v108'161 uv161 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.370+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4640 con 0x55d39beb2b20 2023-10-06T02:26:32.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.373+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v108'162 uv155 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.373+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4240 con 0x55d39beb2b20 2023-10-06T02:26:32.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.375+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v108'163 uv163 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.376+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4240 con 0x55d39beb2b20 2023-10-06T02:26:32.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.378+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v108'164 uv164 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.379 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:26:32.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.378+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4240 con 0x55d39beb2b20 2023-10-06T02:26:32.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.381+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v108'165 uv165 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.381+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec5250 con 0x55d39beb2b20 2023-10-06T02:26:32.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.382+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v108'166 uv166 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.382+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4730 con 0x55d39beb2b20 2023-10-06T02:26:32.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.384+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v108'167 uv167 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.384+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d39bec4730 con 0x55d39beb2b20 2023-10-06T02:26:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42cc96e700 1 -- 172.21.15.6:0/2183103280 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v108'168 uv168 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f42b800c900 con 0x55d39beb2b20 2023-10-06T02:26:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55d39beb2b20 msgr2=0x55d39beb2f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55d39beb2b20 0x55d39beb2f10 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55d39be767f0 msgr2=0x55d39beab4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55d39be767f0 0x55d39beab4c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55d39bebe040 msgr2=0x55d39bec0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55d39bebe040 0x55d39bec0420 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55d39beada30 msgr2=0x55d39beafe10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55d39beada30 0x55d39beafe10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55d39bec1780 msgr2=0x55d39bec1b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55d39bec1780 0x55d39bec1b90 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55d39bebaa50 msgr2=0x55d39bebce30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55d39bebaa50 0x55d39bebce30 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 reap_dead start 2023-10-06T02:26:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55d39beb7c20 msgr2=0x55d39beba000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55d39beb7c20 0x55d39beba000 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 reap_dead start 2023-10-06T02:26:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 reap_dead start 2023-10-06T02:26:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42cd970700 1 -- 172.21.15.6:0/2183103280 reap_dead start 2023-10-06T02:26:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f42b0065890 msgr2=0x7f42b0067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f42b0065890 0x7f42b0067d40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f42b8005a10 tx=0x7f42b8015000 comp rx=0 tx=0).stop 2023-10-06T02:26:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d39be02490 msgr2=0x55d39be95230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d39be02490 0x55d39be95230 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f42c8008b50 tx=0x7f42c8005be0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 shutdown_connections 2023-10-06T02:26:32.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d39be02490 0x55d39be95230 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 --2- 172.21.15.6:0/2183103280 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f42b0065890 0x7f42b0067d40 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 >> 172.21.15.6:0/2183103280 conn(0x55d39bdb95d0 msgr2=0x55d39bde6340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:32.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 shutdown_connections 2023-10-06T02:26:32.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.385+0000 7f42d3f34000 1 -- 172.21.15.6:0/2183103280 wait complete. 2023-10-06T02:26:32.391 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 100.00000000.inode 2023-10-06T02:26:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.468+0000 7f459e528000 1 Processor -- start 2023-10-06T02:26:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.468+0000 7f459e528000 1 -- start start 2023-10-06T02:26:32.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.469+0000 7f459e528000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559da141c7a0 0x559da14a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.469+0000 7f459e528000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da14a7cb0 0x559da14a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.469+0000 7f459e528000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559da14abaa0 0x559da14a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.469+0000 7f459e528000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da131f980 con 0x559da14a7cb0 2023-10-06T02:26:32.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.469+0000 7f459e528000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da131f620 con 0x559da14abaa0 2023-10-06T02:26:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.469+0000 7f459e528000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x559da1316400 con 0x559da141c7a0 2023-10-06T02:26:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.469+0000 7f4596f62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da14a7cb0 0x559da14a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.469+0000 7f4596f62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da14a7cb0 0x559da14a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38662/0 (socket says 172.21.15.6:38662) 2023-10-06T02:26:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.469+0000 7f4596f62700 1 -- 172.21.15.6:0/3402033089 learned_addr learned my addr 172.21.15.6:0/3402033089 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.469+0000 7f4597763700 1 --2- 172.21.15.6:0/3402033089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559da141c7a0 0x559da14a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.469+0000 7f4597f64700 1 --2- 172.21.15.6:0/3402033089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559da14abaa0 0x559da14a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.469+0000 7f4596f62700 1 -- 172.21.15.6:0/3402033089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559da141c7a0 msgr2=0x559da14a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.469+0000 7f4596f62700 1 --2- 172.21.15.6:0/3402033089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559da141c7a0 0x559da14a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.469+0000 7f4596f62700 1 -- 172.21.15.6:0/3402033089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559da14abaa0 msgr2=0x559da14a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.469+0000 7f4596f62700 1 --2- 172.21.15.6:0/3402033089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559da14abaa0 0x559da14a9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.469+0000 7f4596f62700 1 -- 172.21.15.6:0/3402033089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458800a0e0 con 0x559da14a7cb0 2023-10-06T02:26:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.470+0000 7f4597f64700 1 --2- 172.21.15.6:0/3402033089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559da14abaa0 0x559da14a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.470+0000 7f4596f62700 1 --2- 172.21.15.6:0/3402033089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da14a7cb0 0x559da14a98e0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f458c00b3d0 tx=0x7f458c0017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2886820e8b9c0dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.470+0000 7f4595f60700 1 -- 172.21.15.6:0/3402033089 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c00e470 con 0x559da14a7cb0 2023-10-06T02:26:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.470+0000 7f4595f60700 1 -- 172.21.15.6:0/3402033089 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c00e5d0 con 0x559da14a7cb0 2023-10-06T02:26:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.470+0000 7f4595f60700 1 -- 172.21.15.6:0/3402033089 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c00e990 con 0x559da14a7cb0 2023-10-06T02:26:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.470+0000 7f459e528000 1 -- 172.21.15.6:0/3402033089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da14a7cb0 msgr2=0x559da14a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.470+0000 7f459e528000 1 --2- 172.21.15.6:0/3402033089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da14a7cb0 0x559da14a98e0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f458c00b3d0 tx=0x7f458c0017f0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.470+0000 7f459e528000 1 -- 172.21.15.6:0/3402033089 shutdown_connections 2023-10-06T02:26:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.470+0000 7f459e528000 1 --2- 172.21.15.6:0/3402033089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559da14abaa0 0x559da14a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.470+0000 7f459e528000 1 --2- 172.21.15.6:0/3402033089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559da141c7a0 0x559da14a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.470+0000 7f459e528000 1 --2- 172.21.15.6:0/3402033089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da14a7cb0 0x559da14a98e0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.470+0000 7f459e528000 1 -- 172.21.15.6:0/3402033089 >> 172.21.15.6:0/3402033089 conn(0x559da13d4d50 msgr2=0x559da1403e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.470+0000 7f459e528000 1 -- 172.21.15.6:0/3402033089 shutdown_connections 2023-10-06T02:26:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.470+0000 7f459e528000 1 -- 172.21.15.6:0/3402033089 wait complete. 2023-10-06T02:26:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.471+0000 7f459e528000 1 Processor -- start 2023-10-06T02:26:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.471+0000 7f459e528000 1 -- start start 2023-10-06T02:26:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f459e528000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559da141c7a0 0x559da14b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f459e528000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559da14a7cb0 0x559da14a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f459e528000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da14abaa0 0x559da14b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f459e528000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da14b0570 con 0x559da14abaa0 2023-10-06T02:26:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f459e528000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da14b0810 con 0x559da141c7a0 2023-10-06T02:26:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f459e528000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x559da14b0ab0 con 0x559da14a7cb0 2023-10-06T02:26:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f4597f64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da14abaa0 0x559da14b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f4597f64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da14abaa0 0x559da14b1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38672/0 (socket says 172.21.15.6:38672) 2023-10-06T02:26:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f4597f64700 1 -- 172.21.15.6:0/2667870475 learned_addr learned my addr 172.21.15.6:0/2667870475 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f4597763700 1 --2- 172.21.15.6:0/2667870475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559da141c7a0 0x559da14b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f4596f62700 1 --2- 172.21.15.6:0/2667870475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559da14a7cb0 0x559da14a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f4597f64700 1 -- 172.21.15.6:0/2667870475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559da14a7cb0 msgr2=0x559da14a62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f4597f64700 1 --2- 172.21.15.6:0/2667870475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559da14a7cb0 0x559da14a62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f4597f64700 1 -- 172.21.15.6:0/2667870475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559da141c7a0 msgr2=0x559da14b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f4597f64700 1 --2- 172.21.15.6:0/2667870475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559da141c7a0 0x559da14b11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f4597f64700 1 -- 172.21.15.6:0/2667870475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c001ad0 con 0x559da14abaa0 2023-10-06T02:26:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f4597f64700 1 --2- 172.21.15.6:0/2667870475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da14abaa0 0x559da14b1970 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x559da13d4b10 tx=0x7f4588015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:32.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f457ffff700 1 -- 172.21.15.6:0/2667870475 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4588005870 con 0x559da14abaa0 2023-10-06T02:26:32.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f457ffff700 1 -- 172.21.15.6:0/2667870475 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45880032f0 con 0x559da14abaa0 2023-10-06T02:26:32.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f459e528000 1 -- 172.21.15.6:0/2667870475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559da132e3d0 con 0x559da14abaa0 2023-10-06T02:26:32.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f457ffff700 1 -- 172.21.15.6:0/2667870475 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4588025680 con 0x559da14abaa0 2023-10-06T02:26:32.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.472+0000 7f459e528000 1 -- 172.21.15.6:0/2667870475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559da1321ae0 con 0x559da14abaa0 2023-10-06T02:26:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.474+0000 7f457ffff700 1 -- 172.21.15.6:0/2667870475 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4588022070 con 0x559da14abaa0 2023-10-06T02:26:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.474+0000 7f457ffff700 1 --2- 172.21.15.6:0/2667870475 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4584065890 0x7f4584067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.474+0000 7f457ffff700 1 -- 172.21.15.6:0/2667870475 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7496+0+0 (secure 0 0 0) 0x7f4588085a10 con 0x559da14abaa0 2023-10-06T02:26:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.474+0000 7f4597763700 1 --2- 172.21.15.6:0/2667870475 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4584065890 0x7f4584067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.474+0000 7f459e528000 1 --2- 172.21.15.6:0/2667870475 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x559da13d6ed0 0x559da1416f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.474+0000 7f459e528000 1 -- 172.21.15.6:0/2667870475 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e108) v8 -- 0x559da1417470 con 0x559da13d6ed0 2023-10-06T02:26:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.474+0000 7f4596f62700 1 --2- 172.21.15.6:0/2667870475 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x559da13d6ed0 0x559da1416f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.475+0000 7f4597763700 1 --2- 172.21.15.6:0/2667870475 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4584065890 0x7f4584067d40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f4590009c20 tx=0x7f459000c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.475+0000 7f4596f62700 1 --2- 172.21.15.6:0/2667870475 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x559da13d6ed0 0x559da1416f30 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.476+0000 7f4596f62700 1 -- 172.21.15.6:0/2667870475 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 100.00000000.inode [delete] v108'169 uv169 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f458c014070 con 0x559da13d6ed0 2023-10-06T02:26:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.476+0000 7f459e528000 1 -- 172.21.15.6:0/2667870475 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x559da13d6ed0 msgr2=0x559da1416f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.476+0000 7f459e528000 1 --2- 172.21.15.6:0/2667870475 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x559da13d6ed0 0x559da1416f30 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.476+0000 7f459e528000 1 -- 172.21.15.6:0/2667870475 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4584065890 msgr2=0x7f4584067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.476+0000 7f459e528000 1 --2- 172.21.15.6:0/2667870475 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4584065890 0x7f4584067d40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f4590009c20 tx=0x7f459000c040 comp rx=0 tx=0).stop 2023-10-06T02:26:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.476+0000 7f459e528000 1 -- 172.21.15.6:0/2667870475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da14abaa0 msgr2=0x559da14b1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.476+0000 7f459e528000 1 --2- 172.21.15.6:0/2667870475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da14abaa0 0x559da14b1970 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x559da13d4b10 tx=0x7f4588015000 comp rx=0 tx=0).stop 2023-10-06T02:26:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.476+0000 7f4597f64700 1 -- 172.21.15.6:0/2667870475 reap_dead start 2023-10-06T02:26:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.476+0000 7f459e528000 1 -- 172.21.15.6:0/2667870475 shutdown_connections 2023-10-06T02:26:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.476+0000 7f459e528000 1 -- 172.21.15.6:0/2667870475 >> 172.21.15.6:0/2667870475 conn(0x559da13d4d50 msgr2=0x559da1403e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.476+0000 7f459e528000 1 -- 172.21.15.6:0/2667870475 shutdown_connections 2023-10-06T02:26:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.476+0000 7f459e528000 1 -- 172.21.15.6:0/2667870475 wait complete. 2023-10-06T02:26:32.483 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:26:32.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.642+0000 7fbaaec27700 1 Processor -- start 2023-10-06T02:26:32.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.642+0000 7fbaaec27700 1 -- start start 2023-10-06T02:26:32.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.642+0000 7fbaaec27700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbaa8159190 0x7fbaa80ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.642+0000 7fbaaec27700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbaa80ceed0 0x7fbaa806a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.642+0000 7fbaaec27700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaa80cc370 0x7fbaa806a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.642+0000 7fbaaec27700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa80cd5a0 con 0x7fbaa8159190 2023-10-06T02:26:32.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.642+0000 7fbaaec27700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa80b4e20 con 0x7fbaa80ceed0 2023-10-06T02:26:32.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.643+0000 7fbaaec27700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa80b4570 con 0x7fbaa80cc370 2023-10-06T02:26:32.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.643+0000 7fbaac9c3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbaa8159190 0x7fbaa80ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.643+0000 7fbaa7fff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbaa80ceed0 0x7fbaa806a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.643+0000 7fbaac9c3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbaa8159190 0x7fbaa80ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38684/0 (socket says 172.21.15.6:38684) 2023-10-06T02:26:32.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.643+0000 7fbaac9c3700 1 -- 172.21.15.6:0/1700259313 learned_addr learned my addr 172.21.15.6:0/1700259313 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:32.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.643+0000 7fbaad1c4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaa80cc370 0x7fbaa806a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.643+0000 7fbaac9c3700 1 -- 172.21.15.6:0/1700259313 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaa80cc370 msgr2=0x7fbaa806a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:32.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.643+0000 7fbaac9c3700 1 --2- 172.21.15.6:0/1700259313 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaa80cc370 0x7fbaa806a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.643+0000 7fbaac9c3700 1 -- 172.21.15.6:0/1700259313 >> v2:172.21.15.175:3300/0 conn(0x7fbaa80ceed0 msgr2=0x7fbaa806a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:32.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.643+0000 7fbaac9c3700 1 --2- 172.21.15.6:0/1700259313 >> v2:172.21.15.175:3300/0 conn(0x7fbaa80ceed0 0x7fbaa806a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.643+0000 7fbaac9c3700 1 -- 172.21.15.6:0/1700259313 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa80cd2c0 con 0x7fbaa8159190 2023-10-06T02:26:32.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.643+0000 7fbaa7fff700 1 --2- 172.21.15.6:0/1700259313 >> v2:172.21.15.175:3300/0 conn(0x7fbaa80ceed0 0x7fbaa806a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:26:32.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.643+0000 7fbaac9c3700 1 --2- 172.21.15.6:0/1700259313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa8159190 0x7fbaa80ce990 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80883b0 tx=0x7fbaa0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3ce420f2599267 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:32.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.643+0000 7fbaa77fe700 1 -- 172.21.15.6:0/1700259313 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa000e070 con 0x7fbaa8159190 2023-10-06T02:26:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.643+0000 7fbaa77fe700 1 -- 172.21.15.6:0/1700259313 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa000b970 con 0x7fbaa8159190 2023-10-06T02:26:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.643+0000 7fbaa77fe700 1 -- 172.21.15.6:0/1700259313 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa00092e0 con 0x7fbaa8159190 2023-10-06T02:26:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.644+0000 7fbaaec27700 1 -- 172.21.15.6:0/1700259313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa8159190 msgr2=0x7fbaa80ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.644+0000 7fbaaec27700 1 --2- 172.21.15.6:0/1700259313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa8159190 0x7fbaa80ce990 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80883b0 tx=0x7fbaa0009840 comp rx=0 tx=0).stop 2023-10-06T02:26:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.644+0000 7fbaaec27700 1 -- 172.21.15.6:0/1700259313 shutdown_connections 2023-10-06T02:26:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.644+0000 7fbaaec27700 1 --2- 172.21.15.6:0/1700259313 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaa80cc370 0x7fbaa806a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.644+0000 7fbaaec27700 1 --2- 172.21.15.6:0/1700259313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa8159190 0x7fbaa80ce990 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.644+0000 7fbaaec27700 1 --2- 172.21.15.6:0/1700259313 >> v2:172.21.15.175:3300/0 conn(0x7fbaa80ceed0 0x7fbaa806a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.644+0000 7fbaaec27700 1 -- 172.21.15.6:0/1700259313 >> 172.21.15.6:0/1700259313 conn(0x7fbaa8087340 msgr2=0x7fbaa8087710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.644+0000 7fbaaec27700 1 -- 172.21.15.6:0/1700259313 shutdown_connections 2023-10-06T02:26:32.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.644+0000 7fbaaec27700 1 -- 172.21.15.6:0/1700259313 wait complete. 2023-10-06T02:26:32.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.645+0000 7fbaaec27700 1 Processor -- start 2023-10-06T02:26:32.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.645+0000 7fbaaec27700 1 -- start start 2023-10-06T02:26:32.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaaec27700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaa80cc370 0x7fbaa80c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaaec27700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa80ceed0 0x7fbaa80c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaaec27700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaa8159190 0x7fbaa816a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaaec27700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa80c5910 con 0x7fbaa80ceed0 2023-10-06T02:26:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaaec27700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa80c5bf0 con 0x7fbaa8159190 2023-10-06T02:26:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaaec27700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa80c5ed0 con 0x7fbaa80cc370 2023-10-06T02:26:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaa7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa80ceed0 0x7fbaa80c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaa7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa80ceed0 0x7fbaa80c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38692/0 (socket says 172.21.15.6:38692) 2023-10-06T02:26:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaa7fff700 1 -- 172.21.15.6:0/2159913848 learned_addr learned my addr 172.21.15.6:0/2159913848 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaac9c3700 1 --2- 172.21.15.6:0/2159913848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaa80cc370 0x7fbaa80c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaad1c4700 1 --2- 172.21.15.6:0/2159913848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaa8159190 0x7fbaa816a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaa7fff700 1 -- 172.21.15.6:0/2159913848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaa80cc370 msgr2=0x7fbaa80c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaa7fff700 1 --2- 172.21.15.6:0/2159913848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaa80cc370 0x7fbaa80c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaa7fff700 1 -- 172.21.15.6:0/2159913848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaa8159190 msgr2=0x7fbaa816a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaa7fff700 1 --2- 172.21.15.6:0/2159913848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaa8159190 0x7fbaa816a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaa7fff700 1 -- 172.21.15.6:0/2159913848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba98009420 con 0x7fbaa80ceed0 2023-10-06T02:26:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaad1c4700 1 --2- 172.21.15.6:0/2159913848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaa8159190 0x7fbaa816a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.646+0000 7fbaac9c3700 1 --2- 172.21.15.6:0/2159913848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaa80cc370 0x7fbaa80c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.647+0000 7fbaa7fff700 1 --2- 172.21.15.6:0/2159913848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa80ceed0 0x7fbaa80c50c0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fba9800ec80 tx=0x7fba980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.647+0000 7fbaa4ff9700 1 -- 172.21.15.6:0/2159913848 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9800c9d0 con 0x7fbaa80ceed0 2023-10-06T02:26:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.647+0000 7fbaa4ff9700 1 -- 172.21.15.6:0/2159913848 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9800cb30 con 0x7fbaa80ceed0 2023-10-06T02:26:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.647+0000 7fbaaec27700 1 -- 172.21.15.6:0/2159913848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa0009ae0 con 0x7fbaa80ceed0 2023-10-06T02:26:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.647+0000 7fbaa4ff9700 1 -- 172.21.15.6:0/2159913848 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba98013470 con 0x7fbaa80ceed0 2023-10-06T02:26:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.647+0000 7fbaaec27700 1 -- 172.21.15.6:0/2159913848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa80c5600 con 0x7fbaa80ceed0 2023-10-06T02:26:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.648+0000 7fbaaec27700 1 -- 172.21.15.6:0/2159913848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa8088a20 con 0x7fbaa80ceed0 2023-10-06T02:26:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.648+0000 7fbaa4ff9700 1 -- 172.21.15.6:0/2159913848 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba98013820 con 0x7fbaa80ceed0 2023-10-06T02:26:32.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.648+0000 7fbaa4ff9700 1 --2- 172.21.15.6:0/2159913848 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba88066f30 0x7fba880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:32.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.649+0000 7fbaa4ff9700 1 -- 172.21.15.6:0/2159913848 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7496+0+0 (secure 0 0 0) 0x7fba980852d0 con 0x7fbaa80ceed0 2023-10-06T02:26:32.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.649+0000 7fbaac9c3700 1 --2- 172.21.15.6:0/2159913848 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba88066f30 0x7fba880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:32.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.649+0000 7fbaac9c3700 1 --2- 172.21.15.6:0/2159913848 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba88066f30 0x7fba880693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009880 tx=0x7fbaa0018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:32.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.653+0000 7fbaa4ff9700 1 -- 172.21.15.6:0/2159913848 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba98051e40 con 0x7fbaa80ceed0 2023-10-06T02:26:32.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:32.890+0000 7fbaaec27700 1 -- 172.21.15.6:0/2159913848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fbaa80b47d0 con 0x7fbaa80ceed0 2023-10-06T02:26:33.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.098+0000 7fbaa4ff9700 1 -- 172.21.15.6:0/2159913848 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v173) v1 ==== 162+0+0 (secure 0 0 0) 0x7fba98055460 con 0x7fbaa80ceed0 2023-10-06T02:26:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.100+0000 7fbaaec27700 1 -- 172.21.15.6:0/2159913848 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba88066f30 msgr2=0x7fba880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.100+0000 7fbaaec27700 1 --2- 172.21.15.6:0/2159913848 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba88066f30 0x7fba880693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009880 tx=0x7fbaa0018000 comp rx=0 tx=0).stop 2023-10-06T02:26:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.100+0000 7fbaaec27700 1 -- 172.21.15.6:0/2159913848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa80ceed0 msgr2=0x7fbaa80c50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.100+0000 7fbaaec27700 1 --2- 172.21.15.6:0/2159913848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa80ceed0 0x7fbaa80c50c0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fba9800ec80 tx=0x7fba980091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.100+0000 7fbaaec27700 1 -- 172.21.15.6:0/2159913848 shutdown_connections 2023-10-06T02:26:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.100+0000 7fbaaec27700 1 --2- 172.21.15.6:0/2159913848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaa8159190 0x7fbaa816a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.100+0000 7fbaaec27700 1 --2- 172.21.15.6:0/2159913848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaa80cc370 0x7fbaa80c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.100+0000 7fbaaec27700 1 --2- 172.21.15.6:0/2159913848 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba88066f30 0x7fba880693e0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.100+0000 7fbaaec27700 1 --2- 172.21.15.6:0/2159913848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa80ceed0 0x7fbaa80c50c0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.100+0000 7fbaaec27700 1 -- 172.21.15.6:0/2159913848 >> 172.21.15.6:0/2159913848 conn(0x7fbaa8087340 msgr2=0x7fbaa80b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.100+0000 7fbaaec27700 1 -- 172.21.15.6:0/2159913848 shutdown_connections 2023-10-06T02:26:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.100+0000 7fbaaec27700 1 -- 172.21.15.6:0/2159913848 wait complete. 2023-10-06T02:26:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:26:33.107 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:26:33.106+0000 7fd9e6e0d700 -1 mds.0.cache.ino(0x100) No data while reading inode 0x100 2023-10-06T02:26:33.108 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:26:33.106+0000 7fd9e6e0d700 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2023-10-06T02:26:33.108 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:26:33.107+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:26:33.108 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:26:33.107+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:26:33.114 INFO:tasks.ceph.mds.a.smithi006.stderr: -23> 2023-10-06T02:26:33.106+0000 7fd9e6e0d700 -1 mds.0.cache.ino(0x100) No data while reading inode 0x100 2023-10-06T02:26:33.114 INFO:tasks.ceph.mds.a.smithi006.stderr: -13> 2023-10-06T02:26:33.106+0000 7fd9e6e0d700 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2023-10-06T02:26:33.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:33.134 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:26:33.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.236+0000 7eff3b950700 1 Processor -- start 2023-10-06T02:26:33.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.236+0000 7eff3b950700 1 -- start start 2023-10-06T02:26:33.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.237+0000 7eff3b950700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff340ad110 0x7eff340aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.237+0000 7eff3b950700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff340cc430 con 0x7eff34159420 2023-10-06T02:26:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.237+0000 7eff3b950700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff340b1400 con 0x7eff341597f0 2023-10-06T02:26:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.237+0000 7eff3b950700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff340b0920 con 0x7eff340ad110 2023-10-06T02:26:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.237+0000 7eff396ec700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7eff34159420 0x7eff340aca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40934/0 (socket says 172.21.15.6:40934) 2023-10-06T02:26:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.237+0000 7eff396ec700 1 -- 172.21.15.6:0/3441204529 learned_addr learned my addr 172.21.15.6:0/3441204529 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.237+0000 7eff38eeb700 1 --2- 172.21.15.6:0/3441204529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff340ad110 0x7eff340aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.238+0000 7eff33fff700 1 -- 172.21.15.6:0/3441204529 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961782955 0 0) 0x7eff340cc430 con 0x7eff34159420 2023-10-06T02:26:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.238+0000 7eff33fff700 1 -- 172.21.15.6:0/3441204529 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff1c003570 con 0x7eff34159420 2023-10-06T02:26:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.238+0000 7eff33fff700 1 -- 172.21.15.6:0/3441204529 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2215311089 0 0) 0x7eff340b1400 con 0x7eff341597f0 2023-10-06T02:26:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.238+0000 7eff38eeb700 1 -- 172.21.15.6:0/3441204529 >> v1:172.21.15.175:6789/0 conn(0x7eff341597f0 legacy=0x7eff34068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.238+0000 7eff38eeb700 1 -- 172.21.15.6:0/3441204529 >> v1:172.21.15.6:6789/0 conn(0x7eff34159420 legacy=0x7eff340aca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.238+0000 7eff38eeb700 1 -- 172.21.15.6:0/3441204529 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff340b0b10 con 0x7eff340ad110 2023-10-06T02:26:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.238+0000 7eff38eeb700 1 --2- 172.21.15.6:0/3441204529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff340ad110 0x7eff340aeaa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7eff28009910 tx=0x7eff280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70828dae543efb98 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.238+0000 7eff33fff700 1 -- 172.21.15.6:0/3441204529 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2800b680 con 0x7eff340ad110 2023-10-06T02:26:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.238+0000 7eff33fff700 1 -- 172.21.15.6:0/3441204529 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2800b7e0 con 0x7eff340ad110 2023-10-06T02:26:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.238+0000 7eff33fff700 1 -- 172.21.15.6:0/3441204529 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2800bba0 con 0x7eff340ad110 2023-10-06T02:26:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.239+0000 7eff3b950700 1 -- 172.21.15.6:0/3441204529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff340ad110 msgr2=0x7eff340aeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.239+0000 7eff3b950700 1 --2- 172.21.15.6:0/3441204529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff340ad110 0x7eff340aeaa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7eff28009910 tx=0x7eff280091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.239+0000 7eff3b950700 1 -- 172.21.15.6:0/3441204529 shutdown_connections 2023-10-06T02:26:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.239+0000 7eff3b950700 1 --2- 172.21.15.6:0/3441204529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff340ad110 0x7eff340aeaa0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.239+0000 7eff3b950700 1 -- 172.21.15.6:0/3441204529 >> 172.21.15.6:0/3441204529 conn(0x7eff340cc790 msgr2=0x7eff340ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.239+0000 7eff3b950700 1 -- 172.21.15.6:0/3441204529 shutdown_connections 2023-10-06T02:26:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.239+0000 7eff3b950700 1 -- 172.21.15.6:0/3441204529 wait complete. 2023-10-06T02:26:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.240+0000 7eff3b950700 1 Processor -- start 2023-10-06T02:26:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.240+0000 7eff3b950700 1 -- start start 2023-10-06T02:26:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff3b950700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff340ad110 0x7eff3414cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff3b950700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff34159420 0x7eff34150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff3b950700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff341597f0 0x7eff340ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff3b950700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff34152390 con 0x7eff340ad110 2023-10-06T02:26:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff3b950700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3414eb60 con 0x7eff34159420 2023-10-06T02:26:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff3b950700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3414ee40 con 0x7eff341597f0 2023-10-06T02:26:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff396ec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff340ad110 0x7eff3414cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff396ec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff340ad110 0x7eff3414cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38706/0 (socket says 172.21.15.6:38706) 2023-10-06T02:26:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff396ec700 1 -- 172.21.15.6:0/546531981 learned_addr learned my addr 172.21.15.6:0/546531981 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff38eeb700 1 --2- 172.21.15.6:0/546531981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff34159420 0x7eff34150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff396ec700 1 -- 172.21.15.6:0/546531981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff341597f0 msgr2=0x7eff340ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff39eed700 1 --2- 172.21.15.6:0/546531981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff341597f0 0x7eff340ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff396ec700 1 --2- 172.21.15.6:0/546531981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff341597f0 0x7eff340ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff396ec700 1 -- 172.21.15.6:0/546531981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff34159420 msgr2=0x7eff34150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff396ec700 1 --2- 172.21.15.6:0/546531981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff34159420 0x7eff34150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff396ec700 1 -- 172.21.15.6:0/546531981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff28009420 con 0x7eff340ad110 2023-10-06T02:26:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff39eed700 1 --2- 172.21.15.6:0/546531981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff341597f0 0x7eff340ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff38eeb700 1 --2- 172.21.15.6:0/546531981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff34159420 0x7eff34150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.241+0000 7eff396ec700 1 --2- 172.21.15.6:0/546531981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff340ad110 0x7eff3414cba0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0011e0 tx=0x7eff2c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.242+0000 7eff317fa700 1 -- 172.21.15.6:0/546531981 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c005b30 con 0x7eff340ad110 2023-10-06T02:26:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.242+0000 7eff317fa700 1 -- 172.21.15.6:0/546531981 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c005c90 con 0x7eff340ad110 2023-10-06T02:26:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.242+0000 7eff3b950700 1 -- 172.21.15.6:0/546531981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3414f120 con 0x7eff340ad110 2023-10-06T02:26:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.242+0000 7eff317fa700 1 -- 172.21.15.6:0/546531981 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c0072e0 con 0x7eff340ad110 2023-10-06T02:26:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.242+0000 7eff3b950700 1 -- 172.21.15.6:0/546531981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3414d0e0 con 0x7eff340ad110 2023-10-06T02:26:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.243+0000 7eff3b950700 1 -- 172.21.15.6:0/546531981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff34152160 con 0x7eff340ad110 2023-10-06T02:26:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.243+0000 7eff317fa700 1 -- 172.21.15.6:0/546531981 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff2c007650 con 0x7eff340ad110 2023-10-06T02:26:33.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.244+0000 7eff317fa700 1 --2- 172.21.15.6:0/546531981 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff20066f30 0x7eff200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:33.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.244+0000 7eff317fa700 1 -- 172.21.15.6:0/546531981 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7582+0+0 (secure 0 0 0) 0x7eff2c084140 con 0x7eff340ad110 2023-10-06T02:26:33.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.244+0000 7eff38eeb700 1 --2- 172.21.15.6:0/546531981 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff20066f30 0x7eff200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:33.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.244+0000 7eff38eeb700 1 --2- 172.21.15.6:0/546531981 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff20066f30 0x7eff200693e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7eff28009860 tx=0x7eff28017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:33.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.248+0000 7eff317fa700 1 -- 172.21.15.6:0/546531981 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff2c04b5a0 con 0x7eff340ad110 2023-10-06T02:26:33.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.486+0000 7eff3b950700 1 -- 172.21.15.6:0/546531981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff3404bb80 con 0x7eff340ad110 2023-10-06T02:26:33.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.486+0000 7eff317fa700 1 -- 172.21.15.6:0/546531981 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 175 v175) v1 ==== 95+0+3840 (secure 0 0 0) 0x7eff2c017090 con 0x7eff340ad110 2023-10-06T02:26:33.488 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:33.488 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":175,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":175,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:33.108737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:33.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.488+0000 7eff3b950700 1 -- 172.21.15.6:0/546531981 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff20066f30 msgr2=0x7eff200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:33.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.488+0000 7eff3b950700 1 --2- 172.21.15.6:0/546531981 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff20066f30 0x7eff200693e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7eff28009860 tx=0x7eff28017000 comp rx=0 tx=0).stop 2023-10-06T02:26:33.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.488+0000 7eff3b950700 1 -- 172.21.15.6:0/546531981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff340ad110 msgr2=0x7eff3414cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:33.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.488+0000 7eff3b950700 1 --2- 172.21.15.6:0/546531981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff340ad110 0x7eff3414cba0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0011e0 tx=0x7eff2c007df0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.488+0000 7eff3b950700 1 -- 172.21.15.6:0/546531981 shutdown_connections 2023-10-06T02:26:33.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.488+0000 7eff3b950700 1 --2- 172.21.15.6:0/546531981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff341597f0 0x7eff340ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.488+0000 7eff3b950700 1 --2- 172.21.15.6:0/546531981 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7eff20066f30 0x7eff200693e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.488+0000 7eff3b950700 1 --2- 172.21.15.6:0/546531981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff340ad110 0x7eff3414cba0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.488+0000 7eff3b950700 1 --2- 172.21.15.6:0/546531981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff34159420 0x7eff34150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.488+0000 7eff3b950700 1 -- 172.21.15.6:0/546531981 >> 172.21.15.6:0/546531981 conn(0x7eff340cc790 msgr2=0x7eff3406b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:33.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.488+0000 7eff3b950700 1 -- 172.21.15.6:0/546531981 shutdown_connections 2023-10-06T02:26:33.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.488+0000 7eff3b950700 1 -- 172.21.15.6:0/546531981 wait complete. 2023-10-06T02:26:33.491 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 175 2023-10-06T02:26:33.502 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:26:33.502 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:33.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.660+0000 7f87e0ff7700 1 Processor -- start 2023-10-06T02:26:33.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.660+0000 7f87e0ff7700 1 -- start start 2023-10-06T02:26:33.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.661+0000 7f87e0ff7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f87dc0cf1a0 0x7f87dc0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:33.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.661+0000 7f87e0ff7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87dc1597d0 0x7f87dc0d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:33.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.661+0000 7f87e0ff7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87dc0b3560 con 0x7f87dc159400 2023-10-06T02:26:33.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.661+0000 7f87e0ff7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87dc0cf6f0 con 0x7f87dc0cf1a0 2023-10-06T02:26:33.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.661+0000 7f87e0ff7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0cf9d0 con 0x7f87dc1597d0 2023-10-06T02:26:33.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.661+0000 7f87dbfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87dc1597d0 0x7f87dc0d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:33.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.661+0000 7f87daffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f87dc0cf1a0 0x7f87dc0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:33.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.661+0000 7f87db7fe700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f87dc159400 0x7f87dc0ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:36072/0 (socket says 172.21.15.6:36072) 2023-10-06T02:26:33.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.661+0000 7f87dbfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87dc1597d0 0x7f87dc0d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:52688/0 (socket says 172.21.15.6:52688) 2023-10-06T02:26:33.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.661+0000 7f87daffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f87dc0cf1a0 0x7f87dc0cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:59486/0 (socket says 172.21.15.6:59486) 2023-10-06T02:26:33.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.661+0000 7f87dbfff700 1 -- 172.21.15.6:0/3293170505 learned_addr learned my addr 172.21.15.6:0/3293170505 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:33.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.661+0000 7f87dbfff700 1 -- 172.21.15.6:0/3293170505 >> v2:172.21.15.175:3300/0 conn(0x7f87dc0cf1a0 msgr2=0x7f87dc0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:33.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.661+0000 7f87dbfff700 1 --2- 172.21.15.6:0/3293170505 >> v2:172.21.15.175:3300/0 conn(0x7f87dc0cf1a0 0x7f87dc0cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.661+0000 7f87dbfff700 1 -- 172.21.15.6:0/3293170505 >> v1:172.21.15.175:6789/0 conn(0x7f87dc159400 legacy=0x7f87dc0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:33.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.661+0000 7f87dbfff700 1 -- 172.21.15.6:0/3293170505 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc0b2f10 con 0x7f87dc1597d0 2023-10-06T02:26:33.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.661+0000 7f87daffd700 1 --2- 172.21.15.6:0/3293170505 >> v2:172.21.15.175:3300/0 conn(0x7f87dc0cf1a0 0x7f87dc0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:26:33.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.662+0000 7f87dbfff700 1 --2- 172.21.15.6:0/3293170505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87dc1597d0 0x7f87dc0d0400 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009f20 tx=0x7f87d4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d99c954387a81fb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:33.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.662+0000 7f87da7fc700 1 -- 172.21.15.6:0/3293170505 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400e070 con 0x7f87dc1597d0 2023-10-06T02:26:33.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.662+0000 7f87da7fc700 1 -- 172.21.15.6:0/3293170505 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d400b9d0 con 0x7f87dc1597d0 2023-10-06T02:26:33.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.662+0000 7f87da7fc700 1 -- 172.21.15.6:0/3293170505 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d40092e0 con 0x7f87dc1597d0 2023-10-06T02:26:33.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.662+0000 7f87e0ff7700 1 -- 172.21.15.6:0/3293170505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87dc1597d0 msgr2=0x7f87dc0d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:33.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.662+0000 7f87e0ff7700 1 --2- 172.21.15.6:0/3293170505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87dc1597d0 0x7f87dc0d0400 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009f20 tx=0x7f87d4009840 comp rx=0 tx=0).stop 2023-10-06T02:26:33.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.662+0000 7f87e0ff7700 1 -- 172.21.15.6:0/3293170505 shutdown_connections 2023-10-06T02:26:33.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.662+0000 7f87e0ff7700 1 --2- 172.21.15.6:0/3293170505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87dc1597d0 0x7f87dc0d0400 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.662+0000 7f87e0ff7700 1 --2- 172.21.15.6:0/3293170505 >> v2:172.21.15.175:3300/0 conn(0x7f87dc0cf1a0 0x7f87dc0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.662+0000 7f87e0ff7700 1 -- 172.21.15.6:0/3293170505 >> 172.21.15.6:0/3293170505 conn(0x7f87dc06ac10 msgr2=0x7f87dc068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:33.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.663+0000 7f87e0ff7700 1 -- 172.21.15.6:0/3293170505 shutdown_connections 2023-10-06T02:26:33.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.663+0000 7f87e0ff7700 1 -- 172.21.15.6:0/3293170505 wait complete. 2023-10-06T02:26:33.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.664+0000 7f87e0ff7700 1 Processor -- start 2023-10-06T02:26:33.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.664+0000 7f87e0ff7700 1 -- start start 2023-10-06T02:26:33.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.664+0000 7f87e0ff7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87dc0cf1a0 0x7f87dc16cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:33.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87e0ff7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87dc159400 0x7f87dc15c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:33.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87e0ff7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87dc1597d0 0x7f87dc153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:33.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87e0ff7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc153b60 con 0x7f87dc1597d0 2023-10-06T02:26:33.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87e0ff7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc15da10 con 0x7f87dc0cf1a0 2023-10-06T02:26:33.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87e0ff7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc15ce00 con 0x7f87dc159400 2023-10-06T02:26:33.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87dbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87dc1597d0 0x7f87dc153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:33.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87dbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87dc1597d0 0x7f87dc153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38720/0 (socket says 172.21.15.6:38720) 2023-10-06T02:26:33.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87dbfff700 1 -- 172.21.15.6:0/3321550641 learned_addr learned my addr 172.21.15.6:0/3321550641 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:33.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87daffd700 1 --2- 172.21.15.6:0/3321550641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87dc159400 0x7f87dc15c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:33.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87db7fe700 1 --2- 172.21.15.6:0/3321550641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87dc0cf1a0 0x7f87dc16cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:33.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87dbfff700 1 -- 172.21.15.6:0/3321550641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87dc159400 msgr2=0x7f87dc15c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:33.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87dbfff700 1 --2- 172.21.15.6:0/3321550641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87dc159400 0x7f87dc15c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87dbfff700 1 -- 172.21.15.6:0/3321550641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87dc0cf1a0 msgr2=0x7f87dc16cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:33.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87dbfff700 1 --2- 172.21.15.6:0/3321550641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87dc0cf1a0 0x7f87dc16cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87dbfff700 1 -- 172.21.15.6:0/3321550641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d0009420 con 0x7f87dc1597d0 2023-10-06T02:26:33.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87dbfff700 1 --2- 172.21.15.6:0/3321550641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87dc1597d0 0x7f87dc153620 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f87d400b610 tx=0x7f87d4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:33.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87c37fe700 1 -- 172.21.15.6:0/3321550641 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4008ad0 con 0x7f87dc1597d0 2023-10-06T02:26:33.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87c37fe700 1 -- 172.21.15.6:0/3321550641 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d4008c30 con 0x7f87dc1597d0 2023-10-06T02:26:33.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87e0ff7700 1 -- 172.21.15.6:0/3321550641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d4009ae0 con 0x7f87dc1597d0 2023-10-06T02:26:33.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87c37fe700 1 -- 172.21.15.6:0/3321550641 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d401c410 con 0x7f87dc1597d0 2023-10-06T02:26:33.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.665+0000 7f87e0ff7700 1 -- 172.21.15.6:0/3321550641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87dc15d3c0 con 0x7f87dc1597d0 2023-10-06T02:26:33.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.666+0000 7f87e0ff7700 1 -- 172.21.15.6:0/3321550641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87dc0b31f0 con 0x7f87dc1597d0 2023-10-06T02:26:33.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.667+0000 7f87c37fe700 1 -- 172.21.15.6:0/3321550641 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87d4003040 con 0x7f87dc1597d0 2023-10-06T02:26:33.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.667+0000 7f87c37fe700 1 --2- 172.21.15.6:0/3321550641 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f87c8066f60 0x7f87c8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:33.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.667+0000 7f87c37fe700 1 -- 172.21.15.6:0/3321550641 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7582+0+0 (secure 0 0 0) 0x7f87d4086740 con 0x7f87dc1597d0 2023-10-06T02:26:33.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.667+0000 7f87db7fe700 1 --2- 172.21.15.6:0/3321550641 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f87c8066f60 0x7f87c8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:33.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.668+0000 7f87db7fe700 1 --2- 172.21.15.6:0/3321550641 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f87c8066f60 0x7f87c8069410 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f87cc007060 tx=0x7f87cc007ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:33.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.671+0000 7f87c37fe700 1 -- 172.21.15.6:0/3321550641 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87d4053260 con 0x7f87dc1597d0 2023-10-06T02:26:33.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.912+0000 7f87e0ff7700 1 -- 172.21.15.6:0/3321550641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87dc0b2230 con 0x7f87dc1597d0 2023-10-06T02:26:33.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.913+0000 7f87c37fe700 1 -- 172.21.15.6:0/3321550641 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 175 v175) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f87d4056880 con 0x7f87dc1597d0 2023-10-06T02:26:33.915 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:33.915 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":175,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":175,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:33.108737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:33.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.915+0000 7f87e0ff7700 1 -- 172.21.15.6:0/3321550641 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f87c8066f60 msgr2=0x7f87c8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.915+0000 7f87e0ff7700 1 --2- 172.21.15.6:0/3321550641 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f87c8066f60 0x7f87c8069410 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f87cc007060 tx=0x7f87cc007ea0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.915+0000 7f87e0ff7700 1 -- 172.21.15.6:0/3321550641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87dc1597d0 msgr2=0x7f87dc153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.915+0000 7f87e0ff7700 1 --2- 172.21.15.6:0/3321550641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87dc1597d0 0x7f87dc153620 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f87d400b610 tx=0x7f87d4018000 comp rx=0 tx=0).stop 2023-10-06T02:26:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.915+0000 7f87e0ff7700 1 -- 172.21.15.6:0/3321550641 shutdown_connections 2023-10-06T02:26:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.915+0000 7f87e0ff7700 1 --2- 172.21.15.6:0/3321550641 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f87c8066f60 0x7f87c8069410 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.915+0000 7f87e0ff7700 1 --2- 172.21.15.6:0/3321550641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87dc1597d0 0x7f87dc153620 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.915+0000 7f87e0ff7700 1 --2- 172.21.15.6:0/3321550641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87dc0cf1a0 0x7f87dc16cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.915+0000 7f87e0ff7700 1 --2- 172.21.15.6:0/3321550641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87dc159400 0x7f87dc15c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.915+0000 7f87e0ff7700 1 -- 172.21.15.6:0/3321550641 >> 172.21.15.6:0/3321550641 conn(0x7f87dc06ac10 msgr2=0x7f87dc158440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.915+0000 7f87e0ff7700 1 -- 172.21.15.6:0/3321550641 shutdown_connections 2023-10-06T02:26:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:33.915+0000 7f87e0ff7700 1 -- 172.21.15.6:0/3321550641 wait complete. 2023-10-06T02:26:33.918 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 175 2023-10-06T02:26:33.928 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:26:33.929 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:34.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.046+0000 7ff36d67f700 1 Processor -- start 2023-10-06T02:26:34.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.046+0000 7ff36d67f700 1 -- start start 2023-10-06T02:26:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.046+0000 7ff36d67f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3680af4e0 0x7ff3680b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.046+0000 7ff36d67f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff36815db70 0x7ff3680b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.046+0000 7ff36d67f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36815e190 con 0x7ff3680af8b0 2023-10-06T02:26:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.046+0000 7ff36d67f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3680b1910 con 0x7ff36815db70 2023-10-06T02:26:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.046+0000 7ff36d67f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36815dfb0 con 0x7ff3680af4e0 2023-10-06T02:26:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.047+0000 7ff3667fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff3680af8b0 0x7ff36815d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40940/0 (socket says 172.21.15.6:40940) 2023-10-06T02:26:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.047+0000 7ff3667fc700 1 -- 172.21.15.6:0/1534803142 learned_addr learned my addr 172.21.15.6:0/1534803142 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.047+0000 7ff3677fe700 1 --2- 172.21.15.6:0/1534803142 >> v2:172.21.15.175:3300/0 conn(0x7ff36815db70 0x7ff3680b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.047+0000 7ff366ffd700 1 --2- 172.21.15.6:0/1534803142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3680af4e0 0x7ff3680b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.047+0000 7ff365ffb700 1 -- 172.21.15.6:0/1534803142 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984137518 0 0) 0x7ff36815e190 con 0x7ff3680af8b0 2023-10-06T02:26:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.047+0000 7ff365ffb700 1 -- 172.21.15.6:0/1534803142 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff350003570 con 0x7ff3680af8b0 2023-10-06T02:26:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.047+0000 7ff3677fe700 1 -- 172.21.15.6:0/1534803142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3680af4e0 msgr2=0x7ff3680b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.047+0000 7ff3677fe700 1 --2- 172.21.15.6:0/1534803142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3680af4e0 0x7ff3680b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.047+0000 7ff3677fe700 1 -- 172.21.15.6:0/1534803142 >> v1:172.21.15.6:6789/0 conn(0x7ff3680af8b0 legacy=0x7ff36815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.047+0000 7ff3677fe700 1 -- 172.21.15.6:0/1534803142 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3680cb650 con 0x7ff36815db70 2023-10-06T02:26:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.047+0000 7ff3677fe700 1 --2- 172.21.15.6:0/1534803142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff36815db70 0x7ff3680b2620 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff360009e60 tx=0x7ff360009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fccc9441430434e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.047+0000 7ff365ffb700 1 -- 172.21.15.6:0/1534803142 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36000e070 con 0x7ff36815db70 2023-10-06T02:26:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.047+0000 7ff365ffb700 1 -- 172.21.15.6:0/1534803142 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36000bab0 con 0x7ff36815db70 2023-10-06T02:26:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.047+0000 7ff365ffb700 1 -- 172.21.15.6:0/1534803142 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36000be30 con 0x7ff36815db70 2023-10-06T02:26:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.048+0000 7ff36d67f700 1 -- 172.21.15.6:0/1534803142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff36815db70 msgr2=0x7ff3680b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.048+0000 7ff36d67f700 1 --2- 172.21.15.6:0/1534803142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff36815db70 0x7ff3680b2620 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff360009e60 tx=0x7ff360009780 comp rx=0 tx=0).stop 2023-10-06T02:26:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.048+0000 7ff36d67f700 1 -- 172.21.15.6:0/1534803142 shutdown_connections 2023-10-06T02:26:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.048+0000 7ff36d67f700 1 --2- 172.21.15.6:0/1534803142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff36815db70 0x7ff3680b2620 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.048+0000 7ff36d67f700 1 --2- 172.21.15.6:0/1534803142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3680af4e0 0x7ff3680b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.048+0000 7ff36d67f700 1 -- 172.21.15.6:0/1534803142 >> 172.21.15.6:0/1534803142 conn(0x7ff368068680 msgr2=0x7ff368068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.048+0000 7ff36d67f700 1 -- 172.21.15.6:0/1534803142 shutdown_connections 2023-10-06T02:26:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.048+0000 7ff36d67f700 1 -- 172.21.15.6:0/1534803142 wait complete. 2023-10-06T02:26:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.049+0000 7ff36d67f700 1 Processor -- start 2023-10-06T02:26:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.049+0000 7ff36d67f700 1 -- start start 2023-10-06T02:26:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff36d67f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3680af4e0 0x7ff36816ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff36d67f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3680af8b0 0x7ff3680b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff36d67f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff36815db70 0x7ff36815c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff36d67f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36816dda0 con 0x7ff3680af4e0 2023-10-06T02:26:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff36d67f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36816d500 con 0x7ff3680af8b0 2023-10-06T02:26:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff36d67f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36816d7e0 con 0x7ff36815db70 2023-10-06T02:26:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff366ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3680af4e0 0x7ff36816ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff366ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3680af4e0 0x7ff36816ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38730/0 (socket says 172.21.15.6:38730) 2023-10-06T02:26:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff366ffd700 1 -- 172.21.15.6:0/1170280609 learned_addr learned my addr 172.21.15.6:0/1170280609 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff3677fe700 1 --2- 172.21.15.6:0/1170280609 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff36815db70 0x7ff36815c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff3667fc700 1 --2- 172.21.15.6:0/1170280609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3680af8b0 0x7ff3680b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff366ffd700 1 -- 172.21.15.6:0/1170280609 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff36815db70 msgr2=0x7ff36815c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff366ffd700 1 --2- 172.21.15.6:0/1170280609 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff36815db70 0x7ff36815c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff366ffd700 1 -- 172.21.15.6:0/1170280609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3680af8b0 msgr2=0x7ff3680b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff366ffd700 1 --2- 172.21.15.6:0/1170280609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3680af8b0 0x7ff3680b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff366ffd700 1 -- 172.21.15.6:0/1170280609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff360009a20 con 0x7ff3680af4e0 2023-10-06T02:26:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff3677fe700 1 --2- 172.21.15.6:0/1170280609 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff36815db70 0x7ff36815c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff3667fc700 1 --2- 172.21.15.6:0/1170280609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3680af8b0 0x7ff3680b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.050+0000 7ff366ffd700 1 --2- 172.21.15.6:0/1170280609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3680af4e0 0x7ff36816ce70 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7ff35800ec80 tx=0x7ff3580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.051+0000 7ff34effd700 1 -- 172.21.15.6:0/1170280609 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35800c9d0 con 0x7ff3680af4e0 2023-10-06T02:26:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.051+0000 7ff34effd700 1 -- 172.21.15.6:0/1170280609 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35800cb30 con 0x7ff3680af4e0 2023-10-06T02:26:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.051+0000 7ff36d67f700 1 -- 172.21.15.6:0/1170280609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36816dac0 con 0x7ff3680af4e0 2023-10-06T02:26:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.051+0000 7ff34effd700 1 -- 172.21.15.6:0/1170280609 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358013470 con 0x7ff3680af4e0 2023-10-06T02:26:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.051+0000 7ff36d67f700 1 -- 172.21.15.6:0/1170280609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36815ce20 con 0x7ff3680af4e0 2023-10-06T02:26:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.051+0000 7ff36d67f700 1 -- 172.21.15.6:0/1170280609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36815d0a0 con 0x7ff3680af4e0 2023-10-06T02:26:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.052+0000 7ff34effd700 1 -- 172.21.15.6:0/1170280609 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff358013820 con 0x7ff3680af4e0 2023-10-06T02:26:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.052+0000 7ff34effd700 1 --2- 172.21.15.6:0/1170280609 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff354066f30 0x7ff3540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.052+0000 7ff34effd700 1 -- 172.21.15.6:0/1170280609 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7582+0+0 (secure 0 0 0) 0x7ff358085010 con 0x7ff3680af4e0 2023-10-06T02:26:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.053+0000 7ff3667fc700 1 --2- 172.21.15.6:0/1170280609 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff354066f30 0x7ff3540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.053+0000 7ff3667fc700 1 --2- 172.21.15.6:0/1170280609 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff354066f30 0x7ff3540693e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0058d0 tx=0x7ff35c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.057+0000 7ff34effd700 1 -- 172.21.15.6:0/1170280609 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff358051b30 con 0x7ff3680af4e0 2023-10-06T02:26:34.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.293+0000 7ff36d67f700 1 -- 172.21.15.6:0/1170280609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3680b3390 con 0x7ff3680af4e0 2023-10-06T02:26:34.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.294+0000 7ff34effd700 1 -- 172.21.15.6:0/1170280609 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 176 v176) v1 ==== 95+0+4595 (secure 0 0 0) 0x7ff358055150 con 0x7ff3680af4e0 2023-10-06T02:26:34.296 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:34.296 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":176,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8805,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1318769254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1318769254},{"type":"v1","addr":"172.21.15.6:6835","nonce":1318769254}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":176}],"filesystems":[{"mdsmap":{"epoch":175,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:33.108737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:34.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.296+0000 7ff36d67f700 1 -- 172.21.15.6:0/1170280609 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff354066f30 msgr2=0x7ff3540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:34.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.296+0000 7ff36d67f700 1 --2- 172.21.15.6:0/1170280609 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff354066f30 0x7ff3540693e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0058d0 tx=0x7ff35c009040 comp rx=0 tx=0).stop 2023-10-06T02:26:34.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.296+0000 7ff36d67f700 1 -- 172.21.15.6:0/1170280609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3680af4e0 msgr2=0x7ff36816ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:34.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.296+0000 7ff36d67f700 1 --2- 172.21.15.6:0/1170280609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3680af4e0 0x7ff36816ce70 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7ff35800ec80 tx=0x7ff3580091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:34.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.296+0000 7ff36d67f700 1 -- 172.21.15.6:0/1170280609 shutdown_connections 2023-10-06T02:26:34.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.296+0000 7ff36d67f700 1 --2- 172.21.15.6:0/1170280609 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff36815db70 0x7ff36815c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:34.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.296+0000 7ff36d67f700 1 --2- 172.21.15.6:0/1170280609 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff354066f30 0x7ff3540693e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:34.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.296+0000 7ff36d67f700 1 --2- 172.21.15.6:0/1170280609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3680af4e0 0x7ff36816ce70 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:34.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.296+0000 7ff36d67f700 1 --2- 172.21.15.6:0/1170280609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3680af8b0 0x7ff3680b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:34.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.296+0000 7ff36d67f700 1 -- 172.21.15.6:0/1170280609 >> 172.21.15.6:0/1170280609 conn(0x7ff368068680 msgr2=0x7ff36815a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:34.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.296+0000 7ff36d67f700 1 -- 172.21.15.6:0/1170280609 shutdown_connections 2023-10-06T02:26:34.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.296+0000 7ff36d67f700 1 -- 172.21.15.6:0/1170280609 wait complete. 2023-10-06T02:26:34.299 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 176 2023-10-06T02:26:34.310 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 100.00000000.inode' led to DAMAGED state 2023-10-06T02:26:34.310 INFO:tasks.cephfs.test_damage:Applying mutation 'Delete 1.00000000' 2023-10-06T02:26:34.310 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:34.310 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:26:34.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:34.310 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:26:34.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:26:34.325 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:26:34.326 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:26:34.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.484+0000 7fdccffff700 1 Processor -- start 2023-10-06T02:26:34.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.484+0000 7fdccffff700 1 -- start start 2023-10-06T02:26:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.485+0000 7fdccffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcd0069e10 0x7fdcd00cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.485+0000 7fdccffff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdcd00cf7f0 0x7fdcd01592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.485+0000 7fdccffff700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd00cf360 con 0x7fdcd00cb5f0 2023-10-06T02:26:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.485+0000 7fdccffff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd00ce750 con 0x7fdcd00cf7f0 2023-10-06T02:26:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.485+0000 7fdccffff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd00cea30 con 0x7fdcd0069e10 2023-10-06T02:26:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.485+0000 7fdccf7fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdcd00cf7f0 0x7fdcd01592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.485+0000 7fdcceffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcd0069e10 0x7fdcd00cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.485+0000 7fdcce7fc700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fdcd00cb5f0 0x7fdcd0158bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:36080/0 (socket says 172.21.15.6:36080) 2023-10-06T02:26:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.485+0000 7fdcce7fc700 1 -- 172.21.15.6:0/1824181070 learned_addr learned my addr 172.21.15.6:0/1824181070 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.485+0000 7fdcceffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcd0069e10 0x7fdcd00cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:52712/0 (socket says 172.21.15.6:52712) 2023-10-06T02:26:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.485+0000 7fdccf7fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdcd00cf7f0 0x7fdcd01592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:59520/0 (socket says 172.21.15.6:59520) 2023-10-06T02:26:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.486+0000 7fdcceffd700 1 -- 172.21.15.6:0/1824181070 >> v2:172.21.15.175:3300/0 conn(0x7fdcd00cf7f0 msgr2=0x7fdcd01592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.486+0000 7fdcceffd700 1 --2- 172.21.15.6:0/1824181070 >> v2:172.21.15.175:3300/0 conn(0x7fdcd00cf7f0 0x7fdcd01592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.486+0000 7fdcceffd700 1 -- 172.21.15.6:0/1824181070 >> v1:172.21.15.175:6789/0 conn(0x7fdcd00cb5f0 legacy=0x7fdcd0158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.486+0000 7fdcceffd700 1 -- 172.21.15.6:0/1824181070 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd00ced10 con 0x7fdcd0069e10 2023-10-06T02:26:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.486+0000 7fdccf7fe700 1 --2- 172.21.15.6:0/1824181070 >> v2:172.21.15.175:3300/0 conn(0x7fdcd00cf7f0 0x7fdcd01592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:26:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.486+0000 7fdcceffd700 1 --2- 172.21.15.6:0/1824181070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcd0069e10 0x7fdcd00cb0b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0009e60 tx=0x7fdcc0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e589e1b9e860e9b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.486+0000 7fdccdffb700 1 -- 172.21.15.6:0/1824181070 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc000e070 con 0x7fdcd0069e10 2023-10-06T02:26:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.486+0000 7fdccdffb700 1 -- 172.21.15.6:0/1824181070 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc000bb60 con 0x7fdcd0069e10 2023-10-06T02:26:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.486+0000 7fdccdffb700 1 -- 172.21.15.6:0/1824181070 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0012430 con 0x7fdcd0069e10 2023-10-06T02:26:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.487+0000 7fdccffff700 1 -- 172.21.15.6:0/1824181070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcd0069e10 msgr2=0x7fdcd00cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.487+0000 7fdccffff700 1 --2- 172.21.15.6:0/1824181070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcd0069e10 0x7fdcd00cb0b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0009e60 tx=0x7fdcc0009780 comp rx=0 tx=0).stop 2023-10-06T02:26:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.487+0000 7fdccffff700 1 -- 172.21.15.6:0/1824181070 shutdown_connections 2023-10-06T02:26:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.487+0000 7fdccffff700 1 --2- 172.21.15.6:0/1824181070 >> v2:172.21.15.175:3300/0 conn(0x7fdcd00cf7f0 0x7fdcd01592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.487+0000 7fdccffff700 1 --2- 172.21.15.6:0/1824181070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcd0069e10 0x7fdcd00cb0b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.487+0000 7fdccffff700 1 -- 172.21.15.6:0/1824181070 >> 172.21.15.6:0/1824181070 conn(0x7fdcd00d0ba0 msgr2=0x7fdcd00ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.487+0000 7fdccffff700 1 -- 172.21.15.6:0/1824181070 shutdown_connections 2023-10-06T02:26:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.487+0000 7fdccffff700 1 -- 172.21.15.6:0/1824181070 wait complete. 2023-10-06T02:26:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.488+0000 7fdccffff700 1 Processor -- start 2023-10-06T02:26:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.488+0000 7fdccffff700 1 -- start start 2023-10-06T02:26:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.489+0000 7fdccffff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcd0069e10 0x7fdcd0154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.489+0000 7fdccffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcd00cb5f0 0x7fdcd016cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.489+0000 7fdccffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcd00cf7f0 0x7fdcd0147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.489+0000 7fdccffff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd00b30a0 con 0x7fdcd00cb5f0 2023-10-06T02:26:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.489+0000 7fdccffff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd016d190 con 0x7fdcd0069e10 2023-10-06T02:26:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.489+0000 7fdccffff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd016d470 con 0x7fdcd00cf7f0 2023-10-06T02:26:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.489+0000 7fdcce7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcd00cb5f0 0x7fdcd016cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.489+0000 7fdcceffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcd0069e10 0x7fdcd0154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.489+0000 7fdcce7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcd00cb5f0 0x7fdcd016cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38732/0 (socket says 172.21.15.6:38732) 2023-10-06T02:26:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.489+0000 7fdcce7fc700 1 -- 172.21.15.6:0/2971741868 learned_addr learned my addr 172.21.15.6:0/2971741868 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.489+0000 7fdccf7fe700 1 --2- 172.21.15.6:0/2971741868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcd00cf7f0 0x7fdcd0147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.489+0000 7fdcce7fc700 1 -- 172.21.15.6:0/2971741868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcd00cf7f0 msgr2=0x7fdcd0147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.489+0000 7fdcce7fc700 1 --2- 172.21.15.6:0/2971741868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcd00cf7f0 0x7fdcd0147c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.489+0000 7fdcce7fc700 1 -- 172.21.15.6:0/2971741868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcd0069e10 msgr2=0x7fdcd0154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.489+0000 7fdcce7fc700 1 --2- 172.21.15.6:0/2971741868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcd0069e10 0x7fdcd0154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.489+0000 7fdcce7fc700 1 -- 172.21.15.6:0/2971741868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc8009420 con 0x7fdcd00cb5f0 2023-10-06T02:26:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.489+0000 7fdcce7fc700 1 --2- 172.21.15.6:0/2971741868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcd00cb5f0 0x7fdcd016cb00 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800c790 tx=0x7fdcb8007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.490+0000 7fdcc6ffd700 1 -- 172.21.15.6:0/2971741868 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8005b30 con 0x7fdcd00cb5f0 2023-10-06T02:26:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.490+0000 7fdcc6ffd700 1 -- 172.21.15.6:0/2971741868 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb8005cb0 con 0x7fdcd00cb5f0 2023-10-06T02:26:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.490+0000 7fdccffff700 1 -- 172.21.15.6:0/2971741868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc0009a20 con 0x7fdcd00cb5f0 2023-10-06T02:26:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.490+0000 7fdcc6ffd700 1 -- 172.21.15.6:0/2971741868 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8004a80 con 0x7fdcd00cb5f0 2023-10-06T02:26:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.490+0000 7fdccffff700 1 -- 172.21.15.6:0/2971741868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd0155390 con 0x7fdcd00cb5f0 2023-10-06T02:26:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.491+0000 7fdccffff700 1 -- 172.21.15.6:0/2971741868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd00b2e70 con 0x7fdcd00cb5f0 2023-10-06T02:26:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.491+0000 7fdcc6ffd700 1 -- 172.21.15.6:0/2971741868 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdcb80070d0 con 0x7fdcd00cb5f0 2023-10-06T02:26:34.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.492+0000 7fdcc6ffd700 1 --2- 172.21.15.6:0/2971741868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdcb0066f30 0x7fdcb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:34.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.492+0000 7fdcc6ffd700 1 -- 172.21.15.6:0/2971741868 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7582+0+0 (secure 0 0 0) 0x7fdcb8083fd0 con 0x7fdcd00cb5f0 2023-10-06T02:26:34.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.492+0000 7fdcceffd700 1 --2- 172.21.15.6:0/2971741868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdcb0066f30 0x7fdcb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:34.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.492+0000 7fdcceffd700 1 --2- 172.21.15.6:0/2971741868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdcb0066f30 0x7fdcb00693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00097c0 tx=0x7fdcc0019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:34.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.496+0000 7fdcc6ffd700 1 -- 172.21.15.6:0/2971741868 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdcd00b2e70 con 0x7fdcd00cb5f0 2023-10-06T02:26:34.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:34.731+0000 7fdccffff700 1 -- 172.21.15.6:0/2971741868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdcd00b2e70 con 0x7fdcd00cb5f0 2023-10-06T02:26:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.116+0000 7fdcc6ffd700 1 -- 172.21.15.6:0/2971741868 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v177) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdcd00b2e70 con 0x7fdcd00cb5f0 2023-10-06T02:26:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.118+0000 7fdccffff700 1 -- 172.21.15.6:0/2971741868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdcb0066f30 msgr2=0x7fdcb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.118+0000 7fdccffff700 1 --2- 172.21.15.6:0/2971741868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdcb0066f30 0x7fdcb00693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00097c0 tx=0x7fdcc0019000 comp rx=0 tx=0).stop 2023-10-06T02:26:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.118+0000 7fdccffff700 1 -- 172.21.15.6:0/2971741868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcd00cb5f0 msgr2=0x7fdcd016cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.118+0000 7fdccffff700 1 --2- 172.21.15.6:0/2971741868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcd00cb5f0 0x7fdcd016cb00 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800c790 tx=0x7fdcb8007f40 comp rx=0 tx=0).stop 2023-10-06T02:26:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.119+0000 7fdccffff700 1 -- 172.21.15.6:0/2971741868 shutdown_connections 2023-10-06T02:26:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.119+0000 7fdccffff700 1 --2- 172.21.15.6:0/2971741868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcd00cf7f0 0x7fdcd0147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.119+0000 7fdccffff700 1 --2- 172.21.15.6:0/2971741868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcd0069e10 0x7fdcd0154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.119+0000 7fdccffff700 1 --2- 172.21.15.6:0/2971741868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdcb0066f30 0x7fdcb00693e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.119+0000 7fdccffff700 1 --2- 172.21.15.6:0/2971741868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcd00cb5f0 0x7fdcd016cb00 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.119+0000 7fdccffff700 1 -- 172.21.15.6:0/2971741868 >> 172.21.15.6:0/2971741868 conn(0x7fdcd00d0ba0 msgr2=0x7fdcd015fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.119+0000 7fdccffff700 1 -- 172.21.15.6:0/2971741868 shutdown_connections 2023-10-06T02:26:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.119+0000 7fdccffff700 1 -- 172.21.15.6:0/2971741868 wait complete. 2023-10-06T02:26:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:26:35.133 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:26:35.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.253+0000 7fc74b5a0700 1 Processor -- start 2023-10-06T02:26:35.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.254+0000 7fc74b5a0700 1 -- start start 2023-10-06T02:26:35.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.254+0000 7fc74b5a0700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc74415a030 0x7fc74415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:35.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.254+0000 7fc74b5a0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7440afc50 con 0x7fc744087700 2023-10-06T02:26:35.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.254+0000 7fc74b5a0700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7440aff30 con 0x7fc74415a940 2023-10-06T02:26:35.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.254+0000 7fc74b5a0700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7440b0cf0 con 0x7fc74415a030 2023-10-06T02:26:35.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc749b3d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc744087700 0x7fc7440b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40950/0 (socket says 172.21.15.6:40950) 2023-10-06T02:26:35.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc749b3d700 1 -- 172.21.15.6:0/691071511 learned_addr learned my addr 172.21.15.6:0/691071511 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:35.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc74933c700 1 --2- 172.21.15.6:0/691071511 >> v2:172.21.15.175:3300/0 conn(0x7fc74415a030 0x7fc74415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:35.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc743fff700 1 -- 172.21.15.6:0/691071511 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312902083 0 0) 0x7fc7440afc50 con 0x7fc744087700 2023-10-06T02:26:35.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc743fff700 1 -- 172.21.15.6:0/691071511 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc72c003570 con 0x7fc744087700 2023-10-06T02:26:35.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc743fff700 1 -- 172.21.15.6:0/691071511 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2016366267 0 0) 0x7fc72c003570 con 0x7fc744087700 2023-10-06T02:26:35.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc743fff700 1 -- 172.21.15.6:0/691071511 >> v2:172.21.15.175:3300/0 conn(0x7fc74415a030 msgr2=0x7fc74415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:35.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc743fff700 1 --2- 172.21.15.6:0/691071511 >> v2:172.21.15.175:3300/0 conn(0x7fc74415a030 0x7fc74415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:35.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc743fff700 1 -- 172.21.15.6:0/691071511 >> v1:172.21.15.175:6789/0 conn(0x7fc74415a940 legacy=0x7fc744086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:35.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc743fff700 1 -- 172.21.15.6:0/691071511 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7440b0210 con 0x7fc744087700 2023-10-06T02:26:35.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc743fff700 1 -- 172.21.15.6:0/691071511 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fc73c001470 con 0x7fc744087700 2023-10-06T02:26:35.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc743fff700 1 -- 172.21.15.6:0/691071511 >> v1:172.21.15.6:6789/0 conn(0x7fc744087700 legacy=0x7fc7440b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:35.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc743fff700 1 --2- 172.21.15.6:0/691071511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc72c003a60 0x7fc72c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:35.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc743fff700 1 --2- 172.21.15.6:0/691071511 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc72c004810 0x7fc72c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:35.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc743fff700 1 --2- 172.21.15.6:0/691071511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc72c0051c0 0x7fc72c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:35.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc743fff700 1 -- 172.21.15.6:0/691071511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7440b0cf0 con 0x7fc72c003a60 2023-10-06T02:26:35.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc743fff700 1 -- 172.21.15.6:0/691071511 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c00c0d0 con 0x7fc72c0051c0 2023-10-06T02:26:35.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc743fff700 1 -- 172.21.15.6:0/691071511 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c00c290 con 0x7fc72c004810 2023-10-06T02:26:35.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.255+0000 7fc74933c700 1 --2- 172.21.15.6:0/691071511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc72c003a60 0x7fc72c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:35.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.256+0000 7fc749b3d700 1 --2- 172.21.15.6:0/691071511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc72c0051c0 0x7fc72c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:35.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.256+0000 7fc748b3b700 1 --2- 172.21.15.6:0/691071511 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc72c004810 0x7fc72c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:35.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.256+0000 7fc74933c700 1 -- 172.21.15.6:0/691071511 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc72c004810 msgr2=0x7fc72c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:35.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.256+0000 7fc74933c700 1 --2- 172.21.15.6:0/691071511 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc72c004810 0x7fc72c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:35.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.256+0000 7fc74933c700 1 -- 172.21.15.6:0/691071511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc72c0051c0 msgr2=0x7fc72c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:35.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.256+0000 7fc74933c700 1 --2- 172.21.15.6:0/691071511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc72c0051c0 0x7fc72c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:35.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.256+0000 7fc74933c700 1 -- 172.21.15.6:0/691071511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c003570 con 0x7fc72c003a60 2023-10-06T02:26:35.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.256+0000 7fc749b3d700 1 --2- 172.21.15.6:0/691071511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc72c0051c0 0x7fc72c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:35.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.256+0000 7fc748b3b700 1 --2- 172.21.15.6:0/691071511 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc72c004810 0x7fc72c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:35.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.256+0000 7fc749b3d700 1 -- 172.21.15.6:0/691071511 reap_dead start 2023-10-06T02:26:35.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.256+0000 7fc74933c700 1 --2- 172.21.15.6:0/691071511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc72c003a60 0x7fc72c003e70 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fc73400e210 tx=0x7fc73400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301f343160bb1f78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:35.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.256+0000 7fc743fff700 1 -- 172.21.15.6:0/691071511 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73400eac0 con 0x7fc72c003a60 2023-10-06T02:26:35.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.256+0000 7fc743fff700 1 -- 172.21.15.6:0/691071511 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73400f040 con 0x7fc72c003a60 2023-10-06T02:26:35.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.256+0000 7fc743fff700 1 -- 172.21.15.6:0/691071511 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73400ee70 con 0x7fc72c003a60 2023-10-06T02:26:35.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.257+0000 7fc74b5a0700 1 -- 172.21.15.6:0/691071511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc72c003a60 msgr2=0x7fc72c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:35.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.257+0000 7fc74b5a0700 1 --2- 172.21.15.6:0/691071511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc72c003a60 0x7fc72c003e70 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fc73400e210 tx=0x7fc73400b040 comp rx=0 tx=0).stop 2023-10-06T02:26:35.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.257+0000 7fc74b5a0700 1 -- 172.21.15.6:0/691071511 shutdown_connections 2023-10-06T02:26:35.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.257+0000 7fc74b5a0700 1 --2- 172.21.15.6:0/691071511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc72c003a60 0x7fc72c003e70 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:35.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.257+0000 7fc74b5a0700 1 -- 172.21.15.6:0/691071511 >> 172.21.15.6:0/691071511 conn(0x7fc744068680 msgr2=0x7fc744068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:35.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.257+0000 7fc74b5a0700 1 -- 172.21.15.6:0/691071511 shutdown_connections 2023-10-06T02:26:35.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.257+0000 7fc74b5a0700 1 -- 172.21.15.6:0/691071511 wait complete. 2023-10-06T02:26:35.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.258+0000 7fc74b5a0700 1 Processor -- start 2023-10-06T02:26:35.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.258+0000 7fc74b5a0700 1 -- start start 2023-10-06T02:26:35.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc74b5a0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc72c003a60 0x7fc7441539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:35.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc74b5a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc744155dc0 0x7fc7440b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:35.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc74b5a0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7440b45a0 0x7fc7440b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:35.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc74b5a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74416acc0 con 0x7fc744155dc0 2023-10-06T02:26:35.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc74b5a0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74416a0b0 con 0x7fc7440b45a0 2023-10-06T02:26:35.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc74b5a0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74416a390 con 0x7fc72c003a60 2023-10-06T02:26:35.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc748b3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc744155dc0 0x7fc7440b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:35.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc748b3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc744155dc0 0x7fc7440b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38744/0 (socket says 172.21.15.6:38744) 2023-10-06T02:26:35.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc748b3b700 1 -- 172.21.15.6:0/949297593 learned_addr learned my addr 172.21.15.6:0/949297593 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:35.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc74933c700 1 --2- 172.21.15.6:0/949297593 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc72c003a60 0x7fc7441539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:35.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc749b3d700 1 --2- 172.21.15.6:0/949297593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7440b45a0 0x7fc7440b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:35.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc748b3b700 1 -- 172.21.15.6:0/949297593 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc72c003a60 msgr2=0x7fc7441539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:35.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc748b3b700 1 --2- 172.21.15.6:0/949297593 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc72c003a60 0x7fc7441539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:35.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc748b3b700 1 -- 172.21.15.6:0/949297593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7440b45a0 msgr2=0x7fc7440b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:35.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc748b3b700 1 --2- 172.21.15.6:0/949297593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7440b45a0 0x7fc7440b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:35.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc748b3b700 1 -- 172.21.15.6:0/949297593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74416a670 con 0x7fc744155dc0 2023-10-06T02:26:35.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc749b3d700 1 --2- 172.21.15.6:0/949297593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7440b45a0 0x7fc7440b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:35.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc74933c700 1 --2- 172.21.15.6:0/949297593 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc72c003a60 0x7fc7441539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:35.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc748b3b700 1 --2- 172.21.15.6:0/949297593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc744155dc0 0x7fc7440b4060 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fc73800e540 tx=0x7fc738009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:35.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc7417fa700 1 -- 172.21.15.6:0/949297593 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7380115c0 con 0x7fc744155dc0 2023-10-06T02:26:35.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc7417fa700 1 -- 172.21.15.6:0/949297593 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc738011720 con 0x7fc744155dc0 2023-10-06T02:26:35.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc7417fa700 1 -- 172.21.15.6:0/949297593 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc738011ae0 con 0x7fc744155dc0 2023-10-06T02:26:35.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.259+0000 7fc74b5a0700 1 -- 172.21.15.6:0/949297593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74416a950 con 0x7fc744155dc0 2023-10-06T02:26:35.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.260+0000 7fc74b5a0700 1 -- 172.21.15.6:0/949297593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc744169ca0 con 0x7fc744155dc0 2023-10-06T02:26:35.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.260+0000 7fc74b5a0700 1 -- 172.21.15.6:0/949297593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc744088700 con 0x7fc744155dc0 2023-10-06T02:26:35.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.261+0000 7fc7417fa700 1 -- 172.21.15.6:0/949297593 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc738014480 con 0x7fc744155dc0 2023-10-06T02:26:35.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.261+0000 7fc7417fa700 1 --2- 172.21.15.6:0/949297593 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc730066f30 0x7fc7300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:35.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.261+0000 7fc7417fa700 1 -- 172.21.15.6:0/949297593 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7582+0+0 (secure 0 0 0) 0x7fc7380845d0 con 0x7fc744155dc0 2023-10-06T02:26:35.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.262+0000 7fc74933c700 1 --2- 172.21.15.6:0/949297593 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc730066f30 0x7fc7300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:35.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.262+0000 7fc74933c700 1 --2- 172.21.15.6:0/949297593 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc730066f30 0x7fc7300693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc73400afd0 tx=0x7fc73401a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:35.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.266+0000 7fc7417fa700 1 -- 172.21.15.6:0/949297593 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc73804d5a0 con 0x7fc744155dc0 2023-10-06T02:26:35.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:35.546+0000 7fc74b5a0700 1 -- 172.21.15.6:0/949297593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fc7440b04f0 con 0x7fc744155dc0 2023-10-06T02:26:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.125+0000 7fc7417fa700 1 -- 172.21.15.6:0/949297593 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v178) v1 ==== 101+0+0 (secure 0 0 0) 0x7fc738051100 con 0x7fc744155dc0 2023-10-06T02:26:36.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.127+0000 7fc74b5a0700 1 -- 172.21.15.6:0/949297593 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc730066f30 msgr2=0x7fc7300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.127+0000 7fc74b5a0700 1 --2- 172.21.15.6:0/949297593 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc730066f30 0x7fc7300693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc73400afd0 tx=0x7fc73401a000 comp rx=0 tx=0).stop 2023-10-06T02:26:36.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.127+0000 7fc74b5a0700 1 -- 172.21.15.6:0/949297593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc744155dc0 msgr2=0x7fc7440b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.127+0000 7fc74b5a0700 1 --2- 172.21.15.6:0/949297593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc744155dc0 0x7fc7440b4060 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fc73800e540 tx=0x7fc738009040 comp rx=0 tx=0).stop 2023-10-06T02:26:36.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.128+0000 7fc74b5a0700 1 -- 172.21.15.6:0/949297593 shutdown_connections 2023-10-06T02:26:36.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.128+0000 7fc74b5a0700 1 --2- 172.21.15.6:0/949297593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7440b45a0 0x7fc7440b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.128+0000 7fc74b5a0700 1 --2- 172.21.15.6:0/949297593 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc72c003a60 0x7fc7441539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.128+0000 7fc74b5a0700 1 --2- 172.21.15.6:0/949297593 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc730066f30 0x7fc7300693e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.128+0000 7fc74b5a0700 1 --2- 172.21.15.6:0/949297593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc744155dc0 0x7fc7440b4060 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.128+0000 7fc74b5a0700 1 -- 172.21.15.6:0/949297593 >> 172.21.15.6:0/949297593 conn(0x7fc744068680 msgr2=0x7fc7440cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:36.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.128+0000 7fc74b5a0700 1 -- 172.21.15.6:0/949297593 shutdown_connections 2023-10-06T02:26:36.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.128+0000 7fc74b5a0700 1 -- 172.21.15.6:0/949297593 wait complete. 2023-10-06T02:26:36.412 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:26:36.412 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:26:36.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.453+0000 7fad06367000 1 Processor -- start 2023-10-06T02:26:36.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.453+0000 7fad06367000 1 -- start start 2023-10-06T02:26:36.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.454+0000 7fad06367000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f4f748e30 0x564f4f7f07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.454+0000 7fad06367000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f4f7f1f50 0x564f4f7df5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.454+0000 7fad06367000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f4f7f4b50 0x564f4f7dfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.454+0000 7fad06367000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f4f668980 con 0x564f4f7f1f50 2023-10-06T02:26:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.454+0000 7fad06367000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f4f668620 con 0x564f4f748e30 2023-10-06T02:26:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.454+0000 7fad06367000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564f4f65f400 con 0x564f4f7f4b50 2023-10-06T02:26:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.454+0000 7facfeda1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f4f7f1f50 0x564f4f7df5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.454+0000 7facfeda1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f4f7f1f50 0x564f4f7df5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38760/0 (socket says 172.21.15.6:38760) 2023-10-06T02:26:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.454+0000 7facfeda1700 1 -- 172.21.15.6:0/3452056951 learned_addr learned my addr 172.21.15.6:0/3452056951 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.454+0000 7facff5a2700 1 --2- 172.21.15.6:0/3452056951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f4f748e30 0x564f4f7f07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.454+0000 7facffda3700 1 --2- 172.21.15.6:0/3452056951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f4f7f4b50 0x564f4f7dfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.454+0000 7facfeda1700 1 -- 172.21.15.6:0/3452056951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f4f7f4b50 msgr2=0x564f4f7dfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.454+0000 7facfeda1700 1 --2- 172.21.15.6:0/3452056951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f4f7f4b50 0x564f4f7dfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.454+0000 7facfeda1700 1 -- 172.21.15.6:0/3452056951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f4f748e30 msgr2=0x564f4f7f07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.454+0000 7facfeda1700 1 --2- 172.21.15.6:0/3452056951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f4f748e30 0x564f4f7f07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.454+0000 7facfeda1700 1 -- 172.21.15.6:0/3452056951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face8005cf0 con 0x564f4f7f1f50 2023-10-06T02:26:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.455+0000 7facfeda1700 1 --2- 172.21.15.6:0/3452056951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f4f7f1f50 0x564f4f7df5b0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7facf00099b0 tx=0x7facf000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375494a24682da87 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.455+0000 7facfdd9f700 1 -- 172.21.15.6:0/3452056951 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf000f040 con 0x564f4f7f1f50 2023-10-06T02:26:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.455+0000 7facfdd9f700 1 -- 172.21.15.6:0/3452056951 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf0008bc0 con 0x564f4f7f1f50 2023-10-06T02:26:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.455+0000 7facfdd9f700 1 -- 172.21.15.6:0/3452056951 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0014480 con 0x564f4f7f1f50 2023-10-06T02:26:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.455+0000 7fad06367000 1 -- 172.21.15.6:0/3452056951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f4f7f1f50 msgr2=0x564f4f7df5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.455+0000 7fad06367000 1 --2- 172.21.15.6:0/3452056951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f4f7f1f50 0x564f4f7df5b0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7facf00099b0 tx=0x7facf000c040 comp rx=0 tx=0).stop 2023-10-06T02:26:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.455+0000 7fad06367000 1 -- 172.21.15.6:0/3452056951 shutdown_connections 2023-10-06T02:26:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.455+0000 7fad06367000 1 --2- 172.21.15.6:0/3452056951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f4f7f4b50 0x564f4f7dfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.455+0000 7fad06367000 1 --2- 172.21.15.6:0/3452056951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f4f748e30 0x564f4f7f07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.455+0000 7fad06367000 1 --2- 172.21.15.6:0/3452056951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f4f7f1f50 0x564f4f7df5b0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.455+0000 7fad06367000 1 -- 172.21.15.6:0/3452056951 >> 172.21.15.6:0/3452056951 conn(0x564f4f764bd0 msgr2=0x564f4f764fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.455+0000 7fad06367000 1 -- 172.21.15.6:0/3452056951 shutdown_connections 2023-10-06T02:26:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.455+0000 7fad06367000 1 -- 172.21.15.6:0/3452056951 wait complete. 2023-10-06T02:26:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.456+0000 7fad06367000 1 Processor -- start 2023-10-06T02:26:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.456+0000 7fad06367000 1 -- start start 2023-10-06T02:26:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7fad06367000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f4f748e30 0x564f4f762c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7fad06367000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f4f7f1f50 0x564f4f71bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7fad06367000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f4f7f4b50 0x564f4f71c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7fad06367000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f4f7dcf70 con 0x564f4f7f1f50 2023-10-06T02:26:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7fad06367000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f4f7f0f60 con 0x564f4f748e30 2023-10-06T02:26:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7fad06367000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564f4f7dc590 con 0x564f4f7f4b50 2023-10-06T02:26:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7facfeda1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f4f7f1f50 0x564f4f71bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7facfeda1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f4f7f1f50 0x564f4f71bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38764/0 (socket says 172.21.15.6:38764) 2023-10-06T02:26:36.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 learned_addr learned my addr 172.21.15.6:0/1235757224 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:36.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7facff5a2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f4f748e30 0x564f4f762c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7facffda3700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f4f7f4b50 0x564f4f71c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f4f7f4b50 msgr2=0x564f4f71c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7facfeda1700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f4f7f4b50 0x564f4f71c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f4f748e30 msgr2=0x564f4f762c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7facfeda1700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f4f748e30 0x564f4f762c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf0009580 con 0x564f4f7f1f50 2023-10-06T02:26:36.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7facfeda1700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f4f7f1f50 0x564f4f71bbe0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7facf0005c90 tx=0x7facf0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:36.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.457+0000 7facf7fff700 1 -- 172.21.15.6:0/1235757224 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf000f040 con 0x564f4f7f1f50 2023-10-06T02:26:36.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.458+0000 7facf7fff700 1 -- 172.21.15.6:0/1235757224 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf001f420 con 0x564f4f7f1f50 2023-10-06T02:26:36.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.458+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f4f6773d0 con 0x564f4f7f1f50 2023-10-06T02:26:36.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.458+0000 7facf7fff700 1 -- 172.21.15.6:0/1235757224 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf001f800 con 0x564f4f7f1f50 2023-10-06T02:26:36.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.458+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f4f66aae0 con 0x564f4f7f1f50 2023-10-06T02:26:36.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.459+0000 7facf7fff700 1 -- 172.21.15.6:0/1235757224 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7facf00133e0 con 0x564f4f7f1f50 2023-10-06T02:26:36.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.459+0000 7facf7fff700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7face0065890 0x7face0067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.460+0000 7facf7fff700 1 -- 172.21.15.6:0/1235757224 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7582+0+0 (secure 0 0 0) 0x7facf0085220 con 0x564f4f7f1f50 2023-10-06T02:26:36.746 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:26:36.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.460+0000 7facff5a2700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7face0065890 0x7face0067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.460+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x564f4f7de800 0x564f4f810500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.460+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f810a40 con 0x564f4f7de800 2023-10-06T02:26:36.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.460+0000 7facffda3700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x564f4f7de800 0x564f4f810500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.460+0000 7facffda3700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x564f4f7de800 0x564f4f810500 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:36.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.460+0000 7facff5a2700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7face0065890 0x7face0067d40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7face800a520 tx=0x7face8015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:36.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.462+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v109'412 uv386 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.462+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f810df0 con 0x564f4f7de800 2023-10-06T02:26:36.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.463+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v109'413 uv413 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.463+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8111a0 con 0x564f4f7de800 2023-10-06T02:26:36.748 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:26:36.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.464+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v109'414 uv414 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.465+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f812560 con 0x564f4f7de800 2023-10-06T02:26:36.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.466+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v109'415 uv415 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.466+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f812910 con 0x564f4f7de800 2023-10-06T02:26:36.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.467+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v109'416 uv416 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.467+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811550 con 0x564f4f7de800 2023-10-06T02:26:36.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.468+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v109'417 uv417 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.468+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811980 con 0x564f4f7de800 2023-10-06T02:26:36.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.469+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v109'418 uv392 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.469+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811d80 con 0x564f4f7de800 2023-10-06T02:26:36.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.470+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v109'419 uv419 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.470+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811d80 con 0x564f4f7de800 2023-10-06T02:26:36.750 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:26:36.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.471+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v109'420 uv420 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.471+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f812180 con 0x564f4f7de800 2023-10-06T02:26:36.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.472+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v109'421 uv421 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.472+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f812180 con 0x564f4f7de800 2023-10-06T02:26:36.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.474+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v109'422 uv422 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.474+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811d30 con 0x564f4f7de800 2023-10-06T02:26:36.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.475+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v109'423 uv423 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.475+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811d30 con 0x564f4f7de800 2023-10-06T02:26:36.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.476+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v109'424 uv399 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.476+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811d30 con 0x564f4f7de800 2023-10-06T02:26:36.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.477+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v109'425 uv425 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.477+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811d30 con 0x564f4f7de800 2023-10-06T02:26:36.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.478+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v109'426 uv426 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.753 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:26:36.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.478+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811d30 con 0x564f4f7de800 2023-10-06T02:26:36.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.479+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v109'427 uv427 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.479+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811d30 con 0x564f4f7de800 2023-10-06T02:26:36.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.480+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v109'428 uv428 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.481+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811d30 con 0x564f4f7de800 2023-10-06T02:26:36.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.482+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v109'429 uv429 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.482+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f812130 con 0x564f4f7de800 2023-10-06T02:26:36.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.484+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v109'430 uv430 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.484+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f812130 con 0x564f4f7de800 2023-10-06T02:26:36.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.485+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v109'431 uv405 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.485+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811fa0 con 0x564f4f7de800 2023-10-06T02:26:36.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.486+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v109'432 uv432 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.486+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811fa0 con 0x564f4f7de800 2023-10-06T02:26:36.756 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:26:36.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.488+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v109'433 uv433 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.488+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811fa0 con 0x564f4f7de800 2023-10-06T02:26:36.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.489+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v109'434 uv434 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.489+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811fa0 con 0x564f4f7de800 2023-10-06T02:26:36.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.490+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v109'435 uv435 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.490+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811fa0 con 0x564f4f7de800 2023-10-06T02:26:36.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.491+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v109'436 uv436 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.491+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811fa0 con 0x564f4f7de800 2023-10-06T02:26:36.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.493+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v109'437 uv411 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.493+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811fa0 con 0x564f4f7de800 2023-10-06T02:26:36.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.494+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v109'438 uv438 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.494+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811fa0 con 0x564f4f7de800 2023-10-06T02:26:36.758 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:26:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.495+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v109'439 uv439 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.495+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811fa0 con 0x564f4f7de800 2023-10-06T02:26:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.497+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v109'440 uv440 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.497+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811fa0 con 0x564f4f7de800 2023-10-06T02:26:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.498+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v109'441 uv441 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.498+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811fa0 con 0x564f4f7de800 2023-10-06T02:26:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.499+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v109'442 uv442 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f7de800 2023-10-06T02:26:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.499+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x564f4f8131d0 0x564f4f8155b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.499+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f811fa0 con 0x564f4f8131d0 2023-10-06T02:26:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.499+0000 7facff5a2700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x564f4f8131d0 0x564f4f8155b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.500+0000 7facff5a2700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x564f4f8131d0 0x564f4f8155b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:36.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.501+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v109'303 uv286 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.501+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f815af0 con 0x564f4f8131d0 2023-10-06T02:26:36.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.502+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v109'304 uv304 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.502+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f815ea0 con 0x564f4f8131d0 2023-10-06T02:26:36.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.504+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v109'305 uv305 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.761 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:26:36.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.504+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f816740 con 0x564f4f8131d0 2023-10-06T02:26:36.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.506+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v109'306 uv306 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.507+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f816af0 con 0x564f4f8131d0 2023-10-06T02:26:36.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.509+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v109'307 uv307 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.509+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f816ef0 con 0x564f4f8131d0 2023-10-06T02:26:36.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.512+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v109'308 uv291 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.512+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8172f0 con 0x564f4f8131d0 2023-10-06T02:26:36.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.514+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v109'309 uv309 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.514+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8176a0 con 0x564f4f8131d0 2023-10-06T02:26:36.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.517+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v109'310 uv310 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.815 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:26:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.517+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8176a0 con 0x564f4f8131d0 2023-10-06T02:26:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.519+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v109'311 uv311 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.519+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f817aa0 con 0x564f4f8131d0 2023-10-06T02:26:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.525+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v109'312 uv312 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.525+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f817aa0 con 0x564f4f8131d0 2023-10-06T02:26:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.526+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v109'313 uv296 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.526+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8176a0 con 0x564f4f8131d0 2023-10-06T02:26:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.529+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v109'314 uv314 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.529+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8176a0 con 0x564f4f8131d0 2023-10-06T02:26:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.532+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v109'315 uv315 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.817 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:26:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.532+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8176a0 con 0x564f4f8131d0 2023-10-06T02:26:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.534+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v109'316 uv316 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.535+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81b1c0 con 0x564f4f8131d0 2023-10-06T02:26:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.537+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v109'317 uv317 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.537+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f817770 con 0x564f4f8131d0 2023-10-06T02:26:36.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.540+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v109'318 uv302 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.540+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f817770 con 0x564f4f8131d0 2023-10-06T02:26:36.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.542+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v109'319 uv319 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.542+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8176a0 con 0x564f4f8131d0 2023-10-06T02:26:36.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.545+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v109'320 uv320 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.819 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:26:36.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.545+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8186b0 con 0x564f4f8131d0 2023-10-06T02:26:36.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.547+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v109'321 uv321 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.547+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8186b0 con 0x564f4f8131d0 2023-10-06T02:26:36.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.550+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v109'322 uv322 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.550+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8176a0 con 0x564f4f8131d0 2023-10-06T02:26:36.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.555+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v109'323 uv323 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.555+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x564f4f817bb0 0x564f4f819f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.555+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81a600 con 0x564f4f817bb0 2023-10-06T02:26:36.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.555+0000 7facfeda1700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x564f4f817bb0 0x564f4f819f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.555+0000 7facfeda1700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x564f4f817bb0 0x564f4f819f90 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:36.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.557+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v109'81 uv80 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.557+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81ab00 con 0x564f4f817bb0 2023-10-06T02:26:36.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.558+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v109'82 uv82 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.558+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81b080 con 0x564f4f817bb0 2023-10-06T02:26:36.822 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:26:36.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.559+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v109'83 uv83 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.559+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81c980 con 0x564f4f817bb0 2023-10-06T02:26:36.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.560+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v109'84 uv84 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.560+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81cd30 con 0x564f4f817bb0 2023-10-06T02:26:36.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.561+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v109'85 uv85 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.561+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81b970 con 0x564f4f817bb0 2023-10-06T02:26:36.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.563+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v109'86 uv86 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.563+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81b970 con 0x564f4f817bb0 2023-10-06T02:26:36.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.564+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v109'60 uv59 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.564+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81b970 con 0x564f4f817bb0 2023-10-06T02:26:36.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.564+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v109'61 uv61 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.564+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81b970 con 0x564f4f817bb0 2023-10-06T02:26:36.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.565+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v109'62 uv62 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.825 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:26:36.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.565+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81b970 con 0x564f4f817bb0 2023-10-06T02:26:36.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.566+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v109'63 uv63 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.566+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81b970 con 0x564f4f8131d0 2023-10-06T02:26:36.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.567+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v109'81 uv80 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.567+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81b970 con 0x564f4f8131d0 2023-10-06T02:26:36.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.569+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v109'82 uv82 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.569+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81b970 con 0x564f4f8131d0 2023-10-06T02:26:36.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.570+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v109'83 uv83 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.827 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:26:36.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.570+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81b970 con 0x564f4f8131d0 2023-10-06T02:26:36.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.571+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v109'84 uv84 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.571+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81b970 con 0x564f4f8131d0 2023-10-06T02:26:36.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.572+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v109'85 uv85 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.572+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81b970 con 0x564f4f8131d0 2023-10-06T02:26:36.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.573+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v109'86 uv86 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f8131d0 2023-10-06T02:26:36.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.573+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564f4f81c2d0 0x564f4f81f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.573+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81f630 con 0x564f4f81c2d0 2023-10-06T02:26:36.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.573+0000 7facffda3700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564f4f81c2d0 0x564f4f81f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.574+0000 7facffda3700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564f4f81c2d0 0x564f4f81f0f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:36.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.575+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v109'149 uv143 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f81c2d0 2023-10-06T02:26:36.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.575+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81f630 con 0x564f4f81c2d0 2023-10-06T02:26:36.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.576+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v109'150 uv150 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f81c2d0 2023-10-06T02:26:36.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.576+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81f630 con 0x564f4f81c2d0 2023-10-06T02:26:36.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.578+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v109'151 uv151 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f81c2d0 2023-10-06T02:26:36.830 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:26:36.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.578+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f820640 con 0x564f4f81c2d0 2023-10-06T02:26:36.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.579+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v109'152 uv152 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f81c2d0 2023-10-06T02:26:36.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.579+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f820640 con 0x564f4f81c2d0 2023-10-06T02:26:36.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.579+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v109'153 uv153 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f81c2d0 2023-10-06T02:26:36.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.580+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81f630 con 0x564f4f81c2d0 2023-10-06T02:26:36.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.581+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v109'154 uv154 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f81c2d0 2023-10-06T02:26:36.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.581+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81f630 con 0x564f4f81c2d0 2023-10-06T02:26:36.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.581+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v109'155 uv148 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f81c2d0 2023-10-06T02:26:36.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.582+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81f630 con 0x564f4f81c2d0 2023-10-06T02:26:36.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.582+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v109'156 uv156 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f81c2d0 2023-10-06T02:26:36.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.583+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81f630 con 0x564f4f81c2d0 2023-10-06T02:26:36.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.583+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v109'157 uv157 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f81c2d0 2023-10-06T02:26:36.832 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:26:36.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.584+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81f630 con 0x564f4f81c2d0 2023-10-06T02:26:36.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.585+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v109'158 uv158 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f81c2d0 2023-10-06T02:26:36.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.585+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f81f630 con 0x564f4f81c2d0 2023-10-06T02:26:36.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.586+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v109'159 uv159 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f81c2d0 2023-10-06T02:26:36.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.586+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x564f4f81fcb0 0x564f4f822090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.586+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8226b0 con 0x564f4f81fcb0 2023-10-06T02:26:36.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.586+0000 7facff5a2700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x564f4f81fcb0 0x564f4f822090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.587+0000 7facff5a2700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x564f4f81fcb0 0x564f4f822090 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:36.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.588+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v109'66 uv65 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f81fcb0 2023-10-06T02:26:36.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.588+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8226b0 con 0x564f4f81fcb0 2023-10-06T02:26:36.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.589+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v109'67 uv67 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f81fcb0 2023-10-06T02:26:36.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.589+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f822b60 con 0x564f4f81fcb0 2023-10-06T02:26:36.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.591+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v109'68 uv68 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f81fcb0 2023-10-06T02:26:36.835 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:26:36.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.591+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f822b60 con 0x564f4f81fcb0 2023-10-06T02:26:36.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.591+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v109'69 uv69 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f81fcb0 2023-10-06T02:26:36.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.591+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f822b60 con 0x564f4f81fcb0 2023-10-06T02:26:36.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.593+0000 7facff5a2700 1 -- 172.21.15.6:0/1235757224 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v109'70 uv70 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7face8012410 con 0x564f4f81fcb0 2023-10-06T02:26:36.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.593+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f822b60 con 0x564f4f817bb0 2023-10-06T02:26:36.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.594+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v109'81 uv80 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.594+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f822b60 con 0x564f4f817bb0 2023-10-06T02:26:36.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.595+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v109'82 uv82 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.595+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f822b60 con 0x564f4f817bb0 2023-10-06T02:26:36.837 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:26:36.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.596+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v109'83 uv83 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.596+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f823b70 con 0x564f4f817bb0 2023-10-06T02:26:36.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.596+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v109'84 uv84 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.596+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f823b70 con 0x564f4f817bb0 2023-10-06T02:26:36.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.597+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v109'85 uv85 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.597+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f822b60 con 0x564f4f817bb0 2023-10-06T02:26:36.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.598+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v109'86 uv86 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.598+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x564f4f8231e0 0x564f4f8255c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.598+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f825c20 con 0x564f4f8231e0 2023-10-06T02:26:36.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.598+0000 7facfeda1700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x564f4f8231e0 0x564f4f8255c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.599+0000 7facfeda1700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x564f4f8231e0 0x564f4f8255c0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:36.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.600+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v109'132 uv126 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f8231e0 2023-10-06T02:26:36.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.600+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f825ce0 con 0x564f4f8231e0 2023-10-06T02:26:36.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.601+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v109'133 uv133 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f8231e0 2023-10-06T02:26:36.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.601+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f825ce0 con 0x564f4f8231e0 2023-10-06T02:26:36.840 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:26:36.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.602+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v109'134 uv134 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f8231e0 2023-10-06T02:26:36.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.602+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f826130 con 0x564f4f8231e0 2023-10-06T02:26:36.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.603+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v109'135 uv135 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f8231e0 2023-10-06T02:26:36.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.603+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f826130 con 0x564f4f8231e0 2023-10-06T02:26:36.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.604+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v109'136 uv136 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f8231e0 2023-10-06T02:26:36.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.604+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8260e0 con 0x564f4f8231e0 2023-10-06T02:26:36.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.605+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v109'137 uv131 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f8231e0 2023-10-06T02:26:36.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.605+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8260e0 con 0x564f4f8231e0 2023-10-06T02:26:36.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.606+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v109'138 uv138 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f8231e0 2023-10-06T02:26:36.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.606+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8260e0 con 0x564f4f8231e0 2023-10-06T02:26:36.842 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:26:36.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.607+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v109'139 uv139 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f8231e0 2023-10-06T02:26:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.607+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8260e0 con 0x564f4f8231e0 2023-10-06T02:26:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.608+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v109'140 uv140 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f8231e0 2023-10-06T02:26:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.608+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f828e50 con 0x564f4f8231e0 2023-10-06T02:26:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.609+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v109'141 uv141 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f8231e0 2023-10-06T02:26:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.609+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8265d0 con 0x564f4f817bb0 2023-10-06T02:26:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.610+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v109'61 uv60 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.610+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8265d0 con 0x564f4f817bb0 2023-10-06T02:26:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.611+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v109'62 uv62 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.611+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8265d0 con 0x564f4f817bb0 2023-10-06T02:26:36.844 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:26:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.612+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v109'63 uv63 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.612+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f8265d0 con 0x564f4f817bb0 2023-10-06T02:26:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.613+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v109'64 uv64 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.613+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x564f4f826ae0 0x564f4f828ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.613+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829400 con 0x564f4f826ae0 2023-10-06T02:26:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.613+0000 7facffda3700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x564f4f826ae0 0x564f4f828ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.613+0000 7facffda3700 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x564f4f826ae0 0x564f4f828ec0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.614+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v109'81 uv80 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f826ae0 2023-10-06T02:26:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.614+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829400 con 0x564f4f826ae0 2023-10-06T02:26:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.615+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v109'82 uv82 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f826ae0 2023-10-06T02:26:36.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.615+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829400 con 0x564f4f826ae0 2023-10-06T02:26:36.847 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:26:36.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.617+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v109'83 uv83 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f826ae0 2023-10-06T02:26:36.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.617+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f82a410 con 0x564f4f826ae0 2023-10-06T02:26:36.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.618+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v109'84 uv84 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f826ae0 2023-10-06T02:26:36.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.618+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f82a410 con 0x564f4f826ae0 2023-10-06T02:26:36.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.619+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v109'85 uv85 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f826ae0 2023-10-06T02:26:36.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.619+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829400 con 0x564f4f826ae0 2023-10-06T02:26:36.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.620+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v109'86 uv86 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f826ae0 2023-10-06T02:26:36.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.620+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829400 con 0x564f4f81c2d0 2023-10-06T02:26:36.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.622+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v109'69 uv68 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f81c2d0 2023-10-06T02:26:36.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.622+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829400 con 0x564f4f81c2d0 2023-10-06T02:26:36.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.623+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v109'70 uv70 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f81c2d0 2023-10-06T02:26:36.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.623+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829400 con 0x564f4f81c2d0 2023-10-06T02:26:36.849 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:26:36.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.624+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v109'71 uv71 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f81c2d0 2023-10-06T02:26:36.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.624+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829400 con 0x564f4f81c2d0 2023-10-06T02:26:36.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.625+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v109'72 uv72 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f81c2d0 2023-10-06T02:26:36.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.625+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829400 con 0x564f4f81c2d0 2023-10-06T02:26:36.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.626+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v109'73 uv73 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7facf80018d0 con 0x564f4f81c2d0 2023-10-06T02:26:36.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.626+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829400 con 0x564f4f817bb0 2023-10-06T02:26:36.851 INFO:teuthology.orchestra.run.smithi006.stdout:Write #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:26:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.627+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v109'170 uv170 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.627+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829400 con 0x564f4f817bb0 2023-10-06T02:26:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.628+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [write 0~554] v109'171 uv171 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.628+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829800 con 0x564f4f817bb0 2023-10-06T02:26:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.629+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [omap-set-header] v109'172 uv172 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.629+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829800 con 0x564f4f817bb0 2023-10-06T02:26:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.630+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 1.00000000 [create] v109'173 uv168 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.630+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829400 con 0x564f4f817bb0 2023-10-06T02:26:36.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.631+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 1.00000000 [delete] v109'174 uv174 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.631+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829400 con 0x564f4f817bb0 2023-10-06T02:26:36.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.632+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v109'175 uv175 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.853 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:26:36.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.632+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829400 con 0x564f4f817bb0 2023-10-06T02:26:36.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.636+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v109'176 uv176 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.636+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829400 con 0x564f4f817bb0 2023-10-06T02:26:36.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.637+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v109'177 uv177 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.637+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829800 con 0x564f4f817bb0 2023-10-06T02:26:36.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.638+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [omap-set-header] v109'178 uv178 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.638+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564f4f829c20 con 0x564f4f817bb0 2023-10-06T02:26:36.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7facfeda1700 1 -- 172.21.15.6:0/1235757224 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v109'179 uv179 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7facf001b040 con 0x564f4f817bb0 2023-10-06T02:26:36.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x564f4f817bb0 msgr2=0x564f4f819f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x564f4f817bb0 0x564f4f819f90 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x564f4f7de800 msgr2=0x564f4f810500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x564f4f7de800 0x564f4f810500 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x564f4f8231e0 msgr2=0x564f4f8255c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x564f4f8231e0 0x564f4f8255c0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x564f4f8131d0 msgr2=0x564f4f8155b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x564f4f8131d0 0x564f4f8155b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x564f4f826ae0 msgr2=0x564f4f828ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x564f4f826ae0 0x564f4f828ec0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x564f4f81fcb0 msgr2=0x564f4f822090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x564f4f81fcb0 0x564f4f822090 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564f4f81c2d0 msgr2=0x564f4f81f0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564f4f81c2d0 0x564f4f81f0f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 reap_dead start 2023-10-06T02:26:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 reap_dead start 2023-10-06T02:26:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 reap_dead start 2023-10-06T02:26:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 reap_dead start 2023-10-06T02:26:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.639+0000 7facffda3700 1 -- 172.21.15.6:0/1235757224 reap_dead start 2023-10-06T02:26:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.640+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7face0065890 msgr2=0x7face0067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.640+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7face0065890 0x7face0067d40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7face800a520 tx=0x7face8015000 comp rx=0 tx=0).stop 2023-10-06T02:26:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.640+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f4f7f1f50 msgr2=0x564f4f71bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.640+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f4f7f1f50 0x564f4f71bbe0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7facf0005c90 tx=0x7facf0017000 comp rx=0 tx=0).stop 2023-10-06T02:26:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.640+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 shutdown_connections 2023-10-06T02:26:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.640+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f4f7f1f50 0x564f4f71bbe0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.640+0000 7fad06367000 1 --2- 172.21.15.6:0/1235757224 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7face0065890 0x7face0067d40 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.640+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 >> 172.21.15.6:0/1235757224 conn(0x564f4f764bd0 msgr2=0x564f4f764fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.640+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 shutdown_connections 2023-10-06T02:26:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.640+0000 7fad06367000 1 -- 172.21.15.6:0/1235757224 wait complete. 2023-10-06T02:26:36.859 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 1.00000000 2023-10-06T02:26:36.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.935+0000 7fda59250000 1 Processor -- start 2023-10-06T02:26:36.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.935+0000 7fda59250000 1 -- start start 2023-10-06T02:26:36.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda59250000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55872e2ccdd0 0x55872e369e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda59250000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55872e3553b0 0x55872e36a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda59250000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55872e3739b0 0x55872e353a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda59250000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55872e244320 con 0x55872e2ccdd0 2023-10-06T02:26:36.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda59250000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55872e1e8980 con 0x55872e3739b0 2023-10-06T02:26:36.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda59250000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55872e1e8620 con 0x55872e3553b0 2023-10-06T02:26:36.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda5248b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55872e2ccdd0 0x55872e369e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda5248b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55872e2ccdd0 0x55872e369e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38772/0 (socket says 172.21.15.6:38772) 2023-10-06T02:26:36.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda5248b700 1 -- 172.21.15.6:0/2877510491 learned_addr learned my addr 172.21.15.6:0/2877510491 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:36.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda52c8c700 1 --2- 172.21.15.6:0/2877510491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55872e3739b0 0x55872e353a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda51c8a700 1 --2- 172.21.15.6:0/2877510491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55872e3553b0 0x55872e36a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda5248b700 1 -- 172.21.15.6:0/2877510491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55872e3553b0 msgr2=0x55872e36a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:36.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda5248b700 1 --2- 172.21.15.6:0/2877510491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55872e3553b0 0x55872e36a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda5248b700 1 -- 172.21.15.6:0/2877510491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55872e3739b0 msgr2=0x55872e353a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:36.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda5248b700 1 --2- 172.21.15.6:0/2877510491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55872e3739b0 0x55872e353a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda5248b700 1 -- 172.21.15.6:0/2877510491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda44005cf0 con 0x55872e2ccdd0 2023-10-06T02:26:36.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda51c8a700 1 --2- 172.21.15.6:0/2877510491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55872e3553b0 0x55872e36a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:36.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda5248b700 1 --2- 172.21.15.6:0/2877510491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55872e2ccdd0 0x55872e369e80 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fda4c006f70 tx=0x7fda4c0069e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57f8ef0dd07be17 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:36.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda50c88700 1 -- 172.21.15.6:0/2877510491 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c002030 con 0x55872e2ccdd0 2023-10-06T02:26:36.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda50c88700 1 -- 172.21.15.6:0/2877510491 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c002190 con 0x55872e2ccdd0 2023-10-06T02:26:36.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.936+0000 7fda50c88700 1 -- 172.21.15.6:0/2877510491 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c001550 con 0x55872e2ccdd0 2023-10-06T02:26:36.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.937+0000 7fda59250000 1 -- 172.21.15.6:0/2877510491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55872e2ccdd0 msgr2=0x55872e369e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.937+0000 7fda59250000 1 --2- 172.21.15.6:0/2877510491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55872e2ccdd0 0x55872e369e80 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fda4c006f70 tx=0x7fda4c0069e0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.937+0000 7fda59250000 1 -- 172.21.15.6:0/2877510491 shutdown_connections 2023-10-06T02:26:36.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.937+0000 7fda59250000 1 --2- 172.21.15.6:0/2877510491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55872e3739b0 0x55872e353a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.937+0000 7fda59250000 1 --2- 172.21.15.6:0/2877510491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55872e2ccdd0 0x55872e369e80 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.937+0000 7fda59250000 1 --2- 172.21.15.6:0/2877510491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55872e3553b0 0x55872e36a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.937+0000 7fda59250000 1 -- 172.21.15.6:0/2877510491 >> 172.21.15.6:0/2877510491 conn(0x55872e29dd50 msgr2=0x55872e3755a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:36.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.937+0000 7fda59250000 1 -- 172.21.15.6:0/2877510491 shutdown_connections 2023-10-06T02:26:36.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.937+0000 7fda59250000 1 -- 172.21.15.6:0/2877510491 wait complete. 2023-10-06T02:26:36.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.937+0000 7fda59250000 1 Processor -- start 2023-10-06T02:26:36.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.938+0000 7fda59250000 1 -- start start 2023-10-06T02:26:36.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.938+0000 7fda59250000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55872e2ccdd0 0x55872e36d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.938+0000 7fda59250000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55872e3553b0 0x55872e2cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.938+0000 7fda59250000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55872e3739b0 0x55872e36a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.938+0000 7fda59250000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55872e1df400 con 0x55872e3553b0 2023-10-06T02:26:36.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.938+0000 7fda59250000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55872e2ccc00 con 0x55872e2ccdd0 2023-10-06T02:26:36.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.938+0000 7fda59250000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55872e36bfb0 con 0x55872e3739b0 2023-10-06T02:26:36.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.938+0000 7fda51c8a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55872e3553b0 0x55872e2cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.938+0000 7fda51c8a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55872e3553b0 0x55872e2cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38788/0 (socket says 172.21.15.6:38788) 2023-10-06T02:26:36.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.938+0000 7fda51c8a700 1 -- 172.21.15.6:0/3267176848 learned_addr learned my addr 172.21.15.6:0/3267176848 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:36.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.938+0000 7fda5248b700 1 --2- 172.21.15.6:0/3267176848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55872e2ccdd0 0x55872e36d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.938+0000 7fda52c8c700 1 --2- 172.21.15.6:0/3267176848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55872e3739b0 0x55872e36a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.939+0000 7fda51c8a700 1 -- 172.21.15.6:0/3267176848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55872e3739b0 msgr2=0x55872e36a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.939+0000 7fda51c8a700 1 --2- 172.21.15.6:0/3267176848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55872e3739b0 0x55872e36a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.939+0000 7fda51c8a700 1 -- 172.21.15.6:0/3267176848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55872e2ccdd0 msgr2=0x55872e36d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.939+0000 7fda51c8a700 1 --2- 172.21.15.6:0/3267176848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55872e2ccdd0 0x55872e36d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.939+0000 7fda51c8a700 1 -- 172.21.15.6:0/3267176848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55872e1ea750 con 0x55872e3553b0 2023-10-06T02:26:36.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.939+0000 7fda51c8a700 1 --2- 172.21.15.6:0/3267176848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55872e3553b0 0x55872e2cc6c0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00a500 tx=0x7fda3c001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:36.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.939+0000 7fda4affd700 1 -- 172.21.15.6:0/3267176848 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c00ad70 con 0x55872e3553b0 2023-10-06T02:26:36.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.939+0000 7fda4affd700 1 -- 172.21.15.6:0/3267176848 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c00f400 con 0x55872e3553b0 2023-10-06T02:26:36.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.939+0000 7fda59250000 1 -- 172.21.15.6:0/3267176848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55872e1eaae0 con 0x55872e3553b0 2023-10-06T02:26:36.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.939+0000 7fda4affd700 1 -- 172.21.15.6:0/3267176848 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c00f7c0 con 0x55872e3553b0 2023-10-06T02:26:36.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.939+0000 7fda59250000 1 -- 172.21.15.6:0/3267176848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55872e1ea540 con 0x55872e3553b0 2023-10-06T02:26:36.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.940+0000 7fda4affd700 1 -- 172.21.15.6:0/3267176848 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda3c00d040 con 0x55872e3553b0 2023-10-06T02:26:36.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.941+0000 7fda4affd700 1 --2- 172.21.15.6:0/3267176848 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda34065890 0x7fda34067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.941+0000 7fda4affd700 1 -- 172.21.15.6:0/3267176848 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7582+0+0 (secure 0 0 0) 0x7fda3c0835b0 con 0x55872e3553b0 2023-10-06T02:26:36.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.941+0000 7fda5248b700 1 --2- 172.21.15.6:0/3267176848 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda34065890 0x7fda34067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.941+0000 7fda59250000 1 --2- 172.21.15.6:0/3267176848 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55872e36ce80 0x55872e36e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:36.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.941+0000 7fda59250000 1 -- 172.21.15.6:0/3267176848 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e109) v8 -- 0x55872e370790 con 0x55872e36ce80 2023-10-06T02:26:36.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.941+0000 7fda52c8c700 1 --2- 172.21.15.6:0/3267176848 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55872e36ce80 0x55872e36e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:36.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.941+0000 7fda5248b700 1 --2- 172.21.15.6:0/3267176848 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda34065890 0x7fda34067d40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fda4c006e60 tx=0x7fda4c014000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:36.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.941+0000 7fda52c8c700 1 --2- 172.21.15.6:0/3267176848 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55872e36ce80 0x55872e36e4d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:36.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.943+0000 7fda52c8c700 1 -- 172.21.15.6:0/3267176848 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 1.00000000 [delete] v109'180 uv180 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fda44013cc0 con 0x55872e36ce80 2023-10-06T02:26:36.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.943+0000 7fda59250000 1 -- 172.21.15.6:0/3267176848 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55872e36ce80 msgr2=0x55872e36e4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.943+0000 7fda59250000 1 --2- 172.21.15.6:0/3267176848 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55872e36ce80 0x55872e36e4d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:36.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.943+0000 7fda59250000 1 -- 172.21.15.6:0/3267176848 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda34065890 msgr2=0x7fda34067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.943+0000 7fda59250000 1 --2- 172.21.15.6:0/3267176848 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda34065890 0x7fda34067d40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fda4c006e60 tx=0x7fda4c014000 comp rx=0 tx=0).stop 2023-10-06T02:26:36.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.943+0000 7fda59250000 1 -- 172.21.15.6:0/3267176848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55872e3553b0 msgr2=0x55872e2cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:36.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.943+0000 7fda59250000 1 --2- 172.21.15.6:0/3267176848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55872e3553b0 0x55872e2cc6c0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00a500 tx=0x7fda3c001b40 comp rx=0 tx=0).stop 2023-10-06T02:26:36.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.943+0000 7fda52c8c700 1 -- 172.21.15.6:0/3267176848 reap_dead start 2023-10-06T02:26:36.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.943+0000 7fda59250000 1 -- 172.21.15.6:0/3267176848 shutdown_connections 2023-10-06T02:26:36.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.943+0000 7fda59250000 1 -- 172.21.15.6:0/3267176848 >> 172.21.15.6:0/3267176848 conn(0x55872e29dd50 msgr2=0x55872e29ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:36.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.943+0000 7fda59250000 1 -- 172.21.15.6:0/3267176848 shutdown_connections 2023-10-06T02:26:36.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:36.943+0000 7fda59250000 1 -- 172.21.15.6:0/3267176848 wait complete. 2023-10-06T02:26:36.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:26:37.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.108+0000 7f1884ed6700 1 Processor -- start 2023-10-06T02:26:37.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.108+0000 7f1884ed6700 1 -- start start 2023-10-06T02:26:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.109+0000 7f1884ed6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f188006a380 0x7f18800cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.109+0000 7f1884ed6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f188006a750 0x7f188015d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.109+0000 7f1884ed6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18800cae80 con 0x7f188015d770 2023-10-06T02:26:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.109+0000 7f1884ed6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18800cc3d0 con 0x7f188006a380 2023-10-06T02:26:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.109+0000 7f1884ed6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188015dcd0 con 0x7f188006a750 2023-10-06T02:26:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.109+0000 7f187e59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f188006a380 0x7f18800cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.109+0000 7f187e59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f188006a380 0x7f18800cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38794/0 (socket says 172.21.15.6:38794) 2023-10-06T02:26:37.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.109+0000 7f187e59c700 1 -- 172.21.15.6:0/3331503136 learned_addr learned my addr 172.21.15.6:0/3331503136 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:37.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.110+0000 7f187dd9b700 1 --2- 172.21.15.6:0/3331503136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f188006a750 0x7f188015d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:37.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.110+0000 7f187e59c700 1 -- 172.21.15.6:0/3331503136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f188006a750 msgr2=0x7f188015d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:37.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.110+0000 7f187e59c700 1 --2- 172.21.15.6:0/3331503136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f188006a750 0x7f188015d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:37.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.110+0000 7f187e59c700 1 -- 172.21.15.6:0/3331503136 >> v1:172.21.15.175:6789/0 conn(0x7f188015d770 legacy=0x7f1880159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:37.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.110+0000 7f187e59c700 1 -- 172.21.15.6:0/3331503136 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188015dfb0 con 0x7f188006a380 2023-10-06T02:26:37.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.110+0000 7f187e59c700 1 --2- 172.21.15.6:0/3331503136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f188006a380 0x7f18800cb310 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f18780099b0 tx=0x7f1878009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f288a584085b5e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:37.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.110+0000 7f187d59a700 1 -- 172.21.15.6:0/3331503136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1878009ea0 con 0x7f188006a380 2023-10-06T02:26:37.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.110+0000 7f187d59a700 1 -- 172.21.15.6:0/3331503136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187800b860 con 0x7f188006a380 2023-10-06T02:26:37.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.110+0000 7f187d59a700 1 -- 172.21.15.6:0/3331503136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187800bc00 con 0x7f188006a380 2023-10-06T02:26:37.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.111+0000 7f1884ed6700 1 -- 172.21.15.6:0/3331503136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f188006a380 msgr2=0x7f18800cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:37.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.111+0000 7f1884ed6700 1 --2- 172.21.15.6:0/3331503136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f188006a380 0x7f18800cb310 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f18780099b0 tx=0x7f1878009250 comp rx=0 tx=0).stop 2023-10-06T02:26:37.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.111+0000 7f1884ed6700 1 -- 172.21.15.6:0/3331503136 shutdown_connections 2023-10-06T02:26:37.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.111+0000 7f1884ed6700 1 --2- 172.21.15.6:0/3331503136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f188006a380 0x7f18800cb310 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:37.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.111+0000 7f1884ed6700 1 --2- 172.21.15.6:0/3331503136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f188006a750 0x7f188015d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:37.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.111+0000 7f1884ed6700 1 -- 172.21.15.6:0/3331503136 >> 172.21.15.6:0/3331503136 conn(0x7f18800d0350 msgr2=0x7f18800d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:37.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.111+0000 7f1884ed6700 1 -- 172.21.15.6:0/3331503136 shutdown_connections 2023-10-06T02:26:37.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.111+0000 7f1884ed6700 1 -- 172.21.15.6:0/3331503136 wait complete. 2023-10-06T02:26:37.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.112+0000 7f1884ed6700 1 Processor -- start 2023-10-06T02:26:37.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.112+0000 7f1884ed6700 1 -- start start 2023-10-06T02:26:37.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.112+0000 7f1884ed6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f188006a380 0x7f1880169d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:37.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.112+0000 7f1884ed6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f188006a750 0x7f18801450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:37.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.112+0000 7f1884ed6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f188015d770 0x7f1880155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:37.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.112+0000 7f1884ed6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18800c8ce0 con 0x7f188006a750 2023-10-06T02:26:37.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.112+0000 7f1884ed6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18800b4930 con 0x7f188015d770 2023-10-06T02:26:37.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.112+0000 7f1884ed6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18800ca2f0 con 0x7f188006a380 2023-10-06T02:26:37.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.113+0000 7f187dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f188006a750 0x7f18801450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:37.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.113+0000 7f187dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f188006a750 0x7f18801450d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38810/0 (socket says 172.21.15.6:38810) 2023-10-06T02:26:37.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.113+0000 7f187dd9b700 1 -- 172.21.15.6:0/2061225579 learned_addr learned my addr 172.21.15.6:0/2061225579 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:37.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.113+0000 7f187ed9d700 1 --2- 172.21.15.6:0/2061225579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f188015d770 0x7f1880155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:37.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.113+0000 7f187e59c700 1 --2- 172.21.15.6:0/2061225579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f188006a380 0x7f1880169d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:37.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.113+0000 7f187dd9b700 1 -- 172.21.15.6:0/2061225579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f188006a380 msgr2=0x7f1880169d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:37.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.113+0000 7f187dd9b700 1 --2- 172.21.15.6:0/2061225579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f188006a380 0x7f1880169d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:37.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.113+0000 7f187dd9b700 1 -- 172.21.15.6:0/2061225579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f188015d770 msgr2=0x7f1880155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:37.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.113+0000 7f187dd9b700 1 --2- 172.21.15.6:0/2061225579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f188015d770 0x7f1880155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:37.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.113+0000 7f187dd9b700 1 -- 172.21.15.6:0/2061225579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18780094f0 con 0x7f188006a750 2023-10-06T02:26:37.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.113+0000 7f187dd9b700 1 --2- 172.21.15.6:0/2061225579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f188006a750 0x7f18801450d0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f186800ec80 tx=0x7f18680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:37.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.113+0000 7f18767fc700 1 -- 172.21.15.6:0/2061225579 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186800c850 con 0x7f188006a750 2023-10-06T02:26:37.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.113+0000 7f18767fc700 1 -- 172.21.15.6:0/2061225579 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186800c9b0 con 0x7f188006a750 2023-10-06T02:26:37.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.113+0000 7f1884ed6700 1 -- 172.21.15.6:0/2061225579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188016a430 con 0x7f188006a750 2023-10-06T02:26:37.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.113+0000 7f18767fc700 1 -- 172.21.15.6:0/2061225579 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186800cd50 con 0x7f188006a750 2023-10-06T02:26:37.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.113+0000 7f1884ed6700 1 -- 172.21.15.6:0/2061225579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188016a9f0 con 0x7f188006a750 2023-10-06T02:26:37.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.114+0000 7f1884ed6700 1 -- 172.21.15.6:0/2061225579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18800b4aa0 con 0x7f188006a750 2023-10-06T02:26:37.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.115+0000 7f18767fc700 1 -- 172.21.15.6:0/2061225579 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1868013680 con 0x7f188006a750 2023-10-06T02:26:37.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.115+0000 7f18767fc700 1 --2- 172.21.15.6:0/2061225579 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1860066f30 0x7f18600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:37.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.115+0000 7f18767fc700 1 -- 172.21.15.6:0/2061225579 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7582+0+0 (secure 0 0 0) 0x7f1868084f00 con 0x7f188006a750 2023-10-06T02:26:37.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.115+0000 7f187e59c700 1 --2- 172.21.15.6:0/2061225579 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1860066f30 0x7f18600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:37.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.116+0000 7f187e59c700 1 --2- 172.21.15.6:0/2061225579 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1860066f30 0x7f18600693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f18780099b0 tx=0x7f1878017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:37.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.119+0000 7f18767fc700 1 -- 172.21.15.6:0/2061225579 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1868051a20 con 0x7f188006a750 2023-10-06T02:26:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:37.362+0000 7f1884ed6700 1 -- 172.21.15.6:0/2061225579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f18800b5f40 con 0x7f188006a750 2023-10-06T02:26:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.131+0000 7f18767fc700 1 -- 172.21.15.6:0/2061225579 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v179) v1 ==== 162+0+0 (secure 0 0 0) 0x7f1868055040 con 0x7f188006a750 2023-10-06T02:26:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.134+0000 7f1884ed6700 1 -- 172.21.15.6:0/2061225579 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1860066f30 msgr2=0x7f18600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.134+0000 7f1884ed6700 1 --2- 172.21.15.6:0/2061225579 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1860066f30 0x7f18600693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f18780099b0 tx=0x7f1878017000 comp rx=0 tx=0).stop 2023-10-06T02:26:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.134+0000 7f1884ed6700 1 -- 172.21.15.6:0/2061225579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f188006a750 msgr2=0x7f18801450d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.134+0000 7f1884ed6700 1 --2- 172.21.15.6:0/2061225579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f188006a750 0x7f18801450d0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f186800ec80 tx=0x7f18680091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.134+0000 7f1884ed6700 1 -- 172.21.15.6:0/2061225579 shutdown_connections 2023-10-06T02:26:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.134+0000 7f1884ed6700 1 --2- 172.21.15.6:0/2061225579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f188015d770 0x7f1880155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.134+0000 7f1884ed6700 1 --2- 172.21.15.6:0/2061225579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f188006a380 0x7f1880169d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.134+0000 7f1884ed6700 1 --2- 172.21.15.6:0/2061225579 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1860066f30 0x7f18600693e0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.134+0000 7f1884ed6700 1 --2- 172.21.15.6:0/2061225579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f188006a750 0x7f18801450d0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.134+0000 7f1884ed6700 1 -- 172.21.15.6:0/2061225579 >> 172.21.15.6:0/2061225579 conn(0x7f18800d0350 msgr2=0x7f18800b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.134+0000 7f1884ed6700 1 -- 172.21.15.6:0/2061225579 shutdown_connections 2023-10-06T02:26:38.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.134+0000 7f1884ed6700 1 -- 172.21.15.6:0/2061225579 wait complete. 2023-10-06T02:26:38.137 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:26:38.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:38.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.273+0000 7f6af3042700 1 Processor -- start 2023-10-06T02:26:38.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.273+0000 7f6af3042700 1 -- start start 2023-10-06T02:26:38.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.274+0000 7f6af3042700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6aec1431b0 0x7f6aec0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:38.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.274+0000 7f6af3042700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6aec0d0780 0x7f6aec0b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:38.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.274+0000 7f6af3042700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec0cf8a0 con 0x7f6aec142de0 2023-10-06T02:26:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.274+0000 7f6af3042700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aec0d0b50 con 0x7f6aec1431b0 2023-10-06T02:26:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.274+0000 7f6af3042700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aec0cec90 con 0x7f6aec0d0780 2023-10-06T02:26:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.274+0000 7f6aebfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6aec1431b0 0x7f6aec0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.274+0000 7f6af0dde700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6aec142de0 0x7f6aec0ccd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40988/0 (socket says 172.21.15.6:40988) 2023-10-06T02:26:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.274+0000 7f6aebfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6aec1431b0 0x7f6aec0d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38820/0 (socket says 172.21.15.6:38820) 2023-10-06T02:26:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.274+0000 7f6af0dde700 1 -- 172.21.15.6:0/4017549401 learned_addr learned my addr 172.21.15.6:0/4017549401 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.275+0000 7f6af15df700 1 --2- 172.21.15.6:0/4017549401 >> v2:172.21.15.175:3300/0 conn(0x7f6aec0d0780 0x7f6aec0b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.275+0000 7f6aebfff700 1 -- 172.21.15.6:0/4017549401 >> v2:172.21.15.175:3300/0 conn(0x7f6aec0d0780 msgr2=0x7f6aec0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.275+0000 7f6aebfff700 1 --2- 172.21.15.6:0/4017549401 >> v2:172.21.15.175:3300/0 conn(0x7f6aec0d0780 0x7f6aec0b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.275+0000 7f6aebfff700 1 -- 172.21.15.6:0/4017549401 >> v1:172.21.15.6:6789/0 conn(0x7f6aec142de0 legacy=0x7f6aec0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.275+0000 7f6aebfff700 1 -- 172.21.15.6:0/4017549401 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec0cef70 con 0x7f6aec1431b0 2023-10-06T02:26:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.275+0000 7f6aeb7fe700 1 -- 172.21.15.6:0/4017549401 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071350862 0 0) 0x7f6aec0cf8a0 con 0x7f6aec142de0 2023-10-06T02:26:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.275+0000 7f6aebfff700 1 --2- 172.21.15.6:0/4017549401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aec1431b0 0x7f6aec0d0240 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0d0e10 tx=0x7f6adc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4cc380023cb848 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.275+0000 7f6aeb7fe700 1 -- 172.21.15.6:0/4017549401 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc00e070 con 0x7f6aec1431b0 2023-10-06T02:26:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.275+0000 7f6aeb7fe700 1 -- 172.21.15.6:0/4017549401 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6adc00bc30 con 0x7f6aec1431b0 2023-10-06T02:26:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.275+0000 7f6aeb7fe700 1 -- 172.21.15.6:0/4017549401 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc012430 con 0x7f6aec1431b0 2023-10-06T02:26:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.275+0000 7f6af3042700 1 -- 172.21.15.6:0/4017549401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aec1431b0 msgr2=0x7f6aec0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.275+0000 7f6af3042700 1 --2- 172.21.15.6:0/4017549401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aec1431b0 0x7f6aec0d0240 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0d0e10 tx=0x7f6adc009780 comp rx=0 tx=0).stop 2023-10-06T02:26:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.275+0000 7f6af3042700 1 -- 172.21.15.6:0/4017549401 shutdown_connections 2023-10-06T02:26:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.275+0000 7f6af3042700 1 --2- 172.21.15.6:0/4017549401 >> v2:172.21.15.175:3300/0 conn(0x7f6aec0d0780 0x7f6aec0b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.275+0000 7f6af3042700 1 --2- 172.21.15.6:0/4017549401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aec1431b0 0x7f6aec0d0240 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.275+0000 7f6af3042700 1 -- 172.21.15.6:0/4017549401 >> 172.21.15.6:0/4017549401 conn(0x7f6aec069110 msgr2=0x7f6aec06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:38.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.276+0000 7f6af3042700 1 -- 172.21.15.6:0/4017549401 shutdown_connections 2023-10-06T02:26:38.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.276+0000 7f6af3042700 1 -- 172.21.15.6:0/4017549401 wait complete. 2023-10-06T02:26:38.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.277+0000 7f6af3042700 1 Processor -- start 2023-10-06T02:26:38.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.277+0000 7f6af3042700 1 -- start start 2023-10-06T02:26:38.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.277+0000 7f6af3042700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6aec0d0780 0x7f6aec153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.277+0000 7f6af3042700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aec142de0 0x7f6aec153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.277+0000 7f6af3042700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aec1431b0 0x7f6aec16a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6af3042700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec16b390 con 0x7f6aec142de0 2023-10-06T02:26:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6af3042700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec155480 con 0x7f6aec0d0780 2023-10-06T02:26:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6af3042700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec154b50 con 0x7f6aec1431b0 2023-10-06T02:26:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6aebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aec142de0 0x7f6aec153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6aebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aec142de0 0x7f6aec153770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38836/0 (socket says 172.21.15.6:38836) 2023-10-06T02:26:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6aebfff700 1 -- 172.21.15.6:0/2240761362 learned_addr learned my addr 172.21.15.6:0/2240761362 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6af0dde700 1 --2- 172.21.15.6:0/2240761362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6aec0d0780 0x7f6aec153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6af15df700 1 --2- 172.21.15.6:0/2240761362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aec1431b0 0x7f6aec16a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6aebfff700 1 -- 172.21.15.6:0/2240761362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aec1431b0 msgr2=0x7f6aec16a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6aebfff700 1 --2- 172.21.15.6:0/2240761362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aec1431b0 0x7f6aec16a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6aebfff700 1 -- 172.21.15.6:0/2240761362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6aec0d0780 msgr2=0x7f6aec153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6aebfff700 1 --2- 172.21.15.6:0/2240761362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6aec0d0780 0x7f6aec153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6aebfff700 1 -- 172.21.15.6:0/2240761362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc009a20 con 0x7f6aec142de0 2023-10-06T02:26:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6aebfff700 1 --2- 172.21.15.6:0/2240761362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aec142de0 0x7f6aec153770 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0097c0 tx=0x7f6adc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6ae8ff9700 1 -- 172.21.15.6:0/2240761362 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc012e20 con 0x7f6aec142de0 2023-10-06T02:26:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6ae8ff9700 1 -- 172.21.15.6:0/2240761362 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6adc027470 con 0x7f6aec142de0 2023-10-06T02:26:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6ae8ff9700 1 -- 172.21.15.6:0/2240761362 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc027830 con 0x7f6aec142de0 2023-10-06T02:26:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6af3042700 1 -- 172.21.15.6:0/2240761362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec154e30 con 0x7f6aec142de0 2023-10-06T02:26:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.278+0000 7f6af3042700 1 -- 172.21.15.6:0/2240761362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aec153fb0 con 0x7f6aec142de0 2023-10-06T02:26:38.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.279+0000 7f6af3042700 1 -- 172.21.15.6:0/2240761362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aec155630 con 0x7f6aec142de0 2023-10-06T02:26:38.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.280+0000 7f6ae8ff9700 1 -- 172.21.15.6:0/2240761362 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6adc024070 con 0x7f6aec142de0 2023-10-06T02:26:38.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.280+0000 7f6ae8ff9700 1 --2- 172.21.15.6:0/2240761362 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6acc066f30 0x7f6acc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:38.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.280+0000 7f6ae8ff9700 1 -- 172.21.15.6:0/2240761362 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7582+0+0 (secure 0 0 0) 0x7f6adc0872f0 con 0x7f6aec142de0 2023-10-06T02:26:38.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.280+0000 7f6af0dde700 1 --2- 172.21.15.6:0/2240761362 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6acc066f30 0x7f6acc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:38.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.281+0000 7f6af0dde700 1 --2- 172.21.15.6:0/2240761362 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6acc066f30 0x7f6acc0693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f6aec167f20 tx=0x7f6ae4007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:38.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.284+0000 7f6ae8ff9700 1 -- 172.21.15.6:0/2240761362 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6aec155630 con 0x7f6aec142de0 2023-10-06T02:26:38.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.521+0000 7f6af3042700 1 -- 172.21.15.6:0/2240761362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6aec1555f0 con 0x7f6aec142de0 2023-10-06T02:26:38.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.521+0000 7f6ae8ff9700 1 -- 172.21.15.6:0/2240761362 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 180 v180) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f6adc053e10 con 0x7f6aec142de0 2023-10-06T02:26:38.523 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:38.523 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":180,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":180,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:38.133119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8805},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8805":{"gid":8805,"name":"a","rank":0,"incarnation":180,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/1318769254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1318769254},{"type":"v1","addr":"172.21.15.6:6835","nonce":1318769254}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.523+0000 7f6af3042700 1 -- 172.21.15.6:0/2240761362 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6acc066f30 msgr2=0x7f6acc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.523+0000 7f6af3042700 1 --2- 172.21.15.6:0/2240761362 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6acc066f30 0x7f6acc0693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f6aec167f20 tx=0x7f6ae4007d30 comp rx=0 tx=0).stop 2023-10-06T02:26:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.523+0000 7f6af3042700 1 -- 172.21.15.6:0/2240761362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aec142de0 msgr2=0x7f6aec153770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.523+0000 7f6af3042700 1 --2- 172.21.15.6:0/2240761362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aec142de0 0x7f6aec153770 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0097c0 tx=0x7f6adc019000 comp rx=0 tx=0).stop 2023-10-06T02:26:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.523+0000 7f6af3042700 1 -- 172.21.15.6:0/2240761362 shutdown_connections 2023-10-06T02:26:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.524+0000 7f6af3042700 1 --2- 172.21.15.6:0/2240761362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aec1431b0 0x7f6aec16a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.524+0000 7f6af3042700 1 --2- 172.21.15.6:0/2240761362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6aec0d0780 0x7f6aec153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.524+0000 7f6af3042700 1 --2- 172.21.15.6:0/2240761362 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6acc066f30 0x7f6acc0693e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.524+0000 7f6af3042700 1 --2- 172.21.15.6:0/2240761362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aec142de0 0x7f6aec153770 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.524+0000 7f6af3042700 1 -- 172.21.15.6:0/2240761362 >> 172.21.15.6:0/2240761362 conn(0x7f6aec069110 msgr2=0x7f6aec0b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.524+0000 7f6af3042700 1 -- 172.21.15.6:0/2240761362 shutdown_connections 2023-10-06T02:26:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:38.524+0000 7f6af3042700 1 -- 172.21.15.6:0/2240761362 wait complete. 2023-10-06T02:26:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 180 2023-10-06T02:26:38.538 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2023-10-06T02:26:41.157 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:26:41.155+0000 7f81d067d700 -1 log_channel(cluster) log [ERR] : dir 0x1 object missing on disk; some files may be lost () 2023-10-06T02:26:41.157 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:26:41.155+0000 7f81d067d700 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x1 is fatal because it is a system directory for this rank 2023-10-06T02:26:41.157 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:26:41.156+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:26:41.158 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:26:41.156+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:26:41.166 INFO:tasks.ceph.mds.a.smithi006.stderr: -17> 2023-10-06T02:26:41.155+0000 7f81d067d700 -1 log_channel(cluster) log [ERR] : dir 0x1 object missing on disk; some files may be lost () 2023-10-06T02:26:41.166 INFO:tasks.ceph.mds.a.smithi006.stderr: -15> 2023-10-06T02:26:41.155+0000 7f81d067d700 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x1 is fatal because it is a system directory for this rank 2023-10-06T02:26:41.189 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:26:43.539 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:43.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.670+0000 7f5356215700 1 Processor -- start 2023-10-06T02:26:43.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.670+0000 7f5356215700 1 -- start start 2023-10-06T02:26:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.671+0000 7f5356215700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5350142de0 0x7f53500ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.671+0000 7f5356215700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f53500d0950 0x7f53500b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.671+0000 7f5356215700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53500cf8a0 con 0x7f53500cd270 2023-10-06T02:26:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.671+0000 7f5356215700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53500cec90 con 0x7f5350142de0 2023-10-06T02:26:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.671+0000 7f5356215700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53500cef70 con 0x7f53500d0950 2023-10-06T02:26:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.671+0000 7f534f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5350142de0 0x7f53500ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.671+0000 7f534f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5350142de0 0x7f53500ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57108/0 (socket says 172.21.15.6:57108) 2023-10-06T02:26:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.672+0000 7f534f7fe700 1 -- 172.21.15.6:0/2915051663 learned_addr learned my addr 172.21.15.6:0/2915051663 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.672+0000 7f534ffff700 1 --2- 172.21.15.6:0/2915051663 >> v2:172.21.15.175:3300/0 conn(0x7f53500d0950 0x7f53500b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.672+0000 7f534f7fe700 1 -- 172.21.15.6:0/2915051663 >> v2:172.21.15.175:3300/0 conn(0x7f53500d0950 msgr2=0x7f53500b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.672+0000 7f534f7fe700 1 --2- 172.21.15.6:0/2915051663 >> v2:172.21.15.175:3300/0 conn(0x7f53500d0950 0x7f53500b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.672+0000 7f534f7fe700 1 -- 172.21.15.6:0/2915051663 >> v1:172.21.15.175:6789/0 conn(0x7f53500cd270 legacy=0x7f53500d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.672+0000 7f534f7fe700 1 -- 172.21.15.6:0/2915051663 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53500cf250 con 0x7f5350142de0 2023-10-06T02:26:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.672+0000 7f534f7fe700 1 --2- 172.21.15.6:0/2915051663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5350142de0 0x7f53500ccd30 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f53500d0e40 tx=0x7f5340009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c72fc6f706c6257 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.672+0000 7f534e7fc700 1 -- 172.21.15.6:0/2915051663 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534000b820 con 0x7f5350142de0 2023-10-06T02:26:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.672+0000 7f534e7fc700 1 -- 172.21.15.6:0/2915051663 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534000b980 con 0x7f5350142de0 2023-10-06T02:26:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.672+0000 7f534e7fc700 1 -- 172.21.15.6:0/2915051663 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534000bd20 con 0x7f5350142de0 2023-10-06T02:26:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.673+0000 7f5356215700 1 -- 172.21.15.6:0/2915051663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5350142de0 msgr2=0x7f53500ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.673+0000 7f5356215700 1 --2- 172.21.15.6:0/2915051663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5350142de0 0x7f53500ccd30 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f53500d0e40 tx=0x7f5340009250 comp rx=0 tx=0).stop 2023-10-06T02:26:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.673+0000 7f5356215700 1 -- 172.21.15.6:0/2915051663 shutdown_connections 2023-10-06T02:26:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.673+0000 7f5356215700 1 --2- 172.21.15.6:0/2915051663 >> v2:172.21.15.175:3300/0 conn(0x7f53500d0950 0x7f53500b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.673+0000 7f5356215700 1 --2- 172.21.15.6:0/2915051663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5350142de0 0x7f53500ccd30 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.673+0000 7f5356215700 1 -- 172.21.15.6:0/2915051663 >> 172.21.15.6:0/2915051663 conn(0x7f5350069110 msgr2=0x7f535006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.673+0000 7f5356215700 1 -- 172.21.15.6:0/2915051663 shutdown_connections 2023-10-06T02:26:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.673+0000 7f5356215700 1 -- 172.21.15.6:0/2915051663 wait complete. 2023-10-06T02:26:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.674+0000 7f5356215700 1 Processor -- start 2023-10-06T02:26:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.674+0000 7f5356215700 1 -- start start 2023-10-06T02:26:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f5356215700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53500cd270 0x7f53500ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f5356215700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53500d0950 0x7f53500c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f5356215700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5350142de0 0x7f53500b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f5356215700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53500aec40 con 0x7f53500cd270 2023-10-06T02:26:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f5356215700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535015b700 con 0x7f53500d0950 2023-10-06T02:26:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f5356215700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535016dbc0 con 0x7f5350142de0 2023-10-06T02:26:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f534f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53500cd270 0x7f53500ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f534f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53500cd270 0x7f53500ae700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57120/0 (socket says 172.21.15.6:57120) 2023-10-06T02:26:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f534f7fe700 1 -- 172.21.15.6:0/1556117936 learned_addr learned my addr 172.21.15.6:0/1556117936 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f534ffff700 1 --2- 172.21.15.6:0/1556117936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5350142de0 0x7f53500b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f534effd700 1 --2- 172.21.15.6:0/1556117936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53500d0950 0x7f53500c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f534f7fe700 1 -- 172.21.15.6:0/1556117936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5350142de0 msgr2=0x7f53500b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f534f7fe700 1 --2- 172.21.15.6:0/1556117936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5350142de0 0x7f53500b14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f534f7fe700 1 -- 172.21.15.6:0/1556117936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53500d0950 msgr2=0x7f53500c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f534f7fe700 1 --2- 172.21.15.6:0/1556117936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53500d0950 0x7f53500c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f534f7fe700 1 -- 172.21.15.6:0/1556117936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53400094f0 con 0x7f53500cd270 2023-10-06T02:26:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f534ffff700 1 --2- 172.21.15.6:0/1556117936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5350142de0 0x7f53500b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f534effd700 1 --2- 172.21.15.6:0/1556117936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53500d0950 0x7f53500c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.675+0000 7f534f7fe700 1 --2- 172.21.15.6:0/1556117936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53500cd270 0x7f53500ae700 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f5340009290 tx=0x7f5340016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.676+0000 7f53377fe700 1 -- 172.21.15.6:0/1556117936 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534000bc40 con 0x7f53500cd270 2023-10-06T02:26:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.676+0000 7f53377fe700 1 -- 172.21.15.6:0/1556117936 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5340020070 con 0x7f53500cd270 2023-10-06T02:26:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.676+0000 7f5356215700 1 -- 172.21.15.6:0/1556117936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535016dea0 con 0x7f53500cd270 2023-10-06T02:26:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.676+0000 7f53377fe700 1 -- 172.21.15.6:0/1556117936 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534001b6a0 con 0x7f53500cd270 2023-10-06T02:26:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.676+0000 7f5356215700 1 -- 172.21.15.6:0/1556117936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535016e460 con 0x7f53500cd270 2023-10-06T02:26:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.677+0000 7f5356215700 1 -- 172.21.15.6:0/1556117936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5350088ac0 con 0x7f53500cd270 2023-10-06T02:26:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.677+0000 7f53377fe700 1 -- 172.21.15.6:0/1556117936 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5340022030 con 0x7f53500cd270 2023-10-06T02:26:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.677+0000 7f53377fe700 1 --2- 172.21.15.6:0/1556117936 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f533c066f30 0x7f533c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.678+0000 7f53377fe700 1 -- 172.21.15.6:0/1556117936 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7668+0+0 (secure 0 0 0) 0x7f5340086d70 con 0x7f53500cd270 2023-10-06T02:26:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.678+0000 7f534effd700 1 --2- 172.21.15.6:0/1556117936 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f533c066f30 0x7f533c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.678+0000 7f534effd700 1 --2- 172.21.15.6:0/1556117936 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f533c066f30 0x7f533c0693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5344006fd0 tx=0x7f5344008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:43.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.682+0000 7f53377fe700 1 -- 172.21.15.6:0/1556117936 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5340053830 con 0x7f53500cd270 2023-10-06T02:26:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.919+0000 7f5356215700 1 -- 172.21.15.6:0/1556117936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5350088ac0 con 0x7f53500cd270 2023-10-06T02:26:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.919+0000 7f53377fe700 1 -- 172.21.15.6:0/1556117936 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 185 v185) v1 ==== 95+0+4592 (secure 0 0 0) 0x7f5340056e50 con 0x7f53500cd270 2023-10-06T02:26:43.921 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:43.921 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":185,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/216641974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":216641974},{"type":"v1","addr":"172.21.15.6:6835","nonce":216641974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":185}],"filesystems":[{"mdsmap":{"epoch":184,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:41.158273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:43.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.921+0000 7f5356215700 1 -- 172.21.15.6:0/1556117936 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f533c066f30 msgr2=0x7f533c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:43.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.921+0000 7f5356215700 1 --2- 172.21.15.6:0/1556117936 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f533c066f30 0x7f533c0693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5344006fd0 tx=0x7f5344008040 comp rx=0 tx=0).stop 2023-10-06T02:26:43.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.921+0000 7f5356215700 1 -- 172.21.15.6:0/1556117936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53500cd270 msgr2=0x7f53500ae700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:43.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.921+0000 7f5356215700 1 --2- 172.21.15.6:0/1556117936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53500cd270 0x7f53500ae700 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f5340009290 tx=0x7f5340016000 comp rx=0 tx=0).stop 2023-10-06T02:26:43.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.921+0000 7f5356215700 1 -- 172.21.15.6:0/1556117936 shutdown_connections 2023-10-06T02:26:43.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.921+0000 7f5356215700 1 --2- 172.21.15.6:0/1556117936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5350142de0 0x7f53500b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:43.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.921+0000 7f5356215700 1 --2- 172.21.15.6:0/1556117936 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f533c066f30 0x7f533c0693e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:43.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.921+0000 7f5356215700 1 --2- 172.21.15.6:0/1556117936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53500cd270 0x7f53500ae700 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:43.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.921+0000 7f5356215700 1 --2- 172.21.15.6:0/1556117936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53500d0950 0x7f53500c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:43.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.921+0000 7f5356215700 1 -- 172.21.15.6:0/1556117936 >> 172.21.15.6:0/1556117936 conn(0x7f5350069110 msgr2=0x7f535015da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:43.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.922+0000 7f5356215700 1 -- 172.21.15.6:0/1556117936 shutdown_connections 2023-10-06T02:26:43.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:43.922+0000 7f5356215700 1 -- 172.21.15.6:0/1556117936 wait complete. 2023-10-06T02:26:43.925 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 185 2023-10-06T02:26:43.935 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:26:43.935 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:44.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.053+0000 7fb09323f700 1 Processor -- start 2023-10-06T02:26:44.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.053+0000 7fb09323f700 1 -- start start 2023-10-06T02:26:44.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.053+0000 7fb09323f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb08c1431b0 0x7fb08c0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:44.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.053+0000 7fb09323f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb08c0d0780 0x7fb08c0b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:44.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.053+0000 7fb09323f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c0cf8a0 con 0x7fb08c142de0 2023-10-06T02:26:44.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.053+0000 7fb09323f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08c0d0bc0 con 0x7fb08c0d0780 2023-10-06T02:26:44.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.053+0000 7fb09323f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0cec90 con 0x7fb08c1431b0 2023-10-06T02:26:44.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.053+0000 7fb0917dc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb08c0d0780 0x7fb08c0b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:44.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.054+0000 7fb0917dc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb08c0d0780 0x7fb08c0b30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57124/0 (socket says 172.21.15.6:57124) 2023-10-06T02:26:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.054+0000 7fb0917dc700 1 -- 172.21.15.6:0/3222046433 learned_addr learned my addr 172.21.15.6:0/3222046433 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.054+0000 7fb08bfff700 1 --2- 172.21.15.6:0/3222046433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb08c1431b0 0x7fb08c0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.054+0000 7fb0917dc700 1 -- 172.21.15.6:0/3222046433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb08c1431b0 msgr2=0x7fb08c0d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.054+0000 7fb0917dc700 1 --2- 172.21.15.6:0/3222046433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb08c1431b0 0x7fb08c0d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.054+0000 7fb0917dc700 1 -- 172.21.15.6:0/3222046433 >> v1:172.21.15.175:6789/0 conn(0x7fb08c142de0 legacy=0x7fb08c0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.054+0000 7fb0917dc700 1 -- 172.21.15.6:0/3222046433 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0cef70 con 0x7fb08c0d0780 2023-10-06T02:26:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.054+0000 7fb08bfff700 1 --2- 172.21.15.6:0/3222046433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb08c1431b0 0x7fb08c0d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.054+0000 7fb0917dc700 1 --2- 172.21.15.6:0/3222046433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb08c0d0780 0x7fb08c0b30f0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fb0740099b0 tx=0x7fb074009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d760a274b51757 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.054+0000 7fb08b7fe700 1 -- 172.21.15.6:0/3222046433 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07400b860 con 0x7fb08c0d0780 2023-10-06T02:26:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.054+0000 7fb08b7fe700 1 -- 172.21.15.6:0/3222046433 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07400b9c0 con 0x7fb08c0d0780 2023-10-06T02:26:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.054+0000 7fb08b7fe700 1 -- 172.21.15.6:0/3222046433 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07400bd60 con 0x7fb08c0d0780 2023-10-06T02:26:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.055+0000 7fb09323f700 1 -- 172.21.15.6:0/3222046433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb08c0d0780 msgr2=0x7fb08c0b30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.055+0000 7fb09323f700 1 --2- 172.21.15.6:0/3222046433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb08c0d0780 0x7fb08c0b30f0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fb0740099b0 tx=0x7fb074009250 comp rx=0 tx=0).stop 2023-10-06T02:26:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.055+0000 7fb09323f700 1 -- 172.21.15.6:0/3222046433 shutdown_connections 2023-10-06T02:26:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.055+0000 7fb09323f700 1 --2- 172.21.15.6:0/3222046433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb08c0d0780 0x7fb08c0b30f0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.055+0000 7fb09323f700 1 --2- 172.21.15.6:0/3222046433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb08c1431b0 0x7fb08c0d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.055+0000 7fb09323f700 1 -- 172.21.15.6:0/3222046433 >> 172.21.15.6:0/3222046433 conn(0x7fb08c069110 msgr2=0x7fb08c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.055+0000 7fb09323f700 1 -- 172.21.15.6:0/3222046433 shutdown_connections 2023-10-06T02:26:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.055+0000 7fb09323f700 1 -- 172.21.15.6:0/3222046433 wait complete. 2023-10-06T02:26:44.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.056+0000 7fb09323f700 1 Processor -- start 2023-10-06T02:26:44.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.056+0000 7fb09323f700 1 -- start start 2023-10-06T02:26:44.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb09323f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb08c0d0780 0x7fb08c0b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:44.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb09323f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb08c142de0 0x7fb08c169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:44.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb09323f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb08c1431b0 0x7fb08c16a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb09323f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c1555a0 con 0x7fb08c0d0780 2023-10-06T02:26:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb09323f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c1595a0 con 0x7fb08c1431b0 2023-10-06T02:26:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb09323f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c16ad90 con 0x7fb08c142de0 2023-10-06T02:26:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb090fdb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb08c0d0780 0x7fb08c0b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb090fdb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb08c0d0780 0x7fb08c0b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57126/0 (socket says 172.21.15.6:57126) 2023-10-06T02:26:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb090fdb700 1 -- 172.21.15.6:0/2339640417 learned_addr learned my addr 172.21.15.6:0/2339640417 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb08bfff700 1 --2- 172.21.15.6:0/2339640417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb08c142de0 0x7fb08c169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb0917dc700 1 --2- 172.21.15.6:0/2339640417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb08c1431b0 0x7fb08c16a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb090fdb700 1 -- 172.21.15.6:0/2339640417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb08c142de0 msgr2=0x7fb08c169ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb090fdb700 1 --2- 172.21.15.6:0/2339640417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb08c142de0 0x7fb08c169ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb090fdb700 1 -- 172.21.15.6:0/2339640417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb08c1431b0 msgr2=0x7fb08c16a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb090fdb700 1 --2- 172.21.15.6:0/2339640417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb08c1431b0 0x7fb08c16a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb090fdb700 1 -- 172.21.15.6:0/2339640417 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0740094f0 con 0x7fb08c0d0780 2023-10-06T02:26:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb08bfff700 1 --2- 172.21.15.6:0/2339640417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb08c142de0 0x7fb08c169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.057+0000 7fb090fdb700 1 --2- 172.21.15.6:0/2339640417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb08c0d0780 0x7fb08c0b0cb0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fb08400c790 tx=0x7fb084007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.058+0000 7fb088ff9700 1 -- 172.21.15.6:0/2339640417 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084011590 con 0x7fb08c0d0780 2023-10-06T02:26:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.058+0000 7fb088ff9700 1 -- 172.21.15.6:0/2339640417 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb084011710 con 0x7fb08c0d0780 2023-10-06T02:26:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.058+0000 7fb09323f700 1 -- 172.21.15.6:0/2339640417 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c16aab0 con 0x7fb08c0d0780 2023-10-06T02:26:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.058+0000 7fb088ff9700 1 -- 172.21.15.6:0/2339640417 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084011ad0 con 0x7fb08c0d0780 2023-10-06T02:26:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.058+0000 7fb09323f700 1 -- 172.21.15.6:0/2339640417 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c16d600 con 0x7fb08c0d0780 2023-10-06T02:26:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.059+0000 7fb09323f700 1 -- 172.21.15.6:0/2339640417 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c088ac0 con 0x7fb08c0d0780 2023-10-06T02:26:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.059+0000 7fb088ff9700 1 -- 172.21.15.6:0/2339640417 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb08401b3b0 con 0x7fb08c0d0780 2023-10-06T02:26:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.059+0000 7fb088ff9700 1 --2- 172.21.15.6:0/2339640417 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb06c066f30 0x7fb06c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.059+0000 7fb088ff9700 1 -- 172.21.15.6:0/2339640417 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7668+0+0 (secure 0 0 0) 0x7fb084084200 con 0x7fb08c0d0780 2023-10-06T02:26:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.060+0000 7fb08bfff700 1 --2- 172.21.15.6:0/2339640417 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb06c066f30 0x7fb06c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.060+0000 7fb08bfff700 1 --2- 172.21.15.6:0/2339640417 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb06c066f30 0x7fb06c0693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb08c158fc0 tx=0x7fb07c0098f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.063+0000 7fb088ff9700 1 -- 172.21.15.6:0/2339640417 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb084050cc0 con 0x7fb08c0d0780 2023-10-06T02:26:44.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.302+0000 7fb09323f700 1 -- 172.21.15.6:0/2339640417 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb08c04bb80 con 0x7fb08c0d0780 2023-10-06T02:26:44.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.302+0000 7fb088ff9700 1 -- 172.21.15.6:0/2339640417 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 185 v185) v1 ==== 95+0+4592 (secure 0 0 0) 0x7fb084017020 con 0x7fb08c0d0780 2023-10-06T02:26:44.304 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:44.304 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":185,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/216641974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":216641974},{"type":"v1","addr":"172.21.15.6:6835","nonce":216641974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":185}],"filesystems":[{"mdsmap":{"epoch":184,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:41.158273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:44.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.305+0000 7fb09323f700 1 -- 172.21.15.6:0/2339640417 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb06c066f30 msgr2=0x7fb06c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:44.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.305+0000 7fb09323f700 1 --2- 172.21.15.6:0/2339640417 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb06c066f30 0x7fb06c0693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb08c158fc0 tx=0x7fb07c0098f0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.305+0000 7fb09323f700 1 -- 172.21.15.6:0/2339640417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb08c0d0780 msgr2=0x7fb08c0b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:44.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.305+0000 7fb09323f700 1 --2- 172.21.15.6:0/2339640417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb08c0d0780 0x7fb08c0b0cb0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fb08400c790 tx=0x7fb084007f40 comp rx=0 tx=0).stop 2023-10-06T02:26:44.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.305+0000 7fb09323f700 1 -- 172.21.15.6:0/2339640417 shutdown_connections 2023-10-06T02:26:44.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.305+0000 7fb09323f700 1 --2- 172.21.15.6:0/2339640417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb08c1431b0 0x7fb08c16a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.305+0000 7fb09323f700 1 --2- 172.21.15.6:0/2339640417 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb06c066f30 0x7fb06c0693e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.305+0000 7fb09323f700 1 --2- 172.21.15.6:0/2339640417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb08c0d0780 0x7fb08c0b0cb0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.305+0000 7fb09323f700 1 --2- 172.21.15.6:0/2339640417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb08c142de0 0x7fb08c169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.305+0000 7fb09323f700 1 -- 172.21.15.6:0/2339640417 >> 172.21.15.6:0/2339640417 conn(0x7fb08c069110 msgr2=0x7fb08c15d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.305+0000 7fb09323f700 1 -- 172.21.15.6:0/2339640417 shutdown_connections 2023-10-06T02:26:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.305+0000 7fb09323f700 1 -- 172.21.15.6:0/2339640417 wait complete. 2023-10-06T02:26:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 185 2023-10-06T02:26:44.318 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:26:44.318 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:44.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.435+0000 7fbb4e870700 1 Processor -- start 2023-10-06T02:26:44.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.435+0000 7fbb4e870700 1 -- start start 2023-10-06T02:26:44.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.436+0000 7fbb4e870700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb480af8b0 0x7fbb4815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:44.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.436+0000 7fbb4e870700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb480b27f0 0x7fbb4815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:44.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.436+0000 7fbb4e870700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb4815e190 con 0x7fbb480af4e0 2023-10-06T02:26:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.436+0000 7fbb4e870700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb480b1910 con 0x7fbb480af8b0 2023-10-06T02:26:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.436+0000 7fbb4e870700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb480cb650 con 0x7fbb480b27f0 2023-10-06T02:26:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.436+0000 7fbb477fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb480af8b0 0x7fbb4815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.436+0000 7fbb47fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbb480af4e0 0x7fbb480b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53012/0 (socket says 172.21.15.6:53012) 2023-10-06T02:26:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.436+0000 7fbb477fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb480af8b0 0x7fbb4815d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57132/0 (socket says 172.21.15.6:57132) 2023-10-06T02:26:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.436+0000 7fbb47fff700 1 -- 172.21.15.6:0/69201686 learned_addr learned my addr 172.21.15.6:0/69201686 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.437+0000 7fbb4ce0d700 1 --2- 172.21.15.6:0/69201686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb480b27f0 0x7fbb4815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.437+0000 7fbb477fe700 1 -- 172.21.15.6:0/69201686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb480b27f0 msgr2=0x7fbb4815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.437+0000 7fbb477fe700 1 --2- 172.21.15.6:0/69201686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb480b27f0 0x7fbb4815d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.437+0000 7fbb477fe700 1 -- 172.21.15.6:0/69201686 >> v1:172.21.15.6:6789/0 conn(0x7fbb480af4e0 legacy=0x7fbb480b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.437+0000 7fbb477fe700 1 -- 172.21.15.6:0/69201686 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb480ccaf0 con 0x7fbb480af8b0 2023-10-06T02:26:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.437+0000 7fbb477fe700 1 --2- 172.21.15.6:0/69201686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb480af8b0 0x7fbb4815d460 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fbb300098e0 tx=0x7fbb300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319646553b6ecb61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.437+0000 7fbb46ffd700 1 -- 172.21.15.6:0/69201686 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb30009e80 con 0x7fbb480af8b0 2023-10-06T02:26:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.437+0000 7fbb46ffd700 1 -- 172.21.15.6:0/69201686 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3000b860 con 0x7fbb480af8b0 2023-10-06T02:26:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.437+0000 7fbb46ffd700 1 -- 172.21.15.6:0/69201686 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3000bbe0 con 0x7fbb480af8b0 2023-10-06T02:26:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.437+0000 7fbb4e870700 1 -- 172.21.15.6:0/69201686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb480af8b0 msgr2=0x7fbb4815d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.437+0000 7fbb4e870700 1 --2- 172.21.15.6:0/69201686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb480af8b0 0x7fbb4815d460 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fbb300098e0 tx=0x7fbb300091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.438+0000 7fbb4e870700 1 -- 172.21.15.6:0/69201686 shutdown_connections 2023-10-06T02:26:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.438+0000 7fbb4e870700 1 --2- 172.21.15.6:0/69201686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb480b27f0 0x7fbb4815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.438+0000 7fbb4e870700 1 --2- 172.21.15.6:0/69201686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb480af8b0 0x7fbb4815d460 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.438+0000 7fbb4e870700 1 -- 172.21.15.6:0/69201686 >> 172.21.15.6:0/69201686 conn(0x7fbb48068680 msgr2=0x7fbb48068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.438+0000 7fbb4e870700 1 -- 172.21.15.6:0/69201686 shutdown_connections 2023-10-06T02:26:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.438+0000 7fbb4e870700 1 -- 172.21.15.6:0/69201686 wait complete. 2023-10-06T02:26:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.439+0000 7fbb4e870700 1 Processor -- start 2023-10-06T02:26:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.439+0000 7fbb4e870700 1 -- start start 2023-10-06T02:26:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb4e870700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb480af4e0 0x7fbb48169a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb4e870700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb480af8b0 0x7fbb480a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb4e870700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb480b27f0 0x7fbb480a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb4e870700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4816a210 con 0x7fbb480af4e0 2023-10-06T02:26:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb4e870700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb480a72e0 con 0x7fbb480b27f0 2023-10-06T02:26:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb4e870700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb480cff30 con 0x7fbb480af8b0 2023-10-06T02:26:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb47fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb480af4e0 0x7fbb48169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb47fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb480af4e0 0x7fbb48169a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57148/0 (socket says 172.21.15.6:57148) 2023-10-06T02:26:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb47fff700 1 -- 172.21.15.6:0/3581992013 learned_addr learned my addr 172.21.15.6:0/3581992013 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb477fe700 1 --2- 172.21.15.6:0/3581992013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb480af8b0 0x7fbb480a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb4ce0d700 1 --2- 172.21.15.6:0/3581992013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb480b27f0 0x7fbb480a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb47fff700 1 -- 172.21.15.6:0/3581992013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb480af8b0 msgr2=0x7fbb480a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb47fff700 1 --2- 172.21.15.6:0/3581992013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb480af8b0 0x7fbb480a94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb47fff700 1 -- 172.21.15.6:0/3581992013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb480b27f0 msgr2=0x7fbb480a99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb47fff700 1 --2- 172.21.15.6:0/3581992013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb480b27f0 0x7fbb480a99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb47fff700 1 -- 172.21.15.6:0/3581992013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb30009420 con 0x7fbb480af4e0 2023-10-06T02:26:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb477fe700 1 --2- 172.21.15.6:0/3581992013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb480af8b0 0x7fbb480a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb4ce0d700 1 --2- 172.21.15.6:0/3581992013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb480b27f0 0x7fbb480a99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb47fff700 1 --2- 172.21.15.6:0/3581992013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb480af4e0 0x7fbb48169a10 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800c590 tx=0x7fbb38007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb3ffff700 1 -- 172.21.15.6:0/3581992013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb38005b30 con 0x7fbb480af4e0 2023-10-06T02:26:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb3ffff700 1 -- 172.21.15.6:0/3581992013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb38005cb0 con 0x7fbb480af4e0 2023-10-06T02:26:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb4e870700 1 -- 172.21.15.6:0/3581992013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb480d0210 con 0x7fbb480af4e0 2023-10-06T02:26:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb3ffff700 1 -- 172.21.15.6:0/3581992013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb38007320 con 0x7fbb480af4e0 2023-10-06T02:26:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.440+0000 7fbb4e870700 1 -- 172.21.15.6:0/3581992013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb480d07d0 con 0x7fbb480af4e0 2023-10-06T02:26:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.441+0000 7fbb4e870700 1 -- 172.21.15.6:0/3581992013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb48088aa0 con 0x7fbb480af4e0 2023-10-06T02:26:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.442+0000 7fbb3ffff700 1 -- 172.21.15.6:0/3581992013 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb3801b3b0 con 0x7fbb480af4e0 2023-10-06T02:26:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.442+0000 7fbb3ffff700 1 --2- 172.21.15.6:0/3581992013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbb28066f30 0x7fbb280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.442+0000 7fbb3ffff700 1 -- 172.21.15.6:0/3581992013 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7668+0+0 (secure 0 0 0) 0x7fbb38084150 con 0x7fbb480af4e0 2023-10-06T02:26:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.442+0000 7fbb477fe700 1 --2- 172.21.15.6:0/3581992013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbb28066f30 0x7fbb280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.443+0000 7fbb477fe700 1 --2- 172.21.15.6:0/3581992013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbb28066f30 0x7fbb280693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbb300098e0 tx=0x7fbb30017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:44.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.446+0000 7fbb3ffff700 1 -- 172.21.15.6:0/3581992013 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb38050c10 con 0x7fbb480af4e0 2023-10-06T02:26:44.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.684+0000 7fbb4e870700 1 -- 172.21.15.6:0/3581992013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb480b0910 con 0x7fbb480af4e0 2023-10-06T02:26:44.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.684+0000 7fbb3ffff700 1 -- 172.21.15.6:0/3581992013 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 185 v185) v1 ==== 95+0+4592 (secure 0 0 0) 0x7fbb38017090 con 0x7fbb480af4e0 2023-10-06T02:26:44.686 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:44.686 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":185,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/216641974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":216641974},{"type":"v1","addr":"172.21.15.6:6835","nonce":216641974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":185}],"filesystems":[{"mdsmap":{"epoch":184,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:41.158273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.686+0000 7fbb4e870700 1 -- 172.21.15.6:0/3581992013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbb28066f30 msgr2=0x7fbb280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.686+0000 7fbb4e870700 1 --2- 172.21.15.6:0/3581992013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbb28066f30 0x7fbb280693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbb300098e0 tx=0x7fbb30017000 comp rx=0 tx=0).stop 2023-10-06T02:26:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.686+0000 7fbb4e870700 1 -- 172.21.15.6:0/3581992013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb480af4e0 msgr2=0x7fbb48169a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.686+0000 7fbb4e870700 1 --2- 172.21.15.6:0/3581992013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb480af4e0 0x7fbb48169a10 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800c590 tx=0x7fbb38007f90 comp rx=0 tx=0).stop 2023-10-06T02:26:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.686+0000 7fbb4e870700 1 -- 172.21.15.6:0/3581992013 shutdown_connections 2023-10-06T02:26:44.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.686+0000 7fbb4e870700 1 --2- 172.21.15.6:0/3581992013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb480b27f0 0x7fbb480a99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.686+0000 7fbb4e870700 1 --2- 172.21.15.6:0/3581992013 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbb28066f30 0x7fbb280693e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.686+0000 7fbb4e870700 1 --2- 172.21.15.6:0/3581992013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb480af4e0 0x7fbb48169a10 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.686+0000 7fbb4e870700 1 --2- 172.21.15.6:0/3581992013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb480af8b0 0x7fbb480a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.686+0000 7fbb4e870700 1 -- 172.21.15.6:0/3581992013 >> 172.21.15.6:0/3581992013 conn(0x7fbb48068680 msgr2=0x7fbb480c9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:44.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.686+0000 7fbb4e870700 1 -- 172.21.15.6:0/3581992013 shutdown_connections 2023-10-06T02:26:44.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.686+0000 7fbb4e870700 1 -- 172.21.15.6:0/3581992013 wait complete. 2023-10-06T02:26:44.689 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 185 2023-10-06T02:26:44.700 INFO:tasks.cephfs.test_damage:Result: Mutation 'Delete 1.00000000' led to DAMAGED state 2023-10-06T02:26:44.700 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 1.00000000.inode' 2023-10-06T02:26:44.700 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:44.700 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:26:44.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:44.701 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:26:44.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:26:44.715 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:26:44.715 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:26:44.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.873+0000 7fad2085a700 1 Processor -- start 2023-10-06T02:26:44.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.873+0000 7fad2085a700 1 -- start start 2023-10-06T02:26:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.874+0000 7fad2085a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fad1c0c3fd0 0x7fad1c0c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.874+0000 7fad2085a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1c0c3b40 con 0x7fad1c0cbcc0 2023-10-06T02:26:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.874+0000 7fad2085a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1c0c2f30 con 0x7fad1c1574b0 2023-10-06T02:26:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.874+0000 7fad2085a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1c0c4980 con 0x7fad1c0c3fd0 2023-10-06T02:26:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.874+0000 7fad19d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fad1c0c3fd0 0x7fad1c0c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.874+0000 7fad19d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fad1c0c3fd0 0x7fad1c0c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57164/0 (socket says 172.21.15.6:57164) 2023-10-06T02:26:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.874+0000 7fad1ad9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fad1c0cbcc0 0x7fad1c0c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53020/0 (socket says 172.21.15.6:53020) 2023-10-06T02:26:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.874+0000 7fad19d9b700 1 -- 172.21.15.6:0/749429723 learned_addr learned my addr 172.21.15.6:0/749429723 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.875+0000 7fad19d9b700 1 -- 172.21.15.6:0/749429723 >> v1:172.21.15.175:6789/0 conn(0x7fad1c1574b0 legacy=0x7fad1c0b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.875+0000 7fad19d9b700 1 -- 172.21.15.6:0/749429723 >> v1:172.21.15.6:6789/0 conn(0x7fad1c0cbcc0 legacy=0x7fad1c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.875+0000 7fad19d9b700 1 -- 172.21.15.6:0/749429723 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c0c3210 con 0x7fad1c0c3fd0 2023-10-06T02:26:44.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.875+0000 7fad19d9b700 1 --2- 172.21.15.6:0/749429723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0c3fd0 0x7fad1c0c4440 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fad040099b0 tx=0x7fad04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55575bbcdf3399c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:44.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.875+0000 7fad1959a700 1 -- 172.21.15.6:0/749429723 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0400b860 con 0x7fad1c0c3fd0 2023-10-06T02:26:44.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.875+0000 7fad1959a700 1 -- 172.21.15.6:0/749429723 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0400b9c0 con 0x7fad1c0c3fd0 2023-10-06T02:26:44.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.875+0000 7fad1959a700 1 -- 172.21.15.6:0/749429723 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0400bd60 con 0x7fad1c0c3fd0 2023-10-06T02:26:44.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.876+0000 7fad2085a700 1 -- 172.21.15.6:0/749429723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0c3fd0 msgr2=0x7fad1c0c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:44.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.876+0000 7fad2085a700 1 --2- 172.21.15.6:0/749429723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0c3fd0 0x7fad1c0c4440 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fad040099b0 tx=0x7fad04009250 comp rx=0 tx=0).stop 2023-10-06T02:26:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.876+0000 7fad2085a700 1 -- 172.21.15.6:0/749429723 shutdown_connections 2023-10-06T02:26:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.876+0000 7fad2085a700 1 --2- 172.21.15.6:0/749429723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0c3fd0 0x7fad1c0c4440 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.876+0000 7fad2085a700 1 -- 172.21.15.6:0/749429723 >> 172.21.15.6:0/749429723 conn(0x7fad1c067910 msgr2=0x7fad1c0ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.876+0000 7fad2085a700 1 -- 172.21.15.6:0/749429723 shutdown_connections 2023-10-06T02:26:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.876+0000 7fad2085a700 1 -- 172.21.15.6:0/749429723 wait complete. 2023-10-06T02:26:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.877+0000 7fad2085a700 1 Processor -- start 2023-10-06T02:26:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.877+0000 7fad2085a700 1 -- start start 2023-10-06T02:26:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad2085a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0c3fd0 0x7fad1c0b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad2085a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad1c0cbcc0 0x7fad1c0b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad2085a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad1c1574b0 0x7fad1c144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad2085a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0c5be0 con 0x7fad1c0c3fd0 2023-10-06T02:26:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad2085a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0b3860 con 0x7fad1c1574b0 2023-10-06T02:26:44.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad2085a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0c52b0 con 0x7fad1c0cbcc0 2023-10-06T02:26:44.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad1a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0c3fd0 0x7fad1c0b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:44.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad1a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0c3fd0 0x7fad1c0b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57178/0 (socket says 172.21.15.6:57178) 2023-10-06T02:26:44.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad1a59c700 1 -- 172.21.15.6:0/4243147814 learned_addr learned my addr 172.21.15.6:0/4243147814 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:44.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad1ad9d700 1 --2- 172.21.15.6:0/4243147814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad1c1574b0 0x7fad1c144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:44.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad19d9b700 1 --2- 172.21.15.6:0/4243147814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad1c0cbcc0 0x7fad1c0b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:44.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad1a59c700 1 -- 172.21.15.6:0/4243147814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad1c0cbcc0 msgr2=0x7fad1c0b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:44.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad1a59c700 1 --2- 172.21.15.6:0/4243147814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad1c0cbcc0 0x7fad1c0b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad1a59c700 1 -- 172.21.15.6:0/4243147814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad1c1574b0 msgr2=0x7fad1c144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:44.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad1a59c700 1 --2- 172.21.15.6:0/4243147814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad1c1574b0 0x7fad1c144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad1a59c700 1 -- 172.21.15.6:0/4243147814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040094f0 con 0x7fad1c0c3fd0 2023-10-06T02:26:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad1ad9d700 1 --2- 172.21.15.6:0/4243147814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad1c1574b0 0x7fad1c144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad1a59c700 1 --2- 172.21.15.6:0/4243147814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0c3fd0 0x7fad1c0b1b80 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fad1400bc60 tx=0x7fad14009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad127fc700 1 -- 172.21.15.6:0/4243147814 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1400c9c0 con 0x7fad1c0c3fd0 2023-10-06T02:26:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad127fc700 1 -- 172.21.15.6:0/4243147814 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1400cb60 con 0x7fad1c0c3fd0 2023-10-06T02:26:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad2085a700 1 -- 172.21.15.6:0/4243147814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1c0c5590 con 0x7fad1c0c3fd0 2023-10-06T02:26:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad127fc700 1 -- 172.21.15.6:0/4243147814 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad14014410 con 0x7fad1c0c3fd0 2023-10-06T02:26:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.878+0000 7fad2085a700 1 -- 172.21.15.6:0/4243147814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1c0b3570 con 0x7fad1c0c3fd0 2023-10-06T02:26:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.879+0000 7fad2085a700 1 -- 172.21.15.6:0/4243147814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1c06e590 con 0x7fad1c0c3fd0 2023-10-06T02:26:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.880+0000 7fad127fc700 1 -- 172.21.15.6:0/4243147814 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad14014800 con 0x7fad1c0c3fd0 2023-10-06T02:26:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.880+0000 7fad127fc700 1 --2- 172.21.15.6:0/4243147814 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7facfc066f60 0x7facfc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.880+0000 7fad127fc700 1 -- 172.21.15.6:0/4243147814 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7668+0+0 (secure 0 0 0) 0x7fad14084ed0 con 0x7fad1c0c3fd0 2023-10-06T02:26:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.880+0000 7fad19d9b700 1 --2- 172.21.15.6:0/4243147814 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7facfc066f60 0x7facfc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.881+0000 7fad19d9b700 1 --2- 172.21.15.6:0/4243147814 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7facfc066f60 0x7facfc069410 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fad040099b0 tx=0x7fad04016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:44.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:44.884+0000 7fad127fc700 1 -- 172.21.15.6:0/4243147814 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad14051990 con 0x7fad1c0c3fd0 2023-10-06T02:26:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.121+0000 7fad2085a700 1 -- 172.21.15.6:0/4243147814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fad1c0c34f0 con 0x7fad1c0c3fd0 2023-10-06T02:26:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.831+0000 7fad127fc700 1 -- 172.21.15.6:0/4243147814 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v186) v1 ==== 161+0+0 (secure 0 0 0) 0x7fad14054fb0 con 0x7fad1c0c3fd0 2023-10-06T02:26:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.834+0000 7fad2085a700 1 -- 172.21.15.6:0/4243147814 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7facfc066f60 msgr2=0x7facfc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.834+0000 7fad2085a700 1 --2- 172.21.15.6:0/4243147814 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7facfc066f60 0x7facfc069410 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fad040099b0 tx=0x7fad04016000 comp rx=0 tx=0).stop 2023-10-06T02:26:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.834+0000 7fad2085a700 1 -- 172.21.15.6:0/4243147814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0c3fd0 msgr2=0x7fad1c0b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.834+0000 7fad2085a700 1 --2- 172.21.15.6:0/4243147814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0c3fd0 0x7fad1c0b1b80 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fad1400bc60 tx=0x7fad14009820 comp rx=0 tx=0).stop 2023-10-06T02:26:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.834+0000 7fad2085a700 1 -- 172.21.15.6:0/4243147814 shutdown_connections 2023-10-06T02:26:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.834+0000 7fad2085a700 1 --2- 172.21.15.6:0/4243147814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad1c1574b0 0x7fad1c144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.834+0000 7fad2085a700 1 --2- 172.21.15.6:0/4243147814 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7facfc066f60 0x7facfc069410 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.834+0000 7fad2085a700 1 --2- 172.21.15.6:0/4243147814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0c3fd0 0x7fad1c0b1b80 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.834+0000 7fad2085a700 1 --2- 172.21.15.6:0/4243147814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad1c0cbcc0 0x7fad1c0b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:45.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.834+0000 7fad2085a700 1 -- 172.21.15.6:0/4243147814 >> 172.21.15.6:0/4243147814 conn(0x7fad1c067910 msgr2=0x7fad1c155870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:45.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.834+0000 7fad2085a700 1 -- 172.21.15.6:0/4243147814 shutdown_connections 2023-10-06T02:26:45.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.834+0000 7fad2085a700 1 -- 172.21.15.6:0/4243147814 wait complete. 2023-10-06T02:26:45.837 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:26:45.850 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:26:45.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.975+0000 7f0cf19ee700 1 Processor -- start 2023-10-06T02:26:45.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.975+0000 7f0cf19ee700 1 -- start start 2023-10-06T02:26:45.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.976+0000 7f0cf19ee700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0cec153b70 0x7f0cec15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:45.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.976+0000 7f0cf19ee700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cec0cb920 0x7f0cec15a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:45.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.976+0000 7f0cf19ee700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cec0ce7b0 con 0x7f0cec153f40 2023-10-06T02:26:45.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.976+0000 7f0cf19ee700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cec15e350 con 0x7f0cec153b70 2023-10-06T02:26:45.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.976+0000 7f0cf19ee700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec15adb0 con 0x7f0cec0cb920 2023-10-06T02:26:45.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.976+0000 7f0ceb7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cec0cb920 0x7f0cec15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:45.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.976+0000 7f0ceaffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0cec153b70 0x7f0cec15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:45.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.977+0000 7f0ceb7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cec0cb920 0x7f0cec15a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:38396/0 (socket says 172.21.15.6:38396) 2023-10-06T02:26:45.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.977+0000 7f0ceaffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0cec153b70 0x7f0cec15d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:37748/0 (socket says 172.21.15.6:37748) 2023-10-06T02:26:45.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.977+0000 7f0ceb7fe700 1 -- 172.21.15.6:0/2167951067 learned_addr learned my addr 172.21.15.6:0/2167951067 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:45.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.977+0000 7f0cea7fc700 1 --1- 172.21.15.6:0/2167951067 >> v1:172.21.15.175:6789/0 conn(0x7f0cec153f40 0x7f0cec0cb210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:52606/0 (socket says 172.21.15.6:52606) 2023-10-06T02:26:45.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.977+0000 7f0ce9ffb700 1 -- 172.21.15.6:0/2167951067 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469432958 0 0) 0x7f0cec0ce7b0 con 0x7f0cec153f40 2023-10-06T02:26:45.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.977+0000 7f0ce9ffb700 1 -- 172.21.15.6:0/2167951067 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cd8003570 con 0x7f0cec153f40 2023-10-06T02:26:45.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.977+0000 7f0ceaffd700 1 -- 172.21.15.6:0/2167951067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cec0cb920 msgr2=0x7f0cec15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:45.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.977+0000 7f0ceaffd700 1 --2- 172.21.15.6:0/2167951067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cec0cb920 0x7f0cec15a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:45.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.977+0000 7f0ceaffd700 1 -- 172.21.15.6:0/2167951067 >> v1:172.21.15.175:6789/0 conn(0x7f0cec153f40 legacy=0x7f0cec0cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:45.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.977+0000 7f0ceaffd700 1 -- 172.21.15.6:0/2167951067 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec15dab0 con 0x7f0cec153b70 2023-10-06T02:26:45.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.977+0000 7f0ceb7fe700 1 --2- 172.21.15.6:0/2167951067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cec0cb920 0x7f0cec15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:26:45.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.977+0000 7f0ceaffd700 1 --2- 172.21.15.6:0/2167951067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec153b70 0x7f0cec15d3b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009910 tx=0x7f0ce40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b8673fd0238be7d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:45.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.977+0000 7f0ce9ffb700 1 -- 172.21.15.6:0/2167951067 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4011630 con 0x7f0cec153b70 2023-10-06T02:26:45.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.977+0000 7f0ce9ffb700 1 -- 172.21.15.6:0/2167951067 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce4011790 con 0x7f0cec153b70 2023-10-06T02:26:45.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.977+0000 7f0ce9ffb700 1 -- 172.21.15.6:0/2167951067 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4011b30 con 0x7f0cec153b70 2023-10-06T02:26:45.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.978+0000 7f0cf19ee700 1 -- 172.21.15.6:0/2167951067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec153b70 msgr2=0x7f0cec15d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:45.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.978+0000 7f0cf19ee700 1 --2- 172.21.15.6:0/2167951067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec153b70 0x7f0cec15d3b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009910 tx=0x7f0ce40091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:45.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.978+0000 7f0cf19ee700 1 -- 172.21.15.6:0/2167951067 shutdown_connections 2023-10-06T02:26:45.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.978+0000 7f0cf19ee700 1 --2- 172.21.15.6:0/2167951067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cec0cb920 0x7f0cec15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:45.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.978+0000 7f0cf19ee700 1 --2- 172.21.15.6:0/2167951067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec153b70 0x7f0cec15d3b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:45.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.978+0000 7f0cf19ee700 1 -- 172.21.15.6:0/2167951067 >> 172.21.15.6:0/2167951067 conn(0x7f0cec068680 msgr2=0x7f0cec068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:45.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.978+0000 7f0cf19ee700 1 -- 172.21.15.6:0/2167951067 shutdown_connections 2023-10-06T02:26:45.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.978+0000 7f0cf19ee700 1 -- 172.21.15.6:0/2167951067 wait complete. 2023-10-06T02:26:45.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.979+0000 7f0cf19ee700 1 Processor -- start 2023-10-06T02:26:45.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.979+0000 7f0cf19ee700 1 -- start start 2023-10-06T02:26:45.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.980+0000 7f0cf19ee700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec0cb920 0x7f0cec0b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:45.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.980+0000 7f0cf19ee700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cec153b70 0x7f0cec0cee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:45.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.980+0000 7f0cf19ee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cec153f40 0x7f0cec1588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:45.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.980+0000 7f0cf19ee700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0b5220 con 0x7f0cec153f40 2023-10-06T02:26:45.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.980+0000 7f0cf19ee700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0b5500 con 0x7f0cec0cb920 2023-10-06T02:26:45.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.980+0000 7f0cf19ee700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0b57e0 con 0x7f0cec153b70 2023-10-06T02:26:45.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.980+0000 7f0ceb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cec153f40 0x7f0cec1588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:45.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.980+0000 7f0ceb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cec153f40 0x7f0cec1588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57188/0 (socket says 172.21.15.6:57188) 2023-10-06T02:26:45.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.980+0000 7f0ceb7fe700 1 -- 172.21.15.6:0/106911046 learned_addr learned my addr 172.21.15.6:0/106911046 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:45.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.980+0000 7f0ceaffd700 1 --2- 172.21.15.6:0/106911046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec0cb920 0x7f0cec0b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:45.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.980+0000 7f0cea7fc700 1 --2- 172.21.15.6:0/106911046 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cec153b70 0x7f0cec0cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:45.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.980+0000 7f0ceb7fe700 1 -- 172.21.15.6:0/106911046 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cec153b70 msgr2=0x7f0cec0cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:45.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.980+0000 7f0ceb7fe700 1 --2- 172.21.15.6:0/106911046 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cec153b70 0x7f0cec0cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:45.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.980+0000 7f0ceb7fe700 1 -- 172.21.15.6:0/106911046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec0cb920 msgr2=0x7f0cec0b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:45.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.980+0000 7f0ceb7fe700 1 --2- 172.21.15.6:0/106911046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec0cb920 0x7f0cec0b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:45.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.980+0000 7f0ceb7fe700 1 -- 172.21.15.6:0/106911046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc009ae0 con 0x7f0cec153f40 2023-10-06T02:26:45.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.981+0000 7f0ceb7fe700 1 --2- 172.21.15.6:0/106911046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cec153f40 0x7f0cec1588c0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009fd0 tx=0x7f0cdc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:45.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.981+0000 7f0ce2ffd700 1 -- 172.21.15.6:0/106911046 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc018070 con 0x7f0cec153f40 2023-10-06T02:26:45.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.981+0000 7f0ce2ffd700 1 -- 172.21.15.6:0/106911046 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc00f040 con 0x7f0cec153f40 2023-10-06T02:26:45.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.981+0000 7f0ce2ffd700 1 -- 172.21.15.6:0/106911046 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00cbd0 con 0x7f0cec153f40 2023-10-06T02:26:45.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.981+0000 7f0cf19ee700 1 -- 172.21.15.6:0/106911046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce4009420 con 0x7f0cec153f40 2023-10-06T02:26:45.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.981+0000 7f0cf19ee700 1 -- 172.21.15.6:0/106911046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cec0b5da0 con 0x7f0cec153f40 2023-10-06T02:26:45.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.982+0000 7f0cf19ee700 1 -- 172.21.15.6:0/106911046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cec088980 con 0x7f0cec153f40 2023-10-06T02:26:45.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.982+0000 7f0ce2ffd700 1 -- 172.21.15.6:0/106911046 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0cdc003020 con 0x7f0cec153f40 2023-10-06T02:26:45.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.982+0000 7f0ce2ffd700 1 --2- 172.21.15.6:0/106911046 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ccc066f30 0x7f0ccc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:45.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.983+0000 7f0ce2ffd700 1 -- 172.21.15.6:0/106911046 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7668+0+0 (secure 0 0 0) 0x7f0cdc085130 con 0x7f0cec153f40 2023-10-06T02:26:45.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.983+0000 7f0ceaffd700 1 --2- 172.21.15.6:0/106911046 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ccc066f30 0x7f0ccc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:45.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.983+0000 7f0ceaffd700 1 --2- 172.21.15.6:0/106911046 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ccc066f30 0x7f0ccc0693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009860 tx=0x7f0ce4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:45.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:45.987+0000 7f0ce2ffd700 1 -- 172.21.15.6:0/106911046 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0cdc051bf0 con 0x7f0cec153f40 2023-10-06T02:26:46.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.263+0000 7f0cf19ee700 1 -- 172.21.15.6:0/106911046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f0cec068420 con 0x7f0cec153f40 2023-10-06T02:26:46.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.839+0000 7f0ce2ffd700 1 -- 172.21.15.6:0/106911046 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v187) v1 ==== 101+0+0 (secure 0 0 0) 0x7f0cdc055210 con 0x7f0cec153f40 2023-10-06T02:26:46.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.841+0000 7f0cf19ee700 1 -- 172.21.15.6:0/106911046 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ccc066f30 msgr2=0x7f0ccc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:46.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.841+0000 7f0cf19ee700 1 --2- 172.21.15.6:0/106911046 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ccc066f30 0x7f0ccc0693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009860 tx=0x7f0ce4017000 comp rx=0 tx=0).stop 2023-10-06T02:26:46.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.841+0000 7f0cf19ee700 1 -- 172.21.15.6:0/106911046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cec153f40 msgr2=0x7f0cec1588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:46.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.841+0000 7f0cf19ee700 1 --2- 172.21.15.6:0/106911046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cec153f40 0x7f0cec1588c0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009fd0 tx=0x7f0cdc00b040 comp rx=0 tx=0).stop 2023-10-06T02:26:46.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.841+0000 7f0cf19ee700 1 -- 172.21.15.6:0/106911046 shutdown_connections 2023-10-06T02:26:46.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.841+0000 7f0cf19ee700 1 --2- 172.21.15.6:0/106911046 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0ccc066f30 0x7f0ccc0693e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.841+0000 7f0cf19ee700 1 --2- 172.21.15.6:0/106911046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cec153f40 0x7f0cec1588c0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.841+0000 7f0cf19ee700 1 --2- 172.21.15.6:0/106911046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec0cb920 0x7f0cec0b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.841+0000 7f0cf19ee700 1 --2- 172.21.15.6:0/106911046 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cec153b70 0x7f0cec0cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.841+0000 7f0cf19ee700 1 -- 172.21.15.6:0/106911046 >> 172.21.15.6:0/106911046 conn(0x7f0cec068680 msgr2=0x7f0cec0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.841+0000 7f0cf19ee700 1 -- 172.21.15.6:0/106911046 shutdown_connections 2023-10-06T02:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.841+0000 7f0cf19ee700 1 -- 172.21.15.6:0/106911046 wait complete. 2023-10-06T02:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:26:46.857 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:26:46.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.895+0000 7f14a2a7c000 1 Processor -- start 2023-10-06T02:26:46.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.895+0000 7f14a2a7c000 1 -- start start 2023-10-06T02:26:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.896+0000 7f14a2a7c000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603be7f9410 0x5603be7f73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.896+0000 7f14a2a7c000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603be7f9810 0x5603be7e0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.896+0000 7f14a2a7c000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5603be888f90 0x5603be880db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.896+0000 7f14a2a7c000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603be6fd980 con 0x5603be7f9810 2023-10-06T02:26:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.896+0000 7f14a2a7c000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603be6fd620 con 0x5603be7f9410 2023-10-06T02:26:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.896+0000 7f14a2a7c000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5603be6f4400 con 0x5603be888f90 2023-10-06T02:26:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.896+0000 7f149b4b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603be7f9810 0x5603be7e0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.896+0000 7f149b4b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603be7f9810 0x5603be7e0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57202/0 (socket says 172.21.15.6:57202) 2023-10-06T02:26:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.896+0000 7f149b4b6700 1 -- 172.21.15.6:0/1443738917 learned_addr learned my addr 172.21.15.6:0/1443738917 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.896+0000 7f149bcb7700 1 --2- 172.21.15.6:0/1443738917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603be7f9410 0x5603be7f73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.896+0000 7f149b4b6700 1 -- 172.21.15.6:0/1443738917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5603be888f90 msgr2=0x5603be880db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.896+0000 7f149b4b6700 1 --2- 172.21.15.6:0/1443738917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5603be888f90 0x5603be880db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.896+0000 7f149b4b6700 1 -- 172.21.15.6:0/1443738917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603be7f9410 msgr2=0x5603be7f73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.896+0000 7f149b4b6700 1 --2- 172.21.15.6:0/1443738917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603be7f9410 0x5603be7f73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.896+0000 7f149b4b6700 1 -- 172.21.15.6:0/1443738917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1484005db0 con 0x5603be7f9810 2023-10-06T02:26:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.896+0000 7f149bcb7700 1 --2- 172.21.15.6:0/1443738917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603be7f9410 0x5603be7f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.897+0000 7f149b4b6700 1 --2- 172.21.15.6:0/1443738917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603be7f9810 0x5603be7e0a20 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f148400ad70 tx=0x7f1484016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a81a2f45fdd8b33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.897+0000 7f149a4b4700 1 -- 172.21.15.6:0/1443738917 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484000bc0 con 0x5603be7f9810 2023-10-06T02:26:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.897+0000 7f149a4b4700 1 -- 172.21.15.6:0/1443738917 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1484020070 con 0x5603be7f9810 2023-10-06T02:26:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.897+0000 7f149a4b4700 1 -- 172.21.15.6:0/1443738917 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484008c20 con 0x5603be7f9810 2023-10-06T02:26:46.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.897+0000 7f14a2a7c000 1 -- 172.21.15.6:0/1443738917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603be7f9810 msgr2=0x5603be7e0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:46.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.897+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/1443738917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603be7f9810 0x5603be7e0a20 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f148400ad70 tx=0x7f1484016000 comp rx=0 tx=0).stop 2023-10-06T02:26:46.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.897+0000 7f14a2a7c000 1 -- 172.21.15.6:0/1443738917 shutdown_connections 2023-10-06T02:26:46.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.897+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/1443738917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5603be888f90 0x5603be880db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:46.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.897+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/1443738917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603be7f9410 0x5603be7f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:46.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.897+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/1443738917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603be7f9810 0x5603be7e0a20 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:46.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.897+0000 7f14a2a7c000 1 -- 172.21.15.6:0/1443738917 >> 172.21.15.6:0/1443738917 conn(0x5603be7b2d50 msgr2=0x5603be889360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:46.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.897+0000 7f14a2a7c000 1 -- 172.21.15.6:0/1443738917 shutdown_connections 2023-10-06T02:26:46.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.897+0000 7f14a2a7c000 1 -- 172.21.15.6:0/1443738917 wait complete. 2023-10-06T02:26:46.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.898+0000 7f14a2a7c000 1 Processor -- start 2023-10-06T02:26:46.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.898+0000 7f14a2a7c000 1 -- start start 2023-10-06T02:26:46.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.899+0000 7f14a2a7c000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5603be7f9410 0x5603be87f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:46.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.899+0000 7f14a2a7c000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603be7f9810 0x5603be7b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:46.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.899+0000 7f14a2a7c000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603be888f90 0x5603be7b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:46.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.899+0000 7f14a2a7c000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603be87fbb0 con 0x5603be7f9810 2023-10-06T02:26:46.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.899+0000 7f14a2a7c000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603be883e60 con 0x5603be888f90 2023-10-06T02:26:46.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.899+0000 7f14a2a7c000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5603be884100 con 0x5603be7f9410 2023-10-06T02:26:46.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.899+0000 7f149b4b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603be7f9810 0x5603be7b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:46.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.899+0000 7f149b4b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603be7f9810 0x5603be7b4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57216/0 (socket says 172.21.15.6:57216) 2023-10-06T02:26:46.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.899+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 learned_addr learned my addr 172.21.15.6:0/453577546 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:46.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.899+0000 7f149bcb7700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5603be7f9410 0x5603be87f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:46.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.899+0000 7f149c4b8700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603be888f90 0x5603be7b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:46.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.899+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5603be7f9410 msgr2=0x5603be87f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:46.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.899+0000 7f149b4b6700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5603be7f9410 0x5603be87f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:46.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.899+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603be888f90 msgr2=0x5603be7b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:46.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.899+0000 7f149b4b6700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603be888f90 0x5603be7b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:46.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.899+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603be7261c0 con 0x5603be7f9810 2023-10-06T02:26:46.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.900+0000 7f149b4b6700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603be7f9810 0x5603be7b4ba0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f1484005b50 tx=0x7f148401e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:46.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.900+0000 7f1498cb1700 1 -- 172.21.15.6:0/453577546 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148400a250 con 0x5603be7f9810 2023-10-06T02:26:46.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.900+0000 7f1498cb1700 1 -- 172.21.15.6:0/453577546 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1484027690 con 0x5603be7f9810 2023-10-06T02:26:46.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.900+0000 7f1498cb1700 1 -- 172.21.15.6:0/453577546 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484027a50 con 0x5603be7f9810 2023-10-06T02:26:46.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.900+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5603be70c3d0 con 0x5603be7f9810 2023-10-06T02:26:46.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.900+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5603be6ffae0 con 0x5603be7f9810 2023-10-06T02:26:46.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.901+0000 7f1498cb1700 1 -- 172.21.15.6:0/453577546 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1484039440 con 0x5603be7f9810 2023-10-06T02:26:46.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.901+0000 7f1498cb1700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f147c065890 0x7f147c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:46.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.902+0000 7f1498cb1700 1 -- 172.21.15.6:0/453577546 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7668+0+0 (secure 0 0 0) 0x7f1484022070 con 0x5603be7f9810 2023-10-06T02:26:46.908 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:26:46.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.902+0000 7f149bcb7700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f147c065890 0x7f147c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:46.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.902+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5603be899890 0x5603be899c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:46.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.902+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be89a1a0 con 0x5603be899890 2023-10-06T02:26:46.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.902+0000 7f149c4b8700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5603be899890 0x5603be899c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:46.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.902+0000 7f149bcb7700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f147c065890 0x7f147c067d40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1494000c00 tx=0x7f1494001720 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:46.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.902+0000 7f149c4b8700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5603be899890 0x5603be899c60 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:46.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.904+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v110'443 uv417 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.904+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be89a580 con 0x5603be899890 2023-10-06T02:26:46.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.905+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v110'444 uv444 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.905+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a5f30 con 0x5603be899890 2023-10-06T02:26:46.910 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:26:46.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.907+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v110'445 uv445 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.907+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a72f0 con 0x5603be899890 2023-10-06T02:26:46.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.908+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v110'446 uv446 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.908+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a76a0 con 0x5603be899890 2023-10-06T02:26:46.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.909+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v110'447 uv447 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.909+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a62e0 con 0x5603be899890 2023-10-06T02:26:46.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.910+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v110'448 uv448 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.910+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6710 con 0x5603be899890 2023-10-06T02:26:46.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.911+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v110'449 uv423 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.911+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6b10 con 0x5603be899890 2023-10-06T02:26:46.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.913+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v110'450 uv450 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.913+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6b10 con 0x5603be899890 2023-10-06T02:26:46.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.914+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v110'451 uv451 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.916 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:26:46.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.914+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6f10 con 0x5603be899890 2023-10-06T02:26:46.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.915+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v110'452 uv452 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.915+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6f10 con 0x5603be899890 2023-10-06T02:26:46.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.916+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v110'453 uv453 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.916+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6ac0 con 0x5603be899890 2023-10-06T02:26:46.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.917+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v110'454 uv454 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.917+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6ac0 con 0x5603be899890 2023-10-06T02:26:46.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.918+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v110'455 uv430 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.918+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6ac0 con 0x5603be899890 2023-10-06T02:26:46.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.920+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v110'456 uv456 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.920+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6ac0 con 0x5603be899890 2023-10-06T02:26:46.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.921+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v110'457 uv457 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.922 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:26:46.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.921+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6ac0 con 0x5603be899890 2023-10-06T02:26:46.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.922+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v110'458 uv458 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.922+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6ac0 con 0x5603be899890 2023-10-06T02:26:46.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.923+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v110'459 uv459 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.923+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6ac0 con 0x5603be899890 2023-10-06T02:26:46.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.924+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v110'460 uv460 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.924+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6e90 con 0x5603be899890 2023-10-06T02:26:46.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.925+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v110'461 uv461 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.925+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6e90 con 0x5603be899890 2023-10-06T02:26:46.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.926+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v110'462 uv436 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.926+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6d30 con 0x5603be899890 2023-10-06T02:26:46.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.928+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v110'463 uv463 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.928+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6d30 con 0x5603be899890 2023-10-06T02:26:46.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.929+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v110'464 uv464 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.930 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:26:46.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.929+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6d30 con 0x5603be899890 2023-10-06T02:26:46.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.930+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v110'465 uv465 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.930+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6d30 con 0x5603be899890 2023-10-06T02:26:46.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.931+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v110'466 uv466 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.931+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6d30 con 0x5603be899890 2023-10-06T02:26:46.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.932+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v110'467 uv467 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.932+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6d30 con 0x5603be899890 2023-10-06T02:26:46.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.933+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v110'468 uv442 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.933+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6d30 con 0x5603be899890 2023-10-06T02:26:46.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.935+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v110'469 uv469 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.935+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6d30 con 0x5603be899890 2023-10-06T02:26:46.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.936+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v110'470 uv470 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.937 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:26:46.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.936+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6d30 con 0x5603be899890 2023-10-06T02:26:46.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.937+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v110'471 uv471 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.937+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6d30 con 0x5603be899890 2023-10-06T02:26:46.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.938+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v110'472 uv472 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.938+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6d30 con 0x5603be899890 2023-10-06T02:26:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.939+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v110'473 uv473 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be899890 2023-10-06T02:26:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.939+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5603be8a7f60 0x5603be8aa340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.939+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8a6d30 con 0x5603be8a7f60 2023-10-06T02:26:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.940+0000 7f149bcb7700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5603be8a7f60 0x5603be8aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.940+0000 7f149bcb7700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5603be8a7f60 0x5603be8aa340 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:46.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.941+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v110'325 uv307 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.941+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8aa880 con 0x5603be8a7f60 2023-10-06T02:26:46.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.942+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v110'326 uv326 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.942+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8aac30 con 0x5603be8a7f60 2023-10-06T02:26:46.945 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:26:46.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.943+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v110'327 uv327 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.943+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8ab4d0 con 0x5603be8a7f60 2023-10-06T02:26:46.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.946+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v110'328 uv328 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.946+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8ab880 con 0x5603be8a7f60 2023-10-06T02:26:46.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.952+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v110'329 uv329 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.952+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8abc30 con 0x5603be8a7f60 2023-10-06T02:26:46.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.953+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v110'330 uv312 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.953+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8abfe0 con 0x5603be8a7f60 2023-10-06T02:26:46.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.955+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v110'331 uv331 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.955+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8ac390 con 0x5603be8a7f60 2023-10-06T02:26:46.959 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:26:46.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.958+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v110'332 uv332 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.958+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8ac390 con 0x5603be8a7f60 2023-10-06T02:26:46.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.960+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v110'333 uv333 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.960+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8ac390 con 0x5603be8a7f60 2023-10-06T02:26:46.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.961+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v110'334 uv334 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.961+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8ac390 con 0x5603be8a7f60 2023-10-06T02:26:46.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.962+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v110'335 uv317 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.963+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8ac390 con 0x5603be8a7f60 2023-10-06T02:26:46.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.964+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v110'336 uv336 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.964+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8ac390 con 0x5603be8a7f60 2023-10-06T02:26:46.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.965+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v110'337 uv337 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.966 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:26:46.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.965+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8afab0 con 0x5603be8a7f60 2023-10-06T02:26:46.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.966+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v110'338 uv338 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.966+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8afab0 con 0x5603be8a7f60 2023-10-06T02:26:46.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.967+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v110'339 uv339 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.967+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8ac390 con 0x5603be8a7f60 2023-10-06T02:26:46.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.968+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v110'340 uv323 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.968+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8ac390 con 0x5603be8a7f60 2023-10-06T02:26:46.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.969+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v110'341 uv341 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.969+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8ac390 con 0x5603be8a7f60 2023-10-06T02:26:46.971 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:26:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.970+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v110'342 uv342 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.970+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8ad3a0 con 0x5603be8a7f60 2023-10-06T02:26:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.971+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v110'343 uv343 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.971+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8ad3a0 con 0x5603be8a7f60 2023-10-06T02:26:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.972+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v110'344 uv344 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.972+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8ac390 con 0x5603be8a7f60 2023-10-06T02:26:46.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.973+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v110'345 uv345 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.973+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5603be8ac8a0 0x5603be8aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:46.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.973+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8af1c0 con 0x5603be8ac8a0 2023-10-06T02:26:46.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.973+0000 7f149b4b6700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5603be8ac8a0 0x5603be8aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:46.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.973+0000 7f149b4b6700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5603be8ac8a0 0x5603be8aec80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:46.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.974+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v110'87 uv86 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:46.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.974+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8af570 con 0x5603be8ac8a0 2023-10-06T02:26:46.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.975+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v110'88 uv88 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:46.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.976+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8af920 con 0x5603be8ac8a0 2023-10-06T02:26:46.978 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:26:46.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.976+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v110'89 uv89 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:46.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.976+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8ab0e0 con 0x5603be8ac8a0 2023-10-06T02:26:46.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.977+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v110'90 uv90 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:46.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.977+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b1340 con 0x5603be8ac8a0 2023-10-06T02:26:46.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.978+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v110'91 uv91 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:46.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.978+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b0210 con 0x5603be8ac8a0 2023-10-06T02:26:46.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.979+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v110'92 uv92 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:46.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.979+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b0630 con 0x5603be8ac8a0 2023-10-06T02:26:46.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.980+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v110'64 uv63 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:46.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.980+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b0630 con 0x5603be8ac8a0 2023-10-06T02:26:46.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.981+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v110'65 uv65 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:46.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.981+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b0630 con 0x5603be8ac8a0 2023-10-06T02:26:46.983 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:26:46.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.982+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v110'66 uv66 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:46.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.982+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b0af0 con 0x5603be8ac8a0 2023-10-06T02:26:46.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.983+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v110'67 uv67 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:46.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.983+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b0af0 con 0x5603be8a7f60 2023-10-06T02:26:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.984+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v110'87 uv86 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.984+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b0af0 con 0x5603be8a7f60 2023-10-06T02:26:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.985+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v110'88 uv88 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.985+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b0630 con 0x5603be8a7f60 2023-10-06T02:26:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.986+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v110'89 uv89 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.988 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:26:46.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.986+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b0630 con 0x5603be8a7f60 2023-10-06T02:26:46.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.987+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v110'90 uv90 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.987+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b0630 con 0x5603be8a7f60 2023-10-06T02:26:46.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.988+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v110'91 uv91 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.988+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b0630 con 0x5603be8a7f60 2023-10-06T02:26:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.989+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v110'92 uv92 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8a7f60 2023-10-06T02:26:46.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.989+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5603be8b17a0 0x5603be8b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:46.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.989+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b40c0 con 0x5603be8b17a0 2023-10-06T02:26:46.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.989+0000 7f149c4b8700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5603be8b17a0 0x5603be8b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:46.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.990+0000 7f149c4b8700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5603be8b17a0 0x5603be8b3b80 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:46.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.990+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v110'160 uv154 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8b17a0 2023-10-06T02:26:46.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.990+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b40c0 con 0x5603be8b17a0 2023-10-06T02:26:46.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.991+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v110'161 uv161 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8b17a0 2023-10-06T02:26:46.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.992+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b40c0 con 0x5603be8b17a0 2023-10-06T02:26:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.993+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v110'162 uv162 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8b17a0 2023-10-06T02:26:46.994 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:26:46.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.993+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b50d0 con 0x5603be8b17a0 2023-10-06T02:26:46.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.994+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v110'163 uv163 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8b17a0 2023-10-06T02:26:46.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.994+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b50d0 con 0x5603be8b17a0 2023-10-06T02:26:46.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.995+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v110'164 uv164 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8b17a0 2023-10-06T02:26:46.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.995+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b40c0 con 0x5603be8b17a0 2023-10-06T02:26:46.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.996+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v110'165 uv165 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8b17a0 2023-10-06T02:26:46.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.996+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b40c0 con 0x5603be8b17a0 2023-10-06T02:26:46.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.997+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v110'166 uv159 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8b17a0 2023-10-06T02:26:46.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.998+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b40c0 con 0x5603be8b17a0 2023-10-06T02:26:47.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.999+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v110'167 uv167 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8b17a0 2023-10-06T02:26:47.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:46.999+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b40c0 con 0x5603be8b17a0 2023-10-06T02:26:47.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.000+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v110'168 uv168 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8b17a0 2023-10-06T02:26:47.001 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:26:47.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.000+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b40c0 con 0x5603be8b17a0 2023-10-06T02:26:47.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.001+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v110'169 uv169 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8b17a0 2023-10-06T02:26:47.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.001+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8afda0 con 0x5603be8b17a0 2023-10-06T02:26:47.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.002+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v110'170 uv170 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8b17a0 2023-10-06T02:26:47.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.002+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5603be8b4ac0 0x5603be8b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.002+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b73e0 con 0x5603be8b4ac0 2023-10-06T02:26:47.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.003+0000 7f149bcb7700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5603be8b4ac0 0x5603be8b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.003+0000 7f149bcb7700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5603be8b4ac0 0x5603be8b6ea0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:47.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.004+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v110'71 uv70 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8b4ac0 2023-10-06T02:26:47.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.004+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b73e0 con 0x5603be8b4ac0 2023-10-06T02:26:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.005+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v110'72 uv72 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8b4ac0 2023-10-06T02:26:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.005+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b73e0 con 0x5603be8b4ac0 2023-10-06T02:26:47.007 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:26:47.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.006+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v110'73 uv73 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8b4ac0 2023-10-06T02:26:47.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.006+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b77e0 con 0x5603be8b4ac0 2023-10-06T02:26:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.007+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v110'74 uv74 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8b4ac0 2023-10-06T02:26:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.007+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b77e0 con 0x5603be8b4ac0 2023-10-06T02:26:47.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.009+0000 7f149bcb7700 1 -- 172.21.15.6:0/453577546 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v110'75 uv75 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f149400b040 con 0x5603be8b4ac0 2023-10-06T02:26:47.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.009+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b77e0 con 0x5603be8ac8a0 2023-10-06T02:26:47.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.010+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v110'87 uv86 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.010+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b77e0 con 0x5603be8ac8a0 2023-10-06T02:26:47.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.011+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v110'88 uv88 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.011+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b77e0 con 0x5603be8ac8a0 2023-10-06T02:26:47.013 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:26:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.011+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v110'89 uv89 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.011+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b87f0 con 0x5603be8ac8a0 2023-10-06T02:26:47.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.012+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v110'90 uv90 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.012+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b87f0 con 0x5603be8ac8a0 2023-10-06T02:26:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.013+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v110'91 uv91 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.013+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8b77e0 con 0x5603be8ac8a0 2023-10-06T02:26:47.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.014+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v110'92 uv92 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.014+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5603be8b7cf0 0x5603be8ba0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.014+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8ba780 con 0x5603be8b7cf0 2023-10-06T02:26:47.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.014+0000 7f149b4b6700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5603be8b7cf0 0x5603be8ba0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.014+0000 7f149b4b6700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5603be8b7cf0 0x5603be8ba0d0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:47.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.016+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v110'142 uv136 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8b7cf0 2023-10-06T02:26:47.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.016+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bab60 con 0x5603be8b7cf0 2023-10-06T02:26:47.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.017+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v110'143 uv143 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8b7cf0 2023-10-06T02:26:47.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.017+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bab60 con 0x5603be8b7cf0 2023-10-06T02:26:47.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.018+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v110'144 uv144 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8b7cf0 2023-10-06T02:26:47.019 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:26:47.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.018+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bab60 con 0x5603be8b7cf0 2023-10-06T02:26:47.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.019+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v110'145 uv145 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8b7cf0 2023-10-06T02:26:47.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.019+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bab60 con 0x5603be8b7cf0 2023-10-06T02:26:47.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.020+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v110'146 uv146 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8b7cf0 2023-10-06T02:26:47.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.020+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bab60 con 0x5603be8b7cf0 2023-10-06T02:26:47.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.021+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v110'147 uv141 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8b7cf0 2023-10-06T02:26:47.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.021+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bab60 con 0x5603be8b7cf0 2023-10-06T02:26:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.022+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v110'148 uv148 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8b7cf0 2023-10-06T02:26:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.022+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bab60 con 0x5603be8b7cf0 2023-10-06T02:26:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.023+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v110'149 uv149 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8b7cf0 2023-10-06T02:26:47.025 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:26:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.023+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bab60 con 0x5603be8b7cf0 2023-10-06T02:26:47.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.024+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v110'150 uv150 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8b7cf0 2023-10-06T02:26:47.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.024+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bd8d0 con 0x5603be8b7cf0 2023-10-06T02:26:47.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.025+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v110'151 uv151 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8b7cf0 2023-10-06T02:26:47.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.025+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb050 con 0x5603be8ac8a0 2023-10-06T02:26:47.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.028+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v110'66 uv64 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.028+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb050 con 0x5603be8ac8a0 2023-10-06T02:26:47.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.029+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v110'67 uv67 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.029+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb050 con 0x5603be8ac8a0 2023-10-06T02:26:47.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.030+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v110'68 uv68 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.032 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:26:47.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.030+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb050 con 0x5603be8ac8a0 2023-10-06T02:26:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.031+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v110'69 uv69 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.031+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5603be8bb960 0x5603be8be020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.031+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb050 con 0x5603be8bb960 2023-10-06T02:26:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.032+0000 7f149c4b8700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5603be8bb960 0x5603be8be020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.032+0000 7f149c4b8700 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5603be8bb960 0x5603be8be020 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.033+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v110'87 uv86 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8bb960 2023-10-06T02:26:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.033+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb050 con 0x5603be8bb960 2023-10-06T02:26:47.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.034+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v110'88 uv88 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8bb960 2023-10-06T02:26:47.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.034+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb050 con 0x5603be8bb960 2023-10-06T02:26:47.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.035+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v110'89 uv89 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8bb960 2023-10-06T02:26:47.037 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:26:47.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.035+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb050 con 0x5603be8bb960 2023-10-06T02:26:47.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.036+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v110'90 uv90 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8bb960 2023-10-06T02:26:47.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.036+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb050 con 0x5603be8bb960 2023-10-06T02:26:47.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.037+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v110'91 uv91 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8bb960 2023-10-06T02:26:47.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.038+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb050 con 0x5603be8bb960 2023-10-06T02:26:47.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.039+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v110'92 uv92 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8bb960 2023-10-06T02:26:47.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.039+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb050 con 0x5603be8b17a0 2023-10-06T02:26:47.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.040+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v110'74 uv73 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8b17a0 2023-10-06T02:26:47.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.040+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb050 con 0x5603be8b17a0 2023-10-06T02:26:47.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.041+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v110'75 uv75 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8b17a0 2023-10-06T02:26:47.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.041+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb050 con 0x5603be8b17a0 2023-10-06T02:26:47.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.042+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v110'76 uv76 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8b17a0 2023-10-06T02:26:47.043 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:26:47.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.042+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb050 con 0x5603be8b17a0 2023-10-06T02:26:47.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.043+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v110'77 uv77 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8b17a0 2023-10-06T02:26:47.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.043+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb050 con 0x5603be8b17a0 2023-10-06T02:26:47.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.044+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v110'78 uv78 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f148c002b00 con 0x5603be8b17a0 2023-10-06T02:26:47.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.044+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb050 con 0x5603be8ac8a0 2023-10-06T02:26:47.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.045+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v110'182 uv172 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.045+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb020 con 0x5603be8ac8a0 2023-10-06T02:26:47.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.046+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v110'183 uv183 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.046+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb020 con 0x5603be8ac8a0 2023-10-06T02:26:47.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.047+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v110'184 uv184 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.049 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:26:47.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.047+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb020 con 0x5603be8ac8a0 2023-10-06T02:26:47.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.048+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v110'185 uv185 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.048+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8be5b0 con 0x5603be8ac8a0 2023-10-06T02:26:47.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.049+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v110'186 uv186 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.049+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8be5b0 con 0x5603be8ac8a0 2023-10-06T02:26:47.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.050+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v110'187 uv187 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.053 INFO:teuthology.orchestra.run.smithi006.stdout:Write #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:26:47.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.050+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb020 con 0x5603be8ac8a0 2023-10-06T02:26:47.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.051+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [setxattr (30)] v110'188 uv188 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.051+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8bb020 con 0x5603be8ac8a0 2023-10-06T02:26:47.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.052+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [setxattr (30)] v110'189 uv189 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.052+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8be560 con 0x5603be8ac8a0 2023-10-06T02:26:47.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.053+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [omap-set-header] v110'190 uv190 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.053+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x5603be8baf30 con 0x5603be8ac8a0 2023-10-06T02:26:47.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.054+0000 7f149b4b6700 1 -- 172.21.15.6:0/453577546 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [omap-set-vals] v110'191 uv191 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1484055880 con 0x5603be8ac8a0 2023-10-06T02:26:47.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.054+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5603be8ac8a0 msgr2=0x5603be8aec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.054+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5603be8ac8a0 0x5603be8aec80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.054+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5603be899890 msgr2=0x5603be899c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.054+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5603be899890 0x5603be899c60 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.054+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5603be8b7cf0 msgr2=0x5603be8ba0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.054+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5603be8b7cf0 0x5603be8ba0d0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.054+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5603be8a7f60 msgr2=0x5603be8aa340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.054+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5603be8a7f60 0x5603be8aa340 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.054+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5603be8bb960 msgr2=0x5603be8be020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.054+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5603be8bb960 0x5603be8be020 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.054+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 reap_dead start 2023-10-06T02:26:47.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.054+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5603be8b4ac0 msgr2=0x5603be8b6ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.054+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5603be8b4ac0 0x5603be8b6ea0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.054+0000 7f149c4b8700 1 -- 172.21.15.6:0/453577546 reap_dead start 2023-10-06T02:26:47.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.054+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5603be8b17a0 msgr2=0x5603be8b3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.055+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5603be8b17a0 0x5603be8b3b80 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.055+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f147c065890 msgr2=0x7f147c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.055+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f147c065890 0x7f147c067d40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1494000c00 tx=0x7f1494001720 comp rx=0 tx=0).stop 2023-10-06T02:26:47.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.055+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603be7f9810 msgr2=0x5603be7b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.055+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603be7f9810 0x5603be7b4ba0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f1484005b50 tx=0x7f148401e070 comp rx=0 tx=0).stop 2023-10-06T02:26:47.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.055+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 shutdown_connections 2023-10-06T02:26:47.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.055+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603be7f9810 0x5603be7b4ba0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.055+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f147c065890 0x7f147c067d40 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.055+0000 7f14a2a7c000 1 --2- 172.21.15.6:0/453577546 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5603be8b17a0 0x5603be8b3b80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.055+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 >> 172.21.15.6:0/453577546 conn(0x5603be7b2d50 msgr2=0x5603be7e0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:47.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.055+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 shutdown_connections 2023-10-06T02:26:47.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.055+0000 7f14a2a7c000 1 -- 172.21.15.6:0/453577546 wait complete. 2023-10-06T02:26:47.066 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 1.00000000.inode - 2023-10-06T02:26:47.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.138+0000 7f8af381c000 1 Processor -- start 2023-10-06T02:26:47.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.138+0000 7f8af381c000 1 -- start start 2023-10-06T02:26:47.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.139+0000 7f8af381c000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a83ea470 0x55f5a83ea840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.139+0000 7f8af381c000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f5a848ee50 0x55f5a848f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.139+0000 7f8af381c000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5a8407870 0x55f5a848f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.139+0000 7f8af381c000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5a8309980 con 0x55f5a8407870 2023-10-06T02:26:47.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.139+0000 7f8af381c000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5a8309620 con 0x55f5a83ea470 2023-10-06T02:26:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.139+0000 7f8af381c000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5a8300400 con 0x55f5a848ee50 2023-10-06T02:26:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.139+0000 7f8aed258700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5a8407870 0x55f5a848f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.139+0000 7f8aed258700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5a8407870 0x55f5a848f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57238/0 (socket says 172.21.15.6:57238) 2023-10-06T02:26:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.139+0000 7f8aed258700 1 -- 172.21.15.6:0/3310677359 learned_addr learned my addr 172.21.15.6:0/3310677359 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.139+0000 7f8aeca57700 1 --2- 172.21.15.6:0/3310677359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a83ea470 0x55f5a83ea840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.139+0000 7f8ae7fff700 1 --2- 172.21.15.6:0/3310677359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f5a848ee50 0x55f5a848f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.139+0000 7f8aed258700 1 -- 172.21.15.6:0/3310677359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f5a848ee50 msgr2=0x55f5a848f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.139+0000 7f8aed258700 1 --2- 172.21.15.6:0/3310677359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f5a848ee50 0x55f5a848f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.139+0000 7f8aed258700 1 -- 172.21.15.6:0/3310677359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a83ea470 msgr2=0x55f5a83ea840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.139+0000 7f8aed258700 1 --2- 172.21.15.6:0/3310677359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a83ea470 0x55f5a83ea840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.139+0000 7f8aed258700 1 -- 172.21.15.6:0/3310677359 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5a83183d0 con 0x55f5a8407870 2023-10-06T02:26:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.140+0000 7f8aed258700 1 --2- 172.21.15.6:0/3310677359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5a8407870 0x55f5a848f9c0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800ae90 tx=0x7f8ae8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ade2c2d34eb5e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:47.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.140+0000 7f8ae6ffd700 1 -- 172.21.15.6:0/3310677359 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8012450 con 0x55f5a8407870 2023-10-06T02:26:47.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.140+0000 7f8ae6ffd700 1 -- 172.21.15.6:0/3310677359 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae8012cc0 con 0x55f5a8407870 2023-10-06T02:26:47.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.140+0000 7f8ae6ffd700 1 -- 172.21.15.6:0/3310677359 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8012e30 con 0x55f5a8407870 2023-10-06T02:26:47.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.140+0000 7f8af381c000 1 -- 172.21.15.6:0/3310677359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5a8407870 msgr2=0x55f5a848f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.140+0000 7f8af381c000 1 --2- 172.21.15.6:0/3310677359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5a8407870 0x55f5a848f9c0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800ae90 tx=0x7f8ae8019000 comp rx=0 tx=0).stop 2023-10-06T02:26:47.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.140+0000 7f8af381c000 1 -- 172.21.15.6:0/3310677359 shutdown_connections 2023-10-06T02:26:47.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.140+0000 7f8af381c000 1 --2- 172.21.15.6:0/3310677359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5a8407870 0x55f5a848f9c0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.140+0000 7f8af381c000 1 --2- 172.21.15.6:0/3310677359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a83ea470 0x55f5a83ea840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.140+0000 7f8af381c000 1 --2- 172.21.15.6:0/3310677359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f5a848ee50 0x55f5a848f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.140+0000 7f8af381c000 1 -- 172.21.15.6:0/3310677359 >> 172.21.15.6:0/3310677359 conn(0x55f5a8405bd0 msgr2=0x55f5a83eafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:47.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.140+0000 7f8af381c000 1 -- 172.21.15.6:0/3310677359 shutdown_connections 2023-10-06T02:26:47.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.140+0000 7f8af381c000 1 -- 172.21.15.6:0/3310677359 wait complete. 2023-10-06T02:26:47.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.141+0000 7f8af381c000 1 Processor -- start 2023-10-06T02:26:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.141+0000 7f8af381c000 1 -- start start 2023-10-06T02:26:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.141+0000 7f8af381c000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f5a83ea470 0x55f5a848d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.141+0000 7f8af381c000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5a8407870 0x55f5a8496ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8af381c000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a848ee50 0x55f5a8497000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8af381c000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5a83eaaf0 con 0x55f5a8407870 2023-10-06T02:26:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8af381c000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5a8497ab0 con 0x55f5a848ee50 2023-10-06T02:26:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8af381c000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5a8497d50 con 0x55f5a83ea470 2023-10-06T02:26:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8ae7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5a8407870 0x55f5a8496ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8ae7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5a8407870 0x55f5a8496ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57244/0 (socket says 172.21.15.6:57244) 2023-10-06T02:26:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8ae7fff700 1 -- 172.21.15.6:0/4193009456 learned_addr learned my addr 172.21.15.6:0/4193009456 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8aeca57700 1 --2- 172.21.15.6:0/4193009456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f5a83ea470 0x55f5a848d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8aed258700 1 --2- 172.21.15.6:0/4193009456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a848ee50 0x55f5a8497000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8ae7fff700 1 -- 172.21.15.6:0/4193009456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f5a83ea470 msgr2=0x55f5a848d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8ae7fff700 1 --2- 172.21.15.6:0/4193009456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f5a83ea470 0x55f5a848d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8ae7fff700 1 -- 172.21.15.6:0/4193009456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a848ee50 msgr2=0x55f5a8497000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8ae7fff700 1 --2- 172.21.15.6:0/4193009456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a848ee50 0x55f5a8497000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8ae7fff700 1 -- 172.21.15.6:0/4193009456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc001e10 con 0x55f5a8407870 2023-10-06T02:26:47.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8ae7fff700 1 --2- 172.21.15.6:0/4193009456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5a8407870 0x55f5a8496ac0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800f7b0 tx=0x7f8ad8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:47.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8ae57fa700 1 -- 172.21.15.6:0/4193009456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8014070 con 0x55f5a8407870 2023-10-06T02:26:47.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8ae57fa700 1 -- 172.21.15.6:0/4193009456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad800e660 con 0x55f5a8407870 2023-10-06T02:26:47.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8af381c000 1 -- 172.21.15.6:0/4193009456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f5a830bae0 con 0x55f5a8407870 2023-10-06T02:26:47.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8ae57fa700 1 -- 172.21.15.6:0/4193009456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad800ea00 con 0x55f5a8407870 2023-10-06T02:26:47.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.142+0000 7f8af381c000 1 -- 172.21.15.6:0/4193009456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f5a830b540 con 0x55f5a8407870 2023-10-06T02:26:47.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.144+0000 7f8ae57fa700 1 -- 172.21.15.6:0/4193009456 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ad801a430 con 0x55f5a8407870 2023-10-06T02:26:47.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.144+0000 7f8ae57fa700 1 --2- 172.21.15.6:0/4193009456 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8ad00658c0 0x7f8ad0067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.144+0000 7f8ae57fa700 1 -- 172.21.15.6:0/4193009456 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7668+0+0 (secure 0 0 0) 0x7f8ad8004040 con 0x55f5a8407870 2023-10-06T02:26:47.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.144+0000 7f8aeca57700 1 --2- 172.21.15.6:0/4193009456 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8ad00658c0 0x7f8ad0067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.144+0000 7f8af381c000 1 --2- 172.21.15.6:0/4193009456 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55f5a848dde0 0x55f5a83fec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.144+0000 7f8af381c000 1 -- 172.21.15.6:0/4193009456 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:287034c4:::1.00000000.inode:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v8 -- 0x55f5a83eb320 con 0x55f5a848dde0 2023-10-06T02:26:47.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.144+0000 7f8aed258700 1 --2- 172.21.15.6:0/4193009456 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55f5a848dde0 0x55f5a83fec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.145+0000 7f8aeca57700 1 --2- 172.21.15.6:0/4193009456 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8ad00658c0 0x7f8ad0067d70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0005a20 tx=0x7f8ae0005a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:47.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.145+0000 7f8aed258700 1 --2- 172.21.15.6:0/4193009456 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55f5a848dde0 0x55f5a83fec50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:47.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.146+0000 7f8aed258700 1 -- 172.21.15.6:0/4193009456 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 1.00000000.inode [writefull 0~80] v110'346 uv346 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f8ae8019070 con 0x55f5a848dde0 2023-10-06T02:26:47.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.146+0000 7f8af381c000 1 -- 172.21.15.6:0/4193009456 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55f5a848dde0 msgr2=0x55f5a83fec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.146+0000 7f8af381c000 1 --2- 172.21.15.6:0/4193009456 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55f5a848dde0 0x55f5a83fec50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.146+0000 7f8af381c000 1 -- 172.21.15.6:0/4193009456 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8ad00658c0 msgr2=0x7f8ad0067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.146+0000 7f8af381c000 1 --2- 172.21.15.6:0/4193009456 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8ad00658c0 0x7f8ad0067d70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0005a20 tx=0x7f8ae0005a50 comp rx=0 tx=0).stop 2023-10-06T02:26:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.146+0000 7f8af381c000 1 -- 172.21.15.6:0/4193009456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5a8407870 msgr2=0x55f5a8496ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.146+0000 7f8af381c000 1 --2- 172.21.15.6:0/4193009456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5a8407870 0x55f5a8496ac0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800f7b0 tx=0x7f8ad8001e90 comp rx=0 tx=0).stop 2023-10-06T02:26:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.146+0000 7f8aed258700 1 -- 172.21.15.6:0/4193009456 reap_dead start 2023-10-06T02:26:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.146+0000 7f8af381c000 1 -- 172.21.15.6:0/4193009456 shutdown_connections 2023-10-06T02:26:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.146+0000 7f8af381c000 1 -- 172.21.15.6:0/4193009456 >> 172.21.15.6:0/4193009456 conn(0x55f5a8405bd0 msgr2=0x55f5a83bc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.146+0000 7f8af381c000 1 -- 172.21.15.6:0/4193009456 shutdown_connections 2023-10-06T02:26:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.146+0000 7f8af381c000 1 -- 172.21.15.6:0/4193009456 wait complete. 2023-10-06T02:26:47.154 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:26:47.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.313+0000 7f92d8c28700 1 Processor -- start 2023-10-06T02:26:47.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.313+0000 7f92d8c28700 1 -- start start 2023-10-06T02:26:47.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.314+0000 7f92d8c28700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92d40c3fd0 0x7f92d40c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.314+0000 7f92d8c28700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d40c3b40 con 0x7f92d41574b0 2023-10-06T02:26:47.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.314+0000 7f92d8c28700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d40c2f30 con 0x7f92d40cbcc0 2023-10-06T02:26:47.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.314+0000 7f92d8c28700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d40c4980 con 0x7f92d40c3fd0 2023-10-06T02:26:47.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.315+0000 7f92d1d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92d40c3fd0 0x7f92d40c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.315+0000 7f92d259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f92d41574b0 0x7f92d40b0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53054/0 (socket says 172.21.15.6:53054) 2023-10-06T02:26:47.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.315+0000 7f92d259c700 1 -- 172.21.15.6:0/1667376037 learned_addr learned my addr 172.21.15.6:0/1667376037 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:47.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.315+0000 7f92d1d9b700 1 --2- 172.21.15.6:0/1667376037 >> v2:172.21.15.6:3300/0 conn(0x7f92d40c3fd0 0x7f92d40c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57252/0 (socket says 172.21.15.6:57252) 2023-10-06T02:26:47.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.315+0000 7f92d1d9b700 1 -- 172.21.15.6:0/1667376037 >> v1:172.21.15.175:6789/0 conn(0x7f92d40cbcc0 legacy=0x7f92d40c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.315+0000 7f92d1d9b700 1 -- 172.21.15.6:0/1667376037 >> v1:172.21.15.6:6789/0 conn(0x7f92d41574b0 legacy=0x7f92d40b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.315+0000 7f92d1d9b700 1 -- 172.21.15.6:0/1667376037 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d40c3210 con 0x7f92d40c3fd0 2023-10-06T02:26:47.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.315+0000 7f92d159a700 1 -- 172.21.15.6:0/1667376037 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946459090 0 0) 0x7f92d40c3b40 con 0x7f92d41574b0 2023-10-06T02:26:47.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.315+0000 7f92d1d9b700 1 --2- 172.21.15.6:0/1667376037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d40c3fd0 0x7f92d40c4440 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0098e0 tx=0x7f92bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373e6cf669ce5eb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:47.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.315+0000 7f92d159a700 1 -- 172.21.15.6:0/1667376037 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc009e80 con 0x7f92d40c3fd0 2023-10-06T02:26:47.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.315+0000 7f92d159a700 1 -- 172.21.15.6:0/1667376037 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc00b860 con 0x7f92d40c3fd0 2023-10-06T02:26:47.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.315+0000 7f92d159a700 1 -- 172.21.15.6:0/1667376037 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc00bbe0 con 0x7f92d40c3fd0 2023-10-06T02:26:47.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.316+0000 7f92d8c28700 1 -- 172.21.15.6:0/1667376037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d40c3fd0 msgr2=0x7f92d40c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.316+0000 7f92d8c28700 1 --2- 172.21.15.6:0/1667376037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d40c3fd0 0x7f92d40c4440 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0098e0 tx=0x7f92bc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.316+0000 7f92d8c28700 1 -- 172.21.15.6:0/1667376037 shutdown_connections 2023-10-06T02:26:47.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.316+0000 7f92d8c28700 1 --2- 172.21.15.6:0/1667376037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d40c3fd0 0x7f92d40c4440 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.316+0000 7f92d8c28700 1 -- 172.21.15.6:0/1667376037 >> 172.21.15.6:0/1667376037 conn(0x7f92d4067910 msgr2=0x7f92d40ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:47.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.316+0000 7f92d8c28700 1 -- 172.21.15.6:0/1667376037 shutdown_connections 2023-10-06T02:26:47.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.316+0000 7f92d8c28700 1 -- 172.21.15.6:0/1667376037 wait complete. 2023-10-06T02:26:47.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.317+0000 7f92d8c28700 1 Processor -- start 2023-10-06T02:26:47.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.317+0000 7f92d8c28700 1 -- start start 2023-10-06T02:26:47.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d8c28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d40c3fd0 0x7f92d406b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d8c28700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d40cbcc0 0x7f92d406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d8c28700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92d41574b0 0x7f92d406ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d8c28700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d4169970 con 0x7f92d40c3fd0 2023-10-06T02:26:47.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d8c28700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d416a940 con 0x7f92d40cbcc0 2023-10-06T02:26:47.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d8c28700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d4169b80 con 0x7f92d41574b0 2023-10-06T02:26:47.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d40c3fd0 0x7f92d406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d40c3fd0 0x7f92d406b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57258/0 (socket says 172.21.15.6:57258) 2023-10-06T02:26:47.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d259c700 1 -- 172.21.15.6:0/2461986931 learned_addr learned my addr 172.21.15.6:0/2461986931 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:47.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d1d9b700 1 --2- 172.21.15.6:0/2461986931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d40cbcc0 0x7f92d406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d2d9d700 1 --2- 172.21.15.6:0/2461986931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92d41574b0 0x7f92d406ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d259c700 1 -- 172.21.15.6:0/2461986931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92d41574b0 msgr2=0x7f92d406ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d259c700 1 --2- 172.21.15.6:0/2461986931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92d41574b0 0x7f92d406ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d259c700 1 -- 172.21.15.6:0/2461986931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d40cbcc0 msgr2=0x7f92d406c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d259c700 1 --2- 172.21.15.6:0/2461986931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d40cbcc0 0x7f92d406c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d259c700 1 -- 172.21.15.6:0/2461986931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc009420 con 0x7f92d40c3fd0 2023-10-06T02:26:47.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d259c700 1 --2- 172.21.15.6:0/2461986931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d40c3fd0 0x7f92d406b200 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00c560 tx=0x7f92cc007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:47.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92ca7fc700 1 -- 172.21.15.6:0/2461986931 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc0072e0 con 0x7f92d40c3fd0 2023-10-06T02:26:47.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92ca7fc700 1 -- 172.21.15.6:0/2461986931 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92cc007440 con 0x7f92d40c3fd0 2023-10-06T02:26:47.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92d8c28700 1 -- 172.21.15.6:0/2461986931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d4169e60 con 0x7f92d40c3fd0 2023-10-06T02:26:47.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.318+0000 7f92ca7fc700 1 -- 172.21.15.6:0/2461986931 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc0057f0 con 0x7f92d40c3fd0 2023-10-06T02:26:47.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.319+0000 7f92d8c28700 1 -- 172.21.15.6:0/2461986931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d416a420 con 0x7f92d40c3fd0 2023-10-06T02:26:47.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.319+0000 7f92d8c28700 1 -- 172.21.15.6:0/2461986931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d416a640 con 0x7f92d40c3fd0 2023-10-06T02:26:47.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.320+0000 7f92ca7fc700 1 -- 172.21.15.6:0/2461986931 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f92cc005c40 con 0x7f92d40c3fd0 2023-10-06T02:26:47.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.320+0000 7f92ca7fc700 1 --2- 172.21.15.6:0/2461986931 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f92b4066f30 0x7f92b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.321+0000 7f92ca7fc700 1 -- 172.21.15.6:0/2461986931 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7668+0+0 (secure 0 0 0) 0x7f92cc084040 con 0x7f92d40c3fd0 2023-10-06T02:26:47.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.321+0000 7f92d1d9b700 1 --2- 172.21.15.6:0/2461986931 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f92b4066f30 0x7f92b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.321+0000 7f92d1d9b700 1 --2- 172.21.15.6:0/2461986931 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f92b4066f30 0x7f92b40693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0093f0 tx=0x7f92bc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:47.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.325+0000 7f92ca7fc700 1 -- 172.21.15.6:0/2461986931 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92cc050b00 con 0x7f92d40c3fd0 2023-10-06T02:26:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.563+0000 7f92d8c28700 1 -- 172.21.15.6:0/2461986931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f92d406b7a0 con 0x7f92d40c3fd0 2023-10-06T02:26:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.844+0000 7f92ca7fc700 1 -- 172.21.15.6:0/2461986931 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v188) v1 ==== 162+0+0 (secure 0 0 0) 0x7f92cc0170b0 con 0x7f92d40c3fd0 2023-10-06T02:26:47.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.846+0000 7f92d8c28700 1 -- 172.21.15.6:0/2461986931 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f92b4066f30 msgr2=0x7f92b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.846+0000 7f92d8c28700 1 --2- 172.21.15.6:0/2461986931 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f92b4066f30 0x7f92b40693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0093f0 tx=0x7f92bc017000 comp rx=0 tx=0).stop 2023-10-06T02:26:47.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.846+0000 7f92d8c28700 1 -- 172.21.15.6:0/2461986931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d40c3fd0 msgr2=0x7f92d406b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.846+0000 7f92d8c28700 1 --2- 172.21.15.6:0/2461986931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d40c3fd0 0x7f92d406b200 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00c560 tx=0x7f92cc007e30 comp rx=0 tx=0).stop 2023-10-06T02:26:47.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.847+0000 7f92d8c28700 1 -- 172.21.15.6:0/2461986931 shutdown_connections 2023-10-06T02:26:47.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.847+0000 7f92d8c28700 1 --2- 172.21.15.6:0/2461986931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92d41574b0 0x7f92d406ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.847+0000 7f92d8c28700 1 --2- 172.21.15.6:0/2461986931 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f92b4066f30 0x7f92b40693e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.847+0000 7f92d8c28700 1 --2- 172.21.15.6:0/2461986931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d40c3fd0 0x7f92d406b200 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.847+0000 7f92d8c28700 1 --2- 172.21.15.6:0/2461986931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d40cbcc0 0x7f92d406c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.847+0000 7f92d8c28700 1 -- 172.21.15.6:0/2461986931 >> 172.21.15.6:0/2461986931 conn(0x7f92d4067910 msgr2=0x7f92d40cb490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:47.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.847+0000 7f92d8c28700 1 -- 172.21.15.6:0/2461986931 shutdown_connections 2023-10-06T02:26:47.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.847+0000 7f92d8c28700 1 -- 172.21.15.6:0/2461986931 wait complete. 2023-10-06T02:26:47.850 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:26:47.857 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:26:47.855+0000 7fe180f27700 -1 mds.0.cache.ino(0x1) Corrupt inode 0x1: End of buffer 2023-10-06T02:26:47.857 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:26:47.855+0000 7fe180f27700 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2023-10-06T02:26:47.857 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:26:47.856+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:26:47.857 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:26:47.856+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:26:47.863 INFO:tasks.ceph.mds.a.smithi006.stderr: -15> 2023-10-06T02:26:47.855+0000 7fe180f27700 -1 mds.0.cache.ino(0x1) Corrupt inode 0x1: End of buffer 2023-10-06T02:26:47.863 INFO:tasks.ceph.mds.a.smithi006.stderr: -13> 2023-10-06T02:26:47.855+0000 7fe180f27700 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2023-10-06T02:26:47.864 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:47.884 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:26:47.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.986+0000 7f030759e700 1 Processor -- start 2023-10-06T02:26:47.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.986+0000 7f030759e700 1 -- start start 2023-10-06T02:26:47.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.987+0000 7f030759e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0308157040 0x7f03080cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.987+0000 7f030759e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0308157410 0x7f03080cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.987+0000 7f030759e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03080cd5b0 con 0x7f03080cda40 2023-10-06T02:26:47.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.987+0000 7f030759e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03080cca20 con 0x7f0308157040 2023-10-06T02:26:47.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.987+0000 7f030759e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03080ccc80 con 0x7f0308157410 2023-10-06T02:26:47.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.987+0000 7f030659c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0308157040 0x7f03080cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.987+0000 7f030659c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0308157040 0x7f03080cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57278/0 (socket says 172.21.15.6:57278) 2023-10-06T02:26:47.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.987+0000 7f030659c700 1 -- 172.21.15.6:0/1396618121 learned_addr learned my addr 172.21.15.6:0/1396618121 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.987+0000 7f0305d9b700 1 --2- 172.21.15.6:0/1396618121 >> v2:172.21.15.175:3300/0 conn(0x7f0308157410 0x7f03080cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.987+0000 7f030659c700 1 -- 172.21.15.6:0/1396618121 >> v2:172.21.15.175:3300/0 conn(0x7f0308157410 msgr2=0x7f03080cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.987+0000 7f030659c700 1 --2- 172.21.15.6:0/1396618121 >> v2:172.21.15.175:3300/0 conn(0x7f0308157410 0x7f03080cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.987+0000 7f030659c700 1 -- 172.21.15.6:0/1396618121 >> v1:172.21.15.175:6789/0 conn(0x7f03080cda40 legacy=0x7f03080ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.987+0000 7f030659c700 1 -- 172.21.15.6:0/1396618121 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03080ccf60 con 0x7f0308157040 2023-10-06T02:26:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.987+0000 7f030659c700 1 --2- 172.21.15.6:0/1396618121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0308157040 0x7f03080cbfa0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f03080b2c30 tx=0x7f02f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6bccbfcaf3352c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.987+0000 7f030559a700 1 -- 172.21.15.6:0/1396618121 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f800b860 con 0x7f0308157040 2023-10-06T02:26:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.987+0000 7f030559a700 1 -- 172.21.15.6:0/1396618121 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f800b9c0 con 0x7f0308157040 2023-10-06T02:26:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.987+0000 7f030559a700 1 -- 172.21.15.6:0/1396618121 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f800bd60 con 0x7f0308157040 2023-10-06T02:26:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.988+0000 7f030759e700 1 -- 172.21.15.6:0/1396618121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0308157040 msgr2=0x7f03080cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.988+0000 7f030759e700 1 --2- 172.21.15.6:0/1396618121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0308157040 0x7f03080cbfa0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f03080b2c30 tx=0x7f02f8009250 comp rx=0 tx=0).stop 2023-10-06T02:26:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.988+0000 7f030759e700 1 -- 172.21.15.6:0/1396618121 shutdown_connections 2023-10-06T02:26:47.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.988+0000 7f030759e700 1 --2- 172.21.15.6:0/1396618121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0308157040 0x7f03080cbfa0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.988+0000 7f030759e700 1 --2- 172.21.15.6:0/1396618121 >> v2:172.21.15.175:3300/0 conn(0x7f0308157410 0x7f03080cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.988+0000 7f030759e700 1 -- 172.21.15.6:0/1396618121 >> 172.21.15.6:0/1396618121 conn(0x7f0308067130 msgr2=0x7f0308067530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:47.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.988+0000 7f030759e700 1 -- 172.21.15.6:0/1396618121 shutdown_connections 2023-10-06T02:26:47.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.988+0000 7f030759e700 1 -- 172.21.15.6:0/1396618121 wait complete. 2023-10-06T02:26:47.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.989+0000 7f030759e700 1 Processor -- start 2023-10-06T02:26:47.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.989+0000 7f030759e700 1 -- start start 2023-10-06T02:26:47.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.990+0000 7f030759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03080cda40 0x7f030816a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.990+0000 7f030759e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0308157040 0x7f03080ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.990+0000 7f030759e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0308157410 0x7f03080add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.990+0000 7f030759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030814da60 con 0x7f03080cda40 2023-10-06T02:26:47.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.990+0000 7f030759e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0308158340 con 0x7f0308157410 2023-10-06T02:26:47.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.990+0000 7f030759e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030814f830 con 0x7f0308157040 2023-10-06T02:26:47.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.990+0000 7f030659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03080cda40 0x7f030816a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.990+0000 7f030659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03080cda40 0x7f030816a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57290/0 (socket says 172.21.15.6:57290) 2023-10-06T02:26:47.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.990+0000 7f030659c700 1 -- 172.21.15.6:0/2111300637 learned_addr learned my addr 172.21.15.6:0/2111300637 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.990+0000 7f0306d9d700 1 --2- 172.21.15.6:0/2111300637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0308157410 0x7f03080add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.990+0000 7f0305d9b700 1 --2- 172.21.15.6:0/2111300637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0308157040 0x7f03080ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.990+0000 7f030659c700 1 -- 172.21.15.6:0/2111300637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0308157040 msgr2=0x7f03080ad7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.990+0000 7f030659c700 1 --2- 172.21.15.6:0/2111300637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0308157040 0x7f03080ad7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.990+0000 7f030659c700 1 -- 172.21.15.6:0/2111300637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0308157410 msgr2=0x7f03080add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.990+0000 7f030659c700 1 --2- 172.21.15.6:0/2111300637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0308157410 0x7f03080add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.990+0000 7f030659c700 1 -- 172.21.15.6:0/2111300637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f80094f0 con 0x7f03080cda40 2023-10-06T02:26:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.991+0000 7f030659c700 1 --2- 172.21.15.6:0/2111300637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03080cda40 0x7f030816a840 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f0308069100 tx=0x7f02f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.991+0000 7f02f67fc700 1 -- 172.21.15.6:0/2111300637 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8024440 con 0x7f03080cda40 2023-10-06T02:26:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.991+0000 7f02f67fc700 1 -- 172.21.15.6:0/2111300637 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f80245a0 con 0x7f03080cda40 2023-10-06T02:26:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.991+0000 7f030759e700 1 -- 172.21.15.6:0/2111300637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f030816ad80 con 0x7f03080cda40 2023-10-06T02:26:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.991+0000 7f02f67fc700 1 -- 172.21.15.6:0/2111300637 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8024960 con 0x7f03080cda40 2023-10-06T02:26:47.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.991+0000 7f030759e700 1 -- 172.21.15.6:0/2111300637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0308157cf0 con 0x7f03080cda40 2023-10-06T02:26:47.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.992+0000 7f030759e700 1 -- 172.21.15.6:0/2111300637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030806f3c0 con 0x7f03080cda40 2023-10-06T02:26:47.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.992+0000 7f02f67fc700 1 -- 172.21.15.6:0/2111300637 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f02f8024d50 con 0x7f03080cda40 2023-10-06T02:26:47.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.993+0000 7f02f67fc700 1 --2- 172.21.15.6:0/2111300637 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f02e8066f30 0x7f02e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:47.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.993+0000 7f02f67fc700 1 -- 172.21.15.6:0/2111300637 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7754+0+0 (secure 0 0 0) 0x7f02f8086990 con 0x7f03080cda40 2023-10-06T02:26:47.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.993+0000 7f0305d9b700 1 --2- 172.21.15.6:0/2111300637 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f02e8066f30 0x7f02e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:47.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.993+0000 7f0305d9b700 1 --2- 172.21.15.6:0/2111300637 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f02e8066f30 0x7f02e80693e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0308155720 tx=0x7f02fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:47.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:47.997+0000 7f02f67fc700 1 -- 172.21.15.6:0/2111300637 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02f8053360 con 0x7f03080cda40 2023-10-06T02:26:48.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.237+0000 7f030759e700 1 -- 172.21.15.6:0/2111300637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03080cd240 con 0x7f03080cda40 2023-10-06T02:26:48.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.238+0000 7f02f67fc700 1 -- 172.21.15.6:0/2111300637 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 190 v190) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f02f802b340 con 0x7f03080cda40 2023-10-06T02:26:48.240 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:48.240 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":190,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":190,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:47.858150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:48.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.240+0000 7f030759e700 1 -- 172.21.15.6:0/2111300637 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f02e8066f30 msgr2=0x7f02e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.240+0000 7f030759e700 1 --2- 172.21.15.6:0/2111300637 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f02e8066f30 0x7f02e80693e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0308155720 tx=0x7f02fc008040 comp rx=0 tx=0).stop 2023-10-06T02:26:48.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.240+0000 7f030759e700 1 -- 172.21.15.6:0/2111300637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03080cda40 msgr2=0x7f030816a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.240+0000 7f030759e700 1 --2- 172.21.15.6:0/2111300637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03080cda40 0x7f030816a840 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f0308069100 tx=0x7f02f8017000 comp rx=0 tx=0).stop 2023-10-06T02:26:48.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.240+0000 7f030759e700 1 -- 172.21.15.6:0/2111300637 shutdown_connections 2023-10-06T02:26:48.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.240+0000 7f030759e700 1 --2- 172.21.15.6:0/2111300637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0308157410 0x7f03080add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.240+0000 7f030759e700 1 --2- 172.21.15.6:0/2111300637 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f02e8066f30 0x7f02e80693e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.240+0000 7f030759e700 1 --2- 172.21.15.6:0/2111300637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03080cda40 0x7f030816a840 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.240+0000 7f030759e700 1 --2- 172.21.15.6:0/2111300637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0308157040 0x7f03080ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.240+0000 7f030759e700 1 -- 172.21.15.6:0/2111300637 >> 172.21.15.6:0/2111300637 conn(0x7f0308067130 msgr2=0x7f030806da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.240+0000 7f030759e700 1 -- 172.21.15.6:0/2111300637 shutdown_connections 2023-10-06T02:26:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.240+0000 7f030759e700 1 -- 172.21.15.6:0/2111300637 wait complete. 2023-10-06T02:26:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 190 2023-10-06T02:26:48.253 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:26:48.254 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.410+0000 7f7d51b1f700 1 Processor -- start 2023-10-06T02:26:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.410+0000 7f7d51b1f700 1 -- start start 2023-10-06T02:26:48.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.411+0000 7f7d51b1f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d4c15ca10 0x7f7d4c069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.411+0000 7f7d51b1f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d4c067d10 0x7f7d4c06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.411+0000 7f7d51b1f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c0b1ed0 con 0x7f7d4c15cde0 2023-10-06T02:26:48.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.411+0000 7f7d51b1f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c0879c0 con 0x7f7d4c067d10 2023-10-06T02:26:48.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.411+0000 7f7d51b1f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0cec50 con 0x7f7d4c15ca10 2023-10-06T02:26:48.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.411+0000 7f7d4affd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d4c067d10 0x7f7d4c06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.411+0000 7f7d4affd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d4c067d10 0x7f7d4c06a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57300/0 (socket says 172.21.15.6:57300) 2023-10-06T02:26:48.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.411+0000 7f7d4affd700 1 -- 172.21.15.6:0/2624624451 learned_addr learned my addr 172.21.15.6:0/2624624451 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:48.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.411+0000 7f7d4b7fe700 1 --2- 172.21.15.6:0/2624624451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d4c15ca10 0x7f7d4c069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.412+0000 7f7d4affd700 1 -- 172.21.15.6:0/2624624451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d4c15ca10 msgr2=0x7f7d4c069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:48.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.412+0000 7f7d4affd700 1 --2- 172.21.15.6:0/2624624451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d4c15ca10 0x7f7d4c069f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.412+0000 7f7d4affd700 1 -- 172.21.15.6:0/2624624451 >> v1:172.21.15.175:6789/0 conn(0x7f7d4c15cde0 legacy=0x7f7d4c0aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.412+0000 7f7d4affd700 1 -- 172.21.15.6:0/2624624451 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c0cef30 con 0x7f7d4c067d10 2023-10-06T02:26:48.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.412+0000 7f7d4affd700 1 --2- 172.21.15.6:0/2624624451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c067d10 0x7f7d4c06a4b0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f7d400099b0 tx=0x7f7d40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc5acd7829a133c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:48.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.412+0000 7f7d4a7fc700 1 -- 172.21.15.6:0/2624624451 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40009ea0 con 0x7f7d4c067d10 2023-10-06T02:26:48.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.412+0000 7f7d4a7fc700 1 -- 172.21.15.6:0/2624624451 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4000b860 con 0x7f7d4c067d10 2023-10-06T02:26:48.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.412+0000 7f7d4a7fc700 1 -- 172.21.15.6:0/2624624451 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4000bc00 con 0x7f7d4c067d10 2023-10-06T02:26:48.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.412+0000 7f7d51b1f700 1 -- 172.21.15.6:0/2624624451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c067d10 msgr2=0x7f7d4c06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.412+0000 7f7d51b1f700 1 --2- 172.21.15.6:0/2624624451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c067d10 0x7f7d4c06a4b0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f7d400099b0 tx=0x7f7d40009250 comp rx=0 tx=0).stop 2023-10-06T02:26:48.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.412+0000 7f7d51b1f700 1 -- 172.21.15.6:0/2624624451 shutdown_connections 2023-10-06T02:26:48.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.412+0000 7f7d51b1f700 1 --2- 172.21.15.6:0/2624624451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d4c15ca10 0x7f7d4c069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.412+0000 7f7d51b1f700 1 --2- 172.21.15.6:0/2624624451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c067d10 0x7f7d4c06a4b0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.412+0000 7f7d51b1f700 1 -- 172.21.15.6:0/2624624451 >> 172.21.15.6:0/2624624451 conn(0x7f7d4c067910 msgr2=0x7f7d4c0ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:48.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.412+0000 7f7d51b1f700 1 -- 172.21.15.6:0/2624624451 shutdown_connections 2023-10-06T02:26:48.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.412+0000 7f7d51b1f700 1 -- 172.21.15.6:0/2624624451 wait complete. 2023-10-06T02:26:48.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.414+0000 7f7d51b1f700 1 Processor -- start 2023-10-06T02:26:48.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.414+0000 7f7d51b1f700 1 -- start start 2023-10-06T02:26:48.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.414+0000 7f7d51b1f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d4c067d10 0x7f7d4c157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.414+0000 7f7d51b1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c15ca10 0x7f7d4c098c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.414+0000 7f7d51b1f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d4c15cde0 0x7f7d4c0c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.414+0000 7f7d51b1f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c09aac0 con 0x7f7d4c15ca10 2023-10-06T02:26:48.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.414+0000 7f7d51b1f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c099600 con 0x7f7d4c067d10 2023-10-06T02:26:48.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.414+0000 7f7d51b1f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c09a190 con 0x7f7d4c15cde0 2023-10-06T02:26:48.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.415+0000 7f7d4affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c15ca10 0x7f7d4c098c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.415+0000 7f7d4affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c15ca10 0x7f7d4c098c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57312/0 (socket says 172.21.15.6:57312) 2023-10-06T02:26:48.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.415+0000 7f7d4affd700 1 -- 172.21.15.6:0/1443111672 learned_addr learned my addr 172.21.15.6:0/1443111672 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:48.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.415+0000 7f7d4b7fe700 1 --2- 172.21.15.6:0/1443111672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d4c067d10 0x7f7d4c157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.415+0000 7f7d4bfff700 1 --2- 172.21.15.6:0/1443111672 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d4c15cde0 0x7f7d4c0c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.415+0000 7f7d4affd700 1 -- 172.21.15.6:0/1443111672 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d4c15cde0 msgr2=0x7f7d4c0c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.415+0000 7f7d4affd700 1 --2- 172.21.15.6:0/1443111672 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d4c15cde0 0x7f7d4c0c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.415+0000 7f7d4affd700 1 -- 172.21.15.6:0/1443111672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d4c067d10 msgr2=0x7f7d4c157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.415+0000 7f7d4affd700 1 --2- 172.21.15.6:0/1443111672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d4c067d10 0x7f7d4c157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.415+0000 7f7d4affd700 1 -- 172.21.15.6:0/1443111672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d400094f0 con 0x7f7d4c15ca10 2023-10-06T02:26:48.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.415+0000 7f7d4affd700 1 --2- 172.21.15.6:0/1443111672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c15ca10 0x7f7d4c098c30 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c06f4d0 tx=0x7f7d40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:48.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.415+0000 7f7d337fe700 1 -- 172.21.15.6:0/1443111672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40000d10 con 0x7f7d4c15ca10 2023-10-06T02:26:48.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.415+0000 7f7d337fe700 1 -- 172.21.15.6:0/1443111672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4000bbe0 con 0x7f7d4c15ca10 2023-10-06T02:26:48.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.415+0000 7f7d51b1f700 1 -- 172.21.15.6:0/1443111672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c09a470 con 0x7f7d4c15ca10 2023-10-06T02:26:48.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.415+0000 7f7d337fe700 1 -- 172.21.15.6:0/1443111672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40011670 con 0x7f7d4c15ca10 2023-10-06T02:26:48.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.415+0000 7f7d51b1f700 1 -- 172.21.15.6:0/1443111672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c158210 con 0x7f7d4c15ca10 2023-10-06T02:26:48.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.416+0000 7f7d51b1f700 1 -- 172.21.15.6:0/1443111672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c06e8d0 con 0x7f7d4c15ca10 2023-10-06T02:26:48.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.417+0000 7f7d337fe700 1 -- 172.21.15.6:0/1443111672 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d40011aa0 con 0x7f7d4c15ca10 2023-10-06T02:26:48.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.417+0000 7f7d337fe700 1 --2- 172.21.15.6:0/1443111672 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d38066f30 0x7f7d380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.417+0000 7f7d337fe700 1 -- 172.21.15.6:0/1443111672 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7754+0+0 (secure 0 0 0) 0x7f7d400865a0 con 0x7f7d4c15ca10 2023-10-06T02:26:48.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.417+0000 7f7d4b7fe700 1 --2- 172.21.15.6:0/1443111672 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d38066f30 0x7f7d380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.418+0000 7f7d4b7fe700 1 --2- 172.21.15.6:0/1443111672 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d38066f30 0x7f7d380693e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c15c360 tx=0x7f7d3c009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:48.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.421+0000 7f7d337fe700 1 -- 172.21.15.6:0/1443111672 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d40053010 con 0x7f7d4c15ca10 2023-10-06T02:26:48.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.660+0000 7f7d51b1f700 1 -- 172.21.15.6:0/1443111672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d4c09ac00 con 0x7f7d4c15ca10 2023-10-06T02:26:48.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.660+0000 7f7d337fe700 1 -- 172.21.15.6:0/1443111672 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 190 v190) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f7d40056630 con 0x7f7d4c15ca10 2023-10-06T02:26:48.662 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:48.662 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":190,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":190,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:47.858150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:48.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.662+0000 7f7d51b1f700 1 -- 172.21.15.6:0/1443111672 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d38066f30 msgr2=0x7f7d380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.662+0000 7f7d51b1f700 1 --2- 172.21.15.6:0/1443111672 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d38066f30 0x7f7d380693e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c15c360 tx=0x7f7d3c009120 comp rx=0 tx=0).stop 2023-10-06T02:26:48.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.662+0000 7f7d51b1f700 1 -- 172.21.15.6:0/1443111672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c15ca10 msgr2=0x7f7d4c098c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.662+0000 7f7d51b1f700 1 --2- 172.21.15.6:0/1443111672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c15ca10 0x7f7d4c098c30 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c06f4d0 tx=0x7f7d40017000 comp rx=0 tx=0).stop 2023-10-06T02:26:48.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.662+0000 7f7d51b1f700 1 -- 172.21.15.6:0/1443111672 shutdown_connections 2023-10-06T02:26:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.662+0000 7f7d51b1f700 1 --2- 172.21.15.6:0/1443111672 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d4c15cde0 0x7f7d4c0c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.662+0000 7f7d51b1f700 1 --2- 172.21.15.6:0/1443111672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d4c067d10 0x7f7d4c157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.662+0000 7f7d51b1f700 1 --2- 172.21.15.6:0/1443111672 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d38066f30 0x7f7d380693e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.662+0000 7f7d51b1f700 1 --2- 172.21.15.6:0/1443111672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c15ca10 0x7f7d4c098c30 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.662+0000 7f7d51b1f700 1 -- 172.21.15.6:0/1443111672 >> 172.21.15.6:0/1443111672 conn(0x7f7d4c067910 msgr2=0x7f7d4c0b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.662+0000 7f7d51b1f700 1 -- 172.21.15.6:0/1443111672 shutdown_connections 2023-10-06T02:26:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.662+0000 7f7d51b1f700 1 -- 172.21.15.6:0/1443111672 wait complete. 2023-10-06T02:26:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 190 2023-10-06T02:26:48.676 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:26:48.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.794+0000 7f44817ce700 1 Processor -- start 2023-10-06T02:26:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.794+0000 7f44817ce700 1 -- start start 2023-10-06T02:26:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.795+0000 7f44817ce700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f447c0af8b0 0x7f447c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.795+0000 7f44817ce700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f447c0b27f0 0x7f447c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.795+0000 7f44817ce700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f447c15e190 con 0x7f447c0af4e0 2023-10-06T02:26:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.795+0000 7f44817ce700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f447c0b1910 con 0x7f447c0b27f0 2023-10-06T02:26:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.795+0000 7f44817ce700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f447c0cb650 con 0x7f447c0af8b0 2023-10-06T02:26:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.795+0000 7f447b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f447c0b27f0 0x7f447c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.795+0000 7f447a7fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f447c0af8b0 0x7f447c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.795+0000 7f447affd700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f447c0af4e0 0x7f447c0b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:41076/0 (socket says 172.21.15.6:41076) 2023-10-06T02:26:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.795+0000 7f447affd700 1 -- 172.21.15.6:0/625643725 learned_addr learned my addr 172.21.15.6:0/625643725 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.795+0000 7f447b7fe700 1 -- 172.21.15.6:0/625643725 >> v2:172.21.15.175:3300/0 conn(0x7f447c0af8b0 msgr2=0x7f447c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.795+0000 7f447b7fe700 1 --2- 172.21.15.6:0/625643725 >> v2:172.21.15.175:3300/0 conn(0x7f447c0af8b0 0x7f447c15d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.795+0000 7f4479ffb700 1 -- 172.21.15.6:0/625643725 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912527811 0 0) 0x7f447c15e190 con 0x7f447c0af4e0 2023-10-06T02:26:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.795+0000 7f447b7fe700 1 -- 172.21.15.6:0/625643725 >> v1:172.21.15.175:6789/0 conn(0x7f447c0af4e0 legacy=0x7f447c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.795+0000 7f447b7fe700 1 -- 172.21.15.6:0/625643725 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c0ccaf0 con 0x7f447c0b27f0 2023-10-06T02:26:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.796+0000 7f447b7fe700 1 --2- 172.21.15.6:0/625643725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447c0b27f0 0x7f447c15d9a0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f447c0cdd50 tx=0x7f44740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9fa8edd79b0e13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.796+0000 7f4479ffb700 1 -- 172.21.15.6:0/625643725 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4474011630 con 0x7f447c0b27f0 2023-10-06T02:26:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.796+0000 7f4479ffb700 1 -- 172.21.15.6:0/625643725 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4474011790 con 0x7f447c0b27f0 2023-10-06T02:26:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.796+0000 7f4479ffb700 1 -- 172.21.15.6:0/625643725 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4474011b30 con 0x7f447c0b27f0 2023-10-06T02:26:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.796+0000 7f44817ce700 1 -- 172.21.15.6:0/625643725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447c0b27f0 msgr2=0x7f447c15d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.796+0000 7f44817ce700 1 --2- 172.21.15.6:0/625643725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447c0b27f0 0x7f447c15d9a0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f447c0cdd50 tx=0x7f44740091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.796+0000 7f44817ce700 1 -- 172.21.15.6:0/625643725 shutdown_connections 2023-10-06T02:26:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.796+0000 7f44817ce700 1 --2- 172.21.15.6:0/625643725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447c0b27f0 0x7f447c15d9a0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.796+0000 7f44817ce700 1 --2- 172.21.15.6:0/625643725 >> v2:172.21.15.175:3300/0 conn(0x7f447c0af8b0 0x7f447c15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.796+0000 7f44817ce700 1 -- 172.21.15.6:0/625643725 >> 172.21.15.6:0/625643725 conn(0x7f447c068680 msgr2=0x7f447c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.796+0000 7f44817ce700 1 -- 172.21.15.6:0/625643725 shutdown_connections 2023-10-06T02:26:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.796+0000 7f44817ce700 1 -- 172.21.15.6:0/625643725 wait complete. 2023-10-06T02:26:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.798+0000 7f44817ce700 1 Processor -- start 2023-10-06T02:26:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.798+0000 7f44817ce700 1 -- start start 2023-10-06T02:26:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.798+0000 7f44817ce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447c0af4e0 0x7f447c1570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.798+0000 7f44817ce700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f447c0af8b0 0x7f447c15c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.798+0000 7f44817ce700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f447c0b27f0 0x7f447c1555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.798+0000 7f44817ce700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c156010 con 0x7f447c0af4e0 2023-10-06T02:26:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.798+0000 7f44817ce700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c1562f0 con 0x7f447c0b27f0 2023-10-06T02:26:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.798+0000 7f44817ce700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447c1565d0 con 0x7f447c0af8b0 2023-10-06T02:26:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.799+0000 7f447affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447c0af4e0 0x7f447c1570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.799+0000 7f447affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447c0af4e0 0x7f447c1570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54614/0 (socket says 172.21.15.6:54614) 2023-10-06T02:26:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.799+0000 7f447affd700 1 -- 172.21.15.6:0/3813728000 learned_addr learned my addr 172.21.15.6:0/3813728000 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.799+0000 7f447a7fc700 1 --2- 172.21.15.6:0/3813728000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f447c0af8b0 0x7f447c15c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.799+0000 7f447b7fe700 1 --2- 172.21.15.6:0/3813728000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f447c0b27f0 0x7f447c1555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.799+0000 7f447affd700 1 -- 172.21.15.6:0/3813728000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f447c0af8b0 msgr2=0x7f447c15c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.799+0000 7f447affd700 1 --2- 172.21.15.6:0/3813728000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f447c0af8b0 0x7f447c15c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.799+0000 7f447affd700 1 -- 172.21.15.6:0/3813728000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f447c0b27f0 msgr2=0x7f447c1555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.799+0000 7f447affd700 1 --2- 172.21.15.6:0/3813728000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f447c0b27f0 0x7f447c1555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.799+0000 7f447affd700 1 -- 172.21.15.6:0/3813728000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4474009420 con 0x7f447c0af4e0 2023-10-06T02:26:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.799+0000 7f447affd700 1 --2- 172.21.15.6:0/3813728000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447c0af4e0 0x7f447c1570b0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f446c00cc70 tx=0x7f446c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.799+0000 7f4472ffd700 1 -- 172.21.15.6:0/3813728000 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c00a890 con 0x7f447c0af4e0 2023-10-06T02:26:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.799+0000 7f4472ffd700 1 -- 172.21.15.6:0/3813728000 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446c00a9f0 con 0x7f447c0af4e0 2023-10-06T02:26:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.799+0000 7f44817ce700 1 -- 172.21.15.6:0/3813728000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447c1568b0 con 0x7f447c0af4e0 2023-10-06T02:26:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.799+0000 7f4472ffd700 1 -- 172.21.15.6:0/3813728000 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c00ad70 con 0x7f447c0af4e0 2023-10-06T02:26:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.799+0000 7f44817ce700 1 -- 172.21.15.6:0/3813728000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447c1575f0 con 0x7f447c0af4e0 2023-10-06T02:26:48.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.800+0000 7f44817ce700 1 -- 172.21.15.6:0/3813728000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447c156dd0 con 0x7f447c0af4e0 2023-10-06T02:26:48.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.801+0000 7f4472ffd700 1 -- 172.21.15.6:0/3813728000 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f446c007300 con 0x7f447c0af4e0 2023-10-06T02:26:48.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.801+0000 7f4472ffd700 1 --2- 172.21.15.6:0/3813728000 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f445c066f30 0x7f445c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.801+0000 7f4472ffd700 1 -- 172.21.15.6:0/3813728000 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7754+0+0 (secure 0 0 0) 0x7f446c085040 con 0x7f447c0af4e0 2023-10-06T02:26:48.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.801+0000 7f447a7fc700 1 --2- 172.21.15.6:0/3813728000 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f445c066f30 0x7f445c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.802+0000 7f447a7fc700 1 --2- 172.21.15.6:0/3813728000 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f445c066f30 0x7f445c0693e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f447c089810 tx=0x7f44640091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:48.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:48.805+0000 7f4472ffd700 1 -- 172.21.15.6:0/3813728000 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f446c051b30 con 0x7f447c0af4e0 2023-10-06T02:26:49.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.048+0000 7f44817ce700 1 -- 172.21.15.6:0/3813728000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f447c068c20 con 0x7f447c0af4e0 2023-10-06T02:26:49.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.048+0000 7f4472ffd700 1 -- 172.21.15.6:0/3813728000 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 191 v191) v1 ==== 95+0+4595 (secure 0 0 0) 0x7f446c055150 con 0x7f447c0af4e0 2023-10-06T02:26:49.050 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:49.050 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":191,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3743771475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3743771475},{"type":"v1","addr":"172.21.15.6:6835","nonce":3743771475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":191}],"filesystems":[{"mdsmap":{"epoch":190,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:47.858150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:49.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.050+0000 7f44817ce700 1 -- 172.21.15.6:0/3813728000 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f445c066f30 msgr2=0x7f445c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.050+0000 7f44817ce700 1 --2- 172.21.15.6:0/3813728000 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f445c066f30 0x7f445c0693e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f447c089810 tx=0x7f44640091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.050+0000 7f44817ce700 1 -- 172.21.15.6:0/3813728000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447c0af4e0 msgr2=0x7f447c1570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.050+0000 7f44817ce700 1 --2- 172.21.15.6:0/3813728000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447c0af4e0 0x7f447c1570b0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f446c00cc70 tx=0x7f446c001a30 comp rx=0 tx=0).stop 2023-10-06T02:26:49.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.050+0000 7f44817ce700 1 -- 172.21.15.6:0/3813728000 shutdown_connections 2023-10-06T02:26:49.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.050+0000 7f44817ce700 1 --2- 172.21.15.6:0/3813728000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f447c0b27f0 0x7f447c1555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.050+0000 7f44817ce700 1 --2- 172.21.15.6:0/3813728000 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f445c066f30 0x7f445c0693e0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.050+0000 7f44817ce700 1 --2- 172.21.15.6:0/3813728000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447c0af4e0 0x7f447c1570b0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.050+0000 7f44817ce700 1 --2- 172.21.15.6:0/3813728000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f447c0af8b0 0x7f447c15c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.050+0000 7f44817ce700 1 -- 172.21.15.6:0/3813728000 >> 172.21.15.6:0/3813728000 conn(0x7f447c068680 msgr2=0x7f447c06a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:49.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.050+0000 7f44817ce700 1 -- 172.21.15.6:0/3813728000 shutdown_connections 2023-10-06T02:26:49.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.050+0000 7f44817ce700 1 -- 172.21.15.6:0/3813728000 wait complete. 2023-10-06T02:26:49.053 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 191 2023-10-06T02:26:49.064 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt 1.00000000.inode' led to DAMAGED state 2023-10-06T02:26:49.064 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 200.00000000' 2023-10-06T02:26:49.064 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:49.064 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:26:49.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:49.065 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:26:49.079 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:26:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:26:49.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:26:49.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.239+0000 7f596a7ab700 1 Processor -- start 2023-10-06T02:26:49.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.239+0000 7f596a7ab700 1 -- start start 2023-10-06T02:26:49.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f596a7ab700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5964086ff0 0x7f5964087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f596a7ab700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59640b21b0 0x7f59640b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f596a7ab700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59640b2b70 con 0x7f596415a030 2023-10-06T02:26:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f596a7ab700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59640b0cf0 con 0x7f5964086ff0 2023-10-06T02:26:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f596a7ab700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59640879b0 con 0x7f59640b21b0 2023-10-06T02:26:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f59637fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5964086ff0 0x7f5964087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f5963fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f596415a030 0x7f596415a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60238/0 (socket says 172.21.15.6:60238) 2023-10-06T02:26:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f5963fff700 1 -- 172.21.15.6:0/2967644599 learned_addr learned my addr 172.21.15.6:0/2967644599 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f5968d48700 1 --2- 172.21.15.6:0/2967644599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59640b21b0 0x7f59640b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f5962ffd700 1 -- 172.21.15.6:0/2967644599 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587819215 0 0) 0x7f59640b2b70 con 0x7f596415a030 2023-10-06T02:26:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f5962ffd700 1 -- 172.21.15.6:0/2967644599 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5950003570 con 0x7f596415a030 2023-10-06T02:26:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f59637fe700 1 -- 172.21.15.6:0/2967644599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59640b21b0 msgr2=0x7f59640b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f59637fe700 1 --2- 172.21.15.6:0/2967644599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59640b21b0 0x7f59640b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f59637fe700 1 -- 172.21.15.6:0/2967644599 >> v1:172.21.15.6:6789/0 conn(0x7f596415a030 legacy=0x7f596415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f59637fe700 1 -- 172.21.15.6:0/2967644599 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59640afc50 con 0x7f5964086ff0 2023-10-06T02:26:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f5968d48700 1 --2- 172.21.15.6:0/2967644599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59640b21b0 0x7f59640b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f59637fe700 1 --2- 172.21.15.6:0/2967644599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5964086ff0 0x7f5964087470 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f59540098e0 tx=0x7f59540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31452532a0309df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f5962ffd700 1 -- 172.21.15.6:0/2967644599 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595400b640 con 0x7f5964086ff0 2023-10-06T02:26:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f5962ffd700 1 -- 172.21.15.6:0/2967644599 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595400b7a0 con 0x7f5964086ff0 2023-10-06T02:26:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.240+0000 7f5962ffd700 1 -- 172.21.15.6:0/2967644599 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595400bb40 con 0x7f5964086ff0 2023-10-06T02:26:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.241+0000 7f596a7ab700 1 -- 172.21.15.6:0/2967644599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5964086ff0 msgr2=0x7f5964087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.241+0000 7f596a7ab700 1 --2- 172.21.15.6:0/2967644599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5964086ff0 0x7f5964087470 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f59540098e0 tx=0x7f59540091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.241+0000 7f596a7ab700 1 -- 172.21.15.6:0/2967644599 shutdown_connections 2023-10-06T02:26:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.241+0000 7f596a7ab700 1 --2- 172.21.15.6:0/2967644599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59640b21b0 0x7f59640b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.241+0000 7f596a7ab700 1 --2- 172.21.15.6:0/2967644599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5964086ff0 0x7f5964087470 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.241+0000 7f596a7ab700 1 -- 172.21.15.6:0/2967644599 >> 172.21.15.6:0/2967644599 conn(0x7f5964068680 msgr2=0x7f5964068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.241+0000 7f596a7ab700 1 -- 172.21.15.6:0/2967644599 shutdown_connections 2023-10-06T02:26:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.241+0000 7f596a7ab700 1 -- 172.21.15.6:0/2967644599 wait complete. 2023-10-06T02:26:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.242+0000 7f596a7ab700 1 Processor -- start 2023-10-06T02:26:49.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.242+0000 7f596a7ab700 1 -- start start 2023-10-06T02:26:49.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.243+0000 7f596a7ab700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5964086ff0 0x7f59640c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.243+0000 7f596a7ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59640b21b0 0x7f5964156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.243+0000 7f596a7ab700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f596415a030 0x7f596416a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.243+0000 7f596a7ab700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59640c3c40 con 0x7f59640b21b0 2023-10-06T02:26:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.243+0000 7f596a7ab700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596416abc0 con 0x7f596415a030 2023-10-06T02:26:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.243+0000 7f596a7ab700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596416aea0 con 0x7f5964086ff0 2023-10-06T02:26:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.243+0000 7f59637fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59640b21b0 0x7f5964156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.243+0000 7f59637fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59640b21b0 0x7f5964156830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54620/0 (socket says 172.21.15.6:54620) 2023-10-06T02:26:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.243+0000 7f59637fe700 1 -- 172.21.15.6:0/2407177160 learned_addr learned my addr 172.21.15.6:0/2407177160 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.243+0000 7f5968d48700 1 --2- 172.21.15.6:0/2407177160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f596415a030 0x7f596416a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.243+0000 7f5963fff700 1 --2- 172.21.15.6:0/2407177160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5964086ff0 0x7f59640c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.243+0000 7f59637fe700 1 -- 172.21.15.6:0/2407177160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5964086ff0 msgr2=0x7f59640c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.243+0000 7f59637fe700 1 --2- 172.21.15.6:0/2407177160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5964086ff0 0x7f59640c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.243+0000 7f59637fe700 1 -- 172.21.15.6:0/2407177160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f596415a030 msgr2=0x7f596416a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.243+0000 7f59637fe700 1 --2- 172.21.15.6:0/2407177160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f596415a030 0x7f596416a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.243+0000 7f59637fe700 1 -- 172.21.15.6:0/2407177160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5954009420 con 0x7f59640b21b0 2023-10-06T02:26:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.244+0000 7f59637fe700 1 --2- 172.21.15.6:0/2407177160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59640b21b0 0x7f5964156830 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f59640cdd90 tx=0x7f5954017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.244+0000 7f595bfff700 1 -- 172.21.15.6:0/2407177160 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595401bcd0 con 0x7f59640b21b0 2023-10-06T02:26:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.244+0000 7f595bfff700 1 -- 172.21.15.6:0/2407177160 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595401be30 con 0x7f59640b21b0 2023-10-06T02:26:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.244+0000 7f596a7ab700 1 -- 172.21.15.6:0/2407177160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59640c3ee0 con 0x7f59640b21b0 2023-10-06T02:26:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.244+0000 7f595bfff700 1 -- 172.21.15.6:0/2407177160 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954011670 con 0x7f59640b21b0 2023-10-06T02:26:49.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.244+0000 7f596a7ab700 1 -- 172.21.15.6:0/2407177160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59640c5e80 con 0x7f59640b21b0 2023-10-06T02:26:49.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.245+0000 7f596a7ab700 1 -- 172.21.15.6:0/2407177160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59640c4400 con 0x7f59640b21b0 2023-10-06T02:26:49.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.245+0000 7f595bfff700 1 -- 172.21.15.6:0/2407177160 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5954011a20 con 0x7f59640b21b0 2023-10-06T02:26:49.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.245+0000 7f595bfff700 1 --2- 172.21.15.6:0/2407177160 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5944066f30 0x7f59440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.246+0000 7f595bfff700 1 -- 172.21.15.6:0/2407177160 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7754+0+0 (secure 0 0 0) 0x7f5954086330 con 0x7f59640b21b0 2023-10-06T02:26:49.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.246+0000 7f5963fff700 1 --2- 172.21.15.6:0/2407177160 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5944066f30 0x7f59440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.246+0000 7f5963fff700 1 --2- 172.21.15.6:0/2407177160 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5944066f30 0x7f59440693e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f59640c7410 tx=0x7f594c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.250+0000 7f595bfff700 1 -- 172.21.15.6:0/2407177160 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59640c4400 con 0x7f59640b21b0 2023-10-06T02:26:49.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.489+0000 7f596a7ab700 1 -- 172.21.15.6:0/2407177160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f59640c4400 con 0x7f59640b21b0 2023-10-06T02:26:49.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.872+0000 7f595bfff700 1 -- 172.21.15.6:0/2407177160 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v192) v1 ==== 161+0+0 (secure 0 0 0) 0x7f59640c4400 con 0x7f59640b21b0 2023-10-06T02:26:49.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.874+0000 7f596a7ab700 1 -- 172.21.15.6:0/2407177160 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5944066f30 msgr2=0x7f59440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.874+0000 7f596a7ab700 1 --2- 172.21.15.6:0/2407177160 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5944066f30 0x7f59440693e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f59640c7410 tx=0x7f594c009040 comp rx=0 tx=0).stop 2023-10-06T02:26:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.874+0000 7f596a7ab700 1 -- 172.21.15.6:0/2407177160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59640b21b0 msgr2=0x7f5964156830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.874+0000 7f596a7ab700 1 --2- 172.21.15.6:0/2407177160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59640b21b0 0x7f5964156830 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f59640cdd90 tx=0x7f5954017000 comp rx=0 tx=0).stop 2023-10-06T02:26:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.874+0000 7f596a7ab700 1 -- 172.21.15.6:0/2407177160 shutdown_connections 2023-10-06T02:26:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.874+0000 7f596a7ab700 1 --2- 172.21.15.6:0/2407177160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f596415a030 0x7f596416a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.874+0000 7f596a7ab700 1 --2- 172.21.15.6:0/2407177160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5964086ff0 0x7f59640c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.874+0000 7f596a7ab700 1 --2- 172.21.15.6:0/2407177160 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5944066f30 0x7f59440693e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.874+0000 7f596a7ab700 1 --2- 172.21.15.6:0/2407177160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59640b21b0 0x7f5964156830 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.874+0000 7f596a7ab700 1 -- 172.21.15.6:0/2407177160 >> 172.21.15.6:0/2407177160 conn(0x7f5964068680 msgr2=0x7f59640b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.875+0000 7f596a7ab700 1 -- 172.21.15.6:0/2407177160 shutdown_connections 2023-10-06T02:26:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:49.875+0000 7f596a7ab700 1 -- 172.21.15.6:0/2407177160 wait complete. 2023-10-06T02:26:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:26:49.897 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:26:50.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.016+0000 7f9de78d1700 1 Processor -- start 2023-10-06T02:26:50.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.016+0000 7f9de78d1700 1 -- start start 2023-10-06T02:26:50.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.017+0000 7f9de78d1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9de015a030 0x7f9de015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:50.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.017+0000 7f9de78d1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de00afc50 con 0x7f9de015a940 2023-10-06T02:26:50.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.017+0000 7f9de78d1700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de00aff30 con 0x7f9de0087700 2023-10-06T02:26:50.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.017+0000 7f9de78d1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de00b0cf0 con 0x7f9de015a030 2023-10-06T02:26:50.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.017+0000 7f9de566d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9de015a030 0x7f9de015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:50.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.017+0000 7f9de4e6c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9de015a940 0x7f9de0086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60254/0 (socket says 172.21.15.6:60254) 2023-10-06T02:26:50.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.017+0000 7f9de4e6c700 1 -- 172.21.15.6:0/2872792089 learned_addr learned my addr 172.21.15.6:0/2872792089 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:50.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.018+0000 7f9de566d700 1 -- 172.21.15.6:0/2872792089 >> v1:172.21.15.175:6789/0 conn(0x7f9de0087700 legacy=0x7f9de00b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:50.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.018+0000 7f9de566d700 1 -- 172.21.15.6:0/2872792089 >> v1:172.21.15.6:6789/0 conn(0x7f9de015a940 legacy=0x7f9de0086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:50.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.018+0000 7f9de566d700 1 -- 172.21.15.6:0/2872792089 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de00b0210 con 0x7f9de015a030 2023-10-06T02:26:50.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.018+0000 7f9ddffff700 1 -- 172.21.15.6:0/2872792089 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796769996 0 0) 0x7f9de00afc50 con 0x7f9de015a940 2023-10-06T02:26:50.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.018+0000 7f9de566d700 1 --2- 172.21.15.6:0/2872792089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de015a030 0x7f9de015a400 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80098e0 tx=0x7f9dd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae341122ffdb47e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:50.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.018+0000 7f9ddffff700 1 -- 172.21.15.6:0/2872792089 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8009e80 con 0x7f9de015a030 2023-10-06T02:26:50.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.018+0000 7f9ddffff700 1 -- 172.21.15.6:0/2872792089 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd800b860 con 0x7f9de015a030 2023-10-06T02:26:50.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.018+0000 7f9ddffff700 1 -- 172.21.15.6:0/2872792089 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd800bbe0 con 0x7f9de015a030 2023-10-06T02:26:50.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.018+0000 7f9de78d1700 1 -- 172.21.15.6:0/2872792089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de015a030 msgr2=0x7f9de015a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:50.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.018+0000 7f9de78d1700 1 --2- 172.21.15.6:0/2872792089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de015a030 0x7f9de015a400 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80098e0 tx=0x7f9dd80091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.018+0000 7f9de78d1700 1 -- 172.21.15.6:0/2872792089 shutdown_connections 2023-10-06T02:26:50.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.018+0000 7f9de78d1700 1 --2- 172.21.15.6:0/2872792089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de015a030 0x7f9de015a400 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.018+0000 7f9de78d1700 1 -- 172.21.15.6:0/2872792089 >> 172.21.15.6:0/2872792089 conn(0x7f9de0068680 msgr2=0x7f9de0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:50.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.019+0000 7f9de78d1700 1 -- 172.21.15.6:0/2872792089 shutdown_connections 2023-10-06T02:26:50.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.019+0000 7f9de78d1700 1 -- 172.21.15.6:0/2872792089 wait complete. 2023-10-06T02:26:50.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.020+0000 7f9de78d1700 1 Processor -- start 2023-10-06T02:26:50.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.020+0000 7f9de78d1700 1 -- start start 2023-10-06T02:26:50.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de78d1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de0087700 0x7f9de0169900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de78d1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9de015a030 0x7f9de015d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de78d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de015a940 0x7f9de01559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de78d1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00c6b00 con 0x7f9de015a940 2023-10-06T02:26:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de78d1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de015b5c0 con 0x7f9de0087700 2023-10-06T02:26:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de78d1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00c6260 con 0x7f9de015a030 2023-10-06T02:26:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de5e6e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de015a940 0x7f9de01559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de566d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de0087700 0x7f9de0169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de5e6e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de015a940 0x7f9de01559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54646/0 (socket says 172.21.15.6:54646) 2023-10-06T02:26:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de5e6e700 1 -- 172.21.15.6:0/3643268352 learned_addr learned my addr 172.21.15.6:0/3643268352 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de4e6c700 1 --2- 172.21.15.6:0/3643268352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9de015a030 0x7f9de015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de5e6e700 1 -- 172.21.15.6:0/3643268352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9de015a030 msgr2=0x7f9de015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de5e6e700 1 --2- 172.21.15.6:0/3643268352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9de015a030 0x7f9de015d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de5e6e700 1 -- 172.21.15.6:0/3643268352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de0087700 msgr2=0x7f9de0169900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de5e6e700 1 --2- 172.21.15.6:0/3643268352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de0087700 0x7f9de0169900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de5e6e700 1 -- 172.21.15.6:0/3643268352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd8009420 con 0x7f9de015a940 2023-10-06T02:26:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de5e6e700 1 --2- 172.21.15.6:0/3643268352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de015a940 0x7f9de01559f0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000c910 tx=0x7f9dd00016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9ddd7fa700 1 -- 172.21.15.6:0/3643268352 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0012630 con 0x7f9de015a940 2023-10-06T02:26:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9ddd7fa700 1 -- 172.21.15.6:0/3643268352 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd0012790 con 0x7f9de015a940 2023-10-06T02:26:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9ddd7fa700 1 -- 172.21.15.6:0/3643268352 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0012b30 con 0x7f9de015a940 2023-10-06T02:26:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.021+0000 7f9de78d1700 1 -- 172.21.15.6:0/3643268352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de00c6540 con 0x7f9de015a940 2023-10-06T02:26:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.022+0000 7f9de78d1700 1 -- 172.21.15.6:0/3643268352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de0169e40 con 0x7f9de015a940 2023-10-06T02:26:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.022+0000 7f9de78d1700 1 -- 172.21.15.6:0/3643268352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de015b390 con 0x7f9de015a940 2023-10-06T02:26:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.023+0000 7f9ddd7fa700 1 -- 172.21.15.6:0/3643268352 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9dd001a3a0 con 0x7f9de015a940 2023-10-06T02:26:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.023+0000 7f9ddd7fa700 1 --2- 172.21.15.6:0/3643268352 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9dcc066f30 0x7f9dcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.023+0000 7f9ddd7fa700 1 -- 172.21.15.6:0/3643268352 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7754+0+0 (secure 0 0 0) 0x7f9dd0084fb0 con 0x7f9de015a940 2023-10-06T02:26:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.024+0000 7f9de566d700 1 --2- 172.21.15.6:0/3643268352 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9dcc066f30 0x7f9dcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.024+0000 7f9de566d700 1 --2- 172.21.15.6:0/3643268352 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9dcc066f30 0x7f9dcc0693e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80093f0 tx=0x7f9dd8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.028+0000 7f9ddd7fa700 1 -- 172.21.15.6:0/3643268352 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9de015b390 con 0x7f9de015a940 2023-10-06T02:26:50.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.300+0000 7f9de78d1700 1 -- 172.21.15.6:0/3643268352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f9de015b390 con 0x7f9de015a940 2023-10-06T02:26:50.389 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:26:50.466 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:26:50.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.879+0000 7f9ddd7fa700 1 -- 172.21.15.6:0/3643268352 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v193) v1 ==== 101+0+0 (secure 0 0 0) 0x7f9de015b390 con 0x7f9de015a940 2023-10-06T02:26:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.881+0000 7f9de78d1700 1 -- 172.21.15.6:0/3643268352 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9dcc066f30 msgr2=0x7f9dcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.881+0000 7f9de78d1700 1 --2- 172.21.15.6:0/3643268352 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9dcc066f30 0x7f9dcc0693e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80093f0 tx=0x7f9dd8017000 comp rx=0 tx=0).stop 2023-10-06T02:26:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.882+0000 7f9de78d1700 1 -- 172.21.15.6:0/3643268352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de015a940 msgr2=0x7f9de01559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.882+0000 7f9de78d1700 1 --2- 172.21.15.6:0/3643268352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de015a940 0x7f9de01559f0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000c910 tx=0x7f9dd00016b0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.882+0000 7f9de78d1700 1 -- 172.21.15.6:0/3643268352 shutdown_connections 2023-10-06T02:26:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.882+0000 7f9de78d1700 1 --2- 172.21.15.6:0/3643268352 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9dcc066f30 0x7f9dcc0693e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.882+0000 7f9de78d1700 1 --2- 172.21.15.6:0/3643268352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de015a940 0x7f9de01559f0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.882+0000 7f9de78d1700 1 --2- 172.21.15.6:0/3643268352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de0087700 0x7f9de0169900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.882+0000 7f9de78d1700 1 --2- 172.21.15.6:0/3643268352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9de015a030 0x7f9de015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.882+0000 7f9de78d1700 1 -- 172.21.15.6:0/3643268352 >> 172.21.15.6:0/3643268352 conn(0x7f9de0068680 msgr2=0x7f9de0157830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.882+0000 7f9de78d1700 1 -- 172.21.15.6:0/3643268352 shutdown_connections 2023-10-06T02:26:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.882+0000 7f9de78d1700 1 -- 172.21.15.6:0/3643268352 wait complete. 2023-10-06T02:26:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:26:50.931 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:26:50.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.969+0000 7fa029820000 1 Processor -- start 2023-10-06T02:26:51.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.969+0000 7fa029820000 1 -- start start 2023-10-06T02:26:51.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa029820000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa010002300 0x5582f4f29c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa029820000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582f4fbb080 0x5582f4f2d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa029820000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5582f4fbdf50 0x5582f4fa3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa029820000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582f4e2f980 con 0x7fa010002300 2023-10-06T02:26:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa029820000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582f4e2f620 con 0x5582f4fbb080 2023-10-06T02:26:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa029820000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582f4e26400 con 0x5582f4fbdf50 2023-10-06T02:26:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa022a5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa010002300 0x5582f4f29c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa022a5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa010002300 0x5582f4f29c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54672/0 (socket says 172.21.15.6:54672) 2023-10-06T02:26:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa022a5b700 1 -- 172.21.15.6:0/841996687 learned_addr learned my addr 172.21.15.6:0/841996687 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa02325c700 1 --2- 172.21.15.6:0/841996687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5582f4fbdf50 0x5582f4fa3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa02225a700 1 --2- 172.21.15.6:0/841996687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582f4fbb080 0x5582f4f2d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa022a5b700 1 -- 172.21.15.6:0/841996687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5582f4fbdf50 msgr2=0x5582f4fa3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:51.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa022a5b700 1 --2- 172.21.15.6:0/841996687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5582f4fbdf50 0x5582f4fa3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa022a5b700 1 -- 172.21.15.6:0/841996687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582f4fbb080 msgr2=0x5582f4f2d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:51.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa022a5b700 1 --2- 172.21.15.6:0/841996687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582f4fbb080 0x5582f4f2d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa022a5b700 1 -- 172.21.15.6:0/841996687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582f4e3e3d0 con 0x7fa010002300 2023-10-06T02:26:51.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa022a5b700 1 --2- 172.21.15.6:0/841996687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa010002300 0x5582f4f29c70 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fa01c011000 tx=0x7fa01c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215349ab40c671e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:51.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa021258700 1 -- 172.21.15.6:0/841996687 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c0095a0 con 0x7fa010002300 2023-10-06T02:26:51.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa021258700 1 -- 172.21.15.6:0/841996687 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01c00b870 con 0x7fa010002300 2023-10-06T02:26:51.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.970+0000 7fa021258700 1 -- 172.21.15.6:0/841996687 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c00bb60 con 0x7fa010002300 2023-10-06T02:26:51.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.971+0000 7fa029820000 1 -- 172.21.15.6:0/841996687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa010002300 msgr2=0x5582f4f29c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.971+0000 7fa029820000 1 --2- 172.21.15.6:0/841996687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa010002300 0x5582f4f29c70 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fa01c011000 tx=0x7fa01c017000 comp rx=0 tx=0).stop 2023-10-06T02:26:51.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.971+0000 7fa029820000 1 -- 172.21.15.6:0/841996687 shutdown_connections 2023-10-06T02:26:51.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.971+0000 7fa029820000 1 --2- 172.21.15.6:0/841996687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5582f4fbdf50 0x5582f4fa3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.971+0000 7fa029820000 1 --2- 172.21.15.6:0/841996687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa010002300 0x5582f4f29c70 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.971+0000 7fa029820000 1 --2- 172.21.15.6:0/841996687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582f4fbb080 0x5582f4f2d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.971+0000 7fa029820000 1 -- 172.21.15.6:0/841996687 >> 172.21.15.6:0/841996687 conn(0x5582f4ee36c0 msgr2=0x5582f4f14840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:51.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.971+0000 7fa029820000 1 -- 172.21.15.6:0/841996687 shutdown_connections 2023-10-06T02:26:51.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.971+0000 7fa029820000 1 -- 172.21.15.6:0/841996687 wait complete. 2023-10-06T02:26:51.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.971+0000 7fa029820000 1 Processor -- start 2023-10-06T02:26:51.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.971+0000 7fa029820000 1 -- start start 2023-10-06T02:26:51.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.972+0000 7fa029820000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582f4fbb080 0x5582f4f2b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.972+0000 7fa029820000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582f4fbdf50 0x5582f4fbbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.972+0000 7fa029820000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa010002300 0x5582f4fa1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.972+0000 7fa029820000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582f4f0b9a0 con 0x5582f4fbdf50 2023-10-06T02:26:51.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.972+0000 7fa029820000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582f4f0aa80 con 0x5582f4fbb080 2023-10-06T02:26:51.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.972+0000 7fa029820000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582f4f0ad20 con 0x7fa010002300 2023-10-06T02:26:51.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.972+0000 7fa02225a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582f4fbdf50 0x5582f4fbbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.972+0000 7fa02225a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582f4fbdf50 0x5582f4fbbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54678/0 (socket says 172.21.15.6:54678) 2023-10-06T02:26:51.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.972+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 learned_addr learned my addr 172.21.15.6:0/311205515 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:51.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.972+0000 7fa02325c700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa010002300 0x5582f4fa1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.972+0000 7fa022a5b700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582f4fbb080 0x5582f4f2b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.973+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa010002300 msgr2=0x5582f4fa1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.973+0000 7fa02225a700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa010002300 0x5582f4fa1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.973+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582f4fbb080 msgr2=0x5582f4f2b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.973+0000 7fa02225a700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582f4fbb080 0x5582f4f2b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.973+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa010001e10 con 0x5582f4fbdf50 2023-10-06T02:26:51.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.973+0000 7fa02325c700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa010002300 0x5582f4fa1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:51.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.973+0000 7fa022a5b700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582f4fbb080 0x5582f4f2b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:51.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.973+0000 7fa02225a700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582f4fbdf50 0x5582f4fbbb50 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fa00c008840 tx=0x7fa00c00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.973+0000 7fa01b7fe700 1 -- 172.21.15.6:0/311205515 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c00f040 con 0x5582f4fbdf50 2023-10-06T02:26:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.973+0000 7fa01b7fe700 1 -- 172.21.15.6:0/311205515 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c0068c0 con 0x5582f4fbdf50 2023-10-06T02:26:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.973+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5582f4e31ae0 con 0x5582f4fbdf50 2023-10-06T02:26:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.973+0000 7fa01b7fe700 1 -- 172.21.15.6:0/311205515 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c006c80 con 0x5582f4fbdf50 2023-10-06T02:26:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.973+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582f4e31540 con 0x5582f4fbdf50 2023-10-06T02:26:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.974+0000 7fa01b7fe700 1 -- 172.21.15.6:0/311205515 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa00c016620 con 0x5582f4fbdf50 2023-10-06T02:26:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.975+0000 7fa01b7fe700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa0040658c0 0x7fa004067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.975+0000 7fa01b7fe700 1 -- 172.21.15.6:0/311205515 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7754+0+0 (secure 0 0 0) 0x7fa00c084770 con 0x5582f4fbdf50 2023-10-06T02:26:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.975+0000 7fa022a5b700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa0040658c0 0x7fa004067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.320 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:26:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.975+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5582f4fbc090 0x5582f4fccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.975+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4f0c560 con 0x5582f4fbc090 2023-10-06T02:26:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.975+0000 7fa02325c700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5582f4fbc090 0x5582f4fccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.975+0000 7fa02325c700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5582f4fbc090 0x5582f4fccb00 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.975+0000 7fa022a5b700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa0040658c0 0x7fa004067d70 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00c010 tx=0x7fa01c020000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.977+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v111'474 uv448 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.977+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fcd040 con 0x5582f4fbc090 2023-10-06T02:26:51.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.978+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v111'475 uv475 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.978+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fa24e0 con 0x5582f4fbc090 2023-10-06T02:26:51.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.979+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v111'476 uv476 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.322 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:26:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.979+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9bd0 con 0x5582f4fbc090 2023-10-06T02:26:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.980+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v111'477 uv477 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.980+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9f80 con 0x5582f4fbc090 2023-10-06T02:26:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.981+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v111'478 uv478 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.981+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd8bc0 con 0x5582f4fbc090 2023-10-06T02:26:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.982+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v111'479 uv479 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.982+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd8f70 con 0x5582f4fbc090 2023-10-06T02:26:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.983+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v111'480 uv454 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.983+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9320 con 0x5582f4fbc090 2023-10-06T02:26:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.984+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v111'481 uv481 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.984+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9320 con 0x5582f4fbc090 2023-10-06T02:26:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.985+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v111'482 uv482 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.326 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:26:51.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.985+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9320 con 0x5582f4fbc090 2023-10-06T02:26:51.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.986+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v111'483 uv483 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.986+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9320 con 0x5582f4fbc090 2023-10-06T02:26:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.987+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v111'484 uv484 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.987+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9320 con 0x5582f4fbc090 2023-10-06T02:26:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.988+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v111'485 uv485 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.988+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9320 con 0x5582f4fbc090 2023-10-06T02:26:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.989+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v111'486 uv461 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.989+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9320 con 0x5582f4fbc090 2023-10-06T02:26:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.990+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v111'487 uv487 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.990+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9320 con 0x5582f4fbc090 2023-10-06T02:26:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.991+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v111'488 uv488 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.329 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:26:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.991+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9320 con 0x5582f4fbc090 2023-10-06T02:26:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.992+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v111'489 uv489 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.992+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9320 con 0x5582f4fbc090 2023-10-06T02:26:51.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.993+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v111'490 uv490 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.993+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9320 con 0x5582f4fbc090 2023-10-06T02:26:51.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.994+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v111'491 uv491 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.994+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9700 con 0x5582f4fbc090 2023-10-06T02:26:51.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.995+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v111'492 uv492 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.995+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9700 con 0x5582f4fbc090 2023-10-06T02:26:51.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.996+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v111'493 uv467 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.996+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9700 con 0x5582f4fbc090 2023-10-06T02:26:51.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.997+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v111'494 uv494 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.997+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9700 con 0x5582f4fbc090 2023-10-06T02:26:51.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.998+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v111'495 uv495 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.397 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:26:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.998+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9700 con 0x5582f4fbc090 2023-10-06T02:26:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.999+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v111'496 uv496 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:50.999+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9700 con 0x5582f4fbc090 2023-10-06T02:26:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.000+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v111'497 uv497 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.000+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9700 con 0x5582f4fbc090 2023-10-06T02:26:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.001+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v111'498 uv498 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.001+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9700 con 0x5582f4fbc090 2023-10-06T02:26:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.002+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v111'499 uv473 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.002+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9700 con 0x5582f4fbc090 2023-10-06T02:26:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.003+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v111'500 uv500 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.003+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9700 con 0x5582f4fbc090 2023-10-06T02:26:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.004+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v111'501 uv501 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.400 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:26:51.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.004+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9700 con 0x5582f4fbc090 2023-10-06T02:26:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.005+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v111'502 uv502 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.005+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9700 con 0x5582f4fbc090 2023-10-06T02:26:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.006+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v111'503 uv503 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.006+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fd9700 con 0x5582f4fbc090 2023-10-06T02:26:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.007+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v111'504 uv504 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fbc090 2023-10-06T02:26:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.007+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5582f4fd9700 0x5582f4fdc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.007+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fdcd90 con 0x5582f4fd9700 2023-10-06T02:26:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.008+0000 7fa022a5b700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5582f4fd9700 0x5582f4fdc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.008+0000 7fa022a5b700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5582f4fd9700 0x5582f4fdc850 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.009+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v111'347 uv346 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.009+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fdd140 con 0x5582f4fd9700 2023-10-06T02:26:51.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.010+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v111'348 uv348 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.010+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fdd4f0 con 0x5582f4fd9700 2023-10-06T02:26:51.403 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:26:51.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.011+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v111'349 uv349 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.011+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fddd90 con 0x5582f4fd9700 2023-10-06T02:26:51.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.013+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v111'350 uv350 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.013+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fde140 con 0x5582f4fd9700 2023-10-06T02:26:51.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.014+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v111'351 uv351 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.014+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fde4f0 con 0x5582f4fd9700 2023-10-06T02:26:51.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.015+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v111'352 uv334 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.015+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fde8a0 con 0x5582f4fd9700 2023-10-06T02:26:51.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.016+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v111'353 uv353 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.016+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fde8a0 con 0x5582f4fd9700 2023-10-06T02:26:51.405 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:26:51.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.017+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v111'354 uv354 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.017+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fde8a0 con 0x5582f4fd9700 2023-10-06T02:26:51.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.018+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v111'355 uv355 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.018+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fde8a0 con 0x5582f4fd9700 2023-10-06T02:26:51.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.019+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v111'356 uv356 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.019+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fde8a0 con 0x5582f4fd9700 2023-10-06T02:26:51.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.020+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v111'357 uv339 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.020+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fde8a0 con 0x5582f4fd9700 2023-10-06T02:26:51.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.021+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v111'358 uv358 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.021+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fde8a0 con 0x5582f4fd9700 2023-10-06T02:26:51.433 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:26:51.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.022+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v111'359 uv359 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.022+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe1fc0 con 0x5582f4fd9700 2023-10-06T02:26:51.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.023+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v111'360 uv360 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.023+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe1fc0 con 0x5582f4fd9700 2023-10-06T02:26:51.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.024+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v111'361 uv361 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.024+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fde8a0 con 0x5582f4fd9700 2023-10-06T02:26:51.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.025+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v111'362 uv345 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.025+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fde8a0 con 0x5582f4fd9700 2023-10-06T02:26:51.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.026+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v111'363 uv363 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.026+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fde8a0 con 0x5582f4fd9700 2023-10-06T02:26:51.436 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:26:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.028+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v111'364 uv364 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.028+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fdf8b0 con 0x5582f4fd9700 2023-10-06T02:26:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.030+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v111'365 uv365 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.030+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fdf8b0 con 0x5582f4fd9700 2023-10-06T02:26:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.031+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v111'366 uv366 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.031+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fde8a0 con 0x5582f4fd9700 2023-10-06T02:26:51.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.032+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v111'367 uv367 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.032+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5582f4fdef20 0x5582f4fe1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.032+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe18e0 con 0x5582f4fdef20 2023-10-06T02:26:51.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.032+0000 7fa02225a700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5582f4fdef20 0x5582f4fe1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.032+0000 7fa02225a700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5582f4fdef20 0x5582f4fe1300 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:51.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.033+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v111'93 uv92 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.033+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe1d50 con 0x5582f4fdef20 2023-10-06T02:26:51.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.034+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v111'94 uv94 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.034+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe22d0 con 0x5582f4fdef20 2023-10-06T02:26:51.441 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:26:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.035+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v111'95 uv95 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.035+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fdd9c0 con 0x5582f4fdef20 2023-10-06T02:26:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.036+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v111'96 uv96 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.036+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe3d10 con 0x5582f4fdef20 2023-10-06T02:26:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.037+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v111'97 uv97 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.037+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe2c40 con 0x5582f4fdef20 2023-10-06T02:26:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.038+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v111'98 uv98 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.038+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe3040 con 0x5582f4fdef20 2023-10-06T02:26:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.039+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v111'68 uv67 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.039+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe3440 con 0x5582f4fdef20 2023-10-06T02:26:51.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.040+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v111'69 uv69 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.040+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe3440 con 0x5582f4fdef20 2023-10-06T02:26:51.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.041+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v111'70 uv70 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.458 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:26:51.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.041+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe33f0 con 0x5582f4fdef20 2023-10-06T02:26:51.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.042+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v111'71 uv71 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.042+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe33f0 con 0x5582f4fd9700 2023-10-06T02:26:51.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.043+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v111'93 uv92 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.043+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe33f0 con 0x5582f4fd9700 2023-10-06T02:26:51.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.044+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v111'94 uv94 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.044+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe33f0 con 0x5582f4fd9700 2023-10-06T02:26:51.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.046+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v111'95 uv95 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.460 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:26:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.046+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe33f0 con 0x5582f4fd9700 2023-10-06T02:26:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.047+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v111'96 uv96 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.047+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe33f0 con 0x5582f4fd9700 2023-10-06T02:26:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.048+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v111'97 uv97 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.048+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe33f0 con 0x5582f4fd9700 2023-10-06T02:26:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.049+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v111'98 uv98 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fd9700 2023-10-06T02:26:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.049+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5582f4fe4660 0x5582f4fe6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.049+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe6f80 con 0x5582f4fe4660 2023-10-06T02:26:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.049+0000 7fa02325c700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5582f4fe4660 0x5582f4fe6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.049+0000 7fa02325c700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5582f4fe4660 0x5582f4fe6a40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.050+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v111'171 uv165 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fe4660 2023-10-06T02:26:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.050+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe6f80 con 0x5582f4fe4660 2023-10-06T02:26:51.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.051+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v111'172 uv172 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fe4660 2023-10-06T02:26:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.052+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe6f80 con 0x5582f4fe4660 2023-10-06T02:26:51.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.053+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v111'173 uv173 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fe4660 2023-10-06T02:26:51.464 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:26:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.053+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe7f90 con 0x5582f4fe4660 2023-10-06T02:26:51.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.054+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v111'174 uv174 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fe4660 2023-10-06T02:26:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.054+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe7f90 con 0x5582f4fe4660 2023-10-06T02:26:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.055+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v111'175 uv175 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fe4660 2023-10-06T02:26:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.055+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe6f80 con 0x5582f4fe4660 2023-10-06T02:26:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.056+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v111'176 uv176 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fe4660 2023-10-06T02:26:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.056+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe6f80 con 0x5582f4fe4660 2023-10-06T02:26:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.057+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v111'177 uv170 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fe4660 2023-10-06T02:26:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.057+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe6f80 con 0x5582f4fe4660 2023-10-06T02:26:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.058+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v111'178 uv178 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fe4660 2023-10-06T02:26:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.059+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe6f80 con 0x5582f4fe4660 2023-10-06T02:26:51.476 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:26:51.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.060+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v111'179 uv179 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fe4660 2023-10-06T02:26:51.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.060+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe6f80 con 0x5582f4fe4660 2023-10-06T02:26:51.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.061+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v111'180 uv180 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fe4660 2023-10-06T02:26:51.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.061+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fe6f80 con 0x5582f4fe4660 2023-10-06T02:26:51.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.062+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v111'181 uv181 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fe4660 2023-10-06T02:26:51.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.062+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5582f4fe7600 0x5582f4fe99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.062+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fea130 con 0x5582f4fe7600 2023-10-06T02:26:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.062+0000 7fa022a5b700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5582f4fe7600 0x5582f4fe99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.063+0000 7fa022a5b700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5582f4fe7600 0x5582f4fe99e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.064+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v111'76 uv75 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fe7600 2023-10-06T02:26:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.064+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fea510 con 0x5582f4fe7600 2023-10-06T02:26:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.069+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v111'77 uv77 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fe7600 2023-10-06T02:26:51.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.069+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fea510 con 0x5582f4fe7600 2023-10-06T02:26:51.481 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:26:51.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.070+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v111'78 uv78 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fe7600 2023-10-06T02:26:51.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.070+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fea510 con 0x5582f4fe7600 2023-10-06T02:26:51.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.073+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v111'79 uv79 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fe7600 2023-10-06T02:26:51.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.073+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fea510 con 0x5582f4fe7600 2023-10-06T02:26:51.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.075+0000 7fa022a5b700 1 -- 172.21.15.6:0/311205515 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v111'80 uv80 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa01c000bc0 con 0x5582f4fe7600 2023-10-06T02:26:51.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.075+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fea510 con 0x5582f4fdef20 2023-10-06T02:26:51.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.076+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v111'93 uv92 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.076+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fea510 con 0x5582f4fdef20 2023-10-06T02:26:51.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.077+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v111'94 uv94 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.077+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fea510 con 0x5582f4fdef20 2023-10-06T02:26:51.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.077+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v111'95 uv95 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.590 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:26:51.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.078+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4feb520 con 0x5582f4fdef20 2023-10-06T02:26:51.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.078+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v111'96 uv96 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.078+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4feb520 con 0x5582f4fdef20 2023-10-06T02:26:51.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.079+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v111'97 uv97 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.079+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fea510 con 0x5582f4fdef20 2023-10-06T02:26:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.080+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v111'98 uv98 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.080+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5582f4feab90 0x5582f4fecf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.080+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fed5d0 con 0x5582f4feab90 2023-10-06T02:26:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.080+0000 7fa02225a700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5582f4feab90 0x5582f4fecf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.081+0000 7fa02225a700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5582f4feab90 0x5582f4fecf70 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:51.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.082+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v111'152 uv146 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4feab90 2023-10-06T02:26:51.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.082+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4feda00 con 0x5582f4feab90 2023-10-06T02:26:51.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.083+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v111'153 uv153 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4feab90 2023-10-06T02:26:51.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.083+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4feda00 con 0x5582f4feab90 2023-10-06T02:26:51.597 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:26:51.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.084+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v111'154 uv154 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4feab90 2023-10-06T02:26:51.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.084+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4feda00 con 0x5582f4feab90 2023-10-06T02:26:51.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.085+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v111'155 uv155 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4feab90 2023-10-06T02:26:51.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.085+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4feda00 con 0x5582f4feab90 2023-10-06T02:26:51.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.086+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v111'156 uv156 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4feab90 2023-10-06T02:26:51.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.086+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4feda00 con 0x5582f4feab90 2023-10-06T02:26:51.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.087+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v111'157 uv151 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4feab90 2023-10-06T02:26:51.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.087+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4feda00 con 0x5582f4feab90 2023-10-06T02:26:51.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.088+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v111'158 uv158 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4feab90 2023-10-06T02:26:51.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.088+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4feda00 con 0x5582f4feab90 2023-10-06T02:26:51.616 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:26:51.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.089+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v111'159 uv159 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4feab90 2023-10-06T02:26:51.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.089+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4feda00 con 0x5582f4feab90 2023-10-06T02:26:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.090+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v111'160 uv160 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4feab90 2023-10-06T02:26:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.090+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4ff0770 con 0x5582f4feab90 2023-10-06T02:26:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.091+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v111'161 uv161 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4feab90 2023-10-06T02:26:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.091+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fdef20 2023-10-06T02:26:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.093+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v111'70 uv69 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.093+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fdef20 2023-10-06T02:26:51.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.094+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v111'71 uv71 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.094+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fdef20 2023-10-06T02:26:51.621 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:26:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.096+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v111'72 uv72 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.096+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fdef20 2023-10-06T02:26:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.097+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v111'73 uv73 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.097+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5582f4fee800 0x5582f4ff0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.097+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fee800 2023-10-06T02:26:51.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.097+0000 7fa02325c700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5582f4fee800 0x5582f4ff0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.098+0000 7fa02325c700 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5582f4fee800 0x5582f4ff0ec0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:51.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.099+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v111'93 uv92 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fee800 2023-10-06T02:26:51.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.099+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fee800 2023-10-06T02:26:51.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.100+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v111'94 uv94 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fee800 2023-10-06T02:26:51.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.100+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fee800 2023-10-06T02:26:51.631 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:26:51.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.101+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v111'95 uv95 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fee800 2023-10-06T02:26:51.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.101+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fee800 2023-10-06T02:26:51.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.101+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v111'96 uv96 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fee800 2023-10-06T02:26:51.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.102+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fee800 2023-10-06T02:26:51.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.102+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v111'97 uv97 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fee800 2023-10-06T02:26:51.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.102+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fee800 2023-10-06T02:26:51.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.103+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v111'98 uv98 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fee800 2023-10-06T02:26:51.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.104+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fe4660 2023-10-06T02:26:51.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.105+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v111'79 uv78 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fe4660 2023-10-06T02:26:51.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.105+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fe4660 2023-10-06T02:26:51.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.106+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v111'80 uv80 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fe4660 2023-10-06T02:26:51.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.106+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fe4660 2023-10-06T02:26:51.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.107+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v111'81 uv81 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fe4660 2023-10-06T02:26:51.637 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:26:51.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.107+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fe4660 2023-10-06T02:26:51.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.108+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v111'82 uv82 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fe4660 2023-10-06T02:26:51.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.108+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fe4660 2023-10-06T02:26:51.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.109+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v111'83 uv83 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa014010a70 con 0x5582f4fe4660 2023-10-06T02:26:51.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.109+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fdef20 2023-10-06T02:26:51.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.110+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v111'192 uv186 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.110+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fdef20 2023-10-06T02:26:51.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.111+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v111'193 uv193 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.111+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fdef20 2023-10-06T02:26:51.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.112+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v111'194 uv194 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.712 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:26:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.112+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fdef20 2023-10-06T02:26:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.113+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v111'195 uv195 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.113+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4ff1450 con 0x5582f4fdef20 2023-10-06T02:26:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.114+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v111'196 uv196 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.114+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4ff1450 con 0x5582f4fdef20 2023-10-06T02:26:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.115+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v111'197 uv191 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.115+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fdef20 2023-10-06T02:26:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.116+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v111'198 uv198 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.116+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fdef20 2023-10-06T02:26:51.714 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:26:51.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.117+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v111'199 uv199 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.117+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fdef20 2023-10-06T02:26:51.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.118+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v111'200 uv200 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.118+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4fedef0 con 0x5582f4fdef20 2023-10-06T02:26:51.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.119+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v111'201 uv201 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.119+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4ff1400 con 0x5582f4fdef20 2023-10-06T02:26:51.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.120+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v111'202 uv202 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.120+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x5582f4ff1400 con 0x5582f4fdef20 2023-10-06T02:26:51.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa02225a700 1 -- 172.21.15.6:0/311205515 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v111'203 uv203 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa00c012050 con 0x5582f4fdef20 2023-10-06T02:26:51.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5582f4fdef20 msgr2=0x5582f4fe1300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5582f4fdef20 0x5582f4fe1300 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5582f4fbc090 msgr2=0x5582f4fccb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5582f4fbc090 0x5582f4fccb00 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5582f4feab90 msgr2=0x5582f4fecf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5582f4feab90 0x5582f4fecf70 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5582f4fd9700 msgr2=0x5582f4fdc850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5582f4fd9700 0x5582f4fdc850 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5582f4fee800 msgr2=0x5582f4ff0ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5582f4fee800 0x5582f4ff0ec0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 reap_dead start 2023-10-06T02:26:51.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5582f4fe7600 msgr2=0x5582f4fe99e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5582f4fe7600 0x5582f4fe99e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa02325c700 1 -- 172.21.15.6:0/311205515 reap_dead start 2023-10-06T02:26:51.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5582f4fe4660 msgr2=0x5582f4fe6a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5582f4fe4660 0x5582f4fe6a40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa0040658c0 msgr2=0x7fa004067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa0040658c0 0x7fa004067d70 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00c010 tx=0x7fa01c020000 comp rx=0 tx=0).stop 2023-10-06T02:26:51.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582f4fbdf50 msgr2=0x5582f4fbbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582f4fbdf50 0x5582f4fbbb50 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fa00c008840 tx=0x7fa00c00c040 comp rx=0 tx=0).stop 2023-10-06T02:26:51.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 shutdown_connections 2023-10-06T02:26:51.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5582f4fe7600 0x5582f4fe99e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582f4fbdf50 0x5582f4fbbb50 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa0040658c0 0x7fa004067d70 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 --2- 172.21.15.6:0/311205515 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5582f4fe4660 0x5582f4fe6a40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 >> 172.21.15.6:0/311205515 conn(0x5582f4ee36c0 msgr2=0x5582f4fbd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:51.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 shutdown_connections 2023-10-06T02:26:51.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.122+0000 7fa029820000 1 -- 172.21.15.6:0/311205515 wait complete. 2023-10-06T02:26:51.750 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 200.00000000 - 2023-10-06T02:26:51.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.798+0000 7f07a112d000 1 Processor -- start 2023-10-06T02:26:51.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.798+0000 7f07a112d000 1 -- start start 2023-10-06T02:26:51.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f07a112d000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c2e634a330 0x55c2e637ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f07a112d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2e640b8b0 0x55c2e637b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f07a112d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2e640bc80 0x55c2e6407de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f07a112d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e62f2320 con 0x55c2e640b8b0 2023-10-06T02:26:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f07a112d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e6296980 con 0x55c2e640bc80 2023-10-06T02:26:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f07a112d000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2e6296620 con 0x55c2e634a330 2023-10-06T02:26:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f0799b67700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2e640b8b0 0x55c2e637b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f0799b67700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2e640b8b0 0x55c2e637b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54682/0 (socket says 172.21.15.6:54682) 2023-10-06T02:26:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f0799b67700 1 -- 172.21.15.6:0/2400158171 learned_addr learned my addr 172.21.15.6:0/2400158171 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f079a368700 1 --2- 172.21.15.6:0/2400158171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c2e634a330 0x55c2e637ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f079ab69700 1 --2- 172.21.15.6:0/2400158171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2e640bc80 0x55c2e6407de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f0799b67700 1 -- 172.21.15.6:0/2400158171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c2e634a330 msgr2=0x55c2e637ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f0799b67700 1 --2- 172.21.15.6:0/2400158171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c2e634a330 0x55c2e637ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f0799b67700 1 -- 172.21.15.6:0/2400158171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2e640bc80 msgr2=0x55c2e6407de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f0799b67700 1 --2- 172.21.15.6:0/2400158171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2e640bc80 0x55c2e6407de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f0799b67700 1 -- 172.21.15.6:0/2400158171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0794005cf0 con 0x55c2e640b8b0 2023-10-06T02:26:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f079a368700 1 --2- 172.21.15.6:0/2400158171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c2e634a330 0x55c2e637ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f0799b67700 1 --2- 172.21.15.6:0/2400158171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2e640b8b0 0x55c2e637b240 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f078400b4d0 tx=0x7f0784001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5d61ed101e4bbc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f0798b65700 1 -- 172.21.15.6:0/2400158171 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784014070 con 0x55c2e640b8b0 2023-10-06T02:26:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f0798b65700 1 -- 172.21.15.6:0/2400158171 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078400d5d0 con 0x55c2e640b8b0 2023-10-06T02:26:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.799+0000 7f0798b65700 1 -- 172.21.15.6:0/2400158171 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078400d970 con 0x55c2e640b8b0 2023-10-06T02:26:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.800+0000 7f07a112d000 1 -- 172.21.15.6:0/2400158171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2e640b8b0 msgr2=0x55c2e637b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.800+0000 7f07a112d000 1 --2- 172.21.15.6:0/2400158171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2e640b8b0 0x55c2e637b240 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f078400b4d0 tx=0x7f0784001ab0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.800+0000 7f07a112d000 1 -- 172.21.15.6:0/2400158171 shutdown_connections 2023-10-06T02:26:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.800+0000 7f07a112d000 1 --2- 172.21.15.6:0/2400158171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2e640bc80 0x55c2e6407de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.800+0000 7f07a112d000 1 --2- 172.21.15.6:0/2400158171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c2e634a330 0x55c2e637ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.800+0000 7f07a112d000 1 --2- 172.21.15.6:0/2400158171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2e640b8b0 0x55c2e637b240 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.800+0000 7f07a112d000 1 -- 172.21.15.6:0/2400158171 >> 172.21.15.6:0/2400158171 conn(0x55c2e6392bd0 msgr2=0x55c2e64239d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.800+0000 7f07a112d000 1 -- 172.21.15.6:0/2400158171 shutdown_connections 2023-10-06T02:26:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.800+0000 7f07a112d000 1 -- 172.21.15.6:0/2400158171 wait complete. 2023-10-06T02:26:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.801+0000 7f07a112d000 1 Processor -- start 2023-10-06T02:26:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.801+0000 7f07a112d000 1 -- start start 2023-10-06T02:26:51.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.801+0000 7f07a112d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2e634a330 0x55c2e6426680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.801+0000 7f07a112d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2e640b8b0 0x55c2e64297f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.801+0000 7f07a112d000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c2e640bc80 0x55c2e637ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.801+0000 7f07a112d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e628d400 con 0x55c2e634a330 2023-10-06T02:26:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.801+0000 7f07a112d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e6428350 con 0x55c2e640b8b0 2023-10-06T02:26:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.801+0000 7f07a112d000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2e64285f0 con 0x55c2e640bc80 2023-10-06T02:26:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.802+0000 7f079a368700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2e634a330 0x55c2e6426680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.802+0000 7f079a368700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2e634a330 0x55c2e6426680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54684/0 (socket says 172.21.15.6:54684) 2023-10-06T02:26:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.802+0000 7f079a368700 1 -- 172.21.15.6:0/3926157176 learned_addr learned my addr 172.21.15.6:0/3926157176 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.802+0000 7f0799b67700 1 --2- 172.21.15.6:0/3926157176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2e640b8b0 0x55c2e64297f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.802+0000 7f079ab69700 1 --2- 172.21.15.6:0/3926157176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c2e640bc80 0x55c2e637ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.802+0000 7f079a368700 1 -- 172.21.15.6:0/3926157176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c2e640bc80 msgr2=0x55c2e637ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.802+0000 7f079a368700 1 --2- 172.21.15.6:0/3926157176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c2e640bc80 0x55c2e637ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.802+0000 7f079a368700 1 -- 172.21.15.6:0/3926157176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2e640b8b0 msgr2=0x55c2e64297f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.802+0000 7f079a368700 1 --2- 172.21.15.6:0/3926157176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2e640b8b0 0x55c2e64297f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.802+0000 7f079a368700 1 -- 172.21.15.6:0/3926157176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0784001d70 con 0x55c2e634a330 2023-10-06T02:26:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.802+0000 7f079a368700 1 --2- 172.21.15.6:0/3926157176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2e634a330 0x55c2e6426680 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f0794002000 tx=0x7f0794013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.802+0000 7f0792ffd700 1 -- 172.21.15.6:0/3926157176 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794007790 con 0x55c2e634a330 2023-10-06T02:26:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.802+0000 7f0792ffd700 1 -- 172.21.15.6:0/3926157176 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079401b040 con 0x55c2e634a330 2023-10-06T02:26:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.802+0000 7f07a112d000 1 -- 172.21.15.6:0/3926157176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c2e6298ae0 con 0x55c2e634a330 2023-10-06T02:26:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.802+0000 7f0792ffd700 1 -- 172.21.15.6:0/3926157176 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794007b00 con 0x55c2e634a330 2023-10-06T02:26:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.802+0000 7f07a112d000 1 -- 172.21.15.6:0/3926157176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2e6298540 con 0x55c2e634a330 2023-10-06T02:26:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.804+0000 7f0792ffd700 1 -- 172.21.15.6:0/3926157176 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f079401f3f0 con 0x55c2e634a330 2023-10-06T02:26:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.804+0000 7f0792ffd700 1 --2- 172.21.15.6:0/3926157176 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f077c065890 0x7f077c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.804+0000 7f0792ffd700 1 -- 172.21.15.6:0/3926157176 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7754+0+0 (secure 0 0 0) 0x7f0794084630 con 0x55c2e634a330 2023-10-06T02:26:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.804+0000 7f0799b67700 1 --2- 172.21.15.6:0/3926157176 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f077c065890 0x7f077c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.804+0000 7f07a112d000 1 --2- 172.21.15.6:0/3926157176 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55c2e6427dd0 0x55c2e641fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.805+0000 7f07a112d000 1 -- 172.21.15.6:0/3926157176 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:292cf221:::200.00000000:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x55c2e64200c0 con 0x55c2e6427dd0 2023-10-06T02:26:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.805+0000 7f079ab69700 1 --2- 172.21.15.6:0/3926157176 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55c2e6427dd0 0x55c2e641fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:51.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.805+0000 7f0799b67700 1 --2- 172.21.15.6:0/3926157176 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f077c065890 0x7f077c067d40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0784001b10 tx=0x7f0784014000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.805+0000 7f079ab69700 1 --2- 172.21.15.6:0/3926157176 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55c2e6427dd0 0x55c2e641fb80 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.807+0000 7f079ab69700 1 -- 172.21.15.6:0/3926157176 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 200.00000000 [writefull 0~80] v111'368 uv368 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f078c003180 con 0x55c2e6427dd0 2023-10-06T02:26:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.807+0000 7f07a112d000 1 -- 172.21.15.6:0/3926157176 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55c2e6427dd0 msgr2=0x55c2e641fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.807+0000 7f07a112d000 1 --2- 172.21.15.6:0/3926157176 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55c2e6427dd0 0x55c2e641fb80 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:51.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.807+0000 7f07a112d000 1 -- 172.21.15.6:0/3926157176 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f077c065890 msgr2=0x7f077c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.807+0000 7f07a112d000 1 --2- 172.21.15.6:0/3926157176 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f077c065890 0x7f077c067d40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0784001b10 tx=0x7f0784014000 comp rx=0 tx=0).stop 2023-10-06T02:26:51.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.807+0000 7f07a112d000 1 -- 172.21.15.6:0/3926157176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2e634a330 msgr2=0x55c2e6426680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:51.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.807+0000 7f07a112d000 1 --2- 172.21.15.6:0/3926157176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2e634a330 0x55c2e6426680 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f0794002000 tx=0x7f0794013000 comp rx=0 tx=0).stop 2023-10-06T02:26:51.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.807+0000 7f079ab69700 1 -- 172.21.15.6:0/3926157176 reap_dead start 2023-10-06T02:26:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.807+0000 7f07a112d000 1 -- 172.21.15.6:0/3926157176 shutdown_connections 2023-10-06T02:26:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.807+0000 7f07a112d000 1 -- 172.21.15.6:0/3926157176 >> 172.21.15.6:0/3926157176 conn(0x55c2e6392bd0 msgr2=0x55c2e64239d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.807+0000 7f07a112d000 1 -- 172.21.15.6:0/3926157176 shutdown_connections 2023-10-06T02:26:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:51.807+0000 7f07a112d000 1 -- 172.21.15.6:0/3926157176 wait complete. 2023-10-06T02:26:51.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:26:52.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.036+0000 7f7416ecc700 1 Processor -- start 2023-10-06T02:26:52.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.036+0000 7f7416ecc700 1 -- start start 2023-10-06T02:26:52.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.037+0000 7f7416ecc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f74100b0b40 0x7f74100b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:52.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.037+0000 7f7416ecc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74100b06b0 con 0x7f7410069d10 2023-10-06T02:26:52.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.037+0000 7f7416ecc700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74100b2970 con 0x7f74100af400 2023-10-06T02:26:52.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.037+0000 7f7416ecc700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74100afd80 con 0x7f74100b0b40 2023-10-06T02:26:52.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.037+0000 7f74166cb700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7410069d10 0x7f7410158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60278/0 (socket says 172.21.15.6:60278) 2023-10-06T02:26:52.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.037+0000 7f74166cb700 1 -- 172.21.15.6:0/2695316246 learned_addr learned my addr 172.21.15.6:0/2695316246 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:52.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.037+0000 7f74156c9700 1 --2- 172.21.15.6:0/2695316246 >> v2:172.21.15.175:3300/0 conn(0x7f74100b0b40 0x7f74100b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:52.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.037+0000 7f7414ec8700 1 -- 172.21.15.6:0/2695316246 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25019140 0 0) 0x7f74100b06b0 con 0x7f7410069d10 2023-10-06T02:26:52.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.037+0000 7f7414ec8700 1 -- 172.21.15.6:0/2695316246 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73fc003570 con 0x7f7410069d10 2023-10-06T02:26:52.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.037+0000 7f74156c9700 1 -- 172.21.15.6:0/2695316246 >> v1:172.21.15.175:6789/0 conn(0x7f74100af400 legacy=0x7f741015a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:52.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.037+0000 7f74156c9700 1 -- 172.21.15.6:0/2695316246 >> v1:172.21.15.6:6789/0 conn(0x7f7410069d10 legacy=0x7f7410158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:52.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.038+0000 7f74156c9700 1 -- 172.21.15.6:0/2695316246 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74100b0060 con 0x7f74100b0b40 2023-10-06T02:26:52.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.038+0000 7f74156c9700 1 --2- 172.21.15.6:0/2695316246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74100b0b40 0x7f74100b2270 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f74000098e0 tx=0x7f74000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea35551a7dfaeb89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:52.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.038+0000 7f7414ec8700 1 -- 172.21.15.6:0/2695316246 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740000b640 con 0x7f74100b0b40 2023-10-06T02:26:52.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.038+0000 7f7414ec8700 1 -- 172.21.15.6:0/2695316246 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740000b7a0 con 0x7f74100b0b40 2023-10-06T02:26:52.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.038+0000 7f7414ec8700 1 -- 172.21.15.6:0/2695316246 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740000bb40 con 0x7f74100b0b40 2023-10-06T02:26:52.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.038+0000 7f7416ecc700 1 -- 172.21.15.6:0/2695316246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74100b0b40 msgr2=0x7f74100b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:52.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.038+0000 7f7416ecc700 1 --2- 172.21.15.6:0/2695316246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74100b0b40 0x7f74100b2270 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f74000098e0 tx=0x7f74000091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.038+0000 7f7416ecc700 1 -- 172.21.15.6:0/2695316246 shutdown_connections 2023-10-06T02:26:52.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.038+0000 7f7416ecc700 1 --2- 172.21.15.6:0/2695316246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74100b0b40 0x7f74100b2270 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.038+0000 7f7416ecc700 1 -- 172.21.15.6:0/2695316246 >> 172.21.15.6:0/2695316246 conn(0x7f74100d0c10 msgr2=0x7f74100ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:52.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.038+0000 7f7416ecc700 1 -- 172.21.15.6:0/2695316246 shutdown_connections 2023-10-06T02:26:52.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.039+0000 7f7416ecc700 1 -- 172.21.15.6:0/2695316246 wait complete. 2023-10-06T02:26:52.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.040+0000 7f7416ecc700 1 Processor -- start 2023-10-06T02:26:52.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.040+0000 7f7416ecc700 1 -- start start 2023-10-06T02:26:52.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.040+0000 7f7416ecc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7410069d10 0x7f74100a7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:52.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.040+0000 7f7416ecc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74100af400 0x7f74100ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:52.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.040+0000 7f7416ecc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74100b0b40 0x7f7410151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:52.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.040+0000 7f7416ecc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74100ca720 con 0x7f7410069d10 2023-10-06T02:26:52.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.040+0000 7f7416ecc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74100ca950 con 0x7f74100af400 2023-10-06T02:26:52.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.040+0000 7f7416ecc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74100c7430 con 0x7f74100b0b40 2023-10-06T02:26:52.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.040+0000 7f7415eca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7410069d10 0x7f74100a7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:52.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.040+0000 7f7415eca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7410069d10 0x7f74100a7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54696/0 (socket says 172.21.15.6:54696) 2023-10-06T02:26:52.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.040+0000 7f7415eca700 1 -- 172.21.15.6:0/4171928309 learned_addr learned my addr 172.21.15.6:0/4171928309 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:52.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.041+0000 7f74166cb700 1 --2- 172.21.15.6:0/4171928309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74100b0b40 0x7f7410151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:52.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.041+0000 7f74156c9700 1 --2- 172.21.15.6:0/4171928309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74100af400 0x7f74100ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:52.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.041+0000 7f7415eca700 1 -- 172.21.15.6:0/4171928309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74100b0b40 msgr2=0x7f7410151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:52.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.041+0000 7f7415eca700 1 --2- 172.21.15.6:0/4171928309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74100b0b40 0x7f7410151410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.041+0000 7f7415eca700 1 -- 172.21.15.6:0/4171928309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74100af400 msgr2=0x7f74100ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:52.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.041+0000 7f7415eca700 1 --2- 172.21.15.6:0/4171928309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74100af400 0x7f74100ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.041+0000 7f7415eca700 1 -- 172.21.15.6:0/4171928309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7400009420 con 0x7f7410069d10 2023-10-06T02:26:52.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.041+0000 7f74156c9700 1 --2- 172.21.15.6:0/4171928309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74100af400 0x7f74100ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:52.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.041+0000 7f7415eca700 1 --2- 172.21.15.6:0/4171928309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7410069d10 0x7f74100a7940 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f740c00c590 tx=0x7f740c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:52.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.041+0000 7f7405ffb700 1 -- 172.21.15.6:0/4171928309 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c011590 con 0x7f7410069d10 2023-10-06T02:26:52.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.041+0000 7f7405ffb700 1 -- 172.21.15.6:0/4171928309 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740c0116f0 con 0x7f7410069d10 2023-10-06T02:26:52.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.041+0000 7f7405ffb700 1 -- 172.21.15.6:0/4171928309 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c011ab0 con 0x7f7410069d10 2023-10-06T02:26:52.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.041+0000 7f7416ecc700 1 -- 172.21.15.6:0/4171928309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74100c7710 con 0x7f7410069d10 2023-10-06T02:26:52.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.041+0000 7f7416ecc700 1 -- 172.21.15.6:0/4171928309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74100cac30 con 0x7f7410069d10 2023-10-06T02:26:52.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.042+0000 7f7416ecc700 1 -- 172.21.15.6:0/4171928309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74100c7c30 con 0x7f7410069d10 2023-10-06T02:26:52.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.042+0000 7f7405ffb700 1 -- 172.21.15.6:0/4171928309 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f740c01b3b0 con 0x7f7410069d10 2023-10-06T02:26:52.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.043+0000 7f7405ffb700 1 --2- 172.21.15.6:0/4171928309 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f73f4066f30 0x7f73f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:52.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.043+0000 7f7405ffb700 1 -- 172.21.15.6:0/4171928309 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7754+0+0 (secure 0 0 0) 0x7f740c084360 con 0x7f7410069d10 2023-10-06T02:26:52.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.043+0000 7f74156c9700 1 --2- 172.21.15.6:0/4171928309 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f73f4066f30 0x7f73f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:52.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.044+0000 7f74156c9700 1 --2- 172.21.15.6:0/4171928309 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f73f4066f30 0x7f73f40693e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f74100a8d30 tx=0x7f7400017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:52.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.047+0000 7f7405ffb700 1 -- 172.21.15.6:0/4171928309 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74100c7c30 con 0x7f7410069d10 2023-10-06T02:26:52.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.286+0000 7f7416ecc700 1 -- 172.21.15.6:0/4171928309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f7410064ee0 con 0x7f7410069d10 2023-10-06T02:26:52.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.887+0000 7f7405ffb700 1 -- 172.21.15.6:0/4171928309 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v194) v1 ==== 162+0+0 (secure 0 0 0) 0x7f740c017020 con 0x7f7410069d10 2023-10-06T02:26:52.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.890+0000 7f7416ecc700 1 -- 172.21.15.6:0/4171928309 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f73f4066f30 msgr2=0x7f73f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:52.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.890+0000 7f7416ecc700 1 --2- 172.21.15.6:0/4171928309 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f73f4066f30 0x7f73f40693e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f74100a8d30 tx=0x7f7400017000 comp rx=0 tx=0).stop 2023-10-06T02:26:52.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.890+0000 7f7416ecc700 1 -- 172.21.15.6:0/4171928309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7410069d10 msgr2=0x7f74100a7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:52.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.890+0000 7f7416ecc700 1 --2- 172.21.15.6:0/4171928309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7410069d10 0x7f74100a7940 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f740c00c590 tx=0x7f740c00c950 comp rx=0 tx=0).stop 2023-10-06T02:26:52.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.890+0000 7f7416ecc700 1 -- 172.21.15.6:0/4171928309 shutdown_connections 2023-10-06T02:26:52.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.890+0000 7f7416ecc700 1 --2- 172.21.15.6:0/4171928309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74100b0b40 0x7f7410151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.890+0000 7f7416ecc700 1 --2- 172.21.15.6:0/4171928309 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f73f4066f30 0x7f73f40693e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.890+0000 7f7416ecc700 1 --2- 172.21.15.6:0/4171928309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7410069d10 0x7f74100a7940 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.890+0000 7f7416ecc700 1 --2- 172.21.15.6:0/4171928309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74100af400 0x7f74100ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.890+0000 7f7416ecc700 1 -- 172.21.15.6:0/4171928309 >> 172.21.15.6:0/4171928309 conn(0x7f74100d0c10 msgr2=0x7f74100b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:52.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.890+0000 7f7416ecc700 1 -- 172.21.15.6:0/4171928309 shutdown_connections 2023-10-06T02:26:52.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:52.890+0000 7f7416ecc700 1 -- 172.21.15.6:0/4171928309 wait complete. 2023-10-06T02:26:52.893 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:26:52.895 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:26:52.894+0000 7f6fd7361700 -1 log_channel(cluster) log [ERR] : Error recovering journal 0x200: (22) Invalid argument 2023-10-06T02:26:52.896 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:26:52.895+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:26:52.897 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:26:52.895+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:26:52.902 INFO:tasks.ceph.mds.a.smithi006.stderr: -13> 2023-10-06T02:26:52.894+0000 7f6fd7361700 -1 log_channel(cluster) log [ERR] : Error recovering journal 0x200: (22) Invalid argument 2023-10-06T02:26:52.907 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:52.924 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:26:53.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.030+0000 7f18ccc08700 1 Processor -- start 2023-10-06T02:26:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.030+0000 7f18ccc08700 1 -- start start 2023-10-06T02:26:53.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18ccc08700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18c80af4e0 0x7f18c80b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18ccc08700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f18c80af8b0 0x7f18c80b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18ccc08700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18c815d460 0x7f18c815d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18ccc08700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c80b1910 con 0x7f18c80af4e0 2023-10-06T02:26:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18ccc08700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c815e190 con 0x7f18c80af8b0 2023-10-06T02:26:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18ccc08700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c80cb650 con 0x7f18c815d460 2023-10-06T02:26:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18c659c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18c80af4e0 0x7f18c80b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18c659c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18c80af4e0 0x7f18c80b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54730/0 (socket says 172.21.15.6:54730) 2023-10-06T02:26:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18c659c700 1 -- 172.21.15.6:0/2227289808 learned_addr learned my addr 172.21.15.6:0/2227289808 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18c6d9d700 1 --2- 172.21.15.6:0/2227289808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18c815d460 0x7f18c815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18c659c700 1 -- 172.21.15.6:0/2227289808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18c815d460 msgr2=0x7f18c815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18c5d9b700 1 --2- 172.21.15.6:0/2227289808 >> v2:172.21.15.175:3300/0 conn(0x7f18c80af8b0 0x7f18c80b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18c659c700 1 --2- 172.21.15.6:0/2227289808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18c815d460 0x7f18c815d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18c659c700 1 -- 172.21.15.6:0/2227289808 >> v2:172.21.15.175:3300/0 conn(0x7f18c80af8b0 msgr2=0x7f18c80b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18c659c700 1 --2- 172.21.15.6:0/2227289808 >> v2:172.21.15.175:3300/0 conn(0x7f18c80af8b0 0x7f18c80b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18c659c700 1 -- 172.21.15.6:0/2227289808 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c80b2b60 con 0x7f18c80af4e0 2023-10-06T02:26:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18c6d9d700 1 --2- 172.21.15.6:0/2227289808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18c815d460 0x7f18c815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18c5d9b700 1 --2- 172.21.15.6:0/2227289808 >> v2:172.21.15.175:3300/0 conn(0x7f18c80af8b0 0x7f18c80b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18c659c700 1 --2- 172.21.15.6:0/2227289808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18c80af4e0 0x7f18c80b20e0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f18c80cdd50 tx=0x7f18b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29389d8fe3297ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:53.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18c559a700 1 -- 172.21.15.6:0/2227289808 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b800b860 con 0x7f18c80af4e0 2023-10-06T02:26:53.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18c559a700 1 -- 172.21.15.6:0/2227289808 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b800b9c0 con 0x7f18c80af4e0 2023-10-06T02:26:53.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.031+0000 7f18c559a700 1 -- 172.21.15.6:0/2227289808 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b800bd60 con 0x7f18c80af4e0 2023-10-06T02:26:53.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.032+0000 7f18ccc08700 1 -- 172.21.15.6:0/2227289808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18c80af4e0 msgr2=0x7f18c80b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:53.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.032+0000 7f18ccc08700 1 --2- 172.21.15.6:0/2227289808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18c80af4e0 0x7f18c80b20e0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f18c80cdd50 tx=0x7f18b8009250 comp rx=0 tx=0).stop 2023-10-06T02:26:53.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.032+0000 7f18ccc08700 1 -- 172.21.15.6:0/2227289808 shutdown_connections 2023-10-06T02:26:53.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.032+0000 7f18ccc08700 1 --2- 172.21.15.6:0/2227289808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18c815d460 0x7f18c815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.032+0000 7f18ccc08700 1 --2- 172.21.15.6:0/2227289808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18c80af4e0 0x7f18c80b20e0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.032+0000 7f18ccc08700 1 --2- 172.21.15.6:0/2227289808 >> v2:172.21.15.175:3300/0 conn(0x7f18c80af8b0 0x7f18c80b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.032+0000 7f18ccc08700 1 -- 172.21.15.6:0/2227289808 >> 172.21.15.6:0/2227289808 conn(0x7f18c8068680 msgr2=0x7f18c8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:53.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.032+0000 7f18ccc08700 1 -- 172.21.15.6:0/2227289808 shutdown_connections 2023-10-06T02:26:53.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.032+0000 7f18ccc08700 1 -- 172.21.15.6:0/2227289808 wait complete. 2023-10-06T02:26:53.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.033+0000 7f18ccc08700 1 Processor -- start 2023-10-06T02:26:53.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.033+0000 7f18ccc08700 1 -- start start 2023-10-06T02:26:53.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18ccc08700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18c80af4e0 0x7f18c81517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18ccc08700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18c80af8b0 0x7f18c81583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18ccc08700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18c815d460 0x7f18c8153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18ccc08700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c8151d30 con 0x7f18c815d460 2023-10-06T02:26:53.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18ccc08700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c80cf160 con 0x7f18c80af4e0 2023-10-06T02:26:53.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18ccc08700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c8158920 con 0x7f18c80af8b0 2023-10-06T02:26:53.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18c6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18c815d460 0x7f18c8153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18c6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18c815d460 0x7f18c8153510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54732/0 (socket says 172.21.15.6:54732) 2023-10-06T02:26:53.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18c6d9d700 1 -- 172.21.15.6:0/3991970951 learned_addr learned my addr 172.21.15.6:0/3991970951 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:53.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18c659c700 1 --2- 172.21.15.6:0/3991970951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18c80af4e0 0x7f18c81517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18c5d9b700 1 --2- 172.21.15.6:0/3991970951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18c80af8b0 0x7f18c81583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18c6d9d700 1 -- 172.21.15.6:0/3991970951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18c80af8b0 msgr2=0x7f18c81583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:53.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18c6d9d700 1 --2- 172.21.15.6:0/3991970951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18c80af8b0 0x7f18c81583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18c6d9d700 1 -- 172.21.15.6:0/3991970951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18c80af4e0 msgr2=0x7f18c81517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:53.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18c6d9d700 1 --2- 172.21.15.6:0/3991970951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18c80af4e0 0x7f18c81517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18c6d9d700 1 -- 172.21.15.6:0/3991970951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b80094f0 con 0x7f18c815d460 2023-10-06T02:26:53.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18c5d9b700 1 --2- 172.21.15.6:0/3991970951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18c80af8b0 0x7f18c81583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:53.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.034+0000 7f18c6d9d700 1 --2- 172.21.15.6:0/3991970951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18c815d460 0x7f18c8153510 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f18c000cef0 tx=0x7f18c0007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:53.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.035+0000 7f18b67fc700 1 -- 172.21.15.6:0/3991970951 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c000ae00 con 0x7f18c815d460 2023-10-06T02:26:53.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.035+0000 7f18b67fc700 1 -- 172.21.15.6:0/3991970951 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c0016420 con 0x7f18c815d460 2023-10-06T02:26:53.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.035+0000 7f18b67fc700 1 -- 172.21.15.6:0/3991970951 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c00167e0 con 0x7f18c815d460 2023-10-06T02:26:53.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.035+0000 7f18ccc08700 1 -- 172.21.15.6:0/3991970951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c816d1c0 con 0x7f18c815d460 2023-10-06T02:26:53.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.035+0000 7f18ccc08700 1 -- 172.21.15.6:0/3991970951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c816d780 con 0x7f18c815d460 2023-10-06T02:26:53.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.035+0000 7f18ccc08700 1 -- 172.21.15.6:0/3991970951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c8088aa0 con 0x7f18c815d460 2023-10-06T02:26:53.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.036+0000 7f18b67fc700 1 -- 172.21.15.6:0/3991970951 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18c0016bd0 con 0x7f18c815d460 2023-10-06T02:26:53.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.036+0000 7f18b67fc700 1 --2- 172.21.15.6:0/3991970951 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f18a8066f30 0x7f18a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.036+0000 7f18b67fc700 1 -- 172.21.15.6:0/3991970951 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7840+0+0 (secure 0 0 0) 0x7f18c0012070 con 0x7f18c815d460 2023-10-06T02:26:53.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.037+0000 7f18c659c700 1 --2- 172.21.15.6:0/3991970951 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f18a8066f30 0x7f18a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.037+0000 7f18c659c700 1 --2- 172.21.15.6:0/3991970951 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f18a8066f30 0x7f18a80693e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f18c80cdd50 tx=0x7f18b8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:53.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.041+0000 7f18b67fc700 1 -- 172.21.15.6:0/3991970951 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18c004e5a0 con 0x7f18c815d460 2023-10-06T02:26:53.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.276+0000 7f18ccc08700 1 -- 172.21.15.6:0/3991970951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18c80cad20 con 0x7f18c815d460 2023-10-06T02:26:53.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.277+0000 7f18b67fc700 1 -- 172.21.15.6:0/3991970951 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 196 v196) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f18c0052140 con 0x7f18c815d460 2023-10-06T02:26:53.279 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:53.279 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":196,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":196,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:52.897148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:53.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.279+0000 7f18ccc08700 1 -- 172.21.15.6:0/3991970951 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f18a8066f30 msgr2=0x7f18a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:53.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.279+0000 7f18ccc08700 1 --2- 172.21.15.6:0/3991970951 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f18a8066f30 0x7f18a80693e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f18c80cdd50 tx=0x7f18b8017000 comp rx=0 tx=0).stop 2023-10-06T02:26:53.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.279+0000 7f18ccc08700 1 -- 172.21.15.6:0/3991970951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18c815d460 msgr2=0x7f18c8153510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:53.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.279+0000 7f18ccc08700 1 --2- 172.21.15.6:0/3991970951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18c815d460 0x7f18c8153510 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f18c000cef0 tx=0x7f18c0007860 comp rx=0 tx=0).stop 2023-10-06T02:26:53.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.279+0000 7f18ccc08700 1 -- 172.21.15.6:0/3991970951 shutdown_connections 2023-10-06T02:26:53.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.279+0000 7f18ccc08700 1 --2- 172.21.15.6:0/3991970951 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f18a8066f30 0x7f18a80693e0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.279+0000 7f18ccc08700 1 --2- 172.21.15.6:0/3991970951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18c815d460 0x7f18c8153510 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.279+0000 7f18ccc08700 1 --2- 172.21.15.6:0/3991970951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18c80af4e0 0x7f18c81517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.279+0000 7f18ccc08700 1 --2- 172.21.15.6:0/3991970951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18c80af8b0 0x7f18c81583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.279+0000 7f18ccc08700 1 -- 172.21.15.6:0/3991970951 >> 172.21.15.6:0/3991970951 conn(0x7f18c8068680 msgr2=0x7f18c815afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:53.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.279+0000 7f18ccc08700 1 -- 172.21.15.6:0/3991970951 shutdown_connections 2023-10-06T02:26:53.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.279+0000 7f18ccc08700 1 -- 172.21.15.6:0/3991970951 wait complete. 2023-10-06T02:26:53.282 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 196 2023-10-06T02:26:53.292 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:26:53.293 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:53.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.450+0000 7fc686c0d700 1 Processor -- start 2023-10-06T02:26:53.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.450+0000 7fc686c0d700 1 -- start start 2023-10-06T02:26:53.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.451+0000 7fc686c0d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc680159380 0x7fc680159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.451+0000 7fc686c0d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6800ccb60 con 0x7fc6800b20e0 2023-10-06T02:26:53.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.451+0000 7fc686c0d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6800cb6c0 con 0x7fc68015d4d0 2023-10-06T02:26:53.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.451+0000 7fc686c0d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68015e200 con 0x7fc680159380 2023-10-06T02:26:53.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.451+0000 7fc6849a9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc680159380 0x7fc680159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.451+0000 7fc67ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc6800b20e0 0x7fc6800b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60298/0 (socket says 172.21.15.6:60298) 2023-10-06T02:26:53.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.451+0000 7fc67ffff700 1 -- 172.21.15.6:0/4241533458 learned_addr learned my addr 172.21.15.6:0/4241533458 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:53.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.452+0000 7fc6849a9700 1 -- 172.21.15.6:0/4241533458 >> v1:172.21.15.175:6789/0 conn(0x7fc68015d4d0 legacy=0x7fc68015d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:53.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.452+0000 7fc6849a9700 1 -- 172.21.15.6:0/4241533458 >> v1:172.21.15.6:6789/0 conn(0x7fc6800b20e0 legacy=0x7fc6800b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:53.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.452+0000 7fc6849a9700 1 -- 172.21.15.6:0/4241533458 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6800c3ef0 con 0x7fc680159380 2023-10-06T02:26:53.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.452+0000 7fc67f7fe700 1 -- 172.21.15.6:0/4241533458 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720365960 0 0) 0x7fc6800ccb60 con 0x7fc6800b20e0 2023-10-06T02:26:53.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.452+0000 7fc6849a9700 1 --2- 172.21.15.6:0/4241533458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc680159380 0x7fc680159750 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fc6780098e0 tx=0x7fc6780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9984496211ccc557 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:53.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.452+0000 7fc67f7fe700 1 -- 172.21.15.6:0/4241533458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678009e80 con 0x7fc680159380 2023-10-06T02:26:53.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.452+0000 7fc67f7fe700 1 -- 172.21.15.6:0/4241533458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67800b860 con 0x7fc680159380 2023-10-06T02:26:53.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.452+0000 7fc67f7fe700 1 -- 172.21.15.6:0/4241533458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67800bbe0 con 0x7fc680159380 2023-10-06T02:26:53.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.452+0000 7fc686c0d700 1 -- 172.21.15.6:0/4241533458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc680159380 msgr2=0x7fc680159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:53.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.452+0000 7fc686c0d700 1 --2- 172.21.15.6:0/4241533458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc680159380 0x7fc680159750 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fc6780098e0 tx=0x7fc6780091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.452+0000 7fc686c0d700 1 -- 172.21.15.6:0/4241533458 shutdown_connections 2023-10-06T02:26:53.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.452+0000 7fc686c0d700 1 --2- 172.21.15.6:0/4241533458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc680159380 0x7fc680159750 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.452+0000 7fc686c0d700 1 -- 172.21.15.6:0/4241533458 >> 172.21.15.6:0/4241533458 conn(0x7fc680068680 msgr2=0x7fc680068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:53.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.453+0000 7fc686c0d700 1 -- 172.21.15.6:0/4241533458 shutdown_connections 2023-10-06T02:26:53.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.453+0000 7fc686c0d700 1 -- 172.21.15.6:0/4241533458 wait complete. 2023-10-06T02:26:53.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.454+0000 7fc686c0d700 1 Processor -- start 2023-10-06T02:26:53.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.454+0000 7fc686c0d700 1 -- start start 2023-10-06T02:26:53.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc686c0d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6800b20e0 0x7fc68016af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc686c0d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc680159380 0x7fc680158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc686c0d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc68015d4d0 0x7fc6800cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc686c0d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800c8040 con 0x7fc6800b20e0 2023-10-06T02:26:53.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc686c0d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68016b440 con 0x7fc680159380 2023-10-06T02:26:53.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc686c0d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc680158650 con 0x7fc68015d4d0 2023-10-06T02:26:53.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc6849a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6800b20e0 0x7fc68016af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc6849a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6800b20e0 0x7fc68016af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54756/0 (socket says 172.21.15.6:54756) 2023-10-06T02:26:53.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc6849a9700 1 -- 172.21.15.6:0/93240055 learned_addr learned my addr 172.21.15.6:0/93240055 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:53.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc67ffff700 1 --2- 172.21.15.6:0/93240055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc680159380 0x7fc680158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc6851aa700 1 --2- 172.21.15.6:0/93240055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc68015d4d0 0x7fc6800cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc6849a9700 1 -- 172.21.15.6:0/93240055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc68015d4d0 msgr2=0x7fc6800cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:53.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc6849a9700 1 --2- 172.21.15.6:0/93240055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc68015d4d0 0x7fc6800cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc6849a9700 1 -- 172.21.15.6:0/93240055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc680159380 msgr2=0x7fc680158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:53.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc6849a9700 1 --2- 172.21.15.6:0/93240055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc680159380 0x7fc680158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc6849a9700 1 -- 172.21.15.6:0/93240055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc678009420 con 0x7fc6800b20e0 2023-10-06T02:26:53.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc6849a9700 1 --2- 172.21.15.6:0/93240055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6800b20e0 0x7fc68016af00 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fc67800b3c0 tx=0x7fc678017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:53.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc67cff9700 1 -- 172.21.15.6:0/93240055 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67801f070 con 0x7fc6800b20e0 2023-10-06T02:26:53.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc67cff9700 1 -- 172.21.15.6:0/93240055 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc678000c40 con 0x7fc6800b20e0 2023-10-06T02:26:53.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc686c0d700 1 -- 172.21.15.6:0/93240055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6800c7430 con 0x7fc6800b20e0 2023-10-06T02:26:53.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc67cff9700 1 -- 172.21.15.6:0/93240055 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678025420 con 0x7fc6800b20e0 2023-10-06T02:26:53.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.455+0000 7fc686c0d700 1 -- 172.21.15.6:0/93240055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6800c79f0 con 0x7fc6800b20e0 2023-10-06T02:26:53.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.456+0000 7fc686c0d700 1 -- 172.21.15.6:0/93240055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc680088aa0 con 0x7fc6800b20e0 2023-10-06T02:26:53.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.457+0000 7fc67cff9700 1 -- 172.21.15.6:0/93240055 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc678023070 con 0x7fc6800b20e0 2023-10-06T02:26:53.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.457+0000 7fc67cff9700 1 --2- 172.21.15.6:0/93240055 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc660066f30 0x7fc6600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.457+0000 7fc67cff9700 1 -- 172.21.15.6:0/93240055 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7840+0+0 (secure 0 0 0) 0x7fc6780861d0 con 0x7fc6800b20e0 2023-10-06T02:26:53.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.457+0000 7fc67ffff700 1 --2- 172.21.15.6:0/93240055 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc660066f30 0x7fc6600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.458+0000 7fc67ffff700 1 --2- 172.21.15.6:0/93240055 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc660066f30 0x7fc6600693e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc68006b360 tx=0x7fc670009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:53.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.461+0000 7fc67cff9700 1 -- 172.21.15.6:0/93240055 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc678052bf0 con 0x7fc6800b20e0 2023-10-06T02:26:53.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.698+0000 7fc686c0d700 1 -- 172.21.15.6:0/93240055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc68004bb80 con 0x7fc6800b20e0 2023-10-06T02:26:53.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.698+0000 7fc67cff9700 1 -- 172.21.15.6:0/93240055 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 196 v196) v1 ==== 95+0+3840 (secure 0 0 0) 0x7fc67802a090 con 0x7fc6800b20e0 2023-10-06T02:26:53.700 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:53.700 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":196,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":196,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:52.897148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:53.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.700+0000 7fc686c0d700 1 -- 172.21.15.6:0/93240055 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc660066f30 msgr2=0x7fc6600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:53.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.700+0000 7fc686c0d700 1 --2- 172.21.15.6:0/93240055 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc660066f30 0x7fc6600693e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc68006b360 tx=0x7fc670009040 comp rx=0 tx=0).stop 2023-10-06T02:26:53.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.700+0000 7fc686c0d700 1 -- 172.21.15.6:0/93240055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6800b20e0 msgr2=0x7fc68016af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:53.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.700+0000 7fc686c0d700 1 --2- 172.21.15.6:0/93240055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6800b20e0 0x7fc68016af00 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fc67800b3c0 tx=0x7fc678017000 comp rx=0 tx=0).stop 2023-10-06T02:26:53.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.700+0000 7fc686c0d700 1 -- 172.21.15.6:0/93240055 shutdown_connections 2023-10-06T02:26:53.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.700+0000 7fc686c0d700 1 --2- 172.21.15.6:0/93240055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc68015d4d0 0x7fc6800cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.700+0000 7fc686c0d700 1 --2- 172.21.15.6:0/93240055 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc660066f30 0x7fc6600693e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.700+0000 7fc686c0d700 1 --2- 172.21.15.6:0/93240055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6800b20e0 0x7fc68016af00 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.700+0000 7fc686c0d700 1 --2- 172.21.15.6:0/93240055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc680159380 0x7fc680158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.700+0000 7fc686c0d700 1 -- 172.21.15.6:0/93240055 >> 172.21.15.6:0/93240055 conn(0x7fc680068680 msgr2=0x7fc680159df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:53.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.701+0000 7fc686c0d700 1 -- 172.21.15.6:0/93240055 shutdown_connections 2023-10-06T02:26:53.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.701+0000 7fc686c0d700 1 -- 172.21.15.6:0/93240055 wait complete. 2023-10-06T02:26:53.704 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 196 2023-10-06T02:26:53.714 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:26:53.715 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.832+0000 7fa0d86ab700 1 Processor -- start 2023-10-06T02:26:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.832+0000 7fa0d86ab700 1 -- start start 2023-10-06T02:26:53.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.833+0000 7fa0d86ab700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa0d00af4e0 0x7fa0d00b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.833+0000 7fa0d86ab700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0d00af8b0 0x7fa0d00b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.833+0000 7fa0d86ab700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d015e190 con 0x7fa0d015d460 2023-10-06T02:26:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.833+0000 7fa0d86ab700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d00b1910 con 0x7fa0d00af4e0 2023-10-06T02:26:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.833+0000 7fa0d86ab700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d015dfb0 con 0x7fa0d00af8b0 2023-10-06T02:26:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.834+0000 7fa0d6c48700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa0d015d460 0x7fa0d015d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60310/0 (socket says 172.21.15.6:60310) 2023-10-06T02:26:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.834+0000 7fa0d6c48700 1 -- 172.21.15.6:0/884461325 learned_addr learned my addr 172.21.15.6:0/884461325 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.834+0000 7fa0d6447700 1 --2- 172.21.15.6:0/884461325 >> v2:172.21.15.175:3300/0 conn(0x7fa0d00af4e0 0x7fa0d00b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.834+0000 7fa0d5c46700 1 --2- 172.21.15.6:0/884461325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0d00af8b0 0x7fa0d00b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.834+0000 7fa0d5445700 1 -- 172.21.15.6:0/884461325 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989771567 0 0) 0x7fa0d015e190 con 0x7fa0d015d460 2023-10-06T02:26:53.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.834+0000 7fa0d5445700 1 -- 172.21.15.6:0/884461325 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0bc003570 con 0x7fa0d015d460 2023-10-06T02:26:53.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.834+0000 7fa0d6447700 1 -- 172.21.15.6:0/884461325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0d00af8b0 msgr2=0x7fa0d00b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:53.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.834+0000 7fa0d6447700 1 --2- 172.21.15.6:0/884461325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0d00af8b0 0x7fa0d00b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.834+0000 7fa0d6447700 1 -- 172.21.15.6:0/884461325 >> v1:172.21.15.6:6789/0 conn(0x7fa0d015d460 legacy=0x7fa0d015d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:53.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.834+0000 7fa0d6447700 1 -- 172.21.15.6:0/884461325 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d00cb650 con 0x7fa0d00af4e0 2023-10-06T02:26:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.835+0000 7fa0d6447700 1 --2- 172.21.15.6:0/884461325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00af4e0 0x7fa0d00b20e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0098e0 tx=0x7fa0cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ae6607929f87a0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.835+0000 7fa0d5445700 1 -- 172.21.15.6:0/884461325 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc011630 con 0x7fa0d00af4e0 2023-10-06T02:26:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.836+0000 7fa0d5445700 1 -- 172.21.15.6:0/884461325 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc011790 con 0x7fa0d00af4e0 2023-10-06T02:26:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.836+0000 7fa0d5445700 1 -- 172.21.15.6:0/884461325 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc011b30 con 0x7fa0d00af4e0 2023-10-06T02:26:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.836+0000 7fa0d86ab700 1 -- 172.21.15.6:0/884461325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00af4e0 msgr2=0x7fa0d00b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.836+0000 7fa0d86ab700 1 --2- 172.21.15.6:0/884461325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00af4e0 0x7fa0d00b20e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0098e0 tx=0x7fa0cc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.836+0000 7fa0d86ab700 1 -- 172.21.15.6:0/884461325 shutdown_connections 2023-10-06T02:26:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.836+0000 7fa0d86ab700 1 --2- 172.21.15.6:0/884461325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00af4e0 0x7fa0d00b20e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.836+0000 7fa0d86ab700 1 --2- 172.21.15.6:0/884461325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0d00af8b0 0x7fa0d00b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.836+0000 7fa0d86ab700 1 -- 172.21.15.6:0/884461325 >> 172.21.15.6:0/884461325 conn(0x7fa0d0068680 msgr2=0x7fa0d0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.836+0000 7fa0d86ab700 1 -- 172.21.15.6:0/884461325 shutdown_connections 2023-10-06T02:26:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.836+0000 7fa0d86ab700 1 -- 172.21.15.6:0/884461325 wait complete. 2023-10-06T02:26:53.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.837+0000 7fa0d86ab700 1 Processor -- start 2023-10-06T02:26:53.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.837+0000 7fa0d86ab700 1 -- start start 2023-10-06T02:26:53.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.838+0000 7fa0d86ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d00af4e0 0x7fa0d015e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.838+0000 7fa0d86ab700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00af8b0 0x7fa0d00c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.838+0000 7fa0d86ab700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0d015d460 0x7fa0d0160a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.838+0000 7fa0d86ab700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d015f050 con 0x7fa0d00af4e0 2023-10-06T02:26:53.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.838+0000 7fa0d86ab700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d015e6d0 con 0x7fa0d00af8b0 2023-10-06T02:26:53.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.838+0000 7fa0d86ab700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d016c300 con 0x7fa0d015d460 2023-10-06T02:26:53.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.838+0000 7fa0d6447700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d00af4e0 0x7fa0d015e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.838+0000 7fa0d6447700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d00af4e0 0x7fa0d015e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54764/0 (socket says 172.21.15.6:54764) 2023-10-06T02:26:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.838+0000 7fa0d6447700 1 -- 172.21.15.6:0/3629388406 learned_addr learned my addr 172.21.15.6:0/3629388406 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.838+0000 7fa0d6c48700 1 --2- 172.21.15.6:0/3629388406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0d015d460 0x7fa0d0160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.838+0000 7fa0d5c46700 1 --2- 172.21.15.6:0/3629388406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00af8b0 0x7fa0d00c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.838+0000 7fa0d6447700 1 -- 172.21.15.6:0/3629388406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0d015d460 msgr2=0x7fa0d0160a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.838+0000 7fa0d6447700 1 --2- 172.21.15.6:0/3629388406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0d015d460 0x7fa0d0160a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.838+0000 7fa0d6447700 1 -- 172.21.15.6:0/3629388406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00af8b0 msgr2=0x7fa0d00c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.839+0000 7fa0d6447700 1 --2- 172.21.15.6:0/3629388406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00af8b0 0x7fa0d00c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.839+0000 7fa0d6447700 1 -- 172.21.15.6:0/3629388406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc009420 con 0x7fa0d00af4e0 2023-10-06T02:26:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.839+0000 7fa0d6c48700 1 --2- 172.21.15.6:0/3629388406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0d015d460 0x7fa0d0160a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.839+0000 7fa0d5c46700 1 --2- 172.21.15.6:0/3629388406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00af8b0 0x7fa0d00c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.839+0000 7fa0d6447700 1 --2- 172.21.15.6:0/3629388406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d00af4e0 0x7fa0d015e190 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0089520 tx=0x7fa0cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.839+0000 7fa0c67fc700 1 -- 172.21.15.6:0/3629388406 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc011b10 con 0x7fa0d00af4e0 2023-10-06T02:26:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.839+0000 7fa0c67fc700 1 -- 172.21.15.6:0/3629388406 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc0253f0 con 0x7fa0d00af4e0 2023-10-06T02:26:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.839+0000 7fa0c67fc700 1 -- 172.21.15.6:0/3629388406 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc025790 con 0x7fa0d00af4e0 2023-10-06T02:26:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.839+0000 7fa0d86ab700 1 -- 172.21.15.6:0/3629388406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d016c5e0 con 0x7fa0d00af4e0 2023-10-06T02:26:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.839+0000 7fa0d86ab700 1 -- 172.21.15.6:0/3629388406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d015ece0 con 0x7fa0d00af4e0 2023-10-06T02:26:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.840+0000 7fa0d86ab700 1 -- 172.21.15.6:0/3629388406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d0088aa0 con 0x7fa0d00af4e0 2023-10-06T02:26:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.840+0000 7fa0c67fc700 1 -- 172.21.15.6:0/3629388406 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa0cc025b80 con 0x7fa0d00af4e0 2023-10-06T02:26:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.841+0000 7fa0c67fc700 1 --2- 172.21.15.6:0/3629388406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa0b4066fb0 0x7fa0b4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.841+0000 7fa0c67fc700 1 -- 172.21.15.6:0/3629388406 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7840+0+0 (secure 0 0 0) 0x7fa0cc0865d0 con 0x7fa0d00af4e0 2023-10-06T02:26:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.841+0000 7fa0d5c46700 1 --2- 172.21.15.6:0/3629388406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa0b4066fb0 0x7fa0b4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.841+0000 7fa0d5c46700 1 --2- 172.21.15.6:0/3629388406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa0b4066fb0 0x7fa0b4069460 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0006f00 tx=0x7fa0c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:53.845+0000 7fa0c67fc700 1 -- 172.21.15.6:0/3629388406 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0cc052f70 con 0x7fa0d00af4e0 2023-10-06T02:26:54.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.088+0000 7fa0d86ab700 1 -- 172.21.15.6:0/3629388406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0d00b0910 con 0x7fa0d00af4e0 2023-10-06T02:26:54.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.089+0000 7fa0c67fc700 1 -- 172.21.15.6:0/3629388406 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 197 v197) v1 ==== 95+0+4595 (secure 0 0 0) 0x7fa0cc056590 con 0x7fa0d00af4e0 2023-10-06T02:26:54.091 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:54.091 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":197,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3954180287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3954180287},{"type":"v1","addr":"172.21.15.6:6835","nonce":3954180287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":197}],"filesystems":[{"mdsmap":{"epoch":196,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:52.897148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:54.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.091+0000 7fa0d86ab700 1 -- 172.21.15.6:0/3629388406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa0b4066fb0 msgr2=0x7fa0b4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:54.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.091+0000 7fa0d86ab700 1 --2- 172.21.15.6:0/3629388406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa0b4066fb0 0x7fa0b4069460 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0006f00 tx=0x7fa0c0008040 comp rx=0 tx=0).stop 2023-10-06T02:26:54.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.091+0000 7fa0d86ab700 1 -- 172.21.15.6:0/3629388406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d00af4e0 msgr2=0x7fa0d015e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:54.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.091+0000 7fa0d86ab700 1 --2- 172.21.15.6:0/3629388406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d00af4e0 0x7fa0d015e190 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0089520 tx=0x7fa0cc017000 comp rx=0 tx=0).stop 2023-10-06T02:26:54.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.091+0000 7fa0d86ab700 1 -- 172.21.15.6:0/3629388406 shutdown_connections 2023-10-06T02:26:54.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.091+0000 7fa0d86ab700 1 --2- 172.21.15.6:0/3629388406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0d015d460 0x7fa0d0160a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.091+0000 7fa0d86ab700 1 --2- 172.21.15.6:0/3629388406 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa0b4066fb0 0x7fa0b4069460 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.091+0000 7fa0d86ab700 1 --2- 172.21.15.6:0/3629388406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d00af4e0 0x7fa0d015e190 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.091+0000 7fa0d86ab700 1 --2- 172.21.15.6:0/3629388406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00af8b0 0x7fa0d00c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.091+0000 7fa0d86ab700 1 -- 172.21.15.6:0/3629388406 >> 172.21.15.6:0/3629388406 conn(0x7fa0d0068680 msgr2=0x7fa0d00cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:54.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.091+0000 7fa0d86ab700 1 -- 172.21.15.6:0/3629388406 shutdown_connections 2023-10-06T02:26:54.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.091+0000 7fa0d86ab700 1 -- 172.21.15.6:0/3629388406 wait complete. 2023-10-06T02:26:54.094 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 197 2023-10-06T02:26:54.106 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt 200.00000000' led to DAMAGED state 2023-10-06T02:26:54.106 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 200.00000001' 2023-10-06T02:26:54.106 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:54.106 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:26:54.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:54.107 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:26:54.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:26:54.122 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:26:54.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:26:54.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.280+0000 7f8ad0328700 1 Processor -- start 2023-10-06T02:26:54.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.280+0000 7f8ad0328700 1 -- start start 2023-10-06T02:26:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.281+0000 7f8ad0328700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8ac80d0400 0x7f8ac80b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.281+0000 7f8ad0328700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac80b6170 con 0x7f8ac80ccd40 2023-10-06T02:26:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.281+0000 7f8ad0328700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac815dd40 con 0x7f8ac80d07d0 2023-10-06T02:26:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.281+0000 7f8ad0328700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac815e020 con 0x7f8ac80d0400 2023-10-06T02:26:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.281+0000 7f8acd8c3700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8ac80ccd40 0x7f8ac80cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60312/0 (socket says 172.21.15.6:60312) 2023-10-06T02:26:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.281+0000 7f8acd8c3700 1 -- 172.21.15.6:0/1904211379 learned_addr learned my addr 172.21.15.6:0/1904211379 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.282+0000 7f8ace0c4700 1 --2- 172.21.15.6:0/1904211379 >> v2:172.21.15.175:3300/0 conn(0x7f8ac80d0400 0x7f8ac80b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.282+0000 7f8acd0c2700 1 -- 172.21.15.6:0/1904211379 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497133290 0 0) 0x7f8ac80b6170 con 0x7f8ac80ccd40 2023-10-06T02:26:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.282+0000 7f8acd0c2700 1 -- 172.21.15.6:0/1904211379 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ab0003570 con 0x7f8ac80ccd40 2023-10-06T02:26:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.282+0000 7f8ace0c4700 1 -- 172.21.15.6:0/1904211379 >> v1:172.21.15.175:6789/0 conn(0x7f8ac80d07d0 legacy=0x7f8ac80b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.282+0000 7f8ace0c4700 1 -- 172.21.15.6:0/1904211379 >> v1:172.21.15.6:6789/0 conn(0x7f8ac80ccd40 legacy=0x7f8ac80cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.282+0000 7f8ace0c4700 1 -- 172.21.15.6:0/1904211379 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac80ceaa0 con 0x7f8ac80d0400 2023-10-06T02:26:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.282+0000 7f8ace0c4700 1 --2- 172.21.15.6:0/1904211379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac80d0400 0x7f8ac80b5c30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009eb0 tx=0x7f8ac0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19184281ab0c1af9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.282+0000 7f8acd0c2700 1 -- 172.21.15.6:0/1904211379 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac000e070 con 0x7f8ac80d0400 2023-10-06T02:26:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.282+0000 7f8acd0c2700 1 -- 172.21.15.6:0/1904211379 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac000bc30 con 0x7f8ac80d0400 2023-10-06T02:26:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.282+0000 7f8acd0c2700 1 -- 172.21.15.6:0/1904211379 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0012430 con 0x7f8ac80d0400 2023-10-06T02:26:54.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.283+0000 7f8ad0328700 1 -- 172.21.15.6:0/1904211379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac80d0400 msgr2=0x7f8ac80b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:54.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.283+0000 7f8ad0328700 1 --2- 172.21.15.6:0/1904211379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac80d0400 0x7f8ac80b5c30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009eb0 tx=0x7f8ac0009780 comp rx=0 tx=0).stop 2023-10-06T02:26:54.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.283+0000 7f8ad0328700 1 -- 172.21.15.6:0/1904211379 shutdown_connections 2023-10-06T02:26:54.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.283+0000 7f8ad0328700 1 --2- 172.21.15.6:0/1904211379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac80d0400 0x7f8ac80b5c30 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.283+0000 7f8ad0328700 1 -- 172.21.15.6:0/1904211379 >> 172.21.15.6:0/1904211379 conn(0x7f8ac806a220 msgr2=0x7f8ac806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:54.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.283+0000 7f8ad0328700 1 -- 172.21.15.6:0/1904211379 shutdown_connections 2023-10-06T02:26:54.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.283+0000 7f8ad0328700 1 -- 172.21.15.6:0/1904211379 wait complete. 2023-10-06T02:26:54.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.284+0000 7f8ad0328700 1 Processor -- start 2023-10-06T02:26:54.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.284+0000 7f8ad0328700 1 -- start start 2023-10-06T02:26:54.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ad0328700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac80ccd40 0x7f8ac81561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:54.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ad0328700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ac80d0400 0x7f8ac8158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:54.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ad0328700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac80d07d0 0x7f8ac8159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:54.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ad0328700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac81598c0 con 0x7f8ac80d07d0 2023-10-06T02:26:54.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ad0328700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac816bc60 con 0x7f8ac80ccd40 2023-10-06T02:26:54.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ad0328700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac816b090 con 0x7f8ac80d0400 2023-10-06T02:26:54.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ace8c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac80d07d0 0x7f8ac8159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:54.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ace8c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac80d07d0 0x7f8ac8159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54770/0 (socket says 172.21.15.6:54770) 2023-10-06T02:26:54.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ace8c5700 1 -- 172.21.15.6:0/2721948996 learned_addr learned my addr 172.21.15.6:0/2721948996 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:54.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8acd8c3700 1 --2- 172.21.15.6:0/2721948996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ac80d0400 0x7f8ac8158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:54.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ace0c4700 1 --2- 172.21.15.6:0/2721948996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac80ccd40 0x7f8ac81561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:54.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ace8c5700 1 -- 172.21.15.6:0/2721948996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ac80d0400 msgr2=0x7f8ac8158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:54.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ace8c5700 1 --2- 172.21.15.6:0/2721948996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ac80d0400 0x7f8ac8158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ace8c5700 1 -- 172.21.15.6:0/2721948996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac80ccd40 msgr2=0x7f8ac81561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:54.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ace8c5700 1 --2- 172.21.15.6:0/2721948996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac80ccd40 0x7f8ac81561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ace8c5700 1 -- 172.21.15.6:0/2721948996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac0009a20 con 0x7f8ac80d07d0 2023-10-06T02:26:54.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8acd8c3700 1 --2- 172.21.15.6:0/2721948996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ac80d0400 0x7f8ac8158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:54.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ace0c4700 1 --2- 172.21.15.6:0/2721948996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac80ccd40 0x7f8ac81561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:54.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ace8c5700 1 --2- 172.21.15.6:0/2721948996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac80d07d0 0x7f8ac8159380 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800c4c0 tx=0x7f8ab8007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:54.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.285+0000 7f8ac67fc700 1 -- 172.21.15.6:0/2721948996 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8011590 con 0x7f8ac80d07d0 2023-10-06T02:26:54.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.286+0000 7f8ac67fc700 1 -- 172.21.15.6:0/2721948996 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab8011710 con 0x7f8ac80d07d0 2023-10-06T02:26:54.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.286+0000 7f8ad0328700 1 -- 172.21.15.6:0/2721948996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac816b350 con 0x7f8ac80d07d0 2023-10-06T02:26:54.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.286+0000 7f8ac67fc700 1 -- 172.21.15.6:0/2721948996 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8011ad0 con 0x7f8ac80d07d0 2023-10-06T02:26:54.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.286+0000 7f8ad0328700 1 -- 172.21.15.6:0/2721948996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac816b610 con 0x7f8ac80d07d0 2023-10-06T02:26:54.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.286+0000 7f8ad0328700 1 -- 172.21.15.6:0/2721948996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac816be10 con 0x7f8ac80d07d0 2023-10-06T02:26:54.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.287+0000 7f8ac67fc700 1 -- 172.21.15.6:0/2721948996 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ab801b3b0 con 0x7f8ac80d07d0 2023-10-06T02:26:54.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.287+0000 7f8ac67fc700 1 --2- 172.21.15.6:0/2721948996 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8ab4066f30 0x7f8ab40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:54.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.288+0000 7f8ac67fc700 1 -- 172.21.15.6:0/2721948996 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7840+0+0 (secure 0 0 0) 0x7f8ab8084280 con 0x7f8ac80d07d0 2023-10-06T02:26:54.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.288+0000 7f8ace0c4700 1 --2- 172.21.15.6:0/2721948996 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8ab4066f30 0x7f8ab40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:54.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.288+0000 7f8ace0c4700 1 --2- 172.21.15.6:0/2721948996 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8ab4066f30 0x7f8ab40693e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00097c0 tx=0x7f8ac0019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:54.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.292+0000 7f8ac67fc700 1 -- 172.21.15.6:0/2721948996 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ac816be10 con 0x7f8ac80d07d0 2023-10-06T02:26:54.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.533+0000 7f8ad0328700 1 -- 172.21.15.6:0/2721948996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8ac816be10 con 0x7f8ac80d07d0 2023-10-06T02:26:54.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.904+0000 7f8ac67fc700 1 -- 172.21.15.6:0/2721948996 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v198) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8ac816be10 con 0x7f8ac80d07d0 2023-10-06T02:26:54.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.906+0000 7f8ad0328700 1 -- 172.21.15.6:0/2721948996 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8ab4066f30 msgr2=0x7f8ab40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:54.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.906+0000 7f8ad0328700 1 --2- 172.21.15.6:0/2721948996 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8ab4066f30 0x7f8ab40693e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00097c0 tx=0x7f8ac0019000 comp rx=0 tx=0).stop 2023-10-06T02:26:54.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.906+0000 7f8ad0328700 1 -- 172.21.15.6:0/2721948996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac80d07d0 msgr2=0x7f8ac8159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:54.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.906+0000 7f8ad0328700 1 --2- 172.21.15.6:0/2721948996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac80d07d0 0x7f8ac8159380 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800c4c0 tx=0x7f8ab8007f50 comp rx=0 tx=0).stop 2023-10-06T02:26:54.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.906+0000 7f8ad0328700 1 -- 172.21.15.6:0/2721948996 shutdown_connections 2023-10-06T02:26:54.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.906+0000 7f8ad0328700 1 --2- 172.21.15.6:0/2721948996 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8ab4066f30 0x7f8ab40693e0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.906+0000 7f8ad0328700 1 --2- 172.21.15.6:0/2721948996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac80d07d0 0x7f8ac8159380 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.906+0000 7f8ad0328700 1 --2- 172.21.15.6:0/2721948996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac80ccd40 0x7f8ac81561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.906+0000 7f8ad0328700 1 --2- 172.21.15.6:0/2721948996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ac80d0400 0x7f8ac8158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.906+0000 7f8ad0328700 1 -- 172.21.15.6:0/2721948996 >> 172.21.15.6:0/2721948996 conn(0x7f8ac806a220 msgr2=0x7f8ac81584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:54.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.906+0000 7f8ad0328700 1 -- 172.21.15.6:0/2721948996 shutdown_connections 2023-10-06T02:26:54.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:54.907+0000 7f8ad0328700 1 -- 172.21.15.6:0/2721948996 wait complete. 2023-10-06T02:26:54.909 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:26:54.920 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:26:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.039+0000 7fda3edcf700 1 Processor -- start 2023-10-06T02:26:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.039+0000 7fda3edcf700 1 -- start start 2023-10-06T02:26:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.040+0000 7fda3edcf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda3815a030 0x7fda3815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.040+0000 7fda3edcf700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fda3815a940 0x7fda38086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.040+0000 7fda3edcf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda38087530 0x7fda380b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.040+0000 7fda3edcf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda380879d0 con 0x7fda3815a030 2023-10-06T02:26:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.040+0000 7fda3edcf700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda380b0cf0 con 0x7fda3815a940 2023-10-06T02:26:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.040+0000 7fda3edcf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda380afc50 con 0x7fda38087530 2023-10-06T02:26:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.040+0000 7fda3cb6b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda3815a030 0x7fda3815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.040+0000 7fda3cb6b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda3815a030 0x7fda3815a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54782/0 (socket says 172.21.15.6:54782) 2023-10-06T02:26:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.040+0000 7fda3cb6b700 1 -- 172.21.15.6:0/3394869901 learned_addr learned my addr 172.21.15.6:0/3394869901 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.041+0000 7fda3d36c700 1 --2- 172.21.15.6:0/3394869901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda38087530 0x7fda380b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.041+0000 7fda37fff700 1 --2- 172.21.15.6:0/3394869901 >> v2:172.21.15.175:3300/0 conn(0x7fda3815a940 0x7fda38086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.041+0000 7fda3cb6b700 1 -- 172.21.15.6:0/3394869901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda38087530 msgr2=0x7fda380b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.041+0000 7fda3cb6b700 1 --2- 172.21.15.6:0/3394869901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda38087530 0x7fda380b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.041+0000 7fda3cb6b700 1 -- 172.21.15.6:0/3394869901 >> v2:172.21.15.175:3300/0 conn(0x7fda3815a940 msgr2=0x7fda38086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.041+0000 7fda3cb6b700 1 --2- 172.21.15.6:0/3394869901 >> v2:172.21.15.175:3300/0 conn(0x7fda3815a940 0x7fda38086ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.041+0000 7fda3cb6b700 1 -- 172.21.15.6:0/3394869901 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda380aff30 con 0x7fda3815a030 2023-10-06T02:26:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.041+0000 7fda3cb6b700 1 --2- 172.21.15.6:0/3394869901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda3815a030 0x7fda3815a400 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fda38157800 tx=0x7fda30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0efba4e51e0475 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.041+0000 7fda377fe700 1 -- 172.21.15.6:0/3394869901 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000b820 con 0x7fda3815a030 2023-10-06T02:26:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.041+0000 7fda377fe700 1 -- 172.21.15.6:0/3394869901 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3000b980 con 0x7fda3815a030 2023-10-06T02:26:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.041+0000 7fda377fe700 1 -- 172.21.15.6:0/3394869901 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000bd20 con 0x7fda3815a030 2023-10-06T02:26:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.041+0000 7fda3edcf700 1 -- 172.21.15.6:0/3394869901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda3815a030 msgr2=0x7fda3815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.041+0000 7fda3edcf700 1 --2- 172.21.15.6:0/3394869901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda3815a030 0x7fda3815a400 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fda38157800 tx=0x7fda30009250 comp rx=0 tx=0).stop 2023-10-06T02:26:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.042+0000 7fda3edcf700 1 -- 172.21.15.6:0/3394869901 shutdown_connections 2023-10-06T02:26:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.042+0000 7fda3edcf700 1 --2- 172.21.15.6:0/3394869901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda38087530 0x7fda380b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.042+0000 7fda3edcf700 1 --2- 172.21.15.6:0/3394869901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda3815a030 0x7fda3815a400 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.042+0000 7fda3edcf700 1 --2- 172.21.15.6:0/3394869901 >> v2:172.21.15.175:3300/0 conn(0x7fda3815a940 0x7fda38086ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.042+0000 7fda3edcf700 1 -- 172.21.15.6:0/3394869901 >> 172.21.15.6:0/3394869901 conn(0x7fda38068680 msgr2=0x7fda38068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.042+0000 7fda3edcf700 1 -- 172.21.15.6:0/3394869901 shutdown_connections 2023-10-06T02:26:55.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.042+0000 7fda3edcf700 1 -- 172.21.15.6:0/3394869901 wait complete. 2023-10-06T02:26:55.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.043+0000 7fda3edcf700 1 Processor -- start 2023-10-06T02:26:55.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.043+0000 7fda3edcf700 1 -- start start 2023-10-06T02:26:55.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.043+0000 7fda3edcf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda38087530 0x7fda380c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda3edcf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda3815a030 0x7fda38155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda3edcf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda3815a940 0x7fda380b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda3edcf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3815c8f0 con 0x7fda38087530 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda3edcf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3815bce0 con 0x7fda3815a030 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda3edcf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3815bfc0 con 0x7fda3815a940 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda3cb6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda38087530 0x7fda380c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda3cb6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda38087530 0x7fda380c64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54798/0 (socket says 172.21.15.6:54798) 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda3cb6b700 1 -- 172.21.15.6:0/2337556546 learned_addr learned my addr 172.21.15.6:0/2337556546 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda37fff700 1 --2- 172.21.15.6:0/2337556546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda3815a030 0x7fda38155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda3d36c700 1 --2- 172.21.15.6:0/2337556546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda3815a940 0x7fda380b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda3cb6b700 1 -- 172.21.15.6:0/2337556546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda3815a940 msgr2=0x7fda380b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda3cb6b700 1 --2- 172.21.15.6:0/2337556546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda3815a940 0x7fda380b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda3cb6b700 1 -- 172.21.15.6:0/2337556546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda3815a030 msgr2=0x7fda38155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda3cb6b700 1 --2- 172.21.15.6:0/2337556546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda3815a030 0x7fda38155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda3cb6b700 1 -- 172.21.15.6:0/2337556546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda300094f0 con 0x7fda38087530 2023-10-06T02:26:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda3cb6b700 1 --2- 172.21.15.6:0/2337556546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda38087530 0x7fda380c64c0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fda300094c0 tx=0x7fda30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda34ff9700 1 -- 172.21.15.6:0/2337556546 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda30011e00 con 0x7fda38087530 2023-10-06T02:26:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda34ff9700 1 -- 172.21.15.6:0/2337556546 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3001a420 con 0x7fda38087530 2023-10-06T02:26:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda3edcf700 1 -- 172.21.15.6:0/2337556546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3815c2a0 con 0x7fda38087530 2023-10-06T02:26:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda34ff9700 1 -- 172.21.15.6:0/2337556546 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3001a7e0 con 0x7fda38087530 2023-10-06T02:26:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.044+0000 7fda3edcf700 1 -- 172.21.15.6:0/2337556546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda380c6a00 con 0x7fda38087530 2023-10-06T02:26:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.045+0000 7fda3edcf700 1 -- 172.21.15.6:0/2337556546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda38088700 con 0x7fda38087530 2023-10-06T02:26:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.046+0000 7fda34ff9700 1 -- 172.21.15.6:0/2337556546 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda3001ac10 con 0x7fda38087530 2023-10-06T02:26:55.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.046+0000 7fda34ff9700 1 --2- 172.21.15.6:0/2337556546 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda18066f30 0x7fda180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.046+0000 7fda34ff9700 1 -- 172.21.15.6:0/2337556546 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7840+0+0 (secure 0 0 0) 0x7fda30086690 con 0x7fda38087530 2023-10-06T02:26:55.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.046+0000 7fda37fff700 1 --2- 172.21.15.6:0/2337556546 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda18066f30 0x7fda180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.047+0000 7fda37fff700 1 --2- 172.21.15.6:0/2337556546 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda18066f30 0x7fda180693e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fda3816d140 tx=0x7fda28007770 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.051+0000 7fda34ff9700 1 -- 172.21.15.6:0/2337556546 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda300530b0 con 0x7fda38087530 2023-10-06T02:26:55.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.326+0000 7fda3edcf700 1 -- 172.21.15.6:0/2337556546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fda380b0210 con 0x7fda38087530 2023-10-06T02:26:55.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.906+0000 7fda34ff9700 1 -- 172.21.15.6:0/2337556546 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v199) v1 ==== 101+0+0 (secure 0 0 0) 0x7fda300566d0 con 0x7fda38087530 2023-10-06T02:26:55.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.908+0000 7fda3edcf700 1 -- 172.21.15.6:0/2337556546 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda18066f30 msgr2=0x7fda180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.908+0000 7fda3edcf700 1 --2- 172.21.15.6:0/2337556546 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda18066f30 0x7fda180693e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fda3816d140 tx=0x7fda28007770 comp rx=0 tx=0).stop 2023-10-06T02:26:55.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.908+0000 7fda3edcf700 1 -- 172.21.15.6:0/2337556546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda38087530 msgr2=0x7fda380c64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.908+0000 7fda3edcf700 1 --2- 172.21.15.6:0/2337556546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda38087530 0x7fda380c64c0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fda300094c0 tx=0x7fda30017000 comp rx=0 tx=0).stop 2023-10-06T02:26:55.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.908+0000 7fda3edcf700 1 -- 172.21.15.6:0/2337556546 shutdown_connections 2023-10-06T02:26:55.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.908+0000 7fda3edcf700 1 --2- 172.21.15.6:0/2337556546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda3815a940 0x7fda380b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.908+0000 7fda3edcf700 1 --2- 172.21.15.6:0/2337556546 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda18066f30 0x7fda180693e0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.908+0000 7fda3edcf700 1 --2- 172.21.15.6:0/2337556546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda38087530 0x7fda380c64c0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.908+0000 7fda3edcf700 1 --2- 172.21.15.6:0/2337556546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda3815a030 0x7fda38155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.908+0000 7fda3edcf700 1 -- 172.21.15.6:0/2337556546 >> 172.21.15.6:0/2337556546 conn(0x7fda38068680 msgr2=0x7fda380cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.908+0000 7fda3edcf700 1 -- 172.21.15.6:0/2337556546 shutdown_connections 2023-10-06T02:26:55.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.908+0000 7fda3edcf700 1 -- 172.21.15.6:0/2337556546 wait complete. 2023-10-06T02:26:55.912 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:26:55.923 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:26:55.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.961+0000 7f4254500000 1 Processor -- start 2023-10-06T02:26:55.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.961+0000 7f4254500000 1 -- start start 2023-10-06T02:26:55.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.962+0000 7f4254500000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa9144ed60 0x55aa914f93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.962+0000 7f4254500000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa9146a410 0x55aa91469490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.962+0000 7f4254500000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa914f9f90 0x55aa9144fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.962+0000 7f4254500000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa9136e980 con 0x55aa9144ed60 2023-10-06T02:26:55.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.962+0000 7f4254500000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa9136e620 con 0x55aa914f9f90 2023-10-06T02:26:55.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.962+0000 7f4254500000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa91365400 con 0x55aa9146a410 2023-10-06T02:26:55.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.962+0000 7f424d73b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa9144ed60 0x55aa914f93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.962+0000 7f424d73b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa9144ed60 0x55aa914f93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54808/0 (socket says 172.21.15.6:54808) 2023-10-06T02:26:55.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.962+0000 7f424d73b700 1 -- 172.21.15.6:0/2549545213 learned_addr learned my addr 172.21.15.6:0/2549545213 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:55.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.962+0000 7f424cf3a700 1 --2- 172.21.15.6:0/2549545213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa9146a410 0x55aa91469490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.962+0000 7f424df3c700 1 --2- 172.21.15.6:0/2549545213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa914f9f90 0x55aa9144fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f424d73b700 1 -- 172.21.15.6:0/2549545213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa9146a410 msgr2=0x55aa91469490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f424d73b700 1 --2- 172.21.15.6:0/2549545213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa9146a410 0x55aa91469490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f424d73b700 1 -- 172.21.15.6:0/2549545213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa914f9f90 msgr2=0x55aa9144fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f424d73b700 1 --2- 172.21.15.6:0/2549545213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa914f9f90 0x55aa9144fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f424d73b700 1 -- 172.21.15.6:0/2549545213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424000a0e0 con 0x55aa9144ed60 2023-10-06T02:26:55.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f424d73b700 1 --2- 172.21.15.6:0/2549545213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa9144ed60 0x55aa914f93d0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f424000a930 tx=0x7f4240007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7817d544ec43c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f42477fe700 1 -- 172.21.15.6:0/2549545213 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424000d700 con 0x55aa9144ed60 2023-10-06T02:26:55.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f42477fe700 1 -- 172.21.15.6:0/2549545213 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424000d860 con 0x55aa9144ed60 2023-10-06T02:26:55.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f42477fe700 1 -- 172.21.15.6:0/2549545213 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424000dbe0 con 0x55aa9144ed60 2023-10-06T02:26:55.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f4254500000 1 -- 172.21.15.6:0/2549545213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa9144ed60 msgr2=0x55aa914f93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f4254500000 1 --2- 172.21.15.6:0/2549545213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa9144ed60 0x55aa914f93d0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f424000a930 tx=0x7f4240007040 comp rx=0 tx=0).stop 2023-10-06T02:26:55.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f4254500000 1 -- 172.21.15.6:0/2549545213 shutdown_connections 2023-10-06T02:26:55.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f4254500000 1 --2- 172.21.15.6:0/2549545213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa914f9f90 0x55aa9144fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f4254500000 1 --2- 172.21.15.6:0/2549545213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa9144ed60 0x55aa914f93d0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f4254500000 1 --2- 172.21.15.6:0/2549545213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa9146a410 0x55aa91469490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f4254500000 1 -- 172.21.15.6:0/2549545213 >> 172.21.15.6:0/2549545213 conn(0x55aa91423d50 msgr2=0x55aa91424b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f4254500000 1 -- 172.21.15.6:0/2549545213 shutdown_connections 2023-10-06T02:26:55.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.963+0000 7f4254500000 1 -- 172.21.15.6:0/2549545213 wait complete. 2023-10-06T02:26:55.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.964+0000 7f4254500000 1 Processor -- start 2023-10-06T02:26:55.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.964+0000 7f4254500000 1 -- start start 2023-10-06T02:26:55.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.965+0000 7f4254500000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa9144ed60 0x55aa914f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.965+0000 7f4254500000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa9146a410 0x55aa9150b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.965+0000 7f4254500000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa914f9f90 0x55aa914f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.965+0000 7f4254500000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa914f7ae0 con 0x55aa9146a410 2023-10-06T02:26:55.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.965+0000 7f4254500000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa914f7fa0 con 0x55aa9144ed60 2023-10-06T02:26:55.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.965+0000 7f4254500000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa914f8240 con 0x55aa914f9f90 2023-10-06T02:26:55.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.965+0000 7f424cf3a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa9146a410 0x55aa9150b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.965+0000 7f424cf3a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa9146a410 0x55aa9150b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54820/0 (socket says 172.21.15.6:54820) 2023-10-06T02:26:55.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.965+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 learned_addr learned my addr 172.21.15.6:0/1281229814 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:55.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.965+0000 7f424d73b700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa9144ed60 0x55aa914f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.965+0000 7f424df3c700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa914f9f90 0x55aa914f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.965+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa914f9f90 msgr2=0x55aa914f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.965+0000 7f424cf3a700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa914f9f90 0x55aa914f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.965+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa9144ed60 msgr2=0x55aa914f75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.965+0000 7f424cf3a700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa9144ed60 0x55aa914f75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.965+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424000a530 con 0x55aa9146a410 2023-10-06T02:26:55.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.965+0000 7f424cf3a700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa9146a410 0x55aa9150b1b0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f4238005b50 tx=0x7f4238016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.966+0000 7f4245ffb700 1 -- 172.21.15.6:0/1281229814 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42380055f0 con 0x55aa9146a410 2023-10-06T02:26:55.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.966+0000 7f4245ffb700 1 -- 172.21.15.6:0/1281229814 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42380089d0 con 0x55aa9146a410 2023-10-06T02:26:55.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.966+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4238005db0 con 0x55aa9146a410 2023-10-06T02:26:55.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.966+0000 7f4245ffb700 1 -- 172.21.15.6:0/1281229814 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4238012410 con 0x55aa9146a410 2023-10-06T02:26:55.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.966+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aa9137d3d0 con 0x55aa9146a410 2023-10-06T02:26:55.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.967+0000 7f4245ffb700 1 -- 172.21.15.6:0/1281229814 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4238012820 con 0x55aa9146a410 2023-10-06T02:26:55.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.967+0000 7f4245ffb700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4230065890 0x7f4230067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.969+0000 7f4245ffb700 1 -- 172.21.15.6:0/1281229814 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7840+0+0 (secure 0 0 0) 0x7f4238085c50 con 0x55aa9146a410 2023-10-06T02:26:55.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.969+0000 7f424d73b700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4230065890 0x7f4230067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.985 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:26:55.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.969+0000 7f4254500000 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55aa9150b6f0 0x55aa914f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.969+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa914f6790 con 0x55aa9150b6f0 2023-10-06T02:26:55.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.969+0000 7f424df3c700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55aa9150b6f0 0x55aa914f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.969+0000 7f424d73b700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4230065890 0x7f4230067d40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f424000a330 tx=0x7f4240018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.969+0000 7f424df3c700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55aa9150b6f0 0x55aa914f8c20 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.970+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v112'505 uv479 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.970+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91469420 con 0x55aa9150b6f0 2023-10-06T02:26:55.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.971+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v112'506 uv506 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.971+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa914f9160 con 0x55aa9150b6f0 2023-10-06T02:26:55.987 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:26:55.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.972+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v112'507 uv507 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.972+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915187b0 con 0x55aa9150b6f0 2023-10-06T02:26:55.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.973+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v112'508 uv508 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.973+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91518b60 con 0x55aa9150b6f0 2023-10-06T02:26:55.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.974+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v112'509 uv509 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.975+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915177a0 con 0x55aa9150b6f0 2023-10-06T02:26:55.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.976+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v112'510 uv510 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.976+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91517bd0 con 0x55aa9150b6f0 2023-10-06T02:26:55.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.977+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v112'511 uv485 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.977+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91517fd0 con 0x55aa9150b6f0 2023-10-06T02:26:55.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.978+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v112'512 uv512 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.978+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91517fd0 con 0x55aa9150b6f0 2023-10-06T02:26:55.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.979+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v112'513 uv513 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.990 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:26:55.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.979+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915183d0 con 0x55aa9150b6f0 2023-10-06T02:26:55.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.980+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v112'514 uv514 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.981+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91517f80 con 0x55aa9150b6f0 2023-10-06T02:26:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.982+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v112'515 uv515 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.982+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91517f80 con 0x55aa9150b6f0 2023-10-06T02:26:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.983+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v112'516 uv516 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.983+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91517f80 con 0x55aa9150b6f0 2023-10-06T02:26:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.984+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v112'517 uv492 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.984+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91517f80 con 0x55aa9150b6f0 2023-10-06T02:26:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.985+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v112'518 uv518 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.985+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91517f80 con 0x55aa9150b6f0 2023-10-06T02:26:55.992 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:26:55.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.986+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v112'519 uv519 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.986+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91517f80 con 0x55aa9150b6f0 2023-10-06T02:26:55.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.987+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v112'520 uv520 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.987+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91517f80 con 0x55aa9150b6f0 2023-10-06T02:26:55.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.988+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v112'521 uv521 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.988+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91517f80 con 0x55aa9150b6f0 2023-10-06T02:26:55.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.989+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v112'522 uv522 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.990+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91518f10 con 0x55aa9150b6f0 2023-10-06T02:26:55.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.990+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v112'523 uv523 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.990+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91518f10 con 0x55aa9150b6f0 2023-10-06T02:26:55.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.991+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v112'524 uv498 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.992+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91518f10 con 0x55aa9150b6f0 2023-10-06T02:26:55.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.992+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v112'525 uv525 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.992+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91518f10 con 0x55aa9150b6f0 2023-10-06T02:26:55.995 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:26:55.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.994+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v112'526 uv526 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.994+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91519f20 con 0x55aa9150b6f0 2023-10-06T02:26:55.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.995+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v112'527 uv527 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.995+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91519f20 con 0x55aa9150b6f0 2023-10-06T02:26:55.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.996+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v112'528 uv528 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.996+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91518f10 con 0x55aa9150b6f0 2023-10-06T02:26:55.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.997+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v112'529 uv529 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.997+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91518f10 con 0x55aa9150b6f0 2023-10-06T02:26:55.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.998+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v112'530 uv504 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:55.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.998+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91518f10 con 0x55aa9150b6f0 2023-10-06T02:26:56.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.999+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v112'531 uv531 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:56.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:55.999+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91518f10 con 0x55aa9150b6f0 2023-10-06T02:26:56.002 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:26:56.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.000+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v112'532 uv532 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:56.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.000+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91519f20 con 0x55aa9150b6f0 2023-10-06T02:26:56.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.001+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v112'533 uv533 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:56.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.001+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91519f20 con 0x55aa9150b6f0 2023-10-06T02:26:56.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.003+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v112'534 uv534 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:56.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.003+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91518f10 con 0x55aa9150b6f0 2023-10-06T02:26:56.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.004+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v112'535 uv535 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9150b6f0 2023-10-06T02:26:56.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.004+0000 7f4254500000 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55aa91519420 0x55aa9151b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.004+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151bd40 con 0x55aa91519420 2023-10-06T02:26:56.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.004+0000 7f424d73b700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55aa91519420 0x55aa9151b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.005+0000 7f424d73b700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55aa91519420 0x55aa9151b800 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:56.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.006+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v112'369 uv351 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.006+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151c0f0 con 0x55aa91519420 2023-10-06T02:26:56.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.007+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v112'370 uv370 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.007+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151c4a0 con 0x55aa91519420 2023-10-06T02:26:56.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.008+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v112'371 uv371 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.010 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:26:56.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.008+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151cd40 con 0x55aa91519420 2023-10-06T02:26:56.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.009+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v112'372 uv372 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.009+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151d0f0 con 0x55aa91519420 2023-10-06T02:26:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.010+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v112'373 uv373 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.010+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151d4a0 con 0x55aa91519420 2023-10-06T02:26:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.011+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v112'374 uv368 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.011+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151d850 con 0x55aa91519420 2023-10-06T02:26:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.012+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v112'375 uv375 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.012+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151dc00 con 0x55aa91519420 2023-10-06T02:26:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.013+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v112'376 uv376 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.015 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:26:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.013+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151dc00 con 0x55aa91519420 2023-10-06T02:26:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.014+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v112'377 uv377 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.014+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151dc00 con 0x55aa91519420 2023-10-06T02:26:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.015+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v112'378 uv378 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.015+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151dc00 con 0x55aa91519420 2023-10-06T02:26:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.016+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v112'379 uv361 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.016+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151dc00 con 0x55aa91519420 2023-10-06T02:26:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.017+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v112'380 uv380 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.017+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151dc00 con 0x55aa91519420 2023-10-06T02:26:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.018+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v112'381 uv381 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.020 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:26:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.018+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91521320 con 0x55aa91519420 2023-10-06T02:26:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.019+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v112'382 uv382 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.019+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91521320 con 0x55aa91519420 2023-10-06T02:26:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.020+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v112'383 uv383 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.020+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151dc00 con 0x55aa91519420 2023-10-06T02:26:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.021+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v112'384 uv367 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.021+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151dc00 con 0x55aa91519420 2023-10-06T02:26:56.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.022+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v112'385 uv385 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.022+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151dc00 con 0x55aa91519420 2023-10-06T02:26:56.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.023+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v112'386 uv386 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.024 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:26:56.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.023+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151ec10 con 0x55aa91519420 2023-10-06T02:26:56.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.024+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v112'387 uv387 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.024+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151ec10 con 0x55aa91519420 2023-10-06T02:26:56.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.025+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v112'388 uv388 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.025+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151dc00 con 0x55aa91519420 2023-10-06T02:26:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.026+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v112'389 uv389 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.026+0000 7f4254500000 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55aa9151e110 0x55aa915204f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.026+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91520a30 con 0x55aa9151e110 2023-10-06T02:26:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.026+0000 7f424cf3a700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55aa9151e110 0x55aa915204f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.026+0000 7f424cf3a700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55aa9151e110 0x55aa915204f0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:56.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.027+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v112'99 uv98 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.027+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91520e20 con 0x55aa9151e110 2023-10-06T02:26:56.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.028+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v112'100 uv100 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.028+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915213a0 con 0x55aa9151e110 2023-10-06T02:26:56.030 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:26:56.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.029+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v112'101 uv101 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.029+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9151c970 con 0x55aa9151e110 2023-10-06T02:26:56.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.030+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v112'102 uv102 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.030+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91522de0 con 0x55aa9151e110 2023-10-06T02:26:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.031+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v112'103 uv103 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.031+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91521c90 con 0x55aa9151e110 2023-10-06T02:26:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.032+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v112'104 uv104 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.032+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915220b0 con 0x55aa9151e110 2023-10-06T02:26:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.033+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v112'72 uv71 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.033+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915224d0 con 0x55aa9151e110 2023-10-06T02:26:56.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.034+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v112'73 uv73 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.034+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915224d0 con 0x55aa9151e110 2023-10-06T02:26:56.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.035+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v112'74 uv74 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.036 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:26:56.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.035+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91522920 con 0x55aa9151e110 2023-10-06T02:26:56.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.036+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v112'75 uv75 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.037+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91523240 con 0x55aa91519420 2023-10-06T02:26:56.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.038+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v112'99 uv98 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.038+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91523240 con 0x55aa91519420 2023-10-06T02:26:56.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.039+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v112'100 uv100 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.039+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91523240 con 0x55aa91519420 2023-10-06T02:26:56.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.040+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v112'101 uv101 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.042 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:26:56.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.040+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91524250 con 0x55aa91519420 2023-10-06T02:26:56.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.041+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v112'102 uv102 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.041+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91524250 con 0x55aa91519420 2023-10-06T02:26:56.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.042+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v112'103 uv103 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.042+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91523240 con 0x55aa91519420 2023-10-06T02:26:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.043+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v112'104 uv104 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91519420 2023-10-06T02:26:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.043+0000 7f4254500000 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55aa91523750 0x55aa91525b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.043+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91526070 con 0x55aa91523750 2023-10-06T02:26:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.043+0000 7f424df3c700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55aa91523750 0x55aa91525b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.044+0000 7f424df3c700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55aa91523750 0x55aa91525b30 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:56.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.045+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v112'182 uv176 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa91523750 2023-10-06T02:26:56.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.045+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91526070 con 0x55aa91523750 2023-10-06T02:26:56.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.047+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v112'183 uv183 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa91523750 2023-10-06T02:26:56.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.047+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915264a0 con 0x55aa91523750 2023-10-06T02:26:56.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.047+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v112'184 uv184 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa91523750 2023-10-06T02:26:56.049 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:26:56.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.047+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915274b0 con 0x55aa91523750 2023-10-06T02:26:56.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.049+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v112'185 uv185 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa91523750 2023-10-06T02:26:56.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.049+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915274b0 con 0x55aa91523750 2023-10-06T02:26:56.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.051+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v112'186 uv186 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa91523750 2023-10-06T02:26:56.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.051+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915264a0 con 0x55aa91523750 2023-10-06T02:26:56.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.051+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v112'187 uv187 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa91523750 2023-10-06T02:26:56.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.051+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915264a0 con 0x55aa91523750 2023-10-06T02:26:56.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.053+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v112'188 uv181 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa91523750 2023-10-06T02:26:56.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.053+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915264a0 con 0x55aa91523750 2023-10-06T02:26:56.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.054+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v112'189 uv189 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa91523750 2023-10-06T02:26:56.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.054+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915264a0 con 0x55aa91523750 2023-10-06T02:26:56.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.054+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v112'190 uv190 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa91523750 2023-10-06T02:26:56.055 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:26:56.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.055+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915264a0 con 0x55aa91523750 2023-10-06T02:26:56.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.056+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v112'191 uv191 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa91523750 2023-10-06T02:26:56.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.056+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915264a0 con 0x55aa91523750 2023-10-06T02:26:56.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.057+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v112'192 uv192 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa91523750 2023-10-06T02:26:56.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.057+0000 7f4254500000 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55aa91526b20 0x55aa91528f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.057+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915294e0 con 0x55aa91526b20 2023-10-06T02:26:56.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.057+0000 7f424d73b700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55aa91526b20 0x55aa91528f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.057+0000 7f424d73b700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55aa91526b20 0x55aa91528f00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:56.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.059+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v112'81 uv80 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91526b20 2023-10-06T02:26:56.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.059+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915294e0 con 0x55aa91526b20 2023-10-06T02:26:56.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.059+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v112'82 uv82 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91526b20 2023-10-06T02:26:56.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.059+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915294e0 con 0x55aa91526b20 2023-10-06T02:26:56.064 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:26:56.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.064+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v112'83 uv83 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91526b20 2023-10-06T02:26:56.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.064+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91529990 con 0x55aa91526b20 2023-10-06T02:26:56.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.065+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v112'84 uv84 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91526b20 2023-10-06T02:26:56.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.065+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91529990 con 0x55aa91526b20 2023-10-06T02:26:56.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.068+0000 7f424d73b700 1 -- 172.21.15.6:0/1281229814 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v112'85 uv85 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4240012450 con 0x55aa91526b20 2023-10-06T02:26:56.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.068+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91529990 con 0x55aa9151e110 2023-10-06T02:26:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.068+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v112'99 uv98 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.068+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91529990 con 0x55aa9151e110 2023-10-06T02:26:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.069+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v112'100 uv100 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.069+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91529990 con 0x55aa9151e110 2023-10-06T02:26:56.071 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:26:56.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.070+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v112'101 uv101 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.070+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152a9a0 con 0x55aa9151e110 2023-10-06T02:26:56.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.071+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v112'102 uv102 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.071+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152a9a0 con 0x55aa9151e110 2023-10-06T02:26:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.072+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v112'103 uv103 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.072+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa91529990 con 0x55aa9151e110 2023-10-06T02:26:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.073+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v112'104 uv104 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.073+0000 7f4254500000 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55aa9152a010 0x55aa9152c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.073+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152c980 con 0x55aa9152a010 2023-10-06T02:26:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.073+0000 7f424cf3a700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55aa9152a010 0x55aa9152c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.073+0000 7f424cf3a700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55aa9152a010 0x55aa9152c3f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.074+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v112'162 uv156 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9152a010 2023-10-06T02:26:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.074+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152c9c0 con 0x55aa9152a010 2023-10-06T02:26:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.075+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v112'163 uv163 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9152a010 2023-10-06T02:26:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.075+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152cdc0 con 0x55aa9152a010 2023-10-06T02:26:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.076+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v112'164 uv164 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9152a010 2023-10-06T02:26:56.136 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:26:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.076+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152cdc0 con 0x55aa9152a010 2023-10-06T02:26:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.077+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v112'165 uv165 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9152a010 2023-10-06T02:26:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.077+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152cdc0 con 0x55aa9152a010 2023-10-06T02:26:56.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.078+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v112'166 uv166 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9152a010 2023-10-06T02:26:56.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.078+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152cdc0 con 0x55aa9152a010 2023-10-06T02:26:56.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.079+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v112'167 uv161 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9152a010 2023-10-06T02:26:56.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.079+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152cdc0 con 0x55aa9152a010 2023-10-06T02:26:56.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.080+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v112'168 uv168 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9152a010 2023-10-06T02:26:56.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.080+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152cdc0 con 0x55aa9152a010 2023-10-06T02:26:56.139 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:26:56.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.081+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v112'169 uv169 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9152a010 2023-10-06T02:26:56.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.081+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152cdc0 con 0x55aa9152a010 2023-10-06T02:26:56.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.082+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v112'170 uv170 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9152a010 2023-10-06T02:26:56.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.082+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152fb30 con 0x55aa9152a010 2023-10-06T02:26:56.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.083+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v112'171 uv171 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9152a010 2023-10-06T02:26:56.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.083+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9151e110 2023-10-06T02:26:56.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.084+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v112'74 uv73 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.084+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9151e110 2023-10-06T02:26:56.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.086+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v112'75 uv75 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.086+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9151e110 2023-10-06T02:26:56.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.086+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v112'76 uv76 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.146 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:26:56.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.086+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9151e110 2023-10-06T02:26:56.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.087+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v112'77 uv77 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.087+0000 7f4254500000 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55aa9152db90 0x55aa91530280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.087+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9152db90 2023-10-06T02:26:56.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.089+0000 7f424df3c700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55aa9152db90 0x55aa91530280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.089+0000 7f424df3c700 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55aa9152db90 0x55aa91530280 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:56.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.090+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v112'99 uv98 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9152db90 2023-10-06T02:26:56.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.090+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9152db90 2023-10-06T02:26:56.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.093+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v112'100 uv100 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9152db90 2023-10-06T02:26:56.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.093+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9152db90 2023-10-06T02:26:56.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.095+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v112'101 uv101 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9152db90 2023-10-06T02:26:56.149 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:26:56.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.095+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9152db90 2023-10-06T02:26:56.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.098+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v112'102 uv102 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9152db90 2023-10-06T02:26:56.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.098+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9152db90 2023-10-06T02:26:56.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.099+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v112'103 uv103 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9152db90 2023-10-06T02:26:56.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.099+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9152db90 2023-10-06T02:26:56.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.101+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v112'104 uv104 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa9152db90 2023-10-06T02:26:56.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.101+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa91523750 2023-10-06T02:26:56.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.101+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v112'84 uv83 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa91523750 2023-10-06T02:26:56.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.101+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa91523750 2023-10-06T02:26:56.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.102+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v112'85 uv85 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa91523750 2023-10-06T02:26:56.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.102+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa91523750 2023-10-06T02:26:56.151 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:26:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.103+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v112'86 uv86 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa91523750 2023-10-06T02:26:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.103+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa91523750 2023-10-06T02:26:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.105+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v112'87 uv87 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa91523750 2023-10-06T02:26:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.105+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa91523750 2023-10-06T02:26:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.105+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v112'88 uv88 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f424800f800 con 0x55aa91523750 2023-10-06T02:26:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.105+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9151e110 2023-10-06T02:26:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.107+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v112'204 uv196 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.107+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9151e110 2023-10-06T02:26:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.111+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v112'205 uv205 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.111+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9151e110 2023-10-06T02:26:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.111+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v112'206 uv206 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.154 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:26:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.111+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9151e110 2023-10-06T02:26:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.114+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v112'207 uv207 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.114+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9151e110 2023-10-06T02:26:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.118+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v112'208 uv208 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.118+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9151e110 2023-10-06T02:26:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.120+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v112'209 uv203 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.120+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9151e110 2023-10-06T02:26:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.122+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v112'210 uv210 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.122+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9151e110 2023-10-06T02:26:56.156 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:26:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.126+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v112'211 uv211 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.126+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9151e110 2023-10-06T02:26:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.131+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v112'212 uv212 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.131+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9151e110 2023-10-06T02:26:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.131+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v112'213 uv213 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.131+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa9152d2b0 con 0x55aa9151e110 2023-10-06T02:26:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.134+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v112'214 uv214 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.134+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55aa915307c0 con 0x55aa9151e110 2023-10-06T02:26:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f424cf3a700 1 -- 172.21.15.6:0/1281229814 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v112'215 uv215 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f423802d070 con 0x55aa9151e110 2023-10-06T02:26:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55aa9151e110 msgr2=0x55aa915204f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55aa9151e110 0x55aa915204f0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55aa9150b6f0 msgr2=0x55aa914f8c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55aa9150b6f0 0x55aa914f8c20 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55aa9152a010 msgr2=0x55aa9152c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55aa9152a010 0x55aa9152c3f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55aa91519420 msgr2=0x55aa9151b800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55aa91519420 0x55aa9151b800 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55aa9152db90 msgr2=0x55aa91530280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 reap_dead start 2023-10-06T02:26:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55aa9152db90 0x55aa91530280 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55aa91526b20 msgr2=0x55aa91528f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55aa91526b20 0x55aa91528f00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55aa91523750 msgr2=0x55aa91525b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55aa91523750 0x55aa91525b30 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4230065890 msgr2=0x7f4230067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4230065890 0x7f4230067d40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f424000a330 tx=0x7f4240018000 comp rx=0 tx=0).stop 2023-10-06T02:26:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa9146a410 msgr2=0x55aa9150b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 --2- 172.21.15.6:0/1281229814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa9146a410 0x55aa9150b1b0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f4238005b50 tx=0x7f4238016000 comp rx=0 tx=0).stop 2023-10-06T02:26:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f424df3c700 1 -- 172.21.15.6:0/1281229814 reap_dead start 2023-10-06T02:26:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 shutdown_connections 2023-10-06T02:26:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 >> 172.21.15.6:0/1281229814 conn(0x55aa91423d50 msgr2=0x55aa91424b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 shutdown_connections 2023-10-06T02:26:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.139+0000 7f4254500000 1 -- 172.21.15.6:0/1281229814 wait complete. 2023-10-06T02:26:56.163 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 200.00000001 - 2023-10-06T02:26:56.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.238+0000 7f83ae207000 1 Processor -- start 2023-10-06T02:26:56.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.238+0000 7f83ae207000 1 -- start start 2023-10-06T02:26:56.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.239+0000 7f83ae207000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562ee0d31850 0x562ee0dd4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.239+0000 7f83ae207000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ee0d33ab0 0x562ee0d02e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.239+0000 7f83ae207000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee0d33e80 0x562ee0d4dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.239+0000 7f83ae207000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee0c4f980 con 0x562ee0d33e80 2023-10-06T02:26:56.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.239+0000 7f83ae207000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee0c4f620 con 0x562ee0d33ab0 2023-10-06T02:26:56.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.239+0000 7f83ae207000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ee0c46400 con 0x562ee0d31850 2023-10-06T02:26:56.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.239+0000 7f83a7c43700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee0d33e80 0x562ee0d4dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.239+0000 7f83a7c43700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee0d33e80 0x562ee0d4dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54836/0 (socket says 172.21.15.6:54836) 2023-10-06T02:26:56.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.239+0000 7f83a7c43700 1 -- 172.21.15.6:0/324796494 learned_addr learned my addr 172.21.15.6:0/324796494 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:56.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.239+0000 7f83a6c41700 1 --2- 172.21.15.6:0/324796494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ee0d33ab0 0x562ee0d02e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.239+0000 7f83a7442700 1 --2- 172.21.15.6:0/324796494 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562ee0d31850 0x562ee0dd4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.239+0000 7f83a7c43700 1 -- 172.21.15.6:0/324796494 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562ee0d31850 msgr2=0x562ee0dd4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:56.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83a7c43700 1 --2- 172.21.15.6:0/324796494 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562ee0d31850 0x562ee0dd4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83a7c43700 1 -- 172.21.15.6:0/324796494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ee0d33ab0 msgr2=0x562ee0d02e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:56.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83a7c43700 1 --2- 172.21.15.6:0/324796494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ee0d33ab0 0x562ee0d02e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83a7c43700 1 -- 172.21.15.6:0/324796494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839800a0e0 con 0x562ee0d33e80 2023-10-06T02:26:56.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83a7442700 1 --2- 172.21.15.6:0/324796494 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562ee0d31850 0x562ee0dd4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:56.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83a6c41700 1 --2- 172.21.15.6:0/324796494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ee0d33ab0 0x562ee0d02e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:56.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83a7c43700 1 --2- 172.21.15.6:0/324796494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee0d33e80 0x562ee0d4dba0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f839800ab90 tx=0x7f8398015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365b468ceb7d46d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:56.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83a5c3f700 1 -- 172.21.15.6:0/324796494 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839800fe30 con 0x562ee0d33e80 2023-10-06T02:26:56.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83a5c3f700 1 -- 172.21.15.6:0/324796494 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839800f860 con 0x562ee0d33e80 2023-10-06T02:26:56.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83a5c3f700 1 -- 172.21.15.6:0/324796494 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83980246c0 con 0x562ee0d33e80 2023-10-06T02:26:56.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83ae207000 1 -- 172.21.15.6:0/324796494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee0d33e80 msgr2=0x562ee0d4dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83ae207000 1 --2- 172.21.15.6:0/324796494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee0d33e80 0x562ee0d4dba0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f839800ab90 tx=0x7f8398015000 comp rx=0 tx=0).stop 2023-10-06T02:26:56.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83ae207000 1 -- 172.21.15.6:0/324796494 shutdown_connections 2023-10-06T02:26:56.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83ae207000 1 --2- 172.21.15.6:0/324796494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee0d33e80 0x562ee0d4dba0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83ae207000 1 --2- 172.21.15.6:0/324796494 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562ee0d31850 0x562ee0dd4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83ae207000 1 --2- 172.21.15.6:0/324796494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ee0d33ab0 0x562ee0d02e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83ae207000 1 -- 172.21.15.6:0/324796494 >> 172.21.15.6:0/324796494 conn(0x562ee0d4bbd0 msgr2=0x562ee0d07920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:56.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83ae207000 1 -- 172.21.15.6:0/324796494 shutdown_connections 2023-10-06T02:26:56.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.240+0000 7f83ae207000 1 -- 172.21.15.6:0/324796494 wait complete. 2023-10-06T02:26:56.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.241+0000 7f83ae207000 1 Processor -- start 2023-10-06T02:26:56.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.241+0000 7f83ae207000 1 -- start start 2023-10-06T02:26:56.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83ae207000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ee0d31850 0x562ee0d470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83ae207000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562ee0d33ab0 0x562ee0d48740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83ae207000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee0d33e80 0x562ee0d03070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83ae207000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee0ddc280 con 0x562ee0d33e80 2023-10-06T02:26:56.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83ae207000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee0d4afe0 con 0x562ee0d31850 2023-10-06T02:26:56.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83ae207000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ee0d4b280 con 0x562ee0d33ab0 2023-10-06T02:26:56.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83a7c43700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee0d33e80 0x562ee0d03070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83a7c43700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee0d33e80 0x562ee0d03070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54852/0 (socket says 172.21.15.6:54852) 2023-10-06T02:26:56.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83a7c43700 1 -- 172.21.15.6:0/4167479685 learned_addr learned my addr 172.21.15.6:0/4167479685 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:56.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83a7442700 1 --2- 172.21.15.6:0/4167479685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ee0d31850 0x562ee0d470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83a6c41700 1 --2- 172.21.15.6:0/4167479685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562ee0d33ab0 0x562ee0d48740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83a7c43700 1 -- 172.21.15.6:0/4167479685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562ee0d33ab0 msgr2=0x562ee0d48740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83a7c43700 1 --2- 172.21.15.6:0/4167479685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562ee0d33ab0 0x562ee0d48740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83a7c43700 1 -- 172.21.15.6:0/4167479685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ee0d31850 msgr2=0x562ee0d470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83a7c43700 1 --2- 172.21.15.6:0/4167479685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ee0d31850 0x562ee0d470e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83a7c43700 1 -- 172.21.15.6:0/4167479685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ee0c781c0 con 0x562ee0d33e80 2023-10-06T02:26:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83a7c43700 1 --2- 172.21.15.6:0/4167479685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee0d33e80 0x562ee0d03070 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f8398020000 tx=0x7f839801d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f838ffff700 1 -- 172.21.15.6:0/4167479685 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839800fa50 con 0x562ee0d33e80 2023-10-06T02:26:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f838ffff700 1 -- 172.21.15.6:0/4167479685 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839802f420 con 0x562ee0d33e80 2023-10-06T02:26:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f83ae207000 1 -- 172.21.15.6:0/4167479685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562ee0c5e3d0 con 0x562ee0d33e80 2023-10-06T02:26:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.242+0000 7f838ffff700 1 -- 172.21.15.6:0/4167479685 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839802f7e0 con 0x562ee0d33e80 2023-10-06T02:26:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.243+0000 7f83ae207000 1 -- 172.21.15.6:0/4167479685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562ee0c51ae0 con 0x562ee0d33e80 2023-10-06T02:26:56.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.244+0000 7f838ffff700 1 -- 172.21.15.6:0/4167479685 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8398021070 con 0x562ee0d33e80 2023-10-06T02:26:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.244+0000 7f838ffff700 1 --2- 172.21.15.6:0/4167479685 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83940658c0 0x7f8394067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.244+0000 7f838ffff700 1 -- 172.21.15.6:0/4167479685 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7840+0+0 (secure 0 0 0) 0x7f839802b070 con 0x562ee0d33e80 2023-10-06T02:26:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.244+0000 7f83a7442700 1 --2- 172.21.15.6:0/4167479685 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83940658c0 0x7f8394067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.244+0000 7f83ae207000 1 --2- 172.21.15.6:0/4167479685 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x562ee0d48c80 0x562ee0ded1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.244+0000 7f83ae207000 1 -- 172.21.15.6:0/4167479685 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:2e2fa760:::200.00000001:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x562ee0d035b0 con 0x562ee0d48c80 2023-10-06T02:26:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.245+0000 7f83a6c41700 1 --2- 172.21.15.6:0/4167479685 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x562ee0d48c80 0x562ee0ded1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.245+0000 7f83a7442700 1 --2- 172.21.15.6:0/4167479685 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83940658c0 0x7f8394067d70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f83a0005b20 tx=0x7f83a0005a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.245+0000 7f83a6c41700 1 --2- 172.21.15.6:0/4167479685 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x562ee0d48c80 0x562ee0ded1b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.246+0000 7f83a6c41700 1 -- 172.21.15.6:0/4167479685 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 200.00000001 [writefull 0~80] v112'390 uv390 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f839c00c4d0 con 0x562ee0d48c80 2023-10-06T02:26:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.246+0000 7f83ae207000 1 -- 172.21.15.6:0/4167479685 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x562ee0d48c80 msgr2=0x562ee0ded1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.246+0000 7f83ae207000 1 --2- 172.21.15.6:0/4167479685 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x562ee0d48c80 0x562ee0ded1b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.246+0000 7f83ae207000 1 -- 172.21.15.6:0/4167479685 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83940658c0 msgr2=0x7f8394067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.246+0000 7f83ae207000 1 --2- 172.21.15.6:0/4167479685 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83940658c0 0x7f8394067d70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f83a0005b20 tx=0x7f83a0005a50 comp rx=0 tx=0).stop 2023-10-06T02:26:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.246+0000 7f83ae207000 1 -- 172.21.15.6:0/4167479685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee0d33e80 msgr2=0x562ee0d03070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.246+0000 7f83ae207000 1 --2- 172.21.15.6:0/4167479685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee0d33e80 0x562ee0d03070 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f8398020000 tx=0x7f839801d070 comp rx=0 tx=0).stop 2023-10-06T02:26:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.246+0000 7f83a7c43700 1 -- 172.21.15.6:0/4167479685 reap_dead start 2023-10-06T02:26:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.246+0000 7f83ae207000 1 -- 172.21.15.6:0/4167479685 shutdown_connections 2023-10-06T02:26:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.246+0000 7f83ae207000 1 -- 172.21.15.6:0/4167479685 >> 172.21.15.6:0/4167479685 conn(0x562ee0d4bbd0 msgr2=0x562ee0d07920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.246+0000 7f83ae207000 1 -- 172.21.15.6:0/4167479685 shutdown_connections 2023-10-06T02:26:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.247+0000 7f83ae207000 1 -- 172.21.15.6:0/4167479685 wait complete. 2023-10-06T02:26:56.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:26:56.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.424+0000 7f4feb1b8700 1 Processor -- start 2023-10-06T02:26:56.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.424+0000 7f4feb1b8700 1 -- start start 2023-10-06T02:26:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.425+0000 7f4feb1b8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fe40ad140 0x7f4fe40b3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.425+0000 7f4feb1b8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fe406e040 0x7f4fe40699f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.425+0000 7f4feb1b8700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe406ec30 con 0x7f4fe40b3c70 2023-10-06T02:26:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.425+0000 7f4feb1b8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe4159c10 con 0x7f4fe406e040 2023-10-06T02:26:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.425+0000 7f4feb1b8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe4159ef0 con 0x7f4fe40ad140 2023-10-06T02:26:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.425+0000 7f4fea9b7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fe406e040 0x7f4fe40699f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.425+0000 7f4fea9b7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fe406e040 0x7f4fe40699f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54868/0 (socket says 172.21.15.6:54868) 2023-10-06T02:26:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.425+0000 7f4fea9b7700 1 -- 172.21.15.6:0/3619602576 learned_addr learned my addr 172.21.15.6:0/3619602576 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.425+0000 7f4fea1b6700 1 --2- 172.21.15.6:0/3619602576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fe40ad140 0x7f4fe40b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.425+0000 7f4fea9b7700 1 -- 172.21.15.6:0/3619602576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fe40ad140 msgr2=0x7f4fe40b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.425+0000 7f4fea9b7700 1 --2- 172.21.15.6:0/3619602576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fe40ad140 0x7f4fe40b3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.425+0000 7f4fea9b7700 1 -- 172.21.15.6:0/3619602576 >> v1:172.21.15.175:6789/0 conn(0x7f4fe40b3c70 legacy=0x7f4fe406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.425+0000 7f4fea9b7700 1 -- 172.21.15.6:0/3619602576 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe415a1d0 con 0x7f4fe406e040 2023-10-06T02:26:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.425+0000 7f4fea9b7700 1 --2- 172.21.15.6:0/3619602576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fe406e040 0x7f4fe40699f0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009f20 tx=0x7f4fdc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692b55f013825b7f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.426+0000 7f4fe91b4700 1 -- 172.21.15.6:0/3619602576 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc00e070 con 0x7f4fe406e040 2023-10-06T02:26:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.426+0000 7f4fe91b4700 1 -- 172.21.15.6:0/3619602576 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fdc00ba80 con 0x7f4fe406e040 2023-10-06T02:26:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.426+0000 7f4fe91b4700 1 -- 172.21.15.6:0/3619602576 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0092e0 con 0x7f4fe406e040 2023-10-06T02:26:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.426+0000 7f4feb1b8700 1 -- 172.21.15.6:0/3619602576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fe406e040 msgr2=0x7f4fe40699f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.426+0000 7f4feb1b8700 1 --2- 172.21.15.6:0/3619602576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fe406e040 0x7f4fe40699f0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009f20 tx=0x7f4fdc009840 comp rx=0 tx=0).stop 2023-10-06T02:26:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.426+0000 7f4feb1b8700 1 -- 172.21.15.6:0/3619602576 shutdown_connections 2023-10-06T02:26:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.426+0000 7f4feb1b8700 1 --2- 172.21.15.6:0/3619602576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fe406e040 0x7f4fe40699f0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.426+0000 7f4feb1b8700 1 --2- 172.21.15.6:0/3619602576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fe40ad140 0x7f4fe40b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.426+0000 7f4feb1b8700 1 -- 172.21.15.6:0/3619602576 >> 172.21.15.6:0/3619602576 conn(0x7f4fe40ce9d0 msgr2=0x7f4fe406c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.426+0000 7f4feb1b8700 1 -- 172.21.15.6:0/3619602576 shutdown_connections 2023-10-06T02:26:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.426+0000 7f4feb1b8700 1 -- 172.21.15.6:0/3619602576 wait complete. 2023-10-06T02:26:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.427+0000 7f4feb1b8700 1 Processor -- start 2023-10-06T02:26:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.427+0000 7f4feb1b8700 1 -- start start 2023-10-06T02:26:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.428+0000 7f4feb1b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fe406e040 0x7f4fe4152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.428+0000 7f4feb1b8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fe40ad140 0x7f4fe414fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.428+0000 7f4feb1b8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fe4150700 0x7f4fe40cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.428+0000 7f4feb1b8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe4153800 con 0x7f4fe406e040 2023-10-06T02:26:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.428+0000 7f4feb1b8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe40c8270 con 0x7f4fe40ad140 2023-10-06T02:26:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.428+0000 7f4feb1b8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe40c8550 con 0x7f4fe4150700 2023-10-06T02:26:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.428+0000 7f4fea1b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fe406e040 0x7f4fe4152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.428+0000 7f4fea1b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fe406e040 0x7f4fe4152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54878/0 (socket says 172.21.15.6:54878) 2023-10-06T02:26:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.428+0000 7f4fea1b6700 1 -- 172.21.15.6:0/3509054762 learned_addr learned my addr 172.21.15.6:0/3509054762 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.428+0000 7f4fea9b7700 1 --2- 172.21.15.6:0/3509054762 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fe4150700 0x7f4fe40cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.428+0000 7f4fe99b5700 1 --2- 172.21.15.6:0/3509054762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fe40ad140 0x7f4fe414fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.429+0000 7f4fea1b6700 1 -- 172.21.15.6:0/3509054762 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fe4150700 msgr2=0x7f4fe40cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.429+0000 7f4fea1b6700 1 --2- 172.21.15.6:0/3509054762 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fe4150700 0x7f4fe40cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.429+0000 7f4fea1b6700 1 -- 172.21.15.6:0/3509054762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fe40ad140 msgr2=0x7f4fe414fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.429+0000 7f4fea1b6700 1 --2- 172.21.15.6:0/3509054762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fe40ad140 0x7f4fe414fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.429+0000 7f4fea1b6700 1 -- 172.21.15.6:0/3509054762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc009ae0 con 0x7f4fe406e040 2023-10-06T02:26:56.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.429+0000 7f4fea1b6700 1 --2- 172.21.15.6:0/3509054762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fe406e040 0x7f4fe4152f60 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000d890 tx=0x7f4fe0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.429+0000 7f4fda7fc700 1 -- 172.21.15.6:0/3509054762 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00125f0 con 0x7f4fe406e040 2023-10-06T02:26:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.429+0000 7f4fda7fc700 1 -- 172.21.15.6:0/3509054762 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe0012750 con 0x7f4fe406e040 2023-10-06T02:26:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.429+0000 7f4feb1b8700 1 -- 172.21.15.6:0/3509054762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe40c8830 con 0x7f4fe406e040 2023-10-06T02:26:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.429+0000 7f4fda7fc700 1 -- 172.21.15.6:0/3509054762 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0012af0 con 0x7f4fe406e040 2023-10-06T02:26:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.429+0000 7f4feb1b8700 1 -- 172.21.15.6:0/3509054762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe41534a0 con 0x7f4fe406e040 2023-10-06T02:26:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.430+0000 7f4feb1b8700 1 -- 172.21.15.6:0/3509054762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe40c8e80 con 0x7f4fe406e040 2023-10-06T02:26:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.430+0000 7f4fda7fc700 1 -- 172.21.15.6:0/3509054762 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fe001e460 con 0x7f4fe406e040 2023-10-06T02:26:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.431+0000 7f4fda7fc700 1 --2- 172.21.15.6:0/3509054762 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4fc8066f30 0x7f4fc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.431+0000 7f4fda7fc700 1 -- 172.21.15.6:0/3509054762 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7840+0+0 (secure 0 0 0) 0x7f4fe00852b0 con 0x7f4fe406e040 2023-10-06T02:26:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.431+0000 7f4fe99b5700 1 --2- 172.21.15.6:0/3509054762 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4fc8066f30 0x7f4fc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.432+0000 7f4fe99b5700 1 --2- 172.21.15.6:0/3509054762 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4fc8066f30 0x7f4fc80693e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4fe41539a0 tx=0x7f4fd4007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.435+0000 7f4fda7fc700 1 -- 172.21.15.6:0/3509054762 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fe0051cd0 con 0x7f4fe406e040 2023-10-06T02:26:56.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.673+0000 7f4feb1b8700 1 -- 172.21.15.6:0/3509054762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f4fe4064aa0 con 0x7f4fe406e040 2023-10-06T02:26:56.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.914+0000 7f4fda7fc700 1 -- 172.21.15.6:0/3509054762 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v200) v1 ==== 162+0+0 (secure 0 0 0) 0x7f4fe00552f0 con 0x7f4fe406e040 2023-10-06T02:26:56.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.916+0000 7f4feb1b8700 1 -- 172.21.15.6:0/3509054762 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4fc8066f30 msgr2=0x7f4fc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.916+0000 7f4feb1b8700 1 --2- 172.21.15.6:0/3509054762 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4fc8066f30 0x7f4fc80693e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4fe41539a0 tx=0x7f4fd4007ec0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.916+0000 7f4feb1b8700 1 -- 172.21.15.6:0/3509054762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fe406e040 msgr2=0x7f4fe4152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:56.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.916+0000 7f4feb1b8700 1 --2- 172.21.15.6:0/3509054762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fe406e040 0x7f4fe4152f60 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000d890 tx=0x7f4fe0008040 comp rx=0 tx=0).stop 2023-10-06T02:26:56.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.916+0000 7f4feb1b8700 1 -- 172.21.15.6:0/3509054762 shutdown_connections 2023-10-06T02:26:56.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.916+0000 7f4feb1b8700 1 --2- 172.21.15.6:0/3509054762 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fe4150700 0x7f4fe40cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.916+0000 7f4feb1b8700 1 --2- 172.21.15.6:0/3509054762 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4fc8066f30 0x7f4fc80693e0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.916+0000 7f4feb1b8700 1 --2- 172.21.15.6:0/3509054762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fe406e040 0x7f4fe4152f60 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.916+0000 7f4feb1b8700 1 --2- 172.21.15.6:0/3509054762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fe40ad140 0x7f4fe414fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:56.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.916+0000 7f4feb1b8700 1 -- 172.21.15.6:0/3509054762 >> 172.21.15.6:0/3509054762 conn(0x7f4fe40ce9d0 msgr2=0x7f4fe40af470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:56.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.916+0000 7f4feb1b8700 1 -- 172.21.15.6:0/3509054762 shutdown_connections 2023-10-06T02:26:56.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:56.917+0000 7f4feb1b8700 1 -- 172.21.15.6:0/3509054762 wait complete. 2023-10-06T02:26:56.919 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:26:56.922 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:26:56.922+0000 7f9f6d431700 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2023-10-06T02:26:56.923 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:26:56.923+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:26:56.923 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:26:56.923+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:26:56.932 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:56.933 INFO:tasks.ceph.mds.a.smithi006.stderr: -15> 2023-10-06T02:26:56.922+0000 7f9f6d431700 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2023-10-06T02:26:56.952 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:26:57.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.053+0000 7f8a1c094700 1 Processor -- start 2023-10-06T02:26:57.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.054+0000 7f8a1c094700 1 -- start start 2023-10-06T02:26:57.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.054+0000 7f8a1c094700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8a140a73e0 0x7f8a140c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.054+0000 7f8a1c094700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8a140c9df0 0x7f8a140ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.054+0000 7f8a1c094700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a140cb700 0x7f8a140cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.054+0000 7f8a1c094700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a140cb270 con 0x7f8a140a73e0 2023-10-06T02:26:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.054+0000 7f8a1c094700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a140ca660 con 0x7f8a140c9df0 2023-10-06T02:26:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.054+0000 7f8a1c094700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a140ca940 con 0x7f8a140cb700 2023-10-06T02:26:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.054+0000 7f8a19e30700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8a140a73e0 0x7f8a140c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.055+0000 7f8a19e30700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8a140a73e0 0x7f8a140c8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54886/0 (socket says 172.21.15.6:54886) 2023-10-06T02:26:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.055+0000 7f8a19e30700 1 -- 172.21.15.6:0/872674262 learned_addr learned my addr 172.21.15.6:0/872674262 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.055+0000 7f8a1a631700 1 --2- 172.21.15.6:0/872674262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a140cb700 0x7f8a140cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.055+0000 7f8a1962f700 1 --2- 172.21.15.6:0/872674262 >> v2:172.21.15.175:3300/0 conn(0x7f8a140c9df0 0x7f8a140ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.055+0000 7f8a19e30700 1 -- 172.21.15.6:0/872674262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a140cb700 msgr2=0x7f8a140cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.055+0000 7f8a19e30700 1 --2- 172.21.15.6:0/872674262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a140cb700 0x7f8a140cbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.055+0000 7f8a19e30700 1 -- 172.21.15.6:0/872674262 >> v2:172.21.15.175:3300/0 conn(0x7f8a140c9df0 msgr2=0x7f8a140ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.055+0000 7f8a19e30700 1 --2- 172.21.15.6:0/872674262 >> v2:172.21.15.175:3300/0 conn(0x7f8a140c9df0 0x7f8a140ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.055+0000 7f8a19e30700 1 -- 172.21.15.6:0/872674262 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a140cac20 con 0x7f8a140a73e0 2023-10-06T02:26:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.055+0000 7f8a1962f700 1 --2- 172.21.15.6:0/872674262 >> v2:172.21.15.175:3300/0 conn(0x7f8a140c9df0 0x7f8a140ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.055+0000 7f8a19e30700 1 --2- 172.21.15.6:0/872674262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a140a73e0 0x7f8a140c8d60 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f8a1409a100 tx=0x7f8a04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725c012f23352222 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.055+0000 7f8a18e2e700 1 -- 172.21.15.6:0/872674262 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400e070 con 0x7f8a140a73e0 2023-10-06T02:26:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.055+0000 7f8a18e2e700 1 -- 172.21.15.6:0/872674262 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0400ba50 con 0x7f8a140a73e0 2023-10-06T02:26:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.055+0000 7f8a18e2e700 1 -- 172.21.15.6:0/872674262 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a040092e0 con 0x7f8a140a73e0 2023-10-06T02:26:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.056+0000 7f8a1c094700 1 -- 172.21.15.6:0/872674262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a140a73e0 msgr2=0x7f8a140c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.056+0000 7f8a1c094700 1 --2- 172.21.15.6:0/872674262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a140a73e0 0x7f8a140c8d60 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f8a1409a100 tx=0x7f8a04009840 comp rx=0 tx=0).stop 2023-10-06T02:26:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.056+0000 7f8a1c094700 1 -- 172.21.15.6:0/872674262 shutdown_connections 2023-10-06T02:26:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.056+0000 7f8a1c094700 1 --2- 172.21.15.6:0/872674262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a140cb700 0x7f8a140cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.056+0000 7f8a1c094700 1 --2- 172.21.15.6:0/872674262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a140a73e0 0x7f8a140c8d60 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.056+0000 7f8a1c094700 1 --2- 172.21.15.6:0/872674262 >> v2:172.21.15.175:3300/0 conn(0x7f8a140c9df0 0x7f8a140ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.056+0000 7f8a1c094700 1 -- 172.21.15.6:0/872674262 >> 172.21.15.6:0/872674262 conn(0x7f8a140cc790 msgr2=0x7f8a140ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.056+0000 7f8a1c094700 1 -- 172.21.15.6:0/872674262 shutdown_connections 2023-10-06T02:26:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.056+0000 7f8a1c094700 1 -- 172.21.15.6:0/872674262 wait complete. 2023-10-06T02:26:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.057+0000 7f8a1c094700 1 Processor -- start 2023-10-06T02:26:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.057+0000 7f8a1c094700 1 -- start start 2023-10-06T02:26:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a1c094700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a140a73e0 0x7f8a1415c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a1c094700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a140c9df0 0x7f8a1415afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a1c094700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a140cb700 0x7f8a14068680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a1c094700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a140a89d0 con 0x7f8a140c9df0 2023-10-06T02:26:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a1c094700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a140a9550 con 0x7f8a140a73e0 2023-10-06T02:26:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a1c094700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1415b520 con 0x7f8a140cb700 2023-10-06T02:26:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a1962f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a140c9df0 0x7f8a1415afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a1962f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a140c9df0 0x7f8a1415afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54896/0 (socket says 172.21.15.6:54896) 2023-10-06T02:26:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a1962f700 1 -- 172.21.15.6:0/3528330410 learned_addr learned my addr 172.21.15.6:0/3528330410 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a1a631700 1 --2- 172.21.15.6:0/3528330410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a140cb700 0x7f8a14068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a19e30700 1 --2- 172.21.15.6:0/3528330410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a140a73e0 0x7f8a1415c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a1a631700 1 -- 172.21.15.6:0/3528330410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a140a73e0 msgr2=0x7f8a1415c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a1a631700 1 --2- 172.21.15.6:0/3528330410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a140a73e0 0x7f8a1415c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a1a631700 1 -- 172.21.15.6:0/3528330410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a140c9df0 msgr2=0x7f8a1415afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a1a631700 1 --2- 172.21.15.6:0/3528330410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a140c9df0 0x7f8a1415afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a1a631700 1 -- 172.21.15.6:0/3528330410 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a04009ae0 con 0x7f8a140cb700 2023-10-06T02:26:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a1962f700 1 --2- 172.21.15.6:0/3528330410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a140c9df0 0x7f8a1415afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:26:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.058+0000 7f8a1a631700 1 --2- 172.21.15.6:0/3528330410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a140cb700 0x7f8a14068680 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00d890 tx=0x7f8a0c008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.059+0000 7f8a11ffb700 1 -- 172.21.15.6:0/3528330410 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c0125f0 con 0x7f8a140cb700 2023-10-06T02:26:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.059+0000 7f8a11ffb700 1 -- 172.21.15.6:0/3528330410 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c012750 con 0x7f8a140cb700 2023-10-06T02:26:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.059+0000 7f8a1c094700 1 -- 172.21.15.6:0/3528330410 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a140a99e0 con 0x7f8a140cb700 2023-10-06T02:26:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.059+0000 7f8a11ffb700 1 -- 172.21.15.6:0/3528330410 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c012af0 con 0x7f8a140cb700 2023-10-06T02:26:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.059+0000 7f8a1c094700 1 -- 172.21.15.6:0/3528330410 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a140a8f00 con 0x7f8a140cb700 2023-10-06T02:26:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.060+0000 7f8a1c094700 1 -- 172.21.15.6:0/3528330410 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a140a96e0 con 0x7f8a140cb700 2023-10-06T02:26:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.060+0000 7f8a11ffb700 1 -- 172.21.15.6:0/3528330410 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a0c013480 con 0x7f8a140cb700 2023-10-06T02:26:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.060+0000 7f8a11ffb700 1 --2- 172.21.15.6:0/3528330410 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a00066f30 0x7f8a000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.060+0000 7f8a11ffb700 1 -- 172.21.15.6:0/3528330410 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7f8a0c085100 con 0x7f8a140cb700 2023-10-06T02:26:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.061+0000 7f8a19e30700 1 --2- 172.21.15.6:0/3528330410 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a00066f30 0x7f8a000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.061+0000 7f8a19e30700 1 --2- 172.21.15.6:0/3528330410 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a00066f30 0x7f8a000693e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009a60 tx=0x7f8a04018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:57.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.065+0000 7f8a11ffb700 1 -- 172.21.15.6:0/3528330410 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a0c051ac0 con 0x7f8a140cb700 2023-10-06T02:26:57.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.306+0000 7f8a1c094700 1 -- 172.21.15.6:0/3528330410 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a140caf00 con 0x7f8a140cb700 2023-10-06T02:26:57.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.306+0000 7f8a11ffb700 1 -- 172.21.15.6:0/3528330410 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 202 v202) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f8a0c0550e0 con 0x7f8a140cb700 2023-10-06T02:26:57.307 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:57.307 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":202,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":202,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:56.923720+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:57.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.308+0000 7f8a1c094700 1 -- 172.21.15.6:0/3528330410 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a00066f30 msgr2=0x7f8a000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:57.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.308+0000 7f8a1c094700 1 --2- 172.21.15.6:0/3528330410 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a00066f30 0x7f8a000693e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009a60 tx=0x7f8a04018000 comp rx=0 tx=0).stop 2023-10-06T02:26:57.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.308+0000 7f8a1c094700 1 -- 172.21.15.6:0/3528330410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a140cb700 msgr2=0x7f8a14068680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:57.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.308+0000 7f8a1c094700 1 --2- 172.21.15.6:0/3528330410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a140cb700 0x7f8a14068680 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00d890 tx=0x7f8a0c008040 comp rx=0 tx=0).stop 2023-10-06T02:26:57.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.308+0000 7f8a1c094700 1 -- 172.21.15.6:0/3528330410 shutdown_connections 2023-10-06T02:26:57.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.308+0000 7f8a1c094700 1 --2- 172.21.15.6:0/3528330410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a140cb700 0x7f8a14068680 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.308+0000 7f8a1c094700 1 --2- 172.21.15.6:0/3528330410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a140a73e0 0x7f8a1415c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.308+0000 7f8a1c094700 1 --2- 172.21.15.6:0/3528330410 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a00066f30 0x7f8a000693e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.308+0000 7f8a1c094700 1 --2- 172.21.15.6:0/3528330410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a140c9df0 0x7f8a1415afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.308+0000 7f8a1c094700 1 -- 172.21.15.6:0/3528330410 >> 172.21.15.6:0/3528330410 conn(0x7f8a140cc790 msgr2=0x7f8a141559e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:57.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.309+0000 7f8a1c094700 1 -- 172.21.15.6:0/3528330410 shutdown_connections 2023-10-06T02:26:57.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.309+0000 7f8a1c094700 1 -- 172.21.15.6:0/3528330410 wait complete. 2023-10-06T02:26:57.310 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 202 2023-10-06T02:26:57.321 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:26:57.321 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:57.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.480+0000 7f7c621f9700 1 Processor -- start 2023-10-06T02:26:57.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.480+0000 7f7c621f9700 1 -- start start 2023-10-06T02:26:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.481+0000 7f7c621f9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c5c159400 0x7f7c5c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.481+0000 7f7c621f9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5c0b3560 con 0x7f7c5c0cd030 2023-10-06T02:26:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.481+0000 7f7c621f9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5c0cf6f0 con 0x7f7c5c0d05d0 2023-10-06T02:26:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.481+0000 7f7c621f9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5c0cf9d0 con 0x7f7c5c159400 2023-10-06T02:26:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.481+0000 7f7c611f7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c5c159400 0x7f7c5c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.481+0000 7f7c609f6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7c5c0cd030 0x7f7c5c0cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60358/0 (socket says 172.21.15.6:60358) 2023-10-06T02:26:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.481+0000 7f7c609f6700 1 -- 172.21.15.6:0/1859362779 learned_addr learned my addr 172.21.15.6:0/1859362779 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.481+0000 7f7c611f7700 1 -- 172.21.15.6:0/1859362779 >> v1:172.21.15.175:6789/0 conn(0x7f7c5c0d05d0 legacy=0x7f7c5c0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.481+0000 7f7c611f7700 1 -- 172.21.15.6:0/1859362779 >> v1:172.21.15.6:6789/0 conn(0x7f7c5c0cd030 legacy=0x7f7c5c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.481+0000 7f7c53fff700 1 -- 172.21.15.6:0/1859362779 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743052799 0 0) 0x7f7c5c0b3560 con 0x7f7c5c0cd030 2023-10-06T02:26:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.481+0000 7f7c611f7700 1 -- 172.21.15.6:0/1859362779 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c0b2f10 con 0x7f7c5c159400 2023-10-06T02:26:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.482+0000 7f7c611f7700 1 --2- 172.21.15.6:0/1859362779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c5c159400 0x7f7c5c0ccaf0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f7c580098d0 tx=0x7f7c58009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b9f9dbbe9ed804 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.482+0000 7f7c53fff700 1 -- 172.21.15.6:0/1859362779 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58009e70 con 0x7f7c5c159400 2023-10-06T02:26:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.482+0000 7f7c53fff700 1 -- 172.21.15.6:0/1859362779 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c58005c10 con 0x7f7c5c159400 2023-10-06T02:26:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.482+0000 7f7c53fff700 1 -- 172.21.15.6:0/1859362779 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5800b610 con 0x7f7c5c159400 2023-10-06T02:26:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.482+0000 7f7c621f9700 1 -- 172.21.15.6:0/1859362779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c5c159400 msgr2=0x7f7c5c0ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.482+0000 7f7c621f9700 1 --2- 172.21.15.6:0/1859362779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c5c159400 0x7f7c5c0ccaf0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f7c580098d0 tx=0x7f7c58009120 comp rx=0 tx=0).stop 2023-10-06T02:26:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.482+0000 7f7c621f9700 1 -- 172.21.15.6:0/1859362779 shutdown_connections 2023-10-06T02:26:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.482+0000 7f7c621f9700 1 --2- 172.21.15.6:0/1859362779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c5c159400 0x7f7c5c0ccaf0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.482+0000 7f7c621f9700 1 -- 172.21.15.6:0/1859362779 >> 172.21.15.6:0/1859362779 conn(0x7f7c5c06ac10 msgr2=0x7f7c5c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.482+0000 7f7c621f9700 1 -- 172.21.15.6:0/1859362779 shutdown_connections 2023-10-06T02:26:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.482+0000 7f7c621f9700 1 -- 172.21.15.6:0/1859362779 wait complete. 2023-10-06T02:26:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.483+0000 7f7c621f9700 1 Processor -- start 2023-10-06T02:26:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.483+0000 7f7c621f9700 1 -- start start 2023-10-06T02:26:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.484+0000 7f7c621f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c5c0cd030 0x7f7c5c154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.484+0000 7f7c621f9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c5c0d05d0 0x7f7c5c0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.484+0000 7f7c621f9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c5c159400 0x7f7c5c0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.484+0000 7f7c621f9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c154b70 con 0x7f7c5c0cd030 2023-10-06T02:26:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.484+0000 7f7c621f9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c0c7400 con 0x7f7c5c159400 2023-10-06T02:26:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.484+0000 7f7c621f9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c0c67f0 con 0x7f7c5c0d05d0 2023-10-06T02:26:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.484+0000 7f7c611f7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c5c0cd030 0x7f7c5c154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.484+0000 7f7c611f7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c5c0cd030 0x7f7c5c154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54904/0 (socket says 172.21.15.6:54904) 2023-10-06T02:26:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.484+0000 7f7c611f7700 1 -- 172.21.15.6:0/2464654403 learned_addr learned my addr 172.21.15.6:0/2464654403 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.485+0000 7f7c609f6700 1 --2- 172.21.15.6:0/2464654403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c5c0d05d0 0x7f7c5c0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.485+0000 7f7c619f8700 1 --2- 172.21.15.6:0/2464654403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c5c159400 0x7f7c5c0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.485+0000 7f7c611f7700 1 -- 172.21.15.6:0/2464654403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c5c0d05d0 msgr2=0x7f7c5c0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.485+0000 7f7c611f7700 1 --2- 172.21.15.6:0/2464654403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c5c0d05d0 0x7f7c5c0cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.485+0000 7f7c611f7700 1 -- 172.21.15.6:0/2464654403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c5c159400 msgr2=0x7f7c5c0cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.485+0000 7f7c611f7700 1 --2- 172.21.15.6:0/2464654403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c5c159400 0x7f7c5c0cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.485+0000 7f7c611f7700 1 -- 172.21.15.6:0/2464654403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c580093c0 con 0x7f7c5c0cd030 2023-10-06T02:26:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.485+0000 7f7c611f7700 1 --2- 172.21.15.6:0/2464654403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c5c0cd030 0x7f7c5c154630 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009390 tx=0x7f7c58015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.485+0000 7f7c517fa700 1 -- 172.21.15.6:0/2464654403 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c580064e0 con 0x7f7c5c0cd030 2023-10-06T02:26:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.485+0000 7f7c517fa700 1 -- 172.21.15.6:0/2464654403 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c58006640 con 0x7f7c5c0cd030 2023-10-06T02:26:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.485+0000 7f7c517fa700 1 -- 172.21.15.6:0/2464654403 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58026470 con 0x7f7c5c0cd030 2023-10-06T02:26:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.485+0000 7f7c621f9700 1 -- 172.21.15.6:0/2464654403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5c0c6ad0 con 0x7f7c5c0cd030 2023-10-06T02:26:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.485+0000 7f7c621f9700 1 -- 172.21.15.6:0/2464654403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5c0c7090 con 0x7f7c5c0cd030 2023-10-06T02:26:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.486+0000 7f7c621f9700 1 -- 172.21.15.6:0/2464654403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5c0694a0 con 0x7f7c5c0cd030 2023-10-06T02:26:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.486+0000 7f7c517fa700 1 -- 172.21.15.6:0/2464654403 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c58023070 con 0x7f7c5c0cd030 2023-10-06T02:26:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.487+0000 7f7c517fa700 1 --2- 172.21.15.6:0/2464654403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c40066f30 0x7f7c400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.487+0000 7f7c517fa700 1 -- 172.21.15.6:0/2464654403 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7f7c58087060 con 0x7f7c5c0cd030 2023-10-06T02:26:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.487+0000 7f7c609f6700 1 --2- 172.21.15.6:0/2464654403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c40066f30 0x7f7c400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.488+0000 7f7c609f6700 1 --2- 172.21.15.6:0/2464654403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c40066f30 0x7f7c400693e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0c5760 tx=0x7f7c4c007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.491+0000 7f7c517fa700 1 -- 172.21.15.6:0/2464654403 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c58053a20 con 0x7f7c5c0cd030 2023-10-06T02:26:57.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.729+0000 7f7c621f9700 1 -- 172.21.15.6:0/2464654403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c5c0cf2f0 con 0x7f7c5c0cd030 2023-10-06T02:26:57.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.730+0000 7f7c517fa700 1 -- 172.21.15.6:0/2464654403 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 202 v202) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f7c5802b020 con 0x7f7c5c0cd030 2023-10-06T02:26:57.730 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:57.731 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":202,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":202,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:56.923720+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.732+0000 7f7c621f9700 1 -- 172.21.15.6:0/2464654403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c40066f30 msgr2=0x7f7c400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.732+0000 7f7c621f9700 1 --2- 172.21.15.6:0/2464654403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c40066f30 0x7f7c400693e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0c5760 tx=0x7f7c4c007d30 comp rx=0 tx=0).stop 2023-10-06T02:26:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.732+0000 7f7c621f9700 1 -- 172.21.15.6:0/2464654403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c5c0cd030 msgr2=0x7f7c5c154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.732+0000 7f7c621f9700 1 --2- 172.21.15.6:0/2464654403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c5c0cd030 0x7f7c5c154630 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009390 tx=0x7f7c58015000 comp rx=0 tx=0).stop 2023-10-06T02:26:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.732+0000 7f7c621f9700 1 -- 172.21.15.6:0/2464654403 shutdown_connections 2023-10-06T02:26:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.732+0000 7f7c621f9700 1 --2- 172.21.15.6:0/2464654403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c5c159400 0x7f7c5c0cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.732+0000 7f7c621f9700 1 --2- 172.21.15.6:0/2464654403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7c40066f30 0x7f7c400693e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.732+0000 7f7c621f9700 1 --2- 172.21.15.6:0/2464654403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c5c0cd030 0x7f7c5c154630 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.732+0000 7f7c621f9700 1 --2- 172.21.15.6:0/2464654403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c5c0d05d0 0x7f7c5c0cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.732+0000 7f7c621f9700 1 -- 172.21.15.6:0/2464654403 >> 172.21.15.6:0/2464654403 conn(0x7f7c5c06ac10 msgr2=0x7f7c5c157f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:57.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.732+0000 7f7c621f9700 1 -- 172.21.15.6:0/2464654403 shutdown_connections 2023-10-06T02:26:57.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.732+0000 7f7c621f9700 1 -- 172.21.15.6:0/2464654403 wait complete. 2023-10-06T02:26:57.734 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 202 2023-10-06T02:26:57.746 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:26:57.746 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:57.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.864+0000 7faf37a46700 1 Processor -- start 2023-10-06T02:26:57.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.864+0000 7faf37a46700 1 -- start start 2023-10-06T02:26:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.865+0000 7faf37a46700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faf300b3c50 0x7faf3015b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.865+0000 7faf37a46700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf3015bcd0 0x7faf3015a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.865+0000 7faf37a46700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf300afb90 con 0x7faf3015b3c0 2023-10-06T02:26:57.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.865+0000 7faf37a46700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf300b2310 con 0x7faf3015bcd0 2023-10-06T02:26:57.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.865+0000 7faf37a46700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf300b25f0 con 0x7faf300b3c50 2023-10-06T02:26:57.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.865+0000 7faf35fe3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf3015bcd0 0x7faf3015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.865+0000 7faf357e2700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faf3015b3c0 0x7faf30097d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60366/0 (socket says 172.21.15.6:60366) 2023-10-06T02:26:57.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.865+0000 7faf357e2700 1 -- 172.21.15.6:0/2295532334 learned_addr learned my addr 172.21.15.6:0/2295532334 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:57.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.866+0000 7faf35fe3700 1 -- 172.21.15.6:0/2295532334 >> v2:172.21.15.175:3300/0 conn(0x7faf300b3c50 msgr2=0x7faf3015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:57.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.866+0000 7faf34fe1700 1 --2- 172.21.15.6:0/2295532334 >> v2:172.21.15.175:3300/0 conn(0x7faf300b3c50 0x7faf3015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.866+0000 7faf35fe3700 1 --2- 172.21.15.6:0/2295532334 >> v2:172.21.15.175:3300/0 conn(0x7faf300b3c50 0x7faf3015b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.866+0000 7faf35fe3700 1 -- 172.21.15.6:0/2295532334 >> v1:172.21.15.6:6789/0 conn(0x7faf3015b3c0 legacy=0x7faf30097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:57.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.866+0000 7faf35fe3700 1 -- 172.21.15.6:0/2295532334 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf300af820 con 0x7faf3015bcd0 2023-10-06T02:26:57.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.866+0000 7faf2ffff700 1 -- 172.21.15.6:0/2295532334 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424685191 0 0) 0x7faf300afb90 con 0x7faf3015b3c0 2023-10-06T02:26:57.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.866+0000 7faf35fe3700 1 --2- 172.21.15.6:0/2295532334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf3015bcd0 0x7faf3015a590 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7faf3006f9c0 tx=0x7faf20009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24195283648b8b31 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:57.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.866+0000 7faf2ffff700 1 -- 172.21.15.6:0/2295532334 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2000e070 con 0x7faf3015bcd0 2023-10-06T02:26:57.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.866+0000 7faf2ffff700 1 -- 172.21.15.6:0/2295532334 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2000bc30 con 0x7faf3015bcd0 2023-10-06T02:26:57.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.866+0000 7faf2ffff700 1 -- 172.21.15.6:0/2295532334 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20012430 con 0x7faf3015bcd0 2023-10-06T02:26:57.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.867+0000 7faf37a46700 1 -- 172.21.15.6:0/2295532334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf3015bcd0 msgr2=0x7faf3015a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.867+0000 7faf37a46700 1 --2- 172.21.15.6:0/2295532334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf3015bcd0 0x7faf3015a590 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7faf3006f9c0 tx=0x7faf20009780 comp rx=0 tx=0).stop 2023-10-06T02:26:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.867+0000 7faf37a46700 1 -- 172.21.15.6:0/2295532334 shutdown_connections 2023-10-06T02:26:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.867+0000 7faf37a46700 1 --2- 172.21.15.6:0/2295532334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf3015bcd0 0x7faf3015a590 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.867+0000 7faf37a46700 1 --2- 172.21.15.6:0/2295532334 >> v2:172.21.15.175:3300/0 conn(0x7faf300b3c50 0x7faf3015b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.867+0000 7faf37a46700 1 -- 172.21.15.6:0/2295532334 >> 172.21.15.6:0/2295532334 conn(0x7faf30067910 msgr2=0x7faf300ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.867+0000 7faf37a46700 1 -- 172.21.15.6:0/2295532334 shutdown_connections 2023-10-06T02:26:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.867+0000 7faf37a46700 1 -- 172.21.15.6:0/2295532334 wait complete. 2023-10-06T02:26:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.868+0000 7faf37a46700 1 Processor -- start 2023-10-06T02:26:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.868+0000 7faf37a46700 1 -- start start 2023-10-06T02:26:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.869+0000 7faf37a46700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf300b3c50 0x7faf300ce640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.869+0000 7faf37a46700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf3015b3c0 0x7faf30157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.869+0000 7faf37a46700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf3015bcd0 0x7faf300aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.869+0000 7faf37a46700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3009b010 con 0x7faf3015b3c0 2023-10-06T02:26:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.869+0000 7faf37a46700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3009bc50 con 0x7faf3015bcd0 2023-10-06T02:26:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.869+0000 7faf37a46700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3016b700 con 0x7faf300b3c50 2023-10-06T02:26:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.869+0000 7faf34fe1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf3015b3c0 0x7faf30157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.869+0000 7faf34fe1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf3015b3c0 0x7faf30157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54926/0 (socket says 172.21.15.6:54926) 2023-10-06T02:26:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.869+0000 7faf34fe1700 1 -- 172.21.15.6:0/2807952330 learned_addr learned my addr 172.21.15.6:0/2807952330 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.869+0000 7faf35fe3700 1 --2- 172.21.15.6:0/2807952330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf3015bcd0 0x7faf300aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.869+0000 7faf357e2700 1 --2- 172.21.15.6:0/2807952330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf300b3c50 0x7faf300ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.869+0000 7faf34fe1700 1 -- 172.21.15.6:0/2807952330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf300b3c50 msgr2=0x7faf300ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.869+0000 7faf34fe1700 1 --2- 172.21.15.6:0/2807952330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf300b3c50 0x7faf300ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.869+0000 7faf34fe1700 1 -- 172.21.15.6:0/2807952330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf3015bcd0 msgr2=0x7faf300aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.869+0000 7faf34fe1700 1 --2- 172.21.15.6:0/2807952330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf3015bcd0 0x7faf300aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.869+0000 7faf34fe1700 1 -- 172.21.15.6:0/2807952330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf20009a20 con 0x7faf3015b3c0 2023-10-06T02:26:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.869+0000 7faf34fe1700 1 --2- 172.21.15.6:0/2807952330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf3015b3c0 0x7faf30157600 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7faf2400c880 tx=0x7faf24008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.870+0000 7faf2d7fa700 1 -- 172.21.15.6:0/2807952330 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24011600 con 0x7faf3015b3c0 2023-10-06T02:26:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.870+0000 7faf2d7fa700 1 -- 172.21.15.6:0/2807952330 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf24011760 con 0x7faf3015b3c0 2023-10-06T02:26:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.870+0000 7faf37a46700 1 -- 172.21.15.6:0/2807952330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3009a6e0 con 0x7faf3015b3c0 2023-10-06T02:26:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.870+0000 7faf2d7fa700 1 -- 172.21.15.6:0/2807952330 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24011b00 con 0x7faf3015b3c0 2023-10-06T02:26:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.870+0000 7faf37a46700 1 -- 172.21.15.6:0/2807952330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3009aca0 con 0x7faf3015b3c0 2023-10-06T02:26:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.871+0000 7faf37a46700 1 -- 172.21.15.6:0/2807952330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3009b1c0 con 0x7faf3015b3c0 2023-10-06T02:26:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.871+0000 7faf2d7fa700 1 -- 172.21.15.6:0/2807952330 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf24018360 con 0x7faf3015b3c0 2023-10-06T02:26:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.871+0000 7faf2d7fa700 1 --2- 172.21.15.6:0/2807952330 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faf1c066f30 0x7faf1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.871+0000 7faf2d7fa700 1 -- 172.21.15.6:0/2807952330 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7faf24084c60 con 0x7faf3015b3c0 2023-10-06T02:26:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.872+0000 7faf357e2700 1 --2- 172.21.15.6:0/2807952330 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faf1c066f30 0x7faf1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.872+0000 7faf357e2700 1 --2- 172.21.15.6:0/2807952330 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faf1c066f30 0x7faf1c0693e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7faf280029c0 tx=0x7faf28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:57.876+0000 7faf2d7fa700 1 -- 172.21.15.6:0/2807952330 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf3009b1c0 con 0x7faf3015b3c0 2023-10-06T02:26:58.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.116+0000 7faf37a46700 1 -- 172.21.15.6:0/2807952330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf3006e8d0 con 0x7faf3015b3c0 2023-10-06T02:26:58.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.116+0000 7faf2d7fa700 1 -- 172.21.15.6:0/2807952330 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 203 v203) v1 ==== 95+0+4595 (secure 0 0 0) 0x7faf2401f090 con 0x7faf3015b3c0 2023-10-06T02:26:58.164 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:26:58.164 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":203,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9063,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2836519357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2836519357},{"type":"v1","addr":"172.21.15.6:6835","nonce":2836519357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":203}],"filesystems":[{"mdsmap":{"epoch":202,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:26:56.923720+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:26:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.119+0000 7faf37a46700 1 -- 172.21.15.6:0/2807952330 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faf1c066f30 msgr2=0x7faf1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.119+0000 7faf37a46700 1 --2- 172.21.15.6:0/2807952330 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faf1c066f30 0x7faf1c0693e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7faf280029c0 tx=0x7faf28009040 comp rx=0 tx=0).stop 2023-10-06T02:26:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.119+0000 7faf37a46700 1 -- 172.21.15.6:0/2807952330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf3015b3c0 msgr2=0x7faf30157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.119+0000 7faf37a46700 1 --2- 172.21.15.6:0/2807952330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf3015b3c0 0x7faf30157600 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7faf2400c880 tx=0x7faf24008040 comp rx=0 tx=0).stop 2023-10-06T02:26:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.119+0000 7faf37a46700 1 -- 172.21.15.6:0/2807952330 shutdown_connections 2023-10-06T02:26:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.119+0000 7faf37a46700 1 --2- 172.21.15.6:0/2807952330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf3015bcd0 0x7faf300aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.119+0000 7faf37a46700 1 --2- 172.21.15.6:0/2807952330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf300b3c50 0x7faf300ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.119+0000 7faf37a46700 1 --2- 172.21.15.6:0/2807952330 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faf1c066f30 0x7faf1c0693e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.119+0000 7faf37a46700 1 --2- 172.21.15.6:0/2807952330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf3015b3c0 0x7faf30157600 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.119+0000 7faf37a46700 1 -- 172.21.15.6:0/2807952330 >> 172.21.15.6:0/2807952330 conn(0x7faf30067910 msgr2=0x7faf3006cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.119+0000 7faf37a46700 1 -- 172.21.15.6:0/2807952330 shutdown_connections 2023-10-06T02:26:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.119+0000 7faf37a46700 1 -- 172.21.15.6:0/2807952330 wait complete. 2023-10-06T02:26:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 203 2023-10-06T02:26:58.166 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt 200.00000001' led to DAMAGED state 2023-10-06T02:26:58.167 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 500.00000000' 2023-10-06T02:26:58.167 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:58.167 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:26:58.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:58.167 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:26:58.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:26:58.182 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:26:58.183 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:26:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.342+0000 7faeb401e700 1 Processor -- start 2023-10-06T02:26:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.342+0000 7faeb401e700 1 -- start start 2023-10-06T02:26:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.343+0000 7faeb401e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faeac0ccd40 0x7faeac0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.343+0000 7faeb401e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faeac0cf7e0 0x7faeac0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.343+0000 7faeb401e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeac15dd40 con 0x7faeac0d0400 2023-10-06T02:26:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.343+0000 7faeb401e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeac15e020 con 0x7faeac0cf7e0 2023-10-06T02:26:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.343+0000 7faeb401e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0ceaa0 con 0x7faeac0ccd40 2023-10-06T02:26:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.343+0000 7faeb25bb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faeac0cf7e0 0x7faeac0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.343+0000 7faeb1dba700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faeac0d0400 0x7faeac0b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60376/0 (socket says 172.21.15.6:60376) 2023-10-06T02:26:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.343+0000 7faeb1dba700 1 -- 172.21.15.6:0/3888326509 learned_addr learned my addr 172.21.15.6:0/3888326509 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.344+0000 7faeb15b9700 1 --2- 172.21.15.6:0/3888326509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faeac0ccd40 0x7faeac0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.344+0000 7faeb25bb700 1 -- 172.21.15.6:0/3888326509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faeac0ccd40 msgr2=0x7faeac0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.344+0000 7faeb25bb700 1 --2- 172.21.15.6:0/3888326509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faeac0ccd40 0x7faeac0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.344+0000 7faeb25bb700 1 -- 172.21.15.6:0/3888326509 >> v1:172.21.15.6:6789/0 conn(0x7faeac0d0400 legacy=0x7faeac0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.344+0000 7faeb25bb700 1 -- 172.21.15.6:0/3888326509 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac0ced80 con 0x7faeac0cf7e0 2023-10-06T02:26:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.344+0000 7faeb0db8700 1 -- 172.21.15.6:0/3888326509 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3896006222 0 0) 0x7faeac15dd40 con 0x7faeac0d0400 2023-10-06T02:26:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.344+0000 7faeb25bb700 1 --2- 172.21.15.6:0/3888326509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0cf7e0 0x7faeac0b3aa0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009e60 tx=0x7fae9c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55abd531b1c594ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.344+0000 7faeb0db8700 1 -- 172.21.15.6:0/3888326509 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c00e070 con 0x7faeac0cf7e0 2023-10-06T02:26:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.344+0000 7faeb0db8700 1 -- 172.21.15.6:0/3888326509 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c00bc30 con 0x7faeac0cf7e0 2023-10-06T02:26:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.344+0000 7faeb0db8700 1 -- 172.21.15.6:0/3888326509 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c012430 con 0x7faeac0cf7e0 2023-10-06T02:26:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.344+0000 7faeb401e700 1 -- 172.21.15.6:0/3888326509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0cf7e0 msgr2=0x7faeac0b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.344+0000 7faeb401e700 1 --2- 172.21.15.6:0/3888326509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0cf7e0 0x7faeac0b3aa0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009e60 tx=0x7fae9c009780 comp rx=0 tx=0).stop 2023-10-06T02:26:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.345+0000 7faeb401e700 1 -- 172.21.15.6:0/3888326509 shutdown_connections 2023-10-06T02:26:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.345+0000 7faeb401e700 1 --2- 172.21.15.6:0/3888326509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0cf7e0 0x7faeac0b3aa0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.345+0000 7faeb401e700 1 --2- 172.21.15.6:0/3888326509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faeac0ccd40 0x7faeac0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.345+0000 7faeb401e700 1 -- 172.21.15.6:0/3888326509 >> 172.21.15.6:0/3888326509 conn(0x7faeac06a220 msgr2=0x7faeac06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.345+0000 7faeb401e700 1 -- 172.21.15.6:0/3888326509 shutdown_connections 2023-10-06T02:26:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.345+0000 7faeb401e700 1 -- 172.21.15.6:0/3888326509 wait complete. 2023-10-06T02:26:58.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.346+0000 7faeb401e700 1 Processor -- start 2023-10-06T02:26:58.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.346+0000 7faeb401e700 1 -- start start 2023-10-06T02:26:58.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.346+0000 7faeb401e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeac0ccd40 0x7faeac0c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:58.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.346+0000 7faeb401e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faeac0cf7e0 0x7faeac159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:58.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.346+0000 7faeb401e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0d0400 0x7faeac147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:58.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.346+0000 7faeb401e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac15aae0 con 0x7faeac0d0400 2023-10-06T02:26:58.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.346+0000 7faeb401e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0c6080 con 0x7faeac0ccd40 2023-10-06T02:26:58.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.346+0000 7faeb401e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac15ad30 con 0x7faeac0cf7e0 2023-10-06T02:26:58.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.347+0000 7faeb25bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0d0400 0x7faeac147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:58.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.347+0000 7faeb25bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0d0400 0x7faeac147e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54936/0 (socket says 172.21.15.6:54936) 2023-10-06T02:26:58.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.347+0000 7faeb25bb700 1 -- 172.21.15.6:0/1822247681 learned_addr learned my addr 172.21.15.6:0/1822247681 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:58.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.347+0000 7faeb15b9700 1 --2- 172.21.15.6:0/1822247681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faeac0cf7e0 0x7faeac159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:58.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.347+0000 7faeb1dba700 1 --2- 172.21.15.6:0/1822247681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeac0ccd40 0x7faeac0c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:58.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.347+0000 7faeb25bb700 1 -- 172.21.15.6:0/1822247681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faeac0cf7e0 msgr2=0x7faeac159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:58.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.347+0000 7faeb25bb700 1 --2- 172.21.15.6:0/1822247681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faeac0cf7e0 0x7faeac159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:58.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.347+0000 7faeb25bb700 1 -- 172.21.15.6:0/1822247681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeac0ccd40 msgr2=0x7faeac0c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:58.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.347+0000 7faeb25bb700 1 --2- 172.21.15.6:0/1822247681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeac0ccd40 0x7faeac0c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.347+0000 7faeb25bb700 1 -- 172.21.15.6:0/1822247681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c009a20 con 0x7faeac0d0400 2023-10-06T02:26:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.347+0000 7faeb1dba700 1 --2- 172.21.15.6:0/1822247681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeac0ccd40 0x7faeac0c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.347+0000 7faeb25bb700 1 --2- 172.21.15.6:0/1822247681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0d0400 0x7faeac147e70 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fae9c013000 tx=0x7fae9c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.347+0000 7faea9ffb700 1 -- 172.21.15.6:0/1822247681 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c027470 con 0x7faeac0d0400 2023-10-06T02:26:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.347+0000 7faea9ffb700 1 -- 172.21.15.6:0/1822247681 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c027610 con 0x7faeac0d0400 2023-10-06T02:26:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.347+0000 7faeb401e700 1 -- 172.21.15.6:0/1822247681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeac15b010 con 0x7faeac0d0400 2023-10-06T02:26:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.347+0000 7faea9ffb700 1 -- 172.21.15.6:0/1822247681 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0279d0 con 0x7faeac0d0400 2023-10-06T02:26:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.348+0000 7faeb401e700 1 -- 172.21.15.6:0/1822247681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeac16ada0 con 0x7faeac0d0400 2023-10-06T02:26:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.349+0000 7faeb401e700 1 -- 172.21.15.6:0/1822247681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeac088760 con 0x7faeac0d0400 2023-10-06T02:26:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.349+0000 7faea9ffb700 1 -- 172.21.15.6:0/1822247681 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae9c024070 con 0x7faeac0d0400 2023-10-06T02:26:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.349+0000 7faea9ffb700 1 --2- 172.21.15.6:0/1822247681 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fae98066f30 0x7fae980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.349+0000 7faea9ffb700 1 -- 172.21.15.6:0/1822247681 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7fae9c087550 con 0x7faeac0d0400 2023-10-06T02:26:58.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.350+0000 7faeb1dba700 1 --2- 172.21.15.6:0/1822247681 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fae98066f30 0x7fae980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:58.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.350+0000 7faeb1dba700 1 --2- 172.21.15.6:0/1822247681 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fae98066f30 0x7fae980693e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7faeac06ac20 tx=0x7faea4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:58.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.354+0000 7faea9ffb700 1 -- 172.21.15.6:0/1822247681 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae9c053f10 con 0x7faeac0d0400 2023-10-06T02:26:58.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.591+0000 7faeb401e700 1 -- 172.21.15.6:0/1822247681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7faeac0ce6c0 con 0x7faeac0d0400 2023-10-06T02:26:58.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.937+0000 7faea9ffb700 1 -- 172.21.15.6:0/1822247681 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v204) v1 ==== 161+0+0 (secure 0 0 0) 0x7fae9c057530 con 0x7faeac0d0400 2023-10-06T02:26:58.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.939+0000 7faeb401e700 1 -- 172.21.15.6:0/1822247681 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fae98066f30 msgr2=0x7fae980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:58.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.939+0000 7faeb401e700 1 --2- 172.21.15.6:0/1822247681 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fae98066f30 0x7fae980693e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7faeac06ac20 tx=0x7faea4009040 comp rx=0 tx=0).stop 2023-10-06T02:26:58.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.939+0000 7faeb401e700 1 -- 172.21.15.6:0/1822247681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0d0400 msgr2=0x7faeac147e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:58.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.939+0000 7faeb401e700 1 --2- 172.21.15.6:0/1822247681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0d0400 0x7faeac147e70 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fae9c013000 tx=0x7fae9c019000 comp rx=0 tx=0).stop 2023-10-06T02:26:58.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.939+0000 7faeb401e700 1 -- 172.21.15.6:0/1822247681 shutdown_connections 2023-10-06T02:26:58.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.939+0000 7faeb401e700 1 --2- 172.21.15.6:0/1822247681 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fae98066f30 0x7fae980693e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:58.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.939+0000 7faeb401e700 1 --2- 172.21.15.6:0/1822247681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0d0400 0x7faeac147e70 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:58.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.939+0000 7faeb401e700 1 --2- 172.21.15.6:0/1822247681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeac0ccd40 0x7faeac0c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:58.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.939+0000 7faeb401e700 1 --2- 172.21.15.6:0/1822247681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faeac0cf7e0 0x7faeac159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:58.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.939+0000 7faeb401e700 1 -- 172.21.15.6:0/1822247681 >> 172.21.15.6:0/1822247681 conn(0x7faeac06a220 msgr2=0x7faeac153cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:58.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.939+0000 7faeb401e700 1 -- 172.21.15.6:0/1822247681 shutdown_connections 2023-10-06T02:26:58.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:58.939+0000 7faeb401e700 1 -- 172.21.15.6:0/1822247681 wait complete. 2023-10-06T02:26:58.941 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:26:58.952 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:26:59.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.073+0000 7ff82c812700 1 Processor -- start 2023-10-06T02:26:59.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.073+0000 7ff82c812700 1 -- start start 2023-10-06T02:26:59.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.074+0000 7ff82c812700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff8280cf1a0 0x7ff8280cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:59.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.074+0000 7ff82c812700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8280b3560 con 0x7ff8281597d0 2023-10-06T02:26:59.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.074+0000 7ff82c812700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8280cf6f0 con 0x7ff828159400 2023-10-06T02:26:59.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.074+0000 7ff82c812700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8280cf9d0 con 0x7ff8280cf1a0 2023-10-06T02:26:59.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.074+0000 7ff82759e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff8281597d0 0x7ff8280b39f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45556/0 (socket says 172.21.15.6:45556) 2023-10-06T02:26:59.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.074+0000 7ff82759e700 1 -- 172.21.15.6:0/293724407 learned_addr learned my addr 172.21.15.6:0/293724407 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:26:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.074+0000 7ff82659c700 1 --2- 172.21.15.6:0/293724407 >> v2:172.21.15.175:3300/0 conn(0x7ff8280cf1a0 0x7ff8280cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.074+0000 7ff825d9b700 1 -- 172.21.15.6:0/293724407 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116709947 0 0) 0x7ff8280b3560 con 0x7ff8281597d0 2023-10-06T02:26:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.074+0000 7ff825d9b700 1 -- 172.21.15.6:0/293724407 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff814003570 con 0x7ff8281597d0 2023-10-06T02:26:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.074+0000 7ff825d9b700 1 -- 172.21.15.6:0/293724407 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1221256495 0 0) 0x7ff814003570 con 0x7ff8281597d0 2023-10-06T02:26:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.074+0000 7ff825d9b700 1 -- 172.21.15.6:0/293724407 >> v2:172.21.15.175:3300/0 conn(0x7ff8280cf1a0 msgr2=0x7ff8280cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.074+0000 7ff825d9b700 1 --2- 172.21.15.6:0/293724407 >> v2:172.21.15.175:3300/0 conn(0x7ff8280cf1a0 0x7ff8280cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.074+0000 7ff825d9b700 1 -- 172.21.15.6:0/293724407 >> v1:172.21.15.175:6789/0 conn(0x7ff828159400 legacy=0x7ff8280ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.074+0000 7ff825d9b700 1 -- 172.21.15.6:0/293724407 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8280b2f10 con 0x7ff8281597d0 2023-10-06T02:26:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.074+0000 7ff825d9b700 1 -- 172.21.15.6:0/293724407 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7ff8180017f0 con 0x7ff8281597d0 2023-10-06T02:26:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.074+0000 7ff825d9b700 1 -- 172.21.15.6:0/293724407 >> v1:172.21.15.6:6789/0 conn(0x7ff8281597d0 legacy=0x7ff8280b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff825d9b700 1 --2- 172.21.15.6:0/293724407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff814003a60 0x7ff814003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff825d9b700 1 --2- 172.21.15.6:0/293724407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff814004810 0x7ff814004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff825d9b700 1 --2- 172.21.15.6:0/293724407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8140051c0 0x7ff81400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff825d9b700 1 -- 172.21.15.6:0/293724407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8280cf9d0 con 0x7ff814004810 2023-10-06T02:26:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff825d9b700 1 -- 172.21.15.6:0/293724407 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81400c0d0 con 0x7ff8140051c0 2023-10-06T02:26:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff825d9b700 1 -- 172.21.15.6:0/293724407 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81400c290 con 0x7ff814003a60 2023-10-06T02:26:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff82659c700 1 --2- 172.21.15.6:0/293724407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff814004810 0x7ff814004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff826d9d700 1 --2- 172.21.15.6:0/293724407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff814003a60 0x7ff814003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff82759e700 1 --2- 172.21.15.6:0/293724407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8140051c0 0x7ff81400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff82659c700 1 -- 172.21.15.6:0/293724407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff814003a60 msgr2=0x7ff814003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff82659c700 1 --2- 172.21.15.6:0/293724407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff814003a60 0x7ff814003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff82659c700 1 -- 172.21.15.6:0/293724407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8140051c0 msgr2=0x7ff81400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff82659c700 1 --2- 172.21.15.6:0/293724407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8140051c0 0x7ff81400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff82759e700 1 -- 172.21.15.6:0/293724407 reap_dead start 2023-10-06T02:26:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff82659c700 1 -- 172.21.15.6:0/293724407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff814003570 con 0x7ff814004810 2023-10-06T02:26:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff82659c700 1 --2- 172.21.15.6:0/293724407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff814004810 0x7ff814004c80 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7ff810009c00 tx=0x7ff8100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c3839f8ae05d49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff825d9b700 1 -- 172.21.15.6:0/293724407 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81000e710 con 0x7ff814004810 2023-10-06T02:26:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff825d9b700 1 -- 172.21.15.6:0/293724407 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81000e870 con 0x7ff814004810 2023-10-06T02:26:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.075+0000 7ff825d9b700 1 -- 172.21.15.6:0/293724407 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81000ec30 con 0x7ff814004810 2023-10-06T02:26:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.076+0000 7ff82c812700 1 -- 172.21.15.6:0/293724407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff814004810 msgr2=0x7ff814004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.076+0000 7ff82c812700 1 --2- 172.21.15.6:0/293724407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff814004810 0x7ff814004c80 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7ff810009c00 tx=0x7ff8100091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.076+0000 7ff82c812700 1 -- 172.21.15.6:0/293724407 shutdown_connections 2023-10-06T02:26:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.076+0000 7ff82c812700 1 --2- 172.21.15.6:0/293724407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff814004810 0x7ff814004c80 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.076+0000 7ff82c812700 1 -- 172.21.15.6:0/293724407 >> 172.21.15.6:0/293724407 conn(0x7ff82806ac10 msgr2=0x7ff828068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.076+0000 7ff82c812700 1 -- 172.21.15.6:0/293724407 shutdown_connections 2023-10-06T02:26:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.076+0000 7ff82c812700 1 -- 172.21.15.6:0/293724407 wait complete. 2023-10-06T02:26:59.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.077+0000 7ff82c812700 1 Processor -- start 2023-10-06T02:26:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.077+0000 7ff82c812700 1 -- start start 2023-10-06T02:26:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.078+0000 7ff82c812700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff814004810 0x7ff82816dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.078+0000 7ff82c812700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff828159ec0 0x7ff828143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.078+0000 7ff82c812700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff828157650 0x7ff828157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.078+0000 7ff82c812700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff828158030 con 0x7ff814004810 2023-10-06T02:26:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.078+0000 7ff82c812700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82816e4f0 con 0x7ff828159ec0 2023-10-06T02:26:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.078+0000 7ff82c812700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82815b070 con 0x7ff828157650 2023-10-06T02:26:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.078+0000 7ff826d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff814004810 0x7ff82816dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.078+0000 7ff826d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff814004810 0x7ff82816dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52572/0 (socket says 172.21.15.6:52572) 2023-10-06T02:26:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.078+0000 7ff826d9d700 1 -- 172.21.15.6:0/879938868 learned_addr learned my addr 172.21.15.6:0/879938868 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:26:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.078+0000 7ff82659c700 1 --2- 172.21.15.6:0/879938868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff828159ec0 0x7ff828143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.078+0000 7ff82759e700 1 --2- 172.21.15.6:0/879938868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff828157650 0x7ff828157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.078+0000 7ff826d9d700 1 -- 172.21.15.6:0/879938868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff828157650 msgr2=0x7ff828157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.078+0000 7ff826d9d700 1 --2- 172.21.15.6:0/879938868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff828157650 0x7ff828157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.078+0000 7ff826d9d700 1 -- 172.21.15.6:0/879938868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff828159ec0 msgr2=0x7ff828143cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.078+0000 7ff826d9d700 1 --2- 172.21.15.6:0/879938868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff828159ec0 0x7ff828143cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.078+0000 7ff826d9d700 1 -- 172.21.15.6:0/879938868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8281441f0 con 0x7ff814004810 2023-10-06T02:26:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.079+0000 7ff826d9d700 1 --2- 172.21.15.6:0/879938868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff814004810 0x7ff82816dfb0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7ff820002920 tx=0x7ff820007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.079+0000 7ff81effd700 1 -- 172.21.15.6:0/879938868 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff820006870 con 0x7ff814004810 2023-10-06T02:26:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.079+0000 7ff81effd700 1 -- 172.21.15.6:0/879938868 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8200069d0 con 0x7ff814004810 2023-10-06T02:26:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.079+0000 7ff82c812700 1 -- 172.21.15.6:0/879938868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82815a460 con 0x7ff814004810 2023-10-06T02:26:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.079+0000 7ff81effd700 1 -- 172.21.15.6:0/879938868 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff820006d70 con 0x7ff814004810 2023-10-06T02:26:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.079+0000 7ff82c812700 1 -- 172.21.15.6:0/879938868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82815aa20 con 0x7ff814004810 2023-10-06T02:26:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.080+0000 7ff82c812700 1 -- 172.21.15.6:0/879938868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8280b31f0 con 0x7ff814004810 2023-10-06T02:26:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.080+0000 7ff81effd700 1 -- 172.21.15.6:0/879938868 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff82000fa80 con 0x7ff814004810 2023-10-06T02:26:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.080+0000 7ff81effd700 1 --2- 172.21.15.6:0/879938868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff808066f30 0x7ff8080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.080+0000 7ff81effd700 1 -- 172.21.15.6:0/879938868 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7ff820084f40 con 0x7ff814004810 2023-10-06T02:26:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.081+0000 7ff82659c700 1 --2- 172.21.15.6:0/879938868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff808066f30 0x7ff8080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.081+0000 7ff82659c700 1 --2- 172.21.15.6:0/879938868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff808066f30 0x7ff8080693e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff8100091e0 tx=0x7ff81001a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.085+0000 7ff81effd700 1 -- 172.21.15.6:0/879938868 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff820051900 con 0x7ff814004810 2023-10-06T02:26:59.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.359+0000 7ff82c812700 1 -- 172.21.15.6:0/879938868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7ff8281533e0 con 0x7ff814004810 2023-10-06T02:26:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.942+0000 7ff81effd700 1 -- 172.21.15.6:0/879938868 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v205) v1 ==== 101+0+0 (secure 0 0 0) 0x7ff820054f20 con 0x7ff814004810 2023-10-06T02:26:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.944+0000 7ff82c812700 1 -- 172.21.15.6:0/879938868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff808066f30 msgr2=0x7ff8080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.944+0000 7ff82c812700 1 --2- 172.21.15.6:0/879938868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff808066f30 0x7ff8080693e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff8100091e0 tx=0x7ff81001a000 comp rx=0 tx=0).stop 2023-10-06T02:26:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.944+0000 7ff82c812700 1 -- 172.21.15.6:0/879938868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff814004810 msgr2=0x7ff82816dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.944+0000 7ff82c812700 1 --2- 172.21.15.6:0/879938868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff814004810 0x7ff82816dfb0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7ff820002920 tx=0x7ff820007d80 comp rx=0 tx=0).stop 2023-10-06T02:26:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.944+0000 7ff82c812700 1 -- 172.21.15.6:0/879938868 shutdown_connections 2023-10-06T02:26:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.944+0000 7ff82c812700 1 --2- 172.21.15.6:0/879938868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff828157650 0x7ff828157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.944+0000 7ff82c812700 1 --2- 172.21.15.6:0/879938868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff808066f30 0x7ff8080693e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.944+0000 7ff82c812700 1 --2- 172.21.15.6:0/879938868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff814004810 0x7ff82816dfb0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.944+0000 7ff82c812700 1 --2- 172.21.15.6:0/879938868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff828159ec0 0x7ff828143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.944+0000 7ff82c812700 1 -- 172.21.15.6:0/879938868 >> 172.21.15.6:0/879938868 conn(0x7ff82806ac10 msgr2=0x7ff828154d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.944+0000 7ff82c812700 1 -- 172.21.15.6:0/879938868 shutdown_connections 2023-10-06T02:26:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.944+0000 7ff82c812700 1 -- 172.21.15.6:0/879938868 wait complete. 2023-10-06T02:26:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:26:59.958 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:26:59.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.997+0000 7fb353eab000 1 Processor -- start 2023-10-06T02:26:59.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.997+0000 7fb353eab000 1 -- start start 2023-10-06T02:27:00.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb353eab000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dd38801b0 0x555dd3864b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb353eab000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555dd390c500 0x555dd3917de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb353eab000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dd390ce10 0x555dd3918320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb353eab000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd3783980 con 0x555dd38801b0 2023-10-06T02:27:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb353eab000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd3783620 con 0x555dd390ce10 2023-10-06T02:27:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb353eab000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dd377a400 con 0x555dd390c500 2023-10-06T02:27:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb34d0e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dd38801b0 0x555dd3864b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb34d0e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dd38801b0 0x555dd3864b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52584/0 (socket says 172.21.15.6:52584) 2023-10-06T02:27:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb34d0e6700 1 -- 172.21.15.6:0/2403769890 learned_addr learned my addr 172.21.15.6:0/2403769890 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb34c8e5700 1 --2- 172.21.15.6:0/2403769890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555dd390c500 0x555dd3917de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb34d0e6700 1 -- 172.21.15.6:0/2403769890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555dd390c500 msgr2=0x555dd3917de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb34d0e6700 1 --2- 172.21.15.6:0/2403769890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555dd390c500 0x555dd3917de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb34d0e6700 1 -- 172.21.15.6:0/2403769890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dd390ce10 msgr2=0x555dd3918320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb34d8e7700 1 --2- 172.21.15.6:0/2403769890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dd390ce10 0x555dd3918320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb34d0e6700 1 --2- 172.21.15.6:0/2403769890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dd390ce10 0x555dd3918320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb34d0e6700 1 -- 172.21.15.6:0/2403769890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb344005db0 con 0x555dd38801b0 2023-10-06T02:27:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb34d8e7700 1 --2- 172.21.15.6:0/2403769890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dd390ce10 0x555dd3918320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.998+0000 7fb34d0e6700 1 --2- 172.21.15.6:0/2403769890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dd38801b0 0x555dd3864b60 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fb340009670 tx=0x7fb340005ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd94163cd45805d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.999+0000 7fb33f7fe700 1 -- 172.21.15.6:0/2403769890 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34000e070 con 0x555dd38801b0 2023-10-06T02:27:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.999+0000 7fb33f7fe700 1 -- 172.21.15.6:0/2403769890 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb340006530 con 0x555dd38801b0 2023-10-06T02:27:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.999+0000 7fb33f7fe700 1 -- 172.21.15.6:0/2403769890 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3400068f0 con 0x555dd38801b0 2023-10-06T02:27:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.999+0000 7fb353eab000 1 -- 172.21.15.6:0/2403769890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dd38801b0 msgr2=0x555dd3864b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.999+0000 7fb353eab000 1 --2- 172.21.15.6:0/2403769890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dd38801b0 0x555dd3864b60 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fb340009670 tx=0x7fb340005ba0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.999+0000 7fb353eab000 1 -- 172.21.15.6:0/2403769890 shutdown_connections 2023-10-06T02:27:00.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.999+0000 7fb353eab000 1 --2- 172.21.15.6:0/2403769890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dd390ce10 0x555dd3918320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.999+0000 7fb353eab000 1 --2- 172.21.15.6:0/2403769890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dd38801b0 0x555dd3864b60 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.999+0000 7fb353eab000 1 --2- 172.21.15.6:0/2403769890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555dd390c500 0x555dd3917de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.999+0000 7fb353eab000 1 -- 172.21.15.6:0/2403769890 >> 172.21.15.6:0/2403769890 conn(0x555dd3838d50 msgr2=0x555dd3862af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:00.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.999+0000 7fb353eab000 1 -- 172.21.15.6:0/2403769890 shutdown_connections 2023-10-06T02:27:00.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:26:59.999+0000 7fb353eab000 1 -- 172.21.15.6:0/2403769890 wait complete. 2023-10-06T02:27:00.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.000+0000 7fb353eab000 1 Processor -- start 2023-10-06T02:27:00.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.000+0000 7fb353eab000 1 -- start start 2023-10-06T02:27:00.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.000+0000 7fb353eab000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555dd38801b0 0x555dd3916bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.000+0000 7fb353eab000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dd390c500 0x555dd391f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.000+0000 7fb353eab000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dd390ce10 0x555dd391f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb353eab000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd3901a80 con 0x555dd390ce10 2023-10-06T02:27:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb353eab000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd3901820 con 0x555dd390c500 2023-10-06T02:27:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb353eab000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dd3865b60 con 0x555dd38801b0 2023-10-06T02:27:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb34d8e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dd390ce10 0x555dd391f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb34d8e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dd390ce10 0x555dd391f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52586/0 (socket says 172.21.15.6:52586) 2023-10-06T02:27:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 learned_addr learned my addr 172.21.15.6:0/4138055658 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb34d0e6700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555dd38801b0 0x555dd3916bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb34c8e5700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dd390c500 0x555dd391f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555dd38801b0 msgr2=0x555dd3916bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb34d8e7700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555dd38801b0 0x555dd3916bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dd390c500 msgr2=0x555dd391f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb34d8e7700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dd390c500 0x555dd391f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb340005e40 con 0x555dd390ce10 2023-10-06T02:27:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb34d8e7700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dd390ce10 0x555dd391f540 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fb348009480 tx=0x7fb348007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb33dffb700 1 -- 172.21.15.6:0/4138055658 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348010410 con 0x555dd390ce10 2023-10-06T02:27:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb33dffb700 1 -- 172.21.15.6:0/4138055658 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb348010590 con 0x555dd390ce10 2023-10-06T02:27:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555dd37923d0 con 0x555dd390ce10 2023-10-06T02:27:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb33dffb700 1 -- 172.21.15.6:0/4138055658 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348010950 con 0x555dd390ce10 2023-10-06T02:27:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.001+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555dd3785ae0 con 0x555dd390ce10 2023-10-06T02:27:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.003+0000 7fb33dffb700 1 -- 172.21.15.6:0/4138055658 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb348010d00 con 0x555dd390ce10 2023-10-06T02:27:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.003+0000 7fb33dffb700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb330065890 0x7fb330067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.003+0000 7fb33dffb700 1 -- 172.21.15.6:0/4138055658 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7fb348083b60 con 0x555dd390ce10 2023-10-06T02:27:00.008 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:27:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.003+0000 7fb34d0e6700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb330065890 0x7fb330067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.003+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x555dd3864cb0 0x555dd3866a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.003+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39170f0 con 0x555dd3864cb0 2023-10-06T02:27:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.003+0000 7fb34c8e5700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x555dd3864cb0 0x555dd3866a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.004+0000 7fb34d0e6700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb330065890 0x7fb330067d40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb340005be0 tx=0x7fb340014000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.004+0000 7fb34c8e5700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x555dd3864cb0 0x555dd3866a50 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.006+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v113'536 uv510 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.006+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd38ff070 con 0x555dd3864cb0 2023-10-06T02:27:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.007+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v113'537 uv537 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.007+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3914040 con 0x555dd3864cb0 2023-10-06T02:27:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.008+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v113'538 uv538 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.010 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:27:00.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.008+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3866f90 con 0x555dd3864cb0 2023-10-06T02:27:00.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.010+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v113'539 uv539 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.010+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3867380 con 0x555dd3864cb0 2023-10-06T02:27:00.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.011+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v113'540 uv540 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.011+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39282e0 con 0x555dd3864cb0 2023-10-06T02:27:00.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.012+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v113'541 uv541 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.012+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3928690 con 0x555dd3864cb0 2023-10-06T02:27:00.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.013+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v113'542 uv516 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.014+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3928690 con 0x555dd3864cb0 2023-10-06T02:27:00.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.015+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v113'543 uv543 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.015+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3928690 con 0x555dd3864cb0 2023-10-06T02:27:00.016 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:27:00.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.016+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v113'544 uv544 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.016+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39296a0 con 0x555dd3864cb0 2023-10-06T02:27:00.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.017+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v113'545 uv545 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.017+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39296a0 con 0x555dd3864cb0 2023-10-06T02:27:00.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.018+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v113'546 uv546 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.018+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3928690 con 0x555dd3864cb0 2023-10-06T02:27:00.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.019+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v113'547 uv547 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.019+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3928690 con 0x555dd3864cb0 2023-10-06T02:27:00.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.020+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v113'548 uv523 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.020+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3928690 con 0x555dd3864cb0 2023-10-06T02:27:00.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.022+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v113'549 uv549 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.022+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3928690 con 0x555dd3864cb0 2023-10-06T02:27:00.023 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:27:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.023+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v113'550 uv550 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.023+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39296a0 con 0x555dd3864cb0 2023-10-06T02:27:00.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.024+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v113'551 uv551 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.024+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39296a0 con 0x555dd3864cb0 2023-10-06T02:27:00.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.025+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v113'552 uv552 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.025+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3928690 con 0x555dd3864cb0 2023-10-06T02:27:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.027+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v113'553 uv553 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.027+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3928b80 con 0x555dd3864cb0 2023-10-06T02:27:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.028+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v113'554 uv554 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.028+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3928b80 con 0x555dd3864cb0 2023-10-06T02:27:00.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.029+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v113'555 uv529 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.029+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3928b80 con 0x555dd3864cb0 2023-10-06T02:27:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.030+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v113'556 uv556 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.030+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3928b80 con 0x555dd3864cb0 2023-10-06T02:27:00.031 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:27:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.031+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v113'557 uv557 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.031+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3929b90 con 0x555dd3864cb0 2023-10-06T02:27:00.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.032+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v113'558 uv558 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.032+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3929b90 con 0x555dd3864cb0 2023-10-06T02:27:00.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.034+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v113'559 uv559 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.034+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3928b80 con 0x555dd3864cb0 2023-10-06T02:27:00.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.035+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v113'560 uv560 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.035+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3928b80 con 0x555dd3864cb0 2023-10-06T02:27:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.036+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v113'561 uv535 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.036+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3928b80 con 0x555dd3864cb0 2023-10-06T02:27:00.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.037+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v113'562 uv562 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.037+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3928b80 con 0x555dd3864cb0 2023-10-06T02:27:00.039 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:27:00.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.038+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v113'563 uv563 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.038+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3929b90 con 0x555dd3864cb0 2023-10-06T02:27:00.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.039+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v113'564 uv564 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.039+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3929b90 con 0x555dd3864cb0 2023-10-06T02:27:00.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.041+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v113'565 uv565 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.041+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3928b80 con 0x555dd3864cb0 2023-10-06T02:27:00.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.042+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v113'566 uv566 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3864cb0 2023-10-06T02:27:00.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.042+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x555dd3929090 0x555dd392b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.042+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392b9b0 con 0x555dd3929090 2023-10-06T02:27:00.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.042+0000 7fb34d0e6700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x555dd3929090 0x555dd392b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.043+0000 7fb34d0e6700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x555dd3929090 0x555dd392b470 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.044+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v113'391 uv373 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.044+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392bd60 con 0x555dd3929090 2023-10-06T02:27:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.045+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v113'392 uv392 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.045+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392c250 con 0x555dd3929090 2023-10-06T02:27:00.046 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:27:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.046+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v113'393 uv393 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.046+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392cb60 con 0x555dd3929090 2023-10-06T02:27:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.047+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v113'394 uv394 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.047+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392c6f0 con 0x555dd3929090 2023-10-06T02:27:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.048+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v113'395 uv395 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.049+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392d400 con 0x555dd3929090 2023-10-06T02:27:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.050+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v113'396 uv378 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.050+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392d7b0 con 0x555dd3929090 2023-10-06T02:27:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.051+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v113'397 uv397 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.051+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392db60 con 0x555dd3929090 2023-10-06T02:27:00.052 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:27:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.052+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v113'398 uv398 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.052+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392db60 con 0x555dd3929090 2023-10-06T02:27:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.053+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v113'399 uv399 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.053+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392db60 con 0x555dd3929090 2023-10-06T02:27:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.054+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v113'400 uv400 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.054+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392db60 con 0x555dd3929090 2023-10-06T02:27:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.055+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v113'401 uv390 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.055+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392db60 con 0x555dd3929090 2023-10-06T02:27:00.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.056+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v113'402 uv402 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.057+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392db60 con 0x555dd3929090 2023-10-06T02:27:00.058 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:27:00.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.058+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v113'403 uv403 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.058+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3931280 con 0x555dd3929090 2023-10-06T02:27:00.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.059+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v113'404 uv404 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.059+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392cf90 con 0x555dd3929090 2023-10-06T02:27:00.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.060+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v113'405 uv405 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.060+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392cf90 con 0x555dd3929090 2023-10-06T02:27:00.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.061+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v113'406 uv389 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.061+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392db60 con 0x555dd3929090 2023-10-06T02:27:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.064+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v113'407 uv407 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.064+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392db60 con 0x555dd3929090 2023-10-06T02:27:00.066 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:27:00.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.065+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v113'408 uv408 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.065+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392eb70 con 0x555dd3929090 2023-10-06T02:27:00.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.066+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v113'409 uv409 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.067+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392eb70 con 0x555dd3929090 2023-10-06T02:27:00.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.068+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v113'410 uv410 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.068+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392db60 con 0x555dd3929090 2023-10-06T02:27:00.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.069+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v113'411 uv411 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.069+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x555dd392e070 0x555dd3930450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.069+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39309e0 con 0x555dd392e070 2023-10-06T02:27:00.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.069+0000 7fb34c8e5700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x555dd392e070 0x555dd3930450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.069+0000 7fb34c8e5700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x555dd392e070 0x555dd3930450 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:00.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.070+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v113'105 uv104 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.070+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3930dc0 con 0x555dd392e070 2023-10-06T02:27:00.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.071+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v113'106 uv106 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.071+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3930dc0 con 0x555dd392e070 2023-10-06T02:27:00.073 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:27:00.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.072+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v113'107 uv107 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.072+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3931dd0 con 0x555dd392e070 2023-10-06T02:27:00.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.073+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v113'108 uv108 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.073+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3931dd0 con 0x555dd392e070 2023-10-06T02:27:00.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.074+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v113'109 uv109 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.074+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3930dc0 con 0x555dd392e070 2023-10-06T02:27:00.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.075+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v113'110 uv110 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.075+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3930dc0 con 0x555dd392e070 2023-10-06T02:27:00.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.076+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v113'76 uv75 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.076+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3930dc0 con 0x555dd392e070 2023-10-06T02:27:00.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.077+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v113'77 uv77 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.077+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3930dc0 con 0x555dd392e070 2023-10-06T02:27:00.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.078+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v113'78 uv78 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.079 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:27:00.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.078+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3930dc0 con 0x555dd392e070 2023-10-06T02:27:00.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.079+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v113'79 uv79 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.079+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3930dc0 con 0x555dd3929090 2023-10-06T02:27:00.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.080+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v113'105 uv104 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.080+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3930dc0 con 0x555dd3929090 2023-10-06T02:27:00.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.081+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v113'106 uv106 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.081+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3930dc0 con 0x555dd3929090 2023-10-06T02:27:00.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.082+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v113'107 uv107 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.083 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:27:00.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.082+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3930dc0 con 0x555dd3929090 2023-10-06T02:27:00.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.084+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v113'108 uv108 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.084+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3930dc0 con 0x555dd3929090 2023-10-06T02:27:00.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.085+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v113'109 uv109 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.085+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3930dc0 con 0x555dd3929090 2023-10-06T02:27:00.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.086+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v113'110 uv110 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3929090 2023-10-06T02:27:00.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.086+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x555dd39316f0 0x555dd3933ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.086+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3934010 con 0x555dd39316f0 2023-10-06T02:27:00.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.086+0000 7fb34d8e7700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x555dd39316f0 0x555dd3933ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.086+0000 7fb34d8e7700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x555dd39316f0 0x555dd3933ad0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:00.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.087+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v113'193 uv187 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd39316f0 2023-10-06T02:27:00.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.088+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39343c0 con 0x555dd39316f0 2023-10-06T02:27:00.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.089+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v113'194 uv194 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd39316f0 2023-10-06T02:27:00.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.089+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3934830 con 0x555dd39316f0 2023-10-06T02:27:00.090 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:27:00.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.090+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v113'195 uv195 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd39316f0 2023-10-06T02:27:00.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.090+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd392cff0 con 0x555dd39316f0 2023-10-06T02:27:00.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.091+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v113'196 uv196 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd39316f0 2023-10-06T02:27:00.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.091+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3936230 con 0x555dd39316f0 2023-10-06T02:27:00.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.092+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v113'197 uv197 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd39316f0 2023-10-06T02:27:00.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.092+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39351a0 con 0x555dd39316f0 2023-10-06T02:27:00.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.093+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v113'198 uv198 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd39316f0 2023-10-06T02:27:00.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.093+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39355a0 con 0x555dd39316f0 2023-10-06T02:27:00.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.094+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v113'199 uv192 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd39316f0 2023-10-06T02:27:00.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.094+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3935950 con 0x555dd39316f0 2023-10-06T02:27:00.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.095+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v113'200 uv200 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd39316f0 2023-10-06T02:27:00.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.095+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3935950 con 0x555dd39316f0 2023-10-06T02:27:00.096 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:27:00.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.095+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v113'201 uv201 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd39316f0 2023-10-06T02:27:00.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.095+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3935950 con 0x555dd39316f0 2023-10-06T02:27:00.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.096+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v113'202 uv202 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd39316f0 2023-10-06T02:27:00.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.096+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3935950 con 0x555dd39316f0 2023-10-06T02:27:00.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.098+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v113'203 uv203 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd39316f0 2023-10-06T02:27:00.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.098+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x555dd3936b80 0x555dd3938f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.098+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39394a0 con 0x555dd3936b80 2023-10-06T02:27:00.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.098+0000 7fb34d0e6700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x555dd3936b80 0x555dd3938f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.098+0000 7fb34d0e6700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x555dd3936b80 0x555dd3938f60 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:00.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.099+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v113'86 uv85 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3936b80 2023-10-06T02:27:00.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.099+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39394a0 con 0x555dd3936b80 2023-10-06T02:27:00.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.100+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v113'87 uv87 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3936b80 2023-10-06T02:27:00.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.100+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39394a0 con 0x555dd3936b80 2023-10-06T02:27:00.106 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:27:00.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.106+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v113'88 uv88 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3936b80 2023-10-06T02:27:00.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.106+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39394a0 con 0x555dd3936b80 2023-10-06T02:27:00.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.107+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v113'89 uv89 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3936b80 2023-10-06T02:27:00.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.107+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39394a0 con 0x555dd3936b80 2023-10-06T02:27:00.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.110+0000 7fb34d0e6700 1 -- 172.21.15.6:0/4138055658 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v113'90 uv90 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb340006720 con 0x555dd3936b80 2023-10-06T02:27:00.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.110+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39394a0 con 0x555dd392e070 2023-10-06T02:27:00.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.111+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v113'105 uv104 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.111+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39394a0 con 0x555dd392e070 2023-10-06T02:27:00.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.112+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v113'106 uv106 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.112+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39394a0 con 0x555dd392e070 2023-10-06T02:27:00.114 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:27:00.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.113+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v113'107 uv107 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.113+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd393a4b0 con 0x555dd392e070 2023-10-06T02:27:00.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.114+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v113'108 uv108 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.114+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd393a4b0 con 0x555dd392e070 2023-10-06T02:27:00.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.115+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v113'109 uv109 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.115+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd39394a0 con 0x555dd392e070 2023-10-06T02:27:00.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.116+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v113'110 uv110 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.116+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x555dd3939b20 0x555dd393bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.116+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd393c600 con 0x555dd3939b20 2023-10-06T02:27:00.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.116+0000 7fb34c8e5700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x555dd3939b20 0x555dd393bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.117+0000 7fb34c8e5700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x555dd3939b20 0x555dd393bf00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:00.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.118+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v113'172 uv166 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3939b20 2023-10-06T02:27:00.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.118+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd393c9e0 con 0x555dd3939b20 2023-10-06T02:27:00.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.119+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v113'173 uv173 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3939b20 2023-10-06T02:27:00.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.119+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd393c9e0 con 0x555dd3939b20 2023-10-06T02:27:00.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.120+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v113'174 uv174 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3939b20 2023-10-06T02:27:00.120 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:27:00.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.120+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd393c9e0 con 0x555dd3939b20 2023-10-06T02:27:00.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.121+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v113'175 uv175 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3939b20 2023-10-06T02:27:00.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.121+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd393c9e0 con 0x555dd3939b20 2023-10-06T02:27:00.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.122+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v113'176 uv176 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3939b20 2023-10-06T02:27:00.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.122+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd393c9e0 con 0x555dd3939b20 2023-10-06T02:27:00.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.123+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v113'177 uv171 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3939b20 2023-10-06T02:27:00.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.123+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd393c9e0 con 0x555dd3939b20 2023-10-06T02:27:00.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.123+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v113'178 uv178 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3939b20 2023-10-06T02:27:00.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.124+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd393c9e0 con 0x555dd3939b20 2023-10-06T02:27:00.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.124+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v113'179 uv179 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3939b20 2023-10-06T02:27:00.125 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:27:00.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.124+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd393c9e0 con 0x555dd3939b20 2023-10-06T02:27:00.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.125+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v113'180 uv180 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3939b20 2023-10-06T02:27:00.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.125+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd393f6a0 con 0x555dd3939b20 2023-10-06T02:27:00.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.126+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v113'181 uv181 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd3939b20 2023-10-06T02:27:00.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.126+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd393f710 con 0x555dd392e070 2023-10-06T02:27:00.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.127+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v113'78 uv77 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.127+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd393f710 con 0x555dd392e070 2023-10-06T02:27:00.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.128+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v113'79 uv79 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.128+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd393f710 con 0x555dd392e070 2023-10-06T02:27:00.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.130+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v113'80 uv80 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.130 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:27:00.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.130+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd393f710 con 0x555dd392e070 2023-10-06T02:27:00.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.130+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v113'81 uv81 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.130+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x555dd393d280 0x555dd393fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.130+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3940050 con 0x555dd393d280 2023-10-06T02:27:00.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.131+0000 7fb34d8e7700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x555dd393d280 0x555dd393fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.131+0000 7fb34d8e7700 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x555dd393d280 0x555dd393fb10 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:00.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.132+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v113'105 uv104 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd393d280 2023-10-06T02:27:00.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.132+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3940050 con 0x555dd393d280 2023-10-06T02:27:00.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.133+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v113'106 uv106 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd393d280 2023-10-06T02:27:00.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.133+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3940050 con 0x555dd393d280 2023-10-06T02:27:00.134 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:27:00.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.134+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v113'107 uv107 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd393d280 2023-10-06T02:27:00.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.134+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3941060 con 0x555dd393d280 2023-10-06T02:27:00.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.135+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v113'108 uv108 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd393d280 2023-10-06T02:27:00.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.135+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3941060 con 0x555dd393d280 2023-10-06T02:27:00.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.136+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v113'109 uv109 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd393d280 2023-10-06T02:27:00.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.136+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3940050 con 0x555dd393d280 2023-10-06T02:27:00.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.138+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v113'110 uv110 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd393d280 2023-10-06T02:27:00.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.138+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3940050 con 0x555dd39316f0 2023-10-06T02:27:00.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.139+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v113'89 uv88 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd39316f0 2023-10-06T02:27:00.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.139+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3940050 con 0x555dd39316f0 2023-10-06T02:27:00.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.140+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v113'90 uv90 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd39316f0 2023-10-06T02:27:00.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.140+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3940050 con 0x555dd39316f0 2023-10-06T02:27:00.141 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:27:00.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.141+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v113'91 uv91 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd39316f0 2023-10-06T02:27:00.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.141+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3940050 con 0x555dd39316f0 2023-10-06T02:27:00.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.142+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v113'92 uv92 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd39316f0 2023-10-06T02:27:00.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.142+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3940050 con 0x555dd39316f0 2023-10-06T02:27:00.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.143+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v113'93 uv93 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb348016070 con 0x555dd39316f0 2023-10-06T02:27:00.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.143+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3940050 con 0x555dd392e070 2023-10-06T02:27:00.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.144+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v113'216 uv208 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.144+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3940050 con 0x555dd392e070 2023-10-06T02:27:00.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.145+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v113'217 uv217 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.145+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3940050 con 0x555dd392e070 2023-10-06T02:27:00.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.146+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v113'218 uv218 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.147 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:27:00.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.146+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3940050 con 0x555dd392e070 2023-10-06T02:27:00.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.147+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v113'219 uv219 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.147+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3934cb0 con 0x555dd392e070 2023-10-06T02:27:00.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.148+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v113'220 uv220 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.148+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3934cb0 con 0x555dd392e070 2023-10-06T02:27:00.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.149+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v113'221 uv215 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.149+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3934c30 con 0x555dd392e070 2023-10-06T02:27:00.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.150+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v113'222 uv222 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.150+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3934c30 con 0x555dd392e070 2023-10-06T02:27:00.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.151+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v113'223 uv223 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.151 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:27:00.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.151+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3941060 con 0x555dd392e070 2023-10-06T02:27:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.152+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v113'224 uv224 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.152+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3941060 con 0x555dd392e070 2023-10-06T02:27:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.153+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v113'225 uv225 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.153+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3940540 con 0x555dd392e070 2023-10-06T02:27:00.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.154+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v113'226 uv226 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.154+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x555dd3940540 con 0x555dd392e070 2023-10-06T02:27:00.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb34c8e5700 1 -- 172.21.15.6:0/4138055658 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v113'227 uv227 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fb3440085b0 con 0x555dd392e070 2023-10-06T02:27:00.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x555dd392e070 msgr2=0x555dd3930450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x555dd392e070 0x555dd3930450 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x555dd3864cb0 msgr2=0x555dd3866a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x555dd3864cb0 0x555dd3866a50 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x555dd3939b20 msgr2=0x555dd393bf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x555dd3939b20 0x555dd393bf00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x555dd3929090 msgr2=0x555dd392b470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x555dd3929090 0x555dd392b470 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 reap_dead start 2023-10-06T02:27:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x555dd393d280 msgr2=0x555dd393fb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x555dd393d280 0x555dd393fb10 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb34d8e7700 1 -- 172.21.15.6:0/4138055658 reap_dead start 2023-10-06T02:27:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x555dd3936b80 msgr2=0x555dd3938f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x555dd3936b80 0x555dd3938f60 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x555dd39316f0 msgr2=0x555dd3933ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x555dd39316f0 0x555dd3933ad0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb330065890 msgr2=0x7fb330067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb330065890 0x7fb330067d40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb340005be0 tx=0x7fb340014000 comp rx=0 tx=0).stop 2023-10-06T02:27:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dd390ce10 msgr2=0x555dd391f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dd390ce10 0x555dd391f540 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fb348009480 tx=0x7fb348007040 comp rx=0 tx=0).stop 2023-10-06T02:27:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 shutdown_connections 2023-10-06T02:27:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x555dd3936b80 0x555dd3938f60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x555dd39316f0 0x555dd3933ad0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dd390ce10 0x555dd391f540 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 --2- 172.21.15.6:0/4138055658 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb330065890 0x7fb330067d40 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 >> 172.21.15.6:0/4138055658 conn(0x555dd3838d50 msgr2=0x555dd38fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 shutdown_connections 2023-10-06T02:27:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.155+0000 7fb353eab000 1 -- 172.21.15.6:0/4138055658 wait complete. 2023-10-06T02:27:00.160 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 500.00000000 - 2023-10-06T02:27:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.240+0000 7f3eeb13f000 1 Processor -- start 2023-10-06T02:27:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.240+0000 7f3eeb13f000 1 -- start start 2023-10-06T02:27:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.240+0000 7f3eeb13f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6da04f7a0 0x55c6da0da520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.240+0000 7f3eeb13f000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6da0dacb0 0x55c6da034ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.240+0000 7f3eeb13f000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6da0deaa0 0x55c6da0e0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.240+0000 7f3eeb13f000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6d9f52980 con 0x55c6da0deaa0 2023-10-06T02:27:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.240+0000 7f3eeb13f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6d9f52620 con 0x55c6da04f7a0 2023-10-06T02:27:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.240+0000 7f3eeb13f000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c6d9f49400 con 0x55c6da0dacb0 2023-10-06T02:27:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.240+0000 7f3ee4b7b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6da0deaa0 0x55c6da0e0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.240+0000 7f3ee4b7b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6da0deaa0 0x55c6da0e0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52606/0 (socket says 172.21.15.6:52606) 2023-10-06T02:27:00.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.240+0000 7f3ee4b7b700 1 -- 172.21.15.6:0/1157500324 learned_addr learned my addr 172.21.15.6:0/1157500324 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:00.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.240+0000 7f3ee437a700 1 --2- 172.21.15.6:0/1157500324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6da04f7a0 0x55c6da0da520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.240+0000 7f3ee3b79700 1 --2- 172.21.15.6:0/1157500324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6da0dacb0 0x55c6da034ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3ee4b7b700 1 -- 172.21.15.6:0/1157500324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6da0dacb0 msgr2=0x55c6da034ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:00.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3ee4b7b700 1 --2- 172.21.15.6:0/1157500324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6da0dacb0 0x55c6da034ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3ee4b7b700 1 -- 172.21.15.6:0/1157500324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6da04f7a0 msgr2=0x55c6da0da520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:00.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3ee4b7b700 1 --2- 172.21.15.6:0/1157500324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6da04f7a0 0x55c6da0da520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3ee4b7b700 1 -- 172.21.15.6:0/1157500324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc00a180 con 0x55c6da0deaa0 2023-10-06T02:27:00.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3ee4b7b700 1 --2- 172.21.15.6:0/1157500324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6da0deaa0 0x55c6da0e0570 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009920 tx=0x7f3ed400c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c4fef091686f8d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:00.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3ee2b77700 1 -- 172.21.15.6:0/1157500324 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed400f040 con 0x55c6da0deaa0 2023-10-06T02:27:00.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3ee2b77700 1 -- 172.21.15.6:0/1157500324 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed4008890 con 0x55c6da0deaa0 2023-10-06T02:27:00.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3ee2b77700 1 -- 172.21.15.6:0/1157500324 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4008c50 con 0x55c6da0deaa0 2023-10-06T02:27:00.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3eeb13f000 1 -- 172.21.15.6:0/1157500324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6da0deaa0 msgr2=0x55c6da0e0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3eeb13f000 1 --2- 172.21.15.6:0/1157500324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6da0deaa0 0x55c6da0e0570 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009920 tx=0x7f3ed400c040 comp rx=0 tx=0).stop 2023-10-06T02:27:00.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3eeb13f000 1 -- 172.21.15.6:0/1157500324 shutdown_connections 2023-10-06T02:27:00.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3eeb13f000 1 --2- 172.21.15.6:0/1157500324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6da0deaa0 0x55c6da0e0570 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3eeb13f000 1 --2- 172.21.15.6:0/1157500324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6da04f7a0 0x55c6da0da520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3eeb13f000 1 --2- 172.21.15.6:0/1157500324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6da0dacb0 0x55c6da034ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3eeb13f000 1 -- 172.21.15.6:0/1157500324 >> 172.21.15.6:0/1157500324 conn(0x55c6da007d50 msgr2=0x55c6da009320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:00.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3eeb13f000 1 -- 172.21.15.6:0/1157500324 shutdown_connections 2023-10-06T02:27:00.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.241+0000 7f3eeb13f000 1 -- 172.21.15.6:0/1157500324 wait complete. 2023-10-06T02:27:00.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.242+0000 7f3eeb13f000 1 Processor -- start 2023-10-06T02:27:00.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.242+0000 7f3eeb13f000 1 -- start start 2023-10-06T02:27:00.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3eeb13f000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6da04f7a0 0x55c6da048a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3eeb13f000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6da0dacb0 0x55c6da0090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3eeb13f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6da0deaa0 0x55c6da009630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3eeb13f000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6da049600 con 0x55c6da0dacb0 2023-10-06T02:27:00.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3eeb13f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6da0498a0 con 0x55c6da0deaa0 2023-10-06T02:27:00.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3eeb13f000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c6da049b40 con 0x55c6da04f7a0 2023-10-06T02:27:00.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3ee3b79700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6da0dacb0 0x55c6da0090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3ee437a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6da04f7a0 0x55c6da048a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3ee437a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6da04f7a0 0x55c6da048a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:50806/0 (socket says 172.21.15.6:50806) 2023-10-06T02:27:00.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3ee4b7b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6da0deaa0 0x55c6da009630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3ee437a700 1 -- 172.21.15.6:0/932021148 learned_addr learned my addr 172.21.15.6:0/932021148 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:00.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3ee3b79700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6da0dacb0 0x55c6da0090f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52612/0 (socket says 172.21.15.6:52612) 2023-10-06T02:27:00.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3ee3b79700 1 -- 172.21.15.6:0/932021148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6da04f7a0 msgr2=0x55c6da048a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3ee3b79700 1 --2- 172.21.15.6:0/932021148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6da04f7a0 0x55c6da048a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3ee3b79700 1 -- 172.21.15.6:0/932021148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6da0deaa0 msgr2=0x55c6da009630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3ee3b79700 1 --2- 172.21.15.6:0/932021148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6da0deaa0 0x55c6da009630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3ee3b79700 1 -- 172.21.15.6:0/932021148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed40095a0 con 0x55c6da0dacb0 2023-10-06T02:27:00.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3ee4b7b700 1 --2- 172.21.15.6:0/932021148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6da0deaa0 0x55c6da009630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:00.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3ee437a700 1 --2- 172.21.15.6:0/932021148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c6da04f7a0 0x55c6da048a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:00.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.243+0000 7f3ee3b79700 1 --2- 172.21.15.6:0/932021148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6da0dacb0 0x55c6da0090f0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc002dd0 tx=0x7f3ecc001780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:00.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.244+0000 7f3ee1374700 1 -- 172.21.15.6:0/932021148 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc016030 con 0x55c6da0dacb0 2023-10-06T02:27:00.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.244+0000 7f3ee1374700 1 -- 172.21.15.6:0/932021148 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc008070 con 0x55c6da0dacb0 2023-10-06T02:27:00.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.244+0000 7f3eeb13f000 1 -- 172.21.15.6:0/932021148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c6d9f613d0 con 0x55c6da0dacb0 2023-10-06T02:27:00.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.244+0000 7f3ee1374700 1 -- 172.21.15.6:0/932021148 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc00cbd0 con 0x55c6da0dacb0 2023-10-06T02:27:00.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.244+0000 7f3eeb13f000 1 -- 172.21.15.6:0/932021148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c6d9f54ae0 con 0x55c6da0dacb0 2023-10-06T02:27:00.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.245+0000 7f3ee1374700 1 -- 172.21.15.6:0/932021148 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ecc019070 con 0x55c6da0dacb0 2023-10-06T02:27:00.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.245+0000 7f3ee1374700 1 --2- 172.21.15.6:0/932021148 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3ec4065890 0x7f3ec4067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.245+0000 7f3ee1374700 1 -- 172.21.15.6:0/932021148 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7f3ecc017070 con 0x55c6da0dacb0 2023-10-06T02:27:00.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.246+0000 7f3eeb13f000 1 --2- 172.21.15.6:0/932021148 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c6da0dd1d0 0x55c6da04a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.246+0000 7f3ee437a700 1 --2- 172.21.15.6:0/932021148 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3ec4065890 0x7f3ec4067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.246+0000 7f3eeb13f000 1 -- 172.21.15.6:0/932021148 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:1 14.15 14:aa448500:::500.00000000:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x55c6da04a7c0 con 0x55c6da0dd1d0 2023-10-06T02:27:00.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.246+0000 7f3ee4b7b700 1 --2- 172.21.15.6:0/932021148 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c6da0dd1d0 0x55c6da04a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.246+0000 7f3ee437a700 1 --2- 172.21.15.6:0/932021148 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3ec4065890 0x7f3ec4067d40 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00e640 tx=0x7f3edc014000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:00.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.246+0000 7f3ee4b7b700 1 --2- 172.21.15.6:0/932021148 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c6da0dd1d0 0x55c6da04a280 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:00.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.247+0000 7f3ee4b7b700 1 -- 172.21.15.6:0/932021148 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(1 500.00000000 [writefull 0~80] v113'204 uv204 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f3ed4019020 con 0x55c6da0dd1d0 2023-10-06T02:27:00.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.247+0000 7f3eeb13f000 1 -- 172.21.15.6:0/932021148 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c6da0dd1d0 msgr2=0x55c6da04a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.247+0000 7f3eeb13f000 1 --2- 172.21.15.6:0/932021148 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55c6da0dd1d0 0x55c6da04a280 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.247+0000 7f3eeb13f000 1 -- 172.21.15.6:0/932021148 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3ec4065890 msgr2=0x7f3ec4067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.247+0000 7f3eeb13f000 1 --2- 172.21.15.6:0/932021148 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3ec4065890 0x7f3ec4067d40 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00e640 tx=0x7f3edc014000 comp rx=0 tx=0).stop 2023-10-06T02:27:00.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.247+0000 7f3eeb13f000 1 -- 172.21.15.6:0/932021148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6da0dacb0 msgr2=0x55c6da0090f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.247+0000 7f3eeb13f000 1 --2- 172.21.15.6:0/932021148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6da0dacb0 0x55c6da0090f0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc002dd0 tx=0x7f3ecc001780 comp rx=0 tx=0).stop 2023-10-06T02:27:00.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.247+0000 7f3ee4b7b700 1 -- 172.21.15.6:0/932021148 reap_dead start 2023-10-06T02:27:00.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.247+0000 7f3eeb13f000 1 -- 172.21.15.6:0/932021148 shutdown_connections 2023-10-06T02:27:00.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.247+0000 7f3eeb13f000 1 -- 172.21.15.6:0/932021148 >> 172.21.15.6:0/932021148 conn(0x55c6da007d50 msgr2=0x55c6da034ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:00.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.248+0000 7f3eeb13f000 1 -- 172.21.15.6:0/932021148 shutdown_connections 2023-10-06T02:27:00.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.248+0000 7f3eeb13f000 1 -- 172.21.15.6:0/932021148 wait complete. 2023-10-06T02:27:00.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:27:00.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.413+0000 7f8809da2700 1 Processor -- start 2023-10-06T02:27:00.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.413+0000 7f8809da2700 1 -- start start 2023-10-06T02:27:00.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.413+0000 7f8809da2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f88040cc3d0 0x7f88040c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.413+0000 7f8809da2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88040c3b40 con 0x7f88041574b0 2023-10-06T02:27:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.413+0000 7f8809da2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88040c2f30 con 0x7f88040c3fd0 2023-10-06T02:27:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.413+0000 7f8809da2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88040c4980 con 0x7f88040cc3d0 2023-10-06T02:27:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.414+0000 7f8803fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f88040cc3d0 0x7f88040c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.414+0000 7f88037fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f88041574b0 0x7f88040b0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45566/0 (socket says 172.21.15.6:45566) 2023-10-06T02:27:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.414+0000 7f88037fe700 1 -- 172.21.15.6:0/1840643927 learned_addr learned my addr 172.21.15.6:0/1840643927 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.414+0000 7f8803fff700 1 -- 172.21.15.6:0/1840643927 >> v1:172.21.15.175:6789/0 conn(0x7f88040c3fd0 legacy=0x7f88040cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.414+0000 7f8803fff700 1 -- 172.21.15.6:0/1840643927 >> v1:172.21.15.6:6789/0 conn(0x7f88041574b0 legacy=0x7f88040b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.414+0000 7f88027fc700 1 -- 172.21.15.6:0/1840643927 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200101668 0 0) 0x7f88040c3b40 con 0x7f88041574b0 2023-10-06T02:27:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.414+0000 7f8803fff700 1 -- 172.21.15.6:0/1840643927 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88040c3210 con 0x7f88040cc3d0 2023-10-06T02:27:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.414+0000 7f8803fff700 1 --2- 172.21.15.6:0/1840643927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88040cc3d0 0x7f88040c4440 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009e60 tx=0x7f87fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82feeae4cfe52576 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.414+0000 7f88027fc700 1 -- 172.21.15.6:0/1840643927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00e070 con 0x7f88040cc3d0 2023-10-06T02:27:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.414+0000 7f88027fc700 1 -- 172.21.15.6:0/1840643927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc00bc30 con 0x7f88040cc3d0 2023-10-06T02:27:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.414+0000 7f88027fc700 1 -- 172.21.15.6:0/1840643927 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc012430 con 0x7f88040cc3d0 2023-10-06T02:27:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.415+0000 7f8809da2700 1 -- 172.21.15.6:0/1840643927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88040cc3d0 msgr2=0x7f88040c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.415+0000 7f8809da2700 1 --2- 172.21.15.6:0/1840643927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88040cc3d0 0x7f88040c4440 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009e60 tx=0x7f87fc009780 comp rx=0 tx=0).stop 2023-10-06T02:27:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.415+0000 7f8809da2700 1 -- 172.21.15.6:0/1840643927 shutdown_connections 2023-10-06T02:27:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.415+0000 7f8809da2700 1 --2- 172.21.15.6:0/1840643927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88040cc3d0 0x7f88040c4440 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.415+0000 7f8809da2700 1 -- 172.21.15.6:0/1840643927 >> 172.21.15.6:0/1840643927 conn(0x7f8804067910 msgr2=0x7f88040ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.415+0000 7f8809da2700 1 -- 172.21.15.6:0/1840643927 shutdown_connections 2023-10-06T02:27:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.415+0000 7f8809da2700 1 -- 172.21.15.6:0/1840643927 wait complete. 2023-10-06T02:27:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.416+0000 7f8809da2700 1 Processor -- start 2023-10-06T02:27:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.416+0000 7f8809da2700 1 -- start start 2023-10-06T02:27:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f8809da2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88040c3fd0 0x7f880416b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f8809da2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88040cc3d0 0x7f8804141a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f8809da2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88041574b0 0x7f88040b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f8809da2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880416ba90 con 0x7f88041574b0 2023-10-06T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f8809da2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88040ca2d0 con 0x7f88040cc3d0 2023-10-06T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f8809da2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88040c56a0 con 0x7f88040c3fd0 2023-10-06T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f8803fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88041574b0 0x7f88040b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f8803fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88041574b0 0x7f88040b33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52634/0 (socket says 172.21.15.6:52634) 2023-10-06T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f8803fff700 1 -- 172.21.15.6:0/467998892 learned_addr learned my addr 172.21.15.6:0/467998892 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f8802ffd700 1 --2- 172.21.15.6:0/467998892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88040cc3d0 0x7f8804141a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f88037fe700 1 --2- 172.21.15.6:0/467998892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88040c3fd0 0x7f880416b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f8803fff700 1 -- 172.21.15.6:0/467998892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88040c3fd0 msgr2=0x7f880416b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f8803fff700 1 --2- 172.21.15.6:0/467998892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88040c3fd0 0x7f880416b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f8803fff700 1 -- 172.21.15.6:0/467998892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88040cc3d0 msgr2=0x7f8804141a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f8803fff700 1 --2- 172.21.15.6:0/467998892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88040cc3d0 0x7f8804141a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f8803fff700 1 -- 172.21.15.6:0/467998892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc009a20 con 0x7f88041574b0 2023-10-06T02:27:00.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f88037fe700 1 --2- 172.21.15.6:0/467998892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88040c3fd0 0x7f880416b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:00.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.417+0000 7f8803fff700 1 --2- 172.21.15.6:0/467998892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88041574b0 0x7f88040b33a0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00d010 tx=0x7f87fc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:00.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.418+0000 7f87eb7fe700 1 -- 172.21.15.6:0/467998892 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc01b600 con 0x7f88041574b0 2023-10-06T02:27:00.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.418+0000 7f87eb7fe700 1 -- 172.21.15.6:0/467998892 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc01b760 con 0x7f88041574b0 2023-10-06T02:27:00.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.418+0000 7f87eb7fe700 1 -- 172.21.15.6:0/467998892 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc01bb20 con 0x7f88041574b0 2023-10-06T02:27:00.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.418+0000 7f8809da2700 1 -- 172.21.15.6:0/467998892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88040c5980 con 0x7f88041574b0 2023-10-06T02:27:00.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.418+0000 7f8809da2700 1 -- 172.21.15.6:0/467998892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88040c5f40 con 0x7f88041574b0 2023-10-06T02:27:00.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.419+0000 7f8809da2700 1 -- 172.21.15.6:0/467998892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880406e590 con 0x7f88041574b0 2023-10-06T02:27:00.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.419+0000 7f87eb7fe700 1 -- 172.21.15.6:0/467998892 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87fc02f450 con 0x7f88041574b0 2023-10-06T02:27:00.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.419+0000 7f87eb7fe700 1 --2- 172.21.15.6:0/467998892 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f87f0066f30 0x7f87f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:00.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.419+0000 7f87eb7fe700 1 -- 172.21.15.6:0/467998892 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7f87fc086cf0 con 0x7f88041574b0 2023-10-06T02:27:00.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.420+0000 7f88037fe700 1 --2- 172.21.15.6:0/467998892 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f87f0066f30 0x7f87f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:00.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.420+0000 7f88037fe700 1 --2- 172.21.15.6:0/467998892 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f87f0066f30 0x7f87f00693e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f87f40017c0 tx=0x7f87f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:00.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.424+0000 7f87eb7fe700 1 -- 172.21.15.6:0/467998892 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87fc08b070 con 0x7f88041574b0 2023-10-06T02:27:00.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.662+0000 7f8809da2700 1 -- 172.21.15.6:0/467998892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f88040c34f0 con 0x7f88041574b0 2023-10-06T02:27:00.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.946+0000 7f87eb7fe700 1 -- 172.21.15.6:0/467998892 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v206) v1 ==== 162+0+0 (secure 0 0 0) 0x7f87fc0536b0 con 0x7f88041574b0 2023-10-06T02:27:00.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.948+0000 7f8809da2700 1 -- 172.21.15.6:0/467998892 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f87f0066f30 msgr2=0x7f87f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.948+0000 7f8809da2700 1 --2- 172.21.15.6:0/467998892 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f87f0066f30 0x7f87f00693e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f87f40017c0 tx=0x7f87f4009040 comp rx=0 tx=0).stop 2023-10-06T02:27:00.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.948+0000 7f8809da2700 1 -- 172.21.15.6:0/467998892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88041574b0 msgr2=0x7f88040b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:00.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.948+0000 7f8809da2700 1 --2- 172.21.15.6:0/467998892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88041574b0 0x7f88040b33a0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00d010 tx=0x7f87fc019000 comp rx=0 tx=0).stop 2023-10-06T02:27:00.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.948+0000 7f8809da2700 1 -- 172.21.15.6:0/467998892 shutdown_connections 2023-10-06T02:27:00.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.948+0000 7f8809da2700 1 --2- 172.21.15.6:0/467998892 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f87f0066f30 0x7f87f00693e0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.948+0000 7f8809da2700 1 --2- 172.21.15.6:0/467998892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88041574b0 0x7f88040b33a0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.948+0000 7f8809da2700 1 --2- 172.21.15.6:0/467998892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88040c3fd0 0x7f880416b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.948+0000 7f8809da2700 1 --2- 172.21.15.6:0/467998892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88040cc3d0 0x7f8804141a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:00.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.948+0000 7f8809da2700 1 -- 172.21.15.6:0/467998892 >> 172.21.15.6:0/467998892 conn(0x7f8804067910 msgr2=0x7f88041564f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:00.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.948+0000 7f8809da2700 1 -- 172.21.15.6:0/467998892 shutdown_connections 2023-10-06T02:27:00.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:00.948+0000 7f8809da2700 1 -- 172.21.15.6:0/467998892 wait complete. 2023-10-06T02:27:00.950 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:27:00.952 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:27:00.952+0000 7fb01327e700 -1 mds.0.purge_queue operator(): Error -22 loading Journaler 2023-10-06T02:27:00.952 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:27:00.952+0000 7fb01327e700 -1 mds.0.207 unhandled write error (22) Invalid argument, force readonly... 2023-10-06T02:27:00.964 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:01.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.084+0000 7f7446e4b700 1 Processor -- start 2023-10-06T02:27:01.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.084+0000 7f7446e4b700 1 -- start start 2023-10-06T02:27:01.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.085+0000 7f7446e4b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f74400b27f0 0x7f7440159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:01.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.085+0000 7f7446e4b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f744015d4d0 0x7f744015d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:01.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.085+0000 7f7446e4b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74400cb6c0 con 0x7f7440159380 2023-10-06T02:27:01.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.085+0000 7f7446e4b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744015e200 con 0x7f744015d4d0 2023-10-06T02:27:01.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.085+0000 7f7446e4b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74400ccb60 con 0x7f74400b27f0 2023-10-06T02:27:01.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.085+0000 7f74453e8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f744015d4d0 0x7f744015d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:01.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.086+0000 7f7444be7700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7440159380 0x7f74400b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:48094/0 (socket says 172.21.15.6:48094) 2023-10-06T02:27:01.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.086+0000 7f7444be7700 1 -- 172.21.15.6:0/178814371 learned_addr learned my addr 172.21.15.6:0/178814371 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:01.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.086+0000 7f743ffff700 1 --2- 172.21.15.6:0/178814371 >> v2:172.21.15.175:3300/0 conn(0x7f74400b27f0 0x7f7440159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:01.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.086+0000 7f74453e8700 1 -- 172.21.15.6:0/178814371 >> v2:172.21.15.175:3300/0 conn(0x7f74400b27f0 msgr2=0x7f7440159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:01.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.086+0000 7f74453e8700 1 --2- 172.21.15.6:0/178814371 >> v2:172.21.15.175:3300/0 conn(0x7f74400b27f0 0x7f7440159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.086+0000 7f743f7fe700 1 -- 172.21.15.6:0/178814371 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798073762 0 0) 0x7f74400cb6c0 con 0x7f7440159380 2023-10-06T02:27:01.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.086+0000 7f74453e8700 1 -- 172.21.15.6:0/178814371 >> v1:172.21.15.175:6789/0 conn(0x7f7440159380 legacy=0x7f74400b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:01.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.086+0000 7f74453e8700 1 -- 172.21.15.6:0/178814371 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74400c3ef0 con 0x7f744015d4d0 2023-10-06T02:27:01.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.086+0000 7f74453e8700 1 --2- 172.21.15.6:0/178814371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744015d4d0 0x7f744015d930 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f744006b280 tx=0x7f74300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3aeccbae34eab26 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.086+0000 7f743f7fe700 1 -- 172.21.15.6:0/178814371 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7430011630 con 0x7f744015d4d0 2023-10-06T02:27:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.086+0000 7f743f7fe700 1 -- 172.21.15.6:0/178814371 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7430011790 con 0x7f744015d4d0 2023-10-06T02:27:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.086+0000 7f743f7fe700 1 -- 172.21.15.6:0/178814371 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7430011b30 con 0x7f744015d4d0 2023-10-06T02:27:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.087+0000 7f7446e4b700 1 -- 172.21.15.6:0/178814371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744015d4d0 msgr2=0x7f744015d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.087+0000 7f7446e4b700 1 --2- 172.21.15.6:0/178814371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744015d4d0 0x7f744015d930 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f744006b280 tx=0x7f74300091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.087+0000 7f7446e4b700 1 -- 172.21.15.6:0/178814371 shutdown_connections 2023-10-06T02:27:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.087+0000 7f7446e4b700 1 --2- 172.21.15.6:0/178814371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744015d4d0 0x7f744015d930 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.087+0000 7f7446e4b700 1 --2- 172.21.15.6:0/178814371 >> v2:172.21.15.175:3300/0 conn(0x7f74400b27f0 0x7f7440159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.087+0000 7f7446e4b700 1 -- 172.21.15.6:0/178814371 >> 172.21.15.6:0/178814371 conn(0x7f7440068680 msgr2=0x7f7440068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.087+0000 7f7446e4b700 1 -- 172.21.15.6:0/178814371 shutdown_connections 2023-10-06T02:27:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.087+0000 7f7446e4b700 1 -- 172.21.15.6:0/178814371 wait complete. 2023-10-06T02:27:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.088+0000 7f7446e4b700 1 Processor -- start 2023-10-06T02:27:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.088+0000 7f7446e4b700 1 -- start start 2023-10-06T02:27:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.089+0000 7f7446e4b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74400b27f0 0x7f74400c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.089+0000 7f7446e4b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7440159380 0x7f744016a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.089+0000 7f7446e4b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f744015d4d0 0x7f744016c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.089+0000 7f7446e4b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744016c800 con 0x7f7440159380 2023-10-06T02:27:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.089+0000 7f7446e4b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74401698d0 con 0x7f74400b27f0 2023-10-06T02:27:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.089+0000 7f7446e4b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7440169bb0 con 0x7f744015d4d0 2023-10-06T02:27:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.089+0000 7f743ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7440159380 0x7f744016a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.089+0000 7f743ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7440159380 0x7f744016a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52652/0 (socket says 172.21.15.6:52652) 2023-10-06T02:27:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.089+0000 7f743ffff700 1 -- 172.21.15.6:0/3938662610 learned_addr learned my addr 172.21.15.6:0/3938662610 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.089+0000 7f7444be7700 1 --2- 172.21.15.6:0/3938662610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74400b27f0 0x7f74400c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.089+0000 7f74453e8700 1 --2- 172.21.15.6:0/3938662610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f744015d4d0 0x7f744016c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.089+0000 7f743ffff700 1 -- 172.21.15.6:0/3938662610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f744015d4d0 msgr2=0x7f744016c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.089+0000 7f743ffff700 1 --2- 172.21.15.6:0/3938662610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f744015d4d0 0x7f744016c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.089+0000 7f743ffff700 1 -- 172.21.15.6:0/3938662610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74400b27f0 msgr2=0x7f74400c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.089+0000 7f743ffff700 1 --2- 172.21.15.6:0/3938662610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74400b27f0 0x7f74400c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.089+0000 7f743ffff700 1 -- 172.21.15.6:0/3938662610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7430009420 con 0x7f7440159380 2023-10-06T02:27:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.089+0000 7f743ffff700 1 --2- 172.21.15.6:0/3938662610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7440159380 0x7f744016a630 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f743400e930 tx=0x7f74340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.090+0000 7f743cff9700 1 -- 172.21.15.6:0/3938662610 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7434009510 con 0x7f7440159380 2023-10-06T02:27:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.090+0000 7f743cff9700 1 -- 172.21.15.6:0/3938662610 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743400c850 con 0x7f7440159380 2023-10-06T02:27:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.090+0000 7f7446e4b700 1 -- 172.21.15.6:0/3938662610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7440169e90 con 0x7f7440159380 2023-10-06T02:27:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.090+0000 7f743cff9700 1 -- 172.21.15.6:0/3938662610 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743400cc10 con 0x7f7440159380 2023-10-06T02:27:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.090+0000 7f7446e4b700 1 -- 172.21.15.6:0/3938662610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744015aff0 con 0x7f7440159380 2023-10-06T02:27:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.091+0000 7f7446e4b700 1 -- 172.21.15.6:0/3938662610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74400c91b0 con 0x7f7440159380 2023-10-06T02:27:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.091+0000 7f743cff9700 1 -- 172.21.15.6:0/3938662610 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7434013470 con 0x7f7440159380 2023-10-06T02:27:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.091+0000 7f743cff9700 1 --2- 172.21.15.6:0/3938662610 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f742c066f30 0x7f742c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.092+0000 7f743cff9700 1 -- 172.21.15.6:0/3938662610 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7f7434084f50 con 0x7f7440159380 2023-10-06T02:27:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.092+0000 7f7444be7700 1 --2- 172.21.15.6:0/3938662610 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f742c066f30 0x7f742c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.092+0000 7f7444be7700 1 --2- 172.21.15.6:0/3938662610 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f742c066f30 0x7f742c0693e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f744015abb0 tx=0x7f7438009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.096+0000 7f743cff9700 1 -- 172.21.15.6:0/3938662610 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74400c91b0 con 0x7f7440159380 2023-10-06T02:27:01.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.335+0000 7f7446e4b700 1 -- 172.21.15.6:0/3938662610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74400c91b0 con 0x7f7440159380 2023-10-06T02:27:01.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.335+0000 7f743cff9700 1 -- 172.21.15.6:0/3938662610 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 207 v207) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f74400c91b0 con 0x7f7440159380 2023-10-06T02:27:01.336 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":207,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":207,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:00.946765+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9063":{"gid":9063,"name":"a","rank":0,"incarnation":207,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/2836519357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2836519357},{"type":"v1","addr":"172.21.15.6:6835","nonce":2836519357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:01.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.337+0000 7f7446e4b700 1 -- 172.21.15.6:0/3938662610 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f742c066f30 msgr2=0x7f742c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:01.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.337+0000 7f7446e4b700 1 --2- 172.21.15.6:0/3938662610 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f742c066f30 0x7f742c0693e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f744015abb0 tx=0x7f7438009040 comp rx=0 tx=0).stop 2023-10-06T02:27:01.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.337+0000 7f7446e4b700 1 -- 172.21.15.6:0/3938662610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7440159380 msgr2=0x7f744016a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:01.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.337+0000 7f7446e4b700 1 --2- 172.21.15.6:0/3938662610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7440159380 0x7f744016a630 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f743400e930 tx=0x7f74340091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.337+0000 7f7446e4b700 1 -- 172.21.15.6:0/3938662610 shutdown_connections 2023-10-06T02:27:01.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.337+0000 7f7446e4b700 1 --2- 172.21.15.6:0/3938662610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f744015d4d0 0x7f744016c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.337+0000 7f7446e4b700 1 --2- 172.21.15.6:0/3938662610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74400b27f0 0x7f74400c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.337+0000 7f7446e4b700 1 --2- 172.21.15.6:0/3938662610 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f742c066f30 0x7f742c0693e0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.337+0000 7f7446e4b700 1 --2- 172.21.15.6:0/3938662610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7440159380 0x7f744016a630 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.337+0000 7f7446e4b700 1 -- 172.21.15.6:0/3938662610 >> 172.21.15.6:0/3938662610 conn(0x7f7440068680 msgr2=0x7f74400c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:01.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.338+0000 7f7446e4b700 1 -- 172.21.15.6:0/3938662610 shutdown_connections 2023-10-06T02:27:01.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.338+0000 7f7446e4b700 1 -- 172.21.15.6:0/3938662610 wait complete. 2023-10-06T02:27:01.340 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 207 2023-10-06T02:27:01.753 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.875+0000 7f8e9c8f9700 1 Processor -- start 2023-10-06T02:27:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.875+0000 7f8e9c8f9700 1 -- start start 2023-10-06T02:27:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.876+0000 7f8e9c8f9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8e981593f0 0x7f8e9806de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.876+0000 7f8e9c8f9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e9806adf0 0x7f8e9806e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.876+0000 7f8e9c8f9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e98069950 con 0x7f8e981597c0 2023-10-06T02:27:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.876+0000 7f8e9c8f9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e980b2850 con 0x7f8e981593f0 2023-10-06T02:27:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.876+0000 7f8e9c8f9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980b1fb0 con 0x7f8e9806adf0 2023-10-06T02:27:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.876+0000 7f8e95d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8e981597c0 0x7f8e9815d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45578/0 (socket says 172.21.15.6:45578) 2023-10-06T02:27:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.876+0000 7f8e95d9b700 1 -- 172.21.15.6:0/1358360169 learned_addr learned my addr 172.21.15.6:0/1358360169 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.876+0000 7f8e9559a700 1 -- 172.21.15.6:0/1358360169 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665126275 0 0) 0x7f8e98069950 con 0x7f8e981597c0 2023-10-06T02:27:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.876+0000 7f8e9659c700 1 --2- 172.21.15.6:0/1358360169 >> v2:172.21.15.175:3300/0 conn(0x7f8e981593f0 0x7f8e9806de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9559a700 1 -- 172.21.15.6:0/1358360169 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e84003570 con 0x7f8e981597c0 2023-10-06T02:27:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e96d9d700 1 --2- 172.21.15.6:0/1358360169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e9806adf0 0x7f8e9806e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9559a700 1 -- 172.21.15.6:0/1358360169 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 750422348 0 0) 0x7f8e84003570 con 0x7f8e981597c0 2023-10-06T02:27:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9559a700 1 -- 172.21.15.6:0/1358360169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e9806adf0 msgr2=0x7f8e9806e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9559a700 1 --2- 172.21.15.6:0/1358360169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e9806adf0 0x7f8e9806e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9559a700 1 -- 172.21.15.6:0/1358360169 >> v2:172.21.15.175:3300/0 conn(0x7f8e981593f0 msgr2=0x7f8e9806de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9559a700 1 --2- 172.21.15.6:0/1358360169 >> v2:172.21.15.175:3300/0 conn(0x7f8e981593f0 0x7f8e9806de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9559a700 1 -- 172.21.15.6:0/1358360169 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e980b2290 con 0x7f8e981597c0 2023-10-06T02:27:01.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9559a700 1 -- 172.21.15.6:0/1358360169 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f8e800015f0 con 0x7f8e981597c0 2023-10-06T02:27:01.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9559a700 1 -- 172.21.15.6:0/1358360169 >> v1:172.21.15.6:6789/0 conn(0x7f8e981597c0 legacy=0x7f8e9815d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:01.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9559a700 1 --2- 172.21.15.6:0/1358360169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e84003a60 0x7f8e84003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:01.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9559a700 1 --2- 172.21.15.6:0/1358360169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e84004810 0x7f8e84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:01.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9559a700 1 --2- 172.21.15.6:0/1358360169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e9806adf0 0x7f8e840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:01.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9559a700 1 -- 172.21.15.6:0/1358360169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980b2850 con 0x7f8e84003a60 2023-10-06T02:27:01.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9559a700 1 -- 172.21.15.6:0/1358360169 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980b1fb0 con 0x7f8e84004810 2023-10-06T02:27:01.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9559a700 1 -- 172.21.15.6:0/1358360169 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8400ba60 con 0x7f8e9806adf0 2023-10-06T02:27:01.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9659c700 1 --2- 172.21.15.6:0/1358360169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e84003a60 0x7f8e84003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:01.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e95d9b700 1 --2- 172.21.15.6:0/1358360169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e84004810 0x7f8e84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:01.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e96d9d700 1 --2- 172.21.15.6:0/1358360169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e9806adf0 0x7f8e840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9659c700 1 -- 172.21.15.6:0/1358360169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e9806adf0 msgr2=0x7f8e840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9659c700 1 --2- 172.21.15.6:0/1358360169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e9806adf0 0x7f8e840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9659c700 1 -- 172.21.15.6:0/1358360169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e84004810 msgr2=0x7f8e84004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9659c700 1 --2- 172.21.15.6:0/1358360169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e84004810 0x7f8e84004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.877+0000 7f8e9659c700 1 -- 172.21.15.6:0/1358360169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e84003570 con 0x7f8e84003a60 2023-10-06T02:27:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.878+0000 7f8e9659c700 1 --2- 172.21.15.6:0/1358360169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e84003a60 0x7f8e84003e70 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009c30 tx=0x7f8e900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d55797e57e29276 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.878+0000 7f8e9559a700 1 -- 172.21.15.6:0/1358360169 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000e710 con 0x7f8e84003a60 2023-10-06T02:27:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.878+0000 7f8e9559a700 1 -- 172.21.15.6:0/1358360169 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9000e870 con 0x7f8e84003a60 2023-10-06T02:27:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.878+0000 7f8e9559a700 1 -- 172.21.15.6:0/1358360169 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000ec30 con 0x7f8e84003a60 2023-10-06T02:27:01.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.878+0000 7f8e9c8f9700 1 -- 172.21.15.6:0/1358360169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e84003a60 msgr2=0x7f8e84003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:01.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.878+0000 7f8e9c8f9700 1 --2- 172.21.15.6:0/1358360169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e84003a60 0x7f8e84003e70 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009c30 tx=0x7f8e900091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.878+0000 7f8e96d9d700 1 -- 172.21.15.6:0/1358360169 reap_dead start 2023-10-06T02:27:01.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.878+0000 7f8e9c8f9700 1 -- 172.21.15.6:0/1358360169 shutdown_connections 2023-10-06T02:27:01.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.878+0000 7f8e9c8f9700 1 -- 172.21.15.6:0/1358360169 >> 172.21.15.6:0/1358360169 conn(0x7f8e9806cff0 msgr2=0x7f8e980afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:01.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.878+0000 7f8e9c8f9700 1 -- 172.21.15.6:0/1358360169 shutdown_connections 2023-10-06T02:27:01.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.878+0000 7f8e9c8f9700 1 -- 172.21.15.6:0/1358360169 wait complete. 2023-10-06T02:27:01.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.879+0000 7f8e9c8f9700 1 Processor -- start 2023-10-06T02:27:01.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.879+0000 7f8e9c8f9700 1 -- start start 2023-10-06T02:27:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.880+0000 7f8e9c8f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e84003a60 0x7f8e9816aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.880+0000 7f8e9c8f9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e980c8820 0x7f8e98167a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.880+0000 7f8e9c8f9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e9816c790 0x7f8e9816cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.880+0000 7f8e9c8f9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e981474a0 con 0x7f8e84003a60 2023-10-06T02:27:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.880+0000 7f8e9c8f9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9816c300 con 0x7f8e9816c790 2023-10-06T02:27:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.880+0000 7f8e9c8f9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9816d170 con 0x7f8e980c8820 2023-10-06T02:27:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.880+0000 7f8e9659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e84003a60 0x7f8e9816aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.880+0000 7f8e9659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e84003a60 0x7f8e9816aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52680/0 (socket says 172.21.15.6:52680) 2023-10-06T02:27:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.880+0000 7f8e9659c700 1 -- 172.21.15.6:0/3383726164 learned_addr learned my addr 172.21.15.6:0/3383726164 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.880+0000 7f8e95d9b700 1 --2- 172.21.15.6:0/3383726164 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e980c8820 0x7f8e98167a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.880+0000 7f8e96d9d700 1 --2- 172.21.15.6:0/3383726164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e9816c790 0x7f8e9816cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:01.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.880+0000 7f8e9659c700 1 -- 172.21.15.6:0/3383726164 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e980c8820 msgr2=0x7f8e98167a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:01.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.880+0000 7f8e9659c700 1 --2- 172.21.15.6:0/3383726164 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e980c8820 0x7f8e98167a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.880+0000 7f8e9659c700 1 -- 172.21.15.6:0/3383726164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e9816c790 msgr2=0x7f8e9816cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:01.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.880+0000 7f8e9659c700 1 --2- 172.21.15.6:0/3383726164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e9816c790 0x7f8e9816cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:01.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.880+0000 7f8e9659c700 1 -- 172.21.15.6:0/3383726164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e980c8c90 con 0x7f8e84003a60 2023-10-06T02:27:01.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.881+0000 7f8e9659c700 1 --2- 172.21.15.6:0/3383726164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e84003a60 0x7f8e9816aff0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f8e840046d0 tx=0x7f8e9001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:01.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.881+0000 7f8e8e7fc700 1 -- 172.21.15.6:0/3383726164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e90022070 con 0x7f8e84003a60 2023-10-06T02:27:01.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.881+0000 7f8e8e7fc700 1 -- 172.21.15.6:0/3383726164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9000e9e0 con 0x7f8e84003a60 2023-10-06T02:27:01.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.881+0000 7f8e9c8f9700 1 -- 172.21.15.6:0/3383726164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9816b6f0 con 0x7f8e84003a60 2023-10-06T02:27:01.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.881+0000 7f8e8e7fc700 1 -- 172.21.15.6:0/3383726164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9001c450 con 0x7f8e84003a60 2023-10-06T02:27:01.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.881+0000 7f8e9c8f9700 1 -- 172.21.15.6:0/3383726164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9816bcb0 con 0x7f8e84003a60 2023-10-06T02:27:01.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.882+0000 7f8e9c8f9700 1 -- 172.21.15.6:0/3383726164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e981474a0 con 0x7f8e84003a60 2023-10-06T02:27:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.882+0000 7f8e8e7fc700 1 -- 172.21.15.6:0/3383726164 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e9001c840 con 0x7f8e84003a60 2023-10-06T02:27:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.883+0000 7f8e8e7fc700 1 --2- 172.21.15.6:0/3383726164 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8e78066f30 0x7f8e780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.883+0000 7f8e8e7fc700 1 -- 172.21.15.6:0/3383726164 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7f8e900864f0 con 0x7f8e84003a60 2023-10-06T02:27:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.883+0000 7f8e95d9b700 1 --2- 172.21.15.6:0/3383726164 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8e78066f30 0x7f8e780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.884+0000 7f8e95d9b700 1 --2- 172.21.15.6:0/3383726164 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8e78066f30 0x7f8e780693e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8e80000e10 tx=0x7f8e80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:01.887+0000 7f8e8e7fc700 1 -- 172.21.15.6:0/3383726164 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e90052eb0 con 0x7f8e84003a60 2023-10-06T02:27:02.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:02.131+0000 7f8e9c8f9700 1 -- 172.21.15.6:0/3383726164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e9806d3f0 con 0x7f8e84003a60 2023-10-06T02:27:02.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:02.131+0000 7f8e8e7fc700 1 -- 172.21.15.6:0/3383726164 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 208 v208) v1 ==== 95+0+4607 (secure 0 0 0) 0x7f8e9002b090 con 0x7f8e84003a60 2023-10-06T02:27:02.133 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:02.133 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":208,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":208,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:01.948748+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9063":{"gid":9063,"name":"a","rank":0,"incarnation":207,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.6:6835/2836519357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2836519357},{"type":"v1","addr":"172.21.15.6:6835","nonce":2836519357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:02.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:02.133+0000 7f8e9c8f9700 1 -- 172.21.15.6:0/3383726164 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8e78066f30 msgr2=0x7f8e780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:02.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:02.133+0000 7f8e9c8f9700 1 --2- 172.21.15.6:0/3383726164 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8e78066f30 0x7f8e780693e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8e80000e10 tx=0x7f8e80009040 comp rx=0 tx=0).stop 2023-10-06T02:27:02.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:02.133+0000 7f8e9c8f9700 1 -- 172.21.15.6:0/3383726164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e84003a60 msgr2=0x7f8e9816aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:02.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:02.133+0000 7f8e9c8f9700 1 --2- 172.21.15.6:0/3383726164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e84003a60 0x7f8e9816aff0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f8e840046d0 tx=0x7f8e9001a000 comp rx=0 tx=0).stop 2023-10-06T02:27:02.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:02.133+0000 7f8e9c8f9700 1 -- 172.21.15.6:0/3383726164 shutdown_connections 2023-10-06T02:27:02.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:02.133+0000 7f8e9c8f9700 1 --2- 172.21.15.6:0/3383726164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e9816c790 0x7f8e9816cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:02.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:02.133+0000 7f8e9c8f9700 1 --2- 172.21.15.6:0/3383726164 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8e78066f30 0x7f8e780693e0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:02.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:02.133+0000 7f8e9c8f9700 1 --2- 172.21.15.6:0/3383726164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e84003a60 0x7f8e9816aff0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:02.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:02.133+0000 7f8e9c8f9700 1 --2- 172.21.15.6:0/3383726164 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e980c8820 0x7f8e98167a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:02.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:02.133+0000 7f8e9c8f9700 1 -- 172.21.15.6:0/3383726164 >> 172.21.15.6:0/3383726164 conn(0x7f8e9806cff0 msgr2=0x7f8e980cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:02.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:02.133+0000 7f8e9c8f9700 1 -- 172.21.15.6:0/3383726164 shutdown_connections 2023-10-06T02:27:02.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:02.133+0000 7f8e9c8f9700 1 -- 172.21.15.6:0/3383726164 wait complete. 2023-10-06T02:27:02.136 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 208 2023-10-06T02:27:02.146 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 208, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:27:01.948748+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 113, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9063}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9063': {'gid': 9063, 'name': 'a', 'rank': 0, 'incarnation': 207, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.6:6835/2836519357', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 2836519357}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 2836519357}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:27:02.146 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9063:up:reconnect 2023-10-06T02:27:02.146 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2023-10-06T02:27:07.147 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:07.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.279+0000 7f11e72f2700 1 Processor -- start 2023-10-06T02:27:07.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.279+0000 7f11e72f2700 1 -- start start 2023-10-06T02:27:07.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.280+0000 7f11e72f2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f11e00af4e0 0x7f11e00b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:07.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.280+0000 7f11e72f2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11e00af8b0 0x7f11e00b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:07.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.280+0000 7f11e72f2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e015e190 con 0x7f11e015d460 2023-10-06T02:27:07.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.280+0000 7f11e72f2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e00b1910 con 0x7f11e00af4e0 2023-10-06T02:27:07.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.280+0000 7f11e72f2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e015dfb0 con 0x7f11e00af8b0 2023-10-06T02:27:07.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.281+0000 7f11e508e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f11e00af4e0 0x7f11e00b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:07.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.281+0000 7f11e488d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11e00af8b0 0x7f11e00b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:07.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.281+0000 7f11e508e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f11e00af4e0 0x7f11e00b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:38420/0 (socket says 172.21.15.6:38420) 2023-10-06T02:27:07.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.281+0000 7f11e488d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11e00af8b0 0x7f11e00b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:50846/0 (socket says 172.21.15.6:50846) 2023-10-06T02:27:07.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.281+0000 7f11e508e700 1 -- 172.21.15.6:0/3383732260 learned_addr learned my addr 172.21.15.6:0/3383732260 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:07.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.281+0000 7f11e508e700 1 -- 172.21.15.6:0/3383732260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11e00af8b0 msgr2=0x7f11e00b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:07.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.281+0000 7f11e508e700 1 --2- 172.21.15.6:0/3383732260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11e00af8b0 0x7f11e00b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.281+0000 7f11e508e700 1 -- 172.21.15.6:0/3383732260 >> v1:172.21.15.175:6789/0 conn(0x7f11e015d460 legacy=0x7f11e015d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.281+0000 7f11dffff700 1 -- 172.21.15.6:0/3383732260 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051678441 0 0) 0x7f11e015e190 con 0x7f11e015d460 2023-10-06T02:27:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.281+0000 7f11e508e700 1 -- 172.21.15.6:0/3383732260 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e00cb650 con 0x7f11e00af4e0 2023-10-06T02:27:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.281+0000 7f11e488d700 1 --2- 172.21.15.6:0/3383732260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11e00af8b0 0x7f11e00b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.281+0000 7f11e508e700 1 --2- 172.21.15.6:0/3383732260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e00af4e0 0x7f11e00b20e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f11d80099b0 tx=0x7f11d8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=485fd6cd76a090bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.282+0000 7f11dffff700 1 -- 172.21.15.6:0/3383732260 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d8009ea0 con 0x7f11e00af4e0 2023-10-06T02:27:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.282+0000 7f11dffff700 1 -- 172.21.15.6:0/3383732260 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d800b860 con 0x7f11e00af4e0 2023-10-06T02:27:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.282+0000 7f11dffff700 1 -- 172.21.15.6:0/3383732260 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d800bc00 con 0x7f11e00af4e0 2023-10-06T02:27:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.282+0000 7f11e72f2700 1 -- 172.21.15.6:0/3383732260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e00af4e0 msgr2=0x7f11e00b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.282+0000 7f11e72f2700 1 --2- 172.21.15.6:0/3383732260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e00af4e0 0x7f11e00b20e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f11d80099b0 tx=0x7f11d8009250 comp rx=0 tx=0).stop 2023-10-06T02:27:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.282+0000 7f11e72f2700 1 -- 172.21.15.6:0/3383732260 shutdown_connections 2023-10-06T02:27:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.282+0000 7f11e72f2700 1 --2- 172.21.15.6:0/3383732260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e00af4e0 0x7f11e00b20e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.282+0000 7f11e72f2700 1 --2- 172.21.15.6:0/3383732260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11e00af8b0 0x7f11e00b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:07.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.282+0000 7f11e72f2700 1 -- 172.21.15.6:0/3383732260 >> 172.21.15.6:0/3383732260 conn(0x7f11e0068680 msgr2=0x7f11e0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:07.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.282+0000 7f11e72f2700 1 -- 172.21.15.6:0/3383732260 shutdown_connections 2023-10-06T02:27:07.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.282+0000 7f11e72f2700 1 -- 172.21.15.6:0/3383732260 wait complete. 2023-10-06T02:27:07.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.283+0000 7f11e72f2700 1 Processor -- start 2023-10-06T02:27:07.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.283+0000 7f11e72f2700 1 -- start start 2023-10-06T02:27:07.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.284+0000 7f11e72f2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e00af4e0 0x7f11e00d0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:07.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.284+0000 7f11e72f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11e00af8b0 0x7f11e00c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:07.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.284+0000 7f11e72f2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11e015d460 0x7f11e01579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:07.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.284+0000 7f11e72f2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e00cf1d0 con 0x7f11e00af8b0 2023-10-06T02:27:07.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.284+0000 7f11e72f2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e00cf4b0 con 0x7f11e00af4e0 2023-10-06T02:27:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.284+0000 7f11e72f2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e00cf790 con 0x7f11e015d460 2023-10-06T02:27:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.284+0000 7f11e488d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11e00af8b0 0x7f11e00c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.284+0000 7f11e488d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11e00af8b0 0x7f11e00c6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52692/0 (socket says 172.21.15.6:52692) 2023-10-06T02:27:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.284+0000 7f11e488d700 1 -- 172.21.15.6:0/536421430 learned_addr learned my addr 172.21.15.6:0/536421430 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.285+0000 7f11e508e700 1 --2- 172.21.15.6:0/536421430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e00af4e0 0x7f11e00d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.285+0000 7f11e588f700 1 --2- 172.21.15.6:0/536421430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11e015d460 0x7f11e01579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.285+0000 7f11e488d700 1 -- 172.21.15.6:0/536421430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11e015d460 msgr2=0x7f11e01579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.285+0000 7f11e488d700 1 --2- 172.21.15.6:0/536421430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11e015d460 0x7f11e01579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.285+0000 7f11e488d700 1 -- 172.21.15.6:0/536421430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e00af4e0 msgr2=0x7f11e00d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.285+0000 7f11e488d700 1 --2- 172.21.15.6:0/536421430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e00af4e0 0x7f11e00d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.285+0000 7f11e488d700 1 -- 172.21.15.6:0/536421430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d4009420 con 0x7f11e00af8b0 2023-10-06T02:27:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.285+0000 7f11e488d700 1 --2- 172.21.15.6:0/536421430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11e00af8b0 0x7f11e00c6230 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f11d400ec80 tx=0x7f11d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.285+0000 7f11dd7fa700 1 -- 172.21.15.6:0/536421430 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d400c920 con 0x7f11e00af8b0 2023-10-06T02:27:07.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.285+0000 7f11dd7fa700 1 -- 172.21.15.6:0/536421430 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d400ca80 con 0x7f11e00af8b0 2023-10-06T02:27:07.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.285+0000 7f11e72f2700 1 -- 172.21.15.6:0/536421430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d80094f0 con 0x7f11e00af8b0 2023-10-06T02:27:07.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.285+0000 7f11dd7fa700 1 -- 172.21.15.6:0/536421430 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d400ce00 con 0x7f11e00af8b0 2023-10-06T02:27:07.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.285+0000 7f11e72f2700 1 -- 172.21.15.6:0/536421430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e00cfd50 con 0x7f11e00af8b0 2023-10-06T02:27:07.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.286+0000 7f11e72f2700 1 -- 172.21.15.6:0/536421430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e0088aa0 con 0x7f11e00af8b0 2023-10-06T02:27:07.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.287+0000 7f11dd7fa700 1 -- 172.21.15.6:0/536421430 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11d4013680 con 0x7f11e00af8b0 2023-10-06T02:27:07.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.287+0000 7f11dd7fa700 1 --2- 172.21.15.6:0/536421430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f11cc066f30 0x7f11cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:07.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.287+0000 7f11dd7fa700 1 -- 172.21.15.6:0/536421430 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7f11d4085170 con 0x7f11e00af8b0 2023-10-06T02:27:07.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.287+0000 7f11e508e700 1 --2- 172.21.15.6:0/536421430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f11cc066f30 0x7f11cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:07.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.288+0000 7f11e508e700 1 --2- 172.21.15.6:0/536421430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f11cc066f30 0x7f11cc0693e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f11d80099b0 tx=0x7f11d8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:07.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.292+0000 7f11dd7fa700 1 -- 172.21.15.6:0/536421430 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11d4051b30 con 0x7f11e00af8b0 2023-10-06T02:27:07.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.529+0000 7f11e72f2700 1 -- 172.21.15.6:0/536421430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11e00b0910 con 0x7f11e00af8b0 2023-10-06T02:27:07.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.530+0000 7f11dd7fa700 1 -- 172.21.15.6:0/536421430 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 210 v210) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f11d4055150 con 0x7f11e00af8b0 2023-10-06T02:27:07.530 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:07.530 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":210,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":210,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:03.958762+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9063":{"gid":9063,"name":"a","rank":0,"incarnation":207,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/2836519357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2836519357},{"type":"v1","addr":"172.21.15.6:6835","nonce":2836519357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:07.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.531+0000 7f11e72f2700 1 -- 172.21.15.6:0/536421430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f11cc066f30 msgr2=0x7f11cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:07.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.531+0000 7f11e72f2700 1 --2- 172.21.15.6:0/536421430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f11cc066f30 0x7f11cc0693e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f11d80099b0 tx=0x7f11d8017000 comp rx=0 tx=0).stop 2023-10-06T02:27:07.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.531+0000 7f11e72f2700 1 -- 172.21.15.6:0/536421430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11e00af8b0 msgr2=0x7f11e00c6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:07.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.531+0000 7f11e72f2700 1 --2- 172.21.15.6:0/536421430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11e00af8b0 0x7f11e00c6230 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f11d400ec80 tx=0x7f11d40091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:07.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.532+0000 7f11e72f2700 1 -- 172.21.15.6:0/536421430 shutdown_connections 2023-10-06T02:27:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.532+0000 7f11e72f2700 1 --2- 172.21.15.6:0/536421430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11e015d460 0x7f11e01579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.532+0000 7f11e72f2700 1 --2- 172.21.15.6:0/536421430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e00af4e0 0x7f11e00d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.532+0000 7f11e72f2700 1 --2- 172.21.15.6:0/536421430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f11cc066f30 0x7f11cc0693e0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.532+0000 7f11e72f2700 1 --2- 172.21.15.6:0/536421430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11e00af8b0 0x7f11e00c6230 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.532+0000 7f11e72f2700 1 -- 172.21.15.6:0/536421430 >> 172.21.15.6:0/536421430 conn(0x7f11e0068680 msgr2=0x7f11e015d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.532+0000 7f11e72f2700 1 -- 172.21.15.6:0/536421430 shutdown_connections 2023-10-06T02:27:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:07.532+0000 7f11e72f2700 1 -- 172.21.15.6:0/536421430 wait complete. 2023-10-06T02:27:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 210 2023-10-06T02:27:07.947 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:08.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.069+0000 7fcd0a6d7700 1 Processor -- start 2023-10-06T02:27:08.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.069+0000 7fcd0a6d7700 1 -- start start 2023-10-06T02:27:08.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.070+0000 7fcd0a6d7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcd040af8b0 0x7fcd0415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.070+0000 7fcd0a6d7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd0415e190 con 0x7fcd040af4e0 2023-10-06T02:27:08.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.070+0000 7fcd0a6d7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd040cb650 con 0x7fcd040b27f0 2023-10-06T02:27:08.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.070+0000 7fcd0a6d7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd040b1910 con 0x7fcd040af8b0 2023-10-06T02:27:08.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.070+0000 7fcd03fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcd040af4e0 0x7fcd040b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45588/0 (socket says 172.21.15.6:45588) 2023-10-06T02:27:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.070+0000 7fcd03fff700 1 -- 172.21.15.6:0/1094294702 learned_addr learned my addr 172.21.15.6:0/1094294702 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd037fe700 1 --2- 172.21.15.6:0/1094294702 >> v2:172.21.15.175:3300/0 conn(0x7fcd040af8b0 0x7fcd0415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd02ffd700 1 -- 172.21.15.6:0/1094294702 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334372618 0 0) 0x7fcd0415e190 con 0x7fcd040af4e0 2023-10-06T02:27:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd02ffd700 1 -- 172.21.15.6:0/1094294702 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccec003570 con 0x7fcd040af4e0 2023-10-06T02:27:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd02ffd700 1 -- 172.21.15.6:0/1094294702 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3434877873 0 0) 0x7fccec003570 con 0x7fcd040af4e0 2023-10-06T02:27:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd02ffd700 1 -- 172.21.15.6:0/1094294702 >> v2:172.21.15.175:3300/0 conn(0x7fcd040af8b0 msgr2=0x7fcd0415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd02ffd700 1 --2- 172.21.15.6:0/1094294702 >> v2:172.21.15.175:3300/0 conn(0x7fcd040af8b0 0x7fcd0415d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd02ffd700 1 -- 172.21.15.6:0/1094294702 >> v1:172.21.15.175:6789/0 conn(0x7fcd040b27f0 legacy=0x7fcd0415d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd02ffd700 1 -- 172.21.15.6:0/1094294702 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd040ccaf0 con 0x7fcd040af4e0 2023-10-06T02:27:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd02ffd700 1 -- 172.21.15.6:0/1094294702 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fccf4001470 con 0x7fcd040af4e0 2023-10-06T02:27:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd02ffd700 1 -- 172.21.15.6:0/1094294702 >> v1:172.21.15.6:6789/0 conn(0x7fcd040af4e0 legacy=0x7fcd040b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd02ffd700 1 --2- 172.21.15.6:0/1094294702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccec003a60 0x7fccec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd02ffd700 1 --2- 172.21.15.6:0/1094294702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccec004810 0x7fccec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd02ffd700 1 --2- 172.21.15.6:0/1094294702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccec0051c0 0x7fccec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd02ffd700 1 -- 172.21.15.6:0/1094294702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd040b1910 con 0x7fccec0051c0 2023-10-06T02:27:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd02ffd700 1 -- 172.21.15.6:0/1094294702 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec00c160 con 0x7fccec003a60 2023-10-06T02:27:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd02ffd700 1 -- 172.21.15.6:0/1094294702 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec00c320 con 0x7fccec004810 2023-10-06T02:27:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd08c74700 1 --2- 172.21.15.6:0/1094294702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccec0051c0 0x7fccec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd03fff700 1 --2- 172.21.15.6:0/1094294702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccec003a60 0x7fccec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.071+0000 7fcd037fe700 1 --2- 172.21.15.6:0/1094294702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccec004810 0x7fccec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.072+0000 7fcd08c74700 1 -- 172.21.15.6:0/1094294702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccec004810 msgr2=0x7fccec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.072+0000 7fcd08c74700 1 --2- 172.21.15.6:0/1094294702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccec004810 0x7fccec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.072+0000 7fcd08c74700 1 -- 172.21.15.6:0/1094294702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccec003a60 msgr2=0x7fccec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.072+0000 7fcd08c74700 1 --2- 172.21.15.6:0/1094294702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccec003a60 0x7fccec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.072+0000 7fcd08c74700 1 -- 172.21.15.6:0/1094294702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec003570 con 0x7fccec0051c0 2023-10-06T02:27:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.072+0000 7fcd03fff700 1 --2- 172.21.15.6:0/1094294702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccec003a60 0x7fccec003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.072+0000 7fcd08c74700 1 -- 172.21.15.6:0/1094294702 reap_dead start 2023-10-06T02:27:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.072+0000 7fcd08c74700 1 --2- 172.21.15.6:0/1094294702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccec0051c0 0x7fccec00ba60 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fccfc001fc0 tx=0x7fccfc001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd6d61dfbaca379 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.072+0000 7fcd02ffd700 1 -- 172.21.15.6:0/1094294702 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc001950 con 0x7fccec0051c0 2023-10-06T02:27:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.072+0000 7fcd02ffd700 1 -- 172.21.15.6:0/1094294702 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc00c8b0 con 0x7fccec0051c0 2023-10-06T02:27:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.072+0000 7fcd02ffd700 1 -- 172.21.15.6:0/1094294702 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00cc50 con 0x7fccec0051c0 2023-10-06T02:27:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.072+0000 7fcd0a6d7700 1 -- 172.21.15.6:0/1094294702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccec0051c0 msgr2=0x7fccec00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.072+0000 7fcd0a6d7700 1 --2- 172.21.15.6:0/1094294702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccec0051c0 0x7fccec00ba60 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fccfc001fc0 tx=0x7fccfc001640 comp rx=0 tx=0).stop 2023-10-06T02:27:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.072+0000 7fcd0a6d7700 1 -- 172.21.15.6:0/1094294702 shutdown_connections 2023-10-06T02:27:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.073+0000 7fcd0a6d7700 1 --2- 172.21.15.6:0/1094294702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccec0051c0 0x7fccec00ba60 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.073+0000 7fcd0a6d7700 1 -- 172.21.15.6:0/1094294702 >> 172.21.15.6:0/1094294702 conn(0x7fcd04068680 msgr2=0x7fcd04068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.073+0000 7fcd0a6d7700 1 -- 172.21.15.6:0/1094294702 shutdown_connections 2023-10-06T02:27:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.073+0000 7fcd0a6d7700 1 -- 172.21.15.6:0/1094294702 wait complete. 2023-10-06T02:27:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.074+0000 7fcd0a6d7700 1 Processor -- start 2023-10-06T02:27:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.074+0000 7fcd0a6d7700 1 -- start start 2023-10-06T02:27:08.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd0a6d7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccec0051c0 0x7fcd04158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd0a6d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd04154100 0x7fcd04154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd0a6d7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd0415b4f0 0x7fcd0415b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd0a6d7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0415beb0 con 0x7fcd04154100 2023-10-06T02:27:08.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd0a6d7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0416acf0 con 0x7fccec0051c0 2023-10-06T02:27:08.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd0a6d7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd04157750 con 0x7fcd0415b4f0 2023-10-06T02:27:08.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd04154100 0x7fcd04154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd04154100 0x7fcd04154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52698/0 (socket says 172.21.15.6:52698) 2023-10-06T02:27:08.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd037fe700 1 -- 172.21.15.6:0/697877755 learned_addr learned my addr 172.21.15.6:0/697877755 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:08.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd08c74700 1 --2- 172.21.15.6:0/697877755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd0415b4f0 0x7fcd0415b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd03fff700 1 --2- 172.21.15.6:0/697877755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccec0051c0 0x7fcd04158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd037fe700 1 -- 172.21.15.6:0/697877755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd0415b4f0 msgr2=0x7fcd0415b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd037fe700 1 --2- 172.21.15.6:0/697877755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd0415b4f0 0x7fcd0415b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd037fe700 1 -- 172.21.15.6:0/697877755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccec0051c0 msgr2=0x7fcd04158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd037fe700 1 --2- 172.21.15.6:0/697877755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccec0051c0 0x7fcd04158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd037fe700 1 -- 172.21.15.6:0/697877755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd04157a30 con 0x7fcd04154100 2023-10-06T02:27:08.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd03fff700 1 --2- 172.21.15.6:0/697877755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccec0051c0 0x7fcd04158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd037fe700 1 --2- 172.21.15.6:0/697877755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd04154100 0x7fcd04154570 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fccf8011ac0 tx=0x7fccf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fccebfff700 1 -- 172.21.15.6:0/697877755 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf800f940 con 0x7fcd04154100 2023-10-06T02:27:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fccebfff700 1 -- 172.21.15.6:0/697877755 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf800faa0 con 0x7fcd04154100 2023-10-06T02:27:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd0a6d7700 1 -- 172.21.15.6:0/697877755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd04157d10 con 0x7fcd04154100 2023-10-06T02:27:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fccebfff700 1 -- 172.21.15.6:0/697877755 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf800fe20 con 0x7fcd04154100 2023-10-06T02:27:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.075+0000 7fcd0a6d7700 1 -- 172.21.15.6:0/697877755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd04158770 con 0x7fcd04154100 2023-10-06T02:27:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.076+0000 7fcd0a6d7700 1 -- 172.21.15.6:0/697877755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd041575c0 con 0x7fcd04154100 2023-10-06T02:27:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.077+0000 7fccebfff700 1 -- 172.21.15.6:0/697877755 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fccf801d690 con 0x7fcd04154100 2023-10-06T02:27:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.077+0000 7fccebfff700 1 --2- 172.21.15.6:0/697877755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fccf0066f30 0x7fccf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.077+0000 7fccebfff700 1 -- 172.21.15.6:0/697877755 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7fccf8018070 con 0x7fcd04154100 2023-10-06T02:27:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.077+0000 7fcd03fff700 1 --2- 172.21.15.6:0/697877755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fccf0066f30 0x7fccf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.078+0000 7fcd03fff700 1 --2- 172.21.15.6:0/697877755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fccf0066f30 0x7fccf00693e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fccf4007cd0 tx=0x7fccf4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:08.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.081+0000 7fccebfff700 1 -- 172.21.15.6:0/697877755 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fccf80524f0 con 0x7fcd04154100 2023-10-06T02:27:08.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.319+0000 7fcd0a6d7700 1 -- 172.21.15.6:0/697877755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd040cad20 con 0x7fcd04154100 2023-10-06T02:27:08.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.320+0000 7fccebfff700 1 -- 172.21.15.6:0/697877755 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 210 v210) v1 ==== 95+0+4604 (secure 0 0 0) 0x7fccf8055b10 con 0x7fcd04154100 2023-10-06T02:27:08.321 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:08.321 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":210,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":210,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:03.958762+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9063":{"gid":9063,"name":"a","rank":0,"incarnation":207,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/2836519357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2836519357},{"type":"v1","addr":"172.21.15.6:6835","nonce":2836519357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:08.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.322+0000 7fcd0a6d7700 1 -- 172.21.15.6:0/697877755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fccf0066f30 msgr2=0x7fccf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.322+0000 7fcd0a6d7700 1 --2- 172.21.15.6:0/697877755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fccf0066f30 0x7fccf00693e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fccf4007cd0 tx=0x7fccf4009040 comp rx=0 tx=0).stop 2023-10-06T02:27:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.322+0000 7fcd0a6d7700 1 -- 172.21.15.6:0/697877755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd04154100 msgr2=0x7fcd04154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.322+0000 7fcd0a6d7700 1 --2- 172.21.15.6:0/697877755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd04154100 0x7fcd04154570 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fccf8011ac0 tx=0x7fccf80091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.322+0000 7fcd0a6d7700 1 -- 172.21.15.6:0/697877755 shutdown_connections 2023-10-06T02:27:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.322+0000 7fcd0a6d7700 1 --2- 172.21.15.6:0/697877755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd0415b4f0 0x7fcd0415b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.322+0000 7fcd0a6d7700 1 --2- 172.21.15.6:0/697877755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccec0051c0 0x7fcd04158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.322+0000 7fcd0a6d7700 1 --2- 172.21.15.6:0/697877755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fccf0066f30 0x7fccf00693e0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.322+0000 7fcd0a6d7700 1 --2- 172.21.15.6:0/697877755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd04154100 0x7fcd04154570 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.322+0000 7fcd0a6d7700 1 -- 172.21.15.6:0/697877755 >> 172.21.15.6:0/697877755 conn(0x7fcd04068680 msgr2=0x7fcd040b5200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.322+0000 7fcd0a6d7700 1 -- 172.21.15.6:0/697877755 shutdown_connections 2023-10-06T02:27:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.322+0000 7fcd0a6d7700 1 -- 172.21.15.6:0/697877755 wait complete. 2023-10-06T02:27:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 210 2023-10-06T02:27:08.334 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 210, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:27:03.958762+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 113, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9063}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9063': {'gid': 9063, 'name': 'a', 'rank': 0, 'incarnation': 207, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.6:6835/2836519357', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 2836519357}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 2836519357}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:27:08.334 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:27:08.335 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:27:08.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.453+0000 7f60fa10e700 1 Processor -- start 2023-10-06T02:27:08.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.453+0000 7f60fa10e700 1 -- start start 2023-10-06T02:27:08.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.454+0000 7f60fa10e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60f40ccd40 0x7f60f40cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.454+0000 7f60fa10e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f60f40cf7e0 0x7f60f40b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.454+0000 7f60fa10e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f415dd40 con 0x7f60f40d0400 2023-10-06T02:27:08.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.454+0000 7f60fa10e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f415e020 con 0x7f60f40cf7e0 2023-10-06T02:27:08.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.454+0000 7f60fa10e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40ceaa0 con 0x7f60f40ccd40 2023-10-06T02:27:08.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.454+0000 7f60f37fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f60f40d0400 0x7f60f40b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45598/0 (socket says 172.21.15.6:45598) 2023-10-06T02:27:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.454+0000 7f60f37fe700 1 -- 172.21.15.6:0/898018263 learned_addr learned my addr 172.21.15.6:0/898018263 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.455+0000 7f60f2ffd700 1 --2- 172.21.15.6:0/898018263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60f40ccd40 0x7f60f40cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.455+0000 7f60f3fff700 1 --2- 172.21.15.6:0/898018263 >> v2:172.21.15.175:3300/0 conn(0x7f60f40cf7e0 0x7f60f40b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.455+0000 7f60f27fc700 1 -- 172.21.15.6:0/898018263 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709128496 0 0) 0x7f60f415dd40 con 0x7f60f40d0400 2023-10-06T02:27:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.455+0000 7f60f27fc700 1 -- 172.21.15.6:0/898018263 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60dc003570 con 0x7f60f40d0400 2023-10-06T02:27:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.455+0000 7f60f3fff700 1 -- 172.21.15.6:0/898018263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60f40ccd40 msgr2=0x7f60f40cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.455+0000 7f60f3fff700 1 --2- 172.21.15.6:0/898018263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60f40ccd40 0x7f60f40cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.455+0000 7f60f3fff700 1 -- 172.21.15.6:0/898018263 >> v1:172.21.15.6:6789/0 conn(0x7f60f40d0400 legacy=0x7f60f40b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.455+0000 7f60f3fff700 1 -- 172.21.15.6:0/898018263 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f40ced80 con 0x7f60f40cf7e0 2023-10-06T02:27:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.455+0000 7f60f2ffd700 1 --2- 172.21.15.6:0/898018263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60f40ccd40 0x7f60f40cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.455+0000 7f60f3fff700 1 --2- 172.21.15.6:0/898018263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60f40cf7e0 0x7f60f40b3aa0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009e60 tx=0x7f60ec009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca001c61f291ba05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.455+0000 7f60f27fc700 1 -- 172.21.15.6:0/898018263 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec00e070 con 0x7f60f40cf7e0 2023-10-06T02:27:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.455+0000 7f60f27fc700 1 -- 172.21.15.6:0/898018263 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec00bab0 con 0x7f60f40cf7e0 2023-10-06T02:27:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.455+0000 7f60f27fc700 1 -- 172.21.15.6:0/898018263 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec00be70 con 0x7f60f40cf7e0 2023-10-06T02:27:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.456+0000 7f60fa10e700 1 -- 172.21.15.6:0/898018263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60f40cf7e0 msgr2=0x7f60f40b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.456+0000 7f60fa10e700 1 --2- 172.21.15.6:0/898018263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60f40cf7e0 0x7f60f40b3aa0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009e60 tx=0x7f60ec009780 comp rx=0 tx=0).stop 2023-10-06T02:27:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.456+0000 7f60fa10e700 1 -- 172.21.15.6:0/898018263 shutdown_connections 2023-10-06T02:27:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.456+0000 7f60fa10e700 1 --2- 172.21.15.6:0/898018263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60f40cf7e0 0x7f60f40b3aa0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.456+0000 7f60fa10e700 1 --2- 172.21.15.6:0/898018263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60f40ccd40 0x7f60f40cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.456+0000 7f60fa10e700 1 -- 172.21.15.6:0/898018263 >> 172.21.15.6:0/898018263 conn(0x7f60f406a220 msgr2=0x7f60f406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:08.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.456+0000 7f60fa10e700 1 -- 172.21.15.6:0/898018263 shutdown_connections 2023-10-06T02:27:08.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.456+0000 7f60fa10e700 1 -- 172.21.15.6:0/898018263 wait complete. 2023-10-06T02:27:08.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.457+0000 7f60fa10e700 1 Processor -- start 2023-10-06T02:27:08.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.457+0000 7f60fa10e700 1 -- start start 2023-10-06T02:27:08.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.458+0000 7f60fa10e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60f40ccd40 0x7f60f4155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.458+0000 7f60fa10e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60f40cf7e0 0x7f60f416cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.458+0000 7f60fa10e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60f40d0400 0x7f60f40c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.458+0000 7f60fa10e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f415b3a0 con 0x7f60f40ccd40 2023-10-06T02:27:08.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.458+0000 7f60fa10e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4155a50 con 0x7f60f40cf7e0 2023-10-06T02:27:08.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.458+0000 7f60fa10e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f416d360 con 0x7f60f40d0400 2023-10-06T02:27:08.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.458+0000 7f60f37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60f40ccd40 0x7f60f4155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.458+0000 7f60f37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60f40ccd40 0x7f60f4155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52714/0 (socket says 172.21.15.6:52714) 2023-10-06T02:27:08.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.458+0000 7f60f37fe700 1 -- 172.21.15.6:0/4139449530 learned_addr learned my addr 172.21.15.6:0/4139449530 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:08.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.458+0000 7f60f2ffd700 1 --2- 172.21.15.6:0/4139449530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60f40cf7e0 0x7f60f416cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.458+0000 7f60f3fff700 1 --2- 172.21.15.6:0/4139449530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60f40d0400 0x7f60f40c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.458+0000 7f60f37fe700 1 -- 172.21.15.6:0/4139449530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60f40d0400 msgr2=0x7f60f40c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.458+0000 7f60f37fe700 1 --2- 172.21.15.6:0/4139449530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60f40d0400 0x7f60f40c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.458+0000 7f60f37fe700 1 -- 172.21.15.6:0/4139449530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60f40cf7e0 msgr2=0x7f60f416cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.458+0000 7f60f37fe700 1 --2- 172.21.15.6:0/4139449530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60f40cf7e0 0x7f60f416cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.458+0000 7f60f37fe700 1 -- 172.21.15.6:0/4139449530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e8009420 con 0x7f60f40ccd40 2023-10-06T02:27:08.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.458+0000 7f60f37fe700 1 --2- 172.21.15.6:0/4139449530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60f40ccd40 0x7f60f4155510 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f60e400c790 tx=0x7f60e4007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:08.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.459+0000 7f60db7fe700 1 -- 172.21.15.6:0/4139449530 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e40072e0 con 0x7f60f40ccd40 2023-10-06T02:27:08.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.459+0000 7f60db7fe700 1 -- 172.21.15.6:0/4139449530 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e4007440 con 0x7f60f40ccd40 2023-10-06T02:27:08.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.459+0000 7f60fa10e700 1 -- 172.21.15.6:0/4139449530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ec009a20 con 0x7f60f40ccd40 2023-10-06T02:27:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.459+0000 7f60db7fe700 1 -- 172.21.15.6:0/4139449530 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e40057f0 con 0x7f60f40ccd40 2023-10-06T02:27:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.459+0000 7f60fa10e700 1 -- 172.21.15.6:0/4139449530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f415b030 con 0x7f60f40ccd40 2023-10-06T02:27:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.460+0000 7f60db7fe700 1 -- 172.21.15.6:0/4139449530 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60e4005be0 con 0x7f60f40ccd40 2023-10-06T02:27:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.461+0000 7f60db7fe700 1 --2- 172.21.15.6:0/4139449530 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60e0066f30 0x7f60e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.461+0000 7f60db7fe700 1 -- 172.21.15.6:0/4139449530 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7f60e40840b0 con 0x7f60f40ccd40 2023-10-06T02:27:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.461+0000 7f60f2ffd700 1 --2- 172.21.15.6:0/4139449530 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60e0066f30 0x7f60e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.461+0000 7f60f2ffd700 1 --2- 172.21.15.6:0/4139449530 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60e0066f30 0x7f60e00693e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f60f4157470 tx=0x7f60e80091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.462+0000 7f6103406b80 1 Processor -- start 2023-10-06T02:27:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.463+0000 7f6103406b80 1 -- start start 2023-10-06T02:27:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.463+0000 7f6103406b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d20d840 0x560a4d20dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.463+0000 7f6103406b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20ecc0 0x560a4d25d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.463+0000 7f6103406b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d25dc00 0x560a4d25e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.463+0000 7f6103406b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4d164a70 con 0x560a4d20ecc0 2023-10-06T02:27:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.463+0000 7f6103406b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4d162270 con 0x560a4d25dc00 2023-10-06T02:27:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.463+0000 7f6103406b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a4d15e060 con 0x560a4d20d840 2023-10-06T02:27:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.464+0000 7f60f2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20ecc0 0x560a4d25d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.464+0000 7f60f2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20ecc0 0x560a4d25d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52718/0 (socket says 172.21.15.6:52718) 2023-10-06T02:27:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.464+0000 7f60f2ffd700 1 -- 172.21.15.6:0/4048740447 learned_addr learned my addr 172.21.15.6:0/4048740447 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.464+0000 7f60f3fff700 1 --2- 172.21.15.6:0/4048740447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d25dc00 0x560a4d25e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.464+0000 7f60f37fe700 1 --2- 172.21.15.6:0/4048740447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d20d840 0x560a4d20dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.464+0000 7f60f2ffd700 1 -- 172.21.15.6:0/4048740447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d20d840 msgr2=0x560a4d20dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.464+0000 7f60f2ffd700 1 --2- 172.21.15.6:0/4048740447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d20d840 0x560a4d20dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.464+0000 7f60f2ffd700 1 -- 172.21.15.6:0/4048740447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d25dc00 msgr2=0x560a4d25e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.464+0000 7f60f2ffd700 1 --2- 172.21.15.6:0/4048740447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d25dc00 0x560a4d25e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.464+0000 7f60f2ffd700 1 -- 172.21.15.6:0/4048740447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a4cff8270 con 0x560a4d20ecc0 2023-10-06T02:27:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.464+0000 7f60f3fff700 1 --2- 172.21.15.6:0/4048740447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d25dc00 0x560a4d25e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.464+0000 7f60f37fe700 1 --2- 172.21.15.6:0/4048740447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d20d840 0x560a4d20dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.464+0000 7f60f2ffd700 1 --2- 172.21.15.6:0/4048740447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20ecc0 0x560a4d25d6c0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f60e8011fd0 tx=0x7f60e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31efc7bd22862a27 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.464+0000 7f60d8ff9700 1 -- 172.21.15.6:0/4048740447 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e8021420 con 0x560a4d20ecc0 2023-10-06T02:27:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.464+0000 7f60d8ff9700 1 -- 172.21.15.6:0/4048740447 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e8021580 con 0x560a4d20ecc0 2023-10-06T02:27:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.464+0000 7f60d8ff9700 1 -- 172.21.15.6:0/4048740447 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e8021900 con 0x560a4d20ecc0 2023-10-06T02:27:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.465+0000 7f6103406b80 1 -- 172.21.15.6:0/4048740447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20ecc0 msgr2=0x560a4d25d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.465+0000 7f6103406b80 1 --2- 172.21.15.6:0/4048740447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20ecc0 0x560a4d25d6c0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f60e8011fd0 tx=0x7f60e8016000 comp rx=0 tx=0).stop 2023-10-06T02:27:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.465+0000 7f6103406b80 1 -- 172.21.15.6:0/4048740447 shutdown_connections 2023-10-06T02:27:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.465+0000 7f6103406b80 1 --2- 172.21.15.6:0/4048740447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d25dc00 0x560a4d25e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.465+0000 7f6103406b80 1 --2- 172.21.15.6:0/4048740447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d20d840 0x560a4d20dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.465+0000 7f6103406b80 1 --2- 172.21.15.6:0/4048740447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20ecc0 0x560a4d25d6c0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.465+0000 7f6103406b80 1 -- 172.21.15.6:0/4048740447 >> 172.21.15.6:0/4048740447 conn(0x560a4d20f160 msgr2=0x560a4d20f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:08.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.465+0000 7f6103406b80 1 -- 172.21.15.6:0/4048740447 shutdown_connections 2023-10-06T02:27:08.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.465+0000 7f6103406b80 1 -- 172.21.15.6:0/4048740447 wait complete. 2023-10-06T02:27:08.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.465+0000 7f6103406b80 1 -- start start 2023-10-06T02:27:08.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.466+0000 7f6103406b80 1 Processor -- start 2023-10-06T02:27:08.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.466+0000 7f6103406b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d20d840 0x560a4d2650f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.466+0000 7f6103406b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d20ecc0 0x560a4d267520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.466+0000 7f6103406b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d25dc00 0x560a4d239350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.466+0000 7f6103406b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4d109890 con 0x560a4d25dc00 2023-10-06T02:27:08.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.466+0000 7f6103406b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4d124ea0 con 0x560a4d20d840 2023-10-06T02:27:08.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.466+0000 7f6103406b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a4cfe0e30 con 0x560a4d20ecc0 2023-10-06T02:27:08.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.466+0000 7f6103406b80 10 client.0 _ll_register_callbacks cb 0x560a4d1d0e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:27:08.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.466+0000 7f60f3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d25dc00 0x560a4d239350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.466+0000 7f60f3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d25dc00 0x560a4d239350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52722/0 (socket says 172.21.15.6:52722) 2023-10-06T02:27:08.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f60f3fff700 1 -- 172.21.15.6:0/1968483614 learned_addr learned my addr 172.21.15.6:0/1968483614 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:08.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f60f37fe700 1 --2- 172.21.15.6:0/1968483614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d20d840 0x560a4d2650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f60f2ffd700 1 --2- 172.21.15.6:0/1968483614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d20ecc0 0x560a4d267520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f60f3fff700 1 -- 172.21.15.6:0/1968483614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d20ecc0 msgr2=0x560a4d267520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:08.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f60f3fff700 1 --2- 172.21.15.6:0/1968483614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d20ecc0 0x560a4d267520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f60f3fff700 1 -- 172.21.15.6:0/1968483614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d20d840 msgr2=0x560a4d2650f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f60f3fff700 1 --2- 172.21.15.6:0/1968483614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d20d840 0x560a4d2650f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f60f3fff700 1 -- 172.21.15.6:0/1968483614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e8011c50 con 0x560a4d25dc00 2023-10-06T02:27:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f60f3fff700 1 --2- 172.21.15.6:0/1968483614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d25dc00 0x560a4d239350 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f60ec012a10 tx=0x7f60ec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763fb8d94a047ce9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f60d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:27:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f60d1ffb700 1 -- 172.21.15.6:0/1968483614 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec023070 con 0x560a4d25dc00 2023-10-06T02:27:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f60d1ffb700 1 -- 172.21.15.6:0/1968483614 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7f60ec012e00 con 0x560a4d25dc00 2023-10-06T02:27:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f6103406b80 1 -- 172.21.15.6:0/1968483614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a4d202940 con 0x560a4d25dc00 2023-10-06T02:27:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f60d1ffb700 1 -- 172.21.15.6:0/1968483614 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=210) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60ec01e630 con 0x560a4d25dc00 2023-10-06T02:27:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f6103406b80 10 client.9162 fetch_fsmap learned FSMap version 210 2023-10-06T02:27:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f6103406b80 1 -- 172.21.15.6:0/1968483614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=210,monmap=2+}) v3 -- 0x560a4cf9afe0 con 0x560a4d25dc00 2023-10-06T02:27:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f60d1ffb700 1 -- 172.21.15.6:0/1968483614 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560a4d202940 con 0x560a4d25dc00 2023-10-06T02:27:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.467+0000 7f60d1ffb700 1 -- 172.21.15.6:0/1968483614 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 210) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f60ec01e790 con 0x560a4d25dc00 2023-10-06T02:27:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.468+0000 7f6103406b80 10 client.9162 fetch_fsmap finished waiting for FSMap version 210 2023-10-06T02:27:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.468+0000 7f6103406b80 10 client.9162 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:27:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.468+0000 7f6103406b80 20 client.9162 populate_metadata read hostname 'smithi006' 2023-10-06T02:27:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.468+0000 7f6103406b80 1 --2- 172.21.15.6:0/1968483614 >> [v2:172.21.15.6:6833/2836519357,v1:172.21.15.6:6835/2836519357] conn(0x560a4d208b10 0x560a4d208ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.468+0000 7f6103406b80 4 client.9162 mds_command: new command op to 9063 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:27:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.468+0000 7f6103406b80 1 -- 172.21.15.6:0/1968483614 --> [v2:172.21.15.6:6833/2836519357,v1:172.21.15.6:6835/2836519357] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a4d1df870 con 0x560a4d208b10 2023-10-06T02:27:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.468+0000 7f60f37fe700 1 --2- 172.21.15.6:0/1968483614 >> [v2:172.21.15.6:6833/2836519357,v1:172.21.15.6:6835/2836519357] conn(0x560a4d208b10 0x560a4d208ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.468+0000 7f60d1ffb700 10 client.9162 ms_handle_connect on v2:172.21.15.6:6833/2836519357 2023-10-06T02:27:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.468+0000 7f60f37fe700 1 --2- 172.21.15.6:0/1968483614 >> [v2:172.21.15.6:6833/2836519357,v1:172.21.15.6:6835/2836519357] conn(0x560a4d208b10 0x560a4d208ee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f63e32bd01f5305a server_cookie=c43ed0ca5f03122d in_seq=0 out_seq=0 2023-10-06T02:27:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.468+0000 7f60d1ffb700 1 -- 172.21.15.6:0/1968483614 <== mds.0 v2:172.21.15.6:6833/2836519357 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560a4d1df870 con 0x560a4d208b10 2023-10-06T02:27:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.468+0000 7f60d1ffb700 10 client.9162 handle_command_reply: tid=0 2023-10-06T02:27:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.469+0000 7f6103406b80 1 client.9162 shutdown 2023-10-06T02:27:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.469+0000 7f6103406b80 1 -- 172.21.15.6:0/1968483614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d25dc00 msgr2=0x560a4d239350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.469+0000 7f6103406b80 1 --2- 172.21.15.6:0/1968483614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d25dc00 0x560a4d239350 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f60ec012a10 tx=0x7f60ec019000 comp rx=0 tx=0).stop 2023-10-06T02:27:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.469+0000 7f6103406b80 1 -- 172.21.15.6:0/1968483614 shutdown_connections 2023-10-06T02:27:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.469+0000 7f6103406b80 1 --2- 172.21.15.6:0/1968483614 >> [v2:172.21.15.6:6833/2836519357,v1:172.21.15.6:6835/2836519357] conn(0x560a4d208b10 0x560a4d208ee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.469+0000 7f6103406b80 1 --2- 172.21.15.6:0/1968483614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d25dc00 0x560a4d239350 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.469+0000 7f6103406b80 1 --2- 172.21.15.6:0/1968483614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d20d840 0x560a4d2650f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.469+0000 7f60d1ffb700 0 client.9162 ms_handle_reset on v2:172.21.15.6:6833/2836519357 2023-10-06T02:27:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.469+0000 7f6103406b80 1 --2- 172.21.15.6:0/1968483614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d20ecc0 0x560a4d267520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.469+0000 7f6103406b80 1 -- 172.21.15.6:0/1968483614 >> 172.21.15.6:0/1968483614 conn(0x560a4d20f160 msgr2=0x560a4d20e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.469+0000 7f6103406b80 1 -- 172.21.15.6:0/1968483614 shutdown_connections 2023-10-06T02:27:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.469+0000 7f6103406b80 1 -- 172.21.15.6:0/1968483614 wait complete. 2023-10-06T02:27:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.469+0000 7f6103406b80 20 client.9162 trim_cache size 0 max 16384 2023-10-06T02:27:08.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.486+0000 7f6103406b80 1 Processor -- start 2023-10-06T02:27:08.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.486+0000 7f6103406b80 1 -- start start 2023-10-06T02:27:08.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.486+0000 7f6103406b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20d840 0x560a4d239330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.486+0000 7f6103406b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d20ecc0 0x560a4d25d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.486+0000 7f6103406b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d25dc00 0x560a4d266b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.486+0000 7f6103406b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4d256e10 con 0x560a4d20d840 2023-10-06T02:27:08.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.486+0000 7f6103406b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4d236200 con 0x560a4d20ecc0 2023-10-06T02:27:08.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.486+0000 7f6103406b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a4d238290 con 0x560a4d25dc00 2023-10-06T02:27:08.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.486+0000 7f60f37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20d840 0x560a4d239330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.487+0000 7f60f37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20d840 0x560a4d239330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52736/0 (socket says 172.21.15.6:52736) 2023-10-06T02:27:08.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.487+0000 7f60f37fe700 1 -- 172.21.15.6:0/220924883 learned_addr learned my addr 172.21.15.6:0/220924883 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:08.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.487+0000 7f60f37fe700 1 -- 172.21.15.6:0/220924883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d25dc00 msgr2=0x560a4d266b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:08.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.487+0000 7f60f37fe700 1 --2- 172.21.15.6:0/220924883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d25dc00 0x560a4d266b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.487+0000 7f60f37fe700 1 -- 172.21.15.6:0/220924883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d20ecc0 msgr2=0x560a4d25d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:08.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.487+0000 7f60f37fe700 1 --2- 172.21.15.6:0/220924883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d20ecc0 0x560a4d25d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.487+0000 7f60f37fe700 1 -- 172.21.15.6:0/220924883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a4d12c780 con 0x560a4d20d840 2023-10-06T02:27:08.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.487+0000 7f60f37fe700 1 --2- 172.21.15.6:0/220924883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20d840 0x560a4d239330 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f60e40544e0 tx=0x7f60e4050c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844b13d7a8dd5609 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:08.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.487+0000 7f60d97fa700 1 -- 172.21.15.6:0/220924883 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4081e30 con 0x560a4d20d840 2023-10-06T02:27:08.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.487+0000 7f60d97fa700 1 -- 172.21.15.6:0/220924883 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e4083040 con 0x560a4d20d840 2023-10-06T02:27:08.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.487+0000 7f60d97fa700 1 -- 172.21.15.6:0/220924883 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e40702c0 con 0x560a4d20d840 2023-10-06T02:27:08.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.488+0000 7f6103406b80 1 -- 172.21.15.6:0/220924883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20d840 msgr2=0x560a4d239330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.488+0000 7f6103406b80 1 --2- 172.21.15.6:0/220924883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20d840 0x560a4d239330 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f60e40544e0 tx=0x7f60e4050c50 comp rx=0 tx=0).stop 2023-10-06T02:27:08.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.488+0000 7f6103406b80 1 -- 172.21.15.6:0/220924883 shutdown_connections 2023-10-06T02:27:08.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.488+0000 7f6103406b80 1 --2- 172.21.15.6:0/220924883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d25dc00 0x560a4d266b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.488+0000 7f6103406b80 1 --2- 172.21.15.6:0/220924883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20d840 0x560a4d239330 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.488+0000 7f6103406b80 1 --2- 172.21.15.6:0/220924883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d20ecc0 0x560a4d25d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.488+0000 7f6103406b80 1 -- 172.21.15.6:0/220924883 >> 172.21.15.6:0/220924883 conn(0x560a4d20f160 msgr2=0x560a4d206280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:08.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.488+0000 7f6103406b80 1 -- 172.21.15.6:0/220924883 shutdown_connections 2023-10-06T02:27:08.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.488+0000 7f6103406b80 1 -- 172.21.15.6:0/220924883 wait complete. 2023-10-06T02:27:08.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.488+0000 7f6103406b80 1 -- start start 2023-10-06T02:27:08.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.488+0000 7f6103406b80 1 Processor -- start 2023-10-06T02:27:08.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.489+0000 7f6103406b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d20d840 0x560a4d2553e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.489+0000 7f6103406b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20ecc0 0x560a4d255920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.489+0000 7f6103406b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d25dc00 0x560a4d262630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.489+0000 7f6103406b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4d265390 con 0x560a4d20ecc0 2023-10-06T02:27:08.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.489+0000 7f6103406b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4d2635f0 con 0x560a4d20d840 2023-10-06T02:27:08.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.489+0000 7f6103406b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a4d235ca0 con 0x560a4d25dc00 2023-10-06T02:27:08.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.489+0000 7f6103406b80 10 client.0 _ll_register_callbacks cb 0x560a4d1d0e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:27:08.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.489+0000 7f60f2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20ecc0 0x560a4d255920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.489+0000 7f60f2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20ecc0 0x560a4d255920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52740/0 (socket says 172.21.15.6:52740) 2023-10-06T02:27:08.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.489+0000 7f60f2ffd700 1 -- 172.21.15.6:0/3277021893 learned_addr learned my addr 172.21.15.6:0/3277021893 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:08.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.489+0000 7f60f37fe700 1 --2- 172.21.15.6:0/3277021893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d20d840 0x560a4d2553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.489+0000 7f60f3fff700 1 --2- 172.21.15.6:0/3277021893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d25dc00 0x560a4d262630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.489+0000 7f60f2ffd700 1 -- 172.21.15.6:0/3277021893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d25dc00 msgr2=0x560a4d262630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:08.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.489+0000 7f60f2ffd700 1 --2- 172.21.15.6:0/3277021893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d25dc00 0x560a4d262630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.489+0000 7f60f2ffd700 1 -- 172.21.15.6:0/3277021893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d20d840 msgr2=0x560a4d2553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:08.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.489+0000 7f60f2ffd700 1 --2- 172.21.15.6:0/3277021893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d20d840 0x560a4d2553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.489+0000 7f60f2ffd700 1 -- 172.21.15.6:0/3277021893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f415b030 con 0x560a4d20ecc0 2023-10-06T02:27:08.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.490+0000 7f60f2ffd700 1 --2- 172.21.15.6:0/3277021893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20ecc0 0x560a4d255920 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f60e80030c0 tx=0x7f60e8022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b178c0a419c91b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:08.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.490+0000 7f60d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:27:08.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.490+0000 7f60d1ffb700 1 -- 172.21.15.6:0/3277021893 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e802f070 con 0x560a4d20ecc0 2023-10-06T02:27:08.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.490+0000 7f60d1ffb700 1 -- 172.21.15.6:0/3277021893 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7f60e8033430 con 0x560a4d20ecc0 2023-10-06T02:27:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.490+0000 7f6103406b80 1 -- 172.21.15.6:0/3277021893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f60e8021580 con 0x560a4d20ecc0 2023-10-06T02:27:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.490+0000 7f60d1ffb700 1 -- 172.21.15.6:0/3277021893 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=210) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60e8021900 con 0x560a4d20ecc0 2023-10-06T02:27:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.490+0000 7f6103406b80 10 client.9168 fetch_fsmap learned FSMap version 210 2023-10-06T02:27:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.490+0000 7f6103406b80 1 -- 172.21.15.6:0/3277021893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=210,monmap=2+}) v3 -- 0x560a4d113470 con 0x560a4d20ecc0 2023-10-06T02:27:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.490+0000 7f60d1ffb700 1 -- 172.21.15.6:0/3277021893 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e8021580 con 0x560a4d20ecc0 2023-10-06T02:27:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.490+0000 7f60d1ffb700 1 -- 172.21.15.6:0/3277021893 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 210) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f60e8033840 con 0x560a4d20ecc0 2023-10-06T02:27:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.490+0000 7f6103406b80 10 client.9168 fetch_fsmap finished waiting for FSMap version 210 2023-10-06T02:27:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.490+0000 7f6103406b80 10 client.9168 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:27:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.490+0000 7f6103406b80 20 client.9168 populate_metadata read hostname 'smithi006' 2023-10-06T02:27:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.490+0000 7f6103406b80 1 --2- 172.21.15.6:0/3277021893 >> [v2:172.21.15.6:6833/2836519357,v1:172.21.15.6:6835/2836519357] conn(0x560a4d2357a0 0x560a4d262b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.490+0000 7f6103406b80 4 client.9168 mds_command: new command op to 9063 tid=0[{"prefix": "status"}] 2023-10-06T02:27:08.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.490+0000 7f6103406b80 1 -- 172.21.15.6:0/3277021893 --> [v2:172.21.15.6:6833/2836519357,v1:172.21.15.6:6835/2836519357] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560a4d100e00 con 0x560a4d2357a0 2023-10-06T02:27:08.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.490+0000 7f60f37fe700 1 --2- 172.21.15.6:0/3277021893 >> [v2:172.21.15.6:6833/2836519357,v1:172.21.15.6:6835/2836519357] conn(0x560a4d2357a0 0x560a4d262b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.491+0000 7f60d1ffb700 10 client.9168 ms_handle_connect on v2:172.21.15.6:6833/2836519357 2023-10-06T02:27:08.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.491+0000 7f60f37fe700 1 --2- 172.21.15.6:0/3277021893 >> [v2:172.21.15.6:6833/2836519357,v1:172.21.15.6:6835/2836519357] conn(0x560a4d2357a0 0x560a4d262b70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51a98310d912f047 server_cookie=45cbcae075bad496 in_seq=0 out_seq=0 2023-10-06T02:27:08.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.491+0000 7f60d1ffb700 1 -- 172.21.15.6:0/3277021893 <== mds.0 v2:172.21.15.6:6833/2836519357 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x560a4d100e00 con 0x560a4d2357a0 2023-10-06T02:27:08.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.491+0000 7f60d1ffb700 10 client.9168 handle_command_reply: tid=0 2023-10-06T02:27:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.491+0000 7f6103406b80 1 client.9168 shutdown 2023-10-06T02:27:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.491+0000 7f6103406b80 1 -- 172.21.15.6:0/3277021893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20ecc0 msgr2=0x560a4d255920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.491+0000 7f6103406b80 1 --2- 172.21.15.6:0/3277021893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20ecc0 0x560a4d255920 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f60e80030c0 tx=0x7f60e8022000 comp rx=0 tx=0).stop 2023-10-06T02:27:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.491+0000 7f6103406b80 1 -- 172.21.15.6:0/3277021893 shutdown_connections 2023-10-06T02:27:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.491+0000 7f6103406b80 1 --2- 172.21.15.6:0/3277021893 >> [v2:172.21.15.6:6833/2836519357,v1:172.21.15.6:6835/2836519357] conn(0x560a4d2357a0 0x560a4d262b70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.491+0000 7f6103406b80 1 --2- 172.21.15.6:0/3277021893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560a4d25dc00 0x560a4d262630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.491+0000 7f6103406b80 1 --2- 172.21.15.6:0/3277021893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a4d20d840 0x560a4d2553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.491+0000 7f60d1ffb700 0 client.9168 ms_handle_reset on v2:172.21.15.6:6833/2836519357 2023-10-06T02:27:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.491+0000 7f6103406b80 1 --2- 172.21.15.6:0/3277021893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a4d20ecc0 0x560a4d255920 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.491+0000 7f6103406b80 1 -- 172.21.15.6:0/3277021893 >> 172.21.15.6:0/3277021893 conn(0x560a4d20f160 msgr2=0x560a4d238f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.491+0000 7f6103406b80 1 -- 172.21.15.6:0/3277021893 shutdown_connections 2023-10-06T02:27:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.491+0000 7f6103406b80 1 -- 172.21.15.6:0/3277021893 wait complete. 2023-10-06T02:27:08.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.491+0000 7f6103406b80 20 client.9168 trim_cache size 0 max 16384 2023-10-06T02:27:08.508 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:27:08.508 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:27:08.508 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:27:08.509 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 9063, 2023-10-06T02:27:08.509 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:27:08.509 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:27:08.509 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:27:08.509 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 7.5427354019999999, 2023-10-06T02:27:08.509 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 210, 2023-10-06T02:27:08.510 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 113, 2023-10-06T02:27:08.510 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 113, 2023-10-06T02:27:08.510 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 11.538104664 2023-10-06T02:27:08.510 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:27:08.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.492+0000 7f60fa10e700 1 -- 172.21.15.6:0/4139449530 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60e0066f30 msgr2=0x7f60e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.492+0000 7f60fa10e700 1 --2- 172.21.15.6:0/4139449530 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60e0066f30 0x7f60e00693e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f60f4157470 tx=0x7f60e80091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.492+0000 7f60fa10e700 1 -- 172.21.15.6:0/4139449530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60f40ccd40 msgr2=0x7f60f4155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.492+0000 7f60fa10e700 1 --2- 172.21.15.6:0/4139449530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60f40ccd40 0x7f60f4155510 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f60e400c790 tx=0x7f60e4007c80 comp rx=0 tx=0).stop 2023-10-06T02:27:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.492+0000 7f60fa10e700 1 -- 172.21.15.6:0/4139449530 shutdown_connections 2023-10-06T02:27:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.492+0000 7f60fa10e700 1 --2- 172.21.15.6:0/4139449530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60f40d0400 0x7f60f40c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.492+0000 7f60fa10e700 1 --2- 172.21.15.6:0/4139449530 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60e0066f30 0x7f60e00693e0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.492+0000 7f60fa10e700 1 --2- 172.21.15.6:0/4139449530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60f40ccd40 0x7f60f4155510 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.492+0000 7f60fa10e700 1 --2- 172.21.15.6:0/4139449530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60f40cf7e0 0x7f60f416cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.492+0000 7f60fa10e700 1 -- 172.21.15.6:0/4139449530 >> 172.21.15.6:0/4139449530 conn(0x7f60f406a220 msgr2=0x7f60f40b5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:08.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.492+0000 7f60fa10e700 1 -- 172.21.15.6:0/4139449530 shutdown_connections 2023-10-06T02:27:08.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.492+0000 7f60fa10e700 1 -- 172.21.15.6:0/4139449530 wait complete. 2023-10-06T02:27:08.515 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:27:08.515 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:08.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.634+0000 7ff56d9ae700 1 Processor -- start 2023-10-06T02:27:08.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.634+0000 7ff56d9ae700 1 -- start start 2023-10-06T02:27:08.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.634+0000 7ff56d9ae700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff568159380 0x7ff568159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff56d9ae700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5680b20e0 0x7ff5680b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff56d9ae700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff56815d4d0 0x7ff56815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff56d9ae700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56815e200 con 0x7ff5680b20e0 2023-10-06T02:27:08.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff56d9ae700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5680cb6c0 con 0x7ff56815d4d0 2023-10-06T02:27:08.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff56d9ae700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680c3ef0 con 0x7ff568159380 2023-10-06T02:27:08.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff5667fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5680b20e0 0x7ff5680b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff5667fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5680b20e0 0x7ff5680b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56076/0 (socket says 172.21.15.6:56076) 2023-10-06T02:27:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff5667fc700 1 -- 172.21.15.6:0/2607681713 learned_addr learned my addr 172.21.15.6:0/2607681713 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff566ffd700 1 --2- 172.21.15.6:0/2607681713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff568159380 0x7ff568159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff5677fe700 1 --2- 172.21.15.6:0/2607681713 >> v2:172.21.15.175:3300/0 conn(0x7ff56815d4d0 0x7ff56815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff5667fc700 1 -- 172.21.15.6:0/2607681713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff568159380 msgr2=0x7ff568159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff5667fc700 1 --2- 172.21.15.6:0/2607681713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff568159380 0x7ff568159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff5667fc700 1 -- 172.21.15.6:0/2607681713 >> v2:172.21.15.175:3300/0 conn(0x7ff56815d4d0 msgr2=0x7ff56815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff5667fc700 1 --2- 172.21.15.6:0/2607681713 >> v2:172.21.15.175:3300/0 conn(0x7ff56815d4d0 0x7ff56815d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff5667fc700 1 -- 172.21.15.6:0/2607681713 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5680cad90 con 0x7ff5680b20e0 2023-10-06T02:27:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff5667fc700 1 --2- 172.21.15.6:0/2607681713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5680b20e0 0x7ff5680b2530 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7ff5680b63c0 tx=0x7ff55c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96958e958f341db8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:08.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff565ffb700 1 -- 172.21.15.6:0/2607681713 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00b640 con 0x7ff5680b20e0 2023-10-06T02:27:08.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.635+0000 7ff565ffb700 1 -- 172.21.15.6:0/2607681713 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c00b7a0 con 0x7ff5680b20e0 2023-10-06T02:27:08.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.636+0000 7ff565ffb700 1 -- 172.21.15.6:0/2607681713 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00bb40 con 0x7ff5680b20e0 2023-10-06T02:27:08.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.636+0000 7ff56d9ae700 1 -- 172.21.15.6:0/2607681713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5680b20e0 msgr2=0x7ff5680b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.636+0000 7ff56d9ae700 1 --2- 172.21.15.6:0/2607681713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5680b20e0 0x7ff5680b2530 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7ff5680b63c0 tx=0x7ff55c009250 comp rx=0 tx=0).stop 2023-10-06T02:27:08.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.636+0000 7ff56d9ae700 1 -- 172.21.15.6:0/2607681713 shutdown_connections 2023-10-06T02:27:08.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.636+0000 7ff56d9ae700 1 --2- 172.21.15.6:0/2607681713 >> v2:172.21.15.175:3300/0 conn(0x7ff56815d4d0 0x7ff56815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.636+0000 7ff56d9ae700 1 --2- 172.21.15.6:0/2607681713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff568159380 0x7ff568159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.636+0000 7ff56d9ae700 1 --2- 172.21.15.6:0/2607681713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5680b20e0 0x7ff5680b2530 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.636+0000 7ff56d9ae700 1 -- 172.21.15.6:0/2607681713 >> 172.21.15.6:0/2607681713 conn(0x7ff568068680 msgr2=0x7ff568068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:08.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.636+0000 7ff56d9ae700 1 -- 172.21.15.6:0/2607681713 shutdown_connections 2023-10-06T02:27:08.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.636+0000 7ff56d9ae700 1 -- 172.21.15.6:0/2607681713 wait complete. 2023-10-06T02:27:08.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.637+0000 7ff56d9ae700 1 Processor -- start 2023-10-06T02:27:08.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.637+0000 7ff56d9ae700 1 -- start start 2023-10-06T02:27:08.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff56d9ae700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5680b20e0 0x7ff5680ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff56d9ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff568159380 0x7ff568156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff56d9ae700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56815d4d0 0x7ff568169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff56d9ae700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680c8a60 con 0x7ff568159380 2023-10-06T02:27:08.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff56d9ae700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680cece0 con 0x7ff56815d4d0 2023-10-06T02:27:08.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff56d9ae700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680c8430 con 0x7ff5680b20e0 2023-10-06T02:27:08.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff5667fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff568159380 0x7ff568156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff5667fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff568159380 0x7ff568156970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56086/0 (socket says 172.21.15.6:56086) 2023-10-06T02:27:08.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff5667fc700 1 -- 172.21.15.6:0/3054259740 learned_addr learned my addr 172.21.15.6:0/3054259740 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:08.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff5667fc700 1 -- 172.21.15.6:0/3054259740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5680b20e0 msgr2=0x7ff5680ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff5677fe700 1 --2- 172.21.15.6:0/3054259740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56815d4d0 0x7ff568169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff566ffd700 1 --2- 172.21.15.6:0/3054259740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5680b20e0 0x7ff5680ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff5667fc700 1 --2- 172.21.15.6:0/3054259740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5680b20e0 0x7ff5680ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff5667fc700 1 -- 172.21.15.6:0/3054259740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56815d4d0 msgr2=0x7ff568169c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff5667fc700 1 --2- 172.21.15.6:0/3054259740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56815d4d0 0x7ff568169c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff5667fc700 1 -- 172.21.15.6:0/3054259740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c0094f0 con 0x7ff568159380 2023-10-06T02:27:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff5677fe700 1 --2- 172.21.15.6:0/3054259740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56815d4d0 0x7ff568169c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.638+0000 7ff566ffd700 1 --2- 172.21.15.6:0/3054259740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5680b20e0 0x7ff5680ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.639+0000 7ff5667fc700 1 --2- 172.21.15.6:0/3054259740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff568159380 0x7ff568156970 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7ff55c006fd0 tx=0x7ff55c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.639+0000 7ff54effd700 1 -- 172.21.15.6:0/3054259740 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00b910 con 0x7ff568159380 2023-10-06T02:27:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.639+0000 7ff54effd700 1 -- 172.21.15.6:0/3054259740 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c00ba90 con 0x7ff568159380 2023-10-06T02:27:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.639+0000 7ff54effd700 1 -- 172.21.15.6:0/3054259740 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c011670 con 0x7ff568159380 2023-10-06T02:27:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.639+0000 7ff56d9ae700 1 -- 172.21.15.6:0/3054259740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5680cef60 con 0x7ff568159380 2023-10-06T02:27:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.639+0000 7ff56d9ae700 1 -- 172.21.15.6:0/3054259740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5680c86f0 con 0x7ff568159380 2023-10-06T02:27:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.640+0000 7ff56d9ae700 1 -- 172.21.15.6:0/3054259740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff568088aa0 con 0x7ff568159380 2023-10-06T02:27:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.640+0000 7ff54effd700 1 -- 172.21.15.6:0/3054259740 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff55c011a60 con 0x7ff568159380 2023-10-06T02:27:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.641+0000 7ff54effd700 1 --2- 172.21.15.6:0/3054259740 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff554066f30 0x7ff5540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.641+0000 7ff54effd700 1 -- 172.21.15.6:0/3054259740 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7ff55c086480 con 0x7ff568159380 2023-10-06T02:27:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.641+0000 7ff566ffd700 1 --2- 172.21.15.6:0/3054259740 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff554066f30 0x7ff5540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.642+0000 7ff566ffd700 1 --2- 172.21.15.6:0/3054259740 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff554066f30 0x7ff5540693e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff558006f00 tx=0x7ff558008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:08.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.645+0000 7ff54effd700 1 -- 172.21.15.6:0/3054259740 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff55c052e40 con 0x7ff568159380 2023-10-06T02:27:08.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.885+0000 7ff56d9ae700 1 -- 172.21.15.6:0/3054259740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5680c8ba0 con 0x7ff568159380 2023-10-06T02:27:08.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.886+0000 7ff54effd700 1 -- 172.21.15.6:0/3054259740 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 210 v210) v1 ==== 95+0+4604 (secure 0 0 0) 0x7ff55c015090 con 0x7ff568159380 2023-10-06T02:27:08.887 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:08.887 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":210,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":210,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:03.958762+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9063":{"gid":9063,"name":"a","rank":0,"incarnation":207,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/2836519357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2836519357},{"type":"v1","addr":"172.21.15.6:6835","nonce":2836519357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:08.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.888+0000 7ff56d9ae700 1 -- 172.21.15.6:0/3054259740 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff554066f30 msgr2=0x7ff5540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.888+0000 7ff56d9ae700 1 --2- 172.21.15.6:0/3054259740 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff554066f30 0x7ff5540693e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff558006f00 tx=0x7ff558008040 comp rx=0 tx=0).stop 2023-10-06T02:27:08.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.888+0000 7ff56d9ae700 1 -- 172.21.15.6:0/3054259740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff568159380 msgr2=0x7ff568156970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:08.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.888+0000 7ff56d9ae700 1 --2- 172.21.15.6:0/3054259740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff568159380 0x7ff568156970 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7ff55c006fd0 tx=0x7ff55c017000 comp rx=0 tx=0).stop 2023-10-06T02:27:08.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.888+0000 7ff56d9ae700 1 -- 172.21.15.6:0/3054259740 shutdown_connections 2023-10-06T02:27:08.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.888+0000 7ff56d9ae700 1 --2- 172.21.15.6:0/3054259740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56815d4d0 0x7ff568169c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.888+0000 7ff56d9ae700 1 --2- 172.21.15.6:0/3054259740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5680b20e0 0x7ff5680ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.888+0000 7ff56d9ae700 1 --2- 172.21.15.6:0/3054259740 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff554066f30 0x7ff5540693e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.888+0000 7ff56d9ae700 1 --2- 172.21.15.6:0/3054259740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff568159380 0x7ff568156970 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:08.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.888+0000 7ff56d9ae700 1 -- 172.21.15.6:0/3054259740 >> 172.21.15.6:0/3054259740 conn(0x7ff568068680 msgr2=0x7ff5681589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:08.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.888+0000 7ff56d9ae700 1 -- 172.21.15.6:0/3054259740 shutdown_connections 2023-10-06T02:27:08.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:08.888+0000 7ff56d9ae700 1 -- 172.21.15.6:0/3054259740 wait complete. 2023-10-06T02:27:08.891 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 210 2023-10-06T02:27:08.901 INFO:tasks.cephfs.test_damage:Mutation 'Corrupt 500.00000000' did not prevent MDS startup, attempting ls... 2023-10-06T02:27:08.901 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:27:09.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.020+0000 7f5f7142a700 1 Processor -- start 2023-10-06T02:27:09.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.020+0000 7f5f7142a700 1 -- start start 2023-10-06T02:27:09.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.021+0000 7f5f7142a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5f6c159400 0x7f5f6c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:09.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.021+0000 7f5f7142a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f6c0cd030 0x7f5f6c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:09.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.021+0000 7f5f7142a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6c0b3560 con 0x7f5f6c0cf1a0 2023-10-06T02:27:09.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.021+0000 7f5f7142a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6c0cf6f0 con 0x7f5f6c0cd030 2023-10-06T02:27:09.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.021+0000 7f5f7142a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6c0cf9d0 con 0x7f5f6c159400 2023-10-06T02:27:09.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.021+0000 7f5f6b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f6c0cd030 0x7f5f6c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:09.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.021+0000 7f5f70c29700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5f6c0cf1a0 0x7f5f6c0b5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33392/0 (socket says 172.21.15.6:33392) 2023-10-06T02:27:09.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.021+0000 7f5f70c29700 1 -- 172.21.15.6:0/1154734285 learned_addr learned my addr 172.21.15.6:0/1154734285 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:09.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.021+0000 7f5f6bfff700 1 --2- 172.21.15.6:0/1154734285 >> v2:172.21.15.175:3300/0 conn(0x7f5f6c159400 0x7f5f6c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:09.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.021+0000 7f5f6b7fe700 1 -- 172.21.15.6:0/1154734285 >> v2:172.21.15.175:3300/0 conn(0x7f5f6c159400 msgr2=0x7f5f6c0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:09.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.021+0000 7f5f6b7fe700 1 --2- 172.21.15.6:0/1154734285 >> v2:172.21.15.175:3300/0 conn(0x7f5f6c159400 0x7f5f6c0ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:09.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.021+0000 7f5f6b7fe700 1 -- 172.21.15.6:0/1154734285 >> v1:172.21.15.6:6789/0 conn(0x7f5f6c0cf1a0 legacy=0x7f5f6c0b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:09.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.021+0000 7f5f6b7fe700 1 -- 172.21.15.6:0/1154734285 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c0b2f10 con 0x7f5f6c0cd030 2023-10-06T02:27:09.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.021+0000 7f5f6affd700 1 -- 172.21.15.6:0/1154734285 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108074389 0 0) 0x7f5f6c0b3560 con 0x7f5f6c0cf1a0 2023-10-06T02:27:09.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.021+0000 7f5f6bfff700 1 --2- 172.21.15.6:0/1154734285 >> v2:172.21.15.175:3300/0 conn(0x7f5f6c159400 0x7f5f6c0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:09.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.022+0000 7f5f6b7fe700 1 --2- 172.21.15.6:0/1154734285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6c0cd030 0x7f5f6c0cfec0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c067fc0 tx=0x7f5f5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4826c0d6b01f158 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:09.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.022+0000 7f5f6affd700 1 -- 172.21.15.6:0/1154734285 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c00b6b0 con 0x7f5f6c0cd030 2023-10-06T02:27:09.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.022+0000 7f5f6affd700 1 -- 172.21.15.6:0/1154734285 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c00b810 con 0x7f5f6c0cd030 2023-10-06T02:27:09.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.022+0000 7f5f6affd700 1 -- 172.21.15.6:0/1154734285 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c00bbb0 con 0x7f5f6c0cd030 2023-10-06T02:27:09.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.022+0000 7f5f7142a700 1 -- 172.21.15.6:0/1154734285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6c0cd030 msgr2=0x7f5f6c0cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:09.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.022+0000 7f5f7142a700 1 --2- 172.21.15.6:0/1154734285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6c0cd030 0x7f5f6c0cfec0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c067fc0 tx=0x7f5f5c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:09.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.022+0000 7f5f7142a700 1 -- 172.21.15.6:0/1154734285 shutdown_connections 2023-10-06T02:27:09.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.022+0000 7f5f7142a700 1 --2- 172.21.15.6:0/1154734285 >> v2:172.21.15.175:3300/0 conn(0x7f5f6c159400 0x7f5f6c0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:09.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.022+0000 7f5f7142a700 1 --2- 172.21.15.6:0/1154734285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6c0cd030 0x7f5f6c0cfec0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:09.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.022+0000 7f5f7142a700 1 -- 172.21.15.6:0/1154734285 >> 172.21.15.6:0/1154734285 conn(0x7f5f6c06ac10 msgr2=0x7f5f6c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:09.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.022+0000 7f5f7142a700 1 -- 172.21.15.6:0/1154734285 shutdown_connections 2023-10-06T02:27:09.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.022+0000 7f5f7142a700 1 -- 172.21.15.6:0/1154734285 wait complete. 2023-10-06T02:27:09.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.023+0000 7f5f7142a700 1 Processor -- start 2023-10-06T02:27:09.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.024+0000 7f5f7142a700 1 -- start start 2023-10-06T02:27:09.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.024+0000 7f5f7142a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6c0cd030 0x7f5f6c15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:09.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.024+0000 7f5f7142a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f6c0cf1a0 0x7f5f6c15e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:09.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.024+0000 7f5f7142a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6c159400 0x7f5f6c0b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:09.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.024+0000 7f5f7142a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c16b1e0 con 0x7f5f6c159400 2023-10-06T02:27:09.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.024+0000 7f5f7142a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c15cd60 con 0x7f5f6c0cd030 2023-10-06T02:27:09.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.024+0000 7f5f7142a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c15bfa0 con 0x7f5f6c0cf1a0 2023-10-06T02:27:09.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.024+0000 7f5f70c29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6c159400 0x7f5f6c0b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:09.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.025+0000 7f5f70c29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6c159400 0x7f5f6c0b1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56108/0 (socket says 172.21.15.6:56108) 2023-10-06T02:27:09.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.025+0000 7f5f70c29700 1 -- 172.21.15.6:0/1956407220 learned_addr learned my addr 172.21.15.6:0/1956407220 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:09.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.025+0000 7f5f6b7fe700 1 --2- 172.21.15.6:0/1956407220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f6c0cf1a0 0x7f5f6c15e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:09.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.025+0000 7f5f6bfff700 1 --2- 172.21.15.6:0/1956407220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6c0cd030 0x7f5f6c15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:09.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.025+0000 7f5f70c29700 1 -- 172.21.15.6:0/1956407220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f6c0cf1a0 msgr2=0x7f5f6c15e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:09.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.025+0000 7f5f70c29700 1 --2- 172.21.15.6:0/1956407220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f6c0cf1a0 0x7f5f6c15e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:09.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.025+0000 7f5f70c29700 1 -- 172.21.15.6:0/1956407220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6c0cd030 msgr2=0x7f5f6c15e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:09.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.025+0000 7f5f70c29700 1 --2- 172.21.15.6:0/1956407220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6c0cd030 0x7f5f6c15e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:09.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.025+0000 7f5f70c29700 1 -- 172.21.15.6:0/1956407220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c009420 con 0x7f5f6c159400 2023-10-06T02:27:09.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.025+0000 7f5f6bfff700 1 --2- 172.21.15.6:0/1956407220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6c0cd030 0x7f5f6c15e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:09.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.025+0000 7f5f6b7fe700 1 --2- 172.21.15.6:0/1956407220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f6c0cf1a0 0x7f5f6c15e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:09.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.025+0000 7f5f70c29700 1 --2- 172.21.15.6:0/1956407220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6c159400 0x7f5f6c0b1070 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400cc90 tx=0x7f5f64001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:09.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.025+0000 7f5f63fff700 1 -- 172.21.15.6:0/1956407220 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6400cea0 con 0x7f5f6c159400 2023-10-06T02:27:09.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.025+0000 7f5f63fff700 1 -- 172.21.15.6:0/1956407220 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6400ab70 con 0x7f5f6c159400 2023-10-06T02:27:09.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.025+0000 7f5f7142a700 1 -- 172.21.15.6:0/1956407220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6c15c280 con 0x7f5f6c159400 2023-10-06T02:27:09.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.025+0000 7f5f63fff700 1 -- 172.21.15.6:0/1956407220 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f640070f0 con 0x7f5f6c159400 2023-10-06T02:27:09.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.025+0000 7f5f7142a700 1 -- 172.21.15.6:0/1956407220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6c15c840 con 0x7f5f6c159400 2023-10-06T02:27:09.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.026+0000 7f5f7142a700 1 -- 172.21.15.6:0/1956407220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6c159850 con 0x7f5f6c159400 2023-10-06T02:27:09.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.027+0000 7f5f63fff700 1 -- 172.21.15.6:0/1956407220 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f640074a0 con 0x7f5f6c159400 2023-10-06T02:27:09.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.027+0000 7f5f63fff700 1 --2- 172.21.15.6:0/1956407220 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f4c066f30 0x7f5f4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:09.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.027+0000 7f5f63fff700 1 -- 172.21.15.6:0/1956407220 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7f5f640852c0 con 0x7f5f6c159400 2023-10-06T02:27:09.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.027+0000 7f5f6bfff700 1 --2- 172.21.15.6:0/1956407220 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f4c066f30 0x7f5f4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:09.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.028+0000 7f5f6bfff700 1 --2- 172.21.15.6:0/1956407220 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f4c066f30 0x7f5f4c0693e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c160010 tx=0x7f5f54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:09.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.032+0000 7f5f63fff700 1 -- 172.21.15.6:0/1956407220 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f64051d00 con 0x7f5f6c159400 2023-10-06T02:27:09.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.273+0000 7f5f7142a700 1 -- 172.21.15.6:0/1956407220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5f6c0b31f0 con 0x7f5f6c159400 2023-10-06T02:27:09.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.273+0000 7f5f63fff700 1 -- 172.21.15.6:0/1956407220 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v210) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5f64055320 con 0x7f5f6c159400 2023-10-06T02:27:09.274 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:27:09.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.275+0000 7f5f7142a700 1 -- 172.21.15.6:0/1956407220 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f4c066f30 msgr2=0x7f5f4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:09.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.275+0000 7f5f7142a700 1 --2- 172.21.15.6:0/1956407220 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f4c066f30 0x7f5f4c0693e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c160010 tx=0x7f5f54008040 comp rx=0 tx=0).stop 2023-10-06T02:27:09.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.275+0000 7f5f7142a700 1 -- 172.21.15.6:0/1956407220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6c159400 msgr2=0x7f5f6c0b1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:09.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.275+0000 7f5f7142a700 1 --2- 172.21.15.6:0/1956407220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6c159400 0x7f5f6c0b1070 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400cc90 tx=0x7f5f64001a80 comp rx=0 tx=0).stop 2023-10-06T02:27:09.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.275+0000 7f5f7142a700 1 -- 172.21.15.6:0/1956407220 shutdown_connections 2023-10-06T02:27:09.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.275+0000 7f5f7142a700 1 --2- 172.21.15.6:0/1956407220 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f4c066f30 0x7f5f4c0693e0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:09.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.275+0000 7f5f7142a700 1 --2- 172.21.15.6:0/1956407220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6c159400 0x7f5f6c0b1070 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:09.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.275+0000 7f5f7142a700 1 --2- 172.21.15.6:0/1956407220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6c0cd030 0x7f5f6c15e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:09.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.275+0000 7f5f7142a700 1 --2- 172.21.15.6:0/1956407220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f6c0cf1a0 0x7f5f6c15e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:09.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.275+0000 7f5f7142a700 1 -- 172.21.15.6:0/1956407220 >> 172.21.15.6:0/1956407220 conn(0x7f5f6c06ac10 msgr2=0x7f5f6c0b4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:09.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.275+0000 7f5f7142a700 1 -- 172.21.15.6:0/1956407220 shutdown_connections 2023-10-06T02:27:09.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:09.275+0000 7f5f7142a700 1 -- 172.21.15.6:0/1956407220 wait complete. 2023-10-06T02:27:09.288 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:27:09.288 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:27:09.288 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:27:09.288 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:27:09.288 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:09.288 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:27:09.288 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:27:09.288 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:27:09.289 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:27:09.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:09.289 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:27:09.304 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:27:09.305 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:27:09.305 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:27:09.305 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:09.305 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:27:09.305 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:09.305 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:27:09.305 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:27:09.305 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:27:09.305 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:27:09.305 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:27:09.305 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:27:09.306 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:27:09.306 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:27:09.306 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:27:09.306 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:27:09.306 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41917sec preferred_lft 41917sec 2023-10-06T02:27:09.306 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:27:09.306 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:09.306 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:27:09.306 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:27:09.306 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:27:09.306 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:27:09.306 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:27:09.307 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:27:09.307 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:09.307 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:27:09.307 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:09.307 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:27:09.307 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:27:09.307 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:27:09.307 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:09.307 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:27:09.307 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:27:09.307 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:27:09.307 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:09.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:09.308 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:27:09.368 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:27:09.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:09.370 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:27:09.426 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:27:09.426 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:27:09.426 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:27:09.426 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:27:09.426 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:27:09.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:09.426 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:27:09.427 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:27:09.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:27:09.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:27:09.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:27:09.427 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:27:09.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:09.529 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:27:09.543 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:27:09.543 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:27:09.543 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:27:09.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:09.544 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:27:09.608 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:27:09.608 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:27:09.609 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:09.665 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:27:09.665 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:27:09.665 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:09.720 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:27:09.785 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:27:09.786 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:27:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:27:09.850 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:27:09.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:09.851 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:27:09.906 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:27:09.907 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:27:09.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:27:09.973 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:27:09.973 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:27:10.032 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:27:10.032+0000 7fccb5d11540 -1 init, newargv = 0x55d350f0e7a0 newargc=15 2023-10-06T02:27:10.033 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[133208]: starting ceph client 2023-10-06T02:27:10.038 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[133208]: starting fuse 2023-10-06T02:27:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:27:10.041 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:27:10.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:10.042 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:27:10.097 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:27:10.098 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:27:10.098 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:27:10.098 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:27:10.098 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:27:10.098 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:27:10.098 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:27:10.098 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:27:10.098 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:27:10.099 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:27:10.099 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:27:10.099 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:27:10.099 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:27:10.099 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:27:10.099 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:27:10.099 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:27:10.099 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:27:10.099 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:27:10.099 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:27:10.099 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:27:10.099 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:27:10.100 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:27:10.100 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:27:10.100 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:27:10.100 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:27:10.100 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:27:10.100 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:27:10.100 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:27:10.100 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:27:10.220 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.133208.asok 2023-10-06T02:27:10.402 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.133208.asok 2023-10-06T02:27:10.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:10.402 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.133208.asok status 2023-10-06T02:27:10.557 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:27:10.557 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:27:10.557 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:27:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:27:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:27:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:27:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:27:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "133208", 2023-10-06T02:27:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:27:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:27:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:27:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:27:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 9189, 2023-10-06T02:27:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:27:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:27:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:27:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 9189 2023-10-06T02:27:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:27:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:27:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:27:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:27:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3673271899 2023-10-06T02:27:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:27:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:27:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:27:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:27:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:27:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3673271899 2023-10-06T02:27:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:27:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.9189 192.168.0.1:0/3673271899", 2023-10-06T02:27:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/3673271899", 2023-10-06T02:27:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:27:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 210, 2023-10-06T02:27:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 113, 2023-10-06T02:27:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:27:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:27:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:27:10.561 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:27:10.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:10.567 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:27:10.567 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:10.583 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:27:10.583 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:10.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:10.583 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:10.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:10.649 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2023-10-06T02:27:10.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:10.692 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir foo) 2023-10-06T02:27:10.708 INFO:teuthology.orchestra.run.smithi006.stdout:.: 2023-10-06T02:27:10.708 INFO:teuthology.orchestra.run.smithi006.stdout:subdir 2023-10-06T02:27:10.708 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:10.709 INFO:teuthology.orchestra.run.smithi006.stdout:./subdir: 2023-10-06T02:27:10.709 INFO:teuthology.orchestra.run.smithi006.stdout:sixmegs 2023-10-06T02:27:10.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:27:10.723 INFO:teuthology.orchestra.run.smithi006.stderr:mkdir: cannot create directory ‘foo’: Read-only file system 2023-10-06T02:27:10.723 INFO:tasks.cephfs.test_damage:mkdir: cannot create directory ‘foo’: Read-only file system 2023-10-06T02:27:10.723 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt mds_snaptable' 2023-10-06T02:27:10.723 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:27:10.724 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:27:10.724 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:10.802 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:27:10.802 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:27:10.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:10.802 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:27:10.857 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:27:11.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.017+0000 7f585ceab700 1 Processor -- start 2023-10-06T02:27:11.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.017+0000 7f585ceab700 1 -- start start 2023-10-06T02:27:11.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.018+0000 7f585ceab700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5858086ff0 0x7f5858087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:11.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.018+0000 7f585ceab700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f58580b21b0 0x7f58580b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:11.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.018+0000 7f585ceab700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58580b2b70 con 0x7f585815a030 2023-10-06T02:27:11.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.018+0000 7f585ceab700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58580b0cf0 con 0x7f5858086ff0 2023-10-06T02:27:11.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.018+0000 7f585ceab700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58580879b0 con 0x7f58580b21b0 2023-10-06T02:27:11.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.018+0000 7f5855d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5858086ff0 0x7f5858087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:11.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.018+0000 7f5855d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5858086ff0 0x7f5858087470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56118/0 (socket says 172.21.15.6:56118) 2023-10-06T02:27:11.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.018+0000 7f5855d9b700 1 -- 172.21.15.6:0/1870174242 learned_addr learned my addr 172.21.15.6:0/1870174242 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:11.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.018+0000 7f5856d9d700 1 --2- 172.21.15.6:0/1870174242 >> v2:172.21.15.175:3300/0 conn(0x7f58580b21b0 0x7f58580b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:11.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.018+0000 7f5855d9b700 1 -- 172.21.15.6:0/1870174242 >> v2:172.21.15.175:3300/0 conn(0x7f58580b21b0 msgr2=0x7f58580b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:11.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.018+0000 7f5855d9b700 1 --2- 172.21.15.6:0/1870174242 >> v2:172.21.15.175:3300/0 conn(0x7f58580b21b0 0x7f58580b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:11.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.018+0000 7f5855d9b700 1 -- 172.21.15.6:0/1870174242 >> v1:172.21.15.175:6789/0 conn(0x7f585815a030 legacy=0x7f585815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:11.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.018+0000 7f5855d9b700 1 -- 172.21.15.6:0/1870174242 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58580afc50 con 0x7f5858086ff0 2023-10-06T02:27:11.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.018+0000 7f5855d9b700 1 --2- 172.21.15.6:0/1870174242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5858086ff0 0x7f5858087470 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f5858157800 tx=0x7f584c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363ef19ae3d4e2bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:11.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.019+0000 7f585559a700 1 -- 172.21.15.6:0/1870174242 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c009ea0 con 0x7f5858086ff0 2023-10-06T02:27:11.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.019+0000 7f585559a700 1 -- 172.21.15.6:0/1870174242 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584c00b820 con 0x7f5858086ff0 2023-10-06T02:27:11.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.019+0000 7f585559a700 1 -- 172.21.15.6:0/1870174242 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c00bbc0 con 0x7f5858086ff0 2023-10-06T02:27:11.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.019+0000 7f585ceab700 1 -- 172.21.15.6:0/1870174242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5858086ff0 msgr2=0x7f5858087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:11.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.019+0000 7f585ceab700 1 --2- 172.21.15.6:0/1870174242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5858086ff0 0x7f5858087470 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f5858157800 tx=0x7f584c009250 comp rx=0 tx=0).stop 2023-10-06T02:27:11.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.019+0000 7f585ceab700 1 -- 172.21.15.6:0/1870174242 shutdown_connections 2023-10-06T02:27:11.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.019+0000 7f585ceab700 1 --2- 172.21.15.6:0/1870174242 >> v2:172.21.15.175:3300/0 conn(0x7f58580b21b0 0x7f58580b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:11.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.019+0000 7f585ceab700 1 --2- 172.21.15.6:0/1870174242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5858086ff0 0x7f5858087470 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:11.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.019+0000 7f585ceab700 1 -- 172.21.15.6:0/1870174242 >> 172.21.15.6:0/1870174242 conn(0x7f5858068680 msgr2=0x7f5858068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:11.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.019+0000 7f585ceab700 1 -- 172.21.15.6:0/1870174242 shutdown_connections 2023-10-06T02:27:11.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.019+0000 7f585ceab700 1 -- 172.21.15.6:0/1870174242 wait complete. 2023-10-06T02:27:11.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.020+0000 7f585ceab700 1 Processor -- start 2023-10-06T02:27:11.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.020+0000 7f585ceab700 1 -- start start 2023-10-06T02:27:11.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f585ceab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5858086ff0 0x7f585815c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:11.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f585ceab700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58580b21b0 0x7f58580c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:11.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f585ceab700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f585815a030 0x7f58580c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:11.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f585ceab700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585815b540 con 0x7f5858086ff0 2023-10-06T02:27:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f585ceab700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585815c080 con 0x7f58580b21b0 2023-10-06T02:27:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f585ceab700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58580c85c0 con 0x7f585815a030 2023-10-06T02:27:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f585659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5858086ff0 0x7f585815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f585659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5858086ff0 0x7f585815c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56128/0 (socket says 172.21.15.6:56128) 2023-10-06T02:27:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f585659c700 1 -- 172.21.15.6:0/696220942 learned_addr learned my addr 172.21.15.6:0/696220942 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f5855d9b700 1 --2- 172.21.15.6:0/696220942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58580b21b0 0x7f58580c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f5856d9d700 1 --2- 172.21.15.6:0/696220942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f585815a030 0x7f58580c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f585659c700 1 -- 172.21.15.6:0/696220942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f585815a030 msgr2=0x7f58580c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f585659c700 1 --2- 172.21.15.6:0/696220942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f585815a030 0x7f58580c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f585659c700 1 -- 172.21.15.6:0/696220942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58580b21b0 msgr2=0x7f58580c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f585659c700 1 --2- 172.21.15.6:0/696220942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58580b21b0 0x7f58580c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f585659c700 1 -- 172.21.15.6:0/696220942 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c0094f0 con 0x7f5858086ff0 2023-10-06T02:27:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f5856d9d700 1 --2- 172.21.15.6:0/696220942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f585815a030 0x7f58580c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.021+0000 7f5855d9b700 1 --2- 172.21.15.6:0/696220942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58580b21b0 0x7f58580c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.022+0000 7f585659c700 1 --2- 172.21.15.6:0/696220942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5858086ff0 0x7f585815c510 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f584800c510 tx=0x7f584800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.022+0000 7f58467fc700 1 -- 172.21.15.6:0/696220942 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848011590 con 0x7f5858086ff0 2023-10-06T02:27:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.022+0000 7f58467fc700 1 -- 172.21.15.6:0/696220942 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5848011710 con 0x7f5858086ff0 2023-10-06T02:27:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.022+0000 7f585ceab700 1 -- 172.21.15.6:0/696220942 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585815b750 con 0x7f5858086ff0 2023-10-06T02:27:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.022+0000 7f58467fc700 1 -- 172.21.15.6:0/696220942 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848011ad0 con 0x7f5858086ff0 2023-10-06T02:27:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.022+0000 7f585ceab700 1 -- 172.21.15.6:0/696220942 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585815bae0 con 0x7f5858086ff0 2023-10-06T02:27:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.023+0000 7f585ceab700 1 -- 172.21.15.6:0/696220942 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58580ca060 con 0x7f5858086ff0 2023-10-06T02:27:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.023+0000 7f58467fc700 1 -- 172.21.15.6:0/696220942 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f584801b3b0 con 0x7f5858086ff0 2023-10-06T02:27:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.023+0000 7f58467fc700 1 --2- 172.21.15.6:0/696220942 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5838066f30 0x7f58380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.024+0000 7f58467fc700 1 -- 172.21.15.6:0/696220942 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7926+0+0 (secure 0 0 0) 0x7f5848084380 con 0x7f5858086ff0 2023-10-06T02:27:11.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.024+0000 7f5855d9b700 1 --2- 172.21.15.6:0/696220942 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5838066f30 0x7f58380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:11.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.024+0000 7f5855d9b700 1 --2- 172.21.15.6:0/696220942 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5838066f30 0x7f58380693e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5858157800 tx=0x7f584c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:11.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.028+0000 7f58467fc700 1 -- 172.21.15.6:0/696220942 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5848050d40 con 0x7f5858086ff0 2023-10-06T02:27:11.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.264+0000 7f585ceab700 1 -- 172.21.15.6:0/696220942 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f58580aff30 con 0x7f5858086ff0 2023-10-06T02:27:11.265 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:11.265+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:27:11.268 INFO:tasks.ceph.mds.a.smithi006.stderr: -1619> 2023-10-06T02:27:00.952+0000 7fb01327e700 -1 mds.0.purge_queue operator(): Error -22 loading Journaler 2023-10-06T02:27:11.269 INFO:tasks.ceph.mds.a.smithi006.stderr: -1616> 2023-10-06T02:27:00.952+0000 7fb01327e700 -1 mds.0.207 unhandled write error (22) Invalid argument, force readonly... 2023-10-06T02:27:11.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.269+0000 7f58467fc700 1 -- 172.21.15.6:0/696220942 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v211) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5848017070 con 0x7f5858086ff0 2023-10-06T02:27:11.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.272+0000 7f585ceab700 1 -- 172.21.15.6:0/696220942 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5838066f30 msgr2=0x7f58380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:11.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.273+0000 7f585ceab700 1 --2- 172.21.15.6:0/696220942 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5838066f30 0x7f58380693e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5858157800 tx=0x7f584c017000 comp rx=0 tx=0).stop 2023-10-06T02:27:11.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.273+0000 7f585ceab700 1 -- 172.21.15.6:0/696220942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5858086ff0 msgr2=0x7f585815c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:11.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.273+0000 7f585ceab700 1 --2- 172.21.15.6:0/696220942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5858086ff0 0x7f585815c510 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f584800c510 tx=0x7f584800c8d0 comp rx=0 tx=0).stop 2023-10-06T02:27:11.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.273+0000 7f585ceab700 1 -- 172.21.15.6:0/696220942 shutdown_connections 2023-10-06T02:27:11.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.273+0000 7f585ceab700 1 --2- 172.21.15.6:0/696220942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f585815a030 0x7f58580c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:11.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.273+0000 7f585ceab700 1 --2- 172.21.15.6:0/696220942 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5838066f30 0x7f58380693e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:11.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.273+0000 7f585ceab700 1 --2- 172.21.15.6:0/696220942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5858086ff0 0x7f585815c510 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:11.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.273+0000 7f585ceab700 1 --2- 172.21.15.6:0/696220942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58580b21b0 0x7f58580c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:11.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.273+0000 7f585ceab700 1 -- 172.21.15.6:0/696220942 >> 172.21.15.6:0/696220942 conn(0x7f5858068680 msgr2=0x7f58580b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:11.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.273+0000 7f585ceab700 1 -- 172.21.15.6:0/696220942 shutdown_connections 2023-10-06T02:27:11.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.273+0000 7f585ceab700 1 -- 172.21.15.6:0/696220942 wait complete. 2023-10-06T02:27:11.275 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:27:11.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:27:11.293 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:27:11.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.408+0000 7fcb2b263700 1 Processor -- start 2023-10-06T02:27:11.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.408+0000 7fcb2b263700 1 -- start start 2023-10-06T02:27:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.409+0000 7fcb2b263700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb2415a030 0x7fcb2415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.409+0000 7fcb2b263700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb240afc50 con 0x7fcb24087700 2023-10-06T02:27:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.409+0000 7fcb2b263700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb240aff30 con 0x7fcb2415a940 2023-10-06T02:27:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.409+0000 7fcb2b263700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb240b0cf0 con 0x7fcb2415a030 2023-10-06T02:27:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.409+0000 7fcb28fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb2415a030 0x7fcb2415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.409+0000 7fcb29800700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcb24087700 0x7fcb240b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33402/0 (socket says 172.21.15.6:33402) 2023-10-06T02:27:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.409+0000 7fcb29800700 1 -- 172.21.15.6:0/1597566695 learned_addr learned my addr 172.21.15.6:0/1597566695 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.409+0000 7fcb28fff700 1 -- 172.21.15.6:0/1597566695 >> v1:172.21.15.175:6789/0 conn(0x7fcb2415a940 legacy=0x7fcb24086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.409+0000 7fcb28fff700 1 -- 172.21.15.6:0/1597566695 >> v1:172.21.15.6:6789/0 conn(0x7fcb24087700 legacy=0x7fcb240b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.409+0000 7fcb28fff700 1 -- 172.21.15.6:0/1597566695 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb240b0210 con 0x7fcb2415a030 2023-10-06T02:27:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.410+0000 7fcb28fff700 1 --2- 172.21.15.6:0/1597566695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2415a030 0x7fcb2415a400 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fcb180098e0 tx=0x7fcb180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a656bb39f6e38494 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.410+0000 7fcb237fe700 1 -- 172.21.15.6:0/1597566695 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18009e80 con 0x7fcb2415a030 2023-10-06T02:27:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.410+0000 7fcb237fe700 1 -- 172.21.15.6:0/1597566695 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1800b860 con 0x7fcb2415a030 2023-10-06T02:27:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.410+0000 7fcb237fe700 1 -- 172.21.15.6:0/1597566695 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1800bbe0 con 0x7fcb2415a030 2023-10-06T02:27:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.410+0000 7fcb2b263700 1 -- 172.21.15.6:0/1597566695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2415a030 msgr2=0x7fcb2415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.410+0000 7fcb2b263700 1 --2- 172.21.15.6:0/1597566695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2415a030 0x7fcb2415a400 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fcb180098e0 tx=0x7fcb180091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.410+0000 7fcb2b263700 1 -- 172.21.15.6:0/1597566695 shutdown_connections 2023-10-06T02:27:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.410+0000 7fcb2b263700 1 --2- 172.21.15.6:0/1597566695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb2415a030 0x7fcb2415a400 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.410+0000 7fcb2b263700 1 -- 172.21.15.6:0/1597566695 >> 172.21.15.6:0/1597566695 conn(0x7fcb24068680 msgr2=0x7fcb24068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.411+0000 7fcb2b263700 1 -- 172.21.15.6:0/1597566695 shutdown_connections 2023-10-06T02:27:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.411+0000 7fcb2b263700 1 -- 172.21.15.6:0/1597566695 wait complete. 2023-10-06T02:27:11.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.412+0000 7fcb2b263700 1 Processor -- start 2023-10-06T02:27:11.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.412+0000 7fcb2b263700 1 -- start start 2023-10-06T02:27:11.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb2b263700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb24087700 0x7fcb241477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:11.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb2b263700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb2415a030 0x7fcb240c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:11.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb2b263700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb2415a940 0x7fcb240c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:11.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb2b263700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240c56f0 con 0x7fcb24087700 2023-10-06T02:27:11.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb2b263700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240c4ae0 con 0x7fcb2415a030 2023-10-06T02:27:11.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb2b263700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240c4dc0 con 0x7fcb2415a940 2023-10-06T02:27:11.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb28fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb24087700 0x7fcb241477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:11.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb28fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb24087700 0x7fcb241477e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56160/0 (socket says 172.21.15.6:56160) 2023-10-06T02:27:11.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb28fff700 1 -- 172.21.15.6:0/3848975182 learned_addr learned my addr 172.21.15.6:0/3848975182 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:11.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb23fff700 1 --2- 172.21.15.6:0/3848975182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb2415a030 0x7fcb240c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:11.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb29800700 1 --2- 172.21.15.6:0/3848975182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb2415a940 0x7fcb240c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:11.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb28fff700 1 -- 172.21.15.6:0/3848975182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb2415a940 msgr2=0x7fcb240c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:11.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb28fff700 1 --2- 172.21.15.6:0/3848975182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb2415a940 0x7fcb240c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:11.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb28fff700 1 -- 172.21.15.6:0/3848975182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb2415a030 msgr2=0x7fcb240c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:11.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb28fff700 1 --2- 172.21.15.6:0/3848975182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb2415a030 0x7fcb240c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:11.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb28fff700 1 -- 172.21.15.6:0/3848975182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb18009420 con 0x7fcb24087700 2023-10-06T02:27:11.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb28fff700 1 --2- 172.21.15.6:0/3848975182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb24087700 0x7fcb241477e0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fcb180093f0 tx=0x7fcb18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:11.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb20ff9700 1 -- 172.21.15.6:0/3848975182 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1800b9d0 con 0x7fcb24087700 2023-10-06T02:27:11.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.413+0000 7fcb20ff9700 1 -- 172.21.15.6:0/3848975182 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1800bb30 con 0x7fcb24087700 2023-10-06T02:27:11.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.414+0000 7fcb2b263700 1 -- 172.21.15.6:0/3848975182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb240c50a0 con 0x7fcb24087700 2023-10-06T02:27:11.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.414+0000 7fcb20ff9700 1 -- 172.21.15.6:0/3848975182 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18025650 con 0x7fcb24087700 2023-10-06T02:27:11.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.414+0000 7fcb2b263700 1 -- 172.21.15.6:0/3848975182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb24147d20 con 0x7fcb24087700 2023-10-06T02:27:11.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.415+0000 7fcb2b263700 1 -- 172.21.15.6:0/3848975182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb240c5540 con 0x7fcb24087700 2023-10-06T02:27:11.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.415+0000 7fcb20ff9700 1 -- 172.21.15.6:0/3848975182 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb18023070 con 0x7fcb24087700 2023-10-06T02:27:11.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.415+0000 7fcb20ff9700 1 --2- 172.21.15.6:0/3848975182 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb08066f30 0x7fcb080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:11.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.415+0000 7fcb20ff9700 1 -- 172.21.15.6:0/3848975182 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8012+0+0 (secure 0 0 0) 0x7fcb180864a0 con 0x7fcb24087700 2023-10-06T02:27:11.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.415+0000 7fcb23fff700 1 --2- 172.21.15.6:0/3848975182 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb08066f30 0x7fcb080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:11.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.416+0000 7fcb23fff700 1 --2- 172.21.15.6:0/3848975182 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb08066f30 0x7fcb080693e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fcb24159840 tx=0x7fcb10007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:11.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.419+0000 7fcb20ff9700 1 -- 172.21.15.6:0/3848975182 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb18052e10 con 0x7fcb24087700 2023-10-06T02:27:11.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:11.697+0000 7fcb2b263700 1 -- 172.21.15.6:0/3848975182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fcb240b04f0 con 0x7fcb24087700 2023-10-06T02:27:12.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.270+0000 7fcb20ff9700 1 -- 172.21.15.6:0/3848975182 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v212) v1 ==== 107+0+0 (secure 0 0 0) 0x7fcb18015090 con 0x7fcb24087700 2023-10-06T02:27:12.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.272+0000 7fcb2b263700 1 -- 172.21.15.6:0/3848975182 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb08066f30 msgr2=0x7fcb080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.272+0000 7fcb2b263700 1 --2- 172.21.15.6:0/3848975182 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb08066f30 0x7fcb080693e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fcb24159840 tx=0x7fcb10007ec0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.272+0000 7fcb2b263700 1 -- 172.21.15.6:0/3848975182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb24087700 msgr2=0x7fcb241477e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.272+0000 7fcb2b263700 1 --2- 172.21.15.6:0/3848975182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb24087700 0x7fcb241477e0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fcb180093f0 tx=0x7fcb18017000 comp rx=0 tx=0).stop 2023-10-06T02:27:12.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.272+0000 7fcb2b263700 1 -- 172.21.15.6:0/3848975182 shutdown_connections 2023-10-06T02:27:12.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.272+0000 7fcb2b263700 1 --2- 172.21.15.6:0/3848975182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb2415a940 0x7fcb240c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.272+0000 7fcb2b263700 1 --2- 172.21.15.6:0/3848975182 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb08066f30 0x7fcb080693e0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.272+0000 7fcb2b263700 1 --2- 172.21.15.6:0/3848975182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb24087700 0x7fcb241477e0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.272+0000 7fcb2b263700 1 --2- 172.21.15.6:0/3848975182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb2415a030 0x7fcb240c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.272+0000 7fcb2b263700 1 -- 172.21.15.6:0/3848975182 >> 172.21.15.6:0/3848975182 conn(0x7fcb24068680 msgr2=0x7fcb240cb860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:12.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.273+0000 7fcb2b263700 1 -- 172.21.15.6:0/3848975182 shutdown_connections 2023-10-06T02:27:12.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.273+0000 7fcb2b263700 1 -- 172.21.15.6:0/3848975182 wait complete. 2023-10-06T02:27:12.274 INFO:teuthology.orchestra.run.smithi006.stderr:nothing to do: rank is not damaged 2023-10-06T02:27:12.287 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:27:12.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.367+0000 7f91c943a000 1 Processor -- start 2023-10-06T02:27:12.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.367+0000 7f91c943a000 1 -- start start 2023-10-06T02:27:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.368+0000 7f91c943a000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb32d58160 0x55fb32e329e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.368+0000 7f91c943a000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb32e198b0 0x55fb32e14350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.368+0000 7f91c943a000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb32e19c80 0x55fb32e3cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.368+0000 7f91c943a000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb32d00320 con 0x55fb32d58160 2023-10-06T02:27:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.368+0000 7f91c943a000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb32ca4980 con 0x55fb32e198b0 2023-10-06T02:27:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.368+0000 7f91c943a000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb32ca4620 con 0x55fb32e19c80 2023-10-06T02:27:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.368+0000 7f91c2675700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb32d58160 0x55fb32e329e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.368+0000 7f91c2675700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb32d58160 0x55fb32e329e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56170/0 (socket says 172.21.15.6:56170) 2023-10-06T02:27:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.368+0000 7f91c2675700 1 -- 172.21.15.6:0/2934420967 learned_addr learned my addr 172.21.15.6:0/2934420967 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.368+0000 7f91bbfff700 1 --2- 172.21.15.6:0/2934420967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb32e198b0 0x55fb32e14350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.368+0000 7f91c2e76700 1 --2- 172.21.15.6:0/2934420967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb32e19c80 0x55fb32e3cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.368+0000 7f91c2675700 1 -- 172.21.15.6:0/2934420967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb32e19c80 msgr2=0x55fb32e3cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.368+0000 7f91c2675700 1 --2- 172.21.15.6:0/2934420967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb32e19c80 0x55fb32e3cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.368+0000 7f91c2675700 1 -- 172.21.15.6:0/2934420967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb32e198b0 msgr2=0x55fb32e14350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.368+0000 7f91c2675700 1 --2- 172.21.15.6:0/2934420967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb32e198b0 0x55fb32e14350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.368+0000 7f91c2675700 1 -- 172.21.15.6:0/2934420967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac005cf0 con 0x55fb32d58160 2023-10-06T02:27:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.369+0000 7f91bbfff700 1 --2- 172.21.15.6:0/2934420967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb32e198b0 0x55fb32e14350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.369+0000 7f91c2675700 1 --2- 172.21.15.6:0/2934420967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb32d58160 0x55fb32e329e0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f91b4002e30 tx=0x7f91b4002900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722a9c44ce4a384c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.369+0000 7f91c1673700 1 -- 172.21.15.6:0/2934420967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b400bca0 con 0x55fb32d58160 2023-10-06T02:27:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.369+0000 7f91c1673700 1 -- 172.21.15.6:0/2934420967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b4008030 con 0x55fb32d58160 2023-10-06T02:27:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.369+0000 7f91c1673700 1 -- 172.21.15.6:0/2934420967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b400f630 con 0x55fb32d58160 2023-10-06T02:27:12.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.369+0000 7f91c943a000 1 -- 172.21.15.6:0/2934420967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb32d58160 msgr2=0x55fb32e329e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.369+0000 7f91c943a000 1 --2- 172.21.15.6:0/2934420967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb32d58160 0x55fb32e329e0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f91b4002e30 tx=0x7f91b4002900 comp rx=0 tx=0).stop 2023-10-06T02:27:12.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.369+0000 7f91c943a000 1 -- 172.21.15.6:0/2934420967 shutdown_connections 2023-10-06T02:27:12.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.369+0000 7f91c943a000 1 --2- 172.21.15.6:0/2934420967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb32e19c80 0x55fb32e3cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.369+0000 7f91c943a000 1 --2- 172.21.15.6:0/2934420967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb32d58160 0x55fb32e329e0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.369+0000 7f91c943a000 1 --2- 172.21.15.6:0/2934420967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb32e198b0 0x55fb32e14350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.369+0000 7f91c943a000 1 -- 172.21.15.6:0/2934420967 >> 172.21.15.6:0/2934420967 conn(0x55fb32da0bd0 msgr2=0x55fb32d88200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:12.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.369+0000 7f91c943a000 1 -- 172.21.15.6:0/2934420967 shutdown_connections 2023-10-06T02:27:12.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.369+0000 7f91c943a000 1 -- 172.21.15.6:0/2934420967 wait complete. 2023-10-06T02:27:12.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.370+0000 7f91c943a000 1 Processor -- start 2023-10-06T02:27:12.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.370+0000 7f91c943a000 1 -- start start 2023-10-06T02:27:12.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91c943a000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb32d58160 0x55fb32e15fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91c943a000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb32e198b0 0x55fb32e16500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91c943a000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb32e19c80 0x55fb32e17330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91c943a000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb32c9b400 con 0x55fb32d58160 2023-10-06T02:27:12.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91c943a000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb32d9f010 con 0x55fb32e198b0 2023-10-06T02:27:12.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91c943a000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb32e122b0 con 0x55fb32e19c80 2023-10-06T02:27:12.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91c2675700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb32d58160 0x55fb32e15fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91c2675700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb32d58160 0x55fb32e15fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56180/0 (socket says 172.21.15.6:56180) 2023-10-06T02:27:12.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 learned_addr learned my addr 172.21.15.6:0/4110793566 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:12.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91bbfff700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb32e198b0 0x55fb32e16500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91c2e76700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb32e19c80 0x55fb32e17330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb32e19c80 msgr2=0x55fb32e17330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91c2675700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55fb32e19c80 0x55fb32e17330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb32e198b0 msgr2=0x55fb32e16500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91c2675700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb32e198b0 0x55fb32e16500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b400a040 con 0x55fb32d58160 2023-10-06T02:27:12.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91bbfff700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb32e198b0 0x55fb32e16500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:12.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.371+0000 7f91c2675700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb32d58160 0x55fb32e15fc0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f91b4000c00 tx=0x7f91b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:12.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.372+0000 7f91baffd700 1 -- 172.21.15.6:0/4110793566 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b401f070 con 0x55fb32d58160 2023-10-06T02:27:12.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.372+0000 7f91baffd700 1 -- 172.21.15.6:0/4110793566 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b4018630 con 0x55fb32d58160 2023-10-06T02:27:12.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.372+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fb32ca6ae0 con 0x55fb32d58160 2023-10-06T02:27:12.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.372+0000 7f91baffd700 1 -- 172.21.15.6:0/4110793566 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40189f0 con 0x55fb32d58160 2023-10-06T02:27:12.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.372+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb32ca6540 con 0x55fb32d58160 2023-10-06T02:27:12.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.373+0000 7f91baffd700 1 -- 172.21.15.6:0/4110793566 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f91b402d3f0 con 0x55fb32d58160 2023-10-06T02:27:12.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.373+0000 7f91baffd700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f91a40658c0 0x7f91a4067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.373+0000 7f91baffd700 1 -- 172.21.15.6:0/4110793566 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8012+0+0 (secure 0 0 0) 0x7f91b4084e80 con 0x55fb32d58160 2023-10-06T02:27:12.378 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:27:12.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.374+0000 7f91bbfff700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f91a40658c0 0x7f91a4067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.374+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55fb32e16a40 0x55fb32e2bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.374+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e329c0 con 0x55fb32e16a40 2023-10-06T02:27:12.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.374+0000 7f91c2e76700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55fb32e16a40 0x55fb32e2bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.374+0000 7f91c2e76700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55fb32e16a40 0x55fb32e2bf30 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:12.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.374+0000 7f91bbfff700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f91a40658c0 0x7f91a4067d70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00afd0 tx=0x7f91ac015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:12.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.376+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v114'567 uv541 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.376+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e2c470 con 0x55fb32e16a40 2023-10-06T02:27:12.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.377+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v114'568 uv568 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.377+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e2c820 con 0x55fb32e16a40 2023-10-06T02:27:12.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.379+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v114'569 uv569 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.381 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:27:12.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.379+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e2cc00 con 0x55fb32e16a40 2023-10-06T02:27:12.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.380+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v114'570 uv570 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.380+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4e560 con 0x55fb32e16a40 2023-10-06T02:27:12.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.381+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v114'571 uv571 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.381+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4d550 con 0x55fb32e16a40 2023-10-06T02:27:12.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.382+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v114'572 uv572 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.383+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4d900 con 0x55fb32e16a40 2023-10-06T02:27:12.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.384+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v114'573 uv547 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.384+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4dd00 con 0x55fb32e16a40 2023-10-06T02:27:12.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.385+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v114'574 uv574 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.385+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4dd00 con 0x55fb32e16a40 2023-10-06T02:27:12.386 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:27:12.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.386+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v114'575 uv575 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.386+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4dcb0 con 0x55fb32e16a40 2023-10-06T02:27:12.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.387+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v114'576 uv576 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.387+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4dcb0 con 0x55fb32e16a40 2023-10-06T02:27:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.388+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v114'577 uv577 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.388+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4dcb0 con 0x55fb32e16a40 2023-10-06T02:27:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.389+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v114'578 uv578 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.389+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4dcb0 con 0x55fb32e16a40 2023-10-06T02:27:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.391+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v114'579 uv554 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.391+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4dcb0 con 0x55fb32e16a40 2023-10-06T02:27:12.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.392+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v114'580 uv580 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.392+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4dcb0 con 0x55fb32e16a40 2023-10-06T02:27:12.393 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:27:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.393+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v114'581 uv581 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.393+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4dcb0 con 0x55fb32e16a40 2023-10-06T02:27:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.394+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v114'582 uv582 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.394+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4dcb0 con 0x55fb32e16a40 2023-10-06T02:27:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.396+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v114'583 uv583 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.396+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4dcb0 con 0x55fb32e16a40 2023-10-06T02:27:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.397+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v114'584 uv584 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.397+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4e910 con 0x55fb32e16a40 2023-10-06T02:27:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.398+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v114'585 uv585 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.398+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4e910 con 0x55fb32e16a40 2023-10-06T02:27:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.399+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v114'586 uv560 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.399+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4e910 con 0x55fb32e16a40 2023-10-06T02:27:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.400+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v114'587 uv587 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.400+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4e910 con 0x55fb32e16a40 2023-10-06T02:27:12.402 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:27:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.402+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v114'588 uv588 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.402+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4f920 con 0x55fb32e16a40 2023-10-06T02:27:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.403+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v114'589 uv589 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.403+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4f920 con 0x55fb32e16a40 2023-10-06T02:27:12.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.404+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v114'590 uv590 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.404+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4e910 con 0x55fb32e16a40 2023-10-06T02:27:12.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.405+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v114'591 uv591 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.406+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4e910 con 0x55fb32e16a40 2023-10-06T02:27:12.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.407+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v114'592 uv566 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.407+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4e910 con 0x55fb32e16a40 2023-10-06T02:27:12.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.408+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v114'593 uv593 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.408+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4e910 con 0x55fb32e16a40 2023-10-06T02:27:12.409 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:27:12.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.409+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v114'594 uv594 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.409+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4f920 con 0x55fb32e16a40 2023-10-06T02:27:12.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.410+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v114'595 uv595 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.410+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4f920 con 0x55fb32e16a40 2023-10-06T02:27:12.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.411+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v114'596 uv596 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.411+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e4e910 con 0x55fb32e16a40 2023-10-06T02:27:12.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.412+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v114'597 uv597 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e16a40 2023-10-06T02:27:12.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.413+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55fb32e4ee20 0x55fb32e51200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.413+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e51740 con 0x55fb32e4ee20 2023-10-06T02:27:12.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.413+0000 7f91c2675700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55fb32e4ee20 0x55fb32e51200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.413+0000 7f91c2675700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55fb32e4ee20 0x55fb32e51200 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:12.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.414+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v114'415 uv395 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.414+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e51af0 con 0x55fb32e4ee20 2023-10-06T02:27:12.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.416+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v114'416 uv416 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.416+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e51ea0 con 0x55fb32e4ee20 2023-10-06T02:27:12.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.417+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v114'417 uv417 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.417 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:27:12.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.417+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e52740 con 0x55fb32e4ee20 2023-10-06T02:27:12.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.418+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v114'418 uv418 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.418+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e52af0 con 0x55fb32e4ee20 2023-10-06T02:27:12.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.419+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v114'419 uv419 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.419+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e52ea0 con 0x55fb32e4ee20 2023-10-06T02:27:12.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.420+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v114'420 uv414 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.420+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e53250 con 0x55fb32e4ee20 2023-10-06T02:27:12.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.421+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v114'421 uv421 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.421+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e53600 con 0x55fb32e4ee20 2023-10-06T02:27:12.422 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:27:12.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.422+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v114'422 uv422 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.422+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e53600 con 0x55fb32e4ee20 2023-10-06T02:27:12.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.423+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v114'423 uv423 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.423+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e53600 con 0x55fb32e4ee20 2023-10-06T02:27:12.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.424+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v114'424 uv424 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.424+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e53600 con 0x55fb32e4ee20 2023-10-06T02:27:12.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.425+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v114'425 uv413 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.425+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e53600 con 0x55fb32e4ee20 2023-10-06T02:27:12.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.426+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v114'426 uv426 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.426+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e53600 con 0x55fb32e4ee20 2023-10-06T02:27:12.427 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:27:12.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.427+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v114'427 uv427 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.427+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e56d20 con 0x55fb32e4ee20 2023-10-06T02:27:12.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.428+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v114'428 uv428 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.428+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e56d20 con 0x55fb32e4ee20 2023-10-06T02:27:12.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.429+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v114'429 uv429 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.429+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e53600 con 0x55fb32e4ee20 2023-10-06T02:27:12.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.430+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v114'430 uv411 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.430+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e53600 con 0x55fb32e4ee20 2023-10-06T02:27:12.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.431+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v114'431 uv431 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.431+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e53600 con 0x55fb32e4ee20 2023-10-06T02:27:12.433 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:27:12.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.432+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v114'432 uv432 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.432+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e54610 con 0x55fb32e4ee20 2023-10-06T02:27:12.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.433+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v114'433 uv433 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.433+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e54610 con 0x55fb32e4ee20 2023-10-06T02:27:12.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.434+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v114'434 uv434 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.434+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e53600 con 0x55fb32e4ee20 2023-10-06T02:27:12.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.435+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v114'435 uv435 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.435+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55fb32e53b10 0x55fb32e55ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.435+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e56430 con 0x55fb32e53b10 2023-10-06T02:27:12.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.435+0000 7f91bbfff700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55fb32e53b10 0x55fb32e55ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.436+0000 7f91bbfff700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55fb32e53b10 0x55fb32e55ef0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:12.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.437+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v114'111 uv110 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.437+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e567e0 con 0x55fb32e53b10 2023-10-06T02:27:12.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.438+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v114'112 uv112 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.438+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e56b90 con 0x55fb32e53b10 2023-10-06T02:27:12.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.439+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v114'113 uv113 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.440 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:27:12.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.439+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e52370 con 0x55fb32e53b10 2023-10-06T02:27:12.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.440+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v114'114 uv114 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.440+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e585d0 con 0x55fb32e53b10 2023-10-06T02:27:12.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.441+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v114'115 uv115 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.441+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e57480 con 0x55fb32e53b10 2023-10-06T02:27:12.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.442+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v114'116 uv116 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.442+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e57880 con 0x55fb32e53b10 2023-10-06T02:27:12.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.443+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v114'80 uv79 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.443+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e57cb0 con 0x55fb32e53b10 2023-10-06T02:27:12.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.444+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v114'81 uv81 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.444+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e580d0 con 0x55fb32e53b10 2023-10-06T02:27:12.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.445+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v114'82 uv82 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.446 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:27:12.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.445+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e580d0 con 0x55fb32e53b10 2023-10-06T02:27:12.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.446+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v114'83 uv83 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.446+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e57e50 con 0x55fb32e4ee20 2023-10-06T02:27:12.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.447+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v114'111 uv110 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.447+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e57e50 con 0x55fb32e4ee20 2023-10-06T02:27:12.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.448+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v114'112 uv112 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.449+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e57e50 con 0x55fb32e4ee20 2023-10-06T02:27:12.450 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:27:12.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.450+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v114'113 uv113 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.450+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e57e50 con 0x55fb32e4ee20 2023-10-06T02:27:12.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.451+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v114'114 uv114 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.451+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e57e50 con 0x55fb32e4ee20 2023-10-06T02:27:12.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.452+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v114'115 uv115 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.452+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e57e50 con 0x55fb32e4ee20 2023-10-06T02:27:12.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.453+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v114'116 uv116 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e4ee20 2023-10-06T02:27:12.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.453+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55fb32e58e90 0x55fb32e5b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.453+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e57e50 con 0x55fb32e58e90 2023-10-06T02:27:12.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.453+0000 7f91c2e76700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55fb32e58e90 0x55fb32e5b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.454+0000 7f91c2e76700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55fb32e58e90 0x55fb32e5b270 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:12.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.455+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v114'205 uv198 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e58e90 2023-10-06T02:27:12.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.455+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5b7b0 con 0x55fb32e58e90 2023-10-06T02:27:12.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.456+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v114'206 uv206 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e58e90 2023-10-06T02:27:12.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.456+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5b7b0 con 0x55fb32e58e90 2023-10-06T02:27:12.457 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:27:12.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.457+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v114'207 uv207 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e58e90 2023-10-06T02:27:12.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.457+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5c7c0 con 0x55fb32e58e90 2023-10-06T02:27:12.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.458+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v114'208 uv208 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e58e90 2023-10-06T02:27:12.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.458+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5c7c0 con 0x55fb32e58e90 2023-10-06T02:27:12.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.459+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v114'209 uv209 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e58e90 2023-10-06T02:27:12.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.459+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5b7b0 con 0x55fb32e58e90 2023-10-06T02:27:12.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.460+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v114'210 uv210 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e58e90 2023-10-06T02:27:12.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.460+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5b7b0 con 0x55fb32e58e90 2023-10-06T02:27:12.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.462+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v114'211 uv204 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e58e90 2023-10-06T02:27:12.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.462+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5b7b0 con 0x55fb32e58e90 2023-10-06T02:27:12.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.463+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v114'212 uv212 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e58e90 2023-10-06T02:27:12.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.463+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5b7b0 con 0x55fb32e58e90 2023-10-06T02:27:12.464 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:27:12.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.464+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v114'213 uv213 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e58e90 2023-10-06T02:27:12.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.464+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5b7b0 con 0x55fb32e58e90 2023-10-06T02:27:12.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.465+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v114'214 uv214 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e58e90 2023-10-06T02:27:12.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.465+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5b7b0 con 0x55fb32e58e90 2023-10-06T02:27:12.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.466+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v114'215 uv215 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e58e90 2023-10-06T02:27:12.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.466+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55fb32e5be30 0x55fb32e5e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.466+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5e8d0 con 0x55fb32e5be30 2023-10-06T02:27:12.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.467+0000 7f91c2675700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55fb32e5be30 0x55fb32e5e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.467+0000 7f91c2675700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55fb32e5be30 0x55fb32e5e210 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:12.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.468+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v114'91 uv90 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e5be30 2023-10-06T02:27:12.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.468+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5ecb0 con 0x55fb32e5be30 2023-10-06T02:27:12.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.472+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v114'92 uv92 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e5be30 2023-10-06T02:27:12.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.472+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5ecb0 con 0x55fb32e5be30 2023-10-06T02:27:12.474 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:27:12.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.473+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v114'93 uv93 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e5be30 2023-10-06T02:27:12.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.473+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5ecb0 con 0x55fb32e5be30 2023-10-06T02:27:12.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.476+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v114'94 uv94 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e5be30 2023-10-06T02:27:12.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.476+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5ecb0 con 0x55fb32e5be30 2023-10-06T02:27:12.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.479+0000 7f91c2675700 1 -- 172.21.15.6:0/4110793566 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v114'95 uv95 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f91b4015070 con 0x55fb32e5be30 2023-10-06T02:27:12.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.479+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5ecb0 con 0x55fb32e53b10 2023-10-06T02:27:12.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.480+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v114'111 uv110 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.480+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5ecb0 con 0x55fb32e53b10 2023-10-06T02:27:12.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.481+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v114'112 uv112 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.481+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5ecb0 con 0x55fb32e53b10 2023-10-06T02:27:12.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.482+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v114'113 uv113 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.483 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:27:12.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.482+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5fcc0 con 0x55fb32e53b10 2023-10-06T02:27:12.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.483+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v114'114 uv114 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.483+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5fcc0 con 0x55fb32e53b10 2023-10-06T02:27:12.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.484+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v114'115 uv115 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.484+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e5ecb0 con 0x55fb32e53b10 2023-10-06T02:27:12.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.486+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v114'116 uv116 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.486+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55fb32e5f330 0x55fb32e61710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.486+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e61d70 con 0x55fb32e5f330 2023-10-06T02:27:12.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.486+0000 7f91bbfff700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55fb32e5f330 0x55fb32e61710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.487+0000 7f91bbfff700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55fb32e5f330 0x55fb32e61710 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:12.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.488+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v114'182 uv176 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e5f330 2023-10-06T02:27:12.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.488+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62150 con 0x55fb32e5f330 2023-10-06T02:27:12.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.489+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v114'183 uv183 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e5f330 2023-10-06T02:27:12.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.489+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62150 con 0x55fb32e5f330 2023-10-06T02:27:12.492 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:27:12.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.492+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v114'184 uv184 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e5f330 2023-10-06T02:27:12.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.492+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62150 con 0x55fb32e5f330 2023-10-06T02:27:12.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.493+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v114'185 uv185 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e5f330 2023-10-06T02:27:12.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.493+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62150 con 0x55fb32e5f330 2023-10-06T02:27:12.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.494+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v114'186 uv186 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e5f330 2023-10-06T02:27:12.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.494+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62150 con 0x55fb32e5f330 2023-10-06T02:27:12.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.495+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v114'187 uv181 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e5f330 2023-10-06T02:27:12.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.495+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62150 con 0x55fb32e5f330 2023-10-06T02:27:12.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.496+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v114'188 uv188 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e5f330 2023-10-06T02:27:12.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.496+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62150 con 0x55fb32e5f330 2023-10-06T02:27:12.497 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:27:12.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.497+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v114'189 uv189 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e5f330 2023-10-06T02:27:12.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.497+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62150 con 0x55fb32e5f330 2023-10-06T02:27:12.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.498+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v114'190 uv190 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e5f330 2023-10-06T02:27:12.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.498+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e64ec0 con 0x55fb32e5f330 2023-10-06T02:27:12.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.499+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v114'191 uv191 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e5f330 2023-10-06T02:27:12.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.499+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62640 con 0x55fb32e53b10 2023-10-06T02:27:12.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.500+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v114'83 uv81 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.500+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62640 con 0x55fb32e53b10 2023-10-06T02:27:12.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.501+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v114'84 uv84 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.501+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62640 con 0x55fb32e53b10 2023-10-06T02:27:12.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.502+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v114'85 uv85 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.502 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:27:12.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.502+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62640 con 0x55fb32e53b10 2023-10-06T02:27:12.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.503+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v114'86 uv86 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.503+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55fb32e62f50 0x55fb32e65610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.503+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62640 con 0x55fb32e62f50 2023-10-06T02:27:12.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.503+0000 7f91c2e76700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55fb32e62f50 0x55fb32e65610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.503+0000 7f91c2e76700 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55fb32e62f50 0x55fb32e65610 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.504+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v114'111 uv110 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e62f50 2023-10-06T02:27:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.504+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62640 con 0x55fb32e62f50 2023-10-06T02:27:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.505+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v114'112 uv112 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e62f50 2023-10-06T02:27:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.505+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62640 con 0x55fb32e62f50 2023-10-06T02:27:12.511 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:27:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.511+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v114'113 uv113 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e62f50 2023-10-06T02:27:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.511+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62640 con 0x55fb32e62f50 2023-10-06T02:27:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.512+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v114'114 uv114 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e62f50 2023-10-06T02:27:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.512+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62640 con 0x55fb32e62f50 2023-10-06T02:27:12.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.515+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v114'115 uv115 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e62f50 2023-10-06T02:27:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.515+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62640 con 0x55fb32e62f50 2023-10-06T02:27:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.516+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v114'116 uv116 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e62f50 2023-10-06T02:27:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.516+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62640 con 0x55fb32e58e90 2023-10-06T02:27:12.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.517+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v114'94 uv93 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e58e90 2023-10-06T02:27:12.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.517+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62640 con 0x55fb32e58e90 2023-10-06T02:27:12.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.518+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v114'95 uv95 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e58e90 2023-10-06T02:27:12.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.518+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62640 con 0x55fb32e58e90 2023-10-06T02:27:12.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.519+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v114'96 uv96 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e58e90 2023-10-06T02:27:12.520 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:27:12.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.519+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62640 con 0x55fb32e58e90 2023-10-06T02:27:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.520+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v114'97 uv97 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e58e90 2023-10-06T02:27:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.520+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62640 con 0x55fb32e58e90 2023-10-06T02:27:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.521+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v114'98 uv98 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f91bc004520 con 0x55fb32e58e90 2023-10-06T02:27:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.521+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62640 con 0x55fb32e53b10 2023-10-06T02:27:12.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.522+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v114'229 uv220 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.522+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62610 con 0x55fb32e53b10 2023-10-06T02:27:12.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.523+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v114'230 uv230 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.523+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62610 con 0x55fb32e53b10 2023-10-06T02:27:12.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.524+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v114'231 uv231 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.525 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:27:12.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.524+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62610 con 0x55fb32e53b10 2023-10-06T02:27:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.525+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v114'232 uv232 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.525+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e65b50 con 0x55fb32e53b10 2023-10-06T02:27:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.526+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v114'233 uv233 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.526+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e65b50 con 0x55fb32e53b10 2023-10-06T02:27:12.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.527+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v114'234 uv227 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.527+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62610 con 0x55fb32e53b10 2023-10-06T02:27:12.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.529+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v114'235 uv235 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.529+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62610 con 0x55fb32e53b10 2023-10-06T02:27:12.530 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:27:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.530+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v114'236 uv236 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.530+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62610 con 0x55fb32e53b10 2023-10-06T02:27:12.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.531+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v114'237 uv237 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.531+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62610 con 0x55fb32e53b10 2023-10-06T02:27:12.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.532+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v114'238 uv238 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.532+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e65b50 con 0x55fb32e53b10 2023-10-06T02:27:12.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.533+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v114'239 uv239 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.533+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55fb32e62520 con 0x55fb32e53b10 2023-10-06T02:27:12.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91bbfff700 1 -- 172.21.15.6:0/4110793566 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v114'240 uv240 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f91ac0079f0 con 0x55fb32e53b10 2023-10-06T02:27:12.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55fb32e53b10 msgr2=0x55fb32e55ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55fb32e53b10 0x55fb32e55ef0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55fb32e16a40 msgr2=0x55fb32e2bf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55fb32e16a40 0x55fb32e2bf30 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55fb32e5f330 msgr2=0x55fb32e61710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55fb32e5f330 0x55fb32e61710 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55fb32e4ee20 msgr2=0x55fb32e51200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55fb32e4ee20 0x55fb32e51200 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55fb32e62f50 msgr2=0x55fb32e65610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55fb32e62f50 0x55fb32e65610 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55fb32e5be30 msgr2=0x55fb32e5e210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55fb32e5be30 0x55fb32e5e210 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55fb32e58e90 msgr2=0x55fb32e5b270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 reap_dead start 2023-10-06T02:27:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55fb32e58e90 0x55fb32e5b270 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 reap_dead start 2023-10-06T02:27:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 reap_dead start 2023-10-06T02:27:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.534+0000 7f91c2e76700 1 -- 172.21.15.6:0/4110793566 reap_dead start 2023-10-06T02:27:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.535+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f91a40658c0 msgr2=0x7f91a4067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.535+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f91a40658c0 0x7f91a4067d70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00afd0 tx=0x7f91ac015000 comp rx=0 tx=0).stop 2023-10-06T02:27:12.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.535+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb32d58160 msgr2=0x55fb32e15fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.535+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb32d58160 0x55fb32e15fc0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f91b4000c00 tx=0x7f91b4017000 comp rx=0 tx=0).stop 2023-10-06T02:27:12.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.535+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 shutdown_connections 2023-10-06T02:27:12.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.535+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb32d58160 0x55fb32e15fc0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.535+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f91a40658c0 0x7f91a4067d70 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.535+0000 7f91c943a000 1 --2- 172.21.15.6:0/4110793566 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55fb32e58e90 0x55fb32e5b270 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.535+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 >> 172.21.15.6:0/4110793566 conn(0x55fb32da0bd0 msgr2=0x55fb32d89220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:12.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.535+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 shutdown_connections 2023-10-06T02:27:12.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.535+0000 7f91c943a000 1 -- 172.21.15.6:0/4110793566 wait complete. 2023-10-06T02:27:12.540 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds_snaptable - 2023-10-06T02:27:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.619+0000 7faa2bca6000 1 Processor -- start 2023-10-06T02:27:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.619+0000 7faa2bca6000 1 -- start start 2023-10-06T02:27:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.619+0000 7faa2bca6000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55774b801680 0x55774b81df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.619+0000 7faa2bca6000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55774b803ab0 0x55774b8b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.619+0000 7faa2bca6000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55774b803e80 0x55774b8b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.619+0000 7faa2bca6000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774b71f980 con 0x55774b803e80 2023-10-06T02:27:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.619+0000 7faa2bca6000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774b71f620 con 0x55774b801680 2023-10-06T02:27:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.619+0000 7faa2bca6000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55774b716400 con 0x55774b803ab0 2023-10-06T02:27:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.620+0000 7faa256e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55774b803e80 0x55774b8b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.620+0000 7faa256e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55774b803e80 0x55774b8b68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56212/0 (socket says 172.21.15.6:56212) 2023-10-06T02:27:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.620+0000 7faa1c6e0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55774b803ab0 0x55774b8b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.620+0000 7faa256e2700 1 -- 172.21.15.6:0/3784516903 learned_addr learned my addr 172.21.15.6:0/3784516903 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.620+0000 7faa24ee1700 1 --2- 172.21.15.6:0/3784516903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55774b801680 0x55774b81df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.620+0000 7faa256e2700 1 -- 172.21.15.6:0/3784516903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55774b803ab0 msgr2=0x55774b8b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.620+0000 7faa256e2700 1 --2- 172.21.15.6:0/3784516903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55774b803ab0 0x55774b8b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.620+0000 7faa256e2700 1 -- 172.21.15.6:0/3784516903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55774b801680 msgr2=0x55774b81df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.620+0000 7faa256e2700 1 --2- 172.21.15.6:0/3784516903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55774b801680 0x55774b81df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.620+0000 7faa256e2700 1 -- 172.21.15.6:0/3784516903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa14005db0 con 0x55774b803e80 2023-10-06T02:27:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.620+0000 7faa24ee1700 1 --2- 172.21.15.6:0/3784516903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55774b801680 0x55774b81df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.620+0000 7faa256e2700 1 --2- 172.21.15.6:0/3784516903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55774b803e80 0x55774b8b68d0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7faa20001550 tx=0x7faa20006b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca54aa914fc4e0f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.620+0000 7faa1f7fe700 1 -- 172.21.15.6:0/3784516903 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa20006110 con 0x55774b803e80 2023-10-06T02:27:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.620+0000 7faa1f7fe700 1 -- 172.21.15.6:0/3784516903 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa20006290 con 0x55774b803e80 2023-10-06T02:27:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.620+0000 7faa1f7fe700 1 -- 172.21.15.6:0/3784516903 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa20013670 con 0x55774b803e80 2023-10-06T02:27:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.621+0000 7faa2bca6000 1 -- 172.21.15.6:0/3784516903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55774b803e80 msgr2=0x55774b8b68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.621+0000 7faa2bca6000 1 --2- 172.21.15.6:0/3784516903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55774b803e80 0x55774b8b68d0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7faa20001550 tx=0x7faa20006b10 comp rx=0 tx=0).stop 2023-10-06T02:27:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.621+0000 7faa2bca6000 1 -- 172.21.15.6:0/3784516903 shutdown_connections 2023-10-06T02:27:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.621+0000 7faa2bca6000 1 --2- 172.21.15.6:0/3784516903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55774b803e80 0x55774b8b68d0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.621+0000 7faa2bca6000 1 --2- 172.21.15.6:0/3784516903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55774b801680 0x55774b81df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.621+0000 7faa2bca6000 1 --2- 172.21.15.6:0/3784516903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55774b803ab0 0x55774b8b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.621+0000 7faa2bca6000 1 -- 172.21.15.6:0/3784516903 >> 172.21.15.6:0/3784516903 conn(0x55774b81bbd0 msgr2=0x55774b81e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.621+0000 7faa2bca6000 1 -- 172.21.15.6:0/3784516903 shutdown_connections 2023-10-06T02:27:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.621+0000 7faa2bca6000 1 -- 172.21.15.6:0/3784516903 wait complete. 2023-10-06T02:27:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.621+0000 7faa2bca6000 1 Processor -- start 2023-10-06T02:27:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.621+0000 7faa2bca6000 1 -- start start 2023-10-06T02:27:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.622+0000 7faa2bca6000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55774b801680 0x55774b8b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.622+0000 7faa2bca6000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55774b803ab0 0x55774b8b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.622+0000 7faa2bca6000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55774b803e80 0x55774b8a5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.622+0000 7faa2bca6000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774b8b4600 con 0x55774b803e80 2023-10-06T02:27:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.622+0000 7faa2bca6000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774b8b48a0 con 0x55774b801680 2023-10-06T02:27:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.622+0000 7faa2bca6000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55774b8b4b40 con 0x55774b803ab0 2023-10-06T02:27:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.622+0000 7faa256e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55774b803e80 0x55774b8a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.622+0000 7faa256e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55774b803e80 0x55774b8a5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56222/0 (socket says 172.21.15.6:56222) 2023-10-06T02:27:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.622+0000 7faa256e2700 1 -- 172.21.15.6:0/1142903195 learned_addr learned my addr 172.21.15.6:0/1142903195 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.622+0000 7faa24ee1700 1 --2- 172.21.15.6:0/1142903195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55774b801680 0x55774b8b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.622+0000 7faa1c6e0700 1 --2- 172.21.15.6:0/1142903195 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55774b803ab0 0x55774b8b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.622+0000 7faa256e2700 1 -- 172.21.15.6:0/1142903195 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55774b803ab0 msgr2=0x55774b8b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.622+0000 7faa256e2700 1 --2- 172.21.15.6:0/1142903195 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55774b803ab0 0x55774b8b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.622+0000 7faa256e2700 1 -- 172.21.15.6:0/1142903195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55774b801680 msgr2=0x55774b8b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.622+0000 7faa256e2700 1 --2- 172.21.15.6:0/1142903195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55774b801680 0x55774b8b5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.622+0000 7faa256e2700 1 -- 172.21.15.6:0/1142903195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55774b721750 con 0x55774b803e80 2023-10-06T02:27:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.622+0000 7faa1c6e0700 1 --2- 172.21.15.6:0/1142903195 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55774b803ab0 0x55774b8b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.623+0000 7faa256e2700 1 --2- 172.21.15.6:0/1142903195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55774b803e80 0x55774b8a5000 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x55774b7d69a0 tx=0x7faa20014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.623+0000 7faa1dffb700 1 -- 172.21.15.6:0/1142903195 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa20003660 con 0x55774b803e80 2023-10-06T02:27:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.623+0000 7faa1dffb700 1 -- 172.21.15.6:0/1142903195 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa200037c0 con 0x55774b803e80 2023-10-06T02:27:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.623+0000 7faa2bca6000 1 -- 172.21.15.6:0/1142903195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55774b72e3d0 con 0x55774b803e80 2023-10-06T02:27:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.623+0000 7faa1dffb700 1 -- 172.21.15.6:0/1142903195 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa20003b60 con 0x55774b803e80 2023-10-06T02:27:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.623+0000 7faa2bca6000 1 -- 172.21.15.6:0/1142903195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55774b721ae0 con 0x55774b803e80 2023-10-06T02:27:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.624+0000 7faa1dffb700 1 -- 172.21.15.6:0/1142903195 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa200123c0 con 0x55774b803e80 2023-10-06T02:27:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.624+0000 7faa1dffb700 1 --2- 172.21.15.6:0/1142903195 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faa040658c0 0x7faa04067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.625+0000 7faa1dffb700 1 -- 172.21.15.6:0/1142903195 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8012+0+0 (secure 0 0 0) 0x7faa20084ef0 con 0x55774b803e80 2023-10-06T02:27:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.625+0000 7faa24ee1700 1 --2- 172.21.15.6:0/1142903195 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faa040658c0 0x7faa04067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.625+0000 7faa2bca6000 1 --2- 172.21.15.6:0/1142903195 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55774b8b19c0 0x55774b8bd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.625+0000 7faa2bca6000 1 -- 172.21.15.6:0/1142903195 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:1 14.d 14:b50e409b:::mds_snaptable:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v8 -- 0x55774b8b5b10 con 0x55774b8b19c0 2023-10-06T02:27:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.625+0000 7faa1c6e0700 1 --2- 172.21.15.6:0/1142903195 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55774b8b19c0 0x55774b8bd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.625+0000 7faa24ee1700 1 --2- 172.21.15.6:0/1142903195 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faa040658c0 0x7faa04067d70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7faa14005b50 tx=0x7faa14016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.625+0000 7faa1c6e0700 1 --2- 172.21.15.6:0/1142903195 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55774b8b19c0 0x55774b8bd910 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.627+0000 7faa1c6e0700 1 -- 172.21.15.6:0/1142903195 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(1 mds_snaptable [writefull 0~80] v114'96 uv96 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7faa0c009a50 con 0x55774b8b19c0 2023-10-06T02:27:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.627+0000 7faa2bca6000 1 -- 172.21.15.6:0/1142903195 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55774b8b19c0 msgr2=0x55774b8bd910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.627+0000 7faa2bca6000 1 --2- 172.21.15.6:0/1142903195 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55774b8b19c0 0x55774b8bd910 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.627+0000 7faa2bca6000 1 -- 172.21.15.6:0/1142903195 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faa040658c0 msgr2=0x7faa04067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.627+0000 7faa2bca6000 1 --2- 172.21.15.6:0/1142903195 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7faa040658c0 0x7faa04067d70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7faa14005b50 tx=0x7faa14016000 comp rx=0 tx=0).stop 2023-10-06T02:27:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.627+0000 7faa2bca6000 1 -- 172.21.15.6:0/1142903195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55774b803e80 msgr2=0x55774b8a5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.627+0000 7faa2bca6000 1 --2- 172.21.15.6:0/1142903195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55774b803e80 0x55774b8a5000 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x55774b7d69a0 tx=0x7faa20014000 comp rx=0 tx=0).stop 2023-10-06T02:27:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.627+0000 7faa256e2700 1 -- 172.21.15.6:0/1142903195 reap_dead start 2023-10-06T02:27:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.627+0000 7faa2bca6000 1 -- 172.21.15.6:0/1142903195 shutdown_connections 2023-10-06T02:27:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.627+0000 7faa2bca6000 1 -- 172.21.15.6:0/1142903195 >> 172.21.15.6:0/1142903195 conn(0x55774b81bbd0 msgr2=0x55774b81e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.627+0000 7faa2bca6000 1 -- 172.21.15.6:0/1142903195 shutdown_connections 2023-10-06T02:27:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.627+0000 7faa2bca6000 1 -- 172.21.15.6:0/1142903195 wait complete. 2023-10-06T02:27:12.635 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:27:12.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.791+0000 7f5f58e39700 1 Processor -- start 2023-10-06T02:27:12.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.791+0000 7f5f58e39700 1 -- start start 2023-10-06T02:27:12.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.792+0000 7f5f58e39700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f540cc370 0x7f5f5406a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.792+0000 7f5f58e39700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f540ccd20 0x7f5f5406a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.792+0000 7f5f58e39700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f540b4e20 con 0x7f5f54159190 2023-10-06T02:27:12.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.792+0000 7f5f58e39700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f540cd5a0 con 0x7f5f540ccd20 2023-10-06T02:27:12.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.792+0000 7f5f58e39700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f540b4570 con 0x7f5f540cc370 2023-10-06T02:27:12.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.792+0000 7f5f52d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f540ccd20 0x7f5f5406a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.793+0000 7f5f52d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f540ccd20 0x7f5f5406a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56230/0 (socket says 172.21.15.6:56230) 2023-10-06T02:27:12.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.793+0000 7f5f52d9d700 1 -- 172.21.15.6:0/1182801252 learned_addr learned my addr 172.21.15.6:0/1182801252 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:12.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.793+0000 7f5f51d9b700 1 --2- 172.21.15.6:0/1182801252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f540cc370 0x7f5f5406a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.793+0000 7f5f52d9d700 1 -- 172.21.15.6:0/1182801252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f540cc370 msgr2=0x7f5f5406a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:12.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.793+0000 7f5f52d9d700 1 --2- 172.21.15.6:0/1182801252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f540cc370 0x7f5f5406a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.793+0000 7f5f52d9d700 1 -- 172.21.15.6:0/1182801252 >> v1:172.21.15.175:6789/0 conn(0x7f5f54159190 legacy=0x7f5f540ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.793+0000 7f5f52d9d700 1 -- 172.21.15.6:0/1182801252 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f540cd2c0 con 0x7f5f540ccd20 2023-10-06T02:27:12.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.793+0000 7f5f52d9d700 1 --2- 172.21.15.6:0/1182801252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f540ccd20 0x7f5f5406a730 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009f20 tx=0x7f5f4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cee53e071d1d860 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:12.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.793+0000 7f5f5159a700 1 -- 172.21.15.6:0/1182801252 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c00e070 con 0x7f5f540ccd20 2023-10-06T02:27:12.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.793+0000 7f5f5159a700 1 -- 172.21.15.6:0/1182801252 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4c00ba80 con 0x7f5f540ccd20 2023-10-06T02:27:12.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.793+0000 7f5f5159a700 1 -- 172.21.15.6:0/1182801252 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c0092e0 con 0x7f5f540ccd20 2023-10-06T02:27:12.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.794+0000 7f5f58e39700 1 -- 172.21.15.6:0/1182801252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f540ccd20 msgr2=0x7f5f5406a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.794+0000 7f5f58e39700 1 --2- 172.21.15.6:0/1182801252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f540ccd20 0x7f5f5406a730 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009f20 tx=0x7f5f4c009840 comp rx=0 tx=0).stop 2023-10-06T02:27:12.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.794+0000 7f5f58e39700 1 -- 172.21.15.6:0/1182801252 shutdown_connections 2023-10-06T02:27:12.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.794+0000 7f5f58e39700 1 --2- 172.21.15.6:0/1182801252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f540ccd20 0x7f5f5406a730 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.794+0000 7f5f58e39700 1 --2- 172.21.15.6:0/1182801252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f540cc370 0x7f5f5406a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.794+0000 7f5f58e39700 1 -- 172.21.15.6:0/1182801252 >> 172.21.15.6:0/1182801252 conn(0x7f5f54087340 msgr2=0x7f5f54087710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:12.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.794+0000 7f5f58e39700 1 -- 172.21.15.6:0/1182801252 shutdown_connections 2023-10-06T02:27:12.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.794+0000 7f5f58e39700 1 -- 172.21.15.6:0/1182801252 wait complete. 2023-10-06T02:27:12.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.795+0000 7f5f58e39700 1 Processor -- start 2023-10-06T02:27:12.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.795+0000 7f5f58e39700 1 -- start start 2023-10-06T02:27:12.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f58e39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f540cc370 0x7f5f54151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f58e39700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f540ccd20 0x7f5f541554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f58e39700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f54159190 0x7f5f5413dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f58e39700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54156940 con 0x7f5f540cc370 2023-10-06T02:27:12.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f58e39700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54155d30 con 0x7f5f54159190 2023-10-06T02:27:12.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f58e39700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54156010 con 0x7f5f540ccd20 2023-10-06T02:27:12.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f5259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f540cc370 0x7f5f54151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f51d9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f540ccd20 0x7f5f541554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f5259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f540cc370 0x7f5f54151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56244/0 (socket says 172.21.15.6:56244) 2023-10-06T02:27:12.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f5259c700 1 -- 172.21.15.6:0/3337394605 learned_addr learned my addr 172.21.15.6:0/3337394605 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:12.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f52d9d700 1 --2- 172.21.15.6:0/3337394605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f54159190 0x7f5f5413dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f5259c700 1 -- 172.21.15.6:0/3337394605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f540ccd20 msgr2=0x7f5f541554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f5259c700 1 --2- 172.21.15.6:0/3337394605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f540ccd20 0x7f5f541554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f5259c700 1 -- 172.21.15.6:0/3337394605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f54159190 msgr2=0x7f5f5413dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:12.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f5259c700 1 --2- 172.21.15.6:0/3337394605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f54159190 0x7f5f5413dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:12.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f5259c700 1 -- 172.21.15.6:0/3337394605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c009ae0 con 0x7f5f540cc370 2023-10-06T02:27:12.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f5259c700 1 --2- 172.21.15.6:0/3337394605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f540cc370 0x7f5f54151f00 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400c4e0 tx=0x7f5f4400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:12.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f427fc700 1 -- 172.21.15.6:0/3337394605 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44011590 con 0x7f5f540cc370 2023-10-06T02:27:12.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f427fc700 1 -- 172.21.15.6:0/3337394605 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f44011710 con 0x7f5f540cc370 2023-10-06T02:27:12.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.796+0000 7f5f58e39700 1 -- 172.21.15.6:0/3337394605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f541562f0 con 0x7f5f540cc370 2023-10-06T02:27:12.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.797+0000 7f5f427fc700 1 -- 172.21.15.6:0/3337394605 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44011ad0 con 0x7f5f540cc370 2023-10-06T02:27:12.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.797+0000 7f5f58e39700 1 -- 172.21.15.6:0/3337394605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f54155a20 con 0x7f5f540cc370 2023-10-06T02:27:12.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.797+0000 7f5f58e39700 1 -- 172.21.15.6:0/3337394605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f54088a20 con 0x7f5f540cc370 2023-10-06T02:27:12.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.798+0000 7f5f427fc700 1 -- 172.21.15.6:0/3337394605 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f4401b3b0 con 0x7f5f540cc370 2023-10-06T02:27:12.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.798+0000 7f5f427fc700 1 --2- 172.21.15.6:0/3337394605 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f34066f30 0x7f5f340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:12.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.799+0000 7f5f427fc700 1 -- 172.21.15.6:0/3337394605 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8012+0+0 (secure 0 0 0) 0x7f5f44084230 con 0x7f5f540cc370 2023-10-06T02:27:12.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.799+0000 7f5f51d9b700 1 --2- 172.21.15.6:0/3337394605 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f34066f30 0x7f5f340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:12.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.799+0000 7f5f51d9b700 1 --2- 172.21.15.6:0/3337394605 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f34066f30 0x7f5f340693e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5f5416d1c0 tx=0x7f5f48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:12.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:12.803+0000 7f5f427fc700 1 -- 172.21.15.6:0/3337394605 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f44050ba0 con 0x7f5f540cc370 2023-10-06T02:27:13.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.045+0000 7f5f58e39700 1 -- 172.21.15.6:0/3337394605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f5f540b47d0 con 0x7f5f540cc370 2023-10-06T02:27:13.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.274+0000 7f5f427fc700 1 -- 172.21.15.6:0/3337394605 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v213) v1 ==== 162+0+0 (secure 0 0 0) 0x7f5f44017070 con 0x7f5f540cc370 2023-10-06T02:27:13.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.276+0000 7f5f58e39700 1 -- 172.21.15.6:0/3337394605 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f34066f30 msgr2=0x7f5f340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:13.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.276+0000 7f5f58e39700 1 --2- 172.21.15.6:0/3337394605 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f34066f30 0x7f5f340693e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5f5416d1c0 tx=0x7f5f48008040 comp rx=0 tx=0).stop 2023-10-06T02:27:13.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.276+0000 7f5f58e39700 1 -- 172.21.15.6:0/3337394605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f540cc370 msgr2=0x7f5f54151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:13.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.276+0000 7f5f58e39700 1 --2- 172.21.15.6:0/3337394605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f540cc370 0x7f5f54151f00 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400c4e0 tx=0x7f5f4400c7f0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.277+0000 7f5f58e39700 1 -- 172.21.15.6:0/3337394605 shutdown_connections 2023-10-06T02:27:13.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.277+0000 7f5f58e39700 1 --2- 172.21.15.6:0/3337394605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f54159190 0x7f5f5413dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.277+0000 7f5f58e39700 1 --2- 172.21.15.6:0/3337394605 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f34066f30 0x7f5f340693e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.277+0000 7f5f58e39700 1 --2- 172.21.15.6:0/3337394605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f540cc370 0x7f5f54151f00 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.277+0000 7f5f58e39700 1 --2- 172.21.15.6:0/3337394605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f540ccd20 0x7f5f541554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.277+0000 7f5f58e39700 1 -- 172.21.15.6:0/3337394605 >> 172.21.15.6:0/3337394605 conn(0x7f5f54087340 msgr2=0x7f5f540b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:13.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.277+0000 7f5f58e39700 1 -- 172.21.15.6:0/3337394605 shutdown_connections 2023-10-06T02:27:13.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.277+0000 7f5f58e39700 1 -- 172.21.15.6:0/3337394605 wait complete. 2023-10-06T02:27:13.279 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:27:13.279 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:27:13.279+0000 7f5806849700 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds_snaptable': virtual void SnapServer::decode_server_state(ceph::buffer::v15_2_0::list::const_iterator&) no longer understand old encoding version 5 < 101: Malformed input 2023-10-06T02:27:13.280 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:13.280+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:27:13.280 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:13.280+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:27:13.287 INFO:tasks.ceph.mds.a.smithi006.stderr: -22> 2023-10-06T02:27:13.279+0000 7f5806849700 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds_snaptable': virtual void SnapServer::decode_server_state(ceph::buffer::v15_2_0::list::const_iterator&) no longer understand old encoding version 5 < 101: Malformed input 2023-10-06T02:27:13.293 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:13.307 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:27:13.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.413+0000 7fd97f59e700 1 Processor -- start 2023-10-06T02:27:13.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.413+0000 7fd97f59e700 1 -- start start 2023-10-06T02:27:13.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.414+0000 7fd97f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd980069bf0 0x7fd9800b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:13.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.414+0000 7fd97f59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd98006a430 0x7fd9800af040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:13.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.414+0000 7fd97f59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9800b16c0 con 0x7fd980069fc0 2023-10-06T02:27:13.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.414+0000 7fd97f59e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9800b1f40 con 0x7fd98006a430 2023-10-06T02:27:13.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.414+0000 7fd97f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98006a850 con 0x7fd980069bf0 2023-10-06T02:27:13.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.414+0000 7fd97ed9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd98006a430 0x7fd9800af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:13.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.414+0000 7fd97e59c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd980069bf0 0x7fd9800b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:13.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.414+0000 7fd97dd9b700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd980069fc0 0x7fd9800ae930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:50292/0 (socket says 172.21.15.6:50292) 2023-10-06T02:27:13.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.414+0000 7fd97dd9b700 1 -- 172.21.15.6:0/3391804529 learned_addr learned my addr 172.21.15.6:0/3391804529 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:13.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.415+0000 7fd97d59a700 1 -- 172.21.15.6:0/3391804529 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252457606 0 0) 0x7fd9800b16c0 con 0x7fd980069fc0 2023-10-06T02:27:13.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.415+0000 7fd97d59a700 1 -- 172.21.15.6:0/3391804529 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd96c003570 con 0x7fd980069fc0 2023-10-06T02:27:13.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.415+0000 7fd97e59c700 1 -- 172.21.15.6:0/3391804529 >> v2:172.21.15.175:3300/0 conn(0x7fd98006a430 msgr2=0x7fd9800af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:13.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.415+0000 7fd97e59c700 1 --2- 172.21.15.6:0/3391804529 >> v2:172.21.15.175:3300/0 conn(0x7fd98006a430 0x7fd9800af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.415+0000 7fd97e59c700 1 -- 172.21.15.6:0/3391804529 >> v1:172.21.15.175:6789/0 conn(0x7fd980069fc0 legacy=0x7fd9800ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:13.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.415+0000 7fd97e59c700 1 -- 172.21.15.6:0/3391804529 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9800b08c0 con 0x7fd980069bf0 2023-10-06T02:27:13.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.415+0000 7fd97ed9d700 1 --2- 172.21.15.6:0/3391804529 >> v2:172.21.15.175:3300/0 conn(0x7fd98006a430 0x7fd9800af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:13.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.415+0000 7fd97e59c700 1 --2- 172.21.15.6:0/3391804529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd980069bf0 0x7fd9800b0380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd9780098d0 tx=0x7fd978009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8accb75561001922 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:13.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.415+0000 7fd97d59a700 1 -- 172.21.15.6:0/3391804529 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd978005c10 con 0x7fd980069bf0 2023-10-06T02:27:13.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.415+0000 7fd97d59a700 1 -- 172.21.15.6:0/3391804529 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd978005d70 con 0x7fd980069bf0 2023-10-06T02:27:13.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.415+0000 7fd97d59a700 1 -- 172.21.15.6:0/3391804529 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd978006240 con 0x7fd980069bf0 2023-10-06T02:27:13.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.416+0000 7fd97f59e700 1 -- 172.21.15.6:0/3391804529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd980069bf0 msgr2=0x7fd9800b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:13.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.416+0000 7fd97f59e700 1 --2- 172.21.15.6:0/3391804529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd980069bf0 0x7fd9800b0380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd9780098d0 tx=0x7fd978009120 comp rx=0 tx=0).stop 2023-10-06T02:27:13.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.416+0000 7fd97f59e700 1 -- 172.21.15.6:0/3391804529 shutdown_connections 2023-10-06T02:27:13.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.416+0000 7fd97f59e700 1 --2- 172.21.15.6:0/3391804529 >> v2:172.21.15.175:3300/0 conn(0x7fd98006a430 0x7fd9800af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.416+0000 7fd97f59e700 1 --2- 172.21.15.6:0/3391804529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd980069bf0 0x7fd9800b0380 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.416+0000 7fd97f59e700 1 -- 172.21.15.6:0/3391804529 >> 172.21.15.6:0/3391804529 conn(0x7fd980067910 msgr2=0x7fd9800cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:13.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.416+0000 7fd97f59e700 1 -- 172.21.15.6:0/3391804529 shutdown_connections 2023-10-06T02:27:13.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.416+0000 7fd97f59e700 1 -- 172.21.15.6:0/3391804529 wait complete. 2023-10-06T02:27:13.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.417+0000 7fd97f59e700 1 Processor -- start 2023-10-06T02:27:13.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.417+0000 7fd97f59e700 1 -- start start 2023-10-06T02:27:13.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.417+0000 7fd97f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd980069bf0 0x7fd9801516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:13.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.417+0000 7fd97f59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd980069fc0 0x7fd98009b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:13.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd97f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98006a430 0x7fd98009b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:13.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd97f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd980153bc0 con 0x7fd98006a430 2023-10-06T02:27:13.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd97f59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd980159700 con 0x7fd980069fc0 2023-10-06T02:27:13.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd97f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd980152f40 con 0x7fd980069bf0 2023-10-06T02:27:13.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd97ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98006a430 0x7fd98009b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:13.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd97e59c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd980069bf0 0x7fd9801516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:13.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd97ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98006a430 0x7fd98009b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56282/0 (socket says 172.21.15.6:56282) 2023-10-06T02:27:13.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd97ed9d700 1 -- 172.21.15.6:0/862353632 learned_addr learned my addr 172.21.15.6:0/862353632 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:13.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd97dd9b700 1 --2- 172.21.15.6:0/862353632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd980069fc0 0x7fd98009b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:13.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd97e59c700 1 -- 172.21.15.6:0/862353632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd980069fc0 msgr2=0x7fd98009b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:13.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd97e59c700 1 --2- 172.21.15.6:0/862353632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd980069fc0 0x7fd98009b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd97e59c700 1 -- 172.21.15.6:0/862353632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98006a430 msgr2=0x7fd98009b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:13.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd97e59c700 1 --2- 172.21.15.6:0/862353632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98006a430 0x7fd98009b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd97e59c700 1 -- 172.21.15.6:0/862353632 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd970009a20 con 0x7fd980069bf0 2023-10-06T02:27:13.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd97ed9d700 1 --2- 172.21.15.6:0/862353632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98006a430 0x7fd98009b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:13.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd97e59c700 1 --2- 172.21.15.6:0/862353632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd980069bf0 0x7fd9801516f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd978015000 tx=0x7fd978016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:13.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd9767fc700 1 -- 172.21.15.6:0/862353632 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97801a700 con 0x7fd980069bf0 2023-10-06T02:27:13.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd9767fc700 1 -- 172.21.15.6:0/862353632 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97801a860 con 0x7fd980069bf0 2023-10-06T02:27:13.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd97f59e700 1 -- 172.21.15.6:0/862353632 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9780093c0 con 0x7fd980069bf0 2023-10-06T02:27:13.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.418+0000 7fd9767fc700 1 -- 172.21.15.6:0/862353632 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97801ac20 con 0x7fd980069bf0 2023-10-06T02:27:13.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.419+0000 7fd97f59e700 1 -- 172.21.15.6:0/862353632 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd980153500 con 0x7fd980069bf0 2023-10-06T02:27:13.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.419+0000 7fd97f59e700 1 -- 172.21.15.6:0/862353632 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98006aac0 con 0x7fd980069bf0 2023-10-06T02:27:13.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.420+0000 7fd9767fc700 1 -- 172.21.15.6:0/862353632 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd978011420 con 0x7fd980069bf0 2023-10-06T02:27:13.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.420+0000 7fd9767fc700 1 --2- 172.21.15.6:0/862353632 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd960066f30 0x7fd9600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:13.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.420+0000 7fd9767fc700 1 -- 172.21.15.6:0/862353632 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8098+0+0 (secure 0 0 0) 0x7fd9780862f0 con 0x7fd980069bf0 2023-10-06T02:27:13.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.420+0000 7fd97dd9b700 1 --2- 172.21.15.6:0/862353632 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd960066f30 0x7fd9600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:13.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.421+0000 7fd97dd9b700 1 --2- 172.21.15.6:0/862353632 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd960066f30 0x7fd9600693e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd98016cef0 tx=0x7fd968009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:13.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.425+0000 7fd9767fc700 1 -- 172.21.15.6:0/862353632 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd978052c00 con 0x7fd980069bf0 2023-10-06T02:27:13.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.662+0000 7fd97f59e700 1 -- 172.21.15.6:0/862353632 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd98006e960 con 0x7fd980069bf0 2023-10-06T02:27:13.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.663+0000 7fd9767fc700 1 -- 172.21.15.6:0/862353632 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 215 v215) v1 ==== 95+0+3840 (secure 0 0 0) 0x7fd97802b020 con 0x7fd980069bf0 2023-10-06T02:27:13.663 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:13.664 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":215,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":215,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:13.280841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:13.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.665+0000 7fd97f59e700 1 -- 172.21.15.6:0/862353632 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd960066f30 msgr2=0x7fd9600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:13.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.665+0000 7fd97f59e700 1 --2- 172.21.15.6:0/862353632 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd960066f30 0x7fd9600693e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd98016cef0 tx=0x7fd968009040 comp rx=0 tx=0).stop 2023-10-06T02:27:13.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.665+0000 7fd97f59e700 1 -- 172.21.15.6:0/862353632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd980069bf0 msgr2=0x7fd9801516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:13.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.665+0000 7fd97f59e700 1 --2- 172.21.15.6:0/862353632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd980069bf0 0x7fd9801516f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd978015000 tx=0x7fd978016000 comp rx=0 tx=0).stop 2023-10-06T02:27:13.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.665+0000 7fd97f59e700 1 -- 172.21.15.6:0/862353632 shutdown_connections 2023-10-06T02:27:13.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.665+0000 7fd97f59e700 1 --2- 172.21.15.6:0/862353632 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd960066f30 0x7fd9600693e0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.665+0000 7fd97f59e700 1 --2- 172.21.15.6:0/862353632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98006a430 0x7fd98009b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.665+0000 7fd97f59e700 1 --2- 172.21.15.6:0/862353632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd980069bf0 0x7fd9801516f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.665+0000 7fd97f59e700 1 --2- 172.21.15.6:0/862353632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd980069fc0 0x7fd98009b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.665+0000 7fd97f59e700 1 -- 172.21.15.6:0/862353632 >> 172.21.15.6:0/862353632 conn(0x7fd980067910 msgr2=0x7fd9800ad800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:13.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.665+0000 7fd97f59e700 1 -- 172.21.15.6:0/862353632 shutdown_connections 2023-10-06T02:27:13.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.665+0000 7fd97f59e700 1 -- 172.21.15.6:0/862353632 wait complete. 2023-10-06T02:27:13.667 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 215 2023-10-06T02:27:13.678 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:27:13.678 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:13.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.836+0000 7ff8f65e1700 1 Processor -- start 2023-10-06T02:27:13.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.836+0000 7ff8f65e1700 1 -- start start 2023-10-06T02:27:13.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.837+0000 7ff8f65e1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8f0159150 0x7ff8f015de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:13.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.837+0000 7ff8f65e1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8f00cccf0 0x7ff8f00b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:13.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.837+0000 7ff8f65e1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f00afbc0 con 0x7ff8f00b08f0 2023-10-06T02:27:13.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.837+0000 7ff8f65e1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f00cd620 con 0x7ff8f00cccf0 2023-10-06T02:27:13.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.837+0000 7ff8f65e1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f00afe10 con 0x7ff8f0159150 2023-10-06T02:27:13.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.837+0000 7ff8f4b7e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8f00cccf0 0x7ff8f00b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:13.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.837+0000 7ff8ef7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff8f00b08f0 0x7ff8f0159520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33426/0 (socket says 172.21.15.6:33426) 2023-10-06T02:27:13.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.837+0000 7ff8ef7fe700 1 -- 172.21.15.6:0/4182733659 learned_addr learned my addr 172.21.15.6:0/4182733659 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.837+0000 7ff8effff700 1 --2- 172.21.15.6:0/4182733659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8f0159150 0x7ff8f015de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.837+0000 7ff8f4b7e700 1 -- 172.21.15.6:0/4182733659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8f0159150 msgr2=0x7ff8f015de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.837+0000 7ff8f4b7e700 1 --2- 172.21.15.6:0/4182733659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8f0159150 0x7ff8f015de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.837+0000 7ff8f4b7e700 1 -- 172.21.15.6:0/4182733659 >> v1:172.21.15.6:6789/0 conn(0x7ff8f00b08f0 legacy=0x7ff8f0159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.837+0000 7ff8f4b7e700 1 -- 172.21.15.6:0/4182733659 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f00b00f0 con 0x7ff8f00cccf0 2023-10-06T02:27:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.837+0000 7ff8eeffd700 1 -- 172.21.15.6:0/4182733659 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021109762 0 0) 0x7ff8f00afbc0 con 0x7ff8f00b08f0 2023-10-06T02:27:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.837+0000 7ff8f4b7e700 1 --2- 172.21.15.6:0/4182733659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f00cccf0 0x7ff8f00b20a0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8009e60 tx=0x7ff8e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afe628459f39b53 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.838+0000 7ff8eeffd700 1 -- 172.21.15.6:0/4182733659 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e800e070 con 0x7ff8f00cccf0 2023-10-06T02:27:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.838+0000 7ff8eeffd700 1 -- 172.21.15.6:0/4182733659 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e800bc30 con 0x7ff8f00cccf0 2023-10-06T02:27:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.838+0000 7ff8eeffd700 1 -- 172.21.15.6:0/4182733659 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8012430 con 0x7ff8f00cccf0 2023-10-06T02:27:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.838+0000 7ff8f65e1700 1 -- 172.21.15.6:0/4182733659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f00cccf0 msgr2=0x7ff8f00b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.838+0000 7ff8f65e1700 1 --2- 172.21.15.6:0/4182733659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f00cccf0 0x7ff8f00b20a0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8009e60 tx=0x7ff8e8009780 comp rx=0 tx=0).stop 2023-10-06T02:27:13.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.838+0000 7ff8f65e1700 1 -- 172.21.15.6:0/4182733659 shutdown_connections 2023-10-06T02:27:13.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.838+0000 7ff8f65e1700 1 --2- 172.21.15.6:0/4182733659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f00cccf0 0x7ff8f00b20a0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.838+0000 7ff8f65e1700 1 --2- 172.21.15.6:0/4182733659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8f0159150 0x7ff8f015de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.838+0000 7ff8f65e1700 1 -- 172.21.15.6:0/4182733659 >> 172.21.15.6:0/4182733659 conn(0x7ff8f0068680 msgr2=0x7ff8f0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:13.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.838+0000 7ff8f65e1700 1 -- 172.21.15.6:0/4182733659 shutdown_connections 2023-10-06T02:27:13.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.838+0000 7ff8f65e1700 1 -- 172.21.15.6:0/4182733659 wait complete. 2023-10-06T02:27:13.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.839+0000 7ff8f65e1700 1 Processor -- start 2023-10-06T02:27:13.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.840+0000 7ff8f65e1700 1 -- start start 2023-10-06T02:27:13.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.840+0000 7ff8f65e1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8f00b08f0 0x7ff8f0155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:13.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.840+0000 7ff8f65e1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8f00cccf0 0x7ff8f00c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:13.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.840+0000 7ff8f65e1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f0159150 0x7ff8f00c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:13.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.840+0000 7ff8f65e1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f00c4d70 con 0x7ff8f0159150 2023-10-06T02:27:13.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.840+0000 7ff8f65e1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f00c4160 con 0x7ff8f00cccf0 2023-10-06T02:27:13.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.840+0000 7ff8f65e1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f00c4440 con 0x7ff8f00b08f0 2023-10-06T02:27:13.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.840+0000 7ff8f4b7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f0159150 0x7ff8f00c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:13.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.840+0000 7ff8f4b7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f0159150 0x7ff8f00c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56288/0 (socket says 172.21.15.6:56288) 2023-10-06T02:27:13.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.840+0000 7ff8f4b7e700 1 -- 172.21.15.6:0/1665304821 learned_addr learned my addr 172.21.15.6:0/1665304821 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.841+0000 7ff8effff700 1 --2- 172.21.15.6:0/1665304821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8f00b08f0 0x7ff8f0155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.841+0000 7ff8ef7fe700 1 --2- 172.21.15.6:0/1665304821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8f00cccf0 0x7ff8f00c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.841+0000 7ff8f4b7e700 1 -- 172.21.15.6:0/1665304821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8f00b08f0 msgr2=0x7ff8f0155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.841+0000 7ff8f4b7e700 1 --2- 172.21.15.6:0/1665304821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8f00b08f0 0x7ff8f0155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.841+0000 7ff8f4b7e700 1 -- 172.21.15.6:0/1665304821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8f00cccf0 msgr2=0x7ff8f00c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.841+0000 7ff8f4b7e700 1 --2- 172.21.15.6:0/1665304821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8f00cccf0 0x7ff8f00c5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.841+0000 7ff8f4b7e700 1 -- 172.21.15.6:0/1665304821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e8009a20 con 0x7ff8f0159150 2023-10-06T02:27:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.841+0000 7ff8ef7fe700 1 --2- 172.21.15.6:0/1665304821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8f00cccf0 0x7ff8f00c5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.841+0000 7ff8f4b7e700 1 --2- 172.21.15.6:0/1665304821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f0159150 0x7ff8f00c9830 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8013000 tx=0x7ff8e8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.841+0000 7ff8d7fff700 1 -- 172.21.15.6:0/1665304821 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8012ea0 con 0x7ff8f0159150 2023-10-06T02:27:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.841+0000 7ff8d7fff700 1 -- 172.21.15.6:0/1665304821 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e801e630 con 0x7ff8f0159150 2023-10-06T02:27:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.841+0000 7ff8f65e1700 1 -- 172.21.15.6:0/1665304821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f00c4720 con 0x7ff8f0159150 2023-10-06T02:27:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.841+0000 7ff8d7fff700 1 -- 172.21.15.6:0/1665304821 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e801e9d0 con 0x7ff8f0159150 2023-10-06T02:27:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.841+0000 7ff8f65e1700 1 -- 172.21.15.6:0/1665304821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f00c5740 con 0x7ff8f0159150 2023-10-06T02:27:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.842+0000 7ff8f65e1700 1 -- 172.21.15.6:0/1665304821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f00c4f20 con 0x7ff8f0159150 2023-10-06T02:27:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.842+0000 7ff8d7fff700 1 -- 172.21.15.6:0/1665304821 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff8e8024070 con 0x7ff8f0159150 2023-10-06T02:27:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.843+0000 7ff8d7fff700 1 --2- 172.21.15.6:0/1665304821 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff8dc066f30 0x7ff8dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.843+0000 7ff8d7fff700 1 -- 172.21.15.6:0/1665304821 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8098+0+0 (secure 0 0 0) 0x7ff8e8087890 con 0x7ff8f0159150 2023-10-06T02:27:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.843+0000 7ff8effff700 1 --2- 172.21.15.6:0/1665304821 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff8dc066f30 0x7ff8dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.843+0000 7ff8effff700 1 --2- 172.21.15.6:0/1665304821 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff8dc066f30 0x7ff8dc0693e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0006fd0 tx=0x7ff8e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:13.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:13.847+0000 7ff8d7fff700 1 -- 172.21.15.6:0/1665304821 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8f00c4f20 con 0x7ff8f0159150 2023-10-06T02:27:14.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.085+0000 7ff8f65e1700 1 -- 172.21.15.6:0/1665304821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8f00c4eb0 con 0x7ff8f0159150 2023-10-06T02:27:14.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.085+0000 7ff8d7fff700 1 -- 172.21.15.6:0/1665304821 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 215 v215) v1 ==== 95+0+3840 (secure 0 0 0) 0x7ff8e80541a0 con 0x7ff8f0159150 2023-10-06T02:27:14.086 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:14.086 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":215,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":215,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:13.280841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:14.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.087+0000 7ff8f65e1700 1 -- 172.21.15.6:0/1665304821 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff8dc066f30 msgr2=0x7ff8dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:14.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.087+0000 7ff8f65e1700 1 --2- 172.21.15.6:0/1665304821 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff8dc066f30 0x7ff8dc0693e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0006fd0 tx=0x7ff8e0008040 comp rx=0 tx=0).stop 2023-10-06T02:27:14.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.087+0000 7ff8f65e1700 1 -- 172.21.15.6:0/1665304821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f0159150 msgr2=0x7ff8f00c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:14.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.087+0000 7ff8f65e1700 1 --2- 172.21.15.6:0/1665304821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f0159150 0x7ff8f00c9830 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8013000 tx=0x7ff8e8019000 comp rx=0 tx=0).stop 2023-10-06T02:27:14.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.087+0000 7ff8f65e1700 1 -- 172.21.15.6:0/1665304821 shutdown_connections 2023-10-06T02:27:14.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.087+0000 7ff8f65e1700 1 --2- 172.21.15.6:0/1665304821 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff8dc066f30 0x7ff8dc0693e0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.087+0000 7ff8f65e1700 1 --2- 172.21.15.6:0/1665304821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f0159150 0x7ff8f00c9830 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.087+0000 7ff8f65e1700 1 --2- 172.21.15.6:0/1665304821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8f00b08f0 0x7ff8f0155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.087+0000 7ff8f65e1700 1 --2- 172.21.15.6:0/1665304821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8f00cccf0 0x7ff8f00c5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.087+0000 7ff8f65e1700 1 -- 172.21.15.6:0/1665304821 >> 172.21.15.6:0/1665304821 conn(0x7ff8f0068680 msgr2=0x7ff8f00b50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:14.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.087+0000 7ff8f65e1700 1 -- 172.21.15.6:0/1665304821 shutdown_connections 2023-10-06T02:27:14.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.087+0000 7ff8f65e1700 1 -- 172.21.15.6:0/1665304821 wait complete. 2023-10-06T02:27:14.090 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 215 2023-10-06T02:27:14.100 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:27:14.100 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:14.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.218+0000 7f1ef44e2700 1 Processor -- start 2023-10-06T02:27:14.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.218+0000 7f1ef44e2700 1 -- start start 2023-10-06T02:27:14.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.219+0000 7f1ef44e2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1eec0af4e0 0x7f1eec0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.219+0000 7f1ef44e2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1eec0af8b0 0x7f1eec0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.219+0000 7f1ef44e2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eec15e190 con 0x7f1eec15d460 2023-10-06T02:27:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.219+0000 7f1ef44e2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eec0b1910 con 0x7f1eec0af4e0 2023-10-06T02:27:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.219+0000 7f1ef44e2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec15dfb0 con 0x7f1eec0af8b0 2023-10-06T02:27:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.220+0000 7f1ef227e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1eec0af4e0 0x7f1eec0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.220+0000 7f1ef227e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1eec0af4e0 0x7f1eec0b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56298/0 (socket says 172.21.15.6:56298) 2023-10-06T02:27:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.220+0000 7f1ef227e700 1 -- 172.21.15.6:0/1296515519 learned_addr learned my addr 172.21.15.6:0/1296515519 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.220+0000 7f1ef1a7d700 1 --2- 172.21.15.6:0/1296515519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1eec0af8b0 0x7f1eec0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.220+0000 7f1ef227e700 1 -- 172.21.15.6:0/1296515519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1eec0af8b0 msgr2=0x7f1eec0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.220+0000 7f1ef227e700 1 --2- 172.21.15.6:0/1296515519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1eec0af8b0 0x7f1eec0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.220+0000 7f1ef227e700 1 -- 172.21.15.6:0/1296515519 >> v1:172.21.15.175:6789/0 conn(0x7f1eec15d460 legacy=0x7f1eec15d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.220+0000 7f1ef227e700 1 -- 172.21.15.6:0/1296515519 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec0cb650 con 0x7f1eec0af4e0 2023-10-06T02:27:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.220+0000 7f1ef227e700 1 --2- 172.21.15.6:0/1296515519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eec0af4e0 0x7f1eec0b20e0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40099b0 tx=0x7f1ee4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ced64fa376553b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.220+0000 7f1ef127c700 1 -- 172.21.15.6:0/1296515519 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4009ea0 con 0x7f1eec0af4e0 2023-10-06T02:27:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.220+0000 7f1ef127c700 1 -- 172.21.15.6:0/1296515519 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee400b860 con 0x7f1eec0af4e0 2023-10-06T02:27:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.220+0000 7f1ef127c700 1 -- 172.21.15.6:0/1296515519 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee400bc00 con 0x7f1eec0af4e0 2023-10-06T02:27:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.221+0000 7f1ef44e2700 1 -- 172.21.15.6:0/1296515519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eec0af4e0 msgr2=0x7f1eec0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.221+0000 7f1ef44e2700 1 --2- 172.21.15.6:0/1296515519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eec0af4e0 0x7f1eec0b20e0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40099b0 tx=0x7f1ee4009250 comp rx=0 tx=0).stop 2023-10-06T02:27:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.221+0000 7f1ef44e2700 1 -- 172.21.15.6:0/1296515519 shutdown_connections 2023-10-06T02:27:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.221+0000 7f1ef44e2700 1 --2- 172.21.15.6:0/1296515519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eec0af4e0 0x7f1eec0b20e0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.221+0000 7f1ef44e2700 1 --2- 172.21.15.6:0/1296515519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1eec0af8b0 0x7f1eec0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.221+0000 7f1ef44e2700 1 -- 172.21.15.6:0/1296515519 >> 172.21.15.6:0/1296515519 conn(0x7f1eec068680 msgr2=0x7f1eec068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.221+0000 7f1ef44e2700 1 -- 172.21.15.6:0/1296515519 shutdown_connections 2023-10-06T02:27:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.221+0000 7f1ef44e2700 1 -- 172.21.15.6:0/1296515519 wait complete. 2023-10-06T02:27:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.222+0000 7f1ef44e2700 1 Processor -- start 2023-10-06T02:27:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.222+0000 7f1ef44e2700 1 -- start start 2023-10-06T02:27:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef44e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eec0af4e0 0x7f1eec0ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef44e2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1eec0af8b0 0x7f1eec16aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef44e2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1eec15d460 0x7f1eec0a8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef44e2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec15a320 con 0x7f1eec0af4e0 2023-10-06T02:27:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef44e2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec16af50 con 0x7f1eec0af8b0 2023-10-06T02:27:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef44e2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0a6d20 con 0x7f1eec15d460 2023-10-06T02:27:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef227e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eec0af4e0 0x7f1eec0ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef227e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eec0af4e0 0x7f1eec0ae790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56308/0 (socket says 172.21.15.6:56308) 2023-10-06T02:27:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef227e700 1 -- 172.21.15.6:0/2411691515 learned_addr learned my addr 172.21.15.6:0/2411691515 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef1a7d700 1 --2- 172.21.15.6:0/2411691515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1eec0af8b0 0x7f1eec16aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef2a7f700 1 --2- 172.21.15.6:0/2411691515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1eec15d460 0x7f1eec0a8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef227e700 1 -- 172.21.15.6:0/2411691515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1eec15d460 msgr2=0x7f1eec0a8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef227e700 1 --2- 172.21.15.6:0/2411691515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1eec15d460 0x7f1eec0a8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef227e700 1 -- 172.21.15.6:0/2411691515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1eec0af8b0 msgr2=0x7f1eec16aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef227e700 1 --2- 172.21.15.6:0/2411691515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1eec0af8b0 0x7f1eec16aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef227e700 1 -- 172.21.15.6:0/2411691515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee40094f0 con 0x7f1eec0af4e0 2023-10-06T02:27:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef227e700 1 --2- 172.21.15.6:0/2411691515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eec0af4e0 0x7f1eec0ae790 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f1eec089520 tx=0x7f1ee4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1eea7fc700 1 -- 172.21.15.6:0/2411691515 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4000d10 con 0x7f1eec0af4e0 2023-10-06T02:27:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1eea7fc700 1 -- 172.21.15.6:0/2411691515 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee400bbe0 con 0x7f1eec0af4e0 2023-10-06T02:27:14.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1ef44e2700 1 -- 172.21.15.6:0/2411691515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eec0a6fe0 con 0x7f1eec0af4e0 2023-10-06T02:27:14.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.223+0000 7f1eea7fc700 1 -- 172.21.15.6:0/2411691515 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4011670 con 0x7f1eec0af4e0 2023-10-06T02:27:14.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.224+0000 7f1ef44e2700 1 -- 172.21.15.6:0/2411691515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eec0a75a0 con 0x7f1eec0af4e0 2023-10-06T02:27:14.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.224+0000 7f1ef44e2700 1 -- 172.21.15.6:0/2411691515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eec0c6d90 con 0x7f1eec0af4e0 2023-10-06T02:27:14.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.225+0000 7f1eea7fc700 1 -- 172.21.15.6:0/2411691515 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ee4011aa0 con 0x7f1eec0af4e0 2023-10-06T02:27:14.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.225+0000 7f1eea7fc700 1 --2- 172.21.15.6:0/2411691515 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ed8066f30 0x7f1ed80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:14.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.225+0000 7f1eea7fc700 1 -- 172.21.15.6:0/2411691515 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8098+0+0 (secure 0 0 0) 0x7f1ee40865a0 con 0x7f1eec0af4e0 2023-10-06T02:27:14.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.225+0000 7f1ef1a7d700 1 --2- 172.21.15.6:0/2411691515 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ed8066f30 0x7f1ed80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:14.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.226+0000 7f1ef1a7d700 1 --2- 172.21.15.6:0/2411691515 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ed8066f30 0x7f1ed80693e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0cd6c0 tx=0x7f1ee00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:14.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.230+0000 7f1eea7fc700 1 -- 172.21.15.6:0/2411691515 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ee4052eb0 con 0x7f1eec0af4e0 2023-10-06T02:27:14.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.469+0000 7f1ef44e2700 1 -- 172.21.15.6:0/2411691515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1eec0b0910 con 0x7f1eec0af4e0 2023-10-06T02:27:14.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.470+0000 7f1eea7fc700 1 -- 172.21.15.6:0/2411691515 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 216 v216) v1 ==== 95+0+4595 (secure 0 0 0) 0x7f1ee40564d0 con 0x7f1eec0af4e0 2023-10-06T02:27:14.471 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:14.471 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":216,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2361875445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2361875445},{"type":"v1","addr":"172.21.15.6:6835","nonce":2361875445}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":216}],"filesystems":[{"mdsmap":{"epoch":215,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:13.280841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:14.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.472+0000 7f1ef44e2700 1 -- 172.21.15.6:0/2411691515 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ed8066f30 msgr2=0x7f1ed80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.472+0000 7f1ef44e2700 1 --2- 172.21.15.6:0/2411691515 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ed8066f30 0x7f1ed80693e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0cd6c0 tx=0x7f1ee00091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.472+0000 7f1ef44e2700 1 -- 172.21.15.6:0/2411691515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eec0af4e0 msgr2=0x7f1eec0ae790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.472+0000 7f1ef44e2700 1 --2- 172.21.15.6:0/2411691515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eec0af4e0 0x7f1eec0ae790 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f1eec089520 tx=0x7f1ee4017000 comp rx=0 tx=0).stop 2023-10-06T02:27:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.472+0000 7f1ef44e2700 1 -- 172.21.15.6:0/2411691515 shutdown_connections 2023-10-06T02:27:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.472+0000 7f1ef44e2700 1 --2- 172.21.15.6:0/2411691515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1eec15d460 0x7f1eec0a8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.472+0000 7f1ef44e2700 1 --2- 172.21.15.6:0/2411691515 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ed8066f30 0x7f1ed80693e0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.472+0000 7f1ef44e2700 1 --2- 172.21.15.6:0/2411691515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eec0af4e0 0x7f1eec0ae790 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.472+0000 7f1ef44e2700 1 --2- 172.21.15.6:0/2411691515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1eec0af8b0 0x7f1eec16aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.472+0000 7f1ef44e2700 1 -- 172.21.15.6:0/2411691515 >> 172.21.15.6:0/2411691515 conn(0x7f1eec068680 msgr2=0x7f1eec15b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.472+0000 7f1ef44e2700 1 -- 172.21.15.6:0/2411691515 shutdown_connections 2023-10-06T02:27:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.472+0000 7f1ef44e2700 1 -- 172.21.15.6:0/2411691515 wait complete. 2023-10-06T02:27:14.474 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 216 2023-10-06T02:27:14.484 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt mds_snaptable' led to DAMAGED state 2023-10-06T02:27:14.484 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt mds0_inotable' 2023-10-06T02:27:14.484 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:14.484 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:27:14.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:14.485 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:27:14.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:27:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:27:14.500 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:27:14.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.660+0000 7fcb825fc700 1 Processor -- start 2023-10-06T02:27:14.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.660+0000 7fcb825fc700 1 -- start start 2023-10-06T02:27:14.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.661+0000 7fcb825fc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb7c15a030 0x7fcb7c15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:14.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.661+0000 7fcb825fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb7c087700 0x7fcb7c0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:14.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.661+0000 7fcb825fc700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7c0afc50 con 0x7fcb7c15a940 2023-10-06T02:27:14.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.661+0000 7fcb825fc700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7c0b0cf0 con 0x7fcb7c087700 2023-10-06T02:27:14.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.661+0000 7fcb825fc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0aff30 con 0x7fcb7c15a030 2023-10-06T02:27:14.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.661+0000 7fcb80b99700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb7c087700 0x7fcb7c0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:14.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.661+0000 7fcb80b99700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb7c087700 0x7fcb7c0b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56312/0 (socket says 172.21.15.6:56312) 2023-10-06T02:27:14.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.661+0000 7fcb80b99700 1 -- 172.21.15.6:0/3128446009 learned_addr learned my addr 172.21.15.6:0/3128446009 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:14.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.662+0000 7fcb7bfff700 1 --2- 172.21.15.6:0/3128446009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb7c15a030 0x7fcb7c15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:14.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.662+0000 7fcb80b99700 1 -- 172.21.15.6:0/3128446009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb7c15a030 msgr2=0x7fcb7c15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:14.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.662+0000 7fcb80b99700 1 --2- 172.21.15.6:0/3128446009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb7c15a030 0x7fcb7c15a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.662+0000 7fcb80b99700 1 -- 172.21.15.6:0/3128446009 >> v1:172.21.15.175:6789/0 conn(0x7fcb7c15a940 legacy=0x7fcb7c086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:14.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.662+0000 7fcb80b99700 1 -- 172.21.15.6:0/3128446009 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c0b0210 con 0x7fcb7c087700 2023-10-06T02:27:14.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.662+0000 7fcb80b99700 1 --2- 172.21.15.6:0/3128446009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb7c087700 0x7fcb7c0b21b0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009f20 tx=0x7fcb74009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5d026f89242154 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:14.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.662+0000 7fcb7affd700 1 -- 172.21.15.6:0/3128446009 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7400e070 con 0x7fcb7c087700 2023-10-06T02:27:14.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.662+0000 7fcb7affd700 1 -- 172.21.15.6:0/3128446009 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7400ba80 con 0x7fcb7c087700 2023-10-06T02:27:14.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.662+0000 7fcb7affd700 1 -- 172.21.15.6:0/3128446009 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740092e0 con 0x7fcb7c087700 2023-10-06T02:27:14.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.662+0000 7fcb825fc700 1 -- 172.21.15.6:0/3128446009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb7c087700 msgr2=0x7fcb7c0b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:14.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.662+0000 7fcb825fc700 1 --2- 172.21.15.6:0/3128446009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb7c087700 0x7fcb7c0b21b0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009f20 tx=0x7fcb74009840 comp rx=0 tx=0).stop 2023-10-06T02:27:14.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.663+0000 7fcb825fc700 1 -- 172.21.15.6:0/3128446009 shutdown_connections 2023-10-06T02:27:14.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.663+0000 7fcb825fc700 1 --2- 172.21.15.6:0/3128446009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb7c087700 0x7fcb7c0b21b0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.663+0000 7fcb825fc700 1 --2- 172.21.15.6:0/3128446009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb7c15a030 0x7fcb7c15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.663+0000 7fcb825fc700 1 -- 172.21.15.6:0/3128446009 >> 172.21.15.6:0/3128446009 conn(0x7fcb7c068680 msgr2=0x7fcb7c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:14.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.663+0000 7fcb825fc700 1 -- 172.21.15.6:0/3128446009 shutdown_connections 2023-10-06T02:27:14.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.663+0000 7fcb825fc700 1 -- 172.21.15.6:0/3128446009 wait complete. 2023-10-06T02:27:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.664+0000 7fcb825fc700 1 Processor -- start 2023-10-06T02:27:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.664+0000 7fcb825fc700 1 -- start start 2023-10-06T02:27:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb825fc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb7c087700 0x7fcb7c15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb825fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb7c15a030 0x7fcb7c155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb825fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb7c15a940 0x7fcb7c16d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb825fc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0c79e0 con 0x7fcb7c15a940 2023-10-06T02:27:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb825fc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c15e0e0 con 0x7fcb7c15a030 2023-10-06T02:27:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb825fc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0c52c0 con 0x7fcb7c087700 2023-10-06T02:27:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb80b99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb7c15a940 0x7fcb7c16d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb80b99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb7c15a940 0x7fcb7c16d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56314/0 (socket says 172.21.15.6:56314) 2023-10-06T02:27:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb80b99700 1 -- 172.21.15.6:0/1192644226 learned_addr learned my addr 172.21.15.6:0/1192644226 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb7bfff700 1 --2- 172.21.15.6:0/1192644226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb7c087700 0x7fcb7c15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb7b7fe700 1 --2- 172.21.15.6:0/1192644226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb7c15a030 0x7fcb7c155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb80b99700 1 -- 172.21.15.6:0/1192644226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb7c087700 msgr2=0x7fcb7c15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb80b99700 1 --2- 172.21.15.6:0/1192644226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb7c087700 0x7fcb7c15dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb80b99700 1 -- 172.21.15.6:0/1192644226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb7c15a030 msgr2=0x7fcb7c155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:14.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb80b99700 1 --2- 172.21.15.6:0/1192644226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb7c15a030 0x7fcb7c155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:14.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb80b99700 1 -- 172.21.15.6:0/1192644226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb74009ae0 con 0x7fcb7c15a940 2023-10-06T02:27:14.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb80b99700 1 --2- 172.21.15.6:0/1192644226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb7c15a940 0x7fcb7c16d1e0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400b6c0 tx=0x7fcb74018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:14.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb73fff700 1 -- 172.21.15.6:0/1192644226 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740032f0 con 0x7fcb7c15a940 2023-10-06T02:27:14.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb73fff700 1 -- 172.21.15.6:0/1192644226 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb74008d20 con 0x7fcb7c15a940 2023-10-06T02:27:14.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb825fc700 1 -- 172.21.15.6:0/1192644226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb7c0c55a0 con 0x7fcb7c15a940 2023-10-06T02:27:14.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.665+0000 7fcb73fff700 1 -- 172.21.15.6:0/1192644226 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb74026670 con 0x7fcb7c15a940 2023-10-06T02:27:14.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.666+0000 7fcb825fc700 1 -- 172.21.15.6:0/1192644226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7c0c7670 con 0x7fcb7c15a940 2023-10-06T02:27:14.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.666+0000 7fcb825fc700 1 -- 172.21.15.6:0/1192644226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb7c088700 con 0x7fcb7c15a940 2023-10-06T02:27:14.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.667+0000 7fcb73fff700 1 -- 172.21.15.6:0/1192644226 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb74003040 con 0x7fcb7c15a940 2023-10-06T02:27:14.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.667+0000 7fcb73fff700 1 --2- 172.21.15.6:0/1192644226 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb5c066f30 0x7fcb5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:14.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.667+0000 7fcb73fff700 1 -- 172.21.15.6:0/1192644226 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8098+0+0 (secure 0 0 0) 0x7fcb74086e50 con 0x7fcb7c15a940 2023-10-06T02:27:14.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.667+0000 7fcb7bfff700 1 --2- 172.21.15.6:0/1192644226 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb5c066f30 0x7fcb5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:14.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.668+0000 7fcb7bfff700 1 --2- 172.21.15.6:0/1192644226 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb5c066f30 0x7fcb5c0693e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fcb64006fd0 tx=0x7fcb64008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:14.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.672+0000 7fcb73fff700 1 -- 172.21.15.6:0/1192644226 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb74053810 con 0x7fcb7c15a940 2023-10-06T02:27:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:14.909+0000 7fcb825fc700 1 -- 172.21.15.6:0/1192644226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcb7c0c7b20 con 0x7fcb7c15a940 2023-10-06T02:27:15.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.838+0000 7fcb73fff700 1 -- 172.21.15.6:0/1192644226 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v217) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcb74021070 con 0x7fcb7c15a940 2023-10-06T02:27:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.841+0000 7fcb825fc700 1 -- 172.21.15.6:0/1192644226 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb5c066f30 msgr2=0x7fcb5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.841+0000 7fcb825fc700 1 --2- 172.21.15.6:0/1192644226 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb5c066f30 0x7fcb5c0693e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fcb64006fd0 tx=0x7fcb64008040 comp rx=0 tx=0).stop 2023-10-06T02:27:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.841+0000 7fcb825fc700 1 -- 172.21.15.6:0/1192644226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb7c15a940 msgr2=0x7fcb7c16d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.841+0000 7fcb825fc700 1 --2- 172.21.15.6:0/1192644226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb7c15a940 0x7fcb7c16d1e0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400b6c0 tx=0x7fcb74018000 comp rx=0 tx=0).stop 2023-10-06T02:27:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.841+0000 7fcb825fc700 1 -- 172.21.15.6:0/1192644226 shutdown_connections 2023-10-06T02:27:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.841+0000 7fcb825fc700 1 --2- 172.21.15.6:0/1192644226 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb5c066f30 0x7fcb5c0693e0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.841+0000 7fcb825fc700 1 --2- 172.21.15.6:0/1192644226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb7c15a940 0x7fcb7c16d1e0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.841+0000 7fcb825fc700 1 --2- 172.21.15.6:0/1192644226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb7c087700 0x7fcb7c15dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.841+0000 7fcb825fc700 1 --2- 172.21.15.6:0/1192644226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb7c15a030 0x7fcb7c155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.841+0000 7fcb825fc700 1 -- 172.21.15.6:0/1192644226 >> 172.21.15.6:0/1192644226 conn(0x7fcb7c068680 msgr2=0x7fcb7c0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:15.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.841+0000 7fcb825fc700 1 -- 172.21.15.6:0/1192644226 shutdown_connections 2023-10-06T02:27:15.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.841+0000 7fcb825fc700 1 -- 172.21.15.6:0/1192644226 wait complete. 2023-10-06T02:27:15.843 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:27:15.858 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:27:15.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.983+0000 7f742afe7700 1 Processor -- start 2023-10-06T02:27:15.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.983+0000 7f742afe7700 1 -- start start 2023-10-06T02:27:15.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.984+0000 7f742afe7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240cd890 0x7f74240c8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:15.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.984+0000 7f742afe7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742415a0c0 con 0x7f74240c7e20 2023-10-06T02:27:15.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.984+0000 7f742afe7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742406c7d0 con 0x7f742406c350 2023-10-06T02:27:15.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.984+0000 7f742afe7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74240c9150 con 0x7f74240cd890 2023-10-06T02:27:15.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.984+0000 7f7428d83700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f74240c7e20 0x7f742415a550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33440/0 (socket says 172.21.15.6:33440) 2023-10-06T02:27:15.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.984+0000 7f7428d83700 1 -- 172.21.15.6:0/1084033057 learned_addr learned my addr 172.21.15.6:0/1084033057 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:15.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f7429584700 1 --2- 172.21.15.6:0/1084033057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240cd890 0x7f74240c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:15.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f74237fe700 1 -- 172.21.15.6:0/1084033057 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751772677 0 0) 0x7f742415a0c0 con 0x7f74240c7e20 2023-10-06T02:27:15.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f74237fe700 1 -- 172.21.15.6:0/1084033057 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7410003570 con 0x7f74240c7e20 2023-10-06T02:27:15.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f74237fe700 1 -- 172.21.15.6:0/1084033057 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1030562042 0 0) 0x7f7410003570 con 0x7f74240c7e20 2023-10-06T02:27:15.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f74237fe700 1 -- 172.21.15.6:0/1084033057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240cd890 msgr2=0x7f74240c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:15.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f74237fe700 1 --2- 172.21.15.6:0/1084033057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240cd890 0x7f74240c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:15.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f74237fe700 1 -- 172.21.15.6:0/1084033057 >> v1:172.21.15.175:6789/0 conn(0x7f742406c350 legacy=0x7f74240cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:15.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f74237fe700 1 -- 172.21.15.6:0/1084033057 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74240c8b90 con 0x7f74240c7e20 2023-10-06T02:27:15.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f74237fe700 1 -- 172.21.15.6:0/1084033057 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f741c001470 con 0x7f74240c7e20 2023-10-06T02:27:15.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f74237fe700 1 -- 172.21.15.6:0/1084033057 >> v1:172.21.15.6:6789/0 conn(0x7f74240c7e20 legacy=0x7f742415a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:15.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f74237fe700 1 --2- 172.21.15.6:0/1084033057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7410003a90 0x7f7410003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:15.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f74237fe700 1 --2- 172.21.15.6:0/1084033057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7410004810 0x7f7410004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:15.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f74237fe700 1 --2- 172.21.15.6:0/1084033057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240cd890 0x7f74100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:15.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f74237fe700 1 -- 172.21.15.6:0/1084033057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74240c9150 con 0x7f7410003a90 2023-10-06T02:27:15.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f74237fe700 1 -- 172.21.15.6:0/1084033057 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741000bb10 con 0x7f7410004810 2023-10-06T02:27:15.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f74237fe700 1 -- 172.21.15.6:0/1084033057 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741000bcd0 con 0x7f74240cd890 2023-10-06T02:27:15.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f7428d83700 1 --2- 172.21.15.6:0/1084033057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7410003a90 0x7f7410003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:15.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f7423fff700 1 --2- 172.21.15.6:0/1084033057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7410004810 0x7f7410004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:15.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f7429584700 1 --2- 172.21.15.6:0/1084033057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240cd890 0x7f74100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:15.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f7428d83700 1 -- 172.21.15.6:0/1084033057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240cd890 msgr2=0x7f74100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:15.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f7428d83700 1 --2- 172.21.15.6:0/1084033057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240cd890 0x7f74100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:15.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f7428d83700 1 -- 172.21.15.6:0/1084033057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7410004810 msgr2=0x7f7410004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:15.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f7428d83700 1 --2- 172.21.15.6:0/1084033057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7410004810 0x7f7410004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:15.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f7428d83700 1 -- 172.21.15.6:0/1084033057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7410003570 con 0x7f7410003a90 2023-10-06T02:27:15.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.985+0000 7f7429584700 1 --2- 172.21.15.6:0/1084033057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74240cd890 0x7f74100051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:15.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.986+0000 7f7428d83700 1 --2- 172.21.15.6:0/1084033057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7410003a90 0x7f7410003e60 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f741c00c3c0 tx=0x7f741c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43ebddd954ef6c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:15.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.986+0000 7f74237fe700 1 -- 172.21.15.6:0/1084033057 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c00cc90 con 0x7f7410003a90 2023-10-06T02:27:15.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.986+0000 7f74237fe700 1 -- 172.21.15.6:0/1084033057 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741c00cdf0 con 0x7f7410003a90 2023-10-06T02:27:15.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.986+0000 7f74237fe700 1 -- 172.21.15.6:0/1084033057 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c005b70 con 0x7f7410003a90 2023-10-06T02:27:15.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.986+0000 7f742afe7700 1 -- 172.21.15.6:0/1084033057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7410003a90 msgr2=0x7f7410003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:15.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.986+0000 7f742afe7700 1 --2- 172.21.15.6:0/1084033057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7410003a90 0x7f7410003e60 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f741c00c3c0 tx=0x7f741c001e70 comp rx=0 tx=0).stop 2023-10-06T02:27:15.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.986+0000 7f7429584700 1 -- 172.21.15.6:0/1084033057 reap_dead start 2023-10-06T02:27:15.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.986+0000 7f742afe7700 1 -- 172.21.15.6:0/1084033057 shutdown_connections 2023-10-06T02:27:15.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.986+0000 7f742afe7700 1 -- 172.21.15.6:0/1084033057 >> 172.21.15.6:0/1084033057 conn(0x7f7424067130 msgr2=0x7f7424067530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:15.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.986+0000 7f742afe7700 1 -- 172.21.15.6:0/1084033057 shutdown_connections 2023-10-06T02:27:15.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.986+0000 7f742afe7700 1 -- 172.21.15.6:0/1084033057 wait complete. 2023-10-06T02:27:15.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.987+0000 7f742afe7700 1 Processor -- start 2023-10-06T02:27:15.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.988+0000 7f742afe7700 1 -- start start 2023-10-06T02:27:15.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.988+0000 7f742afe7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7410003a90 0x7f74240ac330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:15.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.988+0000 7f742afe7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74240affa0 0x7f7424169c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:15.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.988+0000 7f742afe7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74240c6040 0x7f74241520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:15.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.988+0000 7f742afe7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74240c4200 con 0x7f74240c6040 2023-10-06T02:27:15.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.988+0000 7f742afe7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742416a4c0 con 0x7f74240affa0 2023-10-06T02:27:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.988+0000 7f742afe7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742416a7a0 con 0x7f7410003a90 2023-10-06T02:27:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.988+0000 7f7429584700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74240c6040 0x7f74241520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.988+0000 7f7429584700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74240c6040 0x7f74241520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56342/0 (socket says 172.21.15.6:56342) 2023-10-06T02:27:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.988+0000 7f7429584700 1 -- 172.21.15.6:0/1559239160 learned_addr learned my addr 172.21.15.6:0/1559239160 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.989+0000 7f7428d83700 1 --2- 172.21.15.6:0/1559239160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7410003a90 0x7f74240ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.989+0000 7f7423fff700 1 --2- 172.21.15.6:0/1559239160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74240affa0 0x7f7424169c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.989+0000 7f7429584700 1 -- 172.21.15.6:0/1559239160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7410003a90 msgr2=0x7f74240ac330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.989+0000 7f7429584700 1 --2- 172.21.15.6:0/1559239160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7410003a90 0x7f74240ac330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.989+0000 7f7429584700 1 -- 172.21.15.6:0/1559239160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74240affa0 msgr2=0x7f7424169c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.989+0000 7f7429584700 1 --2- 172.21.15.6:0/1559239160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74240affa0 0x7f7424169c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.989+0000 7f7429584700 1 -- 172.21.15.6:0/1559239160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742416aa80 con 0x7f74240c6040 2023-10-06T02:27:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.989+0000 7f7423fff700 1 --2- 172.21.15.6:0/1559239160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74240affa0 0x7f7424169c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.989+0000 7f7429584700 1 --2- 172.21.15.6:0/1559239160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74240c6040 0x7f74241520d0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f74240cdc90 tx=0x7f740c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.989+0000 7f7420ff9700 1 -- 172.21.15.6:0/1559239160 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c015670 con 0x7f74240c6040 2023-10-06T02:27:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.989+0000 7f7420ff9700 1 -- 172.21.15.6:0/1559239160 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740c0157d0 con 0x7f74240c6040 2023-10-06T02:27:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.989+0000 7f7420ff9700 1 -- 172.21.15.6:0/1559239160 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c015b70 con 0x7f74240c6040 2023-10-06T02:27:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.989+0000 7f742afe7700 1 -- 172.21.15.6:0/1559239160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74240c4450 con 0x7f74240c6040 2023-10-06T02:27:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.989+0000 7f742afe7700 1 -- 172.21.15.6:0/1559239160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74240c64e0 con 0x7f74240c6040 2023-10-06T02:27:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.990+0000 7f742afe7700 1 -- 172.21.15.6:0/1559239160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74240c4640 con 0x7f74240c6040 2023-10-06T02:27:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.991+0000 7f7420ff9700 1 -- 172.21.15.6:0/1559239160 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f740c01e400 con 0x7f74240c6040 2023-10-06T02:27:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.991+0000 7f7420ff9700 1 --2- 172.21.15.6:0/1559239160 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7404066f30 0x7f74040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:15.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.991+0000 7f7420ff9700 1 -- 172.21.15.6:0/1559239160 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8098+0+0 (secure 0 0 0) 0x7f740c0851c0 con 0x7f74240c6040 2023-10-06T02:27:15.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.991+0000 7f7428d83700 1 --2- 172.21.15.6:0/1559239160 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7404066f30 0x7f74040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:15.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.992+0000 7f7428d83700 1 --2- 172.21.15.6:0/1559239160 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7404066f30 0x7f74040693e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f741c001eb0 tx=0x7f741c015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:15.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:15.995+0000 7f7420ff9700 1 -- 172.21.15.6:0/1559239160 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f740c051ad0 con 0x7f74240c6040 2023-10-06T02:27:16.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.270+0000 7f742afe7700 1 -- 172.21.15.6:0/1559239160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f74240c6730 con 0x7f74240c6040 2023-10-06T02:27:16.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.842+0000 7f7420ff9700 1 -- 172.21.15.6:0/1559239160 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v218) v1 ==== 101+0+0 (secure 0 0 0) 0x7f740c0550f0 con 0x7f74240c6040 2023-10-06T02:27:16.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.845+0000 7f742afe7700 1 -- 172.21.15.6:0/1559239160 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7404066f30 msgr2=0x7f74040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:16.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.845+0000 7f742afe7700 1 --2- 172.21.15.6:0/1559239160 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7404066f30 0x7f74040693e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f741c001eb0 tx=0x7f741c015000 comp rx=0 tx=0).stop 2023-10-06T02:27:16.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.845+0000 7f742afe7700 1 -- 172.21.15.6:0/1559239160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74240c6040 msgr2=0x7f74241520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:16.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.845+0000 7f742afe7700 1 --2- 172.21.15.6:0/1559239160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74240c6040 0x7f74241520d0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f74240cdc90 tx=0x7f740c008040 comp rx=0 tx=0).stop 2023-10-06T02:27:16.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.845+0000 7f742afe7700 1 -- 172.21.15.6:0/1559239160 shutdown_connections 2023-10-06T02:27:16.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.845+0000 7f742afe7700 1 --2- 172.21.15.6:0/1559239160 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7404066f30 0x7f74040693e0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:16.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.845+0000 7f742afe7700 1 --2- 172.21.15.6:0/1559239160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74240c6040 0x7f74241520d0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:16.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.845+0000 7f742afe7700 1 --2- 172.21.15.6:0/1559239160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7410003a90 0x7f74240ac330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:16.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.845+0000 7f742afe7700 1 --2- 172.21.15.6:0/1559239160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74240affa0 0x7f7424169c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:16.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.845+0000 7f742afe7700 1 -- 172.21.15.6:0/1559239160 >> 172.21.15.6:0/1559239160 conn(0x7f7424067130 msgr2=0x7f74241592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:16.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.845+0000 7f742afe7700 1 -- 172.21.15.6:0/1559239160 shutdown_connections 2023-10-06T02:27:16.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.845+0000 7f742afe7700 1 -- 172.21.15.6:0/1559239160 wait complete. 2023-10-06T02:27:16.847 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:27:16.859 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:27:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.899+0000 7ff21c667000 1 Processor -- start 2023-10-06T02:27:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.899+0000 7ff21c667000 1 -- start start 2023-10-06T02:27:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.900+0000 7ff21c667000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff204003a60 0x5558b09018e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.900+0000 7ff21c667000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558b09188b0 0x5558b0916b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.900+0000 7ff21c667000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558b0918370 0x5558b09170a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.900+0000 7ff21c667000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558b07ef320 con 0x5558b0918370 2023-10-06T02:27:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.900+0000 7ff21c667000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558b0793980 con 0x5558b09188b0 2023-10-06T02:27:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.900+0000 7ff21c667000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558b0793620 con 0x7ff204003a60 2023-10-06T02:27:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.900+0000 7ff2160a3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558b0918370 0x5558b09170a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.900+0000 7ff2160a3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558b0918370 0x5558b09170a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56360/0 (socket says 172.21.15.6:56360) 2023-10-06T02:27:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.900+0000 7ff2160a3700 1 -- 172.21.15.6:0/3906856523 learned_addr learned my addr 172.21.15.6:0/3906856523 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.900+0000 7ff2158a2700 1 --2- 172.21.15.6:0/3906856523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff204003a60 0x5558b09018e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.900+0000 7ff2150a1700 1 --2- 172.21.15.6:0/3906856523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558b09188b0 0x5558b0916b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.900+0000 7ff2160a3700 1 -- 172.21.15.6:0/3906856523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff204003a60 msgr2=0x5558b09018e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.900+0000 7ff2160a3700 1 --2- 172.21.15.6:0/3906856523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff204003a60 0x5558b09018e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.900+0000 7ff2160a3700 1 -- 172.21.15.6:0/3906856523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558b09188b0 msgr2=0x5558b0916b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.900+0000 7ff2160a3700 1 --2- 172.21.15.6:0/3906856523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558b09188b0 0x5558b0916b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.900+0000 7ff2160a3700 1 -- 172.21.15.6:0/3906856523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558b0795ae0 con 0x5558b0918370 2023-10-06T02:27:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.901+0000 7ff2160a3700 1 --2- 172.21.15.6:0/3906856523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558b0918370 0x5558b09170a0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7ff2100056f0 tx=0x7ff210015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371afa7b3bfa5606 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.901+0000 7ff20ffff700 1 -- 172.21.15.6:0/3906856523 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21000e040 con 0x5558b0918370 2023-10-06T02:27:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.901+0000 7ff20ffff700 1 -- 172.21.15.6:0/3906856523 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff210008600 con 0x5558b0918370 2023-10-06T02:27:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.901+0000 7ff20ffff700 1 -- 172.21.15.6:0/3906856523 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210008c20 con 0x5558b0918370 2023-10-06T02:27:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.901+0000 7ff21c667000 1 -- 172.21.15.6:0/3906856523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558b0918370 msgr2=0x5558b09170a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.901+0000 7ff21c667000 1 --2- 172.21.15.6:0/3906856523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558b0918370 0x5558b09170a0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7ff2100056f0 tx=0x7ff210015000 comp rx=0 tx=0).stop 2023-10-06T02:27:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.901+0000 7ff21c667000 1 -- 172.21.15.6:0/3906856523 shutdown_connections 2023-10-06T02:27:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.901+0000 7ff21c667000 1 --2- 172.21.15.6:0/3906856523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558b0918370 0x5558b09170a0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.901+0000 7ff21c667000 1 --2- 172.21.15.6:0/3906856523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff204003a60 0x5558b09018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.901+0000 7ff21c667000 1 --2- 172.21.15.6:0/3906856523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558b09188b0 0x5558b0916b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.901+0000 7ff21c667000 1 -- 172.21.15.6:0/3906856523 >> 172.21.15.6:0/3906856523 conn(0x5558b08495d0 msgr2=0x5558b0877a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.901+0000 7ff21c667000 1 -- 172.21.15.6:0/3906856523 shutdown_connections 2023-10-06T02:27:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.901+0000 7ff21c667000 1 -- 172.21.15.6:0/3906856523 wait complete. 2023-10-06T02:27:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.902+0000 7ff21c667000 1 Processor -- start 2023-10-06T02:27:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.902+0000 7ff21c667000 1 -- start start 2023-10-06T02:27:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff21c667000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558b0918370 0x5558b08fc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff21c667000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558b09188b0 0x5558b092f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff21c667000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff204003a60 0x5558b08fae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff21c667000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558b078a400 con 0x5558b0918370 2023-10-06T02:27:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff21c667000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558b08fb860 con 0x5558b09188b0 2023-10-06T02:27:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff21c667000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558b08fbb00 con 0x7ff204003a60 2023-10-06T02:27:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff2158a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558b0918370 0x5558b08fc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff2158a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558b0918370 0x5558b08fc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56374/0 (socket says 172.21.15.6:56374) 2023-10-06T02:27:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 learned_addr learned my addr 172.21.15.6:0/429812763 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff2150a1700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558b09188b0 0x5558b092f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff2160a3700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff204003a60 0x5558b08fae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff204003a60 msgr2=0x5558b08fae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff2158a2700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff204003a60 0x5558b08fae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558b09188b0 msgr2=0x5558b092f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff2158a2700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558b09188b0 0x5558b092f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff204001e10 con 0x5558b0918370 2023-10-06T02:27:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff2158a2700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558b0918370 0x5558b08fc780 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7ff20800f590 tx=0x7ff208008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff20e7fc700 1 -- 172.21.15.6:0/429812763 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20800fec0 con 0x5558b0918370 2023-10-06T02:27:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff20e7fc700 1 -- 172.21.15.6:0/429812763 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff208002260 con 0x5558b0918370 2023-10-06T02:27:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5558b0795540 con 0x5558b0918370 2023-10-06T02:27:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.903+0000 7ff20e7fc700 1 -- 172.21.15.6:0/429812763 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2080015b0 con 0x5558b0918370 2023-10-06T02:27:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.904+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558b08fc040 con 0x5558b0918370 2023-10-06T02:27:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.905+0000 7ff20e7fc700 1 -- 172.21.15.6:0/429812763 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff208003040 con 0x5558b0918370 2023-10-06T02:27:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.905+0000 7ff20e7fc700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff1f80658c0 0x7ff1f8067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.905+0000 7ff20e7fc700 1 -- 172.21.15.6:0/429812763 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8098+0+0 (secure 0 0 0) 0x7ff208083260 con 0x5558b0918370 2023-10-06T02:27:16.910 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:27:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.905+0000 7ff2150a1700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff1f80658c0 0x7ff1f8067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.906+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5558b08fb3b0 0x5558b088c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.906+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b088cc10 con 0x5558b08fb3b0 2023-10-06T02:27:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.906+0000 7ff2160a3700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5558b08fb3b0 0x5558b088c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.906+0000 7ff2160a3700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5558b08fb3b0 0x5558b088c6d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.906+0000 7ff2150a1700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff1f80658c0 0x7ff1f8067d70 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff2000093b0 tx=0x5558b091d680 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.908+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v115'598 uv572 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.908+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b088cff0 con 0x5558b08fb3b0 2023-10-06T02:27:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.909+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v115'599 uv599 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.909+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093c850 con 0x5558b08fb3b0 2023-10-06T02:27:16.912 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:27:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.910+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v115'600 uv600 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.911+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093dc10 con 0x5558b08fb3b0 2023-10-06T02:27:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.912+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v115'601 uv601 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.912+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093dfc0 con 0x5558b08fb3b0 2023-10-06T02:27:16.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.914+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v115'602 uv602 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.914+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093cc00 con 0x5558b08fb3b0 2023-10-06T02:27:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.915+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v115'603 uv603 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.915+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093cfb0 con 0x5558b08fb3b0 2023-10-06T02:27:16.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.917+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v115'604 uv578 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.917+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093cfb0 con 0x5558b08fb3b0 2023-10-06T02:27:16.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.918+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v115'605 uv605 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.918+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093cfb0 con 0x5558b08fb3b0 2023-10-06T02:27:16.920 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:27:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.919+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v115'606 uv606 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.919+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093cfb0 con 0x5558b08fb3b0 2023-10-06T02:27:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.921+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v115'607 uv607 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.921+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093cfb0 con 0x5558b08fb3b0 2023-10-06T02:27:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.922+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v115'608 uv608 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.922+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093cfb0 con 0x5558b08fb3b0 2023-10-06T02:27:16.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.923+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v115'609 uv609 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.923+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093cfb0 con 0x5558b08fb3b0 2023-10-06T02:27:16.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.925+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v115'610 uv585 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.925+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093cfb0 con 0x5558b08fb3b0 2023-10-06T02:27:16.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.926+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v115'611 uv611 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.926+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093cfb0 con 0x5558b08fb3b0 2023-10-06T02:27:16.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.927+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v115'612 uv612 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.928 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:27:16.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.927+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093cfb0 con 0x5558b08fb3b0 2023-10-06T02:27:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.928+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v115'613 uv613 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.928+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093cfb0 con 0x5558b08fb3b0 2023-10-06T02:27:16.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.929+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v115'614 uv614 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.930+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093cfb0 con 0x5558b08fb3b0 2023-10-06T02:27:16.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.931+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v115'615 uv615 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.931+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093d390 con 0x5558b08fb3b0 2023-10-06T02:27:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.932+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v115'616 uv616 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.932+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093d840 con 0x5558b08fb3b0 2023-10-06T02:27:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.933+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v115'617 uv591 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.933+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093d390 con 0x5558b08fb3b0 2023-10-06T02:27:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.934+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v115'618 uv618 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.935+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093d390 con 0x5558b08fb3b0 2023-10-06T02:27:16.936 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:27:16.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.936+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v115'619 uv619 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.936+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093d390 con 0x5558b08fb3b0 2023-10-06T02:27:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.937+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v115'620 uv620 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.937+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093d390 con 0x5558b08fb3b0 2023-10-06T02:27:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.938+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v115'621 uv621 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.938+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093d390 con 0x5558b08fb3b0 2023-10-06T02:27:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.939+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v115'622 uv622 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.939+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093d390 con 0x5558b08fb3b0 2023-10-06T02:27:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.941+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v115'623 uv597 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.941+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093d390 con 0x5558b08fb3b0 2023-10-06T02:27:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.942+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v115'624 uv624 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.942+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093d390 con 0x5558b08fb3b0 2023-10-06T02:27:16.943 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:27:16.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.943+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v115'625 uv625 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.943+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093d390 con 0x5558b08fb3b0 2023-10-06T02:27:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.944+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v115'626 uv626 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.944+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093d390 con 0x5558b08fb3b0 2023-10-06T02:27:16.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.946+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v115'627 uv627 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.946+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b093d390 con 0x5558b08fb3b0 2023-10-06T02:27:16.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.947+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v115'628 uv628 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b08fb3b0 2023-10-06T02:27:16.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.947+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5558b093e370 0x5558b0940750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:16.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.947+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0940c90 con 0x5558b093e370 2023-10-06T02:27:16.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.948+0000 7ff2158a2700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5558b093e370 0x5558b0940750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:16.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.948+0000 7ff2158a2700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5558b093e370 0x5558b0940750 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:16.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.949+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v115'436 uv419 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.949+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0941040 con 0x5558b093e370 2023-10-06T02:27:16.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.951+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v115'437 uv437 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.951+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09413f0 con 0x5558b093e370 2023-10-06T02:27:16.952 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:27:16.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.952+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v115'438 uv438 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.952+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09417a0 con 0x5558b093e370 2023-10-06T02:27:16.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.953+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v115'439 uv439 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.953+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b08779a0 con 0x5558b093e370 2023-10-06T02:27:16.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.954+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v115'440 uv440 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.954+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0942040 con 0x5558b093e370 2023-10-06T02:27:16.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.955+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v115'441 uv424 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.955+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09423f0 con 0x5558b093e370 2023-10-06T02:27:16.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.956+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v115'442 uv442 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.956+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09427a0 con 0x5558b093e370 2023-10-06T02:27:16.957 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:27:16.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.957+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v115'443 uv443 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.957+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09427a0 con 0x5558b093e370 2023-10-06T02:27:16.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.958+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v115'444 uv444 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.958+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09427a0 con 0x5558b093e370 2023-10-06T02:27:16.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.959+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v115'445 uv445 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.959+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09427a0 con 0x5558b093e370 2023-10-06T02:27:16.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.960+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v115'446 uv429 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.960+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09427a0 con 0x5558b093e370 2023-10-06T02:27:16.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.961+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v115'447 uv447 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.961+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09427a0 con 0x5558b093e370 2023-10-06T02:27:16.962 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:27:16.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.962+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v115'448 uv448 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.962+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0945ec0 con 0x5558b093e370 2023-10-06T02:27:16.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.963+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v115'449 uv449 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.963+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0945ec0 con 0x5558b093e370 2023-10-06T02:27:16.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.964+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v115'450 uv450 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.964+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09427a0 con 0x5558b093e370 2023-10-06T02:27:16.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.965+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v115'451 uv435 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.965+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09427a0 con 0x5558b093e370 2023-10-06T02:27:16.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.966+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v115'452 uv452 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.966+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09427a0 con 0x5558b093e370 2023-10-06T02:27:16.967 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:27:16.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.967+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v115'453 uv453 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.967+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09437b0 con 0x5558b093e370 2023-10-06T02:27:16.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.968+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v115'454 uv454 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.968+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09437b0 con 0x5558b093e370 2023-10-06T02:27:16.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.969+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v115'455 uv455 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.969+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09427a0 con 0x5558b093e370 2023-10-06T02:27:16.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.970+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v115'456 uv456 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.970+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5558b0942cb0 0x5558b0945090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:16.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.970+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09455d0 con 0x5558b0942cb0 2023-10-06T02:27:16.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.970+0000 7ff2150a1700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5558b0942cb0 0x5558b0945090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:16.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.971+0000 7ff2150a1700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5558b0942cb0 0x5558b0945090 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:16.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.972+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v115'117 uv116 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:16.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.972+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0945e70 con 0x5558b0942cb0 2023-10-06T02:27:16.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.973+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v115'118 uv118 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:16.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.973+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0946220 con 0x5558b0942cb0 2023-10-06T02:27:16.974 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:27:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.974+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v115'119 uv119 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.974+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0947660 con 0x5558b0942cb0 2023-10-06T02:27:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.977+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v115'120 uv120 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.977+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0947af0 con 0x5558b0942cb0 2023-10-06T02:27:16.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.978+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v115'121 uv121 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:16.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.978+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09465d0 con 0x5558b0942cb0 2023-10-06T02:27:16.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.979+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v115'122 uv122 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:16.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.979+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09469d0 con 0x5558b0942cb0 2023-10-06T02:27:16.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.980+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v115'84 uv83 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:16.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.980+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09469d0 con 0x5558b0942cb0 2023-10-06T02:27:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.981+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v115'85 uv85 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.981+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09469d0 con 0x5558b0942cb0 2023-10-06T02:27:16.982 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:27:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.982+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v115'86 uv86 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.982+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0946ea0 con 0x5558b0942cb0 2023-10-06T02:27:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.982+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v115'87 uv87 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.983+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0946a70 con 0x5558b093e370 2023-10-06T02:27:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.984+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v115'117 uv116 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.984+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0946a70 con 0x5558b093e370 2023-10-06T02:27:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.985+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v115'118 uv118 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.985+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0946ea0 con 0x5558b093e370 2023-10-06T02:27:16.986 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:27:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.986+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v115'119 uv119 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.986+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0946ea0 con 0x5558b093e370 2023-10-06T02:27:16.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.987+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v115'120 uv120 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.987+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0946ea0 con 0x5558b093e370 2023-10-06T02:27:16.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.988+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v115'121 uv121 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.988+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0946ea0 con 0x5558b093e370 2023-10-06T02:27:16.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.989+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v115'122 uv122 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b093e370 2023-10-06T02:27:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.989+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5558b09469d0 0x5558b094a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.989+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0946ea0 con 0x5558b09469d0 2023-10-06T02:27:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.989+0000 7ff2160a3700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5558b09469d0 0x5558b094a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.989+0000 7ff2160a3700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5558b09469d0 0x5558b094a440 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:16.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.990+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v115'216 uv210 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b09469d0 2023-10-06T02:27:16.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.990+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094a980 con 0x5558b09469d0 2023-10-06T02:27:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.992+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v115'217 uv217 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b09469d0 2023-10-06T02:27:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.992+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094a980 con 0x5558b09469d0 2023-10-06T02:27:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.993+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v115'218 uv218 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b09469d0 2023-10-06T02:27:16.993 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:27:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.993+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094b990 con 0x5558b09469d0 2023-10-06T02:27:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.994+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v115'219 uv219 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b09469d0 2023-10-06T02:27:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.994+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094b990 con 0x5558b09469d0 2023-10-06T02:27:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.995+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v115'220 uv220 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b09469d0 2023-10-06T02:27:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.995+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094a980 con 0x5558b09469d0 2023-10-06T02:27:16.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.996+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v115'221 uv221 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b09469d0 2023-10-06T02:27:16.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.996+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094a980 con 0x5558b09469d0 2023-10-06T02:27:16.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.997+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v115'222 uv215 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b09469d0 2023-10-06T02:27:16.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.997+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094a980 con 0x5558b09469d0 2023-10-06T02:27:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.998+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v115'223 uv223 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b09469d0 2023-10-06T02:27:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.998+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094a980 con 0x5558b09469d0 2023-10-06T02:27:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.999+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v115'224 uv224 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b09469d0 2023-10-06T02:27:17.000 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:27:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:16.999+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094a980 con 0x5558b09469d0 2023-10-06T02:27:17.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.001+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v115'225 uv225 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b09469d0 2023-10-06T02:27:17.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.001+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094a980 con 0x5558b09469d0 2023-10-06T02:27:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.002+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v115'226 uv226 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210013420 con 0x5558b09469d0 2023-10-06T02:27:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.002+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5558b094b000 0x5558b094d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.002+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094dae0 con 0x5558b094b000 2023-10-06T02:27:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.002+0000 7ff2158a2700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5558b094b000 0x5558b094d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.003+0000 7ff2158a2700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5558b094b000 0x5558b094d3e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.004+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v115'97 uv96 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b094b000 2023-10-06T02:27:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.004+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094db20 con 0x5558b094b000 2023-10-06T02:27:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.005+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v115'98 uv98 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b094b000 2023-10-06T02:27:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.005+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094df50 con 0x5558b094b000 2023-10-06T02:27:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.006+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v115'99 uv99 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b094b000 2023-10-06T02:27:17.007 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:27:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.007+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094df50 con 0x5558b094b000 2023-10-06T02:27:17.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.009+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v115'100 uv100 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b094b000 2023-10-06T02:27:17.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.009+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094df50 con 0x5558b094b000 2023-10-06T02:27:17.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.012+0000 7ff2158a2700 1 -- 172.21.15.6:0/429812763 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v115'101 uv101 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff208051c80 con 0x5558b094b000 2023-10-06T02:27:17.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.012+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094df50 con 0x5558b0942cb0 2023-10-06T02:27:17.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.013+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v115'117 uv116 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.013+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094df50 con 0x5558b0942cb0 2023-10-06T02:27:17.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.014+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v115'118 uv118 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.014+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094df50 con 0x5558b0942cb0 2023-10-06T02:27:17.015 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:27:17.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.015+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v115'119 uv119 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.015+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094ef60 con 0x5558b0942cb0 2023-10-06T02:27:17.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.016+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v115'120 uv120 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.016+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094ef60 con 0x5558b0942cb0 2023-10-06T02:27:17.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.017+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v115'121 uv121 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.017+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b094df50 con 0x5558b0942cb0 2023-10-06T02:27:17.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.017+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v115'122 uv122 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.018+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5558b094e5d0 0x5558b09509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.018+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0950f80 con 0x5558b094e5d0 2023-10-06T02:27:17.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.018+0000 7ff2150a1700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5558b094e5d0 0x5558b09509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.018+0000 7ff2150a1700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5558b094e5d0 0x5558b09509b0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:17.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.019+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v115'192 uv186 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b094e5d0 2023-10-06T02:27:17.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.019+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0951040 con 0x5558b094e5d0 2023-10-06T02:27:17.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.020+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v115'193 uv193 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b094e5d0 2023-10-06T02:27:17.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.020+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0951040 con 0x5558b094e5d0 2023-10-06T02:27:17.021 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:27:17.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.021+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v115'194 uv194 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b094e5d0 2023-10-06T02:27:17.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.021+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09514c0 con 0x5558b094e5d0 2023-10-06T02:27:17.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.022+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v115'195 uv195 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b094e5d0 2023-10-06T02:27:17.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.022+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09514c0 con 0x5558b094e5d0 2023-10-06T02:27:17.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.023+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v115'196 uv196 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b094e5d0 2023-10-06T02:27:17.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.023+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09514c0 con 0x5558b094e5d0 2023-10-06T02:27:17.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.024+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v115'197 uv191 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b094e5d0 2023-10-06T02:27:17.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.024+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09514c0 con 0x5558b094e5d0 2023-10-06T02:27:17.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.025+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v115'198 uv198 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b094e5d0 2023-10-06T02:27:17.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.025+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09514c0 con 0x5558b094e5d0 2023-10-06T02:27:17.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.026+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v115'199 uv199 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b094e5d0 2023-10-06T02:27:17.027 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:27:17.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.026+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09514c0 con 0x5558b094e5d0 2023-10-06T02:27:17.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.027+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v115'200 uv200 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b094e5d0 2023-10-06T02:27:17.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.027+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0954230 con 0x5558b094e5d0 2023-10-06T02:27:17.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.028+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v115'201 uv201 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b094e5d0 2023-10-06T02:27:17.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.028+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b0942cb0 2023-10-06T02:27:17.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.030+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v115'87 uv86 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.030+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b0942cb0 2023-10-06T02:27:17.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.031+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v115'88 uv88 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.031+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b0942cb0 2023-10-06T02:27:17.032 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:27:17.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.031+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v115'89 uv89 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.031+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b0942cb0 2023-10-06T02:27:17.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.032+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v115'90 uv90 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.032+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5558b09522c0 0x5558b0954980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.032+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b09522c0 2023-10-06T02:27:17.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.033+0000 7ff2160a3700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5558b09522c0 0x5558b0954980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.033+0000 7ff2160a3700 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5558b09522c0 0x5558b0954980 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.037+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v115'117 uv116 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210031040 con 0x5558b09522c0 2023-10-06T02:27:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.037+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b09522c0 2023-10-06T02:27:17.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.038+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v115'118 uv118 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210031040 con 0x5558b09522c0 2023-10-06T02:27:17.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.038+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b09522c0 2023-10-06T02:27:17.041 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:27:17.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.040+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v115'119 uv119 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210031040 con 0x5558b09522c0 2023-10-06T02:27:17.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.040+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b09522c0 2023-10-06T02:27:17.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.042+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v115'120 uv120 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210031040 con 0x5558b09522c0 2023-10-06T02:27:17.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.042+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b09522c0 2023-10-06T02:27:17.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.046+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v115'121 uv121 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210031040 con 0x5558b09522c0 2023-10-06T02:27:17.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.046+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b09522c0 2023-10-06T02:27:17.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.047+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v115'122 uv122 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210031040 con 0x5558b09522c0 2023-10-06T02:27:17.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.048+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b09469d0 2023-10-06T02:27:17.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.049+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v115'99 uv98 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210031040 con 0x5558b09469d0 2023-10-06T02:27:17.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.049+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b09469d0 2023-10-06T02:27:17.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.050+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v115'100 uv100 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210031040 con 0x5558b09469d0 2023-10-06T02:27:17.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.050+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b09469d0 2023-10-06T02:27:17.051 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:27:17.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.050+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v115'101 uv101 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210031040 con 0x5558b09469d0 2023-10-06T02:27:17.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.050+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b09469d0 2023-10-06T02:27:17.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.051+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v115'102 uv102 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210031040 con 0x5558b09469d0 2023-10-06T02:27:17.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.051+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b09469d0 2023-10-06T02:27:17.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.052+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v115'103 uv103 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ff210031040 con 0x5558b09469d0 2023-10-06T02:27:17.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.052+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b0942cb0 2023-10-06T02:27:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.054+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v115'241 uv233 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.054+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b0942cb0 2023-10-06T02:27:17.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.058+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v115'242 uv242 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.058+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b0942cb0 2023-10-06T02:27:17.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.059+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v115'243 uv243 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.059 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:27:17.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.059+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b0942cb0 2023-10-06T02:27:17.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.062+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v115'244 uv244 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.062+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b0942cb0 2023-10-06T02:27:17.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.065+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v115'245 uv245 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.065+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b0942cb0 2023-10-06T02:27:17.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.067+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v115'246 uv240 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.067+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b0942cb0 2023-10-06T02:27:17.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.070+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v115'247 uv247 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.070+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b0942cb0 2023-10-06T02:27:17.073 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:27:17.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.073+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v115'248 uv248 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.073+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b0942cb0 2023-10-06T02:27:17.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.076+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v115'249 uv249 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.076+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b0942cb0 2023-10-06T02:27:17.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.081+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v115'250 uv250 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.081+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b09519b0 con 0x5558b0942cb0 2023-10-06T02:27:17.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.082+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v115'251 uv251 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.082+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x5558b0954ec0 con 0x5558b0942cb0 2023-10-06T02:27:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff2150a1700 1 -- 172.21.15.6:0/429812763 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v115'252 uv252 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7ff200010af0 con 0x5558b0942cb0 2023-10-06T02:27:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5558b0942cb0 msgr2=0x5558b0945090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5558b0942cb0 0x5558b0945090 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5558b08fb3b0 msgr2=0x5558b088c6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5558b08fb3b0 0x5558b088c6d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5558b094e5d0 msgr2=0x5558b09509b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5558b094e5d0 0x5558b09509b0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5558b093e370 msgr2=0x5558b0940750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5558b093e370 0x5558b0940750 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5558b09522c0 msgr2=0x5558b0954980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5558b09522c0 0x5558b0954980 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5558b094b000 msgr2=0x5558b094d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5558b094b000 0x5558b094d3e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 reap_dead start 2023-10-06T02:27:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5558b09469d0 msgr2=0x5558b094a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5558b09469d0 0x5558b094a440 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 reap_dead start 2023-10-06T02:27:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.085+0000 7ff2160a3700 1 -- 172.21.15.6:0/429812763 reap_dead start 2023-10-06T02:27:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.086+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff1f80658c0 msgr2=0x7ff1f8067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.086+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff1f80658c0 0x7ff1f8067d70 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff2000093b0 tx=0x5558b091d680 comp rx=0 tx=0).stop 2023-10-06T02:27:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.086+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558b0918370 msgr2=0x5558b08fc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.086+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558b0918370 0x5558b08fc780 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7ff20800f590 tx=0x7ff208008040 comp rx=0 tx=0).stop 2023-10-06T02:27:17.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.086+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 shutdown_connections 2023-10-06T02:27:17.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.086+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558b0918370 0x5558b08fc780 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.086+0000 7ff21c667000 1 --2- 172.21.15.6:0/429812763 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff1f80658c0 0x7ff1f8067d70 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.086+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 >> 172.21.15.6:0/429812763 conn(0x5558b08495d0 msgr2=0x5558b091bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:17.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.086+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 shutdown_connections 2023-10-06T02:27:17.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.086+0000 7ff21c667000 1 -- 172.21.15.6:0/429812763 wait complete. 2023-10-06T02:27:17.091 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2023-10-06T02:27:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.169+0000 7fb41b6c3000 1 Processor -- start 2023-10-06T02:27:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.169+0000 7fb41b6c3000 1 -- start start 2023-10-06T02:27:17.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.170+0000 7fb41b6c3000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b437be680 0x561b437bbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.170+0000 7fb41b6c3000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b437c0ab0 0x561b4378fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.170+0000 7fb41b6c3000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b437c0e80 0x561b437dae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.170+0000 7fb41b6c3000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b436dc980 con 0x561b437c0e80 2023-10-06T02:27:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.170+0000 7fb41b6c3000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b436dc620 con 0x561b437c0ab0 2023-10-06T02:27:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.170+0000 7fb41b6c3000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b436d3400 con 0x561b437be680 2023-10-06T02:27:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.170+0000 7fb4150ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b437c0e80 0x561b437dae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.170+0000 7fb4150ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b437c0e80 0x561b437dae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56392/0 (socket says 172.21.15.6:56392) 2023-10-06T02:27:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.170+0000 7fb4140fd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b437c0ab0 0x561b4378fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.170+0000 7fb4150ff700 1 -- 172.21.15.6:0/1893486419 learned_addr learned my addr 172.21.15.6:0/1893486419 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.170+0000 7fb4148fe700 1 --2- 172.21.15.6:0/1893486419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b437be680 0x561b437bbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb4150ff700 1 -- 172.21.15.6:0/1893486419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b437be680 msgr2=0x561b437bbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb4150ff700 1 --2- 172.21.15.6:0/1893486419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b437be680 0x561b437bbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb4150ff700 1 -- 172.21.15.6:0/1893486419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b437c0ab0 msgr2=0x561b4378fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb4150ff700 1 --2- 172.21.15.6:0/1893486419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b437c0ab0 0x561b4378fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb4150ff700 1 -- 172.21.15.6:0/1893486419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb408005db0 con 0x561b437c0e80 2023-10-06T02:27:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb4150ff700 1 --2- 172.21.15.6:0/1893486419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b437c0e80 0x561b437dae20 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fb404001550 tx=0x7fb404006b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75613a892f1108e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:17.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb4130fb700 1 -- 172.21.15.6:0/1893486419 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb404004150 con 0x561b437c0e80 2023-10-06T02:27:17.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb4130fb700 1 -- 172.21.15.6:0/1893486419 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb404013460 con 0x561b437c0e80 2023-10-06T02:27:17.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb4130fb700 1 -- 172.21.15.6:0/1893486419 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb404013800 con 0x561b437c0e80 2023-10-06T02:27:17.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb41b6c3000 1 -- 172.21.15.6:0/1893486419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b437c0e80 msgr2=0x561b437dae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb41b6c3000 1 --2- 172.21.15.6:0/1893486419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b437c0e80 0x561b437dae20 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fb404001550 tx=0x7fb404006b10 comp rx=0 tx=0).stop 2023-10-06T02:27:17.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb41b6c3000 1 -- 172.21.15.6:0/1893486419 shutdown_connections 2023-10-06T02:27:17.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb41b6c3000 1 --2- 172.21.15.6:0/1893486419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b437c0e80 0x561b437dae20 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb41b6c3000 1 --2- 172.21.15.6:0/1893486419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b437be680 0x561b437bbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb41b6c3000 1 --2- 172.21.15.6:0/1893486419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b437c0ab0 0x561b4378fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb41b6c3000 1 -- 172.21.15.6:0/1893486419 >> 172.21.15.6:0/1893486419 conn(0x561b437d8bd0 msgr2=0x561b437932c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:17.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb41b6c3000 1 -- 172.21.15.6:0/1893486419 shutdown_connections 2023-10-06T02:27:17.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.171+0000 7fb41b6c3000 1 -- 172.21.15.6:0/1893486419 wait complete. 2023-10-06T02:27:17.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.172+0000 7fb41b6c3000 1 Processor -- start 2023-10-06T02:27:17.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.172+0000 7fb41b6c3000 1 -- start start 2023-10-06T02:27:17.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb41b6c3000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b437be680 0x561b437d4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb41b6c3000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b437c0ab0 0x561b4387c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb41b6c3000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b437c0e80 0x561b4387c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb41b6c3000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b437d6660 con 0x561b437c0e80 2023-10-06T02:27:17.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb41b6c3000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b437d6900 con 0x561b437c0ab0 2023-10-06T02:27:17.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb41b6c3000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b437d6ba0 con 0x561b437be680 2023-10-06T02:27:17.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb4150ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b437c0e80 0x561b4387c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb4148fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b437be680 0x561b437d4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb4140fd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b437c0ab0 0x561b4387c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb4148fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b437be680 0x561b437d4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:42072/0 (socket says 172.21.15.6:42072) 2023-10-06T02:27:17.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb4150ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b437c0e80 0x561b4387c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56408/0 (socket says 172.21.15.6:56408) 2023-10-06T02:27:17.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb4148fe700 1 -- 172.21.15.6:0/3078629811 learned_addr learned my addr 172.21.15.6:0/3078629811 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:17.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb4150ff700 1 -- 172.21.15.6:0/3078629811 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b437be680 msgr2=0x561b437d4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb4150ff700 1 --2- 172.21.15.6:0/3078629811 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561b437be680 0x561b437d4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb4150ff700 1 -- 172.21.15.6:0/3078629811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b437c0ab0 msgr2=0x561b4387c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb4150ff700 1 --2- 172.21.15.6:0/3078629811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561b437c0ab0 0x561b4387c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb4150ff700 1 -- 172.21.15.6:0/3078629811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b436de750 con 0x561b437c0e80 2023-10-06T02:27:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb4150ff700 1 --2- 172.21.15.6:0/3078629811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b437c0e80 0x561b4387c7f0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fb404001550 tx=0x7fb404013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb4118f8700 1 -- 172.21.15.6:0/3078629811 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb404017070 con 0x561b437c0e80 2023-10-06T02:27:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb4118f8700 1 -- 172.21.15.6:0/3078629811 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb404004150 con 0x561b437c0e80 2023-10-06T02:27:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.173+0000 7fb4118f8700 1 -- 172.21.15.6:0/3078629811 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40401a040 con 0x561b437c0e80 2023-10-06T02:27:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.174+0000 7fb41b6c3000 1 -- 172.21.15.6:0/3078629811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b436eb3d0 con 0x561b437c0e80 2023-10-06T02:27:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.174+0000 7fb41b6c3000 1 -- 172.21.15.6:0/3078629811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b436deae0 con 0x561b437c0e80 2023-10-06T02:27:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.175+0000 7fb4118f8700 1 -- 172.21.15.6:0/3078629811 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb40400dd20 con 0x561b437c0e80 2023-10-06T02:27:17.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.175+0000 7fb4118f8700 1 --2- 172.21.15.6:0/3078629811 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4000658c0 0x7fb400067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.175+0000 7fb4118f8700 1 -- 172.21.15.6:0/3078629811 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8098+0+0 (secure 0 0 0) 0x7fb404084a40 con 0x561b437c0e80 2023-10-06T02:27:17.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.175+0000 7fb41b6c3000 1 --2- 172.21.15.6:0/3078629811 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x561b437d61e0 0x561b437d7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.175+0000 7fb4148fe700 1 --2- 172.21.15.6:0/3078629811 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4000658c0 0x7fb400067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.175+0000 7fb41b6c3000 1 -- 172.21.15.6:0/3078629811 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v8 -- 0x561b437d4a70 con 0x561b437d61e0 2023-10-06T02:27:17.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.176+0000 7fb4140fd700 1 --2- 172.21.15.6:0/3078629811 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x561b437d61e0 0x561b437d7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.176+0000 7fb4140fd700 1 --2- 172.21.15.6:0/3078629811 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x561b437d61e0 0x561b437d7a90 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:17.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.176+0000 7fb4148fe700 1 --2- 172.21.15.6:0/3078629811 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4000658c0 0x7fb400067d70 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb40c005dc0 tx=0x7fb40c00c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:17.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.177+0000 7fb4140fd700 1 -- 172.21.15.6:0/3078629811 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~80] v115'202 uv202 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb408000bc0 con 0x561b437d61e0 2023-10-06T02:27:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.177+0000 7fb41b6c3000 1 -- 172.21.15.6:0/3078629811 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x561b437d61e0 msgr2=0x561b437d7a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.177+0000 7fb41b6c3000 1 --2- 172.21.15.6:0/3078629811 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x561b437d61e0 0x561b437d7a90 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.177+0000 7fb41b6c3000 1 -- 172.21.15.6:0/3078629811 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4000658c0 msgr2=0x7fb400067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.177+0000 7fb41b6c3000 1 --2- 172.21.15.6:0/3078629811 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4000658c0 0x7fb400067d70 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb40c005dc0 tx=0x7fb40c00c040 comp rx=0 tx=0).stop 2023-10-06T02:27:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.177+0000 7fb41b6c3000 1 -- 172.21.15.6:0/3078629811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b437c0e80 msgr2=0x561b4387c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.177+0000 7fb41b6c3000 1 --2- 172.21.15.6:0/3078629811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b437c0e80 0x561b4387c7f0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fb404001550 tx=0x7fb404013000 comp rx=0 tx=0).stop 2023-10-06T02:27:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.177+0000 7fb4150ff700 1 -- 172.21.15.6:0/3078629811 reap_dead start 2023-10-06T02:27:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.177+0000 7fb41b6c3000 1 -- 172.21.15.6:0/3078629811 shutdown_connections 2023-10-06T02:27:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.177+0000 7fb41b6c3000 1 -- 172.21.15.6:0/3078629811 >> 172.21.15.6:0/3078629811 conn(0x561b437d8bd0 msgr2=0x561b437932c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.177+0000 7fb41b6c3000 1 -- 172.21.15.6:0/3078629811 shutdown_connections 2023-10-06T02:27:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.177+0000 7fb41b6c3000 1 -- 172.21.15.6:0/3078629811 wait complete. 2023-10-06T02:27:17.187 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:27:17.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.346+0000 7f6223a7d700 1 Processor -- start 2023-10-06T02:27:17.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.346+0000 7f6223a7d700 1 -- start start 2023-10-06T02:27:17.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.347+0000 7f6223a7d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f621c15a030 0x7f621c15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.347+0000 7f6223a7d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f621c087700 0x7f621c0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.347+0000 7f6223a7d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621c0afc50 con 0x7f621c15a940 2023-10-06T02:27:17.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.347+0000 7f6223a7d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621c0b0cf0 con 0x7f621c087700 2023-10-06T02:27:17.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.347+0000 7f6223a7d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621c0aff30 con 0x7f621c15a030 2023-10-06T02:27:17.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.347+0000 7f622201a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f621c087700 0x7f621c0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.347+0000 7f622201a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f621c087700 0x7f621c0b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56416/0 (socket says 172.21.15.6:56416) 2023-10-06T02:27:17.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.347+0000 7f622201a700 1 -- 172.21.15.6:0/1440186075 learned_addr learned my addr 172.21.15.6:0/1440186075 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:17.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.347+0000 7f6221819700 1 --2- 172.21.15.6:0/1440186075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f621c15a030 0x7f621c15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.348+0000 7f622201a700 1 -- 172.21.15.6:0/1440186075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f621c15a030 msgr2=0x7f621c15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:17.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.348+0000 7f622201a700 1 --2- 172.21.15.6:0/1440186075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f621c15a030 0x7f621c15a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.348+0000 7f622201a700 1 -- 172.21.15.6:0/1440186075 >> v1:172.21.15.175:6789/0 conn(0x7f621c15a940 legacy=0x7f621c086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.348+0000 7f622201a700 1 -- 172.21.15.6:0/1440186075 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c0b0210 con 0x7f621c087700 2023-10-06T02:27:17.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.348+0000 7f622201a700 1 --2- 172.21.15.6:0/1440186075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f621c087700 0x7f621c0b21b0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f620c009f20 tx=0x7f620c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f610efa7cb94838 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:17.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.348+0000 7f6220817700 1 -- 172.21.15.6:0/1440186075 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c00e070 con 0x7f621c087700 2023-10-06T02:27:17.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.348+0000 7f6220817700 1 -- 172.21.15.6:0/1440186075 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c00b9d0 con 0x7f621c087700 2023-10-06T02:27:17.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.348+0000 7f6220817700 1 -- 172.21.15.6:0/1440186075 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c0092e0 con 0x7f621c087700 2023-10-06T02:27:17.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.348+0000 7f6223a7d700 1 -- 172.21.15.6:0/1440186075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f621c087700 msgr2=0x7f621c0b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.348+0000 7f6223a7d700 1 --2- 172.21.15.6:0/1440186075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f621c087700 0x7f621c0b21b0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f620c009f20 tx=0x7f620c009840 comp rx=0 tx=0).stop 2023-10-06T02:27:17.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.348+0000 7f6223a7d700 1 -- 172.21.15.6:0/1440186075 shutdown_connections 2023-10-06T02:27:17.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.348+0000 7f6223a7d700 1 --2- 172.21.15.6:0/1440186075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f621c087700 0x7f621c0b21b0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.348+0000 7f6223a7d700 1 --2- 172.21.15.6:0/1440186075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f621c15a030 0x7f621c15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.349+0000 7f6223a7d700 1 -- 172.21.15.6:0/1440186075 >> 172.21.15.6:0/1440186075 conn(0x7f621c068680 msgr2=0x7f621c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.349+0000 7f6223a7d700 1 -- 172.21.15.6:0/1440186075 shutdown_connections 2023-10-06T02:27:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.349+0000 7f6223a7d700 1 -- 172.21.15.6:0/1440186075 wait complete. 2023-10-06T02:27:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.350+0000 7f6223a7d700 1 Processor -- start 2023-10-06T02:27:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.350+0000 7f6223a7d700 1 -- start start 2023-10-06T02:27:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.350+0000 7f6223a7d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f621c087700 0x7f621c0c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.350+0000 7f6223a7d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f621c15a030 0x7f621c0c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.350+0000 7f6223a7d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f621c15a940 0x7f621c15b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.350+0000 7f6223a7d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c0c86c0 con 0x7f621c15a940 2023-10-06T02:27:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.350+0000 7f6223a7d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c0c7830 con 0x7f621c087700 2023-10-06T02:27:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.350+0000 7f6223a7d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621c0c7ab0 con 0x7f621c15a030 2023-10-06T02:27:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.351+0000 7f622201a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f621c15a940 0x7f621c15b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.351+0000 7f622201a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f621c15a940 0x7f621c15b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56430/0 (socket says 172.21.15.6:56430) 2023-10-06T02:27:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.351+0000 7f622201a700 1 -- 172.21.15.6:0/999803889 learned_addr learned my addr 172.21.15.6:0/999803889 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.351+0000 7f6221819700 1 --2- 172.21.15.6:0/999803889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f621c087700 0x7f621c0c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.351+0000 7f6221018700 1 --2- 172.21.15.6:0/999803889 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f621c15a030 0x7f621c0c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.351+0000 7f622201a700 1 -- 172.21.15.6:0/999803889 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f621c15a030 msgr2=0x7f621c0c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.351+0000 7f622201a700 1 --2- 172.21.15.6:0/999803889 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f621c15a030 0x7f621c0c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.351+0000 7f622201a700 1 -- 172.21.15.6:0/999803889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f621c087700 msgr2=0x7f621c0c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.351+0000 7f622201a700 1 --2- 172.21.15.6:0/999803889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f621c087700 0x7f621c0c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.351+0000 7f622201a700 1 -- 172.21.15.6:0/999803889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620c009ae0 con 0x7f621c15a940 2023-10-06T02:27:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.351+0000 7f6221819700 1 --2- 172.21.15.6:0/999803889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f621c087700 0x7f621c0c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.351+0000 7f622201a700 1 --2- 172.21.15.6:0/999803889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f621c15a940 0x7f621c15b500 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f620c00b610 tx=0x7f620c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.351+0000 7f6219ffb700 1 -- 172.21.15.6:0/999803889 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c008ad0 con 0x7f621c15a940 2023-10-06T02:27:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.351+0000 7f6219ffb700 1 -- 172.21.15.6:0/999803889 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c008c30 con 0x7f621c15a940 2023-10-06T02:27:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.351+0000 7f6223a7d700 1 -- 172.21.15.6:0/999803889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621c0c7d90 con 0x7f621c15a940 2023-10-06T02:27:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.351+0000 7f6219ffb700 1 -- 172.21.15.6:0/999803889 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c026460 con 0x7f621c15a940 2023-10-06T02:27:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.352+0000 7f6223a7d700 1 -- 172.21.15.6:0/999803889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621c0c8350 con 0x7f621c15a940 2023-10-06T02:27:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.352+0000 7f6223a7d700 1 -- 172.21.15.6:0/999803889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621c0c8870 con 0x7f621c15a940 2023-10-06T02:27:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.353+0000 7f6219ffb700 1 -- 172.21.15.6:0/999803889 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f620c003040 con 0x7f621c15a940 2023-10-06T02:27:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.353+0000 7f6219ffb700 1 --2- 172.21.15.6:0/999803889 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6208066f30 0x7f62080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.353+0000 7f6219ffb700 1 -- 172.21.15.6:0/999803889 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8098+0+0 (secure 0 0 0) 0x7f620c086da0 con 0x7f621c15a940 2023-10-06T02:27:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.353+0000 7f6221819700 1 --2- 172.21.15.6:0/999803889 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6208066f30 0x7f62080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.354+0000 7f6221819700 1 --2- 172.21.15.6:0/999803889 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6208066f30 0x7f62080693e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6214011480 tx=0x7f62140091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.357+0000 7f6219ffb700 1 -- 172.21.15.6:0/999803889 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f621c0c8870 con 0x7f621c15a940 2023-10-06T02:27:17.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.598+0000 7f6223a7d700 1 -- 172.21.15.6:0/999803889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f621c0c8800 con 0x7f621c15a940 2023-10-06T02:27:17.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.846+0000 7f6219ffb700 1 -- 172.21.15.6:0/999803889 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v219) v1 ==== 162+0+0 (secure 0 0 0) 0x7f620c0536b0 con 0x7f621c15a940 2023-10-06T02:27:17.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.848+0000 7f6223a7d700 1 -- 172.21.15.6:0/999803889 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6208066f30 msgr2=0x7f62080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.848+0000 7f6223a7d700 1 --2- 172.21.15.6:0/999803889 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6208066f30 0x7f62080693e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6214011480 tx=0x7f62140091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.848+0000 7f6223a7d700 1 -- 172.21.15.6:0/999803889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f621c15a940 msgr2=0x7f621c15b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.848+0000 7f6223a7d700 1 --2- 172.21.15.6:0/999803889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f621c15a940 0x7f621c15b500 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f620c00b610 tx=0x7f620c018000 comp rx=0 tx=0).stop 2023-10-06T02:27:17.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.848+0000 7f6223a7d700 1 -- 172.21.15.6:0/999803889 shutdown_connections 2023-10-06T02:27:17.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.848+0000 7f6223a7d700 1 --2- 172.21.15.6:0/999803889 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6208066f30 0x7f62080693e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.848+0000 7f6223a7d700 1 --2- 172.21.15.6:0/999803889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f621c15a940 0x7f621c15b500 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.848+0000 7f6223a7d700 1 --2- 172.21.15.6:0/999803889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f621c087700 0x7f621c0c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.848+0000 7f6223a7d700 1 --2- 172.21.15.6:0/999803889 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f621c15a030 0x7f621c0c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.848+0000 7f6223a7d700 1 -- 172.21.15.6:0/999803889 >> 172.21.15.6:0/999803889 conn(0x7f621c068680 msgr2=0x7f621c0af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:17.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.848+0000 7f6223a7d700 1 -- 172.21.15.6:0/999803889 shutdown_connections 2023-10-06T02:27:17.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.848+0000 7f6223a7d700 1 -- 172.21.15.6:0/999803889 wait complete. 2023-10-06T02:27:17.851 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:27:17.853 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:27:17.853+0000 7fb00e9da700 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds0_inotable': virtual void InoTable::decode_state(ceph::buffer::v15_2_0::list::const_iterator&) no longer understand old encoding version 2 < 101: Malformed input 2023-10-06T02:27:17.855 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:17.853+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:27:17.855 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:17.853+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:27:17.859 INFO:tasks.ceph.mds.a.smithi006.stderr: -32> 2023-10-06T02:27:17.853+0000 7fb00e9da700 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds0_inotable': virtual void InoTable::decode_state(ceph::buffer::v15_2_0::list::const_iterator&) no longer understand old encoding version 2 < 101: Malformed input 2023-10-06T02:27:17.865 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:17.879 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:27:17.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.983+0000 7fba4bfe2700 1 Processor -- start 2023-10-06T02:27:17.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.983+0000 7fba4bfe2700 1 -- start start 2023-10-06T02:27:17.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.984+0000 7fba4bfe2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba441431b0 0x7fba440d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.984+0000 7fba4bfe2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fba440d0780 0x7fba440b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.984+0000 7fba4bfe2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba440cf8a0 con 0x7fba44142de0 2023-10-06T02:27:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.984+0000 7fba4bfe2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba440d0b50 con 0x7fba441431b0 2023-10-06T02:27:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.984+0000 7fba4bfe2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba440cec90 con 0x7fba440d0780 2023-10-06T02:27:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.984+0000 7fba4957d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba441431b0 0x7fba440d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.984+0000 7fba49d7e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fba44142de0 0x7fba440ccd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33470/0 (socket says 172.21.15.6:33470) 2023-10-06T02:27:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.984+0000 7fba4957d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba441431b0 0x7fba440d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56448/0 (socket says 172.21.15.6:56448) 2023-10-06T02:27:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.984+0000 7fba49d7e700 1 -- 172.21.15.6:0/2000638347 learned_addr learned my addr 172.21.15.6:0/2000638347 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.985+0000 7fba4a57f700 1 --2- 172.21.15.6:0/2000638347 >> v2:172.21.15.175:3300/0 conn(0x7fba440d0780 0x7fba440b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.985+0000 7fba4957d700 1 -- 172.21.15.6:0/2000638347 >> v2:172.21.15.175:3300/0 conn(0x7fba440d0780 msgr2=0x7fba440b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.985+0000 7fba4957d700 1 --2- 172.21.15.6:0/2000638347 >> v2:172.21.15.175:3300/0 conn(0x7fba440d0780 0x7fba440b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.985+0000 7fba4957d700 1 -- 172.21.15.6:0/2000638347 >> v1:172.21.15.6:6789/0 conn(0x7fba44142de0 legacy=0x7fba440ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.985+0000 7fba4957d700 1 -- 172.21.15.6:0/2000638347 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba440cef70 con 0x7fba441431b0 2023-10-06T02:27:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.985+0000 7fba48d7c700 1 -- 172.21.15.6:0/2000638347 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090921771 0 0) 0x7fba440cf8a0 con 0x7fba44142de0 2023-10-06T02:27:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.985+0000 7fba4a57f700 1 --2- 172.21.15.6:0/2000638347 >> v2:172.21.15.175:3300/0 conn(0x7fba440d0780 0x7fba440b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.985+0000 7fba4957d700 1 --2- 172.21.15.6:0/2000638347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba441431b0 0x7fba440d0240 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fba440d0e10 tx=0x7fba380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb84a7a0f6239b42 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.985+0000 7fba48d7c700 1 -- 172.21.15.6:0/2000638347 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3800b6b0 con 0x7fba441431b0 2023-10-06T02:27:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.985+0000 7fba48d7c700 1 -- 172.21.15.6:0/2000638347 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3800b810 con 0x7fba441431b0 2023-10-06T02:27:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.985+0000 7fba48d7c700 1 -- 172.21.15.6:0/2000638347 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3800bbb0 con 0x7fba441431b0 2023-10-06T02:27:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.986+0000 7fba4bfe2700 1 -- 172.21.15.6:0/2000638347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba441431b0 msgr2=0x7fba440d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.986+0000 7fba4bfe2700 1 --2- 172.21.15.6:0/2000638347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba441431b0 0x7fba440d0240 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fba440d0e10 tx=0x7fba380091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.986+0000 7fba4bfe2700 1 -- 172.21.15.6:0/2000638347 shutdown_connections 2023-10-06T02:27:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.986+0000 7fba4bfe2700 1 --2- 172.21.15.6:0/2000638347 >> v2:172.21.15.175:3300/0 conn(0x7fba440d0780 0x7fba440b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.986+0000 7fba4bfe2700 1 --2- 172.21.15.6:0/2000638347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba441431b0 0x7fba440d0240 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.986+0000 7fba4bfe2700 1 -- 172.21.15.6:0/2000638347 >> 172.21.15.6:0/2000638347 conn(0x7fba44069110 msgr2=0x7fba4406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.986+0000 7fba4bfe2700 1 -- 172.21.15.6:0/2000638347 shutdown_connections 2023-10-06T02:27:17.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.986+0000 7fba4bfe2700 1 -- 172.21.15.6:0/2000638347 wait complete. 2023-10-06T02:27:17.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.987+0000 7fba4bfe2700 1 Processor -- start 2023-10-06T02:27:17.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.987+0000 7fba4bfe2700 1 -- start start 2023-10-06T02:27:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba4bfe2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba440d0780 0x7fba440b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba4bfe2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba44142de0 0x7fba4413e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba4bfe2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba441431b0 0x7fba441545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba4bfe2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4413e7b0 con 0x7fba441431b0 2023-10-06T02:27:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba4bfe2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba44154b00 con 0x7fba44142de0 2023-10-06T02:27:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba4bfe2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba44155940 con 0x7fba440d0780 2023-10-06T02:27:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba4a57f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba441431b0 0x7fba441545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba4a57f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba441431b0 0x7fba441545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56462/0 (socket says 172.21.15.6:56462) 2023-10-06T02:27:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba4a57f700 1 -- 172.21.15.6:0/3250984703 learned_addr learned my addr 172.21.15.6:0/3250984703 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba4957d700 1 --2- 172.21.15.6:0/3250984703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba44142de0 0x7fba4413e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba49d7e700 1 --2- 172.21.15.6:0/3250984703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba440d0780 0x7fba440b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba4a57f700 1 -- 172.21.15.6:0/3250984703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba440d0780 msgr2=0x7fba440b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba4a57f700 1 --2- 172.21.15.6:0/3250984703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba440d0780 0x7fba440b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba4a57f700 1 -- 172.21.15.6:0/3250984703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba44142de0 msgr2=0x7fba4413e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba4a57f700 1 --2- 172.21.15.6:0/3250984703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba44142de0 0x7fba4413e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba4a57f700 1 -- 172.21.15.6:0/3250984703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba38009420 con 0x7fba441431b0 2023-10-06T02:27:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba4a57f700 1 --2- 172.21.15.6:0/3250984703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba441431b0 0x7fba441545c0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009fc0 tx=0x7fba3c0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba41ffb700 1 -- 172.21.15.6:0/3250984703 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c00dbe0 con 0x7fba441431b0 2023-10-06T02:27:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba41ffb700 1 -- 172.21.15.6:0/3250984703 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3c00f040 con 0x7fba441431b0 2023-10-06T02:27:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba4bfe2700 1 -- 172.21.15.6:0/3250984703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba44154d30 con 0x7fba441431b0 2023-10-06T02:27:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.988+0000 7fba41ffb700 1 -- 172.21.15.6:0/3250984703 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c015440 con 0x7fba441431b0 2023-10-06T02:27:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.989+0000 7fba4bfe2700 1 -- 172.21.15.6:0/3250984703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba441552f0 con 0x7fba441431b0 2023-10-06T02:27:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.990+0000 7fba4bfe2700 1 -- 172.21.15.6:0/3250984703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba44088ac0 con 0x7fba441431b0 2023-10-06T02:27:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.990+0000 7fba41ffb700 1 -- 172.21.15.6:0/3250984703 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba3c01e3b0 con 0x7fba441431b0 2023-10-06T02:27:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.990+0000 7fba41ffb700 1 --2- 172.21.15.6:0/3250984703 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba30066f30 0x7fba300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.990+0000 7fba41ffb700 1 -- 172.21.15.6:0/3250984703 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8184+0+0 (secure 0 0 0) 0x7fba3c085300 con 0x7fba441431b0 2023-10-06T02:27:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.990+0000 7fba49d7e700 1 --2- 172.21.15.6:0/3250984703 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba30066f30 0x7fba300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.991+0000 7fba49d7e700 1 --2- 172.21.15.6:0/3250984703 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba30066f30 0x7fba300693e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fba34007fd0 tx=0x7fba34007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:17.995+0000 7fba41ffb700 1 -- 172.21.15.6:0/3250984703 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba3c051b80 con 0x7fba441431b0 2023-10-06T02:27:18.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.234+0000 7fba4bfe2700 1 -- 172.21.15.6:0/3250984703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba4404bb80 con 0x7fba441431b0 2023-10-06T02:27:18.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.234+0000 7fba41ffb700 1 -- 172.21.15.6:0/3250984703 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 221 v221) v1 ==== 95+0+3840 (secure 0 0 0) 0x7fba3c01a090 con 0x7fba441431b0 2023-10-06T02:27:18.235 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:18.236 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":221,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":221,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:17.854293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:18.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.236+0000 7fba4bfe2700 1 -- 172.21.15.6:0/3250984703 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba30066f30 msgr2=0x7fba300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:18.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.236+0000 7fba4bfe2700 1 --2- 172.21.15.6:0/3250984703 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba30066f30 0x7fba300693e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fba34007fd0 tx=0x7fba34007d30 comp rx=0 tx=0).stop 2023-10-06T02:27:18.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.237+0000 7fba4bfe2700 1 -- 172.21.15.6:0/3250984703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba441431b0 msgr2=0x7fba441545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:18.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.237+0000 7fba4bfe2700 1 --2- 172.21.15.6:0/3250984703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba441431b0 0x7fba441545c0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009fc0 tx=0x7fba3c0099b0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.237+0000 7fba4bfe2700 1 -- 172.21.15.6:0/3250984703 shutdown_connections 2023-10-06T02:27:18.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.237+0000 7fba4bfe2700 1 --2- 172.21.15.6:0/3250984703 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba30066f30 0x7fba300693e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.237+0000 7fba4bfe2700 1 --2- 172.21.15.6:0/3250984703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba441431b0 0x7fba441545c0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.237+0000 7fba4bfe2700 1 --2- 172.21.15.6:0/3250984703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba440d0780 0x7fba440b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.237+0000 7fba4bfe2700 1 --2- 172.21.15.6:0/3250984703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba44142de0 0x7fba4413e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.237+0000 7fba4bfe2700 1 -- 172.21.15.6:0/3250984703 >> 172.21.15.6:0/3250984703 conn(0x7fba44069110 msgr2=0x7fba4415dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:18.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.237+0000 7fba4bfe2700 1 -- 172.21.15.6:0/3250984703 shutdown_connections 2023-10-06T02:27:18.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.237+0000 7fba4bfe2700 1 -- 172.21.15.6:0/3250984703 wait complete. 2023-10-06T02:27:18.239 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 221 2023-10-06T02:27:18.249 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:27:18.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.408+0000 7fc94eae4700 1 Processor -- start 2023-10-06T02:27:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.408+0000 7fc94eae4700 1 -- start start 2023-10-06T02:27:18.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.409+0000 7fc94eae4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480af8b0 0x7fc94815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:18.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.409+0000 7fc94eae4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc9480b27f0 0x7fc94815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:18.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.409+0000 7fc94eae4700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94815e190 con 0x7fc9480af4e0 2023-10-06T02:27:18.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.409+0000 7fc94eae4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9480b1910 con 0x7fc9480b27f0 2023-10-06T02:27:18.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.409+0000 7fc94eae4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480cb650 con 0x7fc9480af8b0 2023-10-06T02:27:18.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.409+0000 7fc94d081700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc9480b27f0 0x7fc94815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:18.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.409+0000 7fc947fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480af8b0 0x7fc94815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:18.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.409+0000 7fc94c880700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc9480af4e0 0x7fc9480b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:50356/0 (socket says 172.21.15.6:50356) 2023-10-06T02:27:18.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.409+0000 7fc94c880700 1 -- 172.21.15.6:0/3477398245 learned_addr learned my addr 172.21.15.6:0/3477398245 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:18.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.410+0000 7fc94d081700 1 -- 172.21.15.6:0/3477398245 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480af8b0 msgr2=0x7fc94815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:18.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.410+0000 7fc94d081700 1 --2- 172.21.15.6:0/3477398245 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480af8b0 0x7fc94815d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.410+0000 7fc94d081700 1 -- 172.21.15.6:0/3477398245 >> v1:172.21.15.175:6789/0 conn(0x7fc9480af4e0 legacy=0x7fc9480b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:18.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.410+0000 7fc9477fe700 1 -- 172.21.15.6:0/3477398245 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900690909 0 0) 0x7fc94815e190 con 0x7fc9480af4e0 2023-10-06T02:27:18.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.410+0000 7fc94d081700 1 -- 172.21.15.6:0/3477398245 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9480ccaf0 con 0x7fc9480b27f0 2023-10-06T02:27:18.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.410+0000 7fc947fff700 1 --2- 172.21.15.6:0/3477398245 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480af8b0 0x7fc94815d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:18.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.410+0000 7fc94d081700 1 --2- 172.21.15.6:0/3477398245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9480b27f0 0x7fc94815d9a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc9300098e0 tx=0x7fc9300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e96b26c54df76ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:18.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.410+0000 7fc9477fe700 1 -- 172.21.15.6:0/3477398245 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93000b640 con 0x7fc9480b27f0 2023-10-06T02:27:18.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.410+0000 7fc9477fe700 1 -- 172.21.15.6:0/3477398245 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93000b7a0 con 0x7fc9480b27f0 2023-10-06T02:27:18.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.410+0000 7fc9477fe700 1 -- 172.21.15.6:0/3477398245 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93000bb40 con 0x7fc9480b27f0 2023-10-06T02:27:18.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.410+0000 7fc94eae4700 1 -- 172.21.15.6:0/3477398245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9480b27f0 msgr2=0x7fc94815d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:18.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.410+0000 7fc94eae4700 1 --2- 172.21.15.6:0/3477398245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9480b27f0 0x7fc94815d9a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc9300098e0 tx=0x7fc9300091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.410+0000 7fc94eae4700 1 -- 172.21.15.6:0/3477398245 shutdown_connections 2023-10-06T02:27:18.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.410+0000 7fc94eae4700 1 --2- 172.21.15.6:0/3477398245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9480b27f0 0x7fc94815d9a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.410+0000 7fc94eae4700 1 --2- 172.21.15.6:0/3477398245 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480af8b0 0x7fc94815d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.410+0000 7fc94eae4700 1 -- 172.21.15.6:0/3477398245 >> 172.21.15.6:0/3477398245 conn(0x7fc948068680 msgr2=0x7fc948068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:18.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.410+0000 7fc94eae4700 1 -- 172.21.15.6:0/3477398245 shutdown_connections 2023-10-06T02:27:18.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.411+0000 7fc94eae4700 1 -- 172.21.15.6:0/3477398245 wait complete. 2023-10-06T02:27:18.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.412+0000 7fc94eae4700 1 Processor -- start 2023-10-06T02:27:18.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.412+0000 7fc94eae4700 1 -- start start 2023-10-06T02:27:18.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.412+0000 7fc94eae4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9480af4e0 0x7fc9480a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:18.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.412+0000 7fc94eae4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9480af8b0 0x7fc9480a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:18.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.412+0000 7fc94eae4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480b27f0 0x7fc94814b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:18.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc94eae4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480cdfa0 con 0x7fc9480af8b0 2023-10-06T02:27:18.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc94eae4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480a76e0 con 0x7fc9480af4e0 2023-10-06T02:27:18.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc94eae4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480a79c0 con 0x7fc9480b27f0 2023-10-06T02:27:18.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc947fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9480af8b0 0x7fc9480a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:18.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc947fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9480af8b0 0x7fc9480a6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56470/0 (socket says 172.21.15.6:56470) 2023-10-06T02:27:18.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc947fff700 1 -- 172.21.15.6:0/625447756 learned_addr learned my addr 172.21.15.6:0/625447756 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:18.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc94d081700 1 --2- 172.21.15.6:0/625447756 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480b27f0 0x7fc94814b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:18.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc94c880700 1 --2- 172.21.15.6:0/625447756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9480af4e0 0x7fc9480a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:18.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc947fff700 1 -- 172.21.15.6:0/625447756 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480b27f0 msgr2=0x7fc94814b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:18.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc947fff700 1 --2- 172.21.15.6:0/625447756 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480b27f0 0x7fc94814b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc947fff700 1 -- 172.21.15.6:0/625447756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9480af4e0 msgr2=0x7fc9480a87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:18.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc947fff700 1 --2- 172.21.15.6:0/625447756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9480af4e0 0x7fc9480a87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc947fff700 1 -- 172.21.15.6:0/625447756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc938009a20 con 0x7fc9480af8b0 2023-10-06T02:27:18.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc947fff700 1 --2- 172.21.15.6:0/625447756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9480af8b0 0x7fc9480a6d20 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fc93800c170 tx=0x7fc93800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:18.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc944ff9700 1 -- 172.21.15.6:0/625447756 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93800ccb0 con 0x7fc9480af8b0 2023-10-06T02:27:18.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc944ff9700 1 -- 172.21.15.6:0/625447756 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93800f040 con 0x7fc9480af8b0 2023-10-06T02:27:18.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc944ff9700 1 -- 172.21.15.6:0/625447756 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938014480 con 0x7fc9480af8b0 2023-10-06T02:27:18.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc94eae4700 1 -- 172.21.15.6:0/625447756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc930009420 con 0x7fc9480af8b0 2023-10-06T02:27:18.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.413+0000 7fc94eae4700 1 -- 172.21.15.6:0/625447756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9480d02e0 con 0x7fc9480af8b0 2023-10-06T02:27:18.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.415+0000 7fc94eae4700 1 -- 172.21.15.6:0/625447756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9480a7ee0 con 0x7fc9480af8b0 2023-10-06T02:27:18.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.415+0000 7fc944ff9700 1 -- 172.21.15.6:0/625447756 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9380147f0 con 0x7fc9480af8b0 2023-10-06T02:27:18.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.415+0000 7fc944ff9700 1 --2- 172.21.15.6:0/625447756 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc928066f30 0x7fc9280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:18.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.415+0000 7fc944ff9700 1 -- 172.21.15.6:0/625447756 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8184+0+0 (secure 0 0 0) 0x7fc938085d20 con 0x7fc9480af8b0 2023-10-06T02:27:18.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.416+0000 7fc94c880700 1 --2- 172.21.15.6:0/625447756 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc928066f30 0x7fc9280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:18.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.416+0000 7fc94c880700 1 --2- 172.21.15.6:0/625447756 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc928066f30 0x7fc9280693e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc940007fd0 tx=0x7fc940007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:18.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.420+0000 7fc944ff9700 1 -- 172.21.15.6:0/625447756 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9380525a0 con 0x7fc9480af8b0 2023-10-06T02:27:18.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.659+0000 7fc94eae4700 1 -- 172.21.15.6:0/625447756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9480b0910 con 0x7fc9480af8b0 2023-10-06T02:27:18.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.660+0000 7fc944ff9700 1 -- 172.21.15.6:0/625447756 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 221 v221) v1 ==== 95+0+3840 (secure 0 0 0) 0x7fc938055bc0 con 0x7fc9480af8b0 2023-10-06T02:27:18.660 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:18.661 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":221,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":221,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:17.854293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:18.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.662+0000 7fc94eae4700 1 -- 172.21.15.6:0/625447756 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc928066f30 msgr2=0x7fc9280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:18.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.662+0000 7fc94eae4700 1 --2- 172.21.15.6:0/625447756 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc928066f30 0x7fc9280693e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc940007fd0 tx=0x7fc940007d30 comp rx=0 tx=0).stop 2023-10-06T02:27:18.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.662+0000 7fc94eae4700 1 -- 172.21.15.6:0/625447756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9480af8b0 msgr2=0x7fc9480a6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:18.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.662+0000 7fc94eae4700 1 --2- 172.21.15.6:0/625447756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9480af8b0 0x7fc9480a6d20 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fc93800c170 tx=0x7fc93800b040 comp rx=0 tx=0).stop 2023-10-06T02:27:18.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.662+0000 7fc94eae4700 1 -- 172.21.15.6:0/625447756 shutdown_connections 2023-10-06T02:27:18.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.662+0000 7fc94eae4700 1 --2- 172.21.15.6:0/625447756 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480b27f0 0x7fc94814b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.662+0000 7fc94eae4700 1 --2- 172.21.15.6:0/625447756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9480af4e0 0x7fc9480a87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.662+0000 7fc94eae4700 1 --2- 172.21.15.6:0/625447756 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc928066f30 0x7fc9280693e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.662+0000 7fc94eae4700 1 --2- 172.21.15.6:0/625447756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9480af8b0 0x7fc9480a6d20 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.662+0000 7fc94eae4700 1 -- 172.21.15.6:0/625447756 >> 172.21.15.6:0/625447756 conn(0x7fc948068680 msgr2=0x7fc94815c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:18.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.662+0000 7fc94eae4700 1 -- 172.21.15.6:0/625447756 shutdown_connections 2023-10-06T02:27:18.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.662+0000 7fc94eae4700 1 -- 172.21.15.6:0/625447756 wait complete. 2023-10-06T02:27:18.664 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 221 2023-10-06T02:27:18.674 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:27:18.675 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.795+0000 7f1c78841700 1 Processor -- start 2023-10-06T02:27:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.795+0000 7f1c78841700 1 -- start start 2023-10-06T02:27:18.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.796+0000 7f1c78841700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c740ce9f0 0x7f1c740d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:18.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.796+0000 7f1c78841700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1c741430c0 0x7f1c740d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:18.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.796+0000 7f1c78841700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c740cee60 con 0x7f1c74142cf0 2023-10-06T02:27:18.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.796+0000 7f1c78841700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c740cf140 con 0x7f1c741430c0 2023-10-06T02:27:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.796+0000 7f1c78841700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c740cf420 con 0x7f1c740ce9f0 2023-10-06T02:27:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.796+0000 7f1c72d9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1c741430c0 0x7f1c740d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.796+0000 7f1c71d9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c740ce9f0 0x7f1c740d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.796+0000 7f1c7259c700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f1c74142cf0 0x7f1c740ccd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:42722/0 (socket says 172.21.15.6:42722) 2023-10-06T02:27:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.796+0000 7f1c7259c700 1 -- 172.21.15.6:0/3741611740 learned_addr learned my addr 172.21.15.6:0/3741611740 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.796+0000 7f1c72d9d700 1 -- 172.21.15.6:0/3741611740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c740ce9f0 msgr2=0x7f1c740d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.796+0000 7f1c72d9d700 1 --2- 172.21.15.6:0/3741611740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c740ce9f0 0x7f1c740d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.796+0000 7f1c72d9d700 1 -- 172.21.15.6:0/3741611740 >> v1:172.21.15.175:6789/0 conn(0x7f1c74142cf0 legacy=0x7f1c740ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.796+0000 7f1c7159a700 1 -- 172.21.15.6:0/3741611740 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1467954865 0 0) 0x7f1c740cee60 con 0x7f1c74142cf0 2023-10-06T02:27:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.796+0000 7f1c72d9d700 1 -- 172.21.15.6:0/3741611740 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c740cf700 con 0x7f1c741430c0 2023-10-06T02:27:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.796+0000 7f1c71d9b700 1 --2- 172.21.15.6:0/3741611740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c740ce9f0 0x7f1c740d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.797+0000 7f1c72d9d700 1 --2- 172.21.15.6:0/3741611740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c741430c0 0x7f1c740d07e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c009e60 tx=0x7f1c6c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee11a1bfd6e3102 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.797+0000 7f1c7159a700 1 -- 172.21.15.6:0/3741611740 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c00e070 con 0x7f1c741430c0 2023-10-06T02:27:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.797+0000 7f1c7159a700 1 -- 172.21.15.6:0/3741611740 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6c00bb60 con 0x7f1c741430c0 2023-10-06T02:27:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.797+0000 7f1c7159a700 1 -- 172.21.15.6:0/3741611740 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c012430 con 0x7f1c741430c0 2023-10-06T02:27:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.797+0000 7f1c78841700 1 -- 172.21.15.6:0/3741611740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c741430c0 msgr2=0x7f1c740d07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.797+0000 7f1c78841700 1 --2- 172.21.15.6:0/3741611740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c741430c0 0x7f1c740d07e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c009e60 tx=0x7f1c6c009780 comp rx=0 tx=0).stop 2023-10-06T02:27:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.797+0000 7f1c78841700 1 -- 172.21.15.6:0/3741611740 shutdown_connections 2023-10-06T02:27:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.797+0000 7f1c78841700 1 --2- 172.21.15.6:0/3741611740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c741430c0 0x7f1c740d07e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.797+0000 7f1c78841700 1 --2- 172.21.15.6:0/3741611740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c740ce9f0 0x7f1c740d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.797+0000 7f1c78841700 1 -- 172.21.15.6:0/3741611740 >> 172.21.15.6:0/3741611740 conn(0x7f1c740690f0 msgr2=0x7f1c7406a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:18.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.797+0000 7f1c78841700 1 -- 172.21.15.6:0/3741611740 shutdown_connections 2023-10-06T02:27:18.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.797+0000 7f1c78841700 1 -- 172.21.15.6:0/3741611740 wait complete. 2023-10-06T02:27:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.798+0000 7f1c78841700 1 Processor -- start 2023-10-06T02:27:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.798+0000 7f1c78841700 1 -- start start 2023-10-06T02:27:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.799+0000 7f1c78841700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c740ce9f0 0x7f1c74169700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.799+0000 7f1c78841700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c74142cf0 0x7f1c74158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.799+0000 7f1c78841700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c741430c0 0x7f1c740b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.799+0000 7f1c78841700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c740c5200 con 0x7f1c74142cf0 2023-10-06T02:27:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.799+0000 7f1c78841700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c740b2250 con 0x7f1c741430c0 2023-10-06T02:27:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.799+0000 7f1c78841700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c740b2530 con 0x7f1c740ce9f0 2023-10-06T02:27:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.799+0000 7f1c71d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c74142cf0 0x7f1c74158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.799+0000 7f1c71d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c74142cf0 0x7f1c74158d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55532/0 (socket says 172.21.15.6:55532) 2023-10-06T02:27:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.799+0000 7f1c71d9b700 1 -- 172.21.15.6:0/42435038 learned_addr learned my addr 172.21.15.6:0/42435038 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.799+0000 7f1c7259c700 1 --2- 172.21.15.6:0/42435038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c740ce9f0 0x7f1c74169700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.799+0000 7f1c72d9d700 1 --2- 172.21.15.6:0/42435038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c741430c0 0x7f1c740b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.800+0000 7f1c71d9b700 1 -- 172.21.15.6:0/42435038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c740ce9f0 msgr2=0x7f1c74169700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.800+0000 7f1c71d9b700 1 --2- 172.21.15.6:0/42435038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c740ce9f0 0x7f1c74169700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.800+0000 7f1c71d9b700 1 -- 172.21.15.6:0/42435038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c741430c0 msgr2=0x7f1c740b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.800+0000 7f1c71d9b700 1 --2- 172.21.15.6:0/42435038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c741430c0 0x7f1c740b19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.800+0000 7f1c71d9b700 1 -- 172.21.15.6:0/42435038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c68009420 con 0x7f1c74142cf0 2023-10-06T02:27:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.800+0000 7f1c71d9b700 1 --2- 172.21.15.6:0/42435038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c74142cf0 0x7f1c74158d00 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800ec80 tx=0x7f1c680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.800+0000 7f1c627fc700 1 -- 172.21.15.6:0/42435038 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6800c920 con 0x7f1c74142cf0 2023-10-06T02:27:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.800+0000 7f1c627fc700 1 -- 172.21.15.6:0/42435038 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6800ca80 con 0x7f1c74142cf0 2023-10-06T02:27:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.800+0000 7f1c78841700 1 -- 172.21.15.6:0/42435038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c009a20 con 0x7f1c74142cf0 2023-10-06T02:27:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.800+0000 7f1c627fc700 1 -- 172.21.15.6:0/42435038 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6800ce00 con 0x7f1c74142cf0 2023-10-06T02:27:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.800+0000 7f1c78841700 1 -- 172.21.15.6:0/42435038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c740b2af0 con 0x7f1c74142cf0 2023-10-06T02:27:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.801+0000 7f1c78841700 1 -- 172.21.15.6:0/42435038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c74088ad0 con 0x7f1c74142cf0 2023-10-06T02:27:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.802+0000 7f1c627fc700 1 -- 172.21.15.6:0/42435038 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c68013680 con 0x7f1c74142cf0 2023-10-06T02:27:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.802+0000 7f1c627fc700 1 --2- 172.21.15.6:0/42435038 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c54066f30 0x7f1c540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.802+0000 7f1c627fc700 1 -- 172.21.15.6:0/42435038 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8184+0+0 (secure 0 0 0) 0x7f1c68085610 con 0x7f1c74142cf0 2023-10-06T02:27:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.802+0000 7f1c7259c700 1 --2- 172.21.15.6:0/42435038 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c54066f30 0x7f1c540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.803+0000 7f1c7259c700 1 --2- 172.21.15.6:0/42435038 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c54066f30 0x7f1c540693e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1c740cc110 tx=0x7f1c64007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:18.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:18.806+0000 7f1c627fc700 1 -- 172.21.15.6:0/42435038 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c68051e90 con 0x7f1c74142cf0 2023-10-06T02:27:19.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.048+0000 7f1c78841700 1 -- 172.21.15.6:0/42435038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c740c5340 con 0x7f1c74142cf0 2023-10-06T02:27:19.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.049+0000 7f1c627fc700 1 -- 172.21.15.6:0/42435038 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 222 v222) v1 ==== 95+0+4595 (secure 0 0 0) 0x7f1c68017090 con 0x7f1c74142cf0 2023-10-06T02:27:19.050 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:19.050 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":222,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3650321949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3650321949},{"type":"v1","addr":"172.21.15.6:6835","nonce":3650321949}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":222}],"filesystems":[{"mdsmap":{"epoch":221,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:17.854293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:19.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.051+0000 7f1c78841700 1 -- 172.21.15.6:0/42435038 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c54066f30 msgr2=0x7f1c540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:19.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.051+0000 7f1c78841700 1 --2- 172.21.15.6:0/42435038 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c54066f30 0x7f1c540693e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1c740cc110 tx=0x7f1c64007d30 comp rx=0 tx=0).stop 2023-10-06T02:27:19.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.051+0000 7f1c78841700 1 -- 172.21.15.6:0/42435038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c74142cf0 msgr2=0x7f1c74158d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:19.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.051+0000 7f1c78841700 1 --2- 172.21.15.6:0/42435038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c74142cf0 0x7f1c74158d00 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800ec80 tx=0x7f1c680091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:19.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.051+0000 7f1c78841700 1 -- 172.21.15.6:0/42435038 shutdown_connections 2023-10-06T02:27:19.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.051+0000 7f1c78841700 1 --2- 172.21.15.6:0/42435038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c741430c0 0x7f1c740b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:19.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.051+0000 7f1c78841700 1 --2- 172.21.15.6:0/42435038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c740ce9f0 0x7f1c74169700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:19.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.051+0000 7f1c78841700 1 --2- 172.21.15.6:0/42435038 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c54066f30 0x7f1c540693e0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:19.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.051+0000 7f1c78841700 1 --2- 172.21.15.6:0/42435038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c74142cf0 0x7f1c74158d00 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:19.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.051+0000 7f1c78841700 1 -- 172.21.15.6:0/42435038 >> 172.21.15.6:0/42435038 conn(0x7f1c740690f0 msgr2=0x7f1c740d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:19.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.051+0000 7f1c78841700 1 -- 172.21.15.6:0/42435038 shutdown_connections 2023-10-06T02:27:19.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.051+0000 7f1c78841700 1 -- 172.21.15.6:0/42435038 wait complete. 2023-10-06T02:27:19.053 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 222 2023-10-06T02:27:19.064 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt mds0_inotable' led to DAMAGED state 2023-10-06T02:27:19.064 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 400.00000000' 2023-10-06T02:27:19.064 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:19.064 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:27:19.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:19.064 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:27:19.079 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:27:19.079 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:27:19.079 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:27:19.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.239+0000 7f3d174a7700 1 Processor -- start 2023-10-06T02:27:19.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.239+0000 7f3d174a7700 1 -- start start 2023-10-06T02:27:19.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d174a7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d10159400 0x7f3d100ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:19.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d174a7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3d100cd030 0x7f3d100cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:19.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d174a7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d100cf1a0 0x7f3d100d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:19.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d174a7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d100b3560 con 0x7f3d100cf1a0 2023-10-06T02:27:19.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d174a7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d100cf6f0 con 0x7f3d100cd030 2023-10-06T02:27:19.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d174a7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d100cf9d0 con 0x7f3d10159400 2023-10-06T02:27:19.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d16ca6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d100cf1a0 0x7f3d100d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:19.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d16ca6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d100cf1a0 0x7f3d100d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55540/0 (socket says 172.21.15.6:55540) 2023-10-06T02:27:19.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d16ca6700 1 -- 172.21.15.6:0/2122605115 learned_addr learned my addr 172.21.15.6:0/2122605115 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:19.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d164a5700 1 --2- 172.21.15.6:0/2122605115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d10159400 0x7f3d100ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:19.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d15ca4700 1 --2- 172.21.15.6:0/2122605115 >> v2:172.21.15.175:3300/0 conn(0x7f3d100cd030 0x7f3d100cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:19.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d16ca6700 1 -- 172.21.15.6:0/2122605115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d10159400 msgr2=0x7f3d100ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:19.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d16ca6700 1 --2- 172.21.15.6:0/2122605115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d10159400 0x7f3d100ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:19.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d16ca6700 1 -- 172.21.15.6:0/2122605115 >> v2:172.21.15.175:3300/0 conn(0x7f3d100cd030 msgr2=0x7f3d100cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:19.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d16ca6700 1 --2- 172.21.15.6:0/2122605115 >> v2:172.21.15.175:3300/0 conn(0x7f3d100cd030 0x7f3d100cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:19.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d16ca6700 1 -- 172.21.15.6:0/2122605115 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d100b2f10 con 0x7f3d100cf1a0 2023-10-06T02:27:19.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d15ca4700 1 --2- 172.21.15.6:0/2122605115 >> v2:172.21.15.175:3300/0 conn(0x7f3d100cd030 0x7f3d100cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:19.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d164a5700 1 --2- 172.21.15.6:0/2122605115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d10159400 0x7f3d100ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:19.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.240+0000 7f3d16ca6700 1 --2- 172.21.15.6:0/2122605115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d100cf1a0 0x7f3d100d0400 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f3d10067ec0 tx=0x7f3d00009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca7d6ed2b831bfb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:19.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.241+0000 7f3d154a3700 1 -- 172.21.15.6:0/2122605115 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0000e070 con 0x7f3d100cf1a0 2023-10-06T02:27:19.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.241+0000 7f3d154a3700 1 -- 172.21.15.6:0/2122605115 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0000ba50 con 0x7f3d100cf1a0 2023-10-06T02:27:19.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.241+0000 7f3d154a3700 1 -- 172.21.15.6:0/2122605115 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d000092e0 con 0x7f3d100cf1a0 2023-10-06T02:27:19.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.241+0000 7f3d174a7700 1 -- 172.21.15.6:0/2122605115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d100cf1a0 msgr2=0x7f3d100d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:19.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.241+0000 7f3d174a7700 1 --2- 172.21.15.6:0/2122605115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d100cf1a0 0x7f3d100d0400 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f3d10067ec0 tx=0x7f3d00009840 comp rx=0 tx=0).stop 2023-10-06T02:27:19.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.241+0000 7f3d174a7700 1 -- 172.21.15.6:0/2122605115 shutdown_connections 2023-10-06T02:27:19.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.241+0000 7f3d174a7700 1 --2- 172.21.15.6:0/2122605115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d100cf1a0 0x7f3d100d0400 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:19.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.241+0000 7f3d174a7700 1 --2- 172.21.15.6:0/2122605115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d10159400 0x7f3d100ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:19.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.241+0000 7f3d174a7700 1 --2- 172.21.15.6:0/2122605115 >> v2:172.21.15.175:3300/0 conn(0x7f3d100cd030 0x7f3d100cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:19.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.241+0000 7f3d174a7700 1 -- 172.21.15.6:0/2122605115 >> 172.21.15.6:0/2122605115 conn(0x7f3d1006ac10 msgr2=0x7f3d10068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:19.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.241+0000 7f3d174a7700 1 -- 172.21.15.6:0/2122605115 shutdown_connections 2023-10-06T02:27:19.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.241+0000 7f3d174a7700 1 -- 172.21.15.6:0/2122605115 wait complete. 2023-10-06T02:27:19.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.242+0000 7f3d174a7700 1 Processor -- start 2023-10-06T02:27:19.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.242+0000 7f3d174a7700 1 -- start start 2023-10-06T02:27:19.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.243+0000 7f3d174a7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d100cd030 0x7f3d100b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:19.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.243+0000 7f3d174a7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d100cf1a0 0x7f3d10157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:19.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.243+0000 7f3d174a7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d10159400 0x7f3d10145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:19.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.243+0000 7f3d174a7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d10157ad0 con 0x7f3d100cf1a0 2023-10-06T02:27:19.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.243+0000 7f3d174a7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d101585b0 con 0x7f3d10159400 2023-10-06T02:27:19.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.243+0000 7f3d174a7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d10153c20 con 0x7f3d100cd030 2023-10-06T02:27:19.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.243+0000 7f3d15ca4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d100cf1a0 0x7f3d10157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:19.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.243+0000 7f3d15ca4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d100cf1a0 0x7f3d10157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55546/0 (socket says 172.21.15.6:55546) 2023-10-06T02:27:19.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.243+0000 7f3d15ca4700 1 -- 172.21.15.6:0/646800420 learned_addr learned my addr 172.21.15.6:0/646800420 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:19.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.243+0000 7f3d164a5700 1 --2- 172.21.15.6:0/646800420 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d100cd030 0x7f3d100b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:19.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.243+0000 7f3d16ca6700 1 --2- 172.21.15.6:0/646800420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d10159400 0x7f3d10145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:19.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.243+0000 7f3d15ca4700 1 -- 172.21.15.6:0/646800420 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d100cd030 msgr2=0x7f3d100b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:19.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.243+0000 7f3d15ca4700 1 --2- 172.21.15.6:0/646800420 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d100cd030 0x7f3d100b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:19.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.243+0000 7f3d15ca4700 1 -- 172.21.15.6:0/646800420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d10159400 msgr2=0x7f3d10145bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:19.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.243+0000 7f3d15ca4700 1 --2- 172.21.15.6:0/646800420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d10159400 0x7f3d10145bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:19.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.244+0000 7f3d15ca4700 1 -- 172.21.15.6:0/646800420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d00009ae0 con 0x7f3d100cf1a0 2023-10-06T02:27:19.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.244+0000 7f3d15ca4700 1 --2- 172.21.15.6:0/646800420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d100cf1a0 0x7f3d10157590 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400e8d0 tx=0x7f3d04008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:19.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.244+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/646800420 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04013410 con 0x7f3d100cf1a0 2023-10-06T02:27:19.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.244+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/646800420 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d04013570 con 0x7f3d100cf1a0 2023-10-06T02:27:19.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.244+0000 7f3d174a7700 1 -- 172.21.15.6:0/646800420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d10157d10 con 0x7f3d100cf1a0 2023-10-06T02:27:19.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.244+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/646800420 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04013910 con 0x7f3d100cf1a0 2023-10-06T02:27:19.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.244+0000 7f3d174a7700 1 -- 172.21.15.6:0/646800420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d101582d0 con 0x7f3d100cf1a0 2023-10-06T02:27:19.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.245+0000 7f3d174a7700 1 -- 172.21.15.6:0/646800420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d10153f50 con 0x7f3d100cf1a0 2023-10-06T02:27:19.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.245+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/646800420 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d04013d00 con 0x7f3d100cf1a0 2023-10-06T02:27:19.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.246+0000 7f3d0e7fc700 1 --2- 172.21.15.6:0/646800420 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3cfc066f30 0x7f3cfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:19.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.246+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/646800420 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8184+0+0 (secure 0 0 0) 0x7f3d04084cc0 con 0x7f3d100cf1a0 2023-10-06T02:27:19.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.246+0000 7f3d164a5700 1 --2- 172.21.15.6:0/646800420 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3cfc066f30 0x7f3cfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:19.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.246+0000 7f3d164a5700 1 --2- 172.21.15.6:0/646800420 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3cfc066f30 0x7f3cfc0693e0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800bc80 tx=0x7f3d08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:19.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.250+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/646800420 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d04051540 con 0x7f3d100cf1a0 2023-10-06T02:27:19.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.495+0000 7f3d174a7700 1 -- 172.21.15.6:0/646800420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3d100b31f0 con 0x7f3d100cf1a0 2023-10-06T02:27:19.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.872+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/646800420 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v223) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3d04020090 con 0x7f3d100cf1a0 2023-10-06T02:27:19.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.875+0000 7f3d174a7700 1 -- 172.21.15.6:0/646800420 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3cfc066f30 msgr2=0x7f3cfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:19.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.875+0000 7f3d174a7700 1 --2- 172.21.15.6:0/646800420 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3cfc066f30 0x7f3cfc0693e0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800bc80 tx=0x7f3d08008040 comp rx=0 tx=0).stop 2023-10-06T02:27:19.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.875+0000 7f3d174a7700 1 -- 172.21.15.6:0/646800420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d100cf1a0 msgr2=0x7f3d10157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:19.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.875+0000 7f3d174a7700 1 --2- 172.21.15.6:0/646800420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d100cf1a0 0x7f3d10157590 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400e8d0 tx=0x7f3d04008040 comp rx=0 tx=0).stop 2023-10-06T02:27:19.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.875+0000 7f3d174a7700 1 -- 172.21.15.6:0/646800420 shutdown_connections 2023-10-06T02:27:19.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.875+0000 7f3d174a7700 1 --2- 172.21.15.6:0/646800420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d10159400 0x7f3d10145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:19.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.875+0000 7f3d174a7700 1 --2- 172.21.15.6:0/646800420 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d100cd030 0x7f3d100b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:19.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.875+0000 7f3d174a7700 1 --2- 172.21.15.6:0/646800420 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3cfc066f30 0x7f3cfc0693e0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:19.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.875+0000 7f3d174a7700 1 --2- 172.21.15.6:0/646800420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d100cf1a0 0x7f3d10157590 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:19.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.875+0000 7f3d174a7700 1 -- 172.21.15.6:0/646800420 >> 172.21.15.6:0/646800420 conn(0x7f3d1006ac10 msgr2=0x7f3d10155d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:19.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.875+0000 7f3d174a7700 1 -- 172.21.15.6:0/646800420 shutdown_connections 2023-10-06T02:27:19.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:19.875+0000 7f3d174a7700 1 -- 172.21.15.6:0/646800420 wait complete. 2023-10-06T02:27:19.877 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:27:19.888 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:27:20.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.011+0000 7f835959e700 1 Processor -- start 2023-10-06T02:27:20.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.011+0000 7f835959e700 1 -- start start 2023-10-06T02:27:20.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.012+0000 7f835959e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d0400 0x7f83540b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:20.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.012+0000 7f835959e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f83540ccd40 0x7f83540cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:20.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.012+0000 7f835959e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83540cf7e0 0x7f83540b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:20.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.012+0000 7f835959e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83540b6170 con 0x7f83540cf7e0 2023-10-06T02:27:20.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.012+0000 7f835959e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f835415dd40 con 0x7f83540ccd40 2023-10-06T02:27:20.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.012+0000 7f835959e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835415e020 con 0x7f83540d0400 2023-10-06T02:27:20.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.012+0000 7f83537fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83540cf7e0 0x7f83540b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:20.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.012+0000 7f83537fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83540cf7e0 0x7f83540b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55560/0 (socket says 172.21.15.6:55560) 2023-10-06T02:27:20.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.012+0000 7f83537fe700 1 -- 172.21.15.6:0/1921374684 learned_addr learned my addr 172.21.15.6:0/1921374684 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:20.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.013+0000 7f83527fc700 1 --2- 172.21.15.6:0/1921374684 >> v2:172.21.15.175:3300/0 conn(0x7f83540ccd40 0x7f83540cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:20.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.013+0000 7f83537fe700 1 -- 172.21.15.6:0/1921374684 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d0400 msgr2=0x7f83540b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:20.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.013+0000 7f8352ffd700 1 --2- 172.21.15.6:0/1921374684 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d0400 0x7f83540b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:20.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.013+0000 7f83537fe700 1 --2- 172.21.15.6:0/1921374684 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d0400 0x7f83540b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.013+0000 7f83537fe700 1 -- 172.21.15.6:0/1921374684 >> v2:172.21.15.175:3300/0 conn(0x7f83540ccd40 msgr2=0x7f83540cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:20.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.013+0000 7f83537fe700 1 --2- 172.21.15.6:0/1921374684 >> v2:172.21.15.175:3300/0 conn(0x7f83540ccd40 0x7f83540cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.013+0000 7f83537fe700 1 -- 172.21.15.6:0/1921374684 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83540ceaa0 con 0x7f83540cf7e0 2023-10-06T02:27:20.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.013+0000 7f8352ffd700 1 --2- 172.21.15.6:0/1921374684 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d0400 0x7f83540b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:20.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.013+0000 7f83527fc700 1 --2- 172.21.15.6:0/1921374684 >> v2:172.21.15.175:3300/0 conn(0x7f83540ccd40 0x7f83540cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:20.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.013+0000 7f83537fe700 1 --2- 172.21.15.6:0/1921374684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83540cf7e0 0x7f83540b3aa0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f8354089490 tx=0x7f8344009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef06196d36fdf68 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:20.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.013+0000 7f8351ffb700 1 -- 172.21.15.6:0/1921374684 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834400b860 con 0x7f83540cf7e0 2023-10-06T02:27:20.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.013+0000 7f8351ffb700 1 -- 172.21.15.6:0/1921374684 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834400b9c0 con 0x7f83540cf7e0 2023-10-06T02:27:20.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.013+0000 7f8351ffb700 1 -- 172.21.15.6:0/1921374684 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834400bd60 con 0x7f83540cf7e0 2023-10-06T02:27:20.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.014+0000 7f835959e700 1 -- 172.21.15.6:0/1921374684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83540cf7e0 msgr2=0x7f83540b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:20.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.014+0000 7f835959e700 1 --2- 172.21.15.6:0/1921374684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83540cf7e0 0x7f83540b3aa0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f8354089490 tx=0x7f8344009250 comp rx=0 tx=0).stop 2023-10-06T02:27:20.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.014+0000 7f835959e700 1 -- 172.21.15.6:0/1921374684 shutdown_connections 2023-10-06T02:27:20.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.014+0000 7f835959e700 1 --2- 172.21.15.6:0/1921374684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83540cf7e0 0x7f83540b3aa0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.014+0000 7f835959e700 1 --2- 172.21.15.6:0/1921374684 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d0400 0x7f83540b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.014+0000 7f835959e700 1 --2- 172.21.15.6:0/1921374684 >> v2:172.21.15.175:3300/0 conn(0x7f83540ccd40 0x7f83540cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.014+0000 7f835959e700 1 -- 172.21.15.6:0/1921374684 >> 172.21.15.6:0/1921374684 conn(0x7f835406a220 msgr2=0x7f835406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:20.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.014+0000 7f835959e700 1 -- 172.21.15.6:0/1921374684 shutdown_connections 2023-10-06T02:27:20.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.014+0000 7f835959e700 1 -- 172.21.15.6:0/1921374684 wait complete. 2023-10-06T02:27:20.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.015+0000 7f835959e700 1 Processor -- start 2023-10-06T02:27:20.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.015+0000 7f835959e700 1 -- start start 2023-10-06T02:27:20.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f835959e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83540ccd40 0x7f83541698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:20.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f835959e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83540cf7e0 0x7f8354155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:20.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f835959e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d0400 0x7f83540c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:20.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f835959e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8354159e10 con 0x7f83540cf7e0 2023-10-06T02:27:20.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f835959e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835415a990 con 0x7f83540ccd40 2023-10-06T02:27:20.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f835959e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835415a060 con 0x7f83540d0400 2023-10-06T02:27:20.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f83527fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83540cf7e0 0x7f8354155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:20.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f83527fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83540cf7e0 0x7f8354155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55562/0 (socket says 172.21.15.6:55562) 2023-10-06T02:27:20.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f83527fc700 1 -- 172.21.15.6:0/1299543150 learned_addr learned my addr 172.21.15.6:0/1299543150 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:20.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f8352ffd700 1 --2- 172.21.15.6:0/1299543150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83540ccd40 0x7f83541698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:20.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f83537fe700 1 --2- 172.21.15.6:0/1299543150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d0400 0x7f83540c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:20.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f83527fc700 1 -- 172.21.15.6:0/1299543150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d0400 msgr2=0x7f83540c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:20.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f83527fc700 1 --2- 172.21.15.6:0/1299543150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d0400 0x7f83540c5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f83527fc700 1 -- 172.21.15.6:0/1299543150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83540ccd40 msgr2=0x7f83541698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:20.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f83527fc700 1 --2- 172.21.15.6:0/1299543150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83540ccd40 0x7f83541698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f83527fc700 1 -- 172.21.15.6:0/1299543150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83440094f0 con 0x7f83540cf7e0 2023-10-06T02:27:20.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f83527fc700 1 --2- 172.21.15.6:0/1299543150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83540cf7e0 0x7f8354155050 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f833c00c8b0 tx=0x7f833c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:20.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f834affd700 1 -- 172.21.15.6:0/1299543150 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c011600 con 0x7f83540cf7e0 2023-10-06T02:27:20.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f834affd700 1 -- 172.21.15.6:0/1299543150 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833c011760 con 0x7f83540cf7e0 2023-10-06T02:27:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f835959e700 1 -- 172.21.15.6:0/1299543150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f835415a340 con 0x7f83540cf7e0 2023-10-06T02:27:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.016+0000 7f834affd700 1 -- 172.21.15.6:0/1299543150 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c011b00 con 0x7f83540cf7e0 2023-10-06T02:27:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.017+0000 7f835959e700 1 -- 172.21.15.6:0/1299543150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8354169de0 con 0x7f83540cf7e0 2023-10-06T02:27:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.018+0000 7f835959e700 1 -- 172.21.15.6:0/1299543150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8354157780 con 0x7f83540cf7e0 2023-10-06T02:27:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.018+0000 7f834affd700 1 -- 172.21.15.6:0/1299543150 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f833c018350 con 0x7f83540cf7e0 2023-10-06T02:27:20.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.018+0000 7f834affd700 1 --2- 172.21.15.6:0/1299543150 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8334066f30 0x7f83340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.019+0000 7f834affd700 1 -- 172.21.15.6:0/1299543150 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8184+0+0 (secure 0 0 0) 0x7f833c084da0 con 0x7f83540cf7e0 2023-10-06T02:27:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.019+0000 7f8352ffd700 1 --2- 172.21.15.6:0/1299543150 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8334066f30 0x7f83340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.019+0000 7f8352ffd700 1 --2- 172.21.15.6:0/1299543150 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8334066f30 0x7f83340693e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f834c00d650 tx=0x7f834c007800 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.023+0000 7f834affd700 1 -- 172.21.15.6:0/1299543150 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f833c055050 con 0x7f83540cf7e0 2023-10-06T02:27:20.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.303+0000 7f835959e700 1 -- 172.21.15.6:0/1299543150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f83540ced80 con 0x7f83540cf7e0 2023-10-06T02:27:20.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:27:20.560 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:27:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.878+0000 7f834affd700 1 -- 172.21.15.6:0/1299543150 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v224) v1 ==== 101+0+0 (secure 0 0 0) 0x7f833c054be0 con 0x7f83540cf7e0 2023-10-06T02:27:20.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.880+0000 7f835959e700 1 -- 172.21.15.6:0/1299543150 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8334066f30 msgr2=0x7f83340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:20.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.880+0000 7f835959e700 1 --2- 172.21.15.6:0/1299543150 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8334066f30 0x7f83340693e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f834c00d650 tx=0x7f834c007800 comp rx=0 tx=0).stop 2023-10-06T02:27:20.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.880+0000 7f835959e700 1 -- 172.21.15.6:0/1299543150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83540cf7e0 msgr2=0x7f8354155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:20.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.880+0000 7f835959e700 1 --2- 172.21.15.6:0/1299543150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83540cf7e0 0x7f8354155050 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f833c00c8b0 tx=0x7f833c008040 comp rx=0 tx=0).stop 2023-10-06T02:27:20.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.880+0000 7f835959e700 1 -- 172.21.15.6:0/1299543150 shutdown_connections 2023-10-06T02:27:20.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.880+0000 7f835959e700 1 --2- 172.21.15.6:0/1299543150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d0400 0x7f83540c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.880+0000 7f835959e700 1 --2- 172.21.15.6:0/1299543150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83540ccd40 0x7f83541698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.880+0000 7f835959e700 1 --2- 172.21.15.6:0/1299543150 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8334066f30 0x7f83340693e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.880+0000 7f835959e700 1 --2- 172.21.15.6:0/1299543150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83540cf7e0 0x7f8354155050 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.880+0000 7f835959e700 1 -- 172.21.15.6:0/1299543150 >> 172.21.15.6:0/1299543150 conn(0x7f835406a220 msgr2=0x7f8354158520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:20.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.880+0000 7f835959e700 1 -- 172.21.15.6:0/1299543150 shutdown_connections 2023-10-06T02:27:20.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.880+0000 7f835959e700 1 -- 172.21.15.6:0/1299543150 wait complete. 2023-10-06T02:27:20.882 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:27:20.894 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:27:20.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.931+0000 7fa9cb3ad000 1 Processor -- start 2023-10-06T02:27:20.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.931+0000 7fa9cb3ad000 1 -- start start 2023-10-06T02:27:20.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.932+0000 7fa9cb3ad000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19775b160 0x55e1978349d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:20.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.932+0000 7fa9cb3ad000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19781c8b0 0x55e1977a30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:20.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.932+0000 7fa9cb3ad000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19781cc80 0x55e1977a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:20.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.932+0000 7fa9cb3ad000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1976a7980 con 0x55e19781cc80 2023-10-06T02:27:20.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.932+0000 7fa9cb3ad000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1976a7620 con 0x55e19781c8b0 2023-10-06T02:27:20.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.932+0000 7fa9cb3ad000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e19769e400 con 0x55e19775b160 2023-10-06T02:27:20.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.932+0000 7fa9c4de9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19781cc80 0x55e1977a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:20.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.932+0000 7fa9c4de9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19781cc80 0x55e1977a56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55566/0 (socket says 172.21.15.6:55566) 2023-10-06T02:27:20.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.932+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4129875383 learned_addr learned my addr 172.21.15.6:0/4129875383 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:20.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.932+0000 7fa9c45e8700 1 --2- 172.21.15.6:0/4129875383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19775b160 0x55e1978349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:20.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.932+0000 7fa9c3de7700 1 --2- 172.21.15.6:0/4129875383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19781c8b0 0x55e1977a30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:20.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.932+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4129875383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19775b160 msgr2=0x55e1978349d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:20.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.932+0000 7fa9c4de9700 1 --2- 172.21.15.6:0/4129875383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19775b160 0x55e1978349d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.932+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4129875383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19781c8b0 msgr2=0x55e1977a30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:20.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.932+0000 7fa9c4de9700 1 --2- 172.21.15.6:0/4129875383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19781c8b0 0x55e1977a30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.932+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4129875383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b400a0e0 con 0x55e19781cc80 2023-10-06T02:27:20.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.933+0000 7fa9c45e8700 1 --2- 172.21.15.6:0/4129875383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19775b160 0x55e1978349d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:20.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.933+0000 7fa9c3de7700 1 --2- 172.21.15.6:0/4129875383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19781c8b0 0x55e1977a30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:20.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.933+0000 7fa9c4de9700 1 --2- 172.21.15.6:0/4129875383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19781cc80 0x55e1977a56b0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400a860 tx=0x7fa9b4007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7fbde6c71a390f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:20.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.933+0000 7fa9c2de5700 1 -- 172.21.15.6:0/4129875383 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b400d780 con 0x55e19781cc80 2023-10-06T02:27:20.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.933+0000 7fa9c2de5700 1 -- 172.21.15.6:0/4129875383 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b400d8e0 con 0x55e19781cc80 2023-10-06T02:27:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.933+0000 7fa9c2de5700 1 -- 172.21.15.6:0/4129875383 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b400dc60 con 0x55e19781cc80 2023-10-06T02:27:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.933+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4129875383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19781cc80 msgr2=0x55e1977a56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.933+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4129875383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19781cc80 0x55e1977a56b0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400a860 tx=0x7fa9b4007040 comp rx=0 tx=0).stop 2023-10-06T02:27:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.933+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4129875383 shutdown_connections 2023-10-06T02:27:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.933+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4129875383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19781cc80 0x55e1977a56b0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.933+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4129875383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19775b160 0x55e1978349d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.933+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4129875383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19781c8b0 0x55e1977a30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.933+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4129875383 >> 172.21.15.6:0/4129875383 conn(0x55e1977a3bd0 msgr2=0x55e1978338c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.933+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4129875383 shutdown_connections 2023-10-06T02:27:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.933+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4129875383 wait complete. 2023-10-06T02:27:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.934+0000 7fa9cb3ad000 1 Processor -- start 2023-10-06T02:27:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.934+0000 7fa9cb3ad000 1 -- start start 2023-10-06T02:27:20.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9cb3ad000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19775b160 0x55e197816790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:20.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9cb3ad000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19781c8b0 0x55e197789260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:20.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9cb3ad000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19781cc80 0x55e1978122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:20.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9cb3ad000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1978182f0 con 0x55e19781c8b0 2023-10-06T02:27:20.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9cb3ad000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e197813580 con 0x55e19775b160 2023-10-06T02:27:20.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9cb3ad000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e197817b10 con 0x55e19781cc80 2023-10-06T02:27:20.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9c3de7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19781c8b0 0x55e197789260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:20.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9c3de7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19781c8b0 0x55e197789260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55570/0 (socket says 172.21.15.6:55570) 2023-10-06T02:27:20.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 learned_addr learned my addr 172.21.15.6:0/4057451584 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:20.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9c4de9700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19781cc80 0x55e1978122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:20.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9c45e8700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19775b160 0x55e197816790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:20.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19781cc80 msgr2=0x55e1978122f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:20.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9c3de7700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19781cc80 0x55e1978122f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19775b160 msgr2=0x55e197816790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:20.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9c3de7700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19775b160 0x55e197816790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:20.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b400a510 con 0x55e19781c8b0 2023-10-06T02:27:20.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9c3de7700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19781c8b0 0x55e197789260 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac005b50 tx=0x7fa9ac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:20.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.935+0000 7fa9c15e2700 1 -- 172.21.15.6:0/4057451584 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac020070 con 0x55e19781c8b0 2023-10-06T02:27:20.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.936+0000 7fa9c15e2700 1 -- 172.21.15.6:0/4057451584 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ac008ad0 con 0x55e19781c8b0 2023-10-06T02:27:20.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.936+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9ac005db0 con 0x55e19781c8b0 2023-10-06T02:27:20.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.936+0000 7fa9c15e2700 1 -- 172.21.15.6:0/4057451584 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac026670 con 0x55e19781c8b0 2023-10-06T02:27:20.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.936+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1976b63d0 con 0x55e19781c8b0 2023-10-06T02:27:20.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.937+0000 7fa9c15e2700 1 -- 172.21.15.6:0/4057451584 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9ac024070 con 0x55e19781c8b0 2023-10-06T02:27:20.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.937+0000 7fa9c15e2700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9a4065890 0x7fa9a4067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:20.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.937+0000 7fa9c15e2700 1 -- 172.21.15.6:0/4057451584 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8184+0+0 (secure 0 0 0) 0x7fa9ac085160 con 0x55e19781c8b0 2023-10-06T02:27:20.943 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:27:20.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.937+0000 7fa9c45e8700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9a4065890 0x7fa9a4067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:20.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.937+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55e1977897a0 0x55e197813ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:20.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.937+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197812f70 con 0x55e1977897a0 2023-10-06T02:27:20.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.938+0000 7fa9c4de9700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55e1977897a0 0x55e197813ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:20.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.938+0000 7fa9c4de9700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55e1977897a0 0x55e197813ef0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:20.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.938+0000 7fa9c45e8700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9a4065890 0x7fa9a4067d40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc000c00 tx=0x7fa9bc0019c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:20.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.940+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v116'629 uv603 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4019070 con 0x55e1977897a0 2023-10-06T02:27:20.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.940+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197814430 con 0x55e1977897a0 2023-10-06T02:27:20.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.941+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v116'630 uv630 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4019070 con 0x55e1977897a0 2023-10-06T02:27:20.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.941+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197812830 con 0x55e1977897a0 2023-10-06T02:27:20.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.942+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v116'631 uv631 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4019070 con 0x55e1977897a0 2023-10-06T02:27:20.945 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:27:20.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.942+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197851360 con 0x55e1977897a0 2023-10-06T02:27:20.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.943+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v116'632 uv632 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.943+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197851710 con 0x55e1977897a0 2023-10-06T02:27:20.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.944+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v116'633 uv633 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.944+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850350 con 0x55e1977897a0 2023-10-06T02:27:20.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.945+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v116'634 uv634 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.945+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850750 con 0x55e1977897a0 2023-10-06T02:27:20.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.946+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v116'635 uv609 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.946+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850b50 con 0x55e1977897a0 2023-10-06T02:27:20.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.947+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v116'636 uv636 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.947+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850b50 con 0x55e1977897a0 2023-10-06T02:27:20.948 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:27:20.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.948+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v116'637 uv637 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.948+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850b00 con 0x55e1977897a0 2023-10-06T02:27:20.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.949+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v116'638 uv638 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.949+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850b00 con 0x55e1977897a0 2023-10-06T02:27:20.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.950+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v116'639 uv639 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.950+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850b00 con 0x55e1977897a0 2023-10-06T02:27:20.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.951+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v116'640 uv640 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.951+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850b00 con 0x55e1977897a0 2023-10-06T02:27:20.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.952+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v116'641 uv616 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.952+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850b00 con 0x55e1977897a0 2023-10-06T02:27:20.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.953+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v116'642 uv642 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.953+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850b00 con 0x55e1977897a0 2023-10-06T02:27:20.955 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:27:20.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.954+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v116'643 uv643 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.954+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850b00 con 0x55e1977897a0 2023-10-06T02:27:20.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.955+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v116'644 uv644 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.955+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850b00 con 0x55e1977897a0 2023-10-06T02:27:20.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.956+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v116'645 uv645 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.956+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850b00 con 0x55e1977897a0 2023-10-06T02:27:20.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.957+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v116'646 uv646 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.957+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850f30 con 0x55e1977897a0 2023-10-06T02:27:20.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.958+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v116'647 uv647 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.958+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850d70 con 0x55e1977897a0 2023-10-06T02:27:20.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.959+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v116'648 uv622 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.959+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850d70 con 0x55e1977897a0 2023-10-06T02:27:20.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.960+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v116'649 uv649 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.960+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850d70 con 0x55e1977897a0 2023-10-06T02:27:20.962 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:27:20.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.961+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v116'650 uv650 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.961+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850d70 con 0x55e1977897a0 2023-10-06T02:27:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.962+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v116'651 uv651 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.962+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850d70 con 0x55e1977897a0 2023-10-06T02:27:20.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.963+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v116'652 uv652 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.963+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850d70 con 0x55e1977897a0 2023-10-06T02:27:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.965+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v116'653 uv653 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.965+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850d70 con 0x55e1977897a0 2023-10-06T02:27:20.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.966+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v116'654 uv628 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.966+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850d70 con 0x55e1977897a0 2023-10-06T02:27:20.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.967+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v116'655 uv655 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.967+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850d70 con 0x55e1977897a0 2023-10-06T02:27:20.969 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:27:20.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.968+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v116'656 uv656 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.968+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850d70 con 0x55e1977897a0 2023-10-06T02:27:20.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.969+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v116'657 uv657 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.969+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850d70 con 0x55e1977897a0 2023-10-06T02:27:20.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.970+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v116'658 uv658 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.970+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197850d70 con 0x55e1977897a0 2023-10-06T02:27:20.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.971+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v116'659 uv659 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e1977897a0 2023-10-06T02:27:20.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.971+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55e197851ac0 0x55e197853ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:20.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.971+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e1978543e0 con 0x55e197851ac0 2023-10-06T02:27:20.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.972+0000 7fa9c45e8700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55e197851ac0 0x55e197853ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:20.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.972+0000 7fa9c45e8700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55e197851ac0 0x55e197853ea0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:20.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.973+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v116'457 uv440 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.973+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197854790 con 0x55e197851ac0 2023-10-06T02:27:20.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.975+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v116'458 uv458 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.975+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197854be0 con 0x55e197851ac0 2023-10-06T02:27:20.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.976+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v116'459 uv459 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.976 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:27:20.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.976+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197855520 con 0x55e197851ac0 2023-10-06T02:27:20.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.977+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v116'460 uv460 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.977+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197855130 con 0x55e197851ac0 2023-10-06T02:27:20.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.977+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v116'461 uv461 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.978+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197855e10 con 0x55e197851ac0 2023-10-06T02:27:20.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.979+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v116'462 uv445 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.979+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e1978561c0 con 0x55e197851ac0 2023-10-06T02:27:20.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.980+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v116'463 uv463 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.980+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197856570 con 0x55e197851ac0 2023-10-06T02:27:20.981 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:27:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.981+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v116'464 uv464 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.981+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197856570 con 0x55e197851ac0 2023-10-06T02:27:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.982+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v116'465 uv465 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.982+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197856970 con 0x55e197851ac0 2023-10-06T02:27:20.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.983+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v116'466 uv466 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.983+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197856970 con 0x55e197851ac0 2023-10-06T02:27:20.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.984+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v116'467 uv450 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.984+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197856570 con 0x55e197851ac0 2023-10-06T02:27:20.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.985+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v116'468 uv468 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.985+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197856570 con 0x55e197851ac0 2023-10-06T02:27:20.987 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:27:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.986+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v116'469 uv469 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.986+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197856570 con 0x55e197851ac0 2023-10-06T02:27:20.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.988+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v116'470 uv470 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.988+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197856570 con 0x55e197851ac0 2023-10-06T02:27:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.989+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v116'471 uv471 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.989+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197856570 con 0x55e197851ac0 2023-10-06T02:27:20.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.990+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v116'472 uv456 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.990+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197856570 con 0x55e197851ac0 2023-10-06T02:27:20.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.991+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v116'473 uv473 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.991+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197856570 con 0x55e197851ac0 2023-10-06T02:27:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.992+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v116'474 uv474 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.992 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:27:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.992+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197857580 con 0x55e197851ac0 2023-10-06T02:27:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.993+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v116'475 uv475 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.993+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197857580 con 0x55e197851ac0 2023-10-06T02:27:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.994+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v116'476 uv476 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.994+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197856570 con 0x55e197851ac0 2023-10-06T02:27:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.995+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v116'477 uv477 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.995+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e197856a80 0x55e197858e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.995+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197859470 con 0x55e197856a80 2023-10-06T02:27:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.995+0000 7fa9c3de7700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e197856a80 0x55e197858e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.995+0000 7fa9c3de7700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e197856a80 0x55e197858e60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.997+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v116'123 uv122 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.997+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197859930 con 0x55e197856a80 2023-10-06T02:27:20.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.998+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v116'124 uv124 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:20.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.998+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197859eb0 con 0x55e197856a80 2023-10-06T02:27:21.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.999+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v116'125 uv125 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.001 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:27:21.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:20.999+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785b7b0 con 0x55e197856a80 2023-10-06T02:27:21.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.000+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v116'126 uv126 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.000+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785bb60 con 0x55e197856a80 2023-10-06T02:27:21.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.000+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v116'127 uv127 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.000+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785a7a0 con 0x55e197856a80 2023-10-06T02:27:21.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.001+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v116'128 uv128 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.001+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785aba0 con 0x55e197856a80 2023-10-06T02:27:21.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.002+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v116'88 uv87 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.002+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785aba0 con 0x55e197856a80 2023-10-06T02:27:21.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.003+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v116'89 uv89 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.003+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785ab50 con 0x55e197856a80 2023-10-06T02:27:21.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.005+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v116'90 uv90 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.005 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:27:21.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.005+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785ab50 con 0x55e197856a80 2023-10-06T02:27:21.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.006+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v116'91 uv91 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.006+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785ab50 con 0x55e197851ac0 2023-10-06T02:27:21.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.007+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v116'123 uv122 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:21.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.007+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785ab50 con 0x55e197851ac0 2023-10-06T02:27:21.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.008+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v116'124 uv124 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:21.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.008+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785ab50 con 0x55e197851ac0 2023-10-06T02:27:21.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.009+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v116'125 uv125 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:21.010 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:27:21.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.009+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785ab50 con 0x55e197851ac0 2023-10-06T02:27:21.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.010+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v116'126 uv126 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:21.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.010+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785ab50 con 0x55e197851ac0 2023-10-06T02:27:21.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.011+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v116'127 uv127 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:21.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.011+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785ab50 con 0x55e197851ac0 2023-10-06T02:27:21.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.014+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v116'128 uv128 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e197851ac0 2023-10-06T02:27:21.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.014+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55e19785bf10 0x55e19785e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.014+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785e830 con 0x55e19785bf10 2023-10-06T02:27:21.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.014+0000 7fa9c4de9700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55e19785bf10 0x55e19785e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.014+0000 7fa9c4de9700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55e19785bf10 0x55e19785e2f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.015+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v116'227 uv221 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e19785bf10 2023-10-06T02:27:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.016+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785e830 con 0x55e19785bf10 2023-10-06T02:27:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.017+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v116'228 uv228 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e19785bf10 2023-10-06T02:27:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.017+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785e830 con 0x55e19785bf10 2023-10-06T02:27:21.018 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:27:21.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.018+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v116'229 uv229 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e19785bf10 2023-10-06T02:27:21.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.018+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785f840 con 0x55e19785bf10 2023-10-06T02:27:21.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.019+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v116'230 uv230 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e19785bf10 2023-10-06T02:27:21.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.019+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785f840 con 0x55e19785bf10 2023-10-06T02:27:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.021+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v116'231 uv231 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e19785bf10 2023-10-06T02:27:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.021+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785e830 con 0x55e19785bf10 2023-10-06T02:27:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.022+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v116'232 uv232 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e19785bf10 2023-10-06T02:27:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.023+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785e830 con 0x55e19785bf10 2023-10-06T02:27:21.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.023+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v116'233 uv226 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e19785bf10 2023-10-06T02:27:21.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.023+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785e830 con 0x55e19785bf10 2023-10-06T02:27:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.024+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v116'234 uv234 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e19785bf10 2023-10-06T02:27:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.025+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785e830 con 0x55e19785bf10 2023-10-06T02:27:21.026 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:27:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.026+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v116'235 uv235 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e19785bf10 2023-10-06T02:27:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.026+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785e830 con 0x55e19785bf10 2023-10-06T02:27:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.027+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v116'236 uv236 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e19785bf10 2023-10-06T02:27:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.027+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785e830 con 0x55e19785bf10 2023-10-06T02:27:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.028+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v116'237 uv237 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e19785bf10 2023-10-06T02:27:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.028+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55e19785ed40 0x55e197861120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.028+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e1978617e0 con 0x55e19785ed40 2023-10-06T02:27:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.028+0000 7fa9c45e8700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55e19785ed40 0x55e197861120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.028+0000 7fa9c45e8700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55e19785ed40 0x55e197861120 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.029+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v116'102 uv101 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e19785ed40 2023-10-06T02:27:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.029+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197861bc0 con 0x55e19785ed40 2023-10-06T02:27:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.031+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v116'103 uv103 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e19785ed40 2023-10-06T02:27:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.031+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197861bc0 con 0x55e19785ed40 2023-10-06T02:27:21.034 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:27:21.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.033+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v116'104 uv104 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e19785ed40 2023-10-06T02:27:21.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.033+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197861bc0 con 0x55e19785ed40 2023-10-06T02:27:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.036+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v116'105 uv105 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e19785ed40 2023-10-06T02:27:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.036+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197861bc0 con 0x55e19785ed40 2023-10-06T02:27:21.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.039+0000 7fa9c45e8700 1 -- 172.21.15.6:0/4057451584 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v116'106 uv106 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa9bc016040 con 0x55e19785ed40 2023-10-06T02:27:21.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.039+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197861bc0 con 0x55e197856a80 2023-10-06T02:27:21.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.040+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v116'123 uv122 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.040+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197861bc0 con 0x55e197856a80 2023-10-06T02:27:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.041+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v116'124 uv124 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.041+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197861bc0 con 0x55e197856a80 2023-10-06T02:27:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.042+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v116'125 uv125 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.043 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:27:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.042+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197862bd0 con 0x55e197856a80 2023-10-06T02:27:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.043+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v116'126 uv126 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.043+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197862bd0 con 0x55e197856a80 2023-10-06T02:27:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.044+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v116'127 uv127 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.044+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197861bc0 con 0x55e197856a80 2023-10-06T02:27:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.045+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v116'128 uv128 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.045+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55e197862240 0x55e197864620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.045+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197864c40 con 0x55e197862240 2023-10-06T02:27:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.045+0000 7fa9c3de7700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55e197862240 0x55e197864620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.045+0000 7fa9c3de7700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55e197862240 0x55e197864620 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.047+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v116'203 uv202 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197862240 2023-10-06T02:27:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.047+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197865020 con 0x55e197862240 2023-10-06T02:27:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.048+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v116'204 uv204 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197862240 2023-10-06T02:27:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.048+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197865020 con 0x55e197862240 2023-10-06T02:27:21.049 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:27:21.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.049+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v116'205 uv205 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197862240 2023-10-06T02:27:21.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.049+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197865020 con 0x55e197862240 2023-10-06T02:27:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.050+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v116'206 uv206 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197862240 2023-10-06T02:27:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.050+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197865020 con 0x55e197862240 2023-10-06T02:27:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.051+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v116'207 uv207 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197862240 2023-10-06T02:27:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.051+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197865020 con 0x55e197862240 2023-10-06T02:27:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.052+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v116'208 uv201 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197862240 2023-10-06T02:27:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.052+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197865020 con 0x55e197862240 2023-10-06T02:27:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.053+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v116'209 uv209 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197862240 2023-10-06T02:27:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.053+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197865020 con 0x55e197862240 2023-10-06T02:27:21.054 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:27:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.054+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v116'210 uv210 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197862240 2023-10-06T02:27:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.054+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197865020 con 0x55e197862240 2023-10-06T02:27:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.055+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v116'211 uv211 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197862240 2023-10-06T02:27:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.055+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197867ca0 con 0x55e197862240 2023-10-06T02:27:21.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.056+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v116'212 uv212 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197862240 2023-10-06T02:27:21.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.056+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785a320 con 0x55e197856a80 2023-10-06T02:27:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.057+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v116'91 uv90 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.057+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785a320 con 0x55e197856a80 2023-10-06T02:27:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.058+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v116'92 uv92 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.058+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785a320 con 0x55e197856a80 2023-10-06T02:27:21.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.058+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v116'93 uv93 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.059 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:27:21.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.058+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e19785a320 con 0x55e197856a80 2023-10-06T02:27:21.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.059+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v116'94 uv94 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.059+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55e197865d20 0x55e197868100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.059+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197868640 con 0x55e197865d20 2023-10-06T02:27:21.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.060+0000 7fa9c4de9700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55e197865d20 0x55e197868100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.060+0000 7fa9c4de9700 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55e197865d20 0x55e197868100 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.061+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v116'123 uv122 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e197865d20 2023-10-06T02:27:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.061+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197868640 con 0x55e197865d20 2023-10-06T02:27:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.062+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v116'124 uv124 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e197865d20 2023-10-06T02:27:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.062+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197868640 con 0x55e197865d20 2023-10-06T02:27:21.064 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:27:21.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.064+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v116'125 uv125 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e197865d20 2023-10-06T02:27:21.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.064+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197869650 con 0x55e197865d20 2023-10-06T02:27:21.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.065+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v116'126 uv126 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e197865d20 2023-10-06T02:27:21.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.065+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197869650 con 0x55e197865d20 2023-10-06T02:27:21.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.066+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v116'127 uv127 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e197865d20 2023-10-06T02:27:21.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.066+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197868640 con 0x55e197865d20 2023-10-06T02:27:21.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.067+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v116'128 uv128 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e197865d20 2023-10-06T02:27:21.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.067+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197868640 con 0x55e19785bf10 2023-10-06T02:27:21.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.068+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v116'104 uv103 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e19785bf10 2023-10-06T02:27:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.068+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197868640 con 0x55e19785bf10 2023-10-06T02:27:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.069+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v116'105 uv105 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e19785bf10 2023-10-06T02:27:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.069+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197868640 con 0x55e19785bf10 2023-10-06T02:27:21.070 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:27:21.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.070+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v116'106 uv106 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e19785bf10 2023-10-06T02:27:21.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.070+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197868640 con 0x55e19785bf10 2023-10-06T02:27:21.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.071+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v116'107 uv107 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e19785bf10 2023-10-06T02:27:21.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.071+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197868640 con 0x55e19785bf10 2023-10-06T02:27:21.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.072+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v116'108 uv108 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa9b4025040 con 0x55e19785bf10 2023-10-06T02:27:21.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.072+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197868640 con 0x55e197856a80 2023-10-06T02:27:21.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.073+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v116'253 uv245 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.073+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197868640 con 0x55e197856a80 2023-10-06T02:27:21.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.075+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v116'254 uv254 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.076+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197868640 con 0x55e197856a80 2023-10-06T02:27:21.077 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:27:21.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.077+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v116'255 uv255 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.077+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197868640 con 0x55e197856a80 2023-10-06T02:27:21.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.079+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v116'256 uv256 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.079+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e1978653a0 con 0x55e197856a80 2023-10-06T02:27:21.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.082+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v116'257 uv257 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.082+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e1978653a0 con 0x55e197856a80 2023-10-06T02:27:21.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.087+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v116'258 uv252 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.087+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197868640 con 0x55e197856a80 2023-10-06T02:27:21.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.088+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v116'259 uv259 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.088+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197868640 con 0x55e197856a80 2023-10-06T02:27:21.091 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:27:21.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.091+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v116'260 uv260 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.091+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197869650 con 0x55e197856a80 2023-10-06T02:27:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.094+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v116'261 uv261 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.094+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197869650 con 0x55e197856a80 2023-10-06T02:27:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.099+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v116'262 uv262 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.099+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197868640 con 0x55e197856a80 2023-10-06T02:27:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.101+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v116'263 uv263 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.101+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55e197868b30 con 0x55e197856a80 2023-10-06T02:27:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9c3de7700 1 -- 172.21.15.6:0/4057451584 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v116'264 uv264 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa9ac082d40 con 0x55e197856a80 2023-10-06T02:27:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e197856a80 msgr2=0x55e197858e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e197856a80 0x55e197858e60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55e1977897a0 msgr2=0x55e197813ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55e1977897a0 0x55e197813ef0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55e197862240 msgr2=0x55e197864620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55e197862240 0x55e197864620 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55e197851ac0 msgr2=0x55e197853ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55e197851ac0 0x55e197853ea0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55e197865d20 msgr2=0x55e197868100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55e197865d20 0x55e197868100 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 reap_dead start 2023-10-06T02:27:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55e19785ed40 msgr2=0x55e197861120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55e19785ed40 0x55e197861120 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55e19785bf10 msgr2=0x55e19785e2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9c4de9700 1 -- 172.21.15.6:0/4057451584 reap_dead start 2023-10-06T02:27:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55e19785bf10 0x55e19785e2f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9a4065890 msgr2=0x7fa9a4067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9a4065890 0x7fa9a4067d40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc000c00 tx=0x7fa9bc0019c0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19781c8b0 msgr2=0x55e197789260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19781c8b0 0x55e197789260 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac005b50 tx=0x7fa9ac016000 comp rx=0 tx=0).stop 2023-10-06T02:27:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 shutdown_connections 2023-10-06T02:27:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19781c8b0 0x55e197789260 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.106+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa9a4065890 0x7fa9a4067d40 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.107+0000 7fa9cb3ad000 1 --2- 172.21.15.6:0/4057451584 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55e19785bf10 0x55e19785e2f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.107+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 >> 172.21.15.6:0/4057451584 conn(0x55e1977a3bd0 msgr2=0x55e197832dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.107+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 shutdown_connections 2023-10-06T02:27:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.107+0000 7fa9cb3ad000 1 -- 172.21.15.6:0/4057451584 wait complete. 2023-10-06T02:27:21.111 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 400.00000000 - 2023-10-06T02:27:21.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.189+0000 7f895fae5000 1 Processor -- start 2023-10-06T02:27:21.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.189+0000 7f895fae5000 1 -- start start 2023-10-06T02:27:21.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.190+0000 7f895fae5000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b36f68d710 0x55b36f6639b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.190+0000 7f895fae5000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b36f72f2f0 0x55b36f663ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.190+0000 7f895fae5000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b36f72f6c0 0x55b36f65f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.190+0000 7f895fae5000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b36f5ac980 con 0x55b36f68d710 2023-10-06T02:27:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.190+0000 7f895fae5000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b36f5ac620 con 0x55b36f72f6c0 2023-10-06T02:27:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.190+0000 7f895fae5000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b36f5a3400 con 0x55b36f72f2f0 2023-10-06T02:27:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.190+0000 7f8958d20700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b36f68d710 0x55b36f6639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.190+0000 7f8958d20700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b36f68d710 0x55b36f6639b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55588/0 (socket says 172.21.15.6:55588) 2023-10-06T02:27:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.190+0000 7f8958d20700 1 -- 172.21.15.6:0/3150533180 learned_addr learned my addr 172.21.15.6:0/3150533180 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.190+0000 7f895851f700 1 --2- 172.21.15.6:0/3150533180 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b36f72f2f0 0x55b36f663ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.190+0000 7f8959521700 1 --2- 172.21.15.6:0/3150533180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b36f72f6c0 0x55b36f65f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.191+0000 7f8958d20700 1 -- 172.21.15.6:0/3150533180 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b36f72f2f0 msgr2=0x55b36f663ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.191+0000 7f8958d20700 1 --2- 172.21.15.6:0/3150533180 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b36f72f2f0 0x55b36f663ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.191+0000 7f8958d20700 1 -- 172.21.15.6:0/3150533180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b36f72f6c0 msgr2=0x55b36f65f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.191+0000 7f8958d20700 1 --2- 172.21.15.6:0/3150533180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b36f72f6c0 0x55b36f65f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.191+0000 7f8958d20700 1 -- 172.21.15.6:0/3150533180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8940005cf0 con 0x55b36f68d710 2023-10-06T02:27:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.191+0000 7f8958d20700 1 --2- 172.21.15.6:0/3150533180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b36f68d710 0x55b36f6639b0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f895000a7b0 tx=0x7f8950005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cec063143669522 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.191+0000 7f895751d700 1 -- 172.21.15.6:0/3150533180 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895000f070 con 0x55b36f68d710 2023-10-06T02:27:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.191+0000 7f895751d700 1 -- 172.21.15.6:0/3150533180 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8950008760 con 0x55b36f68d710 2023-10-06T02:27:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.191+0000 7f895751d700 1 -- 172.21.15.6:0/3150533180 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950008b00 con 0x55b36f68d710 2023-10-06T02:27:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.191+0000 7f895fae5000 1 -- 172.21.15.6:0/3150533180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b36f68d710 msgr2=0x55b36f6639b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.191+0000 7f895fae5000 1 --2- 172.21.15.6:0/3150533180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b36f68d710 0x55b36f6639b0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f895000a7b0 tx=0x7f8950005c80 comp rx=0 tx=0).stop 2023-10-06T02:27:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.191+0000 7f895fae5000 1 -- 172.21.15.6:0/3150533180 shutdown_connections 2023-10-06T02:27:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.191+0000 7f895fae5000 1 --2- 172.21.15.6:0/3150533180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b36f72f6c0 0x55b36f65f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.191+0000 7f895fae5000 1 --2- 172.21.15.6:0/3150533180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b36f68d710 0x55b36f6639b0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.191+0000 7f895fae5000 1 --2- 172.21.15.6:0/3150533180 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b36f72f2f0 0x55b36f663ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.191+0000 7f895fae5000 1 -- 172.21.15.6:0/3150533180 >> 172.21.15.6:0/3150533180 conn(0x55b36f6625d0 msgr2=0x55b36f734b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.192+0000 7f895fae5000 1 -- 172.21.15.6:0/3150533180 shutdown_connections 2023-10-06T02:27:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.192+0000 7f895fae5000 1 -- 172.21.15.6:0/3150533180 wait complete. 2023-10-06T02:27:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.192+0000 7f895fae5000 1 Processor -- start 2023-10-06T02:27:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.192+0000 7f895fae5000 1 -- start start 2023-10-06T02:27:21.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.193+0000 7f895fae5000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b36f68d710 0x55b36f72dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.193+0000 7f895fae5000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b36f72f2f0 0x55b36f68f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.193+0000 7f895fae5000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b36f72f6c0 0x55b36f68fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.193+0000 7f895fae5000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b36f72e180 con 0x55b36f72f6c0 2023-10-06T02:27:21.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.193+0000 7f895fae5000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b36f74b8a0 con 0x55b36f72f2f0 2023-10-06T02:27:21.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.193+0000 7f895fae5000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b36f74bb40 con 0x55b36f68d710 2023-10-06T02:27:21.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.193+0000 7f8959521700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b36f72f6c0 0x55b36f68fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.193+0000 7f8959521700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b36f72f6c0 0x55b36f68fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55594/0 (socket says 172.21.15.6:55594) 2023-10-06T02:27:21.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.193+0000 7f8959521700 1 -- 172.21.15.6:0/3302016656 learned_addr learned my addr 172.21.15.6:0/3302016656 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:21.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.193+0000 7f8958d20700 1 --2- 172.21.15.6:0/3302016656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b36f68d710 0x55b36f72dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.193+0000 7f895851f700 1 --2- 172.21.15.6:0/3302016656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b36f72f2f0 0x55b36f68f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.193+0000 7f8959521700 1 -- 172.21.15.6:0/3302016656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b36f68d710 msgr2=0x55b36f72dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.193+0000 7f8959521700 1 --2- 172.21.15.6:0/3302016656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b36f68d710 0x55b36f72dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.193+0000 7f8959521700 1 -- 172.21.15.6:0/3302016656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b36f72f2f0 msgr2=0x55b36f68f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.193+0000 7f8959521700 1 --2- 172.21.15.6:0/3302016656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b36f72f2f0 0x55b36f68f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.193+0000 7f8959521700 1 -- 172.21.15.6:0/3302016656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895000a440 con 0x55b36f72f6c0 2023-10-06T02:27:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.193+0000 7f8959521700 1 --2- 172.21.15.6:0/3302016656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b36f72f6c0 0x55b36f68fb50 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f8948006530 tx=0x7f8948006af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.194+0000 7f8955d1a700 1 -- 172.21.15.6:0/3302016656 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894800eeb0 con 0x55b36f72f6c0 2023-10-06T02:27:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.194+0000 7f8955d1a700 1 -- 172.21.15.6:0/3302016656 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89480123b0 con 0x55b36f72f6c0 2023-10-06T02:27:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.194+0000 7f895fae5000 1 -- 172.21.15.6:0/3302016656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b36f5bb3d0 con 0x55b36f72f6c0 2023-10-06T02:27:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.194+0000 7f8955d1a700 1 -- 172.21.15.6:0/3302016656 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8948012770 con 0x55b36f72f6c0 2023-10-06T02:27:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.194+0000 7f895fae5000 1 -- 172.21.15.6:0/3302016656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b36f5aeae0 con 0x55b36f72f6c0 2023-10-06T02:27:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.195+0000 7f8955d1a700 1 -- 172.21.15.6:0/3302016656 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8948012b60 con 0x55b36f72f6c0 2023-10-06T02:27:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.195+0000 7f8955d1a700 1 --2- 172.21.15.6:0/3302016656 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8938065890 0x7f8938067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.195+0000 7f8955d1a700 1 -- 172.21.15.6:0/3302016656 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8184+0+0 (secure 0 0 0) 0x7f89480833f0 con 0x55b36f72f6c0 2023-10-06T02:27:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.196+0000 7f8958d20700 1 --2- 172.21.15.6:0/3302016656 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8938065890 0x7f8938067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.196+0000 7f895fae5000 1 --2- 172.21.15.6:0/3302016656 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b36f749030 0x55b36f749430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.196+0000 7f895fae5000 1 -- 172.21.15.6:0/3302016656 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v8 -- 0x55b36f749970 con 0x55b36f749030 2023-10-06T02:27:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.196+0000 7f895851f700 1 --2- 172.21.15.6:0/3302016656 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b36f749030 0x55b36f749430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.196+0000 7f8958d20700 1 --2- 172.21.15.6:0/3302016656 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8938065890 0x7f8938067d40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f895000a6a0 tx=0x7f8950019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.196+0000 7f895851f700 1 --2- 172.21.15.6:0/3302016656 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b36f749030 0x55b36f749430 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.197+0000 7f895851f700 1 -- 172.21.15.6:0/3302016656 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(1 400.00000000 [writefull 0~80] v116'109 uv109 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f89400089d0 con 0x55b36f749030 2023-10-06T02:27:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.198+0000 7f895fae5000 1 -- 172.21.15.6:0/3302016656 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b36f749030 msgr2=0x55b36f749430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.198+0000 7f895fae5000 1 --2- 172.21.15.6:0/3302016656 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b36f749030 0x55b36f749430 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.198+0000 7f895fae5000 1 -- 172.21.15.6:0/3302016656 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8938065890 msgr2=0x7f8938067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.198+0000 7f895fae5000 1 --2- 172.21.15.6:0/3302016656 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8938065890 0x7f8938067d40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f895000a6a0 tx=0x7f8950019000 comp rx=0 tx=0).stop 2023-10-06T02:27:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.198+0000 7f895fae5000 1 -- 172.21.15.6:0/3302016656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b36f72f6c0 msgr2=0x55b36f68fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.198+0000 7f895fae5000 1 --2- 172.21.15.6:0/3302016656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b36f72f6c0 0x55b36f68fb50 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f8948006530 tx=0x7f8948006af0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.198+0000 7f8959521700 1 -- 172.21.15.6:0/3302016656 reap_dead start 2023-10-06T02:27:21.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.198+0000 7f895fae5000 1 -- 172.21.15.6:0/3302016656 shutdown_connections 2023-10-06T02:27:21.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.198+0000 7f895fae5000 1 -- 172.21.15.6:0/3302016656 >> 172.21.15.6:0/3302016656 conn(0x55b36f6625d0 msgr2=0x55b36f734cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:21.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.198+0000 7f895fae5000 1 -- 172.21.15.6:0/3302016656 shutdown_connections 2023-10-06T02:27:21.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.198+0000 7f895fae5000 1 -- 172.21.15.6:0/3302016656 wait complete. 2023-10-06T02:27:21.204 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:27:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.365+0000 7fa7c7cb7700 1 Processor -- start 2023-10-06T02:27:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.366+0000 7fa7c7cb7700 1 -- start start 2023-10-06T02:27:21.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.366+0000 7fa7c7cb7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa7c00ccd40 0x7fa7c00cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.366+0000 7fa7c7cb7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7c00cf7e0 0x7fa7c00b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.366+0000 7fa7c7cb7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c015dd40 con 0x7fa7c00d0400 2023-10-06T02:27:21.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.366+0000 7fa7c7cb7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c015e020 con 0x7fa7c00ccd40 2023-10-06T02:27:21.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.366+0000 7fa7c7cb7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c00ceaa0 con 0x7fa7c00cf7e0 2023-10-06T02:27:21.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.367+0000 7fa7c5252700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa7c00ccd40 0x7fa7c00cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.367+0000 7fa7c5252700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa7c00ccd40 0x7fa7c00cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55604/0 (socket says 172.21.15.6:55604) 2023-10-06T02:27:21.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.367+0000 7fa7c5252700 1 -- 172.21.15.6:0/1803263984 learned_addr learned my addr 172.21.15.6:0/1803263984 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:21.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.367+0000 7fa7c6254700 1 --2- 172.21.15.6:0/1803263984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7c00cf7e0 0x7fa7c00b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.367+0000 7fa7c5252700 1 -- 172.21.15.6:0/1803263984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7c00cf7e0 msgr2=0x7fa7c00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:21.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.367+0000 7fa7c5252700 1 --2- 172.21.15.6:0/1803263984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7c00cf7e0 0x7fa7c00b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.367+0000 7fa7c5252700 1 -- 172.21.15.6:0/1803263984 >> v1:172.21.15.175:6789/0 conn(0x7fa7c00d0400 legacy=0x7fa7c00b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:21.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.367+0000 7fa7c5252700 1 -- 172.21.15.6:0/1803263984 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c00ced80 con 0x7fa7c00ccd40 2023-10-06T02:27:21.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.367+0000 7fa7c5252700 1 --2- 172.21.15.6:0/1803263984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7c00ccd40 0x7fa7c00cf2a0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00099b0 tx=0x7fa7b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69b049bfc2de12e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:21.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.367+0000 7fa7c4a51700 1 -- 172.21.15.6:0/1803263984 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b000b820 con 0x7fa7c00ccd40 2023-10-06T02:27:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.367+0000 7fa7c4a51700 1 -- 172.21.15.6:0/1803263984 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b000b980 con 0x7fa7c00ccd40 2023-10-06T02:27:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.367+0000 7fa7c4a51700 1 -- 172.21.15.6:0/1803263984 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b000bd20 con 0x7fa7c00ccd40 2023-10-06T02:27:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.368+0000 7fa7c7cb7700 1 -- 172.21.15.6:0/1803263984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7c00ccd40 msgr2=0x7fa7c00cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.368+0000 7fa7c7cb7700 1 --2- 172.21.15.6:0/1803263984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7c00ccd40 0x7fa7c00cf2a0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00099b0 tx=0x7fa7b0009250 comp rx=0 tx=0).stop 2023-10-06T02:27:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.368+0000 7fa7c7cb7700 1 -- 172.21.15.6:0/1803263984 shutdown_connections 2023-10-06T02:27:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.368+0000 7fa7c7cb7700 1 --2- 172.21.15.6:0/1803263984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7c00cf7e0 0x7fa7c00b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.368+0000 7fa7c7cb7700 1 --2- 172.21.15.6:0/1803263984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7c00ccd40 0x7fa7c00cf2a0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.368+0000 7fa7c7cb7700 1 -- 172.21.15.6:0/1803263984 >> 172.21.15.6:0/1803263984 conn(0x7fa7c006a220 msgr2=0x7fa7c006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.368+0000 7fa7c7cb7700 1 -- 172.21.15.6:0/1803263984 shutdown_connections 2023-10-06T02:27:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.368+0000 7fa7c7cb7700 1 -- 172.21.15.6:0/1803263984 wait complete. 2023-10-06T02:27:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.369+0000 7fa7c7cb7700 1 Processor -- start 2023-10-06T02:27:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.369+0000 7fa7c7cb7700 1 -- start start 2023-10-06T02:27:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7c7cb7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7c00ccd40 0x7fa7c0150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7c7cb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7c00cf7e0 0x7fa7c0151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7c7cb7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7c00d0400 0x7fa7c00b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7c7cb7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c00b0cd0 con 0x7fa7c00cf7e0 2023-10-06T02:27:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7c7cb7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c00b1b30 con 0x7fa7c00ccd40 2023-10-06T02:27:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7c7cb7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c00b0f20 con 0x7fa7c00d0400 2023-10-06T02:27:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7c5252700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7c00cf7e0 0x7fa7c0151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7c5252700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7c00cf7e0 0x7fa7c0151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55614/0 (socket says 172.21.15.6:55614) 2023-10-06T02:27:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7c5252700 1 -- 172.21.15.6:0/261581985 learned_addr learned my addr 172.21.15.6:0/261581985 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7c5a53700 1 --2- 172.21.15.6:0/261581985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7c00ccd40 0x7fa7c0150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7c6254700 1 --2- 172.21.15.6:0/261581985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7c00d0400 0x7fa7c00b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7c5252700 1 -- 172.21.15.6:0/261581985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7c00d0400 msgr2=0x7fa7c00b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7c5252700 1 --2- 172.21.15.6:0/261581985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7c00d0400 0x7fa7c00b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7c5252700 1 -- 172.21.15.6:0/261581985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7c00ccd40 msgr2=0x7fa7c0150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7c5252700 1 --2- 172.21.15.6:0/261581985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7c00ccd40 0x7fa7c0150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7c5252700 1 -- 172.21.15.6:0/261581985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b00094f0 con 0x7fa7c00cf7e0 2023-10-06T02:27:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7c5252700 1 --2- 172.21.15.6:0/261581985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7c00cf7e0 0x7fa7c0151ca0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00094c0 tx=0x7fa7b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.370+0000 7fa7b5ffb700 1 -- 172.21.15.6:0/261581985 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0011bf0 con 0x7fa7c00cf7e0 2023-10-06T02:27:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.371+0000 7fa7b5ffb700 1 -- 172.21.15.6:0/261581985 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b0020070 con 0x7fa7c00cf7e0 2023-10-06T02:27:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.371+0000 7fa7b5ffb700 1 -- 172.21.15.6:0/261581985 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b001b450 con 0x7fa7c00cf7e0 2023-10-06T02:27:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.371+0000 7fa7c7cb7700 1 -- 172.21.15.6:0/261581985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c00b1200 con 0x7fa7c00cf7e0 2023-10-06T02:27:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.371+0000 7fa7c7cb7700 1 -- 172.21.15.6:0/261581985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c00b17c0 con 0x7fa7c00cf7e0 2023-10-06T02:27:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.372+0000 7fa7c7cb7700 1 -- 172.21.15.6:0/261581985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c00b1cc0 con 0x7fa7c00cf7e0 2023-10-06T02:27:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.372+0000 7fa7b5ffb700 1 -- 172.21.15.6:0/261581985 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa7b0022030 con 0x7fa7c00cf7e0 2023-10-06T02:27:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.372+0000 7fa7b5ffb700 1 --2- 172.21.15.6:0/261581985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7a4066f30 0x7fa7a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.373+0000 7fa7b5ffb700 1 -- 172.21.15.6:0/261581985 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8184+0+0 (secure 0 0 0) 0x7fa7b0086dc0 con 0x7fa7c00cf7e0 2023-10-06T02:27:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.373+0000 7fa7c5a53700 1 --2- 172.21.15.6:0/261581985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7a4066f30 0x7fa7a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:21.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.373+0000 7fa7c5a53700 1 --2- 172.21.15.6:0/261581985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7a4066f30 0x7fa7a40693e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc006fd0 tx=0x7fa7bc009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:21.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.377+0000 7fa7b5ffb700 1 -- 172.21.15.6:0/261581985 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7b00535e0 con 0x7fa7c00cf7e0 2023-10-06T02:27:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.616+0000 7fa7c7cb7700 1 -- 172.21.15.6:0/261581985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fa7c00b1cc0 con 0x7fa7c00cf7e0 2023-10-06T02:27:21.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.882+0000 7fa7b5ffb700 1 -- 172.21.15.6:0/261581985 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v225) v1 ==== 162+0+0 (secure 0 0 0) 0x7fa7b0056c00 con 0x7fa7c00cf7e0 2023-10-06T02:27:21.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.885+0000 7fa7c7cb7700 1 -- 172.21.15.6:0/261581985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7a4066f30 msgr2=0x7fa7a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.885+0000 7fa7c7cb7700 1 --2- 172.21.15.6:0/261581985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7a4066f30 0x7fa7a40693e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc006fd0 tx=0x7fa7bc009060 comp rx=0 tx=0).stop 2023-10-06T02:27:21.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.885+0000 7fa7c7cb7700 1 -- 172.21.15.6:0/261581985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7c00cf7e0 msgr2=0x7fa7c0151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:21.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.885+0000 7fa7c7cb7700 1 --2- 172.21.15.6:0/261581985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7c00cf7e0 0x7fa7c0151ca0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00094c0 tx=0x7fa7b0016000 comp rx=0 tx=0).stop 2023-10-06T02:27:21.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.885+0000 7fa7c7cb7700 1 -- 172.21.15.6:0/261581985 shutdown_connections 2023-10-06T02:27:21.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.885+0000 7fa7c7cb7700 1 --2- 172.21.15.6:0/261581985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7c00d0400 0x7fa7c00b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.885+0000 7fa7c7cb7700 1 --2- 172.21.15.6:0/261581985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7c00ccd40 0x7fa7c0150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.885+0000 7fa7c7cb7700 1 --2- 172.21.15.6:0/261581985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa7a4066f30 0x7fa7a40693e0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.885+0000 7fa7c7cb7700 1 --2- 172.21.15.6:0/261581985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7c00cf7e0 0x7fa7c0151ca0 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:21.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.885+0000 7fa7c7cb7700 1 -- 172.21.15.6:0/261581985 >> 172.21.15.6:0/261581985 conn(0x7fa7c006a220 msgr2=0x7fa7c00b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:21.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.885+0000 7fa7c7cb7700 1 -- 172.21.15.6:0/261581985 shutdown_connections 2023-10-06T02:27:21.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:21.885+0000 7fa7c7cb7700 1 -- 172.21.15.6:0/261581985 wait complete. 2023-10-06T02:27:21.888 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:27:21.889 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:27:21.888+0000 7f61d1db7700 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -22 ((22) Invalid argument) 2023-10-06T02:27:21.889 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:21.888+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:27:21.889 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:21.888+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:27:21.894 INFO:tasks.ceph.mds.a.smithi006.stderr: -27> 2023-10-06T02:27:21.888+0000 7f61d1db7700 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -22 ((22) Invalid argument) 2023-10-06T02:27:21.902 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:21.917 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:27:22.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.021+0000 7f59e0318700 1 Processor -- start 2023-10-06T02:27:22.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.021+0000 7f59e0318700 1 -- start start 2023-10-06T02:27:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.022+0000 7f59e0318700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d815ca10 0x7f59d8069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.022+0000 7f59e0318700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f59d8067d10 0x7f59d806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.022+0000 7f59e0318700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d80b1ed0 con 0x7f59d815cde0 2023-10-06T02:27:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.022+0000 7f59e0318700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d80879c0 con 0x7f59d8067d10 2023-10-06T02:27:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.022+0000 7f59e0318700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80cec50 con 0x7f59d815ca10 2023-10-06T02:27:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.023+0000 7f59de0b4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d815ca10 0x7f59d8069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.023+0000 7f59dd8b3700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f59d8067d10 0x7f59d806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.023+0000 7f59de8b5700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f59d815cde0 0x7f59d80aeb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:42746/0 (socket says 172.21.15.6:42746) 2023-10-06T02:27:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.023+0000 7f59de8b5700 1 -- 172.21.15.6:0/3483962386 learned_addr learned my addr 172.21.15.6:0/3483962386 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.023+0000 7f59de0b4700 1 -- 172.21.15.6:0/3483962386 >> v2:172.21.15.175:3300/0 conn(0x7f59d8067d10 msgr2=0x7f59d806a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:22.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.023+0000 7f59de0b4700 1 --2- 172.21.15.6:0/3483962386 >> v2:172.21.15.175:3300/0 conn(0x7f59d8067d10 0x7f59d806a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.023+0000 7f59de0b4700 1 -- 172.21.15.6:0/3483962386 >> v1:172.21.15.175:6789/0 conn(0x7f59d815cde0 legacy=0x7f59d80aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:22.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.023+0000 7f59de0b4700 1 -- 172.21.15.6:0/3483962386 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d80cef30 con 0x7f59d815ca10 2023-10-06T02:27:22.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.023+0000 7f59dd8b3700 1 --2- 172.21.15.6:0/3483962386 >> v2:172.21.15.175:3300/0 conn(0x7f59d8067d10 0x7f59d806a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:22.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.023+0000 7f59de0b4700 1 --2- 172.21.15.6:0/3483962386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d815ca10 0x7f59d8069f70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f59d00098d0 tx=0x7f59d0009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8604cd78328a21b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:22.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.023+0000 7f59dd0b2700 1 -- 172.21.15.6:0/3483962386 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d0005c10 con 0x7f59d815ca10 2023-10-06T02:27:22.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.023+0000 7f59dd0b2700 1 -- 172.21.15.6:0/3483962386 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d0005d70 con 0x7f59d815ca10 2023-10-06T02:27:22.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.023+0000 7f59dd0b2700 1 -- 172.21.15.6:0/3483962386 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d0006280 con 0x7f59d815ca10 2023-10-06T02:27:22.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.024+0000 7f59e0318700 1 -- 172.21.15.6:0/3483962386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d815ca10 msgr2=0x7f59d8069f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:22.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.024+0000 7f59e0318700 1 --2- 172.21.15.6:0/3483962386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d815ca10 0x7f59d8069f70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f59d00098d0 tx=0x7f59d0009120 comp rx=0 tx=0).stop 2023-10-06T02:27:22.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.024+0000 7f59e0318700 1 -- 172.21.15.6:0/3483962386 shutdown_connections 2023-10-06T02:27:22.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.024+0000 7f59e0318700 1 --2- 172.21.15.6:0/3483962386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d815ca10 0x7f59d8069f70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.024+0000 7f59e0318700 1 --2- 172.21.15.6:0/3483962386 >> v2:172.21.15.175:3300/0 conn(0x7f59d8067d10 0x7f59d806a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.024+0000 7f59e0318700 1 -- 172.21.15.6:0/3483962386 >> 172.21.15.6:0/3483962386 conn(0x7f59d8067910 msgr2=0x7f59d80ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:22.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.024+0000 7f59e0318700 1 -- 172.21.15.6:0/3483962386 shutdown_connections 2023-10-06T02:27:22.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.024+0000 7f59e0318700 1 -- 172.21.15.6:0/3483962386 wait complete. 2023-10-06T02:27:22.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.025+0000 7f59e0318700 1 Processor -- start 2023-10-06T02:27:22.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.025+0000 7f59e0318700 1 -- start start 2023-10-06T02:27:22.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59e0318700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d8067d10 0x7f59d80ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59e0318700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59d815ca10 0x7f59d80b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59e0318700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59d815cde0 0x7f59d814f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59e0318700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80aee10 con 0x7f59d815cde0 2023-10-06T02:27:22.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59e0318700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80af0f0 con 0x7f59d815ca10 2023-10-06T02:27:22.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59e0318700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80af3d0 con 0x7f59d8067d10 2023-10-06T02:27:22.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59de8b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59d815cde0 0x7f59d814f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59dd8b3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59d815ca10 0x7f59d80b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59de0b4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d8067d10 0x7f59d80ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59de8b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59d815cde0 0x7f59d814f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55642/0 (socket says 172.21.15.6:55642) 2023-10-06T02:27:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59de8b5700 1 -- 172.21.15.6:0/3506526194 learned_addr learned my addr 172.21.15.6:0/3506526194 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59de8b5700 1 -- 172.21.15.6:0/3506526194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d8067d10 msgr2=0x7f59d80ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59de8b5700 1 --2- 172.21.15.6:0/3506526194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d8067d10 0x7f59d80ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59de8b5700 1 -- 172.21.15.6:0/3506526194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59d815ca10 msgr2=0x7f59d80b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59de8b5700 1 --2- 172.21.15.6:0/3506526194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59d815ca10 0x7f59d80b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59de8b5700 1 -- 172.21.15.6:0/3506526194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59cc009420 con 0x7f59d815cde0 2023-10-06T02:27:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59de0b4700 1 --2- 172.21.15.6:0/3506526194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d8067d10 0x7f59d80ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59dd8b3700 1 --2- 172.21.15.6:0/3506526194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59d815ca10 0x7f59d80b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59de8b5700 1 --2- 172.21.15.6:0/3506526194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59d815cde0 0x7f59d814f290 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f59c800cbc0 tx=0x7f59c8001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59d67fc700 1 -- 172.21.15.6:0/3506526194 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c800a7a0 con 0x7f59d815cde0 2023-10-06T02:27:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.026+0000 7f59d67fc700 1 -- 172.21.15.6:0/3506526194 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c800a900 con 0x7f59d815cde0 2023-10-06T02:27:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.027+0000 7f59e0318700 1 -- 172.21.15.6:0/3506526194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d00093c0 con 0x7f59d815cde0 2023-10-06T02:27:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.027+0000 7f59d67fc700 1 -- 172.21.15.6:0/3506526194 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c800ac80 con 0x7f59d815cde0 2023-10-06T02:27:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.027+0000 7f59e0318700 1 -- 172.21.15.6:0/3506526194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d80aea00 con 0x7f59d815cde0 2023-10-06T02:27:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.028+0000 7f59e0318700 1 -- 172.21.15.6:0/3506526194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d80afbd0 con 0x7f59d815cde0 2023-10-06T02:27:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.028+0000 7f59d67fc700 1 -- 172.21.15.6:0/3506526194 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59c8007300 con 0x7f59d815cde0 2023-10-06T02:27:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.028+0000 7f59d67fc700 1 --2- 172.21.15.6:0/3506526194 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59c4066f30 0x7f59c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.028+0000 7f59d67fc700 1 -- 172.21.15.6:0/3506526194 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8270+0+0 (secure 0 0 0) 0x7f59c8085280 con 0x7f59d815cde0 2023-10-06T02:27:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.029+0000 7f59de0b4700 1 --2- 172.21.15.6:0/3506526194 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59c4066f30 0x7f59c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.029+0000 7f59de0b4700 1 --2- 172.21.15.6:0/3506526194 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59c4066f30 0x7f59c40693e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009160 tx=0x7f59d0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.033+0000 7f59d67fc700 1 -- 172.21.15.6:0/3506526194 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59d80afbd0 con 0x7f59d815cde0 2023-10-06T02:27:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.271+0000 7f59e0318700 1 -- 172.21.15.6:0/3506526194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59d80afbd0 con 0x7f59d815cde0 2023-10-06T02:27:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.271+0000 7f59d67fc700 1 -- 172.21.15.6:0/3506526194 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 227 v227) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f59d80afbd0 con 0x7f59d815cde0 2023-10-06T02:27:22.272 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:22.272 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":227,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":227,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:21.889394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.273+0000 7f59e0318700 1 -- 172.21.15.6:0/3506526194 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59c4066f30 msgr2=0x7f59c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.273+0000 7f59e0318700 1 --2- 172.21.15.6:0/3506526194 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59c4066f30 0x7f59c40693e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009160 tx=0x7f59d0016000 comp rx=0 tx=0).stop 2023-10-06T02:27:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.273+0000 7f59e0318700 1 -- 172.21.15.6:0/3506526194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59d815cde0 msgr2=0x7f59d814f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.273+0000 7f59e0318700 1 --2- 172.21.15.6:0/3506526194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59d815cde0 0x7f59d814f290 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f59c800cbc0 tx=0x7f59c8001990 comp rx=0 tx=0).stop 2023-10-06T02:27:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.273+0000 7f59e0318700 1 -- 172.21.15.6:0/3506526194 shutdown_connections 2023-10-06T02:27:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.273+0000 7f59e0318700 1 --2- 172.21.15.6:0/3506526194 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f59c4066f30 0x7f59c40693e0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.273+0000 7f59e0318700 1 --2- 172.21.15.6:0/3506526194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59d815cde0 0x7f59d814f290 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.273+0000 7f59e0318700 1 --2- 172.21.15.6:0/3506526194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59d8067d10 0x7f59d80ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.273+0000 7f59e0318700 1 --2- 172.21.15.6:0/3506526194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59d815ca10 0x7f59d80b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.273+0000 7f59e0318700 1 -- 172.21.15.6:0/3506526194 >> 172.21.15.6:0/3506526194 conn(0x7f59d8067910 msgr2=0x7f59d81524f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.273+0000 7f59e0318700 1 -- 172.21.15.6:0/3506526194 shutdown_connections 2023-10-06T02:27:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.273+0000 7f59e0318700 1 -- 172.21.15.6:0/3506526194 wait complete. 2023-10-06T02:27:22.276 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 227 2023-10-06T02:27:22.286 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:27:22.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:22.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.445+0000 7fcf2aff1700 1 Processor -- start 2023-10-06T02:27:22.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.445+0000 7fcf2aff1700 1 -- start start 2023-10-06T02:27:22.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.445+0000 7fcf2aff1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf2415cde0 0x7fcf241642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.445+0000 7fcf2aff1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf240b1ed0 con 0x7fcf24067d10 2023-10-06T02:27:22.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.445+0000 7fcf2aff1700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf240879c0 con 0x7fcf2415ca10 2023-10-06T02:27:22.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.445+0000 7fcf2aff1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf240cec50 con 0x7fcf2415cde0 2023-10-06T02:27:22.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.445+0000 7fcf23fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcf24067d10 0x7fcf2406a680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41262/0 (socket says 172.21.15.6:41262) 2023-10-06T02:27:22.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.445+0000 7fcf23fff700 1 -- 172.21.15.6:0/2077517179 learned_addr learned my addr 172.21.15.6:0/2077517179 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:22.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf2958e700 1 --2- 172.21.15.6:0/2077517179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf2415cde0 0x7fcf241642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf237fe700 1 -- 172.21.15.6:0/2077517179 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625904964 0 0) 0x7fcf240b1ed0 con 0x7fcf24067d10 2023-10-06T02:27:22.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf237fe700 1 -- 172.21.15.6:0/2077517179 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf10003570 con 0x7fcf24067d10 2023-10-06T02:27:22.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf237fe700 1 -- 172.21.15.6:0/2077517179 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789189776 0 0) 0x7fcf240879c0 con 0x7fcf2415ca10 2023-10-06T02:27:22.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf237fe700 1 -- 172.21.15.6:0/2077517179 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf240b1ed0 con 0x7fcf2415ca10 2023-10-06T02:27:22.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf237fe700 1 -- 172.21.15.6:0/2077517179 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2125849642 0 0) 0x7fcf10003570 con 0x7fcf24067d10 2023-10-06T02:27:22.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf237fe700 1 -- 172.21.15.6:0/2077517179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf2415cde0 msgr2=0x7fcf241642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:22.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf237fe700 1 --2- 172.21.15.6:0/2077517179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf2415cde0 0x7fcf241642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf237fe700 1 -- 172.21.15.6:0/2077517179 >> v1:172.21.15.175:6789/0 conn(0x7fcf2415ca10 legacy=0x7fcf24069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:22.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf237fe700 1 -- 172.21.15.6:0/2077517179 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf240cef30 con 0x7fcf24067d10 2023-10-06T02:27:22.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf237fe700 1 -- 172.21.15.6:0/2077517179 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fcf14001470 con 0x7fcf24067d10 2023-10-06T02:27:22.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf237fe700 1 -- 172.21.15.6:0/2077517179 >> v1:172.21.15.6:6789/0 conn(0x7fcf24067d10 legacy=0x7fcf2406a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:22.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf237fe700 1 --2- 172.21.15.6:0/2077517179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c20 0x7fcf10004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf237fe700 1 --2- 172.21.15.6:0/2077517179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf10004810 0x7fcf10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf237fe700 1 --2- 172.21.15.6:0/2077517179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf2415cde0 0x7fcf100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf237fe700 1 -- 172.21.15.6:0/2077517179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf240cec50 con 0x7fcf10003c20 2023-10-06T02:27:22.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf237fe700 1 -- 172.21.15.6:0/2077517179 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1000bb70 con 0x7fcf10004810 2023-10-06T02:27:22.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf237fe700 1 -- 172.21.15.6:0/2077517179 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1000bd30 con 0x7fcf2415cde0 2023-10-06T02:27:22.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf28d8d700 1 --2- 172.21.15.6:0/2077517179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c20 0x7fcf10004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf23fff700 1 --2- 172.21.15.6:0/2077517179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf10004810 0x7fcf10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.446+0000 7fcf2958e700 1 --2- 172.21.15.6:0/2077517179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf2415cde0 0x7fcf100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.447+0000 7fcf28d8d700 1 -- 172.21.15.6:0/2077517179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf2415cde0 msgr2=0x7fcf100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:22.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.447+0000 7fcf28d8d700 1 --2- 172.21.15.6:0/2077517179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf2415cde0 0x7fcf100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.447+0000 7fcf28d8d700 1 -- 172.21.15.6:0/2077517179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf10004810 msgr2=0x7fcf10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:22.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.447+0000 7fcf28d8d700 1 --2- 172.21.15.6:0/2077517179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf10004810 0x7fcf10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.447+0000 7fcf28d8d700 1 -- 172.21.15.6:0/2077517179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10003570 con 0x7fcf10003c20 2023-10-06T02:27:22.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.447+0000 7fcf28d8d700 1 --2- 172.21.15.6:0/2077517179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c20 0x7fcf10004010 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00c3c0 tx=0x7fcf1c001bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b66d13b08cb1068 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:22.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.447+0000 7fcf237fe700 1 -- 172.21.15.6:0/2077517179 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c001ee0 con 0x7fcf10003c20 2023-10-06T02:27:22.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.447+0000 7fcf237fe700 1 -- 172.21.15.6:0/2077517179 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c00ccb0 con 0x7fcf10003c20 2023-10-06T02:27:22.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.447+0000 7fcf237fe700 1 -- 172.21.15.6:0/2077517179 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c012650 con 0x7fcf10003c20 2023-10-06T02:27:22.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.447+0000 7fcf2aff1700 1 -- 172.21.15.6:0/2077517179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c20 msgr2=0x7fcf10004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:22.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.447+0000 7fcf2aff1700 1 --2- 172.21.15.6:0/2077517179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c20 0x7fcf10004010 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00c3c0 tx=0x7fcf1c001bd0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.447+0000 7fcf2958e700 1 -- 172.21.15.6:0/2077517179 reap_dead start 2023-10-06T02:27:22.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.447+0000 7fcf2aff1700 1 -- 172.21.15.6:0/2077517179 shutdown_connections 2023-10-06T02:27:22.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.447+0000 7fcf2aff1700 1 -- 172.21.15.6:0/2077517179 >> 172.21.15.6:0/2077517179 conn(0x7fcf24067910 msgr2=0x7fcf240ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:22.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.447+0000 7fcf2aff1700 1 -- 172.21.15.6:0/2077517179 shutdown_connections 2023-10-06T02:27:22.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.447+0000 7fcf2aff1700 1 -- 172.21.15.6:0/2077517179 wait complete. 2023-10-06T02:27:22.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.448+0000 7fcf2aff1700 1 Processor -- start 2023-10-06T02:27:22.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.449+0000 7fcf2aff1700 1 -- start start 2023-10-06T02:27:22.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.449+0000 7fcf2aff1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c20 0x7fcf24148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.449+0000 7fcf2aff1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf24098680 0x7fcf24098af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.449+0000 7fcf2aff1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf2409a6f0 0x7fcf2409ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.449+0000 7fcf2aff1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf24099030 con 0x7fcf10003c20 2023-10-06T02:27:22.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.449+0000 7fcf2aff1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2415e3a0 con 0x7fcf24098680 2023-10-06T02:27:22.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.449+0000 7fcf2aff1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2409bd00 con 0x7fcf2409a6f0 2023-10-06T02:27:22.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.449+0000 7fcf28d8d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c20 0x7fcf24148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.450+0000 7fcf28d8d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c20 0x7fcf24148510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55670/0 (socket says 172.21.15.6:55670) 2023-10-06T02:27:22.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.450+0000 7fcf28d8d700 1 -- 172.21.15.6:0/1772827229 learned_addr learned my addr 172.21.15.6:0/1772827229 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:22.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.450+0000 7fcf2958e700 1 --2- 172.21.15.6:0/1772827229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf2409a6f0 0x7fcf2409ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.450+0000 7fcf23fff700 1 --2- 172.21.15.6:0/1772827229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf24098680 0x7fcf24098af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.450+0000 7fcf28d8d700 1 -- 172.21.15.6:0/1772827229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf2409a6f0 msgr2=0x7fcf2409ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:22.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.450+0000 7fcf28d8d700 1 --2- 172.21.15.6:0/1772827229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf2409a6f0 0x7fcf2409ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.450+0000 7fcf28d8d700 1 -- 172.21.15.6:0/1772827229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf24098680 msgr2=0x7fcf24098af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:22.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.450+0000 7fcf28d8d700 1 --2- 172.21.15.6:0/1772827229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf24098680 0x7fcf24098af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.450+0000 7fcf28d8d700 1 -- 172.21.15.6:0/1772827229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2409b460 con 0x7fcf10003c20 2023-10-06T02:27:22.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.450+0000 7fcf23fff700 1 --2- 172.21.15.6:0/1772827229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf24098680 0x7fcf24098af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:22.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.450+0000 7fcf28d8d700 1 --2- 172.21.15.6:0/1772827229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c20 0x7fcf24148510 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000bb40 tx=0x7fcf1c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:22.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.450+0000 7fcf20ff9700 1 -- 172.21.15.6:0/1772827229 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c01e650 con 0x7fcf10003c20 2023-10-06T02:27:22.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.450+0000 7fcf20ff9700 1 -- 172.21.15.6:0/1772827229 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c01e7d0 con 0x7fcf10003c20 2023-10-06T02:27:22.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.450+0000 7fcf20ff9700 1 -- 172.21.15.6:0/1772827229 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c01e980 con 0x7fcf10003c20 2023-10-06T02:27:22.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.450+0000 7fcf2aff1700 1 -- 172.21.15.6:0/1772827229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2409b740 con 0x7fcf10003c20 2023-10-06T02:27:22.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.450+0000 7fcf2aff1700 1 -- 172.21.15.6:0/1772827229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf24148a50 con 0x7fcf10003c20 2023-10-06T02:27:22.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.451+0000 7fcf2aff1700 1 -- 172.21.15.6:0/1772827229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2406e8d0 con 0x7fcf10003c20 2023-10-06T02:27:22.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.451+0000 7fcf20ff9700 1 -- 172.21.15.6:0/1772827229 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf1c025020 con 0x7fcf10003c20 2023-10-06T02:27:22.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.452+0000 7fcf20ff9700 1 --2- 172.21.15.6:0/1772827229 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf04066f30 0x7fcf040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.452+0000 7fcf20ff9700 1 -- 172.21.15.6:0/1772827229 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8270+0+0 (secure 0 0 0) 0x7fcf1c087650 con 0x7fcf10003c20 2023-10-06T02:27:22.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.452+0000 7fcf23fff700 1 --2- 172.21.15.6:0/1772827229 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf04066f30 0x7fcf040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.453+0000 7fcf23fff700 1 --2- 172.21.15.6:0/1772827229 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf04066f30 0x7fcf040693e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fcf14001c80 tx=0x7fcf14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:22.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.456+0000 7fcf20ff9700 1 -- 172.21.15.6:0/1772827229 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf1c053e80 con 0x7fcf10003c20 2023-10-06T02:27:22.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.695+0000 7fcf2aff1700 1 -- 172.21.15.6:0/1772827229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf240b1b60 con 0x7fcf10003c20 2023-10-06T02:27:22.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.695+0000 7fcf20ff9700 1 -- 172.21.15.6:0/1772827229 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 227 v227) v1 ==== 95+0+3840 (secure 0 0 0) 0x7fcf1c02d070 con 0x7fcf10003c20 2023-10-06T02:27:22.696 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:22.696 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":227,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":227,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:21.889394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:22.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.697+0000 7fcf2aff1700 1 -- 172.21.15.6:0/1772827229 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf04066f30 msgr2=0x7fcf040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:22.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.697+0000 7fcf2aff1700 1 --2- 172.21.15.6:0/1772827229 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf04066f30 0x7fcf040693e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fcf14001c80 tx=0x7fcf14009040 comp rx=0 tx=0).stop 2023-10-06T02:27:22.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.697+0000 7fcf2aff1700 1 -- 172.21.15.6:0/1772827229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c20 msgr2=0x7fcf24148510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:22.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.697+0000 7fcf2aff1700 1 --2- 172.21.15.6:0/1772827229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c20 0x7fcf24148510 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000bb40 tx=0x7fcf1c016000 comp rx=0 tx=0).stop 2023-10-06T02:27:22.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.697+0000 7fcf2aff1700 1 -- 172.21.15.6:0/1772827229 shutdown_connections 2023-10-06T02:27:22.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.697+0000 7fcf2aff1700 1 --2- 172.21.15.6:0/1772827229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf2409a6f0 0x7fcf2409ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.697+0000 7fcf2aff1700 1 --2- 172.21.15.6:0/1772827229 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf04066f30 0x7fcf040693e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.697+0000 7fcf2aff1700 1 --2- 172.21.15.6:0/1772827229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10003c20 0x7fcf24148510 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.697+0000 7fcf2aff1700 1 --2- 172.21.15.6:0/1772827229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf24098680 0x7fcf24098af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.697+0000 7fcf2aff1700 1 -- 172.21.15.6:0/1772827229 >> 172.21.15.6:0/1772827229 conn(0x7fcf24067910 msgr2=0x7fcf240a84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:22.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.697+0000 7fcf2aff1700 1 -- 172.21.15.6:0/1772827229 shutdown_connections 2023-10-06T02:27:22.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.697+0000 7fcf2aff1700 1 -- 172.21.15.6:0/1772827229 wait complete. 2023-10-06T02:27:22.699 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 227 2023-10-06T02:27:22.710 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:27:22.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:22.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.828+0000 7f43b759e700 1 Processor -- start 2023-10-06T02:27:22.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.828+0000 7f43b759e700 1 -- start start 2023-10-06T02:27:22.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.829+0000 7f43b759e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f43b8159400 0x7f43b80ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.829+0000 7f43b759e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43b80cd030 0x7f43b80cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.829+0000 7f43b759e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b80b3560 con 0x7f43b80cf1a0 2023-10-06T02:27:22.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.829+0000 7f43b759e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b80cf6f0 con 0x7f43b80cd030 2023-10-06T02:27:22.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.829+0000 7f43b759e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b80cf9d0 con 0x7f43b8159400 2023-10-06T02:27:22.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.829+0000 7f43b5d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43b80cd030 0x7f43b80cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.829+0000 7f43b5d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43b80cd030 0x7f43b80cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55678/0 (socket says 172.21.15.6:55678) 2023-10-06T02:27:22.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.829+0000 7f43b5d9b700 1 -- 172.21.15.6:0/205600926 learned_addr learned my addr 172.21.15.6:0/205600926 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:22.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.829+0000 7f43b659c700 1 --2- 172.21.15.6:0/205600926 >> v2:172.21.15.175:3300/0 conn(0x7f43b8159400 0x7f43b80ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.829+0000 7f43b5d9b700 1 -- 172.21.15.6:0/205600926 >> v2:172.21.15.175:3300/0 conn(0x7f43b8159400 msgr2=0x7f43b80ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:22.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.829+0000 7f43b5d9b700 1 --2- 172.21.15.6:0/205600926 >> v2:172.21.15.175:3300/0 conn(0x7f43b8159400 0x7f43b80ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.829+0000 7f43b5d9b700 1 -- 172.21.15.6:0/205600926 >> v1:172.21.15.175:6789/0 conn(0x7f43b80cf1a0 legacy=0x7f43b80b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:22.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.829+0000 7f43b5d9b700 1 -- 172.21.15.6:0/205600926 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b80b2f10 con 0x7f43b80cd030 2023-10-06T02:27:22.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.830+0000 7f43b5d9b700 1 --2- 172.21.15.6:0/205600926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b80cd030 0x7f43b80cfec0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f43b8067fc0 tx=0x7f43a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468f14421cbaf00d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:22.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.830+0000 7f43b559a700 1 -- 172.21.15.6:0/205600926 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a0009e70 con 0x7f43b80cd030 2023-10-06T02:27:22.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.830+0000 7f43b559a700 1 -- 172.21.15.6:0/205600926 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a000b860 con 0x7f43b80cd030 2023-10-06T02:27:22.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.830+0000 7f43b559a700 1 -- 172.21.15.6:0/205600926 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a000bc00 con 0x7f43b80cd030 2023-10-06T02:27:22.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.830+0000 7f43b759e700 1 -- 172.21.15.6:0/205600926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b80cd030 msgr2=0x7f43b80cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:22.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.830+0000 7f43b759e700 1 --2- 172.21.15.6:0/205600926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b80cd030 0x7f43b80cfec0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f43b8067fc0 tx=0x7f43a0009250 comp rx=0 tx=0).stop 2023-10-06T02:27:22.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.830+0000 7f43b759e700 1 -- 172.21.15.6:0/205600926 shutdown_connections 2023-10-06T02:27:22.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.830+0000 7f43b759e700 1 --2- 172.21.15.6:0/205600926 >> v2:172.21.15.175:3300/0 conn(0x7f43b8159400 0x7f43b80ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.830+0000 7f43b759e700 1 --2- 172.21.15.6:0/205600926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b80cd030 0x7f43b80cfec0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.830+0000 7f43b759e700 1 -- 172.21.15.6:0/205600926 >> 172.21.15.6:0/205600926 conn(0x7f43b806ac10 msgr2=0x7f43b8068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:22.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.830+0000 7f43b759e700 1 -- 172.21.15.6:0/205600926 shutdown_connections 2023-10-06T02:27:22.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.830+0000 7f43b759e700 1 -- 172.21.15.6:0/205600926 wait complete. 2023-10-06T02:27:22.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.831+0000 7f43b759e700 1 Processor -- start 2023-10-06T02:27:22.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.832+0000 7f43b759e700 1 -- start start 2023-10-06T02:27:22.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.832+0000 7f43b759e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43b80cd030 0x7f43b80a7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.832+0000 7f43b759e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43b80cf1a0 0x7f43b80c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.832+0000 7f43b759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b8159400 0x7f43b80ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.832+0000 7f43b759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80a7dd0 con 0x7f43b8159400 2023-10-06T02:27:22.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.832+0000 7f43b759e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80ca040 con 0x7f43b80cf1a0 2023-10-06T02:27:22.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.832+0000 7f43b759e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80cb9a0 con 0x7f43b80cd030 2023-10-06T02:27:22.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.832+0000 7f43b6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b8159400 0x7f43b80ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.832+0000 7f43b6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b8159400 0x7f43b80ca6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55680/0 (socket says 172.21.15.6:55680) 2023-10-06T02:27:22.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.832+0000 7f43b6d9d700 1 -- 172.21.15.6:0/907562113 learned_addr learned my addr 172.21.15.6:0/907562113 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:22.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.833+0000 7f43b659c700 1 --2- 172.21.15.6:0/907562113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43b80cd030 0x7f43b80a7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.833+0000 7f43b5d9b700 1 --2- 172.21.15.6:0/907562113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43b80cf1a0 0x7f43b80c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.833+0000 7f43b6d9d700 1 -- 172.21.15.6:0/907562113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43b80cd030 msgr2=0x7f43b80a7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:22.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.833+0000 7f43b6d9d700 1 --2- 172.21.15.6:0/907562113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43b80cd030 0x7f43b80a7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.833+0000 7f43b6d9d700 1 -- 172.21.15.6:0/907562113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43b80cf1a0 msgr2=0x7f43b80c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.833+0000 7f43b6d9d700 1 --2- 172.21.15.6:0/907562113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43b80cf1a0 0x7f43b80c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.833+0000 7f43b6d9d700 1 -- 172.21.15.6:0/907562113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a00094f0 con 0x7f43b8159400 2023-10-06T02:27:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.833+0000 7f43b5d9b700 1 --2- 172.21.15.6:0/907562113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43b80cf1a0 0x7f43b80c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.833+0000 7f43b6d9d700 1 --2- 172.21.15.6:0/907562113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b8159400 0x7f43b80ca6e0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f43a800c8e0 tx=0x7f43a8001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.833+0000 7f43ae7fc700 1 -- 172.21.15.6:0/907562113 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a800ce80 con 0x7f43b8159400 2023-10-06T02:27:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.833+0000 7f43ae7fc700 1 -- 172.21.15.6:0/907562113 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a800a7e0 con 0x7f43b8159400 2023-10-06T02:27:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.833+0000 7f43b759e700 1 -- 172.21.15.6:0/907562113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b80ca270 con 0x7f43b8159400 2023-10-06T02:27:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.833+0000 7f43ae7fc700 1 -- 172.21.15.6:0/907562113 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a800ab80 con 0x7f43b8159400 2023-10-06T02:27:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.833+0000 7f43b759e700 1 -- 172.21.15.6:0/907562113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b80cb350 con 0x7f43b8159400 2023-10-06T02:27:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.834+0000 7f43b759e700 1 -- 172.21.15.6:0/907562113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b80cbd30 con 0x7f43b8159400 2023-10-06T02:27:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.834+0000 7f43ae7fc700 1 -- 172.21.15.6:0/907562113 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43a8012420 con 0x7f43b8159400 2023-10-06T02:27:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.835+0000 7f43ae7fc700 1 --2- 172.21.15.6:0/907562113 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4398066f30 0x7f43980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:22.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.835+0000 7f43ae7fc700 1 -- 172.21.15.6:0/907562113 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8270+0+0 (secure 0 0 0) 0x7f43a80852b0 con 0x7f43b8159400 2023-10-06T02:27:22.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.835+0000 7f43b659c700 1 --2- 172.21.15.6:0/907562113 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4398066f30 0x7f43980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:22.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.836+0000 7f43b659c700 1 --2- 172.21.15.6:0/907562113 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4398066f30 0x7f43980693e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f43b80af440 tx=0x7f43b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:22.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:22.839+0000 7f43ae7fc700 1 -- 172.21.15.6:0/907562113 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43a8051ae0 con 0x7f43b8159400 2023-10-06T02:27:23.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.082+0000 7f43b759e700 1 -- 172.21.15.6:0/907562113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43b80b3280 con 0x7f43b8159400 2023-10-06T02:27:23.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.082+0000 7f43ae7fc700 1 -- 172.21.15.6:0/907562113 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 228 v228) v1 ==== 95+0+4592 (secure 0 0 0) 0x7f43a8055100 con 0x7f43b8159400 2023-10-06T02:27:23.083 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:23.083 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":228,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9366,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/829468452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":829468452},{"type":"v1","addr":"172.21.15.6:6835","nonce":829468452}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":228}],"filesystems":[{"mdsmap":{"epoch":227,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:21.889394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:23.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.085+0000 7f43b759e700 1 -- 172.21.15.6:0/907562113 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4398066f30 msgr2=0x7f43980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:23.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.085+0000 7f43b759e700 1 --2- 172.21.15.6:0/907562113 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4398066f30 0x7f43980693e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f43b80af440 tx=0x7f43b0008040 comp rx=0 tx=0).stop 2023-10-06T02:27:23.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.085+0000 7f43b759e700 1 -- 172.21.15.6:0/907562113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b8159400 msgr2=0x7f43b80ca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:23.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.085+0000 7f43b759e700 1 --2- 172.21.15.6:0/907562113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b8159400 0x7f43b80ca6e0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f43a800c8e0 tx=0x7f43a8001710 comp rx=0 tx=0).stop 2023-10-06T02:27:23.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.085+0000 7f43b759e700 1 -- 172.21.15.6:0/907562113 shutdown_connections 2023-10-06T02:27:23.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.085+0000 7f43b759e700 1 --2- 172.21.15.6:0/907562113 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4398066f30 0x7f43980693e0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:23.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.085+0000 7f43b759e700 1 --2- 172.21.15.6:0/907562113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b8159400 0x7f43b80ca6e0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:23.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.085+0000 7f43b759e700 1 --2- 172.21.15.6:0/907562113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43b80cd030 0x7f43b80a7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:23.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.085+0000 7f43b759e700 1 --2- 172.21.15.6:0/907562113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43b80cf1a0 0x7f43b80c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:23.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.085+0000 7f43b759e700 1 -- 172.21.15.6:0/907562113 >> 172.21.15.6:0/907562113 conn(0x7f43b806ac10 msgr2=0x7f43b8157bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:23.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.085+0000 7f43b759e700 1 -- 172.21.15.6:0/907562113 shutdown_connections 2023-10-06T02:27:23.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.085+0000 7f43b759e700 1 -- 172.21.15.6:0/907562113 wait complete. 2023-10-06T02:27:23.087 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 228 2023-10-06T02:27:23.097 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt 400.00000000' led to DAMAGED state 2023-10-06T02:27:23.097 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt 100.00000000.inode' 2023-10-06T02:27:23.097 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:23.098 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:27:23.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:23.098 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:27:23.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:27:23.113 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:27:23.114 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:27:23.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.272+0000 7fbdd0095700 1 Processor -- start 2023-10-06T02:27:23.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.273+0000 7fbdd0095700 1 -- start start 2023-10-06T02:27:23.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.273+0000 7fbdd0095700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc80af7c0 0x7fbdc815d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:23.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.273+0000 7fbdd0095700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbdc8159960 0x7fbdc815d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:23.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.273+0000 7fbdd0095700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc815a170 con 0x7fbdc80af3f0 2023-10-06T02:27:23.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.273+0000 7fbdd0095700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc80caeb0 con 0x7fbdc8159960 2023-10-06T02:27:23.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.273+0000 7fbdd0095700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc815db80 con 0x7fbdc80af7c0 2023-10-06T02:27:23.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.274+0000 7fbdce632700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbdc8159960 0x7fbdc815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:23.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.274+0000 7fbdcd630700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc80af7c0 0x7fbdc815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:23.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.274+0000 7fbdcde31700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fbdc80af3f0 0x7fbdc815a600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:42774/0 (socket says 172.21.15.6:42774) 2023-10-06T02:27:23.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.274+0000 7fbdce632700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbdc8159960 0x7fbdc815d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:39804/0 (socket says 172.21.15.6:39804) 2023-10-06T02:27:23.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.274+0000 7fbdcd630700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc80af7c0 0x7fbdc815d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:36964/0 (socket says 172.21.15.6:36964) 2023-10-06T02:27:23.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.274+0000 7fbdcde31700 1 -- 172.21.15.6:0/2283136637 learned_addr learned my addr 172.21.15.6:0/2283136637 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:23.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.274+0000 7fbdcd630700 1 -- 172.21.15.6:0/2283136637 >> v2:172.21.15.175:3300/0 conn(0x7fbdc8159960 msgr2=0x7fbdc815d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:23.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.274+0000 7fbdcd630700 1 --2- 172.21.15.6:0/2283136637 >> v2:172.21.15.175:3300/0 conn(0x7fbdc8159960 0x7fbdc815d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:23.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.274+0000 7fbdcd630700 1 -- 172.21.15.6:0/2283136637 >> v1:172.21.15.175:6789/0 conn(0x7fbdc80af3f0 legacy=0x7fbdc815a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:23.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.274+0000 7fbdcd630700 1 -- 172.21.15.6:0/2283136637 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc815de60 con 0x7fbdc80af7c0 2023-10-06T02:27:23.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.274+0000 7fbdcce2f700 1 -- 172.21.15.6:0/2283136637 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707976447 0 0) 0x7fbdc815a170 con 0x7fbdc80af3f0 2023-10-06T02:27:23.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.274+0000 7fbdce632700 1 --2- 172.21.15.6:0/2283136637 >> v2:172.21.15.175:3300/0 conn(0x7fbdc8159960 0x7fbdc815d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:23.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.274+0000 7fbdcd630700 1 --2- 172.21.15.6:0/2283136637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc80af7c0 0x7fbdc815d030 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0098e0 tx=0x7fbdbc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a965f913a5f1b516 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:23.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.275+0000 7fbdcce2f700 1 -- 172.21.15.6:0/2283136637 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc00b640 con 0x7fbdc80af7c0 2023-10-06T02:27:23.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.275+0000 7fbdcce2f700 1 -- 172.21.15.6:0/2283136637 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc00b7a0 con 0x7fbdc80af7c0 2023-10-06T02:27:23.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.275+0000 7fbdcce2f700 1 -- 172.21.15.6:0/2283136637 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc00bb40 con 0x7fbdc80af7c0 2023-10-06T02:27:23.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.275+0000 7fbdd0095700 1 -- 172.21.15.6:0/2283136637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc80af7c0 msgr2=0x7fbdc815d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:23.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.275+0000 7fbdd0095700 1 --2- 172.21.15.6:0/2283136637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc80af7c0 0x7fbdc815d030 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0098e0 tx=0x7fbdbc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:23.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.275+0000 7fbdd0095700 1 -- 172.21.15.6:0/2283136637 shutdown_connections 2023-10-06T02:27:23.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.275+0000 7fbdd0095700 1 --2- 172.21.15.6:0/2283136637 >> v2:172.21.15.175:3300/0 conn(0x7fbdc8159960 0x7fbdc815d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.275+0000 7fbdd0095700 1 --2- 172.21.15.6:0/2283136637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc80af7c0 0x7fbdc815d030 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.275+0000 7fbdd0095700 1 -- 172.21.15.6:0/2283136637 >> 172.21.15.6:0/2283136637 conn(0x7fbdc806a260 msgr2=0x7fbdc80cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.275+0000 7fbdd0095700 1 -- 172.21.15.6:0/2283136637 shutdown_connections 2023-10-06T02:27:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.275+0000 7fbdd0095700 1 -- 172.21.15.6:0/2283136637 wait complete. 2023-10-06T02:27:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.276+0000 7fbdd0095700 1 Processor -- start 2023-10-06T02:27:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.276+0000 7fbdd0095700 1 -- start start 2023-10-06T02:27:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.277+0000 7fbdd0095700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdc80af3f0 0x7fbdc816af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.277+0000 7fbdd0095700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc8159960 0x7fbdc816d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.277+0000 7fbdd0095700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc816d890 0x7fbdc80c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.277+0000 7fbdd0095700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc816dd10 con 0x7fbdc816d890 2023-10-06T02:27:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.277+0000 7fbdd0095700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc80c7430 con 0x7fbdc80af3f0 2023-10-06T02:27:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.277+0000 7fbdd0095700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc80c7150 con 0x7fbdc8159960 2023-10-06T02:27:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.277+0000 7fbdce632700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc816d890 0x7fbdc80c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.277+0000 7fbdce632700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc816d890 0x7fbdc80c63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55688/0 (socket says 172.21.15.6:55688) 2023-10-06T02:27:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.277+0000 7fbdce632700 1 -- 172.21.15.6:0/1865220567 learned_addr learned my addr 172.21.15.6:0/1865220567 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.277+0000 7fbdcd630700 1 --2- 172.21.15.6:0/1865220567 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc8159960 0x7fbdc816d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.277+0000 7fbdcde31700 1 --2- 172.21.15.6:0/1865220567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdc80af3f0 0x7fbdc816af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.278+0000 7fbdce632700 1 -- 172.21.15.6:0/1865220567 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc8159960 msgr2=0x7fbdc816d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.278+0000 7fbdce632700 1 --2- 172.21.15.6:0/1865220567 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc8159960 0x7fbdc816d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.278+0000 7fbdce632700 1 -- 172.21.15.6:0/1865220567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdc80af3f0 msgr2=0x7fbdc816af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.278+0000 7fbdce632700 1 --2- 172.21.15.6:0/1865220567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdc80af3f0 0x7fbdc816af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.278+0000 7fbdce632700 1 -- 172.21.15.6:0/1865220567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb8009420 con 0x7fbdc816d890 2023-10-06T02:27:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.278+0000 7fbdcde31700 1 --2- 172.21.15.6:0/1865220567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdc80af3f0 0x7fbdc816af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.278+0000 7fbdce632700 1 --2- 172.21.15.6:0/1865220567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc816d890 0x7fbdc80c63f0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800ea80 tx=0x7fbdb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.278+0000 7fbdc5ffb700 1 -- 172.21.15.6:0/1865220567 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb800c850 con 0x7fbdc816d890 2023-10-06T02:27:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.278+0000 7fbdc5ffb700 1 -- 172.21.15.6:0/1865220567 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb800c9d0 con 0x7fbdc816d890 2023-10-06T02:27:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.278+0000 7fbdd0095700 1 -- 172.21.15.6:0/1865220567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdbc009420 con 0x7fbdc816d890 2023-10-06T02:27:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.278+0000 7fbdc5ffb700 1 -- 172.21.15.6:0/1865220567 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb800cd90 con 0x7fbdc816d890 2023-10-06T02:27:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.278+0000 7fbdd0095700 1 -- 172.21.15.6:0/1865220567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc815b340 con 0x7fbdc816d890 2023-10-06T02:27:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.279+0000 7fbdd0095700 1 -- 172.21.15.6:0/1865220567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc806e700 con 0x7fbdc816d890 2023-10-06T02:27:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.279+0000 7fbdc5ffb700 1 -- 172.21.15.6:0/1865220567 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbdb8013680 con 0x7fbdc816d890 2023-10-06T02:27:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.280+0000 7fbdc5ffb700 1 --2- 172.21.15.6:0/1865220567 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbdb4066f30 0x7fbdb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.280+0000 7fbdc5ffb700 1 -- 172.21.15.6:0/1865220567 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8270+0+0 (secure 0 0 0) 0x7fbdb8085500 con 0x7fbdc816d890 2023-10-06T02:27:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.280+0000 7fbdcde31700 1 --2- 172.21.15.6:0/1865220567 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbdb4066f30 0x7fbdb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.281+0000 7fbdcde31700 1 --2- 172.21.15.6:0/1865220567 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbdb4066f30 0x7fbdb40693e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fbdc81468d0 tx=0x7fbdc0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:23.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.284+0000 7fbdc5ffb700 1 -- 172.21.15.6:0/1865220567 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbdb8051d30 con 0x7fbdc816d890 2023-10-06T02:27:23.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.525+0000 7fbdd0095700 1 -- 172.21.15.6:0/1865220567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbdc80b25a0 con 0x7fbdc816d890 2023-10-06T02:27:23.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.902+0000 7fbdc5ffb700 1 -- 172.21.15.6:0/1865220567 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v229) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbdb8017090 con 0x7fbdc816d890 2023-10-06T02:27:23.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.904+0000 7fbdd0095700 1 -- 172.21.15.6:0/1865220567 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbdb4066f30 msgr2=0x7fbdb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:23.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.904+0000 7fbdd0095700 1 --2- 172.21.15.6:0/1865220567 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbdb4066f30 0x7fbdb40693e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fbdc81468d0 tx=0x7fbdc0009040 comp rx=0 tx=0).stop 2023-10-06T02:27:23.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.904+0000 7fbdd0095700 1 -- 172.21.15.6:0/1865220567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc816d890 msgr2=0x7fbdc80c63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:23.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.904+0000 7fbdd0095700 1 --2- 172.21.15.6:0/1865220567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc816d890 0x7fbdc80c63f0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800ea80 tx=0x7fbdb80091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:23.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.904+0000 7fbdd0095700 1 -- 172.21.15.6:0/1865220567 shutdown_connections 2023-10-06T02:27:23.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.904+0000 7fbdd0095700 1 --2- 172.21.15.6:0/1865220567 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbdb4066f30 0x7fbdb40693e0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:23.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.904+0000 7fbdd0095700 1 --2- 172.21.15.6:0/1865220567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc816d890 0x7fbdc80c63f0 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:23.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.904+0000 7fbdd0095700 1 --2- 172.21.15.6:0/1865220567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdc80af3f0 0x7fbdc816af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:23.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.904+0000 7fbdd0095700 1 --2- 172.21.15.6:0/1865220567 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdc8159960 0x7fbdc816d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:23.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.904+0000 7fbdd0095700 1 -- 172.21.15.6:0/1865220567 >> 172.21.15.6:0/1865220567 conn(0x7fbdc806a260 msgr2=0x7fbdc80c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:23.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.904+0000 7fbdd0095700 1 -- 172.21.15.6:0/1865220567 shutdown_connections 2023-10-06T02:27:23.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:23.905+0000 7fbdd0095700 1 -- 172.21.15.6:0/1865220567 wait complete. 2023-10-06T02:27:23.907 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:27:23.918 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:27:24.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.037+0000 7f6ddcf6b700 1 Processor -- start 2023-10-06T02:27:24.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.037+0000 7f6ddcf6b700 1 -- start start 2023-10-06T02:27:24.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.038+0000 7f6ddcf6b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6dd80d07d0 0x7f6dd80b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:24.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.038+0000 7f6ddcf6b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd815dd40 con 0x7f6dd80d0400 2023-10-06T02:27:24.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.038+0000 7f6ddcf6b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd815e020 con 0x7f6dd80ccd40 2023-10-06T02:27:24.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.038+0000 7f6ddcf6b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd80ceaa0 con 0x7f6dd80d07d0 2023-10-06T02:27:24.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.038+0000 7f6dd6d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6dd80d07d0 0x7f6dd80b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:24.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.038+0000 7f6dd659c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6dd80d0400 0x7f6dd80b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41272/0 (socket says 172.21.15.6:41272) 2023-10-06T02:27:24.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.038+0000 7f6dd6d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6dd80d07d0 0x7f6dd80b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55702/0 (socket says 172.21.15.6:55702) 2023-10-06T02:27:24.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.038+0000 7f6dd659c700 1 -- 172.21.15.6:0/2921488889 learned_addr learned my addr 172.21.15.6:0/2921488889 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:24.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.039+0000 7f6dd6d9d700 1 -- 172.21.15.6:0/2921488889 >> v1:172.21.15.175:6789/0 conn(0x7f6dd80ccd40 legacy=0x7f6dd80cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:24.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.039+0000 7f6dd6d9d700 1 -- 172.21.15.6:0/2921488889 >> v1:172.21.15.6:6789/0 conn(0x7f6dd80d0400 legacy=0x7f6dd80b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:24.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.039+0000 7f6dd559a700 1 -- 172.21.15.6:0/2921488889 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195507024 0 0) 0x7f6dd815dd40 con 0x7f6dd80d0400 2023-10-06T02:27:24.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.039+0000 7f6dd6d9d700 1 -- 172.21.15.6:0/2921488889 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd80ced80 con 0x7f6dd80d07d0 2023-10-06T02:27:24.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.039+0000 7f6dd6d9d700 1 --2- 172.21.15.6:0/2921488889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dd80d07d0 0x7f6dd80b3aa0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80098e0 tx=0x7f6dc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e8a309d6adf876 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:24.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.039+0000 7f6dd559a700 1 -- 172.21.15.6:0/2921488889 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8009e80 con 0x7f6dd80d07d0 2023-10-06T02:27:24.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.039+0000 7f6dd559a700 1 -- 172.21.15.6:0/2921488889 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc800b860 con 0x7f6dd80d07d0 2023-10-06T02:27:24.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.039+0000 7f6dd559a700 1 -- 172.21.15.6:0/2921488889 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800bbe0 con 0x7f6dd80d07d0 2023-10-06T02:27:24.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.039+0000 7f6ddcf6b700 1 -- 172.21.15.6:0/2921488889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dd80d07d0 msgr2=0x7f6dd80b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:24.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.039+0000 7f6ddcf6b700 1 --2- 172.21.15.6:0/2921488889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dd80d07d0 0x7f6dd80b3aa0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80098e0 tx=0x7f6dc80091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:24.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.040+0000 7f6ddcf6b700 1 -- 172.21.15.6:0/2921488889 shutdown_connections 2023-10-06T02:27:24.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.040+0000 7f6ddcf6b700 1 --2- 172.21.15.6:0/2921488889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dd80d07d0 0x7f6dd80b3aa0 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:24.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.040+0000 7f6ddcf6b700 1 -- 172.21.15.6:0/2921488889 >> 172.21.15.6:0/2921488889 conn(0x7f6dd806a220 msgr2=0x7f6dd806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:24.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.040+0000 7f6ddcf6b700 1 -- 172.21.15.6:0/2921488889 shutdown_connections 2023-10-06T02:27:24.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.040+0000 7f6ddcf6b700 1 -- 172.21.15.6:0/2921488889 wait complete. 2023-10-06T02:27:24.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.041+0000 7f6ddcf6b700 1 Processor -- start 2023-10-06T02:27:24.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.041+0000 7f6ddcf6b700 1 -- start start 2023-10-06T02:27:24.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.041+0000 7f6ddcf6b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dd80ccd40 0x7f6dd816ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:24.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.041+0000 7f6ddcf6b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dd80d0400 0x7f6dd8157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:24.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.041+0000 7f6ddcf6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dd80d07d0 0x7f6dd81584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:24.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.041+0000 7f6ddcf6b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd8151850 con 0x7f6dd80d07d0 2023-10-06T02:27:24.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.041+0000 7f6ddcf6b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd8150c40 con 0x7f6dd80d0400 2023-10-06T02:27:24.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.041+0000 7f6ddcf6b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd8150f20 con 0x7f6dd80ccd40 2023-10-06T02:27:24.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.041+0000 7f6dd6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dd80d07d0 0x7f6dd81584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:24.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.041+0000 7f6dd6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dd80d07d0 0x7f6dd81584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55718/0 (socket says 172.21.15.6:55718) 2023-10-06T02:27:24.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.041+0000 7f6dd6d9d700 1 -- 172.21.15.6:0/1564275914 learned_addr learned my addr 172.21.15.6:0/1564275914 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:24.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.042+0000 7f6dd5d9b700 1 --2- 172.21.15.6:0/1564275914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dd80d0400 0x7f6dd8157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:24.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.042+0000 7f6dd659c700 1 --2- 172.21.15.6:0/1564275914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dd80ccd40 0x7f6dd816ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:24.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.042+0000 7f6dd6d9d700 1 -- 172.21.15.6:0/1564275914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dd80ccd40 msgr2=0x7f6dd816ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:24.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.042+0000 7f6dd6d9d700 1 --2- 172.21.15.6:0/1564275914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dd80ccd40 0x7f6dd816ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:24.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.042+0000 7f6dd6d9d700 1 -- 172.21.15.6:0/1564275914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dd80d0400 msgr2=0x7f6dd8157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:24.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.042+0000 7f6dd6d9d700 1 --2- 172.21.15.6:0/1564275914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dd80d0400 0x7f6dd8157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:24.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.042+0000 7f6dd6d9d700 1 -- 172.21.15.6:0/1564275914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc8009420 con 0x7f6dd80d07d0 2023-10-06T02:27:24.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.042+0000 7f6dd659c700 1 --2- 172.21.15.6:0/1564275914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dd80ccd40 0x7f6dd816ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:24.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.042+0000 7f6dd6d9d700 1 --2- 172.21.15.6:0/1564275914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dd80d07d0 0x7f6dd81584d0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80883f0 tx=0x7f6dc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.042+0000 7f6dce7fc700 1 -- 172.21.15.6:0/1564275914 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc801f070 con 0x7f6dd80d07d0 2023-10-06T02:27:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.042+0000 7f6dce7fc700 1 -- 172.21.15.6:0/1564275914 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc800baa0 con 0x7f6dd80d07d0 2023-10-06T02:27:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.042+0000 7f6ddcf6b700 1 -- 172.21.15.6:0/1564275914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd8151200 con 0x7f6dd80d07d0 2023-10-06T02:27:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.042+0000 7f6dce7fc700 1 -- 172.21.15.6:0/1564275914 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8025670 con 0x7f6dd80d07d0 2023-10-06T02:27:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.042+0000 7f6ddcf6b700 1 -- 172.21.15.6:0/1564275914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd814fee0 con 0x7f6dd80d07d0 2023-10-06T02:27:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.043+0000 7f6ddcf6b700 1 -- 172.21.15.6:0/1564275914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd8088760 con 0x7f6dd80d07d0 2023-10-06T02:27:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.043+0000 7f6dce7fc700 1 -- 172.21.15.6:0/1564275914 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6dc8023070 con 0x7f6dd80d07d0 2023-10-06T02:27:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.044+0000 7f6dce7fc700 1 --2- 172.21.15.6:0/1564275914 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6db8066f30 0x7f6db80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.044+0000 7f6dce7fc700 1 -- 172.21.15.6:0/1564275914 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8270+0+0 (secure 0 0 0) 0x7f6dc80866a0 con 0x7f6dd80d07d0 2023-10-06T02:27:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.044+0000 7f6dd659c700 1 --2- 172.21.15.6:0/1564275914 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6db8066f30 0x7f6db80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.045+0000 7f6dd659c700 1 --2- 172.21.15.6:0/1564275914 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6db8066f30 0x7f6db80693e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0007fd0 tx=0x7f6dd0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:24.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.048+0000 7f6dce7fc700 1 -- 172.21.15.6:0/1564275914 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6dc8052ed0 con 0x7f6dd80d07d0 2023-10-06T02:27:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.328+0000 7f6ddcf6b700 1 -- 172.21.15.6:0/1564275914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f6dd80ce6c0 con 0x7f6dd80d07d0 2023-10-06T02:27:24.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.907+0000 7f6dce7fc700 1 -- 172.21.15.6:0/1564275914 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v230) v1 ==== 101+0+0 (secure 0 0 0) 0x7f6dc8015090 con 0x7f6dd80d07d0 2023-10-06T02:27:24.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.909+0000 7f6ddcf6b700 1 -- 172.21.15.6:0/1564275914 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6db8066f30 msgr2=0x7f6db80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.909+0000 7f6ddcf6b700 1 --2- 172.21.15.6:0/1564275914 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6db8066f30 0x7f6db80693e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0007fd0 tx=0x7f6dd0009040 comp rx=0 tx=0).stop 2023-10-06T02:27:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.909+0000 7f6ddcf6b700 1 -- 172.21.15.6:0/1564275914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dd80d07d0 msgr2=0x7f6dd81584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.909+0000 7f6ddcf6b700 1 --2- 172.21.15.6:0/1564275914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dd80d07d0 0x7f6dd81584d0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80883f0 tx=0x7f6dc8017000 comp rx=0 tx=0).stop 2023-10-06T02:27:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.909+0000 7f6ddcf6b700 1 -- 172.21.15.6:0/1564275914 shutdown_connections 2023-10-06T02:27:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.909+0000 7f6ddcf6b700 1 --2- 172.21.15.6:0/1564275914 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6db8066f30 0x7f6db80693e0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.909+0000 7f6ddcf6b700 1 --2- 172.21.15.6:0/1564275914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dd80d07d0 0x7f6dd81584d0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.909+0000 7f6ddcf6b700 1 --2- 172.21.15.6:0/1564275914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dd80ccd40 0x7f6dd816ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.909+0000 7f6ddcf6b700 1 --2- 172.21.15.6:0/1564275914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dd80d0400 0x7f6dd8157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.909+0000 7f6ddcf6b700 1 -- 172.21.15.6:0/1564275914 >> 172.21.15.6:0/1564275914 conn(0x7f6dd806a220 msgr2=0x7f6dd80b5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.909+0000 7f6ddcf6b700 1 -- 172.21.15.6:0/1564275914 shutdown_connections 2023-10-06T02:27:24.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.909+0000 7f6ddcf6b700 1 -- 172.21.15.6:0/1564275914 wait complete. 2023-10-06T02:27:24.911 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:27:24.923 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:27:24.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.962+0000 7fede8502000 1 Processor -- start 2023-10-06T02:27:24.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.962+0000 7fede8502000 1 -- start start 2023-10-06T02:27:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7fede8502000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560760d7490 0x55607608ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7fede8502000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607614da80 0x5560760d3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7fede8502000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607614de50 0x5560760d4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7fede8502000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556075fd8980 con 0x55607614de50 2023-10-06T02:27:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7fede8502000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556075fd8620 con 0x5560760d7490 2023-10-06T02:27:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7fede8502000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x556075fcf400 con 0x55607614da80 2023-10-06T02:27:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7fede1f3e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607614de50 0x5560760d4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7fede1f3e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607614de50 0x5560760d4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55734/0 (socket says 172.21.15.6:55734) 2023-10-06T02:27:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7fede1f3e700 1 -- 172.21.15.6:0/1380778324 learned_addr learned my addr 172.21.15.6:0/1380778324 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7fede173d700 1 --2- 172.21.15.6:0/1380778324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560760d7490 0x55607608ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7feddbfff700 1 --2- 172.21.15.6:0/1380778324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607614da80 0x5560760d3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7fede1f3e700 1 -- 172.21.15.6:0/1380778324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607614da80 msgr2=0x5560760d3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7fede1f3e700 1 --2- 172.21.15.6:0/1380778324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607614da80 0x5560760d3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7fede1f3e700 1 -- 172.21.15.6:0/1380778324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560760d7490 msgr2=0x55607608ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7fede1f3e700 1 --2- 172.21.15.6:0/1380778324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560760d7490 0x55607608ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7fede1f3e700 1 -- 172.21.15.6:0/1380778324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd4005cf0 con 0x55607614de50 2023-10-06T02:27:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7fede1f3e700 1 --2- 172.21.15.6:0/1380778324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607614de50 0x5560760d4000 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7feddc006f40 tx=0x7feddc0069f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80cbe0858ed586bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7feddb7fe700 1 -- 172.21.15.6:0/1380778324 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc006110 con 0x55607614de50 2023-10-06T02:27:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7feddb7fe700 1 -- 172.21.15.6:0/1380778324 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc006270 con 0x55607614de50 2023-10-06T02:27:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.963+0000 7feddb7fe700 1 -- 172.21.15.6:0/1380778324 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc004730 con 0x55607614de50 2023-10-06T02:27:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.964+0000 7fede8502000 1 -- 172.21.15.6:0/1380778324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607614de50 msgr2=0x5560760d4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.964+0000 7fede8502000 1 --2- 172.21.15.6:0/1380778324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607614de50 0x5560760d4000 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7feddc006f40 tx=0x7feddc0069f0 comp rx=0 tx=0).stop 2023-10-06T02:27:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.964+0000 7fede8502000 1 -- 172.21.15.6:0/1380778324 shutdown_connections 2023-10-06T02:27:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.964+0000 7fede8502000 1 --2- 172.21.15.6:0/1380778324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607614de50 0x5560760d4000 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.964+0000 7fede8502000 1 --2- 172.21.15.6:0/1380778324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560760d7490 0x55607608ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.964+0000 7fede8502000 1 --2- 172.21.15.6:0/1380778324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607614da80 0x5560760d3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.964+0000 7fede8502000 1 -- 172.21.15.6:0/1380778324 >> 172.21.15.6:0/1380778324 conn(0x55607608e5d0 msgr2=0x55607608b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.964+0000 7fede8502000 1 -- 172.21.15.6:0/1380778324 shutdown_connections 2023-10-06T02:27:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.964+0000 7fede8502000 1 -- 172.21.15.6:0/1380778324 wait complete. 2023-10-06T02:27:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.964+0000 7fede8502000 1 Processor -- start 2023-10-06T02:27:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.965+0000 7fede8502000 1 -- start start 2023-10-06T02:27:24.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.965+0000 7fede8502000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560760d7490 0x55607614a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:24.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.965+0000 7fede8502000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607614da80 0x5560761637d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:24.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.965+0000 7fede8502000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607614de50 0x556076148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:24.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.965+0000 7fede8502000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607614adb0 con 0x5560760d7490 2023-10-06T02:27:24.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.965+0000 7fede8502000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607614b050 con 0x55607614da80 2023-10-06T02:27:24.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.965+0000 7fede8502000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55607614b2f0 con 0x55607614de50 2023-10-06T02:27:24.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.965+0000 7fede173d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560760d7490 0x55607614a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:24.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.965+0000 7fede173d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560760d7490 0x55607614a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55746/0 (socket says 172.21.15.6:55746) 2023-10-06T02:27:24.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.965+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 learned_addr learned my addr 172.21.15.6:0/159513884 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:24.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.965+0000 7feddbfff700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607614da80 0x5560761637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:24.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.965+0000 7fede1f3e700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607614de50 0x556076148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:24.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.966+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607614de50 msgr2=0x556076148560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:24.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.966+0000 7fede173d700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607614de50 0x556076148560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:24.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.966+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607614da80 msgr2=0x5560761637d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:24.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.966+0000 7fede173d700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607614da80 0x5560761637d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:24.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.966+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd0001e10 con 0x5560760d7490 2023-10-06T02:27:24.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.966+0000 7fede1f3e700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607614de50 0x556076148560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:24.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.966+0000 7fede173d700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560760d7490 0x55607614a400 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fedd4012000 tx=0x7fedd4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:24.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.966+0000 7fedd9ffb700 1 -- 172.21.15.6:0/159513884 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd4000bc0 con 0x5560760d7490 2023-10-06T02:27:24.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.966+0000 7fedd9ffb700 1 -- 172.21.15.6:0/159513884 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd4022070 con 0x5560760d7490 2023-10-06T02:27:24.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.966+0000 7fedd9ffb700 1 -- 172.21.15.6:0/159513884 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd4027430 con 0x5560760d7490 2023-10-06T02:27:24.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.966+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556075fe73d0 con 0x5560760d7490 2023-10-06T02:27:24.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.966+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556075fdaae0 con 0x5560760d7490 2023-10-06T02:27:24.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.967+0000 7fedd9ffb700 1 -- 172.21.15.6:0/159513884 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fedd4024030 con 0x5560760d7490 2023-10-06T02:27:24.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.968+0000 7fedd9ffb700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fedc40658c0 0x7fedc4067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:24.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.968+0000 7fedd9ffb700 1 -- 172.21.15.6:0/159513884 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8270+0+0 (secure 0 0 0) 0x7fedd4085fc0 con 0x5560760d7490 2023-10-06T02:27:24.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.968+0000 7feddbfff700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fedc40658c0 0x7fedc4067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:24.972 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:27:24.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.968+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5560761466c0 0x55607617fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:24.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.968+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076180300 con 0x5560761466c0 2023-10-06T02:27:24.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.968+0000 7fede1f3e700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5560761466c0 0x55607617fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:24.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.968+0000 7feddbfff700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fedc40658c0 0x7fedc4067d70 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009a60 tx=0x7fedcc005c80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:24.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.968+0000 7fede1f3e700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5560761466c0 0x55607617fdc0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:24.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.970+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v117'660 uv634 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.970+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761806b0 con 0x5560761466c0 2023-10-06T02:27:24.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.972+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v117'661 uv661 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.972+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076180a60 con 0x5560761466c0 2023-10-06T02:27:24.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.973+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v117'662 uv662 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.975 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:27:24.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.973+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076181e20 con 0x5560761466c0 2023-10-06T02:27:24.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.974+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v117'663 uv663 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.974+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761821d0 con 0x5560761466c0 2023-10-06T02:27:24.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.975+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v117'664 uv664 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.975+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076180e10 con 0x5560761466c0 2023-10-06T02:27:24.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.976+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v117'665 uv665 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.977+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076181210 con 0x5560761466c0 2023-10-06T02:27:24.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.978+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v117'666 uv640 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.978+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761815c0 con 0x5560761466c0 2023-10-06T02:27:24.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.979+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v117'667 uv667 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.979+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761815c0 con 0x5560761466c0 2023-10-06T02:27:24.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.980+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v117'668 uv668 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.981 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:27:24.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.980+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761815c0 con 0x5560761466c0 2023-10-06T02:27:24.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.981+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v117'669 uv669 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.981+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761815c0 con 0x5560761466c0 2023-10-06T02:27:24.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.983+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v117'670 uv670 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.983+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761815c0 con 0x5560761466c0 2023-10-06T02:27:24.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.984+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v117'671 uv671 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.984+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761815c0 con 0x5560761466c0 2023-10-06T02:27:24.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.985+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v117'672 uv647 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.985+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761815c0 con 0x5560761466c0 2023-10-06T02:27:24.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.986+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v117'673 uv673 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.986+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761815c0 con 0x5560761466c0 2023-10-06T02:27:24.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.987+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v117'674 uv674 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.988 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:27:24.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.987+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761815c0 con 0x5560761466c0 2023-10-06T02:27:24.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.988+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v117'675 uv675 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.988+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761815c0 con 0x5560761466c0 2023-10-06T02:27:24.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.989+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v117'676 uv676 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.990+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761815c0 con 0x5560761466c0 2023-10-06T02:27:24.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.991+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v117'677 uv677 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.991+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076182580 con 0x5560761466c0 2023-10-06T02:27:24.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.992+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v117'678 uv678 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.992+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076182580 con 0x5560761466c0 2023-10-06T02:27:24.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.993+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v117'679 uv653 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.993+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076182580 con 0x5560761466c0 2023-10-06T02:27:24.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.994+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v117'680 uv680 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.994+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076182580 con 0x5560761466c0 2023-10-06T02:27:24.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.996+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v117'681 uv681 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.996 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:27:24.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.996+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076183590 con 0x5560761466c0 2023-10-06T02:27:24.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.997+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v117'682 uv682 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.997+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076183590 con 0x5560761466c0 2023-10-06T02:27:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.998+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v117'683 uv683 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.998+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076182580 con 0x5560761466c0 2023-10-06T02:27:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.999+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v117'684 uv684 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:24.999+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076182580 con 0x5560761466c0 2023-10-06T02:27:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.000+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v117'685 uv659 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.000+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076182580 con 0x5560761466c0 2023-10-06T02:27:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.001+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v117'686 uv686 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.001+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076182580 con 0x5560761466c0 2023-10-06T02:27:25.003 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:27:25.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.003+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v117'687 uv687 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:25.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.003+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076183590 con 0x5560761466c0 2023-10-06T02:27:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.004+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v117'688 uv688 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.004+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076183590 con 0x5560761466c0 2023-10-06T02:27:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.005+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v117'689 uv689 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.005+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076182580 con 0x5560761466c0 2023-10-06T02:27:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.006+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v117'690 uv690 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x5560761466c0 2023-10-06T02:27:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.006+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x556076182a90 0x556076184e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.006+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761853b0 con 0x556076182a90 2023-10-06T02:27:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.006+0000 7fede173d700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x556076182a90 0x556076184e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.007+0000 7fede173d700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x556076182a90 0x556076184e70 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.008+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v117'478 uv461 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.008+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076185760 con 0x556076182a90 2023-10-06T02:27:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.009+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v117'479 uv479 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.009+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076185b10 con 0x556076182a90 2023-10-06T02:27:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.010+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v117'480 uv480 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.011 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:27:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.010+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761863b0 con 0x556076182a90 2023-10-06T02:27:25.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.012+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v117'481 uv481 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.012+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076186760 con 0x556076182a90 2023-10-06T02:27:25.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.013+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v117'482 uv482 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.013+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076186b10 con 0x556076182a90 2023-10-06T02:27:25.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.014+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v117'483 uv466 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.014+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076186ec0 con 0x556076182a90 2023-10-06T02:27:25.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.015+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v117'484 uv484 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.015+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076186ec0 con 0x556076182a90 2023-10-06T02:27:25.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.016+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v117'485 uv485 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.017 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:27:25.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.016+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076186ec0 con 0x556076182a90 2023-10-06T02:27:25.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.017+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v117'486 uv486 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.017+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076186ec0 con 0x556076182a90 2023-10-06T02:27:25.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.018+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v117'487 uv487 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.018+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076186ec0 con 0x556076182a90 2023-10-06T02:27:25.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.019+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v117'488 uv471 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.019+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076186ec0 con 0x556076182a90 2023-10-06T02:27:25.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.020+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v117'489 uv489 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.020+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076186ec0 con 0x556076182a90 2023-10-06T02:27:25.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.021+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v117'490 uv490 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.022 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:27:25.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.021+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618a5e0 con 0x556076182a90 2023-10-06T02:27:25.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.022+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v117'491 uv491 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.022+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618a5e0 con 0x556076182a90 2023-10-06T02:27:25.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.023+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v117'492 uv492 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.023+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076186ec0 con 0x556076182a90 2023-10-06T02:27:25.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.025+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v117'493 uv477 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.025+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076186ec0 con 0x556076182a90 2023-10-06T02:27:25.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.026+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v117'494 uv494 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.026+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076186ec0 con 0x556076182a90 2023-10-06T02:27:25.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.027+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v117'495 uv495 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.027 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:27:25.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.027+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076187ed0 con 0x556076182a90 2023-10-06T02:27:25.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.028+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v117'496 uv496 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.028+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076187ed0 con 0x556076182a90 2023-10-06T02:27:25.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.029+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v117'497 uv497 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.029+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076186ec0 con 0x556076182a90 2023-10-06T02:27:25.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.030+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v117'498 uv498 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.030+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5560761873d0 0x5560761897b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.030+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076189cf0 con 0x5560761873d0 2023-10-06T02:27:25.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.030+0000 7feddbfff700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5560761873d0 0x5560761897b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.030+0000 7feddbfff700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5560761873d0 0x5560761897b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.031+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v117'129 uv128 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.031+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618a0e0 con 0x5560761873d0 2023-10-06T02:27:25.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.032+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v117'130 uv130 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.033+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076185fb0 con 0x5560761873d0 2023-10-06T02:27:25.034 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:27:25.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.033+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v117'131 uv131 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.033+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618bfb0 con 0x5560761873d0 2023-10-06T02:27:25.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.034+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v117'132 uv132 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.034+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618c360 con 0x5560761873d0 2023-10-06T02:27:25.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.035+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v117'133 uv133 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.035+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618afa0 con 0x5560761873d0 2023-10-06T02:27:25.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.036+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v117'134 uv134 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.036+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618b3a0 con 0x5560761873d0 2023-10-06T02:27:25.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.037+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v117'92 uv91 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.037+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618b3a0 con 0x5560761873d0 2023-10-06T02:27:25.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.038+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v117'93 uv93 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.038+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618b3a0 con 0x5560761873d0 2023-10-06T02:27:25.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.039+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v117'94 uv94 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.040 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:27:25.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.039+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618b3a0 con 0x5560761873d0 2023-10-06T02:27:25.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.040+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v117'95 uv95 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.040+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618b3a0 con 0x556076182a90 2023-10-06T02:27:25.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.041+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v117'129 uv128 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.041+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618b3a0 con 0x556076182a90 2023-10-06T02:27:25.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.042+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v117'130 uv130 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.042+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618b3a0 con 0x556076182a90 2023-10-06T02:27:25.043 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:27:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.043+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v117'131 uv131 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.043+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618b3a0 con 0x556076182a90 2023-10-06T02:27:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.044+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v117'132 uv132 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.044+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618b3a0 con 0x556076182a90 2023-10-06T02:27:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.045+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v117'133 uv133 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.045+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618b3a0 con 0x556076182a90 2023-10-06T02:27:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.046+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v117'134 uv134 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedd40548f0 con 0x556076182a90 2023-10-06T02:27:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.046+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55607618c710 0x55607618eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.046+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618f030 con 0x55607618c710 2023-10-06T02:27:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.046+0000 7fede1f3e700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55607618c710 0x55607618eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.046+0000 7fede1f3e700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55607618c710 0x55607618eaf0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.047+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v117'238 uv232 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x55607618c710 2023-10-06T02:27:25.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.047+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618f030 con 0x55607618c710 2023-10-06T02:27:25.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.048+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v117'239 uv239 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x55607618c710 2023-10-06T02:27:25.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.049+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618f030 con 0x55607618c710 2023-10-06T02:27:25.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.049+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v117'240 uv240 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x55607618c710 2023-10-06T02:27:25.050 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:27:25.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.049+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076190040 con 0x55607618c710 2023-10-06T02:27:25.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.050+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v117'241 uv241 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x55607618c710 2023-10-06T02:27:25.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.050+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076190040 con 0x55607618c710 2023-10-06T02:27:25.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.051+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v117'242 uv242 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x55607618c710 2023-10-06T02:27:25.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.052+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618f030 con 0x55607618c710 2023-10-06T02:27:25.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.053+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v117'243 uv243 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x55607618c710 2023-10-06T02:27:25.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.053+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618f030 con 0x55607618c710 2023-10-06T02:27:25.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.054+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v117'244 uv237 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x55607618c710 2023-10-06T02:27:25.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.054+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618f030 con 0x55607618c710 2023-10-06T02:27:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.055+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v117'245 uv245 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x55607618c710 2023-10-06T02:27:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.055+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618f030 con 0x55607618c710 2023-10-06T02:27:25.056 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:27:25.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.056+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v117'246 uv246 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x55607618c710 2023-10-06T02:27:25.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.056+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618f030 con 0x55607618c710 2023-10-06T02:27:25.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.057+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v117'247 uv247 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x55607618c710 2023-10-06T02:27:25.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.057+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55607618f030 con 0x55607618c710 2023-10-06T02:27:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.058+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v117'248 uv248 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x55607618c710 2023-10-06T02:27:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.058+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55607618f540 0x556076191920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.058+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076191fd0 con 0x55607618f540 2023-10-06T02:27:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.058+0000 7fede173d700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55607618f540 0x556076191920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.059+0000 7fede173d700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55607618f540 0x556076191920 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.060+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v117'107 uv106 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fedd4069db0 con 0x55607618f540 2023-10-06T02:27:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.060+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076191fd0 con 0x55607618f540 2023-10-06T02:27:25.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.061+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v117'108 uv108 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fedd4069db0 con 0x55607618f540 2023-10-06T02:27:25.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.061+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076191fd0 con 0x55607618f540 2023-10-06T02:27:25.066 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:27:25.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.066+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v117'109 uv109 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fedd4069db0 con 0x55607618f540 2023-10-06T02:27:25.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.066+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076192480 con 0x55607618f540 2023-10-06T02:27:25.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.068+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v117'110 uv110 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fedd4069db0 con 0x55607618f540 2023-10-06T02:27:25.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.068+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076192480 con 0x55607618f540 2023-10-06T02:27:25.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.071+0000 7fede173d700 1 -- 172.21.15.6:0/159513884 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v117'111 uv111 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fedd4069db0 con 0x55607618f540 2023-10-06T02:27:25.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.071+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076192480 con 0x5560761873d0 2023-10-06T02:27:25.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.071+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v117'129 uv128 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.071+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076192480 con 0x5560761873d0 2023-10-06T02:27:25.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.072+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v117'130 uv130 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.072+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076192480 con 0x5560761873d0 2023-10-06T02:27:25.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.073+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v117'131 uv131 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.074 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:27:25.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.073+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076193490 con 0x5560761873d0 2023-10-06T02:27:25.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.074+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v117'132 uv132 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.074+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076193490 con 0x5560761873d0 2023-10-06T02:27:25.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.075+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v117'133 uv133 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.075+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076192480 con 0x5560761873d0 2023-10-06T02:27:25.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.076+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v117'134 uv134 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.076+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x556076192b00 0x556076194ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.076+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195420 con 0x556076192b00 2023-10-06T02:27:25.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.076+0000 7feddbfff700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x556076192b00 0x556076194ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.076+0000 7feddbfff700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x556076192b00 0x556076194ee0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.078+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v117'213 uv207 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x556076192b00 2023-10-06T02:27:25.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.078+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195800 con 0x556076192b00 2023-10-06T02:27:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.080+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v117'214 uv214 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x556076192b00 2023-10-06T02:27:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.080+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195800 con 0x556076192b00 2023-10-06T02:27:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.081+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v117'215 uv215 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x556076192b00 2023-10-06T02:27:25.081 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:27:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.081+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195800 con 0x556076192b00 2023-10-06T02:27:25.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.082+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v117'216 uv216 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x556076192b00 2023-10-06T02:27:25.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.082+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195800 con 0x556076192b00 2023-10-06T02:27:25.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.083+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v117'217 uv217 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x556076192b00 2023-10-06T02:27:25.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.083+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195800 con 0x556076192b00 2023-10-06T02:27:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.083+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v117'218 uv212 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x556076192b00 2023-10-06T02:27:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.084+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195800 con 0x556076192b00 2023-10-06T02:27:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.084+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v117'219 uv219 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x556076192b00 2023-10-06T02:27:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.084+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195800 con 0x556076192b00 2023-10-06T02:27:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.085+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v117'220 uv220 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x556076192b00 2023-10-06T02:27:25.086 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:27:25.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.085+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195800 con 0x556076192b00 2023-10-06T02:27:25.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.086+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v117'221 uv221 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x556076192b00 2023-10-06T02:27:25.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.086+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076198570 con 0x556076192b00 2023-10-06T02:27:25.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.087+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v117'222 uv222 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x556076192b00 2023-10-06T02:27:25.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.087+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195cf0 con 0x5560761873d0 2023-10-06T02:27:25.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.088+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v117'95 uv94 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.088+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195cf0 con 0x5560761873d0 2023-10-06T02:27:25.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.089+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v117'96 uv96 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.089+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195cf0 con 0x5560761873d0 2023-10-06T02:27:25.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.090+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v117'97 uv97 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.090 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:27:25.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.090+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195cf0 con 0x5560761873d0 2023-10-06T02:27:25.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.091+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v117'98 uv98 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.091+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x556076196200 0x5560761965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.091+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076198cc0 con 0x556076196200 2023-10-06T02:27:25.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.091+0000 7fede1f3e700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x556076196200 0x5560761965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.092+0000 7fede1f3e700 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x556076196200 0x5560761965d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.093+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v117'129 uv128 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x556076196200 2023-10-06T02:27:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.093+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076198cc0 con 0x556076196200 2023-10-06T02:27:25.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.094+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v117'130 uv130 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x556076196200 2023-10-06T02:27:25.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.094+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076198cc0 con 0x556076196200 2023-10-06T02:27:25.095 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:27:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.095+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v117'131 uv131 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x556076196200 2023-10-06T02:27:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.095+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076199cd0 con 0x556076196200 2023-10-06T02:27:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.096+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v117'132 uv132 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x556076196200 2023-10-06T02:27:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.096+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076199cd0 con 0x556076196200 2023-10-06T02:27:25.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.097+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v117'133 uv133 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x556076196200 2023-10-06T02:27:25.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.097+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076198cc0 con 0x556076196200 2023-10-06T02:27:25.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.098+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v117'134 uv134 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x556076196200 2023-10-06T02:27:25.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.098+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076198cc0 con 0x55607618c710 2023-10-06T02:27:25.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.099+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v117'110 uv109 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x55607618c710 2023-10-06T02:27:25.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.099+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076198cc0 con 0x55607618c710 2023-10-06T02:27:25.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.100+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v117'111 uv111 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x55607618c710 2023-10-06T02:27:25.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.100+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076198cc0 con 0x55607618c710 2023-10-06T02:27:25.101 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:27:25.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.101+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v117'112 uv112 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x55607618c710 2023-10-06T02:27:25.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.101+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076198cc0 con 0x55607618c710 2023-10-06T02:27:25.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.102+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v117'113 uv113 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x55607618c710 2023-10-06T02:27:25.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.102+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195880 con 0x55607618c710 2023-10-06T02:27:25.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.103+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v117'114 uv114 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7feddc0044f0 con 0x55607618c710 2023-10-06T02:27:25.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.103+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195880 con 0x5560761873d0 2023-10-06T02:27:25.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.104+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v117'265 uv257 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.104+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195880 con 0x5560761873d0 2023-10-06T02:27:25.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.105+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v117'266 uv266 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.105+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195880 con 0x5560761873d0 2023-10-06T02:27:25.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.108+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v117'267 uv267 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.110 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:27:25.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.108+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195880 con 0x5560761873d0 2023-10-06T02:27:25.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.110+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v117'268 uv268 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.110+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761991b0 con 0x5560761873d0 2023-10-06T02:27:25.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.113+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v117'269 uv269 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.113+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761991b0 con 0x5560761873d0 2023-10-06T02:27:25.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.116+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v117'270 uv264 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.116+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195880 con 0x5560761873d0 2023-10-06T02:27:25.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.117+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v117'271 uv271 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.117+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195880 con 0x5560761873d0 2023-10-06T02:27:25.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.118+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v117'272 uv272 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.118 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:27:25.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.118+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195880 con 0x5560761873d0 2023-10-06T02:27:25.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.119+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v117'273 uv273 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.119+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076195880 con 0x5560761873d0 2023-10-06T02:27:25.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.120+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v117'274 uv274 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.120+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x5560761991b0 con 0x5560761873d0 2023-10-06T02:27:25.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.121+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v117'275 uv275 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.121+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x556076199420 con 0x5560761873d0 2023-10-06T02:27:25.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7feddbfff700 1 -- 172.21.15.6:0/159513884 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v117'276 uv276 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fedcc008c20 con 0x5560761873d0 2023-10-06T02:27:25.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5560761873d0 msgr2=0x5560761897b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5560761873d0 0x5560761897b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5560761466c0 msgr2=0x55607617fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5560761466c0 0x55607617fdc0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x556076192b00 msgr2=0x556076194ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x556076192b00 0x556076194ee0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x556076182a90 msgr2=0x556076184e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x556076182a90 0x556076184e70 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x556076196200 msgr2=0x5560761965d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x556076196200 0x5560761965d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55607618f540 msgr2=0x556076191920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 reap_dead start 2023-10-06T02:27:25.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55607618f540 0x556076191920 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede1f3e700 1 -- 172.21.15.6:0/159513884 reap_dead start 2023-10-06T02:27:25.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55607618c710 msgr2=0x55607618eaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55607618c710 0x55607618eaf0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fedc40658c0 msgr2=0x7fedc4067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fedc40658c0 0x7fedc4067d70 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009a60 tx=0x7fedcc005c80 comp rx=0 tx=0).stop 2023-10-06T02:27:25.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560760d7490 msgr2=0x55607614a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560760d7490 0x55607614a400 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fedd4012000 tx=0x7fedd4016000 comp rx=0 tx=0).stop 2023-10-06T02:27:25.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 shutdown_connections 2023-10-06T02:27:25.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560760d7490 0x55607614a400 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fedc40658c0 0x7fedc4067d70 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 --2- 172.21.15.6:0/159513884 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55607618c710 0x55607618eaf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 >> 172.21.15.6:0/159513884 conn(0x55607608e5d0 msgr2=0x55607614cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:25.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 shutdown_connections 2023-10-06T02:27:25.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.123+0000 7fede8502000 1 -- 172.21.15.6:0/159513884 wait complete. 2023-10-06T02:27:25.127 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put 100.00000000.inode - 2023-10-06T02:27:25.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.205+0000 7f8411070000 1 Processor -- start 2023-10-06T02:27:25.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.205+0000 7f8411070000 1 -- start start 2023-10-06T02:27:25.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f8411070000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e56bab4e30 0x55e56bb57ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f8411070000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e56bab79e0 0x55e56bb59160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f8411070000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e56bb5df50 0x55e56bad2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f8411070000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e56ba30320 con 0x55e56bab4e30 2023-10-06T02:27:25.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f8411070000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e56b9d4980 con 0x55e56bb5df50 2023-10-06T02:27:25.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f8411070000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e56b9d4620 con 0x55e56bab79e0 2023-10-06T02:27:25.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f840a2ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e56bab4e30 0x55e56bb57ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f840a2ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e56bab4e30 0x55e56bb57ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55766/0 (socket says 172.21.15.6:55766) 2023-10-06T02:27:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f840a2ab700 1 -- 172.21.15.6:0/304402721 learned_addr learned my addr 172.21.15.6:0/304402721 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f8409aaa700 1 --2- 172.21.15.6:0/304402721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e56bab79e0 0x55e56bb59160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f840aaac700 1 --2- 172.21.15.6:0/304402721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e56bb5df50 0x55e56bad2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f840a2ab700 1 -- 172.21.15.6:0/304402721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e56bab79e0 msgr2=0x55e56bb59160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f840a2ab700 1 --2- 172.21.15.6:0/304402721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e56bab79e0 0x55e56bb59160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f840a2ab700 1 -- 172.21.15.6:0/304402721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e56bb5df50 msgr2=0x55e56bad2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f840a2ab700 1 --2- 172.21.15.6:0/304402721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e56bb5df50 0x55e56bad2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f840a2ab700 1 -- 172.21.15.6:0/304402721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc00a0e0 con 0x55e56bab4e30 2023-10-06T02:27:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f8409aaa700 1 --2- 172.21.15.6:0/304402721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e56bab79e0 0x55e56bb59160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.206+0000 7f840aaac700 1 --2- 172.21.15.6:0/304402721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e56bb5df50 0x55e56bad2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.207+0000 7f840a2ab700 1 --2- 172.21.15.6:0/304402721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e56bab4e30 0x55e56bb57ed0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f8404001da0 tx=0x7f8404001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c22428d6a1e679 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.207+0000 7f8408aa8700 1 -- 172.21.15.6:0/304402721 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404014070 con 0x55e56bab4e30 2023-10-06T02:27:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.207+0000 7f8408aa8700 1 -- 172.21.15.6:0/304402721 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8404008030 con 0x55e56bab4e30 2023-10-06T02:27:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.207+0000 7f8408aa8700 1 -- 172.21.15.6:0/304402721 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840400bdf0 con 0x55e56bab4e30 2023-10-06T02:27:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.207+0000 7f8411070000 1 -- 172.21.15.6:0/304402721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e56bab4e30 msgr2=0x55e56bb57ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.207+0000 7f8411070000 1 --2- 172.21.15.6:0/304402721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e56bab4e30 0x55e56bb57ed0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f8404001da0 tx=0x7f8404001810 comp rx=0 tx=0).stop 2023-10-06T02:27:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.207+0000 7f8411070000 1 -- 172.21.15.6:0/304402721 shutdown_connections 2023-10-06T02:27:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.207+0000 7f8411070000 1 --2- 172.21.15.6:0/304402721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e56bb5df50 0x55e56bad2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.207+0000 7f8411070000 1 --2- 172.21.15.6:0/304402721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e56bab4e30 0x55e56bb57ed0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.207+0000 7f8411070000 1 --2- 172.21.15.6:0/304402721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e56bab79e0 0x55e56bb59160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.207+0000 7f8411070000 1 -- 172.21.15.6:0/304402721 >> 172.21.15.6:0/304402721 conn(0x55e56bad0bd0 msgr2=0x55e56bb59bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.207+0000 7f8411070000 1 -- 172.21.15.6:0/304402721 shutdown_connections 2023-10-06T02:27:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.207+0000 7f8411070000 1 -- 172.21.15.6:0/304402721 wait complete. 2023-10-06T02:27:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.208+0000 7f8411070000 1 Processor -- start 2023-10-06T02:27:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.208+0000 7f8411070000 1 -- start start 2023-10-06T02:27:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.208+0000 7f8411070000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e56bab4e30 0x55e56bb54d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.208+0000 7f8411070000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e56bab79e0 0x55e56bb56f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f8411070000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e56bb5df50 0x55e56bacd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f8411070000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e56b9cb400 con 0x55e56bb5df50 2023-10-06T02:27:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f8411070000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e56bb5f570 con 0x55e56bab4e30 2023-10-06T02:27:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f8411070000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e56bb5f810 con 0x55e56bab79e0 2023-10-06T02:27:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f840aaac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e56bb5df50 0x55e56bacd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f840aaac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e56bb5df50 0x55e56bacd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55774/0 (socket says 172.21.15.6:55774) 2023-10-06T02:27:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f840aaac700 1 -- 172.21.15.6:0/1742540912 learned_addr learned my addr 172.21.15.6:0/1742540912 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f840a2ab700 1 --2- 172.21.15.6:0/1742540912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e56bab4e30 0x55e56bb54d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f840aaac700 1 -- 172.21.15.6:0/1742540912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e56bab79e0 msgr2=0x55e56bb56f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f8409aaa700 1 --2- 172.21.15.6:0/1742540912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e56bab79e0 0x55e56bb56f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f840aaac700 1 --2- 172.21.15.6:0/1742540912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e56bab79e0 0x55e56bb56f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f840aaac700 1 -- 172.21.15.6:0/1742540912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e56bab4e30 msgr2=0x55e56bb54d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f840aaac700 1 --2- 172.21.15.6:0/1742540912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e56bab4e30 0x55e56bb54d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f840aaac700 1 -- 172.21.15.6:0/1742540912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840400a040 con 0x55e56bb5df50 2023-10-06T02:27:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f840aaac700 1 --2- 172.21.15.6:0/1742540912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e56bb5df50 0x55e56bacd470 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x55e56ba8a300 tx=0x7f83fc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f83faffd700 1 -- 172.21.15.6:0/1742540912 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc00fa70 con 0x55e56bb5df50 2023-10-06T02:27:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f83faffd700 1 -- 172.21.15.6:0/1742540912 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc00fe50 con 0x55e56bb5df50 2023-10-06T02:27:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f83faffd700 1 -- 172.21.15.6:0/1742540912 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc010670 con 0x55e56bb5df50 2023-10-06T02:27:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f8411070000 1 -- 172.21.15.6:0/1742540912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e56b9d6ae0 con 0x55e56bb5df50 2023-10-06T02:27:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.209+0000 7f8411070000 1 -- 172.21.15.6:0/1742540912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e56b9d6540 con 0x55e56bb5df50 2023-10-06T02:27:25.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.211+0000 7f83faffd700 1 -- 172.21.15.6:0/1742540912 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83fc003040 con 0x55e56bb5df50 2023-10-06T02:27:25.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.211+0000 7f83faffd700 1 --2- 172.21.15.6:0/1742540912 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83ec065890 0x7f83ec067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.211+0000 7f83faffd700 1 -- 172.21.15.6:0/1742540912 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8270+0+0 (secure 0 0 0) 0x7f83fc085c00 con 0x55e56bb5df50 2023-10-06T02:27:25.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.211+0000 7f840a2ab700 1 --2- 172.21.15.6:0/1742540912 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83ec065890 0x7f83ec067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.211+0000 7f8411070000 1 --2- 172.21.15.6:0/1742540912 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e56bad2630 0x55e56bb5a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.211+0000 7f8411070000 1 -- 172.21.15.6:0/1742540912 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.1f 14:fe07bba1:::100.00000000.inode:head [writefull 0~80 in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v8 -- 0x55e56bb5af00 con 0x55e56bad2630 2023-10-06T02:27:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.211+0000 7f8409aaa700 1 --2- 172.21.15.6:0/1742540912 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e56bad2630 0x55e56bb5a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.212+0000 7f840a2ab700 1 --2- 172.21.15.6:0/1742540912 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83ec065890 0x7f83ec067d40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8404001870 tx=0x7f8404016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.212+0000 7f8409aaa700 1 --2- 172.21.15.6:0/1742540912 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e56bad2630 0x55e56bb5a9c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.214+0000 7f8409aaa700 1 -- 172.21.15.6:0/1742540912 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 100.00000000.inode [writefull 0~80] v117'277 uv277 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f840000e650 con 0x55e56bad2630 2023-10-06T02:27:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.214+0000 7f8411070000 1 -- 172.21.15.6:0/1742540912 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e56bad2630 msgr2=0x55e56bb5a9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.214+0000 7f8411070000 1 --2- 172.21.15.6:0/1742540912 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e56bad2630 0x55e56bb5a9c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.214+0000 7f8411070000 1 -- 172.21.15.6:0/1742540912 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83ec065890 msgr2=0x7f83ec067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.214+0000 7f8411070000 1 --2- 172.21.15.6:0/1742540912 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f83ec065890 0x7f83ec067d40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8404001870 tx=0x7f8404016000 comp rx=0 tx=0).stop 2023-10-06T02:27:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.214+0000 7f8411070000 1 -- 172.21.15.6:0/1742540912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e56bb5df50 msgr2=0x55e56bacd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.214+0000 7f8411070000 1 --2- 172.21.15.6:0/1742540912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e56bb5df50 0x55e56bacd470 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x55e56ba8a300 tx=0x7f83fc015000 comp rx=0 tx=0).stop 2023-10-06T02:27:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.214+0000 7f840aaac700 1 -- 172.21.15.6:0/1742540912 reap_dead start 2023-10-06T02:27:25.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.214+0000 7f8411070000 1 -- 172.21.15.6:0/1742540912 shutdown_connections 2023-10-06T02:27:25.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.214+0000 7f8411070000 1 -- 172.21.15.6:0/1742540912 >> 172.21.15.6:0/1742540912 conn(0x55e56bad0bd0 msgr2=0x55e56bad33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:25.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.214+0000 7f8411070000 1 -- 172.21.15.6:0/1742540912 shutdown_connections 2023-10-06T02:27:25.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.214+0000 7f8411070000 1 -- 172.21.15.6:0/1742540912 wait complete. 2023-10-06T02:27:25.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:27:25.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.378+0000 7f14d0256700 1 Processor -- start 2023-10-06T02:27:25.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.379+0000 7f14d0256700 1 -- start start 2023-10-06T02:27:25.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.379+0000 7f14d0256700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14c80d0400 0x7f14c80b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.379+0000 7f14d0256700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14c80ccd40 0x7f14c80cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.379+0000 7f14d0256700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c80b6170 con 0x7f14c80cf7e0 2023-10-06T02:27:25.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.379+0000 7f14d0256700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c815dd40 con 0x7f14c80d0400 2023-10-06T02:27:25.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.379+0000 7f14d0256700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c815e020 con 0x7f14c80ccd40 2023-10-06T02:27:25.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.380+0000 7f14cdff2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14c80d0400 0x7f14c80b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.380+0000 7f14ce7f3700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f14c80cf7e0 0x7f14c80b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41288/0 (socket says 172.21.15.6:41288) 2023-10-06T02:27:25.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.380+0000 7f14ce7f3700 1 -- 172.21.15.6:0/771702789 learned_addr learned my addr 172.21.15.6:0/771702789 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:25.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.380+0000 7f14cd7f1700 1 --2- 172.21.15.6:0/771702789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14c80ccd40 0x7f14c80cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.380+0000 7f14ccff0700 1 -- 172.21.15.6:0/771702789 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859562276 0 0) 0x7f14c80b6170 con 0x7f14c80cf7e0 2023-10-06T02:27:25.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.380+0000 7f14ccff0700 1 -- 172.21.15.6:0/771702789 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14b0003570 con 0x7f14c80cf7e0 2023-10-06T02:27:25.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.380+0000 7f14cdff2700 1 -- 172.21.15.6:0/771702789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14c80ccd40 msgr2=0x7f14c80cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.380+0000 7f14cdff2700 1 --2- 172.21.15.6:0/771702789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14c80ccd40 0x7f14c80cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.380+0000 7f14cdff2700 1 -- 172.21.15.6:0/771702789 >> v1:172.21.15.6:6789/0 conn(0x7f14c80cf7e0 legacy=0x7f14c80b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.380+0000 7f14cdff2700 1 -- 172.21.15.6:0/771702789 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80ceaa0 con 0x7f14c80d0400 2023-10-06T02:27:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.380+0000 7f14cd7f1700 1 --2- 172.21.15.6:0/771702789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14c80ccd40 0x7f14c80cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.380+0000 7f14cdff2700 1 --2- 172.21.15.6:0/771702789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14c80d0400 0x7f14c80b5c30 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f14c00098d0 tx=0x7f14c0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d172d2f84d298caa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.380+0000 7f14ccff0700 1 -- 172.21.15.6:0/771702789 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0005c10 con 0x7f14c80d0400 2023-10-06T02:27:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.380+0000 7f14ccff0700 1 -- 172.21.15.6:0/771702789 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c0005d70 con 0x7f14c80d0400 2023-10-06T02:27:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.380+0000 7f14ccff0700 1 -- 172.21.15.6:0/771702789 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0006260 con 0x7f14c80d0400 2023-10-06T02:27:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.381+0000 7f14d0256700 1 -- 172.21.15.6:0/771702789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14c80d0400 msgr2=0x7f14c80b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.381+0000 7f14d0256700 1 --2- 172.21.15.6:0/771702789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14c80d0400 0x7f14c80b5c30 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f14c00098d0 tx=0x7f14c0009120 comp rx=0 tx=0).stop 2023-10-06T02:27:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.381+0000 7f14d0256700 1 -- 172.21.15.6:0/771702789 shutdown_connections 2023-10-06T02:27:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.381+0000 7f14d0256700 1 --2- 172.21.15.6:0/771702789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14c80d0400 0x7f14c80b5c30 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.381+0000 7f14d0256700 1 --2- 172.21.15.6:0/771702789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14c80ccd40 0x7f14c80cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.381+0000 7f14d0256700 1 -- 172.21.15.6:0/771702789 >> 172.21.15.6:0/771702789 conn(0x7f14c806a220 msgr2=0x7f14c806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.381+0000 7f14d0256700 1 -- 172.21.15.6:0/771702789 shutdown_connections 2023-10-06T02:27:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.381+0000 7f14d0256700 1 -- 172.21.15.6:0/771702789 wait complete. 2023-10-06T02:27:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.382+0000 7f14d0256700 1 Processor -- start 2023-10-06T02:27:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.382+0000 7f14d0256700 1 -- start start 2023-10-06T02:27:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.383+0000 7f14d0256700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14c80ccd40 0x7f14c814c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.383+0000 7f14d0256700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14c80cf7e0 0x7f14c814d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.383+0000 7f14d0256700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14c80d0400 0x7f14c8169a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.383+0000 7f14d0256700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c814ee60 con 0x7f14c80ccd40 2023-10-06T02:27:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.383+0000 7f14d0256700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c814e250 con 0x7f14c80cf7e0 2023-10-06T02:27:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.383+0000 7f14d0256700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c814e530 con 0x7f14c80d0400 2023-10-06T02:27:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.383+0000 7f14cdff2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14c80ccd40 0x7f14c814c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.383+0000 7f14cdff2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14c80ccd40 0x7f14c814c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55800/0 (socket says 172.21.15.6:55800) 2023-10-06T02:27:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.383+0000 7f14cdff2700 1 -- 172.21.15.6:0/2024381804 learned_addr learned my addr 172.21.15.6:0/2024381804 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.383+0000 7f14cd7f1700 1 --2- 172.21.15.6:0/2024381804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14c80cf7e0 0x7f14c814d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.383+0000 7f14cdff2700 1 -- 172.21.15.6:0/2024381804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14c80d0400 msgr2=0x7f14c8169a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.383+0000 7f14cdff2700 1 --2- 172.21.15.6:0/2024381804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14c80d0400 0x7f14c8169a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.383+0000 7f14cdff2700 1 -- 172.21.15.6:0/2024381804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14c80cf7e0 msgr2=0x7f14c814d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.383+0000 7f14cdff2700 1 --2- 172.21.15.6:0/2024381804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14c80cf7e0 0x7f14c814d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.383+0000 7f14cdff2700 1 -- 172.21.15.6:0/2024381804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc009420 con 0x7f14c80ccd40 2023-10-06T02:27:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.383+0000 7f14cdff2700 1 --2- 172.21.15.6:0/2024381804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14c80ccd40 0x7f14c814c9d0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009ec0 tx=0x7f14c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.384+0000 7f14c5ffb700 1 -- 172.21.15.6:0/2024381804 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c001d9c0 con 0x7f14c80ccd40 2023-10-06T02:27:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.384+0000 7f14c5ffb700 1 -- 172.21.15.6:0/2024381804 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c001db40 con 0x7f14c80ccd40 2023-10-06T02:27:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.384+0000 7f14c5ffb700 1 -- 172.21.15.6:0/2024381804 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c001b480 con 0x7f14c80ccd40 2023-10-06T02:27:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.384+0000 7f14d0256700 1 -- 172.21.15.6:0/2024381804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c00093c0 con 0x7f14c80ccd40 2023-10-06T02:27:25.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.384+0000 7f14d0256700 1 -- 172.21.15.6:0/2024381804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c814eaf0 con 0x7f14c80ccd40 2023-10-06T02:27:25.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.385+0000 7f14d0256700 1 -- 172.21.15.6:0/2024381804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c8088760 con 0x7f14c80ccd40 2023-10-06T02:27:25.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.385+0000 7f14c5ffb700 1 -- 172.21.15.6:0/2024381804 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14c001b870 con 0x7f14c80ccd40 2023-10-06T02:27:25.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.386+0000 7f14c5ffb700 1 --2- 172.21.15.6:0/2024381804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f14b4066f30 0x7f14b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.386+0000 7f14c5ffb700 1 -- 172.21.15.6:0/2024381804 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8270+0+0 (secure 0 0 0) 0x7f14c0086fe0 con 0x7f14c80ccd40 2023-10-06T02:27:25.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.386+0000 7f14cd7f1700 1 --2- 172.21.15.6:0/2024381804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f14b4066f30 0x7f14b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.386+0000 7f14cd7f1700 1 --2- 172.21.15.6:0/2024381804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f14b4066f30 0x7f14b40693e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f14bc006f00 tx=0x7f14bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.390+0000 7f14c5ffb700 1 -- 172.21.15.6:0/2024381804 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14c0053930 con 0x7f14c80ccd40 2023-10-06T02:27:25.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.629+0000 7f14d0256700 1 -- 172.21.15.6:0/2024381804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f14c80ced80 con 0x7f14c80ccd40 2023-10-06T02:27:25.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.911+0000 7f14c5ffb700 1 -- 172.21.15.6:0/2024381804 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v231) v1 ==== 162+0+0 (secure 0 0 0) 0x7f14c002a070 con 0x7f14c80ccd40 2023-10-06T02:27:25.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.913+0000 7f14d0256700 1 -- 172.21.15.6:0/2024381804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f14b4066f30 msgr2=0x7f14b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.913+0000 7f14d0256700 1 --2- 172.21.15.6:0/2024381804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f14b4066f30 0x7f14b40693e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f14bc006f00 tx=0x7f14bc008040 comp rx=0 tx=0).stop 2023-10-06T02:27:25.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.913+0000 7f14d0256700 1 -- 172.21.15.6:0/2024381804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14c80ccd40 msgr2=0x7f14c814c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.913+0000 7f14d0256700 1 --2- 172.21.15.6:0/2024381804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14c80ccd40 0x7f14c814c9d0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009ec0 tx=0x7f14c0016000 comp rx=0 tx=0).stop 2023-10-06T02:27:25.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.913+0000 7f14d0256700 1 -- 172.21.15.6:0/2024381804 shutdown_connections 2023-10-06T02:27:25.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.913+0000 7f14d0256700 1 --2- 172.21.15.6:0/2024381804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14c80d0400 0x7f14c8169a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.913+0000 7f14d0256700 1 --2- 172.21.15.6:0/2024381804 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f14b4066f30 0x7f14b40693e0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.913+0000 7f14d0256700 1 --2- 172.21.15.6:0/2024381804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14c80ccd40 0x7f14c814c9d0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.913+0000 7f14d0256700 1 --2- 172.21.15.6:0/2024381804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14c80cf7e0 0x7f14c814d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.913+0000 7f14d0256700 1 -- 172.21.15.6:0/2024381804 >> 172.21.15.6:0/2024381804 conn(0x7f14c806a220 msgr2=0x7f14c80b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:25.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.914+0000 7f14d0256700 1 -- 172.21.15.6:0/2024381804 shutdown_connections 2023-10-06T02:27:25.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:25.914+0000 7f14d0256700 1 -- 172.21.15.6:0/2024381804 wait complete. 2023-10-06T02:27:25.916 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:27:25.918 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:27:25.918+0000 7f424e36e700 -1 mds.0.cache.ino(0x100) Corrupt inode 0x100: End of buffer 2023-10-06T02:27:25.919 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:27:25.918+0000 7f424e36e700 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2023-10-06T02:27:25.919 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:25.919+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:27:25.920 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:25.919+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:27:25.926 INFO:tasks.ceph.mds.a.smithi006.stderr: -25> 2023-10-06T02:27:25.918+0000 7f424e36e700 -1 mds.0.cache.ino(0x100) Corrupt inode 0x100: End of buffer 2023-10-06T02:27:25.926 INFO:tasks.ceph.mds.a.smithi006.stderr: -15> 2023-10-06T02:27:25.918+0000 7f424e36e700 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2023-10-06T02:27:25.930 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:25.948 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:27:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.052+0000 7f50f7533700 1 Processor -- start 2023-10-06T02:27:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.052+0000 7f50f7533700 1 -- start start 2023-10-06T02:27:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.053+0000 7f50f7533700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50f0159420 0x7f50f00aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.053+0000 7f50f7533700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50f00ad110 0x7f50f00ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.053+0000 7f50f7533700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f00cc430 con 0x7f50f01597f0 2023-10-06T02:27:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.053+0000 7f50f7533700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f00b0920 con 0x7f50f00ad110 2023-10-06T02:27:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.053+0000 7f50f7533700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f00af180 con 0x7f50f0159420 2023-10-06T02:27:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.053+0000 7f50f5ad0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50f00ad110 0x7f50f00ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.053+0000 7f50f5ad0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50f00ad110 0x7f50f00ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55818/0 (socket says 172.21.15.6:55818) 2023-10-06T02:27:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.053+0000 7f50f5ad0700 1 -- 172.21.15.6:0/417293075 learned_addr learned my addr 172.21.15.6:0/417293075 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.054+0000 7f50f5ad0700 1 -- 172.21.15.6:0/417293075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50f0159420 msgr2=0x7f50f00aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.054+0000 7f50f5ad0700 1 --2- 172.21.15.6:0/417293075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50f0159420 0x7f50f00aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.054+0000 7f50f5ad0700 1 -- 172.21.15.6:0/417293075 >> v1:172.21.15.175:6789/0 conn(0x7f50f01597f0 legacy=0x7f50f00aca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.054+0000 7f50f5ad0700 1 -- 172.21.15.6:0/417293075 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f00b1400 con 0x7f50f00ad110 2023-10-06T02:27:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.054+0000 7f50f5ad0700 1 --2- 172.21.15.6:0/417293075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f00ad110 0x7f50f00ac050 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009f20 tx=0x7f50e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d802ccc7dfbf54d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.054+0000 7f50e3fff700 1 -- 172.21.15.6:0/417293075 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e800e070 con 0x7f50f00ad110 2023-10-06T02:27:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.054+0000 7f50e3fff700 1 -- 172.21.15.6:0/417293075 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e800ba40 con 0x7f50f00ad110 2023-10-06T02:27:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.054+0000 7f50e3fff700 1 -- 172.21.15.6:0/417293075 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e80092e0 con 0x7f50f00ad110 2023-10-06T02:27:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.055+0000 7f50f7533700 1 -- 172.21.15.6:0/417293075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f00ad110 msgr2=0x7f50f00ac050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.055+0000 7f50f7533700 1 --2- 172.21.15.6:0/417293075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f00ad110 0x7f50f00ac050 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009f20 tx=0x7f50e8009840 comp rx=0 tx=0).stop 2023-10-06T02:27:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.055+0000 7f50f7533700 1 -- 172.21.15.6:0/417293075 shutdown_connections 2023-10-06T02:27:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.055+0000 7f50f7533700 1 --2- 172.21.15.6:0/417293075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f00ad110 0x7f50f00ac050 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.055+0000 7f50f7533700 1 --2- 172.21.15.6:0/417293075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50f0159420 0x7f50f00aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.055+0000 7f50f7533700 1 -- 172.21.15.6:0/417293075 >> 172.21.15.6:0/417293075 conn(0x7f50f00cc790 msgr2=0x7f50f00ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.055+0000 7f50f7533700 1 -- 172.21.15.6:0/417293075 shutdown_connections 2023-10-06T02:27:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.055+0000 7f50f7533700 1 -- 172.21.15.6:0/417293075 wait complete. 2023-10-06T02:27:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.056+0000 7f50f7533700 1 Processor -- start 2023-10-06T02:27:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.056+0000 7f50f7533700 1 -- start start 2023-10-06T02:27:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f7533700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50f00ad110 0x7f50f01432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f7533700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50f0159420 0x7f50f015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f7533700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f01597f0 0x7f50f015c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f7533700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f016cee0 con 0x7f50f01597f0 2023-10-06T02:27:26.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f7533700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f016d780 con 0x7f50f00ad110 2023-10-06T02:27:26.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f7533700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f0143800 con 0x7f50f0159420 2023-10-06T02:27:26.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f5ad0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f01597f0 0x7f50f015c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f5ad0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f01597f0 0x7f50f015c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55828/0 (socket says 172.21.15.6:55828) 2023-10-06T02:27:26.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f5ad0700 1 -- 172.21.15.6:0/3355176295 learned_addr learned my addr 172.21.15.6:0/3355176295 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:26.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f52cf700 1 --2- 172.21.15.6:0/3355176295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50f00ad110 0x7f50f01432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f4ace700 1 --2- 172.21.15.6:0/3355176295 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50f0159420 0x7f50f015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f5ad0700 1 -- 172.21.15.6:0/3355176295 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50f0159420 msgr2=0x7f50f015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f5ad0700 1 --2- 172.21.15.6:0/3355176295 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50f0159420 0x7f50f015bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f5ad0700 1 -- 172.21.15.6:0/3355176295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50f00ad110 msgr2=0x7f50f01432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f5ad0700 1 --2- 172.21.15.6:0/3355176295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50f00ad110 0x7f50f01432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f5ad0700 1 -- 172.21.15.6:0/3355176295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e8009ae0 con 0x7f50f01597f0 2023-10-06T02:27:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f5ad0700 1 --2- 172.21.15.6:0/3355176295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f01597f0 0x7f50f015c410 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f50f015e260 tx=0x7f50e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50e17fa700 1 -- 172.21.15.6:0/3355176295 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e80092e0 con 0x7f50f01597f0 2023-10-06T02:27:26.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50e17fa700 1 -- 172.21.15.6:0/3355176295 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e8012d00 con 0x7f50f01597f0 2023-10-06T02:27:26.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50f7533700 1 -- 172.21.15.6:0/3355176295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f016a630 con 0x7f50f01597f0 2023-10-06T02:27:26.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.057+0000 7f50e17fa700 1 -- 172.21.15.6:0/3355176295 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e801e660 con 0x7f50f01597f0 2023-10-06T02:27:26.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.058+0000 7f50f7533700 1 -- 172.21.15.6:0/3355176295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f016d410 con 0x7f50f01597f0 2023-10-06T02:27:26.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.058+0000 7f50f7533700 1 -- 172.21.15.6:0/3355176295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f016d930 con 0x7f50f01597f0 2023-10-06T02:27:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.059+0000 7f50e17fa700 1 -- 172.21.15.6:0/3355176295 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50e801ea10 con 0x7f50f01597f0 2023-10-06T02:27:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.059+0000 7f50e17fa700 1 --2- 172.21.15.6:0/3355176295 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f50d4066f30 0x7f50d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.059+0000 7f50e17fa700 1 -- 172.21.15.6:0/3355176295 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8356+0+0 (secure 0 0 0) 0x7f50e8086a90 con 0x7f50f01597f0 2023-10-06T02:27:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.059+0000 7f50f52cf700 1 --2- 172.21.15.6:0/3355176295 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f50d4066f30 0x7f50d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.060+0000 7f50f52cf700 1 --2- 172.21.15.6:0/3355176295 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f50d4066f30 0x7f50d40693e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f50f014a170 tx=0x7f50e40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.064+0000 7f50e17fa700 1 -- 172.21.15.6:0/3355176295 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50f016d930 con 0x7f50f01597f0 2023-10-06T02:27:26.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.302+0000 7f50f7533700 1 -- 172.21.15.6:0/3355176295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50f016d8f0 con 0x7f50f01597f0 2023-10-06T02:27:26.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.302+0000 7f50e17fa700 1 -- 172.21.15.6:0/3355176295 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 233 v233) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f50e8053260 con 0x7f50f01597f0 2023-10-06T02:27:26.303 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:26.303 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":233,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":233,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:25.920101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:26.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.305+0000 7f50f7533700 1 -- 172.21.15.6:0/3355176295 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f50d4066f30 msgr2=0x7f50d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.305+0000 7f50f7533700 1 --2- 172.21.15.6:0/3355176295 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f50d4066f30 0x7f50d40693e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f50f014a170 tx=0x7f50e40091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.305+0000 7f50f7533700 1 -- 172.21.15.6:0/3355176295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f01597f0 msgr2=0x7f50f015c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.305+0000 7f50f7533700 1 --2- 172.21.15.6:0/3355176295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f01597f0 0x7f50f015c410 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f50f015e260 tx=0x7f50e8017000 comp rx=0 tx=0).stop 2023-10-06T02:27:26.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.305+0000 7f50f7533700 1 -- 172.21.15.6:0/3355176295 shutdown_connections 2023-10-06T02:27:26.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.305+0000 7f50f7533700 1 --2- 172.21.15.6:0/3355176295 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f50d4066f30 0x7f50d40693e0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.305+0000 7f50f7533700 1 --2- 172.21.15.6:0/3355176295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f01597f0 0x7f50f015c410 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.305+0000 7f50f7533700 1 --2- 172.21.15.6:0/3355176295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50f00ad110 0x7f50f01432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.305+0000 7f50f7533700 1 --2- 172.21.15.6:0/3355176295 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50f0159420 0x7f50f015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.305+0000 7f50f7533700 1 -- 172.21.15.6:0/3355176295 >> 172.21.15.6:0/3355176295 conn(0x7f50f00cc790 msgr2=0x7f50f0156520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:26.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.305+0000 7f50f7533700 1 -- 172.21.15.6:0/3355176295 shutdown_connections 2023-10-06T02:27:26.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.305+0000 7f50f7533700 1 -- 172.21.15.6:0/3355176295 wait complete. 2023-10-06T02:27:26.307 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 233 2023-10-06T02:27:26.317 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:27:26.318 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:26.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.476+0000 7f6ac6fe7700 1 Processor -- start 2023-10-06T02:27:26.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.476+0000 7f6ac6fe7700 1 -- start start 2023-10-06T02:27:26.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.477+0000 7f6ac6fe7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6ac00af8b0 0x7f6ac015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.477+0000 7f6ac6fe7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac015e190 con 0x7f6ac00b27f0 2023-10-06T02:27:26.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.477+0000 7f6ac6fe7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac00cb650 con 0x7f6ac00af4e0 2023-10-06T02:27:26.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.477+0000 7f6ac6fe7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac00b1910 con 0x7f6ac00af8b0 2023-10-06T02:27:26.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.477+0000 7f6ac5584700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6ac00b27f0 0x7f6ac015d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41292/0 (socket says 172.21.15.6:41292) 2023-10-06T02:27:26.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.477+0000 7f6ac5584700 1 -- 172.21.15.6:0/1271723749 learned_addr learned my addr 172.21.15.6:0/1271723749 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:26.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.477+0000 7f6abffff700 1 --2- 172.21.15.6:0/1271723749 >> v2:172.21.15.175:3300/0 conn(0x7f6ac00af8b0 0x7f6ac015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.477+0000 7f6abf7fe700 1 -- 172.21.15.6:0/1271723749 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746270782 0 0) 0x7f6ac015e190 con 0x7f6ac00b27f0 2023-10-06T02:27:26.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.477+0000 7f6abf7fe700 1 -- 172.21.15.6:0/1271723749 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aac003570 con 0x7f6ac00b27f0 2023-10-06T02:27:26.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.477+0000 7f6abffff700 1 -- 172.21.15.6:0/1271723749 >> v1:172.21.15.175:6789/0 conn(0x7f6ac00af4e0 legacy=0x7f6ac00b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.477+0000 7f6abf7fe700 1 -- 172.21.15.6:0/1271723749 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463955722 0 0) 0x7f6ac00cb650 con 0x7f6ac00af4e0 2023-10-06T02:27:26.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.477+0000 7f6abffff700 1 -- 172.21.15.6:0/1271723749 >> v1:172.21.15.6:6789/0 conn(0x7f6ac00b27f0 legacy=0x7f6ac015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.477+0000 7f6abffff700 1 -- 172.21.15.6:0/1271723749 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac00ccaf0 con 0x7f6ac00af8b0 2023-10-06T02:27:26.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.477+0000 7f6abffff700 1 --2- 172.21.15.6:0/1271723749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac00af8b0 0x7f6ac015d460 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009e60 tx=0x7f6ab0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77880dedac7693a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.478+0000 7f6abf7fe700 1 -- 172.21.15.6:0/1271723749 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab000e070 con 0x7f6ac00af8b0 2023-10-06T02:27:26.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.478+0000 7f6abf7fe700 1 -- 172.21.15.6:0/1271723749 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab000bb60 con 0x7f6ac00af8b0 2023-10-06T02:27:26.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.478+0000 7f6abf7fe700 1 -- 172.21.15.6:0/1271723749 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0012430 con 0x7f6ac00af8b0 2023-10-06T02:27:26.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.478+0000 7f6ac6fe7700 1 -- 172.21.15.6:0/1271723749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac00af8b0 msgr2=0x7f6ac015d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.478+0000 7f6ac6fe7700 1 --2- 172.21.15.6:0/1271723749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac00af8b0 0x7f6ac015d460 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009e60 tx=0x7f6ab0009780 comp rx=0 tx=0).stop 2023-10-06T02:27:26.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.478+0000 7f6ac6fe7700 1 -- 172.21.15.6:0/1271723749 shutdown_connections 2023-10-06T02:27:26.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.478+0000 7f6ac6fe7700 1 --2- 172.21.15.6:0/1271723749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac00af8b0 0x7f6ac015d460 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.478+0000 7f6ac6fe7700 1 -- 172.21.15.6:0/1271723749 >> 172.21.15.6:0/1271723749 conn(0x7f6ac0068680 msgr2=0x7f6ac0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:26.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.478+0000 7f6ac6fe7700 1 -- 172.21.15.6:0/1271723749 shutdown_connections 2023-10-06T02:27:26.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.478+0000 7f6ac6fe7700 1 -- 172.21.15.6:0/1271723749 wait complete. 2023-10-06T02:27:26.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.479+0000 7f6ac6fe7700 1 Processor -- start 2023-10-06T02:27:26.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.479+0000 7f6ac6fe7700 1 -- start start 2023-10-06T02:27:26.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.480+0000 7f6ac6fe7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac00af4e0 0x7f6ac0154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.480+0000 7f6ac6fe7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ac00af8b0 0x7f6ac0152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.480+0000 7f6ac6fe7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac00b27f0 0x7f6ac0152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.480+0000 7f6ac6fe7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac0144300 con 0x7f6ac00af4e0 2023-10-06T02:27:26.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.480+0000 7f6ac6fe7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac01436f0 con 0x7f6ac00b27f0 2023-10-06T02:27:26.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.480+0000 7f6ac6fe7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac01439d0 con 0x7f6ac00af8b0 2023-10-06T02:27:26.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.480+0000 7f6ac4d83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac00af4e0 0x7f6ac0154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.480+0000 7f6ac4d83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac00af4e0 0x7f6ac0154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55842/0 (socket says 172.21.15.6:55842) 2023-10-06T02:27:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.480+0000 7f6ac4d83700 1 -- 172.21.15.6:0/3377108373 learned_addr learned my addr 172.21.15.6:0/3377108373 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.480+0000 7f6ac5584700 1 --2- 172.21.15.6:0/3377108373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac00b27f0 0x7f6ac0152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.481+0000 7f6abffff700 1 --2- 172.21.15.6:0/3377108373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ac00af8b0 0x7f6ac0152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.481+0000 7f6ac4d83700 1 -- 172.21.15.6:0/3377108373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ac00af8b0 msgr2=0x7f6ac0152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.481+0000 7f6ac4d83700 1 --2- 172.21.15.6:0/3377108373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ac00af8b0 0x7f6ac0152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.481+0000 7f6ac4d83700 1 -- 172.21.15.6:0/3377108373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac00b27f0 msgr2=0x7f6ac0152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.481+0000 7f6ac4d83700 1 --2- 172.21.15.6:0/3377108373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac00b27f0 0x7f6ac0152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.481+0000 7f6ac4d83700 1 -- 172.21.15.6:0/3377108373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab0009a20 con 0x7f6ac00af4e0 2023-10-06T02:27:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.481+0000 7f6ac4d83700 1 --2- 172.21.15.6:0/3377108373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac00af4e0 0x7f6ac0154ca0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800c7e0 tx=0x7f6ab8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.481+0000 7f6abcff9700 1 -- 172.21.15.6:0/3377108373 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8012700 con 0x7f6ac00af4e0 2023-10-06T02:27:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.481+0000 7f6abcff9700 1 -- 172.21.15.6:0/3377108373 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab8012880 con 0x7f6ac00af4e0 2023-10-06T02:27:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.481+0000 7f6abcff9700 1 -- 172.21.15.6:0/3377108373 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8012c40 con 0x7f6ac00af4e0 2023-10-06T02:27:26.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.481+0000 7f6ac6fe7700 1 -- 172.21.15.6:0/3377108373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac0143cb0 con 0x7f6ac00af4e0 2023-10-06T02:27:26.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.481+0000 7f6ac6fe7700 1 -- 172.21.15.6:0/3377108373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac01551e0 con 0x7f6ac00af4e0 2023-10-06T02:27:26.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.482+0000 7f6ac6fe7700 1 -- 172.21.15.6:0/3377108373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac0088aa0 con 0x7f6ac00af4e0 2023-10-06T02:27:26.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.482+0000 7f6abcff9700 1 -- 172.21.15.6:0/3377108373 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ab801b400 con 0x7f6ac00af4e0 2023-10-06T02:27:26.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.483+0000 7f6abcff9700 1 --2- 172.21.15.6:0/3377108373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6aa0066f30 0x7f6aa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.483+0000 7f6abcff9700 1 -- 172.21.15.6:0/3377108373 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8356+0+0 (secure 0 0 0) 0x7f6ab8084c00 con 0x7f6ac00af4e0 2023-10-06T02:27:26.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.483+0000 7f6abffff700 1 --2- 172.21.15.6:0/3377108373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6aa0066f30 0x7f6aa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.484+0000 7f6abffff700 1 --2- 172.21.15.6:0/3377108373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6aa0066f30 0x7f6aa00693e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009e60 tx=0x7f6ab0019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.487+0000 7f6abcff9700 1 -- 172.21.15.6:0/3377108373 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ab808b080 con 0x7f6ac00af4e0 2023-10-06T02:27:26.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.731+0000 7f6ac6fe7700 1 -- 172.21.15.6:0/3377108373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ac00cad20 con 0x7f6ac00af4e0 2023-10-06T02:27:26.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.732+0000 7f6abcff9700 1 -- 172.21.15.6:0/3377108373 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 233 v233) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f6ab80513d0 con 0x7f6ac00af4e0 2023-10-06T02:27:26.732 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:26.733 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":233,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":233,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:25.920101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.734+0000 7f6ac6fe7700 1 -- 172.21.15.6:0/3377108373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6aa0066f30 msgr2=0x7f6aa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.734+0000 7f6ac6fe7700 1 --2- 172.21.15.6:0/3377108373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6aa0066f30 0x7f6aa00693e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009e60 tx=0x7f6ab0019000 comp rx=0 tx=0).stop 2023-10-06T02:27:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.734+0000 7f6ac6fe7700 1 -- 172.21.15.6:0/3377108373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac00af4e0 msgr2=0x7f6ac0154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.734+0000 7f6ac6fe7700 1 --2- 172.21.15.6:0/3377108373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac00af4e0 0x7f6ac0154ca0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800c7e0 tx=0x7f6ab8007df0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.734+0000 7f6ac6fe7700 1 -- 172.21.15.6:0/3377108373 shutdown_connections 2023-10-06T02:27:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.734+0000 7f6ac6fe7700 1 --2- 172.21.15.6:0/3377108373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac00b27f0 0x7f6ac0152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.734+0000 7f6ac6fe7700 1 --2- 172.21.15.6:0/3377108373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6aa0066f30 0x7f6aa00693e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.734+0000 7f6ac6fe7700 1 --2- 172.21.15.6:0/3377108373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac00af4e0 0x7f6ac0154ca0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.734+0000 7f6ac6fe7700 1 --2- 172.21.15.6:0/3377108373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ac00af8b0 0x7f6ac0152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.734+0000 7f6ac6fe7700 1 -- 172.21.15.6:0/3377108373 >> 172.21.15.6:0/3377108373 conn(0x7f6ac0068680 msgr2=0x7f6ac00b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.734+0000 7f6ac6fe7700 1 -- 172.21.15.6:0/3377108373 shutdown_connections 2023-10-06T02:27:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.734+0000 7f6ac6fe7700 1 -- 172.21.15.6:0/3377108373 wait complete. 2023-10-06T02:27:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 233 2023-10-06T02:27:26.747 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:27:26.748 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:26.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.865+0000 7f411164c700 1 Processor -- start 2023-10-06T02:27:26.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.866+0000 7f411164c700 1 -- start start 2023-10-06T02:27:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.866+0000 7f411164c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f410c068d90 0x7f410c0af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f411164c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410c06d5b0 con 0x7f410c06da40 2023-10-06T02:27:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f411164c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410c06dea0 con 0x7f410c0af1d0 2023-10-06T02:27:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f411164c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410c0caf90 con 0x7f410c068d90 2023-10-06T02:27:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f410b7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f410c06da40 0x7f410c159a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41298/0 (socket says 172.21.15.6:41298) 2023-10-06T02:27:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f410b7fe700 1 -- 172.21.15.6:0/126455566 learned_addr learned my addr 172.21.15.6:0/126455566 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f4109ffb700 1 -- 172.21.15.6:0/126455566 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108841035 0 0) 0x7f410c06d5b0 con 0x7f410c06da40 2023-10-06T02:27:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f4109ffb700 1 -- 172.21.15.6:0/126455566 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40f8003570 con 0x7f410c06da40 2023-10-06T02:27:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f410a7fc700 1 --2- 172.21.15.6:0/126455566 >> v2:172.21.15.175:3300/0 conn(0x7f410c068d90 0x7f410c0af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f4109ffb700 1 -- 172.21.15.6:0/126455566 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1606467760 0 0) 0x7f40f8003570 con 0x7f410c06da40 2023-10-06T02:27:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f4109ffb700 1 -- 172.21.15.6:0/126455566 >> v2:172.21.15.175:3300/0 conn(0x7f410c068d90 msgr2=0x7f410c0af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f4109ffb700 1 --2- 172.21.15.6:0/126455566 >> v2:172.21.15.175:3300/0 conn(0x7f410c068d90 0x7f410c0af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f4109ffb700 1 -- 172.21.15.6:0/126455566 >> v1:172.21.15.175:6789/0 conn(0x7f410c0af1d0 legacy=0x7f410c068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f4109ffb700 1 -- 172.21.15.6:0/126455566 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c15a9a0 con 0x7f410c06da40 2023-10-06T02:27:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f4109ffb700 1 -- 172.21.15.6:0/126455566 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f40fc001470 con 0x7f410c06da40 2023-10-06T02:27:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f4109ffb700 1 -- 172.21.15.6:0/126455566 >> v1:172.21.15.6:6789/0 conn(0x7f410c06da40 legacy=0x7f410c159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f4109ffb700 1 --2- 172.21.15.6:0/126455566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40f8003a60 0x7f40f8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f4109ffb700 1 --2- 172.21.15.6:0/126455566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40f8004810 0x7f40f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f4109ffb700 1 --2- 172.21.15.6:0/126455566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40f80051c0 0x7f40f800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f4109ffb700 1 -- 172.21.15.6:0/126455566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c0caf90 con 0x7f40f8003a60 2023-10-06T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f4109ffb700 1 -- 172.21.15.6:0/126455566 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f800c0d0 con 0x7f40f80051c0 2023-10-06T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f4109ffb700 1 -- 172.21.15.6:0/126455566 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f800c290 con 0x7f40f8004810 2023-10-06T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.867+0000 7f410affd700 1 --2- 172.21.15.6:0/126455566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40f8003a60 0x7f40f8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.868+0000 7f410b7fe700 1 --2- 172.21.15.6:0/126455566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40f80051c0 0x7f40f800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.868+0000 7f410a7fc700 1 --2- 172.21.15.6:0/126455566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40f8004810 0x7f40f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.868+0000 7f410affd700 1 -- 172.21.15.6:0/126455566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40f8004810 msgr2=0x7f40f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.868+0000 7f410affd700 1 --2- 172.21.15.6:0/126455566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40f8004810 0x7f40f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.868+0000 7f410affd700 1 -- 172.21.15.6:0/126455566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40f80051c0 msgr2=0x7f40f800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.868+0000 7f410affd700 1 --2- 172.21.15.6:0/126455566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40f80051c0 0x7f40f800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.868+0000 7f410b7fe700 1 -- 172.21.15.6:0/126455566 reap_dead start 2023-10-06T02:27:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.868+0000 7f410affd700 1 -- 172.21.15.6:0/126455566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f8003570 con 0x7f40f8003a60 2023-10-06T02:27:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.868+0000 7f410a7fc700 1 --2- 172.21.15.6:0/126455566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40f8004810 0x7f40f8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.868+0000 7f410affd700 1 --2- 172.21.15.6:0/126455566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40f8003a60 0x7f40f8003e70 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f4104001fc0 tx=0x7f4104001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7103d77a2261736f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.868+0000 7f4109ffb700 1 -- 172.21.15.6:0/126455566 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104001950 con 0x7f40f8003a60 2023-10-06T02:27:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.868+0000 7f4109ffb700 1 -- 172.21.15.6:0/126455566 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410400c8b0 con 0x7f40f8003a60 2023-10-06T02:27:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.868+0000 7f4109ffb700 1 -- 172.21.15.6:0/126455566 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410400cc50 con 0x7f40f8003a60 2023-10-06T02:27:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.869+0000 7f411164c700 1 -- 172.21.15.6:0/126455566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40f8003a60 msgr2=0x7f40f8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.869+0000 7f411164c700 1 --2- 172.21.15.6:0/126455566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40f8003a60 0x7f40f8003e70 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f4104001fc0 tx=0x7f4104001640 comp rx=0 tx=0).stop 2023-10-06T02:27:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.869+0000 7f411164c700 1 -- 172.21.15.6:0/126455566 shutdown_connections 2023-10-06T02:27:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.869+0000 7f411164c700 1 --2- 172.21.15.6:0/126455566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40f8003a60 0x7f40f8003e70 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.869+0000 7f411164c700 1 -- 172.21.15.6:0/126455566 >> 172.21.15.6:0/126455566 conn(0x7f410c06a220 msgr2=0x7f410c06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.869+0000 7f411164c700 1 -- 172.21.15.6:0/126455566 shutdown_connections 2023-10-06T02:27:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.869+0000 7f411164c700 1 -- 172.21.15.6:0/126455566 wait complete. 2023-10-06T02:27:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.870+0000 7f411164c700 1 Processor -- start 2023-10-06T02:27:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.870+0000 7f411164c700 1 -- start start 2023-10-06T02:27:26.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f411164c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40f8003a60 0x7f410c155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f411164c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f410c169ae0 0x7f410c0c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f411164c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f410c0b2170 0x7f410c0b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f411164c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c16a050 con 0x7f410c169ae0 2023-10-06T02:27:26.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f411164c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c16a330 con 0x7f40f8003a60 2023-10-06T02:27:26.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f411164c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410c16a610 con 0x7f410c0b2170 2023-10-06T02:27:26.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f410a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f410c169ae0 0x7f410c0c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f410a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f410c169ae0 0x7f410c0c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55858/0 (socket says 172.21.15.6:55858) 2023-10-06T02:27:26.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f410a7fc700 1 -- 172.21.15.6:0/2533117267 learned_addr learned my addr 172.21.15.6:0/2533117267 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:26.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f410b7fe700 1 --2- 172.21.15.6:0/2533117267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f410c0b2170 0x7f410c0b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f410affd700 1 --2- 172.21.15.6:0/2533117267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40f8003a60 0x7f410c155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f410a7fc700 1 -- 172.21.15.6:0/2533117267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f410c0b2170 msgr2=0x7f410c0b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f410a7fc700 1 --2- 172.21.15.6:0/2533117267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f410c0b2170 0x7f410c0b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f410a7fc700 1 -- 172.21.15.6:0/2533117267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40f8003a60 msgr2=0x7f410c155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f410a7fc700 1 --2- 172.21.15.6:0/2533117267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40f8003a60 0x7f410c155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f410a7fc700 1 -- 172.21.15.6:0/2533117267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c16a8f0 con 0x7f410c169ae0 2023-10-06T02:27:26.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f410a7fc700 1 --2- 172.21.15.6:0/2533117267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f410c169ae0 0x7f410c0c85e0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f40f4011700 tx=0x7f40f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f4102ffd700 1 -- 172.21.15.6:0/2533117267 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4015670 con 0x7f410c169ae0 2023-10-06T02:27:26.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f4102ffd700 1 -- 172.21.15.6:0/2533117267 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f40157d0 con 0x7f410c169ae0 2023-10-06T02:27:26.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f4102ffd700 1 -- 172.21.15.6:0/2533117267 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4015b90 con 0x7f410c169ae0 2023-10-06T02:27:26.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f411164c700 1 -- 172.21.15.6:0/2533117267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410c16abd0 con 0x7f410c169ae0 2023-10-06T02:27:26.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.871+0000 7f411164c700 1 -- 172.21.15.6:0/2533117267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410c0b2b20 con 0x7f410c169ae0 2023-10-06T02:27:26.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.872+0000 7f411164c700 1 -- 172.21.15.6:0/2533117267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f410c06e720 con 0x7f410c169ae0 2023-10-06T02:27:26.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.873+0000 7f4102ffd700 1 -- 172.21.15.6:0/2533117267 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40f4013410 con 0x7f410c169ae0 2023-10-06T02:27:26.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.873+0000 7f4102ffd700 1 --2- 172.21.15.6:0/2533117267 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f40ec066f30 0x7f40ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.873+0000 7f4102ffd700 1 -- 172.21.15.6:0/2533117267 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8356+0+0 (secure 0 0 0) 0x7f40f40851f0 con 0x7f410c169ae0 2023-10-06T02:27:26.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.874+0000 7f410affd700 1 --2- 172.21.15.6:0/2533117267 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f40ec066f30 0x7f40ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.874+0000 7f410affd700 1 --2- 172.21.15.6:0/2533117267 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f40ec066f30 0x7f40ec0693e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4104001da0 tx=0x7f4104015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:26.878+0000 7f4102ffd700 1 -- 172.21.15.6:0/2533117267 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40f4051a80 con 0x7f410c169ae0 2023-10-06T02:27:27.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.122+0000 7f411164c700 1 -- 172.21.15.6:0/2533117267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f410c16ad60 con 0x7f410c169ae0 2023-10-06T02:27:27.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.122+0000 7f4102ffd700 1 -- 172.21.15.6:0/2533117267 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 234 v234) v1 ==== 95+0+4592 (secure 0 0 0) 0x7f40f4019090 con 0x7f410c169ae0 2023-10-06T02:27:27.123 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:27.123 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":234,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9432,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/172936756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":172936756},{"type":"v1","addr":"172.21.15.6:6835","nonce":172936756}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":234}],"filesystems":[{"mdsmap":{"epoch":233,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:25.920101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:27.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.124+0000 7f411164c700 1 -- 172.21.15.6:0/2533117267 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f40ec066f30 msgr2=0x7f40ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.124+0000 7f411164c700 1 --2- 172.21.15.6:0/2533117267 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f40ec066f30 0x7f40ec0693e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4104001da0 tx=0x7f4104015000 comp rx=0 tx=0).stop 2023-10-06T02:27:27.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.124+0000 7f411164c700 1 -- 172.21.15.6:0/2533117267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f410c169ae0 msgr2=0x7f410c0c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.124+0000 7f411164c700 1 --2- 172.21.15.6:0/2533117267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f410c169ae0 0x7f410c0c85e0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f40f4011700 tx=0x7f40f4008040 comp rx=0 tx=0).stop 2023-10-06T02:27:27.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.124+0000 7f411164c700 1 -- 172.21.15.6:0/2533117267 shutdown_connections 2023-10-06T02:27:27.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.124+0000 7f411164c700 1 --2- 172.21.15.6:0/2533117267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f410c0b2170 0x7f410c0b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.124+0000 7f411164c700 1 --2- 172.21.15.6:0/2533117267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40f8003a60 0x7f410c155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.124+0000 7f411164c700 1 --2- 172.21.15.6:0/2533117267 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f40ec066f30 0x7f40ec0693e0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.124+0000 7f411164c700 1 --2- 172.21.15.6:0/2533117267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f410c169ae0 0x7f410c0c85e0 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.124+0000 7f411164c700 1 -- 172.21.15.6:0/2533117267 >> 172.21.15.6:0/2533117267 conn(0x7f410c06a220 msgr2=0x7f410c156c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:27.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.124+0000 7f411164c700 1 -- 172.21.15.6:0/2533117267 shutdown_connections 2023-10-06T02:27:27.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.124+0000 7f411164c700 1 -- 172.21.15.6:0/2533117267 wait complete. 2023-10-06T02:27:27.126 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 234 2023-10-06T02:27:27.137 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt 100.00000000.inode' led to DAMAGED state 2023-10-06T02:27:27.137 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 1.00000000.inode' 2023-10-06T02:27:27.137 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:27.138 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:27:27.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:27.138 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:27:27.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:27:27.154 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:27:27.154 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:27:27.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.314+0000 7f061e487700 1 Processor -- start 2023-10-06T02:27:27.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.314+0000 7f061e487700 1 -- start start 2023-10-06T02:27:27.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.315+0000 7f061e487700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0618159400 0x7f06180ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.315+0000 7f061e487700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f06180d05d0 0x7f06180b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.315+0000 7f061e487700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06180b3560 con 0x7f06180cd030 2023-10-06T02:27:27.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.315+0000 7f061e487700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06180cf6f0 con 0x7f06180d05d0 2023-10-06T02:27:27.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.315+0000 7f061e487700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06180cf9d0 con 0x7f0618159400 2023-10-06T02:27:27.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.315+0000 7f061dc86700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f06180d05d0 0x7f06180b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.315+0000 7f061dc86700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f06180d05d0 0x7f06180b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55874/0 (socket says 172.21.15.6:55874) 2023-10-06T02:27:27.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.315+0000 7f061dc86700 1 -- 172.21.15.6:0/2873803694 learned_addr learned my addr 172.21.15.6:0/2873803694 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:27.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.315+0000 7f061d485700 1 --2- 172.21.15.6:0/2873803694 >> v2:172.21.15.175:3300/0 conn(0x7f0618159400 0x7f06180ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.315+0000 7f061dc86700 1 -- 172.21.15.6:0/2873803694 >> v2:172.21.15.175:3300/0 conn(0x7f0618159400 msgr2=0x7f06180ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:27.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.315+0000 7f061dc86700 1 --2- 172.21.15.6:0/2873803694 >> v2:172.21.15.175:3300/0 conn(0x7f0618159400 0x7f06180ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.315+0000 7f061dc86700 1 -- 172.21.15.6:0/2873803694 >> v1:172.21.15.175:6789/0 conn(0x7f06180cd030 legacy=0x7f06180cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:27.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.316+0000 7f061dc86700 1 -- 172.21.15.6:0/2873803694 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06180b2f10 con 0x7f06180d05d0 2023-10-06T02:27:27.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.316+0000 7f061dc86700 1 --2- 172.21.15.6:0/2873803694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06180d05d0 0x7f06180b39f0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f0618067fc0 tx=0x7f0608009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d9fdd529e8aac4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:27.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.316+0000 7f0617fff700 1 -- 172.21.15.6:0/2873803694 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060800e070 con 0x7f06180d05d0 2023-10-06T02:27:27.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.316+0000 7f0617fff700 1 -- 172.21.15.6:0/2873803694 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060800ba10 con 0x7f06180d05d0 2023-10-06T02:27:27.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.316+0000 7f0617fff700 1 -- 172.21.15.6:0/2873803694 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06080092e0 con 0x7f06180d05d0 2023-10-06T02:27:27.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.316+0000 7f061e487700 1 -- 172.21.15.6:0/2873803694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06180d05d0 msgr2=0x7f06180b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.316+0000 7f061e487700 1 --2- 172.21.15.6:0/2873803694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06180d05d0 0x7f06180b39f0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f0618067fc0 tx=0x7f0608009840 comp rx=0 tx=0).stop 2023-10-06T02:27:27.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.316+0000 7f061e487700 1 -- 172.21.15.6:0/2873803694 shutdown_connections 2023-10-06T02:27:27.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.316+0000 7f061e487700 1 --2- 172.21.15.6:0/2873803694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06180d05d0 0x7f06180b39f0 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.316+0000 7f061e487700 1 --2- 172.21.15.6:0/2873803694 >> v2:172.21.15.175:3300/0 conn(0x7f0618159400 0x7f06180ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.316+0000 7f061e487700 1 -- 172.21.15.6:0/2873803694 >> 172.21.15.6:0/2873803694 conn(0x7f061806ac10 msgr2=0x7f0618068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:27.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.316+0000 7f061e487700 1 -- 172.21.15.6:0/2873803694 shutdown_connections 2023-10-06T02:27:27.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.316+0000 7f061e487700 1 -- 172.21.15.6:0/2873803694 wait complete. 2023-10-06T02:27:27.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.318+0000 7f061e487700 1 Processor -- start 2023-10-06T02:27:27.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.318+0000 7f061e487700 1 -- start start 2023-10-06T02:27:27.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.318+0000 7f061e487700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06180cd030 0x7f0618169780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.318+0000 7f061e487700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06180d05d0 0x7f061815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.318+0000 7f061e487700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0618159400 0x7f06181597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.318+0000 7f061e487700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061815afe0 con 0x7f0618159400 2023-10-06T02:27:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.318+0000 7f061e487700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0618152790 con 0x7f06180d05d0 2023-10-06T02:27:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.318+0000 7f061e487700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061816ceb0 con 0x7f06180cd030 2023-10-06T02:27:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.319+0000 7f061dc86700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0618159400 0x7f06181597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.319+0000 7f061dc86700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0618159400 0x7f06181597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55884/0 (socket says 172.21.15.6:55884) 2023-10-06T02:27:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.319+0000 7f061dc86700 1 -- 172.21.15.6:0/3332190618 learned_addr learned my addr 172.21.15.6:0/3332190618 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.319+0000 7f061cc84700 1 --2- 172.21.15.6:0/3332190618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06180d05d0 0x7f061815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.319+0000 7f061d485700 1 --2- 172.21.15.6:0/3332190618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06180cd030 0x7f0618169780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.319+0000 7f061dc86700 1 -- 172.21.15.6:0/3332190618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06180cd030 msgr2=0x7f0618169780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.319+0000 7f061dc86700 1 --2- 172.21.15.6:0/3332190618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06180cd030 0x7f0618169780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.319+0000 7f061dc86700 1 -- 172.21.15.6:0/3332190618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06180d05d0 msgr2=0x7f061815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.319+0000 7f061dc86700 1 --2- 172.21.15.6:0/3332190618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06180d05d0 0x7f061815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.319+0000 7f061dc86700 1 -- 172.21.15.6:0/3332190618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0608009ae0 con 0x7f0618159400 2023-10-06T02:27:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.319+0000 7f061dc86700 1 --2- 172.21.15.6:0/3332190618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0618159400 0x7f06181597d0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f0608003000 tx=0x7f0608017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.319+0000 7f06157fa700 1 -- 172.21.15.6:0/3332190618 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060800bee0 con 0x7f0618159400 2023-10-06T02:27:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.319+0000 7f06157fa700 1 -- 172.21.15.6:0/3332190618 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06080032f0 con 0x7f0618159400 2023-10-06T02:27:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.319+0000 7f061e487700 1 -- 172.21.15.6:0/3332190618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0618169dd0 con 0x7f0618159400 2023-10-06T02:27:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.319+0000 7f06157fa700 1 -- 172.21.15.6:0/3332190618 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060801d420 con 0x7f0618159400 2023-10-06T02:27:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.319+0000 7f061e487700 1 -- 172.21.15.6:0/3332190618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061816a390 con 0x7f0618159400 2023-10-06T02:27:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.320+0000 7f061e487700 1 -- 172.21.15.6:0/3332190618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061816a6d0 con 0x7f0618159400 2023-10-06T02:27:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.321+0000 7f06157fa700 1 -- 172.21.15.6:0/3332190618 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f060801d850 con 0x7f0618159400 2023-10-06T02:27:27.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.321+0000 7f06157fa700 1 --2- 172.21.15.6:0/3332190618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0604066f30 0x7f06040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.321+0000 7f06157fa700 1 -- 172.21.15.6:0/3332190618 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8356+0+0 (secure 0 0 0) 0x7f06080866f0 con 0x7f0618159400 2023-10-06T02:27:27.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.321+0000 7f061d485700 1 --2- 172.21.15.6:0/3332190618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0604066f30 0x7f06040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.322+0000 7f061d485700 1 --2- 172.21.15.6:0/3332190618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0604066f30 0x7f06040693e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f06100061f0 tx=0x7f0610008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:27.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.325+0000 7f06157fa700 1 -- 172.21.15.6:0/3332190618 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0608052ec0 con 0x7f0618159400 2023-10-06T02:27:27.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.564+0000 7f061e487700 1 -- 172.21.15.6:0/3332190618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f06180b31f0 con 0x7f0618159400 2023-10-06T02:27:27.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.928+0000 7f06157fa700 1 -- 172.21.15.6:0/3332190618 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v235) v1 ==== 161+0+0 (secure 0 0 0) 0x7f06080564e0 con 0x7f0618159400 2023-10-06T02:27:27.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.931+0000 7f061e487700 1 -- 172.21.15.6:0/3332190618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0604066f30 msgr2=0x7f06040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.931+0000 7f061e487700 1 --2- 172.21.15.6:0/3332190618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0604066f30 0x7f06040693e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f06100061f0 tx=0x7f0610008040 comp rx=0 tx=0).stop 2023-10-06T02:27:27.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.931+0000 7f061e487700 1 -- 172.21.15.6:0/3332190618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0618159400 msgr2=0x7f06181597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.931+0000 7f061e487700 1 --2- 172.21.15.6:0/3332190618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0618159400 0x7f06181597d0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f0608003000 tx=0x7f0608017000 comp rx=0 tx=0).stop 2023-10-06T02:27:27.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.931+0000 7f061e487700 1 -- 172.21.15.6:0/3332190618 shutdown_connections 2023-10-06T02:27:27.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.931+0000 7f061e487700 1 --2- 172.21.15.6:0/3332190618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0604066f30 0x7f06040693e0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.931+0000 7f061e487700 1 --2- 172.21.15.6:0/3332190618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0618159400 0x7f06181597d0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.931+0000 7f061e487700 1 --2- 172.21.15.6:0/3332190618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06180cd030 0x7f0618169780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.931+0000 7f061e487700 1 --2- 172.21.15.6:0/3332190618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06180d05d0 0x7f061815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.931+0000 7f061e487700 1 -- 172.21.15.6:0/3332190618 >> 172.21.15.6:0/3332190618 conn(0x7f061806ac10 msgr2=0x7f0618154b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:27.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.931+0000 7f061e487700 1 -- 172.21.15.6:0/3332190618 shutdown_connections 2023-10-06T02:27:27.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:27.931+0000 7f061e487700 1 -- 172.21.15.6:0/3332190618 wait complete. 2023-10-06T02:27:27.933 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:27:27.945 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:27:28.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.069+0000 7f76955e7700 1 Processor -- start 2023-10-06T02:27:28.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.069+0000 7f76955e7700 1 -- start start 2023-10-06T02:27:28.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.069+0000 7f76955e7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f76900b0ee0 0x7f7690068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:28.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.069+0000 7f76955e7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76900c2b20 0x7f76900c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:28.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.069+0000 7f76955e7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76900c34b0 con 0x7f769006ea50 2023-10-06T02:27:28.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.069+0000 7f76955e7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7690159a70 con 0x7f76900b0ee0 2023-10-06T02:27:28.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.069+0000 7f76955e7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7690159d30 con 0x7f76900c2b20 2023-10-06T02:27:28.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.070+0000 7f768f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76900c2b20 0x7f76900c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:28.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.070+0000 7f768ffff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f76900b0ee0 0x7f7690068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.070+0000 7f768ffff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f76900b0ee0 0x7f7690068680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:39962/0 (socket says 172.21.15.6:39962) 2023-10-06T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.070+0000 7f768f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76900c2b20 0x7f76900c2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:37130/0 (socket says 172.21.15.6:37130) 2023-10-06T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.070+0000 7f768ffff700 1 -- 172.21.15.6:0/1950893445 learned_addr learned my addr 172.21.15.6:0/1950893445 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.070+0000 7f7694de6700 1 --1- 172.21.15.6:0/1950893445 >> v1:172.21.15.175:6789/0 conn(0x7f769006ea50 0x7f76900af680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:42830/0 (socket says 172.21.15.6:42830) 2023-10-06T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.070+0000 7f768ffff700 1 -- 172.21.15.6:0/1950893445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76900c2b20 msgr2=0x7f76900c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.070+0000 7f768ffff700 1 --2- 172.21.15.6:0/1950893445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76900c2b20 0x7f76900c2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.070+0000 7f768ffff700 1 -- 172.21.15.6:0/1950893445 >> v1:172.21.15.175:6789/0 conn(0x7f769006ea50 legacy=0x7f76900af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.070+0000 7f768ffff700 1 -- 172.21.15.6:0/1950893445 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769015a010 con 0x7f76900b0ee0 2023-10-06T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.070+0000 7f768f7fe700 1 --2- 172.21.15.6:0/1950893445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76900c2b20 0x7f76900c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.070+0000 7f768ffff700 1 --2- 172.21.15.6:0/1950893445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76900b0ee0 0x7f7690068680 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f76800099b0 tx=0x7f7680009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bcd980c1e3d6bd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.071+0000 7f768effd700 1 -- 172.21.15.6:0/1950893445 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680009ea0 con 0x7f76900b0ee0 2023-10-06T02:27:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.071+0000 7f768effd700 1 -- 172.21.15.6:0/1950893445 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768000b860 con 0x7f76900b0ee0 2023-10-06T02:27:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.071+0000 7f768effd700 1 -- 172.21.15.6:0/1950893445 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768000bc20 con 0x7f76900b0ee0 2023-10-06T02:27:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.071+0000 7f76955e7700 1 -- 172.21.15.6:0/1950893445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76900b0ee0 msgr2=0x7f7690068680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.071+0000 7f76955e7700 1 --2- 172.21.15.6:0/1950893445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76900b0ee0 0x7f7690068680 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f76800099b0 tx=0x7f7680009250 comp rx=0 tx=0).stop 2023-10-06T02:27:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.071+0000 7f76955e7700 1 -- 172.21.15.6:0/1950893445 shutdown_connections 2023-10-06T02:27:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.071+0000 7f76955e7700 1 --2- 172.21.15.6:0/1950893445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76900b0ee0 0x7f7690068680 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.071+0000 7f76955e7700 1 --2- 172.21.15.6:0/1950893445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76900c2b20 0x7f76900c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.071+0000 7f76955e7700 1 -- 172.21.15.6:0/1950893445 >> 172.21.15.6:0/1950893445 conn(0x7f76900cc5e0 msgr2=0x7f76900cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.071+0000 7f76955e7700 1 -- 172.21.15.6:0/1950893445 shutdown_connections 2023-10-06T02:27:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.071+0000 7f76955e7700 1 -- 172.21.15.6:0/1950893445 wait complete. 2023-10-06T02:27:28.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.072+0000 7f76955e7700 1 Processor -- start 2023-10-06T02:27:28.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.073+0000 7f76955e7700 1 -- start start 2023-10-06T02:27:28.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.073+0000 7f76955e7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f769006ea50 0x7f7690169690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:28.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.073+0000 7f76955e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76900b0ee0 0x7f769016a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:28.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.073+0000 7f76955e7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76900c2b20 0x7f7690167850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:28.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.073+0000 7f76955e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769016abd0 con 0x7f76900b0ee0 2023-10-06T02:27:28.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.073+0000 7f76955e7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769016bef0 con 0x7f769006ea50 2023-10-06T02:27:28.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.073+0000 7f76955e7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7690167d90 con 0x7f76900c2b20 2023-10-06T02:27:28.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.073+0000 7f768f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76900b0ee0 0x7f769016a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:28.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.073+0000 7f768f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76900b0ee0 0x7f769016a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55898/0 (socket says 172.21.15.6:55898) 2023-10-06T02:27:28.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.073+0000 7f768f7fe700 1 -- 172.21.15.6:0/1596275069 learned_addr learned my addr 172.21.15.6:0/1596275069 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:28.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.074+0000 7f768ffff700 1 --2- 172.21.15.6:0/1596275069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f769006ea50 0x7f7690169690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:28.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.074+0000 7f7694de6700 1 --2- 172.21.15.6:0/1596275069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76900c2b20 0x7f7690167850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:28.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.074+0000 7f768f7fe700 1 -- 172.21.15.6:0/1596275069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76900c2b20 msgr2=0x7f7690167850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.074+0000 7f768f7fe700 1 --2- 172.21.15.6:0/1596275069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76900c2b20 0x7f7690167850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.074+0000 7f768f7fe700 1 -- 172.21.15.6:0/1596275069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f769006ea50 msgr2=0x7f7690169690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.074+0000 7f768f7fe700 1 --2- 172.21.15.6:0/1596275069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f769006ea50 0x7f7690169690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.074+0000 7f768f7fe700 1 -- 172.21.15.6:0/1596275069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7684009420 con 0x7f76900b0ee0 2023-10-06T02:27:28.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.074+0000 7f768f7fe700 1 --2- 172.21.15.6:0/1596275069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76900b0ee0 0x7f769016a690 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f768400ec80 tx=0x7f76840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:28.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.074+0000 7f7677fff700 1 -- 172.21.15.6:0/1596275069 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768400c8c0 con 0x7f76900b0ee0 2023-10-06T02:27:28.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.074+0000 7f7677fff700 1 -- 172.21.15.6:0/1596275069 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768400ca20 con 0x7f76900b0ee0 2023-10-06T02:27:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.074+0000 7f76955e7700 1 -- 172.21.15.6:0/1596275069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76800094f0 con 0x7f76900b0ee0 2023-10-06T02:27:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.074+0000 7f7677fff700 1 -- 172.21.15.6:0/1596275069 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768400cda0 con 0x7f76900b0ee0 2023-10-06T02:27:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.074+0000 7f76955e7700 1 -- 172.21.15.6:0/1596275069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769016b5c0 con 0x7f76900b0ee0 2023-10-06T02:27:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.075+0000 7f76955e7700 1 -- 172.21.15.6:0/1596275069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769006e250 con 0x7f76900b0ee0 2023-10-06T02:27:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.076+0000 7f7677fff700 1 -- 172.21.15.6:0/1596275069 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7684013680 con 0x7f76900b0ee0 2023-10-06T02:27:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.076+0000 7f7677fff700 1 --2- 172.21.15.6:0/1596275069 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f767c066f30 0x7f767c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.076+0000 7f7677fff700 1 -- 172.21.15.6:0/1596275069 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8356+0+0 (secure 0 0 0) 0x7f7684085710 con 0x7f76900b0ee0 2023-10-06T02:27:28.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.076+0000 7f768ffff700 1 --2- 172.21.15.6:0/1596275069 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f767c066f30 0x7f767c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:28.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.077+0000 7f768ffff700 1 --2- 172.21.15.6:0/1596275069 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f767c066f30 0x7f767c0693e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f76800099b0 tx=0x7f7680017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:28.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.081+0000 7f7677fff700 1 -- 172.21.15.6:0/1596275069 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7684051ee0 con 0x7f76900b0ee0 2023-10-06T02:27:28.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.354+0000 7f76955e7700 1 -- 172.21.15.6:0/1596275069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f769016c030 con 0x7f76900b0ee0 2023-10-06T02:27:28.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.936+0000 7f7677fff700 1 -- 172.21.15.6:0/1596275069 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v236) v1 ==== 101+0+0 (secure 0 0 0) 0x7f7684017090 con 0x7f76900b0ee0 2023-10-06T02:27:28.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.939+0000 7f76955e7700 1 -- 172.21.15.6:0/1596275069 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f767c066f30 msgr2=0x7f767c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.939+0000 7f76955e7700 1 --2- 172.21.15.6:0/1596275069 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f767c066f30 0x7f767c0693e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f76800099b0 tx=0x7f7680017000 comp rx=0 tx=0).stop 2023-10-06T02:27:28.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.939+0000 7f76955e7700 1 -- 172.21.15.6:0/1596275069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76900b0ee0 msgr2=0x7f769016a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.939+0000 7f76955e7700 1 --2- 172.21.15.6:0/1596275069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76900b0ee0 0x7f769016a690 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f768400ec80 tx=0x7f76840091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.939+0000 7f76955e7700 1 -- 172.21.15.6:0/1596275069 shutdown_connections 2023-10-06T02:27:28.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.939+0000 7f76955e7700 1 --2- 172.21.15.6:0/1596275069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76900c2b20 0x7f7690167850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.939+0000 7f76955e7700 1 --2- 172.21.15.6:0/1596275069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f769006ea50 0x7f7690169690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.939+0000 7f76955e7700 1 --2- 172.21.15.6:0/1596275069 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f767c066f30 0x7f767c0693e0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.939+0000 7f76955e7700 1 --2- 172.21.15.6:0/1596275069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76900b0ee0 0x7f769016a690 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.939+0000 7f76955e7700 1 -- 172.21.15.6:0/1596275069 >> 172.21.15.6:0/1596275069 conn(0x7f76900cc5e0 msgr2=0x7f76900ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:28.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.939+0000 7f76955e7700 1 -- 172.21.15.6:0/1596275069 shutdown_connections 2023-10-06T02:27:28.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.939+0000 7f76955e7700 1 -- 172.21.15.6:0/1596275069 wait complete. 2023-10-06T02:27:28.941 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:27:28.955 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:27:28.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.997+0000 7f698d4fe000 1 Processor -- start 2023-10-06T02:27:28.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.997+0000 7f698d4fe000 1 -- start start 2023-10-06T02:27:29.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.997+0000 7f698d4fe000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f86316dcc0 0x55f8631b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.997+0000 7f698d4fe000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f86319aa00 0x55f863240990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.997+0000 7f698d4fe000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f863228cc0 0x55f8631af840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.997+0000 7f698d4fe000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8630b5980 con 0x55f86316dcc0 2023-10-06T02:27:29.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.997+0000 7f698d4fe000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8630b5620 con 0x55f86319aa00 2023-10-06T02:27:29.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.997+0000 7f698d4fe000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8630ac400 con 0x55f863228cc0 2023-10-06T02:27:29.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.998+0000 7f6986739700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f86316dcc0 0x55f8631b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.998+0000 7f6986739700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f86316dcc0 0x55f8631b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34824/0 (socket says 172.21.15.6:34824) 2023-10-06T02:27:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.998+0000 7f6986739700 1 -- 172.21.15.6:0/1054066402 learned_addr learned my addr 172.21.15.6:0/1054066402 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.998+0000 7f6985f38700 1 --2- 172.21.15.6:0/1054066402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f86319aa00 0x55f863240990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.998+0000 7f6986f3a700 1 --2- 172.21.15.6:0/1054066402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f863228cc0 0x55f8631af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.998+0000 7f6986739700 1 -- 172.21.15.6:0/1054066402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f863228cc0 msgr2=0x55f8631af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.998+0000 7f6986739700 1 --2- 172.21.15.6:0/1054066402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f863228cc0 0x55f8631af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.998+0000 7f6986739700 1 -- 172.21.15.6:0/1054066402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f86319aa00 msgr2=0x55f863240990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.998+0000 7f6986739700 1 --2- 172.21.15.6:0/1054066402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f86319aa00 0x55f863240990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.998+0000 7f6986739700 1 -- 172.21.15.6:0/1054066402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698000a0e0 con 0x55f86316dcc0 2023-10-06T02:27:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.998+0000 7f6986739700 1 --2- 172.21.15.6:0/1054066402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f86316dcc0 0x55f8631b2c50 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f6978001cf0 tx=0x7f6978001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abedd72c67deb5e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.998+0000 7f6984f36700 1 -- 172.21.15.6:0/1054066402 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697800baf0 con 0x55f86316dcc0 2023-10-06T02:27:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.998+0000 7f6984f36700 1 -- 172.21.15.6:0/1054066402 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697800bc70 con 0x55f86316dcc0 2023-10-06T02:27:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.998+0000 7f6984f36700 1 -- 172.21.15.6:0/1054066402 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697800e470 con 0x55f86316dcc0 2023-10-06T02:27:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.999+0000 7f698d4fe000 1 -- 172.21.15.6:0/1054066402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f86316dcc0 msgr2=0x55f8631b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.999+0000 7f698d4fe000 1 --2- 172.21.15.6:0/1054066402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f86316dcc0 0x55f8631b2c50 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f6978001cf0 tx=0x7f6978001770 comp rx=0 tx=0).stop 2023-10-06T02:27:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.999+0000 7f698d4fe000 1 -- 172.21.15.6:0/1054066402 shutdown_connections 2023-10-06T02:27:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.999+0000 7f698d4fe000 1 --2- 172.21.15.6:0/1054066402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f863228cc0 0x55f8631af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.999+0000 7f698d4fe000 1 --2- 172.21.15.6:0/1054066402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f86316dcc0 0x55f8631b2c50 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.999+0000 7f698d4fe000 1 --2- 172.21.15.6:0/1054066402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f86319aa00 0x55f863240990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.999+0000 7f698d4fe000 1 -- 172.21.15.6:0/1054066402 >> 172.21.15.6:0/1054066402 conn(0x55f8631696c0 msgr2=0x55f86316d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.999+0000 7f698d4fe000 1 -- 172.21.15.6:0/1054066402 shutdown_connections 2023-10-06T02:27:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.999+0000 7f698d4fe000 1 -- 172.21.15.6:0/1054066402 wait complete. 2023-10-06T02:27:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.999+0000 7f698d4fe000 1 Processor -- start 2023-10-06T02:27:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:28.999+0000 7f698d4fe000 1 -- start start 2023-10-06T02:27:29.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.000+0000 7f698d4fe000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f86316dcc0 0x55f863223370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.000+0000 7f698d4fe000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f86319aa00 0x55f86321f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.000+0000 7f698d4fe000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f863228cc0 0x55f863220640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.000+0000 7f698d4fe000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f86323cd60 con 0x55f86319aa00 2023-10-06T02:27:29.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.000+0000 7f698d4fe000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f86323d000 con 0x55f863228cc0 2023-10-06T02:27:29.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.000+0000 7f698d4fe000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f86323d2a0 con 0x55f86316dcc0 2023-10-06T02:27:29.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.000+0000 7f6985f38700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f86319aa00 0x55f86321f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.000+0000 7f6985f38700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f86319aa00 0x55f86321f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34838/0 (socket says 172.21.15.6:34838) 2023-10-06T02:27:29.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.000+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 learned_addr learned my addr 172.21.15.6:0/2166665323 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.000+0000 7f6986739700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f86316dcc0 0x55f863223370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.000+0000 7f6986f3a700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f863228cc0 0x55f863220640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.001+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f86316dcc0 msgr2=0x55f863223370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.001+0000 7f6985f38700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f86316dcc0 0x55f863223370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.001+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f863228cc0 msgr2=0x55f863220640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.001+0000 7f6985f38700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f863228cc0 0x55f863220640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.001+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970001e10 con 0x55f86319aa00 2023-10-06T02:27:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.001+0000 7f6986739700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f86316dcc0 0x55f863223370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.001+0000 7f6985f38700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f86319aa00 0x55f86321f990 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f697c011000 tx=0x7f697c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.001+0000 7f6976ffd700 1 -- 172.21.15.6:0/2166665323 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c0054f0 con 0x55f86319aa00 2023-10-06T02:27:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.001+0000 7f6976ffd700 1 -- 172.21.15.6:0/2166665323 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c0078e0 con 0x55f86319aa00 2023-10-06T02:27:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.001+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697c005cf0 con 0x55f86319aa00 2023-10-06T02:27:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.001+0000 7f6976ffd700 1 -- 172.21.15.6:0/2166665323 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c01d3f0 con 0x55f86319aa00 2023-10-06T02:27:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.001+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8630c43d0 con 0x55f86319aa00 2023-10-06T02:27:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.002+0000 7f6976ffd700 1 -- 172.21.15.6:0/2166665323 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f697c019040 con 0x55f86319aa00 2023-10-06T02:27:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.003+0000 7f6976ffd700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f69680658c0 0x7f6968067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.003+0000 7f6976ffd700 1 -- 172.21.15.6:0/2166665323 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8356+0+0 (secure 0 0 0) 0x7f697c0853f0 con 0x55f86319aa00 2023-10-06T02:27:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.003+0000 7f6986739700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f69680658c0 0x7f6968067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.007 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:27:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.003+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55f863220b80 0x55f86323dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.003+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86323e1c0 con 0x55f863220b80 2023-10-06T02:27:29.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.003+0000 7f6986f3a700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55f863220b80 0x55f86323dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.004+0000 7f6986f3a700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55f863220b80 0x55f86323dc80 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.004+0000 7f6986739700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f69680658c0 0x7f6968067d70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6978001cf0 tx=0x7f6978014000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.005+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v118'691 uv665 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.006+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325e440 con 0x55f863220b80 2023-10-06T02:27:29.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.007+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v118'692 uv692 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.007+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325e7f0 con 0x55f863220b80 2023-10-06T02:27:29.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.008+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v118'693 uv693 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.010 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:27:29.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.008+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325fbb0 con 0x55f863220b80 2023-10-06T02:27:29.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.009+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v118'694 uv694 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.009+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325ff60 con 0x55f863220b80 2023-10-06T02:27:29.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.011+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v118'695 uv695 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.011+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325eba0 con 0x55f863220b80 2023-10-06T02:27:29.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.012+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v118'696 uv696 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.012+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325ef80 con 0x55f863220b80 2023-10-06T02:27:29.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.014+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v118'697 uv671 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.014+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f380 con 0x55f863220b80 2023-10-06T02:27:29.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.015+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v118'698 uv698 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.015+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f380 con 0x55f863220b80 2023-10-06T02:27:29.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.016+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v118'699 uv699 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.017 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:27:29.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.016+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.017+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v118'700 uv700 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.017+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.018+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v118'701 uv701 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.018+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.020+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v118'702 uv702 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.020+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.021+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v118'703 uv678 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.021+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.022+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v118'704 uv704 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.022+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.023+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v118'705 uv705 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.024 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:27:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.023+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.024+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v118'706 uv706 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.024+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.026+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v118'707 uv707 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.026+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.027+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v118'708 uv708 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.027+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.028+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v118'709 uv709 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.028+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.029+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v118'710 uv684 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.029+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.031+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v118'711 uv711 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.031+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.032+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v118'712 uv712 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.032 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:27:29.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.032+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.033+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v118'713 uv713 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.033+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.034+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v118'714 uv714 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.034+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.035+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v118'715 uv715 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.035+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.037+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v118'716 uv690 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.037+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.038+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v118'717 uv717 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.038+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.039+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v118'718 uv718 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.040 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:27:29.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.039+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.041+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v118'719 uv719 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.041+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.042+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v118'720 uv720 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.042+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f863220b80 2023-10-06T02:27:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.044+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v118'721 uv721 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863220b80 2023-10-06T02:27:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.044+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55f86325f710 0x55f863262830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.044+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86325f330 con 0x55f86325f710 2023-10-06T02:27:29.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.044+0000 7f6986739700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55f86325f710 0x55f863262830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.045+0000 7f6986739700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55f86325f710 0x55f863262830 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.046+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v118'499 uv482 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.046+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863262d70 con 0x55f86325f710 2023-10-06T02:27:29.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.048+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v118'500 uv500 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.048+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863263120 con 0x55f86325f710 2023-10-06T02:27:29.049 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:27:29.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.049+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v118'501 uv501 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.049+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f8632634d0 con 0x55f86325f710 2023-10-06T02:27:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.050+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v118'502 uv502 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.050+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863263880 con 0x55f86325f710 2023-10-06T02:27:29.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.051+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v118'503 uv503 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.051+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863263ca0 con 0x55f86325f710 2023-10-06T02:27:29.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.052+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v118'504 uv487 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.052+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f8632640a0 con 0x55f86325f710 2023-10-06T02:27:29.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.053+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v118'505 uv505 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.053+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f8632640a0 con 0x55f86325f710 2023-10-06T02:27:29.055 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:27:29.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.055+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v118'506 uv506 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.055+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f8632640a0 con 0x55f86325f710 2023-10-06T02:27:29.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.056+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v118'507 uv507 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.056+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863241b00 con 0x55f86325f710 2023-10-06T02:27:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.057+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v118'508 uv508 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.057+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863241b00 con 0x55f86325f710 2023-10-06T02:27:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.058+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v118'509 uv492 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.058+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f8632640a0 con 0x55f86325f710 2023-10-06T02:27:29.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.060+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v118'510 uv510 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.060+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f8632640a0 con 0x55f86325f710 2023-10-06T02:27:29.061 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:27:29.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.061+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v118'511 uv511 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.061+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f8632677c0 con 0x55f86325f710 2023-10-06T02:27:29.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.062+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v118'512 uv512 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.062+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863241b00 con 0x55f86325f710 2023-10-06T02:27:29.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.064+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v118'513 uv513 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.064+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863241b00 con 0x55f86325f710 2023-10-06T02:27:29.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.065+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v118'514 uv498 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.065+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f8632640a0 con 0x55f86325f710 2023-10-06T02:27:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.066+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v118'515 uv515 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.066+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f8632640a0 con 0x55f86325f710 2023-10-06T02:27:29.067 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:27:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.067+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v118'516 uv516 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.067+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f8632650b0 con 0x55f86325f710 2023-10-06T02:27:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.068+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v118'517 uv517 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.068+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f8632650b0 con 0x55f86325f710 2023-10-06T02:27:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.069+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v118'518 uv518 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.069+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f8632640a0 con 0x55f86325f710 2023-10-06T02:27:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.070+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v118'519 uv519 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.070+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55f8632645b0 0x55f863266990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.070+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863266fb0 con 0x55f8632645b0 2023-10-06T02:27:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.070+0000 7f6985f38700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55f8632645b0 0x55f863266990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.070+0000 7f6985f38700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55f8632645b0 0x55f863266990 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.071+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v118'135 uv134 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.071+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863267480 con 0x55f8632645b0 2023-10-06T02:27:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.072+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v118'136 uv136 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.072+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863267a00 con 0x55f8632645b0 2023-10-06T02:27:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.073+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v118'137 uv137 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.075 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:27:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.073+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863269300 con 0x55f8632645b0 2023-10-06T02:27:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.075+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v118'138 uv138 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.075+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f8632696b0 con 0x55f8632645b0 2023-10-06T02:27:29.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.076+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v118'139 uv139 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.076+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f8632682f0 con 0x55f8632645b0 2023-10-06T02:27:29.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.077+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v118'140 uv140 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.077+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863268710 con 0x55f8632645b0 2023-10-06T02:27:29.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.078+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v118'96 uv95 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.078+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863268710 con 0x55f8632645b0 2023-10-06T02:27:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.079+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v118'97 uv97 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.079+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863268710 con 0x55f8632645b0 2023-10-06T02:27:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.080+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v118'98 uv98 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.080 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:27:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.080+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863268710 con 0x55f8632645b0 2023-10-06T02:27:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.080+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v118'99 uv99 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.080+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863268710 con 0x55f86325f710 2023-10-06T02:27:29.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.082+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v118'135 uv134 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.082+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863268710 con 0x55f86325f710 2023-10-06T02:27:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.083+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v118'136 uv136 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.083+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863268710 con 0x55f86325f710 2023-10-06T02:27:29.084 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:27:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.083+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v118'137 uv137 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.083+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863268710 con 0x55f86325f710 2023-10-06T02:27:29.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.084+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v118'138 uv138 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.084+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863268710 con 0x55f86325f710 2023-10-06T02:27:29.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.085+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v118'139 uv139 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.085+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863268710 con 0x55f86325f710 2023-10-06T02:27:29.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.086+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v118'140 uv140 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86325f710 2023-10-06T02:27:29.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.086+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55f863269a60 0x55f86326be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.086+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326c380 con 0x55f863269a60 2023-10-06T02:27:29.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.086+0000 7f6986f3a700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55f863269a60 0x55f86326be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.087+0000 7f6986f3a700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55f863269a60 0x55f86326be40 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.088+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v118'249 uv243 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863269a60 2023-10-06T02:27:29.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.088+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326c380 con 0x55f863269a60 2023-10-06T02:27:29.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.089+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v118'250 uv250 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863269a60 2023-10-06T02:27:29.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.089+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326c380 con 0x55f863269a60 2023-10-06T02:27:29.091 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:27:29.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.091+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v118'251 uv251 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863269a60 2023-10-06T02:27:29.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.091+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326d390 con 0x55f863269a60 2023-10-06T02:27:29.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.092+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v118'252 uv252 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863269a60 2023-10-06T02:27:29.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.092+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326d390 con 0x55f863269a60 2023-10-06T02:27:29.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.093+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v118'253 uv253 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863269a60 2023-10-06T02:27:29.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.093+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326c380 con 0x55f863269a60 2023-10-06T02:27:29.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.095+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v118'254 uv254 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863269a60 2023-10-06T02:27:29.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.095+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326c380 con 0x55f863269a60 2023-10-06T02:27:29.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.096+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v118'255 uv248 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863269a60 2023-10-06T02:27:29.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.096+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326c380 con 0x55f863269a60 2023-10-06T02:27:29.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.097+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v118'256 uv256 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863269a60 2023-10-06T02:27:29.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.097+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326c380 con 0x55f863269a60 2023-10-06T02:27:29.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.098+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v118'257 uv257 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863269a60 2023-10-06T02:27:29.098 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:27:29.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.098+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326c380 con 0x55f863269a60 2023-10-06T02:27:29.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.099+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v118'258 uv258 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863269a60 2023-10-06T02:27:29.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.099+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326c380 con 0x55f863269a60 2023-10-06T02:27:29.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.100+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v118'259 uv259 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863269a60 2023-10-06T02:27:29.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.100+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55f86326c890 0x55f86326ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.100+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326f3e0 con 0x55f86326c890 2023-10-06T02:27:29.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.100+0000 7f6986739700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55f86326c890 0x55f86326ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.101+0000 7f6986739700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55f86326c890 0x55f86326ec90 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.102+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v118'112 uv111 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86326c890 2023-10-06T02:27:29.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.102+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326f7c0 con 0x55f86326c890 2023-10-06T02:27:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.103+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v118'113 uv113 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86326c890 2023-10-06T02:27:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.103+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326f7c0 con 0x55f86326c890 2023-10-06T02:27:29.107 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:27:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.107+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v118'114 uv114 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86326c890 2023-10-06T02:27:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.107+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326f7c0 con 0x55f86326c890 2023-10-06T02:27:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.108+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v118'115 uv115 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86326c890 2023-10-06T02:27:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.108+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326f7c0 con 0x55f86326c890 2023-10-06T02:27:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.111+0000 7f6986739700 1 -- 172.21.15.6:0/2166665323 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v118'116 uv116 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6978014070 con 0x55f86326c890 2023-10-06T02:27:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.111+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326f7c0 con 0x55f8632645b0 2023-10-06T02:27:29.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.112+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v118'135 uv134 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.112+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326f7c0 con 0x55f8632645b0 2023-10-06T02:27:29.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.113+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v118'136 uv136 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.113+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326f7c0 con 0x55f8632645b0 2023-10-06T02:27:29.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.113+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v118'137 uv137 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.114 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:27:29.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.113+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f8632707d0 con 0x55f8632645b0 2023-10-06T02:27:29.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.114+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v118'138 uv138 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.114+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f8632707d0 con 0x55f8632645b0 2023-10-06T02:27:29.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.115+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v118'139 uv139 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.115+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f86326f7c0 con 0x55f8632645b0 2023-10-06T02:27:29.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.116+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v118'140 uv140 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.116+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55f86326fe40 0x55f863272220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.116+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863272830 con 0x55f86326fe40 2023-10-06T02:27:29.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.116+0000 7f6985f38700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55f86326fe40 0x55f863272220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.117+0000 7f6985f38700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55f86326fe40 0x55f863272220 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.118+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v118'223 uv217 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f86326fe40 2023-10-06T02:27:29.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.118+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863272c10 con 0x55f86326fe40 2023-10-06T02:27:29.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.119+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v118'224 uv224 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f86326fe40 2023-10-06T02:27:29.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.119+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863272c10 con 0x55f86326fe40 2023-10-06T02:27:29.120 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:27:29.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.120+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v118'225 uv225 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f86326fe40 2023-10-06T02:27:29.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.120+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863272c10 con 0x55f86326fe40 2023-10-06T02:27:29.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.121+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v118'226 uv226 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f86326fe40 2023-10-06T02:27:29.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.121+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863272c10 con 0x55f86326fe40 2023-10-06T02:27:29.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.122+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v118'227 uv227 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f86326fe40 2023-10-06T02:27:29.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.122+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863272c10 con 0x55f86326fe40 2023-10-06T02:27:29.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.123+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v118'228 uv222 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f86326fe40 2023-10-06T02:27:29.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.123+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863272c10 con 0x55f86326fe40 2023-10-06T02:27:29.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.124+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v118'229 uv229 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f86326fe40 2023-10-06T02:27:29.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.124+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863272c10 con 0x55f86326fe40 2023-10-06T02:27:29.125 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:27:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.125+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v118'230 uv230 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f86326fe40 2023-10-06T02:27:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.125+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863272c10 con 0x55f86326fe40 2023-10-06T02:27:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.126+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v118'231 uv231 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f86326fe40 2023-10-06T02:27:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.126+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863275980 con 0x55f86326fe40 2023-10-06T02:27:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.127+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v118'232 uv232 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f86326fe40 2023-10-06T02:27:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.127+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863273100 con 0x55f8632645b0 2023-10-06T02:27:29.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.128+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v118'99 uv98 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.128+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863273100 con 0x55f8632645b0 2023-10-06T02:27:29.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.129+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v118'100 uv100 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.129+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863273100 con 0x55f8632645b0 2023-10-06T02:27:29.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.132+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v118'101 uv101 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.133 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:27:29.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.132+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863273100 con 0x55f8632645b0 2023-10-06T02:27:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.133+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v118'102 uv102 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.133+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55f863273a30 0x55f8632760d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.133+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863273100 con 0x55f863273a30 2023-10-06T02:27:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.133+0000 7f6986f3a700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55f863273a30 0x55f8632760d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.134+0000 7f6986f3a700 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55f863273a30 0x55f8632760d0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.135+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v118'135 uv134 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863273a30 2023-10-06T02:27:29.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.135+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863273100 con 0x55f863273a30 2023-10-06T02:27:29.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.136+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v118'136 uv136 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863273a30 2023-10-06T02:27:29.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.136+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863273100 con 0x55f863273a30 2023-10-06T02:27:29.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.137+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v118'137 uv137 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863273a30 2023-10-06T02:27:29.139 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:27:29.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.137+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863273100 con 0x55f863273a30 2023-10-06T02:27:29.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.138+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v118'138 uv138 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863273a30 2023-10-06T02:27:29.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.138+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863273100 con 0x55f863273a30 2023-10-06T02:27:29.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.139+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v118'139 uv139 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863273a30 2023-10-06T02:27:29.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.139+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863273100 con 0x55f863273a30 2023-10-06T02:27:29.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.140+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v118'140 uv140 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863273a30 2023-10-06T02:27:29.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.140+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863273100 con 0x55f863269a60 2023-10-06T02:27:29.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.141+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v118'115 uv114 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863269a60 2023-10-06T02:27:29.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.141+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863273100 con 0x55f863269a60 2023-10-06T02:27:29.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.143+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v118'116 uv116 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863269a60 2023-10-06T02:27:29.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.143+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863273100 con 0x55f863269a60 2023-10-06T02:27:29.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.144+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v118'117 uv117 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863269a60 2023-10-06T02:27:29.144 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:27:29.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.144+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863273100 con 0x55f863269a60 2023-10-06T02:27:29.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.145+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v118'118 uv118 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863269a60 2023-10-06T02:27:29.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.145+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863276610 con 0x55f863269a60 2023-10-06T02:27:29.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.146+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v118'119 uv119 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6980014420 con 0x55f863269a60 2023-10-06T02:27:29.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.146+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863276610 con 0x55f8632645b0 2023-10-06T02:27:29.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.147+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v118'278 uv277 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.147+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863276610 con 0x55f8632645b0 2023-10-06T02:27:29.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.148+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v118'279 uv279 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.148+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863276610 con 0x55f8632645b0 2023-10-06T02:27:29.149 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:27:29.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.149+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v118'280 uv280 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.149+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863276610 con 0x55f8632645b0 2023-10-06T02:27:29.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.150+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v118'281 uv281 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.150+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863276610 con 0x55f8632645b0 2023-10-06T02:27:29.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.151+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v118'282 uv282 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.151+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863276610 con 0x55f8632645b0 2023-10-06T02:27:29.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.152+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v118'283 uv276 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.152+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863276610 con 0x55f8632645b0 2023-10-06T02:27:29.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.153+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v118'284 uv284 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.153+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863276610 con 0x55f8632645b0 2023-10-06T02:27:29.154 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:27:29.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.154+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v118'285 uv285 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.154+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863277620 con 0x55f8632645b0 2023-10-06T02:27:29.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.155+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v118'286 uv286 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.155+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863277620 con 0x55f8632645b0 2023-10-06T02:27:29.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.156+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v118'287 uv287 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.156+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863276610 con 0x55f8632645b0 2023-10-06T02:27:29.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.157+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v118'288 uv288 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.157+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x55f863276610 con 0x55f8632645b0 2023-10-06T02:27:29.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f6985f38700 1 -- 172.21.15.6:0/2166665323 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v118'289 uv289 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f697c082f20 con 0x55f8632645b0 2023-10-06T02:27:29.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55f8632645b0 msgr2=0x55f863266990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55f8632645b0 0x55f863266990 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55f863220b80 msgr2=0x55f86323dc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55f863220b80 0x55f86323dc80 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55f86326fe40 msgr2=0x55f863272220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55f86326fe40 0x55f863272220 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55f86325f710 msgr2=0x55f863262830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55f86325f710 0x55f863262830 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55f863273a30 msgr2=0x55f8632760d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55f863273a30 0x55f8632760d0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 reap_dead start 2023-10-06T02:27:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55f86326c890 msgr2=0x55f86326ec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55f86326c890 0x55f86326ec90 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f6986f3a700 1 -- 172.21.15.6:0/2166665323 reap_dead start 2023-10-06T02:27:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55f863269a60 msgr2=0x55f86326be40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55f863269a60 0x55f86326be40 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f69680658c0 msgr2=0x7f6968067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f69680658c0 0x7f6968067d70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6978001cf0 tx=0x7f6978014000 comp rx=0 tx=0).stop 2023-10-06T02:27:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f86319aa00 msgr2=0x55f86321f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f86319aa00 0x55f86321f990 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f697c011000 tx=0x7f697c015000 comp rx=0 tx=0).stop 2023-10-06T02:27:29.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 shutdown_connections 2023-10-06T02:27:29.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55f86326c890 0x55f86326ec90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f86319aa00 0x55f86321f990 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f69680658c0 0x7f6968067d70 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 --2- 172.21.15.6:0/2166665323 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55f863269a60 0x55f86326be40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 >> 172.21.15.6:0/2166665323 conn(0x55f8631696c0 msgr2=0x55f86316d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:29.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 shutdown_connections 2023-10-06T02:27:29.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.158+0000 7f698d4fe000 1 -- 172.21.15.6:0/2166665323 wait complete. 2023-10-06T02:27:29.163 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 1.00000000.inode 0 2023-10-06T02:27:29.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.241+0000 7f233831b000 1 Processor -- start 2023-10-06T02:27:29.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.241+0000 7f233831b000 1 -- start start 2023-10-06T02:27:29.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.242+0000 7f233831b000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fa0e65d90 0x558fa0effe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.242+0000 7f233831b000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558fa0e73650 0x558fa0f196e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.242+0000 7f233831b000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fa0f01a60 0x558fa0f19c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.242+0000 7f233831b000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fa0d8e980 con 0x558fa0f01a60 2023-10-06T02:27:29.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.242+0000 7f233831b000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fa0d8e620 con 0x558fa0e65d90 2023-10-06T02:27:29.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.242+0000 7f233831b000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x558fa0d85400 con 0x558fa0e73650 2023-10-06T02:27:29.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.242+0000 7f2331d57700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fa0f01a60 0x558fa0f19c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.242+0000 7f2331d57700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fa0f01a60 0x558fa0f19c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34848/0 (socket says 172.21.15.6:34848) 2023-10-06T02:27:29.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.242+0000 7f2331d57700 1 -- 172.21.15.6:0/2386157408 learned_addr learned my addr 172.21.15.6:0/2386157408 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:29.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.242+0000 7f2331556700 1 --2- 172.21.15.6:0/2386157408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fa0e65d90 0x558fa0effe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.242+0000 7f2330d55700 1 --2- 172.21.15.6:0/2386157408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558fa0e73650 0x558fa0f196e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f2331d57700 1 -- 172.21.15.6:0/2386157408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558fa0e73650 msgr2=0x558fa0f196e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:29.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f2331d57700 1 --2- 172.21.15.6:0/2386157408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558fa0e73650 0x558fa0f196e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f2331d57700 1 -- 172.21.15.6:0/2386157408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fa0e65d90 msgr2=0x558fa0effe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:29.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f2331d57700 1 --2- 172.21.15.6:0/2386157408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fa0e65d90 0x558fa0effe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f2331d57700 1 -- 172.21.15.6:0/2386157408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c00a180 con 0x558fa0f01a60 2023-10-06T02:27:29.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f2331d57700 1 --2- 172.21.15.6:0/2386157408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fa0f01a60 0x558fa0f19c20 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x558fa0e44390 tx=0x7f232c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd253e2dfba1aeb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f23237fe700 1 -- 172.21.15.6:0/2386157408 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c0032f0 con 0x558fa0f01a60 2023-10-06T02:27:29.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f23237fe700 1 -- 172.21.15.6:0/2386157408 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c00ed80 con 0x558fa0f01a60 2023-10-06T02:27:29.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f23237fe700 1 -- 172.21.15.6:0/2386157408 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c00ea10 con 0x558fa0f01a60 2023-10-06T02:27:29.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f233831b000 1 -- 172.21.15.6:0/2386157408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fa0f01a60 msgr2=0x558fa0f19c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f233831b000 1 --2- 172.21.15.6:0/2386157408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fa0f01a60 0x558fa0f19c20 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x558fa0e44390 tx=0x7f232c014000 comp rx=0 tx=0).stop 2023-10-06T02:27:29.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f233831b000 1 -- 172.21.15.6:0/2386157408 shutdown_connections 2023-10-06T02:27:29.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f233831b000 1 --2- 172.21.15.6:0/2386157408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fa0f01a60 0x558fa0f19c20 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f233831b000 1 --2- 172.21.15.6:0/2386157408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fa0e65d90 0x558fa0effe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f233831b000 1 --2- 172.21.15.6:0/2386157408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558fa0e73650 0x558fa0f196e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f233831b000 1 -- 172.21.15.6:0/2386157408 >> 172.21.15.6:0/2386157408 conn(0x558fa0e445d0 msgr2=0x558fa0e6f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f233831b000 1 -- 172.21.15.6:0/2386157408 shutdown_connections 2023-10-06T02:27:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.243+0000 7f233831b000 1 -- 172.21.15.6:0/2386157408 wait complete. 2023-10-06T02:27:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.244+0000 7f233831b000 1 Processor -- start 2023-10-06T02:27:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.244+0000 7f233831b000 1 -- start start 2023-10-06T02:27:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f233831b000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fa0e65d90 0x558fa0e83510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f233831b000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558fa0e73650 0x558fa0efcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f233831b000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fa0f01a60 0x558fa0f298b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f233831b000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fa0eff080 con 0x558fa0e65d90 2023-10-06T02:27:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f233831b000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fa0eff320 con 0x558fa0f01a60 2023-10-06T02:27:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f233831b000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x558fa0efddd0 con 0x558fa0e73650 2023-10-06T02:27:29.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f2331556700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fa0e65d90 0x558fa0e83510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f2331556700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fa0e65d90 0x558fa0e83510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34850/0 (socket says 172.21.15.6:34850) 2023-10-06T02:27:29.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f2331556700 1 -- 172.21.15.6:0/3634488565 learned_addr learned my addr 172.21.15.6:0/3634488565 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:29.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f2331d57700 1 --2- 172.21.15.6:0/3634488565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fa0f01a60 0x558fa0f298b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f2330d55700 1 --2- 172.21.15.6:0/3634488565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558fa0e73650 0x558fa0efcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f2331556700 1 -- 172.21.15.6:0/3634488565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558fa0e73650 msgr2=0x558fa0efcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f2331556700 1 --2- 172.21.15.6:0/3634488565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558fa0e73650 0x558fa0efcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f2331556700 1 -- 172.21.15.6:0/3634488565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fa0f01a60 msgr2=0x558fa0f298b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f2331556700 1 --2- 172.21.15.6:0/3634488565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fa0f01a60 0x558fa0f298b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f2331556700 1 -- 172.21.15.6:0/3634488565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fa0db71c0 con 0x558fa0e65d90 2023-10-06T02:27:29.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f2331556700 1 --2- 172.21.15.6:0/3634488565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fa0e65d90 0x558fa0e83510 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f23240087c0 tx=0x7f232400c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f2321ffb700 1 -- 172.21.15.6:0/3634488565 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232400f040 con 0x558fa0e65d90 2023-10-06T02:27:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f2321ffb700 1 -- 172.21.15.6:0/3634488565 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2324015680 con 0x558fa0e65d90 2023-10-06T02:27:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f233831b000 1 -- 172.21.15.6:0/3634488565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558fa0d9d3d0 con 0x558fa0e65d90 2023-10-06T02:27:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f2321ffb700 1 -- 172.21.15.6:0/3634488565 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324015a20 con 0x558fa0e65d90 2023-10-06T02:27:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.245+0000 7f233831b000 1 -- 172.21.15.6:0/3634488565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558fa0d90ae0 con 0x558fa0e65d90 2023-10-06T02:27:29.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.247+0000 7f2321ffb700 1 -- 172.21.15.6:0/3634488565 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f232401e400 con 0x558fa0e65d90 2023-10-06T02:27:29.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.247+0000 7f2321ffb700 1 --2- 172.21.15.6:0/3634488565 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2314065890 0x7f2314067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.247+0000 7f2321ffb700 1 -- 172.21.15.6:0/3634488565 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8356+0+0 (secure 0 0 0) 0x7f2324084810 con 0x558fa0e65d90 2023-10-06T02:27:29.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.247+0000 7f2330d55700 1 --2- 172.21.15.6:0/3634488565 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2314065890 0x7f2314067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.247+0000 7f233831b000 1 --2- 172.21.15.6:0/3634488565 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x558fa0f29df0 0x558fa0e661f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.247+0000 7f233831b000 1 -- 172.21.15.6:0/3634488565 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:287034c4:::1.00000000.inode:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v8 -- 0x558fa0e6d040 con 0x558fa0f29df0 2023-10-06T02:27:29.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.247+0000 7f2331d57700 1 --2- 172.21.15.6:0/3634488565 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x558fa0f29df0 0x558fa0e661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.248+0000 7f2330d55700 1 --2- 172.21.15.6:0/3634488565 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2314065890 0x7f2314067d40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f23280011e0 tx=0x7f23280017f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.248+0000 7f2331d57700 1 --2- 172.21.15.6:0/3634488565 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x558fa0f29df0 0x558fa0e661f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.249+0000 7f2331d57700 1 -- 172.21.15.6:0/3634488565 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 1.00000000.inode [truncate 0] v118'520 uv520 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f232c00e7e0 con 0x558fa0f29df0 2023-10-06T02:27:29.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.249+0000 7f233831b000 1 -- 172.21.15.6:0/3634488565 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x558fa0f29df0 msgr2=0x558fa0e661f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.249+0000 7f233831b000 1 --2- 172.21.15.6:0/3634488565 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x558fa0f29df0 0x558fa0e661f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.249+0000 7f233831b000 1 -- 172.21.15.6:0/3634488565 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2314065890 msgr2=0x7f2314067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.249+0000 7f233831b000 1 --2- 172.21.15.6:0/3634488565 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2314065890 0x7f2314067d40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f23280011e0 tx=0x7f23280017f0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.249+0000 7f233831b000 1 -- 172.21.15.6:0/3634488565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fa0e65d90 msgr2=0x558fa0e83510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.249+0000 7f233831b000 1 --2- 172.21.15.6:0/3634488565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fa0e65d90 0x558fa0e83510 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f23240087c0 tx=0x7f232400c040 comp rx=0 tx=0).stop 2023-10-06T02:27:29.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.249+0000 7f2331d57700 1 -- 172.21.15.6:0/3634488565 reap_dead start 2023-10-06T02:27:29.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.249+0000 7f233831b000 1 -- 172.21.15.6:0/3634488565 shutdown_connections 2023-10-06T02:27:29.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.249+0000 7f233831b000 1 -- 172.21.15.6:0/3634488565 >> 172.21.15.6:0/3634488565 conn(0x558fa0e445d0 msgr2=0x558fa0e6f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:29.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.249+0000 7f233831b000 1 -- 172.21.15.6:0/3634488565 shutdown_connections 2023-10-06T02:27:29.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.249+0000 7f233831b000 1 -- 172.21.15.6:0/3634488565 wait complete. 2023-10-06T02:27:29.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:27:29.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.415+0000 7f7a029c6700 1 Processor -- start 2023-10-06T02:27:29.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.415+0000 7f7a029c6700 1 -- start start 2023-10-06T02:27:29.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.416+0000 7f7a029c6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79fc0d0400 0x7f79fc0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.416+0000 7f7a029c6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79fc0ccd40 0x7f79fc0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.416+0000 7f7a029c6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79fc0b6170 con 0x7f79fc0cf7e0 2023-10-06T02:27:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.416+0000 7f7a029c6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79fc15dd40 con 0x7f79fc0d0400 2023-10-06T02:27:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.416+0000 7f7a029c6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc15e020 con 0x7f79fc0ccd40 2023-10-06T02:27:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.416+0000 7f79fbfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79fc0d0400 0x7f79fc0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.416+0000 7f79fbfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79fc0d0400 0x7f79fc0b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34856/0 (socket says 172.21.15.6:34856) 2023-10-06T02:27:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.416+0000 7f79fbfff700 1 -- 172.21.15.6:0/4260547427 learned_addr learned my addr 172.21.15.6:0/4260547427 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.417+0000 7f79fb7fe700 1 --2- 172.21.15.6:0/4260547427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79fc0ccd40 0x7f79fc0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.417+0000 7f79fbfff700 1 -- 172.21.15.6:0/4260547427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79fc0ccd40 msgr2=0x7f79fc0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.417+0000 7f79fbfff700 1 --2- 172.21.15.6:0/4260547427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79fc0ccd40 0x7f79fc0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.417+0000 7f79fbfff700 1 -- 172.21.15.6:0/4260547427 >> v1:172.21.15.175:6789/0 conn(0x7f79fc0cf7e0 legacy=0x7f79fc0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.417+0000 7f79fbfff700 1 -- 172.21.15.6:0/4260547427 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc0ceaa0 con 0x7f79fc0d0400 2023-10-06T02:27:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.417+0000 7f79fbfff700 1 --2- 172.21.15.6:0/4260547427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79fc0d0400 0x7f79fc0b5c30 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009990 tx=0x7f79ec009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cdf18be82290f05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.417+0000 7f79faffd700 1 -- 172.21.15.6:0/4260547427 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec009e80 con 0x7f79fc0d0400 2023-10-06T02:27:29.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.417+0000 7f79faffd700 1 -- 172.21.15.6:0/4260547427 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ec005c10 con 0x7f79fc0d0400 2023-10-06T02:27:29.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.417+0000 7f79faffd700 1 -- 172.21.15.6:0/4260547427 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec00b650 con 0x7f79fc0d0400 2023-10-06T02:27:29.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.418+0000 7f7a029c6700 1 -- 172.21.15.6:0/4260547427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79fc0d0400 msgr2=0x7f79fc0b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.418+0000 7f7a029c6700 1 --2- 172.21.15.6:0/4260547427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79fc0d0400 0x7f79fc0b5c30 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009990 tx=0x7f79ec009220 comp rx=0 tx=0).stop 2023-10-06T02:27:29.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.418+0000 7f7a029c6700 1 -- 172.21.15.6:0/4260547427 shutdown_connections 2023-10-06T02:27:29.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.418+0000 7f7a029c6700 1 --2- 172.21.15.6:0/4260547427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79fc0d0400 0x7f79fc0b5c30 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.418+0000 7f7a029c6700 1 --2- 172.21.15.6:0/4260547427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79fc0ccd40 0x7f79fc0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.418+0000 7f7a029c6700 1 -- 172.21.15.6:0/4260547427 >> 172.21.15.6:0/4260547427 conn(0x7f79fc06a220 msgr2=0x7f79fc06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:29.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.418+0000 7f7a029c6700 1 -- 172.21.15.6:0/4260547427 shutdown_connections 2023-10-06T02:27:29.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.418+0000 7f7a029c6700 1 -- 172.21.15.6:0/4260547427 wait complete. 2023-10-06T02:27:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.419+0000 7f7a029c6700 1 Processor -- start 2023-10-06T02:27:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.419+0000 7f7a029c6700 1 -- start start 2023-10-06T02:27:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f7a029c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79fc0ccd40 0x7f79fc14dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f7a029c6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79fc0cf7e0 0x7f79fc141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f7a029c6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79fc0d0400 0x7f79fc14e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f7a029c6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc14d0b0 con 0x7f79fc0ccd40 2023-10-06T02:27:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f7a029c6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc14d950 con 0x7f79fc0d0400 2023-10-06T02:27:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f7a029c6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc14f520 con 0x7f79fc0cf7e0 2023-10-06T02:27:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f79fbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79fc0ccd40 0x7f79fc14dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f79fbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79fc0ccd40 0x7f79fc14dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34862/0 (socket says 172.21.15.6:34862) 2023-10-06T02:27:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f79fbfff700 1 -- 172.21.15.6:0/4233710274 learned_addr learned my addr 172.21.15.6:0/4233710274 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f79fb7fe700 1 --2- 172.21.15.6:0/4233710274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79fc0cf7e0 0x7f79fc141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f7a00f63700 1 --2- 172.21.15.6:0/4233710274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79fc0d0400 0x7f79fc14e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f79fbfff700 1 -- 172.21.15.6:0/4233710274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79fc0cf7e0 msgr2=0x7f79fc141f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f79fbfff700 1 --2- 172.21.15.6:0/4233710274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79fc0cf7e0 0x7f79fc141f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f79fbfff700 1 -- 172.21.15.6:0/4233710274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79fc0d0400 msgr2=0x7f79fc14e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f79fbfff700 1 --2- 172.21.15.6:0/4233710274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79fc0d0400 0x7f79fc14e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f79fbfff700 1 -- 172.21.15.6:0/4233710274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec009480 con 0x7f79fc0ccd40 2023-10-06T02:27:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f79fbfff700 1 --2- 172.21.15.6:0/4233710274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79fc0ccd40 0x7f79fc14dde0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00b3c0 tx=0x7f79ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f79e3fff700 1 -- 172.21.15.6:0/4233710274 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec011980 con 0x7f79fc0ccd40 2023-10-06T02:27:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f79e3fff700 1 -- 172.21.15.6:0/4233710274 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ec020070 con 0x7f79fc0ccd40 2023-10-06T02:27:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f7a029c6700 1 -- 172.21.15.6:0/4233710274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79fc14d300 con 0x7f79fc0ccd40 2023-10-06T02:27:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f79e3fff700 1 -- 172.21.15.6:0/4233710274 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec011d10 con 0x7f79fc0ccd40 2023-10-06T02:27:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.420+0000 7f7a029c6700 1 -- 172.21.15.6:0/4233710274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79fc142470 con 0x7f79fc0ccd40 2023-10-06T02:27:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.421+0000 7f7a029c6700 1 -- 172.21.15.6:0/4233710274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79fc088760 con 0x7f79fc0ccd40 2023-10-06T02:27:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.422+0000 7f79e3fff700 1 -- 172.21.15.6:0/4233710274 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79ec022030 con 0x7f79fc0ccd40 2023-10-06T02:27:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.422+0000 7f79e3fff700 1 --2- 172.21.15.6:0/4233710274 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f79e8066f30 0x7f79e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.422+0000 7f79e3fff700 1 -- 172.21.15.6:0/4233710274 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8356+0+0 (secure 0 0 0) 0x7f79ec086a90 con 0x7f79fc0ccd40 2023-10-06T02:27:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.422+0000 7f79fb7fe700 1 --2- 172.21.15.6:0/4233710274 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f79e8066f30 0x7f79e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.423+0000 7f79fb7fe700 1 --2- 172.21.15.6:0/4233710274 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f79e8066f30 0x7f79e80693e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f79fc14d060 tx=0x7f79f00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.426+0000 7f79e3fff700 1 -- 172.21.15.6:0/4233710274 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79ec053260 con 0x7f79fc0ccd40 2023-10-06T02:27:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.668+0000 7f7a029c6700 1 -- 172.21.15.6:0/4233710274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f79fc0ced80 con 0x7f79fc0ccd40 2023-10-06T02:27:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.839+0000 7f79e3fff700 1 -- 172.21.15.6:0/4233710274 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v237) v1 ==== 162+0+0 (secure 0 0 0) 0x7f79ec056880 con 0x7f79fc0ccd40 2023-10-06T02:27:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.842+0000 7f7a029c6700 1 -- 172.21.15.6:0/4233710274 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f79e8066f30 msgr2=0x7f79e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.842+0000 7f7a029c6700 1 --2- 172.21.15.6:0/4233710274 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f79e8066f30 0x7f79e80693e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f79fc14d060 tx=0x7f79f00091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.842+0000 7f7a029c6700 1 -- 172.21.15.6:0/4233710274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79fc0ccd40 msgr2=0x7f79fc14dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.842+0000 7f7a029c6700 1 --2- 172.21.15.6:0/4233710274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79fc0ccd40 0x7f79fc14dde0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00b3c0 tx=0x7f79ec016000 comp rx=0 tx=0).stop 2023-10-06T02:27:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.842+0000 7f7a029c6700 1 -- 172.21.15.6:0/4233710274 shutdown_connections 2023-10-06T02:27:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.842+0000 7f7a029c6700 1 --2- 172.21.15.6:0/4233710274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79fc0d0400 0x7f79fc14e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.842+0000 7f7a029c6700 1 --2- 172.21.15.6:0/4233710274 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f79e8066f30 0x7f79e80693e0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.842+0000 7f7a029c6700 1 --2- 172.21.15.6:0/4233710274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79fc0ccd40 0x7f79fc14dde0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.842+0000 7f7a029c6700 1 --2- 172.21.15.6:0/4233710274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79fc0cf7e0 0x7f79fc141f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.842+0000 7f7a029c6700 1 -- 172.21.15.6:0/4233710274 >> 172.21.15.6:0/4233710274 conn(0x7f79fc06a220 msgr2=0x7f79fc156c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:29.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.842+0000 7f7a029c6700 1 -- 172.21.15.6:0/4233710274 shutdown_connections 2023-10-06T02:27:29.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.842+0000 7f7a029c6700 1 -- 172.21.15.6:0/4233710274 wait complete. 2023-10-06T02:27:29.844 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:27:29.845 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:27:29.844+0000 7f04e5e51700 -1 mds.0.cache.ino(0x1) No data while reading inode 0x1 2023-10-06T02:27:29.845 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:27:29.844+0000 7f04e5e51700 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2023-10-06T02:27:29.845 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:29.845+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:27:29.845 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:29.845+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:27:29.851 INFO:tasks.ceph.mds.a.smithi006.stderr: -15> 2023-10-06T02:27:29.844+0000 7f04e5e51700 -1 mds.0.cache.ino(0x1) No data while reading inode 0x1 2023-10-06T02:27:29.851 INFO:tasks.ceph.mds.a.smithi006.stderr: -13> 2023-10-06T02:27:29.844+0000 7f04e5e51700 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2023-10-06T02:27:29.858 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:29.873 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:27:29.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.978+0000 7fd7cf59e700 1 Processor -- start 2023-10-06T02:27:29.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.978+0000 7fd7cf59e700 1 -- start start 2023-10-06T02:27:29.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.979+0000 7fd7cf59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7d00d05d0 0x7fd7d01641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.979+0000 7fd7cf59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d00b3560 con 0x7fd7d0159400 2023-10-06T02:27:29.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.979+0000 7fd7cf59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d00cf6f0 con 0x7fd7d00cf1a0 2023-10-06T02:27:29.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.979+0000 7fd7cf59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d00cf9d0 con 0x7fd7d00d05d0 2023-10-06T02:27:29.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.979+0000 7fd7ced9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7d00d05d0 0x7fd7d01641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.979+0000 7fd7ce59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd7d0159400 0x7fd7d00ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41556/0 (socket says 172.21.15.6:41556) 2023-10-06T02:27:29.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.979+0000 7fd7ce59c700 1 -- 172.21.15.6:0/4145952001 learned_addr learned my addr 172.21.15.6:0/4145952001 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:29.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.979+0000 7fd7ced9d700 1 --2- 172.21.15.6:0/4145952001 >> v2:172.21.15.6:3300/0 conn(0x7fd7d00d05d0 0x7fd7d01641d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34870/0 (socket says 172.21.15.6:34870) 2023-10-06T02:27:29.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.980+0000 7fd7ced9d700 1 -- 172.21.15.6:0/4145952001 >> v1:172.21.15.175:6789/0 conn(0x7fd7d00cf1a0 legacy=0x7fd7d00cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:29.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.980+0000 7fd7ced9d700 1 -- 172.21.15.6:0/4145952001 >> v1:172.21.15.6:6789/0 conn(0x7fd7d0159400 legacy=0x7fd7d00ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.980+0000 7fd7ced9d700 1 -- 172.21.15.6:0/4145952001 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d00b2f10 con 0x7fd7d00d05d0 2023-10-06T02:27:29.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.980+0000 7fd7cd59a700 1 -- 172.21.15.6:0/4145952001 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441213090 0 0) 0x7fd7d00b3560 con 0x7fd7d0159400 2023-10-06T02:27:29.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.980+0000 7fd7ced9d700 1 --2- 172.21.15.6:0/4145952001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7d00d05d0 0x7fd7d01641d0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009e60 tx=0x7fd7c0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2e9431594c8c72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.980+0000 7fd7cd59a700 1 -- 172.21.15.6:0/4145952001 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c000e070 con 0x7fd7d00d05d0 2023-10-06T02:27:29.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.980+0000 7fd7cd59a700 1 -- 172.21.15.6:0/4145952001 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c000bc30 con 0x7fd7d00d05d0 2023-10-06T02:27:29.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.980+0000 7fd7cd59a700 1 -- 172.21.15.6:0/4145952001 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0012430 con 0x7fd7d00d05d0 2023-10-06T02:27:29.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.980+0000 7fd7cf59e700 1 -- 172.21.15.6:0/4145952001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7d00d05d0 msgr2=0x7fd7d01641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.980+0000 7fd7cf59e700 1 --2- 172.21.15.6:0/4145952001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7d00d05d0 0x7fd7d01641d0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009e60 tx=0x7fd7c0009780 comp rx=0 tx=0).stop 2023-10-06T02:27:29.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.980+0000 7fd7cf59e700 1 -- 172.21.15.6:0/4145952001 shutdown_connections 2023-10-06T02:27:29.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.980+0000 7fd7cf59e700 1 --2- 172.21.15.6:0/4145952001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7d00d05d0 0x7fd7d01641d0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.980+0000 7fd7cf59e700 1 -- 172.21.15.6:0/4145952001 >> 172.21.15.6:0/4145952001 conn(0x7fd7d006ac10 msgr2=0x7fd7d0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:29.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.981+0000 7fd7cf59e700 1 -- 172.21.15.6:0/4145952001 shutdown_connections 2023-10-06T02:27:29.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.981+0000 7fd7cf59e700 1 -- 172.21.15.6:0/4145952001 wait complete. 2023-10-06T02:27:29.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.982+0000 7fd7cf59e700 1 Processor -- start 2023-10-06T02:27:29.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.982+0000 7fd7cf59e700 1 -- start start 2023-10-06T02:27:29.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.982+0000 7fd7cf59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7d00cf1a0 0x7fd7d01530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.982+0000 7fd7cf59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7d00d05d0 0x7fd7d00b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.982+0000 7fd7cf59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7d0159400 0x7fd7d01548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.982+0000 7fd7cf59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d0153610 con 0x7fd7d0159400 2023-10-06T02:27:29.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.982+0000 7fd7cf59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d00b19c0 con 0x7fd7d00d05d0 2023-10-06T02:27:29.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.982+0000 7fd7cf59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d00b0db0 con 0x7fd7d00cf1a0 2023-10-06T02:27:29.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.982+0000 7fd7ced9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7d0159400 0x7fd7d01548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.983+0000 7fd7ced9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7d0159400 0x7fd7d01548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34880/0 (socket says 172.21.15.6:34880) 2023-10-06T02:27:29.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.983+0000 7fd7ced9d700 1 -- 172.21.15.6:0/3121332811 learned_addr learned my addr 172.21.15.6:0/3121332811 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:29.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.983+0000 7fd7cdd9b700 1 --2- 172.21.15.6:0/3121332811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7d00d05d0 0x7fd7d00b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.983+0000 7fd7ce59c700 1 --2- 172.21.15.6:0/3121332811 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7d00cf1a0 0x7fd7d01530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.983+0000 7fd7ced9d700 1 -- 172.21.15.6:0/3121332811 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7d00cf1a0 msgr2=0x7fd7d01530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.983+0000 7fd7ced9d700 1 --2- 172.21.15.6:0/3121332811 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7d00cf1a0 0x7fd7d01530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.983+0000 7fd7ced9d700 1 -- 172.21.15.6:0/3121332811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7d00d05d0 msgr2=0x7fd7d00b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.983+0000 7fd7ced9d700 1 --2- 172.21.15.6:0/3121332811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7d00d05d0 0x7fd7d00b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.983+0000 7fd7ced9d700 1 -- 172.21.15.6:0/3121332811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c0009a20 con 0x7fd7d0159400 2023-10-06T02:27:29.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.983+0000 7fd7ced9d700 1 --2- 172.21.15.6:0/3121332811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7d0159400 0x7fd7d01548d0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00099f0 tx=0x7fd7c0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.983+0000 7fd7c67fc700 1 -- 172.21.15.6:0/3121332811 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0012e10 con 0x7fd7d0159400 2023-10-06T02:27:29.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.983+0000 7fd7c67fc700 1 -- 172.21.15.6:0/3121332811 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c001d630 con 0x7fd7d0159400 2023-10-06T02:27:29.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.983+0000 7fd7cf59e700 1 -- 172.21.15.6:0/3121332811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d00b1090 con 0x7fd7d0159400 2023-10-06T02:27:29.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.983+0000 7fd7c67fc700 1 -- 172.21.15.6:0/3121332811 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c001d9f0 con 0x7fd7d0159400 2023-10-06T02:27:29.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.983+0000 7fd7cf59e700 1 -- 172.21.15.6:0/3121332811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d00b1650 con 0x7fd7d0159400 2023-10-06T02:27:29.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.984+0000 7fd7cf59e700 1 -- 172.21.15.6:0/3121332811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d00b1b70 con 0x7fd7d0159400 2023-10-06T02:27:29.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.985+0000 7fd7c67fc700 1 -- 172.21.15.6:0/3121332811 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd7c0024070 con 0x7fd7d0159400 2023-10-06T02:27:29.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.985+0000 7fd7c67fc700 1 --2- 172.21.15.6:0/3121332811 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd7b0066f30 0x7fd7b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.985+0000 7fd7c67fc700 1 -- 172.21.15.6:0/3121332811 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8442+0+0 (secure 0 0 0) 0x7fd7c0087890 con 0x7fd7d0159400 2023-10-06T02:27:29.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.985+0000 7fd7ce59c700 1 --2- 172.21.15.6:0/3121332811 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd7b0066f30 0x7fd7b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.986+0000 7fd7ce59c700 1 --2- 172.21.15.6:0/3121332811 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd7b0066f30 0x7fd7b00693e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8002970 tx=0x7fd7c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:29.990+0000 7fd7c67fc700 1 -- 172.21.15.6:0/3121332811 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7d00b1b70 con 0x7fd7d0159400 2023-10-06T02:27:30.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.229+0000 7fd7cf59e700 1 -- 172.21.15.6:0/3121332811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7d00b1b30 con 0x7fd7d0159400 2023-10-06T02:27:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.229+0000 7fd7c67fc700 1 -- 172.21.15.6:0/3121332811 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 238 v238) v1 ==== 95+0+3840 (secure 0 0 0) 0x7fd7c002c090 con 0x7fd7d0159400 2023-10-06T02:27:30.230 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:30.230 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":238,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":238,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:29.845629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:30.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.231+0000 7fd7cf59e700 1 -- 172.21.15.6:0/3121332811 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd7b0066f30 msgr2=0x7fd7b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.231+0000 7fd7cf59e700 1 --2- 172.21.15.6:0/3121332811 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd7b0066f30 0x7fd7b00693e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8002970 tx=0x7fd7c8009040 comp rx=0 tx=0).stop 2023-10-06T02:27:30.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.231+0000 7fd7cf59e700 1 -- 172.21.15.6:0/3121332811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7d0159400 msgr2=0x7fd7d01548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.231+0000 7fd7cf59e700 1 --2- 172.21.15.6:0/3121332811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7d0159400 0x7fd7d01548d0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00099f0 tx=0x7fd7c0019000 comp rx=0 tx=0).stop 2023-10-06T02:27:30.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.231+0000 7fd7cf59e700 1 -- 172.21.15.6:0/3121332811 shutdown_connections 2023-10-06T02:27:30.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.231+0000 7fd7cf59e700 1 --2- 172.21.15.6:0/3121332811 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd7b0066f30 0x7fd7b00693e0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.231+0000 7fd7cf59e700 1 --2- 172.21.15.6:0/3121332811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7d0159400 0x7fd7d01548d0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.231+0000 7fd7cf59e700 1 --2- 172.21.15.6:0/3121332811 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7d00cf1a0 0x7fd7d01530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.231+0000 7fd7cf59e700 1 --2- 172.21.15.6:0/3121332811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7d00d05d0 0x7fd7d00b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.231+0000 7fd7cf59e700 1 -- 172.21.15.6:0/3121332811 >> 172.21.15.6:0/3121332811 conn(0x7fd7d006ac10 msgr2=0x7fd7d015fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:30.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.231+0000 7fd7cf59e700 1 -- 172.21.15.6:0/3121332811 shutdown_connections 2023-10-06T02:27:30.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.231+0000 7fd7cf59e700 1 -- 172.21.15.6:0/3121332811 wait complete. 2023-10-06T02:27:30.233 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 238 2023-10-06T02:27:30.244 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:27:30.244 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:30.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.403+0000 7fe6fa16c700 1 Processor -- start 2023-10-06T02:27:30.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.403+0000 7fe6fa16c700 1 -- start start 2023-10-06T02:27:30.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.404+0000 7fe6fa16c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6f40af4e0 0x7fe6f40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.404+0000 7fe6fa16c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe6f40af8b0 0x7fe6f40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.404+0000 7fe6fa16c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f415e190 con 0x7fe6f415d460 2023-10-06T02:27:30.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.404+0000 7fe6fa16c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f40b1910 con 0x7fe6f40af8b0 2023-10-06T02:27:30.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.404+0000 7fe6fa16c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f415dfb0 con 0x7fe6f40af4e0 2023-10-06T02:27:30.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.404+0000 7fe6f37fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6f40af4e0 0x7fe6f40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.404+0000 7fe6f2ffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe6f40af8b0 0x7fe6f40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.404+0000 7fe6f37fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6f40af4e0 0x7fe6f40b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:51792/0 (socket says 172.21.15.6:51792) 2023-10-06T02:27:30.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.404+0000 7fe6f37fe700 1 -- 172.21.15.6:0/509300573 learned_addr learned my addr 172.21.15.6:0/509300573 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:30.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.405+0000 7fe6f2ffd700 1 -- 172.21.15.6:0/509300573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6f40af4e0 msgr2=0x7fe6f40b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:30.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.405+0000 7fe6f2ffd700 1 --2- 172.21.15.6:0/509300573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6f40af4e0 0x7fe6f40b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.405+0000 7fe6f2ffd700 1 -- 172.21.15.6:0/509300573 >> v1:172.21.15.175:6789/0 conn(0x7fe6f415d460 legacy=0x7fe6f415d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.405+0000 7fe6f2ffd700 1 -- 172.21.15.6:0/509300573 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f40cb650 con 0x7fe6f40af8b0 2023-10-06T02:27:30.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.405+0000 7fe6f2ffd700 1 --2- 172.21.15.6:0/509300573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6f40af8b0 0x7fe6f40b2620 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80098e0 tx=0x7fe6e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efe62c0b21162464 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.405+0000 7fe6f27fc700 1 -- 172.21.15.6:0/509300573 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800b640 con 0x7fe6f40af8b0 2023-10-06T02:27:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.405+0000 7fe6f27fc700 1 -- 172.21.15.6:0/509300573 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e800b7a0 con 0x7fe6f40af8b0 2023-10-06T02:27:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.405+0000 7fe6f27fc700 1 -- 172.21.15.6:0/509300573 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800bb40 con 0x7fe6f40af8b0 2023-10-06T02:27:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.406+0000 7fe6fa16c700 1 -- 172.21.15.6:0/509300573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6f40af8b0 msgr2=0x7fe6f40b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.406+0000 7fe6fa16c700 1 --2- 172.21.15.6:0/509300573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6f40af8b0 0x7fe6f40b2620 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80098e0 tx=0x7fe6e80091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.406+0000 7fe6fa16c700 1 -- 172.21.15.6:0/509300573 shutdown_connections 2023-10-06T02:27:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.406+0000 7fe6fa16c700 1 --2- 172.21.15.6:0/509300573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6f40af4e0 0x7fe6f40b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.406+0000 7fe6fa16c700 1 --2- 172.21.15.6:0/509300573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6f40af8b0 0x7fe6f40b2620 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.406+0000 7fe6fa16c700 1 -- 172.21.15.6:0/509300573 >> 172.21.15.6:0/509300573 conn(0x7fe6f4068680 msgr2=0x7fe6f4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:30.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.406+0000 7fe6fa16c700 1 -- 172.21.15.6:0/509300573 shutdown_connections 2023-10-06T02:27:30.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.406+0000 7fe6fa16c700 1 -- 172.21.15.6:0/509300573 wait complete. 2023-10-06T02:27:30.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.407+0000 7fe6fa16c700 1 Processor -- start 2023-10-06T02:27:30.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.407+0000 7fe6fa16c700 1 -- start start 2023-10-06T02:27:30.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6fa16c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6f40af4e0 0x7fe6f416cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6fa16c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6f40af8b0 0x7fe6f40a7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6fa16c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6f415d460 0x7fe6f4169d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6fa16c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40c7300 con 0x7fe6f40af8b0 2023-10-06T02:27:30.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6fa16c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40c7550 con 0x7fe6f40af4e0 2023-10-06T02:27:30.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6fa16c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40c7830 con 0x7fe6f415d460 2023-10-06T02:27:30.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6f2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6f40af8b0 0x7fe6f40a7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6f2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6f40af8b0 0x7fe6f40a7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34888/0 (socket says 172.21.15.6:34888) 2023-10-06T02:27:30.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6f2ffd700 1 -- 172.21.15.6:0/47562699 learned_addr learned my addr 172.21.15.6:0/47562699 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:30.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6f37fe700 1 --2- 172.21.15.6:0/47562699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6f40af4e0 0x7fe6f416cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6f3fff700 1 --2- 172.21.15.6:0/47562699 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6f415d460 0x7fe6f4169d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6f2ffd700 1 -- 172.21.15.6:0/47562699 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6f415d460 msgr2=0x7fe6f4169d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6f2ffd700 1 --2- 172.21.15.6:0/47562699 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6f415d460 0x7fe6f4169d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6f2ffd700 1 -- 172.21.15.6:0/47562699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6f40af4e0 msgr2=0x7fe6f416cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6f2ffd700 1 --2- 172.21.15.6:0/47562699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6f40af4e0 0x7fe6f416cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6f2ffd700 1 -- 172.21.15.6:0/47562699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e8009420 con 0x7fe6f40af8b0 2023-10-06T02:27:30.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6f37fe700 1 --2- 172.21.15.6:0/47562699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6f40af4e0 0x7fe6f416cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:30.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6f2ffd700 1 --2- 172.21.15.6:0/47562699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6f40af8b0 0x7fe6f40a7a30 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8009f80 tx=0x7fe6e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:30.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.408+0000 7fe6db7fe700 1 -- 172.21.15.6:0/47562699 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800b910 con 0x7fe6f40af8b0 2023-10-06T02:27:30.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.409+0000 7fe6db7fe700 1 -- 172.21.15.6:0/47562699 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e800ba70 con 0x7fe6f40af8b0 2023-10-06T02:27:30.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.409+0000 7fe6fa16c700 1 -- 172.21.15.6:0/47562699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f40c7b10 con 0x7fe6f40af8b0 2023-10-06T02:27:30.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.409+0000 7fe6db7fe700 1 -- 172.21.15.6:0/47562699 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8024670 con 0x7fe6f40af8b0 2023-10-06T02:27:30.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.409+0000 7fe6fa16c700 1 -- 172.21.15.6:0/47562699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f416d0e0 con 0x7fe6f40af8b0 2023-10-06T02:27:30.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.409+0000 7fe6fa16c700 1 -- 172.21.15.6:0/47562699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f4088aa0 con 0x7fe6f40af8b0 2023-10-06T02:27:30.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.410+0000 7fe6db7fe700 1 -- 172.21.15.6:0/47562699 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6e8011420 con 0x7fe6f40af8b0 2023-10-06T02:27:30.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.410+0000 7fe6db7fe700 1 --2- 172.21.15.6:0/47562699 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6e0066f00 0x7fe6e00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.410+0000 7fe6db7fe700 1 -- 172.21.15.6:0/47562699 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8442+0+0 (secure 0 0 0) 0x7fe6e80869a0 con 0x7fe6f40af8b0 2023-10-06T02:27:30.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.410+0000 7fe6f37fe700 1 --2- 172.21.15.6:0/47562699 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6e0066f00 0x7fe6e00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.411+0000 7fe6f37fe700 1 --2- 172.21.15.6:0/47562699 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6e0066f00 0x7fe6e00693b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4006fd0 tx=0x7fe6e4009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:30.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.414+0000 7fe6db7fe700 1 -- 172.21.15.6:0/47562699 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6e8053120 con 0x7fe6f40af8b0 2023-10-06T02:27:30.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.652+0000 7fe6fa16c700 1 -- 172.21.15.6:0/47562699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6f40cee90 con 0x7fe6f40af8b0 2023-10-06T02:27:30.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.652+0000 7fe6db7fe700 1 -- 172.21.15.6:0/47562699 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 238 v238) v1 ==== 95+0+3840 (secure 0 0 0) 0x7fe6e8056740 con 0x7fe6f40af8b0 2023-10-06T02:27:30.653 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:30.653 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":238,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":238,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:29.845629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:30.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.654+0000 7fe6fa16c700 1 -- 172.21.15.6:0/47562699 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6e0066f00 msgr2=0x7fe6e00693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.654+0000 7fe6fa16c700 1 --2- 172.21.15.6:0/47562699 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6e0066f00 0x7fe6e00693b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4006fd0 tx=0x7fe6e4009250 comp rx=0 tx=0).stop 2023-10-06T02:27:30.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.654+0000 7fe6fa16c700 1 -- 172.21.15.6:0/47562699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6f40af8b0 msgr2=0x7fe6f40a7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.654+0000 7fe6fa16c700 1 --2- 172.21.15.6:0/47562699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6f40af8b0 0x7fe6f40a7a30 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8009f80 tx=0x7fe6e8017000 comp rx=0 tx=0).stop 2023-10-06T02:27:30.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.654+0000 7fe6fa16c700 1 -- 172.21.15.6:0/47562699 shutdown_connections 2023-10-06T02:27:30.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.654+0000 7fe6fa16c700 1 --2- 172.21.15.6:0/47562699 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6f415d460 0x7fe6f4169d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.654+0000 7fe6fa16c700 1 --2- 172.21.15.6:0/47562699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6f40af4e0 0x7fe6f416cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.654+0000 7fe6fa16c700 1 --2- 172.21.15.6:0/47562699 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe6e0066f00 0x7fe6e00693b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.654+0000 7fe6fa16c700 1 --2- 172.21.15.6:0/47562699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6f40af8b0 0x7fe6f40a7a30 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.654+0000 7fe6fa16c700 1 -- 172.21.15.6:0/47562699 >> 172.21.15.6:0/47562699 conn(0x7fe6f4068680 msgr2=0x7fe6f40cdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:30.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.654+0000 7fe6fa16c700 1 -- 172.21.15.6:0/47562699 shutdown_connections 2023-10-06T02:27:30.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.654+0000 7fe6fa16c700 1 -- 172.21.15.6:0/47562699 wait complete. 2023-10-06T02:27:30.657 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 238 2023-10-06T02:27:30.667 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:27:30.667 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:30.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.786+0000 7fc5d34d5700 1 Processor -- start 2023-10-06T02:27:30.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.786+0000 7fc5d34d5700 1 -- start start 2023-10-06T02:27:30.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.787+0000 7fc5d34d5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc5cc0af8b0 0x7fc5cc15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.787+0000 7fc5d34d5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5cc0b27f0 0x7fc5cc15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.787+0000 7fc5d34d5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5cc15e190 con 0x7fc5cc0af4e0 2023-10-06T02:27:30.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.787+0000 7fc5d34d5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc0b1910 con 0x7fc5cc0b27f0 2023-10-06T02:27:30.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.787+0000 7fc5d34d5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc0cb650 con 0x7fc5cc0af8b0 2023-10-06T02:27:30.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.787+0000 7fc5d1a72700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5cc0b27f0 0x7fc5cc15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.788+0000 7fc5d1a72700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5cc0b27f0 0x7fc5cc15d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34898/0 (socket says 172.21.15.6:34898) 2023-10-06T02:27:30.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.788+0000 7fc5d1a72700 1 -- 172.21.15.6:0/1279107271 learned_addr learned my addr 172.21.15.6:0/1279107271 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:30.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.788+0000 7fc5d0a70700 1 --2- 172.21.15.6:0/1279107271 >> v2:172.21.15.175:3300/0 conn(0x7fc5cc0af8b0 0x7fc5cc15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.788+0000 7fc5d1a72700 1 -- 172.21.15.6:0/1279107271 >> v2:172.21.15.175:3300/0 conn(0x7fc5cc0af8b0 msgr2=0x7fc5cc15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:30.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.788+0000 7fc5d1a72700 1 --2- 172.21.15.6:0/1279107271 >> v2:172.21.15.175:3300/0 conn(0x7fc5cc0af8b0 0x7fc5cc15d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.788+0000 7fc5d1a72700 1 -- 172.21.15.6:0/1279107271 >> v1:172.21.15.175:6789/0 conn(0x7fc5cc0af4e0 legacy=0x7fc5cc0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.788+0000 7fc5d1a72700 1 -- 172.21.15.6:0/1279107271 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc0ccaf0 con 0x7fc5cc0b27f0 2023-10-06T02:27:30.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.788+0000 7fc5d1a72700 1 --2- 172.21.15.6:0/1279107271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5cc0b27f0 0x7fc5cc15d9a0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0cdd50 tx=0x7fc5bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f40b4e7057db1e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:30.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.788+0000 7fc5cbfff700 1 -- 172.21.15.6:0/1279107271 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc00b860 con 0x7fc5cc0b27f0 2023-10-06T02:27:30.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.788+0000 7fc5cbfff700 1 -- 172.21.15.6:0/1279107271 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc00b9c0 con 0x7fc5cc0b27f0 2023-10-06T02:27:30.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.788+0000 7fc5cbfff700 1 -- 172.21.15.6:0/1279107271 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc00bd60 con 0x7fc5cc0b27f0 2023-10-06T02:27:30.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.789+0000 7fc5d34d5700 1 -- 172.21.15.6:0/1279107271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5cc0b27f0 msgr2=0x7fc5cc15d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.789+0000 7fc5d34d5700 1 --2- 172.21.15.6:0/1279107271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5cc0b27f0 0x7fc5cc15d9a0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0cdd50 tx=0x7fc5bc009250 comp rx=0 tx=0).stop 2023-10-06T02:27:30.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.789+0000 7fc5d34d5700 1 -- 172.21.15.6:0/1279107271 shutdown_connections 2023-10-06T02:27:30.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.789+0000 7fc5d34d5700 1 --2- 172.21.15.6:0/1279107271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5cc0b27f0 0x7fc5cc15d9a0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.789+0000 7fc5d34d5700 1 --2- 172.21.15.6:0/1279107271 >> v2:172.21.15.175:3300/0 conn(0x7fc5cc0af8b0 0x7fc5cc15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.789+0000 7fc5d34d5700 1 -- 172.21.15.6:0/1279107271 >> 172.21.15.6:0/1279107271 conn(0x7fc5cc068680 msgr2=0x7fc5cc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:30.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.789+0000 7fc5d34d5700 1 -- 172.21.15.6:0/1279107271 shutdown_connections 2023-10-06T02:27:30.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.789+0000 7fc5d34d5700 1 -- 172.21.15.6:0/1279107271 wait complete. 2023-10-06T02:27:30.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.790+0000 7fc5d34d5700 1 Processor -- start 2023-10-06T02:27:30.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.790+0000 7fc5d34d5700 1 -- start start 2023-10-06T02:27:30.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d34d5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5cc0af4e0 0x7fc5cc16d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d34d5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5cc0af8b0 0x7fc5cc154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d34d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5cc0b27f0 0x7fc5cc154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d34d5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0cf4a0 con 0x7fc5cc0b27f0 2023-10-06T02:27:30.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d34d5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0cee90 con 0x7fc5cc0af4e0 2023-10-06T02:27:30.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d34d5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc1578a0 con 0x7fc5cc0af8b0 2023-10-06T02:27:30.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d1a72700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5cc0b27f0 0x7fc5cc154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d1a72700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5cc0b27f0 0x7fc5cc154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34900/0 (socket says 172.21.15.6:34900) 2023-10-06T02:27:30.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d1a72700 1 -- 172.21.15.6:0/1869082497 learned_addr learned my addr 172.21.15.6:0/1869082497 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:30.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d1271700 1 --2- 172.21.15.6:0/1869082497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5cc0af4e0 0x7fc5cc16d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d0a70700 1 --2- 172.21.15.6:0/1869082497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5cc0af8b0 0x7fc5cc154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d1a72700 1 -- 172.21.15.6:0/1869082497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5cc0af8b0 msgr2=0x7fc5cc154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d1a72700 1 --2- 172.21.15.6:0/1869082497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5cc0af8b0 0x7fc5cc154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d1a72700 1 -- 172.21.15.6:0/1869082497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5cc0af4e0 msgr2=0x7fc5cc16d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d1a72700 1 --2- 172.21.15.6:0/1869082497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5cc0af4e0 0x7fc5cc16d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d1a72700 1 -- 172.21.15.6:0/1869082497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc0094f0 con 0x7fc5cc0b27f0 2023-10-06T02:27:30.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d0a70700 1 --2- 172.21.15.6:0/1869082497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5cc0af8b0 0x7fc5cc154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:30.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5d1a72700 1 --2- 172.21.15.6:0/1869082497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5cc0b27f0 0x7fc5cc154dd0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009290 tx=0x7fc5bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:30.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.791+0000 7fc5c97fa700 1 -- 172.21.15.6:0/1869082497 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc01a630 con 0x7fc5cc0b27f0 2023-10-06T02:27:30.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.792+0000 7fc5c97fa700 1 -- 172.21.15.6:0/1869082497 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc01a790 con 0x7fc5cc0b27f0 2023-10-06T02:27:30.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.792+0000 7fc5d34d5700 1 -- 172.21.15.6:0/1869082497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5cc0cf130 con 0x7fc5cc0b27f0 2023-10-06T02:27:30.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.792+0000 7fc5c97fa700 1 -- 172.21.15.6:0/1869082497 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc01ab50 con 0x7fc5cc0b27f0 2023-10-06T02:27:30.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.792+0000 7fc5d34d5700 1 -- 172.21.15.6:0/1869082497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5cc16d610 con 0x7fc5cc0b27f0 2023-10-06T02:27:30.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.792+0000 7fc5d34d5700 1 -- 172.21.15.6:0/1869082497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5cc0cf650 con 0x7fc5cc0b27f0 2023-10-06T02:27:30.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.793+0000 7fc5c97fa700 1 -- 172.21.15.6:0/1869082497 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5bc02d440 con 0x7fc5cc0b27f0 2023-10-06T02:27:30.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.793+0000 7fc5c97fa700 1 --2- 172.21.15.6:0/1869082497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc5b8066f30 0x7fc5b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.793+0000 7fc5c97fa700 1 -- 172.21.15.6:0/1869082497 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8442+0+0 (secure 0 0 0) 0x7fc5bc086c80 con 0x7fc5cc0b27f0 2023-10-06T02:27:30.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.793+0000 7fc5d1271700 1 --2- 172.21.15.6:0/1869082497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc5b8066f30 0x7fc5b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.794+0000 7fc5d1271700 1 --2- 172.21.15.6:0/1869082497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc5b8066f30 0x7fc5b80693e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4007fd0 tx=0x7fc5c4001650 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:30.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:30.798+0000 7fc5c97fa700 1 -- 172.21.15.6:0/1869082497 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5cc0cf650 con 0x7fc5cc0b27f0 2023-10-06T02:27:31.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.046+0000 7fc5d34d5700 1 -- 172.21.15.6:0/1869082497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5cc0cf5e0 con 0x7fc5cc0b27f0 2023-10-06T02:27:31.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.046+0000 7fc5c97fa700 1 -- 172.21.15.6:0/1869082497 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 239 v239) v1 ==== 95+0+4595 (secure 0 0 0) 0x7fc5bc015020 con 0x7fc5cc0b27f0 2023-10-06T02:27:31.047 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:31.047 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":239,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9483,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1123398769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1123398769},{"type":"v1","addr":"172.21.15.6:6835","nonce":1123398769}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":239}],"filesystems":[{"mdsmap":{"epoch":238,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:29.845629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:31.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.048+0000 7fc5d34d5700 1 -- 172.21.15.6:0/1869082497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc5b8066f30 msgr2=0x7fc5b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:31.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.048+0000 7fc5d34d5700 1 --2- 172.21.15.6:0/1869082497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc5b8066f30 0x7fc5b80693e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4007fd0 tx=0x7fc5c4001650 comp rx=0 tx=0).stop 2023-10-06T02:27:31.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.048+0000 7fc5d34d5700 1 -- 172.21.15.6:0/1869082497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5cc0b27f0 msgr2=0x7fc5cc154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:31.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.048+0000 7fc5d34d5700 1 --2- 172.21.15.6:0/1869082497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5cc0b27f0 0x7fc5cc154dd0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009290 tx=0x7fc5bc017000 comp rx=0 tx=0).stop 2023-10-06T02:27:31.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.048+0000 7fc5d34d5700 1 -- 172.21.15.6:0/1869082497 shutdown_connections 2023-10-06T02:27:31.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.048+0000 7fc5d34d5700 1 --2- 172.21.15.6:0/1869082497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc5b8066f30 0x7fc5b80693e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.048+0000 7fc5d34d5700 1 --2- 172.21.15.6:0/1869082497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5cc0b27f0 0x7fc5cc154dd0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.048+0000 7fc5d34d5700 1 --2- 172.21.15.6:0/1869082497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5cc0af4e0 0x7fc5cc16d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.048+0000 7fc5d34d5700 1 --2- 172.21.15.6:0/1869082497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5cc0af8b0 0x7fc5cc154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.048+0000 7fc5d34d5700 1 -- 172.21.15.6:0/1869082497 >> 172.21.15.6:0/1869082497 conn(0x7fc5cc068680 msgr2=0x7fc5cc15c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.048+0000 7fc5d34d5700 1 -- 172.21.15.6:0/1869082497 shutdown_connections 2023-10-06T02:27:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.048+0000 7fc5d34d5700 1 -- 172.21.15.6:0/1869082497 wait complete. 2023-10-06T02:27:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 239 2023-10-06T02:27:31.061 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 1.00000000.inode' led to DAMAGED state 2023-10-06T02:27:31.061 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 200.00000000' 2023-10-06T02:27:31.061 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:31.061 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:27:31.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:31.062 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:27:31.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:27:31.078 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:27:31.078 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:27:31.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.239+0000 7f3f1c930700 1 Processor -- start 2023-10-06T02:27:31.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.239+0000 7f3f1c930700 1 -- start start 2023-10-06T02:27:31.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.240+0000 7f3f1c930700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3f180b2490 0x7f3f180cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:31.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.240+0000 7f3f1c930700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f180b2860 0x7f3f180b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:31.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.240+0000 7f3f1c930700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f180b0bb0 con 0x7f3f18159150 2023-10-06T02:27:31.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.240+0000 7f3f1c930700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f180cd6e0 con 0x7f3f180b2490 2023-10-06T02:27:31.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.240+0000 7f3f1c930700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f180cb630 con 0x7f3f180b2860 2023-10-06T02:27:31.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.240+0000 7f3f1659c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3f180b2490 0x7f3f180cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:31.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.240+0000 7f3f15d9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f180b2860 0x7f3f180b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:31.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.240+0000 7f3f16d9d700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f3f18159150 0x7f3f181595b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:37160/0 (socket says 172.21.15.6:37160) 2023-10-06T02:27:31.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.240+0000 7f3f16d9d700 1 -- 172.21.15.6:0/3092843428 learned_addr learned my addr 172.21.15.6:0/3092843428 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:31.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.240+0000 7f3f1659c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3f180b2490 0x7f3f180cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:45042/0 (socket says 172.21.15.6:45042) 2023-10-06T02:27:31.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.240+0000 7f3f15d9b700 1 -- 172.21.15.6:0/3092843428 >> v2:172.21.15.175:3300/0 conn(0x7f3f180b2490 msgr2=0x7f3f180cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:31.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.240+0000 7f3f15d9b700 1 --2- 172.21.15.6:0/3092843428 >> v2:172.21.15.175:3300/0 conn(0x7f3f180b2490 0x7f3f180cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.241+0000 7f3f15d9b700 1 -- 172.21.15.6:0/3092843428 >> v1:172.21.15.175:6789/0 conn(0x7f3f18159150 legacy=0x7f3f181595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:31.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.241+0000 7f3f15d9b700 1 -- 172.21.15.6:0/3092843428 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f180cb910 con 0x7f3f180b2860 2023-10-06T02:27:31.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.241+0000 7f3f1559a700 1 -- 172.21.15.6:0/3092843428 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385242019 0 0) 0x7f3f180b0bb0 con 0x7f3f18159150 2023-10-06T02:27:31.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.241+0000 7f3f1659c700 1 --2- 172.21.15.6:0/3092843428 >> v2:172.21.15.175:3300/0 conn(0x7f3f180b2490 0x7f3f180cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:31.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.241+0000 7f3f15d9b700 1 --2- 172.21.15.6:0/3092843428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f180b2860 0x7f3f180b0670 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3f000098e0 tx=0x7f3f000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df1845a768ac4e3f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.241+0000 7f3f1559a700 1 -- 172.21.15.6:0/3092843428 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000b640 con 0x7f3f180b2860 2023-10-06T02:27:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.241+0000 7f3f1559a700 1 -- 172.21.15.6:0/3092843428 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0000b7a0 con 0x7f3f180b2860 2023-10-06T02:27:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.241+0000 7f3f1559a700 1 -- 172.21.15.6:0/3092843428 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000bb40 con 0x7f3f180b2860 2023-10-06T02:27:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.241+0000 7f3f1c930700 1 -- 172.21.15.6:0/3092843428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f180b2860 msgr2=0x7f3f180b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.241+0000 7f3f1c930700 1 --2- 172.21.15.6:0/3092843428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f180b2860 0x7f3f180b0670 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3f000098e0 tx=0x7f3f000091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.242+0000 7f3f1c930700 1 -- 172.21.15.6:0/3092843428 shutdown_connections 2023-10-06T02:27:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.242+0000 7f3f1c930700 1 --2- 172.21.15.6:0/3092843428 >> v2:172.21.15.175:3300/0 conn(0x7f3f180b2490 0x7f3f180cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.242+0000 7f3f1c930700 1 --2- 172.21.15.6:0/3092843428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f180b2860 0x7f3f180b0670 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.242+0000 7f3f1c930700 1 -- 172.21.15.6:0/3092843428 >> 172.21.15.6:0/3092843428 conn(0x7f3f18068680 msgr2=0x7f3f18068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.242+0000 7f3f1c930700 1 -- 172.21.15.6:0/3092843428 shutdown_connections 2023-10-06T02:27:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.242+0000 7f3f1c930700 1 -- 172.21.15.6:0/3092843428 wait complete. 2023-10-06T02:27:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.243+0000 7f3f1c930700 1 Processor -- start 2023-10-06T02:27:31.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.243+0000 7f3f1c930700 1 -- start start 2023-10-06T02:27:31.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.243+0000 7f3f1c930700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f180b2490 0x7f3f1814f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:31.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.243+0000 7f3f1c930700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f180b2860 0x7f3f180c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:31.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.243+0000 7f3f1c930700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f18159150 0x7f3f18153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:31.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.243+0000 7f3f1c930700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f18151050 con 0x7f3f180b2860 2023-10-06T02:27:31.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.243+0000 7f3f1c930700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f180c4db0 con 0x7f3f180b2490 2023-10-06T02:27:31.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.243+0000 7f3f1c930700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f180c4fe0 con 0x7f3f18159150 2023-10-06T02:27:31.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.244+0000 7f3f15d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f180b2860 0x7f3f180c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:31.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.244+0000 7f3f15d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f180b2860 0x7f3f180c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34908/0 (socket says 172.21.15.6:34908) 2023-10-06T02:27:31.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.244+0000 7f3f15d9b700 1 -- 172.21.15.6:0/1616785373 learned_addr learned my addr 172.21.15.6:0/1616785373 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:31.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.244+0000 7f3f1659c700 1 --2- 172.21.15.6:0/1616785373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f180b2490 0x7f3f1814f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:31.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.244+0000 7f3f16d9d700 1 --2- 172.21.15.6:0/1616785373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f18159150 0x7f3f18153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:31.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.244+0000 7f3f15d9b700 1 -- 172.21.15.6:0/1616785373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f18159150 msgr2=0x7f3f18153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:31.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.244+0000 7f3f15d9b700 1 --2- 172.21.15.6:0/1616785373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f18159150 0x7f3f18153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.244+0000 7f3f15d9b700 1 -- 172.21.15.6:0/1616785373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f180b2490 msgr2=0x7f3f1814f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:31.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.244+0000 7f3f15d9b700 1 --2- 172.21.15.6:0/1616785373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f180b2490 0x7f3f1814f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.244+0000 7f3f15d9b700 1 -- 172.21.15.6:0/1616785373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f10009420 con 0x7f3f180b2860 2023-10-06T02:27:31.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.244+0000 7f3f15d9b700 1 --2- 172.21.15.6:0/1616785373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f180b2860 0x7f3f180c5da0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009f80 tx=0x7f3f00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:31.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.244+0000 7f3f0e7fc700 1 -- 172.21.15.6:0/1616785373 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000bb20 con 0x7f3f180b2860 2023-10-06T02:27:31.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.244+0000 7f3f0e7fc700 1 -- 172.21.15.6:0/1616785373 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f00000c90 con 0x7f3f180b2860 2023-10-06T02:27:31.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.244+0000 7f3f1c930700 1 -- 172.21.15.6:0/1616785373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f00009420 con 0x7f3f180b2860 2023-10-06T02:27:31.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.244+0000 7f3f0e7fc700 1 -- 172.21.15.6:0/1616785373 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00011650 con 0x7f3f180b2860 2023-10-06T02:27:31.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.244+0000 7f3f1c930700 1 -- 172.21.15.6:0/1616785373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f180c55a0 con 0x7f3f180b2860 2023-10-06T02:27:31.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.245+0000 7f3f1c930700 1 -- 172.21.15.6:0/1616785373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f18088700 con 0x7f3f180b2860 2023-10-06T02:27:31.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.246+0000 7f3f0e7fc700 1 -- 172.21.15.6:0/1616785373 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f00011a40 con 0x7f3f180b2860 2023-10-06T02:27:31.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.246+0000 7f3f0e7fc700 1 --2- 172.21.15.6:0/1616785373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3ef8066f30 0x7f3ef80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:31.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.246+0000 7f3f0e7fc700 1 -- 172.21.15.6:0/1616785373 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8442+0+0 (secure 0 0 0) 0x7f3f00086a60 con 0x7f3f180b2860 2023-10-06T02:27:31.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.246+0000 7f3f1659c700 1 --2- 172.21.15.6:0/1616785373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3ef8066f30 0x7f3ef80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:31.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.247+0000 7f3f1659c700 1 --2- 172.21.15.6:0/1616785373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3ef8066f30 0x7f3ef80693e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3f10009f40 tx=0x7f3f100091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:31.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.251+0000 7f3f0e7fc700 1 -- 172.21.15.6:0/1616785373 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f000531e0 con 0x7f3f180b2860 2023-10-06T02:27:31.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.492+0000 7f3f1c930700 1 -- 172.21.15.6:0/1616785373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3f18068420 con 0x7f3f180b2860 2023-10-06T02:27:31.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.944+0000 7f3f0e7fc700 1 -- 172.21.15.6:0/1616785373 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v240) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3f00056800 con 0x7f3f180b2860 2023-10-06T02:27:31.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.946+0000 7f3f1c930700 1 -- 172.21.15.6:0/1616785373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3ef8066f30 msgr2=0x7f3ef80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.946+0000 7f3f1c930700 1 --2- 172.21.15.6:0/1616785373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3ef8066f30 0x7f3ef80693e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3f10009f40 tx=0x7f3f100091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.946+0000 7f3f1c930700 1 -- 172.21.15.6:0/1616785373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f180b2860 msgr2=0x7f3f180c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.946+0000 7f3f1c930700 1 --2- 172.21.15.6:0/1616785373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f180b2860 0x7f3f180c5da0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009f80 tx=0x7f3f00017000 comp rx=0 tx=0).stop 2023-10-06T02:27:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.947+0000 7f3f1c930700 1 -- 172.21.15.6:0/1616785373 shutdown_connections 2023-10-06T02:27:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.947+0000 7f3f1c930700 1 --2- 172.21.15.6:0/1616785373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f18159150 0x7f3f18153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.947+0000 7f3f1c930700 1 --2- 172.21.15.6:0/1616785373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f180b2490 0x7f3f1814f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.947+0000 7f3f1c930700 1 --2- 172.21.15.6:0/1616785373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3ef8066f30 0x7f3ef80693e0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.947+0000 7f3f1c930700 1 --2- 172.21.15.6:0/1616785373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f180b2860 0x7f3f180c5da0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.947+0000 7f3f1c930700 1 -- 172.21.15.6:0/1616785373 >> 172.21.15.6:0/1616785373 conn(0x7f3f18068680 msgr2=0x7f3f181527d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.947+0000 7f3f1c930700 1 -- 172.21.15.6:0/1616785373 shutdown_connections 2023-10-06T02:27:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:31.947+0000 7f3f1c930700 1 -- 172.21.15.6:0/1616785373 wait complete. 2023-10-06T02:27:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:27:31.961 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:27:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.082+0000 7fab69316700 1 Processor -- start 2023-10-06T02:27:32.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.082+0000 7fab69316700 1 -- start start 2023-10-06T02:27:32.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab69316700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fab6415a030 0x7fab6415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:32.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab69316700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fab6415a940 0x7fab64086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:32.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab69316700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab64087530 0x7fab640b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:32.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab69316700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab640879d0 con 0x7fab6415a940 2023-10-06T02:27:32.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab69316700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab640b0cf0 con 0x7fab6415a030 2023-10-06T02:27:32.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab69316700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab640afc50 con 0x7fab64087530 2023-10-06T02:27:32.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab627fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fab6415a940 0x7fab64086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:32.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab627fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fab6415a940 0x7fab64086ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34924/0 (socket says 172.21.15.6:34924) 2023-10-06T02:27:32.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab627fc700 1 -- 172.21.15.6:0/4278059573 learned_addr learned my addr 172.21.15.6:0/4278059573 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:32.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab627fc700 1 -- 172.21.15.6:0/4278059573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab64087530 msgr2=0x7fab640b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:32.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab637fe700 1 --2- 172.21.15.6:0/4278059573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab64087530 0x7fab640b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:32.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab627fc700 1 --2- 172.21.15.6:0/4278059573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab64087530 0x7fab640b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab62ffd700 1 --2- 172.21.15.6:0/4278059573 >> v2:172.21.15.175:3300/0 conn(0x7fab6415a030 0x7fab6415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:32.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab627fc700 1 -- 172.21.15.6:0/4278059573 >> v2:172.21.15.175:3300/0 conn(0x7fab6415a030 msgr2=0x7fab6415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:32.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab627fc700 1 --2- 172.21.15.6:0/4278059573 >> v2:172.21.15.175:3300/0 conn(0x7fab6415a030 0x7fab6415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab627fc700 1 -- 172.21.15.6:0/4278059573 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab640aff30 con 0x7fab6415a940 2023-10-06T02:27:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab627fc700 1 --2- 172.21.15.6:0/4278059573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6415a940 0x7fab64086ff0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fab640cddc0 tx=0x7fab4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855a1f0ba9f2b38 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab61ffb700 1 -- 172.21.15.6:0/4278059573 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c00b820 con 0x7fab6415a940 2023-10-06T02:27:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab61ffb700 1 -- 172.21.15.6:0/4278059573 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c00b980 con 0x7fab6415a940 2023-10-06T02:27:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.083+0000 7fab61ffb700 1 -- 172.21.15.6:0/4278059573 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c00bd20 con 0x7fab6415a940 2023-10-06T02:27:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.084+0000 7fab69316700 1 -- 172.21.15.6:0/4278059573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6415a940 msgr2=0x7fab64086ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.084+0000 7fab69316700 1 --2- 172.21.15.6:0/4278059573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6415a940 0x7fab64086ff0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fab640cddc0 tx=0x7fab4c009250 comp rx=0 tx=0).stop 2023-10-06T02:27:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.084+0000 7fab69316700 1 -- 172.21.15.6:0/4278059573 shutdown_connections 2023-10-06T02:27:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.084+0000 7fab69316700 1 --2- 172.21.15.6:0/4278059573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab64087530 0x7fab640b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.084+0000 7fab69316700 1 --2- 172.21.15.6:0/4278059573 >> v2:172.21.15.175:3300/0 conn(0x7fab6415a030 0x7fab6415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.084+0000 7fab69316700 1 --2- 172.21.15.6:0/4278059573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6415a940 0x7fab64086ff0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.084+0000 7fab69316700 1 -- 172.21.15.6:0/4278059573 >> 172.21.15.6:0/4278059573 conn(0x7fab64068680 msgr2=0x7fab64068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.084+0000 7fab69316700 1 -- 172.21.15.6:0/4278059573 shutdown_connections 2023-10-06T02:27:32.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.084+0000 7fab69316700 1 -- 172.21.15.6:0/4278059573 wait complete. 2023-10-06T02:27:32.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.085+0000 7fab69316700 1 Processor -- start 2023-10-06T02:27:32.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.085+0000 7fab69316700 1 -- start start 2023-10-06T02:27:32.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.086+0000 7fab69316700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab64087530 0x7fab6416ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:32.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.086+0000 7fab69316700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6415a030 0x7fab640c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:32.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.086+0000 7fab69316700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab6415a940 0x7fab64169aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:32.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.086+0000 7fab69316700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab640c7830 con 0x7fab6415a030 2023-10-06T02:27:32.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.086+0000 7fab69316700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab64169fe0 con 0x7fab6415a940 2023-10-06T02:27:32.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.086+0000 7fab69316700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab640c9530 con 0x7fab64087530 2023-10-06T02:27:32.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.086+0000 7fab627fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6415a030 0x7fab640c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:32.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.086+0000 7fab627fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6415a030 0x7fab640c72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34938/0 (socket says 172.21.15.6:34938) 2023-10-06T02:27:32.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.086+0000 7fab627fc700 1 -- 172.21.15.6:0/711793497 learned_addr learned my addr 172.21.15.6:0/711793497 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:32.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.086+0000 7fab62ffd700 1 --2- 172.21.15.6:0/711793497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab64087530 0x7fab6416ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:32.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.086+0000 7fab637fe700 1 --2- 172.21.15.6:0/711793497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab6415a940 0x7fab64169aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:32.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.086+0000 7fab627fc700 1 -- 172.21.15.6:0/711793497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab64087530 msgr2=0x7fab6416ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:32.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.086+0000 7fab627fc700 1 --2- 172.21.15.6:0/711793497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab64087530 0x7fab6416ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.086+0000 7fab627fc700 1 -- 172.21.15.6:0/711793497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab6415a940 msgr2=0x7fab64169aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:32.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.086+0000 7fab627fc700 1 --2- 172.21.15.6:0/711793497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab6415a940 0x7fab64169aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.086+0000 7fab627fc700 1 -- 172.21.15.6:0/711793497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c0094f0 con 0x7fab6415a030 2023-10-06T02:27:32.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.086+0000 7fab627fc700 1 --2- 172.21.15.6:0/711793497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6415a030 0x7fab640c72f0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0099b0 tx=0x7fab4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:32.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.087+0000 7fab5affd700 1 -- 172.21.15.6:0/711793497 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c024440 con 0x7fab6415a030 2023-10-06T02:27:32.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.087+0000 7fab5affd700 1 -- 172.21.15.6:0/711793497 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c0245c0 con 0x7fab6415a030 2023-10-06T02:27:32.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.087+0000 7fab69316700 1 -- 172.21.15.6:0/711793497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab640ca0b0 con 0x7fab6415a030 2023-10-06T02:27:32.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.087+0000 7fab5affd700 1 -- 172.21.15.6:0/711793497 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c024980 con 0x7fab6415a030 2023-10-06T02:27:32.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.087+0000 7fab69316700 1 -- 172.21.15.6:0/711793497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab640c9a60 con 0x7fab6415a030 2023-10-06T02:27:32.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.087+0000 7fab69316700 1 -- 172.21.15.6:0/711793497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab640ca240 con 0x7fab6415a030 2023-10-06T02:27:32.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.088+0000 7fab5affd700 1 -- 172.21.15.6:0/711793497 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab4c01a420 con 0x7fab6415a030 2023-10-06T02:27:32.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.088+0000 7fab5affd700 1 --2- 172.21.15.6:0/711793497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fab44066f30 0x7fab440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:32.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.088+0000 7fab5affd700 1 -- 172.21.15.6:0/711793497 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8442+0+0 (secure 0 0 0) 0x7fab4c086ea0 con 0x7fab6415a030 2023-10-06T02:27:32.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.089+0000 7fab62ffd700 1 --2- 172.21.15.6:0/711793497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fab44066f30 0x7fab440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:32.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.089+0000 7fab62ffd700 1 --2- 172.21.15.6:0/711793497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fab44066f30 0x7fab440693e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00e4d0 tx=0x7fab5c007680 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:32.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.093+0000 7fab5affd700 1 -- 172.21.15.6:0/711793497 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab4c053620 con 0x7fab6415a030 2023-10-06T02:27:32.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.368+0000 7fab69316700 1 -- 172.21.15.6:0/711793497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fab640b0210 con 0x7fab6415a030 2023-10-06T02:27:32.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.955+0000 7fab5affd700 1 -- 172.21.15.6:0/711793497 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v241) v1 ==== 101+0+0 (secure 0 0 0) 0x7fab4c015090 con 0x7fab6415a030 2023-10-06T02:27:32.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.958+0000 7fab69316700 1 -- 172.21.15.6:0/711793497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fab44066f30 msgr2=0x7fab440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:32.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.958+0000 7fab69316700 1 --2- 172.21.15.6:0/711793497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fab44066f30 0x7fab440693e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00e4d0 tx=0x7fab5c007680 comp rx=0 tx=0).stop 2023-10-06T02:27:32.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.958+0000 7fab69316700 1 -- 172.21.15.6:0/711793497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6415a030 msgr2=0x7fab640c72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:32.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.958+0000 7fab69316700 1 --2- 172.21.15.6:0/711793497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6415a030 0x7fab640c72f0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0099b0 tx=0x7fab4c017000 comp rx=0 tx=0).stop 2023-10-06T02:27:32.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.958+0000 7fab69316700 1 -- 172.21.15.6:0/711793497 shutdown_connections 2023-10-06T02:27:32.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.958+0000 7fab69316700 1 --2- 172.21.15.6:0/711793497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab6415a940 0x7fab64169aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.958+0000 7fab69316700 1 --2- 172.21.15.6:0/711793497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab64087530 0x7fab6416ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.958+0000 7fab69316700 1 --2- 172.21.15.6:0/711793497 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fab44066f30 0x7fab440693e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.958+0000 7fab69316700 1 --2- 172.21.15.6:0/711793497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6415a030 0x7fab640c72f0 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.958+0000 7fab69316700 1 -- 172.21.15.6:0/711793497 >> 172.21.15.6:0/711793497 conn(0x7fab64068680 msgr2=0x7fab640b5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:32.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.958+0000 7fab69316700 1 -- 172.21.15.6:0/711793497 shutdown_connections 2023-10-06T02:27:32.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:32.958+0000 7fab69316700 1 -- 172.21.15.6:0/711793497 wait complete. 2023-10-06T02:27:32.960 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:27:32.972 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:27:33.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.012+0000 7fa3c9e85000 1 Processor -- start 2023-10-06T02:27:33.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.012+0000 7fa3c9e85000 1 -- start start 2023-10-06T02:27:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.013+0000 7fa3c9e85000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2fa5c67a0 0x55d2fa638290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.013+0000 7fa3c9e85000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2fa651cb0 0x55d2fa5803a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.013+0000 7fa3c9e85000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2fa655aa0 0x55d2fa636f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.013+0000 7fa3c9e85000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2fa4c9980 con 0x55d2fa5c67a0 2023-10-06T02:27:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.013+0000 7fa3c9e85000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2fa4c9620 con 0x55d2fa655aa0 2023-10-06T02:27:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.013+0000 7fa3c9e85000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2fa4c0400 con 0x55d2fa651cb0 2023-10-06T02:27:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.013+0000 7fa3c30c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2fa5c67a0 0x55d2fa638290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.013+0000 7fa3c30c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2fa5c67a0 0x55d2fa638290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34948/0 (socket says 172.21.15.6:34948) 2023-10-06T02:27:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.013+0000 7fa3c30c0700 1 -- 172.21.15.6:0/2498638481 learned_addr learned my addr 172.21.15.6:0/2498638481 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.013+0000 7fa3c38c1700 1 --2- 172.21.15.6:0/2498638481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2fa655aa0 0x55d2fa636f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.013+0000 7fa3c28bf700 1 --2- 172.21.15.6:0/2498638481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2fa651cb0 0x55d2fa5803a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.013+0000 7fa3c30c0700 1 -- 172.21.15.6:0/2498638481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2fa651cb0 msgr2=0x55d2fa5803a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.013+0000 7fa3c30c0700 1 --2- 172.21.15.6:0/2498638481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2fa651cb0 0x55d2fa5803a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.013+0000 7fa3c30c0700 1 -- 172.21.15.6:0/2498638481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2fa655aa0 msgr2=0x55d2fa636f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.013+0000 7fa3c30c0700 1 --2- 172.21.15.6:0/2498638481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2fa655aa0 0x55d2fa636f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.013+0000 7fa3c30c0700 1 -- 172.21.15.6:0/2498638481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b4005db0 con 0x55d2fa5c67a0 2023-10-06T02:27:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.013+0000 7fa3c28bf700 1 --2- 172.21.15.6:0/2498638481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2fa651cb0 0x55d2fa5803a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.014+0000 7fa3c30c0700 1 --2- 172.21.15.6:0/2498638481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2fa5c67a0 0x55d2fa638290 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400ae50 tx=0x7fa3b4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17bcb5e46dd3a20 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.014+0000 7fa3c18bd700 1 -- 172.21.15.6:0/2498638481 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4000bc0 con 0x55d2fa5c67a0 2023-10-06T02:27:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.014+0000 7fa3c18bd700 1 -- 172.21.15.6:0/2498638481 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b4008ab0 con 0x55d2fa5c67a0 2023-10-06T02:27:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.014+0000 7fa3c18bd700 1 -- 172.21.15.6:0/2498638481 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4008e70 con 0x55d2fa5c67a0 2023-10-06T02:27:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.014+0000 7fa3c9e85000 1 -- 172.21.15.6:0/2498638481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2fa5c67a0 msgr2=0x55d2fa638290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.014+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/2498638481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2fa5c67a0 0x55d2fa638290 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400ae50 tx=0x7fa3b4016000 comp rx=0 tx=0).stop 2023-10-06T02:27:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.014+0000 7fa3c9e85000 1 -- 172.21.15.6:0/2498638481 shutdown_connections 2023-10-06T02:27:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.014+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/2498638481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2fa655aa0 0x55d2fa636f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.014+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/2498638481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2fa5c67a0 0x55d2fa638290 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.014+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/2498638481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2fa651cb0 0x55d2fa5803a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.014+0000 7fa3c9e85000 1 -- 172.21.15.6:0/2498638481 >> 172.21.15.6:0/2498638481 conn(0x55d2fa57ed50 msgr2=0x55d2fa5c5080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.014+0000 7fa3c9e85000 1 -- 172.21.15.6:0/2498638481 shutdown_connections 2023-10-06T02:27:33.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.014+0000 7fa3c9e85000 1 -- 172.21.15.6:0/2498638481 wait complete. 2023-10-06T02:27:33.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.015+0000 7fa3c9e85000 1 Processor -- start 2023-10-06T02:27:33.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.015+0000 7fa3c9e85000 1 -- start start 2023-10-06T02:27:33.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.016+0000 7fa3c9e85000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2fa5c67a0 0x55d2fa631290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.016+0000 7fa3c9e85000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2fa651cb0 0x55d2fa62fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.016+0000 7fa3c9e85000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2fa655aa0 0x55d2fa638aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.016+0000 7fa3c9e85000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2fa6317d0 con 0x55d2fa655aa0 2023-10-06T02:27:33.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.016+0000 7fa3c9e85000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2fa630370 con 0x55d2fa651cb0 2023-10-06T02:27:33.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.016+0000 7fa3c9e85000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2fa630610 con 0x55d2fa5c67a0 2023-10-06T02:27:33.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.016+0000 7fa3c38c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2fa655aa0 0x55d2fa638aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.016+0000 7fa3c38c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2fa655aa0 0x55d2fa638aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34956/0 (socket says 172.21.15.6:34956) 2023-10-06T02:27:33.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.016+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 learned_addr learned my addr 172.21.15.6:0/372061998 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:33.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.016+0000 7fa3c30c0700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2fa5c67a0 0x55d2fa631290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.016+0000 7fa3c28bf700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2fa651cb0 0x55d2fa62fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.016+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2fa5c67a0 msgr2=0x55d2fa631290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.016+0000 7fa3c38c1700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2fa5c67a0 0x55d2fa631290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.016+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2fa651cb0 msgr2=0x55d2fa62fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.016+0000 7fa3c38c1700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2fa651cb0 0x55d2fa62fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.016+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2fa4f21c0 con 0x55d2fa655aa0 2023-10-06T02:27:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.016+0000 7fa3c38c1700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2fa655aa0 0x55d2fa638aa0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00e6c0 tx=0x7fa3bc007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.017+0000 7fa3abfff700 1 -- 172.21.15.6:0/372061998 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc012650 con 0x55d2fa655aa0 2023-10-06T02:27:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.017+0000 7fa3abfff700 1 -- 172.21.15.6:0/372061998 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc00b040 con 0x55d2fa655aa0 2023-10-06T02:27:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.017+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d2fa4d83d0 con 0x55d2fa655aa0 2023-10-06T02:27:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.017+0000 7fa3abfff700 1 -- 172.21.15.6:0/372061998 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc012a00 con 0x55d2fa655aa0 2023-10-06T02:27:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.017+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2fa4cbae0 con 0x55d2fa655aa0 2023-10-06T02:27:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.018+0000 7fa3abfff700 1 -- 172.21.15.6:0/372061998 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3bc0113c0 con 0x55d2fa655aa0 2023-10-06T02:27:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.018+0000 7fa3abfff700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa3b00658c0 0x7fa3b0067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.018+0000 7fa3abfff700 1 -- 172.21.15.6:0/372061998 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8442+0+0 (secure 0 0 0) 0x7fa3bc083d50 con 0x55d2fa655aa0 2023-10-06T02:27:33.023 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:27:33.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.019+0000 7fa3c30c0700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa3b00658c0 0x7fa3b0067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.019+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55d2fa63a910 0x55d2fa669d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.019+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa66a260 con 0x55d2fa63a910 2023-10-06T02:27:33.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.019+0000 7fa3c28bf700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55d2fa63a910 0x55d2fa669d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.019+0000 7fa3c28bf700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55d2fa63a910 0x55d2fa669d20 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:33.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.019+0000 7fa3c30c0700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa3b00658c0 0x7fa3b0067d70 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40030c0 tx=0x7fa3b401d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:33.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.021+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v119'722 uv696 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.021+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa66a640 con 0x55d2fa63a910 2023-10-06T02:27:33.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.022+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v119'723 uv723 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.022+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa66a9f0 con 0x55d2fa63a910 2023-10-06T02:27:33.025 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:27:33.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.024+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v119'724 uv724 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.024+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa677660 con 0x55d2fa63a910 2023-10-06T02:27:33.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.025+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v119'725 uv725 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.025+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa677a10 con 0x55d2fa63a910 2023-10-06T02:27:33.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.026+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v119'726 uv726 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.026+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa676650 con 0x55d2fa63a910 2023-10-06T02:27:33.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.028+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v119'727 uv727 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.028+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa676a00 con 0x55d2fa63a910 2023-10-06T02:27:33.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.029+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v119'728 uv702 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.029+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa676a00 con 0x55d2fa63a910 2023-10-06T02:27:33.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.031+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v119'729 uv729 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.031+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa676a00 con 0x55d2fa63a910 2023-10-06T02:27:33.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.032+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v119'730 uv730 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.033 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:27:33.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.032+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa676a00 con 0x55d2fa63a910 2023-10-06T02:27:33.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.033+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v119'731 uv731 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.033+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa676a00 con 0x55d2fa63a910 2023-10-06T02:27:33.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.034+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v119'732 uv732 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.034+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa676a00 con 0x55d2fa63a910 2023-10-06T02:27:33.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.035+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v119'733 uv733 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.035+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa676a00 con 0x55d2fa63a910 2023-10-06T02:27:33.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.037+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v119'734 uv709 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.037+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa676a00 con 0x55d2fa63a910 2023-10-06T02:27:33.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.038+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v119'735 uv735 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.038+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa676a00 con 0x55d2fa63a910 2023-10-06T02:27:33.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.039+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v119'736 uv736 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.040 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:27:33.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.039+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa676a00 con 0x55d2fa63a910 2023-10-06T02:27:33.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.040+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v119'737 uv737 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.040+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa676a00 con 0x55d2fa63a910 2023-10-06T02:27:33.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.041+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v119'738 uv738 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.041+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa676a00 con 0x55d2fa63a910 2023-10-06T02:27:33.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.043+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v119'739 uv739 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.043+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa677dc0 con 0x55d2fa63a910 2023-10-06T02:27:33.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.044+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v119'740 uv740 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.044+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa677dc0 con 0x55d2fa63a910 2023-10-06T02:27:33.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.045+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v119'741 uv715 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.045+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa677160 con 0x55d2fa63a910 2023-10-06T02:27:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.046+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v119'742 uv742 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.046+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa677160 con 0x55d2fa63a910 2023-10-06T02:27:33.048 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:27:33.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.048+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v119'743 uv743 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.048+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa677160 con 0x55d2fa63a910 2023-10-06T02:27:33.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.049+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v119'744 uv744 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.049+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa677160 con 0x55d2fa63a910 2023-10-06T02:27:33.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.050+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v119'745 uv745 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.051+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa677160 con 0x55d2fa63a910 2023-10-06T02:27:33.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.052+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v119'746 uv746 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.052+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa677160 con 0x55d2fa63a910 2023-10-06T02:27:33.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.053+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v119'747 uv721 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.053+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa677160 con 0x55d2fa63a910 2023-10-06T02:27:33.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.054+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v119'748 uv748 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.054+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa677160 con 0x55d2fa63a910 2023-10-06T02:27:33.056 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:27:33.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.056+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v119'749 uv749 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.056+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa677160 con 0x55d2fa63a910 2023-10-06T02:27:33.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.057+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v119'750 uv750 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.057+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa677160 con 0x55d2fa63a910 2023-10-06T02:27:33.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.058+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v119'751 uv751 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.058+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa677160 con 0x55d2fa63a910 2023-10-06T02:27:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.059+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v119'752 uv752 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa63a910 2023-10-06T02:27:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.059+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55d2fa6782d0 0x55d2fa67a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.060+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa677160 con 0x55d2fa6782d0 2023-10-06T02:27:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.060+0000 7fa3c30c0700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55d2fa6782d0 0x55d2fa67a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.060+0000 7fa3c30c0700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55d2fa6782d0 0x55d2fa67a6b0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:33.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.062+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v119'521 uv520 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.062+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67abf0 con 0x55d2fa6782d0 2023-10-06T02:27:33.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.063+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v119'522 uv522 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.063+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67afa0 con 0x55d2fa6782d0 2023-10-06T02:27:33.064 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:27:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.064+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v119'523 uv523 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.064+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67b840 con 0x55d2fa6782d0 2023-10-06T02:27:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.065+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v119'524 uv524 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.065+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67bbf0 con 0x55d2fa6782d0 2023-10-06T02:27:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.066+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v119'525 uv525 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.066+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67bfa0 con 0x55d2fa6782d0 2023-10-06T02:27:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.067+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v119'526 uv508 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.067+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67c350 con 0x55d2fa6782d0 2023-10-06T02:27:33.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.068+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v119'527 uv527 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.068+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67c350 con 0x55d2fa6782d0 2023-10-06T02:27:33.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.069+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v119'528 uv528 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.070 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:27:33.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.069+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67c350 con 0x55d2fa6782d0 2023-10-06T02:27:33.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.070+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v119'529 uv529 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.071+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67c350 con 0x55d2fa6782d0 2023-10-06T02:27:33.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.072+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v119'530 uv530 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.072+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67c350 con 0x55d2fa6782d0 2023-10-06T02:27:33.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.073+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v119'531 uv513 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.073+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67c350 con 0x55d2fa6782d0 2023-10-06T02:27:33.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.074+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v119'532 uv532 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.074+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67c350 con 0x55d2fa6782d0 2023-10-06T02:27:33.075 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:27:33.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.075+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v119'533 uv533 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.075+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67fa70 con 0x55d2fa6782d0 2023-10-06T02:27:33.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.076+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v119'534 uv534 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.076+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67fa70 con 0x55d2fa6782d0 2023-10-06T02:27:33.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.077+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v119'535 uv535 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.077+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67c350 con 0x55d2fa6782d0 2023-10-06T02:27:33.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.078+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v119'536 uv519 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.078+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67c350 con 0x55d2fa6782d0 2023-10-06T02:27:33.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.079+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v119'537 uv537 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.079+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67c350 con 0x55d2fa6782d0 2023-10-06T02:27:33.080 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:27:33.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.080+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v119'538 uv538 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.080+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67d360 con 0x55d2fa6782d0 2023-10-06T02:27:33.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.081+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v119'539 uv539 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.081+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67d360 con 0x55d2fa6782d0 2023-10-06T02:27:33.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.082+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v119'540 uv540 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.082+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67c350 con 0x55d2fa6782d0 2023-10-06T02:27:33.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.083+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v119'541 uv541 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.083+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55d2fa67c860 0x55d2fa67ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.083+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67f180 con 0x55d2fa67c860 2023-10-06T02:27:33.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.083+0000 7fa3c28bf700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55d2fa67c860 0x55d2fa67ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.083+0000 7fa3c28bf700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55d2fa67c860 0x55d2fa67ec40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:33.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.085+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v119'141 uv140 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.085+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67f180 con 0x55d2fa67c860 2023-10-06T02:27:33.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.086+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v119'142 uv142 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.086+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67f180 con 0x55d2fa67c860 2023-10-06T02:27:33.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.087+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v119'143 uv143 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.087 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:27:33.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.087+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa6806a0 con 0x55d2fa67c860 2023-10-06T02:27:33.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.088+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v119'144 uv144 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.088+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa6806a0 con 0x55d2fa67c860 2023-10-06T02:27:33.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.089+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v119'145 uv145 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.089+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67f690 con 0x55d2fa67c860 2023-10-06T02:27:33.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.090+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v119'146 uv146 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.090+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67f690 con 0x55d2fa67c860 2023-10-06T02:27:33.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.091+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v119'100 uv99 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.091+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67f690 con 0x55d2fa67c860 2023-10-06T02:27:33.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.092+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v119'101 uv101 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.092+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67f690 con 0x55d2fa67c860 2023-10-06T02:27:33.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.093+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v119'102 uv102 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.093 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:27:33.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.093+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67f690 con 0x55d2fa67c860 2023-10-06T02:27:33.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.093+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v119'103 uv103 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.093+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67f690 con 0x55d2fa6782d0 2023-10-06T02:27:33.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.095+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v119'141 uv140 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.095+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67f690 con 0x55d2fa6782d0 2023-10-06T02:27:33.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.096+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v119'142 uv142 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.096+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67f690 con 0x55d2fa6782d0 2023-10-06T02:27:33.097 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:27:33.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.097+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v119'143 uv143 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.097+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa6806a0 con 0x55d2fa6782d0 2023-10-06T02:27:33.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.098+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v119'144 uv144 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.098+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa6806a0 con 0x55d2fa6782d0 2023-10-06T02:27:33.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.099+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v119'145 uv145 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.099+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa67f690 con 0x55d2fa6782d0 2023-10-06T02:27:33.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.100+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v119'146 uv146 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa6782d0 2023-10-06T02:27:33.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.100+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55d2fa67fd10 0x55d2fa6820f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.100+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa682630 con 0x55d2fa67fd10 2023-10-06T02:27:33.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.100+0000 7fa3c38c1700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55d2fa67fd10 0x55d2fa6820f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.100+0000 7fa3c38c1700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55d2fa67fd10 0x55d2fa6820f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.101+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v119'260 uv254 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa67fd10 2023-10-06T02:27:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.102+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa682aa0 con 0x55d2fa67fd10 2023-10-06T02:27:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.102+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v119'261 uv261 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa67fd10 2023-10-06T02:27:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.103+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa682f90 con 0x55d2fa67fd10 2023-10-06T02:27:33.104 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:27:33.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.104+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v119'262 uv262 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa67fd10 2023-10-06T02:27:33.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.104+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa684890 con 0x55d2fa67fd10 2023-10-06T02:27:33.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.105+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v119'263 uv263 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa67fd10 2023-10-06T02:27:33.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.105+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa684c40 con 0x55d2fa67fd10 2023-10-06T02:27:33.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.106+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v119'264 uv264 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa67fd10 2023-10-06T02:27:33.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.106+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa683880 con 0x55d2fa67fd10 2023-10-06T02:27:33.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.107+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v119'265 uv265 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa67fd10 2023-10-06T02:27:33.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.107+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa683c80 con 0x55d2fa67fd10 2023-10-06T02:27:33.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.109+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v119'266 uv259 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa67fd10 2023-10-06T02:27:33.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.109+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa684080 con 0x55d2fa67fd10 2023-10-06T02:27:33.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.110+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v119'267 uv267 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa67fd10 2023-10-06T02:27:33.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.110+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa684080 con 0x55d2fa67fd10 2023-10-06T02:27:33.111 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:27:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.111+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v119'268 uv268 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa67fd10 2023-10-06T02:27:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.111+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa684030 con 0x55d2fa67fd10 2023-10-06T02:27:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.112+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v119'269 uv269 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa67fd10 2023-10-06T02:27:33.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.112+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa684030 con 0x55d2fa67fd10 2023-10-06T02:27:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.113+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v119'270 uv270 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa67fd10 2023-10-06T02:27:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.113+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55d2fa684400 0x55d2fa687510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.114+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa687a50 con 0x55d2fa684400 2023-10-06T02:27:33.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.114+0000 7fa3c30c0700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55d2fa684400 0x55d2fa687510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.114+0000 7fa3c30c0700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55d2fa684400 0x55d2fa687510 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:33.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.115+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v119'117 uv116 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa684400 2023-10-06T02:27:33.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.115+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa687a50 con 0x55d2fa684400 2023-10-06T02:27:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.116+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v119'118 uv118 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa684400 2023-10-06T02:27:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.117+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa687a50 con 0x55d2fa684400 2023-10-06T02:27:33.119 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:27:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.119+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v119'119 uv119 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa684400 2023-10-06T02:27:33.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.119+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa687a50 con 0x55d2fa684400 2023-10-06T02:27:33.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.122+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v119'120 uv120 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa684400 2023-10-06T02:27:33.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.122+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa687ea0 con 0x55d2fa684400 2023-10-06T02:27:33.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.125+0000 7fa3c30c0700 1 -- 172.21.15.6:0/372061998 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v119'121 uv121 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3b4008c20 con 0x55d2fa684400 2023-10-06T02:27:33.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.125+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa687ea0 con 0x55d2fa67c860 2023-10-06T02:27:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.126+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v119'141 uv140 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.126+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa687ea0 con 0x55d2fa67c860 2023-10-06T02:27:33.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.127+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v119'142 uv142 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.127+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa687ea0 con 0x55d2fa67c860 2023-10-06T02:27:33.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.127+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v119'143 uv143 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.128 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:27:33.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.127+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa688eb0 con 0x55d2fa67c860 2023-10-06T02:27:33.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.128+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v119'144 uv144 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.128+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa688eb0 con 0x55d2fa67c860 2023-10-06T02:27:33.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.129+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v119'145 uv145 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.129+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa687ea0 con 0x55d2fa67c860 2023-10-06T02:27:33.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.130+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v119'146 uv146 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.130+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55d2fa6883b0 0x55d2fa68a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.130+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68ad60 con 0x55d2fa6883b0 2023-10-06T02:27:33.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.130+0000 7fa3c28bf700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55d2fa6883b0 0x55d2fa68a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.131+0000 7fa3c28bf700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55d2fa6883b0 0x55d2fa68a790 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:33.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.132+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v119'233 uv227 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa6883b0 2023-10-06T02:27:33.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.132+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68b140 con 0x55d2fa6883b0 2023-10-06T02:27:33.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.133+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v119'234 uv234 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa6883b0 2023-10-06T02:27:33.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.133+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68b140 con 0x55d2fa6883b0 2023-10-06T02:27:33.134 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:27:33.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.134+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v119'235 uv235 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa6883b0 2023-10-06T02:27:33.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.134+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68b140 con 0x55d2fa6883b0 2023-10-06T02:27:33.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.135+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v119'236 uv236 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa6883b0 2023-10-06T02:27:33.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.135+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68b140 con 0x55d2fa6883b0 2023-10-06T02:27:33.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.136+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v119'237 uv237 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa6883b0 2023-10-06T02:27:33.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.136+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68b140 con 0x55d2fa6883b0 2023-10-06T02:27:33.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.137+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v119'238 uv232 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa6883b0 2023-10-06T02:27:33.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.137+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68b140 con 0x55d2fa6883b0 2023-10-06T02:27:33.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.138+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v119'239 uv239 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa6883b0 2023-10-06T02:27:33.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.138+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68b140 con 0x55d2fa6883b0 2023-10-06T02:27:33.139 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:27:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.139+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v119'240 uv240 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa6883b0 2023-10-06T02:27:33.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.139+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68b140 con 0x55d2fa6883b0 2023-10-06T02:27:33.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.140+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v119'241 uv241 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa6883b0 2023-10-06T02:27:33.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.140+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68deb0 con 0x55d2fa6883b0 2023-10-06T02:27:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.141+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v119'242 uv242 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa6883b0 2023-10-06T02:27:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.141+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68b630 con 0x55d2fa67c860 2023-10-06T02:27:33.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.144+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v119'103 uv102 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.144+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68b630 con 0x55d2fa67c860 2023-10-06T02:27:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.144+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v119'104 uv104 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.145+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68b630 con 0x55d2fa67c860 2023-10-06T02:27:33.146 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:27:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.145+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v119'105 uv105 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.145+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68b630 con 0x55d2fa67c860 2023-10-06T02:27:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.146+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v119'106 uv106 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.146+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55d2fa68bb40 0x55d2fa68bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.147+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e600 con 0x55d2fa68bb40 2023-10-06T02:27:33.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.147+0000 7fa3c38c1700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55d2fa68bb40 0x55d2fa68bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.147+0000 7fa3c38c1700 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55d2fa68bb40 0x55d2fa68bf30 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:33.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.148+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v119'141 uv140 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa68bb40 2023-10-06T02:27:33.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.148+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e600 con 0x55d2fa68bb40 2023-10-06T02:27:33.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.151+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v119'142 uv142 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa68bb40 2023-10-06T02:27:33.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.151+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e600 con 0x55d2fa68bb40 2023-10-06T02:27:33.153 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:27:33.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.152+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v119'143 uv143 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa68bb40 2023-10-06T02:27:33.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.152+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68f610 con 0x55d2fa68bb40 2023-10-06T02:27:33.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.155+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v119'144 uv144 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa68bb40 2023-10-06T02:27:33.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.155+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68f610 con 0x55d2fa68bb40 2023-10-06T02:27:33.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.158+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v119'145 uv145 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa68bb40 2023-10-06T02:27:33.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.158+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e600 con 0x55d2fa68bb40 2023-10-06T02:27:33.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.160+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v119'146 uv146 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa68bb40 2023-10-06T02:27:33.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.160+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e600 con 0x55d2fa67fd10 2023-10-06T02:27:33.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.161+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v119'120 uv119 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa67fd10 2023-10-06T02:27:33.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.161+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e600 con 0x55d2fa67fd10 2023-10-06T02:27:33.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.162+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v119'121 uv121 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa67fd10 2023-10-06T02:27:33.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.162+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e600 con 0x55d2fa67fd10 2023-10-06T02:27:33.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.163+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v119'122 uv122 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa67fd10 2023-10-06T02:27:33.164 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:27:33.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.163+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e600 con 0x55d2fa67fd10 2023-10-06T02:27:33.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.164+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v119'123 uv123 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa67fd10 2023-10-06T02:27:33.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.164+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e600 con 0x55d2fa67fd10 2023-10-06T02:27:33.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.165+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v119'124 uv124 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fa3bc052530 con 0x55d2fa67fd10 2023-10-06T02:27:33.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.165+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e600 con 0x55d2fa67c860 2023-10-06T02:27:33.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.166+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v119'290 uv282 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.166+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e600 con 0x55d2fa67c860 2023-10-06T02:27:33.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.167+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v119'291 uv291 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.167+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e600 con 0x55d2fa67c860 2023-10-06T02:27:33.169 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:27:33.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.168+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v119'292 uv292 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.168+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e600 con 0x55d2fa67c860 2023-10-06T02:27:33.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.171+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v119'293 uv293 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.171+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68ea30 con 0x55d2fa67c860 2023-10-06T02:27:33.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.173+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v119'294 uv294 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.173+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68ea30 con 0x55d2fa67c860 2023-10-06T02:27:33.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.176+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v119'295 uv289 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.176+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e600 con 0x55d2fa67c860 2023-10-06T02:27:33.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.179+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v119'296 uv296 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.179+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e600 con 0x55d2fa67c860 2023-10-06T02:27:33.181 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:27:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.181+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v119'297 uv297 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.181+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e600 con 0x55d2fa67c860 2023-10-06T02:27:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.183+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v119'298 uv298 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.183+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e600 con 0x55d2fa67c860 2023-10-06T02:27:33.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.186+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v119'299 uv299 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.186+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68e9e0 con 0x55d2fa67c860 2023-10-06T02:27:33.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.187+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v119'300 uv300 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.187+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55d2fa68eed0 con 0x55d2fa67c860 2023-10-06T02:27:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c28bf700 1 -- 172.21.15.6:0/372061998 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v119'301 uv301 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa3b800e790 con 0x55d2fa67c860 2023-10-06T02:27:33.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55d2fa67c860 msgr2=0x55d2fa67ec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55d2fa67c860 0x55d2fa67ec40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55d2fa63a910 msgr2=0x55d2fa669d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55d2fa63a910 0x55d2fa669d20 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55d2fa6883b0 msgr2=0x55d2fa68a790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55d2fa6883b0 0x55d2fa68a790 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55d2fa6782d0 msgr2=0x55d2fa67a6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55d2fa6782d0 0x55d2fa67a6b0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 reap_dead start 2023-10-06T02:27:33.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55d2fa68bb40 msgr2=0x55d2fa68bf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55d2fa68bb40 0x55d2fa68bf30 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55d2fa684400 msgr2=0x55d2fa687510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55d2fa684400 0x55d2fa687510 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55d2fa67fd10 msgr2=0x55d2fa6820f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55d2fa67fd10 0x55d2fa6820f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa3b00658c0 msgr2=0x7fa3b0067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa3b00658c0 0x7fa3b0067d70 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40030c0 tx=0x7fa3b401d000 comp rx=0 tx=0).stop 2023-10-06T02:27:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2fa655aa0 msgr2=0x55d2fa638aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c38c1700 1 -- 172.21.15.6:0/372061998 reap_dead start 2023-10-06T02:27:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.188+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2fa655aa0 0x55d2fa638aa0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00e6c0 tx=0x7fa3bc007040 comp rx=0 tx=0).stop 2023-10-06T02:27:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.189+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 shutdown_connections 2023-10-06T02:27:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.189+0000 7fa3c9e85000 1 --2- 172.21.15.6:0/372061998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2fa655aa0 0x55d2fa638aa0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.189+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 >> 172.21.15.6:0/372061998 conn(0x55d2fa57ed50 msgr2=0x55d2fa5abe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:33.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.189+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 shutdown_connections 2023-10-06T02:27:33.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.189+0000 7fa3c9e85000 1 -- 172.21.15.6:0/372061998 wait complete. 2023-10-06T02:27:33.193 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 200.00000000 0 2023-10-06T02:27:33.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.273+0000 7f989d9c1000 1 Processor -- start 2023-10-06T02:27:33.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.273+0000 7f989d9c1000 1 -- start start 2023-10-06T02:27:33.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.273+0000 7f989d9c1000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55da0ddf9e30 0x55da0dea1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.273+0000 7f989d9c1000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da0ddfc9e0 0x55da0de9c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.273+0000 7f989d9c1000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da0dea2f50 0x55da0de9c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.273+0000 7f989d9c1000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da0dd75320 con 0x55da0dea2f50 2023-10-06T02:27:33.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.273+0000 7f989d9c1000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da0dd19980 con 0x55da0ddfc9e0 2023-10-06T02:27:33.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.273+0000 7f989d9c1000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da0dd19620 con 0x55da0ddf9e30 2023-10-06T02:27:33.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.274+0000 7f98973fd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da0dea2f50 0x55da0de9c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.274+0000 7f98973fd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da0dea2f50 0x55da0de9c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34982/0 (socket says 172.21.15.6:34982) 2023-10-06T02:27:33.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.274+0000 7f98973fd700 1 -- 172.21.15.6:0/2721445256 learned_addr learned my addr 172.21.15.6:0/2721445256 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.274+0000 7f9896bfc700 1 --2- 172.21.15.6:0/2721445256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55da0ddf9e30 0x55da0dea1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.274+0000 7f98963fb700 1 --2- 172.21.15.6:0/2721445256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da0ddfc9e0 0x55da0de9c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.274+0000 7f98973fd700 1 -- 172.21.15.6:0/2721445256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55da0ddf9e30 msgr2=0x55da0dea1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.274+0000 7f98973fd700 1 --2- 172.21.15.6:0/2721445256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55da0ddf9e30 0x55da0dea1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.274+0000 7f98973fd700 1 -- 172.21.15.6:0/2721445256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da0ddfc9e0 msgr2=0x55da0de9c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.274+0000 7f98973fd700 1 --2- 172.21.15.6:0/2721445256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da0ddfc9e0 0x55da0de9c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.274+0000 7f98973fd700 1 -- 172.21.15.6:0/2721445256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9880005cf0 con 0x55da0dea2f50 2023-10-06T02:27:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.274+0000 7f98973fd700 1 --2- 172.21.15.6:0/2721445256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da0dea2f50 0x55da0de9c890 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f9888001580 tx=0x7f9888006b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361a97a23f48b745 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.274+0000 7f98953f9700 1 -- 172.21.15.6:0/2721445256 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888006110 con 0x55da0dea2f50 2023-10-06T02:27:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.274+0000 7f98953f9700 1 -- 172.21.15.6:0/2721445256 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9888006290 con 0x55da0dea2f50 2023-10-06T02:27:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.274+0000 7f98953f9700 1 -- 172.21.15.6:0/2721445256 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888006400 con 0x55da0dea2f50 2023-10-06T02:27:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.275+0000 7f989d9c1000 1 -- 172.21.15.6:0/2721445256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da0dea2f50 msgr2=0x55da0de9c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.275+0000 7f989d9c1000 1 --2- 172.21.15.6:0/2721445256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da0dea2f50 0x55da0de9c890 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f9888001580 tx=0x7f9888006b10 comp rx=0 tx=0).stop 2023-10-06T02:27:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.275+0000 7f989d9c1000 1 -- 172.21.15.6:0/2721445256 shutdown_connections 2023-10-06T02:27:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.275+0000 7f989d9c1000 1 --2- 172.21.15.6:0/2721445256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da0dea2f50 0x55da0de9c890 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.275+0000 7f989d9c1000 1 --2- 172.21.15.6:0/2721445256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55da0ddf9e30 0x55da0dea1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.275+0000 7f989d9c1000 1 --2- 172.21.15.6:0/2721445256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da0ddfc9e0 0x55da0de9c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.275+0000 7f989d9c1000 1 -- 172.21.15.6:0/2721445256 >> 172.21.15.6:0/2721445256 conn(0x55da0de15bd0 msgr2=0x55da0de9ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.275+0000 7f989d9c1000 1 -- 172.21.15.6:0/2721445256 shutdown_connections 2023-10-06T02:27:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.275+0000 7f989d9c1000 1 -- 172.21.15.6:0/2721445256 wait complete. 2023-10-06T02:27:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.275+0000 7f989d9c1000 1 Processor -- start 2023-10-06T02:27:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.275+0000 7f989d9c1000 1 -- start start 2023-10-06T02:27:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.276+0000 7f989d9c1000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da0ddf9e30 0x55da0deb5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.276+0000 7f989d9c1000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55da0ddfc9e0 0x55da0ddccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.276+0000 7f989d9c1000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da0dea2f50 0x55da0de988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.276+0000 7f989d9c1000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da0dd10400 con 0x55da0ddf9e30 2023-10-06T02:27:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.276+0000 7f989d9c1000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da0dea3320 con 0x55da0dea2f50 2023-10-06T02:27:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.276+0000 7f989d9c1000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da0ddcd130 con 0x55da0ddfc9e0 2023-10-06T02:27:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.276+0000 7f9896bfc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da0ddf9e30 0x55da0deb5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.276+0000 7f9896bfc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da0ddf9e30 0x55da0deb5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34994/0 (socket says 172.21.15.6:34994) 2023-10-06T02:27:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.276+0000 7f9896bfc700 1 -- 172.21.15.6:0/492221976 learned_addr learned my addr 172.21.15.6:0/492221976 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.276+0000 7f98963fb700 1 --2- 172.21.15.6:0/492221976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55da0ddfc9e0 0x55da0ddccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.276+0000 7f98973fd700 1 --2- 172.21.15.6:0/492221976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da0dea2f50 0x55da0de988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.276+0000 7f9896bfc700 1 -- 172.21.15.6:0/492221976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55da0ddfc9e0 msgr2=0x55da0ddccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.276+0000 7f9896bfc700 1 --2- 172.21.15.6:0/492221976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55da0ddfc9e0 0x55da0ddccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.276+0000 7f9896bfc700 1 -- 172.21.15.6:0/492221976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da0dea2f50 msgr2=0x55da0de988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.276+0000 7f9896bfc700 1 --2- 172.21.15.6:0/492221976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da0dea2f50 0x55da0de988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.276+0000 7f9896bfc700 1 -- 172.21.15.6:0/492221976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da0dd1b750 con 0x55da0ddf9e30 2023-10-06T02:27:33.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.277+0000 7f9896bfc700 1 --2- 172.21.15.6:0/492221976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da0ddf9e30 0x55da0deb5850 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f9890002ed0 tx=0x7f9890001780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:33.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.277+0000 7f988f7fe700 1 -- 172.21.15.6:0/492221976 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989000cca0 con 0x55da0ddf9e30 2023-10-06T02:27:33.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.277+0000 7f988f7fe700 1 -- 172.21.15.6:0/492221976 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9890008030 con 0x55da0ddf9e30 2023-10-06T02:27:33.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.277+0000 7f988f7fe700 1 -- 172.21.15.6:0/492221976 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890011450 con 0x55da0ddf9e30 2023-10-06T02:27:33.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.277+0000 7f989d9c1000 1 -- 172.21.15.6:0/492221976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55da0dd1bae0 con 0x55da0ddf9e30 2023-10-06T02:27:33.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.277+0000 7f989d9c1000 1 -- 172.21.15.6:0/492221976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da0dd1b540 con 0x55da0ddf9e30 2023-10-06T02:27:33.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.278+0000 7f988f7fe700 1 -- 172.21.15.6:0/492221976 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98900117c0 con 0x55da0ddf9e30 2023-10-06T02:27:33.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.278+0000 7f988f7fe700 1 --2- 172.21.15.6:0/492221976 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9878065890 0x7f9878067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.278+0000 7f988f7fe700 1 -- 172.21.15.6:0/492221976 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8442+0+0 (secure 0 0 0) 0x7f9890083e90 con 0x55da0ddf9e30 2023-10-06T02:27:33.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.279+0000 7f98963fb700 1 --2- 172.21.15.6:0/492221976 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9878065890 0x7f9878067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.279+0000 7f989d9c1000 1 --2- 172.21.15.6:0/492221976 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55da0dea3750 0x55da0dea3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.279+0000 7f989d9c1000 1 -- 172.21.15.6:0/492221976 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:292cf221:::200.00000000:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x55da0dea4090 con 0x55da0dea3750 2023-10-06T02:27:33.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.279+0000 7f98973fd700 1 --2- 172.21.15.6:0/492221976 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55da0dea3750 0x55da0dea3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.279+0000 7f98963fb700 1 --2- 172.21.15.6:0/492221976 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9878065890 0x7f9878067d40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9880003080 tx=0x7f9880019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:33.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.279+0000 7f98973fd700 1 --2- 172.21.15.6:0/492221976 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55da0dea3750 0x55da0dea3b50 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:33.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.280+0000 7f98973fd700 1 -- 172.21.15.6:0/492221976 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 200.00000000 [truncate 0] v119'542 uv542 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f98880044f0 con 0x55da0dea3750 2023-10-06T02:27:33.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.280+0000 7f989d9c1000 1 -- 172.21.15.6:0/492221976 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55da0dea3750 msgr2=0x55da0dea3b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.280+0000 7f989d9c1000 1 --2- 172.21.15.6:0/492221976 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55da0dea3750 0x55da0dea3b50 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.280+0000 7f989d9c1000 1 -- 172.21.15.6:0/492221976 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9878065890 msgr2=0x7f9878067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.280+0000 7f989d9c1000 1 --2- 172.21.15.6:0/492221976 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9878065890 0x7f9878067d40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9880003080 tx=0x7f9880019000 comp rx=0 tx=0).stop 2023-10-06T02:27:33.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.280+0000 7f989d9c1000 1 -- 172.21.15.6:0/492221976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da0ddf9e30 msgr2=0x55da0deb5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.280+0000 7f989d9c1000 1 --2- 172.21.15.6:0/492221976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da0ddf9e30 0x55da0deb5850 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f9890002ed0 tx=0x7f9890001780 comp rx=0 tx=0).stop 2023-10-06T02:27:33.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.281+0000 7f98973fd700 1 -- 172.21.15.6:0/492221976 reap_dead start 2023-10-06T02:27:33.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.281+0000 7f989d9c1000 1 -- 172.21.15.6:0/492221976 shutdown_connections 2023-10-06T02:27:33.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.281+0000 7f989d9c1000 1 -- 172.21.15.6:0/492221976 >> 172.21.15.6:0/492221976 conn(0x55da0de15bd0 msgr2=0x55da0de9e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:33.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.281+0000 7f989d9c1000 1 -- 172.21.15.6:0/492221976 shutdown_connections 2023-10-06T02:27:33.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.281+0000 7f989d9c1000 1 -- 172.21.15.6:0/492221976 wait complete. 2023-10-06T02:27:33.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:27:33.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.447+0000 7fbe0a3e7700 1 Processor -- start 2023-10-06T02:27:33.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.447+0000 7fbe0a3e7700 1 -- start start 2023-10-06T02:27:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.448+0000 7fbe0a3e7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbe0415cae0 0x7fbe040c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.448+0000 7fbe0a3e7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe040cc740 0x7fbe040ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.448+0000 7fbe0a3e7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0406a1a0 con 0x7fbe0406a910 2023-10-06T02:27:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.448+0000 7fbe0a3e7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0406a480 con 0x7fbe0415cae0 2023-10-06T02:27:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.448+0000 7fbe0a3e7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe040c3f40 con 0x7fbe040cc740 2023-10-06T02:27:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.448+0000 7fbe08984700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe040cc740 0x7fbe040ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.448+0000 7fbe03fff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbe0415cae0 0x7fbe040c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.448+0000 7fbe037fe700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fbe0406a910 0x7fbe0406ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:37186/0 (socket says 172.21.15.6:37186) 2023-10-06T02:27:33.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.448+0000 7fbe037fe700 1 -- 172.21.15.6:0/1418956135 learned_addr learned my addr 172.21.15.6:0/1418956135 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:33.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.448+0000 7fbe02ffd700 1 -- 172.21.15.6:0/1418956135 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142471697 0 0) 0x7fbe0406a1a0 con 0x7fbe0406a910 2023-10-06T02:27:33.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.448+0000 7fbe08984700 1 -- 172.21.15.6:0/1418956135 >> v2:172.21.15.175:3300/0 conn(0x7fbe0415cae0 msgr2=0x7fbe040c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:33.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.448+0000 7fbe08984700 1 --2- 172.21.15.6:0/1418956135 >> v2:172.21.15.175:3300/0 conn(0x7fbe0415cae0 0x7fbe040c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.448+0000 7fbe08984700 1 -- 172.21.15.6:0/1418956135 >> v1:172.21.15.175:6789/0 conn(0x7fbe0406a910 legacy=0x7fbe0406ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.448+0000 7fbe08984700 1 -- 172.21.15.6:0/1418956135 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe040c4220 con 0x7fbe040cc740 2023-10-06T02:27:33.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.448+0000 7fbe08984700 1 --2- 172.21.15.6:0/1418956135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe040cc740 0x7fbe040ccbc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009e60 tx=0x7fbdfc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d53b6aab0af6ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:33.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.449+0000 7fbe02ffd700 1 -- 172.21.15.6:0/1418956135 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc00e070 con 0x7fbe040cc740 2023-10-06T02:27:33.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.449+0000 7fbe02ffd700 1 -- 172.21.15.6:0/1418956135 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc00bb60 con 0x7fbe040cc740 2023-10-06T02:27:33.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.449+0000 7fbe02ffd700 1 -- 172.21.15.6:0/1418956135 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc012430 con 0x7fbe040cc740 2023-10-06T02:27:33.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.449+0000 7fbe0a3e7700 1 -- 172.21.15.6:0/1418956135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe040cc740 msgr2=0x7fbe040ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.449+0000 7fbe0a3e7700 1 --2- 172.21.15.6:0/1418956135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe040cc740 0x7fbe040ccbc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009e60 tx=0x7fbdfc009780 comp rx=0 tx=0).stop 2023-10-06T02:27:33.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.449+0000 7fbe0a3e7700 1 -- 172.21.15.6:0/1418956135 shutdown_connections 2023-10-06T02:27:33.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.449+0000 7fbe0a3e7700 1 --2- 172.21.15.6:0/1418956135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe040cc740 0x7fbe040ccbc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.449+0000 7fbe0a3e7700 1 --2- 172.21.15.6:0/1418956135 >> v2:172.21.15.175:3300/0 conn(0x7fbe0415cae0 0x7fbe040c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.449+0000 7fbe0a3e7700 1 -- 172.21.15.6:0/1418956135 >> 172.21.15.6:0/1418956135 conn(0x7fbe04067910 msgr2=0x7fbe040ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:33.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.449+0000 7fbe0a3e7700 1 -- 172.21.15.6:0/1418956135 shutdown_connections 2023-10-06T02:27:33.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.449+0000 7fbe0a3e7700 1 -- 172.21.15.6:0/1418956135 wait complete. 2023-10-06T02:27:33.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.450+0000 7fbe0a3e7700 1 Processor -- start 2023-10-06T02:27:33.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.450+0000 7fbe0a3e7700 1 -- start start 2023-10-06T02:27:33.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.451+0000 7fbe0a3e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe0406a910 0x7fbe041699b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.451+0000 7fbe0a3e7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe040cc740 0x7fbe0409a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.451+0000 7fbe0a3e7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe0415cae0 0x7fbe04098220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.451+0000 7fbe0a3e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe04156920 con 0x7fbe0406a910 2023-10-06T02:27:33.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.451+0000 7fbe0a3e7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe040b1880 con 0x7fbe0415cae0 2023-10-06T02:27:33.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.451+0000 7fbe0a3e7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe040b0f50 con 0x7fbe040cc740 2023-10-06T02:27:33.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.451+0000 7fbe03fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe0406a910 0x7fbe041699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.451+0000 7fbe03fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe0406a910 0x7fbe041699b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35010/0 (socket says 172.21.15.6:35010) 2023-10-06T02:27:33.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.451+0000 7fbe03fff700 1 -- 172.21.15.6:0/72288890 learned_addr learned my addr 172.21.15.6:0/72288890 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:33.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.451+0000 7fbe037fe700 1 --2- 172.21.15.6:0/72288890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe040cc740 0x7fbe0409a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.452+0000 7fbe08984700 1 --2- 172.21.15.6:0/72288890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe0415cae0 0x7fbe04098220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.452+0000 7fbe03fff700 1 -- 172.21.15.6:0/72288890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe040cc740 msgr2=0x7fbe0409a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.452+0000 7fbe03fff700 1 --2- 172.21.15.6:0/72288890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe040cc740 0x7fbe0409a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.452+0000 7fbe03fff700 1 -- 172.21.15.6:0/72288890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe0415cae0 msgr2=0x7fbe04098220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.452+0000 7fbe03fff700 1 --2- 172.21.15.6:0/72288890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe0415cae0 0x7fbe04098220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.452+0000 7fbe03fff700 1 -- 172.21.15.6:0/72288890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc009a20 con 0x7fbe0406a910 2023-10-06T02:27:33.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.452+0000 7fbe08984700 1 --2- 172.21.15.6:0/72288890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe0415cae0 0x7fbe04098220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:33.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.452+0000 7fbe03fff700 1 --2- 172.21.15.6:0/72288890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe0406a910 0x7fbe041699b0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400ea00 tx=0x7fbdf4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:33.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.452+0000 7fbdebfff700 1 -- 172.21.15.6:0/72288890 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400c850 con 0x7fbe0406a910 2023-10-06T02:27:33.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.452+0000 7fbdebfff700 1 -- 172.21.15.6:0/72288890 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf400c9b0 con 0x7fbe0406a910 2023-10-06T02:27:33.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.452+0000 7fbdebfff700 1 -- 172.21.15.6:0/72288890 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400cd30 con 0x7fbe0406a910 2023-10-06T02:27:33.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.452+0000 7fbe0a3e7700 1 -- 172.21.15.6:0/72288890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe040b1230 con 0x7fbe0406a910 2023-10-06T02:27:33.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.452+0000 7fbe0a3e7700 1 -- 172.21.15.6:0/72288890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe04169ef0 con 0x7fbe0406a910 2023-10-06T02:27:33.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.453+0000 7fbe0a3e7700 1 -- 172.21.15.6:0/72288890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0406e590 con 0x7fbe0406a910 2023-10-06T02:27:33.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.453+0000 7fbdebfff700 1 -- 172.21.15.6:0/72288890 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbdf4013680 con 0x7fbe0406a910 2023-10-06T02:27:33.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.454+0000 7fbdebfff700 1 --2- 172.21.15.6:0/72288890 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbdf0066f30 0x7fbdf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:33.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.454+0000 7fbdebfff700 1 -- 172.21.15.6:0/72288890 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8442+0+0 (secure 0 0 0) 0x7fbdf40857a0 con 0x7fbe0406a910 2023-10-06T02:27:33.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.454+0000 7fbe037fe700 1 --2- 172.21.15.6:0/72288890 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbdf0066f30 0x7fbdf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:33.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.454+0000 7fbe037fe700 1 --2- 172.21.15.6:0/72288890 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbdf0066f30 0x7fbdf00693e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fbe040b2db0 tx=0x7fbdf8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:33.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.458+0000 7fbdebfff700 1 -- 172.21.15.6:0/72288890 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbdf4051ec0 con 0x7fbe0406a910 2023-10-06T02:27:33.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.698+0000 7fbe0a3e7700 1 -- 172.21.15.6:0/72288890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fbe040b1b60 con 0x7fbe0406a910 2023-10-06T02:27:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.961+0000 7fbdebfff700 1 -- 172.21.15.6:0/72288890 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v242) v1 ==== 162+0+0 (secure 0 0 0) 0x7fbdf40170b0 con 0x7fbe0406a910 2023-10-06T02:27:34.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.964+0000 7fbe0a3e7700 1 -- 172.21.15.6:0/72288890 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbdf0066f30 msgr2=0x7fbdf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.964+0000 7fbe0a3e7700 1 --2- 172.21.15.6:0/72288890 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbdf0066f30 0x7fbdf00693e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fbe040b2db0 tx=0x7fbdf8009040 comp rx=0 tx=0).stop 2023-10-06T02:27:34.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.964+0000 7fbe0a3e7700 1 -- 172.21.15.6:0/72288890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe0406a910 msgr2=0x7fbe041699b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.964+0000 7fbe0a3e7700 1 --2- 172.21.15.6:0/72288890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe0406a910 0x7fbe041699b0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400ea00 tx=0x7fbdf4009120 comp rx=0 tx=0).stop 2023-10-06T02:27:34.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.964+0000 7fbe0a3e7700 1 -- 172.21.15.6:0/72288890 shutdown_connections 2023-10-06T02:27:34.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.964+0000 7fbe0a3e7700 1 --2- 172.21.15.6:0/72288890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe0415cae0 0x7fbe04098220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.964+0000 7fbe0a3e7700 1 --2- 172.21.15.6:0/72288890 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbdf0066f30 0x7fbdf00693e0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.964+0000 7fbe0a3e7700 1 --2- 172.21.15.6:0/72288890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe0406a910 0x7fbe041699b0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.964+0000 7fbe0a3e7700 1 --2- 172.21.15.6:0/72288890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe040cc740 0x7fbe0409a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.964+0000 7fbe0a3e7700 1 -- 172.21.15.6:0/72288890 >> 172.21.15.6:0/72288890 conn(0x7fbe04067910 msgr2=0x7fbe04158150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:34.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.964+0000 7fbe0a3e7700 1 -- 172.21.15.6:0/72288890 shutdown_connections 2023-10-06T02:27:34.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:33.964+0000 7fbe0a3e7700 1 -- 172.21.15.6:0/72288890 wait complete. 2023-10-06T02:27:34.340 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:27:34.340 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:27:33.968+0000 7fa533a13700 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2023-10-06T02:27:34.341 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:33.969+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:27:34.341 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:33.969+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:27:34.341 INFO:tasks.ceph.mds.a.smithi006.stderr: -13> 2023-10-06T02:27:33.968+0000 7fa533a13700 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (22) Invalid argument 2023-10-06T02:27:34.342 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:34.342 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:27:34.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.462+0000 7f7fc0a85700 1 Processor -- start 2023-10-06T02:27:34.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.463+0000 7f7fc0a85700 1 -- start start 2023-10-06T02:27:34.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.463+0000 7f7fc0a85700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fbc0af4e0 0x7f7fbc0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.463+0000 7f7fc0a85700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7fbc15db70 0x7f7fbc0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fc0a85700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fbc15e190 con 0x7f7fbc0af8b0 2023-10-06T02:27:34.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fc0a85700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fbc0b1910 con 0x7f7fbc15db70 2023-10-06T02:27:34.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fc0a85700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc15dfb0 con 0x7f7fbc0af4e0 2023-10-06T02:27:34.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb9d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7fbc0af8b0 0x7f7fbc15d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41598/0 (socket says 172.21.15.6:41598) 2023-10-06T02:27:34.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb9d9b700 1 -- 172.21.15.6:0/1443786456 learned_addr learned my addr 172.21.15.6:0/1443786456 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:34.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fbad9d700 1 --2- 172.21.15.6:0/1443786456 >> v2:172.21.15.175:3300/0 conn(0x7f7fbc15db70 0x7f7fbc0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fba59c700 1 --2- 172.21.15.6:0/1443786456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fbc0af4e0 0x7f7fbc0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb959a700 1 -- 172.21.15.6:0/1443786456 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295084673 0 0) 0x7f7fbc15e190 con 0x7f7fbc0af8b0 2023-10-06T02:27:34.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb959a700 1 -- 172.21.15.6:0/1443786456 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fa8003570 con 0x7f7fbc0af8b0 2023-10-06T02:27:34.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb959a700 1 -- 172.21.15.6:0/1443786456 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 713067133 0 0) 0x7f7fa8003570 con 0x7f7fbc0af8b0 2023-10-06T02:27:34.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb959a700 1 -- 172.21.15.6:0/1443786456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fbc0af4e0 msgr2=0x7f7fbc0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:34.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb959a700 1 --2- 172.21.15.6:0/1443786456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fbc0af4e0 0x7f7fbc0b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb959a700 1 -- 172.21.15.6:0/1443786456 >> v2:172.21.15.175:3300/0 conn(0x7f7fbc15db70 msgr2=0x7f7fbc0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:34.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb959a700 1 --2- 172.21.15.6:0/1443786456 >> v2:172.21.15.175:3300/0 conn(0x7f7fbc15db70 0x7f7fbc0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb959a700 1 -- 172.21.15.6:0/1443786456 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc0cb650 con 0x7f7fbc0af8b0 2023-10-06T02:27:34.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb959a700 1 -- 172.21.15.6:0/1443786456 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f7fa4001470 con 0x7f7fbc0af8b0 2023-10-06T02:27:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb959a700 1 -- 172.21.15.6:0/1443786456 >> v1:172.21.15.6:6789/0 conn(0x7f7fbc0af8b0 legacy=0x7f7fbc15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb959a700 1 --2- 172.21.15.6:0/1443786456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fa8003a60 0x7f7fa8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb959a700 1 --2- 172.21.15.6:0/1443786456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fbc0af4e0 0x7f7fa8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb959a700 1 --2- 172.21.15.6:0/1443786456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8004d50 0x7f7fa80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb959a700 1 -- 172.21.15.6:0/1443786456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc0b1910 con 0x7f7fa8004d50 2023-10-06T02:27:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb959a700 1 -- 172.21.15.6:0/1443786456 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc15dfb0 con 0x7f7fa8003a60 2023-10-06T02:27:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.464+0000 7f7fb959a700 1 -- 172.21.15.6:0/1443786456 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa800ba60 con 0x7f7fbc0af4e0 2023-10-06T02:27:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.465+0000 7f7fbad9d700 1 --2- 172.21.15.6:0/1443786456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8004d50 0x7f7fa80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.465+0000 7f7fba59c700 1 --2- 172.21.15.6:0/1443786456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fa8003a60 0x7f7fa8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.465+0000 7f7fb9d9b700 1 --2- 172.21.15.6:0/1443786456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fbc0af4e0 0x7f7fa8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.465+0000 7f7fbad9d700 1 -- 172.21.15.6:0/1443786456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fbc0af4e0 msgr2=0x7f7fa8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.465+0000 7f7fbad9d700 1 --2- 172.21.15.6:0/1443786456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fbc0af4e0 0x7f7fa8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.465+0000 7f7fbad9d700 1 -- 172.21.15.6:0/1443786456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fa8003a60 msgr2=0x7f7fa8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.465+0000 7f7fbad9d700 1 --2- 172.21.15.6:0/1443786456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fa8003a60 0x7f7fa8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.465+0000 7f7fbad9d700 1 -- 172.21.15.6:0/1443786456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa8003570 con 0x7f7fa8004d50 2023-10-06T02:27:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.465+0000 7f7fbad9d700 1 --2- 172.21.15.6:0/1443786456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8004d50 0x7f7fa80051c0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00e210 tx=0x7f7fac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6555f678c7fa9885 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.465+0000 7f7fb959a700 1 -- 172.21.15.6:0/1443786456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac00ea60 con 0x7f7fa8004d50 2023-10-06T02:27:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.465+0000 7f7fb959a700 1 -- 172.21.15.6:0/1443786456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac00f040 con 0x7f7fa8004d50 2023-10-06T02:27:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.465+0000 7f7fb959a700 1 -- 172.21.15.6:0/1443786456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac00ee10 con 0x7f7fa8004d50 2023-10-06T02:27:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.466+0000 7f7fc0a85700 1 -- 172.21.15.6:0/1443786456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8004d50 msgr2=0x7f7fa80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.466+0000 7f7fc0a85700 1 --2- 172.21.15.6:0/1443786456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8004d50 0x7f7fa80051c0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00e210 tx=0x7f7fac00b040 comp rx=0 tx=0).stop 2023-10-06T02:27:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.466+0000 7f7fbad9d700 1 -- 172.21.15.6:0/1443786456 reap_dead start 2023-10-06T02:27:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.466+0000 7f7fc0a85700 1 -- 172.21.15.6:0/1443786456 shutdown_connections 2023-10-06T02:27:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.466+0000 7f7fc0a85700 1 -- 172.21.15.6:0/1443786456 >> 172.21.15.6:0/1443786456 conn(0x7f7fbc068680 msgr2=0x7f7fbc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.466+0000 7f7fc0a85700 1 -- 172.21.15.6:0/1443786456 shutdown_connections 2023-10-06T02:27:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.466+0000 7f7fc0a85700 1 -- 172.21.15.6:0/1443786456 wait complete. 2023-10-06T02:27:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.467+0000 7f7fc0a85700 1 Processor -- start 2023-10-06T02:27:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.467+0000 7f7fc0a85700 1 -- start start 2023-10-06T02:27:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fc0a85700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8004d50 0x7f7fbc0a9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fc0a85700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fbc16e0e0 0x7f7fbc16d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fc0a85700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fbc16da50 0x7f7fbc0c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fc0a85700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc15a300 con 0x7f7fa8004d50 2023-10-06T02:27:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fc0a85700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc16def0 con 0x7f7fbc16e0e0 2023-10-06T02:27:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fc0a85700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc0a7180 con 0x7f7fbc16da50 2023-10-06T02:27:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fba59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8004d50 0x7f7fbc0a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fba59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8004d50 0x7f7fbc0a9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35036/0 (socket says 172.21.15.6:35036) 2023-10-06T02:27:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fba59c700 1 -- 172.21.15.6:0/3673597087 learned_addr learned my addr 172.21.15.6:0/3673597087 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fb9d9b700 1 --2- 172.21.15.6:0/3673597087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fbc16e0e0 0x7f7fbc16d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fbad9d700 1 --2- 172.21.15.6:0/3673597087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fbc16da50 0x7f7fbc0c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fba59c700 1 -- 172.21.15.6:0/3673597087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fbc16da50 msgr2=0x7f7fbc0c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fba59c700 1 --2- 172.21.15.6:0/3673597087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fbc16da50 0x7f7fbc0c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fba59c700 1 -- 172.21.15.6:0/3673597087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fbc16e0e0 msgr2=0x7f7fbc16d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fba59c700 1 --2- 172.21.15.6:0/3673597087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fbc16e0e0 0x7f7fbc16d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fba59c700 1 -- 172.21.15.6:0/3673597087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc0a73b0 con 0x7f7fa8004d50 2023-10-06T02:27:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fba59c700 1 --2- 172.21.15.6:0/3673597087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8004d50 0x7f7fbc0a9750 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4011b10 tx=0x7f7fb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:34.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fb27fc700 1 -- 172.21.15.6:0/3673597087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb400f9f0 con 0x7f7fa8004d50 2023-10-06T02:27:34.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fb27fc700 1 -- 172.21.15.6:0/3673597087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb400fb50 con 0x7f7fa8004d50 2023-10-06T02:27:34.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fc0a85700 1 -- 172.21.15.6:0/3673597087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fbc0a7690 con 0x7f7fa8004d50 2023-10-06T02:27:34.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fb27fc700 1 -- 172.21.15.6:0/3673597087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb400fed0 con 0x7f7fa8004d50 2023-10-06T02:27:34.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.468+0000 7f7fc0a85700 1 -- 172.21.15.6:0/3673597087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fbc0a7c50 con 0x7f7fa8004d50 2023-10-06T02:27:34.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.469+0000 7f7fc0a85700 1 -- 172.21.15.6:0/3673597087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fbc088aa0 con 0x7f7fa8004d50 2023-10-06T02:27:34.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.470+0000 7f7fb27fc700 1 -- 172.21.15.6:0/3673597087 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7fb4014650 con 0x7f7fa8004d50 2023-10-06T02:27:34.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.470+0000 7f7fb27fc700 1 --2- 172.21.15.6:0/3673597087 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f9c066f30 0x7f7f9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.470+0000 7f7fb27fc700 1 -- 172.21.15.6:0/3673597087 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f7fb4018030 con 0x7f7fa8004d50 2023-10-06T02:27:34.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.471+0000 7f7fb9d9b700 1 --2- 172.21.15.6:0/3673597087 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f9c066f30 0x7f7f9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.471+0000 7f7fb9d9b700 1 --2- 172.21.15.6:0/3673597087 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f9c066f30 0x7f7f9c0693e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4000fd0 tx=0x7f7fa4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:34.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.474+0000 7f7fb27fc700 1 -- 172.21.15.6:0/3673597087 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7fb4052230 con 0x7f7fa8004d50 2023-10-06T02:27:34.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.712+0000 7f7fc0a85700 1 -- 172.21.15.6:0/3673597087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fbc0b2860 con 0x7f7fa8004d50 2023-10-06T02:27:34.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.713+0000 7f7fb27fc700 1 -- 172.21.15.6:0/3673597087 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 244 v244) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f7fb4022020 con 0x7f7fa8004d50 2023-10-06T02:27:34.714 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:34.714 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":244,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":244,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:33.969838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.714+0000 7f7fc0a85700 1 -- 172.21.15.6:0/3673597087 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f9c066f30 msgr2=0x7f7f9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.714+0000 7f7fc0a85700 1 --2- 172.21.15.6:0/3673597087 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f9c066f30 0x7f7f9c0693e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4000fd0 tx=0x7f7fa4009040 comp rx=0 tx=0).stop 2023-10-06T02:27:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.714+0000 7f7fc0a85700 1 -- 172.21.15.6:0/3673597087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8004d50 msgr2=0x7f7fbc0a9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.714+0000 7f7fc0a85700 1 --2- 172.21.15.6:0/3673597087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8004d50 0x7f7fbc0a9750 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4011b10 tx=0x7f7fb40091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.715+0000 7f7fc0a85700 1 -- 172.21.15.6:0/3673597087 shutdown_connections 2023-10-06T02:27:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.715+0000 7f7fc0a85700 1 --2- 172.21.15.6:0/3673597087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fbc16da50 0x7f7fbc0c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.715+0000 7f7fc0a85700 1 --2- 172.21.15.6:0/3673597087 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f9c066f30 0x7f7f9c0693e0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.715+0000 7f7fc0a85700 1 --2- 172.21.15.6:0/3673597087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8004d50 0x7f7fbc0a9750 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.715+0000 7f7fc0a85700 1 --2- 172.21.15.6:0/3673597087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fbc16e0e0 0x7f7fbc16d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.715+0000 7f7fc0a85700 1 -- 172.21.15.6:0/3673597087 >> 172.21.15.6:0/3673597087 conn(0x7f7fbc068680 msgr2=0x7f7fbc0cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.715+0000 7f7fc0a85700 1 -- 172.21.15.6:0/3673597087 shutdown_connections 2023-10-06T02:27:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.715+0000 7f7fc0a85700 1 -- 172.21.15.6:0/3673597087 wait complete. 2023-10-06T02:27:34.717 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 244 2023-10-06T02:27:34.727 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:27:34.728 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:34.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.846+0000 7f2efd504700 1 Processor -- start 2023-10-06T02:27:34.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.846+0000 7f2efd504700 1 -- start start 2023-10-06T02:27:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.847+0000 7f2efd504700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2ef815a590 0x7f2ef815a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.847+0000 7f2efd504700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef80afb90 con 0x7f2ef815b3c0 2023-10-06T02:27:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.847+0000 7f2efd504700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef815aed0 con 0x7f2ef80b3c50 2023-10-06T02:27:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.847+0000 7f2efd504700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef80b2310 con 0x7f2ef815a590 2023-10-06T02:27:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.847+0000 7f2ef77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2ef815a590 0x7f2ef815a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.847+0000 7f2ef77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2ef815a590 0x7f2ef815a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35052/0 (socket says 172.21.15.6:35052) 2023-10-06T02:27:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.847+0000 7f2ef77fe700 1 -- 172.21.15.6:0/1939715647 learned_addr learned my addr 172.21.15.6:0/1939715647 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.847+0000 7f2ef6ffd700 1 --1- 172.21.15.6:0/1939715647 >> v1:172.21.15.6:6789/0 conn(0x7f2ef815b3c0 0x7f2ef8097d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41608/0 (socket says 172.21.15.6:41608) 2023-10-06T02:27:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.847+0000 7f2ef77fe700 1 -- 172.21.15.6:0/1939715647 >> v1:172.21.15.175:6789/0 conn(0x7f2ef80b3c50 legacy=0x7f2ef815b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.847+0000 7f2ef77fe700 1 -- 172.21.15.6:0/1939715647 >> v1:172.21.15.6:6789/0 conn(0x7f2ef815b3c0 legacy=0x7f2ef8097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.847+0000 7f2ef77fe700 1 -- 172.21.15.6:0/1939715647 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef80b25f0 con 0x7f2ef815a590 2023-10-06T02:27:34.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.848+0000 7f2ef77fe700 1 --2- 172.21.15.6:0/1939715647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef815a590 0x7f2ef815a990 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009f20 tx=0x7f2ee8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0e222dd794d052 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:34.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.848+0000 7f2ef5ffb700 1 -- 172.21.15.6:0/1939715647 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee800e070 con 0x7f2ef815a590 2023-10-06T02:27:34.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.848+0000 7f2ef5ffb700 1 -- 172.21.15.6:0/1939715647 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee800ba40 con 0x7f2ef815a590 2023-10-06T02:27:34.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.848+0000 7f2ef5ffb700 1 -- 172.21.15.6:0/1939715647 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80092e0 con 0x7f2ef815a590 2023-10-06T02:27:34.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.848+0000 7f2efd504700 1 -- 172.21.15.6:0/1939715647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef815a590 msgr2=0x7f2ef815a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.848+0000 7f2efd504700 1 --2- 172.21.15.6:0/1939715647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef815a590 0x7f2ef815a990 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009f20 tx=0x7f2ee8009840 comp rx=0 tx=0).stop 2023-10-06T02:27:34.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.848+0000 7f2efd504700 1 -- 172.21.15.6:0/1939715647 shutdown_connections 2023-10-06T02:27:34.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.848+0000 7f2efd504700 1 --2- 172.21.15.6:0/1939715647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef815a590 0x7f2ef815a990 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.848+0000 7f2efd504700 1 -- 172.21.15.6:0/1939715647 >> 172.21.15.6:0/1939715647 conn(0x7f2ef8067910 msgr2=0x7f2ef80ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:34.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.848+0000 7f2efd504700 1 -- 172.21.15.6:0/1939715647 shutdown_connections 2023-10-06T02:27:34.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.848+0000 7f2efd504700 1 -- 172.21.15.6:0/1939715647 wait complete. 2023-10-06T02:27:34.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.850+0000 7f2efd504700 1 Processor -- start 2023-10-06T02:27:34.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.850+0000 7f2efd504700 1 -- start start 2023-10-06T02:27:34.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.850+0000 7f2efd504700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef80b3c50 0x7f2ef809ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.850+0000 7f2efd504700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ef815a590 0x7f2ef81689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.850+0000 7f2efd504700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ef815b3c0 0x7f2ef80ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.850+0000 7f2efd504700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef809b2c0 con 0x7f2ef80b3c50 2023-10-06T02:27:34.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.850+0000 7f2efd504700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef80aa150 con 0x7f2ef815a590 2023-10-06T02:27:34.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.850+0000 7f2efd504700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef8168f30 con 0x7f2ef815b3c0 2023-10-06T02:27:34.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.850+0000 7f2ef6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef80b3c50 0x7f2ef809ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.850+0000 7f2ef6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef80b3c50 0x7f2ef809ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35058/0 (socket says 172.21.15.6:35058) 2023-10-06T02:27:34.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.850+0000 7f2ef6ffd700 1 -- 172.21.15.6:0/2376241764 learned_addr learned my addr 172.21.15.6:0/2376241764 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:34.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.851+0000 7f2ef67fc700 1 --2- 172.21.15.6:0/2376241764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ef815a590 0x7f2ef81689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.851+0000 7f2ef77fe700 1 --2- 172.21.15.6:0/2376241764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ef815b3c0 0x7f2ef80ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.851+0000 7f2ef6ffd700 1 -- 172.21.15.6:0/2376241764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ef815b3c0 msgr2=0x7f2ef80ab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.851+0000 7f2ef6ffd700 1 --2- 172.21.15.6:0/2376241764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ef815b3c0 0x7f2ef80ab0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.851+0000 7f2ef6ffd700 1 -- 172.21.15.6:0/2376241764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ef815a590 msgr2=0x7f2ef81689f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.851+0000 7f2ef6ffd700 1 --2- 172.21.15.6:0/2376241764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ef815a590 0x7f2ef81689f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.851+0000 7f2ef6ffd700 1 -- 172.21.15.6:0/2376241764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee8009ae0 con 0x7f2ef80b3c50 2023-10-06T02:27:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.851+0000 7f2ef6ffd700 1 --2- 172.21.15.6:0/2376241764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef80b3c50 0x7f2ef809ad80 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000c560 tx=0x7f2ef0007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.851+0000 7f2eeeffd700 1 -- 172.21.15.6:0/2376241764 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef00072e0 con 0x7f2ef80b3c50 2023-10-06T02:27:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.851+0000 7f2eeeffd700 1 -- 172.21.15.6:0/2376241764 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef0007440 con 0x7f2ef80b3c50 2023-10-06T02:27:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.851+0000 7f2efd504700 1 -- 172.21.15.6:0/2376241764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef80a9540 con 0x7f2ef80b3c50 2023-10-06T02:27:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.851+0000 7f2eeeffd700 1 -- 172.21.15.6:0/2376241764 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef00057f0 con 0x7f2ef80b3c50 2023-10-06T02:27:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.851+0000 7f2efd504700 1 -- 172.21.15.6:0/2376241764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef80a9b00 con 0x7f2ef80b3c50 2023-10-06T02:27:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.852+0000 7f2efd504700 1 -- 172.21.15.6:0/2376241764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef806e8d0 con 0x7f2ef80b3c50 2023-10-06T02:27:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.853+0000 7f2eeeffd700 1 -- 172.21.15.6:0/2376241764 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ef0005ba0 con 0x7f2ef80b3c50 2023-10-06T02:27:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.853+0000 7f2eeeffd700 1 --2- 172.21.15.6:0/2376241764 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2ed8066f30 0x7f2ed80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.853+0000 7f2eeeffd700 1 -- 172.21.15.6:0/2376241764 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2ef0084580 con 0x7f2ef80b3c50 2023-10-06T02:27:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.853+0000 7f2ef67fc700 1 --2- 172.21.15.6:0/2376241764 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2ed8066f30 0x7f2ed80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.854+0000 7f2ef67fc700 1 --2- 172.21.15.6:0/2376241764 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2ed8066f30 0x7f2ed80693e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0006fd0 tx=0x7f2ee0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:34.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:34.858+0000 7f2eeeffd700 1 -- 172.21.15.6:0/2376241764 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ef0050cb0 con 0x7f2ef80b3c50 2023-10-06T02:27:35.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.099+0000 7f2efd504700 1 -- 172.21.15.6:0/2376241764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ef809bd50 con 0x7f2ef80b3c50 2023-10-06T02:27:35.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.100+0000 7f2eeeffd700 1 -- 172.21.15.6:0/2376241764 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 245 v245) v1 ==== 95+0+4595 (secure 0 0 0) 0x7f2ef0017070 con 0x7f2ef80b3c50 2023-10-06T02:27:35.100 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:35.101 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":245,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9543,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2420647508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2420647508},{"type":"v1","addr":"172.21.15.6:6835","nonce":2420647508}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":245}],"filesystems":[{"mdsmap":{"epoch":244,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:33.969838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.102+0000 7f2efd504700 1 -- 172.21.15.6:0/2376241764 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2ed8066f30 msgr2=0x7f2ed80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.102+0000 7f2efd504700 1 --2- 172.21.15.6:0/2376241764 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2ed8066f30 0x7f2ed80693e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0006fd0 tx=0x7f2ee0008040 comp rx=0 tx=0).stop 2023-10-06T02:27:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.102+0000 7f2efd504700 1 -- 172.21.15.6:0/2376241764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef80b3c50 msgr2=0x7f2ef809ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.102+0000 7f2efd504700 1 --2- 172.21.15.6:0/2376241764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef80b3c50 0x7f2ef809ad80 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000c560 tx=0x7f2ef0007f00 comp rx=0 tx=0).stop 2023-10-06T02:27:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.102+0000 7f2efd504700 1 -- 172.21.15.6:0/2376241764 shutdown_connections 2023-10-06T02:27:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.102+0000 7f2efd504700 1 --2- 172.21.15.6:0/2376241764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ef815b3c0 0x7f2ef80ab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.102+0000 7f2efd504700 1 --2- 172.21.15.6:0/2376241764 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2ed8066f30 0x7f2ed80693e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.102+0000 7f2efd504700 1 --2- 172.21.15.6:0/2376241764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef80b3c50 0x7f2ef809ad80 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.102+0000 7f2efd504700 1 --2- 172.21.15.6:0/2376241764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ef815a590 0x7f2ef81689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.102+0000 7f2efd504700 1 -- 172.21.15.6:0/2376241764 >> 172.21.15.6:0/2376241764 conn(0x7f2ef8067910 msgr2=0x7f2ef81584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.102+0000 7f2efd504700 1 -- 172.21.15.6:0/2376241764 shutdown_connections 2023-10-06T02:27:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.102+0000 7f2efd504700 1 -- 172.21.15.6:0/2376241764 wait complete. 2023-10-06T02:27:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 245 2023-10-06T02:27:35.115 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:27:35.115 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.233+0000 7f481fbd4700 1 Processor -- start 2023-10-06T02:27:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.234+0000 7f481fbd4700 1 -- start start 2023-10-06T02:27:35.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.234+0000 7f481fbd4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48180b3c50 0x7f481815b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.234+0000 7f481fbd4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f481815bcd0 0x7f481815a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.234+0000 7f481fbd4700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48180afb90 con 0x7f481815b3c0 2023-10-06T02:27:35.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.234+0000 7f481fbd4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48180b2310 con 0x7f481815bcd0 2023-10-06T02:27:35.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.234+0000 7f481fbd4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48180b25f0 con 0x7f48180b3c50 2023-10-06T02:27:35.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.235+0000 7f481d16f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48180b3c50 0x7f481815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.235+0000 7f481e171700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f481815bcd0 0x7f481815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.235+0000 7f481d16f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48180b3c50 0x7f481815b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:51962/0 (socket says 172.21.15.6:51962) 2023-10-06T02:27:35.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.235+0000 7f481d970700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f481815b3c0 0x7f4818097d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:37202/0 (socket says 172.21.15.6:37202) 2023-10-06T02:27:35.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.235+0000 7f481e171700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f481815bcd0 0x7f481815a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:45192/0 (socket says 172.21.15.6:45192) 2023-10-06T02:27:35.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.235+0000 7f481d16f700 1 -- 172.21.15.6:0/146667801 learned_addr learned my addr 172.21.15.6:0/146667801 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:35.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.235+0000 7f481d16f700 1 -- 172.21.15.6:0/146667801 >> v2:172.21.15.175:3300/0 conn(0x7f481815bcd0 msgr2=0x7f481815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:35.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.235+0000 7f481d16f700 1 --2- 172.21.15.6:0/146667801 >> v2:172.21.15.175:3300/0 conn(0x7f481815bcd0 0x7f481815a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.235+0000 7f481d16f700 1 -- 172.21.15.6:0/146667801 >> v1:172.21.15.175:6789/0 conn(0x7f481815b3c0 legacy=0x7f4818097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.235+0000 7f481d16f700 1 -- 172.21.15.6:0/146667801 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48180af820 con 0x7f48180b3c50 2023-10-06T02:27:35.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.235+0000 7f481d16f700 1 --2- 172.21.15.6:0/146667801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48180b3c50 0x7f481815b790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f480c0099b0 tx=0x7f480c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50e14a182a0b0c7f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:35.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.235+0000 7f481c96e700 1 -- 172.21.15.6:0/146667801 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c009ea0 con 0x7f48180b3c50 2023-10-06T02:27:35.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.236+0000 7f481c96e700 1 -- 172.21.15.6:0/146667801 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c00b860 con 0x7f48180b3c50 2023-10-06T02:27:35.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.236+0000 7f481c96e700 1 -- 172.21.15.6:0/146667801 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c00bc00 con 0x7f48180b3c50 2023-10-06T02:27:35.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.236+0000 7f481fbd4700 1 -- 172.21.15.6:0/146667801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48180b3c50 msgr2=0x7f481815b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.236+0000 7f481fbd4700 1 --2- 172.21.15.6:0/146667801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48180b3c50 0x7f481815b790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f480c0099b0 tx=0x7f480c009250 comp rx=0 tx=0).stop 2023-10-06T02:27:35.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.236+0000 7f481fbd4700 1 -- 172.21.15.6:0/146667801 shutdown_connections 2023-10-06T02:27:35.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.236+0000 7f481fbd4700 1 --2- 172.21.15.6:0/146667801 >> v2:172.21.15.175:3300/0 conn(0x7f481815bcd0 0x7f481815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.236+0000 7f481fbd4700 1 --2- 172.21.15.6:0/146667801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48180b3c50 0x7f481815b790 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.236+0000 7f481fbd4700 1 -- 172.21.15.6:0/146667801 >> 172.21.15.6:0/146667801 conn(0x7f4818067910 msgr2=0x7f48180ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:35.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.236+0000 7f481fbd4700 1 -- 172.21.15.6:0/146667801 shutdown_connections 2023-10-06T02:27:35.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.236+0000 7f481fbd4700 1 -- 172.21.15.6:0/146667801 wait complete. 2023-10-06T02:27:35.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.237+0000 7f481fbd4700 1 Processor -- start 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.237+0000 7f481fbd4700 1 -- start start 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.238+0000 7f481fbd4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48180b3c50 0x7f4818169900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.238+0000 7f481fbd4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f481815b3c0 0x7f481806ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.238+0000 7f481fbd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f481815bcd0 0x7f48180c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.238+0000 7f481fbd4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48180c4490 con 0x7f481815bcd0 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.238+0000 7f481fbd4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48180c3880 con 0x7f481815b3c0 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.238+0000 7f481fbd4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48180c3b60 con 0x7f48180b3c50 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.238+0000 7f481e171700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f481815bcd0 0x7f48180c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.238+0000 7f481e171700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f481815bcd0 0x7f48180c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35068/0 (socket says 172.21.15.6:35068) 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.238+0000 7f481e171700 1 -- 172.21.15.6:0/3165796331 learned_addr learned my addr 172.21.15.6:0/3165796331 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.238+0000 7f481d16f700 1 --2- 172.21.15.6:0/3165796331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f481815b3c0 0x7f481806ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.238+0000 7f481d970700 1 --2- 172.21.15.6:0/3165796331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48180b3c50 0x7f4818169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.238+0000 7f481e171700 1 -- 172.21.15.6:0/3165796331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48180b3c50 msgr2=0x7f4818169900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.238+0000 7f481e171700 1 --2- 172.21.15.6:0/3165796331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48180b3c50 0x7f4818169900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.238+0000 7f481e171700 1 -- 172.21.15.6:0/3165796331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f481815b3c0 msgr2=0x7f481806ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.238+0000 7f481e171700 1 --2- 172.21.15.6:0/3165796331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f481815b3c0 0x7f481806ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.239+0000 7f481e171700 1 -- 172.21.15.6:0/3165796331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c0094f0 con 0x7f481815bcd0 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.239+0000 7f481d970700 1 --2- 172.21.15.6:0/3165796331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48180b3c50 0x7f4818169900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.239+0000 7f481d16f700 1 --2- 172.21.15.6:0/3165796331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f481815b3c0 0x7f481806ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.239+0000 7f481e171700 1 --2- 172.21.15.6:0/3165796331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f481815bcd0 0x7f48180c5e50 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f4808009df0 tx=0x7f480800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.239+0000 7f4815ffb700 1 -- 172.21.15.6:0/3165796331 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480800cb50 con 0x7f481815bcd0 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.239+0000 7f4815ffb700 1 -- 172.21.15.6:0/3165796331 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480800f040 con 0x7f481815bcd0 2023-10-06T02:27:35.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.239+0000 7f481fbd4700 1 -- 172.21.15.6:0/3165796331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48180c3e40 con 0x7f481815bcd0 2023-10-06T02:27:35.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.239+0000 7f4815ffb700 1 -- 172.21.15.6:0/3165796331 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4808014480 con 0x7f481815bcd0 2023-10-06T02:27:35.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.239+0000 7f481fbd4700 1 -- 172.21.15.6:0/3165796331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48180c3530 con 0x7f481815bcd0 2023-10-06T02:27:35.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.240+0000 7f481fbd4700 1 -- 172.21.15.6:0/3165796331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481806e8d0 con 0x7f481815bcd0 2023-10-06T02:27:35.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.240+0000 7f4815ffb700 1 -- 172.21.15.6:0/3165796331 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4808014830 con 0x7f481815bcd0 2023-10-06T02:27:35.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.241+0000 7f4815ffb700 1 --2- 172.21.15.6:0/3165796331 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4804066f30 0x7f48040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.241+0000 7f4815ffb700 1 -- 172.21.15.6:0/3165796331 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f4808085a70 con 0x7f481815bcd0 2023-10-06T02:27:35.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.241+0000 7f481d970700 1 --2- 172.21.15.6:0/3165796331 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4804066f30 0x7f48040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.242+0000 7f481d970700 1 --2- 172.21.15.6:0/3165796331 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4804066f30 0x7f48040693e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4810007fd0 tx=0x7f4810007dd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:35.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.245+0000 7f4815ffb700 1 -- 172.21.15.6:0/3165796331 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48080521a0 con 0x7f481815bcd0 2023-10-06T02:27:35.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.482+0000 7f481fbd4700 1 -- 172.21.15.6:0/3165796331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f481804bb80 con 0x7f481815bcd0 2023-10-06T02:27:35.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.483+0000 7f4815ffb700 1 -- 172.21.15.6:0/3165796331 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 245 v245) v1 ==== 95+0+4595 (secure 0 0 0) 0x7f4808018090 con 0x7f481815bcd0 2023-10-06T02:27:35.483 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:35.483 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":245,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9543,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2420647508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2420647508},{"type":"v1","addr":"172.21.15.6:6835","nonce":2420647508}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":245}],"filesystems":[{"mdsmap":{"epoch":244,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:33.969838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.485+0000 7f481fbd4700 1 -- 172.21.15.6:0/3165796331 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4804066f30 msgr2=0x7f48040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.485+0000 7f481fbd4700 1 --2- 172.21.15.6:0/3165796331 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4804066f30 0x7f48040693e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4810007fd0 tx=0x7f4810007dd0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.485+0000 7f481fbd4700 1 -- 172.21.15.6:0/3165796331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f481815bcd0 msgr2=0x7f48180c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.485+0000 7f481fbd4700 1 --2- 172.21.15.6:0/3165796331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f481815bcd0 0x7f48180c5e50 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f4808009df0 tx=0x7f480800b040 comp rx=0 tx=0).stop 2023-10-06T02:27:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.485+0000 7f481fbd4700 1 -- 172.21.15.6:0/3165796331 shutdown_connections 2023-10-06T02:27:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.485+0000 7f481fbd4700 1 --2- 172.21.15.6:0/3165796331 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4804066f30 0x7f48040693e0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.485+0000 7f481fbd4700 1 --2- 172.21.15.6:0/3165796331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f481815bcd0 0x7f48180c5e50 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.485+0000 7f481fbd4700 1 --2- 172.21.15.6:0/3165796331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48180b3c50 0x7f4818169900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.485+0000 7f481fbd4700 1 --2- 172.21.15.6:0/3165796331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f481815b3c0 0x7f481806ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.485+0000 7f481fbd4700 1 -- 172.21.15.6:0/3165796331 >> 172.21.15.6:0/3165796331 conn(0x7f4818067910 msgr2=0x7f4818157760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.485+0000 7f481fbd4700 1 -- 172.21.15.6:0/3165796331 shutdown_connections 2023-10-06T02:27:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.485+0000 7f481fbd4700 1 -- 172.21.15.6:0/3165796331 wait complete. 2023-10-06T02:27:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 245 2023-10-06T02:27:35.497 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 200.00000000' led to DAMAGED state 2023-10-06T02:27:35.498 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 200.00000001' 2023-10-06T02:27:35.498 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:35.498 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:27:35.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:35.498 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:27:35.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:27:35.513 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:27:35.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:27:35.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.672+0000 7f20456a5700 1 Processor -- start 2023-10-06T02:27:35.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.672+0000 7f20456a5700 1 -- start start 2023-10-06T02:27:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.673+0000 7f20456a5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2040159400 0x7f20400ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.673+0000 7f20456a5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20400cd030 0x7f20400cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.673+0000 7f20456a5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20400b3560 con 0x7f20400cf1a0 2023-10-06T02:27:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.673+0000 7f20456a5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20400cf6f0 con 0x7f2040159400 2023-10-06T02:27:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.673+0000 7f20456a5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20400cf9d0 con 0x7f20400cd030 2023-10-06T02:27:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.673+0000 7f203f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20400cd030 0x7f20400cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.673+0000 7f203ffff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2040159400 0x7f20400ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.673+0000 7f203ffff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2040159400 0x7f20400ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:45208/0 (socket says 172.21.15.6:45208) 2023-10-06T02:27:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.673+0000 7f203ffff700 1 -- 172.21.15.6:0/2573085475 learned_addr learned my addr 172.21.15.6:0/2573085475 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.673+0000 7f203f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20400cd030 0x7f20400cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:51972/0 (socket says 172.21.15.6:51972) 2023-10-06T02:27:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.673+0000 7f2044ea4700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f20400cf1a0 0x7f20400b5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:37210/0 (socket says 172.21.15.6:37210) 2023-10-06T02:27:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.674+0000 7f203f7fe700 1 -- 172.21.15.6:0/2573085475 >> v2:172.21.15.175:3300/0 conn(0x7f2040159400 msgr2=0x7f20400ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:35.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.674+0000 7f203f7fe700 1 --2- 172.21.15.6:0/2573085475 >> v2:172.21.15.175:3300/0 conn(0x7f2040159400 0x7f20400ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.674+0000 7f203f7fe700 1 -- 172.21.15.6:0/2573085475 >> v1:172.21.15.175:6789/0 conn(0x7f20400cf1a0 legacy=0x7f20400b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.674+0000 7f203f7fe700 1 -- 172.21.15.6:0/2573085475 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20400b2f10 con 0x7f20400cd030 2023-10-06T02:27:35.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.674+0000 7f203ffff700 1 --2- 172.21.15.6:0/2573085475 >> v2:172.21.15.175:3300/0 conn(0x7f2040159400 0x7f20400ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:35.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.674+0000 7f203effd700 1 -- 172.21.15.6:0/2573085475 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373714790 0 0) 0x7f20400b3560 con 0x7f20400cf1a0 2023-10-06T02:27:35.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.674+0000 7f203f7fe700 1 --2- 172.21.15.6:0/2573085475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20400cd030 0x7f20400cfec0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f20340098e0 tx=0x7f20340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d41944443d5b207 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:35.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.674+0000 7f203effd700 1 -- 172.21.15.6:0/2573085475 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203400b640 con 0x7f20400cd030 2023-10-06T02:27:35.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.674+0000 7f203effd700 1 -- 172.21.15.6:0/2573085475 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203400b7a0 con 0x7f20400cd030 2023-10-06T02:27:35.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.674+0000 7f203effd700 1 -- 172.21.15.6:0/2573085475 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203400bb40 con 0x7f20400cd030 2023-10-06T02:27:35.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.675+0000 7f20456a5700 1 -- 172.21.15.6:0/2573085475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20400cd030 msgr2=0x7f20400cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.675+0000 7f20456a5700 1 --2- 172.21.15.6:0/2573085475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20400cd030 0x7f20400cfec0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f20340098e0 tx=0x7f20340091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.675+0000 7f20456a5700 1 -- 172.21.15.6:0/2573085475 shutdown_connections 2023-10-06T02:27:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.675+0000 7f20456a5700 1 --2- 172.21.15.6:0/2573085475 >> v2:172.21.15.175:3300/0 conn(0x7f2040159400 0x7f20400ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.675+0000 7f20456a5700 1 --2- 172.21.15.6:0/2573085475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20400cd030 0x7f20400cfec0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.675+0000 7f20456a5700 1 -- 172.21.15.6:0/2573085475 >> 172.21.15.6:0/2573085475 conn(0x7f204006ac10 msgr2=0x7f2040068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.675+0000 7f20456a5700 1 -- 172.21.15.6:0/2573085475 shutdown_connections 2023-10-06T02:27:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.675+0000 7f20456a5700 1 -- 172.21.15.6:0/2573085475 wait complete. 2023-10-06T02:27:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.676+0000 7f20456a5700 1 Processor -- start 2023-10-06T02:27:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.676+0000 7f20456a5700 1 -- start start 2023-10-06T02:27:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f20456a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20400cd030 0x7f204015bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f20456a5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20400cf1a0 0x7f204015c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f20456a5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2040159400 0x7f20400b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f20456a5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204015c970 con 0x7f20400cd030 2023-10-06T02:27:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f20456a5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204015cbe0 con 0x7f20400cf1a0 2023-10-06T02:27:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f20456a5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204015cec0 con 0x7f2040159400 2023-10-06T02:27:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f203ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20400cd030 0x7f204015bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f203ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20400cd030 0x7f204015bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35084/0 (socket says 172.21.15.6:35084) 2023-10-06T02:27:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f203ffff700 1 -- 172.21.15.6:0/3997593360 learned_addr learned my addr 172.21.15.6:0/3997593360 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f203f7fe700 1 --2- 172.21.15.6:0/3997593360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20400cf1a0 0x7f204015c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f2044ea4700 1 --2- 172.21.15.6:0/3997593360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2040159400 0x7f20400b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f203ffff700 1 -- 172.21.15.6:0/3997593360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2040159400 msgr2=0x7f20400b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f203ffff700 1 --2- 172.21.15.6:0/3997593360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2040159400 0x7f20400b01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f203ffff700 1 -- 172.21.15.6:0/3997593360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20400cf1a0 msgr2=0x7f204015c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f203ffff700 1 --2- 172.21.15.6:0/3997593360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20400cf1a0 0x7f204015c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f203ffff700 1 -- 172.21.15.6:0/3997593360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2030009480 con 0x7f20400cd030 2023-10-06T02:27:35.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f203ffff700 1 --2- 172.21.15.6:0/3997593360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20400cd030 0x7f204015bef0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f203000ec80 tx=0x7f2030009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:35.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f2027fff700 1 -- 172.21.15.6:0/3997593360 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030005a00 con 0x7f20400cd030 2023-10-06T02:27:35.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f2027fff700 1 -- 172.21.15.6:0/3997593360 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2030005b60 con 0x7f20400cd030 2023-10-06T02:27:35.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f2027fff700 1 -- 172.21.15.6:0/3997593360 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203000c850 con 0x7f20400cd030 2023-10-06T02:27:35.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f20456a5700 1 -- 172.21.15.6:0/3997593360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2034009420 con 0x7f20400cd030 2023-10-06T02:27:35.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.677+0000 7f20456a5700 1 -- 172.21.15.6:0/3997593360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204015d480 con 0x7f20400cd030 2023-10-06T02:27:35.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.678+0000 7f20456a5700 1 -- 172.21.15.6:0/3997593360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204015dad0 con 0x7f20400cd030 2023-10-06T02:27:35.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.679+0000 7f2027fff700 1 -- 172.21.15.6:0/3997593360 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f203000cc00 con 0x7f20400cd030 2023-10-06T02:27:35.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.679+0000 7f2027fff700 1 --2- 172.21.15.6:0/3997593360 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f202c066f30 0x7f202c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.679+0000 7f2027fff700 1 -- 172.21.15.6:0/3997593360 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f20300854f0 con 0x7f20400cd030 2023-10-06T02:27:35.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.679+0000 7f203f7fe700 1 --2- 172.21.15.6:0/3997593360 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f202c066f30 0x7f202c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.680+0000 7f203f7fe700 1 --2- 172.21.15.6:0/3997593360 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f202c066f30 0x7f202c0693e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f20340091e0 tx=0x7f2034017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:35.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.684+0000 7f2027fff700 1 -- 172.21.15.6:0/3997593360 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2030051be0 con 0x7f20400cd030 2023-10-06T02:27:35.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.925+0000 7f20456a5700 1 -- 172.21.15.6:0/3997593360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f20400b31f0 con 0x7f20400cd030 2023-10-06T02:27:35.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.982+0000 7f2027fff700 1 -- 172.21.15.6:0/3997593360 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v246) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2030055200 con 0x7f20400cd030 2023-10-06T02:27:35.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.984+0000 7f20456a5700 1 -- 172.21.15.6:0/3997593360 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f202c066f30 msgr2=0x7f202c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.984+0000 7f20456a5700 1 --2- 172.21.15.6:0/3997593360 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f202c066f30 0x7f202c0693e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f20340091e0 tx=0x7f2034017000 comp rx=0 tx=0).stop 2023-10-06T02:27:35.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.984+0000 7f20456a5700 1 -- 172.21.15.6:0/3997593360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20400cd030 msgr2=0x7f204015bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.984+0000 7f20456a5700 1 --2- 172.21.15.6:0/3997593360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20400cd030 0x7f204015bef0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f203000ec80 tx=0x7f2030009220 comp rx=0 tx=0).stop 2023-10-06T02:27:35.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.984+0000 7f20456a5700 1 -- 172.21.15.6:0/3997593360 shutdown_connections 2023-10-06T02:27:35.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.984+0000 7f20456a5700 1 --2- 172.21.15.6:0/3997593360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2040159400 0x7f20400b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.984+0000 7f20456a5700 1 --2- 172.21.15.6:0/3997593360 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f202c066f30 0x7f202c0693e0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.984+0000 7f20456a5700 1 --2- 172.21.15.6:0/3997593360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20400cd030 0x7f204015bef0 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.984+0000 7f20456a5700 1 --2- 172.21.15.6:0/3997593360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20400cf1a0 0x7f204015c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.984+0000 7f20456a5700 1 -- 172.21.15.6:0/3997593360 >> 172.21.15.6:0/3997593360 conn(0x7f204006ac10 msgr2=0x7f2040155f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:35.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.984+0000 7f20456a5700 1 -- 172.21.15.6:0/3997593360 shutdown_connections 2023-10-06T02:27:35.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:35.984+0000 7f20456a5700 1 -- 172.21.15.6:0/3997593360 wait complete. 2023-10-06T02:27:35.987 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:27:35.997 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:27:36.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.117+0000 7ffa74892700 1 Processor -- start 2023-10-06T02:27:36.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.117+0000 7ffa74892700 1 -- start start 2023-10-06T02:27:36.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa74892700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa7015a030 0x7ffa7015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:36.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa74892700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa7015a940 0x7ffa70086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:36.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa74892700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffa70087530 0x7ffa700b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:36.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa74892700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa700b0cf0 con 0x7ffa7015a030 2023-10-06T02:27:36.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa74892700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa700879b0 con 0x7ffa70087530 2023-10-06T02:27:36.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa74892700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa700afc50 con 0x7ffa7015a940 2023-10-06T02:27:36.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa6e59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa7015a030 0x7ffa7015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:36.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa6e59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa7015a030 0x7ffa7015a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35090/0 (socket says 172.21.15.6:35090) 2023-10-06T02:27:36.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa6e59c700 1 -- 172.21.15.6:0/4243024583 learned_addr learned my addr 172.21.15.6:0/4243024583 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:36.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa6ed9d700 1 --2- 172.21.15.6:0/4243024583 >> v2:172.21.15.175:3300/0 conn(0x7ffa70087530 0x7ffa700b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:36.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa6dd9b700 1 --2- 172.21.15.6:0/4243024583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa7015a940 0x7ffa70086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:36.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa6e59c700 1 -- 172.21.15.6:0/4243024583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa7015a940 msgr2=0x7ffa70086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:36.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa6e59c700 1 --2- 172.21.15.6:0/4243024583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa7015a940 0x7ffa70086ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa6e59c700 1 -- 172.21.15.6:0/4243024583 >> v2:172.21.15.175:3300/0 conn(0x7ffa70087530 msgr2=0x7ffa700b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:36.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa6e59c700 1 --2- 172.21.15.6:0/4243024583 >> v2:172.21.15.175:3300/0 conn(0x7ffa70087530 0x7ffa700b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa6e59c700 1 -- 172.21.15.6:0/4243024583 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa700aff30 con 0x7ffa7015a030 2023-10-06T02:27:36.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa6e59c700 1 --2- 172.21.15.6:0/4243024583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa7015a030 0x7ffa7015a400 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7ffa700b1fa0 tx=0x7ffa68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1ee29d9ae51a97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:36.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa6d59a700 1 -- 172.21.15.6:0/4243024583 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6800b820 con 0x7ffa7015a030 2023-10-06T02:27:36.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa6d59a700 1 -- 172.21.15.6:0/4243024583 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6800b980 con 0x7ffa7015a030 2023-10-06T02:27:36.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.118+0000 7ffa6d59a700 1 -- 172.21.15.6:0/4243024583 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6800bd20 con 0x7ffa7015a030 2023-10-06T02:27:36.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.119+0000 7ffa74892700 1 -- 172.21.15.6:0/4243024583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa7015a030 msgr2=0x7ffa7015a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.119+0000 7ffa74892700 1 --2- 172.21.15.6:0/4243024583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa7015a030 0x7ffa7015a400 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7ffa700b1fa0 tx=0x7ffa68009250 comp rx=0 tx=0).stop 2023-10-06T02:27:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.119+0000 7ffa74892700 1 -- 172.21.15.6:0/4243024583 shutdown_connections 2023-10-06T02:27:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.119+0000 7ffa74892700 1 --2- 172.21.15.6:0/4243024583 >> v2:172.21.15.175:3300/0 conn(0x7ffa70087530 0x7ffa700b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.119+0000 7ffa74892700 1 --2- 172.21.15.6:0/4243024583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa7015a030 0x7ffa7015a400 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.119+0000 7ffa74892700 1 --2- 172.21.15.6:0/4243024583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa7015a940 0x7ffa70086ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.119+0000 7ffa74892700 1 -- 172.21.15.6:0/4243024583 >> 172.21.15.6:0/4243024583 conn(0x7ffa70068680 msgr2=0x7ffa70068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.119+0000 7ffa74892700 1 -- 172.21.15.6:0/4243024583 shutdown_connections 2023-10-06T02:27:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.119+0000 7ffa74892700 1 -- 172.21.15.6:0/4243024583 wait complete. 2023-10-06T02:27:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.120+0000 7ffa74892700 1 Processor -- start 2023-10-06T02:27:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.120+0000 7ffa74892700 1 -- start start 2023-10-06T02:27:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa74892700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa70087530 0x7ffa7016abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa74892700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa7015a030 0x7ffa700b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa74892700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa7015a940 0x7ffa700cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa74892700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa700b5200 con 0x7ffa7015a940 2023-10-06T02:27:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa74892700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa700b3130 con 0x7ffa70087530 2023-10-06T02:27:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa74892700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa700b33d0 con 0x7ffa7015a030 2023-10-06T02:27:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa6ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa7015a940 0x7ffa700cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa6ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa7015a940 0x7ffa700cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35098/0 (socket says 172.21.15.6:35098) 2023-10-06T02:27:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa6ed9d700 1 -- 172.21.15.6:0/3977881757 learned_addr learned my addr 172.21.15.6:0/3977881757 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa6dd9b700 1 --2- 172.21.15.6:0/3977881757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa7015a030 0x7ffa700b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa6e59c700 1 --2- 172.21.15.6:0/3977881757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa70087530 0x7ffa7016abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa6ed9d700 1 -- 172.21.15.6:0/3977881757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa7015a030 msgr2=0x7ffa700b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa6ed9d700 1 --2- 172.21.15.6:0/3977881757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa7015a030 0x7ffa700b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa6ed9d700 1 -- 172.21.15.6:0/3977881757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa70087530 msgr2=0x7ffa7016abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa6ed9d700 1 --2- 172.21.15.6:0/3977881757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa70087530 0x7ffa7016abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa6ed9d700 1 -- 172.21.15.6:0/3977881757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa680094f0 con 0x7ffa7015a940 2023-10-06T02:27:36.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa6e59c700 1 --2- 172.21.15.6:0/3977881757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa70087530 0x7ffa7016abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:36.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.121+0000 7ffa6ed9d700 1 --2- 172.21.15.6:0/3977881757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa7015a940 0x7ffa700cc4b0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009fa0 tx=0x7ffa60009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:36.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.122+0000 7ffa667fc700 1 -- 172.21.15.6:0/3977881757 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6000ec70 con 0x7ffa7015a940 2023-10-06T02:27:36.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.122+0000 7ffa667fc700 1 -- 172.21.15.6:0/3977881757 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6000edd0 con 0x7ffa7015a940 2023-10-06T02:27:36.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.122+0000 7ffa74892700 1 -- 172.21.15.6:0/3977881757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa700b36b0 con 0x7ffa7015a940 2023-10-06T02:27:36.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.122+0000 7ffa667fc700 1 -- 172.21.15.6:0/3977881757 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa60014670 con 0x7ffa7015a940 2023-10-06T02:27:36.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.122+0000 7ffa74892700 1 -- 172.21.15.6:0/3977881757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa700b5410 con 0x7ffa7015a940 2023-10-06T02:27:36.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.123+0000 7ffa74892700 1 -- 172.21.15.6:0/3977881757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa700b3bd0 con 0x7ffa7015a940 2023-10-06T02:27:36.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.123+0000 7ffa667fc700 1 -- 172.21.15.6:0/3977881757 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa600149e0 con 0x7ffa7015a940 2023-10-06T02:27:36.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.123+0000 7ffa667fc700 1 --2- 172.21.15.6:0/3977881757 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffa50066f30 0x7ffa500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:36.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.123+0000 7ffa667fc700 1 -- 172.21.15.6:0/3977881757 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 8528+0+0 (secure 0 0 0) 0x7ffa60085760 con 0x7ffa7015a940 2023-10-06T02:27:36.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.124+0000 7ffa6e59c700 1 --2- 172.21.15.6:0/3977881757 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffa50066f30 0x7ffa500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:36.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.124+0000 7ffa6e59c700 1 --2- 172.21.15.6:0/3977881757 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffa50066f30 0x7ffa500693e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ffa700b1fa0 tx=0x7ffa68017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:36.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.128+0000 7ffa667fc700 1 -- 172.21.15.6:0/3977881757 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa60051e90 con 0x7ffa7015a940 2023-10-06T02:27:36.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.403+0000 7ffa74892700 1 -- 172.21.15.6:0/3977881757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7ffa700b0210 con 0x7ffa7015a940 2023-10-06T02:27:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.988+0000 7ffa667fc700 1 -- 172.21.15.6:0/3977881757 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v247) v1 ==== 101+0+0 (secure 0 0 0) 0x7ffa600554b0 con 0x7ffa7015a940 2023-10-06T02:27:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.991+0000 7ffa74892700 1 -- 172.21.15.6:0/3977881757 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffa50066f30 msgr2=0x7ffa500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.991+0000 7ffa74892700 1 --2- 172.21.15.6:0/3977881757 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffa50066f30 0x7ffa500693e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ffa700b1fa0 tx=0x7ffa68017000 comp rx=0 tx=0).stop 2023-10-06T02:27:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.991+0000 7ffa74892700 1 -- 172.21.15.6:0/3977881757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa7015a940 msgr2=0x7ffa700cc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.991+0000 7ffa74892700 1 --2- 172.21.15.6:0/3977881757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa7015a940 0x7ffa700cc4b0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009fa0 tx=0x7ffa60009900 comp rx=0 tx=0).stop 2023-10-06T02:27:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.991+0000 7ffa74892700 1 -- 172.21.15.6:0/3977881757 shutdown_connections 2023-10-06T02:27:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.991+0000 7ffa74892700 1 --2- 172.21.15.6:0/3977881757 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ffa50066f30 0x7ffa500693e0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.991+0000 7ffa74892700 1 --2- 172.21.15.6:0/3977881757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa7015a940 0x7ffa700cc4b0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.991+0000 7ffa74892700 1 --2- 172.21.15.6:0/3977881757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa70087530 0x7ffa7016abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.991+0000 7ffa74892700 1 --2- 172.21.15.6:0/3977881757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa7015a030 0x7ffa700b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.991+0000 7ffa74892700 1 -- 172.21.15.6:0/3977881757 >> 172.21.15.6:0/3977881757 conn(0x7ffa70068680 msgr2=0x7ffa70159120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.991+0000 7ffa74892700 1 -- 172.21.15.6:0/3977881757 shutdown_connections 2023-10-06T02:27:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:36.991+0000 7ffa74892700 1 -- 172.21.15.6:0/3977881757 wait complete. 2023-10-06T02:27:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:27:37.006 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:27:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.046+0000 7f627a618000 1 Processor -- start 2023-10-06T02:27:37.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.046+0000 7f627a618000 1 -- start start 2023-10-06T02:27:37.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f627a618000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075c07de30 0x56075c126000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f627a618000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56075c126f50 0x56075c0825c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f627a618000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56075c12a260 0x56075c119a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f627a618000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075bf9d980 con 0x56075c12a260 2023-10-06T02:27:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f627a618000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075bf9d620 con 0x56075c07de30 2023-10-06T02:27:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f627a618000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56075bf94400 con 0x56075c126f50 2023-10-06T02:27:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f6274054700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56075c12a260 0x56075c119a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f6274054700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56075c12a260 0x56075c119a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35110/0 (socket says 172.21.15.6:35110) 2023-10-06T02:27:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f6274054700 1 -- 172.21.15.6:0/3514968168 learned_addr learned my addr 172.21.15.6:0/3514968168 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f6273052700 1 --2- 172.21.15.6:0/3514968168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56075c126f50 0x56075c0825c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f6273853700 1 --2- 172.21.15.6:0/3514968168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075c07de30 0x56075c126000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f6274054700 1 -- 172.21.15.6:0/3514968168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56075c126f50 msgr2=0x56075c0825c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f6274054700 1 --2- 172.21.15.6:0/3514968168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56075c126f50 0x56075c0825c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f6274054700 1 -- 172.21.15.6:0/3514968168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075c07de30 msgr2=0x56075c126000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f6274054700 1 --2- 172.21.15.6:0/3514968168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075c07de30 0x56075c126000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f6274054700 1 -- 172.21.15.6:0/3514968168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c005cf0 con 0x56075c12a260 2023-10-06T02:27:37.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f6274054700 1 --2- 172.21.15.6:0/3514968168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56075c12a260 0x56075c119a60 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f626c009920 tx=0x7f626c00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2fbf2da0a44769 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f6272050700 1 -- 172.21.15.6:0/3514968168 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00f040 con 0x56075c12a260 2023-10-06T02:27:37.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f6272050700 1 -- 172.21.15.6:0/3514968168 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c008af0 con 0x56075c12a260 2023-10-06T02:27:37.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.047+0000 7f6272050700 1 -- 172.21.15.6:0/3514968168 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c008e90 con 0x56075c12a260 2023-10-06T02:27:37.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.048+0000 7f627a618000 1 -- 172.21.15.6:0/3514968168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56075c12a260 msgr2=0x56075c119a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.048+0000 7f627a618000 1 --2- 172.21.15.6:0/3514968168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56075c12a260 0x56075c119a60 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f626c009920 tx=0x7f626c00c040 comp rx=0 tx=0).stop 2023-10-06T02:27:37.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.048+0000 7f627a618000 1 -- 172.21.15.6:0/3514968168 shutdown_connections 2023-10-06T02:27:37.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.048+0000 7f627a618000 1 --2- 172.21.15.6:0/3514968168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56075c12a260 0x56075c119a60 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.048+0000 7f627a618000 1 --2- 172.21.15.6:0/3514968168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075c07de30 0x56075c126000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.048+0000 7f627a618000 1 --2- 172.21.15.6:0/3514968168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56075c126f50 0x56075c0825c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.048+0000 7f627a618000 1 -- 172.21.15.6:0/3514968168 >> 172.21.15.6:0/3514968168 conn(0x56075c099bd0 msgr2=0x56075c099fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:37.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.048+0000 7f627a618000 1 -- 172.21.15.6:0/3514968168 shutdown_connections 2023-10-06T02:27:37.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.048+0000 7f627a618000 1 -- 172.21.15.6:0/3514968168 wait complete. 2023-10-06T02:27:37.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.049+0000 7f627a618000 1 Processor -- start 2023-10-06T02:27:37.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.049+0000 7f627a618000 1 -- start start 2023-10-06T02:27:37.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.049+0000 7f627a618000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56075c07de30 0x56075c128b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.049+0000 7f627a618000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56075c126f50 0x56075c116980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.049+0000 7f627a618000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075c12a260 0x56075c11db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.049+0000 7f627a618000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075c11d4e0 con 0x56075c07de30 2023-10-06T02:27:37.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.049+0000 7f627a618000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075c124f80 con 0x56075c12a260 2023-10-06T02:27:37.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.049+0000 7f627a618000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56075c128170 con 0x56075c126f50 2023-10-06T02:27:37.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.050+0000 7f6273853700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56075c07de30 0x56075c128b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.050+0000 7f6273853700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56075c07de30 0x56075c128b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35122/0 (socket says 172.21.15.6:35122) 2023-10-06T02:27:37.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.050+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 learned_addr learned my addr 172.21.15.6:0/3383822276 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:37.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.050+0000 7f6273052700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56075c126f50 0x56075c116980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.050+0000 7f6274054700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075c12a260 0x56075c11db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.050+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56075c126f50 msgr2=0x56075c116980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.050+0000 7f6273853700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56075c126f50 0x56075c116980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.050+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075c12a260 msgr2=0x56075c11db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.050+0000 7f6273853700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075c12a260 0x56075c11db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.050+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c009570 con 0x56075c07de30 2023-10-06T02:27:37.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.050+0000 7f6273853700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56075c07de30 0x56075c128b50 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x56075c053300 tx=0x7f6264015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.050+0000 7f627084d700 1 -- 172.21.15.6:0/3383822276 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6264020070 con 0x56075c07de30 2023-10-06T02:27:37.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.050+0000 7f627084d700 1 -- 172.21.15.6:0/3383822276 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626400fe20 con 0x56075c07de30 2023-10-06T02:27:37.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.050+0000 7f627084d700 1 -- 172.21.15.6:0/3383822276 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400fab0 con 0x56075c07de30 2023-10-06T02:27:37.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.050+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626400a0e0 con 0x56075c07de30 2023-10-06T02:27:37.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.050+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56075bfac3d0 con 0x56075c07de30 2023-10-06T02:27:37.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.052+0000 7f627084d700 1 -- 172.21.15.6:0/3383822276 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6264003040 con 0x56075c07de30 2023-10-06T02:27:37.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.052+0000 7f627084d700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f62540658c0 0x7f6254067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.052+0000 7f627084d700 1 -- 172.21.15.6:0/3383822276 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f6264086910 con 0x56075c07de30 2023-10-06T02:27:37.057 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:27:37.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.052+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56075c11e5b0 0x56075c11ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.052+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c11b2c0 con 0x56075c11e5b0 2023-10-06T02:27:37.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.052+0000 7f6273052700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f62540658c0 0x7f6254067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.053+0000 7f6274054700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56075c11e5b0 0x56075c11ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.053+0000 7f6274054700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56075c11e5b0 0x56075c11ad80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.053+0000 7f6273052700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f62540658c0 0x7f6254067d70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f625c001ed0 tx=0x7f625c000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.055+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v120'753 uv727 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.055+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c11b6a0 con 0x56075c11e5b0 2023-10-06T02:27:37.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.056+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v120'754 uv754 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.056+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c050c20 con 0x56075c11e5b0 2023-10-06T02:27:37.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.057+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v120'755 uv755 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.059 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:27:37.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.057+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c050fd0 con 0x56075c11e5b0 2023-10-06T02:27:37.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.058+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v120'756 uv756 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.058+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c051380 con 0x56075c11e5b0 2023-10-06T02:27:37.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.060+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v120'757 uv757 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.060+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c0517b0 con 0x56075c11e5b0 2023-10-06T02:27:37.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.061+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v120'758 uv758 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.061+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c142de0 con 0x56075c11e5b0 2023-10-06T02:27:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.062+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v120'759 uv733 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.062+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c142de0 con 0x56075c11e5b0 2023-10-06T02:27:37.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.063+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v120'760 uv760 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.063+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c142de0 con 0x56075c11e5b0 2023-10-06T02:27:37.065 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:27:37.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.064+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v120'761 uv761 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.064+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c143df0 con 0x56075c11e5b0 2023-10-06T02:27:37.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.065+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v120'762 uv762 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.065+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c143df0 con 0x56075c11e5b0 2023-10-06T02:27:37.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.066+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v120'763 uv763 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.066+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c142de0 con 0x56075c11e5b0 2023-10-06T02:27:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.068+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v120'764 uv764 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.068+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c142de0 con 0x56075c11e5b0 2023-10-06T02:27:37.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.069+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v120'765 uv740 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.069+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c142de0 con 0x56075c11e5b0 2023-10-06T02:27:37.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.070+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v120'766 uv766 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.070+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c142de0 con 0x56075c11e5b0 2023-10-06T02:27:37.071 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:27:37.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.071+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v120'767 uv767 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.071+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c143df0 con 0x56075c11e5b0 2023-10-06T02:27:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.072+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v120'768 uv768 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.072+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c143df0 con 0x56075c11e5b0 2023-10-06T02:27:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.074+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v120'769 uv769 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.074+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c142de0 con 0x56075c11e5b0 2023-10-06T02:27:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.075+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v120'770 uv770 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.075+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c1432d0 con 0x56075c11e5b0 2023-10-06T02:27:37.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.076+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v120'771 uv771 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.076+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c1432d0 con 0x56075c11e5b0 2023-10-06T02:27:37.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.077+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v120'772 uv746 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.077+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c1432d0 con 0x56075c11e5b0 2023-10-06T02:27:37.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.079+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v120'773 uv773 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.079+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c1432d0 con 0x56075c11e5b0 2023-10-06T02:27:37.080 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:27:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.080+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v120'774 uv774 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.080+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c1442e0 con 0x56075c11e5b0 2023-10-06T02:27:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.081+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v120'775 uv775 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.081+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c1442e0 con 0x56075c11e5b0 2023-10-06T02:27:37.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.082+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v120'776 uv776 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.082+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c1432d0 con 0x56075c11e5b0 2023-10-06T02:27:37.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.083+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v120'777 uv777 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.083+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c1432d0 con 0x56075c11e5b0 2023-10-06T02:27:37.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.084+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v120'778 uv752 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.084+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c1432d0 con 0x56075c11e5b0 2023-10-06T02:27:37.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.085+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v120'779 uv779 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.086+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c1432d0 con 0x56075c11e5b0 2023-10-06T02:27:37.087 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:27:37.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.087+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v120'780 uv780 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.087+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c1442e0 con 0x56075c11e5b0 2023-10-06T02:27:37.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.088+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v120'781 uv781 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.088+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c1442e0 con 0x56075c11e5b0 2023-10-06T02:27:37.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.089+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v120'782 uv782 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.089+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c1432d0 con 0x56075c11e5b0 2023-10-06T02:27:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.090+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v120'783 uv783 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c11e5b0 2023-10-06T02:27:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.090+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56075c1437e0 0x56075c145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.090+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c146100 con 0x56075c1437e0 2023-10-06T02:27:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.090+0000 7f6273853700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56075c1437e0 0x56075c145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.091+0000 7f6273853700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56075c1437e0 0x56075c145bc0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.092+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v120'543 uv525 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.092+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c1464b0 con 0x56075c1437e0 2023-10-06T02:27:37.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.093+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v120'544 uv544 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.094+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c146860 con 0x56075c1437e0 2023-10-06T02:27:37.095 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:27:37.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.095+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v120'545 uv545 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.095+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c147100 con 0x56075c1437e0 2023-10-06T02:27:37.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.096+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v120'546 uv546 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.096+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c1474b0 con 0x56075c1437e0 2023-10-06T02:27:37.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.097+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v120'547 uv547 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.097+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c147860 con 0x56075c1437e0 2023-10-06T02:27:37.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.098+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v120'548 uv542 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.098+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c147c10 con 0x56075c1437e0 2023-10-06T02:27:37.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.099+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v120'549 uv549 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.099+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c147c10 con 0x56075c1437e0 2023-10-06T02:27:37.100 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:27:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.100+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v120'550 uv550 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.100+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c147c10 con 0x56075c1437e0 2023-10-06T02:27:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.101+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v120'551 uv551 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.101+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c147c10 con 0x56075c1437e0 2023-10-06T02:27:37.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.102+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v120'552 uv552 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.102+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c147c10 con 0x56075c1437e0 2023-10-06T02:27:37.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.104+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v120'553 uv535 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.104+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c147c10 con 0x56075c1437e0 2023-10-06T02:27:37.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.105+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v120'554 uv554 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.105+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c147c10 con 0x56075c1437e0 2023-10-06T02:27:37.106 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:27:37.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.106+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v120'555 uv555 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.106+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14b330 con 0x56075c1437e0 2023-10-06T02:27:37.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.107+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v120'556 uv556 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.107+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14b330 con 0x56075c1437e0 2023-10-06T02:27:37.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.108+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v120'557 uv557 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.108+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c147c10 con 0x56075c1437e0 2023-10-06T02:27:37.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.110+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v120'558 uv541 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.110+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c147c10 con 0x56075c1437e0 2023-10-06T02:27:37.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.111+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v120'559 uv559 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.111+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c147c10 con 0x56075c1437e0 2023-10-06T02:27:37.112 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:27:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.112+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v120'560 uv560 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.112+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c148c20 con 0x56075c1437e0 2023-10-06T02:27:37.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.113+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v120'561 uv561 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.113+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c148c20 con 0x56075c1437e0 2023-10-06T02:27:37.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.114+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v120'562 uv562 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.114+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c147c10 con 0x56075c1437e0 2023-10-06T02:27:37.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.115+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v120'563 uv563 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.115+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56075c148120 0x56075c14a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.115+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14aa40 con 0x56075c148120 2023-10-06T02:27:37.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.115+0000 7f6273052700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56075c148120 0x56075c14a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.115+0000 7f6273052700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56075c148120 0x56075c14a500 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.116+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v120'147 uv146 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.116+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14adf0 con 0x56075c148120 2023-10-06T02:27:37.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.117+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v120'148 uv148 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.117+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14b1a0 con 0x56075c148120 2023-10-06T02:27:37.119 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:27:37.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.118+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v120'149 uv149 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.118+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14c560 con 0x56075c148120 2023-10-06T02:27:37.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.119+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v120'150 uv150 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.119+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14c990 con 0x56075c148120 2023-10-06T02:27:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.120+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v120'151 uv151 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.120+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14b550 con 0x56075c148120 2023-10-06T02:27:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.122+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v120'152 uv152 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.122+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14b950 con 0x56075c148120 2023-10-06T02:27:37.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.123+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v120'104 uv103 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.123+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14bda0 con 0x56075c148120 2023-10-06T02:27:37.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.123+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v120'105 uv105 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.123+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14bda0 con 0x56075c148120 2023-10-06T02:27:37.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.124+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v120'106 uv106 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.126 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:27:37.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.124+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14bda0 con 0x56075c148120 2023-10-06T02:27:37.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.125+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v120'107 uv107 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.125+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14bda0 con 0x56075c1437e0 2023-10-06T02:27:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.126+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v120'147 uv146 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.126+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14bda0 con 0x56075c1437e0 2023-10-06T02:27:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.127+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v120'148 uv148 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.127+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14bda0 con 0x56075c1437e0 2023-10-06T02:27:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.128+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v120'149 uv149 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.129 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:27:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.128+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14bda0 con 0x56075c1437e0 2023-10-06T02:27:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.129+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v120'150 uv150 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.129+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14bda0 con 0x56075c1437e0 2023-10-06T02:27:37.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.130+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v120'151 uv151 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.130+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14bda0 con 0x56075c1437e0 2023-10-06T02:27:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.131+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v120'152 uv152 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c1437e0 2023-10-06T02:27:37.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.131+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56075c14d2a0 0x56075c14f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.131+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14fbc0 con 0x56075c14d2a0 2023-10-06T02:27:37.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.131+0000 7f6274054700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56075c14d2a0 0x56075c14f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.132+0000 7f6274054700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56075c14d2a0 0x56075c14f680 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.133+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v120'271 uv265 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c14d2a0 2023-10-06T02:27:37.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.133+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14fbc0 con 0x56075c14d2a0 2023-10-06T02:27:37.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.134+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v120'272 uv272 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c14d2a0 2023-10-06T02:27:37.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.134+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14fbc0 con 0x56075c14d2a0 2023-10-06T02:27:37.135 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:27:37.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.135+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v120'273 uv273 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c14d2a0 2023-10-06T02:27:37.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.135+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c150bd0 con 0x56075c14d2a0 2023-10-06T02:27:37.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.136+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v120'274 uv274 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c14d2a0 2023-10-06T02:27:37.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.136+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c150bd0 con 0x56075c14d2a0 2023-10-06T02:27:37.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.137+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v120'275 uv275 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c14d2a0 2023-10-06T02:27:37.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.137+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14fbc0 con 0x56075c14d2a0 2023-10-06T02:27:37.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.138+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v120'276 uv276 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c14d2a0 2023-10-06T02:27:37.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.138+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14fbc0 con 0x56075c14d2a0 2023-10-06T02:27:37.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.139+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v120'277 uv270 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c14d2a0 2023-10-06T02:27:37.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.139+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14fbc0 con 0x56075c14d2a0 2023-10-06T02:27:37.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.140+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v120'278 uv278 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c14d2a0 2023-10-06T02:27:37.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.140+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14fbc0 con 0x56075c14d2a0 2023-10-06T02:27:37.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.142+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v120'279 uv279 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c14d2a0 2023-10-06T02:27:37.142 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:27:37.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.142+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14fbc0 con 0x56075c14d2a0 2023-10-06T02:27:37.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.143+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v120'280 uv280 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c14d2a0 2023-10-06T02:27:37.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.143+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c14fbc0 con 0x56075c14d2a0 2023-10-06T02:27:37.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.144+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v120'281 uv281 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c14d2a0 2023-10-06T02:27:37.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.144+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56075c150240 0x56075c152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.144+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c152d20 con 0x56075c150240 2023-10-06T02:27:37.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.144+0000 7f6273853700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56075c150240 0x56075c152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.144+0000 7f6273853700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56075c150240 0x56075c152620 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.145+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v120'122 uv121 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c150240 2023-10-06T02:27:37.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.145+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c153100 con 0x56075c150240 2023-10-06T02:27:37.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.147+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v120'123 uv123 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c150240 2023-10-06T02:27:37.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.147+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c153100 con 0x56075c150240 2023-10-06T02:27:37.150 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:27:37.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.149+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v120'124 uv124 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c150240 2023-10-06T02:27:37.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.149+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c153100 con 0x56075c150240 2023-10-06T02:27:37.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.153+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v120'125 uv125 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c150240 2023-10-06T02:27:37.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.153+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c153100 con 0x56075c150240 2023-10-06T02:27:37.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.155+0000 7f6273853700 1 -- 172.21.15.6:0/3383822276 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v120'126 uv126 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6264016020 con 0x56075c150240 2023-10-06T02:27:37.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.155+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c153100 con 0x56075c148120 2023-10-06T02:27:37.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.156+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v120'147 uv146 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.156+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c153100 con 0x56075c148120 2023-10-06T02:27:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.157+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v120'148 uv148 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.157+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c153100 con 0x56075c148120 2023-10-06T02:27:37.158 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:27:37.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.158+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v120'149 uv149 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.158+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c154110 con 0x56075c148120 2023-10-06T02:27:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.158+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v120'150 uv150 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.159+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c154110 con 0x56075c148120 2023-10-06T02:27:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.159+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v120'151 uv151 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.159+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c153100 con 0x56075c148120 2023-10-06T02:27:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.160+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v120'152 uv152 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.160+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56075c153780 0x56075c155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.160+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156170 con 0x56075c153780 2023-10-06T02:27:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.160+0000 7f6273052700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56075c153780 0x56075c155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.161+0000 7f6273052700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56075c153780 0x56075c155b60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.162+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v120'243 uv237 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c153780 2023-10-06T02:27:37.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.162+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156550 con 0x56075c153780 2023-10-06T02:27:37.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.163+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v120'244 uv244 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c153780 2023-10-06T02:27:37.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.163+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156550 con 0x56075c153780 2023-10-06T02:27:37.164 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:27:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.164+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v120'245 uv245 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c153780 2023-10-06T02:27:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.164+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156550 con 0x56075c153780 2023-10-06T02:27:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.165+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v120'246 uv246 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c153780 2023-10-06T02:27:37.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.165+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156550 con 0x56075c153780 2023-10-06T02:27:37.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.166+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v120'247 uv247 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c153780 2023-10-06T02:27:37.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.166+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156550 con 0x56075c153780 2023-10-06T02:27:37.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.167+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v120'248 uv242 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c153780 2023-10-06T02:27:37.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.167+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156550 con 0x56075c153780 2023-10-06T02:27:37.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.168+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v120'249 uv249 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c153780 2023-10-06T02:27:37.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.168+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156550 con 0x56075c153780 2023-10-06T02:27:37.169 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:27:37.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.169+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v120'250 uv250 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c153780 2023-10-06T02:27:37.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.169+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156550 con 0x56075c153780 2023-10-06T02:27:37.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.170+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v120'251 uv251 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c153780 2023-10-06T02:27:37.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.170+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c1592c0 con 0x56075c153780 2023-10-06T02:27:37.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.171+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v120'252 uv252 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c153780 2023-10-06T02:27:37.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.171+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156a40 con 0x56075c148120 2023-10-06T02:27:37.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.172+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v120'107 uv106 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.172+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156a40 con 0x56075c148120 2023-10-06T02:27:37.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.173+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v120'108 uv108 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.173+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156a40 con 0x56075c148120 2023-10-06T02:27:37.174 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:27:37.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.174+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v120'109 uv109 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.174+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156a40 con 0x56075c148120 2023-10-06T02:27:37.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.175+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v120'110 uv110 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.175+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56075c157350 0x56075c159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.175+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156a40 con 0x56075c157350 2023-10-06T02:27:37.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.175+0000 7f6274054700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56075c157350 0x56075c159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.176+0000 7f6274054700 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56075c157350 0x56075c159a10 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.177+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v120'147 uv146 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c157350 2023-10-06T02:27:37.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.177+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156a40 con 0x56075c157350 2023-10-06T02:27:37.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.178+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v120'148 uv148 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c157350 2023-10-06T02:27:37.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.178+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156a40 con 0x56075c157350 2023-10-06T02:27:37.180 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:27:37.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.179+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v120'149 uv149 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c157350 2023-10-06T02:27:37.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.180+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156a40 con 0x56075c157350 2023-10-06T02:27:37.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.181+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v120'150 uv150 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c157350 2023-10-06T02:27:37.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.181+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156a40 con 0x56075c157350 2023-10-06T02:27:37.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.182+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v120'151 uv151 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c157350 2023-10-06T02:27:37.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.182+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156a40 con 0x56075c157350 2023-10-06T02:27:37.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.183+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v120'152 uv152 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c157350 2023-10-06T02:27:37.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.183+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156a40 con 0x56075c14d2a0 2023-10-06T02:27:37.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.184+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v120'125 uv124 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c14d2a0 2023-10-06T02:27:37.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.184+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156a40 con 0x56075c14d2a0 2023-10-06T02:27:37.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.185+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v120'126 uv126 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c14d2a0 2023-10-06T02:27:37.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.185+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156a40 con 0x56075c14d2a0 2023-10-06T02:27:37.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.186+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v120'127 uv127 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c14d2a0 2023-10-06T02:27:37.186 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:27:37.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.186+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c156a40 con 0x56075c14d2a0 2023-10-06T02:27:37.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.187+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v120'128 uv128 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c14d2a0 2023-10-06T02:27:37.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.187+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c159f50 con 0x56075c14d2a0 2023-10-06T02:27:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.188+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v120'129 uv129 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f626c0146d0 con 0x56075c14d2a0 2023-10-06T02:27:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.188+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c159f50 con 0x56075c148120 2023-10-06T02:27:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.189+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v120'302 uv294 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.189+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c159f50 con 0x56075c148120 2023-10-06T02:27:37.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.190+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v120'303 uv303 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.190+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c159f50 con 0x56075c148120 2023-10-06T02:27:37.191 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:27:37.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.191+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v120'304 uv304 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.191+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c159f50 con 0x56075c148120 2023-10-06T02:27:37.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.192+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v120'305 uv305 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.192+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c159f50 con 0x56075c148120 2023-10-06T02:27:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.193+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v120'306 uv306 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.193+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c159f50 con 0x56075c148120 2023-10-06T02:27:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.194+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v120'307 uv301 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.194+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c159f50 con 0x56075c148120 2023-10-06T02:27:37.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.195+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v120'308 uv308 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.195+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c159f50 con 0x56075c148120 2023-10-06T02:27:37.197 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:27:37.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.196+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v120'309 uv309 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.196+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c15af60 con 0x56075c148120 2023-10-06T02:27:37.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.197+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v120'310 uv310 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.197+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c15af60 con 0x56075c148120 2023-10-06T02:27:37.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.198+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v120'311 uv311 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.198+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c159f50 con 0x56075c148120 2023-10-06T02:27:37.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.199+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v120'312 uv312 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.199+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56075c159f50 con 0x56075c148120 2023-10-06T02:27:37.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.200+0000 7f6273052700 1 -- 172.21.15.6:0/3383822276 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v120'313 uv313 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f625c00e970 con 0x56075c148120 2023-10-06T02:27:37.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.200+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56075c148120 msgr2=0x56075c14a500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.200+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56075c148120 0x56075c14a500 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.200+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56075c11e5b0 msgr2=0x56075c11ad80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.200+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56075c11e5b0 0x56075c11ad80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.200+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56075c153780 msgr2=0x56075c155b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.200+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56075c153780 0x56075c155b60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.200+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56075c1437e0 msgr2=0x56075c145bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.200+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56075c1437e0 0x56075c145bc0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.200+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56075c157350 msgr2=0x56075c159a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.200+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56075c157350 0x56075c159a10 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.200+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 reap_dead start 2023-10-06T02:27:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.200+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56075c150240 msgr2=0x56075c152620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.200+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56075c150240 0x56075c152620 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.201+0000 7f6274054700 1 -- 172.21.15.6:0/3383822276 reap_dead start 2023-10-06T02:27:37.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.201+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56075c14d2a0 msgr2=0x56075c14f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.201+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56075c14d2a0 0x56075c14f680 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.201+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f62540658c0 msgr2=0x7f6254067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.201+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f62540658c0 0x7f6254067d70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f625c001ed0 tx=0x7f625c000bc0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.201+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56075c07de30 msgr2=0x56075c128b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.201+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56075c07de30 0x56075c128b50 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x56075c053300 tx=0x7f6264015000 comp rx=0 tx=0).stop 2023-10-06T02:27:37.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.201+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 shutdown_connections 2023-10-06T02:27:37.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.201+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56075c14d2a0 0x56075c14f680 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.201+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56075c07de30 0x56075c128b50 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.201+0000 7f627a618000 1 --2- 172.21.15.6:0/3383822276 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f62540658c0 0x7f6254067d70 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.201+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 >> 172.21.15.6:0/3383822276 conn(0x56075c099bd0 msgr2=0x56075c0802d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:37.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.201+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 shutdown_connections 2023-10-06T02:27:37.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.201+0000 7f627a618000 1 -- 172.21.15.6:0/3383822276 wait complete. 2023-10-06T02:27:37.205 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 200.00000001 0 2023-10-06T02:27:37.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.283+0000 7fc11bac4000 1 Processor -- start 2023-10-06T02:27:37.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.283+0000 7fc11bac4000 1 -- start start 2023-10-06T02:27:37.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.284+0000 7fc11bac4000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558bc17a3490 0x558bc17875b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.284+0000 7fc11bac4000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558bc1819a80 0x558bc1785cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.284+0000 7fc11bac4000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bc1819e50 0x558bc175b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.284+0000 7fc11bac4000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bc16a4980 con 0x558bc1819e50 2023-10-06T02:27:37.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.284+0000 7fc11bac4000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bc16a4620 con 0x558bc1819a80 2023-10-06T02:27:37.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.284+0000 7fc11bac4000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x558bc169b400 con 0x558bc17a3490 2023-10-06T02:27:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.284+0000 7fc115500700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bc1819e50 0x558bc175b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.284+0000 7fc115500700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bc1819e50 0x558bc175b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35146/0 (socket says 172.21.15.6:35146) 2023-10-06T02:27:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.284+0000 7fc115500700 1 -- 172.21.15.6:0/827377138 learned_addr learned my addr 172.21.15.6:0/827377138 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.284+0000 7fc114cff700 1 --2- 172.21.15.6:0/827377138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558bc17a3490 0x558bc17875b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.284+0000 7fc1144fe700 1 --2- 172.21.15.6:0/827377138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558bc1819a80 0x558bc1785cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.284+0000 7fc115500700 1 -- 172.21.15.6:0/827377138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558bc17a3490 msgr2=0x558bc17875b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.284+0000 7fc115500700 1 --2- 172.21.15.6:0/827377138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558bc17a3490 0x558bc17875b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.284+0000 7fc115500700 1 -- 172.21.15.6:0/827377138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558bc1819a80 msgr2=0x558bc1785cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.284+0000 7fc115500700 1 --2- 172.21.15.6:0/827377138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558bc1819a80 0x558bc1785cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.284+0000 7fc115500700 1 -- 172.21.15.6:0/827377138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc108005db0 con 0x558bc1819e50 2023-10-06T02:27:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.284+0000 7fc115500700 1 --2- 172.21.15.6:0/827377138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bc1819e50 0x558bc175b650 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fc1040016e0 tx=0x7fc104006930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc8bc54f469b59d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.285+0000 7fc1134fc700 1 -- 172.21.15.6:0/827377138 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104004120 con 0x558bc1819e50 2023-10-06T02:27:37.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.285+0000 7fc1134fc700 1 -- 172.21.15.6:0/827377138 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10400e470 con 0x558bc1819e50 2023-10-06T02:27:37.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.285+0000 7fc1134fc700 1 -- 172.21.15.6:0/827377138 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10400e830 con 0x558bc1819e50 2023-10-06T02:27:37.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.285+0000 7fc11bac4000 1 -- 172.21.15.6:0/827377138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bc1819e50 msgr2=0x558bc175b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.285+0000 7fc11bac4000 1 --2- 172.21.15.6:0/827377138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bc1819e50 0x558bc175b650 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fc1040016e0 tx=0x7fc104006930 comp rx=0 tx=0).stop 2023-10-06T02:27:37.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.285+0000 7fc11bac4000 1 -- 172.21.15.6:0/827377138 shutdown_connections 2023-10-06T02:27:37.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.285+0000 7fc11bac4000 1 --2- 172.21.15.6:0/827377138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bc1819e50 0x558bc175b650 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.285+0000 7fc11bac4000 1 --2- 172.21.15.6:0/827377138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558bc17a3490 0x558bc17875b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.285+0000 7fc11bac4000 1 --2- 172.21.15.6:0/827377138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558bc1819a80 0x558bc1785cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.285+0000 7fc11bac4000 1 -- 172.21.15.6:0/827377138 >> 172.21.15.6:0/827377138 conn(0x558bc175a5d0 msgr2=0x558bc17855b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:37.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.285+0000 7fc11bac4000 1 -- 172.21.15.6:0/827377138 shutdown_connections 2023-10-06T02:27:37.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.285+0000 7fc11bac4000 1 -- 172.21.15.6:0/827377138 wait complete. 2023-10-06T02:27:37.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.286+0000 7fc11bac4000 1 Processor -- start 2023-10-06T02:27:37.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.286+0000 7fc11bac4000 1 -- start start 2023-10-06T02:27:37.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.286+0000 7fc11bac4000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558bc17a3490 0x558bc18121c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.286+0000 7fc11bac4000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bc1819a80 0x558bc179e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc11bac4000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558bc1819e50 0x558bc1815380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc11bac4000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bc1812700 con 0x558bc1819a80 2023-10-06T02:27:37.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc11bac4000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bc18112a0 con 0x558bc17a3490 2023-10-06T02:27:37.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc11bac4000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x558bc1811540 con 0x558bc1819e50 2023-10-06T02:27:37.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc1144fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bc1819a80 0x558bc179e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc1144fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bc1819a80 0x558bc179e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35156/0 (socket says 172.21.15.6:35156) 2023-10-06T02:27:37.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc1144fe700 1 -- 172.21.15.6:0/2965409572 learned_addr learned my addr 172.21.15.6:0/2965409572 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:37.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc115500700 1 --2- 172.21.15.6:0/2965409572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558bc1819e50 0x558bc1815380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc114cff700 1 --2- 172.21.15.6:0/2965409572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558bc17a3490 0x558bc18121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc1144fe700 1 -- 172.21.15.6:0/2965409572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558bc1819e50 msgr2=0x558bc1815380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc1144fe700 1 --2- 172.21.15.6:0/2965409572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558bc1819e50 0x558bc1815380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc1144fe700 1 -- 172.21.15.6:0/2965409572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558bc17a3490 msgr2=0x558bc18121c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc1144fe700 1 --2- 172.21.15.6:0/2965409572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558bc17a3490 0x558bc18121c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc1144fe700 1 -- 172.21.15.6:0/2965409572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc104006bf0 con 0x558bc1819a80 2023-10-06T02:27:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc1144fe700 1 --2- 172.21.15.6:0/2965409572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bc1819a80 0x558bc179e670 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fc10800a5a0 tx=0x7fc108016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc111cf9700 1 -- 172.21.15.6:0/2965409572 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1080054f0 con 0x558bc1819a80 2023-10-06T02:27:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc111cf9700 1 -- 172.21.15.6:0/2965409572 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc108000bc0 con 0x558bc1819a80 2023-10-06T02:27:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc11bac4000 1 -- 172.21.15.6:0/2965409572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558bc16b33d0 con 0x558bc1819a80 2023-10-06T02:27:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc111cf9700 1 -- 172.21.15.6:0/2965409572 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108008c20 con 0x558bc1819a80 2023-10-06T02:27:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.287+0000 7fc11bac4000 1 -- 172.21.15.6:0/2965409572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558bc16a6ae0 con 0x558bc1819a80 2023-10-06T02:27:37.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.289+0000 7fc111cf9700 1 -- 172.21.15.6:0/2965409572 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc108025070 con 0x558bc1819a80 2023-10-06T02:27:37.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.289+0000 7fc111cf9700 1 --2- 172.21.15.6:0/2965409572 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc100065890 0x7fc100067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.289+0000 7fc111cf9700 1 -- 172.21.15.6:0/2965409572 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fc1080859e0 con 0x558bc1819a80 2023-10-06T02:27:37.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.289+0000 7fc114cff700 1 --2- 172.21.15.6:0/2965409572 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc100065890 0x7fc100067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.289+0000 7fc11bac4000 1 --2- 172.21.15.6:0/2965409572 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x558bc1830270 0x558bc1813270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.289+0000 7fc11bac4000 1 -- 172.21.15.6:0/2965409572 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:1 14.14 14:2e2fa760:::200.00000001:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x558bc179ebb0 con 0x558bc1830270 2023-10-06T02:27:37.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.289+0000 7fc115500700 1 --2- 172.21.15.6:0/2965409572 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x558bc1830270 0x558bc1813270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.290+0000 7fc114cff700 1 --2- 172.21.15.6:0/2965409572 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc100065890 0x7fc100067d40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc10c005fd0 tx=0x7fc10c00c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.290+0000 7fc115500700 1 --2- 172.21.15.6:0/2965409572 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x558bc1830270 0x558bc1813270 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.291+0000 7fc115500700 1 -- 172.21.15.6:0/2965409572 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(1 200.00000001 [truncate 0] v120'564 uv564 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fc10400eba0 con 0x558bc1830270 2023-10-06T02:27:37.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.291+0000 7fc11bac4000 1 -- 172.21.15.6:0/2965409572 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x558bc1830270 msgr2=0x558bc1813270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.291+0000 7fc11bac4000 1 --2- 172.21.15.6:0/2965409572 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x558bc1830270 0x558bc1813270 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.291+0000 7fc11bac4000 1 -- 172.21.15.6:0/2965409572 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc100065890 msgr2=0x7fc100067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.291+0000 7fc11bac4000 1 --2- 172.21.15.6:0/2965409572 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc100065890 0x7fc100067d40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc10c005fd0 tx=0x7fc10c00c040 comp rx=0 tx=0).stop 2023-10-06T02:27:37.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.291+0000 7fc11bac4000 1 -- 172.21.15.6:0/2965409572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bc1819a80 msgr2=0x558bc179e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.291+0000 7fc11bac4000 1 --2- 172.21.15.6:0/2965409572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bc1819a80 0x558bc179e670 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fc10800a5a0 tx=0x7fc108016000 comp rx=0 tx=0).stop 2023-10-06T02:27:37.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.291+0000 7fc115500700 1 -- 172.21.15.6:0/2965409572 reap_dead start 2023-10-06T02:27:37.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.291+0000 7fc11bac4000 1 -- 172.21.15.6:0/2965409572 shutdown_connections 2023-10-06T02:27:37.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.291+0000 7fc11bac4000 1 -- 172.21.15.6:0/2965409572 >> 172.21.15.6:0/2965409572 conn(0x558bc175a5d0 msgr2=0x558bc179fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:37.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.291+0000 7fc11bac4000 1 -- 172.21.15.6:0/2965409572 shutdown_connections 2023-10-06T02:27:37.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.291+0000 7fc11bac4000 1 -- 172.21.15.6:0/2965409572 wait complete. 2023-10-06T02:27:37.297 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:27:37.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.457+0000 7f6c176fb700 1 Processor -- start 2023-10-06T02:27:37.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.458+0000 7f6c176fb700 1 -- start start 2023-10-06T02:27:37.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.458+0000 7f6c176fb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c100d0400 0x7f6c100b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.458+0000 7f6c176fb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6c100d07d0 0x7f6c100b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.458+0000 7f6c176fb700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c100b6170 con 0x7f6c100ccd40 2023-10-06T02:27:37.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.458+0000 7f6c176fb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1015dd40 con 0x7f6c100d07d0 2023-10-06T02:27:37.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.459+0000 7f6c176fb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1015e020 con 0x7f6c100d0400 2023-10-06T02:27:37.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.459+0000 7f6c15c98700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6c100d07d0 0x7f6c100b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.459+0000 7f6c15497700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c100d0400 0x7f6c100b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.459+0000 7f6c15c98700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6c100d07d0 0x7f6c100b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:45286/0 (socket says 172.21.15.6:45286) 2023-10-06T02:27:37.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.459+0000 7f6c14c96700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f6c100ccd40 0x7f6c100cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:37226/0 (socket says 172.21.15.6:37226) 2023-10-06T02:27:37.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.459+0000 7f6c15497700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c100d0400 0x7f6c100b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:52076/0 (socket says 172.21.15.6:52076) 2023-10-06T02:27:37.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.459+0000 7f6c15c98700 1 -- 172.21.15.6:0/1749000310 learned_addr learned my addr 172.21.15.6:0/1749000310 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:37.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.459+0000 7f6c15c98700 1 -- 172.21.15.6:0/1749000310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c100d0400 msgr2=0x7f6c100b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:37.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.459+0000 7f6c15c98700 1 --2- 172.21.15.6:0/1749000310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c100d0400 0x7f6c100b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.459+0000 7f6c15c98700 1 -- 172.21.15.6:0/1749000310 >> v1:172.21.15.175:6789/0 conn(0x7f6c100ccd40 legacy=0x7f6c100cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.459+0000 7f6c15c98700 1 -- 172.21.15.6:0/1749000310 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c100ceaa0 con 0x7f6c100d07d0 2023-10-06T02:27:37.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.459+0000 7f6c15c98700 1 --2- 172.21.15.6:0/1749000310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c100d07d0 0x7f6c100b3aa0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009f20 tx=0x7f6c00009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad9715f4fdeb7712 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.459+0000 7f6c0ffff700 1 -- 172.21.15.6:0/1749000310 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000e070 con 0x7f6c100d07d0 2023-10-06T02:27:37.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.460+0000 7f6c0ffff700 1 -- 172.21.15.6:0/1749000310 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0000b9d0 con 0x7f6c100d07d0 2023-10-06T02:27:37.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.460+0000 7f6c0ffff700 1 -- 172.21.15.6:0/1749000310 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c000092e0 con 0x7f6c100d07d0 2023-10-06T02:27:37.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.460+0000 7f6c176fb700 1 -- 172.21.15.6:0/1749000310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c100d07d0 msgr2=0x7f6c100b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.460+0000 7f6c176fb700 1 --2- 172.21.15.6:0/1749000310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c100d07d0 0x7f6c100b3aa0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009f20 tx=0x7f6c00009840 comp rx=0 tx=0).stop 2023-10-06T02:27:37.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.460+0000 7f6c176fb700 1 -- 172.21.15.6:0/1749000310 shutdown_connections 2023-10-06T02:27:37.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.460+0000 7f6c176fb700 1 --2- 172.21.15.6:0/1749000310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c100d07d0 0x7f6c100b3aa0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.460+0000 7f6c176fb700 1 --2- 172.21.15.6:0/1749000310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c100d0400 0x7f6c100b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.460+0000 7f6c176fb700 1 -- 172.21.15.6:0/1749000310 >> 172.21.15.6:0/1749000310 conn(0x7f6c1006a220 msgr2=0x7f6c1006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:37.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.460+0000 7f6c176fb700 1 -- 172.21.15.6:0/1749000310 shutdown_connections 2023-10-06T02:27:37.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.460+0000 7f6c176fb700 1 -- 172.21.15.6:0/1749000310 wait complete. 2023-10-06T02:27:37.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.461+0000 7f6c176fb700 1 Processor -- start 2023-10-06T02:27:37.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.461+0000 7f6c176fb700 1 -- start start 2023-10-06T02:27:37.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.462+0000 7f6c176fb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c100ccd40 0x7f6c100c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.462+0000 7f6c176fb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c100d0400 0x7f6c10159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.462+0000 7f6c176fb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c100d07d0 0x7f6c1015a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.462+0000 7f6c176fb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c100c51a0 con 0x7f6c100ccd40 2023-10-06T02:27:37.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.462+0000 7f6c176fb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c100cb910 con 0x7f6c100d07d0 2023-10-06T02:27:37.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.462+0000 7f6c176fb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c100c5440 con 0x7f6c100d0400 2023-10-06T02:27:37.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.462+0000 7f6c15497700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c100ccd40 0x7f6c100c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.462+0000 7f6c15497700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c100ccd40 0x7f6c100c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35170/0 (socket says 172.21.15.6:35170) 2023-10-06T02:27:37.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.462+0000 7f6c15497700 1 -- 172.21.15.6:0/2626653969 learned_addr learned my addr 172.21.15.6:0/2626653969 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:37.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.462+0000 7f6c15c98700 1 --2- 172.21.15.6:0/2626653969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c100d07d0 0x7f6c1015a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.462+0000 7f6c15497700 1 -- 172.21.15.6:0/2626653969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c100d0400 msgr2=0x7f6c10159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.462+0000 7f6c15497700 1 --2- 172.21.15.6:0/2626653969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c100d0400 0x7f6c10159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.462+0000 7f6c15497700 1 -- 172.21.15.6:0/2626653969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c100d07d0 msgr2=0x7f6c1015a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.462+0000 7f6c15497700 1 --2- 172.21.15.6:0/2626653969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c100d07d0 0x7f6c1015a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.462+0000 7f6c15497700 1 -- 172.21.15.6:0/2626653969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c00009ae0 con 0x7f6c100ccd40 2023-10-06T02:27:37.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.463+0000 7f6c15497700 1 --2- 172.21.15.6:0/2626653969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c100ccd40 0x7f6c100c8560 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800ec80 tx=0x7f6c08009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.463+0000 7f6c0d7fa700 1 -- 172.21.15.6:0/2626653969 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800c9d0 con 0x7f6c100ccd40 2023-10-06T02:27:37.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.463+0000 7f6c0d7fa700 1 -- 172.21.15.6:0/2626653969 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0800cb30 con 0x7f6c100ccd40 2023-10-06T02:27:37.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.463+0000 7f6c176fb700 1 -- 172.21.15.6:0/2626653969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c100c5720 con 0x7f6c100ccd40 2023-10-06T02:27:37.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.463+0000 7f6c0d7fa700 1 -- 172.21.15.6:0/2626653969 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c08013470 con 0x7f6c100ccd40 2023-10-06T02:27:37.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.463+0000 7f6c176fb700 1 -- 172.21.15.6:0/2626653969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c100c5ce0 con 0x7f6c100ccd40 2023-10-06T02:27:37.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.464+0000 7f6c176fb700 1 -- 172.21.15.6:0/2626653969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c10088760 con 0x7f6c100ccd40 2023-10-06T02:27:37.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.464+0000 7f6c0d7fa700 1 -- 172.21.15.6:0/2626653969 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c08013860 con 0x7f6c100ccd40 2023-10-06T02:27:37.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.465+0000 7f6c0d7fa700 1 --2- 172.21.15.6:0/2626653969 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6bfc066f30 0x7f6bfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.465+0000 7f6c0d7fa700 1 -- 172.21.15.6:0/2626653969 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f6c080857b0 con 0x7f6c100ccd40 2023-10-06T02:27:37.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.465+0000 7f6c14c96700 1 --2- 172.21.15.6:0/2626653969 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6bfc066f30 0x7f6bfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.465+0000 7f6c14c96700 1 --2- 172.21.15.6:0/2626653969 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6bfc066f30 0x7f6bfc0693e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6c1015ca10 tx=0x7f6c04007b30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.469+0000 7f6c0d7fa700 1 -- 172.21.15.6:0/2626653969 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c08051ee0 con 0x7f6c100ccd40 2023-10-06T02:27:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.712+0000 7f6c176fb700 1 -- 172.21.15.6:0/2626653969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f6c100ced80 con 0x7f6c100ccd40 2023-10-06T02:27:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.989+0000 7f6c0d7fa700 1 -- 172.21.15.6:0/2626653969 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v248) v1 ==== 162+0+0 (secure 0 0 0) 0x7f6c080210b0 con 0x7f6c100ccd40 2023-10-06T02:27:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.991+0000 7f6c176fb700 1 -- 172.21.15.6:0/2626653969 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6bfc066f30 msgr2=0x7f6bfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.991+0000 7f6c176fb700 1 --2- 172.21.15.6:0/2626653969 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6bfc066f30 0x7f6bfc0693e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6c1015ca10 tx=0x7f6c04007b30 comp rx=0 tx=0).stop 2023-10-06T02:27:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.991+0000 7f6c176fb700 1 -- 172.21.15.6:0/2626653969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c100ccd40 msgr2=0x7f6c100c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.991+0000 7f6c176fb700 1 --2- 172.21.15.6:0/2626653969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c100ccd40 0x7f6c100c8560 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800ec80 tx=0x7f6c08009120 comp rx=0 tx=0).stop 2023-10-06T02:27:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.991+0000 7f6c176fb700 1 -- 172.21.15.6:0/2626653969 shutdown_connections 2023-10-06T02:27:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.991+0000 7f6c176fb700 1 --2- 172.21.15.6:0/2626653969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c100d07d0 0x7f6c1015a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.991+0000 7f6c176fb700 1 --2- 172.21.15.6:0/2626653969 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6bfc066f30 0x7f6bfc0693e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.991+0000 7f6c176fb700 1 --2- 172.21.15.6:0/2626653969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c100ccd40 0x7f6c100c8560 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.991+0000 7f6c176fb700 1 --2- 172.21.15.6:0/2626653969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c100d0400 0x7f6c10159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.992+0000 7f6c176fb700 1 -- 172.21.15.6:0/2626653969 >> 172.21.15.6:0/2626653969 conn(0x7f6c1006a220 msgr2=0x7f6c101580d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.992+0000 7f6c176fb700 1 -- 172.21.15.6:0/2626653969 shutdown_connections 2023-10-06T02:27:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:37.992+0000 7f6c176fb700 1 -- 172.21.15.6:0/2626653969 wait complete. 2023-10-06T02:27:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:27:38.001 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:27:38.001+0000 7fa356cba700 -1 log_channel(cluster) log [ERR] : missing journal object 2023-10-06T02:27:38.002 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:38.001+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:27:38.002 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:38.001+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:27:38.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:38.011 INFO:tasks.ceph.mds.a.smithi006.stderr: -13> 2023-10-06T02:27:38.001+0000 7fa356cba700 -1 log_channel(cluster) log [ERR] : missing journal object 2023-10-06T02:27:38.033 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:27:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.131+0000 7fbcc94af700 1 Processor -- start 2023-10-06T02:27:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.131+0000 7fbcc94af700 1 -- start start 2023-10-06T02:27:38.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.132+0000 7fbcc94af700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbcc4159110 0x7fbcc406f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.132+0000 7fbcc94af700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbcc40ad690 0x7fbcc406f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.132+0000 7fbcc94af700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc40ac1f0 con 0x7fbcc40c8b30 2023-10-06T02:27:38.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.132+0000 7fbcc94af700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc4069ca0 con 0x7fbcc4159110 2023-10-06T02:27:38.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.132+0000 7fbcc94af700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc4069400 con 0x7fbcc40ad690 2023-10-06T02:27:38.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.132+0000 7fbcc2ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbcc4159110 0x7fbcc406f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.132+0000 7fbcc27fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbcc40c8b30 0x7fbcc415cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41624/0 (socket says 172.21.15.6:41624) 2023-10-06T02:27:38.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.132+0000 7fbcc27fc700 1 -- 172.21.15.6:0/2921022043 learned_addr learned my addr 172.21.15.6:0/2921022043 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:38.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.133+0000 7fbcc37fe700 1 --2- 172.21.15.6:0/2921022043 >> v2:172.21.15.175:3300/0 conn(0x7fbcc40ad690 0x7fbcc406f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.133+0000 7fbcc2ffd700 1 -- 172.21.15.6:0/2921022043 >> v2:172.21.15.175:3300/0 conn(0x7fbcc40ad690 msgr2=0x7fbcc406f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:38.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.133+0000 7fbcc2ffd700 1 --2- 172.21.15.6:0/2921022043 >> v2:172.21.15.175:3300/0 conn(0x7fbcc40ad690 0x7fbcc406f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.133+0000 7fbcc2ffd700 1 -- 172.21.15.6:0/2921022043 >> v1:172.21.15.6:6789/0 conn(0x7fbcc40c8b30 legacy=0x7fbcc415cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.133+0000 7fbcc2ffd700 1 -- 172.21.15.6:0/2921022043 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc40696e0 con 0x7fbcc4159110 2023-10-06T02:27:38.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.133+0000 7fbcc1ffb700 1 -- 172.21.15.6:0/2921022043 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897823809 0 0) 0x7fbcc40ac1f0 con 0x7fbcc40c8b30 2023-10-06T02:27:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.133+0000 7fbcc2ffd700 1 --2- 172.21.15.6:0/2921022043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcc4159110 0x7fbcc406f140 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4064080 tx=0x7fbcbc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568afa9f226d2e54 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.133+0000 7fbcc1ffb700 1 -- 172.21.15.6:0/2921022043 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc00e070 con 0x7fbcc4159110 2023-10-06T02:27:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.133+0000 7fbcc1ffb700 1 -- 172.21.15.6:0/2921022043 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcbc00bc30 con 0x7fbcc4159110 2023-10-06T02:27:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.133+0000 7fbcc1ffb700 1 -- 172.21.15.6:0/2921022043 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc012430 con 0x7fbcc4159110 2023-10-06T02:27:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.133+0000 7fbcc94af700 1 -- 172.21.15.6:0/2921022043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcc4159110 msgr2=0x7fbcc406f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.134+0000 7fbcc94af700 1 --2- 172.21.15.6:0/2921022043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcc4159110 0x7fbcc406f140 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4064080 tx=0x7fbcbc009780 comp rx=0 tx=0).stop 2023-10-06T02:27:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.134+0000 7fbcc94af700 1 -- 172.21.15.6:0/2921022043 shutdown_connections 2023-10-06T02:27:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.134+0000 7fbcc94af700 1 --2- 172.21.15.6:0/2921022043 >> v2:172.21.15.175:3300/0 conn(0x7fbcc40ad690 0x7fbcc406f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.134+0000 7fbcc94af700 1 --2- 172.21.15.6:0/2921022043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcc4159110 0x7fbcc406f140 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.134+0000 7fbcc94af700 1 -- 172.21.15.6:0/2921022043 >> 172.21.15.6:0/2921022043 conn(0x7fbcc40cd110 msgr2=0x7fbcc406ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:38.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.134+0000 7fbcc94af700 1 -- 172.21.15.6:0/2921022043 shutdown_connections 2023-10-06T02:27:38.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.134+0000 7fbcc94af700 1 -- 172.21.15.6:0/2921022043 wait complete. 2023-10-06T02:27:38.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.135+0000 7fbcc94af700 1 Processor -- start 2023-10-06T02:27:38.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.135+0000 7fbcc94af700 1 -- start start 2023-10-06T02:27:38.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.135+0000 7fbcc94af700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcc40ad690 0x7fbcc40c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc94af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcc40c8b30 0x7fbcc4154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc94af700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcc4159110 0x7fbcc40c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc94af700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc40c22a0 con 0x7fbcc40c8b30 2023-10-06T02:27:38.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc94af700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc40c9b00 con 0x7fbcc40ad690 2023-10-06T02:27:38.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc94af700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc40c39d0 con 0x7fbcc4159110 2023-10-06T02:27:38.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcc40c8b30 0x7fbcc4154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcc40c8b30 0x7fbcc4154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35214/0 (socket says 172.21.15.6:35214) 2023-10-06T02:27:38.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc27fc700 1 -- 172.21.15.6:0/2971593353 learned_addr learned my addr 172.21.15.6:0/2971593353 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:38.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc2ffd700 1 --2- 172.21.15.6:0/2971593353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcc40ad690 0x7fbcc40c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc37fe700 1 --2- 172.21.15.6:0/2971593353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcc4159110 0x7fbcc40c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc27fc700 1 -- 172.21.15.6:0/2971593353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcc4159110 msgr2=0x7fbcc40c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc27fc700 1 --2- 172.21.15.6:0/2971593353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcc4159110 0x7fbcc40c5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc27fc700 1 -- 172.21.15.6:0/2971593353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcc40ad690 msgr2=0x7fbcc40c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc27fc700 1 --2- 172.21.15.6:0/2971593353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcc40ad690 0x7fbcc40c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc27fc700 1 -- 172.21.15.6:0/2971593353 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc009a20 con 0x7fbcc40c8b30 2023-10-06T02:27:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc27fc700 1 --2- 172.21.15.6:0/2971593353 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcc40c8b30 0x7fbcc4154250 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00c810 tx=0x7fbcac007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcbaffd700 1 -- 172.21.15.6:0/2971593353 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac005c00 con 0x7fbcc40c8b30 2023-10-06T02:27:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcbaffd700 1 -- 172.21.15.6:0/2971593353 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac005d60 con 0x7fbcc40c8b30 2023-10-06T02:27:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc94af700 1 -- 172.21.15.6:0/2971593353 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc4154790 con 0x7fbcc40c8b30 2023-10-06T02:27:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcbaffd700 1 -- 172.21.15.6:0/2971593353 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac007300 con 0x7fbcc40c8b30 2023-10-06T02:27:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.136+0000 7fbcc94af700 1 -- 172.21.15.6:0/2971593353 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc40c9250 con 0x7fbcc40c8b30 2023-10-06T02:27:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.137+0000 7fbcc94af700 1 -- 172.21.15.6:0/2971593353 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc406d6b0 con 0x7fbcc40c8b30 2023-10-06T02:27:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.138+0000 7fbcbaffd700 1 -- 172.21.15.6:0/2971593353 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbcac01b3b0 con 0x7fbcc40c8b30 2023-10-06T02:27:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.138+0000 7fbcbaffd700 1 --2- 172.21.15.6:0/2971593353 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbca4066f30 0x7fbca40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.138+0000 7fbcbaffd700 1 -- 172.21.15.6:0/2971593353 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8614+0+0 (secure 0 0 0) 0x7fbcac084570 con 0x7fbcc40c8b30 2023-10-06T02:27:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.138+0000 7fbcc2ffd700 1 --2- 172.21.15.6:0/2971593353 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbca4066f30 0x7fbca40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.139+0000 7fbcc2ffd700 1 --2- 172.21.15.6:0/2971593353 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbca4066f30 0x7fbca40693e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4064080 tx=0x7fbcbc019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:38.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.142+0000 7fbcbaffd700 1 -- 172.21.15.6:0/2971593353 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbcac050c40 con 0x7fbcc40c8b30 2023-10-06T02:27:38.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.379+0000 7fbcc94af700 1 -- 172.21.15.6:0/2971593353 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbcc40c9c40 con 0x7fbcc40c8b30 2023-10-06T02:27:38.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.380+0000 7fbcbaffd700 1 -- 172.21.15.6:0/2971593353 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 250 v250) v1 ==== 95+0+3840 (secure 0 0 0) 0x7fbcac017070 con 0x7fbcc40c8b30 2023-10-06T02:27:38.381 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:38.381 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":250,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":250,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:38.002516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.382+0000 7fbcc94af700 1 -- 172.21.15.6:0/2971593353 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbca4066f30 msgr2=0x7fbca40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.382+0000 7fbcc94af700 1 --2- 172.21.15.6:0/2971593353 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbca4066f30 0x7fbca40693e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4064080 tx=0x7fbcbc019000 comp rx=0 tx=0).stop 2023-10-06T02:27:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.382+0000 7fbcc94af700 1 -- 172.21.15.6:0/2971593353 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcc40c8b30 msgr2=0x7fbcc4154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.382+0000 7fbcc94af700 1 --2- 172.21.15.6:0/2971593353 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcc40c8b30 0x7fbcc4154250 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00c810 tx=0x7fbcac007db0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.382+0000 7fbcc94af700 1 -- 172.21.15.6:0/2971593353 shutdown_connections 2023-10-06T02:27:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.382+0000 7fbcc94af700 1 --2- 172.21.15.6:0/2971593353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcc4159110 0x7fbcc40c5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.382+0000 7fbcc94af700 1 --2- 172.21.15.6:0/2971593353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcc40ad690 0x7fbcc40c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.382+0000 7fbcc94af700 1 --2- 172.21.15.6:0/2971593353 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbca4066f30 0x7fbca40693e0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.382+0000 7fbcc94af700 1 --2- 172.21.15.6:0/2971593353 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcc40c8b30 0x7fbcc4154250 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.382+0000 7fbcc94af700 1 -- 172.21.15.6:0/2971593353 >> 172.21.15.6:0/2971593353 conn(0x7fbcc40cd110 msgr2=0x7fbcc40a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.382+0000 7fbcc94af700 1 -- 172.21.15.6:0/2971593353 shutdown_connections 2023-10-06T02:27:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.382+0000 7fbcc94af700 1 -- 172.21.15.6:0/2971593353 wait complete. 2023-10-06T02:27:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 250 2023-10-06T02:27:38.394 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:27:38.395 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.552+0000 7f4c92dd9700 1 Processor -- start 2023-10-06T02:27:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.552+0000 7f4c92dd9700 1 -- start start 2023-10-06T02:27:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.553+0000 7f4c92dd9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c8c159380 0x7f4c8c159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.553+0000 7f4c92dd9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4c8c0b20e0 0x7f4c8c0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.553+0000 7f4c92dd9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8c0cb6c0 con 0x7f4c8c15d4d0 2023-10-06T02:27:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.553+0000 7f4c92dd9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c8c15e200 con 0x7f4c8c0b20e0 2023-10-06T02:27:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.553+0000 7f4c92dd9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c0ccb60 con 0x7f4c8c159380 2023-10-06T02:27:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.553+0000 7f4c8bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4c8c0b20e0 0x7f4c8c0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.553+0000 7f4c8bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4c8c0b20e0 0x7f4c8c0b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35228/0 (socket says 172.21.15.6:35228) 2023-10-06T02:27:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.553+0000 7f4c8bfff700 1 -- 172.21.15.6:0/3684786435 learned_addr learned my addr 172.21.15.6:0/3684786435 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.553+0000 7f4c91376700 1 --1- 172.21.15.6:0/3684786435 >> v1:172.21.15.6:6789/0 conn(0x7f4c8c15d4d0 0x7f4c8c15d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41628/0 (socket says 172.21.15.6:41628) 2023-10-06T02:27:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.554+0000 7f4c90b75700 1 --2- 172.21.15.6:0/3684786435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c8c159380 0x7f4c8c159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.554+0000 7f4c8bfff700 1 -- 172.21.15.6:0/3684786435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c8c159380 msgr2=0x7f4c8c159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.554+0000 7f4c8bfff700 1 --2- 172.21.15.6:0/3684786435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c8c159380 0x7f4c8c159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.554+0000 7f4c8bfff700 1 -- 172.21.15.6:0/3684786435 >> v1:172.21.15.6:6789/0 conn(0x7f4c8c15d4d0 legacy=0x7f4c8c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.554+0000 7f4c8b7fe700 1 -- 172.21.15.6:0/3684786435 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279838482 0 0) 0x7f4c8c0cb6c0 con 0x7f4c8c15d4d0 2023-10-06T02:27:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.554+0000 7f4c8bfff700 1 -- 172.21.15.6:0/3684786435 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c0c3ef0 con 0x7f4c8c0b20e0 2023-10-06T02:27:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.554+0000 7f4c90b75700 1 --2- 172.21.15.6:0/3684786435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c8c159380 0x7f4c8c159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.554+0000 7f4c8bfff700 1 --2- 172.21.15.6:0/3684786435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8c0b20e0 0x7f4c8c0b2530 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c009f20 tx=0x7f4c7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3cbacb9325d791 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.554+0000 7f4c8b7fe700 1 -- 172.21.15.6:0/3684786435 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c00e070 con 0x7f4c8c0b20e0 2023-10-06T02:27:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.554+0000 7f4c8b7fe700 1 -- 172.21.15.6:0/3684786435 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7c00ba80 con 0x7f4c8c0b20e0 2023-10-06T02:27:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.554+0000 7f4c8b7fe700 1 -- 172.21.15.6:0/3684786435 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c0092e0 con 0x7f4c8c0b20e0 2023-10-06T02:27:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.555+0000 7f4c92dd9700 1 -- 172.21.15.6:0/3684786435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8c0b20e0 msgr2=0x7f4c8c0b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.555+0000 7f4c92dd9700 1 --2- 172.21.15.6:0/3684786435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8c0b20e0 0x7f4c8c0b2530 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c009f20 tx=0x7f4c7c009840 comp rx=0 tx=0).stop 2023-10-06T02:27:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.555+0000 7f4c92dd9700 1 -- 172.21.15.6:0/3684786435 shutdown_connections 2023-10-06T02:27:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.555+0000 7f4c92dd9700 1 --2- 172.21.15.6:0/3684786435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c8c159380 0x7f4c8c159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.555+0000 7f4c92dd9700 1 --2- 172.21.15.6:0/3684786435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8c0b20e0 0x7f4c8c0b2530 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.555+0000 7f4c92dd9700 1 -- 172.21.15.6:0/3684786435 >> 172.21.15.6:0/3684786435 conn(0x7f4c8c068680 msgr2=0x7f4c8c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.555+0000 7f4c92dd9700 1 -- 172.21.15.6:0/3684786435 shutdown_connections 2023-10-06T02:27:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.555+0000 7f4c92dd9700 1 -- 172.21.15.6:0/3684786435 wait complete. 2023-10-06T02:27:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.556+0000 7f4c92dd9700 1 Processor -- start 2023-10-06T02:27:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.556+0000 7f4c92dd9700 1 -- start start 2023-10-06T02:27:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.557+0000 7f4c92dd9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c8c0b20e0 0x7f4c8c0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.557+0000 7f4c92dd9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8c159380 0x7f4c8c16e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.557+0000 7f4c92dd9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c8c15d4d0 0x7f4c8c0d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.557+0000 7f4c92dd9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c0d0f30 con 0x7f4c8c159380 2023-10-06T02:27:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.557+0000 7f4c92dd9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c0cecc0 con 0x7f4c8c15d4d0 2023-10-06T02:27:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.557+0000 7f4c92dd9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c0ce390 con 0x7f4c8c0b20e0 2023-10-06T02:27:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.557+0000 7f4c8bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8c159380 0x7f4c8c16e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.557+0000 7f4c8bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8c159380 0x7f4c8c16e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35234/0 (socket says 172.21.15.6:35234) 2023-10-06T02:27:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.557+0000 7f4c8bfff700 1 -- 172.21.15.6:0/2467084210 learned_addr learned my addr 172.21.15.6:0/2467084210 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.557+0000 7f4c90b75700 1 --2- 172.21.15.6:0/2467084210 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c8c0b20e0 0x7f4c8c0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.557+0000 7f4c91376700 1 --2- 172.21.15.6:0/2467084210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c8c15d4d0 0x7f4c8c0d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.557+0000 7f4c8bfff700 1 -- 172.21.15.6:0/2467084210 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c8c0b20e0 msgr2=0x7f4c8c0cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.557+0000 7f4c8bfff700 1 --2- 172.21.15.6:0/2467084210 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c8c0b20e0 0x7f4c8c0cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.557+0000 7f4c8bfff700 1 -- 172.21.15.6:0/2467084210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c8c15d4d0 msgr2=0x7f4c8c0d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.557+0000 7f4c8bfff700 1 --2- 172.21.15.6:0/2467084210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c8c15d4d0 0x7f4c8c0d06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.557+0000 7f4c8bfff700 1 -- 172.21.15.6:0/2467084210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c009ae0 con 0x7f4c8c159380 2023-10-06T02:27:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.557+0000 7f4c8bfff700 1 --2- 172.21.15.6:0/2467084210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8c159380 0x7f4c8c16e060 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00b6c0 tx=0x7f4c7c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.558+0000 7f4c88ff9700 1 -- 172.21.15.6:0/2467084210 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c007820 con 0x7f4c8c159380 2023-10-06T02:27:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.558+0000 7f4c88ff9700 1 -- 172.21.15.6:0/2467084210 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7c0079c0 con 0x7f4c8c159380 2023-10-06T02:27:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.558+0000 7f4c88ff9700 1 -- 172.21.15.6:0/2467084210 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c007d80 con 0x7f4c8c159380 2023-10-06T02:27:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.558+0000 7f4c92dd9700 1 -- 172.21.15.6:0/2467084210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8c0ce670 con 0x7f4c8c159380 2023-10-06T02:27:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.558+0000 7f4c92dd9700 1 -- 172.21.15.6:0/2467084210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8c0d0c20 con 0x7f4c8c159380 2023-10-06T02:27:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.559+0000 7f4c92dd9700 1 -- 172.21.15.6:0/2467084210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c8c088aa0 con 0x7f4c8c159380 2023-10-06T02:27:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.559+0000 7f4c88ff9700 1 -- 172.21.15.6:0/2467084210 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c7c01c410 con 0x7f4c8c159380 2023-10-06T02:27:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.559+0000 7f4c88ff9700 1 --2- 172.21.15.6:0/2467084210 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c6c066f30 0x7f4c6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.560+0000 7f4c88ff9700 1 -- 172.21.15.6:0/2467084210 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8614+0+0 (secure 0 0 0) 0x7f4c7c086a00 con 0x7f4c8c159380 2023-10-06T02:27:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.560+0000 7f4c90b75700 1 --2- 172.21.15.6:0/2467084210 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c6c066f30 0x7f4c6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.560+0000 7f4c90b75700 1 --2- 172.21.15.6:0/2467084210 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c6c066f30 0x7f4c6c0693e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f4c84006f00 tx=0x7f4c84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:38.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.564+0000 7f4c88ff9700 1 -- 172.21.15.6:0/2467084210 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c7c0530d0 con 0x7f4c8c159380 2023-10-06T02:27:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.806+0000 7f4c92dd9700 1 -- 172.21.15.6:0/2467084210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c8c0cad90 con 0x7f4c8c159380 2023-10-06T02:27:38.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.806+0000 7f4c88ff9700 1 -- 172.21.15.6:0/2467084210 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 250 v250) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f4c7c0566f0 con 0x7f4c8c159380 2023-10-06T02:27:38.807 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:38.808 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":250,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":250,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:38.002516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:38.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.809+0000 7f4c92dd9700 1 -- 172.21.15.6:0/2467084210 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c6c066f30 msgr2=0x7f4c6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.809+0000 7f4c92dd9700 1 --2- 172.21.15.6:0/2467084210 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c6c066f30 0x7f4c6c0693e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f4c84006f00 tx=0x7f4c84008040 comp rx=0 tx=0).stop 2023-10-06T02:27:38.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.809+0000 7f4c92dd9700 1 -- 172.21.15.6:0/2467084210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8c159380 msgr2=0x7f4c8c16e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.809+0000 7f4c92dd9700 1 --2- 172.21.15.6:0/2467084210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8c159380 0x7f4c8c16e060 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00b6c0 tx=0x7f4c7c018000 comp rx=0 tx=0).stop 2023-10-06T02:27:38.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.809+0000 7f4c92dd9700 1 -- 172.21.15.6:0/2467084210 shutdown_connections 2023-10-06T02:27:38.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.809+0000 7f4c92dd9700 1 --2- 172.21.15.6:0/2467084210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c8c15d4d0 0x7f4c8c0d06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.809+0000 7f4c92dd9700 1 --2- 172.21.15.6:0/2467084210 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c8c0b20e0 0x7f4c8c0cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.809+0000 7f4c92dd9700 1 --2- 172.21.15.6:0/2467084210 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4c6c066f30 0x7f4c6c0693e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.809+0000 7f4c92dd9700 1 --2- 172.21.15.6:0/2467084210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8c159380 0x7f4c8c16e060 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.809+0000 7f4c92dd9700 1 -- 172.21.15.6:0/2467084210 >> 172.21.15.6:0/2467084210 conn(0x7f4c8c068680 msgr2=0x7f4c8c0cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:38.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.809+0000 7f4c92dd9700 1 -- 172.21.15.6:0/2467084210 shutdown_connections 2023-10-06T02:27:38.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.809+0000 7f4c92dd9700 1 -- 172.21.15.6:0/2467084210 wait complete. 2023-10-06T02:27:38.811 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 250 2023-10-06T02:27:38.821 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:27:38.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:38.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.939+0000 7fef5a836700 1 Processor -- start 2023-10-06T02:27:38.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.939+0000 7fef5a836700 1 -- start start 2023-10-06T02:27:38.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.940+0000 7fef5a836700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef540af4e0 0x7fef540b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.940+0000 7fef5a836700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef5415db70 0x7fef540b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.940+0000 7fef5a836700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5415e190 con 0x7fef540af8b0 2023-10-06T02:27:38.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.940+0000 7fef5a836700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef540b1910 con 0x7fef5415db70 2023-10-06T02:27:38.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.940+0000 7fef5a836700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5415dfb0 con 0x7fef540af4e0 2023-10-06T02:27:38.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.940+0000 7fef58dd3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef5415db70 0x7fef540b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.940+0000 7fef58dd3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef5415db70 0x7fef540b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42132/0 (socket says 172.21.15.6:42132) 2023-10-06T02:27:38.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.940+0000 7fef58dd3700 1 -- 172.21.15.6:0/1398505093 learned_addr learned my addr 172.21.15.6:0/1398505093 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:38.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.941+0000 7fef53fff700 1 --2- 172.21.15.6:0/1398505093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef540af4e0 0x7fef540b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.941+0000 7fef58dd3700 1 -- 172.21.15.6:0/1398505093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef540af4e0 msgr2=0x7fef540b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:38.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.941+0000 7fef58dd3700 1 --2- 172.21.15.6:0/1398505093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef540af4e0 0x7fef540b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.941+0000 7fef58dd3700 1 -- 172.21.15.6:0/1398505093 >> v1:172.21.15.175:6789/0 conn(0x7fef540af8b0 legacy=0x7fef5415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:38.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.941+0000 7fef58dd3700 1 -- 172.21.15.6:0/1398505093 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef540cb650 con 0x7fef5415db70 2023-10-06T02:27:38.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.941+0000 7fef58dd3700 1 --2- 172.21.15.6:0/1398505093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef5415db70 0x7fef540b2620 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009f20 tx=0x7fef4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce40c988c6120a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:38.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.941+0000 7fef52ffd700 1 -- 172.21.15.6:0/1398505093 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c00e070 con 0x7fef5415db70 2023-10-06T02:27:38.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.941+0000 7fef52ffd700 1 -- 172.21.15.6:0/1398505093 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c00ba80 con 0x7fef5415db70 2023-10-06T02:27:38.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.941+0000 7fef52ffd700 1 -- 172.21.15.6:0/1398505093 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0092e0 con 0x7fef5415db70 2023-10-06T02:27:38.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.941+0000 7fef5a836700 1 -- 172.21.15.6:0/1398505093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef5415db70 msgr2=0x7fef540b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.942+0000 7fef5a836700 1 --2- 172.21.15.6:0/1398505093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef5415db70 0x7fef540b2620 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009f20 tx=0x7fef4c009840 comp rx=0 tx=0).stop 2023-10-06T02:27:38.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.942+0000 7fef5a836700 1 -- 172.21.15.6:0/1398505093 shutdown_connections 2023-10-06T02:27:38.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.942+0000 7fef5a836700 1 --2- 172.21.15.6:0/1398505093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef5415db70 0x7fef540b2620 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.942+0000 7fef5a836700 1 --2- 172.21.15.6:0/1398505093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef540af4e0 0x7fef540b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.942+0000 7fef5a836700 1 -- 172.21.15.6:0/1398505093 >> 172.21.15.6:0/1398505093 conn(0x7fef54068680 msgr2=0x7fef54068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:38.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.942+0000 7fef5a836700 1 -- 172.21.15.6:0/1398505093 shutdown_connections 2023-10-06T02:27:38.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.942+0000 7fef5a836700 1 -- 172.21.15.6:0/1398505093 wait complete. 2023-10-06T02:27:38.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.943+0000 7fef5a836700 1 Processor -- start 2023-10-06T02:27:38.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.943+0000 7fef5a836700 1 -- start start 2023-10-06T02:27:38.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef5a836700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef540af4e0 0x7fef54151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef5a836700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef540af8b0 0x7fef541500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef5a836700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef5415db70 0x7fef5415c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef5a836700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef540c9510 con 0x7fef540af8b0 2023-10-06T02:27:38.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef5a836700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef540c97f0 con 0x7fef540af4e0 2023-10-06T02:27:38.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef5a836700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef540c9ad0 con 0x7fef5415db70 2023-10-06T02:27:38.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef540af8b0 0x7fef541500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef540af8b0 0x7fef541500c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42148/0 (socket says 172.21.15.6:42148) 2023-10-06T02:27:38.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef537fe700 1 -- 172.21.15.6:0/4029644113 learned_addr learned my addr 172.21.15.6:0/4029644113 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:38.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef58dd3700 1 --2- 172.21.15.6:0/4029644113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef5415db70 0x7fef5415c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef53fff700 1 --2- 172.21.15.6:0/4029644113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef540af4e0 0x7fef54151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef537fe700 1 -- 172.21.15.6:0/4029644113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef5415db70 msgr2=0x7fef5415c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef537fe700 1 --2- 172.21.15.6:0/4029644113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef5415db70 0x7fef5415c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef537fe700 1 -- 172.21.15.6:0/4029644113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef540af4e0 msgr2=0x7fef54151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef537fe700 1 --2- 172.21.15.6:0/4029644113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef540af4e0 0x7fef54151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef537fe700 1 -- 172.21.15.6:0/4029644113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c009ae0 con 0x7fef540af8b0 2023-10-06T02:27:38.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef58dd3700 1 --2- 172.21.15.6:0/4029644113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef5415db70 0x7fef5415c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:38.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef53fff700 1 --2- 172.21.15.6:0/4029644113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef540af4e0 0x7fef54151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:38.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.944+0000 7fef537fe700 1 --2- 172.21.15.6:0/4029644113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef540af8b0 0x7fef541500c0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fef4800c590 tx=0x7fef4800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:38.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.945+0000 7fef3bfff700 1 -- 172.21.15.6:0/4029644113 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48011590 con 0x7fef540af8b0 2023-10-06T02:27:38.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.945+0000 7fef3bfff700 1 -- 172.21.15.6:0/4029644113 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef480116f0 con 0x7fef540af8b0 2023-10-06T02:27:38.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.945+0000 7fef3bfff700 1 -- 172.21.15.6:0/4029644113 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48011ab0 con 0x7fef540af8b0 2023-10-06T02:27:38.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.945+0000 7fef5a836700 1 -- 172.21.15.6:0/4029644113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef540c9db0 con 0x7fef540af8b0 2023-10-06T02:27:38.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.945+0000 7fef5a836700 1 -- 172.21.15.6:0/4029644113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef54150600 con 0x7fef540af8b0 2023-10-06T02:27:38.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.945+0000 7fef5a836700 1 -- 172.21.15.6:0/4029644113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef540c82d0 con 0x7fef540af8b0 2023-10-06T02:27:38.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.946+0000 7fef3bfff700 1 -- 172.21.15.6:0/4029644113 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef4801b3b0 con 0x7fef540af8b0 2023-10-06T02:27:38.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.946+0000 7fef3bfff700 1 --2- 172.21.15.6:0/4029644113 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fef40066f30 0x7fef400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.946+0000 7fef3bfff700 1 -- 172.21.15.6:0/4029644113 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8614+0+0 (secure 0 0 0) 0x7fef48084680 con 0x7fef540af8b0 2023-10-06T02:27:38.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.947+0000 7fef53fff700 1 --2- 172.21.15.6:0/4029644113 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fef40066f30 0x7fef400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.947+0000 7fef53fff700 1 --2- 172.21.15.6:0/4029644113 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fef40066f30 0x7fef400693e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fef44009990 tx=0x7fef44008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:38.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:38.950+0000 7fef3bfff700 1 -- 172.21.15.6:0/4029644113 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef540c82d0 con 0x7fef540af8b0 2023-10-06T02:27:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.191+0000 7fef5a836700 1 -- 172.21.15.6:0/4029644113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef540c82d0 con 0x7fef540af8b0 2023-10-06T02:27:39.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.191+0000 7fef3bfff700 1 -- 172.21.15.6:0/4029644113 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 251 v251) v1 ==== 95+0+4595 (secure 0 0 0) 0x7fef540c82d0 con 0x7fef540af8b0 2023-10-06T02:27:39.192 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:39.192 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":251,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9597,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/4129427704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":4129427704},{"type":"v1","addr":"172.21.15.6:6835","nonce":4129427704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":251}],"filesystems":[{"mdsmap":{"epoch":250,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:38.002516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:39.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.193+0000 7fef5a836700 1 -- 172.21.15.6:0/4029644113 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fef40066f30 msgr2=0x7fef400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.193+0000 7fef5a836700 1 --2- 172.21.15.6:0/4029644113 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fef40066f30 0x7fef400693e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fef44009990 tx=0x7fef44008040 comp rx=0 tx=0).stop 2023-10-06T02:27:39.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.193+0000 7fef5a836700 1 -- 172.21.15.6:0/4029644113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef540af8b0 msgr2=0x7fef541500c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.193+0000 7fef5a836700 1 --2- 172.21.15.6:0/4029644113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef540af8b0 0x7fef541500c0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fef4800c590 tx=0x7fef4800c950 comp rx=0 tx=0).stop 2023-10-06T02:27:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.193+0000 7fef5a836700 1 -- 172.21.15.6:0/4029644113 shutdown_connections 2023-10-06T02:27:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.193+0000 7fef5a836700 1 --2- 172.21.15.6:0/4029644113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef5415db70 0x7fef5415c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.193+0000 7fef5a836700 1 --2- 172.21.15.6:0/4029644113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef540af4e0 0x7fef54151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.193+0000 7fef5a836700 1 --2- 172.21.15.6:0/4029644113 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fef40066f30 0x7fef400693e0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.193+0000 7fef5a836700 1 --2- 172.21.15.6:0/4029644113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef540af8b0 0x7fef541500c0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.194+0000 7fef5a836700 1 -- 172.21.15.6:0/4029644113 >> 172.21.15.6:0/4029644113 conn(0x7fef54068680 msgr2=0x7fef541517f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.194+0000 7fef5a836700 1 -- 172.21.15.6:0/4029644113 shutdown_connections 2023-10-06T02:27:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.194+0000 7fef5a836700 1 -- 172.21.15.6:0/4029644113 wait complete. 2023-10-06T02:27:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 251 2023-10-06T02:27:39.206 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 200.00000001' led to DAMAGED state 2023-10-06T02:27:39.206 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 500.00000000' 2023-10-06T02:27:39.206 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:39.206 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:27:39.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:39.207 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:27:39.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:27:39.221 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:27:39.222 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:27:39.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.381+0000 7f1cb230f700 1 Processor -- start 2023-10-06T02:27:39.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.381+0000 7f1cb230f700 1 -- start start 2023-10-06T02:27:39.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.382+0000 7f1cb230f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1cac159660 0x7f1cac0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.382+0000 7f1cb230f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1cac0cd7c0 0x7f1cac086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.382+0000 7f1cb230f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cac0cf2c0 con 0x7f1cac087530 2023-10-06T02:27:39.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.382+0000 7f1cb230f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cac087950 con 0x7f1cac0cd7c0 2023-10-06T02:27:39.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.382+0000 7f1cb230f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cac0ce6b0 con 0x7f1cac159660 2023-10-06T02:27:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.382+0000 7f1cb0b0c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1cac0cd7c0 0x7f1cac086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.382+0000 7f1cb0b0c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1cac0cd7c0 0x7f1cac086ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42164/0 (socket says 172.21.15.6:42164) 2023-10-06T02:27:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.382+0000 7f1cb0b0c700 1 -- 172.21.15.6:0/1861731148 learned_addr learned my addr 172.21.15.6:0/1861731148 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.382+0000 7f1cb130d700 1 --2- 172.21.15.6:0/1861731148 >> v2:172.21.15.175:3300/0 conn(0x7f1cac159660 0x7f1cac0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.382+0000 7f1cb0b0c700 1 -- 172.21.15.6:0/1861731148 >> v2:172.21.15.175:3300/0 conn(0x7f1cac159660 msgr2=0x7f1cac0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.382+0000 7f1cb0b0c700 1 --2- 172.21.15.6:0/1861731148 >> v2:172.21.15.175:3300/0 conn(0x7f1cac159660 0x7f1cac0cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.382+0000 7f1cb0b0c700 1 -- 172.21.15.6:0/1861731148 >> v1:172.21.15.175:6789/0 conn(0x7f1cac087530 legacy=0x7f1cac15d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.382+0000 7f1cb0b0c700 1 -- 172.21.15.6:0/1861731148 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac0ce990 con 0x7f1cac0cd7c0 2023-10-06T02:27:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.382+0000 7f1cb0b0c700 1 --2- 172.21.15.6:0/1861731148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac0cd7c0 0x7f1cac086ff0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f1cac089400 tx=0x7f1c9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1815743df0afae47 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.383+0000 7f1ca3fff700 1 -- 172.21.15.6:0/1861731148 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c00b860 con 0x7f1cac0cd7c0 2023-10-06T02:27:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.383+0000 7f1ca3fff700 1 -- 172.21.15.6:0/1861731148 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c00b9c0 con 0x7f1cac0cd7c0 2023-10-06T02:27:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.383+0000 7f1ca3fff700 1 -- 172.21.15.6:0/1861731148 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c00bd60 con 0x7f1cac0cd7c0 2023-10-06T02:27:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.383+0000 7f1cb230f700 1 -- 172.21.15.6:0/1861731148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac0cd7c0 msgr2=0x7f1cac086ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.383+0000 7f1cb230f700 1 --2- 172.21.15.6:0/1861731148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac0cd7c0 0x7f1cac086ff0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f1cac089400 tx=0x7f1c9c009250 comp rx=0 tx=0).stop 2023-10-06T02:27:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.383+0000 7f1cb230f700 1 -- 172.21.15.6:0/1861731148 shutdown_connections 2023-10-06T02:27:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.383+0000 7f1cb230f700 1 --2- 172.21.15.6:0/1861731148 >> v2:172.21.15.175:3300/0 conn(0x7f1cac159660 0x7f1cac0cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.383+0000 7f1cb230f700 1 --2- 172.21.15.6:0/1861731148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac0cd7c0 0x7f1cac086ff0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.383+0000 7f1cb230f700 1 -- 172.21.15.6:0/1861731148 >> 172.21.15.6:0/1861731148 conn(0x7f1cac0d0c40 msgr2=0x7f1cac0ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.383+0000 7f1cb230f700 1 -- 172.21.15.6:0/1861731148 shutdown_connections 2023-10-06T02:27:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.383+0000 7f1cb230f700 1 -- 172.21.15.6:0/1861731148 wait complete. 2023-10-06T02:27:39.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.384+0000 7f1cb230f700 1 Processor -- start 2023-10-06T02:27:39.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.384+0000 7f1cb230f700 1 -- start start 2023-10-06T02:27:39.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.385+0000 7f1cb230f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cac087530 0x7f1cac148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.385+0000 7f1cb230f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac0cd7c0 0x7f1cac15a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.385+0000 7f1cb230f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cac159660 0x7f1cac15bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.385+0000 7f1cb230f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac0c7350 con 0x7f1cac0cd7c0 2023-10-06T02:27:39.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.385+0000 7f1cb230f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac15ad00 con 0x7f1cac159660 2023-10-06T02:27:39.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.385+0000 7f1cb230f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac15afe0 con 0x7f1cac087530 2023-10-06T02:27:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.385+0000 7f1cb0b0c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac0cd7c0 0x7f1cac15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.385+0000 7f1cb0b0c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac0cd7c0 0x7f1cac15a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42166/0 (socket says 172.21.15.6:42166) 2023-10-06T02:27:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.385+0000 7f1cb0b0c700 1 -- 172.21.15.6:0/984861520 learned_addr learned my addr 172.21.15.6:0/984861520 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.386+0000 7f1cb130d700 1 --2- 172.21.15.6:0/984861520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cac087530 0x7f1cac148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.386+0000 7f1cb1b0e700 1 --2- 172.21.15.6:0/984861520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cac159660 0x7f1cac15bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.386+0000 7f1cb0b0c700 1 -- 172.21.15.6:0/984861520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cac087530 msgr2=0x7f1cac148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.386+0000 7f1cb0b0c700 1 --2- 172.21.15.6:0/984861520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cac087530 0x7f1cac148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.386+0000 7f1cb0b0c700 1 -- 172.21.15.6:0/984861520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cac159660 msgr2=0x7f1cac15bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.386+0000 7f1cb0b0c700 1 --2- 172.21.15.6:0/984861520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cac159660 0x7f1cac15bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.386+0000 7f1cb0b0c700 1 -- 172.21.15.6:0/984861520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c0094f0 con 0x7f1cac0cd7c0 2023-10-06T02:27:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.386+0000 7f1cb1b0e700 1 --2- 172.21.15.6:0/984861520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cac159660 0x7f1cac15bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.386+0000 7f1cb0b0c700 1 --2- 172.21.15.6:0/984861520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac0cd7c0 0x7f1cac15a440 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f1cac065030 tx=0x7f1c9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.386+0000 7f1ca17fa700 1 -- 172.21.15.6:0/984861520 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c011e60 con 0x7f1cac0cd7c0 2023-10-06T02:27:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.386+0000 7f1ca17fa700 1 -- 172.21.15.6:0/984861520 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c01a630 con 0x7f1cac0cd7c0 2023-10-06T02:27:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.386+0000 7f1cb230f700 1 -- 172.21.15.6:0/984861520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cac15b2c0 con 0x7f1cac0cd7c0 2023-10-06T02:27:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.386+0000 7f1ca17fa700 1 -- 172.21.15.6:0/984861520 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c01a9f0 con 0x7f1cac0cd7c0 2023-10-06T02:27:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.386+0000 7f1cb230f700 1 -- 172.21.15.6:0/984861520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cac149300 con 0x7f1cac0cd7c0 2023-10-06T02:27:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.387+0000 7f1cb230f700 1 -- 172.21.15.6:0/984861520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cac0c74c0 con 0x7f1cac0cd7c0 2023-10-06T02:27:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.387+0000 7f1ca17fa700 1 -- 172.21.15.6:0/984861520 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c9c02d440 con 0x7f1cac0cd7c0 2023-10-06T02:27:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.388+0000 7f1ca17fa700 1 --2- 172.21.15.6:0/984861520 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c90066f30 0x7f1c900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.388+0000 7f1ca17fa700 1 -- 172.21.15.6:0/984861520 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8614+0+0 (secure 0 0 0) 0x7f1c9c086c80 con 0x7f1cac0cd7c0 2023-10-06T02:27:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.388+0000 7f1cb130d700 1 --2- 172.21.15.6:0/984861520 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c90066f30 0x7f1c900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.388+0000 7f1cb130d700 1 --2- 172.21.15.6:0/984861520 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c90066f30 0x7f1c900693e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8006fd0 tx=0x7f1ca8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.392+0000 7f1ca17fa700 1 -- 172.21.15.6:0/984861520 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c9c053350 con 0x7f1cac0cd7c0 2023-10-06T02:27:39.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:39.628+0000 7f1cb230f700 1 -- 172.21.15.6:0/984861520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1cac0cec70 con 0x7f1cac0cd7c0 2023-10-06T02:27:40.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.018+0000 7f1ca17fa700 1 -- 172.21.15.6:0/984861520 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v252) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1c9c015090 con 0x7f1cac0cd7c0 2023-10-06T02:27:40.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.020+0000 7f1cb230f700 1 -- 172.21.15.6:0/984861520 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c90066f30 msgr2=0x7f1c900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.020+0000 7f1cb230f700 1 --2- 172.21.15.6:0/984861520 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c90066f30 0x7f1c900693e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8006fd0 tx=0x7f1ca8008040 comp rx=0 tx=0).stop 2023-10-06T02:27:40.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.020+0000 7f1cb230f700 1 -- 172.21.15.6:0/984861520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac0cd7c0 msgr2=0x7f1cac15a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.020+0000 7f1cb230f700 1 --2- 172.21.15.6:0/984861520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac0cd7c0 0x7f1cac15a440 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f1cac065030 tx=0x7f1c9c017000 comp rx=0 tx=0).stop 2023-10-06T02:27:40.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.020+0000 7f1cb230f700 1 -- 172.21.15.6:0/984861520 shutdown_connections 2023-10-06T02:27:40.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.020+0000 7f1cb230f700 1 --2- 172.21.15.6:0/984861520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cac159660 0x7f1cac15bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.020+0000 7f1cb230f700 1 --2- 172.21.15.6:0/984861520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1cac087530 0x7f1cac148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.020+0000 7f1cb230f700 1 --2- 172.21.15.6:0/984861520 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1c90066f30 0x7f1c900693e0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.020+0000 7f1cb230f700 1 --2- 172.21.15.6:0/984861520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac0cd7c0 0x7f1cac15a440 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.020+0000 7f1cb230f700 1 -- 172.21.15.6:0/984861520 >> 172.21.15.6:0/984861520 conn(0x7f1cac0d0c40 msgr2=0x7f1cac0afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:40.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.020+0000 7f1cb230f700 1 -- 172.21.15.6:0/984861520 shutdown_connections 2023-10-06T02:27:40.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.020+0000 7f1cb230f700 1 -- 172.21.15.6:0/984861520 wait complete. 2023-10-06T02:27:40.022 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:27:40.034 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:27:40.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.154+0000 7fec27be4700 1 Processor -- start 2023-10-06T02:27:40.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.155+0000 7fec27be4700 1 -- start start 2023-10-06T02:27:40.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.155+0000 7fec27be4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fec2015a030 0x7fec2015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.155+0000 7fec27be4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fec2015a940 0x7fec20086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.155+0000 7fec27be4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec20087530 0x7fec200b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.155+0000 7fec27be4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec200879d0 con 0x7fec2015a940 2023-10-06T02:27:40.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.155+0000 7fec27be4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec200b0cf0 con 0x7fec2015a030 2023-10-06T02:27:40.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.155+0000 7fec27be4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec200afc50 con 0x7fec20087530 2023-10-06T02:27:40.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.155+0000 7fec2517f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fec2015a940 0x7fec20086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.156+0000 7fec2517f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fec2015a940 0x7fec20086ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42174/0 (socket says 172.21.15.6:42174) 2023-10-06T02:27:40.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.156+0000 7fec2517f700 1 -- 172.21.15.6:0/2861206111 learned_addr learned my addr 172.21.15.6:0/2861206111 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:40.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.156+0000 7fec26181700 1 --2- 172.21.15.6:0/2861206111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec20087530 0x7fec200b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.156+0000 7fec2517f700 1 -- 172.21.15.6:0/2861206111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec20087530 msgr2=0x7fec200b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:40.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.156+0000 7fec2517f700 1 --2- 172.21.15.6:0/2861206111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec20087530 0x7fec200b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.156+0000 7fec25980700 1 --2- 172.21.15.6:0/2861206111 >> v2:172.21.15.175:3300/0 conn(0x7fec2015a030 0x7fec2015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.156+0000 7fec2517f700 1 -- 172.21.15.6:0/2861206111 >> v2:172.21.15.175:3300/0 conn(0x7fec2015a030 msgr2=0x7fec2015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:40.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.156+0000 7fec2517f700 1 --2- 172.21.15.6:0/2861206111 >> v2:172.21.15.175:3300/0 conn(0x7fec2015a030 0x7fec2015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.156+0000 7fec2517f700 1 -- 172.21.15.6:0/2861206111 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec200aff30 con 0x7fec2015a940 2023-10-06T02:27:40.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.156+0000 7fec26181700 1 --2- 172.21.15.6:0/2861206111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec20087530 0x7fec200b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:40.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.156+0000 7fec25980700 1 --2- 172.21.15.6:0/2861206111 >> v2:172.21.15.175:3300/0 conn(0x7fec2015a030 0x7fec2015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:40.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.156+0000 7fec2517f700 1 --2- 172.21.15.6:0/2861206111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec2015a940 0x7fec20086ff0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fec200cddc0 tx=0x7fec14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bbbfe3e579ec89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:40.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.156+0000 7fec2497e700 1 -- 172.21.15.6:0/2861206111 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400b820 con 0x7fec2015a940 2023-10-06T02:27:40.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.156+0000 7fec2497e700 1 -- 172.21.15.6:0/2861206111 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1400b980 con 0x7fec2015a940 2023-10-06T02:27:40.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.156+0000 7fec2497e700 1 -- 172.21.15.6:0/2861206111 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400bd20 con 0x7fec2015a940 2023-10-06T02:27:40.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.157+0000 7fec27be4700 1 -- 172.21.15.6:0/2861206111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec2015a940 msgr2=0x7fec20086ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.157+0000 7fec27be4700 1 --2- 172.21.15.6:0/2861206111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec2015a940 0x7fec20086ff0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fec200cddc0 tx=0x7fec14009250 comp rx=0 tx=0).stop 2023-10-06T02:27:40.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.157+0000 7fec27be4700 1 -- 172.21.15.6:0/2861206111 shutdown_connections 2023-10-06T02:27:40.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.157+0000 7fec27be4700 1 --2- 172.21.15.6:0/2861206111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec20087530 0x7fec200b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.157+0000 7fec27be4700 1 --2- 172.21.15.6:0/2861206111 >> v2:172.21.15.175:3300/0 conn(0x7fec2015a030 0x7fec2015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.157+0000 7fec27be4700 1 --2- 172.21.15.6:0/2861206111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec2015a940 0x7fec20086ff0 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.157+0000 7fec27be4700 1 -- 172.21.15.6:0/2861206111 >> 172.21.15.6:0/2861206111 conn(0x7fec20068680 msgr2=0x7fec20068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:40.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.157+0000 7fec27be4700 1 -- 172.21.15.6:0/2861206111 shutdown_connections 2023-10-06T02:27:40.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.157+0000 7fec27be4700 1 -- 172.21.15.6:0/2861206111 wait complete. 2023-10-06T02:27:40.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.158+0000 7fec27be4700 1 Processor -- start 2023-10-06T02:27:40.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.158+0000 7fec27be4700 1 -- start start 2023-10-06T02:27:40.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.159+0000 7fec27be4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec20087530 0x7fec20156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.159+0000 7fec27be4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec2015a030 0x7fec2015d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.159+0000 7fec27be4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec2015a940 0x7fec2015d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.159+0000 7fec27be4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec20169e60 con 0x7fec2015a940 2023-10-06T02:27:40.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.159+0000 7fec27be4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2016a120 con 0x7fec20087530 2023-10-06T02:27:40.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.159+0000 7fec27be4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2016a400 con 0x7fec2015a030 2023-10-06T02:27:40.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.159+0000 7fec26181700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec2015a940 0x7fec2015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.159+0000 7fec26181700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec2015a940 0x7fec2015d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42184/0 (socket says 172.21.15.6:42184) 2023-10-06T02:27:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.159+0000 7fec26181700 1 -- 172.21.15.6:0/2317812930 learned_addr learned my addr 172.21.15.6:0/2317812930 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.159+0000 7fec2517f700 1 --2- 172.21.15.6:0/2317812930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec2015a030 0x7fec2015d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.159+0000 7fec25980700 1 --2- 172.21.15.6:0/2317812930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec20087530 0x7fec20156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.159+0000 7fec26181700 1 -- 172.21.15.6:0/2317812930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec2015a030 msgr2=0x7fec2015d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.159+0000 7fec26181700 1 --2- 172.21.15.6:0/2317812930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec2015a030 0x7fec2015d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.159+0000 7fec26181700 1 -- 172.21.15.6:0/2317812930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec20087530 msgr2=0x7fec20156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.159+0000 7fec26181700 1 --2- 172.21.15.6:0/2317812930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec20087530 0x7fec20156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.159+0000 7fec26181700 1 -- 172.21.15.6:0/2317812930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec140094f0 con 0x7fec2015a940 2023-10-06T02:27:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.159+0000 7fec26181700 1 --2- 172.21.15.6:0/2317812930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec2015a940 0x7fec2015d910 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fec1000cf60 tx=0x7fec10007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.160+0000 7fec1dffb700 1 -- 172.21.15.6:0/2317812930 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1000ae40 con 0x7fec2015a940 2023-10-06T02:27:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.160+0000 7fec1dffb700 1 -- 172.21.15.6:0/2317812930 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec10015440 con 0x7fec2015a940 2023-10-06T02:27:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.160+0000 7fec27be4700 1 -- 172.21.15.6:0/2317812930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2016a6e0 con 0x7fec2015a940 2023-10-06T02:27:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.160+0000 7fec1dffb700 1 -- 172.21.15.6:0/2317812930 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10015800 con 0x7fec2015a940 2023-10-06T02:27:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.160+0000 7fec27be4700 1 -- 172.21.15.6:0/2317812930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2016aca0 con 0x7fec2015a940 2023-10-06T02:27:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.161+0000 7fec27be4700 1 -- 172.21.15.6:0/2317812930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec200c4c10 con 0x7fec2015a940 2023-10-06T02:27:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.161+0000 7fec1dffb700 1 -- 172.21.15.6:0/2317812930 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec1000d440 con 0x7fec2015a940 2023-10-06T02:27:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.162+0000 7fec1dffb700 1 --2- 172.21.15.6:0/2317812930 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec0c066f30 0x7fec0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.162+0000 7fec1dffb700 1 -- 172.21.15.6:0/2317812930 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8614+0+0 (secure 0 0 0) 0x7fec10085c60 con 0x7fec2015a940 2023-10-06T02:27:40.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.162+0000 7fec25980700 1 --2- 172.21.15.6:0/2317812930 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec0c066f30 0x7fec0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.162+0000 7fec25980700 1 --2- 172.21.15.6:0/2317812930 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec0c066f30 0x7fec0c0693e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fec1800adc0 tx=0x7fec18006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:40.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.166+0000 7fec1dffb700 1 -- 172.21.15.6:0/2317812930 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec200c4c10 con 0x7fec2015a940 2023-10-06T02:27:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:40.446+0000 7fec27be4700 1 -- 172.21.15.6:0/2317812930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fec200c4c10 con 0x7fec2015a940 2023-10-06T02:27:41.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.028+0000 7fec1dffb700 1 -- 172.21.15.6:0/2317812930 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v253) v1 ==== 101+0+0 (secure 0 0 0) 0x7fec200c4c10 con 0x7fec2015a940 2023-10-06T02:27:41.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.030+0000 7fec27be4700 1 -- 172.21.15.6:0/2317812930 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec0c066f30 msgr2=0x7fec0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.030+0000 7fec27be4700 1 --2- 172.21.15.6:0/2317812930 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec0c066f30 0x7fec0c0693e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fec1800adc0 tx=0x7fec18006f90 comp rx=0 tx=0).stop 2023-10-06T02:27:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.030+0000 7fec27be4700 1 -- 172.21.15.6:0/2317812930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec2015a940 msgr2=0x7fec2015d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.030+0000 7fec27be4700 1 --2- 172.21.15.6:0/2317812930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec2015a940 0x7fec2015d910 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fec1000cf60 tx=0x7fec10007870 comp rx=0 tx=0).stop 2023-10-06T02:27:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.030+0000 7fec27be4700 1 -- 172.21.15.6:0/2317812930 shutdown_connections 2023-10-06T02:27:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.030+0000 7fec27be4700 1 --2- 172.21.15.6:0/2317812930 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec0c066f30 0x7fec0c0693e0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.030+0000 7fec27be4700 1 --2- 172.21.15.6:0/2317812930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec2015a940 0x7fec2015d910 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.030+0000 7fec27be4700 1 --2- 172.21.15.6:0/2317812930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec20087530 0x7fec20156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.030+0000 7fec27be4700 1 --2- 172.21.15.6:0/2317812930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec2015a030 0x7fec2015d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.031+0000 7fec27be4700 1 -- 172.21.15.6:0/2317812930 >> 172.21.15.6:0/2317812930 conn(0x7fec20068680 msgr2=0x7fec200b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.031+0000 7fec27be4700 1 -- 172.21.15.6:0/2317812930 shutdown_connections 2023-10-06T02:27:41.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.031+0000 7fec27be4700 1 -- 172.21.15.6:0/2317812930 wait complete. 2023-10-06T02:27:41.033 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:27:41.046 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:27:41.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.086+0000 7f7381e86000 1 Processor -- start 2023-10-06T02:27:41.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.086+0000 7f7381e86000 1 -- start start 2023-10-06T02:27:41.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.087+0000 7f7381e86000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b48a549710 0x55b48a563de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.087+0000 7f7381e86000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b48a5eb2f0 0x55b48a5ec140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.087+0000 7f7381e86000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b48a5eb6c0 0x55b48a5eedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.087+0000 7f7381e86000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b48a468620 con 0x55b48a549710 2023-10-06T02:27:41.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.087+0000 7f7381e86000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b48a45f400 con 0x55b48a5eb2f0 2023-10-06T02:27:41.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.087+0000 7f7381e86000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b48a5eaf30 con 0x55b48a5eb6c0 2023-10-06T02:27:41.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.087+0000 7f737b0c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b48a549710 0x55b48a563de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.087+0000 7f737b0c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b48a549710 0x55b48a563de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42212/0 (socket says 172.21.15.6:42212) 2023-10-06T02:27:41.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.087+0000 7f737b0c1700 1 -- 172.21.15.6:0/2272041790 learned_addr learned my addr 172.21.15.6:0/2272041790 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:41.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.087+0000 7f737a8c0700 1 --2- 172.21.15.6:0/2272041790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b48a5eb2f0 0x55b48a5ec140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.087+0000 7f737b8c2700 1 --2- 172.21.15.6:0/2272041790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b48a5eb6c0 0x55b48a5eedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.087+0000 7f737b0c1700 1 -- 172.21.15.6:0/2272041790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b48a5eb6c0 msgr2=0x55b48a5eedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:41.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.087+0000 7f737b0c1700 1 --2- 172.21.15.6:0/2272041790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b48a5eb6c0 0x55b48a5eedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.087+0000 7f737b0c1700 1 -- 172.21.15.6:0/2272041790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b48a5eb2f0 msgr2=0x55b48a5ec140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:41.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.087+0000 7f737b0c1700 1 --2- 172.21.15.6:0/2272041790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b48a5eb2f0 0x55b48a5ec140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.087+0000 7f737b0c1700 1 -- 172.21.15.6:0/2272041790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c005db0 con 0x55b48a549710 2023-10-06T02:27:41.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.087+0000 7f737b0c1700 1 --2- 172.21.15.6:0/2272041790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b48a549710 0x55b48a563de0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f737400c5a0 tx=0x7f7374007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e966fccd2e5a16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.088+0000 7f73798be700 1 -- 172.21.15.6:0/2272041790 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73740116c0 con 0x55b48a549710 2023-10-06T02:27:41.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.088+0000 7f73798be700 1 -- 172.21.15.6:0/2272041790 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7374011820 con 0x55b48a549710 2023-10-06T02:27:41.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.088+0000 7f73798be700 1 -- 172.21.15.6:0/2272041790 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7374011ba0 con 0x55b48a549710 2023-10-06T02:27:41.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.088+0000 7f7381e86000 1 -- 172.21.15.6:0/2272041790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b48a549710 msgr2=0x55b48a563de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.088+0000 7f7381e86000 1 --2- 172.21.15.6:0/2272041790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b48a549710 0x55b48a563de0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f737400c5a0 tx=0x7f7374007040 comp rx=0 tx=0).stop 2023-10-06T02:27:41.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.088+0000 7f7381e86000 1 -- 172.21.15.6:0/2272041790 shutdown_connections 2023-10-06T02:27:41.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.088+0000 7f7381e86000 1 --2- 172.21.15.6:0/2272041790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b48a5eb6c0 0x55b48a5eedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.088+0000 7f7381e86000 1 --2- 172.21.15.6:0/2272041790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b48a549710 0x55b48a563de0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.088+0000 7f7381e86000 1 --2- 172.21.15.6:0/2272041790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b48a5eb2f0 0x55b48a5ec140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.088+0000 7f7381e86000 1 -- 172.21.15.6:0/2272041790 >> 172.21.15.6:0/2272041790 conn(0x55b48a51e5d0 msgr2=0x55b48a5209b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:41.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.088+0000 7f7381e86000 1 -- 172.21.15.6:0/2272041790 shutdown_connections 2023-10-06T02:27:41.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.088+0000 7f7381e86000 1 -- 172.21.15.6:0/2272041790 wait complete. 2023-10-06T02:27:41.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.089+0000 7f7381e86000 1 Processor -- start 2023-10-06T02:27:41.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.089+0000 7f7381e86000 1 -- start start 2023-10-06T02:27:41.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.090+0000 7f7381e86000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b48a549710 0x55b48a605e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.090+0000 7f7381e86000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b48a5eb2f0 0x55b48a5e8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.090+0000 7f7381e86000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b48a5eb6c0 0x55b48a5ed0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.090+0000 7f7381e86000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b48a563820 con 0x55b48a5eb2f0 2023-10-06T02:27:41.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.090+0000 7f7381e86000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b48a5f1ed0 con 0x55b48a549710 2023-10-06T02:27:41.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.090+0000 7f7381e86000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b48a5efec0 con 0x55b48a5eb6c0 2023-10-06T02:27:41.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.090+0000 7f737a8c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b48a5eb2f0 0x55b48a5e8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.090+0000 7f737a8c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b48a5eb2f0 0x55b48a5e8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42214/0 (socket says 172.21.15.6:42214) 2023-10-06T02:27:41.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.090+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 learned_addr learned my addr 172.21.15.6:0/943712101 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:41.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.090+0000 7f737b0c1700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b48a549710 0x55b48a605e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.090+0000 7f737b8c2700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b48a5eb6c0 0x55b48a5ed0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.090+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b48a5eb6c0 msgr2=0x55b48a5ed0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.090+0000 7f737a8c0700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b48a5eb6c0 0x55b48a5ed0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.090+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b48a549710 msgr2=0x55b48a605e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.090+0000 7f737a8c0700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b48a549710 0x55b48a605e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.090+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737400d040 con 0x55b48a5eb2f0 2023-10-06T02:27:41.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.090+0000 7f737a8c0700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b48a5eb2f0 0x55b48a5e8ac0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f7364008940 tx=0x7f7364005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.091+0000 7f7373fff700 1 -- 172.21.15.6:0/943712101 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364006840 con 0x55b48a5eb2f0 2023-10-06T02:27:41.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.091+0000 7f7373fff700 1 -- 172.21.15.6:0/943712101 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7364010040 con 0x55b48a5eb2f0 2023-10-06T02:27:41.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.091+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b48a4911c0 con 0x55b48a5eb2f0 2023-10-06T02:27:41.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.091+0000 7f7373fff700 1 -- 172.21.15.6:0/943712101 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364006bf0 con 0x55b48a5eb2f0 2023-10-06T02:27:41.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.091+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b48a4773d0 con 0x55b48a5eb2f0 2023-10-06T02:27:41.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.092+0000 7f7373fff700 1 -- 172.21.15.6:0/943712101 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f736401e460 con 0x55b48a5eb2f0 2023-10-06T02:27:41.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.092+0000 7f7373fff700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f735c065890 0x7f735c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.092+0000 7f7373fff700 1 -- 172.21.15.6:0/943712101 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8614+0+0 (secure 0 0 0) 0x7f73640841f0 con 0x55b48a5eb2f0 2023-10-06T02:27:41.096 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:27:41.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.093+0000 7f7381e86000 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55b48a5646f0 0x55b48a5f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.093+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a5f3560 con 0x55b48a5646f0 2023-10-06T02:27:41.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.093+0000 7f737b0c1700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f735c065890 0x7f735c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.093+0000 7f737b8c2700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55b48a5646f0 0x55b48a5f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.093+0000 7f737b8c2700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55b48a5646f0 0x55b48a5f3020 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.093+0000 7f737b0c1700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f735c065890 0x7f735c067d40 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7374011fd0 tx=0x7f7374016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.095+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v121'784 uv758 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.095+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a5ea950 con 0x55b48a5646f0 2023-10-06T02:27:41.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.097+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v121'785 uv785 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.097+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6112d0 con 0x55b48a5646f0 2023-10-06T02:27:41.099 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:27:41.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.098+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v121'786 uv786 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.098+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a612690 con 0x55b48a5646f0 2023-10-06T02:27:41.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.099+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v121'787 uv787 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.099+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a612a40 con 0x55b48a5646f0 2023-10-06T02:27:41.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.101+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v121'788 uv788 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.101+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a5ed830 con 0x55b48a5646f0 2023-10-06T02:27:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.102+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v121'789 uv789 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.102+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a611b70 con 0x55b48a5646f0 2023-10-06T02:27:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.103+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v121'790 uv764 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.103+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a611f70 con 0x55b48a5646f0 2023-10-06T02:27:41.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.105+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v121'791 uv791 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.105+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a611f70 con 0x55b48a5646f0 2023-10-06T02:27:41.106 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:27:41.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.106+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v121'792 uv792 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.106+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a611f20 con 0x55b48a5646f0 2023-10-06T02:27:41.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.107+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v121'793 uv793 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.107+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a611f20 con 0x55b48a5646f0 2023-10-06T02:27:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.108+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v121'794 uv794 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.109+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a611f20 con 0x55b48a5646f0 2023-10-06T02:27:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.110+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v121'795 uv795 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.110+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a611f20 con 0x55b48a5646f0 2023-10-06T02:27:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.112+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v121'796 uv771 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.112+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a611f20 con 0x55b48a5646f0 2023-10-06T02:27:41.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.113+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v121'797 uv797 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.113+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a611f20 con 0x55b48a5646f0 2023-10-06T02:27:41.114 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:27:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.114+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v121'798 uv798 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.114+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a611f20 con 0x55b48a5646f0 2023-10-06T02:27:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.115+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v121'799 uv799 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.115+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a611f20 con 0x55b48a5646f0 2023-10-06T02:27:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.117+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v121'800 uv800 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.117+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a611f20 con 0x55b48a5646f0 2023-10-06T02:27:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.118+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v121'801 uv801 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.118+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a612df0 con 0x55b48a5646f0 2023-10-06T02:27:41.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.119+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v121'802 uv802 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.119+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a612df0 con 0x55b48a5646f0 2023-10-06T02:27:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.121+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v121'803 uv777 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.121+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a612df0 con 0x55b48a5646f0 2023-10-06T02:27:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.122+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v121'804 uv804 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.122+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a612df0 con 0x55b48a5646f0 2023-10-06T02:27:41.124 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:27:41.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.123+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v121'805 uv805 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.123+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a613e00 con 0x55b48a5646f0 2023-10-06T02:27:41.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.125+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v121'806 uv806 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.125+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a613e00 con 0x55b48a5646f0 2023-10-06T02:27:41.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.126+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v121'807 uv807 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.126+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a612df0 con 0x55b48a5646f0 2023-10-06T02:27:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.127+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v121'808 uv808 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.127+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a612df0 con 0x55b48a5646f0 2023-10-06T02:27:41.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.129+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v121'809 uv783 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.129+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a612df0 con 0x55b48a5646f0 2023-10-06T02:27:41.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.130+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v121'810 uv810 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.130+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a612df0 con 0x55b48a5646f0 2023-10-06T02:27:41.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.131+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v121'811 uv811 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.132 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:27:41.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.131+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a613e00 con 0x55b48a5646f0 2023-10-06T02:27:41.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.133+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v121'812 uv812 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.133+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a613e00 con 0x55b48a5646f0 2023-10-06T02:27:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.134+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v121'813 uv813 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.134+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a612df0 con 0x55b48a5646f0 2023-10-06T02:27:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.135+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v121'814 uv814 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a5646f0 2023-10-06T02:27:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.135+0000 7f7381e86000 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b48a613300 0x55b48a6156e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.135+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a615c20 con 0x55b48a613300 2023-10-06T02:27:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.135+0000 7f737b0c1700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b48a613300 0x55b48a6156e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.136+0000 7f737b0c1700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b48a613300 0x55b48a6156e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.137+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v121'565 uv547 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.138+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a615fd0 con 0x55b48a613300 2023-10-06T02:27:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.139+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v121'566 uv566 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.139+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a616380 con 0x55b48a613300 2023-10-06T02:27:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.140+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v121'567 uv567 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.141 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:27:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.140+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a616c20 con 0x55b48a613300 2023-10-06T02:27:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.142+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v121'568 uv568 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.142+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a616fd0 con 0x55b48a613300 2023-10-06T02:27:41.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.144+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v121'569 uv569 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.144+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a617380 con 0x55b48a613300 2023-10-06T02:27:41.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.145+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v121'570 uv552 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.145+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a617730 con 0x55b48a613300 2023-10-06T02:27:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.147+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v121'571 uv571 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.147+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a617ae0 con 0x55b48a613300 2023-10-06T02:27:41.148 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:27:41.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.148+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v121'572 uv572 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.148+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a617ae0 con 0x55b48a613300 2023-10-06T02:27:41.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.149+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v121'573 uv573 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.149+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a617ae0 con 0x55b48a613300 2023-10-06T02:27:41.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.150+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v121'574 uv574 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.150+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a617ae0 con 0x55b48a613300 2023-10-06T02:27:41.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.152+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v121'575 uv564 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.152+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a617ae0 con 0x55b48a613300 2023-10-06T02:27:41.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.153+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v121'576 uv576 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.153+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a617ae0 con 0x55b48a613300 2023-10-06T02:27:41.155 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:27:41.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.154+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v121'577 uv577 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.154+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61b200 con 0x55b48a613300 2023-10-06T02:27:41.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.156+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v121'578 uv578 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.156+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61b200 con 0x55b48a613300 2023-10-06T02:27:41.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.157+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v121'579 uv579 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.157+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a617ae0 con 0x55b48a613300 2023-10-06T02:27:41.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.158+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v121'580 uv563 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.158+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a617ae0 con 0x55b48a613300 2023-10-06T02:27:41.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.160+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v121'581 uv581 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.160+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a617ae0 con 0x55b48a613300 2023-10-06T02:27:41.161 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:27:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.161+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v121'582 uv582 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.161+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a618af0 con 0x55b48a613300 2023-10-06T02:27:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.162+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v121'583 uv583 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.162+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a618af0 con 0x55b48a613300 2023-10-06T02:27:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.163+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v121'584 uv584 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.163+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a617ae0 con 0x55b48a613300 2023-10-06T02:27:41.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.164+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v121'585 uv585 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.164+0000 7f7381e86000 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b48a617ff0 0x55b48a61a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.164+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61a910 con 0x55b48a617ff0 2023-10-06T02:27:41.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.164+0000 7f737a8c0700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b48a617ff0 0x55b48a61a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.165+0000 7f737a8c0700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b48a617ff0 0x55b48a61a3d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.166+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v121'153 uv152 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.166+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61acc0 con 0x55b48a617ff0 2023-10-06T02:27:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.167+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v121'154 uv154 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.167+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61b070 con 0x55b48a617ff0 2023-10-06T02:27:41.168 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:27:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.168+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v121'155 uv155 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.168+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61c430 con 0x55b48a617ff0 2023-10-06T02:27:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.169+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v121'156 uv156 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.169+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61c7e0 con 0x55b48a617ff0 2023-10-06T02:27:41.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.170+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v121'157 uv157 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.170+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61b420 con 0x55b48a617ff0 2023-10-06T02:27:41.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.171+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v121'158 uv158 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.171+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61b820 con 0x55b48a617ff0 2023-10-06T02:27:41.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.172+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v121'108 uv107 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.172+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61bc50 con 0x55b48a617ff0 2023-10-06T02:27:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.173+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v121'109 uv109 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.173+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61bc50 con 0x55b48a617ff0 2023-10-06T02:27:41.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.175+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v121'110 uv110 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.176 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:27:41.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.175+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61bc00 con 0x55b48a617ff0 2023-10-06T02:27:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.176+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v121'111 uv111 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.176+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61bbd0 con 0x55b48a613300 2023-10-06T02:27:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.177+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v121'153 uv152 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.177+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61bbd0 con 0x55b48a613300 2023-10-06T02:27:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.178+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v121'154 uv154 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.178+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61bbd0 con 0x55b48a613300 2023-10-06T02:27:41.179 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:27:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.179+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v121'155 uv155 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.179+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61bbd0 con 0x55b48a613300 2023-10-06T02:27:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.180+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v121'156 uv156 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.180+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61bbd0 con 0x55b48a613300 2023-10-06T02:27:41.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.181+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v121'157 uv157 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.181+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61bbd0 con 0x55b48a613300 2023-10-06T02:27:41.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.182+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v121'158 uv158 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a613300 2023-10-06T02:27:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.182+0000 7f7381e86000 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b48a61d0f0 0x55b48a61f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.182+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61bbd0 con 0x55b48a61d0f0 2023-10-06T02:27:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.182+0000 7f737b8c2700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b48a61d0f0 0x55b48a61f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.183+0000 7f737b8c2700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b48a61d0f0 0x55b48a61f4d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.184+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v121'282 uv276 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a61d0f0 2023-10-06T02:27:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.184+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61bbd0 con 0x55b48a61d0f0 2023-10-06T02:27:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.185+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v121'283 uv283 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a61d0f0 2023-10-06T02:27:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.185+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61fa90 con 0x55b48a61d0f0 2023-10-06T02:27:41.186 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:27:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.186+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v121'284 uv284 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a61d0f0 2023-10-06T02:27:41.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.186+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a620aa0 con 0x55b48a61d0f0 2023-10-06T02:27:41.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.187+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v121'285 uv285 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a61d0f0 2023-10-06T02:27:41.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.187+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a620aa0 con 0x55b48a61d0f0 2023-10-06T02:27:41.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.188+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v121'286 uv286 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a61d0f0 2023-10-06T02:27:41.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.188+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61fa90 con 0x55b48a61d0f0 2023-10-06T02:27:41.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.189+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v121'287 uv287 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a61d0f0 2023-10-06T02:27:41.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.189+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61fa90 con 0x55b48a61d0f0 2023-10-06T02:27:41.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.190+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v121'288 uv281 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a61d0f0 2023-10-06T02:27:41.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.190+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61fa90 con 0x55b48a61d0f0 2023-10-06T02:27:41.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.191+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v121'289 uv289 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a61d0f0 2023-10-06T02:27:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.191+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61fa90 con 0x55b48a61d0f0 2023-10-06T02:27:41.193 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:27:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.192+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v121'290 uv290 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a61d0f0 2023-10-06T02:27:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.192+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61fa90 con 0x55b48a61d0f0 2023-10-06T02:27:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.193+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v121'291 uv291 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a61d0f0 2023-10-06T02:27:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.194+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a61fa90 con 0x55b48a61d0f0 2023-10-06T02:27:41.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.195+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v121'292 uv292 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a61d0f0 2023-10-06T02:27:41.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.195+0000 7f7381e86000 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55b48a620110 0x55b48a6224f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.195+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a622b50 con 0x55b48a620110 2023-10-06T02:27:41.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.195+0000 7f737b0c1700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55b48a620110 0x55b48a6224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.195+0000 7f737b0c1700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55b48a620110 0x55b48a6224f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.196+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v121'127 uv126 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a620110 2023-10-06T02:27:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.196+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a622b90 con 0x55b48a620110 2023-10-06T02:27:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.198+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v121'128 uv128 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a620110 2023-10-06T02:27:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.198+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a622fc0 con 0x55b48a620110 2023-10-06T02:27:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.199+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v121'129 uv129 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a620110 2023-10-06T02:27:41.199 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:27:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.199+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a622fc0 con 0x55b48a620110 2023-10-06T02:27:41.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.200+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v121'130 uv130 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a620110 2023-10-06T02:27:41.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.200+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a622fc0 con 0x55b48a620110 2023-10-06T02:27:41.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.201+0000 7f737b0c1700 1 -- 172.21.15.6:0/943712101 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v121'131 uv131 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7374012480 con 0x55b48a620110 2023-10-06T02:27:41.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.201+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a622fc0 con 0x55b48a617ff0 2023-10-06T02:27:41.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.202+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v121'153 uv152 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.202+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a622fc0 con 0x55b48a617ff0 2023-10-06T02:27:41.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.203+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v121'154 uv154 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.203+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a622fc0 con 0x55b48a617ff0 2023-10-06T02:27:41.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.204+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v121'155 uv155 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.204 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:27:41.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.204+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a623fd0 con 0x55b48a617ff0 2023-10-06T02:27:41.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.204+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v121'156 uv156 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.205+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a623fd0 con 0x55b48a617ff0 2023-10-06T02:27:41.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.205+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v121'157 uv157 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.205+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a622fc0 con 0x55b48a617ff0 2023-10-06T02:27:41.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.206+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v121'158 uv158 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.206+0000 7f7381e86000 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b48a6234d0 0x55b48a6258b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.206+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a625fb0 con 0x55b48a6234d0 2023-10-06T02:27:41.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.207+0000 7f737a8c0700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b48a6234d0 0x55b48a6258b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.207+0000 7f737a8c0700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b48a6234d0 0x55b48a6258b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.208+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v121'253 uv247 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a6234d0 2023-10-06T02:27:41.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.208+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a625ff0 con 0x55b48a6234d0 2023-10-06T02:27:41.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.209+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v121'254 uv254 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a6234d0 2023-10-06T02:27:41.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.209+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a626420 con 0x55b48a6234d0 2023-10-06T02:27:41.210 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:27:41.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.210+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v121'255 uv255 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a6234d0 2023-10-06T02:27:41.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.210+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a626420 con 0x55b48a6234d0 2023-10-06T02:27:41.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.211+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v121'256 uv256 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a6234d0 2023-10-06T02:27:41.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.211+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a626420 con 0x55b48a6234d0 2023-10-06T02:27:41.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.212+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v121'257 uv257 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a6234d0 2023-10-06T02:27:41.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.212+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a626420 con 0x55b48a6234d0 2023-10-06T02:27:41.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.213+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v121'258 uv252 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a6234d0 2023-10-06T02:27:41.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.213+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a626420 con 0x55b48a6234d0 2023-10-06T02:27:41.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.214+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v121'259 uv259 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a6234d0 2023-10-06T02:27:41.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.214+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a626420 con 0x55b48a6234d0 2023-10-06T02:27:41.215 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:27:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.215+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v121'260 uv260 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a6234d0 2023-10-06T02:27:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.215+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a626420 con 0x55b48a6234d0 2023-10-06T02:27:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.216+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v121'261 uv261 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a6234d0 2023-10-06T02:27:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.216+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a629190 con 0x55b48a6234d0 2023-10-06T02:27:41.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.217+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v121'262 uv262 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a6234d0 2023-10-06T02:27:41.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.217+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a626910 con 0x55b48a617ff0 2023-10-06T02:27:41.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.218+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v121'111 uv110 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.218+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a626910 con 0x55b48a617ff0 2023-10-06T02:27:41.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.219+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v121'112 uv112 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.219+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a626910 con 0x55b48a617ff0 2023-10-06T02:27:41.220 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:27:41.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.220+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v121'113 uv113 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.220+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a626910 con 0x55b48a617ff0 2023-10-06T02:27:41.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.221+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v121'114 uv114 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.221+0000 7f7381e86000 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55b48a626e20 0x55b48a6271f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.221+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a626e20 2023-10-06T02:27:41.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.221+0000 7f737b8c2700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55b48a626e20 0x55b48a6271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.222+0000 7f737b8c2700 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55b48a626e20 0x55b48a6271f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.223+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v121'153 uv152 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a626e20 2023-10-06T02:27:41.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.223+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a626e20 2023-10-06T02:27:41.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.224+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v121'154 uv154 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a626e20 2023-10-06T02:27:41.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.224+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a626e20 2023-10-06T02:27:41.225 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:27:41.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.225+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v121'155 uv155 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a626e20 2023-10-06T02:27:41.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.225+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a62a8f0 con 0x55b48a626e20 2023-10-06T02:27:41.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.226+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v121'156 uv156 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a626e20 2023-10-06T02:27:41.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.226+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a62a8f0 con 0x55b48a626e20 2023-10-06T02:27:41.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.227+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v121'157 uv157 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a626e20 2023-10-06T02:27:41.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.227+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a626e20 2023-10-06T02:27:41.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.228+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v121'158 uv158 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a626e20 2023-10-06T02:27:41.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.228+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a61d0f0 2023-10-06T02:27:41.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.229+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v121'130 uv129 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a61d0f0 2023-10-06T02:27:41.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.229+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a61d0f0 2023-10-06T02:27:41.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.230+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v121'131 uv131 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a61d0f0 2023-10-06T02:27:41.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.230+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a61d0f0 2023-10-06T02:27:41.231 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:27:41.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.231+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v121'132 uv132 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a61d0f0 2023-10-06T02:27:41.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.231+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a61d0f0 2023-10-06T02:27:41.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.232+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v121'133 uv133 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a61d0f0 2023-10-06T02:27:41.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.232+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a61d0f0 2023-10-06T02:27:41.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.233+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v121'134 uv134 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f736c008b70 con 0x55b48a61d0f0 2023-10-06T02:27:41.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.233+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a617ff0 2023-10-06T02:27:41.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.234+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v121'314 uv306 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.234+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a617ff0 2023-10-06T02:27:41.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.235+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v121'315 uv315 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.235+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a617ff0 2023-10-06T02:27:41.237 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:27:41.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.236+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v121'316 uv316 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.236+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a617ff0 2023-10-06T02:27:41.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.240+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v121'317 uv317 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.241+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a617ff0 2023-10-06T02:27:41.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.242+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v121'318 uv318 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.242+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a617ff0 2023-10-06T02:27:41.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.243+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v121'319 uv313 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.243+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a617ff0 2023-10-06T02:27:41.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.244+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v121'320 uv320 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.244+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a617ff0 2023-10-06T02:27:41.245 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:27:41.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.244+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v121'321 uv321 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.245+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a62a8f0 con 0x55b48a617ff0 2023-10-06T02:27:41.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.245+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v121'322 uv322 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.245+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a62a8f0 con 0x55b48a617ff0 2023-10-06T02:27:41.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.246+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v121'323 uv323 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.246+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a6298e0 con 0x55b48a617ff0 2023-10-06T02:27:41.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.247+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v121'324 uv324 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.247+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55b48a629dd0 con 0x55b48a617ff0 2023-10-06T02:27:41.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f737a8c0700 1 -- 172.21.15.6:0/943712101 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v121'325 uv325 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f736401a020 con 0x55b48a617ff0 2023-10-06T02:27:41.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b48a617ff0 msgr2=0x55b48a61a3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b48a617ff0 0x55b48a61a3d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55b48a5646f0 msgr2=0x55b48a5f3020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55b48a5646f0 0x55b48a5f3020 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b48a6234d0 msgr2=0x55b48a6258b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b48a6234d0 0x55b48a6258b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b48a613300 msgr2=0x55b48a6156e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b48a613300 0x55b48a6156e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55b48a626e20 msgr2=0x55b48a6271f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 reap_dead start 2023-10-06T02:27:41.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55b48a626e20 0x55b48a6271f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55b48a620110 msgr2=0x55b48a6224f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55b48a620110 0x55b48a6224f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b48a61d0f0 msgr2=0x55b48a61f4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b48a61d0f0 0x55b48a61f4d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f735c065890 msgr2=0x7f735c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f735c065890 0x7f735c067d40 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7374011fd0 tx=0x7f7374016000 comp rx=0 tx=0).stop 2023-10-06T02:27:41.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b48a5eb2f0 msgr2=0x55b48a5e8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.248+0000 7f7381e86000 1 --2- 172.21.15.6:0/943712101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b48a5eb2f0 0x55b48a5e8ac0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f7364008940 tx=0x7f7364005e20 comp rx=0 tx=0).stop 2023-10-06T02:27:41.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.249+0000 7f737b8c2700 1 -- 172.21.15.6:0/943712101 reap_dead start 2023-10-06T02:27:41.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.249+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 shutdown_connections 2023-10-06T02:27:41.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.249+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 >> 172.21.15.6:0/943712101 conn(0x55b48a51e5d0 msgr2=0x55b48a5209b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:41.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.249+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 shutdown_connections 2023-10-06T02:27:41.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.249+0000 7f7381e86000 1 -- 172.21.15.6:0/943712101 wait complete. 2023-10-06T02:27:41.253 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 500.00000000 0 2023-10-06T02:27:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.332+0000 7f2c961f7000 1 Processor -- start 2023-10-06T02:27:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.333+0000 7f2c961f7000 1 -- start start 2023-10-06T02:27:41.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.333+0000 7f2c961f7000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c7c0030b0 0x55ae56e6d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.333+0000 7f2c961f7000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae56dc7c40 0x55ae56dcb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.333+0000 7f2c961f7000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae56dcbab0 0x55ae56d99940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.333+0000 7f2c961f7000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae56d42320 con 0x55ae56dcbab0 2023-10-06T02:27:41.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.333+0000 7f2c961f7000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae56ce6980 con 0x7f2c7c0030b0 2023-10-06T02:27:41.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.333+0000 7f2c961f7000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ae56ce6620 con 0x55ae56dc7c40 2023-10-06T02:27:41.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.333+0000 7f2c8fc33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae56dcbab0 0x55ae56d99940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.333+0000 7f2c8fc33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae56dcbab0 0x55ae56d99940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42238/0 (socket says 172.21.15.6:42238) 2023-10-06T02:27:41.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.333+0000 7f2c8f432700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c7c0030b0 0x55ae56e6d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.333+0000 7f2c8fc33700 1 -- 172.21.15.6:0/1871756252 learned_addr learned my addr 172.21.15.6:0/1871756252 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:41.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.333+0000 7f2c8ec31700 1 --2- 172.21.15.6:0/1871756252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae56dc7c40 0x55ae56dcb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c8fc33700 1 -- 172.21.15.6:0/1871756252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae56dc7c40 msgr2=0x55ae56dcb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:41.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c8fc33700 1 --2- 172.21.15.6:0/1871756252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae56dc7c40 0x55ae56dcb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c8fc33700 1 -- 172.21.15.6:0/1871756252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c7c0030b0 msgr2=0x55ae56e6d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:41.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c8fc33700 1 --2- 172.21.15.6:0/1871756252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c7c0030b0 0x55ae56e6d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c8fc33700 1 -- 172.21.15.6:0/1871756252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae56ce8ae0 con 0x55ae56dcbab0 2023-10-06T02:27:41.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c8fc33700 1 --2- 172.21.15.6:0/1871756252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae56dcbab0 0x55ae56d99940 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f2c80001450 tx=0x55ae56dcb2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28437c1b2c045d67 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c8dc2f700 1 -- 172.21.15.6:0/1871756252 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c80006dd0 con 0x55ae56dcbab0 2023-10-06T02:27:41.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c8dc2f700 1 -- 172.21.15.6:0/1871756252 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c80003450 con 0x55ae56dcbab0 2023-10-06T02:27:41.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c8dc2f700 1 -- 172.21.15.6:0/1871756252 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c80003810 con 0x55ae56dcbab0 2023-10-06T02:27:41.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c961f7000 1 -- 172.21.15.6:0/1871756252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae56dcbab0 msgr2=0x55ae56d99940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c961f7000 1 --2- 172.21.15.6:0/1871756252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae56dcbab0 0x55ae56d99940 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f2c80001450 tx=0x55ae56dcb2e0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c961f7000 1 -- 172.21.15.6:0/1871756252 shutdown_connections 2023-10-06T02:27:41.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c961f7000 1 --2- 172.21.15.6:0/1871756252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae56dcbab0 0x55ae56d99940 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c961f7000 1 --2- 172.21.15.6:0/1871756252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c7c0030b0 0x55ae56e6d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c961f7000 1 --2- 172.21.15.6:0/1871756252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae56dc7c40 0x55ae56dcb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c961f7000 1 -- 172.21.15.6:0/1871756252 >> 172.21.15.6:0/1871756252 conn(0x55ae56de2bd0 msgr2=0x55ae56dc7290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c961f7000 1 -- 172.21.15.6:0/1871756252 shutdown_connections 2023-10-06T02:27:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.334+0000 7f2c961f7000 1 -- 172.21.15.6:0/1871756252 wait complete. 2023-10-06T02:27:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.335+0000 7f2c961f7000 1 Processor -- start 2023-10-06T02:27:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.335+0000 7f2c961f7000 1 -- start start 2023-10-06T02:27:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c961f7000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae56dc7c40 0x55ae56dbeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c961f7000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae56dcbab0 0x55ae56e6b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c961f7000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c7c0030b0 0x55ae56e82dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c961f7000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae56cdd400 con 0x7f2c7c0030b0 2023-10-06T02:27:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c961f7000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae56dc5950 con 0x55ae56dc7c40 2023-10-06T02:27:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c961f7000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ae56dbe370 con 0x55ae56dcbab0 2023-10-06T02:27:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c8fc33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c7c0030b0 0x55ae56e82dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c8f432700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae56dc7c40 0x55ae56dbeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c8fc33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c7c0030b0 0x55ae56e82dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42244/0 (socket says 172.21.15.6:42244) 2023-10-06T02:27:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c8ec31700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae56dcbab0 0x55ae56e6b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c8fc33700 1 -- 172.21.15.6:0/1184056488 learned_addr learned my addr 172.21.15.6:0/1184056488 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c8fc33700 1 -- 172.21.15.6:0/1184056488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae56dcbab0 msgr2=0x55ae56e6b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c8fc33700 1 --2- 172.21.15.6:0/1184056488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae56dcbab0 0x55ae56e6b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c8fc33700 1 -- 172.21.15.6:0/1184056488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae56dc7c40 msgr2=0x55ae56dbeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c8fc33700 1 --2- 172.21.15.6:0/1184056488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae56dc7c40 0x55ae56dbeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c8fc33700 1 -- 172.21.15.6:0/1184056488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae56cf53d0 con 0x7f2c7c0030b0 2023-10-06T02:27:41.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c8fc33700 1 --2- 172.21.15.6:0/1184056488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c7c0030b0 0x55ae56e82dc0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f2c800014a0 tx=0x7f2c80016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.336+0000 7f2c87fff700 1 -- 172.21.15.6:0/1184056488 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c80003810 con 0x7f2c7c0030b0 2023-10-06T02:27:41.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.337+0000 7f2c87fff700 1 -- 172.21.15.6:0/1184056488 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c80012600 con 0x7f2c7c0030b0 2023-10-06T02:27:41.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.337+0000 7f2c87fff700 1 -- 172.21.15.6:0/1184056488 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c80012a00 con 0x7f2c7c0030b0 2023-10-06T02:27:41.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.337+0000 7f2c961f7000 1 -- 172.21.15.6:0/1184056488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ae56ce8540 con 0x7f2c7c0030b0 2023-10-06T02:27:41.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.337+0000 7f2c961f7000 1 -- 172.21.15.6:0/1184056488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ae56dbe8b0 con 0x7f2c7c0030b0 2023-10-06T02:27:41.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.338+0000 7f2c87fff700 1 -- 172.21.15.6:0/1184056488 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c8001a070 con 0x7f2c7c0030b0 2023-10-06T02:27:41.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.338+0000 7f2c87fff700 1 --2- 172.21.15.6:0/1184056488 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c70065890 0x7f2c70067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.338+0000 7f2c87fff700 1 -- 172.21.15.6:0/1184056488 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8614+0+0 (secure 0 0 0) 0x7f2c800847e0 con 0x7f2c7c0030b0 2023-10-06T02:27:41.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.338+0000 7f2c8f432700 1 --2- 172.21.15.6:0/1184056488 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c70065890 0x7f2c70067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.339+0000 7f2c961f7000 1 --2- 172.21.15.6:0/1184056488 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55ae56dc53d0 0x55ae56de0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.339+0000 7f2c961f7000 1 -- 172.21.15.6:0/1184056488 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:1 14.15 14:aa448500:::500.00000000:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) v8 -- 0x55ae56dc7290 con 0x55ae56dc53d0 2023-10-06T02:27:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.339+0000 7f2c8ec31700 1 --2- 172.21.15.6:0/1184056488 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55ae56dc53d0 0x55ae56de0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.339+0000 7f2c8f432700 1 --2- 172.21.15.6:0/1184056488 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c70065890 0x7f2c70067d40 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2c88005a20 tx=0x7f2c8800c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.339+0000 7f2c8ec31700 1 --2- 172.21.15.6:0/1184056488 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55ae56dc53d0 0x55ae56de0630 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.340+0000 7f2c8ec31700 1 -- 172.21.15.6:0/1184056488 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(1 500.00000000 [truncate 0] v121'293 uv293 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2c78016070 con 0x55ae56dc53d0 2023-10-06T02:27:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.340+0000 7f2c961f7000 1 -- 172.21.15.6:0/1184056488 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55ae56dc53d0 msgr2=0x55ae56de0630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.340+0000 7f2c961f7000 1 --2- 172.21.15.6:0/1184056488 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55ae56dc53d0 0x55ae56de0630 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.340+0000 7f2c961f7000 1 -- 172.21.15.6:0/1184056488 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c70065890 msgr2=0x7f2c70067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.340+0000 7f2c961f7000 1 --2- 172.21.15.6:0/1184056488 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2c70065890 0x7f2c70067d40 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2c88005a20 tx=0x7f2c8800c040 comp rx=0 tx=0).stop 2023-10-06T02:27:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.340+0000 7f2c961f7000 1 -- 172.21.15.6:0/1184056488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c7c0030b0 msgr2=0x55ae56e82dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.340+0000 7f2c961f7000 1 --2- 172.21.15.6:0/1184056488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c7c0030b0 0x55ae56e82dc0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f2c800014a0 tx=0x7f2c80016000 comp rx=0 tx=0).stop 2023-10-06T02:27:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.340+0000 7f2c8fc33700 1 -- 172.21.15.6:0/1184056488 reap_dead start 2023-10-06T02:27:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.340+0000 7f2c961f7000 1 -- 172.21.15.6:0/1184056488 shutdown_connections 2023-10-06T02:27:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.340+0000 7f2c961f7000 1 -- 172.21.15.6:0/1184056488 >> 172.21.15.6:0/1184056488 conn(0x55ae56de2bd0 msgr2=0x55ae56de2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.340+0000 7f2c961f7000 1 -- 172.21.15.6:0/1184056488 shutdown_connections 2023-10-06T02:27:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.340+0000 7f2c961f7000 1 -- 172.21.15.6:0/1184056488 wait complete. 2023-10-06T02:27:41.354 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:27:41.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.504+0000 7fb2f29d7700 1 Processor -- start 2023-10-06T02:27:41.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.504+0000 7fb2f29d7700 1 -- start start 2023-10-06T02:27:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.505+0000 7fb2f29d7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2ec0d0400 0x7fb2ec0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.505+0000 7fb2f29d7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb2ec0d07d0 0x7fb2ec0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.505+0000 7fb2f29d7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec0b6170 con 0x7fb2ec0ccd40 2023-10-06T02:27:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.505+0000 7fb2f29d7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ec15dd40 con 0x7fb2ec0d07d0 2023-10-06T02:27:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.505+0000 7fb2f29d7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec15e020 con 0x7fb2ec0d0400 2023-10-06T02:27:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.505+0000 7fb2f0f74700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb2ec0d07d0 0x7fb2ec0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.505+0000 7fb2eb7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb2ec0ccd40 0x7fb2ec0cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38956/0 (socket says 172.21.15.6:38956) 2023-10-06T02:27:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.505+0000 7fb2eb7fe700 1 -- 172.21.15.6:0/4031029693 learned_addr learned my addr 172.21.15.6:0/4031029693 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.505+0000 7fb2ebfff700 1 --2- 172.21.15.6:0/4031029693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2ec0d0400 0x7fb2ec0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.506+0000 7fb2f0f74700 1 -- 172.21.15.6:0/4031029693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2ec0d0400 msgr2=0x7fb2ec0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.506+0000 7fb2f0f74700 1 --2- 172.21.15.6:0/4031029693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2ec0d0400 0x7fb2ec0b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.506+0000 7fb2f0f74700 1 -- 172.21.15.6:0/4031029693 >> v1:172.21.15.6:6789/0 conn(0x7fb2ec0ccd40 legacy=0x7fb2ec0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.506+0000 7fb2f0f74700 1 -- 172.21.15.6:0/4031029693 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec0ceaa0 con 0x7fb2ec0d07d0 2023-10-06T02:27:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.506+0000 7fb2eaffd700 1 -- 172.21.15.6:0/4031029693 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188265124 0 0) 0x7fb2ec0b6170 con 0x7fb2ec0ccd40 2023-10-06T02:27:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.506+0000 7fb2ebfff700 1 --2- 172.21.15.6:0/4031029693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2ec0d0400 0x7fb2ec0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.506+0000 7fb2f0f74700 1 --2- 172.21.15.6:0/4031029693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2ec0d07d0 0x7fb2ec0b3aa0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009e60 tx=0x7fb2e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6a6e57013e4140 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.506+0000 7fb2eaffd700 1 -- 172.21.15.6:0/4031029693 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e400e070 con 0x7fb2ec0d07d0 2023-10-06T02:27:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.506+0000 7fb2eaffd700 1 -- 172.21.15.6:0/4031029693 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e400bc30 con 0x7fb2ec0d07d0 2023-10-06T02:27:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.506+0000 7fb2eaffd700 1 -- 172.21.15.6:0/4031029693 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4012430 con 0x7fb2ec0d07d0 2023-10-06T02:27:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.506+0000 7fb2f29d7700 1 -- 172.21.15.6:0/4031029693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2ec0d07d0 msgr2=0x7fb2ec0b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.506+0000 7fb2f29d7700 1 --2- 172.21.15.6:0/4031029693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2ec0d07d0 0x7fb2ec0b3aa0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009e60 tx=0x7fb2e4009780 comp rx=0 tx=0).stop 2023-10-06T02:27:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.506+0000 7fb2f29d7700 1 -- 172.21.15.6:0/4031029693 shutdown_connections 2023-10-06T02:27:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.506+0000 7fb2f29d7700 1 --2- 172.21.15.6:0/4031029693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2ec0d07d0 0x7fb2ec0b3aa0 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.506+0000 7fb2f29d7700 1 --2- 172.21.15.6:0/4031029693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2ec0d0400 0x7fb2ec0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.506+0000 7fb2f29d7700 1 -- 172.21.15.6:0/4031029693 >> 172.21.15.6:0/4031029693 conn(0x7fb2ec06a220 msgr2=0x7fb2ec06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.507+0000 7fb2f29d7700 1 -- 172.21.15.6:0/4031029693 shutdown_connections 2023-10-06T02:27:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.507+0000 7fb2f29d7700 1 -- 172.21.15.6:0/4031029693 wait complete. 2023-10-06T02:27:41.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.508+0000 7fb2f29d7700 1 Processor -- start 2023-10-06T02:27:41.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.508+0000 7fb2f29d7700 1 -- start start 2023-10-06T02:27:41.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.508+0000 7fb2f29d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2ec0ccd40 0x7fb2ec159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.508+0000 7fb2f29d7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2ec0d0400 0x7fb2ec0c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.508+0000 7fb2f29d7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2ec0d07d0 0x7fb2ec169b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.508+0000 7fb2f29d7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0c5fb0 con 0x7fb2ec0ccd40 2023-10-06T02:27:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2f29d7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec15b0f0 con 0x7fb2ec0d07d0 2023-10-06T02:27:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2f29d7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec15b3d0 con 0x7fb2ec0d0400 2023-10-06T02:27:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2ec0ccd40 0x7fb2ec159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2ec0ccd40 0x7fb2ec159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42262/0 (socket says 172.21.15.6:42262) 2023-10-06T02:27:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2ebfff700 1 -- 172.21.15.6:0/1337734231 learned_addr learned my addr 172.21.15.6:0/1337734231 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2f0f74700 1 --2- 172.21.15.6:0/1337734231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2ec0d07d0 0x7fb2ec169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2eb7fe700 1 --2- 172.21.15.6:0/1337734231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2ec0d0400 0x7fb2ec0c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2ebfff700 1 -- 172.21.15.6:0/1337734231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2ec0d0400 msgr2=0x7fb2ec0c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2ebfff700 1 --2- 172.21.15.6:0/1337734231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2ec0d0400 0x7fb2ec0c5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2ebfff700 1 -- 172.21.15.6:0/1337734231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2ec0d07d0 msgr2=0x7fb2ec169b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2ebfff700 1 --2- 172.21.15.6:0/1337734231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2ec0d07d0 0x7fb2ec169b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2ebfff700 1 -- 172.21.15.6:0/1337734231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e4009a20 con 0x7fb2ec0ccd40 2023-10-06T02:27:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2ebfff700 1 --2- 172.21.15.6:0/1337734231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2ec0ccd40 0x7fb2ec159ac0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc00e920 tx=0x7fb2dc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2d3fff700 1 -- 172.21.15.6:0/1337734231 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc005a00 con 0x7fb2ec0ccd40 2023-10-06T02:27:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2d3fff700 1 -- 172.21.15.6:0/1337734231 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc005b60 con 0x7fb2ec0ccd40 2023-10-06T02:27:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2d3fff700 1 -- 172.21.15.6:0/1337734231 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc006020 con 0x7fb2ec0ccd40 2023-10-06T02:27:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2f29d7700 1 -- 172.21.15.6:0/1337734231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ec15b6b0 con 0x7fb2ec0ccd40 2023-10-06T02:27:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.509+0000 7fb2f29d7700 1 -- 172.21.15.6:0/1337734231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ec15bc70 con 0x7fb2ec0ccd40 2023-10-06T02:27:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.510+0000 7fb2f29d7700 1 -- 172.21.15.6:0/1337734231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ec088760 con 0x7fb2ec0ccd40 2023-10-06T02:27:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.511+0000 7fb2d3fff700 1 -- 172.21.15.6:0/1337734231 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2dc006410 con 0x7fb2ec0ccd40 2023-10-06T02:27:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.511+0000 7fb2d3fff700 1 --2- 172.21.15.6:0/1337734231 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb2d8066f30 0x7fb2d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.511+0000 7fb2d3fff700 1 -- 172.21.15.6:0/1337734231 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8614+0+0 (secure 0 0 0) 0x7fb2dc085250 con 0x7fb2ec0ccd40 2023-10-06T02:27:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.511+0000 7fb2eb7fe700 1 --2- 172.21.15.6:0/1337734231 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb2d8066f30 0x7fb2d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.512+0000 7fb2eb7fe700 1 --2- 172.21.15.6:0/1337734231 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb2d8066f30 0x7fb2d80693e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0007fd0 tx=0x7fb2e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.515+0000 7fb2d3fff700 1 -- 172.21.15.6:0/1337734231 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2dc051920 con 0x7fb2ec0ccd40 2023-10-06T02:27:41.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:41.754+0000 7fb2f29d7700 1 -- 172.21.15.6:0/1337734231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fb2ec0ced80 con 0x7fb2ec0ccd40 2023-10-06T02:27:42.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.031+0000 7fb2d3fff700 1 -- 172.21.15.6:0/1337734231 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v254) v1 ==== 162+0+0 (secure 0 0 0) 0x7fb2dc054f40 con 0x7fb2ec0ccd40 2023-10-06T02:27:42.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.034+0000 7fb2f29d7700 1 -- 172.21.15.6:0/1337734231 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb2d8066f30 msgr2=0x7fb2d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.034+0000 7fb2f29d7700 1 --2- 172.21.15.6:0/1337734231 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb2d8066f30 0x7fb2d80693e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0007fd0 tx=0x7fb2e0009040 comp rx=0 tx=0).stop 2023-10-06T02:27:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.034+0000 7fb2f29d7700 1 -- 172.21.15.6:0/1337734231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2ec0ccd40 msgr2=0x7fb2ec159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.034+0000 7fb2f29d7700 1 --2- 172.21.15.6:0/1337734231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2ec0ccd40 0x7fb2ec159ac0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc00e920 tx=0x7fb2dc008040 comp rx=0 tx=0).stop 2023-10-06T02:27:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.034+0000 7fb2f29d7700 1 -- 172.21.15.6:0/1337734231 shutdown_connections 2023-10-06T02:27:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.034+0000 7fb2f29d7700 1 --2- 172.21.15.6:0/1337734231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2ec0d07d0 0x7fb2ec169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.034+0000 7fb2f29d7700 1 --2- 172.21.15.6:0/1337734231 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb2d8066f30 0x7fb2d80693e0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.034+0000 7fb2f29d7700 1 --2- 172.21.15.6:0/1337734231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2ec0ccd40 0x7fb2ec159ac0 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.034+0000 7fb2f29d7700 1 --2- 172.21.15.6:0/1337734231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2ec0d0400 0x7fb2ec0c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.034+0000 7fb2f29d7700 1 -- 172.21.15.6:0/1337734231 >> 172.21.15.6:0/1337734231 conn(0x7fb2ec06a220 msgr2=0x7fb2ec153d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.034+0000 7fb2f29d7700 1 -- 172.21.15.6:0/1337734231 shutdown_connections 2023-10-06T02:27:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.034+0000 7fb2f29d7700 1 -- 172.21.15.6:0/1337734231 wait complete. 2023-10-06T02:27:42.036 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:27:42.451 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:42.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.579+0000 7fe54c9d9700 1 Processor -- start 2023-10-06T02:27:42.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.579+0000 7fe54c9d9700 1 -- start start 2023-10-06T02:27:42.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.580+0000 7fe54c9d9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe5480af8b0 0x7fe54815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:42.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.580+0000 7fe54c9d9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe5480b27f0 0x7fe54815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:42.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.580+0000 7fe54c9d9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54815e190 con 0x7fe5480af4e0 2023-10-06T02:27:42.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.580+0000 7fe54c9d9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5480b1910 con 0x7fe5480b27f0 2023-10-06T02:27:42.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.580+0000 7fe54c9d9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5480cb650 con 0x7fe5480af8b0 2023-10-06T02:27:42.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.580+0000 7fe546d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe5480b27f0 0x7fe54815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:42.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.580+0000 7fe546d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe5480b27f0 0x7fe54815d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42268/0 (socket says 172.21.15.6:42268) 2023-10-06T02:27:42.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.580+0000 7fe546d9d700 1 -- 172.21.15.6:0/1885939002 learned_addr learned my addr 172.21.15.6:0/1885939002 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:42.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.581+0000 7fe545d9b700 1 --2- 172.21.15.6:0/1885939002 >> v2:172.21.15.175:3300/0 conn(0x7fe5480af8b0 0x7fe54815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:42.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.581+0000 7fe546d9d700 1 -- 172.21.15.6:0/1885939002 >> v2:172.21.15.175:3300/0 conn(0x7fe5480af8b0 msgr2=0x7fe54815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:42.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.581+0000 7fe546d9d700 1 --2- 172.21.15.6:0/1885939002 >> v2:172.21.15.175:3300/0 conn(0x7fe5480af8b0 0x7fe54815d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.581+0000 7fe546d9d700 1 -- 172.21.15.6:0/1885939002 >> v1:172.21.15.175:6789/0 conn(0x7fe5480af4e0 legacy=0x7fe5480b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:42.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.581+0000 7fe546d9d700 1 -- 172.21.15.6:0/1885939002 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5480ccaf0 con 0x7fe5480b27f0 2023-10-06T02:27:42.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.581+0000 7fe546d9d700 1 --2- 172.21.15.6:0/1885939002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5480b27f0 0x7fe54815d9a0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7fe5480cdd50 tx=0x7fe540009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6726ace69ba9a02e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:42.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.581+0000 7fe54559a700 1 -- 172.21.15.6:0/1885939002 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54000b860 con 0x7fe5480b27f0 2023-10-06T02:27:42.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.581+0000 7fe54559a700 1 -- 172.21.15.6:0/1885939002 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54000b9c0 con 0x7fe5480b27f0 2023-10-06T02:27:42.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.581+0000 7fe54559a700 1 -- 172.21.15.6:0/1885939002 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54000bd60 con 0x7fe5480b27f0 2023-10-06T02:27:42.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.582+0000 7fe54c9d9700 1 -- 172.21.15.6:0/1885939002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5480b27f0 msgr2=0x7fe54815d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:42.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.582+0000 7fe54c9d9700 1 --2- 172.21.15.6:0/1885939002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5480b27f0 0x7fe54815d9a0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7fe5480cdd50 tx=0x7fe540009250 comp rx=0 tx=0).stop 2023-10-06T02:27:42.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.582+0000 7fe54c9d9700 1 -- 172.21.15.6:0/1885939002 shutdown_connections 2023-10-06T02:27:42.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.582+0000 7fe54c9d9700 1 --2- 172.21.15.6:0/1885939002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5480b27f0 0x7fe54815d9a0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.582+0000 7fe54c9d9700 1 --2- 172.21.15.6:0/1885939002 >> v2:172.21.15.175:3300/0 conn(0x7fe5480af8b0 0x7fe54815d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.582+0000 7fe54c9d9700 1 -- 172.21.15.6:0/1885939002 >> 172.21.15.6:0/1885939002 conn(0x7fe548068680 msgr2=0x7fe548068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:42.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.582+0000 7fe54c9d9700 1 -- 172.21.15.6:0/1885939002 shutdown_connections 2023-10-06T02:27:42.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.582+0000 7fe54c9d9700 1 -- 172.21.15.6:0/1885939002 wait complete. 2023-10-06T02:27:42.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.583+0000 7fe54c9d9700 1 Processor -- start 2023-10-06T02:27:42.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.583+0000 7fe54c9d9700 1 -- start start 2023-10-06T02:27:42.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.584+0000 7fe54c9d9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5480af4e0 0x7fe54816d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:42.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.584+0000 7fe54c9d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5480af8b0 0x7fe548154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:42.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.584+0000 7fe54c9d9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5480b27f0 0x7fe548154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:42.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.584+0000 7fe54c9d9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480cf4a0 con 0x7fe5480af8b0 2023-10-06T02:27:42.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.584+0000 7fe54c9d9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480cee90 con 0x7fe5480b27f0 2023-10-06T02:27:42.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.584+0000 7fe54c9d9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5481578a0 con 0x7fe5480af4e0 2023-10-06T02:27:42.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.584+0000 7fe545d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5480af8b0 0x7fe548154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:42.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.584+0000 7fe545d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5480af8b0 0x7fe548154890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42274/0 (socket says 172.21.15.6:42274) 2023-10-06T02:27:42.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.584+0000 7fe545d9b700 1 -- 172.21.15.6:0/4154802915 learned_addr learned my addr 172.21.15.6:0/4154802915 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.584+0000 7fe546d9d700 1 --2- 172.21.15.6:0/4154802915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5480b27f0 0x7fe548154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.584+0000 7fe54659c700 1 --2- 172.21.15.6:0/4154802915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5480af4e0 0x7fe54816d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.584+0000 7fe545d9b700 1 -- 172.21.15.6:0/4154802915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5480af4e0 msgr2=0x7fe54816d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.584+0000 7fe545d9b700 1 --2- 172.21.15.6:0/4154802915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5480af4e0 0x7fe54816d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.584+0000 7fe545d9b700 1 -- 172.21.15.6:0/4154802915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5480b27f0 msgr2=0x7fe548154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.584+0000 7fe545d9b700 1 --2- 172.21.15.6:0/4154802915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5480b27f0 0x7fe548154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.584+0000 7fe545d9b700 1 -- 172.21.15.6:0/4154802915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5400094f0 con 0x7fe5480af8b0 2023-10-06T02:27:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.584+0000 7fe545d9b700 1 --2- 172.21.15.6:0/4154802915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5480af8b0 0x7fe548154890 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fe53000d7e0 tx=0x7fe530008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.585+0000 7fe53e7fc700 1 -- 172.21.15.6:0/4154802915 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5300125f0 con 0x7fe5480af8b0 2023-10-06T02:27:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.585+0000 7fe53e7fc700 1 -- 172.21.15.6:0/4154802915 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe530012750 con 0x7fe5480af8b0 2023-10-06T02:27:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.585+0000 7fe54c9d9700 1 -- 172.21.15.6:0/4154802915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5480cf130 con 0x7fe5480af8b0 2023-10-06T02:27:42.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.585+0000 7fe53e7fc700 1 -- 172.21.15.6:0/4154802915 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe530012b10 con 0x7fe5480af8b0 2023-10-06T02:27:42.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.585+0000 7fe54c9d9700 1 -- 172.21.15.6:0/4154802915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54816d610 con 0x7fe5480af8b0 2023-10-06T02:27:42.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.586+0000 7fe54c9d9700 1 -- 172.21.15.6:0/4154802915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5480cf610 con 0x7fe5480af8b0 2023-10-06T02:27:42.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.586+0000 7fe53e7fc700 1 -- 172.21.15.6:0/4154802915 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe530013480 con 0x7fe5480af8b0 2023-10-06T02:27:42.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.586+0000 7fe53e7fc700 1 --2- 172.21.15.6:0/4154802915 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe528066f30 0x7fe5280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:42.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.586+0000 7fe53e7fc700 1 -- 172.21.15.6:0/4154802915 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8614+0+0 (secure 0 0 0) 0x7fe5300854c0 con 0x7fe5480af8b0 2023-10-06T02:27:42.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.587+0000 7fe54659c700 1 --2- 172.21.15.6:0/4154802915 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe528066f30 0x7fe5280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:42.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.587+0000 7fe54659c700 1 --2- 172.21.15.6:0/4154802915 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe528066f30 0x7fe5280693e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fe538007fd0 tx=0x7fe538001650 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:42.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.591+0000 7fe53e7fc700 1 -- 172.21.15.6:0/4154802915 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe530055620 con 0x7fe5480af8b0 2023-10-06T02:27:42.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.829+0000 7fe54c9d9700 1 -- 172.21.15.6:0/4154802915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5480b0910 con 0x7fe5480af8b0 2023-10-06T02:27:42.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.829+0000 7fe53e7fc700 1 -- 172.21.15.6:0/4154802915 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 255 v255) v1 ==== 95+0+4604 (secure 0 0 0) 0x7fe5300551b0 con 0x7fe5480af8b0 2023-10-06T02:27:42.830 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:42.830 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":255,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":255,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:42.032599+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9597":{"gid":9597,"name":"a","rank":0,"incarnation":255,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/4129427704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":4129427704},{"type":"v1","addr":"172.21.15.6:6835","nonce":4129427704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.831+0000 7fe54c9d9700 1 -- 172.21.15.6:0/4154802915 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe528066f30 msgr2=0x7fe5280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.831+0000 7fe54c9d9700 1 --2- 172.21.15.6:0/4154802915 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe528066f30 0x7fe5280693e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fe538007fd0 tx=0x7fe538001650 comp rx=0 tx=0).stop 2023-10-06T02:27:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.831+0000 7fe54c9d9700 1 -- 172.21.15.6:0/4154802915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5480af8b0 msgr2=0x7fe548154890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.831+0000 7fe54c9d9700 1 --2- 172.21.15.6:0/4154802915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5480af8b0 0x7fe548154890 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fe53000d7e0 tx=0x7fe530008040 comp rx=0 tx=0).stop 2023-10-06T02:27:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.831+0000 7fe54c9d9700 1 -- 172.21.15.6:0/4154802915 shutdown_connections 2023-10-06T02:27:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.831+0000 7fe54c9d9700 1 --2- 172.21.15.6:0/4154802915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5480b27f0 0x7fe548154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.831+0000 7fe54c9d9700 1 --2- 172.21.15.6:0/4154802915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5480af4e0 0x7fe54816d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.831+0000 7fe54c9d9700 1 --2- 172.21.15.6:0/4154802915 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe528066f30 0x7fe5280693e0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.831+0000 7fe54c9d9700 1 --2- 172.21.15.6:0/4154802915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5480af8b0 0x7fe548154890 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.831+0000 7fe54c9d9700 1 -- 172.21.15.6:0/4154802915 >> 172.21.15.6:0/4154802915 conn(0x7fe548068680 msgr2=0x7fe54815c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:42.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.831+0000 7fe54c9d9700 1 -- 172.21.15.6:0/4154802915 shutdown_connections 2023-10-06T02:27:42.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:42.831+0000 7fe54c9d9700 1 -- 172.21.15.6:0/4154802915 wait complete. 2023-10-06T02:27:42.835 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 255 2023-10-06T02:27:42.844 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 255, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:27:42.032599+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 121, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9597}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9597': {'gid': 9597, 'name': 'a', 'rank': 0, 'incarnation': 255, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.6:6835/4129427704', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 4129427704}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 4129427704}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:27:42.844 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9597:up:replay 2023-10-06T02:27:42.844 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2023-10-06T02:27:48.248 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:48.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.380+0000 7f7043b2c700 1 Processor -- start 2023-10-06T02:27:48.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.380+0000 7f7043b2c700 1 -- start start 2023-10-06T02:27:48.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.381+0000 7f7043b2c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f703c0af8b0 0x7f703c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.381+0000 7f7043b2c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c15e190 con 0x7f703c0b27f0 2023-10-06T02:27:48.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.381+0000 7f7043b2c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c0cb650 con 0x7f703c0af4e0 2023-10-06T02:27:48.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.381+0000 7f7043b2c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703c0b1910 con 0x7f703c0af8b0 2023-10-06T02:27:48.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.381+0000 7f70420c9700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f703c0b27f0 0x7f703c15d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38964/0 (socket says 172.21.15.6:38964) 2023-10-06T02:27:48.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.381+0000 7f70420c9700 1 -- 172.21.15.6:0/793842173 learned_addr learned my addr 172.21.15.6:0/793842173 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:48.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.381+0000 7f70410c7700 1 --2- 172.21.15.6:0/793842173 >> v2:172.21.15.175:3300/0 conn(0x7f703c0af8b0 0x7f703c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.381+0000 7f70408c6700 1 -- 172.21.15.6:0/793842173 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172873989 0 0) 0x7f703c15e190 con 0x7f703c0b27f0 2023-10-06T02:27:48.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.381+0000 7f70408c6700 1 -- 172.21.15.6:0/793842173 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7024003570 con 0x7f703c0b27f0 2023-10-06T02:27:48.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.381+0000 7f70410c7700 1 -- 172.21.15.6:0/793842173 >> v1:172.21.15.175:6789/0 conn(0x7f703c0af4e0 legacy=0x7f703c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.381+0000 7f70410c7700 1 -- 172.21.15.6:0/793842173 >> v1:172.21.15.6:6789/0 conn(0x7f703c0b27f0 legacy=0x7f703c15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.381+0000 7f70410c7700 1 -- 172.21.15.6:0/793842173 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c0ccaf0 con 0x7f703c0af8b0 2023-10-06T02:27:48.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.382+0000 7f70410c7700 1 --2- 172.21.15.6:0/793842173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f703c0af8b0 0x7f703c15d460 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f70300098e0 tx=0x7f70300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bf625092a1afffe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.382+0000 7f70408c6700 1 -- 172.21.15.6:0/793842173 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703000b640 con 0x7f703c0af8b0 2023-10-06T02:27:48.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.382+0000 7f70408c6700 1 -- 172.21.15.6:0/793842173 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703000b7a0 con 0x7f703c0af8b0 2023-10-06T02:27:48.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.382+0000 7f70408c6700 1 -- 172.21.15.6:0/793842173 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703000bb40 con 0x7f703c0af8b0 2023-10-06T02:27:48.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.382+0000 7f7043b2c700 1 -- 172.21.15.6:0/793842173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f703c0af8b0 msgr2=0x7f703c15d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.382+0000 7f7043b2c700 1 --2- 172.21.15.6:0/793842173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f703c0af8b0 0x7f703c15d460 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f70300098e0 tx=0x7f70300091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.382+0000 7f7043b2c700 1 -- 172.21.15.6:0/793842173 shutdown_connections 2023-10-06T02:27:48.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.382+0000 7f7043b2c700 1 --2- 172.21.15.6:0/793842173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f703c0af8b0 0x7f703c15d460 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.382+0000 7f7043b2c700 1 -- 172.21.15.6:0/793842173 >> 172.21.15.6:0/793842173 conn(0x7f703c068680 msgr2=0x7f703c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:48.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.383+0000 7f7043b2c700 1 -- 172.21.15.6:0/793842173 shutdown_connections 2023-10-06T02:27:48.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.383+0000 7f7043b2c700 1 -- 172.21.15.6:0/793842173 wait complete. 2023-10-06T02:27:48.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.384+0000 7f7043b2c700 1 Processor -- start 2023-10-06T02:27:48.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.384+0000 7f7043b2c700 1 -- start start 2023-10-06T02:27:48.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.384+0000 7f7043b2c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f703c0af4e0 0x7f703c1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.384+0000 7f7043b2c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f703c0af8b0 0x7f703c155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.384+0000 7f7043b2c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f703c0b27f0 0x7f703c0c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.384+0000 7f7043b2c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c157150 con 0x7f703c0af8b0 2023-10-06T02:27:48.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.384+0000 7f7043b2c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c156540 con 0x7f703c0af4e0 2023-10-06T02:27:48.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.384+0000 7f7043b2c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c156820 con 0x7f703c0b27f0 2023-10-06T02:27:48.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.384+0000 7f70410c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f703c0af8b0 0x7f703c155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.385+0000 7f70410c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f703c0af8b0 0x7f703c155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42282/0 (socket says 172.21.15.6:42282) 2023-10-06T02:27:48.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.385+0000 7f70410c7700 1 -- 172.21.15.6:0/313672176 learned_addr learned my addr 172.21.15.6:0/313672176 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:48.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.385+0000 7f70418c8700 1 --2- 172.21.15.6:0/313672176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f703c0af4e0 0x7f703c1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.385+0000 7f70420c9700 1 --2- 172.21.15.6:0/313672176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f703c0b27f0 0x7f703c0c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.385+0000 7f70410c7700 1 -- 172.21.15.6:0/313672176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f703c0b27f0 msgr2=0x7f703c0c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.385+0000 7f70410c7700 1 --2- 172.21.15.6:0/313672176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f703c0b27f0 0x7f703c0c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.385+0000 7f70410c7700 1 -- 172.21.15.6:0/313672176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f703c0af4e0 msgr2=0x7f703c1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.385+0000 7f70410c7700 1 --2- 172.21.15.6:0/313672176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f703c0af4e0 0x7f703c1519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.385+0000 7f70410c7700 1 -- 172.21.15.6:0/313672176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030009420 con 0x7f703c0af8b0 2023-10-06T02:27:48.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.385+0000 7f70420c9700 1 --2- 172.21.15.6:0/313672176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f703c0b27f0 0x7f703c0c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:48.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.385+0000 7f70418c8700 1 --2- 172.21.15.6:0/313672176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f703c0af4e0 0x7f703c1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:48.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.385+0000 7f70410c7700 1 --2- 172.21.15.6:0/313672176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f703c0af8b0 0x7f703c155b60 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f70300093f0 tx=0x7f7030017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.385+0000 7f7039ffb700 1 -- 172.21.15.6:0/313672176 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703000bb20 con 0x7f703c0af8b0 2023-10-06T02:27:48.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.385+0000 7f7039ffb700 1 -- 172.21.15.6:0/313672176 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7030011420 con 0x7f703c0af8b0 2023-10-06T02:27:48.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.385+0000 7f7043b2c700 1 -- 172.21.15.6:0/313672176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703c156b00 con 0x7f703c0af8b0 2023-10-06T02:27:48.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.385+0000 7f7039ffb700 1 -- 172.21.15.6:0/313672176 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030011800 con 0x7f703c0af8b0 2023-10-06T02:27:48.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.385+0000 7f7043b2c700 1 -- 172.21.15.6:0/313672176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703c151ef0 con 0x7f703c0af8b0 2023-10-06T02:27:48.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.386+0000 7f7043b2c700 1 -- 172.21.15.6:0/313672176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703c153c00 con 0x7f703c0af8b0 2023-10-06T02:27:48.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.387+0000 7f7039ffb700 1 -- 172.21.15.6:0/313672176 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7030011c30 con 0x7f703c0af8b0 2023-10-06T02:27:48.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.387+0000 7f7039ffb700 1 --2- 172.21.15.6:0/313672176 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7028066f60 0x7f7028069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.387+0000 7f7039ffb700 1 -- 172.21.15.6:0/313672176 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8614+0+0 (secure 0 0 0) 0x7f70300868b0 con 0x7f703c0af8b0 2023-10-06T02:27:48.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.387+0000 7f70418c8700 1 --2- 172.21.15.6:0/313672176 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7028066f60 0x7f7028069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.388+0000 7f70418c8700 1 --2- 172.21.15.6:0/313672176 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7028066f60 0x7f7028069410 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f703c0c93f0 tx=0x7f702c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.392+0000 7f7039ffb700 1 -- 172.21.15.6:0/313672176 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f703c153c00 con 0x7f703c0af8b0 2023-10-06T02:27:48.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.632+0000 7f7043b2c700 1 -- 172.21.15.6:0/313672176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f703c153c00 con 0x7f703c0af8b0 2023-10-06T02:27:48.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.632+0000 7f7039ffb700 1 -- 172.21.15.6:0/313672176 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 258 v258) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f703c153c00 con 0x7f703c0af8b0 2023-10-06T02:27:48.633 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:48.633 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":258,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":258,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:45.053249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9597":{"gid":9597,"name":"a","rank":0,"incarnation":255,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/4129427704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":4129427704},{"type":"v1","addr":"172.21.15.6:6835","nonce":4129427704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.635+0000 7f7043b2c700 1 -- 172.21.15.6:0/313672176 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7028066f60 msgr2=0x7f7028069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.635+0000 7f7043b2c700 1 --2- 172.21.15.6:0/313672176 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7028066f60 0x7f7028069410 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f703c0c93f0 tx=0x7f702c009040 comp rx=0 tx=0).stop 2023-10-06T02:27:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.635+0000 7f7043b2c700 1 -- 172.21.15.6:0/313672176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f703c0af8b0 msgr2=0x7f703c155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.635+0000 7f7043b2c700 1 --2- 172.21.15.6:0/313672176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f703c0af8b0 0x7f703c155b60 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f70300093f0 tx=0x7f7030017000 comp rx=0 tx=0).stop 2023-10-06T02:27:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.635+0000 7f7043b2c700 1 -- 172.21.15.6:0/313672176 shutdown_connections 2023-10-06T02:27:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.635+0000 7f7043b2c700 1 --2- 172.21.15.6:0/313672176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f703c0b27f0 0x7f703c0c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.635+0000 7f7043b2c700 1 --2- 172.21.15.6:0/313672176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f703c0af4e0 0x7f703c1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.635+0000 7f7043b2c700 1 --2- 172.21.15.6:0/313672176 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7028066f60 0x7f7028069410 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.635+0000 7f7043b2c700 1 --2- 172.21.15.6:0/313672176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f703c0af8b0 0x7f703c155b60 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.635+0000 7f7043b2c700 1 -- 172.21.15.6:0/313672176 >> 172.21.15.6:0/313672176 conn(0x7f703c068680 msgr2=0x7f703c0cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:48.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.635+0000 7f7043b2c700 1 -- 172.21.15.6:0/313672176 shutdown_connections 2023-10-06T02:27:48.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.635+0000 7f7043b2c700 1 -- 172.21.15.6:0/313672176 wait complete. 2023-10-06T02:27:48.637 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 258 2023-10-06T02:27:48.647 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 258, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:27:45.053249+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 121, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9597}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9597': {'gid': 9597, 'name': 'a', 'rank': 0, 'incarnation': 255, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.6:6835/4129427704', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 4129427704}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 4129427704}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:27:48.647 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:27:48.647 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:27:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.767+0000 7fb39c734700 1 Processor -- start 2023-10-06T02:27:48.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.767+0000 7fb39c734700 1 -- start start 2023-10-06T02:27:48.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.768+0000 7fb39c734700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb39415a030 0x7fb39415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.768+0000 7fb39c734700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb39415a940 0x7fb394086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.768+0000 7fb39c734700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb394087530 0x7fb3940b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.768+0000 7fb39c734700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3940b0cf0 con 0x7fb394087530 2023-10-06T02:27:48.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.768+0000 7fb39c734700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb394087960 con 0x7fb39415a940 2023-10-06T02:27:48.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.768+0000 7fb39c734700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3940afc50 con 0x7fb39415a030 2023-10-06T02:27:48.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.768+0000 7fb39acd1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb394087530 0x7fb3940b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.768+0000 7fb39acd1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb394087530 0x7fb3940b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36570/0 (socket says 172.21.15.6:36570) 2023-10-06T02:27:48.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.768+0000 7fb39acd1700 1 -- 172.21.15.6:0/2115942856 learned_addr learned my addr 172.21.15.6:0/2115942856 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:48.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.769+0000 7fb39a4d0700 1 --2- 172.21.15.6:0/2115942856 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb39415a030 0x7fb39415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.769+0000 7fb399ccf700 1 --2- 172.21.15.6:0/2115942856 >> v2:172.21.15.175:3300/0 conn(0x7fb39415a940 0x7fb394086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.769+0000 7fb39acd1700 1 -- 172.21.15.6:0/2115942856 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb39415a030 msgr2=0x7fb39415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:48.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.769+0000 7fb39acd1700 1 --2- 172.21.15.6:0/2115942856 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb39415a030 0x7fb39415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.769+0000 7fb39acd1700 1 -- 172.21.15.6:0/2115942856 >> v2:172.21.15.175:3300/0 conn(0x7fb39415a940 msgr2=0x7fb394086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:48.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.769+0000 7fb39acd1700 1 --2- 172.21.15.6:0/2115942856 >> v2:172.21.15.175:3300/0 conn(0x7fb39415a940 0x7fb394086ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.769+0000 7fb39acd1700 1 -- 172.21.15.6:0/2115942856 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3940aff30 con 0x7fb394087530 2023-10-06T02:27:48.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.769+0000 7fb39acd1700 1 --2- 172.21.15.6:0/2115942856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb394087530 0x7fb3940b21b0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7fb394089180 tx=0x7fb384009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b88fa12edae928 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.769+0000 7fb3994ce700 1 -- 172.21.15.6:0/2115942856 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38400e070 con 0x7fb394087530 2023-10-06T02:27:48.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.769+0000 7fb3994ce700 1 -- 172.21.15.6:0/2115942856 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38400ba50 con 0x7fb394087530 2023-10-06T02:27:48.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.769+0000 7fb3994ce700 1 -- 172.21.15.6:0/2115942856 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3840092e0 con 0x7fb394087530 2023-10-06T02:27:48.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.770+0000 7fb39c734700 1 -- 172.21.15.6:0/2115942856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb394087530 msgr2=0x7fb3940b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.770+0000 7fb39c734700 1 --2- 172.21.15.6:0/2115942856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb394087530 0x7fb3940b21b0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7fb394089180 tx=0x7fb384009840 comp rx=0 tx=0).stop 2023-10-06T02:27:48.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.770+0000 7fb39c734700 1 -- 172.21.15.6:0/2115942856 shutdown_connections 2023-10-06T02:27:48.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.770+0000 7fb39c734700 1 --2- 172.21.15.6:0/2115942856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb394087530 0x7fb3940b21b0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.770+0000 7fb39c734700 1 --2- 172.21.15.6:0/2115942856 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb39415a030 0x7fb39415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.770+0000 7fb39c734700 1 --2- 172.21.15.6:0/2115942856 >> v2:172.21.15.175:3300/0 conn(0x7fb39415a940 0x7fb394086ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.770+0000 7fb39c734700 1 -- 172.21.15.6:0/2115942856 >> 172.21.15.6:0/2115942856 conn(0x7fb394068680 msgr2=0x7fb394068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:48.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.770+0000 7fb39c734700 1 -- 172.21.15.6:0/2115942856 shutdown_connections 2023-10-06T02:27:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.770+0000 7fb39c734700 1 -- 172.21.15.6:0/2115942856 wait complete. 2023-10-06T02:27:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.771+0000 7fb39c734700 1 Processor -- start 2023-10-06T02:27:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.771+0000 7fb39c734700 1 -- start start 2023-10-06T02:27:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.771+0000 7fb39c734700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb394087530 0x7fb39415ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.771+0000 7fb39c734700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39415a030 0x7fb3941559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.771+0000 7fb39c734700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb39415a940 0x7fb3940aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb39c734700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3940c5dc0 con 0x7fb39415a030 2023-10-06T02:27:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb39c734700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39415c5c0 con 0x7fb394087530 2023-10-06T02:27:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb39c734700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39415b9b0 con 0x7fb39415a940 2023-10-06T02:27:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb399ccf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39415a030 0x7fb3941559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb399ccf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39415a030 0x7fb3941559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36578/0 (socket says 172.21.15.6:36578) 2023-10-06T02:27:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb399ccf700 1 -- 172.21.15.6:0/2453500618 learned_addr learned my addr 172.21.15.6:0/2453500618 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:48.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb39a4d0700 1 --2- 172.21.15.6:0/2453500618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb394087530 0x7fb39415ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb39acd1700 1 --2- 172.21.15.6:0/2453500618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb39415a940 0x7fb3940aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb399ccf700 1 -- 172.21.15.6:0/2453500618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb39415a940 msgr2=0x7fb3940aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb399ccf700 1 --2- 172.21.15.6:0/2453500618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb39415a940 0x7fb3940aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb399ccf700 1 -- 172.21.15.6:0/2453500618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb394087530 msgr2=0x7fb39415ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb399ccf700 1 --2- 172.21.15.6:0/2453500618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb394087530 0x7fb39415ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb399ccf700 1 -- 172.21.15.6:0/2453500618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb384009ae0 con 0x7fb39415a030 2023-10-06T02:27:48.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb399ccf700 1 --2- 172.21.15.6:0/2453500618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39415a030 0x7fb3941559e0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7fb388006b00 tx=0x7fb388008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb3927fc700 1 -- 172.21.15.6:0/2453500618 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3880125f0 con 0x7fb39415a030 2023-10-06T02:27:48.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb3927fc700 1 -- 172.21.15.6:0/2453500618 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb388012770 con 0x7fb39415a030 2023-10-06T02:27:48.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb39c734700 1 -- 172.21.15.6:0/2453500618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39415bc90 con 0x7fb39415a030 2023-10-06T02:27:48.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb3927fc700 1 -- 172.21.15.6:0/2453500618 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388012b30 con 0x7fb39415a030 2023-10-06T02:27:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.772+0000 7fb39c734700 1 -- 172.21.15.6:0/2453500618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39415c250 con 0x7fb39415a030 2023-10-06T02:27:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.774+0000 7fb3927fc700 1 -- 172.21.15.6:0/2453500618 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb38801e460 con 0x7fb39415a030 2023-10-06T02:27:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.774+0000 7fb3927fc700 1 --2- 172.21.15.6:0/2453500618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb380066f30 0x7fb3800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.774+0000 7fb3927fc700 1 -- 172.21.15.6:0/2453500618 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8614+0+0 (secure 0 0 0) 0x7fb388085530 con 0x7fb39415a030 2023-10-06T02:27:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.774+0000 7fb39a4d0700 1 --2- 172.21.15.6:0/2453500618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb380066f30 0x7fb3800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.775+0000 7fb39a4d0700 1 --2- 172.21.15.6:0/2453500618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb380066f30 0x7fb3800693e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb38c006fd0 tx=0x7fb38c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.776+0000 7fb3a5a2cb80 1 Processor -- start 2023-10-06T02:27:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.776+0000 7fb3a5a2cb80 1 -- start start 2023-10-06T02:27:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.777+0000 7fb3a5a2cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cee840 0x560270ceec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.777+0000 7fb3a5a2cb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cefcc0 0x560270d3e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.777+0000 7fb3a5a2cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d3f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.777+0000 7fb3a5a2cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560270c45a70 con 0x560270d3ec00 2023-10-06T02:27:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.777+0000 7fb3a5a2cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560270c43270 con 0x560270cee840 2023-10-06T02:27:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.777+0000 7fb3a5a2cb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560270c3f060 con 0x560270cefcc0 2023-10-06T02:27:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.777+0000 7fb39acd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d3f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.777+0000 7fb39acd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d3f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36586/0 (socket says 172.21.15.6:36586) 2023-10-06T02:27:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.777+0000 7fb39acd1700 1 -- 172.21.15.6:0/559139658 learned_addr learned my addr 172.21.15.6:0/559139658 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.777+0000 7fb39a4d0700 1 --2- 172.21.15.6:0/559139658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cee840 0x560270ceec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.777+0000 7fb399ccf700 1 --2- 172.21.15.6:0/559139658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cefcc0 0x560270d3e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.777+0000 7fb39acd1700 1 -- 172.21.15.6:0/559139658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cefcc0 msgr2=0x560270d3e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.777+0000 7fb39acd1700 1 --2- 172.21.15.6:0/559139658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cefcc0 0x560270d3e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.777+0000 7fb39acd1700 1 -- 172.21.15.6:0/559139658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cee840 msgr2=0x560270ceec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.777+0000 7fb39acd1700 1 --2- 172.21.15.6:0/559139658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cee840 0x560270ceec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.777+0000 7fb39acd1700 1 -- 172.21.15.6:0/559139658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560270ad9270 con 0x560270d3ec00 2023-10-06T02:27:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.777+0000 7fb39acd1700 1 --2- 172.21.15.6:0/559139658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d3f050 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fb384009fd0 tx=0x7fb384018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea275e11d4bfcf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.778+0000 7fb37b7fe700 1 -- 172.21.15.6:0/559139658 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384007240 con 0x560270d3ec00 2023-10-06T02:27:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.778+0000 7fb37b7fe700 1 -- 172.21.15.6:0/559139658 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38400bbc0 con 0x560270d3ec00 2023-10-06T02:27:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.778+0000 7fb37b7fe700 1 -- 172.21.15.6:0/559139658 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384007610 con 0x560270d3ec00 2023-10-06T02:27:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.778+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/559139658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 msgr2=0x560270d3f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.778+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/559139658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d3f050 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fb384009fd0 tx=0x7fb384018000 comp rx=0 tx=0).stop 2023-10-06T02:27:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.778+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/559139658 shutdown_connections 2023-10-06T02:27:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.778+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/559139658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d3f050 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.778+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/559139658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cee840 0x560270ceec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.778+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/559139658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cefcc0 0x560270d3e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.778+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/559139658 >> 172.21.15.6:0/559139658 conn(0x560270cf0160 msgr2=0x560270cf0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.778+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/559139658 shutdown_connections 2023-10-06T02:27:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.778+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/559139658 wait complete. 2023-10-06T02:27:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.779+0000 7fb3a5a2cb80 1 -- start start 2023-10-06T02:27:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.779+0000 7fb3a5a2cb80 1 Processor -- start 2023-10-06T02:27:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb3a5a2cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cee840 0x560270d2ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb3a5a2cb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cefcc0 0x560270d360c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb3a5a2cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d37ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb3a5a2cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560270bea890 con 0x560270d3ec00 2023-10-06T02:27:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb3a5a2cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560270c05ea0 con 0x560270cee840 2023-10-06T02:27:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb3a5a2cb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560270ac1e30 con 0x560270cefcc0 2023-10-06T02:27:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb3a5a2cb80 10 client.0 _ll_register_callbacks cb 0x560270cb1e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:27:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb39acd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d37ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb39acd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d37ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36588/0 (socket says 172.21.15.6:36588) 2023-10-06T02:27:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb39acd1700 1 -- 172.21.15.6:0/1272540255 learned_addr learned my addr 172.21.15.6:0/1272540255 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb399ccf700 1 --2- 172.21.15.6:0/1272540255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cefcc0 0x560270d360c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb39a4d0700 1 --2- 172.21.15.6:0/1272540255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cee840 0x560270d2ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb39acd1700 1 -- 172.21.15.6:0/1272540255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cefcc0 msgr2=0x560270d360c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb39acd1700 1 --2- 172.21.15.6:0/1272540255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cefcc0 0x560270d360c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb39acd1700 1 -- 172.21.15.6:0/1272540255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cee840 msgr2=0x560270d2ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb39acd1700 1 --2- 172.21.15.6:0/1272540255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cee840 0x560270d2ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb39acd1700 1 -- 172.21.15.6:0/1272540255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3940aff30 con 0x560270d3ec00 2023-10-06T02:27:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb39acd1700 1 --2- 172.21.15.6:0/1272540255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d37ed0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fb384007d50 tx=0x7fb384020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f9b6589880c5e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.780+0000 7fb378ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:27:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.781+0000 7fb378ff9700 1 -- 172.21.15.6:0/1272540255 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38402c070 con 0x560270d3ec00 2023-10-06T02:27:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.781+0000 7fb378ff9700 1 -- 172.21.15.6:0/1272540255 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8614+0+0 (secure 0 0 0) 0x7fb384027670 con 0x560270d3ec00 2023-10-06T02:27:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.781+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/1272540255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560270ce3940 con 0x560270d3ec00 2023-10-06T02:27:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.781+0000 7fb378ff9700 1 -- 172.21.15.6:0/1272540255 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=258) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3840032f0 con 0x560270d3ec00 2023-10-06T02:27:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.781+0000 7fb3a5a2cb80 10 client.9684 fetch_fsmap learned FSMap version 258 2023-10-06T02:27:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.781+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/1272540255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=258,monmap=2+}) v3 -- 0x560270a7bfe0 con 0x560270d3ec00 2023-10-06T02:27:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.781+0000 7fb378ff9700 1 -- 172.21.15.6:0/1272540255 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38403c020 con 0x560270d3ec00 2023-10-06T02:27:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.781+0000 7fb378ff9700 1 -- 172.21.15.6:0/1272540255 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 258) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb384019030 con 0x560270d3ec00 2023-10-06T02:27:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.781+0000 7fb3a5a2cb80 10 client.9684 fetch_fsmap finished waiting for FSMap version 258 2023-10-06T02:27:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.781+0000 7fb3a5a2cb80 10 client.9684 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:27:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.781+0000 7fb3a5a2cb80 20 client.9684 populate_metadata read hostname 'smithi006' 2023-10-06T02:27:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.781+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/1272540255 >> [v2:172.21.15.6:6833/4129427704,v1:172.21.15.6:6835/4129427704] conn(0x560270d301b0 0x560270d30580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.781+0000 7fb3a5a2cb80 4 client.9684 mds_command: new command op to 9597 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:27:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.781+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/1272540255 --> [v2:172.21.15.6:6833/4129427704,v1:172.21.15.6:6835/4129427704] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560270cc0870 con 0x560270d301b0 2023-10-06T02:27:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.781+0000 7fb39a4d0700 1 --2- 172.21.15.6:0/1272540255 >> [v2:172.21.15.6:6833/4129427704,v1:172.21.15.6:6835/4129427704] conn(0x560270d301b0 0x560270d30580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.782+0000 7fb378ff9700 10 client.9684 ms_handle_connect on v2:172.21.15.6:6833/4129427704 2023-10-06T02:27:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.782+0000 7fb39a4d0700 1 --2- 172.21.15.6:0/1272540255 >> [v2:172.21.15.6:6833/4129427704,v1:172.21.15.6:6835/4129427704] conn(0x560270d301b0 0x560270d30580 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9cf1eab9294620a server_cookie=874d3df323099792 in_seq=0 out_seq=0 2023-10-06T02:27:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.782+0000 7fb378ff9700 1 -- 172.21.15.6:0/1272540255 <== mds.0 v2:172.21.15.6:6833/4129427704 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560270cc0870 con 0x560270d301b0 2023-10-06T02:27:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.782+0000 7fb378ff9700 10 client.9684 handle_command_reply: tid=0 2023-10-06T02:27:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.782+0000 7fb3a5a2cb80 1 client.9684 shutdown 2023-10-06T02:27:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.782+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/1272540255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 msgr2=0x560270d37ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.782+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/1272540255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d37ed0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fb384007d50 tx=0x7fb384020040 comp rx=0 tx=0).stop 2023-10-06T02:27:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.782+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/1272540255 shutdown_connections 2023-10-06T02:27:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.782+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/1272540255 >> [v2:172.21.15.6:6833/4129427704,v1:172.21.15.6:6835/4129427704] conn(0x560270d301b0 0x560270d30580 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.782+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/1272540255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d37ed0 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.782+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/1272540255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cee840 0x560270d2ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.782+0000 7fb378ff9700 0 client.9684 ms_handle_reset on v2:172.21.15.6:6833/4129427704 2023-10-06T02:27:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.782+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/1272540255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cefcc0 0x560270d360c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.782+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/1272540255 >> 172.21.15.6:0/1272540255 conn(0x560270cf0160 msgr2=0x560270cef1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.783+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/1272540255 shutdown_connections 2023-10-06T02:27:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.783+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/1272540255 wait complete. 2023-10-06T02:27:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.783+0000 7fb3a5a2cb80 20 client.9684 trim_cache size 0 max 16384 2023-10-06T02:27:48.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.800+0000 7fb3a5a2cb80 1 Processor -- start 2023-10-06T02:27:48.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.800+0000 7fb3a5a2cb80 1 -- start start 2023-10-06T02:27:48.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.800+0000 7fb3a5a2cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cee840 0x560270d1e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.800+0000 7fb3a5a2cb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cefcc0 0x560270d1e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.800+0000 7fb3a5a2cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d323b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.800+0000 7fb3a5a2cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560270d3ea40 con 0x560270d3ec00 2023-10-06T02:27:48.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.800+0000 7fb3a5a2cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560270d35cc0 con 0x560270cee840 2023-10-06T02:27:48.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.800+0000 7fb3a5a2cb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560270cce2e0 con 0x560270cefcc0 2023-10-06T02:27:48.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.801+0000 7fb39acd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d323b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.801+0000 7fb39acd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d323b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36592/0 (socket says 172.21.15.6:36592) 2023-10-06T02:27:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.801+0000 7fb39acd1700 1 -- 172.21.15.6:0/3928545436 learned_addr learned my addr 172.21.15.6:0/3928545436 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.801+0000 7fb399ccf700 1 --2- 172.21.15.6:0/3928545436 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cefcc0 0x560270d1e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.801+0000 7fb39a4d0700 1 --2- 172.21.15.6:0/3928545436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cee840 0x560270d1e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.801+0000 7fb39acd1700 1 -- 172.21.15.6:0/3928545436 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cefcc0 msgr2=0x560270d1e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.801+0000 7fb39acd1700 1 --2- 172.21.15.6:0/3928545436 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cefcc0 0x560270d1e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.801+0000 7fb39acd1700 1 -- 172.21.15.6:0/3928545436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cee840 msgr2=0x560270d1e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.801+0000 7fb39acd1700 1 --2- 172.21.15.6:0/3928545436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cee840 0x560270d1e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.801+0000 7fb39acd1700 1 -- 172.21.15.6:0/3928545436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560270c0d780 con 0x560270d3ec00 2023-10-06T02:27:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.801+0000 7fb39a4d0700 1 --2- 172.21.15.6:0/3928545436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cee840 0x560270d1e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.801+0000 7fb39acd1700 1 --2- 172.21.15.6:0/3928545436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d323b0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fb384009880 tx=0x7fb384029070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142c8e30a1a441dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.801+0000 7fb37bfff700 1 -- 172.21.15.6:0/3928545436 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384021020 con 0x560270d3ec00 2023-10-06T02:27:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.801+0000 7fb37bfff700 1 -- 172.21.15.6:0/3928545436 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38403c040 con 0x560270d3ec00 2023-10-06T02:27:48.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.801+0000 7fb37bfff700 1 -- 172.21.15.6:0/3928545436 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38402c070 con 0x560270d3ec00 2023-10-06T02:27:48.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.802+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/3928545436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 msgr2=0x560270d323b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.802+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/3928545436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d323b0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fb384009880 tx=0x7fb384029070 comp rx=0 tx=0).stop 2023-10-06T02:27:48.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.802+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/3928545436 shutdown_connections 2023-10-06T02:27:48.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.802+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/3928545436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d323b0 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.802+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/3928545436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cee840 0x560270d1e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.802+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/3928545436 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cefcc0 0x560270d1e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.802+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/3928545436 >> 172.21.15.6:0/3928545436 conn(0x560270cf0160 msgr2=0x560270ce9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:48.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.802+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/3928545436 shutdown_connections 2023-10-06T02:27:48.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.802+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/3928545436 wait complete. 2023-10-06T02:27:48.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.802+0000 7fb3a5a2cb80 1 -- start start 2023-10-06T02:27:48.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.802+0000 7fb3a5a2cb80 1 Processor -- start 2023-10-06T02:27:48.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.803+0000 7fb3a5a2cb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cee840 0x560270cef690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.803+0000 7fb3a5a2cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cefcc0 0x560270d93fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.803+0000 7fb3a5a2cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d12790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.803+0000 7fb3a5a2cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560270d13520 con 0x560270d3ec00 2023-10-06T02:27:48.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.803+0000 7fb3a5a2cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560270d9aa10 con 0x560270cefcc0 2023-10-06T02:27:48.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.803+0000 7fb3a5a2cb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560270d38a60 con 0x560270cee840 2023-10-06T02:27:48.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.803+0000 7fb3a5a2cb80 10 client.0 _ll_register_callbacks cb 0x560270cb1e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:27:48.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.803+0000 7fb39acd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d12790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.803+0000 7fb39a4d0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cee840 0x560270cef690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.803+0000 7fb39acd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d12790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36600/0 (socket says 172.21.15.6:36600) 2023-10-06T02:27:48.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.803+0000 7fb39acd1700 1 -- 172.21.15.6:0/3468076022 learned_addr learned my addr 172.21.15.6:0/3468076022 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:48.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.803+0000 7fb399ccf700 1 --2- 172.21.15.6:0/3468076022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cefcc0 0x560270d93fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb39acd1700 1 -- 172.21.15.6:0/3468076022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cee840 msgr2=0x560270cef690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:48.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb39acd1700 1 --2- 172.21.15.6:0/3468076022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cee840 0x560270cef690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb39acd1700 1 -- 172.21.15.6:0/3468076022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cefcc0 msgr2=0x560270d93fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:48.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb39acd1700 1 --2- 172.21.15.6:0/3468076022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cefcc0 0x560270d93fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb39acd1700 1 -- 172.21.15.6:0/3468076022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560270a7bfe0 con 0x560270d3ec00 2023-10-06T02:27:48.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb39acd1700 1 --2- 172.21.15.6:0/3468076022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d12790 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fb384007d50 tx=0x7fb38402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a975a3efaee7acbe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb378ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:27:48.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb378ff9700 1 -- 172.21.15.6:0/3468076022 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384021040 con 0x560270d3ec00 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb378ff9700 1 -- 172.21.15.6:0/3468076022 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8614+0+0 (secure 0 0 0) 0x7fb38403d080 con 0x560270d3ec00 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/3468076022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb38400bbc0 con 0x560270d3ec00 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb378ff9700 1 -- 172.21.15.6:0/3468076022 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=258) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb384038720 con 0x560270d3ec00 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb3a5a2cb80 10 client.9690 fetch_fsmap learned FSMap version 258 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/3468076022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=258,monmap=2+}) v3 -- 0x560270bf4470 con 0x560270d3ec00 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb378ff9700 1 -- 172.21.15.6:0/3468076022 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb384045020 con 0x560270d3ec00 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb378ff9700 1 -- 172.21.15.6:0/3468076022 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 258) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb38400b050 con 0x560270d3ec00 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb3a5a2cb80 10 client.9690 fetch_fsmap finished waiting for FSMap version 258 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb3a5a2cb80 10 client.9690 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb3a5a2cb80 20 client.9690 populate_metadata read hostname 'smithi006' 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/3468076022 >> [v2:172.21.15.6:6833/4129427704,v1:172.21.15.6:6835/4129427704] conn(0x560270d32590 0x560270d32960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb3a5a2cb80 4 client.9690 mds_command: new command op to 9597 tid=0[{"prefix": "status"}] 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.804+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/3468076022 --> [v2:172.21.15.6:6833/4129427704,v1:172.21.15.6:6835/4129427704] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560270be1e00 con 0x560270d32590 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.805+0000 7fb39a4d0700 1 --2- 172.21.15.6:0/3468076022 >> [v2:172.21.15.6:6833/4129427704,v1:172.21.15.6:6835/4129427704] conn(0x560270d32590 0x560270d32960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.805+0000 7fb378ff9700 10 client.9690 ms_handle_connect on v2:172.21.15.6:6833/4129427704 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.805+0000 7fb39a4d0700 1 --2- 172.21.15.6:0/3468076022 >> [v2:172.21.15.6:6833/4129427704,v1:172.21.15.6:6835/4129427704] conn(0x560270d32590 0x560270d32960 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d14a8850234fbe4b server_cookie=b78cb98a91a24b00 in_seq=0 out_seq=0 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.805+0000 7fb378ff9700 1 -- 172.21.15.6:0/3468076022 <== mds.0 v2:172.21.15.6:6833/4129427704 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x560270be1e00 con 0x560270d32590 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.805+0000 7fb378ff9700 10 client.9690 handle_command_reply: tid=0 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.805+0000 7fb3a5a2cb80 1 client.9690 shutdown 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.805+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/3468076022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 msgr2=0x560270d12790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.805+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/3468076022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d12790 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fb384007d50 tx=0x7fb38402c000 comp rx=0 tx=0).stop 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.805+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/3468076022 shutdown_connections 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.805+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/3468076022 >> [v2:172.21.15.6:6833/4129427704,v1:172.21.15.6:6835/4129427704] conn(0x560270d32590 0x560270d32960 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.805+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/3468076022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560270d3ec00 0x560270d12790 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.805+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/3468076022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560270cee840 0x560270cef690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.805+0000 7fb3a5a2cb80 1 --2- 172.21.15.6:0/3468076022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560270cefcc0 0x560270d93fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.805+0000 7fb378ff9700 0 client.9690 ms_handle_reset on v2:172.21.15.6:6833/4129427704 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.805+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/3468076022 >> 172.21.15.6:0/3468076022 conn(0x560270cf0160 msgr2=0x560270d1e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.805+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/3468076022 shutdown_connections 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.805+0000 7fb3a5a2cb80 1 -- 172.21.15.6:0/3468076022 wait complete. 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.806+0000 7fb3a5a2cb80 20 client.9690 trim_cache size 0 max 16384 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 9597, 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 6.7661252379999999, 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 258, 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 121, 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 121, 2023-10-06T02:27:48.961 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 10.770389412 2023-10-06T02:27:48.961 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:27:48.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.806+0000 7fb39c734700 1 -- 172.21.15.6:0/2453500618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb380066f30 msgr2=0x7fb3800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:49.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.806+0000 7fb39c734700 1 --2- 172.21.15.6:0/2453500618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb380066f30 0x7fb3800693e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb38c006fd0 tx=0x7fb38c008040 comp rx=0 tx=0).stop 2023-10-06T02:27:49.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.806+0000 7fb39c734700 1 -- 172.21.15.6:0/2453500618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39415a030 msgr2=0x7fb3941559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:49.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.806+0000 7fb39c734700 1 --2- 172.21.15.6:0/2453500618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39415a030 0x7fb3941559e0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7fb388006b00 tx=0x7fb388008040 comp rx=0 tx=0).stop 2023-10-06T02:27:49.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.806+0000 7fb39c734700 1 -- 172.21.15.6:0/2453500618 shutdown_connections 2023-10-06T02:27:49.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.806+0000 7fb39c734700 1 --2- 172.21.15.6:0/2453500618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb39415a940 0x7fb3940aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.806+0000 7fb39c734700 1 --2- 172.21.15.6:0/2453500618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb394087530 0x7fb39415ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.806+0000 7fb39c734700 1 --2- 172.21.15.6:0/2453500618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb380066f30 0x7fb3800693e0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.806+0000 7fb39c734700 1 --2- 172.21.15.6:0/2453500618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39415a030 0x7fb3941559e0 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.806+0000 7fb39c734700 1 -- 172.21.15.6:0/2453500618 >> 172.21.15.6:0/2453500618 conn(0x7fb394068680 msgr2=0x7fb394156810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:49.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.806+0000 7fb39c734700 1 -- 172.21.15.6:0/2453500618 shutdown_connections 2023-10-06T02:27:49.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:48.806+0000 7fb39c734700 1 -- 172.21.15.6:0/2453500618 wait complete. 2023-10-06T02:27:49.030 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:27:49.030 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Truncate 500.00000000', proceeding to ls 2023-10-06T02:27:49.030 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:27:49.031 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:27:49.018+0000 7fdcab48b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:27:49.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.153+0000 7f92a5879700 1 Processor -- start 2023-10-06T02:27:49.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.153+0000 7f92a5879700 1 -- start start 2023-10-06T02:27:49.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.154+0000 7f92a5879700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92a01591d0 0x7f92a00aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:49.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.154+0000 7f92a5879700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f92a006a2e0 0x7f92a00af230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:49.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.154+0000 7f92a5879700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a00d0e00 con 0x7f92a015a890 2023-10-06T02:27:49.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.154+0000 7f92a5879700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a015a400 con 0x7f92a01591d0 2023-10-06T02:27:49.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.154+0000 7f92a5879700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a0159b10 con 0x7f92a006a2e0 2023-10-06T02:27:49.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.154+0000 7f929effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92a01591d0 0x7f92a00aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:49.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.154+0000 7f929effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92a01591d0 0x7f92a00aecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36602/0 (socket says 172.21.15.6:36602) 2023-10-06T02:27:49.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.154+0000 7f929effd700 1 -- 172.21.15.6:0/1769042241 learned_addr learned my addr 172.21.15.6:0/1769042241 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:49.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.154+0000 7f929f7fe700 1 --2- 172.21.15.6:0/1769042241 >> v2:172.21.15.175:3300/0 conn(0x7f92a006a2e0 0x7f92a00af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:49.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.154+0000 7f929effd700 1 -- 172.21.15.6:0/1769042241 >> v2:172.21.15.175:3300/0 conn(0x7f92a006a2e0 msgr2=0x7f92a00af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:49.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.154+0000 7f929effd700 1 --2- 172.21.15.6:0/1769042241 >> v2:172.21.15.175:3300/0 conn(0x7f92a006a2e0 0x7f92a00af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.154+0000 7f929effd700 1 -- 172.21.15.6:0/1769042241 >> v1:172.21.15.175:6789/0 conn(0x7f92a015a890 legacy=0x7f92a0069bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:49.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.154+0000 7f929effd700 1 -- 172.21.15.6:0/1769042241 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a0159db0 con 0x7f92a01591d0 2023-10-06T02:27:49.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.154+0000 7f929f7fe700 1 --2- 172.21.15.6:0/1769042241 >> v2:172.21.15.175:3300/0 conn(0x7f92a006a2e0 0x7f92a00af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:49.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.155+0000 7f929effd700 1 --2- 172.21.15.6:0/1769042241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a01591d0 0x7f92a00aecf0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f92a015a370 tx=0x7f9298009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d2a5a551aaa7ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:49.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.155+0000 7f929dffb700 1 -- 172.21.15.6:0/1769042241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929800e070 con 0x7f92a01591d0 2023-10-06T02:27:49.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.155+0000 7f929dffb700 1 -- 172.21.15.6:0/1769042241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929800ba50 con 0x7f92a01591d0 2023-10-06T02:27:49.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.155+0000 7f929dffb700 1 -- 172.21.15.6:0/1769042241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92980092e0 con 0x7f92a01591d0 2023-10-06T02:27:49.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.155+0000 7f92a5879700 1 -- 172.21.15.6:0/1769042241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a01591d0 msgr2=0x7f92a00aecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:49.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.155+0000 7f92a5879700 1 --2- 172.21.15.6:0/1769042241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a01591d0 0x7f92a00aecf0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f92a015a370 tx=0x7f9298009840 comp rx=0 tx=0).stop 2023-10-06T02:27:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.155+0000 7f92a5879700 1 -- 172.21.15.6:0/1769042241 shutdown_connections 2023-10-06T02:27:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.155+0000 7f92a5879700 1 --2- 172.21.15.6:0/1769042241 >> v2:172.21.15.175:3300/0 conn(0x7f92a006a2e0 0x7f92a00af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.155+0000 7f92a5879700 1 --2- 172.21.15.6:0/1769042241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a01591d0 0x7f92a00aecf0 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.155+0000 7f92a5879700 1 -- 172.21.15.6:0/1769042241 >> 172.21.15.6:0/1769042241 conn(0x7f92a0069150 msgr2=0x7f92a00d0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.155+0000 7f92a5879700 1 -- 172.21.15.6:0/1769042241 shutdown_connections 2023-10-06T02:27:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.155+0000 7f92a5879700 1 -- 172.21.15.6:0/1769042241 wait complete. 2023-10-06T02:27:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.157+0000 7f92a5879700 1 Processor -- start 2023-10-06T02:27:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.157+0000 7f92a5879700 1 -- start start 2023-10-06T02:27:49.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.157+0000 7f92a5879700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a006a2e0 0x7f92a00b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:49.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.157+0000 7f92a5879700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92a01591d0 0x7f92a0154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:49.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.157+0000 7f92a5879700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92a015a890 0x7f92a0154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:49.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.157+0000 7f92a5879700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a01552a0 con 0x7f92a006a2e0 2023-10-06T02:27:49.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.157+0000 7f92a5879700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a015eff0 con 0x7f92a015a890 2023-10-06T02:27:49.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.157+0000 7f92a5879700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a015f2d0 con 0x7f92a01591d0 2023-10-06T02:27:49.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.157+0000 7f929effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a006a2e0 0x7f92a00b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:49.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.158+0000 7f929effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a006a2e0 0x7f92a00b5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36606/0 (socket says 172.21.15.6:36606) 2023-10-06T02:27:49.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.158+0000 7f929effd700 1 -- 172.21.15.6:0/150829893 learned_addr learned my addr 172.21.15.6:0/150829893 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:49.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.158+0000 7f929effd700 1 -- 172.21.15.6:0/150829893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92a01591d0 msgr2=0x7f92a0154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:49.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.158+0000 7f929effd700 1 --2- 172.21.15.6:0/150829893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92a01591d0 0x7f92a0154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.158+0000 7f929effd700 1 -- 172.21.15.6:0/150829893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92a015a890 msgr2=0x7f92a0154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:49.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.158+0000 7f929f7fe700 1 --2- 172.21.15.6:0/150829893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92a015a890 0x7f92a0154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:49.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.158+0000 7f929effd700 1 --2- 172.21.15.6:0/150829893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92a015a890 0x7f92a0154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.158+0000 7f929effd700 1 -- 172.21.15.6:0/150829893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9298009ae0 con 0x7f92a006a2e0 2023-10-06T02:27:49.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.158+0000 7f929f7fe700 1 --2- 172.21.15.6:0/150829893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92a015a890 0x7f92a0154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:49.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.158+0000 7f929effd700 1 --2- 172.21.15.6:0/150829893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a006a2e0 0x7f92a00b5830 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f92a015be90 tx=0x7f9298018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:49.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.158+0000 7f9296ffd700 1 -- 172.21.15.6:0/150829893 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9298008a80 con 0x7f92a006a2e0 2023-10-06T02:27:49.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.158+0000 7f9296ffd700 1 -- 172.21.15.6:0/150829893 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9298008c00 con 0x7f92a006a2e0 2023-10-06T02:27:49.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.158+0000 7f92a5879700 1 -- 172.21.15.6:0/150829893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a015f5b0 con 0x7f92a006a2e0 2023-10-06T02:27:49.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.158+0000 7f9296ffd700 1 -- 172.21.15.6:0/150829893 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9298026460 con 0x7f92a006a2e0 2023-10-06T02:27:49.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.158+0000 7f92a5879700 1 -- 172.21.15.6:0/150829893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a015fb70 con 0x7f92a006a2e0 2023-10-06T02:27:49.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.159+0000 7f92a5879700 1 -- 172.21.15.6:0/150829893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a0064ee0 con 0x7f92a006a2e0 2023-10-06T02:27:49.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.160+0000 7f9296ffd700 1 -- 172.21.15.6:0/150829893 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9298003040 con 0x7f92a006a2e0 2023-10-06T02:27:49.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.160+0000 7f9296ffd700 1 --2- 172.21.15.6:0/150829893 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9280066f30 0x7f92800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:49.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.160+0000 7f9296ffd700 1 -- 172.21.15.6:0/150829893 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8614+0+0 (secure 0 0 0) 0x7f9298086950 con 0x7f92a006a2e0 2023-10-06T02:27:49.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.160+0000 7f929e7fc700 1 --2- 172.21.15.6:0/150829893 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9280066f30 0x7f92800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:49.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.161+0000 7f929e7fc700 1 --2- 172.21.15.6:0/150829893 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9280066f30 0x7f92800693e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f92a00b3640 tx=0x7f9288007ab0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:49.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.164+0000 7f9296ffd700 1 -- 172.21.15.6:0/150829893 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92980530d0 con 0x7f92a006a2e0 2023-10-06T02:27:49.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.404+0000 7f92a5879700 1 -- 172.21.15.6:0/150829893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f92a0064aa0 con 0x7f92a006a2e0 2023-10-06T02:27:49.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.405+0000 7f9296ffd700 1 -- 172.21.15.6:0/150829893 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v258) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9298021060 con 0x7f92a006a2e0 2023-10-06T02:27:49.420 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:27:49.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.407+0000 7f92a5879700 1 -- 172.21.15.6:0/150829893 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9280066f30 msgr2=0x7f92800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:49.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.407+0000 7f92a5879700 1 --2- 172.21.15.6:0/150829893 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9280066f30 0x7f92800693e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f92a00b3640 tx=0x7f9288007ab0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.407+0000 7f92a5879700 1 -- 172.21.15.6:0/150829893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a006a2e0 msgr2=0x7f92a00b5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:49.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.407+0000 7f92a5879700 1 --2- 172.21.15.6:0/150829893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a006a2e0 0x7f92a00b5830 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f92a015be90 tx=0x7f9298018000 comp rx=0 tx=0).stop 2023-10-06T02:27:49.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.407+0000 7f92a5879700 1 -- 172.21.15.6:0/150829893 shutdown_connections 2023-10-06T02:27:49.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.407+0000 7f92a5879700 1 --2- 172.21.15.6:0/150829893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92a015a890 0x7f92a0154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.407+0000 7f92a5879700 1 --2- 172.21.15.6:0/150829893 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9280066f30 0x7f92800693e0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.407+0000 7f92a5879700 1 --2- 172.21.15.6:0/150829893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a006a2e0 0x7f92a00b5830 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.407+0000 7f92a5879700 1 --2- 172.21.15.6:0/150829893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92a01591d0 0x7f92a0154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.407+0000 7f92a5879700 1 -- 172.21.15.6:0/150829893 >> 172.21.15.6:0/150829893 conn(0x7f92a0069150 msgr2=0x7f92a00c5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:49.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.407+0000 7f92a5879700 1 -- 172.21.15.6:0/150829893 shutdown_connections 2023-10-06T02:27:49.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:49.407+0000 7f92a5879700 1 -- 172.21.15.6:0/150829893 wait complete. 2023-10-06T02:27:49.423 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:27:49.423 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:27:49.423 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:27:49.423 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:27:49.423 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:49.423 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:27:49.423 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:27:49.423 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:27:49.423 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:27:49.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:49.424 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:27:49.439 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:27:49.439 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:27:49.439 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:27:49.439 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:49.439 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:27:49.440 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:49.440 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:27:49.440 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:27:49.440 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:27:49.440 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:27:49.440 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:27:49.440 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:27:49.440 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:27:49.440 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:27:49.440 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:27:49.440 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:27:49.440 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41877sec preferred_lft 41877sec 2023-10-06T02:27:49.441 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:27:49.441 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:49.441 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:27:49.441 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:27:49.441 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:27:49.441 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:27:49.441 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:27:49.441 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:27:49.441 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:49.441 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:27:49.441 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:49.441 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:27:49.442 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:27:49.442 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:27:49.442 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:49.442 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:27:49.442 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:27:49.442 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:27:49.442 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:49.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:49.442 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:27:49.503 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:27:50.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:50.085 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:27:50.144 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:27:50.244 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:27:50.244 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:27:50.244 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:27:50.244 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:27:50.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:50.245 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:27:50.245 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:27:50.245 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:27:50.245 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:27:50.245 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:27:50.245 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:27:50.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:52.157 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:27:52.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:27:52.189 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:27:52.204 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:27:52.228 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:27:52.228 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:27:52.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:52.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:27:52.273 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:27:52.274 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:27:52.274 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:52.330 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:27:52.330 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:27:52.331 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:52.386 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:27:52.454 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:27:52.454 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:27:52.521 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:27:52.521 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:27:52.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:52.522 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:27:52.578 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:27:52.578 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:27:52.621 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:27:52.647 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:27:52.647 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:27:52.706 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:27:52.706+0000 7f353caab540 -1 init, newargv = 0x55f4ee313fa0 newargc=15 2023-10-06T02:27:52.707 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[136686]: starting ceph client 2023-10-06T02:27:52.712 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[136686]: starting fuse 2023-10-06T02:27:52.715 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:27:52.716 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:27:52.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:52.716 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:27:52.771 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:27:52.771 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:27:52.771 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:27:52.771 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:27:52.772 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:27:52.772 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:27:52.772 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:27:52.772 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:27:52.772 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:27:52.772 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:27:52.772 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:27:52.772 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:27:52.772 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:27:52.772 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:27:52.772 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:27:52.772 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:27:52.773 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:27:52.773 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:27:52.773 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:27:52.773 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:27:52.773 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:27:52.773 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:27:52.773 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:27:52.773 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:27:52.773 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:27:52.773 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:27:52.773 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:27:52.773 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:27:52.773 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:27:52.894 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.136686.asok 2023-10-06T02:27:53.076 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.136686.asok 2023-10-06T02:27:53.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:53.077 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.136686.asok status 2023-10-06T02:27:53.231 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:27:53.231 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:27:53.231 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:27:53.231 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:27:53.231 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:27:53.231 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:27:53.231 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:27:53.231 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "136686", 2023-10-06T02:27:53.231 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:27:53.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:27:53.232 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:27:53.232 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:27:53.232 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 9705, 2023-10-06T02:27:53.232 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:27:53.232 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:27:53.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:27:53.232 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 9705 2023-10-06T02:27:53.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:27:53.232 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:27:53.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:27:53.232 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:27:53.232 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2440344751 2023-10-06T02:27:53.233 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:27:53.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:27:53.233 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:27:53.233 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:27:53.233 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:27:53.233 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2440344751 2023-10-06T02:27:53.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:27:53.233 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.9705 192.168.0.1:0/2440344751", 2023-10-06T02:27:53.233 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/2440344751", 2023-10-06T02:27:53.233 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:27:53.233 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 258, 2023-10-06T02:27:53.233 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 121, 2023-10-06T02:27:53.234 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:27:53.234 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:27:53.234 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:27:53.234 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:27:53.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:53.241 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:27:53.241 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:53.256 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:27:53.256 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:53.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:53.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:53.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:53.321 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2023-10-06T02:27:53.363 INFO:teuthology.orchestra.run:waiting for 20 2023-10-06T02:27:53.380 INFO:teuthology.orchestra.run.smithi006.stdout:.: 2023-10-06T02:27:53.381 INFO:teuthology.orchestra.run.smithi006.stdout:subdir 2023-10-06T02:27:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:53.381 INFO:teuthology.orchestra.run.smithi006.stdout:./subdir: 2023-10-06T02:27:53.381 INFO:teuthology.orchestra.run.smithi006.stdout:sixmegs 2023-10-06T02:27:53.381 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 500.00000000' did not caused DAMAGED state 2023-10-06T02:27:53.381 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate mds_snaptable' 2023-10-06T02:27:53.381 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:27:53.381 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:27:53.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:53.461 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:27:53.462 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:27:53.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:53.462 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:27:53.517 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:27:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.676+0000 7f30522e0700 1 Processor -- start 2023-10-06T02:27:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.676+0000 7f30522e0700 1 -- start start 2023-10-06T02:27:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.676+0000 7f30522e0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f304c086ff0 0x7f304c087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.676+0000 7f30522e0700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f304c0b21b0 0x7f304c0b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.676+0000 7f30522e0700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c0b2b70 con 0x7f304c15a030 2023-10-06T02:27:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.676+0000 7f30522e0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304c0b0cf0 con 0x7f304c086ff0 2023-10-06T02:27:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.676+0000 7f30522e0700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304c0879b0 con 0x7f304c0b21b0 2023-10-06T02:27:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.677+0000 7f304b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f304c086ff0 0x7f304c087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.677+0000 7f304b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f304c086ff0 0x7f304c087470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36620/0 (socket says 172.21.15.6:36620) 2023-10-06T02:27:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.677+0000 7f304b7fe700 1 -- 172.21.15.6:0/1619418336 learned_addr learned my addr 172.21.15.6:0/1619418336 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.677+0000 7f305087d700 1 --2- 172.21.15.6:0/1619418336 >> v2:172.21.15.175:3300/0 conn(0x7f304c0b21b0 0x7f304c0b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.677+0000 7f304b7fe700 1 -- 172.21.15.6:0/1619418336 >> v2:172.21.15.175:3300/0 conn(0x7f304c0b21b0 msgr2=0x7f304c0b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.677+0000 7f304b7fe700 1 --2- 172.21.15.6:0/1619418336 >> v2:172.21.15.175:3300/0 conn(0x7f304c0b21b0 0x7f304c0b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.677+0000 7f304b7fe700 1 -- 172.21.15.6:0/1619418336 >> v1:172.21.15.175:6789/0 conn(0x7f304c15a030 legacy=0x7f304c15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.677+0000 7f304b7fe700 1 -- 172.21.15.6:0/1619418336 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0afc50 con 0x7f304c086ff0 2023-10-06T02:27:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.677+0000 7f304b7fe700 1 --2- 172.21.15.6:0/1619418336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c086ff0 0x7f304c087470 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f304c157800 tx=0x7f3040009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5773b77ffe5aeb4d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.677+0000 7f304affd700 1 -- 172.21.15.6:0/1619418336 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304000b7e0 con 0x7f304c086ff0 2023-10-06T02:27:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.677+0000 7f304affd700 1 -- 172.21.15.6:0/1619418336 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304000b940 con 0x7f304c086ff0 2023-10-06T02:27:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.677+0000 7f304affd700 1 -- 172.21.15.6:0/1619418336 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304000bce0 con 0x7f304c086ff0 2023-10-06T02:27:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.678+0000 7f30522e0700 1 -- 172.21.15.6:0/1619418336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c086ff0 msgr2=0x7f304c087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.678+0000 7f30522e0700 1 --2- 172.21.15.6:0/1619418336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c086ff0 0x7f304c087470 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f304c157800 tx=0x7f3040009250 comp rx=0 tx=0).stop 2023-10-06T02:27:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.678+0000 7f30522e0700 1 -- 172.21.15.6:0/1619418336 shutdown_connections 2023-10-06T02:27:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.678+0000 7f30522e0700 1 --2- 172.21.15.6:0/1619418336 >> v2:172.21.15.175:3300/0 conn(0x7f304c0b21b0 0x7f304c0b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.678+0000 7f30522e0700 1 --2- 172.21.15.6:0/1619418336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c086ff0 0x7f304c087470 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.678+0000 7f30522e0700 1 -- 172.21.15.6:0/1619418336 >> 172.21.15.6:0/1619418336 conn(0x7f304c068680 msgr2=0x7f304c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.678+0000 7f30522e0700 1 -- 172.21.15.6:0/1619418336 shutdown_connections 2023-10-06T02:27:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.678+0000 7f30522e0700 1 -- 172.21.15.6:0/1619418336 wait complete. 2023-10-06T02:27:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.679+0000 7f30522e0700 1 Processor -- start 2023-10-06T02:27:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.679+0000 7f30522e0700 1 -- start start 2023-10-06T02:27:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.680+0000 7f30522e0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f304c086ff0 0x7f304c148a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.680+0000 7f30522e0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c0b21b0 0x7f304c0c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.680+0000 7f30522e0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f304c15a030 0x7f304c0c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.680+0000 7f30522e0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0c65b0 con 0x7f304c0b21b0 2023-10-06T02:27:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.680+0000 7f30522e0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0c5430 con 0x7f304c086ff0 2023-10-06T02:27:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.680+0000 7f30522e0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0c4820 con 0x7f304c15a030 2023-10-06T02:27:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.680+0000 7f304b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c0b21b0 0x7f304c0c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.680+0000 7f304b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c0b21b0 0x7f304c0c3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36622/0 (socket says 172.21.15.6:36622) 2023-10-06T02:27:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.680+0000 7f304b7fe700 1 -- 172.21.15.6:0/2213226571 learned_addr learned my addr 172.21.15.6:0/2213226571 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.680+0000 7f305087d700 1 --2- 172.21.15.6:0/2213226571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f304c15a030 0x7f304c0c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.680+0000 7f304bfff700 1 --2- 172.21.15.6:0/2213226571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f304c086ff0 0x7f304c148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.680+0000 7f304b7fe700 1 -- 172.21.15.6:0/2213226571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f304c15a030 msgr2=0x7f304c0c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.680+0000 7f304b7fe700 1 --2- 172.21.15.6:0/2213226571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f304c15a030 0x7f304c0c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.681+0000 7f304b7fe700 1 -- 172.21.15.6:0/2213226571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f304c086ff0 msgr2=0x7f304c148a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.681+0000 7f304b7fe700 1 --2- 172.21.15.6:0/2213226571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f304c086ff0 0x7f304c148a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.681+0000 7f304b7fe700 1 -- 172.21.15.6:0/2213226571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30400094f0 con 0x7f304c0b21b0 2023-10-06T02:27:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.681+0000 7f304b7fe700 1 --2- 172.21.15.6:0/2213226571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c0b21b0 0x7f304c0c3c40 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f30400030c0 tx=0x7f3040016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.681+0000 7f3033fff700 1 -- 172.21.15.6:0/2213226571 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040011e00 con 0x7f304c0b21b0 2023-10-06T02:27:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.681+0000 7f3033fff700 1 -- 172.21.15.6:0/2213226571 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304001b470 con 0x7f304c0b21b0 2023-10-06T02:27:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.681+0000 7f3033fff700 1 -- 172.21.15.6:0/2213226571 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304001b830 con 0x7f304c0b21b0 2023-10-06T02:27:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.681+0000 7f30522e0700 1 -- 172.21.15.6:0/2213226571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c0c4b00 con 0x7f304c0b21b0 2023-10-06T02:27:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.681+0000 7f30522e0700 1 -- 172.21.15.6:0/2213226571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c0c50c0 con 0x7f304c0b21b0 2023-10-06T02:27:53.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.682+0000 7f30522e0700 1 -- 172.21.15.6:0/2213226571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304c0c55e0 con 0x7f304c0b21b0 2023-10-06T02:27:53.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.682+0000 7f3033fff700 1 -- 172.21.15.6:0/2213226571 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f304001bbe0 con 0x7f304c0b21b0 2023-10-06T02:27:53.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.683+0000 7f3033fff700 1 --2- 172.21.15.6:0/2213226571 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3038066f30 0x7f30380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.683+0000 7f3033fff700 1 -- 172.21.15.6:0/2213226571 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8614+0+0 (secure 0 0 0) 0x7f3040086d10 con 0x7f304c0b21b0 2023-10-06T02:27:53.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.683+0000 7f304bfff700 1 --2- 172.21.15.6:0/2213226571 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3038066f30 0x7f30380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.683+0000 7f304bfff700 1 --2- 172.21.15.6:0/2213226571 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3038066f30 0x7f30380693e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f303c009af0 tx=0x7f303c009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:53.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.687+0000 7f3033fff700 1 -- 172.21.15.6:0/2213226571 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f304c0c55e0 con 0x7f304c0b21b0 2023-10-06T02:27:53.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.926+0000 7f30522e0700 1 -- 172.21.15.6:0/2213226571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f304c0c55e0 con 0x7f304c0b21b0 2023-10-06T02:27:53.927 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:53.927+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:27:53.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.930+0000 7f3033fff700 1 -- 172.21.15.6:0/2213226571 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v259) v1 ==== 161+0+0 (secure 0 0 0) 0x7f304c0c55e0 con 0x7f304c0b21b0 2023-10-06T02:27:53.933 INFO:tasks.ceph.mds.a.smithi006.stderr: -572> 2023-10-06T02:27:49.018+0000 7fdcab48b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:27:53.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.934+0000 7f30522e0700 1 -- 172.21.15.6:0/2213226571 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3038066f30 msgr2=0x7f30380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:53.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.934+0000 7f30522e0700 1 --2- 172.21.15.6:0/2213226571 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3038066f30 0x7f30380693e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f303c009af0 tx=0x7f303c009060 comp rx=0 tx=0).stop 2023-10-06T02:27:53.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.934+0000 7f30522e0700 1 -- 172.21.15.6:0/2213226571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c0b21b0 msgr2=0x7f304c0c3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:53.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.934+0000 7f30522e0700 1 --2- 172.21.15.6:0/2213226571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c0b21b0 0x7f304c0c3c40 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f30400030c0 tx=0x7f3040016000 comp rx=0 tx=0).stop 2023-10-06T02:27:53.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.934+0000 7f30522e0700 1 -- 172.21.15.6:0/2213226571 shutdown_connections 2023-10-06T02:27:53.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.934+0000 7f30522e0700 1 --2- 172.21.15.6:0/2213226571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f304c15a030 0x7f304c0c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.934+0000 7f30522e0700 1 --2- 172.21.15.6:0/2213226571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f304c086ff0 0x7f304c148a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.934+0000 7f30522e0700 1 --2- 172.21.15.6:0/2213226571 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3038066f30 0x7f30380693e0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.934+0000 7f30522e0700 1 --2- 172.21.15.6:0/2213226571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c0b21b0 0x7f304c0c3c40 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.934+0000 7f30522e0700 1 -- 172.21.15.6:0/2213226571 >> 172.21.15.6:0/2213226571 conn(0x7f304c068680 msgr2=0x7f304c0b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:53.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.934+0000 7f30522e0700 1 -- 172.21.15.6:0/2213226571 shutdown_connections 2023-10-06T02:27:53.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:53.934+0000 7f30522e0700 1 -- 172.21.15.6:0/2213226571 wait complete. 2023-10-06T02:27:53.936 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:27:53.948 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:27:53.954 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:27:54.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.068+0000 7ff91c6a5700 1 Processor -- start 2023-10-06T02:27:54.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.068+0000 7ff91c6a5700 1 -- start start 2023-10-06T02:27:54.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.069+0000 7ff91c6a5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff91415a030 0x7ff91415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.069+0000 7ff91c6a5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9140afc50 con 0x7ff914087700 2023-10-06T02:27:54.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.069+0000 7ff91c6a5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9140aff30 con 0x7ff91415a940 2023-10-06T02:27:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.069+0000 7ff91c6a5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9140b0cf0 con 0x7ff91415a030 2023-10-06T02:27:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.069+0000 7ff91ac42700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff914087700 0x7ff9140b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34396/0 (socket says 172.21.15.6:34396) 2023-10-06T02:27:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.069+0000 7ff91ac42700 1 -- 172.21.15.6:0/2967894768 learned_addr learned my addr 172.21.15.6:0/2967894768 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.069+0000 7ff91a441700 1 --2- 172.21.15.6:0/2967894768 >> v2:172.21.15.175:3300/0 conn(0x7ff91415a030 0x7ff91415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.069+0000 7ff91943f700 1 -- 172.21.15.6:0/2967894768 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430210888 0 0) 0x7ff9140afc50 con 0x7ff914087700 2023-10-06T02:27:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.069+0000 7ff91943f700 1 -- 172.21.15.6:0/2967894768 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff900003570 con 0x7ff914087700 2023-10-06T02:27:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.069+0000 7ff91a441700 1 -- 172.21.15.6:0/2967894768 >> v1:172.21.15.175:6789/0 conn(0x7ff91415a940 legacy=0x7ff914086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.069+0000 7ff91943f700 1 -- 172.21.15.6:0/2967894768 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029980395 0 0) 0x7ff9140aff30 con 0x7ff91415a940 2023-10-06T02:27:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.069+0000 7ff91a441700 1 -- 172.21.15.6:0/2967894768 >> v1:172.21.15.6:6789/0 conn(0x7ff914087700 legacy=0x7ff9140b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.069+0000 7ff91a441700 1 -- 172.21.15.6:0/2967894768 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9140b0210 con 0x7ff91415a030 2023-10-06T02:27:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.070+0000 7ff91a441700 1 --2- 172.21.15.6:0/2967894768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff91415a030 0x7ff91415a400 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff9100098e0 tx=0x7ff9100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82a4b9350e65f9df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.070+0000 7ff91943f700 1 -- 172.21.15.6:0/2967894768 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91000b640 con 0x7ff91415a030 2023-10-06T02:27:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.070+0000 7ff91943f700 1 -- 172.21.15.6:0/2967894768 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91000b7a0 con 0x7ff91415a030 2023-10-06T02:27:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.070+0000 7ff91943f700 1 -- 172.21.15.6:0/2967894768 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91000bb40 con 0x7ff91415a030 2023-10-06T02:27:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.070+0000 7ff91c6a5700 1 -- 172.21.15.6:0/2967894768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff91415a030 msgr2=0x7ff91415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.070+0000 7ff91c6a5700 1 --2- 172.21.15.6:0/2967894768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff91415a030 0x7ff91415a400 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff9100098e0 tx=0x7ff9100091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.070+0000 7ff91c6a5700 1 -- 172.21.15.6:0/2967894768 shutdown_connections 2023-10-06T02:27:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.070+0000 7ff91c6a5700 1 --2- 172.21.15.6:0/2967894768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff91415a030 0x7ff91415a400 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.070+0000 7ff91c6a5700 1 -- 172.21.15.6:0/2967894768 >> 172.21.15.6:0/2967894768 conn(0x7ff914068680 msgr2=0x7ff914068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.070+0000 7ff91c6a5700 1 -- 172.21.15.6:0/2967894768 shutdown_connections 2023-10-06T02:27:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.070+0000 7ff91c6a5700 1 -- 172.21.15.6:0/2967894768 wait complete. 2023-10-06T02:27:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.072+0000 7ff91c6a5700 1 Processor -- start 2023-10-06T02:27:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.072+0000 7ff91c6a5700 1 -- start start 2023-10-06T02:27:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.072+0000 7ff91c6a5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff914087700 0x7ff914155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.072+0000 7ff91c6a5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff91415a030 0x7ff9140c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.072+0000 7ff91c6a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91415a940 0x7ff9140c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.072+0000 7ff91c6a5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91416ae80 con 0x7ff91415a940 2023-10-06T02:27:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.072+0000 7ff91c6a5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91416dfb0 con 0x7ff914087700 2023-10-06T02:27:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.072+0000 7ff91c6a5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91416d680 con 0x7ff91415a030 2023-10-06T02:27:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.072+0000 7ff91ac42700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91415a940 0x7ff9140c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.072+0000 7ff91ac42700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91415a940 0x7ff9140c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36640/0 (socket says 172.21.15.6:36640) 2023-10-06T02:27:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.072+0000 7ff91ac42700 1 -- 172.21.15.6:0/844330661 learned_addr learned my addr 172.21.15.6:0/844330661 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.073+0000 7ff91ac42700 1 -- 172.21.15.6:0/844330661 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff91415a030 msgr2=0x7ff9140c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.073+0000 7ff91a441700 1 --2- 172.21.15.6:0/844330661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff914087700 0x7ff914155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.073+0000 7ff919c40700 1 --2- 172.21.15.6:0/844330661 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff91415a030 0x7ff9140c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.073+0000 7ff91ac42700 1 --2- 172.21.15.6:0/844330661 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff91415a030 0x7ff9140c60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.073+0000 7ff91ac42700 1 -- 172.21.15.6:0/844330661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff914087700 msgr2=0x7ff914155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.073+0000 7ff91ac42700 1 --2- 172.21.15.6:0/844330661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff914087700 0x7ff914155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.073+0000 7ff91ac42700 1 -- 172.21.15.6:0/844330661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff910009420 con 0x7ff91415a940 2023-10-06T02:27:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.073+0000 7ff91ac42700 1 --2- 172.21.15.6:0/844330661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91415a940 0x7ff9140c65f0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7ff90c001460 tx=0x7ff90c001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.073+0000 7ff90a7fc700 1 -- 172.21.15.6:0/844330661 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c00a990 con 0x7ff91415a940 2023-10-06T02:27:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.073+0000 7ff90a7fc700 1 -- 172.21.15.6:0/844330661 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c00aaf0 con 0x7ff91415a940 2023-10-06T02:27:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.073+0000 7ff91c6a5700 1 -- 172.21.15.6:0/844330661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff91416d960 con 0x7ff91415a940 2023-10-06T02:27:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.073+0000 7ff90a7fc700 1 -- 172.21.15.6:0/844330661 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c00ae70 con 0x7ff91415a940 2023-10-06T02:27:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.073+0000 7ff91c6a5700 1 -- 172.21.15.6:0/844330661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff914156150 con 0x7ff91415a940 2023-10-06T02:27:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.074+0000 7ff91c6a5700 1 -- 172.21.15.6:0/844330661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff91416e120 con 0x7ff91415a940 2023-10-06T02:27:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.074+0000 7ff90a7fc700 1 -- 172.21.15.6:0/844330661 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff90c007300 con 0x7ff91415a940 2023-10-06T02:27:54.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.075+0000 7ff90a7fc700 1 --2- 172.21.15.6:0/844330661 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff8f8066f30 0x7ff8f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.075+0000 7ff90a7fc700 1 -- 172.21.15.6:0/844330661 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 8700+0+0 (secure 0 0 0) 0x7ff90c085540 con 0x7ff91415a940 2023-10-06T02:27:54.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.075+0000 7ff91a441700 1 --2- 172.21.15.6:0/844330661 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff8f8066f30 0x7ff8f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:54.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.076+0000 7ff91a441700 1 --2- 172.21.15.6:0/844330661 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff8f8066f30 0x7ff8f80693e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff91000a010 tx=0x7ff910017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:54.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.079+0000 7ff90a7fc700 1 -- 172.21.15.6:0/844330661 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff90c051c40 con 0x7ff91415a940 2023-10-06T02:27:54.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.357+0000 7ff91c6a5700 1 -- 172.21.15.6:0/844330661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7ff9140b04f0 con 0x7ff91415a940 2023-10-06T02:27:54.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.931+0000 7ff90a7fc700 1 -- 172.21.15.6:0/844330661 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v260) v1 ==== 107+0+0 (secure 0 0 0) 0x7ff90c055260 con 0x7ff91415a940 2023-10-06T02:27:54.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.934+0000 7ff91c6a5700 1 -- 172.21.15.6:0/844330661 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff8f8066f30 msgr2=0x7ff8f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.934+0000 7ff91c6a5700 1 --2- 172.21.15.6:0/844330661 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff8f8066f30 0x7ff8f80693e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff91000a010 tx=0x7ff910017000 comp rx=0 tx=0).stop 2023-10-06T02:27:54.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.934+0000 7ff91c6a5700 1 -- 172.21.15.6:0/844330661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91415a940 msgr2=0x7ff9140c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.934+0000 7ff91c6a5700 1 --2- 172.21.15.6:0/844330661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91415a940 0x7ff9140c65f0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7ff90c001460 tx=0x7ff90c001a80 comp rx=0 tx=0).stop 2023-10-06T02:27:54.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.934+0000 7ff91c6a5700 1 -- 172.21.15.6:0/844330661 shutdown_connections 2023-10-06T02:27:54.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.934+0000 7ff91c6a5700 1 --2- 172.21.15.6:0/844330661 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff8f8066f30 0x7ff8f80693e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.934+0000 7ff91c6a5700 1 --2- 172.21.15.6:0/844330661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91415a940 0x7ff9140c65f0 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.934+0000 7ff91c6a5700 1 --2- 172.21.15.6:0/844330661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff914087700 0x7ff914155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.934+0000 7ff91c6a5700 1 --2- 172.21.15.6:0/844330661 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff91415a030 0x7ff9140c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.934+0000 7ff91c6a5700 1 -- 172.21.15.6:0/844330661 >> 172.21.15.6:0/844330661 conn(0x7ff914068680 msgr2=0x7ff914158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:54.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.934+0000 7ff91c6a5700 1 -- 172.21.15.6:0/844330661 shutdown_connections 2023-10-06T02:27:54.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:54.934+0000 7ff91c6a5700 1 -- 172.21.15.6:0/844330661 wait complete. 2023-10-06T02:27:54.936 INFO:teuthology.orchestra.run.smithi006.stderr:nothing to do: rank is not damaged 2023-10-06T02:27:54.948 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:27:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.028+0000 7f00f87d6000 1 Processor -- start 2023-10-06T02:27:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.028+0000 7f00f87d6000 1 -- start start 2023-10-06T02:27:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f87d6000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561e7c649600 0x561e7c617c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f87d6000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e7c6e0800 0x561e7c618140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f87d6000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e7c6ed490 0x561e7c618680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f87d6000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e7c5c0320 con 0x561e7c6e0800 2023-10-06T02:27:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f87d6000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e7c564980 con 0x561e7c6ed490 2023-10-06T02:27:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f87d6000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e7c564620 con 0x561e7c649600 2023-10-06T02:27:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f1210700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e7c6e0800 0x561e7c618140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f1210700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e7c6e0800 0x561e7c618140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36670/0 (socket says 172.21.15.6:36670) 2023-10-06T02:27:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f1210700 1 -- 172.21.15.6:0/2989773345 learned_addr learned my addr 172.21.15.6:0/2989773345 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f1a11700 1 --2- 172.21.15.6:0/2989773345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561e7c649600 0x561e7c617c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f2212700 1 --2- 172.21.15.6:0/2989773345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e7c6ed490 0x561e7c618680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f1210700 1 -- 172.21.15.6:0/2989773345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561e7c649600 msgr2=0x561e7c617c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f1210700 1 --2- 172.21.15.6:0/2989773345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561e7c649600 0x561e7c617c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f1210700 1 -- 172.21.15.6:0/2989773345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e7c6ed490 msgr2=0x561e7c618680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f1210700 1 --2- 172.21.15.6:0/2989773345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e7c6ed490 0x561e7c618680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f1210700 1 -- 172.21.15.6:0/2989773345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e7c566ae0 con 0x561e7c6e0800 2023-10-06T02:27:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f2212700 1 --2- 172.21.15.6:0/2989773345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e7c6ed490 0x561e7c618680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.029+0000 7f00f1210700 1 --2- 172.21.15.6:0/2989773345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e7c6e0800 0x561e7c618140 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00c5a0 tx=0x7f00dc0018f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48779f58295ae6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.030+0000 7f00ebfff700 1 -- 172.21.15.6:0/2989773345 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc016030 con 0x561e7c6e0800 2023-10-06T02:27:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.030+0000 7f00ebfff700 1 -- 172.21.15.6:0/2989773345 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc008070 con 0x561e7c6e0800 2023-10-06T02:27:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.030+0000 7f00ebfff700 1 -- 172.21.15.6:0/2989773345 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc011450 con 0x561e7c6e0800 2023-10-06T02:27:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.030+0000 7f00f87d6000 1 -- 172.21.15.6:0/2989773345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e7c6e0800 msgr2=0x561e7c618140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.030+0000 7f00f87d6000 1 --2- 172.21.15.6:0/2989773345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e7c6e0800 0x561e7c618140 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00c5a0 tx=0x7f00dc0018f0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.030+0000 7f00f87d6000 1 -- 172.21.15.6:0/2989773345 shutdown_connections 2023-10-06T02:27:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.030+0000 7f00f87d6000 1 --2- 172.21.15.6:0/2989773345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e7c6ed490 0x561e7c618680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.030+0000 7f00f87d6000 1 --2- 172.21.15.6:0/2989773345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561e7c649600 0x561e7c617c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.030+0000 7f00f87d6000 1 --2- 172.21.15.6:0/2989773345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e7c6e0800 0x561e7c618140 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.030+0000 7f00f87d6000 1 -- 172.21.15.6:0/2989773345 >> 172.21.15.6:0/2989773345 conn(0x561e7c660bd0 msgr2=0x561e7c61c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.030+0000 7f00f87d6000 1 -- 172.21.15.6:0/2989773345 shutdown_connections 2023-10-06T02:27:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.030+0000 7f00f87d6000 1 -- 172.21.15.6:0/2989773345 wait complete. 2023-10-06T02:27:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.031+0000 7f00f87d6000 1 Processor -- start 2023-10-06T02:27:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.031+0000 7f00f87d6000 1 -- start start 2023-10-06T02:27:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f87d6000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e7c649600 0x561e7c6603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f87d6000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e7c6e0800 0x561e7c703250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f87d6000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561e7c6ed490 0x561e7c704d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f87d6000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e7c55b400 con 0x561e7c649600 2023-10-06T02:27:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f87d6000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e7c704b50 con 0x561e7c6e0800 2023-10-06T02:27:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f87d6000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e7c703c30 con 0x561e7c6ed490 2023-10-06T02:27:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f1a11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e7c649600 0x561e7c6603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f1a11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e7c649600 0x561e7c6603f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36684/0 (socket says 172.21.15.6:36684) 2023-10-06T02:27:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 learned_addr learned my addr 172.21.15.6:0/798931078 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f1210700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e7c6e0800 0x561e7c703250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f2212700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561e7c6ed490 0x561e7c704d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561e7c6ed490 msgr2=0x561e7c704d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f1a11700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561e7c6ed490 0x561e7c704d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e7c6e0800 msgr2=0x561e7c703250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f1a11700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e7c6e0800 0x561e7c703250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc00a040 con 0x561e7c649600 2023-10-06T02:27:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f2212700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561e7c6ed490 0x561e7c704d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f1a11700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e7c649600 0x561e7c6603f0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f00ec007ba0 tx=0x7f00ec00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00ea7fc700 1 -- 172.21.15.6:0/798931078 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec00f070 con 0x561e7c649600 2023-10-06T02:27:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00ea7fc700 1 -- 172.21.15.6:0/798931078 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec010040 con 0x561e7c649600 2023-10-06T02:27:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561e7c566540 con 0x561e7c649600 2023-10-06T02:27:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00ea7fc700 1 -- 172.21.15.6:0/798931078 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec006d80 con 0x561e7c649600 2023-10-06T02:27:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.032+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e7c704170 con 0x561e7c649600 2023-10-06T02:27:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.034+0000 7f00ea7fc700 1 -- 172.21.15.6:0/798931078 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00ec016660 con 0x561e7c649600 2023-10-06T02:27:55.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.034+0000 7f00ea7fc700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f00d40658c0 0x7f00d4067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.034+0000 7f00ea7fc700 1 -- 172.21.15.6:0/798931078 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 8700+0+0 (secure 0 0 0) 0x7f00ec084bf0 con 0x561e7c649600 2023-10-06T02:27:55.040 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:27:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.034+0000 7f00f1210700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f00d40658c0 0x7f00d4067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.035+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x561e7c703790 0x561e7c6ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.035+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c659610 con 0x561e7c703790 2023-10-06T02:27:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.035+0000 7f00f2212700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x561e7c703790 0x561e7c6ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.035+0000 7f00f1210700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f00d40658c0 0x7f00d4067d70 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00d010 tx=0x7f00dc019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.035+0000 7f00f2212700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x561e7c703790 0x561e7c6ff820 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.037+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v122'815 uv789 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.037+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c6ffd60 con 0x561e7c703790 2023-10-06T02:27:55.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.038+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v122'816 uv816 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.038+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7001a0 con 0x561e7c703790 2023-10-06T02:27:55.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.040+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v122'817 uv817 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.042 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:27:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.040+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70eed0 con 0x561e7c703790 2023-10-06T02:27:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.041+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v122'818 uv818 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.041+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70f280 con 0x561e7c703790 2023-10-06T02:27:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.042+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v122'819 uv819 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.042+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c705500 con 0x561e7c703790 2023-10-06T02:27:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.044+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v122'820 uv820 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.044+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70e3b0 con 0x561e7c703790 2023-10-06T02:27:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.045+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v122'821 uv795 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.045+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70e760 con 0x561e7c703790 2023-10-06T02:27:55.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.046+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v122'822 uv822 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.046+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70e760 con 0x561e7c703790 2023-10-06T02:27:55.048 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:27:55.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.047+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v122'823 uv823 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.047+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70e760 con 0x561e7c703790 2023-10-06T02:27:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.049+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v122'824 uv824 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.049+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70e760 con 0x561e7c703790 2023-10-06T02:27:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.050+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v122'825 uv825 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.050+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70e760 con 0x561e7c703790 2023-10-06T02:27:55.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.051+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v122'826 uv826 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.051+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70e760 con 0x561e7c703790 2023-10-06T02:27:55.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.052+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v122'827 uv802 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.052+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70e760 con 0x561e7c703790 2023-10-06T02:27:55.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.053+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v122'828 uv828 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.053+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70e760 con 0x561e7c703790 2023-10-06T02:27:55.055 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:27:55.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.055+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v122'829 uv829 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.055+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70e760 con 0x561e7c703790 2023-10-06T02:27:55.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.056+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v122'830 uv830 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.056+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70e760 con 0x561e7c703790 2023-10-06T02:27:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.057+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v122'831 uv831 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.057+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70e760 con 0x561e7c703790 2023-10-06T02:27:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.059+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v122'832 uv832 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.059+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70f630 con 0x561e7c703790 2023-10-06T02:27:55.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.060+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v122'833 uv833 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.060+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70f630 con 0x561e7c703790 2023-10-06T02:27:55.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.061+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v122'834 uv808 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.061+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70f630 con 0x561e7c703790 2023-10-06T02:27:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.063+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v122'835 uv835 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.063+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70f630 con 0x561e7c703790 2023-10-06T02:27:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.064+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v122'836 uv836 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.065 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:27:55.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.064+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c710640 con 0x561e7c703790 2023-10-06T02:27:55.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.065+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v122'837 uv837 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.065+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c710640 con 0x561e7c703790 2023-10-06T02:27:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.066+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v122'838 uv838 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.066+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70f630 con 0x561e7c703790 2023-10-06T02:27:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.068+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v122'839 uv839 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.068+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70f630 con 0x561e7c703790 2023-10-06T02:27:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.069+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v122'840 uv814 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.069+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70f630 con 0x561e7c703790 2023-10-06T02:27:55.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.070+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v122'841 uv841 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.070+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70f630 con 0x561e7c703790 2023-10-06T02:27:55.071 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:27:55.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.071+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v122'842 uv842 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.071+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c710640 con 0x561e7c703790 2023-10-06T02:27:55.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.072+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v122'843 uv843 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.072+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c710640 con 0x561e7c703790 2023-10-06T02:27:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.073+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v122'844 uv844 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.073+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c70f630 con 0x561e7c703790 2023-10-06T02:27:55.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.075+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v122'845 uv845 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c703790 2023-10-06T02:27:55.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.075+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x561e7c70fb40 0x561e7c711f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.075+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c712460 con 0x561e7c70fb40 2023-10-06T02:27:55.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.075+0000 7f00f1a11700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x561e7c70fb40 0x561e7c711f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.075+0000 7f00f1a11700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x561e7c70fb40 0x561e7c711f20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.077+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v122'589 uv569 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.077+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c712810 con 0x561e7c70fb40 2023-10-06T02:27:55.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.078+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v122'590 uv590 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.078+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c712bc0 con 0x561e7c70fb40 2023-10-06T02:27:55.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.079+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v122'591 uv591 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.079 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:27:55.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.079+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c713460 con 0x561e7c70fb40 2023-10-06T02:27:55.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.080+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v122'592 uv592 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.080+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c713810 con 0x561e7c70fb40 2023-10-06T02:27:55.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.081+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v122'593 uv593 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.081+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c713bc0 con 0x561e7c70fb40 2023-10-06T02:27:55.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.084+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v122'594 uv588 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.084+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c713f70 con 0x561e7c70fb40 2023-10-06T02:27:55.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.085+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v122'595 uv595 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.085+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c714320 con 0x561e7c70fb40 2023-10-06T02:27:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.087+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v122'596 uv596 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.088 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:27:55.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.087+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c714320 con 0x561e7c70fb40 2023-10-06T02:27:55.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.088+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v122'597 uv597 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.088+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c714320 con 0x561e7c70fb40 2023-10-06T02:27:55.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.090+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v122'598 uv598 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.090+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c714320 con 0x561e7c70fb40 2023-10-06T02:27:55.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.091+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v122'599 uv587 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.091+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c714320 con 0x561e7c70fb40 2023-10-06T02:27:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.092+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v122'600 uv600 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.092+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c714320 con 0x561e7c70fb40 2023-10-06T02:27:55.094 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:27:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.093+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v122'601 uv601 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.093+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c717a40 con 0x561e7c70fb40 2023-10-06T02:27:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.094+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v122'602 uv602 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.094+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c717a40 con 0x561e7c70fb40 2023-10-06T02:27:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.095+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v122'603 uv603 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.095+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c714320 con 0x561e7c70fb40 2023-10-06T02:27:55.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.096+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v122'604 uv585 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.096+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c714320 con 0x561e7c70fb40 2023-10-06T02:27:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.098+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v122'605 uv605 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.098+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c714320 con 0x561e7c70fb40 2023-10-06T02:27:55.099 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:27:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.099+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v122'606 uv606 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.099+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c715330 con 0x561e7c70fb40 2023-10-06T02:27:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.100+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v122'607 uv607 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.100+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c715330 con 0x561e7c70fb40 2023-10-06T02:27:55.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.101+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v122'608 uv608 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.101+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c714320 con 0x561e7c70fb40 2023-10-06T02:27:55.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.102+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v122'609 uv609 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.102+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x561e7c714830 0x561e7c716c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.102+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c717150 con 0x561e7c714830 2023-10-06T02:27:55.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.102+0000 7f00f1210700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x561e7c714830 0x561e7c716c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.103+0000 7f00f1210700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x561e7c714830 0x561e7c716c10 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.104+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v122'159 uv158 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.104+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7175c0 con 0x561e7c714830 2023-10-06T02:27:55.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.105+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v122'160 uv160 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.105+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c717b40 con 0x561e7c714830 2023-10-06T02:27:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.106+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v122'161 uv161 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.107 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:27:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.106+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c719440 con 0x561e7c714830 2023-10-06T02:27:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.107+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v122'162 uv162 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.107+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7197f0 con 0x561e7c714830 2023-10-06T02:27:55.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.108+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v122'163 uv163 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.108+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c718430 con 0x561e7c714830 2023-10-06T02:27:55.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.109+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v122'164 uv164 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.109+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c718850 con 0x561e7c714830 2023-10-06T02:27:55.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.110+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v122'113 uv112 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.110+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c718c80 con 0x561e7c714830 2023-10-06T02:27:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.111+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v122'114 uv114 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.111+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c718c80 con 0x561e7c714830 2023-10-06T02:27:55.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.112+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v122'115 uv115 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.112 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:27:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.112+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c718c30 con 0x561e7c714830 2023-10-06T02:27:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.112+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v122'116 uv116 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.113+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c719050 con 0x561e7c70fb40 2023-10-06T02:27:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.114+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v122'159 uv158 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.114+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c719050 con 0x561e7c70fb40 2023-10-06T02:27:55.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.115+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v122'160 uv160 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.115+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c719050 con 0x561e7c70fb40 2023-10-06T02:27:55.116 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:27:55.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.116+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v122'161 uv161 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.116+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c719050 con 0x561e7c70fb40 2023-10-06T02:27:55.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.117+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v122'162 uv162 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.117+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c719050 con 0x561e7c70fb40 2023-10-06T02:27:55.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.118+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v122'163 uv163 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.118+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c719050 con 0x561e7c70fb40 2023-10-06T02:27:55.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.119+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v122'164 uv164 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c70fb40 2023-10-06T02:27:55.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.119+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x561e7c718c00 0x561e7c71c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.119+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71c600 con 0x561e7c718c00 2023-10-06T02:27:55.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.119+0000 7f00f2212700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x561e7c718c00 0x561e7c71c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.120+0000 7f00f2212700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x561e7c718c00 0x561e7c71c0c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.121+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v122'294 uv287 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c718c00 2023-10-06T02:27:55.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.121+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71c600 con 0x561e7c718c00 2023-10-06T02:27:55.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.122+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v122'295 uv295 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c718c00 2023-10-06T02:27:55.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.122+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71c600 con 0x561e7c718c00 2023-10-06T02:27:55.124 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:27:55.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.123+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v122'296 uv296 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c718c00 2023-10-06T02:27:55.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.123+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71d610 con 0x561e7c718c00 2023-10-06T02:27:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.125+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v122'297 uv297 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c718c00 2023-10-06T02:27:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.125+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71d610 con 0x561e7c718c00 2023-10-06T02:27:55.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.126+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v122'298 uv298 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c718c00 2023-10-06T02:27:55.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.126+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71c600 con 0x561e7c718c00 2023-10-06T02:27:55.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.127+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v122'299 uv299 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c718c00 2023-10-06T02:27:55.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.127+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71c600 con 0x561e7c718c00 2023-10-06T02:27:55.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.128+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v122'300 uv293 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c718c00 2023-10-06T02:27:55.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.128+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71c600 con 0x561e7c718c00 2023-10-06T02:27:55.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.129+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v122'301 uv301 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c718c00 2023-10-06T02:27:55.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.129+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71c600 con 0x561e7c718c00 2023-10-06T02:27:55.131 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:27:55.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.131+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v122'302 uv302 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c718c00 2023-10-06T02:27:55.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.131+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71c600 con 0x561e7c718c00 2023-10-06T02:27:55.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.132+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v122'303 uv303 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c718c00 2023-10-06T02:27:55.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.132+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c717fc0 con 0x561e7c718c00 2023-10-06T02:27:55.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.133+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v122'304 uv304 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c718c00 2023-10-06T02:27:55.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.133+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x561e7c71d000 0x561e7c71f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.133+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71f920 con 0x561e7c71d000 2023-10-06T02:27:55.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.133+0000 7f00f1a11700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x561e7c71d000 0x561e7c71f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.133+0000 7f00f1a11700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x561e7c71d000 0x561e7c71f3e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.134+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v122'132 uv131 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c71d000 2023-10-06T02:27:55.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.134+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71f920 con 0x561e7c71d000 2023-10-06T02:27:55.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.136+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v122'133 uv133 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c71d000 2023-10-06T02:27:55.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.136+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71f920 con 0x561e7c71d000 2023-10-06T02:27:55.137 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:27:55.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.137+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v122'134 uv134 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c71d000 2023-10-06T02:27:55.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.137+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71fd20 con 0x561e7c71d000 2023-10-06T02:27:55.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.138+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v122'135 uv135 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c71d000 2023-10-06T02:27:55.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.138+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71fd20 con 0x561e7c71d000 2023-10-06T02:27:55.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.139+0000 7f00f1a11700 1 -- 172.21.15.6:0/798931078 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v122'136 uv136 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f00ec01c020 con 0x561e7c71d000 2023-10-06T02:27:55.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.140+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71fd20 con 0x561e7c714830 2023-10-06T02:27:55.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.141+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v122'159 uv158 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.141+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71fd20 con 0x561e7c714830 2023-10-06T02:27:55.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.141+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v122'160 uv160 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.142+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71fd20 con 0x561e7c714830 2023-10-06T02:27:55.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.142+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v122'161 uv161 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.143 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:27:55.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.143+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c720d30 con 0x561e7c714830 2023-10-06T02:27:55.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.144+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v122'162 uv162 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.144+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c720d30 con 0x561e7c714830 2023-10-06T02:27:55.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.145+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v122'163 uv163 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.145+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c71fd20 con 0x561e7c714830 2023-10-06T02:27:55.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.146+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v122'164 uv164 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.146+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x561e7c720230 0x561e7c722610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.146+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c722d10 con 0x561e7c720230 2023-10-06T02:27:55.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.146+0000 7f00f1210700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x561e7c720230 0x561e7c722610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.146+0000 7f00f1210700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x561e7c720230 0x561e7c722610 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.148+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v122'263 uv257 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c720230 2023-10-06T02:27:55.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.148+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c723110 con 0x561e7c720230 2023-10-06T02:27:55.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.149+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v122'264 uv264 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c720230 2023-10-06T02:27:55.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.149+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c723110 con 0x561e7c720230 2023-10-06T02:27:55.150 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:27:55.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.149+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v122'265 uv265 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c720230 2023-10-06T02:27:55.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.149+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c723110 con 0x561e7c720230 2023-10-06T02:27:55.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.150+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v122'266 uv266 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c720230 2023-10-06T02:27:55.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.150+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c723110 con 0x561e7c720230 2023-10-06T02:27:55.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.152+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v122'267 uv267 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c720230 2023-10-06T02:27:55.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.152+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c723110 con 0x561e7c720230 2023-10-06T02:27:55.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.153+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v122'268 uv262 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c720230 2023-10-06T02:27:55.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.153+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c723110 con 0x561e7c720230 2023-10-06T02:27:55.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.154+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v122'269 uv269 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c720230 2023-10-06T02:27:55.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.154+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c723110 con 0x561e7c720230 2023-10-06T02:27:55.155 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:27:55.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.155+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v122'270 uv270 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c720230 2023-10-06T02:27:55.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.155+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c723110 con 0x561e7c720230 2023-10-06T02:27:55.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.156+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v122'271 uv271 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c720230 2023-10-06T02:27:55.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.156+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c725e80 con 0x561e7c720230 2023-10-06T02:27:55.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.157+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v122'272 uv272 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c720230 2023-10-06T02:27:55.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.157+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c723600 con 0x561e7c714830 2023-10-06T02:27:55.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.158+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v122'116 uv114 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.158+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c723600 con 0x561e7c714830 2023-10-06T02:27:55.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.159+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v122'117 uv117 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.159+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c723600 con 0x561e7c714830 2023-10-06T02:27:55.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.160+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v122'118 uv118 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.160 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:27:55.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.160+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c723600 con 0x561e7c714830 2023-10-06T02:27:55.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.161+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v122'119 uv119 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.161+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x561e7c723b10 0x561e7c723ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.161+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7265d0 con 0x561e7c723b10 2023-10-06T02:27:55.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.161+0000 7f00f2212700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x561e7c723b10 0x561e7c723ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.162+0000 7f00f2212700 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x561e7c723b10 0x561e7c723ee0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.163+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v122'159 uv158 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c723b10 2023-10-06T02:27:55.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.163+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7265d0 con 0x561e7c723b10 2023-10-06T02:27:55.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.164+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v122'160 uv160 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c723b10 2023-10-06T02:27:55.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.164+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7265d0 con 0x561e7c723b10 2023-10-06T02:27:55.165 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:27:55.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.165+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v122'161 uv161 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c723b10 2023-10-06T02:27:55.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.165+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7275e0 con 0x561e7c723b10 2023-10-06T02:27:55.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.166+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v122'162 uv162 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c723b10 2023-10-06T02:27:55.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.166+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7275e0 con 0x561e7c723b10 2023-10-06T02:27:55.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.168+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v122'163 uv163 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c723b10 2023-10-06T02:27:55.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.168+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7265d0 con 0x561e7c723b10 2023-10-06T02:27:55.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.171+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v122'164 uv164 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c723b10 2023-10-06T02:27:55.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.171+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7265d0 con 0x561e7c718c00 2023-10-06T02:27:55.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.172+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v122'135 uv134 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c718c00 2023-10-06T02:27:55.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.172+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7265d0 con 0x561e7c718c00 2023-10-06T02:27:55.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.173+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v122'136 uv136 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c718c00 2023-10-06T02:27:55.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.173+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7265d0 con 0x561e7c718c00 2023-10-06T02:27:55.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.174+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v122'137 uv137 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c718c00 2023-10-06T02:27:55.175 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:27:55.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.174+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7265d0 con 0x561e7c718c00 2023-10-06T02:27:55.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.175+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v122'138 uv138 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c718c00 2023-10-06T02:27:55.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.175+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7265d0 con 0x561e7c718c00 2023-10-06T02:27:55.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.176+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v122'139 uv139 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f00e40063c0 con 0x561e7c718c00 2023-10-06T02:27:55.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.176+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7265d0 con 0x561e7c714830 2023-10-06T02:27:55.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.177+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v122'327 uv318 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.177+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7265d0 con 0x561e7c714830 2023-10-06T02:27:55.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.178+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v122'328 uv328 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.178+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7265d0 con 0x561e7c714830 2023-10-06T02:27:55.180 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:27:55.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.179+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v122'329 uv329 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.179+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7265d0 con 0x561e7c714830 2023-10-06T02:27:55.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.181+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v122'330 uv330 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.181+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c723190 con 0x561e7c714830 2023-10-06T02:27:55.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.182+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v122'331 uv331 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.182+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c723190 con 0x561e7c714830 2023-10-06T02:27:55.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.183+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v122'332 uv325 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.183+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7265d0 con 0x561e7c714830 2023-10-06T02:27:55.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.184+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v122'333 uv333 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.184+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7265d0 con 0x561e7c714830 2023-10-06T02:27:55.185 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:27:55.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.185+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v122'334 uv334 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.185+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7275e0 con 0x561e7c714830 2023-10-06T02:27:55.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.186+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v122'335 uv335 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.186+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c7275e0 con 0x561e7c714830 2023-10-06T02:27:55.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.187+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v122'336 uv336 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.187+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c726ac0 con 0x561e7c714830 2023-10-06T02:27:55.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.188+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v122'337 uv337 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.188+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x561e7c726ac0 con 0x561e7c714830 2023-10-06T02:27:55.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f1210700 1 -- 172.21.15.6:0/798931078 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v122'338 uv338 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f00dc011990 con 0x561e7c714830 2023-10-06T02:27:55.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x561e7c714830 msgr2=0x561e7c716c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x561e7c714830 0x561e7c716c10 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x561e7c703790 msgr2=0x561e7c6ff820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x561e7c703790 0x561e7c6ff820 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x561e7c720230 msgr2=0x561e7c722610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x561e7c720230 0x561e7c722610 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x561e7c70fb40 msgr2=0x561e7c711f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x561e7c70fb40 0x561e7c711f20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x561e7c723b10 msgr2=0x561e7c723ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x561e7c723b10 0x561e7c723ee0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x561e7c71d000 msgr2=0x561e7c71f3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x561e7c71d000 0x561e7c71f3e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x561e7c718c00 msgr2=0x561e7c71c0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x561e7c718c00 0x561e7c71c0c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 reap_dead start 2023-10-06T02:27:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 reap_dead start 2023-10-06T02:27:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 reap_dead start 2023-10-06T02:27:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f2212700 1 -- 172.21.15.6:0/798931078 reap_dead start 2023-10-06T02:27:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f00d40658c0 msgr2=0x7f00d4067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f00d40658c0 0x7f00d4067d70 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00d010 tx=0x7f00dc019000 comp rx=0 tx=0).stop 2023-10-06T02:27:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e7c649600 msgr2=0x561e7c6603f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e7c649600 0x561e7c6603f0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f00ec007ba0 tx=0x7f00ec00c040 comp rx=0 tx=0).stop 2023-10-06T02:27:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 shutdown_connections 2023-10-06T02:27:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e7c649600 0x561e7c6603f0 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 --2- 172.21.15.6:0/798931078 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f00d40658c0 0x7f00d4067d70 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 >> 172.21.15.6:0/798931078 conn(0x561e7c660bd0 msgr2=0x561e7c61c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:55.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 shutdown_connections 2023-10-06T02:27:55.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.189+0000 7f00f87d6000 1 -- 172.21.15.6:0/798931078 wait complete. 2023-10-06T02:27:55.193 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate mds_snaptable 0 2023-10-06T02:27:55.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.271+0000 7f6e634f8000 1 Processor -- start 2023-10-06T02:27:55.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.271+0000 7f6e634f8000 1 -- start start 2023-10-06T02:27:55.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.272+0000 7f6e634f8000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55efb0dc77a0 0x55efb0dc5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.272+0000 7f6e634f8000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55efb0e52cb0 0x55efb0e5fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.272+0000 7f6e634f8000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55efb0e56aa0 0x55efb0e60120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.272+0000 7f6e634f8000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb0d26320 con 0x55efb0dc77a0 2023-10-06T02:27:55.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.272+0000 7f6e634f8000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb0cca980 con 0x55efb0e52cb0 2023-10-06T02:27:55.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.272+0000 7f6e634f8000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55efb0cca620 con 0x55efb0e56aa0 2023-10-06T02:27:55.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.272+0000 7f6e5c733700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55efb0dc77a0 0x55efb0dc5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.272+0000 7f6e5c733700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55efb0dc77a0 0x55efb0dc5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36698/0 (socket says 172.21.15.6:36698) 2023-10-06T02:27:55.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.272+0000 7f6e5c733700 1 -- 172.21.15.6:0/3319386359 learned_addr learned my addr 172.21.15.6:0/3319386359 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:55.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.272+0000 7f6e5bf32700 1 --2- 172.21.15.6:0/3319386359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55efb0e52cb0 0x55efb0e5fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.272+0000 7f6e5cf34700 1 --2- 172.21.15.6:0/3319386359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55efb0e56aa0 0x55efb0e60120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.272+0000 7f6e5c733700 1 -- 172.21.15.6:0/3319386359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55efb0e56aa0 msgr2=0x55efb0e60120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:55.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.272+0000 7f6e5c733700 1 --2- 172.21.15.6:0/3319386359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55efb0e56aa0 0x55efb0e60120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.272+0000 7f6e5c733700 1 -- 172.21.15.6:0/3319386359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55efb0e52cb0 msgr2=0x55efb0e5fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:55.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.272+0000 7f6e5c733700 1 --2- 172.21.15.6:0/3319386359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55efb0e52cb0 0x55efb0e5fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.272+0000 7f6e5c733700 1 -- 172.21.15.6:0/3319386359 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e54005cf0 con 0x55efb0dc77a0 2023-10-06T02:27:55.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.273+0000 7f6e5c733700 1 --2- 172.21.15.6:0/3319386359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55efb0dc77a0 0x55efb0dc5aa0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f6e54005c90 tx=0x7f6e54013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee55b368bfd5a7f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.273+0000 7f6e5af30700 1 -- 172.21.15.6:0/3319386359 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e54000c90 con 0x55efb0dc77a0 2023-10-06T02:27:55.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.273+0000 7f6e5af30700 1 -- 172.21.15.6:0/3319386359 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e540135f0 con 0x55efb0dc77a0 2023-10-06T02:27:55.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.273+0000 7f6e5af30700 1 -- 172.21.15.6:0/3319386359 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e54013bd0 con 0x55efb0dc77a0 2023-10-06T02:27:55.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.273+0000 7f6e634f8000 1 -- 172.21.15.6:0/3319386359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55efb0dc77a0 msgr2=0x55efb0dc5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.273+0000 7f6e634f8000 1 --2- 172.21.15.6:0/3319386359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55efb0dc77a0 0x55efb0dc5aa0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f6e54005c90 tx=0x7f6e54013000 comp rx=0 tx=0).stop 2023-10-06T02:27:55.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.273+0000 7f6e634f8000 1 -- 172.21.15.6:0/3319386359 shutdown_connections 2023-10-06T02:27:55.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.273+0000 7f6e634f8000 1 --2- 172.21.15.6:0/3319386359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55efb0e56aa0 0x55efb0e60120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.273+0000 7f6e634f8000 1 --2- 172.21.15.6:0/3319386359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55efb0dc77a0 0x55efb0dc5aa0 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.273+0000 7f6e634f8000 1 --2- 172.21.15.6:0/3319386359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55efb0e52cb0 0x55efb0e5fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.273+0000 7f6e634f8000 1 -- 172.21.15.6:0/3319386359 >> 172.21.15.6:0/3319386359 conn(0x55efb0d7fd50 msgr2=0x55efb0dc63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:55.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.273+0000 7f6e634f8000 1 -- 172.21.15.6:0/3319386359 shutdown_connections 2023-10-06T02:27:55.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.273+0000 7f6e634f8000 1 -- 172.21.15.6:0/3319386359 wait complete. 2023-10-06T02:27:55.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.274+0000 7f6e634f8000 1 Processor -- start 2023-10-06T02:27:55.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.274+0000 7f6e634f8000 1 -- start start 2023-10-06T02:27:55.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e634f8000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55efb0dc77a0 0x55efb0e47620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e634f8000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55efb0e52cb0 0x55efb0dc5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e634f8000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55efb0e56aa0 0x55efb0dc5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e634f8000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb0cc1400 con 0x55efb0e56aa0 2023-10-06T02:27:55.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e634f8000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb0d81a70 con 0x55efb0e52cb0 2023-10-06T02:27:55.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e634f8000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55efb0e4dbf0 con 0x55efb0dc77a0 2023-10-06T02:27:55.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e5cf34700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55efb0e56aa0 0x55efb0dc5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e5cf34700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55efb0e56aa0 0x55efb0dc5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36712/0 (socket says 172.21.15.6:36712) 2023-10-06T02:27:55.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e5c733700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55efb0dc77a0 0x55efb0e47620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e5bf32700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55efb0e52cb0 0x55efb0dc5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e5cf34700 1 -- 172.21.15.6:0/461127802 learned_addr learned my addr 172.21.15.6:0/461127802 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:55.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e5cf34700 1 -- 172.21.15.6:0/461127802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55efb0dc77a0 msgr2=0x55efb0e47620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e5cf34700 1 --2- 172.21.15.6:0/461127802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55efb0dc77a0 0x55efb0e47620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e5cf34700 1 -- 172.21.15.6:0/461127802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55efb0e52cb0 msgr2=0x55efb0dc5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e5cf34700 1 --2- 172.21.15.6:0/461127802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55efb0e52cb0 0x55efb0dc5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e5cf34700 1 -- 172.21.15.6:0/461127802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efb0cd93d0 con 0x55efb0e56aa0 2023-10-06T02:27:55.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e5cf34700 1 --2- 172.21.15.6:0/461127802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55efb0e56aa0 0x55efb0dc5fe0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00e640 tx=0x7f6e4c001d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e5972d700 1 -- 172.21.15.6:0/461127802 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c012350 con 0x55efb0e56aa0 2023-10-06T02:27:55.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e5972d700 1 -- 172.21.15.6:0/461127802 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c0124b0 con 0x55efb0e56aa0 2023-10-06T02:27:55.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e634f8000 1 -- 172.21.15.6:0/461127802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55efb0cccae0 con 0x55efb0e56aa0 2023-10-06T02:27:55.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e5972d700 1 -- 172.21.15.6:0/461127802 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c012870 con 0x55efb0e56aa0 2023-10-06T02:27:55.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.275+0000 7f6e634f8000 1 -- 172.21.15.6:0/461127802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55efb0ccc540 con 0x55efb0e56aa0 2023-10-06T02:27:55.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.277+0000 7f6e5972d700 1 -- 172.21.15.6:0/461127802 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e4c012be0 con 0x55efb0e56aa0 2023-10-06T02:27:55.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.277+0000 7f6e5972d700 1 --2- 172.21.15.6:0/461127802 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e3c065890 0x7f6e3c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.277+0000 7f6e5972d700 1 -- 172.21.15.6:0/461127802 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 8700+0+0 (secure 0 0 0) 0x7f6e4c083330 con 0x55efb0e56aa0 2023-10-06T02:27:55.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.277+0000 7f6e5c733700 1 --2- 172.21.15.6:0/461127802 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e3c065890 0x7f6e3c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.277+0000 7f6e634f8000 1 --2- 172.21.15.6:0/461127802 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55efb0e4cd10 0x55efb0e4c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.277+0000 7f6e634f8000 1 -- 172.21.15.6:0/461127802 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:1 14.d 14:b50e409b:::mds_snaptable:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v8 -- 0x55efb0dacac0 con 0x55efb0e4cd10 2023-10-06T02:27:55.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.278+0000 7f6e5bf32700 1 --2- 172.21.15.6:0/461127802 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55efb0e4cd10 0x55efb0e4c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.278+0000 7f6e5c733700 1 --2- 172.21.15.6:0/461127802 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e3c065890 0x7f6e3c067d40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6e54005c90 tx=0x7f6e5401b000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.278+0000 7f6e5bf32700 1 --2- 172.21.15.6:0/461127802 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55efb0e4cd10 0x55efb0e4c2f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.279+0000 7f6e5bf32700 1 -- 172.21.15.6:0/461127802 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(1 mds_snaptable [truncate 0] v122'137 uv137 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6e4400b240 con 0x55efb0e4cd10 2023-10-06T02:27:55.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.279+0000 7f6e634f8000 1 -- 172.21.15.6:0/461127802 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55efb0e4cd10 msgr2=0x55efb0e4c2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.279+0000 7f6e634f8000 1 --2- 172.21.15.6:0/461127802 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55efb0e4cd10 0x55efb0e4c2f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.279+0000 7f6e634f8000 1 -- 172.21.15.6:0/461127802 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e3c065890 msgr2=0x7f6e3c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.279+0000 7f6e634f8000 1 --2- 172.21.15.6:0/461127802 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e3c065890 0x7f6e3c067d40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6e54005c90 tx=0x7f6e5401b000 comp rx=0 tx=0).stop 2023-10-06T02:27:55.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.279+0000 7f6e634f8000 1 -- 172.21.15.6:0/461127802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55efb0e56aa0 msgr2=0x55efb0dc5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.279+0000 7f6e634f8000 1 --2- 172.21.15.6:0/461127802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55efb0e56aa0 0x55efb0dc5fe0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00e640 tx=0x7f6e4c001d10 comp rx=0 tx=0).stop 2023-10-06T02:27:55.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.279+0000 7f6e5cf34700 1 -- 172.21.15.6:0/461127802 reap_dead start 2023-10-06T02:27:55.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.279+0000 7f6e634f8000 1 -- 172.21.15.6:0/461127802 shutdown_connections 2023-10-06T02:27:55.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.279+0000 7f6e634f8000 1 -- 172.21.15.6:0/461127802 >> 172.21.15.6:0/461127802 conn(0x55efb0d7fd50 msgr2=0x55efb0e47c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:55.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.279+0000 7f6e634f8000 1 -- 172.21.15.6:0/461127802 shutdown_connections 2023-10-06T02:27:55.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.279+0000 7f6e634f8000 1 -- 172.21.15.6:0/461127802 wait complete. 2023-10-06T02:27:55.297 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:27:55.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.445+0000 7f7d64ebc700 1 Processor -- start 2023-10-06T02:27:55.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.445+0000 7f7d64ebc700 1 -- start start 2023-10-06T02:27:55.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.445+0000 7f7d64ebc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d600a89c0 0x7f7d600aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.445+0000 7f7d64ebc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d600a8d90 0x7f7d600af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.445+0000 7f7d64ebc700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d6006b030 con 0x7f7d600af570 2023-10-06T02:27:55.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.445+0000 7f7d64ebc700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d600af9b0 con 0x7f7d600a8d90 2023-10-06T02:27:55.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.446+0000 7f7d64ebc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d600b1ab0 con 0x7f7d600a89c0 2023-10-06T02:27:55.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.446+0000 7f7d5dd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d600a8d90 0x7f7d600af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.446+0000 7f7d5dd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d600a8d90 0x7f7d600af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36716/0 (socket says 172.21.15.6:36716) 2023-10-06T02:27:55.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.446+0000 7f7d5dd9b700 1 -- 172.21.15.6:0/807356970 learned_addr learned my addr 172.21.15.6:0/807356970 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:55.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.446+0000 7f7d5e59c700 1 --2- 172.21.15.6:0/807356970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d600a89c0 0x7f7d600aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.446+0000 7f7d5dd9b700 1 -- 172.21.15.6:0/807356970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d600a89c0 msgr2=0x7f7d600aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:55.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.446+0000 7f7d5dd9b700 1 --2- 172.21.15.6:0/807356970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d600a89c0 0x7f7d600aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.446+0000 7f7d5dd9b700 1 -- 172.21.15.6:0/807356970 >> v1:172.21.15.175:6789/0 conn(0x7f7d600af570 legacy=0x7f7d600b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.446+0000 7f7d5dd9b700 1 -- 172.21.15.6:0/807356970 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6006ad50 con 0x7f7d600a8d90 2023-10-06T02:27:55.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.446+0000 7f7d5dd9b700 1 --2- 172.21.15.6:0/807356970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d600a8d90 0x7f7d600af030 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f7d480099b0 tx=0x7f7d48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110c3c663071fa9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.446+0000 7f7d5d59a700 1 -- 172.21.15.6:0/807356970 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48009ea0 con 0x7f7d600a8d90 2023-10-06T02:27:55.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.446+0000 7f7d5d59a700 1 -- 172.21.15.6:0/807356970 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4800b860 con 0x7f7d600a8d90 2023-10-06T02:27:55.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.446+0000 7f7d5d59a700 1 -- 172.21.15.6:0/807356970 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4800bc00 con 0x7f7d600a8d90 2023-10-06T02:27:55.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.447+0000 7f7d64ebc700 1 -- 172.21.15.6:0/807356970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d600a8d90 msgr2=0x7f7d600af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.447+0000 7f7d64ebc700 1 --2- 172.21.15.6:0/807356970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d600a8d90 0x7f7d600af030 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f7d480099b0 tx=0x7f7d48009250 comp rx=0 tx=0).stop 2023-10-06T02:27:55.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.447+0000 7f7d64ebc700 1 -- 172.21.15.6:0/807356970 shutdown_connections 2023-10-06T02:27:55.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.447+0000 7f7d64ebc700 1 --2- 172.21.15.6:0/807356970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d600a89c0 0x7f7d600aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.447+0000 7f7d64ebc700 1 --2- 172.21.15.6:0/807356970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d600a8d90 0x7f7d600af030 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.447+0000 7f7d64ebc700 1 -- 172.21.15.6:0/807356970 >> 172.21.15.6:0/807356970 conn(0x7f7d60067910 msgr2=0x7f7d600ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:55.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.447+0000 7f7d64ebc700 1 -- 172.21.15.6:0/807356970 shutdown_connections 2023-10-06T02:27:55.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.447+0000 7f7d64ebc700 1 -- 172.21.15.6:0/807356970 wait complete. 2023-10-06T02:27:55.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.448+0000 7f7d64ebc700 1 Processor -- start 2023-10-06T02:27:55.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.448+0000 7f7d64ebc700 1 -- start start 2023-10-06T02:27:55.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.449+0000 7f7d64ebc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d600a89c0 0x7f7d600c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.449+0000 7f7d64ebc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d600a8d90 0x7f7d600c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.449+0000 7f7d64ebc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d600af570 0x7f7d600c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.449+0000 7f7d64ebc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d600c71e0 con 0x7f7d600a89c0 2023-10-06T02:27:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.449+0000 7f7d64ebc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d600c65d0 con 0x7f7d600af570 2023-10-06T02:27:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.449+0000 7f7d64ebc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d600c68b0 con 0x7f7d600a8d90 2023-10-06T02:27:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.449+0000 7f7d5e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d600a89c0 0x7f7d600c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.449+0000 7f7d5e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d600a89c0 0x7f7d600c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36730/0 (socket says 172.21.15.6:36730) 2023-10-06T02:27:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.449+0000 7f7d5e59c700 1 -- 172.21.15.6:0/3527903063 learned_addr learned my addr 172.21.15.6:0/3527903063 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.449+0000 7f7d5dd9b700 1 --2- 172.21.15.6:0/3527903063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d600a8d90 0x7f7d600c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.449+0000 7f7d5ed9d700 1 --2- 172.21.15.6:0/3527903063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d600af570 0x7f7d600c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.449+0000 7f7d5e59c700 1 -- 172.21.15.6:0/3527903063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d600a8d90 msgr2=0x7f7d600c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.449+0000 7f7d5e59c700 1 --2- 172.21.15.6:0/3527903063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d600a8d90 0x7f7d600c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.449+0000 7f7d5e59c700 1 -- 172.21.15.6:0/3527903063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d600af570 msgr2=0x7f7d600c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.449+0000 7f7d5e59c700 1 --2- 172.21.15.6:0/3527903063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d600af570 0x7f7d600c4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.449+0000 7f7d5e59c700 1 -- 172.21.15.6:0/3527903063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d480094f0 con 0x7f7d600a89c0 2023-10-06T02:27:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.450+0000 7f7d5e59c700 1 --2- 172.21.15.6:0/3527903063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d600a89c0 0x7f7d600c89c0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800ec80 tx=0x7f7d58009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.450+0000 7f7d567fc700 1 -- 172.21.15.6:0/3527903063 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5800c850 con 0x7f7d600a89c0 2023-10-06T02:27:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.450+0000 7f7d567fc700 1 -- 172.21.15.6:0/3527903063 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5800c9b0 con 0x7f7d600a89c0 2023-10-06T02:27:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.450+0000 7f7d64ebc700 1 -- 172.21.15.6:0/3527903063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d600c6b90 con 0x7f7d600a89c0 2023-10-06T02:27:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.450+0000 7f7d567fc700 1 -- 172.21.15.6:0/3527903063 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5800cd30 con 0x7f7d600a89c0 2023-10-06T02:27:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.450+0000 7f7d64ebc700 1 -- 172.21.15.6:0/3527903063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d600ca9e0 con 0x7f7d600a89c0 2023-10-06T02:27:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.451+0000 7f7d64ebc700 1 -- 172.21.15.6:0/3527903063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d60087170 con 0x7f7d600a89c0 2023-10-06T02:27:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.451+0000 7f7d567fc700 1 -- 172.21.15.6:0/3527903063 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d58013680 con 0x7f7d600a89c0 2023-10-06T02:27:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.452+0000 7f7d567fc700 1 --2- 172.21.15.6:0/3527903063 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d40066f30 0x7f7d400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.452+0000 7f7d567fc700 1 -- 172.21.15.6:0/3527903063 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 8700+0+0 (secure 0 0 0) 0x7f7d58085700 con 0x7f7d600a89c0 2023-10-06T02:27:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.452+0000 7f7d5dd9b700 1 --2- 172.21.15.6:0/3527903063 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d40066f30 0x7f7d400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.452+0000 7f7d5dd9b700 1 --2- 172.21.15.6:0/3527903063 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d40066f30 0x7f7d400693e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7d480099b0 tx=0x7f7d48017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.456+0000 7f7d567fc700 1 -- 172.21.15.6:0/3527903063 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d58051d20 con 0x7f7d600a89c0 2023-10-06T02:27:55.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:55.693+0000 7f7d64ebc700 1 -- 172.21.15.6:0/3527903063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f7d6006e5d0 con 0x7f7d600a89c0 2023-10-06T02:27:56.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.088+0000 7f7d567fc700 1 -- 172.21.15.6:0/3527903063 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v261) v1 ==== 162+0+0 (secure 0 0 0) 0x7f7d580210b0 con 0x7f7d600a89c0 2023-10-06T02:27:56.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.090+0000 7f7d64ebc700 1 -- 172.21.15.6:0/3527903063 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d40066f30 msgr2=0x7f7d400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:56.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.090+0000 7f7d64ebc700 1 --2- 172.21.15.6:0/3527903063 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d40066f30 0x7f7d400693e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7d480099b0 tx=0x7f7d48017000 comp rx=0 tx=0).stop 2023-10-06T02:27:56.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.090+0000 7f7d64ebc700 1 -- 172.21.15.6:0/3527903063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d600a89c0 msgr2=0x7f7d600c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:56.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.090+0000 7f7d64ebc700 1 --2- 172.21.15.6:0/3527903063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d600a89c0 0x7f7d600c89c0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800ec80 tx=0x7f7d58009120 comp rx=0 tx=0).stop 2023-10-06T02:27:56.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.090+0000 7f7d64ebc700 1 -- 172.21.15.6:0/3527903063 shutdown_connections 2023-10-06T02:27:56.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.090+0000 7f7d64ebc700 1 --2- 172.21.15.6:0/3527903063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d600af570 0x7f7d600c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.090+0000 7f7d64ebc700 1 --2- 172.21.15.6:0/3527903063 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7d40066f30 0x7f7d400693e0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.090+0000 7f7d64ebc700 1 --2- 172.21.15.6:0/3527903063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d600a89c0 0x7f7d600c89c0 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.090+0000 7f7d64ebc700 1 --2- 172.21.15.6:0/3527903063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d600a8d90 0x7f7d600c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.090+0000 7f7d64ebc700 1 -- 172.21.15.6:0/3527903063 >> 172.21.15.6:0/3527903063 conn(0x7f7d60067910 msgr2=0x7f7d600b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:56.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.090+0000 7f7d64ebc700 1 -- 172.21.15.6:0/3527903063 shutdown_connections 2023-10-06T02:27:56.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.090+0000 7f7d64ebc700 1 -- 172.21.15.6:0/3527903063 wait complete. 2023-10-06T02:27:56.092 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:27:56.095 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:27:56.095+0000 7f9b2f2cd700 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds_snaptable': End of buffer 2023-10-06T02:27:56.096 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:56.095+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:27:56.096 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:56.096+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:27:56.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:56.111 INFO:tasks.ceph.mds.a.smithi006.stderr: -26> 2023-10-06T02:27:56.095+0000 7f9b2f2cd700 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds_snaptable': End of buffer 2023-10-06T02:27:56.133 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:27:56.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.230+0000 7f3992236700 1 Processor -- start 2023-10-06T02:27:56.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.231+0000 7f3992236700 1 -- start start 2023-10-06T02:27:56.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.231+0000 7f3992236700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f398c0a73e0 0x7f398c0c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:56.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.231+0000 7f3992236700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f398c0c9df0 0x7f398c0ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:56.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.231+0000 7f3992236700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f398c0cb700 0x7f398c0cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:56.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.231+0000 7f3992236700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c0cb270 con 0x7f398c0c9df0 2023-10-06T02:27:56.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.231+0000 7f3992236700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c0ca660 con 0x7f398c0a73e0 2023-10-06T02:27:56.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.231+0000 7f3992236700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0ca940 con 0x7f398c0cb700 2023-10-06T02:27:56.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.232+0000 7f398affd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f398c0c9df0 0x7f398c0ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.232+0000 7f398affd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f398c0c9df0 0x7f398c0ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36762/0 (socket says 172.21.15.6:36762) 2023-10-06T02:27:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.232+0000 7f398affd700 1 -- 172.21.15.6:0/1475823182 learned_addr learned my addr 172.21.15.6:0/1475823182 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.232+0000 7f398bfff700 1 --2- 172.21.15.6:0/1475823182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f398c0cb700 0x7f398c0cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.232+0000 7f398b7fe700 1 --2- 172.21.15.6:0/1475823182 >> v2:172.21.15.175:3300/0 conn(0x7f398c0a73e0 0x7f398c0c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.232+0000 7f398affd700 1 -- 172.21.15.6:0/1475823182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f398c0cb700 msgr2=0x7f398c0cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.232+0000 7f398affd700 1 --2- 172.21.15.6:0/1475823182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f398c0cb700 0x7f398c0cbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.232+0000 7f398affd700 1 -- 172.21.15.6:0/1475823182 >> v2:172.21.15.175:3300/0 conn(0x7f398c0a73e0 msgr2=0x7f398c0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.232+0000 7f398affd700 1 --2- 172.21.15.6:0/1475823182 >> v2:172.21.15.175:3300/0 conn(0x7f398c0a73e0 0x7f398c0c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.232+0000 7f398affd700 1 -- 172.21.15.6:0/1475823182 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c0cac20 con 0x7f398c0c9df0 2023-10-06T02:27:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.232+0000 7f398affd700 1 --2- 172.21.15.6:0/1475823182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0c9df0 0x7f398c0ac050 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f398c0b1210 tx=0x7f3980009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6e1ec3bb944508 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.232+0000 7f398a7fc700 1 -- 172.21.15.6:0/1475823182 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398000b640 con 0x7f398c0c9df0 2023-10-06T02:27:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.232+0000 7f398a7fc700 1 -- 172.21.15.6:0/1475823182 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398000b7a0 con 0x7f398c0c9df0 2023-10-06T02:27:56.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.232+0000 7f398a7fc700 1 -- 172.21.15.6:0/1475823182 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398000bb40 con 0x7f398c0c9df0 2023-10-06T02:27:56.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.233+0000 7f3992236700 1 -- 172.21.15.6:0/1475823182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0c9df0 msgr2=0x7f398c0ac050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:56.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.233+0000 7f3992236700 1 --2- 172.21.15.6:0/1475823182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0c9df0 0x7f398c0ac050 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f398c0b1210 tx=0x7f3980009250 comp rx=0 tx=0).stop 2023-10-06T02:27:56.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.233+0000 7f3992236700 1 -- 172.21.15.6:0/1475823182 shutdown_connections 2023-10-06T02:27:56.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.233+0000 7f3992236700 1 --2- 172.21.15.6:0/1475823182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f398c0cb700 0x7f398c0cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.233+0000 7f3992236700 1 --2- 172.21.15.6:0/1475823182 >> v2:172.21.15.175:3300/0 conn(0x7f398c0a73e0 0x7f398c0c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.233+0000 7f3992236700 1 --2- 172.21.15.6:0/1475823182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0c9df0 0x7f398c0ac050 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.233+0000 7f3992236700 1 -- 172.21.15.6:0/1475823182 >> 172.21.15.6:0/1475823182 conn(0x7f398c0cc790 msgr2=0x7f398c0ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:56.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.233+0000 7f3992236700 1 -- 172.21.15.6:0/1475823182 shutdown_connections 2023-10-06T02:27:56.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.233+0000 7f3992236700 1 -- 172.21.15.6:0/1475823182 wait complete. 2023-10-06T02:27:56.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.234+0000 7f3992236700 1 Processor -- start 2023-10-06T02:27:56.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.234+0000 7f3992236700 1 -- start start 2023-10-06T02:27:56.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.235+0000 7f3992236700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0a73e0 0x7f398c169a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:56.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.235+0000 7f3992236700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f398c0c9df0 0x7f398c155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:56.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.235+0000 7f3992236700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f398c0cb700 0x7f398c098de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:56.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.235+0000 7f3992236700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c16d0b0 con 0x7f398c0a73e0 2023-10-06T02:27:56.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.235+0000 7f3992236700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c096df0 con 0x7f398c0cb700 2023-10-06T02:27:56.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.235+0000 7f3992236700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0970d0 con 0x7f398c0c9df0 2023-10-06T02:27:56.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.235+0000 7f398b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0a73e0 0x7f398c169a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:56.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.235+0000 7f398b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0a73e0 0x7f398c169a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36770/0 (socket says 172.21.15.6:36770) 2023-10-06T02:27:56.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.235+0000 7f398b7fe700 1 -- 172.21.15.6:0/868393488 learned_addr learned my addr 172.21.15.6:0/868393488 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:56.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.235+0000 7f398affd700 1 --2- 172.21.15.6:0/868393488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f398c0c9df0 0x7f398c155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:56.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.235+0000 7f398bfff700 1 --2- 172.21.15.6:0/868393488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f398c0cb700 0x7f398c098de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:56.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.235+0000 7f398b7fe700 1 -- 172.21.15.6:0/868393488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f398c0c9df0 msgr2=0x7f398c155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:56.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.235+0000 7f398b7fe700 1 --2- 172.21.15.6:0/868393488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f398c0c9df0 0x7f398c155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.235+0000 7f398b7fe700 1 -- 172.21.15.6:0/868393488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f398c0cb700 msgr2=0x7f398c098de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:56.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.235+0000 7f398b7fe700 1 --2- 172.21.15.6:0/868393488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f398c0cb700 0x7f398c098de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.235+0000 7f398b7fe700 1 -- 172.21.15.6:0/868393488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39800094f0 con 0x7f398c0a73e0 2023-10-06T02:27:56.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.235+0000 7f398b7fe700 1 --2- 172.21.15.6:0/868393488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0a73e0 0x7f398c169a80 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f397c00e930 tx=0x7f397c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:56.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.236+0000 7f39737fe700 1 -- 172.21.15.6:0/868393488 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c013680 con 0x7f398c0a73e0 2023-10-06T02:27:56.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.236+0000 7f39737fe700 1 -- 172.21.15.6:0/868393488 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c0137e0 con 0x7f398c0a73e0 2023-10-06T02:27:56.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.236+0000 7f3992236700 1 -- 172.21.15.6:0/868393488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c0973b0 con 0x7f398c0a73e0 2023-10-06T02:27:56.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.236+0000 7f39737fe700 1 -- 172.21.15.6:0/868393488 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c013b80 con 0x7f398c0a73e0 2023-10-06T02:27:56.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.236+0000 7f3992236700 1 -- 172.21.15.6:0/868393488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c096a30 con 0x7f398c0a73e0 2023-10-06T02:27:56.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.237+0000 7f3992236700 1 -- 172.21.15.6:0/868393488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c16d350 con 0x7f398c0a73e0 2023-10-06T02:27:56.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.237+0000 7f39737fe700 1 -- 172.21.15.6:0/868393488 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f397c00c3e0 con 0x7f398c0a73e0 2023-10-06T02:27:56.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.237+0000 7f39737fe700 1 --2- 172.21.15.6:0/868393488 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3978066f30 0x7f39780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:56.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.237+0000 7f39737fe700 1 -- 172.21.15.6:0/868393488 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 8786+0+0 (secure 0 0 0) 0x7f397c085230 con 0x7f398c0a73e0 2023-10-06T02:27:56.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.237+0000 7f398affd700 1 --2- 172.21.15.6:0/868393488 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3978066f30 0x7f39780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:56.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.238+0000 7f398affd700 1 --2- 172.21.15.6:0/868393488 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3978066f30 0x7f39780693e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f398c0b1210 tx=0x7f3980017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:56.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.242+0000 7f39737fe700 1 -- 172.21.15.6:0/868393488 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f397c051850 con 0x7f398c0a73e0 2023-10-06T02:27:56.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.482+0000 7f3992236700 1 -- 172.21.15.6:0/868393488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f398c0caf00 con 0x7f398c0a73e0 2023-10-06T02:27:56.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.483+0000 7f39737fe700 1 -- 172.21.15.6:0/868393488 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 263 v263) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f397c054e70 con 0x7f398c0a73e0 2023-10-06T02:27:56.484 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:56.484 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":263,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":263,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:56.096544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":123,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.485+0000 7f3992236700 1 -- 172.21.15.6:0/868393488 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3978066f30 msgr2=0x7f39780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.485+0000 7f3992236700 1 --2- 172.21.15.6:0/868393488 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3978066f30 0x7f39780693e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f398c0b1210 tx=0x7f3980017000 comp rx=0 tx=0).stop 2023-10-06T02:27:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.485+0000 7f3992236700 1 -- 172.21.15.6:0/868393488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0a73e0 msgr2=0x7f398c169a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.485+0000 7f3992236700 1 --2- 172.21.15.6:0/868393488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0a73e0 0x7f398c169a80 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f397c00e930 tx=0x7f397c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.485+0000 7f3992236700 1 -- 172.21.15.6:0/868393488 shutdown_connections 2023-10-06T02:27:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.485+0000 7f3992236700 1 --2- 172.21.15.6:0/868393488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f398c0cb700 0x7f398c098de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.485+0000 7f3992236700 1 --2- 172.21.15.6:0/868393488 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3978066f30 0x7f39780693e0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.485+0000 7f3992236700 1 --2- 172.21.15.6:0/868393488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0a73e0 0x7f398c169a80 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.485+0000 7f3992236700 1 --2- 172.21.15.6:0/868393488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f398c0c9df0 0x7f398c155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.485+0000 7f3992236700 1 -- 172.21.15.6:0/868393488 >> 172.21.15.6:0/868393488 conn(0x7f398c0cc790 msgr2=0x7f398c0ad280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.485+0000 7f3992236700 1 -- 172.21.15.6:0/868393488 shutdown_connections 2023-10-06T02:27:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.485+0000 7f3992236700 1 -- 172.21.15.6:0/868393488 wait complete. 2023-10-06T02:27:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 263 2023-10-06T02:27:56.497 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:27:56.497 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:56.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.656+0000 7f8b2947b700 1 Processor -- start 2023-10-06T02:27:56.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.656+0000 7f8b2947b700 1 -- start start 2023-10-06T02:27:56.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.657+0000 7f8b2947b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b240b08f0 0x7f8b2415de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:56.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.657+0000 7f8b2947b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b240cccf0 0x7f8b240b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:56.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.657+0000 7f8b2947b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b240afbc0 con 0x7f8b24159150 2023-10-06T02:27:56.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.657+0000 7f8b2947b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b240cd620 con 0x7f8b240cccf0 2023-10-06T02:27:56.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.657+0000 7f8b2947b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b240afe10 con 0x7f8b240b08f0 2023-10-06T02:27:56.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.657+0000 7f8b237fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b240cccf0 0x7f8b240b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:56.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.657+0000 7f8b22ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8b24159150 0x7f8b24159520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34444/0 (socket says 172.21.15.6:34444) 2023-10-06T02:27:56.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.657+0000 7f8b237fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b240cccf0 0x7f8b240b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36786/0 (socket says 172.21.15.6:36786) 2023-10-06T02:27:56.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.657+0000 7f8b22ffd700 1 -- 172.21.15.6:0/870461956 learned_addr learned my addr 172.21.15.6:0/870461956 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:56.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.658+0000 7f8b227fc700 1 --2- 172.21.15.6:0/870461956 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b240b08f0 0x7f8b2415de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:56.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.658+0000 7f8b237fe700 1 -- 172.21.15.6:0/870461956 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b240b08f0 msgr2=0x7f8b2415de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:56.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.658+0000 7f8b237fe700 1 --2- 172.21.15.6:0/870461956 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b240b08f0 0x7f8b2415de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.658+0000 7f8b237fe700 1 -- 172.21.15.6:0/870461956 >> v1:172.21.15.6:6789/0 conn(0x7f8b24159150 legacy=0x7f8b24159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:56.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.658+0000 7f8b237fe700 1 -- 172.21.15.6:0/870461956 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b240b00f0 con 0x7f8b240cccf0 2023-10-06T02:27:56.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.658+0000 7f8b237fe700 1 --2- 172.21.15.6:0/870461956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b240cccf0 0x7f8b240b20a0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009e60 tx=0x7f8b14009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956c4da39d0b8093 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:56.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.658+0000 7f8b21ffb700 1 -- 172.21.15.6:0/870461956 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1400e070 con 0x7f8b240cccf0 2023-10-06T02:27:56.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.658+0000 7f8b21ffb700 1 -- 172.21.15.6:0/870461956 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1400bc30 con 0x7f8b240cccf0 2023-10-06T02:27:56.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.658+0000 7f8b21ffb700 1 -- 172.21.15.6:0/870461956 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b14012430 con 0x7f8b240cccf0 2023-10-06T02:27:56.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.659+0000 7f8b2947b700 1 -- 172.21.15.6:0/870461956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b240cccf0 msgr2=0x7f8b240b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:56.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.659+0000 7f8b2947b700 1 --2- 172.21.15.6:0/870461956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b240cccf0 0x7f8b240b20a0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009e60 tx=0x7f8b14009780 comp rx=0 tx=0).stop 2023-10-06T02:27:56.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.659+0000 7f8b2947b700 1 -- 172.21.15.6:0/870461956 shutdown_connections 2023-10-06T02:27:56.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.659+0000 7f8b2947b700 1 --2- 172.21.15.6:0/870461956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b240cccf0 0x7f8b240b20a0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.659+0000 7f8b2947b700 1 --2- 172.21.15.6:0/870461956 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b240b08f0 0x7f8b2415de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.659+0000 7f8b2947b700 1 -- 172.21.15.6:0/870461956 >> 172.21.15.6:0/870461956 conn(0x7f8b24068680 msgr2=0x7f8b24068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:56.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.659+0000 7f8b2947b700 1 -- 172.21.15.6:0/870461956 shutdown_connections 2023-10-06T02:27:56.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.659+0000 7f8b2947b700 1 -- 172.21.15.6:0/870461956 wait complete. 2023-10-06T02:27:56.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.660+0000 7f8b2947b700 1 Processor -- start 2023-10-06T02:27:56.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.660+0000 7f8b2947b700 1 -- start start 2023-10-06T02:27:56.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b2947b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b240b08f0 0x7f8b240c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b2947b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b240cccf0 0x7f8b2416cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b2947b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b24159150 0x7f8b2416d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b2947b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b240c8900 con 0x7f8b240b08f0 2023-10-06T02:27:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b2947b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b240c7c80 con 0x7f8b24159150 2023-10-06T02:27:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b2947b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b240c7f60 con 0x7f8b240cccf0 2023-10-06T02:27:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b22ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b240b08f0 0x7f8b240c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b22ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b240b08f0 0x7f8b240c7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36802/0 (socket says 172.21.15.6:36802) 2023-10-06T02:27:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b22ffd700 1 -- 172.21.15.6:0/452449456 learned_addr learned my addr 172.21.15.6:0/452449456 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b227fc700 1 --2- 172.21.15.6:0/452449456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b240cccf0 0x7f8b2416cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b237fe700 1 --2- 172.21.15.6:0/452449456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b24159150 0x7f8b2416d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b22ffd700 1 -- 172.21.15.6:0/452449456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b240cccf0 msgr2=0x7f8b2416cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b22ffd700 1 --2- 172.21.15.6:0/452449456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b240cccf0 0x7f8b2416cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b22ffd700 1 -- 172.21.15.6:0/452449456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b24159150 msgr2=0x7f8b2416d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:56.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b22ffd700 1 --2- 172.21.15.6:0/452449456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b24159150 0x7f8b2416d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b22ffd700 1 -- 172.21.15.6:0/452449456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b14009a20 con 0x7f8b240b08f0 2023-10-06T02:27:56.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b22ffd700 1 --2- 172.21.15.6:0/452449456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b240b08f0 0x7f8b240c7420 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00c7c0 tx=0x7f8b1c007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:56.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b1affd700 1 -- 172.21.15.6:0/452449456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c005b30 con 0x7f8b240b08f0 2023-10-06T02:27:56.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b1affd700 1 -- 172.21.15.6:0/452449456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c005c90 con 0x7f8b240b08f0 2023-10-06T02:27:56.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b2947b700 1 -- 172.21.15.6:0/452449456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b240c8240 con 0x7f8b240b08f0 2023-10-06T02:27:56.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b1affd700 1 -- 172.21.15.6:0/452449456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c007320 con 0x7f8b240b08f0 2023-10-06T02:27:56.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.661+0000 7f8b2947b700 1 -- 172.21.15.6:0/452449456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b240c7960 con 0x7f8b240b08f0 2023-10-06T02:27:56.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.662+0000 7f8b2947b700 1 -- 172.21.15.6:0/452449456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b24088aa0 con 0x7f8b240b08f0 2023-10-06T02:27:56.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.663+0000 7f8b1affd700 1 -- 172.21.15.6:0/452449456 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b1c007690 con 0x7f8b240b08f0 2023-10-06T02:27:56.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.663+0000 7f8b1affd700 1 --2- 172.21.15.6:0/452449456 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8b04066f30 0x7f8b040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:56.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.663+0000 7f8b1affd700 1 -- 172.21.15.6:0/452449456 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 8786+0+0 (secure 0 0 0) 0x7f8b1c084580 con 0x7f8b240b08f0 2023-10-06T02:27:56.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.664+0000 7f8b227fc700 1 --2- 172.21.15.6:0/452449456 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8b04066f30 0x7f8b040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:56.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.664+0000 7f8b227fc700 1 --2- 172.21.15.6:0/452449456 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8b04066f30 0x7f8b040693e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f8b240af790 tx=0x7f8b0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:56.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.667+0000 7f8b1affd700 1 -- 172.21.15.6:0/452449456 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b1c050ba0 con 0x7f8b240b08f0 2023-10-06T02:27:56.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.907+0000 7f8b2947b700 1 -- 172.21.15.6:0/452449456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b240c86e0 con 0x7f8b240b08f0 2023-10-06T02:27:56.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.907+0000 7f8b1affd700 1 -- 172.21.15.6:0/452449456 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 263 v263) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f8b1c017020 con 0x7f8b240b08f0 2023-10-06T02:27:56.908 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:56.908 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":263,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":263,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:56.096544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":123,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:56.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.909+0000 7f8b2947b700 1 -- 172.21.15.6:0/452449456 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8b04066f30 msgr2=0x7f8b040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:56.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.909+0000 7f8b2947b700 1 --2- 172.21.15.6:0/452449456 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8b04066f30 0x7f8b040693e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f8b240af790 tx=0x7f8b0c008040 comp rx=0 tx=0).stop 2023-10-06T02:27:56.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.909+0000 7f8b2947b700 1 -- 172.21.15.6:0/452449456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b240b08f0 msgr2=0x7f8b240c7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:56.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.909+0000 7f8b2947b700 1 --2- 172.21.15.6:0/452449456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b240b08f0 0x7f8b240c7420 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00c7c0 tx=0x7f8b1c007f30 comp rx=0 tx=0).stop 2023-10-06T02:27:56.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.909+0000 7f8b2947b700 1 -- 172.21.15.6:0/452449456 shutdown_connections 2023-10-06T02:27:56.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.909+0000 7f8b2947b700 1 --2- 172.21.15.6:0/452449456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b24159150 0x7f8b2416d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.909+0000 7f8b2947b700 1 --2- 172.21.15.6:0/452449456 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8b04066f30 0x7f8b040693e0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.909+0000 7f8b2947b700 1 --2- 172.21.15.6:0/452449456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b240b08f0 0x7f8b240c7420 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.909+0000 7f8b2947b700 1 --2- 172.21.15.6:0/452449456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b240cccf0 0x7f8b2416cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:56.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.909+0000 7f8b2947b700 1 -- 172.21.15.6:0/452449456 >> 172.21.15.6:0/452449456 conn(0x7f8b24068680 msgr2=0x7f8b240b50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:56.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.909+0000 7f8b2947b700 1 -- 172.21.15.6:0/452449456 shutdown_connections 2023-10-06T02:27:56.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:56.909+0000 7f8b2947b700 1 -- 172.21.15.6:0/452449456 wait complete. 2023-10-06T02:27:56.912 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 263 2023-10-06T02:27:56.922 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:27:56.922 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:57.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.040+0000 7fa2ff686700 1 Processor -- start 2023-10-06T02:27:57.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.040+0000 7fa2ff686700 1 -- start start 2023-10-06T02:27:57.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.041+0000 7fa2ff686700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2f81593f0 0x7fa2f806de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:57.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.041+0000 7fa2ff686700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f81597c0 0x7fa2f806e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:57.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.041+0000 7fa2ff686700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f8069950 con 0x7fa2f80b3d30 2023-10-06T02:27:57.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.041+0000 7fa2ff686700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f80b2850 con 0x7fa2f81593f0 2023-10-06T02:27:57.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.041+0000 7fa2ff686700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f80b1fb0 con 0x7fa2f81597c0 2023-10-06T02:27:57.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.041+0000 7fa2fd422700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2f81593f0 0x7fa2f806de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.041+0000 7fa2fd422700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2f81593f0 0x7fa2f806de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36818/0 (socket says 172.21.15.6:36818) 2023-10-06T02:27:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.041+0000 7fa2fd422700 1 -- 172.21.15.6:0/4133204737 learned_addr learned my addr 172.21.15.6:0/4133204737 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.041+0000 7fa2fcc21700 1 --2- 172.21.15.6:0/4133204737 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f81597c0 0x7fa2f806e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.042+0000 7fa2fd422700 1 -- 172.21.15.6:0/4133204737 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f81597c0 msgr2=0x7fa2f806e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.042+0000 7fa2fd422700 1 --2- 172.21.15.6:0/4133204737 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f81597c0 0x7fa2f806e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.042+0000 7fa2fd422700 1 -- 172.21.15.6:0/4133204737 >> v1:172.21.15.175:6789/0 conn(0x7fa2f80b3d30 legacy=0x7fa2f815d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.042+0000 7fa2fd422700 1 -- 172.21.15.6:0/4133204737 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f80b2290 con 0x7fa2f81593f0 2023-10-06T02:27:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.042+0000 7fa2fcc21700 1 --2- 172.21.15.6:0/4133204737 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f81597c0 0x7fa2f806e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.042+0000 7fa2fd422700 1 --2- 172.21.15.6:0/4133204737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2f81593f0 0x7fa2f806de10 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00099b0 tx=0x7fa2f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3791622e7544e93d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.042+0000 7fa2f7fff700 1 -- 172.21.15.6:0/4133204737 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000b860 con 0x7fa2f81593f0 2023-10-06T02:27:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.042+0000 7fa2f7fff700 1 -- 172.21.15.6:0/4133204737 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f000b9c0 con 0x7fa2f81593f0 2023-10-06T02:27:57.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.042+0000 7fa2f7fff700 1 -- 172.21.15.6:0/4133204737 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000bd60 con 0x7fa2f81593f0 2023-10-06T02:27:57.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.042+0000 7fa2ff686700 1 -- 172.21.15.6:0/4133204737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2f81593f0 msgr2=0x7fa2f806de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:57.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.042+0000 7fa2ff686700 1 --2- 172.21.15.6:0/4133204737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2f81593f0 0x7fa2f806de10 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00099b0 tx=0x7fa2f0009250 comp rx=0 tx=0).stop 2023-10-06T02:27:57.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.042+0000 7fa2ff686700 1 -- 172.21.15.6:0/4133204737 shutdown_connections 2023-10-06T02:27:57.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.042+0000 7fa2ff686700 1 --2- 172.21.15.6:0/4133204737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2f81593f0 0x7fa2f806de10 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:57.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.042+0000 7fa2ff686700 1 --2- 172.21.15.6:0/4133204737 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f81597c0 0x7fa2f806e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:57.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.042+0000 7fa2ff686700 1 -- 172.21.15.6:0/4133204737 >> 172.21.15.6:0/4133204737 conn(0x7fa2f806cff0 msgr2=0x7fa2f80afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:57.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.043+0000 7fa2ff686700 1 -- 172.21.15.6:0/4133204737 shutdown_connections 2023-10-06T02:27:57.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.043+0000 7fa2ff686700 1 -- 172.21.15.6:0/4133204737 wait complete. 2023-10-06T02:27:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.044+0000 7fa2ff686700 1 Processor -- start 2023-10-06T02:27:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.044+0000 7fa2ff686700 1 -- start start 2023-10-06T02:27:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.044+0000 7fa2ff686700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2f80b3d30 0x7fa2f80cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.044+0000 7fa2ff686700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f81593f0 0x7fa2f8153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.044+0000 7fa2ff686700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f81597c0 0x7fa2f80acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.044+0000 7fa2ff686700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f80c7360 con 0x7fa2f80b3d30 2023-10-06T02:27:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2ff686700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f81542f0 con 0x7fa2f81593f0 2023-10-06T02:27:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2ff686700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f80ad2e0 con 0x7fa2f81597c0 2023-10-06T02:27:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2fd422700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2f80b3d30 0x7fa2f80cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2fd422700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2f80b3d30 0x7fa2f80cb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36832/0 (socket says 172.21.15.6:36832) 2023-10-06T02:27:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2fd422700 1 -- 172.21.15.6:0/4244504197 learned_addr learned my addr 172.21.15.6:0/4244504197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2fdc23700 1 --2- 172.21.15.6:0/4244504197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f81597c0 0x7fa2f80acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2fcc21700 1 --2- 172.21.15.6:0/4244504197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f81593f0 0x7fa2f8153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2fd422700 1 -- 172.21.15.6:0/4244504197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f81597c0 msgr2=0x7fa2f80acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2fd422700 1 --2- 172.21.15.6:0/4244504197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f81597c0 0x7fa2f80acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2fd422700 1 -- 172.21.15.6:0/4244504197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f81593f0 msgr2=0x7fa2f8153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2fd422700 1 --2- 172.21.15.6:0/4244504197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f81593f0 0x7fa2f8153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2fd422700 1 -- 172.21.15.6:0/4244504197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f00094f0 con 0x7fa2f80b3d30 2023-10-06T02:27:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2fcc21700 1 --2- 172.21.15.6:0/4244504197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f81593f0 0x7fa2f8153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2fd422700 1 --2- 172.21.15.6:0/4244504197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2f80b3d30 0x7fa2f80cb090 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00090b0 tx=0x7fa2f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2f57fa700 1 -- 172.21.15.6:0/4244504197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0026480 con 0x7fa2f80b3d30 2023-10-06T02:27:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2f57fa700 1 -- 172.21.15.6:0/4244504197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f001f070 con 0x7fa2f80b3d30 2023-10-06T02:27:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2ff686700 1 -- 172.21.15.6:0/4244504197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f80ca440 con 0x7fa2f80b3d30 2023-10-06T02:27:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2f57fa700 1 -- 172.21.15.6:0/4244504197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0026830 con 0x7fa2f80b3d30 2023-10-06T02:27:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.045+0000 7fa2ff686700 1 -- 172.21.15.6:0/4244504197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f80caa00 con 0x7fa2f80b3d30 2023-10-06T02:27:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.046+0000 7fa2ff686700 1 -- 172.21.15.6:0/4244504197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f806d3f0 con 0x7fa2f80b3d30 2023-10-06T02:27:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.047+0000 7fa2f57fa700 1 -- 172.21.15.6:0/4244504197 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2f0026ba0 con 0x7fa2f80b3d30 2023-10-06T02:27:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.047+0000 7fa2f57fa700 1 --2- 172.21.15.6:0/4244504197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa2e4066f30 0x7fa2e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.047+0000 7fa2f57fa700 1 -- 172.21.15.6:0/4244504197 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 8786+0+0 (secure 0 0 0) 0x7fa2f0021070 con 0x7fa2f80b3d30 2023-10-06T02:27:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.047+0000 7fa2fcc21700 1 --2- 172.21.15.6:0/4244504197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa2e4066f30 0x7fa2e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.048+0000 7fa2fcc21700 1 --2- 172.21.15.6:0/4244504197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa2e4066f30 0x7fa2e40693e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec006ea0 tx=0x7fa2ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:57.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.051+0000 7fa2f57fa700 1 -- 172.21.15.6:0/4244504197 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2f0053600 con 0x7fa2f80b3d30 2023-10-06T02:27:57.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.293+0000 7fa2ff686700 1 -- 172.21.15.6:0/4244504197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2f80b2570 con 0x7fa2f80b3d30 2023-10-06T02:27:57.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.293+0000 7fa2f57fa700 1 -- 172.21.15.6:0/4244504197 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 264 v264) v1 ==== 95+0+4595 (secure 0 0 0) 0x7fa2f002b020 con 0x7fa2f80b3d30 2023-10-06T02:27:57.294 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:27:57.294 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":264,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3396709104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3396709104},{"type":"v1","addr":"172.21.15.6:6835","nonce":3396709104}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":264}],"filesystems":[{"mdsmap":{"epoch":263,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:56.096544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":123,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:27:57.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.295+0000 7fa2ff686700 1 -- 172.21.15.6:0/4244504197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa2e4066f30 msgr2=0x7fa2e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:57.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.295+0000 7fa2ff686700 1 --2- 172.21.15.6:0/4244504197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa2e4066f30 0x7fa2e40693e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec006ea0 tx=0x7fa2ec008040 comp rx=0 tx=0).stop 2023-10-06T02:27:57.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.295+0000 7fa2ff686700 1 -- 172.21.15.6:0/4244504197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2f80b3d30 msgr2=0x7fa2f80cb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:57.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.295+0000 7fa2ff686700 1 --2- 172.21.15.6:0/4244504197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2f80b3d30 0x7fa2f80cb090 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00090b0 tx=0x7fa2f0017000 comp rx=0 tx=0).stop 2023-10-06T02:27:57.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.295+0000 7fa2ff686700 1 -- 172.21.15.6:0/4244504197 shutdown_connections 2023-10-06T02:27:57.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.295+0000 7fa2ff686700 1 --2- 172.21.15.6:0/4244504197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f81597c0 0x7fa2f80acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:57.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.295+0000 7fa2ff686700 1 --2- 172.21.15.6:0/4244504197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa2e4066f30 0x7fa2e40693e0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:57.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.295+0000 7fa2ff686700 1 --2- 172.21.15.6:0/4244504197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2f80b3d30 0x7fa2f80cb090 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:57.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.295+0000 7fa2ff686700 1 --2- 172.21.15.6:0/4244504197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f81593f0 0x7fa2f8153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:57.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.295+0000 7fa2ff686700 1 -- 172.21.15.6:0/4244504197 >> 172.21.15.6:0/4244504197 conn(0x7fa2f806cff0 msgr2=0x7fa2f815b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:57.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.295+0000 7fa2ff686700 1 -- 172.21.15.6:0/4244504197 shutdown_connections 2023-10-06T02:27:57.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.295+0000 7fa2ff686700 1 -- 172.21.15.6:0/4244504197 wait complete. 2023-10-06T02:27:57.298 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 264 2023-10-06T02:27:57.308 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate mds_snaptable' led to DAMAGED state 2023-10-06T02:27:57.308 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate mds0_inotable' 2023-10-06T02:27:57.308 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:57.308 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:27:57.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:57.309 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:27:57.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:27:57.323 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:27:57.324 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:27:57.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.482+0000 7fef2d58c700 1 Processor -- start 2023-10-06T02:27:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.482+0000 7fef2d58c700 1 -- start start 2023-10-06T02:27:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef2d58c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef28159400 0x7fef280ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef2d58c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef280cd030 0x7fef280cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef2d58c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fef280cf1a0 0x7fef280d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef2d58c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef280b3560 con 0x7fef280cd030 2023-10-06T02:27:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef2d58c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef280cf6f0 con 0x7fef280cf1a0 2023-10-06T02:27:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef2d58c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef280cf9d0 con 0x7fef28159400 2023-10-06T02:27:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef277fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef280cd030 0x7fef280cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef277fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef280cd030 0x7fef280cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36834/0 (socket says 172.21.15.6:36834) 2023-10-06T02:27:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef277fe700 1 -- 172.21.15.6:0/1788563954 learned_addr learned my addr 172.21.15.6:0/1788563954 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef2cd8b700 1 --2- 172.21.15.6:0/1788563954 >> v2:172.21.15.175:3300/0 conn(0x7fef280cf1a0 0x7fef280d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef27fff700 1 --2- 172.21.15.6:0/1788563954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef28159400 0x7fef280ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef277fe700 1 -- 172.21.15.6:0/1788563954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef28159400 msgr2=0x7fef280ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef277fe700 1 --2- 172.21.15.6:0/1788563954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef28159400 0x7fef280ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef277fe700 1 -- 172.21.15.6:0/1788563954 >> v2:172.21.15.175:3300/0 conn(0x7fef280cf1a0 msgr2=0x7fef280d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef277fe700 1 --2- 172.21.15.6:0/1788563954 >> v2:172.21.15.175:3300/0 conn(0x7fef280cf1a0 0x7fef280d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef277fe700 1 -- 172.21.15.6:0/1788563954 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef280b2f10 con 0x7fef280cd030 2023-10-06T02:27:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef2cd8b700 1 --2- 172.21.15.6:0/1788563954 >> v2:172.21.15.175:3300/0 conn(0x7fef280cf1a0 0x7fef280d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.483+0000 7fef27fff700 1 --2- 172.21.15.6:0/1788563954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef28159400 0x7fef280ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.484+0000 7fef277fe700 1 --2- 172.21.15.6:0/1788563954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef280cd030 0x7fef280cfec0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fef280d0f40 tx=0x7fef1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705e9178dfc8b37c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.484+0000 7fef26ffd700 1 -- 172.21.15.6:0/1788563954 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00b860 con 0x7fef280cd030 2023-10-06T02:27:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.484+0000 7fef26ffd700 1 -- 172.21.15.6:0/1788563954 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c00b9c0 con 0x7fef280cd030 2023-10-06T02:27:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.484+0000 7fef26ffd700 1 -- 172.21.15.6:0/1788563954 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00bd60 con 0x7fef280cd030 2023-10-06T02:27:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.484+0000 7fef2d58c700 1 -- 172.21.15.6:0/1788563954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef280cd030 msgr2=0x7fef280cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.484+0000 7fef2d58c700 1 --2- 172.21.15.6:0/1788563954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef280cd030 0x7fef280cfec0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fef280d0f40 tx=0x7fef1c009250 comp rx=0 tx=0).stop 2023-10-06T02:27:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.484+0000 7fef2d58c700 1 -- 172.21.15.6:0/1788563954 shutdown_connections 2023-10-06T02:27:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.484+0000 7fef2d58c700 1 --2- 172.21.15.6:0/1788563954 >> v2:172.21.15.175:3300/0 conn(0x7fef280cf1a0 0x7fef280d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.484+0000 7fef2d58c700 1 --2- 172.21.15.6:0/1788563954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef28159400 0x7fef280ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.484+0000 7fef2d58c700 1 --2- 172.21.15.6:0/1788563954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef280cd030 0x7fef280cfec0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.484+0000 7fef2d58c700 1 -- 172.21.15.6:0/1788563954 >> 172.21.15.6:0/1788563954 conn(0x7fef2806ac10 msgr2=0x7fef28068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.484+0000 7fef2d58c700 1 -- 172.21.15.6:0/1788563954 shutdown_connections 2023-10-06T02:27:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.484+0000 7fef2d58c700 1 -- 172.21.15.6:0/1788563954 wait complete. 2023-10-06T02:27:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.485+0000 7fef2d58c700 1 Processor -- start 2023-10-06T02:27:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.486+0000 7fef2d58c700 1 -- start start 2023-10-06T02:27:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.486+0000 7fef2d58c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef280cd030 0x7fef281699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.486+0000 7fef2d58c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef280cf1a0 0x7fef28169ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.486+0000 7fef2d58c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef28159400 0x7fef280b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.486+0000 7fef2d58c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2816a740 con 0x7fef280cd030 2023-10-06T02:27:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.486+0000 7fef2d58c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2816aa20 con 0x7fef280cf1a0 2023-10-06T02:27:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.486+0000 7fef2d58c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2816ad00 con 0x7fef28159400 2023-10-06T02:27:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.486+0000 7fef27fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef280cd030 0x7fef281699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.486+0000 7fef27fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef280cd030 0x7fef281699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36844/0 (socket says 172.21.15.6:36844) 2023-10-06T02:27:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.486+0000 7fef27fff700 1 -- 172.21.15.6:0/3966673958 learned_addr learned my addr 172.21.15.6:0/3966673958 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.487+0000 7fef277fe700 1 --2- 172.21.15.6:0/3966673958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef280cf1a0 0x7fef28169ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.487+0000 7fef2cd8b700 1 --2- 172.21.15.6:0/3966673958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef28159400 0x7fef280b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.487+0000 7fef27fff700 1 -- 172.21.15.6:0/3966673958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef28159400 msgr2=0x7fef280b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.487+0000 7fef27fff700 1 --2- 172.21.15.6:0/3966673958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef28159400 0x7fef280b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.487+0000 7fef27fff700 1 -- 172.21.15.6:0/3966673958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef280cf1a0 msgr2=0x7fef28169ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.487+0000 7fef27fff700 1 --2- 172.21.15.6:0/3966673958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef280cf1a0 0x7fef28169ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.487+0000 7fef27fff700 1 -- 172.21.15.6:0/3966673958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c0094f0 con 0x7fef280cd030 2023-10-06T02:27:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.487+0000 7fef2cd8b700 1 --2- 172.21.15.6:0/3966673958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef28159400 0x7fef280b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.487+0000 7fef27fff700 1 --2- 172.21.15.6:0/3966673958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef280cd030 0x7fef281699a0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fef1800c880 tx=0x7fef18008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.487+0000 7fef0ffff700 1 -- 172.21.15.6:0/3966673958 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18005a00 con 0x7fef280cd030 2023-10-06T02:27:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.487+0000 7fef0ffff700 1 -- 172.21.15.6:0/3966673958 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef18005b60 con 0x7fef280cd030 2023-10-06T02:27:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.487+0000 7fef0ffff700 1 -- 172.21.15.6:0/3966673958 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18011600 con 0x7fef280cd030 2023-10-06T02:27:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.487+0000 7fef2d58c700 1 -- 172.21.15.6:0/3966673958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2816afe0 con 0x7fef280cd030 2023-10-06T02:27:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.487+0000 7fef2d58c700 1 -- 172.21.15.6:0/3966673958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2816a420 con 0x7fef280cd030 2023-10-06T02:27:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.488+0000 7fef2d58c700 1 -- 172.21.15.6:0/3966673958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef281597d0 con 0x7fef280cd030 2023-10-06T02:27:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.488+0000 7fef0ffff700 1 -- 172.21.15.6:0/3966673958 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef180119f0 con 0x7fef280cd030 2023-10-06T02:27:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.489+0000 7fef0ffff700 1 --2- 172.21.15.6:0/3966673958 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fef14066f30 0x7fef140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.489+0000 7fef0ffff700 1 -- 172.21.15.6:0/3966673958 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 8786+0+0 (secure 0 0 0) 0x7fef18084fc0 con 0x7fef280cd030 2023-10-06T02:27:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.489+0000 7fef277fe700 1 --2- 172.21.15.6:0/3966673958 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fef14066f30 0x7fef140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.490+0000 7fef277fe700 1 --2- 172.21.15.6:0/3966673958 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fef14066f30 0x7fef140693e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fef280d0f40 tx=0x7fef1c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.493+0000 7fef0ffff700 1 -- 172.21.15.6:0/3966673958 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef180515e0 con 0x7fef280cd030 2023-10-06T02:27:57.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:57.734+0000 7fef2d58c700 1 -- 172.21.15.6:0/3966673958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fef280b31f0 con 0x7fef280cd030 2023-10-06T02:27:58.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.111+0000 7fef0ffff700 1 -- 172.21.15.6:0/3966673958 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v265) v1 ==== 161+0+0 (secure 0 0 0) 0x7fef1801e070 con 0x7fef280cd030 2023-10-06T02:27:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.114+0000 7fef2d58c700 1 -- 172.21.15.6:0/3966673958 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fef14066f30 msgr2=0x7fef140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.114+0000 7fef2d58c700 1 --2- 172.21.15.6:0/3966673958 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fef14066f30 0x7fef140693e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fef280d0f40 tx=0x7fef1c017000 comp rx=0 tx=0).stop 2023-10-06T02:27:58.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.114+0000 7fef2d58c700 1 -- 172.21.15.6:0/3966673958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef280cd030 msgr2=0x7fef281699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:58.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.114+0000 7fef2d58c700 1 --2- 172.21.15.6:0/3966673958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef280cd030 0x7fef281699a0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fef1800c880 tx=0x7fef18008040 comp rx=0 tx=0).stop 2023-10-06T02:27:58.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.114+0000 7fef2d58c700 1 -- 172.21.15.6:0/3966673958 shutdown_connections 2023-10-06T02:27:58.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.114+0000 7fef2d58c700 1 --2- 172.21.15.6:0/3966673958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef28159400 0x7fef280b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:58.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.114+0000 7fef2d58c700 1 --2- 172.21.15.6:0/3966673958 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fef14066f30 0x7fef140693e0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:58.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.114+0000 7fef2d58c700 1 --2- 172.21.15.6:0/3966673958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef280cd030 0x7fef281699a0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:58.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.114+0000 7fef2d58c700 1 --2- 172.21.15.6:0/3966673958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef280cf1a0 0x7fef28169ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:58.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.114+0000 7fef2d58c700 1 -- 172.21.15.6:0/3966673958 >> 172.21.15.6:0/3966673958 conn(0x7fef2806ac10 msgr2=0x7fef28155f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:58.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.114+0000 7fef2d58c700 1 -- 172.21.15.6:0/3966673958 shutdown_connections 2023-10-06T02:27:58.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.114+0000 7fef2d58c700 1 -- 172.21.15.6:0/3966673958 wait complete. 2023-10-06T02:27:58.117 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:27:58.128 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:27:58.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.249+0000 7fd4086f7700 1 Processor -- start 2023-10-06T02:27:58.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.249+0000 7fd4086f7700 1 -- start start 2023-10-06T02:27:58.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.250+0000 7fd4086f7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd400086ff0 0x7fd400087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:58.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.250+0000 7fd4086f7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4000b21b0 0x7fd4000b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:58.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.250+0000 7fd4086f7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4000b2b70 con 0x7fd40015a030 2023-10-06T02:27:58.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.250+0000 7fd4086f7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4000b0cf0 con 0x7fd400086ff0 2023-10-06T02:27:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.250+0000 7fd4086f7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000879b0 con 0x7fd4000b21b0 2023-10-06T02:27:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.250+0000 7fd405c92700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd400086ff0 0x7fd400087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.250+0000 7fd405c92700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd400086ff0 0x7fd400087470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36858/0 (socket says 172.21.15.6:36858) 2023-10-06T02:27:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.250+0000 7fd405c92700 1 -- 172.21.15.6:0/538511453 learned_addr learned my addr 172.21.15.6:0/538511453 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.250+0000 7fd406493700 1 --1- 172.21.15.6:0/538511453 >> v1:172.21.15.6:6789/0 conn(0x7fd40015a030 0x7fd40015a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34452/0 (socket says 172.21.15.6:34452) 2023-10-06T02:27:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.251+0000 7fd406c94700 1 --2- 172.21.15.6:0/538511453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4000b21b0 0x7fd4000b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.251+0000 7fd405c92700 1 -- 172.21.15.6:0/538511453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4000b21b0 msgr2=0x7fd4000b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.251+0000 7fd405c92700 1 --2- 172.21.15.6:0/538511453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4000b21b0 0x7fd4000b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.251+0000 7fd405c92700 1 -- 172.21.15.6:0/538511453 >> v1:172.21.15.6:6789/0 conn(0x7fd40015a030 legacy=0x7fd40015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.251+0000 7fd405c92700 1 -- 172.21.15.6:0/538511453 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4000afc50 con 0x7fd400086ff0 2023-10-06T02:27:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.251+0000 7fd406c94700 1 --2- 172.21.15.6:0/538511453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4000b21b0 0x7fd4000b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.251+0000 7fd405c92700 1 --2- 172.21.15.6:0/538511453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd400086ff0 0x7fd400087470 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40099b0 tx=0x7fd3f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ba1c8212641cfb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.251+0000 7fd405491700 1 -- 172.21.15.6:0/538511453 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f400b860 con 0x7fd400086ff0 2023-10-06T02:27:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.251+0000 7fd405491700 1 -- 172.21.15.6:0/538511453 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f400b9c0 con 0x7fd400086ff0 2023-10-06T02:27:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.251+0000 7fd405491700 1 -- 172.21.15.6:0/538511453 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f400bd60 con 0x7fd400086ff0 2023-10-06T02:27:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.251+0000 7fd4086f7700 1 -- 172.21.15.6:0/538511453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd400086ff0 msgr2=0x7fd400087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.251+0000 7fd4086f7700 1 --2- 172.21.15.6:0/538511453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd400086ff0 0x7fd400087470 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40099b0 tx=0x7fd3f4009250 comp rx=0 tx=0).stop 2023-10-06T02:27:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.252+0000 7fd4086f7700 1 -- 172.21.15.6:0/538511453 shutdown_connections 2023-10-06T02:27:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.252+0000 7fd4086f7700 1 --2- 172.21.15.6:0/538511453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4000b21b0 0x7fd4000b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.252+0000 7fd4086f7700 1 --2- 172.21.15.6:0/538511453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd400086ff0 0x7fd400087470 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.252+0000 7fd4086f7700 1 -- 172.21.15.6:0/538511453 >> 172.21.15.6:0/538511453 conn(0x7fd400068680 msgr2=0x7fd400068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.252+0000 7fd4086f7700 1 -- 172.21.15.6:0/538511453 shutdown_connections 2023-10-06T02:27:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.252+0000 7fd4086f7700 1 -- 172.21.15.6:0/538511453 wait complete. 2023-10-06T02:27:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.253+0000 7fd4086f7700 1 Processor -- start 2023-10-06T02:27:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.253+0000 7fd4086f7700 1 -- start start 2023-10-06T02:27:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.253+0000 7fd4086f7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd400086ff0 0x7fd40016d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.253+0000 7fd4086f7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4000b21b0 0x7fd400155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.253+0000 7fd4086f7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd40015a030 0x7fd4001577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.253+0000 7fd4086f7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000c4fb0 con 0x7fd400086ff0 2023-10-06T02:27:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.253+0000 7fd4086f7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000c4cb0 con 0x7fd40015a030 2023-10-06T02:27:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.253+0000 7fd4086f7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40016da30 con 0x7fd4000b21b0 2023-10-06T02:27:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.254+0000 7fd406493700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd400086ff0 0x7fd40016d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.254+0000 7fd406493700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd400086ff0 0x7fd40016d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36864/0 (socket says 172.21.15.6:36864) 2023-10-06T02:27:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.254+0000 7fd406493700 1 -- 172.21.15.6:0/320689307 learned_addr learned my addr 172.21.15.6:0/320689307 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.254+0000 7fd406c94700 1 --2- 172.21.15.6:0/320689307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd40015a030 0x7fd4001577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:58.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.254+0000 7fd405c92700 1 --2- 172.21.15.6:0/320689307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4000b21b0 0x7fd400155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:58.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.254+0000 7fd406493700 1 -- 172.21.15.6:0/320689307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4000b21b0 msgr2=0x7fd400155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:58.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.254+0000 7fd406493700 1 --2- 172.21.15.6:0/320689307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4000b21b0 0x7fd400155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:58.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.254+0000 7fd406493700 1 -- 172.21.15.6:0/320689307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd40015a030 msgr2=0x7fd4001577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:58.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.254+0000 7fd406493700 1 --2- 172.21.15.6:0/320689307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd40015a030 0x7fd4001577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.254+0000 7fd406493700 1 -- 172.21.15.6:0/320689307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f40094f0 con 0x7fd400086ff0 2023-10-06T02:27:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.254+0000 7fd406493700 1 --2- 172.21.15.6:0/320689307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd400086ff0 0x7fd40016d1e0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800cd30 tx=0x7fd3f8001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.254+0000 7fd3fe7fc700 1 -- 172.21.15.6:0/320689307 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8005df0 con 0x7fd400086ff0 2023-10-06T02:27:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.254+0000 7fd3fe7fc700 1 -- 172.21.15.6:0/320689307 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f800a960 con 0x7fd400086ff0 2023-10-06T02:27:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.254+0000 7fd4086f7700 1 -- 172.21.15.6:0/320689307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40016dd10 con 0x7fd400086ff0 2023-10-06T02:27:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.254+0000 7fd3fe7fc700 1 -- 172.21.15.6:0/320689307 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f800ad20 con 0x7fd400086ff0 2023-10-06T02:27:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.254+0000 7fd4086f7700 1 -- 172.21.15.6:0/320689307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40016dff0 con 0x7fd400086ff0 2023-10-06T02:27:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.255+0000 7fd4086f7700 1 -- 172.21.15.6:0/320689307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd400088700 con 0x7fd400086ff0 2023-10-06T02:27:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.256+0000 7fd3fe7fc700 1 -- 172.21.15.6:0/320689307 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd3f8007300 con 0x7fd400086ff0 2023-10-06T02:27:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.256+0000 7fd3fe7fc700 1 --2- 172.21.15.6:0/320689307 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd3ec066f30 0x7fd3ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.256+0000 7fd3fe7fc700 1 -- 172.21.15.6:0/320689307 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 8786+0+0 (secure 0 0 0) 0x7fd3f8085200 con 0x7fd400086ff0 2023-10-06T02:27:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.256+0000 7fd405c92700 1 --2- 172.21.15.6:0/320689307 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd3ec066f30 0x7fd3ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:58.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.257+0000 7fd405c92700 1 --2- 172.21.15.6:0/320689307 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd3ec066f30 0x7fd3ec0693e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40099b0 tx=0x7fd3f4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:58.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.260+0000 7fd3fe7fc700 1 -- 172.21.15.6:0/320689307 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3f80518a0 con 0x7fd400086ff0 2023-10-06T02:27:58.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:58.533+0000 7fd4086f7700 1 -- 172.21.15.6:0/320689307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fd4000aff30 con 0x7fd400086ff0 2023-10-06T02:27:59.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.118+0000 7fd3fe7fc700 1 -- 172.21.15.6:0/320689307 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v266) v1 ==== 101+0+0 (secure 0 0 0) 0x7fd3f8054ec0 con 0x7fd400086ff0 2023-10-06T02:27:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.121+0000 7fd4086f7700 1 -- 172.21.15.6:0/320689307 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd3ec066f30 msgr2=0x7fd3ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.121+0000 7fd4086f7700 1 --2- 172.21.15.6:0/320689307 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd3ec066f30 0x7fd3ec0693e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40099b0 tx=0x7fd3f4017000 comp rx=0 tx=0).stop 2023-10-06T02:27:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.121+0000 7fd4086f7700 1 -- 172.21.15.6:0/320689307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd400086ff0 msgr2=0x7fd40016d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.121+0000 7fd4086f7700 1 --2- 172.21.15.6:0/320689307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd400086ff0 0x7fd40016d1e0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800cd30 tx=0x7fd3f8001af0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.121+0000 7fd4086f7700 1 -- 172.21.15.6:0/320689307 shutdown_connections 2023-10-06T02:27:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.121+0000 7fd4086f7700 1 --2- 172.21.15.6:0/320689307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd40015a030 0x7fd4001577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.121+0000 7fd4086f7700 1 --2- 172.21.15.6:0/320689307 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd3ec066f30 0x7fd3ec0693e0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.121+0000 7fd4086f7700 1 --2- 172.21.15.6:0/320689307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd400086ff0 0x7fd40016d1e0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.121+0000 7fd4086f7700 1 --2- 172.21.15.6:0/320689307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4000b21b0 0x7fd400155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.121+0000 7fd4086f7700 1 -- 172.21.15.6:0/320689307 >> 172.21.15.6:0/320689307 conn(0x7fd400068680 msgr2=0x7fd4000cb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:59.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.121+0000 7fd4086f7700 1 -- 172.21.15.6:0/320689307 shutdown_connections 2023-10-06T02:27:59.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.121+0000 7fd4086f7700 1 -- 172.21.15.6:0/320689307 wait complete. 2023-10-06T02:27:59.123 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:27:59.135 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:27:59.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.174+0000 7f80b5c94000 1 Processor -- start 2023-10-06T02:27:59.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.174+0000 7f80b5c94000 1 -- start start 2023-10-06T02:27:59.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.175+0000 7f80b5c94000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55be4ac38e30 0x55be4acdff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.175+0000 7f80b5c94000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4ace1f50 0x55be4ac55fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.175+0000 7f80b5c94000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55be4ace5260 0x55be4ac56520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.175+0000 7f80b5c94000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4abb4320 con 0x55be4ace5260 2023-10-06T02:27:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.175+0000 7f80b5c94000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4ab58980 con 0x55be4ace1f50 2023-10-06T02:27:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.175+0000 7f80b5c94000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be4ab58620 con 0x55be4ac38e30 2023-10-06T02:27:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.175+0000 7f80af6d0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55be4ace5260 0x55be4ac56520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.175+0000 7f80af6d0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55be4ace5260 0x55be4ac56520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50342/0 (socket says 172.21.15.6:50342) 2023-10-06T02:27:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.175+0000 7f80af6d0700 1 -- 172.21.15.6:0/2708835296 learned_addr learned my addr 172.21.15.6:0/2708835296 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.175+0000 7f80ae6ce700 1 --2- 172.21.15.6:0/2708835296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4ace1f50 0x55be4ac55fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.175+0000 7f80aeecf700 1 --2- 172.21.15.6:0/2708835296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55be4ac38e30 0x55be4acdff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.175+0000 7f80af6d0700 1 -- 172.21.15.6:0/2708835296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55be4ac38e30 msgr2=0x55be4acdff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.175+0000 7f80af6d0700 1 --2- 172.21.15.6:0/2708835296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55be4ac38e30 0x55be4acdff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.175+0000 7f80af6d0700 1 -- 172.21.15.6:0/2708835296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4ace1f50 msgr2=0x55be4ac55fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.175+0000 7f80af6d0700 1 --2- 172.21.15.6:0/2708835296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4ace1f50 0x55be4ac55fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.175+0000 7f80af6d0700 1 -- 172.21.15.6:0/2708835296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a8005cf0 con 0x55be4ace5260 2023-10-06T02:27:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.175+0000 7f80ae6ce700 1 --2- 172.21.15.6:0/2708835296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4ace1f50 0x55be4ac55fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.176+0000 7f80af6d0700 1 --2- 172.21.15.6:0/2708835296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55be4ace5260 0x55be4ac56520 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f80a000a590 tx=0x7f80a0005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7997347a05915e3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.176+0000 7f80ad6cc700 1 -- 172.21.15.6:0/2708835296 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a000e510 con 0x55be4ace5260 2023-10-06T02:27:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.176+0000 7f80ad6cc700 1 -- 172.21.15.6:0/2708835296 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a000e690 con 0x55be4ace5260 2023-10-06T02:27:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.176+0000 7f80ad6cc700 1 -- 172.21.15.6:0/2708835296 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a000ea50 con 0x55be4ace5260 2023-10-06T02:27:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.176+0000 7f80b5c94000 1 -- 172.21.15.6:0/2708835296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55be4ace5260 msgr2=0x55be4ac56520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.176+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2708835296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55be4ace5260 0x55be4ac56520 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f80a000a590 tx=0x7f80a0005c40 comp rx=0 tx=0).stop 2023-10-06T02:27:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.176+0000 7f80b5c94000 1 -- 172.21.15.6:0/2708835296 shutdown_connections 2023-10-06T02:27:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.176+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2708835296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55be4ace5260 0x55be4ac56520 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.176+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2708835296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55be4ac38e30 0x55be4acdff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.176+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2708835296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4ace1f50 0x55be4ac55fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.176+0000 7f80b5c94000 1 -- 172.21.15.6:0/2708835296 >> 172.21.15.6:0/2708835296 conn(0x55be4ac54bd0 msgr2=0x55be4ac54fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.176+0000 7f80b5c94000 1 -- 172.21.15.6:0/2708835296 shutdown_connections 2023-10-06T02:27:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.176+0000 7f80b5c94000 1 -- 172.21.15.6:0/2708835296 wait complete. 2023-10-06T02:27:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.177+0000 7f80b5c94000 1 Processor -- start 2023-10-06T02:27:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.177+0000 7f80b5c94000 1 -- start start 2023-10-06T02:27:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80b5c94000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4ac38e30 0x55be4acee760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80b5c94000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55be4ace1f50 0x55be4acd5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80b5c94000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55be4ace5260 0x55be4acd9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80b5c94000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4ab4f400 con 0x55be4ace1f50 2023-10-06T02:27:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80b5c94000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4acef750 con 0x55be4ac38e30 2023-10-06T02:27:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80b5c94000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be4aceef70 con 0x55be4ace5260 2023-10-06T02:27:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80ae6ce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55be4ace1f50 0x55be4acd5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80ae6ce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55be4ace1f50 0x55be4acd5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50354/0 (socket says 172.21.15.6:50354) 2023-10-06T02:27:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 learned_addr learned my addr 172.21.15.6:0/2830643184 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80aeecf700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4ac38e30 0x55be4acee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80af6d0700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55be4ace5260 0x55be4acd9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55be4ace5260 msgr2=0x55be4acd9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80ae6ce700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55be4ace5260 0x55be4acd9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4ac38e30 msgr2=0x55be4acee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80ae6ce700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4ac38e30 0x55be4acee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a000a0e0 con 0x55be4ace1f50 2023-10-06T02:27:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80ae6ce700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55be4ace1f50 0x55be4acd5f10 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f80a400b2f0 tx=0x7f80a40019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f809f7fe700 1 -- 172.21.15.6:0/2830643184 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a400bdd0 con 0x55be4ace1f50 2023-10-06T02:27:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f809f7fe700 1 -- 172.21.15.6:0/2830643184 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a400f450 con 0x55be4ace1f50 2023-10-06T02:27:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.178+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55be4ab5aae0 con 0x55be4ace1f50 2023-10-06T02:27:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.179+0000 7f809f7fe700 1 -- 172.21.15.6:0/2830643184 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a400f810 con 0x55be4ace1f50 2023-10-06T02:27:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.179+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be4ab5a540 con 0x55be4ace1f50 2023-10-06T02:27:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.180+0000 7f809f7fe700 1 -- 172.21.15.6:0/2830643184 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80a400fb80 con 0x55be4ace1f50 2023-10-06T02:27:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.180+0000 7f809f7fe700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f80940658c0 0x7f8094067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.180+0000 7f809f7fe700 1 -- 172.21.15.6:0/2830643184 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 8786+0+0 (secure 0 0 0) 0x7f80a40843d0 con 0x55be4ace1f50 2023-10-06T02:27:59.185 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:27:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.181+0000 7f80aeecf700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f80940658c0 0x7f8094067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.181+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55be4acd6450 0x55be4ac3d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.181+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4acda260 con 0x55be4acd6450 2023-10-06T02:27:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.181+0000 7f80af6d0700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55be4acd6450 0x55be4ac3d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.181+0000 7f80af6d0700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55be4acd6450 0x55be4ac3d390 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.181+0000 7f80aeecf700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f80940658c0 0x7f8094067d70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f80a8015040 tx=0x7f80a8012000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.183+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v123'846 uv820 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.183+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ac39290 con 0x55be4acd6450 2023-10-06T02:27:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.184+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v123'847 uv847 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.184+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ac3d8d0 con 0x55be4acd6450 2023-10-06T02:27:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.186+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v123'848 uv848 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.187 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:27:59.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.186+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad001c0 con 0x55be4acd6450 2023-10-06T02:27:59.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.187+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v123'849 uv849 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.187+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad00570 con 0x55be4acd6450 2023-10-06T02:27:59.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.188+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v123'850 uv850 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.188+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4acff1b0 con 0x55be4acd6450 2023-10-06T02:27:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.190+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v123'851 uv851 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.190+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4acff5b0 con 0x55be4acd6450 2023-10-06T02:27:59.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.191+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v123'852 uv826 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.191+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4acff960 con 0x55be4acd6450 2023-10-06T02:27:59.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.192+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v123'853 uv853 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.192+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4acff960 con 0x55be4acd6450 2023-10-06T02:27:59.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.194+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v123'854 uv854 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.194 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:27:59.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.194+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4acff960 con 0x55be4acd6450 2023-10-06T02:27:59.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.195+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v123'855 uv855 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.195+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4acff960 con 0x55be4acd6450 2023-10-06T02:27:59.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.196+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v123'856 uv856 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.196+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4acff960 con 0x55be4acd6450 2023-10-06T02:27:59.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.197+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v123'857 uv857 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.197+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4acff960 con 0x55be4acd6450 2023-10-06T02:27:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.198+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v123'858 uv833 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.199+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4acff960 con 0x55be4acd6450 2023-10-06T02:27:59.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.200+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v123'859 uv859 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.200+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4acff960 con 0x55be4acd6450 2023-10-06T02:27:59.201 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:27:59.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.201+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v123'860 uv860 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.201+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4acff960 con 0x55be4acd6450 2023-10-06T02:27:59.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.202+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v123'861 uv861 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.202+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4acff960 con 0x55be4acd6450 2023-10-06T02:27:59.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.203+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v123'862 uv862 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.203+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4acff960 con 0x55be4acd6450 2023-10-06T02:27:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.205+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v123'863 uv863 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.205+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad00920 con 0x55be4acd6450 2023-10-06T02:27:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.206+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v123'864 uv864 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.206+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad00920 con 0x55be4acd6450 2023-10-06T02:27:59.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.207+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v123'865 uv839 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.207+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad00920 con 0x55be4acd6450 2023-10-06T02:27:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.208+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v123'866 uv866 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.209+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad00920 con 0x55be4acd6450 2023-10-06T02:27:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.210+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v123'867 uv867 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.210 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:27:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.210+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad01930 con 0x55be4acd6450 2023-10-06T02:27:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.211+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v123'868 uv868 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.211+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad01930 con 0x55be4acd6450 2023-10-06T02:27:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.212+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v123'869 uv869 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.212+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad00920 con 0x55be4acd6450 2023-10-06T02:27:59.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.214+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v123'870 uv870 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.214+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad00920 con 0x55be4acd6450 2023-10-06T02:27:59.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.215+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v123'871 uv845 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.215+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad00920 con 0x55be4acd6450 2023-10-06T02:27:59.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.216+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v123'872 uv872 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.216+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad00920 con 0x55be4acd6450 2023-10-06T02:27:59.218 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:27:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.218+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v123'873 uv873 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.218+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad01930 con 0x55be4acd6450 2023-10-06T02:27:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.219+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v123'874 uv874 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.219+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad01930 con 0x55be4acd6450 2023-10-06T02:27:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.220+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v123'875 uv875 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.220+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad00920 con 0x55be4acd6450 2023-10-06T02:27:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.222+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v123'876 uv876 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4acd6450 2023-10-06T02:27:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.222+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55be4ad00e30 0x55be4ad03210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.222+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad03750 con 0x55be4ad00e30 2023-10-06T02:27:59.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.222+0000 7f80aeecf700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55be4ad00e30 0x55be4ad03210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.222+0000 7f80aeecf700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55be4ad00e30 0x55be4ad03210 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.224+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v123'610 uv593 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.224+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad03b00 con 0x55be4ad00e30 2023-10-06T02:27:59.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.225+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v123'611 uv611 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.225+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad03eb0 con 0x55be4ad00e30 2023-10-06T02:27:59.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.226+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v123'612 uv612 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.226 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:27:59.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.226+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad04750 con 0x55be4ad00e30 2023-10-06T02:27:59.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.227+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v123'613 uv613 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.227+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad04b00 con 0x55be4ad00e30 2023-10-06T02:27:59.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.228+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v123'614 uv614 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.228+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad04eb0 con 0x55be4ad00e30 2023-10-06T02:27:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.230+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v123'615 uv598 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.230+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad05260 con 0x55be4ad00e30 2023-10-06T02:27:59.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.231+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v123'616 uv616 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.231+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad05610 con 0x55be4ad00e30 2023-10-06T02:27:59.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.232+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v123'617 uv617 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.232 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:27:59.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.232+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad05610 con 0x55be4ad00e30 2023-10-06T02:27:59.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.233+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v123'618 uv618 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.233+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad05610 con 0x55be4ad00e30 2023-10-06T02:27:59.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.234+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v123'619 uv619 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.234+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad05610 con 0x55be4ad00e30 2023-10-06T02:27:59.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.235+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v123'620 uv603 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.235+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad05610 con 0x55be4ad00e30 2023-10-06T02:27:59.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.236+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v123'621 uv621 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.236+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad05610 con 0x55be4ad00e30 2023-10-06T02:27:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.237+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v123'622 uv622 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.238 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:27:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.238+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad08d30 con 0x55be4ad00e30 2023-10-06T02:27:59.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.239+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v123'623 uv623 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.239+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad08d30 con 0x55be4ad00e30 2023-10-06T02:27:59.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.240+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v123'624 uv624 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.240+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad05610 con 0x55be4ad00e30 2023-10-06T02:27:59.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.241+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v123'625 uv609 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.241+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad05610 con 0x55be4ad00e30 2023-10-06T02:27:59.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.242+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v123'626 uv626 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.242+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad05610 con 0x55be4ad00e30 2023-10-06T02:27:59.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.243+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v123'627 uv627 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.244 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:27:59.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.243+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad06620 con 0x55be4ad00e30 2023-10-06T02:27:59.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.244+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v123'628 uv628 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.244+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad06620 con 0x55be4ad00e30 2023-10-06T02:27:59.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.245+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v123'629 uv629 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.245+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad05610 con 0x55be4ad00e30 2023-10-06T02:27:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.246+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v123'630 uv630 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.246+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55be4ad05b20 0x55be4ad07f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.246+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad08440 con 0x55be4ad05b20 2023-10-06T02:27:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.247+0000 7f80ae6ce700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55be4ad05b20 0x55be4ad07f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.247+0000 7f80ae6ce700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55be4ad05b20 0x55be4ad07f00 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.248+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v123'165 uv164 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.248+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad087f0 con 0x55be4ad05b20 2023-10-06T02:27:59.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.249+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v123'166 uv166 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.249+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad08d20 con 0x55be4ad05b20 2023-10-06T02:27:59.250 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:27:59.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.250+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v123'167 uv167 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.250+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad0a620 con 0x55be4ad05b20 2023-10-06T02:27:59.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.251+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v123'168 uv168 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.251+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad0a9d0 con 0x55be4ad05b20 2023-10-06T02:27:59.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.252+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v123'169 uv169 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.252+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad09610 con 0x55be4ad05b20 2023-10-06T02:27:59.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.253+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v123'170 uv170 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.253+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad09a10 con 0x55be4ad05b20 2023-10-06T02:27:59.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.254+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v123'117 uv116 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.254+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad09e40 con 0x55be4ad05b20 2023-10-06T02:27:59.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.255+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v123'118 uv118 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.255+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad0a260 con 0x55be4ad05b20 2023-10-06T02:27:59.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.256+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v123'119 uv119 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.256 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:27:59.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.256+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad09df0 con 0x55be4ad05b20 2023-10-06T02:27:59.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.257+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v123'120 uv120 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.257+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad09dc0 con 0x55be4ad00e30 2023-10-06T02:27:59.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.258+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v123'165 uv164 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.258+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad09dc0 con 0x55be4ad00e30 2023-10-06T02:27:59.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.259+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v123'166 uv166 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.259+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad09dc0 con 0x55be4ad00e30 2023-10-06T02:27:59.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.260+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v123'167 uv167 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.261 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:27:59.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.260+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad09dc0 con 0x55be4ad00e30 2023-10-06T02:27:59.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.261+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v123'168 uv168 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.261+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad09dc0 con 0x55be4ad00e30 2023-10-06T02:27:59.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.262+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v123'169 uv169 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.262+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad09dc0 con 0x55be4ad00e30 2023-10-06T02:27:59.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.263+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v123'170 uv170 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad00e30 2023-10-06T02:27:59.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.263+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55be4ad0b290 0x55be4ad0d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.263+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad0dbb0 con 0x55be4ad0b290 2023-10-06T02:27:59.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.263+0000 7f80af6d0700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55be4ad0b290 0x55be4ad0d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.264+0000 7f80af6d0700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55be4ad0b290 0x55be4ad0d670 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.265+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v123'305 uv299 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad0b290 2023-10-06T02:27:59.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.265+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad0dbb0 con 0x55be4ad0b290 2023-10-06T02:27:59.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.266+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v123'306 uv306 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad0b290 2023-10-06T02:27:59.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.266+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad0dbb0 con 0x55be4ad0b290 2023-10-06T02:27:59.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.267+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v123'307 uv307 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad0b290 2023-10-06T02:27:59.268 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:27:59.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.267+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad0ebc0 con 0x55be4ad0b290 2023-10-06T02:27:59.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.269+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v123'308 uv308 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad0b290 2023-10-06T02:27:59.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.269+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad0ebc0 con 0x55be4ad0b290 2023-10-06T02:27:59.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.270+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v123'309 uv309 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad0b290 2023-10-06T02:27:59.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.270+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad0dbb0 con 0x55be4ad0b290 2023-10-06T02:27:59.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.271+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v123'310 uv310 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad0b290 2023-10-06T02:27:59.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.271+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad0dbb0 con 0x55be4ad0b290 2023-10-06T02:27:59.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.272+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v123'311 uv304 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad0b290 2023-10-06T02:27:59.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.272+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad0dbb0 con 0x55be4ad0b290 2023-10-06T02:27:59.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.273+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v123'312 uv312 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad0b290 2023-10-06T02:27:59.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.273+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad0dbb0 con 0x55be4ad0b290 2023-10-06T02:27:59.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.275+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v123'313 uv313 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad0b290 2023-10-06T02:27:59.275 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:27:59.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.275+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad0dbb0 con 0x55be4ad0b290 2023-10-06T02:27:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.276+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v123'314 uv314 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad0b290 2023-10-06T02:27:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.276+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad0dfb0 con 0x55be4ad0b290 2023-10-06T02:27:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.277+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v123'315 uv315 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad0b290 2023-10-06T02:27:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.277+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55be4ad0e490 0x55be4ad10870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.277+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad10db0 con 0x55be4ad0e490 2023-10-06T02:27:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.278+0000 7f80aeecf700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55be4ad0e490 0x55be4ad10870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.278+0000 7f80aeecf700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55be4ad0e490 0x55be4ad10870 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.279+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v123'138 uv137 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad0e490 2023-10-06T02:27:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.279+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad11190 con 0x55be4ad0e490 2023-10-06T02:27:59.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.282+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v123'139 uv139 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad0e490 2023-10-06T02:27:59.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.282+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad11190 con 0x55be4ad0e490 2023-10-06T02:27:59.282 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:27:59.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.282+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v123'140 uv140 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad0e490 2023-10-06T02:27:59.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.282+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad11190 con 0x55be4ad0e490 2023-10-06T02:27:59.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.283+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v123'141 uv141 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad0e490 2023-10-06T02:27:59.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.283+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad11190 con 0x55be4ad0e490 2023-10-06T02:27:59.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.284+0000 7f80aeecf700 1 -- 172.21.15.6:0/2830643184 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v123'142 uv142 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f80a8012560 con 0x55be4ad0e490 2023-10-06T02:27:59.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.284+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad11190 con 0x55be4ad05b20 2023-10-06T02:27:59.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.285+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v123'165 uv164 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.285+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad11190 con 0x55be4ad05b20 2023-10-06T02:27:59.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.286+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v123'166 uv166 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.286+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad11190 con 0x55be4ad05b20 2023-10-06T02:27:59.287 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:27:59.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.287+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v123'167 uv167 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.287+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad121a0 con 0x55be4ad05b20 2023-10-06T02:27:59.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.288+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v123'168 uv168 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.288+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad121a0 con 0x55be4ad05b20 2023-10-06T02:27:59.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.289+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v123'169 uv169 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.289+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad11190 con 0x55be4ad05b20 2023-10-06T02:27:59.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.290+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v123'170 uv170 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.290+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55be4ad11ac0 0x55be4ad13ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.290+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad143e0 con 0x55be4ad11ac0 2023-10-06T02:27:59.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.290+0000 7f80ae6ce700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55be4ad11ac0 0x55be4ad13ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.290+0000 7f80ae6ce700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55be4ad11ac0 0x55be4ad13ea0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.292+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v123'273 uv267 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad11ac0 2023-10-06T02:27:59.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.292+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad14460 con 0x55be4ad11ac0 2023-10-06T02:27:59.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.293+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v123'274 uv274 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad11ac0 2023-10-06T02:27:59.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.293+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad14460 con 0x55be4ad11ac0 2023-10-06T02:27:59.294 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:27:59.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.294+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v123'275 uv275 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad11ac0 2023-10-06T02:27:59.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.294+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad14860 con 0x55be4ad11ac0 2023-10-06T02:27:59.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.295+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v123'276 uv276 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad11ac0 2023-10-06T02:27:59.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.295+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad14860 con 0x55be4ad11ac0 2023-10-06T02:27:59.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.296+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v123'277 uv277 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad11ac0 2023-10-06T02:27:59.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.296+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad14860 con 0x55be4ad11ac0 2023-10-06T02:27:59.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.297+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v123'278 uv272 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad11ac0 2023-10-06T02:27:59.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.297+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad14860 con 0x55be4ad11ac0 2023-10-06T02:27:59.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.298+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v123'279 uv279 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad11ac0 2023-10-06T02:27:59.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.298+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad14860 con 0x55be4ad11ac0 2023-10-06T02:27:59.299 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:27:59.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.299+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v123'280 uv280 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad11ac0 2023-10-06T02:27:59.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.299+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad14860 con 0x55be4ad11ac0 2023-10-06T02:27:59.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.300+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v123'281 uv281 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad11ac0 2023-10-06T02:27:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.300+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad175d0 con 0x55be4ad11ac0 2023-10-06T02:27:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.301+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v123'282 uv282 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad11ac0 2023-10-06T02:27:59.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.301+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad14d50 con 0x55be4ad05b20 2023-10-06T02:27:59.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.302+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v123'120 uv119 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.302+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad14d50 con 0x55be4ad05b20 2023-10-06T02:27:59.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.303+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v123'121 uv121 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.303+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad14d50 con 0x55be4ad05b20 2023-10-06T02:27:59.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.304+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v123'122 uv122 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.304 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:27:59.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.304+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad14d50 con 0x55be4ad05b20 2023-10-06T02:27:59.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.305+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v123'123 uv123 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.305+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55be4ad15260 0x55be4ad17640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.305+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad17b80 con 0x55be4ad15260 2023-10-06T02:27:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.305+0000 7f80af6d0700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55be4ad15260 0x55be4ad17640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.306+0000 7f80af6d0700 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55be4ad15260 0x55be4ad17640 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.306+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v123'165 uv164 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad15260 2023-10-06T02:27:59.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.307+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad17b80 con 0x55be4ad15260 2023-10-06T02:27:59.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.307+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v123'166 uv166 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad15260 2023-10-06T02:27:59.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.308+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad17b80 con 0x55be4ad15260 2023-10-06T02:27:59.309 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:27:59.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.309+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v123'167 uv167 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad15260 2023-10-06T02:27:59.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.309+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad18b90 con 0x55be4ad15260 2023-10-06T02:27:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.310+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v123'168 uv168 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad15260 2023-10-06T02:27:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.310+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad18b90 con 0x55be4ad15260 2023-10-06T02:27:59.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.311+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v123'169 uv169 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad15260 2023-10-06T02:27:59.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.311+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad17b80 con 0x55be4ad15260 2023-10-06T02:27:59.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.312+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v123'170 uv170 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad15260 2023-10-06T02:27:59.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.312+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad17b80 con 0x55be4ad0b290 2023-10-06T02:27:59.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.313+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v123'140 uv139 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad0b290 2023-10-06T02:27:59.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.313+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad17b80 con 0x55be4ad0b290 2023-10-06T02:27:59.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.314+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v123'141 uv141 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad0b290 2023-10-06T02:27:59.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.314+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad17b80 con 0x55be4ad0b290 2023-10-06T02:27:59.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.315+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v123'142 uv142 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad0b290 2023-10-06T02:27:59.315 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:27:59.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.315+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad17b80 con 0x55be4ad0b290 2023-10-06T02:27:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.316+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v123'143 uv143 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad0b290 2023-10-06T02:27:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.316+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad148e0 con 0x55be4ad0b290 2023-10-06T02:27:59.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.317+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v123'144 uv144 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f80a0000f40 con 0x55be4ad0b290 2023-10-06T02:27:59.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.317+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad148e0 con 0x55be4ad05b20 2023-10-06T02:27:59.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.318+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v123'339 uv331 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.318+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad148e0 con 0x55be4ad05b20 2023-10-06T02:27:59.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.319+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v123'340 uv340 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.319+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad148e0 con 0x55be4ad05b20 2023-10-06T02:27:59.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.320+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v123'341 uv341 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.321 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:27:59.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.320+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad148e0 con 0x55be4ad05b20 2023-10-06T02:27:59.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.321+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v123'342 uv342 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.321+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad148e0 con 0x55be4ad05b20 2023-10-06T02:27:59.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.322+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v123'343 uv343 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.322+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad148e0 con 0x55be4ad05b20 2023-10-06T02:27:59.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.323+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v123'344 uv338 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.323+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad148e0 con 0x55be4ad05b20 2023-10-06T02:27:59.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.324+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v123'345 uv345 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.324+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad148e0 con 0x55be4ad05b20 2023-10-06T02:27:59.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.325+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v123'346 uv346 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.327 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:27:59.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.325+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad148e0 con 0x55be4ad05b20 2023-10-06T02:27:59.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.326+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v123'347 uv347 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.326+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad148e0 con 0x55be4ad05b20 2023-10-06T02:27:59.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.327+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v123'348 uv348 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.327+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad18070 con 0x55be4ad05b20 2023-10-06T02:27:59.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.328+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v123'349 uv349 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.328+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x55be4ad18070 con 0x55be4ad05b20 2023-10-06T02:27:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.329+0000 7f80ae6ce700 1 -- 172.21.15.6:0/2830643184 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v123'350 uv350 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f80a4015de0 con 0x55be4ad05b20 2023-10-06T02:27:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.329+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55be4ad05b20 msgr2=0x55be4ad07f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.329+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55be4ad05b20 0x55be4ad07f00 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.329+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55be4acd6450 msgr2=0x55be4ac3d390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.329+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55be4acd6450 0x55be4ac3d390 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.329+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55be4ad11ac0 msgr2=0x55be4ad13ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.329+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55be4ad11ac0 0x55be4ad13ea0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.329+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55be4ad00e30 msgr2=0x55be4ad03210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.329+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55be4ad00e30 0x55be4ad03210 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.329+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55be4ad15260 msgr2=0x55be4ad17640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.329+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55be4ad15260 0x55be4ad17640 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.329+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55be4ad0e490 msgr2=0x55be4ad10870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.329+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55be4ad0e490 0x55be4ad10870 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.329+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55be4ad0b290 msgr2=0x55be4ad0d670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.329+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55be4ad0b290 0x55be4ad0d670 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.329+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 reap_dead start 2023-10-06T02:27:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.330+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 reap_dead start 2023-10-06T02:27:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.330+0000 7f80af6d0700 1 -- 172.21.15.6:0/2830643184 reap_dead start 2023-10-06T02:27:59.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.330+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f80940658c0 msgr2=0x7f8094067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.330+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f80940658c0 0x7f8094067d70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f80a8015040 tx=0x7f80a8012000 comp rx=0 tx=0).stop 2023-10-06T02:27:59.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.330+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55be4ace1f50 msgr2=0x55be4acd5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.330+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55be4ace1f50 0x55be4acd5f10 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f80a400b2f0 tx=0x7f80a40019a0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.330+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 shutdown_connections 2023-10-06T02:27:59.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.330+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55be4ace1f50 0x55be4acd5f10 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.330+0000 7f80b5c94000 1 --2- 172.21.15.6:0/2830643184 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f80940658c0 0x7f8094067d70 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.330+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 >> 172.21.15.6:0/2830643184 conn(0x55be4ac54bd0 msgr2=0x55be4ac54fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:59.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.330+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 shutdown_connections 2023-10-06T02:27:59.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.330+0000 7f80b5c94000 1 -- 172.21.15.6:0/2830643184 wait complete. 2023-10-06T02:27:59.334 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate mds0_inotable 0 2023-10-06T02:27:59.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.413+0000 7f669e7c2000 1 Processor -- start 2023-10-06T02:27:59.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.413+0000 7f669e7c2000 1 -- start start 2023-10-06T02:27:59.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.413+0000 7f669e7c2000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a52e61160 0x562a52f375f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.413+0000 7f669e7c2000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562a52f228b0 0x562a52eac210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.413+0000 7f669e7c2000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a52f22c80 0x562a52f3b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.413+0000 7f669e7c2000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a52dad980 con 0x562a52f22c80 2023-10-06T02:27:59.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.413+0000 7f669e7c2000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a52dad620 con 0x562a52e61160 2023-10-06T02:27:59.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.413+0000 7f669e7c2000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a52da4400 con 0x562a52f228b0 2023-10-06T02:27:59.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.413+0000 7f66981fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a52f22c80 0x562a52f3b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.413+0000 7f66981fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a52f22c80 0x562a52f3b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50366/0 (socket says 172.21.15.6:50366) 2023-10-06T02:27:59.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.413+0000 7f66981fe700 1 -- 172.21.15.6:0/1402724150 learned_addr learned my addr 172.21.15.6:0/1402724150 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:59.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.414+0000 7f66979fd700 1 --2- 172.21.15.6:0/1402724150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a52e61160 0x562a52f375f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.414+0000 7f66971fc700 1 --2- 172.21.15.6:0/1402724150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562a52f228b0 0x562a52eac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.414+0000 7f66981fe700 1 -- 172.21.15.6:0/1402724150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562a52f228b0 msgr2=0x562a52eac210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:59.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.414+0000 7f66981fe700 1 --2- 172.21.15.6:0/1402724150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562a52f228b0 0x562a52eac210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.414+0000 7f66981fe700 1 -- 172.21.15.6:0/1402724150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a52e61160 msgr2=0x562a52f375f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:59.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.414+0000 7f66981fe700 1 --2- 172.21.15.6:0/1402724150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a52e61160 0x562a52f375f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.414+0000 7f66981fe700 1 -- 172.21.15.6:0/1402724150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c005cf0 con 0x562a52f22c80 2023-10-06T02:27:59.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.414+0000 7f66981fe700 1 --2- 172.21.15.6:0/1402724150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a52f22c80 0x562a52f3b8d0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f668800ac40 tx=0x7f6688015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb86e1201a4d16e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.414+0000 7f66961fa700 1 -- 172.21.15.6:0/1402724150 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668800fe00 con 0x562a52f22c80 2023-10-06T02:27:59.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.414+0000 7f66961fa700 1 -- 172.21.15.6:0/1402724150 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668801f070 con 0x562a52f22c80 2023-10-06T02:27:59.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.414+0000 7f66961fa700 1 -- 172.21.15.6:0/1402724150 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668800f860 con 0x562a52f22c80 2023-10-06T02:27:59.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.414+0000 7f669e7c2000 1 -- 172.21.15.6:0/1402724150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a52f22c80 msgr2=0x562a52f3b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.414+0000 7f669e7c2000 1 --2- 172.21.15.6:0/1402724150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a52f22c80 0x562a52f3b8d0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f668800ac40 tx=0x7f6688015000 comp rx=0 tx=0).stop 2023-10-06T02:27:59.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.414+0000 7f669e7c2000 1 -- 172.21.15.6:0/1402724150 shutdown_connections 2023-10-06T02:27:59.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.414+0000 7f669e7c2000 1 --2- 172.21.15.6:0/1402724150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a52f22c80 0x562a52f3b8d0 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.414+0000 7f669e7c2000 1 --2- 172.21.15.6:0/1402724150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a52e61160 0x562a52f375f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.414+0000 7f669e7c2000 1 --2- 172.21.15.6:0/1402724150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562a52f228b0 0x562a52eac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.415+0000 7f669e7c2000 1 -- 172.21.15.6:0/1402724150 >> 172.21.15.6:0/1402724150 conn(0x562a52ea9bd0 msgr2=0x562a52e92540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.415+0000 7f669e7c2000 1 -- 172.21.15.6:0/1402724150 shutdown_connections 2023-10-06T02:27:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.415+0000 7f669e7c2000 1 -- 172.21.15.6:0/1402724150 wait complete. 2023-10-06T02:27:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.415+0000 7f669e7c2000 1 Processor -- start 2023-10-06T02:27:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.415+0000 7f669e7c2000 1 -- start start 2023-10-06T02:27:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f669e7c2000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562a52e61160 0x562a52f18b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f669e7c2000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a52f228b0 0x562a52f398c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f669e7c2000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a52f22c80 0x562a52f39e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f669e7c2000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a52f21140 con 0x562a52f22c80 2023-10-06T02:27:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f669e7c2000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a52f213e0 con 0x562a52f228b0 2023-10-06T02:27:59.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f669e7c2000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a52f21680 con 0x562a52e61160 2023-10-06T02:27:59.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f66981fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a52f22c80 0x562a52f39e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f66971fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a52f228b0 0x562a52f398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f66981fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a52f22c80 0x562a52f39e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50374/0 (socket says 172.21.15.6:50374) 2023-10-06T02:27:59.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f66981fe700 1 -- 172.21.15.6:0/3196819170 learned_addr learned my addr 172.21.15.6:0/3196819170 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:59.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f66979fd700 1 --2- 172.21.15.6:0/3196819170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562a52e61160 0x562a52f18b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f66971fc700 1 -- 172.21.15.6:0/3196819170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562a52e61160 msgr2=0x562a52f18b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f66971fc700 1 --2- 172.21.15.6:0/3196819170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562a52e61160 0x562a52f18b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f66971fc700 1 -- 172.21.15.6:0/3196819170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a52f22c80 msgr2=0x562a52f39e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f66971fc700 1 --2- 172.21.15.6:0/3196819170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a52f22c80 0x562a52f39e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f66971fc700 1 -- 172.21.15.6:0/3196819170 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a52dd61c0 con 0x562a52f228b0 2023-10-06T02:27:59.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f66981fe700 1 --2- 172.21.15.6:0/3196819170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a52f22c80 0x562a52f39e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:59.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.416+0000 7f66971fc700 1 --2- 172.21.15.6:0/3196819170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a52f228b0 0x562a52f398c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f668c008af0 tx=0x7f668c00c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.417+0000 7f66949f7700 1 -- 172.21.15.6:0/3196819170 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c00f040 con 0x562a52f228b0 2023-10-06T02:27:59.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.417+0000 7f66949f7700 1 -- 172.21.15.6:0/3196819170 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c0108b0 con 0x562a52f228b0 2023-10-06T02:27:59.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.417+0000 7f66949f7700 1 -- 172.21.15.6:0/3196819170 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c010c30 con 0x562a52f228b0 2023-10-06T02:27:59.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.417+0000 7f669e7c2000 1 -- 172.21.15.6:0/3196819170 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668800a0e0 con 0x562a52f228b0 2023-10-06T02:27:59.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.417+0000 7f669e7c2000 1 -- 172.21.15.6:0/3196819170 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a52dbc3d0 con 0x562a52f228b0 2023-10-06T02:27:59.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.418+0000 7f66949f7700 1 -- 172.21.15.6:0/3196819170 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f668c015450 con 0x562a52f228b0 2023-10-06T02:27:59.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.418+0000 7f66949f7700 1 --2- 172.21.15.6:0/3196819170 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f66840658c0 0x7f6684067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.419+0000 7f66949f7700 1 -- 172.21.15.6:0/3196819170 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 8786+0+0 (secure 0 0 0) 0x7f668c084b70 con 0x562a52f228b0 2023-10-06T02:27:59.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.419+0000 7f66979fd700 1 --2- 172.21.15.6:0/3196819170 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f66840658c0 0x7f6684067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.419+0000 7f669e7c2000 1 --2- 172.21.15.6:0/3196819170 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x562a52f38c10 0x562a52f3f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.419+0000 7f669e7c2000 1 -- 172.21.15.6:0/3196819170 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v8 -- 0x562a52f3f820 con 0x562a52f38c10 2023-10-06T02:27:59.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.419+0000 7f66981fe700 1 --2- 172.21.15.6:0/3196819170 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x562a52f38c10 0x562a52f3f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.419+0000 7f66979fd700 1 --2- 172.21.15.6:0/3196819170 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f66840658c0 0x7f6684067d70 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6690000c00 tx=0x7f6690001730 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.419+0000 7f66981fe700 1 --2- 172.21.15.6:0/3196819170 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x562a52f38c10 0x562a52f3f2e0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.420+0000 7f66981fe700 1 -- 172.21.15.6:0/3196819170 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(1 mds0_inotable [truncate 0] v123'283 uv283 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6688016020 con 0x562a52f38c10 2023-10-06T02:27:59.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.420+0000 7f669e7c2000 1 -- 172.21.15.6:0/3196819170 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x562a52f38c10 msgr2=0x562a52f3f2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.420+0000 7f669e7c2000 1 --2- 172.21.15.6:0/3196819170 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x562a52f38c10 0x562a52f3f2e0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.420+0000 7f669e7c2000 1 -- 172.21.15.6:0/3196819170 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f66840658c0 msgr2=0x7f6684067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.420+0000 7f669e7c2000 1 --2- 172.21.15.6:0/3196819170 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f66840658c0 0x7f6684067d70 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6690000c00 tx=0x7f6690001730 comp rx=0 tx=0).stop 2023-10-06T02:27:59.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.420+0000 7f669e7c2000 1 -- 172.21.15.6:0/3196819170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a52f228b0 msgr2=0x562a52f398c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.420+0000 7f669e7c2000 1 --2- 172.21.15.6:0/3196819170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a52f228b0 0x562a52f398c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f668c008af0 tx=0x7f668c00c040 comp rx=0 tx=0).stop 2023-10-06T02:27:59.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.420+0000 7f66981fe700 1 -- 172.21.15.6:0/3196819170 reap_dead start 2023-10-06T02:27:59.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.420+0000 7f669e7c2000 1 -- 172.21.15.6:0/3196819170 shutdown_connections 2023-10-06T02:27:59.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.420+0000 7f669e7c2000 1 -- 172.21.15.6:0/3196819170 >> 172.21.15.6:0/3196819170 conn(0x562a52ea9bd0 msgr2=0x562a52f3acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:59.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.420+0000 7f669e7c2000 1 -- 172.21.15.6:0/3196819170 shutdown_connections 2023-10-06T02:27:59.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.421+0000 7f669e7c2000 1 -- 172.21.15.6:0/3196819170 wait complete. 2023-10-06T02:27:59.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:27:59.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.586+0000 7fa22616d700 1 Processor -- start 2023-10-06T02:27:59.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.586+0000 7fa22616d700 1 -- start start 2023-10-06T02:27:59.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.587+0000 7fa22616d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2200688d0 0x7fa22015da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.587+0000 7fa22616d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa220068ca0 0x7fa220158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.587+0000 7fa22616d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa2201593e0 0x7fa2200ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.587+0000 7fa22616d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22015dfa0 con 0x7fa220068ca0 2023-10-06T02:27:59.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.587+0000 7fa22616d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2200cc5c0 con 0x7fa2201593e0 2023-10-06T02:27:59.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.587+0000 7fa22616d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2200cc8a0 con 0x7fa2200688d0 2023-10-06T02:27:59.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.587+0000 7fa21effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa220068ca0 0x7fa220158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.587+0000 7fa21effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa220068ca0 0x7fa220158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50376/0 (socket says 172.21.15.6:50376) 2023-10-06T02:27:59.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.587+0000 7fa21effd700 1 -- 172.21.15.6:0/1268259506 learned_addr learned my addr 172.21.15.6:0/1268259506 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:59.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.587+0000 7fa21ffff700 1 --2- 172.21.15.6:0/1268259506 >> v2:172.21.15.175:3300/0 conn(0x7fa2201593e0 0x7fa2200ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.587+0000 7fa21f7fe700 1 --2- 172.21.15.6:0/1268259506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2200688d0 0x7fa22015da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.587+0000 7fa21effd700 1 -- 172.21.15.6:0/1268259506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2200688d0 msgr2=0x7fa22015da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:59.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.587+0000 7fa21effd700 1 --2- 172.21.15.6:0/1268259506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2200688d0 0x7fa22015da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.588+0000 7fa21effd700 1 -- 172.21.15.6:0/1268259506 >> v2:172.21.15.175:3300/0 conn(0x7fa2201593e0 msgr2=0x7fa2200ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.588+0000 7fa21effd700 1 --2- 172.21.15.6:0/1268259506 >> v2:172.21.15.175:3300/0 conn(0x7fa2201593e0 0x7fa2200ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.588+0000 7fa21effd700 1 -- 172.21.15.6:0/1268259506 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2200ccb80 con 0x7fa220068ca0 2023-10-06T02:27:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.588+0000 7fa21ffff700 1 --2- 172.21.15.6:0/1268259506 >> v2:172.21.15.175:3300/0 conn(0x7fa2201593e0 0x7fa2200ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.588+0000 7fa21effd700 1 --2- 172.21.15.6:0/1268259506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa220068ca0 0x7fa220158ea0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fa2200cd770 tx=0x7fa214009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04c5cb5c98754c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.588+0000 7fa21e7fc700 1 -- 172.21.15.6:0/1268259506 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21400b860 con 0x7fa220068ca0 2023-10-06T02:27:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.588+0000 7fa21e7fc700 1 -- 172.21.15.6:0/1268259506 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21400b9c0 con 0x7fa220068ca0 2023-10-06T02:27:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.588+0000 7fa21e7fc700 1 -- 172.21.15.6:0/1268259506 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21400bd60 con 0x7fa220068ca0 2023-10-06T02:27:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.588+0000 7fa22616d700 1 -- 172.21.15.6:0/1268259506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa220068ca0 msgr2=0x7fa220158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.588+0000 7fa22616d700 1 --2- 172.21.15.6:0/1268259506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa220068ca0 0x7fa220158ea0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fa2200cd770 tx=0x7fa214009250 comp rx=0 tx=0).stop 2023-10-06T02:27:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.588+0000 7fa22616d700 1 -- 172.21.15.6:0/1268259506 shutdown_connections 2023-10-06T02:27:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.588+0000 7fa22616d700 1 --2- 172.21.15.6:0/1268259506 >> v2:172.21.15.175:3300/0 conn(0x7fa2201593e0 0x7fa2200ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.588+0000 7fa22616d700 1 --2- 172.21.15.6:0/1268259506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2200688d0 0x7fa22015da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.588+0000 7fa22616d700 1 --2- 172.21.15.6:0/1268259506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa220068ca0 0x7fa220158ea0 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.588+0000 7fa22616d700 1 -- 172.21.15.6:0/1268259506 >> 172.21.15.6:0/1268259506 conn(0x7fa22006d330 msgr2=0x7fa22006d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:59.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.588+0000 7fa22616d700 1 -- 172.21.15.6:0/1268259506 shutdown_connections 2023-10-06T02:27:59.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.588+0000 7fa22616d700 1 -- 172.21.15.6:0/1268259506 wait complete. 2023-10-06T02:27:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.590+0000 7fa22616d700 1 Processor -- start 2023-10-06T02:27:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.590+0000 7fa22616d700 1 -- start start 2023-10-06T02:27:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.590+0000 7fa22616d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2200688d0 0x7fa220155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.590+0000 7fa22616d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa220068ca0 0x7fa220144900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.590+0000 7fa22616d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2201593e0 0x7fa2200c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.590+0000 7fa22616d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22015a420 con 0x7fa220068ca0 2023-10-06T02:27:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.590+0000 7fa22616d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa220155ac0 con 0x7fa2201593e0 2023-10-06T02:27:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.590+0000 7fa22616d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22015d5c0 con 0x7fa2200688d0 2023-10-06T02:27:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.590+0000 7fa21effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa220068ca0 0x7fa220144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.590+0000 7fa21effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa220068ca0 0x7fa220144900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50390/0 (socket says 172.21.15.6:50390) 2023-10-06T02:27:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.591+0000 7fa21effd700 1 -- 172.21.15.6:0/2366506494 learned_addr learned my addr 172.21.15.6:0/2366506494 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.591+0000 7fa21ffff700 1 --2- 172.21.15.6:0/2366506494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2201593e0 0x7fa2200c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.591+0000 7fa21f7fe700 1 --2- 172.21.15.6:0/2366506494 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2200688d0 0x7fa220155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.591+0000 7fa21effd700 1 -- 172.21.15.6:0/2366506494 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2200688d0 msgr2=0x7fa220155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.591+0000 7fa21effd700 1 --2- 172.21.15.6:0/2366506494 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2200688d0 0x7fa220155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.591+0000 7fa21effd700 1 -- 172.21.15.6:0/2366506494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2201593e0 msgr2=0x7fa2200c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.591+0000 7fa21effd700 1 --2- 172.21.15.6:0/2366506494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2201593e0 0x7fa2200c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.591+0000 7fa21effd700 1 -- 172.21.15.6:0/2366506494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2140094f0 con 0x7fa220068ca0 2023-10-06T02:27:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.591+0000 7fa21effd700 1 --2- 172.21.15.6:0/2366506494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa220068ca0 0x7fa220144900 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fa22006e020 tx=0x7fa214017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.591+0000 7fa2077fe700 1 -- 172.21.15.6:0/2366506494 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa214024440 con 0x7fa220068ca0 2023-10-06T02:27:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.591+0000 7fa2077fe700 1 -- 172.21.15.6:0/2366506494 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2140245a0 con 0x7fa220068ca0 2023-10-06T02:27:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.591+0000 7fa22616d700 1 -- 172.21.15.6:0/2366506494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22015c520 con 0x7fa220068ca0 2023-10-06T02:27:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.591+0000 7fa2077fe700 1 -- 172.21.15.6:0/2366506494 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa214024940 con 0x7fa220068ca0 2023-10-06T02:27:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.591+0000 7fa22616d700 1 -- 172.21.15.6:0/2366506494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22015cae0 con 0x7fa220068ca0 2023-10-06T02:27:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.592+0000 7fa22616d700 1 -- 172.21.15.6:0/2366506494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22006e6e0 con 0x7fa220068ca0 2023-10-06T02:27:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.593+0000 7fa2077fe700 1 -- 172.21.15.6:0/2366506494 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa21401a420 con 0x7fa220068ca0 2023-10-06T02:27:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.593+0000 7fa2077fe700 1 --2- 172.21.15.6:0/2366506494 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa20c066f30 0x7fa20c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.593+0000 7fa2077fe700 1 -- 172.21.15.6:0/2366506494 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 8786+0+0 (secure 0 0 0) 0x7fa214087050 con 0x7fa220068ca0 2023-10-06T02:27:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.593+0000 7fa21f7fe700 1 --2- 172.21.15.6:0/2366506494 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa20c066f30 0x7fa20c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.593+0000 7fa21f7fe700 1 --2- 172.21.15.6:0/2366506494 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa20c066f30 0x7fa20c0693e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa21000acb0 tx=0x7fa210008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.597+0000 7fa2077fe700 1 -- 172.21.15.6:0/2366506494 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa214053720 con 0x7fa220068ca0 2023-10-06T02:27:59.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.833+0000 7fa22616d700 1 -- 172.21.15.6:0/2366506494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fa2200cce60 con 0x7fa220068ca0 2023-10-06T02:27:59.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.845+0000 7fa2077fe700 1 -- 172.21.15.6:0/2366506494 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v267) v1 ==== 162+0+0 (secure 0 0 0) 0x7fa2140150b0 con 0x7fa220068ca0 2023-10-06T02:27:59.847 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:27:59.847+0000 7f8f1cd6d700 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds0_inotable': End of buffer 2023-10-06T02:27:59.847 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:59.847+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:27:59.848 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:27:59.847+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:27:59.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.848+0000 7fa22616d700 1 -- 172.21.15.6:0/2366506494 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa20c066f30 msgr2=0x7fa20c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.848+0000 7fa22616d700 1 --2- 172.21.15.6:0/2366506494 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa20c066f30 0x7fa20c0693e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa21000acb0 tx=0x7fa210008040 comp rx=0 tx=0).stop 2023-10-06T02:27:59.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.848+0000 7fa22616d700 1 -- 172.21.15.6:0/2366506494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa220068ca0 msgr2=0x7fa220144900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.848+0000 7fa22616d700 1 --2- 172.21.15.6:0/2366506494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa220068ca0 0x7fa220144900 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fa22006e020 tx=0x7fa214017000 comp rx=0 tx=0).stop 2023-10-06T02:27:59.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.848+0000 7fa22616d700 1 -- 172.21.15.6:0/2366506494 shutdown_connections 2023-10-06T02:27:59.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.848+0000 7fa22616d700 1 --2- 172.21.15.6:0/2366506494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2201593e0 0x7fa2200c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.848+0000 7fa22616d700 1 --2- 172.21.15.6:0/2366506494 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2200688d0 0x7fa220155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.848+0000 7fa22616d700 1 --2- 172.21.15.6:0/2366506494 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa20c066f30 0x7fa20c0693e0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.848+0000 7fa22616d700 1 --2- 172.21.15.6:0/2366506494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa220068ca0 0x7fa220144900 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.848+0000 7fa22616d700 1 -- 172.21.15.6:0/2366506494 >> 172.21.15.6:0/2366506494 conn(0x7fa22006d330 msgr2=0x7fa2200632e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:59.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.848+0000 7fa22616d700 1 -- 172.21.15.6:0/2366506494 shutdown_connections 2023-10-06T02:27:59.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.848+0000 7fa22616d700 1 -- 172.21.15.6:0/2366506494 wait complete. 2023-10-06T02:27:59.850 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:27:59.855 INFO:tasks.ceph.mds.a.smithi006.stderr: -27> 2023-10-06T02:27:59.847+0000 7f8f1cd6d700 -1 log_channel(cluster) log [ERR] : error decoding table object 'mds0_inotable': End of buffer 2023-10-06T02:27:59.863 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:59.876 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:27:59.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.982+0000 7efddeae1700 1 Processor -- start 2023-10-06T02:27:59.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.982+0000 7efddeae1700 1 -- start start 2023-10-06T02:27:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.983+0000 7efddeae1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdd8157760 0x7efdd80b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.983+0000 7efddeae1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd815bca0 con 0x7efdd8140c90 2023-10-06T02:27:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.983+0000 7efddeae1700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd815b090 con 0x7efdd81408c0 2023-10-06T02:27:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.983+0000 7efddeae1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd815b370 con 0x7efdd8157760 2023-10-06T02:27:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.983+0000 7efdcffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdd8157760 0x7efdd80b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.983+0000 7efddd07e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efdd8140c90 0x7efdd80cbd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47258/0 (socket says 172.21.15.6:47258) 2023-10-06T02:27:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.983+0000 7efddd07e700 1 -- 172.21.15.6:0/467084178 learned_addr learned my addr 172.21.15.6:0/467084178 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:27:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.983+0000 7efdcffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdd8157760 0x7efdd80b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50418/0 (socket says 172.21.15.6:50418) 2023-10-06T02:27:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.984+0000 7efdcffff700 1 -- 172.21.15.6:0/467084178 >> v1:172.21.15.175:6789/0 conn(0x7efdd81408c0 legacy=0x7efdd80ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.984+0000 7efdcffff700 1 -- 172.21.15.6:0/467084178 >> v1:172.21.15.6:6789/0 conn(0x7efdd8140c90 legacy=0x7efdd80cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.984+0000 7efdcffff700 1 -- 172.21.15.6:0/467084178 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd815b650 con 0x7efdd8157760 2023-10-06T02:27:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.984+0000 7efdcf7fe700 1 -- 172.21.15.6:0/467084178 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425282961 0 0) 0x7efdd815bca0 con 0x7efdd8140c90 2023-10-06T02:27:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.984+0000 7efdcffff700 1 --2- 172.21.15.6:0/467084178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdd8157760 0x7efdd80b2080 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7efdc80098e0 tx=0x7efdc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebb8c9bfb2d3984 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.984+0000 7efdcf7fe700 1 -- 172.21.15.6:0/467084178 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc8009e80 con 0x7efdd8157760 2023-10-06T02:27:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.984+0000 7efdcf7fe700 1 -- 172.21.15.6:0/467084178 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc800b860 con 0x7efdd8157760 2023-10-06T02:27:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.984+0000 7efdcf7fe700 1 -- 172.21.15.6:0/467084178 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc800bbe0 con 0x7efdd8157760 2023-10-06T02:27:59.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.985+0000 7efddeae1700 1 -- 172.21.15.6:0/467084178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdd8157760 msgr2=0x7efdd80b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.985+0000 7efddeae1700 1 --2- 172.21.15.6:0/467084178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdd8157760 0x7efdd80b2080 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7efdc80098e0 tx=0x7efdc80091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.985+0000 7efddeae1700 1 -- 172.21.15.6:0/467084178 shutdown_connections 2023-10-06T02:27:59.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.985+0000 7efddeae1700 1 --2- 172.21.15.6:0/467084178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdd8157760 0x7efdd80b2080 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.985+0000 7efddeae1700 1 -- 172.21.15.6:0/467084178 >> 172.21.15.6:0/467084178 conn(0x7efdd80ccfb0 msgr2=0x7efdd80cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:59.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.985+0000 7efddeae1700 1 -- 172.21.15.6:0/467084178 shutdown_connections 2023-10-06T02:27:59.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.985+0000 7efddeae1700 1 -- 172.21.15.6:0/467084178 wait complete. 2023-10-06T02:27:59.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.986+0000 7efddeae1700 1 Processor -- start 2023-10-06T02:27:59.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.986+0000 7efddeae1700 1 -- start start 2023-10-06T02:27:59.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efddeae1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdd81408c0 0x7efdd80a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efddeae1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdd8140c90 0x7efdd813b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efddeae1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdd8157760 0x7efdd813b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efddeae1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd813d5f0 con 0x7efdd8157760 2023-10-06T02:27:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efddeae1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd813e170 con 0x7efdd81408c0 2023-10-06T02:27:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efddeae1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd813d840 con 0x7efdd8140c90 2023-10-06T02:27:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efddd07e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdd8157760 0x7efdd813b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efddd07e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdd8157760 0x7efdd813b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50422/0 (socket says 172.21.15.6:50422) 2023-10-06T02:27:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efddd07e700 1 -- 172.21.15.6:0/496965825 learned_addr learned my addr 172.21.15.6:0/496965825 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:27:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efddc87d700 1 --2- 172.21.15.6:0/496965825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdd81408c0 0x7efdd80a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efdcffff700 1 --2- 172.21.15.6:0/496965825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdd8140c90 0x7efdd813b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efddd07e700 1 -- 172.21.15.6:0/496965825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdd8140c90 msgr2=0x7efdd813b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efddd07e700 1 --2- 172.21.15.6:0/496965825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdd8140c90 0x7efdd813b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efddd07e700 1 -- 172.21.15.6:0/496965825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdd81408c0 msgr2=0x7efdd80a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efddd07e700 1 --2- 172.21.15.6:0/496965825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdd81408c0 0x7efdd80a4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efddd07e700 1 -- 172.21.15.6:0/496965825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc8009420 con 0x7efdd8157760 2023-10-06T02:27:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efddd07e700 1 --2- 172.21.15.6:0/496965825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdd8157760 0x7efdd813b570 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7efdd000ccc0 tx=0x7efdd0001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efdccff9700 1 -- 172.21.15.6:0/496965825 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000a8a0 con 0x7efdd8157760 2023-10-06T02:27:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efdccff9700 1 -- 172.21.15.6:0/496965825 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd000aa00 con 0x7efdd8157760 2023-10-06T02:27:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efddeae1700 1 -- 172.21.15.6:0/496965825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd813db20 con 0x7efdd8157760 2023-10-06T02:27:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.987+0000 7efdccff9700 1 -- 172.21.15.6:0/496965825 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000adc0 con 0x7efdd8157760 2023-10-06T02:27:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.988+0000 7efddeae1700 1 -- 172.21.15.6:0/496965825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd80a4ab0 con 0x7efdd8157760 2023-10-06T02:27:59.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.989+0000 7efddeae1700 1 -- 172.21.15.6:0/496965825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd806df40 con 0x7efdd8157760 2023-10-06T02:27:59.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.989+0000 7efdccff9700 1 -- 172.21.15.6:0/496965825 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efdd0007300 con 0x7efdd8157760 2023-10-06T02:27:59.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.989+0000 7efdccff9700 1 --2- 172.21.15.6:0/496965825 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efdc4066f30 0x7efdc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:59.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.990+0000 7efdccff9700 1 -- 172.21.15.6:0/496965825 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8872+0+0 (secure 0 0 0) 0x7efdd00854f0 con 0x7efdd8157760 2023-10-06T02:27:59.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.990+0000 7efddc87d700 1 --2- 172.21.15.6:0/496965825 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efdc4066f30 0x7efdc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:59.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.990+0000 7efddc87d700 1 --2- 172.21.15.6:0/496965825 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efdc4066f30 0x7efdc40693e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7efdd4003ac0 tx=0x7efdd4007ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:59.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:27:59.994+0000 7efdccff9700 1 -- 172.21.15.6:0/496965825 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdd0051b40 con 0x7efdd8157760 2023-10-06T02:28:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.231+0000 7efddeae1700 1 -- 172.21.15.6:0/496965825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdd815b930 con 0x7efdd8157760 2023-10-06T02:28:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.231+0000 7efdccff9700 1 -- 172.21.15.6:0/496965825 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 268 v268) v1 ==== 95+0+3840 (secure 0 0 0) 0x7efdd0055160 con 0x7efdd8157760 2023-10-06T02:28:00.232 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:00.232 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":268,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":268,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:59.848086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.233+0000 7efddeae1700 1 -- 172.21.15.6:0/496965825 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efdc4066f30 msgr2=0x7efdc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.233+0000 7efddeae1700 1 --2- 172.21.15.6:0/496965825 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efdc4066f30 0x7efdc40693e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7efdd4003ac0 tx=0x7efdd4007ea0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.233+0000 7efddeae1700 1 -- 172.21.15.6:0/496965825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdd8157760 msgr2=0x7efdd813b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.233+0000 7efddeae1700 1 --2- 172.21.15.6:0/496965825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdd8157760 0x7efdd813b570 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7efdd000ccc0 tx=0x7efdd0001a80 comp rx=0 tx=0).stop 2023-10-06T02:28:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.233+0000 7efddeae1700 1 -- 172.21.15.6:0/496965825 shutdown_connections 2023-10-06T02:28:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.233+0000 7efddeae1700 1 --2- 172.21.15.6:0/496965825 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efdc4066f30 0x7efdc40693e0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.233+0000 7efddeae1700 1 --2- 172.21.15.6:0/496965825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdd8157760 0x7efdd813b570 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.233+0000 7efddeae1700 1 --2- 172.21.15.6:0/496965825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdd81408c0 0x7efdd80a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.233+0000 7efddeae1700 1 --2- 172.21.15.6:0/496965825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdd8140c90 0x7efdd813b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.233+0000 7efddeae1700 1 -- 172.21.15.6:0/496965825 >> 172.21.15.6:0/496965825 conn(0x7efdd80ccfb0 msgr2=0x7efdd80cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:00.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.233+0000 7efddeae1700 1 -- 172.21.15.6:0/496965825 shutdown_connections 2023-10-06T02:28:00.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.233+0000 7efddeae1700 1 -- 172.21.15.6:0/496965825 wait complete. 2023-10-06T02:28:00.235 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 268 2023-10-06T02:28:00.247 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:28:00.247 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:00.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.407+0000 7fe276f6a700 1 Processor -- start 2023-10-06T02:28:00.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.407+0000 7fe276f6a700 1 -- start start 2023-10-06T02:28:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.407+0000 7fe276f6a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe27015b3c0 0x7fe270097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.407+0000 7fe276f6a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2700b3c50 0x7fe27015b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.407+0000 7fe276f6a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2700afb90 con 0x7fe27015bcd0 2023-10-06T02:28:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.407+0000 7fe276f6a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2700b2310 con 0x7fe2700b3c50 2023-10-06T02:28:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.407+0000 7fe276f6a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2700b25f0 con 0x7fe27015b3c0 2023-10-06T02:28:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.407+0000 7fe26ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2700b3c50 0x7fe27015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.408+0000 7fe275507700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe27015bcd0 0x7fe27015a590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47262/0 (socket says 172.21.15.6:47262) 2023-10-06T02:28:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.408+0000 7fe275507700 1 -- 172.21.15.6:0/2306772539 learned_addr learned my addr 172.21.15.6:0/2306772539 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.408+0000 7fe274d06700 1 --2- 172.21.15.6:0/2306772539 >> v2:172.21.15.175:3300/0 conn(0x7fe27015b3c0 0x7fe270097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.408+0000 7fe26ffff700 1 -- 172.21.15.6:0/2306772539 >> v2:172.21.15.175:3300/0 conn(0x7fe27015b3c0 msgr2=0x7fe270097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.408+0000 7fe26ffff700 1 --2- 172.21.15.6:0/2306772539 >> v2:172.21.15.175:3300/0 conn(0x7fe27015b3c0 0x7fe270097d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.408+0000 7fe26ffff700 1 -- 172.21.15.6:0/2306772539 >> v1:172.21.15.6:6789/0 conn(0x7fe27015bcd0 legacy=0x7fe27015a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.408+0000 7fe26ffff700 1 -- 172.21.15.6:0/2306772539 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2700af820 con 0x7fe2700b3c50 2023-10-06T02:28:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.408+0000 7fe26ffff700 1 --2- 172.21.15.6:0/2306772539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2700b3c50 0x7fe27015b790 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fe2700874b0 tx=0x7fe260009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d0e7ac40f2b0f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.408+0000 7fe26f7fe700 1 -- 172.21.15.6:0/2306772539 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26000e070 con 0x7fe2700b3c50 2023-10-06T02:28:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.408+0000 7fe26f7fe700 1 -- 172.21.15.6:0/2306772539 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26000bc30 con 0x7fe2700b3c50 2023-10-06T02:28:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.408+0000 7fe26f7fe700 1 -- 172.21.15.6:0/2306772539 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260012430 con 0x7fe2700b3c50 2023-10-06T02:28:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.409+0000 7fe276f6a700 1 -- 172.21.15.6:0/2306772539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2700b3c50 msgr2=0x7fe27015b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.409+0000 7fe276f6a700 1 --2- 172.21.15.6:0/2306772539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2700b3c50 0x7fe27015b790 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fe2700874b0 tx=0x7fe260009780 comp rx=0 tx=0).stop 2023-10-06T02:28:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.409+0000 7fe276f6a700 1 -- 172.21.15.6:0/2306772539 shutdown_connections 2023-10-06T02:28:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.409+0000 7fe276f6a700 1 --2- 172.21.15.6:0/2306772539 >> v2:172.21.15.175:3300/0 conn(0x7fe27015b3c0 0x7fe270097d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.409+0000 7fe276f6a700 1 --2- 172.21.15.6:0/2306772539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2700b3c50 0x7fe27015b790 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.409+0000 7fe276f6a700 1 -- 172.21.15.6:0/2306772539 >> 172.21.15.6:0/2306772539 conn(0x7fe270067910 msgr2=0x7fe2700ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.409+0000 7fe276f6a700 1 -- 172.21.15.6:0/2306772539 shutdown_connections 2023-10-06T02:28:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.409+0000 7fe276f6a700 1 -- 172.21.15.6:0/2306772539 wait complete. 2023-10-06T02:28:00.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.410+0000 7fe276f6a700 1 Processor -- start 2023-10-06T02:28:00.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.410+0000 7fe276f6a700 1 -- start start 2023-10-06T02:28:00.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe276f6a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2700b3c50 0x7fe27009aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:00.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe276f6a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27015b3c0 0x7fe2700a8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:00.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe276f6a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe27015bcd0 0x7fe2700a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:00.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe276f6a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27006b6f0 con 0x7fe27015b3c0 2023-10-06T02:28:00.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe276f6a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700a9b60 con 0x7fe2700b3c50 2023-10-06T02:28:00.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe276f6a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700a9e40 con 0x7fe27015bcd0 2023-10-06T02:28:00.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe26ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27015b3c0 0x7fe2700a8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:00.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe26ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27015b3c0 0x7fe2700a8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50444/0 (socket says 172.21.15.6:50444) 2023-10-06T02:28:00.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe26ffff700 1 -- 172.21.15.6:0/2684550650 learned_addr learned my addr 172.21.15.6:0/2684550650 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:00.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe274d06700 1 --2- 172.21.15.6:0/2684550650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2700b3c50 0x7fe27009aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe275507700 1 --2- 172.21.15.6:0/2684550650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe27015bcd0 0x7fe2700a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe26ffff700 1 -- 172.21.15.6:0/2684550650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe27015bcd0 msgr2=0x7fe2700a94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe26ffff700 1 --2- 172.21.15.6:0/2684550650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe27015bcd0 0x7fe2700a94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe26ffff700 1 -- 172.21.15.6:0/2684550650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2700b3c50 msgr2=0x7fe27009aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe26ffff700 1 --2- 172.21.15.6:0/2684550650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2700b3c50 0x7fe27009aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe26ffff700 1 -- 172.21.15.6:0/2684550650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe260009a20 con 0x7fe27015b3c0 2023-10-06T02:28:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe26ffff700 1 --2- 172.21.15.6:0/2684550650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27015b3c0 0x7fe2700a8f80 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fe26000b6c0 tx=0x7fe260019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe26cff9700 1 -- 172.21.15.6:0/2684550650 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260012c90 con 0x7fe27015b3c0 2023-10-06T02:28:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.411+0000 7fe26cff9700 1 -- 172.21.15.6:0/2684550650 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe260012df0 con 0x7fe27015b3c0 2023-10-06T02:28:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.412+0000 7fe276f6a700 1 -- 172.21.15.6:0/2684550650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2700aa120 con 0x7fe27015b3c0 2023-10-06T02:28:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.412+0000 7fe26cff9700 1 -- 172.21.15.6:0/2684550650 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260026640 con 0x7fe27015b3c0 2023-10-06T02:28:00.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.412+0000 7fe276f6a700 1 -- 172.21.15.6:0/2684550650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2700aa6e0 con 0x7fe27015b3c0 2023-10-06T02:28:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.412+0000 7fe276f6a700 1 -- 172.21.15.6:0/2684550650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27006e8d0 con 0x7fe27015b3c0 2023-10-06T02:28:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.413+0000 7fe26cff9700 1 -- 172.21.15.6:0/2684550650 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe260026a30 con 0x7fe27015b3c0 2023-10-06T02:28:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.413+0000 7fe26cff9700 1 --2- 172.21.15.6:0/2684550650 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe250066f30 0x7fe2500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.413+0000 7fe26cff9700 1 -- 172.21.15.6:0/2684550650 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8872+0+0 (secure 0 0 0) 0x7fe260086fc0 con 0x7fe27015b3c0 2023-10-06T02:28:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.413+0000 7fe274d06700 1 --2- 172.21.15.6:0/2684550650 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe250066f30 0x7fe2500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.414+0000 7fe274d06700 1 --2- 172.21.15.6:0/2684550650 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe250066f30 0x7fe2500693e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fe2680061f0 tx=0x7fe268008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.417+0000 7fe26cff9700 1 -- 172.21.15.6:0/2684550650 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2600b85a0 con 0x7fe27015b3c0 2023-10-06T02:28:00.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.656+0000 7fe276f6a700 1 -- 172.21.15.6:0/2684550650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2700a89a0 con 0x7fe27015b3c0 2023-10-06T02:28:00.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.657+0000 7fe26cff9700 1 -- 172.21.15.6:0/2684550650 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 268 v268) v1 ==== 95+0+3840 (secure 0 0 0) 0x7fe260053590 con 0x7fe27015b3c0 2023-10-06T02:28:00.657 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:00.658 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":268,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":268,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:59.848086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:00.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.659+0000 7fe276f6a700 1 -- 172.21.15.6:0/2684550650 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe250066f30 msgr2=0x7fe2500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:00.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.659+0000 7fe276f6a700 1 --2- 172.21.15.6:0/2684550650 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe250066f30 0x7fe2500693e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fe2680061f0 tx=0x7fe268008040 comp rx=0 tx=0).stop 2023-10-06T02:28:00.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.659+0000 7fe276f6a700 1 -- 172.21.15.6:0/2684550650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27015b3c0 msgr2=0x7fe2700a8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:00.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.659+0000 7fe276f6a700 1 --2- 172.21.15.6:0/2684550650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27015b3c0 0x7fe2700a8f80 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fe26000b6c0 tx=0x7fe260019000 comp rx=0 tx=0).stop 2023-10-06T02:28:00.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.659+0000 7fe276f6a700 1 -- 172.21.15.6:0/2684550650 shutdown_connections 2023-10-06T02:28:00.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.659+0000 7fe276f6a700 1 --2- 172.21.15.6:0/2684550650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe27015bcd0 0x7fe2700a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.659+0000 7fe276f6a700 1 --2- 172.21.15.6:0/2684550650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2700b3c50 0x7fe27009aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.659+0000 7fe276f6a700 1 --2- 172.21.15.6:0/2684550650 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe250066f30 0x7fe2500693e0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.659+0000 7fe276f6a700 1 --2- 172.21.15.6:0/2684550650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27015b3c0 0x7fe2700a8f80 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.659+0000 7fe276f6a700 1 -- 172.21.15.6:0/2684550650 >> 172.21.15.6:0/2684550650 conn(0x7fe270067910 msgr2=0x7fe2701595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:00.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.659+0000 7fe276f6a700 1 -- 172.21.15.6:0/2684550650 shutdown_connections 2023-10-06T02:28:00.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.659+0000 7fe276f6a700 1 -- 172.21.15.6:0/2684550650 wait complete. 2023-10-06T02:28:00.661 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 268 2023-10-06T02:28:00.671 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:28:00.671 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:00.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.790+0000 7f7ccf9d2700 1 Processor -- start 2023-10-06T02:28:00.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.790+0000 7f7ccf9d2700 1 -- start start 2023-10-06T02:28:00.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.791+0000 7f7ccf9d2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7cc81593f0 0x7f7cc806de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:00.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.791+0000 7f7ccf9d2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7cc806adf0 0x7f7cc806e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:00.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.791+0000 7f7ccf9d2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc8069950 con 0x7f7cc81597c0 2023-10-06T02:28:00.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.791+0000 7f7ccf9d2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc80b2850 con 0x7f7cc806adf0 2023-10-06T02:28:00.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.791+0000 7f7ccf9d2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc80b1fb0 con 0x7f7cc81593f0 2023-10-06T02:28:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.791+0000 7f7ccdf6f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7cc806adf0 0x7f7cc806e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.791+0000 7f7cccf6d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7cc81597c0 0x7f7cc815d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47264/0 (socket says 172.21.15.6:47264) 2023-10-06T02:28:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.791+0000 7f7ccdf6f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7cc806adf0 0x7f7cc806e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50460/0 (socket says 172.21.15.6:50460) 2023-10-06T02:28:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.791+0000 7f7cccf6d700 1 -- 172.21.15.6:0/1519818060 learned_addr learned my addr 172.21.15.6:0/1519818060 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.791+0000 7f7ccd76e700 1 --2- 172.21.15.6:0/1519818060 >> v2:172.21.15.175:3300/0 conn(0x7f7cc81593f0 0x7f7cc806de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.791+0000 7f7ccdf6f700 1 -- 172.21.15.6:0/1519818060 >> v2:172.21.15.175:3300/0 conn(0x7f7cc81593f0 msgr2=0x7f7cc806de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.791+0000 7f7ccdf6f700 1 --2- 172.21.15.6:0/1519818060 >> v2:172.21.15.175:3300/0 conn(0x7f7cc81593f0 0x7f7cc806de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.791+0000 7f7ccdf6f700 1 -- 172.21.15.6:0/1519818060 >> v1:172.21.15.6:6789/0 conn(0x7f7cc81597c0 legacy=0x7f7cc815d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.791+0000 7f7cc7fff700 1 -- 172.21.15.6:0/1519818060 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673137641 0 0) 0x7f7cc8069950 con 0x7f7cc81597c0 2023-10-06T02:28:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.791+0000 7f7ccdf6f700 1 -- 172.21.15.6:0/1519818060 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc80b2290 con 0x7f7cc806adf0 2023-10-06T02:28:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.791+0000 7f7ccdf6f700 1 --2- 172.21.15.6:0/1519818060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cc806adf0 0x7f7cc806e350 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8087470 tx=0x7f7cc0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22042839f5cc858 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.792+0000 7f7cc7fff700 1 -- 172.21.15.6:0/1519818060 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc000e070 con 0x7f7cc806adf0 2023-10-06T02:28:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.792+0000 7f7cc7fff700 1 -- 172.21.15.6:0/1519818060 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc000bc30 con 0x7f7cc806adf0 2023-10-06T02:28:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.792+0000 7f7cc7fff700 1 -- 172.21.15.6:0/1519818060 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0012430 con 0x7f7cc806adf0 2023-10-06T02:28:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.792+0000 7f7ccf9d2700 1 -- 172.21.15.6:0/1519818060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cc806adf0 msgr2=0x7f7cc806e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.792+0000 7f7ccf9d2700 1 --2- 172.21.15.6:0/1519818060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cc806adf0 0x7f7cc806e350 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8087470 tx=0x7f7cc0009780 comp rx=0 tx=0).stop 2023-10-06T02:28:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.792+0000 7f7ccf9d2700 1 -- 172.21.15.6:0/1519818060 shutdown_connections 2023-10-06T02:28:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.792+0000 7f7ccf9d2700 1 --2- 172.21.15.6:0/1519818060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cc806adf0 0x7f7cc806e350 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.792+0000 7f7ccf9d2700 1 --2- 172.21.15.6:0/1519818060 >> v2:172.21.15.175:3300/0 conn(0x7f7cc81593f0 0x7f7cc806de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.792+0000 7f7ccf9d2700 1 -- 172.21.15.6:0/1519818060 >> 172.21.15.6:0/1519818060 conn(0x7f7cc806cff0 msgr2=0x7f7cc80afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:00.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.792+0000 7f7ccf9d2700 1 -- 172.21.15.6:0/1519818060 shutdown_connections 2023-10-06T02:28:00.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.792+0000 7f7ccf9d2700 1 -- 172.21.15.6:0/1519818060 wait complete. 2023-10-06T02:28:00.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.793+0000 7f7ccf9d2700 1 Processor -- start 2023-10-06T02:28:00.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.793+0000 7f7ccf9d2700 1 -- start start 2023-10-06T02:28:00.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.794+0000 7f7ccf9d2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cc806adf0 0x7f7cc81698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:00.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.794+0000 7f7ccf9d2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cc81593f0 0x7f7cc80a5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:00.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.794+0000 7f7ccf9d2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cc81597c0 0x7f7cc80a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:00.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.794+0000 7f7ccf9d2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc80a5ef0 con 0x7f7cc81597c0 2023-10-06T02:28:00.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.794+0000 7f7ccf9d2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc8169de0 con 0x7f7cc806adf0 2023-10-06T02:28:00.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.794+0000 7f7ccf9d2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc80c91f0 con 0x7f7cc81593f0 2023-10-06T02:28:00.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.794+0000 7f7ccdf6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cc81597c0 0x7f7cc80a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:00.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.794+0000 7f7ccdf6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cc81597c0 0x7f7cc80a59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50468/0 (socket says 172.21.15.6:50468) 2023-10-06T02:28:00.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.794+0000 7f7ccdf6f700 1 -- 172.21.15.6:0/699340576 learned_addr learned my addr 172.21.15.6:0/699340576 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:00.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.794+0000 7f7ccd76e700 1 --2- 172.21.15.6:0/699340576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cc806adf0 0x7f7cc81698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:00.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.794+0000 7f7cccf6d700 1 --2- 172.21.15.6:0/699340576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cc81593f0 0x7f7cc80a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:00.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.795+0000 7f7ccdf6f700 1 -- 172.21.15.6:0/699340576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cc81593f0 msgr2=0x7f7cc80a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:00.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.795+0000 7f7ccdf6f700 1 --2- 172.21.15.6:0/699340576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cc81593f0 0x7f7cc80a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.795+0000 7f7ccdf6f700 1 -- 172.21.15.6:0/699340576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cc806adf0 msgr2=0x7f7cc81698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:00.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.795+0000 7f7ccdf6f700 1 --2- 172.21.15.6:0/699340576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cc806adf0 0x7f7cc81698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:00.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.795+0000 7f7ccdf6f700 1 -- 172.21.15.6:0/699340576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc0009a20 con 0x7f7cc81597c0 2023-10-06T02:28:00.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.795+0000 7f7ccdf6f700 1 --2- 172.21.15.6:0/699340576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cc81597c0 0x7f7cc80a59b0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0013000 tx=0x7f7cc0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:00.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.795+0000 7f7cc57fa700 1 -- 172.21.15.6:0/699340576 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0027470 con 0x7f7cc81597c0 2023-10-06T02:28:00.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.795+0000 7f7cc57fa700 1 -- 172.21.15.6:0/699340576 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc00275f0 con 0x7f7cc81597c0 2023-10-06T02:28:00.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.795+0000 7f7ccf9d2700 1 -- 172.21.15.6:0/699340576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc80c94d0 con 0x7f7cc81597c0 2023-10-06T02:28:00.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.795+0000 7f7cc57fa700 1 -- 172.21.15.6:0/699340576 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00279b0 con 0x7f7cc81597c0 2023-10-06T02:28:00.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.795+0000 7f7ccf9d2700 1 -- 172.21.15.6:0/699340576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc80c9b10 con 0x7f7cc81597c0 2023-10-06T02:28:00.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.796+0000 7f7ccf9d2700 1 -- 172.21.15.6:0/699340576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc806d3f0 con 0x7f7cc81597c0 2023-10-06T02:28:00.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.796+0000 7f7cc57fa700 1 -- 172.21.15.6:0/699340576 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7cc0024070 con 0x7f7cc81597c0 2023-10-06T02:28:00.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.797+0000 7f7cc57fa700 1 --2- 172.21.15.6:0/699340576 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7cb4066f30 0x7f7cb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:00.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.797+0000 7f7cc57fa700 1 -- 172.21.15.6:0/699340576 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8872+0+0 (secure 0 0 0) 0x7f7cc00878f0 con 0x7f7cc81597c0 2023-10-06T02:28:00.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.797+0000 7f7ccd76e700 1 --2- 172.21.15.6:0/699340576 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7cb4066f30 0x7f7cb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:00.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.797+0000 7f7ccd76e700 1 --2- 172.21.15.6:0/699340576 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7cb4066f30 0x7f7cb40693e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8006fd0 tx=0x7f7cb8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:00.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:00.801+0000 7f7cc57fa700 1 -- 172.21.15.6:0/699340576 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cc0053ec0 con 0x7f7cc81597c0 2023-10-06T02:28:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.042+0000 7f7ccf9d2700 1 -- 172.21.15.6:0/699340576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7cc80c9e30 con 0x7f7cc81597c0 2023-10-06T02:28:01.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.042+0000 7f7cc57fa700 1 -- 172.21.15.6:0/699340576 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 269 v269) v1 ==== 95+0+4595 (secure 0 0 0) 0x7f7cc002c020 con 0x7f7cc81597c0 2023-10-06T02:28:01.043 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:01.043 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":269,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9825,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1461010014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1461010014},{"type":"v1","addr":"172.21.15.6:6835","nonce":1461010014}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":269}],"filesystems":[{"mdsmap":{"epoch":268,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:27:59.848086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.044+0000 7f7ccf9d2700 1 -- 172.21.15.6:0/699340576 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7cb4066f30 msgr2=0x7f7cb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.044+0000 7f7ccf9d2700 1 --2- 172.21.15.6:0/699340576 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7cb4066f30 0x7f7cb40693e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8006fd0 tx=0x7f7cb8008040 comp rx=0 tx=0).stop 2023-10-06T02:28:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.044+0000 7f7ccf9d2700 1 -- 172.21.15.6:0/699340576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cc81597c0 msgr2=0x7f7cc80a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.044+0000 7f7ccf9d2700 1 --2- 172.21.15.6:0/699340576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cc81597c0 0x7f7cc80a59b0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0013000 tx=0x7f7cc0019000 comp rx=0 tx=0).stop 2023-10-06T02:28:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.044+0000 7f7ccf9d2700 1 -- 172.21.15.6:0/699340576 shutdown_connections 2023-10-06T02:28:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.044+0000 7f7ccf9d2700 1 --2- 172.21.15.6:0/699340576 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7cb4066f30 0x7f7cb40693e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.044+0000 7f7ccf9d2700 1 --2- 172.21.15.6:0/699340576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cc81597c0 0x7f7cc80a59b0 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.044+0000 7f7ccf9d2700 1 --2- 172.21.15.6:0/699340576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cc806adf0 0x7f7cc81698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.044+0000 7f7ccf9d2700 1 --2- 172.21.15.6:0/699340576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cc81593f0 0x7f7cc80a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.044+0000 7f7ccf9d2700 1 -- 172.21.15.6:0/699340576 >> 172.21.15.6:0/699340576 conn(0x7f7cc806cff0 msgr2=0x7f7cc815c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.044+0000 7f7ccf9d2700 1 -- 172.21.15.6:0/699340576 shutdown_connections 2023-10-06T02:28:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.044+0000 7f7ccf9d2700 1 -- 172.21.15.6:0/699340576 wait complete. 2023-10-06T02:28:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 269 2023-10-06T02:28:01.057 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate mds0_inotable' led to DAMAGED state 2023-10-06T02:28:01.057 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 400.00000000' 2023-10-06T02:28:01.057 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:01.057 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:28:01.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:01.057 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:28:01.072 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:28:01.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:28:01.073 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:28:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.232+0000 7fc7b4ace700 1 Processor -- start 2023-10-06T02:28:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.232+0000 7fc7b4ace700 1 -- start start 2023-10-06T02:28:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.233+0000 7fc7b4ace700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc7b006a910 0x7fc7b006ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.233+0000 7fc7b4ace700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b006a1a0 con 0x7fc7b015cae0 2023-10-06T02:28:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.233+0000 7fc7b4ace700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b006a480 con 0x7fc7b00cc740 2023-10-06T02:28:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.233+0000 7fc7b4ace700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b00c8e40 con 0x7fc7b006a910 2023-10-06T02:28:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.233+0000 7fc7ae59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc7b015cae0 0x7fc7b00c8730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47276/0 (socket says 172.21.15.6:47276) 2023-10-06T02:28:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.233+0000 7fc7ae59c700 1 -- 172.21.15.6:0/3936672036 learned_addr learned my addr 172.21.15.6:0/3936672036 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.234+0000 7fc7add9b700 1 --2- 172.21.15.6:0/3936672036 >> v2:172.21.15.175:3300/0 conn(0x7fc7b006a910 0x7fc7b006ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:01.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.234+0000 7fc7ad59a700 1 -- 172.21.15.6:0/3936672036 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927890415 0 0) 0x7fc7b006a1a0 con 0x7fc7b015cae0 2023-10-06T02:28:01.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.234+0000 7fc7ad59a700 1 -- 172.21.15.6:0/3936672036 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc798003570 con 0x7fc7b015cae0 2023-10-06T02:28:01.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.234+0000 7fc7add9b700 1 -- 172.21.15.6:0/3936672036 >> v1:172.21.15.175:6789/0 conn(0x7fc7b00cc740 legacy=0x7fc7b00ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:01.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.234+0000 7fc7ad59a700 1 -- 172.21.15.6:0/3936672036 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119148466 0 0) 0x7fc7b006a480 con 0x7fc7b00cc740 2023-10-06T02:28:01.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.234+0000 7fc7add9b700 1 -- 172.21.15.6:0/3936672036 >> v1:172.21.15.6:6789/0 conn(0x7fc7b015cae0 legacy=0x7fc7b00c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:01.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.234+0000 7fc7add9b700 1 -- 172.21.15.6:0/3936672036 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b006b2d0 con 0x7fc7b006a910 2023-10-06T02:28:01.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.234+0000 7fc7add9b700 1 --2- 172.21.15.6:0/3936672036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7b006a910 0x7fc7b006ad90 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40098e0 tx=0x7fc7a40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2d2a42e5ae9b380 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:01.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.234+0000 7fc7ad59a700 1 -- 172.21.15.6:0/3936672036 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a400b640 con 0x7fc7b006a910 2023-10-06T02:28:01.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.234+0000 7fc7ad59a700 1 -- 172.21.15.6:0/3936672036 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a400b7a0 con 0x7fc7b006a910 2023-10-06T02:28:01.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.234+0000 7fc7ad59a700 1 -- 172.21.15.6:0/3936672036 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a400bb40 con 0x7fc7b006a910 2023-10-06T02:28:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.235+0000 7fc7b4ace700 1 -- 172.21.15.6:0/3936672036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7b006a910 msgr2=0x7fc7b006ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.235+0000 7fc7b4ace700 1 --2- 172.21.15.6:0/3936672036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7b006a910 0x7fc7b006ad90 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40098e0 tx=0x7fc7a40091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.235+0000 7fc7b4ace700 1 -- 172.21.15.6:0/3936672036 shutdown_connections 2023-10-06T02:28:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.235+0000 7fc7b4ace700 1 --2- 172.21.15.6:0/3936672036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7b006a910 0x7fc7b006ad90 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.235+0000 7fc7b4ace700 1 -- 172.21.15.6:0/3936672036 >> 172.21.15.6:0/3936672036 conn(0x7fc7b0067910 msgr2=0x7fc7b00ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.235+0000 7fc7b4ace700 1 -- 172.21.15.6:0/3936672036 shutdown_connections 2023-10-06T02:28:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.235+0000 7fc7b4ace700 1 -- 172.21.15.6:0/3936672036 wait complete. 2023-10-06T02:28:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.236+0000 7fc7b4ace700 1 Processor -- start 2023-10-06T02:28:01.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.236+0000 7fc7b4ace700 1 -- start start 2023-10-06T02:28:01.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.237+0000 7fc7b4ace700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7b006a910 0x7fc7b0156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:01.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.237+0000 7fc7b4ace700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b00cc740 0x7fc7b00c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:01.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.237+0000 7fc7b4ace700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7b015cae0 0x7fc7b00b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:01.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.237+0000 7fc7b4ace700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b00b3bc0 con 0x7fc7b00cc740 2023-10-06T02:28:01.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.237+0000 7fc7b4ace700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b0156b90 con 0x7fc7b006a910 2023-10-06T02:28:01.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.237+0000 7fc7b4ace700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b016a410 con 0x7fc7b015cae0 2023-10-06T02:28:01.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.237+0000 7fc7add9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b00cc740 0x7fc7b00c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:01.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.237+0000 7fc7add9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b00cc740 0x7fc7b00c77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50472/0 (socket says 172.21.15.6:50472) 2023-10-06T02:28:01.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.237+0000 7fc7add9b700 1 -- 172.21.15.6:0/3921947023 learned_addr learned my addr 172.21.15.6:0/3921947023 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:01.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.237+0000 7fc7ae59c700 1 --2- 172.21.15.6:0/3921947023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7b006a910 0x7fc7b0156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.237+0000 7fc7aed9d700 1 --2- 172.21.15.6:0/3921947023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7b015cae0 0x7fc7b00b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.237+0000 7fc7add9b700 1 -- 172.21.15.6:0/3921947023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7b015cae0 msgr2=0x7fc7b00b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.237+0000 7fc7add9b700 1 --2- 172.21.15.6:0/3921947023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7b015cae0 0x7fc7b00b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.237+0000 7fc7add9b700 1 -- 172.21.15.6:0/3921947023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7b006a910 msgr2=0x7fc7b0156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.237+0000 7fc7add9b700 1 --2- 172.21.15.6:0/3921947023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7b006a910 0x7fc7b0156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.237+0000 7fc7add9b700 1 -- 172.21.15.6:0/3921947023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a4009420 con 0x7fc7b00cc740 2023-10-06T02:28:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.237+0000 7fc7add9b700 1 --2- 172.21.15.6:0/3921947023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b00cc740 0x7fc7b00c77d0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40093f0 tx=0x7fc7a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.238+0000 7fc79e7fc700 1 -- 172.21.15.6:0/3921947023 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a401f070 con 0x7fc7b00cc740 2023-10-06T02:28:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.238+0000 7fc79e7fc700 1 -- 172.21.15.6:0/3921947023 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a4002f70 con 0x7fc7b00cc740 2023-10-06T02:28:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.238+0000 7fc7b4ace700 1 -- 172.21.15.6:0/3921947023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b016a6f0 con 0x7fc7b00cc740 2023-10-06T02:28:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.238+0000 7fc79e7fc700 1 -- 172.21.15.6:0/3921947023 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4011420 con 0x7fc7b00cc740 2023-10-06T02:28:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.238+0000 7fc7b4ace700 1 -- 172.21.15.6:0/3921947023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b016acb0 con 0x7fc7b00cc740 2023-10-06T02:28:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.239+0000 7fc7b4ace700 1 -- 172.21.15.6:0/3921947023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b006e590 con 0x7fc7b00cc740 2023-10-06T02:28:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.239+0000 7fc79e7fc700 1 -- 172.21.15.6:0/3921947023 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7a4011810 con 0x7fc7b00cc740 2023-10-06T02:28:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.240+0000 7fc79e7fc700 1 --2- 172.21.15.6:0/3921947023 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc790066f30 0x7fc7900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.240+0000 7fc79e7fc700 1 -- 172.21.15.6:0/3921947023 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8872+0+0 (secure 0 0 0) 0x7fc7a4086220 con 0x7fc7b00cc740 2023-10-06T02:28:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.240+0000 7fc7ae59c700 1 --2- 172.21.15.6:0/3921947023 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc790066f30 0x7fc7900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.240+0000 7fc7ae59c700 1 --2- 172.21.15.6:0/3921947023 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc790066f30 0x7fc7900693e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0000c00 tx=0x7fc7a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:01.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.244+0000 7fc79e7fc700 1 -- 172.21.15.6:0/3921947023 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7a40527f0 con 0x7fc7b00cc740 2023-10-06T02:28:01.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:01.479+0000 7fc7b4ace700 1 -- 172.21.15.6:0/3921947023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc7b006cd30 con 0x7fc7b00cc740 2023-10-06T02:28:02.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.130+0000 7fc79e7fc700 1 -- 172.21.15.6:0/3921947023 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v270) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc7a4055e10 con 0x7fc7b00cc740 2023-10-06T02:28:02.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.132+0000 7fc7b4ace700 1 -- 172.21.15.6:0/3921947023 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc790066f30 msgr2=0x7fc7900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:02.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.132+0000 7fc7b4ace700 1 --2- 172.21.15.6:0/3921947023 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc790066f30 0x7fc7900693e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0000c00 tx=0x7fc7a0009040 comp rx=0 tx=0).stop 2023-10-06T02:28:02.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.132+0000 7fc7b4ace700 1 -- 172.21.15.6:0/3921947023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b00cc740 msgr2=0x7fc7b00c77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:02.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.132+0000 7fc7b4ace700 1 --2- 172.21.15.6:0/3921947023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b00cc740 0x7fc7b00c77d0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40093f0 tx=0x7fc7a4017000 comp rx=0 tx=0).stop 2023-10-06T02:28:02.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.132+0000 7fc7b4ace700 1 -- 172.21.15.6:0/3921947023 shutdown_connections 2023-10-06T02:28:02.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.132+0000 7fc7b4ace700 1 --2- 172.21.15.6:0/3921947023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7b015cae0 0x7fc7b00b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:02.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.132+0000 7fc7b4ace700 1 --2- 172.21.15.6:0/3921947023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7b006a910 0x7fc7b0156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:02.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.132+0000 7fc7b4ace700 1 --2- 172.21.15.6:0/3921947023 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc790066f30 0x7fc7900693e0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:02.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.132+0000 7fc7b4ace700 1 --2- 172.21.15.6:0/3921947023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b00cc740 0x7fc7b00c77d0 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:02.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.132+0000 7fc7b4ace700 1 -- 172.21.15.6:0/3921947023 >> 172.21.15.6:0/3921947023 conn(0x7fc7b0067910 msgr2=0x7fc7b006c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:02.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.132+0000 7fc7b4ace700 1 -- 172.21.15.6:0/3921947023 shutdown_connections 2023-10-06T02:28:02.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.133+0000 7fc7b4ace700 1 -- 172.21.15.6:0/3921947023 wait complete. 2023-10-06T02:28:02.134 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:28:02.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:28:02.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.272+0000 7fe3c96e5700 1 Processor -- start 2023-10-06T02:28:02.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.273+0000 7fe3c96e5700 1 -- start start 2023-10-06T02:28:02.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.273+0000 7fe3c96e5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c40a89c0 0x7fe3c40aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.273+0000 7fe3c96e5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3c40a8d90 0x7fe3c40af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.273+0000 7fe3c96e5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe3c40af570 0x7fe3c40b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.273+0000 7fe3c96e5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c40af9b0 con 0x7fe3c40a8d90 2023-10-06T02:28:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.273+0000 7fe3c96e5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c406b030 con 0x7fe3c40af570 2023-10-06T02:28:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.273+0000 7fe3c96e5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40b1ab0 con 0x7fe3c40a89c0 2023-10-06T02:28:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.273+0000 7fe3c27fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3c40a8d90 0x7fe3c40af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.273+0000 7fe3c27fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3c40a8d90 0x7fe3c40af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50488/0 (socket says 172.21.15.6:50488) 2023-10-06T02:28:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.273+0000 7fe3c27fc700 1 -- 172.21.15.6:0/1905204958 learned_addr learned my addr 172.21.15.6:0/1905204958 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.274+0000 7fe3c27fc700 1 -- 172.21.15.6:0/1905204958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c40a89c0 msgr2=0x7fe3c40aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.274+0000 7fe3c2ffd700 1 --2- 172.21.15.6:0/1905204958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c40a89c0 0x7fe3c40aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.274+0000 7fe3c37fe700 1 --2- 172.21.15.6:0/1905204958 >> v2:172.21.15.175:3300/0 conn(0x7fe3c40af570 0x7fe3c40b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.274+0000 7fe3c27fc700 1 --2- 172.21.15.6:0/1905204958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c40a89c0 0x7fe3c40aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.274+0000 7fe3c27fc700 1 -- 172.21.15.6:0/1905204958 >> v2:172.21.15.175:3300/0 conn(0x7fe3c40af570 msgr2=0x7fe3c40b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.274+0000 7fe3c27fc700 1 --2- 172.21.15.6:0/1905204958 >> v2:172.21.15.175:3300/0 conn(0x7fe3c40af570 0x7fe3c40b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.274+0000 7fe3c27fc700 1 -- 172.21.15.6:0/1905204958 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c406ad50 con 0x7fe3c40a8d90 2023-10-06T02:28:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.274+0000 7fe3c27fc700 1 --2- 172.21.15.6:0/1905204958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3c40a8d90 0x7fe3c40af030 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40ad760 tx=0x7fe3ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28e09f8ec2c6362 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.274+0000 7fe3c1ffb700 1 -- 172.21.15.6:0/1905204958 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac00b860 con 0x7fe3c40a8d90 2023-10-06T02:28:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.274+0000 7fe3c1ffb700 1 -- 172.21.15.6:0/1905204958 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac00b9c0 con 0x7fe3c40a8d90 2023-10-06T02:28:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.274+0000 7fe3c1ffb700 1 -- 172.21.15.6:0/1905204958 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac00bd60 con 0x7fe3c40a8d90 2023-10-06T02:28:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.275+0000 7fe3c96e5700 1 -- 172.21.15.6:0/1905204958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3c40a8d90 msgr2=0x7fe3c40af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.275+0000 7fe3c96e5700 1 --2- 172.21.15.6:0/1905204958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3c40a8d90 0x7fe3c40af030 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40ad760 tx=0x7fe3ac009250 comp rx=0 tx=0).stop 2023-10-06T02:28:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.275+0000 7fe3c96e5700 1 -- 172.21.15.6:0/1905204958 shutdown_connections 2023-10-06T02:28:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.275+0000 7fe3c96e5700 1 --2- 172.21.15.6:0/1905204958 >> v2:172.21.15.175:3300/0 conn(0x7fe3c40af570 0x7fe3c40b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.275+0000 7fe3c96e5700 1 --2- 172.21.15.6:0/1905204958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c40a89c0 0x7fe3c40aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:02.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.275+0000 7fe3c96e5700 1 --2- 172.21.15.6:0/1905204958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3c40a8d90 0x7fe3c40af030 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:02.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.275+0000 7fe3c96e5700 1 -- 172.21.15.6:0/1905204958 >> 172.21.15.6:0/1905204958 conn(0x7fe3c4067910 msgr2=0x7fe3c40ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:02.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.275+0000 7fe3c96e5700 1 -- 172.21.15.6:0/1905204958 shutdown_connections 2023-10-06T02:28:02.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.275+0000 7fe3c96e5700 1 -- 172.21.15.6:0/1905204958 wait complete. 2023-10-06T02:28:02.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.276+0000 7fe3c96e5700 1 Processor -- start 2023-10-06T02:28:02.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.276+0000 7fe3c96e5700 1 -- start start 2023-10-06T02:28:02.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c96e5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c40a89c0 0x7fe3c409a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:02.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c96e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3c40a8d90 0x7fe3c4098e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:02.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c96e5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3c40af570 0x7fe3c40c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c96e5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c409a0b0 con 0x7fe3c40a8d90 2023-10-06T02:28:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c96e5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40c4040 con 0x7fe3c40af570 2023-10-06T02:28:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c96e5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40994a0 con 0x7fe3c40a89c0 2023-10-06T02:28:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3c40a8d90 0x7fe3c4098e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3c40a8d90 0x7fe3c4098e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50490/0 (socket says 172.21.15.6:50490) 2023-10-06T02:28:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c27fc700 1 -- 172.21.15.6:0/3395411152 learned_addr learned my addr 172.21.15.6:0/3395411152 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c37fe700 1 --2- 172.21.15.6:0/3395411152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3c40af570 0x7fe3c40c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c2ffd700 1 --2- 172.21.15.6:0/3395411152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c40a89c0 0x7fe3c409a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c27fc700 1 -- 172.21.15.6:0/3395411152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c40a89c0 msgr2=0x7fe3c409a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c27fc700 1 --2- 172.21.15.6:0/3395411152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c40a89c0 0x7fe3c409a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c27fc700 1 -- 172.21.15.6:0/3395411152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3c40af570 msgr2=0x7fe3c40c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c27fc700 1 --2- 172.21.15.6:0/3395411152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3c40af570 0x7fe3c40c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c27fc700 1 -- 172.21.15.6:0/3395411152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ac0094f0 con 0x7fe3c40a8d90 2023-10-06T02:28:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c37fe700 1 --2- 172.21.15.6:0/3395411152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3c40af570 0x7fe3c40c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c27fc700 1 --2- 172.21.15.6:0/3395411152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3c40a8d90 0x7fe3c4098e30 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7fe3c406f2f0 tx=0x7fe3ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3baffd700 1 -- 172.21.15.6:0/3395411152 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac024440 con 0x7fe3c40a8d90 2023-10-06T02:28:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3baffd700 1 -- 172.21.15.6:0/3395411152 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac0245a0 con 0x7fe3c40a8d90 2023-10-06T02:28:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c96e5700 1 -- 172.21.15.6:0/3395411152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c4099780 con 0x7fe3c40a8d90 2023-10-06T02:28:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3baffd700 1 -- 172.21.15.6:0/3395411152 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac024960 con 0x7fe3c40a8d90 2023-10-06T02:28:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.277+0000 7fe3c96e5700 1 -- 172.21.15.6:0/3395411152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c4099d40 con 0x7fe3c40a8d90 2023-10-06T02:28:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.278+0000 7fe3c96e5700 1 -- 172.21.15.6:0/3395411152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c4087170 con 0x7fe3c40a8d90 2023-10-06T02:28:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.279+0000 7fe3baffd700 1 -- 172.21.15.6:0/3395411152 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3ac01a420 con 0x7fe3c40a8d90 2023-10-06T02:28:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.279+0000 7fe3baffd700 1 --2- 172.21.15.6:0/3395411152 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe3a4066fb0 0x7fe3a4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.279+0000 7fe3baffd700 1 -- 172.21.15.6:0/3395411152 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8872+0+0 (secure 0 0 0) 0x7fe3ac087140 con 0x7fe3c40a8d90 2023-10-06T02:28:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.280+0000 7fe3c2ffd700 1 --2- 172.21.15.6:0/3395411152 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe3a4066fb0 0x7fe3a4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.280+0000 7fe3c2ffd700 1 --2- 172.21.15.6:0/3395411152 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe3a4066fb0 0x7fe3a4069460 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00e5f0 tx=0x7fe3bc0076d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.283+0000 7fe3baffd700 1 -- 172.21.15.6:0/3395411152 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3ac0536b0 con 0x7fe3c40a8d90 2023-10-06T02:28:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:02.560+0000 7fe3c96e5700 1 -- 172.21.15.6:0/3395411152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fe3c406e5d0 con 0x7fe3c40a8d90 2023-10-06T02:28:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.134+0000 7fe3baffd700 1 -- 172.21.15.6:0/3395411152 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v271) v1 ==== 101+0+0 (secure 0 0 0) 0x7fe3ac056cd0 con 0x7fe3c40a8d90 2023-10-06T02:28:03.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.137+0000 7fe3c96e5700 1 -- 172.21.15.6:0/3395411152 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe3a4066fb0 msgr2=0x7fe3a4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.137+0000 7fe3c96e5700 1 --2- 172.21.15.6:0/3395411152 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe3a4066fb0 0x7fe3a4069460 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00e5f0 tx=0x7fe3bc0076d0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.137+0000 7fe3c96e5700 1 -- 172.21.15.6:0/3395411152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3c40a8d90 msgr2=0x7fe3c4098e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.137+0000 7fe3c96e5700 1 --2- 172.21.15.6:0/3395411152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3c40a8d90 0x7fe3c4098e30 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7fe3c406f2f0 tx=0x7fe3ac017000 comp rx=0 tx=0).stop 2023-10-06T02:28:03.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.137+0000 7fe3c96e5700 1 -- 172.21.15.6:0/3395411152 shutdown_connections 2023-10-06T02:28:03.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.137+0000 7fe3c96e5700 1 --2- 172.21.15.6:0/3395411152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3c40af570 0x7fe3c40c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.137+0000 7fe3c96e5700 1 --2- 172.21.15.6:0/3395411152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3c40a89c0 0x7fe3c409a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.137+0000 7fe3c96e5700 1 --2- 172.21.15.6:0/3395411152 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe3a4066fb0 0x7fe3a4069460 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.137+0000 7fe3c96e5700 1 --2- 172.21.15.6:0/3395411152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3c40a8d90 0x7fe3c4098e30 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.137+0000 7fe3c96e5700 1 -- 172.21.15.6:0/3395411152 >> 172.21.15.6:0/3395411152 conn(0x7fe3c4067910 msgr2=0x7fe3c40afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:03.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.137+0000 7fe3c96e5700 1 -- 172.21.15.6:0/3395411152 shutdown_connections 2023-10-06T02:28:03.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.137+0000 7fe3c96e5700 1 -- 172.21.15.6:0/3395411152 wait complete. 2023-10-06T02:28:03.139 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:28:03.152 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:28:03.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.191+0000 7f4243e9e000 1 Processor -- start 2023-10-06T02:28:03.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.192+0000 7f4243e9e000 1 -- start start 2023-10-06T02:28:03.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.192+0000 7f4243e9e000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a9c213fe30 0x55a9c21e4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.192+0000 7f4243e9e000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a9c21429e0 0x55a9c21e8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.192+0000 7f4243e9e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9c21e8f50 0x55a9c2112530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.192+0000 7f4243e9e000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9c205f980 con 0x55a9c213fe30 2023-10-06T02:28:03.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.192+0000 7f4243e9e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9c205f620 con 0x55a9c21e8f50 2023-10-06T02:28:03.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.192+0000 7f4243e9e000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9c2056400 con 0x55a9c21429e0 2023-10-06T02:28:03.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.192+0000 7f423d0d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a9c213fe30 0x55a9c21e4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.192+0000 7f423d0d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a9c213fe30 0x55a9c21e4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50504/0 (socket says 172.21.15.6:50504) 2023-10-06T02:28:03.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.192+0000 7f423d0d9700 1 -- 172.21.15.6:0/2638374225 learned_addr learned my addr 172.21.15.6:0/2638374225 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:03.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f423d0d9700 1 -- 172.21.15.6:0/2638374225 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a9c21429e0 msgr2=0x55a9c21e8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f423d0d9700 1 --2- 172.21.15.6:0/2638374225 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a9c21429e0 0x55a9c21e8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f423d0d9700 1 -- 172.21.15.6:0/2638374225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9c21e8f50 msgr2=0x55a9c2112530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f423d0d9700 1 --2- 172.21.15.6:0/2638374225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9c21e8f50 0x55a9c2112530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f423d0d9700 1 -- 172.21.15.6:0/2638374225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4234005cf0 con 0x55a9c213fe30 2023-10-06T02:28:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f423d0d9700 1 --2- 172.21.15.6:0/2638374225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a9c213fe30 0x55a9c21e4460 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f423000b3a0 tx=0x7f42300017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78280dc1baa00393 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f422f7fe700 1 -- 172.21.15.6:0/2638374225 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423000e470 con 0x55a9c213fe30 2023-10-06T02:28:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f422f7fe700 1 -- 172.21.15.6:0/2638374225 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423000e5d0 con 0x55a9c213fe30 2023-10-06T02:28:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f422f7fe700 1 -- 172.21.15.6:0/2638374225 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423000e990 con 0x55a9c213fe30 2023-10-06T02:28:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f4243e9e000 1 -- 172.21.15.6:0/2638374225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a9c213fe30 msgr2=0x55a9c21e4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f4243e9e000 1 --2- 172.21.15.6:0/2638374225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a9c213fe30 0x55a9c21e4460 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f423000b3a0 tx=0x7f42300017f0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f4243e9e000 1 -- 172.21.15.6:0/2638374225 shutdown_connections 2023-10-06T02:28:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f4243e9e000 1 --2- 172.21.15.6:0/2638374225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9c21e8f50 0x55a9c2112530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f4243e9e000 1 --2- 172.21.15.6:0/2638374225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a9c213fe30 0x55a9c21e4460 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f4243e9e000 1 --2- 172.21.15.6:0/2638374225 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a9c21429e0 0x55a9c21e8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f4243e9e000 1 -- 172.21.15.6:0/2638374225 >> 172.21.15.6:0/2638374225 conn(0x55a9c215bbd0 msgr2=0x55a9c21e4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f4243e9e000 1 -- 172.21.15.6:0/2638374225 shutdown_connections 2023-10-06T02:28:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.193+0000 7f4243e9e000 1 -- 172.21.15.6:0/2638374225 wait complete. 2023-10-06T02:28:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.194+0000 7f4243e9e000 1 Processor -- start 2023-10-06T02:28:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.194+0000 7f4243e9e000 1 -- start start 2023-10-06T02:28:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f4243e9e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9c213fe30 0x55a9c21df2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f4243e9e000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a9c21429e0 0x55a9c21ffb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f4243e9e000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a9c21e8f50 0x55a9c2112390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f4243e9e000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9c21e28c0 con 0x55a9c21429e0 2023-10-06T02:28:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f4243e9e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9c22000b0 con 0x55a9c213fe30 2023-10-06T02:28:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f4243e9e000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9c21e19a0 con 0x55a9c21e8f50 2023-10-06T02:28:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f423c8d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a9c21429e0 0x55a9c21ffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f423c8d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a9c21429e0 0x55a9c21ffb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50516/0 (socket says 172.21.15.6:50516) 2023-10-06T02:28:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 learned_addr learned my addr 172.21.15.6:0/3905336795 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f423d0d9700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9c213fe30 0x55a9c21df2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f423d8da700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a9c21e8f50 0x55a9c2112390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a9c21e8f50 msgr2=0x55a9c2112390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f423c8d8700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a9c21e8f50 0x55a9c2112390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9c213fe30 msgr2=0x55a9c21df2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f423c8d8700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9c213fe30 0x55a9c21df2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4230001ad0 con 0x55a9c21429e0 2023-10-06T02:28:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f423d8da700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a9c21e8f50 0x55a9c2112390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.195+0000 7f423c8d8700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a9c21429e0 0x55a9c21ffb70 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f423400ae40 tx=0x7f4234019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.196+0000 7f422dffb700 1 -- 172.21.15.6:0/3905336795 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234008280 con 0x55a9c21429e0 2023-10-06T02:28:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.196+0000 7f422dffb700 1 -- 172.21.15.6:0/3905336795 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42340083e0 con 0x55a9c21429e0 2023-10-06T02:28:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.196+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a9c206e3d0 con 0x55a9c21429e0 2023-10-06T02:28:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.196+0000 7f422dffb700 1 -- 172.21.15.6:0/3905336795 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234008780 con 0x55a9c21429e0 2023-10-06T02:28:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.196+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9c2061ae0 con 0x55a9c21429e0 2023-10-06T02:28:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.197+0000 7f422dffb700 1 -- 172.21.15.6:0/3905336795 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f423401c640 con 0x55a9c21429e0 2023-10-06T02:28:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.197+0000 7f422dffb700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f42200658c0 0x7f4220067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.198+0000 7f422dffb700 1 -- 172.21.15.6:0/3905336795 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8872+0+0 (secure 0 0 0) 0x7f4234084d30 con 0x55a9c21429e0 2023-10-06T02:28:03.202 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:28:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.198+0000 7f423d0d9700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f42200658c0 0x7f4220067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.198+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55a9c21ea1e0 0x55a9c21ea5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.198+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c21eaaf0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.198+0000 7f423d8da700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55a9c21ea1e0 0x55a9c21ea5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.198+0000 7f423d0d9700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f42200658c0 0x7f4220067d70 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4230001830 tx=0x7f4230014000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.198+0000 7f423d8da700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55a9c21ea1e0 0x55a9c21ea5b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.200+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v124'877 uv851 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.200+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2208310 con 0x55a9c21ea1e0 2023-10-06T02:28:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.202+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v124'878 uv878 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.202+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c22086c0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.204 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:28:03.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.203+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v124'879 uv879 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.203+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2209a80 con 0x55a9c21ea1e0 2023-10-06T02:28:03.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.205+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v124'880 uv880 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.205+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2209e30 con 0x55a9c21ea1e0 2023-10-06T02:28:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.206+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v124'881 uv881 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.206+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2208a70 con 0x55a9c21ea1e0 2023-10-06T02:28:03.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.207+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v124'882 uv882 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.207+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2208ea0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.209+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v124'883 uv857 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.209+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c22092a0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.210+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v124'884 uv884 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.210+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c22092a0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.211+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v124'885 uv885 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.212 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:28:03.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.211+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c22092a0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.213+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v124'886 uv886 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.213+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c22092a0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.214+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v124'887 uv887 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.214+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c22092a0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.215+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v124'888 uv888 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.215+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c22092a0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.216+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v124'889 uv864 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.216+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c22092a0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.218+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v124'890 uv890 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.218+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c22096d0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.219+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v124'891 uv891 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.220 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:28:03.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.219+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c22092a0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.220+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v124'892 uv892 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.220+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c22092a0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.222+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v124'893 uv893 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.222+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c22092a0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.223+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v124'894 uv894 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.223+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2209680 con 0x55a9c21ea1e0 2023-10-06T02:28:03.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.224+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v124'895 uv895 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.224+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c21128d0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.225+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v124'896 uv870 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.225+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c21128d0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.226+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v124'897 uv897 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.226+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c21128d0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.228 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:28:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.227+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v124'898 uv898 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.227+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c21128d0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.229+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v124'899 uv899 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.229+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c21128d0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.230+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v124'900 uv900 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.230+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c21128d0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.231+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v124'901 uv901 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.231+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c21128d0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.232+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v124'902 uv876 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.232+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c21128d0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.233+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v124'903 uv903 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.233+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c21128d0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.235 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:28:03.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.234+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v124'904 uv904 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.235+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c21128d0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.236+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v124'905 uv905 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.236+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c21128d0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.237+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v124'906 uv906 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.237+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c21128d0 con 0x55a9c21ea1e0 2023-10-06T02:28:03.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.238+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v124'907 uv907 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c21ea1e0 2023-10-06T02:28:03.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.238+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55a9c220a6f0 0x55a9c220cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.238+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c21128d0 con 0x55a9c220a6f0 2023-10-06T02:28:03.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.239+0000 7f423d0d9700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55a9c220a6f0 0x55a9c220cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.239+0000 7f423d0d9700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55a9c220a6f0 0x55a9c220cad0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:03.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.241+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v124'631 uv614 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.241+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220d010 con 0x55a9c220a6f0 2023-10-06T02:28:03.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.242+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v124'632 uv632 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.242+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220d3c0 con 0x55a9c220a6f0 2023-10-06T02:28:03.243 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:28:03.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.243+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v124'633 uv633 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.243+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220dc60 con 0x55a9c220a6f0 2023-10-06T02:28:03.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.244+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v124'634 uv634 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.244+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220e010 con 0x55a9c220a6f0 2023-10-06T02:28:03.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.245+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v124'635 uv635 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.245+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220e3c0 con 0x55a9c220a6f0 2023-10-06T02:28:03.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.246+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v124'636 uv619 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.246+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220e770 con 0x55a9c220a6f0 2023-10-06T02:28:03.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.248+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v124'637 uv637 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.248+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220eb20 con 0x55a9c220a6f0 2023-10-06T02:28:03.249 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:28:03.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.249+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v124'638 uv638 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.249+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220eb20 con 0x55a9c220a6f0 2023-10-06T02:28:03.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.250+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v124'639 uv639 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.250+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220eb20 con 0x55a9c220a6f0 2023-10-06T02:28:03.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.251+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v124'640 uv640 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.251+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220eb20 con 0x55a9c220a6f0 2023-10-06T02:28:03.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.252+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v124'641 uv624 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.252+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220eb20 con 0x55a9c220a6f0 2023-10-06T02:28:03.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.253+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v124'642 uv642 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.253+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220eb20 con 0x55a9c220a6f0 2023-10-06T02:28:03.255 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:28:03.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.254+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v124'643 uv643 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.254+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2212240 con 0x55a9c220a6f0 2023-10-06T02:28:03.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.256+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v124'644 uv644 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.256+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2212240 con 0x55a9c220a6f0 2023-10-06T02:28:03.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.257+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v124'645 uv645 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.257+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220eb20 con 0x55a9c220a6f0 2023-10-06T02:28:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.258+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v124'646 uv630 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.258+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220eb20 con 0x55a9c220a6f0 2023-10-06T02:28:03.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.259+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v124'647 uv647 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.259+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220eb20 con 0x55a9c220a6f0 2023-10-06T02:28:03.260 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:28:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.260+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v124'648 uv648 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.260+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220fb30 con 0x55a9c220a6f0 2023-10-06T02:28:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.261+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v124'649 uv649 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.261+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220fb30 con 0x55a9c220a6f0 2023-10-06T02:28:03.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.262+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v124'650 uv650 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.262+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c220eb20 con 0x55a9c220a6f0 2023-10-06T02:28:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.263+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v124'651 uv651 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.263+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55a9c220f030 0x55a9c2211410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.263+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2211950 con 0x55a9c220f030 2023-10-06T02:28:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.263+0000 7f423c8d8700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55a9c220f030 0x55a9c2211410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.263+0000 7f423c8d8700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55a9c220f030 0x55a9c2211410 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:03.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.264+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v124'171 uv170 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.265+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2211d00 con 0x55a9c220f030 2023-10-06T02:28:03.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.265+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v124'172 uv172 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.265+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c22120b0 con 0x55a9c220f030 2023-10-06T02:28:03.267 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:28:03.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.266+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v124'173 uv173 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.266+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2213470 con 0x55a9c220f030 2023-10-06T02:28:03.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.267+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v124'174 uv174 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.267+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2213820 con 0x55a9c220f030 2023-10-06T02:28:03.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.268+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v124'175 uv175 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.268+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2212460 con 0x55a9c220f030 2023-10-06T02:28:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.269+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v124'176 uv176 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.269+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2212860 con 0x55a9c220f030 2023-10-06T02:28:03.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.270+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v124'121 uv120 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.270+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2212c60 con 0x55a9c220f030 2023-10-06T02:28:03.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.271+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v124'122 uv122 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.271+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2212c60 con 0x55a9c220f030 2023-10-06T02:28:03.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.273+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v124'123 uv123 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.274 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:28:03.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.273+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c22130b0 con 0x55a9c220f030 2023-10-06T02:28:03.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.274+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v124'124 uv124 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.274+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2213bd0 con 0x55a9c220a6f0 2023-10-06T02:28:03.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.275+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v124'171 uv170 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.275+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2213bd0 con 0x55a9c220a6f0 2023-10-06T02:28:03.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.276+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v124'172 uv172 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.276+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2213bd0 con 0x55a9c220a6f0 2023-10-06T02:28:03.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.277+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v124'173 uv173 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.278 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:28:03.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.277+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2214be0 con 0x55a9c220a6f0 2023-10-06T02:28:03.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.278+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v124'174 uv174 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.278+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2214be0 con 0x55a9c220a6f0 2023-10-06T02:28:03.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.279+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v124'175 uv175 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.279+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2213bd0 con 0x55a9c220a6f0 2023-10-06T02:28:03.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.280+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v124'176 uv176 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c220a6f0 2023-10-06T02:28:03.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.280+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55a9c22140e0 0x55a9c22164c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.280+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2216a00 con 0x55a9c22140e0 2023-10-06T02:28:03.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.280+0000 7f423d8da700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55a9c22140e0 0x55a9c22164c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.280+0000 7f423d8da700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55a9c22140e0 0x55a9c22164c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:03.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.281+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v124'316 uv310 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c22140e0 2023-10-06T02:28:03.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.282+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2216a40 con 0x55a9c22140e0 2023-10-06T02:28:03.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.283+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v124'317 uv317 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c22140e0 2023-10-06T02:28:03.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.283+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2216a40 con 0x55a9c22140e0 2023-10-06T02:28:03.284 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:28:03.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.284+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v124'318 uv318 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c22140e0 2023-10-06T02:28:03.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.284+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2217ed0 con 0x55a9c22140e0 2023-10-06T02:28:03.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.285+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v124'319 uv319 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c22140e0 2023-10-06T02:28:03.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.285+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2217ed0 con 0x55a9c22140e0 2023-10-06T02:28:03.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.286+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v124'320 uv320 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c22140e0 2023-10-06T02:28:03.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.286+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2216ec0 con 0x55a9c22140e0 2023-10-06T02:28:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.287+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v124'321 uv321 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c22140e0 2023-10-06T02:28:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.287+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2216ec0 con 0x55a9c22140e0 2023-10-06T02:28:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.288+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v124'322 uv315 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c22140e0 2023-10-06T02:28:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.288+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2216ec0 con 0x55a9c22140e0 2023-10-06T02:28:03.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.290+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v124'323 uv323 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c22140e0 2023-10-06T02:28:03.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.290+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2216ec0 con 0x55a9c22140e0 2023-10-06T02:28:03.291 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:28:03.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.291+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v124'324 uv324 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c22140e0 2023-10-06T02:28:03.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.291+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2216ec0 con 0x55a9c22140e0 2023-10-06T02:28:03.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.292+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v124'325 uv325 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c22140e0 2023-10-06T02:28:03.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.292+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2216ec0 con 0x55a9c22140e0 2023-10-06T02:28:03.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.293+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v124'326 uv326 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c22140e0 2023-10-06T02:28:03.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.293+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55a9c22173d0 0x55a9c22197b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.293+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2219eb0 con 0x55a9c22173d0 2023-10-06T02:28:03.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.294+0000 7f423d0d9700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55a9c22173d0 0x55a9c22197b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.295+0000 7f423d0d9700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55a9c22173d0 0x55a9c22197b0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:03.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.296+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v124'143 uv142 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c22173d0 2023-10-06T02:28:03.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.296+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2219eb0 con 0x55a9c22173d0 2023-10-06T02:28:03.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.297+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v124'144 uv144 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c22173d0 2023-10-06T02:28:03.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.297+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221a2e0 con 0x55a9c22173d0 2023-10-06T02:28:03.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.300+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v124'145 uv145 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c22173d0 2023-10-06T02:28:03.300 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:28:03.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.300+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221a2b0 con 0x55a9c22173d0 2023-10-06T02:28:03.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.303+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v124'146 uv146 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c22173d0 2023-10-06T02:28:03.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.303+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221a2b0 con 0x55a9c22173d0 2023-10-06T02:28:03.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.304+0000 7f423d0d9700 1 -- 172.21.15.6:0/3905336795 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v124'147 uv147 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4230022070 con 0x55a9c22173d0 2023-10-06T02:28:03.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.304+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221a2b0 con 0x55a9c220f030 2023-10-06T02:28:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.305+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v124'171 uv170 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.305+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221a2b0 con 0x55a9c220f030 2023-10-06T02:28:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.306+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v124'172 uv172 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.306+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221a2b0 con 0x55a9c220f030 2023-10-06T02:28:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.307+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v124'173 uv173 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.307 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:28:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.307+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221b2c0 con 0x55a9c220f030 2023-10-06T02:28:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.308+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v124'174 uv174 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.308+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221b2c0 con 0x55a9c220f030 2023-10-06T02:28:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.308+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v124'175 uv175 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.308+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221a2b0 con 0x55a9c220f030 2023-10-06T02:28:03.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.309+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v124'176 uv176 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.309+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55a9c221a930 0x55a9c221cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.309+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221d2f0 con 0x55a9c221a930 2023-10-06T02:28:03.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.310+0000 7f423c8d8700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55a9c221a930 0x55a9c221cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.310+0000 7f423c8d8700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55a9c221a930 0x55a9c221cd10 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:03.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.311+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v124'284 uv283 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c221a930 2023-10-06T02:28:03.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.311+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221d3d0 con 0x55a9c221a930 2023-10-06T02:28:03.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.312+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v124'285 uv285 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c221a930 2023-10-06T02:28:03.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.312+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221d800 con 0x55a9c221a930 2023-10-06T02:28:03.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.314+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v124'286 uv286 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c221a930 2023-10-06T02:28:03.314 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:28:03.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.314+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221d800 con 0x55a9c221a930 2023-10-06T02:28:03.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.315+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v124'287 uv287 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c221a930 2023-10-06T02:28:03.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.315+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221d800 con 0x55a9c221a930 2023-10-06T02:28:03.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.316+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v124'288 uv288 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c221a930 2023-10-06T02:28:03.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.316+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221d800 con 0x55a9c221a930 2023-10-06T02:28:03.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.317+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v124'289 uv282 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c221a930 2023-10-06T02:28:03.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.317+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221d800 con 0x55a9c221a930 2023-10-06T02:28:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.318+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v124'290 uv290 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c221a930 2023-10-06T02:28:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.318+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221d800 con 0x55a9c221a930 2023-10-06T02:28:03.319 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:28:03.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.319+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v124'291 uv291 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c221a930 2023-10-06T02:28:03.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.319+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221d800 con 0x55a9c221a930 2023-10-06T02:28:03.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.320+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v124'292 uv292 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c221a930 2023-10-06T02:28:03.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.320+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2220570 con 0x55a9c221a930 2023-10-06T02:28:03.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.321+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v124'293 uv293 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c221a930 2023-10-06T02:28:03.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.321+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c220f030 2023-10-06T02:28:03.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.322+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v124'124 uv123 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.322+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c220f030 2023-10-06T02:28:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.323+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v124'125 uv125 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.323+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c220f030 2023-10-06T02:28:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.324+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v124'126 uv126 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.325 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:28:03.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.324+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c220f030 2023-10-06T02:28:03.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.325+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v124'127 uv127 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.325+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55a9c221e620 0x55a9c2220cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.325+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c221e620 2023-10-06T02:28:03.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.325+0000 7f423d8da700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55a9c221e620 0x55a9c2220cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.326+0000 7f423d8da700 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55a9c221e620 0x55a9c2220cc0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:03.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.327+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v124'171 uv170 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c221e620 2023-10-06T02:28:03.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.327+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c221e620 2023-10-06T02:28:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.328+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v124'172 uv172 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c221e620 2023-10-06T02:28:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.328+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c221e620 2023-10-06T02:28:03.329 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:28:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.329+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v124'173 uv173 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c221e620 2023-10-06T02:28:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.329+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c221e620 2023-10-06T02:28:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.330+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v124'174 uv174 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c221e620 2023-10-06T02:28:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.330+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c221e620 2023-10-06T02:28:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.331+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v124'175 uv175 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c221e620 2023-10-06T02:28:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.331+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c221e620 2023-10-06T02:28:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.333+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v124'176 uv176 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c221e620 2023-10-06T02:28:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.333+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c22140e0 2023-10-06T02:28:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.334+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v124'145 uv144 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c22140e0 2023-10-06T02:28:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.334+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c22140e0 2023-10-06T02:28:03.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.335+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v124'146 uv146 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c22140e0 2023-10-06T02:28:03.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.335+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c22140e0 2023-10-06T02:28:03.336 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:28:03.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.336+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v124'147 uv147 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c22140e0 2023-10-06T02:28:03.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.336+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c22140e0 2023-10-06T02:28:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.337+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v124'148 uv148 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c22140e0 2023-10-06T02:28:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.337+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c22140e0 2023-10-06T02:28:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.338+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v124'149 uv149 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f423800c830 con 0x55a9c22140e0 2023-10-06T02:28:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.338+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c220f030 2023-10-06T02:28:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.339+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v124'351 uv343 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.339+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c220f030 2023-10-06T02:28:03.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.340+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v124'352 uv352 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.340+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c220f030 2023-10-06T02:28:03.341 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:28:03.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.341+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v124'353 uv353 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.341+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c220f030 2023-10-06T02:28:03.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.342+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v124'354 uv354 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.342+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c220f030 2023-10-06T02:28:03.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.343+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v124'355 uv355 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.343+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c220f030 2023-10-06T02:28:03.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.344+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v124'356 uv350 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.344+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c220f030 2023-10-06T02:28:03.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.345+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v124'357 uv357 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.345+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c220f030 2023-10-06T02:28:03.346 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:28:03.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.346+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v124'358 uv358 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.346+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c220f030 2023-10-06T02:28:03.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.347+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v124'359 uv359 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.347+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c220f030 2023-10-06T02:28:03.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.348+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v124'360 uv360 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.348+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c221dcf0 con 0x55a9c220f030 2023-10-06T02:28:03.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.349+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v124'361 uv361 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.349+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x55a9c2221200 con 0x55a9c220f030 2023-10-06T02:28:03.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f423c8d8700 1 -- 172.21.15.6:0/3905336795 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v124'362 uv362 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f4234022020 con 0x55a9c220f030 2023-10-06T02:28:03.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55a9c220f030 msgr2=0x55a9c2211410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55a9c220f030 0x55a9c2211410 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55a9c21ea1e0 msgr2=0x55a9c21ea5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55a9c21ea1e0 0x55a9c21ea5b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55a9c221a930 msgr2=0x55a9c221cd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55a9c221a930 0x55a9c221cd10 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55a9c220a6f0 msgr2=0x55a9c220cad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55a9c220a6f0 0x55a9c220cad0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55a9c221e620 msgr2=0x55a9c2220cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55a9c221e620 0x55a9c2220cc0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55a9c22173d0 msgr2=0x55a9c22197b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55a9c22173d0 0x55a9c22197b0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 reap_dead start 2023-10-06T02:28:03.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f423d8da700 1 -- 172.21.15.6:0/3905336795 reap_dead start 2023-10-06T02:28:03.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55a9c22140e0 msgr2=0x55a9c22164c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55a9c22140e0 0x55a9c22164c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.350+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f42200658c0 msgr2=0x7f4220067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.351+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f42200658c0 0x7f4220067d70 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4230001830 tx=0x7f4230014000 comp rx=0 tx=0).stop 2023-10-06T02:28:03.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.351+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a9c21429e0 msgr2=0x55a9c21ffb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.351+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a9c21429e0 0x55a9c21ffb70 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f423400ae40 tx=0x7f4234019000 comp rx=0 tx=0).stop 2023-10-06T02:28:03.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.351+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 shutdown_connections 2023-10-06T02:28:03.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.351+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a9c21429e0 0x55a9c21ffb70 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.351+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f42200658c0 0x7f4220067d70 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.351+0000 7f4243e9e000 1 --2- 172.21.15.6:0/3905336795 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55a9c22140e0 0x55a9c22164c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.351+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 >> 172.21.15.6:0/3905336795 conn(0x55a9c215bbd0 msgr2=0x55a9c21e2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:03.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.351+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 shutdown_connections 2023-10-06T02:28:03.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.351+0000 7f4243e9e000 1 -- 172.21.15.6:0/3905336795 wait complete. 2023-10-06T02:28:03.355 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 400.00000000 0 2023-10-06T02:28:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.433+0000 7f297b582000 1 Processor -- start 2023-10-06T02:28:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.433+0000 7f297b582000 1 -- start start 2023-10-06T02:28:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f297b582000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1575fe30 0x562c158034c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f297b582000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562c157629e0 0x562c1577da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f297b582000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c15808f50 0x562c15807fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f297b582000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c1567f980 con 0x562c15808f50 2023-10-06T02:28:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f297b582000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c1567f620 con 0x562c1575fe30 2023-10-06T02:28:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f297b582000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x562c15676400 con 0x562c157629e0 2023-10-06T02:28:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f2974fbe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c15808f50 0x562c15807fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f2974fbe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c15808f50 0x562c15807fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50538/0 (socket says 172.21.15.6:50538) 2023-10-06T02:28:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f2974fbe700 1 -- 172.21.15.6:0/805356349 learned_addr learned my addr 172.21.15.6:0/805356349 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f29747bd700 1 --2- 172.21.15.6:0/805356349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1575fe30 0x562c158034c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f2973fbc700 1 --2- 172.21.15.6:0/805356349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562c157629e0 0x562c1577da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f2974fbe700 1 -- 172.21.15.6:0/805356349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562c157629e0 msgr2=0x562c1577da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f2974fbe700 1 --2- 172.21.15.6:0/805356349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562c157629e0 0x562c1577da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f2974fbe700 1 -- 172.21.15.6:0/805356349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1575fe30 msgr2=0x562c158034c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f2974fbe700 1 --2- 172.21.15.6:0/805356349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1575fe30 0x562c158034c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f2974fbe700 1 -- 172.21.15.6:0/805356349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296400a180 con 0x562c15808f50 2023-10-06T02:28:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f2973fbc700 1 --2- 172.21.15.6:0/805356349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562c157629e0 0x562c1577da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.434+0000 7f2974fbe700 1 --2- 172.21.15.6:0/805356349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c15808f50 0x562c15807fc0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f296400ad60 tx=0x7f2964011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79cd29d4b1b7dbc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.435+0000 7f2972fba700 1 -- 172.21.15.6:0/805356349 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296400ee70 con 0x562c15808f50 2023-10-06T02:28:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.435+0000 7f2972fba700 1 -- 172.21.15.6:0/805356349 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2964005710 con 0x562c15808f50 2023-10-06T02:28:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.435+0000 7f2972fba700 1 -- 172.21.15.6:0/805356349 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296400e7e0 con 0x562c15808f50 2023-10-06T02:28:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.435+0000 7f297b582000 1 -- 172.21.15.6:0/805356349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c15808f50 msgr2=0x562c15807fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.435+0000 7f297b582000 1 --2- 172.21.15.6:0/805356349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c15808f50 0x562c15807fc0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f296400ad60 tx=0x7f2964011000 comp rx=0 tx=0).stop 2023-10-06T02:28:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.435+0000 7f297b582000 1 -- 172.21.15.6:0/805356349 shutdown_connections 2023-10-06T02:28:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.435+0000 7f297b582000 1 --2- 172.21.15.6:0/805356349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c15808f50 0x562c15807fc0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.435+0000 7f297b582000 1 --2- 172.21.15.6:0/805356349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1575fe30 0x562c158034c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.435+0000 7f297b582000 1 --2- 172.21.15.6:0/805356349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562c157629e0 0x562c1577da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.435+0000 7f297b582000 1 -- 172.21.15.6:0/805356349 >> 172.21.15.6:0/805356349 conn(0x562c1577bbd0 msgr2=0x562c158072e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.435+0000 7f297b582000 1 -- 172.21.15.6:0/805356349 shutdown_connections 2023-10-06T02:28:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.435+0000 7f297b582000 1 -- 172.21.15.6:0/805356349 wait complete. 2023-10-06T02:28:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.436+0000 7f297b582000 1 Processor -- start 2023-10-06T02:28:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.436+0000 7f297b582000 1 -- start start 2023-10-06T02:28:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.436+0000 7f297b582000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562c1575fe30 0x562c158075f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.436+0000 7f297b582000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c157629e0 0x562c157608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.436+0000 7f297b582000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c15808f50 0x562c15779000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.436+0000 7f297b582000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c15803750 con 0x562c157629e0 2023-10-06T02:28:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.436+0000 7f297b582000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c15803210 con 0x562c15808f50 2023-10-06T02:28:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.436+0000 7f297b582000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x562c158034b0 con 0x562c1575fe30 2023-10-06T02:28:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.436+0000 7f2973fbc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c157629e0 0x562c157608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.436+0000 7f2973fbc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c157629e0 0x562c157608e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50550/0 (socket says 172.21.15.6:50550) 2023-10-06T02:28:03.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.436+0000 7f2973fbc700 1 -- 172.21.15.6:0/25570960 learned_addr learned my addr 172.21.15.6:0/25570960 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:03.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.436+0000 7f29747bd700 1 --2- 172.21.15.6:0/25570960 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562c1575fe30 0x562c158075f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.437+0000 7f2974fbe700 1 --2- 172.21.15.6:0/25570960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c15808f50 0x562c15779000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.437+0000 7f2973fbc700 1 -- 172.21.15.6:0/25570960 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562c1575fe30 msgr2=0x562c158075f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.437+0000 7f2973fbc700 1 --2- 172.21.15.6:0/25570960 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562c1575fe30 0x562c158075f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.437+0000 7f2973fbc700 1 -- 172.21.15.6:0/25570960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c15808f50 msgr2=0x562c15779000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.437+0000 7f2973fbc700 1 --2- 172.21.15.6:0/25570960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c15808f50 0x562c15779000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.437+0000 7f2973fbc700 1 -- 172.21.15.6:0/25570960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c156a81c0 con 0x562c157629e0 2023-10-06T02:28:03.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.437+0000 7f2973fbc700 1 --2- 172.21.15.6:0/25570960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c157629e0 0x562c157608e0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f295c008810 tx=0x7f295c005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:03.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.437+0000 7f29717b7700 1 -- 172.21.15.6:0/25570960 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c00f070 con 0x562c157629e0 2023-10-06T02:28:03.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.437+0000 7f29717b7700 1 -- 172.21.15.6:0/25570960 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c006750 con 0x562c157629e0 2023-10-06T02:28:03.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.437+0000 7f29717b7700 1 -- 172.21.15.6:0/25570960 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c006b10 con 0x562c157629e0 2023-10-06T02:28:03.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.437+0000 7f297b582000 1 -- 172.21.15.6:0/25570960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c1568e3d0 con 0x562c157629e0 2023-10-06T02:28:03.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.437+0000 7f297b582000 1 -- 172.21.15.6:0/25570960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c15681ae0 con 0x562c157629e0 2023-10-06T02:28:03.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.438+0000 7f29717b7700 1 -- 172.21.15.6:0/25570960 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f295c013410 con 0x562c157629e0 2023-10-06T02:28:03.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.439+0000 7f29717b7700 1 --2- 172.21.15.6:0/25570960 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f29540658c0 0x7f2954067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.439+0000 7f29717b7700 1 -- 172.21.15.6:0/25570960 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8872+0+0 (secure 0 0 0) 0x7f295c083870 con 0x562c157629e0 2023-10-06T02:28:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.439+0000 7f29747bd700 1 --2- 172.21.15.6:0/25570960 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f29540658c0 0x7f2954067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.439+0000 7f297b582000 1 --2- 172.21.15.6:0/25570960 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x562c15760e20 0x562c1581cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.439+0000 7f297b582000 1 -- 172.21.15.6:0/25570960 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v8 -- 0x562c157623f0 con 0x562c15760e20 2023-10-06T02:28:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.439+0000 7f2974fbe700 1 --2- 172.21.15.6:0/25570960 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x562c15760e20 0x562c1581cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.439+0000 7f29747bd700 1 --2- 172.21.15.6:0/25570960 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f29540658c0 0x7f2954067d70 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f296c000c00 tx=0x7f296c001810 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.440+0000 7f2974fbe700 1 --2- 172.21.15.6:0/25570960 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x562c15760e20 0x562c1581cdf0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.441+0000 7f2974fbe700 1 -- 172.21.15.6:0/25570960 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(1 400.00000000 [truncate 0] v124'150 uv150 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f296400e300 con 0x562c15760e20 2023-10-06T02:28:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.441+0000 7f297b582000 1 -- 172.21.15.6:0/25570960 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x562c15760e20 msgr2=0x562c1581cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.441+0000 7f297b582000 1 --2- 172.21.15.6:0/25570960 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x562c15760e20 0x562c1581cdf0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.441+0000 7f297b582000 1 -- 172.21.15.6:0/25570960 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f29540658c0 msgr2=0x7f2954067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.441+0000 7f297b582000 1 --2- 172.21.15.6:0/25570960 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f29540658c0 0x7f2954067d70 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f296c000c00 tx=0x7f296c001810 comp rx=0 tx=0).stop 2023-10-06T02:28:03.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.441+0000 7f297b582000 1 -- 172.21.15.6:0/25570960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c157629e0 msgr2=0x562c157608e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.441+0000 7f297b582000 1 --2- 172.21.15.6:0/25570960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c157629e0 0x562c157608e0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f295c008810 tx=0x7f295c005c70 comp rx=0 tx=0).stop 2023-10-06T02:28:03.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.441+0000 7f2974fbe700 1 -- 172.21.15.6:0/25570960 reap_dead start 2023-10-06T02:28:03.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.441+0000 7f297b582000 1 -- 172.21.15.6:0/25570960 shutdown_connections 2023-10-06T02:28:03.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.441+0000 7f297b582000 1 -- 172.21.15.6:0/25570960 >> 172.21.15.6:0/25570960 conn(0x562c1577bbd0 msgr2=0x562c1577bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:03.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.441+0000 7f297b582000 1 -- 172.21.15.6:0/25570960 shutdown_connections 2023-10-06T02:28:03.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.441+0000 7f297b582000 1 -- 172.21.15.6:0/25570960 wait complete. 2023-10-06T02:28:03.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:28:03.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.608+0000 7f02718ca700 1 Processor -- start 2023-10-06T02:28:03.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.608+0000 7f02718ca700 1 -- start start 2023-10-06T02:28:03.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.609+0000 7f02718ca700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f026c069d80 0x7f026c06a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.609+0000 7f02718ca700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f026c0cdd60 0x7f026c0ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.609+0000 7f02718ca700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026c06a730 con 0x7f026c0cf7d0 2023-10-06T02:28:03.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.609+0000 7f02718ca700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026c159c10 con 0x7f026c069d80 2023-10-06T02:28:03.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.609+0000 7f02718ca700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c15abd0 con 0x7f026c0cdd60 2023-10-06T02:28:03.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.609+0000 7f026a7fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f026c069d80 0x7f026c06a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.609+0000 7f026b7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f026c0cdd60 0x7f026c0ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.609+0000 7f026affd700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f026c0cf7d0 0x7f026c0cb1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:58012/0 (socket says 172.21.15.6:58012) 2023-10-06T02:28:03.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.609+0000 7f026affd700 1 -- 172.21.15.6:0/2333499138 learned_addr learned my addr 172.21.15.6:0/2333499138 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:03.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.610+0000 7f026a7fc700 1 -- 172.21.15.6:0/2333499138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f026c0cdd60 msgr2=0x7f026c0ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:03.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.610+0000 7f026a7fc700 1 --2- 172.21.15.6:0/2333499138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f026c0cdd60 0x7f026c0ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.610+0000 7f026a7fc700 1 -- 172.21.15.6:0/2333499138 >> v1:172.21.15.175:6789/0 conn(0x7f026c0cf7d0 legacy=0x7f026c0cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.610+0000 7f026a7fc700 1 -- 172.21.15.6:0/2333499138 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c0cbb80 con 0x7f026c069d80 2023-10-06T02:28:03.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.610+0000 7f026b7fe700 1 --2- 172.21.15.6:0/2333499138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f026c0cdd60 0x7f026c0ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:03.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.610+0000 7f0269ffb700 1 -- 172.21.15.6:0/2333499138 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268979898 0 0) 0x7f026c06a730 con 0x7f026c0cf7d0 2023-10-06T02:28:03.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.610+0000 7f026a7fc700 1 --2- 172.21.15.6:0/2333499138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f026c069d80 0x7f026c06a1f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f02540098e0 tx=0x7f02540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c80672231e63f6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:03.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.610+0000 7f0269ffb700 1 -- 172.21.15.6:0/2333499138 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025400b640 con 0x7f026c069d80 2023-10-06T02:28:03.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.610+0000 7f0269ffb700 1 -- 172.21.15.6:0/2333499138 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025400b7a0 con 0x7f026c069d80 2023-10-06T02:28:03.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.610+0000 7f0269ffb700 1 -- 172.21.15.6:0/2333499138 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025400bb40 con 0x7f026c069d80 2023-10-06T02:28:03.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.611+0000 7f02718ca700 1 -- 172.21.15.6:0/2333499138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f026c069d80 msgr2=0x7f026c06a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.611+0000 7f02718ca700 1 --2- 172.21.15.6:0/2333499138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f026c069d80 0x7f026c06a1f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f02540098e0 tx=0x7f02540091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.611+0000 7f02718ca700 1 -- 172.21.15.6:0/2333499138 shutdown_connections 2023-10-06T02:28:03.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.611+0000 7f02718ca700 1 --2- 172.21.15.6:0/2333499138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f026c0cdd60 0x7f026c0ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.611+0000 7f02718ca700 1 --2- 172.21.15.6:0/2333499138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f026c069d80 0x7f026c06a1f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.611+0000 7f02718ca700 1 -- 172.21.15.6:0/2333499138 >> 172.21.15.6:0/2333499138 conn(0x7f026c0d0c60 msgr2=0x7f026c0ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:03.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.611+0000 7f02718ca700 1 -- 172.21.15.6:0/2333499138 shutdown_connections 2023-10-06T02:28:03.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.611+0000 7f02718ca700 1 -- 172.21.15.6:0/2333499138 wait complete. 2023-10-06T02:28:03.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.612+0000 7f02718ca700 1 Processor -- start 2023-10-06T02:28:03.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.612+0000 7f02718ca700 1 -- start start 2023-10-06T02:28:03.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f02718ca700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f026c069d80 0x7f026c148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f02718ca700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f026c0cdd60 0x7f026c15c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f02718ca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f026c0cf7d0 0x7f026c15ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f02718ca700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c15bc50 con 0x7f026c0cf7d0 2023-10-06T02:28:03.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f02718ca700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c15ada0 con 0x7f026c069d80 2023-10-06T02:28:03.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f02718ca700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c15b040 con 0x7f026c0cdd60 2023-10-06T02:28:03.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f026affd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f026c069d80 0x7f026c148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f026a7fc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f026c0cdd60 0x7f026c15c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f026b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f026c0cf7d0 0x7f026c15ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f026affd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f026c069d80 0x7f026c148df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:49124/0 (socket says 172.21.15.6:49124) 2023-10-06T02:28:03.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f026affd700 1 -- 172.21.15.6:0/3171168430 learned_addr learned my addr 172.21.15.6:0/3171168430 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:03.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f026a7fc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f026c0cdd60 0x7f026c15c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:60290/0 (socket says 172.21.15.6:60290) 2023-10-06T02:28:03.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f026a7fc700 1 -- 172.21.15.6:0/3171168430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f026c069d80 msgr2=0x7f026c148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f026a7fc700 1 --2- 172.21.15.6:0/3171168430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f026c069d80 0x7f026c148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f026a7fc700 1 -- 172.21.15.6:0/3171168430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f026c0cf7d0 msgr2=0x7f026c15ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:03.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f026a7fc700 1 --2- 172.21.15.6:0/3171168430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f026c0cf7d0 0x7f026c15ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:03.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f026a7fc700 1 -- 172.21.15.6:0/3171168430 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c009a20 con 0x7f026c0cdd60 2023-10-06T02:28:03.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f026a7fc700 1 --2- 172.21.15.6:0/3171168430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f026c0cdd60 0x7f026c15c970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0254016000 tx=0x7f0254017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:03.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.613+0000 7f0262ffd700 1 -- 172.21.15.6:0/3171168430 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254000d10 con 0x7f026c0cdd60 2023-10-06T02:28:03.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.614+0000 7f0262ffd700 1 -- 172.21.15.6:0/3171168430 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025400bb20 con 0x7f026c0cdd60 2023-10-06T02:28:03.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.614+0000 7f02718ca700 1 -- 172.21.15.6:0/3171168430 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0254009420 con 0x7f026c0cdd60 2023-10-06T02:28:03.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.614+0000 7f0262ffd700 1 -- 172.21.15.6:0/3171168430 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254011670 con 0x7f026c0cdd60 2023-10-06T02:28:03.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.614+0000 7f02718ca700 1 -- 172.21.15.6:0/3171168430 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026c15b600 con 0x7f026c0cdd60 2023-10-06T02:28:03.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.614+0000 7f02718ca700 1 -- 172.21.15.6:0/3171168430 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026c04bb80 con 0x7f026c0cdd60 2023-10-06T02:28:03.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.615+0000 7f0262ffd700 1 -- 172.21.15.6:0/3171168430 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0254011a20 con 0x7f026c0cdd60 2023-10-06T02:28:03.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.615+0000 7f0262ffd700 1 --2- 172.21.15.6:0/3171168430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f024c066f30 0x7f024c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:03.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.615+0000 7f0262ffd700 1 -- 172.21.15.6:0/3171168430 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8872+0+0 (secure 0 0 0) 0x7f0254086610 con 0x7f026c0cdd60 2023-10-06T02:28:03.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.615+0000 7f026affd700 1 --2- 172.21.15.6:0/3171168430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f024c066f30 0x7f024c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:03.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.616+0000 7f026affd700 1 --2- 172.21.15.6:0/3171168430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f024c066f30 0x7f024c0693e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0264007fd0 tx=0x7f0264007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:03.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.620+0000 7f0262ffd700 1 -- 172.21.15.6:0/3171168430 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0254052c40 con 0x7f026c0cdd60 2023-10-06T02:28:03.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:03.861+0000 7f02718ca700 1 -- 172.21.15.6:0/3171168430 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f026c064f20 con 0x7f026c0cdd60 2023-10-06T02:28:04.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.147+0000 7f0262ffd700 1 -- 172.21.15.6:0/3171168430 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v272) v1 ==== 162+0+0 (secure 0 0 0) 0x7f02540150b0 con 0x7f026c0cdd60 2023-10-06T02:28:04.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.149+0000 7f02718ca700 1 -- 172.21.15.6:0/3171168430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f024c066f30 msgr2=0x7f024c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:04.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.149+0000 7f02718ca700 1 --2- 172.21.15.6:0/3171168430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f024c066f30 0x7f024c0693e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0264007fd0 tx=0x7f0264007df0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.149+0000 7f02718ca700 1 -- 172.21.15.6:0/3171168430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f026c0cdd60 msgr2=0x7f026c15c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:04.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.149+0000 7f02718ca700 1 --2- 172.21.15.6:0/3171168430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f026c0cdd60 0x7f026c15c970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0254016000 tx=0x7f0254017000 comp rx=0 tx=0).stop 2023-10-06T02:28:04.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.149+0000 7f02718ca700 1 -- 172.21.15.6:0/3171168430 shutdown_connections 2023-10-06T02:28:04.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.149+0000 7f02718ca700 1 --2- 172.21.15.6:0/3171168430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f024c066f30 0x7f024c0693e0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.149+0000 7f02718ca700 1 --2- 172.21.15.6:0/3171168430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f026c0cf7d0 0x7f026c15ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.149+0000 7f02718ca700 1 --2- 172.21.15.6:0/3171168430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f026c069d80 0x7f026c148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.149+0000 7f02718ca700 1 --2- 172.21.15.6:0/3171168430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f026c0cdd60 0x7f026c15c970 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.149+0000 7f02718ca700 1 -- 172.21.15.6:0/3171168430 >> 172.21.15.6:0/3171168430 conn(0x7f026c0d0c60 msgr2=0x7f026c0b04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.149+0000 7f02718ca700 1 -- 172.21.15.6:0/3171168430 shutdown_connections 2023-10-06T02:28:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.149+0000 7f02718ca700 1 -- 172.21.15.6:0/3171168430 wait complete. 2023-10-06T02:28:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:28:04.154 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:28:04.153+0000 7f79e4685700 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -22 ((22) Invalid argument) 2023-10-06T02:28:04.154 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:28:04.154+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:28:04.155 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:28:04.154+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:28:04.160 INFO:tasks.ceph.mds.a.smithi006.stderr: -28> 2023-10-06T02:28:04.153+0000 7f79e4685700 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -22 ((22) Invalid argument) 2023-10-06T02:28:04.167 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:04.184 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:28:04.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.288+0000 7f1969d34700 1 Processor -- start 2023-10-06T02:28:04.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.288+0000 7f1969d34700 1 -- start start 2023-10-06T02:28:04.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.289+0000 7f1969d34700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1964159150 0x7f196415de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:04.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.289+0000 7f1969d34700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f19640cccf0 0x7f19640b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:04.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.289+0000 7f1969d34700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19640afbc0 con 0x7f19640b08f0 2023-10-06T02:28:04.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.289+0000 7f1969d34700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19640cd620 con 0x7f19640cccf0 2023-10-06T02:28:04.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.289+0000 7f1969d34700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19640afe10 con 0x7f1964159150 2023-10-06T02:28:04.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.289+0000 7f1962ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f19640b08f0 0x7f1964159520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47310/0 (socket says 172.21.15.6:47310) 2023-10-06T02:28:04.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.289+0000 7f1962ffd700 1 -- 172.21.15.6:0/1717694515 learned_addr learned my addr 172.21.15.6:0/1717694515 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:04.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.289+0000 7f1963fff700 1 --2- 172.21.15.6:0/1717694515 >> v2:172.21.15.175:3300/0 conn(0x7f19640cccf0 0x7f19640b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:04.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.289+0000 7f19637fe700 1 --2- 172.21.15.6:0/1717694515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1964159150 0x7f196415de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:04.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.290+0000 7f19627fc700 1 -- 172.21.15.6:0/1717694515 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617449337 0 0) 0x7f19640afbc0 con 0x7f19640b08f0 2023-10-06T02:28:04.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.290+0000 7f19627fc700 1 -- 172.21.15.6:0/1717694515 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f194c003570 con 0x7f19640b08f0 2023-10-06T02:28:04.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.290+0000 7f1963fff700 1 -- 172.21.15.6:0/1717694515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1964159150 msgr2=0x7f196415de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:04.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.290+0000 7f1963fff700 1 --2- 172.21.15.6:0/1717694515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1964159150 0x7f196415de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.290+0000 7f1963fff700 1 -- 172.21.15.6:0/1717694515 >> v1:172.21.15.6:6789/0 conn(0x7f19640b08f0 legacy=0x7f1964159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:04.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.290+0000 7f1963fff700 1 -- 172.21.15.6:0/1717694515 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19640b00f0 con 0x7f19640cccf0 2023-10-06T02:28:04.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.290+0000 7f19637fe700 1 --2- 172.21.15.6:0/1717694515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1964159150 0x7f196415de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:04.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.290+0000 7f1963fff700 1 --2- 172.21.15.6:0/1717694515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19640cccf0 0x7f19640b20a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f195c009e60 tx=0x7f195c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6f0c443560a716 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:04.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.290+0000 7f19627fc700 1 -- 172.21.15.6:0/1717694515 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c00e070 con 0x7f19640cccf0 2023-10-06T02:28:04.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.290+0000 7f19627fc700 1 -- 172.21.15.6:0/1717694515 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195c00bab0 con 0x7f19640cccf0 2023-10-06T02:28:04.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.290+0000 7f19627fc700 1 -- 172.21.15.6:0/1717694515 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c00be70 con 0x7f19640cccf0 2023-10-06T02:28:04.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.291+0000 7f1969d34700 1 -- 172.21.15.6:0/1717694515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19640cccf0 msgr2=0x7f19640b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.291+0000 7f1969d34700 1 --2- 172.21.15.6:0/1717694515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19640cccf0 0x7f19640b20a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f195c009e60 tx=0x7f195c009780 comp rx=0 tx=0).stop 2023-10-06T02:28:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.291+0000 7f1969d34700 1 -- 172.21.15.6:0/1717694515 shutdown_connections 2023-10-06T02:28:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.291+0000 7f1969d34700 1 --2- 172.21.15.6:0/1717694515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19640cccf0 0x7f19640b20a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.291+0000 7f1969d34700 1 --2- 172.21.15.6:0/1717694515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1964159150 0x7f196415de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.291+0000 7f1969d34700 1 -- 172.21.15.6:0/1717694515 >> 172.21.15.6:0/1717694515 conn(0x7f1964068680 msgr2=0x7f1964068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.291+0000 7f1969d34700 1 -- 172.21.15.6:0/1717694515 shutdown_connections 2023-10-06T02:28:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.291+0000 7f1969d34700 1 -- 172.21.15.6:0/1717694515 wait complete. 2023-10-06T02:28:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.292+0000 7f1969d34700 1 Processor -- start 2023-10-06T02:28:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.292+0000 7f1969d34700 1 -- start start 2023-10-06T02:28:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f1969d34700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19640b08f0 0x7f1964145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f1969d34700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19640cccf0 0x7f19640b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f1969d34700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1964159150 0x7f19640b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f1969d34700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1964146300 con 0x7f1964159150 2023-10-06T02:28:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f1969d34700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196415ca00 con 0x7f19640b08f0 2023-10-06T02:28:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f1969d34700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196415bb50 con 0x7f19640cccf0 2023-10-06T02:28:04.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f1963fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1964159150 0x7f19640b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f1963fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1964159150 0x7f19640b55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50574/0 (socket says 172.21.15.6:50574) 2023-10-06T02:28:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f1963fff700 1 -- 172.21.15.6:0/2462977975 learned_addr learned my addr 172.21.15.6:0/2462977975 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f19637fe700 1 --2- 172.21.15.6:0/2462977975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19640b08f0 0x7f1964145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f1962ffd700 1 --2- 172.21.15.6:0/2462977975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19640cccf0 0x7f19640b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f1963fff700 1 -- 172.21.15.6:0/2462977975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19640cccf0 msgr2=0x7f19640b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f1963fff700 1 --2- 172.21.15.6:0/2462977975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19640cccf0 0x7f19640b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f1963fff700 1 -- 172.21.15.6:0/2462977975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19640b08f0 msgr2=0x7f1964145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f1963fff700 1 --2- 172.21.15.6:0/2462977975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19640b08f0 0x7f1964145dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f1963fff700 1 -- 172.21.15.6:0/2462977975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1954009420 con 0x7f1964159150 2023-10-06T02:28:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f1963fff700 1 --2- 172.21.15.6:0/2462977975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1964159150 0x7f19640b55f0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f195c00b610 tx=0x7f195c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f194b7fe700 1 -- 172.21.15.6:0/2462977975 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c012dd0 con 0x7f1964159150 2023-10-06T02:28:04.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f194b7fe700 1 -- 172.21.15.6:0/2462977975 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195c027470 con 0x7f1964159150 2023-10-06T02:28:04.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.293+0000 7f1969d34700 1 -- 172.21.15.6:0/2462977975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c009a20 con 0x7f1964159150 2023-10-06T02:28:04.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.294+0000 7f194b7fe700 1 -- 172.21.15.6:0/2462977975 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c027830 con 0x7f1964159150 2023-10-06T02:28:04.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.294+0000 7f1969d34700 1 -- 172.21.15.6:0/2462977975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19640c5730 con 0x7f1964159150 2023-10-06T02:28:04.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.294+0000 7f1969d34700 1 -- 172.21.15.6:0/2462977975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1964088aa0 con 0x7f1964159150 2023-10-06T02:28:04.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.295+0000 7f194b7fe700 1 -- 172.21.15.6:0/2462977975 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f195c024070 con 0x7f1964159150 2023-10-06T02:28:04.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.295+0000 7f194b7fe700 1 --2- 172.21.15.6:0/2462977975 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1950066f30 0x7f19500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:04.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.295+0000 7f194b7fe700 1 -- 172.21.15.6:0/2462977975 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 8958+0+0 (secure 0 0 0) 0x7f195c087c00 con 0x7f1964159150 2023-10-06T02:28:04.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.295+0000 7f19637fe700 1 --2- 172.21.15.6:0/2462977975 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1950066f30 0x7f19500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:04.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.296+0000 7f19637fe700 1 --2- 172.21.15.6:0/2462977975 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1950066f30 0x7f19500693e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f19640ce920 tx=0x7f19540091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:04.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.300+0000 7f194b7fe700 1 -- 172.21.15.6:0/2462977975 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f195c08e080 con 0x7f1964159150 2023-10-06T02:28:04.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.536+0000 7f1969d34700 1 -- 172.21.15.6:0/2462977975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f196404bb80 con 0x7f1964159150 2023-10-06T02:28:04.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.537+0000 7f194b7fe700 1 -- 172.21.15.6:0/2462977975 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 274 v274) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f195c02c090 con 0x7f1964159150 2023-10-06T02:28:04.539 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:04.539 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":274,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":274,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:28:04.154913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.539+0000 7f1969d34700 1 -- 172.21.15.6:0/2462977975 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1950066f30 msgr2=0x7f19500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.539+0000 7f1969d34700 1 --2- 172.21.15.6:0/2462977975 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1950066f30 0x7f19500693e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f19640ce920 tx=0x7f19540091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.539+0000 7f1969d34700 1 -- 172.21.15.6:0/2462977975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1964159150 msgr2=0x7f19640b55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.539+0000 7f1969d34700 1 --2- 172.21.15.6:0/2462977975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1964159150 0x7f19640b55f0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f195c00b610 tx=0x7f195c019000 comp rx=0 tx=0).stop 2023-10-06T02:28:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.539+0000 7f1969d34700 1 -- 172.21.15.6:0/2462977975 shutdown_connections 2023-10-06T02:28:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.539+0000 7f1969d34700 1 --2- 172.21.15.6:0/2462977975 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1950066f30 0x7f19500693e0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.539+0000 7f1969d34700 1 --2- 172.21.15.6:0/2462977975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1964159150 0x7f19640b55f0 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.539+0000 7f1969d34700 1 --2- 172.21.15.6:0/2462977975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19640b08f0 0x7f1964145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.539+0000 7f1969d34700 1 --2- 172.21.15.6:0/2462977975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19640cccf0 0x7f19640b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.539+0000 7f1969d34700 1 -- 172.21.15.6:0/2462977975 >> 172.21.15.6:0/2462977975 conn(0x7f1964068680 msgr2=0x7f19640b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.539+0000 7f1969d34700 1 -- 172.21.15.6:0/2462977975 shutdown_connections 2023-10-06T02:28:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.539+0000 7f1969d34700 1 -- 172.21.15.6:0/2462977975 wait complete. 2023-10-06T02:28:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 274 2023-10-06T02:28:04.552 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:28:04.553 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:04.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.710+0000 7fb1362f9700 1 Processor -- start 2023-10-06T02:28:04.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.710+0000 7fb1362f9700 1 -- start start 2023-10-06T02:28:04.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.710+0000 7fb1362f9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb13015ca10 0x7fb130069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:04.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.710+0000 7fb1362f9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb130067d10 0x7fb13006a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:04.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.710+0000 7fb1362f9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb13015cde0 0x7fb1300aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:04.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.710+0000 7fb1362f9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1300b1ed0 con 0x7fb13015cde0 2023-10-06T02:28:04.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.710+0000 7fb1362f9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1300879c0 con 0x7fb130067d10 2023-10-06T02:28:04.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.710+0000 7fb1362f9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1300cec50 con 0x7fb13015ca10 2023-10-06T02:28:04.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.710+0000 7fb134896700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb13015cde0 0x7fb1300aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:04.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.711+0000 7fb134896700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb13015cde0 0x7fb1300aeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50576/0 (socket says 172.21.15.6:50576) 2023-10-06T02:28:04.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.711+0000 7fb134896700 1 -- 172.21.15.6:0/2999571446 learned_addr learned my addr 172.21.15.6:0/2999571446 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:04.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.711+0000 7fb12ffff700 1 --2- 172.21.15.6:0/2999571446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb13015ca10 0x7fb130069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:04.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.711+0000 7fb12f7fe700 1 --2- 172.21.15.6:0/2999571446 >> v2:172.21.15.175:3300/0 conn(0x7fb130067d10 0x7fb13006a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:04.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.711+0000 7fb134896700 1 -- 172.21.15.6:0/2999571446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb13015ca10 msgr2=0x7fb130069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:04.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.711+0000 7fb134896700 1 --2- 172.21.15.6:0/2999571446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb13015ca10 0x7fb130069f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.711+0000 7fb134896700 1 -- 172.21.15.6:0/2999571446 >> v2:172.21.15.175:3300/0 conn(0x7fb130067d10 msgr2=0x7fb13006a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:04.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.711+0000 7fb134896700 1 --2- 172.21.15.6:0/2999571446 >> v2:172.21.15.175:3300/0 conn(0x7fb130067d10 0x7fb13006a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.711+0000 7fb134896700 1 -- 172.21.15.6:0/2999571446 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1300cef30 con 0x7fb13015cde0 2023-10-06T02:28:04.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.711+0000 7fb134896700 1 --2- 172.21.15.6:0/2999571446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb13015cde0 0x7fb1300aeb30 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7fb13006c2d0 tx=0x7fb128009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141f68b963ab886a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:04.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.711+0000 7fb12effd700 1 -- 172.21.15.6:0/2999571446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12800e070 con 0x7fb13015cde0 2023-10-06T02:28:04.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.711+0000 7fb12effd700 1 -- 172.21.15.6:0/2999571446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12800ba50 con 0x7fb13015cde0 2023-10-06T02:28:04.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.711+0000 7fb12effd700 1 -- 172.21.15.6:0/2999571446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1280092e0 con 0x7fb13015cde0 2023-10-06T02:28:04.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.712+0000 7fb1362f9700 1 -- 172.21.15.6:0/2999571446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb13015cde0 msgr2=0x7fb1300aeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:04.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.712+0000 7fb1362f9700 1 --2- 172.21.15.6:0/2999571446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb13015cde0 0x7fb1300aeb30 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7fb13006c2d0 tx=0x7fb128009840 comp rx=0 tx=0).stop 2023-10-06T02:28:04.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.712+0000 7fb1362f9700 1 -- 172.21.15.6:0/2999571446 shutdown_connections 2023-10-06T02:28:04.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.712+0000 7fb1362f9700 1 --2- 172.21.15.6:0/2999571446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb13015cde0 0x7fb1300aeb30 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.712+0000 7fb1362f9700 1 --2- 172.21.15.6:0/2999571446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb13015ca10 0x7fb130069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.712+0000 7fb1362f9700 1 --2- 172.21.15.6:0/2999571446 >> v2:172.21.15.175:3300/0 conn(0x7fb130067d10 0x7fb13006a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.712+0000 7fb1362f9700 1 -- 172.21.15.6:0/2999571446 >> 172.21.15.6:0/2999571446 conn(0x7fb130067910 msgr2=0x7fb1300ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:04.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.712+0000 7fb1362f9700 1 -- 172.21.15.6:0/2999571446 shutdown_connections 2023-10-06T02:28:04.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.712+0000 7fb1362f9700 1 -- 172.21.15.6:0/2999571446 wait complete. 2023-10-06T02:28:04.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.713+0000 7fb1362f9700 1 Processor -- start 2023-10-06T02:28:04.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.713+0000 7fb1362f9700 1 -- start start 2023-10-06T02:28:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb1362f9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb130067d10 0x7fb130169730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb1362f9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13015ca10 0x7fb13009aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb1362f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb13015cde0 0x7fb13009b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb1362f9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb130157f60 con 0x7fb13015cde0 2023-10-06T02:28:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb1362f9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1300af2c0 con 0x7fb13015ca10 2023-10-06T02:28:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb1362f9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1300ae9b0 con 0x7fb130067d10 2023-10-06T02:28:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb134896700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb13015cde0 0x7fb13009b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb134896700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb13015cde0 0x7fb13009b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50586/0 (socket says 172.21.15.6:50586) 2023-10-06T02:28:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb134896700 1 -- 172.21.15.6:0/637421964 learned_addr learned my addr 172.21.15.6:0/637421964 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb12ffff700 1 --2- 172.21.15.6:0/637421964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb130067d10 0x7fb130169730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb12f7fe700 1 --2- 172.21.15.6:0/637421964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13015ca10 0x7fb13009aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb134896700 1 -- 172.21.15.6:0/637421964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb130067d10 msgr2=0x7fb130169730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb134896700 1 --2- 172.21.15.6:0/637421964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb130067d10 0x7fb130169730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb134896700 1 -- 172.21.15.6:0/637421964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13015ca10 msgr2=0x7fb13009aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:04.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb134896700 1 --2- 172.21.15.6:0/637421964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13015ca10 0x7fb13009aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb134896700 1 -- 172.21.15.6:0/637421964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb128009ae0 con 0x7fb13015cde0 2023-10-06T02:28:04.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb134896700 1 --2- 172.21.15.6:0/637421964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb13015cde0 0x7fb13009b3f0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7fb128012000 tx=0x7fb128018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:04.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.714+0000 7fb127fff700 1 -- 172.21.15.6:0/637421964 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1280032f0 con 0x7fb13015cde0 2023-10-06T02:28:04.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.715+0000 7fb127fff700 1 -- 172.21.15.6:0/637421964 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb128008d20 con 0x7fb13015cde0 2023-10-06T02:28:04.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.715+0000 7fb1362f9700 1 -- 172.21.15.6:0/637421964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13009bc70 con 0x7fb13015cde0 2023-10-06T02:28:04.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.715+0000 7fb127fff700 1 -- 172.21.15.6:0/637421964 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12801c660 con 0x7fb13015cde0 2023-10-06T02:28:04.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.715+0000 7fb1362f9700 1 -- 172.21.15.6:0/637421964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1300aef50 con 0x7fb13015cde0 2023-10-06T02:28:04.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.715+0000 7fb1362f9700 1 -- 172.21.15.6:0/637421964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13006e8d0 con 0x7fb13015cde0 2023-10-06T02:28:04.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.717+0000 7fb127fff700 1 -- 172.21.15.6:0/637421964 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb128003040 con 0x7fb13015cde0 2023-10-06T02:28:04.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.717+0000 7fb127fff700 1 --2- 172.21.15.6:0/637421964 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb110066f30 0x7fb1100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:04.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.717+0000 7fb127fff700 1 -- 172.21.15.6:0/637421964 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 8958+0+0 (secure 0 0 0) 0x7fb128086e30 con 0x7fb13015cde0 2023-10-06T02:28:04.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.717+0000 7fb12ffff700 1 --2- 172.21.15.6:0/637421964 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb110066f30 0x7fb1100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:04.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.718+0000 7fb12ffff700 1 --2- 172.21.15.6:0/637421964 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb110066f30 0x7fb1100693e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb120006aa0 tx=0x7fb120008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:04.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.721+0000 7fb127fff700 1 -- 172.21.15.6:0/637421964 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1280533b0 con 0x7fb13015cde0 2023-10-06T02:28:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.959+0000 7fb1362f9700 1 -- 172.21.15.6:0/637421964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1300b1b60 con 0x7fb13015cde0 2023-10-06T02:28:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.960+0000 7fb127fff700 1 -- 172.21.15.6:0/637421964 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 274 v274) v1 ==== 95+0+3840 (secure 0 0 0) 0x7fb128009940 con 0x7fb13015cde0 2023-10-06T02:28:04.962 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:04.962 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":274,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":274,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:28:04.154913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.962+0000 7fb1362f9700 1 -- 172.21.15.6:0/637421964 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb110066f30 msgr2=0x7fb1100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.962+0000 7fb1362f9700 1 --2- 172.21.15.6:0/637421964 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb110066f30 0x7fb1100693e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb120006aa0 tx=0x7fb120008040 comp rx=0 tx=0).stop 2023-10-06T02:28:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.962+0000 7fb1362f9700 1 -- 172.21.15.6:0/637421964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb13015cde0 msgr2=0x7fb13009b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.962+0000 7fb1362f9700 1 --2- 172.21.15.6:0/637421964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb13015cde0 0x7fb13009b3f0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7fb128012000 tx=0x7fb128018000 comp rx=0 tx=0).stop 2023-10-06T02:28:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.962+0000 7fb1362f9700 1 -- 172.21.15.6:0/637421964 shutdown_connections 2023-10-06T02:28:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.962+0000 7fb1362f9700 1 --2- 172.21.15.6:0/637421964 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb110066f30 0x7fb1100693e0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.962+0000 7fb1362f9700 1 --2- 172.21.15.6:0/637421964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb13015cde0 0x7fb13009b3f0 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.962+0000 7fb1362f9700 1 --2- 172.21.15.6:0/637421964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb130067d10 0x7fb130169730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.962+0000 7fb1362f9700 1 --2- 172.21.15.6:0/637421964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13015ca10 0x7fb13009aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.962+0000 7fb1362f9700 1 -- 172.21.15.6:0/637421964 >> 172.21.15.6:0/637421964 conn(0x7fb130067910 msgr2=0x7fb13006dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.962+0000 7fb1362f9700 1 -- 172.21.15.6:0/637421964 shutdown_connections 2023-10-06T02:28:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:04.962+0000 7fb1362f9700 1 -- 172.21.15.6:0/637421964 wait complete. 2023-10-06T02:28:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 274 2023-10-06T02:28:04.976 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:28:04.976 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.094+0000 7fdc7eaf9700 1 Processor -- start 2023-10-06T02:28:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.094+0000 7fdc7eaf9700 1 -- start start 2023-10-06T02:28:05.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.094+0000 7fdc7eaf9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc780af4e0 0x7fdc780b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.094+0000 7fdc7eaf9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdc780af8b0 0x7fdc780b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.094+0000 7fdc7eaf9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7815e190 con 0x7fdc7815d460 2023-10-06T02:28:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.094+0000 7fdc7eaf9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc780b1910 con 0x7fdc780af4e0 2023-10-06T02:28:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.094+0000 7fdc7eaf9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc7815dfa0 con 0x7fdc780af8b0 2023-10-06T02:28:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.095+0000 7fdc7c895700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc780af4e0 0x7fdc780b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.095+0000 7fdc7c895700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc780af4e0 0x7fdc780b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50600/0 (socket says 172.21.15.6:50600) 2023-10-06T02:28:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.095+0000 7fdc7c895700 1 -- 172.21.15.6:0/3703388506 learned_addr learned my addr 172.21.15.6:0/3703388506 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.095+0000 7fdc7c895700 1 -- 172.21.15.6:0/3703388506 >> v2:172.21.15.175:3300/0 conn(0x7fdc780af8b0 msgr2=0x7fdc780b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.095+0000 7fdc77fff700 1 --2- 172.21.15.6:0/3703388506 >> v2:172.21.15.175:3300/0 conn(0x7fdc780af8b0 0x7fdc780b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.095+0000 7fdc7c895700 1 --2- 172.21.15.6:0/3703388506 >> v2:172.21.15.175:3300/0 conn(0x7fdc780af8b0 0x7fdc780b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.095+0000 7fdc7c895700 1 -- 172.21.15.6:0/3703388506 >> v1:172.21.15.175:6789/0 conn(0x7fdc7815d460 legacy=0x7fdc7815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.095+0000 7fdc7c895700 1 -- 172.21.15.6:0/3703388506 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc780cb650 con 0x7fdc780af4e0 2023-10-06T02:28:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.095+0000 7fdc77fff700 1 --2- 172.21.15.6:0/3703388506 >> v2:172.21.15.175:3300/0 conn(0x7fdc780af8b0 0x7fdc780b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.095+0000 7fdc7c895700 1 --2- 172.21.15.6:0/3703388506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc780af4e0 0x7fdc780b20e0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7fdc780cdd50 tx=0x7fdc70009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ef5fd86d3e349a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.095+0000 7fdc777fe700 1 -- 172.21.15.6:0/3703388506 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7000e070 con 0x7fdc780af4e0 2023-10-06T02:28:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.095+0000 7fdc777fe700 1 -- 172.21.15.6:0/3703388506 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7000ba10 con 0x7fdc780af4e0 2023-10-06T02:28:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.095+0000 7fdc777fe700 1 -- 172.21.15.6:0/3703388506 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc700092e0 con 0x7fdc780af4e0 2023-10-06T02:28:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.096+0000 7fdc7eaf9700 1 -- 172.21.15.6:0/3703388506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc780af4e0 msgr2=0x7fdc780b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.096+0000 7fdc7eaf9700 1 --2- 172.21.15.6:0/3703388506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc780af4e0 0x7fdc780b20e0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7fdc780cdd50 tx=0x7fdc70009840 comp rx=0 tx=0).stop 2023-10-06T02:28:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.096+0000 7fdc7eaf9700 1 -- 172.21.15.6:0/3703388506 shutdown_connections 2023-10-06T02:28:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.096+0000 7fdc7eaf9700 1 --2- 172.21.15.6:0/3703388506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc780af4e0 0x7fdc780b20e0 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.096+0000 7fdc7eaf9700 1 --2- 172.21.15.6:0/3703388506 >> v2:172.21.15.175:3300/0 conn(0x7fdc780af8b0 0x7fdc780b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.096+0000 7fdc7eaf9700 1 -- 172.21.15.6:0/3703388506 >> 172.21.15.6:0/3703388506 conn(0x7fdc78068680 msgr2=0x7fdc78068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.096+0000 7fdc7eaf9700 1 -- 172.21.15.6:0/3703388506 shutdown_connections 2023-10-06T02:28:05.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.096+0000 7fdc7eaf9700 1 -- 172.21.15.6:0/3703388506 wait complete. 2023-10-06T02:28:05.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.097+0000 7fdc7eaf9700 1 Processor -- start 2023-10-06T02:28:05.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.097+0000 7fdc7eaf9700 1 -- start start 2023-10-06T02:28:05.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.098+0000 7fdc7eaf9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc780af4e0 0x7fdc7816a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.098+0000 7fdc7eaf9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc780af8b0 0x7fdc780c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.098+0000 7fdc7eaf9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc7815d460 0x7fdc78154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.098+0000 7fdc7eaf9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc780c9240 con 0x7fdc780af8b0 2023-10-06T02:28:05.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.098+0000 7fdc7eaf9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc78154cd0 con 0x7fdc7815d460 2023-10-06T02:28:05.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.098+0000 7fdc7eaf9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc780ce4b0 con 0x7fdc780af4e0 2023-10-06T02:28:05.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.098+0000 7fdc77fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc780af8b0 0x7fdc780c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.098+0000 7fdc77fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc780af8b0 0x7fdc780c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50614/0 (socket says 172.21.15.6:50614) 2023-10-06T02:28:05.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.098+0000 7fdc77fff700 1 -- 172.21.15.6:0/2099925918 learned_addr learned my addr 172.21.15.6:0/2099925918 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:05.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.098+0000 7fdc7c895700 1 --2- 172.21.15.6:0/2099925918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc780af4e0 0x7fdc7816a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.098+0000 7fdc7d096700 1 --2- 172.21.15.6:0/2099925918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc7815d460 0x7fdc78154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.098+0000 7fdc77fff700 1 -- 172.21.15.6:0/2099925918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc780af4e0 msgr2=0x7fdc7816a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.098+0000 7fdc77fff700 1 --2- 172.21.15.6:0/2099925918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc780af4e0 0x7fdc7816a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.098+0000 7fdc77fff700 1 -- 172.21.15.6:0/2099925918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc7815d460 msgr2=0x7fdc78154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.098+0000 7fdc77fff700 1 --2- 172.21.15.6:0/2099925918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc7815d460 0x7fdc78154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.098+0000 7fdc77fff700 1 -- 172.21.15.6:0/2099925918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc70009ae0 con 0x7fdc780af8b0 2023-10-06T02:28:05.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.098+0000 7fdc77fff700 1 --2- 172.21.15.6:0/2099925918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc780af8b0 0x7fdc780c8d00 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800c8b0 tx=0x7fdc68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:05.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.099+0000 7fdc74ff9700 1 -- 172.21.15.6:0/2099925918 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc68011600 con 0x7fdc780af8b0 2023-10-06T02:28:05.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.099+0000 7fdc74ff9700 1 -- 172.21.15.6:0/2099925918 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc68011760 con 0x7fdc780af8b0 2023-10-06T02:28:05.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.099+0000 7fdc7eaf9700 1 -- 172.21.15.6:0/2099925918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc780cf030 con 0x7fdc780af8b0 2023-10-06T02:28:05.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.099+0000 7fdc74ff9700 1 -- 172.21.15.6:0/2099925918 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc68011b20 con 0x7fdc780af8b0 2023-10-06T02:28:05.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.099+0000 7fdc7eaf9700 1 -- 172.21.15.6:0/2099925918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc780ce9e0 con 0x7fdc780af8b0 2023-10-06T02:28:05.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.099+0000 7fdc7eaf9700 1 -- 172.21.15.6:0/2099925918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc780cf1c0 con 0x7fdc780af8b0 2023-10-06T02:28:05.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.100+0000 7fdc74ff9700 1 -- 172.21.15.6:0/2099925918 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc680193b0 con 0x7fdc780af8b0 2023-10-06T02:28:05.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.100+0000 7fdc74ff9700 1 --2- 172.21.15.6:0/2099925918 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc58066f30 0x7fdc580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.101+0000 7fdc74ff9700 1 -- 172.21.15.6:0/2099925918 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 8958+0+0 (secure 0 0 0) 0x7fdc68084fa0 con 0x7fdc780af8b0 2023-10-06T02:28:05.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.101+0000 7fdc7c895700 1 --2- 172.21.15.6:0/2099925918 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc58066f30 0x7fdc580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.101+0000 7fdc7c895700 1 --2- 172.21.15.6:0/2099925918 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc58066f30 0x7fdc580693e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009880 tx=0x7fdc70017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:05.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.105+0000 7fdc74ff9700 1 -- 172.21.15.6:0/2099925918 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc680b65a0 con 0x7fdc780af8b0 2023-10-06T02:28:05.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.343+0000 7fdc7eaf9700 1 -- 172.21.15.6:0/2099925918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc780b0910 con 0x7fdc780af8b0 2023-10-06T02:28:05.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.344+0000 7fdc74ff9700 1 -- 172.21.15.6:0/2099925918 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 275 v275) v1 ==== 95+0+4595 (secure 0 0 0) 0x7fdc6801f090 con 0x7fdc780af8b0 2023-10-06T02:28:05.345 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:05.345 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":275,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9897,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2274292833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2274292833},{"type":"v1","addr":"172.21.15.6:6835","nonce":2274292833}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":275}],"filesystems":[{"mdsmap":{"epoch":274,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:28:04.154913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:05.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.346+0000 7fdc7eaf9700 1 -- 172.21.15.6:0/2099925918 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc58066f30 msgr2=0x7fdc580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.346+0000 7fdc7eaf9700 1 --2- 172.21.15.6:0/2099925918 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc58066f30 0x7fdc580693e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009880 tx=0x7fdc70017000 comp rx=0 tx=0).stop 2023-10-06T02:28:05.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.346+0000 7fdc7eaf9700 1 -- 172.21.15.6:0/2099925918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc780af8b0 msgr2=0x7fdc780c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.346+0000 7fdc7eaf9700 1 --2- 172.21.15.6:0/2099925918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc780af8b0 0x7fdc780c8d00 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800c8b0 tx=0x7fdc68008040 comp rx=0 tx=0).stop 2023-10-06T02:28:05.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.346+0000 7fdc7eaf9700 1 -- 172.21.15.6:0/2099925918 shutdown_connections 2023-10-06T02:28:05.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.346+0000 7fdc7eaf9700 1 --2- 172.21.15.6:0/2099925918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc7815d460 0x7fdc78154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.346+0000 7fdc7eaf9700 1 --2- 172.21.15.6:0/2099925918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdc780af4e0 0x7fdc7816a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.346+0000 7fdc7eaf9700 1 --2- 172.21.15.6:0/2099925918 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdc58066f30 0x7fdc580693e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.346+0000 7fdc7eaf9700 1 --2- 172.21.15.6:0/2099925918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc780af8b0 0x7fdc780c8d00 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.346+0000 7fdc7eaf9700 1 -- 172.21.15.6:0/2099925918 >> 172.21.15.6:0/2099925918 conn(0x7fdc78068680 msgr2=0x7fdc7815a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:05.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.346+0000 7fdc7eaf9700 1 -- 172.21.15.6:0/2099925918 shutdown_connections 2023-10-06T02:28:05.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.346+0000 7fdc7eaf9700 1 -- 172.21.15.6:0/2099925918 wait complete. 2023-10-06T02:28:05.349 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 275 2023-10-06T02:28:05.359 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 400.00000000' led to DAMAGED state 2023-10-06T02:28:05.359 INFO:tasks.cephfs.test_damage:Applying mutation 'Truncate 100.00000000.inode' 2023-10-06T02:28:05.360 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:05.360 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:28:05.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:05.360 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:28:05.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:28:05.375 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:28:05.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:28:05.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.534+0000 7efc8d31f700 1 Processor -- start 2023-10-06T02:28:05.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.534+0000 7efc8d31f700 1 -- start start 2023-10-06T02:28:05.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.534+0000 7efc8d31f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc88159860 0x7efc880cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.534+0000 7efc8d31f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc880cd6e0 con 0x7efc880b2490 2023-10-06T02:28:05.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.534+0000 7efc8d31f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc880cb630 con 0x7efc880b2860 2023-10-06T02:28:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.534+0000 7efc8d31f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc880cb910 con 0x7efc88159860 2023-10-06T02:28:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.534+0000 7efc86ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efc880b2490 0x7efc880b0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47324/0 (socket says 172.21.15.6:47324) 2023-10-06T02:28:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc86ffd700 1 -- 172.21.15.6:0/1737952303 learned_addr learned my addr 172.21.15.6:0/1737952303 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc877fe700 1 --2- 172.21.15.6:0/1737952303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc88159860 0x7efc880cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc85ffb700 1 -- 172.21.15.6:0/1737952303 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459466697 0 0) 0x7efc880cd6e0 con 0x7efc880b2490 2023-10-06T02:28:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc85ffb700 1 -- 172.21.15.6:0/1737952303 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc74003570 con 0x7efc880b2490 2023-10-06T02:28:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc85ffb700 1 -- 172.21.15.6:0/1737952303 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008401904 0 0) 0x7efc880cb630 con 0x7efc880b2860 2023-10-06T02:28:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc85ffb700 1 -- 172.21.15.6:0/1737952303 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc880cd6e0 con 0x7efc880b2860 2023-10-06T02:28:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc85ffb700 1 -- 172.21.15.6:0/1737952303 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3088579924 0 0) 0x7efc74003570 con 0x7efc880b2490 2023-10-06T02:28:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc85ffb700 1 -- 172.21.15.6:0/1737952303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc88159860 msgr2=0x7efc880cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc85ffb700 1 --2- 172.21.15.6:0/1737952303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc88159860 0x7efc880cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc85ffb700 1 -- 172.21.15.6:0/1737952303 >> v1:172.21.15.175:6789/0 conn(0x7efc880b2860 legacy=0x7efc88159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc85ffb700 1 -- 172.21.15.6:0/1737952303 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc880cbbf0 con 0x7efc880b2490 2023-10-06T02:28:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc85ffb700 1 -- 172.21.15.6:0/1737952303 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7efc800017f0 con 0x7efc880b2490 2023-10-06T02:28:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc85ffb700 1 -- 172.21.15.6:0/1737952303 >> v1:172.21.15.6:6789/0 conn(0x7efc880b2490 legacy=0x7efc880b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc85ffb700 1 --2- 172.21.15.6:0/1737952303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc74003c20 0x7efc74004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc85ffb700 1 --2- 172.21.15.6:0/1737952303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc74004810 0x7efc74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc85ffb700 1 --2- 172.21.15.6:0/1737952303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc88159860 0x7efc74005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc85ffb700 1 -- 172.21.15.6:0/1737952303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc880cb910 con 0x7efc74003c20 2023-10-06T02:28:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc85ffb700 1 -- 172.21.15.6:0/1737952303 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7400bbf0 con 0x7efc74004810 2023-10-06T02:28:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc85ffb700 1 -- 172.21.15.6:0/1737952303 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7400bdb0 con 0x7efc88159860 2023-10-06T02:28:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc86ffd700 1 --2- 172.21.15.6:0/1737952303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc74003c20 0x7efc74004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc867fc700 1 --2- 172.21.15.6:0/1737952303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc74004810 0x7efc74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.535+0000 7efc877fe700 1 --2- 172.21.15.6:0/1737952303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc88159860 0x7efc74005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.536+0000 7efc86ffd700 1 -- 172.21.15.6:0/1737952303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc88159860 msgr2=0x7efc74005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.536+0000 7efc86ffd700 1 --2- 172.21.15.6:0/1737952303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc88159860 0x7efc74005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.536+0000 7efc86ffd700 1 -- 172.21.15.6:0/1737952303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc74004810 msgr2=0x7efc74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.536+0000 7efc86ffd700 1 --2- 172.21.15.6:0/1737952303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc74004810 0x7efc74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.536+0000 7efc86ffd700 1 -- 172.21.15.6:0/1737952303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc74003570 con 0x7efc74003c20 2023-10-06T02:28:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.536+0000 7efc86ffd700 1 --2- 172.21.15.6:0/1737952303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc74003c20 0x7efc74004010 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7efc8000a800 tx=0x7efc800020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f795d0b83b208eee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.536+0000 7efc85ffb700 1 -- 172.21.15.6:0/1737952303 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc800071a0 con 0x7efc74003c20 2023-10-06T02:28:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.536+0000 7efc85ffb700 1 -- 172.21.15.6:0/1737952303 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc80007300 con 0x7efc74003c20 2023-10-06T02:28:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.536+0000 7efc85ffb700 1 -- 172.21.15.6:0/1737952303 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc800076c0 con 0x7efc74003c20 2023-10-06T02:28:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.536+0000 7efc8d31f700 1 -- 172.21.15.6:0/1737952303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc74003c20 msgr2=0x7efc74004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.536+0000 7efc8d31f700 1 --2- 172.21.15.6:0/1737952303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc74003c20 0x7efc74004010 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7efc8000a800 tx=0x7efc800020c0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.536+0000 7efc877fe700 1 -- 172.21.15.6:0/1737952303 reap_dead start 2023-10-06T02:28:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.536+0000 7efc8d31f700 1 -- 172.21.15.6:0/1737952303 shutdown_connections 2023-10-06T02:28:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.536+0000 7efc8d31f700 1 -- 172.21.15.6:0/1737952303 >> 172.21.15.6:0/1737952303 conn(0x7efc88068680 msgr2=0x7efc88068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.536+0000 7efc8d31f700 1 -- 172.21.15.6:0/1737952303 shutdown_connections 2023-10-06T02:28:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.536+0000 7efc8d31f700 1 -- 172.21.15.6:0/1737952303 wait complete. 2023-10-06T02:28:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.538+0000 7efc8d31f700 1 Processor -- start 2023-10-06T02:28:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.538+0000 7efc8d31f700 1 -- start start 2023-10-06T02:28:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.538+0000 7efc8d31f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc74003c20 0x7efc881457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.538+0000 7efc8d31f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc880c3920 0x7efc880c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.538+0000 7efc8d31f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc880c5a80 0x7efc880c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.538+0000 7efc8d31f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc880c42d0 con 0x7efc74003c20 2023-10-06T02:28:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.538+0000 7efc8d31f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc880c67f0 con 0x7efc880c5a80 2023-10-06T02:28:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.538+0000 7efc8d31f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc880c6ad0 con 0x7efc880c3920 2023-10-06T02:28:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc86ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc74003c20 0x7efc881457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc86ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc74003c20 0x7efc881457c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50628/0 (socket says 172.21.15.6:50628) 2023-10-06T02:28:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc86ffd700 1 -- 172.21.15.6:0/3390184674 learned_addr learned my addr 172.21.15.6:0/3390184674 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc867fc700 1 --2- 172.21.15.6:0/3390184674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc880c3920 0x7efc880c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc877fe700 1 --2- 172.21.15.6:0/3390184674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc880c5a80 0x7efc880c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc86ffd700 1 -- 172.21.15.6:0/3390184674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc880c3920 msgr2=0x7efc880c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc86ffd700 1 --2- 172.21.15.6:0/3390184674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc880c3920 0x7efc880c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc86ffd700 1 -- 172.21.15.6:0/3390184674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc880c5a80 msgr2=0x7efc880c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc86ffd700 1 --2- 172.21.15.6:0/3390184674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc880c5a80 0x7efc880c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc86ffd700 1 -- 172.21.15.6:0/3390184674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc880c6db0 con 0x7efc74003c20 2023-10-06T02:28:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc877fe700 1 --2- 172.21.15.6:0/3390184674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc880c5a80 0x7efc880c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc867fc700 1 --2- 172.21.15.6:0/3390184674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc880c3920 0x7efc880c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc86ffd700 1 --2- 172.21.15.6:0/3390184674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc74003c20 0x7efc881457c0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7efc740057f0 tx=0x7efc80016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc7effd700 1 -- 172.21.15.6:0/3390184674 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc800019d0 con 0x7efc74003c20 2023-10-06T02:28:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc7effd700 1 -- 172.21.15.6:0/3390184674 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc80020410 con 0x7efc74003c20 2023-10-06T02:28:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc8d31f700 1 -- 172.21.15.6:0/3390184674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc880c7090 con 0x7efc74003c20 2023-10-06T02:28:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc7effd700 1 -- 172.21.15.6:0/3390184674 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc800207b0 con 0x7efc74003c20 2023-10-06T02:28:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.539+0000 7efc8d31f700 1 -- 172.21.15.6:0/3390184674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc880c6460 con 0x7efc74003c20 2023-10-06T02:28:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.540+0000 7efc8d31f700 1 -- 172.21.15.6:0/3390184674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc88088700 con 0x7efc74003c20 2023-10-06T02:28:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.541+0000 7efc7effd700 1 -- 172.21.15.6:0/3390184674 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc80020b20 con 0x7efc74003c20 2023-10-06T02:28:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.541+0000 7efc7effd700 1 --2- 172.21.15.6:0/3390184674 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc68066f30 0x7efc680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.541+0000 7efc7effd700 1 -- 172.21.15.6:0/3390184674 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 8958+0+0 (secure 0 0 0) 0x7efc80087400 con 0x7efc74003c20 2023-10-06T02:28:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.541+0000 7efc867fc700 1 --2- 172.21.15.6:0/3390184674 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc68066f30 0x7efc680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.542+0000 7efc867fc700 1 --2- 172.21.15.6:0/3390184674 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc68066f30 0x7efc680693e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7efc700010e0 tx=0x7efc70009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.545+0000 7efc7effd700 1 -- 172.21.15.6:0/3390184674 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc80053980 con 0x7efc74003c20 2023-10-06T02:28:05.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:05.783+0000 7efc8d31f700 1 -- 172.21.15.6:0/3390184674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efc880cbed0 con 0x7efc74003c20 2023-10-06T02:28:06.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.166+0000 7efc7effd700 1 -- 172.21.15.6:0/3390184674 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v276) v1 ==== 161+0+0 (secure 0 0 0) 0x7efc80025090 con 0x7efc74003c20 2023-10-06T02:28:06.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.168+0000 7efc8d31f700 1 -- 172.21.15.6:0/3390184674 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc68066f30 msgr2=0x7efc680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:06.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.168+0000 7efc8d31f700 1 --2- 172.21.15.6:0/3390184674 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc68066f30 0x7efc680693e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7efc700010e0 tx=0x7efc70009040 comp rx=0 tx=0).stop 2023-10-06T02:28:06.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.168+0000 7efc8d31f700 1 -- 172.21.15.6:0/3390184674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc74003c20 msgr2=0x7efc881457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:06.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.168+0000 7efc8d31f700 1 --2- 172.21.15.6:0/3390184674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc74003c20 0x7efc881457c0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7efc740057f0 tx=0x7efc80016000 comp rx=0 tx=0).stop 2023-10-06T02:28:06.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.168+0000 7efc8d31f700 1 -- 172.21.15.6:0/3390184674 shutdown_connections 2023-10-06T02:28:06.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.168+0000 7efc8d31f700 1 --2- 172.21.15.6:0/3390184674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc880c5a80 0x7efc880c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:06.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.168+0000 7efc8d31f700 1 --2- 172.21.15.6:0/3390184674 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efc68066f30 0x7efc680693e0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:06.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.168+0000 7efc8d31f700 1 --2- 172.21.15.6:0/3390184674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc74003c20 0x7efc881457c0 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:06.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.168+0000 7efc8d31f700 1 --2- 172.21.15.6:0/3390184674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc880c3920 0x7efc880c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:06.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.168+0000 7efc8d31f700 1 -- 172.21.15.6:0/3390184674 >> 172.21.15.6:0/3390184674 conn(0x7efc88068680 msgr2=0x7efc880cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:06.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.168+0000 7efc8d31f700 1 -- 172.21.15.6:0/3390184674 shutdown_connections 2023-10-06T02:28:06.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.168+0000 7efc8d31f700 1 -- 172.21.15.6:0/3390184674 wait complete. 2023-10-06T02:28:06.172 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:28:06.183 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:28:06.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.303+0000 7fcb96d13700 1 Processor -- start 2023-10-06T02:28:06.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.303+0000 7fcb96d13700 1 -- start start 2023-10-06T02:28:06.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.304+0000 7fcb96d13700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcb900b2860 0x7fcb900cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:06.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.304+0000 7fcb96d13700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb90159150 0x7fcb90159590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:06.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.304+0000 7fcb96d13700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb900cb630 con 0x7fcb900b2490 2023-10-06T02:28:06.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.304+0000 7fcb96d13700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb900cd6e0 con 0x7fcb90159150 2023-10-06T02:28:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.304+0000 7fcb96d13700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb900cb910 con 0x7fcb900b2860 2023-10-06T02:28:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.304+0000 7fcb94aaf700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcb900b2490 0x7fcb900b0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47332/0 (socket says 172.21.15.6:47332) 2023-10-06T02:28:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.304+0000 7fcb952b0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb90159150 0x7fcb90159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.304+0000 7fcb94aaf700 1 -- 172.21.15.6:0/2345896654 learned_addr learned my addr 172.21.15.6:0/2345896654 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.305+0000 7fcb952b0700 1 -- 172.21.15.6:0/2345896654 >> v2:172.21.15.175:3300/0 conn(0x7fcb900b2860 msgr2=0x7fcb900cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.305+0000 7fcb8ffff700 1 --2- 172.21.15.6:0/2345896654 >> v2:172.21.15.175:3300/0 conn(0x7fcb900b2860 0x7fcb900cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.305+0000 7fcb952b0700 1 --2- 172.21.15.6:0/2345896654 >> v2:172.21.15.175:3300/0 conn(0x7fcb900b2860 0x7fcb900cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.305+0000 7fcb952b0700 1 -- 172.21.15.6:0/2345896654 >> v1:172.21.15.6:6789/0 conn(0x7fcb900b2490 legacy=0x7fcb900b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.305+0000 7fcb8f7fe700 1 -- 172.21.15.6:0/2345896654 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403791881 0 0) 0x7fcb900cb630 con 0x7fcb900b2490 2023-10-06T02:28:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.305+0000 7fcb952b0700 1 -- 172.21.15.6:0/2345896654 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb900cbbf0 con 0x7fcb90159150 2023-10-06T02:28:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.305+0000 7fcb952b0700 1 --2- 172.21.15.6:0/2345896654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb90159150 0x7fcb90159590 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fcb780098e0 tx=0x7fcb780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15aed582bc05cbb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:06.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.305+0000 7fcb8f7fe700 1 -- 172.21.15.6:0/2345896654 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb78009e80 con 0x7fcb90159150 2023-10-06T02:28:06.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.305+0000 7fcb8f7fe700 1 -- 172.21.15.6:0/2345896654 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7800b820 con 0x7fcb90159150 2023-10-06T02:28:06.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.305+0000 7fcb8f7fe700 1 -- 172.21.15.6:0/2345896654 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7800bba0 con 0x7fcb90159150 2023-10-06T02:28:06.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.305+0000 7fcb96d13700 1 -- 172.21.15.6:0/2345896654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb90159150 msgr2=0x7fcb90159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:06.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.305+0000 7fcb96d13700 1 --2- 172.21.15.6:0/2345896654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb90159150 0x7fcb90159590 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fcb780098e0 tx=0x7fcb780091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:06.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.306+0000 7fcb96d13700 1 -- 172.21.15.6:0/2345896654 shutdown_connections 2023-10-06T02:28:06.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.306+0000 7fcb96d13700 1 --2- 172.21.15.6:0/2345896654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb90159150 0x7fcb90159590 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:06.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.306+0000 7fcb96d13700 1 --2- 172.21.15.6:0/2345896654 >> v2:172.21.15.175:3300/0 conn(0x7fcb900b2860 0x7fcb900cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:06.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.306+0000 7fcb96d13700 1 -- 172.21.15.6:0/2345896654 >> 172.21.15.6:0/2345896654 conn(0x7fcb90068680 msgr2=0x7fcb90068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:06.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.306+0000 7fcb96d13700 1 -- 172.21.15.6:0/2345896654 shutdown_connections 2023-10-06T02:28:06.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.306+0000 7fcb96d13700 1 -- 172.21.15.6:0/2345896654 wait complete. 2023-10-06T02:28:06.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.307+0000 7fcb96d13700 1 Processor -- start 2023-10-06T02:28:06.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.307+0000 7fcb96d13700 1 -- start start 2023-10-06T02:28:06.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb96d13700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb900b2490 0x7fcb900c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:06.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb96d13700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb900b2860 0x7fcb90148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:06.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb96d13700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb90159150 0x7fcb90148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:06.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb96d13700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb90149010 con 0x7fcb900b2490 2023-10-06T02:28:06.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb96d13700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900c9f10 con 0x7fcb900b2860 2023-10-06T02:28:06.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb96d13700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900ca1f0 con 0x7fcb90159150 2023-10-06T02:28:06.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb94aaf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb900b2490 0x7fcb900c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:06.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb94aaf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb900b2490 0x7fcb900c72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50644/0 (socket says 172.21.15.6:50644) 2023-10-06T02:28:06.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb94aaf700 1 -- 172.21.15.6:0/1654124718 learned_addr learned my addr 172.21.15.6:0/1654124718 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:06.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb8ffff700 1 --2- 172.21.15.6:0/1654124718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb900b2860 0x7fcb90148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:06.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb94aaf700 1 -- 172.21.15.6:0/1654124718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb90159150 msgr2=0x7fcb90148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:06.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb94aaf700 1 --2- 172.21.15.6:0/1654124718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb90159150 0x7fcb90148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:06.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb94aaf700 1 -- 172.21.15.6:0/1654124718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb900b2860 msgr2=0x7fcb90148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:06.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb94aaf700 1 --2- 172.21.15.6:0/1654124718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb900b2860 0x7fcb90148590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:06.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb94aaf700 1 -- 172.21.15.6:0/1654124718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb78009420 con 0x7fcb900b2490 2023-10-06T02:28:06.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb94aaf700 1 --2- 172.21.15.6:0/1654124718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb900b2490 0x7fcb900c72f0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800c7e0 tx=0x7fcb88007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:06.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb8cff9700 1 -- 172.21.15.6:0/1654124718 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88005b30 con 0x7fcb900b2490 2023-10-06T02:28:06.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb8cff9700 1 -- 172.21.15.6:0/1654124718 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb88005c90 con 0x7fcb900b2490 2023-10-06T02:28:06.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb96d13700 1 -- 172.21.15.6:0/1654124718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb900ca4d0 con 0x7fcb900b2490 2023-10-06T02:28:06.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb8cff9700 1 -- 172.21.15.6:0/1654124718 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88007300 con 0x7fcb900b2490 2023-10-06T02:28:06.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.308+0000 7fcb96d13700 1 -- 172.21.15.6:0/1654124718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb901545f0 con 0x7fcb900b2490 2023-10-06T02:28:06.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.309+0000 7fcb96d13700 1 -- 172.21.15.6:0/1654124718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb90088700 con 0x7fcb900b2490 2023-10-06T02:28:06.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.310+0000 7fcb8cff9700 1 -- 172.21.15.6:0/1654124718 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb8801b400 con 0x7fcb900b2490 2023-10-06T02:28:06.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.310+0000 7fcb8cff9700 1 --2- 172.21.15.6:0/1654124718 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb70066f30 0x7fcb700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:06.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.310+0000 7fcb8cff9700 1 -- 172.21.15.6:0/1654124718 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 8958+0+0 (secure 0 0 0) 0x7fcb88084d30 con 0x7fcb900b2490 2023-10-06T02:28:06.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.310+0000 7fcb8ffff700 1 --2- 172.21.15.6:0/1654124718 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb70066f30 0x7fcb700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:06.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.311+0000 7fcb8ffff700 1 --2- 172.21.15.6:0/1654124718 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb70066f30 0x7fcb700693e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fcb900af690 tx=0x7fcb80007510 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:06.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.314+0000 7fcb8cff9700 1 -- 172.21.15.6:0/1654124718 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb88051330 con 0x7fcb900b2490 2023-10-06T02:28:06.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:06.590+0000 7fcb96d13700 1 -- 172.21.15.6:0/1654124718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fcb900cbed0 con 0x7fcb900b2490 2023-10-06T02:28:07.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.171+0000 7fcb8cff9700 1 -- 172.21.15.6:0/1654124718 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v277) v1 ==== 101+0+0 (secure 0 0 0) 0x7fcb88054950 con 0x7fcb900b2490 2023-10-06T02:28:07.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.173+0000 7fcb96d13700 1 -- 172.21.15.6:0/1654124718 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb70066f30 msgr2=0x7fcb700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.173+0000 7fcb96d13700 1 --2- 172.21.15.6:0/1654124718 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb70066f30 0x7fcb700693e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fcb900af690 tx=0x7fcb80007510 comp rx=0 tx=0).stop 2023-10-06T02:28:07.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.173+0000 7fcb96d13700 1 -- 172.21.15.6:0/1654124718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb900b2490 msgr2=0x7fcb900c72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.173+0000 7fcb96d13700 1 --2- 172.21.15.6:0/1654124718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb900b2490 0x7fcb900c72f0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800c7e0 tx=0x7fcb88007df0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.173+0000 7fcb96d13700 1 -- 172.21.15.6:0/1654124718 shutdown_connections 2023-10-06T02:28:07.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.173+0000 7fcb96d13700 1 --2- 172.21.15.6:0/1654124718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb90159150 0x7fcb90148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.173+0000 7fcb96d13700 1 --2- 172.21.15.6:0/1654124718 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb70066f30 0x7fcb700693e0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.173+0000 7fcb96d13700 1 --2- 172.21.15.6:0/1654124718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb900b2490 0x7fcb900c72f0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.173+0000 7fcb96d13700 1 --2- 172.21.15.6:0/1654124718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb900b2860 0x7fcb90148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.174+0000 7fcb96d13700 1 -- 172.21.15.6:0/1654124718 >> 172.21.15.6:0/1654124718 conn(0x7fcb90068680 msgr2=0x7fcb900b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:07.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.174+0000 7fcb96d13700 1 -- 172.21.15.6:0/1654124718 shutdown_connections 2023-10-06T02:28:07.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.174+0000 7fcb96d13700 1 -- 172.21.15.6:0/1654124718 wait complete. 2023-10-06T02:28:07.177 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:28:07.189 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:28:07.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.228+0000 7f9f0dbf3000 1 Processor -- start 2023-10-06T02:28:07.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.228+0000 7f9f0dbf3000 1 -- start start 2023-10-06T02:28:07.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.228+0000 7f9f0dbf3000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a55fefe30 0x564a56093640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.228+0000 7f9f0dbf3000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564a55ff29e0 0x564a560968f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.228+0000 7f9f0dbf3000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a56098f50 0x564a55fc2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.228+0000 7f9f0dbf3000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a55f6b320 con 0x564a55ff29e0 2023-10-06T02:28:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.228+0000 7f9f0dbf3000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a55f0f980 con 0x564a56098f50 2023-10-06T02:28:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.228+0000 7f9f0dbf3000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a55f0f620 con 0x564a55fefe30 2023-10-06T02:28:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.228+0000 7f9f0662d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564a55ff29e0 0x564a560968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.228+0000 7f9f0662d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564a55ff29e0 0x564a560968f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50670/0 (socket says 172.21.15.6:50670) 2023-10-06T02:28:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.228+0000 7f9f0662d700 1 -- 172.21.15.6:0/3073250650 learned_addr learned my addr 172.21.15.6:0/3073250650 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.229+0000 7f9f0662d700 1 -- 172.21.15.6:0/3073250650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a55fefe30 msgr2=0x564a56093640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.229+0000 7f9f06e2e700 1 --2- 172.21.15.6:0/3073250650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a55fefe30 0x564a56093640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.229+0000 7f9f0762f700 1 --2- 172.21.15.6:0/3073250650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a56098f50 0x564a55fc2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.229+0000 7f9f0662d700 1 --2- 172.21.15.6:0/3073250650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a55fefe30 0x564a56093640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.229+0000 7f9f0662d700 1 -- 172.21.15.6:0/3073250650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a56098f50 msgr2=0x564a55fc2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.229+0000 7f9f0662d700 1 --2- 172.21.15.6:0/3073250650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a56098f50 0x564a55fc2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.229+0000 7f9f0662d700 1 -- 172.21.15.6:0/3073250650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef0005cf0 con 0x564a55ff29e0 2023-10-06T02:28:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.229+0000 7f9f06e2e700 1 --2- 172.21.15.6:0/3073250650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a55fefe30 0x564a56093640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.229+0000 7f9f0762f700 1 --2- 172.21.15.6:0/3073250650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a56098f50 0x564a55fc2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.229+0000 7f9f0662d700 1 --2- 172.21.15.6:0/3073250650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564a55ff29e0 0x564a560968f0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0005570 tx=0x7f9ef0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b26f58d48ebc780 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.229+0000 7f9f0562b700 1 -- 172.21.15.6:0/3073250650 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0002f90 con 0x564a55ff29e0 2023-10-06T02:28:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.229+0000 7f9f0562b700 1 -- 172.21.15.6:0/3073250650 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef0000bc0 con 0x564a55ff29e0 2023-10-06T02:28:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.229+0000 7f9f0562b700 1 -- 172.21.15.6:0/3073250650 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0008c00 con 0x564a55ff29e0 2023-10-06T02:28:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.230+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/3073250650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564a55ff29e0 msgr2=0x564a560968f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.230+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/3073250650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564a55ff29e0 0x564a560968f0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0005570 tx=0x7f9ef0016000 comp rx=0 tx=0).stop 2023-10-06T02:28:07.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.230+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/3073250650 shutdown_connections 2023-10-06T02:28:07.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.230+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/3073250650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a56098f50 0x564a55fc2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.230+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/3073250650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a55fefe30 0x564a56093640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.230+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/3073250650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564a55ff29e0 0x564a560968f0 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.230+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/3073250650 >> 172.21.15.6:0/3073250650 conn(0x564a5600bbd0 msgr2=0x564a55ff22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:07.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.230+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/3073250650 shutdown_connections 2023-10-06T02:28:07.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.230+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/3073250650 wait complete. 2023-10-06T02:28:07.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.230+0000 7f9f0dbf3000 1 Processor -- start 2023-10-06T02:28:07.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.230+0000 7f9f0dbf3000 1 -- start start 2023-10-06T02:28:07.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.231+0000 7f9f0dbf3000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564a55fefe30 0x564a55ff0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.231+0000 7f9f0dbf3000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a55ff29e0 0x564a5608dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.231+0000 7f9f0dbf3000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a56098f50 0x564a55fc2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.231+0000 7f9f0dbf3000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a55f06400 con 0x564a55fefe30 2023-10-06T02:28:07.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.231+0000 7f9f0dbf3000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5608e3c0 con 0x564a56098f50 2023-10-06T02:28:07.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.231+0000 7f9f0dbf3000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a5608e660 con 0x564a55ff29e0 2023-10-06T02:28:07.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.231+0000 7f9f06e2e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564a55fefe30 0x564a55ff0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.231+0000 7f9f06e2e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564a55fefe30 0x564a55ff0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50678/0 (socket says 172.21.15.6:50678) 2023-10-06T02:28:07.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.231+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 learned_addr learned my addr 172.21.15.6:0/1870003 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:07.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.231+0000 7f9f0662d700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a55ff29e0 0x564a5608dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.231+0000 7f9f0762f700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a56098f50 0x564a55fc2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.232+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a55ff29e0 msgr2=0x564a5608dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.232+0000 7f9f06e2e700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a55ff29e0 0x564a5608dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.232+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a56098f50 msgr2=0x564a55fc2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.232+0000 7f9f06e2e700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a56098f50 0x564a55fc2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.232+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a55f1e3d0 con 0x564a55fefe30 2023-10-06T02:28:07.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.232+0000 7f9f06e2e700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564a55fefe30 0x564a55ff0c30 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f9f000016c0 tx=0x7f9f00008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:07.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.232+0000 7f9eff7fe700 1 -- 172.21.15.6:0/1870003 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0000a070 con 0x564a55fefe30 2023-10-06T02:28:07.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.232+0000 7f9eff7fe700 1 -- 172.21.15.6:0/1870003 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f00002110 con 0x564a55fefe30 2023-10-06T02:28:07.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.232+0000 7f9eff7fe700 1 -- 172.21.15.6:0/1870003 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f00006300 con 0x564a55fefe30 2023-10-06T02:28:07.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.232+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564a55f11ae0 con 0x564a55fefe30 2023-10-06T02:28:07.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.232+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a55f11540 con 0x564a55fefe30 2023-10-06T02:28:07.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.233+0000 7f9eff7fe700 1 -- 172.21.15.6:0/1870003 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f00004750 con 0x564a55fefe30 2023-10-06T02:28:07.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.234+0000 7f9eff7fe700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ee8065890 0x7f9ee8067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.234+0000 7f9eff7fe700 1 -- 172.21.15.6:0/1870003 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 8958+0+0 (secure 0 0 0) 0x7f9f00083300 con 0x564a55fefe30 2023-10-06T02:28:07.240 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:28:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.234+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x564a55fc3320 0x564a56099830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.234+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a5608f7d0 con 0x564a55fc3320 2023-10-06T02:28:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.234+0000 7f9f0662d700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ee8065890 0x7f9ee8067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.234+0000 7f9f0762f700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x564a55fc3320 0x564a56099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.235+0000 7f9f0762f700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x564a55fc3320 0x564a56099830 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.235+0000 7f9f0662d700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ee8065890 0x7f9ee8067d40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0005b40 tx=0x7f9ef001e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.237+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v125'908 uv882 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.237+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a56086380 con 0x564a55fc3320 2023-10-06T02:28:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.238+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v125'909 uv909 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.238+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a56086760 con 0x564a55fc3320 2023-10-06T02:28:07.243 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:28:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.240+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v125'910 uv910 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.240+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a56086b40 con 0x564a55fc3320 2023-10-06T02:28:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.241+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v125'911 uv911 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.241+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b9300 con 0x564a55fc3320 2023-10-06T02:28:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.242+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v125'912 uv912 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.242+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b87e0 con 0x564a55fc3320 2023-10-06T02:28:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.244+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v125'913 uv913 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.244+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b8c10 con 0x564a55fc3320 2023-10-06T02:28:07.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.245+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v125'914 uv888 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.245+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b96b0 con 0x564a55fc3320 2023-10-06T02:28:07.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.246+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v125'915 uv915 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.246+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b96b0 con 0x564a55fc3320 2023-10-06T02:28:07.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.248+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v125'916 uv916 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.249 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:28:07.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.248+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560ba6c0 con 0x564a55fc3320 2023-10-06T02:28:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.249+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v125'917 uv917 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.249+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560ba6c0 con 0x564a55fc3320 2023-10-06T02:28:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.250+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v125'918 uv918 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.250+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b96b0 con 0x564a55fc3320 2023-10-06T02:28:07.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.251+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v125'919 uv919 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.251+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b96b0 con 0x564a55fc3320 2023-10-06T02:28:07.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.253+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v125'920 uv895 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.253+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b96b0 con 0x564a55fc3320 2023-10-06T02:28:07.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.254+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v125'921 uv921 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.254+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b96b0 con 0x564a55fc3320 2023-10-06T02:28:07.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.255+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v125'922 uv922 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.257 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:28:07.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.255+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560ba6c0 con 0x564a55fc3320 2023-10-06T02:28:07.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.256+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v125'923 uv923 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.256+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560ba6c0 con 0x564a55fc3320 2023-10-06T02:28:07.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.258+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v125'924 uv924 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.258+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b96b0 con 0x564a55fc3320 2023-10-06T02:28:07.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.259+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v125'925 uv925 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.259+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b96b0 con 0x564a55fc3320 2023-10-06T02:28:07.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.260+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v125'926 uv926 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.260+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b96b0 con 0x564a55fc3320 2023-10-06T02:28:07.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.262+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v125'927 uv901 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.262+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b96b0 con 0x564a55fc3320 2023-10-06T02:28:07.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.263+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v125'928 uv928 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.263+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b96b0 con 0x564a55fc3320 2023-10-06T02:28:07.266 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:28:07.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.264+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v125'929 uv929 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.265+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560ba6c0 con 0x564a55fc3320 2023-10-06T02:28:07.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.266+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v125'930 uv930 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.266+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560ba6c0 con 0x564a55fc3320 2023-10-06T02:28:07.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.268+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v125'931 uv931 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.268+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b96b0 con 0x564a55fc3320 2023-10-06T02:28:07.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.269+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v125'932 uv932 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.269+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b96b0 con 0x564a55fc3320 2023-10-06T02:28:07.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.270+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v125'933 uv907 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.270+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b96b0 con 0x564a55fc3320 2023-10-06T02:28:07.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.272+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v125'934 uv934 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.272+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b96b0 con 0x564a55fc3320 2023-10-06T02:28:07.274 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:28:07.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.273+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v125'935 uv935 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.273+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560ba6c0 con 0x564a55fc3320 2023-10-06T02:28:07.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.274+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v125'936 uv936 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.274+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560ba6c0 con 0x564a55fc3320 2023-10-06T02:28:07.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.275+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v125'937 uv937 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.275+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560b96b0 con 0x564a55fc3320 2023-10-06T02:28:07.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.277+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v125'938 uv938 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a55fc3320 2023-10-06T02:28:07.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.277+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x564a560b9bc0 0x564a560bbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.277+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560bc4e0 con 0x564a560b9bc0 2023-10-06T02:28:07.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.277+0000 7f9f06e2e700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x564a560b9bc0 0x564a560bbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.277+0000 7f9f06e2e700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x564a560b9bc0 0x564a560bbfa0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:07.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.279+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v125'652 uv635 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.279+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560bc890 con 0x564a560b9bc0 2023-10-06T02:28:07.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.280+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v125'653 uv653 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.280+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560bcd30 con 0x564a560b9bc0 2023-10-06T02:28:07.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.281+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v125'654 uv654 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.283 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:28:07.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.281+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560bd640 con 0x564a560b9bc0 2023-10-06T02:28:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.282+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v125'655 uv655 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.282+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560bd1d0 con 0x564a560b9bc0 2023-10-06T02:28:07.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.284+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v125'656 uv656 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.284+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560bdee0 con 0x564a560b9bc0 2023-10-06T02:28:07.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.285+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v125'657 uv640 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.285+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560be290 con 0x564a560b9bc0 2023-10-06T02:28:07.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.286+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v125'658 uv658 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.286+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560be640 con 0x564a560b9bc0 2023-10-06T02:28:07.288 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:28:07.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.287+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v125'659 uv659 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.287+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560be640 con 0x564a560b9bc0 2023-10-06T02:28:07.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.288+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v125'660 uv660 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.288+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560bda70 con 0x564a560b9bc0 2023-10-06T02:28:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.289+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v125'661 uv661 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.289+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560bda70 con 0x564a560b9bc0 2023-10-06T02:28:07.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.290+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v125'662 uv645 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.290+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560be640 con 0x564a560b9bc0 2023-10-06T02:28:07.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.292+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v125'663 uv663 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.292+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560be640 con 0x564a560b9bc0 2023-10-06T02:28:07.294 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:28:07.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.293+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v125'664 uv664 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.293+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c1d60 con 0x564a560b9bc0 2023-10-06T02:28:07.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.294+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v125'665 uv665 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.294+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560bda70 con 0x564a560b9bc0 2023-10-06T02:28:07.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.295+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v125'666 uv666 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.295+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560bda70 con 0x564a560b9bc0 2023-10-06T02:28:07.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.296+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v125'667 uv651 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.296+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560be640 con 0x564a560b9bc0 2023-10-06T02:28:07.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.298+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v125'668 uv668 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.298+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560be640 con 0x564a560b9bc0 2023-10-06T02:28:07.300 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:28:07.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.299+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v125'669 uv669 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.299+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560bf650 con 0x564a560b9bc0 2023-10-06T02:28:07.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.300+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v125'670 uv670 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.300+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560bf650 con 0x564a560b9bc0 2023-10-06T02:28:07.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.301+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v125'671 uv671 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.301+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560be640 con 0x564a560b9bc0 2023-10-06T02:28:07.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.302+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v125'672 uv672 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.302+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x564a560beba0 0x564a560c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.302+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c1560 con 0x564a560beba0 2023-10-06T02:28:07.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.302+0000 7f9f0662d700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x564a560beba0 0x564a560c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.303+0000 7f9f0662d700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x564a560beba0 0x564a560c0f80 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:07.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.304+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v125'177 uv176 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.304+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c1a20 con 0x564a560beba0 2023-10-06T02:28:07.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.305+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v125'178 uv178 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.305+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c1fa0 con 0x564a560beba0 2023-10-06T02:28:07.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.306+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v125'179 uv179 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.307 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:28:07.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.306+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c38a0 con 0x564a560beba0 2023-10-06T02:28:07.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.307+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v125'180 uv180 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.307+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c3c50 con 0x564a560beba0 2023-10-06T02:28:07.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.308+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v125'181 uv181 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.308+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c2890 con 0x564a560beba0 2023-10-06T02:28:07.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.309+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v125'182 uv182 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.309+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c2c90 con 0x564a560beba0 2023-10-06T02:28:07.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.310+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v125'125 uv124 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.310+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c30e0 con 0x564a560beba0 2023-10-06T02:28:07.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.311+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v125'126 uv126 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.311+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c30e0 con 0x564a560beba0 2023-10-06T02:28:07.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.312+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v125'127 uv127 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.313 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:28:07.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.312+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c3090 con 0x564a560beba0 2023-10-06T02:28:07.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.312+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v125'128 uv128 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.312+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c3060 con 0x564a560b9bc0 2023-10-06T02:28:07.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.314+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v125'177 uv176 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.314+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c3060 con 0x564a560b9bc0 2023-10-06T02:28:07.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.315+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v125'178 uv178 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.315+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c3060 con 0x564a560b9bc0 2023-10-06T02:28:07.318 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:28:07.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.316+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v125'179 uv179 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.316+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c3060 con 0x564a560b9bc0 2023-10-06T02:28:07.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.317+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v125'180 uv180 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.317+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c34f0 con 0x564a560b9bc0 2023-10-06T02:28:07.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.318+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v125'181 uv181 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.318+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c34f0 con 0x564a560b9bc0 2023-10-06T02:28:07.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.319+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v125'182 uv182 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560b9bc0 2023-10-06T02:28:07.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.319+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564a560c34a0 0x564a560c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.319+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c6a60 con 0x564a560c34a0 2023-10-06T02:28:07.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.319+0000 7f9f0762f700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564a560c34a0 0x564a560c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.319+0000 7f9f0762f700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564a560c34a0 0x564a560c6520 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:07.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.320+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v125'327 uv321 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560c34a0 2023-10-06T02:28:07.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.320+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c6a60 con 0x564a560c34a0 2023-10-06T02:28:07.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.321+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v125'328 uv328 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560c34a0 2023-10-06T02:28:07.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.321+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c6a60 con 0x564a560c34a0 2023-10-06T02:28:07.324 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:28:07.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.323+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v125'329 uv329 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560c34a0 2023-10-06T02:28:07.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.323+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c7ab0 con 0x564a560c34a0 2023-10-06T02:28:07.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.324+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v125'330 uv330 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560c34a0 2023-10-06T02:28:07.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.324+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c7a70 con 0x564a560c34a0 2023-10-06T02:28:07.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.325+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v125'331 uv331 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560c34a0 2023-10-06T02:28:07.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.325+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c6a60 con 0x564a560c34a0 2023-10-06T02:28:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.327+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v125'332 uv332 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560c34a0 2023-10-06T02:28:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.327+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c6a60 con 0x564a560c34a0 2023-10-06T02:28:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.328+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v125'333 uv326 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560c34a0 2023-10-06T02:28:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.328+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c6a60 con 0x564a560c34a0 2023-10-06T02:28:07.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.329+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v125'334 uv334 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560c34a0 2023-10-06T02:28:07.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.329+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c6a60 con 0x564a560c34a0 2023-10-06T02:28:07.331 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:28:07.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.330+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v125'335 uv335 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560c34a0 2023-10-06T02:28:07.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.330+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c6a60 con 0x564a560c34a0 2023-10-06T02:28:07.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.334+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v125'336 uv336 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560c34a0 2023-10-06T02:28:07.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.334+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c6eb0 con 0x564a560c34a0 2023-10-06T02:28:07.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.334+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v125'337 uv337 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560c34a0 2023-10-06T02:28:07.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.335+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x564a560c73c0 0x564a560c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.335+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c9eb0 con 0x564a560c73c0 2023-10-06T02:28:07.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.335+0000 7f9f06e2e700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x564a560c73c0 0x564a560c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.335+0000 7f9f06e2e700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x564a560c73c0 0x564a560c77f0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.336+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v125'148 uv147 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560c73c0 2023-10-06T02:28:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.336+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c9eb0 con 0x564a560c73c0 2023-10-06T02:28:07.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.338+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v125'149 uv149 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560c73c0 2023-10-06T02:28:07.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.338+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c9eb0 con 0x564a560c73c0 2023-10-06T02:28:07.340 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:28:07.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.339+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v125'150 uv150 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560c73c0 2023-10-06T02:28:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.339+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560c9eb0 con 0x564a560c73c0 2023-10-06T02:28:07.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.340+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v125'151 uv151 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560c73c0 2023-10-06T02:28:07.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.340+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560ca300 con 0x564a560c73c0 2023-10-06T02:28:07.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.341+0000 7f9f06e2e700 1 -- 172.21.15.6:0/1870003 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v125'152 uv152 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f00080be0 con 0x564a560c73c0 2023-10-06T02:28:07.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.341+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560ca300 con 0x564a560beba0 2023-10-06T02:28:07.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.342+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v125'177 uv176 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.342+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560ca300 con 0x564a560beba0 2023-10-06T02:28:07.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.343+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v125'178 uv178 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.343+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560ca300 con 0x564a560beba0 2023-10-06T02:28:07.345 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:28:07.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.344+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v125'179 uv179 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.344+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560cb310 con 0x564a560beba0 2023-10-06T02:28:07.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.345+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v125'180 uv180 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.345+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560cb310 con 0x564a560beba0 2023-10-06T02:28:07.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.346+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v125'181 uv181 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.346+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560ca300 con 0x564a560beba0 2023-10-06T02:28:07.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.347+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v125'182 uv182 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.347+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x564a560ca810 0x564a560ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.347+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560cd1c0 con 0x564a560ca810 2023-10-06T02:28:07.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.347+0000 7f9f0662d700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x564a560ca810 0x564a560ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.348+0000 7f9f0662d700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x564a560ca810 0x564a560ccbf0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:07.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.349+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v125'294 uv288 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560ca810 2023-10-06T02:28:07.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.349+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560cd200 con 0x564a560ca810 2023-10-06T02:28:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.350+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v125'295 uv295 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560ca810 2023-10-06T02:28:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.350+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560cd600 con 0x564a560ca810 2023-10-06T02:28:07.352 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:28:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.351+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v125'296 uv296 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560ca810 2023-10-06T02:28:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.351+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560cd600 con 0x564a560ca810 2023-10-06T02:28:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.352+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v125'297 uv297 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560ca810 2023-10-06T02:28:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.352+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560cd600 con 0x564a560ca810 2023-10-06T02:28:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.353+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v125'298 uv298 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560ca810 2023-10-06T02:28:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.353+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560cd600 con 0x564a560ca810 2023-10-06T02:28:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.354+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v125'299 uv293 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560ca810 2023-10-06T02:28:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.354+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560cd600 con 0x564a560ca810 2023-10-06T02:28:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.355+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v125'300 uv300 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560ca810 2023-10-06T02:28:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.355+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560cd600 con 0x564a560ca810 2023-10-06T02:28:07.357 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:28:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.356+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v125'301 uv301 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560ca810 2023-10-06T02:28:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.356+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560cd600 con 0x564a560ca810 2023-10-06T02:28:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.357+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v125'302 uv302 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560ca810 2023-10-06T02:28:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.357+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0370 con 0x564a560ca810 2023-10-06T02:28:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.358+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v125'303 uv303 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560ca810 2023-10-06T02:28:07.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.358+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560cdaf0 con 0x564a560beba0 2023-10-06T02:28:07.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.359+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v125'128 uv127 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.359+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560cdaf0 con 0x564a560beba0 2023-10-06T02:28:07.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.360+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v125'129 uv129 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.360+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560cdaf0 con 0x564a560beba0 2023-10-06T02:28:07.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.361+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v125'130 uv130 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.363 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:28:07.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.361+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560cdaf0 con 0x564a560beba0 2023-10-06T02:28:07.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.362+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v125'131 uv131 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.362+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x564a560ce000 0x564a560ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.362+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0ac0 con 0x564a560ce000 2023-10-06T02:28:07.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.363+0000 7f9f0762f700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x564a560ce000 0x564a560ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.363+0000 7f9f0762f700 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x564a560ce000 0x564a560ce3f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:07.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.364+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v125'177 uv176 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560ce000 2023-10-06T02:28:07.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.364+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0ac0 con 0x564a560ce000 2023-10-06T02:28:07.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.365+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v125'178 uv178 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560ce000 2023-10-06T02:28:07.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.365+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0ac0 con 0x564a560ce000 2023-10-06T02:28:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.366+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v125'179 uv179 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560ce000 2023-10-06T02:28:07.368 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:28:07.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.367+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d1ad0 con 0x564a560ce000 2023-10-06T02:28:07.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.368+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v125'180 uv180 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560ce000 2023-10-06T02:28:07.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.368+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d1ad0 con 0x564a560ce000 2023-10-06T02:28:07.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.370+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v125'181 uv181 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560ce000 2023-10-06T02:28:07.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.370+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0ac0 con 0x564a560ce000 2023-10-06T02:28:07.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.371+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v125'182 uv182 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560ce000 2023-10-06T02:28:07.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.371+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0ac0 con 0x564a560c34a0 2023-10-06T02:28:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.372+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v125'151 uv150 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560c34a0 2023-10-06T02:28:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.372+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0ac0 con 0x564a560c34a0 2023-10-06T02:28:07.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.373+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v125'152 uv152 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560c34a0 2023-10-06T02:28:07.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.373+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0ac0 con 0x564a560c34a0 2023-10-06T02:28:07.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.374+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v125'153 uv153 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560c34a0 2023-10-06T02:28:07.375 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:28:07.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.374+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0ac0 con 0x564a560c34a0 2023-10-06T02:28:07.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.375+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v125'154 uv154 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560c34a0 2023-10-06T02:28:07.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.375+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0ac0 con 0x564a560c34a0 2023-10-06T02:28:07.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.376+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v125'155 uv155 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9ef800f6e0 con 0x564a560c34a0 2023-10-06T02:28:07.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.376+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0ac0 con 0x564a560beba0 2023-10-06T02:28:07.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.377+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v125'363 uv355 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.377+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0ac0 con 0x564a560beba0 2023-10-06T02:28:07.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.378+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v125'364 uv364 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.378+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0ac0 con 0x564a560beba0 2023-10-06T02:28:07.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.379+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v125'365 uv365 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.380 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:28:07.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.379+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0ac0 con 0x564a560beba0 2023-10-06T02:28:07.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.380+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v125'366 uv366 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.380+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0ea0 con 0x564a560beba0 2023-10-06T02:28:07.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.381+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v125'367 uv367 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.381+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0b40 con 0x564a560beba0 2023-10-06T02:28:07.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.382+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v125'368 uv362 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.382+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0ac0 con 0x564a560beba0 2023-10-06T02:28:07.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.383+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v125'369 uv369 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.383+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0ac0 con 0x564a560beba0 2023-10-06T02:28:07.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.384+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v125'370 uv370 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.385 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:28:07.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.384+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d1ad0 con 0x564a560beba0 2023-10-06T02:28:07.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.385+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v125'371 uv371 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.385+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d1ad0 con 0x564a560beba0 2023-10-06T02:28:07.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.385+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v125'372 uv372 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.385+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0fb0 con 0x564a560beba0 2023-10-06T02:28:07.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.387+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v125'373 uv373 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.387+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x564a560d0fb0 con 0x564a560beba0 2023-10-06T02:28:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.387+0000 7f9f0662d700 1 -- 172.21.15.6:0/1870003 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v125'374 uv374 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9ef0026700 con 0x564a560beba0 2023-10-06T02:28:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x564a560beba0 msgr2=0x564a560c0f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x564a560beba0 0x564a560c0f80 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x564a55fc3320 msgr2=0x564a56099830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x564a55fc3320 0x564a56099830 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x564a560ca810 msgr2=0x564a560ccbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x564a560ca810 0x564a560ccbf0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x564a560b9bc0 msgr2=0x564a560bbfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x564a560b9bc0 0x564a560bbfa0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x564a560ce000 msgr2=0x564a560ce3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x564a560ce000 0x564a560ce3f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x564a560c73c0 msgr2=0x564a560c77f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 reap_dead start 2023-10-06T02:28:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x564a560c73c0 0x564a560c77f0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0762f700 1 -- 172.21.15.6:0/1870003 reap_dead start 2023-10-06T02:28:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564a560c34a0 msgr2=0x564a560c6520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564a560c34a0 0x564a560c6520 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ee8065890 msgr2=0x7f9ee8067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ee8065890 0x7f9ee8067d40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0005b40 tx=0x7f9ef001e000 comp rx=0 tx=0).stop 2023-10-06T02:28:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564a55fefe30 msgr2=0x564a55ff0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564a55fefe30 0x564a55ff0c30 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f9f000016c0 tx=0x7f9f00008040 comp rx=0 tx=0).stop 2023-10-06T02:28:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 shutdown_connections 2023-10-06T02:28:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x564a560c73c0 0x564a560c77f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564a560c34a0 0x564a560c6520 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564a55fefe30 0x564a55ff0c30 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 --2- 172.21.15.6:0/1870003 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ee8065890 0x7f9ee8067d40 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 >> 172.21.15.6:0/1870003 conn(0x564a5600bbd0 msgr2=0x564a55ff22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 shutdown_connections 2023-10-06T02:28:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.388+0000 7f9f0dbf3000 1 -- 172.21.15.6:0/1870003 wait complete. 2023-10-06T02:28:07.395 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata truncate 100.00000000.inode 0 2023-10-06T02:28:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.473+0000 7fc964ca3000 1 Processor -- start 2023-10-06T02:28:07.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.473+0000 7fc964ca3000 1 -- start start 2023-10-06T02:28:07.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc964ca3000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc948002300 0x56212940fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc964ca3000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621293f32e0 0x5621294105f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc964ca3000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562129410b30 0x5621293f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc964ca3000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562129282980 con 0x5621293f32e0 2023-10-06T02:28:07.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc964ca3000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562129282620 con 0x562129410b30 2023-10-06T02:28:07.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc964ca3000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x562129279400 con 0x7fc948002300 2023-10-06T02:28:07.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc95d6dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621293f32e0 0x5621294105f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc95d6dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621293f32e0 0x5621294105f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50686/0 (socket says 172.21.15.6:50686) 2023-10-06T02:28:07.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc95d6dd700 1 -- 172.21.15.6:0/1238255260 learned_addr learned my addr 172.21.15.6:0/1238255260 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:07.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc95dede700 1 --2- 172.21.15.6:0/1238255260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc948002300 0x56212940fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc95e6df700 1 --2- 172.21.15.6:0/1238255260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562129410b30 0x5621293f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc95d6dd700 1 -- 172.21.15.6:0/1238255260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc948002300 msgr2=0x56212940fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:07.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc95d6dd700 1 --2- 172.21.15.6:0/1238255260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc948002300 0x56212940fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc95d6dd700 1 -- 172.21.15.6:0/1238255260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562129410b30 msgr2=0x5621293f3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:07.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc95d6dd700 1 --2- 172.21.15.6:0/1238255260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562129410b30 0x5621293f3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc95d6dd700 1 -- 172.21.15.6:0/1238255260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621292913d0 con 0x5621293f32e0 2023-10-06T02:28:07.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc95d6dd700 1 --2- 172.21.15.6:0/1238255260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621293f32e0 0x5621294105f0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fc9540098f0 tx=0x7fc95400c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75a0d4374d51f75 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:07.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.474+0000 7fc94ffff700 1 -- 172.21.15.6:0/1238255260 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95400f040 con 0x5621293f32e0 2023-10-06T02:28:07.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.475+0000 7fc94ffff700 1 -- 172.21.15.6:0/1238255260 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc954009e90 con 0x5621293f32e0 2023-10-06T02:28:07.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.475+0000 7fc94ffff700 1 -- 172.21.15.6:0/1238255260 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954008d60 con 0x5621293f32e0 2023-10-06T02:28:07.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.475+0000 7fc964ca3000 1 -- 172.21.15.6:0/1238255260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621293f32e0 msgr2=0x5621294105f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.475+0000 7fc964ca3000 1 --2- 172.21.15.6:0/1238255260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621293f32e0 0x5621294105f0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fc9540098f0 tx=0x7fc95400c040 comp rx=0 tx=0).stop 2023-10-06T02:28:07.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.475+0000 7fc964ca3000 1 -- 172.21.15.6:0/1238255260 shutdown_connections 2023-10-06T02:28:07.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.475+0000 7fc964ca3000 1 --2- 172.21.15.6:0/1238255260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562129410b30 0x5621293f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.475+0000 7fc964ca3000 1 --2- 172.21.15.6:0/1238255260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc948002300 0x56212940fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.475+0000 7fc964ca3000 1 --2- 172.21.15.6:0/1238255260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621293f32e0 0x5621294105f0 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.475+0000 7fc964ca3000 1 -- 172.21.15.6:0/1238255260 >> 172.21.15.6:0/1238255260 conn(0x56212937ebd0 msgr2=0x5621293662e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:07.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.475+0000 7fc964ca3000 1 -- 172.21.15.6:0/1238255260 shutdown_connections 2023-10-06T02:28:07.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.475+0000 7fc964ca3000 1 -- 172.21.15.6:0/1238255260 wait complete. 2023-10-06T02:28:07.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.476+0000 7fc964ca3000 1 Processor -- start 2023-10-06T02:28:07.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.476+0000 7fc964ca3000 1 -- start start 2023-10-06T02:28:07.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.476+0000 7fc964ca3000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621293f32e0 0x5621293f08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.476+0000 7fc964ca3000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562129410b30 0x5621293f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.476+0000 7fc964ca3000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc948002300 0x5621293f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.476+0000 7fc964ca3000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621293f15a0 con 0x5621293f32e0 2023-10-06T02:28:07.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.476+0000 7fc964ca3000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621293f1840 con 0x562129410b30 2023-10-06T02:28:07.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.476+0000 7fc964ca3000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621293f1ae0 con 0x7fc948002300 2023-10-06T02:28:07.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.477+0000 7fc95dede700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621293f32e0 0x5621293f08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.477+0000 7fc95dede700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621293f32e0 0x5621293f08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50692/0 (socket says 172.21.15.6:50692) 2023-10-06T02:28:07.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.477+0000 7fc95dede700 1 -- 172.21.15.6:0/243782629 learned_addr learned my addr 172.21.15.6:0/243782629 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:07.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.477+0000 7fc95d6dd700 1 --2- 172.21.15.6:0/243782629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562129410b30 0x5621293f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.477+0000 7fc95e6df700 1 --2- 172.21.15.6:0/243782629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc948002300 0x5621293f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.477+0000 7fc95dede700 1 -- 172.21.15.6:0/243782629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc948002300 msgr2=0x5621293f5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.477+0000 7fc95dede700 1 --2- 172.21.15.6:0/243782629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc948002300 0x5621293f5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.477+0000 7fc95dede700 1 -- 172.21.15.6:0/243782629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562129410b30 msgr2=0x5621293f2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.477+0000 7fc95dede700 1 --2- 172.21.15.6:0/243782629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562129410b30 0x5621293f2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.477+0000 7fc95dede700 1 -- 172.21.15.6:0/243782629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9540095a0 con 0x5621293f32e0 2023-10-06T02:28:07.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.477+0000 7fc95dede700 1 --2- 172.21.15.6:0/243782629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621293f32e0 0x5621293f08a0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fc95800af10 tx=0x7fc958018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:07.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.477+0000 7fc94e7fc700 1 -- 172.21.15.6:0/243782629 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958005b00 con 0x5621293f32e0 2023-10-06T02:28:07.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.477+0000 7fc94e7fc700 1 -- 172.21.15.6:0/243782629 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9580054f0 con 0x5621293f32e0 2023-10-06T02:28:07.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.477+0000 7fc94e7fc700 1 -- 172.21.15.6:0/243782629 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958020860 con 0x5621293f32e0 2023-10-06T02:28:07.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.477+0000 7fc964ca3000 1 -- 172.21.15.6:0/243782629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562129284ae0 con 0x5621293f32e0 2023-10-06T02:28:07.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.477+0000 7fc964ca3000 1 -- 172.21.15.6:0/243782629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562129284540 con 0x5621293f32e0 2023-10-06T02:28:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.478+0000 7fc94e7fc700 1 -- 172.21.15.6:0/243782629 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc958013070 con 0x5621293f32e0 2023-10-06T02:28:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.479+0000 7fc94e7fc700 1 --2- 172.21.15.6:0/243782629 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc9400658c0 0x7fc940067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.479+0000 7fc94e7fc700 1 -- 172.21.15.6:0/243782629 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 8958+0+0 (secure 0 0 0) 0x7fc9580858e0 con 0x5621293f32e0 2023-10-06T02:28:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.479+0000 7fc95d6dd700 1 --2- 172.21.15.6:0/243782629 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc9400658c0 0x7fc940067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.479+0000 7fc964ca3000 1 --2- 172.21.15.6:0/243782629 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5621293f0de0 0x56212941e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.479+0000 7fc964ca3000 1 -- 172.21.15.6:0/243782629 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.1f 14:fe07bba1:::100.00000000.inode:head [truncate 0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v8 -- 0x56212941ea60 con 0x5621293f0de0 2023-10-06T02:28:07.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.479+0000 7fc95e6df700 1 --2- 172.21.15.6:0/243782629 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5621293f0de0 0x56212941e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.479+0000 7fc95d6dd700 1 --2- 172.21.15.6:0/243782629 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc9400658c0 0x7fc940067d70 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc9540057a0 tx=0x7fc95401a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:07.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.480+0000 7fc95e6df700 1 --2- 172.21.15.6:0/243782629 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5621293f0de0 0x56212941e520 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:07.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.481+0000 7fc95e6df700 1 -- 172.21.15.6:0/243782629 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 100.00000000.inode [truncate 0] v125'375 uv375 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fc950006250 con 0x5621293f0de0 2023-10-06T02:28:07.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.481+0000 7fc964ca3000 1 -- 172.21.15.6:0/243782629 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5621293f0de0 msgr2=0x56212941e520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.481+0000 7fc964ca3000 1 --2- 172.21.15.6:0/243782629 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5621293f0de0 0x56212941e520 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.481+0000 7fc964ca3000 1 -- 172.21.15.6:0/243782629 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc9400658c0 msgr2=0x7fc940067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.481+0000 7fc964ca3000 1 --2- 172.21.15.6:0/243782629 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc9400658c0 0x7fc940067d70 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc9540057a0 tx=0x7fc95401a000 comp rx=0 tx=0).stop 2023-10-06T02:28:07.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.481+0000 7fc964ca3000 1 -- 172.21.15.6:0/243782629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621293f32e0 msgr2=0x5621293f08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.481+0000 7fc964ca3000 1 --2- 172.21.15.6:0/243782629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621293f32e0 0x5621293f08a0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fc95800af10 tx=0x7fc958018000 comp rx=0 tx=0).stop 2023-10-06T02:28:07.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.481+0000 7fc95e6df700 1 -- 172.21.15.6:0/243782629 reap_dead start 2023-10-06T02:28:07.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.481+0000 7fc964ca3000 1 -- 172.21.15.6:0/243782629 shutdown_connections 2023-10-06T02:28:07.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.481+0000 7fc964ca3000 1 -- 172.21.15.6:0/243782629 >> 172.21.15.6:0/243782629 conn(0x56212937ebd0 msgr2=0x5621293f6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:07.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.481+0000 7fc964ca3000 1 -- 172.21.15.6:0/243782629 shutdown_connections 2023-10-06T02:28:07.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.481+0000 7fc964ca3000 1 -- 172.21.15.6:0/243782629 wait complete. 2023-10-06T02:28:07.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:28:07.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.649+0000 7f52faaea700 1 Processor -- start 2023-10-06T02:28:07.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.649+0000 7f52faaea700 1 -- start start 2023-10-06T02:28:07.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.650+0000 7f52faaea700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f52f40ad140 0x7f52f40b3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.650+0000 7f52faaea700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f40b3c70 0x7f52f406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.650+0000 7f52faaea700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f406ec30 con 0x7f52f406de70 2023-10-06T02:28:07.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.650+0000 7f52faaea700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f406e290 con 0x7f52f40ad140 2023-10-06T02:28:07.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.650+0000 7f52faaea700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f4159c10 con 0x7f52f40b3c70 2023-10-06T02:28:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.650+0000 7f52fa2e9700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f52f406de70 0x7f52f415ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47354/0 (socket says 172.21.15.6:47354) 2023-10-06T02:28:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.650+0000 7f52fa2e9700 1 -- 172.21.15.6:0/4239803037 learned_addr learned my addr 172.21.15.6:0/4239803037 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.650+0000 7f52f92e7700 1 --2- 172.21.15.6:0/4239803037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f40b3c70 0x7f52f406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.650+0000 7f52f9ae8700 1 --2- 172.21.15.6:0/4239803037 >> v2:172.21.15.175:3300/0 conn(0x7f52f40ad140 0x7f52f40b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.650+0000 7f52f8ae6700 1 -- 172.21.15.6:0/4239803037 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206037476 0 0) 0x7f52f406ec30 con 0x7f52f406de70 2023-10-06T02:28:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.650+0000 7f52f8ae6700 1 -- 172.21.15.6:0/4239803037 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e0003570 con 0x7f52f406de70 2023-10-06T02:28:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.650+0000 7f52f8ae6700 1 -- 172.21.15.6:0/4239803037 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 630941596 0 0) 0x7f52e0003570 con 0x7f52f406de70 2023-10-06T02:28:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.650+0000 7f52f9ae8700 1 -- 172.21.15.6:0/4239803037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f40b3c70 msgr2=0x7f52f406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.650+0000 7f52f9ae8700 1 --2- 172.21.15.6:0/4239803037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f40b3c70 0x7f52f406d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.651+0000 7f52f9ae8700 1 -- 172.21.15.6:0/4239803037 >> v1:172.21.15.6:6789/0 conn(0x7f52f406de70 legacy=0x7f52f415ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.651+0000 7f52f9ae8700 1 -- 172.21.15.6:0/4239803037 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f4159ef0 con 0x7f52f40ad140 2023-10-06T02:28:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.651+0000 7f52f92e7700 1 --2- 172.21.15.6:0/4239803037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f40b3c70 0x7f52f406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.651+0000 7f52f9ae8700 1 --2- 172.21.15.6:0/4239803037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52f40ad140 0x7f52f40b3730 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f52f00098e0 tx=0x7f52f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a70595c2a3428a3c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.651+0000 7f52f8ae6700 1 -- 172.21.15.6:0/4239803037 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0017f0 con 0x7f52f40ad140 2023-10-06T02:28:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.651+0000 7f52f8ae6700 1 -- 172.21.15.6:0/4239803037 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f0011420 con 0x7f52f40ad140 2023-10-06T02:28:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.651+0000 7f52f8ae6700 1 -- 172.21.15.6:0/4239803037 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f00117a0 con 0x7f52f40ad140 2023-10-06T02:28:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.651+0000 7f52faaea700 1 -- 172.21.15.6:0/4239803037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52f40ad140 msgr2=0x7f52f40b3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.651+0000 7f52faaea700 1 --2- 172.21.15.6:0/4239803037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52f40ad140 0x7f52f40b3730 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f52f00098e0 tx=0x7f52f00091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.651+0000 7f52faaea700 1 -- 172.21.15.6:0/4239803037 shutdown_connections 2023-10-06T02:28:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.651+0000 7f52faaea700 1 --2- 172.21.15.6:0/4239803037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52f40ad140 0x7f52f40b3730 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.651+0000 7f52faaea700 1 --2- 172.21.15.6:0/4239803037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f40b3c70 0x7f52f406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.651+0000 7f52faaea700 1 -- 172.21.15.6:0/4239803037 >> 172.21.15.6:0/4239803037 conn(0x7f52f40ce9d0 msgr2=0x7f52f406c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:07.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.652+0000 7f52faaea700 1 -- 172.21.15.6:0/4239803037 shutdown_connections 2023-10-06T02:28:07.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.652+0000 7f52faaea700 1 -- 172.21.15.6:0/4239803037 wait complete. 2023-10-06T02:28:07.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.653+0000 7f52faaea700 1 Processor -- start 2023-10-06T02:28:07.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.653+0000 7f52faaea700 1 -- start start 2023-10-06T02:28:07.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.653+0000 7f52faaea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f406de70 0x7f52f414e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.653+0000 7f52faaea700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f40ad140 0x7f52f40c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.653+0000 7f52faaea700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52f40c8f00 0x7f52f40c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.653+0000 7f52faaea700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f416b660 con 0x7f52f406de70 2023-10-06T02:28:07.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.653+0000 7f52faaea700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f4152040 con 0x7f52f40c8f00 2023-10-06T02:28:07.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.653+0000 7f52faaea700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f4152320 con 0x7f52f40ad140 2023-10-06T02:28:07.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.653+0000 7f52f9ae8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f406de70 0x7f52f414e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.654+0000 7f52f9ae8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f406de70 0x7f52f414e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50704/0 (socket says 172.21.15.6:50704) 2023-10-06T02:28:07.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.654+0000 7f52f9ae8700 1 -- 172.21.15.6:0/1034626603 learned_addr learned my addr 172.21.15.6:0/1034626603 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:07.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.654+0000 7f52fa2e9700 1 --2- 172.21.15.6:0/1034626603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52f40c8f00 0x7f52f40c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.654+0000 7f52f92e7700 1 --2- 172.21.15.6:0/1034626603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f40ad140 0x7f52f40c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.654+0000 7f52f9ae8700 1 -- 172.21.15.6:0/1034626603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f40ad140 msgr2=0x7f52f40c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.654+0000 7f52f9ae8700 1 --2- 172.21.15.6:0/1034626603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f40ad140 0x7f52f40c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.654+0000 7f52f9ae8700 1 -- 172.21.15.6:0/1034626603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52f40c8f00 msgr2=0x7f52f40c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:07.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.654+0000 7f52f9ae8700 1 --2- 172.21.15.6:0/1034626603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52f40c8f00 0x7f52f40c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:07.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.654+0000 7f52f9ae8700 1 -- 172.21.15.6:0/1034626603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e4009420 con 0x7f52f406de70 2023-10-06T02:28:07.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.654+0000 7f52f9ae8700 1 --2- 172.21.15.6:0/1034626603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f406de70 0x7f52f414e3a0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f52f4069190 tx=0x7f52f0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:07.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.654+0000 7f52e9ffb700 1 -- 172.21.15.6:0/1034626603 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f001caf0 con 0x7f52f406de70 2023-10-06T02:28:07.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.654+0000 7f52e9ffb700 1 -- 172.21.15.6:0/1034626603 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f001cc50 con 0x7f52f406de70 2023-10-06T02:28:07.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.654+0000 7f52faaea700 1 -- 172.21.15.6:0/1034626603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f0009420 con 0x7f52f406de70 2023-10-06T02:28:07.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.654+0000 7f52e9ffb700 1 -- 172.21.15.6:0/1034626603 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f001a450 con 0x7f52f406de70 2023-10-06T02:28:07.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.654+0000 7f52faaea700 1 -- 172.21.15.6:0/1034626603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f416b2f0 con 0x7f52f406de70 2023-10-06T02:28:07.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.655+0000 7f52faaea700 1 -- 172.21.15.6:0/1034626603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f4064aa0 con 0x7f52f406de70 2023-10-06T02:28:07.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.656+0000 7f52e9ffb700 1 -- 172.21.15.6:0/1034626603 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52f001a7e0 con 0x7f52f406de70 2023-10-06T02:28:07.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.656+0000 7f52e9ffb700 1 --2- 172.21.15.6:0/1034626603 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52d8066f30 0x7f52d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:07.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.656+0000 7f52e9ffb700 1 -- 172.21.15.6:0/1034626603 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 8958+0+0 (secure 0 0 0) 0x7f52f0086ae0 con 0x7f52f406de70 2023-10-06T02:28:07.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.656+0000 7f52f92e7700 1 --2- 172.21.15.6:0/1034626603 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52d8066f30 0x7f52d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:07.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.657+0000 7f52f92e7700 1 --2- 172.21.15.6:0/1034626603 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52d8066f30 0x7f52d80693e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f52f40cae00 tx=0x7f52e40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:07.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.661+0000 7f52e9ffb700 1 -- 172.21.15.6:0/1034626603 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52f0053060 con 0x7f52f406de70 2023-10-06T02:28:07.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:07.903+0000 7f52faaea700 1 -- 172.21.15.6:0/1034626603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f52f415a1d0 con 0x7f52f406de70 2023-10-06T02:28:08.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.177+0000 7f52e9ffb700 1 -- 172.21.15.6:0/1034626603 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v278) v1 ==== 162+0+0 (secure 0 0 0) 0x7f52f00290b0 con 0x7f52f406de70 2023-10-06T02:28:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.179+0000 7f52faaea700 1 -- 172.21.15.6:0/1034626603 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52d8066f30 msgr2=0x7f52d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.179+0000 7f52faaea700 1 --2- 172.21.15.6:0/1034626603 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52d8066f30 0x7f52d80693e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f52f40cae00 tx=0x7f52e40091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.179+0000 7f52faaea700 1 -- 172.21.15.6:0/1034626603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f406de70 msgr2=0x7f52f414e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.179+0000 7f52faaea700 1 --2- 172.21.15.6:0/1034626603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f406de70 0x7f52f414e3a0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f52f4069190 tx=0x7f52f0016000 comp rx=0 tx=0).stop 2023-10-06T02:28:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.179+0000 7f52faaea700 1 -- 172.21.15.6:0/1034626603 shutdown_connections 2023-10-06T02:28:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.179+0000 7f52faaea700 1 --2- 172.21.15.6:0/1034626603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52f40c8f00 0x7f52f40c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.179+0000 7f52faaea700 1 --2- 172.21.15.6:0/1034626603 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52d8066f30 0x7f52d80693e0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.179+0000 7f52faaea700 1 --2- 172.21.15.6:0/1034626603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f406de70 0x7f52f414e3a0 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.179+0000 7f52faaea700 1 --2- 172.21.15.6:0/1034626603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52f40ad140 0x7f52f40c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.179+0000 7f52faaea700 1 -- 172.21.15.6:0/1034626603 >> 172.21.15.6:0/1034626603 conn(0x7f52f40ce9d0 msgr2=0x7f52f40ae7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.179+0000 7f52faaea700 1 -- 172.21.15.6:0/1034626603 shutdown_connections 2023-10-06T02:28:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.180+0000 7f52faaea700 1 -- 172.21.15.6:0/1034626603 wait complete. 2023-10-06T02:28:08.183 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:28:08.189 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:28:08.187+0000 7f979d8cd700 -1 mds.0.cache.ino(0x100) No data while reading inode 0x100 2023-10-06T02:28:08.189 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:28:08.187+0000 7f979d8cd700 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2023-10-06T02:28:08.189 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:28:08.188+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:28:08.190 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:28:08.188+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:28:08.195 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:08.198 INFO:tasks.ceph.mds.a.smithi006.stderr: -23> 2023-10-06T02:28:08.187+0000 7f979d8cd700 -1 mds.0.cache.ino(0x100) No data while reading inode 0x100 2023-10-06T02:28:08.198 INFO:tasks.ceph.mds.a.smithi006.stderr: -13> 2023-10-06T02:28:08.187+0000 7f979d8cd700 -1 log_channel(cluster) log [ERR] : Error loading MDS rank 0: (2) No such file or directory 2023-10-06T02:28:08.217 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:28:08.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.314+0000 7f39afe5e700 1 Processor -- start 2023-10-06T02:28:08.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.315+0000 7f39afe5e700 1 -- start start 2023-10-06T02:28:08.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.315+0000 7f39afe5e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f39a80af4e0 0x7f39a80b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:08.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.315+0000 7f39afe5e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39a80af8b0 0x7f39a80b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:08.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.315+0000 7f39afe5e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39a815d460 0x7f39a815d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:08.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.315+0000 7f39afe5e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a80b1910 con 0x7f39a80af8b0 2023-10-06T02:28:08.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.315+0000 7f39afe5e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a815e190 con 0x7f39a80af4e0 2023-10-06T02:28:08.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.315+0000 7f39afe5e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80cb650 con 0x7f39a815d460 2023-10-06T02:28:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.316+0000 7f39ad3f9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39a80af8b0 0x7f39a80b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.316+0000 7f39ad3f9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39a80af8b0 0x7f39a80b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50714/0 (socket says 172.21.15.6:50714) 2023-10-06T02:28:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.316+0000 7f39ad3f9700 1 -- 172.21.15.6:0/3425296841 learned_addr learned my addr 172.21.15.6:0/3425296841 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.316+0000 7f39adbfa700 1 --2- 172.21.15.6:0/3425296841 >> v2:172.21.15.175:3300/0 conn(0x7f39a80af4e0 0x7f39a80b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.316+0000 7f39ae3fb700 1 --2- 172.21.15.6:0/3425296841 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39a815d460 0x7f39a815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.316+0000 7f39ad3f9700 1 -- 172.21.15.6:0/3425296841 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39a815d460 msgr2=0x7f39a815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.316+0000 7f39ad3f9700 1 --2- 172.21.15.6:0/3425296841 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39a815d460 0x7f39a815d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.316+0000 7f39ad3f9700 1 -- 172.21.15.6:0/3425296841 >> v2:172.21.15.175:3300/0 conn(0x7f39a80af4e0 msgr2=0x7f39a80b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.316+0000 7f39ad3f9700 1 --2- 172.21.15.6:0/3425296841 >> v2:172.21.15.175:3300/0 conn(0x7f39a80af4e0 0x7f39a80b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.316+0000 7f39ad3f9700 1 -- 172.21.15.6:0/3425296841 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a80b2b60 con 0x7f39a80af8b0 2023-10-06T02:28:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.316+0000 7f39adbfa700 1 --2- 172.21.15.6:0/3425296841 >> v2:172.21.15.175:3300/0 conn(0x7f39a80af4e0 0x7f39a80b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.316+0000 7f39ad3f9700 1 --2- 172.21.15.6:0/3425296841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a80af8b0 0x7f39a80b2620 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f39a80d1360 tx=0x7f399c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8d77196ed6d9d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.316+0000 7f39acbf8700 1 -- 172.21.15.6:0/3425296841 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c00b860 con 0x7f39a80af8b0 2023-10-06T02:28:08.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.316+0000 7f39acbf8700 1 -- 172.21.15.6:0/3425296841 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c00b9c0 con 0x7f39a80af8b0 2023-10-06T02:28:08.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.316+0000 7f39acbf8700 1 -- 172.21.15.6:0/3425296841 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c00bd60 con 0x7f39a80af8b0 2023-10-06T02:28:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.317+0000 7f39afe5e700 1 -- 172.21.15.6:0/3425296841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a80af8b0 msgr2=0x7f39a80b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.317+0000 7f39afe5e700 1 --2- 172.21.15.6:0/3425296841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a80af8b0 0x7f39a80b2620 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f39a80d1360 tx=0x7f399c009250 comp rx=0 tx=0).stop 2023-10-06T02:28:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.317+0000 7f39afe5e700 1 -- 172.21.15.6:0/3425296841 shutdown_connections 2023-10-06T02:28:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.317+0000 7f39afe5e700 1 --2- 172.21.15.6:0/3425296841 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39a815d460 0x7f39a815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.317+0000 7f39afe5e700 1 --2- 172.21.15.6:0/3425296841 >> v2:172.21.15.175:3300/0 conn(0x7f39a80af4e0 0x7f39a80b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.317+0000 7f39afe5e700 1 --2- 172.21.15.6:0/3425296841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a80af8b0 0x7f39a80b2620 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.317+0000 7f39afe5e700 1 -- 172.21.15.6:0/3425296841 >> 172.21.15.6:0/3425296841 conn(0x7f39a8068680 msgr2=0x7f39a8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.317+0000 7f39afe5e700 1 -- 172.21.15.6:0/3425296841 shutdown_connections 2023-10-06T02:28:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.317+0000 7f39afe5e700 1 -- 172.21.15.6:0/3425296841 wait complete. 2023-10-06T02:28:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.318+0000 7f39afe5e700 1 Processor -- start 2023-10-06T02:28:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.318+0000 7f39afe5e700 1 -- start start 2023-10-06T02:28:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.319+0000 7f39afe5e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39a80af4e0 0x7f39a8169b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.319+0000 7f39afe5e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39a80af8b0 0x7f39a80c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.319+0000 7f39afe5e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a815d460 0x7f39a80c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.319+0000 7f39afe5e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a8157b40 con 0x7f39a815d460 2023-10-06T02:28:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.319+0000 7f39afe5e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a816a0a0 con 0x7f39a80af8b0 2023-10-06T02:28:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.319+0000 7f39afe5e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80c8b30 con 0x7f39a80af4e0 2023-10-06T02:28:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.319+0000 7f39ae3fb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a815d460 0x7f39a80c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.319+0000 7f39ae3fb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a815d460 0x7f39a80c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50716/0 (socket says 172.21.15.6:50716) 2023-10-06T02:28:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.319+0000 7f39ae3fb700 1 -- 172.21.15.6:0/1912588740 learned_addr learned my addr 172.21.15.6:0/1912588740 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.319+0000 7f39adbfa700 1 --2- 172.21.15.6:0/1912588740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39a80af4e0 0x7f39a8169b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.319+0000 7f39ad3f9700 1 --2- 172.21.15.6:0/1912588740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39a80af8b0 0x7f39a80c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.319+0000 7f39ae3fb700 1 -- 172.21.15.6:0/1912588740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39a80af4e0 msgr2=0x7f39a8169b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.319+0000 7f39ae3fb700 1 --2- 172.21.15.6:0/1912588740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39a80af4e0 0x7f39a8169b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.319+0000 7f39ae3fb700 1 -- 172.21.15.6:0/1912588740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39a80af8b0 msgr2=0x7f39a80c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.319+0000 7f39ae3fb700 1 --2- 172.21.15.6:0/1912588740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39a80af8b0 0x7f39a80c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.319+0000 7f39ae3fb700 1 -- 172.21.15.6:0/1912588740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c0094f0 con 0x7f39a815d460 2023-10-06T02:28:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.319+0000 7f39ae3fb700 1 --2- 172.21.15.6:0/1912588740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a815d460 0x7f39a80c84b0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f39a000d860 tx=0x7f39a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.320+0000 7f39a5ffb700 1 -- 172.21.15.6:0/1912588740 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a00125f0 con 0x7f39a815d460 2023-10-06T02:28:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.320+0000 7f39a5ffb700 1 -- 172.21.15.6:0/1912588740 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a0012790 con 0x7f39a815d460 2023-10-06T02:28:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.320+0000 7f39afe5e700 1 -- 172.21.15.6:0/1912588740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a80c8e10 con 0x7f39a815d460 2023-10-06T02:28:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.320+0000 7f39a5ffb700 1 -- 172.21.15.6:0/1912588740 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0012b50 con 0x7f39a815d460 2023-10-06T02:28:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.320+0000 7f39afe5e700 1 -- 172.21.15.6:0/1912588740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a80c93d0 con 0x7f39a815d460 2023-10-06T02:28:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.321+0000 7f39afe5e700 1 -- 172.21.15.6:0/1912588740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a8088aa0 con 0x7f39a815d460 2023-10-06T02:28:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.321+0000 7f39a5ffb700 1 -- 172.21.15.6:0/1912588740 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f39a0013480 con 0x7f39a815d460 2023-10-06T02:28:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.322+0000 7f39a5ffb700 1 --2- 172.21.15.6:0/1912588740 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3994066f30 0x7f39940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.322+0000 7f39a5ffb700 1 -- 172.21.15.6:0/1912588740 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7f39a00855b0 con 0x7f39a815d460 2023-10-06T02:28:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.322+0000 7f39adbfa700 1 --2- 172.21.15.6:0/1912588740 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3994066f30 0x7f39940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.322+0000 7f39adbfa700 1 --2- 172.21.15.6:0/1912588740 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3994066f30 0x7f39940693e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3998007740 tx=0x7f39980099d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.326+0000 7f39a5ffb700 1 -- 172.21.15.6:0/1912588740 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39a0051ad0 con 0x7f39a815d460 2023-10-06T02:28:08.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.565+0000 7f39afe5e700 1 -- 172.21.15.6:0/1912588740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39a80cad20 con 0x7f39a815d460 2023-10-06T02:28:08.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.565+0000 7f39a5ffb700 1 -- 172.21.15.6:0/1912588740 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 280 v280) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f39a00550f0 con 0x7f39a815d460 2023-10-06T02:28:08.567 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:08.567 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":280,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":280,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:28:08.190129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:08.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.567+0000 7f39afe5e700 1 -- 172.21.15.6:0/1912588740 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3994066f30 msgr2=0x7f39940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:08.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.567+0000 7f39afe5e700 1 --2- 172.21.15.6:0/1912588740 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3994066f30 0x7f39940693e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3998007740 tx=0x7f39980099d0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.567+0000 7f39afe5e700 1 -- 172.21.15.6:0/1912588740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a815d460 msgr2=0x7f39a80c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.567+0000 7f39afe5e700 1 --2- 172.21.15.6:0/1912588740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a815d460 0x7f39a80c84b0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f39a000d860 tx=0x7f39a0008040 comp rx=0 tx=0).stop 2023-10-06T02:28:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.568+0000 7f39afe5e700 1 -- 172.21.15.6:0/1912588740 shutdown_connections 2023-10-06T02:28:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.568+0000 7f39afe5e700 1 --2- 172.21.15.6:0/1912588740 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3994066f30 0x7f39940693e0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.568+0000 7f39afe5e700 1 --2- 172.21.15.6:0/1912588740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a815d460 0x7f39a80c84b0 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.568+0000 7f39afe5e700 1 --2- 172.21.15.6:0/1912588740 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39a80af4e0 0x7f39a8169b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.568+0000 7f39afe5e700 1 --2- 172.21.15.6:0/1912588740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39a80af8b0 0x7f39a80c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.568+0000 7f39afe5e700 1 -- 172.21.15.6:0/1912588740 >> 172.21.15.6:0/1912588740 conn(0x7f39a8068680 msgr2=0x7f39a80b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.568+0000 7f39afe5e700 1 -- 172.21.15.6:0/1912588740 shutdown_connections 2023-10-06T02:28:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.568+0000 7f39afe5e700 1 -- 172.21.15.6:0/1912588740 wait complete. 2023-10-06T02:28:08.571 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 280 2023-10-06T02:28:08.581 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:28:08.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:08.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.738+0000 7f1b0ca10700 1 Processor -- start 2023-10-06T02:28:08.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.738+0000 7f1b0ca10700 1 -- start start 2023-10-06T02:28:08.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.739+0000 7f1b0ca10700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1b080af8b0 0x7f1b0815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:08.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.739+0000 7f1b0ca10700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1b080b27f0 0x7f1b0815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:08.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.739+0000 7f1b0ca10700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0815e190 con 0x7f1b080af4e0 2023-10-06T02:28:08.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.739+0000 7f1b0ca10700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b080b1910 con 0x7f1b080af8b0 2023-10-06T02:28:08.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.739+0000 7f1b0ca10700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b080cb650 con 0x7f1b080b27f0 2023-10-06T02:28:08.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.739+0000 7f1b05d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1b080af8b0 0x7f1b0815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:08.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.739+0000 7f1b0659c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1b080af4e0 0x7f1b080b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60672/0 (socket says 172.21.15.6:60672) 2023-10-06T02:28:08.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.739+0000 7f1b05d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1b080af8b0 0x7f1b0815d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57898/0 (socket says 172.21.15.6:57898) 2023-10-06T02:28:08.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.740+0000 7f1b0659c700 1 -- 172.21.15.6:0/1496600113 learned_addr learned my addr 172.21.15.6:0/1496600113 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:08.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.740+0000 7f1b06d9d700 1 --2- 172.21.15.6:0/1496600113 >> v2:172.21.15.175:3300/0 conn(0x7f1b080b27f0 0x7f1b0815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:08.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.740+0000 7f1b05d9b700 1 -- 172.21.15.6:0/1496600113 >> v2:172.21.15.175:3300/0 conn(0x7f1b080b27f0 msgr2=0x7f1b0815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:08.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.740+0000 7f1b05d9b700 1 --2- 172.21.15.6:0/1496600113 >> v2:172.21.15.175:3300/0 conn(0x7f1b080b27f0 0x7f1b0815d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.740+0000 7f1b05d9b700 1 -- 172.21.15.6:0/1496600113 >> v1:172.21.15.6:6789/0 conn(0x7f1b080af4e0 legacy=0x7f1b080b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:08.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.740+0000 7f1b05d9b700 1 -- 172.21.15.6:0/1496600113 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b080ccaf0 con 0x7f1b080af8b0 2023-10-06T02:28:08.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.740+0000 7f1b0559a700 1 -- 172.21.15.6:0/1496600113 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924127078 0 0) 0x7f1b0815e190 con 0x7f1b080af4e0 2023-10-06T02:28:08.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.740+0000 7f1b06d9d700 1 --2- 172.21.15.6:0/1496600113 >> v2:172.21.15.175:3300/0 conn(0x7f1b080b27f0 0x7f1b0815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:08.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.740+0000 7f1b05d9b700 1 --2- 172.21.15.6:0/1496600113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b080af8b0 0x7f1b0815d460 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f1b080c7280 tx=0x7f1af80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa243416d54c731 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:08.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.740+0000 7f1b0559a700 1 -- 172.21.15.6:0/1496600113 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af800b6b0 con 0x7f1b080af8b0 2023-10-06T02:28:08.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.740+0000 7f1b0559a700 1 -- 172.21.15.6:0/1496600113 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af800b810 con 0x7f1b080af8b0 2023-10-06T02:28:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.740+0000 7f1b0559a700 1 -- 172.21.15.6:0/1496600113 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af800bbb0 con 0x7f1b080af8b0 2023-10-06T02:28:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.741+0000 7f1b0ca10700 1 -- 172.21.15.6:0/1496600113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b080af8b0 msgr2=0x7f1b0815d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.741+0000 7f1b0ca10700 1 --2- 172.21.15.6:0/1496600113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b080af8b0 0x7f1b0815d460 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f1b080c7280 tx=0x7f1af80091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.741+0000 7f1b0ca10700 1 -- 172.21.15.6:0/1496600113 shutdown_connections 2023-10-06T02:28:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.741+0000 7f1b0ca10700 1 --2- 172.21.15.6:0/1496600113 >> v2:172.21.15.175:3300/0 conn(0x7f1b080b27f0 0x7f1b0815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.741+0000 7f1b0ca10700 1 --2- 172.21.15.6:0/1496600113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b080af8b0 0x7f1b0815d460 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.741+0000 7f1b0ca10700 1 -- 172.21.15.6:0/1496600113 >> 172.21.15.6:0/1496600113 conn(0x7f1b08068680 msgr2=0x7f1b08068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.741+0000 7f1b0ca10700 1 -- 172.21.15.6:0/1496600113 shutdown_connections 2023-10-06T02:28:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.741+0000 7f1b0ca10700 1 -- 172.21.15.6:0/1496600113 wait complete. 2023-10-06T02:28:08.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.742+0000 7f1b0ca10700 1 Processor -- start 2023-10-06T02:28:08.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.742+0000 7f1b0ca10700 1 -- start start 2023-10-06T02:28:08.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b0ca10700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1b080af4e0 0x7f1b0816a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:08.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b0ca10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b080af8b0 0x7f1b08154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:08.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b0ca10700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b080b27f0 0x7f1b08154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:08.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b0ca10700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080c8360 con 0x7f1b080af8b0 2023-10-06T02:28:08.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b0ca10700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080c8600 con 0x7f1b080b27f0 2023-10-06T02:28:08.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b0ca10700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b08169ed0 con 0x7f1b080af4e0 2023-10-06T02:28:08.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b05d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b080af8b0 0x7f1b08154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:08.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b05d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b080af8b0 0x7f1b08154340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57912/0 (socket says 172.21.15.6:57912) 2023-10-06T02:28:08.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b05d9b700 1 -- 172.21.15.6:0/2695111224 learned_addr learned my addr 172.21.15.6:0/2695111224 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:08.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b06d9d700 1 --2- 172.21.15.6:0/2695111224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b080b27f0 0x7f1b08154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:08.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b0659c700 1 --2- 172.21.15.6:0/2695111224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1b080af4e0 0x7f1b0816a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:08.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b05d9b700 1 -- 172.21.15.6:0/2695111224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1b080af4e0 msgr2=0x7f1b0816a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:08.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b05d9b700 1 --2- 172.21.15.6:0/2695111224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1b080af4e0 0x7f1b0816a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b05d9b700 1 -- 172.21.15.6:0/2695111224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b080b27f0 msgr2=0x7f1b08154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:08.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b05d9b700 1 --2- 172.21.15.6:0/2695111224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b080b27f0 0x7f1b08154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b05d9b700 1 -- 172.21.15.6:0/2695111224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af8009420 con 0x7f1b080af8b0 2023-10-06T02:28:08.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b06d9d700 1 --2- 172.21.15.6:0/2695111224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b080b27f0 0x7f1b08154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:08.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b05d9b700 1 --2- 172.21.15.6:0/2695111224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b080af8b0 0x7f1b08154340 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f1af8013000 tx=0x7f1af8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:08.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1af67fc700 1 -- 172.21.15.6:0/2695111224 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8011420 con 0x7f1b080af8b0 2023-10-06T02:28:08.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1af67fc700 1 -- 172.21.15.6:0/2695111224 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af8011580 con 0x7f1b080af8b0 2023-10-06T02:28:08.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b0ca10700 1 -- 172.21.15.6:0/2695111224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b08154ec0 con 0x7f1b080af8b0 2023-10-06T02:28:08.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1af67fc700 1 -- 172.21.15.6:0/2695111224 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8011920 con 0x7f1b080af8b0 2023-10-06T02:28:08.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.743+0000 7f1b0ca10700 1 -- 172.21.15.6:0/2695111224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b08155480 con 0x7f1b080af8b0 2023-10-06T02:28:08.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.744+0000 7f1b0ca10700 1 -- 172.21.15.6:0/2695111224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b080c8790 con 0x7f1b080af8b0 2023-10-06T02:28:08.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.745+0000 7f1af67fc700 1 -- 172.21.15.6:0/2695111224 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1af8011d10 con 0x7f1b080af8b0 2023-10-06T02:28:08.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.745+0000 7f1af67fc700 1 --2- 172.21.15.6:0/2695111224 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ae8066f30 0x7f1ae80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:08.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.745+0000 7f1af67fc700 1 -- 172.21.15.6:0/2695111224 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7f1af8086e20 con 0x7f1b080af8b0 2023-10-06T02:28:08.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.745+0000 7f1b0659c700 1 --2- 172.21.15.6:0/2695111224 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ae8066f30 0x7f1ae80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:08.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.746+0000 7f1b0659c700 1 --2- 172.21.15.6:0/2695111224 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ae8066f30 0x7f1ae80693e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1b0815c4a0 tx=0x7f1afc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:08.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.749+0000 7f1af67fc700 1 -- 172.21.15.6:0/2695111224 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1af80533c0 con 0x7f1b080af8b0 2023-10-06T02:28:08.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.990+0000 7f1b0ca10700 1 -- 172.21.15.6:0/2695111224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b0815c4f0 con 0x7f1b080af8b0 2023-10-06T02:28:08.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.991+0000 7f1af67fc700 1 -- 172.21.15.6:0/2695111224 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 280 v280) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f1af8015070 con 0x7f1b080af8b0 2023-10-06T02:28:08.993 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:08.993 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":280,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":280,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:28:08.190129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:08.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.993+0000 7f1b0ca10700 1 -- 172.21.15.6:0/2695111224 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ae8066f30 msgr2=0x7f1ae80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:08.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.993+0000 7f1b0ca10700 1 --2- 172.21.15.6:0/2695111224 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ae8066f30 0x7f1ae80693e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1b0815c4a0 tx=0x7f1afc009040 comp rx=0 tx=0).stop 2023-10-06T02:28:08.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.993+0000 7f1b0ca10700 1 -- 172.21.15.6:0/2695111224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b080af8b0 msgr2=0x7f1b08154340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:08.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.993+0000 7f1b0ca10700 1 --2- 172.21.15.6:0/2695111224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b080af8b0 0x7f1b08154340 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f1af8013000 tx=0x7f1af8017000 comp rx=0 tx=0).stop 2023-10-06T02:28:08.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.993+0000 7f1b0ca10700 1 -- 172.21.15.6:0/2695111224 shutdown_connections 2023-10-06T02:28:08.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.993+0000 7f1b0ca10700 1 --2- 172.21.15.6:0/2695111224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b080b27f0 0x7f1b08154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.993+0000 7f1b0ca10700 1 --2- 172.21.15.6:0/2695111224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1b080af4e0 0x7f1b0816a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.993+0000 7f1b0ca10700 1 --2- 172.21.15.6:0/2695111224 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ae8066f30 0x7f1ae80693e0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.993+0000 7f1b0ca10700 1 --2- 172.21.15.6:0/2695111224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b080af8b0 0x7f1b08154340 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:08.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.993+0000 7f1b0ca10700 1 -- 172.21.15.6:0/2695111224 >> 172.21.15.6:0/2695111224 conn(0x7f1b08068680 msgr2=0x7f1b080b5310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:08.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.993+0000 7f1b0ca10700 1 -- 172.21.15.6:0/2695111224 shutdown_connections 2023-10-06T02:28:08.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:08.994+0000 7f1b0ca10700 1 -- 172.21.15.6:0/2695111224 wait complete. 2023-10-06T02:28:08.997 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 280 2023-10-06T02:28:09.008 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:28:09.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:09.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.125+0000 7f6ac4958700 1 Processor -- start 2023-10-06T02:28:09.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.125+0000 7f6ac4958700 1 -- start start 2023-10-06T02:28:09.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.126+0000 7f6ac4958700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ac0159400 0x7f6ac00ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:09.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.126+0000 7f6ac4958700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ac00d05d0 0x7f6ac00b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:09.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.126+0000 7f6ac4958700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac00b3560 con 0x7f6ac00cd030 2023-10-06T02:28:09.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.126+0000 7f6ac4958700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac00cf6f0 con 0x7f6ac00d05d0 2023-10-06T02:28:09.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.126+0000 7f6ac4958700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac00cf9d0 con 0x7f6ac0159400 2023-10-06T02:28:09.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.126+0000 7f6abf59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ac00d05d0 0x7f6ac00b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:09.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.126+0000 7f6abf59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ac00d05d0 0x7f6ac00b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57924/0 (socket says 172.21.15.6:57924) 2023-10-06T02:28:09.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.126+0000 7f6abf59e700 1 -- 172.21.15.6:0/4093872470 learned_addr learned my addr 172.21.15.6:0/4093872470 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:09.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.126+0000 7f6abe59c700 1 --1- 172.21.15.6:0/4093872470 >> v1:172.21.15.6:6789/0 conn(0x7f6ac00cd030 0x7f6ac00cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60686/0 (socket says 172.21.15.6:60686) 2023-10-06T02:28:09.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.126+0000 7f6abed9d700 1 --2- 172.21.15.6:0/4093872470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ac0159400 0x7f6ac00ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:09.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.126+0000 7f6abf59e700 1 -- 172.21.15.6:0/4093872470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ac0159400 msgr2=0x7f6ac00ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:09.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.126+0000 7f6abf59e700 1 --2- 172.21.15.6:0/4093872470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ac0159400 0x7f6ac00ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:09.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.126+0000 7f6abf59e700 1 -- 172.21.15.6:0/4093872470 >> v1:172.21.15.6:6789/0 conn(0x7f6ac00cd030 legacy=0x7f6ac00cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:09.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.126+0000 7f6abf59e700 1 -- 172.21.15.6:0/4093872470 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac00b2f10 con 0x7f6ac00d05d0 2023-10-06T02:28:09.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.126+0000 7f6abf59e700 1 --2- 172.21.15.6:0/4093872470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac00d05d0 0x7f6ac00b39f0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009f20 tx=0x7f6ab0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aeffd6d7810a436 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:09.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.126+0000 7f6abdd9b700 1 -- 172.21.15.6:0/4093872470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab000e070 con 0x7f6ac00d05d0 2023-10-06T02:28:09.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.127+0000 7f6abdd9b700 1 -- 172.21.15.6:0/4093872470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab000ba80 con 0x7f6ac00d05d0 2023-10-06T02:28:09.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.127+0000 7f6abdd9b700 1 -- 172.21.15.6:0/4093872470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00092e0 con 0x7f6ac00d05d0 2023-10-06T02:28:09.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.127+0000 7f6ac4958700 1 -- 172.21.15.6:0/4093872470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac00d05d0 msgr2=0x7f6ac00b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:09.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.127+0000 7f6ac4958700 1 --2- 172.21.15.6:0/4093872470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac00d05d0 0x7f6ac00b39f0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009f20 tx=0x7f6ab0009840 comp rx=0 tx=0).stop 2023-10-06T02:28:09.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.127+0000 7f6ac4958700 1 -- 172.21.15.6:0/4093872470 shutdown_connections 2023-10-06T02:28:09.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.127+0000 7f6ac4958700 1 --2- 172.21.15.6:0/4093872470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac00d05d0 0x7f6ac00b39f0 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:09.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.127+0000 7f6ac4958700 1 --2- 172.21.15.6:0/4093872470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ac0159400 0x7f6ac00ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:09.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.127+0000 7f6ac4958700 1 -- 172.21.15.6:0/4093872470 >> 172.21.15.6:0/4093872470 conn(0x7f6ac006ac10 msgr2=0x7f6ac0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:09.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.127+0000 7f6ac4958700 1 -- 172.21.15.6:0/4093872470 shutdown_connections 2023-10-06T02:28:09.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.127+0000 7f6ac4958700 1 -- 172.21.15.6:0/4093872470 wait complete. 2023-10-06T02:28:09.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.128+0000 7f6ac4958700 1 Processor -- start 2023-10-06T02:28:09.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.128+0000 7f6ac4958700 1 -- start start 2023-10-06T02:28:09.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.129+0000 7f6ac4958700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac00cd030 0x7f6ac00cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:09.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.129+0000 7f6ac4958700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ac00d05d0 0x7f6ac00c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:09.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.129+0000 7f6ac4958700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac0159400 0x7f6ac01524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:09.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.129+0000 7f6ac4958700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac014f530 con 0x7f6ac0159400 2023-10-06T02:28:09.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.129+0000 7f6ac4958700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac00cbdc0 con 0x7f6ac00cd030 2023-10-06T02:28:09.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.129+0000 7f6ac4958700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac00c61b0 con 0x7f6ac00d05d0 2023-10-06T02:28:09.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.129+0000 7f6abf59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac0159400 0x7f6ac01524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.129+0000 7f6abf59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac0159400 0x7f6ac01524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57930/0 (socket says 172.21.15.6:57930) 2023-10-06T02:28:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.129+0000 7f6abf59e700 1 -- 172.21.15.6:0/2547118689 learned_addr learned my addr 172.21.15.6:0/2547118689 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.129+0000 7f6abe59c700 1 --2- 172.21.15.6:0/2547118689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ac00d05d0 0x7f6ac00c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.129+0000 7f6abf59e700 1 -- 172.21.15.6:0/2547118689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ac00d05d0 msgr2=0x7f6ac00c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.129+0000 7f6abed9d700 1 --2- 172.21.15.6:0/2547118689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac00cd030 0x7f6ac00cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.129+0000 7f6abf59e700 1 --2- 172.21.15.6:0/2547118689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ac00d05d0 0x7f6ac00c71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.129+0000 7f6abf59e700 1 -- 172.21.15.6:0/2547118689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac00cd030 msgr2=0x7f6ac00cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.129+0000 7f6abf59e700 1 --2- 172.21.15.6:0/2547118689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac00cd030 0x7f6ac00cb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.130+0000 7f6abf59e700 1 -- 172.21.15.6:0/2547118689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab0009ae0 con 0x7f6ac0159400 2023-10-06T02:28:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.130+0000 7f6abf59e700 1 --2- 172.21.15.6:0/2547118689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac0159400 0x7f6ac01524e0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f6ac00b2b80 tx=0x7f6ab0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.130+0000 7f6ab6ffd700 1 -- 172.21.15.6:0/2547118689 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0008e80 con 0x7f6ac0159400 2023-10-06T02:28:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.130+0000 7f6ab6ffd700 1 -- 172.21.15.6:0/2547118689 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab0026460 con 0x7f6ac0159400 2023-10-06T02:28:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.130+0000 7f6ac4958700 1 -- 172.21.15.6:0/2547118689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac00c6420 con 0x7f6ac0159400 2023-10-06T02:28:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.130+0000 7f6ab6ffd700 1 -- 172.21.15.6:0/2547118689 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0026800 con 0x7f6ac0159400 2023-10-06T02:28:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.130+0000 7f6ac4958700 1 -- 172.21.15.6:0/2547118689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac00c67b0 con 0x7f6ac0159400 2023-10-06T02:28:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.131+0000 7f6ac4958700 1 -- 172.21.15.6:0/2547118689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac00b31f0 con 0x7f6ac0159400 2023-10-06T02:28:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.131+0000 7f6ab6ffd700 1 -- 172.21.15.6:0/2547118689 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ab0003040 con 0x7f6ac0159400 2023-10-06T02:28:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.132+0000 7f6ab6ffd700 1 --2- 172.21.15.6:0/2547118689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6aa0066f30 0x7f6aa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.132+0000 7f6ab6ffd700 1 -- 172.21.15.6:0/2547118689 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7f6ab0087410 con 0x7f6ac0159400 2023-10-06T02:28:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.132+0000 7f6abed9d700 1 --2- 172.21.15.6:0/2547118689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6aa0066f30 0x7f6aa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.132+0000 7f6abed9d700 1 --2- 172.21.15.6:0/2547118689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6aa0066f30 0x7f6aa00693e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8008900 tx=0x7f6ab8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:09.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.136+0000 7f6ab6ffd700 1 -- 172.21.15.6:0/2547118689 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ab0053930 con 0x7f6ac0159400 2023-10-06T02:28:09.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.375+0000 7f6ac4958700 1 -- 172.21.15.6:0/2547118689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ac0069f10 con 0x7f6ac0159400 2023-10-06T02:28:09.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.375+0000 7f6ab6ffd700 1 -- 172.21.15.6:0/2547118689 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 281 v281) v1 ==== 95+0+4595 (secure 0 0 0) 0x7f6ab0056f50 con 0x7f6ac0159400 2023-10-06T02:28:09.377 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:09.378 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":281,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/4058600046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":4058600046},{"type":"v1","addr":"172.21.15.6:6835","nonce":4058600046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":281}],"filesystems":[{"mdsmap":{"epoch":280,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:28:08.190129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.377+0000 7f6ac4958700 1 -- 172.21.15.6:0/2547118689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6aa0066f30 msgr2=0x7f6aa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.377+0000 7f6ac4958700 1 --2- 172.21.15.6:0/2547118689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6aa0066f30 0x7f6aa00693e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8008900 tx=0x7f6ab8008040 comp rx=0 tx=0).stop 2023-10-06T02:28:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.377+0000 7f6ac4958700 1 -- 172.21.15.6:0/2547118689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac0159400 msgr2=0x7f6ac01524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.377+0000 7f6ac4958700 1 --2- 172.21.15.6:0/2547118689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac0159400 0x7f6ac01524e0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f6ac00b2b80 tx=0x7f6ab0018000 comp rx=0 tx=0).stop 2023-10-06T02:28:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.377+0000 7f6ac4958700 1 -- 172.21.15.6:0/2547118689 shutdown_connections 2023-10-06T02:28:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.377+0000 7f6ac4958700 1 --2- 172.21.15.6:0/2547118689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6aa0066f30 0x7f6aa00693e0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.377+0000 7f6ac4958700 1 --2- 172.21.15.6:0/2547118689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ac0159400 0x7f6ac01524e0 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.377+0000 7f6ac4958700 1 --2- 172.21.15.6:0/2547118689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ac00cd030 0x7f6ac00cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.377+0000 7f6ac4958700 1 --2- 172.21.15.6:0/2547118689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ac00d05d0 0x7f6ac00c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.377+0000 7f6ac4958700 1 -- 172.21.15.6:0/2547118689 >> 172.21.15.6:0/2547118689 conn(0x7f6ac006ac10 msgr2=0x7f6ac00cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.377+0000 7f6ac4958700 1 -- 172.21.15.6:0/2547118689 shutdown_connections 2023-10-06T02:28:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.377+0000 7f6ac4958700 1 -- 172.21.15.6:0/2547118689 wait complete. 2023-10-06T02:28:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 281 2023-10-06T02:28:09.391 INFO:tasks.cephfs.test_damage:Result: Mutation 'Truncate 100.00000000.inode' led to DAMAGED state 2023-10-06T02:28:09.391 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap key 10000000000.00000000:sixmegs_head' 2023-10-06T02:28:09.391 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:09.391 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:28:09.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:09.391 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:28:09.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:28:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:28:09.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:28:09.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.565+0000 7fbafdb1a700 1 Processor -- start 2023-10-06T02:28:09.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.565+0000 7fbafdb1a700 1 -- start start 2023-10-06T02:28:09.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.566+0000 7fbafdb1a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbaf815a030 0x7fbaf815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:09.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.566+0000 7fbafdb1a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf8087700 0x7fbaf80b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:09.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.566+0000 7fbafdb1a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf80afc50 con 0x7fbaf815a940 2023-10-06T02:28:09.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.566+0000 7fbafdb1a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf80b0cf0 con 0x7fbaf815a030 2023-10-06T02:28:09.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.566+0000 7fbafdb1a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80aff30 con 0x7fbaf8087700 2023-10-06T02:28:09.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.566+0000 7fbaf6ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbaf815a940 0x7fbaf8086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60690/0 (socket says 172.21.15.6:60690) 2023-10-06T02:28:09.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.566+0000 7fbaf6ffd700 1 -- 172.21.15.6:0/4133860270 learned_addr learned my addr 172.21.15.6:0/4133860270 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:09.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.566+0000 7fbaf7fff700 1 --2- 172.21.15.6:0/4133860270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf8087700 0x7fbaf80b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:09.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.566+0000 7fbaf77fe700 1 --2- 172.21.15.6:0/4133860270 >> v2:172.21.15.175:3300/0 conn(0x7fbaf815a030 0x7fbaf815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:09.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.566+0000 7fbaf67fc700 1 -- 172.21.15.6:0/4133860270 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880750 0 0) 0x7fbaf80afc50 con 0x7fbaf815a940 2023-10-06T02:28:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf67fc700 1 -- 172.21.15.6:0/4133860270 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbae4003570 con 0x7fbaf815a940 2023-10-06T02:28:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf67fc700 1 -- 172.21.15.6:0/4133860270 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1897009085 0 0) 0x7fbae4003570 con 0x7fbaf815a940 2023-10-06T02:28:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf67fc700 1 -- 172.21.15.6:0/4133860270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf8087700 msgr2=0x7fbaf80b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf67fc700 1 --2- 172.21.15.6:0/4133860270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf8087700 0x7fbaf80b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf67fc700 1 -- 172.21.15.6:0/4133860270 >> v2:172.21.15.175:3300/0 conn(0x7fbaf815a030 msgr2=0x7fbaf815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf67fc700 1 --2- 172.21.15.6:0/4133860270 >> v2:172.21.15.175:3300/0 conn(0x7fbaf815a030 0x7fbaf815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf67fc700 1 -- 172.21.15.6:0/4133860270 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf80b0210 con 0x7fbaf815a940 2023-10-06T02:28:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf67fc700 1 -- 172.21.15.6:0/4133860270 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fbae0001470 con 0x7fbaf815a940 2023-10-06T02:28:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf67fc700 1 -- 172.21.15.6:0/4133860270 >> v1:172.21.15.6:6789/0 conn(0x7fbaf815a940 legacy=0x7fbaf8086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf67fc700 1 --2- 172.21.15.6:0/4133860270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbae4003a60 0x7fbae4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf67fc700 1 --2- 172.21.15.6:0/4133860270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf8087700 0x7fbae4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf67fc700 1 --2- 172.21.15.6:0/4133860270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbae4004d50 0x7fbae40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:09.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf67fc700 1 -- 172.21.15.6:0/4133860270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80b0cf0 con 0x7fbae4004d50 2023-10-06T02:28:09.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf67fc700 1 -- 172.21.15.6:0/4133860270 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80aff30 con 0x7fbae4003a60 2023-10-06T02:28:09.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf67fc700 1 -- 172.21.15.6:0/4133860270 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae400ba60 con 0x7fbaf8087700 2023-10-06T02:28:09.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf7fff700 1 --2- 172.21.15.6:0/4133860270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbae4004d50 0x7fbae40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:09.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf77fe700 1 --2- 172.21.15.6:0/4133860270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbae4003a60 0x7fbae4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:09.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf6ffd700 1 --2- 172.21.15.6:0/4133860270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf8087700 0x7fbae4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:09.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf7fff700 1 -- 172.21.15.6:0/4133860270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf8087700 msgr2=0x7fbae4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:09.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf7fff700 1 --2- 172.21.15.6:0/4133860270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf8087700 0x7fbae4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:09.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf7fff700 1 -- 172.21.15.6:0/4133860270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbae4003a60 msgr2=0x7fbae4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:09.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf7fff700 1 --2- 172.21.15.6:0/4133860270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbae4003a60 0x7fbae4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:09.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf7fff700 1 -- 172.21.15.6:0/4133860270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae4003570 con 0x7fbae4004d50 2023-10-06T02:28:09.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.567+0000 7fbaf7fff700 1 --2- 172.21.15.6:0/4133860270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbae4004d50 0x7fbae40051c0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8087b00 tx=0x7fbae800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd03048b2e5cbe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:09.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.568+0000 7fbaf67fc700 1 -- 172.21.15.6:0/4133860270 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae800ea30 con 0x7fbae4004d50 2023-10-06T02:28:09.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.568+0000 7fbaf67fc700 1 -- 172.21.15.6:0/4133860270 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae800f040 con 0x7fbae4004d50 2023-10-06T02:28:09.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.568+0000 7fbaf67fc700 1 -- 172.21.15.6:0/4133860270 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae800ede0 con 0x7fbae4004d50 2023-10-06T02:28:09.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.568+0000 7fbafdb1a700 1 -- 172.21.15.6:0/4133860270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbae4004d50 msgr2=0x7fbae40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:09.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.568+0000 7fbafdb1a700 1 --2- 172.21.15.6:0/4133860270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbae4004d50 0x7fbae40051c0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8087b00 tx=0x7fbae800b040 comp rx=0 tx=0).stop 2023-10-06T02:28:09.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.568+0000 7fbaf7fff700 1 -- 172.21.15.6:0/4133860270 reap_dead start 2023-10-06T02:28:09.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.568+0000 7fbafdb1a700 1 -- 172.21.15.6:0/4133860270 shutdown_connections 2023-10-06T02:28:09.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.568+0000 7fbafdb1a700 1 -- 172.21.15.6:0/4133860270 >> 172.21.15.6:0/4133860270 conn(0x7fbaf8068680 msgr2=0x7fbaf8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:09.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.568+0000 7fbafdb1a700 1 -- 172.21.15.6:0/4133860270 shutdown_connections 2023-10-06T02:28:09.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.568+0000 7fbafdb1a700 1 -- 172.21.15.6:0/4133860270 wait complete. 2023-10-06T02:28:09.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.569+0000 7fbafdb1a700 1 Processor -- start 2023-10-06T02:28:09.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.569+0000 7fbafdb1a700 1 -- start start 2023-10-06T02:28:09.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.570+0000 7fbafdb1a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbae4004d50 0x7fbaf815ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:09.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.570+0000 7fbafdb1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf815c760 0x7fbaf8169f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:09.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.570+0000 7fbafdb1a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf815cbd0 0x7fbaf816a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:09.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.570+0000 7fbafdb1a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf815b2a0 con 0x7fbaf815c760 2023-10-06T02:28:09.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.570+0000 7fbafdb1a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf815c0e0 con 0x7fbae4004d50 2023-10-06T02:28:09.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.570+0000 7fbafdb1a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf815b4d0 con 0x7fbaf815cbd0 2023-10-06T02:28:09.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.570+0000 7fbaf6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf815c760 0x7fbaf8169f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:09.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.570+0000 7fbaf6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf815c760 0x7fbaf8169f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57940/0 (socket says 172.21.15.6:57940) 2023-10-06T02:28:09.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.570+0000 7fbaf6ffd700 1 -- 172.21.15.6:0/2481059124 learned_addr learned my addr 172.21.15.6:0/2481059124 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:09.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.570+0000 7fbaf77fe700 1 --2- 172.21.15.6:0/2481059124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbae4004d50 0x7fbaf815ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:09.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.570+0000 7fbaf6ffd700 1 -- 172.21.15.6:0/2481059124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf815cbd0 msgr2=0x7fbaf816a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:09.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.570+0000 7fbaf6ffd700 1 --2- 172.21.15.6:0/2481059124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf815cbd0 0x7fbaf816a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:09.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.571+0000 7fbaf6ffd700 1 -- 172.21.15.6:0/2481059124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbae4004d50 msgr2=0x7fbaf815ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:09.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.571+0000 7fbaf6ffd700 1 --2- 172.21.15.6:0/2481059124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbae4004d50 0x7fbaf815ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:09.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.571+0000 7fbaf6ffd700 1 -- 172.21.15.6:0/2481059124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf815b7b0 con 0x7fbaf815c760 2023-10-06T02:28:09.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.571+0000 7fbaf77fe700 1 --2- 172.21.15.6:0/2481059124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbae4004d50 0x7fbaf815ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:09.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.571+0000 7fbaf6ffd700 1 --2- 172.21.15.6:0/2481059124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf815c760 0x7fbaf8169f20 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7fbae00079e0 tx=0x7fbae0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:09.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.571+0000 7fbaef7fe700 1 -- 172.21.15.6:0/2481059124 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0018030 con 0x7fbaf815c760 2023-10-06T02:28:09.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.571+0000 7fbaef7fe700 1 -- 172.21.15.6:0/2481059124 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae000f8a0 con 0x7fbaf815c760 2023-10-06T02:28:09.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.571+0000 7fbafdb1a700 1 -- 172.21.15.6:0/2481059124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf815ba90 con 0x7fbaf815c760 2023-10-06T02:28:09.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.571+0000 7fbaef7fe700 1 -- 172.21.15.6:0/2481059124 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae000fc40 con 0x7fbaf815c760 2023-10-06T02:28:09.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.571+0000 7fbafdb1a700 1 -- 172.21.15.6:0/2481059124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf816a9a0 con 0x7fbaf815c760 2023-10-06T02:28:09.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.572+0000 7fbafdb1a700 1 -- 172.21.15.6:0/2481059124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf815c270 con 0x7fbaf815c760 2023-10-06T02:28:09.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.572+0000 7fbaef7fe700 1 -- 172.21.15.6:0/2481059124 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbae001b070 con 0x7fbaf815c760 2023-10-06T02:28:09.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.573+0000 7fbaef7fe700 1 --2- 172.21.15.6:0/2481059124 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbad8066f30 0x7fbad80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:09.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.573+0000 7fbaef7fe700 1 -- 172.21.15.6:0/2481059124 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7fbae0019070 con 0x7fbaf815c760 2023-10-06T02:28:09.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.573+0000 7fbaf77fe700 1 --2- 172.21.15.6:0/2481059124 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbad8066f30 0x7fbad80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:09.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.573+0000 7fbaf77fe700 1 --2- 172.21.15.6:0/2481059124 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbad8066f30 0x7fbad80693e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0006f00 tx=0x7fbaf0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:09.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.577+0000 7fbaef7fe700 1 -- 172.21.15.6:0/2481059124 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbae0051800 con 0x7fbaf815c760 2023-10-06T02:28:09.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:09.817+0000 7fbafdb1a700 1 -- 172.21.15.6:0/2481059124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbaf80b04f0 con 0x7fbaf815c760 2023-10-06T02:28:10.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.207+0000 7fbaef7fe700 1 -- 172.21.15.6:0/2481059124 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v282) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbae0054e20 con 0x7fbaf815c760 2023-10-06T02:28:10.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.209+0000 7fbafdb1a700 1 -- 172.21.15.6:0/2481059124 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbad8066f30 msgr2=0x7fbad80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:10.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.209+0000 7fbafdb1a700 1 --2- 172.21.15.6:0/2481059124 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbad8066f30 0x7fbad80693e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0006f00 tx=0x7fbaf0008040 comp rx=0 tx=0).stop 2023-10-06T02:28:10.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.209+0000 7fbafdb1a700 1 -- 172.21.15.6:0/2481059124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf815c760 msgr2=0x7fbaf8169f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:10.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.209+0000 7fbafdb1a700 1 --2- 172.21.15.6:0/2481059124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf815c760 0x7fbaf8169f20 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7fbae00079e0 tx=0x7fbae0001e90 comp rx=0 tx=0).stop 2023-10-06T02:28:10.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.210+0000 7fbafdb1a700 1 -- 172.21.15.6:0/2481059124 shutdown_connections 2023-10-06T02:28:10.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.210+0000 7fbafdb1a700 1 --2- 172.21.15.6:0/2481059124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf815cbd0 0x7fbaf816a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:10.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.210+0000 7fbafdb1a700 1 --2- 172.21.15.6:0/2481059124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbae4004d50 0x7fbaf815ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:10.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.210+0000 7fbafdb1a700 1 --2- 172.21.15.6:0/2481059124 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbad8066f30 0x7fbad80693e0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:10.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.210+0000 7fbafdb1a700 1 --2- 172.21.15.6:0/2481059124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaf815c760 0x7fbaf8169f20 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:10.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.210+0000 7fbafdb1a700 1 -- 172.21.15.6:0/2481059124 >> 172.21.15.6:0/2481059124 conn(0x7fbaf8068680 msgr2=0x7fbaf80cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:10.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.210+0000 7fbafdb1a700 1 -- 172.21.15.6:0/2481059124 shutdown_connections 2023-10-06T02:28:10.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.210+0000 7fbafdb1a700 1 -- 172.21.15.6:0/2481059124 wait complete. 2023-10-06T02:28:10.213 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:28:10.224 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:28:10.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.344+0000 7f9f9d075700 1 Processor -- start 2023-10-06T02:28:10.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.344+0000 7f9f9d075700 1 -- start start 2023-10-06T02:28:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.344+0000 7f9f9d075700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9f980af3f0 0x7f9f9815a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.344+0000 7f9f9d075700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f980af7c0 0x7f9f9815d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.344+0000 7f9f9d075700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9815a170 con 0x7f9f98159960 2023-10-06T02:28:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.344+0000 7f9f9d075700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f980caeb0 con 0x7f9f980af7c0 2023-10-06T02:28:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.344+0000 7f9f9d075700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9815db80 con 0x7f9f980af3f0 2023-10-06T02:28:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.345+0000 7f9f8e59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f980af7c0 0x7f9f9815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.345+0000 7f9f9759e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9f98159960 0x7f9f98068680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60706/0 (socket says 172.21.15.6:60706) 2023-10-06T02:28:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.345+0000 7f9f8e59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f980af7c0 0x7f9f9815d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57946/0 (socket says 172.21.15.6:57946) 2023-10-06T02:28:10.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.345+0000 7f9f9759e700 1 -- 172.21.15.6:0/5341606 learned_addr learned my addr 172.21.15.6:0/5341606 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:10.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.345+0000 7f9f96d9d700 1 --2- 172.21.15.6:0/5341606 >> v2:172.21.15.175:3300/0 conn(0x7f9f980af3f0 0x7f9f9815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:10.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.345+0000 7f9f8e59c700 1 -- 172.21.15.6:0/5341606 >> v2:172.21.15.175:3300/0 conn(0x7f9f980af3f0 msgr2=0x7f9f9815a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:10.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.345+0000 7f9f8e59c700 1 --2- 172.21.15.6:0/5341606 >> v2:172.21.15.175:3300/0 conn(0x7f9f980af3f0 0x7f9f9815a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:10.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.345+0000 7f9f8e59c700 1 -- 172.21.15.6:0/5341606 >> v1:172.21.15.6:6789/0 conn(0x7f9f98159960 legacy=0x7f9f98068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:10.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.345+0000 7f9f9659c700 1 -- 172.21.15.6:0/5341606 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917643622 0 0) 0x7f9f9815a170 con 0x7f9f98159960 2023-10-06T02:28:10.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.345+0000 7f9f8e59c700 1 -- 172.21.15.6:0/5341606 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9815de60 con 0x7f9f980af7c0 2023-10-06T02:28:10.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.345+0000 7f9f8e59c700 1 --2- 172.21.15.6:0/5341606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f980af7c0 0x7f9f9815d030 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f9f980ccf90 tx=0x7f9f800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f068fa52b6745c15 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:10.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.345+0000 7f9f9659c700 1 -- 172.21.15.6:0/5341606 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8000b6b0 con 0x7f9f980af7c0 2023-10-06T02:28:10.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.345+0000 7f9f9659c700 1 -- 172.21.15.6:0/5341606 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8000b810 con 0x7f9f980af7c0 2023-10-06T02:28:10.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.345+0000 7f9f9659c700 1 -- 172.21.15.6:0/5341606 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8000bbb0 con 0x7f9f980af7c0 2023-10-06T02:28:10.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.346+0000 7f9f9d075700 1 -- 172.21.15.6:0/5341606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f980af7c0 msgr2=0x7f9f9815d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:10.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.346+0000 7f9f9d075700 1 --2- 172.21.15.6:0/5341606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f980af7c0 0x7f9f9815d030 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f9f980ccf90 tx=0x7f9f800091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:10.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.346+0000 7f9f9d075700 1 -- 172.21.15.6:0/5341606 shutdown_connections 2023-10-06T02:28:10.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.346+0000 7f9f9d075700 1 --2- 172.21.15.6:0/5341606 >> v2:172.21.15.175:3300/0 conn(0x7f9f980af3f0 0x7f9f9815a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:10.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.346+0000 7f9f9d075700 1 --2- 172.21.15.6:0/5341606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f980af7c0 0x7f9f9815d030 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:10.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.346+0000 7f9f9d075700 1 -- 172.21.15.6:0/5341606 >> 172.21.15.6:0/5341606 conn(0x7f9f9806a260 msgr2=0x7f9f980cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:10.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.346+0000 7f9f9d075700 1 -- 172.21.15.6:0/5341606 shutdown_connections 2023-10-06T02:28:10.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.346+0000 7f9f9d075700 1 -- 172.21.15.6:0/5341606 wait complete. 2023-10-06T02:28:10.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.347+0000 7f9f9d075700 1 Processor -- start 2023-10-06T02:28:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.347+0000 7f9f9d075700 1 -- start start 2023-10-06T02:28:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f9d075700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f980af3f0 0x7f9f98147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f9d075700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f98159960 0x7f9f98169b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f9d075700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9816a0a0 0x7f9f980c2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f9d075700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9816ab70 con 0x7f9f98159960 2023-10-06T02:28:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f9d075700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f981480b0 con 0x7f9f9816a0a0 2023-10-06T02:28:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f9d075700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f980b13a0 con 0x7f9f980af3f0 2023-10-06T02:28:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f8e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f98159960 0x7f9f98169b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f8e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f98159960 0x7f9f98169b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57962/0 (socket says 172.21.15.6:57962) 2023-10-06T02:28:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f8e59c700 1 -- 172.21.15.6:0/739151872 learned_addr learned my addr 172.21.15.6:0/739151872 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f96d9d700 1 --2- 172.21.15.6:0/739151872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f980af3f0 0x7f9f98147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:10.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f9759e700 1 --2- 172.21.15.6:0/739151872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9816a0a0 0x7f9f980c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:10.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f8e59c700 1 -- 172.21.15.6:0/739151872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f980af3f0 msgr2=0x7f9f98147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:10.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f8e59c700 1 --2- 172.21.15.6:0/739151872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f980af3f0 0x7f9f98147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:10.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f8e59c700 1 -- 172.21.15.6:0/739151872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9816a0a0 msgr2=0x7f9f980c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:10.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f8e59c700 1 --2- 172.21.15.6:0/739151872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9816a0a0 0x7f9f980c2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:10.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f8e59c700 1 -- 172.21.15.6:0/739151872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f80009420 con 0x7f9f98159960 2023-10-06T02:28:10.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f96d9d700 1 --2- 172.21.15.6:0/739151872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f980af3f0 0x7f9f98147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:10.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f9759e700 1 --2- 172.21.15.6:0/739151872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9816a0a0 0x7f9f980c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:10.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.348+0000 7f9f8e59c700 1 --2- 172.21.15.6:0/739151872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f98159960 0x7f9f98169b60 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f9f9806c600 tx=0x7f9f80017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:10.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.349+0000 7f9f8f7fe700 1 -- 172.21.15.6:0/739151872 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8000bb90 con 0x7f9f98159960 2023-10-06T02:28:10.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.349+0000 7f9f8f7fe700 1 -- 172.21.15.6:0/739151872 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f80011420 con 0x7f9f98159960 2023-10-06T02:28:10.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.349+0000 7f9f9d075700 1 -- 172.21.15.6:0/739151872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9816a5b0 con 0x7f9f98159960 2023-10-06T02:28:10.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.349+0000 7f9f8f7fe700 1 -- 172.21.15.6:0/739151872 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f800117e0 con 0x7f9f98159960 2023-10-06T02:28:10.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.349+0000 7f9f9d075700 1 -- 172.21.15.6:0/739151872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f980b1030 con 0x7f9f98159960 2023-10-06T02:28:10.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.350+0000 7f9f9d075700 1 -- 172.21.15.6:0/739151872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f980b0e90 con 0x7f9f98159960 2023-10-06T02:28:10.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.350+0000 7f9f8f7fe700 1 -- 172.21.15.6:0/739151872 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f80011b90 con 0x7f9f98159960 2023-10-06T02:28:10.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.351+0000 7f9f8f7fe700 1 --2- 172.21.15.6:0/739151872 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9f78066f30 0x7f9f780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:10.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.351+0000 7f9f8f7fe700 1 -- 172.21.15.6:0/739151872 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7f9f800871b0 con 0x7f9f98159960 2023-10-06T02:28:10.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.351+0000 7f9f96d9d700 1 --2- 172.21.15.6:0/739151872 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9f78066f30 0x7f9f780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:10.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.352+0000 7f9f96d9d700 1 --2- 172.21.15.6:0/739151872 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9f78066f30 0x7f9f780693e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f9f88006fd0 tx=0x7f9f88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:10.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.355+0000 7f9f8f7fe700 1 -- 172.21.15.6:0/739151872 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f80053750 con 0x7f9f98159960 2023-10-06T02:28:10.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:10.632+0000 7f9f9d075700 1 -- 172.21.15.6:0/739151872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f9f980b0e90 con 0x7f9f98159960 2023-10-06T02:28:11.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.216+0000 7f9f8f7fe700 1 -- 172.21.15.6:0/739151872 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v283) v1 ==== 101+0+0 (secure 0 0 0) 0x7f9f980b0e90 con 0x7f9f98159960 2023-10-06T02:28:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.218+0000 7f9f9d075700 1 -- 172.21.15.6:0/739151872 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9f78066f30 msgr2=0x7f9f780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.218+0000 7f9f9d075700 1 --2- 172.21.15.6:0/739151872 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9f78066f30 0x7f9f780693e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f9f88006fd0 tx=0x7f9f88008040 comp rx=0 tx=0).stop 2023-10-06T02:28:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.218+0000 7f9f9d075700 1 -- 172.21.15.6:0/739151872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f98159960 msgr2=0x7f9f98169b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.218+0000 7f9f9d075700 1 --2- 172.21.15.6:0/739151872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f98159960 0x7f9f98169b60 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f9f9806c600 tx=0x7f9f80017000 comp rx=0 tx=0).stop 2023-10-06T02:28:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.218+0000 7f9f9d075700 1 -- 172.21.15.6:0/739151872 shutdown_connections 2023-10-06T02:28:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.218+0000 7f9f9d075700 1 --2- 172.21.15.6:0/739151872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9816a0a0 0x7f9f980c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.218+0000 7f9f9d075700 1 --2- 172.21.15.6:0/739151872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f980af3f0 0x7f9f98147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.218+0000 7f9f9d075700 1 --2- 172.21.15.6:0/739151872 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9f78066f30 0x7f9f780693e0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.218+0000 7f9f9d075700 1 --2- 172.21.15.6:0/739151872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f98159960 0x7f9f98169b60 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.218+0000 7f9f9d075700 1 -- 172.21.15.6:0/739151872 >> 172.21.15.6:0/739151872 conn(0x7f9f9806a260 msgr2=0x7f9f980c9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:11.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.218+0000 7f9f9d075700 1 -- 172.21.15.6:0/739151872 shutdown_connections 2023-10-06T02:28:11.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.218+0000 7f9f9d075700 1 -- 172.21.15.6:0/739151872 wait complete. 2023-10-06T02:28:11.221 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:28:11.233 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:28:11.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.270+0000 7f30c8a09000 1 Processor -- start 2023-10-06T02:28:11.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.270+0000 7f30c8a09000 1 -- start start 2023-10-06T02:28:11.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.271+0000 7f30c8a09000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b06619fe30 0x55b0661bb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.271+0000 7f30c8a09000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0661a29e0 0x55b0661a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.271+0000 7f30c8a09000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b066248f50 0x55b066249a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.271+0000 7f30c8a09000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0660bf980 con 0x55b0661a29e0 2023-10-06T02:28:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.271+0000 7f30c8a09000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0660bf620 con 0x55b066248f50 2023-10-06T02:28:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.271+0000 7f30c8a09000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0660b6400 con 0x55b06619fe30 2023-10-06T02:28:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.271+0000 7f30c1443700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0661a29e0 0x55b0661a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.271+0000 7f30c1443700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0661a29e0 0x55b0661a04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57984/0 (socket says 172.21.15.6:57984) 2023-10-06T02:28:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.271+0000 7f30c1443700 1 -- 172.21.15.6:0/80827163 learned_addr learned my addr 172.21.15.6:0/80827163 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.271+0000 7f30c1c44700 1 --2- 172.21.15.6:0/80827163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b06619fe30 0x55b0661bb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.271+0000 7f30c2445700 1 --2- 172.21.15.6:0/80827163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b066248f50 0x55b066249a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30c1443700 1 -- 172.21.15.6:0/80827163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b06619fe30 msgr2=0x55b0661bb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30c1443700 1 --2- 172.21.15.6:0/80827163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b06619fe30 0x55b0661bb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30c1443700 1 -- 172.21.15.6:0/80827163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b066248f50 msgr2=0x55b066249a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30c1443700 1 --2- 172.21.15.6:0/80827163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b066248f50 0x55b066249a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30c1443700 1 -- 172.21.15.6:0/80827163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac005db0 con 0x55b0661a29e0 2023-10-06T02:28:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30c1443700 1 --2- 172.21.15.6:0/80827163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0661a29e0 0x55b0661a04b0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00af30 tx=0x7f30ac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775febb097573536 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30bbfff700 1 -- 172.21.15.6:0/80827163 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac000bc0 con 0x55b0661a29e0 2023-10-06T02:28:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30bbfff700 1 -- 172.21.15.6:0/80827163 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ac0085b0 con 0x55b0661a29e0 2023-10-06T02:28:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30bbfff700 1 -- 172.21.15.6:0/80827163 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac000d20 con 0x55b0661a29e0 2023-10-06T02:28:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30c8a09000 1 -- 172.21.15.6:0/80827163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0661a29e0 msgr2=0x55b0661a04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30c8a09000 1 --2- 172.21.15.6:0/80827163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0661a29e0 0x55b0661a04b0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00af30 tx=0x7f30ac019000 comp rx=0 tx=0).stop 2023-10-06T02:28:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30c8a09000 1 -- 172.21.15.6:0/80827163 shutdown_connections 2023-10-06T02:28:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30c8a09000 1 --2- 172.21.15.6:0/80827163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b066248f50 0x55b066249a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30c8a09000 1 --2- 172.21.15.6:0/80827163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b06619fe30 0x55b0661bb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30c8a09000 1 --2- 172.21.15.6:0/80827163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0661a29e0 0x55b0661a04b0 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30c8a09000 1 -- 172.21.15.6:0/80827163 >> 172.21.15.6:0/80827163 conn(0x55b0661bbbd0 msgr2=0x55b066244cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30c8a09000 1 -- 172.21.15.6:0/80827163 shutdown_connections 2023-10-06T02:28:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.272+0000 7f30c8a09000 1 -- 172.21.15.6:0/80827163 wait complete. 2023-10-06T02:28:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.273+0000 7f30c8a09000 1 Processor -- start 2023-10-06T02:28:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.273+0000 7f30c8a09000 1 -- start start 2023-10-06T02:28:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c8a09000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b06619fe30 0x55b06624c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c8a09000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b0661a29e0 0x55b0661a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c8a09000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b066248f50 0x55b066242750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c8a09000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b066173640 con 0x55b06619fe30 2023-10-06T02:28:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c8a09000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b066251480 con 0x55b066248f50 2023-10-06T02:28:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c8a09000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b066251720 con 0x55b0661a29e0 2023-10-06T02:28:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c1c44700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b06619fe30 0x55b06624c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c1c44700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b06619fe30 0x55b06624c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57996/0 (socket says 172.21.15.6:57996) 2023-10-06T02:28:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 learned_addr learned my addr 172.21.15.6:0/4262051206 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c2445700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b066248f50 0x55b066242750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c1443700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b0661a29e0 0x55b0661a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b0661a29e0 msgr2=0x55b0661a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c1c44700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b0661a29e0 0x55b0661a4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b066248f50 msgr2=0x55b066242750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c1c44700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b066248f50 0x55b066242750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0660e81c0 con 0x55b06619fe30 2023-10-06T02:28:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c1443700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b0661a29e0 0x55b0661a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.274+0000 7f30c1c44700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b06619fe30 0x55b06624c940 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f30bc003e10 tx=0x7f30bc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.275+0000 7f30ba7fc700 1 -- 172.21.15.6:0/4262051206 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc00bd40 con 0x55b06619fe30 2023-10-06T02:28:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.275+0000 7f30ba7fc700 1 -- 172.21.15.6:0/4262051206 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc008040 con 0x55b06619fe30 2023-10-06T02:28:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.275+0000 7f30ba7fc700 1 -- 172.21.15.6:0/4262051206 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc00bea0 con 0x55b06619fe30 2023-10-06T02:28:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.275+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b0660ce3d0 con 0x55b06619fe30 2023-10-06T02:28:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.275+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0660c1ae0 con 0x55b06619fe30 2023-10-06T02:28:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.276+0000 7f30ba7fc700 1 -- 172.21.15.6:0/4262051206 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f30bc001610 con 0x55b06619fe30 2023-10-06T02:28:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.276+0000 7f30ba7fc700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f30a4065890 0x7f30a4067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.276+0000 7f30ba7fc700 1 -- 172.21.15.6:0/4262051206 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7f30bc083d30 con 0x55b06619fe30 2023-10-06T02:28:11.282 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:28:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.277+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55b0661a4ab0 0x55b066240550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.277+0000 7f30c1443700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f30a4065890 0x7f30a4067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.277+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066240a90 con 0x55b0661a4ab0 2023-10-06T02:28:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.277+0000 7f30c2445700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55b0661a4ab0 0x55b066240550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.277+0000 7f30c1443700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f30a4065890 0x7f30a4067d40 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f30ac008930 tx=0x7f30ac01d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.277+0000 7f30c2445700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55b0661a4ab0 0x55b066240550 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.279+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v126'939 uv913 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.279+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066240e70 con 0x55b0661a4ab0 2023-10-06T02:28:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.281+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v126'940 uv940 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.281+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066241220 con 0x55b0661a4ab0 2023-10-06T02:28:11.284 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:28:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.282+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v126'941 uv941 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.282+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066264ef0 con 0x55b0661a4ab0 2023-10-06T02:28:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.284+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v126'942 uv942 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.284+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662652a0 con 0x55b0661a4ab0 2023-10-06T02:28:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.285+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v126'943 uv943 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.285+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066263ee0 con 0x55b0661a4ab0 2023-10-06T02:28:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.286+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v126'944 uv944 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.286+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066264310 con 0x55b0661a4ab0 2023-10-06T02:28:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.288+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v126'945 uv919 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.288+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066264710 con 0x55b0661a4ab0 2023-10-06T02:28:11.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.289+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v126'946 uv946 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.289+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066264710 con 0x55b0661a4ab0 2023-10-06T02:28:11.292 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:28:11.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.290+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v126'947 uv947 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.290+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066264b10 con 0x55b0661a4ab0 2023-10-06T02:28:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.292+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v126'948 uv948 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.292+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066264b10 con 0x55b0661a4ab0 2023-10-06T02:28:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.293+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v126'949 uv949 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.293+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662646c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.294+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v126'950 uv950 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.294+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662646c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.295+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v126'951 uv926 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.295+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662646c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.297+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v126'952 uv952 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.297+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662646c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.299 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:28:11.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.298+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v126'953 uv953 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.298+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662646c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.299+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v126'954 uv954 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.299+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662646c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.300+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v126'955 uv955 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.300+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662646c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.302+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v126'956 uv956 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.302+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066265650 con 0x55b0661a4ab0 2023-10-06T02:28:11.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.303+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v126'957 uv957 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.303+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066265650 con 0x55b0661a4ab0 2023-10-06T02:28:11.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.304+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v126'958 uv932 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.305+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066265650 con 0x55b0661a4ab0 2023-10-06T02:28:11.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.306+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v126'959 uv959 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.306+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066265650 con 0x55b0661a4ab0 2023-10-06T02:28:11.308 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:28:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.307+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v126'960 uv960 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.307+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066266660 con 0x55b0661a4ab0 2023-10-06T02:28:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.308+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v126'961 uv961 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.308+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066266660 con 0x55b0661a4ab0 2023-10-06T02:28:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.310+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v126'962 uv962 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.310+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066265650 con 0x55b0661a4ab0 2023-10-06T02:28:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.311+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v126'963 uv963 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.311+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066265650 con 0x55b0661a4ab0 2023-10-06T02:28:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.313+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v126'964 uv938 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.313+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066265650 con 0x55b0661a4ab0 2023-10-06T02:28:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.314+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v126'965 uv965 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.314+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066265650 con 0x55b0661a4ab0 2023-10-06T02:28:11.317 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:28:11.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.315+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v126'966 uv966 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.316+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066266660 con 0x55b0661a4ab0 2023-10-06T02:28:11.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.317+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v126'967 uv967 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.317+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066266660 con 0x55b0661a4ab0 2023-10-06T02:28:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.318+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v126'968 uv968 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.318+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066265650 con 0x55b0661a4ab0 2023-10-06T02:28:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.319+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v126'969 uv969 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b0661a4ab0 2023-10-06T02:28:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.319+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b066265b60 0x55b066267f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.319+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066268480 con 0x55b066265b60 2023-10-06T02:28:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.319+0000 7f30c1c44700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b066265b60 0x55b066267f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.320+0000 7f30c1c44700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b066265b60 0x55b066267f40 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:11.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.321+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v126'673 uv656 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.321+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066268830 con 0x55b066265b60 2023-10-06T02:28:11.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.323+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v126'674 uv674 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.323+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066268be0 con 0x55b066265b60 2023-10-06T02:28:11.325 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:28:11.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.324+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v126'675 uv675 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.324+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066269480 con 0x55b066265b60 2023-10-06T02:28:11.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.325+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v126'676 uv676 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.325+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066269830 con 0x55b066265b60 2023-10-06T02:28:11.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.326+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v126'677 uv677 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.326+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066269be0 con 0x55b066265b60 2023-10-06T02:28:11.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.327+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v126'678 uv661 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.327+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066269f90 con 0x55b066265b60 2023-10-06T02:28:11.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.329+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v126'679 uv679 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.329+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626a340 con 0x55b066265b60 2023-10-06T02:28:11.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.330+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v126'680 uv680 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.331 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:28:11.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.330+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626a340 con 0x55b066265b60 2023-10-06T02:28:11.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.331+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v126'681 uv681 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.331+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626a340 con 0x55b066265b60 2023-10-06T02:28:11.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.332+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v126'682 uv682 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.332+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626a340 con 0x55b066265b60 2023-10-06T02:28:11.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.333+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v126'683 uv666 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.333+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626a340 con 0x55b066265b60 2023-10-06T02:28:11.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.334+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v126'684 uv684 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.334+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626a340 con 0x55b066265b60 2023-10-06T02:28:11.337 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:28:11.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.335+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v126'685 uv685 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.335+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626da60 con 0x55b066265b60 2023-10-06T02:28:11.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.337+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v126'686 uv686 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.337+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626da60 con 0x55b066265b60 2023-10-06T02:28:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.338+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v126'687 uv687 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.338+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626a340 con 0x55b066265b60 2023-10-06T02:28:11.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.339+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v126'688 uv672 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.339+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626a340 con 0x55b066265b60 2023-10-06T02:28:11.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.340+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v126'689 uv689 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.340+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626a340 con 0x55b066265b60 2023-10-06T02:28:11.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.341+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v126'690 uv690 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.343 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:28:11.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.341+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626b350 con 0x55b066265b60 2023-10-06T02:28:11.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.343+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v126'691 uv691 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.343+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626b350 con 0x55b066265b60 2023-10-06T02:28:11.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.344+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v126'692 uv692 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.344+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626a340 con 0x55b066265b60 2023-10-06T02:28:11.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.345+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v126'693 uv693 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.345+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b06626a850 0x55b06626cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.345+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626d170 con 0x55b06626a850 2023-10-06T02:28:11.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.345+0000 7f30c1443700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b06626a850 0x55b06626cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.345+0000 7f30c1443700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b06626a850 0x55b06626cc30 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:11.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.346+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v126'183 uv182 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.346+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626d520 con 0x55b06626a850 2023-10-06T02:28:11.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.347+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v126'184 uv184 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.347+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626d950 con 0x55b06626a850 2023-10-06T02:28:11.350 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:28:11.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.348+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v126'185 uv185 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.348+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066269070 con 0x55b06626a850 2023-10-06T02:28:11.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.349+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v126'186 uv186 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.349+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626f350 con 0x55b06626a850 2023-10-06T02:28:11.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.350+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v126'187 uv187 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.350+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626e240 con 0x55b06626a850 2023-10-06T02:28:11.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.351+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v126'188 uv188 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.351+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626e640 con 0x55b06626a850 2023-10-06T02:28:11.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.353+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v126'129 uv128 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.353+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626e640 con 0x55b06626a850 2023-10-06T02:28:11.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.354+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v126'130 uv130 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.354+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626e640 con 0x55b06626a850 2023-10-06T02:28:11.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.355+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v126'131 uv131 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.356 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:28:11.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.355+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626eb30 con 0x55b06626a850 2023-10-06T02:28:11.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.356+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v126'132 uv132 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.356+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626eb30 con 0x55b066265b60 2023-10-06T02:28:11.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.357+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v126'183 uv182 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.357+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626eb30 con 0x55b066265b60 2023-10-06T02:28:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.358+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v126'184 uv184 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.358+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626eb30 con 0x55b066265b60 2023-10-06T02:28:11.360 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:28:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.359+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v126'185 uv185 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.359+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626eb30 con 0x55b066265b60 2023-10-06T02:28:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.360+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v126'186 uv186 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.360+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626eb30 con 0x55b066265b60 2023-10-06T02:28:11.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.361+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v126'187 uv187 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.361+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626eb30 con 0x55b066265b60 2023-10-06T02:28:11.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.363+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v126'188 uv188 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066265b60 2023-10-06T02:28:11.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.363+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b06626e640 0x55b066271cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.363+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066272210 con 0x55b06626e640 2023-10-06T02:28:11.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.363+0000 7f30c2445700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b06626e640 0x55b066271cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.363+0000 7f30c2445700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b06626e640 0x55b066271cd0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:11.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.364+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v126'338 uv332 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b06626e640 2023-10-06T02:28:11.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.364+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066272210 con 0x55b06626e640 2023-10-06T02:28:11.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.366+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v126'339 uv339 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b06626e640 2023-10-06T02:28:11.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.366+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066272210 con 0x55b06626e640 2023-10-06T02:28:11.368 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:28:11.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.367+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v126'340 uv340 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b06626e640 2023-10-06T02:28:11.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.367+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066273220 con 0x55b06626e640 2023-10-06T02:28:11.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.368+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v126'341 uv341 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b06626e640 2023-10-06T02:28:11.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.368+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066273220 con 0x55b06626e640 2023-10-06T02:28:11.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.369+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v126'342 uv342 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b06626e640 2023-10-06T02:28:11.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.369+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066272210 con 0x55b06626e640 2023-10-06T02:28:11.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.370+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v126'343 uv343 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b06626e640 2023-10-06T02:28:11.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.371+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066272210 con 0x55b06626e640 2023-10-06T02:28:11.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.373+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v126'344 uv337 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b06626e640 2023-10-06T02:28:11.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.373+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066272210 con 0x55b06626e640 2023-10-06T02:28:11.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.375+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v126'345 uv345 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b06626e640 2023-10-06T02:28:11.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.375+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066272210 con 0x55b06626e640 2023-10-06T02:28:11.377 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:28:11.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.376+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v126'346 uv346 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b06626e640 2023-10-06T02:28:11.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.376+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066272210 con 0x55b06626e640 2023-10-06T02:28:11.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.377+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v126'347 uv347 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b06626e640 2023-10-06T02:28:11.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.377+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06626ddd0 con 0x55b06626e640 2023-10-06T02:28:11.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.378+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v126'348 uv348 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b06626e640 2023-10-06T02:28:11.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.378+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55b066272c10 0x55b066274ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.378+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066275530 con 0x55b066272c10 2023-10-06T02:28:11.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.379+0000 7f30c1c44700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55b066272c10 0x55b066274ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.379+0000 7f30c1c44700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55b066272c10 0x55b066274ff0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:11.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.380+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v126'153 uv152 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066272c10 2023-10-06T02:28:11.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.380+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066275530 con 0x55b066272c10 2023-10-06T02:28:11.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.381+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v126'154 uv154 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066272c10 2023-10-06T02:28:11.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.382+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066275530 con 0x55b066272c10 2023-10-06T02:28:11.386 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:28:11.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.384+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v126'155 uv155 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066272c10 2023-10-06T02:28:11.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.384+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066272290 con 0x55b066272c10 2023-10-06T02:28:11.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.385+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v126'156 uv156 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066272c10 2023-10-06T02:28:11.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.385+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066275a20 con 0x55b066272c10 2023-10-06T02:28:11.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.388+0000 7f30c1c44700 1 -- 172.21.15.6:0/4262051206 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v126'157 uv157 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30bc017020 con 0x55b066272c10 2023-10-06T02:28:11.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.388+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066275a20 con 0x55b06626a850 2023-10-06T02:28:11.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.389+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v126'183 uv182 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.389+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066275a20 con 0x55b06626a850 2023-10-06T02:28:11.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.390+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v126'184 uv184 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.390+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066275a20 con 0x55b06626a850 2023-10-06T02:28:11.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.391+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v126'185 uv185 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.393 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:28:11.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.391+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066276a30 con 0x55b06626a850 2023-10-06T02:28:11.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.392+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v126'186 uv186 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.392+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066276a30 con 0x55b06626a850 2023-10-06T02:28:11.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.393+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v126'187 uv187 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.393+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066275a20 con 0x55b06626a850 2023-10-06T02:28:11.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.394+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v126'188 uv188 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.394+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b066275f30 0x55b066278310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.394+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066278850 con 0x55b066275f30 2023-10-06T02:28:11.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.394+0000 7f30c1443700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b066275f30 0x55b066278310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.395+0000 7f30c1443700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b066275f30 0x55b066278310 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:11.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.396+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v126'304 uv298 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b066275f30 2023-10-06T02:28:11.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.396+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066278850 con 0x55b066275f30 2023-10-06T02:28:11.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.397+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v126'305 uv305 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b066275f30 2023-10-06T02:28:11.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.397+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066278cb0 con 0x55b066275f30 2023-10-06T02:28:11.399 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:28:11.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.398+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v126'306 uv306 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b066275f30 2023-10-06T02:28:11.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.398+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066278cb0 con 0x55b066275f30 2023-10-06T02:28:11.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.399+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v126'307 uv307 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b066275f30 2023-10-06T02:28:11.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.399+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066278cb0 con 0x55b066275f30 2023-10-06T02:28:11.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.400+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v126'308 uv308 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b066275f30 2023-10-06T02:28:11.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.400+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066278cb0 con 0x55b066275f30 2023-10-06T02:28:11.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.401+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v126'309 uv303 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b066275f30 2023-10-06T02:28:11.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.401+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066278cb0 con 0x55b066275f30 2023-10-06T02:28:11.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.402+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v126'310 uv310 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b066275f30 2023-10-06T02:28:11.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.402+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066278cb0 con 0x55b066275f30 2023-10-06T02:28:11.404 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:28:11.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.403+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v126'311 uv311 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b066275f30 2023-10-06T02:28:11.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.403+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b066278cb0 con 0x55b066275f30 2023-10-06T02:28:11.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.404+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v126'312 uv312 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b066275f30 2023-10-06T02:28:11.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.404+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06627ba20 con 0x55b066275f30 2023-10-06T02:28:11.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.405+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v126'313 uv313 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b066275f30 2023-10-06T02:28:11.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.405+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626a850 2023-10-06T02:28:11.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.407+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v126'132 uv131 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.407+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626a850 2023-10-06T02:28:11.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.408+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v126'133 uv133 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.408+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626a850 2023-10-06T02:28:11.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.409+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v126'134 uv134 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.411 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:28:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.409+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626a850 2023-10-06T02:28:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.410+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v126'135 uv135 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.410+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55b066279a80 0x55b06627c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.410+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b066279a80 2023-10-06T02:28:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.410+0000 7f30c2445700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55b066279a80 0x55b06627c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.411+0000 7f30c2445700 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55b066279a80 0x55b06627c170 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.412+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v126'183 uv182 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b066279a80 2023-10-06T02:28:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.412+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b066279a80 2023-10-06T02:28:11.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.413+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v126'184 uv184 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b066279a80 2023-10-06T02:28:11.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.413+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b066279a80 2023-10-06T02:28:11.417 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:28:11.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.415+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v126'185 uv185 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b066279a80 2023-10-06T02:28:11.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.416+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b066279a80 2023-10-06T02:28:11.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.418+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v126'186 uv186 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b066279a80 2023-10-06T02:28:11.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.418+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b066279a80 2023-10-06T02:28:11.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.421+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v126'187 uv187 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b066279a80 2023-10-06T02:28:11.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.421+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b066279a80 2023-10-06T02:28:11.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.423+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v126'188 uv188 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b066279a80 2023-10-06T02:28:11.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.423+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626e640 2023-10-06T02:28:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.425+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v126'156 uv155 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b06626e640 2023-10-06T02:28:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.425+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626e640 2023-10-06T02:28:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.426+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v126'157 uv157 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b06626e640 2023-10-06T02:28:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.426+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626e640 2023-10-06T02:28:11.428 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:28:11.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.427+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v126'158 uv158 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b06626e640 2023-10-06T02:28:11.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.427+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626e640 2023-10-06T02:28:11.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.428+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v126'159 uv159 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b06626e640 2023-10-06T02:28:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.428+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626e640 2023-10-06T02:28:11.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.429+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v126'160 uv160 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f30b400e9c0 con 0x55b06626e640 2023-10-06T02:28:11.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.429+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626a850 2023-10-06T02:28:11.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.430+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v126'376 uv375 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.431+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626a850 2023-10-06T02:28:11.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.432+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v126'377 uv377 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.432+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626a850 2023-10-06T02:28:11.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.433+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v126'378 uv378 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.434 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:28:11.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.433+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626a850 2023-10-06T02:28:11.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.434+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v126'379 uv379 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.434+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626a850 2023-10-06T02:28:11.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.435+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v126'380 uv380 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.435+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626a850 2023-10-06T02:28:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.436+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v126'381 uv374 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.436+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626a850 2023-10-06T02:28:11.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.437+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v126'382 uv382 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.437+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626a850 2023-10-06T02:28:11.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.438+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v126'383 uv383 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.440 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:28:11.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.438+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626a850 2023-10-06T02:28:11.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.439+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v126'384 uv384 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.439+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662791a0 con 0x55b06626a850 2023-10-06T02:28:11.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.440+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v126'385 uv385 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.440+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b06627c6b0 con 0x55b06626a850 2023-10-06T02:28:11.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.441+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v126'386 uv386 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.441+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x55b0662790b0 con 0x55b06626a850 2023-10-06T02:28:11.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c1443700 1 -- 172.21.15.6:0/4262051206 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v126'387 uv387 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f30ac023020 con 0x55b06626a850 2023-10-06T02:28:11.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b06626a850 msgr2=0x55b06626cc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55b06626a850 0x55b06626cc30 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55b0661a4ab0 msgr2=0x55b066240550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55b0661a4ab0 0x55b066240550 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b066275f30 msgr2=0x55b066278310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55b066275f30 0x55b066278310 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b066265b60 msgr2=0x55b066267f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55b066265b60 0x55b066267f40 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55b066279a80 msgr2=0x55b06627c170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55b066279a80 0x55b06627c170 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55b066272c10 msgr2=0x55b066274ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55b066272c10 0x55b066274ff0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 reap_dead start 2023-10-06T02:28:11.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b06626e640 msgr2=0x55b066271cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55b06626e640 0x55b066271cd0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 reap_dead start 2023-10-06T02:28:11.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c2445700 1 -- 172.21.15.6:0/4262051206 reap_dead start 2023-10-06T02:28:11.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f30a4065890 msgr2=0x7f30a4067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f30a4065890 0x7f30a4067d40 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f30ac008930 tx=0x7f30ac01d000 comp rx=0 tx=0).stop 2023-10-06T02:28:11.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b06619fe30 msgr2=0x55b06624c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b06619fe30 0x55b06624c940 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f30bc003e10 tx=0x7f30bc000bc0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 shutdown_connections 2023-10-06T02:28:11.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b06619fe30 0x55b06624c940 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 --2- 172.21.15.6:0/4262051206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f30a4065890 0x7f30a4067d40 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 >> 172.21.15.6:0/4262051206 conn(0x55b0661bbbd0 msgr2=0x55b066244cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:11.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 shutdown_connections 2023-10-06T02:28:11.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.442+0000 7f30c8a09000 1 -- 172.21.15.6:0/4262051206 wait complete. 2023-10-06T02:28:11.448 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 sixmegs_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2023-10-06T02:28:11.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.528+0000 7f8a8365d000 1 Processor -- start 2023-10-06T02:28:11.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.528+0000 7f8a8365d000 1 -- start start 2023-10-06T02:28:11.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.529+0000 7f8a8365d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56248ba75b50 0x56248ba80200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.529+0000 7f8a8365d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56248b9a7c10 0x56248b9a7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.529+0000 7f8a8365d000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56248ba89780 0x56248ba89b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.529+0000 7f8a8365d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248b950320 con 0x56248b9a7c10 2023-10-06T02:28:11.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.529+0000 7f8a8365d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248b8f4980 con 0x56248ba75b50 2023-10-06T02:28:11.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.529+0000 7f8a8365d000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56248b8f4620 con 0x56248ba89780 2023-10-06T02:28:11.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.529+0000 7f8a77fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56248b9a7c10 0x56248b9a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.529+0000 7f8a77fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56248b9a7c10 0x56248b9a7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58018/0 (socket says 172.21.15.6:58018) 2023-10-06T02:28:11.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.529+0000 7f8a77fff700 1 -- 172.21.15.6:0/512755803 learned_addr learned my addr 172.21.15.6:0/512755803 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:11.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.529+0000 7f8a7c898700 1 --2- 172.21.15.6:0/512755803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56248ba75b50 0x56248ba80200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.529+0000 7f8a7d099700 1 --2- 172.21.15.6:0/512755803 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56248ba89780 0x56248ba89b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.529+0000 7f8a77fff700 1 -- 172.21.15.6:0/512755803 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56248ba89780 msgr2=0x56248ba89b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:11.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a77fff700 1 --2- 172.21.15.6:0/512755803 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56248ba89780 0x56248ba89b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a77fff700 1 -- 172.21.15.6:0/512755803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56248ba75b50 msgr2=0x56248ba80200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:11.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a77fff700 1 --2- 172.21.15.6:0/512755803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56248ba75b50 0x56248ba80200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a77fff700 1 -- 172.21.15.6:0/512755803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56248b8f6ae0 con 0x56248b9a7c10 2023-10-06T02:28:11.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a7d099700 1 --2- 172.21.15.6:0/512755803 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56248ba89780 0x56248ba89b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:11.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a77fff700 1 --2- 172.21.15.6:0/512755803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56248b9a7c10 0x56248b9a7fe0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f8a680097d0 tx=0x7f8a6800c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66301293a3688a33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:11.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a76ffd700 1 -- 172.21.15.6:0/512755803 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6800f040 con 0x56248b9a7c10 2023-10-06T02:28:11.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a76ffd700 1 -- 172.21.15.6:0/512755803 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a680089c0 con 0x56248b9a7c10 2023-10-06T02:28:11.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a76ffd700 1 -- 172.21.15.6:0/512755803 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68008d40 con 0x56248b9a7c10 2023-10-06T02:28:11.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a8365d000 1 -- 172.21.15.6:0/512755803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56248b9a7c10 msgr2=0x56248b9a7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a8365d000 1 --2- 172.21.15.6:0/512755803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56248b9a7c10 0x56248b9a7fe0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f8a680097d0 tx=0x7f8a6800c040 comp rx=0 tx=0).stop 2023-10-06T02:28:11.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a8365d000 1 -- 172.21.15.6:0/512755803 shutdown_connections 2023-10-06T02:28:11.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a8365d000 1 --2- 172.21.15.6:0/512755803 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56248ba89780 0x56248ba89b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a8365d000 1 --2- 172.21.15.6:0/512755803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56248ba75b50 0x56248ba80200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a8365d000 1 --2- 172.21.15.6:0/512755803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56248b9a7c10 0x56248b9a7fe0 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a8365d000 1 -- 172.21.15.6:0/512755803 >> 172.21.15.6:0/512755803 conn(0x56248b9f0c30 msgr2=0x56248b9f1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:11.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a8365d000 1 -- 172.21.15.6:0/512755803 shutdown_connections 2023-10-06T02:28:11.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.530+0000 7f8a8365d000 1 -- 172.21.15.6:0/512755803 wait complete. 2023-10-06T02:28:11.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.531+0000 7f8a8365d000 1 Processor -- start 2023-10-06T02:28:11.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.531+0000 7f8a8365d000 1 -- start start 2023-10-06T02:28:11.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a8365d000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56248b9a7c10 0x56248ba74c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a8365d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56248ba75b50 0x56248b9d4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a8365d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56248ba89780 0x56248b9d5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a8365d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248b8eb400 con 0x56248ba75b50 2023-10-06T02:28:11.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a8365d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248ba8ce80 con 0x56248ba89780 2023-10-06T02:28:11.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a8365d000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56248ba751a0 con 0x56248b9a7c10 2023-10-06T02:28:11.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a77fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56248ba75b50 0x56248b9d4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a77fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56248ba75b50 0x56248b9d4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58020/0 (socket says 172.21.15.6:58020) 2023-10-06T02:28:11.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a77fff700 1 -- 172.21.15.6:0/2624176370 learned_addr learned my addr 172.21.15.6:0/2624176370 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:11.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a7c898700 1 --2- 172.21.15.6:0/2624176370 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56248b9a7c10 0x56248ba74c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a7d099700 1 --2- 172.21.15.6:0/2624176370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56248ba89780 0x56248b9d5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a77fff700 1 -- 172.21.15.6:0/2624176370 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56248b9a7c10 msgr2=0x56248ba74c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a77fff700 1 --2- 172.21.15.6:0/2624176370 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56248b9a7c10 0x56248ba74c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a77fff700 1 -- 172.21.15.6:0/2624176370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56248ba89780 msgr2=0x56248b9d5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a77fff700 1 --2- 172.21.15.6:0/2624176370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56248ba89780 0x56248b9d5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a77fff700 1 -- 172.21.15.6:0/2624176370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a680094b0 con 0x56248ba75b50 2023-10-06T02:28:11.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a77fff700 1 --2- 172.21.15.6:0/2624176370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56248ba75b50 0x56248b9d4ed0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f8a68005fd0 tx=0x7f8a6801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:11.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.532+0000 7f8a757fa700 1 -- 172.21.15.6:0/2624176370 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6800f040 con 0x56248ba75b50 2023-10-06T02:28:11.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.533+0000 7f8a757fa700 1 -- 172.21.15.6:0/2624176370 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a68015990 con 0x56248ba75b50 2023-10-06T02:28:11.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.533+0000 7f8a8365d000 1 -- 172.21.15.6:0/2624176370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56248b8f6540 con 0x56248ba75b50 2023-10-06T02:28:11.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.533+0000 7f8a757fa700 1 -- 172.21.15.6:0/2624176370 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68015d10 con 0x56248ba75b50 2023-10-06T02:28:11.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.533+0000 7f8a8365d000 1 -- 172.21.15.6:0/2624176370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56248ba8c200 con 0x56248ba75b50 2023-10-06T02:28:11.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.534+0000 7f8a757fa700 1 -- 172.21.15.6:0/2624176370 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a6801f400 con 0x56248ba75b50 2023-10-06T02:28:11.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.534+0000 7f8a757fa700 1 --2- 172.21.15.6:0/2624176370 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a60065890 0x7f8a60067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.534+0000 7f8a757fa700 1 -- 172.21.15.6:0/2624176370 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7f8a68085fe0 con 0x56248ba75b50 2023-10-06T02:28:11.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.534+0000 7f8a8365d000 1 --2- 172.21.15.6:0/2624176370 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56248b9d5de0 0x56248ba83fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.534+0000 7f8a7c898700 1 --2- 172.21.15.6:0/2624176370 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a60065890 0x7f8a60067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.534+0000 7f8a8365d000 1 -- 172.21.15.6:0/2624176370 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=104b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126) v8 -- 0x56248b9f33b0 con 0x56248b9d5de0 2023-10-06T02:28:11.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.535+0000 7f8a7d099700 1 --2- 172.21.15.6:0/2624176370 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56248b9d5de0 0x56248ba83fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.535+0000 7f8a7d099700 1 --2- 172.21.15.6:0/2624176370 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56248b9d5de0 0x56248ba83fa0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:11.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.535+0000 7f8a7c898700 1 --2- 172.21.15.6:0/2624176370 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a60065890 0x7f8a60067d40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8a70000c00 tx=0x7f8a70001830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:11.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.536+0000 7f8a7d099700 1 -- 172.21.15.6:0/2624176370 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v126'970 uv970 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f8a78006240 con 0x56248b9d5de0 2023-10-06T02:28:11.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.536+0000 7f8a8365d000 1 -- 172.21.15.6:0/2624176370 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56248b9d5de0 msgr2=0x56248ba83fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.537+0000 7f8a8365d000 1 --2- 172.21.15.6:0/2624176370 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56248b9d5de0 0x56248ba83fa0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.537+0000 7f8a8365d000 1 -- 172.21.15.6:0/2624176370 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a60065890 msgr2=0x7f8a60067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.537+0000 7f8a8365d000 1 --2- 172.21.15.6:0/2624176370 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a60065890 0x7f8a60067d40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8a70000c00 tx=0x7f8a70001830 comp rx=0 tx=0).stop 2023-10-06T02:28:11.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.537+0000 7f8a8365d000 1 -- 172.21.15.6:0/2624176370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56248ba75b50 msgr2=0x56248b9d4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.537+0000 7f8a8365d000 1 --2- 172.21.15.6:0/2624176370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56248ba75b50 0x56248b9d4ed0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f8a68005fd0 tx=0x7f8a6801a000 comp rx=0 tx=0).stop 2023-10-06T02:28:11.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.537+0000 7f8a7d099700 1 -- 172.21.15.6:0/2624176370 reap_dead start 2023-10-06T02:28:11.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.537+0000 7f8a8365d000 1 -- 172.21.15.6:0/2624176370 shutdown_connections 2023-10-06T02:28:11.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.537+0000 7f8a8365d000 1 -- 172.21.15.6:0/2624176370 >> 172.21.15.6:0/2624176370 conn(0x56248b9f0c30 msgr2=0x56248b9f1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:11.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.537+0000 7f8a8365d000 1 -- 172.21.15.6:0/2624176370 shutdown_connections 2023-10-06T02:28:11.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.537+0000 7f8a8365d000 1 -- 172.21.15.6:0/2624176370 wait complete. 2023-10-06T02:28:11.546 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:28:11.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.705+0000 7fa982925700 1 Processor -- start 2023-10-06T02:28:11.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.705+0000 7fa982925700 1 -- start start 2023-10-06T02:28:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.706+0000 7fa982925700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa97c0cd7d0 0x7fa97c0d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.706+0000 7fa982925700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97c0af770 con 0x7fa97c0cd400 2023-10-06T02:28:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.706+0000 7fa982925700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97c0afa50 con 0x7fa97c0b0810 2023-10-06T02:28:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.706+0000 7fa982925700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c0afd30 con 0x7fa97c0cd7d0 2023-10-06T02:28:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.706+0000 7fa981923700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa97c0cd400 0x7fa97c0b1f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60730/0 (socket says 172.21.15.6:60730) 2023-10-06T02:28:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.706+0000 7fa981923700 1 -- 172.21.15.6:0/607998935 learned_addr learned my addr 172.21.15.6:0/607998935 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.706+0000 7fa981122700 1 --2- 172.21.15.6:0/607998935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa97c0cd7d0 0x7fa97c0d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.706+0000 7fa980921700 1 -- 172.21.15.6:0/607998935 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032855016 0 0) 0x7fa97c0af770 con 0x7fa97c0cd400 2023-10-06T02:28:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.706+0000 7fa980921700 1 -- 172.21.15.6:0/607998935 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa964003570 con 0x7fa97c0cd400 2023-10-06T02:28:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.706+0000 7fa980921700 1 -- 172.21.15.6:0/607998935 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019685752 0 0) 0x7fa97c0afa50 con 0x7fa97c0b0810 2023-10-06T02:28:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.706+0000 7fa980921700 1 -- 172.21.15.6:0/607998935 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa97c0af770 con 0x7fa97c0b0810 2023-10-06T02:28:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.706+0000 7fa981122700 1 -- 172.21.15.6:0/607998935 >> v1:172.21.15.175:6789/0 conn(0x7fa97c0b0810 legacy=0x7fa97c15a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.706+0000 7fa981122700 1 -- 172.21.15.6:0/607998935 >> v1:172.21.15.6:6789/0 conn(0x7fa97c0cd400 legacy=0x7fa97c0b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.706+0000 7fa981122700 1 -- 172.21.15.6:0/607998935 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c0b0010 con 0x7fa97c0cd7d0 2023-10-06T02:28:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.707+0000 7fa981122700 1 --2- 172.21.15.6:0/607998935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa97c0cd7d0 0x7fa97c0d01a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa970009910 tx=0x7fa9700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69d64a71400b0c78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.707+0000 7fa980921700 1 -- 172.21.15.6:0/607998935 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970011630 con 0x7fa97c0cd7d0 2023-10-06T02:28:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.707+0000 7fa980921700 1 -- 172.21.15.6:0/607998935 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa970011790 con 0x7fa97c0cd7d0 2023-10-06T02:28:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.707+0000 7fa980921700 1 -- 172.21.15.6:0/607998935 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970011b30 con 0x7fa97c0cd7d0 2023-10-06T02:28:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.707+0000 7fa982925700 1 -- 172.21.15.6:0/607998935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa97c0cd7d0 msgr2=0x7fa97c0d01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.707+0000 7fa982925700 1 --2- 172.21.15.6:0/607998935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa97c0cd7d0 0x7fa97c0d01a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa970009910 tx=0x7fa9700091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.707+0000 7fa982925700 1 -- 172.21.15.6:0/607998935 shutdown_connections 2023-10-06T02:28:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.707+0000 7fa982925700 1 --2- 172.21.15.6:0/607998935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa97c0cd7d0 0x7fa97c0d01a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.707+0000 7fa982925700 1 -- 172.21.15.6:0/607998935 >> 172.21.15.6:0/607998935 conn(0x7fa97c06a110 msgr2=0x7fa97c06a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.708+0000 7fa982925700 1 -- 172.21.15.6:0/607998935 shutdown_connections 2023-10-06T02:28:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.708+0000 7fa982925700 1 -- 172.21.15.6:0/607998935 wait complete. 2023-10-06T02:28:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.709+0000 7fa982925700 1 Processor -- start 2023-10-06T02:28:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.709+0000 7fa982925700 1 -- start start 2023-10-06T02:28:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.709+0000 7fa982925700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa97c0b0810 0x7fa97c0c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.709+0000 7fa982925700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0cd400 0x7fa97c0b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.709+0000 7fa982925700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa97c0cf560 0x7fa97c15bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.709+0000 7fa982925700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c15c7b0 con 0x7fa97c0cd400 2023-10-06T02:28:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.709+0000 7fa982925700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c15c4d0 con 0x7fa97c0cf560 2023-10-06T02:28:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.709+0000 7fa982925700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c0c7250 con 0x7fa97c0b0810 2023-10-06T02:28:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.709+0000 7fa981122700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0cd400 0x7fa97c0b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.709+0000 7fa981122700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0cd400 0x7fa97c0b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58030/0 (socket says 172.21.15.6:58030) 2023-10-06T02:28:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.709+0000 7fa981122700 1 -- 172.21.15.6:0/2735085865 learned_addr learned my addr 172.21.15.6:0/2735085865 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.710+0000 7fa982124700 1 --2- 172.21.15.6:0/2735085865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa97c0cf560 0x7fa97c15bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.710+0000 7fa981923700 1 --2- 172.21.15.6:0/2735085865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa97c0b0810 0x7fa97c0c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.710+0000 7fa981122700 1 -- 172.21.15.6:0/2735085865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa97c0b0810 msgr2=0x7fa97c0c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.710+0000 7fa981122700 1 --2- 172.21.15.6:0/2735085865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa97c0b0810 0x7fa97c0c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.710+0000 7fa981122700 1 -- 172.21.15.6:0/2735085865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa97c0cf560 msgr2=0x7fa97c15bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.710+0000 7fa981122700 1 --2- 172.21.15.6:0/2735085865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa97c0cf560 0x7fa97c15bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:11.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.710+0000 7fa981122700 1 -- 172.21.15.6:0/2735085865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa970009420 con 0x7fa97c0cd400 2023-10-06T02:28:11.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.710+0000 7fa981122700 1 --2- 172.21.15.6:0/2735085865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0cd400 0x7fa97c0b4100 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7fa970009f00 tx=0x7fa970017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:11.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.710+0000 7fa979ffb700 1 -- 172.21.15.6:0/2735085865 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97001f070 con 0x7fa97c0cd400 2023-10-06T02:28:11.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.710+0000 7fa979ffb700 1 -- 172.21.15.6:0/2735085865 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa970002f70 con 0x7fa97c0cd400 2023-10-06T02:28:11.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.710+0000 7fa979ffb700 1 -- 172.21.15.6:0/2735085865 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970011900 con 0x7fa97c0cd400 2023-10-06T02:28:11.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.710+0000 7fa982925700 1 -- 172.21.15.6:0/2735085865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa97c0c7530 con 0x7fa97c0cd400 2023-10-06T02:28:11.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.710+0000 7fa982925700 1 -- 172.21.15.6:0/2735085865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97c0c8270 con 0x7fa97c0cd400 2023-10-06T02:28:11.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.711+0000 7fa982925700 1 -- 172.21.15.6:0/2735085865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97c0c8460 con 0x7fa97c0cd400 2023-10-06T02:28:11.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.712+0000 7fa979ffb700 1 -- 172.21.15.6:0/2735085865 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa970023070 con 0x7fa97c0cd400 2023-10-06T02:28:11.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.712+0000 7fa979ffb700 1 --2- 172.21.15.6:0/2735085865 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa968066f30 0x7fa9680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:11.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.712+0000 7fa979ffb700 1 -- 172.21.15.6:0/2735085865 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7fa970086530 con 0x7fa97c0cd400 2023-10-06T02:28:11.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.712+0000 7fa981923700 1 --2- 172.21.15.6:0/2735085865 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa968066f30 0x7fa9680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:11.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.713+0000 7fa981923700 1 --2- 172.21.15.6:0/2735085865 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa968066f30 0x7fa9680693e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fa96c007fd0 tx=0x7fa96c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:11.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.717+0000 7fa979ffb700 1 -- 172.21.15.6:0/2735085865 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa970052a50 con 0x7fa97c0cd400 2023-10-06T02:28:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:11.954+0000 7fa982925700 1 -- 172.21.15.6:0/2735085865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fa97c0c7a50 con 0x7fa97c0cd400 2023-10-06T02:28:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.220+0000 7fa979ffb700 1 -- 172.21.15.6:0/2735085865 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v284) v1 ==== 162+0+0 (secure 0 0 0) 0x7fa97c0c7a50 con 0x7fa97c0cd400 2023-10-06T02:28:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.222+0000 7fa982925700 1 -- 172.21.15.6:0/2735085865 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa968066f30 msgr2=0x7fa9680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.222+0000 7fa982925700 1 --2- 172.21.15.6:0/2735085865 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa968066f30 0x7fa9680693e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fa96c007fd0 tx=0x7fa96c009040 comp rx=0 tx=0).stop 2023-10-06T02:28:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.222+0000 7fa982925700 1 -- 172.21.15.6:0/2735085865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0cd400 msgr2=0x7fa97c0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.222+0000 7fa982925700 1 --2- 172.21.15.6:0/2735085865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0cd400 0x7fa97c0b4100 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7fa970009f00 tx=0x7fa970017000 comp rx=0 tx=0).stop 2023-10-06T02:28:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.222+0000 7fa982925700 1 -- 172.21.15.6:0/2735085865 shutdown_connections 2023-10-06T02:28:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.222+0000 7fa982925700 1 --2- 172.21.15.6:0/2735085865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa97c0cf560 0x7fa97c15bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.222+0000 7fa982925700 1 --2- 172.21.15.6:0/2735085865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa97c0b0810 0x7fa97c0c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.222+0000 7fa982925700 1 --2- 172.21.15.6:0/2735085865 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa968066f30 0x7fa9680693e0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.222+0000 7fa982925700 1 --2- 172.21.15.6:0/2735085865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0cd400 0x7fa97c0b4100 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.222+0000 7fa982925700 1 -- 172.21.15.6:0/2735085865 >> 172.21.15.6:0/2735085865 conn(0x7fa97c06a110 msgr2=0x7fa97c0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.223+0000 7fa982925700 1 -- 172.21.15.6:0/2735085865 shutdown_connections 2023-10-06T02:28:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.223+0000 7fa982925700 1 -- 172.21.15.6:0/2735085865 wait complete. 2023-10-06T02:28:12.226 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:28:12.644 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:12.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.775+0000 7f9dbf59e700 1 Processor -- start 2023-10-06T02:28:12.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.775+0000 7f9dbf59e700 1 -- start start 2023-10-06T02:28:12.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9dbf59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc0159400 0x7f9dc00ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:12.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9dbf59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9dc00d05d0 0x7f9dc00b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:12.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9dbf59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc00b3560 con 0x7f9dc00cd030 2023-10-06T02:28:12.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9dbf59e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc00cf6f0 con 0x7f9dc00d05d0 2023-10-06T02:28:12.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9dbf59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc00cf9d0 con 0x7f9dc0159400 2023-10-06T02:28:12.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9db5d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9dc00cd030 0x7f9dc00cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60736/0 (socket says 172.21.15.6:60736) 2023-10-06T02:28:12.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9db5d9b700 1 -- 172.21.15.6:0/800816568 learned_addr learned my addr 172.21.15.6:0/800816568 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:12.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9dbe59c700 1 --2- 172.21.15.6:0/800816568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc0159400 0x7f9dc00ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:12.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9dbed9d700 1 --2- 172.21.15.6:0/800816568 >> v2:172.21.15.175:3300/0 conn(0x7f9dc00d05d0 0x7f9dc00b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:12.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9dbdd9b700 1 -- 172.21.15.6:0/800816568 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154094177 0 0) 0x7f9dc00b3560 con 0x7f9dc00cd030 2023-10-06T02:28:12.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9dbdd9b700 1 -- 172.21.15.6:0/800816568 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dac003570 con 0x7f9dc00cd030 2023-10-06T02:28:12.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9dbdd9b700 1 -- 172.21.15.6:0/800816568 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2785378350 0 0) 0x7f9dac003570 con 0x7f9dc00cd030 2023-10-06T02:28:12.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9dbdd9b700 1 -- 172.21.15.6:0/800816568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc0159400 msgr2=0x7f9dc00ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:12.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9dbdd9b700 1 --2- 172.21.15.6:0/800816568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc0159400 0x7f9dc00ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:12.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9dbdd9b700 1 -- 172.21.15.6:0/800816568 >> v2:172.21.15.175:3300/0 conn(0x7f9dc00d05d0 msgr2=0x7f9dc00b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:12.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9dbdd9b700 1 --2- 172.21.15.6:0/800816568 >> v2:172.21.15.175:3300/0 conn(0x7f9dc00d05d0 0x7f9dc00b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:12.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9dbdd9b700 1 -- 172.21.15.6:0/800816568 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc00b2f10 con 0x7f9dc00cd030 2023-10-06T02:28:12.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9dbed9d700 1 --2- 172.21.15.6:0/800816568 >> v2:172.21.15.175:3300/0 conn(0x7f9dc00d05d0 0x7f9dc00b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:12.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.776+0000 7f9dbdd9b700 1 -- 172.21.15.6:0/800816568 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f9da8001470 con 0x7f9dc00cd030 2023-10-06T02:28:12.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbe59c700 1 --2- 172.21.15.6:0/800816568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc0159400 0x7f9dc00ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:12.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbdd9b700 1 -- 172.21.15.6:0/800816568 >> v1:172.21.15.6:6789/0 conn(0x7f9dc00cd030 legacy=0x7f9dc00cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:12.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbdd9b700 1 --2- 172.21.15.6:0/800816568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dac003a60 0x7f9dac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:12.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbdd9b700 1 --2- 172.21.15.6:0/800816568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc0159400 0x7f9dac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:12.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbdd9b700 1 --2- 172.21.15.6:0/800816568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dac004d50 0x7f9dac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:12.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbdd9b700 1 -- 172.21.15.6:0/800816568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc00cf6f0 con 0x7f9dac003a60 2023-10-06T02:28:12.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbdd9b700 1 -- 172.21.15.6:0/800816568 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc00cf9d0 con 0x7f9dac004d50 2023-10-06T02:28:12.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbdd9b700 1 -- 172.21.15.6:0/800816568 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac00ba60 con 0x7f9dc0159400 2023-10-06T02:28:12.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbe59c700 1 --2- 172.21.15.6:0/800816568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dac003a60 0x7f9dac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:12.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9db5d9b700 1 --2- 172.21.15.6:0/800816568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc0159400 0x7f9dac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:12.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbed9d700 1 --2- 172.21.15.6:0/800816568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dac004d50 0x7f9dac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:12.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbe59c700 1 -- 172.21.15.6:0/800816568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc0159400 msgr2=0x7f9dac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:12.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbe59c700 1 --2- 172.21.15.6:0/800816568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc0159400 0x7f9dac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:12.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbe59c700 1 -- 172.21.15.6:0/800816568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dac004d50 msgr2=0x7f9dac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:12.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbe59c700 1 --2- 172.21.15.6:0/800816568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dac004d50 0x7f9dac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:12.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbe59c700 1 -- 172.21.15.6:0/800816568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db00093c0 con 0x7f9dac003a60 2023-10-06T02:28:12.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbed9d700 1 --2- 172.21.15.6:0/800816568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dac004d50 0x7f9dac0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:12.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbe59c700 1 --2- 172.21.15.6:0/800816568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dac003a60 0x7f9dac003e70 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009de0 tx=0x7f9db0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9345164cec9015c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:12.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbdd9b700 1 -- 172.21.15.6:0/800816568 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0009730 con 0x7f9dac003a60 2023-10-06T02:28:12.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbdd9b700 1 -- 172.21.15.6:0/800816568 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db0005a00 con 0x7f9dac003a60 2023-10-06T02:28:12.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.777+0000 7f9dbdd9b700 1 -- 172.21.15.6:0/800816568 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0005dc0 con 0x7f9dac003a60 2023-10-06T02:28:12.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.778+0000 7f9dbf59e700 1 -- 172.21.15.6:0/800816568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dac003a60 msgr2=0x7f9dac003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:12.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.778+0000 7f9dbf59e700 1 --2- 172.21.15.6:0/800816568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dac003a60 0x7f9dac003e70 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009de0 tx=0x7f9db0009120 comp rx=0 tx=0).stop 2023-10-06T02:28:12.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.778+0000 7f9dbed9d700 1 -- 172.21.15.6:0/800816568 reap_dead start 2023-10-06T02:28:12.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.778+0000 7f9dbf59e700 1 -- 172.21.15.6:0/800816568 shutdown_connections 2023-10-06T02:28:12.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.778+0000 7f9dbf59e700 1 -- 172.21.15.6:0/800816568 >> 172.21.15.6:0/800816568 conn(0x7f9dc006ac10 msgr2=0x7f9dc0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:12.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.778+0000 7f9dbf59e700 1 -- 172.21.15.6:0/800816568 shutdown_connections 2023-10-06T02:28:12.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.778+0000 7f9dbf59e700 1 -- 172.21.15.6:0/800816568 wait complete. 2023-10-06T02:28:12.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.779+0000 7f9dbf59e700 1 Processor -- start 2023-10-06T02:28:12.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.779+0000 7f9dbf59e700 1 -- start start 2023-10-06T02:28:12.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.780+0000 7f9dbf59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dac003a60 0x7f9dc0151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:12.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.780+0000 7f9dbf59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dc00c4ef0 0x7f9dc00c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:12.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.780+0000 7f9dbf59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc00b1710 0x7f9dc00b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:12.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.780+0000 7f9dbf59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc00b20c0 con 0x7f9dac003a60 2023-10-06T02:28:12.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.780+0000 7f9dbf59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc01530a0 con 0x7f9dc00c4ef0 2023-10-06T02:28:12.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.780+0000 7f9dbf59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc0151be0 con 0x7f9dc00b1710 2023-10-06T02:28:12.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.780+0000 7f9dbe59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dac003a60 0x7f9dc0151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:12.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.780+0000 7f9dbe59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dac003a60 0x7f9dc0151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58046/0 (socket says 172.21.15.6:58046) 2023-10-06T02:28:12.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.780+0000 7f9dbe59c700 1 -- 172.21.15.6:0/2747881827 learned_addr learned my addr 172.21.15.6:0/2747881827 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:12.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.780+0000 7f9dbed9d700 1 --2- 172.21.15.6:0/2747881827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc00b1710 0x7f9dc00b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:12.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.780+0000 7f9db5d9b700 1 --2- 172.21.15.6:0/2747881827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dc00c4ef0 0x7f9dc00c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:12.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.780+0000 7f9dbe59c700 1 -- 172.21.15.6:0/2747881827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc00b1710 msgr2=0x7f9dc00b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:12.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.781+0000 7f9dbe59c700 1 --2- 172.21.15.6:0/2747881827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc00b1710 0x7f9dc00b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:12.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.781+0000 7f9dbe59c700 1 -- 172.21.15.6:0/2747881827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dc00c4ef0 msgr2=0x7f9dc00c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:12.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.781+0000 7f9dbe59c700 1 --2- 172.21.15.6:0/2747881827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dc00c4ef0 0x7f9dc00c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:12.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.781+0000 7f9dbe59c700 1 -- 172.21.15.6:0/2747881827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc0152490 con 0x7f9dac003a60 2023-10-06T02:28:12.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.781+0000 7f9db5d9b700 1 --2- 172.21.15.6:0/2747881827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dc00c4ef0 0x7f9dc00c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:12.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.781+0000 7f9dbed9d700 1 --2- 172.21.15.6:0/2747881827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc00b1710 0x7f9dc00b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:12.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.781+0000 7f9dbe59c700 1 --2- 172.21.15.6:0/2747881827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dac003a60 0x7f9dc0151e00 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0046f0 tx=0x7f9db0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:12.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.781+0000 7f9db6ffd700 1 -- 172.21.15.6:0/2747881827 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0023070 con 0x7f9dac003a60 2023-10-06T02:28:12.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.781+0000 7f9db6ffd700 1 -- 172.21.15.6:0/2747881827 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db0006240 con 0x7f9dac003a60 2023-10-06T02:28:12.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.781+0000 7f9dbf59e700 1 -- 172.21.15.6:0/2747881827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc0152770 con 0x7f9dac003a60 2023-10-06T02:28:12.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.781+0000 7f9db6ffd700 1 -- 172.21.15.6:0/2747881827 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0006600 con 0x7f9dac003a60 2023-10-06T02:28:12.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.781+0000 7f9dbf59e700 1 -- 172.21.15.6:0/2747881827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc0152d30 con 0x7f9dac003a60 2023-10-06T02:28:12.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.782+0000 7f9dbf59e700 1 -- 172.21.15.6:0/2747881827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc00cf220 con 0x7f9dac003a60 2023-10-06T02:28:12.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.782+0000 7f9db6ffd700 1 -- 172.21.15.6:0/2747881827 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9db0013470 con 0x7f9dac003a60 2023-10-06T02:28:12.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.783+0000 7f9db6ffd700 1 --2- 172.21.15.6:0/2747881827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9da0066f30 0x7f9da00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:12.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.783+0000 7f9db6ffd700 1 -- 172.21.15.6:0/2747881827 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7f9db00868b0 con 0x7f9dac003a60 2023-10-06T02:28:12.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.783+0000 7f9db5d9b700 1 --2- 172.21.15.6:0/2747881827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9da0066f30 0x7f9da00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:12.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.784+0000 7f9db5d9b700 1 --2- 172.21.15.6:0/2747881827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9da0066f30 0x7f9da00693e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f9da8000e10 tx=0x7f9da8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:12.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:12.787+0000 7f9db6ffd700 1 -- 172.21.15.6:0/2747881827 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9db0052e50 con 0x7f9dac003a60 2023-10-06T02:28:13.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:13.026+0000 7f9dbf59e700 1 -- 172.21.15.6:0/2747881827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9dc00b31f0 con 0x7f9dac003a60 2023-10-06T02:28:13.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:13.026+0000 7f9db6ffd700 1 -- 172.21.15.6:0/2747881827 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 285 v285) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f9db0017020 con 0x7f9dac003a60 2023-10-06T02:28:13.028 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:13.028 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":285,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":285,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:28:12.222356+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9963":{"gid":9963,"name":"a","rank":0,"incarnation":285,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/4058600046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":4058600046},{"type":"v1","addr":"172.21.15.6:6835","nonce":4058600046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:13.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:13.029+0000 7f9dbf59e700 1 -- 172.21.15.6:0/2747881827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9da0066f30 msgr2=0x7f9da00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:13.029+0000 7f9dbf59e700 1 --2- 172.21.15.6:0/2747881827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9da0066f30 0x7f9da00693e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f9da8000e10 tx=0x7f9da8009040 comp rx=0 tx=0).stop 2023-10-06T02:28:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:13.029+0000 7f9dbf59e700 1 -- 172.21.15.6:0/2747881827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dac003a60 msgr2=0x7f9dc0151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:13.029+0000 7f9dbf59e700 1 --2- 172.21.15.6:0/2747881827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dac003a60 0x7f9dc0151e00 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0046f0 tx=0x7f9db0019000 comp rx=0 tx=0).stop 2023-10-06T02:28:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:13.029+0000 7f9dbf59e700 1 -- 172.21.15.6:0/2747881827 shutdown_connections 2023-10-06T02:28:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:13.029+0000 7f9dbf59e700 1 --2- 172.21.15.6:0/2747881827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc00b1710 0x7f9dc00b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:13.029+0000 7f9dbf59e700 1 --2- 172.21.15.6:0/2747881827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9da0066f30 0x7f9da00693e0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:13.029+0000 7f9dbf59e700 1 --2- 172.21.15.6:0/2747881827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dac003a60 0x7f9dc0151e00 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:13.029+0000 7f9dbf59e700 1 --2- 172.21.15.6:0/2747881827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dc00c4ef0 0x7f9dc00c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:13.029+0000 7f9dbf59e700 1 -- 172.21.15.6:0/2747881827 >> 172.21.15.6:0/2747881827 conn(0x7f9dc006ac10 msgr2=0x7f9dc01565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:13.029+0000 7f9dbf59e700 1 -- 172.21.15.6:0/2747881827 shutdown_connections 2023-10-06T02:28:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:13.029+0000 7f9dbf59e700 1 -- 172.21.15.6:0/2747881827 wait complete. 2023-10-06T02:28:13.032 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 285 2023-10-06T02:28:13.042 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 285, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:28:12.222356+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 126, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9963}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9963': {'gid': 9963, 'name': 'a', 'rank': 0, 'incarnation': 285, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.6:6835/4058600046', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 4058600046}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 4058600046}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:28:13.043 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9963:up:replay 2023-10-06T02:28:13.043 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2023-10-06T02:28:18.447 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:18.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.577+0000 7fc8fe04c700 1 Processor -- start 2023-10-06T02:28:18.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.577+0000 7fc8fe04c700 1 -- start start 2023-10-06T02:28:18.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.578+0000 7fc8fe04c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8f8159400 0x7fc8f80ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.578+0000 7fc8fe04c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc8f80cd030 0x7fc8f80cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.578+0000 7fc8fe04c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc8f80cf1a0 0x7fc8f80d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.578+0000 7fc8fe04c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f80b3560 con 0x7fc8f80cd030 2023-10-06T02:28:18.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.578+0000 7fc8fe04c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f80cf6f0 con 0x7fc8f80cf1a0 2023-10-06T02:28:18.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.578+0000 7fc8fe04c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80cf9d0 con 0x7fc8f8159400 2023-10-06T02:28:18.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.578+0000 7fc8fc849700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc8f80cd030 0x7fc8f80cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.578+0000 7fc8fc849700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc8f80cd030 0x7fc8f80cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58060/0 (socket says 172.21.15.6:58060) 2023-10-06T02:28:18.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.578+0000 7fc8fc849700 1 -- 172.21.15.6:0/2255201829 learned_addr learned my addr 172.21.15.6:0/2255201829 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:18.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.578+0000 7fc8fd04a700 1 --2- 172.21.15.6:0/2255201829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8f8159400 0x7fc8f80ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.578+0000 7fc8fd84b700 1 --2- 172.21.15.6:0/2255201829 >> v2:172.21.15.175:3300/0 conn(0x7fc8f80cf1a0 0x7fc8f80d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.579+0000 7fc8fc849700 1 -- 172.21.15.6:0/2255201829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8f8159400 msgr2=0x7fc8f80ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:18.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.579+0000 7fc8fc849700 1 --2- 172.21.15.6:0/2255201829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8f8159400 0x7fc8f80ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.579+0000 7fc8fc849700 1 -- 172.21.15.6:0/2255201829 >> v2:172.21.15.175:3300/0 conn(0x7fc8f80cf1a0 msgr2=0x7fc8f80d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:18.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.579+0000 7fc8fc849700 1 --2- 172.21.15.6:0/2255201829 >> v2:172.21.15.175:3300/0 conn(0x7fc8f80cf1a0 0x7fc8f80d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.579+0000 7fc8fc849700 1 -- 172.21.15.6:0/2255201829 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f80b2f10 con 0x7fc8f80cd030 2023-10-06T02:28:18.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.579+0000 7fc8fd84b700 1 --2- 172.21.15.6:0/2255201829 >> v2:172.21.15.175:3300/0 conn(0x7fc8f80cf1a0 0x7fc8f80d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:18.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.579+0000 7fc8fd04a700 1 --2- 172.21.15.6:0/2255201829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8f8159400 0x7fc8f80ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:18.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.579+0000 7fc8fc849700 1 --2- 172.21.15.6:0/2255201829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f80cd030 0x7fc8f80cfec0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80d0f40 tx=0x7fc8e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d51e1996020367 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:18.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.579+0000 7fc8effff700 1 -- 172.21.15.6:0/2255201829 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e800b860 con 0x7fc8f80cd030 2023-10-06T02:28:18.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.579+0000 7fc8effff700 1 -- 172.21.15.6:0/2255201829 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e800b9c0 con 0x7fc8f80cd030 2023-10-06T02:28:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.579+0000 7fc8effff700 1 -- 172.21.15.6:0/2255201829 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e800bd60 con 0x7fc8f80cd030 2023-10-06T02:28:18.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.580+0000 7fc8fe04c700 1 -- 172.21.15.6:0/2255201829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f80cd030 msgr2=0x7fc8f80cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:18.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.580+0000 7fc8fe04c700 1 --2- 172.21.15.6:0/2255201829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f80cd030 0x7fc8f80cfec0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80d0f40 tx=0x7fc8e8009250 comp rx=0 tx=0).stop 2023-10-06T02:28:18.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.580+0000 7fc8fe04c700 1 -- 172.21.15.6:0/2255201829 shutdown_connections 2023-10-06T02:28:18.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.580+0000 7fc8fe04c700 1 --2- 172.21.15.6:0/2255201829 >> v2:172.21.15.175:3300/0 conn(0x7fc8f80cf1a0 0x7fc8f80d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.580+0000 7fc8fe04c700 1 --2- 172.21.15.6:0/2255201829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8f8159400 0x7fc8f80ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.580+0000 7fc8fe04c700 1 --2- 172.21.15.6:0/2255201829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f80cd030 0x7fc8f80cfec0 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.580+0000 7fc8fe04c700 1 -- 172.21.15.6:0/2255201829 >> 172.21.15.6:0/2255201829 conn(0x7fc8f806ac10 msgr2=0x7fc8f8068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:18.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.580+0000 7fc8fe04c700 1 -- 172.21.15.6:0/2255201829 shutdown_connections 2023-10-06T02:28:18.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.580+0000 7fc8fe04c700 1 -- 172.21.15.6:0/2255201829 wait complete. 2023-10-06T02:28:18.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.581+0000 7fc8fe04c700 1 Processor -- start 2023-10-06T02:28:18.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.581+0000 7fc8fe04c700 1 -- start start 2023-10-06T02:28:18.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fe04c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f80cd030 0x7fc8f80c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fe04c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8f80cf1a0 0x7fc8f80c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fe04c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8f8159400 0x7fc8f8147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fe04c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80c8ad0 con 0x7fc8f80cd030 2023-10-06T02:28:18.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fe04c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80ca850 con 0x7fc8f8159400 2023-10-06T02:28:18.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fe04c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f81484e0 con 0x7fc8f80cf1a0 2023-10-06T02:28:18.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fd04a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f80cd030 0x7fc8f80c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fd04a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f80cd030 0x7fc8f80c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58068/0 (socket says 172.21.15.6:58068) 2023-10-06T02:28:18.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fd04a700 1 -- 172.21.15.6:0/3920967830 learned_addr learned my addr 172.21.15.6:0/3920967830 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:18.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fc849700 1 --2- 172.21.15.6:0/3920967830 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8f80cf1a0 0x7fc8f80c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fd84b700 1 --2- 172.21.15.6:0/3920967830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8f8159400 0x7fc8f8147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fd04a700 1 -- 172.21.15.6:0/3920967830 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8f80cf1a0 msgr2=0x7fc8f80c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:18.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fd04a700 1 --2- 172.21.15.6:0/3920967830 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8f80cf1a0 0x7fc8f80c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fd04a700 1 -- 172.21.15.6:0/3920967830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8f8159400 msgr2=0x7fc8f8147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:18.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fd04a700 1 --2- 172.21.15.6:0/3920967830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8f8159400 0x7fc8f8147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fd04a700 1 -- 172.21.15.6:0/3920967830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e80094f0 con 0x7fc8f80cd030 2023-10-06T02:28:18.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fd84b700 1 --2- 172.21.15.6:0/3920967830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8f8159400 0x7fc8f8147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:18.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fc849700 1 --2- 172.21.15.6:0/3920967830 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8f80cf1a0 0x7fc8f80c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:18.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.582+0000 7fc8fd04a700 1 --2- 172.21.15.6:0/3920967830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f80cd030 0x7fc8f80c95f0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7fc8f400d840 tx=0x7fc8f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:18.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.583+0000 7fc8ed7fa700 1 -- 172.21.15.6:0/3920967830 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4005a00 con 0x7fc8f80cd030 2023-10-06T02:28:18.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.583+0000 7fc8ed7fa700 1 -- 172.21.15.6:0/3920967830 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f4005b60 con 0x7fc8f80cd030 2023-10-06T02:28:18.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.583+0000 7fc8fe04c700 1 -- 172.21.15.6:0/3920967830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f80c9c40 con 0x7fc8f80cd030 2023-10-06T02:28:18.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.583+0000 7fc8ed7fa700 1 -- 172.21.15.6:0/3920967830 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f40125f0 con 0x7fc8f80cd030 2023-10-06T02:28:18.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.583+0000 7fc8fe04c700 1 -- 172.21.15.6:0/3920967830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f80ca200 con 0x7fc8f80cd030 2023-10-06T02:28:18.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.584+0000 7fc8fe04c700 1 -- 172.21.15.6:0/3920967830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f80cab30 con 0x7fc8f80cd030 2023-10-06T02:28:18.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.584+0000 7fc8ed7fa700 1 -- 172.21.15.6:0/3920967830 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8f40129e0 con 0x7fc8f80cd030 2023-10-06T02:28:18.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.584+0000 7fc8ed7fa700 1 --2- 172.21.15.6:0/3920967830 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc8dc066f30 0x7fc8dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.585+0000 7fc8ed7fa700 1 -- 172.21.15.6:0/3920967830 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7fc8f4085440 con 0x7fc8f80cd030 2023-10-06T02:28:18.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.585+0000 7fc8fc849700 1 --2- 172.21.15.6:0/3920967830 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc8dc066f30 0x7fc8dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.585+0000 7fc8fc849700 1 --2- 172.21.15.6:0/3920967830 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc8dc066f30 0x7fc8dc0693e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80d0f40 tx=0x7fc8e8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:18.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.589+0000 7fc8ed7fa700 1 -- 172.21.15.6:0/3920967830 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8f4051960 con 0x7fc8f80cd030 2023-10-06T02:28:18.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.829+0000 7fc8fe04c700 1 -- 172.21.15.6:0/3920967830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8f80b31f0 con 0x7fc8f80cd030 2023-10-06T02:28:18.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.829+0000 7fc8ed7fa700 1 -- 172.21.15.6:0/3920967830 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 288 v288) v1 ==== 95+0+4604 (secure 0 0 0) 0x7fc8f4054f80 con 0x7fc8f80cd030 2023-10-06T02:28:18.831 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:18.831 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":288,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":288,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:28:15.236294+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9963":{"gid":9963,"name":"a","rank":0,"incarnation":285,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/4058600046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":4058600046},{"type":"v1","addr":"172.21.15.6:6835","nonce":4058600046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:18.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.831+0000 7fc8fe04c700 1 -- 172.21.15.6:0/3920967830 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc8dc066f30 msgr2=0x7fc8dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.831+0000 7fc8fe04c700 1 --2- 172.21.15.6:0/3920967830 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc8dc066f30 0x7fc8dc0693e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80d0f40 tx=0x7fc8e8017000 comp rx=0 tx=0).stop 2023-10-06T02:28:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.831+0000 7fc8fe04c700 1 -- 172.21.15.6:0/3920967830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f80cd030 msgr2=0x7fc8f80c95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.831+0000 7fc8fe04c700 1 --2- 172.21.15.6:0/3920967830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f80cd030 0x7fc8f80c95f0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7fc8f400d840 tx=0x7fc8f4008040 comp rx=0 tx=0).stop 2023-10-06T02:28:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.832+0000 7fc8fe04c700 1 -- 172.21.15.6:0/3920967830 shutdown_connections 2023-10-06T02:28:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.832+0000 7fc8fe04c700 1 --2- 172.21.15.6:0/3920967830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8f8159400 0x7fc8f8147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.832+0000 7fc8fe04c700 1 --2- 172.21.15.6:0/3920967830 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc8dc066f30 0x7fc8dc0693e0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.832+0000 7fc8fe04c700 1 --2- 172.21.15.6:0/3920967830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f80cd030 0x7fc8f80c95f0 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.832+0000 7fc8fe04c700 1 --2- 172.21.15.6:0/3920967830 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8f80cf1a0 0x7fc8f80c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.832+0000 7fc8fe04c700 1 -- 172.21.15.6:0/3920967830 >> 172.21.15.6:0/3920967830 conn(0x7fc8f806ac10 msgr2=0x7fc8f80b5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.832+0000 7fc8fe04c700 1 -- 172.21.15.6:0/3920967830 shutdown_connections 2023-10-06T02:28:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.832+0000 7fc8fe04c700 1 -- 172.21.15.6:0/3920967830 wait complete. 2023-10-06T02:28:18.835 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 288 2023-10-06T02:28:18.845 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 288, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:28:15.236294+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 126, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9963}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9963': {'gid': 9963, 'name': 'a', 'rank': 0, 'incarnation': 285, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.6:6835/4058600046', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 4058600046}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 4058600046}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:28:18.845 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:28:18.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:28:18.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.964+0000 7fd9019ed700 1 Processor -- start 2023-10-06T02:28:18.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.964+0000 7fd9019ed700 1 -- start start 2023-10-06T02:28:18.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.965+0000 7fd9019ed700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd8fc0a8b90 0x7fd8fc0afa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.965+0000 7fd9019ed700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8fc0b1ef0 0x7fd8fc0b2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.965+0000 7fd9019ed700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8fc158270 con 0x7fd8fc0aff50 2023-10-06T02:28:18.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.965+0000 7fd9019ed700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8fc0b28d0 con 0x7fd8fc0b1ef0 2023-10-06T02:28:18.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.965+0000 7fd9019ed700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8fc0a8f60 con 0x7fd8fc0a8b90 2023-10-06T02:28:18.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.965+0000 7fd8fb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8fc0b1ef0 0x7fd8fc0b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.965+0000 7fd8fa7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd8fc0aff50 0x7fd8fc158700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50252/0 (socket says 172.21.15.6:50252) 2023-10-06T02:28:18.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.965+0000 7fd8fb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8fc0b1ef0 0x7fd8fc0b2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46814/0 (socket says 172.21.15.6:46814) 2023-10-06T02:28:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.965+0000 7fd8fa7fc700 1 -- 172.21.15.6:0/2285897806 learned_addr learned my addr 172.21.15.6:0/2285897806 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.965+0000 7fd8faffd700 1 --2- 172.21.15.6:0/2285897806 >> v2:172.21.15.175:3300/0 conn(0x7fd8fc0a8b90 0x7fd8fc0afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.965+0000 7fd8fb7fe700 1 -- 172.21.15.6:0/2285897806 >> v2:172.21.15.175:3300/0 conn(0x7fd8fc0a8b90 msgr2=0x7fd8fc0afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.965+0000 7fd8fb7fe700 1 --2- 172.21.15.6:0/2285897806 >> v2:172.21.15.175:3300/0 conn(0x7fd8fc0a8b90 0x7fd8fc0afa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.965+0000 7fd8fb7fe700 1 -- 172.21.15.6:0/2285897806 >> v1:172.21.15.6:6789/0 conn(0x7fd8fc0aff50 legacy=0x7fd8fc158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.965+0000 7fd8fb7fe700 1 -- 172.21.15.6:0/2285897806 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc0b0490 con 0x7fd8fc0b1ef0 2023-10-06T02:28:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.965+0000 7fd8f9ffb700 1 -- 172.21.15.6:0/2285897806 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433928792 0 0) 0x7fd8fc158270 con 0x7fd8fc0aff50 2023-10-06T02:28:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.965+0000 7fd8fb7fe700 1 --2- 172.21.15.6:0/2285897806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8fc0b1ef0 0x7fd8fc0b2390 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc06bb20 tx=0x7fd8f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c716c8b4b54dbe61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.966+0000 7fd8f9ffb700 1 -- 172.21.15.6:0/2285897806 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f400b6b0 con 0x7fd8fc0b1ef0 2023-10-06T02:28:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.966+0000 7fd8f9ffb700 1 -- 172.21.15.6:0/2285897806 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f400b810 con 0x7fd8fc0b1ef0 2023-10-06T02:28:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.966+0000 7fd8f9ffb700 1 -- 172.21.15.6:0/2285897806 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f400bbb0 con 0x7fd8fc0b1ef0 2023-10-06T02:28:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.966+0000 7fd9019ed700 1 -- 172.21.15.6:0/2285897806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8fc0b1ef0 msgr2=0x7fd8fc0b2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:18.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.966+0000 7fd9019ed700 1 --2- 172.21.15.6:0/2285897806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8fc0b1ef0 0x7fd8fc0b2390 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc06bb20 tx=0x7fd8f40091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.966+0000 7fd9019ed700 1 -- 172.21.15.6:0/2285897806 shutdown_connections 2023-10-06T02:28:18.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.966+0000 7fd9019ed700 1 --2- 172.21.15.6:0/2285897806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8fc0b1ef0 0x7fd8fc0b2390 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.966+0000 7fd9019ed700 1 --2- 172.21.15.6:0/2285897806 >> v2:172.21.15.175:3300/0 conn(0x7fd8fc0a8b90 0x7fd8fc0afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.966+0000 7fd9019ed700 1 -- 172.21.15.6:0/2285897806 >> 172.21.15.6:0/2285897806 conn(0x7fd8fc067910 msgr2=0x7fd8fc0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:18.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.966+0000 7fd9019ed700 1 -- 172.21.15.6:0/2285897806 shutdown_connections 2023-10-06T02:28:18.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.966+0000 7fd9019ed700 1 -- 172.21.15.6:0/2285897806 wait complete. 2023-10-06T02:28:18.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.967+0000 7fd9019ed700 1 Processor -- start 2023-10-06T02:28:18.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.967+0000 7fd9019ed700 1 -- start start 2023-10-06T02:28:18.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.968+0000 7fd9019ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8fc0a8b90 0x7fd8fc156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.968+0000 7fd9019ed700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8fc0aff50 0x7fd8fc158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.968+0000 7fd9019ed700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8fc0b1ef0 0x7fd8fc159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.968+0000 7fd9019ed700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0ab730 con 0x7fd8fc0a8b90 2023-10-06T02:28:18.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.968+0000 7fd9019ed700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0ab120 con 0x7fd8fc0b1ef0 2023-10-06T02:28:18.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.968+0000 7fd9019ed700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0aa910 con 0x7fd8fc0aff50 2023-10-06T02:28:18.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.968+0000 7fd8faffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8fc0a8b90 0x7fd8fc156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.968+0000 7fd8faffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8fc0a8b90 0x7fd8fc156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46830/0 (socket says 172.21.15.6:46830) 2023-10-06T02:28:18.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.968+0000 7fd8faffd700 1 -- 172.21.15.6:0/1350928387 learned_addr learned my addr 172.21.15.6:0/1350928387 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:18.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.969+0000 7fd8faffd700 1 -- 172.21.15.6:0/1350928387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8fc0aff50 msgr2=0x7fd8fc158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:18.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.969+0000 7fd8faffd700 1 --2- 172.21.15.6:0/1350928387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8fc0aff50 0x7fd8fc158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.969+0000 7fd8faffd700 1 -- 172.21.15.6:0/1350928387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8fc0b1ef0 msgr2=0x7fd8fc159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:18.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.969+0000 7fd8faffd700 1 --2- 172.21.15.6:0/1350928387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8fc0b1ef0 0x7fd8fc159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.969+0000 7fd8faffd700 1 -- 172.21.15.6:0/1350928387 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f4009420 con 0x7fd8fc0a8b90 2023-10-06T02:28:18.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.969+0000 7fd8faffd700 1 --2- 172.21.15.6:0/1350928387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8fc0a8b90 0x7fd8fc156760 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00a320 tx=0x7fd8ec007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:18.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.969+0000 7fd8e2ffd700 1 -- 172.21.15.6:0/1350928387 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec00e450 con 0x7fd8fc0a8b90 2023-10-06T02:28:18.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.969+0000 7fd8e2ffd700 1 -- 172.21.15.6:0/1350928387 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec00e5d0 con 0x7fd8fc0a8b90 2023-10-06T02:28:18.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.969+0000 7fd9019ed700 1 -- 172.21.15.6:0/1350928387 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8fc0ab3c0 con 0x7fd8fc0a8b90 2023-10-06T02:28:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.969+0000 7fd8e2ffd700 1 -- 172.21.15.6:0/1350928387 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec00e990 con 0x7fd8fc0a8b90 2023-10-06T02:28:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.969+0000 7fd9019ed700 1 -- 172.21.15.6:0/1350928387 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8fc0aabf0 con 0x7fd8fc0a8b90 2023-10-06T02:28:18.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.971+0000 7fd8e2ffd700 1 -- 172.21.15.6:0/1350928387 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8ec003020 con 0x7fd8fc0a8b90 2023-10-06T02:28:18.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.971+0000 7fd8e2ffd700 1 --2- 172.21.15.6:0/1350928387 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8e8066f30 0x7fd8e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.971+0000 7fd8e2ffd700 1 -- 172.21.15.6:0/1350928387 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7fd8ec012070 con 0x7fd8fc0a8b90 2023-10-06T02:28:18.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.971+0000 7fd8fa7fc700 1 --2- 172.21.15.6:0/1350928387 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8e8066f30 0x7fd8e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.972+0000 7fd8fa7fc700 1 --2- 172.21.15.6:0/1350928387 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8e8066f30 0x7fd8e80693e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00011e0 tx=0x7fd8f00079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:18.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.973+0000 7fd90ace5b80 1 Processor -- start 2023-10-06T02:28:18.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.973+0000 7fd90ace5b80 1 -- start start 2023-10-06T02:28:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd90ace5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fa840 0x55c9e43fac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd90ace5b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e43fbcc0 0x55c9e444a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd90ace5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e444ac00 0x55c9e444b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd90ace5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e4351a70 con 0x55c9e444ac00 2023-10-06T02:28:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd90ace5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e434f270 con 0x55c9e43fa840 2023-10-06T02:28:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd90ace5b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9e434b060 con 0x55c9e43fbcc0 2023-10-06T02:28:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd8fb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e444ac00 0x55c9e444b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd8fb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e444ac00 0x55c9e444b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46832/0 (socket says 172.21.15.6:46832) 2023-10-06T02:28:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd8faffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fa840 0x55c9e43fac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd8fb7fe700 1 -- 172.21.15.6:0/1310631312 learned_addr learned my addr 172.21.15.6:0/1310631312 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:18.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd8fa7fc700 1 --2- 172.21.15.6:0/1310631312 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e43fbcc0 0x55c9e444a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd8fb7fe700 1 -- 172.21.15.6:0/1310631312 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e43fbcc0 msgr2=0x55c9e444a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:18.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd8fb7fe700 1 --2- 172.21.15.6:0/1310631312 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e43fbcc0 0x55c9e444a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd8fb7fe700 1 -- 172.21.15.6:0/1310631312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fa840 msgr2=0x55c9e43fac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:18.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd8fb7fe700 1 --2- 172.21.15.6:0/1310631312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fa840 0x55c9e43fac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd8fb7fe700 1 -- 172.21.15.6:0/1310631312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9e41e5270 con 0x55c9e444ac00 2023-10-06T02:28:18.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd8fb7fe700 1 --2- 172.21.15.6:0/1310631312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e444ac00 0x55c9e444b050 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400b0e0 tx=0x7fd8f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc0bab0e5425e89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:18.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.974+0000 7fd8dbfff700 1 -- 172.21.15.6:0/1310631312 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f400b980 con 0x55c9e444ac00 2023-10-06T02:28:18.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.975+0000 7fd8dbfff700 1 -- 172.21.15.6:0/1310631312 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f400bae0 con 0x55c9e444ac00 2023-10-06T02:28:18.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.975+0000 7fd8dbfff700 1 -- 172.21.15.6:0/1310631312 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f40246d0 con 0x55c9e444ac00 2023-10-06T02:28:18.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.975+0000 7fd90ace5b80 1 -- 172.21.15.6:0/1310631312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e444ac00 msgr2=0x55c9e444b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.975+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/1310631312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e444ac00 0x55c9e444b050 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400b0e0 tx=0x7fd8f4017000 comp rx=0 tx=0).stop 2023-10-06T02:28:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.975+0000 7fd90ace5b80 1 -- 172.21.15.6:0/1310631312 shutdown_connections 2023-10-06T02:28:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.975+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/1310631312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e444ac00 0x55c9e444b050 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.975+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/1310631312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fa840 0x55c9e43fac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.975+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/1310631312 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e43fbcc0 0x55c9e444a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.975+0000 7fd90ace5b80 1 -- 172.21.15.6:0/1310631312 >> 172.21.15.6:0/1310631312 conn(0x55c9e43fc160 msgr2=0x55c9e43fc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.975+0000 7fd90ace5b80 1 -- 172.21.15.6:0/1310631312 shutdown_connections 2023-10-06T02:28:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.975+0000 7fd90ace5b80 1 -- 172.21.15.6:0/1310631312 wait complete. 2023-10-06T02:28:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.976+0000 7fd90ace5b80 1 -- start start 2023-10-06T02:28:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.976+0000 7fd90ace5b80 1 Processor -- start 2023-10-06T02:28:18.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd90ace5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fa840 0x55c9e4423ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd90ace5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fbcc0 0x55c9e44481e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd90ace5b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e444ac00 0x55c9e4441880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd90ace5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e42f6890 con 0x55c9e43fbcc0 2023-10-06T02:28:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd90ace5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e4311ea0 con 0x55c9e43fa840 2023-10-06T02:28:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd90ace5b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9e41cde30 con 0x55c9e444ac00 2023-10-06T02:28:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd90ace5b80 10 client.0 _ll_register_callbacks cb 0x55c9e43bde70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:28:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd8fa7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fbcc0 0x55c9e44481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd8fa7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fbcc0 0x55c9e44481e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46836/0 (socket says 172.21.15.6:46836) 2023-10-06T02:28:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd8fa7fc700 1 -- 172.21.15.6:0/2205581243 learned_addr learned my addr 172.21.15.6:0/2205581243 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd8faffd700 1 --2- 172.21.15.6:0/2205581243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fa840 0x55c9e4423ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd8fb7fe700 1 --2- 172.21.15.6:0/2205581243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e444ac00 0x55c9e4441880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd8fa7fc700 1 -- 172.21.15.6:0/2205581243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e444ac00 msgr2=0x55c9e4441880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd8fa7fc700 1 --2- 172.21.15.6:0/2205581243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e444ac00 0x55c9e4441880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd8fa7fc700 1 -- 172.21.15.6:0/2205581243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fa840 msgr2=0x55c9e4423ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd8fa7fc700 1 --2- 172.21.15.6:0/2205581243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fa840 0x55c9e4423ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd8fa7fc700 1 -- 172.21.15.6:0/2205581243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8fc0b0490 con 0x55c9e43fbcc0 2023-10-06T02:28:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd8fb7fe700 1 --2- 172.21.15.6:0/2205581243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e444ac00 0x55c9e4441880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd8fa7fc700 1 --2- 172.21.15.6:0/2205581243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fbcc0 0x55c9e44481e0 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc09bc80 tx=0x7fd8f0017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec840910eed216a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd8d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:28:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd8d97fa700 1 -- 172.21.15.6:0/2205581243 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f001a070 con 0x55c9e43fbcc0 2023-10-06T02:28:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd8d97fa700 1 -- 172.21.15.6:0/2205581243 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7fd8f0015c30 con 0x55c9e43fbcc0 2023-10-06T02:28:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.977+0000 7fd90ace5b80 1 -- 172.21.15.6:0/2205581243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c9e43ef940 con 0x55c9e43fbcc0 2023-10-06T02:28:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.978+0000 7fd8d97fa700 1 -- 172.21.15.6:0/2205581243 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=288) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8f0007870 con 0x55c9e43fbcc0 2023-10-06T02:28:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.978+0000 7fd90ace5b80 10 client.10053 fetch_fsmap learned FSMap version 288 2023-10-06T02:28:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.978+0000 7fd90ace5b80 1 -- 172.21.15.6:0/2205581243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=288,monmap=2+}) v3 -- 0x55c9e4187fe0 con 0x55c9e43fbcc0 2023-10-06T02:28:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.978+0000 7fd8d97fa700 1 -- 172.21.15.6:0/2205581243 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c9e43ef940 con 0x55c9e43fbcc0 2023-10-06T02:28:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.978+0000 7fd8d97fa700 1 -- 172.21.15.6:0/2205581243 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 288) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd8f0020460 con 0x55c9e43fbcc0 2023-10-06T02:28:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.978+0000 7fd90ace5b80 10 client.10053 fetch_fsmap finished waiting for FSMap version 288 2023-10-06T02:28:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.978+0000 7fd90ace5b80 10 client.10053 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:28:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.978+0000 7fd90ace5b80 20 client.10053 populate_metadata read hostname 'smithi006' 2023-10-06T02:28:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.978+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/2205581243 >> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] conn(0x55c9e44412e0 0x55c9e443a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.978+0000 7fd90ace5b80 4 client.10053 mds_command: new command op to 9963 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:28:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.978+0000 7fd90ace5b80 1 -- 172.21.15.6:0/2205581243 --> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c9e43cc870 con 0x55c9e44412e0 2023-10-06T02:28:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.978+0000 7fd8faffd700 1 --2- 172.21.15.6:0/2205581243 >> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] conn(0x55c9e44412e0 0x55c9e443a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.978+0000 7fd8d97fa700 10 client.10053 ms_handle_connect on v2:172.21.15.6:6833/4058600046 2023-10-06T02:28:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.978+0000 7fd8faffd700 1 --2- 172.21.15.6:0/2205581243 >> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] conn(0x55c9e44412e0 0x55c9e443a3c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=300330dd82ee2d13 server_cookie=25c7bc5da120f594 in_seq=0 out_seq=0 2023-10-06T02:28:18.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.979+0000 7fd8d97fa700 1 -- 172.21.15.6:0/2205581243 <== mds.0 v2:172.21.15.6:6833/4058600046 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c9e43cc870 con 0x55c9e44412e0 2023-10-06T02:28:18.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.979+0000 7fd8d97fa700 10 client.10053 handle_command_reply: tid=0 2023-10-06T02:28:18.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.979+0000 7fd90ace5b80 1 client.10053 shutdown 2023-10-06T02:28:18.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.979+0000 7fd90ace5b80 1 -- 172.21.15.6:0/2205581243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fbcc0 msgr2=0x55c9e44481e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:18.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.979+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/2205581243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fbcc0 0x55c9e44481e0 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc09bc80 tx=0x7fd8f0017040 comp rx=0 tx=0).stop 2023-10-06T02:28:18.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.979+0000 7fd90ace5b80 1 -- 172.21.15.6:0/2205581243 shutdown_connections 2023-10-06T02:28:18.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.979+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/2205581243 >> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] conn(0x55c9e44412e0 0x55c9e443a3c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.979+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/2205581243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e444ac00 0x55c9e4441880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.979+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/2205581243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fa840 0x55c9e4423ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.979+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/2205581243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fbcc0 0x55c9e44481e0 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:18.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.979+0000 7fd8d97fa700 0 client.10053 ms_handle_reset on v2:172.21.15.6:6833/4058600046 2023-10-06T02:28:18.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.979+0000 7fd90ace5b80 1 -- 172.21.15.6:0/2205581243 >> 172.21.15.6:0/2205581243 conn(0x55c9e43fc160 msgr2=0x55c9e43fb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:18.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.979+0000 7fd90ace5b80 1 -- 172.21.15.6:0/2205581243 shutdown_connections 2023-10-06T02:28:18.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.979+0000 7fd90ace5b80 1 -- 172.21.15.6:0/2205581243 wait complete. 2023-10-06T02:28:18.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.980+0000 7fd90ace5b80 20 client.10053 trim_cache size 0 max 16384 2023-10-06T02:28:19.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.996+0000 7fd90ace5b80 1 Processor -- start 2023-10-06T02:28:19.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.997+0000 7fd90ace5b80 1 -- start start 2023-10-06T02:28:19.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.997+0000 7fd90ace5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fa840 0x55c9e4449c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.997+0000 7fd90ace5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fbcc0 0x55c9e443a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.997+0000 7fd90ace5b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e444ac00 0x55c9e44a1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.997+0000 7fd90ace5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e4438e50 con 0x55c9e43fa840 2023-10-06T02:28:19.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.997+0000 7fd90ace5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e43f8160 con 0x55c9e43fbcc0 2023-10-06T02:28:19.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.997+0000 7fd90ace5b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9e43fd140 con 0x55c9e444ac00 2023-10-06T02:28:19.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.997+0000 7fd8faffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fa840 0x55c9e4449c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:19.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.997+0000 7fd8faffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fa840 0x55c9e4449c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46842/0 (socket says 172.21.15.6:46842) 2023-10-06T02:28:19.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.997+0000 7fd8faffd700 1 -- 172.21.15.6:0/929169638 learned_addr learned my addr 172.21.15.6:0/929169638 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:19.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.997+0000 7fd8faffd700 1 -- 172.21.15.6:0/929169638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e444ac00 msgr2=0x55c9e44a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:19.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd8faffd700 1 --2- 172.21.15.6:0/929169638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e444ac00 0x55c9e44a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd8faffd700 1 -- 172.21.15.6:0/929169638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fbcc0 msgr2=0x55c9e443a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:19.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd8fa7fc700 1 --2- 172.21.15.6:0/929169638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fbcc0 0x55c9e443a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:19.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd8faffd700 1 --2- 172.21.15.6:0/929169638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fbcc0 0x55c9e443a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd8faffd700 1 -- 172.21.15.6:0/929169638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9e4319780 con 0x55c9e43fa840 2023-10-06T02:28:19.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd8fa7fc700 1 --2- 172.21.15.6:0/929169638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fbcc0 0x55c9e443a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:19.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd8faffd700 1 --2- 172.21.15.6:0/929169638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fa840 0x55c9e4449c90 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec083c90 tx=0x7fd8ec022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a3aa07eb54fd07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:19.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd8e0ff9700 1 -- 172.21.15.6:0/929169638 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec054750 con 0x55c9e43fa840 2023-10-06T02:28:19.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd8e0ff9700 1 -- 172.21.15.6:0/929169638 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec083ce0 con 0x55c9e43fa840 2023-10-06T02:28:19.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd8e0ff9700 1 -- 172.21.15.6:0/929169638 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec052d20 con 0x55c9e43fa840 2023-10-06T02:28:19.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd90ace5b80 1 -- 172.21.15.6:0/929169638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fa840 msgr2=0x55c9e4449c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:19.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/929169638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fa840 0x55c9e4449c90 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec083c90 tx=0x7fd8ec022040 comp rx=0 tx=0).stop 2023-10-06T02:28:19.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd90ace5b80 1 -- 172.21.15.6:0/929169638 shutdown_connections 2023-10-06T02:28:19.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/929169638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e444ac00 0x55c9e44a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/929169638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fa840 0x55c9e4449c90 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/929169638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fbcc0 0x55c9e443a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd90ace5b80 1 -- 172.21.15.6:0/929169638 >> 172.21.15.6:0/929169638 conn(0x55c9e43fc160 msgr2=0x55c9e43f3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd90ace5b80 1 -- 172.21.15.6:0/929169638 shutdown_connections 2023-10-06T02:28:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.998+0000 7fd90ace5b80 1 -- 172.21.15.6:0/929169638 wait complete. 2023-10-06T02:28:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.999+0000 7fd90ace5b80 1 -- start start 2023-10-06T02:28:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:18.999+0000 7fd90ace5b80 1 Processor -- start 2023-10-06T02:28:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.000+0000 7fd90ace5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fa840 0x55c9e4437350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.000+0000 7fd90ace5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fbcc0 0x55c9e4437890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.000+0000 7fd90ace5b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e444ac00 0x55c9e44a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.000+0000 7fd90ace5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e44a80a0 con 0x55c9e43fbcc0 2023-10-06T02:28:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.000+0000 7fd90ace5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e444a490 con 0x55c9e43fa840 2023-10-06T02:28:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.000+0000 7fd90ace5b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9e43fb350 con 0x55c9e444ac00 2023-10-06T02:28:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.000+0000 7fd90ace5b80 10 client.0 _ll_register_callbacks cb 0x55c9e43bde70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:28:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.000+0000 7fd8fa7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fbcc0 0x55c9e4437890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.000+0000 7fd8fa7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fbcc0 0x55c9e4437890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46846/0 (socket says 172.21.15.6:46846) 2023-10-06T02:28:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.000+0000 7fd8fa7fc700 1 -- 172.21.15.6:0/4164458426 learned_addr learned my addr 172.21.15.6:0/4164458426 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.000+0000 7fd8fa7fc700 1 -- 172.21.15.6:0/4164458426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e444ac00 msgr2=0x55c9e44a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.000+0000 7fd8fa7fc700 1 --2- 172.21.15.6:0/4164458426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e444ac00 0x55c9e44a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.000+0000 7fd8fa7fc700 1 -- 172.21.15.6:0/4164458426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fa840 msgr2=0x55c9e4437350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.000+0000 7fd8faffd700 1 --2- 172.21.15.6:0/4164458426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fa840 0x55c9e4437350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.000+0000 7fd8fa7fc700 1 --2- 172.21.15.6:0/4164458426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fa840 0x55c9e4437350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.000+0000 7fd8fa7fc700 1 -- 172.21.15.6:0/4164458426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8fc0aabf0 con 0x55c9e43fbcc0 2023-10-06T02:28:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.001+0000 7fd8fa7fc700 1 --2- 172.21.15.6:0/4164458426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fbcc0 0x55c9e4437890 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x55c9e43f9380 tx=0x7fd8f0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d734cefd3b32fb04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.001+0000 7fd8d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:28:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.001+0000 7fd8d97fa700 1 -- 172.21.15.6:0/4164458426 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00152e0 con 0x55c9e43fbcc0 2023-10-06T02:28:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.001+0000 7fd8d97fa700 1 -- 172.21.15.6:0/4164458426 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7fd8f0020460 con 0x55c9e43fbcc0 2023-10-06T02:28:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.001+0000 7fd90ace5b80 1 -- 172.21.15.6:0/4164458426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd8f400bae0 con 0x55c9e43fbcc0 2023-10-06T02:28:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.001+0000 7fd8d97fa700 1 -- 172.21.15.6:0/4164458426 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=288) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8f0020bb0 con 0x55c9e43fbcc0 2023-10-06T02:28:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.001+0000 7fd90ace5b80 10 client.10059 fetch_fsmap learned FSMap version 288 2023-10-06T02:28:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.001+0000 7fd90ace5b80 1 -- 172.21.15.6:0/4164458426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=288,monmap=2+}) v3 -- 0x55c9e4300470 con 0x55c9e43fbcc0 2023-10-06T02:28:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.001+0000 7fd8d97fa700 1 -- 172.21.15.6:0/4164458426 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f400bae0 con 0x55c9e43fbcc0 2023-10-06T02:28:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.001+0000 7fd8d97fa700 1 -- 172.21.15.6:0/4164458426 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 288) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd8f0028070 con 0x55c9e43fbcc0 2023-10-06T02:28:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.001+0000 7fd90ace5b80 10 client.10059 fetch_fsmap finished waiting for FSMap version 288 2023-10-06T02:28:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.001+0000 7fd90ace5b80 10 client.10059 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:28:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.001+0000 7fd90ace5b80 20 client.10059 populate_metadata read hostname 'smithi006' 2023-10-06T02:28:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.001+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/4164458426 >> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] conn(0x55c9e44a7270 0x55c9e4424770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.001+0000 7fd90ace5b80 4 client.10059 mds_command: new command op to 9963 tid=0[{"prefix": "status"}] 2023-10-06T02:28:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.001+0000 7fd90ace5b80 1 -- 172.21.15.6:0/4164458426 --> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c9e42ede00 con 0x55c9e44a7270 2023-10-06T02:28:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.001+0000 7fd8faffd700 1 --2- 172.21.15.6:0/4164458426 >> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] conn(0x55c9e44a7270 0x55c9e4424770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.002+0000 7fd8d97fa700 10 client.10059 ms_handle_connect on v2:172.21.15.6:6833/4058600046 2023-10-06T02:28:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.002+0000 7fd8faffd700 1 --2- 172.21.15.6:0/4164458426 >> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] conn(0x55c9e44a7270 0x55c9e4424770 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44e86c6adaab2390 server_cookie=91a2db826f699c27 in_seq=0 out_seq=0 2023-10-06T02:28:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.002+0000 7fd8d97fa700 1 -- 172.21.15.6:0/4164458426 <== mds.0 v2:172.21.15.6:6833/4058600046 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x55c9e42ede00 con 0x55c9e44a7270 2023-10-06T02:28:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.002+0000 7fd8d97fa700 10 client.10059 handle_command_reply: tid=0 2023-10-06T02:28:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.002+0000 7fd90ace5b80 1 client.10059 shutdown 2023-10-06T02:28:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.002+0000 7fd90ace5b80 1 -- 172.21.15.6:0/4164458426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fbcc0 msgr2=0x55c9e4437890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.002+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/4164458426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fbcc0 0x55c9e4437890 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x55c9e43f9380 tx=0x7fd8f0015000 comp rx=0 tx=0).stop 2023-10-06T02:28:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.002+0000 7fd90ace5b80 1 -- 172.21.15.6:0/4164458426 shutdown_connections 2023-10-06T02:28:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.002+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/4164458426 >> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] conn(0x55c9e44a7270 0x55c9e4424770 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.002+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/4164458426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55c9e444ac00 0x55c9e44a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.002+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/4164458426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9e43fa840 0x55c9e4437350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.002+0000 7fd8d97fa700 0 client.10059 ms_handle_reset on v2:172.21.15.6:6833/4058600046 2023-10-06T02:28:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.002+0000 7fd90ace5b80 1 --2- 172.21.15.6:0/4164458426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c9e43fbcc0 0x55c9e4437890 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.002+0000 7fd90ace5b80 1 -- 172.21.15.6:0/4164458426 >> 172.21.15.6:0/4164458426 conn(0x55c9e43fc160 msgr2=0x55c9e43f7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.002+0000 7fd90ace5b80 1 -- 172.21.15.6:0/4164458426 shutdown_connections 2023-10-06T02:28:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.002+0000 7fd90ace5b80 1 -- 172.21.15.6:0/4164458426 wait complete. 2023-10-06T02:28:19.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.002+0000 7fd90ace5b80 20 client.10059 trim_cache size 0 max 16384 2023-10-06T02:28:19.016 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:28:19.016 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:28:19.016 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:28:19.016 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 9963, 2023-10-06T02:28:19.017 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:28:19.017 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:28:19.017 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:28:19.017 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 6.779072384, 2023-10-06T02:28:19.017 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 288, 2023-10-06T02:28:19.017 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 126, 2023-10-06T02:28:19.017 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 126, 2023-10-06T02:28:19.023 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 10.784702612 2023-10-06T02:28:19.023 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:28:19.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.003+0000 7fd9019ed700 1 -- 172.21.15.6:0/1350928387 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8e8066f30 msgr2=0x7fd8e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:19.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.003+0000 7fd9019ed700 1 --2- 172.21.15.6:0/1350928387 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8e8066f30 0x7fd8e80693e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00011e0 tx=0x7fd8f00079d0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.003+0000 7fd9019ed700 1 -- 172.21.15.6:0/1350928387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8fc0a8b90 msgr2=0x7fd8fc156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:19.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.003+0000 7fd9019ed700 1 --2- 172.21.15.6:0/1350928387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8fc0a8b90 0x7fd8fc156760 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00a320 tx=0x7fd8ec007900 comp rx=0 tx=0).stop 2023-10-06T02:28:19.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.003+0000 7fd9019ed700 1 -- 172.21.15.6:0/1350928387 shutdown_connections 2023-10-06T02:28:19.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.003+0000 7fd9019ed700 1 --2- 172.21.15.6:0/1350928387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8fc0b1ef0 0x7fd8fc159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.003+0000 7fd9019ed700 1 --2- 172.21.15.6:0/1350928387 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd8e8066f30 0x7fd8e80693e0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.003+0000 7fd9019ed700 1 --2- 172.21.15.6:0/1350928387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8fc0a8b90 0x7fd8fc156760 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.003+0000 7fd9019ed700 1 --2- 172.21.15.6:0/1350928387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8fc0aff50 0x7fd8fc158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.003+0000 7fd9019ed700 1 -- 172.21.15.6:0/1350928387 >> 172.21.15.6:0/1350928387 conn(0x7fd8fc067910 msgr2=0x7fd8fc06d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:19.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.003+0000 7fd9019ed700 1 -- 172.21.15.6:0/1350928387 shutdown_connections 2023-10-06T02:28:19.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.003+0000 7fd9019ed700 1 -- 172.21.15.6:0/1350928387 wait complete. 2023-10-06T02:28:19.026 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:28:19.026 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Corrupt omap key 10000000000.00000000:sixmegs_head', proceeding to ls 2023-10-06T02:28:19.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:28:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.143+0000 7f3b09d3b700 1 Processor -- start 2023-10-06T02:28:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.143+0000 7f3b09d3b700 1 -- start start 2023-10-06T02:28:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.144+0000 7f3b09d3b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3b040af4e0 0x7f3b040b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.144+0000 7f3b09d3b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3b040af8b0 0x7f3b040b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.144+0000 7f3b09d3b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0415e190 con 0x7f3b0415d460 2023-10-06T02:28:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.144+0000 7f3b09d3b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b040b1910 con 0x7f3b040af8b0 2023-10-06T02:28:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.144+0000 7f3b09d3b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0415dfa0 con 0x7f3b040af4e0 2023-10-06T02:28:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.144+0000 7f3b02ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3b040af8b0 0x7f3b040b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.144+0000 7f3b03fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3b0415d460 0x7f3b0415d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50266/0 (socket says 172.21.15.6:50266) 2023-10-06T02:28:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.144+0000 7f3b03fff700 1 -- 172.21.15.6:0/4152555216 learned_addr learned my addr 172.21.15.6:0/4152555216 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.145+0000 7f3b037fe700 1 --2- 172.21.15.6:0/4152555216 >> v2:172.21.15.175:3300/0 conn(0x7f3b040af4e0 0x7f3b040b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.145+0000 7f3b02ffd700 1 -- 172.21.15.6:0/4152555216 >> v2:172.21.15.175:3300/0 conn(0x7f3b040af4e0 msgr2=0x7f3b040b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.145+0000 7f3b02ffd700 1 --2- 172.21.15.6:0/4152555216 >> v2:172.21.15.175:3300/0 conn(0x7f3b040af4e0 0x7f3b040b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.145+0000 7f3b02ffd700 1 -- 172.21.15.6:0/4152555216 >> v1:172.21.15.6:6789/0 conn(0x7f3b0415d460 legacy=0x7f3b0415d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.145+0000 7f3b02ffd700 1 -- 172.21.15.6:0/4152555216 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b040cb650 con 0x7f3b040af8b0 2023-10-06T02:28:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.145+0000 7f3b037fe700 1 --2- 172.21.15.6:0/4152555216 >> v2:172.21.15.175:3300/0 conn(0x7f3b040af4e0 0x7f3b040b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.145+0000 7f3b02ffd700 1 --2- 172.21.15.6:0/4152555216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b040af8b0 0x7f3b040b2620 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f3b040d1360 tx=0x7f3af80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55b0e5a84ad3ce0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.145+0000 7f3b027fc700 1 -- 172.21.15.6:0/4152555216 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8011630 con 0x7f3b040af8b0 2023-10-06T02:28:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.145+0000 7f3b027fc700 1 -- 172.21.15.6:0/4152555216 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af8011790 con 0x7f3b040af8b0 2023-10-06T02:28:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.145+0000 7f3b027fc700 1 -- 172.21.15.6:0/4152555216 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8011b30 con 0x7f3b040af8b0 2023-10-06T02:28:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.146+0000 7f3b09d3b700 1 -- 172.21.15.6:0/4152555216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b040af8b0 msgr2=0x7f3b040b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.146+0000 7f3b09d3b700 1 --2- 172.21.15.6:0/4152555216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b040af8b0 0x7f3b040b2620 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f3b040d1360 tx=0x7f3af80091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.146+0000 7f3b09d3b700 1 -- 172.21.15.6:0/4152555216 shutdown_connections 2023-10-06T02:28:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.146+0000 7f3b09d3b700 1 --2- 172.21.15.6:0/4152555216 >> v2:172.21.15.175:3300/0 conn(0x7f3b040af4e0 0x7f3b040b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.146+0000 7f3b09d3b700 1 --2- 172.21.15.6:0/4152555216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b040af8b0 0x7f3b040b2620 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.146+0000 7f3b09d3b700 1 -- 172.21.15.6:0/4152555216 >> 172.21.15.6:0/4152555216 conn(0x7f3b04068680 msgr2=0x7f3b04068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.146+0000 7f3b09d3b700 1 -- 172.21.15.6:0/4152555216 shutdown_connections 2023-10-06T02:28:19.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.146+0000 7f3b09d3b700 1 -- 172.21.15.6:0/4152555216 wait complete. 2023-10-06T02:28:19.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.147+0000 7f3b09d3b700 1 Processor -- start 2023-10-06T02:28:19.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.147+0000 7f3b09d3b700 1 -- start start 2023-10-06T02:28:19.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3b09d3b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b040af4e0 0x7f3b04159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3b09d3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b040af8b0 0x7f3b040cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3b09d3b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b0415d460 0x7f3b040ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3b09d3b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040d0490 con 0x7f3b040af8b0 2023-10-06T02:28:19.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3b09d3b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040a6d20 con 0x7f3b0415d460 2023-10-06T02:28:19.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3b09d3b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040a72a0 con 0x7f3b040af4e0 2023-10-06T02:28:19.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3b02ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b040af8b0 0x7f3b040cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:19.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3b02ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b040af8b0 0x7f3b040cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46856/0 (socket says 172.21.15.6:46856) 2023-10-06T02:28:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3b02ffd700 1 -- 172.21.15.6:0/1875833886 learned_addr learned my addr 172.21.15.6:0/1875833886 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3b03fff700 1 --2- 172.21.15.6:0/1875833886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b0415d460 0x7f3b040ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3b037fe700 1 --2- 172.21.15.6:0/1875833886 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b040af4e0 0x7f3b04159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3b02ffd700 1 -- 172.21.15.6:0/1875833886 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b040af4e0 msgr2=0x7f3b04159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3b02ffd700 1 --2- 172.21.15.6:0/1875833886 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b040af4e0 0x7f3b04159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3b02ffd700 1 -- 172.21.15.6:0/1875833886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b0415d460 msgr2=0x7f3b040ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3b02ffd700 1 --2- 172.21.15.6:0/1875833886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b0415d460 0x7f3b040ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3b02ffd700 1 -- 172.21.15.6:0/1875833886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af8009420 con 0x7f3b040af8b0 2023-10-06T02:28:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3b02ffd700 1 --2- 172.21.15.6:0/1875833886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b040af8b0 0x7f3b040cde20 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f3af8002000 tx=0x7f3af8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.148+0000 7f3aeb7fe700 1 -- 172.21.15.6:0/1875833886 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af801cd60 con 0x7f3b040af8b0 2023-10-06T02:28:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.149+0000 7f3aeb7fe700 1 -- 172.21.15.6:0/1875833886 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af801a450 con 0x7f3b040af8b0 2023-10-06T02:28:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.149+0000 7f3b09d3b700 1 -- 172.21.15.6:0/1875833886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b040d06a0 con 0x7f3b040af8b0 2023-10-06T02:28:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.149+0000 7f3aeb7fe700 1 -- 172.21.15.6:0/1875833886 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af801a7d0 con 0x7f3b040af8b0 2023-10-06T02:28:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.149+0000 7f3b09d3b700 1 -- 172.21.15.6:0/1875833886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b040a6f30 con 0x7f3b040af8b0 2023-10-06T02:28:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.150+0000 7f3b09d3b700 1 -- 172.21.15.6:0/1875833886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b04088aa0 con 0x7f3b040af8b0 2023-10-06T02:28:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.150+0000 7f3aeb7fe700 1 -- 172.21.15.6:0/1875833886 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3af801ac00 con 0x7f3b040af8b0 2023-10-06T02:28:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.150+0000 7f3aeb7fe700 1 --2- 172.21.15.6:0/1875833886 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3af0066f30 0x7f3af00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.150+0000 7f3aeb7fe700 1 -- 172.21.15.6:0/1875833886 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7f3af8086d90 con 0x7f3b040af8b0 2023-10-06T02:28:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.150+0000 7f3b037fe700 1 --2- 172.21.15.6:0/1875833886 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3af0066f30 0x7f3af00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.151+0000 7f3b037fe700 1 --2- 172.21.15.6:0/1875833886 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3af0066f30 0x7f3af00693e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f3af4006f00 tx=0x7f3af4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.155+0000 7f3aeb7fe700 1 -- 172.21.15.6:0/1875833886 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3af8053360 con 0x7f3b040af8b0 2023-10-06T02:28:19.203 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:28:19.201+0000 7f79cef63700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:28:19.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.393+0000 7f3b09d3b700 1 -- 172.21.15.6:0/1875833886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3b040a73e0 con 0x7f3b040af8b0 2023-10-06T02:28:19.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.394+0000 7f3aeb7fe700 1 -- 172.21.15.6:0/1875833886 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v288) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3af8056980 con 0x7f3b040af8b0 2023-10-06T02:28:19.396 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:28:19.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.396+0000 7f3b09d3b700 1 -- 172.21.15.6:0/1875833886 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3af0066f30 msgr2=0x7f3af00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.396+0000 7f3b09d3b700 1 --2- 172.21.15.6:0/1875833886 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3af0066f30 0x7f3af00693e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f3af4006f00 tx=0x7f3af4008040 comp rx=0 tx=0).stop 2023-10-06T02:28:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.396+0000 7f3b09d3b700 1 -- 172.21.15.6:0/1875833886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b040af8b0 msgr2=0x7f3b040cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.396+0000 7f3b09d3b700 1 --2- 172.21.15.6:0/1875833886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b040af8b0 0x7f3b040cde20 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f3af8002000 tx=0x7f3af8016000 comp rx=0 tx=0).stop 2023-10-06T02:28:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.396+0000 7f3b09d3b700 1 -- 172.21.15.6:0/1875833886 shutdown_connections 2023-10-06T02:28:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.396+0000 7f3b09d3b700 1 --2- 172.21.15.6:0/1875833886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b0415d460 0x7f3b040ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.396+0000 7f3b09d3b700 1 --2- 172.21.15.6:0/1875833886 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b040af4e0 0x7f3b04159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.396+0000 7f3b09d3b700 1 --2- 172.21.15.6:0/1875833886 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3af0066f30 0x7f3af00693e0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.396+0000 7f3b09d3b700 1 --2- 172.21.15.6:0/1875833886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b040af8b0 0x7f3b040cde20 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.396+0000 7f3b09d3b700 1 -- 172.21.15.6:0/1875833886 >> 172.21.15.6:0/1875833886 conn(0x7f3b04068680 msgr2=0x7f3b0415b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.396+0000 7f3b09d3b700 1 -- 172.21.15.6:0/1875833886 shutdown_connections 2023-10-06T02:28:19.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:19.396+0000 7f3b09d3b700 1 -- 172.21.15.6:0/1875833886 wait complete. 2023-10-06T02:28:19.410 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:28:19.410 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:28:19.411 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:28:19.411 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:28:19.411 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:19.411 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:28:19.411 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:28:19.411 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:28:19.411 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:28:19.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:19.411 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:28:19.427 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:28:19.427 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:28:19.430 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:28:19.430 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:19.430 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:28:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:19.431 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:28:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:28:19.431 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:28:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:28:19.431 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:28:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:28:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:28:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41847sec preferred_lft 41847sec 2023-10-06T02:28:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:28:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:19.432 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:28:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:28:19.432 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:28:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:28:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:28:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:19.433 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:28:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:28:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:28:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:19.433 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:28:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:28:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:28:19.434 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:19.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:19.434 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:28:19.491 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:28:19.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:19.650 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:28:19.705 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:28:19.705 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:28:19.706 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:28:19.706 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:28:19.706 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:28:19.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:19.706 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:28:19.706 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:28:19.706 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:28:19.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:28:19.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:28:19.707 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:28:19.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:19.809 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:28:19.823 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:28:19.823 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:28:19.823 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:28:19.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:19.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:28:19.888 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:28:19.888 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:28:19.889 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:19.943 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:28:19.944 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:28:19.944 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:19.998 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:28:20.064 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:28:20.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:28:20.129 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:28:20.130 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:28:20.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:20.131 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:28:20.186 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:28:20.186 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:28:20.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:28:20.256 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:28:20.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:28:20.312 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:28:20.310+0000 7fcb5530e540 -1 init, newargv = 0x55c4179a1dd0 newargc=15 2023-10-06T02:28:20.312 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[138999]: starting ceph client 2023-10-06T02:28:20.317 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[138999]: starting fuse 2023-10-06T02:28:20.322 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:28:20.323 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:28:20.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:20.324 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:28:20.380 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:28:20.380 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:28:20.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:20.380 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:28:20.380 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:28:20.380 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:28:20.380 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:28:20.381 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:28:20.381 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:28:20.381 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:28:20.381 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:28:20.381 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:28:20.381 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:28:20.381 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:28:20.381 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:28:20.381 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:28:20.381 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:28:20.381 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:28:20.381 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:28:20.381 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:28:20.382 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:28:20.382 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:28:20.382 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:28:20.382 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:28:20.382 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:28:20.382 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:28:20.382 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:28:20.382 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:28:20.382 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:28:20.503 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.138999.asok 2023-10-06T02:28:20.685 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.138999.asok 2023-10-06T02:28:20.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:20.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.138999.asok status 2023-10-06T02:28:20.841 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:28:20.842 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:28:20.842 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:28:20.842 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:28:20.842 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:28:20.842 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:28:20.842 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:28:20.843 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "138999", 2023-10-06T02:28:20.843 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:28:20.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:28:20.843 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:28:20.843 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:28:20.843 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 10074, 2023-10-06T02:28:20.843 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:28:20.843 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:28:20.843 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:28:20.844 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 10074 2023-10-06T02:28:20.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:28:20.844 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:28:20.844 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:28:20.844 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:28:20.844 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 552742142 2023-10-06T02:28:20.844 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:28:20.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:28:20.845 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:28:20.845 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:28:20.845 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:28:20.845 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 552742142 2023-10-06T02:28:20.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:28:20.845 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.10074 192.168.0.1:0/552742142", 2023-10-06T02:28:20.845 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/552742142", 2023-10-06T02:28:20.845 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:28:20.846 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 288, 2023-10-06T02:28:20.846 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 126, 2023-10-06T02:28:20.846 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:28:20.846 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:28:20.846 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:28:20.846 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:28:20.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:20.852 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:28:20.852 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:20.868 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:28:20.868 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:20.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:20.868 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:20.934 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:20.934 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:28:20.934 DEBUG:teuthology.orchestra.run.smithi006:> import stat 2023-10-06T02:28:20.934 DEBUG:teuthology.orchestra.run.smithi006:> import json 2023-10-06T02:28:20.934 DEBUG:teuthology.orchestra.run.smithi006:> import sys 2023-10-06T02:28:20.934 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:28:20.934 DEBUG:teuthology.orchestra.run.smithi006:> try: 2023-10-06T02:28:20.934 DEBUG:teuthology.orchestra.run.smithi006:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/./subdir/sixmegs'"'"') 2023-10-06T02:28:20.934 DEBUG:teuthology.orchestra.run.smithi006:> except OSError as e: 2023-10-06T02:28:20.934 DEBUG:teuthology.orchestra.run.smithi006:> sys.exit(e.errno) 2023-10-06T02:28:20.934 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:28:20.935 DEBUG:teuthology.orchestra.run.smithi006:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-10-06T02:28:20.935 DEBUG:teuthology.orchestra.run.smithi006:> print(json.dumps( 2023-10-06T02:28:20.935 DEBUG:teuthology.orchestra.run.smithi006:> dict([(a, getattr(s, a)) for a in attrs]), 2023-10-06T02:28:20.935 DEBUG:teuthology.orchestra.run.smithi006:> indent=2)) 2023-10-06T02:28:20.935 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:28:20.976 INFO:teuthology.orchestra.run:waiting for 20 2023-10-06T02:28:21.221 INFO:teuthology.orchestra.run.smithi006.stderr:daemon-helper: command failed with exit status 5 2023-10-06T02:28:22.276 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:28:22.279 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:28:26.858 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:28:26.857+0000 7fc34f931700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-06T02:28:27.078 DEBUG:teuthology.orchestra.run:got remote process result: 5 2023-10-06T02:28:27.078 INFO:tasks.cephfs.test_damage:Result: EIO on client 2023-10-06T02:28:27.078 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:27.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.210+0000 7f442b93e700 1 Processor -- start 2023-10-06T02:28:27.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.210+0000 7f442b93e700 1 -- start start 2023-10-06T02:28:27.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.211+0000 7f442b93e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44240af4e0 0x7f44240b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.211+0000 7f442b93e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f442415db70 0x7f44240b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.211+0000 7f442b93e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442415e190 con 0x7f44240af8b0 2023-10-06T02:28:27.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.211+0000 7f442b93e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44240b1910 con 0x7f44240af4e0 2023-10-06T02:28:27.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.211+0000 7f442b93e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442415dfa0 con 0x7f442415db70 2023-10-06T02:28:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.211+0000 7f44296da700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44240af4e0 0x7f44240b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.211+0000 7f44296da700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44240af4e0 0x7f44240b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46870/0 (socket says 172.21.15.6:46870) 2023-10-06T02:28:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.211+0000 7f44296da700 1 -- 172.21.15.6:0/1902304180 learned_addr learned my addr 172.21.15.6:0/1902304180 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.211+0000 7f4429edb700 1 --2- 172.21.15.6:0/1902304180 >> v2:172.21.15.175:3300/0 conn(0x7f442415db70 0x7f44240b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.211+0000 7f44296da700 1 -- 172.21.15.6:0/1902304180 >> v2:172.21.15.175:3300/0 conn(0x7f442415db70 msgr2=0x7f44240b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.211+0000 7f44296da700 1 --2- 172.21.15.6:0/1902304180 >> v2:172.21.15.175:3300/0 conn(0x7f442415db70 0x7f44240b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.211+0000 7f44296da700 1 -- 172.21.15.6:0/1902304180 >> v1:172.21.15.175:6789/0 conn(0x7f44240af8b0 legacy=0x7f442415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.211+0000 7f44296da700 1 -- 172.21.15.6:0/1902304180 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44240cb650 con 0x7f44240af4e0 2023-10-06T02:28:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.212+0000 7f44296da700 1 --2- 172.21.15.6:0/1902304180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44240af4e0 0x7f44240b20e0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f44240c7280 tx=0x7f441c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e1ca8da5ecaa41 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.212+0000 7f4423fff700 1 -- 172.21.15.6:0/1902304180 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c009e70 con 0x7f44240af4e0 2023-10-06T02:28:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.212+0000 7f4423fff700 1 -- 172.21.15.6:0/1902304180 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c00b860 con 0x7f44240af4e0 2023-10-06T02:28:27.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.212+0000 7f4423fff700 1 -- 172.21.15.6:0/1902304180 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c00bc00 con 0x7f44240af4e0 2023-10-06T02:28:27.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.212+0000 7f442b93e700 1 -- 172.21.15.6:0/1902304180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44240af4e0 msgr2=0x7f44240b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.212+0000 7f442b93e700 1 --2- 172.21.15.6:0/1902304180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44240af4e0 0x7f44240b20e0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f44240c7280 tx=0x7f441c009250 comp rx=0 tx=0).stop 2023-10-06T02:28:27.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.212+0000 7f442b93e700 1 -- 172.21.15.6:0/1902304180 shutdown_connections 2023-10-06T02:28:27.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.212+0000 7f442b93e700 1 --2- 172.21.15.6:0/1902304180 >> v2:172.21.15.175:3300/0 conn(0x7f442415db70 0x7f44240b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.212+0000 7f442b93e700 1 --2- 172.21.15.6:0/1902304180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44240af4e0 0x7f44240b20e0 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.212+0000 7f442b93e700 1 -- 172.21.15.6:0/1902304180 >> 172.21.15.6:0/1902304180 conn(0x7f4424068680 msgr2=0x7f4424068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.212+0000 7f442b93e700 1 -- 172.21.15.6:0/1902304180 shutdown_connections 2023-10-06T02:28:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.212+0000 7f442b93e700 1 -- 172.21.15.6:0/1902304180 wait complete. 2023-10-06T02:28:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.213+0000 7f442b93e700 1 Processor -- start 2023-10-06T02:28:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.213+0000 7f442b93e700 1 -- start start 2023-10-06T02:28:27.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.214+0000 7f442b93e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44240af4e0 0x7f44240d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.214+0000 7f442b93e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44240af8b0 0x7f4424152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.214+0000 7f442b93e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f442415db70 0x7f44241510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.214+0000 7f442b93e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44240cff10 con 0x7f442415db70 2023-10-06T02:28:27.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.214+0000 7f442b93e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44241527c0 con 0x7f44240af8b0 2023-10-06T02:28:27.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.214+0000 7f442b93e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4424151610 con 0x7f44240af4e0 2023-10-06T02:28:27.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.214+0000 7f4429edb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f442415db70 0x7f44241510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.215+0000 7f4429edb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f442415db70 0x7f44241510d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46876/0 (socket says 172.21.15.6:46876) 2023-10-06T02:28:27.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.215+0000 7f4429edb700 1 -- 172.21.15.6:0/613762136 learned_addr learned my addr 172.21.15.6:0/613762136 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:27.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.215+0000 7f4429edb700 1 -- 172.21.15.6:0/613762136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44240af4e0 msgr2=0x7f44240d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.215+0000 7f4429edb700 1 --2- 172.21.15.6:0/613762136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44240af4e0 0x7f44240d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.215+0000 7f4429edb700 1 -- 172.21.15.6:0/613762136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44240af8b0 msgr2=0x7f4424152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.215+0000 7f4428ed9700 1 --2- 172.21.15.6:0/613762136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44240af8b0 0x7f4424152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.215+0000 7f4429edb700 1 --2- 172.21.15.6:0/613762136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44240af8b0 0x7f4424152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.215+0000 7f4429edb700 1 -- 172.21.15.6:0/613762136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c0094f0 con 0x7f442415db70 2023-10-06T02:28:27.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.215+0000 7f4429edb700 1 --2- 172.21.15.6:0/613762136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f442415db70 0x7f44241510d0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f4414009e40 tx=0x7f441400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:27.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.215+0000 7f44217fa700 1 -- 172.21.15.6:0/613762136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441400cc20 con 0x7f442415db70 2023-10-06T02:28:27.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.215+0000 7f44217fa700 1 -- 172.21.15.6:0/613762136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441400f040 con 0x7f442415db70 2023-10-06T02:28:27.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.215+0000 7f442b93e700 1 -- 172.21.15.6:0/613762136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44240d13f0 con 0x7f442415db70 2023-10-06T02:28:27.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.215+0000 7f44217fa700 1 -- 172.21.15.6:0/613762136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414014480 con 0x7f442415db70 2023-10-06T02:28:27.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.215+0000 7f442b93e700 1 -- 172.21.15.6:0/613762136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44240cf8c0 con 0x7f442415db70 2023-10-06T02:28:27.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.216+0000 7f442b93e700 1 -- 172.21.15.6:0/613762136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4424088aa0 con 0x7f442415db70 2023-10-06T02:28:27.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.217+0000 7f44217fa700 1 -- 172.21.15.6:0/613762136 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4414014830 con 0x7f442415db70 2023-10-06T02:28:27.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.217+0000 7f44217fa700 1 --2- 172.21.15.6:0/613762136 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4410066f30 0x7f44100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.217+0000 7f44217fa700 1 -- 172.21.15.6:0/613762136 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7f4414085bf0 con 0x7f442415db70 2023-10-06T02:28:27.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.217+0000 7f44296da700 1 --2- 172.21.15.6:0/613762136 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4410066f30 0x7f44100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.218+0000 7f44296da700 1 --2- 172.21.15.6:0/613762136 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4410066f30 0x7f44100693e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f44240c7280 tx=0x7f441c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:27.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.222+0000 7f44217fa700 1 -- 172.21.15.6:0/613762136 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4414052110 con 0x7f442415db70 2023-10-06T02:28:27.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.465+0000 7f442b93e700 1 -- 172.21.15.6:0/613762136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44240d0050 con 0x7f442415db70 2023-10-06T02:28:27.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.465+0000 7f44217fa700 1 -- 172.21.15.6:0/613762136 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 289 v289) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f4414018090 con 0x7f442415db70 2023-10-06T02:28:27.467 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:27.468 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":289,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":289,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:28:26.858976+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9963":{"gid":9963,"name":"a","rank":0,"incarnation":285,"state":"up:active","state_seq":7,"addr":"172.21.15.6:6835/4058600046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":4058600046},{"type":"v1","addr":"172.21.15.6:6835","nonce":4058600046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:27.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.467+0000 7f442b93e700 1 -- 172.21.15.6:0/613762136 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4410066f30 msgr2=0x7f44100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.467+0000 7f442b93e700 1 --2- 172.21.15.6:0/613762136 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4410066f30 0x7f44100693e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f44240c7280 tx=0x7f441c017000 comp rx=0 tx=0).stop 2023-10-06T02:28:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.467+0000 7f442b93e700 1 -- 172.21.15.6:0/613762136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f442415db70 msgr2=0x7f44241510d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.467+0000 7f442b93e700 1 --2- 172.21.15.6:0/613762136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f442415db70 0x7f44241510d0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f4414009e40 tx=0x7f441400b040 comp rx=0 tx=0).stop 2023-10-06T02:28:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.467+0000 7f442b93e700 1 -- 172.21.15.6:0/613762136 shutdown_connections 2023-10-06T02:28:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.467+0000 7f442b93e700 1 --2- 172.21.15.6:0/613762136 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4410066f30 0x7f44100693e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.467+0000 7f442b93e700 1 --2- 172.21.15.6:0/613762136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f442415db70 0x7f44241510d0 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.467+0000 7f442b93e700 1 --2- 172.21.15.6:0/613762136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44240af4e0 0x7f44240d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.467+0000 7f442b93e700 1 --2- 172.21.15.6:0/613762136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44240af8b0 0x7f4424152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.467+0000 7f442b93e700 1 -- 172.21.15.6:0/613762136 >> 172.21.15.6:0/613762136 conn(0x7f4424068680 msgr2=0x7f44240b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.468+0000 7f442b93e700 1 -- 172.21.15.6:0/613762136 shutdown_connections 2023-10-06T02:28:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.468+0000 7f442b93e700 1 -- 172.21.15.6:0/613762136 wait complete. 2023-10-06T02:28:27.471 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 289 2023-10-06T02:28:27.481 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2023-10-06T02:28:27.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.600+0000 7f4d37003700 1 Processor -- start 2023-10-06T02:28:27.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.600+0000 7f4d37003700 1 -- start start 2023-10-06T02:28:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.601+0000 7f4d37003700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d300af400 0x7f4d300b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.601+0000 7f4d37003700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4d30069d10 0x7f4d3006a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.601+0000 7f4d37003700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d300b06b0 con 0x7f4d300b0b40 2023-10-06T02:28:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.601+0000 7f4d37003700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3006a6f0 con 0x7f4d30069d10 2023-10-06T02:28:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.601+0000 7f4d37003700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300b2970 con 0x7f4d300af400 2023-10-06T02:28:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.601+0000 7f4d35800700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4d300b0b40 0x7f4d3015a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50280/0 (socket says 172.21.15.6:50280) 2023-10-06T02:28:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d35800700 1 -- 172.21.15.6:0/2981695865 learned_addr learned my addr 172.21.15.6:0/2981695865 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d36001700 1 --2- 172.21.15.6:0/2981695865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d300af400 0x7f4d300b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d36802700 1 --2- 172.21.15.6:0/2981695865 >> v2:172.21.15.175:3300/0 conn(0x7f4d30069d10 0x7f4d3006a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d34fff700 1 -- 172.21.15.6:0/2981695865 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048626790 0 0) 0x7f4d300b06b0 con 0x7f4d300b0b40 2023-10-06T02:28:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d34fff700 1 -- 172.21.15.6:0/2981695865 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d18003570 con 0x7f4d300b0b40 2023-10-06T02:28:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d34fff700 1 -- 172.21.15.6:0/2981695865 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3251124392 0 0) 0x7f4d18003570 con 0x7f4d300b0b40 2023-10-06T02:28:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d34fff700 1 -- 172.21.15.6:0/2981695865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d300af400 msgr2=0x7f4d300b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d34fff700 1 --2- 172.21.15.6:0/2981695865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d300af400 0x7f4d300b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d34fff700 1 -- 172.21.15.6:0/2981695865 >> v2:172.21.15.175:3300/0 conn(0x7f4d30069d10 msgr2=0x7f4d3006a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d34fff700 1 --2- 172.21.15.6:0/2981695865 >> v2:172.21.15.175:3300/0 conn(0x7f4d30069d10 0x7f4d3006a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d34fff700 1 -- 172.21.15.6:0/2981695865 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d300afd80 con 0x7f4d300b0b40 2023-10-06T02:28:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d34fff700 1 -- 172.21.15.6:0/2981695865 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f4d24001470 con 0x7f4d300b0b40 2023-10-06T02:28:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d36001700 1 --2- 172.21.15.6:0/2981695865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d300af400 0x7f4d300b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d34fff700 1 -- 172.21.15.6:0/2981695865 >> v1:172.21.15.6:6789/0 conn(0x7f4d300b0b40 legacy=0x7f4d3015a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d34fff700 1 --2- 172.21.15.6:0/2981695865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d300af400 0x7f4d18003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d34fff700 1 --2- 172.21.15.6:0/2981695865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d18003fa0 0x7f4d18004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d34fff700 1 --2- 172.21.15.6:0/2981695865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d18004d50 0x7f4d180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d34fff700 1 -- 172.21.15.6:0/2981695865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3006a6f0 con 0x7f4d18004d50 2023-10-06T02:28:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d34fff700 1 -- 172.21.15.6:0/2981695865 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300b2970 con 0x7f4d18003fa0 2023-10-06T02:28:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d34fff700 1 -- 172.21.15.6:0/2981695865 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1800ba60 con 0x7f4d300af400 2023-10-06T02:28:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d36802700 1 --2- 172.21.15.6:0/2981695865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d18004d50 0x7f4d180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.602+0000 7f4d36001700 1 --2- 172.21.15.6:0/2981695865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d300af400 0x7f4d18003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.603+0000 7f4d35800700 1 --2- 172.21.15.6:0/2981695865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d18003fa0 0x7f4d18004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.603+0000 7f4d36802700 1 -- 172.21.15.6:0/2981695865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d300af400 msgr2=0x7f4d18003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:27.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.603+0000 7f4d36802700 1 --2- 172.21.15.6:0/2981695865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d300af400 0x7f4d18003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.603+0000 7f4d36802700 1 -- 172.21.15.6:0/2981695865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d18003fa0 msgr2=0x7f4d18004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:27.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.603+0000 7f4d36802700 1 --2- 172.21.15.6:0/2981695865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d18003fa0 0x7f4d18004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.603+0000 7f4d36802700 1 -- 172.21.15.6:0/2981695865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d20009420 con 0x7f4d18004d50 2023-10-06T02:28:27.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.603+0000 7f4d35800700 1 --2- 172.21.15.6:0/2981695865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d18003fa0 0x7f4d18004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:27.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.603+0000 7f4d36802700 1 --2- 172.21.15.6:0/2981695865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d18004d50 0x7f4d180051c0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800e210 tx=0x7f4d2800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0cb3782787533 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:27.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.603+0000 7f4d34fff700 1 -- 172.21.15.6:0/2981695865 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2800eac0 con 0x7f4d18004d50 2023-10-06T02:28:27.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.603+0000 7f4d34fff700 1 -- 172.21.15.6:0/2981695865 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2800f040 con 0x7f4d18004d50 2023-10-06T02:28:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.603+0000 7f4d34fff700 1 -- 172.21.15.6:0/2981695865 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2800ee70 con 0x7f4d18004d50 2023-10-06T02:28:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.604+0000 7f4d37003700 1 -- 172.21.15.6:0/2981695865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d18004d50 msgr2=0x7f4d180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.604+0000 7f4d37003700 1 --2- 172.21.15.6:0/2981695865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d18004d50 0x7f4d180051c0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800e210 tx=0x7f4d2800b040 comp rx=0 tx=0).stop 2023-10-06T02:28:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.604+0000 7f4d36802700 1 -- 172.21.15.6:0/2981695865 reap_dead start 2023-10-06T02:28:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.604+0000 7f4d37003700 1 -- 172.21.15.6:0/2981695865 shutdown_connections 2023-10-06T02:28:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.604+0000 7f4d37003700 1 -- 172.21.15.6:0/2981695865 >> 172.21.15.6:0/2981695865 conn(0x7f4d300d0c10 msgr2=0x7f4d300ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.604+0000 7f4d37003700 1 -- 172.21.15.6:0/2981695865 shutdown_connections 2023-10-06T02:28:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.604+0000 7f4d37003700 1 -- 172.21.15.6:0/2981695865 wait complete. 2023-10-06T02:28:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.605+0000 7f4d37003700 1 Processor -- start 2023-10-06T02:28:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.605+0000 7f4d37003700 1 -- start start 2023-10-06T02:28:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d37003700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d18004d50 0x7f4d301579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d37003700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d300c6540 0x7f4d3016a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d37003700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d300c3ac0 0x7f4d300c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d37003700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3016b0f0 con 0x7f4d18004d50 2023-10-06T02:28:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d37003700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d30157f10 con 0x7f4d300c3ac0 2023-10-06T02:28:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d37003700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300c77f0 con 0x7f4d300c6540 2023-10-06T02:28:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d36001700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d18004d50 0x7f4d301579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d36001700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d18004d50 0x7f4d301579d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46886/0 (socket says 172.21.15.6:46886) 2023-10-06T02:28:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d36001700 1 -- 172.21.15.6:0/964788724 learned_addr learned my addr 172.21.15.6:0/964788724 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d35800700 1 --2- 172.21.15.6:0/964788724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d300c6540 0x7f4d3016a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d36802700 1 --2- 172.21.15.6:0/964788724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d300c3ac0 0x7f4d300c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d36001700 1 -- 172.21.15.6:0/964788724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d300c6540 msgr2=0x7f4d3016a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d36001700 1 --2- 172.21.15.6:0/964788724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d300c6540 0x7f4d3016a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d36001700 1 -- 172.21.15.6:0/964788724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d300c3ac0 msgr2=0x7f4d300c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d36001700 1 --2- 172.21.15.6:0/964788724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d300c3ac0 0x7f4d300c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d36001700 1 -- 172.21.15.6:0/964788724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3016a5f0 con 0x7f4d18004d50 2023-10-06T02:28:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d36001700 1 --2- 172.21.15.6:0/964788724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d18004d50 0x7f4d301579d0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f4d20011d70 tx=0x7f4d200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.606+0000 7f4d2dffb700 1 -- 172.21.15.6:0/964788724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20011e70 con 0x7f4d18004d50 2023-10-06T02:28:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.607+0000 7f4d2dffb700 1 -- 172.21.15.6:0/964788724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2000fc20 con 0x7f4d18004d50 2023-10-06T02:28:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.607+0000 7f4d37003700 1 -- 172.21.15.6:0/964788724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d300c9fd0 con 0x7f4d18004d50 2023-10-06T02:28:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.607+0000 7f4d2dffb700 1 -- 172.21.15.6:0/964788724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2001d480 con 0x7f4d18004d50 2023-10-06T02:28:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.607+0000 7f4d37003700 1 -- 172.21.15.6:0/964788724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3016ab30 con 0x7f4d18004d50 2023-10-06T02:28:27.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.608+0000 7f4d2dffb700 1 -- 172.21.15.6:0/964788724 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d2001d870 con 0x7f4d18004d50 2023-10-06T02:28:27.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.609+0000 7f4d2dffb700 1 --2- 172.21.15.6:0/964788724 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d1c066f30 0x7f4d1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.609+0000 7f4d2dffb700 1 -- 172.21.15.6:0/964788724 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7f4d20018070 con 0x7f4d18004d50 2023-10-06T02:28:27.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.609+0000 7f4d35800700 1 --2- 172.21.15.6:0/964788724 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d1c066f30 0x7f4d1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.610+0000 7f4d35800700 1 --2- 172.21.15.6:0/964788724 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d1c066f30 0x7f4d1c0693e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f4d300b3850 tx=0x7f4d24007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:27.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.611+0000 7f4d4155db80 1 Processor -- start 2023-10-06T02:28:27.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.611+0000 7f4d4155db80 1 -- start start 2023-10-06T02:28:27.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.611+0000 7f4d4155db80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56157306eef0 0x561573049d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.611+0000 7f4d4155db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56157304f360 0x56157304a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.611+0000 7f4d4155db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561573050ab0 0x56157304a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.611+0000 7f4d4155db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561572fa4b10 con 0x561573050ab0 2023-10-06T02:28:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.611+0000 7f4d4155db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561572fa2310 con 0x56157304f360 2023-10-06T02:28:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.611+0000 7f4d4155db80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561572f9e100 con 0x56157306eef0 2023-10-06T02:28:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.611+0000 7f4d36802700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561573050ab0 0x56157304a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.611+0000 7f4d36802700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561573050ab0 0x56157304a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46892/0 (socket says 172.21.15.6:46892) 2023-10-06T02:28:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.611+0000 7f4d36802700 1 -- 172.21.15.6:0/93275789 learned_addr learned my addr 172.21.15.6:0/93275789 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.611+0000 7f4d35800700 1 --2- 172.21.15.6:0/93275789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56157304f360 0x56157304a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.612+0000 7f4d36001700 1 --2- 172.21.15.6:0/93275789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56157306eef0 0x561573049d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.612+0000 7f4d36802700 1 -- 172.21.15.6:0/93275789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56157306eef0 msgr2=0x561573049d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:27.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.612+0000 7f4d36802700 1 --2- 172.21.15.6:0/93275789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56157306eef0 0x561573049d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.612+0000 7f4d36802700 1 -- 172.21.15.6:0/93275789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56157304f360 msgr2=0x56157304a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:27.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.612+0000 7f4d36802700 1 --2- 172.21.15.6:0/93275789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56157304f360 0x56157304a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.612+0000 7f4d36802700 1 -- 172.21.15.6:0/93275789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561572e38310 con 0x561573050ab0 2023-10-06T02:28:27.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.612+0000 7f4d36001700 1 --2- 172.21.15.6:0/93275789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56157306eef0 0x561573049d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:27.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.612+0000 7f4d36802700 1 --2- 172.21.15.6:0/93275789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561573050ab0 0x56157304a7e0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f4d28016000 tx=0x7f4d2801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597c4ad7783b4b2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:27.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.612+0000 7f4d16ffd700 1 -- 172.21.15.6:0/93275789 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28023070 con 0x561573050ab0 2023-10-06T02:28:27.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.612+0000 7f4d16ffd700 1 -- 172.21.15.6:0/93275789 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d28009ac0 con 0x561573050ab0 2023-10-06T02:28:27.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.612+0000 7f4d16ffd700 1 -- 172.21.15.6:0/93275789 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2800ecf0 con 0x561573050ab0 2023-10-06T02:28:27.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.613+0000 7f4d4155db80 1 -- 172.21.15.6:0/93275789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561573050ab0 msgr2=0x56157304a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.613+0000 7f4d4155db80 1 --2- 172.21.15.6:0/93275789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561573050ab0 0x56157304a7e0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f4d28016000 tx=0x7f4d2801a000 comp rx=0 tx=0).stop 2023-10-06T02:28:27.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.613+0000 7f4d4155db80 1 -- 172.21.15.6:0/93275789 shutdown_connections 2023-10-06T02:28:27.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.613+0000 7f4d4155db80 1 --2- 172.21.15.6:0/93275789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561573050ab0 0x56157304a7e0 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.613+0000 7f4d4155db80 1 --2- 172.21.15.6:0/93275789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56157306eef0 0x561573049d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.613+0000 7f4d4155db80 1 --2- 172.21.15.6:0/93275789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56157304f360 0x56157304a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.613+0000 7f4d4155db80 1 -- 172.21.15.6:0/93275789 >> 172.21.15.6:0/93275789 conn(0x56157304ef20 msgr2=0x56157304f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.613+0000 7f4d4155db80 1 -- 172.21.15.6:0/93275789 shutdown_connections 2023-10-06T02:28:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.613+0000 7f4d4155db80 1 -- 172.21.15.6:0/93275789 wait complete. 2023-10-06T02:28:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.613+0000 7f4d4155db80 1 -- start start 2023-10-06T02:28:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.613+0000 7f4d4155db80 1 Processor -- start 2023-10-06T02:28:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.614+0000 7f4d4155db80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56157304f360 0x561573096540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.614+0000 7f4d4155db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561573050ab0 0x5615730a3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.614+0000 7f4d4155db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x561573095380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.614+0000 7f4d4155db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561572f49930 con 0x56157306eef0 2023-10-06T02:28:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.614+0000 7f4d4155db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561572f64f40 con 0x561573050ab0 2023-10-06T02:28:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.614+0000 7f4d4155db80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561572e20ed0 con 0x56157304f360 2023-10-06T02:28:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.614+0000 7f4d4155db80 10 client.0 _ll_register_callbacks cb 0x5615730110c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:28:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.614+0000 7f4d36802700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x561573095380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.614+0000 7f4d36802700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x561573095380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46898/0 (socket says 172.21.15.6:46898) 2023-10-06T02:28:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.614+0000 7f4d36802700 1 -- 172.21.15.6:0/3961539571 learned_addr learned my addr 172.21.15.6:0/3961539571 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.614+0000 7f4d36001700 1 --2- 172.21.15.6:0/3961539571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56157304f360 0x561573096540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.614+0000 7f4d35800700 1 --2- 172.21.15.6:0/3961539571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561573050ab0 0x5615730a3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d36802700 1 -- 172.21.15.6:0/3961539571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56157304f360 msgr2=0x561573096540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d36802700 1 --2- 172.21.15.6:0/3961539571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56157304f360 0x561573096540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d36802700 1 -- 172.21.15.6:0/3961539571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561573050ab0 msgr2=0x5615730a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d36802700 1 --2- 172.21.15.6:0/3961539571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561573050ab0 0x5615730a3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d36802700 1 -- 172.21.15.6:0/3961539571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d20009420 con 0x56157306eef0 2023-10-06T02:28:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d36802700 1 --2- 172.21.15.6:0/3961539571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x561573095380 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f4d180046f0 tx=0x7f4d28023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f88ac0f8d8f5538 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d0ffff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:28:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d0ffff700 1 -- 172.21.15.6:0/3961539571 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28014c00 con 0x56157306eef0 2023-10-06T02:28:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d0ffff700 1 -- 172.21.15.6:0/3961539571 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7f4d28014d60 con 0x56157306eef0 2023-10-06T02:28:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d4155db80 1 -- 172.21.15.6:0/3961539571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5615730429e0 con 0x56157306eef0 2023-10-06T02:28:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d0ffff700 1 -- 172.21.15.6:0/3961539571 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=289) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d28032690 con 0x56157306eef0 2023-10-06T02:28:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d4155db80 10 client.10092 fetch_fsmap learned FSMap version 289 2023-10-06T02:28:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d4155db80 1 -- 172.21.15.6:0/3961539571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=289,monmap=2+}) v3 -- 0x561572ddb080 con 0x56157306eef0 2023-10-06T02:28:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d0ffff700 1 -- 172.21.15.6:0/3961539571 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5615730429e0 con 0x56157306eef0 2023-10-06T02:28:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d0ffff700 1 -- 172.21.15.6:0/3961539571 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 289) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4d280327f0 con 0x56157306eef0 2023-10-06T02:28:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d4155db80 10 client.10092 fetch_fsmap finished waiting for FSMap version 289 2023-10-06T02:28:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d4155db80 10 client.10092 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:28:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d4155db80 20 client.10092 populate_metadata read hostname 'smithi006' 2023-10-06T02:28:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d4155db80 1 --2- 172.21.15.6:0/3961539571 >> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] conn(0x5615730958c0 0x56157306d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d4155db80 4 client.10092 mds_command: new command op to 9963 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:28:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.615+0000 7f4d4155db80 1 -- 172.21.15.6:0/3961539571 --> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56157301f910 con 0x5615730958c0 2023-10-06T02:28:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.616+0000 7f4d36001700 1 --2- 172.21.15.6:0/3961539571 >> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] conn(0x5615730958c0 0x56157306d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.616+0000 7f4d0ffff700 10 client.10092 ms_handle_connect on v2:172.21.15.6:6833/4058600046 2023-10-06T02:28:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.616+0000 7f4d36001700 1 --2- 172.21.15.6:0/3961539571 >> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] conn(0x5615730958c0 0x56157306d9f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=187b6daebcce9c5a server_cookie=dc55d8da1ecbf129 in_seq=0 out_seq=0 2023-10-06T02:28:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.616+0000 7f4d0ffff700 1 -- 172.21.15.6:0/3961539571 <== mds.0 v2:172.21.15.6:6833/4058600046 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56157301f910 con 0x5615730958c0 2023-10-06T02:28:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.616+0000 7f4d0ffff700 10 client.10092 handle_command_reply: tid=0 2023-10-06T02:28:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.616+0000 7f4d4155db80 1 client.10092 shutdown 2023-10-06T02:28:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.616+0000 7f4d4155db80 1 -- 172.21.15.6:0/3961539571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 msgr2=0x561573095380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.616+0000 7f4d4155db80 1 --2- 172.21.15.6:0/3961539571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x561573095380 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f4d180046f0 tx=0x7f4d28023000 comp rx=0 tx=0).stop 2023-10-06T02:28:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.617+0000 7f4d4155db80 1 -- 172.21.15.6:0/3961539571 shutdown_connections 2023-10-06T02:28:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.617+0000 7f4d4155db80 1 --2- 172.21.15.6:0/3961539571 >> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] conn(0x5615730958c0 0x56157306d9f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.617+0000 7f4d4155db80 1 --2- 172.21.15.6:0/3961539571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x561573095380 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.617+0000 7f4d4155db80 1 --2- 172.21.15.6:0/3961539571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56157304f360 0x561573096540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.617+0000 7f4d0ffff700 0 client.10092 ms_handle_reset on v2:172.21.15.6:6833/4058600046 2023-10-06T02:28:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.617+0000 7f4d4155db80 1 --2- 172.21.15.6:0/3961539571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561573050ab0 0x5615730a3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.617+0000 7f4d4155db80 1 -- 172.21.15.6:0/3961539571 >> 172.21.15.6:0/3961539571 conn(0x56157304ef20 msgr2=0x56157304fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.617+0000 7f4d4155db80 1 -- 172.21.15.6:0/3961539571 shutdown_connections 2023-10-06T02:28:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.617+0000 7f4d4155db80 1 -- 172.21.15.6:0/3961539571 wait complete. 2023-10-06T02:28:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.617+0000 7f4d4155db80 20 client.10092 trim_cache size 0 max 16384 2023-10-06T02:28:27.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.629+0000 7f4d4155db80 1 Processor -- start 2023-10-06T02:28:27.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.629+0000 7f4d4155db80 1 -- start start 2023-10-06T02:28:27.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d4155db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56157304f360 0x561573095e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d4155db80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561573050ab0 0x56157304f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d4155db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x56157304fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d4155db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56157306ebe0 con 0x56157306eef0 2023-10-06T02:28:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d4155db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561573046620 con 0x56157304f360 2023-10-06T02:28:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d4155db80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56157304cb40 con 0x561573050ab0 2023-10-06T02:28:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d36802700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x56157304fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d36802700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x56157304fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46912/0 (socket says 172.21.15.6:46912) 2023-10-06T02:28:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d36802700 1 -- 172.21.15.6:0/1384249612 learned_addr learned my addr 172.21.15.6:0/1384249612 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d36802700 1 -- 172.21.15.6:0/1384249612 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561573050ab0 msgr2=0x56157304f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d36001700 1 --2- 172.21.15.6:0/1384249612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56157304f360 0x561573095e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d35800700 1 --2- 172.21.15.6:0/1384249612 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561573050ab0 0x56157304f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d36802700 1 --2- 172.21.15.6:0/1384249612 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561573050ab0 0x56157304f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d36802700 1 -- 172.21.15.6:0/1384249612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56157304f360 msgr2=0x561573095e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d36802700 1 --2- 172.21.15.6:0/1384249612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56157304f360 0x561573095e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d36802700 1 -- 172.21.15.6:0/1384249612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561572f6c820 con 0x56157306eef0 2023-10-06T02:28:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d36001700 1 --2- 172.21.15.6:0/1384249612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56157304f360 0x561573095e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.630+0000 7f4d36802700 1 --2- 172.21.15.6:0/1384249612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x56157304fc70 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800e210 tx=0x7f4d2802d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa4c56184a45cda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.631+0000 7f4d177fe700 1 -- 172.21.15.6:0/1384249612 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28023070 con 0x56157306eef0 2023-10-06T02:28:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.631+0000 7f4d177fe700 1 -- 172.21.15.6:0/1384249612 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2801e430 con 0x56157306eef0 2023-10-06T02:28:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.631+0000 7f4d177fe700 1 -- 172.21.15.6:0/1384249612 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28014e50 con 0x56157306eef0 2023-10-06T02:28:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.631+0000 7f4d4155db80 1 -- 172.21.15.6:0/1384249612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 msgr2=0x56157304fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.631+0000 7f4d4155db80 1 --2- 172.21.15.6:0/1384249612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x56157304fc70 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800e210 tx=0x7f4d2802d000 comp rx=0 tx=0).stop 2023-10-06T02:28:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.631+0000 7f4d4155db80 1 -- 172.21.15.6:0/1384249612 shutdown_connections 2023-10-06T02:28:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.631+0000 7f4d4155db80 1 --2- 172.21.15.6:0/1384249612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x56157304fc70 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.631+0000 7f4d4155db80 1 --2- 172.21.15.6:0/1384249612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56157304f360 0x561573095e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.631+0000 7f4d4155db80 1 --2- 172.21.15.6:0/1384249612 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561573050ab0 0x56157304f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.631+0000 7f4d4155db80 1 -- 172.21.15.6:0/1384249612 >> 172.21.15.6:0/1384249612 conn(0x56157304ef20 msgr2=0x5615730444a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:27.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.631+0000 7f4d4155db80 1 -- 172.21.15.6:0/1384249612 shutdown_connections 2023-10-06T02:28:27.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.631+0000 7f4d4155db80 1 -- 172.21.15.6:0/1384249612 wait complete. 2023-10-06T02:28:27.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.632+0000 7f4d4155db80 1 -- start start 2023-10-06T02:28:27.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.632+0000 7f4d4155db80 1 Processor -- start 2023-10-06T02:28:27.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d4155db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56157304f360 0x561573072f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d4155db80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561573050ab0 0x5615730f8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d4155db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x5615730f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d4155db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561573044e10 con 0x56157306eef0 2023-10-06T02:28:27.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d4155db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56157307c870 con 0x56157304f360 2023-10-06T02:28:27.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d4155db80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56157307c500 con 0x561573050ab0 2023-10-06T02:28:27.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d4155db80 10 client.0 _ll_register_callbacks cb 0x5615730110c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:28:27.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d36802700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x5615730f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d36802700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x5615730f88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46922/0 (socket says 172.21.15.6:46922) 2023-10-06T02:28:27.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d36802700 1 -- 172.21.15.6:0/1159593502 learned_addr learned my addr 172.21.15.6:0/1159593502 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:27.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d36001700 1 --2- 172.21.15.6:0/1159593502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56157304f360 0x561573072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d35800700 1 --2- 172.21.15.6:0/1159593502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561573050ab0 0x5615730f8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d36802700 1 -- 172.21.15.6:0/1159593502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561573050ab0 msgr2=0x5615730f8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:27.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d36802700 1 --2- 172.21.15.6:0/1159593502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561573050ab0 0x5615730f8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d36802700 1 -- 172.21.15.6:0/1159593502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56157304f360 msgr2=0x561573072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:27.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d36802700 1 --2- 172.21.15.6:0/1159593502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56157304f360 0x561573072f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d36802700 1 -- 172.21.15.6:0/1159593502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561572ddb080 con 0x56157306eef0 2023-10-06T02:28:27.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d35800700 1 --2- 172.21.15.6:0/1159593502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561573050ab0 0x5615730f8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:27.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d36802700 1 --2- 172.21.15.6:0/1159593502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x5615730f88a0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f4d28034010 tx=0x7f4d28034040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c0d2ad4b8e2331 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:27.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d0ffff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:28:27.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d0ffff700 1 -- 172.21.15.6:0/1159593502 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28023040 con 0x56157306eef0 2023-10-06T02:28:27.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d0ffff700 1 -- 172.21.15.6:0/1159593502 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7f4d28048020 con 0x56157306eef0 2023-10-06T02:28:27.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d4155db80 1 -- 172.21.15.6:0/1159593502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d28009ac0 con 0x56157306eef0 2023-10-06T02:28:27.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d0ffff700 1 -- 172.21.15.6:0/1159593502 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=289) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d28014920 con 0x56157306eef0 2023-10-06T02:28:27.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d4155db80 10 client.10098 fetch_fsmap learned FSMap version 289 2023-10-06T02:28:27.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.633+0000 7f4d4155db80 1 -- 172.21.15.6:0/1159593502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=289,monmap=2+}) v3 -- 0x561572f53510 con 0x56157306eef0 2023-10-06T02:28:27.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d0ffff700 1 -- 172.21.15.6:0/1159593502 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d28009ac0 con 0x56157306eef0 2023-10-06T02:28:27.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d0ffff700 1 -- 172.21.15.6:0/1159593502 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 289) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4d2803a070 con 0x56157306eef0 2023-10-06T02:28:27.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d4155db80 10 client.10098 fetch_fsmap finished waiting for FSMap version 289 2023-10-06T02:28:27.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d4155db80 10 client.10098 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:28:27.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d4155db80 20 client.10098 populate_metadata read hostname 'smithi006' 2023-10-06T02:28:27.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d4155db80 1 --2- 172.21.15.6:0/1159593502 >> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] conn(0x56157304fcc0 0x56157307cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d4155db80 4 client.10098 mds_command: new command op to 9963 tid=0[{"prefix": "damage ls", "format": "json-pretty"}] 2023-10-06T02:28:27.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d4155db80 1 -- 172.21.15.6:0/1159593502 --> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x561572f40ea0 con 0x56157304fcc0 2023-10-06T02:28:27.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d36001700 1 --2- 172.21.15.6:0/1159593502 >> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] conn(0x56157304fcc0 0x56157307cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d0ffff700 10 client.10098 ms_handle_connect on v2:172.21.15.6:6833/4058600046 2023-10-06T02:28:27.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d36001700 1 --2- 172.21.15.6:0/1159593502 >> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] conn(0x56157304fcc0 0x56157307cd00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=454e73b9ade6adcf server_cookie=17ca95f58b4c5385 in_seq=0 out_seq=0 2023-10-06T02:28:27.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d0ffff700 1 -- 172.21.15.6:0/1159593502 <== mds.0 v2:172.21.15.6:6833/4058600046 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+214 (crc 0 0 0) 0x561572f40ea0 con 0x56157304fcc0 2023-10-06T02:28:27.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d0ffff700 10 client.10098 handle_command_reply: tid=0 2023-10-06T02:28:27.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d4155db80 1 client.10098 shutdown 2023-10-06T02:28:27.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d4155db80 1 -- 172.21.15.6:0/1159593502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 msgr2=0x5615730f88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d4155db80 1 --2- 172.21.15.6:0/1159593502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x5615730f88a0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f4d28034010 tx=0x7f4d28034040 comp rx=0 tx=0).stop 2023-10-06T02:28:27.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d4155db80 1 -- 172.21.15.6:0/1159593502 shutdown_connections 2023-10-06T02:28:27.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d4155db80 1 --2- 172.21.15.6:0/1159593502 >> [v2:172.21.15.6:6833/4058600046,v1:172.21.15.6:6835/4058600046] conn(0x56157304fcc0 0x56157307cd00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d4155db80 1 --2- 172.21.15.6:0/1159593502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56157306eef0 0x5615730f88a0 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d4155db80 1 --2- 172.21.15.6:0/1159593502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56157304f360 0x561573072f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d4155db80 1 --2- 172.21.15.6:0/1159593502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561573050ab0 0x5615730f8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d0ffff700 0 client.10098 ms_handle_reset on v2:172.21.15.6:6833/4058600046 2023-10-06T02:28:27.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.634+0000 7f4d4155db80 1 -- 172.21.15.6:0/1159593502 >> 172.21.15.6:0/1159593502 conn(0x56157304ef20 msgr2=0x56157307d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:27.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.635+0000 7f4d4155db80 1 -- 172.21.15.6:0/1159593502 shutdown_connections 2023-10-06T02:28:27.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.635+0000 7f4d4155db80 1 -- 172.21.15.6:0/1159593502 wait complete. 2023-10-06T02:28:27.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.635+0000 7f4d4155db80 20 client.10098 trim_cache size 0 max 16384 2023-10-06T02:28:27.644 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:27.644 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-06T02:28:27.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:28:27.644 INFO:teuthology.orchestra.run.smithi006.stdout: "damage_type": "dentry", 2023-10-06T02:28:27.644 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 477890390, 2023-10-06T02:28:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 1099511627776, 2023-10-06T02:28:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: "frag": "*", 2023-10-06T02:28:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: "dname": "sixmegs", 2023-10-06T02:28:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_id": "head", 2023-10-06T02:28:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/subdir/sixmegs" 2023-10-06T02:28:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:28:27.645 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-06T02:28:27.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.635+0000 7f4d37003700 1 -- 172.21.15.6:0/964788724 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d1c066f30 msgr2=0x7f4d1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.635+0000 7f4d37003700 1 --2- 172.21.15.6:0/964788724 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d1c066f30 0x7f4d1c0693e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f4d300b3850 tx=0x7f4d24007040 comp rx=0 tx=0).stop 2023-10-06T02:28:27.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.635+0000 7f4d37003700 1 -- 172.21.15.6:0/964788724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d18004d50 msgr2=0x7f4d301579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.635+0000 7f4d37003700 1 --2- 172.21.15.6:0/964788724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d18004d50 0x7f4d301579d0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f4d20011d70 tx=0x7f4d200091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.635+0000 7f4d37003700 1 -- 172.21.15.6:0/964788724 shutdown_connections 2023-10-06T02:28:27.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.635+0000 7f4d37003700 1 --2- 172.21.15.6:0/964788724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d300c3ac0 0x7f4d300c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.635+0000 7f4d37003700 1 --2- 172.21.15.6:0/964788724 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d1c066f30 0x7f4d1c0693e0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.635+0000 7f4d37003700 1 --2- 172.21.15.6:0/964788724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d18004d50 0x7f4d301579d0 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.635+0000 7f4d37003700 1 --2- 172.21.15.6:0/964788724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d300c6540 0x7f4d3016a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.635+0000 7f4d37003700 1 -- 172.21.15.6:0/964788724 >> 172.21.15.6:0/964788724 conn(0x7f4d300d0c10 msgr2=0x7f4d30158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:27.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.635+0000 7f4d37003700 1 -- 172.21.15.6:0/964788724 shutdown_connections 2023-10-06T02:28:27.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.635+0000 7f4d37003700 1 -- 172.21.15.6:0/964788724 wait complete. 2023-10-06T02:28:27.649 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap key 100.00000000:stray0_head' 2023-10-06T02:28:27.649 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:28:27.649 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:28:27.650 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:27.688 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:28:27.689 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:28:27.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:27.689 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:28:27.743 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:28:27.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.902+0000 7f0c11d9f700 1 Processor -- start 2023-10-06T02:28:27.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.902+0000 7f0c11d9f700 1 -- start start 2023-10-06T02:28:27.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.903+0000 7f0c11d9f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0c0c15cae0 0x7f0c0c0c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.903+0000 7f0c11d9f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0c0cc740 0x7f0c0c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.903+0000 7f0c11d9f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c0c06a1a0 con 0x7f0c0c06a910 2023-10-06T02:28:27.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.903+0000 7f0c11d9f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0c06a480 con 0x7f0c0c15cae0 2023-10-06T02:28:27.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.903+0000 7f0c11d9f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c0c3f40 con 0x7f0c0c0cc740 2023-10-06T02:28:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.903+0000 7f0c0affd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0c0c06a910 0x7f0c0c06ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50292/0 (socket says 172.21.15.6:50292) 2023-10-06T02:28:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.903+0000 7f0c0affd700 1 -- 172.21.15.6:0/655104412 learned_addr learned my addr 172.21.15.6:0/655104412 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.904+0000 7f0c0b7fe700 1 --2- 172.21.15.6:0/655104412 >> v2:172.21.15.175:3300/0 conn(0x7f0c0c15cae0 0x7f0c0c0c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.904+0000 7f0c0bfff700 1 --2- 172.21.15.6:0/655104412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0c0cc740 0x7f0c0c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.904+0000 7f0c0a7fc700 1 -- 172.21.15.6:0/655104412 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545264191 0 0) 0x7f0c0c06a1a0 con 0x7f0c0c06a910 2023-10-06T02:28:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.904+0000 7f0c0a7fc700 1 -- 172.21.15.6:0/655104412 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bf4003570 con 0x7f0c0c06a910 2023-10-06T02:28:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.904+0000 7f0c0b7fe700 1 -- 172.21.15.6:0/655104412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0c0cc740 msgr2=0x7f0c0c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.904+0000 7f0c0b7fe700 1 --2- 172.21.15.6:0/655104412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0c0cc740 0x7f0c0c0ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.904+0000 7f0c0b7fe700 1 -- 172.21.15.6:0/655104412 >> v1:172.21.15.6:6789/0 conn(0x7f0c0c06a910 legacy=0x7f0c0c06ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.904+0000 7f0c0b7fe700 1 -- 172.21.15.6:0/655104412 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c0c4220 con 0x7f0c0c15cae0 2023-10-06T02:28:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.904+0000 7f0c0b7fe700 1 --2- 172.21.15.6:0/655104412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c0c15cae0 0x7f0c0c0c8730 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc0098d0 tx=0x7f0bfc009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3db57239b011007 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.904+0000 7f0c0a7fc700 1 -- 172.21.15.6:0/655104412 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc005c10 con 0x7f0c0c15cae0 2023-10-06T02:28:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.904+0000 7f0c0a7fc700 1 -- 172.21.15.6:0/655104412 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bfc005d70 con 0x7f0c0c15cae0 2023-10-06T02:28:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.904+0000 7f0c0a7fc700 1 -- 172.21.15.6:0/655104412 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc006260 con 0x7f0c0c15cae0 2023-10-06T02:28:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.905+0000 7f0c11d9f700 1 -- 172.21.15.6:0/655104412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c0c15cae0 msgr2=0x7f0c0c0c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.905+0000 7f0c11d9f700 1 --2- 172.21.15.6:0/655104412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c0c15cae0 0x7f0c0c0c8730 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc0098d0 tx=0x7f0bfc009120 comp rx=0 tx=0).stop 2023-10-06T02:28:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.905+0000 7f0c11d9f700 1 -- 172.21.15.6:0/655104412 shutdown_connections 2023-10-06T02:28:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.905+0000 7f0c11d9f700 1 --2- 172.21.15.6:0/655104412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0c0cc740 0x7f0c0c0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.905+0000 7f0c11d9f700 1 --2- 172.21.15.6:0/655104412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c0c15cae0 0x7f0c0c0c8730 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.905+0000 7f0c11d9f700 1 -- 172.21.15.6:0/655104412 >> 172.21.15.6:0/655104412 conn(0x7f0c0c067910 msgr2=0x7f0c0c0ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.905+0000 7f0c11d9f700 1 -- 172.21.15.6:0/655104412 shutdown_connections 2023-10-06T02:28:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.905+0000 7f0c11d9f700 1 -- 172.21.15.6:0/655104412 wait complete. 2023-10-06T02:28:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.906+0000 7f0c11d9f700 1 Processor -- start 2023-10-06T02:28:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.906+0000 7f0c11d9f700 1 -- start start 2023-10-06T02:28:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.907+0000 7f0c11d9f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c0c06a910 0x7f0c0c16cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.907+0000 7f0c11d9f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0c0cc740 0x7f0c0c16af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.907+0000 7f0c11d9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c0c15cae0 0x7f0c0c154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.907+0000 7f0c11d9f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c14f8b0 con 0x7f0c0c15cae0 2023-10-06T02:28:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.907+0000 7f0c11d9f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c0b0eb0 con 0x7f0c0c06a910 2023-10-06T02:28:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.907+0000 7f0c11d9f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c0b1a30 con 0x7f0c0c0cc740 2023-10-06T02:28:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.907+0000 7f0c0bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c0c15cae0 0x7f0c0c154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.907+0000 7f0c0bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c0c15cae0 0x7f0c0c154d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46938/0 (socket says 172.21.15.6:46938) 2023-10-06T02:28:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.907+0000 7f0c0bfff700 1 -- 172.21.15.6:0/1872153557 learned_addr learned my addr 172.21.15.6:0/1872153557 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.907+0000 7f0c0b7fe700 1 --2- 172.21.15.6:0/1872153557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c0c06a910 0x7f0c0c16cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.907+0000 7f0c0affd700 1 --2- 172.21.15.6:0/1872153557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0c0cc740 0x7f0c0c16af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.907+0000 7f0c0bfff700 1 -- 172.21.15.6:0/1872153557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0c0cc740 msgr2=0x7f0c0c16af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.907+0000 7f0c0bfff700 1 --2- 172.21.15.6:0/1872153557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0c0cc740 0x7f0c0c16af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.907+0000 7f0c0bfff700 1 -- 172.21.15.6:0/1872153557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c0c06a910 msgr2=0x7f0c0c16cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:27.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.907+0000 7f0c0bfff700 1 --2- 172.21.15.6:0/1872153557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c0c06a910 0x7f0c0c16cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:27.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.907+0000 7f0c0bfff700 1 -- 172.21.15.6:0/1872153557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc0093c0 con 0x7f0c0c15cae0 2023-10-06T02:28:27.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.908+0000 7f0c0bfff700 1 --2- 172.21.15.6:0/1872153557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c0c15cae0 0x7f0c0c154d90 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009ec0 tx=0x7f0c0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:27.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.908+0000 7f0bf37fe700 1 -- 172.21.15.6:0/1872153557 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0400cb70 con 0x7f0c0c15cae0 2023-10-06T02:28:27.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.908+0000 7f0bf37fe700 1 -- 172.21.15.6:0/1872153557 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0400f040 con 0x7f0c0c15cae0 2023-10-06T02:28:27.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.908+0000 7f0bf37fe700 1 -- 172.21.15.6:0/1872153557 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04014480 con 0x7f0c0c15cae0 2023-10-06T02:28:27.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.908+0000 7f0c11d9f700 1 -- 172.21.15.6:0/1872153557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0c0b1100 con 0x7f0c0c15cae0 2023-10-06T02:28:27.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.908+0000 7f0c11d9f700 1 -- 172.21.15.6:0/1872153557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0c0b16c0 con 0x7f0c0c15cae0 2023-10-06T02:28:27.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.909+0000 7f0c11d9f700 1 -- 172.21.15.6:0/1872153557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0c068ba0 con 0x7f0c0c15cae0 2023-10-06T02:28:27.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.909+0000 7f0bf37fe700 1 -- 172.21.15.6:0/1872153557 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c04014830 con 0x7f0c0c15cae0 2023-10-06T02:28:27.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.910+0000 7f0bf37fe700 1 --2- 172.21.15.6:0/1872153557 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bf8066f30 0x7f0bf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:27.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.910+0000 7f0bf37fe700 1 -- 172.21.15.6:0/1872153557 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 9044+0+0 (secure 0 0 0) 0x7f0c04085be0 con 0x7f0c0c15cae0 2023-10-06T02:28:27.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.910+0000 7f0c0b7fe700 1 --2- 172.21.15.6:0/1872153557 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bf8066f30 0x7f0bf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:27.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.910+0000 7f0c0b7fe700 1 --2- 172.21.15.6:0/1872153557 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bf8066f30 0x7f0bf80693e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009160 tx=0x7f0bfc016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:27.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:27.914+0000 7f0bf37fe700 1 -- 172.21.15.6:0/1872153557 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c04052100 con 0x7f0c0c15cae0 2023-10-06T02:28:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.151+0000 7f0c11d9f700 1 -- 172.21.15.6:0/1872153557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0c0c06e590 con 0x7f0c0c15cae0 2023-10-06T02:28:28.154 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:28:28.152+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:28:28.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.156+0000 7f0bf37fe700 1 -- 172.21.15.6:0/1872153557 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v290) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0c04018090 con 0x7f0c0c15cae0 2023-10-06T02:28:28.160 INFO:tasks.ceph.mds.a.smithi006.stderr: -640> 2023-10-06T02:28:19.201+0000 7f79cef63700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:28:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.158+0000 7f0c11d9f700 1 -- 172.21.15.6:0/1872153557 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bf8066f30 msgr2=0x7f0bf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.158+0000 7f0c11d9f700 1 --2- 172.21.15.6:0/1872153557 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bf8066f30 0x7f0bf80693e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009160 tx=0x7f0bfc016000 comp rx=0 tx=0).stop 2023-10-06T02:28:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.158+0000 7f0c11d9f700 1 -- 172.21.15.6:0/1872153557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c0c15cae0 msgr2=0x7f0c0c154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.158+0000 7f0c11d9f700 1 --2- 172.21.15.6:0/1872153557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c0c15cae0 0x7f0c0c154d90 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009ec0 tx=0x7f0c0400b040 comp rx=0 tx=0).stop 2023-10-06T02:28:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.158+0000 7f0c11d9f700 1 -- 172.21.15.6:0/1872153557 shutdown_connections 2023-10-06T02:28:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.158+0000 7f0c11d9f700 1 --2- 172.21.15.6:0/1872153557 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0bf8066f30 0x7f0bf80693e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.158+0000 7f0c11d9f700 1 --2- 172.21.15.6:0/1872153557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c0c15cae0 0x7f0c0c154d90 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.158+0000 7f0c11d9f700 1 --2- 172.21.15.6:0/1872153557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c0c06a910 0x7f0c0c16cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.158+0000 7f0c11d9f700 1 --2- 172.21.15.6:0/1872153557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c0c0cc740 0x7f0c0c16af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.158+0000 7f0c11d9f700 1 -- 172.21.15.6:0/1872153557 >> 172.21.15.6:0/1872153557 conn(0x7f0c0c067910 msgr2=0x7f0c0c15bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.158+0000 7f0c11d9f700 1 -- 172.21.15.6:0/1872153557 shutdown_connections 2023-10-06T02:28:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.158+0000 7f0c11d9f700 1 -- 172.21.15.6:0/1872153557 wait complete. 2023-10-06T02:28:28.162 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:28:28.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:28:28.181 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:28:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.294+0000 7f9b0b698700 1 Processor -- start 2023-10-06T02:28:28.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.294+0000 7f9b0b698700 1 -- start start 2023-10-06T02:28:28.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.295+0000 7f9b0b698700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9b041574b0 0x7f9b040b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:28.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.295+0000 7f9b0b698700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9b040b13f0 0x7f9b040c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.295+0000 7f9b0b698700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b040c4510 0x7f9b040cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.295+0000 7f9b0b698700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b040c4970 con 0x7f9b041574b0 2023-10-06T02:28:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.295+0000 7f9b0b698700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b040c3b40 con 0x7f9b040b13f0 2023-10-06T02:28:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.295+0000 7f9b0b698700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040c2f30 con 0x7f9b040c4510 2023-10-06T02:28:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.295+0000 7f9b09434700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9b041574b0 0x7f9b040b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.295+0000 7f9b09434700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9b041574b0 0x7f9b040b0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46956/0 (socket says 172.21.15.6:46956) 2023-10-06T02:28:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.295+0000 7f9b09434700 1 -- 172.21.15.6:0/3580761039 learned_addr learned my addr 172.21.15.6:0/3580761039 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.295+0000 7f9b09c35700 1 --2- 172.21.15.6:0/3580761039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b040c4510 0x7f9b040cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.295+0000 7f9b08c33700 1 --2- 172.21.15.6:0/3580761039 >> v2:172.21.15.175:3300/0 conn(0x7f9b040b13f0 0x7f9b040c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.295+0000 7f9b09434700 1 -- 172.21.15.6:0/3580761039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b040c4510 msgr2=0x7f9b040cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.295+0000 7f9b09434700 1 --2- 172.21.15.6:0/3580761039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b040c4510 0x7f9b040cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.295+0000 7f9b09434700 1 -- 172.21.15.6:0/3580761039 >> v2:172.21.15.175:3300/0 conn(0x7f9b040b13f0 msgr2=0x7f9b040c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.295+0000 7f9b09434700 1 --2- 172.21.15.6:0/3580761039 >> v2:172.21.15.175:3300/0 conn(0x7f9b040b13f0 0x7f9b040c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.295+0000 7f9b09434700 1 -- 172.21.15.6:0/3580761039 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b040c3210 con 0x7f9b041574b0 2023-10-06T02:28:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.295+0000 7f9b08c33700 1 --2- 172.21.15.6:0/3580761039 >> v2:172.21.15.175:3300/0 conn(0x7f9b040b13f0 0x7f9b040c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.296+0000 7f9b09434700 1 --2- 172.21.15.6:0/3580761039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b041574b0 0x7f9b040b0eb0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f9b0406f050 tx=0x7f9b00009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a18624965595859 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.296+0000 7f9afbfff700 1 -- 172.21.15.6:0/3580761039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0000e070 con 0x7f9b041574b0 2023-10-06T02:28:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.296+0000 7f9afbfff700 1 -- 172.21.15.6:0/3580761039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0000bad0 con 0x7f9b041574b0 2023-10-06T02:28:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.296+0000 7f9afbfff700 1 -- 172.21.15.6:0/3580761039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b000092e0 con 0x7f9b041574b0 2023-10-06T02:28:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.296+0000 7f9b0b698700 1 -- 172.21.15.6:0/3580761039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b041574b0 msgr2=0x7f9b040b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.296+0000 7f9b0b698700 1 --2- 172.21.15.6:0/3580761039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b041574b0 0x7f9b040b0eb0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f9b0406f050 tx=0x7f9b00009840 comp rx=0 tx=0).stop 2023-10-06T02:28:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.296+0000 7f9b0b698700 1 -- 172.21.15.6:0/3580761039 shutdown_connections 2023-10-06T02:28:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.296+0000 7f9b0b698700 1 --2- 172.21.15.6:0/3580761039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b040c4510 0x7f9b040cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.296+0000 7f9b0b698700 1 --2- 172.21.15.6:0/3580761039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b041574b0 0x7f9b040b0eb0 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.296+0000 7f9b0b698700 1 --2- 172.21.15.6:0/3580761039 >> v2:172.21.15.175:3300/0 conn(0x7f9b040b13f0 0x7f9b040c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.296+0000 7f9b0b698700 1 -- 172.21.15.6:0/3580761039 >> 172.21.15.6:0/3580761039 conn(0x7f9b04067910 msgr2=0x7f9b040ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.296+0000 7f9b0b698700 1 -- 172.21.15.6:0/3580761039 shutdown_connections 2023-10-06T02:28:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.296+0000 7f9b0b698700 1 -- 172.21.15.6:0/3580761039 wait complete. 2023-10-06T02:28:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.297+0000 7f9b0b698700 1 Processor -- start 2023-10-06T02:28:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.297+0000 7f9b0b698700 1 -- start start 2023-10-06T02:28:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.298+0000 7f9b0b698700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b040b13f0 0x7f9b04153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.298+0000 7f9b0b698700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b040c4510 0x7f9b04167710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.298+0000 7f9b0b698700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b041574b0 0x7f9b04155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.298+0000 7f9b0b698700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0415be90 con 0x7f9b041574b0 2023-10-06T02:28:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.298+0000 7f9b0b698700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b04154630 con 0x7f9b040b13f0 2023-10-06T02:28:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.298+0000 7f9b0b698700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040c5240 con 0x7f9b040c4510 2023-10-06T02:28:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.298+0000 7f9b09c35700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b041574b0 0x7f9b04155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.298+0000 7f9b09c35700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b041574b0 0x7f9b04155540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46960/0 (socket says 172.21.15.6:46960) 2023-10-06T02:28:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.299+0000 7f9b09c35700 1 -- 172.21.15.6:0/3976684608 learned_addr learned my addr 172.21.15.6:0/3976684608 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.299+0000 7f9b08c33700 1 --2- 172.21.15.6:0/3976684608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b040c4510 0x7f9b04167710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.299+0000 7f9b09434700 1 --2- 172.21.15.6:0/3976684608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b040b13f0 0x7f9b04153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.299+0000 7f9b09c35700 1 -- 172.21.15.6:0/3976684608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b040c4510 msgr2=0x7f9b04167710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.299+0000 7f9b09c35700 1 --2- 172.21.15.6:0/3976684608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b040c4510 0x7f9b04167710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.299+0000 7f9b09c35700 1 -- 172.21.15.6:0/3976684608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b040b13f0 msgr2=0x7f9b04153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.299+0000 7f9b09c35700 1 --2- 172.21.15.6:0/3976684608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b040b13f0 0x7f9b04153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.299+0000 7f9b09c35700 1 -- 172.21.15.6:0/3976684608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b00009ae0 con 0x7f9b041574b0 2023-10-06T02:28:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.299+0000 7f9b09434700 1 --2- 172.21.15.6:0/3976684608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b040b13f0 0x7f9b04153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.299+0000 7f9b09c35700 1 --2- 172.21.15.6:0/3976684608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b041574b0 0x7f9b04155540 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00d890 tx=0x7f9afc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.299+0000 7f9af97fa700 1 -- 172.21.15.6:0/3976684608 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0125f0 con 0x7f9b041574b0 2023-10-06T02:28:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.299+0000 7f9af97fa700 1 -- 172.21.15.6:0/3976684608 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc012770 con 0x7f9b041574b0 2023-10-06T02:28:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.299+0000 7f9b0b698700 1 -- 172.21.15.6:0/3976684608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b040c5520 con 0x7f9b041574b0 2023-10-06T02:28:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.299+0000 7f9af97fa700 1 -- 172.21.15.6:0/3976684608 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc012b30 con 0x7f9b041574b0 2023-10-06T02:28:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.299+0000 7f9b0b698700 1 -- 172.21.15.6:0/3976684608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b040c5ae0 con 0x7f9b041574b0 2023-10-06T02:28:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.300+0000 7f9b0b698700 1 -- 172.21.15.6:0/3976684608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b0406e590 con 0x7f9b041574b0 2023-10-06T02:28:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.301+0000 7f9af97fa700 1 -- 172.21.15.6:0/3976684608 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9afc01e460 con 0x7f9b041574b0 2023-10-06T02:28:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.301+0000 7f9af97fa700 1 --2- 172.21.15.6:0/3976684608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ae8066f30 0x7f9ae80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.301+0000 7f9af97fa700 1 -- 172.21.15.6:0/3976684608 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 9130+0+0 (secure 0 0 0) 0x7f9afc0858a0 con 0x7f9b041574b0 2023-10-06T02:28:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.301+0000 7f9b09434700 1 --2- 172.21.15.6:0/3976684608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ae8066f30 0x7f9ae80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.302+0000 7f9b09434700 1 --2- 172.21.15.6:0/3976684608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ae8066f30 0x7f9ae80693e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009fd0 tx=0x7f9b00018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.306+0000 7f9af97fa700 1 -- 172.21.15.6:0/3976684608 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9afc051d70 con 0x7f9b041574b0 2023-10-06T02:28:28.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:28.583+0000 7f9b0b698700 1 -- 172.21.15.6:0/3976684608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f9b040c34f0 con 0x7f9b041574b0 2023-10-06T02:28:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.159+0000 7f9af97fa700 1 -- 172.21.15.6:0/3976684608 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v291) v1 ==== 107+0+0 (secure 0 0 0) 0x7f9afc055390 con 0x7f9b041574b0 2023-10-06T02:28:29.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.162+0000 7f9b0b698700 1 -- 172.21.15.6:0/3976684608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ae8066f30 msgr2=0x7f9ae80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.162+0000 7f9b0b698700 1 --2- 172.21.15.6:0/3976684608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ae8066f30 0x7f9ae80693e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009fd0 tx=0x7f9b00018000 comp rx=0 tx=0).stop 2023-10-06T02:28:29.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.162+0000 7f9b0b698700 1 -- 172.21.15.6:0/3976684608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b041574b0 msgr2=0x7f9b04155540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.162+0000 7f9b0b698700 1 --2- 172.21.15.6:0/3976684608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b041574b0 0x7f9b04155540 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00d890 tx=0x7f9afc008040 comp rx=0 tx=0).stop 2023-10-06T02:28:29.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.162+0000 7f9b0b698700 1 -- 172.21.15.6:0/3976684608 shutdown_connections 2023-10-06T02:28:29.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.162+0000 7f9b0b698700 1 --2- 172.21.15.6:0/3976684608 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ae8066f30 0x7f9ae80693e0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.162+0000 7f9b0b698700 1 --2- 172.21.15.6:0/3976684608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b041574b0 0x7f9b04155540 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.162+0000 7f9b0b698700 1 --2- 172.21.15.6:0/3976684608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b040b13f0 0x7f9b04153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.162+0000 7f9b0b698700 1 --2- 172.21.15.6:0/3976684608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b040c4510 0x7f9b04167710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.162+0000 7f9b0b698700 1 -- 172.21.15.6:0/3976684608 >> 172.21.15.6:0/3976684608 conn(0x7f9b04067910 msgr2=0x7f9b04159890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:29.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.162+0000 7f9b0b698700 1 -- 172.21.15.6:0/3976684608 shutdown_connections 2023-10-06T02:28:29.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.162+0000 7f9b0b698700 1 -- 172.21.15.6:0/3976684608 wait complete. 2023-10-06T02:28:29.165 INFO:teuthology.orchestra.run.smithi006.stderr:nothing to do: rank is not damaged 2023-10-06T02:28:29.177 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:28:29.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.255+0000 7f31f7141000 1 Processor -- start 2023-10-06T02:28:29.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.255+0000 7f31f7141000 1 -- start start 2023-10-06T02:28:29.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.256+0000 7f31f7141000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56148ce82dd0 0x56148ce9aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.256+0000 7f31f7141000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56148cf0b3b0 0x56148cf09ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.256+0000 7f31f7141000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56148cf299b0 0x56148cf319c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.256+0000 7f31f7141000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56148cd9e980 con 0x56148cf0b3b0 2023-10-06T02:28:29.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.256+0000 7f31f7141000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56148cd9e620 con 0x56148cf299b0 2023-10-06T02:28:29.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.256+0000 7f31f7141000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56148cd95400 con 0x56148ce82dd0 2023-10-06T02:28:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.256+0000 7f31efb7b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56148cf0b3b0 0x56148cf09ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.256+0000 7f31efb7b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56148cf0b3b0 0x56148cf09ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47928/0 (socket says 172.21.15.6:47928) 2023-10-06T02:28:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.256+0000 7f31efb7b700 1 -- 172.21.15.6:0/2245551395 learned_addr learned my addr 172.21.15.6:0/2245551395 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.256+0000 7f31f0b7d700 1 --2- 172.21.15.6:0/2245551395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56148cf299b0 0x56148cf319c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.256+0000 7f31f037c700 1 --2- 172.21.15.6:0/2245551395 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56148ce82dd0 0x56148ce9aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.256+0000 7f31efb7b700 1 -- 172.21.15.6:0/2245551395 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56148ce82dd0 msgr2=0x56148ce9aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:29.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.256+0000 7f31efb7b700 1 --2- 172.21.15.6:0/2245551395 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56148ce82dd0 0x56148ce9aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.256+0000 7f31efb7b700 1 -- 172.21.15.6:0/2245551395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56148cf299b0 msgr2=0x56148cf319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:29.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.256+0000 7f31efb7b700 1 --2- 172.21.15.6:0/2245551395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56148cf299b0 0x56148cf319c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.256+0000 7f31efb7b700 1 -- 172.21.15.6:0/2245551395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e0005cf0 con 0x56148cf0b3b0 2023-10-06T02:28:29.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.256+0000 7f31f037c700 1 --2- 172.21.15.6:0/2245551395 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56148ce82dd0 0x56148ce9aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.257+0000 7f31efb7b700 1 --2- 172.21.15.6:0/2245551395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56148cf0b3b0 0x56148cf09ca0 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f31e000ada0 tx=0x7f31e0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84019460f7bfe4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.257+0000 7f31eeb79700 1 -- 172.21.15.6:0/2245551395 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0000bc0 con 0x56148cf0b3b0 2023-10-06T02:28:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.257+0000 7f31eeb79700 1 -- 172.21.15.6:0/2245551395 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e0020070 con 0x56148cf0b3b0 2023-10-06T02:28:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.257+0000 7f31eeb79700 1 -- 172.21.15.6:0/2245551395 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0027480 con 0x56148cf0b3b0 2023-10-06T02:28:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.257+0000 7f31f7141000 1 -- 172.21.15.6:0/2245551395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56148cf0b3b0 msgr2=0x56148cf09ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.257+0000 7f31f7141000 1 --2- 172.21.15.6:0/2245551395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56148cf0b3b0 0x56148cf09ca0 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f31e000ada0 tx=0x7f31e0013000 comp rx=0 tx=0).stop 2023-10-06T02:28:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.257+0000 7f31f7141000 1 -- 172.21.15.6:0/2245551395 shutdown_connections 2023-10-06T02:28:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.257+0000 7f31f7141000 1 --2- 172.21.15.6:0/2245551395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56148cf299b0 0x56148cf319c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.257+0000 7f31f7141000 1 --2- 172.21.15.6:0/2245551395 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56148ce82dd0 0x56148ce9aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.257+0000 7f31f7141000 1 --2- 172.21.15.6:0/2245551395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56148cf0b3b0 0x56148cf09ca0 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.257+0000 7f31f7141000 1 -- 172.21.15.6:0/2245551395 >> 172.21.15.6:0/2245551395 conn(0x56148ce53d50 msgr2=0x56148ce56130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.257+0000 7f31f7141000 1 -- 172.21.15.6:0/2245551395 shutdown_connections 2023-10-06T02:28:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.257+0000 7f31f7141000 1 -- 172.21.15.6:0/2245551395 wait complete. 2023-10-06T02:28:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.258+0000 7f31f7141000 1 Processor -- start 2023-10-06T02:28:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.258+0000 7f31f7141000 1 -- start start 2023-10-06T02:28:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f7141000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56148ce82dd0 0x56148cf194e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f7141000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56148cf0b3b0 0x56148cf1bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f7141000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56148cf299b0 0x56148cf169a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f7141000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56148cf17270 con 0x56148ce82dd0 2023-10-06T02:28:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f7141000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56148cf17510 con 0x56148cf0b3b0 2023-10-06T02:28:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f7141000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56148cf177b0 con 0x56148cf299b0 2023-10-06T02:28:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f037c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56148ce82dd0 0x56148cf194e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f037c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56148ce82dd0 0x56148cf194e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47940/0 (socket says 172.21.15.6:47940) 2023-10-06T02:28:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 learned_addr learned my addr 172.21.15.6:0/1602037446 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31efb7b700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56148cf0b3b0 0x56148cf1bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f0b7d700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56148cf299b0 0x56148cf169a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56148cf299b0 msgr2=0x56148cf169a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f037c700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56148cf299b0 0x56148cf169a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56148cf0b3b0 msgr2=0x56148cf1bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f037c700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56148cf0b3b0 0x56148cf1bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56148cdc71c0 con 0x56148ce82dd0 2023-10-06T02:28:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f037c700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56148ce82dd0 0x56148cf194e0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f31e4007910 tx=0x7f31e4005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31ed376700 1 -- 172.21.15.6:0/1602037446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e4010070 con 0x56148ce82dd0 2023-10-06T02:28:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31ed376700 1 -- 172.21.15.6:0/1602037446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e4006650 con 0x56148ce82dd0 2023-10-06T02:28:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56148cdad3d0 con 0x56148ce82dd0 2023-10-06T02:28:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31ed376700 1 -- 172.21.15.6:0/1602037446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e40069f0 con 0x56148ce82dd0 2023-10-06T02:28:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.259+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56148cda0ae0 con 0x56148ce82dd0 2023-10-06T02:28:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.261+0000 7f31ed376700 1 -- 172.21.15.6:0/1602037446 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31e4009430 con 0x56148ce82dd0 2023-10-06T02:28:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.261+0000 7f31ed376700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f31dc0658c0 0x7f31dc067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.261+0000 7f31ed376700 1 -- 172.21.15.6:0/1602037446 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 9130+0+0 (secure 0 0 0) 0x7f31e4083990 con 0x56148ce82dd0 2023-10-06T02:28:29.269 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:28:29.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.261+0000 7f31efb7b700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f31dc0658c0 0x7f31dc067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.261+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56148ce9c010 0x56148cf18190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.261+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf186d0 con 0x56148ce9c010 2023-10-06T02:28:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.262+0000 7f31f0b7d700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56148ce9c010 0x56148cf18190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.262+0000 7f31f0b7d700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56148ce9c010 0x56148cf18190 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.262+0000 7f31efb7b700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f31dc0658c0 0x7f31dc067d70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f31e000c010 tx=0x7f31e001e070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.264+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v127'971 uv944 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.264+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf18ab0 con 0x56148ce9c010 2023-10-06T02:28:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.266+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v127'972 uv972 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.266+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf450e0 con 0x56148ce9c010 2023-10-06T02:28:29.272 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:28:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.268+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v127'973 uv973 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.268+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf464a0 con 0x56148ce9c010 2023-10-06T02:28:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.270+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v127'974 uv974 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.270+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf46850 con 0x56148ce9c010 2023-10-06T02:28:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.271+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v127'975 uv975 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.271+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45490 con 0x56148ce9c010 2023-10-06T02:28:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.272+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v127'976 uv976 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.272+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf458c0 con 0x56148ce9c010 2023-10-06T02:28:29.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.273+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v127'977 uv950 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.273+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45cc0 con 0x56148ce9c010 2023-10-06T02:28:29.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.275+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v127'978 uv978 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.275+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45cc0 con 0x56148ce9c010 2023-10-06T02:28:29.277 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:28:29.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.276+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v127'979 uv979 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.276+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf460c0 con 0x56148ce9c010 2023-10-06T02:28:29.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.277+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v127'980 uv980 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.277+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.278+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v127'981 uv981 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.278+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.279+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v127'982 uv982 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.279+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.280+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v127'983 uv970 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.280+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.281+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v127'984 uv984 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.281+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.283+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v127'985 uv985 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.284 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:28:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.283+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.284+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v127'986 uv986 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.284+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.285+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v127'987 uv987 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.285+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.286+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v127'988 uv988 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.287+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.289+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v127'989 uv989 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.289+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.290+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v127'990 uv963 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.291+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.292+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v127'991 uv991 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.292+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.293+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v127'992 uv992 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.295 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:28:29.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.293+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.294+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v127'993 uv993 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.294+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.295+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v127'994 uv994 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.295+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.297+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v127'995 uv995 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.297+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.298+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v127'996 uv969 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.298+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.299+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v127'997 uv997 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.299+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.300+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v127'998 uv998 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.302 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:28:29.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.300+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.302+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v127'999 uv999 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.302+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.303+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v127'1000 uv1000 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.303+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148ce9c010 2023-10-06T02:28:29.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.304+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v127'1001 uv1001 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148ce9c010 2023-10-06T02:28:29.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.304+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56148cf46050 0x56148cf49120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.304+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf45c70 con 0x56148cf46050 2023-10-06T02:28:29.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.304+0000 7f31f037c700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56148cf46050 0x56148cf49120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.305+0000 7f31f037c700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56148cf46050 0x56148cf49120 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:29.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.306+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v127'697 uv677 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.306+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf49660 con 0x56148cf46050 2023-10-06T02:28:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.308+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v127'698 uv698 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.308+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf49ae0 con 0x56148cf46050 2023-10-06T02:28:29.310 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:28:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.309+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v127'699 uv699 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.309+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4a3f0 con 0x56148cf46050 2023-10-06T02:28:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.310+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v127'700 uv700 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.310+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf49f80 con 0x56148cf46050 2023-10-06T02:28:29.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.311+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v127'701 uv701 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.311+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4ac90 con 0x56148cf46050 2023-10-06T02:28:29.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.312+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v127'702 uv696 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.312+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4b040 con 0x56148cf46050 2023-10-06T02:28:29.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.313+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v127'703 uv703 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.313+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4b3f0 con 0x56148cf46050 2023-10-06T02:28:29.316 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:28:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.314+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v127'704 uv704 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.314+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4b3f0 con 0x56148cf46050 2023-10-06T02:28:29.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.315+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v127'705 uv705 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.315+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4b3f0 con 0x56148cf46050 2023-10-06T02:28:29.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.317+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v127'706 uv706 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.317+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4b3f0 con 0x56148cf46050 2023-10-06T02:28:29.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.318+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v127'707 uv695 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.318+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4b3f0 con 0x56148cf46050 2023-10-06T02:28:29.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.319+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v127'708 uv708 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.319+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4b3f0 con 0x56148cf46050 2023-10-06T02:28:29.321 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:28:29.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.320+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v127'709 uv709 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.320+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4eb10 con 0x56148cf46050 2023-10-06T02:28:29.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.321+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v127'710 uv710 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.321+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4eb10 con 0x56148cf46050 2023-10-06T02:28:29.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.323+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v127'711 uv711 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.323+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4b3f0 con 0x56148cf46050 2023-10-06T02:28:29.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.324+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v127'712 uv693 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.324+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4b3f0 con 0x56148cf46050 2023-10-06T02:28:29.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.325+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v127'713 uv713 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.325+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4b3f0 con 0x56148cf46050 2023-10-06T02:28:29.327 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:28:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.326+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v127'714 uv714 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.326+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4c400 con 0x56148cf46050 2023-10-06T02:28:29.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.327+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v127'715 uv715 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.327+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4c400 con 0x56148cf46050 2023-10-06T02:28:29.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.328+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v127'716 uv716 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.328+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4b3f0 con 0x56148cf46050 2023-10-06T02:28:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.329+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v127'717 uv717 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.329+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56148cf4b900 0x56148cf4dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.329+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4e2b0 con 0x56148cf4b900 2023-10-06T02:28:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.329+0000 7f31efb7b700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56148cf4b900 0x56148cf4dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.330+0000 7f31efb7b700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56148cf4b900 0x56148cf4dce0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.331+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v127'189 uv188 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.331+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4e760 con 0x56148cf4b900 2023-10-06T02:28:29.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.332+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v127'190 uv190 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.332+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4ece0 con 0x56148cf4b900 2023-10-06T02:28:29.334 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:28:29.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.333+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v127'191 uv191 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.333+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4a8c0 con 0x56148cf4b900 2023-10-06T02:28:29.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.334+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v127'192 uv192 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.334+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf50720 con 0x56148cf4b900 2023-10-06T02:28:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.335+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v127'193 uv193 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.335+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4f5d0 con 0x56148cf4b900 2023-10-06T02:28:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.337+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v127'194 uv194 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.337+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4f5d0 con 0x56148cf4b900 2023-10-06T02:28:29.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.338+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v127'135 uv134 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.338+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4f5d0 con 0x56148cf4b900 2023-10-06T02:28:29.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.339+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v127'136 uv136 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.339+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4f5d0 con 0x56148cf4b900 2023-10-06T02:28:29.341 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:28:29.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.340+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v127'137 uv137 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.340+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4fb00 con 0x56148cf4b900 2023-10-06T02:28:29.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.341+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v127'138 uv138 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.341+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4fb00 con 0x56148cf46050 2023-10-06T02:28:29.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.342+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v127'189 uv188 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.342+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4fb00 con 0x56148cf46050 2023-10-06T02:28:29.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.343+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v127'190 uv190 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.343+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4fb00 con 0x56148cf46050 2023-10-06T02:28:29.346 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:28:29.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.344+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v127'191 uv191 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.344+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4fb00 con 0x56148cf46050 2023-10-06T02:28:29.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.345+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v127'192 uv192 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.345+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4fb00 con 0x56148cf46050 2023-10-06T02:28:29.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.346+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v127'193 uv193 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.346+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf4fb00 con 0x56148cf46050 2023-10-06T02:28:29.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.347+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v127'194 uv194 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf46050 2023-10-06T02:28:29.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.347+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56148cf4fb00 0x56148cf52b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.347+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf53090 con 0x56148cf4fb00 2023-10-06T02:28:29.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.347+0000 7f31f0b7d700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56148cf4fb00 0x56148cf52b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.348+0000 7f31f0b7d700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56148cf4fb00 0x56148cf52b50 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:29.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.349+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v127'349 uv343 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf4fb00 2023-10-06T02:28:29.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.349+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf53090 con 0x56148cf4fb00 2023-10-06T02:28:29.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.351+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v127'350 uv350 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf4fb00 2023-10-06T02:28:29.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.351+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf53090 con 0x56148cf4fb00 2023-10-06T02:28:29.353 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:28:29.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.352+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v127'351 uv351 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf4fb00 2023-10-06T02:28:29.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.352+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf540a0 con 0x56148cf4fb00 2023-10-06T02:28:29.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.353+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v127'352 uv352 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf4fb00 2023-10-06T02:28:29.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.353+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf540a0 con 0x56148cf4fb00 2023-10-06T02:28:29.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.354+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v127'353 uv353 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf4fb00 2023-10-06T02:28:29.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.354+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf53090 con 0x56148cf4fb00 2023-10-06T02:28:29.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.355+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v127'354 uv354 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf4fb00 2023-10-06T02:28:29.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.355+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf53090 con 0x56148cf4fb00 2023-10-06T02:28:29.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.356+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v127'355 uv348 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf4fb00 2023-10-06T02:28:29.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.356+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf53090 con 0x56148cf4fb00 2023-10-06T02:28:29.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.357+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v127'356 uv356 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf4fb00 2023-10-06T02:28:29.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.357+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf53090 con 0x56148cf4fb00 2023-10-06T02:28:29.360 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:28:29.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.358+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v127'357 uv357 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf4fb00 2023-10-06T02:28:29.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.358+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf53090 con 0x56148cf4fb00 2023-10-06T02:28:29.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.360+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v127'358 uv358 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf4fb00 2023-10-06T02:28:29.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.360+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf53490 con 0x56148cf4fb00 2023-10-06T02:28:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.361+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v127'359 uv359 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf4fb00 2023-10-06T02:28:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.361+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56148cf539a0 0x56148cf55d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.361+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf56300 con 0x56148cf539a0 2023-10-06T02:28:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.361+0000 7f31f037c700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56148cf539a0 0x56148cf55d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.361+0000 7f31f037c700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56148cf539a0 0x56148cf55d80 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:29.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.363+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v127'158 uv157 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf539a0 2023-10-06T02:28:29.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.363+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf566e0 con 0x56148cf539a0 2023-10-06T02:28:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.364+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v127'159 uv159 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf539a0 2023-10-06T02:28:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.364+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf566e0 con 0x56148cf539a0 2023-10-06T02:28:29.366 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:28:29.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.365+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v127'160 uv160 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf539a0 2023-10-06T02:28:29.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.365+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf566e0 con 0x56148cf539a0 2023-10-06T02:28:29.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.367+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v127'161 uv161 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf539a0 2023-10-06T02:28:29.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.367+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf566e0 con 0x56148cf539a0 2023-10-06T02:28:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.367+0000 7f31f037c700 1 -- 172.21.15.6:0/1602037446 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v127'162 uv162 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f31e4051f70 con 0x56148cf539a0 2023-10-06T02:28:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.367+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf566e0 con 0x56148cf4b900 2023-10-06T02:28:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.369+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v127'189 uv188 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.369+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf566e0 con 0x56148cf4b900 2023-10-06T02:28:29.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.370+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v127'190 uv190 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.370+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf566e0 con 0x56148cf4b900 2023-10-06T02:28:29.372 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:28:29.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.371+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v127'191 uv191 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.371+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf576f0 con 0x56148cf4b900 2023-10-06T02:28:29.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.372+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v127'192 uv192 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.372+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf576f0 con 0x56148cf4b900 2023-10-06T02:28:29.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.373+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v127'193 uv193 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.373+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf566e0 con 0x56148cf4b900 2023-10-06T02:28:29.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.374+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v127'194 uv194 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.374+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56148cf56d60 0x56148cf59140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.374+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59760 con 0x56148cf56d60 2023-10-06T02:28:29.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.374+0000 7f31efb7b700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56148cf56d60 0x56148cf59140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.374+0000 7f31efb7b700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56148cf56d60 0x56148cf59140 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.375+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v127'314 uv308 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf56d60 2023-10-06T02:28:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.375+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59b40 con 0x56148cf56d60 2023-10-06T02:28:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.377+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v127'315 uv315 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf56d60 2023-10-06T02:28:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.377+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59b40 con 0x56148cf56d60 2023-10-06T02:28:29.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.378+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v127'316 uv316 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf56d60 2023-10-06T02:28:29.379 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:28:29.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.378+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59b40 con 0x56148cf56d60 2023-10-06T02:28:29.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.379+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v127'317 uv317 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf56d60 2023-10-06T02:28:29.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.379+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59b40 con 0x56148cf56d60 2023-10-06T02:28:29.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.380+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v127'318 uv318 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf56d60 2023-10-06T02:28:29.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.380+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59b40 con 0x56148cf56d60 2023-10-06T02:28:29.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.381+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v127'319 uv313 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf56d60 2023-10-06T02:28:29.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.381+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59b40 con 0x56148cf56d60 2023-10-06T02:28:29.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.382+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v127'320 uv320 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf56d60 2023-10-06T02:28:29.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.382+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59b40 con 0x56148cf56d60 2023-10-06T02:28:29.385 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:28:29.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.383+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v127'321 uv321 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf56d60 2023-10-06T02:28:29.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.383+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59b40 con 0x56148cf56d60 2023-10-06T02:28:29.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.384+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v127'322 uv322 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf56d60 2023-10-06T02:28:29.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.384+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5c8b0 con 0x56148cf56d60 2023-10-06T02:28:29.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.386+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v127'323 uv323 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf56d60 2023-10-06T02:28:29.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.386+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5a030 con 0x56148cf4b900 2023-10-06T02:28:29.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.387+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v127'137 uv135 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.387+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5a030 con 0x56148cf4b900 2023-10-06T02:28:29.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.388+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v127'138 uv138 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.388+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5a030 con 0x56148cf4b900 2023-10-06T02:28:29.390 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:28:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.389+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v127'139 uv139 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.389+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5a030 con 0x56148cf4b900 2023-10-06T02:28:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.390+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v127'140 uv140 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.390+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56148cf5a540 0x56148cf5a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.390+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5d000 con 0x56148cf5a540 2023-10-06T02:28:29.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.390+0000 7f31f0b7d700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56148cf5a540 0x56148cf5a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.390+0000 7f31f0b7d700 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56148cf5a540 0x56148cf5a950 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:29.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.392+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v127'189 uv188 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf5a540 2023-10-06T02:28:29.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.392+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5d000 con 0x56148cf5a540 2023-10-06T02:28:29.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.393+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v127'190 uv190 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf5a540 2023-10-06T02:28:29.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.393+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5d000 con 0x56148cf5a540 2023-10-06T02:28:29.395 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:28:29.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.393+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v127'191 uv191 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf5a540 2023-10-06T02:28:29.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.394+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5e010 con 0x56148cf5a540 2023-10-06T02:28:29.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.395+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v127'192 uv192 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf5a540 2023-10-06T02:28:29.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.395+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5e010 con 0x56148cf5a540 2023-10-06T02:28:29.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.396+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v127'193 uv193 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf5a540 2023-10-06T02:28:29.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.396+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5d000 con 0x56148cf5a540 2023-10-06T02:28:29.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.397+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v127'194 uv194 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf5a540 2023-10-06T02:28:29.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.397+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5d000 con 0x56148cf4fb00 2023-10-06T02:28:29.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.398+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v127'161 uv160 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf4fb00 2023-10-06T02:28:29.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.398+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5d000 con 0x56148cf4fb00 2023-10-06T02:28:29.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.399+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v127'162 uv162 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf4fb00 2023-10-06T02:28:29.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.399+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5d000 con 0x56148cf4fb00 2023-10-06T02:28:29.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.400+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v127'163 uv163 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf4fb00 2023-10-06T02:28:29.401 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:28:29.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.400+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59c00 con 0x56148cf4fb00 2023-10-06T02:28:29.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.401+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v127'164 uv164 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf4fb00 2023-10-06T02:28:29.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.401+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59c00 con 0x56148cf4fb00 2023-10-06T02:28:29.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.402+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v127'165 uv165 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f31e8010250 con 0x56148cf4fb00 2023-10-06T02:28:29.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.402+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59c00 con 0x56148cf4b900 2023-10-06T02:28:29.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.404+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v127'389 uv380 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.404+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59c00 con 0x56148cf4b900 2023-10-06T02:28:29.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.405+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v127'390 uv390 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.405+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59c00 con 0x56148cf4b900 2023-10-06T02:28:29.407 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:28:29.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.406+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v127'391 uv391 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.406+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59c00 con 0x56148cf4b900 2023-10-06T02:28:29.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.407+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v127'392 uv392 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.407+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5d5b0 con 0x56148cf4b900 2023-10-06T02:28:29.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.408+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v127'393 uv393 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.408+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5d5b0 con 0x56148cf4b900 2023-10-06T02:28:29.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.410+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v127'394 uv387 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.410+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59c00 con 0x56148cf4b900 2023-10-06T02:28:29.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.411+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v127'395 uv395 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.411+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59c00 con 0x56148cf4b900 2023-10-06T02:28:29.413 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:28:29.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.411+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v127'396 uv396 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.411+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59c00 con 0x56148cf4b900 2023-10-06T02:28:29.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.412+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v127'397 uv397 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.412+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf59c00 con 0x56148cf4b900 2023-10-06T02:28:29.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.413+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v127'398 uv398 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.414+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5d4f0 con 0x56148cf4b900 2023-10-06T02:28:29.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.415+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v127'399 uv399 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.415+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x56148cf5d910 con 0x56148cf4b900 2023-10-06T02:28:29.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31efb7b700 1 -- 172.21.15.6:0/1602037446 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v127'400 uv400 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f31e002f070 con 0x56148cf4b900 2023-10-06T02:28:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56148cf4b900 msgr2=0x56148cf4dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56148cf4b900 0x56148cf4dce0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56148ce9c010 msgr2=0x56148cf18190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56148ce9c010 0x56148cf18190 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56148cf56d60 msgr2=0x56148cf59140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56148cf56d60 0x56148cf59140 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56148cf46050 msgr2=0x56148cf49120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56148cf46050 0x56148cf49120 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56148cf5a540 msgr2=0x56148cf5a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56148cf5a540 0x56148cf5a950 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56148cf539a0 msgr2=0x56148cf55d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56148cf539a0 0x56148cf55d80 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 reap_dead start 2023-10-06T02:28:29.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f0b7d700 1 -- 172.21.15.6:0/1602037446 reap_dead start 2023-10-06T02:28:29.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56148cf4fb00 msgr2=0x56148cf52b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56148cf4fb00 0x56148cf52b50 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f31dc0658c0 msgr2=0x7f31dc067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f31dc0658c0 0x7f31dc067d70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f31e000c010 tx=0x7f31e001e070 comp rx=0 tx=0).stop 2023-10-06T02:28:29.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56148ce82dd0 msgr2=0x56148cf194e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56148ce82dd0 0x56148cf194e0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f31e4007910 tx=0x7f31e4005dc0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 shutdown_connections 2023-10-06T02:28:29.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56148ce82dd0 0x56148cf194e0 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 --2- 172.21.15.6:0/1602037446 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f31dc0658c0 0x7f31dc067d70 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 >> 172.21.15.6:0/1602037446 conn(0x56148ce53d50 msgr2=0x56148ce56130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:29.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 shutdown_connections 2023-10-06T02:28:29.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.416+0000 7f31f7141000 1 -- 172.21.15.6:0/1602037446 wait complete. 2023-10-06T02:28:29.423 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 100.00000000 stray0_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2023-10-06T02:28:29.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.503+0000 7f3904f33000 1 Processor -- start 2023-10-06T02:28:29.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.503+0000 7f3904f33000 1 -- start start 2023-10-06T02:28:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.503+0000 7f3904f33000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e9e2bd670 0x564e9e347ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.503+0000 7f3904f33000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e365b10 0x564e9e348430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.503+0000 7f3904f33000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e9e368c90 0x564e9e28ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.503+0000 7f3904f33000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9e1db980 con 0x564e9e2bd670 2023-10-06T02:28:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.503+0000 7f3904f33000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9e1db620 con 0x564e9e365b10 2023-10-06T02:28:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.503+0000 7f3904f33000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e9e1d2400 con 0x564e9e368c90 2023-10-06T02:28:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.503+0000 7f38fe16e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e9e2bd670 0x564e9e347ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.503+0000 7f38fe16e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e9e2bd670 0x564e9e347ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47964/0 (socket says 172.21.15.6:47964) 2023-10-06T02:28:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.503+0000 7f38fe16e700 1 -- 172.21.15.6:0/2025288800 learned_addr learned my addr 172.21.15.6:0/2025288800 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f38f7fff700 1 --2- 172.21.15.6:0/2025288800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e365b10 0x564e9e348430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f38fe96f700 1 --2- 172.21.15.6:0/2025288800 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e9e368c90 0x564e9e28ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f38fe16e700 1 -- 172.21.15.6:0/2025288800 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e9e368c90 msgr2=0x564e9e28ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:29.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f38fe16e700 1 --2- 172.21.15.6:0/2025288800 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e9e368c90 0x564e9e28ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f38fe16e700 1 -- 172.21.15.6:0/2025288800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e365b10 msgr2=0x564e9e348430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:29.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f38fe16e700 1 --2- 172.21.15.6:0/2025288800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e365b10 0x564e9e348430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f38fe16e700 1 -- 172.21.15.6:0/2025288800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f0005db0 con 0x564e9e2bd670 2023-10-06T02:28:29.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f38fe16e700 1 --2- 172.21.15.6:0/2025288800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e9e2bd670 0x564e9e347ef0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x564e9e2912f0 tx=0x7f38f0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f681fe94c6dda510 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:29.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f38fd16c700 1 -- 172.21.15.6:0/2025288800 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f0000bc0 con 0x564e9e2bd670 2023-10-06T02:28:29.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f38fd16c700 1 -- 172.21.15.6:0/2025288800 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f0008a50 con 0x564e9e2bd670 2023-10-06T02:28:29.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f38fd16c700 1 -- 172.21.15.6:0/2025288800 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f0008e10 con 0x564e9e2bd670 2023-10-06T02:28:29.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f3904f33000 1 -- 172.21.15.6:0/2025288800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e9e2bd670 msgr2=0x564e9e347ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f3904f33000 1 --2- 172.21.15.6:0/2025288800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e9e2bd670 0x564e9e347ef0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x564e9e2912f0 tx=0x7f38f0016000 comp rx=0 tx=0).stop 2023-10-06T02:28:29.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f3904f33000 1 -- 172.21.15.6:0/2025288800 shutdown_connections 2023-10-06T02:28:29.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f3904f33000 1 --2- 172.21.15.6:0/2025288800 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e9e368c90 0x564e9e28ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f3904f33000 1 --2- 172.21.15.6:0/2025288800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e9e2bd670 0x564e9e347ef0 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f3904f33000 1 --2- 172.21.15.6:0/2025288800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e365b10 0x564e9e348430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.504+0000 7f3904f33000 1 -- 172.21.15.6:0/2025288800 >> 172.21.15.6:0/2025288800 conn(0x564e9e2d7c30 msgr2=0x564e9e2922b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:29.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.505+0000 7f3904f33000 1 -- 172.21.15.6:0/2025288800 shutdown_connections 2023-10-06T02:28:29.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.505+0000 7f3904f33000 1 -- 172.21.15.6:0/2025288800 wait complete. 2023-10-06T02:28:29.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.505+0000 7f3904f33000 1 Processor -- start 2023-10-06T02:28:29.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.505+0000 7f3904f33000 1 -- start start 2023-10-06T02:28:29.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f3904f33000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e2bd670 0x564e9e344900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f3904f33000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e9e365b10 0x564e9e2be640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f3904f33000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e9e368c90 0x564e9e2beb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f3904f33000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9e35d830 con 0x564e9e365b10 2023-10-06T02:28:29.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f3904f33000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9e35f770 con 0x564e9e2bd670 2023-10-06T02:28:29.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f3904f33000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e9e2bb9d0 con 0x564e9e368c90 2023-10-06T02:28:29.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f38f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e9e365b10 0x564e9e2be640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f38f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e9e365b10 0x564e9e2be640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47966/0 (socket says 172.21.15.6:47966) 2023-10-06T02:28:29.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f38f7fff700 1 -- 172.21.15.6:0/166145868 learned_addr learned my addr 172.21.15.6:0/166145868 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:29.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f38fe16e700 1 --2- 172.21.15.6:0/166145868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e2bd670 0x564e9e344900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f38fe96f700 1 --2- 172.21.15.6:0/166145868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e9e368c90 0x564e9e2beb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f38f7fff700 1 -- 172.21.15.6:0/166145868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e9e368c90 msgr2=0x564e9e2beb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f38f7fff700 1 --2- 172.21.15.6:0/166145868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564e9e368c90 0x564e9e2beb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f38f7fff700 1 -- 172.21.15.6:0/166145868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e2bd670 msgr2=0x564e9e344900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f38f7fff700 1 --2- 172.21.15.6:0/166145868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e2bd670 0x564e9e344900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f38f7fff700 1 -- 172.21.15.6:0/166145868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e9e2041c0 con 0x564e9e365b10 2023-10-06T02:28:29.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f38fe16e700 1 --2- 172.21.15.6:0/166145868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e2bd670 0x564e9e344900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:29.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.506+0000 7f38f7fff700 1 --2- 172.21.15.6:0/166145868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e9e365b10 0x564e9e2be640 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f38e8008940 tx=0x7f38e8005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:29.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.507+0000 7f38f6ffd700 1 -- 172.21.15.6:0/166145868 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e800f050 con 0x564e9e365b10 2023-10-06T02:28:29.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.507+0000 7f38f6ffd700 1 -- 172.21.15.6:0/166145868 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e8010040 con 0x564e9e365b10 2023-10-06T02:28:29.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.507+0000 7f38f6ffd700 1 -- 172.21.15.6:0/166145868 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e8006a50 con 0x564e9e365b10 2023-10-06T02:28:29.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.507+0000 7f3904f33000 1 -- 172.21.15.6:0/166145868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564e9e1ea3d0 con 0x564e9e365b10 2023-10-06T02:28:29.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.507+0000 7f3904f33000 1 -- 172.21.15.6:0/166145868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e9e1ddae0 con 0x564e9e365b10 2023-10-06T02:28:29.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.508+0000 7f38f6ffd700 1 -- 172.21.15.6:0/166145868 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f38e801f460 con 0x564e9e365b10 2023-10-06T02:28:29.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.508+0000 7f38f6ffd700 1 --2- 172.21.15.6:0/166145868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38e0065890 0x7f38e0067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.508+0000 7f38f6ffd700 1 -- 172.21.15.6:0/166145868 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 9130+0+0 (secure 0 0 0) 0x7f38e8084750 con 0x564e9e365b10 2023-10-06T02:28:29.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.508+0000 7f38fe16e700 1 --2- 172.21.15.6:0/166145868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38e0065890 0x7f38e0067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.509+0000 7f3904f33000 1 --2- 172.21.15.6:0/166145868 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x564e9e35cba0 0x564e9e383c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.509+0000 7f3904f33000 1 -- 172.21.15.6:0/166145868 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:1 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=103b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127) v8 -- 0x564e9e364080 con 0x564e9e35cba0 2023-10-06T02:28:29.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.509+0000 7f38fe96f700 1 --2- 172.21.15.6:0/166145868 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x564e9e35cba0 0x564e9e383c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.509+0000 7f38fe96f700 1 --2- 172.21.15.6:0/166145868 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x564e9e35cba0 0x564e9e383c70 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:29.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.509+0000 7f38fe16e700 1 --2- 172.21.15.6:0/166145868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38e0065890 0x7f38e0067d40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f38f0023000 tx=0x7f38f001c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:29.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.510+0000 7f38fe96f700 1 -- 172.21.15.6:0/166145868 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(1 100.00000000 [omap-set-vals] v127'324 uv324 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f38f8003980 con 0x564e9e35cba0 2023-10-06T02:28:29.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.510+0000 7f3904f33000 1 -- 172.21.15.6:0/166145868 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x564e9e35cba0 msgr2=0x564e9e383c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.510+0000 7f3904f33000 1 --2- 172.21.15.6:0/166145868 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x564e9e35cba0 0x564e9e383c70 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.510+0000 7f3904f33000 1 -- 172.21.15.6:0/166145868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38e0065890 msgr2=0x7f38e0067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.510+0000 7f3904f33000 1 --2- 172.21.15.6:0/166145868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38e0065890 0x7f38e0067d40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f38f0023000 tx=0x7f38f001c000 comp rx=0 tx=0).stop 2023-10-06T02:28:29.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.510+0000 7f3904f33000 1 -- 172.21.15.6:0/166145868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e9e365b10 msgr2=0x564e9e2be640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.510+0000 7f3904f33000 1 --2- 172.21.15.6:0/166145868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564e9e365b10 0x564e9e2be640 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f38e8008940 tx=0x7f38e8005bc0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.510+0000 7f38fe96f700 1 -- 172.21.15.6:0/166145868 reap_dead start 2023-10-06T02:28:29.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.510+0000 7f3904f33000 1 -- 172.21.15.6:0/166145868 shutdown_connections 2023-10-06T02:28:29.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.510+0000 7f3904f33000 1 -- 172.21.15.6:0/166145868 >> 172.21.15.6:0/166145868 conn(0x564e9e2d7c30 msgr2=0x564e9e2d8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:29.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.510+0000 7f3904f33000 1 -- 172.21.15.6:0/166145868 shutdown_connections 2023-10-06T02:28:29.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.510+0000 7f3904f33000 1 -- 172.21.15.6:0/166145868 wait complete. 2023-10-06T02:28:29.518 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:28:29.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.677+0000 7fb27276c700 1 Processor -- start 2023-10-06T02:28:29.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.677+0000 7fb27276c700 1 -- start start 2023-10-06T02:28:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.677+0000 7fb27276c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb26c15a030 0x7fb26c15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.678+0000 7fb27276c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb26c15a940 0x7fb26c086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.678+0000 7fb27276c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26c087960 con 0x7fb26c087530 2023-10-06T02:28:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.678+0000 7fb27276c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26c0b0cf0 con 0x7fb26c15a940 2023-10-06T02:28:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.678+0000 7fb27276c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c0afc50 con 0x7fb26c15a030 2023-10-06T02:28:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.678+0000 7fb270d09700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb26c087530 0x7fb26c0b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52136/0 (socket says 172.21.15.6:52136) 2023-10-06T02:28:29.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.678+0000 7fb270d09700 1 -- 172.21.15.6:0/63719159 learned_addr learned my addr 172.21.15.6:0/63719159 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:29.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.678+0000 7fb26b7fe700 1 --2- 172.21.15.6:0/63719159 >> v2:172.21.15.175:3300/0 conn(0x7fb26c15a940 0x7fb26c086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.678+0000 7fb26bfff700 1 --2- 172.21.15.6:0/63719159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb26c15a030 0x7fb26c15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.678+0000 7fb26affd700 1 -- 172.21.15.6:0/63719159 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294904628 0 0) 0x7fb26c087960 con 0x7fb26c087530 2023-10-06T02:28:29.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.678+0000 7fb26affd700 1 -- 172.21.15.6:0/63719159 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb258003570 con 0x7fb26c087530 2023-10-06T02:28:29.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.678+0000 7fb26b7fe700 1 -- 172.21.15.6:0/63719159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb26c15a030 msgr2=0x7fb26c15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:29.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.678+0000 7fb26b7fe700 1 --2- 172.21.15.6:0/63719159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb26c15a030 0x7fb26c15a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.678+0000 7fb26b7fe700 1 -- 172.21.15.6:0/63719159 >> v1:172.21.15.6:6789/0 conn(0x7fb26c087530 legacy=0x7fb26c0b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.678+0000 7fb26affd700 1 -- 172.21.15.6:0/63719159 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1319937391 0 0) 0x7fb258003570 con 0x7fb26c087530 2023-10-06T02:28:29.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.678+0000 7fb26b7fe700 1 -- 172.21.15.6:0/63719159 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c0aff30 con 0x7fb26c15a940 2023-10-06T02:28:29.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.678+0000 7fb26bfff700 1 --2- 172.21.15.6:0/63719159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb26c15a030 0x7fb26c15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:29.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.678+0000 7fb26b7fe700 1 --2- 172.21.15.6:0/63719159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb26c15a940 0x7fb26c086ff0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0098e0 tx=0x7fb25c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b4f11275aa3902d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:29.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.679+0000 7fb26affd700 1 -- 172.21.15.6:0/63719159 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2640017f0 con 0x7fb26c15a940 2023-10-06T02:28:29.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.679+0000 7fb26affd700 1 -- 172.21.15.6:0/63719159 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25c011420 con 0x7fb26c15a940 2023-10-06T02:28:29.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.679+0000 7fb26affd700 1 -- 172.21.15.6:0/63719159 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c0117c0 con 0x7fb26c15a940 2023-10-06T02:28:29.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.679+0000 7fb27276c700 1 -- 172.21.15.6:0/63719159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb26c15a940 msgr2=0x7fb26c086ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.679+0000 7fb27276c700 1 --2- 172.21.15.6:0/63719159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb26c15a940 0x7fb26c086ff0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0098e0 tx=0x7fb25c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.679+0000 7fb27276c700 1 -- 172.21.15.6:0/63719159 shutdown_connections 2023-10-06T02:28:29.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.679+0000 7fb27276c700 1 --2- 172.21.15.6:0/63719159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb26c15a030 0x7fb26c15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.679+0000 7fb27276c700 1 --2- 172.21.15.6:0/63719159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb26c15a940 0x7fb26c086ff0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.679+0000 7fb27276c700 1 -- 172.21.15.6:0/63719159 >> 172.21.15.6:0/63719159 conn(0x7fb26c068680 msgr2=0x7fb26c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:29.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.679+0000 7fb27276c700 1 -- 172.21.15.6:0/63719159 shutdown_connections 2023-10-06T02:28:29.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.679+0000 7fb27276c700 1 -- 172.21.15.6:0/63719159 wait complete. 2023-10-06T02:28:29.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.680+0000 7fb27276c700 1 Processor -- start 2023-10-06T02:28:29.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.681+0000 7fb27276c700 1 -- start start 2023-10-06T02:28:29.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.681+0000 7fb27276c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb26c087530 0x7fb26c0c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.681+0000 7fb27276c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb26c15a030 0x7fb26c1569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.681+0000 7fb27276c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c15a940 0x7fb26c0c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.681+0000 7fb27276c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c0c50a0 con 0x7fb26c15a940 2023-10-06T02:28:29.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.681+0000 7fb27276c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c156f30 con 0x7fb26c15a030 2023-10-06T02:28:29.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.681+0000 7fb27276c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c0c4490 con 0x7fb26c087530 2023-10-06T02:28:29.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.681+0000 7fb270d09700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c15a940 0x7fb26c0c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.681+0000 7fb270d09700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c15a940 0x7fb26c0c3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47968/0 (socket says 172.21.15.6:47968) 2023-10-06T02:28:29.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.681+0000 7fb270d09700 1 -- 172.21.15.6:0/236520266 learned_addr learned my addr 172.21.15.6:0/236520266 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:29.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.682+0000 7fb26b7fe700 1 --2- 172.21.15.6:0/236520266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb26c15a030 0x7fb26c1569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.682+0000 7fb26bfff700 1 --2- 172.21.15.6:0/236520266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb26c087530 0x7fb26c0c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.682+0000 7fb270d09700 1 -- 172.21.15.6:0/236520266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb26c087530 msgr2=0x7fb26c0c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.682+0000 7fb270d09700 1 --2- 172.21.15.6:0/236520266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb26c087530 0x7fb26c0c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.682+0000 7fb270d09700 1 -- 172.21.15.6:0/236520266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb26c15a030 msgr2=0x7fb26c1569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:29.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.682+0000 7fb270d09700 1 --2- 172.21.15.6:0/236520266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb26c15a030 0x7fb26c1569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:29.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.682+0000 7fb270d09700 1 -- 172.21.15.6:0/236520266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb254009420 con 0x7fb26c15a940 2023-10-06T02:28:29.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.682+0000 7fb26bfff700 1 --2- 172.21.15.6:0/236520266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb26c087530 0x7fb26c0c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:29.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.682+0000 7fb270d09700 1 --2- 172.21.15.6:0/236520266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c15a940 0x7fb26c0c3c40 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7fb264001560 tx=0x7fb264001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:29.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.682+0000 7fb263fff700 1 -- 172.21.15.6:0/236520266 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264004dc0 con 0x7fb26c15a940 2023-10-06T02:28:29.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.682+0000 7fb263fff700 1 -- 172.21.15.6:0/236520266 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26400a750 con 0x7fb26c15a940 2023-10-06T02:28:29.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.682+0000 7fb27276c700 1 -- 172.21.15.6:0/236520266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb25c009420 con 0x7fb26c15a940 2023-10-06T02:28:29.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.682+0000 7fb263fff700 1 -- 172.21.15.6:0/236520266 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26400ab10 con 0x7fb26c15a940 2023-10-06T02:28:29.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.682+0000 7fb27276c700 1 -- 172.21.15.6:0/236520266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26c0c4a50 con 0x7fb26c15a940 2023-10-06T02:28:29.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.683+0000 7fb27276c700 1 -- 172.21.15.6:0/236520266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26c088700 con 0x7fb26c15a940 2023-10-06T02:28:29.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.684+0000 7fb263fff700 1 -- 172.21.15.6:0/236520266 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb264007150 con 0x7fb26c15a940 2023-10-06T02:28:29.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.684+0000 7fb263fff700 1 --2- 172.21.15.6:0/236520266 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb24c066f30 0x7fb24c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:29.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.684+0000 7fb263fff700 1 -- 172.21.15.6:0/236520266 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 9130+0+0 (secure 0 0 0) 0x7fb264084dd0 con 0x7fb26c15a940 2023-10-06T02:28:29.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.684+0000 7fb26bfff700 1 --2- 172.21.15.6:0/236520266 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb24c066f30 0x7fb24c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:29.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.685+0000 7fb26bfff700 1 --2- 172.21.15.6:0/236520266 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb24c066f30 0x7fb24c0693e0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb2540093f0 tx=0x7fb254008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:29.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.688+0000 7fb263fff700 1 -- 172.21.15.6:0/236520266 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb264051320 con 0x7fb26c15a940 2023-10-06T02:28:29.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:29.929+0000 7fb27276c700 1 -- 172.21.15.6:0/236520266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fb26c0b0210 con 0x7fb26c15a940 2023-10-06T02:28:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:30.924+0000 7fb263fff700 1 -- 172.21.15.6:0/236520266 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v292) v1 ==== 162+0+0 (secure 0 0 0) 0x7fb264018020 con 0x7fb26c15a940 2023-10-06T02:28:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:30.927+0000 7fb27276c700 1 -- 172.21.15.6:0/236520266 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb24c066f30 msgr2=0x7fb24c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:30.927+0000 7fb27276c700 1 --2- 172.21.15.6:0/236520266 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb24c066f30 0x7fb24c0693e0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb2540093f0 tx=0x7fb254008040 comp rx=0 tx=0).stop 2023-10-06T02:28:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:30.927+0000 7fb27276c700 1 -- 172.21.15.6:0/236520266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c15a940 msgr2=0x7fb26c0c3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:30.927+0000 7fb27276c700 1 --2- 172.21.15.6:0/236520266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c15a940 0x7fb26c0c3c40 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7fb264001560 tx=0x7fb264001640 comp rx=0 tx=0).stop 2023-10-06T02:28:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:30.927+0000 7fb27276c700 1 -- 172.21.15.6:0/236520266 shutdown_connections 2023-10-06T02:28:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:30.927+0000 7fb27276c700 1 --2- 172.21.15.6:0/236520266 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb24c066f30 0x7fb24c0693e0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:30.927+0000 7fb27276c700 1 --2- 172.21.15.6:0/236520266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c15a940 0x7fb26c0c3c40 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:30.927+0000 7fb27276c700 1 --2- 172.21.15.6:0/236520266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb26c087530 0x7fb26c0c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:30.927+0000 7fb27276c700 1 --2- 172.21.15.6:0/236520266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb26c15a030 0x7fb26c1569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:30.928+0000 7fb27276c700 1 -- 172.21.15.6:0/236520266 >> 172.21.15.6:0/236520266 conn(0x7fb26c068680 msgr2=0x7fb26c0cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:30.928+0000 7fb27276c700 1 -- 172.21.15.6:0/236520266 shutdown_connections 2023-10-06T02:28:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:30.928+0000 7fb27276c700 1 -- 172.21.15.6:0/236520266 wait complete. 2023-10-06T02:28:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:28:30.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:31.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.070+0000 7fcb2e3a5700 1 Processor -- start 2023-10-06T02:28:31.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.070+0000 7fcb2e3a5700 1 -- start start 2023-10-06T02:28:31.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb2e3a5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcb28159150 0x7fcb2815de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb2e3a5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb280b08f0 0x7fcb28159520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb2e3a5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb280afbc0 con 0x7fcb280cccf0 2023-10-06T02:28:31.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb2e3a5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb28159a60 con 0x7fcb280b08f0 2023-10-06T02:28:31.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb2e3a5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb280cd620 con 0x7fcb28159150 2023-10-06T02:28:31.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb277fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb280b08f0 0x7fcb28159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb277fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb280b08f0 0x7fcb28159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47980/0 (socket says 172.21.15.6:47980) 2023-10-06T02:28:31.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb2c942700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcb280cccf0 0x7fcb280b20a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52148/0 (socket says 172.21.15.6:52148) 2023-10-06T02:28:31.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb277fe700 1 -- 172.21.15.6:0/3371933008 learned_addr learned my addr 172.21.15.6:0/3371933008 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:31.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb27fff700 1 --2- 172.21.15.6:0/3371933008 >> v2:172.21.15.175:3300/0 conn(0x7fcb28159150 0x7fcb2815de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb277fe700 1 -- 172.21.15.6:0/3371933008 >> v2:172.21.15.175:3300/0 conn(0x7fcb28159150 msgr2=0x7fcb2815de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:31.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb277fe700 1 --2- 172.21.15.6:0/3371933008 >> v2:172.21.15.175:3300/0 conn(0x7fcb28159150 0x7fcb2815de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb277fe700 1 -- 172.21.15.6:0/3371933008 >> v1:172.21.15.6:6789/0 conn(0x7fcb280cccf0 legacy=0x7fcb280b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb277fe700 1 -- 172.21.15.6:0/3371933008 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb280afe10 con 0x7fcb280b08f0 2023-10-06T02:28:31.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb26ffd700 1 -- 172.21.15.6:0/3371933008 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709857204 0 0) 0x7fcb280afbc0 con 0x7fcb280cccf0 2023-10-06T02:28:31.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb277fe700 1 --2- 172.21.15.6:0/3371933008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb280b08f0 0x7fcb28159520 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7fcb280cddd0 tx=0x7fcb10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac8b2ef91980ab2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb26ffd700 1 -- 172.21.15.6:0/3371933008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1000b860 con 0x7fcb280b08f0 2023-10-06T02:28:31.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb26ffd700 1 -- 172.21.15.6:0/3371933008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1000b9c0 con 0x7fcb280b08f0 2023-10-06T02:28:31.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.071+0000 7fcb26ffd700 1 -- 172.21.15.6:0/3371933008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1000bd60 con 0x7fcb280b08f0 2023-10-06T02:28:31.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.072+0000 7fcb2e3a5700 1 -- 172.21.15.6:0/3371933008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb280b08f0 msgr2=0x7fcb28159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.072+0000 7fcb2e3a5700 1 --2- 172.21.15.6:0/3371933008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb280b08f0 0x7fcb28159520 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7fcb280cddd0 tx=0x7fcb10009250 comp rx=0 tx=0).stop 2023-10-06T02:28:31.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.072+0000 7fcb2e3a5700 1 -- 172.21.15.6:0/3371933008 shutdown_connections 2023-10-06T02:28:31.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.072+0000 7fcb2e3a5700 1 --2- 172.21.15.6:0/3371933008 >> v2:172.21.15.175:3300/0 conn(0x7fcb28159150 0x7fcb2815de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.072+0000 7fcb2e3a5700 1 --2- 172.21.15.6:0/3371933008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb280b08f0 0x7fcb28159520 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.072+0000 7fcb2e3a5700 1 -- 172.21.15.6:0/3371933008 >> 172.21.15.6:0/3371933008 conn(0x7fcb28068680 msgr2=0x7fcb28068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:31.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.072+0000 7fcb2e3a5700 1 -- 172.21.15.6:0/3371933008 shutdown_connections 2023-10-06T02:28:31.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.072+0000 7fcb2e3a5700 1 -- 172.21.15.6:0/3371933008 wait complete. 2023-10-06T02:28:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.073+0000 7fcb2e3a5700 1 Processor -- start 2023-10-06T02:28:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.073+0000 7fcb2e3a5700 1 -- start start 2023-10-06T02:28:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.074+0000 7fcb2e3a5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb280b08f0 0x7fcb280c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.074+0000 7fcb2e3a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb280cccf0 0x7fcb2815b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.074+0000 7fcb2e3a5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb28159150 0x7fcb280ce330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.074+0000 7fcb2e3a5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280ca260 con 0x7fcb280cccf0 2023-10-06T02:28:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.074+0000 7fcb2e3a5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2815bb90 con 0x7fcb280b08f0 2023-10-06T02:28:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.074+0000 7fcb2e3a5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2816a8e0 con 0x7fcb28159150 2023-10-06T02:28:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.074+0000 7fcb277fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb280cccf0 0x7fcb2815b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.074+0000 7fcb277fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb280cccf0 0x7fcb2815b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47994/0 (socket says 172.21.15.6:47994) 2023-10-06T02:28:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.074+0000 7fcb277fe700 1 -- 172.21.15.6:0/3427013935 learned_addr learned my addr 172.21.15.6:0/3427013935 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.074+0000 7fcb277fe700 1 -- 172.21.15.6:0/3427013935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb28159150 msgr2=0x7fcb280ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.074+0000 7fcb277fe700 1 --2- 172.21.15.6:0/3427013935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb28159150 0x7fcb280ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.074+0000 7fcb277fe700 1 -- 172.21.15.6:0/3427013935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb280b08f0 msgr2=0x7fcb280c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.074+0000 7fcb277fe700 1 --2- 172.21.15.6:0/3427013935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb280b08f0 0x7fcb280c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.074+0000 7fcb277fe700 1 -- 172.21.15.6:0/3427013935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb100094f0 con 0x7fcb280cccf0 2023-10-06T02:28:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.075+0000 7fcb277fe700 1 --2- 172.21.15.6:0/3427013935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb280cccf0 0x7fcb2815b650 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fcb10006f50 tx=0x7fcb10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.075+0000 7fcb1ffff700 1 -- 172.21.15.6:0/3427013935 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10024440 con 0x7fcb280cccf0 2023-10-06T02:28:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.075+0000 7fcb1ffff700 1 -- 172.21.15.6:0/3427013935 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb100245e0 con 0x7fcb280cccf0 2023-10-06T02:28:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.075+0000 7fcb2e3a5700 1 -- 172.21.15.6:0/3427013935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb28169d60 con 0x7fcb280cccf0 2023-10-06T02:28:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.075+0000 7fcb1ffff700 1 -- 172.21.15.6:0/3427013935 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb100249a0 con 0x7fcb280cccf0 2023-10-06T02:28:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.075+0000 7fcb2e3a5700 1 -- 172.21.15.6:0/3427013935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2816a320 con 0x7fcb280cccf0 2023-10-06T02:28:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.076+0000 7fcb2e3a5700 1 -- 172.21.15.6:0/3427013935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb28088aa0 con 0x7fcb280cccf0 2023-10-06T02:28:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.076+0000 7fcb1ffff700 1 -- 172.21.15.6:0/3427013935 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb10024d50 con 0x7fcb280cccf0 2023-10-06T02:28:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.077+0000 7fcb1ffff700 1 --2- 172.21.15.6:0/3427013935 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb08066f30 0x7fcb080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.077+0000 7fcb1ffff700 1 -- 172.21.15.6:0/3427013935 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 9130+0+0 (secure 0 0 0) 0x7fcb10086fc0 con 0x7fcb280cccf0 2023-10-06T02:28:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.077+0000 7fcb27fff700 1 --2- 172.21.15.6:0/3427013935 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb08066f30 0x7fcb080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.077+0000 7fcb27fff700 1 --2- 172.21.15.6:0/3427013935 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb08066f30 0x7fcb080693e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009a60 tx=0x7fcb18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.081+0000 7fcb1ffff700 1 -- 172.21.15.6:0/3427013935 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb10053490 con 0x7fcb280cccf0 2023-10-06T02:28:31.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.318+0000 7fcb2e3a5700 1 -- 172.21.15.6:0/3427013935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb2804bb80 con 0x7fcb280cccf0 2023-10-06T02:28:31.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.319+0000 7fcb1ffff700 1 -- 172.21.15.6:0/3427013935 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 293 v293) v1 ==== 95+0+4607 (secure 0 0 0) 0x7fcb10015090 con 0x7fcb280cccf0 2023-10-06T02:28:31.321 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:31.321 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":293,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":293,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:28:30.926144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":127,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10113},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10113":{"gid":10113,"name":"a","rank":0,"incarnation":293,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/3458727123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3458727123},{"type":"v1","addr":"172.21.15.6:6835","nonce":3458727123}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.321+0000 7fcb2e3a5700 1 -- 172.21.15.6:0/3427013935 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb08066f30 msgr2=0x7fcb080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.321+0000 7fcb2e3a5700 1 --2- 172.21.15.6:0/3427013935 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb08066f30 0x7fcb080693e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009a60 tx=0x7fcb18008040 comp rx=0 tx=0).stop 2023-10-06T02:28:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.321+0000 7fcb2e3a5700 1 -- 172.21.15.6:0/3427013935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb280cccf0 msgr2=0x7fcb2815b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.321+0000 7fcb2e3a5700 1 --2- 172.21.15.6:0/3427013935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb280cccf0 0x7fcb2815b650 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fcb10006f50 tx=0x7fcb10017000 comp rx=0 tx=0).stop 2023-10-06T02:28:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.321+0000 7fcb2e3a5700 1 -- 172.21.15.6:0/3427013935 shutdown_connections 2023-10-06T02:28:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.321+0000 7fcb2e3a5700 1 --2- 172.21.15.6:0/3427013935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb28159150 0x7fcb280ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.321+0000 7fcb2e3a5700 1 --2- 172.21.15.6:0/3427013935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb280b08f0 0x7fcb280c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.321+0000 7fcb2e3a5700 1 --2- 172.21.15.6:0/3427013935 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcb08066f30 0x7fcb080693e0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.321+0000 7fcb2e3a5700 1 --2- 172.21.15.6:0/3427013935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb280cccf0 0x7fcb2815b650 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.321+0000 7fcb2e3a5700 1 -- 172.21.15.6:0/3427013935 >> 172.21.15.6:0/3427013935 conn(0x7fcb28068680 msgr2=0x7fcb280cb430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:31.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.321+0000 7fcb2e3a5700 1 -- 172.21.15.6:0/3427013935 shutdown_connections 2023-10-06T02:28:31.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:31.321+0000 7fcb2e3a5700 1 -- 172.21.15.6:0/3427013935 wait complete. 2023-10-06T02:28:31.324 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 293 2023-10-06T02:28:31.335 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2023-10-06T02:28:33.944 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:28:33.942+0000 7f2e9ebe6700 -1 mds.0.damage notify_dentry Damage to dentries in fragment * of ino 0x100is fatal because it is a system directory for this rank 2023-10-06T02:28:33.946 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:28:33.944+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:28:33.946 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:28:33.944+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:28:33.957 INFO:tasks.ceph.mds.a.smithi006.stderr: -15> 2023-10-06T02:28:33.942+0000 7f2e9ebe6700 -1 mds.0.damage notify_dentry Damage to dentries in fragment * of ino 0x100is fatal because it is a system directory for this rank 2023-10-06T02:28:33.979 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:28:36.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:36.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.469+0000 7f5de6233700 1 Processor -- start 2023-10-06T02:28:36.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.469+0000 7f5de6233700 1 -- start start 2023-10-06T02:28:36.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.469+0000 7f5de6233700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de01593f0 0x7f5de006de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.469+0000 7f5de6233700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5de01597c0 0x7f5de006e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.469+0000 7f5de6233700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de0069950 con 0x7f5de00b3d30 2023-10-06T02:28:36.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.469+0000 7f5de6233700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de00b2850 con 0x7f5de01597c0 2023-10-06T02:28:36.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.469+0000 7f5de6233700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de00b1fb0 con 0x7f5de01593f0 2023-10-06T02:28:36.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.470+0000 7f5ddffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5de00b3d30 0x7f5de015d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52164/0 (socket says 172.21.15.6:52164) 2023-10-06T02:28:36.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.470+0000 7f5ddffff700 1 -- 172.21.15.6:0/1556649987 learned_addr learned my addr 172.21.15.6:0/1556649987 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:36.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.470+0000 7f5ddf7fe700 1 --2- 172.21.15.6:0/1556649987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de01593f0 0x7f5de006de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.470+0000 7f5ddeffd700 1 --2- 172.21.15.6:0/1556649987 >> v2:172.21.15.175:3300/0 conn(0x7f5de01597c0 0x7f5de006e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.470+0000 7f5dde7fc700 1 -- 172.21.15.6:0/1556649987 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446345625 0 0) 0x7f5de0069950 con 0x7f5de00b3d30 2023-10-06T02:28:36.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.470+0000 7f5dde7fc700 1 -- 172.21.15.6:0/1556649987 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dc8003570 con 0x7f5de00b3d30 2023-10-06T02:28:36.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.470+0000 7f5dde7fc700 1 -- 172.21.15.6:0/1556649987 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 855071666 0 0) 0x7f5dc8003570 con 0x7f5de00b3d30 2023-10-06T02:28:36.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.470+0000 7f5ddf7fe700 1 -- 172.21.15.6:0/1556649987 >> v2:172.21.15.175:3300/0 conn(0x7f5de01597c0 msgr2=0x7f5de006e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:36.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.470+0000 7f5ddf7fe700 1 --2- 172.21.15.6:0/1556649987 >> v2:172.21.15.175:3300/0 conn(0x7f5de01597c0 0x7f5de006e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.470+0000 7f5ddf7fe700 1 -- 172.21.15.6:0/1556649987 >> v1:172.21.15.6:6789/0 conn(0x7f5de00b3d30 legacy=0x7f5de015d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:36.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.470+0000 7f5ddf7fe700 1 -- 172.21.15.6:0/1556649987 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de00b2290 con 0x7f5de01593f0 2023-10-06T02:28:36.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.470+0000 7f5ddeffd700 1 --2- 172.21.15.6:0/1556649987 >> v2:172.21.15.175:3300/0 conn(0x7f5de01597c0 0x7f5de006e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:36.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.470+0000 7f5ddf7fe700 1 --2- 172.21.15.6:0/1556649987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de01593f0 0x7f5de006de10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00098e0 tx=0x7f5dd00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bc79d5dad3bfbea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:36.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.471+0000 7f5dde7fc700 1 -- 172.21.15.6:0/1556649987 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd80017f0 con 0x7f5de01593f0 2023-10-06T02:28:36.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.471+0000 7f5dde7fc700 1 -- 172.21.15.6:0/1556649987 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd0011420 con 0x7f5de01593f0 2023-10-06T02:28:36.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.471+0000 7f5dde7fc700 1 -- 172.21.15.6:0/1556649987 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd00117c0 con 0x7f5de01593f0 2023-10-06T02:28:36.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.471+0000 7f5de6233700 1 -- 172.21.15.6:0/1556649987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de01593f0 msgr2=0x7f5de006de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:36.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.471+0000 7f5de6233700 1 --2- 172.21.15.6:0/1556649987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de01593f0 0x7f5de006de10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00098e0 tx=0x7f5dd00091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.471+0000 7f5de6233700 1 -- 172.21.15.6:0/1556649987 shutdown_connections 2023-10-06T02:28:36.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.471+0000 7f5de6233700 1 --2- 172.21.15.6:0/1556649987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de01593f0 0x7f5de006de10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.471+0000 7f5de6233700 1 --2- 172.21.15.6:0/1556649987 >> v2:172.21.15.175:3300/0 conn(0x7f5de01597c0 0x7f5de006e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.471+0000 7f5de6233700 1 -- 172.21.15.6:0/1556649987 >> 172.21.15.6:0/1556649987 conn(0x7f5de006cff0 msgr2=0x7f5de00afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:36.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.471+0000 7f5de6233700 1 -- 172.21.15.6:0/1556649987 shutdown_connections 2023-10-06T02:28:36.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.471+0000 7f5de6233700 1 -- 172.21.15.6:0/1556649987 wait complete. 2023-10-06T02:28:36.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.473+0000 7f5de6233700 1 Processor -- start 2023-10-06T02:28:36.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.473+0000 7f5de6233700 1 -- start start 2023-10-06T02:28:36.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5de6233700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de00b3d30 0x7f5de0153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5de6233700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5de01593f0 0x7f5de00c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5de6233700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de01597c0 0x7f5de00acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5de6233700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de00c72d0 con 0x7f5de01597c0 2023-10-06T02:28:36.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5de6233700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de01542c0 con 0x7f5de01593f0 2023-10-06T02:28:36.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5de6233700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de016a390 con 0x7f5de00b3d30 2023-10-06T02:28:36.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5ddffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de01597c0 0x7f5de00acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5ddffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de01597c0 0x7f5de00acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48032/0 (socket says 172.21.15.6:48032) 2023-10-06T02:28:36.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5ddffff700 1 -- 172.21.15.6:0/989600508 learned_addr learned my addr 172.21.15.6:0/989600508 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:36.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5ddf7fe700 1 --2- 172.21.15.6:0/989600508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de00b3d30 0x7f5de0153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5ddeffd700 1 --2- 172.21.15.6:0/989600508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5de01593f0 0x7f5de00c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5ddffff700 1 -- 172.21.15.6:0/989600508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de00b3d30 msgr2=0x7f5de0153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:36.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5ddffff700 1 --2- 172.21.15.6:0/989600508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de00b3d30 0x7f5de0153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5ddffff700 1 -- 172.21.15.6:0/989600508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5de01593f0 msgr2=0x7f5de00c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:36.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5ddffff700 1 --2- 172.21.15.6:0/989600508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5de01593f0 0x7f5de00c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5ddffff700 1 -- 172.21.15.6:0/989600508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd40093c0 con 0x7f5de01597c0 2023-10-06T02:28:36.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5ddffff700 1 --2- 172.21.15.6:0/989600508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de01597c0 0x7f5de00acc80 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8001560 tx=0x7f5dd8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:36.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5dc77fe700 1 -- 172.21.15.6:0/989600508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8004dc0 con 0x7f5de01597c0 2023-10-06T02:28:36.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5dc77fe700 1 -- 172.21.15.6:0/989600508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd800a6a0 con 0x7f5de01597c0 2023-10-06T02:28:36.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5de6233700 1 -- 172.21.15.6:0/989600508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd0009420 con 0x7f5de01597c0 2023-10-06T02:28:36.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5dc77fe700 1 -- 172.21.15.6:0/989600508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd800aa60 con 0x7f5de01597c0 2023-10-06T02:28:36.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5de6233700 1 -- 172.21.15.6:0/989600508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de016a950 con 0x7f5de01597c0 2023-10-06T02:28:36.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.475+0000 7f5de6233700 1 -- 172.21.15.6:0/989600508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de006d3f0 con 0x7f5de01597c0 2023-10-06T02:28:36.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.476+0000 7f5dc77fe700 1 -- 172.21.15.6:0/989600508 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5dd8007150 con 0x7f5de01597c0 2023-10-06T02:28:36.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.476+0000 7f5dc77fe700 1 --2- 172.21.15.6:0/989600508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5dcc066f30 0x7f5dcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.476+0000 7f5dc77fe700 1 -- 172.21.15.6:0/989600508 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7f5dd8084c60 con 0x7f5de01597c0 2023-10-06T02:28:36.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.477+0000 7f5ddf7fe700 1 --2- 172.21.15.6:0/989600508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5dcc066f30 0x7f5dcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.477+0000 7f5ddf7fe700 1 --2- 172.21.15.6:0/989600508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5dcc066f30 0x7f5dcc0693e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00093f0 tx=0x7f5dd0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:36.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.482+0000 7f5dc77fe700 1 -- 172.21.15.6:0/989600508 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5dd8051160 con 0x7f5de01597c0 2023-10-06T02:28:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.719+0000 7f5de6233700 1 -- 172.21.15.6:0/989600508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5de006dbd0 con 0x7f5de01597c0 2023-10-06T02:28:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.719+0000 7f5dc77fe700 1 -- 172.21.15.6:0/989600508 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 298 v298) v1 ==== 95+0+4593 (secure 0 0 0) 0x7f5dd8018020 con 0x7f5de01597c0 2023-10-06T02:28:36.721 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:36.721 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":298,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/171345142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":171345142},{"type":"v1","addr":"172.21.15.6:6835","nonce":171345142}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":298}],"filesystems":[{"mdsmap":{"epoch":297,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:28:33.946256+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":128,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:36.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.721+0000 7f5de6233700 1 -- 172.21.15.6:0/989600508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5dcc066f30 msgr2=0x7f5dcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:36.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.721+0000 7f5de6233700 1 --2- 172.21.15.6:0/989600508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5dcc066f30 0x7f5dcc0693e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00093f0 tx=0x7f5dd0016000 comp rx=0 tx=0).stop 2023-10-06T02:28:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.721+0000 7f5de6233700 1 -- 172.21.15.6:0/989600508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de01597c0 msgr2=0x7f5de00acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.721+0000 7f5de6233700 1 --2- 172.21.15.6:0/989600508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de01597c0 0x7f5de00acc80 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8001560 tx=0x7f5dd8001640 comp rx=0 tx=0).stop 2023-10-06T02:28:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.721+0000 7f5de6233700 1 -- 172.21.15.6:0/989600508 shutdown_connections 2023-10-06T02:28:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.721+0000 7f5de6233700 1 --2- 172.21.15.6:0/989600508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5dcc066f30 0x7f5dcc0693e0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.721+0000 7f5de6233700 1 --2- 172.21.15.6:0/989600508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5de01597c0 0x7f5de00acc80 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.721+0000 7f5de6233700 1 --2- 172.21.15.6:0/989600508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5de00b3d30 0x7f5de0153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.721+0000 7f5de6233700 1 --2- 172.21.15.6:0/989600508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5de01593f0 0x7f5de00c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.721+0000 7f5de6233700 1 -- 172.21.15.6:0/989600508 >> 172.21.15.6:0/989600508 conn(0x7f5de006cff0 msgr2=0x7f5de015b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.722+0000 7f5de6233700 1 -- 172.21.15.6:0/989600508 shutdown_connections 2023-10-06T02:28:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.722+0000 7f5de6233700 1 -- 172.21.15.6:0/989600508 wait complete. 2023-10-06T02:28:36.725 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 298 2023-10-06T02:28:36.735 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:28:36.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:36.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.853+0000 7fdf16429700 1 Processor -- start 2023-10-06T02:28:36.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.853+0000 7fdf16429700 1 -- start start 2023-10-06T02:28:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.854+0000 7fdf16429700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdf101419b0 0x7fdf10164260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.854+0000 7fdf16429700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf100b0350 con 0x7fdf100b0ed0 2023-10-06T02:28:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.854+0000 7fdf16429700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf100b0590 con 0x7fdf100688d0 2023-10-06T02:28:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.854+0000 7fdf16429700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf100b0870 con 0x7fdf101419b0 2023-10-06T02:28:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.854+0000 7fdf14c26700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdf100b0ed0 0x7fdf1013f3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52174/0 (socket says 172.21.15.6:52174) 2023-10-06T02:28:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.854+0000 7fdf14c26700 1 -- 172.21.15.6:0/3464326009 learned_addr learned my addr 172.21.15.6:0/3464326009 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.854+0000 7fdf15c28700 1 --2- 172.21.15.6:0/3464326009 >> v2:172.21.15.175:3300/0 conn(0x7fdf101419b0 0x7fdf10164260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.854+0000 7fdf0ffff700 1 -- 172.21.15.6:0/3464326009 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825536354 0 0) 0x7fdf04001110 con 0x7fdf100b0ed0 2023-10-06T02:28:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.855+0000 7fdf0ffff700 1 -- 172.21.15.6:0/3464326009 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdef8003570 con 0x7fdf100b0ed0 2023-10-06T02:28:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.855+0000 7fdf0ffff700 1 -- 172.21.15.6:0/3464326009 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223068336 0 0) 0x7fdf100b0590 con 0x7fdf100688d0 2023-10-06T02:28:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.855+0000 7fdf0ffff700 1 -- 172.21.15.6:0/3464326009 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf04001110 con 0x7fdf100688d0 2023-10-06T02:28:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.855+0000 7fdf15c28700 1 -- 172.21.15.6:0/3464326009 >> v1:172.21.15.175:6789/0 conn(0x7fdf100688d0 legacy=0x7fdf100afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.855+0000 7fdf15c28700 1 -- 172.21.15.6:0/3464326009 >> v1:172.21.15.6:6789/0 conn(0x7fdf100b0ed0 legacy=0x7fdf1013f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.855+0000 7fdf15c28700 1 -- 172.21.15.6:0/3464326009 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf100b0b50 con 0x7fdf101419b0 2023-10-06T02:28:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.855+0000 7fdf15c28700 1 --2- 172.21.15.6:0/3464326009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf101419b0 0x7fdf10164260 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fdf000098e0 tx=0x7fdf000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec452d43b22be14 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.855+0000 7fdf0ffff700 1 -- 172.21.15.6:0/3464326009 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00011630 con 0x7fdf101419b0 2023-10-06T02:28:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.855+0000 7fdf0ffff700 1 -- 172.21.15.6:0/3464326009 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf00011790 con 0x7fdf101419b0 2023-10-06T02:28:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.855+0000 7fdf0ffff700 1 -- 172.21.15.6:0/3464326009 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00011b30 con 0x7fdf101419b0 2023-10-06T02:28:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.856+0000 7fdf16429700 1 -- 172.21.15.6:0/3464326009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf101419b0 msgr2=0x7fdf10164260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.856+0000 7fdf16429700 1 --2- 172.21.15.6:0/3464326009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf101419b0 0x7fdf10164260 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fdf000098e0 tx=0x7fdf000091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.856+0000 7fdf16429700 1 -- 172.21.15.6:0/3464326009 shutdown_connections 2023-10-06T02:28:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.856+0000 7fdf16429700 1 --2- 172.21.15.6:0/3464326009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf101419b0 0x7fdf10164260 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.856+0000 7fdf16429700 1 -- 172.21.15.6:0/3464326009 >> 172.21.15.6:0/3464326009 conn(0x7fdf1006b320 msgr2=0x7fdf1006b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.856+0000 7fdf16429700 1 -- 172.21.15.6:0/3464326009 shutdown_connections 2023-10-06T02:28:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.856+0000 7fdf16429700 1 -- 172.21.15.6:0/3464326009 wait complete. 2023-10-06T02:28:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.857+0000 7fdf16429700 1 Processor -- start 2023-10-06T02:28:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.857+0000 7fdf16429700 1 -- start start 2023-10-06T02:28:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf16429700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf100688d0 0x7fdf100abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf16429700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf100b0ed0 0x7fdf100ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf16429700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf101419b0 0x7fdf100ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf16429700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1016b470 con 0x7fdf100b0ed0 2023-10-06T02:28:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf16429700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf100cac30 con 0x7fdf101419b0 2023-10-06T02:28:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf16429700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf100ccfb0 con 0x7fdf100688d0 2023-10-06T02:28:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf14c26700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf100b0ed0 0x7fdf100ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf14c26700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf100b0ed0 0x7fdf100ca1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48034/0 (socket says 172.21.15.6:48034) 2023-10-06T02:28:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf14c26700 1 -- 172.21.15.6:0/374168967 learned_addr learned my addr 172.21.15.6:0/374168967 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf15427700 1 --2- 172.21.15.6:0/374168967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf100688d0 0x7fdf100abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf15c28700 1 --2- 172.21.15.6:0/374168967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf101419b0 0x7fdf100ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf14c26700 1 -- 172.21.15.6:0/374168967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf100688d0 msgr2=0x7fdf100abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf14c26700 1 --2- 172.21.15.6:0/374168967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf100688d0 0x7fdf100abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf14c26700 1 -- 172.21.15.6:0/374168967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf101419b0 msgr2=0x7fdf100ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf14c26700 1 --2- 172.21.15.6:0/374168967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf101419b0 0x7fdf100ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf14c26700 1 -- 172.21.15.6:0/374168967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf00009420 con 0x7fdf100b0ed0 2023-10-06T02:28:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf15c28700 1 --2- 172.21.15.6:0/374168967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf101419b0 0x7fdf100ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf14c26700 1 --2- 172.21.15.6:0/374168967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf100b0ed0 0x7fdf100ca1b0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7fdf040058d0 tx=0x7fdf04007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.858+0000 7fdf0d7fa700 1 -- 172.21.15.6:0/374168967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04005b30 con 0x7fdf100b0ed0 2023-10-06T02:28:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.859+0000 7fdf0d7fa700 1 -- 172.21.15.6:0/374168967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf04005c90 con 0x7fdf100b0ed0 2023-10-06T02:28:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.859+0000 7fdf16429700 1 -- 172.21.15.6:0/374168967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf100cd290 con 0x7fdf100b0ed0 2023-10-06T02:28:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.859+0000 7fdf0d7fa700 1 -- 172.21.15.6:0/374168967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04007300 con 0x7fdf100b0ed0 2023-10-06T02:28:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.859+0000 7fdf16429700 1 -- 172.21.15.6:0/374168967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1016b090 con 0x7fdf100b0ed0 2023-10-06T02:28:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.859+0000 7fdf16429700 1 -- 172.21.15.6:0/374168967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1016b5b0 con 0x7fdf100b0ed0 2023-10-06T02:28:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.860+0000 7fdf0d7fa700 1 -- 172.21.15.6:0/374168967 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf0401b400 con 0x7fdf100b0ed0 2023-10-06T02:28:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.860+0000 7fdf0d7fa700 1 --2- 172.21.15.6:0/374168967 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdefc066f30 0x7fdefc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.860+0000 7fdf0d7fa700 1 -- 172.21.15.6:0/374168967 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7fdf04084d30 con 0x7fdf100b0ed0 2023-10-06T02:28:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.860+0000 7fdf15427700 1 --2- 172.21.15.6:0/374168967 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdefc066f30 0x7fdefc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.861+0000 7fdf15427700 1 --2- 172.21.15.6:0/374168967 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdefc066f30 0x7fdefc0693e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fdf10167730 tx=0x7fdf08007f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:36.865+0000 7fdf0d7fa700 1 -- 172.21.15.6:0/374168967 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf1016b5b0 con 0x7fdf100b0ed0 2023-10-06T02:28:37.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.106+0000 7fdf16429700 1 -- 172.21.15.6:0/374168967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf100b0350 con 0x7fdf100b0ed0 2023-10-06T02:28:37.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.106+0000 7fdf0d7fa700 1 -- 172.21.15.6:0/374168967 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 298 v298) v1 ==== 95+0+4593 (secure 0 0 0) 0x7fdf100b0350 con 0x7fdf100b0ed0 2023-10-06T02:28:37.108 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:37.108 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":298,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/171345142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":171345142},{"type":"v1","addr":"172.21.15.6:6835","nonce":171345142}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":298}],"filesystems":[{"mdsmap":{"epoch":297,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:28:33.946256+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":128,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:37.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.108+0000 7fdf16429700 1 -- 172.21.15.6:0/374168967 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdefc066f30 msgr2=0x7fdefc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:37.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.108+0000 7fdf16429700 1 --2- 172.21.15.6:0/374168967 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdefc066f30 0x7fdefc0693e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fdf10167730 tx=0x7fdf08007f90 comp rx=0 tx=0).stop 2023-10-06T02:28:37.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.108+0000 7fdf16429700 1 -- 172.21.15.6:0/374168967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf100b0ed0 msgr2=0x7fdf100ca1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:37.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.108+0000 7fdf16429700 1 --2- 172.21.15.6:0/374168967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf100b0ed0 0x7fdf100ca1b0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7fdf040058d0 tx=0x7fdf04007ea0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.108+0000 7fdf16429700 1 -- 172.21.15.6:0/374168967 shutdown_connections 2023-10-06T02:28:37.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.108+0000 7fdf16429700 1 --2- 172.21.15.6:0/374168967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf101419b0 0x7fdf100ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.108+0000 7fdf16429700 1 --2- 172.21.15.6:0/374168967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf100688d0 0x7fdf100abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.108+0000 7fdf16429700 1 --2- 172.21.15.6:0/374168967 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdefc066f30 0x7fdefc0693e0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.108+0000 7fdf16429700 1 --2- 172.21.15.6:0/374168967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf100b0ed0 0x7fdf100ca1b0 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.108+0000 7fdf16429700 1 -- 172.21.15.6:0/374168967 >> 172.21.15.6:0/374168967 conn(0x7fdf1006b320 msgr2=0x7fdf100ace60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:37.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.108+0000 7fdf16429700 1 -- 172.21.15.6:0/374168967 shutdown_connections 2023-10-06T02:28:37.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.108+0000 7fdf16429700 1 -- 172.21.15.6:0/374168967 wait complete. 2023-10-06T02:28:37.111 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 298 2023-10-06T02:28:37.122 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:28:37.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:37.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.240+0000 7fda3e346700 1 Processor -- start 2023-10-06T02:28:37.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.240+0000 7fda3e346700 1 -- start start 2023-10-06T02:28:37.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.241+0000 7fda3e346700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda38159400 0x7fda380ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:37.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.241+0000 7fda3e346700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fda380d05d0 0x7fda380b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:37.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.241+0000 7fda3e346700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda380b3560 con 0x7fda380cd030 2023-10-06T02:28:37.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.241+0000 7fda3e346700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda380cf6f0 con 0x7fda38159400 2023-10-06T02:28:37.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.241+0000 7fda3e346700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda380cf9d0 con 0x7fda380d05d0 2023-10-06T02:28:37.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.241+0000 7fda3d344700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda38159400 0x7fda380ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:37.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.241+0000 7fda3d344700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda38159400 0x7fda380ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48036/0 (socket says 172.21.15.6:48036) 2023-10-06T02:28:37.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.241+0000 7fda3d344700 1 -- 172.21.15.6:0/2376390297 learned_addr learned my addr 172.21.15.6:0/2376390297 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:37.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.241+0000 7fda3cb43700 1 --1- 172.21.15.6:0/2376390297 >> v1:172.21.15.6:6789/0 conn(0x7fda380cd030 0x7fda380cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52190/0 (socket says 172.21.15.6:52190) 2023-10-06T02:28:37.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.241+0000 7fda3db45700 1 --2- 172.21.15.6:0/2376390297 >> v2:172.21.15.175:3300/0 conn(0x7fda380d05d0 0x7fda380b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:37.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.241+0000 7fda3d344700 1 -- 172.21.15.6:0/2376390297 >> v2:172.21.15.175:3300/0 conn(0x7fda380d05d0 msgr2=0x7fda380b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:37.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.241+0000 7fda3d344700 1 --2- 172.21.15.6:0/2376390297 >> v2:172.21.15.175:3300/0 conn(0x7fda380d05d0 0x7fda380b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.241+0000 7fda3d344700 1 -- 172.21.15.6:0/2376390297 >> v1:172.21.15.6:6789/0 conn(0x7fda380cd030 legacy=0x7fda380cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:37.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.241+0000 7fda3d344700 1 -- 172.21.15.6:0/2376390297 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda380b2f10 con 0x7fda38159400 2023-10-06T02:28:37.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.241+0000 7fda37fff700 1 -- 172.21.15.6:0/2376390297 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002798840 0 0) 0x7fda380b3560 con 0x7fda380cd030 2023-10-06T02:28:37.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.242+0000 7fda3d344700 1 --2- 172.21.15.6:0/2376390297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda38159400 0x7fda380ccaf0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7fda380b34d0 tx=0x7fda28009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12486829563bace7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:37.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.242+0000 7fda37fff700 1 -- 172.21.15.6:0/2376390297 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2800e070 con 0x7fda38159400 2023-10-06T02:28:37.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.242+0000 7fda37fff700 1 -- 172.21.15.6:0/2376390297 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2800ba20 con 0x7fda38159400 2023-10-06T02:28:37.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.242+0000 7fda37fff700 1 -- 172.21.15.6:0/2376390297 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda280092e0 con 0x7fda38159400 2023-10-06T02:28:37.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.242+0000 7fda3e346700 1 -- 172.21.15.6:0/2376390297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda38159400 msgr2=0x7fda380ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:37.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.242+0000 7fda3e346700 1 --2- 172.21.15.6:0/2376390297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda38159400 0x7fda380ccaf0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7fda380b34d0 tx=0x7fda28009840 comp rx=0 tx=0).stop 2023-10-06T02:28:37.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.242+0000 7fda3e346700 1 -- 172.21.15.6:0/2376390297 shutdown_connections 2023-10-06T02:28:37.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.242+0000 7fda3e346700 1 --2- 172.21.15.6:0/2376390297 >> v2:172.21.15.175:3300/0 conn(0x7fda380d05d0 0x7fda380b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.242+0000 7fda3e346700 1 --2- 172.21.15.6:0/2376390297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda38159400 0x7fda380ccaf0 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.242+0000 7fda3e346700 1 -- 172.21.15.6:0/2376390297 >> 172.21.15.6:0/2376390297 conn(0x7fda3806ac10 msgr2=0x7fda38068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:37.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.242+0000 7fda3e346700 1 -- 172.21.15.6:0/2376390297 shutdown_connections 2023-10-06T02:28:37.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.242+0000 7fda3e346700 1 -- 172.21.15.6:0/2376390297 wait complete. 2023-10-06T02:28:37.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.243+0000 7fda3e346700 1 Processor -- start 2023-10-06T02:28:37.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.244+0000 7fda3e346700 1 -- start start 2023-10-06T02:28:37.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.244+0000 7fda3e346700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda380cd030 0x7fda3815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:37.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.244+0000 7fda3e346700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda380d05d0 0x7fda38146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:37.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.244+0000 7fda3e346700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda38159400 0x7fda3815a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:37.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.244+0000 7fda3e346700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3815bd10 con 0x7fda380d05d0 2023-10-06T02:28:37.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.244+0000 7fda3e346700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda38147120 con 0x7fda38159400 2023-10-06T02:28:37.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.244+0000 7fda3e346700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3815b100 con 0x7fda380cd030 2023-10-06T02:28:37.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.245+0000 7fda3cb43700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda380d05d0 0x7fda38146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:37.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.245+0000 7fda3cb43700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda380d05d0 0x7fda38146be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48040/0 (socket says 172.21.15.6:48040) 2023-10-06T02:28:37.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.245+0000 7fda3cb43700 1 -- 172.21.15.6:0/3204483199 learned_addr learned my addr 172.21.15.6:0/3204483199 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:37.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.245+0000 7fda3cb43700 1 -- 172.21.15.6:0/3204483199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda380cd030 msgr2=0x7fda3815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:37.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.245+0000 7fda3cb43700 1 --2- 172.21.15.6:0/3204483199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda380cd030 0x7fda3815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.245+0000 7fda3cb43700 1 -- 172.21.15.6:0/3204483199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda38159400 msgr2=0x7fda3815a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:37.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.245+0000 7fda3cb43700 1 --2- 172.21.15.6:0/3204483199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda38159400 0x7fda3815a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.245+0000 7fda3cb43700 1 -- 172.21.15.6:0/3204483199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda28009ae0 con 0x7fda380d05d0 2023-10-06T02:28:37.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.245+0000 7fda3cb43700 1 --2- 172.21.15.6:0/3204483199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda380d05d0 0x7fda38146be0 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0011e0 tx=0x7fda2c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:37.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.245+0000 7fda357fa700 1 -- 172.21.15.6:0/3204483199 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c007300 con 0x7fda380d05d0 2023-10-06T02:28:37.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.245+0000 7fda357fa700 1 -- 172.21.15.6:0/3204483199 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2c007460 con 0x7fda380d05d0 2023-10-06T02:28:37.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.245+0000 7fda357fa700 1 -- 172.21.15.6:0/3204483199 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c004830 con 0x7fda380d05d0 2023-10-06T02:28:37.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.245+0000 7fda3e346700 1 -- 172.21.15.6:0/3204483199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3815b3e0 con 0x7fda380d05d0 2023-10-06T02:28:37.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.245+0000 7fda3e346700 1 -- 172.21.15.6:0/3204483199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3815b9a0 con 0x7fda380d05d0 2023-10-06T02:28:37.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.246+0000 7fda3e346700 1 -- 172.21.15.6:0/3204483199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda380cf340 con 0x7fda380d05d0 2023-10-06T02:28:37.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.247+0000 7fda357fa700 1 -- 172.21.15.6:0/3204483199 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda2c004be0 con 0x7fda380d05d0 2023-10-06T02:28:37.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.247+0000 7fda357fa700 1 --2- 172.21.15.6:0/3204483199 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda24066f30 0x7fda240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:37.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.247+0000 7fda357fa700 1 -- 172.21.15.6:0/3204483199 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7fda2c0848a0 con 0x7fda380d05d0 2023-10-06T02:28:37.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.248+0000 7fda3d344700 1 --2- 172.21.15.6:0/3204483199 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda24066f30 0x7fda240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:37.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.248+0000 7fda3d344700 1 --2- 172.21.15.6:0/3204483199 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda24066f30 0x7fda240693e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fda28009fd0 tx=0x7fda28018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:37.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.252+0000 7fda357fa700 1 -- 172.21.15.6:0/3204483199 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda2c050d60 con 0x7fda380d05d0 2023-10-06T02:28:37.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.491+0000 7fda3e346700 1 -- 172.21.15.6:0/3204483199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda380b31f0 con 0x7fda380d05d0 2023-10-06T02:28:37.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.491+0000 7fda357fa700 1 -- 172.21.15.6:0/3204483199 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 298 v298) v1 ==== 95+0+4593 (secure 0 0 0) 0x7fda2c018030 con 0x7fda380d05d0 2023-10-06T02:28:37.492 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:37.492 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":298,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/171345142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":171345142},{"type":"v1","addr":"172.21.15.6:6835","nonce":171345142}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":298}],"filesystems":[{"mdsmap":{"epoch":297,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:28:33.946256+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":128,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:37.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.493+0000 7fda3e346700 1 -- 172.21.15.6:0/3204483199 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda24066f30 msgr2=0x7fda240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:37.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.493+0000 7fda3e346700 1 --2- 172.21.15.6:0/3204483199 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda24066f30 0x7fda240693e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fda28009fd0 tx=0x7fda28018000 comp rx=0 tx=0).stop 2023-10-06T02:28:37.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.493+0000 7fda3e346700 1 -- 172.21.15.6:0/3204483199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda380d05d0 msgr2=0x7fda38146be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:37.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.493+0000 7fda3e346700 1 --2- 172.21.15.6:0/3204483199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda380d05d0 0x7fda38146be0 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0011e0 tx=0x7fda2c007e10 comp rx=0 tx=0).stop 2023-10-06T02:28:37.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.493+0000 7fda3e346700 1 -- 172.21.15.6:0/3204483199 shutdown_connections 2023-10-06T02:28:37.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.493+0000 7fda3e346700 1 --2- 172.21.15.6:0/3204483199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda38159400 0x7fda3815a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.493+0000 7fda3e346700 1 --2- 172.21.15.6:0/3204483199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda380cd030 0x7fda3815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.493+0000 7fda3e346700 1 --2- 172.21.15.6:0/3204483199 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda24066f30 0x7fda240693e0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.493+0000 7fda3e346700 1 --2- 172.21.15.6:0/3204483199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda380d05d0 0x7fda38146be0 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.493+0000 7fda3e346700 1 -- 172.21.15.6:0/3204483199 >> 172.21.15.6:0/3204483199 conn(0x7fda3806ac10 msgr2=0x7fda380b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.493+0000 7fda3e346700 1 -- 172.21.15.6:0/3204483199 shutdown_connections 2023-10-06T02:28:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.493+0000 7fda3e346700 1 -- 172.21.15.6:0/3204483199 wait complete. 2023-10-06T02:28:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 298 2023-10-06T02:28:37.505 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap key 100.00000000:stray0_head' led to DAMAGED state 2023-10-06T02:28:37.506 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap key 1.00000000:subdir_head' 2023-10-06T02:28:37.506 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:37.506 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:28:37.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:37.506 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:28:37.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:28:37.521 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:28:37.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:28:37.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.680+0000 7f28e36af700 1 Processor -- start 2023-10-06T02:28:37.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.680+0000 7f28e36af700 1 -- start start 2023-10-06T02:28:37.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.681+0000 7f28e36af700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28dc0b2490 0x7f28dc0cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:37.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.681+0000 7f28e36af700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28dc0b2860 0x7f28dc0b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:37.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.681+0000 7f28e36af700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f28dc159150 0x7f28dc1595b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:37.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.681+0000 7f28e36af700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28dc0b0bb0 con 0x7f28dc0b2490 2023-10-06T02:28:37.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.681+0000 7f28e36af700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28dc0cb630 con 0x7f28dc159150 2023-10-06T02:28:37.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.681+0000 7f28e36af700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0cb910 con 0x7f28dc0b2860 2023-10-06T02:28:37.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.681+0000 7f28e144b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28dc0b2490 0x7f28dc0cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:37.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.681+0000 7f28e144b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28dc0b2490 0x7f28dc0cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48046/0 (socket says 172.21.15.6:48046) 2023-10-06T02:28:37.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.681+0000 7f28e144b700 1 -- 172.21.15.6:0/3424797248 learned_addr learned my addr 172.21.15.6:0/3424797248 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:37.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.682+0000 7f28e1c4c700 1 --2- 172.21.15.6:0/3424797248 >> v2:172.21.15.175:3300/0 conn(0x7f28dc159150 0x7f28dc1595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:37.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.682+0000 7f28e0c4a700 1 --2- 172.21.15.6:0/3424797248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28dc0b2860 0x7f28dc0b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:37.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.682+0000 7f28e144b700 1 -- 172.21.15.6:0/3424797248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28dc0b2860 msgr2=0x7f28dc0b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:37.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.682+0000 7f28e144b700 1 --2- 172.21.15.6:0/3424797248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28dc0b2860 0x7f28dc0b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.682+0000 7f28e144b700 1 -- 172.21.15.6:0/3424797248 >> v2:172.21.15.175:3300/0 conn(0x7f28dc159150 msgr2=0x7f28dc1595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:37.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.682+0000 7f28e144b700 1 --2- 172.21.15.6:0/3424797248 >> v2:172.21.15.175:3300/0 conn(0x7f28dc159150 0x7f28dc1595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.682+0000 7f28e144b700 1 -- 172.21.15.6:0/3424797248 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc0cbbf0 con 0x7f28dc0b2490 2023-10-06T02:28:37.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.682+0000 7f28e144b700 1 --2- 172.21.15.6:0/3424797248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28dc0b2490 0x7f28dc0cb050 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0cad20 tx=0x7f28cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5b58654ea4e640 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:37.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.682+0000 7f28dbfff700 1 -- 172.21.15.6:0/3424797248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc00e070 con 0x7f28dc0b2490 2023-10-06T02:28:37.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.682+0000 7f28dbfff700 1 -- 172.21.15.6:0/3424797248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc00ba50 con 0x7f28dc0b2490 2023-10-06T02:28:37.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.682+0000 7f28dbfff700 1 -- 172.21.15.6:0/3424797248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0092e0 con 0x7f28dc0b2490 2023-10-06T02:28:37.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.682+0000 7f28e36af700 1 -- 172.21.15.6:0/3424797248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28dc0b2490 msgr2=0x7f28dc0cb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:37.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.682+0000 7f28e36af700 1 --2- 172.21.15.6:0/3424797248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28dc0b2490 0x7f28dc0cb050 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0cad20 tx=0x7f28cc009840 comp rx=0 tx=0).stop 2023-10-06T02:28:37.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.683+0000 7f28e36af700 1 -- 172.21.15.6:0/3424797248 shutdown_connections 2023-10-06T02:28:37.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.683+0000 7f28e36af700 1 --2- 172.21.15.6:0/3424797248 >> v2:172.21.15.175:3300/0 conn(0x7f28dc159150 0x7f28dc1595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.683+0000 7f28e36af700 1 --2- 172.21.15.6:0/3424797248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28dc0b2490 0x7f28dc0cb050 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.683+0000 7f28e36af700 1 --2- 172.21.15.6:0/3424797248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28dc0b2860 0x7f28dc0b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.683+0000 7f28e36af700 1 -- 172.21.15.6:0/3424797248 >> 172.21.15.6:0/3424797248 conn(0x7f28dc068680 msgr2=0x7f28dc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:37.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.683+0000 7f28e36af700 1 -- 172.21.15.6:0/3424797248 shutdown_connections 2023-10-06T02:28:37.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.683+0000 7f28e36af700 1 -- 172.21.15.6:0/3424797248 wait complete. 2023-10-06T02:28:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.684+0000 7f28e36af700 1 Processor -- start 2023-10-06T02:28:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.684+0000 7f28e36af700 1 -- start start 2023-10-06T02:28:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e36af700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28dc0b2490 0x7f28dc0c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e36af700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28dc0b2860 0x7f28dc0c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e36af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28dc159150 0x7f28dc0af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e36af700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc152b60 con 0x7f28dc159150 2023-10-06T02:28:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e36af700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc1526d0 con 0x7f28dc0b2860 2023-10-06T02:28:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e36af700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0c67b0 con 0x7f28dc0b2490 2023-10-06T02:28:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e1c4c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28dc159150 0x7f28dc0af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:37.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e1c4c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28dc159150 0x7f28dc0af240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48060/0 (socket says 172.21.15.6:48060) 2023-10-06T02:28:37.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e1c4c700 1 -- 172.21.15.6:0/3781476369 learned_addr learned my addr 172.21.15.6:0/3781476369 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:37.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e144b700 1 --2- 172.21.15.6:0/3781476369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28dc0b2490 0x7f28dc0c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:37.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e0c4a700 1 --2- 172.21.15.6:0/3781476369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28dc0b2860 0x7f28dc0c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:37.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e1c4c700 1 -- 172.21.15.6:0/3781476369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28dc0b2490 msgr2=0x7f28dc0c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:37.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e1c4c700 1 --2- 172.21.15.6:0/3781476369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28dc0b2490 0x7f28dc0c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e1c4c700 1 -- 172.21.15.6:0/3781476369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28dc0b2860 msgr2=0x7f28dc0c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:37.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e1c4c700 1 --2- 172.21.15.6:0/3781476369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28dc0b2860 0x7f28dc0c4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e1c4c700 1 -- 172.21.15.6:0/3781476369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc009ae0 con 0x7f28dc159150 2023-10-06T02:28:37.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e1c4c700 1 --2- 172.21.15.6:0/3781476369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28dc159150 0x7f28dc0af240 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f28d400d860 tx=0x7f28d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:37.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28d97fa700 1 -- 172.21.15.6:0/3781476369 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d40125f0 con 0x7f28dc159150 2023-10-06T02:28:37.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28d97fa700 1 -- 172.21.15.6:0/3781476369 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d4012790 con 0x7f28dc159150 2023-10-06T02:28:37.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28e36af700 1 -- 172.21.15.6:0/3781476369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28dc1517e0 con 0x7f28dc159150 2023-10-06T02:28:37.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.685+0000 7f28d97fa700 1 -- 172.21.15.6:0/3781476369 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4012b50 con 0x7f28dc159150 2023-10-06T02:28:37.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.686+0000 7f28e36af700 1 -- 172.21.15.6:0/3781476369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28dc151da0 con 0x7f28dc159150 2023-10-06T02:28:37.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.686+0000 7f28e36af700 1 -- 172.21.15.6:0/3781476369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28dc152840 con 0x7f28dc159150 2023-10-06T02:28:37.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.687+0000 7f28d97fa700 1 -- 172.21.15.6:0/3781476369 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28d4013480 con 0x7f28dc159150 2023-10-06T02:28:37.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.687+0000 7f28d97fa700 1 --2- 172.21.15.6:0/3781476369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f28c8066f30 0x7f28c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:37.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.687+0000 7f28d97fa700 1 -- 172.21.15.6:0/3781476369 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7f28d40855b0 con 0x7f28dc159150 2023-10-06T02:28:37.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.687+0000 7f28e144b700 1 --2- 172.21.15.6:0/3781476369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f28c8066f30 0x7f28c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.688+0000 7f28e144b700 1 --2- 172.21.15.6:0/3781476369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f28c8066f30 0x7f28c80693e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009880 tx=0x7f28cc018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.692+0000 7f28d97fa700 1 -- 172.21.15.6:0/3781476369 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28d4051a30 con 0x7f28dc159150 2023-10-06T02:28:37.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.933+0000 7f28e36af700 1 -- 172.21.15.6:0/3781476369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f28dc0cbed0 con 0x7f28dc159150 2023-10-06T02:28:37.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.969+0000 7f28d97fa700 1 -- 172.21.15.6:0/3781476369 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v299) v1 ==== 161+0+0 (secure 0 0 0) 0x7f28d4055050 con 0x7f28dc159150 2023-10-06T02:28:37.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.972+0000 7f28e36af700 1 -- 172.21.15.6:0/3781476369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f28c8066f30 msgr2=0x7f28c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:37.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.972+0000 7f28e36af700 1 --2- 172.21.15.6:0/3781476369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f28c8066f30 0x7f28c80693e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009880 tx=0x7f28cc018000 comp rx=0 tx=0).stop 2023-10-06T02:28:37.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.972+0000 7f28e36af700 1 -- 172.21.15.6:0/3781476369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28dc159150 msgr2=0x7f28dc0af240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:37.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.972+0000 7f28e36af700 1 --2- 172.21.15.6:0/3781476369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28dc159150 0x7f28dc0af240 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f28d400d860 tx=0x7f28d4008040 comp rx=0 tx=0).stop 2023-10-06T02:28:37.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.972+0000 7f28e36af700 1 -- 172.21.15.6:0/3781476369 shutdown_connections 2023-10-06T02:28:37.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.972+0000 7f28e36af700 1 --2- 172.21.15.6:0/3781476369 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f28c8066f30 0x7f28c80693e0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.972+0000 7f28e36af700 1 --2- 172.21.15.6:0/3781476369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28dc159150 0x7f28dc0af240 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.972+0000 7f28e36af700 1 --2- 172.21.15.6:0/3781476369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28dc0b2490 0x7f28dc0c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.972+0000 7f28e36af700 1 --2- 172.21.15.6:0/3781476369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28dc0b2860 0x7f28dc0c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:37.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.972+0000 7f28e36af700 1 -- 172.21.15.6:0/3781476369 >> 172.21.15.6:0/3781476369 conn(0x7f28dc068680 msgr2=0x7f28dc0d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:37.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.972+0000 7f28e36af700 1 -- 172.21.15.6:0/3781476369 shutdown_connections 2023-10-06T02:28:37.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:37.972+0000 7f28e36af700 1 -- 172.21.15.6:0/3781476369 wait complete. 2023-10-06T02:28:37.974 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:28:37.984 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:28:38.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.103+0000 7f6673370700 1 Processor -- start 2023-10-06T02:28:38.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.104+0000 7f6673370700 1 -- start start 2023-10-06T02:28:38.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.104+0000 7f6673370700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f666c06b7e0 0x7f666c0cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.104+0000 7f6673370700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f666c06bbb0 0x7f666c06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.104+0000 7f6673370700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f666c06cff0 0x7f666c06d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.104+0000 7f6673370700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f666c0c90d0 con 0x7f666c06bbb0 2023-10-06T02:28:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.104+0000 7f6673370700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f666c0c7c60 con 0x7f666c06cff0 2023-10-06T02:28:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.104+0000 7f6673370700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666c0c7980 con 0x7f666c06b7e0 2023-10-06T02:28:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.105+0000 7f667090b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f666c06bbb0 0x7f666c06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.105+0000 7f667090b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f666c06bbb0 0x7f666c06cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48068/0 (socket says 172.21.15.6:48068) 2023-10-06T02:28:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.105+0000 7f667090b700 1 -- 172.21.15.6:0/620658379 learned_addr learned my addr 172.21.15.6:0/620658379 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.105+0000 7f667190d700 1 --2- 172.21.15.6:0/620658379 >> v2:172.21.15.175:3300/0 conn(0x7f666c06cff0 0x7f666c06d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.105+0000 7f667110c700 1 --2- 172.21.15.6:0/620658379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f666c06b7e0 0x7f666c0cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.105+0000 7f667090b700 1 -- 172.21.15.6:0/620658379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f666c06b7e0 msgr2=0x7f666c0cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.105+0000 7f667090b700 1 --2- 172.21.15.6:0/620658379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f666c06b7e0 0x7f666c0cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.105+0000 7f667090b700 1 -- 172.21.15.6:0/620658379 >> v2:172.21.15.175:3300/0 conn(0x7f666c06cff0 msgr2=0x7f666c06d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.105+0000 7f667090b700 1 --2- 172.21.15.6:0/620658379 >> v2:172.21.15.175:3300/0 conn(0x7f666c06cff0 0x7f666c06d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.105+0000 7f667090b700 1 -- 172.21.15.6:0/620658379 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c0c9350 con 0x7f666c06bbb0 2023-10-06T02:28:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.105+0000 7f667090b700 1 --2- 172.21.15.6:0/620658379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f666c06bbb0 0x7f666c06cab0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f666000bc50 tx=0x7f666000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e7b3006f93bb43 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.105+0000 7f666bfff700 1 -- 172.21.15.6:0/620658379 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666000be60 con 0x7f666c06bbb0 2023-10-06T02:28:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.105+0000 7f666bfff700 1 -- 172.21.15.6:0/620658379 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666000ddc0 con 0x7f666c06bbb0 2023-10-06T02:28:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.105+0000 7f666bfff700 1 -- 172.21.15.6:0/620658379 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66600196b0 con 0x7f666c06bbb0 2023-10-06T02:28:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.106+0000 7f6673370700 1 -- 172.21.15.6:0/620658379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f666c06bbb0 msgr2=0x7f666c06cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.106+0000 7f6673370700 1 --2- 172.21.15.6:0/620658379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f666c06bbb0 0x7f666c06cab0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f666000bc50 tx=0x7f666000b4f0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.106+0000 7f6673370700 1 -- 172.21.15.6:0/620658379 shutdown_connections 2023-10-06T02:28:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.106+0000 7f6673370700 1 --2- 172.21.15.6:0/620658379 >> v2:172.21.15.175:3300/0 conn(0x7f666c06cff0 0x7f666c06d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.106+0000 7f6673370700 1 --2- 172.21.15.6:0/620658379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f666c06b7e0 0x7f666c0cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.106+0000 7f6673370700 1 --2- 172.21.15.6:0/620658379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f666c06bbb0 0x7f666c06cab0 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.106+0000 7f6673370700 1 -- 172.21.15.6:0/620658379 >> 172.21.15.6:0/620658379 conn(0x7f666c06a260 msgr2=0x7f666c0cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.106+0000 7f6673370700 1 -- 172.21.15.6:0/620658379 shutdown_connections 2023-10-06T02:28:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.106+0000 7f6673370700 1 -- 172.21.15.6:0/620658379 wait complete. 2023-10-06T02:28:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.107+0000 7f6673370700 1 Processor -- start 2023-10-06T02:28:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.107+0000 7f6673370700 1 -- start start 2023-10-06T02:28:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f6673370700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f666c06b7e0 0x7f666c155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f6673370700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f666c06bbb0 0x7f666c165c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f6673370700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f666c06cff0 0x7f666c0c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f6673370700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c0c4ab0 con 0x7f666c06cff0 2023-10-06T02:28:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f6673370700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c155e90 con 0x7f666c06bbb0 2023-10-06T02:28:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f6673370700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666c0c6fa0 con 0x7f666c06b7e0 2023-10-06T02:28:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f667190d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f666c06cff0 0x7f666c0c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f667190d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f666c06cff0 0x7f666c0c6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48082/0 (socket says 172.21.15.6:48082) 2023-10-06T02:28:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f667190d700 1 -- 172.21.15.6:0/4088186340 learned_addr learned my addr 172.21.15.6:0/4088186340 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f667110c700 1 --2- 172.21.15.6:0/4088186340 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f666c06b7e0 0x7f666c155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f667090b700 1 --2- 172.21.15.6:0/4088186340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f666c06bbb0 0x7f666c165c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f667190d700 1 -- 172.21.15.6:0/4088186340 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f666c06b7e0 msgr2=0x7f666c155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f667190d700 1 --2- 172.21.15.6:0/4088186340 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f666c06b7e0 0x7f666c155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f667190d700 1 -- 172.21.15.6:0/4088186340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f666c06bbb0 msgr2=0x7f666c165c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f667190d700 1 --2- 172.21.15.6:0/4088186340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f666c06bbb0 0x7f666c165c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f667190d700 1 -- 172.21.15.6:0/4088186340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666000b790 con 0x7f666c06cff0 2023-10-06T02:28:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f667110c700 1 --2- 172.21.15.6:0/4088186340 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f666c06b7e0 0x7f666c155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f667090b700 1 --2- 172.21.15.6:0/4088186340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f666c06bbb0 0x7f666c165c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.108+0000 7f667190d700 1 --2- 172.21.15.6:0/4088186340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f666c06cff0 0x7f666c0c6500 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f665c009fa0 tx=0x7f665c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.109+0000 7f66697fa700 1 -- 172.21.15.6:0/4088186340 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c00ed20 con 0x7f666c06cff0 2023-10-06T02:28:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.109+0000 7f66697fa700 1 -- 172.21.15.6:0/4088186340 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665c00ee80 con 0x7f666c06cff0 2023-10-06T02:28:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.109+0000 7f66697fa700 1 -- 172.21.15.6:0/4088186340 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c014670 con 0x7f666c06cff0 2023-10-06T02:28:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.109+0000 7f6673370700 1 -- 172.21.15.6:0/4088186340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f666c0c4180 con 0x7f666c06cff0 2023-10-06T02:28:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.109+0000 7f6673370700 1 -- 172.21.15.6:0/4088186340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f666c0c4740 con 0x7f666c06cff0 2023-10-06T02:28:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.110+0000 7f6673370700 1 -- 172.21.15.6:0/4088186340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f666c0c4c20 con 0x7f666c06cff0 2023-10-06T02:28:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.110+0000 7f66697fa700 1 -- 172.21.15.6:0/4088186340 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f665c0149e0 con 0x7f666c06cff0 2023-10-06T02:28:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.110+0000 7f66697fa700 1 --2- 172.21.15.6:0/4088186340 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6658066f30 0x7f66580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.111+0000 7f66697fa700 1 -- 172.21.15.6:0/4088186340 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7f665c085b10 con 0x7f666c06cff0 2023-10-06T02:28:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.111+0000 7f667110c700 1 --2- 172.21.15.6:0/4088186340 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6658066f30 0x7f66580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.111+0000 7f667110c700 1 --2- 172.21.15.6:0/4088186340 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6658066f30 0x7f66580693e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f6664009990 tx=0x7f6664008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.115+0000 7f66697fa700 1 -- 172.21.15.6:0/4088186340 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f665c051f90 con 0x7f666c06cff0 2023-10-06T02:28:38.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.391+0000 7f6673370700 1 -- 172.21.15.6:0/4088186340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f666c150910 con 0x7f666c06cff0 2023-10-06T02:28:38.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.980+0000 7f66697fa700 1 -- 172.21.15.6:0/4088186340 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v300) v1 ==== 101+0+0 (secure 0 0 0) 0x7f665c0555b0 con 0x7f666c06cff0 2023-10-06T02:28:38.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.982+0000 7f6673370700 1 -- 172.21.15.6:0/4088186340 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6658066f30 msgr2=0x7f66580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:38.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.982+0000 7f6673370700 1 --2- 172.21.15.6:0/4088186340 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6658066f30 0x7f66580693e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f6664009990 tx=0x7f6664008040 comp rx=0 tx=0).stop 2023-10-06T02:28:38.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.982+0000 7f6673370700 1 -- 172.21.15.6:0/4088186340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f666c06cff0 msgr2=0x7f666c0c6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:38.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.982+0000 7f6673370700 1 --2- 172.21.15.6:0/4088186340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f666c06cff0 0x7f666c0c6500 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f665c009fa0 tx=0x7f665c009900 comp rx=0 tx=0).stop 2023-10-06T02:28:38.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.982+0000 7f6673370700 1 -- 172.21.15.6:0/4088186340 shutdown_connections 2023-10-06T02:28:38.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.982+0000 7f6673370700 1 --2- 172.21.15.6:0/4088186340 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6658066f30 0x7f66580693e0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.982+0000 7f6673370700 1 --2- 172.21.15.6:0/4088186340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f666c06cff0 0x7f666c0c6500 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.982+0000 7f6673370700 1 --2- 172.21.15.6:0/4088186340 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f666c06b7e0 0x7f666c155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.982+0000 7f6673370700 1 --2- 172.21.15.6:0/4088186340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f666c06bbb0 0x7f666c165c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.982+0000 7f6673370700 1 -- 172.21.15.6:0/4088186340 >> 172.21.15.6:0/4088186340 conn(0x7f666c06a260 msgr2=0x7f666c14ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:38.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.982+0000 7f6673370700 1 -- 172.21.15.6:0/4088186340 shutdown_connections 2023-10-06T02:28:38.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:38.982+0000 7f6673370700 1 -- 172.21.15.6:0/4088186340 wait complete. 2023-10-06T02:28:38.984 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:28:38.996 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:28:39.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.034+0000 7efff50b0000 1 Processor -- start 2023-10-06T02:28:39.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.035+0000 7efff50b0000 1 -- start start 2023-10-06T02:28:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.035+0000 7efff50b0000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611191f3850 0x561119296150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.035+0000 7efff50b0000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611191f5ab0 0x56111920f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.035+0000 7efff50b0000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611191f5e80 0x5611192103d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.035+0000 7efff50b0000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561119111980 con 0x5611191f5ab0 2023-10-06T02:28:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.035+0000 7efff50b0000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561119111620 con 0x5611191f5e80 2023-10-06T02:28:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.035+0000 7efff50b0000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561119108400 con 0x5611191f3850 2023-10-06T02:28:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.035+0000 7effedaea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611191f5ab0 0x56111920f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.035+0000 7effedaea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611191f5ab0 0x56111920f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34184/0 (socket says 172.21.15.6:34184) 2023-10-06T02:28:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.035+0000 7effedaea700 1 -- 172.21.15.6:0/541039002 learned_addr learned my addr 172.21.15.6:0/541039002 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7effee2eb700 1 --2- 172.21.15.6:0/541039002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611191f3850 0x561119296150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7effeeaec700 1 --2- 172.21.15.6:0/541039002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611191f5e80 0x5611192103d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7effedaea700 1 -- 172.21.15.6:0/541039002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611191f3850 msgr2=0x561119296150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7effedaea700 1 --2- 172.21.15.6:0/541039002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611191f3850 0x561119296150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7effedaea700 1 -- 172.21.15.6:0/541039002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611191f5e80 msgr2=0x5611192103d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7effedaea700 1 --2- 172.21.15.6:0/541039002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611191f5e80 0x5611192103d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7effedaea700 1 -- 172.21.15.6:0/541039002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd8005cf0 con 0x5611191f5ab0 2023-10-06T02:28:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7effeeaec700 1 --2- 172.21.15.6:0/541039002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611191f5e80 0x5611192103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7effedaea700 1 --2- 172.21.15.6:0/541039002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611191f5ab0 0x56111920f800 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7effd800add0 tx=0x7effd8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b70d2ce4a7e0fff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7effecae8700 1 -- 172.21.15.6:0/541039002 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd8000bc0 con 0x5611191f5ab0 2023-10-06T02:28:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7effecae8700 1 -- 172.21.15.6:0/541039002 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd80089d0 con 0x5611191f5ab0 2023-10-06T02:28:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7effecae8700 1 -- 172.21.15.6:0/541039002 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd8000d20 con 0x5611191f5ab0 2023-10-06T02:28:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7efff50b0000 1 -- 172.21.15.6:0/541039002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611191f5ab0 msgr2=0x56111920f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7efff50b0000 1 --2- 172.21.15.6:0/541039002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611191f5ab0 0x56111920f800 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7effd800add0 tx=0x7effd8016000 comp rx=0 tx=0).stop 2023-10-06T02:28:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7efff50b0000 1 -- 172.21.15.6:0/541039002 shutdown_connections 2023-10-06T02:28:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7efff50b0000 1 --2- 172.21.15.6:0/541039002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611191f5e80 0x5611192103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7efff50b0000 1 --2- 172.21.15.6:0/541039002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611191f3850 0x561119296150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.036+0000 7efff50b0000 1 --2- 172.21.15.6:0/541039002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611191f5ab0 0x56111920f800 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.037+0000 7efff50b0000 1 -- 172.21.15.6:0/541039002 >> 172.21.15.6:0/541039002 conn(0x56111920dbd0 msgr2=0x5611191f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.037+0000 7efff50b0000 1 -- 172.21.15.6:0/541039002 shutdown_connections 2023-10-06T02:28:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.037+0000 7efff50b0000 1 -- 172.21.15.6:0/541039002 wait complete. 2023-10-06T02:28:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.037+0000 7efff50b0000 1 Processor -- start 2023-10-06T02:28:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.037+0000 7efff50b0000 1 -- start start 2023-10-06T02:28:39.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7efff50b0000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611191f3850 0x56111920cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7efff50b0000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611191f5ab0 0x5611192936d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7efff50b0000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611191f5e80 0x561119293c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7efff50b0000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611192addf0 con 0x5611191f5e80 2023-10-06T02:28:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7efff50b0000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611192ae090 con 0x5611191f3850 2023-10-06T02:28:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7efff50b0000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611192ae330 con 0x5611191f5ab0 2023-10-06T02:28:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7effeeaec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611191f5e80 0x561119293c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7effeeaec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611191f5e80 0x561119293c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34192/0 (socket says 172.21.15.6:34192) 2023-10-06T02:28:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 learned_addr learned my addr 172.21.15.6:0/1359082197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7effee2eb700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611191f3850 0x56111920cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7effedaea700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611191f5ab0 0x5611192936d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611191f5ab0 msgr2=0x5611192936d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7effeeaec700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611191f5ab0 0x5611192936d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611191f3850 msgr2=0x56111920cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7effeeaec700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611191f3850 0x56111920cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56111913a1c0 con 0x5611191f5e80 2023-10-06T02:28:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7effedaea700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611191f5ab0 0x5611192936d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.038+0000 7effee2eb700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611191f3850 0x56111920cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.039+0000 7effeeaec700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611191f5e80 0x561119293c10 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7effe000d4f0 tx=0x7effe0007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.039+0000 7effe6ffd700 1 -- 172.21.15.6:0/1359082197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe000b070 con 0x5611191f5e80 2023-10-06T02:28:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.039+0000 7effe6ffd700 1 -- 172.21.15.6:0/1359082197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe0008e30 con 0x5611191f5e80 2023-10-06T02:28:39.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.039+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5611191203d0 con 0x5611191f5e80 2023-10-06T02:28:39.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.039+0000 7effe6ffd700 1 -- 172.21.15.6:0/1359082197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0012640 con 0x5611191f5e80 2023-10-06T02:28:39.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.039+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561119113ae0 con 0x5611191f5e80 2023-10-06T02:28:39.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.040+0000 7effe6ffd700 1 -- 172.21.15.6:0/1359082197 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7effe00129b0 con 0x5611191f5e80 2023-10-06T02:28:39.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.040+0000 7effe6ffd700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7effd00658c0 0x7effd0067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.041+0000 7effe6ffd700 1 -- 172.21.15.6:0/1359082197 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7effe0083e80 con 0x5611191f5e80 2023-10-06T02:28:39.046 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:28:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.041+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56111920d040 0x561119296230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.041+0000 7effee2eb700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7effd00658c0 0x7effd0067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.041+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x561119296770 con 0x56111920d040 2023-10-06T02:28:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.041+0000 7effedaea700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56111920d040 0x561119296230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.041+0000 7effedaea700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56111920d040 0x561119296230 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.041+0000 7effee2eb700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7effd00658c0 0x7effd0067d70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7effe8001ed0 tx=0x7effe8001820 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.043+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v128'1002 uv976 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.043+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x561119296b50 con 0x56111920d040 2023-10-06T02:28:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.045+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v128'1003 uv1003 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.045+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x561119296f90 con 0x56111920d040 2023-10-06T02:28:39.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.046+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v128'1004 uv1004 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.051 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:28:39.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.046+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b8ce0 con 0x56111920d040 2023-10-06T02:28:39.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.047+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v128'1005 uv1005 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.047+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b9090 con 0x56111920d040 2023-10-06T02:28:39.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.048+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v128'1006 uv1006 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.048+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b7cd0 con 0x56111920d040 2023-10-06T02:28:39.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.050+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v128'1007 uv1007 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.050+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b8080 con 0x56111920d040 2023-10-06T02:28:39.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.051+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v128'1008 uv982 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.051+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b8430 con 0x56111920d040 2023-10-06T02:28:39.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.052+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v128'1009 uv1009 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.052+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b8430 con 0x56111920d040 2023-10-06T02:28:39.054 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:28:39.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.054+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v128'1010 uv1010 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.054+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b8430 con 0x56111920d040 2023-10-06T02:28:39.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.055+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v128'1011 uv1011 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.055+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b8430 con 0x56111920d040 2023-10-06T02:28:39.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.056+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v128'1012 uv1012 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.056+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b8430 con 0x56111920d040 2023-10-06T02:28:39.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.057+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v128'1013 uv1013 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.057+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b8430 con 0x56111920d040 2023-10-06T02:28:39.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.058+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v128'1014 uv989 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.058+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b8430 con 0x56111920d040 2023-10-06T02:28:39.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.060+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v128'1015 uv1015 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.060+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b8430 con 0x56111920d040 2023-10-06T02:28:39.061 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:28:39.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.061+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v128'1016 uv1016 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.061+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b8430 con 0x56111920d040 2023-10-06T02:28:39.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.062+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v128'1017 uv1017 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.062+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b8430 con 0x56111920d040 2023-10-06T02:28:39.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.064+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v128'1018 uv1018 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.064+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b8430 con 0x56111920d040 2023-10-06T02:28:39.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.065+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v128'1019 uv1019 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.065+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b9440 con 0x56111920d040 2023-10-06T02:28:39.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.066+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v128'1020 uv1020 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.066+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b9440 con 0x56111920d040 2023-10-06T02:28:39.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.068+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v128'1021 uv995 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.068+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b9440 con 0x56111920d040 2023-10-06T02:28:39.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.069+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v128'1022 uv1022 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.069+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b9440 con 0x56111920d040 2023-10-06T02:28:39.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.070+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v128'1023 uv1023 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.071 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:28:39.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.070+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192ba450 con 0x56111920d040 2023-10-06T02:28:39.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.071+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v128'1024 uv1024 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.071+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192ba450 con 0x56111920d040 2023-10-06T02:28:39.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.073+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v128'1025 uv1025 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.073+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b9440 con 0x56111920d040 2023-10-06T02:28:39.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.074+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v128'1026 uv1026 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.074+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b9440 con 0x56111920d040 2023-10-06T02:28:39.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.075+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v128'1027 uv1001 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.076+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b9440 con 0x56111920d040 2023-10-06T02:28:39.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.077+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v128'1028 uv1028 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.077+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b9440 con 0x56111920d040 2023-10-06T02:28:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.078+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v128'1029 uv1029 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.079 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:28:39.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.078+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192ba450 con 0x56111920d040 2023-10-06T02:28:39.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.079+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v128'1030 uv1030 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.079+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192ba450 con 0x56111920d040 2023-10-06T02:28:39.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.080+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v128'1031 uv1031 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.080+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192b9440 con 0x56111920d040 2023-10-06T02:28:39.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.083+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v128'1032 uv1032 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x56111920d040 2023-10-06T02:28:39.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.083+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5611192b9950 0x5611192bbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.083+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bc270 con 0x5611192b9950 2023-10-06T02:28:39.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.084+0000 7effee2eb700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5611192b9950 0x5611192bbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.084+0000 7effee2eb700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5611192b9950 0x5611192bbd30 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.086+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v128'719 uv701 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.086+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bc620 con 0x5611192b9950 2023-10-06T02:28:39.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.087+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v128'720 uv720 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.087+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bc9d0 con 0x5611192b9950 2023-10-06T02:28:39.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.088+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v128'721 uv721 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.089 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:28:39.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.088+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bd270 con 0x5611192b9950 2023-10-06T02:28:39.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.089+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v128'722 uv722 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.089+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bd620 con 0x5611192b9950 2023-10-06T02:28:39.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.091+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v128'723 uv723 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.091+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bd9d0 con 0x5611192b9950 2023-10-06T02:28:39.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.092+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v128'724 uv706 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.092+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bdd80 con 0x5611192b9950 2023-10-06T02:28:39.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.093+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v128'725 uv725 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.093+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bdd80 con 0x5611192b9950 2023-10-06T02:28:39.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.094+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v128'726 uv726 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.095 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:28:39.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.094+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bdd80 con 0x5611192b9950 2023-10-06T02:28:39.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.095+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v128'727 uv727 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.095+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bdd80 con 0x5611192b9950 2023-10-06T02:28:39.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.096+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v128'728 uv728 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.096+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bdd80 con 0x5611192b9950 2023-10-06T02:28:39.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.098+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v128'729 uv711 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.098+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bdd80 con 0x5611192b9950 2023-10-06T02:28:39.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.099+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v128'730 uv730 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.099+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bdd80 con 0x5611192b9950 2023-10-06T02:28:39.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.100+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v128'731 uv731 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.101 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:28:39.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.100+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c14a0 con 0x5611192b9950 2023-10-06T02:28:39.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.101+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v128'732 uv732 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.101+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c14a0 con 0x5611192b9950 2023-10-06T02:28:39.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.102+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v128'733 uv733 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.102+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bdd80 con 0x5611192b9950 2023-10-06T02:28:39.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.104+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v128'734 uv717 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.104+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bdd80 con 0x5611192b9950 2023-10-06T02:28:39.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.105+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v128'735 uv735 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.105+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bdd80 con 0x5611192b9950 2023-10-06T02:28:39.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.106+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v128'736 uv736 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.106 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:28:39.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.106+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bed90 con 0x5611192b9950 2023-10-06T02:28:39.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.107+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v128'737 uv737 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.107+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bed90 con 0x5611192b9950 2023-10-06T02:28:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.108+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v128'738 uv738 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.108+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192bdd80 con 0x5611192b9950 2023-10-06T02:28:39.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.109+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v128'739 uv739 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.109+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5611192be290 0x5611192c0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.109+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c0bb0 con 0x5611192be290 2023-10-06T02:28:39.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.109+0000 7effedaea700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5611192be290 0x5611192c0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.109+0000 7effedaea700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5611192be290 0x5611192c0670 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.110+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v128'195 uv194 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.110+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c0bb0 con 0x5611192be290 2023-10-06T02:28:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.111+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v128'196 uv196 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.111+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c1070 con 0x5611192be290 2023-10-06T02:28:39.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.112+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v128'197 uv197 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.113 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:28:39.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.112+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c2080 con 0x5611192be290 2023-10-06T02:28:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.114+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v128'198 uv198 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.114+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c2080 con 0x5611192be290 2023-10-06T02:28:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.114+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v128'199 uv199 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.114+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c1070 con 0x5611192be290 2023-10-06T02:28:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.115+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v128'200 uv200 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.115+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c1070 con 0x5611192be290 2023-10-06T02:28:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.116+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v128'139 uv138 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.116+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c1070 con 0x5611192be290 2023-10-06T02:28:39.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.117+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v128'140 uv140 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.117+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c1070 con 0x5611192be290 2023-10-06T02:28:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.118+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v128'141 uv141 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.119 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:28:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.118+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c1070 con 0x5611192be290 2023-10-06T02:28:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.119+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v128'142 uv142 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.119+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c1070 con 0x5611192b9950 2023-10-06T02:28:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.120+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v128'195 uv194 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.120+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c1070 con 0x5611192b9950 2023-10-06T02:28:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.121+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v128'196 uv196 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.121+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c1070 con 0x5611192b9950 2023-10-06T02:28:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.122+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v128'197 uv197 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.123 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:28:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.122+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c2080 con 0x5611192b9950 2023-10-06T02:28:39.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.123+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v128'198 uv198 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.123+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c2080 con 0x5611192b9950 2023-10-06T02:28:39.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.124+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v128'199 uv199 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.124+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c1070 con 0x5611192b9950 2023-10-06T02:28:39.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.125+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v128'200 uv200 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192b9950 2023-10-06T02:28:39.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.125+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5611192c16f0 0x5611192c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.126+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c40a0 con 0x5611192c16f0 2023-10-06T02:28:39.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.126+0000 7effeeaec700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5611192c16f0 0x5611192c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.126+0000 7effeeaec700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5611192c16f0 0x5611192c3ad0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.127+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v128'360 uv354 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192c16f0 2023-10-06T02:28:39.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.127+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c4550 con 0x5611192c16f0 2023-10-06T02:28:39.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.128+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v128'361 uv361 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192c16f0 2023-10-06T02:28:39.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.129+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c4a40 con 0x5611192c16f0 2023-10-06T02:28:39.132 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:28:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.131+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v128'362 uv362 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192c16f0 2023-10-06T02:28:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.131+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c6340 con 0x5611192c16f0 2023-10-06T02:28:39.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.132+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v128'363 uv363 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192c16f0 2023-10-06T02:28:39.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.132+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c66f0 con 0x5611192c16f0 2023-10-06T02:28:39.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.133+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v128'364 uv364 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192c16f0 2023-10-06T02:28:39.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.134+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c5330 con 0x5611192c16f0 2023-10-06T02:28:39.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.135+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v128'365 uv365 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192c16f0 2023-10-06T02:28:39.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.135+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c5730 con 0x5611192c16f0 2023-10-06T02:28:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.136+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v128'366 uv359 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192c16f0 2023-10-06T02:28:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.136+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c5b30 con 0x5611192c16f0 2023-10-06T02:28:39.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.137+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v128'367 uv367 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192c16f0 2023-10-06T02:28:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.137+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c5b30 con 0x5611192c16f0 2023-10-06T02:28:39.138 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:28:39.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.138+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v128'368 uv368 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192c16f0 2023-10-06T02:28:39.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.138+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c5ae0 con 0x5611192c16f0 2023-10-06T02:28:39.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.139+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v128'369 uv369 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192c16f0 2023-10-06T02:28:39.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.139+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c5ae0 con 0x5611192c16f0 2023-10-06T02:28:39.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.141+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v128'370 uv370 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192c16f0 2023-10-06T02:28:39.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.141+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5611192c5ee0 0x5611192c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.141+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c9500 con 0x5611192c5ee0 2023-10-06T02:28:39.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.141+0000 7effee2eb700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5611192c5ee0 0x5611192c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.142+0000 7effee2eb700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5611192c5ee0 0x5611192c8fc0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.143+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v128'163 uv162 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192c5ee0 2023-10-06T02:28:39.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.143+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c9500 con 0x5611192c5ee0 2023-10-06T02:28:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.144+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v128'164 uv164 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192c5ee0 2023-10-06T02:28:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.144+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c9500 con 0x5611192c5ee0 2023-10-06T02:28:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:28:39.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.147+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v128'165 uv165 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192c5ee0 2023-10-06T02:28:39.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.147+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c9900 con 0x5611192c5ee0 2023-10-06T02:28:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.149+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v128'166 uv166 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192c5ee0 2023-10-06T02:28:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.149+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c9900 con 0x5611192c5ee0 2023-10-06T02:28:39.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.152+0000 7effee2eb700 1 -- 172.21.15.6:0/1359082197 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v128'167 uv167 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7effe800d920 con 0x5611192c5ee0 2023-10-06T02:28:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.152+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c9900 con 0x5611192be290 2023-10-06T02:28:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.153+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v128'195 uv194 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.153+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c9900 con 0x5611192be290 2023-10-06T02:28:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.154+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v128'196 uv196 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.154+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c9900 con 0x5611192be290 2023-10-06T02:28:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.155+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v128'197 uv197 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.156 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:28:39.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.155+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192ca910 con 0x5611192be290 2023-10-06T02:28:39.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.156+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v128'198 uv198 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.156+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192ca910 con 0x5611192be290 2023-10-06T02:28:39.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.157+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v128'199 uv199 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.157+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192c9900 con 0x5611192be290 2023-10-06T02:28:39.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.158+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v128'200 uv200 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.158+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5611192c9e10 0x5611192cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.158+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192cc800 con 0x5611192c9e10 2023-10-06T02:28:39.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.158+0000 7effedaea700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5611192c9e10 0x5611192cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.158+0000 7effedaea700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5611192c9e10 0x5611192cc1f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.160+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v128'325 uv318 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192c9e10 2023-10-06T02:28:39.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.160+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192ccbe0 con 0x5611192c9e10 2023-10-06T02:28:39.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.161+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v128'326 uv326 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192c9e10 2023-10-06T02:28:39.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.161+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192ccbe0 con 0x5611192c9e10 2023-10-06T02:28:39.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.162+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v128'327 uv327 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192c9e10 2023-10-06T02:28:39.162 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:28:39.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.162+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192ccbe0 con 0x5611192c9e10 2023-10-06T02:28:39.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.163+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v128'328 uv328 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192c9e10 2023-10-06T02:28:39.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.163+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192ccbe0 con 0x5611192c9e10 2023-10-06T02:28:39.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.164+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v128'329 uv329 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192c9e10 2023-10-06T02:28:39.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.164+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192ccbe0 con 0x5611192c9e10 2023-10-06T02:28:39.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.166+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v128'330 uv324 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192c9e10 2023-10-06T02:28:39.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.166+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192ccbe0 con 0x5611192c9e10 2023-10-06T02:28:39.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.167+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v128'331 uv331 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192c9e10 2023-10-06T02:28:39.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.167+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192ccbe0 con 0x5611192c9e10 2023-10-06T02:28:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.168+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v128'332 uv332 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192c9e10 2023-10-06T02:28:39.169 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:28:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.168+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192ccbe0 con 0x5611192c9e10 2023-10-06T02:28:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.169+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v128'333 uv333 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192c9e10 2023-10-06T02:28:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.169+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192cf950 con 0x5611192c9e10 2023-10-06T02:28:39.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.170+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v128'334 uv334 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192c9e10 2023-10-06T02:28:39.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.170+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192cd0d0 con 0x5611192be290 2023-10-06T02:28:39.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.171+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v128'142 uv140 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.171+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192cd0d0 con 0x5611192be290 2023-10-06T02:28:39.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.172+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v128'143 uv143 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.172+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192cd0d0 con 0x5611192be290 2023-10-06T02:28:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.173+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v128'144 uv144 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.174 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:28:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.173+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192cd0d0 con 0x5611192be290 2023-10-06T02:28:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.174+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v128'145 uv145 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.174+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5611192cd5e0 0x5611192cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.174+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d00a0 con 0x5611192cd5e0 2023-10-06T02:28:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.174+0000 7effeeaec700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5611192cd5e0 0x5611192cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.175+0000 7effeeaec700 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5611192cd5e0 0x5611192cd9d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.176+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v128'195 uv194 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192cd5e0 2023-10-06T02:28:39.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.176+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d00a0 con 0x5611192cd5e0 2023-10-06T02:28:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.179+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v128'196 uv196 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192cd5e0 2023-10-06T02:28:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.179+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d00a0 con 0x5611192cd5e0 2023-10-06T02:28:39.180 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:28:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.180+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v128'197 uv197 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192cd5e0 2023-10-06T02:28:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.180+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d10b0 con 0x5611192cd5e0 2023-10-06T02:28:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.182+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v128'198 uv198 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192cd5e0 2023-10-06T02:28:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.182+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d10b0 con 0x5611192cd5e0 2023-10-06T02:28:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.183+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v128'199 uv199 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192cd5e0 2023-10-06T02:28:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.184+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d00a0 con 0x5611192cd5e0 2023-10-06T02:28:39.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.186+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v128'200 uv200 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192cd5e0 2023-10-06T02:28:39.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.186+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d00a0 con 0x5611192c16f0 2023-10-06T02:28:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.187+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v128'166 uv165 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192c16f0 2023-10-06T02:28:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.187+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d00a0 con 0x5611192c16f0 2023-10-06T02:28:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.188+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v128'167 uv167 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192c16f0 2023-10-06T02:28:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.188+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d00a0 con 0x5611192c16f0 2023-10-06T02:28:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.189+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v128'168 uv168 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192c16f0 2023-10-06T02:28:39.190 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:28:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.189+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192cccc0 con 0x5611192c16f0 2023-10-06T02:28:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.190+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v128'169 uv169 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192c16f0 2023-10-06T02:28:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.190+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d0590 con 0x5611192c16f0 2023-10-06T02:28:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.191+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v128'170 uv170 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7effe0018070 con 0x5611192c16f0 2023-10-06T02:28:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.191+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d0590 con 0x5611192be290 2023-10-06T02:28:39.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.192+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v128'402 uv393 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.192+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d0590 con 0x5611192be290 2023-10-06T02:28:39.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.193+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v128'403 uv403 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.193+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d0590 con 0x5611192be290 2023-10-06T02:28:39.195 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:28:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.194+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v128'404 uv404 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.194+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d0590 con 0x5611192be290 2023-10-06T02:28:39.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.195+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v128'405 uv405 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.195+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d0590 con 0x5611192be290 2023-10-06T02:28:39.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.196+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v128'406 uv406 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.196+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d0590 con 0x5611192be290 2023-10-06T02:28:39.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.197+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v128'407 uv400 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.197+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d0590 con 0x5611192be290 2023-10-06T02:28:39.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.198+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v128'408 uv408 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.198+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d0590 con 0x5611192be290 2023-10-06T02:28:39.199 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:28:39.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.199+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v128'409 uv409 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.199+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d15a0 con 0x5611192be290 2023-10-06T02:28:39.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.200+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v128'410 uv410 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.200+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d15a0 con 0x5611192be290 2023-10-06T02:28:39.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.201+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v128'411 uv411 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.201+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d0590 con 0x5611192be290 2023-10-06T02:28:39.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.202+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v128'412 uv412 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.202+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x5611192d0800 con 0x5611192be290 2023-10-06T02:28:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7effedaea700 1 -- 172.21.15.6:0/1359082197 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v128'413 uv413 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7effd8026670 con 0x5611192be290 2023-10-06T02:28:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5611192be290 msgr2=0x5611192c0670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5611192be290 0x5611192c0670 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56111920d040 msgr2=0x561119296230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56111920d040 0x561119296230 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5611192c9e10 msgr2=0x5611192cc1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5611192c9e10 0x5611192cc1f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5611192b9950 msgr2=0x5611192bbd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5611192b9950 0x5611192bbd30 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 reap_dead start 2023-10-06T02:28:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5611192cd5e0 msgr2=0x5611192cd9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5611192cd5e0 0x5611192cd9d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7effeeaec700 1 -- 172.21.15.6:0/1359082197 reap_dead start 2023-10-06T02:28:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5611192c5ee0 msgr2=0x5611192c8fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5611192c5ee0 0x5611192c8fc0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5611192c16f0 msgr2=0x5611192c3ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5611192c16f0 0x5611192c3ad0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7effd00658c0 msgr2=0x7effd0067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7effd00658c0 0x7effd0067d70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7effe8001ed0 tx=0x7effe8001820 comp rx=0 tx=0).stop 2023-10-06T02:28:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611191f5e80 msgr2=0x561119293c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611191f5e80 0x561119293c10 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7effe000d4f0 tx=0x7effe0007040 comp rx=0 tx=0).stop 2023-10-06T02:28:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 shutdown_connections 2023-10-06T02:28:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5611192c5ee0 0x5611192c8fc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5611192c16f0 0x5611192c3ad0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611191f5e80 0x561119293c10 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 --2- 172.21.15.6:0/1359082197 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7effd00658c0 0x7effd0067d70 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 >> 172.21.15.6:0/1359082197 conn(0x56111920dbd0 msgr2=0x5611191f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 shutdown_connections 2023-10-06T02:28:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.203+0000 7efff50b0000 1 -- 172.21.15.6:0/1359082197 wait complete. 2023-10-06T02:28:39.208 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 1.00000000 subdir_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2023-10-06T02:28:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.287+0000 7fda2e194000 1 Processor -- start 2023-10-06T02:28:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.287+0000 7fda2e194000 1 -- start start 2023-10-06T02:28:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.288+0000 7fda2e194000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19eaec8c0 0x55e19eb1e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.288+0000 7fda2e194000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19eb37e70 0x55e19eb34ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.288+0000 7fda2e194000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19ebaeb70 0x55e19ebc5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.288+0000 7fda2e194000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e19ea39620 con 0x55e19eaec8c0 2023-10-06T02:28:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.288+0000 7fda2e194000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e19ea30400 con 0x55e19eb37e70 2023-10-06T02:28:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.288+0000 7fda2e194000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e19eb33d80 con 0x55e19ebaeb70 2023-10-06T02:28:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.288+0000 7fda273cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19eaec8c0 0x55e19eb1e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.288+0000 7fda273cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19eaec8c0 0x55e19eb1e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34222/0 (socket says 172.21.15.6:34222) 2023-10-06T02:28:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.288+0000 7fda273cf700 1 -- 172.21.15.6:0/2213309058 learned_addr learned my addr 172.21.15.6:0/2213309058 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.288+0000 7fda27bd0700 1 --2- 172.21.15.6:0/2213309058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19ebaeb70 0x55e19ebc5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.288+0000 7fda26bce700 1 --2- 172.21.15.6:0/2213309058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19eb37e70 0x55e19eb34ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.288+0000 7fda273cf700 1 -- 172.21.15.6:0/2213309058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19ebaeb70 msgr2=0x55e19ebc5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:39.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.288+0000 7fda273cf700 1 --2- 172.21.15.6:0/2213309058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19ebaeb70 0x55e19ebc5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.288+0000 7fda273cf700 1 -- 172.21.15.6:0/2213309058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19eb37e70 msgr2=0x55e19eb34ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:39.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.288+0000 7fda273cf700 1 --2- 172.21.15.6:0/2213309058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19eb37e70 0x55e19eb34ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.288+0000 7fda273cf700 1 -- 172.21.15.6:0/2213309058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1800a180 con 0x55e19eaec8c0 2023-10-06T02:28:39.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.289+0000 7fda273cf700 1 --2- 172.21.15.6:0/2213309058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19eaec8c0 0x55e19eb1e9b0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x55e19eaef380 tx=0x7fda18011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c116e14689fc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.289+0000 7fda25bcc700 1 -- 172.21.15.6:0/2213309058 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1800ed60 con 0x55e19eaec8c0 2023-10-06T02:28:39.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.289+0000 7fda25bcc700 1 -- 172.21.15.6:0/2213309058 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda18000f40 con 0x55e19eaec8c0 2023-10-06T02:28:39.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.289+0000 7fda25bcc700 1 -- 172.21.15.6:0/2213309058 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1801c430 con 0x55e19eaec8c0 2023-10-06T02:28:39.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.289+0000 7fda2e194000 1 -- 172.21.15.6:0/2213309058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19eaec8c0 msgr2=0x55e19eb1e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.289+0000 7fda2e194000 1 --2- 172.21.15.6:0/2213309058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19eaec8c0 0x55e19eb1e9b0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x55e19eaef380 tx=0x7fda18011000 comp rx=0 tx=0).stop 2023-10-06T02:28:39.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.289+0000 7fda2e194000 1 -- 172.21.15.6:0/2213309058 shutdown_connections 2023-10-06T02:28:39.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.289+0000 7fda2e194000 1 --2- 172.21.15.6:0/2213309058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19ebaeb70 0x55e19ebc5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.289+0000 7fda2e194000 1 --2- 172.21.15.6:0/2213309058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19eaec8c0 0x55e19eb1e9b0 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.289+0000 7fda2e194000 1 --2- 172.21.15.6:0/2213309058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19eb37e70 0x55e19eb34ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.289+0000 7fda2e194000 1 -- 172.21.15.6:0/2213309058 >> 172.21.15.6:0/2213309058 conn(0x55e19eaef5c0 msgr2=0x55e19eaf19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:39.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.289+0000 7fda2e194000 1 -- 172.21.15.6:0/2213309058 shutdown_connections 2023-10-06T02:28:39.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.289+0000 7fda2e194000 1 -- 172.21.15.6:0/2213309058 wait complete. 2023-10-06T02:28:39.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.290+0000 7fda2e194000 1 Processor -- start 2023-10-06T02:28:39.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.290+0000 7fda2e194000 1 -- start start 2023-10-06T02:28:39.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda2e194000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19eaec8c0 0x55e19ebaba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda2e194000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19eb37e70 0x55e19eb1e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda2e194000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19ebaeb70 0x55e19eb34c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda2e194000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e19ebc6b40 con 0x55e19eaec8c0 2023-10-06T02:28:39.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda2e194000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e19ebc6de0 con 0x55e19eb37e70 2023-10-06T02:28:39.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda2e194000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e19ebc7080 con 0x55e19ebaeb70 2023-10-06T02:28:39.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda273cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19eaec8c0 0x55e19ebaba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda273cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19eaec8c0 0x55e19ebaba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34230/0 (socket says 172.21.15.6:34230) 2023-10-06T02:28:39.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda273cf700 1 -- 172.21.15.6:0/3383611629 learned_addr learned my addr 172.21.15.6:0/3383611629 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:39.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda26bce700 1 --2- 172.21.15.6:0/3383611629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19eb37e70 0x55e19eb1e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda27bd0700 1 --2- 172.21.15.6:0/3383611629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19ebaeb70 0x55e19eb34c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda273cf700 1 -- 172.21.15.6:0/3383611629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19ebaeb70 msgr2=0x55e19eb34c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda273cf700 1 --2- 172.21.15.6:0/3383611629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e19ebaeb70 0x55e19eb34c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda273cf700 1 -- 172.21.15.6:0/3383611629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19eb37e70 msgr2=0x55e19eb1e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda273cf700 1 --2- 172.21.15.6:0/3383611629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19eb37e70 0x55e19eb1e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda273cf700 1 -- 172.21.15.6:0/3383611629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e19ea3b750 con 0x55e19eaec8c0 2023-10-06T02:28:39.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda26bce700 1 --2- 172.21.15.6:0/3383611629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e19eb37e70 0x55e19eb1e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:39.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda273cf700 1 --2- 172.21.15.6:0/3383611629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19eaec8c0 0x55e19ebaba90 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7fda1800a510 tx=0x7fda1801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda1ffff700 1 -- 172.21.15.6:0/3383611629 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1800e9f0 con 0x55e19eaec8c0 2023-10-06T02:28:39.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda1ffff700 1 -- 172.21.15.6:0/3383611629 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1800e4f0 con 0x55e19eaec8c0 2023-10-06T02:28:39.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda1ffff700 1 -- 172.21.15.6:0/3383611629 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda180316c0 con 0x55e19eaec8c0 2023-10-06T02:28:39.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda2e194000 1 -- 172.21.15.6:0/3383611629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e19ea621c0 con 0x55e19eaec8c0 2023-10-06T02:28:39.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.291+0000 7fda2e194000 1 -- 172.21.15.6:0/3383611629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e19ea483d0 con 0x55e19eaec8c0 2023-10-06T02:28:39.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.293+0000 7fda1ffff700 1 -- 172.21.15.6:0/3383611629 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda1802e070 con 0x55e19eaec8c0 2023-10-06T02:28:39.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.293+0000 7fda1ffff700 1 --2- 172.21.15.6:0/3383611629 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda080658c0 0x7fda08067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.293+0000 7fda1ffff700 1 -- 172.21.15.6:0/3383611629 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7fda18087140 con 0x55e19eaec8c0 2023-10-06T02:28:39.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.293+0000 7fda26bce700 1 --2- 172.21.15.6:0/3383611629 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda080658c0 0x7fda08067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.293+0000 7fda2e194000 1 --2- 172.21.15.6:0/3383611629 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e19ebc87d0 0x55e19ebe1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.293+0000 7fda2e194000 1 -- 172.21.15.6:0/3383611629 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=103b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128) v8 -- 0x55e19eb1eef0 con 0x55e19ebc87d0 2023-10-06T02:28:39.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.293+0000 7fda27bd0700 1 --2- 172.21.15.6:0/3383611629 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e19ebc87d0 0x55e19ebe1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.294+0000 7fda26bce700 1 --2- 172.21.15.6:0/3383611629 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda080658c0 0x7fda08067d70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fda100057a0 tx=0x7fda10005be0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.294+0000 7fda27bd0700 1 --2- 172.21.15.6:0/3383611629 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e19ebc87d0 0x55e19ebe1440 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.295+0000 7fda27bd0700 1 -- 172.21.15.6:0/3383611629 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 1.00000000 [omap-set-vals] v128'414 uv414 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fda20009aa0 con 0x55e19ebc87d0 2023-10-06T02:28:39.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.295+0000 7fda2e194000 1 -- 172.21.15.6:0/3383611629 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e19ebc87d0 msgr2=0x55e19ebe1440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.295+0000 7fda2e194000 1 --2- 172.21.15.6:0/3383611629 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e19ebc87d0 0x55e19ebe1440 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.295+0000 7fda2e194000 1 -- 172.21.15.6:0/3383611629 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda080658c0 msgr2=0x7fda08067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.295+0000 7fda2e194000 1 --2- 172.21.15.6:0/3383611629 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda080658c0 0x7fda08067d70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fda100057a0 tx=0x7fda10005be0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.295+0000 7fda2e194000 1 -- 172.21.15.6:0/3383611629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19eaec8c0 msgr2=0x55e19ebaba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.295+0000 7fda2e194000 1 --2- 172.21.15.6:0/3383611629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e19eaec8c0 0x55e19ebaba90 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7fda1800a510 tx=0x7fda1801d000 comp rx=0 tx=0).stop 2023-10-06T02:28:39.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.295+0000 7fda27bd0700 1 -- 172.21.15.6:0/3383611629 reap_dead start 2023-10-06T02:28:39.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.295+0000 7fda2e194000 1 -- 172.21.15.6:0/3383611629 shutdown_connections 2023-10-06T02:28:39.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.295+0000 7fda2e194000 1 -- 172.21.15.6:0/3383611629 >> 172.21.15.6:0/3383611629 conn(0x55e19eaef5c0 msgr2=0x55e19eaf19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:39.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.295+0000 7fda2e194000 1 -- 172.21.15.6:0/3383611629 shutdown_connections 2023-10-06T02:28:39.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.295+0000 7fda2e194000 1 -- 172.21.15.6:0/3383611629 wait complete. 2023-10-06T02:28:39.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:28:39.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.463+0000 7f0444e83700 1 Processor -- start 2023-10-06T02:28:39.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.463+0000 7f0444e83700 1 -- start start 2023-10-06T02:28:39.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.464+0000 7f0444e83700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f044006a380 0x7f04400cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.464+0000 7f0444e83700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0440159170 0x7f04401595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.464+0000 7f0444e83700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04400cae80 con 0x7f044006a750 2023-10-06T02:28:39.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.464+0000 7f0444e83700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04400cc3d0 con 0x7f0440159170 2023-10-06T02:28:39.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.464+0000 7f0444e83700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0440159b30 con 0x7f044006a380 2023-10-06T02:28:39.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.464+0000 7f043dd9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f044006a750 0x7f044015d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38622/0 (socket says 172.21.15.6:38622) 2023-10-06T02:28:39.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.464+0000 7f043dd9b700 1 -- 172.21.15.6:0/2479845710 learned_addr learned my addr 172.21.15.6:0/2479845710 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:39.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.464+0000 7f043ed9d700 1 --2- 172.21.15.6:0/2479845710 >> v2:172.21.15.175:3300/0 conn(0x7f0440159170 0x7f04401595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.464+0000 7f043e59c700 1 --2- 172.21.15.6:0/2479845710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f044006a380 0x7f04400cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.464+0000 7f043d59a700 1 -- 172.21.15.6:0/2479845710 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2399539656 0 0) 0x7f04400cae80 con 0x7f044006a750 2023-10-06T02:28:39.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.464+0000 7f043d59a700 1 -- 172.21.15.6:0/2479845710 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0428003570 con 0x7f044006a750 2023-10-06T02:28:39.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.464+0000 7f043e59c700 1 -- 172.21.15.6:0/2479845710 >> v2:172.21.15.175:3300/0 conn(0x7f0440159170 msgr2=0x7f04401595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:39.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.464+0000 7f043e59c700 1 --2- 172.21.15.6:0/2479845710 >> v2:172.21.15.175:3300/0 conn(0x7f0440159170 0x7f04401595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.464+0000 7f043e59c700 1 -- 172.21.15.6:0/2479845710 >> v1:172.21.15.6:6789/0 conn(0x7f044006a750 legacy=0x7f044015d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.464+0000 7f043e59c700 1 -- 172.21.15.6:0/2479845710 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044015dcd0 con 0x7f044006a380 2023-10-06T02:28:39.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.465+0000 7f043e59c700 1 --2- 172.21.15.6:0/2479845710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f044006a380 0x7f04400cb310 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f04300098e0 tx=0x7f04300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3587aaf3e5b8a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.465+0000 7f043d59a700 1 -- 172.21.15.6:0/2479845710 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430011630 con 0x7f044006a380 2023-10-06T02:28:39.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.465+0000 7f043d59a700 1 -- 172.21.15.6:0/2479845710 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0430011790 con 0x7f044006a380 2023-10-06T02:28:39.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.465+0000 7f043d59a700 1 -- 172.21.15.6:0/2479845710 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430011b30 con 0x7f044006a380 2023-10-06T02:28:39.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.465+0000 7f0444e83700 1 -- 172.21.15.6:0/2479845710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f044006a380 msgr2=0x7f04400cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.465+0000 7f0444e83700 1 --2- 172.21.15.6:0/2479845710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f044006a380 0x7f04400cb310 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f04300098e0 tx=0x7f04300091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.465+0000 7f0444e83700 1 -- 172.21.15.6:0/2479845710 shutdown_connections 2023-10-06T02:28:39.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.465+0000 7f0444e83700 1 --2- 172.21.15.6:0/2479845710 >> v2:172.21.15.175:3300/0 conn(0x7f0440159170 0x7f04401595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.465+0000 7f0444e83700 1 --2- 172.21.15.6:0/2479845710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f044006a380 0x7f04400cb310 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.465+0000 7f0444e83700 1 -- 172.21.15.6:0/2479845710 >> 172.21.15.6:0/2479845710 conn(0x7f04400d0350 msgr2=0x7f04400d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:39.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.465+0000 7f0444e83700 1 -- 172.21.15.6:0/2479845710 shutdown_connections 2023-10-06T02:28:39.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.465+0000 7f0444e83700 1 -- 172.21.15.6:0/2479845710 wait complete. 2023-10-06T02:28:39.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.466+0000 7f0444e83700 1 Processor -- start 2023-10-06T02:28:39.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.466+0000 7f0444e83700 1 -- start start 2023-10-06T02:28:39.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.467+0000 7f0444e83700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f044006a380 0x7f04400c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.467+0000 7f0444e83700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f044006a750 0x7f04400b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.467+0000 7f0444e83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0440159170 0x7f0440154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.467+0000 7f0444e83700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04400c92e0 con 0x7f0440159170 2023-10-06T02:28:39.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.467+0000 7f0444e83700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04401551b0 con 0x7f044006a750 2023-10-06T02:28:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.467+0000 7f0444e83700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04400c83f0 con 0x7f044006a380 2023-10-06T02:28:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.467+0000 7f043ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0440159170 0x7f0440154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.467+0000 7f043ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0440159170 0x7f0440154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34246/0 (socket says 172.21.15.6:34246) 2023-10-06T02:28:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.467+0000 7f043ed9d700 1 -- 172.21.15.6:0/2453430739 learned_addr learned my addr 172.21.15.6:0/2453430739 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.467+0000 7f043e59c700 1 --2- 172.21.15.6:0/2453430739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f044006a380 0x7f04400c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.467+0000 7f043dd9b700 1 --2- 172.21.15.6:0/2453430739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f044006a750 0x7f04400b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.468+0000 7f043ed9d700 1 -- 172.21.15.6:0/2453430739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f044006a380 msgr2=0x7f04400c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.468+0000 7f043ed9d700 1 --2- 172.21.15.6:0/2453430739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f044006a380 0x7f04400c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.468+0000 7f043ed9d700 1 -- 172.21.15.6:0/2453430739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f044006a750 msgr2=0x7f04400b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.468+0000 7f043ed9d700 1 --2- 172.21.15.6:0/2453430739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f044006a750 0x7f04400b5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.468+0000 7f043ed9d700 1 -- 172.21.15.6:0/2453430739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0430009420 con 0x7f0440159170 2023-10-06T02:28:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.468+0000 7f043dd9b700 1 --2- 172.21.15.6:0/2453430739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f044006a750 0x7f04400b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.468+0000 7f043ed9d700 1 --2- 172.21.15.6:0/2453430739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0440159170 0x7f0440154c70 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f0438009e20 tx=0x7f043800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.468+0000 7f042e7fc700 1 -- 172.21.15.6:0/2453430739 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043800cb50 con 0x7f0440159170 2023-10-06T02:28:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.468+0000 7f042e7fc700 1 -- 172.21.15.6:0/2453430739 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043800f040 con 0x7f0440159170 2023-10-06T02:28:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.468+0000 7f0444e83700 1 -- 172.21.15.6:0/2453430739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04400c86d0 con 0x7f0440159170 2023-10-06T02:28:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.468+0000 7f042e7fc700 1 -- 172.21.15.6:0/2453430739 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438014480 con 0x7f0440159170 2023-10-06T02:28:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.468+0000 7f0444e83700 1 -- 172.21.15.6:0/2453430739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04400c8f70 con 0x7f0440159170 2023-10-06T02:28:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.469+0000 7f0444e83700 1 -- 172.21.15.6:0/2453430739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044015b650 con 0x7f0440159170 2023-10-06T02:28:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.469+0000 7f042e7fc700 1 -- 172.21.15.6:0/2453430739 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0438014830 con 0x7f0440159170 2023-10-06T02:28:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.470+0000 7f042e7fc700 1 --2- 172.21.15.6:0/2453430739 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0420066f30 0x7f04200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.470+0000 7f042e7fc700 1 -- 172.21.15.6:0/2453430739 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7f0438085bd0 con 0x7f0440159170 2023-10-06T02:28:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.470+0000 7f043e59c700 1 --2- 172.21.15.6:0/2453430739 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0420066f30 0x7f04200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.470+0000 7f043e59c700 1 --2- 172.21.15.6:0/2453430739 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0420066f30 0x7f04200693e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f04300091e0 tx=0x7f0430017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.474+0000 7f042e7fc700 1 -- 172.21.15.6:0/2453430739 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0438052050 con 0x7f0440159170 2023-10-06T02:28:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.713+0000 7f0444e83700 1 -- 172.21.15.6:0/2453430739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f044015dfb0 con 0x7f0440159170 2023-10-06T02:28:39.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.853+0000 7f042e7fc700 1 -- 172.21.15.6:0/2453430739 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v301) v1 ==== 162+0+0 (secure 0 0 0) 0x7f04380180b0 con 0x7f0440159170 2023-10-06T02:28:39.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.855+0000 7f0444e83700 1 -- 172.21.15.6:0/2453430739 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0420066f30 msgr2=0x7f04200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.855+0000 7f0444e83700 1 --2- 172.21.15.6:0/2453430739 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0420066f30 0x7f04200693e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f04300091e0 tx=0x7f0430017000 comp rx=0 tx=0).stop 2023-10-06T02:28:39.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.855+0000 7f0444e83700 1 -- 172.21.15.6:0/2453430739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0440159170 msgr2=0x7f0440154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.855+0000 7f0444e83700 1 --2- 172.21.15.6:0/2453430739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0440159170 0x7f0440154c70 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f0438009e20 tx=0x7f043800b040 comp rx=0 tx=0).stop 2023-10-06T02:28:39.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.855+0000 7f0444e83700 1 -- 172.21.15.6:0/2453430739 shutdown_connections 2023-10-06T02:28:39.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.855+0000 7f0444e83700 1 --2- 172.21.15.6:0/2453430739 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0420066f30 0x7f04200693e0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.855+0000 7f0444e83700 1 --2- 172.21.15.6:0/2453430739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0440159170 0x7f0440154c70 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.855+0000 7f0444e83700 1 --2- 172.21.15.6:0/2453430739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f044006a380 0x7f04400c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.855+0000 7f0444e83700 1 --2- 172.21.15.6:0/2453430739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f044006a750 0x7f04400b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.855+0000 7f0444e83700 1 -- 172.21.15.6:0/2453430739 >> 172.21.15.6:0/2453430739 conn(0x7f04400d0350 msgr2=0x7f044015d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:39.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.855+0000 7f0444e83700 1 -- 172.21.15.6:0/2453430739 shutdown_connections 2023-10-06T02:28:39.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:39.856+0000 7f0444e83700 1 -- 172.21.15.6:0/2453430739 wait complete. 2023-10-06T02:28:39.858 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:28:40.274 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.398+0000 7fddb979e700 1 Processor -- start 2023-10-06T02:28:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.398+0000 7fddb979e700 1 -- start start 2023-10-06T02:28:40.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.399+0000 7fddb979e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddb40d0950 0x7fddb41645c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:40.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.399+0000 7fddb979e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb40cf8a0 con 0x7fddb4142de0 2023-10-06T02:28:40.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.399+0000 7fddb979e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb40b4100 con 0x7fddb41431b0 2023-10-06T02:28:40.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.399+0000 7fddb979e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb40cec90 con 0x7fddb40d0950 2023-10-06T02:28:40.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.399+0000 7fddb2ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fddb4142de0 0x7fddb40ccd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38628/0 (socket says 172.21.15.6:38628) 2023-10-06T02:28:40.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.399+0000 7fddb2ffd700 1 -- 172.21.15.6:0/2248879355 learned_addr learned my addr 172.21.15.6:0/2248879355 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:40.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb37fe700 1 --2- 172.21.15.6:0/2248879355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddb40d0950 0x7fddb41645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:40.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb1ffb700 1 -- 172.21.15.6:0/2248879355 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484234325 0 0) 0x7fddb40cf8a0 con 0x7fddb4142de0 2023-10-06T02:28:40.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb1ffb700 1 -- 172.21.15.6:0/2248879355 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdda0003570 con 0x7fddb4142de0 2023-10-06T02:28:40.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb1ffb700 1 -- 172.21.15.6:0/2248879355 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191249373 0 0) 0x7fddb40b4100 con 0x7fddb41431b0 2023-10-06T02:28:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb1ffb700 1 -- 172.21.15.6:0/2248879355 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddb40cf8a0 con 0x7fddb41431b0 2023-10-06T02:28:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb1ffb700 1 -- 172.21.15.6:0/2248879355 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 746342523 0 0) 0x7fdda0003570 con 0x7fddb4142de0 2023-10-06T02:28:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb1ffb700 1 -- 172.21.15.6:0/2248879355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddb40d0950 msgr2=0x7fddb41645c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb1ffb700 1 --2- 172.21.15.6:0/2248879355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddb40d0950 0x7fddb41645c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb1ffb700 1 -- 172.21.15.6:0/2248879355 >> v1:172.21.15.175:6789/0 conn(0x7fddb41431b0 legacy=0x7fddb40d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb1ffb700 1 -- 172.21.15.6:0/2248879355 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb40cef70 con 0x7fddb4142de0 2023-10-06T02:28:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb1ffb700 1 -- 172.21.15.6:0/2248879355 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fdda4001470 con 0x7fddb4142de0 2023-10-06T02:28:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb1ffb700 1 -- 172.21.15.6:0/2248879355 >> v1:172.21.15.6:6789/0 conn(0x7fddb4142de0 legacy=0x7fddb40ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb1ffb700 1 --2- 172.21.15.6:0/2248879355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdda0003c20 0x7fdda0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb1ffb700 1 --2- 172.21.15.6:0/2248879355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdda0004810 0x7fdda0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb1ffb700 1 --2- 172.21.15.6:0/2248879355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddb40d0950 0x7fdda00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb1ffb700 1 -- 172.21.15.6:0/2248879355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb40cec90 con 0x7fdda0003c20 2023-10-06T02:28:40.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb1ffb700 1 -- 172.21.15.6:0/2248879355 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda000bb40 con 0x7fdda0004810 2023-10-06T02:28:40.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb1ffb700 1 -- 172.21.15.6:0/2248879355 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda000bd00 con 0x7fddb40d0950 2023-10-06T02:28:40.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb2ffd700 1 --2- 172.21.15.6:0/2248879355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdda0003c20 0x7fdda0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:40.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb27fc700 1 --2- 172.21.15.6:0/2248879355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdda0004810 0x7fdda0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:40.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb37fe700 1 --2- 172.21.15.6:0/2248879355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddb40d0950 0x7fdda00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:40.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb2ffd700 1 -- 172.21.15.6:0/2248879355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddb40d0950 msgr2=0x7fdda00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:40.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.400+0000 7fddb2ffd700 1 --2- 172.21.15.6:0/2248879355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddb40d0950 0x7fdda00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:40.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.401+0000 7fddb2ffd700 1 -- 172.21.15.6:0/2248879355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdda0004810 msgr2=0x7fdda0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:40.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.401+0000 7fddb2ffd700 1 --2- 172.21.15.6:0/2248879355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdda0004810 0x7fdda0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:40.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.401+0000 7fddb2ffd700 1 -- 172.21.15.6:0/2248879355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda0003570 con 0x7fdda0003c20 2023-10-06T02:28:40.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.401+0000 7fddb2ffd700 1 --2- 172.21.15.6:0/2248879355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdda0003c20 0x7fdda0004010 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fdda400c2d0 tx=0x7fddb4065040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112d02e8ff80659f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:40.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.401+0000 7fddb1ffb700 1 -- 172.21.15.6:0/2248879355 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda400cc00 con 0x7fdda0003c20 2023-10-06T02:28:40.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.401+0000 7fddb1ffb700 1 -- 172.21.15.6:0/2248879355 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda400cd60 con 0x7fdda0003c20 2023-10-06T02:28:40.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.401+0000 7fddb1ffb700 1 -- 172.21.15.6:0/2248879355 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda4005b70 con 0x7fdda0003c20 2023-10-06T02:28:40.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.401+0000 7fddb979e700 1 -- 172.21.15.6:0/2248879355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdda0003c20 msgr2=0x7fdda0004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:40.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.401+0000 7fddb979e700 1 --2- 172.21.15.6:0/2248879355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdda0003c20 0x7fdda0004010 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fdda400c2d0 tx=0x7fddb4065040 comp rx=0 tx=0).stop 2023-10-06T02:28:40.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.401+0000 7fddb37fe700 1 -- 172.21.15.6:0/2248879355 reap_dead start 2023-10-06T02:28:40.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.401+0000 7fddb979e700 1 -- 172.21.15.6:0/2248879355 shutdown_connections 2023-10-06T02:28:40.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.401+0000 7fddb979e700 1 -- 172.21.15.6:0/2248879355 >> 172.21.15.6:0/2248879355 conn(0x7fddb4069110 msgr2=0x7fddb406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:40.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.401+0000 7fddb979e700 1 -- 172.21.15.6:0/2248879355 shutdown_connections 2023-10-06T02:28:40.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.401+0000 7fddb979e700 1 -- 172.21.15.6:0/2248879355 wait complete. 2023-10-06T02:28:40.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.403+0000 7fddb979e700 1 Processor -- start 2023-10-06T02:28:40.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.403+0000 7fddb979e700 1 -- start start 2023-10-06T02:28:40.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.403+0000 7fddb979e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdda0003c20 0x7fddb416d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:40.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.403+0000 7fddb979e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddb416ddd0 0x7fddb4155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:40.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.403+0000 7fddb979e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddb4155a90 0x7fddb413d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:40.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.403+0000 7fddb979e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb40b1f80 con 0x7fddb4155a90 2023-10-06T02:28:40.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.403+0000 7fddb979e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb416e240 con 0x7fdda0003c20 2023-10-06T02:28:40.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.403+0000 7fddb979e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb41546b0 con 0x7fddb416ddd0 2023-10-06T02:28:40.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddb37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddb4155a90 0x7fddb413d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:40.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddb37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddb4155a90 0x7fddb413d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34264/0 (socket says 172.21.15.6:34264) 2023-10-06T02:28:40.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddb37fe700 1 -- 172.21.15.6:0/646124070 learned_addr learned my addr 172.21.15.6:0/646124070 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:40.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddb27fc700 1 --2- 172.21.15.6:0/646124070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddb416ddd0 0x7fddb4155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:40.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddb2ffd700 1 --2- 172.21.15.6:0/646124070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdda0003c20 0x7fddb416d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:40.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddb37fe700 1 -- 172.21.15.6:0/646124070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddb416ddd0 msgr2=0x7fddb4155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:40.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddb37fe700 1 --2- 172.21.15.6:0/646124070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddb416ddd0 0x7fddb4155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:40.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddb37fe700 1 -- 172.21.15.6:0/646124070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdda0003c20 msgr2=0x7fddb416d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:40.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddb37fe700 1 --2- 172.21.15.6:0/646124070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdda0003c20 0x7fddb416d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:40.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddb37fe700 1 -- 172.21.15.6:0/646124070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb4154220 con 0x7fddb4155a90 2023-10-06T02:28:40.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddb27fc700 1 --2- 172.21.15.6:0/646124070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddb416ddd0 0x7fddb4155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:40.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddb2ffd700 1 --2- 172.21.15.6:0/646124070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdda0003c20 0x7fddb416d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:40.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddb37fe700 1 --2- 172.21.15.6:0/646124070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddb4155a90 0x7fddb413d660 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7fddb40d0d50 tx=0x7fddac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:40.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddaaffd700 1 -- 172.21.15.6:0/646124070 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac00e040 con 0x7fddb4155a90 2023-10-06T02:28:40.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddaaffd700 1 -- 172.21.15.6:0/646124070 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddac00f040 con 0x7fddb4155a90 2023-10-06T02:28:40.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddb979e700 1 -- 172.21.15.6:0/646124070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb4153330 con 0x7fddb4155a90 2023-10-06T02:28:40.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddaaffd700 1 -- 172.21.15.6:0/646124070 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac00fdf0 con 0x7fddb4155a90 2023-10-06T02:28:40.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.404+0000 7fddb979e700 1 -- 172.21.15.6:0/646124070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb41538f0 con 0x7fddb4155a90 2023-10-06T02:28:40.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.405+0000 7fddb979e700 1 -- 172.21.15.6:0/646124070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb41543b0 con 0x7fddb4155a90 2023-10-06T02:28:40.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.406+0000 7fddaaffd700 1 -- 172.21.15.6:0/646124070 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fddac015640 con 0x7fddb4155a90 2023-10-06T02:28:40.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.406+0000 7fddaaffd700 1 --2- 172.21.15.6:0/646124070 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdd94066f30 0x7fdd940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:40.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.406+0000 7fddaaffd700 1 -- 172.21.15.6:0/646124070 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7fddac085cc0 con 0x7fddb4155a90 2023-10-06T02:28:40.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.406+0000 7fddb2ffd700 1 --2- 172.21.15.6:0/646124070 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdd94066f30 0x7fdd940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:40.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.407+0000 7fddb2ffd700 1 --2- 172.21.15.6:0/646124070 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdd94066f30 0x7fdd940693e0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fdda4001ed0 tx=0x7fdda4015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:40.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.410+0000 7fddaaffd700 1 -- 172.21.15.6:0/646124070 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddac052140 con 0x7fddb4155a90 2023-10-06T02:28:40.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.651+0000 7fddb979e700 1 -- 172.21.15.6:0/646124070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddb4088ac0 con 0x7fddb4155a90 2023-10-06T02:28:40.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.652+0000 7fddaaffd700 1 -- 172.21.15.6:0/646124070 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 301 v301) v1 ==== 95+0+4604 (secure 0 0 0) 0x7fddac055760 con 0x7fddb4155a90 2023-10-06T02:28:40.653 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:40.653 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":301,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":301,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:28:39.850437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":128,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10164":{"gid":10164,"name":"a","rank":0,"incarnation":301,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/171345142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":171345142},{"type":"v1","addr":"172.21.15.6:6835","nonce":171345142}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:40.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.654+0000 7fddb979e700 1 -- 172.21.15.6:0/646124070 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdd94066f30 msgr2=0x7fdd940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:40.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.654+0000 7fddb979e700 1 --2- 172.21.15.6:0/646124070 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdd94066f30 0x7fdd940693e0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fdda4001ed0 tx=0x7fdda4015000 comp rx=0 tx=0).stop 2023-10-06T02:28:40.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.654+0000 7fddb979e700 1 -- 172.21.15.6:0/646124070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddb4155a90 msgr2=0x7fddb413d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:40.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.654+0000 7fddb979e700 1 --2- 172.21.15.6:0/646124070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddb4155a90 0x7fddb413d660 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7fddb40d0d50 tx=0x7fddac00b040 comp rx=0 tx=0).stop 2023-10-06T02:28:40.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.654+0000 7fddb979e700 1 -- 172.21.15.6:0/646124070 shutdown_connections 2023-10-06T02:28:40.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.654+0000 7fddb979e700 1 --2- 172.21.15.6:0/646124070 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdd94066f30 0x7fdd940693e0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:40.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.654+0000 7fddb979e700 1 --2- 172.21.15.6:0/646124070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddb4155a90 0x7fddb413d660 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:40.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.654+0000 7fddb979e700 1 --2- 172.21.15.6:0/646124070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdda0003c20 0x7fddb416d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:40.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.654+0000 7fddb979e700 1 --2- 172.21.15.6:0/646124070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddb416ddd0 0x7fddb4155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.654+0000 7fddb979e700 1 -- 172.21.15.6:0/646124070 >> 172.21.15.6:0/646124070 conn(0x7fddb4069110 msgr2=0x7fddb40d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.654+0000 7fddb979e700 1 -- 172.21.15.6:0/646124070 shutdown_connections 2023-10-06T02:28:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:40.654+0000 7fddb979e700 1 -- 172.21.15.6:0/646124070 wait complete. 2023-10-06T02:28:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 301 2023-10-06T02:28:40.666 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 301, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:28:39.850437+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 128, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10164}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10164': {'gid': 10164, 'name': 'a', 'rank': 0, 'incarnation': 301, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.6:6835/171345142', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 171345142}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 171345142}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:28:40.667 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10164:up:replay 2023-10-06T02:28:40.667 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2023-10-06T02:28:44.960 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:28:44.960+0000 7f2635869700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:28:45.996 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:28:45.995+0000 7fc34f931700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-06T02:28:46.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.203+0000 7f543f59e700 1 Processor -- start 2023-10-06T02:28:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.203+0000 7f543f59e700 1 -- start start 2023-10-06T02:28:46.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.204+0000 7f543f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5440159400 0x7f54400ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.204+0000 7f543f59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f54400cd030 0x7f54400cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.204+0000 7f543f59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54400b3560 con 0x7f54400cf1a0 2023-10-06T02:28:46.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.204+0000 7f543f59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54400cf6f0 con 0x7f54400cd030 2023-10-06T02:28:46.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.204+0000 7f543f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54400cf9d0 con 0x7f5440159400 2023-10-06T02:28:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.204+0000 7f543dd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f54400cd030 0x7f54400cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.204+0000 7f543dd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f54400cd030 0x7f54400cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34274/0 (socket says 172.21.15.6:34274) 2023-10-06T02:28:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.204+0000 7f543dd9b700 1 -- 172.21.15.6:0/926811338 learned_addr learned my addr 172.21.15.6:0/926811338 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.204+0000 7f543ed9d700 1 --1- 172.21.15.6:0/926811338 >> v1:172.21.15.6:6789/0 conn(0x7f54400cf1a0 0x7f54400b5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38636/0 (socket says 172.21.15.6:38636) 2023-10-06T02:28:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.204+0000 7f543e59c700 1 --2- 172.21.15.6:0/926811338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5440159400 0x7f54400ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.205+0000 7f543dd9b700 1 -- 172.21.15.6:0/926811338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5440159400 msgr2=0x7f54400ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.205+0000 7f543dd9b700 1 --2- 172.21.15.6:0/926811338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5440159400 0x7f54400ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.205+0000 7f543dd9b700 1 -- 172.21.15.6:0/926811338 >> v1:172.21.15.6:6789/0 conn(0x7f54400cf1a0 legacy=0x7f54400b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.205+0000 7f543dd9b700 1 -- 172.21.15.6:0/926811338 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54400b2f10 con 0x7f54400cd030 2023-10-06T02:28:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.205+0000 7f543d59a700 1 -- 172.21.15.6:0/926811338 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984908509 0 0) 0x7f54400b3560 con 0x7f54400cf1a0 2023-10-06T02:28:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.205+0000 7f543dd9b700 1 --2- 172.21.15.6:0/926811338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54400cd030 0x7f54400cfec0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f54280099b0 tx=0x7f5428009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f30a8fbea8c7d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.205+0000 7f543d59a700 1 -- 172.21.15.6:0/926811338 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542800b860 con 0x7f54400cd030 2023-10-06T02:28:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.205+0000 7f543d59a700 1 -- 172.21.15.6:0/926811338 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542800b9c0 con 0x7f54400cd030 2023-10-06T02:28:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.205+0000 7f543d59a700 1 -- 172.21.15.6:0/926811338 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542800bd60 con 0x7f54400cd030 2023-10-06T02:28:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.205+0000 7f543f59e700 1 -- 172.21.15.6:0/926811338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54400cd030 msgr2=0x7f54400cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.205+0000 7f543f59e700 1 --2- 172.21.15.6:0/926811338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54400cd030 0x7f54400cfec0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f54280099b0 tx=0x7f5428009250 comp rx=0 tx=0).stop 2023-10-06T02:28:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.206+0000 7f543f59e700 1 -- 172.21.15.6:0/926811338 shutdown_connections 2023-10-06T02:28:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.206+0000 7f543f59e700 1 --2- 172.21.15.6:0/926811338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5440159400 0x7f54400ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.206+0000 7f543f59e700 1 --2- 172.21.15.6:0/926811338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54400cd030 0x7f54400cfec0 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.206+0000 7f543f59e700 1 -- 172.21.15.6:0/926811338 >> 172.21.15.6:0/926811338 conn(0x7f544006ac10 msgr2=0x7f5440068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.206+0000 7f543f59e700 1 -- 172.21.15.6:0/926811338 shutdown_connections 2023-10-06T02:28:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.206+0000 7f543f59e700 1 -- 172.21.15.6:0/926811338 wait complete. 2023-10-06T02:28:46.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.207+0000 7f543f59e700 1 Processor -- start 2023-10-06T02:28:46.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.207+0000 7f543f59e700 1 -- start start 2023-10-06T02:28:46.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.207+0000 7f543f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54400cd030 0x7f54401520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.207+0000 7f543f59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54400cf1a0 0x7f544014f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.207+0000 7f543f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5440159400 0x7f544015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.207+0000 7f543f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5440153a80 con 0x7f54400cd030 2023-10-06T02:28:46.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.207+0000 7f543f59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54401501c0 con 0x7f54400cf1a0 2023-10-06T02:28:46.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.207+0000 7f543f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54401504a0 con 0x7f5440159400 2023-10-06T02:28:46.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.208+0000 7f543e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54400cd030 0x7f54401520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.208+0000 7f543e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54400cd030 0x7f54401520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34278/0 (socket says 172.21.15.6:34278) 2023-10-06T02:28:46.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.208+0000 7f543e59c700 1 -- 172.21.15.6:0/230739866 learned_addr learned my addr 172.21.15.6:0/230739866 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:46.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.208+0000 7f543ed9d700 1 --2- 172.21.15.6:0/230739866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5440159400 0x7f544015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.208+0000 7f543dd9b700 1 --2- 172.21.15.6:0/230739866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54400cf1a0 0x7f544014f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.208+0000 7f543e59c700 1 -- 172.21.15.6:0/230739866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5440159400 msgr2=0x7f544015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.208+0000 7f543e59c700 1 --2- 172.21.15.6:0/230739866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5440159400 0x7f544015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.208+0000 7f543e59c700 1 -- 172.21.15.6:0/230739866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54400cf1a0 msgr2=0x7f544014f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.208+0000 7f543e59c700 1 --2- 172.21.15.6:0/230739866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54400cf1a0 0x7f544014f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.208+0000 7f543e59c700 1 -- 172.21.15.6:0/230739866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54280094f0 con 0x7f54400cd030 2023-10-06T02:28:46.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.208+0000 7f543ed9d700 1 --2- 172.21.15.6:0/230739866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5440159400 0x7f544015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:46.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.208+0000 7f543e59c700 1 --2- 172.21.15.6:0/230739866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54400cd030 0x7f54401520d0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f543000e0e0 tx=0x7f54300098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.208+0000 7f54367fc700 1 -- 172.21.15.6:0/230739866 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543000ecd0 con 0x7f54400cd030 2023-10-06T02:28:46.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.208+0000 7f54367fc700 1 -- 172.21.15.6:0/230739866 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543000ee30 con 0x7f54400cd030 2023-10-06T02:28:46.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.208+0000 7f543f59e700 1 -- 172.21.15.6:0/230739866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5440150780 con 0x7f54400cd030 2023-10-06T02:28:46.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.208+0000 7f54367fc700 1 -- 172.21.15.6:0/230739866 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430014670 con 0x7f54400cd030 2023-10-06T02:28:46.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.208+0000 7f543f59e700 1 -- 172.21.15.6:0/230739866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544014fa30 con 0x7f54400cd030 2023-10-06T02:28:46.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.209+0000 7f543f59e700 1 -- 172.21.15.6:0/230739866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5440159860 con 0x7f54400cd030 2023-10-06T02:28:46.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.210+0000 7f54367fc700 1 -- 172.21.15.6:0/230739866 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54300149e0 con 0x7f54400cd030 2023-10-06T02:28:46.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.210+0000 7f54367fc700 1 --2- 172.21.15.6:0/230739866 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5420066f30 0x7f54200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.210+0000 7f54367fc700 1 -- 172.21.15.6:0/230739866 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7f5430085a60 con 0x7f54400cd030 2023-10-06T02:28:46.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.210+0000 7f543dd9b700 1 --2- 172.21.15.6:0/230739866 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5420066f30 0x7f54200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.211+0000 7f543dd9b700 1 --2- 172.21.15.6:0/230739866 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5420066f30 0x7f54200693e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f54280099b0 tx=0x7f5428017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.215+0000 7f54367fc700 1 -- 172.21.15.6:0/230739866 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5430051ee0 con 0x7f54400cd030 2023-10-06T02:28:46.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.455+0000 7f543f59e700 1 -- 172.21.15.6:0/230739866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54400b31f0 con 0x7f54400cd030 2023-10-06T02:28:46.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.455+0000 7f54367fc700 1 -- 172.21.15.6:0/230739866 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 305 v305) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f5430055500 con 0x7f54400cd030 2023-10-06T02:28:46.456 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:46.456 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":305,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":305,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:28:45.996149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":128,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10164":{"gid":10164,"name":"a","rank":0,"incarnation":301,"state":"up:active","state_seq":6,"addr":"172.21.15.6:6835/171345142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":171345142},{"type":"v1","addr":"172.21.15.6:6835","nonce":171345142}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:46.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.457+0000 7f543f59e700 1 -- 172.21.15.6:0/230739866 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5420066f30 msgr2=0x7f54200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.457+0000 7f543f59e700 1 --2- 172.21.15.6:0/230739866 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5420066f30 0x7f54200693e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f54280099b0 tx=0x7f5428017000 comp rx=0 tx=0).stop 2023-10-06T02:28:46.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.457+0000 7f543f59e700 1 -- 172.21.15.6:0/230739866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54400cd030 msgr2=0x7f54401520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.457+0000 7f543f59e700 1 --2- 172.21.15.6:0/230739866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54400cd030 0x7f54401520d0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f543000e0e0 tx=0x7f54300098d0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.457+0000 7f543f59e700 1 -- 172.21.15.6:0/230739866 shutdown_connections 2023-10-06T02:28:46.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.457+0000 7f543f59e700 1 --2- 172.21.15.6:0/230739866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5440159400 0x7f544015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.457+0000 7f543f59e700 1 --2- 172.21.15.6:0/230739866 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5420066f30 0x7f54200693e0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.457+0000 7f543f59e700 1 --2- 172.21.15.6:0/230739866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54400cd030 0x7f54401520d0 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.457+0000 7f543f59e700 1 --2- 172.21.15.6:0/230739866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54400cf1a0 0x7f544014f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.457+0000 7f543f59e700 1 -- 172.21.15.6:0/230739866 >> 172.21.15.6:0/230739866 conn(0x7f544006ac10 msgr2=0x7f54400cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:46.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.457+0000 7f543f59e700 1 -- 172.21.15.6:0/230739866 shutdown_connections 2023-10-06T02:28:46.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.457+0000 7f543f59e700 1 -- 172.21.15.6:0/230739866 wait complete. 2023-10-06T02:28:46.460 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 305 2023-10-06T02:28:46.470 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 305, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:28:45.996149+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 128, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10164}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10164': {'gid': 10164, 'name': 'a', 'rank': 0, 'incarnation': 301, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.6:6835/171345142', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 171345142}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 171345142}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:28:46.470 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:28:46.470 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:28:46.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.589+0000 7f1dd9b21700 1 Processor -- start 2023-10-06T02:28:46.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.589+0000 7f1dd9b21700 1 -- start start 2023-10-06T02:28:46.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.590+0000 7f1dd9b21700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dd4159400 0x7f1dd40ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.590+0000 7f1dd9b21700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd40b3560 con 0x7f1dd40d05d0 2023-10-06T02:28:46.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.590+0000 7f1dd9b21700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd40cf6f0 con 0x7f1dd40cd030 2023-10-06T02:28:46.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.590+0000 7f1dd9b21700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd40cf9d0 con 0x7f1dd4159400 2023-10-06T02:28:46.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.590+0000 7f1dd9320700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1dd40d05d0 0x7f1dd40b39f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38638/0 (socket says 172.21.15.6:38638) 2023-10-06T02:28:46.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.590+0000 7f1dd9320700 1 -- 172.21.15.6:0/1988655589 learned_addr learned my addr 172.21.15.6:0/1988655589 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:46.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd8b1f700 1 --2- 172.21.15.6:0/1988655589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dd4159400 0x7f1dd40ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd37fe700 1 -- 172.21.15.6:0/1988655589 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386012874 0 0) 0x7f1dd40b3560 con 0x7f1dd40d05d0 2023-10-06T02:28:46.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd37fe700 1 -- 172.21.15.6:0/1988655589 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dc0003570 con 0x7f1dd40d05d0 2023-10-06T02:28:46.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd37fe700 1 -- 172.21.15.6:0/1988655589 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667373603 0 0) 0x7f1dd40cf6f0 con 0x7f1dd40cd030 2023-10-06T02:28:46.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd37fe700 1 -- 172.21.15.6:0/1988655589 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dd40b3560 con 0x7f1dd40cd030 2023-10-06T02:28:46.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd37fe700 1 -- 172.21.15.6:0/1988655589 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 283971884 0 0) 0x7f1dc0003570 con 0x7f1dd40d05d0 2023-10-06T02:28:46.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd37fe700 1 -- 172.21.15.6:0/1988655589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dd4159400 msgr2=0x7f1dd40ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:46.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd37fe700 1 --2- 172.21.15.6:0/1988655589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dd4159400 0x7f1dd40ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd37fe700 1 -- 172.21.15.6:0/1988655589 >> v1:172.21.15.175:6789/0 conn(0x7f1dd40cd030 legacy=0x7f1dd40cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd37fe700 1 -- 172.21.15.6:0/1988655589 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd40b2f10 con 0x7f1dd40d05d0 2023-10-06T02:28:46.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd37fe700 1 -- 172.21.15.6:0/1988655589 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f1dbc001470 con 0x7f1dd40d05d0 2023-10-06T02:28:46.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd37fe700 1 -- 172.21.15.6:0/1988655589 >> v1:172.21.15.6:6789/0 conn(0x7f1dd40d05d0 legacy=0x7f1dd40b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd37fe700 1 --2- 172.21.15.6:0/1988655589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dc0003c20 0x7f1dc0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd37fe700 1 --2- 172.21.15.6:0/1988655589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dd4159400 0x7f1dc0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd37fe700 1 --2- 172.21.15.6:0/1988655589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc0004d50 0x7f1dc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd37fe700 1 -- 172.21.15.6:0/1988655589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd40cf9d0 con 0x7f1dc0004d50 2023-10-06T02:28:46.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd37fe700 1 -- 172.21.15.6:0/1988655589 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc000bbf0 con 0x7f1dc0003c20 2023-10-06T02:28:46.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd37fe700 1 -- 172.21.15.6:0/1988655589 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc000bd60 con 0x7f1dd4159400 2023-10-06T02:28:46.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd9320700 1 --2- 172.21.15.6:0/1988655589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc0004d50 0x7f1dc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd8b1f700 1 --2- 172.21.15.6:0/1988655589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dc0003c20 0x7f1dc0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd3fff700 1 --2- 172.21.15.6:0/1988655589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dd4159400 0x7f1dc0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd9320700 1 -- 172.21.15.6:0/1988655589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dd4159400 msgr2=0x7f1dc0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:46.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd9320700 1 --2- 172.21.15.6:0/1988655589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dd4159400 0x7f1dc0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd9320700 1 -- 172.21.15.6:0/1988655589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dc0003c20 msgr2=0x7f1dc0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:46.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.591+0000 7f1dd9320700 1 --2- 172.21.15.6:0/1988655589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dc0003c20 0x7f1dc0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.592+0000 7f1dd9320700 1 -- 172.21.15.6:0/1988655589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc0003570 con 0x7f1dc0004d50 2023-10-06T02:28:46.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.592+0000 7f1dd8b1f700 1 --2- 172.21.15.6:0/1988655589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dc0003c20 0x7f1dc0004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:46.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.592+0000 7f1dd9320700 1 --2- 172.21.15.6:0/1988655589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc0004d50 0x7f1dc00051c0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40d09d0 tx=0x7f1dbc001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81072337f349a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.592+0000 7f1dd37fe700 1 -- 172.21.15.6:0/1988655589 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc00cae0 con 0x7f1dc0004d50 2023-10-06T02:28:46.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.592+0000 7f1dd37fe700 1 -- 172.21.15.6:0/1988655589 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc00cc40 con 0x7f1dc0004d50 2023-10-06T02:28:46.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.592+0000 7f1dd37fe700 1 -- 172.21.15.6:0/1988655589 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc005920 con 0x7f1dc0004d50 2023-10-06T02:28:46.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.592+0000 7f1dd9b21700 1 -- 172.21.15.6:0/1988655589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc0004d50 msgr2=0x7f1dc00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.592+0000 7f1dd9b21700 1 --2- 172.21.15.6:0/1988655589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc0004d50 0x7f1dc00051c0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40d09d0 tx=0x7f1dbc001d40 comp rx=0 tx=0).stop 2023-10-06T02:28:46.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.592+0000 7f1dd9320700 1 -- 172.21.15.6:0/1988655589 reap_dead start 2023-10-06T02:28:46.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.592+0000 7f1dd9b21700 1 -- 172.21.15.6:0/1988655589 shutdown_connections 2023-10-06T02:28:46.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.592+0000 7f1dd9b21700 1 -- 172.21.15.6:0/1988655589 >> 172.21.15.6:0/1988655589 conn(0x7f1dd406ac10 msgr2=0x7f1dd4068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:46.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.592+0000 7f1dd9b21700 1 -- 172.21.15.6:0/1988655589 shutdown_connections 2023-10-06T02:28:46.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.592+0000 7f1dd9b21700 1 -- 172.21.15.6:0/1988655589 wait complete. 2023-10-06T02:28:46.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.593+0000 7f1dd9b21700 1 Processor -- start 2023-10-06T02:28:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.594+0000 7f1dd9b21700 1 -- start start 2023-10-06T02:28:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.594+0000 7f1dd9b21700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dd40c7930 0x7f1dd415b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.594+0000 7f1dd9b21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd40c90e0 0x7f1dd41597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.594+0000 7f1dd9b21700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dd40c7d00 0x7f1dd40c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.594+0000 7f1dd9b21700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd415ac30 con 0x7f1dd40c90e0 2023-10-06T02:28:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.594+0000 7f1dd9b21700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd415a020 con 0x7f1dd40c7930 2023-10-06T02:28:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.594+0000 7f1dd9b21700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd415a300 con 0x7f1dd40c7d00 2023-10-06T02:28:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.594+0000 7f1dd3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd40c90e0 0x7f1dd41597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.594+0000 7f1dd3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd40c90e0 0x7f1dd41597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34288/0 (socket says 172.21.15.6:34288) 2023-10-06T02:28:46.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.594+0000 7f1dd3fff700 1 -- 172.21.15.6:0/1181304838 learned_addr learned my addr 172.21.15.6:0/1181304838 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:46.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.595+0000 7f1dd3fff700 1 -- 172.21.15.6:0/1181304838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dd40c7d00 msgr2=0x7f1dd40c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.595+0000 7f1dd3fff700 1 --2- 172.21.15.6:0/1181304838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dd40c7d00 0x7f1dd40c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.595+0000 7f1dd8b1f700 1 --2- 172.21.15.6:0/1181304838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dd40c7930 0x7f1dd415b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.595+0000 7f1dd3fff700 1 -- 172.21.15.6:0/1181304838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dd40c7930 msgr2=0x7f1dd415b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.595+0000 7f1dd3fff700 1 --2- 172.21.15.6:0/1181304838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dd40c7930 0x7f1dd415b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.595+0000 7f1dd3fff700 1 -- 172.21.15.6:0/1181304838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd415a5e0 con 0x7f1dd40c90e0 2023-10-06T02:28:46.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.595+0000 7f1dd3fff700 1 --2- 172.21.15.6:0/1181304838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd40c90e0 0x7f1dd41597d0 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400ecf0 tx=0x7f1dc40017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.595+0000 7f1dd0ff9700 1 -- 172.21.15.6:0/1181304838 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc400eea0 con 0x7f1dd40c90e0 2023-10-06T02:28:46.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.595+0000 7f1dd0ff9700 1 -- 172.21.15.6:0/1181304838 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc4006ba0 con 0x7f1dd40c90e0 2023-10-06T02:28:46.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.595+0000 7f1dd9b21700 1 -- 172.21.15.6:0/1181304838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd415a8c0 con 0x7f1dd40c90e0 2023-10-06T02:28:46.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.595+0000 7f1dd0ff9700 1 -- 172.21.15.6:0/1181304838 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc400cb10 con 0x7f1dd40c90e0 2023-10-06T02:28:46.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.595+0000 7f1dd9b21700 1 -- 172.21.15.6:0/1181304838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd4159d10 con 0x7f1dd40c90e0 2023-10-06T02:28:46.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.596+0000 7f1dd0ff9700 1 -- 172.21.15.6:0/1181304838 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1dc4015430 con 0x7f1dd40c90e0 2023-10-06T02:28:46.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.597+0000 7f1dd0ff9700 1 --2- 172.21.15.6:0/1181304838 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1db4066f30 0x7f1db40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.597+0000 7f1dd0ff9700 1 -- 172.21.15.6:0/1181304838 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7f1dc40859f0 con 0x7f1dd40c90e0 2023-10-06T02:28:46.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.597+0000 7f1dd8b1f700 1 --2- 172.21.15.6:0/1181304838 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1db4066f30 0x7f1db40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.598+0000 7f1dd8b1f700 1 --2- 172.21.15.6:0/1181304838 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1db4066f30 0x7f1db40693e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009710 tx=0x7f1dcc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.599+0000 7f1de407bb80 1 Processor -- start 2023-10-06T02:28:46.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.599+0000 7f1de407bb80 1 -- start start 2023-10-06T02:28:46.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1de407bb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c90e50 0x561d57c6bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1de407bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c712c0 0x561d57c6c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1de407bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c72a10 0x561d57c6c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1de407bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d57bc6a70 con 0x561d57c72a10 2023-10-06T02:28:46.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1de407bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d57bc4270 con 0x561d57c712c0 2023-10-06T02:28:46.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1de407bb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d57bc0060 con 0x561d57c90e50 2023-10-06T02:28:46.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1dd9320700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c72a10 0x561d57c6c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1dd9320700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c72a10 0x561d57c6c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34300/0 (socket says 172.21.15.6:34300) 2023-10-06T02:28:46.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1dd9320700 1 -- 172.21.15.6:0/239664464 learned_addr learned my addr 172.21.15.6:0/239664464 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:46.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1dd3fff700 1 --2- 172.21.15.6:0/239664464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c712c0 0x561d57c6c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1dd8b1f700 1 --2- 172.21.15.6:0/239664464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c90e50 0x561d57c6bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1dd9320700 1 -- 172.21.15.6:0/239664464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c90e50 msgr2=0x561d57c6bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:46.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1dd9320700 1 --2- 172.21.15.6:0/239664464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c90e50 0x561d57c6bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1dd9320700 1 -- 172.21.15.6:0/239664464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c712c0 msgr2=0x561d57c6c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1dd9320700 1 --2- 172.21.15.6:0/239664464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c712c0 0x561d57c6c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1dd9320700 1 -- 172.21.15.6:0/239664464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d57a5a270 con 0x561d57c72a10 2023-10-06T02:28:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1dd9320700 1 --2- 172.21.15.6:0/239664464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c72a10 0x561d57c6c740 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc001d80 tx=0x7f1dbc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e3cf1bfcd88c8b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1dc9ffb700 1 -- 172.21.15.6:0/239664464 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc007a30 con 0x561d57c72a10 2023-10-06T02:28:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1dc9ffb700 1 -- 172.21.15.6:0/239664464 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc001690 con 0x561d57c72a10 2023-10-06T02:28:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.600+0000 7f1dc9ffb700 1 -- 172.21.15.6:0/239664464 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc001390 con 0x561d57c72a10 2023-10-06T02:28:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.601+0000 7f1de407bb80 1 -- 172.21.15.6:0/239664464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c72a10 msgr2=0x561d57c6c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.601+0000 7f1de407bb80 1 --2- 172.21.15.6:0/239664464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c72a10 0x561d57c6c740 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc001d80 tx=0x7f1dbc015000 comp rx=0 tx=0).stop 2023-10-06T02:28:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.601+0000 7f1de407bb80 1 -- 172.21.15.6:0/239664464 shutdown_connections 2023-10-06T02:28:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.601+0000 7f1de407bb80 1 --2- 172.21.15.6:0/239664464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c72a10 0x561d57c6c740 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.601+0000 7f1de407bb80 1 --2- 172.21.15.6:0/239664464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c90e50 0x561d57c6bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.601+0000 7f1de407bb80 1 --2- 172.21.15.6:0/239664464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c712c0 0x561d57c6c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.601+0000 7f1de407bb80 1 -- 172.21.15.6:0/239664464 >> 172.21.15.6:0/239664464 conn(0x561d57c70e80 msgr2=0x561d57c716b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:46.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.601+0000 7f1de407bb80 1 -- 172.21.15.6:0/239664464 shutdown_connections 2023-10-06T02:28:46.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.601+0000 7f1de407bb80 1 -- 172.21.15.6:0/239664464 wait complete. 2023-10-06T02:28:46.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.602+0000 7f1de407bb80 1 -- start start 2023-10-06T02:28:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.602+0000 7f1de407bb80 1 Processor -- start 2023-10-06T02:28:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1de407bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c712c0 0x561d57c8f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1de407bb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c72a10 0x561d57cb8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1de407bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c90e50 0x561d57c91370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1de407bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d57b6b890 con 0x561d57c712c0 2023-10-06T02:28:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1de407bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d57b86ea0 con 0x561d57c90e50 2023-10-06T02:28:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1de407bb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d57a42e30 con 0x561d57c72a10 2023-10-06T02:28:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1de407bb80 10 client.0 _ll_register_callbacks cb 0x561d57c33020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:28:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1dd8b1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c712c0 0x561d57c8f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1dd8b1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c712c0 0x561d57c8f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34312/0 (socket says 172.21.15.6:34312) 2023-10-06T02:28:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1dd8b1f700 1 -- 172.21.15.6:0/3107114269 learned_addr learned my addr 172.21.15.6:0/3107114269 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1dd9320700 1 --2- 172.21.15.6:0/3107114269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c90e50 0x561d57c91370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1dd3fff700 1 --2- 172.21.15.6:0/3107114269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c72a10 0x561d57cb8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1dd8b1f700 1 -- 172.21.15.6:0/3107114269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c72a10 msgr2=0x561d57cb8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1dd8b1f700 1 --2- 172.21.15.6:0/3107114269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c72a10 0x561d57cb8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1dd8b1f700 1 -- 172.21.15.6:0/3107114269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c90e50 msgr2=0x561d57c91370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1dd8b1f700 1 --2- 172.21.15.6:0/3107114269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c90e50 0x561d57c91370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1dd8b1f700 1 -- 172.21.15.6:0/3107114269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc0003570 con 0x561d57c712c0 2023-10-06T02:28:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1dd8b1f700 1 --2- 172.21.15.6:0/3107114269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c712c0 0x561d57c8f7c0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc016910 tx=0x7f1dcc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a860bd2f2cc8767d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1db2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:28:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1db2ffd700 1 -- 172.21.15.6:0/3107114269 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc0157a0 con 0x561d57c712c0 2023-10-06T02:28:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1db2ffd700 1 -- 172.21.15.6:0/3107114269 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7f1dcc015900 con 0x561d57c712c0 2023-10-06T02:28:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.603+0000 7f1de407bb80 1 -- 172.21.15.6:0/3107114269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d57c64940 con 0x561d57c712c0 2023-10-06T02:28:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.604+0000 7f1db2ffd700 1 -- 172.21.15.6:0/3107114269 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=305) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dcc015cd0 con 0x561d57c712c0 2023-10-06T02:28:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.604+0000 7f1de407bb80 10 client.10251 fetch_fsmap learned FSMap version 305 2023-10-06T02:28:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.604+0000 7f1de407bb80 1 -- 172.21.15.6:0/3107114269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=305,monmap=2+}) v3 -- 0x561d579fcfe0 con 0x561d57c712c0 2023-10-06T02:28:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.604+0000 7f1db2ffd700 1 -- 172.21.15.6:0/3107114269 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d57c64940 con 0x561d57c712c0 2023-10-06T02:28:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.604+0000 7f1db2ffd700 1 -- 172.21.15.6:0/3107114269 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 305) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1dcc02c440 con 0x561d57c712c0 2023-10-06T02:28:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.604+0000 7f1de407bb80 10 client.10251 fetch_fsmap finished waiting for FSMap version 305 2023-10-06T02:28:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.604+0000 7f1de407bb80 10 client.10251 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:28:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.604+0000 7f1de407bb80 20 client.10251 populate_metadata read hostname 'smithi006' 2023-10-06T02:28:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.604+0000 7f1de407bb80 1 --2- 172.21.15.6:0/3107114269 >> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] conn(0x561d57c918b0 0x561d57cb6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.604+0000 7f1de407bb80 4 client.10251 mds_command: new command op to 10164 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:28:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.604+0000 7f1de407bb80 1 -- 172.21.15.6:0/3107114269 --> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d57c41870 con 0x561d57c918b0 2023-10-06T02:28:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.604+0000 7f1dd3fff700 1 --2- 172.21.15.6:0/3107114269 >> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] conn(0x561d57c918b0 0x561d57cb6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.604+0000 7f1db2ffd700 10 client.10251 ms_handle_connect on v2:172.21.15.6:6833/171345142 2023-10-06T02:28:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.604+0000 7f1dd3fff700 1 --2- 172.21.15.6:0/3107114269 >> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] conn(0x561d57c918b0 0x561d57cb6ec0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48b16236c889986a server_cookie=e31155f10200e5b7 in_seq=0 out_seq=0 2023-10-06T02:28:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.605+0000 7f1db2ffd700 1 -- 172.21.15.6:0/3107114269 <== mds.0 v2:172.21.15.6:6833/171345142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x561d57c41870 con 0x561d57c918b0 2023-10-06T02:28:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.605+0000 7f1db2ffd700 10 client.10251 handle_command_reply: tid=0 2023-10-06T02:28:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.605+0000 7f1de407bb80 1 client.10251 shutdown 2023-10-06T02:28:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.605+0000 7f1de407bb80 1 -- 172.21.15.6:0/3107114269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c712c0 msgr2=0x561d57c8f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.605+0000 7f1de407bb80 1 --2- 172.21.15.6:0/3107114269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c712c0 0x561d57c8f7c0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc016910 tx=0x7f1dcc01a000 comp rx=0 tx=0).stop 2023-10-06T02:28:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.605+0000 7f1de407bb80 1 -- 172.21.15.6:0/3107114269 shutdown_connections 2023-10-06T02:28:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.605+0000 7f1de407bb80 1 --2- 172.21.15.6:0/3107114269 >> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] conn(0x561d57c918b0 0x561d57cb6ec0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.605+0000 7f1de407bb80 1 --2- 172.21.15.6:0/3107114269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c90e50 0x561d57c91370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.605+0000 7f1db2ffd700 0 client.10251 ms_handle_reset on v2:172.21.15.6:6833/171345142 2023-10-06T02:28:46.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.605+0000 7f1de407bb80 1 --2- 172.21.15.6:0/3107114269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c712c0 0x561d57c8f7c0 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.605+0000 7f1de407bb80 1 --2- 172.21.15.6:0/3107114269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c72a10 0x561d57cb8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.605+0000 7f1de407bb80 1 -- 172.21.15.6:0/3107114269 >> 172.21.15.6:0/3107114269 conn(0x561d57c70e80 msgr2=0x561d57c6fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:46.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.605+0000 7f1de407bb80 1 -- 172.21.15.6:0/3107114269 shutdown_connections 2023-10-06T02:28:46.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.605+0000 7f1de407bb80 1 -- 172.21.15.6:0/3107114269 wait complete. 2023-10-06T02:28:46.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.605+0000 7f1de407bb80 20 client.10251 trim_cache size 0 max 16384 2023-10-06T02:28:46.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.622+0000 7f1de407bb80 1 Processor -- start 2023-10-06T02:28:46.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.622+0000 7f1de407bb80 1 -- start start 2023-10-06T02:28:46.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.623+0000 7f1de407bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c712c0 0x561d57cc5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.623+0000 7f1de407bb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c72a10 0x561d57d15b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.623+0000 7f1de407bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c90e50 0x561d57cb99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.623+0000 7f1de407bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d57c72270 con 0x561d57c90e50 2023-10-06T02:28:46.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.623+0000 7f1de407bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d57c72050 con 0x561d57c712c0 2023-10-06T02:28:46.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.623+0000 7f1de407bb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d57c92420 con 0x561d57c72a10 2023-10-06T02:28:46.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.623+0000 7f1dd9320700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c90e50 0x561d57cb99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.623+0000 7f1dd9320700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c90e50 0x561d57cb99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34328/0 (socket says 172.21.15.6:34328) 2023-10-06T02:28:46.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.623+0000 7f1dd9320700 1 -- 172.21.15.6:0/648773834 learned_addr learned my addr 172.21.15.6:0/648773834 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:46.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.623+0000 7f1dd8b1f700 1 --2- 172.21.15.6:0/648773834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c712c0 0x561d57cc5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.623+0000 7f1dd3fff700 1 --2- 172.21.15.6:0/648773834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c72a10 0x561d57d15b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.624+0000 7f1dd9320700 1 -- 172.21.15.6:0/648773834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c72a10 msgr2=0x561d57d15b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:46.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.624+0000 7f1dd9320700 1 --2- 172.21.15.6:0/648773834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c72a10 0x561d57d15b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.624+0000 7f1dd9320700 1 -- 172.21.15.6:0/648773834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c712c0 msgr2=0x561d57cc5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:46.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.624+0000 7f1dd9320700 1 --2- 172.21.15.6:0/648773834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c712c0 0x561d57cc5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.624+0000 7f1dd9320700 1 -- 172.21.15.6:0/648773834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d57b8e780 con 0x561d57c90e50 2023-10-06T02:28:46.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.624+0000 7f1dd9320700 1 --2- 172.21.15.6:0/648773834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c90e50 0x561d57cb99f0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc011000 tx=0x7f1dbc01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b864fb44fa380e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.624+0000 7f1dca7fc700 1 -- 172.21.15.6:0/648773834 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc00cdb0 con 0x561d57c90e50 2023-10-06T02:28:46.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.624+0000 7f1dca7fc700 1 -- 172.21.15.6:0/648773834 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc00c9b0 con 0x561d57c90e50 2023-10-06T02:28:46.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.624+0000 7f1dca7fc700 1 -- 172.21.15.6:0/648773834 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0048f0 con 0x561d57c90e50 2023-10-06T02:28:46.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.624+0000 7f1de407bb80 1 -- 172.21.15.6:0/648773834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c90e50 msgr2=0x561d57cb99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.624+0000 7f1de407bb80 1 --2- 172.21.15.6:0/648773834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c90e50 0x561d57cb99f0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc011000 tx=0x7f1dbc01e000 comp rx=0 tx=0).stop 2023-10-06T02:28:46.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.624+0000 7f1de407bb80 1 -- 172.21.15.6:0/648773834 shutdown_connections 2023-10-06T02:28:46.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.624+0000 7f1de407bb80 1 --2- 172.21.15.6:0/648773834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c90e50 0x561d57cb99f0 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.624+0000 7f1de407bb80 1 --2- 172.21.15.6:0/648773834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c712c0 0x561d57cc5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.624+0000 7f1de407bb80 1 --2- 172.21.15.6:0/648773834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c72a10 0x561d57d15b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.624+0000 7f1de407bb80 1 -- 172.21.15.6:0/648773834 >> 172.21.15.6:0/648773834 conn(0x561d57c70e80 msgr2=0x561d57cba780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:46.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.624+0000 7f1de407bb80 1 -- 172.21.15.6:0/648773834 shutdown_connections 2023-10-06T02:28:46.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.625+0000 7f1de407bb80 1 -- 172.21.15.6:0/648773834 wait complete. 2023-10-06T02:28:46.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.625+0000 7f1de407bb80 1 -- start start 2023-10-06T02:28:46.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.625+0000 7f1de407bb80 1 Processor -- start 2023-10-06T02:28:46.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.626+0000 7f1de407bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c712c0 0x561d57d14e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.626+0000 7f1de407bb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c72a10 0x561d57c9c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.626+0000 7f1de407bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c90e50 0x561d57d1ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.626+0000 7f1de407bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d57cd4570 con 0x561d57c90e50 2023-10-06T02:28:46.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.626+0000 7f1de407bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d57d1da50 con 0x561d57c712c0 2023-10-06T02:28:46.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.626+0000 7f1de407bb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d57cb6e50 con 0x561d57c72a10 2023-10-06T02:28:46.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.626+0000 7f1de407bb80 10 client.0 _ll_register_callbacks cb 0x561d57c33020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:28:46.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.626+0000 7f1dd9320700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c90e50 0x561d57d1ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.626+0000 7f1dd9320700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c90e50 0x561d57d1ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34334/0 (socket says 172.21.15.6:34334) 2023-10-06T02:28:46.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.626+0000 7f1dd9320700 1 -- 172.21.15.6:0/628788577 learned_addr learned my addr 172.21.15.6:0/628788577 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:46.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.626+0000 7f1dd8b1f700 1 --2- 172.21.15.6:0/628788577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c712c0 0x561d57d14e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.626+0000 7f1dd3fff700 1 --2- 172.21.15.6:0/628788577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c72a10 0x561d57c9c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.626+0000 7f1dd9320700 1 -- 172.21.15.6:0/628788577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c72a10 msgr2=0x561d57c9c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:46.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.626+0000 7f1dd9320700 1 --2- 172.21.15.6:0/628788577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c72a10 0x561d57c9c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.626+0000 7f1dd9320700 1 -- 172.21.15.6:0/628788577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c712c0 msgr2=0x561d57d14e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:46.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.626+0000 7f1dd9320700 1 --2- 172.21.15.6:0/628788577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c712c0 0x561d57d14e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.626+0000 7f1dd9320700 1 -- 172.21.15.6:0/628788577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d57a5a270 con 0x561d57c90e50 2023-10-06T02:28:46.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.627+0000 7f1dd9320700 1 --2- 172.21.15.6:0/628788577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c90e50 0x561d57d1ceb0 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc001a30 tx=0x7f1dbc029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980ed3968a919485 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.627+0000 7f1db2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:28:46.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.627+0000 7f1db2ffd700 1 -- 172.21.15.6:0/628788577 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc00cdb0 con 0x561d57c90e50 2023-10-06T02:28:46.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.627+0000 7f1db2ffd700 1 -- 172.21.15.6:0/628788577 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7f1dbc034020 con 0x561d57c90e50 2023-10-06T02:28:46.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.627+0000 7f1de407bb80 1 -- 172.21.15.6:0/628788577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d57c91fa0 con 0x561d57c90e50 2023-10-06T02:28:46.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.627+0000 7f1db2ffd700 1 -- 172.21.15.6:0/628788577 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=305) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dbc007070 con 0x561d57c90e50 2023-10-06T02:28:46.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.627+0000 7f1de407bb80 10 client.10257 fetch_fsmap learned FSMap version 305 2023-10-06T02:28:46.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.627+0000 7f1de407bb80 1 -- 172.21.15.6:0/628788577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=305,monmap=2+}) v3 -- 0x561d57b75470 con 0x561d57c90e50 2023-10-06T02:28:46.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.627+0000 7f1db2ffd700 1 -- 172.21.15.6:0/628788577 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d57c91fa0 con 0x561d57c90e50 2023-10-06T02:28:46.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.627+0000 7f1db2ffd700 1 -- 172.21.15.6:0/628788577 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 305) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1dbc019070 con 0x561d57c90e50 2023-10-06T02:28:46.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.627+0000 7f1de407bb80 10 client.10257 fetch_fsmap finished waiting for FSMap version 305 2023-10-06T02:28:46.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.627+0000 7f1de407bb80 10 client.10257 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:28:46.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.627+0000 7f1de407bb80 20 client.10257 populate_metadata read hostname 'smithi006' 2023-10-06T02:28:46.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.627+0000 7f1de407bb80 1 --2- 172.21.15.6:0/628788577 >> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] conn(0x561d57c70990 0x561d57c71690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.627+0000 7f1de407bb80 4 client.10257 mds_command: new command op to 10164 tid=0[{"prefix": "status"}] 2023-10-06T02:28:46.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.627+0000 7f1de407bb80 1 -- 172.21.15.6:0/628788577 --> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f1dbc001690 con 0x561d57c70990 2023-10-06T02:28:46.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.627+0000 7f1dd8b1f700 1 --2- 172.21.15.6:0/628788577 >> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] conn(0x561d57c70990 0x561d57c71690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.628+0000 7f1db2ffd700 10 client.10257 ms_handle_connect on v2:172.21.15.6:6833/171345142 2023-10-06T02:28:46.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.628+0000 7f1dd8b1f700 1 --2- 172.21.15.6:0/628788577 >> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] conn(0x561d57c70990 0x561d57c71690 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fd7c6495ed7b288 server_cookie=6e3bd1d279ab17aa in_seq=0 out_seq=0 2023-10-06T02:28:46.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.628+0000 7f1db2ffd700 1 -- 172.21.15.6:0/628788577 <== mds.0 v2:172.21.15.6:6833/171345142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+329 (crc 0 0 0) 0x7f1dbc001690 con 0x561d57c70990 2023-10-06T02:28:46.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.628+0000 7f1db2ffd700 10 client.10257 handle_command_reply: tid=0 2023-10-06T02:28:46.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.628+0000 7f1de407bb80 1 client.10257 shutdown 2023-10-06T02:28:46.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.628+0000 7f1de407bb80 1 -- 172.21.15.6:0/628788577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c90e50 msgr2=0x561d57d1ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.628+0000 7f1de407bb80 1 --2- 172.21.15.6:0/628788577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c90e50 0x561d57d1ceb0 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc001a30 tx=0x7f1dbc029000 comp rx=0 tx=0).stop 2023-10-06T02:28:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.628+0000 7f1de407bb80 1 -- 172.21.15.6:0/628788577 shutdown_connections 2023-10-06T02:28:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.628+0000 7f1de407bb80 1 --2- 172.21.15.6:0/628788577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d57c90e50 0x561d57d1ceb0 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.628+0000 7f1de407bb80 1 --2- 172.21.15.6:0/628788577 >> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] conn(0x561d57c70990 0x561d57c71690 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.628+0000 7f1de407bb80 1 --2- 172.21.15.6:0/628788577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d57c712c0 0x561d57d14e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.628+0000 7f1de407bb80 1 --2- 172.21.15.6:0/628788577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561d57c72a10 0x561d57c9c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.628+0000 7f1db2ffd700 0 client.10257 ms_handle_reset on v2:172.21.15.6:6833/171345142 2023-10-06T02:28:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.628+0000 7f1de407bb80 1 -- 172.21.15.6:0/628788577 >> 172.21.15.6:0/628788577 conn(0x561d57c70e80 msgr2=0x561d57cb9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.628+0000 7f1de407bb80 1 -- 172.21.15.6:0/628788577 shutdown_connections 2023-10-06T02:28:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.628+0000 7f1de407bb80 1 -- 172.21.15.6:0/628788577 wait complete. 2023-10-06T02:28:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.628+0000 7f1de407bb80 20 client.10257 trim_cache size 0 max 16384 2023-10-06T02:28:46.637 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:28:46.637 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:28:46.637 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:28:46.637 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 10164, 2023-10-06T02:28:46.637 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:28:46.637 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:28:46.637 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:28:46.637 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 6.7767617700000002, 2023-10-06T02:28:46.637 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 305, 2023-10-06T02:28:46.638 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 128, 2023-10-06T02:28:46.638 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 128, 2023-10-06T02:28:46.638 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 12.647264819 2023-10-06T02:28:46.638 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:28:46.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.629+0000 7f1dd9b21700 1 -- 172.21.15.6:0/1181304838 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1db4066f30 msgr2=0x7f1db40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.629+0000 7f1dd9b21700 1 --2- 172.21.15.6:0/1181304838 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1db4066f30 0x7f1db40693e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009710 tx=0x7f1dcc008040 comp rx=0 tx=0).stop 2023-10-06T02:28:46.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.629+0000 7f1dd9b21700 1 -- 172.21.15.6:0/1181304838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd40c90e0 msgr2=0x7f1dd41597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.629+0000 7f1dd9b21700 1 --2- 172.21.15.6:0/1181304838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd40c90e0 0x7f1dd41597d0 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400ecf0 tx=0x7f1dc40017e0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.629+0000 7f1dd9b21700 1 -- 172.21.15.6:0/1181304838 shutdown_connections 2023-10-06T02:28:46.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.629+0000 7f1dd9b21700 1 --2- 172.21.15.6:0/1181304838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dd40c7d00 0x7f1dd40c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.629+0000 7f1dd9b21700 1 --2- 172.21.15.6:0/1181304838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dd40c7930 0x7f1dd415b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.629+0000 7f1dd9b21700 1 --2- 172.21.15.6:0/1181304838 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1db4066f30 0x7f1db40693e0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.629+0000 7f1dd9b21700 1 --2- 172.21.15.6:0/1181304838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd40c90e0 0x7f1dd41597d0 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.629+0000 7f1dd9b21700 1 -- 172.21.15.6:0/1181304838 >> 172.21.15.6:0/1181304838 conn(0x7f1dd406ac10 msgr2=0x7f1dd40cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:46.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.629+0000 7f1dd9b21700 1 -- 172.21.15.6:0/1181304838 shutdown_connections 2023-10-06T02:28:46.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.629+0000 7f1dd9b21700 1 -- 172.21.15.6:0/1181304838 wait complete. 2023-10-06T02:28:46.642 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:28:46.642 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Corrupt omap key 1.00000000:subdir_head', proceeding to ls 2023-10-06T02:28:46.642 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:28:46.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.761+0000 7fb0a4492700 1 Processor -- start 2023-10-06T02:28:46.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.761+0000 7fb0a4492700 1 -- start start 2023-10-06T02:28:46.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.762+0000 7fb0a4492700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb09c067d10 0x7fb09c06a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.762+0000 7fb0a4492700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09c0b1ed0 con 0x7fb09c15ca10 2023-10-06T02:28:46.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.762+0000 7fb0a4492700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09c0879c0 con 0x7fb09c15cde0 2023-10-06T02:28:46.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.762+0000 7fb0a4492700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09c0cec50 con 0x7fb09c067d10 2023-10-06T02:28:46.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.762+0000 7fb0a222e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb09c15ca10 0x7fb09c069f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38648/0 (socket says 172.21.15.6:38648) 2023-10-06T02:28:46.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.762+0000 7fb0a222e700 1 -- 172.21.15.6:0/215671684 learned_addr learned my addr 172.21.15.6:0/215671684 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:46.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.762+0000 7fb0a1a2d700 1 --2- 172.21.15.6:0/215671684 >> v2:172.21.15.175:3300/0 conn(0x7fb09c067d10 0x7fb09c06a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.762+0000 7fb0a122c700 1 -- 172.21.15.6:0/215671684 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580739058 0 0) 0x7fb09c0b1ed0 con 0x7fb09c15ca10 2023-10-06T02:28:46.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.762+0000 7fb0a122c700 1 -- 172.21.15.6:0/215671684 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb088003570 con 0x7fb09c15ca10 2023-10-06T02:28:46.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.762+0000 7fb0a1a2d700 1 -- 172.21.15.6:0/215671684 >> v1:172.21.15.175:6789/0 conn(0x7fb09c15cde0 legacy=0x7fb09c0b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.762+0000 7fb0a122c700 1 -- 172.21.15.6:0/215671684 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170794713 0 0) 0x7fb09c0879c0 con 0x7fb09c15cde0 2023-10-06T02:28:46.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.762+0000 7fb0a1a2d700 1 -- 172.21.15.6:0/215671684 >> v1:172.21.15.6:6789/0 conn(0x7fb09c15ca10 legacy=0x7fb09c069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.762+0000 7fb0a1a2d700 1 -- 172.21.15.6:0/215671684 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c0cef30 con 0x7fb09c067d10 2023-10-06T02:28:46.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.763+0000 7fb0a1a2d700 1 --2- 172.21.15.6:0/215671684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb09c067d10 0x7fb09c06a680 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb08c0098e0 tx=0x7fb08c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51d6d310961bced0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.763+0000 7fb0a122c700 1 -- 172.21.15.6:0/215671684 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c00b640 con 0x7fb09c067d10 2023-10-06T02:28:46.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.763+0000 7fb0a122c700 1 -- 172.21.15.6:0/215671684 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c00b7a0 con 0x7fb09c067d10 2023-10-06T02:28:46.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.763+0000 7fb0a122c700 1 -- 172.21.15.6:0/215671684 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c00bb40 con 0x7fb09c067d10 2023-10-06T02:28:46.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.763+0000 7fb0a4492700 1 -- 172.21.15.6:0/215671684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb09c067d10 msgr2=0x7fb09c06a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.763+0000 7fb0a4492700 1 --2- 172.21.15.6:0/215671684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb09c067d10 0x7fb09c06a680 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb08c0098e0 tx=0x7fb08c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.763+0000 7fb0a4492700 1 -- 172.21.15.6:0/215671684 shutdown_connections 2023-10-06T02:28:46.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.763+0000 7fb0a4492700 1 --2- 172.21.15.6:0/215671684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb09c067d10 0x7fb09c06a680 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.763+0000 7fb0a4492700 1 -- 172.21.15.6:0/215671684 >> 172.21.15.6:0/215671684 conn(0x7fb09c067910 msgr2=0x7fb09c0ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:46.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.763+0000 7fb0a4492700 1 -- 172.21.15.6:0/215671684 shutdown_connections 2023-10-06T02:28:46.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.764+0000 7fb0a4492700 1 -- 172.21.15.6:0/215671684 wait complete. 2023-10-06T02:28:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.765+0000 7fb0a4492700 1 Processor -- start 2023-10-06T02:28:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.765+0000 7fb0a4492700 1 -- start start 2023-10-06T02:28:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.765+0000 7fb0a4492700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb09c067d10 0x7fb09c155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.765+0000 7fb0a4492700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb09c15ca10 0x7fb09c152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.765+0000 7fb0a4492700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb09c15cde0 0x7fb09c158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.765+0000 7fb0a4492700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c1534d0 con 0x7fb09c15cde0 2023-10-06T02:28:46.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.765+0000 7fb0a4492700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c15e920 con 0x7fb09c15ca10 2023-10-06T02:28:46.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.765+0000 7fb0a4492700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c15e310 con 0x7fb09c067d10 2023-10-06T02:28:46.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.765+0000 7fb0a2a2f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb09c15cde0 0x7fb09c158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.765+0000 7fb0a2a2f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb09c15cde0 0x7fb09c158d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34348/0 (socket says 172.21.15.6:34348) 2023-10-06T02:28:46.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.765+0000 7fb0a2a2f700 1 -- 172.21.15.6:0/686860256 learned_addr learned my addr 172.21.15.6:0/686860256 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:46.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.766+0000 7fb0a222e700 1 --2- 172.21.15.6:0/686860256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb09c067d10 0x7fb09c155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.766+0000 7fb0a1a2d700 1 --2- 172.21.15.6:0/686860256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb09c15ca10 0x7fb09c152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.766+0000 7fb0a2a2f700 1 -- 172.21.15.6:0/686860256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb09c067d10 msgr2=0x7fb09c155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.766+0000 7fb0a2a2f700 1 --2- 172.21.15.6:0/686860256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb09c067d10 0x7fb09c155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.766+0000 7fb0a2a2f700 1 -- 172.21.15.6:0/686860256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb09c15ca10 msgr2=0x7fb09c152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.766+0000 7fb0a2a2f700 1 --2- 172.21.15.6:0/686860256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb09c15ca10 0x7fb09c152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.766+0000 7fb0a2a2f700 1 -- 172.21.15.6:0/686860256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c009420 con 0x7fb09c15cde0 2023-10-06T02:28:46.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.766+0000 7fb0a2a2f700 1 --2- 172.21.15.6:0/686860256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb09c15cde0 0x7fb09c158d00 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7fb09400c890 tx=0x7fb094001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.766+0000 7fb0927fc700 1 -- 172.21.15.6:0/686860256 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094012630 con 0x7fb09c15cde0 2023-10-06T02:28:46.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.766+0000 7fb0927fc700 1 -- 172.21.15.6:0/686860256 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb094012790 con 0x7fb09c15cde0 2023-10-06T02:28:46.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.766+0000 7fb0a4492700 1 -- 172.21.15.6:0/686860256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09c1531f0 con 0x7fb09c15cde0 2023-10-06T02:28:46.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.766+0000 7fb0927fc700 1 -- 172.21.15.6:0/686860256 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094012b50 con 0x7fb09c15cde0 2023-10-06T02:28:46.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.766+0000 7fb0a4492700 1 -- 172.21.15.6:0/686860256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09c152860 con 0x7fb09c15cde0 2023-10-06T02:28:46.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.767+0000 7fb0a4492700 1 -- 172.21.15.6:0/686860256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09c15e170 con 0x7fb09c15cde0 2023-10-06T02:28:46.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.767+0000 7fb0927fc700 1 -- 172.21.15.6:0/686860256 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb09401a3a0 con 0x7fb09c15cde0 2023-10-06T02:28:46.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.768+0000 7fb0927fc700 1 --2- 172.21.15.6:0/686860256 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb080066f30 0x7fb0800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.768+0000 7fb0927fc700 1 -- 172.21.15.6:0/686860256 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7fb0940854c0 con 0x7fb09c15cde0 2023-10-06T02:28:46.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.768+0000 7fb0a222e700 1 --2- 172.21.15.6:0/686860256 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb080066f30 0x7fb0800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.768+0000 7fb0a222e700 1 --2- 172.21.15.6:0/686860256 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb080066f30 0x7fb0800693e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb098000c00 tx=0x7fb098009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:46.772+0000 7fb0927fc700 1 -- 172.21.15.6:0/686860256 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb09c15e170 con 0x7fb09c15cde0 2023-10-06T02:28:47.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:47.016+0000 7fb0a4492700 1 -- 172.21.15.6:0/686860256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb09c15e170 con 0x7fb09c15cde0 2023-10-06T02:28:47.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:47.016+0000 7fb0927fc700 1 -- 172.21.15.6:0/686860256 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v305) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb09c15e170 con 0x7fb09c15cde0 2023-10-06T02:28:47.017 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:28:47.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:47.018+0000 7fb0a4492700 1 -- 172.21.15.6:0/686860256 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb080066f30 msgr2=0x7fb0800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:47.018+0000 7fb0a4492700 1 --2- 172.21.15.6:0/686860256 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb080066f30 0x7fb0800693e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb098000c00 tx=0x7fb098009040 comp rx=0 tx=0).stop 2023-10-06T02:28:47.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:47.018+0000 7fb0a4492700 1 -- 172.21.15.6:0/686860256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb09c15cde0 msgr2=0x7fb09c158d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:47.018+0000 7fb0a4492700 1 --2- 172.21.15.6:0/686860256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb09c15cde0 0x7fb09c158d00 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7fb09400c890 tx=0x7fb094001670 comp rx=0 tx=0).stop 2023-10-06T02:28:47.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:47.018+0000 7fb0a4492700 1 -- 172.21.15.6:0/686860256 shutdown_connections 2023-10-06T02:28:47.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:47.018+0000 7fb0a4492700 1 --2- 172.21.15.6:0/686860256 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb080066f30 0x7fb0800693e0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:47.018+0000 7fb0a4492700 1 --2- 172.21.15.6:0/686860256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb09c15cde0 0x7fb09c158d00 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:47.018+0000 7fb0a4492700 1 --2- 172.21.15.6:0/686860256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb09c067d10 0x7fb09c155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:47.018+0000 7fb0a4492700 1 --2- 172.21.15.6:0/686860256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb09c15ca10 0x7fb09c152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:47.018+0000 7fb0a4492700 1 -- 172.21.15.6:0/686860256 >> 172.21.15.6:0/686860256 conn(0x7fb09c067910 msgr2=0x7fb09c0b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:47.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:47.018+0000 7fb0a4492700 1 -- 172.21.15.6:0/686860256 shutdown_connections 2023-10-06T02:28:47.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:47.018+0000 7fb0a4492700 1 -- 172.21.15.6:0/686860256 wait complete. 2023-10-06T02:28:47.031 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:28:47.031 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:28:47.031 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:28:47.031 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:28:47.031 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:47.031 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:28:47.031 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:28:47.031 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:28:47.032 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:28:47.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:47.032 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:28:47.049 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:28:47.049 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:28:47.049 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:28:47.049 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:47.049 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:28:47.049 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:47.049 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:28:47.050 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:47.050 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:28:47.050 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:28:47.050 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:47.050 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:28:47.050 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:28:47.050 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:47.050 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:28:47.050 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:28:47.050 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41819sec preferred_lft 41819sec 2023-10-06T02:28:47.050 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:28:47.050 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:47.051 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:28:47.051 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:47.051 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:28:47.051 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:28:47.051 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:47.051 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:28:47.051 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:47.051 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:28:47.051 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:47.051 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:28:47.051 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:28:47.051 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:28:47.051 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:47.052 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:28:47.052 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:28:47.052 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:28:47.052 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:47.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:47.052 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:28:47.111 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:28:47.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:47.112 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:28:47.168 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:28:47.168 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:28:47.168 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:28:47.169 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:28:47.169 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:28:47.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:47.169 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:28:47.169 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:28:47.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:28:47.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:28:47.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:28:47.170 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:28:47.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:47.271 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:28:47.286 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:28:47.286 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:28:47.287 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:28:47.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:47.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:28:47.352 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:28:47.352 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:28:47.353 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:47.407 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:28:47.408 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:28:47.408 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:47.461 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:28:47.526 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:28:47.526 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:28:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:28:47.592 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:28:47.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:47.592 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:28:47.647 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:28:47.647 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:28:47.690 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:28:47.714 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:28:47.714 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:28:47.773 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:28:47.773+0000 7f9b219fb540 -1 init, newargv = 0x5650ea1aa4c0 newargc=15 2023-10-06T02:28:47.774 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[140387]: starting ceph client 2023-10-06T02:28:47.779 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[140387]: starting fuse 2023-10-06T02:28:47.780 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:28:47.782 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:28:47.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:47.782 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:28:47.837 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:28:47.838 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:28:47.838 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:47.838 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:28:47.838 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:28:47.838 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:28:47.838 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:28:47.838 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:28:47.838 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:28:47.838 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:28:47.839 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:28:47.839 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:28:47.839 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:28:47.839 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:28:47.839 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:28:47.839 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:28:47.839 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:28:47.839 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:28:47.839 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:28:47.839 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:28:47.839 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:28:47.839 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:28:47.839 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:28:47.839 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:28:47.840 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:28:47.840 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:28:47.840 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:28:47.840 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:28:47.840 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:28:47.960 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.140387.asok 2023-10-06T02:28:48.142 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.140387.asok 2023-10-06T02:28:48.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:48.143 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.140387.asok status 2023-10-06T02:28:48.297 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:28:48.297 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:28:48.297 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:28:48.297 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:28:48.297 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:28:48.297 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:28:48.297 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:28:48.298 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "140387", 2023-10-06T02:28:48.298 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:28:48.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:28:48.298 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:28:48.298 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:28:48.298 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 10269, 2023-10-06T02:28:48.298 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:28:48.298 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:28:48.298 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:28:48.298 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 10269 2023-10-06T02:28:48.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:28:48.298 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:28:48.299 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:28:48.299 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:28:48.299 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1430640511 2023-10-06T02:28:48.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:28:48.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:28:48.299 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:28:48.299 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:28:48.299 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:28:48.299 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1430640511 2023-10-06T02:28:48.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:28:48.299 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.10269 192.168.0.1:0/1430640511", 2023-10-06T02:28:48.299 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/1430640511", 2023-10-06T02:28:48.299 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:28:48.300 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 305, 2023-10-06T02:28:48.300 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 128, 2023-10-06T02:28:48.300 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:28:48.300 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:28:48.300 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:28:48.300 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:28:48.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:48.307 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:28:48.307 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:48.323 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:28:48.323 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:48.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:48.323 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:48.389 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:48.389 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:28:48.389 DEBUG:teuthology.orchestra.run.smithi006:> import stat 2023-10-06T02:28:48.389 DEBUG:teuthology.orchestra.run.smithi006:> import json 2023-10-06T02:28:48.389 DEBUG:teuthology.orchestra.run.smithi006:> import sys 2023-10-06T02:28:48.389 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:28:48.389 DEBUG:teuthology.orchestra.run.smithi006:> try: 2023-10-06T02:28:48.389 DEBUG:teuthology.orchestra.run.smithi006:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/./subdir'"'"') 2023-10-06T02:28:48.389 DEBUG:teuthology.orchestra.run.smithi006:> except OSError as e: 2023-10-06T02:28:48.390 DEBUG:teuthology.orchestra.run.smithi006:> sys.exit(e.errno) 2023-10-06T02:28:48.390 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:28:48.390 DEBUG:teuthology.orchestra.run.smithi006:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-10-06T02:28:48.390 DEBUG:teuthology.orchestra.run.smithi006:> print(json.dumps( 2023-10-06T02:28:48.390 DEBUG:teuthology.orchestra.run.smithi006:> dict([(a, getattr(s, a)) for a in attrs]), 2023-10-06T02:28:48.390 DEBUG:teuthology.orchestra.run.smithi006:> indent=2)) 2023-10-06T02:28:48.390 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:28:48.432 INFO:teuthology.orchestra.run:waiting for 20 2023-10-06T02:28:48.679 INFO:teuthology.orchestra.run.smithi006.stderr:daemon-helper: command failed with exit status 5 2023-10-06T02:28:52.370 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:28:52.373 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:28:54.533 DEBUG:teuthology.orchestra.run:got remote process result: 5 2023-10-06T02:28:54.534 INFO:tasks.cephfs.test_damage:Result: EIO on client 2023-10-06T02:28:54.534 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.666+0000 7fac4aa43700 1 Processor -- start 2023-10-06T02:28:54.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.666+0000 7fac4aa43700 1 -- start start 2023-10-06T02:28:54.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.667+0000 7fac4aa43700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fac440ae520 0x7fac4415bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:54.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.667+0000 7fac4aa43700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac440a72b0 con 0x7fac4409a080 2023-10-06T02:28:54.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.667+0000 7fac4aa43700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac440a7590 con 0x7fac440ae8f0 2023-10-06T02:28:54.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.667+0000 7fac4aa43700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac4415b110 con 0x7fac440ae520 2023-10-06T02:28:54.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.667+0000 7fac437fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fac4409a080 0x7fac440a6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39498/0 (socket says 172.21.15.6:39498) 2023-10-06T02:28:54.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.667+0000 7fac437fe700 1 -- 172.21.15.6:0/2206086273 learned_addr learned my addr 172.21.15.6:0/2206086273 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:54.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.667+0000 7fac43fff700 1 --2- 172.21.15.6:0/2206086273 >> v2:172.21.15.175:3300/0 conn(0x7fac440ae520 0x7fac4415bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:54.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.667+0000 7fac42ffd700 1 -- 172.21.15.6:0/2206086273 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958717250 0 0) 0x7fac440a72b0 con 0x7fac4409a080 2023-10-06T02:28:54.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.667+0000 7fac42ffd700 1 -- 172.21.15.6:0/2206086273 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac2c003570 con 0x7fac4409a080 2023-10-06T02:28:54.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.667+0000 7fac43fff700 1 -- 172.21.15.6:0/2206086273 >> v1:172.21.15.175:6789/0 conn(0x7fac440ae8f0 legacy=0x7fac44156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:54.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.667+0000 7fac42ffd700 1 -- 172.21.15.6:0/2206086273 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089432552 0 0) 0x7fac440a7590 con 0x7fac440ae8f0 2023-10-06T02:28:54.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.667+0000 7fac43fff700 1 -- 172.21.15.6:0/2206086273 >> v1:172.21.15.6:6789/0 conn(0x7fac4409a080 legacy=0x7fac440a6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:54.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.667+0000 7fac43fff700 1 -- 172.21.15.6:0/2206086273 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4415b3f0 con 0x7fac440ae520 2023-10-06T02:28:54.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.668+0000 7fac43fff700 1 --2- 172.21.15.6:0/2206086273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac440ae520 0x7fac4415bbf0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fac340098e0 tx=0x7fac340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eaed98557dc9f67 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:54.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.668+0000 7fac42ffd700 1 -- 172.21.15.6:0/2206086273 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac38001470 con 0x7fac440ae520 2023-10-06T02:28:54.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.668+0000 7fac42ffd700 1 -- 172.21.15.6:0/2206086273 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac34011420 con 0x7fac440ae520 2023-10-06T02:28:54.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.668+0000 7fac42ffd700 1 -- 172.21.15.6:0/2206086273 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac340117c0 con 0x7fac440ae520 2023-10-06T02:28:54.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.668+0000 7fac4aa43700 1 -- 172.21.15.6:0/2206086273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac440ae520 msgr2=0x7fac4415bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:54.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.668+0000 7fac4aa43700 1 --2- 172.21.15.6:0/2206086273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac440ae520 0x7fac4415bbf0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fac340098e0 tx=0x7fac340091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.668+0000 7fac4aa43700 1 -- 172.21.15.6:0/2206086273 shutdown_connections 2023-10-06T02:28:54.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.668+0000 7fac4aa43700 1 --2- 172.21.15.6:0/2206086273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac440ae520 0x7fac4415bbf0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.668+0000 7fac4aa43700 1 -- 172.21.15.6:0/2206086273 >> 172.21.15.6:0/2206086273 conn(0x7fac440cc790 msgr2=0x7fac440ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:54.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.668+0000 7fac4aa43700 1 -- 172.21.15.6:0/2206086273 shutdown_connections 2023-10-06T02:28:54.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.669+0000 7fac4aa43700 1 -- 172.21.15.6:0/2206086273 wait complete. 2023-10-06T02:28:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.670+0000 7fac4aa43700 1 Processor -- start 2023-10-06T02:28:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.670+0000 7fac4aa43700 1 -- start start 2023-10-06T02:28:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.670+0000 7fac4aa43700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac4409a080 0x7fac44155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.670+0000 7fac4aa43700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac440ae520 0x7fac44097690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac4aa43700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440ae8f0 0x7fac44068680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac4aa43700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac44098430 con 0x7fac4409a080 2023-10-06T02:28:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac4aa43700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac441675d0 con 0x7fac440ae520 2023-10-06T02:28:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac4aa43700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac44167e30 con 0x7fac440ae8f0 2023-10-06T02:28:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac43fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac4409a080 0x7fac44155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac43fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac4409a080 0x7fac44155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56398/0 (socket says 172.21.15.6:56398) 2023-10-06T02:28:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac43fff700 1 -- 172.21.15.6:0/1789689403 learned_addr learned my addr 172.21.15.6:0/1789689403 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac437fe700 1 --2- 172.21.15.6:0/1789689403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac440ae520 0x7fac44097690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:54.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac48fe0700 1 --2- 172.21.15.6:0/1789689403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440ae8f0 0x7fac44068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:54.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac43fff700 1 -- 172.21.15.6:0/1789689403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440ae8f0 msgr2=0x7fac44068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:54.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac43fff700 1 --2- 172.21.15.6:0/1789689403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440ae8f0 0x7fac44068680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac43fff700 1 -- 172.21.15.6:0/1789689403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac440ae520 msgr2=0x7fac44097690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:54.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac43fff700 1 --2- 172.21.15.6:0/1789689403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac440ae520 0x7fac44097690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac43fff700 1 -- 172.21.15.6:0/1789689403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac34009420 con 0x7fac4409a080 2023-10-06T02:28:54.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac437fe700 1 --2- 172.21.15.6:0/1789689403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac440ae520 0x7fac44097690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:54.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac43fff700 1 --2- 172.21.15.6:0/1789689403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac4409a080 0x7fac44155110 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7fac340030c0 tx=0x7fac34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:54.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac2bfff700 1 -- 172.21.15.6:0/1789689403 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac34010c20 con 0x7fac4409a080 2023-10-06T02:28:54.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac2bfff700 1 -- 172.21.15.6:0/1789689403 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac34010d80 con 0x7fac4409a080 2023-10-06T02:28:54.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac4aa43700 1 -- 172.21.15.6:0/1789689403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac44098150 con 0x7fac4409a080 2023-10-06T02:28:54.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac2bfff700 1 -- 172.21.15.6:0/1789689403 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3401d680 con 0x7fac4409a080 2023-10-06T02:28:54.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.671+0000 7fac4aa43700 1 -- 172.21.15.6:0/1789689403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac44167b40 con 0x7fac4409a080 2023-10-06T02:28:54.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.672+0000 7fac4aa43700 1 -- 172.21.15.6:0/1789689403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4406e1b0 con 0x7fac4409a080 2023-10-06T02:28:54.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.673+0000 7fac2bfff700 1 -- 172.21.15.6:0/1789689403 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac3401da30 con 0x7fac4409a080 2023-10-06T02:28:54.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.673+0000 7fac2bfff700 1 --2- 172.21.15.6:0/1789689403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fac30066f30 0x7fac300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:54.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.673+0000 7fac2bfff700 1 -- 172.21.15.6:0/1789689403 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7fac34087250 con 0x7fac4409a080 2023-10-06T02:28:54.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.673+0000 7fac437fe700 1 --2- 172.21.15.6:0/1789689403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fac30066f30 0x7fac300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:54.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.674+0000 7fac437fe700 1 --2- 172.21.15.6:0/1789689403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fac30066f30 0x7fac300693e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fac380011e0 tx=0x7fac38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:54.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.678+0000 7fac2bfff700 1 -- 172.21.15.6:0/1789689403 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac340536d0 con 0x7fac4409a080 2023-10-06T02:28:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.918+0000 7fac4aa43700 1 -- 172.21.15.6:0/1789689403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac4404bb80 con 0x7fac4409a080 2023-10-06T02:28:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.918+0000 7fac2bfff700 1 -- 172.21.15.6:0/1789689403 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 305 v305) v1 ==== 95+0+4604 (secure 0 0 0) 0x7fac34056cf0 con 0x7fac4409a080 2023-10-06T02:28:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:54.919 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":305,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":305,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:28:45.996149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":128,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10164":{"gid":10164,"name":"a","rank":0,"incarnation":301,"state":"up:active","state_seq":6,"addr":"172.21.15.6:6835/171345142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":171345142},{"type":"v1","addr":"172.21.15.6:6835","nonce":171345142}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.920+0000 7fac4aa43700 1 -- 172.21.15.6:0/1789689403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fac30066f30 msgr2=0x7fac300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.920+0000 7fac4aa43700 1 --2- 172.21.15.6:0/1789689403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fac30066f30 0x7fac300693e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fac380011e0 tx=0x7fac38009040 comp rx=0 tx=0).stop 2023-10-06T02:28:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.920+0000 7fac4aa43700 1 -- 172.21.15.6:0/1789689403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac4409a080 msgr2=0x7fac44155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.920+0000 7fac4aa43700 1 --2- 172.21.15.6:0/1789689403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac4409a080 0x7fac44155110 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7fac340030c0 tx=0x7fac34017000 comp rx=0 tx=0).stop 2023-10-06T02:28:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.920+0000 7fac4aa43700 1 -- 172.21.15.6:0/1789689403 shutdown_connections 2023-10-06T02:28:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.920+0000 7fac4aa43700 1 --2- 172.21.15.6:0/1789689403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440ae8f0 0x7fac44068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.920+0000 7fac4aa43700 1 --2- 172.21.15.6:0/1789689403 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fac30066f30 0x7fac300693e0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.920+0000 7fac4aa43700 1 --2- 172.21.15.6:0/1789689403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac4409a080 0x7fac44155110 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.920+0000 7fac4aa43700 1 --2- 172.21.15.6:0/1789689403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac440ae520 0x7fac44097690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.920+0000 7fac4aa43700 1 -- 172.21.15.6:0/1789689403 >> 172.21.15.6:0/1789689403 conn(0x7fac440cc790 msgr2=0x7fac441560d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.920+0000 7fac4aa43700 1 -- 172.21.15.6:0/1789689403 shutdown_connections 2023-10-06T02:28:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:54.920+0000 7fac4aa43700 1 -- 172.21.15.6:0/1789689403 wait complete. 2023-10-06T02:28:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 305 2023-10-06T02:28:54.933 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2023-10-06T02:28:55.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.054+0000 7fbaf12f7700 1 Processor -- start 2023-10-06T02:28:55.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.054+0000 7fbaf12f7700 1 -- start start 2023-10-06T02:28:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.055+0000 7fbaf12f7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec069d80 0x7fbaec06a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.055+0000 7fbaf12f7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbaec0cdd60 0x7fbaec0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.055+0000 7fbaf12f7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaec06a730 con 0x7fbaec0cf7d0 2023-10-06T02:28:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.055+0000 7fbaf12f7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaec159c10 con 0x7fbaec0cdd60 2023-10-06T02:28:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.055+0000 7fbaf12f7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec15abd0 con 0x7fbaec069d80 2023-10-06T02:28:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.055+0000 7fbaeb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbaec0cdd60 0x7fbaec0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.055+0000 7fbaeb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbaec0cdd60 0x7fbaec0ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56402/0 (socket says 172.21.15.6:56402) 2023-10-06T02:28:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.055+0000 7fbaeb7fe700 1 -- 172.21.15.6:0/1864742276 learned_addr learned my addr 172.21.15.6:0/1864742276 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.055+0000 7fbaea7fc700 1 --2- 172.21.15.6:0/1864742276 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec069d80 0x7fbaec06a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.055+0000 7fbaeb7fe700 1 -- 172.21.15.6:0/1864742276 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec069d80 msgr2=0x7fbaec06a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.055+0000 7fbaeb7fe700 1 --2- 172.21.15.6:0/1864742276 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec069d80 0x7fbaec06a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.055+0000 7fbaeb7fe700 1 -- 172.21.15.6:0/1864742276 >> v1:172.21.15.175:6789/0 conn(0x7fbaec0cf7d0 legacy=0x7fbaec0cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.055+0000 7fbaeb7fe700 1 -- 172.21.15.6:0/1864742276 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec0cbb80 con 0x7fbaec0cdd60 2023-10-06T02:28:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.056+0000 7fbaeb7fe700 1 --2- 172.21.15.6:0/1864742276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaec0cdd60 0x7fbaec0ce1c0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7fbae40099e0 tx=0x7fbae4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9538505ef36a3d11 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.056+0000 7fbae9ffb700 1 -- 172.21.15.6:0/1864742276 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae400b7e0 con 0x7fbaec0cdd60 2023-10-06T02:28:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.056+0000 7fbae9ffb700 1 -- 172.21.15.6:0/1864742276 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae400b940 con 0x7fbaec0cdd60 2023-10-06T02:28:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.056+0000 7fbae9ffb700 1 -- 172.21.15.6:0/1864742276 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae400bce0 con 0x7fbaec0cdd60 2023-10-06T02:28:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.056+0000 7fbaf12f7700 1 -- 172.21.15.6:0/1864742276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaec0cdd60 msgr2=0x7fbaec0ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.056+0000 7fbaf12f7700 1 --2- 172.21.15.6:0/1864742276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaec0cdd60 0x7fbaec0ce1c0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7fbae40099e0 tx=0x7fbae4009250 comp rx=0 tx=0).stop 2023-10-06T02:28:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.056+0000 7fbaf12f7700 1 -- 172.21.15.6:0/1864742276 shutdown_connections 2023-10-06T02:28:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.056+0000 7fbaf12f7700 1 --2- 172.21.15.6:0/1864742276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaec0cdd60 0x7fbaec0ce1c0 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.056+0000 7fbaf12f7700 1 --2- 172.21.15.6:0/1864742276 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec069d80 0x7fbaec06a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.056+0000 7fbaf12f7700 1 -- 172.21.15.6:0/1864742276 >> 172.21.15.6:0/1864742276 conn(0x7fbaec0d0c60 msgr2=0x7fbaec0ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.056+0000 7fbaf12f7700 1 -- 172.21.15.6:0/1864742276 shutdown_connections 2023-10-06T02:28:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.056+0000 7fbaf12f7700 1 -- 172.21.15.6:0/1864742276 wait complete. 2023-10-06T02:28:55.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.058+0000 7fbaf12f7700 1 Processor -- start 2023-10-06T02:28:55.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.058+0000 7fbaf12f7700 1 -- start start 2023-10-06T02:28:55.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.058+0000 7fbaf12f7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaec069d80 0x7fbaec0c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.058+0000 7fbaf12f7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec0cdd60 0x7fbaec0c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.058+0000 7fbaf12f7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaec0cf7d0 0x7fbaec16a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.058+0000 7fbaf12f7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec0a6c00 con 0x7fbaec0cf7d0 2023-10-06T02:28:55.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.058+0000 7fbaf12f7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec0c7800 con 0x7fbaec069d80 2023-10-06T02:28:55.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.058+0000 7fbaf12f7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec0c7ae0 con 0x7fbaec0cdd60 2023-10-06T02:28:55.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.058+0000 7fbaeb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaec0cf7d0 0x7fbaec16a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.058+0000 7fbaeb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaec0cf7d0 0x7fbaec16a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56410/0 (socket says 172.21.15.6:56410) 2023-10-06T02:28:55.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.058+0000 7fbaeb7fe700 1 -- 172.21.15.6:0/1576355312 learned_addr learned my addr 172.21.15.6:0/1576355312 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:55.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.059+0000 7fbaeb7fe700 1 -- 172.21.15.6:0/1576355312 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec0cdd60 msgr2=0x7fbaec0c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.059+0000 7fbaeb7fe700 1 --2- 172.21.15.6:0/1576355312 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec0cdd60 0x7fbaec0c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.059+0000 7fbaeb7fe700 1 -- 172.21.15.6:0/1576355312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaec069d80 msgr2=0x7fbaec0c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.059+0000 7fbaeb7fe700 1 --2- 172.21.15.6:0/1576355312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaec069d80 0x7fbaec0c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.059+0000 7fbaeb7fe700 1 -- 172.21.15.6:0/1576355312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae40094f0 con 0x7fbaec0cf7d0 2023-10-06T02:28:55.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.059+0000 7fbaeb7fe700 1 --2- 172.21.15.6:0/1576355312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaec0cf7d0 0x7fbaec16a1f0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7fbae40030c0 tx=0x7fbae4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.059+0000 7fbae2ffd700 1 -- 172.21.15.6:0/1576355312 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae400b7e0 con 0x7fbaec0cf7d0 2023-10-06T02:28:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.059+0000 7fbae2ffd700 1 -- 172.21.15.6:0/1576355312 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae4020070 con 0x7fbaec0cf7d0 2023-10-06T02:28:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.059+0000 7fbaf12f7700 1 -- 172.21.15.6:0/1576355312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaec0c7dc0 con 0x7fbaec0cf7d0 2023-10-06T02:28:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.059+0000 7fbae2ffd700 1 -- 172.21.15.6:0/1576355312 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae401b6a0 con 0x7fbaec0cf7d0 2023-10-06T02:28:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.059+0000 7fbaf12f7700 1 -- 172.21.15.6:0/1576355312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaec0c8380 con 0x7fbaec0cf7d0 2023-10-06T02:28:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.061+0000 7fbae2ffd700 1 -- 172.21.15.6:0/1576355312 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbae4022030 con 0x7fbaec0cf7d0 2023-10-06T02:28:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.061+0000 7fbae2ffd700 1 --2- 172.21.15.6:0/1576355312 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbacc066f30 0x7fbacc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.061+0000 7fbae2ffd700 1 -- 172.21.15.6:0/1576355312 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7fbae4087270 con 0x7fbaec0cf7d0 2023-10-06T02:28:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.062+0000 7fbaeaffd700 1 --2- 172.21.15.6:0/1576355312 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbacc066f30 0x7fbacc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.062+0000 7fbaeaffd700 1 --2- 172.21.15.6:0/1576355312 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbacc066f30 0x7fbacc0693e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fbaec15cb30 tx=0x7fbadc007ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.063+0000 7fbafa5efb80 1 Processor -- start 2023-10-06T02:28:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.063+0000 7fbafa5efb80 1 -- start start 2023-10-06T02:28:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.064+0000 7fbafa5efb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e81731ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.064+0000 7fbafa5efb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e81731b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.064+0000 7fbafa5efb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e817321ab0 0x55e81731b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.064+0000 7fbafa5efb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e817275b10 con 0x55e81733fef0 2023-10-06T02:28:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.064+0000 7fbafa5efb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e817273310 con 0x55e817321ab0 2023-10-06T02:28:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.064+0000 7fbafa5efb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e81726f100 con 0x55e817320360 2023-10-06T02:28:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.064+0000 7fbaeaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e81731ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.064+0000 7fbaeaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e81731ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56420/0 (socket says 172.21.15.6:56420) 2023-10-06T02:28:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.064+0000 7fbaeaffd700 1 -- 172.21.15.6:0/2348374275 learned_addr learned my addr 172.21.15.6:0/2348374275 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.064+0000 7fbaeb7fe700 1 --2- 172.21.15.6:0/2348374275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e817321ab0 0x55e81731b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.064+0000 7fbaea7fc700 1 --2- 172.21.15.6:0/2348374275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e81731b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.064+0000 7fbaeaffd700 1 -- 172.21.15.6:0/2348374275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 msgr2=0x55e81731b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.064+0000 7fbaeaffd700 1 --2- 172.21.15.6:0/2348374275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e81731b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.064+0000 7fbaeaffd700 1 -- 172.21.15.6:0/2348374275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e817321ab0 msgr2=0x55e81731b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.064+0000 7fbaeaffd700 1 --2- 172.21.15.6:0/2348374275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e817321ab0 0x55e81731b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.064+0000 7fbaeaffd700 1 -- 172.21.15.6:0/2348374275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e817109310 con 0x55e81733fef0 2023-10-06T02:28:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.064+0000 7fbaea7fc700 1 --2- 172.21.15.6:0/2348374275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e81731b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.065+0000 7fbaeaffd700 1 --2- 172.21.15.6:0/2348374275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e81731ad60 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00cc90 tx=0x7fbadc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a516bb66da7a55a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.065+0000 7fbacbfff700 1 -- 172.21.15.6:0/2348374275 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc013b60 con 0x55e81733fef0 2023-10-06T02:28:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.065+0000 7fbacbfff700 1 -- 172.21.15.6:0/2348374275 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc013cc0 con 0x55e81733fef0 2023-10-06T02:28:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.065+0000 7fbacbfff700 1 -- 172.21.15.6:0/2348374275 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc01e630 con 0x55e81733fef0 2023-10-06T02:28:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.065+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2348374275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 msgr2=0x55e81731ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.065+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/2348374275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e81731ad60 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00cc90 tx=0x7fbadc012000 comp rx=0 tx=0).stop 2023-10-06T02:28:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.065+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2348374275 shutdown_connections 2023-10-06T02:28:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.065+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/2348374275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e817321ab0 0x55e81731b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.065+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/2348374275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e81731ad60 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.065+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/2348374275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e81731b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.065+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2348374275 >> 172.21.15.6:0/2348374275 conn(0x55e81731ff20 msgr2=0x55e817320750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.065+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2348374275 shutdown_connections 2023-10-06T02:28:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.066+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2348374275 wait complete. 2023-10-06T02:28:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.066+0000 7fbafa5efb80 1 -- start start 2023-10-06T02:28:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.066+0000 7fbafa5efb80 1 Processor -- start 2023-10-06T02:28:55.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbafa5efb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e817366650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbafa5efb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e817321ab0 0x55e817366d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbafa5efb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e81733fef0 0x55e81731b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbafa5efb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e81721a930 con 0x55e817321ab0 2023-10-06T02:28:55.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbafa5efb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e817235f40 con 0x55e81733fef0 2023-10-06T02:28:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbafa5efb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e8170f1ed0 con 0x55e817320360 2023-10-06T02:28:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbafa5efb80 10 client.0 _ll_register_callbacks cb 0x55e8172e20c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:28:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbaea7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e817321ab0 0x55e817366d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbaea7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e817321ab0 0x55e817366d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56426/0 (socket says 172.21.15.6:56426) 2023-10-06T02:28:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbaea7fc700 1 -- 172.21.15.6:0/2447807824 learned_addr learned my addr 172.21.15.6:0/2447807824 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbaeb7fe700 1 --2- 172.21.15.6:0/2447807824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e81733fef0 0x55e81731b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbaeaffd700 1 --2- 172.21.15.6:0/2447807824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e817366650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbaea7fc700 1 -- 172.21.15.6:0/2447807824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 msgr2=0x55e817366650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbaea7fc700 1 --2- 172.21.15.6:0/2447807824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e817366650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbaea7fc700 1 -- 172.21.15.6:0/2447807824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e81733fef0 msgr2=0x55e81731b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbaea7fc700 1 --2- 172.21.15.6:0/2447807824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e81733fef0 0x55e81731b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbaea7fc700 1 -- 172.21.15.6:0/2447807824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbadc00c8d0 con 0x55e817321ab0 2023-10-06T02:28:55.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.067+0000 7fbaeaffd700 1 --2- 172.21.15.6:0/2447807824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e817366650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:55.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.068+0000 7fbaea7fc700 1 --2- 172.21.15.6:0/2447807824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e817321ab0 0x55e817366d10 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7fbad400f380 tx=0x7fbad4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba01ac861fc77e5e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.068+0000 7fbac97fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:28:55.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.068+0000 7fbac97fa700 1 -- 172.21.15.6:0/2447807824 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4014460 con 0x55e817321ab0 2023-10-06T02:28:55.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.068+0000 7fbac97fa700 1 -- 172.21.15.6:0/2447807824 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7fbad40145c0 con 0x55e817321ab0 2023-10-06T02:28:55.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.068+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2447807824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e8173139e0 con 0x55e817321ab0 2023-10-06T02:28:55.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.068+0000 7fbac97fa700 1 -- 172.21.15.6:0/2447807824 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=305) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbad4014990 con 0x55e817321ab0 2023-10-06T02:28:55.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.068+0000 7fbafa5efb80 10 client.10287 fetch_fsmap learned FSMap version 305 2023-10-06T02:28:55.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.068+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2447807824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=305,monmap=2+}) v3 -- 0x55e8170ac080 con 0x55e817321ab0 2023-10-06T02:28:55.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.068+0000 7fbac97fa700 1 -- 172.21.15.6:0/2447807824 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e8173139e0 con 0x55e817321ab0 2023-10-06T02:28:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.068+0000 7fbac97fa700 1 -- 172.21.15.6:0/2447807824 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 305) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbad4014af0 con 0x55e817321ab0 2023-10-06T02:28:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.068+0000 7fbafa5efb80 10 client.10287 fetch_fsmap finished waiting for FSMap version 305 2023-10-06T02:28:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.068+0000 7fbafa5efb80 10 client.10287 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:28:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.068+0000 7fbafa5efb80 20 client.10287 populate_metadata read hostname 'smithi006' 2023-10-06T02:28:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.068+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/2447807824 >> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] conn(0x55e817374dc0 0x55e817347750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.068+0000 7fbafa5efb80 4 client.10287 mds_command: new command op to 10164 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:28:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.068+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2447807824 --> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e8172f0910 con 0x55e817374dc0 2023-10-06T02:28:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.068+0000 7fbaeaffd700 1 --2- 172.21.15.6:0/2447807824 >> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] conn(0x55e817374dc0 0x55e817347750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.069+0000 7fbac97fa700 10 client.10287 ms_handle_connect on v2:172.21.15.6:6833/171345142 2023-10-06T02:28:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.069+0000 7fbaeaffd700 1 --2- 172.21.15.6:0/2447807824 >> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] conn(0x55e817374dc0 0x55e817347750 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56db00852c93d6c8 server_cookie=66861ae44288e85 in_seq=0 out_seq=0 2023-10-06T02:28:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.069+0000 7fbac97fa700 1 -- 172.21.15.6:0/2447807824 <== mds.0 v2:172.21.15.6:6833/171345142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e8172f0910 con 0x55e817374dc0 2023-10-06T02:28:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.069+0000 7fbac97fa700 10 client.10287 handle_command_reply: tid=0 2023-10-06T02:28:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.069+0000 7fbafa5efb80 1 client.10287 shutdown 2023-10-06T02:28:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.069+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2447807824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e817321ab0 msgr2=0x55e817366d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.069+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/2447807824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e817321ab0 0x55e817366d10 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7fbad400f380 tx=0x7fbad4008040 comp rx=0 tx=0).stop 2023-10-06T02:28:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.069+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2447807824 shutdown_connections 2023-10-06T02:28:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.069+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/2447807824 >> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] conn(0x55e817374dc0 0x55e817347750 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.069+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/2447807824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e81733fef0 0x55e81731b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.069+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/2447807824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e817366650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.069+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/2447807824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e817321ab0 0x55e817366d10 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.069+0000 7fbac97fa700 0 client.10287 ms_handle_reset on v2:172.21.15.6:6833/171345142 2023-10-06T02:28:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.069+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2447807824 >> 172.21.15.6:0/2447807824 conn(0x55e81731ff20 msgr2=0x55e817320e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.070+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2447807824 shutdown_connections 2023-10-06T02:28:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.070+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2447807824 wait complete. 2023-10-06T02:28:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.070+0000 7fbafa5efb80 20 client.10287 trim_cache size 0 max 16384 2023-10-06T02:28:55.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.082+0000 7fbafa5efb80 1 Processor -- start 2023-10-06T02:28:55.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.082+0000 7fbafa5efb80 1 -- start start 2023-10-06T02:28:55.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbafa5efb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e81734dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbafa5efb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e817321ab0 0x55e8173c1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbafa5efb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e81731bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbafa5efb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e81731e150 con 0x55e81733fef0 2023-10-06T02:28:55.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbafa5efb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8172fe380 con 0x55e817321ab0 2023-10-06T02:28:55.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbafa5efb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e81734be50 con 0x55e817320360 2023-10-06T02:28:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbaeb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e81731bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbaeb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e81731bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56440/0 (socket says 172.21.15.6:56440) 2023-10-06T02:28:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbaeb7fe700 1 -- 172.21.15.6:0/2702022384 learned_addr learned my addr 172.21.15.6:0/2702022384 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbaea7fc700 1 --2- 172.21.15.6:0/2702022384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e817321ab0 0x55e8173c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbaeaffd700 1 --2- 172.21.15.6:0/2702022384 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e81734dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbaeb7fe700 1 -- 172.21.15.6:0/2702022384 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 msgr2=0x55e81734dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbaeb7fe700 1 --2- 172.21.15.6:0/2702022384 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e81734dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbaeb7fe700 1 -- 172.21.15.6:0/2702022384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e817321ab0 msgr2=0x55e8173c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbaeb7fe700 1 --2- 172.21.15.6:0/2702022384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e817321ab0 0x55e8173c1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbaeb7fe700 1 -- 172.21.15.6:0/2702022384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e81723d820 con 0x55e81733fef0 2023-10-06T02:28:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbaea7fc700 1 --2- 172.21.15.6:0/2702022384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e817321ab0 0x55e8173c1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbaeb7fe700 1 --2- 172.21.15.6:0/2702022384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e81731bd40 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7fbae4057340 tx=0x7fbae4086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a5872c98073a54 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbae0ff9700 1 -- 172.21.15.6:0/2702022384 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae405e350 con 0x55e81733fef0 2023-10-06T02:28:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbae0ff9700 1 -- 172.21.15.6:0/2702022384 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae4023e00 con 0x55e81733fef0 2023-10-06T02:28:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.083+0000 7fbae0ff9700 1 -- 172.21.15.6:0/2702022384 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4055750 con 0x55e81733fef0 2023-10-06T02:28:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.084+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2702022384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 msgr2=0x55e81731bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.084+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/2702022384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e81731bd40 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7fbae4057340 tx=0x7fbae4086040 comp rx=0 tx=0).stop 2023-10-06T02:28:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.084+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2702022384 shutdown_connections 2023-10-06T02:28:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.084+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/2702022384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e81731bd40 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.084+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/2702022384 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e81734dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.084+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/2702022384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e817321ab0 0x55e8173c1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.084+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2702022384 >> 172.21.15.6:0/2702022384 conn(0x55e81731ff20 msgr2=0x55e817347630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.084+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2702022384 shutdown_connections 2023-10-06T02:28:55.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.084+0000 7fbafa5efb80 1 -- 172.21.15.6:0/2702022384 wait complete. 2023-10-06T02:28:55.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.085+0000 7fbafa5efb80 1 -- start start 2023-10-06T02:28:55.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.085+0000 7fbafa5efb80 1 Processor -- start 2023-10-06T02:28:55.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.085+0000 7fbafa5efb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e817320d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbafa5efb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e817321ab0 0x55e817365810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbafa5efb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e817365d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbafa5efb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e817366a40 con 0x55e81733fef0 2023-10-06T02:28:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbafa5efb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e81734b640 con 0x55e817321ab0 2023-10-06T02:28:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbafa5efb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e817321270 con 0x55e817320360 2023-10-06T02:28:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbafa5efb80 10 client.0 _ll_register_callbacks cb 0x55e8172e20c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:28:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbaeb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e817365d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbaeb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e817365d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56454/0 (socket says 172.21.15.6:56454) 2023-10-06T02:28:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbaeb7fe700 1 -- 172.21.15.6:0/3808982794 learned_addr learned my addr 172.21.15.6:0/3808982794 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbaeaffd700 1 --2- 172.21.15.6:0/3808982794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e817320d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbaea7fc700 1 --2- 172.21.15.6:0/3808982794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e817321ab0 0x55e817365810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbaeb7fe700 1 -- 172.21.15.6:0/3808982794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 msgr2=0x55e817320d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbaeb7fe700 1 --2- 172.21.15.6:0/3808982794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e817320d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbaeb7fe700 1 -- 172.21.15.6:0/3808982794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e817321ab0 msgr2=0x55e817365810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbaeb7fe700 1 --2- 172.21.15.6:0/3808982794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e817321ab0 0x55e817365810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbaeb7fe700 1 -- 172.21.15.6:0/3808982794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaec0c8380 con 0x55e81733fef0 2023-10-06T02:28:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbaeb7fe700 1 --2- 172.21.15.6:0/3808982794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e817365d50 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7fbae4006e20 tx=0x7fbae4057530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437a700928ba496a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbac97fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:28:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbac97fa700 1 -- 172.21.15.6:0/3808982794 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae405e350 con 0x55e81733fef0 2023-10-06T02:28:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbac97fa700 1 -- 172.21.15.6:0/3808982794 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7fbae40554f0 con 0x55e81733fef0 2023-10-06T02:28:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbafa5efb80 1 -- 172.21.15.6:0/3808982794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbadc013cc0 con 0x55e81733fef0 2023-10-06T02:28:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbac97fa700 1 -- 172.21.15.6:0/3808982794 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=305) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbae40568a0 con 0x55e81733fef0 2023-10-06T02:28:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbafa5efb80 10 client.10293 fetch_fsmap learned FSMap version 305 2023-10-06T02:28:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.086+0000 7fbafa5efb80 1 -- 172.21.15.6:0/3808982794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=305,monmap=2+}) v3 -- 0x55e817224510 con 0x55e81733fef0 2023-10-06T02:28:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.087+0000 7fbac97fa700 1 -- 172.21.15.6:0/3808982794 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc013cc0 con 0x55e81733fef0 2023-10-06T02:28:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.087+0000 7fbac97fa700 1 -- 172.21.15.6:0/3808982794 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 305) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbae405dec0 con 0x55e81733fef0 2023-10-06T02:28:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.087+0000 7fbafa5efb80 10 client.10293 fetch_fsmap finished waiting for FSMap version 305 2023-10-06T02:28:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.087+0000 7fbafa5efb80 10 client.10293 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:28:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.087+0000 7fbafa5efb80 20 client.10293 populate_metadata read hostname 'smithi006' 2023-10-06T02:28:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.087+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/3808982794 >> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] conn(0x55e817366290 0x55e817347450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.087+0000 7fbafa5efb80 4 client.10293 mds_command: new command op to 10164 tid=0[{"prefix": "damage ls", "format": "json-pretty"}] 2023-10-06T02:28:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.087+0000 7fbafa5efb80 1 -- 172.21.15.6:0/3808982794 --> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x55e817211ea0 con 0x55e817366290 2023-10-06T02:28:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.087+0000 7fbaeaffd700 1 --2- 172.21.15.6:0/3808982794 >> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] conn(0x55e817366290 0x55e817347450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.087+0000 7fbac97fa700 10 client.10293 ms_handle_connect on v2:172.21.15.6:6833/171345142 2023-10-06T02:28:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.087+0000 7fbaeaffd700 1 --2- 172.21.15.6:0/3808982794 >> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] conn(0x55e817366290 0x55e817347450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1bd5bac66a8daef server_cookie=6ea5c92351db0881 in_seq=0 out_seq=0 2023-10-06T02:28:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.087+0000 7fbac97fa700 1 -- 172.21.15.6:0/3808982794 <== mds.0 v2:172.21.15.6:6833/171345142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+194 (crc 0 0 0) 0x55e817211ea0 con 0x55e817366290 2023-10-06T02:28:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.087+0000 7fbac97fa700 10 client.10293 handle_command_reply: tid=0 2023-10-06T02:28:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.087+0000 7fbafa5efb80 1 client.10293 shutdown 2023-10-06T02:28:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.087+0000 7fbafa5efb80 1 -- 172.21.15.6:0/3808982794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 msgr2=0x55e817365d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.087+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/3808982794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e817365d50 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7fbae4006e20 tx=0x7fbae4057530 comp rx=0 tx=0).stop 2023-10-06T02:28:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbafa5efb80 1 -- 172.21.15.6:0/3808982794 shutdown_connections 2023-10-06T02:28:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/3808982794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e81733fef0 0x55e817365d50 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/3808982794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e817320360 0x55e817320d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/3808982794 >> [v2:172.21.15.6:6833/171345142,v1:172.21.15.6:6835/171345142] conn(0x55e817366290 0x55e817347450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbafa5efb80 1 --2- 172.21.15.6:0/3808982794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e817321ab0 0x55e817365810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbafa5efb80 1 -- 172.21.15.6:0/3808982794 >> 172.21.15.6:0/3808982794 conn(0x55e81731ff20 msgr2=0x55e81731ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbac97fa700 0 client.10293 ms_handle_reset on v2:172.21.15.6:6833/171345142 2023-10-06T02:28:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbafa5efb80 1 -- 172.21.15.6:0/3808982794 shutdown_connections 2023-10-06T02:28:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbafa5efb80 1 -- 172.21.15.6:0/3808982794 wait complete. 2023-10-06T02:28:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbafa5efb80 20 client.10293 trim_cache size 0 max 16384 2023-10-06T02:28:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:55.096 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-06T02:28:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:28:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "damage_type": "dentry", 2023-10-06T02:28:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 1523035418, 2023-10-06T02:28:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 1, 2023-10-06T02:28:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "frag": "*", 2023-10-06T02:28:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: "dname": "subdir", 2023-10-06T02:28:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_id": "head", 2023-10-06T02:28:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/subdir" 2023-10-06T02:28:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:28:55.097 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-06T02:28:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbaf12f7700 1 -- 172.21.15.6:0/1576355312 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbacc066f30 msgr2=0x7fbacc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbaf12f7700 1 --2- 172.21.15.6:0/1576355312 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbacc066f30 0x7fbacc0693e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fbaec15cb30 tx=0x7fbadc007ea0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbaf12f7700 1 -- 172.21.15.6:0/1576355312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaec0cf7d0 msgr2=0x7fbaec16a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbaf12f7700 1 --2- 172.21.15.6:0/1576355312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaec0cf7d0 0x7fbaec16a1f0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7fbae40030c0 tx=0x7fbae4016000 comp rx=0 tx=0).stop 2023-10-06T02:28:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbaf12f7700 1 -- 172.21.15.6:0/1576355312 shutdown_connections 2023-10-06T02:28:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbaf12f7700 1 --2- 172.21.15.6:0/1576355312 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbacc066f30 0x7fbacc0693e0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbaf12f7700 1 --2- 172.21.15.6:0/1576355312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaec0cf7d0 0x7fbaec16a1f0 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbaf12f7700 1 --2- 172.21.15.6:0/1576355312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaec069d80 0x7fbaec0c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbaf12f7700 1 --2- 172.21.15.6:0/1576355312 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec0cdd60 0x7fbaec0c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbaf12f7700 1 -- 172.21.15.6:0/1576355312 >> 172.21.15.6:0/1576355312 conn(0x7fbaec0d0c60 msgr2=0x7fbaec0b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbaf12f7700 1 -- 172.21.15.6:0/1576355312 shutdown_connections 2023-10-06T02:28:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.088+0000 7fbaf12f7700 1 -- 172.21.15.6:0/1576355312 wait complete. 2023-10-06T02:28:55.100 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on 10000000000.00000000' 2023-10-06T02:28:55.101 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:28:55.101 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:28:55.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:55.134 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:28:55.135 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:28:55.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:55.135 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:28:55.190 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:28:55.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.349+0000 7f863622d700 1 Processor -- start 2023-10-06T02:28:55.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.349+0000 7f863622d700 1 -- start start 2023-10-06T02:28:55.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.350+0000 7f863622d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f86300b2860 0x7f86300cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.350+0000 7f863622d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8630159150 0x7f8630159590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.350+0000 7f863622d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86300cb630 con 0x7f86300b2490 2023-10-06T02:28:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.350+0000 7f863622d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86300cd6e0 con 0x7f86300b2860 2023-10-06T02:28:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.350+0000 7f863622d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86300cb910 con 0x7f8630159150 2023-10-06T02:28:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.350+0000 7f862effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f86300b2860 0x7f86300cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.350+0000 7f862f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f86300b2490 0x7f86300b0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39508/0 (socket says 172.21.15.6:39508) 2023-10-06T02:28:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.350+0000 7f862f7fe700 1 -- 172.21.15.6:0/31809660 learned_addr learned my addr 172.21.15.6:0/31809660 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.350+0000 7f862effd700 1 -- 172.21.15.6:0/31809660 >> v2:172.21.15.175:3300/0 conn(0x7f8630159150 msgr2=0x7f8630159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.350+0000 7f862effd700 1 --2- 172.21.15.6:0/31809660 >> v2:172.21.15.175:3300/0 conn(0x7f8630159150 0x7f8630159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.350+0000 7f862effd700 1 -- 172.21.15.6:0/31809660 >> v1:172.21.15.6:6789/0 conn(0x7f86300b2490 legacy=0x7f86300b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.350+0000 7f862effd700 1 -- 172.21.15.6:0/31809660 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86300cbbf0 con 0x7f86300b2860 2023-10-06T02:28:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.350+0000 7f862e7fc700 1 -- 172.21.15.6:0/31809660 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334780485 0 0) 0x7f86300cb630 con 0x7f86300b2490 2023-10-06T02:28:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.350+0000 7f862effd700 1 --2- 172.21.15.6:0/31809660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86300b2860 0x7f86300cb050 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f86240098e0 tx=0x7f86240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec2beac6bdfc158 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.350+0000 7f862e7fc700 1 -- 172.21.15.6:0/31809660 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8624009e80 con 0x7f86300b2860 2023-10-06T02:28:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.350+0000 7f862e7fc700 1 -- 172.21.15.6:0/31809660 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862400b820 con 0x7f86300b2860 2023-10-06T02:28:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.350+0000 7f862e7fc700 1 -- 172.21.15.6:0/31809660 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862400bba0 con 0x7f86300b2860 2023-10-06T02:28:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.351+0000 7f863622d700 1 -- 172.21.15.6:0/31809660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86300b2860 msgr2=0x7f86300cb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.351+0000 7f863622d700 1 --2- 172.21.15.6:0/31809660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86300b2860 0x7f86300cb050 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f86240098e0 tx=0x7f86240091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.351+0000 7f863622d700 1 -- 172.21.15.6:0/31809660 shutdown_connections 2023-10-06T02:28:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.351+0000 7f863622d700 1 --2- 172.21.15.6:0/31809660 >> v2:172.21.15.175:3300/0 conn(0x7f8630159150 0x7f8630159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.351+0000 7f863622d700 1 --2- 172.21.15.6:0/31809660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86300b2860 0x7f86300cb050 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.351+0000 7f863622d700 1 -- 172.21.15.6:0/31809660 >> 172.21.15.6:0/31809660 conn(0x7f8630068680 msgr2=0x7f8630068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.351+0000 7f863622d700 1 -- 172.21.15.6:0/31809660 shutdown_connections 2023-10-06T02:28:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.351+0000 7f863622d700 1 -- 172.21.15.6:0/31809660 wait complete. 2023-10-06T02:28:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.352+0000 7f863622d700 1 Processor -- start 2023-10-06T02:28:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.352+0000 7f863622d700 1 -- start start 2023-10-06T02:28:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f863622d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86300b2490 0x7f86300c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f863622d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86300b2860 0x7f86300c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f863622d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8630159150 0x7f863016a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f863622d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86300c6290 con 0x7f86300b2860 2023-10-06T02:28:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f863622d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86300c5a90 con 0x7f8630159150 2023-10-06T02:28:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f863622d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86300c8e50 con 0x7f86300b2490 2023-10-06T02:28:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f862effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86300b2860 0x7f86300c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f862effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86300b2860 0x7f86300c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56484/0 (socket says 172.21.15.6:56484) 2023-10-06T02:28:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f862effd700 1 -- 172.21.15.6:0/3468589498 learned_addr learned my addr 172.21.15.6:0/3468589498 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f862f7fe700 1 --2- 172.21.15.6:0/3468589498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86300b2490 0x7f86300c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f862ffff700 1 --2- 172.21.15.6:0/3468589498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8630159150 0x7f863016a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f862effd700 1 -- 172.21.15.6:0/3468589498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86300b2490 msgr2=0x7f86300c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f862effd700 1 --2- 172.21.15.6:0/3468589498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86300b2490 0x7f86300c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f862effd700 1 -- 172.21.15.6:0/3468589498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8630159150 msgr2=0x7f863016a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f862effd700 1 --2- 172.21.15.6:0/3468589498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8630159150 0x7f863016a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f862effd700 1 -- 172.21.15.6:0/3468589498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8624009420 con 0x7f86300b2860 2023-10-06T02:28:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f862f7fe700 1 --2- 172.21.15.6:0/3468589498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86300b2490 0x7f86300c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:55.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f862ffff700 1 --2- 172.21.15.6:0/3468589498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8630159150 0x7f863016a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:55.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.353+0000 7f862effd700 1 --2- 172.21.15.6:0/3468589498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86300b2860 0x7f86300c5550 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f86300880a0 tx=0x7f8624017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.354+0000 7f86177fe700 1 -- 172.21.15.6:0/3468589498 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8624011420 con 0x7f86300b2860 2023-10-06T02:28:55.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.354+0000 7f86177fe700 1 -- 172.21.15.6:0/3468589498 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8624011580 con 0x7f86300b2860 2023-10-06T02:28:55.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.354+0000 7f863622d700 1 -- 172.21.15.6:0/3468589498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86300c5cd0 con 0x7f86300b2860 2023-10-06T02:28:55.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.354+0000 7f86177fe700 1 -- 172.21.15.6:0/3468589498 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8624011940 con 0x7f86300b2860 2023-10-06T02:28:55.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.354+0000 7f863622d700 1 -- 172.21.15.6:0/3468589498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86300c90f0 con 0x7f86300b2860 2023-10-06T02:28:55.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.355+0000 7f863622d700 1 -- 172.21.15.6:0/3468589498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8630088700 con 0x7f86300b2860 2023-10-06T02:28:55.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.355+0000 7f86177fe700 1 -- 172.21.15.6:0/3468589498 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f862402c3b0 con 0x7f86300b2860 2023-10-06T02:28:55.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.355+0000 7f86177fe700 1 --2- 172.21.15.6:0/3468589498 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f861c066f30 0x7f861c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.355+0000 7f86177fe700 1 -- 172.21.15.6:0/3468589498 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 9216+0+0 (secure 0 0 0) 0x7f8624086b20 con 0x7f86300b2860 2023-10-06T02:28:55.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.356+0000 7f862f7fe700 1 --2- 172.21.15.6:0/3468589498 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f861c066f30 0x7f861c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.356+0000 7f862f7fe700 1 --2- 172.21.15.6:0/3468589498 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f861c066f30 0x7f861c0693e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f86200011e0 tx=0x7f8620009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.360+0000 7f86177fe700 1 -- 172.21.15.6:0/3468589498 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8624052fa0 con 0x7f86300b2860 2023-10-06T02:28:55.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.597+0000 7f863622d700 1 -- 172.21.15.6:0/3468589498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f86300cbed0 con 0x7f86300b2860 2023-10-06T02:28:55.598 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:28:55.598+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:28:55.603 INFO:tasks.ceph.mds.a.smithi006.stderr: -564> 2023-10-06T02:28:44.960+0000 7f2635869700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:28:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.604+0000 7f86177fe700 1 -- 172.21.15.6:0/3468589498 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v306) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8624028090 con 0x7f86300b2860 2023-10-06T02:28:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.607+0000 7f863622d700 1 -- 172.21.15.6:0/3468589498 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f861c066f30 msgr2=0x7f861c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.607+0000 7f863622d700 1 --2- 172.21.15.6:0/3468589498 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f861c066f30 0x7f861c0693e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f86200011e0 tx=0x7f8620009040 comp rx=0 tx=0).stop 2023-10-06T02:28:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.607+0000 7f863622d700 1 -- 172.21.15.6:0/3468589498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86300b2860 msgr2=0x7f86300c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.607+0000 7f863622d700 1 --2- 172.21.15.6:0/3468589498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86300b2860 0x7f86300c5550 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f86300880a0 tx=0x7f8624017000 comp rx=0 tx=0).stop 2023-10-06T02:28:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.607+0000 7f863622d700 1 -- 172.21.15.6:0/3468589498 shutdown_connections 2023-10-06T02:28:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.607+0000 7f863622d700 1 --2- 172.21.15.6:0/3468589498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8630159150 0x7f863016a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.607+0000 7f863622d700 1 --2- 172.21.15.6:0/3468589498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86300b2490 0x7f86300c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.607+0000 7f863622d700 1 --2- 172.21.15.6:0/3468589498 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f861c066f30 0x7f861c0693e0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.607+0000 7f863622d700 1 --2- 172.21.15.6:0/3468589498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86300b2860 0x7f86300c5550 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.607+0000 7f863622d700 1 -- 172.21.15.6:0/3468589498 >> 172.21.15.6:0/3468589498 conn(0x7f8630068680 msgr2=0x7f86301579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.607+0000 7f863622d700 1 -- 172.21.15.6:0/3468589498 shutdown_connections 2023-10-06T02:28:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.607+0000 7f863622d700 1 -- 172.21.15.6:0/3468589498 wait complete. 2023-10-06T02:28:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:28:55.621 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:28:55.626 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:28:55.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.740+0000 7f538c847700 1 Processor -- start 2023-10-06T02:28:55.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.740+0000 7f538c847700 1 -- start start 2023-10-06T02:28:55.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.741+0000 7f538c847700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f53880b28c0 0x7f5388087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.741+0000 7f538c847700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53880afc50 con 0x7f5388086ff0 2023-10-06T02:28:55.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.741+0000 7f538c847700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53880aff30 con 0x7f538815a030 2023-10-06T02:28:55.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.741+0000 7f538c847700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53880b0cf0 con 0x7f53880b28c0 2023-10-06T02:28:55.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.741+0000 7f5385d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5388086ff0 0x7f53880b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39522/0 (socket says 172.21.15.6:39522) 2023-10-06T02:28:55.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.741+0000 7f5385d9b700 1 -- 172.21.15.6:0/2519173723 learned_addr learned my addr 172.21.15.6:0/2519173723 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:55.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.741+0000 7f538559a700 1 -- 172.21.15.6:0/2519173723 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447506833 0 0) 0x7f53880afc50 con 0x7f5388086ff0 2023-10-06T02:28:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.741+0000 7f538559a700 1 -- 172.21.15.6:0/2519173723 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5370003570 con 0x7f5388086ff0 2023-10-06T02:28:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.741+0000 7f5386d9d700 1 --2- 172.21.15.6:0/2519173723 >> v2:172.21.15.175:3300/0 conn(0x7f53880b28c0 0x7f5388087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.741+0000 7f538559a700 1 -- 172.21.15.6:0/2519173723 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2899062363 0 0) 0x7f5370003570 con 0x7f5388086ff0 2023-10-06T02:28:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.741+0000 7f538559a700 1 -- 172.21.15.6:0/2519173723 >> v2:172.21.15.175:3300/0 conn(0x7f53880b28c0 msgr2=0x7f5388087470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.741+0000 7f538559a700 1 --2- 172.21.15.6:0/2519173723 >> v2:172.21.15.175:3300/0 conn(0x7f53880b28c0 0x7f5388087470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.741+0000 7f538559a700 1 -- 172.21.15.6:0/2519173723 >> v1:172.21.15.175:6789/0 conn(0x7f538815a030 legacy=0x7f538815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.741+0000 7f538559a700 1 -- 172.21.15.6:0/2519173723 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53880b0210 con 0x7f5388086ff0 2023-10-06T02:28:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.741+0000 7f538559a700 1 -- 172.21.15.6:0/2519173723 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f537c001470 con 0x7f5388086ff0 2023-10-06T02:28:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.741+0000 7f538559a700 1 -- 172.21.15.6:0/2519173723 >> v1:172.21.15.6:6789/0 conn(0x7f5388086ff0 legacy=0x7f53880b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f538559a700 1 --2- 172.21.15.6:0/2519173723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5370003a60 0x7f5370003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f538559a700 1 --2- 172.21.15.6:0/2519173723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5370004810 0x7f5370004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f538559a700 1 --2- 172.21.15.6:0/2519173723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53700051c0 0x7f537000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f538559a700 1 -- 172.21.15.6:0/2519173723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53880b0cf0 con 0x7f5370004810 2023-10-06T02:28:55.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f538559a700 1 -- 172.21.15.6:0/2519173723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537000c0d0 con 0x7f5370003a60 2023-10-06T02:28:55.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f538559a700 1 -- 172.21.15.6:0/2519173723 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537000c290 con 0x7f53700051c0 2023-10-06T02:28:55.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f5385d9b700 1 --2- 172.21.15.6:0/2519173723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5370004810 0x7f5370004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f538659c700 1 --2- 172.21.15.6:0/2519173723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5370003a60 0x7f5370003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f5386d9d700 1 --2- 172.21.15.6:0/2519173723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53700051c0 0x7f537000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f5385d9b700 1 -- 172.21.15.6:0/2519173723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53700051c0 msgr2=0x7f537000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:55.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f5385d9b700 1 --2- 172.21.15.6:0/2519173723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53700051c0 0x7f537000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f5385d9b700 1 -- 172.21.15.6:0/2519173723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5370003a60 msgr2=0x7f5370003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:55.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f5385d9b700 1 --2- 172.21.15.6:0/2519173723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5370003a60 0x7f5370003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f5386d9d700 1 -- 172.21.15.6:0/2519173723 reap_dead start 2023-10-06T02:28:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f5385d9b700 1 -- 172.21.15.6:0/2519173723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5370003570 con 0x7f5370004810 2023-10-06T02:28:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f5385d9b700 1 --2- 172.21.15.6:0/2519173723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5370004810 0x7f5370004c80 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f537c00c3c0 tx=0x7f537c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899a8fd05e479c76 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f538559a700 1 -- 172.21.15.6:0/2519173723 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c00cc10 con 0x7f5370004810 2023-10-06T02:28:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f538559a700 1 -- 172.21.15.6:0/2519173723 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c00cd70 con 0x7f5370004810 2023-10-06T02:28:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.742+0000 7f538559a700 1 -- 172.21.15.6:0/2519173723 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c005b50 con 0x7f5370004810 2023-10-06T02:28:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.743+0000 7f538c847700 1 -- 172.21.15.6:0/2519173723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5370004810 msgr2=0x7f5370004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.743+0000 7f538c847700 1 --2- 172.21.15.6:0/2519173723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5370004810 0x7f5370004c80 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f537c00c3c0 tx=0x7f537c001e50 comp rx=0 tx=0).stop 2023-10-06T02:28:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.743+0000 7f538c847700 1 -- 172.21.15.6:0/2519173723 shutdown_connections 2023-10-06T02:28:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.743+0000 7f538c847700 1 --2- 172.21.15.6:0/2519173723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5370004810 0x7f5370004c80 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.743+0000 7f538c847700 1 -- 172.21.15.6:0/2519173723 >> 172.21.15.6:0/2519173723 conn(0x7f5388068680 msgr2=0x7f5388068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:55.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.743+0000 7f538c847700 1 -- 172.21.15.6:0/2519173723 shutdown_connections 2023-10-06T02:28:55.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.743+0000 7f538c847700 1 -- 172.21.15.6:0/2519173723 wait complete. 2023-10-06T02:28:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.744+0000 7f538c847700 1 Processor -- start 2023-10-06T02:28:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.744+0000 7f538c847700 1 -- start start 2023-10-06T02:28:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f538c847700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5370004810 0x7f5388156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f538c847700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388169f50 0x7f538815cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f538c847700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815d500 0x7f53880aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f538c847700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538815b440 con 0x7f5388169f50 2023-10-06T02:28:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f538c847700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538816a450 con 0x7f5370004810 2023-10-06T02:28:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f538c847700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538816a730 con 0x7f538815d500 2023-10-06T02:28:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f5385d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388169f50 0x7f538815cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f5385d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388169f50 0x7f538815cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56530/0 (socket says 172.21.15.6:56530) 2023-10-06T02:28:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f5385d9b700 1 -- 172.21.15.6:0/260845702 learned_addr learned my addr 172.21.15.6:0/260845702 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f538659c700 1 --2- 172.21.15.6:0/260845702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5370004810 0x7f5388156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f5386d9d700 1 --2- 172.21.15.6:0/260845702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815d500 0x7f53880aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f5385d9b700 1 -- 172.21.15.6:0/260845702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815d500 msgr2=0x7f53880aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f5385d9b700 1 --2- 172.21.15.6:0/260845702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815d500 0x7f53880aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f5385d9b700 1 -- 172.21.15.6:0/260845702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5370004810 msgr2=0x7f5388156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f5385d9b700 1 --2- 172.21.15.6:0/260845702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5370004810 0x7f5388156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f5385d9b700 1 -- 172.21.15.6:0/260845702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538816aa10 con 0x7f5388169f50 2023-10-06T02:28:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f5386d9d700 1 --2- 172.21.15.6:0/260845702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815d500 0x7f53880aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.745+0000 7f5385d9b700 1 --2- 172.21.15.6:0/260845702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388169f50 0x7f538815cfc0 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f537000c0a0 tx=0x7f537c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.746+0000 7f53767fc700 1 -- 172.21.15.6:0/260845702 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c00cc10 con 0x7f5388169f50 2023-10-06T02:28:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.746+0000 7f53767fc700 1 -- 172.21.15.6:0/260845702 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c0070d0 con 0x7f5388169f50 2023-10-06T02:28:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.746+0000 7f53767fc700 1 -- 172.21.15.6:0/260845702 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c00cee0 con 0x7f5388169f50 2023-10-06T02:28:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.746+0000 7f538c847700 1 -- 172.21.15.6:0/260845702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538815b440 con 0x7f5388169f50 2023-10-06T02:28:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.746+0000 7f538c847700 1 -- 172.21.15.6:0/260845702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5388156ea0 con 0x7f5388169f50 2023-10-06T02:28:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.747+0000 7f538c847700 1 -- 172.21.15.6:0/260845702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538816af30 con 0x7f5388169f50 2023-10-06T02:28:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.747+0000 7f53767fc700 1 -- 172.21.15.6:0/260845702 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f537c007720 con 0x7f5388169f50 2023-10-06T02:28:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.747+0000 7f53767fc700 1 --2- 172.21.15.6:0/260845702 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5368066f30 0x7f53680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.748+0000 7f53767fc700 1 -- 172.21.15.6:0/260845702 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 9302+0+0 (secure 0 0 0) 0x7f537c086a70 con 0x7f5388169f50 2023-10-06T02:28:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.748+0000 7f538659c700 1 --2- 172.21.15.6:0/260845702 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5368066f30 0x7f53680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.748+0000 7f538659c700 1 --2- 172.21.15.6:0/260845702 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5368066f30 0x7f53680693e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f5378003bc0 tx=0x7f5378007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:55.752+0000 7f53767fc700 1 -- 172.21.15.6:0/260845702 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f538816af30 con 0x7f5388169f50 2023-10-06T02:28:56.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.030+0000 7f538c847700 1 -- 172.21.15.6:0/260845702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f538816af30 con 0x7f5388169f50 2023-10-06T02:28:56.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.603+0000 7f53767fc700 1 -- 172.21.15.6:0/260845702 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v307) v1 ==== 107+0+0 (secure 0 0 0) 0x7f538816af30 con 0x7f5388169f50 2023-10-06T02:28:56.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.605+0000 7f538c847700 1 -- 172.21.15.6:0/260845702 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5368066f30 msgr2=0x7f53680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.605+0000 7f538c847700 1 --2- 172.21.15.6:0/260845702 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5368066f30 0x7f53680693e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f5378003bc0 tx=0x7f5378007d30 comp rx=0 tx=0).stop 2023-10-06T02:28:56.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.605+0000 7f538c847700 1 -- 172.21.15.6:0/260845702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388169f50 msgr2=0x7f538815cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.605+0000 7f538c847700 1 --2- 172.21.15.6:0/260845702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388169f50 0x7f538815cfc0 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f537000c0a0 tx=0x7f537c015000 comp rx=0 tx=0).stop 2023-10-06T02:28:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.605+0000 7f538c847700 1 -- 172.21.15.6:0/260845702 shutdown_connections 2023-10-06T02:28:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.605+0000 7f538c847700 1 --2- 172.21.15.6:0/260845702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815d500 0x7f53880aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.605+0000 7f538c847700 1 --2- 172.21.15.6:0/260845702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5370004810 0x7f5388156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.605+0000 7f538c847700 1 --2- 172.21.15.6:0/260845702 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5368066f30 0x7f53680693e0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.605+0000 7f538c847700 1 --2- 172.21.15.6:0/260845702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388169f50 0x7f538815cfc0 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.605+0000 7f538c847700 1 -- 172.21.15.6:0/260845702 >> 172.21.15.6:0/260845702 conn(0x7f5388068680 msgr2=0x7f5388087470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:56.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.605+0000 7f538c847700 1 -- 172.21.15.6:0/260845702 shutdown_connections 2023-10-06T02:28:56.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.605+0000 7f538c847700 1 -- 172.21.15.6:0/260845702 wait complete. 2023-10-06T02:28:56.607 INFO:teuthology.orchestra.run.smithi006.stderr:nothing to do: rank is not damaged 2023-10-06T02:28:56.619 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:28:56.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.699+0000 7fda093ae000 1 Processor -- start 2023-10-06T02:28:56.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.699+0000 7fda093ae000 1 -- start start 2023-10-06T02:28:56.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.699+0000 7fda093ae000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56168ebaa1b0 0x56168eb8cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.699+0000 7fda093ae000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56168ec36500 0x56168ec2c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda093ae000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56168ec36e10 0x56168ec282b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda093ae000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56168eaad980 con 0x56168ebaa1b0 2023-10-06T02:28:56.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda093ae000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56168eaad620 con 0x56168ec36500 2023-10-06T02:28:56.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda093ae000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56168eaa4400 con 0x56168ec36e10 2023-10-06T02:28:56.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda025e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56168ebaa1b0 0x56168eb8cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda025e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56168ebaa1b0 0x56168eb8cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56544/0 (socket says 172.21.15.6:56544) 2023-10-06T02:28:56.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda025e9700 1 -- 172.21.15.6:0/938621229 learned_addr learned my addr 172.21.15.6:0/938621229 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:56.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda01de8700 1 --2- 172.21.15.6:0/938621229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56168ec36500 0x56168ec2c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda02dea700 1 --2- 172.21.15.6:0/938621229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56168ec36e10 0x56168ec282b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda025e9700 1 -- 172.21.15.6:0/938621229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56168ec36e10 msgr2=0x56168ec282b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:56.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda025e9700 1 --2- 172.21.15.6:0/938621229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56168ec36e10 0x56168ec282b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda025e9700 1 -- 172.21.15.6:0/938621229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56168ec36500 msgr2=0x56168ec2c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:56.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda025e9700 1 --2- 172.21.15.6:0/938621229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56168ec36500 0x56168ec2c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda025e9700 1 -- 172.21.15.6:0/938621229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f4005db0 con 0x56168ebaa1b0 2023-10-06T02:28:56.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda01de8700 1 --2- 172.21.15.6:0/938621229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56168ec36500 0x56168ec2c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:56.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda02dea700 1 --2- 172.21.15.6:0/938621229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56168ec36e10 0x56168ec282b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:56.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda025e9700 1 --2- 172.21.15.6:0/938621229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56168ebaa1b0 0x56168eb8cd60 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400a480 tx=0x7fd9f4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca78464812be88fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda00de6700 1 -- 172.21.15.6:0/938621229 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4005c10 con 0x56168ebaa1b0 2023-10-06T02:28:56.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda00de6700 1 -- 172.21.15.6:0/938621229 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f4000bc0 con 0x56168ebaa1b0 2023-10-06T02:28:56.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.700+0000 7fda00de6700 1 -- 172.21.15.6:0/938621229 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4008800 con 0x56168ebaa1b0 2023-10-06T02:28:56.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.701+0000 7fda093ae000 1 -- 172.21.15.6:0/938621229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56168ebaa1b0 msgr2=0x56168eb8cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.701+0000 7fda093ae000 1 --2- 172.21.15.6:0/938621229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56168ebaa1b0 0x56168eb8cd60 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400a480 tx=0x7fd9f4016000 comp rx=0 tx=0).stop 2023-10-06T02:28:56.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.701+0000 7fda093ae000 1 -- 172.21.15.6:0/938621229 shutdown_connections 2023-10-06T02:28:56.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.701+0000 7fda093ae000 1 --2- 172.21.15.6:0/938621229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56168ec36e10 0x56168ec282b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.701+0000 7fda093ae000 1 --2- 172.21.15.6:0/938621229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56168ebaa1b0 0x56168eb8cd60 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.701+0000 7fda093ae000 1 --2- 172.21.15.6:0/938621229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56168ec36500 0x56168ec2c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.701+0000 7fda093ae000 1 -- 172.21.15.6:0/938621229 >> 172.21.15.6:0/938621229 conn(0x56168eb62d50 msgr2=0x56168ec35ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:56.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.701+0000 7fda093ae000 1 -- 172.21.15.6:0/938621229 shutdown_connections 2023-10-06T02:28:56.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.701+0000 7fda093ae000 1 -- 172.21.15.6:0/938621229 wait complete. 2023-10-06T02:28:56.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.701+0000 7fda093ae000 1 Processor -- start 2023-10-06T02:28:56.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.702+0000 7fda093ae000 1 -- start start 2023-10-06T02:28:56.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.702+0000 7fda093ae000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56168ebaa1b0 0x56168ec27120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.702+0000 7fda093ae000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56168ec36500 0x56168ec3b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.702+0000 7fda093ae000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56168ec36e10 0x56168ec3b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.702+0000 7fda093ae000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56168ec45560 con 0x56168ec36e10 2023-10-06T02:28:56.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.702+0000 7fda093ae000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56168ec3bc90 con 0x56168ebaa1b0 2023-10-06T02:28:56.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.702+0000 7fda093ae000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56168ec39ea0 con 0x56168ec36500 2023-10-06T02:28:56.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.702+0000 7fda02dea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56168ec36e10 0x56168ec3b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.702+0000 7fda02dea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56168ec36e10 0x56168ec3b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56558/0 (socket says 172.21.15.6:56558) 2023-10-06T02:28:56.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.702+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 learned_addr learned my addr 172.21.15.6:0/2962703791 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:56.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.702+0000 7fda01de8700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56168ec36500 0x56168ec3b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.703+0000 7fda025e9700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56168ebaa1b0 0x56168ec27120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.703+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56168ec36500 msgr2=0x56168ec3b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.703+0000 7fda02dea700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56168ec36500 0x56168ec3b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.703+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56168ebaa1b0 msgr2=0x56168ec27120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.703+0000 7fda02dea700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56168ebaa1b0 0x56168ec27120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.703+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56168ead61c0 con 0x56168ec36e10 2023-10-06T02:28:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.703+0000 7fda02dea700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56168ec36e10 0x56168ec3b750 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009480 tx=0x7fd9fc007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.703+0000 7fd9f2ffd700 1 -- 172.21.15.6:0/2962703791 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc010410 con 0x56168ec36e10 2023-10-06T02:28:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.703+0000 7fd9f2ffd700 1 -- 172.21.15.6:0/2962703791 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc010590 con 0x56168ec36e10 2023-10-06T02:28:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.703+0000 7fd9f2ffd700 1 -- 172.21.15.6:0/2962703791 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc010950 con 0x56168ec36e10 2023-10-06T02:28:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.703+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56168eabc3d0 con 0x56168ec36e10 2023-10-06T02:28:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.703+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56168eaafae0 con 0x56168ec36e10 2023-10-06T02:28:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.704+0000 7fd9f2ffd700 1 -- 172.21.15.6:0/2962703791 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9fc010d40 con 0x56168ec36e10 2023-10-06T02:28:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.705+0000 7fd9f2ffd700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd9e4065890 0x7fd9e4067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.705+0000 7fd9f2ffd700 1 -- 172.21.15.6:0/2962703791 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 9302+0+0 (secure 0 0 0) 0x7fd9fc084160 con 0x56168ec36e10 2023-10-06T02:28:56.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.705+0000 7fda025e9700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd9e4065890 0x7fd9e4067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.710 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:28:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.705+0000 7fda093ae000 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56168eb8d270 0x56168ec2a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.705+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec27660 con 0x56168eb8d270 2023-10-06T02:28:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.705+0000 7fda01de8700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56168eb8d270 0x56168ec2a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.705+0000 7fda025e9700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd9e4065890 0x7fd9e4067d40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400a480 tx=0x7fd9f401d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.706+0000 7fda01de8700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56168eb8d270 0x56168ec2a550 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.708+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v129'1033 uv1007 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.708+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec2aa90 con 0x56168eb8d270 2023-10-06T02:28:56.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.709+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v129'1034 uv1034 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.709+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168eb924b0 con 0x56168eb8d270 2023-10-06T02:28:56.712 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:28:56.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.711+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v129'1035 uv1035 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.711+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec52b40 con 0x56168eb8d270 2023-10-06T02:28:56.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.712+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v129'1036 uv1036 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.712+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec52ef0 con 0x56168eb8d270 2023-10-06T02:28:56.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.713+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v129'1037 uv1037 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.713+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec51b30 con 0x56168eb8d270 2023-10-06T02:28:56.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.715+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v129'1038 uv1038 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.715+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec51f60 con 0x56168eb8d270 2023-10-06T02:28:56.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.716+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v129'1039 uv1013 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.716+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec51f60 con 0x56168eb8d270 2023-10-06T02:28:56.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.718+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v129'1040 uv1040 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.718+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec51f60 con 0x56168eb8d270 2023-10-06T02:28:56.719 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:28:56.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.719+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v129'1041 uv1041 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.719+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec51f60 con 0x56168eb8d270 2023-10-06T02:28:56.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.720+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v129'1042 uv1042 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.720+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec51f60 con 0x56168eb8d270 2023-10-06T02:28:56.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.722+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v129'1043 uv1043 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.722+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec51f60 con 0x56168eb8d270 2023-10-06T02:28:56.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.723+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v129'1044 uv1044 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.723+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec51f60 con 0x56168eb8d270 2023-10-06T02:28:56.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.724+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v129'1045 uv1020 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.725+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec51f60 con 0x56168eb8d270 2023-10-06T02:28:56.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.726+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v129'1046 uv1046 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.726+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec51f60 con 0x56168eb8d270 2023-10-06T02:28:56.727 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:28:56.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.727+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v129'1047 uv1047 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.727+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec51f60 con 0x56168eb8d270 2023-10-06T02:28:56.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.728+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v129'1048 uv1048 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.728+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec51f60 con 0x56168eb8d270 2023-10-06T02:28:56.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.730+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v129'1049 uv1049 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.730+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec51f60 con 0x56168eb8d270 2023-10-06T02:28:56.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.731+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v129'1050 uv1050 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.731+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec532a0 con 0x56168eb8d270 2023-10-06T02:28:56.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.732+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v129'1051 uv1051 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.732+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec532a0 con 0x56168eb8d270 2023-10-06T02:28:56.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.734+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v129'1052 uv1026 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.734+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec532a0 con 0x56168eb8d270 2023-10-06T02:28:56.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.735+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v129'1053 uv1053 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.735+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec532a0 con 0x56168eb8d270 2023-10-06T02:28:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.736+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v129'1054 uv1054 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.737 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:28:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.736+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec542b0 con 0x56168eb8d270 2023-10-06T02:28:56.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.738+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v129'1055 uv1055 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.738+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec542b0 con 0x56168eb8d270 2023-10-06T02:28:56.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.739+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v129'1056 uv1056 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.739+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec532a0 con 0x56168eb8d270 2023-10-06T02:28:56.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.740+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v129'1057 uv1057 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.740+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec532a0 con 0x56168eb8d270 2023-10-06T02:28:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.742+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v129'1058 uv1032 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.742+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec532a0 con 0x56168eb8d270 2023-10-06T02:28:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.743+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v129'1059 uv1059 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.743+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec532a0 con 0x56168eb8d270 2023-10-06T02:28:56.744 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:28:56.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.744+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v129'1060 uv1060 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.744+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec542b0 con 0x56168eb8d270 2023-10-06T02:28:56.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.745+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v129'1061 uv1061 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.745+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec542b0 con 0x56168eb8d270 2023-10-06T02:28:56.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.746+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v129'1062 uv1062 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.747+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec532a0 con 0x56168eb8d270 2023-10-06T02:28:56.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.748+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v129'1063 uv1063 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168eb8d270 2023-10-06T02:28:56.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.748+0000 7fda093ae000 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56168ec537b0 0x56168ec55b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.748+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec560d0 con 0x56168ec537b0 2023-10-06T02:28:56.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.748+0000 7fda025e9700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56168ec537b0 0x56168ec55b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.748+0000 7fda025e9700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56168ec537b0 0x56168ec55b90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.750+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v129'743 uv723 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.750+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec56480 con 0x56168ec537b0 2023-10-06T02:28:56.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.751+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v129'744 uv744 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.751+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec56830 con 0x56168ec537b0 2023-10-06T02:28:56.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.752+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v129'745 uv745 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.753 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:28:56.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.752+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec56be0 con 0x56168ec537b0 2023-10-06T02:28:56.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.753+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v129'746 uv746 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.754+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec56f90 con 0x56168ec537b0 2023-10-06T02:28:56.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.755+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v129'747 uv747 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.755+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec57340 con 0x56168ec537b0 2023-10-06T02:28:56.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.756+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v129'748 uv742 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.756+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec576f0 con 0x56168ec537b0 2023-10-06T02:28:56.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.757+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v129'749 uv749 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.757+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec57aa0 con 0x56168ec537b0 2023-10-06T02:28:56.758 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:28:56.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.758+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v129'750 uv750 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.758+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec57aa0 con 0x56168ec537b0 2023-10-06T02:28:56.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.759+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v129'751 uv751 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.759+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec52690 con 0x56168ec537b0 2023-10-06T02:28:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.760+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v129'752 uv752 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.760+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec52690 con 0x56168ec537b0 2023-10-06T02:28:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.762+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v129'753 uv741 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.762+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec52610 con 0x56168ec537b0 2023-10-06T02:28:56.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.763+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v129'754 uv754 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.763+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec52610 con 0x56168ec537b0 2023-10-06T02:28:56.764 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:28:56.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.764+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v129'755 uv755 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.764+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec52610 con 0x56168ec537b0 2023-10-06T02:28:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.765+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v129'756 uv756 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.765+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec52610 con 0x56168ec537b0 2023-10-06T02:28:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.766+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v129'757 uv757 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.766+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec52610 con 0x56168ec537b0 2023-10-06T02:28:56.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.767+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v129'758 uv739 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.767+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec52610 con 0x56168ec537b0 2023-10-06T02:28:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.768+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v129'759 uv759 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.768+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec52610 con 0x56168ec537b0 2023-10-06T02:28:56.770 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:28:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.769+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v129'760 uv760 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.770+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec52610 con 0x56168ec537b0 2023-10-06T02:28:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.771+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v129'761 uv761 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.771+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec52610 con 0x56168ec537b0 2023-10-06T02:28:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.772+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v129'762 uv762 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.772+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec52610 con 0x56168ec537b0 2023-10-06T02:28:56.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.773+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v129'763 uv763 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.773+0000 7fda093ae000 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56168ec52610 0x56168ec5a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.773+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5a9f0 con 0x56168ec52610 2023-10-06T02:28:56.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.773+0000 7fda01de8700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56168ec52610 0x56168ec5a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.773+0000 7fda01de8700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56168ec52610 0x56168ec5a4b0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.774+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v129'201 uv200 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.774+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5add0 con 0x56168ec52610 2023-10-06T02:28:56.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.775+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v129'202 uv202 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.775+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5add0 con 0x56168ec52610 2023-10-06T02:28:56.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.776+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v129'203 uv203 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.777 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:28:56.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.776+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5bde0 con 0x56168ec52610 2023-10-06T02:28:56.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.777+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v129'204 uv204 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.777+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5bde0 con 0x56168ec52610 2023-10-06T02:28:56.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.778+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v129'205 uv205 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.778+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5add0 con 0x56168ec52610 2023-10-06T02:28:56.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.779+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v129'206 uv206 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.779+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5add0 con 0x56168ec52610 2023-10-06T02:28:56.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.780+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v129'144 uv143 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.780+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5add0 con 0x56168ec52610 2023-10-06T02:28:56.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.781+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v129'145 uv145 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.781+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5add0 con 0x56168ec52610 2023-10-06T02:28:56.783 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:28:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.783+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v129'146 uv146 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.783+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5b1d0 con 0x56168ec52610 2023-10-06T02:28:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.784+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v129'147 uv147 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.784+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5b1d0 con 0x56168ec537b0 2023-10-06T02:28:56.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.785+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v129'201 uv200 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.785+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5b1d0 con 0x56168ec537b0 2023-10-06T02:28:56.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.786+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v129'202 uv202 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.786+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5b1d0 con 0x56168ec537b0 2023-10-06T02:28:56.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.787+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v129'203 uv203 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.788 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:28:56.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.787+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5c1e0 con 0x56168ec537b0 2023-10-06T02:28:56.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.788+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v129'204 uv204 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.788+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5c1e0 con 0x56168ec537b0 2023-10-06T02:28:56.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.789+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v129'205 uv205 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.789+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5b1d0 con 0x56168ec537b0 2023-10-06T02:28:56.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.790+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v129'206 uv206 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec537b0 2023-10-06T02:28:56.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.790+0000 7fda093ae000 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56168ec5b6e0 0x56168ec5dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.790+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5e000 con 0x56168ec5b6e0 2023-10-06T02:28:56.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.790+0000 7fda02dea700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56168ec5b6e0 0x56168ec5dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.791+0000 7fda02dea700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56168ec5b6e0 0x56168ec5dac0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.792+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v129'371 uv365 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec5b6e0 2023-10-06T02:28:56.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.792+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5e4b0 con 0x56168ec5b6e0 2023-10-06T02:28:56.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.793+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v129'372 uv372 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec5b6e0 2023-10-06T02:28:56.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.793+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5e9a0 con 0x56168ec5b6e0 2023-10-06T02:28:56.794 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:28:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.794+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v129'373 uv373 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec5b6e0 2023-10-06T02:28:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.794+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec57bc0 con 0x56168ec5b6e0 2023-10-06T02:28:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.795+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v129'374 uv374 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec5b6e0 2023-10-06T02:28:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.795+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec603e0 con 0x56168ec5b6e0 2023-10-06T02:28:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.797+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v129'375 uv375 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec5b6e0 2023-10-06T02:28:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.797+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5f290 con 0x56168ec5b6e0 2023-10-06T02:28:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.798+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v129'376 uv376 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec5b6e0 2023-10-06T02:28:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.798+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5f690 con 0x56168ec5b6e0 2023-10-06T02:28:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.799+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v129'377 uv370 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec5b6e0 2023-10-06T02:28:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.799+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5fa90 con 0x56168ec5b6e0 2023-10-06T02:28:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.800+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v129'378 uv378 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec5b6e0 2023-10-06T02:28:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.800+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5fa90 con 0x56168ec5b6e0 2023-10-06T02:28:56.802 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:28:56.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.801+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v129'379 uv379 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec5b6e0 2023-10-06T02:28:56.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.801+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5fa40 con 0x56168ec5b6e0 2023-10-06T02:28:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.803+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v129'380 uv380 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec5b6e0 2023-10-06T02:28:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.803+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec5fe90 con 0x56168ec5b6e0 2023-10-06T02:28:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.804+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v129'381 uv381 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec5b6e0 2023-10-06T02:28:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.804+0000 7fda093ae000 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56168ec5fe40 0x56168ec62d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.804+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec632a0 con 0x56168ec5fe40 2023-10-06T02:28:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.804+0000 7fda025e9700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56168ec5fe40 0x56168ec62d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.804+0000 7fda025e9700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56168ec5fe40 0x56168ec62d60 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.806+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v129'168 uv167 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec5fe40 2023-10-06T02:28:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.806+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec632a0 con 0x56168ec5fe40 2023-10-06T02:28:56.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.807+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v129'169 uv169 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec5fe40 2023-10-06T02:28:56.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.807+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec632a0 con 0x56168ec5fe40 2023-10-06T02:28:56.809 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:28:56.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.808+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v129'170 uv170 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec5fe40 2023-10-06T02:28:56.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.808+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec636a0 con 0x56168ec5fe40 2023-10-06T02:28:56.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.809+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v129'171 uv171 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec5fe40 2023-10-06T02:28:56.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.809+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec636a0 con 0x56168ec5fe40 2023-10-06T02:28:56.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.811+0000 7fda025e9700 1 -- 172.21.15.6:0/2962703791 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v129'172 uv172 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9f4023020 con 0x56168ec5fe40 2023-10-06T02:28:56.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.811+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec636a0 con 0x56168ec52610 2023-10-06T02:28:56.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.812+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v129'201 uv200 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.812+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec636a0 con 0x56168ec52610 2023-10-06T02:28:56.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.812+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v129'202 uv202 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.813+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec636a0 con 0x56168ec52610 2023-10-06T02:28:56.814 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:28:56.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.813+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v129'203 uv203 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.813+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec646b0 con 0x56168ec52610 2023-10-06T02:28:56.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.814+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v129'204 uv204 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.814+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec646b0 con 0x56168ec52610 2023-10-06T02:28:56.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.815+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v129'205 uv205 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.815+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec636a0 con 0x56168ec52610 2023-10-06T02:28:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.816+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v129'206 uv206 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.816+0000 7fda093ae000 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56168ec63bb0 0x56168ec65f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.816+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66690 con 0x56168ec63bb0 2023-10-06T02:28:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.816+0000 7fda01de8700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56168ec63bb0 0x56168ec65f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.816+0000 7fda01de8700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56168ec63bb0 0x56168ec65f90 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.818+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v129'335 uv329 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec63bb0 2023-10-06T02:28:56.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.818+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66a70 con 0x56168ec63bb0 2023-10-06T02:28:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.819+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v129'336 uv336 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec63bb0 2023-10-06T02:28:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.819+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66a70 con 0x56168ec63bb0 2023-10-06T02:28:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.820+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v129'337 uv337 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec63bb0 2023-10-06T02:28:56.820 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:28:56.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.820+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66a70 con 0x56168ec63bb0 2023-10-06T02:28:56.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.821+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v129'338 uv338 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec63bb0 2023-10-06T02:28:56.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.821+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66a70 con 0x56168ec63bb0 2023-10-06T02:28:56.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.822+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v129'339 uv339 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec63bb0 2023-10-06T02:28:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.822+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66a70 con 0x56168ec63bb0 2023-10-06T02:28:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.823+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v129'340 uv334 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec63bb0 2023-10-06T02:28:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.823+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66a70 con 0x56168ec63bb0 2023-10-06T02:28:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.824+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v129'341 uv341 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec63bb0 2023-10-06T02:28:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.824+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66a70 con 0x56168ec63bb0 2023-10-06T02:28:56.825 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:28:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.825+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v129'342 uv342 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec63bb0 2023-10-06T02:28:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.825+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66a70 con 0x56168ec63bb0 2023-10-06T02:28:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.826+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v129'343 uv343 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec63bb0 2023-10-06T02:28:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.826+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec697e0 con 0x56168ec63bb0 2023-10-06T02:28:56.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.827+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v129'344 uv344 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec63bb0 2023-10-06T02:28:56.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.827+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f60 con 0x56168ec52610 2023-10-06T02:28:56.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.828+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v129'147 uv145 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.828+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f60 con 0x56168ec52610 2023-10-06T02:28:56.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.829+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v129'148 uv148 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.829+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f60 con 0x56168ec52610 2023-10-06T02:28:56.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.830+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v129'149 uv149 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.830 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:28:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.830+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f60 con 0x56168ec52610 2023-10-06T02:28:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.831+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v129'150 uv150 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.831+0000 7fda093ae000 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56168ec67840 0x56168ec69f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.831+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f60 con 0x56168ec67840 2023-10-06T02:28:56.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.831+0000 7fda02dea700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56168ec67840 0x56168ec69f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.832+0000 7fda02dea700 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56168ec67840 0x56168ec69f30 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.833+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v129'201 uv200 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec67840 2023-10-06T02:28:56.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.833+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f60 con 0x56168ec67840 2023-10-06T02:28:56.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.834+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v129'202 uv202 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec67840 2023-10-06T02:28:56.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.834+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f60 con 0x56168ec67840 2023-10-06T02:28:56.835 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:28:56.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.835+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v129'203 uv203 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec67840 2023-10-06T02:28:56.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.835+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f60 con 0x56168ec67840 2023-10-06T02:28:56.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.836+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v129'204 uv204 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec67840 2023-10-06T02:28:56.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.836+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f60 con 0x56168ec67840 2023-10-06T02:28:56.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.837+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v129'205 uv205 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec67840 2023-10-06T02:28:56.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.837+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f60 con 0x56168ec67840 2023-10-06T02:28:56.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.838+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v129'206 uv206 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec67840 2023-10-06T02:28:56.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.838+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f60 con 0x56168ec5b6e0 2023-10-06T02:28:56.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.840+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v129'171 uv170 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec5b6e0 2023-10-06T02:28:56.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.840+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f60 con 0x56168ec5b6e0 2023-10-06T02:28:56.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.841+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v129'172 uv172 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec5b6e0 2023-10-06T02:28:56.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.841+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f60 con 0x56168ec5b6e0 2023-10-06T02:28:56.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.842+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v129'173 uv173 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec5b6e0 2023-10-06T02:28:56.842 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:28:56.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.842+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f60 con 0x56168ec5b6e0 2023-10-06T02:28:56.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.843+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v129'174 uv174 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec5b6e0 2023-10-06T02:28:56.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.843+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f60 con 0x56168ec5b6e0 2023-10-06T02:28:56.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.844+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v129'175 uv175 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd9fc016070 con 0x56168ec5b6e0 2023-10-06T02:28:56.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.844+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f60 con 0x56168ec52610 2023-10-06T02:28:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.845+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v129'416 uv406 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.845+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f30 con 0x56168ec52610 2023-10-06T02:28:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.846+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v129'417 uv417 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.846+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f30 con 0x56168ec52610 2023-10-06T02:28:56.847 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:28:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.847+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v129'418 uv418 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.847+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f30 con 0x56168ec52610 2023-10-06T02:28:56.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.848+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v129'419 uv419 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.848+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f30 con 0x56168ec52610 2023-10-06T02:28:56.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.849+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v129'420 uv420 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.849+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f30 con 0x56168ec52610 2023-10-06T02:28:56.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.850+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v129'421 uv414 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.850+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f30 con 0x56168ec52610 2023-10-06T02:28:56.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.851+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v129'422 uv422 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.851+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f30 con 0x56168ec52610 2023-10-06T02:28:56.853 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:28:56.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.852+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v129'423 uv423 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.852+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f30 con 0x56168ec52610 2023-10-06T02:28:56.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.853+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v129'424 uv424 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.853+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec66f30 con 0x56168ec52610 2023-10-06T02:28:56.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.854+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v129'425 uv425 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.854+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec6a470 con 0x56168ec52610 2023-10-06T02:28:56.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.855+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v129'426 uv426 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.855+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x56168ec6a870 con 0x56168ec52610 2023-10-06T02:28:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda01de8700 1 -- 172.21.15.6:0/2962703791 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v129'427 uv427 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fd9f8013040 con 0x56168ec52610 2023-10-06T02:28:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56168ec52610 msgr2=0x56168ec5a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56168ec52610 0x56168ec5a4b0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56168eb8d270 msgr2=0x56168ec2a550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x56168eb8d270 0x56168ec2a550 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56168ec63bb0 msgr2=0x56168ec65f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56168ec63bb0 0x56168ec65f90 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56168ec537b0 msgr2=0x56168ec55b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 reap_dead start 2023-10-06T02:28:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56168ec537b0 0x56168ec55b90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56168ec67840 msgr2=0x56168ec69f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56168ec67840 0x56168ec69f30 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56168ec5fe40 msgr2=0x56168ec62d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x56168ec5fe40 0x56168ec62d60 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56168ec5b6e0 msgr2=0x56168ec5dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x56168ec5b6e0 0x56168ec5dac0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd9e4065890 msgr2=0x7fd9e4067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd9e4065890 0x7fd9e4067d40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400a480 tx=0x7fd9f401d000 comp rx=0 tx=0).stop 2023-10-06T02:28:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda02dea700 1 -- 172.21.15.6:0/2962703791 reap_dead start 2023-10-06T02:28:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56168ec36e10 msgr2=0x56168ec3b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56168ec36e10 0x56168ec3b750 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009480 tx=0x7fd9fc007040 comp rx=0 tx=0).stop 2023-10-06T02:28:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 shutdown_connections 2023-10-06T02:28:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 --2- 172.21.15.6:0/2962703791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56168ec36e10 0x56168ec3b750 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 >> 172.21.15.6:0/2962703791 conn(0x56168eb62d50 msgr2=0x56168ebaa690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 shutdown_connections 2023-10-06T02:28:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.857+0000 7fda093ae000 1 -- 172.21.15.6:0/2962703791 wait complete. 2023-10-06T02:28:56.861 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader 10000000000.00000000 deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2023-10-06T02:28:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.940+0000 7fd3bf17b000 1 Processor -- start 2023-10-06T02:28:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.940+0000 7fd3bf17b000 1 -- start start 2023-10-06T02:28:56.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.941+0000 7fd3bf17b000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f67691be90 0x55f6769c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.941+0000 7fd3bf17b000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f6769bda70 0x55f6769b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.941+0000 7fd3bf17b000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6769bde40 0x55f6769b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.941+0000 7fd3bf17b000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f67683b980 con 0x55f6769bde40 2023-10-06T02:28:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.941+0000 7fd3bf17b000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f67683b620 con 0x55f67691be90 2023-10-06T02:28:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.941+0000 7fd3bf17b000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f676832400 con 0x55f6769bda70 2023-10-06T02:28:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.941+0000 7fd3b8bb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6769bde40 0x55f6769b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.941+0000 7fd3b8bb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6769bde40 0x55f6769b5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56570/0 (socket says 172.21.15.6:56570) 2023-10-06T02:28:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.941+0000 7fd3b8bb7700 1 -- 172.21.15.6:0/3124265556 learned_addr learned my addr 172.21.15.6:0/3124265556 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.941+0000 7fd3b83b6700 1 --2- 172.21.15.6:0/3124265556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f67691be90 0x55f6769c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.941+0000 7fd3b7bb5700 1 --2- 172.21.15.6:0/3124265556 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f6769bda70 0x55f6769b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.941+0000 7fd3b8bb7700 1 -- 172.21.15.6:0/3124265556 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f6769bda70 msgr2=0x55f6769b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.941+0000 7fd3b8bb7700 1 --2- 172.21.15.6:0/3124265556 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f6769bda70 0x55f6769b4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.941+0000 7fd3b8bb7700 1 -- 172.21.15.6:0/3124265556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f67691be90 msgr2=0x55f6769c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.941+0000 7fd3b8bb7700 1 --2- 172.21.15.6:0/3124265556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f67691be90 0x55f6769c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.941+0000 7fd3b8bb7700 1 -- 172.21.15.6:0/3124265556 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a8005cf0 con 0x55f6769bde40 2023-10-06T02:28:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.941+0000 7fd3b83b6700 1 --2- 172.21.15.6:0/3124265556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f67691be90 0x55f6769c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.942+0000 7fd3b8bb7700 1 --2- 172.21.15.6:0/3124265556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6769bde40 0x55f6769b5290 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000b010 tx=0x7fd3b0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f389bf41e2ba444 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.942+0000 7fd3b6bb3700 1 -- 172.21.15.6:0/3124265556 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0010520 con 0x55f6769bde40 2023-10-06T02:28:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.942+0000 7fd3b6bb3700 1 -- 172.21.15.6:0/3124265556 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b00109c0 con 0x55f6769bde40 2023-10-06T02:28:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.942+0000 7fd3b6bb3700 1 -- 172.21.15.6:0/3124265556 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0010d80 con 0x55f6769bde40 2023-10-06T02:28:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.942+0000 7fd3bf17b000 1 -- 172.21.15.6:0/3124265556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6769bde40 msgr2=0x55f6769b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.942+0000 7fd3bf17b000 1 --2- 172.21.15.6:0/3124265556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6769bde40 0x55f6769b5290 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000b010 tx=0x7fd3b0014000 comp rx=0 tx=0).stop 2023-10-06T02:28:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.942+0000 7fd3bf17b000 1 -- 172.21.15.6:0/3124265556 shutdown_connections 2023-10-06T02:28:56.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.942+0000 7fd3bf17b000 1 --2- 172.21.15.6:0/3124265556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6769bde40 0x55f6769b5290 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.942+0000 7fd3bf17b000 1 --2- 172.21.15.6:0/3124265556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f67691be90 0x55f6769c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.942+0000 7fd3bf17b000 1 --2- 172.21.15.6:0/3124265556 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f6769bda70 0x55f6769b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.942+0000 7fd3bf17b000 1 -- 172.21.15.6:0/3124265556 >> 172.21.15.6:0/3124265556 conn(0x55f6768f0d50 msgr2=0x55f6769be270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:56.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.942+0000 7fd3bf17b000 1 -- 172.21.15.6:0/3124265556 shutdown_connections 2023-10-06T02:28:56.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.942+0000 7fd3bf17b000 1 -- 172.21.15.6:0/3124265556 wait complete. 2023-10-06T02:28:56.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.943+0000 7fd3bf17b000 1 Processor -- start 2023-10-06T02:28:56.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.943+0000 7fd3bf17b000 1 -- start start 2023-10-06T02:28:56.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.943+0000 7fd3bf17b000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f67691be90 0x55f6769d7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3bf17b000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6769bda70 0x55f6769c0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3bf17b000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6769bde40 0x55f6769ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3bf17b000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6769bfd40 con 0x55f6769bda70 2023-10-06T02:28:56.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3bf17b000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6769bffe0 con 0x55f6769bde40 2023-10-06T02:28:56.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3bf17b000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f6769c0280 con 0x55f67691be90 2023-10-06T02:28:56.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3b7bb5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6769bda70 0x55f6769c0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3b7bb5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6769bda70 0x55f6769c0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56574/0 (socket says 172.21.15.6:56574) 2023-10-06T02:28:56.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3b7bb5700 1 -- 172.21.15.6:0/1664272716 learned_addr learned my addr 172.21.15.6:0/1664272716 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:56.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3b8bb7700 1 --2- 172.21.15.6:0/1664272716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6769bde40 0x55f6769ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3b83b6700 1 --2- 172.21.15.6:0/1664272716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f67691be90 0x55f6769d7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3b7bb5700 1 -- 172.21.15.6:0/1664272716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f67691be90 msgr2=0x55f6769d7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3b7bb5700 1 --2- 172.21.15.6:0/1664272716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f67691be90 0x55f6769d7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3b7bb5700 1 -- 172.21.15.6:0/1664272716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6769bde40 msgr2=0x55f6769ad240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3b7bb5700 1 --2- 172.21.15.6:0/1664272716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6769bde40 0x55f6769ad240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3b7bb5700 1 -- 172.21.15.6:0/1664272716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6768641c0 con 0x55f6769bda70 2023-10-06T02:28:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3b7bb5700 1 --2- 172.21.15.6:0/1664272716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6769bda70 0x55f6769c0c60 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac001380 tx=0x7fd3ac00a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3b53b0700 1 -- 172.21.15.6:0/1664272716 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac00aae0 con 0x55f6769bda70 2023-10-06T02:28:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3b53b0700 1 -- 172.21.15.6:0/1664272716 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac00ac40 con 0x55f6769bda70 2023-10-06T02:28:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3b53b0700 1 -- 172.21.15.6:0/1664272716 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac00f400 con 0x55f6769bda70 2023-10-06T02:28:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3bf17b000 1 -- 172.21.15.6:0/1664272716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b000a0e0 con 0x55f6769bda70 2023-10-06T02:28:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.944+0000 7fd3bf17b000 1 -- 172.21.15.6:0/1664272716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f67684a3d0 con 0x55f6769bda70 2023-10-06T02:28:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.946+0000 7fd3b53b0700 1 -- 172.21.15.6:0/1664272716 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd3ac00d040 con 0x55f6769bda70 2023-10-06T02:28:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.946+0000 7fd3b53b0700 1 --2- 172.21.15.6:0/1664272716 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd3a4065890 0x7fd3a4067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.946+0000 7fd3b53b0700 1 -- 172.21.15.6:0/1664272716 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 9302+0+0 (secure 0 0 0) 0x7fd3ac083a40 con 0x55f6769bda70 2023-10-06T02:28:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.946+0000 7fd3b83b6700 1 --2- 172.21.15.6:0/1664272716 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd3a4065890 0x7fd3a4067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.946+0000 7fd3bf17b000 1 --2- 172.21.15.6:0/1664272716 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55f6769c3280 0x55f676934e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.946+0000 7fd3bf17b000 1 -- 172.21.15.6:0/1664272716 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e129) v8 -- 0x55f676935360 con 0x55f6769c3280 2023-10-06T02:28:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.946+0000 7fd3b8bb7700 1 --2- 172.21.15.6:0/1664272716 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55f6769c3280 0x55f676934e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.947+0000 7fd3b83b6700 1 --2- 172.21.15.6:0/1664272716 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd3a4065890 0x7fd3a4067d40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009d60 tx=0x7fd3a8005a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.947+0000 7fd3b8bb7700 1 --2- 172.21.15.6:0/1664272716 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55f6769c3280 0x55f676934e20 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.948+0000 7fd3b8bb7700 1 -- 172.21.15.6:0/1664272716 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-header] v129'1064 uv1064 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fd3b0010c20 con 0x55f6769c3280 2023-10-06T02:28:56.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.948+0000 7fd3bf17b000 1 -- 172.21.15.6:0/1664272716 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55f6769c3280 msgr2=0x55f676934e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.948+0000 7fd3bf17b000 1 --2- 172.21.15.6:0/1664272716 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55f6769c3280 0x55f676934e20 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.948+0000 7fd3bf17b000 1 -- 172.21.15.6:0/1664272716 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd3a4065890 msgr2=0x7fd3a4067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.948+0000 7fd3bf17b000 1 --2- 172.21.15.6:0/1664272716 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd3a4065890 0x7fd3a4067d40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009d60 tx=0x7fd3a8005a50 comp rx=0 tx=0).stop 2023-10-06T02:28:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.948+0000 7fd3bf17b000 1 -- 172.21.15.6:0/1664272716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6769bda70 msgr2=0x55f6769c0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.948+0000 7fd3bf17b000 1 --2- 172.21.15.6:0/1664272716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6769bda70 0x55f6769c0c60 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac001380 tx=0x7fd3ac00a4e0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.948+0000 7fd3b8bb7700 1 -- 172.21.15.6:0/1664272716 reap_dead start 2023-10-06T02:28:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.948+0000 7fd3bf17b000 1 -- 172.21.15.6:0/1664272716 shutdown_connections 2023-10-06T02:28:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.948+0000 7fd3bf17b000 1 -- 172.21.15.6:0/1664272716 >> 172.21.15.6:0/1664272716 conn(0x55f6768f0d50 msgr2=0x55f6769be270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.948+0000 7fd3bf17b000 1 -- 172.21.15.6:0/1664272716 shutdown_connections 2023-10-06T02:28:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:56.948+0000 7fd3bf17b000 1 -- 172.21.15.6:0/1664272716 wait complete. 2023-10-06T02:28:56.954 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:28:57.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.115+0000 7f18326ff700 1 Processor -- start 2023-10-06T02:28:57.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.115+0000 7f18326ff700 1 -- start start 2023-10-06T02:28:57.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.116+0000 7f18326ff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f182c0a89c0 0x7f182c0aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.116+0000 7f18326ff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f182c0a8d90 0x7f182c0af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.116+0000 7f18326ff700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182c06b030 con 0x7f182c0af570 2023-10-06T02:28:57.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.116+0000 7f18326ff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f182c0af9b0 con 0x7f182c0a8d90 2023-10-06T02:28:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.116+0000 7f18326ff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182c0b1ab0 con 0x7f182c0a89c0 2023-10-06T02:28:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.117+0000 7f182bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f182c0a89c0 0x7f182c0aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.117+0000 7f182b7fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f182c0a8d90 0x7f182c0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.117+0000 7f1830c9c700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f182c0af570 0x7f182c0b2810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:39710/0 (socket says 172.21.15.6:39710) 2023-10-06T02:28:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.117+0000 7f1830c9c700 1 -- 172.21.15.6:0/3842464970 learned_addr learned my addr 172.21.15.6:0/3842464970 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.117+0000 7f182bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f182c0a89c0 0x7f182c0aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:60364/0 (socket says 172.21.15.6:60364) 2023-10-06T02:28:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.117+0000 7f182bfff700 1 -- 172.21.15.6:0/3842464970 >> v2:172.21.15.175:3300/0 conn(0x7f182c0a8d90 msgr2=0x7f182c0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.117+0000 7f182bfff700 1 --2- 172.21.15.6:0/3842464970 >> v2:172.21.15.175:3300/0 conn(0x7f182c0a8d90 0x7f182c0af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.117+0000 7f182bfff700 1 -- 172.21.15.6:0/3842464970 >> v1:172.21.15.175:6789/0 conn(0x7f182c0af570 legacy=0x7f182c0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.117+0000 7f182bfff700 1 -- 172.21.15.6:0/3842464970 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c06ad50 con 0x7f182c0a89c0 2023-10-06T02:28:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.117+0000 7f182bfff700 1 --2- 172.21.15.6:0/3842464970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f182c0a89c0 0x7f182c0aeaf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f181c0098d0 tx=0x7f181c009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13008b33c5642e2d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.117+0000 7f182affd700 1 -- 172.21.15.6:0/3842464970 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c005c10 con 0x7f182c0a89c0 2023-10-06T02:28:57.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.117+0000 7f182affd700 1 -- 172.21.15.6:0/3842464970 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c005d70 con 0x7f182c0a89c0 2023-10-06T02:28:57.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.117+0000 7f182affd700 1 -- 172.21.15.6:0/3842464970 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c006280 con 0x7f182c0a89c0 2023-10-06T02:28:57.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.118+0000 7f18326ff700 1 -- 172.21.15.6:0/3842464970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f182c0a89c0 msgr2=0x7f182c0aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.118+0000 7f18326ff700 1 --2- 172.21.15.6:0/3842464970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f182c0a89c0 0x7f182c0aeaf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f181c0098d0 tx=0x7f181c009120 comp rx=0 tx=0).stop 2023-10-06T02:28:57.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.118+0000 7f18326ff700 1 -- 172.21.15.6:0/3842464970 shutdown_connections 2023-10-06T02:28:57.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.118+0000 7f18326ff700 1 --2- 172.21.15.6:0/3842464970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f182c0a89c0 0x7f182c0aeaf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.118+0000 7f18326ff700 1 --2- 172.21.15.6:0/3842464970 >> v2:172.21.15.175:3300/0 conn(0x7f182c0a8d90 0x7f182c0af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.118+0000 7f18326ff700 1 -- 172.21.15.6:0/3842464970 >> 172.21.15.6:0/3842464970 conn(0x7f182c067910 msgr2=0x7f182c0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:57.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.118+0000 7f18326ff700 1 -- 172.21.15.6:0/3842464970 shutdown_connections 2023-10-06T02:28:57.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.118+0000 7f18326ff700 1 -- 172.21.15.6:0/3842464970 wait complete. 2023-10-06T02:28:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.119+0000 7f18326ff700 1 Processor -- start 2023-10-06T02:28:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.119+0000 7f18326ff700 1 -- start start 2023-10-06T02:28:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f18326ff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f182c0a89c0 0x7f182c0c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f18326ff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f182c0a8d90 0x7f182c09ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f18326ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182c0af570 0x7f182c09b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f18326ff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c16b030 con 0x7f182c0af570 2023-10-06T02:28:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f18326ff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c16b9e0 con 0x7f182c0a8d90 2023-10-06T02:28:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f18326ff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182c16ad50 con 0x7f182c0a89c0 2023-10-06T02:28:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f1830c9c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182c0af570 0x7f182c09b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f182bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f182c0a89c0 0x7f182c0c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f182b7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f182c0a8d90 0x7f182c09ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f1830c9c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182c0af570 0x7f182c09b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56590/0 (socket says 172.21.15.6:56590) 2023-10-06T02:28:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f1830c9c700 1 -- 172.21.15.6:0/690699401 learned_addr learned my addr 172.21.15.6:0/690699401 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f182bfff700 1 -- 172.21.15.6:0/690699401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f182c0a8d90 msgr2=0x7f182c09ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f182bfff700 1 --2- 172.21.15.6:0/690699401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f182c0a8d90 0x7f182c09ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f182bfff700 1 -- 172.21.15.6:0/690699401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182c0af570 msgr2=0x7f182c09b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f182bfff700 1 --2- 172.21.15.6:0/690699401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182c0af570 0x7f182c09b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f182bfff700 1 -- 172.21.15.6:0/690699401 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c0093c0 con 0x7f182c0a89c0 2023-10-06T02:28:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f182bfff700 1 --2- 172.21.15.6:0/690699401 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f182c0a89c0 0x7f182c0c6780 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f181c015000 tx=0x7f181c016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.120+0000 7f1813fff700 1 -- 172.21.15.6:0/690699401 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c01a630 con 0x7f182c0a89c0 2023-10-06T02:28:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.121+0000 7f1813fff700 1 -- 172.21.15.6:0/690699401 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c01a790 con 0x7f182c0a89c0 2023-10-06T02:28:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.121+0000 7f18326ff700 1 -- 172.21.15.6:0/690699401 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182c16b390 con 0x7f182c0a89c0 2023-10-06T02:28:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.121+0000 7f1813fff700 1 -- 172.21.15.6:0/690699401 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c01ab50 con 0x7f182c0a89c0 2023-10-06T02:28:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.121+0000 7f18326ff700 1 -- 172.21.15.6:0/690699401 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182c0c6cc0 con 0x7f182c0a89c0 2023-10-06T02:28:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.122+0000 7f18326ff700 1 -- 172.21.15.6:0/690699401 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182c087170 con 0x7f182c0a89c0 2023-10-06T02:28:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.122+0000 7f1813fff700 1 -- 172.21.15.6:0/690699401 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f181c011420 con 0x7f182c0a89c0 2023-10-06T02:28:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.122+0000 7f1813fff700 1 --2- 172.21.15.6:0/690699401 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1818066f30 0x7f18180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.122+0000 7f1813fff700 1 -- 172.21.15.6:0/690699401 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 9302+0+0 (secure 0 0 0) 0x7f181c0867d0 con 0x7f182c0a89c0 2023-10-06T02:28:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.123+0000 7f182b7fe700 1 --2- 172.21.15.6:0/690699401 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1818066f30 0x7f18180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.123+0000 7f182b7fe700 1 --2- 172.21.15.6:0/690699401 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1818066f30 0x7f18180693e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f182c159e50 tx=0x7f18200091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.127+0000 7f1813fff700 1 -- 172.21.15.6:0/690699401 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f181c052bf0 con 0x7f182c0a89c0 2023-10-06T02:28:57.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.370+0000 7f18326ff700 1 -- 172.21.15.6:0/690699401 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f182c06e5d0 con 0x7f182c0a89c0 2023-10-06T02:28:57.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.864+0000 7f1813fff700 1 -- 172.21.15.6:0/690699401 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v308) v1 ==== 162+0+0 (secure 0 0 0) 0x7f181c02b020 con 0x7f182c0a89c0 2023-10-06T02:28:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.868+0000 7f18326ff700 1 -- 172.21.15.6:0/690699401 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1818066f30 msgr2=0x7f18180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.868+0000 7f18326ff700 1 --2- 172.21.15.6:0/690699401 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1818066f30 0x7f18180693e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f182c159e50 tx=0x7f18200091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.868+0000 7f18326ff700 1 -- 172.21.15.6:0/690699401 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f182c0a89c0 msgr2=0x7f182c0c6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.868+0000 7f18326ff700 1 --2- 172.21.15.6:0/690699401 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f182c0a89c0 0x7f182c0c6780 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f181c015000 tx=0x7f181c016000 comp rx=0 tx=0).stop 2023-10-06T02:28:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.868+0000 7f18326ff700 1 -- 172.21.15.6:0/690699401 shutdown_connections 2023-10-06T02:28:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.868+0000 7f18326ff700 1 --2- 172.21.15.6:0/690699401 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1818066f30 0x7f18180693e0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.868+0000 7f18326ff700 1 --2- 172.21.15.6:0/690699401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182c0af570 0x7f182c09b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.868+0000 7f18326ff700 1 --2- 172.21.15.6:0/690699401 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f182c0a89c0 0x7f182c0c6780 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.868+0000 7f18326ff700 1 --2- 172.21.15.6:0/690699401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f182c0a8d90 0x7f182c09ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.868+0000 7f18326ff700 1 -- 172.21.15.6:0/690699401 >> 172.21.15.6:0/690699401 conn(0x7f182c067910 msgr2=0x7f182c0ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:57.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.868+0000 7f18326ff700 1 -- 172.21.15.6:0/690699401 shutdown_connections 2023-10-06T02:28:57.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:57.868+0000 7f18326ff700 1 -- 172.21.15.6:0/690699401 wait complete. 2023-10-06T02:28:57.870 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:28:58.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.420+0000 7fc1b37f7700 1 Processor -- start 2023-10-06T02:28:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.420+0000 7fc1b37f7700 1 -- start start 2023-10-06T02:28:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.421+0000 7fc1b37f7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc1ac0b27f0 0x7fc1ac159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.421+0000 7fc1b37f7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc1ac15d4d0 0x7fc1ac15d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.421+0000 7fc1b37f7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac0cb6c0 con 0x7fc1ac159380 2023-10-06T02:28:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.421+0000 7fc1b37f7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac15e200 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.421+0000 7fc1b37f7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac0ccb60 con 0x7fc1ac0b27f0 2023-10-06T02:28:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.421+0000 7fc1b1d94700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc1ac15d4d0 0x7fc1ac15d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.421+0000 7fc1b1593700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc1ac159380 0x7fc1ac0b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39548/0 (socket says 172.21.15.6:39548) 2023-10-06T02:28:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.421+0000 7fc1b1593700 1 -- 172.21.15.6:0/1518001137 learned_addr learned my addr 172.21.15.6:0/1518001137 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:28:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.421+0000 7fc1b1d94700 1 -- 172.21.15.6:0/1518001137 >> v2:172.21.15.175:3300/0 conn(0x7fc1ac0b27f0 msgr2=0x7fc1ac159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.421+0000 7fc1b1d94700 1 --2- 172.21.15.6:0/1518001137 >> v2:172.21.15.175:3300/0 conn(0x7fc1ac0b27f0 0x7fc1ac159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.421+0000 7fc1b1d94700 1 -- 172.21.15.6:0/1518001137 >> v1:172.21.15.6:6789/0 conn(0x7fc1ac159380 legacy=0x7fc1ac0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.421+0000 7fc1abfff700 1 -- 172.21.15.6:0/1518001137 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105658661 0 0) 0x7fc1ac0cb6c0 con 0x7fc1ac159380 2023-10-06T02:28:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.421+0000 7fc1b1d94700 1 -- 172.21.15.6:0/1518001137 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac0c3ef0 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.421+0000 7fc1b1d94700 1 --2- 172.21.15.6:0/1518001137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1ac15d4d0 0x7fc1ac15d930 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac06b280 tx=0x7fc19c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd99da4109427f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.422+0000 7fc1abfff700 1 -- 172.21.15.6:0/1518001137 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c00e070 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.422+0000 7fc1abfff700 1 -- 172.21.15.6:0/1518001137 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c00bbf0 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.422+0000 7fc1abfff700 1 -- 172.21.15.6:0/1518001137 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c012430 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.422+0000 7fc1b37f7700 1 -- 172.21.15.6:0/1518001137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1ac15d4d0 msgr2=0x7fc1ac15d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.422+0000 7fc1b37f7700 1 --2- 172.21.15.6:0/1518001137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1ac15d4d0 0x7fc1ac15d930 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac06b280 tx=0x7fc19c009780 comp rx=0 tx=0).stop 2023-10-06T02:28:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.422+0000 7fc1b37f7700 1 -- 172.21.15.6:0/1518001137 shutdown_connections 2023-10-06T02:28:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.422+0000 7fc1b37f7700 1 --2- 172.21.15.6:0/1518001137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1ac15d4d0 0x7fc1ac15d930 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.422+0000 7fc1b37f7700 1 --2- 172.21.15.6:0/1518001137 >> v2:172.21.15.175:3300/0 conn(0x7fc1ac0b27f0 0x7fc1ac159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.422+0000 7fc1b37f7700 1 -- 172.21.15.6:0/1518001137 >> 172.21.15.6:0/1518001137 conn(0x7fc1ac068680 msgr2=0x7fc1ac068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.422+0000 7fc1b37f7700 1 -- 172.21.15.6:0/1518001137 shutdown_connections 2023-10-06T02:28:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.422+0000 7fc1b37f7700 1 -- 172.21.15.6:0/1518001137 wait complete. 2023-10-06T02:28:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.423+0000 7fc1b37f7700 1 Processor -- start 2023-10-06T02:28:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.423+0000 7fc1b37f7700 1 -- start start 2023-10-06T02:28:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.424+0000 7fc1b37f7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1ac0b27f0 0x7fc1ac14c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.424+0000 7fc1b37f7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1ac159380 0x7fc1ac0cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.424+0000 7fc1b37f7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1ac15d4d0 0x7fc1ac0b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.424+0000 7fc1b37f7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac0ced50 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.424+0000 7fc1b37f7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac0cf810 con 0x7fc1ac159380 2023-10-06T02:28:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.424+0000 7fc1b37f7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac0ce790 con 0x7fc1ac0b27f0 2023-10-06T02:28:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.424+0000 7fc1b1d94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1ac15d4d0 0x7fc1ac0b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.424+0000 7fc1b1d94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1ac15d4d0 0x7fc1ac0b5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56612/0 (socket says 172.21.15.6:56612) 2023-10-06T02:28:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.424+0000 7fc1b1d94700 1 -- 172.21.15.6:0/1463896321 learned_addr learned my addr 172.21.15.6:0/1463896321 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:28:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.425+0000 7fc1b1593700 1 --2- 172.21.15.6:0/1463896321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1ac0b27f0 0x7fc1ac14c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.425+0000 7fc1b0d92700 1 --2- 172.21.15.6:0/1463896321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1ac159380 0x7fc1ac0cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.425+0000 7fc1b1d94700 1 -- 172.21.15.6:0/1463896321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1ac0b27f0 msgr2=0x7fc1ac14c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.425+0000 7fc1b1d94700 1 --2- 172.21.15.6:0/1463896321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1ac0b27f0 0x7fc1ac14c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.425+0000 7fc1b1d94700 1 -- 172.21.15.6:0/1463896321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1ac159380 msgr2=0x7fc1ac0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.425+0000 7fc1b1d94700 1 --2- 172.21.15.6:0/1463896321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1ac159380 0x7fc1ac0cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.425+0000 7fc1b1d94700 1 -- 172.21.15.6:0/1463896321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c009a20 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.425+0000 7fc1b1d94700 1 --2- 172.21.15.6:0/1463896321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1ac15d4d0 0x7fc1ac0b5580 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac089520 tx=0x7fc19c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.425+0000 7fc1a97fa700 1 -- 172.21.15.6:0/1463896321 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c012e40 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.425+0000 7fc1a97fa700 1 -- 172.21.15.6:0/1463896321 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c007000 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.425+0000 7fc1b37f7700 1 -- 172.21.15.6:0/1463896321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ac0cea70 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.425+0000 7fc1a97fa700 1 -- 172.21.15.6:0/1463896321 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c01b850 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.425+0000 7fc1b37f7700 1 -- 172.21.15.6:0/1463896321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac169970 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.426+0000 7fc1b37f7700 1 -- 172.21.15.6:0/1463896321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ac0b0e20 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.427+0000 7fc1a97fa700 1 -- 172.21.15.6:0/1463896321 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc19c01bc80 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.427+0000 7fc1a97fa700 1 --2- 172.21.15.6:0/1463896321 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc198066f30 0x7fc1980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.427+0000 7fc1a97fa700 1 -- 172.21.15.6:0/1463896321 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 9302+0+0 (secure 0 0 0) 0x7fc19c0874e0 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.427+0000 7fc1b1593700 1 --2- 172.21.15.6:0/1463896321 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc198066f30 0x7fc1980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.428+0000 7fc1b1593700 1 --2- 172.21.15.6:0/1463896321 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc198066f30 0x7fc1980693e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40011e0 tx=0x7fc1a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:58.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.432+0000 7fc1a97fa700 1 -- 172.21.15.6:0/1463896321 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc19c053900 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.668+0000 7fc1b37f7700 1 -- 172.21.15.6:0/1463896321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1ac0cad90 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.669+0000 7fc1a97fa700 1 -- 172.21.15.6:0/1463896321 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 309 v309) v1 ==== 95+0+4607 (secure 0 0 0) 0x7fc19c056f20 con 0x7fc1ac15d4d0 2023-10-06T02:28:58.670 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:28:58.670 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":309,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":309,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:28:57.864104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":129,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10308":{"gid":10308,"name":"a","rank":0,"incarnation":309,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/1713670870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1713670870},{"type":"v1","addr":"172.21.15.6:6835","nonce":1713670870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:28:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.671+0000 7fc1b37f7700 1 -- 172.21.15.6:0/1463896321 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc198066f30 msgr2=0x7fc1980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.671+0000 7fc1b37f7700 1 --2- 172.21.15.6:0/1463896321 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc198066f30 0x7fc1980693e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40011e0 tx=0x7fc1a4009040 comp rx=0 tx=0).stop 2023-10-06T02:28:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.671+0000 7fc1b37f7700 1 -- 172.21.15.6:0/1463896321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1ac15d4d0 msgr2=0x7fc1ac0b5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.671+0000 7fc1b37f7700 1 --2- 172.21.15.6:0/1463896321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1ac15d4d0 0x7fc1ac0b5580 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac089520 tx=0x7fc19c019000 comp rx=0 tx=0).stop 2023-10-06T02:28:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.671+0000 7fc1b37f7700 1 -- 172.21.15.6:0/1463896321 shutdown_connections 2023-10-06T02:28:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.671+0000 7fc1b37f7700 1 --2- 172.21.15.6:0/1463896321 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc198066f30 0x7fc1980693e0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.671+0000 7fc1b37f7700 1 --2- 172.21.15.6:0/1463896321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1ac15d4d0 0x7fc1ac0b5580 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.671+0000 7fc1b37f7700 1 --2- 172.21.15.6:0/1463896321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1ac0b27f0 0x7fc1ac14c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.671+0000 7fc1b37f7700 1 --2- 172.21.15.6:0/1463896321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1ac159380 0x7fc1ac0cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.671+0000 7fc1b37f7700 1 -- 172.21.15.6:0/1463896321 >> 172.21.15.6:0/1463896321 conn(0x7fc1ac068680 msgr2=0x7fc1ac1588d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.671+0000 7fc1b37f7700 1 -- 172.21.15.6:0/1463896321 shutdown_connections 2023-10-06T02:28:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:28:58.671+0000 7fc1b37f7700 1 -- 172.21.15.6:0/1463896321 wait complete. 2023-10-06T02:28:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 309 2023-10-06T02:28:58.683 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 309, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:28:57.864104+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 129, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10308}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10308': {'gid': 10308, 'name': 'a', 'rank': 0, 'incarnation': 309, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.6:6835/1713670870', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 1713670870}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 1713670870}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:28:58.684 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10308:up:replay 2023-10-06T02:28:58.684 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2023-10-06T02:29:01.607 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:29:01.607+0000 7f20746b8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:29:04.088 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.220+0000 7fda19e42700 1 Processor -- start 2023-10-06T02:29:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.220+0000 7fda19e42700 1 -- start start 2023-10-06T02:29:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.221+0000 7fda19e42700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fda141408c0 0x7fda140c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.221+0000 7fda19e42700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda140c7560 0x7fda140aca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.221+0000 7fda19e42700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda140ac570 con 0x7fda140c1f50 2023-10-06T02:29:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.221+0000 7fda19e42700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda140c2490 con 0x7fda141408c0 2023-10-06T02:29:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.221+0000 7fda19e42700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda140c2770 con 0x7fda140c7560 2023-10-06T02:29:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.221+0000 7fda13fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fda140c1f50 0x7fda140c6e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40290/0 (socket says 172.21.15.6:40290) 2023-10-06T02:29:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.221+0000 7fda13fff700 1 -- 172.21.15.6:0/775871288 learned_addr learned my addr 172.21.15.6:0/775871288 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.221+0000 7fda19641700 1 --2- 172.21.15.6:0/775871288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda140c7560 0x7fda140aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.221+0000 7fda18e40700 1 --2- 172.21.15.6:0/775871288 >> v2:172.21.15.175:3300/0 conn(0x7fda141408c0 0x7fda140c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.221+0000 7fda137fe700 1 -- 172.21.15.6:0/775871288 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246209248 0 0) 0x7fda140ac570 con 0x7fda140c1f50 2023-10-06T02:29:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.222+0000 7fda137fe700 1 -- 172.21.15.6:0/775871288 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9fc003570 con 0x7fda140c1f50 2023-10-06T02:29:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.222+0000 7fda18e40700 1 -- 172.21.15.6:0/775871288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda140c7560 msgr2=0x7fda140aca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.222+0000 7fda18e40700 1 --2- 172.21.15.6:0/775871288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda140c7560 0x7fda140aca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.222+0000 7fda18e40700 1 -- 172.21.15.6:0/775871288 >> v1:172.21.15.6:6789/0 conn(0x7fda140c1f50 legacy=0x7fda140c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.222+0000 7fda137fe700 1 -- 172.21.15.6:0/775871288 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 494636122 0 0) 0x7fd9fc003570 con 0x7fda140c1f50 2023-10-06T02:29:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.222+0000 7fda18e40700 1 -- 172.21.15.6:0/775871288 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda140ac200 con 0x7fda141408c0 2023-10-06T02:29:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.222+0000 7fda19641700 1 --2- 172.21.15.6:0/775871288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda140c7560 0x7fda140aca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.222+0000 7fda18e40700 1 --2- 172.21.15.6:0/775871288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda141408c0 0x7fda140c1a10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fda040098e0 tx=0x7fda040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0490d4b36edea48 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.222+0000 7fda137fe700 1 -- 172.21.15.6:0/775871288 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda08001470 con 0x7fda141408c0 2023-10-06T02:29:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.222+0000 7fda137fe700 1 -- 172.21.15.6:0/775871288 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda04011420 con 0x7fda141408c0 2023-10-06T02:29:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.222+0000 7fda137fe700 1 -- 172.21.15.6:0/775871288 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda040117c0 con 0x7fda141408c0 2023-10-06T02:29:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.223+0000 7fda19e42700 1 -- 172.21.15.6:0/775871288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda141408c0 msgr2=0x7fda140c1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.223+0000 7fda19e42700 1 --2- 172.21.15.6:0/775871288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda141408c0 0x7fda140c1a10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fda040098e0 tx=0x7fda040091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.223+0000 7fda19e42700 1 -- 172.21.15.6:0/775871288 shutdown_connections 2023-10-06T02:29:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.223+0000 7fda19e42700 1 --2- 172.21.15.6:0/775871288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda140c7560 0x7fda140aca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.223+0000 7fda19e42700 1 --2- 172.21.15.6:0/775871288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda141408c0 0x7fda140c1a10 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.223+0000 7fda19e42700 1 -- 172.21.15.6:0/775871288 >> 172.21.15.6:0/775871288 conn(0x7fda140cbd50 msgr2=0x7fda140cc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.223+0000 7fda19e42700 1 -- 172.21.15.6:0/775871288 shutdown_connections 2023-10-06T02:29:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.223+0000 7fda19e42700 1 -- 172.21.15.6:0/775871288 wait complete. 2023-10-06T02:29:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.224+0000 7fda19e42700 1 Processor -- start 2023-10-06T02:29:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.224+0000 7fda19e42700 1 -- start start 2023-10-06T02:29:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda19e42700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda140c1f50 0x7fda1415adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda19e42700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda140c7560 0x7fda1415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda19e42700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda141408c0 0x7fda1413dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda19e42700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1415c0c0 con 0x7fda140c7560 2023-10-06T02:29:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda19e42700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda140c4220 con 0x7fda141408c0 2023-10-06T02:29:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda19e42700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1415c320 con 0x7fda140c1f50 2023-10-06T02:29:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda13fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda140c7560 0x7fda1415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda13fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda140c7560 0x7fda1415bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53642/0 (socket says 172.21.15.6:53642) 2023-10-06T02:29:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda18e40700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda140c1f50 0x7fda1415adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda13fff700 1 -- 172.21.15.6:0/4236214104 learned_addr learned my addr 172.21.15.6:0/4236214104 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda19641700 1 --2- 172.21.15.6:0/4236214104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda141408c0 0x7fda1413dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda13fff700 1 -- 172.21.15.6:0/4236214104 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda140c1f50 msgr2=0x7fda1415adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda13fff700 1 --2- 172.21.15.6:0/4236214104 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda140c1f50 0x7fda1415adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda13fff700 1 -- 172.21.15.6:0/4236214104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda141408c0 msgr2=0x7fda1413dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda13fff700 1 --2- 172.21.15.6:0/4236214104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda141408c0 0x7fda1413dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda13fff700 1 -- 172.21.15.6:0/4236214104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c009a20 con 0x7fda140c7560 2023-10-06T02:29:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda18e40700 1 --2- 172.21.15.6:0/4236214104 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda140c1f50 0x7fda1415adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.225+0000 7fda13fff700 1 --2- 172.21.15.6:0/4236214104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda140c7560 0x7fda1415bb80 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fda0800c960 tx=0x7fda08001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.226+0000 7fda10ff9700 1 -- 172.21.15.6:0/4236214104 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda08005b30 con 0x7fda140c7560 2023-10-06T02:29:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.226+0000 7fda10ff9700 1 -- 172.21.15.6:0/4236214104 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda08005c90 con 0x7fda140c7560 2023-10-06T02:29:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.226+0000 7fda19e42700 1 -- 172.21.15.6:0/4236214104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda04009420 con 0x7fda140c7560 2023-10-06T02:29:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.226+0000 7fda10ff9700 1 -- 172.21.15.6:0/4236214104 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda08007340 con 0x7fda140c7560 2023-10-06T02:29:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.226+0000 7fda19e42700 1 -- 172.21.15.6:0/4236214104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1415c8e0 con 0x7fda140c7560 2023-10-06T02:29:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.227+0000 7fda19e42700 1 -- 172.21.15.6:0/4236214104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1406d3d0 con 0x7fda140c7560 2023-10-06T02:29:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.227+0000 7fda10ff9700 1 -- 172.21.15.6:0/4236214104 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda0801b400 con 0x7fda140c7560 2023-10-06T02:29:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.227+0000 7fda10ff9700 1 --2- 172.21.15.6:0/4236214104 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda00066f30 0x7fda000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.228+0000 7fda10ff9700 1 -- 172.21.15.6:0/4236214104 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 9302+0+0 (secure 0 0 0) 0x7fda08084f50 con 0x7fda140c7560 2023-10-06T02:29:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.228+0000 7fda18e40700 1 --2- 172.21.15.6:0/4236214104 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda00066f30 0x7fda000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.228+0000 7fda18e40700 1 --2- 172.21.15.6:0/4236214104 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda00066f30 0x7fda000693e0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fda040030c0 tx=0x7fda04016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.232+0000 7fda10ff9700 1 -- 172.21.15.6:0/4236214104 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda080514b0 con 0x7fda140c7560 2023-10-06T02:29:04.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.472+0000 7fda19e42700 1 -- 172.21.15.6:0/4236214104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda140c4390 con 0x7fda140c7560 2023-10-06T02:29:04.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.473+0000 7fda10ff9700 1 -- 172.21.15.6:0/4236214104 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 312 v312) v1 ==== 95+0+4607 (secure 0 0 0) 0x7fda08054ad0 con 0x7fda140c7560 2023-10-06T02:29:04.474 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:04.474 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":312,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":312,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:00.875879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":129,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10308":{"gid":10308,"name":"a","rank":0,"incarnation":309,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/1713670870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1713670870},{"type":"v1","addr":"172.21.15.6:6835","nonce":1713670870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:04.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.475+0000 7fda19e42700 1 -- 172.21.15.6:0/4236214104 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda00066f30 msgr2=0x7fda000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.475+0000 7fda19e42700 1 --2- 172.21.15.6:0/4236214104 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda00066f30 0x7fda000693e0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fda040030c0 tx=0x7fda04016000 comp rx=0 tx=0).stop 2023-10-06T02:29:04.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.475+0000 7fda19e42700 1 -- 172.21.15.6:0/4236214104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda140c7560 msgr2=0x7fda1415bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.475+0000 7fda19e42700 1 --2- 172.21.15.6:0/4236214104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda140c7560 0x7fda1415bb80 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fda0800c960 tx=0x7fda08001a00 comp rx=0 tx=0).stop 2023-10-06T02:29:04.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.475+0000 7fda19e42700 1 -- 172.21.15.6:0/4236214104 shutdown_connections 2023-10-06T02:29:04.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.475+0000 7fda19e42700 1 --2- 172.21.15.6:0/4236214104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda141408c0 0x7fda1413dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.475+0000 7fda19e42700 1 --2- 172.21.15.6:0/4236214104 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda140c1f50 0x7fda1415adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.475+0000 7fda19e42700 1 --2- 172.21.15.6:0/4236214104 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda00066f30 0x7fda000693e0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.475+0000 7fda19e42700 1 --2- 172.21.15.6:0/4236214104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda140c7560 0x7fda1415bb80 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.475+0000 7fda19e42700 1 -- 172.21.15.6:0/4236214104 >> 172.21.15.6:0/4236214104 conn(0x7fda140cbd50 msgr2=0x7fda140adf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:04.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.475+0000 7fda19e42700 1 -- 172.21.15.6:0/4236214104 shutdown_connections 2023-10-06T02:29:04.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.475+0000 7fda19e42700 1 -- 172.21.15.6:0/4236214104 wait complete. 2023-10-06T02:29:04.477 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 312 2023-10-06T02:29:04.487 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 312, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:29:00.875879+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 129, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10308}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10308': {'gid': 10308, 'name': 'a', 'rank': 0, 'incarnation': 309, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.6:6835/1713670870', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 1713670870}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 1713670870}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:29:04.488 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:29:04.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:29:04.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.608+0000 7f63289fa700 1 Processor -- start 2023-10-06T02:29:04.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.608+0000 7f63289fa700 1 -- start start 2023-10-06T02:29:04.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.609+0000 7f63289fa700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63240cfe90 0x7f63240d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.609+0000 7f63289fa700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f632415abe0 0x7f632415b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.609+0000 7f63289fa700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63240ceea0 con 0x7f6324153a10 2023-10-06T02:29:04.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.609+0000 7f63289fa700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6324069140 con 0x7f632415abe0 2023-10-06T02:29:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.609+0000 7f63289fa700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63240d0820 con 0x7f63240cfe90 2023-10-06T02:29:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.609+0000 7f63237fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6324153a10 0x7f63240cf330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40306/0 (socket says 172.21.15.6:40306) 2023-10-06T02:29:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.609+0000 7f6323fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f632415abe0 0x7f632415b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.609+0000 7f63237fe700 1 -- 172.21.15.6:0/3863828888 learned_addr learned my addr 172.21.15.6:0/3863828888 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.609+0000 7f6322ffd700 1 --2- 172.21.15.6:0/3863828888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63240cfe90 0x7f63240d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.609+0000 7f6323fff700 1 -- 172.21.15.6:0/3863828888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63240cfe90 msgr2=0x7f63240d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.609+0000 7f6323fff700 1 --2- 172.21.15.6:0/3863828888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63240cfe90 0x7f63240d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.609+0000 7f6323fff700 1 -- 172.21.15.6:0/3863828888 >> v1:172.21.15.6:6789/0 conn(0x7f6324153a10 legacy=0x7f63240cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.609+0000 7f6323fff700 1 -- 172.21.15.6:0/3863828888 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632415b540 con 0x7f632415abe0 2023-10-06T02:29:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.609+0000 7f63227fc700 1 -- 172.21.15.6:0/3863828888 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682345750 0 0) 0x7f63240ceea0 con 0x7f6324153a10 2023-10-06T02:29:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.610+0000 7f6323fff700 1 --2- 172.21.15.6:0/3863828888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f632415abe0 0x7f632415b000 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f631c009e60 tx=0x7f631c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efcdc99d9faf3f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.610+0000 7f63227fc700 1 -- 172.21.15.6:0/3863828888 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c00e070 con 0x7f632415abe0 2023-10-06T02:29:04.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.610+0000 7f63227fc700 1 -- 172.21.15.6:0/3863828888 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c00bb60 con 0x7f632415abe0 2023-10-06T02:29:04.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.610+0000 7f63227fc700 1 -- 172.21.15.6:0/3863828888 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c012430 con 0x7f632415abe0 2023-10-06T02:29:04.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.610+0000 7f63289fa700 1 -- 172.21.15.6:0/3863828888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f632415abe0 msgr2=0x7f632415b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.610+0000 7f63289fa700 1 --2- 172.21.15.6:0/3863828888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f632415abe0 0x7f632415b000 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f631c009e60 tx=0x7f631c009780 comp rx=0 tx=0).stop 2023-10-06T02:29:04.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.610+0000 7f63289fa700 1 -- 172.21.15.6:0/3863828888 shutdown_connections 2023-10-06T02:29:04.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.610+0000 7f63289fa700 1 --2- 172.21.15.6:0/3863828888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f632415abe0 0x7f632415b000 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.610+0000 7f63289fa700 1 --2- 172.21.15.6:0/3863828888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63240cfe90 0x7f63240d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.610+0000 7f63289fa700 1 -- 172.21.15.6:0/3863828888 >> 172.21.15.6:0/3863828888 conn(0x7f632406ac00 msgr2=0x7f6324068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:04.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.610+0000 7f63289fa700 1 -- 172.21.15.6:0/3863828888 shutdown_connections 2023-10-06T02:29:04.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.610+0000 7f63289fa700 1 -- 172.21.15.6:0/3863828888 wait complete. 2023-10-06T02:29:04.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.612+0000 7f63289fa700 1 Processor -- start 2023-10-06T02:29:04.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.612+0000 7f63289fa700 1 -- start start 2023-10-06T02:29:04.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.612+0000 7f63289fa700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63240cfe90 0x7f6324158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.612+0000 7f63289fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6324153a10 0x7f6324169a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.612+0000 7f63289fa700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f632415abe0 0x7f63241556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.612+0000 7f63289fa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632416a900 con 0x7f6324153a10 2023-10-06T02:29:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.612+0000 7f63289fa700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6324155250 con 0x7f632415abe0 2023-10-06T02:29:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.612+0000 7f63289fa700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632416a340 con 0x7f63240cfe90 2023-10-06T02:29:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.612+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6324153a10 0x7f6324169a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.612+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6324153a10 0x7f6324169a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53654/0 (socket says 172.21.15.6:53654) 2023-10-06T02:29:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.612+0000 7f6322ffd700 1 -- 172.21.15.6:0/1051487724 learned_addr learned my addr 172.21.15.6:0/1051487724 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.613+0000 7f6322ffd700 1 -- 172.21.15.6:0/1051487724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63240cfe90 msgr2=0x7f6324158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.613+0000 7f6322ffd700 1 --2- 172.21.15.6:0/1051487724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63240cfe90 0x7f6324158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.613+0000 7f6322ffd700 1 -- 172.21.15.6:0/1051487724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f632415abe0 msgr2=0x7f63241556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.613+0000 7f6322ffd700 1 --2- 172.21.15.6:0/1051487724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f632415abe0 0x7f63241556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.613+0000 7f6322ffd700 1 -- 172.21.15.6:0/1051487724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c009a20 con 0x7f6324153a10 2023-10-06T02:29:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.613+0000 7f6322ffd700 1 --2- 172.21.15.6:0/1051487724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6324153a10 0x7f6324169a40 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f631800ecb0 tx=0x7f63180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.613+0000 7f630b7fe700 1 -- 172.21.15.6:0/1051487724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631800c9d0 con 0x7f6324153a10 2023-10-06T02:29:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.613+0000 7f630b7fe700 1 -- 172.21.15.6:0/1051487724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631800cb30 con 0x7f6324153a10 2023-10-06T02:29:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.613+0000 7f63289fa700 1 -- 172.21.15.6:0/1051487724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632416a620 con 0x7f6324153a10 2023-10-06T02:29:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.613+0000 7f630b7fe700 1 -- 172.21.15.6:0/1051487724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631800ced0 con 0x7f6324153a10 2023-10-06T02:29:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.613+0000 7f63289fa700 1 -- 172.21.15.6:0/1051487724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6324169f80 con 0x7f6324153a10 2023-10-06T02:29:04.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.614+0000 7f630b7fe700 1 -- 172.21.15.6:0/1051487724 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6318013680 con 0x7f6324153a10 2023-10-06T02:29:04.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.615+0000 7f630b7fe700 1 --2- 172.21.15.6:0/1051487724 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6310066f30 0x7f63100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.615+0000 7f630b7fe700 1 -- 172.21.15.6:0/1051487724 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 9302+0+0 (secure 0 0 0) 0x7f63180856e0 con 0x7f6324153a10 2023-10-06T02:29:04.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.615+0000 7f63237fe700 1 --2- 172.21.15.6:0/1051487724 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6310066f30 0x7f63100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.616+0000 7f63237fe700 1 --2- 172.21.15.6:0/1051487724 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6310066f30 0x7f63100693e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f63140011e0 tx=0x7f63140079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:04.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.617+0000 7f6332f54b80 1 Processor -- start 2023-10-06T02:29:04.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.617+0000 7f6332f54b80 1 -- start start 2023-10-06T02:29:04.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6332f54b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d228611e50 0x55d2285eccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6332f54b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2285f22c0 0x55d2285ed200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6332f54b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f3a10 0x55d2285ed740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6332f54b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d228547a70 con 0x55d2285f22c0 2023-10-06T02:29:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6332f54b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d228545270 con 0x55d2285f3a10 2023-10-06T02:29:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6332f54b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d228541060 con 0x55d228611e50 2023-10-06T02:29:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2285f22c0 0x55d2285ed200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2285f22c0 0x55d2285ed200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53660/0 (socket says 172.21.15.6:53660) 2023-10-06T02:29:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6322ffd700 1 -- 172.21.15.6:0/3084415629 learned_addr learned my addr 172.21.15.6:0/3084415629 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6323fff700 1 --2- 172.21.15.6:0/3084415629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f3a10 0x55d2285ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f63237fe700 1 --2- 172.21.15.6:0/3084415629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d228611e50 0x55d2285eccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6322ffd700 1 -- 172.21.15.6:0/3084415629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d228611e50 msgr2=0x55d2285eccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6322ffd700 1 --2- 172.21.15.6:0/3084415629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d228611e50 0x55d2285eccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6322ffd700 1 -- 172.21.15.6:0/3084415629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f3a10 msgr2=0x55d2285ed740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6322ffd700 1 --2- 172.21.15.6:0/3084415629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f3a10 0x55d2285ed740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6322ffd700 1 -- 172.21.15.6:0/3084415629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2283db270 con 0x55d2285f22c0 2023-10-06T02:29:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6322ffd700 1 --2- 172.21.15.6:0/3084415629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2285f22c0 0x55d2285ed200 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f6318009850 tx=0x7f6318082d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ba0b70a9a284e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6308ff9700 1 -- 172.21.15.6:0/3084415629 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318055590 con 0x55d2285f22c0 2023-10-06T02:29:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6308ff9700 1 -- 172.21.15.6:0/3084415629 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6318058a10 con 0x55d2285f22c0 2023-10-06T02:29:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.618+0000 7f6308ff9700 1 -- 172.21.15.6:0/3084415629 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631805c760 con 0x55d2285f22c0 2023-10-06T02:29:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.619+0000 7f6332f54b80 1 -- 172.21.15.6:0/3084415629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2285f22c0 msgr2=0x55d2285ed200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.619+0000 7f6332f54b80 1 --2- 172.21.15.6:0/3084415629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2285f22c0 0x55d2285ed200 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f6318009850 tx=0x7f6318082d10 comp rx=0 tx=0).stop 2023-10-06T02:29:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.619+0000 7f6332f54b80 1 -- 172.21.15.6:0/3084415629 shutdown_connections 2023-10-06T02:29:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.619+0000 7f6332f54b80 1 --2- 172.21.15.6:0/3084415629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f3a10 0x55d2285ed740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.619+0000 7f6332f54b80 1 --2- 172.21.15.6:0/3084415629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d228611e50 0x55d2285eccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.619+0000 7f6332f54b80 1 --2- 172.21.15.6:0/3084415629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2285f22c0 0x55d2285ed200 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.619+0000 7f6332f54b80 1 -- 172.21.15.6:0/3084415629 >> 172.21.15.6:0/3084415629 conn(0x55d2285f1e80 msgr2=0x55d2285f26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.619+0000 7f6332f54b80 1 -- 172.21.15.6:0/3084415629 shutdown_connections 2023-10-06T02:29:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.619+0000 7f6332f54b80 1 -- 172.21.15.6:0/3084415629 wait complete. 2023-10-06T02:29:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.620+0000 7f6332f54b80 1 -- start start 2023-10-06T02:29:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.620+0000 7f6332f54b80 1 Processor -- start 2023-10-06T02:29:04.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6332f54b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f22c0 0x55d22860ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6332f54b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2285f3a10 0x55d22863afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6332f54b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d228611e50 0x55d22863b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6332f54b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2284ec890 con 0x55d2285f3a10 2023-10-06T02:29:04.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6332f54b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d228507ea0 con 0x55d2285f22c0 2023-10-06T02:29:04.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6332f54b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2283c3e30 con 0x55d228611e50 2023-10-06T02:29:04.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6332f54b80 10 client.0 _ll_register_callbacks cb 0x55d2285b4020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:29:04.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2285f3a10 0x55d22863afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2285f3a10 0x55d22863afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53668/0 (socket says 172.21.15.6:53668) 2023-10-06T02:29:04.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6322ffd700 1 -- 172.21.15.6:0/1337303412 learned_addr learned my addr 172.21.15.6:0/1337303412 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:04.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f63237fe700 1 --2- 172.21.15.6:0/1337303412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f22c0 0x55d22860ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6323fff700 1 --2- 172.21.15.6:0/1337303412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d228611e50 0x55d22863b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6322ffd700 1 -- 172.21.15.6:0/1337303412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d228611e50 msgr2=0x55d22863b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:04.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6322ffd700 1 --2- 172.21.15.6:0/1337303412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d228611e50 0x55d22863b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6322ffd700 1 -- 172.21.15.6:0/1337303412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f22c0 msgr2=0x55d22860ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:04.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6322ffd700 1 --2- 172.21.15.6:0/1337303412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f22c0 0x55d22860ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6322ffd700 1 -- 172.21.15.6:0/1337303412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6324169f80 con 0x55d2285f3a10 2023-10-06T02:29:04.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6322ffd700 1 --2- 172.21.15.6:0/1337303412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2285f3a10 0x55d22863afe0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7f63180554c0 tx=0x7f631806e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34eb0ad4127c56dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:04.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6301ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:29:04.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6301ffb700 1 -- 172.21.15.6:0/1337303412 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318055590 con 0x55d2285f3a10 2023-10-06T02:29:04.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6301ffb700 1 -- 172.21.15.6:0/1337303412 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 9302+0+0 (secure 0 0 0) 0x7f631805c760 con 0x55d2285f3a10 2023-10-06T02:29:04.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6332f54b80 1 -- 172.21.15.6:0/1337303412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2285e5940 con 0x55d2285f3a10 2023-10-06T02:29:04.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.621+0000 7f6301ffb700 1 -- 172.21.15.6:0/1337303412 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=312) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6318071250 con 0x55d2285f3a10 2023-10-06T02:29:04.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.622+0000 7f6332f54b80 10 client.10365 fetch_fsmap learned FSMap version 312 2023-10-06T02:29:04.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.622+0000 7f6332f54b80 1 -- 172.21.15.6:0/1337303412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=312,monmap=2+}) v3 -- 0x55d22837dfe0 con 0x55d2285f3a10 2023-10-06T02:29:04.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.622+0000 7f6301ffb700 1 -- 172.21.15.6:0/1337303412 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6318075080 con 0x55d2285f3a10 2023-10-06T02:29:04.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.622+0000 7f6301ffb700 1 -- 172.21.15.6:0/1337303412 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 312) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6318055a20 con 0x55d2285f3a10 2023-10-06T02:29:04.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.622+0000 7f6332f54b80 10 client.10365 fetch_fsmap finished waiting for FSMap version 312 2023-10-06T02:29:04.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.622+0000 7f6332f54b80 10 client.10365 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:29:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.622+0000 7f6332f54b80 20 client.10365 populate_metadata read hostname 'smithi006' 2023-10-06T02:29:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.622+0000 7f6332f54b80 1 --2- 172.21.15.6:0/1337303412 >> [v2:172.21.15.6:6833/1713670870,v1:172.21.15.6:6835/1713670870] conn(0x55d22861ab80 0x55d22861af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.622+0000 7f6332f54b80 4 client.10365 mds_command: new command op to 10308 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:29:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.622+0000 7f6332f54b80 1 -- 172.21.15.6:0/1337303412 --> [v2:172.21.15.6:6833/1713670870,v1:172.21.15.6:6835/1713670870] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d2285c2870 con 0x55d22861ab80 2023-10-06T02:29:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.622+0000 7f63237fe700 1 --2- 172.21.15.6:0/1337303412 >> [v2:172.21.15.6:6833/1713670870,v1:172.21.15.6:6835/1713670870] conn(0x55d22861ab80 0x55d22861af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.622+0000 7f6301ffb700 10 client.10365 ms_handle_connect on v2:172.21.15.6:6833/1713670870 2023-10-06T02:29:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.622+0000 7f63237fe700 1 --2- 172.21.15.6:0/1337303412 >> [v2:172.21.15.6:6833/1713670870,v1:172.21.15.6:6835/1713670870] conn(0x55d22861ab80 0x55d22861af50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5012d6f8c977784 server_cookie=2142eb125ba2ce9e in_seq=0 out_seq=0 2023-10-06T02:29:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.623+0000 7f6301ffb700 1 -- 172.21.15.6:0/1337303412 <== mds.0 v2:172.21.15.6:6833/1713670870 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d2285c2870 con 0x55d22861ab80 2023-10-06T02:29:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.623+0000 7f6301ffb700 10 client.10365 handle_command_reply: tid=0 2023-10-06T02:29:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.623+0000 7f6332f54b80 1 client.10365 shutdown 2023-10-06T02:29:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.623+0000 7f6332f54b80 1 -- 172.21.15.6:0/1337303412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2285f3a10 msgr2=0x55d22863afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.623+0000 7f6332f54b80 1 --2- 172.21.15.6:0/1337303412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2285f3a10 0x55d22863afe0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7f63180554c0 tx=0x7f631806e000 comp rx=0 tx=0).stop 2023-10-06T02:29:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.623+0000 7f6332f54b80 1 -- 172.21.15.6:0/1337303412 shutdown_connections 2023-10-06T02:29:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.623+0000 7f6332f54b80 1 --2- 172.21.15.6:0/1337303412 >> [v2:172.21.15.6:6833/1713670870,v1:172.21.15.6:6835/1713670870] conn(0x55d22861ab80 0x55d22861af50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.623+0000 7f6332f54b80 1 --2- 172.21.15.6:0/1337303412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d228611e50 0x55d22863b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.623+0000 7f6332f54b80 1 --2- 172.21.15.6:0/1337303412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f22c0 0x55d22860ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.623+0000 7f6332f54b80 1 --2- 172.21.15.6:0/1337303412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2285f3a10 0x55d22863afe0 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.623+0000 7f6301ffb700 0 client.10365 ms_handle_reset on v2:172.21.15.6:6833/1713670870 2023-10-06T02:29:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.623+0000 7f6332f54b80 1 -- 172.21.15.6:0/1337303412 >> 172.21.15.6:0/1337303412 conn(0x55d2285f1e80 msgr2=0x55d2285f0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.623+0000 7f6332f54b80 1 -- 172.21.15.6:0/1337303412 shutdown_connections 2023-10-06T02:29:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.623+0000 7f6332f54b80 1 -- 172.21.15.6:0/1337303412 wait complete. 2023-10-06T02:29:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.623+0000 7f6332f54b80 20 client.10365 trim_cache size 0 max 16384 2023-10-06T02:29:04.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.640+0000 7f6332f54b80 1 Processor -- start 2023-10-06T02:29:04.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.640+0000 7f6332f54b80 1 -- start start 2023-10-06T02:29:04.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.641+0000 7f6332f54b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f22c0 0x55d2286110e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.641+0000 7f6332f54b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2285f3a10 0x55d2285e7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.641+0000 7f6332f54b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d228611e50 0x55d228649520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.641+0000 7f6332f54b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d228620c50 con 0x55d228611e50 2023-10-06T02:29:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.641+0000 7f6332f54b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2285f4220 con 0x55d2285f22c0 2023-10-06T02:29:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.641+0000 7f6332f54b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d22860ae60 con 0x55d2285f3a10 2023-10-06T02:29:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.641+0000 7f6323fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d228611e50 0x55d228649520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.641+0000 7f6323fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d228611e50 0x55d228649520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53680/0 (socket says 172.21.15.6:53680) 2023-10-06T02:29:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.641+0000 7f6323fff700 1 -- 172.21.15.6:0/2116488210 learned_addr learned my addr 172.21.15.6:0/2116488210 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.641+0000 7f6323fff700 1 -- 172.21.15.6:0/2116488210 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2285f3a10 msgr2=0x55d2285e7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.641+0000 7f6323fff700 1 --2- 172.21.15.6:0/2116488210 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2285f3a10 0x55d2285e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.641+0000 7f6323fff700 1 -- 172.21.15.6:0/2116488210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f22c0 msgr2=0x55d2286110e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:04.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.641+0000 7f6323fff700 1 --2- 172.21.15.6:0/2116488210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f22c0 0x55d2286110e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.641+0000 7f6323fff700 1 -- 172.21.15.6:0/2116488210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d22850f780 con 0x55d228611e50 2023-10-06T02:29:04.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.641+0000 7f6323fff700 1 --2- 172.21.15.6:0/2116488210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d228611e50 0x55d228649520 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f631c013000 tx=0x7f631c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8332d584f02e3c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:04.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.642+0000 7f63097fa700 1 -- 172.21.15.6:0/2116488210 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c023070 con 0x55d228611e50 2023-10-06T02:29:04.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.642+0000 7f63097fa700 1 -- 172.21.15.6:0/2116488210 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c00bed0 con 0x55d228611e50 2023-10-06T02:29:04.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.642+0000 7f63097fa700 1 -- 172.21.15.6:0/2116488210 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c0129d0 con 0x55d228611e50 2023-10-06T02:29:04.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.642+0000 7f6332f54b80 1 -- 172.21.15.6:0/2116488210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d228611e50 msgr2=0x55d228649520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.642+0000 7f6332f54b80 1 --2- 172.21.15.6:0/2116488210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d228611e50 0x55d228649520 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f631c013000 tx=0x7f631c019000 comp rx=0 tx=0).stop 2023-10-06T02:29:04.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.642+0000 7f6332f54b80 1 -- 172.21.15.6:0/2116488210 shutdown_connections 2023-10-06T02:29:04.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.642+0000 7f6332f54b80 1 --2- 172.21.15.6:0/2116488210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d228611e50 0x55d228649520 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.642+0000 7f6332f54b80 1 --2- 172.21.15.6:0/2116488210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f22c0 0x55d2286110e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.642+0000 7f6332f54b80 1 --2- 172.21.15.6:0/2116488210 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2285f3a10 0x55d2285e7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.642+0000 7f6332f54b80 1 -- 172.21.15.6:0/2116488210 >> 172.21.15.6:0/2116488210 conn(0x55d2285f1e80 msgr2=0x55d22860c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:04.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.642+0000 7f6332f54b80 1 -- 172.21.15.6:0/2116488210 shutdown_connections 2023-10-06T02:29:04.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.642+0000 7f6332f54b80 1 -- 172.21.15.6:0/2116488210 wait complete. 2023-10-06T02:29:04.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.643+0000 7f6332f54b80 1 -- start start 2023-10-06T02:29:04.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.643+0000 7f6332f54b80 1 Processor -- start 2023-10-06T02:29:04.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.643+0000 7f6332f54b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f22c0 0x55d22860fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.643+0000 7f6332f54b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2285f3a10 0x55d2286101d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.643+0000 7f6332f54b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d228611e50 0x55d228650380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.643+0000 7f6332f54b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d22869d8d0 con 0x55d228611e50 2023-10-06T02:29:04.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.643+0000 7f6332f54b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2285f1450 con 0x55d2285f22c0 2023-10-06T02:29:04.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.643+0000 7f6332f54b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2285f0840 con 0x55d2285f3a10 2023-10-06T02:29:04.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6332f54b80 10 client.0 _ll_register_callbacks cb 0x55d2285b4020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:29:04.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6323fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d228611e50 0x55d228650380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6323fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d228611e50 0x55d228650380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53690/0 (socket says 172.21.15.6:53690) 2023-10-06T02:29:04.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6323fff700 1 -- 172.21.15.6:0/1132541228 learned_addr learned my addr 172.21.15.6:0/1132541228 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:04.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f63237fe700 1 --2- 172.21.15.6:0/1132541228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f22c0 0x55d22860fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6322ffd700 1 --2- 172.21.15.6:0/1132541228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2285f3a10 0x55d2286101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6323fff700 1 -- 172.21.15.6:0/1132541228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2285f3a10 msgr2=0x55d2286101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:04.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6323fff700 1 --2- 172.21.15.6:0/1132541228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2285f3a10 0x55d2286101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6323fff700 1 -- 172.21.15.6:0/1132541228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f22c0 msgr2=0x55d22860fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:04.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6323fff700 1 --2- 172.21.15.6:0/1132541228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f22c0 0x55d22860fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6323fff700 1 -- 172.21.15.6:0/1132541228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632415b540 con 0x55d228611e50 2023-10-06T02:29:04.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6323fff700 1 --2- 172.21.15.6:0/1132541228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d228611e50 0x55d228650380 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f631c0099f0 tx=0x7f631c023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a5b13f73997949 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:04.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6301ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:29:04.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6301ffb700 1 -- 172.21.15.6:0/1132541228 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c01eb90 con 0x55d228611e50 2023-10-06T02:29:04.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6301ffb700 1 -- 172.21.15.6:0/1132541228 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 9302+0+0 (secure 0 0 0) 0x7f631c01ecf0 con 0x55d228611e50 2023-10-06T02:29:04.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6332f54b80 1 -- 172.21.15.6:0/1132541228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6318058a10 con 0x55d228611e50 2023-10-06T02:29:04.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6301ffb700 1 -- 172.21.15.6:0/1132541228 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=312) v2 ==== 24+0+0 (secure 0 0 0) 0x7f631c027620 con 0x55d228611e50 2023-10-06T02:29:04.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6332f54b80 10 client.10371 fetch_fsmap learned FSMap version 312 2023-10-06T02:29:04.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6332f54b80 1 -- 172.21.15.6:0/1132541228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=312,monmap=2+}) v3 -- 0x55d2284f6470 con 0x55d228611e50 2023-10-06T02:29:04.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.644+0000 7f6301ffb700 1 -- 172.21.15.6:0/1132541228 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6318058a10 con 0x55d228611e50 2023-10-06T02:29:04.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6301ffb700 1 -- 172.21.15.6:0/1132541228 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 312) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f631c027780 con 0x55d228611e50 2023-10-06T02:29:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6332f54b80 10 client.10371 fetch_fsmap finished waiting for FSMap version 312 2023-10-06T02:29:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6332f54b80 10 client.10371 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:29:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6332f54b80 20 client.10371 populate_metadata read hostname 'smithi006' 2023-10-06T02:29:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6332f54b80 1 --2- 172.21.15.6:0/1132541228 >> [v2:172.21.15.6:6833/1713670870,v1:172.21.15.6:6835/1713670870] conn(0x55d2286508c0 0x55d228650c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6332f54b80 4 client.10371 mds_command: new command op to 10308 tid=0[{"prefix": "status"}] 2023-10-06T02:29:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6332f54b80 1 -- 172.21.15.6:0/1132541228 --> [v2:172.21.15.6:6833/1713670870,v1:172.21.15.6:6835/1713670870] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d2284e3e00 con 0x55d2286508c0 2023-10-06T02:29:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f63237fe700 1 --2- 172.21.15.6:0/1132541228 >> [v2:172.21.15.6:6833/1713670870,v1:172.21.15.6:6835/1713670870] conn(0x55d2286508c0 0x55d228650c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6301ffb700 10 client.10371 ms_handle_connect on v2:172.21.15.6:6833/1713670870 2023-10-06T02:29:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f63237fe700 1 --2- 172.21.15.6:0/1132541228 >> [v2:172.21.15.6:6833/1713670870,v1:172.21.15.6:6835/1713670870] conn(0x55d2286508c0 0x55d228650c90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a59c421ed527149 server_cookie=eb60f1f8a5dbdee8 in_seq=0 out_seq=0 2023-10-06T02:29:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6301ffb700 1 -- 172.21.15.6:0/1132541228 <== mds.0 v2:172.21.15.6:6833/1713670870 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x55d2284e3e00 con 0x55d2286508c0 2023-10-06T02:29:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6301ffb700 10 client.10371 handle_command_reply: tid=0 2023-10-06T02:29:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6332f54b80 1 client.10371 shutdown 2023-10-06T02:29:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6332f54b80 1 -- 172.21.15.6:0/1132541228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d228611e50 msgr2=0x55d228650380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6332f54b80 1 --2- 172.21.15.6:0/1132541228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d228611e50 0x55d228650380 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f631c0099f0 tx=0x7f631c023000 comp rx=0 tx=0).stop 2023-10-06T02:29:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6332f54b80 1 -- 172.21.15.6:0/1132541228 shutdown_connections 2023-10-06T02:29:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6332f54b80 1 --2- 172.21.15.6:0/1132541228 >> [v2:172.21.15.6:6833/1713670870,v1:172.21.15.6:6835/1713670870] conn(0x55d2286508c0 0x55d228650c90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6332f54b80 1 --2- 172.21.15.6:0/1132541228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d228611e50 0x55d228650380 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6301ffb700 0 client.10371 ms_handle_reset on v2:172.21.15.6:6833/1713670870 2023-10-06T02:29:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6332f54b80 1 --2- 172.21.15.6:0/1132541228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2285f22c0 0x55d22860fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6332f54b80 1 --2- 172.21.15.6:0/1132541228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d2285f3a10 0x55d2286101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6332f54b80 1 -- 172.21.15.6:0/1132541228 >> 172.21.15.6:0/1132541228 conn(0x55d2285f1e80 msgr2=0x55d228620410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6332f54b80 1 -- 172.21.15.6:0/1132541228 shutdown_connections 2023-10-06T02:29:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.645+0000 7f6332f54b80 1 -- 172.21.15.6:0/1132541228 wait complete. 2023-10-06T02:29:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.646+0000 7f6332f54b80 20 client.10371 trim_cache size 0 max 16384 2023-10-06T02:29:04.653 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:29:04.653 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:29:04.653 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:29:04.653 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 10308, 2023-10-06T02:29:04.653 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:29:04.653 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:29:04.653 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:29:04.653 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 6.779650245, 2023-10-06T02:29:04.653 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 312, 2023-10-06T02:29:04.653 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 129, 2023-10-06T02:29:04.653 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 129, 2023-10-06T02:29:04.653 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 9.0180523170000004 2023-10-06T02:29:04.654 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:29:04.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.646+0000 7f63289fa700 1 -- 172.21.15.6:0/1051487724 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6310066f30 msgr2=0x7f63100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.646+0000 7f63289fa700 1 --2- 172.21.15.6:0/1051487724 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6310066f30 0x7f63100693e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f63140011e0 tx=0x7f63140079d0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.646+0000 7f63289fa700 1 -- 172.21.15.6:0/1051487724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6324153a10 msgr2=0x7f6324169a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.646+0000 7f63289fa700 1 --2- 172.21.15.6:0/1051487724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6324153a10 0x7f6324169a40 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f631800ecb0 tx=0x7f63180091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.646+0000 7f63289fa700 1 -- 172.21.15.6:0/1051487724 shutdown_connections 2023-10-06T02:29:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.646+0000 7f63289fa700 1 --2- 172.21.15.6:0/1051487724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f632415abe0 0x7f63241556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.646+0000 7f63289fa700 1 --2- 172.21.15.6:0/1051487724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63240cfe90 0x7f6324158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.646+0000 7f63289fa700 1 --2- 172.21.15.6:0/1051487724 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6310066f30 0x7f63100693e0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.646+0000 7f63289fa700 1 --2- 172.21.15.6:0/1051487724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6324153a10 0x7f6324169a40 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.646+0000 7f63289fa700 1 -- 172.21.15.6:0/1051487724 >> 172.21.15.6:0/1051487724 conn(0x7f632406ac00 msgr2=0x7f6324151ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.646+0000 7f63289fa700 1 -- 172.21.15.6:0/1051487724 shutdown_connections 2023-10-06T02:29:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.646+0000 7f63289fa700 1 -- 172.21.15.6:0/1051487724 wait complete. 2023-10-06T02:29:04.658 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:29:04.658 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Corrupt omap header on 10000000000.00000000', proceeding to ls 2023-10-06T02:29:04.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:29:04.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.776+0000 7fec6f59e700 1 Processor -- start 2023-10-06T02:29:04.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.776+0000 7fec6f59e700 1 -- start start 2023-10-06T02:29:04.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.777+0000 7fec6f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec700d0530 0x7fec700b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.777+0000 7fec6f59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fec70068d90 0x7fec7015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.777+0000 7fec6f59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec700ce640 con 0x7fec7015c900 2023-10-06T02:29:04.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.777+0000 7fec6f59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7015a440 con 0x7fec70068d90 2023-10-06T02:29:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.777+0000 7fec6f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7015a9c0 con 0x7fec700d0530 2023-10-06T02:29:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.777+0000 7fec6ed9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fec70068d90 0x7fec7015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.777+0000 7fec6ed9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fec70068d90 0x7fec7015abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53702/0 (socket says 172.21.15.6:53702) 2023-10-06T02:29:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.777+0000 7fec6ed9d700 1 -- 172.21.15.6:0/3790415502 learned_addr learned my addr 172.21.15.6:0/3790415502 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.777+0000 7fec6dd9b700 1 --2- 172.21.15.6:0/3790415502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec700d0530 0x7fec700b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.777+0000 7fec6ed9d700 1 -- 172.21.15.6:0/3790415502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec700d0530 msgr2=0x7fec700b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.777+0000 7fec6ed9d700 1 --2- 172.21.15.6:0/3790415502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec700d0530 0x7fec700b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.777+0000 7fec6ed9d700 1 -- 172.21.15.6:0/3790415502 >> v1:172.21.15.175:6789/0 conn(0x7fec7015c900 legacy=0x7fec700cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.777+0000 7fec6ed9d700 1 -- 172.21.15.6:0/3790415502 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec700cccf0 con 0x7fec70068d90 2023-10-06T02:29:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.778+0000 7fec6ed9d700 1 --2- 172.21.15.6:0/3790415502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec70068d90 0x7fec7015abe0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7fec68009f20 tx=0x7fec68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25077ee60a1b09c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.778+0000 7fec6d59a700 1 -- 172.21.15.6:0/3790415502 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6800e070 con 0x7fec70068d90 2023-10-06T02:29:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.778+0000 7fec6d59a700 1 -- 172.21.15.6:0/3790415502 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6800ba80 con 0x7fec70068d90 2023-10-06T02:29:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.778+0000 7fec6d59a700 1 -- 172.21.15.6:0/3790415502 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec680092e0 con 0x7fec70068d90 2023-10-06T02:29:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.778+0000 7fec6f59e700 1 -- 172.21.15.6:0/3790415502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec70068d90 msgr2=0x7fec7015abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.778+0000 7fec6f59e700 1 --2- 172.21.15.6:0/3790415502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec70068d90 0x7fec7015abe0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7fec68009f20 tx=0x7fec68009840 comp rx=0 tx=0).stop 2023-10-06T02:29:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.778+0000 7fec6f59e700 1 -- 172.21.15.6:0/3790415502 shutdown_connections 2023-10-06T02:29:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.778+0000 7fec6f59e700 1 --2- 172.21.15.6:0/3790415502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec70068d90 0x7fec7015abe0 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.778+0000 7fec6f59e700 1 --2- 172.21.15.6:0/3790415502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec700d0530 0x7fec700b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.778+0000 7fec6f59e700 1 -- 172.21.15.6:0/3790415502 >> 172.21.15.6:0/3790415502 conn(0x7fec7006ac00 msgr2=0x7fec70068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.778+0000 7fec6f59e700 1 -- 172.21.15.6:0/3790415502 shutdown_connections 2023-10-06T02:29:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.778+0000 7fec6f59e700 1 -- 172.21.15.6:0/3790415502 wait complete. 2023-10-06T02:29:04.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.779+0000 7fec6f59e700 1 Processor -- start 2023-10-06T02:29:04.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.779+0000 7fec6f59e700 1 -- start start 2023-10-06T02:29:04.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.780+0000 7fec6f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec70068d90 0x7fec70145320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.780+0000 7fec6f59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec700d0530 0x7fec700c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.780+0000 7fec6f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec7015c900 0x7fec70145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.780+0000 7fec6f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec700c91b0 con 0x7fec70068d90 2023-10-06T02:29:04.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.780+0000 7fec6f59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec700c85a0 con 0x7fec700d0530 2023-10-06T02:29:04.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.780+0000 7fec6f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec700c8880 con 0x7fec7015c900 2023-10-06T02:29:04.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.780+0000 7fec6e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec70068d90 0x7fec70145320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.780+0000 7fec6e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec70068d90 0x7fec70145320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53718/0 (socket says 172.21.15.6:53718) 2023-10-06T02:29:04.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.780+0000 7fec6e59c700 1 -- 172.21.15.6:0/3429351077 learned_addr learned my addr 172.21.15.6:0/3429351077 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:04.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.781+0000 7fec6ed9d700 1 --2- 172.21.15.6:0/3429351077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec7015c900 0x7fec70145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.781+0000 7fec6e59c700 1 -- 172.21.15.6:0/3429351077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec7015c900 msgr2=0x7fec70145ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.781+0000 7fec6dd9b700 1 --2- 172.21.15.6:0/3429351077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec700d0530 0x7fec700c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.781+0000 7fec6e59c700 1 --2- 172.21.15.6:0/3429351077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec7015c900 0x7fec70145ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.781+0000 7fec6e59c700 1 -- 172.21.15.6:0/3429351077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec700d0530 msgr2=0x7fec700c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:04.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.781+0000 7fec6e59c700 1 --2- 172.21.15.6:0/3429351077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec700d0530 0x7fec700c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:04.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.781+0000 7fec6e59c700 1 -- 172.21.15.6:0/3429351077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec68009ae0 con 0x7fec70068d90 2023-10-06T02:29:04.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.781+0000 7fec6ed9d700 1 --2- 172.21.15.6:0/3429351077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec7015c900 0x7fec70145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:04.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.781+0000 7fec6e59c700 1 --2- 172.21.15.6:0/3429351077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec70068d90 0x7fec70145320 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fec6000c4e0 tx=0x7fec6000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:04.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.781+0000 7fec5e7fc700 1 -- 172.21.15.6:0/3429351077 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60011590 con 0x7fec70068d90 2023-10-06T02:29:04.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.781+0000 7fec5e7fc700 1 -- 172.21.15.6:0/3429351077 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec60011710 con 0x7fec70068d90 2023-10-06T02:29:04.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.781+0000 7fec6f59e700 1 -- 172.21.15.6:0/3429351077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec700c8b60 con 0x7fec70068d90 2023-10-06T02:29:04.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.781+0000 7fec5e7fc700 1 -- 172.21.15.6:0/3429351077 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60011ad0 con 0x7fec70068d90 2023-10-06T02:29:04.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.781+0000 7fec6f59e700 1 -- 172.21.15.6:0/3429351077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec70145860 con 0x7fec70068d90 2023-10-06T02:29:04.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.782+0000 7fec6f59e700 1 -- 172.21.15.6:0/3429351077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec70145a50 con 0x7fec70068d90 2023-10-06T02:29:04.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.782+0000 7fec5e7fc700 1 -- 172.21.15.6:0/3429351077 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec6001b3b0 con 0x7fec70068d90 2023-10-06T02:29:04.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.783+0000 7fec5e7fc700 1 --2- 172.21.15.6:0/3429351077 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec50066f30 0x7fec500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:04.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.783+0000 7fec5e7fc700 1 -- 172.21.15.6:0/3429351077 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 9302+0+0 (secure 0 0 0) 0x7fec600848c0 con 0x7fec70068d90 2023-10-06T02:29:04.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.783+0000 7fec6dd9b700 1 --2- 172.21.15.6:0/3429351077 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec50066f30 0x7fec500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:04.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.783+0000 7fec6dd9b700 1 --2- 172.21.15.6:0/3429351077 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec50066f30 0x7fec500693e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fec64006fd0 tx=0x7fec64008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:04.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:04.787+0000 7fec5e7fc700 1 -- 172.21.15.6:0/3429351077 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec60050ce0 con 0x7fec70068d90 2023-10-06T02:29:05.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:05.028+0000 7fec6f59e700 1 -- 172.21.15.6:0/3429351077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fec70069550 con 0x7fec70068d90 2023-10-06T02:29:05.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:05.028+0000 7fec5e7fc700 1 -- 172.21.15.6:0/3429351077 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v312) v1 ==== 53+0+73 (secure 0 0 0) 0x7fec60017030 con 0x7fec70068d90 2023-10-06T02:29:05.029 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:29:05.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:05.030+0000 7fec6f59e700 1 -- 172.21.15.6:0/3429351077 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec50066f30 msgr2=0x7fec500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:05.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:05.030+0000 7fec6f59e700 1 --2- 172.21.15.6:0/3429351077 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec50066f30 0x7fec500693e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fec64006fd0 tx=0x7fec64008040 comp rx=0 tx=0).stop 2023-10-06T02:29:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:05.030+0000 7fec6f59e700 1 -- 172.21.15.6:0/3429351077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec70068d90 msgr2=0x7fec70145320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:05.030+0000 7fec6f59e700 1 --2- 172.21.15.6:0/3429351077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec70068d90 0x7fec70145320 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fec6000c4e0 tx=0x7fec6000c8a0 comp rx=0 tx=0).stop 2023-10-06T02:29:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:05.030+0000 7fec6f59e700 1 -- 172.21.15.6:0/3429351077 shutdown_connections 2023-10-06T02:29:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:05.030+0000 7fec6f59e700 1 --2- 172.21.15.6:0/3429351077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec7015c900 0x7fec70145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:05.030+0000 7fec6f59e700 1 --2- 172.21.15.6:0/3429351077 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec50066f30 0x7fec500693e0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:05.030+0000 7fec6f59e700 1 --2- 172.21.15.6:0/3429351077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec70068d90 0x7fec70145320 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:05.030+0000 7fec6f59e700 1 --2- 172.21.15.6:0/3429351077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec700d0530 0x7fec700c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:05.030+0000 7fec6f59e700 1 -- 172.21.15.6:0/3429351077 >> 172.21.15.6:0/3429351077 conn(0x7fec7006ac00 msgr2=0x7fec700b5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:05.030+0000 7fec6f59e700 1 -- 172.21.15.6:0/3429351077 shutdown_connections 2023-10-06T02:29:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:05.030+0000 7fec6f59e700 1 -- 172.21.15.6:0/3429351077 wait complete. 2023-10-06T02:29:05.043 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:29:05.043 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:29:05.043 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:29:05.043 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:29:05.043 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:29:05.043 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:29:05.043 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:29:05.043 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:29:05.043 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:29:05.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:05.044 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:29:05.059 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:29:05.060 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:29:05.060 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:29:05.060 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:29:05.060 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:29:05.060 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:29:05.060 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:29:05.060 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:29:05.060 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:29:05.060 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:29:05.060 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:29:05.060 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:29:05.061 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:29:05.061 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:29:05.061 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:29:05.061 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:29:05.061 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41801sec preferred_lft 41801sec 2023-10-06T02:29:05.061 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:29:05.061 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:29:05.061 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:29:05.061 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:29:05.061 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:29:05.061 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:29:05.061 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:29:05.061 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:29:05.062 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:29:05.062 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:29:05.062 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:29:05.062 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:29:05.062 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:29:05.062 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:29:05.062 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:29:05.062 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:29:05.062 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:29:05.062 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:29:05.062 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:29:05.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:05.063 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:29:05.123 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:29:05.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:05.124 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:29:05.180 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:29:05.180 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:29:05.181 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:29:05.181 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:29:05.181 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:29:05.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:05.181 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:29:05.181 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:29:05.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:29:05.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:29:05.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:29:05.181 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:29:05.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:05.283 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:29:05.297 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:29:05.298 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:29:05.298 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:29:05.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:05.298 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:29:05.363 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:29:05.363 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:29:05.363 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:29:05.418 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:29:05.419 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:29:05.419 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:29:05.473 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:29:05.539 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:29:05.539 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:29:05.604 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:29:05.605 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:29:05.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:29:05.605 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:29:05.660 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:29:05.660 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:29:05.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:29:05.728 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:29:05.728 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:29:05.786 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:29:05.785+0000 7fdbf759b540 -1 init, newargv = 0x5620df955ae0 newargc=15 2023-10-06T02:29:05.786 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[141354]: starting ceph client 2023-10-06T02:29:05.791 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[141354]: starting fuse 2023-10-06T02:29:05.794 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:29:05.796 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:29:05.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:29:05.797 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:29:05.851 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:29:05.852 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:29:05.852 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:29:05.852 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:29:05.852 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:29:05.852 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:29:05.852 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:29:05.852 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:29:05.852 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:29:05.852 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:29:05.852 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:29:05.852 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:29:05.853 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:29:05.853 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:29:05.853 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:29:05.853 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:29:05.853 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:29:05.853 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:29:05.853 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:29:05.853 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:29:05.853 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:29:05.853 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:29:05.853 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:29:05.853 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:29:05.853 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:29:05.854 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:29:05.854 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:29:05.854 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:29:05.854 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:29:05.975 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.141354.asok 2023-10-06T02:29:06.156 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.141354.asok 2023-10-06T02:29:06.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:29:06.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.141354.asok status 2023-10-06T02:29:06.312 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:29:06.312 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:29:06.312 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:29:06.312 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:29:06.312 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:29:06.312 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:29:06.312 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:29:06.312 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "141354", 2023-10-06T02:29:06.313 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:29:06.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:29:06.313 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:29:06.313 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:29:06.313 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 10383, 2023-10-06T02:29:06.313 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:29:06.313 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:29:06.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:29:06.313 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 10383 2023-10-06T02:29:06.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:29:06.313 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:29:06.314 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:29:06.314 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:29:06.314 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4069564767 2023-10-06T02:29:06.314 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:29:06.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:29:06.314 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:29:06.314 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:29:06.314 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:29:06.314 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4069564767 2023-10-06T02:29:06.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:29:06.314 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.10383 192.168.0.1:0/4069564767", 2023-10-06T02:29:06.315 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/4069564767", 2023-10-06T02:29:06.315 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:29:06.315 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 312, 2023-10-06T02:29:06.315 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 129, 2023-10-06T02:29:06.315 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:29:06.315 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:29:06.315 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:29:06.315 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:29:06.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:29:06.322 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:29:06.322 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:29:06.337 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:29:06.338 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:29:06.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:29:06.338 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:29:06.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:29:06.403 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2023-10-06T02:29:06.445 INFO:teuthology.orchestra.run:waiting for 20 2023-10-06T02:29:06.461 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:29:06.460+0000 7f2070eb1700 -1 mds.0.cache.dir(0x10000000000) Corrupt fnode in dirfrag 0x10000000000: void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&) no longer understand old encoding version 3 < 101: Malformed input 2023-10-06T02:29:06.462 INFO:teuthology.orchestra.run.smithi006.stdout:.: 2023-10-06T02:29:06.462 INFO:teuthology.orchestra.run.smithi006.stdout:subdir 2023-10-06T02:29:06.462 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:06.462 INFO:teuthology.orchestra.run.smithi006.stdout:./subdir: 2023-10-06T02:29:06.462 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on 10000000000.00000000' did not caused DAMAGED state 2023-10-06T02:29:06.462 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on 600.00000000' 2023-10-06T02:29:06.462 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:29:06.463 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:29:06.463 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:29:06.539 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:29:06.539 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:29:06.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:06.539 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:29:06.594 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:29:06.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.753+0000 7f9dcdea0700 1 Processor -- start 2023-10-06T02:29:06.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.753+0000 7f9dcdea0700 1 -- start start 2023-10-06T02:29:06.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.754+0000 7f9dcdea0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9dc80cd750 0x7f9dc81642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:06.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.754+0000 7f9dcdea0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc806a1a0 con 0x7f9dc806a910 2023-10-06T02:29:06.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.754+0000 7f9dcdea0700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc806a480 con 0x7f9dc815cae0 2023-10-06T02:29:06.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.754+0000 7f9dcdea0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc80cdbd0 con 0x7f9dc80cd750 2023-10-06T02:29:06.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.754+0000 7f9dc7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9dc80cd750 0x7f9dc81642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:06.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.754+0000 7f9dc6ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9dc806a910 0x7f9dc806ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40320/0 (socket says 172.21.15.6:40320) 2023-10-06T02:29:06.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.754+0000 7f9dc7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9dc80cd750 0x7f9dc81642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53724/0 (socket says 172.21.15.6:53724) 2023-10-06T02:29:06.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.754+0000 7f9dc6ffd700 1 -- 172.21.15.6:0/3605136318 learned_addr learned my addr 172.21.15.6:0/3605136318 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:06.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.755+0000 7f9dc7fff700 1 -- 172.21.15.6:0/3605136318 >> v1:172.21.15.175:6789/0 conn(0x7f9dc815cae0 legacy=0x7f9dc80c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:06.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.755+0000 7f9dc7fff700 1 -- 172.21.15.6:0/3605136318 >> v1:172.21.15.6:6789/0 conn(0x7f9dc806a910 legacy=0x7f9dc806ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:06.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.755+0000 7f9dc7fff700 1 -- 172.21.15.6:0/3605136318 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc80c8e40 con 0x7f9dc80cd750 2023-10-06T02:29:06.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.755+0000 7f9dc67fc700 1 -- 172.21.15.6:0/3605136318 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115283700 0 0) 0x7f9dc806a1a0 con 0x7f9dc806a910 2023-10-06T02:29:06.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.755+0000 7f9dc7fff700 1 --2- 172.21.15.6:0/3605136318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc80cd750 0x7f9dc81642c0 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009e60 tx=0x7f9dc0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2cf0b8b82c46d04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:06.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.755+0000 7f9dc67fc700 1 -- 172.21.15.6:0/3605136318 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc000e070 con 0x7f9dc80cd750 2023-10-06T02:29:06.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.755+0000 7f9dc67fc700 1 -- 172.21.15.6:0/3605136318 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc000bc30 con 0x7f9dc80cd750 2023-10-06T02:29:06.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.755+0000 7f9dc67fc700 1 -- 172.21.15.6:0/3605136318 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0012430 con 0x7f9dc80cd750 2023-10-06T02:29:06.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.756+0000 7f9dcdea0700 1 -- 172.21.15.6:0/3605136318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc80cd750 msgr2=0x7f9dc81642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:06.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.756+0000 7f9dcdea0700 1 --2- 172.21.15.6:0/3605136318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc80cd750 0x7f9dc81642c0 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009e60 tx=0x7f9dc0009780 comp rx=0 tx=0).stop 2023-10-06T02:29:06.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.756+0000 7f9dcdea0700 1 -- 172.21.15.6:0/3605136318 shutdown_connections 2023-10-06T02:29:06.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.756+0000 7f9dcdea0700 1 --2- 172.21.15.6:0/3605136318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc80cd750 0x7f9dc81642c0 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:06.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.756+0000 7f9dcdea0700 1 -- 172.21.15.6:0/3605136318 >> 172.21.15.6:0/3605136318 conn(0x7f9dc8067910 msgr2=0x7f9dc80ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:06.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.756+0000 7f9dcdea0700 1 -- 172.21.15.6:0/3605136318 shutdown_connections 2023-10-06T02:29:06.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.756+0000 7f9dcdea0700 1 -- 172.21.15.6:0/3605136318 wait complete. 2023-10-06T02:29:06.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.757+0000 7f9dcdea0700 1 Processor -- start 2023-10-06T02:29:06.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.757+0000 7f9dcdea0700 1 -- start start 2023-10-06T02:29:06.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dcdea0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dc806a910 0x7f9dc80c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:06.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dcdea0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc80cd750 0x7f9dc80cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dcdea0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc815cae0 0x7f9dc814efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dcdea0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc80c9fd0 con 0x7f9dc815cae0 2023-10-06T02:29:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dcdea0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc80c5940 con 0x7f9dc806a910 2023-10-06T02:29:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dcdea0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc80c5be0 con 0x7f9dc80cd750 2023-10-06T02:29:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dc7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc815cae0 0x7f9dc814efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dc7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc815cae0 0x7f9dc814efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53726/0 (socket says 172.21.15.6:53726) 2023-10-06T02:29:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dc7fff700 1 -- 172.21.15.6:0/3978406312 learned_addr learned my addr 172.21.15.6:0/3978406312 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dc77fe700 1 --2- 172.21.15.6:0/3978406312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dc806a910 0x7f9dc80c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dc6ffd700 1 --2- 172.21.15.6:0/3978406312 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc80cd750 0x7f9dc80cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:06.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dc7fff700 1 -- 172.21.15.6:0/3978406312 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc80cd750 msgr2=0x7f9dc80cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:06.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dc7fff700 1 --2- 172.21.15.6:0/3978406312 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc80cd750 0x7f9dc80cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:06.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dc7fff700 1 -- 172.21.15.6:0/3978406312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dc806a910 msgr2=0x7f9dc80c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:06.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dc7fff700 1 --2- 172.21.15.6:0/3978406312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dc806a910 0x7f9dc80c9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:06.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dc7fff700 1 -- 172.21.15.6:0/3978406312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc0009a20 con 0x7f9dc815cae0 2023-10-06T02:29:06.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dc6ffd700 1 --2- 172.21.15.6:0/3978406312 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc80cd750 0x7f9dc80cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:06.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dc7fff700 1 --2- 172.21.15.6:0/3978406312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc815cae0 0x7f9dc814efe0 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0013000 tx=0x7f9dc0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:06.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9daf7fe700 1 -- 172.21.15.6:0/3978406312 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0012e60 con 0x7f9dc815cae0 2023-10-06T02:29:06.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9daf7fe700 1 -- 172.21.15.6:0/3978406312 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc001b630 con 0x7f9dc815cae0 2023-10-06T02:29:06.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9daf7fe700 1 -- 172.21.15.6:0/3978406312 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc001b9b0 con 0x7f9dc815cae0 2023-10-06T02:29:06.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.758+0000 7f9dcdea0700 1 -- 172.21.15.6:0/3978406312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc80c9730 con 0x7f9dc815cae0 2023-10-06T02:29:06.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.759+0000 7f9dcdea0700 1 -- 172.21.15.6:0/3978406312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc80c9cf0 con 0x7f9dc815cae0 2023-10-06T02:29:06.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.760+0000 7f9dcdea0700 1 -- 172.21.15.6:0/3978406312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc806e590 con 0x7f9dc815cae0 2023-10-06T02:29:06.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.760+0000 7f9daf7fe700 1 -- 172.21.15.6:0/3978406312 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9dc001bd20 con 0x7f9dc815cae0 2023-10-06T02:29:06.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.760+0000 7f9daf7fe700 1 --2- 172.21.15.6:0/3978406312 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9db4066f30 0x7f9db40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:06.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.760+0000 7f9daf7fe700 1 -- 172.21.15.6:0/3978406312 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 9302+0+0 (secure 0 0 0) 0x7f9dc00871b0 con 0x7f9dc815cae0 2023-10-06T02:29:06.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.761+0000 7f9dc77fe700 1 --2- 172.21.15.6:0/3978406312 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9db4066f30 0x7f9db40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:06.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.761+0000 7f9dc77fe700 1 --2- 172.21.15.6:0/3978406312 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9db4066f30 0x7f9db40693e0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f9dc816d0f0 tx=0x7f9db8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:06.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:06.765+0000 7f9daf7fe700 1 -- 172.21.15.6:0/3978406312 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9dc0053680 con 0x7f9dc815cae0 2023-10-06T02:29:07.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.006+0000 7f9dcdea0700 1 -- 172.21.15.6:0/3978406312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9dc8159d20 con 0x7f9dc815cae0 2023-10-06T02:29:07.007 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:29:07.007+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:29:07.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.013+0000 7f9daf7fe700 1 -- 172.21.15.6:0/3978406312 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v313) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9dc002a090 con 0x7f9dc815cae0 2023-10-06T02:29:07.015 INFO:tasks.ceph.mds.a.smithi006.stderr: -622> 2023-10-06T02:29:01.607+0000 7f20746b8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:29:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.015+0000 7f9dcdea0700 1 -- 172.21.15.6:0/3978406312 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9db4066f30 msgr2=0x7f9db40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.015+0000 7f9dcdea0700 1 --2- 172.21.15.6:0/3978406312 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9db4066f30 0x7f9db40693e0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f9dc816d0f0 tx=0x7f9db8009040 comp rx=0 tx=0).stop 2023-10-06T02:29:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.015+0000 7f9dcdea0700 1 -- 172.21.15.6:0/3978406312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc815cae0 msgr2=0x7f9dc814efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:07.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.015+0000 7f9dcdea0700 1 --2- 172.21.15.6:0/3978406312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc815cae0 0x7f9dc814efe0 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0013000 tx=0x7f9dc0019000 comp rx=0 tx=0).stop 2023-10-06T02:29:07.017 INFO:tasks.ceph.mds.a.smithi006.stderr: -91> 2023-10-06T02:29:06.460+0000 7f2070eb1700 -1 mds.0.cache.dir(0x10000000000) Corrupt fnode in dirfrag 0x10000000000: void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&) no longer understand old encoding version 3 < 101: Malformed input 2023-10-06T02:29:07.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.016+0000 7f9dcdea0700 1 -- 172.21.15.6:0/3978406312 shutdown_connections 2023-10-06T02:29:07.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.016+0000 7f9dcdea0700 1 --2- 172.21.15.6:0/3978406312 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9db4066f30 0x7f9db40693e0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:07.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.016+0000 7f9dcdea0700 1 --2- 172.21.15.6:0/3978406312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc815cae0 0x7f9dc814efe0 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:07.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.016+0000 7f9dcdea0700 1 --2- 172.21.15.6:0/3978406312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9dc806a910 0x7f9dc80c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:07.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.016+0000 7f9dcdea0700 1 --2- 172.21.15.6:0/3978406312 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9dc80cd750 0x7f9dc80cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:07.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.016+0000 7f9dcdea0700 1 -- 172.21.15.6:0/3978406312 >> 172.21.15.6:0/3978406312 conn(0x7f9dc8067910 msgr2=0x7f9dc815a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:07.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.016+0000 7f9dcdea0700 1 -- 172.21.15.6:0/3978406312 shutdown_connections 2023-10-06T02:29:07.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.016+0000 7f9dcdea0700 1 -- 172.21.15.6:0/3978406312 wait complete. 2023-10-06T02:29:07.018 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:29:07.029 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:29:07.036 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:29:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.149+0000 7fe81ba31700 1 Processor -- start 2023-10-06T02:29:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.149+0000 7fe81ba31700 1 -- start start 2023-10-06T02:29:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.150+0000 7fe81ba31700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe81406c460 0x7fe81415da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.150+0000 7fe81ba31700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe8140c7840 0x7fe814158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.150+0000 7fe81ba31700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8140c7cb0 con 0x7fe81406c830 2023-10-06T02:29:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.150+0000 7fe81ba31700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81415dfc0 con 0x7fe8140c7840 2023-10-06T02:29:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.150+0000 7fe81ba31700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8140c7f90 con 0x7fe81406c460 2023-10-06T02:29:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.150+0000 7fe818fcc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe8140c7840 0x7fe814158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.150+0000 7fe818fcc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe8140c7840 0x7fe814158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53770/0 (socket says 172.21.15.6:53770) 2023-10-06T02:29:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.150+0000 7fe818fcc700 1 -- 172.21.15.6:0/1630008281 learned_addr learned my addr 172.21.15.6:0/1630008281 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.150+0000 7fe8197cd700 1 --2- 172.21.15.6:0/1630008281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe81406c460 0x7fe81415da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.150+0000 7fe818fcc700 1 -- 172.21.15.6:0/1630008281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe81406c460 msgr2=0x7fe81415da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.150+0000 7fe818fcc700 1 --2- 172.21.15.6:0/1630008281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe81406c460 0x7fe81415da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.150+0000 7fe818fcc700 1 -- 172.21.15.6:0/1630008281 >> v1:172.21.15.175:6789/0 conn(0x7fe81406c830 legacy=0x7fe8141594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.150+0000 7fe818fcc700 1 -- 172.21.15.6:0/1630008281 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8140c8270 con 0x7fe8140c7840 2023-10-06T02:29:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.151+0000 7fe818fcc700 1 --2- 172.21.15.6:0/1630008281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8140c7840 0x7fe814158f60 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7fe8040099b0 tx=0x7fe804009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3cb7d2a79f7f27 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.151+0000 7fe80bfff700 1 -- 172.21.15.6:0/1630008281 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804009ea0 con 0x7fe8140c7840 2023-10-06T02:29:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.151+0000 7fe80bfff700 1 -- 172.21.15.6:0/1630008281 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80400b860 con 0x7fe8140c7840 2023-10-06T02:29:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.151+0000 7fe80bfff700 1 -- 172.21.15.6:0/1630008281 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80400bc00 con 0x7fe8140c7840 2023-10-06T02:29:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.151+0000 7fe81ba31700 1 -- 172.21.15.6:0/1630008281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8140c7840 msgr2=0x7fe814158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.151+0000 7fe81ba31700 1 --2- 172.21.15.6:0/1630008281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8140c7840 0x7fe814158f60 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7fe8040099b0 tx=0x7fe804009250 comp rx=0 tx=0).stop 2023-10-06T02:29:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.151+0000 7fe81ba31700 1 -- 172.21.15.6:0/1630008281 shutdown_connections 2023-10-06T02:29:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.151+0000 7fe81ba31700 1 --2- 172.21.15.6:0/1630008281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe81406c460 0x7fe81415da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.151+0000 7fe81ba31700 1 --2- 172.21.15.6:0/1630008281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8140c7840 0x7fe814158f60 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.151+0000 7fe81ba31700 1 -- 172.21.15.6:0/1630008281 >> 172.21.15.6:0/1630008281 conn(0x7fe8140c9cc0 msgr2=0x7fe81406acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.151+0000 7fe81ba31700 1 -- 172.21.15.6:0/1630008281 shutdown_connections 2023-10-06T02:29:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.151+0000 7fe81ba31700 1 -- 172.21.15.6:0/1630008281 wait complete. 2023-10-06T02:29:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.152+0000 7fe81ba31700 1 Processor -- start 2023-10-06T02:29:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.152+0000 7fe81ba31700 1 -- start start 2023-10-06T02:29:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.153+0000 7fe81ba31700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe81406c460 0x7fe8140b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.153+0000 7fe81ba31700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe81406c830 0x7fe81416d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.153+0000 7fe81ba31700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe8140c7840 0x7fe81416d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.153+0000 7fe81ba31700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8140b1450 con 0x7fe81406c460 2023-10-06T02:29:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.153+0000 7fe81ba31700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8140b0840 con 0x7fe81406c830 2023-10-06T02:29:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.153+0000 7fe81ba31700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8140b0b20 con 0x7fe8140c7840 2023-10-06T02:29:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.153+0000 7fe8197cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe81406c460 0x7fe8140b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.153+0000 7fe8197cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe81406c460 0x7fe8140b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53776/0 (socket says 172.21.15.6:53776) 2023-10-06T02:29:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.153+0000 7fe8197cd700 1 -- 172.21.15.6:0/3939272318 learned_addr learned my addr 172.21.15.6:0/3939272318 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.154+0000 7fe8197cd700 1 -- 172.21.15.6:0/3939272318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe8140c7840 msgr2=0x7fe81416d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.154+0000 7fe8197cd700 1 --2- 172.21.15.6:0/3939272318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe8140c7840 0x7fe81416d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.154+0000 7fe8197cd700 1 -- 172.21.15.6:0/3939272318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe81406c830 msgr2=0x7fe81416d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.154+0000 7fe8197cd700 1 --2- 172.21.15.6:0/3939272318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe81406c830 0x7fe81416d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.154+0000 7fe8197cd700 1 -- 172.21.15.6:0/3939272318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8040094f0 con 0x7fe81406c460 2023-10-06T02:29:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.154+0000 7fe8197cd700 1 --2- 172.21.15.6:0/3939272318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe81406c460 0x7fe8140b18e0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7fe81000ec80 tx=0x7fe8100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.154+0000 7fe8097fa700 1 -- 172.21.15.6:0/3939272318 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81000c9d0 con 0x7fe81406c460 2023-10-06T02:29:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.154+0000 7fe8097fa700 1 -- 172.21.15.6:0/3939272318 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81000cb30 con 0x7fe81406c460 2023-10-06T02:29:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.154+0000 7fe81ba31700 1 -- 172.21.15.6:0/3939272318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8140b0e00 con 0x7fe81406c460 2023-10-06T02:29:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.154+0000 7fe8097fa700 1 -- 172.21.15.6:0/3939272318 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe810013470 con 0x7fe81406c460 2023-10-06T02:29:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.154+0000 7fe81ba31700 1 -- 172.21.15.6:0/3939272318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8140b1e20 con 0x7fe81406c460 2023-10-06T02:29:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.155+0000 7fe81ba31700 1 -- 172.21.15.6:0/3939272318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8140b1730 con 0x7fe81406c460 2023-10-06T02:29:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.155+0000 7fe8097fa700 1 -- 172.21.15.6:0/3939272318 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe810013820 con 0x7fe81406c460 2023-10-06T02:29:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.156+0000 7fe8097fa700 1 --2- 172.21.15.6:0/3939272318 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7f8066f30 0x7fe7f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.156+0000 7fe8097fa700 1 -- 172.21.15.6:0/3939272318 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 9388+0+0 (secure 0 0 0) 0x7fe810085760 con 0x7fe81406c460 2023-10-06T02:29:07.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.156+0000 7fe818fcc700 1 --2- 172.21.15.6:0/3939272318 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7f8066f30 0x7fe7f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:07.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.157+0000 7fe818fcc700 1 --2- 172.21.15.6:0/3939272318 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7f8066f30 0x7fe7f80693e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fe8040099b0 tx=0x7fe804017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:07.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.160+0000 7fe8097fa700 1 -- 172.21.15.6:0/3939272318 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe810051b30 con 0x7fe81406c460 2023-10-06T02:29:07.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:07.436+0000 7fe81ba31700 1 -- 172.21.15.6:0/3939272318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fe8140c8550 con 0x7fe81406c460 2023-10-06T02:29:08.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.013+0000 7fe8097fa700 1 -- 172.21.15.6:0/3939272318 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v314) v1 ==== 107+0+0 (secure 0 0 0) 0x7fe810055150 con 0x7fe81406c460 2023-10-06T02:29:08.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.016+0000 7fe81ba31700 1 -- 172.21.15.6:0/3939272318 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7f8066f30 msgr2=0x7fe7f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.016+0000 7fe81ba31700 1 --2- 172.21.15.6:0/3939272318 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7f8066f30 0x7fe7f80693e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fe8040099b0 tx=0x7fe804017000 comp rx=0 tx=0).stop 2023-10-06T02:29:08.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.016+0000 7fe81ba31700 1 -- 172.21.15.6:0/3939272318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe81406c460 msgr2=0x7fe8140b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.016+0000 7fe81ba31700 1 --2- 172.21.15.6:0/3939272318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe81406c460 0x7fe8140b18e0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7fe81000ec80 tx=0x7fe8100091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.016+0000 7fe81ba31700 1 -- 172.21.15.6:0/3939272318 shutdown_connections 2023-10-06T02:29:08.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.016+0000 7fe81ba31700 1 --2- 172.21.15.6:0/3939272318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe8140c7840 0x7fe81416d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.016+0000 7fe81ba31700 1 --2- 172.21.15.6:0/3939272318 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe7f8066f30 0x7fe7f80693e0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.016+0000 7fe81ba31700 1 --2- 172.21.15.6:0/3939272318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe81406c460 0x7fe8140b18e0 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.016+0000 7fe81ba31700 1 --2- 172.21.15.6:0/3939272318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe81406c830 0x7fe81416d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.016+0000 7fe81ba31700 1 -- 172.21.15.6:0/3939272318 >> 172.21.15.6:0/3939272318 conn(0x7fe8140c9cc0 msgr2=0x7fe8140c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:08.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.016+0000 7fe81ba31700 1 -- 172.21.15.6:0/3939272318 shutdown_connections 2023-10-06T02:29:08.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.016+0000 7fe81ba31700 1 -- 172.21.15.6:0/3939272318 wait complete. 2023-10-06T02:29:08.018 INFO:teuthology.orchestra.run.smithi006.stderr:nothing to do: rank is not damaged 2023-10-06T02:29:08.031 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:29:08.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.111+0000 7f569fc24000 1 Processor -- start 2023-10-06T02:29:08.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.111+0000 7f569fc24000 1 -- start start 2023-10-06T02:29:08.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.112+0000 7f569fc24000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55705436dcc0 0x5570544270e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.112+0000 7f569fc24000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5570543b3130 0x557054427620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.112+0000 7f569fc24000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054428cc0 0x55705444e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.112+0000 7f569fc24000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570542b5620 con 0x55705436dcc0 2023-10-06T02:29:08.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.112+0000 7f569fc24000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570542ac400 con 0x557054428cc0 2023-10-06T02:29:08.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.112+0000 7f569fc24000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x557054369d30 con 0x5570543b3130 2023-10-06T02:29:08.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.112+0000 7f5698e5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55705436dcc0 0x5570544270e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.112+0000 7f5698e5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55705436dcc0 0x5570544270e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53792/0 (socket says 172.21.15.6:53792) 2023-10-06T02:29:08.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.112+0000 7f5698e5f700 1 -- 172.21.15.6:0/1747491835 learned_addr learned my addr 172.21.15.6:0/1747491835 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:08.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.112+0000 7f5699660700 1 --2- 172.21.15.6:0/1747491835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054428cc0 0x55705444e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.112+0000 7f569865e700 1 --2- 172.21.15.6:0/1747491835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5570543b3130 0x557054427620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f5698e5f700 1 -- 172.21.15.6:0/1747491835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5570543b3130 msgr2=0x557054427620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f5698e5f700 1 --2- 172.21.15.6:0/1747491835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5570543b3130 0x557054427620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f5698e5f700 1 -- 172.21.15.6:0/1747491835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054428cc0 msgr2=0x55705444e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f5698e5f700 1 --2- 172.21.15.6:0/1747491835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054428cc0 0x55705444e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f5698e5f700 1 -- 172.21.15.6:0/1747491835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5680005db0 con 0x55705436dcc0 2023-10-06T02:29:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f569865e700 1 --2- 172.21.15.6:0/1747491835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5570543b3130 0x557054427620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f5699660700 1 --2- 172.21.15.6:0/1747491835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054428cc0 0x55705444e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f5698e5f700 1 --2- 172.21.15.6:0/1747491835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55705436dcc0 0x5570544270e0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f568800b840 tx=0x7f5688005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872f9ba9706d11b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f569765c700 1 -- 172.21.15.6:0/1747491835 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688012680 con 0x55705436dcc0 2023-10-06T02:29:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f569765c700 1 -- 172.21.15.6:0/1747491835 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56880127e0 con 0x55705436dcc0 2023-10-06T02:29:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f569765c700 1 -- 172.21.15.6:0/1747491835 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688012b80 con 0x55705436dcc0 2023-10-06T02:29:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f569fc24000 1 -- 172.21.15.6:0/1747491835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55705436dcc0 msgr2=0x5570544270e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f569fc24000 1 --2- 172.21.15.6:0/1747491835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55705436dcc0 0x5570544270e0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f568800b840 tx=0x7f5688005d40 comp rx=0 tx=0).stop 2023-10-06T02:29:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f569fc24000 1 -- 172.21.15.6:0/1747491835 shutdown_connections 2023-10-06T02:29:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f569fc24000 1 --2- 172.21.15.6:0/1747491835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557054428cc0 0x55705444e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f569fc24000 1 --2- 172.21.15.6:0/1747491835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55705436dcc0 0x5570544270e0 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f569fc24000 1 --2- 172.21.15.6:0/1747491835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5570543b3130 0x557054427620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.113+0000 7f569fc24000 1 -- 172.21.15.6:0/1747491835 >> 172.21.15.6:0/1747491835 conn(0x5570543696c0 msgr2=0x55705443f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.114+0000 7f569fc24000 1 -- 172.21.15.6:0/1747491835 shutdown_connections 2023-10-06T02:29:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.114+0000 7f569fc24000 1 -- 172.21.15.6:0/1747491835 wait complete. 2023-10-06T02:29:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.114+0000 7f569fc24000 1 Processor -- start 2023-10-06T02:29:08.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.114+0000 7f569fc24000 1 -- start start 2023-10-06T02:29:08.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.115+0000 7f569fc24000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55705436dcc0 0x557054426490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.115+0000 7f569fc24000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5570543b3130 0x557054441f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.115+0000 7f569fc24000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557054428cc0 0x5570543af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.115+0000 7f569fc24000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570544269d0 con 0x557054428cc0 2023-10-06T02:29:08.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.115+0000 7f569fc24000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705444b490 con 0x55705436dcc0 2023-10-06T02:29:08.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.115+0000 7f569fc24000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5570543b1300 con 0x5570543b3130 2023-10-06T02:29:08.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.115+0000 7f5699660700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557054428cc0 0x5570543af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.115+0000 7f5699660700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557054428cc0 0x5570543af840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53800/0 (socket says 172.21.15.6:53800) 2023-10-06T02:29:08.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.115+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 learned_addr learned my addr 172.21.15.6:0/2711755430 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:08.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.115+0000 7f5698e5f700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55705436dcc0 0x557054426490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.115+0000 7f569865e700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5570543b3130 0x557054441f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.115+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5570543b3130 msgr2=0x557054441f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.115+0000 7f5699660700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5570543b3130 0x557054441f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.115+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55705436dcc0 msgr2=0x557054426490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.115+0000 7f5699660700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55705436dcc0 0x557054426490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.115+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568800b410 con 0x557054428cc0 2023-10-06T02:29:08.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.115+0000 7f569865e700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5570543b3130 0x557054441f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:08.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.116+0000 7f5699660700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557054428cc0 0x5570543af840 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f5690008920 tx=0x7f569000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:08.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.116+0000 7f5695e59700 1 -- 172.21.15.6:0/2711755430 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569000f050 con 0x557054428cc0 2023-10-06T02:29:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.116+0000 7f5695e59700 1 -- 172.21.15.6:0/2711755430 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5690010040 con 0x557054428cc0 2023-10-06T02:29:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.116+0000 7f5695e59700 1 -- 172.21.15.6:0/2711755430 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690006b20 con 0x557054428cc0 2023-10-06T02:29:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.116+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5570542de1c0 con 0x557054428cc0 2023-10-06T02:29:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.116+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5570542c43d0 con 0x557054428cc0 2023-10-06T02:29:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.117+0000 7f5695e59700 1 -- 172.21.15.6:0/2711755430 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5690015460 con 0x557054428cc0 2023-10-06T02:29:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.118+0000 7f5695e59700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5678065890 0x7f5678067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.118+0000 7f5695e59700 1 -- 172.21.15.6:0/2711755430 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 9388+0+0 (secure 0 0 0) 0x7f5690084790 con 0x557054428cc0 2023-10-06T02:29:08.122 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:29:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.118+0000 7f5698e5f700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5678065890 0x7f5678067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.118+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5570543b1730 0x5570543b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.118+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x5570543b2040 con 0x5570543b1730 2023-10-06T02:29:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.118+0000 7f569865e700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5570543b1730 0x5570543b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.118+0000 7f569865e700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5570543b1730 0x5570543b1b00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.118+0000 7f5698e5f700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5678065890 0x7f5678067d40 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f5688005d80 tx=0x7f5688018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.121+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v130'1065 uv1038 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.121+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x5570543b23f0 con 0x5570543b1730 2023-10-06T02:29:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.122+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v130'1066 uv1066 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.122+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445e460 con 0x5570543b1730 2023-10-06T02:29:08.125 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:29:08.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.124+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v130'1067 uv1067 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.124+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445f820 con 0x5570543b1730 2023-10-06T02:29:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.125+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v130'1068 uv1068 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.125+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445fbd0 con 0x5570543b1730 2023-10-06T02:29:08.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.126+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v130'1069 uv1069 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.126+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445e810 con 0x5570543b1730 2023-10-06T02:29:08.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.128+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v130'1070 uv1070 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.128+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445ebc0 con 0x5570543b1730 2023-10-06T02:29:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.129+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v130'1071 uv1044 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.129+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445ef70 con 0x5570543b1730 2023-10-06T02:29:08.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.131+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v130'1072 uv1072 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.131+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445ef70 con 0x5570543b1730 2023-10-06T02:29:08.133 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:29:08.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.132+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v130'1073 uv1073 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.132+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445ef70 con 0x5570543b1730 2023-10-06T02:29:08.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.133+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v130'1074 uv1074 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.133+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445ef70 con 0x5570543b1730 2023-10-06T02:29:08.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.134+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v130'1075 uv1075 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.134+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445ef70 con 0x5570543b1730 2023-10-06T02:29:08.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.136+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v130'1076 uv1076 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.136+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445ef70 con 0x5570543b1730 2023-10-06T02:29:08.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.137+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v130'1077 uv1064 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.137+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445ef70 con 0x5570543b1730 2023-10-06T02:29:08.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.138+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v130'1078 uv1078 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.138+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445ef70 con 0x5570543b1730 2023-10-06T02:29:08.140 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:29:08.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.140+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v130'1079 uv1079 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.140+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445ef70 con 0x5570543b1730 2023-10-06T02:29:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.141+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v130'1080 uv1080 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.141+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445ef70 con 0x5570543b1730 2023-10-06T02:29:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.142+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v130'1081 uv1081 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.142+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445ef70 con 0x5570543b1730 2023-10-06T02:29:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.144+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v130'1082 uv1082 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.144+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445f370 con 0x5570543b1730 2023-10-06T02:29:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.145+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v130'1083 uv1083 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.145+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445f1e0 con 0x5570543b1730 2023-10-06T02:29:08.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.146+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v130'1084 uv1057 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.146+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445f1e0 con 0x5570543b1730 2023-10-06T02:29:08.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.147+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v130'1085 uv1085 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.147+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445f1e0 con 0x5570543b1730 2023-10-06T02:29:08.149 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:29:08.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.149+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v130'1086 uv1086 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.149+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445f1e0 con 0x5570543b1730 2023-10-06T02:29:08.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.150+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v130'1087 uv1087 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.150+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445f1e0 con 0x5570543b1730 2023-10-06T02:29:08.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.151+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v130'1088 uv1088 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.151+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445f1e0 con 0x5570543b1730 2023-10-06T02:29:08.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.153+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v130'1089 uv1089 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.153+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445f1e0 con 0x5570543b1730 2023-10-06T02:29:08.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.154+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v130'1090 uv1063 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.154+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445f1e0 con 0x5570543b1730 2023-10-06T02:29:08.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.155+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v130'1091 uv1091 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.155+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445f1e0 con 0x5570543b1730 2023-10-06T02:29:08.157 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:29:08.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.156+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v130'1092 uv1092 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.156+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445f1e0 con 0x5570543b1730 2023-10-06T02:29:08.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.158+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v130'1093 uv1093 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.158+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445f1e0 con 0x5570543b1730 2023-10-06T02:29:08.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.159+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v130'1094 uv1094 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.159+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705445f1e0 con 0x5570543b1730 2023-10-06T02:29:08.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.161+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v130'1095 uv1095 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x5570543b1730 2023-10-06T02:29:08.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.161+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55705445ff80 0x557054462360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.161+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x5570544628a0 con 0x55705445ff80 2023-10-06T02:29:08.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.161+0000 7f5698e5f700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55705445ff80 0x557054462360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.161+0000 7f5698e5f700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55705445ff80 0x557054462360 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:08.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.163+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v130'767 uv747 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.163+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054462c50 con 0x55705445ff80 2023-10-06T02:29:08.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.165+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v130'768 uv768 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.165+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054463000 con 0x55705445ff80 2023-10-06T02:29:08.166 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:29:08.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.166+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v130'769 uv769 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.166+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x5570544638a0 con 0x55705445ff80 2023-10-06T02:29:08.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.167+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v130'770 uv770 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.167+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054463c50 con 0x55705445ff80 2023-10-06T02:29:08.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.168+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v130'771 uv771 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.168+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054464000 con 0x55705445ff80 2023-10-06T02:29:08.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.170+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v130'772 uv766 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.170+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x5570544643b0 con 0x55705445ff80 2023-10-06T02:29:08.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.171+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v130'773 uv773 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.171+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054464760 con 0x55705445ff80 2023-10-06T02:29:08.173 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:29:08.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.172+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v130'774 uv774 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.172+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054464760 con 0x55705445ff80 2023-10-06T02:29:08.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.173+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v130'775 uv775 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.173+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054464760 con 0x55705445ff80 2023-10-06T02:29:08.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.175+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v130'776 uv776 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.175+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054464760 con 0x55705445ff80 2023-10-06T02:29:08.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.176+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v130'777 uv765 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.176+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054464760 con 0x55705445ff80 2023-10-06T02:29:08.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.178+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v130'778 uv778 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.178+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054464760 con 0x55705445ff80 2023-10-06T02:29:08.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.179+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v130'779 uv779 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.179 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:29:08.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.179+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054467e80 con 0x55705445ff80 2023-10-06T02:29:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.180+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v130'780 uv780 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.180+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054467e80 con 0x55705445ff80 2023-10-06T02:29:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.181+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v130'781 uv781 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.181+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054464760 con 0x55705445ff80 2023-10-06T02:29:08.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.182+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v130'782 uv763 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.182+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054464760 con 0x55705445ff80 2023-10-06T02:29:08.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.184+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v130'783 uv783 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.184+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054464760 con 0x55705445ff80 2023-10-06T02:29:08.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.185+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v130'784 uv784 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.185 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:29:08.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.185+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054465770 con 0x55705445ff80 2023-10-06T02:29:08.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.186+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v130'785 uv785 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.186+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054465770 con 0x55705445ff80 2023-10-06T02:29:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.187+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v130'786 uv786 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.187+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054464760 con 0x55705445ff80 2023-10-06T02:29:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.188+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v130'787 uv787 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.188+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x557054464c70 0x557054467050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.188+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054467590 con 0x557054464c70 2023-10-06T02:29:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.188+0000 7f569865e700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x557054464c70 0x557054467050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.189+0000 7f569865e700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x557054464c70 0x557054467050 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:08.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.190+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v130'207 uv206 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.190+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054467590 con 0x557054464c70 2023-10-06T02:29:08.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.191+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v130'208 uv208 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.191+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054467a50 con 0x557054464c70 2023-10-06T02:29:08.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.192+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v130'209 uv209 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.194 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:29:08.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.192+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054468a60 con 0x557054464c70 2023-10-06T02:29:08.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.193+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v130'210 uv210 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.193+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054468a60 con 0x557054464c70 2023-10-06T02:29:08.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.194+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v130'211 uv211 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.194+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054467a50 con 0x557054464c70 2023-10-06T02:29:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.195+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v130'212 uv212 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.195+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054467a50 con 0x557054464c70 2023-10-06T02:29:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.196+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v130'149 uv148 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.196+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054467a50 con 0x557054464c70 2023-10-06T02:29:08.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.197+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v130'150 uv150 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.197+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054467a50 con 0x557054464c70 2023-10-06T02:29:08.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.198+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v130'151 uv151 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.199 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:29:08.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.198+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054467a50 con 0x557054464c70 2023-10-06T02:29:08.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.199+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v130'152 uv152 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.199+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054467a50 con 0x55705445ff80 2023-10-06T02:29:08.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.201+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v130'207 uv206 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.201+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054467a50 con 0x55705445ff80 2023-10-06T02:29:08.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.202+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v130'208 uv208 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.202+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054467a50 con 0x55705445ff80 2023-10-06T02:29:08.203 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:29:08.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.203+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v130'209 uv209 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.203+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054468a60 con 0x55705445ff80 2023-10-06T02:29:08.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.204+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v130'210 uv210 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.204+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054468a60 con 0x55705445ff80 2023-10-06T02:29:08.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.205+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v130'211 uv211 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.205+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054467a50 con 0x55705445ff80 2023-10-06T02:29:08.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.206+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v130'212 uv212 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705445ff80 2023-10-06T02:29:08.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.207+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5570544680d0 0x55705446a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.207+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705446a9f0 con 0x5570544680d0 2023-10-06T02:29:08.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.207+0000 7f5699660700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5570544680d0 0x55705446a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.207+0000 7f5699660700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5570544680d0 0x55705446a4b0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:08.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.209+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v130'382 uv376 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x5570544680d0 2023-10-06T02:29:08.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.209+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705446aea0 con 0x5570544680d0 2023-10-06T02:29:08.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.210+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v130'383 uv383 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x5570544680d0 2023-10-06T02:29:08.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.210+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705446b390 con 0x5570544680d0 2023-10-06T02:29:08.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.211+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v130'384 uv384 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x5570544680d0 2023-10-06T02:29:08.212 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:29:08.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.211+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705446cc90 con 0x5570544680d0 2023-10-06T02:29:08.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.212+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v130'385 uv385 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x5570544680d0 2023-10-06T02:29:08.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.212+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705446d040 con 0x5570544680d0 2023-10-06T02:29:08.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.213+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v130'386 uv386 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x5570544680d0 2023-10-06T02:29:08.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.214+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705446bc80 con 0x5570544680d0 2023-10-06T02:29:08.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.215+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v130'387 uv387 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x5570544680d0 2023-10-06T02:29:08.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.215+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705446c0a0 con 0x5570544680d0 2023-10-06T02:29:08.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.216+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v130'388 uv381 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x5570544680d0 2023-10-06T02:29:08.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.216+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705446c4a0 con 0x5570544680d0 2023-10-06T02:29:08.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.217+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v130'389 uv389 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x5570544680d0 2023-10-06T02:29:08.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.217+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705446c4a0 con 0x5570544680d0 2023-10-06T02:29:08.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.218+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v130'390 uv390 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x5570544680d0 2023-10-06T02:29:08.219 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:29:08.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.218+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705446c8a0 con 0x5570544680d0 2023-10-06T02:29:08.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.219+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v130'391 uv391 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x5570544680d0 2023-10-06T02:29:08.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.219+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705446c8a0 con 0x5570544680d0 2023-10-06T02:29:08.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.220+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v130'392 uv392 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x5570544680d0 2023-10-06T02:29:08.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.220+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55705446d3f0 0x55705446f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.220+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705446fd10 con 0x55705446d3f0 2023-10-06T02:29:08.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.220+0000 7f5698e5f700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55705446d3f0 0x55705446f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.221+0000 7f5698e5f700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55705446d3f0 0x55705446f7d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:08.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.224+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v130'173 uv172 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705446d3f0 2023-10-06T02:29:08.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.224+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705446fd10 con 0x55705446d3f0 2023-10-06T02:29:08.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.226+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v130'174 uv174 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705446d3f0 2023-10-06T02:29:08.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.226+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55705446fd10 con 0x55705446d3f0 2023-10-06T02:29:08.227 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:29:08.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.227+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v130'175 uv175 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705446d3f0 2023-10-06T02:29:08.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.227+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054470190 con 0x55705446d3f0 2023-10-06T02:29:08.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.228+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v130'176 uv176 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705446d3f0 2023-10-06T02:29:08.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.228+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054470190 con 0x55705446d3f0 2023-10-06T02:29:08.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.229+0000 7f5698e5f700 1 -- 172.21.15.6:0/2711755430 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v130'177 uv177 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5688018070 con 0x55705446d3f0 2023-10-06T02:29:08.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.229+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054470190 con 0x557054464c70 2023-10-06T02:29:08.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.230+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v130'207 uv206 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.230+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054470190 con 0x557054464c70 2023-10-06T02:29:08.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.231+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v130'208 uv208 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.231+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054470190 con 0x557054464c70 2023-10-06T02:29:08.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.232+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v130'209 uv209 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.233 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:29:08.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.232+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x5570544711a0 con 0x557054464c70 2023-10-06T02:29:08.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.233+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v130'210 uv210 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.233+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x5570544711a0 con 0x557054464c70 2023-10-06T02:29:08.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.234+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v130'211 uv211 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.234+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054470190 con 0x557054464c70 2023-10-06T02:29:08.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.235+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v130'212 uv212 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.235+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x557054470810 0x557054472bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.235+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054473130 con 0x557054470810 2023-10-06T02:29:08.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.235+0000 7f569865e700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x557054470810 0x557054472bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.235+0000 7f569865e700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x557054470810 0x557054472bf0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:08.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.237+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v130'345 uv339 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054470810 2023-10-06T02:29:08.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.237+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054473170 con 0x557054470810 2023-10-06T02:29:08.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.238+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v130'346 uv346 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054470810 2023-10-06T02:29:08.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.238+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x5570544735a0 con 0x557054470810 2023-10-06T02:29:08.239 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:29:08.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.239+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v130'347 uv347 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054470810 2023-10-06T02:29:08.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.239+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x5570544735a0 con 0x557054470810 2023-10-06T02:29:08.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.240+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v130'348 uv348 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054470810 2023-10-06T02:29:08.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.240+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x5570544735a0 con 0x557054470810 2023-10-06T02:29:08.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.241+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v130'349 uv349 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054470810 2023-10-06T02:29:08.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.241+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x5570544735a0 con 0x557054470810 2023-10-06T02:29:08.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.242+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v130'350 uv344 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054470810 2023-10-06T02:29:08.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.242+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x5570544735a0 con 0x557054470810 2023-10-06T02:29:08.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.243+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v130'351 uv351 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054470810 2023-10-06T02:29:08.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.243+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x5570544735a0 con 0x557054470810 2023-10-06T02:29:08.245 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:29:08.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.244+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v130'352 uv352 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054470810 2023-10-06T02:29:08.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.244+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x5570544735a0 con 0x557054470810 2023-10-06T02:29:08.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.245+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v130'353 uv353 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054470810 2023-10-06T02:29:08.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.245+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476310 con 0x557054470810 2023-10-06T02:29:08.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.247+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v130'354 uv354 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054470810 2023-10-06T02:29:08.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.247+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054473a90 con 0x557054464c70 2023-10-06T02:29:08.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.247+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v130'152 uv150 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.247+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054473a90 con 0x557054464c70 2023-10-06T02:29:08.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.248+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v130'153 uv153 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.248+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054473a90 con 0x557054464c70 2023-10-06T02:29:08.250 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:29:08.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.249+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v130'154 uv154 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.249+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054473a90 con 0x557054464c70 2023-10-06T02:29:08.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.250+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v130'155 uv155 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.250+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x557054473fa0 0x5570544743b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.250+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x557054473fa0 2023-10-06T02:29:08.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.251+0000 7f5699660700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x557054473fa0 0x5570544743b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.251+0000 7f5699660700 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x557054473fa0 0x5570544743b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.252+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v130'207 uv206 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x557054473fa0 2023-10-06T02:29:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.252+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x557054473fa0 2023-10-06T02:29:08.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.255+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v130'208 uv208 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x557054473fa0 2023-10-06T02:29:08.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.255+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x557054473fa0 2023-10-06T02:29:08.258 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:29:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.258+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v130'209 uv209 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x557054473fa0 2023-10-06T02:29:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.258+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054477a70 con 0x557054473fa0 2023-10-06T02:29:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.259+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v130'210 uv210 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x557054473fa0 2023-10-06T02:29:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.259+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054477a70 con 0x557054473fa0 2023-10-06T02:29:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.262+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v130'211 uv211 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x557054473fa0 2023-10-06T02:29:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.262+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x557054473fa0 2023-10-06T02:29:08.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.264+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v130'212 uv212 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x557054473fa0 2023-10-06T02:29:08.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.264+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x5570544680d0 2023-10-06T02:29:08.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.266+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v130'176 uv175 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x5570544680d0 2023-10-06T02:29:08.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.266+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x5570544680d0 2023-10-06T02:29:08.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.267+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v130'177 uv177 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x5570544680d0 2023-10-06T02:29:08.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.267+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x5570544680d0 2023-10-06T02:29:08.268 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:29:08.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.268+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v130'178 uv178 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x5570544680d0 2023-10-06T02:29:08.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.268+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x5570544680d0 2023-10-06T02:29:08.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.269+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v130'179 uv179 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x5570544680d0 2023-10-06T02:29:08.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.269+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x5570544680d0 2023-10-06T02:29:08.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.270+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v130'180 uv180 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f569001b020 con 0x5570544680d0 2023-10-06T02:29:08.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.270+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x557054464c70 2023-10-06T02:29:08.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.272+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v130'429 uv420 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.272+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x557054464c70 2023-10-06T02:29:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.273+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v130'430 uv430 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.273+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x557054464c70 2023-10-06T02:29:08.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.274+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v130'431 uv431 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.275 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:29:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.274+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x557054464c70 2023-10-06T02:29:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.275+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v130'432 uv432 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.275+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x557054464c70 2023-10-06T02:29:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.276+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v130'433 uv433 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.276+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x557054464c70 2023-10-06T02:29:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.277+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v130'434 uv427 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.277+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x557054464c70 2023-10-06T02:29:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.278+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v130'435 uv435 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.278+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x557054464c70 2023-10-06T02:29:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.279+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v130'436 uv436 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.280 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:29:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.279+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054477a70 con 0x557054464c70 2023-10-06T02:29:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.280+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v130'437 uv437 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.280+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054477a70 con 0x557054464c70 2023-10-06T02:29:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.281+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v130'438 uv438 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.281+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476a60 con 0x557054464c70 2023-10-06T02:29:08.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.282+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v130'439 uv439 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.282+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x557054476f50 con 0x557054464c70 2023-10-06T02:29:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569865e700 1 -- 172.21.15.6:0/2711755430 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v130'440 uv440 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5680008970 con 0x557054464c70 2023-10-06T02:29:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x557054464c70 msgr2=0x557054467050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x557054464c70 0x557054467050 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5570543b1730 msgr2=0x5570543b1b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5570543b1730 0x5570543b1b00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x557054470810 msgr2=0x557054472bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x557054470810 0x557054472bf0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55705445ff80 msgr2=0x557054462360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55705445ff80 0x557054462360 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 reap_dead start 2023-10-06T02:29:08.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x557054473fa0 msgr2=0x5570544743b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x557054473fa0 0x5570544743b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f5699660700 1 -- 172.21.15.6:0/2711755430 reap_dead start 2023-10-06T02:29:08.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55705446d3f0 msgr2=0x55705446f7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55705446d3f0 0x55705446f7d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5570544680d0 msgr2=0x55705446a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5570544680d0 0x55705446a4b0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5678065890 msgr2=0x7f5678067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5678065890 0x7f5678067d40 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f5688005d80 tx=0x7f5688018000 comp rx=0 tx=0).stop 2023-10-06T02:29:08.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557054428cc0 msgr2=0x5570543af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557054428cc0 0x5570543af840 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f5690008920 tx=0x7f569000c040 comp rx=0 tx=0).stop 2023-10-06T02:29:08.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 shutdown_connections 2023-10-06T02:29:08.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55705446d3f0 0x55705446f7d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5570544680d0 0x55705446a4b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557054428cc0 0x5570543af840 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 --2- 172.21.15.6:0/2711755430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5678065890 0x7f5678067d40 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.283+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 >> 172.21.15.6:0/2711755430 conn(0x5570543696c0 msgr2=0x5570543999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:08.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.284+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 shutdown_connections 2023-10-06T02:29:08.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.284+0000 7f569fc24000 1 -- 172.21.15.6:0/2711755430 wait complete. 2023-10-06T02:29:08.289 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader 600.00000000 deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2023-10-06T02:29:08.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.369+0000 7fb5020eb000 1 Processor -- start 2023-10-06T02:29:08.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.369+0000 7fb5020eb000 1 -- start start 2023-10-06T02:29:08.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.370+0000 7fb5020eb000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563f00360c90 0x563f002cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.370+0000 7fb5020eb000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f00358980 0x563f00361060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.370+0000 7fb5020eb000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f00356ec0 0x563f00357290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.370+0000 7fb5020eb000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0022e320 con 0x563f00358980 2023-10-06T02:29:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.370+0000 7fb5020eb000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f001d2980 con 0x563f00356ec0 2023-10-06T02:29:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.370+0000 7fb5020eb000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f001d2620 con 0x563f00360c90 2023-10-06T02:29:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.370+0000 7fb4fab25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f00358980 0x563f00361060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.370+0000 7fb4fab25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f00358980 0x563f00361060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53820/0 (socket says 172.21.15.6:53820) 2023-10-06T02:29:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.370+0000 7fb4fab25700 1 -- 172.21.15.6:0/516748581 learned_addr learned my addr 172.21.15.6:0/516748581 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.370+0000 7fb4fbb27700 1 --2- 172.21.15.6:0/516748581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f00356ec0 0x563f00357290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.370+0000 7fb4fb326700 1 --2- 172.21.15.6:0/516748581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563f00360c90 0x563f002cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.370+0000 7fb4fab25700 1 -- 172.21.15.6:0/516748581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563f00360c90 msgr2=0x563f002cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.370+0000 7fb4fab25700 1 --2- 172.21.15.6:0/516748581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563f00360c90 0x563f002cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.370+0000 7fb4fab25700 1 -- 172.21.15.6:0/516748581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f00356ec0 msgr2=0x563f00357290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.370+0000 7fb4fab25700 1 --2- 172.21.15.6:0/516748581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f00356ec0 0x563f00357290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.370+0000 7fb4fab25700 1 -- 172.21.15.6:0/516748581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f001d4ae0 con 0x563f00358980 2023-10-06T02:29:08.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.370+0000 7fb4fab25700 1 --2- 172.21.15.6:0/516748581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f00358980 0x563f00361060 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0000e10 tx=0x563f002cfe30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87ac7a487aaa3a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:08.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.371+0000 7fb4f9b23700 1 -- 172.21.15.6:0/516748581 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f000f450 con 0x563f00358980 2023-10-06T02:29:08.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.371+0000 7fb4f9b23700 1 -- 172.21.15.6:0/516748581 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f0005030 con 0x563f00358980 2023-10-06T02:29:08.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.371+0000 7fb4f9b23700 1 -- 172.21.15.6:0/516748581 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f000f610 con 0x563f00358980 2023-10-06T02:29:08.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.371+0000 7fb5020eb000 1 -- 172.21.15.6:0/516748581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f00358980 msgr2=0x563f00361060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.371+0000 7fb5020eb000 1 --2- 172.21.15.6:0/516748581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f00358980 0x563f00361060 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0000e10 tx=0x563f002cfe30 comp rx=0 tx=0).stop 2023-10-06T02:29:08.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.371+0000 7fb5020eb000 1 -- 172.21.15.6:0/516748581 shutdown_connections 2023-10-06T02:29:08.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.371+0000 7fb5020eb000 1 --2- 172.21.15.6:0/516748581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f00356ec0 0x563f00357290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.371+0000 7fb5020eb000 1 --2- 172.21.15.6:0/516748581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563f00360c90 0x563f002cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.371+0000 7fb5020eb000 1 --2- 172.21.15.6:0/516748581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f00358980 0x563f00361060 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.371+0000 7fb5020eb000 1 -- 172.21.15.6:0/516748581 >> 172.21.15.6:0/516748581 conn(0x563f00287d50 msgr2=0x563f002b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:08.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.371+0000 7fb5020eb000 1 -- 172.21.15.6:0/516748581 shutdown_connections 2023-10-06T02:29:08.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.371+0000 7fb5020eb000 1 -- 172.21.15.6:0/516748581 wait complete. 2023-10-06T02:29:08.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.372+0000 7fb5020eb000 1 Processor -- start 2023-10-06T02:29:08.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.372+0000 7fb5020eb000 1 -- start start 2023-10-06T02:29:08.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.372+0000 7fb5020eb000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563f00356ec0 0x563f002b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb5020eb000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f00358980 0x563f00355210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb5020eb000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f00360c90 0x563f0035fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb5020eb000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f001c9400 con 0x563f00358980 2023-10-06T02:29:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb5020eb000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0035dae0 con 0x563f00360c90 2023-10-06T02:29:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb5020eb000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f0035a3b0 con 0x563f00356ec0 2023-10-06T02:29:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb4fab25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f00358980 0x563f00355210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb4fab25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f00358980 0x563f00355210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53836/0 (socket says 172.21.15.6:53836) 2023-10-06T02:29:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb4fab25700 1 -- 172.21.15.6:0/1516663326 learned_addr learned my addr 172.21.15.6:0/1516663326 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb4fbb27700 1 --2- 172.21.15.6:0/1516663326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f00360c90 0x563f0035fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb4fb326700 1 --2- 172.21.15.6:0/1516663326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563f00356ec0 0x563f002b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb4fab25700 1 -- 172.21.15.6:0/1516663326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563f00356ec0 msgr2=0x563f002b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb4fab25700 1 --2- 172.21.15.6:0/1516663326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563f00356ec0 0x563f002b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb4fab25700 1 -- 172.21.15.6:0/1516663326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f00360c90 msgr2=0x563f0035fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb4fab25700 1 --2- 172.21.15.6:0/1516663326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f00360c90 0x563f0035fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb4fab25700 1 -- 172.21.15.6:0/1516663326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f001e13d0 con 0x563f00358980 2023-10-06T02:29:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb4fab25700 1 --2- 172.21.15.6:0/1516663326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f00358980 0x563f00355210 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009c10 tx=0x7fb4f0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb4e3fff700 1 -- 172.21.15.6:0/1516663326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0018800 con 0x563f00358980 2023-10-06T02:29:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb4e3fff700 1 -- 172.21.15.6:0/1516663326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f0018960 con 0x563f00358980 2023-10-06T02:29:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb5020eb000 1 -- 172.21.15.6:0/1516663326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563f001d4540 con 0x563f00358980 2023-10-06T02:29:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb4e3fff700 1 -- 172.21.15.6:0/1516663326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0018d00 con 0x563f00358980 2023-10-06T02:29:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.373+0000 7fb5020eb000 1 -- 172.21.15.6:0/1516663326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f0035a8f0 con 0x563f00358980 2023-10-06T02:29:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.375+0000 7fb4e3fff700 1 -- 172.21.15.6:0/1516663326 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4f0015020 con 0x563f00358980 2023-10-06T02:29:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.375+0000 7fb4e3fff700 1 --2- 172.21.15.6:0/1516663326 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4e80658c0 0x7fb4e8067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.375+0000 7fb4e3fff700 1 -- 172.21.15.6:0/1516663326 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 9388+0+0 (secure 0 0 0) 0x7fb4f0085e20 con 0x563f00358980 2023-10-06T02:29:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.375+0000 7fb4fb326700 1 --2- 172.21.15.6:0/1516663326 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4e80658c0 0x7fb4e8067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.375+0000 7fb5020eb000 1 --2- 172.21.15.6:0/1516663326 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x563f00355750 0x563f0037af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.375+0000 7fb5020eb000 1 -- 172.21.15.6:0/1516663326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x563f002b70c0 con 0x563f00355750 2023-10-06T02:29:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.376+0000 7fb4fbb27700 1 --2- 172.21.15.6:0/1516663326 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x563f00355750 0x563f0037af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.376+0000 7fb4fb326700 1 --2- 172.21.15.6:0/1516663326 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4e80658c0 0x7fb4e8067d70 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec001440 tx=0x7fb4ec001780 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.376+0000 7fb4fbb27700 1 --2- 172.21.15.6:0/1516663326 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x563f00355750 0x563f0037af80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.377+0000 7fb4fbb27700 1 -- 172.21.15.6:0/1516663326 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 600.00000000 [omap-set-header] v130'1096 uv1096 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fb4f4018070 con 0x563f00355750 2023-10-06T02:29:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.377+0000 7fb5020eb000 1 -- 172.21.15.6:0/1516663326 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x563f00355750 msgr2=0x563f0037af80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.377+0000 7fb5020eb000 1 --2- 172.21.15.6:0/1516663326 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x563f00355750 0x563f0037af80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.377+0000 7fb5020eb000 1 -- 172.21.15.6:0/1516663326 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4e80658c0 msgr2=0x7fb4e8067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.377+0000 7fb5020eb000 1 --2- 172.21.15.6:0/1516663326 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb4e80658c0 0x7fb4e8067d70 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec001440 tx=0x7fb4ec001780 comp rx=0 tx=0).stop 2023-10-06T02:29:08.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.377+0000 7fb5020eb000 1 -- 172.21.15.6:0/1516663326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f00358980 msgr2=0x563f00355210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.377+0000 7fb5020eb000 1 --2- 172.21.15.6:0/1516663326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f00358980 0x563f00355210 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009c10 tx=0x7fb4f0014000 comp rx=0 tx=0).stop 2023-10-06T02:29:08.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.377+0000 7fb4fbb27700 1 -- 172.21.15.6:0/1516663326 reap_dead start 2023-10-06T02:29:08.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.377+0000 7fb5020eb000 1 -- 172.21.15.6:0/1516663326 shutdown_connections 2023-10-06T02:29:08.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.377+0000 7fb5020eb000 1 -- 172.21.15.6:0/1516663326 >> 172.21.15.6:0/1516663326 conn(0x563f00287d50 msgr2=0x563f00361060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:08.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.377+0000 7fb5020eb000 1 -- 172.21.15.6:0/1516663326 shutdown_connections 2023-10-06T02:29:08.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.377+0000 7fb5020eb000 1 -- 172.21.15.6:0/1516663326 wait complete. 2023-10-06T02:29:08.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:29:08.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.545+0000 7f60bdc6e700 1 Processor -- start 2023-10-06T02:29:08.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.545+0000 7f60bdc6e700 1 -- start start 2023-10-06T02:29:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.545+0000 7f60bdc6e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f60b80cd7d0 0x7f60b80d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.545+0000 7f60bdc6e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b80b0810 0x7f60b80d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.545+0000 7f60bdc6e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b80d0c20 con 0x7f60b80cd400 2023-10-06T02:29:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.545+0000 7f60bdc6e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b80af770 con 0x7f60b80cd7d0 2023-10-06T02:29:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.545+0000 7f60bdc6e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b80afa50 con 0x7f60b80b0810 2023-10-06T02:29:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.546+0000 7f60b7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f60b80cd7d0 0x7f60b80d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.546+0000 7f60bcc6c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f60b80cd400 0x7f60b80b1f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40338/0 (socket says 172.21.15.6:40338) 2023-10-06T02:29:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.546+0000 7f60bcc6c700 1 -- 172.21.15.6:0/1085897262 learned_addr learned my addr 172.21.15.6:0/1085897262 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:08.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.546+0000 7f60bd46d700 1 --2- 172.21.15.6:0/1085897262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b80b0810 0x7f60b80d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.546+0000 7f60b7fff700 1 -- 172.21.15.6:0/1085897262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b80b0810 msgr2=0x7f60b80d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:08.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.546+0000 7f60b7fff700 1 --2- 172.21.15.6:0/1085897262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b80b0810 0x7f60b80d06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.546+0000 7f60b7fff700 1 -- 172.21.15.6:0/1085897262 >> v1:172.21.15.6:6789/0 conn(0x7f60b80cd400 legacy=0x7f60b80b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.546+0000 7f60b77fe700 1 -- 172.21.15.6:0/1085897262 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761692443 0 0) 0x7f60b80d0c20 con 0x7f60b80cd400 2023-10-06T02:29:08.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.546+0000 7f60b7fff700 1 -- 172.21.15.6:0/1085897262 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b80afd30 con 0x7f60b80cd7d0 2023-10-06T02:29:08.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.546+0000 7f60b7fff700 1 --2- 172.21.15.6:0/1085897262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b80cd7d0 0x7f60b80d01a0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009910 tx=0x7f60ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce700b55023329d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:08.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.546+0000 7f60b77fe700 1 -- 172.21.15.6:0/1085897262 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00b640 con 0x7f60b80cd7d0 2023-10-06T02:29:08.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.546+0000 7f60b77fe700 1 -- 172.21.15.6:0/1085897262 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac00b7a0 con 0x7f60b80cd7d0 2023-10-06T02:29:08.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.546+0000 7f60b77fe700 1 -- 172.21.15.6:0/1085897262 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00bb60 con 0x7f60b80cd7d0 2023-10-06T02:29:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.547+0000 7f60bdc6e700 1 -- 172.21.15.6:0/1085897262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b80cd7d0 msgr2=0x7f60b80d01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.547+0000 7f60bdc6e700 1 --2- 172.21.15.6:0/1085897262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b80cd7d0 0x7f60b80d01a0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009910 tx=0x7f60ac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.547+0000 7f60bdc6e700 1 -- 172.21.15.6:0/1085897262 shutdown_connections 2023-10-06T02:29:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.547+0000 7f60bdc6e700 1 --2- 172.21.15.6:0/1085897262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b80b0810 0x7f60b80d06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.547+0000 7f60bdc6e700 1 --2- 172.21.15.6:0/1085897262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b80cd7d0 0x7f60b80d01a0 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.547+0000 7f60bdc6e700 1 -- 172.21.15.6:0/1085897262 >> 172.21.15.6:0/1085897262 conn(0x7f60b806a110 msgr2=0x7f60b806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.547+0000 7f60bdc6e700 1 -- 172.21.15.6:0/1085897262 shutdown_connections 2023-10-06T02:29:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.547+0000 7f60bdc6e700 1 -- 172.21.15.6:0/1085897262 wait complete. 2023-10-06T02:29:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.548+0000 7f60bdc6e700 1 Processor -- start 2023-10-06T02:29:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.548+0000 7f60bdc6e700 1 -- start start 2023-10-06T02:29:08.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.549+0000 7f60bdc6e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60b80b0810 0x7f60b8169840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.549+0000 7f60bdc6e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b80cd400 0x7f60b81537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.549+0000 7f60bdc6e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b81553b0 0x7f60b80b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.549+0000 7f60bdc6e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b8154890 con 0x7f60b80cd400 2023-10-06T02:29:08.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.549+0000 7f60bdc6e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b8169d80 con 0x7f60b80b0810 2023-10-06T02:29:08.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.549+0000 7f60bdc6e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b8153d20 con 0x7f60b81553b0 2023-10-06T02:29:08.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.549+0000 7f60b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b80cd400 0x7f60b81537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.549+0000 7f60b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b80cd400 0x7f60b81537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53862/0 (socket says 172.21.15.6:53862) 2023-10-06T02:29:08.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.549+0000 7f60b7fff700 1 -- 172.21.15.6:0/3653611047 learned_addr learned my addr 172.21.15.6:0/3653611047 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:08.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.549+0000 7f60bd46d700 1 --2- 172.21.15.6:0/3653611047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b81553b0 0x7f60b80b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.549+0000 7f60bcc6c700 1 --2- 172.21.15.6:0/3653611047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60b80b0810 0x7f60b8169840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.549+0000 7f60b7fff700 1 -- 172.21.15.6:0/3653611047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b81553b0 msgr2=0x7f60b80b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.549+0000 7f60b7fff700 1 --2- 172.21.15.6:0/3653611047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b81553b0 0x7f60b80b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.549+0000 7f60b7fff700 1 -- 172.21.15.6:0/3653611047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60b80b0810 msgr2=0x7f60b8169840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.549+0000 7f60b7fff700 1 --2- 172.21.15.6:0/3653611047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60b80b0810 0x7f60b8169840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.549+0000 7f60b7fff700 1 -- 172.21.15.6:0/3653611047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac009420 con 0x7f60b80cd400 2023-10-06T02:29:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.549+0000 7f60bcc6c700 1 --2- 172.21.15.6:0/3653611047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60b80b0810 0x7f60b8169840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.550+0000 7f60b7fff700 1 --2- 172.21.15.6:0/3653611047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b80cd400 0x7f60b81537e0 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f60b8089070 tx=0x7f60ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.550+0000 7f60b4ff9700 1 -- 172.21.15.6:0/3653611047 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac01f070 con 0x7f60b80cd400 2023-10-06T02:29:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.550+0000 7f60b4ff9700 1 -- 172.21.15.6:0/3653611047 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac00bb20 con 0x7f60b80cd400 2023-10-06T02:29:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.550+0000 7f60b4ff9700 1 -- 172.21.15.6:0/3653611047 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac011650 con 0x7f60b80cd400 2023-10-06T02:29:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.550+0000 7f60bdc6e700 1 -- 172.21.15.6:0/3653611047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b8153ff0 con 0x7f60b80cd400 2023-10-06T02:29:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.550+0000 7f60bdc6e700 1 -- 172.21.15.6:0/3653611047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b81545b0 con 0x7f60b80cd400 2023-10-06T02:29:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.551+0000 7f60bdc6e700 1 -- 172.21.15.6:0/3653611047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b8064aa0 con 0x7f60b80cd400 2023-10-06T02:29:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.551+0000 7f60b4ff9700 1 -- 172.21.15.6:0/3653611047 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60ac011a80 con 0x7f60b80cd400 2023-10-06T02:29:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.551+0000 7f60b4ff9700 1 --2- 172.21.15.6:0/3653611047 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60a4066f30 0x7f60a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.551+0000 7f60b4ff9700 1 -- 172.21.15.6:0/3653611047 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 9388+0+0 (secure 0 0 0) 0x7f60ac086720 con 0x7f60b80cd400 2023-10-06T02:29:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.552+0000 7f60bcc6c700 1 --2- 172.21.15.6:0/3653611047 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60a4066f30 0x7f60a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.552+0000 7f60bcc6c700 1 --2- 172.21.15.6:0/3653611047 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60a4066f30 0x7f60a40693e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f60b0007fd0 tx=0x7f60b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:08.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.556+0000 7f60b4ff9700 1 -- 172.21.15.6:0/3653611047 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60ac052b70 con 0x7f60b80cd400 2023-10-06T02:29:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:08.796+0000 7f60bdc6e700 1 -- 172.21.15.6:0/3653611047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f60b80b0010 con 0x7f60b80cd400 2023-10-06T02:29:09.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.017+0000 7f60b4ff9700 1 -- 172.21.15.6:0/3653611047 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v315) v1 ==== 162+0+0 (secure 0 0 0) 0x7f60ac0150b0 con 0x7f60b80cd400 2023-10-06T02:29:09.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.019+0000 7f60bdc6e700 1 -- 172.21.15.6:0/3653611047 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60a4066f30 msgr2=0x7f60a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:09.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.019+0000 7f60bdc6e700 1 --2- 172.21.15.6:0/3653611047 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60a4066f30 0x7f60a40693e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f60b0007fd0 tx=0x7f60b0009040 comp rx=0 tx=0).stop 2023-10-06T02:29:09.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.020+0000 7f60bdc6e700 1 -- 172.21.15.6:0/3653611047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b80cd400 msgr2=0x7f60b81537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:09.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.020+0000 7f60bdc6e700 1 --2- 172.21.15.6:0/3653611047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b80cd400 0x7f60b81537e0 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f60b8089070 tx=0x7f60ac017000 comp rx=0 tx=0).stop 2023-10-06T02:29:09.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.020+0000 7f60bdc6e700 1 -- 172.21.15.6:0/3653611047 shutdown_connections 2023-10-06T02:29:09.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.020+0000 7f60bdc6e700 1 --2- 172.21.15.6:0/3653611047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b81553b0 0x7f60b80b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:09.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.020+0000 7f60bdc6e700 1 --2- 172.21.15.6:0/3653611047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60b80b0810 0x7f60b8169840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:09.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.020+0000 7f60bdc6e700 1 --2- 172.21.15.6:0/3653611047 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f60a4066f30 0x7f60a40693e0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:09.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.020+0000 7f60bdc6e700 1 --2- 172.21.15.6:0/3653611047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b80cd400 0x7f60b81537e0 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:09.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.020+0000 7f60bdc6e700 1 -- 172.21.15.6:0/3653611047 >> 172.21.15.6:0/3653611047 conn(0x7f60b806a110 msgr2=0x7f60b80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:09.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.020+0000 7f60bdc6e700 1 -- 172.21.15.6:0/3653611047 shutdown_connections 2023-10-06T02:29:09.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.020+0000 7f60bdc6e700 1 -- 172.21.15.6:0/3653611047 wait complete. 2023-10-06T02:29:09.022 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:29:09.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:09.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.155+0000 7f6aa9cc0700 1 Processor -- start 2023-10-06T02:29:09.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.155+0000 7f6aa9cc0700 1 -- start start 2023-10-06T02:29:09.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.156+0000 7f6aa9cc0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aa40d05d0 0x7f6aa41641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.156+0000 7f6aa9cc0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa40b3560 con 0x7f6aa4159400 2023-10-06T02:29:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.156+0000 7f6aa9cc0700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa40cf6f0 con 0x7f6aa40cf1a0 2023-10-06T02:29:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.156+0000 7f6aa9cc0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa40cf9d0 con 0x7f6aa40d05d0 2023-10-06T02:29:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.156+0000 7f6aa8cbe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6aa4159400 0x7f6aa40ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36256/0 (socket says 172.21.15.6:36256) 2023-10-06T02:29:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.156+0000 7f6aa8cbe700 1 -- 172.21.15.6:0/3392160923 learned_addr learned my addr 172.21.15.6:0/3392160923 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.156+0000 7f6aa94bf700 1 --2- 172.21.15.6:0/3392160923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aa40d05d0 0x7f6aa41641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.156+0000 7f6aa37fe700 1 -- 172.21.15.6:0/3392160923 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127148523 0 0) 0x7f6aa40b3560 con 0x7f6aa4159400 2023-10-06T02:29:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.156+0000 7f6aa37fe700 1 -- 172.21.15.6:0/3392160923 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a8c003570 con 0x7f6aa4159400 2023-10-06T02:29:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.156+0000 7f6aa37fe700 1 -- 172.21.15.6:0/3392160923 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556758515 0 0) 0x7f6aa40cf6f0 con 0x7f6aa40cf1a0 2023-10-06T02:29:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.156+0000 7f6aa37fe700 1 -- 172.21.15.6:0/3392160923 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aa40b3560 con 0x7f6aa40cf1a0 2023-10-06T02:29:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.157+0000 7f6aa94bf700 1 -- 172.21.15.6:0/3392160923 >> v1:172.21.15.175:6789/0 conn(0x7f6aa40cf1a0 legacy=0x7f6aa40cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.157+0000 7f6aa94bf700 1 -- 172.21.15.6:0/3392160923 >> v1:172.21.15.6:6789/0 conn(0x7f6aa4159400 legacy=0x7f6aa40ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.157+0000 7f6aa94bf700 1 -- 172.21.15.6:0/3392160923 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa40b2f10 con 0x7f6aa40d05d0 2023-10-06T02:29:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.157+0000 7f6aa94bf700 1 --2- 172.21.15.6:0/3392160923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aa40d05d0 0x7f6aa41641d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c009e90 tx=0x7f6a9c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e125f3a800ab1fa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.157+0000 7f6aa37fe700 1 -- 172.21.15.6:0/3392160923 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c00e070 con 0x7f6aa40d05d0 2023-10-06T02:29:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.157+0000 7f6aa37fe700 1 -- 172.21.15.6:0/3392160923 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c00bb80 con 0x7f6aa40d05d0 2023-10-06T02:29:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.157+0000 7f6aa37fe700 1 -- 172.21.15.6:0/3392160923 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c012430 con 0x7f6aa40d05d0 2023-10-06T02:29:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.157+0000 7f6aa9cc0700 1 -- 172.21.15.6:0/3392160923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aa40d05d0 msgr2=0x7f6aa41641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.157+0000 7f6aa9cc0700 1 --2- 172.21.15.6:0/3392160923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aa40d05d0 0x7f6aa41641d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c009e90 tx=0x7f6a9c009780 comp rx=0 tx=0).stop 2023-10-06T02:29:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.157+0000 7f6aa9cc0700 1 -- 172.21.15.6:0/3392160923 shutdown_connections 2023-10-06T02:29:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.157+0000 7f6aa9cc0700 1 --2- 172.21.15.6:0/3392160923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aa40d05d0 0x7f6aa41641d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.157+0000 7f6aa9cc0700 1 -- 172.21.15.6:0/3392160923 >> 172.21.15.6:0/3392160923 conn(0x7f6aa406ac10 msgr2=0x7f6aa4068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.158+0000 7f6aa9cc0700 1 -- 172.21.15.6:0/3392160923 shutdown_connections 2023-10-06T02:29:09.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.158+0000 7f6aa9cc0700 1 -- 172.21.15.6:0/3392160923 wait complete. 2023-10-06T02:29:09.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.159+0000 7f6aa9cc0700 1 Processor -- start 2023-10-06T02:29:09.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.159+0000 7f6aa9cc0700 1 -- start start 2023-10-06T02:29:09.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa9cc0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aa40cf1a0 0x7f6aa4149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:09.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa9cc0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aa40d05d0 0x7f6aa40c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:09.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa9cc0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6aa4159400 0x7f6aa40b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa9cc0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa40c5f90 con 0x7f6aa40cf1a0 2023-10-06T02:29:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa9cc0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa40c50c0 con 0x7f6aa4159400 2023-10-06T02:29:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa9cc0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa40c5380 con 0x7f6aa40d05d0 2023-10-06T02:29:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa8cbe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aa40cf1a0 0x7f6aa4149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa8cbe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aa40cf1a0 0x7f6aa4149ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42490/0 (socket says 172.21.15.6:42490) 2023-10-06T02:29:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa8cbe700 1 -- 172.21.15.6:0/152752976 learned_addr learned my addr 172.21.15.6:0/152752976 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa3fff700 1 --2- 172.21.15.6:0/152752976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aa40d05d0 0x7f6aa40c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa94bf700 1 --2- 172.21.15.6:0/152752976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6aa4159400 0x7f6aa40b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa8cbe700 1 -- 172.21.15.6:0/152752976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aa40d05d0 msgr2=0x7f6aa40c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa8cbe700 1 --2- 172.21.15.6:0/152752976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aa40d05d0 0x7f6aa40c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa8cbe700 1 -- 172.21.15.6:0/152752976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6aa4159400 msgr2=0x7f6aa40b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa8cbe700 1 --2- 172.21.15.6:0/152752976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6aa4159400 0x7f6aa40b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa8cbe700 1 -- 172.21.15.6:0/152752976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c009a20 con 0x7f6aa40cf1a0 2023-10-06T02:29:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa3fff700 1 --2- 172.21.15.6:0/152752976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aa40d05d0 0x7f6aa40c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa94bf700 1 --2- 172.21.15.6:0/152752976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6aa4159400 0x7f6aa40b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa8cbe700 1 --2- 172.21.15.6:0/152752976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aa40cf1a0 0x7f6aa4149ae0 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f6a9400c790 tx=0x7f6a94007ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa0ff9700 1 -- 172.21.15.6:0/152752976 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a940072e0 con 0x7f6aa40cf1a0 2023-10-06T02:29:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa0ff9700 1 -- 172.21.15.6:0/152752976 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a94007440 con 0x7f6aa40cf1a0 2023-10-06T02:29:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa0ff9700 1 -- 172.21.15.6:0/152752976 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a940057f0 con 0x7f6aa40cf1a0 2023-10-06T02:29:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa9cc0700 1 -- 172.21.15.6:0/152752976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa40c5660 con 0x7f6aa40cf1a0 2023-10-06T02:29:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.160+0000 7f6aa9cc0700 1 -- 172.21.15.6:0/152752976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa40c5c20 con 0x7f6aa40cf1a0 2023-10-06T02:29:09.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.161+0000 7f6aa9cc0700 1 -- 172.21.15.6:0/152752976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa40b31f0 con 0x7f6aa40cf1a0 2023-10-06T02:29:09.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.162+0000 7f6aa0ff9700 1 -- 172.21.15.6:0/152752976 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a94005be0 con 0x7f6aa40cf1a0 2023-10-06T02:29:09.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.162+0000 7f6aa0ff9700 1 --2- 172.21.15.6:0/152752976 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6a90066f30 0x7f6a900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:09.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.162+0000 7f6aa0ff9700 1 -- 172.21.15.6:0/152752976 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 9388+0+0 (secure 0 0 0) 0x7f6a940849f0 con 0x7f6aa40cf1a0 2023-10-06T02:29:09.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.162+0000 7f6aa3fff700 1 --2- 172.21.15.6:0/152752976 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6a90066f30 0x7f6a900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:09.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.163+0000 7f6aa3fff700 1 --2- 172.21.15.6:0/152752976 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6a90066f30 0x7f6a900693e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6a98003990 tx=0x7f6a98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:09.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.166+0000 7f6aa0ff9700 1 -- 172.21.15.6:0/152752976 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a94050d30 con 0x7f6aa40cf1a0 2023-10-06T02:29:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.407+0000 7f6aa9cc0700 1 -- 172.21.15.6:0/152752976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6aa4068420 con 0x7f6aa40cf1a0 2023-10-06T02:29:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.408+0000 7f6aa0ff9700 1 -- 172.21.15.6:0/152752976 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 316 v316) v1 ==== 95+0+4607 (secure 0 0 0) 0x7f6a94017070 con 0x7f6aa40cf1a0 2023-10-06T02:29:09.409 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:09.409 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":316,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":316,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:09.018010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":130,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10398":{"gid":10398,"name":"a","rank":0,"incarnation":316,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/2198441052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2198441052},{"type":"v1","addr":"172.21.15.6:6835","nonce":2198441052}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.410+0000 7f6aa9cc0700 1 -- 172.21.15.6:0/152752976 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6a90066f30 msgr2=0x7f6a900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.410+0000 7f6aa9cc0700 1 --2- 172.21.15.6:0/152752976 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6a90066f30 0x7f6a900693e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6a98003990 tx=0x7f6a98009040 comp rx=0 tx=0).stop 2023-10-06T02:29:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.410+0000 7f6aa9cc0700 1 -- 172.21.15.6:0/152752976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aa40cf1a0 msgr2=0x7f6aa4149ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.410+0000 7f6aa9cc0700 1 --2- 172.21.15.6:0/152752976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aa40cf1a0 0x7f6aa4149ae0 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f6a9400c790 tx=0x7f6a94007ce0 comp rx=0 tx=0).stop 2023-10-06T02:29:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.410+0000 7f6aa9cc0700 1 -- 172.21.15.6:0/152752976 shutdown_connections 2023-10-06T02:29:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.410+0000 7f6aa9cc0700 1 --2- 172.21.15.6:0/152752976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6aa4159400 0x7f6aa40b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.410+0000 7f6aa9cc0700 1 --2- 172.21.15.6:0/152752976 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6a90066f30 0x7f6a900693e0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.410+0000 7f6aa9cc0700 1 --2- 172.21.15.6:0/152752976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6aa40cf1a0 0x7f6aa4149ae0 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.410+0000 7f6aa9cc0700 1 --2- 172.21.15.6:0/152752976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aa40d05d0 0x7f6aa40c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.410+0000 7f6aa9cc0700 1 -- 172.21.15.6:0/152752976 >> 172.21.15.6:0/152752976 conn(0x7f6aa406ac10 msgr2=0x7f6aa415c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.410+0000 7f6aa9cc0700 1 -- 172.21.15.6:0/152752976 shutdown_connections 2023-10-06T02:29:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:09.410+0000 7f6aa9cc0700 1 -- 172.21.15.6:0/152752976 wait complete. 2023-10-06T02:29:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 316 2023-10-06T02:29:09.423 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2023-10-06T02:29:12.035 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:29:12.034+0000 7f7511f78700 -1 mds.0.cache.dir(0x600) Corrupt fnode in dirfrag 0x600: void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&) no longer understand old encoding version 3 < 101: Malformed input 2023-10-06T02:29:12.035 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:29:12.034+0000 7f7511f78700 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x600 is fatal because it is a system directory for this rank 2023-10-06T02:29:12.036 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:29:12.035+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:29:12.036 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:29:12.035+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:29:12.043 INFO:tasks.ceph.mds.a.smithi006.stderr: -18> 2023-10-06T02:29:12.034+0000 7f7511f78700 -1 mds.0.cache.dir(0x600) Corrupt fnode in dirfrag 0x600: void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&) no longer understand old encoding version 3 < 101: Malformed input 2023-10-06T02:29:12.043 INFO:tasks.ceph.mds.a.smithi006.stderr: -15> 2023-10-06T02:29:12.034+0000 7f7511f78700 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x600 is fatal because it is a system directory for this rank 2023-10-06T02:29:12.065 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:29:14.424 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:14.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.556+0000 7f837e3f4700 1 Processor -- start 2023-10-06T02:29:14.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.556+0000 7f837e3f4700 1 -- start start 2023-10-06T02:29:14.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.557+0000 7f837e3f4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83780af390 0x7f8378158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:14.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.557+0000 7f837e3f4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8378068ca0 0x7f83781592f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.557+0000 7f837e3f4700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83780b2330 con 0x7f83780688d0 2023-10-06T02:29:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.557+0000 7f837e3f4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83780ac720 con 0x7f83780af390 2023-10-06T02:29:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.557+0000 7f837e3f4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83780b0310 con 0x7f8378068ca0 2023-10-06T02:29:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.557+0000 7f837cbf1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83780af390 0x7f8378158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.557+0000 7f837cbf1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83780af390 0x7f8378158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42526/0 (socket says 172.21.15.6:42526) 2023-10-06T02:29:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.557+0000 7f837cbf1700 1 -- 172.21.15.6:0/3125262694 learned_addr learned my addr 172.21.15.6:0/3125262694 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.557+0000 7f837dbf3700 1 --2- 172.21.15.6:0/3125262694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8378068ca0 0x7f83781592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.558+0000 7f837cbf1700 1 -- 172.21.15.6:0/3125262694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8378068ca0 msgr2=0x7f83781592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.558+0000 7f837cbf1700 1 --2- 172.21.15.6:0/3125262694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8378068ca0 0x7f83781592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.558+0000 7f837cbf1700 1 -- 172.21.15.6:0/3125262694 >> v1:172.21.15.175:6789/0 conn(0x7f83780688d0 legacy=0x7f83780afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.558+0000 7f837cbf1700 1 -- 172.21.15.6:0/3125262694 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8378159830 con 0x7f83780af390 2023-10-06T02:29:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.558+0000 7f837cbf1700 1 --2- 172.21.15.6:0/3125262694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83780af390 0x7f8378158db0 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f8368009990 tx=0x7f8368009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578422d66a0735df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:14.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.558+0000 7f836ffff700 1 -- 172.21.15.6:0/3125262694 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368005c10 con 0x7f83780af390 2023-10-06T02:29:14.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.558+0000 7f836ffff700 1 -- 172.21.15.6:0/3125262694 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8368005d70 con 0x7f83780af390 2023-10-06T02:29:14.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.558+0000 7f836ffff700 1 -- 172.21.15.6:0/3125262694 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836800b880 con 0x7f83780af390 2023-10-06T02:29:14.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.558+0000 7f837e3f4700 1 -- 172.21.15.6:0/3125262694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83780af390 msgr2=0x7f8378158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:14.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.558+0000 7f837e3f4700 1 --2- 172.21.15.6:0/3125262694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83780af390 0x7f8378158db0 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f8368009990 tx=0x7f8368009220 comp rx=0 tx=0).stop 2023-10-06T02:29:14.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.558+0000 7f837e3f4700 1 -- 172.21.15.6:0/3125262694 shutdown_connections 2023-10-06T02:29:14.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.558+0000 7f837e3f4700 1 --2- 172.21.15.6:0/3125262694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8378068ca0 0x7f83781592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:14.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.559+0000 7f837e3f4700 1 --2- 172.21.15.6:0/3125262694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83780af390 0x7f8378158db0 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:14.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.559+0000 7f837e3f4700 1 -- 172.21.15.6:0/3125262694 >> 172.21.15.6:0/3125262694 conn(0x7f8378096240 msgr2=0x7f8378069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:14.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.559+0000 7f837e3f4700 1 -- 172.21.15.6:0/3125262694 shutdown_connections 2023-10-06T02:29:14.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.559+0000 7f837e3f4700 1 -- 172.21.15.6:0/3125262694 wait complete. 2023-10-06T02:29:14.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.560+0000 7f837e3f4700 1 Processor -- start 2023-10-06T02:29:14.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.560+0000 7f837e3f4700 1 -- start start 2023-10-06T02:29:14.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.561+0000 7f837e3f4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83780688d0 0x7f837816aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:14.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.561+0000 7f837e3f4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8378068ca0 0x7f8378099230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:14.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.561+0000 7f837e3f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83780af390 0x7f83780c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:14.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.561+0000 7f837e3f4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837816b000 con 0x7f83780af390 2023-10-06T02:29:14.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.561+0000 7f837e3f4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8378099770 con 0x7f8378068ca0 2023-10-06T02:29:14.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.561+0000 7f837e3f4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83780c2140 con 0x7f83780688d0 2023-10-06T02:29:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.561+0000 7f837dbf3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83780af390 0x7f83780c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.561+0000 7f837dbf3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83780af390 0x7f83780c1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42542/0 (socket says 172.21.15.6:42542) 2023-10-06T02:29:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.561+0000 7f837dbf3700 1 -- 172.21.15.6:0/1095018463 learned_addr learned my addr 172.21.15.6:0/1095018463 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.561+0000 7f837d3f2700 1 --2- 172.21.15.6:0/1095018463 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83780688d0 0x7f837816aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.561+0000 7f837cbf1700 1 --2- 172.21.15.6:0/1095018463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8378068ca0 0x7f8378099230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.561+0000 7f837dbf3700 1 -- 172.21.15.6:0/1095018463 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83780688d0 msgr2=0x7f837816aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.561+0000 7f837dbf3700 1 --2- 172.21.15.6:0/1095018463 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83780688d0 0x7f837816aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.561+0000 7f837dbf3700 1 -- 172.21.15.6:0/1095018463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8378068ca0 msgr2=0x7f8378099230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.561+0000 7f837dbf3700 1 --2- 172.21.15.6:0/1095018463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8378068ca0 0x7f8378099230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.561+0000 7f837dbf3700 1 -- 172.21.15.6:0/1095018463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8368009480 con 0x7f83780af390 2023-10-06T02:29:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.561+0000 7f837dbf3700 1 --2- 172.21.15.6:0/1095018463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83780af390 0x7f83780c1c00 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f8370009fa0 tx=0x7f8370009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.562+0000 7f836d7fa700 1 -- 172.21.15.6:0/1095018463 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837000ed20 con 0x7f83780af390 2023-10-06T02:29:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.562+0000 7f836d7fa700 1 -- 172.21.15.6:0/1095018463 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837000ee80 con 0x7f83780af390 2023-10-06T02:29:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.562+0000 7f837e3f4700 1 -- 172.21.15.6:0/1095018463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83780c23e0 con 0x7f83780af390 2023-10-06T02:29:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.562+0000 7f836d7fa700 1 -- 172.21.15.6:0/1095018463 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370014670 con 0x7f83780af390 2023-10-06T02:29:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.562+0000 7f837e3f4700 1 -- 172.21.15.6:0/1095018463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83780c29a0 con 0x7f83780af390 2023-10-06T02:29:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.563+0000 7f837e3f4700 1 -- 172.21.15.6:0/1095018463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83780ac4f0 con 0x7f83780af390 2023-10-06T02:29:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.563+0000 7f836d7fa700 1 -- 172.21.15.6:0/1095018463 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83700149e0 con 0x7f83780af390 2023-10-06T02:29:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.563+0000 7f836d7fa700 1 --2- 172.21.15.6:0/1095018463 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f835c066f30 0x7f835c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.564+0000 7f836d7fa700 1 -- 172.21.15.6:0/1095018463 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 9474+0+0 (secure 0 0 0) 0x7f8370085c20 con 0x7f83780af390 2023-10-06T02:29:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.564+0000 7f837d3f2700 1 --2- 172.21.15.6:0/1095018463 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f835c066f30 0x7f835c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:14.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.564+0000 7f837d3f2700 1 --2- 172.21.15.6:0/1095018463 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f835c066f30 0x7f835c0693e0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8374003890 tx=0x7f8374009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:14.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.568+0000 7f836d7fa700 1 -- 172.21.15.6:0/1095018463 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8370051f90 con 0x7f83780af390 2023-10-06T02:29:14.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.805+0000 7f837e3f4700 1 -- 172.21.15.6:0/1095018463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83780b25d0 con 0x7f83780af390 2023-10-06T02:29:14.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.805+0000 7f836d7fa700 1 -- 172.21.15.6:0/1095018463 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 321 v321) v1 ==== 95+0+4596 (secure 0 0 0) 0x7f83700555b0 con 0x7f83780af390 2023-10-06T02:29:14.806 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:14.806 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":321,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10443,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1486243669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1486243669},{"type":"v1","addr":"172.21.15.6:6835","nonce":1486243669}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":321}],"filesystems":[{"mdsmap":{"epoch":320,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:12.036207+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":131,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:14.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.807+0000 7f837e3f4700 1 -- 172.21.15.6:0/1095018463 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f835c066f30 msgr2=0x7f835c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:14.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.807+0000 7f837e3f4700 1 --2- 172.21.15.6:0/1095018463 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f835c066f30 0x7f835c0693e0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8374003890 tx=0x7f8374009040 comp rx=0 tx=0).stop 2023-10-06T02:29:14.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.807+0000 7f837e3f4700 1 -- 172.21.15.6:0/1095018463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83780af390 msgr2=0x7f83780c1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:14.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.807+0000 7f837e3f4700 1 --2- 172.21.15.6:0/1095018463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83780af390 0x7f83780c1c00 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f8370009fa0 tx=0x7f8370009900 comp rx=0 tx=0).stop 2023-10-06T02:29:14.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.807+0000 7f837e3f4700 1 -- 172.21.15.6:0/1095018463 shutdown_connections 2023-10-06T02:29:14.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.807+0000 7f837e3f4700 1 --2- 172.21.15.6:0/1095018463 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f835c066f30 0x7f835c0693e0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:14.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.807+0000 7f837e3f4700 1 --2- 172.21.15.6:0/1095018463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83780af390 0x7f83780c1c00 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:14.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.807+0000 7f837e3f4700 1 --2- 172.21.15.6:0/1095018463 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83780688d0 0x7f837816aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:14.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.807+0000 7f837e3f4700 1 --2- 172.21.15.6:0/1095018463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8378068ca0 0x7f8378099230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:14.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.807+0000 7f837e3f4700 1 -- 172.21.15.6:0/1095018463 >> 172.21.15.6:0/1095018463 conn(0x7f8378096240 msgr2=0x7f837806b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:14.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.807+0000 7f837e3f4700 1 -- 172.21.15.6:0/1095018463 shutdown_connections 2023-10-06T02:29:14.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.807+0000 7f837e3f4700 1 -- 172.21.15.6:0/1095018463 wait complete. 2023-10-06T02:29:14.809 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 321 2023-10-06T02:29:14.820 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:29:14.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.938+0000 7fdadce87700 1 Processor -- start 2023-10-06T02:29:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.938+0000 7fdadce87700 1 -- start start 2023-10-06T02:29:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.939+0000 7fdadce87700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdad815ca10 0x7fdad8069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.939+0000 7fdadce87700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdad815cde0 0x7fdad80b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.939+0000 7fdadce87700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad80b1ed0 con 0x7fdad8067d10 2023-10-06T02:29:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.939+0000 7fdadce87700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad80879c0 con 0x7fdad815cde0 2023-10-06T02:29:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.939+0000 7fdadce87700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad80cec50 con 0x7fdad815ca10 2023-10-06T02:29:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.939+0000 7fdad6d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdad815cde0 0x7fdad80b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.940+0000 7fdad6d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdad815cde0 0x7fdad80b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42550/0 (socket says 172.21.15.6:42550) 2023-10-06T02:29:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.940+0000 7fdad6d9d700 1 -- 172.21.15.6:0/3366698847 learned_addr learned my addr 172.21.15.6:0/3366698847 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.940+0000 7fdad659c700 1 --2- 172.21.15.6:0/3366698847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdad815ca10 0x7fdad8069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.940+0000 7fdad6d9d700 1 -- 172.21.15.6:0/3366698847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdad815ca10 msgr2=0x7fdad8069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.940+0000 7fdad6d9d700 1 --2- 172.21.15.6:0/3366698847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdad815ca10 0x7fdad8069f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:14.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.940+0000 7fdad6d9d700 1 -- 172.21.15.6:0/3366698847 >> v1:172.21.15.175:6789/0 conn(0x7fdad8067d10 legacy=0x7fdad806a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:14.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.940+0000 7fdad6d9d700 1 -- 172.21.15.6:0/3366698847 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad80cef30 con 0x7fdad815cde0 2023-10-06T02:29:14.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.940+0000 7fdad6d9d700 1 --2- 172.21.15.6:0/3366698847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdad815cde0 0x7fdad80b2360 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009f20 tx=0x7fdac8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c35023e67795236 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:14.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.940+0000 7fdad559a700 1 -- 172.21.15.6:0/3366698847 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac800e070 con 0x7fdad815cde0 2023-10-06T02:29:14.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.940+0000 7fdad559a700 1 -- 172.21.15.6:0/3366698847 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac800ba40 con 0x7fdad815cde0 2023-10-06T02:29:14.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.940+0000 7fdad559a700 1 -- 172.21.15.6:0/3366698847 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac80092e0 con 0x7fdad815cde0 2023-10-06T02:29:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.941+0000 7fdadce87700 1 -- 172.21.15.6:0/3366698847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdad815cde0 msgr2=0x7fdad80b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.941+0000 7fdadce87700 1 --2- 172.21.15.6:0/3366698847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdad815cde0 0x7fdad80b2360 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009f20 tx=0x7fdac8009840 comp rx=0 tx=0).stop 2023-10-06T02:29:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.941+0000 7fdadce87700 1 -- 172.21.15.6:0/3366698847 shutdown_connections 2023-10-06T02:29:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.941+0000 7fdadce87700 1 --2- 172.21.15.6:0/3366698847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdad815cde0 0x7fdad80b2360 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.941+0000 7fdadce87700 1 --2- 172.21.15.6:0/3366698847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdad815ca10 0x7fdad8069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.941+0000 7fdadce87700 1 -- 172.21.15.6:0/3366698847 >> 172.21.15.6:0/3366698847 conn(0x7fdad8067910 msgr2=0x7fdad80ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.941+0000 7fdadce87700 1 -- 172.21.15.6:0/3366698847 shutdown_connections 2023-10-06T02:29:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.941+0000 7fdadce87700 1 -- 172.21.15.6:0/3366698847 wait complete. 2023-10-06T02:29:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.942+0000 7fdadce87700 1 Processor -- start 2023-10-06T02:29:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.942+0000 7fdadce87700 1 -- start start 2023-10-06T02:29:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdadce87700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdad8067d10 0x7fdad815f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdadce87700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdad815ca10 0x7fdad80cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdadce87700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdad815cde0 0x7fdad8169dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdadce87700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad816a300 con 0x7fdad815ca10 2023-10-06T02:29:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdadce87700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad8098890 con 0x7fdad8067d10 2023-10-06T02:29:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdadce87700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad815e730 con 0x7fdad815cde0 2023-10-06T02:29:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdad5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdad815ca10 0x7fdad80cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdad5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdad815ca10 0x7fdad80cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42556/0 (socket says 172.21.15.6:42556) 2023-10-06T02:29:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdad5d9b700 1 -- 172.21.15.6:0/950492091 learned_addr learned my addr 172.21.15.6:0/950492091 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdad659c700 1 --2- 172.21.15.6:0/950492091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdad8067d10 0x7fdad815f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdad6d9d700 1 --2- 172.21.15.6:0/950492091 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdad815cde0 0x7fdad8169dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdad5d9b700 1 -- 172.21.15.6:0/950492091 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdad815cde0 msgr2=0x7fdad8169dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdad5d9b700 1 --2- 172.21.15.6:0/950492091 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdad815cde0 0x7fdad8169dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdad5d9b700 1 -- 172.21.15.6:0/950492091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdad8067d10 msgr2=0x7fdad815f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdad5d9b700 1 --2- 172.21.15.6:0/950492091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdad8067d10 0x7fdad815f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:14.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdad5d9b700 1 -- 172.21.15.6:0/950492091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac8009ae0 con 0x7fdad815ca10 2023-10-06T02:29:14.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdad5d9b700 1 --2- 172.21.15.6:0/950492091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdad815ca10 0x7fdad80cdbb0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fdac000c5d0 tx=0x7fdac0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:14.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdace7fc700 1 -- 172.21.15.6:0/950492091 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac0011590 con 0x7fdad815ca10 2023-10-06T02:29:14.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdace7fc700 1 -- 172.21.15.6:0/950492091 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac0011710 con 0x7fdad815ca10 2023-10-06T02:29:14.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdace7fc700 1 -- 172.21.15.6:0/950492091 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac0011ad0 con 0x7fdad815ca10 2023-10-06T02:29:14.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdadce87700 1 -- 172.21.15.6:0/950492091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad815ea10 con 0x7fdad815ca10 2023-10-06T02:29:14.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.943+0000 7fdadce87700 1 -- 172.21.15.6:0/950492091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad815efd0 con 0x7fdad815ca10 2023-10-06T02:29:14.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.944+0000 7fdadce87700 1 -- 172.21.15.6:0/950492091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad806e8d0 con 0x7fdad815ca10 2023-10-06T02:29:14.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.945+0000 7fdace7fc700 1 -- 172.21.15.6:0/950492091 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdac001c460 con 0x7fdad815ca10 2023-10-06T02:29:14.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.945+0000 7fdace7fc700 1 --2- 172.21.15.6:0/950492091 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdab8066f30 0x7fdab80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:14.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.945+0000 7fdace7fc700 1 -- 172.21.15.6:0/950492091 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 9474+0+0 (secure 0 0 0) 0x7fdac00850f0 con 0x7fdad815ca10 2023-10-06T02:29:14.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.945+0000 7fdad659c700 1 --2- 172.21.15.6:0/950492091 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdab8066f30 0x7fdab80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:14.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.946+0000 7fdad659c700 1 --2- 172.21.15.6:0/950492091 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdab8066f30 0x7fdab80693e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fdad815c2f0 tx=0x7fdad0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:14.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:14.950+0000 7fdace7fc700 1 -- 172.21.15.6:0/950492091 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdac0051460 con 0x7fdad815ca10 2023-10-06T02:29:15.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.189+0000 7fdadce87700 1 -- 172.21.15.6:0/950492091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdad80b1b60 con 0x7fdad815ca10 2023-10-06T02:29:15.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.189+0000 7fdace7fc700 1 -- 172.21.15.6:0/950492091 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 321 v321) v1 ==== 95+0+4596 (secure 0 0 0) 0x7fdac0054a80 con 0x7fdad815ca10 2023-10-06T02:29:15.190 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:15.190 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":321,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10443,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1486243669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1486243669},{"type":"v1","addr":"172.21.15.6:6835","nonce":1486243669}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":321}],"filesystems":[{"mdsmap":{"epoch":320,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:12.036207+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":131,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:15.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.191+0000 7fdadce87700 1 -- 172.21.15.6:0/950492091 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdab8066f30 msgr2=0x7fdab80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:15.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.191+0000 7fdadce87700 1 --2- 172.21.15.6:0/950492091 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdab8066f30 0x7fdab80693e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fdad815c2f0 tx=0x7fdad0008040 comp rx=0 tx=0).stop 2023-10-06T02:29:15.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.191+0000 7fdadce87700 1 -- 172.21.15.6:0/950492091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdad815ca10 msgr2=0x7fdad80cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:15.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.191+0000 7fdadce87700 1 --2- 172.21.15.6:0/950492091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdad815ca10 0x7fdad80cdbb0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fdac000c5d0 tx=0x7fdac0007f60 comp rx=0 tx=0).stop 2023-10-06T02:29:15.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.191+0000 7fdadce87700 1 -- 172.21.15.6:0/950492091 shutdown_connections 2023-10-06T02:29:15.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.191+0000 7fdadce87700 1 --2- 172.21.15.6:0/950492091 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdad815cde0 0x7fdad8169dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.191+0000 7fdadce87700 1 --2- 172.21.15.6:0/950492091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdad8067d10 0x7fdad815f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.191+0000 7fdadce87700 1 --2- 172.21.15.6:0/950492091 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdab8066f30 0x7fdab80693e0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.191+0000 7fdadce87700 1 --2- 172.21.15.6:0/950492091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdad815ca10 0x7fdad80cdbb0 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.191+0000 7fdadce87700 1 -- 172.21.15.6:0/950492091 >> 172.21.15.6:0/950492091 conn(0x7fdad8067910 msgr2=0x7fdad8159d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:15.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.191+0000 7fdadce87700 1 -- 172.21.15.6:0/950492091 shutdown_connections 2023-10-06T02:29:15.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.191+0000 7fdadce87700 1 -- 172.21.15.6:0/950492091 wait complete. 2023-10-06T02:29:15.193 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 321 2023-10-06T02:29:15.204 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:29:15.204 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:15.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.323+0000 7f35a8550700 1 Processor -- start 2023-10-06T02:29:15.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.323+0000 7f35a8550700 1 -- start start 2023-10-06T02:29:15.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a8550700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f35a00af4e0 0x7f35a00b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:15.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a8550700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a015db70 0x7f35a00b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:15.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a8550700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a015e190 con 0x7f35a00af8b0 2023-10-06T02:29:15.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a8550700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a00b1910 con 0x7f35a00af4e0 2023-10-06T02:29:15.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a8550700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a015dfa0 con 0x7f35a015db70 2023-10-06T02:29:15.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a62ec700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f35a00af4e0 0x7f35a00b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:15.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a5aeb700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f35a00af8b0 0x7f35a015d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36268/0 (socket says 172.21.15.6:36268) 2023-10-06T02:29:15.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a5aeb700 1 -- 172.21.15.6:0/1511003621 learned_addr learned my addr 172.21.15.6:0/1511003621 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:15.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a6aed700 1 --2- 172.21.15.6:0/1511003621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a015db70 0x7f35a00b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:15.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a62ec700 1 -- 172.21.15.6:0/1511003621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a015db70 msgr2=0x7f35a00b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:15.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a62ec700 1 --2- 172.21.15.6:0/1511003621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a015db70 0x7f35a00b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a62ec700 1 -- 172.21.15.6:0/1511003621 >> v1:172.21.15.6:6789/0 conn(0x7f35a00af8b0 legacy=0x7f35a015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:15.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a52ea700 1 -- 172.21.15.6:0/1511003621 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267999492 0 0) 0x7f35a015e190 con 0x7f35a00af8b0 2023-10-06T02:29:15.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a62ec700 1 -- 172.21.15.6:0/1511003621 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a00cb650 con 0x7f35a00af4e0 2023-10-06T02:29:15.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a62ec700 1 --2- 172.21.15.6:0/1511003621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a00af4e0 0x7f35a00b20e0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f35980098e0 tx=0x7f35980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e0631ae794e2d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:15.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a52ea700 1 -- 172.21.15.6:0/1511003621 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598009e80 con 0x7f35a00af4e0 2023-10-06T02:29:15.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a52ea700 1 -- 172.21.15.6:0/1511003621 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359800b860 con 0x7f35a00af4e0 2023-10-06T02:29:15.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.324+0000 7f35a52ea700 1 -- 172.21.15.6:0/1511003621 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800bbe0 con 0x7f35a00af4e0 2023-10-06T02:29:15.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.325+0000 7f35a8550700 1 -- 172.21.15.6:0/1511003621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a00af4e0 msgr2=0x7f35a00b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:15.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.325+0000 7f35a8550700 1 --2- 172.21.15.6:0/1511003621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a00af4e0 0x7f35a00b20e0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f35980098e0 tx=0x7f35980091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.325+0000 7f35a8550700 1 -- 172.21.15.6:0/1511003621 shutdown_connections 2023-10-06T02:29:15.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.325+0000 7f35a8550700 1 --2- 172.21.15.6:0/1511003621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a015db70 0x7f35a00b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.325+0000 7f35a8550700 1 --2- 172.21.15.6:0/1511003621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a00af4e0 0x7f35a00b20e0 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.325+0000 7f35a8550700 1 -- 172.21.15.6:0/1511003621 >> 172.21.15.6:0/1511003621 conn(0x7f35a0068680 msgr2=0x7f35a0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:15.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.325+0000 7f35a8550700 1 -- 172.21.15.6:0/1511003621 shutdown_connections 2023-10-06T02:29:15.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.325+0000 7f35a8550700 1 -- 172.21.15.6:0/1511003621 wait complete. 2023-10-06T02:29:15.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.326+0000 7f35a8550700 1 Processor -- start 2023-10-06T02:29:15.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.326+0000 7f35a8550700 1 -- start start 2023-10-06T02:29:15.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.327+0000 7f35a8550700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a00af4e0 0x7f35a0151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:15.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.327+0000 7f35a8550700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a00af8b0 0x7f35a00cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:15.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.327+0000 7f35a8550700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a015db70 0x7f35a0153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:15.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.327+0000 7f35a8550700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a01524e0 con 0x7f35a00af8b0 2023-10-06T02:29:15.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.327+0000 7f35a8550700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00cdec0 con 0x7f35a015db70 2023-10-06T02:29:15.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.327+0000 7f35a8550700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00ce160 con 0x7f35a00af4e0 2023-10-06T02:29:15.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.327+0000 7f35a5aeb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a00af8b0 0x7f35a00cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:15.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.327+0000 7f35a5aeb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a00af8b0 0x7f35a00cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42586/0 (socket says 172.21.15.6:42586) 2023-10-06T02:29:15.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.327+0000 7f35a5aeb700 1 -- 172.21.15.6:0/2947112573 learned_addr learned my addr 172.21.15.6:0/2947112573 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:15.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.327+0000 7f35a62ec700 1 --2- 172.21.15.6:0/2947112573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a00af4e0 0x7f35a0151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:15.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.327+0000 7f35a6aed700 1 --2- 172.21.15.6:0/2947112573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a015db70 0x7f35a0153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:15.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.327+0000 7f35a5aeb700 1 -- 172.21.15.6:0/2947112573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a00af4e0 msgr2=0x7f35a0151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:15.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.327+0000 7f35a5aeb700 1 --2- 172.21.15.6:0/2947112573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a00af4e0 0x7f35a0151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.327+0000 7f35a5aeb700 1 -- 172.21.15.6:0/2947112573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a015db70 msgr2=0x7f35a0153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:15.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.327+0000 7f35a5aeb700 1 --2- 172.21.15.6:0/2947112573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a015db70 0x7f35a0153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.327+0000 7f35a5aeb700 1 -- 172.21.15.6:0/2947112573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3598009420 con 0x7f35a00af8b0 2023-10-06T02:29:15.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.327+0000 7f35a5aeb700 1 --2- 172.21.15.6:0/2947112573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a00af8b0 0x7f35a00cf1b0 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f359400c810 tx=0x7f3594007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:15.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.328+0000 7f359e7fc700 1 -- 172.21.15.6:0/2947112573 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594005c00 con 0x7f35a00af8b0 2023-10-06T02:29:15.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.328+0000 7f359e7fc700 1 -- 172.21.15.6:0/2947112573 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3594005d60 con 0x7f35a00af8b0 2023-10-06T02:29:15.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.328+0000 7f35a8550700 1 -- 172.21.15.6:0/2947112573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a00ce440 con 0x7f35a00af8b0 2023-10-06T02:29:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.328+0000 7f359e7fc700 1 -- 172.21.15.6:0/2947112573 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594007320 con 0x7f35a00af8b0 2023-10-06T02:29:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.328+0000 7f35a8550700 1 -- 172.21.15.6:0/2947112573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a00cea00 con 0x7f35a00af8b0 2023-10-06T02:29:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.329+0000 7f35a8550700 1 -- 172.21.15.6:0/2947112573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a00cebf0 con 0x7f35a00af8b0 2023-10-06T02:29:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.329+0000 7f359e7fc700 1 -- 172.21.15.6:0/2947112573 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f359401b400 con 0x7f35a00af8b0 2023-10-06T02:29:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.329+0000 7f359e7fc700 1 --2- 172.21.15.6:0/2947112573 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f358c066f30 0x7f358c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.329+0000 7f359e7fc700 1 -- 172.21.15.6:0/2947112573 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 9474+0+0 (secure 0 0 0) 0x7f3594084ef0 con 0x7f35a00af8b0 2023-10-06T02:29:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.330+0000 7f35a62ec700 1 --2- 172.21.15.6:0/2947112573 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f358c066f30 0x7f358c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.330+0000 7f35a62ec700 1 --2- 172.21.15.6:0/2947112573 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f358c066f30 0x7f358c0693e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f35980091e0 tx=0x7f3598017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:15.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.334+0000 7f359e7fc700 1 -- 172.21.15.6:0/2947112573 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35940512e0 con 0x7f35a00af8b0 2023-10-06T02:29:15.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.574+0000 7f35a8550700 1 -- 172.21.15.6:0/2947112573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35a00b0910 con 0x7f35a00af8b0 2023-10-06T02:29:15.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.575+0000 7f359e7fc700 1 -- 172.21.15.6:0/2947112573 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 321 v321) v1 ==== 95+0+4596 (secure 0 0 0) 0x7f3594054900 con 0x7f35a00af8b0 2023-10-06T02:29:15.575 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:15.576 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":321,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10443,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1486243669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1486243669},{"type":"v1","addr":"172.21.15.6:6835","nonce":1486243669}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":321}],"filesystems":[{"mdsmap":{"epoch":320,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:12.036207+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":131,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:15.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.577+0000 7f35a8550700 1 -- 172.21.15.6:0/2947112573 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f358c066f30 msgr2=0x7f358c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:15.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.577+0000 7f35a8550700 1 --2- 172.21.15.6:0/2947112573 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f358c066f30 0x7f358c0693e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f35980091e0 tx=0x7f3598017000 comp rx=0 tx=0).stop 2023-10-06T02:29:15.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.577+0000 7f35a8550700 1 -- 172.21.15.6:0/2947112573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a00af8b0 msgr2=0x7f35a00cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:15.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.577+0000 7f35a8550700 1 --2- 172.21.15.6:0/2947112573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a00af8b0 0x7f35a00cf1b0 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f359400c810 tx=0x7f3594007db0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.577+0000 7f35a8550700 1 -- 172.21.15.6:0/2947112573 shutdown_connections 2023-10-06T02:29:15.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.577+0000 7f35a8550700 1 --2- 172.21.15.6:0/2947112573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a015db70 0x7f35a0153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.577+0000 7f35a8550700 1 --2- 172.21.15.6:0/2947112573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a00af4e0 0x7f35a0151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.577+0000 7f35a8550700 1 --2- 172.21.15.6:0/2947112573 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f358c066f30 0x7f358c0693e0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.577+0000 7f35a8550700 1 --2- 172.21.15.6:0/2947112573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a00af8b0 0x7f35a00cf1b0 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.577+0000 7f35a8550700 1 -- 172.21.15.6:0/2947112573 >> 172.21.15.6:0/2947112573 conn(0x7f35a0068680 msgr2=0x7f35a00cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:15.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.577+0000 7f35a8550700 1 -- 172.21.15.6:0/2947112573 shutdown_connections 2023-10-06T02:29:15.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.577+0000 7f35a8550700 1 -- 172.21.15.6:0/2947112573 wait complete. 2023-10-06T02:29:15.579 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 321 2023-10-06T02:29:15.589 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on 600.00000000' led to DAMAGED state 2023-10-06T02:29:15.589 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on mds0_openfiles.0' 2023-10-06T02:29:15.589 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:29:15.590 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:29:15.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:15.590 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:29:15.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:29:15.605 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:29:15.605 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:29:15.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.765+0000 7f3f3c80c700 1 Processor -- start 2023-10-06T02:29:15.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.765+0000 7f3f3c80c700 1 -- start start 2023-10-06T02:29:15.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.766+0000 7f3f3c80c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3f3815a030 0x7f3f3815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:15.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.766+0000 7f3f3c80c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f380afc50 con 0x7f3f38087700 2023-10-06T02:29:15.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.766+0000 7f3f3c80c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f380aff30 con 0x7f3f3815a940 2023-10-06T02:29:15.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.766+0000 7f3f3c80c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f380b0cf0 con 0x7f3f3815a030 2023-10-06T02:29:15.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.766+0000 7f3f36d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3f38087700 0x7f3f380b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36284/0 (socket says 172.21.15.6:36284) 2023-10-06T02:29:15.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.766+0000 7f3f36d9d700 1 -- 172.21.15.6:0/3465255235 learned_addr learned my addr 172.21.15.6:0/3465255235 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:15.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.766+0000 7f3f3659c700 1 --2- 172.21.15.6:0/3465255235 >> v2:172.21.15.175:3300/0 conn(0x7f3f3815a030 0x7f3f3815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:15.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.767+0000 7f3f3559a700 1 -- 172.21.15.6:0/3465255235 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425050182 0 0) 0x7f3f380afc50 con 0x7f3f38087700 2023-10-06T02:29:15.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.767+0000 7f3f3559a700 1 -- 172.21.15.6:0/3465255235 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f24003570 con 0x7f3f38087700 2023-10-06T02:29:15.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.767+0000 7f3f3659c700 1 -- 172.21.15.6:0/3465255235 >> v1:172.21.15.175:6789/0 conn(0x7f3f3815a940 legacy=0x7f3f38086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:15.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.767+0000 7f3f3659c700 1 -- 172.21.15.6:0/3465255235 >> v1:172.21.15.6:6789/0 conn(0x7f3f38087700 legacy=0x7f3f380b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:15.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.767+0000 7f3f3559a700 1 -- 172.21.15.6:0/3465255235 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 484901053 0 0) 0x7f3f24003570 con 0x7f3f38087700 2023-10-06T02:29:15.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.767+0000 7f3f3659c700 1 -- 172.21.15.6:0/3465255235 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f380b0210 con 0x7f3f3815a030 2023-10-06T02:29:15.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.767+0000 7f3f3659c700 1 --2- 172.21.15.6:0/3465255235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f3815a030 0x7f3f3815a400 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3f300098e0 tx=0x7f3f300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbe62d9b99e2d106 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:15.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.767+0000 7f3f3559a700 1 -- 172.21.15.6:0/3465255235 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f280017f0 con 0x7f3f3815a030 2023-10-06T02:29:15.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.767+0000 7f3f3559a700 1 -- 172.21.15.6:0/3465255235 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f30011420 con 0x7f3f3815a030 2023-10-06T02:29:15.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.767+0000 7f3f3559a700 1 -- 172.21.15.6:0/3465255235 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f300117c0 con 0x7f3f3815a030 2023-10-06T02:29:15.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.768+0000 7f3f3c80c700 1 -- 172.21.15.6:0/3465255235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f3815a030 msgr2=0x7f3f3815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:15.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.768+0000 7f3f3c80c700 1 --2- 172.21.15.6:0/3465255235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f3815a030 0x7f3f3815a400 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3f300098e0 tx=0x7f3f300091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.768+0000 7f3f3c80c700 1 -- 172.21.15.6:0/3465255235 shutdown_connections 2023-10-06T02:29:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.768+0000 7f3f3c80c700 1 --2- 172.21.15.6:0/3465255235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f3815a030 0x7f3f3815a400 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.768+0000 7f3f3c80c700 1 -- 172.21.15.6:0/3465255235 >> 172.21.15.6:0/3465255235 conn(0x7f3f38068680 msgr2=0x7f3f38068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.768+0000 7f3f3c80c700 1 -- 172.21.15.6:0/3465255235 shutdown_connections 2023-10-06T02:29:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.768+0000 7f3f3c80c700 1 -- 172.21.15.6:0/3465255235 wait complete. 2023-10-06T02:29:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.769+0000 7f3f3c80c700 1 Processor -- start 2023-10-06T02:29:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.769+0000 7f3f3c80c700 1 -- start start 2023-10-06T02:29:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f3c80c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f38087700 0x7f3f3814b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f3c80c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f3815a030 0x7f3f380c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f3c80c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f3815a940 0x7f3f3815c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f3c80c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f380c4610 con 0x7f3f3815a030 2023-10-06T02:29:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f3c80c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3815be10 con 0x7f3f38087700 2023-10-06T02:29:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f3c80c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f380c3ce0 con 0x7f3f3815a940 2023-10-06T02:29:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f35d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f3815a030 0x7f3f380c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f35d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f3815a030 0x7f3f380c7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42590/0 (socket says 172.21.15.6:42590) 2023-10-06T02:29:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f35d9b700 1 -- 172.21.15.6:0/2187302372 learned_addr learned my addr 172.21.15.6:0/2187302372 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f3659c700 1 --2- 172.21.15.6:0/2187302372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f38087700 0x7f3f3814b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f36d9d700 1 --2- 172.21.15.6:0/2187302372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f3815a940 0x7f3f3815c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f35d9b700 1 -- 172.21.15.6:0/2187302372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f3815a940 msgr2=0x7f3f3815c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f35d9b700 1 --2- 172.21.15.6:0/2187302372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f3815a940 0x7f3f3815c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f35d9b700 1 -- 172.21.15.6:0/2187302372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f38087700 msgr2=0x7f3f3814b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f35d9b700 1 --2- 172.21.15.6:0/2187302372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f38087700 0x7f3f3814b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f35d9b700 1 -- 172.21.15.6:0/2187302372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f30009420 con 0x7f3f3815a030 2023-10-06T02:29:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f36d9d700 1 --2- 172.21.15.6:0/2187302372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f3815a940 0x7f3f3815c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f35d9b700 1 --2- 172.21.15.6:0/2187302372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f3815a030 0x7f3f380c7cd0 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000c560 tx=0x7f3f20007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:15.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f2e7fc700 1 -- 172.21.15.6:0/2187302372 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f20011590 con 0x7f3f3815a030 2023-10-06T02:29:15.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f2e7fc700 1 -- 172.21.15.6:0/2187302372 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f20011710 con 0x7f3f3815a030 2023-10-06T02:29:15.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f3c80c700 1 -- 172.21.15.6:0/2187302372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f380c3fc0 con 0x7f3f3815a030 2023-10-06T02:29:15.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.770+0000 7f3f2e7fc700 1 -- 172.21.15.6:0/2187302372 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f20011ad0 con 0x7f3f3815a030 2023-10-06T02:29:15.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.771+0000 7f3f3c80c700 1 -- 172.21.15.6:0/2187302372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3814bef0 con 0x7f3f3815a030 2023-10-06T02:29:15.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.771+0000 7f3f3c80c700 1 -- 172.21.15.6:0/2187302372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f38088700 con 0x7f3f3815a030 2023-10-06T02:29:15.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.772+0000 7f3f2e7fc700 1 -- 172.21.15.6:0/2187302372 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f2001b3b0 con 0x7f3f3815a030 2023-10-06T02:29:15.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.772+0000 7f3f2e7fc700 1 --2- 172.21.15.6:0/2187302372 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3f18066f30 0x7f3f180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:15.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.772+0000 7f3f2e7fc700 1 -- 172.21.15.6:0/2187302372 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 9474+0+0 (secure 0 0 0) 0x7f3f20084850 con 0x7f3f3815a030 2023-10-06T02:29:15.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.773+0000 7f3f3659c700 1 --2- 172.21.15.6:0/2187302372 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3f18066f30 0x7f3f180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:15.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.773+0000 7f3f3659c700 1 --2- 172.21.15.6:0/2187302372 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3f18066f30 0x7f3f180693e0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3f300097b0 tx=0x7f3f30016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:15.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:15.777+0000 7f3f2e7fc700 1 -- 172.21.15.6:0/2187302372 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f20050bc0 con 0x7f3f3815a030 2023-10-06T02:29:16.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.015+0000 7f3f3c80c700 1 -- 172.21.15.6:0/2187302372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3f380b04f0 con 0x7f3f3815a030 2023-10-06T02:29:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.051+0000 7f3f2e7fc700 1 -- 172.21.15.6:0/2187302372 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v322) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3f20017030 con 0x7f3f3815a030 2023-10-06T02:29:16.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.053+0000 7f3f3c80c700 1 -- 172.21.15.6:0/2187302372 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3f18066f30 msgr2=0x7f3f180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:16.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.053+0000 7f3f3c80c700 1 --2- 172.21.15.6:0/2187302372 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3f18066f30 0x7f3f180693e0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3f300097b0 tx=0x7f3f30016000 comp rx=0 tx=0).stop 2023-10-06T02:29:16.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.053+0000 7f3f3c80c700 1 -- 172.21.15.6:0/2187302372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f3815a030 msgr2=0x7f3f380c7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:16.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.053+0000 7f3f3c80c700 1 --2- 172.21.15.6:0/2187302372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f3815a030 0x7f3f380c7cd0 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000c560 tx=0x7f3f20007f20 comp rx=0 tx=0).stop 2023-10-06T02:29:16.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.053+0000 7f3f3c80c700 1 -- 172.21.15.6:0/2187302372 shutdown_connections 2023-10-06T02:29:16.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.053+0000 7f3f3c80c700 1 --2- 172.21.15.6:0/2187302372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f3815a940 0x7f3f3815c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:16.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.053+0000 7f3f3c80c700 1 --2- 172.21.15.6:0/2187302372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f38087700 0x7f3f3814b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:16.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.053+0000 7f3f3c80c700 1 --2- 172.21.15.6:0/2187302372 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3f18066f30 0x7f3f180693e0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:16.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.053+0000 7f3f3c80c700 1 --2- 172.21.15.6:0/2187302372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f3815a030 0x7f3f380c7cd0 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:16.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.053+0000 7f3f3c80c700 1 -- 172.21.15.6:0/2187302372 >> 172.21.15.6:0/2187302372 conn(0x7f3f38068680 msgr2=0x7f3f380cb730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:16.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.053+0000 7f3f3c80c700 1 -- 172.21.15.6:0/2187302372 shutdown_connections 2023-10-06T02:29:16.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.054+0000 7f3f3c80c700 1 -- 172.21.15.6:0/2187302372 wait complete. 2023-10-06T02:29:16.056 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:29:16.066 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:29:16.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.185+0000 7f30494fb700 1 Processor -- start 2023-10-06T02:29:16.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.185+0000 7f30494fb700 1 -- start start 2023-10-06T02:29:16.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.186+0000 7f30494fb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f30440cf1a0 0x7f30440cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:16.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.186+0000 7f30494fb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f30441597d0 0x7f30440d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:16.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.186+0000 7f30494fb700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30440b3560 con 0x7f3044159400 2023-10-06T02:29:16.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.186+0000 7f30494fb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30440cf6f0 con 0x7f30440cf1a0 2023-10-06T02:29:16.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.186+0000 7f30494fb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30440cf9d0 con 0x7f30441597d0 2023-10-06T02:29:16.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.186+0000 7f30437fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f30440cf1a0 0x7f30440cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:16.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.186+0000 7f30437fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f30440cf1a0 0x7f30440cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42606/0 (socket says 172.21.15.6:42606) 2023-10-06T02:29:16.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.186+0000 7f30437fe700 1 -- 172.21.15.6:0/748425836 learned_addr learned my addr 172.21.15.6:0/748425836 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:16.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.186+0000 7f3048cfa700 1 --2- 172.21.15.6:0/748425836 >> v2:172.21.15.175:3300/0 conn(0x7f30441597d0 0x7f30440d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:16.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.186+0000 7f30437fe700 1 -- 172.21.15.6:0/748425836 >> v2:172.21.15.175:3300/0 conn(0x7f30441597d0 msgr2=0x7f30440d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:16.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.187+0000 7f30437fe700 1 --2- 172.21.15.6:0/748425836 >> v2:172.21.15.175:3300/0 conn(0x7f30441597d0 0x7f30440d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:16.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.187+0000 7f30437fe700 1 -- 172.21.15.6:0/748425836 >> v1:172.21.15.175:6789/0 conn(0x7f3044159400 legacy=0x7f30440ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:16.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.187+0000 7f30437fe700 1 -- 172.21.15.6:0/748425836 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30440b2f10 con 0x7f30440cf1a0 2023-10-06T02:29:16.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.187+0000 7f30437fe700 1 --2- 172.21.15.6:0/748425836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30440cf1a0 0x7f30440cfec0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f3044069710 tx=0x7f3038009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2c91a81d6c6852 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:16.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.187+0000 7f3042ffd700 1 -- 172.21.15.6:0/748425836 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303800b820 con 0x7f30440cf1a0 2023-10-06T02:29:16.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.187+0000 7f3042ffd700 1 -- 172.21.15.6:0/748425836 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303800b980 con 0x7f30440cf1a0 2023-10-06T02:29:16.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.187+0000 7f3042ffd700 1 -- 172.21.15.6:0/748425836 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303800bd20 con 0x7f30440cf1a0 2023-10-06T02:29:16.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.187+0000 7f30494fb700 1 -- 172.21.15.6:0/748425836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30440cf1a0 msgr2=0x7f30440cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.187+0000 7f30494fb700 1 --2- 172.21.15.6:0/748425836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30440cf1a0 0x7f30440cfec0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f3044069710 tx=0x7f3038009250 comp rx=0 tx=0).stop 2023-10-06T02:29:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.187+0000 7f30494fb700 1 -- 172.21.15.6:0/748425836 shutdown_connections 2023-10-06T02:29:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.187+0000 7f30494fb700 1 --2- 172.21.15.6:0/748425836 >> v2:172.21.15.175:3300/0 conn(0x7f30441597d0 0x7f30440d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.187+0000 7f30494fb700 1 --2- 172.21.15.6:0/748425836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30440cf1a0 0x7f30440cfec0 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.187+0000 7f30494fb700 1 -- 172.21.15.6:0/748425836 >> 172.21.15.6:0/748425836 conn(0x7f304406ac10 msgr2=0x7f3044068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.187+0000 7f30494fb700 1 -- 172.21.15.6:0/748425836 shutdown_connections 2023-10-06T02:29:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.187+0000 7f30494fb700 1 -- 172.21.15.6:0/748425836 wait complete. 2023-10-06T02:29:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.189+0000 7f30494fb700 1 Processor -- start 2023-10-06T02:29:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.189+0000 7f30494fb700 1 -- start start 2023-10-06T02:29:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.189+0000 7f30494fb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30440cf1a0 0x7f30441533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.189+0000 7f30494fb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3044159400 0x7f304415f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.189+0000 7f30494fb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30441597d0 0x7f304415fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:16.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.189+0000 7f30494fb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3044169a50 con 0x7f3044159400 2023-10-06T02:29:16.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.189+0000 7f30494fb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3044154ec0 con 0x7f30441597d0 2023-10-06T02:29:16.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.189+0000 7f30494fb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30441551a0 con 0x7f30440cf1a0 2023-10-06T02:29:16.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.190+0000 7f30437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3044159400 0x7f304415f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:16.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.190+0000 7f30437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3044159400 0x7f304415f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42622/0 (socket says 172.21.15.6:42622) 2023-10-06T02:29:16.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.190+0000 7f30437fe700 1 -- 172.21.15.6:0/417173990 learned_addr learned my addr 172.21.15.6:0/417173990 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:16.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.190+0000 7f3043fff700 1 --2- 172.21.15.6:0/417173990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30440cf1a0 0x7f30441533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:16.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.190+0000 7f3048cfa700 1 --2- 172.21.15.6:0/417173990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30441597d0 0x7f304415fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:16.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.190+0000 7f30437fe700 1 -- 172.21.15.6:0/417173990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30440cf1a0 msgr2=0x7f30441533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:16.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.190+0000 7f30437fe700 1 --2- 172.21.15.6:0/417173990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30440cf1a0 0x7f30441533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:16.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.190+0000 7f30437fe700 1 -- 172.21.15.6:0/417173990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30441597d0 msgr2=0x7f304415fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:16.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.190+0000 7f30437fe700 1 --2- 172.21.15.6:0/417173990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30441597d0 0x7f304415fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:16.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.190+0000 7f30437fe700 1 -- 172.21.15.6:0/417173990 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30380094f0 con 0x7f3044159400 2023-10-06T02:29:16.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.190+0000 7f30437fe700 1 --2- 172.21.15.6:0/417173990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3044159400 0x7f304415f550 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f30380030c0 tx=0x7f3038016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:16.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.190+0000 7f302bfff700 1 -- 172.21.15.6:0/417173990 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303800bbc0 con 0x7f3044159400 2023-10-06T02:29:16.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.190+0000 7f302bfff700 1 -- 172.21.15.6:0/417173990 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3038020070 con 0x7f3044159400 2023-10-06T02:29:16.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.190+0000 7f302bfff700 1 -- 172.21.15.6:0/417173990 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303801b6a0 con 0x7f3044159400 2023-10-06T02:29:16.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.190+0000 7f30494fb700 1 -- 172.21.15.6:0/417173990 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3044155480 con 0x7f3044159400 2023-10-06T02:29:16.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.190+0000 7f30494fb700 1 -- 172.21.15.6:0/417173990 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30441538e0 con 0x7f3044159400 2023-10-06T02:29:16.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.191+0000 7f30494fb700 1 -- 172.21.15.6:0/417173990 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30440ccaf0 con 0x7f3044159400 2023-10-06T02:29:16.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.192+0000 7f302bfff700 1 -- 172.21.15.6:0/417173990 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3038022030 con 0x7f3044159400 2023-10-06T02:29:16.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.192+0000 7f302bfff700 1 --2- 172.21.15.6:0/417173990 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3030066f30 0x7f30300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:16.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.192+0000 7f302bfff700 1 -- 172.21.15.6:0/417173990 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 9474+0+0 (secure 0 0 0) 0x7f3038087320 con 0x7f3044159400 2023-10-06T02:29:16.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.192+0000 7f3043fff700 1 --2- 172.21.15.6:0/417173990 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3030066f30 0x7f30300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:16.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.193+0000 7f3043fff700 1 --2- 172.21.15.6:0/417173990 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3030066f30 0x7f30300693e0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f30340039e0 tx=0x7f3034007ef0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:16.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.196+0000 7f302bfff700 1 -- 172.21.15.6:0/417173990 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3038053740 con 0x7f3044159400 2023-10-06T02:29:16.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:16.478+0000 7f30494fb700 1 -- 172.21.15.6:0/417173990 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f30440ccaf0 con 0x7f3044159400 2023-10-06T02:29:17.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.061+0000 7f302bfff700 1 -- 172.21.15.6:0/417173990 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v323) v1 ==== 101+0+0 (secure 0 0 0) 0x7f3038056d60 con 0x7f3044159400 2023-10-06T02:29:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.063+0000 7f30494fb700 1 -- 172.21.15.6:0/417173990 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3030066f30 msgr2=0x7f30300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.063+0000 7f30494fb700 1 --2- 172.21.15.6:0/417173990 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3030066f30 0x7f30300693e0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f30340039e0 tx=0x7f3034007ef0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.063+0000 7f30494fb700 1 -- 172.21.15.6:0/417173990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3044159400 msgr2=0x7f304415f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.063+0000 7f30494fb700 1 --2- 172.21.15.6:0/417173990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3044159400 0x7f304415f550 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f30380030c0 tx=0x7f3038016000 comp rx=0 tx=0).stop 2023-10-06T02:29:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.063+0000 7f30494fb700 1 -- 172.21.15.6:0/417173990 shutdown_connections 2023-10-06T02:29:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.063+0000 7f30494fb700 1 --2- 172.21.15.6:0/417173990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30441597d0 0x7f304415fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.063+0000 7f30494fb700 1 --2- 172.21.15.6:0/417173990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30440cf1a0 0x7f30441533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.063+0000 7f30494fb700 1 --2- 172.21.15.6:0/417173990 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3030066f30 0x7f30300693e0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.063+0000 7f30494fb700 1 --2- 172.21.15.6:0/417173990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3044159400 0x7f304415f550 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.063+0000 7f30494fb700 1 -- 172.21.15.6:0/417173990 >> 172.21.15.6:0/417173990 conn(0x7f304406ac10 msgr2=0x7f304415c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:17.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.063+0000 7f30494fb700 1 -- 172.21.15.6:0/417173990 shutdown_connections 2023-10-06T02:29:17.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.063+0000 7f30494fb700 1 -- 172.21.15.6:0/417173990 wait complete. 2023-10-06T02:29:17.065 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:29:17.077 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:29:17.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.116+0000 7fe0b1f0d000 1 Processor -- start 2023-10-06T02:29:17.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.116+0000 7fe0b1f0d000 1 -- start start 2023-10-06T02:29:17.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0b1f0d000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643355e5d60 0x564335559660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0b1f0d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564335541290 0x5643355e6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0b1f0d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643355e69c0 0x564335513be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0b1f0d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643354bc320 con 0x5643355e69c0 2023-10-06T02:29:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0b1f0d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564335460980 con 0x564335541290 2023-10-06T02:29:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0b1f0d000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564335460620 con 0x5643355e5d60 2023-10-06T02:29:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0ab949700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643355e69c0 0x564335513be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0ab949700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643355e69c0 0x564335513be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42648/0 (socket says 172.21.15.6:42648) 2023-10-06T02:29:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0ab949700 1 -- 172.21.15.6:0/2201315490 learned_addr learned my addr 172.21.15.6:0/2201315490 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0ab148700 1 --2- 172.21.15.6:0/2201315490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643355e5d60 0x564335559660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0aa947700 1 --2- 172.21.15.6:0/2201315490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564335541290 0x5643355e6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0ab949700 1 -- 172.21.15.6:0/2201315490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643355e5d60 msgr2=0x564335559660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0ab949700 1 --2- 172.21.15.6:0/2201315490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643355e5d60 0x564335559660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0ab949700 1 -- 172.21.15.6:0/2201315490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564335541290 msgr2=0x5643355e6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0ab949700 1 --2- 172.21.15.6:0/2201315490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564335541290 0x5643355e6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0ab949700 1 -- 172.21.15.6:0/2201315490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564335462ae0 con 0x5643355e69c0 2023-10-06T02:29:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0ab949700 1 --2- 172.21.15.6:0/2201315490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643355e69c0 0x564335513be0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fe09c003000 tx=0x7fe09c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbc87c347f9aebc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0a9945700 1 -- 172.21.15.6:0/2201315490 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c0103a0 con 0x5643355e69c0 2023-10-06T02:29:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0a9945700 1 -- 172.21.15.6:0/2201315490 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c0012d0 con 0x5643355e69c0 2023-10-06T02:29:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.117+0000 7fe0a9945700 1 -- 172.21.15.6:0/2201315490 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c010e80 con 0x5643355e69c0 2023-10-06T02:29:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.118+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/2201315490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643355e69c0 msgr2=0x564335513be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.118+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/2201315490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643355e69c0 0x564335513be0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fe09c003000 tx=0x7fe09c015000 comp rx=0 tx=0).stop 2023-10-06T02:29:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.118+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/2201315490 shutdown_connections 2023-10-06T02:29:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.118+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/2201315490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643355e69c0 0x564335513be0 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.118+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/2201315490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643355e5d60 0x564335559660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.118+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/2201315490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564335541290 0x5643355e6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.118+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/2201315490 >> 172.21.15.6:0/2201315490 conn(0x56433555cbd0 msgr2=0x5643355e7070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:17.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.118+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/2201315490 shutdown_connections 2023-10-06T02:29:17.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.118+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/2201315490 wait complete. 2023-10-06T02:29:17.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.119+0000 7fe0b1f0d000 1 Processor -- start 2023-10-06T02:29:17.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.119+0000 7fe0b1f0d000 1 -- start start 2023-10-06T02:29:17.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.119+0000 7fe0b1f0d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564335541290 0x5643355ebfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.119+0000 7fe0b1f0d000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643355e5d60 0x564335514080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.119+0000 7fe0b1f0d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643355e69c0 0x5643355e10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.119+0000 7fe0b1f0d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564335457400 con 0x564335541290 2023-10-06T02:29:17.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.119+0000 7fe0b1f0d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56433555c730 con 0x5643355e69c0 2023-10-06T02:29:17.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.119+0000 7fe0b1f0d000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56433555f9d0 con 0x5643355e5d60 2023-10-06T02:29:17.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.120+0000 7fe0ab148700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564335541290 0x5643355ebfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.120+0000 7fe0ab148700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564335541290 0x5643355ebfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42658/0 (socket says 172.21.15.6:42658) 2023-10-06T02:29:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.120+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 learned_addr learned my addr 172.21.15.6:0/1113071326 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.120+0000 7fe0aa947700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643355e5d60 0x564335514080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.120+0000 7fe0ab949700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643355e69c0 0x5643355e10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.120+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643355e5d60 msgr2=0x564335514080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.120+0000 7fe0ab148700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643355e5d60 0x564335514080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.120+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643355e69c0 msgr2=0x5643355e10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.120+0000 7fe0ab148700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643355e69c0 0x5643355e10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.120+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098001e10 con 0x564335541290 2023-10-06T02:29:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.120+0000 7fe0aa947700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643355e5d60 0x564335514080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.120+0000 7fe0ab148700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564335541290 0x5643355ebfa0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4008af0 tx=0x7fe0a400c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.120+0000 7fe0a3fff700 1 -- 172.21.15.6:0/1113071326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a400f040 con 0x564335541290 2023-10-06T02:29:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.120+0000 7fe0a3fff700 1 -- 172.21.15.6:0/1113071326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a40139a0 con 0x564335541290 2023-10-06T02:29:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.120+0000 7fe0a3fff700 1 -- 172.21.15.6:0/1113071326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4013d40 con 0x564335541290 2023-10-06T02:29:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.120+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564335462540 con 0x564335541290 2023-10-06T02:29:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.120+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643355e1620 con 0x564335541290 2023-10-06T02:29:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.122+0000 7fe0a3fff700 1 -- 172.21.15.6:0/1113071326 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0a401e630 con 0x564335541290 2023-10-06T02:29:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.122+0000 7fe0a3fff700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe08c065890 0x7fe08c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.122+0000 7fe0a3fff700 1 -- 172.21.15.6:0/1113071326 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 9474+0+0 (secure 0 0 0) 0x7fe0a401a070 con 0x564335541290 2023-10-06T02:29:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.122+0000 7fe0aa947700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe08c065890 0x7fe08c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.127 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:29:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.122+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5643355edac0 0x56433555a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.122+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433555a740 con 0x5643355edac0 2023-10-06T02:29:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.122+0000 7fe0ab949700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5643355edac0 0x56433555a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.123+0000 7fe0aa947700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe08c065890 0x7fe08c067d40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fe094003130 tx=0x7fe094009270 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.123+0000 7fe0ab949700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5643355edac0 0x56433555a200 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.125+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v131'1097 uv1070 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.125+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433555ab20 con 0x5643355edac0 2023-10-06T02:29:17.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.126+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v131'1098 uv1098 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.126+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x5643356096f0 con 0x5643355edac0 2023-10-06T02:29:17.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.128+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v131'1099 uv1099 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.130 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:29:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.128+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560aab0 con 0x5643355edac0 2023-10-06T02:29:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.129+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v131'1100 uv1100 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.129+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560ae60 con 0x5643355edac0 2023-10-06T02:29:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.130+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v131'1101 uv1101 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.131+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335609aa0 con 0x5643355edac0 2023-10-06T02:29:17.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.132+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v131'1102 uv1102 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.132+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335609ea0 con 0x5643355edac0 2023-10-06T02:29:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.133+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v131'1103 uv1076 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.133+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560a250 con 0x5643355edac0 2023-10-06T02:29:17.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.135+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v131'1104 uv1104 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.135+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560a250 con 0x5643355edac0 2023-10-06T02:29:17.136 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:29:17.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.136+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v131'1105 uv1105 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.136+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560a250 con 0x5643355edac0 2023-10-06T02:29:17.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.137+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v131'1106 uv1106 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.137+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560a250 con 0x5643355edac0 2023-10-06T02:29:17.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.139+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v131'1107 uv1107 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.139+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560a250 con 0x5643355edac0 2023-10-06T02:29:17.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.140+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v131'1108 uv1108 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.140+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560a250 con 0x5643355edac0 2023-10-06T02:29:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.141+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v131'1109 uv1083 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.141+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560a250 con 0x5643355edac0 2023-10-06T02:29:17.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.143+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v131'1110 uv1110 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.143+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560a250 con 0x5643355edac0 2023-10-06T02:29:17.144 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:29:17.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.144+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v131'1111 uv1111 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.144+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560a250 con 0x5643355edac0 2023-10-06T02:29:17.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.145+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v131'1112 uv1112 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.145+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560a250 con 0x5643355edac0 2023-10-06T02:29:17.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.146+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v131'1113 uv1113 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.146+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560a250 con 0x5643355edac0 2023-10-06T02:29:17.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.147+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v131'1114 uv1114 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.147+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560b210 con 0x5643355edac0 2023-10-06T02:29:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.149+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v131'1115 uv1115 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.149+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560b210 con 0x5643355edac0 2023-10-06T02:29:17.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.150+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v131'1116 uv1096 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.150+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560b210 con 0x5643355edac0 2023-10-06T02:29:17.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.152+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v131'1117 uv1117 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.152+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560b210 con 0x5643355edac0 2023-10-06T02:29:17.153 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:29:17.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.153+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v131'1118 uv1118 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.153+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560c220 con 0x5643355edac0 2023-10-06T02:29:17.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.154+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v131'1119 uv1119 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.154+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560c220 con 0x5643355edac0 2023-10-06T02:29:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.156+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v131'1120 uv1120 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.156+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560b210 con 0x5643355edac0 2023-10-06T02:29:17.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.157+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v131'1121 uv1121 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.157+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560b210 con 0x5643355edac0 2023-10-06T02:29:17.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.159+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v131'1122 uv1095 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.159+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560b210 con 0x5643355edac0 2023-10-06T02:29:17.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.160+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v131'1123 uv1123 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.160+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560b210 con 0x5643355edac0 2023-10-06T02:29:17.162 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:29:17.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.161+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v131'1124 uv1124 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.161+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560c220 con 0x5643355edac0 2023-10-06T02:29:17.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.163+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v131'1125 uv1125 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.163+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560c220 con 0x5643355edac0 2023-10-06T02:29:17.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.164+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v131'1126 uv1126 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.164+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560b210 con 0x5643355edac0 2023-10-06T02:29:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.165+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v131'1127 uv1127 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x5643355edac0 2023-10-06T02:29:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.165+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56433560b720 0x56433560db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.165+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560e040 con 0x56433560b720 2023-10-06T02:29:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.165+0000 7fe0ab148700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56433560b720 0x56433560db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.166+0000 7fe0ab148700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56433560b720 0x56433560db00 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:17.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.167+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v131'789 uv771 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.167+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560e3f0 con 0x56433560b720 2023-10-06T02:29:17.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.168+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v131'790 uv790 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.169+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560e7a0 con 0x56433560b720 2023-10-06T02:29:17.170 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:29:17.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.170+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v131'791 uv791 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.170+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560f040 con 0x56433560b720 2023-10-06T02:29:17.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.171+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v131'792 uv792 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.171+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560f3f0 con 0x56433560b720 2023-10-06T02:29:17.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.172+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v131'793 uv793 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.172+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560f7a0 con 0x56433560b720 2023-10-06T02:29:17.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.173+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v131'794 uv776 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.173+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560f7a0 con 0x56433560b720 2023-10-06T02:29:17.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.174+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v131'795 uv795 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.174+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560f7a0 con 0x56433560b720 2023-10-06T02:29:17.176 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:29:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.175+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v131'796 uv796 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.175+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560f7a0 con 0x56433560b720 2023-10-06T02:29:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.176+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v131'797 uv797 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.176+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560f7a0 con 0x56433560b720 2023-10-06T02:29:17.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.177+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v131'798 uv798 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.178+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560f7a0 con 0x56433560b720 2023-10-06T02:29:17.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.179+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v131'799 uv781 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.179+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560f7a0 con 0x56433560b720 2023-10-06T02:29:17.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.180+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v131'800 uv800 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.180+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560f7a0 con 0x56433560b720 2023-10-06T02:29:17.181 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:29:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.181+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v131'801 uv801 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.181+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335612ec0 con 0x56433560b720 2023-10-06T02:29:17.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.182+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v131'802 uv802 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.182+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335612ec0 con 0x56433560b720 2023-10-06T02:29:17.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.183+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v131'803 uv803 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.183+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560f7a0 con 0x56433560b720 2023-10-06T02:29:17.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.184+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v131'804 uv787 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.184+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560f7a0 con 0x56433560b720 2023-10-06T02:29:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.185+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v131'805 uv805 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.185+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560f7a0 con 0x56433560b720 2023-10-06T02:29:17.187 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:29:17.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.186+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v131'806 uv806 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.186+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x5643356107b0 con 0x56433560b720 2023-10-06T02:29:17.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.188+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v131'807 uv807 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.188+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x5643356107b0 con 0x56433560b720 2023-10-06T02:29:17.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.189+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v131'808 uv808 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.189+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433560f7a0 con 0x56433560b720 2023-10-06T02:29:17.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.190+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v131'809 uv809 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.190+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56433560fcb0 0x564335612090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.190+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x5643356125d0 con 0x56433560fcb0 2023-10-06T02:29:17.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.190+0000 7fe0aa947700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56433560fcb0 0x564335612090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.190+0000 7fe0aa947700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56433560fcb0 0x564335612090 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:17.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.191+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v131'213 uv212 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09400f8a0 con 0x56433560fcb0 2023-10-06T02:29:17.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.191+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335612980 con 0x56433560fcb0 2023-10-06T02:29:17.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.192+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v131'214 uv214 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.192+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335612d30 con 0x56433560fcb0 2023-10-06T02:29:17.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.193+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v131'215 uv215 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.194 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:29:17.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.193+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335614630 con 0x56433560fcb0 2023-10-06T02:29:17.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.195+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v131'216 uv216 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.195+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x5643356149e0 con 0x56433560fcb0 2023-10-06T02:29:17.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.196+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v131'217 uv217 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.196+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335613620 con 0x56433560fcb0 2023-10-06T02:29:17.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.197+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v131'218 uv218 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.197+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335613a20 con 0x56433560fcb0 2023-10-06T02:29:17.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.198+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v131'153 uv152 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.198+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335613e50 con 0x56433560fcb0 2023-10-06T02:29:17.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.199+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v131'154 uv154 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.199+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335614280 con 0x56433560fcb0 2023-10-06T02:29:17.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.199+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v131'155 uv155 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.200 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:29:17.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.200+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335613e50 con 0x56433560fcb0 2023-10-06T02:29:17.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.201+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v131'156 uv156 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.201+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335613dd0 con 0x56433560b720 2023-10-06T02:29:17.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.203+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v131'213 uv212 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.203+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335613dd0 con 0x56433560b720 2023-10-06T02:29:17.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.204+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v131'214 uv214 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.204+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335613dd0 con 0x56433560b720 2023-10-06T02:29:17.205 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:29:17.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.205+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v131'215 uv215 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.205+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335613dd0 con 0x56433560b720 2023-10-06T02:29:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.206+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v131'216 uv216 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.206+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335614260 con 0x56433560b720 2023-10-06T02:29:17.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.207+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v131'217 uv217 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.207+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335614260 con 0x56433560b720 2023-10-06T02:29:17.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.208+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v131'218 uv218 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x56433560b720 2023-10-06T02:29:17.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.208+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564335614210 0x5643356172b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.208+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x5643356177f0 con 0x564335614210 2023-10-06T02:29:17.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.208+0000 7fe0ab949700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564335614210 0x5643356172b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.209+0000 7fe0ab949700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564335614210 0x5643356172b0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:17.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.210+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v131'393 uv387 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x564335614210 2023-10-06T02:29:17.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.210+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x5643356177f0 con 0x564335614210 2023-10-06T02:29:17.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.211+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v131'394 uv394 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x564335614210 2023-10-06T02:29:17.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.211+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x5643356177f0 con 0x564335614210 2023-10-06T02:29:17.215 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:29:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.212+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v131'395 uv395 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x564335614210 2023-10-06T02:29:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.213+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335618800 con 0x564335614210 2023-10-06T02:29:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.214+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v131'396 uv396 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x564335614210 2023-10-06T02:29:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.214+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335618800 con 0x564335614210 2023-10-06T02:29:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.215+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v131'397 uv397 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x564335614210 2023-10-06T02:29:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.215+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x5643356177f0 con 0x564335614210 2023-10-06T02:29:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.216+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v131'398 uv398 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x564335614210 2023-10-06T02:29:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.216+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x5643356177f0 con 0x564335614210 2023-10-06T02:29:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.217+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v131'399 uv392 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x564335614210 2023-10-06T02:29:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.217+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x5643356177f0 con 0x564335614210 2023-10-06T02:29:17.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.218+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v131'400 uv400 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x564335614210 2023-10-06T02:29:17.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.218+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x5643356177f0 con 0x564335614210 2023-10-06T02:29:17.220 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:29:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.219+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v131'401 uv401 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x564335614210 2023-10-06T02:29:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.219+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x5643356177f0 con 0x564335614210 2023-10-06T02:29:17.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.221+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v131'402 uv402 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x564335614210 2023-10-06T02:29:17.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.221+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335617870 con 0x564335614210 2023-10-06T02:29:17.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.222+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v131'403 uv403 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x564335614210 2023-10-06T02:29:17.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.222+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x564335618180 0x564335618590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.222+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561abe0 con 0x564335618180 2023-10-06T02:29:17.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.222+0000 7fe0ab148700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x564335618180 0x564335618590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.222+0000 7fe0ab148700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x564335618180 0x564335618590 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.223+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v131'178 uv177 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x564335618180 2023-10-06T02:29:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.223+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561abe0 con 0x564335618180 2023-10-06T02:29:17.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.225+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v131'179 uv179 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x564335618180 2023-10-06T02:29:17.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.225+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561abe0 con 0x564335618180 2023-10-06T02:29:17.226 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:29:17.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.226+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v131'180 uv180 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x564335618180 2023-10-06T02:29:17.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.226+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561ac20 con 0x564335618180 2023-10-06T02:29:17.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.227+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v131'181 uv181 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x564335618180 2023-10-06T02:29:17.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.227+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561b040 con 0x564335618180 2023-10-06T02:29:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.228+0000 7fe0ab148700 1 -- 172.21.15.6:0/1113071326 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v131'182 uv182 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe0a4012040 con 0x564335618180 2023-10-06T02:29:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.228+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561b040 con 0x56433560fcb0 2023-10-06T02:29:17.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.229+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v131'213 uv212 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.229+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561b040 con 0x56433560fcb0 2023-10-06T02:29:17.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.230+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v131'214 uv214 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.230+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561b040 con 0x56433560fcb0 2023-10-06T02:29:17.231 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:29:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.231+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v131'215 uv215 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.231+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561c050 con 0x56433560fcb0 2023-10-06T02:29:17.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.232+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v131'216 uv216 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.232+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561c050 con 0x56433560fcb0 2023-10-06T02:29:17.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.233+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v131'217 uv217 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.233+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561b040 con 0x56433560fcb0 2023-10-06T02:29:17.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.234+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v131'218 uv218 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.234+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56433561b550 0x56433561d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.234+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561de70 con 0x56433561b550 2023-10-06T02:29:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.234+0000 7fe0aa947700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56433561b550 0x56433561d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.234+0000 7fe0aa947700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56433561b550 0x56433561d930 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:17.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.235+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v131'355 uv349 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433561b550 2023-10-06T02:29:17.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.235+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e250 con 0x56433561b550 2023-10-06T02:29:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.236+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v131'356 uv356 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433561b550 2023-10-06T02:29:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.236+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e250 con 0x56433561b550 2023-10-06T02:29:17.238 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:29:17.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.237+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v131'357 uv357 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433561b550 2023-10-06T02:29:17.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.237+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e250 con 0x56433561b550 2023-10-06T02:29:17.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.238+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v131'358 uv358 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433561b550 2023-10-06T02:29:17.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.238+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e250 con 0x56433561b550 2023-10-06T02:29:17.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.239+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v131'359 uv359 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433561b550 2023-10-06T02:29:17.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.239+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e250 con 0x56433561b550 2023-10-06T02:29:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.240+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v131'360 uv354 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433561b550 2023-10-06T02:29:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.240+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e250 con 0x56433561b550 2023-10-06T02:29:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.241+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v131'361 uv361 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433561b550 2023-10-06T02:29:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.241+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e250 con 0x56433561b550 2023-10-06T02:29:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.242+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v131'362 uv362 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433561b550 2023-10-06T02:29:17.243 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:29:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.242+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e250 con 0x56433561b550 2023-10-06T02:29:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.243+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v131'363 uv363 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433561b550 2023-10-06T02:29:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.243+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335620fc0 con 0x56433561b550 2023-10-06T02:29:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.244+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v131'364 uv364 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433561b550 2023-10-06T02:29:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.244+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e740 con 0x56433560fcb0 2023-10-06T02:29:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.245+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v131'157 uv155 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.245+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e740 con 0x56433560fcb0 2023-10-06T02:29:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.246+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v131'158 uv158 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.246+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e740 con 0x56433560fcb0 2023-10-06T02:29:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.247+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v131'159 uv159 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.248 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:29:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.247+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e740 con 0x56433560fcb0 2023-10-06T02:29:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.248+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v131'160 uv160 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.248+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56433561f050 0x564335621710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.248+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e740 con 0x56433561f050 2023-10-06T02:29:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.249+0000 7fe0ab949700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56433561f050 0x564335621710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.249+0000 7fe0ab949700 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56433561f050 0x564335621710 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.250+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v131'213 uv212 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x56433561f050 2023-10-06T02:29:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.250+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e740 con 0x56433561f050 2023-10-06T02:29:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.252+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v131'214 uv214 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x56433561f050 2023-10-06T02:29:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.252+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e740 con 0x56433561f050 2023-10-06T02:29:17.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.255+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v131'215 uv215 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x56433561f050 2023-10-06T02:29:17.255 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:29:17.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.255+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e740 con 0x56433561f050 2023-10-06T02:29:17.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.257+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v131'216 uv216 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x56433561f050 2023-10-06T02:29:17.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.257+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e740 con 0x56433561f050 2023-10-06T02:29:17.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.260+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v131'217 uv217 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x56433561f050 2023-10-06T02:29:17.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.260+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e740 con 0x56433561f050 2023-10-06T02:29:17.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.263+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v131'218 uv218 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x56433561f050 2023-10-06T02:29:17.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.263+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e740 con 0x564335614210 2023-10-06T02:29:17.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.264+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v131'181 uv180 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x564335614210 2023-10-06T02:29:17.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.264+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e740 con 0x564335614210 2023-10-06T02:29:17.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.265+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v131'182 uv182 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x564335614210 2023-10-06T02:29:17.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.265+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e740 con 0x564335614210 2023-10-06T02:29:17.267 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:29:17.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.266+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v131'183 uv183 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x564335614210 2023-10-06T02:29:17.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.266+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e740 con 0x564335614210 2023-10-06T02:29:17.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.267+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v131'184 uv184 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x564335614210 2023-10-06T02:29:17.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.267+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e740 con 0x564335614210 2023-10-06T02:29:17.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.268+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v131'185 uv185 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fe09c010c50 con 0x564335614210 2023-10-06T02:29:17.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.268+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e740 con 0x56433560fcb0 2023-10-06T02:29:17.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.270+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v131'442 uv433 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.270+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e740 con 0x56433560fcb0 2023-10-06T02:29:17.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.271+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v131'443 uv443 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.271+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e710 con 0x56433560fcb0 2023-10-06T02:29:17.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.272+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v131'444 uv444 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.272 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:29:17.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.272+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e710 con 0x56433560fcb0 2023-10-06T02:29:17.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.273+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v131'445 uv445 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.273+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335621c50 con 0x56433560fcb0 2023-10-06T02:29:17.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.274+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v131'446 uv446 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.274+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335621c50 con 0x56433560fcb0 2023-10-06T02:29:17.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.275+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v131'447 uv440 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.275+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e710 con 0x56433560fcb0 2023-10-06T02:29:17.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.276+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v131'448 uv448 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.276+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e6f0 con 0x56433560fcb0 2023-10-06T02:29:17.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.277+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v131'449 uv449 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.277 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:29:17.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.277+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e6f0 con 0x56433560fcb0 2023-10-06T02:29:17.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.278+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v131'450 uv450 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.278+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e6f0 con 0x56433560fcb0 2023-10-06T02:29:17.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.279+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v131'451 uv451 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.279+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x564335621c50 con 0x56433560fcb0 2023-10-06T02:29:17.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.280+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v131'452 uv452 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.280+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x56433561e600 con 0x56433560fcb0 2023-10-06T02:29:17.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0aa947700 1 -- 172.21.15.6:0/1113071326 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v131'453 uv453 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe09400fcd0 con 0x56433560fcb0 2023-10-06T02:29:17.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56433560fcb0 msgr2=0x564335612090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56433560fcb0 0x564335612090 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5643355edac0 msgr2=0x56433555a200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5643355edac0 0x56433555a200 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56433561b550 msgr2=0x56433561d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x56433561b550 0x56433561d930 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56433560b720 msgr2=0x56433560db00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x56433560b720 0x56433560db00 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56433561f050 msgr2=0x564335621710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x56433561f050 0x564335621710 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x564335618180 msgr2=0x564335618590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x564335618180 0x564335618590 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564335614210 msgr2=0x5643356172b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 reap_dead start 2023-10-06T02:29:17.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x564335614210 0x5643356172b0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 reap_dead start 2023-10-06T02:29:17.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 reap_dead start 2023-10-06T02:29:17.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0ab949700 1 -- 172.21.15.6:0/1113071326 reap_dead start 2023-10-06T02:29:17.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe08c065890 msgr2=0x7fe08c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe08c065890 0x7fe08c067d40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fe094003130 tx=0x7fe094009270 comp rx=0 tx=0).stop 2023-10-06T02:29:17.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564335541290 msgr2=0x5643355ebfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564335541290 0x5643355ebfa0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4008af0 tx=0x7fe0a400c040 comp rx=0 tx=0).stop 2023-10-06T02:29:17.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 shutdown_connections 2023-10-06T02:29:17.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564335541290 0x5643355ebfa0 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 --2- 172.21.15.6:0/1113071326 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe08c065890 0x7fe08c067d40 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 >> 172.21.15.6:0/1113071326 conn(0x56433555cbd0 msgr2=0x5643355e7010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:17.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 shutdown_connections 2023-10-06T02:29:17.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.281+0000 7fe0b1f0d000 1 -- 172.21.15.6:0/1113071326 wait complete. 2023-10-06T02:29:17.286 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader mds0_openfiles.0 deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2023-10-06T02:29:17.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.364+0000 7fa31171b000 1 Processor -- start 2023-10-06T02:29:17.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.364+0000 7fa31171b000 1 -- start start 2023-10-06T02:29:17.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa31171b000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560004fd6e90 0x56000501b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa31171b000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5600050024b0 0x56000501e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa31171b000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560005093ce0 0x5600050ae740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa31171b000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560004f1e980 con 0x560004fd6e90 2023-10-06T02:29:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa31171b000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560004f1e620 con 0x560005093ce0 2023-10-06T02:29:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa31171b000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560004f15400 con 0x5600050024b0 2023-10-06T02:29:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa30a956700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560004fd6e90 0x56000501b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa30a956700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560004fd6e90 0x56000501b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42672/0 (socket says 172.21.15.6:42672) 2023-10-06T02:29:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa30a956700 1 -- 172.21.15.6:0/225291945 learned_addr learned my addr 172.21.15.6:0/225291945 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa30a155700 1 --2- 172.21.15.6:0/225291945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5600050024b0 0x56000501e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa30a956700 1 -- 172.21.15.6:0/225291945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5600050024b0 msgr2=0x56000501e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa30b157700 1 --2- 172.21.15.6:0/225291945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560005093ce0 0x5600050ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa30a956700 1 --2- 172.21.15.6:0/225291945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5600050024b0 0x56000501e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa30a956700 1 -- 172.21.15.6:0/225291945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560005093ce0 msgr2=0x5600050ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa30a956700 1 --2- 172.21.15.6:0/225291945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560005093ce0 0x5600050ae740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa30a956700 1 -- 172.21.15.6:0/225291945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30400a180 con 0x560004fd6e90 2023-10-06T02:29:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa30a956700 1 --2- 172.21.15.6:0/225291945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560004fd6e90 0x56000501b750 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009580 tx=0x7fa2fc005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5233739e174725a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa309153700 1 -- 172.21.15.6:0/225291945 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc00e070 con 0x560004fd6e90 2023-10-06T02:29:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa309153700 1 -- 172.21.15.6:0/225291945 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc012410 con 0x560004fd6e90 2023-10-06T02:29:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.365+0000 7fa309153700 1 -- 172.21.15.6:0/225291945 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc0127f0 con 0x560004fd6e90 2023-10-06T02:29:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.366+0000 7fa31171b000 1 -- 172.21.15.6:0/225291945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560004fd6e90 msgr2=0x56000501b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.366+0000 7fa31171b000 1 --2- 172.21.15.6:0/225291945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560004fd6e90 0x56000501b750 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009580 tx=0x7fa2fc005ae0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.366+0000 7fa31171b000 1 -- 172.21.15.6:0/225291945 shutdown_connections 2023-10-06T02:29:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.366+0000 7fa31171b000 1 --2- 172.21.15.6:0/225291945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560005093ce0 0x5600050ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.366+0000 7fa31171b000 1 --2- 172.21.15.6:0/225291945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560004fd6e90 0x56000501b750 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.366+0000 7fa31171b000 1 --2- 172.21.15.6:0/225291945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5600050024b0 0x56000501e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.366+0000 7fa31171b000 1 -- 172.21.15.6:0/225291945 >> 172.21.15.6:0/225291945 conn(0x560004fd26c0 msgr2=0x5600050addc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:17.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.366+0000 7fa31171b000 1 -- 172.21.15.6:0/225291945 shutdown_connections 2023-10-06T02:29:17.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.366+0000 7fa31171b000 1 -- 172.21.15.6:0/225291945 wait complete. 2023-10-06T02:29:17.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.366+0000 7fa31171b000 1 Processor -- start 2023-10-06T02:29:17.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.366+0000 7fa31171b000 1 -- start start 2023-10-06T02:29:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.367+0000 7fa31171b000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560004fd6e90 0x5600050b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.367+0000 7fa31171b000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5600050024b0 0x5600050ac800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.367+0000 7fa31171b000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560005093ce0 0x5600050b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.367+0000 7fa31171b000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600050aef60 con 0x560004fd6e90 2023-10-06T02:29:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.367+0000 7fa31171b000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600050af200 con 0x560005093ce0 2023-10-06T02:29:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.367+0000 7fa31171b000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560005091f10 con 0x5600050024b0 2023-10-06T02:29:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.367+0000 7fa30a956700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560004fd6e90 0x5600050b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.367+0000 7fa30a956700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560004fd6e90 0x5600050b3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42680/0 (socket says 172.21.15.6:42680) 2023-10-06T02:29:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.367+0000 7fa30a956700 1 -- 172.21.15.6:0/1909591447 learned_addr learned my addr 172.21.15.6:0/1909591447 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.367+0000 7fa30a155700 1 --2- 172.21.15.6:0/1909591447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5600050024b0 0x5600050ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.367+0000 7fa30b157700 1 --2- 172.21.15.6:0/1909591447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560005093ce0 0x5600050b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.368+0000 7fa30a956700 1 -- 172.21.15.6:0/1909591447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5600050024b0 msgr2=0x5600050ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.368+0000 7fa30a956700 1 --2- 172.21.15.6:0/1909591447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5600050024b0 0x5600050ac800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.368+0000 7fa30a956700 1 -- 172.21.15.6:0/1909591447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560005093ce0 msgr2=0x5600050b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.368+0000 7fa30a956700 1 --2- 172.21.15.6:0/1909591447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560005093ce0 0x5600050b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.368+0000 7fa30a956700 1 -- 172.21.15.6:0/1909591447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc005d80 con 0x560004fd6e90 2023-10-06T02:29:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.368+0000 7fa30a956700 1 --2- 172.21.15.6:0/1909591447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560004fd6e90 0x5600050b3200 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x560004fd3930 tx=0x7fa2fc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.368+0000 7fa2fb7fe700 1 -- 172.21.15.6:0/1909591447 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc005770 con 0x560004fd6e90 2023-10-06T02:29:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.368+0000 7fa2fb7fe700 1 -- 172.21.15.6:0/1909591447 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc008a60 con 0x560004fd6e90 2023-10-06T02:29:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.368+0000 7fa31171b000 1 -- 172.21.15.6:0/1909591447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560004f2d3d0 con 0x560004fd6e90 2023-10-06T02:29:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.368+0000 7fa2fb7fe700 1 -- 172.21.15.6:0/1909591447 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc008e20 con 0x560004fd6e90 2023-10-06T02:29:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.368+0000 7fa31171b000 1 -- 172.21.15.6:0/1909591447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560004f20ae0 con 0x560004fd6e90 2023-10-06T02:29:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.369+0000 7fa2fb7fe700 1 -- 172.21.15.6:0/1909591447 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2fc01e660 con 0x560004fd6e90 2023-10-06T02:29:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.370+0000 7fa2fb7fe700 1 --2- 172.21.15.6:0/1909591447 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa2f00658c0 0x7fa2f0067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.370+0000 7fa2fb7fe700 1 -- 172.21.15.6:0/1909591447 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 9474+0+0 (secure 0 0 0) 0x7fa2fc085ec0 con 0x560004fd6e90 2023-10-06T02:29:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.370+0000 7fa30a155700 1 --2- 172.21.15.6:0/1909591447 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa2f00658c0 0x7fa2f0067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.370+0000 7fa31171b000 1 --2- 172.21.15.6:0/1909591447 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5600050b3740 0x5600050928f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.370+0000 7fa31171b000 1 -- 172.21.15.6:0/1909591447 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x5600050acd40 con 0x5600050b3740 2023-10-06T02:29:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.370+0000 7fa30b157700 1 --2- 172.21.15.6:0/1909591447 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5600050b3740 0x5600050928f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.370+0000 7fa30a155700 1 --2- 172.21.15.6:0/1909591447 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa2f00658c0 0x7fa2f0067d70 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa30000f6c0 tx=0x7fa300002820 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.370+0000 7fa30b157700 1 --2- 172.21.15.6:0/1909591447 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5600050b3740 0x5600050928f0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.372+0000 7fa30b157700 1 -- 172.21.15.6:0/1909591447 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 mds0_openfiles.0 [omap-set-header] v131'157 uv157 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fa30400e7e0 con 0x5600050b3740 2023-10-06T02:29:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.372+0000 7fa31171b000 1 -- 172.21.15.6:0/1909591447 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5600050b3740 msgr2=0x5600050928f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.372+0000 7fa31171b000 1 --2- 172.21.15.6:0/1909591447 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5600050b3740 0x5600050928f0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.372+0000 7fa31171b000 1 -- 172.21.15.6:0/1909591447 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa2f00658c0 msgr2=0x7fa2f0067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.372+0000 7fa31171b000 1 --2- 172.21.15.6:0/1909591447 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa2f00658c0 0x7fa2f0067d70 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa30000f6c0 tx=0x7fa300002820 comp rx=0 tx=0).stop 2023-10-06T02:29:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.372+0000 7fa31171b000 1 -- 172.21.15.6:0/1909591447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560004fd6e90 msgr2=0x5600050b3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.372+0000 7fa31171b000 1 --2- 172.21.15.6:0/1909591447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560004fd6e90 0x5600050b3200 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x560004fd3930 tx=0x7fa2fc014000 comp rx=0 tx=0).stop 2023-10-06T02:29:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.372+0000 7fa30b157700 1 -- 172.21.15.6:0/1909591447 reap_dead start 2023-10-06T02:29:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.372+0000 7fa31171b000 1 -- 172.21.15.6:0/1909591447 shutdown_connections 2023-10-06T02:29:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.372+0000 7fa31171b000 1 -- 172.21.15.6:0/1909591447 >> 172.21.15.6:0/1909591447 conn(0x560004fd26c0 msgr2=0x56000501b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.372+0000 7fa31171b000 1 -- 172.21.15.6:0/1909591447 shutdown_connections 2023-10-06T02:29:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.372+0000 7fa31171b000 1 -- 172.21.15.6:0/1909591447 wait complete. 2023-10-06T02:29:17.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:29:17.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.540+0000 7f645b3f3700 1 Processor -- start 2023-10-06T02:29:17.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.540+0000 7f645b3f3700 1 -- start start 2023-10-06T02:29:17.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.541+0000 7f645b3f3700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f64540cd400 0x7f64540b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.541+0000 7f645b3f3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64540cd7d0 0x7f64540b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.541+0000 7f645b3f3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64540b0810 0x7f64540d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.541+0000 7f645b3f3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64540b29a0 con 0x7f64540b0810 2023-10-06T02:29:17.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.541+0000 7f645b3f3700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64540af770 con 0x7f64540cd400 2023-10-06T02:29:17.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.541+0000 7f645b3f3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64540afa50 con 0x7f64540cd7d0 2023-10-06T02:29:17.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.541+0000 7f645abf2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64540b0810 0x7f64540d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.541+0000 7f645abf2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64540b0810 0x7f64540d01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42682/0 (socket says 172.21.15.6:42682) 2023-10-06T02:29:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.541+0000 7f645abf2700 1 -- 172.21.15.6:0/1127078735 learned_addr learned my addr 172.21.15.6:0/1127078735 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.541+0000 7f6459bf0700 1 --2- 172.21.15.6:0/1127078735 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64540cd7d0 0x7f64540b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.541+0000 7f645a3f1700 1 --2- 172.21.15.6:0/1127078735 >> v2:172.21.15.175:3300/0 conn(0x7f64540cd400 0x7f64540b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.541+0000 7f645abf2700 1 -- 172.21.15.6:0/1127078735 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64540cd7d0 msgr2=0x7f64540b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.541+0000 7f645abf2700 1 --2- 172.21.15.6:0/1127078735 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64540cd7d0 0x7f64540b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.541+0000 7f645abf2700 1 -- 172.21.15.6:0/1127078735 >> v2:172.21.15.175:3300/0 conn(0x7f64540cd400 msgr2=0x7f64540b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.541+0000 7f645abf2700 1 --2- 172.21.15.6:0/1127078735 >> v2:172.21.15.175:3300/0 conn(0x7f64540cd400 0x7f64540b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.541+0000 7f645abf2700 1 -- 172.21.15.6:0/1127078735 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64540afd30 con 0x7f64540b0810 2023-10-06T02:29:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.542+0000 7f645abf2700 1 --2- 172.21.15.6:0/1127078735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64540b0810 0x7f64540d01a0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f64540892a0 tx=0x7f6444009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34d2cd5924671a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.542+0000 7f64593ef700 1 -- 172.21.15.6:0/1127078735 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644400e070 con 0x7f64540b0810 2023-10-06T02:29:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.542+0000 7f64593ef700 1 -- 172.21.15.6:0/1127078735 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644400ba50 con 0x7f64540b0810 2023-10-06T02:29:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.542+0000 7f64593ef700 1 -- 172.21.15.6:0/1127078735 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64440092e0 con 0x7f64540b0810 2023-10-06T02:29:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.542+0000 7f645b3f3700 1 -- 172.21.15.6:0/1127078735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64540b0810 msgr2=0x7f64540d01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.542+0000 7f645b3f3700 1 --2- 172.21.15.6:0/1127078735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64540b0810 0x7f64540d01a0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f64540892a0 tx=0x7f6444009840 comp rx=0 tx=0).stop 2023-10-06T02:29:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.542+0000 7f645b3f3700 1 -- 172.21.15.6:0/1127078735 shutdown_connections 2023-10-06T02:29:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.542+0000 7f645b3f3700 1 --2- 172.21.15.6:0/1127078735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64540b0810 0x7f64540d01a0 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.542+0000 7f645b3f3700 1 --2- 172.21.15.6:0/1127078735 >> v2:172.21.15.175:3300/0 conn(0x7f64540cd400 0x7f64540b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.542+0000 7f645b3f3700 1 --2- 172.21.15.6:0/1127078735 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64540cd7d0 0x7f64540b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.542+0000 7f645b3f3700 1 -- 172.21.15.6:0/1127078735 >> 172.21.15.6:0/1127078735 conn(0x7f645406a110 msgr2=0x7f645406a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.542+0000 7f645b3f3700 1 -- 172.21.15.6:0/1127078735 shutdown_connections 2023-10-06T02:29:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.542+0000 7f645b3f3700 1 -- 172.21.15.6:0/1127078735 wait complete. 2023-10-06T02:29:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.543+0000 7f645b3f3700 1 Processor -- start 2023-10-06T02:29:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.544+0000 7f645b3f3700 1 -- start start 2023-10-06T02:29:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.544+0000 7f645b3f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64540b0810 0x7f645416cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.544+0000 7f645b3f3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64540cd400 0x7f64540c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.544+0000 7f645b3f3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64541530b0 0x7f645416a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.544+0000 7f645b3f3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6454169930 con 0x7f64540b0810 2023-10-06T02:29:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.544+0000 7f645b3f3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64540c69e0 con 0x7f64540cd400 2023-10-06T02:29:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.544+0000 7f645b3f3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645416dc80 con 0x7f64541530b0 2023-10-06T02:29:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.544+0000 7f645a3f1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64540b0810 0x7f645416cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.544+0000 7f645a3f1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64540b0810 0x7f645416cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42686/0 (socket says 172.21.15.6:42686) 2023-10-06T02:29:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.544+0000 7f645a3f1700 1 -- 172.21.15.6:0/4076777755 learned_addr learned my addr 172.21.15.6:0/4076777755 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.544+0000 7f6459bf0700 1 --2- 172.21.15.6:0/4076777755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64540cd400 0x7f64540c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.545+0000 7f645abf2700 1 --2- 172.21.15.6:0/4076777755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64541530b0 0x7f645416a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.545+0000 7f645a3f1700 1 -- 172.21.15.6:0/4076777755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64541530b0 msgr2=0x7f645416a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.545+0000 7f645a3f1700 1 --2- 172.21.15.6:0/4076777755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64541530b0 0x7f645416a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.545+0000 7f645a3f1700 1 -- 172.21.15.6:0/4076777755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64540cd400 msgr2=0x7f64540c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.545+0000 7f645a3f1700 1 --2- 172.21.15.6:0/4076777755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64540cd400 0x7f64540c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.545+0000 7f645a3f1700 1 -- 172.21.15.6:0/4076777755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6444009ae0 con 0x7f64540b0810 2023-10-06T02:29:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.545+0000 7f645a3f1700 1 --2- 172.21.15.6:0/4076777755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64540b0810 0x7f645416cd90 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7f644c00c850 tx=0x7f644c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.545+0000 7f64527fc700 1 -- 172.21.15.6:0/4076777755 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c011600 con 0x7f64540b0810 2023-10-06T02:29:17.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.545+0000 7f64527fc700 1 -- 172.21.15.6:0/4076777755 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c011760 con 0x7f64540b0810 2023-10-06T02:29:17.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.545+0000 7f645b3f3700 1 -- 172.21.15.6:0/4076777755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645416d3e0 con 0x7f64540b0810 2023-10-06T02:29:17.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.545+0000 7f64527fc700 1 -- 172.21.15.6:0/4076777755 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c011b00 con 0x7f64540b0810 2023-10-06T02:29:17.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.545+0000 7f645b3f3700 1 -- 172.21.15.6:0/4076777755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645416d9a0 con 0x7f64540b0810 2023-10-06T02:29:17.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.546+0000 7f645b3f3700 1 -- 172.21.15.6:0/4076777755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645404bb80 con 0x7f64540b0810 2023-10-06T02:29:17.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.546+0000 7f64527fc700 1 -- 172.21.15.6:0/4076777755 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f644c0193f0 con 0x7f64540b0810 2023-10-06T02:29:17.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.547+0000 7f64527fc700 1 --2- 172.21.15.6:0/4076777755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6440066f30 0x7f64400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:17.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.547+0000 7f64527fc700 1 -- 172.21.15.6:0/4076777755 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 9474+0+0 (secure 0 0 0) 0x7f644c0857a0 con 0x7f64540b0810 2023-10-06T02:29:17.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.547+0000 7f6459bf0700 1 --2- 172.21.15.6:0/4076777755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6440066f30 0x7f64400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:17.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.547+0000 7f6459bf0700 1 --2- 172.21.15.6:0/4076777755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6440066f30 0x7f64400693e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f64540aefc0 tx=0x7f6448008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:17.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.551+0000 7f64527fc700 1 -- 172.21.15.6:0/4076777755 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f644c0555a0 con 0x7f64540b0810 2023-10-06T02:29:17.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:17.790+0000 7f645b3f3700 1 -- 172.21.15.6:0/4076777755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f6454064aa0 con 0x7f64540b0810 2023-10-06T02:29:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.062+0000 7f64527fc700 1 -- 172.21.15.6:0/4076777755 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v324) v1 ==== 162+0+0 (secure 0 0 0) 0x7f644c055130 con 0x7f64540b0810 2023-10-06T02:29:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.064+0000 7f645b3f3700 1 -- 172.21.15.6:0/4076777755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6440066f30 msgr2=0x7f64400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.064+0000 7f645b3f3700 1 --2- 172.21.15.6:0/4076777755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6440066f30 0x7f64400693e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f64540aefc0 tx=0x7f6448008040 comp rx=0 tx=0).stop 2023-10-06T02:29:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.064+0000 7f645b3f3700 1 -- 172.21.15.6:0/4076777755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64540b0810 msgr2=0x7f645416cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.064+0000 7f645b3f3700 1 --2- 172.21.15.6:0/4076777755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64540b0810 0x7f645416cd90 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7f644c00c850 tx=0x7f644c008040 comp rx=0 tx=0).stop 2023-10-06T02:29:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.064+0000 7f645b3f3700 1 -- 172.21.15.6:0/4076777755 shutdown_connections 2023-10-06T02:29:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.064+0000 7f645b3f3700 1 --2- 172.21.15.6:0/4076777755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64541530b0 0x7f645416a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.064+0000 7f645b3f3700 1 --2- 172.21.15.6:0/4076777755 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6440066f30 0x7f64400693e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.064+0000 7f645b3f3700 1 --2- 172.21.15.6:0/4076777755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64540b0810 0x7f645416cd90 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.064+0000 7f645b3f3700 1 --2- 172.21.15.6:0/4076777755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64540cd400 0x7f64540c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.064+0000 7f645b3f3700 1 -- 172.21.15.6:0/4076777755 >> 172.21.15.6:0/4076777755 conn(0x7f645406a110 msgr2=0x7f64540ce500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.064+0000 7f645b3f3700 1 -- 172.21.15.6:0/4076777755 shutdown_connections 2023-10-06T02:29:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.064+0000 7f645b3f3700 1 -- 172.21.15.6:0/4076777755 wait complete. 2023-10-06T02:29:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:29:18.068 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:29:18.068+0000 7f01e8554700 -1 mds.0.openfiles _load_finish: corrupted header/values: End of buffer 2023-10-06T02:29:18.482 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:18.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.609+0000 7f5c43433700 1 Processor -- start 2023-10-06T02:29:18.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.610+0000 7f5c43433700 1 -- start start 2023-10-06T02:29:18.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.610+0000 7f5c43433700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5c3c0af4e0 0x7f5c3c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.610+0000 7f5c43433700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c3c0af8b0 0x7f5c3c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.610+0000 7f5c43433700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c3c15d460 0x7f5c3c15d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.610+0000 7f5c43433700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3c0b1910 con 0x7f5c3c15d460 2023-10-06T02:29:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.610+0000 7f5c43433700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3c15e190 con 0x7f5c3c0af4e0 2023-10-06T02:29:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.610+0000 7f5c43433700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c0cb650 con 0x7f5c3c0af8b0 2023-10-06T02:29:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.610+0000 7f5c419d0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c3c15d460 0x7f5c3c15d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.611+0000 7f5c419d0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c3c15d460 0x7f5c3c15d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42692/0 (socket says 172.21.15.6:42692) 2023-10-06T02:29:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.611+0000 7f5c419d0700 1 -- 172.21.15.6:0/3570547757 learned_addr learned my addr 172.21.15.6:0/3570547757 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.611+0000 7f5c409ce700 1 --2- 172.21.15.6:0/3570547757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c3c0af8b0 0x7f5c3c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.611+0000 7f5c411cf700 1 --2- 172.21.15.6:0/3570547757 >> v2:172.21.15.175:3300/0 conn(0x7f5c3c0af4e0 0x7f5c3c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.611+0000 7f5c419d0700 1 -- 172.21.15.6:0/3570547757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c3c0af8b0 msgr2=0x7f5c3c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.611+0000 7f5c419d0700 1 --2- 172.21.15.6:0/3570547757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c3c0af8b0 0x7f5c3c0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.611+0000 7f5c419d0700 1 -- 172.21.15.6:0/3570547757 >> v2:172.21.15.175:3300/0 conn(0x7f5c3c0af4e0 msgr2=0x7f5c3c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.611+0000 7f5c419d0700 1 --2- 172.21.15.6:0/3570547757 >> v2:172.21.15.175:3300/0 conn(0x7f5c3c0af4e0 0x7f5c3c0b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.611+0000 7f5c419d0700 1 -- 172.21.15.6:0/3570547757 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c0b2b60 con 0x7f5c3c15d460 2023-10-06T02:29:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.611+0000 7f5c411cf700 1 --2- 172.21.15.6:0/3570547757 >> v2:172.21.15.175:3300/0 conn(0x7f5c3c0af4e0 0x7f5c3c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.611+0000 7f5c409ce700 1 --2- 172.21.15.6:0/3570547757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c3c0af8b0 0x7f5c3c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.611+0000 7f5c419d0700 1 --2- 172.21.15.6:0/3570547757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c15d460 0x7f5c3c15d8a0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0d1360 tx=0x7f5c2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4f9e2760f55208 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.611+0000 7f5c3bfff700 1 -- 172.21.15.6:0/3570547757 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c00e070 con 0x7f5c3c15d460 2023-10-06T02:29:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.611+0000 7f5c3bfff700 1 -- 172.21.15.6:0/3570547757 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c00ba50 con 0x7f5c3c15d460 2023-10-06T02:29:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.611+0000 7f5c3bfff700 1 -- 172.21.15.6:0/3570547757 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c0092e0 con 0x7f5c3c15d460 2023-10-06T02:29:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.612+0000 7f5c43433700 1 -- 172.21.15.6:0/3570547757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c15d460 msgr2=0x7f5c3c15d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.612+0000 7f5c43433700 1 --2- 172.21.15.6:0/3570547757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c15d460 0x7f5c3c15d8a0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0d1360 tx=0x7f5c2c009840 comp rx=0 tx=0).stop 2023-10-06T02:29:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.612+0000 7f5c43433700 1 -- 172.21.15.6:0/3570547757 shutdown_connections 2023-10-06T02:29:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.612+0000 7f5c43433700 1 --2- 172.21.15.6:0/3570547757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c15d460 0x7f5c3c15d8a0 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.612+0000 7f5c43433700 1 --2- 172.21.15.6:0/3570547757 >> v2:172.21.15.175:3300/0 conn(0x7f5c3c0af4e0 0x7f5c3c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.612+0000 7f5c43433700 1 --2- 172.21.15.6:0/3570547757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c3c0af8b0 0x7f5c3c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.612+0000 7f5c43433700 1 -- 172.21.15.6:0/3570547757 >> 172.21.15.6:0/3570547757 conn(0x7f5c3c068680 msgr2=0x7f5c3c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.612+0000 7f5c43433700 1 -- 172.21.15.6:0/3570547757 shutdown_connections 2023-10-06T02:29:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.612+0000 7f5c43433700 1 -- 172.21.15.6:0/3570547757 wait complete. 2023-10-06T02:29:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.613+0000 7f5c43433700 1 Processor -- start 2023-10-06T02:29:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.613+0000 7f5c43433700 1 -- start start 2023-10-06T02:29:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.614+0000 7f5c43433700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c0af4e0 0x7f5c3c148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.614+0000 7f5c43433700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c3c0af8b0 0x7f5c3c156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.614+0000 7f5c43433700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c3c15d460 0x7f5c3c16d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.614+0000 7f5c43433700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c149520 con 0x7f5c3c0af4e0 2023-10-06T02:29:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.614+0000 7f5c43433700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c1581b0 con 0x7f5c3c0af8b0 2023-10-06T02:29:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.614+0000 7f5c43433700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c158640 con 0x7f5c3c15d460 2023-10-06T02:29:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.614+0000 7f5c411cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c0af4e0 0x7f5c3c148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.614+0000 7f5c411cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c0af4e0 0x7f5c3c148fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42706/0 (socket says 172.21.15.6:42706) 2023-10-06T02:29:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.614+0000 7f5c411cf700 1 -- 172.21.15.6:0/1470312665 learned_addr learned my addr 172.21.15.6:0/1470312665 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.614+0000 7f5c419d0700 1 --2- 172.21.15.6:0/1470312665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c3c15d460 0x7f5c3c16d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.614+0000 7f5c409ce700 1 --2- 172.21.15.6:0/1470312665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c3c0af8b0 0x7f5c3c156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.614+0000 7f5c411cf700 1 -- 172.21.15.6:0/1470312665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c3c15d460 msgr2=0x7f5c3c16d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.614+0000 7f5c411cf700 1 --2- 172.21.15.6:0/1470312665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c3c15d460 0x7f5c3c16d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.614+0000 7f5c411cf700 1 -- 172.21.15.6:0/1470312665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c3c0af8b0 msgr2=0x7f5c3c156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.614+0000 7f5c411cf700 1 --2- 172.21.15.6:0/1470312665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c3c0af8b0 0x7f5c3c156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.614+0000 7f5c411cf700 1 -- 172.21.15.6:0/1470312665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c009ae0 con 0x7f5c3c0af4e0 2023-10-06T02:29:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.614+0000 7f5c419d0700 1 --2- 172.21.15.6:0/1470312665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c3c15d460 0x7f5c3c16d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.615+0000 7f5c409ce700 1 --2- 172.21.15.6:0/1470312665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c3c0af8b0 0x7f5c3c156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.615+0000 7f5c411cf700 1 --2- 172.21.15.6:0/1470312665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c0af4e0 0x7f5c3c148fe0 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400e900 tx=0x7f5c34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.615+0000 7f5c397fa700 1 -- 172.21.15.6:0/1470312665 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3400eea0 con 0x7f5c3c0af4e0 2023-10-06T02:29:18.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.615+0000 7f5c397fa700 1 -- 172.21.15.6:0/1470312665 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3400c5e0 con 0x7f5c3c0af4e0 2023-10-06T02:29:18.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.615+0000 7f5c43433700 1 -- 172.21.15.6:0/1470312665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3c1575a0 con 0x7f5c3c0af4e0 2023-10-06T02:29:18.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.615+0000 7f5c397fa700 1 -- 172.21.15.6:0/1470312665 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3400c980 con 0x7f5c3c0af4e0 2023-10-06T02:29:18.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.615+0000 7f5c43433700 1 -- 172.21.15.6:0/1470312665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3c157b60 con 0x7f5c3c0af4e0 2023-10-06T02:29:18.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.616+0000 7f5c43433700 1 -- 172.21.15.6:0/1470312665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3c158490 con 0x7f5c3c0af4e0 2023-10-06T02:29:18.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.616+0000 7f5c397fa700 1 -- 172.21.15.6:0/1470312665 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c3400cd30 con 0x7f5c3c0af4e0 2023-10-06T02:29:18.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.617+0000 7f5c397fa700 1 --2- 172.21.15.6:0/1470312665 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c28066f30 0x7f5c280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:18.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.617+0000 7f5c397fa700 1 -- 172.21.15.6:0/1470312665 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 9474+0+0 (secure 0 0 0) 0x7f5c34085200 con 0x7f5c3c0af4e0 2023-10-06T02:29:18.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.617+0000 7f5c409ce700 1 --2- 172.21.15.6:0/1470312665 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c28066f30 0x7f5c280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:18.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.617+0000 7f5c409ce700 1 --2- 172.21.15.6:0/1470312665 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c28066f30 0x7f5c280693e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c1540c0 tx=0x7f5c30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:18.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.621+0000 7f5c397fa700 1 -- 172.21.15.6:0/1470312665 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c34055000 con 0x7f5c3c0af4e0 2023-10-06T02:29:18.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.858+0000 7f5c43433700 1 -- 172.21.15.6:0/1470312665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c3c0cad20 con 0x7f5c3c0af4e0 2023-10-06T02:29:18.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.858+0000 7f5c397fa700 1 -- 172.21.15.6:0/1470312665 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 325 v325) v1 ==== 95+0+4607 (secure 0 0 0) 0x7f5c34054b90 con 0x7f5c3c0af4e0 2023-10-06T02:29:18.860 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:18.860 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":325,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":325,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:18.063173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":131,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10443},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10443":{"gid":10443,"name":"a","rank":0,"incarnation":325,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/1486243669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1486243669},{"type":"v1","addr":"172.21.15.6:6835","nonce":1486243669}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:18.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.861+0000 7f5c43433700 1 -- 172.21.15.6:0/1470312665 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c28066f30 msgr2=0x7f5c280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:18.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.861+0000 7f5c43433700 1 --2- 172.21.15.6:0/1470312665 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c28066f30 0x7f5c280693e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c1540c0 tx=0x7f5c30008040 comp rx=0 tx=0).stop 2023-10-06T02:29:18.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.861+0000 7f5c43433700 1 -- 172.21.15.6:0/1470312665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c0af4e0 msgr2=0x7f5c3c148fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:18.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.861+0000 7f5c43433700 1 --2- 172.21.15.6:0/1470312665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c0af4e0 0x7f5c3c148fe0 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400e900 tx=0x7f5c34008040 comp rx=0 tx=0).stop 2023-10-06T02:29:18.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.861+0000 7f5c43433700 1 -- 172.21.15.6:0/1470312665 shutdown_connections 2023-10-06T02:29:18.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.861+0000 7f5c43433700 1 --2- 172.21.15.6:0/1470312665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c3c15d460 0x7f5c3c16d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:18.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.861+0000 7f5c43433700 1 --2- 172.21.15.6:0/1470312665 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c28066f30 0x7f5c280693e0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:18.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.861+0000 7f5c43433700 1 --2- 172.21.15.6:0/1470312665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c0af4e0 0x7f5c3c148fe0 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:18.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.861+0000 7f5c43433700 1 --2- 172.21.15.6:0/1470312665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c3c0af8b0 0x7f5c3c156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:18.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.861+0000 7f5c43433700 1 -- 172.21.15.6:0/1470312665 >> 172.21.15.6:0/1470312665 conn(0x7f5c3c068680 msgr2=0x7f5c3c154d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:18.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.861+0000 7f5c43433700 1 -- 172.21.15.6:0/1470312665 shutdown_connections 2023-10-06T02:29:18.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:18.861+0000 7f5c43433700 1 -- 172.21.15.6:0/1470312665 wait complete. 2023-10-06T02:29:18.864 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 325 2023-10-06T02:29:18.873 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 325, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:29:18.063173+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 131, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10443}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10443': {'gid': 10443, 'name': 'a', 'rank': 0, 'incarnation': 325, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.6:6835/1486243669', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 1486243669}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 1486243669}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:29:18.874 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10443:up:replay 2023-10-06T02:29:18.874 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2023-10-06T02:29:22.485 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:29:22.488 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:29:23.047 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:29:23.047+0000 7f01ebd5b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:29:24.277 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:25.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.178+0000 7f4b9f59e700 1 Processor -- start 2023-10-06T02:29:25.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.178+0000 7f4b9f59e700 1 -- start start 2023-10-06T02:29:25.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.179+0000 7f4b9f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ba00cf1a0 0x7f4ba00cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.179+0000 7f4b9f59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4ba01597d0 0x7f4ba00d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.179+0000 7f4b9f59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba00b3560 con 0x7f4ba0159400 2023-10-06T02:29:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.179+0000 7f4b9f59e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba00cf6f0 con 0x7f4ba01597d0 2023-10-06T02:29:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.179+0000 7f4b9f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00cf9d0 con 0x7f4ba00cf1a0 2023-10-06T02:29:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.179+0000 7f4b9ed9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4ba01597d0 0x7f4ba00d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.179+0000 7f4b9dd9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ba00cf1a0 0x7f4ba00cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.179+0000 7f4b9e59c700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4ba0159400 0x7f4ba00ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:40184/0 (socket says 172.21.15.6:40184) 2023-10-06T02:29:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.179+0000 7f4b9dd9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ba00cf1a0 0x7f4ba00cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:60742/0 (socket says 172.21.15.6:60742) 2023-10-06T02:29:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.179+0000 7f4b9e59c700 1 -- 172.21.15.6:0/3862823375 learned_addr learned my addr 172.21.15.6:0/3862823375 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.179+0000 7f4b9ed9d700 1 --2- 172.21.15.6:0/3862823375 >> v2:172.21.15.175:3300/0 conn(0x7f4ba01597d0 0x7f4ba00d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:34322/0 (socket says 172.21.15.6:34322) 2023-10-06T02:29:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.180+0000 7f4b9dd9b700 1 -- 172.21.15.6:0/3862823375 >> v2:172.21.15.175:3300/0 conn(0x7f4ba01597d0 msgr2=0x7f4ba00d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.180+0000 7f4b9dd9b700 1 --2- 172.21.15.6:0/3862823375 >> v2:172.21.15.175:3300/0 conn(0x7f4ba01597d0 0x7f4ba00d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.180+0000 7f4b9dd9b700 1 -- 172.21.15.6:0/3862823375 >> v1:172.21.15.175:6789/0 conn(0x7f4ba0159400 legacy=0x7f4ba00ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.180+0000 7f4b9dd9b700 1 -- 172.21.15.6:0/3862823375 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba00b2f10 con 0x7f4ba00cf1a0 2023-10-06T02:29:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.180+0000 7f4b9ed9d700 1 --2- 172.21.15.6:0/3862823375 >> v2:172.21.15.175:3300/0 conn(0x7f4ba01597d0 0x7f4ba00d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.180+0000 7f4b9dd9b700 1 --2- 172.21.15.6:0/3862823375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ba00cf1a0 0x7f4ba00cfec0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4b880098e0 tx=0x7f4b880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38f470d90c686772 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.180+0000 7f4b9d59a700 1 -- 172.21.15.6:0/3862823375 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b88011630 con 0x7f4ba00cf1a0 2023-10-06T02:29:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.180+0000 7f4b9d59a700 1 -- 172.21.15.6:0/3862823375 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b88011790 con 0x7f4ba00cf1a0 2023-10-06T02:29:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.180+0000 7f4b9d59a700 1 -- 172.21.15.6:0/3862823375 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b88011b30 con 0x7f4ba00cf1a0 2023-10-06T02:29:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.181+0000 7f4b9f59e700 1 -- 172.21.15.6:0/3862823375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ba00cf1a0 msgr2=0x7f4ba00cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.181+0000 7f4b9f59e700 1 --2- 172.21.15.6:0/3862823375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ba00cf1a0 0x7f4ba00cfec0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4b880098e0 tx=0x7f4b880091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.181+0000 7f4b9f59e700 1 -- 172.21.15.6:0/3862823375 shutdown_connections 2023-10-06T02:29:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.181+0000 7f4b9f59e700 1 --2- 172.21.15.6:0/3862823375 >> v2:172.21.15.175:3300/0 conn(0x7f4ba01597d0 0x7f4ba00d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.181+0000 7f4b9f59e700 1 --2- 172.21.15.6:0/3862823375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ba00cf1a0 0x7f4ba00cfec0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.181+0000 7f4b9f59e700 1 -- 172.21.15.6:0/3862823375 >> 172.21.15.6:0/3862823375 conn(0x7f4ba006ac10 msgr2=0x7f4ba0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.181+0000 7f4b9f59e700 1 -- 172.21.15.6:0/3862823375 shutdown_connections 2023-10-06T02:29:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.181+0000 7f4b9f59e700 1 -- 172.21.15.6:0/3862823375 wait complete. 2023-10-06T02:29:25.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.182+0000 7f4b9f59e700 1 Processor -- start 2023-10-06T02:29:25.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.182+0000 7f4b9f59e700 1 -- start start 2023-10-06T02:29:25.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.183+0000 7f4b9f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ba00cf1a0 0x7f4ba0145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.183+0000 7f4b9f59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ba0159400 0x7f4ba0169b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.183+0000 7f4b9f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba01597d0 0x7f4ba00b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.183+0000 7f4b9f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00b45f0 con 0x7f4ba01597d0 2023-10-06T02:29:25.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.183+0000 7f4b9f59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00b48d0 con 0x7f4ba0159400 2023-10-06T02:29:25.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.183+0000 7f4b9f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00b4bb0 con 0x7f4ba00cf1a0 2023-10-06T02:29:25.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.183+0000 7f4b9ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba01597d0 0x7f4ba00b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.183+0000 7f4b9ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba01597d0 0x7f4ba00b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57224/0 (socket says 172.21.15.6:57224) 2023-10-06T02:29:25.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.183+0000 7f4b9ed9d700 1 -- 172.21.15.6:0/3923365374 learned_addr learned my addr 172.21.15.6:0/3923365374 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:25.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.183+0000 7f4b9dd9b700 1 --2- 172.21.15.6:0/3923365374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ba0159400 0x7f4ba0169b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.183+0000 7f4b9e59c700 1 --2- 172.21.15.6:0/3923365374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ba00cf1a0 0x7f4ba0145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.184+0000 7f4b9ed9d700 1 -- 172.21.15.6:0/3923365374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ba00cf1a0 msgr2=0x7f4ba0145aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.184+0000 7f4b9ed9d700 1 --2- 172.21.15.6:0/3923365374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ba00cf1a0 0x7f4ba0145aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.184+0000 7f4b9ed9d700 1 -- 172.21.15.6:0/3923365374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ba0159400 msgr2=0x7f4ba0169b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.184+0000 7f4b9ed9d700 1 --2- 172.21.15.6:0/3923365374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ba0159400 0x7f4ba0169b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.184+0000 7f4b9ed9d700 1 -- 172.21.15.6:0/3923365374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b98009420 con 0x7f4ba01597d0 2023-10-06T02:29:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.184+0000 7f4b9ed9d700 1 --2- 172.21.15.6:0/3923365374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba01597d0 0x7f4ba00b0d90 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009fd0 tx=0x7f4b980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.184+0000 7f4b967fc700 1 -- 172.21.15.6:0/3923365374 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9800c6a0 con 0x7f4ba01597d0 2023-10-06T02:29:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.184+0000 7f4b967fc700 1 -- 172.21.15.6:0/3923365374 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9800c820 con 0x7f4ba01597d0 2023-10-06T02:29:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.184+0000 7f4b967fc700 1 -- 172.21.15.6:0/3923365374 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9800cbe0 con 0x7f4ba01597d0 2023-10-06T02:29:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.184+0000 7f4b9f59e700 1 -- 172.21.15.6:0/3923365374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b88009420 con 0x7f4ba01597d0 2023-10-06T02:29:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.184+0000 7f4b9f59e700 1 -- 172.21.15.6:0/3923365374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba00b5170 con 0x7f4ba01597d0 2023-10-06T02:29:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.185+0000 7f4b9f59e700 1 -- 172.21.15.6:0/3923365374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba00b5360 con 0x7f4ba01597d0 2023-10-06T02:29:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.185+0000 7f4b967fc700 1 -- 172.21.15.6:0/3923365374 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b98013470 con 0x7f4ba01597d0 2023-10-06T02:29:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.186+0000 7f4b967fc700 1 --2- 172.21.15.6:0/3923365374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b80066f30 0x7f4b800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.186+0000 7f4b967fc700 1 -- 172.21.15.6:0/3923365374 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 9474+0+0 (secure 0 0 0) 0x7f4b980855f0 con 0x7f4ba01597d0 2023-10-06T02:29:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.186+0000 7f4b9e59c700 1 --2- 172.21.15.6:0/3923365374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b80066f30 0x7f4b800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.186+0000 7f4b9e59c700 1 --2- 172.21.15.6:0/3923365374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b80066f30 0x7f4b800693e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f4b90007400 tx=0x7f4b90001b00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:25.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.190+0000 7f4b967fc700 1 -- 172.21.15.6:0/3923365374 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b980553f0 con 0x7f4ba01597d0 2023-10-06T02:29:25.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.428+0000 7f4b9f59e700 1 -- 172.21.15.6:0/3923365374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ba00b31f0 con 0x7f4ba01597d0 2023-10-06T02:29:25.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.428+0000 7f4b967fc700 1 -- 172.21.15.6:0/3923365374 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 328 v328) v1 ==== 95+0+4607 (secure 0 0 0) 0x7f4b98054f80 con 0x7f4ba01597d0 2023-10-06T02:29:25.429 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:25.429 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":328,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":328,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:21.085583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":131,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10443},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10443":{"gid":10443,"name":"a","rank":0,"incarnation":325,"state":"up:active","state_seq":5,"addr":"172.21.15.6:6835/1486243669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1486243669},{"type":"v1","addr":"172.21.15.6:6835","nonce":1486243669}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:25.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.430+0000 7f4b9f59e700 1 -- 172.21.15.6:0/3923365374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b80066f30 msgr2=0x7f4b800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.430+0000 7f4b9f59e700 1 --2- 172.21.15.6:0/3923365374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b80066f30 0x7f4b800693e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f4b90007400 tx=0x7f4b90001b00 comp rx=0 tx=0).stop 2023-10-06T02:29:25.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.430+0000 7f4b9f59e700 1 -- 172.21.15.6:0/3923365374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba01597d0 msgr2=0x7f4ba00b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.430+0000 7f4b9f59e700 1 --2- 172.21.15.6:0/3923365374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba01597d0 0x7f4ba00b0d90 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009fd0 tx=0x7f4b980091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.430+0000 7f4b9f59e700 1 -- 172.21.15.6:0/3923365374 shutdown_connections 2023-10-06T02:29:25.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.430+0000 7f4b9f59e700 1 --2- 172.21.15.6:0/3923365374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b80066f30 0x7f4b800693e0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.430+0000 7f4b9f59e700 1 --2- 172.21.15.6:0/3923365374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba01597d0 0x7f4ba00b0d90 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.430+0000 7f4b9f59e700 1 --2- 172.21.15.6:0/3923365374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ba00cf1a0 0x7f4ba0145aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.430+0000 7f4b9f59e700 1 --2- 172.21.15.6:0/3923365374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ba0159400 0x7f4ba0169b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.430+0000 7f4b9f59e700 1 -- 172.21.15.6:0/3923365374 >> 172.21.15.6:0/3923365374 conn(0x7f4ba006ac10 msgr2=0x7f4ba0155d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:25.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.430+0000 7f4b9f59e700 1 -- 172.21.15.6:0/3923365374 shutdown_connections 2023-10-06T02:29:25.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.430+0000 7f4b9f59e700 1 -- 172.21.15.6:0/3923365374 wait complete. 2023-10-06T02:29:25.434 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 328 2023-10-06T02:29:25.443 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 328, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:40.366191+0000', 'modified': '2023-10-06T02:29:21.085583+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 131, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10443}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10443': {'gid': 10443, 'name': 'a', 'rank': 0, 'incarnation': 325, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.6:6835/1486243669', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 1486243669}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 1486243669}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:29:25.443 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:29:25.443 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:29:25.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.562+0000 7f8857314700 1 Processor -- start 2023-10-06T02:29:25.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.562+0000 7f8857314700 1 -- start start 2023-10-06T02:29:25.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.563+0000 7f8857314700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8850159280 0x7f885006f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.563+0000 7f8857314700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8850159650 0x7f8850068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.563+0000 7f8857314700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88500c8340 con 0x7f885006f950 2023-10-06T02:29:25.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.563+0000 7f8857314700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88500c7a10 con 0x7f8850159280 2023-10-06T02:29:25.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.563+0000 7f8857314700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88500c7cf0 con 0x7f8850159650 2023-10-06T02:29:25.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.563+0000 7f8856312700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8850159280 0x7f885006f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.563+0000 7f8856b13700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f885006f950 0x7f885015cf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52224/0 (socket says 172.21.15.6:52224) 2023-10-06T02:29:25.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.563+0000 7f8856b13700 1 -- 172.21.15.6:0/1020440409 learned_addr learned my addr 172.21.15.6:0/1020440409 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:25.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.564+0000 7f8855b11700 1 --2- 172.21.15.6:0/1020440409 >> v2:172.21.15.175:3300/0 conn(0x7f8850159650 0x7f8850068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.564+0000 7f8856312700 1 -- 172.21.15.6:0/1020440409 >> v2:172.21.15.175:3300/0 conn(0x7f8850159650 msgr2=0x7f8850068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:25.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.564+0000 7f8856312700 1 --2- 172.21.15.6:0/1020440409 >> v2:172.21.15.175:3300/0 conn(0x7f8850159650 0x7f8850068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.564+0000 7f8856312700 1 -- 172.21.15.6:0/1020440409 >> v1:172.21.15.6:6789/0 conn(0x7f885006f950 legacy=0x7f885015cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.564+0000 7f8856312700 1 -- 172.21.15.6:0/1020440409 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88500c7fd0 con 0x7f8850159280 2023-10-06T02:29:25.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.564+0000 7f8855310700 1 -- 172.21.15.6:0/1020440409 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2218801242 0 0) 0x7f88500c8340 con 0x7f885006f950 2023-10-06T02:29:25.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.564+0000 7f8856312700 1 --2- 172.21.15.6:0/1020440409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8850159280 0x7f885006f410 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f8850069660 tx=0x7f88480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8acf7590495690f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:25.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.564+0000 7f8855310700 1 -- 172.21.15.6:0/1020440409 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884800b6b0 con 0x7f8850159280 2023-10-06T02:29:25.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.564+0000 7f8855310700 1 -- 172.21.15.6:0/1020440409 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884800b810 con 0x7f8850159280 2023-10-06T02:29:25.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.564+0000 7f8855310700 1 -- 172.21.15.6:0/1020440409 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884800bbb0 con 0x7f8850159280 2023-10-06T02:29:25.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.565+0000 7f8857314700 1 -- 172.21.15.6:0/1020440409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8850159280 msgr2=0x7f885006f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.565+0000 7f8857314700 1 --2- 172.21.15.6:0/1020440409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8850159280 0x7f885006f410 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f8850069660 tx=0x7f88480091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.565+0000 7f8857314700 1 -- 172.21.15.6:0/1020440409 shutdown_connections 2023-10-06T02:29:25.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.565+0000 7f8857314700 1 --2- 172.21.15.6:0/1020440409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8850159280 0x7f885006f410 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.565+0000 7f8857314700 1 --2- 172.21.15.6:0/1020440409 >> v2:172.21.15.175:3300/0 conn(0x7f8850159650 0x7f8850068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.565+0000 7f8857314700 1 -- 172.21.15.6:0/1020440409 >> 172.21.15.6:0/1020440409 conn(0x7f88500c9070 msgr2=0x7f88500c9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:25.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.565+0000 7f8857314700 1 -- 172.21.15.6:0/1020440409 shutdown_connections 2023-10-06T02:29:25.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.565+0000 7f8857314700 1 -- 172.21.15.6:0/1020440409 wait complete. 2023-10-06T02:29:25.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.566+0000 7f8857314700 1 Processor -- start 2023-10-06T02:29:25.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.566+0000 7f8857314700 1 -- start start 2023-10-06T02:29:25.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.566+0000 7f8857314700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f885006f950 0x7f88500c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.566+0000 7f8857314700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8850159280 0x7f885015c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.566+0000 7f8857314700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88500c5160 0x7f885015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.566+0000 7f8857314700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8850159a30 con 0x7f88500c5160 2023-10-06T02:29:25.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.566+0000 7f8857314700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8850159f60 con 0x7f8850159280 2023-10-06T02:29:25.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.566+0000 7f8857314700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88500c4240 con 0x7f885006f950 2023-10-06T02:29:25.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.567+0000 7f8856b13700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88500c5160 0x7f885015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.567+0000 7f8856b13700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88500c5160 0x7f885015b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57238/0 (socket says 172.21.15.6:57238) 2023-10-06T02:29:25.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.567+0000 7f8856b13700 1 -- 172.21.15.6:0/3627522189 learned_addr learned my addr 172.21.15.6:0/3627522189 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:25.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.567+0000 7f8856312700 1 --2- 172.21.15.6:0/3627522189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f885006f950 0x7f88500c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.567+0000 7f8855b11700 1 --2- 172.21.15.6:0/3627522189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8850159280 0x7f885015c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.567+0000 7f8856b13700 1 -- 172.21.15.6:0/3627522189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f885006f950 msgr2=0x7f88500c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.567+0000 7f8856b13700 1 --2- 172.21.15.6:0/3627522189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f885006f950 0x7f88500c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.567+0000 7f8856b13700 1 -- 172.21.15.6:0/3627522189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8850159280 msgr2=0x7f885015c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.567+0000 7f8856b13700 1 --2- 172.21.15.6:0/3627522189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8850159280 0x7f885015c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.567+0000 7f8856b13700 1 -- 172.21.15.6:0/3627522189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8848009420 con 0x7f88500c5160 2023-10-06T02:29:25.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.567+0000 7f8856b13700 1 --2- 172.21.15.6:0/3627522189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88500c5160 0x7f885015b4b0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f884000ccf0 tx=0x7f8840001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:25.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.567+0000 7f884e7fc700 1 -- 172.21.15.6:0/3627522189 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884000a870 con 0x7f88500c5160 2023-10-06T02:29:25.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.567+0000 7f884e7fc700 1 -- 172.21.15.6:0/3627522189 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884000a9d0 con 0x7f88500c5160 2023-10-06T02:29:25.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.567+0000 7f8857314700 1 -- 172.21.15.6:0/3627522189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8850159c80 con 0x7f88500c5160 2023-10-06T02:29:25.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.567+0000 7f884e7fc700 1 -- 172.21.15.6:0/3627522189 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884000ad70 con 0x7f88500c5160 2023-10-06T02:29:25.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.567+0000 7f8857314700 1 -- 172.21.15.6:0/3627522189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88500c3ed0 con 0x7f88500c5160 2023-10-06T02:29:25.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.569+0000 7f884e7fc700 1 -- 172.21.15.6:0/3627522189 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8840007300 con 0x7f88500c5160 2023-10-06T02:29:25.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.569+0000 7f884e7fc700 1 --2- 172.21.15.6:0/3627522189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f883c066f30 0x7f883c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.569+0000 7f884e7fc700 1 -- 172.21.15.6:0/3627522189 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 9474+0+0 (secure 0 0 0) 0x7f8840085700 con 0x7f88500c5160 2023-10-06T02:29:25.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.569+0000 7f8856312700 1 --2- 172.21.15.6:0/3627522189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f883c066f30 0x7f883c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.570+0000 7f8856312700 1 --2- 172.21.15.6:0/3627522189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f883c066f30 0x7f883c0693e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f88480093f0 tx=0x7f8848017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:25.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.571+0000 7f886186eb80 1 Processor -- start 2023-10-06T02:29:25.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.571+0000 7f886186eb80 1 -- start start 2023-10-06T02:29:25.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f886186eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665ed5e50 0x561665eb0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f886186eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665eb1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f886186eb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665eb7a10 0x561665eb1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f886186eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561665e0ba70 con 0x561665eb62c0 2023-10-06T02:29:25.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f886186eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561665e09270 con 0x561665ed5e50 2023-10-06T02:29:25.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f886186eb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561665e05060 con 0x561665eb7a10 2023-10-06T02:29:25.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f8855b11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665eb1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f8856312700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665ed5e50 0x561665eb0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f8855b11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665eb1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57242/0 (socket says 172.21.15.6:57242) 2023-10-06T02:29:25.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f8855b11700 1 -- 172.21.15.6:0/3111635729 learned_addr learned my addr 172.21.15.6:0/3111635729 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:25.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f8856b13700 1 --2- 172.21.15.6:0/3111635729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665eb7a10 0x561665eb1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f8855b11700 1 -- 172.21.15.6:0/3111635729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665eb7a10 msgr2=0x561665eb1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:25.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f8855b11700 1 --2- 172.21.15.6:0/3111635729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665eb7a10 0x561665eb1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f8855b11700 1 -- 172.21.15.6:0/3111635729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665ed5e50 msgr2=0x561665eb0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:25.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f8855b11700 1 --2- 172.21.15.6:0/3111635729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665ed5e50 0x561665eb0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f8855b11700 1 -- 172.21.15.6:0/3111635729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561665c9f270 con 0x561665eb62c0 2023-10-06T02:29:25.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f8855b11700 1 --2- 172.21.15.6:0/3111635729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665eb1200 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f884400bab0 tx=0x7f8844008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1801ef07ee8c9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:25.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f88377fe700 1 -- 172.21.15.6:0/3111635729 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8844010950 con 0x561665eb62c0 2023-10-06T02:29:25.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f88377fe700 1 -- 172.21.15.6:0/3111635729 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8844010ab0 con 0x561665eb62c0 2023-10-06T02:29:25.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.572+0000 7f88377fe700 1 -- 172.21.15.6:0/3111635729 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8844010e50 con 0x561665eb62c0 2023-10-06T02:29:25.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.573+0000 7f886186eb80 1 -- 172.21.15.6:0/3111635729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 msgr2=0x561665eb1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.573+0000 7f886186eb80 1 --2- 172.21.15.6:0/3111635729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665eb1200 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f884400bab0 tx=0x7f8844008040 comp rx=0 tx=0).stop 2023-10-06T02:29:25.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.573+0000 7f886186eb80 1 -- 172.21.15.6:0/3111635729 shutdown_connections 2023-10-06T02:29:25.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.573+0000 7f886186eb80 1 --2- 172.21.15.6:0/3111635729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665eb7a10 0x561665eb1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.573+0000 7f886186eb80 1 --2- 172.21.15.6:0/3111635729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665ed5e50 0x561665eb0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.573+0000 7f886186eb80 1 --2- 172.21.15.6:0/3111635729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665eb1200 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.573+0000 7f886186eb80 1 -- 172.21.15.6:0/3111635729 >> 172.21.15.6:0/3111635729 conn(0x561665eb5e80 msgr2=0x561665eb66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:25.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.573+0000 7f886186eb80 1 -- 172.21.15.6:0/3111635729 shutdown_connections 2023-10-06T02:29:25.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.573+0000 7f886186eb80 1 -- 172.21.15.6:0/3111635729 wait complete. 2023-10-06T02:29:25.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.574+0000 7f886186eb80 1 -- start start 2023-10-06T02:29:25.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.574+0000 7f886186eb80 1 Processor -- start 2023-10-06T02:29:25.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f886186eb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665eb62c0 0x561665f0b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f886186eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb7a10 0x561665ee3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f886186eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665ed5e50 0x561665ee38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f886186eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561665db0890 con 0x561665eb7a10 2023-10-06T02:29:25.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f886186eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561665dcbea0 con 0x561665ed5e50 2023-10-06T02:29:25.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f886186eb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561665c87e30 con 0x561665eb62c0 2023-10-06T02:29:25.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f886186eb80 10 client.0 _ll_register_callbacks cb 0x561665e78020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:29:25.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f8855b11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb7a10 0x561665ee3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f8855b11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb7a10 0x561665ee3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57252/0 (socket says 172.21.15.6:57252) 2023-10-06T02:29:25.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f8855b11700 1 -- 172.21.15.6:0/2738868100 learned_addr learned my addr 172.21.15.6:0/2738868100 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:25.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f8856312700 1 --2- 172.21.15.6:0/2738868100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665eb62c0 0x561665f0b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f8856b13700 1 --2- 172.21.15.6:0/2738868100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665ed5e50 0x561665ee38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f8855b11700 1 -- 172.21.15.6:0/2738868100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665eb62c0 msgr2=0x561665f0b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:25.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f8855b11700 1 --2- 172.21.15.6:0/2738868100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665eb62c0 0x561665f0b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f8855b11700 1 -- 172.21.15.6:0/2738868100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665ed5e50 msgr2=0x561665ee38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:25.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f8855b11700 1 --2- 172.21.15.6:0/2738868100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665ed5e50 0x561665ee38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f8855b11700 1 -- 172.21.15.6:0/2738868100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884400e040 con 0x561665eb7a10 2023-10-06T02:29:25.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f8855b11700 1 --2- 172.21.15.6:0/2738868100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb7a10 0x561665ee3370 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f8844010530 tx=0x7f884401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39af8068fb7197d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:25.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f8834ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:29:25.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f8834ff9700 1 -- 172.21.15.6:0/2738868100 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8844022070 con 0x561665eb7a10 2023-10-06T02:29:25.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f8834ff9700 1 -- 172.21.15.6:0/2738868100 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 9474+0+0 (secure 0 0 0) 0x7f8844014850 con 0x561665eb7a10 2023-10-06T02:29:25.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.575+0000 7f886186eb80 1 -- 172.21.15.6:0/2738868100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561665ea9940 con 0x561665eb7a10 2023-10-06T02:29:25.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.576+0000 7f8834ff9700 1 -- 172.21.15.6:0/2738868100 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=328) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8844014c20 con 0x561665eb7a10 2023-10-06T02:29:25.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.576+0000 7f886186eb80 10 client.10524 fetch_fsmap learned FSMap version 328 2023-10-06T02:29:25.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.576+0000 7f886186eb80 1 -- 172.21.15.6:0/2738868100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=328,monmap=2+}) v3 -- 0x561665c41fe0 con 0x561665eb7a10 2023-10-06T02:29:25.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.576+0000 7f8834ff9700 1 -- 172.21.15.6:0/2738868100 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561665ea9940 con 0x561665eb7a10 2023-10-06T02:29:25.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.576+0000 7f8834ff9700 1 -- 172.21.15.6:0/2738868100 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 328) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f884401d450 con 0x561665eb7a10 2023-10-06T02:29:25.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.576+0000 7f886186eb80 10 client.10524 fetch_fsmap finished waiting for FSMap version 328 2023-10-06T02:29:25.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.576+0000 7f886186eb80 10 client.10524 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:29:25.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.576+0000 7f886186eb80 20 client.10524 populate_metadata read hostname 'smithi006' 2023-10-06T02:29:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.576+0000 7f886186eb80 1 --2- 172.21.15.6:0/2738868100 >> [v2:172.21.15.6:6833/1486243669,v1:172.21.15.6:6835/1486243669] conn(0x561665f0d8e0 0x561665f0dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.576+0000 7f886186eb80 4 client.10524 mds_command: new command op to 10443 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:29:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.576+0000 7f886186eb80 1 -- 172.21.15.6:0/2738868100 --> [v2:172.21.15.6:6833/1486243669,v1:172.21.15.6:6835/1486243669] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561665e86870 con 0x561665f0d8e0 2023-10-06T02:29:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.576+0000 7f8856312700 1 --2- 172.21.15.6:0/2738868100 >> [v2:172.21.15.6:6833/1486243669,v1:172.21.15.6:6835/1486243669] conn(0x561665f0d8e0 0x561665f0dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.576+0000 7f8834ff9700 10 client.10524 ms_handle_connect on v2:172.21.15.6:6833/1486243669 2023-10-06T02:29:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.576+0000 7f8856312700 1 --2- 172.21.15.6:0/2738868100 >> [v2:172.21.15.6:6833/1486243669,v1:172.21.15.6:6835/1486243669] conn(0x561665f0d8e0 0x561665f0dcb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e12c1fe22b15966f server_cookie=b39f3d03684332f3 in_seq=0 out_seq=0 2023-10-06T02:29:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.577+0000 7f8834ff9700 1 -- 172.21.15.6:0/2738868100 <== mds.0 v2:172.21.15.6:6833/1486243669 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x561665e86870 con 0x561665f0d8e0 2023-10-06T02:29:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.577+0000 7f8834ff9700 10 client.10524 handle_command_reply: tid=0 2023-10-06T02:29:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.577+0000 7f886186eb80 1 client.10524 shutdown 2023-10-06T02:29:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.577+0000 7f886186eb80 1 -- 172.21.15.6:0/2738868100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb7a10 msgr2=0x561665ee3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.577+0000 7f886186eb80 1 --2- 172.21.15.6:0/2738868100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb7a10 0x561665ee3370 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f8844010530 tx=0x7f884401d000 comp rx=0 tx=0).stop 2023-10-06T02:29:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.577+0000 7f886186eb80 1 -- 172.21.15.6:0/2738868100 shutdown_connections 2023-10-06T02:29:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.577+0000 7f886186eb80 1 --2- 172.21.15.6:0/2738868100 >> [v2:172.21.15.6:6833/1486243669,v1:172.21.15.6:6835/1486243669] conn(0x561665f0d8e0 0x561665f0dcb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.577+0000 7f886186eb80 1 --2- 172.21.15.6:0/2738868100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665ed5e50 0x561665ee38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.577+0000 7f886186eb80 1 --2- 172.21.15.6:0/2738868100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665eb62c0 0x561665f0b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.577+0000 7f8834ff9700 0 client.10524 ms_handle_reset on v2:172.21.15.6:6833/1486243669 2023-10-06T02:29:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.577+0000 7f886186eb80 1 --2- 172.21.15.6:0/2738868100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb7a10 0x561665ee3370 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.577+0000 7f886186eb80 1 -- 172.21.15.6:0/2738868100 >> 172.21.15.6:0/2738868100 conn(0x561665eb5e80 msgr2=0x561665eb6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.577+0000 7f886186eb80 1 -- 172.21.15.6:0/2738868100 shutdown_connections 2023-10-06T02:29:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.577+0000 7f886186eb80 1 -- 172.21.15.6:0/2738868100 wait complete. 2023-10-06T02:29:25.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.578+0000 7f886186eb80 20 client.10524 trim_cache size 0 max 16384 2023-10-06T02:29:25.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.594+0000 7f886186eb80 1 Processor -- start 2023-10-06T02:29:25.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.594+0000 7f886186eb80 1 -- start start 2023-10-06T02:29:25.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.595+0000 7f886186eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665ee3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.595+0000 7f886186eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665eb7a10 0x561665f5b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.595+0000 7f886186eb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665ed5e50 0x561665f5bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.595+0000 7f886186eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561665ed7260 con 0x561665eb62c0 2023-10-06T02:29:25.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.595+0000 7f886186eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561665eab640 con 0x561665eb7a10 2023-10-06T02:29:25.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.595+0000 7f886186eb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561665ed5620 con 0x561665ed5e50 2023-10-06T02:29:25.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.595+0000 7f8856312700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665ee3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.595+0000 7f8856312700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665ee3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57262/0 (socket says 172.21.15.6:57262) 2023-10-06T02:29:25.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.595+0000 7f8856312700 1 -- 172.21.15.6:0/3948234472 learned_addr learned my addr 172.21.15.6:0/3948234472 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:25.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.595+0000 7f8855b11700 1 --2- 172.21.15.6:0/3948234472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665eb7a10 0x561665f5b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.595+0000 7f8856b13700 1 --2- 172.21.15.6:0/3948234472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665ed5e50 0x561665f5bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f8856312700 1 -- 172.21.15.6:0/3948234472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665ed5e50 msgr2=0x561665f5bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:25.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f8856312700 1 --2- 172.21.15.6:0/3948234472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665ed5e50 0x561665f5bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f8856312700 1 -- 172.21.15.6:0/3948234472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665eb7a10 msgr2=0x561665f5b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:25.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f8856312700 1 --2- 172.21.15.6:0/3948234472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665eb7a10 0x561665f5b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f8856312700 1 -- 172.21.15.6:0/3948234472 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561665dd3780 con 0x561665eb62c0 2023-10-06T02:29:25.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f8855b11700 1 --2- 172.21.15.6:0/3948234472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665eb7a10 0x561665f5b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:25.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f8856312700 1 --2- 172.21.15.6:0/3948234472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665ee3a10 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f884800bac0 tx=0x7f8848014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed8db23e2d42c4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:25.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f8837fff700 1 -- 172.21.15.6:0/3948234472 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884802e070 con 0x561665eb62c0 2023-10-06T02:29:25.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f8837fff700 1 -- 172.21.15.6:0/3948234472 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8848030040 con 0x561665eb62c0 2023-10-06T02:29:25.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f8837fff700 1 -- 172.21.15.6:0/3948234472 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848021070 con 0x561665eb62c0 2023-10-06T02:29:25.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f886186eb80 1 -- 172.21.15.6:0/3948234472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 msgr2=0x561665ee3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f886186eb80 1 --2- 172.21.15.6:0/3948234472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665ee3a10 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f884800bac0 tx=0x7f8848014000 comp rx=0 tx=0).stop 2023-10-06T02:29:25.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f886186eb80 1 -- 172.21.15.6:0/3948234472 shutdown_connections 2023-10-06T02:29:25.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f886186eb80 1 --2- 172.21.15.6:0/3948234472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665ed5e50 0x561665f5bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f886186eb80 1 --2- 172.21.15.6:0/3948234472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665ee3a10 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f886186eb80 1 --2- 172.21.15.6:0/3948234472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665eb7a10 0x561665f5b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f886186eb80 1 -- 172.21.15.6:0/3948234472 >> 172.21.15.6:0/3948234472 conn(0x561665eb5e80 msgr2=0x561665ee43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:25.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f886186eb80 1 -- 172.21.15.6:0/3948234472 shutdown_connections 2023-10-06T02:29:25.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.596+0000 7f886186eb80 1 -- 172.21.15.6:0/3948234472 wait complete. 2023-10-06T02:29:25.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.597+0000 7f886186eb80 1 -- start start 2023-10-06T02:29:25.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.597+0000 7f886186eb80 1 Processor -- start 2023-10-06T02:29:25.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f886186eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665efef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f886186eb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665eb7a10 0x561665eb0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f886186eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665ed5e50 0x561665eb1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f886186eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561665eb19f0 con 0x561665eb62c0 2023-10-06T02:29:25.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f886186eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561665efc190 con 0x561665ed5e50 2023-10-06T02:29:25.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f886186eb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561665efc3e0 con 0x561665eb7a10 2023-10-06T02:29:25.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f886186eb80 10 client.0 _ll_register_callbacks cb 0x561665e78020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:29:25.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f8856312700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665efef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f8856312700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665efef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57274/0 (socket says 172.21.15.6:57274) 2023-10-06T02:29:25.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f8856312700 1 -- 172.21.15.6:0/488363006 learned_addr learned my addr 172.21.15.6:0/488363006 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:25.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f8855b11700 1 --2- 172.21.15.6:0/488363006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665eb7a10 0x561665eb0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f8856b13700 1 --2- 172.21.15.6:0/488363006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665ed5e50 0x561665eb1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f8856312700 1 -- 172.21.15.6:0/488363006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665eb7a10 msgr2=0x561665eb0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:25.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f8856312700 1 --2- 172.21.15.6:0/488363006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665eb7a10 0x561665eb0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f8856312700 1 -- 172.21.15.6:0/488363006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665ed5e50 msgr2=0x561665eb1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:25.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f8856312700 1 --2- 172.21.15.6:0/488363006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665ed5e50 0x561665eb1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f8856312700 1 -- 172.21.15.6:0/488363006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88500c7fd0 con 0x561665eb62c0 2023-10-06T02:29:25.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f8856b13700 1 --2- 172.21.15.6:0/488363006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665ed5e50 0x561665eb1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:25.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f8856312700 1 --2- 172.21.15.6:0/488363006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665efef60 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f8850064860 tx=0x7f884802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b215e0f2b031bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:25.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.598+0000 7f8834ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:29:25.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.599+0000 7f8834ff9700 1 -- 172.21.15.6:0/488363006 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848021040 con 0x561665eb62c0 2023-10-06T02:29:25.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.599+0000 7f8834ff9700 1 -- 172.21.15.6:0/488363006 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 9474+0+0 (secure 0 0 0) 0x7f884801ac40 con 0x561665eb62c0 2023-10-06T02:29:25.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.599+0000 7f886186eb80 1 -- 172.21.15.6:0/488363006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8844010ab0 con 0x561665eb62c0 2023-10-06T02:29:25.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.599+0000 7f8834ff9700 1 -- 172.21.15.6:0/488363006 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=328) v2 ==== 24+0+0 (secure 0 0 0) 0x7f884800bde0 con 0x561665eb62c0 2023-10-06T02:29:25.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.599+0000 7f886186eb80 10 client.10530 fetch_fsmap learned FSMap version 328 2023-10-06T02:29:25.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.599+0000 7f886186eb80 1 -- 172.21.15.6:0/488363006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=328,monmap=2+}) v3 -- 0x561665dba470 con 0x561665eb62c0 2023-10-06T02:29:25.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.599+0000 7f8834ff9700 1 -- 172.21.15.6:0/488363006 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8844010ab0 con 0x561665eb62c0 2023-10-06T02:29:25.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.599+0000 7f8834ff9700 1 -- 172.21.15.6:0/488363006 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 328) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8848011630 con 0x561665eb62c0 2023-10-06T02:29:25.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.599+0000 7f886186eb80 10 client.10530 fetch_fsmap finished waiting for FSMap version 328 2023-10-06T02:29:25.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.599+0000 7f886186eb80 10 client.10530 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:29:25.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.599+0000 7f886186eb80 20 client.10530 populate_metadata read hostname 'smithi006' 2023-10-06T02:29:25.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.599+0000 7f886186eb80 1 --2- 172.21.15.6:0/488363006 >> [v2:172.21.15.6:6833/1486243669,v1:172.21.15.6:6835/1486243669] conn(0x561665f57c20 0x561665f13ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.599+0000 7f886186eb80 4 client.10530 mds_command: new command op to 10443 tid=0[{"prefix": "status"}] 2023-10-06T02:29:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.599+0000 7f886186eb80 1 -- 172.21.15.6:0/488363006 --> [v2:172.21.15.6:6833/1486243669,v1:172.21.15.6:6835/1486243669] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561665da7e00 con 0x561665f57c20 2023-10-06T02:29:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.599+0000 7f8855b11700 1 --2- 172.21.15.6:0/488363006 >> [v2:172.21.15.6:6833/1486243669,v1:172.21.15.6:6835/1486243669] conn(0x561665f57c20 0x561665f13ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.599+0000 7f8834ff9700 10 client.10530 ms_handle_connect on v2:172.21.15.6:6833/1486243669 2023-10-06T02:29:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.599+0000 7f8855b11700 1 --2- 172.21.15.6:0/488363006 >> [v2:172.21.15.6:6833/1486243669,v1:172.21.15.6:6835/1486243669] conn(0x561665f57c20 0x561665f13ce0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=476778f696d06a98 server_cookie=3711735859125cde in_seq=0 out_seq=0 2023-10-06T02:29:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f8834ff9700 1 -- 172.21.15.6:0/488363006 <== mds.0 v2:172.21.15.6:6833/1486243669 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+329 (crc 0 0 0) 0x561665da7e00 con 0x561665f57c20 2023-10-06T02:29:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f8834ff9700 10 client.10530 handle_command_reply: tid=0 2023-10-06T02:29:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f886186eb80 1 client.10530 shutdown 2023-10-06T02:29:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f886186eb80 1 -- 172.21.15.6:0/488363006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 msgr2=0x561665efef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f886186eb80 1 --2- 172.21.15.6:0/488363006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665efef60 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f8850064860 tx=0x7f884802e000 comp rx=0 tx=0).stop 2023-10-06T02:29:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f886186eb80 1 -- 172.21.15.6:0/488363006 shutdown_connections 2023-10-06T02:29:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f886186eb80 1 --2- 172.21.15.6:0/488363006 >> [v2:172.21.15.6:6833/1486243669,v1:172.21.15.6:6835/1486243669] conn(0x561665f57c20 0x561665f13ce0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f886186eb80 1 --2- 172.21.15.6:0/488363006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561665ed5e50 0x561665eb1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f886186eb80 1 --2- 172.21.15.6:0/488363006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561665eb62c0 0x561665efef60 unknown :-1 s=CLOSED pgs=2246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f886186eb80 1 --2- 172.21.15.6:0/488363006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x561665eb7a10 0x561665eb0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f8834ff9700 0 client.10530 ms_handle_reset on v2:172.21.15.6:6833/1486243669 2023-10-06T02:29:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f886186eb80 1 -- 172.21.15.6:0/488363006 >> 172.21.15.6:0/488363006 conn(0x561665eb5e80 msgr2=0x561665eab780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f886186eb80 1 -- 172.21.15.6:0/488363006 shutdown_connections 2023-10-06T02:29:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f886186eb80 1 -- 172.21.15.6:0/488363006 wait complete. 2023-10-06T02:29:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f886186eb80 20 client.10530 trim_cache size 0 max 16384 2023-10-06T02:29:25.608 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:29:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:29:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:29:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 10443, 2023-10-06T02:29:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:29:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:29:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:29:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 7.5357479569999999, 2023-10-06T02:29:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 328, 2023-10-06T02:29:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 131, 2023-10-06T02:29:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 131, 2023-10-06T02:29:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 13.533922836 2023-10-06T02:29:25.609 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:29:25.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f8857314700 1 -- 172.21.15.6:0/3627522189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f883c066f30 msgr2=0x7f883c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f8857314700 1 --2- 172.21.15.6:0/3627522189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f883c066f30 0x7f883c0693e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f88480093f0 tx=0x7f8848017000 comp rx=0 tx=0).stop 2023-10-06T02:29:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f8857314700 1 -- 172.21.15.6:0/3627522189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88500c5160 msgr2=0x7f885015b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.600+0000 7f8857314700 1 --2- 172.21.15.6:0/3627522189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88500c5160 0x7f885015b4b0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f884000ccf0 tx=0x7f8840001a20 comp rx=0 tx=0).stop 2023-10-06T02:29:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.601+0000 7f8857314700 1 -- 172.21.15.6:0/3627522189 shutdown_connections 2023-10-06T02:29:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.601+0000 7f8857314700 1 --2- 172.21.15.6:0/3627522189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f883c066f30 0x7f883c0693e0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.601+0000 7f8857314700 1 --2- 172.21.15.6:0/3627522189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88500c5160 0x7f885015b4b0 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.601+0000 7f8857314700 1 --2- 172.21.15.6:0/3627522189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f885006f950 0x7f88500c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.601+0000 7f8857314700 1 --2- 172.21.15.6:0/3627522189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8850159280 0x7f885015c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.601+0000 7f8857314700 1 -- 172.21.15.6:0/3627522189 >> 172.21.15.6:0/3627522189 conn(0x7f88500c9070 msgr2=0x7f88500cb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.601+0000 7f8857314700 1 -- 172.21.15.6:0/3627522189 shutdown_connections 2023-10-06T02:29:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.601+0000 7f8857314700 1 -- 172.21.15.6:0/3627522189 wait complete. 2023-10-06T02:29:25.613 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:29:25.613 INFO:tasks.cephfs.test_damage:Daemons came up after mutation 'Corrupt omap header on mds0_openfiles.0', proceeding to ls 2023-10-06T02:29:25.613 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:29:25.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.730+0000 7f492c5c7700 1 Processor -- start 2023-10-06T02:29:25.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.730+0000 7f492c5c7700 1 -- start start 2023-10-06T02:29:25.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.731+0000 7f492c5c7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49240af4e0 0x7f49240b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.731+0000 7f492c5c7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f492415db70 0x7f49240b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.731+0000 7f492c5c7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492415e190 con 0x7f49240af8b0 2023-10-06T02:29:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.731+0000 7f492c5c7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49240b1910 con 0x7f492415db70 2023-10-06T02:29:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.731+0000 7f492c5c7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492415dfb0 con 0x7f49240af4e0 2023-10-06T02:29:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.731+0000 7f492ab64700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f492415db70 0x7f49240b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.732+0000 7f492ab64700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f492415db70 0x7f49240b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57290/0 (socket says 172.21.15.6:57290) 2023-10-06T02:29:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.732+0000 7f492ab64700 1 -- 172.21.15.6:0/3651303516 learned_addr learned my addr 172.21.15.6:0/3651303516 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.732+0000 7f492a363700 1 --2- 172.21.15.6:0/3651303516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49240af4e0 0x7f49240b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.732+0000 7f492ab64700 1 -- 172.21.15.6:0/3651303516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49240af4e0 msgr2=0x7f49240b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.732+0000 7f492ab64700 1 --2- 172.21.15.6:0/3651303516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49240af4e0 0x7f49240b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.732+0000 7f492ab64700 1 -- 172.21.15.6:0/3651303516 >> v1:172.21.15.175:6789/0 conn(0x7f49240af8b0 legacy=0x7f492415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.732+0000 7f492ab64700 1 -- 172.21.15.6:0/3651303516 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49240cb650 con 0x7f492415db70 2023-10-06T02:29:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.732+0000 7f492ab64700 1 --2- 172.21.15.6:0/3651303516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f492415db70 0x7f49240b2620 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f491c009f20 tx=0x7f491c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c472bcc97fc908be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.732+0000 7f4929361700 1 -- 172.21.15.6:0/3651303516 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c00e070 con 0x7f492415db70 2023-10-06T02:29:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.732+0000 7f4929361700 1 -- 172.21.15.6:0/3651303516 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c00ba40 con 0x7f492415db70 2023-10-06T02:29:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.732+0000 7f4929361700 1 -- 172.21.15.6:0/3651303516 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0092e0 con 0x7f492415db70 2023-10-06T02:29:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.733+0000 7f492c5c7700 1 -- 172.21.15.6:0/3651303516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f492415db70 msgr2=0x7f49240b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.733+0000 7f492c5c7700 1 --2- 172.21.15.6:0/3651303516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f492415db70 0x7f49240b2620 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f491c009f20 tx=0x7f491c009840 comp rx=0 tx=0).stop 2023-10-06T02:29:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.733+0000 7f492c5c7700 1 -- 172.21.15.6:0/3651303516 shutdown_connections 2023-10-06T02:29:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.733+0000 7f492c5c7700 1 --2- 172.21.15.6:0/3651303516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f492415db70 0x7f49240b2620 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.733+0000 7f492c5c7700 1 --2- 172.21.15.6:0/3651303516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49240af4e0 0x7f49240b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.733+0000 7f492c5c7700 1 -- 172.21.15.6:0/3651303516 >> 172.21.15.6:0/3651303516 conn(0x7f4924068680 msgr2=0x7f4924068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:25.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.733+0000 7f492c5c7700 1 -- 172.21.15.6:0/3651303516 shutdown_connections 2023-10-06T02:29:25.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.733+0000 7f492c5c7700 1 -- 172.21.15.6:0/3651303516 wait complete. 2023-10-06T02:29:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.734+0000 7f492c5c7700 1 Processor -- start 2023-10-06T02:29:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.734+0000 7f492c5c7700 1 -- start start 2023-10-06T02:29:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f492c5c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49240af4e0 0x7f49240cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f492c5c7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49240af8b0 0x7f492414b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f492c5c7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f492415db70 0x7f492414ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f492c5c7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49240a6d20 con 0x7f49240af4e0 2023-10-06T02:29:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f492c5c7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49240a78a0 con 0x7f492415db70 2023-10-06T02:29:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f492c5c7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49240a6f70 con 0x7f49240af8b0 2023-10-06T02:29:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f492a363700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49240af4e0 0x7f49240cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f492a363700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49240af4e0 0x7f49240cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57298/0 (socket says 172.21.15.6:57298) 2023-10-06T02:29:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f492a363700 1 -- 172.21.15.6:0/969996793 learned_addr learned my addr 172.21.15.6:0/969996793 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f492ab64700 1 --2- 172.21.15.6:0/969996793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f492415db70 0x7f492414ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f4929b62700 1 --2- 172.21.15.6:0/969996793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49240af8b0 0x7f492414b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f492a363700 1 -- 172.21.15.6:0/969996793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49240af8b0 msgr2=0x7f492414b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f492a363700 1 --2- 172.21.15.6:0/969996793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49240af8b0 0x7f492414b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f492a363700 1 -- 172.21.15.6:0/969996793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f492415db70 msgr2=0x7f492414ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f492a363700 1 --2- 172.21.15.6:0/969996793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f492415db70 0x7f492414ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f492a363700 1 -- 172.21.15.6:0/969996793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c009ae0 con 0x7f49240af4e0 2023-10-06T02:29:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f492a363700 1 --2- 172.21.15.6:0/969996793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49240af4e0 0x7f49240cccc0 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f492000d860 tx=0x7f4920008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f491a7fc700 1 -- 172.21.15.6:0/969996793 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49200125f0 con 0x7f49240af4e0 2023-10-06T02:29:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f491a7fc700 1 -- 172.21.15.6:0/969996793 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4920012750 con 0x7f49240af4e0 2023-10-06T02:29:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f492c5c7700 1 -- 172.21.15.6:0/969996793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49240a7250 con 0x7f49240af4e0 2023-10-06T02:29:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.735+0000 7f491a7fc700 1 -- 172.21.15.6:0/969996793 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920012b10 con 0x7f49240af4e0 2023-10-06T02:29:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.736+0000 7f492c5c7700 1 -- 172.21.15.6:0/969996793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49240cd200 con 0x7f49240af4e0 2023-10-06T02:29:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.736+0000 7f492c5c7700 1 -- 172.21.15.6:0/969996793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49240cd420 con 0x7f49240af4e0 2023-10-06T02:29:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.737+0000 7f491a7fc700 1 -- 172.21.15.6:0/969996793 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f492001e460 con 0x7f49240af4e0 2023-10-06T02:29:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.737+0000 7f491a7fc700 1 --2- 172.21.15.6:0/969996793 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4908066f30 0x7f49080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.737+0000 7f491a7fc700 1 -- 172.21.15.6:0/969996793 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 9474+0+0 (secure 0 0 0) 0x7f4920085930 con 0x7f49240af4e0 2023-10-06T02:29:25.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.737+0000 7f4929b62700 1 --2- 172.21.15.6:0/969996793 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4908066f30 0x7f49080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:25.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.738+0000 7f4929b62700 1 --2- 172.21.15.6:0/969996793 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4908066f30 0x7f49080693e0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f49240c8ea0 tx=0x7f4914007ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:25.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.741+0000 7f491a7fc700 1 -- 172.21.15.6:0/969996793 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4920051ca0 con 0x7f49240af4e0 2023-10-06T02:29:25.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.981+0000 7f492c5c7700 1 -- 172.21.15.6:0/969996793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f49240b0910 con 0x7f49240af4e0 2023-10-06T02:29:25.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.981+0000 7f491a7fc700 1 -- 172.21.15.6:0/969996793 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v328) v1 ==== 53+0+73 (secure 0 0 0) 0x7f49200552c0 con 0x7f49240af4e0 2023-10-06T02:29:25.982 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:29:25.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.983+0000 7f492c5c7700 1 -- 172.21.15.6:0/969996793 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4908066f30 msgr2=0x7f49080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.983+0000 7f492c5c7700 1 --2- 172.21.15.6:0/969996793 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4908066f30 0x7f49080693e0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f49240c8ea0 tx=0x7f4914007ea0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.983+0000 7f492c5c7700 1 -- 172.21.15.6:0/969996793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49240af4e0 msgr2=0x7f49240cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:25.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.983+0000 7f492c5c7700 1 --2- 172.21.15.6:0/969996793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49240af4e0 0x7f49240cccc0 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f492000d860 tx=0x7f4920008040 comp rx=0 tx=0).stop 2023-10-06T02:29:25.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.983+0000 7f492c5c7700 1 -- 172.21.15.6:0/969996793 shutdown_connections 2023-10-06T02:29:25.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.983+0000 7f492c5c7700 1 --2- 172.21.15.6:0/969996793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f492415db70 0x7f492414ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.983+0000 7f492c5c7700 1 --2- 172.21.15.6:0/969996793 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4908066f30 0x7f49080693e0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.983+0000 7f492c5c7700 1 --2- 172.21.15.6:0/969996793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49240af4e0 0x7f49240cccc0 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.983+0000 7f492c5c7700 1 --2- 172.21.15.6:0/969996793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49240af8b0 0x7f492414b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:25.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.983+0000 7f492c5c7700 1 -- 172.21.15.6:0/969996793 >> 172.21.15.6:0/969996793 conn(0x7f4924068680 msgr2=0x7f49240aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:25.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.983+0000 7f492c5c7700 1 -- 172.21.15.6:0/969996793 shutdown_connections 2023-10-06T02:29:25.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:25.983+0000 7f492c5c7700 1 -- 172.21.15.6:0/969996793 wait complete. 2023-10-06T02:29:25.996 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:29:25.996 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:29:25.996 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:29:25.996 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:29:25.996 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:29:25.996 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:29:25.996 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:29:25.996 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:29:25.996 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:29:25.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:25.997 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:29:26.013 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:29:26.013 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:29:26.013 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:29:26.013 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:29:26.013 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:29:26.013 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:29:26.013 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:29:26.013 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:29:26.013 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:29:26.014 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:29:26.014 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:29:26.014 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:29:26.014 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:29:26.014 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:29:26.014 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:29:26.014 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:29:26.014 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41780sec preferred_lft 41780sec 2023-10-06T02:29:26.015 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:29:26.015 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:29:26.015 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:29:26.015 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:29:26.015 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:29:26.015 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:29:26.015 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:29:26.015 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:29:26.015 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:29:26.015 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:29:26.016 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:29:26.016 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:29:26.016 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:29:26.016 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:29:26.016 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:29:26.016 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:29:26.016 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:29:26.017 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:29:26.017 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:29:26.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:26.017 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:29:26.077 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:29:26.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:26.079 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:29:26.135 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:29:26.135 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:29:26.135 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:29:26.135 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:29:26.135 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:29:26.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:26.136 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:29:26.136 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:29:26.136 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:29:26.136 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:29:26.136 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:29:26.136 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:29:26.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:26.237 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:29:26.252 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:29:26.252 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:29:26.252 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:29:26.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:26.253 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:29:26.318 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:29:26.318 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:29:26.318 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:29:26.373 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:29:26.374 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:29:26.374 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:29:26.428 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:29:26.494 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:29:26.494 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:29:26.558 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:29:26.559 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:29:26.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:29:26.560 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:29:26.615 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:29:26.615 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:29:26.658 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:29:26.683 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:29:26.683 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:29:26.740 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:29:26.740+0000 7f6d13816540 -1 init, newargv = 0x55cd0775efd0 newargc=15 2023-10-06T02:29:26.741 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[142626]: starting ceph client 2023-10-06T02:29:26.746 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[142626]: starting fuse 2023-10-06T02:29:26.749 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:29:26.750 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:29:26.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:29:26.751 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:29:26.807 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:29:26.807 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:29:26.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:29:26.807 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:29:26.807 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:29:26.807 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:29:26.807 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:29:26.807 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:29:26.808 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:29:26.808 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:29:26.808 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:29:26.808 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:29:26.808 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:29:26.808 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:29:26.808 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:29:26.808 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:29:26.808 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:29:26.808 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:29:26.808 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:29:26.808 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:29:26.809 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:29:26.809 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:29:26.809 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:29:26.809 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:29:26.809 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:29:26.809 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:29:26.809 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:29:26.809 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:29:26.809 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:29:26.930 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.142626.asok 2023-10-06T02:29:27.112 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.142626.asok 2023-10-06T02:29:27.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:29:27.112 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.142626.asok status 2023-10-06T02:29:27.266 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:29:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:29:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:29:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:29:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:29:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:29:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:29:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "142626", 2023-10-06T02:29:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:29:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:29:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:29:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:29:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 10545, 2023-10-06T02:29:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:29:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:29:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:29:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 10545 2023-10-06T02:29:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:29:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:29:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:29:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:29:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2807317573 2023-10-06T02:29:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:29:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:29:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:29:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:29:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:29:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2807317573 2023-10-06T02:29:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:29:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.10545 192.168.0.1:0/2807317573", 2023-10-06T02:29:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/2807317573", 2023-10-06T02:29:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:29:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 328, 2023-10-06T02:29:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 131, 2023-10-06T02:29:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:29:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:29:27.270 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:29:27.270 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:29:27.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:29:27.276 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:29:27.277 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:29:27.292 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:29:27.292 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:29:27.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:29:27.293 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:29:27.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:29:27.357 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R .) 2023-10-06T02:29:27.399 INFO:teuthology.orchestra.run:waiting for 20 2023-10-06T02:29:27.416 INFO:teuthology.orchestra.run.smithi006.stdout:.: 2023-10-06T02:29:27.417 INFO:teuthology.orchestra.run.smithi006.stdout:subdir 2023-10-06T02:29:27.417 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:27.417 INFO:teuthology.orchestra.run.smithi006.stdout:./subdir: 2023-10-06T02:29:27.417 INFO:teuthology.orchestra.run.smithi006.stdout:sixmegs 2023-10-06T02:29:27.417 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on mds0_openfiles.0' did not caused DAMAGED state 2023-10-06T02:29:27.417 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on 100.00000000' 2023-10-06T02:29:27.417 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:29:27.418 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:29:27.418 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:29:27.491 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:29:27.491 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:29:27.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:27.491 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:29:27.547 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:29:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.706+0000 7f577527c700 1 Processor -- start 2023-10-06T02:29:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.706+0000 7f577527c700 1 -- start start 2023-10-06T02:29:27.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.707+0000 7f577527c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5770156720 0x7f57700adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:27.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.707+0000 7f577527c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f57700c7f20 0x7f57700ae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:27.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.707+0000 7f577527c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57700b00e0 con 0x7f5770156350 2023-10-06T02:29:27.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.707+0000 7f577527c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57700c87c0 con 0x7f57700c7f20 2023-10-06T02:29:27.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.707+0000 7f577527c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57700b0960 con 0x7f5770156720 2023-10-06T02:29:27.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.707+0000 7f576effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5770156350 0x7f577015ab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52234/0 (socket says 172.21.15.6:52234) 2023-10-06T02:29:27.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.707+0000 7f576effd700 1 -- 172.21.15.6:0/1635156185 learned_addr learned my addr 172.21.15.6:0/1635156185 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:27.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576e7fc700 1 --2- 172.21.15.6:0/1635156185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5770156720 0x7f57700adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:27.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576f7fe700 1 --2- 172.21.15.6:0/1635156185 >> v2:172.21.15.175:3300/0 conn(0x7f57700c7f20 0x7f57700ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:27.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576dffb700 1 -- 172.21.15.6:0/1635156185 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166301190 0 0) 0x7f57700b00e0 con 0x7f5770156350 2023-10-06T02:29:27.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576dffb700 1 -- 172.21.15.6:0/1635156185 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f575c003570 con 0x7f5770156350 2023-10-06T02:29:27.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576dffb700 1 -- 172.21.15.6:0/1635156185 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 508105144 0 0) 0x7f575c003570 con 0x7f5770156350 2023-10-06T02:29:27.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576dffb700 1 -- 172.21.15.6:0/1635156185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5770156720 msgr2=0x7f57700adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:27.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576dffb700 1 --2- 172.21.15.6:0/1635156185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5770156720 0x7f57700adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:27.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576dffb700 1 -- 172.21.15.6:0/1635156185 >> v2:172.21.15.175:3300/0 conn(0x7f57700c7f20 msgr2=0x7f57700ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:27.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576dffb700 1 --2- 172.21.15.6:0/1635156185 >> v2:172.21.15.175:3300/0 conn(0x7f57700c7f20 0x7f57700ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:27.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576dffb700 1 -- 172.21.15.6:0/1635156185 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57700b1e00 con 0x7f5770156350 2023-10-06T02:29:27.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576dffb700 1 -- 172.21.15.6:0/1635156185 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f5768001470 con 0x7f5770156350 2023-10-06T02:29:27.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576e7fc700 1 --2- 172.21.15.6:0/1635156185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5770156720 0x7f57700adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:27.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576dffb700 1 -- 172.21.15.6:0/1635156185 >> v1:172.21.15.6:6789/0 conn(0x7f5770156350 legacy=0x7f577015ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:27.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576dffb700 1 --2- 172.21.15.6:0/1635156185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5770156720 0x7f575c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:27.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576dffb700 1 --2- 172.21.15.6:0/1635156185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c003fa0 0x7f575c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:27.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576dffb700 1 --2- 172.21.15.6:0/1635156185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f575c004d50 0x7f575c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:27.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576dffb700 1 -- 172.21.15.6:0/1635156185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57700c87c0 con 0x7f575c003fa0 2023-10-06T02:29:27.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576dffb700 1 -- 172.21.15.6:0/1635156185 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57700b0960 con 0x7f575c004d50 2023-10-06T02:29:27.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576dffb700 1 -- 172.21.15.6:0/1635156185 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c00ba60 con 0x7f5770156720 2023-10-06T02:29:27.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576e7fc700 1 --2- 172.21.15.6:0/1635156185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c003fa0 0x7f575c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:27.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576effd700 1 --2- 172.21.15.6:0/1635156185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5770156720 0x7f575c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:27.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.708+0000 7f576f7fe700 1 --2- 172.21.15.6:0/1635156185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f575c004d50 0x7f575c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:27.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.709+0000 7f576e7fc700 1 -- 172.21.15.6:0/1635156185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5770156720 msgr2=0x7f575c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:27.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.709+0000 7f576e7fc700 1 --2- 172.21.15.6:0/1635156185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5770156720 0x7f575c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:27.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.709+0000 7f576e7fc700 1 -- 172.21.15.6:0/1635156185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f575c004d50 msgr2=0x7f575c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:27.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.709+0000 7f576e7fc700 1 --2- 172.21.15.6:0/1635156185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f575c004d50 0x7f575c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:27.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.709+0000 7f576e7fc700 1 -- 172.21.15.6:0/1635156185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5758009420 con 0x7f575c003fa0 2023-10-06T02:29:27.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.709+0000 7f576e7fc700 1 --2- 172.21.15.6:0/1635156185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c003fa0 0x7f575c004810 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f5758009df0 tx=0x7f57580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2868572012bf3bff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:27.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.709+0000 7f576dffb700 1 -- 172.21.15.6:0/1635156185 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758009740 con 0x7f575c003fa0 2023-10-06T02:29:27.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.709+0000 7f576dffb700 1 -- 172.21.15.6:0/1635156185 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575800e920 con 0x7f575c003fa0 2023-10-06T02:29:27.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.709+0000 7f576dffb700 1 -- 172.21.15.6:0/1635156185 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575800ece0 con 0x7f575c003fa0 2023-10-06T02:29:27.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.709+0000 7f577527c700 1 -- 172.21.15.6:0/1635156185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c003fa0 msgr2=0x7f575c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:27.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.709+0000 7f577527c700 1 --2- 172.21.15.6:0/1635156185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c003fa0 0x7f575c004810 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f5758009df0 tx=0x7f57580091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:27.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.709+0000 7f576f7fe700 1 -- 172.21.15.6:0/1635156185 reap_dead start 2023-10-06T02:29:27.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.709+0000 7f577527c700 1 -- 172.21.15.6:0/1635156185 shutdown_connections 2023-10-06T02:29:27.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.709+0000 7f577527c700 1 -- 172.21.15.6:0/1635156185 >> 172.21.15.6:0/1635156185 conn(0x7f5770069110 msgr2=0x7f57700cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:27.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.709+0000 7f577527c700 1 -- 172.21.15.6:0/1635156185 shutdown_connections 2023-10-06T02:29:27.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.710+0000 7f577527c700 1 -- 172.21.15.6:0/1635156185 wait complete. 2023-10-06T02:29:27.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.711+0000 7f577527c700 1 Processor -- start 2023-10-06T02:29:27.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.711+0000 7f577527c700 1 -- start start 2023-10-06T02:29:27.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.711+0000 7f577527c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c003fa0 0x7f577014c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:27.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.711+0000 7f577527c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f577014d4b0 0x7f577014ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:27.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.711+0000 7f577527c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57700cabd0 0x7f57700cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:27.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.711+0000 7f577527c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577014b050 con 0x7f575c003fa0 2023-10-06T02:29:27.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.711+0000 7f577527c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577014b720 con 0x7f57700cabd0 2023-10-06T02:29:27.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.711+0000 7f577527c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57700cb580 con 0x7f577014d4b0 2023-10-06T02:29:27.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.712+0000 7f576effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c003fa0 0x7f577014c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:27.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.712+0000 7f576effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c003fa0 0x7f577014c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57314/0 (socket says 172.21.15.6:57314) 2023-10-06T02:29:27.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.712+0000 7f576effd700 1 -- 172.21.15.6:0/3114008352 learned_addr learned my addr 172.21.15.6:0/3114008352 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:27.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.712+0000 7f576f7fe700 1 --2- 172.21.15.6:0/3114008352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57700cabd0 0x7f57700cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:27.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.712+0000 7f576e7fc700 1 --2- 172.21.15.6:0/3114008352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f577014d4b0 0x7f577014ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:27.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.712+0000 7f576effd700 1 -- 172.21.15.6:0/3114008352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f577014d4b0 msgr2=0x7f577014ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:27.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.712+0000 7f576effd700 1 --2- 172.21.15.6:0/3114008352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f577014d4b0 0x7f577014ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:27.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.712+0000 7f576effd700 1 -- 172.21.15.6:0/3114008352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57700cabd0 msgr2=0x7f57700cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:27.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.712+0000 7f576effd700 1 --2- 172.21.15.6:0/3114008352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57700cabd0 0x7f57700cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:27.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.712+0000 7f576effd700 1 -- 172.21.15.6:0/3114008352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577014da70 con 0x7f575c003fa0 2023-10-06T02:29:27.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.712+0000 7f576f7fe700 1 --2- 172.21.15.6:0/3114008352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57700cabd0 0x7f57700cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:27.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.712+0000 7f576effd700 1 --2- 172.21.15.6:0/3114008352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c003fa0 0x7f577014c790 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f5768007420 tx=0x7f5768001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:27.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.712+0000 7f5766ffd700 1 -- 172.21.15.6:0/3114008352 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576800f8d0 con 0x7f575c003fa0 2023-10-06T02:29:27.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.712+0000 7f5766ffd700 1 -- 172.21.15.6:0/3114008352 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576800fa30 con 0x7f575c003fa0 2023-10-06T02:29:27.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.712+0000 7f577527c700 1 -- 172.21.15.6:0/3114008352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577014dd50 con 0x7f575c003fa0 2023-10-06T02:29:27.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.712+0000 7f5766ffd700 1 -- 172.21.15.6:0/3114008352 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576800fdf0 con 0x7f575c003fa0 2023-10-06T02:29:27.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.712+0000 7f577527c700 1 -- 172.21.15.6:0/3114008352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577014e310 con 0x7f575c003fa0 2023-10-06T02:29:27.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.713+0000 7f577527c700 1 -- 172.21.15.6:0/3114008352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577006fcb0 con 0x7f575c003fa0 2023-10-06T02:29:27.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.714+0000 7f5766ffd700 1 -- 172.21.15.6:0/3114008352 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57680135c0 con 0x7f575c003fa0 2023-10-06T02:29:27.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.714+0000 7f5766ffd700 1 --2- 172.21.15.6:0/3114008352 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5750066f30 0x7f57500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:27.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.714+0000 7f5766ffd700 1 -- 172.21.15.6:0/3114008352 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 9474+0+0 (secure 0 0 0) 0x7f57680852e0 con 0x7f575c003fa0 2023-10-06T02:29:27.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.714+0000 7f576e7fc700 1 --2- 172.21.15.6:0/3114008352 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5750066f30 0x7f57500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:27.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.715+0000 7f576e7fc700 1 --2- 172.21.15.6:0/3114008352 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5750066f30 0x7f57500693e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f57580091e0 tx=0x7f575801a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:27.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.718+0000 7f5766ffd700 1 -- 172.21.15.6:0/3114008352 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5768051650 con 0x7f575c003fa0 2023-10-06T02:29:27.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.960+0000 7f577527c700 1 -- 172.21.15.6:0/3114008352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5770068420 con 0x7f575c003fa0 2023-10-06T02:29:27.961 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:29:27.961+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:29:27.965 INFO:tasks.ceph.mds.a.smithi006.stderr: -1625> 2023-10-06T02:29:18.068+0000 7f01e8554700 -1 mds.0.openfiles _load_finish: corrupted header/values: End of buffer 2023-10-06T02:29:27.969 INFO:tasks.ceph.mds.a.smithi006.stderr: -611> 2023-10-06T02:29:23.047+0000 7f01ebd5b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:29:27.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.965+0000 7f5766ffd700 1 -- 172.21.15.6:0/3114008352 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v329) v1 ==== 161+0+0 (secure 0 0 0) 0x7f576801a070 con 0x7f575c003fa0 2023-10-06T02:29:27.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.970+0000 7f577527c700 1 -- 172.21.15.6:0/3114008352 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5750066f30 msgr2=0x7f57500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:27.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.970+0000 7f577527c700 1 --2- 172.21.15.6:0/3114008352 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5750066f30 0x7f57500693e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f57580091e0 tx=0x7f575801a000 comp rx=0 tx=0).stop 2023-10-06T02:29:27.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.970+0000 7f577527c700 1 -- 172.21.15.6:0/3114008352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c003fa0 msgr2=0x7f577014c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:27.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.970+0000 7f577527c700 1 --2- 172.21.15.6:0/3114008352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c003fa0 0x7f577014c790 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f5768007420 tx=0x7f5768001e90 comp rx=0 tx=0).stop 2023-10-06T02:29:27.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.970+0000 7f577527c700 1 -- 172.21.15.6:0/3114008352 shutdown_connections 2023-10-06T02:29:27.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.970+0000 7f577527c700 1 --2- 172.21.15.6:0/3114008352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57700cabd0 0x7f57700cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:27.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.970+0000 7f577527c700 1 --2- 172.21.15.6:0/3114008352 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5750066f30 0x7f57500693e0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:27.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.970+0000 7f577527c700 1 --2- 172.21.15.6:0/3114008352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c003fa0 0x7f577014c790 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:27.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.970+0000 7f577527c700 1 --2- 172.21.15.6:0/3114008352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f577014d4b0 0x7f577014ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:27.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.970+0000 7f577527c700 1 -- 172.21.15.6:0/3114008352 >> 172.21.15.6:0/3114008352 conn(0x7f5770069110 msgr2=0x7f57700cc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:27.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.970+0000 7f577527c700 1 -- 172.21.15.6:0/3114008352 shutdown_connections 2023-10-06T02:29:27.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:27.970+0000 7f577527c700 1 -- 172.21.15.6:0/3114008352 wait complete. 2023-10-06T02:29:27.972 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:29:27.984 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:29:27.990 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:29:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.104+0000 7fb865c8a700 1 Processor -- start 2023-10-06T02:29:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.104+0000 7fb865c8a700 1 -- start start 2023-10-06T02:29:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.105+0000 7fb865c8a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb86006a910 0x7fb86006ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.105+0000 7fb865c8a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8600cc740 0x7fb8600ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.105+0000 7fb865c8a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86006a1a0 con 0x7fb86015cae0 2023-10-06T02:29:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.105+0000 7fb865c8a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86006a480 con 0x7fb8600cc740 2023-10-06T02:29:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.105+0000 7fb865c8a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600c8e40 con 0x7fb86006a910 2023-10-06T02:29:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.105+0000 7fb85f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb86015cae0 0x7fb8600c8730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52244/0 (socket says 172.21.15.6:52244) 2023-10-06T02:29:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.105+0000 7fb85f7fe700 1 -- 172.21.15.6:0/4155689257 learned_addr learned my addr 172.21.15.6:0/4155689257 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.105+0000 7fb85e7fc700 1 -- 172.21.15.6:0/4155689257 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267546963 0 0) 0x7fb86006a1a0 con 0x7fb86015cae0 2023-10-06T02:29:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.105+0000 7fb85effd700 1 --2- 172.21.15.6:0/4155689257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb86006a910 0x7fb86006ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.105+0000 7fb85e7fc700 1 -- 172.21.15.6:0/4155689257 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb848003570 con 0x7fb86015cae0 2023-10-06T02:29:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.105+0000 7fb85ffff700 1 --2- 172.21.15.6:0/4155689257 >> v2:172.21.15.175:3300/0 conn(0x7fb8600cc740 0x7fb8600ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85e7fc700 1 -- 172.21.15.6:0/4155689257 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 238026061 0 0) 0x7fb848003570 con 0x7fb86015cae0 2023-10-06T02:29:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85e7fc700 1 -- 172.21.15.6:0/4155689257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb86006a910 msgr2=0x7fb86006ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85e7fc700 1 --2- 172.21.15.6:0/4155689257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb86006a910 0x7fb86006ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85e7fc700 1 -- 172.21.15.6:0/4155689257 >> v2:172.21.15.175:3300/0 conn(0x7fb8600cc740 msgr2=0x7fb8600ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85e7fc700 1 --2- 172.21.15.6:0/4155689257 >> v2:172.21.15.175:3300/0 conn(0x7fb8600cc740 0x7fb8600ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85e7fc700 1 -- 172.21.15.6:0/4155689257 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8600c3f40 con 0x7fb86015cae0 2023-10-06T02:29:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85e7fc700 1 -- 172.21.15.6:0/4155689257 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fb8500015f0 con 0x7fb86015cae0 2023-10-06T02:29:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85e7fc700 1 -- 172.21.15.6:0/4155689257 >> v1:172.21.15.6:6789/0 conn(0x7fb86015cae0 legacy=0x7fb8600c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85e7fc700 1 --2- 172.21.15.6:0/4155689257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb848003a60 0x7fb848003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85e7fc700 1 --2- 172.21.15.6:0/4155689257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb848004810 0x7fb848004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85e7fc700 1 --2- 172.21.15.6:0/4155689257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb86006a910 0x7fb8480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85e7fc700 1 -- 172.21.15.6:0/4155689257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86006a480 con 0x7fb848004810 2023-10-06T02:29:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85e7fc700 1 -- 172.21.15.6:0/4155689257 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600c8e40 con 0x7fb848003a60 2023-10-06T02:29:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85e7fc700 1 -- 172.21.15.6:0/4155689257 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84800bb40 con 0x7fb86006a910 2023-10-06T02:29:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85ffff700 1 --2- 172.21.15.6:0/4155689257 >> v2:172.21.15.175:3300/0 conn(0x7fb8600cc740 0x7fb8600ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85effd700 1 --2- 172.21.15.6:0/4155689257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb848004810 0x7fb848004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85f7fe700 1 --2- 172.21.15.6:0/4155689257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb848003a60 0x7fb848003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85ffff700 1 --2- 172.21.15.6:0/4155689257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb86006a910 0x7fb8480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85effd700 1 -- 172.21.15.6:0/4155689257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb86006a910 msgr2=0x7fb8480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85effd700 1 --2- 172.21.15.6:0/4155689257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb86006a910 0x7fb8480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85effd700 1 -- 172.21.15.6:0/4155689257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb848003a60 msgr2=0x7fb848003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85effd700 1 --2- 172.21.15.6:0/4155689257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb848003a60 0x7fb848003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85effd700 1 -- 172.21.15.6:0/4155689257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb848003570 con 0x7fb848004810 2023-10-06T02:29:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85effd700 1 --2- 172.21.15.6:0/4155689257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb848004810 0x7fb848004c80 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7fb854009c00 tx=0x7fb8540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8af36b52ba7cda9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85e7fc700 1 -- 172.21.15.6:0/4155689257 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85400e710 con 0x7fb848004810 2023-10-06T02:29:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85e7fc700 1 -- 172.21.15.6:0/4155689257 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85400e870 con 0x7fb848004810 2023-10-06T02:29:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.106+0000 7fb85e7fc700 1 -- 172.21.15.6:0/4155689257 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85400ec30 con 0x7fb848004810 2023-10-06T02:29:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.107+0000 7fb865c8a700 1 -- 172.21.15.6:0/4155689257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb848004810 msgr2=0x7fb848004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.107+0000 7fb865c8a700 1 --2- 172.21.15.6:0/4155689257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb848004810 0x7fb848004c80 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7fb854009c00 tx=0x7fb8540091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.107+0000 7fb85ffff700 1 -- 172.21.15.6:0/4155689257 reap_dead start 2023-10-06T02:29:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.107+0000 7fb865c8a700 1 -- 172.21.15.6:0/4155689257 shutdown_connections 2023-10-06T02:29:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.107+0000 7fb865c8a700 1 -- 172.21.15.6:0/4155689257 >> 172.21.15.6:0/4155689257 conn(0x7fb860067910 msgr2=0x7fb8600ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.107+0000 7fb865c8a700 1 -- 172.21.15.6:0/4155689257 shutdown_connections 2023-10-06T02:29:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.107+0000 7fb865c8a700 1 -- 172.21.15.6:0/4155689257 wait complete. 2023-10-06T02:29:28.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.108+0000 7fb865c8a700 1 Processor -- start 2023-10-06T02:29:28.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.108+0000 7fb865c8a700 1 -- start start 2023-10-06T02:29:28.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.109+0000 7fb865c8a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb848004810 0x7fb86014f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:28.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.109+0000 7fb865c8a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8600b1c00 0x7fb8600c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:28.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.109+0000 7fb865c8a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8600c5ef0 0x7fb860157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:28.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.109+0000 7fb865c8a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600b2320 con 0x7fb8600c5ef0 2023-10-06T02:29:28.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.109+0000 7fb865c8a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600c6390 con 0x7fb848004810 2023-10-06T02:29:28.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.109+0000 7fb865c8a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600c6670 con 0x7fb8600b1c00 2023-10-06T02:29:28.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.109+0000 7fb85ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8600c5ef0 0x7fb860157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:28.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.109+0000 7fb85ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8600c5ef0 0x7fb860157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57342/0 (socket says 172.21.15.6:57342) 2023-10-06T02:29:28.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.109+0000 7fb85ffff700 1 -- 172.21.15.6:0/1478941907 learned_addr learned my addr 172.21.15.6:0/1478941907 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:28.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.109+0000 7fb85ffff700 1 -- 172.21.15.6:0/1478941907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8600b1c00 msgr2=0x7fb8600c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:28.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.109+0000 7fb85ffff700 1 --2- 172.21.15.6:0/1478941907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8600b1c00 0x7fb8600c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:28.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.109+0000 7fb85ffff700 1 -- 172.21.15.6:0/1478941907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb848004810 msgr2=0x7fb86014f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:28.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.109+0000 7fb85f7fe700 1 --2- 172.21.15.6:0/1478941907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb848004810 0x7fb86014f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.109+0000 7fb85ffff700 1 --2- 172.21.15.6:0/1478941907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb848004810 0x7fb86014f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.109+0000 7fb85ffff700 1 -- 172.21.15.6:0/1478941907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8600c6950 con 0x7fb8600c5ef0 2023-10-06T02:29:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.110+0000 7fb85ffff700 1 --2- 172.21.15.6:0/1478941907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8600c5ef0 0x7fb860157a90 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7fb860064870 tx=0x7fb8580097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.110+0000 7fb8477fe700 1 -- 172.21.15.6:0/1478941907 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85801b070 con 0x7fb8600c5ef0 2023-10-06T02:29:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.110+0000 7fb8477fe700 1 -- 172.21.15.6:0/1478941907 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb858010c90 con 0x7fb8600c5ef0 2023-10-06T02:29:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.110+0000 7fb8477fe700 1 -- 172.21.15.6:0/1478941907 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858017430 con 0x7fb8600c5ef0 2023-10-06T02:29:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.110+0000 7fb865c8a700 1 -- 172.21.15.6:0/1478941907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8600b2530 con 0x7fb8600c5ef0 2023-10-06T02:29:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.110+0000 7fb865c8a700 1 -- 172.21.15.6:0/1478941907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb860157fd0 con 0x7fb8600c5ef0 2023-10-06T02:29:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.111+0000 7fb865c8a700 1 -- 172.21.15.6:0/1478941907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8600b2720 con 0x7fb8600c5ef0 2023-10-06T02:29:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.111+0000 7fb8477fe700 1 -- 172.21.15.6:0/1478941907 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb858003020 con 0x7fb8600c5ef0 2023-10-06T02:29:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.111+0000 7fb8477fe700 1 --2- 172.21.15.6:0/1478941907 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb84c066f30 0x7fb84c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.112+0000 7fb8477fe700 1 -- 172.21.15.6:0/1478941907 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 9560+0+0 (secure 0 0 0) 0x7fb858085aa0 con 0x7fb8600c5ef0 2023-10-06T02:29:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.112+0000 7fb85f7fe700 1 --2- 172.21.15.6:0/1478941907 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb84c066f30 0x7fb84c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.112+0000 7fb85f7fe700 1 --2- 172.21.15.6:0/1478941907 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb84c066f30 0x7fb84c0693e0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb850000ef0 tx=0x7fb850009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.116+0000 7fb8477fe700 1 -- 172.21.15.6:0/1478941907 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8580505a0 con 0x7fb8600c5ef0 2023-10-06T02:29:28.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.396+0000 7fb865c8a700 1 -- 172.21.15.6:0/1478941907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fb86006e590 con 0x7fb8600c5ef0 2023-10-06T02:29:28.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.966+0000 7fb8477fe700 1 -- 172.21.15.6:0/1478941907 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 nothing to do: rank is not damaged v330) v1 ==== 107+0+0 (secure 0 0 0) 0x7fb858051dc0 con 0x7fb8600c5ef0 2023-10-06T02:29:28.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.968+0000 7fb865c8a700 1 -- 172.21.15.6:0/1478941907 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb84c066f30 msgr2=0x7fb84c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:28.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.968+0000 7fb865c8a700 1 --2- 172.21.15.6:0/1478941907 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb84c066f30 0x7fb84c0693e0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb850000ef0 tx=0x7fb850009040 comp rx=0 tx=0).stop 2023-10-06T02:29:28.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.968+0000 7fb865c8a700 1 -- 172.21.15.6:0/1478941907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8600c5ef0 msgr2=0x7fb860157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:28.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.968+0000 7fb865c8a700 1 --2- 172.21.15.6:0/1478941907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8600c5ef0 0x7fb860157a90 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7fb860064870 tx=0x7fb8580097d0 comp rx=0 tx=0).stop 2023-10-06T02:29:28.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.969+0000 7fb865c8a700 1 -- 172.21.15.6:0/1478941907 shutdown_connections 2023-10-06T02:29:28.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.969+0000 7fb865c8a700 1 --2- 172.21.15.6:0/1478941907 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb84c066f30 0x7fb84c0693e0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:28.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.969+0000 7fb865c8a700 1 --2- 172.21.15.6:0/1478941907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8600c5ef0 0x7fb860157a90 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:28.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.969+0000 7fb865c8a700 1 --2- 172.21.15.6:0/1478941907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb848004810 0x7fb86014f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:28.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.969+0000 7fb865c8a700 1 --2- 172.21.15.6:0/1478941907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8600b1c00 0x7fb8600c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:28.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.969+0000 7fb865c8a700 1 -- 172.21.15.6:0/1478941907 >> 172.21.15.6:0/1478941907 conn(0x7fb860067910 msgr2=0x7fb86006ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:28.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.969+0000 7fb865c8a700 1 -- 172.21.15.6:0/1478941907 shutdown_connections 2023-10-06T02:29:28.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:28.969+0000 7fb865c8a700 1 -- 172.21.15.6:0/1478941907 wait complete. 2023-10-06T02:29:28.971 INFO:teuthology.orchestra.run.smithi006.stderr:nothing to do: rank is not damaged 2023-10-06T02:29:28.983 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:29:29.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.062+0000 7f2785b63000 1 Processor -- start 2023-10-06T02:29:29.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.062+0000 7f2785b63000 1 -- start start 2023-10-06T02:29:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f2785b63000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559246fdd680 0x559246ff81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f2785b63000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559246fdfab0 0x559247081e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f2785b63000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559246fdfe80 0x559246ffa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f2785b63000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559246efb620 con 0x559246fdfab0 2023-10-06T02:29:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f2785b63000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559246ef2400 con 0x559246fdd680 2023-10-06T02:29:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f2785b63000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55924707ead0 con 0x559246fdfe80 2023-10-06T02:29:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f277e59d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559246fdfab0 0x559247081e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f277e59d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559246fdfab0 0x559247081e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42004/0 (socket says 172.21.15.6:42004) 2023-10-06T02:29:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f277e59d700 1 -- 172.21.15.6:0/2189460473 learned_addr learned my addr 172.21.15.6:0/2189460473 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f277ed9e700 1 --2- 172.21.15.6:0/2189460473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559246fdd680 0x559246ff81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f277f59f700 1 --2- 172.21.15.6:0/2189460473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559246fdfe80 0x559246ffa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f277e59d700 1 -- 172.21.15.6:0/2189460473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559246fdfe80 msgr2=0x559246ffa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f277e59d700 1 --2- 172.21.15.6:0/2189460473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559246fdfe80 0x559246ffa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f277e59d700 1 -- 172.21.15.6:0/2189460473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559246fdd680 msgr2=0x559246ff81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f277e59d700 1 --2- 172.21.15.6:0/2189460473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559246fdd680 0x559246ff81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f277e59d700 1 -- 172.21.15.6:0/2189460473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2768005db0 con 0x559246fdfab0 2023-10-06T02:29:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f277ed9e700 1 --2- 172.21.15.6:0/2189460473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559246fdd680 0x559246ff81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.063+0000 7f277f59f700 1 --2- 172.21.15.6:0/2189460473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559246fdfe80 0x559246ffa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.064+0000 7f277e59d700 1 --2- 172.21.15.6:0/2189460473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559246fdfab0 0x559247081e50 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x559246fb1300 tx=0x7f2768016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e298cb1e301ecb3d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.064+0000 7f277d59b700 1 -- 172.21.15.6:0/2189460473 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768005510 con 0x559246fdfab0 2023-10-06T02:29:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.064+0000 7f277d59b700 1 -- 172.21.15.6:0/2189460473 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2768000bc0 con 0x559246fdfab0 2023-10-06T02:29:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.064+0000 7f277d59b700 1 -- 172.21.15.6:0/2189460473 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768008bc0 con 0x559246fdfab0 2023-10-06T02:29:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.064+0000 7f2785b63000 1 -- 172.21.15.6:0/2189460473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559246fdfab0 msgr2=0x559247081e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.064+0000 7f2785b63000 1 --2- 172.21.15.6:0/2189460473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559246fdfab0 0x559247081e50 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x559246fb1300 tx=0x7f2768016000 comp rx=0 tx=0).stop 2023-10-06T02:29:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.064+0000 7f2785b63000 1 -- 172.21.15.6:0/2189460473 shutdown_connections 2023-10-06T02:29:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.064+0000 7f2785b63000 1 --2- 172.21.15.6:0/2189460473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559246fdfe80 0x559246ffa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.064+0000 7f2785b63000 1 --2- 172.21.15.6:0/2189460473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559246fdd680 0x559246ff81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.064+0000 7f2785b63000 1 --2- 172.21.15.6:0/2189460473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559246fdfab0 0x559247081e50 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.064+0000 7f2785b63000 1 -- 172.21.15.6:0/2189460473 >> 172.21.15.6:0/2189460473 conn(0x559246ff7bd0 msgr2=0x559247084810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.064+0000 7f2785b63000 1 -- 172.21.15.6:0/2189460473 shutdown_connections 2023-10-06T02:29:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.064+0000 7f2785b63000 1 -- 172.21.15.6:0/2189460473 wait complete. 2023-10-06T02:29:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.065+0000 7f2785b63000 1 Processor -- start 2023-10-06T02:29:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.065+0000 7f2785b63000 1 -- start start 2023-10-06T02:29:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f2785b63000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559246fdd680 0x55924707cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f2785b63000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559246fdfab0 0x55924707a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f2785b63000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559246fdfe80 0x559246fae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f2785b63000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559247083b80 con 0x559246fdd680 2023-10-06T02:29:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f2785b63000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55924707d600 con 0x559246fdfab0 2023-10-06T02:29:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f2785b63000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55924707d8a0 con 0x559246fdfe80 2023-10-06T02:29:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f277ed9e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559246fdd680 0x55924707cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f277ed9e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559246fdd680 0x55924707cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42016/0 (socket says 172.21.15.6:42016) 2023-10-06T02:29:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 learned_addr learned my addr 172.21.15.6:0/1718792265 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f277e59d700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559246fdfab0 0x55924707a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f277f59f700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559246fdfe80 0x559246fae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559246fdfe80 msgr2=0x559246fae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f277ed9e700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559246fdfe80 0x559246fae600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559246fdfab0 msgr2=0x55924707a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f277ed9e700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559246fdfab0 0x55924707a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559246efd750 con 0x559246fdd680 2023-10-06T02:29:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f277ed9e700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559246fdd680 0x55924707cc70 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f2778008b20 tx=0x7f2778005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.066+0000 7f27777fe700 1 -- 172.21.15.6:0/1718792265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778018070 con 0x559246fdd680 2023-10-06T02:29:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.067+0000 7f27777fe700 1 -- 172.21.15.6:0/1718792265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2778010040 con 0x559246fdd680 2023-10-06T02:29:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.067+0000 7f27777fe700 1 -- 172.21.15.6:0/1718792265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778006c70 con 0x559246fdd680 2023-10-06T02:29:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.067+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559246f241c0 con 0x559246fdd680 2023-10-06T02:29:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.067+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559246f0a3d0 con 0x559246fdd680 2023-10-06T02:29:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.068+0000 7f27777fe700 1 -- 172.21.15.6:0/1718792265 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2778014600 con 0x559246fdd680 2023-10-06T02:29:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.068+0000 7f27777fe700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2760065890 0x7f2760067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.068+0000 7f27777fe700 1 -- 172.21.15.6:0/1718792265 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 9560+0+0 (secure 0 0 0) 0x7f2778083d90 con 0x559246fdd680 2023-10-06T02:29:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.069+0000 7f277e59d700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2760065890 0x7f2760067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.074 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:29:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.069+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55924707e280 0x5592470a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.069+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x559246ff0250 con 0x55924707e280 2023-10-06T02:29:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.069+0000 7f277f59f700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55924707e280 0x5592470a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.069+0000 7f277e59d700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2760065890 0x7f2760067d40 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f276800c010 tx=0x7f276801e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.069+0000 7f277f59f700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55924707e280 0x5592470a1750 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.071+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v132'1128 uv1102 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.071+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a1c90 con 0x55924707e280 2023-10-06T02:29:29.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.073+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v132'1129 uv1129 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.073+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a2040 con 0x55924707e280 2023-10-06T02:29:29.076 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:29:29.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.074+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v132'1130 uv1130 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.074+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a3400 con 0x55924707e280 2023-10-06T02:29:29.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.075+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v132'1131 uv1131 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.075+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a37b0 con 0x55924707e280 2023-10-06T02:29:29.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.077+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v132'1132 uv1132 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.077+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a23f0 con 0x55924707e280 2023-10-06T02:29:29.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.078+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v132'1133 uv1133 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.078+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a2820 con 0x55924707e280 2023-10-06T02:29:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.079+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v132'1134 uv1108 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.079+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a2c20 con 0x55924707e280 2023-10-06T02:29:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.080+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v132'1135 uv1135 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.081+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a2c20 con 0x55924707e280 2023-10-06T02:29:29.082 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:29:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.082+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v132'1136 uv1136 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.082+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a3020 con 0x55924707e280 2023-10-06T02:29:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.083+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v132'1137 uv1137 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.083+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a3020 con 0x55924707e280 2023-10-06T02:29:29.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.084+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v132'1138 uv1138 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.084+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a2bd0 con 0x55924707e280 2023-10-06T02:29:29.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.086+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v132'1139 uv1139 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.086+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a2bd0 con 0x55924707e280 2023-10-06T02:29:29.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.087+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v132'1140 uv1115 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.087+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a2bd0 con 0x55924707e280 2023-10-06T02:29:29.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.089+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v132'1141 uv1141 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.089+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a2bd0 con 0x55924707e280 2023-10-06T02:29:29.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.090+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v132'1142 uv1142 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.090 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:29:29.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.090+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a2bd0 con 0x55924707e280 2023-10-06T02:29:29.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.091+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v132'1143 uv1143 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.091+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a2bd0 con 0x55924707e280 2023-10-06T02:29:29.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.092+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v132'1144 uv1144 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.092+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a2bd0 con 0x55924707e280 2023-10-06T02:29:29.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.094+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v132'1145 uv1145 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.094+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a3b60 con 0x55924707e280 2023-10-06T02:29:29.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.095+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v132'1146 uv1146 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.095+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a3b60 con 0x55924707e280 2023-10-06T02:29:29.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.096+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v132'1147 uv1121 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.097+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a3b60 con 0x55924707e280 2023-10-06T02:29:29.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.098+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v132'1148 uv1148 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.098+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a3b60 con 0x55924707e280 2023-10-06T02:29:29.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.099+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v132'1149 uv1149 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.100 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:29:29.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.099+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a4b70 con 0x55924707e280 2023-10-06T02:29:29.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.100+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v132'1150 uv1150 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.100+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a4b70 con 0x55924707e280 2023-10-06T02:29:29.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.102+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v132'1151 uv1151 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.102+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a3b60 con 0x55924707e280 2023-10-06T02:29:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.103+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v132'1152 uv1152 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.103+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a3b60 con 0x55924707e280 2023-10-06T02:29:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.104+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v132'1153 uv1127 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.104+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a3b60 con 0x55924707e280 2023-10-06T02:29:29.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.106+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v132'1154 uv1154 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.106+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a3b60 con 0x55924707e280 2023-10-06T02:29:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.107+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v132'1155 uv1155 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.107 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:29:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.107+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a4b70 con 0x55924707e280 2023-10-06T02:29:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.108+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v132'1156 uv1156 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.108+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a4b70 con 0x55924707e280 2023-10-06T02:29:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.109+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v132'1157 uv1157 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.109+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a3b60 con 0x55924707e280 2023-10-06T02:29:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.110+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v132'1158 uv1158 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x55924707e280 2023-10-06T02:29:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.111+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5592470a4070 0x5592470a6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.111+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a6990 con 0x5592470a4070 2023-10-06T02:29:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.111+0000 7f277ed9e700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5592470a4070 0x5592470a6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.111+0000 7f277ed9e700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5592470a4070 0x5592470a6450 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:29.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.113+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v132'813 uv793 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.113+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a6d40 con 0x5592470a4070 2023-10-06T02:29:29.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.114+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v132'814 uv814 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.114+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a70f0 con 0x5592470a4070 2023-10-06T02:29:29.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.115+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v132'815 uv815 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.116 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:29:29.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.115+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a7990 con 0x5592470a4070 2023-10-06T02:29:29.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.116+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v132'816 uv816 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.116+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a7d40 con 0x5592470a4070 2023-10-06T02:29:29.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.117+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v132'817 uv817 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.117+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a80f0 con 0x5592470a4070 2023-10-06T02:29:29.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.118+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v132'818 uv812 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.118+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a84a0 con 0x5592470a4070 2023-10-06T02:29:29.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.119+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v132'819 uv819 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.119+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a8850 con 0x5592470a4070 2023-10-06T02:29:29.122 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:29:29.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.120+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v132'820 uv820 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.120+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a8850 con 0x5592470a4070 2023-10-06T02:29:29.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.123+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v132'821 uv821 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.123+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a8850 con 0x5592470a4070 2023-10-06T02:29:29.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.124+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v132'822 uv822 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.124+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a8850 con 0x5592470a4070 2023-10-06T02:29:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.125+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v132'823 uv811 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.125+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a8850 con 0x5592470a4070 2023-10-06T02:29:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.126+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v132'824 uv824 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.126+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a8850 con 0x5592470a4070 2023-10-06T02:29:29.128 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:29:29.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.127+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v132'825 uv825 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.127+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470abf70 con 0x5592470a4070 2023-10-06T02:29:29.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.129+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v132'826 uv826 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.129+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470abf70 con 0x5592470a4070 2023-10-06T02:29:29.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.130+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v132'827 uv827 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.130+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a8850 con 0x5592470a4070 2023-10-06T02:29:29.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.131+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v132'828 uv809 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.131+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a8850 con 0x5592470a4070 2023-10-06T02:29:29.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.132+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v132'829 uv829 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.132+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a8850 con 0x5592470a4070 2023-10-06T02:29:29.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.133+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v132'830 uv830 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.133 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:29:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.133+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a9860 con 0x5592470a4070 2023-10-06T02:29:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.134+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v132'831 uv831 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.134+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a9860 con 0x5592470a4070 2023-10-06T02:29:29.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.135+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v132'832 uv832 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.135+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a8850 con 0x5592470a4070 2023-10-06T02:29:29.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.136+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v132'833 uv833 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.136+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5592470a8d60 0x5592470ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.136+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ab680 con 0x5592470a8d60 2023-10-06T02:29:29.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.136+0000 7f277e59d700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5592470a8d60 0x5592470ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.136+0000 7f277e59d700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5592470a8d60 0x5592470ab140 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:29.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.137+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v132'219 uv218 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.137+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470aba30 con 0x5592470a8d60 2023-10-06T02:29:29.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.138+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v132'220 uv220 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.138+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470abde0 con 0x5592470a8d60 2023-10-06T02:29:29.139 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:29:29.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.139+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v132'221 uv221 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.139+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470a75a0 con 0x5592470a8d60 2023-10-06T02:29:29.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.140+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v132'222 uv222 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.140+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ad790 con 0x5592470a8d60 2023-10-06T02:29:29.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.141+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v132'223 uv223 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.141+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ac680 con 0x5592470a8d60 2023-10-06T02:29:29.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.142+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v132'224 uv224 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.142+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470acaa0 con 0x5592470a8d60 2023-10-06T02:29:29.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.143+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v132'159 uv158 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.143+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470acea0 con 0x5592470a8d60 2023-10-06T02:29:29.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.144+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v132'160 uv160 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.144+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470acea0 con 0x5592470a8d60 2023-10-06T02:29:29.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.145+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v132'161 uv161 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.146 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:29:29.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.145+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ace50 con 0x5592470a8d60 2023-10-06T02:29:29.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.146+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v132'162 uv162 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.146+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ace50 con 0x5592470a4070 2023-10-06T02:29:29.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.147+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v132'219 uv218 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.147+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ace50 con 0x5592470a4070 2023-10-06T02:29:29.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.148+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v132'220 uv220 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.148+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ace50 con 0x5592470a4070 2023-10-06T02:29:29.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.149+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v132'221 uv221 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.150 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:29:29.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.149+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ace50 con 0x5592470a4070 2023-10-06T02:29:29.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.150+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v132'222 uv222 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.150+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ace50 con 0x5592470a4070 2023-10-06T02:29:29.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.151+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v132'223 uv223 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.151+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ace50 con 0x5592470a4070 2023-10-06T02:29:29.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.152+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v132'224 uv224 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470a4070 2023-10-06T02:29:29.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.152+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5592470ae0c0 0x5592470b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.152+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ace50 con 0x5592470ae0c0 2023-10-06T02:29:29.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.152+0000 7f277f59f700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5592470ae0c0 0x5592470b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.153+0000 7f277f59f700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5592470ae0c0 0x5592470b04a0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:29.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.154+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v132'404 uv398 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470ae0c0 2023-10-06T02:29:29.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.154+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b09e0 con 0x5592470ae0c0 2023-10-06T02:29:29.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.155+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v132'405 uv405 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470ae0c0 2023-10-06T02:29:29.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.155+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b09e0 con 0x5592470ae0c0 2023-10-06T02:29:29.157 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:29:29.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.156+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v132'406 uv406 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470ae0c0 2023-10-06T02:29:29.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.156+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b19f0 con 0x5592470ae0c0 2023-10-06T02:29:29.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.157+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v132'407 uv407 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470ae0c0 2023-10-06T02:29:29.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.157+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b19f0 con 0x5592470ae0c0 2023-10-06T02:29:29.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.158+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v132'408 uv408 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470ae0c0 2023-10-06T02:29:29.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.158+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b09e0 con 0x5592470ae0c0 2023-10-06T02:29:29.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.160+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v132'409 uv409 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470ae0c0 2023-10-06T02:29:29.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.160+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b09e0 con 0x5592470ae0c0 2023-10-06T02:29:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.161+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v132'410 uv403 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470ae0c0 2023-10-06T02:29:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.161+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b09e0 con 0x5592470ae0c0 2023-10-06T02:29:29.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.162+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v132'411 uv411 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470ae0c0 2023-10-06T02:29:29.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.162+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b09e0 con 0x5592470ae0c0 2023-10-06T02:29:29.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.163+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v132'412 uv412 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470ae0c0 2023-10-06T02:29:29.163 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:29:29.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.163+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b09e0 con 0x5592470ae0c0 2023-10-06T02:29:29.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.164+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v132'413 uv413 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470ae0c0 2023-10-06T02:29:29.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.164+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b09e0 con 0x5592470ae0c0 2023-10-06T02:29:29.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.165+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v132'414 uv414 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470ae0c0 2023-10-06T02:29:29.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.165+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5592470b1060 0x5592470b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.165+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b3b00 con 0x5592470b1060 2023-10-06T02:29:29.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.165+0000 7f277ed9e700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5592470b1060 0x5592470b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.165+0000 7f277ed9e700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5592470b1060 0x5592470b3440 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:29.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.167+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v132'183 uv182 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470b1060 2023-10-06T02:29:29.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.167+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b3b40 con 0x5592470b1060 2023-10-06T02:29:29.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.168+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v132'184 uv184 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470b1060 2023-10-06T02:29:29.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.168+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b3f70 con 0x5592470b1060 2023-10-06T02:29:29.169 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:29:29.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.169+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v132'185 uv185 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470b1060 2023-10-06T02:29:29.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.169+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b3f70 con 0x5592470b1060 2023-10-06T02:29:29.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.171+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v132'186 uv186 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470b1060 2023-10-06T02:29:29.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.171+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b3f70 con 0x5592470b1060 2023-10-06T02:29:29.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.171+0000 7f277ed9e700 1 -- 172.21.15.6:0/1718792265 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v132'187 uv187 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f277801a070 con 0x5592470b1060 2023-10-06T02:29:29.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.171+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b3f70 con 0x5592470a8d60 2023-10-06T02:29:29.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.172+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v132'219 uv218 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.172+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b3f70 con 0x5592470a8d60 2023-10-06T02:29:29.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.173+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v132'220 uv220 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.173+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b3f70 con 0x5592470a8d60 2023-10-06T02:29:29.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.176+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v132'221 uv221 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.177 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:29:29.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.176+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b4f80 con 0x5592470a8d60 2023-10-06T02:29:29.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.177+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v132'222 uv222 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.177+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b4f80 con 0x5592470a8d60 2023-10-06T02:29:29.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.178+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v132'223 uv223 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.178+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b3f70 con 0x5592470a8d60 2023-10-06T02:29:29.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.178+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v132'224 uv224 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.179+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5592470b45f0 0x5592470b69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.179+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b6f60 con 0x5592470b45f0 2023-10-06T02:29:29.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.179+0000 7f277e59d700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5592470b45f0 0x5592470b69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.179+0000 7f277e59d700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5592470b45f0 0x5592470b69d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:29.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.180+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v132'365 uv359 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470b45f0 2023-10-06T02:29:29.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.180+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b7020 con 0x5592470b45f0 2023-10-06T02:29:29.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.181+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v132'366 uv366 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470b45f0 2023-10-06T02:29:29.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.181+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b7450 con 0x5592470b45f0 2023-10-06T02:29:29.182 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:29:29.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.182+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v132'367 uv367 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470b45f0 2023-10-06T02:29:29.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.182+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b7450 con 0x5592470b45f0 2023-10-06T02:29:29.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.183+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v132'368 uv368 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470b45f0 2023-10-06T02:29:29.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.183+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b7450 con 0x5592470b45f0 2023-10-06T02:29:29.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.184+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v132'369 uv369 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470b45f0 2023-10-06T02:29:29.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.184+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b7450 con 0x5592470b45f0 2023-10-06T02:29:29.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.185+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v132'370 uv364 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470b45f0 2023-10-06T02:29:29.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.185+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b7450 con 0x5592470b45f0 2023-10-06T02:29:29.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.186+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v132'371 uv371 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470b45f0 2023-10-06T02:29:29.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.186+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b7450 con 0x5592470b45f0 2023-10-06T02:29:29.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.187+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v132'372 uv372 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470b45f0 2023-10-06T02:29:29.188 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:29:29.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.187+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b7450 con 0x5592470b45f0 2023-10-06T02:29:29.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.188+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v132'373 uv373 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470b45f0 2023-10-06T02:29:29.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.188+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba1c0 con 0x5592470b45f0 2023-10-06T02:29:29.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.190+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v132'374 uv374 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470b45f0 2023-10-06T02:29:29.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.190+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b7940 con 0x5592470a8d60 2023-10-06T02:29:29.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.191+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v132'162 uv160 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.191+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b7940 con 0x5592470a8d60 2023-10-06T02:29:29.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.192+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v132'163 uv163 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.192+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b7940 con 0x5592470a8d60 2023-10-06T02:29:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.193+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v132'164 uv164 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.193 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:29:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.193+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470b7940 con 0x5592470a8d60 2023-10-06T02:29:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.193+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v132'165 uv165 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.194+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5592470b7e50 0x5592470b8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.194+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba910 con 0x5592470b7e50 2023-10-06T02:29:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.194+0000 7f277f59f700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5592470b7e50 0x5592470b8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.194+0000 7f277f59f700 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5592470b7e50 0x5592470b8220 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:29.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.195+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v132'219 uv218 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470b7e50 2023-10-06T02:29:29.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.195+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba910 con 0x5592470b7e50 2023-10-06T02:29:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.196+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v132'220 uv220 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470b7e50 2023-10-06T02:29:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.196+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba910 con 0x5592470b7e50 2023-10-06T02:29:29.198 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:29:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.198+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v132'221 uv221 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470b7e50 2023-10-06T02:29:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.198+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470bb920 con 0x5592470b7e50 2023-10-06T02:29:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.199+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v132'222 uv222 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470b7e50 2023-10-06T02:29:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.199+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470bb920 con 0x5592470b7e50 2023-10-06T02:29:29.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.200+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v132'223 uv223 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470b7e50 2023-10-06T02:29:29.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.200+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba910 con 0x5592470b7e50 2023-10-06T02:29:29.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.201+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v132'224 uv224 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470b7e50 2023-10-06T02:29:29.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.201+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba910 con 0x5592470ae0c0 2023-10-06T02:29:29.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.202+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v132'186 uv185 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470ae0c0 2023-10-06T02:29:29.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.202+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba910 con 0x5592470ae0c0 2023-10-06T02:29:29.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.203+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v132'187 uv187 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470ae0c0 2023-10-06T02:29:29.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.203+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba910 con 0x5592470ae0c0 2023-10-06T02:29:29.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.204+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v132'188 uv188 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470ae0c0 2023-10-06T02:29:29.204 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:29:29.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.204+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba910 con 0x5592470ae0c0 2023-10-06T02:29:29.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.205+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v132'189 uv189 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470ae0c0 2023-10-06T02:29:29.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.205+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba910 con 0x5592470ae0c0 2023-10-06T02:29:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.206+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v132'190 uv190 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f2770002c90 con 0x5592470ae0c0 2023-10-06T02:29:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.206+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba910 con 0x5592470a8d60 2023-10-06T02:29:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.207+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v132'455 uv446 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.207+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba910 con 0x5592470a8d60 2023-10-06T02:29:29.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.208+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v132'456 uv456 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.208+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba910 con 0x5592470a8d60 2023-10-06T02:29:29.209 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:29:29.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.209+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v132'457 uv457 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.209+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba910 con 0x5592470a8d60 2023-10-06T02:29:29.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.210+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v132'458 uv458 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.210+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470bad60 con 0x5592470a8d60 2023-10-06T02:29:29.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.211+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v132'459 uv459 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.211+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470bad60 con 0x5592470a8d60 2023-10-06T02:29:29.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.212+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v132'460 uv453 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.212+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba910 con 0x5592470a8d60 2023-10-06T02:29:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.213+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v132'461 uv461 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.213+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba910 con 0x5592470a8d60 2023-10-06T02:29:29.214 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:29:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.214+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v132'462 uv462 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.214+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba910 con 0x5592470a8d60 2023-10-06T02:29:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.215+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v132'463 uv463 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.215+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470bb920 con 0x5592470a8d60 2023-10-06T02:29:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.216+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v132'464 uv464 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.216+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470ba910 con 0x5592470a8d60 2023-10-06T02:29:29.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.217+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v132'465 uv465 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.217+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x5592470bae00 con 0x5592470a8d60 2023-10-06T02:29:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f277e59d700 1 -- 172.21.15.6:0/1718792265 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v132'466 uv466 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f2768008970 con 0x5592470a8d60 2023-10-06T02:29:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5592470a8d60 msgr2=0x5592470ab140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5592470a8d60 0x5592470ab140 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55924707e280 msgr2=0x5592470a1750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55924707e280 0x5592470a1750 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5592470b45f0 msgr2=0x5592470b69d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5592470b45f0 0x5592470b69d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5592470a4070 msgr2=0x5592470a6450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5592470a4070 0x5592470a6450 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 reap_dead start 2023-10-06T02:29:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5592470b7e50 msgr2=0x5592470b8220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5592470b7e50 0x5592470b8220 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f277f59f700 1 -- 172.21.15.6:0/1718792265 reap_dead start 2023-10-06T02:29:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5592470b1060 msgr2=0x5592470b3440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5592470b1060 0x5592470b3440 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5592470ae0c0 msgr2=0x5592470b04a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5592470ae0c0 0x5592470b04a0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2760065890 msgr2=0x7f2760067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2760065890 0x7f2760067d40 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f276800c010 tx=0x7f276801e000 comp rx=0 tx=0).stop 2023-10-06T02:29:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559246fdd680 msgr2=0x55924707cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559246fdd680 0x55924707cc70 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f2778008b20 tx=0x7f2778005a50 comp rx=0 tx=0).stop 2023-10-06T02:29:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 shutdown_connections 2023-10-06T02:29:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5592470b1060 0x5592470b3440 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559246fdd680 0x55924707cc70 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2760065890 0x7f2760067d40 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 --2- 172.21.15.6:0/1718792265 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5592470ae0c0 0x5592470b04a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 >> 172.21.15.6:0/1718792265 conn(0x559246ff7bd0 msgr2=0x559247084810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 shutdown_connections 2023-10-06T02:29:29.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.218+0000 7f2785b63000 1 -- 172.21.15.6:0/1718792265 wait complete. 2023-10-06T02:29:29.223 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader 100.00000000 deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2023-10-06T02:29:29.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.302+0000 7f4653fed000 1 Processor -- start 2023-10-06T02:29:29.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.302+0000 7f4653fed000 1 -- start start 2023-10-06T02:29:29.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f4653fed000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56007537db60 0x56007537bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f4653fed000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560075374090 0x56007537fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f4653fed000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56007537df30 0x5600753800a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f4653fed000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600751f2980 con 0x56007537db60 2023-10-06T02:29:29.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f4653fed000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600751f2620 con 0x560075374090 2023-10-06T02:29:29.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f4653fed000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600751e9400 con 0x56007537df30 2023-10-06T02:29:29.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f464d228700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56007537db60 0x56007537bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f464d228700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56007537db60 0x56007537bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42046/0 (socket says 172.21.15.6:42046) 2023-10-06T02:29:29.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f464d228700 1 -- 172.21.15.6:0/4017066668 learned_addr learned my addr 172.21.15.6:0/4017066668 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:29.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f464ca27700 1 --2- 172.21.15.6:0/4017066668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560075374090 0x56007537fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f464da29700 1 --2- 172.21.15.6:0/4017066668 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56007537df30 0x5600753800a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f464d228700 1 -- 172.21.15.6:0/4017066668 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56007537df30 msgr2=0x5600753800a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:29.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f464d228700 1 --2- 172.21.15.6:0/4017066668 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56007537df30 0x5600753800a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f464d228700 1 -- 172.21.15.6:0/4017066668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560075374090 msgr2=0x56007537fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:29.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f464d228700 1 --2- 172.21.15.6:0/4017066668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560075374090 0x56007537fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f464d228700 1 -- 172.21.15.6:0/4017066668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600752013d0 con 0x56007537db60 2023-10-06T02:29:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f464da29700 1 --2- 172.21.15.6:0/4017066668 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56007537df30 0x5600753800a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.303+0000 7f464d228700 1 --2- 172.21.15.6:0/4017066668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56007537db60 0x56007537bf20 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f46480015a0 tx=0x5600752f0ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d417e03186aa796 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.304+0000 7f46477fe700 1 -- 172.21.15.6:0/4017066668 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464800f520 con 0x56007537db60 2023-10-06T02:29:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.304+0000 7f46477fe700 1 -- 172.21.15.6:0/4017066668 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464800f680 con 0x56007537db60 2023-10-06T02:29:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.304+0000 7f46477fe700 1 -- 172.21.15.6:0/4017066668 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464800f810 con 0x56007537db60 2023-10-06T02:29:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.304+0000 7f4653fed000 1 -- 172.21.15.6:0/4017066668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56007537db60 msgr2=0x56007537bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.304+0000 7f4653fed000 1 --2- 172.21.15.6:0/4017066668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56007537db60 0x56007537bf20 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f46480015a0 tx=0x5600752f0ea0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.304+0000 7f4653fed000 1 -- 172.21.15.6:0/4017066668 shutdown_connections 2023-10-06T02:29:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.304+0000 7f4653fed000 1 --2- 172.21.15.6:0/4017066668 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56007537df30 0x5600753800a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.304+0000 7f4653fed000 1 --2- 172.21.15.6:0/4017066668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56007537db60 0x56007537bf20 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.304+0000 7f4653fed000 1 --2- 172.21.15.6:0/4017066668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560075374090 0x56007537fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.304+0000 7f4653fed000 1 -- 172.21.15.6:0/4017066668 >> 172.21.15.6:0/4017066668 conn(0x5600752a7d50 msgr2=0x5600752a9050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.304+0000 7f4653fed000 1 -- 172.21.15.6:0/4017066668 shutdown_connections 2023-10-06T02:29:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.304+0000 7f4653fed000 1 -- 172.21.15.6:0/4017066668 wait complete. 2023-10-06T02:29:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.305+0000 7f4653fed000 1 Processor -- start 2023-10-06T02:29:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.305+0000 7f4653fed000 1 -- start start 2023-10-06T02:29:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.305+0000 7f4653fed000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560075374090 0x5600752d3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.305+0000 7f4653fed000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56007537db60 0x560075383950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.305+0000 7f4653fed000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56007537df30 0x560075383e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.305+0000 7f4653fed000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600753714f0 con 0x56007537df30 2023-10-06T02:29:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.305+0000 7f4653fed000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600753843d0 con 0x560075374090 2023-10-06T02:29:29.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.305+0000 7f4653fed000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560075387210 con 0x56007537db60 2023-10-06T02:29:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.306+0000 7f464da29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56007537df30 0x560075383e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.306+0000 7f464da29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56007537df30 0x560075383e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42060/0 (socket says 172.21.15.6:42060) 2023-10-06T02:29:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.306+0000 7f464d228700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560075374090 0x5600752d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.306+0000 7f464da29700 1 -- 172.21.15.6:0/1854101771 learned_addr learned my addr 172.21.15.6:0/1854101771 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.306+0000 7f464ca27700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56007537db60 0x560075383950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.306+0000 7f464da29700 1 -- 172.21.15.6:0/1854101771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56007537db60 msgr2=0x560075383950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.306+0000 7f464da29700 1 --2- 172.21.15.6:0/1854101771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56007537db60 0x560075383950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.306+0000 7f464da29700 1 -- 172.21.15.6:0/1854101771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560075374090 msgr2=0x5600752d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.306+0000 7f464da29700 1 --2- 172.21.15.6:0/1854101771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560075374090 0x5600752d3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.306+0000 7f464da29700 1 -- 172.21.15.6:0/1854101771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56007521b1c0 con 0x56007537df30 2023-10-06T02:29:29.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.306+0000 7f464da29700 1 --2- 172.21.15.6:0/1854101771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56007537df30 0x560075383e90 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f4640014000 tx=0x7f4640015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:29.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.306+0000 7f4645ffb700 1 -- 172.21.15.6:0/1854101771 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640021070 con 0x56007537df30 2023-10-06T02:29:29.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.306+0000 7f4645ffb700 1 -- 172.21.15.6:0/1854101771 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4640004620 con 0x56007537df30 2023-10-06T02:29:29.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.306+0000 7f4653fed000 1 -- 172.21.15.6:0/1854101771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5600751f4ae0 con 0x56007537df30 2023-10-06T02:29:29.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.306+0000 7f4645ffb700 1 -- 172.21.15.6:0/1854101771 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640012450 con 0x56007537df30 2023-10-06T02:29:29.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.306+0000 7f4653fed000 1 -- 172.21.15.6:0/1854101771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600751f4540 con 0x56007537df30 2023-10-06T02:29:29.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.308+0000 7f4645ffb700 1 -- 172.21.15.6:0/1854101771 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4640004c90 con 0x56007537df30 2023-10-06T02:29:29.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.308+0000 7f4645ffb700 1 --2- 172.21.15.6:0/1854101771 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4630065890 0x7f4630067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.308+0000 7f4645ffb700 1 -- 172.21.15.6:0/1854101771 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 9560+0+0 (secure 0 0 0) 0x7f4640084f90 con 0x56007537df30 2023-10-06T02:29:29.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.308+0000 7f4653fed000 1 --2- 172.21.15.6:0/1854101771 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5600752f1240 0x560075370430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.308+0000 7f4653fed000 1 -- 172.21.15.6:0/1854101771 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:1 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132) v8 -- 0x560075370970 con 0x5600752f1240 2023-10-06T02:29:29.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.308+0000 7f464d228700 1 --2- 172.21.15.6:0/1854101771 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4630065890 0x7f4630067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.308+0000 7f464ca27700 1 --2- 172.21.15.6:0/1854101771 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5600752f1240 0x560075370430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.309+0000 7f464d228700 1 --2- 172.21.15.6:0/1854101771 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4630065890 0x7f4630067d40 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4648016000 tx=0x7f4648017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:29.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.309+0000 7f464ca27700 1 --2- 172.21.15.6:0/1854101771 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5600752f1240 0x560075370430 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:29.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.310+0000 7f464ca27700 1 -- 172.21.15.6:0/1854101771 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(1 100.00000000 [omap-set-header] v132'375 uv375 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4638012040 con 0x5600752f1240 2023-10-06T02:29:29.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.310+0000 7f4653fed000 1 -- 172.21.15.6:0/1854101771 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5600752f1240 msgr2=0x560075370430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.310+0000 7f4653fed000 1 --2- 172.21.15.6:0/1854101771 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5600752f1240 0x560075370430 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.310+0000 7f4653fed000 1 -- 172.21.15.6:0/1854101771 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4630065890 msgr2=0x7f4630067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.310+0000 7f4653fed000 1 --2- 172.21.15.6:0/1854101771 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4630065890 0x7f4630067d40 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4648016000 tx=0x7f4648017000 comp rx=0 tx=0).stop 2023-10-06T02:29:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.310+0000 7f4653fed000 1 -- 172.21.15.6:0/1854101771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56007537df30 msgr2=0x560075383e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.310+0000 7f4653fed000 1 --2- 172.21.15.6:0/1854101771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56007537df30 0x560075383e90 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f4640014000 tx=0x7f4640015000 comp rx=0 tx=0).stop 2023-10-06T02:29:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.310+0000 7f464da29700 1 -- 172.21.15.6:0/1854101771 reap_dead start 2023-10-06T02:29:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.310+0000 7f4653fed000 1 -- 172.21.15.6:0/1854101771 shutdown_connections 2023-10-06T02:29:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.310+0000 7f4653fed000 1 -- 172.21.15.6:0/1854101771 >> 172.21.15.6:0/1854101771 conn(0x5600752a7d50 msgr2=0x56007537c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.310+0000 7f4653fed000 1 -- 172.21.15.6:0/1854101771 shutdown_connections 2023-10-06T02:29:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.310+0000 7f4653fed000 1 -- 172.21.15.6:0/1854101771 wait complete. 2023-10-06T02:29:29.317 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:29:29.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.475+0000 7f0f440b6700 1 Processor -- start 2023-10-06T02:29:29.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.476+0000 7f0f440b6700 1 -- start start 2023-10-06T02:29:29.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.476+0000 7f0f440b6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0f3c0d07d0 0x7f0f3c0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.476+0000 7f0f440b6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3c15dd40 con 0x7f0f3c0d0400 2023-10-06T02:29:29.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.476+0000 7f0f440b6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3c15e020 con 0x7f0f3c0ccd40 2023-10-06T02:29:29.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.476+0000 7f0f440b6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c0ceaa0 con 0x7f0f3c0d07d0 2023-10-06T02:29:29.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.477+0000 7f0f42653700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0f3c0d07d0 0x7f0f3c0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.477+0000 7f0f41e52700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0f3c0d0400 0x7f0f3c0b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49838/0 (socket says 172.21.15.6:49838) 2023-10-06T02:29:29.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.477+0000 7f0f41e52700 1 -- 172.21.15.6:0/1088817228 learned_addr learned my addr 172.21.15.6:0/1088817228 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:29.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.477+0000 7f0f42653700 1 -- 172.21.15.6:0/1088817228 >> v1:172.21.15.175:6789/0 conn(0x7f0f3c0ccd40 legacy=0x7f0f3c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.477+0000 7f0f42653700 1 -- 172.21.15.6:0/1088817228 >> v1:172.21.15.6:6789/0 conn(0x7f0f3c0d0400 legacy=0x7f0f3c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.477+0000 7f0f42653700 1 -- 172.21.15.6:0/1088817228 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c0ced80 con 0x7f0f3c0d07d0 2023-10-06T02:29:29.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.477+0000 7f0f42653700 1 --2- 172.21.15.6:0/1088817228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f3c0d07d0 0x7f0f3c0b3aa0 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009e60 tx=0x7f0f2c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954fa126687dad54 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:29.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.477+0000 7f0f40e50700 1 -- 172.21.15.6:0/1088817228 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00e070 con 0x7f0f3c0d07d0 2023-10-06T02:29:29.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.477+0000 7f0f40e50700 1 -- 172.21.15.6:0/1088817228 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c00bc30 con 0x7f0f3c0d07d0 2023-10-06T02:29:29.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.477+0000 7f0f40e50700 1 -- 172.21.15.6:0/1088817228 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c012430 con 0x7f0f3c0d07d0 2023-10-06T02:29:29.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.478+0000 7f0f440b6700 1 -- 172.21.15.6:0/1088817228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f3c0d07d0 msgr2=0x7f0f3c0b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.478+0000 7f0f440b6700 1 --2- 172.21.15.6:0/1088817228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f3c0d07d0 0x7f0f3c0b3aa0 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009e60 tx=0x7f0f2c009780 comp rx=0 tx=0).stop 2023-10-06T02:29:29.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.478+0000 7f0f440b6700 1 -- 172.21.15.6:0/1088817228 shutdown_connections 2023-10-06T02:29:29.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.478+0000 7f0f440b6700 1 --2- 172.21.15.6:0/1088817228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f3c0d07d0 0x7f0f3c0b3aa0 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.478+0000 7f0f440b6700 1 -- 172.21.15.6:0/1088817228 >> 172.21.15.6:0/1088817228 conn(0x7f0f3c06a220 msgr2=0x7f0f3c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:29.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.478+0000 7f0f440b6700 1 -- 172.21.15.6:0/1088817228 shutdown_connections 2023-10-06T02:29:29.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.478+0000 7f0f440b6700 1 -- 172.21.15.6:0/1088817228 wait complete. 2023-10-06T02:29:29.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.479+0000 7f0f440b6700 1 Processor -- start 2023-10-06T02:29:29.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.479+0000 7f0f440b6700 1 -- start start 2023-10-06T02:29:29.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f440b6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3c0ccd40 0x7f0f3c1533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f440b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f3c0d0400 0x7f0f3c0c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f440b6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f3c0d07d0 0x7f0f3c1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f440b6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c15b260 con 0x7f0f3c0d0400 2023-10-06T02:29:29.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f440b6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c153910 con 0x7f0f3c0ccd40 2023-10-06T02:29:29.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f440b6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c159f40 con 0x7f0f3c0d07d0 2023-10-06T02:29:29.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f41651700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f3c0d0400 0x7f0f3c0c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f41651700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f3c0d0400 0x7f0f3c0c5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42072/0 (socket says 172.21.15.6:42072) 2023-10-06T02:29:29.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f41651700 1 -- 172.21.15.6:0/1232644995 learned_addr learned my addr 172.21.15.6:0/1232644995 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:29.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f41e52700 1 --2- 172.21.15.6:0/1232644995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3c0ccd40 0x7f0f3c1533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f42653700 1 --2- 172.21.15.6:0/1232644995 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f3c0d07d0 0x7f0f3c1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f41651700 1 -- 172.21.15.6:0/1232644995 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f3c0d07d0 msgr2=0x7f0f3c1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f41651700 1 --2- 172.21.15.6:0/1232644995 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f3c0d07d0 0x7f0f3c1580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f41651700 1 -- 172.21.15.6:0/1232644995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3c0ccd40 msgr2=0x7f0f3c1533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f41651700 1 --2- 172.21.15.6:0/1232644995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3c0ccd40 0x7f0f3c1533d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f41651700 1 -- 172.21.15.6:0/1232644995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2c009a20 con 0x7f0f3c0d0400 2023-10-06T02:29:29.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f41651700 1 --2- 172.21.15.6:0/1232644995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f3c0d0400 0x7f0f3c0c5100 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000c790 tx=0x7f0f30007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:29.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f39ffb700 1 -- 172.21.15.6:0/1232644995 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30011590 con 0x7f0f3c0d0400 2023-10-06T02:29:29.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.480+0000 7f0f39ffb700 1 -- 172.21.15.6:0/1232644995 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f30011710 con 0x7f0f3c0d0400 2023-10-06T02:29:29.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.481+0000 7f0f440b6700 1 -- 172.21.15.6:0/1232644995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3c15a220 con 0x7f0f3c0d0400 2023-10-06T02:29:29.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.481+0000 7f0f39ffb700 1 -- 172.21.15.6:0/1232644995 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30011ad0 con 0x7f0f3c0d0400 2023-10-06T02:29:29.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.481+0000 7f0f440b6700 1 -- 172.21.15.6:0/1232644995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3c15a7e0 con 0x7f0f3c0d0400 2023-10-06T02:29:29.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.482+0000 7f0f440b6700 1 -- 172.21.15.6:0/1232644995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3c088760 con 0x7f0f3c0d0400 2023-10-06T02:29:29.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.482+0000 7f0f39ffb700 1 -- 172.21.15.6:0/1232644995 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f3001b3b0 con 0x7f0f3c0d0400 2023-10-06T02:29:29.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.482+0000 7f0f39ffb700 1 --2- 172.21.15.6:0/1232644995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f28066f30 0x7f0f280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:29.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.483+0000 7f0f39ffb700 1 -- 172.21.15.6:0/1232644995 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 9560+0+0 (secure 0 0 0) 0x7f0f30084890 con 0x7f0f3c0d0400 2023-10-06T02:29:29.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.483+0000 7f0f41e52700 1 --2- 172.21.15.6:0/1232644995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f28066f30 0x7f0f280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:29.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.483+0000 7f0f41e52700 1 --2- 172.21.15.6:0/1232644995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f28066f30 0x7f0f280693e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f0f34007fd0 tx=0x7f0f34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:29.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.487+0000 7f0f39ffb700 1 -- 172.21.15.6:0/1232644995 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f30050b50 con 0x7f0f3c0d0400 2023-10-06T02:29:29.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.723+0000 7f0f440b6700 1 -- 172.21.15.6:0/1232644995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f0f3c0ce6c0 con 0x7f0f3c0d0400 2023-10-06T02:29:29.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.862+0000 7f0f39ffb700 1 -- 172.21.15.6:0/1232644995 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v331) v1 ==== 162+0+0 (secure 0 0 0) 0x7f0f30017030 con 0x7f0f3c0d0400 2023-10-06T02:29:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.865+0000 7f0f440b6700 1 -- 172.21.15.6:0/1232644995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f28066f30 msgr2=0x7f0f280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.865+0000 7f0f440b6700 1 --2- 172.21.15.6:0/1232644995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f28066f30 0x7f0f280693e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f0f34007fd0 tx=0x7f0f34009040 comp rx=0 tx=0).stop 2023-10-06T02:29:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.866+0000 7f0f440b6700 1 -- 172.21.15.6:0/1232644995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f3c0d0400 msgr2=0x7f0f3c0c5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.866+0000 7f0f440b6700 1 --2- 172.21.15.6:0/1232644995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f3c0d0400 0x7f0f3c0c5100 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000c790 tx=0x7f0f30007f40 comp rx=0 tx=0).stop 2023-10-06T02:29:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.866+0000 7f0f440b6700 1 -- 172.21.15.6:0/1232644995 shutdown_connections 2023-10-06T02:29:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.866+0000 7f0f440b6700 1 --2- 172.21.15.6:0/1232644995 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f3c0d07d0 0x7f0f3c1580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.866+0000 7f0f440b6700 1 --2- 172.21.15.6:0/1232644995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3c0ccd40 0x7f0f3c1533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.866+0000 7f0f440b6700 1 --2- 172.21.15.6:0/1232644995 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0f28066f30 0x7f0f280693e0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.866+0000 7f0f440b6700 1 --2- 172.21.15.6:0/1232644995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f3c0d0400 0x7f0f3c0c5100 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.866+0000 7f0f440b6700 1 -- 172.21.15.6:0/1232644995 >> 172.21.15.6:0/1232644995 conn(0x7f0f3c06a220 msgr2=0x7f0f3c087200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.866+0000 7f0f440b6700 1 -- 172.21.15.6:0/1232644995 shutdown_connections 2023-10-06T02:29:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.866+0000 7f0f440b6700 1 -- 172.21.15.6:0/1232644995 wait complete. 2023-10-06T02:29:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:29:29.879 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:29.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.998+0000 7f1d3dc59700 1 Processor -- start 2023-10-06T02:29:29.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.998+0000 7f1d3dc59700 1 -- start start 2023-10-06T02:29:30.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.999+0000 7f1d3dc59700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d380cf1a0 0x7f1d380cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:30.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.999+0000 7f1d3dc59700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d381597d0 0x7f1d380d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.999+0000 7f1d3dc59700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d380b3560 con 0x7f1d38159400 2023-10-06T02:29:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.999+0000 7f1d3dc59700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d380cf6f0 con 0x7f1d381597d0 2023-10-06T02:29:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.999+0000 7f1d3dc59700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380cf9d0 con 0x7f1d380cf1a0 2023-10-06T02:29:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.999+0000 7f1d37fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d380cf1a0 0x7f1d380cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.999+0000 7f1d3d458700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d381597d0 0x7f1d380d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.999+0000 7f1d3cc57700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f1d38159400 0x7f1d380ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:39954/0 (socket says 172.21.15.6:39954) 2023-10-06T02:29:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.999+0000 7f1d3d458700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d381597d0 0x7f1d380d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:50142/0 (socket says 172.21.15.6:50142) 2023-10-06T02:29:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.999+0000 7f1d37fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d380cf1a0 0x7f1d380cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:48444/0 (socket says 172.21.15.6:48444) 2023-10-06T02:29:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:29.999+0000 7f1d3cc57700 1 -- 172.21.15.6:0/529300808 learned_addr learned my addr 172.21.15.6:0/529300808 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.000+0000 7f1d37fff700 1 -- 172.21.15.6:0/529300808 >> v2:172.21.15.175:3300/0 conn(0x7f1d381597d0 msgr2=0x7f1d380d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.000+0000 7f1d37fff700 1 --2- 172.21.15.6:0/529300808 >> v2:172.21.15.175:3300/0 conn(0x7f1d381597d0 0x7f1d380d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.000+0000 7f1d37fff700 1 -- 172.21.15.6:0/529300808 >> v1:172.21.15.175:6789/0 conn(0x7f1d38159400 legacy=0x7f1d380ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.000+0000 7f1d37fff700 1 -- 172.21.15.6:0/529300808 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d380b2f10 con 0x7f1d380cf1a0 2023-10-06T02:29:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.000+0000 7f1d377fe700 1 -- 172.21.15.6:0/529300808 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222891594 0 0) 0x7f1d380b3560 con 0x7f1d38159400 2023-10-06T02:29:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.000+0000 7f1d3d458700 1 --2- 172.21.15.6:0/529300808 >> v2:172.21.15.175:3300/0 conn(0x7f1d381597d0 0x7f1d380d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.000+0000 7f1d37fff700 1 --2- 172.21.15.6:0/529300808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d380cf1a0 0x7f1d380cfec0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0098e0 tx=0x7f1d2c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d2495b6e531b482 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.000+0000 7f1d377fe700 1 -- 172.21.15.6:0/529300808 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00b640 con 0x7f1d380cf1a0 2023-10-06T02:29:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.000+0000 7f1d377fe700 1 -- 172.21.15.6:0/529300808 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c00b7a0 con 0x7f1d380cf1a0 2023-10-06T02:29:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.000+0000 7f1d377fe700 1 -- 172.21.15.6:0/529300808 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00bb40 con 0x7f1d380cf1a0 2023-10-06T02:29:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.001+0000 7f1d3dc59700 1 -- 172.21.15.6:0/529300808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d380cf1a0 msgr2=0x7f1d380cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.001+0000 7f1d3dc59700 1 --2- 172.21.15.6:0/529300808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d380cf1a0 0x7f1d380cfec0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0098e0 tx=0x7f1d2c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.001+0000 7f1d3dc59700 1 -- 172.21.15.6:0/529300808 shutdown_connections 2023-10-06T02:29:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.001+0000 7f1d3dc59700 1 --2- 172.21.15.6:0/529300808 >> v2:172.21.15.175:3300/0 conn(0x7f1d381597d0 0x7f1d380d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.001+0000 7f1d3dc59700 1 --2- 172.21.15.6:0/529300808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d380cf1a0 0x7f1d380cfec0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.001+0000 7f1d3dc59700 1 -- 172.21.15.6:0/529300808 >> 172.21.15.6:0/529300808 conn(0x7f1d3806ac10 msgr2=0x7f1d38068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.001+0000 7f1d3dc59700 1 -- 172.21.15.6:0/529300808 shutdown_connections 2023-10-06T02:29:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.001+0000 7f1d3dc59700 1 -- 172.21.15.6:0/529300808 wait complete. 2023-10-06T02:29:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.002+0000 7f1d3dc59700 1 Processor -- start 2023-10-06T02:29:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.002+0000 7f1d3dc59700 1 -- start start 2023-10-06T02:29:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d3dc59700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d380cf1a0 0x7f1d380b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d3dc59700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d38159400 0x7f1d38153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d3dc59700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d381597d0 0x7f1d381541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d3dc59700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380c5b90 con 0x7f1d38159400 2023-10-06T02:29:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d3dc59700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380c5e70 con 0x7f1d381597d0 2023-10-06T02:29:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d3dc59700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380c6150 con 0x7f1d380cf1a0 2023-10-06T02:29:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d3cc57700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d380cf1a0 0x7f1d380b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d37fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d38159400 0x7f1d38153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d3cc57700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d380cf1a0 0x7f1d380b19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:48450/0 (socket says 172.21.15.6:48450) 2023-10-06T02:29:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d3cc57700 1 -- 172.21.15.6:0/1742309531 learned_addr learned my addr 172.21.15.6:0/1742309531 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d3d458700 1 --2- 172.21.15.6:0/1742309531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d381597d0 0x7f1d381541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d3cc57700 1 -- 172.21.15.6:0/1742309531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d381597d0 msgr2=0x7f1d381541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d3cc57700 1 --2- 172.21.15.6:0/1742309531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d381597d0 0x7f1d381541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d3cc57700 1 -- 172.21.15.6:0/1742309531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d38159400 msgr2=0x7f1d38153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d3cc57700 1 --2- 172.21.15.6:0/1742309531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d38159400 0x7f1d38153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d3cc57700 1 -- 172.21.15.6:0/1742309531 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d30009a20 con 0x7f1d380cf1a0 2023-10-06T02:29:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d37fff700 1 --2- 172.21.15.6:0/1742309531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d38159400 0x7f1d38153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.003+0000 7f1d3cc57700 1 --2- 172.21.15.6:0/1742309531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d380cf1a0 0x7f1d380b19c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c7e0 tx=0x7f1d28007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.004+0000 7f1d34ff9700 1 -- 172.21.15.6:0/1742309531 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28005d20 con 0x7f1d380cf1a0 2023-10-06T02:29:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.004+0000 7f1d34ff9700 1 -- 172.21.15.6:0/1742309531 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d28005e80 con 0x7f1d380cf1a0 2023-10-06T02:29:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.004+0000 7f1d3dc59700 1 -- 172.21.15.6:0/1742309531 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2c009420 con 0x7f1d380cf1a0 2023-10-06T02:29:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.004+0000 7f1d34ff9700 1 -- 172.21.15.6:0/1742309531 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28007320 con 0x7f1d380cf1a0 2023-10-06T02:29:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.004+0000 7f1d3dc59700 1 -- 172.21.15.6:0/1742309531 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d380c6710 con 0x7f1d380cf1a0 2023-10-06T02:29:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.005+0000 7f1d3dc59700 1 -- 172.21.15.6:0/1742309531 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d380ccaf0 con 0x7f1d380cf1a0 2023-10-06T02:29:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.005+0000 7f1d34ff9700 1 -- 172.21.15.6:0/1742309531 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d28007690 con 0x7f1d380cf1a0 2023-10-06T02:29:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.005+0000 7f1d34ff9700 1 --2- 172.21.15.6:0/1742309531 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d24066f30 0x7f1d240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.005+0000 7f1d34ff9700 1 -- 172.21.15.6:0/1742309531 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 9560+0+0 (secure 0 0 0) 0x7f1d28084af0 con 0x7f1d380cf1a0 2023-10-06T02:29:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.006+0000 7f1d37fff700 1 --2- 172.21.15.6:0/1742309531 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d24066f30 0x7f1d240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.006+0000 7f1d37fff700 1 --2- 172.21.15.6:0/1742309531 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d24066f30 0x7f1d240693e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0093f0 tx=0x7f1d2c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:30.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.010+0000 7f1d34ff9700 1 -- 172.21.15.6:0/1742309531 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d28050e10 con 0x7f1d380cf1a0 2023-10-06T02:29:30.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.249+0000 7f1d3dc59700 1 -- 172.21.15.6:0/1742309531 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d380b31f0 con 0x7f1d380cf1a0 2023-10-06T02:29:30.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.250+0000 7f1d34ff9700 1 -- 172.21.15.6:0/1742309531 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 331 v331) v1 ==== 95+0+4607 (secure 0 0 0) 0x7f1d28017030 con 0x7f1d380cf1a0 2023-10-06T02:29:30.251 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:30.251 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":331,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":331,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:29.860090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":132,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10554},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10554":{"gid":10554,"name":"a","rank":0,"incarnation":331,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/3944398775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3944398775},{"type":"v1","addr":"172.21.15.6:6835","nonce":3944398775}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:30.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.252+0000 7f1d3dc59700 1 -- 172.21.15.6:0/1742309531 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d24066f30 msgr2=0x7f1d240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:30.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.252+0000 7f1d3dc59700 1 --2- 172.21.15.6:0/1742309531 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d24066f30 0x7f1d240693e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0093f0 tx=0x7f1d2c017000 comp rx=0 tx=0).stop 2023-10-06T02:29:30.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.252+0000 7f1d3dc59700 1 -- 172.21.15.6:0/1742309531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d380cf1a0 msgr2=0x7f1d380b19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:30.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.252+0000 7f1d3dc59700 1 --2- 172.21.15.6:0/1742309531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d380cf1a0 0x7f1d380b19c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c7e0 tx=0x7f1d28007e00 comp rx=0 tx=0).stop 2023-10-06T02:29:30.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.252+0000 7f1d3dc59700 1 -- 172.21.15.6:0/1742309531 shutdown_connections 2023-10-06T02:29:30.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.252+0000 7f1d3dc59700 1 --2- 172.21.15.6:0/1742309531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d381597d0 0x7f1d381541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:30.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.252+0000 7f1d3dc59700 1 --2- 172.21.15.6:0/1742309531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d380cf1a0 0x7f1d380b19c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:30.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.252+0000 7f1d3dc59700 1 --2- 172.21.15.6:0/1742309531 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d24066f30 0x7f1d240693e0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:30.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.252+0000 7f1d3dc59700 1 --2- 172.21.15.6:0/1742309531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d38159400 0x7f1d38153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:30.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.252+0000 7f1d3dc59700 1 -- 172.21.15.6:0/1742309531 >> 172.21.15.6:0/1742309531 conn(0x7f1d3806ac10 msgr2=0x7f1d380b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:30.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.252+0000 7f1d3dc59700 1 -- 172.21.15.6:0/1742309531 shutdown_connections 2023-10-06T02:29:30.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:30.252+0000 7f1d3dc59700 1 -- 172.21.15.6:0/1742309531 wait complete. 2023-10-06T02:29:30.254 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 331 2023-10-06T02:29:30.265 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2023-10-06T02:29:32.869 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:29:32.869+0000 7f14279b2700 -1 mds.0.cache.dir(0x100) Corrupt fnode in dirfrag 0x100: void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&) no longer understand old encoding version 3 < 101: Malformed input 2023-10-06T02:29:32.871 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:29:32.870+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:29:32.871 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:29:32.870+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:29:32.878 INFO:tasks.ceph.mds.a.smithi006.stderr: -20> 2023-10-06T02:29:32.869+0000 7f14279b2700 -1 mds.0.cache.dir(0x100) Corrupt fnode in dirfrag 0x100: void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&) no longer understand old encoding version 3 < 101: Malformed input 2023-10-06T02:29:32.901 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:29:35.266 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:35.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.398+0000 7f538f1b6700 1 Processor -- start 2023-10-06T02:29:35.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.399+0000 7f538f1b6700 1 -- start start 2023-10-06T02:29:35.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.399+0000 7f538f1b6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f538815ca10 0x7f5388069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:35.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.399+0000 7f538f1b6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5388067d10 0x7f538806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:35.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.399+0000 7f538f1b6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815cde0 0x7f53880aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:35.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.399+0000 7f538f1b6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53880b1ed0 con 0x7f538815ca10 2023-10-06T02:29:35.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.399+0000 7f538f1b6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53880879c0 con 0x7f5388067d10 2023-10-06T02:29:35.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.399+0000 7f538f1b6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53880cec50 con 0x7f538815cde0 2023-10-06T02:29:35.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.399+0000 7f538cf52700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f538815ca10 0x7f5388069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:35.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.400+0000 7f538cf52700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f538815ca10 0x7f5388069f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42092/0 (socket says 172.21.15.6:42092) 2023-10-06T02:29:35.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.400+0000 7f538cf52700 1 -- 172.21.15.6:0/1932585207 learned_addr learned my addr 172.21.15.6:0/1932585207 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:35.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.400+0000 7f5387fff700 1 --2- 172.21.15.6:0/1932585207 >> v2:172.21.15.175:3300/0 conn(0x7f5388067d10 0x7f538806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:35.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.400+0000 7f538d753700 1 --2- 172.21.15.6:0/1932585207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815cde0 0x7f53880aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:35.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.400+0000 7f538cf52700 1 -- 172.21.15.6:0/1932585207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815cde0 msgr2=0x7f53880aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:35.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.400+0000 7f538cf52700 1 --2- 172.21.15.6:0/1932585207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815cde0 0x7f53880aeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:35.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.400+0000 7f538cf52700 1 -- 172.21.15.6:0/1932585207 >> v2:172.21.15.175:3300/0 conn(0x7f5388067d10 msgr2=0x7f538806a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:35.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.400+0000 7f538cf52700 1 --2- 172.21.15.6:0/1932585207 >> v2:172.21.15.175:3300/0 conn(0x7f5388067d10 0x7f538806a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:35.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.400+0000 7f538cf52700 1 -- 172.21.15.6:0/1932585207 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53880cef30 con 0x7f538815ca10 2023-10-06T02:29:35.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.400+0000 7f5387fff700 1 --2- 172.21.15.6:0/1932585207 >> v2:172.21.15.175:3300/0 conn(0x7f5388067d10 0x7f538806a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:35.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.400+0000 7f538d753700 1 --2- 172.21.15.6:0/1932585207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815cde0 0x7f53880aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:35.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.400+0000 7f538cf52700 1 --2- 172.21.15.6:0/1932585207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f538815ca10 0x7f5388069f70 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f53880a9170 tx=0x7f5380009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61aafd5b3b1479bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:35.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.400+0000 7f53877fe700 1 -- 172.21.15.6:0/1932585207 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538000e070 con 0x7f538815ca10 2023-10-06T02:29:35.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.400+0000 7f53877fe700 1 -- 172.21.15.6:0/1932585207 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538000bad0 con 0x7f538815ca10 2023-10-06T02:29:35.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.400+0000 7f53877fe700 1 -- 172.21.15.6:0/1932585207 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53800092e0 con 0x7f538815ca10 2023-10-06T02:29:35.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.401+0000 7f538f1b6700 1 -- 172.21.15.6:0/1932585207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f538815ca10 msgr2=0x7f5388069f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:35.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.401+0000 7f538f1b6700 1 --2- 172.21.15.6:0/1932585207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f538815ca10 0x7f5388069f70 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f53880a9170 tx=0x7f5380009840 comp rx=0 tx=0).stop 2023-10-06T02:29:35.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.401+0000 7f538f1b6700 1 -- 172.21.15.6:0/1932585207 shutdown_connections 2023-10-06T02:29:35.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.401+0000 7f538f1b6700 1 --2- 172.21.15.6:0/1932585207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815cde0 0x7f53880aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:35.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.401+0000 7f538f1b6700 1 --2- 172.21.15.6:0/1932585207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f538815ca10 0x7f5388069f70 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:35.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.401+0000 7f538f1b6700 1 --2- 172.21.15.6:0/1932585207 >> v2:172.21.15.175:3300/0 conn(0x7f5388067d10 0x7f538806a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:35.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.401+0000 7f538f1b6700 1 -- 172.21.15.6:0/1932585207 >> 172.21.15.6:0/1932585207 conn(0x7f5388067910 msgr2=0x7f53880ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:35.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.401+0000 7f538f1b6700 1 -- 172.21.15.6:0/1932585207 shutdown_connections 2023-10-06T02:29:35.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.401+0000 7f538f1b6700 1 -- 172.21.15.6:0/1932585207 wait complete. 2023-10-06T02:29:35.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.402+0000 7f538f1b6700 1 Processor -- start 2023-10-06T02:29:35.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.402+0000 7f538f1b6700 1 -- start start 2023-10-06T02:29:35.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.403+0000 7f538f1b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388067d10 0x7f538809b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:35.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.403+0000 7f538f1b6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f538815ca10 0x7f5388157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:35.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.403+0000 7f538f1b6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815cde0 0x7f5388157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:35.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.403+0000 7f538f1b6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5388099280 con 0x7f5388067d10 2023-10-06T02:29:35.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.403+0000 7f538f1b6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5388098670 con 0x7f538815ca10 2023-10-06T02:29:35.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.403+0000 7f538f1b6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5388098950 con 0x7f538815cde0 2023-10-06T02:29:35.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.403+0000 7f538cf52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388067d10 0x7f538809b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:35.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.403+0000 7f538cf52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388067d10 0x7f538809b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42100/0 (socket says 172.21.15.6:42100) 2023-10-06T02:29:35.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.403+0000 7f538cf52700 1 -- 172.21.15.6:0/1011374722 learned_addr learned my addr 172.21.15.6:0/1011374722 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:35.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.403+0000 7f5387fff700 1 --2- 172.21.15.6:0/1011374722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f538815ca10 0x7f5388157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:35.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.403+0000 7f538d753700 1 --2- 172.21.15.6:0/1011374722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815cde0 0x7f5388157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:35.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.403+0000 7f538cf52700 1 -- 172.21.15.6:0/1011374722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815cde0 msgr2=0x7f5388157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:35.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.403+0000 7f538cf52700 1 --2- 172.21.15.6:0/1011374722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815cde0 0x7f5388157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:35.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.403+0000 7f538cf52700 1 -- 172.21.15.6:0/1011374722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f538815ca10 msgr2=0x7f5388157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:35.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.403+0000 7f538cf52700 1 --2- 172.21.15.6:0/1011374722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f538815ca10 0x7f5388157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:35.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.403+0000 7f538cf52700 1 -- 172.21.15.6:0/1011374722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5380009ae0 con 0x7f5388067d10 2023-10-06T02:29:35.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.403+0000 7f538d753700 1 --2- 172.21.15.6:0/1011374722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815cde0 0x7f5388157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:35.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.404+0000 7f538cf52700 1 --2- 172.21.15.6:0/1011374722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388067d10 0x7f538809b030 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f538806f4d0 tx=0x7f5380018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:35.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.404+0000 7f5384ff9700 1 -- 172.21.15.6:0/1011374722 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380008aa0 con 0x7f5388067d10 2023-10-06T02:29:35.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.404+0000 7f5384ff9700 1 -- 172.21.15.6:0/1011374722 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5380008c20 con 0x7f5388067d10 2023-10-06T02:29:35.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.404+0000 7f5384ff9700 1 -- 172.21.15.6:0/1011374722 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380026460 con 0x7f5388067d10 2023-10-06T02:29:35.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.404+0000 7f538f1b6700 1 -- 172.21.15.6:0/1011374722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5388098c30 con 0x7f5388067d10 2023-10-06T02:29:35.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.404+0000 7f538f1b6700 1 -- 172.21.15.6:0/1011374722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538809b570 con 0x7f5388067d10 2023-10-06T02:29:35.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.405+0000 7f538f1b6700 1 -- 172.21.15.6:0/1011374722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538809b790 con 0x7f5388067d10 2023-10-06T02:29:35.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.405+0000 7f5384ff9700 1 -- 172.21.15.6:0/1011374722 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5380003040 con 0x7f5388067d10 2023-10-06T02:29:35.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.406+0000 7f5384ff9700 1 --2- 172.21.15.6:0/1011374722 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5368066f60 0x7f5368069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:35.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.406+0000 7f5384ff9700 1 -- 172.21.15.6:0/1011374722 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 9646+0+0 (secure 0 0 0) 0x7f5380087240 con 0x7f5388067d10 2023-10-06T02:29:35.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.406+0000 7f5387fff700 1 --2- 172.21.15.6:0/1011374722 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5368066f60 0x7f5368069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:35.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.406+0000 7f5387fff700 1 --2- 172.21.15.6:0/1011374722 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5368066f60 0x7f5368069410 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f5378006f00 tx=0x7f5378008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:35.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.410+0000 7f5384ff9700 1 -- 172.21.15.6:0/1011374722 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5380053510 con 0x7f5388067d10 2023-10-06T02:29:35.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.649+0000 7f538f1b6700 1 -- 172.21.15.6:0/1011374722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53880990d0 con 0x7f5388067d10 2023-10-06T02:29:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.649+0000 7f5384ff9700 1 -- 172.21.15.6:0/1011374722 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 336 v336) v1 ==== 95+0+4593 (secure 0 0 0) 0x7f5380021090 con 0x7f5388067d10 2023-10-06T02:29:35.650 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:35.650 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":336,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10596,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/862419044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":862419044},{"type":"v1","addr":"172.21.15.6:6835","nonce":862419044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":336}],"filesystems":[{"mdsmap":{"epoch":335,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:32.871348+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":133,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:35.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.651+0000 7f538f1b6700 1 -- 172.21.15.6:0/1011374722 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5368066f60 msgr2=0x7f5368069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:35.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.651+0000 7f538f1b6700 1 --2- 172.21.15.6:0/1011374722 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5368066f60 0x7f5368069410 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f5378006f00 tx=0x7f5378008040 comp rx=0 tx=0).stop 2023-10-06T02:29:35.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.651+0000 7f538f1b6700 1 -- 172.21.15.6:0/1011374722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388067d10 msgr2=0x7f538809b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:35.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.651+0000 7f538f1b6700 1 --2- 172.21.15.6:0/1011374722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388067d10 0x7f538809b030 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f538806f4d0 tx=0x7f5380018000 comp rx=0 tx=0).stop 2023-10-06T02:29:35.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.651+0000 7f538f1b6700 1 -- 172.21.15.6:0/1011374722 shutdown_connections 2023-10-06T02:29:35.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.651+0000 7f538f1b6700 1 --2- 172.21.15.6:0/1011374722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538815cde0 0x7f5388157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:35.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.651+0000 7f538f1b6700 1 --2- 172.21.15.6:0/1011374722 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5368066f60 0x7f5368069410 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:35.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.651+0000 7f538f1b6700 1 --2- 172.21.15.6:0/1011374722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388067d10 0x7f538809b030 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:35.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.651+0000 7f538f1b6700 1 --2- 172.21.15.6:0/1011374722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f538815ca10 0x7f5388157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:35.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.651+0000 7f538f1b6700 1 -- 172.21.15.6:0/1011374722 >> 172.21.15.6:0/1011374722 conn(0x7f5388067910 msgr2=0x7f538815ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:35.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.652+0000 7f538f1b6700 1 -- 172.21.15.6:0/1011374722 shutdown_connections 2023-10-06T02:29:35.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.652+0000 7f538f1b6700 1 -- 172.21.15.6:0/1011374722 wait complete. 2023-10-06T02:29:35.654 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 336 2023-10-06T02:29:35.665 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:29:35.665 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:35.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.783+0000 7f6e97415700 1 Processor -- start 2023-10-06T02:29:35.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.783+0000 7f6e97415700 1 -- start start 2023-10-06T02:29:35.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.784+0000 7f6e97415700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6e90159150 0x7f6e9015de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:35.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.784+0000 7f6e97415700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6e900b08f0 0x7f6e90159520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:35.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.784+0000 7f6e97415700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e900afbc0 con 0x7f6e900cccf0 2023-10-06T02:29:35.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.784+0000 7f6e97415700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e90159a60 con 0x7f6e900b08f0 2023-10-06T02:29:35.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.784+0000 7f6e97415700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e900cd620 con 0x7f6e90159150 2023-10-06T02:29:35.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.784+0000 7f6e949b0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6e900b08f0 0x7f6e90159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:35.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.784+0000 7f6e949b0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6e900b08f0 0x7f6e90159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42106/0 (socket says 172.21.15.6:42106) 2023-10-06T02:29:35.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.784+0000 7f6e949b0700 1 -- 172.21.15.6:0/2421777210 learned_addr learned my addr 172.21.15.6:0/2421777210 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:35.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.784+0000 7f6e951b1700 1 --2- 172.21.15.6:0/2421777210 >> v2:172.21.15.175:3300/0 conn(0x7f6e90159150 0x7f6e9015de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:35.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.785+0000 7f6e949b0700 1 -- 172.21.15.6:0/2421777210 >> v2:172.21.15.175:3300/0 conn(0x7f6e90159150 msgr2=0x7f6e9015de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:35.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.785+0000 7f6e949b0700 1 --2- 172.21.15.6:0/2421777210 >> v2:172.21.15.175:3300/0 conn(0x7f6e90159150 0x7f6e9015de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:35.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.785+0000 7f6e949b0700 1 -- 172.21.15.6:0/2421777210 >> v1:172.21.15.175:6789/0 conn(0x7f6e900cccf0 legacy=0x7f6e900b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:35.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.785+0000 7f6e949b0700 1 -- 172.21.15.6:0/2421777210 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e900afe10 con 0x7f6e900b08f0 2023-10-06T02:29:35.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.785+0000 7f6e949b0700 1 --2- 172.21.15.6:0/2421777210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e900b08f0 0x7f6e90159520 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7f6e900cddd0 tx=0x7f6e84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fee57fd51ede2d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:35.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.785+0000 7f6e8ffff700 1 -- 172.21.15.6:0/2421777210 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84009e70 con 0x7f6e900b08f0 2023-10-06T02:29:35.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.785+0000 7f6e8ffff700 1 -- 172.21.15.6:0/2421777210 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8400b860 con 0x7f6e900b08f0 2023-10-06T02:29:35.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.785+0000 7f6e8ffff700 1 -- 172.21.15.6:0/2421777210 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8400bc00 con 0x7f6e900b08f0 2023-10-06T02:29:35.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.785+0000 7f6e97415700 1 -- 172.21.15.6:0/2421777210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e900b08f0 msgr2=0x7f6e90159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:35.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.785+0000 7f6e97415700 1 --2- 172.21.15.6:0/2421777210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e900b08f0 0x7f6e90159520 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7f6e900cddd0 tx=0x7f6e84009250 comp rx=0 tx=0).stop 2023-10-06T02:29:35.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.785+0000 7f6e97415700 1 -- 172.21.15.6:0/2421777210 shutdown_connections 2023-10-06T02:29:35.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.785+0000 7f6e97415700 1 --2- 172.21.15.6:0/2421777210 >> v2:172.21.15.175:3300/0 conn(0x7f6e90159150 0x7f6e9015de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:35.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.785+0000 7f6e97415700 1 --2- 172.21.15.6:0/2421777210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e900b08f0 0x7f6e90159520 unknown :-1 s=CLOSED pgs=2273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:35.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.786+0000 7f6e97415700 1 -- 172.21.15.6:0/2421777210 >> 172.21.15.6:0/2421777210 conn(0x7f6e90068680 msgr2=0x7f6e90068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:35.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.786+0000 7f6e97415700 1 -- 172.21.15.6:0/2421777210 shutdown_connections 2023-10-06T02:29:35.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.786+0000 7f6e97415700 1 -- 172.21.15.6:0/2421777210 wait complete. 2023-10-06T02:29:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.787+0000 7f6e97415700 1 Processor -- start 2023-10-06T02:29:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.787+0000 7f6e97415700 1 -- start start 2023-10-06T02:29:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e97415700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e900b08f0 0x7f6e900c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e97415700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e900cccf0 0x7f6e9015ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e97415700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e90159150 0x7f6e900c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e97415700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9015c380 con 0x7f6e90159150 2023-10-06T02:29:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e97415700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9015b700 con 0x7f6e900b08f0 2023-10-06T02:29:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e97415700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9015b9e0 con 0x7f6e900cccf0 2023-10-06T02:29:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e959b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e90159150 0x7f6e900c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e959b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e90159150 0x7f6e900c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42122/0 (socket says 172.21.15.6:42122) 2023-10-06T02:29:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e959b2700 1 -- 172.21.15.6:0/2738417458 learned_addr learned my addr 172.21.15.6:0/2738417458 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e949b0700 1 --2- 172.21.15.6:0/2738417458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e900cccf0 0x7f6e9015ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e951b1700 1 --2- 172.21.15.6:0/2738417458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e900b08f0 0x7f6e900c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e959b2700 1 -- 172.21.15.6:0/2738417458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e900cccf0 msgr2=0x7f6e9015ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e959b2700 1 --2- 172.21.15.6:0/2738417458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e900cccf0 0x7f6e9015ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e959b2700 1 -- 172.21.15.6:0/2738417458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e900b08f0 msgr2=0x7f6e900c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e959b2700 1 --2- 172.21.15.6:0/2738417458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e900b08f0 0x7f6e900c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e959b2700 1 -- 172.21.15.6:0/2738417458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e840094f0 con 0x7f6e90159150 2023-10-06T02:29:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e959b2700 1 --2- 172.21.15.6:0/2738417458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e90159150 0x7f6e900c7300 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800c560 tx=0x7f6e88007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e8d7fa700 1 -- 172.21.15.6:0/2738417458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88011590 con 0x7f6e90159150 2023-10-06T02:29:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e8d7fa700 1 -- 172.21.15.6:0/2738417458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e880116f0 con 0x7f6e90159150 2023-10-06T02:29:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e8d7fa700 1 -- 172.21.15.6:0/2738417458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88011ab0 con 0x7f6e90159150 2023-10-06T02:29:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e97415700 1 -- 172.21.15.6:0/2738417458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9015bcc0 con 0x7f6e90159150 2023-10-06T02:29:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.788+0000 7f6e97415700 1 -- 172.21.15.6:0/2738417458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e900c9540 con 0x7f6e90159150 2023-10-06T02:29:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.789+0000 7f6e97415700 1 -- 172.21.15.6:0/2738417458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e9015c4c0 con 0x7f6e90159150 2023-10-06T02:29:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.790+0000 7f6e8d7fa700 1 -- 172.21.15.6:0/2738417458 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e8801b3b0 con 0x7f6e90159150 2023-10-06T02:29:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.790+0000 7f6e8d7fa700 1 --2- 172.21.15.6:0/2738417458 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e7c066f30 0x7f6e7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.790+0000 7f6e8d7fa700 1 -- 172.21.15.6:0/2738417458 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 9646+0+0 (secure 0 0 0) 0x7f6e88084890 con 0x7f6e90159150 2023-10-06T02:29:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.791+0000 7f6e951b1700 1 --2- 172.21.15.6:0/2738417458 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e7c066f30 0x7f6e7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.791+0000 7f6e951b1700 1 --2- 172.21.15.6:0/2738417458 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e7c066f30 0x7f6e7c0693e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000f570 tx=0x7f6e8000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:35.795+0000 7f6e8d7fa700 1 -- 172.21.15.6:0/2738417458 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e9015c4c0 con 0x7f6e90159150 2023-10-06T02:29:36.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.035+0000 7f6e97415700 1 -- 172.21.15.6:0/2738417458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e9015c4c0 con 0x7f6e90159150 2023-10-06T02:29:36.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.036+0000 7f6e8d7fa700 1 -- 172.21.15.6:0/2738417458 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 336 v336) v1 ==== 95+0+4593 (secure 0 0 0) 0x7f6e9015c4c0 con 0x7f6e90159150 2023-10-06T02:29:36.036 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:36.037 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":336,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10596,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/862419044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":862419044},{"type":"v1","addr":"172.21.15.6:6835","nonce":862419044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":336}],"filesystems":[{"mdsmap":{"epoch":335,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:32.871348+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":133,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:36.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.037+0000 7f6e97415700 1 -- 172.21.15.6:0/2738417458 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e7c066f30 msgr2=0x7f6e7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:36.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.037+0000 7f6e97415700 1 --2- 172.21.15.6:0/2738417458 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e7c066f30 0x7f6e7c0693e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000f570 tx=0x7f6e8000b040 comp rx=0 tx=0).stop 2023-10-06T02:29:36.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.037+0000 7f6e97415700 1 -- 172.21.15.6:0/2738417458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e90159150 msgr2=0x7f6e900c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:36.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.037+0000 7f6e97415700 1 --2- 172.21.15.6:0/2738417458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e90159150 0x7f6e900c7300 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800c560 tx=0x7f6e88007ef0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.038+0000 7f6e97415700 1 -- 172.21.15.6:0/2738417458 shutdown_connections 2023-10-06T02:29:36.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.038+0000 7f6e97415700 1 --2- 172.21.15.6:0/2738417458 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6e7c066f30 0x7f6e7c0693e0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.038+0000 7f6e97415700 1 --2- 172.21.15.6:0/2738417458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e90159150 0x7f6e900c7300 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.038+0000 7f6e97415700 1 --2- 172.21.15.6:0/2738417458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e900b08f0 0x7f6e900c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.038+0000 7f6e97415700 1 --2- 172.21.15.6:0/2738417458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e900cccf0 0x7f6e9015ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.038+0000 7f6e97415700 1 -- 172.21.15.6:0/2738417458 >> 172.21.15.6:0/2738417458 conn(0x7f6e90068680 msgr2=0x7f6e900d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:36.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.038+0000 7f6e97415700 1 -- 172.21.15.6:0/2738417458 shutdown_connections 2023-10-06T02:29:36.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.038+0000 7f6e97415700 1 -- 172.21.15.6:0/2738417458 wait complete. 2023-10-06T02:29:36.040 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 336 2023-10-06T02:29:36.050 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:29:36.050 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.170+0000 7fdacc0c0700 1 Processor -- start 2023-10-06T02:29:36.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.170+0000 7fdacc0c0700 1 -- start start 2023-10-06T02:29:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.171+0000 7fdacc0c0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdac40af8b0 0x7fdac415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.171+0000 7fdacc0c0700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdac40b27f0 0x7fdac415d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.171+0000 7fdacc0c0700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac415e190 con 0x7fdac40af4e0 2023-10-06T02:29:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.171+0000 7fdacc0c0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac40b1910 con 0x7fdac40af8b0 2023-10-06T02:29:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.171+0000 7fdacc0c0700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac40cb650 con 0x7fdac40b27f0 2023-10-06T02:29:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.171+0000 7fdac965b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdac40af8b0 0x7fdac415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.171+0000 7fdac965b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdac40af8b0 0x7fdac415d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42136/0 (socket says 172.21.15.6:42136) 2023-10-06T02:29:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.171+0000 7fdac965b700 1 -- 172.21.15.6:0/2033850914 learned_addr learned my addr 172.21.15.6:0/2033850914 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.171+0000 7fdaca65d700 1 --2- 172.21.15.6:0/2033850914 >> v2:172.21.15.175:3300/0 conn(0x7fdac40b27f0 0x7fdac415d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.171+0000 7fdac965b700 1 -- 172.21.15.6:0/2033850914 >> v2:172.21.15.175:3300/0 conn(0x7fdac40b27f0 msgr2=0x7fdac415d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.171+0000 7fdac965b700 1 --2- 172.21.15.6:0/2033850914 >> v2:172.21.15.175:3300/0 conn(0x7fdac40b27f0 0x7fdac415d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.171+0000 7fdac965b700 1 -- 172.21.15.6:0/2033850914 >> v1:172.21.15.175:6789/0 conn(0x7fdac40af4e0 legacy=0x7fdac40b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.171+0000 7fdac965b700 1 -- 172.21.15.6:0/2033850914 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac40ccaf0 con 0x7fdac40af8b0 2023-10-06T02:29:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.171+0000 7fdac965b700 1 --2- 172.21.15.6:0/2033850914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac40af8b0 0x7fdac415d460 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7fdac40c7280 tx=0x7fdab4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2faba3f01c81e792 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:36.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.172+0000 7fdac8e5a700 1 -- 172.21.15.6:0/2033850914 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4009e70 con 0x7fdac40af8b0 2023-10-06T02:29:36.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.172+0000 7fdac8e5a700 1 -- 172.21.15.6:0/2033850914 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab400b860 con 0x7fdac40af8b0 2023-10-06T02:29:36.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.172+0000 7fdac8e5a700 1 -- 172.21.15.6:0/2033850914 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab400bc00 con 0x7fdac40af8b0 2023-10-06T02:29:36.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.172+0000 7fdacc0c0700 1 -- 172.21.15.6:0/2033850914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac40af8b0 msgr2=0x7fdac415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:36.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.172+0000 7fdacc0c0700 1 --2- 172.21.15.6:0/2033850914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac40af8b0 0x7fdac415d460 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7fdac40c7280 tx=0x7fdab4009250 comp rx=0 tx=0).stop 2023-10-06T02:29:36.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.172+0000 7fdacc0c0700 1 -- 172.21.15.6:0/2033850914 shutdown_connections 2023-10-06T02:29:36.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.172+0000 7fdacc0c0700 1 --2- 172.21.15.6:0/2033850914 >> v2:172.21.15.175:3300/0 conn(0x7fdac40b27f0 0x7fdac415d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.172+0000 7fdacc0c0700 1 --2- 172.21.15.6:0/2033850914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac40af8b0 0x7fdac415d460 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.172+0000 7fdacc0c0700 1 -- 172.21.15.6:0/2033850914 >> 172.21.15.6:0/2033850914 conn(0x7fdac4068680 msgr2=0x7fdac4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:36.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.172+0000 7fdacc0c0700 1 -- 172.21.15.6:0/2033850914 shutdown_connections 2023-10-06T02:29:36.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.172+0000 7fdacc0c0700 1 -- 172.21.15.6:0/2033850914 wait complete. 2023-10-06T02:29:36.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.173+0000 7fdacc0c0700 1 Processor -- start 2023-10-06T02:29:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.173+0000 7fdacc0c0700 1 -- start start 2023-10-06T02:29:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.174+0000 7fdacc0c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac40af4e0 0x7fdac40a8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.174+0000 7fdacc0c0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdac40af8b0 0x7fdac40a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.174+0000 7fdacc0c0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdac40b27f0 0x7fdac40c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.174+0000 7fdacc0c0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac415a530 con 0x7fdac40af4e0 2023-10-06T02:29:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.174+0000 7fdacc0c0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac40c7dd0 con 0x7fdac40af8b0 2023-10-06T02:29:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.174+0000 7fdacc0c0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac40c74a0 con 0x7fdac40b27f0 2023-10-06T02:29:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.174+0000 7fdac9e5c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac40af4e0 0x7fdac40a8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.174+0000 7fdac9e5c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac40af4e0 0x7fdac40a8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42138/0 (socket says 172.21.15.6:42138) 2023-10-06T02:29:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.174+0000 7fdac9e5c700 1 -- 172.21.15.6:0/2611695881 learned_addr learned my addr 172.21.15.6:0/2611695881 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.174+0000 7fdaca65d700 1 --2- 172.21.15.6:0/2611695881 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdac40b27f0 0x7fdac40c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.174+0000 7fdac965b700 1 --2- 172.21.15.6:0/2611695881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdac40af8b0 0x7fdac40a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.174+0000 7fdac9e5c700 1 -- 172.21.15.6:0/2611695881 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdac40b27f0 msgr2=0x7fdac40c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.174+0000 7fdac9e5c700 1 --2- 172.21.15.6:0/2611695881 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdac40b27f0 0x7fdac40c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.175+0000 7fdac9e5c700 1 -- 172.21.15.6:0/2611695881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdac40af8b0 msgr2=0x7fdac40a92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.175+0000 7fdac9e5c700 1 --2- 172.21.15.6:0/2611695881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdac40af8b0 0x7fdac40a92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.175+0000 7fdac9e5c700 1 -- 172.21.15.6:0/2611695881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab40094f0 con 0x7fdac40af4e0 2023-10-06T02:29:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.175+0000 7fdac9e5c700 1 --2- 172.21.15.6:0/2611695881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac40af4e0 0x7fdac40a8d80 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7fdac000c4e0 tx=0x7fdac000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.175+0000 7fdab9ffb700 1 -- 172.21.15.6:0/2611695881 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac0011590 con 0x7fdac40af4e0 2023-10-06T02:29:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.175+0000 7fdab9ffb700 1 -- 172.21.15.6:0/2611695881 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac0011710 con 0x7fdac40af4e0 2023-10-06T02:29:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.175+0000 7fdacc0c0700 1 -- 172.21.15.6:0/2611695881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac40c7780 con 0x7fdac40af4e0 2023-10-06T02:29:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.175+0000 7fdab9ffb700 1 -- 172.21.15.6:0/2611695881 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac0011ad0 con 0x7fdac40af4e0 2023-10-06T02:29:36.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.175+0000 7fdacc0c0700 1 -- 172.21.15.6:0/2611695881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac40c87a0 con 0x7fdac40af4e0 2023-10-06T02:29:36.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.176+0000 7fdacc0c0700 1 -- 172.21.15.6:0/2611695881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac40c80b0 con 0x7fdac40af4e0 2023-10-06T02:29:36.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.176+0000 7fdab9ffb700 1 -- 172.21.15.6:0/2611695881 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdac0001020 con 0x7fdac40af4e0 2023-10-06T02:29:36.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.177+0000 7fdab9ffb700 1 --2- 172.21.15.6:0/2611695881 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdaa8066f30 0x7fdaa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.177+0000 7fdab9ffb700 1 -- 172.21.15.6:0/2611695881 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 9646+0+0 (secure 0 0 0) 0x7fdac00849b0 con 0x7fdac40af4e0 2023-10-06T02:29:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.177+0000 7fdac965b700 1 --2- 172.21.15.6:0/2611695881 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdaa8066f30 0x7fdaa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.178+0000 7fdac965b700 1 --2- 172.21.15.6:0/2611695881 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdaa8066f30 0x7fdaa80693e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fdac4089810 tx=0x7fdab4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.181+0000 7fdab9ffb700 1 -- 172.21.15.6:0/2611695881 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdac0050c80 con 0x7fdac40af4e0 2023-10-06T02:29:36.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.419+0000 7fdacc0c0700 1 -- 172.21.15.6:0/2611695881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdac40b0910 con 0x7fdac40af4e0 2023-10-06T02:29:36.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.419+0000 7fdab9ffb700 1 -- 172.21.15.6:0/2611695881 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 336 v336) v1 ==== 95+0+4593 (secure 0 0 0) 0x7fdac0017030 con 0x7fdac40af4e0 2023-10-06T02:29:36.420 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:36.420 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":336,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10596,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/862419044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":862419044},{"type":"v1","addr":"172.21.15.6:6835","nonce":862419044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":336}],"filesystems":[{"mdsmap":{"epoch":335,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:32.871348+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":133,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:36.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.421+0000 7fdacc0c0700 1 -- 172.21.15.6:0/2611695881 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdaa8066f30 msgr2=0x7fdaa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:36.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.421+0000 7fdacc0c0700 1 --2- 172.21.15.6:0/2611695881 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdaa8066f30 0x7fdaa80693e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fdac4089810 tx=0x7fdab4017000 comp rx=0 tx=0).stop 2023-10-06T02:29:36.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.421+0000 7fdacc0c0700 1 -- 172.21.15.6:0/2611695881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac40af4e0 msgr2=0x7fdac40a8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:36.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.421+0000 7fdacc0c0700 1 --2- 172.21.15.6:0/2611695881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac40af4e0 0x7fdac40a8d80 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7fdac000c4e0 tx=0x7fdac000c8a0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.421+0000 7fdacc0c0700 1 -- 172.21.15.6:0/2611695881 shutdown_connections 2023-10-06T02:29:36.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.421+0000 7fdacc0c0700 1 --2- 172.21.15.6:0/2611695881 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdac40b27f0 0x7fdac40c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.421+0000 7fdacc0c0700 1 --2- 172.21.15.6:0/2611695881 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fdaa8066f30 0x7fdaa80693e0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.421+0000 7fdacc0c0700 1 --2- 172.21.15.6:0/2611695881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac40af4e0 0x7fdac40a8d80 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.421+0000 7fdacc0c0700 1 --2- 172.21.15.6:0/2611695881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdac40af8b0 0x7fdac40a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.421+0000 7fdacc0c0700 1 -- 172.21.15.6:0/2611695881 >> 172.21.15.6:0/2611695881 conn(0x7fdac4068680 msgr2=0x7fdac40cc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:36.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.421+0000 7fdacc0c0700 1 -- 172.21.15.6:0/2611695881 shutdown_connections 2023-10-06T02:29:36.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.421+0000 7fdacc0c0700 1 -- 172.21.15.6:0/2611695881 wait complete. 2023-10-06T02:29:36.423 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 336 2023-10-06T02:29:36.434 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on 100.00000000' led to DAMAGED state 2023-10-06T02:29:36.434 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on mds0_sessionmap' 2023-10-06T02:29:36.434 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:29:36.434 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:29:36.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:36.434 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:29:36.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:29:36.449 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:29:36.449 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:29:36.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.608+0000 7fef0b75e700 1 Processor -- start 2023-10-06T02:29:36.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.608+0000 7fef0b75e700 1 -- start start 2023-10-06T02:29:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.609+0000 7fef0b75e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fef04156350 0x7fef0415ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:36.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.609+0000 7fef0b75e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef040b00e0 con 0x7fef04156720 2023-10-06T02:29:36.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.609+0000 7fef0b75e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef040c87c0 con 0x7fef040ae260 2023-10-06T02:29:36.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.609+0000 7fef0b75e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef040b0960 con 0x7fef04156350 2023-10-06T02:29:36.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.609+0000 7fef08cf9700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fef04156720 0x7fef040adb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49858/0 (socket says 172.21.15.6:49858) 2023-10-06T02:29:36.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.609+0000 7fef08cf9700 1 -- 172.21.15.6:0/3867433860 learned_addr learned my addr 172.21.15.6:0/3867433860 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:36.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.610+0000 7fef094fa700 1 --2- 172.21.15.6:0/3867433860 >> v2:172.21.15.175:3300/0 conn(0x7fef04156350 0x7fef0415ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:36.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.610+0000 7fef03fff700 1 -- 172.21.15.6:0/3867433860 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280572836 0 0) 0x7fef040b00e0 con 0x7fef04156720 2023-10-06T02:29:36.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.610+0000 7fef03fff700 1 -- 172.21.15.6:0/3867433860 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeec003570 con 0x7fef04156720 2023-10-06T02:29:36.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.610+0000 7fef03fff700 1 -- 172.21.15.6:0/3867433860 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022697450 0 0) 0x7fef040c87c0 con 0x7fef040ae260 2023-10-06T02:29:36.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.610+0000 7fef03fff700 1 -- 172.21.15.6:0/3867433860 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef040b00e0 con 0x7fef040ae260 2023-10-06T02:29:36.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.610+0000 7fef03fff700 1 -- 172.21.15.6:0/3867433860 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3319975526 0 0) 0x7feeec003570 con 0x7fef04156720 2023-10-06T02:29:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.610+0000 7fef094fa700 1 -- 172.21.15.6:0/3867433860 >> v1:172.21.15.175:6789/0 conn(0x7fef040ae260 legacy=0x7fef040b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.610+0000 7fef094fa700 1 -- 172.21.15.6:0/3867433860 >> v1:172.21.15.6:6789/0 conn(0x7fef04156720 legacy=0x7fef040adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.610+0000 7fef094fa700 1 -- 172.21.15.6:0/3867433860 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0415b090 con 0x7fef04156350 2023-10-06T02:29:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.610+0000 7fef094fa700 1 --2- 172.21.15.6:0/3867433860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef04156350 0x7fef0415ab50 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7feefc009910 tx=0x7feefc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d23a56389f00864 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.610+0000 7fef03fff700 1 -- 172.21.15.6:0/3867433860 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef8001470 con 0x7fef04156350 2023-10-06T02:29:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.610+0000 7fef03fff700 1 -- 172.21.15.6:0/3867433860 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc011420 con 0x7fef04156350 2023-10-06T02:29:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.610+0000 7fef03fff700 1 -- 172.21.15.6:0/3867433860 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc0117c0 con 0x7fef04156350 2023-10-06T02:29:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.611+0000 7fef0b75e700 1 -- 172.21.15.6:0/3867433860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef04156350 msgr2=0x7fef0415ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.611+0000 7fef0b75e700 1 --2- 172.21.15.6:0/3867433860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef04156350 0x7fef0415ab50 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7feefc009910 tx=0x7feefc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.611+0000 7fef0b75e700 1 -- 172.21.15.6:0/3867433860 shutdown_connections 2023-10-06T02:29:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.611+0000 7fef0b75e700 1 --2- 172.21.15.6:0/3867433860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef04156350 0x7fef0415ab50 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.611+0000 7fef0b75e700 1 -- 172.21.15.6:0/3867433860 >> 172.21.15.6:0/3867433860 conn(0x7fef04069110 msgr2=0x7fef040cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:36.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.611+0000 7fef0b75e700 1 -- 172.21.15.6:0/3867433860 shutdown_connections 2023-10-06T02:29:36.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.611+0000 7fef0b75e700 1 -- 172.21.15.6:0/3867433860 wait complete. 2023-10-06T02:29:36.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.612+0000 7fef0b75e700 1 Processor -- start 2023-10-06T02:29:36.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.612+0000 7fef0b75e700 1 -- start start 2023-10-06T02:29:36.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.613+0000 7fef0b75e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef040ae260 0x7fef04158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:36.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.613+0000 7fef0b75e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef04156350 0x7fef0415b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:36.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.613+0000 7fef0b75e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef04156720 0x7fef0415ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:36.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.613+0000 7fef0b75e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef04149760 con 0x7fef04156720 2023-10-06T02:29:36.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.613+0000 7fef0b75e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef04149430 con 0x7fef040ae260 2023-10-06T02:29:36.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.613+0000 7fef0b75e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef041590b0 con 0x7fef04156350 2023-10-06T02:29:36.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.613+0000 7fef09cfb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef04156720 0x7fef0415ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:36.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.613+0000 7fef09cfb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef04156720 0x7fef0415ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42148/0 (socket says 172.21.15.6:42148) 2023-10-06T02:29:36.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.613+0000 7fef09cfb700 1 -- 172.21.15.6:0/1736108360 learned_addr learned my addr 172.21.15.6:0/1736108360 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:36.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.613+0000 7fef08cf9700 1 --2- 172.21.15.6:0/1736108360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef04156350 0x7fef0415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:36.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.613+0000 7fef094fa700 1 --2- 172.21.15.6:0/1736108360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef040ae260 0x7fef04158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:36.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.613+0000 7fef09cfb700 1 -- 172.21.15.6:0/1736108360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef04156350 msgr2=0x7fef0415b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:36.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.613+0000 7fef09cfb700 1 --2- 172.21.15.6:0/1736108360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef04156350 0x7fef0415b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.613+0000 7fef09cfb700 1 -- 172.21.15.6:0/1736108360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef040ae260 msgr2=0x7fef04158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:36.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.613+0000 7fef09cfb700 1 --2- 172.21.15.6:0/1736108360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef040ae260 0x7fef04158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:36.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.614+0000 7fef09cfb700 1 -- 172.21.15.6:0/1736108360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc009420 con 0x7fef04156720 2023-10-06T02:29:36.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.614+0000 7fef094fa700 1 --2- 172.21.15.6:0/1736108360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef040ae260 0x7fef04158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.614+0000 7fef09cfb700 1 --2- 172.21.15.6:0/1736108360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef04156720 0x7fef0415ba70 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7feef400c910 tx=0x7feef4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.614+0000 7fef017fa700 1 -- 172.21.15.6:0/1736108360 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef4012630 con 0x7fef04156720 2023-10-06T02:29:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.614+0000 7fef017fa700 1 -- 172.21.15.6:0/1736108360 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef40127b0 con 0x7fef04156720 2023-10-06T02:29:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.614+0000 7fef0b75e700 1 -- 172.21.15.6:0/1736108360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef04159390 con 0x7fef04156720 2023-10-06T02:29:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.614+0000 7fef017fa700 1 -- 172.21.15.6:0/1736108360 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef4012b70 con 0x7fef04156720 2023-10-06T02:29:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.614+0000 7fef0b75e700 1 -- 172.21.15.6:0/1736108360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef04158c50 con 0x7fef04156720 2023-10-06T02:29:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.615+0000 7fef0b75e700 1 -- 172.21.15.6:0/1736108360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef0406fcb0 con 0x7fef04156720 2023-10-06T02:29:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.615+0000 7fef017fa700 1 -- 172.21.15.6:0/1736108360 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feef401b400 con 0x7fef04156720 2023-10-06T02:29:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.616+0000 7fef017fa700 1 --2- 172.21.15.6:0/1736108360 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feef0066f30 0x7feef00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:36.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.616+0000 7fef017fa700 1 -- 172.21.15.6:0/1736108360 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 9646+0+0 (secure 0 0 0) 0x7feef40858d0 con 0x7fef04156720 2023-10-06T02:29:36.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.616+0000 7fef094fa700 1 --2- 172.21.15.6:0/1736108360 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feef0066f30 0x7feef00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:36.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.616+0000 7fef094fa700 1 --2- 172.21.15.6:0/1736108360 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feef0066f30 0x7feef00693e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7feefc0093f0 tx=0x7feefc016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:36.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.620+0000 7fef017fa700 1 -- 172.21.15.6:0/1736108360 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feef4051b40 con 0x7fef04156720 2023-10-06T02:29:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:36.858+0000 7fef0b75e700 1 -- 172.21.15.6:0/1736108360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fef040ae7f0 con 0x7fef04156720 2023-10-06T02:29:37.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.124+0000 7fef017fa700 1 -- 172.21.15.6:0/1736108360 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v337) v1 ==== 161+0+0 (secure 0 0 0) 0x7feef4016090 con 0x7fef04156720 2023-10-06T02:29:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.127+0000 7fef0b75e700 1 -- 172.21.15.6:0/1736108360 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feef0066f30 msgr2=0x7feef00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.127+0000 7fef0b75e700 1 --2- 172.21.15.6:0/1736108360 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feef0066f30 0x7feef00693e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7feefc0093f0 tx=0x7feefc016000 comp rx=0 tx=0).stop 2023-10-06T02:29:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.127+0000 7fef0b75e700 1 -- 172.21.15.6:0/1736108360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef04156720 msgr2=0x7fef0415ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.127+0000 7fef0b75e700 1 --2- 172.21.15.6:0/1736108360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef04156720 0x7fef0415ba70 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7feef400c910 tx=0x7feef4007f90 comp rx=0 tx=0).stop 2023-10-06T02:29:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.127+0000 7fef0b75e700 1 -- 172.21.15.6:0/1736108360 shutdown_connections 2023-10-06T02:29:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.127+0000 7fef0b75e700 1 --2- 172.21.15.6:0/1736108360 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7feef0066f30 0x7feef00693e0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.127+0000 7fef0b75e700 1 --2- 172.21.15.6:0/1736108360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef04156720 0x7fef0415ba70 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.127+0000 7fef0b75e700 1 --2- 172.21.15.6:0/1736108360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef040ae260 0x7fef04158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.127+0000 7fef0b75e700 1 --2- 172.21.15.6:0/1736108360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef04156350 0x7fef0415b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.127+0000 7fef0b75e700 1 -- 172.21.15.6:0/1736108360 >> 172.21.15.6:0/1736108360 conn(0x7fef04069110 msgr2=0x7fef040cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.127+0000 7fef0b75e700 1 -- 172.21.15.6:0/1736108360 shutdown_connections 2023-10-06T02:29:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.127+0000 7fef0b75e700 1 -- 172.21.15.6:0/1736108360 wait complete. 2023-10-06T02:29:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:29:37.140 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:29:37.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.260+0000 7f9469f5c700 1 Processor -- start 2023-10-06T02:29:37.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.260+0000 7f9469f5c700 1 -- start start 2023-10-06T02:29:37.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.261+0000 7f9469f5c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9464159400 0x7f94640ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:37.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.261+0000 7f9469f5c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94640b3560 con 0x7f94640cd030 2023-10-06T02:29:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.261+0000 7f9469f5c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94640cf6f0 con 0x7f94640d05d0 2023-10-06T02:29:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.261+0000 7f9469f5c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94640cf9d0 con 0x7f9464159400 2023-10-06T02:29:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.261+0000 7f9468f5a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9464159400 0x7f94640ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.261+0000 7f9468f5a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9464159400 0x7f94640ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42160/0 (socket says 172.21.15.6:42160) 2023-10-06T02:29:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.261+0000 7f9468f5a700 1 -- 172.21.15.6:0/174889608 learned_addr learned my addr 172.21.15.6:0/174889608 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.262+0000 7f9468f5a700 1 -- 172.21.15.6:0/174889608 >> v1:172.21.15.175:6789/0 conn(0x7f94640d05d0 legacy=0x7f94640b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.262+0000 7f9468f5a700 1 -- 172.21.15.6:0/174889608 >> v1:172.21.15.6:6789/0 conn(0x7f94640cd030 legacy=0x7f94640cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.262+0000 7f9468f5a700 1 -- 172.21.15.6:0/174889608 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94640b2f10 con 0x7f9464159400 2023-10-06T02:29:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.262+0000 7f94637fe700 1 -- 172.21.15.6:0/174889608 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987591715 0 0) 0x7f94640b3560 con 0x7f94640cd030 2023-10-06T02:29:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.262+0000 7f9468f5a700 1 --2- 172.21.15.6:0/174889608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9464159400 0x7f94640ccaf0 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f9454009990 tx=0x7f9454009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d380a7bffb8cc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.262+0000 7f94637fe700 1 -- 172.21.15.6:0/174889608 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9454005c10 con 0x7f9464159400 2023-10-06T02:29:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.262+0000 7f94637fe700 1 -- 172.21.15.6:0/174889608 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9454005d70 con 0x7f9464159400 2023-10-06T02:29:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.262+0000 7f94637fe700 1 -- 172.21.15.6:0/174889608 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945400b860 con 0x7f9464159400 2023-10-06T02:29:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.262+0000 7f9469f5c700 1 -- 172.21.15.6:0/174889608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9464159400 msgr2=0x7f94640ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.262+0000 7f9469f5c700 1 --2- 172.21.15.6:0/174889608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9464159400 0x7f94640ccaf0 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f9454009990 tx=0x7f9454009220 comp rx=0 tx=0).stop 2023-10-06T02:29:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.262+0000 7f9469f5c700 1 -- 172.21.15.6:0/174889608 shutdown_connections 2023-10-06T02:29:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.262+0000 7f9469f5c700 1 --2- 172.21.15.6:0/174889608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9464159400 0x7f94640ccaf0 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.262+0000 7f9469f5c700 1 -- 172.21.15.6:0/174889608 >> 172.21.15.6:0/174889608 conn(0x7f946406ac10 msgr2=0x7f9464068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.262+0000 7f9469f5c700 1 -- 172.21.15.6:0/174889608 shutdown_connections 2023-10-06T02:29:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.263+0000 7f9469f5c700 1 -- 172.21.15.6:0/174889608 wait complete. 2023-10-06T02:29:37.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.264+0000 7f9469f5c700 1 Processor -- start 2023-10-06T02:29:37.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.264+0000 7f9469f5c700 1 -- start start 2023-10-06T02:29:37.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.264+0000 7f9469f5c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94640cd030 0x7f9464159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:37.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.264+0000 7f9469f5c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94640d05d0 0x7f9464143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:37.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.264+0000 7f9469f5c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9464159400 0x7f946415a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:37.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.264+0000 7f9469f5c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9464169ed0 con 0x7f94640d05d0 2023-10-06T02:29:37.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.264+0000 7f9469f5c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946415a4a0 con 0x7f94640cd030 2023-10-06T02:29:37.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.264+0000 7f9469f5c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946416d960 con 0x7f9464159400 2023-10-06T02:29:37.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.265+0000 7f9463fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94640d05d0 0x7f9464143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:37.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.265+0000 7f9463fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94640d05d0 0x7f9464143a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42176/0 (socket says 172.21.15.6:42176) 2023-10-06T02:29:37.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.265+0000 7f9463fff700 1 -- 172.21.15.6:0/2664431790 learned_addr learned my addr 172.21.15.6:0/2664431790 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:37.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.265+0000 7f946975b700 1 --2- 172.21.15.6:0/2664431790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9464159400 0x7f946415a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:37.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.265+0000 7f9468f5a700 1 --2- 172.21.15.6:0/2664431790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94640cd030 0x7f9464159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:37.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.265+0000 7f9463fff700 1 -- 172.21.15.6:0/2664431790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9464159400 msgr2=0x7f946415a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:37.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.265+0000 7f9463fff700 1 --2- 172.21.15.6:0/2664431790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9464159400 0x7f946415a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:37.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.265+0000 7f9463fff700 1 -- 172.21.15.6:0/2664431790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94640cd030 msgr2=0x7f9464159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:37.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.265+0000 7f9463fff700 1 --2- 172.21.15.6:0/2664431790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94640cd030 0x7f9464159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:37.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.265+0000 7f9463fff700 1 -- 172.21.15.6:0/2664431790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9454009480 con 0x7f94640d05d0 2023-10-06T02:29:37.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.265+0000 7f9463fff700 1 --2- 172.21.15.6:0/2664431790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94640d05d0 0x7f9464143a10 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7f945800c7e0 tx=0x7f9458007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:37.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.265+0000 7f9460ff9700 1 -- 172.21.15.6:0/2664431790 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458011590 con 0x7f94640d05d0 2023-10-06T02:29:37.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.265+0000 7f9460ff9700 1 -- 172.21.15.6:0/2664431790 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94580116f0 con 0x7f94640d05d0 2023-10-06T02:29:37.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.265+0000 7f9469f5c700 1 -- 172.21.15.6:0/2664431790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f946416dc40 con 0x7f94640d05d0 2023-10-06T02:29:37.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.265+0000 7f9460ff9700 1 -- 172.21.15.6:0/2664431790 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458011ab0 con 0x7f94640d05d0 2023-10-06T02:29:37.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.265+0000 7f9469f5c700 1 -- 172.21.15.6:0/2664431790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f946416e200 con 0x7f94640d05d0 2023-10-06T02:29:37.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.266+0000 7f9469f5c700 1 -- 172.21.15.6:0/2664431790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946416a0d0 con 0x7f94640d05d0 2023-10-06T02:29:37.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.267+0000 7f9460ff9700 1 -- 172.21.15.6:0/2664431790 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f945801b3b0 con 0x7f94640d05d0 2023-10-06T02:29:37.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.267+0000 7f9460ff9700 1 --2- 172.21.15.6:0/2664431790 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9450066f30 0x7f94500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:37.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.267+0000 7f9460ff9700 1 -- 172.21.15.6:0/2664431790 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 9646+0+0 (secure 0 0 0) 0x7f9458084a70 con 0x7f94640d05d0 2023-10-06T02:29:37.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.267+0000 7f9468f5a700 1 --2- 172.21.15.6:0/2664431790 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9450066f30 0x7f94500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:37.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.268+0000 7f9468f5a700 1 --2- 172.21.15.6:0/2664431790 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9450066f30 0x7f94500693e0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9454009260 tx=0x7f9454016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:37.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.271+0000 7f9460ff9700 1 -- 172.21.15.6:0/2664431790 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f946416a0d0 con 0x7f94640d05d0 2023-10-06T02:29:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:37.546+0000 7f9469f5c700 1 -- 172.21.15.6:0/2664431790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f946416a0a0 con 0x7f94640d05d0 2023-10-06T02:29:38.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.132+0000 7f9460ff9700 1 -- 172.21.15.6:0/2664431790 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v338) v1 ==== 101+0+0 (secure 0 0 0) 0x7f9458017030 con 0x7f94640d05d0 2023-10-06T02:29:38.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.135+0000 7f9469f5c700 1 -- 172.21.15.6:0/2664431790 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9450066f30 msgr2=0x7f94500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.135+0000 7f9469f5c700 1 --2- 172.21.15.6:0/2664431790 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9450066f30 0x7f94500693e0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9454009260 tx=0x7f9454016000 comp rx=0 tx=0).stop 2023-10-06T02:29:38.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.135+0000 7f9469f5c700 1 -- 172.21.15.6:0/2664431790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94640d05d0 msgr2=0x7f9464143a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.135+0000 7f9469f5c700 1 --2- 172.21.15.6:0/2664431790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94640d05d0 0x7f9464143a10 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7f945800c7e0 tx=0x7f9458007da0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.135+0000 7f9469f5c700 1 -- 172.21.15.6:0/2664431790 shutdown_connections 2023-10-06T02:29:38.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.135+0000 7f9469f5c700 1 --2- 172.21.15.6:0/2664431790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9464159400 0x7f946415a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.135+0000 7f9469f5c700 1 --2- 172.21.15.6:0/2664431790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94640cd030 0x7f9464159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.135+0000 7f9469f5c700 1 --2- 172.21.15.6:0/2664431790 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9450066f30 0x7f94500693e0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.135+0000 7f9469f5c700 1 --2- 172.21.15.6:0/2664431790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94640d05d0 0x7f9464143a10 unknown :-1 s=CLOSED pgs=2281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.135+0000 7f9469f5c700 1 -- 172.21.15.6:0/2664431790 >> 172.21.15.6:0/2664431790 conn(0x7f946406ac10 msgr2=0x7f9464154e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:38.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.135+0000 7f9469f5c700 1 -- 172.21.15.6:0/2664431790 shutdown_connections 2023-10-06T02:29:38.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.135+0000 7f9469f5c700 1 -- 172.21.15.6:0/2664431790 wait complete. 2023-10-06T02:29:38.139 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:29:38.151 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:29:38.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.192+0000 7f5cf79a1000 1 Processor -- start 2023-10-06T02:29:38.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.192+0000 7f5cf79a1000 1 -- start start 2023-10-06T02:29:38.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.192+0000 7f5cf79a1000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586d07d6160 0x5586d081c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.192+0000 7f5cf79a1000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586d08978b0 0x5586d0893de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cf79a1000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5586d0897c80 0x5586d0894320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cf79a1000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586d0722980 con 0x5586d08978b0 2023-10-06T02:29:38.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cf79a1000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586d0722620 con 0x5586d07d6160 2023-10-06T02:29:38.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cf79a1000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586d0719400 con 0x5586d0897c80 2023-10-06T02:29:38.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cf03db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586d08978b0 0x5586d0893de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cf03db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586d08978b0 0x5586d0893de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42178/0 (socket says 172.21.15.6:42178) 2023-10-06T02:29:38.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cf03db700 1 -- 172.21.15.6:0/4004877560 learned_addr learned my addr 172.21.15.6:0/4004877560 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:38.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cf0bdc700 1 --2- 172.21.15.6:0/4004877560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586d07d6160 0x5586d081c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cf13dd700 1 --2- 172.21.15.6:0/4004877560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5586d0897c80 0x5586d0894320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cf03db700 1 -- 172.21.15.6:0/4004877560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5586d0897c80 msgr2=0x5586d0894320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:38.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cf03db700 1 --2- 172.21.15.6:0/4004877560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5586d0897c80 0x5586d0894320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cf03db700 1 -- 172.21.15.6:0/4004877560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586d07d6160 msgr2=0x5586d081c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:38.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cf03db700 1 --2- 172.21.15.6:0/4004877560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586d07d6160 0x5586d081c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cf03db700 1 -- 172.21.15.6:0/4004877560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce4005cf0 con 0x5586d08978b0 2023-10-06T02:29:38.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cf13dd700 1 --2- 172.21.15.6:0/4004877560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5586d0897c80 0x5586d0894320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:38.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cf03db700 1 --2- 172.21.15.6:0/4004877560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586d08978b0 0x5586d0893de0 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40099b0 tx=0x7f5ce400c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a252d16fcd1f4c6c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:38.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cef3d9700 1 -- 172.21.15.6:0/4004877560 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce400f040 con 0x5586d08978b0 2023-10-06T02:29:38.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cef3d9700 1 -- 172.21.15.6:0/4004877560 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce4008b50 con 0x5586d08978b0 2023-10-06T02:29:38.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.193+0000 7f5cef3d9700 1 -- 172.21.15.6:0/4004877560 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4013420 con 0x5586d08978b0 2023-10-06T02:29:38.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.194+0000 7f5cf79a1000 1 -- 172.21.15.6:0/4004877560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586d08978b0 msgr2=0x5586d0893de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.194+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/4004877560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586d08978b0 0x5586d0893de0 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40099b0 tx=0x7f5ce400c040 comp rx=0 tx=0).stop 2023-10-06T02:29:38.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.194+0000 7f5cf79a1000 1 -- 172.21.15.6:0/4004877560 shutdown_connections 2023-10-06T02:29:38.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.194+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/4004877560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5586d0897c80 0x5586d0894320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.194+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/4004877560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586d07d6160 0x5586d081c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.194+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/4004877560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586d08978b0 0x5586d0893de0 unknown :-1 s=CLOSED pgs=2282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.194+0000 7f5cf79a1000 1 -- 172.21.15.6:0/4004877560 >> 172.21.15.6:0/4004877560 conn(0x5586d081ebd0 msgr2=0x5586d0806b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:38.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.194+0000 7f5cf79a1000 1 -- 172.21.15.6:0/4004877560 shutdown_connections 2023-10-06T02:29:38.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.194+0000 7f5cf79a1000 1 -- 172.21.15.6:0/4004877560 wait complete. 2023-10-06T02:29:38.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.195+0000 7f5cf79a1000 1 Processor -- start 2023-10-06T02:29:38.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.195+0000 7f5cf79a1000 1 -- start start 2023-10-06T02:29:38.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.195+0000 7f5cf79a1000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5586d07d6160 0x5586d08932d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.195+0000 7f5cf79a1000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586d08978b0 0x5586d08af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.195+0000 7f5cf79a1000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586d0897c80 0x5586d08afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.195+0000 7f5cf79a1000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586d08abb10 con 0x5586d0897c80 2023-10-06T02:29:38.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.195+0000 7f5cf79a1000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586d08abdb0 con 0x5586d08978b0 2023-10-06T02:29:38.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.195+0000 7f5cf79a1000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586d08ac050 con 0x5586d07d6160 2023-10-06T02:29:38.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.195+0000 7f5cf13dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586d0897c80 0x5586d08afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.196+0000 7f5cf13dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586d0897c80 0x5586d08afdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42190/0 (socket says 172.21.15.6:42190) 2023-10-06T02:29:38.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.196+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 learned_addr learned my addr 172.21.15.6:0/465761876 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:38.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.196+0000 7f5cf0bdc700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5586d07d6160 0x5586d08932d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.196+0000 7f5cf03db700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586d08978b0 0x5586d08af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.196+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5586d07d6160 msgr2=0x5586d08932d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.196+0000 7f5cf13dd700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5586d07d6160 0x5586d08932d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.196+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586d08978b0 msgr2=0x5586d08af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.196+0000 7f5cf13dd700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586d08978b0 0x5586d08af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.196+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce40095e0 con 0x5586d0897c80 2023-10-06T02:29:38.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.196+0000 7f5cf13dd700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586d0897c80 0x5586d08afdf0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000c250 tx=0x7f5ce0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:38.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.196+0000 7f5cedbd6700 1 -- 172.21.15.6:0/465761876 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce000cbc0 con 0x5586d0897c80 2023-10-06T02:29:38.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.196+0000 7f5cedbd6700 1 -- 172.21.15.6:0/465761876 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce000cd20 con 0x5586d0897c80 2023-10-06T02:29:38.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.196+0000 7f5cedbd6700 1 -- 172.21.15.6:0/465761876 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0003680 con 0x5586d0897c80 2023-10-06T02:29:38.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.196+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce8005cf0 con 0x5586d0897c80 2023-10-06T02:29:38.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.196+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5586d07313d0 con 0x5586d0897c80 2023-10-06T02:29:38.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.198+0000 7f5cedbd6700 1 -- 172.21.15.6:0/465761876 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ce0003a70 con 0x5586d0897c80 2023-10-06T02:29:38.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.198+0000 7f5cedbd6700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5cdc065890 0x7f5cdc067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.198+0000 7f5cedbd6700 1 -- 172.21.15.6:0/465761876 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 9646+0+0 (secure 0 0 0) 0x7f5ce0083880 con 0x5586d0897c80 2023-10-06T02:29:38.203 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:29:38.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.198+0000 7f5cf0bdc700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5cdc065890 0x7f5cdc067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.198+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5586d0893810 0x5586d08bb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.198+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d07c2840 con 0x5586d0893810 2023-10-06T02:29:38.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.198+0000 7f5cf03db700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5586d0893810 0x5586d08bb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.199+0000 7f5cf03db700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5586d0893810 0x5586d08bb980 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:38.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.199+0000 7f5cf0bdc700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5cdc065890 0x7f5cdc067d40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800a520 tx=0x7f5ce8016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:38.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.201+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v133'1159 uv1133 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.201+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d081d180 con 0x5586d0893810 2023-10-06T02:29:38.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.202+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v133'1160 uv1160 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.202+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08bbec0 con 0x5586d0893810 2023-10-06T02:29:38.206 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:29:38.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.204+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v133'1161 uv1161 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.204+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cc440 con 0x5586d0893810 2023-10-06T02:29:38.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.205+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v133'1162 uv1162 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.205+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cc7f0 con 0x5586d0893810 2023-10-06T02:29:38.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.206+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v133'1163 uv1163 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.206+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cb430 con 0x5586d0893810 2023-10-06T02:29:38.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.208+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v133'1164 uv1164 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.208+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cb810 con 0x5586d0893810 2023-10-06T02:29:38.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.209+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v133'1165 uv1139 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.209+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cb810 con 0x5586d0893810 2023-10-06T02:29:38.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.211+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v133'1166 uv1166 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.211+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cb810 con 0x5586d0893810 2023-10-06T02:29:38.212 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:29:38.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.212+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v133'1167 uv1167 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.212+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cb7e0 con 0x5586d0893810 2023-10-06T02:29:38.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.213+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v133'1168 uv1168 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.213+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cb7e0 con 0x5586d0893810 2023-10-06T02:29:38.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.214+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v133'1169 uv1169 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.214+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cb7e0 con 0x5586d0893810 2023-10-06T02:29:38.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.216+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v133'1170 uv1170 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.216+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cb7e0 con 0x5586d0893810 2023-10-06T02:29:38.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.217+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v133'1171 uv1146 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.217+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cb7e0 con 0x5586d0893810 2023-10-06T02:29:38.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.218+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v133'1172 uv1172 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.218+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cb7e0 con 0x5586d0893810 2023-10-06T02:29:38.220 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:29:38.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.220+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v133'1173 uv1173 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.220+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cb7e0 con 0x5586d0893810 2023-10-06T02:29:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.221+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v133'1174 uv1174 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.221+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cb7e0 con 0x5586d0893810 2023-10-06T02:29:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.223+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v133'1175 uv1175 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.223+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cb7e0 con 0x5586d0893810 2023-10-06T02:29:38.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.224+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v133'1176 uv1176 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.224+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08ccba0 con 0x5586d0893810 2023-10-06T02:29:38.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.225+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v133'1177 uv1177 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.225+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08ccba0 con 0x5586d0893810 2023-10-06T02:29:38.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.227+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v133'1178 uv1152 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.227+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cbf40 con 0x5586d0893810 2023-10-06T02:29:38.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.228+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v133'1179 uv1179 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.228+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cbf40 con 0x5586d0893810 2023-10-06T02:29:38.229 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:29:38.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.229+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v133'1180 uv1180 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.229+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cbf40 con 0x5586d0893810 2023-10-06T02:29:38.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.230+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v133'1181 uv1181 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.230+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cbf40 con 0x5586d0893810 2023-10-06T02:29:38.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.232+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v133'1182 uv1182 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.232+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cbf40 con 0x5586d0893810 2023-10-06T02:29:38.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.233+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v133'1183 uv1183 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.233+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cbf40 con 0x5586d0893810 2023-10-06T02:29:38.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.234+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v133'1184 uv1158 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.234+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cbf40 con 0x5586d0893810 2023-10-06T02:29:38.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.236+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v133'1185 uv1185 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.236+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cbf40 con 0x5586d0893810 2023-10-06T02:29:38.237 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:29:38.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.237+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v133'1186 uv1186 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.237+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cbf40 con 0x5586d0893810 2023-10-06T02:29:38.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.238+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v133'1187 uv1187 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.238+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cbf40 con 0x5586d0893810 2023-10-06T02:29:38.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.239+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v133'1188 uv1188 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.239+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cbf40 con 0x5586d0893810 2023-10-06T02:29:38.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.241+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v133'1189 uv1189 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d0893810 2023-10-06T02:29:38.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.241+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5586d08cbf40 0x5586d08cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.241+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cf600 con 0x5586d08cbf40 2023-10-06T02:29:38.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.241+0000 7f5cf0bdc700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5586d08cbf40 0x5586d08cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.241+0000 7f5cf0bdc700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5586d08cbf40 0x5586d08cf0c0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:38.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.243+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v133'835 uv817 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.243+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cf9b0 con 0x5586d08cbf40 2023-10-06T02:29:38.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.244+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v133'836 uv836 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.244+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08cfd60 con 0x5586d08cbf40 2023-10-06T02:29:38.246 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:29:38.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.246+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v133'837 uv837 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.246+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d0600 con 0x5586d08cbf40 2023-10-06T02:29:38.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.247+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v133'838 uv838 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.247+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d09b0 con 0x5586d08cbf40 2023-10-06T02:29:38.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.248+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v133'839 uv839 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.248+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d0d60 con 0x5586d08cbf40 2023-10-06T02:29:38.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.250+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v133'840 uv822 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.250+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d1110 con 0x5586d08cbf40 2023-10-06T02:29:38.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.251+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v133'841 uv841 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.251+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d14c0 con 0x5586d08cbf40 2023-10-06T02:29:38.252 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:29:38.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.252+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v133'842 uv842 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.252+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d14c0 con 0x5586d08cbf40 2023-10-06T02:29:38.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.253+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v133'843 uv843 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.253+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d14c0 con 0x5586d08cbf40 2023-10-06T02:29:38.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.255+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v133'844 uv844 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.255+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d14c0 con 0x5586d08cbf40 2023-10-06T02:29:38.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.256+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v133'845 uv827 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.256+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d14c0 con 0x5586d08cbf40 2023-10-06T02:29:38.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.257+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v133'846 uv846 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.257+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d14c0 con 0x5586d08cbf40 2023-10-06T02:29:38.258 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:29:38.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.258+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v133'847 uv847 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.258+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d4be0 con 0x5586d08cbf40 2023-10-06T02:29:38.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.260+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v133'848 uv848 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.260+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d4be0 con 0x5586d08cbf40 2023-10-06T02:29:38.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.261+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v133'849 uv849 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.261+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d14c0 con 0x5586d08cbf40 2023-10-06T02:29:38.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.262+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v133'850 uv833 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.262+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d14c0 con 0x5586d08cbf40 2023-10-06T02:29:38.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.263+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v133'851 uv851 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.263+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d14c0 con 0x5586d08cbf40 2023-10-06T02:29:38.264 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:29:38.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.264+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v133'852 uv852 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.264+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d24d0 con 0x5586d08cbf40 2023-10-06T02:29:38.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.265+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v133'853 uv853 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.265+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d24d0 con 0x5586d08cbf40 2023-10-06T02:29:38.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.266+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v133'854 uv854 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.266+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d14c0 con 0x5586d08cbf40 2023-10-06T02:29:38.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.267+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v133'855 uv855 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.267+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5586d08d19d0 0x5586d08d3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.267+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d42f0 con 0x5586d08d19d0 2023-10-06T02:29:38.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.267+0000 7f5cf03db700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5586d08d19d0 0x5586d08d3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.268+0000 7f5cf03db700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5586d08d19d0 0x5586d08d3db0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:38.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.269+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v133'225 uv224 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.269+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d42f0 con 0x5586d08d19d0 2023-10-06T02:29:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.270+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v133'226 uv226 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.270+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d42f0 con 0x5586d08d19d0 2023-10-06T02:29:38.271 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:29:38.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.271+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v133'227 uv227 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.271+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d5300 con 0x5586d08d19d0 2023-10-06T02:29:38.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.272+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v133'228 uv228 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.272+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d5300 con 0x5586d08d19d0 2023-10-06T02:29:38.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.273+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v133'229 uv229 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.273+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d42f0 con 0x5586d08d19d0 2023-10-06T02:29:38.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.274+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v133'230 uv230 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.274+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d42f0 con 0x5586d08d19d0 2023-10-06T02:29:38.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.275+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v133'163 uv162 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.275+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d42f0 con 0x5586d08d19d0 2023-10-06T02:29:38.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.276+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v133'164 uv164 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.276+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d42f0 con 0x5586d08d19d0 2023-10-06T02:29:38.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.277+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v133'165 uv165 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.278 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:29:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.277+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d42f0 con 0x5586d08d19d0 2023-10-06T02:29:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.278+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v133'166 uv166 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.278+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d42f0 con 0x5586d08cbf40 2023-10-06T02:29:38.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.279+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v133'225 uv224 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.279+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d42f0 con 0x5586d08cbf40 2023-10-06T02:29:38.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.280+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v133'226 uv226 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.280+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d42f0 con 0x5586d08cbf40 2023-10-06T02:29:38.282 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:29:38.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.282+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v133'227 uv227 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.282+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d42f0 con 0x5586d08cbf40 2023-10-06T02:29:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.283+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v133'228 uv228 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.283+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d42f0 con 0x5586d08cbf40 2023-10-06T02:29:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.283+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v133'229 uv229 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.284+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d42f0 con 0x5586d08cbf40 2023-10-06T02:29:38.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.285+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v133'230 uv230 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08cbf40 2023-10-06T02:29:38.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.285+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5586d08d4c00 0x5586d08d6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.285+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d7520 con 0x5586d08d4c00 2023-10-06T02:29:38.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.285+0000 7f5cf13dd700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5586d08d4c00 0x5586d08d6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.285+0000 7f5cf13dd700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5586d08d4c00 0x5586d08d6fe0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.286+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v133'415 uv409 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08d4c00 2023-10-06T02:29:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.286+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d78d0 con 0x5586d08d4c00 2023-10-06T02:29:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.287+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v133'416 uv416 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08d4c00 2023-10-06T02:29:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.287+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d7cc0 con 0x5586d08d4c00 2023-10-06T02:29:38.289 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:29:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.289+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v133'417 uv417 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08d4c00 2023-10-06T02:29:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.289+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d95c0 con 0x5586d08d4c00 2023-10-06T02:29:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.290+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v133'418 uv418 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08d4c00 2023-10-06T02:29:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.290+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d9970 con 0x5586d08d4c00 2023-10-06T02:29:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.291+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v133'419 uv419 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08d4c00 2023-10-06T02:29:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.291+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d85b0 con 0x5586d08d4c00 2023-10-06T02:29:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.292+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v133'420 uv420 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08d4c00 2023-10-06T02:29:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.292+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d89b0 con 0x5586d08d4c00 2023-10-06T02:29:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.293+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v133'421 uv414 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08d4c00 2023-10-06T02:29:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.293+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d8db0 con 0x5586d08d4c00 2023-10-06T02:29:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.294+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v133'422 uv422 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08d4c00 2023-10-06T02:29:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.294+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d8db0 con 0x5586d08d4c00 2023-10-06T02:29:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.295+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v133'423 uv423 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08d4c00 2023-10-06T02:29:38.296 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:29:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.295+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d8d60 con 0x5586d08d4c00 2023-10-06T02:29:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.297+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v133'424 uv424 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08d4c00 2023-10-06T02:29:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.297+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08d8d60 con 0x5586d08d4c00 2023-10-06T02:29:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.298+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v133'425 uv425 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08d4c00 2023-10-06T02:29:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.298+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5586d08d9160 0x5586d08dc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.298+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08dc780 con 0x5586d08d9160 2023-10-06T02:29:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.298+0000 7f5cf0bdc700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5586d08d9160 0x5586d08dc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.299+0000 7f5cf0bdc700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5586d08d9160 0x5586d08dc240 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:38.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.300+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v133'188 uv187 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08d9160 2023-10-06T02:29:38.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.300+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08dc780 con 0x5586d08d9160 2023-10-06T02:29:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.301+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v133'189 uv189 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08d9160 2023-10-06T02:29:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.301+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08dcbb0 con 0x5586d08d9160 2023-10-06T02:29:38.302 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:29:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.302+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v133'190 uv190 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08d9160 2023-10-06T02:29:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.302+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08dcbb0 con 0x5586d08d9160 2023-10-06T02:29:38.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.304+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v133'191 uv191 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08d9160 2023-10-06T02:29:38.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.304+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08dcbb0 con 0x5586d08d9160 2023-10-06T02:29:38.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.305+0000 7f5cf0bdc700 1 -- 172.21.15.6:0/465761876 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v133'192 uv192 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ce802b4c0 con 0x5586d08d9160 2023-10-06T02:29:38.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.305+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08dcbb0 con 0x5586d08d19d0 2023-10-06T02:29:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.306+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v133'225 uv224 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.306+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08dcbb0 con 0x5586d08d19d0 2023-10-06T02:29:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.307+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v133'226 uv226 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.307+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08dcbb0 con 0x5586d08d19d0 2023-10-06T02:29:38.308 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:29:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.308+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v133'227 uv227 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.308+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08ddbc0 con 0x5586d08d19d0 2023-10-06T02:29:38.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.309+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v133'228 uv228 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.309+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08ddbc0 con 0x5586d08d19d0 2023-10-06T02:29:38.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.313+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v133'229 uv229 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.313+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08dcbb0 con 0x5586d08d19d0 2023-10-06T02:29:38.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.314+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v133'230 uv230 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.314+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5586d08dd230 0x5586d08df610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.314+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08dfb90 con 0x5586d08dd230 2023-10-06T02:29:38.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.314+0000 7f5cf03db700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5586d08dd230 0x5586d08df610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.314+0000 7f5cf03db700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5586d08dd230 0x5586d08df610 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.316+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v133'376 uv369 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08dd230 2023-10-06T02:29:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.316+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08dfc70 con 0x5586d08dd230 2023-10-06T02:29:38.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.317+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v133'377 uv377 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08dd230 2023-10-06T02:29:38.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.317+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e00a0 con 0x5586d08dd230 2023-10-06T02:29:38.318 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:29:38.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.318+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v133'378 uv378 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08dd230 2023-10-06T02:29:38.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.318+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e00a0 con 0x5586d08dd230 2023-10-06T02:29:38.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.319+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v133'379 uv379 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08dd230 2023-10-06T02:29:38.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.319+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e00a0 con 0x5586d08dd230 2023-10-06T02:29:38.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.320+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v133'380 uv380 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08dd230 2023-10-06T02:29:38.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.320+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e00a0 con 0x5586d08dd230 2023-10-06T02:29:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.321+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v133'381 uv375 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08dd230 2023-10-06T02:29:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.321+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e00a0 con 0x5586d08dd230 2023-10-06T02:29:38.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.322+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v133'382 uv382 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08dd230 2023-10-06T02:29:38.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.322+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e00a0 con 0x5586d08dd230 2023-10-06T02:29:38.323 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:29:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.323+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v133'383 uv383 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08dd230 2023-10-06T02:29:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.323+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e00a0 con 0x5586d08dd230 2023-10-06T02:29:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.324+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v133'384 uv384 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08dd230 2023-10-06T02:29:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.324+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e2e10 con 0x5586d08dd230 2023-10-06T02:29:38.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.325+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v133'385 uv385 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08dd230 2023-10-06T02:29:38.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.325+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d19d0 2023-10-06T02:29:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.326+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v133'167 uv165 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.326+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d19d0 2023-10-06T02:29:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.327+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v133'168 uv168 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.327+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d19d0 2023-10-06T02:29:38.328 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:29:38.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.328+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v133'169 uv169 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.328+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d19d0 2023-10-06T02:29:38.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.329+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v133'170 uv170 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.329+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5586d08e0ea0 0x5586d08e3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.329+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08e0ea0 2023-10-06T02:29:38.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.329+0000 7f5cf13dd700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5586d08e0ea0 0x5586d08e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.329+0000 7f5cf13dd700 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5586d08e0ea0 0x5586d08e3560 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:38.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.331+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v133'225 uv224 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08e0ea0 2023-10-06T02:29:38.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.331+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08e0ea0 2023-10-06T02:29:38.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.332+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v133'226 uv226 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08e0ea0 2023-10-06T02:29:38.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.332+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08e0ea0 2023-10-06T02:29:38.333 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:29:38.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.333+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v133'227 uv227 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08e0ea0 2023-10-06T02:29:38.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.333+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08e0ea0 2023-10-06T02:29:38.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.334+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v133'228 uv228 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08e0ea0 2023-10-06T02:29:38.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.334+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08e0ea0 2023-10-06T02:29:38.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.335+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v133'229 uv229 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08e0ea0 2023-10-06T02:29:38.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.335+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08e0ea0 2023-10-06T02:29:38.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.336+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v133'230 uv230 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08e0ea0 2023-10-06T02:29:38.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.336+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d4c00 2023-10-06T02:29:38.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.337+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v133'191 uv190 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08d4c00 2023-10-06T02:29:38.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.337+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d4c00 2023-10-06T02:29:38.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.338+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v133'192 uv192 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08d4c00 2023-10-06T02:29:38.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.338+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d4c00 2023-10-06T02:29:38.339 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:29:38.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.339+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v133'193 uv193 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08d4c00 2023-10-06T02:29:38.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.339+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d4c00 2023-10-06T02:29:38.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.340+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v133'194 uv194 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08d4c00 2023-10-06T02:29:38.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.340+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d4c00 2023-10-06T02:29:38.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.341+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v133'195 uv195 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5ce0051c30 con 0x5586d08d4c00 2023-10-06T02:29:38.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.341+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d19d0 2023-10-06T02:29:38.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.342+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v133'468 uv459 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.342+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d19d0 2023-10-06T02:29:38.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.343+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v133'469 uv469 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.343+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d19d0 2023-10-06T02:29:38.345 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:29:38.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.344+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v133'470 uv470 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.344+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d19d0 2023-10-06T02:29:38.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.345+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v133'471 uv471 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.345+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e3aa0 con 0x5586d08d19d0 2023-10-06T02:29:38.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.346+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v133'472 uv472 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.346+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e3aa0 con 0x5586d08d19d0 2023-10-06T02:29:38.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.348+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v133'473 uv466 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.348+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d19d0 2023-10-06T02:29:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.349+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v133'474 uv474 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.349+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d19d0 2023-10-06T02:29:38.350 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:29:38.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.350+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v133'475 uv475 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.350+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d19d0 2023-10-06T02:29:38.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.351+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v133'476 uv476 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.351+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d19d0 2023-10-06T02:29:38.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.352+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v133'477 uv477 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.352+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e0590 con 0x5586d08d19d0 2023-10-06T02:29:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.353+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v133'478 uv478 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.353+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x5586d08e3aa0 con 0x5586d08d19d0 2023-10-06T02:29:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.354+0000 7f5cf03db700 1 -- 172.21.15.6:0/465761876 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v133'479 uv479 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5ce401a040 con 0x5586d08d19d0 2023-10-06T02:29:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.354+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5586d08d19d0 msgr2=0x5586d08d3db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.354+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x5586d08d19d0 0x5586d08d3db0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.354+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5586d0893810 msgr2=0x5586d08bb980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.354+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x5586d0893810 0x5586d08bb980 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.354+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5586d08dd230 msgr2=0x5586d08df610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.354+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x5586d08dd230 0x5586d08df610 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.354+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5586d08cbf40 msgr2=0x5586d08cf0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.354+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x5586d08cbf40 0x5586d08cf0c0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.354+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5586d08e0ea0 msgr2=0x5586d08e3560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.354+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x5586d08e0ea0 0x5586d08e3560 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.354+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 reap_dead start 2023-10-06T02:29:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.355+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5586d08d9160 msgr2=0x5586d08dc240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.355+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x5586d08d9160 0x5586d08dc240 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.355+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5586d08d4c00 msgr2=0x5586d08d6fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.355+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x5586d08d4c00 0x5586d08d6fe0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.355+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5cdc065890 msgr2=0x7f5cdc067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.355+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5cdc065890 0x7f5cdc067d40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800a520 tx=0x7f5ce8016000 comp rx=0 tx=0).stop 2023-10-06T02:29:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.355+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586d0897c80 msgr2=0x5586d08afdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.355+0000 7f5cf79a1000 1 --2- 172.21.15.6:0/465761876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586d0897c80 0x5586d08afdf0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000c250 tx=0x7f5ce0008040 comp rx=0 tx=0).stop 2023-10-06T02:29:38.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.355+0000 7f5cf13dd700 1 -- 172.21.15.6:0/465761876 reap_dead start 2023-10-06T02:29:38.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.355+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 shutdown_connections 2023-10-06T02:29:38.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.355+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 >> 172.21.15.6:0/465761876 conn(0x5586d081ebd0 msgr2=0x5586d07daab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:38.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.355+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 shutdown_connections 2023-10-06T02:29:38.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.355+0000 7f5cf79a1000 1 -- 172.21.15.6:0/465761876 wait complete. 2023-10-06T02:29:38.359 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader mds0_sessionmap deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2023-10-06T02:29:38.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.439+0000 7ff1463a5000 1 Processor -- start 2023-10-06T02:29:38.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.439+0000 7ff1463a5000 1 -- start start 2023-10-06T02:29:38.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff1463a5000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e84d153850 0x55e84d1706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff1463a5000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84d155ab0 0x55e84d124c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff1463a5000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84d155e80 0x55e84d125160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff1463a5000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84d071980 con 0x55e84d155e80 2023-10-06T02:29:38.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff1463a5000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84d071620 con 0x55e84d155ab0 2023-10-06T02:29:38.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff1463a5000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e84d068400 con 0x55e84d153850 2023-10-06T02:29:38.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff13fde1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84d155e80 0x55e84d125160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff13eddf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84d155ab0 0x55e84d124c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff13fde1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84d155e80 0x55e84d125160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42202/0 (socket says 172.21.15.6:42202) 2023-10-06T02:29:38.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff13fde1700 1 -- 172.21.15.6:0/2418172704 learned_addr learned my addr 172.21.15.6:0/2418172704 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:38.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff13f5e0700 1 --2- 172.21.15.6:0/2418172704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e84d153850 0x55e84d1706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff13fde1700 1 -- 172.21.15.6:0/2418172704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e84d153850 msgr2=0x55e84d1706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:38.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff13fde1700 1 --2- 172.21.15.6:0/2418172704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e84d153850 0x55e84d1706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff13fde1700 1 -- 172.21.15.6:0/2418172704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84d155ab0 msgr2=0x55e84d124c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:38.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff13fde1700 1 --2- 172.21.15.6:0/2418172704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84d155ab0 0x55e84d124c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff13fde1700 1 -- 172.21.15.6:0/2418172704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff130005cf0 con 0x55e84d155e80 2023-10-06T02:29:38.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff13fde1700 1 --2- 172.21.15.6:0/2418172704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84d155e80 0x55e84d125160 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x55e84d127300 tx=0x7ff138014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea11595089bbc500 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:38.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff13dddd700 1 -- 172.21.15.6:0/2418172704 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1380032f0 con 0x55e84d155e80 2023-10-06T02:29:38.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff13dddd700 1 -- 172.21.15.6:0/2418172704 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13800ed80 con 0x55e84d155e80 2023-10-06T02:29:38.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.440+0000 7ff13dddd700 1 -- 172.21.15.6:0/2418172704 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13800ea10 con 0x55e84d155e80 2023-10-06T02:29:38.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.441+0000 7ff1463a5000 1 -- 172.21.15.6:0/2418172704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84d155e80 msgr2=0x55e84d125160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.441+0000 7ff1463a5000 1 --2- 172.21.15.6:0/2418172704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84d155e80 0x55e84d125160 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x55e84d127300 tx=0x7ff138014000 comp rx=0 tx=0).stop 2023-10-06T02:29:38.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.441+0000 7ff1463a5000 1 -- 172.21.15.6:0/2418172704 shutdown_connections 2023-10-06T02:29:38.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.441+0000 7ff1463a5000 1 --2- 172.21.15.6:0/2418172704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84d155e80 0x55e84d125160 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.441+0000 7ff1463a5000 1 --2- 172.21.15.6:0/2418172704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e84d153850 0x55e84d1706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.441+0000 7ff1463a5000 1 --2- 172.21.15.6:0/2418172704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84d155ab0 0x55e84d124c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.441+0000 7ff1463a5000 1 -- 172.21.15.6:0/2418172704 >> 172.21.15.6:0/2418172704 conn(0x55e84d16dbd0 msgr2=0x55e84d1282c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:38.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.441+0000 7ff1463a5000 1 -- 172.21.15.6:0/2418172704 shutdown_connections 2023-10-06T02:29:38.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.441+0000 7ff1463a5000 1 -- 172.21.15.6:0/2418172704 wait complete. 2023-10-06T02:29:38.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.441+0000 7ff1463a5000 1 Processor -- start 2023-10-06T02:29:38.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.442+0000 7ff1463a5000 1 -- start start 2023-10-06T02:29:38.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.442+0000 7ff1463a5000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e84d153850 0x55e84d1eba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.442+0000 7ff1463a5000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84d155ab0 0x55e84d206760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.442+0000 7ff1463a5000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84d155e80 0x55e84d205830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.442+0000 7ff1463a5000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84d2065a0 con 0x55e84d155ab0 2023-10-06T02:29:38.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.442+0000 7ff1463a5000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84d1f4d30 con 0x55e84d155e80 2023-10-06T02:29:38.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.442+0000 7ff1463a5000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e84d1ebfb0 con 0x55e84d153850 2023-10-06T02:29:38.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.442+0000 7ff13eddf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84d155ab0 0x55e84d206760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.442+0000 7ff13eddf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84d155ab0 0x55e84d206760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42218/0 (socket says 172.21.15.6:42218) 2023-10-06T02:29:38.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.442+0000 7ff13eddf700 1 -- 172.21.15.6:0/1803709019 learned_addr learned my addr 172.21.15.6:0/1803709019 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:38.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.442+0000 7ff13fde1700 1 --2- 172.21.15.6:0/1803709019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84d155e80 0x55e84d205830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.442+0000 7ff13f5e0700 1 --2- 172.21.15.6:0/1803709019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e84d153850 0x55e84d1eba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.443+0000 7ff13eddf700 1 -- 172.21.15.6:0/1803709019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e84d153850 msgr2=0x55e84d1eba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.443+0000 7ff13eddf700 1 --2- 172.21.15.6:0/1803709019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e84d153850 0x55e84d1eba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.443+0000 7ff13eddf700 1 -- 172.21.15.6:0/1803709019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84d155e80 msgr2=0x55e84d205830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.443+0000 7ff13eddf700 1 --2- 172.21.15.6:0/1803709019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84d155e80 0x55e84d205830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.443+0000 7ff13eddf700 1 -- 172.21.15.6:0/1803709019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e84d09a1c0 con 0x55e84d155ab0 2023-10-06T02:29:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.443+0000 7ff13f5e0700 1 --2- 172.21.15.6:0/1803709019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e84d153850 0x55e84d1eba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.443+0000 7ff13fde1700 1 --2- 172.21.15.6:0/1803709019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84d155e80 0x55e84d205830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.443+0000 7ff13eddf700 1 --2- 172.21.15.6:0/1803709019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84d155ab0 0x55e84d206760 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7ff13400c620 tx=0x7ff134001740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.443+0000 7ff127fff700 1 -- 172.21.15.6:0/1803709019 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134001c20 con 0x55e84d155ab0 2023-10-06T02:29:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.443+0000 7ff127fff700 1 -- 172.21.15.6:0/1803709019 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff134005070 con 0x55e84d155ab0 2023-10-06T02:29:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.443+0000 7ff1463a5000 1 -- 172.21.15.6:0/1803709019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13800a180 con 0x55e84d155ab0 2023-10-06T02:29:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.443+0000 7ff127fff700 1 -- 172.21.15.6:0/1803709019 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134010630 con 0x55e84d155ab0 2023-10-06T02:29:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.443+0000 7ff1463a5000 1 -- 172.21.15.6:0/1803709019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e84d0803d0 con 0x55e84d155ab0 2023-10-06T02:29:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.444+0000 7ff127fff700 1 -- 172.21.15.6:0/1803709019 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1340109e0 con 0x55e84d155ab0 2023-10-06T02:29:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.445+0000 7ff127fff700 1 --2- 172.21.15.6:0/1803709019 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff12c0658c0 0x7ff12c067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.445+0000 7ff127fff700 1 -- 172.21.15.6:0/1803709019 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 9646+0+0 (secure 0 0 0) 0x7ff134008070 con 0x55e84d155ab0 2023-10-06T02:29:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.445+0000 7ff13f5e0700 1 --2- 172.21.15.6:0/1803709019 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff12c0658c0 0x7ff12c067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.445+0000 7ff1463a5000 1 --2- 172.21.15.6:0/1803709019 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e84d151cc0 0x55e84d152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.445+0000 7ff1463a5000 1 -- 172.21.15.6:0/1803709019 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e133) v8 -- 0x55e84d1525d0 con 0x55e84d151cc0 2023-10-06T02:29:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.445+0000 7ff13fde1700 1 --2- 172.21.15.6:0/1803709019 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e84d151cc0 0x55e84d152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.445+0000 7ff13f5e0700 1 --2- 172.21.15.6:0/1803709019 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff12c0658c0 0x7ff12c067d70 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff1300084e0 tx=0x7ff13000c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.445+0000 7ff13fde1700 1 --2- 172.21.15.6:0/1803709019 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e84d151cc0 0x55e84d152090 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.447+0000 7ff13fde1700 1 -- 172.21.15.6:0/1803709019 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 mds0_sessionmap [omap-set-header] v133'171 uv171 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7ff13800e7e0 con 0x55e84d151cc0 2023-10-06T02:29:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.447+0000 7ff1463a5000 1 -- 172.21.15.6:0/1803709019 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e84d151cc0 msgr2=0x55e84d152090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.447+0000 7ff1463a5000 1 --2- 172.21.15.6:0/1803709019 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55e84d151cc0 0x55e84d152090 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.447+0000 7ff1463a5000 1 -- 172.21.15.6:0/1803709019 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff12c0658c0 msgr2=0x7ff12c067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.447+0000 7ff1463a5000 1 --2- 172.21.15.6:0/1803709019 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff12c0658c0 0x7ff12c067d70 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff1300084e0 tx=0x7ff13000c040 comp rx=0 tx=0).stop 2023-10-06T02:29:38.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.447+0000 7ff1463a5000 1 -- 172.21.15.6:0/1803709019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84d155ab0 msgr2=0x55e84d206760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.447+0000 7ff1463a5000 1 --2- 172.21.15.6:0/1803709019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84d155ab0 0x55e84d206760 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7ff13400c620 tx=0x7ff134001740 comp rx=0 tx=0).stop 2023-10-06T02:29:38.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.447+0000 7ff13fde1700 1 -- 172.21.15.6:0/1803709019 reap_dead start 2023-10-06T02:29:38.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.447+0000 7ff1463a5000 1 -- 172.21.15.6:0/1803709019 shutdown_connections 2023-10-06T02:29:38.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.447+0000 7ff1463a5000 1 -- 172.21.15.6:0/1803709019 >> 172.21.15.6:0/1803709019 conn(0x55e84d16dbd0 msgr2=0x55e84d124c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:38.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.447+0000 7ff1463a5000 1 -- 172.21.15.6:0/1803709019 shutdown_connections 2023-10-06T02:29:38.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.447+0000 7ff1463a5000 1 -- 172.21.15.6:0/1803709019 wait complete. 2023-10-06T02:29:38.453 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:29:38.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.615+0000 7fe140a8d700 1 Processor -- start 2023-10-06T02:29:38.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.615+0000 7fe140a8d700 1 -- start start 2023-10-06T02:29:38.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.616+0000 7fe140a8d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe13c06b7e0 0x7fe13c0cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.616+0000 7fe140a8d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13c0c90d0 con 0x7fe13c06bbb0 2023-10-06T02:29:38.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.616+0000 7fe140a8d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13c0c7c60 con 0x7fe13c06d1c0 2023-10-06T02:29:38.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.616+0000 7fe140a8d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe13c157600 con 0x7fe13c06b7e0 2023-10-06T02:29:38.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.616+0000 7fe139d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe13c06bbb0 0x7fe13c06cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49886/0 (socket says 172.21.15.6:49886) 2023-10-06T02:29:38.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.616+0000 7fe139d9b700 1 -- 172.21.15.6:0/2535373636 learned_addr learned my addr 172.21.15.6:0/2535373636 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:38.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.616+0000 7fe13a59c700 1 --2- 172.21.15.6:0/2535373636 >> v2:172.21.15.175:3300/0 conn(0x7fe13c06b7e0 0x7fe13c0cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.616+0000 7fe13959a700 1 -- 172.21.15.6:0/2535373636 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944471388 0 0) 0x7fe13c0c90d0 con 0x7fe13c06bbb0 2023-10-06T02:29:38.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.616+0000 7fe13959a700 1 -- 172.21.15.6:0/2535373636 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe124003570 con 0x7fe13c06bbb0 2023-10-06T02:29:38.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13959a700 1 -- 172.21.15.6:0/2535373636 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2958958591 0 0) 0x7fe124003570 con 0x7fe13c06bbb0 2023-10-06T02:29:38.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13959a700 1 -- 172.21.15.6:0/2535373636 >> v2:172.21.15.175:3300/0 conn(0x7fe13c06b7e0 msgr2=0x7fe13c0cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:38.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13959a700 1 --2- 172.21.15.6:0/2535373636 >> v2:172.21.15.175:3300/0 conn(0x7fe13c06b7e0 0x7fe13c0cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13959a700 1 -- 172.21.15.6:0/2535373636 >> v1:172.21.15.175:6789/0 conn(0x7fe13c06d1c0 legacy=0x7fe13c1600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13959a700 1 -- 172.21.15.6:0/2535373636 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c0c7980 con 0x7fe13c06bbb0 2023-10-06T02:29:38.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13959a700 1 -- 172.21.15.6:0/2535373636 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7fe130001470 con 0x7fe13c06bbb0 2023-10-06T02:29:38.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13a59c700 1 --2- 172.21.15.6:0/2535373636 >> v2:172.21.15.175:3300/0 conn(0x7fe13c06b7e0 0x7fe13c0cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:38.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13959a700 1 -- 172.21.15.6:0/2535373636 >> v1:172.21.15.6:6789/0 conn(0x7fe13c06bbb0 legacy=0x7fe13c06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13959a700 1 --2- 172.21.15.6:0/2535373636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe124003a60 0x7fe124003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13959a700 1 --2- 172.21.15.6:0/2535373636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe124004810 0x7fe124004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13959a700 1 --2- 172.21.15.6:0/2535373636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1240051c0 0x7fe12400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13959a700 1 -- 172.21.15.6:0/2535373636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c157600 con 0x7fe124003a60 2023-10-06T02:29:38.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13959a700 1 -- 172.21.15.6:0/2535373636 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12400c050 con 0x7fe1240051c0 2023-10-06T02:29:38.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13959a700 1 -- 172.21.15.6:0/2535373636 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12400c210 con 0x7fe124004810 2023-10-06T02:29:38.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13a59c700 1 --2- 172.21.15.6:0/2535373636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe124003a60 0x7fe124003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe139d9b700 1 --2- 172.21.15.6:0/2535373636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe124004810 0x7fe124004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13ad9d700 1 --2- 172.21.15.6:0/2535373636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1240051c0 0x7fe12400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13a59c700 1 -- 172.21.15.6:0/2535373636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe124004810 msgr2=0x7fe124004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:38.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13a59c700 1 --2- 172.21.15.6:0/2535373636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe124004810 0x7fe124004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13a59c700 1 -- 172.21.15.6:0/2535373636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1240051c0 msgr2=0x7fe12400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:38.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13a59c700 1 --2- 172.21.15.6:0/2535373636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1240051c0 0x7fe12400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13a59c700 1 -- 172.21.15.6:0/2535373636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe124003570 con 0x7fe124003a60 2023-10-06T02:29:38.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe139d9b700 1 --2- 172.21.15.6:0/2535373636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe124004810 0x7fe124004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:38.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13ad9d700 1 --2- 172.21.15.6:0/2535373636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1240051c0 0x7fe12400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:38.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13ad9d700 1 -- 172.21.15.6:0/2535373636 reap_dead start 2023-10-06T02:29:38.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13a59c700 1 --2- 172.21.15.6:0/2535373636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe124003a60 0x7fe124003e30 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009df0 tx=0x7fe12c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399e08c4062b930e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:38.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13959a700 1 -- 172.21.15.6:0/2535373636 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c009740 con 0x7fe124003a60 2023-10-06T02:29:38.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13959a700 1 -- 172.21.15.6:0/2535373636 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12c00e920 con 0x7fe124003a60 2023-10-06T02:29:38.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.617+0000 7fe13959a700 1 -- 172.21.15.6:0/2535373636 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c00ece0 con 0x7fe124003a60 2023-10-06T02:29:38.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.618+0000 7fe140a8d700 1 -- 172.21.15.6:0/2535373636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe124003a60 msgr2=0x7fe124003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.618+0000 7fe140a8d700 1 --2- 172.21.15.6:0/2535373636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe124003a60 0x7fe124003e30 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009df0 tx=0x7fe12c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.618+0000 7fe140a8d700 1 -- 172.21.15.6:0/2535373636 shutdown_connections 2023-10-06T02:29:38.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.618+0000 7fe140a8d700 1 --2- 172.21.15.6:0/2535373636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe124003a60 0x7fe124003e30 unknown :-1 s=CLOSED pgs=2287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.618+0000 7fe140a8d700 1 -- 172.21.15.6:0/2535373636 >> 172.21.15.6:0/2535373636 conn(0x7fe13c06a260 msgr2=0x7fe13c0cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:38.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.618+0000 7fe140a8d700 1 -- 172.21.15.6:0/2535373636 shutdown_connections 2023-10-06T02:29:38.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.618+0000 7fe140a8d700 1 -- 172.21.15.6:0/2535373636 wait complete. 2023-10-06T02:29:38.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.619+0000 7fe140a8d700 1 Processor -- start 2023-10-06T02:29:38.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.619+0000 7fe140a8d700 1 -- start start 2023-10-06T02:29:38.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.620+0000 7fe140a8d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe124003a60 0x7fe13c0ad100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.620+0000 7fe140a8d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe13c0af160 0x7fe13c146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.620+0000 7fe140a8d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe13c146f70 0x7fe13c1473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.620+0000 7fe140a8d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c147920 con 0x7fe13c146f70 2023-10-06T02:29:38.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.620+0000 7fe140a8d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c0ad920 con 0x7fe13c0af160 2023-10-06T02:29:38.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.620+0000 7fe140a8d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c0adc00 con 0x7fe124003a60 2023-10-06T02:29:38.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.620+0000 7fe13ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe13c146f70 0x7fe13c1473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.620+0000 7fe13ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe13c146f70 0x7fe13c1473e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42244/0 (socket says 172.21.15.6:42244) 2023-10-06T02:29:38.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.620+0000 7fe13ad9d700 1 -- 172.21.15.6:0/1704741744 learned_addr learned my addr 172.21.15.6:0/1704741744 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:38.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.620+0000 7fe139d9b700 1 --2- 172.21.15.6:0/1704741744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe13c0af160 0x7fe13c146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.620+0000 7fe13a59c700 1 --2- 172.21.15.6:0/1704741744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe124003a60 0x7fe13c0ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.620+0000 7fe13ad9d700 1 -- 172.21.15.6:0/1704741744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe124003a60 msgr2=0x7fe13c0ad100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.620+0000 7fe13ad9d700 1 --2- 172.21.15.6:0/1704741744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe124003a60 0x7fe13c0ad100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.620+0000 7fe13ad9d700 1 -- 172.21.15.6:0/1704741744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe13c0af160 msgr2=0x7fe13c146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:38.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.620+0000 7fe13ad9d700 1 --2- 172.21.15.6:0/1704741744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe13c0af160 0x7fe13c146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:38.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.620+0000 7fe13ad9d700 1 -- 172.21.15.6:0/1704741744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c0adee0 con 0x7fe13c146f70 2023-10-06T02:29:38.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.620+0000 7fe13ad9d700 1 --2- 172.21.15.6:0/1704741744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe13c146f70 0x7fe13c1473e0 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7fe13c06d590 tx=0x7fe134009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:38.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.621+0000 7fe12a7fc700 1 -- 172.21.15.6:0/1704741744 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134012590 con 0x7fe13c146f70 2023-10-06T02:29:38.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.621+0000 7fe12a7fc700 1 -- 172.21.15.6:0/1704741744 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe134012710 con 0x7fe13c146f70 2023-10-06T02:29:38.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.621+0000 7fe140a8d700 1 -- 172.21.15.6:0/1704741744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe13c0ae1c0 con 0x7fe13c146f70 2023-10-06T02:29:38.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.621+0000 7fe12a7fc700 1 -- 172.21.15.6:0/1704741744 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134012ad0 con 0x7fe13c146f70 2023-10-06T02:29:38.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.621+0000 7fe140a8d700 1 -- 172.21.15.6:0/1704741744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13c146bd0 con 0x7fe13c146f70 2023-10-06T02:29:38.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.622+0000 7fe140a8d700 1 -- 172.21.15.6:0/1704741744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe13c06e700 con 0x7fe13c146f70 2023-10-06T02:29:38.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.622+0000 7fe12a7fc700 1 -- 172.21.15.6:0/1704741744 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe134003030 con 0x7fe13c146f70 2023-10-06T02:29:38.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.622+0000 7fe12a7fc700 1 --2- 172.21.15.6:0/1704741744 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe11c066f30 0x7fe11c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:38.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.622+0000 7fe12a7fc700 1 -- 172.21.15.6:0/1704741744 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 9646+0+0 (secure 0 0 0) 0x7fe134085230 con 0x7fe13c146f70 2023-10-06T02:29:38.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.623+0000 7fe13a59c700 1 --2- 172.21.15.6:0/1704741744 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe11c066f30 0x7fe11c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:38.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.623+0000 7fe13a59c700 1 --2- 172.21.15.6:0/1704741744 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe11c066f30 0x7fe11c0693e0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fe12c0091e0 tx=0x7fe12c01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:38.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.627+0000 7fe12a7fc700 1 -- 172.21.15.6:0/1704741744 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe134051500 con 0x7fe13c146f70 2023-10-06T02:29:38.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:38.866+0000 7fe140a8d700 1 -- 172.21.15.6:0/1704741744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fe13c0c9350 con 0x7fe13c146f70 2023-10-06T02:29:39.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.139+0000 7fe12a7fc700 1 -- 172.21.15.6:0/1704741744 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v339) v1 ==== 162+0+0 (secure 0 0 0) 0x7fe134054b20 con 0x7fe13c146f70 2023-10-06T02:29:39.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.141+0000 7fe140a8d700 1 -- 172.21.15.6:0/1704741744 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe11c066f30 msgr2=0x7fe11c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:39.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.141+0000 7fe140a8d700 1 --2- 172.21.15.6:0/1704741744 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe11c066f30 0x7fe11c0693e0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fe12c0091e0 tx=0x7fe12c01a000 comp rx=0 tx=0).stop 2023-10-06T02:29:39.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.141+0000 7fe140a8d700 1 -- 172.21.15.6:0/1704741744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe13c146f70 msgr2=0x7fe13c1473e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:39.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.141+0000 7fe140a8d700 1 --2- 172.21.15.6:0/1704741744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe13c146f70 0x7fe13c1473e0 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7fe13c06d590 tx=0x7fe134009040 comp rx=0 tx=0).stop 2023-10-06T02:29:39.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.141+0000 7fe140a8d700 1 -- 172.21.15.6:0/1704741744 shutdown_connections 2023-10-06T02:29:39.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.141+0000 7fe140a8d700 1 --2- 172.21.15.6:0/1704741744 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe11c066f30 0x7fe11c0693e0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.141+0000 7fe140a8d700 1 --2- 172.21.15.6:0/1704741744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe13c146f70 0x7fe13c1473e0 unknown :-1 s=CLOSED pgs=2288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.141+0000 7fe140a8d700 1 --2- 172.21.15.6:0/1704741744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe124003a60 0x7fe13c0ad100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.141+0000 7fe140a8d700 1 --2- 172.21.15.6:0/1704741744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe13c0af160 0x7fe13c146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.141+0000 7fe140a8d700 1 -- 172.21.15.6:0/1704741744 >> 172.21.15.6:0/1704741744 conn(0x7fe13c06a260 msgr2=0x7fe13c0c1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.141+0000 7fe140a8d700 1 -- 172.21.15.6:0/1704741744 shutdown_connections 2023-10-06T02:29:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.141+0000 7fe140a8d700 1 -- 172.21.15.6:0/1704741744 wait complete. 2023-10-06T02:29:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:29:39.145 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:29:39.145+0000 7fae803aa700 -1 log_channel(cluster) log [ERR] : corrupt sessionmap header: virtual void SessionMapStore::decode_header(ceph::bufferlist&) no longer understand old encoding version 1 < 101: Malformed input 2023-10-06T02:29:39.146 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:29:39.146+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:29:39.147 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:29:39.146+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:29:39.155 INFO:tasks.ceph.mds.a.smithi006.stderr: -29> 2023-10-06T02:29:39.145+0000 7fae803aa700 -1 log_channel(cluster) log [ERR] : corrupt sessionmap header: virtual void SessionMapStore::decode_header(ceph::bufferlist&) no longer understand old encoding version 1 < 101: Malformed input 2023-10-06T02:29:39.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:39.176 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:29:39.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.279+0000 7f097b9d4700 1 Processor -- start 2023-10-06T02:29:39.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.279+0000 7f097b9d4700 1 -- start start 2023-10-06T02:29:39.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.280+0000 7f097b9d4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f09741593f0 0x7f097406de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:39.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.280+0000 7f097b9d4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f097406adf0 0x7f097406e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:39.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.280+0000 7f097b9d4700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0974069950 con 0x7f09741597c0 2023-10-06T02:29:39.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.280+0000 7f097b9d4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09740b2850 con 0x7f09741593f0 2023-10-06T02:29:39.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.280+0000 7f097b9d4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09740b1fb0 con 0x7f097406adf0 2023-10-06T02:29:39.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.281+0000 7f0979f71700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f097406adf0 0x7f097406e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:39.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.281+0000 7f0979770700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f09741593f0 0x7f097406de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:39.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.281+0000 7f0979f71700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f097406adf0 0x7f097406e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:51606/0 (socket says 172.21.15.6:51606) 2023-10-06T02:29:39.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.281+0000 7f0979770700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f09741593f0 0x7f097406de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:35626/0 (socket says 172.21.15.6:35626) 2023-10-06T02:29:39.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.281+0000 7f0979f71700 1 -- 172.21.15.6:0/1731133616 learned_addr learned my addr 172.21.15.6:0/1731133616 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:39.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.281+0000 7f0978f6f700 1 --1- 172.21.15.6:0/1731133616 >> v1:172.21.15.175:6789/0 conn(0x7f09741597c0 0x7f097415d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:57856/0 (socket says 172.21.15.6:57856) 2023-10-06T02:29:39.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.281+0000 7f0979f71700 1 -- 172.21.15.6:0/1731133616 >> v2:172.21.15.175:3300/0 conn(0x7f09741593f0 msgr2=0x7f097406de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:39.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.281+0000 7f0979f71700 1 --2- 172.21.15.6:0/1731133616 >> v2:172.21.15.175:3300/0 conn(0x7f09741593f0 0x7f097406de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.281+0000 7f0979f71700 1 -- 172.21.15.6:0/1731133616 >> v1:172.21.15.175:6789/0 conn(0x7f09741597c0 legacy=0x7f097415d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:39.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.281+0000 7f0979f71700 1 -- 172.21.15.6:0/1731133616 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09740b2290 con 0x7f097406adf0 2023-10-06T02:29:39.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.281+0000 7f0979f71700 1 --2- 172.21.15.6:0/1731133616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f097406adf0 0x7f097406e350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0964009f20 tx=0x7f0964009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52b646adaedc9217 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:39.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.281+0000 7f0973fff700 1 -- 172.21.15.6:0/1731133616 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096400e070 con 0x7f097406adf0 2023-10-06T02:29:39.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.282+0000 7f0973fff700 1 -- 172.21.15.6:0/1731133616 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096400b9d0 con 0x7f097406adf0 2023-10-06T02:29:39.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.282+0000 7f0973fff700 1 -- 172.21.15.6:0/1731133616 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09640092e0 con 0x7f097406adf0 2023-10-06T02:29:39.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.282+0000 7f097b9d4700 1 -- 172.21.15.6:0/1731133616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f097406adf0 msgr2=0x7f097406e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:39.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.282+0000 7f097b9d4700 1 --2- 172.21.15.6:0/1731133616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f097406adf0 0x7f097406e350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0964009f20 tx=0x7f0964009840 comp rx=0 tx=0).stop 2023-10-06T02:29:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.282+0000 7f097b9d4700 1 -- 172.21.15.6:0/1731133616 shutdown_connections 2023-10-06T02:29:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.282+0000 7f097b9d4700 1 --2- 172.21.15.6:0/1731133616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f097406adf0 0x7f097406e350 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.282+0000 7f097b9d4700 1 --2- 172.21.15.6:0/1731133616 >> v2:172.21.15.175:3300/0 conn(0x7f09741593f0 0x7f097406de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.282+0000 7f097b9d4700 1 -- 172.21.15.6:0/1731133616 >> 172.21.15.6:0/1731133616 conn(0x7f097406cff0 msgr2=0x7f09740afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.282+0000 7f097b9d4700 1 -- 172.21.15.6:0/1731133616 shutdown_connections 2023-10-06T02:29:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.282+0000 7f097b9d4700 1 -- 172.21.15.6:0/1731133616 wait complete. 2023-10-06T02:29:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.283+0000 7f097b9d4700 1 Processor -- start 2023-10-06T02:29:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.283+0000 7f097b9d4700 1 -- start start 2023-10-06T02:29:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.284+0000 7f097b9d4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f097406adf0 0x7f0974146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.284+0000 7f097b9d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09741593f0 0x7f09740cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.284+0000 7f097b9d4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09741597c0 0x7f09740cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:39.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.284+0000 7f097b9d4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09741492b0 con 0x7f09741593f0 2023-10-06T02:29:39.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.284+0000 7f097b9d4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0974149590 con 0x7f09741597c0 2023-10-06T02:29:39.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.284+0000 7f097b9d4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0974149870 con 0x7f097406adf0 2023-10-06T02:29:39.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.284+0000 7f0978f6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09741593f0 0x7f09740cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:39.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.284+0000 7f0978f6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09741593f0 0x7f09740cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56588/0 (socket says 172.21.15.6:56588) 2023-10-06T02:29:39.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.284+0000 7f0978f6f700 1 -- 172.21.15.6:0/2987355215 learned_addr learned my addr 172.21.15.6:0/2987355215 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:39.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.284+0000 7f0979770700 1 --2- 172.21.15.6:0/2987355215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f097406adf0 0x7f0974146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:39.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.284+0000 7f0979f71700 1 --2- 172.21.15.6:0/2987355215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09741597c0 0x7f09740cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:39.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.284+0000 7f0978f6f700 1 -- 172.21.15.6:0/2987355215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f097406adf0 msgr2=0x7f0974146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:39.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.284+0000 7f0978f6f700 1 --2- 172.21.15.6:0/2987355215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f097406adf0 0x7f0974146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.284+0000 7f0978f6f700 1 -- 172.21.15.6:0/2987355215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09741597c0 msgr2=0x7f09740cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:39.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.284+0000 7f0978f6f700 1 --2- 172.21.15.6:0/2987355215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09741597c0 0x7f09740cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.284+0000 7f0978f6f700 1 -- 172.21.15.6:0/2987355215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0964009ae0 con 0x7f09741593f0 2023-10-06T02:29:39.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.285+0000 7f0978f6f700 1 --2- 172.21.15.6:0/2987355215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09741593f0 0x7f09740cb570 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7f096800c590 tx=0x7f0968001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:39.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.285+0000 7f09717fa700 1 -- 172.21.15.6:0/2987355215 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968005ac0 con 0x7f09741593f0 2023-10-06T02:29:39.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.285+0000 7f09717fa700 1 -- 172.21.15.6:0/2987355215 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0968005c20 con 0x7f09741593f0 2023-10-06T02:29:39.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.285+0000 7f097b9d4700 1 -- 172.21.15.6:0/2987355215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0974149b50 con 0x7f09741593f0 2023-10-06T02:29:39.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.285+0000 7f09717fa700 1 -- 172.21.15.6:0/2987355215 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09680070d0 con 0x7f09741593f0 2023-10-06T02:29:39.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.285+0000 7f097b9d4700 1 -- 172.21.15.6:0/2987355215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0974147080 con 0x7f09741593f0 2023-10-06T02:29:39.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.286+0000 7f097b9d4700 1 -- 172.21.15.6:0/2987355215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097414a070 con 0x7f09741593f0 2023-10-06T02:29:39.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.286+0000 7f09717fa700 1 -- 172.21.15.6:0/2987355215 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0968007440 con 0x7f09741593f0 2023-10-06T02:29:39.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.287+0000 7f09717fa700 1 --2- 172.21.15.6:0/2987355215 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0960066f30 0x7f09600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.287+0000 7f09717fa700 1 -- 172.21.15.6:0/2987355215 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 9732+0+0 (secure 0 0 0) 0x7f09680848e0 con 0x7f09741593f0 2023-10-06T02:29:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.287+0000 7f0979770700 1 --2- 172.21.15.6:0/2987355215 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0960066f30 0x7f09600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.287+0000 7f0979770700 1 --2- 172.21.15.6:0/2987355215 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0960066f30 0x7f09600693e0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f097415c220 tx=0x7f096c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.291+0000 7f09717fa700 1 -- 172.21.15.6:0/2987355215 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f097414a070 con 0x7f09741593f0 2023-10-06T02:29:39.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.530+0000 7f097b9d4700 1 -- 172.21.15.6:0/2987355215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f097414a070 con 0x7f09741593f0 2023-10-06T02:29:39.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.531+0000 7f09717fa700 1 -- 172.21.15.6:0/2987355215 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 341 v341) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f097414a070 con 0x7f09741593f0 2023-10-06T02:29:39.531 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:39.532 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":341,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":341,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:39.146546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.533+0000 7f097b9d4700 1 -- 172.21.15.6:0/2987355215 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0960066f30 msgr2=0x7f09600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.533+0000 7f097b9d4700 1 --2- 172.21.15.6:0/2987355215 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0960066f30 0x7f09600693e0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f097415c220 tx=0x7f096c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.533+0000 7f097b9d4700 1 -- 172.21.15.6:0/2987355215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09741593f0 msgr2=0x7f09740cb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.533+0000 7f097b9d4700 1 --2- 172.21.15.6:0/2987355215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09741593f0 0x7f09740cb570 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7f096800c590 tx=0x7f0968001070 comp rx=0 tx=0).stop 2023-10-06T02:29:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.533+0000 7f097b9d4700 1 -- 172.21.15.6:0/2987355215 shutdown_connections 2023-10-06T02:29:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.533+0000 7f097b9d4700 1 --2- 172.21.15.6:0/2987355215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09741597c0 0x7f09740cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.533+0000 7f097b9d4700 1 --2- 172.21.15.6:0/2987355215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f097406adf0 0x7f0974146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.533+0000 7f097b9d4700 1 --2- 172.21.15.6:0/2987355215 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0960066f30 0x7f09600693e0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.533+0000 7f097b9d4700 1 --2- 172.21.15.6:0/2987355215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09741593f0 0x7f09740cb570 unknown :-1 s=CLOSED pgs=2291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.533+0000 7f097b9d4700 1 -- 172.21.15.6:0/2987355215 >> 172.21.15.6:0/2987355215 conn(0x7f097406cff0 msgr2=0x7f097415a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.533+0000 7f097b9d4700 1 -- 172.21.15.6:0/2987355215 shutdown_connections 2023-10-06T02:29:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.533+0000 7f097b9d4700 1 -- 172.21.15.6:0/2987355215 wait complete. 2023-10-06T02:29:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 341 2023-10-06T02:29:39.545 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:29:39.546 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:39.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.705+0000 7f9542c80700 1 Processor -- start 2023-10-06T02:29:39.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.705+0000 7f9542c80700 1 -- start start 2023-10-06T02:29:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.705+0000 7f9542c80700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f953c0af4e0 0x7f953c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.705+0000 7f9542c80700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f953c15db70 0x7f953c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.705+0000 7f9542c80700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953c15e190 con 0x7f953c0af8b0 2023-10-06T02:29:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.705+0000 7f9542c80700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f953c0b1910 con 0x7f953c15db70 2023-10-06T02:29:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.705+0000 7f9542c80700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f953c15dfa0 con 0x7f953c0af4e0 2023-10-06T02:29:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.706+0000 7f954121d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f953c15db70 0x7f953c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.706+0000 7f954121d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f953c15db70 0x7f953c0b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56598/0 (socket says 172.21.15.6:56598) 2023-10-06T02:29:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.706+0000 7f953bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f953c0af8b0 0x7f953c15d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37850/0 (socket says 172.21.15.6:37850) 2023-10-06T02:29:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.706+0000 7f954121d700 1 -- 172.21.15.6:0/1639079469 learned_addr learned my addr 172.21.15.6:0/1639079469 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.706+0000 7f9540a1c700 1 --2- 172.21.15.6:0/1639079469 >> v2:172.21.15.175:3300/0 conn(0x7f953c0af4e0 0x7f953c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.706+0000 7f954121d700 1 -- 172.21.15.6:0/1639079469 >> v2:172.21.15.175:3300/0 conn(0x7f953c0af4e0 msgr2=0x7f953c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.706+0000 7f954121d700 1 --2- 172.21.15.6:0/1639079469 >> v2:172.21.15.175:3300/0 conn(0x7f953c0af4e0 0x7f953c0b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.706+0000 7f954121d700 1 -- 172.21.15.6:0/1639079469 >> v1:172.21.15.6:6789/0 conn(0x7f953c0af8b0 legacy=0x7f953c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.706+0000 7f953b7fe700 1 -- 172.21.15.6:0/1639079469 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829024124 0 0) 0x7f953c15e190 con 0x7f953c0af8b0 2023-10-06T02:29:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.706+0000 7f954121d700 1 -- 172.21.15.6:0/1639079469 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953c0cb650 con 0x7f953c15db70 2023-10-06T02:29:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.706+0000 7f954121d700 1 --2- 172.21.15.6:0/1639079469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f953c15db70 0x7f953c0b2620 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7f953c0d1360 tx=0x7f9524009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c500a3b8461c32b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.706+0000 7f953b7fe700 1 -- 172.21.15.6:0/1639079469 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952400b860 con 0x7f953c15db70 2023-10-06T02:29:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.706+0000 7f953b7fe700 1 -- 172.21.15.6:0/1639079469 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952400b9c0 con 0x7f953c15db70 2023-10-06T02:29:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.706+0000 7f953b7fe700 1 -- 172.21.15.6:0/1639079469 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952400bd60 con 0x7f953c15db70 2023-10-06T02:29:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.707+0000 7f9542c80700 1 -- 172.21.15.6:0/1639079469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f953c15db70 msgr2=0x7f953c0b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.707+0000 7f9542c80700 1 --2- 172.21.15.6:0/1639079469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f953c15db70 0x7f953c0b2620 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7f953c0d1360 tx=0x7f9524009250 comp rx=0 tx=0).stop 2023-10-06T02:29:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.707+0000 7f9542c80700 1 -- 172.21.15.6:0/1639079469 shutdown_connections 2023-10-06T02:29:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.707+0000 7f9542c80700 1 --2- 172.21.15.6:0/1639079469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f953c15db70 0x7f953c0b2620 unknown :-1 s=CLOSED pgs=2293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.707+0000 7f9542c80700 1 --2- 172.21.15.6:0/1639079469 >> v2:172.21.15.175:3300/0 conn(0x7f953c0af4e0 0x7f953c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.707+0000 7f9542c80700 1 -- 172.21.15.6:0/1639079469 >> 172.21.15.6:0/1639079469 conn(0x7f953c068680 msgr2=0x7f953c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.707+0000 7f9542c80700 1 -- 172.21.15.6:0/1639079469 shutdown_connections 2023-10-06T02:29:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.707+0000 7f9542c80700 1 -- 172.21.15.6:0/1639079469 wait complete. 2023-10-06T02:29:39.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.708+0000 7f9542c80700 1 Processor -- start 2023-10-06T02:29:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.708+0000 7f9542c80700 1 -- start start 2023-10-06T02:29:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.709+0000 7f9542c80700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f953c0af4e0 0x7f953c0d0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.709+0000 7f9542c80700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f953c0af8b0 0x7f953c14b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.709+0000 7f9542c80700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f953c15db70 0x7f953c0b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.709+0000 7f9542c80700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953c0a6d20 con 0x7f953c0af8b0 2023-10-06T02:29:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.709+0000 7f9542c80700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953c14bf20 con 0x7f953c0af4e0 2023-10-06T02:29:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.709+0000 7f9542c80700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953c16a5e0 con 0x7f953c15db70 2023-10-06T02:29:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.709+0000 7f953bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f953c0af8b0 0x7f953c14b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.709+0000 7f953bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f953c0af8b0 0x7f953c14b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56608/0 (socket says 172.21.15.6:56608) 2023-10-06T02:29:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.709+0000 7f953bfff700 1 -- 172.21.15.6:0/3792023049 learned_addr learned my addr 172.21.15.6:0/3792023049 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.709+0000 7f9540a1c700 1 --2- 172.21.15.6:0/3792023049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f953c0af4e0 0x7f953c0d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.709+0000 7f954121d700 1 --2- 172.21.15.6:0/3792023049 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f953c15db70 0x7f953c0b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.709+0000 7f953bfff700 1 -- 172.21.15.6:0/3792023049 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f953c15db70 msgr2=0x7f953c0b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.709+0000 7f953bfff700 1 --2- 172.21.15.6:0/3792023049 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f953c15db70 0x7f953c0b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.709+0000 7f953bfff700 1 -- 172.21.15.6:0/3792023049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f953c0af4e0 msgr2=0x7f953c0d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.709+0000 7f953bfff700 1 --2- 172.21.15.6:0/3792023049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f953c0af4e0 0x7f953c0d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.709+0000 7f953bfff700 1 -- 172.21.15.6:0/3792023049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95240094f0 con 0x7f953c0af8b0 2023-10-06T02:29:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.709+0000 7f953bfff700 1 --2- 172.21.15.6:0/3792023049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f953c0af8b0 0x7f953c14b9e0 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f952c00c7e0 tx=0x7f952c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.710+0000 7f9538ff9700 1 -- 172.21.15.6:0/3792023049 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c0073d0 con 0x7f953c0af8b0 2023-10-06T02:29:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.710+0000 7f9538ff9700 1 -- 172.21.15.6:0/3792023049 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952c007530 con 0x7f953c0af8b0 2023-10-06T02:29:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.710+0000 7f9542c80700 1 -- 172.21.15.6:0/3792023049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953c16a8c0 con 0x7f953c0af8b0 2023-10-06T02:29:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.710+0000 7f9538ff9700 1 -- 172.21.15.6:0/3792023049 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c004a80 con 0x7f953c0af8b0 2023-10-06T02:29:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.710+0000 7f9542c80700 1 -- 172.21.15.6:0/3792023049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953c16ae80 con 0x7f953c0af8b0 2023-10-06T02:29:39.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.711+0000 7f9542c80700 1 -- 172.21.15.6:0/3792023049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953c0a6e60 con 0x7f953c0af8b0 2023-10-06T02:29:39.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.711+0000 7f9538ff9700 1 -- 172.21.15.6:0/3792023049 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f952c01c3b0 con 0x7f953c0af8b0 2023-10-06T02:29:39.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.711+0000 7f9538ff9700 1 --2- 172.21.15.6:0/3792023049 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f951c066f30 0x7f951c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:39.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.711+0000 7f9538ff9700 1 -- 172.21.15.6:0/3792023049 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 9732+0+0 (secure 0 0 0) 0x7f952c084a20 con 0x7f953c0af8b0 2023-10-06T02:29:39.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.712+0000 7f9540a1c700 1 --2- 172.21.15.6:0/3792023049 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f951c066f30 0x7f951c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:39.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.712+0000 7f9540a1c700 1 --2- 172.21.15.6:0/3792023049 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f951c066f30 0x7f951c0693e0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f95340074f0 tx=0x7f9534009700 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:39.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.716+0000 7f9538ff9700 1 -- 172.21.15.6:0/3792023049 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f953c0a6e60 con 0x7f953c0af8b0 2023-10-06T02:29:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.956+0000 7f9542c80700 1 -- 172.21.15.6:0/3792023049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f953c0a6e60 con 0x7f953c0af8b0 2023-10-06T02:29:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.956+0000 7f9538ff9700 1 -- 172.21.15.6:0/3792023049 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 341 v341) v1 ==== 95+0+3840 (secure 0 0 0) 0x7f953c0a6e60 con 0x7f953c0af8b0 2023-10-06T02:29:39.957 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:39.958 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":341,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":341,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:39.146546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.958+0000 7f9542c80700 1 -- 172.21.15.6:0/3792023049 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f951c066f30 msgr2=0x7f951c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.958+0000 7f9542c80700 1 --2- 172.21.15.6:0/3792023049 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f951c066f30 0x7f951c0693e0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f95340074f0 tx=0x7f9534009700 comp rx=0 tx=0).stop 2023-10-06T02:29:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.958+0000 7f9542c80700 1 -- 172.21.15.6:0/3792023049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f953c0af8b0 msgr2=0x7f953c14b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:39.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.958+0000 7f9542c80700 1 --2- 172.21.15.6:0/3792023049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f953c0af8b0 0x7f953c14b9e0 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f952c00c7e0 tx=0x7f952c007de0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.958+0000 7f9542c80700 1 -- 172.21.15.6:0/3792023049 shutdown_connections 2023-10-06T02:29:39.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.958+0000 7f9542c80700 1 --2- 172.21.15.6:0/3792023049 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f953c15db70 0x7f953c0b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.958+0000 7f9542c80700 1 --2- 172.21.15.6:0/3792023049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f953c0af4e0 0x7f953c0d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.958+0000 7f9542c80700 1 --2- 172.21.15.6:0/3792023049 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f951c066f30 0x7f951c0693e0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.958+0000 7f9542c80700 1 --2- 172.21.15.6:0/3792023049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f953c0af8b0 0x7f953c14b9e0 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:39.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.958+0000 7f9542c80700 1 -- 172.21.15.6:0/3792023049 >> 172.21.15.6:0/3792023049 conn(0x7f953c068680 msgr2=0x7f953c068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:39.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.959+0000 7f9542c80700 1 -- 172.21.15.6:0/3792023049 shutdown_connections 2023-10-06T02:29:39.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:39.959+0000 7f9542c80700 1 -- 172.21.15.6:0/3792023049 wait complete. 2023-10-06T02:29:39.961 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 341 2023-10-06T02:29:39.971 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:29:39.971 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:40.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.090+0000 7fa3058d7700 1 Processor -- start 2023-10-06T02:29:40.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.090+0000 7fa3058d7700 1 -- start start 2023-10-06T02:29:40.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.090+0000 7fa3058d7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa3000af8b0 0x7fa30015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:40.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.090+0000 7fa3058d7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3000b27f0 0x7fa30015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:40.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.090+0000 7fa3058d7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30015e190 con 0x7fa3000af4e0 2023-10-06T02:29:40.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.090+0000 7fa3058d7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3000b1910 con 0x7fa3000af8b0 2023-10-06T02:29:40.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.090+0000 7fa3058d7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000cb650 con 0x7fa3000b27f0 2023-10-06T02:29:40.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.091+0000 7fa2fe7fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa3000af8b0 0x7fa30015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:40.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.091+0000 7fa2ff7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3000b27f0 0x7fa30015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.091+0000 7fa2feffd700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa3000af4e0 0x7fa3000b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:57864/0 (socket says 172.21.15.6:57864) 2023-10-06T02:29:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.091+0000 7fa2ff7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3000b27f0 0x7fa30015d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:51634/0 (socket says 172.21.15.6:51634) 2023-10-06T02:29:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.091+0000 7fa2fe7fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa3000af8b0 0x7fa30015d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:35664/0 (socket says 172.21.15.6:35664) 2023-10-06T02:29:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.091+0000 7fa2feffd700 1 -- 172.21.15.6:0/1665009105 learned_addr learned my addr 172.21.15.6:0/1665009105 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.091+0000 7fa2fdffb700 1 -- 172.21.15.6:0/1665009105 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357347615 0 0) 0x7fa30015e190 con 0x7fa3000af4e0 2023-10-06T02:29:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.091+0000 7fa2fdffb700 1 -- 172.21.15.6:0/1665009105 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2ec003570 con 0x7fa3000af4e0 2023-10-06T02:29:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.091+0000 7fa2ff7fe700 1 -- 172.21.15.6:0/1665009105 >> v2:172.21.15.175:3300/0 conn(0x7fa3000af8b0 msgr2=0x7fa30015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.091+0000 7fa2ff7fe700 1 --2- 172.21.15.6:0/1665009105 >> v2:172.21.15.175:3300/0 conn(0x7fa3000af8b0 0x7fa30015d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.091+0000 7fa2ff7fe700 1 -- 172.21.15.6:0/1665009105 >> v1:172.21.15.175:6789/0 conn(0x7fa3000af4e0 legacy=0x7fa3000b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.091+0000 7fa2ff7fe700 1 -- 172.21.15.6:0/1665009105 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3000ccaf0 con 0x7fa3000b27f0 2023-10-06T02:29:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.091+0000 7fa2fe7fc700 1 --2- 172.21.15.6:0/1665009105 >> v2:172.21.15.175:3300/0 conn(0x7fa3000af8b0 0x7fa30015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.091+0000 7fa2ff7fe700 1 --2- 172.21.15.6:0/1665009105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3000b27f0 0x7fa30015d9a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80098e0 tx=0x7fa2f80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3287ed31a9ab9bf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.092+0000 7fa2fdffb700 1 -- 172.21.15.6:0/1665009105 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8011630 con 0x7fa3000b27f0 2023-10-06T02:29:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.092+0000 7fa2fdffb700 1 -- 172.21.15.6:0/1665009105 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f8011790 con 0x7fa3000b27f0 2023-10-06T02:29:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.092+0000 7fa2fdffb700 1 -- 172.21.15.6:0/1665009105 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8011b30 con 0x7fa3000b27f0 2023-10-06T02:29:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.092+0000 7fa3058d7700 1 -- 172.21.15.6:0/1665009105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3000b27f0 msgr2=0x7fa30015d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.092+0000 7fa3058d7700 1 --2- 172.21.15.6:0/1665009105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3000b27f0 0x7fa30015d9a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80098e0 tx=0x7fa2f80091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.092+0000 7fa3058d7700 1 -- 172.21.15.6:0/1665009105 shutdown_connections 2023-10-06T02:29:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.092+0000 7fa3058d7700 1 --2- 172.21.15.6:0/1665009105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3000b27f0 0x7fa30015d9a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.092+0000 7fa3058d7700 1 --2- 172.21.15.6:0/1665009105 >> v2:172.21.15.175:3300/0 conn(0x7fa3000af8b0 0x7fa30015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.092+0000 7fa3058d7700 1 -- 172.21.15.6:0/1665009105 >> 172.21.15.6:0/1665009105 conn(0x7fa300068680 msgr2=0x7fa300068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.092+0000 7fa3058d7700 1 -- 172.21.15.6:0/1665009105 shutdown_connections 2023-10-06T02:29:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.092+0000 7fa3058d7700 1 -- 172.21.15.6:0/1665009105 wait complete. 2023-10-06T02:29:40.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.093+0000 7fa3058d7700 1 Processor -- start 2023-10-06T02:29:40.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.093+0000 7fa3058d7700 1 -- start start 2023-10-06T02:29:40.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.094+0000 7fa3058d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3000af4e0 0x7fa3000cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:40.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.094+0000 7fa3058d7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3000af8b0 0x7fa300159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:40.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.094+0000 7fa3058d7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3000b27f0 0x7fa30016a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:40.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.094+0000 7fa3058d7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30016a9f0 con 0x7fa3000af4e0 2023-10-06T02:29:40.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.094+0000 7fa3058d7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000ae510 con 0x7fa3000af8b0 2023-10-06T02:29:40.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.094+0000 7fa3058d7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000ae7f0 con 0x7fa3000b27f0 2023-10-06T02:29:40.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.094+0000 7fa2feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3000af4e0 0x7fa3000cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:40.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.094+0000 7fa2feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3000af4e0 0x7fa3000cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56624/0 (socket says 172.21.15.6:56624) 2023-10-06T02:29:40.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.094+0000 7fa2feffd700 1 -- 172.21.15.6:0/3190266473 learned_addr learned my addr 172.21.15.6:0/3190266473 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:40.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.095+0000 7fa2fe7fc700 1 --2- 172.21.15.6:0/3190266473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3000af8b0 0x7fa300159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:40.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.095+0000 7fa2ff7fe700 1 --2- 172.21.15.6:0/3190266473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3000b27f0 0x7fa30016a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:40.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.095+0000 7fa2feffd700 1 -- 172.21.15.6:0/3190266473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3000b27f0 msgr2=0x7fa30016a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:40.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.095+0000 7fa2feffd700 1 --2- 172.21.15.6:0/3190266473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3000b27f0 0x7fa30016a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:40.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.095+0000 7fa2feffd700 1 -- 172.21.15.6:0/3190266473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3000af8b0 msgr2=0x7fa300159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:40.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.095+0000 7fa2feffd700 1 --2- 172.21.15.6:0/3190266473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3000af8b0 0x7fa300159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:40.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.095+0000 7fa2feffd700 1 -- 172.21.15.6:0/3190266473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e8009420 con 0x7fa3000af4e0 2023-10-06T02:29:40.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.095+0000 7fa2feffd700 1 --2- 172.21.15.6:0/3190266473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3000af4e0 0x7fa3000cde20 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000cc40 tx=0x7fa2f0001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:40.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.095+0000 7fa2f6ffd700 1 -- 172.21.15.6:0/3190266473 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000a9c0 con 0x7fa3000af4e0 2023-10-06T02:29:40.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.095+0000 7fa2f6ffd700 1 -- 172.21.15.6:0/3190266473 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f000ab40 con 0x7fa3000af4e0 2023-10-06T02:29:40.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.095+0000 7fa2f6ffd700 1 -- 172.21.15.6:0/3190266473 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f00070f0 con 0x7fa3000af4e0 2023-10-06T02:29:40.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.095+0000 7fa3058d7700 1 -- 172.21.15.6:0/3190266473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f8009420 con 0x7fa3000af4e0 2023-10-06T02:29:40.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.095+0000 7fa3058d7700 1 -- 172.21.15.6:0/3190266473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3000a70a0 con 0x7fa3000af4e0 2023-10-06T02:29:40.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.096+0000 7fa3058d7700 1 -- 172.21.15.6:0/3190266473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa300069270 con 0x7fa3000af4e0 2023-10-06T02:29:40.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.096+0000 7fa2f6ffd700 1 -- 172.21.15.6:0/3190266473 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2f0007520 con 0x7fa3000af4e0 2023-10-06T02:29:40.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.097+0000 7fa2f6ffd700 1 --2- 172.21.15.6:0/3190266473 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa2e0066f30 0x7fa2e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:40.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.097+0000 7fa2f6ffd700 1 -- 172.21.15.6:0/3190266473 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 9732+0+0 (secure 0 0 0) 0x7fa2f0085a10 con 0x7fa3000af4e0 2023-10-06T02:29:40.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.097+0000 7fa2fe7fc700 1 --2- 172.21.15.6:0/3190266473 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa2e0066f30 0x7fa2e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:40.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.098+0000 7fa2fe7fc700 1 --2- 172.21.15.6:0/3190266473 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa2e0066f30 0x7fa2e00693e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fa2e80093f0 tx=0x7fa2e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:40.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.101+0000 7fa2f6ffd700 1 -- 172.21.15.6:0/3190266473 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2f0051d00 con 0x7fa3000af4e0 2023-10-06T02:29:40.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.337+0000 7fa3058d7700 1 -- 172.21.15.6:0/3190266473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3000a72c0 con 0x7fa3000af4e0 2023-10-06T02:29:40.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.337+0000 7fa2f6ffd700 1 -- 172.21.15.6:0/3190266473 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 342 v342) v1 ==== 95+0+4596 (secure 0 0 0) 0x7fa2f0055320 con 0x7fa3000af4e0 2023-10-06T02:29:40.338 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:40.338 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":342,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10653,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1827807239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1827807239},{"type":"v1","addr":"172.21.15.6:6835","nonce":1827807239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":342}],"filesystems":[{"mdsmap":{"epoch":341,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:39.146546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:40.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.340+0000 7fa3058d7700 1 -- 172.21.15.6:0/3190266473 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa2e0066f30 msgr2=0x7fa2e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:40.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.340+0000 7fa3058d7700 1 --2- 172.21.15.6:0/3190266473 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa2e0066f30 0x7fa2e00693e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fa2e80093f0 tx=0x7fa2e8008040 comp rx=0 tx=0).stop 2023-10-06T02:29:40.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.340+0000 7fa3058d7700 1 -- 172.21.15.6:0/3190266473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3000af4e0 msgr2=0x7fa3000cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:40.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.340+0000 7fa3058d7700 1 --2- 172.21.15.6:0/3190266473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3000af4e0 0x7fa3000cde20 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000cc40 tx=0x7fa2f0001a70 comp rx=0 tx=0).stop 2023-10-06T02:29:40.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.340+0000 7fa3058d7700 1 -- 172.21.15.6:0/3190266473 shutdown_connections 2023-10-06T02:29:40.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.340+0000 7fa3058d7700 1 --2- 172.21.15.6:0/3190266473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3000b27f0 0x7fa30016a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:40.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.340+0000 7fa3058d7700 1 --2- 172.21.15.6:0/3190266473 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa2e0066f30 0x7fa2e00693e0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:40.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.340+0000 7fa3058d7700 1 --2- 172.21.15.6:0/3190266473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3000af4e0 0x7fa3000cde20 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:40.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.340+0000 7fa3058d7700 1 --2- 172.21.15.6:0/3190266473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3000af8b0 0x7fa300159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:40.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.340+0000 7fa3058d7700 1 -- 172.21.15.6:0/3190266473 >> 172.21.15.6:0/3190266473 conn(0x7fa300068680 msgr2=0x7fa30015c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:40.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.340+0000 7fa3058d7700 1 -- 172.21.15.6:0/3190266473 shutdown_connections 2023-10-06T02:29:40.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.340+0000 7fa3058d7700 1 -- 172.21.15.6:0/3190266473 wait complete. 2023-10-06T02:29:40.342 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 342 2023-10-06T02:29:40.352 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on mds0_sessionmap' led to DAMAGED state 2023-10-06T02:29:40.353 INFO:tasks.cephfs.test_damage:Applying mutation 'Corrupt omap header on 1.00000000' 2023-10-06T02:29:40.353 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi006.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:29:40.353 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:29:40.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:40.353 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:29:40.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:29:40.368 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:29:40.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:29:40.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.527+0000 7f4e33bf3700 1 Processor -- start 2023-10-06T02:29:40.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.527+0000 7f4e33bf3700 1 -- start start 2023-10-06T02:29:40.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.528+0000 7f4e33bf3700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4e2c15a030 0x7f4e2c15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:40.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.528+0000 7f4e33bf3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2c087700 0x7f4e2c0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:40.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.528+0000 7f4e33bf3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e2c0afc50 con 0x7f4e2c15a940 2023-10-06T02:29:40.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.528+0000 7f4e33bf3700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2c0b0cf0 con 0x7f4e2c15a030 2023-10-06T02:29:40.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.528+0000 7f4e33bf3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c0aff30 con 0x7f4e2c087700 2023-10-06T02:29:40.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.529+0000 7f4e32190700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2c087700 0x7f4e2c0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:40.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.529+0000 7f4e3198f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4e2c15a030 0x7f4e2c15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:40.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.529+0000 7f4e3118e700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4e2c15a940 0x7f4e2c086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:57868/0 (socket says 172.21.15.6:57868) 2023-10-06T02:29:40.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.529+0000 7f4e3118e700 1 -- 172.21.15.6:0/2878693541 learned_addr learned my addr 172.21.15.6:0/2878693541 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:40.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.529+0000 7f4e32190700 1 -- 172.21.15.6:0/2878693541 >> v2:172.21.15.175:3300/0 conn(0x7f4e2c15a030 msgr2=0x7f4e2c15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:40.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.529+0000 7f4e32190700 1 --2- 172.21.15.6:0/2878693541 >> v2:172.21.15.175:3300/0 conn(0x7f4e2c15a030 0x7f4e2c15a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.529+0000 7f4e32190700 1 -- 172.21.15.6:0/2878693541 >> v1:172.21.15.175:6789/0 conn(0x7f4e2c15a940 legacy=0x7f4e2c086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.529+0000 7f4e32190700 1 -- 172.21.15.6:0/2878693541 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c0b0210 con 0x7f4e2c087700 2023-10-06T02:29:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.529+0000 7f4e3198f700 1 --2- 172.21.15.6:0/2878693541 >> v2:172.21.15.175:3300/0 conn(0x7f4e2c15a030 0x7f4e2c15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.529+0000 7f4e32190700 1 --2- 172.21.15.6:0/2878693541 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2c087700 0x7f4e2c0b21b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009e60 tx=0x7f4e1c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=426a387a0d9c0bfd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.529+0000 7f4e3098d700 1 -- 172.21.15.6:0/2878693541 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c00e070 con 0x7f4e2c087700 2023-10-06T02:29:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.529+0000 7f4e3098d700 1 -- 172.21.15.6:0/2878693541 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1c00bb60 con 0x7f4e2c087700 2023-10-06T02:29:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.529+0000 7f4e3098d700 1 -- 172.21.15.6:0/2878693541 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c012430 con 0x7f4e2c087700 2023-10-06T02:29:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.530+0000 7f4e33bf3700 1 -- 172.21.15.6:0/2878693541 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2c087700 msgr2=0x7f4e2c0b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.530+0000 7f4e33bf3700 1 --2- 172.21.15.6:0/2878693541 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2c087700 0x7f4e2c0b21b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009e60 tx=0x7f4e1c009780 comp rx=0 tx=0).stop 2023-10-06T02:29:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.530+0000 7f4e33bf3700 1 -- 172.21.15.6:0/2878693541 shutdown_connections 2023-10-06T02:29:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.530+0000 7f4e33bf3700 1 --2- 172.21.15.6:0/2878693541 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2c087700 0x7f4e2c0b21b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.530+0000 7f4e33bf3700 1 --2- 172.21.15.6:0/2878693541 >> v2:172.21.15.175:3300/0 conn(0x7f4e2c15a030 0x7f4e2c15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.530+0000 7f4e33bf3700 1 -- 172.21.15.6:0/2878693541 >> 172.21.15.6:0/2878693541 conn(0x7f4e2c068680 msgr2=0x7f4e2c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.530+0000 7f4e33bf3700 1 -- 172.21.15.6:0/2878693541 shutdown_connections 2023-10-06T02:29:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.530+0000 7f4e33bf3700 1 -- 172.21.15.6:0/2878693541 wait complete. 2023-10-06T02:29:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.531+0000 7f4e33bf3700 1 Processor -- start 2023-10-06T02:29:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.531+0000 7f4e33bf3700 1 -- start start 2023-10-06T02:29:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.532+0000 7f4e33bf3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2c087700 0x7f4e2c169cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.532+0000 7f4e33bf3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c15a030 0x7f4e2c0c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.532+0000 7f4e33bf3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e2c15a940 0x7f4e2c0c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.532+0000 7f4e33bf3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c15ba50 con 0x7f4e2c15a030 2023-10-06T02:29:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.532+0000 7f4e33bf3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c15b740 con 0x7f4e2c15a940 2023-10-06T02:29:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.532+0000 7f4e33bf3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c0c4bd0 con 0x7f4e2c087700 2023-10-06T02:29:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.532+0000 7f4e3118e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c15a030 0x7f4e2c0c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.532+0000 7f4e3118e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c15a030 0x7f4e2c0c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56630/0 (socket says 172.21.15.6:56630) 2023-10-06T02:29:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.532+0000 7f4e3118e700 1 -- 172.21.15.6:0/4229665726 learned_addr learned my addr 172.21.15.6:0/4229665726 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.532+0000 7f4e32190700 1 --2- 172.21.15.6:0/4229665726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e2c15a940 0x7f4e2c0c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.532+0000 7f4e3198f700 1 --2- 172.21.15.6:0/4229665726 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2c087700 0x7f4e2c169cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.532+0000 7f4e3118e700 1 -- 172.21.15.6:0/4229665726 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2c087700 msgr2=0x7f4e2c169cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.532+0000 7f4e3118e700 1 --2- 172.21.15.6:0/4229665726 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2c087700 0x7f4e2c169cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.532+0000 7f4e3118e700 1 -- 172.21.15.6:0/4229665726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e2c15a940 msgr2=0x7f4e2c0c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.532+0000 7f4e3118e700 1 --2- 172.21.15.6:0/4229665726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e2c15a940 0x7f4e2c0c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.532+0000 7f4e3118e700 1 -- 172.21.15.6:0/4229665726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e24009420 con 0x7f4e2c15a030 2023-10-06T02:29:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.532+0000 7f4e3198f700 1 --2- 172.21.15.6:0/4229665726 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2c087700 0x7f4e2c169cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.533+0000 7f4e3118e700 1 --2- 172.21.15.6:0/4229665726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c15a030 0x7f4e2c0c43a0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000c590 tx=0x7f4e20007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.533+0000 7f4e29ffb700 1 -- 172.21.15.6:0/4229665726 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e20005b30 con 0x7f4e2c15a030 2023-10-06T02:29:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.533+0000 7f4e29ffb700 1 -- 172.21.15.6:0/4229665726 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e20005cb0 con 0x7f4e2c15a030 2023-10-06T02:29:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.533+0000 7f4e33bf3700 1 -- 172.21.15.6:0/4229665726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1c009a20 con 0x7f4e2c15a030 2023-10-06T02:29:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.533+0000 7f4e29ffb700 1 -- 172.21.15.6:0/4229665726 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e20007320 con 0x7f4e2c15a030 2023-10-06T02:29:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.533+0000 7f4e33bf3700 1 -- 172.21.15.6:0/4229665726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2c0c5190 con 0x7f4e2c15a030 2023-10-06T02:29:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.534+0000 7f4e33bf3700 1 -- 172.21.15.6:0/4229665726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2c0c5380 con 0x7f4e2c15a030 2023-10-06T02:29:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.534+0000 7f4e29ffb700 1 -- 172.21.15.6:0/4229665726 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e2001c440 con 0x7f4e2c15a030 2023-10-06T02:29:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.535+0000 7f4e29ffb700 1 --2- 172.21.15.6:0/4229665726 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e18066f30 0x7f4e180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.535+0000 7f4e29ffb700 1 -- 172.21.15.6:0/4229665726 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 9732+0+0 (secure 0 0 0) 0x7f4e20084740 con 0x7f4e2c15a030 2023-10-06T02:29:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.535+0000 7f4e3198f700 1 --2- 172.21.15.6:0/4229665726 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e18066f30 0x7f4e180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.535+0000 7f4e3198f700 1 --2- 172.21.15.6:0/4229665726 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e18066f30 0x7f4e180693e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f4e24011600 tx=0x7f4e240091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.539+0000 7f4e29ffb700 1 -- 172.21.15.6:0/4229665726 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e2004b5a0 con 0x7f4e2c15a030 2023-10-06T02:29:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:40.779+0000 7f4e33bf3700 1 -- 172.21.15.6:0/4229665726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4e2c0b04f0 con 0x7f4e2c15a030 2023-10-06T02:29:41.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.160+0000 7f4e29ffb700 1 -- 172.21.15.6:0/4229665726 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v343) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4e20017090 con 0x7f4e2c15a030 2023-10-06T02:29:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.162+0000 7f4e33bf3700 1 -- 172.21.15.6:0/4229665726 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e18066f30 msgr2=0x7f4e180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.162+0000 7f4e33bf3700 1 --2- 172.21.15.6:0/4229665726 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e18066f30 0x7f4e180693e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f4e24011600 tx=0x7f4e240091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.162+0000 7f4e33bf3700 1 -- 172.21.15.6:0/4229665726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c15a030 msgr2=0x7f4e2c0c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.162+0000 7f4e33bf3700 1 --2- 172.21.15.6:0/4229665726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c15a030 0x7f4e2c0c43a0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000c590 tx=0x7f4e20007f70 comp rx=0 tx=0).stop 2023-10-06T02:29:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.162+0000 7f4e33bf3700 1 -- 172.21.15.6:0/4229665726 shutdown_connections 2023-10-06T02:29:41.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.162+0000 7f4e33bf3700 1 --2- 172.21.15.6:0/4229665726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e2c15a940 0x7f4e2c0c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:41.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.162+0000 7f4e33bf3700 1 --2- 172.21.15.6:0/4229665726 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2c087700 0x7f4e2c169cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:41.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.162+0000 7f4e33bf3700 1 --2- 172.21.15.6:0/4229665726 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4e18066f30 0x7f4e180693e0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:41.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.162+0000 7f4e33bf3700 1 --2- 172.21.15.6:0/4229665726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c15a030 0x7f4e2c0c43a0 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:41.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.162+0000 7f4e33bf3700 1 -- 172.21.15.6:0/4229665726 >> 172.21.15.6:0/4229665726 conn(0x7f4e2c068680 msgr2=0x7f4e2c0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:41.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.162+0000 7f4e33bf3700 1 -- 172.21.15.6:0/4229665726 shutdown_connections 2023-10-06T02:29:41.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.162+0000 7f4e33bf3700 1 -- 172.21.15.6:0/4229665726 wait complete. 2023-10-06T02:29:41.164 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:29:41.176 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-10-06T02:29:41.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.297+0000 7f850258f700 1 Processor -- start 2023-10-06T02:29:41.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.297+0000 7f850258f700 1 -- start start 2023-10-06T02:29:41.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.298+0000 7f850258f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f84fc0cfe90 0x7f84fc0d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:41.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.298+0000 7f850258f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84fc0ceea0 con 0x7f84fc15abe0 2023-10-06T02:29:41.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.298+0000 7f850258f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84fc15a690 con 0x7f84fc153a10 2023-10-06T02:29:41.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.298+0000 7f850258f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84fc069140 con 0x7f84fc0cfe90 2023-10-06T02:29:41.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.298+0000 7f8501d8e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f84fc15abe0 0x7f84fc15afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37852/0 (socket says 172.21.15.6:37852) 2023-10-06T02:29:41.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.298+0000 7f8501d8e700 1 -- 172.21.15.6:0/1764481853 learned_addr learned my addr 172.21.15.6:0/1764481853 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:41.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.298+0000 7f8500d8c700 1 --2- 172.21.15.6:0/1764481853 >> v2:172.21.15.175:3300/0 conn(0x7f84fc0cfe90 0x7f84fc0d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:41.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.298+0000 7f84fbfff700 1 -- 172.21.15.6:0/1764481853 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225201601 0 0) 0x7f84fc0ceea0 con 0x7f84fc15abe0 2023-10-06T02:29:41.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.298+0000 7f84fbfff700 1 -- 172.21.15.6:0/1764481853 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84e4003570 con 0x7f84fc15abe0 2023-10-06T02:29:41.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.298+0000 7f84fbfff700 1 -- 172.21.15.6:0/1764481853 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922009473 0 0) 0x7f84fc15a690 con 0x7f84fc153a10 2023-10-06T02:29:41.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.299+0000 7f84fbfff700 1 -- 172.21.15.6:0/1764481853 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84fc0ceea0 con 0x7f84fc153a10 2023-10-06T02:29:41.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.299+0000 7f8500d8c700 1 -- 172.21.15.6:0/1764481853 >> v1:172.21.15.175:6789/0 conn(0x7f84fc153a10 legacy=0x7f84fc0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:41.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.299+0000 7f8500d8c700 1 -- 172.21.15.6:0/1764481853 >> v1:172.21.15.6:6789/0 conn(0x7f84fc15abe0 legacy=0x7f84fc15afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:41.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.299+0000 7f84fbfff700 1 -- 172.21.15.6:0/1764481853 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1810360533 0 0) 0x7f84e4003570 con 0x7f84fc15abe0 2023-10-06T02:29:41.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.299+0000 7f8500d8c700 1 -- 172.21.15.6:0/1764481853 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc0ce850 con 0x7f84fc0cfe90 2023-10-06T02:29:41.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.299+0000 7f8500d8c700 1 --2- 172.21.15.6:0/1764481853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84fc0cfe90 0x7f84fc0d0310 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f84f00098e0 tx=0x7f84f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd7a9153fdcfd46c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:41.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.299+0000 7f84fbfff700 1 -- 172.21.15.6:0/1764481853 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec0017f0 con 0x7f84fc0cfe90 2023-10-06T02:29:41.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.299+0000 7f84fbfff700 1 -- 172.21.15.6:0/1764481853 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f0011420 con 0x7f84fc0cfe90 2023-10-06T02:29:41.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.299+0000 7f84fbfff700 1 -- 172.21.15.6:0/1764481853 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f00117c0 con 0x7f84fc0cfe90 2023-10-06T02:29:41.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.300+0000 7f850258f700 1 -- 172.21.15.6:0/1764481853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84fc0cfe90 msgr2=0x7f84fc0d0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:41.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.300+0000 7f850258f700 1 --2- 172.21.15.6:0/1764481853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84fc0cfe90 0x7f84fc0d0310 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f84f00098e0 tx=0x7f84f00091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:41.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.300+0000 7f850258f700 1 -- 172.21.15.6:0/1764481853 shutdown_connections 2023-10-06T02:29:41.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.300+0000 7f850258f700 1 --2- 172.21.15.6:0/1764481853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84fc0cfe90 0x7f84fc0d0310 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:41.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.300+0000 7f850258f700 1 -- 172.21.15.6:0/1764481853 >> 172.21.15.6:0/1764481853 conn(0x7f84fc06ac00 msgr2=0x7f84fc068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:41.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.300+0000 7f850258f700 1 -- 172.21.15.6:0/1764481853 shutdown_connections 2023-10-06T02:29:41.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.300+0000 7f850258f700 1 -- 172.21.15.6:0/1764481853 wait complete. 2023-10-06T02:29:41.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.301+0000 7f850258f700 1 Processor -- start 2023-10-06T02:29:41.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.301+0000 7f850258f700 1 -- start start 2023-10-06T02:29:41.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f850258f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84fc0cfe90 0x7f84fc158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:41.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f850258f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84fc153a10 0x7f84fc14dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:41.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f850258f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84fc15abe0 0x7f84fc1558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:41.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f850258f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc14e290 con 0x7f84fc0cfe90 2023-10-06T02:29:41.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f850258f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc16a0f0 con 0x7f84fc15abe0 2023-10-06T02:29:41.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f850258f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc16a3d0 con 0x7f84fc153a10 2023-10-06T02:29:41.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f850158d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84fc0cfe90 0x7f84fc158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:41.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f850158d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84fc0cfe90 0x7f84fc158080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56640/0 (socket says 172.21.15.6:56640) 2023-10-06T02:29:41.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f850158d700 1 -- 172.21.15.6:0/3145805301 learned_addr learned my addr 172.21.15.6:0/3145805301 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f8501d8e700 1 --2- 172.21.15.6:0/3145805301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84fc15abe0 0x7f84fc1558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f8500d8c700 1 --2- 172.21.15.6:0/3145805301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84fc153a10 0x7f84fc14dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f850158d700 1 -- 172.21.15.6:0/3145805301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84fc153a10 msgr2=0x7f84fc14dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f850158d700 1 --2- 172.21.15.6:0/3145805301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84fc153a10 0x7f84fc14dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f850158d700 1 -- 172.21.15.6:0/3145805301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84fc15abe0 msgr2=0x7f84fc1558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f850158d700 1 --2- 172.21.15.6:0/3145805301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84fc15abe0 0x7f84fc1558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f850158d700 1 -- 172.21.15.6:0/3145805301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f0009420 con 0x7f84fc0cfe90 2023-10-06T02:29:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f850158d700 1 --2- 172.21.15.6:0/3145805301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84fc0cfe90 0x7f84fc158080 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f84f400c790 tx=0x7f84f4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f84f97fa700 1 -- 172.21.15.6:0/3145805301 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4010510 con 0x7f84fc0cfe90 2023-10-06T02:29:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f84f97fa700 1 -- 172.21.15.6:0/3145805301 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f4010670 con 0x7f84fc0cfe90 2023-10-06T02:29:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.302+0000 7f850258f700 1 -- 172.21.15.6:0/3145805301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84fc16a6b0 con 0x7f84fc0cfe90 2023-10-06T02:29:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.303+0000 7f84f97fa700 1 -- 172.21.15.6:0/3145805301 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4010a10 con 0x7f84fc0cfe90 2023-10-06T02:29:41.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.303+0000 7f850258f700 1 -- 172.21.15.6:0/3145805301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84fc16ac70 con 0x7f84fc0cfe90 2023-10-06T02:29:41.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.304+0000 7f850258f700 1 -- 172.21.15.6:0/3145805301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84fc0b0970 con 0x7f84fc0cfe90 2023-10-06T02:29:41.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.304+0000 7f84f97fa700 1 -- 172.21.15.6:0/3145805301 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84f401b3b0 con 0x7f84fc0cfe90 2023-10-06T02:29:41.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.304+0000 7f84f97fa700 1 --2- 172.21.15.6:0/3145805301 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84e8066f30 0x7f84e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:41.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.304+0000 7f84f97fa700 1 -- 172.21.15.6:0/3145805301 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 9732+0+0 (secure 0 0 0) 0x7f84f4084e60 con 0x7f84fc0cfe90 2023-10-06T02:29:41.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.304+0000 7f8500d8c700 1 --2- 172.21.15.6:0/3145805301 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84e8066f30 0x7f84e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:41.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.305+0000 7f8500d8c700 1 --2- 172.21.15.6:0/3145805301 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84e8066f30 0x7f84e80693e0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f84f00093f0 tx=0x7f84f0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:41.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.308+0000 7f84f97fa700 1 -- 172.21.15.6:0/3145805301 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84f40510d0 con 0x7f84fc0cfe90 2023-10-06T02:29:41.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:41.584+0000 7f850258f700 1 -- 172.21.15.6:0/3145805301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f84fc15a970 con 0x7f84fc0cfe90 2023-10-06T02:29:42.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.162+0000 7f84f97fa700 1 -- 172.21.15.6:0/3145805301 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 6:0 v344) v1 ==== 101+0+0 (secure 0 0 0) 0x7f84f4017070 con 0x7f84fc0cfe90 2023-10-06T02:29:42.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.165+0000 7f850258f700 1 -- 172.21.15.6:0/3145805301 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84e8066f30 msgr2=0x7f84e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.165+0000 7f850258f700 1 --2- 172.21.15.6:0/3145805301 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84e8066f30 0x7f84e80693e0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f84f00093f0 tx=0x7f84f0016000 comp rx=0 tx=0).stop 2023-10-06T02:29:42.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.165+0000 7f850258f700 1 -- 172.21.15.6:0/3145805301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84fc0cfe90 msgr2=0x7f84fc158080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.165+0000 7f850258f700 1 --2- 172.21.15.6:0/3145805301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84fc0cfe90 0x7f84fc158080 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f84f400c790 tx=0x7f84f4007e10 comp rx=0 tx=0).stop 2023-10-06T02:29:42.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.165+0000 7f850258f700 1 -- 172.21.15.6:0/3145805301 shutdown_connections 2023-10-06T02:29:42.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.165+0000 7f850258f700 1 --2- 172.21.15.6:0/3145805301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84fc15abe0 0x7f84fc1558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.165+0000 7f850258f700 1 --2- 172.21.15.6:0/3145805301 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f84e8066f30 0x7f84e80693e0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.165+0000 7f850258f700 1 --2- 172.21.15.6:0/3145805301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84fc0cfe90 0x7f84fc158080 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.165+0000 7f850258f700 1 --2- 172.21.15.6:0/3145805301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84fc153a10 0x7f84fc14dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.165+0000 7f850258f700 1 -- 172.21.15.6:0/3145805301 >> 172.21.15.6:0/3145805301 conn(0x7f84fc06ac00 msgr2=0x7f84fc0b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.165+0000 7f850258f700 1 -- 172.21.15.6:0/3145805301 shutdown_connections 2023-10-06T02:29:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.165+0000 7f850258f700 1 -- 172.21.15.6:0/3145805301 wait complete. 2023-10-06T02:29:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:repaired: restoring rank 6:0 2023-10-06T02:29:42.180 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata import - 2023-10-06T02:29:42.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.220+0000 7f9c3ba38000 1 Processor -- start 2023-10-06T02:29:42.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.220+0000 7f9c3ba38000 1 -- start start 2023-10-06T02:29:42.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.221+0000 7f9c3ba38000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aceccd0850 0x55acecca1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.221+0000 7f9c3ba38000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aceccd2ab0 0x55acecca1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.221+0000 7f9c3ba38000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aceccd2e80 0x55acecd797c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.221+0000 7f9c3ba38000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acecc4a320 con 0x55aceccd2e80 2023-10-06T02:29:42.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.221+0000 7f9c3ba38000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acecbee980 con 0x55aceccd0850 2023-10-06T02:29:42.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.221+0000 7f9c3ba38000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55acecbee620 con 0x55aceccd2ab0 2023-10-06T02:29:42.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.221+0000 7f9c35474700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aceccd2e80 0x55acecd797c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.221+0000 7f9c35474700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aceccd2e80 0x55acecd797c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56650/0 (socket says 172.21.15.6:56650) 2023-10-06T02:29:42.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.221+0000 7f9c35474700 1 -- 172.21.15.6:0/1815756341 learned_addr learned my addr 172.21.15.6:0/1815756341 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:42.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.221+0000 7f9c34472700 1 --2- 172.21.15.6:0/1815756341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aceccd2ab0 0x55acecca1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.221+0000 7f9c34c73700 1 --2- 172.21.15.6:0/1815756341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aceccd0850 0x55acecca1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.222+0000 7f9c35474700 1 -- 172.21.15.6:0/1815756341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aceccd2ab0 msgr2=0x55acecca1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:42.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.222+0000 7f9c35474700 1 --2- 172.21.15.6:0/1815756341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aceccd2ab0 0x55acecca1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.222+0000 7f9c35474700 1 -- 172.21.15.6:0/1815756341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aceccd0850 msgr2=0x55acecca1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:42.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.222+0000 7f9c35474700 1 --2- 172.21.15.6:0/1815756341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aceccd0850 0x55acecca1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.222+0000 7f9c35474700 1 -- 172.21.15.6:0/1815756341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c005cf0 con 0x55aceccd2e80 2023-10-06T02:29:42.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.222+0000 7f9c35474700 1 --2- 172.21.15.6:0/1815756341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aceccd2e80 0x55acecd797c0 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00a520 tx=0x7f9c2c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8bde166713d5568 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:42.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.222+0000 7f9c33470700 1 -- 172.21.15.6:0/1815756341 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c01a070 con 0x55aceccd2e80 2023-10-06T02:29:42.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.222+0000 7f9c33470700 1 -- 172.21.15.6:0/1815756341 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c0136c0 con 0x55aceccd2e80 2023-10-06T02:29:42.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.222+0000 7f9c33470700 1 -- 172.21.15.6:0/1815756341 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c013dc0 con 0x55aceccd2e80 2023-10-06T02:29:42.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.222+0000 7f9c3ba38000 1 -- 172.21.15.6:0/1815756341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aceccd2e80 msgr2=0x55acecd797c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.222+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/1815756341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aceccd2e80 0x55acecd797c0 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00a520 tx=0x7f9c2c013000 comp rx=0 tx=0).stop 2023-10-06T02:29:42.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.223+0000 7f9c3ba38000 1 -- 172.21.15.6:0/1815756341 shutdown_connections 2023-10-06T02:29:42.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.223+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/1815756341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aceccd2e80 0x55acecd797c0 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.223+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/1815756341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aceccd0850 0x55acecca1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.223+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/1815756341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aceccd2ab0 0x55acecca1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.223+0000 7f9c3ba38000 1 -- 172.21.15.6:0/1815756341 >> 172.21.15.6:0/1815756341 conn(0x55acecceabd0 msgr2=0x55acecced440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:42.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.223+0000 7f9c3ba38000 1 -- 172.21.15.6:0/1815756341 shutdown_connections 2023-10-06T02:29:42.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.223+0000 7f9c3ba38000 1 -- 172.21.15.6:0/1815756341 wait complete. 2023-10-06T02:29:42.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.223+0000 7f9c3ba38000 1 Processor -- start 2023-10-06T02:29:42.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.223+0000 7f9c3ba38000 1 -- start start 2023-10-06T02:29:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.224+0000 7f9c3ba38000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aceccd0850 0x55acecd6fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.224+0000 7f9c3ba38000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aceccd2ab0 0x55acecccf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.224+0000 7f9c3ba38000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aceccd2e80 0x55acecccfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.224+0000 7f9c3ba38000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acecbe5400 con 0x55aceccd0850 2023-10-06T02:29:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.224+0000 7f9c3ba38000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aceccea110 con 0x55aceccd2e80 2023-10-06T02:29:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.224+0000 7f9c3ba38000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55acecce9930 con 0x55aceccd2ab0 2023-10-06T02:29:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.224+0000 7f9c34c73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aceccd0850 0x55acecd6fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.224+0000 7f9c34c73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aceccd0850 0x55acecd6fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56656/0 (socket says 172.21.15.6:56656) 2023-10-06T02:29:42.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.224+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 learned_addr learned my addr 172.21.15.6:0/3821967638 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:42.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.224+0000 7f9c34472700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aceccd2ab0 0x55acecccf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.224+0000 7f9c35474700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aceccd2e80 0x55acecccfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.225+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aceccd2ab0 msgr2=0x55acecccf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.225+0000 7f9c34c73700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aceccd2ab0 0x55acecccf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.225+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aceccd2e80 msgr2=0x55acecccfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.225+0000 7f9c34c73700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aceccd2e80 0x55acecccfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.225+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55acecbfd3d0 con 0x55aceccd0850 2023-10-06T02:29:42.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.225+0000 7f9c34c73700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aceccd0850 0x55acecd6fe00 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400d4c0 tx=0x7f9c24006970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:42.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.225+0000 7f9c31c6d700 1 -- 172.21.15.6:0/3821967638 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c24013480 con 0x55aceccd0850 2023-10-06T02:29:42.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.225+0000 7f9c31c6d700 1 -- 172.21.15.6:0/3821967638 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c240135e0 con 0x55aceccd0850 2023-10-06T02:29:42.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.225+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55acecbf0ae0 con 0x55aceccd0850 2023-10-06T02:29:42.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.225+0000 7f9c31c6d700 1 -- 172.21.15.6:0/3821967638 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c24013980 con 0x55aceccd0850 2023-10-06T02:29:42.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.225+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55acecbf0540 con 0x55aceccd0850 2023-10-06T02:29:42.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.226+0000 7f9c31c6d700 1 -- 172.21.15.6:0/3821967638 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c240123e0 con 0x55aceccd0850 2023-10-06T02:29:42.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.227+0000 7f9c31c6d700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c14065890 0x7f9c14067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.227+0000 7f9c31c6d700 1 -- 172.21.15.6:0/3821967638 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 9732+0+0 (secure 0 0 0) 0x7f9c24083db0 con 0x55aceccd0850 2023-10-06T02:29:42.233 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pool 2023-10-06T02:29:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.227+0000 7f9c34472700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c14065890 0x7f9c14067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.227+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55acecd7a940 0x55acecd76e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.227+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:1 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd773b0 con 0x55acecd7a940 2023-10-06T02:29:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.227+0000 7f9c35474700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55acecd7a940 0x55acecd76e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.228+0000 7f9c35474700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55acecd7a940 0x55acecd76e70 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.228+0000 7f9c34472700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c14065890 0x7f9c14067d40 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c000ff0 tx=0x7f9c1c000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.230+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(1 601.00000000 [create] v134'1190 uv1164 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.230+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:2 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd77790 con 0x55acecd7a940 2023-10-06T02:29:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.231+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== osd_op_reply(2 601.00000000 [delete] v134'1191 uv1191 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.231+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:3 14.10 14:09401a81:::601.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd97230 con 0x55acecd7a940 2023-10-06T02:29:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.233+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 3 ==== osd_op_reply(3 601.00000000 [create] v134'1192 uv1192 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.235 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::601.00000000:head# 2023-10-06T02:29:42.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.233+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:4 14.10 14:09401a81:::601.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd985f0 con 0x55acecd7a940 2023-10-06T02:29:42.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.234+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 4 ==== osd_op_reply(4 601.00000000 [setxattr (30)] v134'1193 uv1193 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.234+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:5 14.10 14:09401a81:::601.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd989a0 con 0x55acecd7a940 2023-10-06T02:29:42.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.235+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 5 ==== osd_op_reply(5 601.00000000 [setxattr (62)] v134'1194 uv1194 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.235+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:6 14.10 14:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.236+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 6 ==== osd_op_reply(6 601.00000000 [omap-set-header] v134'1195 uv1195 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.236+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.238+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 7 ==== osd_op_reply(7 602.00000000 [create] v134'1196 uv1170 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.238+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:8 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.239+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 8 ==== osd_op_reply(8 602.00000000 [delete] v134'1197 uv1197 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.239+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:9 14.10 14:0bd6d154:::602.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.241 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::602.00000000:head# 2023-10-06T02:29:42.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.240+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 9 ==== osd_op_reply(9 602.00000000 [create] v134'1198 uv1198 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.240+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:10 14.10 14:0bd6d154:::602.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.242+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 10 ==== osd_op_reply(10 602.00000000 [setxattr (30)] v134'1199 uv1199 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.242+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:11 14.10 14:0bd6d154:::602.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd98d50 con 0x55acecd7a940 2023-10-06T02:29:42.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.243+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 11 ==== osd_op_reply(11 602.00000000 [setxattr (62)] v134'1200 uv1200 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.243+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:12 14.10 14:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.244+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 12 ==== osd_op_reply(12 602.00000000 [omap-set-header] v134'1201 uv1201 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.244+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:13 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.245+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 13 ==== osd_op_reply(13 10000000000.00000000 [create] v134'1202 uv1177 ondisk = -17 ((17) File exists)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.246+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:14 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.247+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 14 ==== osd_op_reply(14 10000000000.00000000 [delete] v134'1203 uv1203 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.247+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:15 14.10 14:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.248+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 15 ==== osd_op_reply(15 10000000000.00000000 [create] v134'1204 uv1204 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.249 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::10000000000.00000000:head# 2023-10-06T02:29:42.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.248+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:16 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.249+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 16 ==== osd_op_reply(16 10000000000.00000000 [setxattr (30)] v134'1205 uv1205 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.249+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:17 14.10 14:0cf6ad0f:::10000000000.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd98d50 con 0x55acecd7a940 2023-10-06T02:29:42.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.251+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 17 ==== osd_op_reply(17 10000000000.00000000 [setxattr (62)] v134'1206 uv1206 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.251+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:18 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.252+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 18 ==== osd_op_reply(18 10000000000.00000000 [omap-set-header] v134'1207 uv1207 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.252+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:19 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.253+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 19 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v134'1208 uv1208 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.253+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:20 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.255+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 20 ==== osd_op_reply(20 600.00000000 [create] v134'1209 uv1183 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.255+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:21 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.256+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 21 ==== osd_op_reply(21 600.00000000 [delete] v134'1210 uv1210 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.256+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:22 14.10 14:0d82a743:::600.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.257 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::600.00000000:head# 2023-10-06T02:29:42.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.257+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 22 ==== osd_op_reply(22 600.00000000 [create] v134'1211 uv1211 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.257+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:23 14.10 14:0d82a743:::600.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.258+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 23 ==== osd_op_reply(23 600.00000000 [setxattr (30)] v134'1212 uv1212 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.258+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:24 14.10 14:0d82a743:::600.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd98d50 con 0x55acecd7a940 2023-10-06T02:29:42.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.260+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 24 ==== osd_op_reply(24 600.00000000 [setxattr (62)] v134'1213 uv1213 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.260+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:25 14.10 14:0d82a743:::600.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.261+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 25 ==== osd_op_reply(25 600.00000000 [omap-set-header] v134'1214 uv1214 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.261+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:26 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.263+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 26 ==== osd_op_reply(26 603.00000000 [create] v134'1215 uv1189 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.263+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:27 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.264+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 27 ==== osd_op_reply(27 603.00000000 [delete] v134'1216 uv1216 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.264+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:28 14.10 14:0d89b25e:::603.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.265 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::603.00000000:head# 2023-10-06T02:29:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.265+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 28 ==== osd_op_reply(28 603.00000000 [create] v134'1217 uv1217 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.265+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:29 14.10 14:0d89b25e:::603.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd98d50 con 0x55acecd7a940 2023-10-06T02:29:42.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.266+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 29 ==== osd_op_reply(29 603.00000000 [setxattr (30)] v134'1218 uv1218 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.266+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:30 14.10 14:0d89b25e:::603.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd98d50 con 0x55acecd7a940 2023-10-06T02:29:42.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.267+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 30 ==== osd_op_reply(30 603.00000000 [setxattr (62)] v134'1219 uv1219 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.267+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:31 14.10 14:0d89b25e:::603.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd7a940 2023-10-06T02:29:42.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.269+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.1 v2:172.21.15.6:6800/90678 31 ==== osd_op_reply(31 603.00000000 [omap-set-header] v134'1220 uv1220 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecd7a940 2023-10-06T02:29:42.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.269+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55acecd97ed0 0x55acecd9ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.269+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:32 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd975e0 con 0x55acecd97ed0 2023-10-06T02:29:42.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.269+0000 7f9c34c73700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55acecd97ed0 0x55acecd9ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.269+0000 7f9c34c73700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55acecd97ed0 0x55acecd9ad60 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:42.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.271+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== osd_op_reply(32 1.00000000.inode [create] v134'856 uv839 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.271+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:33 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9b2a0 con 0x55acecd97ed0 2023-10-06T02:29:42.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.273+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== osd_op_reply(33 1.00000000.inode [delete] v134'857 uv857 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.273+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:34 14.14 14:287034c4:::1.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9b650 con 0x55acecd97ed0 2023-10-06T02:29:42.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.274+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 3 ==== osd_op_reply(34 1.00000000.inode [create] v134'858 uv858 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.275 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000.inode:head# 2023-10-06T02:29:42.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.274+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:35 14.14 14:287034c4:::1.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9bef0 con 0x55acecd97ed0 2023-10-06T02:29:42.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.275+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 4 ==== osd_op_reply(35 1.00000000.inode [write 0~554] v134'859 uv859 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.275+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:36 14.14 14:287034c4:::1.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9c2a0 con 0x55acecd97ed0 2023-10-06T02:29:42.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.277+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 5 ==== osd_op_reply(36 1.00000000.inode [omap-set-header] v134'860 uv860 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.277+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:37 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9c650 con 0x55acecd97ed0 2023-10-06T02:29:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.278+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 6 ==== osd_op_reply(37 200.00000000 [create] v134'861 uv844 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.278+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:38 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9ca00 con 0x55acecd97ed0 2023-10-06T02:29:42.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.279+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 7 ==== osd_op_reply(38 200.00000000 [delete] v134'862 uv862 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.279+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9ca00 con 0x55acecd97ed0 2023-10-06T02:29:42.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.280+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 8 ==== osd_op_reply(39 200.00000000 [create] v134'863 uv863 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.281 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000000:head# 2023-10-06T02:29:42.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.280+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:40 14.14 14:292cf221:::200.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9ca00 con 0x55acecd97ed0 2023-10-06T02:29:42.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.282+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 9 ==== osd_op_reply(40 200.00000000 [write 0~90] v134'864 uv864 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.282+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:41 14.14 14:292cf221:::200.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9ca00 con 0x55acecd97ed0 2023-10-06T02:29:42.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.283+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 10 ==== osd_op_reply(41 200.00000000 [omap-set-header] v134'865 uv865 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.283+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:42 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9ca00 con 0x55acecd97ed0 2023-10-06T02:29:42.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.284+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 11 ==== osd_op_reply(42 200.00000001 [create] v134'866 uv849 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.284+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:43 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9ca00 con 0x55acecd97ed0 2023-10-06T02:29:42.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.286+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 12 ==== osd_op_reply(43 200.00000001 [delete] v134'867 uv867 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.286+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:44 14.14 14:2e2fa760:::200.00000001:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9ca00 con 0x55acecd97ed0 2023-10-06T02:29:42.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.287+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 13 ==== osd_op_reply(44 200.00000001 [create] v134'868 uv868 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.287 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::200.00000001:head# 2023-10-06T02:29:42.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.287+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:45 14.14 14:2e2fa760:::200.00000001:head [write 0~14075 in=14075b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda0120 con 0x55acecd97ed0 2023-10-06T02:29:42.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.288+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 14 ==== osd_op_reply(45 200.00000001 [write 0~14075] v134'869 uv869 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.288+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:46 14.14 14:2e2fa760:::200.00000001:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda0120 con 0x55acecd97ed0 2023-10-06T02:29:42.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.289+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 15 ==== osd_op_reply(46 200.00000001 [omap-set-header] v134'870 uv870 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.289+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:47 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9ca00 con 0x55acecd97ed0 2023-10-06T02:29:42.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.291+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 16 ==== osd_op_reply(47 606.00000000 [create] v134'871 uv855 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.291+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:48 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9ca00 con 0x55acecd97ed0 2023-10-06T02:29:42.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.292+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 17 ==== osd_op_reply(48 606.00000000 [delete] v134'872 uv872 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.292+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:49 14.14 14:2f55791f:::606.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9ca00 con 0x55acecd97ed0 2023-10-06T02:29:42.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.293+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 18 ==== osd_op_reply(49 606.00000000 [create] v134'873 uv873 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.294 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::606.00000000:head# 2023-10-06T02:29:42.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.293+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:50 14.14 14:2f55791f:::606.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9da10 con 0x55acecd97ed0 2023-10-06T02:29:42.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.294+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 19 ==== osd_op_reply(50 606.00000000 [setxattr (30)] v134'874 uv874 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.294+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:51 14.14 14:2f55791f:::606.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9da10 con 0x55acecd97ed0 2023-10-06T02:29:42.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.295+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 20 ==== osd_op_reply(51 606.00000000 [setxattr (62)] v134'875 uv875 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.295+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:52 14.14 14:2f55791f:::606.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9ca00 con 0x55acecd97ed0 2023-10-06T02:29:42.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.296+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 21 ==== osd_op_reply(52 606.00000000 [omap-set-header] v134'876 uv876 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.296+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55acecd9cf10 0x55acecd9f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.296+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:53 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9f880 con 0x55acecd9cf10 2023-10-06T02:29:42.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.297+0000 7f9c34472700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55acecd9cf10 0x55acecd9f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.297+0000 7f9c34472700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55acecd9cf10 0x55acecd9f2f0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.298+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(53 607.00000000 [create] v134'231 uv230 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.298+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:54 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9baf0 con 0x55acecd9cf10 2023-10-06T02:29:42.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.299+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(54 607.00000000 [delete] v134'232 uv232 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.299+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:55 14.1c 14:3ed09add:::607.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecd9fd30 con 0x55acecd9cf10 2023-10-06T02:29:42.301 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::607.00000000:head# 2023-10-06T02:29:42.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.300+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(55 607.00000000 [create] v134'233 uv233 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.300+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:56 14.1c 14:3ed09add:::607.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda1c70 con 0x55acecd9cf10 2023-10-06T02:29:42.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.301+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(56 607.00000000 [setxattr (30)] v134'234 uv234 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.301+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:57 14.1c 14:3ed09add:::607.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda2020 con 0x55acecd9cf10 2023-10-06T02:29:42.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.303+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 5 ==== osd_op_reply(57 607.00000000 [setxattr (62)] v134'235 uv235 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.303+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:58 14.1c 14:3ed09add:::607.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda0c60 con 0x55acecd9cf10 2023-10-06T02:29:42.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.304+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 6 ==== osd_op_reply(58 607.00000000 [omap-set-header] v134'236 uv236 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.304+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:59 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda1090 con 0x55acecd9cf10 2023-10-06T02:29:42.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.305+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 7 ==== osd_op_reply(59 mds0_openfiles.0 [create] v134'167 uv166 ondisk = -17 ((17) File exists)) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.305+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:60 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda14c0 con 0x55acecd9cf10 2023-10-06T02:29:42.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.306+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 8 ==== osd_op_reply(60 mds0_openfiles.0 [delete] v134'168 uv168 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.306+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:61 14.6 14:654134d2:::mds0_openfiles.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda14c0 con 0x55acecd9cf10 2023-10-06T02:29:42.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.307+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 9 ==== osd_op_reply(61 mds0_openfiles.0 [create] v134'169 uv169 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.307 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_openfiles.0:head# 2023-10-06T02:29:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.307+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:62 14.6 14:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda1470 con 0x55acecd9cf10 2023-10-06T02:29:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.308+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 10 ==== osd_op_reply(62 mds0_openfiles.0 [omap-set-header] v134'170 uv170 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.308+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:63 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda1440 con 0x55acecd97ed0 2023-10-06T02:29:42.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.309+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 22 ==== osd_op_reply(63 608.00000000 [create] v134'231 uv230 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.309+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:64 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda1440 con 0x55acecd97ed0 2023-10-06T02:29:42.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.310+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 23 ==== osd_op_reply(64 608.00000000 [delete] v134'232 uv232 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.310+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:65 14.e 14:717a0223:::608.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda1440 con 0x55acecd97ed0 2023-10-06T02:29:42.312 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::608.00000000:head# 2023-10-06T02:29:42.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.311+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 24 ==== osd_op_reply(65 608.00000000 [create] v134'233 uv233 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.311+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:66 14.e 14:717a0223:::608.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda1440 con 0x55acecd97ed0 2023-10-06T02:29:42.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.312+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 25 ==== osd_op_reply(66 608.00000000 [setxattr (30)] v134'234 uv234 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.313+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:67 14.e 14:717a0223:::608.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda1440 con 0x55acecd97ed0 2023-10-06T02:29:42.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.314+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 26 ==== osd_op_reply(67 608.00000000 [setxattr (62)] v134'235 uv235 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.314+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- osd_op(unknown.0.0:68 14.e 14:717a0223:::608.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda1440 con 0x55acecd97ed0 2023-10-06T02:29:42.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.315+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.4 v2:172.21.15.175:6808/90865 27 ==== osd_op_reply(68 608.00000000 [omap-set-header] v134'236 uv236 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecd97ed0 2023-10-06T02:29:42.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.315+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55acecda1880 0x55acecda48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.315+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:69 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda4e30 con 0x55acecda1880 2023-10-06T02:29:42.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.315+0000 7f9c35474700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55acecda1880 0x55acecda48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.315+0000 7f9c35474700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55acecda1880 0x55acecda48f0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:42.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.317+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(69 604.00000000 [create] v134'426 uv420 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecda1880 2023-10-06T02:29:42.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.317+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:70 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda4e30 con 0x55acecda1880 2023-10-06T02:29:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.318+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== osd_op_reply(70 604.00000000 [delete] v134'427 uv427 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecda1880 2023-10-06T02:29:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.318+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:71 14.15 14:a93a17c2:::604.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda4e30 con 0x55acecda1880 2023-10-06T02:29:42.319 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::604.00000000:head# 2023-10-06T02:29:42.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.319+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.7 v2:172.21.15.175:6824/90910 3 ==== osd_op_reply(71 604.00000000 [create] v134'428 uv428 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecda1880 2023-10-06T02:29:42.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.319+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:72 14.15 14:a93a17c2:::604.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda5e40 con 0x55acecda1880 2023-10-06T02:29:42.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.320+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.7 v2:172.21.15.175:6824/90910 4 ==== osd_op_reply(72 604.00000000 [setxattr (30)] v134'429 uv429 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecda1880 2023-10-06T02:29:42.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.320+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:73 14.15 14:a93a17c2:::604.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda5e40 con 0x55acecda1880 2023-10-06T02:29:42.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.321+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.7 v2:172.21.15.175:6824/90910 5 ==== osd_op_reply(73 604.00000000 [setxattr (62)] v134'430 uv430 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecda1880 2023-10-06T02:29:42.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.321+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:74 14.15 14:a93a17c2:::604.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda4e30 con 0x55acecda1880 2023-10-06T02:29:42.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.323+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.7 v2:172.21.15.175:6824/90910 6 ==== osd_op_reply(74 604.00000000 [omap-set-header] v134'431 uv431 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecda1880 2023-10-06T02:29:42.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.323+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:75 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda4e30 con 0x55acecda1880 2023-10-06T02:29:42.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.324+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.7 v2:172.21.15.175:6824/90910 7 ==== osd_op_reply(75 500.00000000 [create] v134'432 uv425 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecda1880 2023-10-06T02:29:42.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.324+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:76 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda4e30 con 0x55acecda1880 2023-10-06T02:29:42.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.325+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.7 v2:172.21.15.175:6824/90910 8 ==== osd_op_reply(76 500.00000000 [delete] v134'433 uv433 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecda1880 2023-10-06T02:29:42.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.325+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:77 14.15 14:aa448500:::500.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda4e30 con 0x55acecda1880 2023-10-06T02:29:42.326 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::500.00000000:head# 2023-10-06T02:29:42.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.326+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.7 v2:172.21.15.175:6824/90910 9 ==== osd_op_reply(77 500.00000000 [create] v134'434 uv434 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecda1880 2023-10-06T02:29:42.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.326+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:78 14.15 14:aa448500:::500.00000000:head [write 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda4e30 con 0x55acecda1880 2023-10-06T02:29:42.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.327+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.7 v2:172.21.15.175:6824/90910 10 ==== osd_op_reply(78 500.00000000 [write 0~90] v134'435 uv435 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecda1880 2023-10-06T02:29:42.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.327+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:79 14.15 14:aa448500:::500.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda5230 con 0x55acecda1880 2023-10-06T02:29:42.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.329+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.7 v2:172.21.15.175:6824/90910 11 ==== osd_op_reply(79 500.00000000 [omap-set-header] v134'436 uv436 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecda1880 2023-10-06T02:29:42.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.329+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55acecda5740 0x55acecda7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.329+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:80 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda80a0 con 0x55acecda5740 2023-10-06T02:29:42.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.329+0000 7f9c34c73700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55acecda5740 0x55acecda7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.329+0000 7f9c34c73700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55acecda5740 0x55acecda7b20 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:42.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.330+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== osd_op_reply(80 mds_snaptable [create] v134'193 uv192 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecda5740 2023-10-06T02:29:42.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.330+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:81 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda80a0 con 0x55acecda5740 2023-10-06T02:29:42.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.332+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== osd_op_reply(81 mds_snaptable [delete] v134'194 uv194 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecda5740 2023-10-06T02:29:42.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.332+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:82 14.d 14:b50e409b:::mds_snaptable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda80a0 con 0x55acecda5740 2023-10-06T02:29:42.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.333+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.6 v2:172.21.15.175:6813/90867 3 ==== osd_op_reply(82 mds_snaptable [create] v134'195 uv195 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecda5740 2023-10-06T02:29:42.333 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds_snaptable:head# 2023-10-06T02:29:42.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.333+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:83 14.d 14:b50e409b:::mds_snaptable:head [write 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda8550 con 0x55acecda5740 2023-10-06T02:29:42.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.334+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.6 v2:172.21.15.175:6813/90867 4 ==== osd_op_reply(83 mds_snaptable [write 0~70] v134'196 uv196 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecda5740 2023-10-06T02:29:42.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.334+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- osd_op(unknown.0.0:84 14.d 14:b50e409b:::mds_snaptable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda8550 con 0x55acecda5740 2023-10-06T02:29:42.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.335+0000 7f9c34c73700 1 -- 172.21.15.6:0/3821967638 <== osd.6 v2:172.21.15.175:6813/90867 5 ==== osd_op_reply(84 mds_snaptable [omap-set-header] v134'197 uv197 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c24052100 con 0x55acecda5740 2023-10-06T02:29:42.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.335+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:85 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda8550 con 0x55acecd9cf10 2023-10-06T02:29:42.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.336+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 11 ==== osd_op_reply(85 605.00000000 [create] v134'231 uv230 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.336+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:86 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda8550 con 0x55acecd9cf10 2023-10-06T02:29:42.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.337+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 12 ==== osd_op_reply(86 605.00000000 [delete] v134'232 uv232 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.337+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:87 14.1d 14:b871830b:::605.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda8550 con 0x55acecd9cf10 2023-10-06T02:29:42.339 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::605.00000000:head# 2023-10-06T02:29:42.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.338+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 13 ==== osd_op_reply(87 605.00000000 [create] v134'233 uv233 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.338+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:88 14.1d 14:b871830b:::605.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda9560 con 0x55acecd9cf10 2023-10-06T02:29:42.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.339+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 14 ==== osd_op_reply(88 605.00000000 [setxattr (30)] v134'234 uv234 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.339+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda9560 con 0x55acecd9cf10 2023-10-06T02:29:42.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.340+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 15 ==== osd_op_reply(89 605.00000000 [setxattr (62)] v134'235 uv235 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.340+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:90 14.1d 14:b871830b:::605.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecda8550 con 0x55acecd9cf10 2023-10-06T02:29:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.341+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 16 ==== osd_op_reply(90 605.00000000 [omap-set-header] v134'236 uv236 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.341+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55acecda8a60 0x55acecdaae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.341+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:91 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab460 con 0x55acecda8a60 2023-10-06T02:29:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.341+0000 7f9c34472700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55acecda8a60 0x55acecdaae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.342+0000 7f9c34472700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55acecda8a60 0x55acecdaae40 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:42.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.343+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(91 mds0_inotable [create] v134'386 uv380 ondisk = -17 ((17) File exists)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecda8a60 2023-10-06T02:29:42.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.343+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:92 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab840 con 0x55acecda8a60 2023-10-06T02:29:42.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.344+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== osd_op_reply(92 mds0_inotable [delete] v134'387 uv387 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecda8a60 2023-10-06T02:29:42.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.344+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab840 con 0x55acecda8a60 2023-10-06T02:29:42.345 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_inotable:head# 2023-10-06T02:29:42.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.345+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.2 v2:172.21.15.6:6808/90680 3 ==== osd_op_reply(93 mds0_inotable [create] v134'388 uv388 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecda8a60 2023-10-06T02:29:42.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.345+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [write 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab840 con 0x55acecda8a60 2023-10-06T02:29:42.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.346+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.2 v2:172.21.15.6:6808/90680 4 ==== osd_op_reply(94 mds0_inotable [write 0~34] v134'389 uv389 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecda8a60 2023-10-06T02:29:42.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.346+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:95 14.13 14:c91d4a1d:::mds0_inotable:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab840 con 0x55acecda8a60 2023-10-06T02:29:42.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.347+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.2 v2:172.21.15.6:6808/90680 5 ==== osd_op_reply(95 mds0_inotable [omap-set-header] v134'390 uv390 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecda8a60 2023-10-06T02:29:42.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.347+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:96 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab840 con 0x55acecda8a60 2023-10-06T02:29:42.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.348+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.2 v2:172.21.15.6:6808/90680 6 ==== osd_op_reply(96 100.00000000 [create] v134'391 uv385 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecda8a60 2023-10-06T02:29:42.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.348+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:97 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab840 con 0x55acecda8a60 2023-10-06T02:29:42.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.349+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.2 v2:172.21.15.6:6808/90680 7 ==== osd_op_reply(97 100.00000000 [delete] v134'392 uv392 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecda8a60 2023-10-06T02:29:42.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.349+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:98 14.13 14:cd5a64a3:::100.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab840 con 0x55acecda8a60 2023-10-06T02:29:42.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.350+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.2 v2:172.21.15.6:6808/90680 8 ==== osd_op_reply(98 100.00000000 [create] v134'393 uv393 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecda8a60 2023-10-06T02:29:42.351 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000:head# 2023-10-06T02:29:42.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.350+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:99 14.13 14:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab840 con 0x55acecda8a60 2023-10-06T02:29:42.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.351+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.2 v2:172.21.15.6:6808/90680 9 ==== osd_op_reply(99 100.00000000 [omap-set-header] v134'394 uv394 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecda8a60 2023-10-06T02:29:42.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.351+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:100 14.13 14:cd5a64a3:::100.00000000:head [omap-set-vals in=5074b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdae5b0 con 0x55acecda8a60 2023-10-06T02:29:42.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.352+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.2 v2:172.21.15.6:6808/90680 10 ==== osd_op_reply(100 100.00000000 [omap-set-vals] v134'395 uv395 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecda8a60 2023-10-06T02:29:42.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.352+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:101 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdabd30 con 0x55acecd9cf10 2023-10-06T02:29:42.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.353+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 17 ==== osd_op_reply(101 mds0_sessionmap [create] v134'172 uv171 ondisk = -17 ((17) File exists)) v8 ==== 159+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.353+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:102 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdabd30 con 0x55acecd9cf10 2023-10-06T02:29:42.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.354+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 18 ==== osd_op_reply(102 mds0_sessionmap [delete] v134'173 uv173 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.354+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:103 14.b 14:d0630e4c:::mds0_sessionmap:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdabd30 con 0x55acecd9cf10 2023-10-06T02:29:42.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.355+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 19 ==== osd_op_reply(103 mds0_sessionmap [create] v134'174 uv174 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.356 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::mds0_sessionmap:head# 2023-10-06T02:29:42.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.355+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:104 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdabd30 con 0x55acecd9cf10 2023-10-06T02:29:42.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.356+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 20 ==== osd_op_reply(104 mds0_sessionmap [omap-set-header] v134'175 uv175 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.356+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55acecdac240 0x55acecdac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.356+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:105 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdaed00 con 0x55acecdac240 2023-10-06T02:29:42.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.356+0000 7f9c35474700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55acecdac240 0x55acecdac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.357+0000 7f9c35474700 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55acecdac240 0x55acecdac650 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:42.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.358+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(105 609.00000000 [create] v134'231 uv230 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecdac240 2023-10-06T02:29:42.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.358+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:106 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdaed00 con 0x55acecdac240 2023-10-06T02:29:42.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.359+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(106 609.00000000 [delete] v134'232 uv232 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecdac240 2023-10-06T02:29:42.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.359+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:107 14.7 14:e0b41d06:::609.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdaed00 con 0x55acecdac240 2023-10-06T02:29:42.362 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::609.00000000:head# 2023-10-06T02:29:42.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.362+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(107 609.00000000 [create] v134'233 uv233 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecdac240 2023-10-06T02:29:42.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.362+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:108 14.7 14:e0b41d06:::609.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdafd10 con 0x55acecdac240 2023-10-06T02:29:42.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.365+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(108 609.00000000 [setxattr (30)] v134'234 uv234 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecdac240 2023-10-06T02:29:42.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.365+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:109 14.7 14:e0b41d06:::609.00000000:head [setxattr parent (62) in=68b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdafd10 con 0x55acecdac240 2023-10-06T02:29:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.367+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.5 v2:172.21.15.175:6800/90866 5 ==== osd_op_reply(109 609.00000000 [setxattr (62)] v134'235 uv235 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecdac240 2023-10-06T02:29:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.367+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:110 14.7 14:e0b41d06:::609.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdaed00 con 0x55acecdac240 2023-10-06T02:29:42.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.370+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.5 v2:172.21.15.175:6800/90866 6 ==== osd_op_reply(110 609.00000000 [omap-set-header] v134'236 uv236 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecdac240 2023-10-06T02:29:42.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.370+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:111 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdaed00 con 0x55acecda1880 2023-10-06T02:29:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.371+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.7 v2:172.21.15.175:6824/90910 12 ==== osd_op_reply(111 400.00000000 [create] v134'196 uv195 ondisk = -17 ((17) File exists)) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecda1880 2023-10-06T02:29:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.371+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:112 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdaed00 con 0x55acecda1880 2023-10-06T02:29:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.372+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.7 v2:172.21.15.175:6824/90910 13 ==== osd_op_reply(112 400.00000000 [delete] v134'197 uv197 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecda1880 2023-10-06T02:29:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.372+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:113 14.f 14:f1f69726:::400.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdaed00 con 0x55acecda1880 2023-10-06T02:29:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.373+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.7 v2:172.21.15.175:6824/90910 14 ==== osd_op_reply(113 400.00000000 [create] v134'198 uv198 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecda1880 2023-10-06T02:29:42.374 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::400.00000000:head# 2023-10-06T02:29:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.373+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:114 14.f 14:f1f69726:::400.00000000:head [write 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdaf0d0 con 0x55acecda1880 2023-10-06T02:29:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.374+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.7 v2:172.21.15.175:6824/90910 15 ==== osd_op_reply(114 400.00000000 [write 0~22] v134'199 uv199 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecda1880 2023-10-06T02:29:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.374+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:115 14.f 14:f1f69726:::400.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab8c0 con 0x55acecda1880 2023-10-06T02:29:42.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.376+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 <== osd.7 v2:172.21.15.175:6824/90910 16 ==== osd_op_reply(115 400.00000000 [omap-set-header] v134'200 uv200 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f9c2c01e610 con 0x55acecda1880 2023-10-06T02:29:42.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.376+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:116 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab8c0 con 0x55acecd9cf10 2023-10-06T02:29:42.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.377+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 21 ==== osd_op_reply(116 100.00000000.inode [create] v134'480 uv472 ondisk = -17 ((17) File exists)) v8 ==== 162+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.377+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:117 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab8c0 con 0x55acecd9cf10 2023-10-06T02:29:42.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.378+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 22 ==== osd_op_reply(117 100.00000000.inode [delete] v134'481 uv481 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.379+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:118 14.1f 14:fe07bba1:::100.00000000.inode:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab8c0 con 0x55acecd9cf10 2023-10-06T02:29:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.380+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 23 ==== osd_op_reply(118 100.00000000.inode [create] v134'482 uv482 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.381 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::100.00000000.inode:head# 2023-10-06T02:29:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.380+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:119 14.1f 14:fe07bba1:::100.00000000.inode:head [write 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab8c0 con 0x55acecd9cf10 2023-10-06T02:29:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.381+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 24 ==== osd_op_reply(119 100.00000000.inode [write 0~554] v134'483 uv483 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.381+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:120 14.1f 14:fe07bba1:::100.00000000.inode:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdaf380 con 0x55acecd9cf10 2023-10-06T02:29:42.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.382+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 25 ==== osd_op_reply(120 100.00000000.inode [omap-set-header] v134'484 uv484 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.382+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:121 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdaf380 con 0x55acecd9cf10 2023-10-06T02:29:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.383+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 26 ==== osd_op_reply(121 1.00000000 [create] v134'485 uv479 ondisk = -17 ((17) File exists)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.383+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:122 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab8c0 con 0x55acecd9cf10 2023-10-06T02:29:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.384+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 27 ==== osd_op_reply(122 1.00000000 [delete] v134'486 uv486 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.384+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:123 14.1f 14:ff5b34d6:::1.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab8c0 con 0x55acecd9cf10 2023-10-06T02:29:42.386 INFO:teuthology.orchestra.run.smithi006.stdout:***Overwrite*** #-9223372036854775808:00000000:::1.00000000:head# 2023-10-06T02:29:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.385+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 28 ==== osd_op_reply(123 1.00000000 [create] v134'487 uv487 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.386+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:124 14.1f 14:ff5b34d6:::1.00000000:head [setxattr layout (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab8c0 con 0x55acecd9cf10 2023-10-06T02:29:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.387+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 29 ==== osd_op_reply(124 1.00000000 [setxattr (30)] v134'488 uv488 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.387+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:125 14.1f 14:ff5b34d6:::1.00000000:head [setxattr parent (30) in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdab8c0 con 0x55acecd9cf10 2023-10-06T02:29:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.387+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 30 ==== osd_op_reply(125 1.00000000 [setxattr (30)] v134'489 uv489 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.387+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:126 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdaf2e0 con 0x55acecd9cf10 2023-10-06T02:29:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.388+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 31 ==== osd_op_reply(126 1.00000000 [omap-set-header] v134'490 uv490 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.388+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:127 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x55acecdaf550 con 0x55acecd9cf10 2023-10-06T02:29:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c34472700 1 -- 172.21.15.6:0/3821967638 <== osd.0 v2:172.21.15.6:6816/90679 32 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v134'491 uv491 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9c1c011ab0 con 0x55acecd9cf10 2023-10-06T02:29:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55acecd9cf10 msgr2=0x55acecd9f2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x55acecd9cf10 0x55acecd9f2f0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55acecd7a940 msgr2=0x55acecd76e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x55acecd7a940 0x55acecd76e70 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55acecda8a60 msgr2=0x55acecdaae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x55acecda8a60 0x55acecdaae40 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55acecd97ed0 msgr2=0x55acecd9ad60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x55acecd97ed0 0x55acecd9ad60 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55acecdac240 msgr2=0x55acecdac650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x55acecdac240 0x55acecdac650 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55acecda5740 msgr2=0x55acecda7b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x55acecda5740 0x55acecda7b20 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55acecda1880 msgr2=0x55acecda48f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 reap_dead start 2023-10-06T02:29:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x55acecda1880 0x55acecda48f0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 reap_dead start 2023-10-06T02:29:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 reap_dead start 2023-10-06T02:29:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c35474700 1 -- 172.21.15.6:0/3821967638 reap_dead start 2023-10-06T02:29:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c14065890 msgr2=0x7f9c14067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.389+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c14065890 0x7f9c14067d40 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c000ff0 tx=0x7f9c1c000bc0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.390+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aceccd0850 msgr2=0x55acecd6fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.390+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aceccd0850 0x55acecd6fe00 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400d4c0 tx=0x7f9c24006970 comp rx=0 tx=0).stop 2023-10-06T02:29:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.390+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 shutdown_connections 2023-10-06T02:29:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.390+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aceccd0850 0x55acecd6fe00 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.390+0000 7f9c3ba38000 1 --2- 172.21.15.6:0/3821967638 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c14065890 0x7f9c14067d40 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.390+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 >> 172.21.15.6:0/3821967638 conn(0x55acecceabd0 msgr2=0x55acecca1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.390+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 shutdown_connections 2023-10-06T02:29:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.390+0000 7f9c3ba38000 1 -- 172.21.15.6:0/3821967638 wait complete. 2023-10-06T02:29:42.396 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapheader 1.00000000 deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2023-10-06T02:29:42.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.476+0000 7f41760dc000 1 Processor -- start 2023-10-06T02:29:42.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.476+0000 7f41760dc000 1 -- start start 2023-10-06T02:29:42.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.476+0000 7f41760dc000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557ade022e30 0x557ade0c2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.476+0000 7f41760dc000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557ade0cbf50 0x557ade027600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.476+0000 7f41760dc000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ade0ceb50 0x557ade0c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.476+0000 7f41760dc000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557addf42620 con 0x557ade0cbf50 2023-10-06T02:29:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.476+0000 7f41760dc000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557addf39400 con 0x557ade0ceb50 2023-10-06T02:29:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.476+0000 7f41760dc000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ade0c7a40 con 0x557ade022e30 2023-10-06T02:29:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.477+0000 7f416eb16700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557ade0cbf50 0x557ade027600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.477+0000 7f416eb16700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557ade0cbf50 0x557ade027600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56680/0 (socket says 172.21.15.6:56680) 2023-10-06T02:29:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.477+0000 7f416eb16700 1 -- 172.21.15.6:0/888883078 learned_addr learned my addr 172.21.15.6:0/888883078 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.477+0000 7f416f317700 1 --2- 172.21.15.6:0/888883078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557ade022e30 0x557ade0c2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.477+0000 7f416fb18700 1 --2- 172.21.15.6:0/888883078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ade0ceb50 0x557ade0c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.477+0000 7f416eb16700 1 -- 172.21.15.6:0/888883078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557ade022e30 msgr2=0x557ade0c2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:42.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.477+0000 7f416eb16700 1 --2- 172.21.15.6:0/888883078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557ade022e30 0x557ade0c2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.477+0000 7f416eb16700 1 -- 172.21.15.6:0/888883078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ade0ceb50 msgr2=0x557ade0c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:42.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.477+0000 7f416eb16700 1 --2- 172.21.15.6:0/888883078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ade0ceb50 0x557ade0c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.477+0000 7f416eb16700 1 -- 172.21.15.6:0/888883078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4164005db0 con 0x557ade0cbf50 2023-10-06T02:29:42.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.477+0000 7f416eb16700 1 --2- 172.21.15.6:0/888883078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557ade0cbf50 0x557ade027600 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x557addff8300 tx=0x7f4164016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6421025bd78aad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:42.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.477+0000 7f416db14700 1 -- 172.21.15.6:0/888883078 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164020070 con 0x557ade0cbf50 2023-10-06T02:29:42.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.477+0000 7f416db14700 1 -- 172.21.15.6:0/888883078 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4164005510 con 0x557ade0cbf50 2023-10-06T02:29:42.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.477+0000 7f416db14700 1 -- 172.21.15.6:0/888883078 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164008970 con 0x557ade0cbf50 2023-10-06T02:29:42.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.478+0000 7f41760dc000 1 -- 172.21.15.6:0/888883078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557ade0cbf50 msgr2=0x557ade027600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.478+0000 7f41760dc000 1 --2- 172.21.15.6:0/888883078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557ade0cbf50 0x557ade027600 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x557addff8300 tx=0x7f4164016000 comp rx=0 tx=0).stop 2023-10-06T02:29:42.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.478+0000 7f41760dc000 1 -- 172.21.15.6:0/888883078 shutdown_connections 2023-10-06T02:29:42.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.478+0000 7f41760dc000 1 --2- 172.21.15.6:0/888883078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ade0ceb50 0x557ade0c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.478+0000 7f41760dc000 1 --2- 172.21.15.6:0/888883078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557ade022e30 0x557ade0c2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.478+0000 7f41760dc000 1 --2- 172.21.15.6:0/888883078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557ade0cbf50 0x557ade027600 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.478+0000 7f41760dc000 1 -- 172.21.15.6:0/888883078 >> 172.21.15.6:0/888883078 conn(0x557ade03ebd0 msgr2=0x557ade03efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:42.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.478+0000 7f41760dc000 1 -- 172.21.15.6:0/888883078 shutdown_connections 2023-10-06T02:29:42.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.478+0000 7f41760dc000 1 -- 172.21.15.6:0/888883078 wait complete. 2023-10-06T02:29:42.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.478+0000 7f41760dc000 1 Processor -- start 2023-10-06T02:29:42.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.478+0000 7f41760dc000 1 -- start start 2023-10-06T02:29:42.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.479+0000 7f41760dc000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ade022e30 0x557ade0c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.479+0000 7f41760dc000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557ade0cbf50 0x557ade0c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.479+0000 7f41760dc000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557ade0ceb50 0x557ade0c3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.479+0000 7f41760dc000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ade0c2ab0 con 0x557ade0ceb50 2023-10-06T02:29:42.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.479+0000 7f41760dc000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ade0c2d50 con 0x557ade022e30 2023-10-06T02:29:42.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.479+0000 7f41760dc000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ade0c2ff0 con 0x557ade0cbf50 2023-10-06T02:29:42.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.479+0000 7f416fb18700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557ade0ceb50 0x557ade0c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.479+0000 7f416fb18700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557ade0ceb50 0x557ade0c3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56690/0 (socket says 172.21.15.6:56690) 2023-10-06T02:29:42.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.479+0000 7f416fb18700 1 -- 172.21.15.6:0/2125685906 learned_addr learned my addr 172.21.15.6:0/2125685906 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:42.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.479+0000 7f416f317700 1 --2- 172.21.15.6:0/2125685906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ade022e30 0x557ade0c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.479+0000 7f416eb16700 1 --2- 172.21.15.6:0/2125685906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557ade0cbf50 0x557ade0c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.479+0000 7f416fb18700 1 -- 172.21.15.6:0/2125685906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557ade0cbf50 msgr2=0x557ade0c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.479+0000 7f416fb18700 1 --2- 172.21.15.6:0/2125685906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x557ade0cbf50 0x557ade0c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.479+0000 7f416fb18700 1 -- 172.21.15.6:0/2125685906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ade022e30 msgr2=0x557ade0c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.479+0000 7f416fb18700 1 --2- 172.21.15.6:0/2125685906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ade022e30 0x557ade0c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.479+0000 7f416fb18700 1 -- 172.21.15.6:0/2125685906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557addf44750 con 0x557ade0ceb50 2023-10-06T02:29:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.479+0000 7f416f317700 1 --2- 172.21.15.6:0/2125685906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ade022e30 0x557ade0c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.480+0000 7f416fb18700 1 --2- 172.21.15.6:0/2125685906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557ade0ceb50 0x557ade0c3730 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f4168010940 tx=0x7f4168005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.480+0000 7f4157fff700 1 -- 172.21.15.6:0/2125685906 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416800b430 con 0x557ade0ceb50 2023-10-06T02:29:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.480+0000 7f4157fff700 1 -- 172.21.15.6:0/2125685906 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4168012680 con 0x557ade0ceb50 2023-10-06T02:29:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.480+0000 7f41760dc000 1 -- 172.21.15.6:0/2125685906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557addf6b1c0 con 0x557ade0ceb50 2023-10-06T02:29:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.480+0000 7f4157fff700 1 -- 172.21.15.6:0/2125685906 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4168012a40 con 0x557ade0ceb50 2023-10-06T02:29:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.480+0000 7f41760dc000 1 -- 172.21.15.6:0/2125685906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557addf513d0 con 0x557ade0ceb50 2023-10-06T02:29:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.481+0000 7f4157fff700 1 -- 172.21.15.6:0/2125685906 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4168013440 con 0x557ade0ceb50 2023-10-06T02:29:42.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.481+0000 7f4157fff700 1 --2- 172.21.15.6:0/2125685906 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f415c0658c0 0x7f415c067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.482+0000 7f4157fff700 1 -- 172.21.15.6:0/2125685906 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 9732+0+0 (secure 0 0 0) 0x7f4168017030 con 0x557ade0ceb50 2023-10-06T02:29:42.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.482+0000 7f416f317700 1 --2- 172.21.15.6:0/2125685906 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f415c0658c0 0x7f415c067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.482+0000 7f41760dc000 1 --2- 172.21.15.6:0/2125685906 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x557ade0cae50 0x557ade0c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.482+0000 7f41760dc000 1 -- 172.21.15.6:0/2125685906 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-header in=80b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e134) v8 -- 0x557ade0c41b0 con 0x557ade0cae50 2023-10-06T02:29:42.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.482+0000 7f416eb16700 1 --2- 172.21.15.6:0/2125685906 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x557ade0cae50 0x557ade0c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.482+0000 7f416f317700 1 --2- 172.21.15.6:0/2125685906 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f415c0658c0 0x7f415c067d70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f4160005fd0 tx=0x7f416000c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:42.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.482+0000 7f416eb16700 1 --2- 172.21.15.6:0/2125685906 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x557ade0cae50 0x557ade0c3c70 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:42.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.483+0000 7f416eb16700 1 -- 172.21.15.6:0/2125685906 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 1.00000000 [omap-set-header] v134'492 uv492 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f4164008970 con 0x557ade0cae50 2023-10-06T02:29:42.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.483+0000 7f41760dc000 1 -- 172.21.15.6:0/2125685906 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x557ade0cae50 msgr2=0x557ade0c3c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.483+0000 7f41760dc000 1 --2- 172.21.15.6:0/2125685906 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x557ade0cae50 0x557ade0c3c70 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.483+0000 7f41760dc000 1 -- 172.21.15.6:0/2125685906 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f415c0658c0 msgr2=0x7f415c067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.483+0000 7f41760dc000 1 --2- 172.21.15.6:0/2125685906 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f415c0658c0 0x7f415c067d70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f4160005fd0 tx=0x7f416000c040 comp rx=0 tx=0).stop 2023-10-06T02:29:42.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.483+0000 7f41760dc000 1 -- 172.21.15.6:0/2125685906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557ade0ceb50 msgr2=0x557ade0c3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.483+0000 7f41760dc000 1 --2- 172.21.15.6:0/2125685906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557ade0ceb50 0x557ade0c3730 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f4168010940 tx=0x7f4168005d40 comp rx=0 tx=0).stop 2023-10-06T02:29:42.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.483+0000 7f416fb18700 1 -- 172.21.15.6:0/2125685906 reap_dead start 2023-10-06T02:29:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.483+0000 7f41760dc000 1 -- 172.21.15.6:0/2125685906 shutdown_connections 2023-10-06T02:29:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.483+0000 7f41760dc000 1 -- 172.21.15.6:0/2125685906 >> 172.21.15.6:0/2125685906 conn(0x557ade03ebd0 msgr2=0x557addff5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.484+0000 7f41760dc000 1 -- 172.21.15.6:0/2125685906 shutdown_connections 2023-10-06T02:29:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.484+0000 7f41760dc000 1 -- 172.21.15.6:0/2125685906 wait complete. 2023-10-06T02:29:42.496 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:29:42.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.655+0000 7f4d52d5a700 1 Processor -- start 2023-10-06T02:29:42.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.655+0000 7f4d52d5a700 1 -- start start 2023-10-06T02:29:42.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.656+0000 7f4d52d5a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4d4c0cd400 0x7f4d4c0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.656+0000 7f4d52d5a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d4c0cd7d0 0x7f4d4c0b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.656+0000 7f4d52d5a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c0b29a0 con 0x7f4d4c0b0810 2023-10-06T02:29:42.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.656+0000 7f4d52d5a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c0af770 con 0x7f4d4c0cd7d0 2023-10-06T02:29:42.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.656+0000 7f4d52d5a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c0afa50 con 0x7f4d4c0cd400 2023-10-06T02:29:42.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.656+0000 7f4d51557700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d4c0cd7d0 0x7f4d4c0b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.656+0000 7f4d51557700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d4c0cd7d0 0x7f4d4c0b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56696/0 (socket says 172.21.15.6:56696) 2023-10-06T02:29:42.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.656+0000 7f4d51557700 1 -- 172.21.15.6:0/2017421546 learned_addr learned my addr 172.21.15.6:0/2017421546 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:42.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.656+0000 7f4d51d58700 1 --2- 172.21.15.6:0/2017421546 >> v2:172.21.15.175:3300/0 conn(0x7f4d4c0cd400 0x7f4d4c0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.656+0000 7f4d51557700 1 -- 172.21.15.6:0/2017421546 >> v2:172.21.15.175:3300/0 conn(0x7f4d4c0cd400 msgr2=0x7f4d4c0b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:42.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.656+0000 7f4d51557700 1 --2- 172.21.15.6:0/2017421546 >> v2:172.21.15.175:3300/0 conn(0x7f4d4c0cd400 0x7f4d4c0b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.656+0000 7f4d51557700 1 -- 172.21.15.6:0/2017421546 >> v1:172.21.15.175:6789/0 conn(0x7f4d4c0b0810 legacy=0x7f4d4c0d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.656+0000 7f4d51557700 1 -- 172.21.15.6:0/2017421546 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c0afd30 con 0x7f4d4c0cd7d0 2023-10-06T02:29:42.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.656+0000 7f4d51d58700 1 --2- 172.21.15.6:0/2017421546 >> v2:172.21.15.175:3300/0 conn(0x7f4d4c0cd400 0x7f4d4c0b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:42.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.657+0000 7f4d51557700 1 --2- 172.21.15.6:0/2017421546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d4c0cd7d0 0x7f4d4c0b2460 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f4d400099b0 tx=0x7f4d40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fdc2890de9be7d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:42.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.657+0000 7f4d50d56700 1 -- 172.21.15.6:0/2017421546 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40009ea0 con 0x7f4d4c0cd7d0 2023-10-06T02:29:42.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.657+0000 7f4d50d56700 1 -- 172.21.15.6:0/2017421546 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4000b820 con 0x7f4d4c0cd7d0 2023-10-06T02:29:42.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.657+0000 7f4d50d56700 1 -- 172.21.15.6:0/2017421546 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4000bbe0 con 0x7f4d4c0cd7d0 2023-10-06T02:29:42.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.657+0000 7f4d52d5a700 1 -- 172.21.15.6:0/2017421546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d4c0cd7d0 msgr2=0x7f4d4c0b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.657+0000 7f4d52d5a700 1 --2- 172.21.15.6:0/2017421546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d4c0cd7d0 0x7f4d4c0b2460 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f4d400099b0 tx=0x7f4d40009250 comp rx=0 tx=0).stop 2023-10-06T02:29:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.657+0000 7f4d52d5a700 1 -- 172.21.15.6:0/2017421546 shutdown_connections 2023-10-06T02:29:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.657+0000 7f4d52d5a700 1 --2- 172.21.15.6:0/2017421546 >> v2:172.21.15.175:3300/0 conn(0x7f4d4c0cd400 0x7f4d4c0b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.657+0000 7f4d52d5a700 1 --2- 172.21.15.6:0/2017421546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d4c0cd7d0 0x7f4d4c0b2460 unknown :-1 s=CLOSED pgs=2305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.657+0000 7f4d52d5a700 1 -- 172.21.15.6:0/2017421546 >> 172.21.15.6:0/2017421546 conn(0x7f4d4c06a110 msgr2=0x7f4d4c06a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.657+0000 7f4d52d5a700 1 -- 172.21.15.6:0/2017421546 shutdown_connections 2023-10-06T02:29:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.657+0000 7f4d52d5a700 1 -- 172.21.15.6:0/2017421546 wait complete. 2023-10-06T02:29:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.658+0000 7f4d52d5a700 1 Processor -- start 2023-10-06T02:29:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.658+0000 7f4d52d5a700 1 -- start start 2023-10-06T02:29:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.659+0000 7f4d52d5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d4c0b0810 0x7f4d4c0c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.659+0000 7f4d52d5a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d4c0cd400 0x7f4d4c148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.659+0000 7f4d52d5a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d4c15a1b0 0x7f4d4c15a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.659+0000 7f4d52d5a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c15af60 con 0x7f4d4c0b0810 2023-10-06T02:29:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.659+0000 7f4d52d5a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c0c4310 con 0x7f4d4c0cd400 2023-10-06T02:29:42.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.659+0000 7f4d52d5a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c15ac80 con 0x7f4d4c15a1b0 2023-10-06T02:29:42.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.659+0000 7f4d51d58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d4c0b0810 0x7f4d4c0c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.659+0000 7f4d51d58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d4c0b0810 0x7f4d4c0c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56698/0 (socket says 172.21.15.6:56698) 2023-10-06T02:29:42.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.659+0000 7f4d51d58700 1 -- 172.21.15.6:0/3677520283 learned_addr learned my addr 172.21.15.6:0/3677520283 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:42.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.659+0000 7f4d52559700 1 --2- 172.21.15.6:0/3677520283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d4c15a1b0 0x7f4d4c15a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.659+0000 7f4d51557700 1 --2- 172.21.15.6:0/3677520283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d4c0cd400 0x7f4d4c148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.660+0000 7f4d51d58700 1 -- 172.21.15.6:0/3677520283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d4c15a1b0 msgr2=0x7f4d4c15a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.660+0000 7f4d51d58700 1 --2- 172.21.15.6:0/3677520283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d4c15a1b0 0x7f4d4c15a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.660+0000 7f4d51d58700 1 -- 172.21.15.6:0/3677520283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d4c0cd400 msgr2=0x7f4d4c148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:42.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.660+0000 7f4d51d58700 1 --2- 172.21.15.6:0/3677520283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d4c0cd400 0x7f4d4c148430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:42.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.660+0000 7f4d51d58700 1 -- 172.21.15.6:0/3677520283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d44009a20 con 0x7f4d4c0b0810 2023-10-06T02:29:42.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.660+0000 7f4d51d58700 1 --2- 172.21.15.6:0/3677520283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d4c0b0810 0x7f4d4c0c7ea0 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400c220 tx=0x7f4d4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:42.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.660+0000 7f4d49ffb700 1 -- 172.21.15.6:0/3677520283 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4400cca0 con 0x7f4d4c0b0810 2023-10-06T02:29:42.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.660+0000 7f4d49ffb700 1 -- 172.21.15.6:0/3677520283 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4400f040 con 0x7f4d4c0b0810 2023-10-06T02:29:42.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.660+0000 7f4d49ffb700 1 -- 172.21.15.6:0/3677520283 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44014480 con 0x7f4d4c0b0810 2023-10-06T02:29:42.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.660+0000 7f4d52d5a700 1 -- 172.21.15.6:0/3677520283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d400094f0 con 0x7f4d4c0b0810 2023-10-06T02:29:42.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.660+0000 7f4d52d5a700 1 -- 172.21.15.6:0/3677520283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4c0c3fa0 con 0x7f4d4c0b0810 2023-10-06T02:29:42.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.661+0000 7f4d52d5a700 1 -- 172.21.15.6:0/3677520283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4c0c45f0 con 0x7f4d4c0b0810 2023-10-06T02:29:42.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.662+0000 7f4d49ffb700 1 -- 172.21.15.6:0/3677520283 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d440147f0 con 0x7f4d4c0b0810 2023-10-06T02:29:42.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.662+0000 7f4d49ffb700 1 --2- 172.21.15.6:0/3677520283 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d38066f30 0x7f4d380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:42.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.662+0000 7f4d49ffb700 1 -- 172.21.15.6:0/3677520283 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 9732+0+0 (secure 0 0 0) 0x7f4d44086450 con 0x7f4d4c0b0810 2023-10-06T02:29:42.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.662+0000 7f4d51557700 1 --2- 172.21.15.6:0/3677520283 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d38066f30 0x7f4d380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:42.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.663+0000 7f4d51557700 1 --2- 172.21.15.6:0/3677520283 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d38066f30 0x7f4d380693e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c069d40 tx=0x7f4d40017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:42.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.666+0000 7f4d49ffb700 1 -- 172.21.15.6:0/3677520283 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d440560f0 con 0x7f4d4c0b0810 2023-10-06T02:29:42.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:42.908+0000 7f4d52d5a700 1 -- 172.21.15.6:0/3677520283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f4d4c064aa0 con 0x7f4d4c0b0810 2023-10-06T02:29:43.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.170+0000 7f4d49ffb700 1 -- 172.21.15.6:0/3677520283 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v345) v1 ==== 162+0+0 (secure 0 0 0) 0x7f4d44055c80 con 0x7f4d4c0b0810 2023-10-06T02:29:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.172+0000 7f4d52d5a700 1 -- 172.21.15.6:0/3677520283 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d38066f30 msgr2=0x7f4d380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.172+0000 7f4d52d5a700 1 --2- 172.21.15.6:0/3677520283 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d38066f30 0x7f4d380693e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c069d40 tx=0x7f4d40017000 comp rx=0 tx=0).stop 2023-10-06T02:29:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.172+0000 7f4d52d5a700 1 -- 172.21.15.6:0/3677520283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d4c0b0810 msgr2=0x7f4d4c0c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.172+0000 7f4d52d5a700 1 --2- 172.21.15.6:0/3677520283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d4c0b0810 0x7f4d4c0c7ea0 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400c220 tx=0x7f4d4400b040 comp rx=0 tx=0).stop 2023-10-06T02:29:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.172+0000 7f4d52d5a700 1 -- 172.21.15.6:0/3677520283 shutdown_connections 2023-10-06T02:29:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.172+0000 7f4d52d5a700 1 --2- 172.21.15.6:0/3677520283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d4c15a1b0 0x7f4d4c15a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.172+0000 7f4d52d5a700 1 --2- 172.21.15.6:0/3677520283 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4d38066f30 0x7f4d380693e0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.172+0000 7f4d52d5a700 1 --2- 172.21.15.6:0/3677520283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d4c0b0810 0x7f4d4c0c7ea0 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.172+0000 7f4d52d5a700 1 --2- 172.21.15.6:0/3677520283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d4c0cd400 0x7f4d4c148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.172+0000 7f4d52d5a700 1 -- 172.21.15.6:0/3677520283 >> 172.21.15.6:0/3677520283 conn(0x7f4d4c06a110 msgr2=0x7f4d4c0cc600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.172+0000 7f4d52d5a700 1 -- 172.21.15.6:0/3677520283 shutdown_connections 2023-10-06T02:29:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.172+0000 7f4d52d5a700 1 -- 172.21.15.6:0/3677520283 wait complete. 2023-10-06T02:29:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:29:43.187 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:43.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.307+0000 7f59686e2700 1 Processor -- start 2023-10-06T02:29:43.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.307+0000 7f59686e2700 1 -- start start 2023-10-06T02:29:43.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.307+0000 7f59686e2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59600af4e0 0x7f59600b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:43.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.308+0000 7f59686e2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f596015db70 0x7f59600b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:43.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.308+0000 7f59686e2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596015e190 con 0x7f59600af8b0 2023-10-06T02:29:43.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.308+0000 7f59686e2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59600b1910 con 0x7f596015db70 2023-10-06T02:29:43.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.308+0000 7f59686e2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596015dfb0 con 0x7f59600af4e0 2023-10-06T02:29:43.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.308+0000 7f5966c7f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f596015db70 0x7f59600b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:43.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.308+0000 7f5966c7f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f596015db70 0x7f59600b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56708/0 (socket says 172.21.15.6:56708) 2023-10-06T02:29:43.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.308+0000 7f5966c7f700 1 -- 172.21.15.6:0/2724922741 learned_addr learned my addr 172.21.15.6:0/2724922741 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:43.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.308+0000 7f596647e700 1 --2- 172.21.15.6:0/2724922741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59600af4e0 0x7f59600b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:43.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.308+0000 7f5966c7f700 1 -- 172.21.15.6:0/2724922741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59600af4e0 msgr2=0x7f59600b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:43.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.308+0000 7f5966c7f700 1 --2- 172.21.15.6:0/2724922741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59600af4e0 0x7f59600b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:43.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.308+0000 7f5966c7f700 1 -- 172.21.15.6:0/2724922741 >> v1:172.21.15.175:6789/0 conn(0x7f59600af8b0 legacy=0x7f596015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:43.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.308+0000 7f5966c7f700 1 -- 172.21.15.6:0/2724922741 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600cb650 con 0x7f596015db70 2023-10-06T02:29:43.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.308+0000 7f596647e700 1 --2- 172.21.15.6:0/2724922741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59600af4e0 0x7f59600b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:43.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.308+0000 7f5966c7f700 1 --2- 172.21.15.6:0/2724922741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f596015db70 0x7f59600b2620 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f5950009f20 tx=0x7f5950009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3ee8f465684a14 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:43.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.308+0000 7f596547c700 1 -- 172.21.15.6:0/2724922741 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595000e070 con 0x7f596015db70 2023-10-06T02:29:43.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.308+0000 7f596547c700 1 -- 172.21.15.6:0/2724922741 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595000ba80 con 0x7f596015db70 2023-10-06T02:29:43.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.308+0000 7f596547c700 1 -- 172.21.15.6:0/2724922741 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59500092e0 con 0x7f596015db70 2023-10-06T02:29:43.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.309+0000 7f59686e2700 1 -- 172.21.15.6:0/2724922741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f596015db70 msgr2=0x7f59600b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:43.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.309+0000 7f59686e2700 1 --2- 172.21.15.6:0/2724922741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f596015db70 0x7f59600b2620 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f5950009f20 tx=0x7f5950009840 comp rx=0 tx=0).stop 2023-10-06T02:29:43.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.309+0000 7f59686e2700 1 -- 172.21.15.6:0/2724922741 shutdown_connections 2023-10-06T02:29:43.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.309+0000 7f59686e2700 1 --2- 172.21.15.6:0/2724922741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f596015db70 0x7f59600b2620 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:43.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.309+0000 7f59686e2700 1 --2- 172.21.15.6:0/2724922741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59600af4e0 0x7f59600b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:43.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.309+0000 7f59686e2700 1 -- 172.21.15.6:0/2724922741 >> 172.21.15.6:0/2724922741 conn(0x7f5960068680 msgr2=0x7f5960068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:43.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.309+0000 7f59686e2700 1 -- 172.21.15.6:0/2724922741 shutdown_connections 2023-10-06T02:29:43.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.309+0000 7f59686e2700 1 -- 172.21.15.6:0/2724922741 wait complete. 2023-10-06T02:29:43.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.310+0000 7f59686e2700 1 Processor -- start 2023-10-06T02:29:43.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.310+0000 7f59686e2700 1 -- start start 2023-10-06T02:29:43.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.311+0000 7f59686e2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59600af4e0 0x7f59600ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:43.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.311+0000 7f59686e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59600af8b0 0x7f5960159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:43.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.311+0000 7f59686e2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f596015db70 0x7f59600b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:43.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.311+0000 7f59686e2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596016a750 con 0x7f59600af8b0 2023-10-06T02:29:43.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.311+0000 7f59686e2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59600c9d70 con 0x7f596015db70 2023-10-06T02:29:43.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.311+0000 7f59686e2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596016a100 con 0x7f59600af4e0 2023-10-06T02:29:43.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.311+0000 7f5965c7d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59600af8b0 0x7f5960159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:43.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.311+0000 7f5965c7d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59600af8b0 0x7f5960159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56722/0 (socket says 172.21.15.6:56722) 2023-10-06T02:29:43.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.311+0000 7f5965c7d700 1 -- 172.21.15.6:0/2488219373 learned_addr learned my addr 172.21.15.6:0/2488219373 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:43.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.311+0000 7f596647e700 1 --2- 172.21.15.6:0/2488219373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59600af4e0 0x7f59600ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:43.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.311+0000 7f5966c7f700 1 --2- 172.21.15.6:0/2488219373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f596015db70 0x7f59600b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:43.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.311+0000 7f5965c7d700 1 -- 172.21.15.6:0/2488219373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59600af4e0 msgr2=0x7f59600ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:43.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.311+0000 7f5965c7d700 1 --2- 172.21.15.6:0/2488219373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59600af4e0 0x7f59600ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:43.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.311+0000 7f5965c7d700 1 -- 172.21.15.6:0/2488219373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f596015db70 msgr2=0x7f59600b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:43.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.311+0000 7f5965c7d700 1 --2- 172.21.15.6:0/2488219373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f596015db70 0x7f59600b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:43.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.311+0000 7f5965c7d700 1 -- 172.21.15.6:0/2488219373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5950009ae0 con 0x7f59600af8b0 2023-10-06T02:29:43.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.311+0000 7f5965c7d700 1 --2- 172.21.15.6:0/2488219373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59600af8b0 0x7f5960159bd0 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7f595400c590 tx=0x7f595400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:43.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.312+0000 7f595e7fc700 1 -- 172.21.15.6:0/2488219373 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954011590 con 0x7f59600af8b0 2023-10-06T02:29:43.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.312+0000 7f595e7fc700 1 -- 172.21.15.6:0/2488219373 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5954011710 con 0x7f59600af8b0 2023-10-06T02:29:43.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.312+0000 7f59686e2700 1 -- 172.21.15.6:0/2488219373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596016a3e0 con 0x7f59600af8b0 2023-10-06T02:29:43.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.312+0000 7f595e7fc700 1 -- 172.21.15.6:0/2488219373 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954011ad0 con 0x7f59600af8b0 2023-10-06T02:29:43.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.312+0000 7f59686e2700 1 -- 172.21.15.6:0/2488219373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59600aeb10 con 0x7f59600af8b0 2023-10-06T02:29:43.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.313+0000 7f59686e2700 1 -- 172.21.15.6:0/2488219373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59600aff50 con 0x7f59600af8b0 2023-10-06T02:29:43.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.313+0000 7f595e7fc700 1 -- 172.21.15.6:0/2488219373 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f595401b3b0 con 0x7f59600af8b0 2023-10-06T02:29:43.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.313+0000 7f595e7fc700 1 --2- 172.21.15.6:0/2488219373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f594c066f30 0x7f594c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:43.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.313+0000 7f595e7fc700 1 -- 172.21.15.6:0/2488219373 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 9732+0+0 (secure 0 0 0) 0x7f59540849a0 con 0x7f59600af8b0 2023-10-06T02:29:43.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.314+0000 7f596647e700 1 --2- 172.21.15.6:0/2488219373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f594c066f30 0x7f594c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:43.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.314+0000 7f596647e700 1 --2- 172.21.15.6:0/2488219373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f594c066f30 0x7f594c0693e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5958006f00 tx=0x7f5958008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:43.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.318+0000 7f595e7fc700 1 -- 172.21.15.6:0/2488219373 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5954050c10 con 0x7f59600af8b0 2023-10-06T02:29:43.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.558+0000 7f59686e2700 1 -- 172.21.15.6:0/2488219373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f596016a890 con 0x7f59600af8b0 2023-10-06T02:29:43.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.559+0000 7f595e7fc700 1 -- 172.21.15.6:0/2488219373 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 346 v346) v1 ==== 95+0+4607 (secure 0 0 0) 0x7f5954017030 con 0x7f59600af8b0 2023-10-06T02:29:43.560 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:43.560 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":346,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":346,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:43.170871+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10653":{"gid":10653,"name":"a","rank":0,"incarnation":346,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/1827807239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1827807239},{"type":"v1","addr":"172.21.15.6:6835","nonce":1827807239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.561+0000 7f59686e2700 1 -- 172.21.15.6:0/2488219373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f594c066f30 msgr2=0x7f594c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.561+0000 7f59686e2700 1 --2- 172.21.15.6:0/2488219373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f594c066f30 0x7f594c0693e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5958006f00 tx=0x7f5958008040 comp rx=0 tx=0).stop 2023-10-06T02:29:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.561+0000 7f59686e2700 1 -- 172.21.15.6:0/2488219373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59600af8b0 msgr2=0x7f5960159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.561+0000 7f59686e2700 1 --2- 172.21.15.6:0/2488219373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59600af8b0 0x7f5960159bd0 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7f595400c590 tx=0x7f595400c8a0 comp rx=0 tx=0).stop 2023-10-06T02:29:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.561+0000 7f59686e2700 1 -- 172.21.15.6:0/2488219373 shutdown_connections 2023-10-06T02:29:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.561+0000 7f59686e2700 1 --2- 172.21.15.6:0/2488219373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f596015db70 0x7f59600b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.561+0000 7f59686e2700 1 --2- 172.21.15.6:0/2488219373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59600af4e0 0x7f59600ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.561+0000 7f59686e2700 1 --2- 172.21.15.6:0/2488219373 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f594c066f30 0x7f594c0693e0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.561+0000 7f59686e2700 1 --2- 172.21.15.6:0/2488219373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59600af8b0 0x7f5960159bd0 unknown :-1 s=CLOSED pgs=2308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.561+0000 7f59686e2700 1 -- 172.21.15.6:0/2488219373 >> 172.21.15.6:0/2488219373 conn(0x7f5960068680 msgr2=0x7f59600d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.561+0000 7f59686e2700 1 -- 172.21.15.6:0/2488219373 shutdown_connections 2023-10-06T02:29:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:43.561+0000 7f59686e2700 1 -- 172.21.15.6:0/2488219373 wait complete. 2023-10-06T02:29:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 346 2023-10-06T02:29:43.574 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2023-10-06T02:29:46.198 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:29:46.196+0000 7fca2276b700 -1 mds.0.cache.dir(0x1) Corrupt fnode in dirfrag 0x1: void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&) no longer understand old encoding version 3 < 101: Malformed input 2023-10-06T02:29:46.198 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-06T02:29:46.197+0000 7fca2276b700 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x1 is fatal because it is a system directory for this rank 2023-10-06T02:29:46.199 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:29:46.197+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:29:46.199 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:29:46.197+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-10-06T02:29:46.209 INFO:tasks.ceph.mds.a.smithi006.stderr: -18> 2023-10-06T02:29:46.196+0000 7fca2276b700 -1 mds.0.cache.dir(0x1) Corrupt fnode in dirfrag 0x1: void fnode_t::decode(ceph::buffer::v15_2_0::list::const_iterator&) no longer understand old encoding version 3 < 101: Malformed input 2023-10-06T02:29:46.210 INFO:tasks.ceph.mds.a.smithi006.stderr: -15> 2023-10-06T02:29:46.197+0000 7fca2276b700 -1 mds.0.damage notify_dirfrag Damage to fragment * of ino 0x1 is fatal because it is a system directory for this rank 2023-10-06T02:29:46.233 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:29:48.574 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:48.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.703+0000 7fabc84db700 1 Processor -- start 2023-10-06T02:29:48.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.703+0000 7fabc84db700 1 -- start start 2023-10-06T02:29:48.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.704+0000 7fabc84db700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabc0142de0 0x7fabc00ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:48.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.704+0000 7fabc84db700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fabc00cd270 0x7fabc00d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:48.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.704+0000 7fabc84db700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc00cf8a0 con 0x7fabc01431b0 2023-10-06T02:29:48.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.704+0000 7fabc84db700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc00b4100 con 0x7fabc00cd270 2023-10-06T02:29:48.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.704+0000 7fabc84db700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc00cec90 con 0x7fabc0142de0 2023-10-06T02:29:48.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.705+0000 7fabc6277700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabc0142de0 0x7fabc00ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:48.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.705+0000 7fabc5a76700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fabc00cd270 0x7fabc00d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:48.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.705+0000 7fabc6277700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabc0142de0 0x7fabc00ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:47344/0 (socket says 172.21.15.6:47344) 2023-10-06T02:29:48.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.705+0000 7fabc6277700 1 -- 172.21.15.6:0/580443790 learned_addr learned my addr 172.21.15.6:0/580443790 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:48.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.705+0000 7fabc6a78700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fabc01431b0 0x7fabc015d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:46786/0 (socket says 172.21.15.6:46786) 2023-10-06T02:29:48.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.705+0000 7fabc6277700 1 -- 172.21.15.6:0/580443790 >> v2:172.21.15.175:3300/0 conn(0x7fabc00cd270 msgr2=0x7fabc00d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:48.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.705+0000 7fabc6277700 1 --2- 172.21.15.6:0/580443790 >> v2:172.21.15.175:3300/0 conn(0x7fabc00cd270 0x7fabc00d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:48.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.705+0000 7fabc6277700 1 -- 172.21.15.6:0/580443790 >> v1:172.21.15.175:6789/0 conn(0x7fabc01431b0 legacy=0x7fabc015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:48.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.705+0000 7fabc6277700 1 -- 172.21.15.6:0/580443790 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc00cef70 con 0x7fabc0142de0 2023-10-06T02:29:48.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.705+0000 7fabc5a76700 1 --2- 172.21.15.6:0/580443790 >> v2:172.21.15.175:3300/0 conn(0x7fabc00cd270 0x7fabc00d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:48.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.705+0000 7fabc6277700 1 --2- 172.21.15.6:0/580443790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabc0142de0 0x7fabc00ccd30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009f20 tx=0x7fabb8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b01f17c252282792 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:48.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.706+0000 7fabc5275700 1 -- 172.21.15.6:0/580443790 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb800e070 con 0x7fabc0142de0 2023-10-06T02:29:48.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.706+0000 7fabc5275700 1 -- 172.21.15.6:0/580443790 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb800b9d0 con 0x7fabc0142de0 2023-10-06T02:29:48.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.706+0000 7fabc5275700 1 -- 172.21.15.6:0/580443790 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80092e0 con 0x7fabc0142de0 2023-10-06T02:29:48.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.706+0000 7fabc84db700 1 -- 172.21.15.6:0/580443790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabc0142de0 msgr2=0x7fabc00ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:48.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.706+0000 7fabc84db700 1 --2- 172.21.15.6:0/580443790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabc0142de0 0x7fabc00ccd30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009f20 tx=0x7fabb8009840 comp rx=0 tx=0).stop 2023-10-06T02:29:48.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.706+0000 7fabc84db700 1 -- 172.21.15.6:0/580443790 shutdown_connections 2023-10-06T02:29:48.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.706+0000 7fabc84db700 1 --2- 172.21.15.6:0/580443790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabc0142de0 0x7fabc00ccd30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:48.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.706+0000 7fabc84db700 1 --2- 172.21.15.6:0/580443790 >> v2:172.21.15.175:3300/0 conn(0x7fabc00cd270 0x7fabc00d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:48.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.706+0000 7fabc84db700 1 -- 172.21.15.6:0/580443790 >> 172.21.15.6:0/580443790 conn(0x7fabc0069110 msgr2=0x7fabc006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:48.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.706+0000 7fabc84db700 1 -- 172.21.15.6:0/580443790 shutdown_connections 2023-10-06T02:29:48.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.706+0000 7fabc84db700 1 -- 172.21.15.6:0/580443790 wait complete. 2023-10-06T02:29:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.707+0000 7fabc84db700 1 Processor -- start 2023-10-06T02:29:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.707+0000 7fabc84db700 1 -- start start 2023-10-06T02:29:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.708+0000 7fabc84db700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabc00cd270 0x7fabc013dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.708+0000 7fabc84db700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabc0142de0 0x7fabc016bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.708+0000 7fabc84db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc01431b0 0x7fabc01552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.708+0000 7fabc84db700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc013e4f0 con 0x7fabc01431b0 2023-10-06T02:29:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.708+0000 7fabc84db700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc016c160 con 0x7fabc0142de0 2023-10-06T02:29:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.708+0000 7fabc84db700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc00afeb0 con 0x7fabc00cd270 2023-10-06T02:29:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.708+0000 7fabc6a78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc01431b0 0x7fabc01552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.708+0000 7fabc6a78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc01431b0 0x7fabc01552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41364/0 (socket says 172.21.15.6:41364) 2023-10-06T02:29:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.708+0000 7fabc6a78700 1 -- 172.21.15.6:0/3018964338 learned_addr learned my addr 172.21.15.6:0/3018964338 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.708+0000 7fabc5a76700 1 --2- 172.21.15.6:0/3018964338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabc0142de0 0x7fabc016bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.708+0000 7fabc6277700 1 --2- 172.21.15.6:0/3018964338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabc00cd270 0x7fabc013dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.709+0000 7fabc6a78700 1 -- 172.21.15.6:0/3018964338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabc00cd270 msgr2=0x7fabc013dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.709+0000 7fabc6a78700 1 --2- 172.21.15.6:0/3018964338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabc00cd270 0x7fabc013dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.709+0000 7fabc6a78700 1 -- 172.21.15.6:0/3018964338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabc0142de0 msgr2=0x7fabc016bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.709+0000 7fabc6a78700 1 --2- 172.21.15.6:0/3018964338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabc0142de0 0x7fabc016bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.709+0000 7fabc6a78700 1 -- 172.21.15.6:0/3018964338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4009420 con 0x7fabc01431b0 2023-10-06T02:29:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.709+0000 7fabc6a78700 1 --2- 172.21.15.6:0/3018964338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc01431b0 0x7fabc01552f0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7fabb000c5c0 tx=0x7fabb0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.709+0000 7fabbe7fc700 1 -- 172.21.15.6:0/3018964338 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb0005a70 con 0x7fabc01431b0 2023-10-06T02:29:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.709+0000 7fabbe7fc700 1 -- 172.21.15.6:0/3018964338 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb0005bf0 con 0x7fabc01431b0 2023-10-06T02:29:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.709+0000 7fabc84db700 1 -- 172.21.15.6:0/3018964338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb8009ae0 con 0x7fabc01431b0 2023-10-06T02:29:48.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.709+0000 7fabbe7fc700 1 -- 172.21.15.6:0/3018964338 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb00070d0 con 0x7fabc01431b0 2023-10-06T02:29:48.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.709+0000 7fabc84db700 1 -- 172.21.15.6:0/3018964338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc00af330 con 0x7fabc01431b0 2023-10-06T02:29:48.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.710+0000 7fabc84db700 1 -- 172.21.15.6:0/3018964338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc00b0060 con 0x7fabc01431b0 2023-10-06T02:29:48.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.711+0000 7fabbe7fc700 1 -- 172.21.15.6:0/3018964338 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fabb0007480 con 0x7fabc01431b0 2023-10-06T02:29:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.711+0000 7fabbe7fc700 1 --2- 172.21.15.6:0/3018964338 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fabac066f30 0x7fabac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.711+0000 7fabbe7fc700 1 -- 172.21.15.6:0/3018964338 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 9818+0+0 (secure 0 0 0) 0x7fabb0084900 con 0x7fabc01431b0 2023-10-06T02:29:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.711+0000 7fabc6277700 1 --2- 172.21.15.6:0/3018964338 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fabac066f30 0x7fabac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.712+0000 7fabc6277700 1 --2- 172.21.15.6:0/3018964338 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fabac066f30 0x7fabac0693e0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009880 tx=0x7fabb8018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:48.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.715+0000 7fabbe7fc700 1 -- 172.21.15.6:0/3018964338 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabc00b0060 con 0x7fabc01431b0 2023-10-06T02:29:48.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.956+0000 7fabc84db700 1 -- 172.21.15.6:0/3018964338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabc00b0020 con 0x7fabc01431b0 2023-10-06T02:29:48.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.957+0000 7fabbe7fc700 1 -- 172.21.15.6:0/3018964338 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 351 v351) v1 ==== 95+0+4596 (secure 0 0 0) 0x7fabb0050b20 con 0x7fabc01431b0 2023-10-06T02:29:48.959 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:48.959 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":351,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10713,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2434594072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2434594072},{"type":"v1","addr":"172.21.15.6:6835","nonce":2434594072}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":351}],"filesystems":[{"mdsmap":{"epoch":350,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:46.199267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:48.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.959+0000 7fabc84db700 1 -- 172.21.15.6:0/3018964338 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fabac066f30 msgr2=0x7fabac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:48.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.959+0000 7fabc84db700 1 --2- 172.21.15.6:0/3018964338 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fabac066f30 0x7fabac0693e0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009880 tx=0x7fabb8018000 comp rx=0 tx=0).stop 2023-10-06T02:29:48.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.959+0000 7fabc84db700 1 -- 172.21.15.6:0/3018964338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc01431b0 msgr2=0x7fabc01552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:48.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.959+0000 7fabc84db700 1 --2- 172.21.15.6:0/3018964338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc01431b0 0x7fabc01552f0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7fabb000c5c0 tx=0x7fabb0007ef0 comp rx=0 tx=0).stop 2023-10-06T02:29:48.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.959+0000 7fabc84db700 1 -- 172.21.15.6:0/3018964338 shutdown_connections 2023-10-06T02:29:48.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.959+0000 7fabc84db700 1 --2- 172.21.15.6:0/3018964338 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fabac066f30 0x7fabac0693e0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:48.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.959+0000 7fabc84db700 1 --2- 172.21.15.6:0/3018964338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc01431b0 0x7fabc01552f0 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:48.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.959+0000 7fabc84db700 1 --2- 172.21.15.6:0/3018964338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabc00cd270 0x7fabc013dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:48.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.959+0000 7fabc84db700 1 --2- 172.21.15.6:0/3018964338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabc0142de0 0x7fabc016bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:48.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.959+0000 7fabc84db700 1 -- 172.21.15.6:0/3018964338 >> 172.21.15.6:0/3018964338 conn(0x7fabc0069110 msgr2=0x7fabc00d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:48.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.959+0000 7fabc84db700 1 -- 172.21.15.6:0/3018964338 shutdown_connections 2023-10-06T02:29:48.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:48.959+0000 7fabc84db700 1 -- 172.21.15.6:0/3018964338 wait complete. 2023-10-06T02:29:48.962 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 351 2023-10-06T02:29:48.972 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T02:29:48.973 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:49.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.089+0000 7fc69805a700 1 Processor -- start 2023-10-06T02:29:49.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.089+0000 7fc69805a700 1 -- start start 2023-10-06T02:29:49.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.090+0000 7fc69805a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc690150740 0x7fc6900c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:49.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.090+0000 7fc69805a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc69006cde0 0x7fc6900af560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:49.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.090+0000 7fc69805a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69006c950 con 0x7fc690150370 2023-10-06T02:29:49.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.090+0000 7fc69805a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc690069b10 con 0x7fc690150740 2023-10-06T02:29:49.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.090+0000 7fc69805a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc690069830 con 0x7fc69006cde0 2023-10-06T02:29:49.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.090+0000 7fc6955f5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc690150740 0x7fc6900c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:49.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.090+0000 7fc695df6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc690150370 0x7fc690069040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42470/0 (socket says 172.21.15.6:42470) 2023-10-06T02:29:49.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.090+0000 7fc695df6700 1 -- 172.21.15.6:0/4233709914 learned_addr learned my addr 172.21.15.6:0/4233709914 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:49.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.091+0000 7fc6955f5700 1 -- 172.21.15.6:0/4233709914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc69006cde0 msgr2=0x7fc6900af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:49.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.091+0000 7fc6965f7700 1 --2- 172.21.15.6:0/4233709914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc69006cde0 0x7fc6900af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:49.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.091+0000 7fc6955f5700 1 --2- 172.21.15.6:0/4233709914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc69006cde0 0x7fc6900af560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.091+0000 7fc694df4700 1 -- 172.21.15.6:0/4233709914 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85385613 0 0) 0x7fc69006c950 con 0x7fc690150370 2023-10-06T02:29:49.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.091+0000 7fc6955f5700 1 -- 172.21.15.6:0/4233709914 >> v1:172.21.15.6:6789/0 conn(0x7fc690150370 legacy=0x7fc690069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:49.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.091+0000 7fc6955f5700 1 -- 172.21.15.6:0/4233709914 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69006c300 con 0x7fc690150740 2023-10-06T02:29:49.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.091+0000 7fc6955f5700 1 --2- 172.21.15.6:0/4233709914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc690150740 0x7fc6900c8b40 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7fc6840098e0 tx=0x7fc6840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c47d93530ebeb19 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:49.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.091+0000 7fc694df4700 1 -- 172.21.15.6:0/4233709914 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684009e80 con 0x7fc690150740 2023-10-06T02:29:49.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.091+0000 7fc694df4700 1 -- 172.21.15.6:0/4233709914 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68400b860 con 0x7fc690150740 2023-10-06T02:29:49.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.091+0000 7fc694df4700 1 -- 172.21.15.6:0/4233709914 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68400bbe0 con 0x7fc690150740 2023-10-06T02:29:49.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.092+0000 7fc69805a700 1 -- 172.21.15.6:0/4233709914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc690150740 msgr2=0x7fc6900c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.092+0000 7fc69805a700 1 --2- 172.21.15.6:0/4233709914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc690150740 0x7fc6900c8b40 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7fc6840098e0 tx=0x7fc6840091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.092+0000 7fc69805a700 1 -- 172.21.15.6:0/4233709914 shutdown_connections 2023-10-06T02:29:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.092+0000 7fc69805a700 1 --2- 172.21.15.6:0/4233709914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc69006cde0 0x7fc6900af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.092+0000 7fc69805a700 1 --2- 172.21.15.6:0/4233709914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc690150740 0x7fc6900c8b40 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.092+0000 7fc69805a700 1 -- 172.21.15.6:0/4233709914 >> 172.21.15.6:0/4233709914 conn(0x7fc69006b6e0 msgr2=0x7fc6900ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.092+0000 7fc69805a700 1 -- 172.21.15.6:0/4233709914 shutdown_connections 2023-10-06T02:29:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.092+0000 7fc69805a700 1 -- 172.21.15.6:0/4233709914 wait complete. 2023-10-06T02:29:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.093+0000 7fc69805a700 1 Processor -- start 2023-10-06T02:29:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.093+0000 7fc69805a700 1 -- start start 2023-10-06T02:29:49.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc69805a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc69006cde0 0x7fc690168c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:49.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc69805a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc690150370 0x7fc6900c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:49.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc69805a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc69015ab50 0x7fc690157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:49.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc69805a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900cc070 con 0x7fc69006cde0 2023-10-06T02:29:49.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc69805a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69015bbd0 con 0x7fc690150370 2023-10-06T02:29:49.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc69805a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69015afc0 con 0x7fc69015ab50 2023-10-06T02:29:49.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc695df6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc69006cde0 0x7fc690168c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:49.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc695df6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc69006cde0 0x7fc690168c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41370/0 (socket says 172.21.15.6:41370) 2023-10-06T02:29:49.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc695df6700 1 -- 172.21.15.6:0/1295864304 learned_addr learned my addr 172.21.15.6:0/1295864304 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:49.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc6965f7700 1 --2- 172.21.15.6:0/1295864304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc69015ab50 0x7fc690157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:49.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc695df6700 1 -- 172.21.15.6:0/1295864304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc69015ab50 msgr2=0x7fc690157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:49.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc695df6700 1 --2- 172.21.15.6:0/1295864304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc69015ab50 0x7fc690157580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc695df6700 1 -- 172.21.15.6:0/1295864304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc690150370 msgr2=0x7fc6900c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:49.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc6955f5700 1 --2- 172.21.15.6:0/1295864304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc690150370 0x7fc6900c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:49.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc695df6700 1 --2- 172.21.15.6:0/1295864304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc690150370 0x7fc6900c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc695df6700 1 -- 172.21.15.6:0/1295864304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc684009420 con 0x7fc69006cde0 2023-10-06T02:29:49.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc695df6700 1 --2- 172.21.15.6:0/1295864304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc69006cde0 0x7fc690168c00 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7fc68800c7e0 tx=0x7fc688007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:49.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc68dffb700 1 -- 172.21.15.6:0/1295864304 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688005b30 con 0x7fc69006cde0 2023-10-06T02:29:49.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc68dffb700 1 -- 172.21.15.6:0/1295864304 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc688005c90 con 0x7fc69006cde0 2023-10-06T02:29:49.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc69805a700 1 -- 172.21.15.6:0/1295864304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69015b2a0 con 0x7fc69006cde0 2023-10-06T02:29:49.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.094+0000 7fc68dffb700 1 -- 172.21.15.6:0/1295864304 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688007300 con 0x7fc69006cde0 2023-10-06T02:29:49.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.095+0000 7fc69805a700 1 -- 172.21.15.6:0/1295864304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69015b860 con 0x7fc69006cde0 2023-10-06T02:29:49.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.095+0000 7fc69805a700 1 -- 172.21.15.6:0/1295864304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69006db40 con 0x7fc69006cde0 2023-10-06T02:29:49.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.096+0000 7fc68dffb700 1 -- 172.21.15.6:0/1295864304 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc68801b400 con 0x7fc69006cde0 2023-10-06T02:29:49.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.096+0000 7fc68dffb700 1 --2- 172.21.15.6:0/1295864304 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc67c066f30 0x7fc67c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:49.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.096+0000 7fc68dffb700 1 -- 172.21.15.6:0/1295864304 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 9818+0+0 (secure 0 0 0) 0x7fc688085100 con 0x7fc69006cde0 2023-10-06T02:29:49.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.097+0000 7fc6955f5700 1 --2- 172.21.15.6:0/1295864304 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc67c066f30 0x7fc67c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:49.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.097+0000 7fc6955f5700 1 --2- 172.21.15.6:0/1295864304 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc67c066f30 0x7fc67c0693e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc69014f040 tx=0x7fc684017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:49.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.101+0000 7fc68dffb700 1 -- 172.21.15.6:0/1295864304 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6880513a0 con 0x7fc69006cde0 2023-10-06T02:29:49.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.341+0000 7fc69805a700 1 -- 172.21.15.6:0/1295864304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc69006c5e0 con 0x7fc69006cde0 2023-10-06T02:29:49.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.341+0000 7fc68dffb700 1 -- 172.21.15.6:0/1295864304 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 351 v351) v1 ==== 95+0+4596 (secure 0 0 0) 0x7fc6880549c0 con 0x7fc69006cde0 2023-10-06T02:29:49.343 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:49.343 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":351,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10713,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2434594072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2434594072},{"type":"v1","addr":"172.21.15.6:6835","nonce":2434594072}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":351}],"filesystems":[{"mdsmap":{"epoch":350,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:46.199267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:49.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.343+0000 7fc69805a700 1 -- 172.21.15.6:0/1295864304 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc67c066f30 msgr2=0x7fc67c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:49.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.343+0000 7fc69805a700 1 --2- 172.21.15.6:0/1295864304 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc67c066f30 0x7fc67c0693e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc69014f040 tx=0x7fc684017000 comp rx=0 tx=0).stop 2023-10-06T02:29:49.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.343+0000 7fc69805a700 1 -- 172.21.15.6:0/1295864304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc69006cde0 msgr2=0x7fc690168c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:49.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.343+0000 7fc69805a700 1 --2- 172.21.15.6:0/1295864304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc69006cde0 0x7fc690168c00 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7fc68800c7e0 tx=0x7fc688007df0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.343+0000 7fc69805a700 1 -- 172.21.15.6:0/1295864304 shutdown_connections 2023-10-06T02:29:49.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.343+0000 7fc69805a700 1 --2- 172.21.15.6:0/1295864304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc69015ab50 0x7fc690157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.343+0000 7fc69805a700 1 --2- 172.21.15.6:0/1295864304 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc67c066f30 0x7fc67c0693e0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.343+0000 7fc69805a700 1 --2- 172.21.15.6:0/1295864304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc69006cde0 0x7fc690168c00 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.343+0000 7fc69805a700 1 --2- 172.21.15.6:0/1295864304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc690150370 0x7fc6900c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.343+0000 7fc69805a700 1 -- 172.21.15.6:0/1295864304 >> 172.21.15.6:0/1295864304 conn(0x7fc69006b6e0 msgr2=0x7fc6900ae150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.343+0000 7fc69805a700 1 -- 172.21.15.6:0/1295864304 shutdown_connections 2023-10-06T02:29:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.343+0000 7fc69805a700 1 -- 172.21.15.6:0/1295864304 wait complete. 2023-10-06T02:29:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 351 2023-10-06T02:29:49.357 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T02:29:49.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:49.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.474+0000 7fd052b19700 1 Processor -- start 2023-10-06T02:29:49.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.474+0000 7fd052b19700 1 -- start start 2023-10-06T02:29:49.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.475+0000 7fd052b19700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd04c068ca0 0x7fd04c1512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:49.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.475+0000 7fd052b19700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04c1517f0 0x7fd04c06ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:49.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.475+0000 7fd052b19700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04c151c70 con 0x7fd04c0688d0 2023-10-06T02:29:49.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.475+0000 7fd052b19700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04c0c9a50 con 0x7fd04c068ca0 2023-10-06T02:29:49.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.475+0000 7fd052b19700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c0c9d30 con 0x7fd04c1517f0 2023-10-06T02:29:49.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.475+0000 7fd04bfff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd04c068ca0 0x7fd04c1512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:49.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.475+0000 7fd0510b6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04c1517f0 0x7fd04c06ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:49.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.475+0000 7fd0508b5700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd04c0688d0 0x7fd04c0c8750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:46798/0 (socket says 172.21.15.6:46798) 2023-10-06T02:29:49.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.475+0000 7fd0508b5700 1 -- 172.21.15.6:0/1912280646 learned_addr learned my addr 172.21.15.6:0/1912280646 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:49.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.476+0000 7fd04bfff700 1 -- 172.21.15.6:0/1912280646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04c1517f0 msgr2=0x7fd04c06ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:49.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.476+0000 7fd04bfff700 1 --2- 172.21.15.6:0/1912280646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04c1517f0 0x7fd04c06ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.476+0000 7fd04bfff700 1 -- 172.21.15.6:0/1912280646 >> v1:172.21.15.175:6789/0 conn(0x7fd04c0688d0 legacy=0x7fd04c0c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:49.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.476+0000 7fd04bfff700 1 -- 172.21.15.6:0/1912280646 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c0ca010 con 0x7fd04c068ca0 2023-10-06T02:29:49.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.476+0000 7fd0510b6700 1 --2- 172.21.15.6:0/1912280646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04c1517f0 0x7fd04c06ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.476+0000 7fd04bfff700 1 --2- 172.21.15.6:0/1912280646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c068ca0 0x7fd04c1512b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd03c0098e0 tx=0x7fd03c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9d5a3924a78afc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.476+0000 7fd04b7fe700 1 -- 172.21.15.6:0/1912280646 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c00b640 con 0x7fd04c068ca0 2023-10-06T02:29:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.476+0000 7fd04b7fe700 1 -- 172.21.15.6:0/1912280646 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c00b7a0 con 0x7fd04c068ca0 2023-10-06T02:29:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.476+0000 7fd04b7fe700 1 -- 172.21.15.6:0/1912280646 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c00bb40 con 0x7fd04c068ca0 2023-10-06T02:29:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.476+0000 7fd052b19700 1 -- 172.21.15.6:0/1912280646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c068ca0 msgr2=0x7fd04c1512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.476+0000 7fd052b19700 1 --2- 172.21.15.6:0/1912280646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c068ca0 0x7fd04c1512b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd03c0098e0 tx=0x7fd03c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.477+0000 7fd052b19700 1 -- 172.21.15.6:0/1912280646 shutdown_connections 2023-10-06T02:29:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.477+0000 7fd052b19700 1 --2- 172.21.15.6:0/1912280646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04c1517f0 0x7fd04c06ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.477+0000 7fd052b19700 1 --2- 172.21.15.6:0/1912280646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c068ca0 0x7fd04c1512b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.477+0000 7fd052b19700 1 -- 172.21.15.6:0/1912280646 >> 172.21.15.6:0/1912280646 conn(0x7fd04c06a220 msgr2=0x7fd04c06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.477+0000 7fd052b19700 1 -- 172.21.15.6:0/1912280646 shutdown_connections 2023-10-06T02:29:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.477+0000 7fd052b19700 1 -- 172.21.15.6:0/1912280646 wait complete. 2023-10-06T02:29:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.478+0000 7fd052b19700 1 Processor -- start 2023-10-06T02:29:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.478+0000 7fd052b19700 1 -- start start 2023-10-06T02:29:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd052b19700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd04c0688d0 0x7fd04c0c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd052b19700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04c068ca0 0x7fd04c14ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd052b19700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c1517f0 0x7fd04c06c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd052b19700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c168e70 con 0x7fd04c0688d0 2023-10-06T02:29:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd052b19700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c0c70b0 con 0x7fd04c1517f0 2023-10-06T02:29:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd052b19700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c168260 con 0x7fd04c068ca0 2023-10-06T02:29:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd0508b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd04c0688d0 0x7fd04c0c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:49.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd0508b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd04c0688d0 0x7fd04c0c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41380/0 (socket says 172.21.15.6:41380) 2023-10-06T02:29:49.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd0508b5700 1 -- 172.21.15.6:0/2870107039 learned_addr learned my addr 172.21.15.6:0/2870107039 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:49.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd04bfff700 1 --2- 172.21.15.6:0/2870107039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04c068ca0 0x7fd04c14ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:49.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd0510b6700 1 --2- 172.21.15.6:0/2870107039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c1517f0 0x7fd04c06c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:49.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd0508b5700 1 -- 172.21.15.6:0/2870107039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04c068ca0 msgr2=0x7fd04c14ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:49.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd0508b5700 1 --2- 172.21.15.6:0/2870107039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04c068ca0 0x7fd04c14ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd0508b5700 1 -- 172.21.15.6:0/2870107039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c1517f0 msgr2=0x7fd04c06c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:49.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd0508b5700 1 --2- 172.21.15.6:0/2870107039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c1517f0 0x7fd04c06c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd0508b5700 1 -- 172.21.15.6:0/2870107039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd044009a20 con 0x7fd04c0688d0 2023-10-06T02:29:49.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd0508b5700 1 --2- 172.21.15.6:0/2870107039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd04c0688d0 0x7fd04c0c6b70 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7fd03400c7f0 tx=0x7fd034007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:49.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd048ff9700 1 -- 172.21.15.6:0/2870107039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034005b30 con 0x7fd04c0688d0 2023-10-06T02:29:49.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.479+0000 7fd048ff9700 1 -- 172.21.15.6:0/2870107039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd034005cb0 con 0x7fd04c0688d0 2023-10-06T02:29:49.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.480+0000 7fd052b19700 1 -- 172.21.15.6:0/2870107039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd03c009420 con 0x7fd04c0688d0 2023-10-06T02:29:49.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.480+0000 7fd048ff9700 1 -- 172.21.15.6:0/2870107039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034004a80 con 0x7fd04c0688d0 2023-10-06T02:29:49.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.480+0000 7fd052b19700 1 -- 172.21.15.6:0/2870107039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04c1688a0 con 0x7fd04c0688d0 2023-10-06T02:29:49.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.480+0000 7fd052b19700 1 -- 172.21.15.6:0/2870107039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04c06e720 con 0x7fd04c0688d0 2023-10-06T02:29:49.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.481+0000 7fd048ff9700 1 -- 172.21.15.6:0/2870107039 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd0340070d0 con 0x7fd04c0688d0 2023-10-06T02:29:49.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.481+0000 7fd048ff9700 1 --2- 172.21.15.6:0/2870107039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd02c066f30 0x7fd02c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:49.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.481+0000 7fd048ff9700 1 -- 172.21.15.6:0/2870107039 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 9818+0+0 (secure 0 0 0) 0x7fd034084820 con 0x7fd04c0688d0 2023-10-06T02:29:49.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.482+0000 7fd04bfff700 1 --2- 172.21.15.6:0/2870107039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd02c066f30 0x7fd02c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:49.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.482+0000 7fd04bfff700 1 --2- 172.21.15.6:0/2870107039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd02c066f30 0x7fd02c0693e0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd03c0093f0 tx=0x7fd03c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:49.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.486+0000 7fd048ff9700 1 -- 172.21.15.6:0/2870107039 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd03404b5a0 con 0x7fd04c0688d0 2023-10-06T02:29:49.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.724+0000 7fd052b19700 1 -- 172.21.15.6:0/2870107039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd04c0ca2f0 con 0x7fd04c0688d0 2023-10-06T02:29:49.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.725+0000 7fd048ff9700 1 -- 172.21.15.6:0/2870107039 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 351 v351) v1 ==== 95+0+4596 (secure 0 0 0) 0x7fd034050b00 con 0x7fd04c0688d0 2023-10-06T02:29:49.727 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:49.727 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":351,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10713,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2434594072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2434594072},{"type":"v1","addr":"172.21.15.6:6835","nonce":2434594072}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":351}],"filesystems":[{"mdsmap":{"epoch":350,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:46.199267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.726+0000 7fd052b19700 1 -- 172.21.15.6:0/2870107039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd02c066f30 msgr2=0x7fd02c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.726+0000 7fd052b19700 1 --2- 172.21.15.6:0/2870107039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd02c066f30 0x7fd02c0693e0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd03c0093f0 tx=0x7fd03c017000 comp rx=0 tx=0).stop 2023-10-06T02:29:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.726+0000 7fd052b19700 1 -- 172.21.15.6:0/2870107039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd04c0688d0 msgr2=0x7fd04c0c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.726+0000 7fd052b19700 1 --2- 172.21.15.6:0/2870107039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd04c0688d0 0x7fd04c0c6b70 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7fd03400c7f0 tx=0x7fd034007f70 comp rx=0 tx=0).stop 2023-10-06T02:29:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.727+0000 7fd052b19700 1 -- 172.21.15.6:0/2870107039 shutdown_connections 2023-10-06T02:29:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.727+0000 7fd052b19700 1 --2- 172.21.15.6:0/2870107039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c1517f0 0x7fd04c06c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.727+0000 7fd052b19700 1 --2- 172.21.15.6:0/2870107039 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd02c066f30 0x7fd02c0693e0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.727+0000 7fd052b19700 1 --2- 172.21.15.6:0/2870107039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd04c0688d0 0x7fd04c0c6b70 unknown :-1 s=CLOSED pgs=2316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.727+0000 7fd052b19700 1 --2- 172.21.15.6:0/2870107039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd04c068ca0 0x7fd04c14ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.727+0000 7fd052b19700 1 -- 172.21.15.6:0/2870107039 >> 172.21.15.6:0/2870107039 conn(0x7fd04c06a220 msgr2=0x7fd04c14d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.727+0000 7fd052b19700 1 -- 172.21.15.6:0/2870107039 shutdown_connections 2023-10-06T02:29:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:49.727+0000 7fd052b19700 1 -- 172.21.15.6:0/2870107039 wait complete. 2023-10-06T02:29:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 351 2023-10-06T02:29:49.740 INFO:tasks.cephfs.test_damage:Result: Mutation 'Corrupt omap header on 1.00000000' led to DAMAGED state 2023-10-06T02:29:49.740 INFO:tasks.cephfs.test_damage:All 39 mutations had expected outcomes 2023-10-06T02:29:49.740 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:29:49.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:29:49.778 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:29:49.829 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:29:49.829 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:29:49.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:49.830 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:29:49.845 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:29:49.845 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:29:49.845 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:29:49.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:49.846 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:29:49.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:29:49.862 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T02:29:49.863 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:29:49.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:49.863 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T02:29:49.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:29:49.901 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T02:29:49.901 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:29:49.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:29:49.901 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T02:29:49.918 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T02:29:49.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:29:49.919 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:50.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.058+0000 7f1d82e85700 1 Processor -- start 2023-10-06T02:29:50.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.058+0000 7f1d82e85700 1 -- start start 2023-10-06T02:29:50.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.059+0000 7f1d82e85700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d7c159400 0x7f1d7c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.059+0000 7f1d82e85700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d7c0d05d0 0x7f1d7c0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.059+0000 7f1d82e85700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c0b3560 con 0x7f1d7c0cd030 2023-10-06T02:29:50.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.059+0000 7f1d82e85700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c0cf6f0 con 0x7f1d7c0d05d0 2023-10-06T02:29:50.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.059+0000 7f1d82e85700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c0cf9d0 con 0x7f1d7c159400 2023-10-06T02:29:50.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.059+0000 7f1d82684700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d7c0d05d0 0x7f1d7c0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.059+0000 7f1d82684700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d7c0d05d0 0x7f1d7c0b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41384/0 (socket says 172.21.15.6:41384) 2023-10-06T02:29:50.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.059+0000 7f1d82684700 1 -- 172.21.15.6:0/3712607529 learned_addr learned my addr 172.21.15.6:0/3712607529 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:50.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.059+0000 7f1d81682700 1 --1- 172.21.15.6:0/3712607529 >> v1:172.21.15.6:6789/0 conn(0x7f1d7c0cd030 0x7f1d7c0cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42476/0 (socket says 172.21.15.6:42476) 2023-10-06T02:29:50.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.059+0000 7f1d81e83700 1 --2- 172.21.15.6:0/3712607529 >> v2:172.21.15.175:3300/0 conn(0x7f1d7c159400 0x7f1d7c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.059+0000 7f1d82684700 1 -- 172.21.15.6:0/3712607529 >> v2:172.21.15.175:3300/0 conn(0x7f1d7c159400 msgr2=0x7f1d7c0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:50.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.059+0000 7f1d82684700 1 --2- 172.21.15.6:0/3712607529 >> v2:172.21.15.175:3300/0 conn(0x7f1d7c159400 0x7f1d7c0ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.059+0000 7f1d82684700 1 -- 172.21.15.6:0/3712607529 >> v1:172.21.15.6:6789/0 conn(0x7f1d7c0cd030 legacy=0x7f1d7c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.059+0000 7f1d82684700 1 -- 172.21.15.6:0/3712607529 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0b2f10 con 0x7f1d7c0d05d0 2023-10-06T02:29:50.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.059+0000 7f1d80e81700 1 -- 172.21.15.6:0/3712607529 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865127686 0 0) 0x7f1d7c0b3560 con 0x7f1d7c0cd030 2023-10-06T02:29:50.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.060+0000 7f1d82684700 1 --2- 172.21.15.6:0/3712607529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c0d05d0 0x7f1d7c0b39f0 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c067fc0 tx=0x7f1d74009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8b394eb49468ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:50.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.060+0000 7f1d80e81700 1 -- 172.21.15.6:0/3712607529 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7400e070 con 0x7f1d7c0d05d0 2023-10-06T02:29:50.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.060+0000 7f1d80e81700 1 -- 172.21.15.6:0/3712607529 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7400ba50 con 0x7f1d7c0d05d0 2023-10-06T02:29:50.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.060+0000 7f1d80e81700 1 -- 172.21.15.6:0/3712607529 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d740092e0 con 0x7f1d7c0d05d0 2023-10-06T02:29:50.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.060+0000 7f1d82e85700 1 -- 172.21.15.6:0/3712607529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c0d05d0 msgr2=0x7f1d7c0b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.060+0000 7f1d82e85700 1 --2- 172.21.15.6:0/3712607529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c0d05d0 0x7f1d7c0b39f0 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c067fc0 tx=0x7f1d74009840 comp rx=0 tx=0).stop 2023-10-06T02:29:50.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.060+0000 7f1d82e85700 1 -- 172.21.15.6:0/3712607529 shutdown_connections 2023-10-06T02:29:50.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.060+0000 7f1d82e85700 1 --2- 172.21.15.6:0/3712607529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c0d05d0 0x7f1d7c0b39f0 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.060+0000 7f1d82e85700 1 --2- 172.21.15.6:0/3712607529 >> v2:172.21.15.175:3300/0 conn(0x7f1d7c159400 0x7f1d7c0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.060+0000 7f1d82e85700 1 -- 172.21.15.6:0/3712607529 >> 172.21.15.6:0/3712607529 conn(0x7f1d7c06ac10 msgr2=0x7f1d7c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:50.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.060+0000 7f1d82e85700 1 -- 172.21.15.6:0/3712607529 shutdown_connections 2023-10-06T02:29:50.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.060+0000 7f1d82e85700 1 -- 172.21.15.6:0/3712607529 wait complete. 2023-10-06T02:29:50.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.061+0000 7f1d82e85700 1 Processor -- start 2023-10-06T02:29:50.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.061+0000 7f1d82e85700 1 -- start start 2023-10-06T02:29:50.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.062+0000 7f1d82e85700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c0cd030 0x7f1d7c169840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.062+0000 7f1d82e85700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d7c0d05d0 0x7f1d7c15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.062+0000 7f1d82e85700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c159400 0x7f1d7c15be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.062+0000 7f1d82e85700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c169d80 con 0x7f1d7c159400 2023-10-06T02:29:50.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.062+0000 7f1d82e85700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c16cc40 con 0x7f1d7c0cd030 2023-10-06T02:29:50.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.062+0000 7f1d82e85700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0b0b10 con 0x7f1d7c0d05d0 2023-10-06T02:29:50.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.062+0000 7f1d82684700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c159400 0x7f1d7c15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.062+0000 7f1d82684700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c159400 0x7f1d7c15be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41396/0 (socket says 172.21.15.6:41396) 2023-10-06T02:29:50.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.062+0000 7f1d82684700 1 -- 172.21.15.6:0/142780401 learned_addr learned my addr 172.21.15.6:0/142780401 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:50.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.062+0000 7f1d81e83700 1 --2- 172.21.15.6:0/142780401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c0cd030 0x7f1d7c169840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.062+0000 7f1d81682700 1 --2- 172.21.15.6:0/142780401 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d7c0d05d0 0x7f1d7c15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.062+0000 7f1d82684700 1 -- 172.21.15.6:0/142780401 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d7c0d05d0 msgr2=0x7f1d7c15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.062+0000 7f1d82684700 1 --2- 172.21.15.6:0/142780401 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d7c0d05d0 0x7f1d7c15b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.062+0000 7f1d82684700 1 -- 172.21.15.6:0/142780401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c0cd030 msgr2=0x7f1d7c169840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.062+0000 7f1d82684700 1 --2- 172.21.15.6:0/142780401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c0cd030 0x7f1d7c169840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.063+0000 7f1d82684700 1 -- 172.21.15.6:0/142780401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d74009ae0 con 0x7f1d7c159400 2023-10-06T02:29:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.063+0000 7f1d81e83700 1 --2- 172.21.15.6:0/142780401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c0cd030 0x7f1d7c169840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.063+0000 7f1d82684700 1 --2- 172.21.15.6:0/142780401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c159400 0x7f1d7c15be00 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009ab0 tx=0x7f1d74018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.063+0000 7f1d71ffb700 1 -- 172.21.15.6:0/142780401 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74008e80 con 0x7f1d7c159400 2023-10-06T02:29:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.063+0000 7f1d71ffb700 1 -- 172.21.15.6:0/142780401 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7400be60 con 0x7f1d7c159400 2023-10-06T02:29:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.063+0000 7f1d82e85700 1 -- 172.21.15.6:0/142780401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c15c640 con 0x7f1d7c159400 2023-10-06T02:29:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.063+0000 7f1d71ffb700 1 -- 172.21.15.6:0/142780401 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74026690 con 0x7f1d7c159400 2023-10-06T02:29:50.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.063+0000 7f1d82e85700 1 -- 172.21.15.6:0/142780401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c0b04c0 con 0x7f1d7c159400 2023-10-06T02:29:50.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.064+0000 7f1d82e85700 1 -- 172.21.15.6:0/142780401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c0b0c50 con 0x7f1d7c159400 2023-10-06T02:29:50.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.064+0000 7f1d71ffb700 1 -- 172.21.15.6:0/142780401 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d74003040 con 0x7f1d7c159400 2023-10-06T02:29:50.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.065+0000 7f1d71ffb700 1 --2- 172.21.15.6:0/142780401 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d60066f30 0x7f1d600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.065+0000 7f1d71ffb700 1 -- 172.21.15.6:0/142780401 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 9818+0+0 (secure 0 0 0) 0x7f1d74086f80 con 0x7f1d7c159400 2023-10-06T02:29:50.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.065+0000 7f1d81e83700 1 --2- 172.21.15.6:0/142780401 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d60066f30 0x7f1d600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.066+0000 7f1d81e83700 1 --2- 172.21.15.6:0/142780401 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d60066f30 0x7f1d600693e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f1d78006aa0 tx=0x7f1d78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:50.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.069+0000 7f1d71ffb700 1 -- 172.21.15.6:0/142780401 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d740531a0 con 0x7f1d7c159400 2023-10-06T02:29:50.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.310+0000 7f1d82e85700 1 -- 172.21.15.6:0/142780401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d7c069ee0 con 0x7f1d7c159400 2023-10-06T02:29:50.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.311+0000 7f1d71ffb700 1 -- 172.21.15.6:0/142780401 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 351 v351) v1 ==== 95+0+4596 (secure 0 0 0) 0x7f1d740567c0 con 0x7f1d7c159400 2023-10-06T02:29:50.312 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:50.313 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":351,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10713,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2434594072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2434594072},{"type":"v1","addr":"172.21.15.6:6835","nonce":2434594072}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":351}],"filesystems":[{"mdsmap":{"epoch":350,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:46.199267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:50.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.312+0000 7f1d82e85700 1 -- 172.21.15.6:0/142780401 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d60066f30 msgr2=0x7f1d600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.312+0000 7f1d82e85700 1 --2- 172.21.15.6:0/142780401 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d60066f30 0x7f1d600693e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f1d78006aa0 tx=0x7f1d78008040 comp rx=0 tx=0).stop 2023-10-06T02:29:50.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.312+0000 7f1d82e85700 1 -- 172.21.15.6:0/142780401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c159400 msgr2=0x7f1d7c15be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.312+0000 7f1d82e85700 1 --2- 172.21.15.6:0/142780401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c159400 0x7f1d7c15be00 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009ab0 tx=0x7f1d74018000 comp rx=0 tx=0).stop 2023-10-06T02:29:50.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.313+0000 7f1d82e85700 1 -- 172.21.15.6:0/142780401 shutdown_connections 2023-10-06T02:29:50.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.313+0000 7f1d82e85700 1 --2- 172.21.15.6:0/142780401 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1d60066f30 0x7f1d600693e0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.313+0000 7f1d82e85700 1 --2- 172.21.15.6:0/142780401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7c159400 0x7f1d7c15be00 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.313+0000 7f1d82e85700 1 --2- 172.21.15.6:0/142780401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c0cd030 0x7f1d7c169840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.313+0000 7f1d82e85700 1 --2- 172.21.15.6:0/142780401 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d7c0d05d0 0x7f1d7c15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.313+0000 7f1d82e85700 1 -- 172.21.15.6:0/142780401 >> 172.21.15.6:0/142780401 conn(0x7f1d7c06ac10 msgr2=0x7f1d7c0cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:50.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.313+0000 7f1d82e85700 1 -- 172.21.15.6:0/142780401 shutdown_connections 2023-10-06T02:29:50.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.313+0000 7f1d82e85700 1 -- 172.21.15.6:0/142780401 wait complete. 2023-10-06T02:29:50.316 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 351 2023-10-06T02:29:50.326 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:29:50.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.444+0000 7f49dc01c700 1 Processor -- start 2023-10-06T02:29:50.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.444+0000 7f49dc01c700 1 -- start start 2023-10-06T02:29:50.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.445+0000 7f49dc01c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49d40af1d0 0x7f49d40af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.445+0000 7f49dc01c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49d406da40 0x7f49d4068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.445+0000 7f49dc01c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d406d5b0 con 0x7f49d4068bc0 2023-10-06T02:29:50.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.445+0000 7f49dc01c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d40caf90 con 0x7f49d406da40 2023-10-06T02:29:50.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.445+0000 7f49dc01c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d4069040 con 0x7f49d40af1d0 2023-10-06T02:29:50.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.445+0000 7f49d95b7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49d406da40 0x7f49d4068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.445+0000 7f49da5b9700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f49d4068bc0 0x7f49d4159a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42490/0 (socket says 172.21.15.6:42490) 2023-10-06T02:29:50.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.445+0000 7f49da5b9700 1 -- 172.21.15.6:0/1931757827 learned_addr learned my addr 172.21.15.6:0/1931757827 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:50.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.445+0000 7f49d9db8700 1 --2- 172.21.15.6:0/1931757827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49d40af1d0 0x7f49d40af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.445+0000 7f49d95b7700 1 -- 172.21.15.6:0/1931757827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49d40af1d0 msgr2=0x7f49d40af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:50.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.445+0000 7f49d95b7700 1 --2- 172.21.15.6:0/1931757827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49d40af1d0 0x7f49d40af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.445+0000 7f49d95b7700 1 -- 172.21.15.6:0/1931757827 >> v1:172.21.15.6:6789/0 conn(0x7f49d4068bc0 legacy=0x7f49d4159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.445+0000 7f49d95b7700 1 -- 172.21.15.6:0/1931757827 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d406deb0 con 0x7f49d406da40 2023-10-06T02:29:50.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.445+0000 7f49d9db8700 1 --2- 172.21.15.6:0/1931757827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49d40af1d0 0x7f49d40af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:50.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.445+0000 7f49d8db6700 1 -- 172.21.15.6:0/1931757827 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422007099 0 0) 0x7f49d406d5b0 con 0x7f49d4068bc0 2023-10-06T02:29:50.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.445+0000 7f49d95b7700 1 --2- 172.21.15.6:0/1931757827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d406da40 0x7f49d4068680 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7f49c40098e0 tx=0x7f49c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c053d6fc7f42b042 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:50.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.446+0000 7f49d8db6700 1 -- 172.21.15.6:0/1931757827 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c4009e80 con 0x7f49d406da40 2023-10-06T02:29:50.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.446+0000 7f49d8db6700 1 -- 172.21.15.6:0/1931757827 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c400b860 con 0x7f49d406da40 2023-10-06T02:29:50.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.446+0000 7f49d8db6700 1 -- 172.21.15.6:0/1931757827 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c400bbe0 con 0x7f49d406da40 2023-10-06T02:29:50.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.446+0000 7f49dc01c700 1 -- 172.21.15.6:0/1931757827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d406da40 msgr2=0x7f49d4068680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.446+0000 7f49dc01c700 1 --2- 172.21.15.6:0/1931757827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d406da40 0x7f49d4068680 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7f49c40098e0 tx=0x7f49c40091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.446+0000 7f49dc01c700 1 -- 172.21.15.6:0/1931757827 shutdown_connections 2023-10-06T02:29:50.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.446+0000 7f49dc01c700 1 --2- 172.21.15.6:0/1931757827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49d40af1d0 0x7f49d40af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.446+0000 7f49dc01c700 1 --2- 172.21.15.6:0/1931757827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d406da40 0x7f49d4068680 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.446+0000 7f49dc01c700 1 -- 172.21.15.6:0/1931757827 >> 172.21.15.6:0/1931757827 conn(0x7f49d406a220 msgr2=0x7f49d406b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:50.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.446+0000 7f49dc01c700 1 -- 172.21.15.6:0/1931757827 shutdown_connections 2023-10-06T02:29:50.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.446+0000 7f49dc01c700 1 -- 172.21.15.6:0/1931757827 wait complete. 2023-10-06T02:29:50.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.447+0000 7f49dc01c700 1 Processor -- start 2023-10-06T02:29:50.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.447+0000 7f49dc01c700 1 -- start start 2023-10-06T02:29:50.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49dc01c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49d4068bc0 0x7f49d40a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49dc01c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49d406da40 0x7f49d40c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49dc01c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d40af1d0 0x7f49d41552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49dc01c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d40c6e80 con 0x7f49d40af1d0 2023-10-06T02:29:50.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49dc01c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d40c58a0 con 0x7f49d4068bc0 2023-10-06T02:29:50.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49dc01c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d40c6590 con 0x7f49d406da40 2023-10-06T02:29:50.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49da5b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d40af1d0 0x7f49d41552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49da5b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d40af1d0 0x7f49d41552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41422/0 (socket says 172.21.15.6:41422) 2023-10-06T02:29:50.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49da5b9700 1 -- 172.21.15.6:0/3783654912 learned_addr learned my addr 172.21.15.6:0/3783654912 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:50.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49d9db8700 1 --2- 172.21.15.6:0/3783654912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49d4068bc0 0x7f49d40a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49d95b7700 1 --2- 172.21.15.6:0/3783654912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49d406da40 0x7f49d40c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49da5b9700 1 -- 172.21.15.6:0/3783654912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49d406da40 msgr2=0x7f49d40c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49da5b9700 1 --2- 172.21.15.6:0/3783654912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49d406da40 0x7f49d40c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49da5b9700 1 -- 172.21.15.6:0/3783654912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49d4068bc0 msgr2=0x7f49d40a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49da5b9700 1 --2- 172.21.15.6:0/3783654912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49d4068bc0 0x7f49d40a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49da5b9700 1 -- 172.21.15.6:0/3783654912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c4009420 con 0x7f49d40af1d0 2023-10-06T02:29:50.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49d9db8700 1 --2- 172.21.15.6:0/3783654912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49d4068bc0 0x7f49d40a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:50.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.448+0000 7f49d95b7700 1 --2- 172.21.15.6:0/3783654912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49d406da40 0x7f49d40c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:50.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.449+0000 7f49da5b9700 1 --2- 172.21.15.6:0/3783654912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d40af1d0 0x7f49d41552b0 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00cbf0 tx=0x7f49cc0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:50.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.449+0000 7f49c9ffb700 1 -- 172.21.15.6:0/3783654912 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc00a9c0 con 0x7f49d40af1d0 2023-10-06T02:29:50.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.449+0000 7f49c9ffb700 1 -- 172.21.15.6:0/3783654912 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49cc00ab20 con 0x7f49d40af1d0 2023-10-06T02:29:50.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.449+0000 7f49dc01c700 1 -- 172.21.15.6:0/3783654912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d40c6830 con 0x7f49d40af1d0 2023-10-06T02:29:50.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.449+0000 7f49c9ffb700 1 -- 172.21.15.6:0/3783654912 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc0070f0 con 0x7f49d40af1d0 2023-10-06T02:29:50.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.449+0000 7f49dc01c700 1 -- 172.21.15.6:0/3783654912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d41557f0 con 0x7f49d40af1d0 2023-10-06T02:29:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.450+0000 7f49dc01c700 1 -- 172.21.15.6:0/3783654912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d406e720 con 0x7f49d40af1d0 2023-10-06T02:29:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.451+0000 7f49c9ffb700 1 -- 172.21.15.6:0/3783654912 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49cc007520 con 0x7f49d40af1d0 2023-10-06T02:29:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.451+0000 7f49c9ffb700 1 --2- 172.21.15.6:0/3783654912 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f49b8066f30 0x7f49b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.451+0000 7f49c9ffb700 1 -- 172.21.15.6:0/3783654912 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 9818+0+0 (secure 0 0 0) 0x7f49cc0859d0 con 0x7f49d40af1d0 2023-10-06T02:29:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.451+0000 7f49d9db8700 1 --2- 172.21.15.6:0/3783654912 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f49b8066f30 0x7f49b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.452+0000 7f49d9db8700 1 --2- 172.21.15.6:0/3783654912 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f49b8066f30 0x7f49b80693e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f49d0008b20 tx=0x7f49d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:50.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.455+0000 7f49c9ffb700 1 -- 172.21.15.6:0/3783654912 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49cc051c70 con 0x7f49d40af1d0 2023-10-06T02:29:50.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.647+0000 7f49dc01c700 1 -- 172.21.15.6:0/3783654912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49d40c6fc0 con 0x7f49d40af1d0 2023-10-06T02:29:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.648+0000 7f49c9ffb700 1 -- 172.21.15.6:0/3783654912 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+22134 (secure 0 0 0) 0x7f49cc055290 con 0x7f49d40af1d0 2023-10-06T02:29:50.650 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:50.650 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":135,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:29:46.199032+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:38.117438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:39.346545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/1827807239":"2023-10-07T02:29:46.199003+0000","172.21.15.6:6835/3743771475":"2023-10-07T02:26:52.896928+0000","172.21.15.6:6835/1318769254":"2023-10-07T02:26:41.158040+0000","172.21.15.6:6835/2869895689":"2023-10-07T02:25:23.853264+0000","172.21.15.6:6833/1045457090":"2023-10-07T02:25:56.200399+0000","172.21.15.6:6833/2361875445":"2023-10-07T02:27:17.854084+0000","172.21.15.6:6835/3364863394":"2023-10-07T02:26:17.923309+0000","172.21.15.6:6835/3306486265":"2023-10-07T02:26:03.842781+0000","172.21.15.6:6833/2951290545":"2023-10-07T02:25:45.052605+0000","172.21.15.6:6835/3458727123":"2023-10-07T02:28:33.945993+0000","172.21.15.6:6833/862419044":"2023-10-07T02:29:39.146227+0000","172.21.15.6:6833/216641974":"2023-10-07T02:26:47.857852+0000","172.21.15.6:6833/3743771475":"2023-10-07T02:26:52.896928+0000","172.21.15.6:6833/171345142":"2023-10-07T02:28:55.598562+0000","172.21.15.6:6833/1052086725":"2023-10-07T02:25:58.221425+0000","172.21.15.6:6833/2846199049":"2023-10-07T02:24:54.766539+0000","172.21.15.6:6833/1318769254":"2023-10-07T02:26:41.158040+0000","172.21.15.6:6835/3954180287":"2023-10-07T02:26:56.923442+0000","172.21.15.6:6833/1622379942":"2023-10-07T02:25:17.098229+0000","172.21.15.6:6833/1827807239":"2023-10-07T02:29:46.199003+0000","172.21.15.6:6833/4105967039":"2023-10-07T02:26:10.886741+0000","172.21.15.6:6835/2951290545":"2023-10-07T02:25:45.052605+0000","172.21.15.6:6835/2298587443":"2023-10-07T02:25:11.951806+0000","172.21.15.6:6833/2198441052":"2023-10-07T02:29:12.035908+0000","172.21.15.6:6833/2298587443":"2023-10-07T02:25:11.951806+0000","172.21.15.6:6835/3396709104":"2023-10-07T02:27:59.847878+0000","172.21.15.6:6835/1622379942":"2023-10-07T02:25:17.098229+0000","172.21.15.6:6835/216641974":"2023-10-07T02:26:47.857852+0000","172.21.15.6:6833/3428181968":"2023-10-07T02:26:33.108528+0000","172.21.15.6:6835/2846199049":"2023-10-07T02:24:54.766539+0000","172.21.15.6:6833/3306486265":"2023-10-07T02:26:03.842781+0000","172.21.15.6:6835/788286408":"2023-10-07T02:25:31.922453+0000","172.21.15.6:6835/1052086725":"2023-10-07T02:25:58.221425+0000","172.21.15.6:6835/3650321949":"2023-10-07T02:27:21.889165+0000","172.21.15.6:6833/172936756":"2023-10-07T02:27:29.845422+0000","172.21.15.6:6833/2220056807":"2023-10-07T02:25:27.888466+0000","172.21.15.6:6835/3081379602":"2023-10-07T02:26:31.089756+0000","172.21.15.6:6835/2220056807":"2023-10-07T02:25:27.888466+0000","172.21.15.6:6833/2869895689":"2023-10-07T02:25:23.853264+0000","172.21.15.6:6835/171345142":"2023-10-07T02:28:55.598562+0000","172.21.15.6:6835/4105967039":"2023-10-07T02:26:10.886741+0000","172.21.15.6:6835/2420647508":"2023-10-07T02:27:38.002295+0000","172.21.15.6:6833/3012609856":"2023-10-07T02:27:13.280610+0000","172.21.15.6:6835/1045457090":"2023-10-07T02:25:56.200399+0000","172.21.15.6:6835/2198441052":"2023-10-07T02:29:12.035908+0000","172.21.15.6:6833/3954180287":"2023-10-07T02:26:56.923442+0000","172.21.15.6:6833/2836519357":"2023-10-07T02:27:11.265755+0000","172.21.15.6:6833/2274292833":"2023-10-07T02:28:08.189815+0000","172.21.15.6:6833/1713670870":"2023-10-07T02:29:07.007752+0000","172.21.15.6:6835/2836519357":"2023-10-07T02:27:11.265755+0000","172.21.15.6:6835/3012609856":"2023-10-07T02:27:13.280610+0000","172.21.15.6:6833/4058600046":"2023-10-07T02:28:28.153959+0000","172.21.15.6:6833/3650321949":"2023-10-07T02:27:21.889165+0000","172.21.15.6:6833/829468452":"2023-10-07T02:27:25.919824+0000","172.21.15.6:6833/3081379602":"2023-10-07T02:26:31.089756+0000","172.21.15.6:6835/829468452":"2023-10-07T02:27:25.919824+0000","172.21.15.6:6835/172936756":"2023-10-07T02:27:29.845422+0000","172.21.15.6:6835/4058600046":"2023-10-07T02:28:28.153959+0000","172.21.15.6:6833/1123398769":"2023-10-07T02:27:33.969565+0000","172.21.15.6:6833/1461010014":"2023-10-07T02:28:04.154595+0000","172.21.15.6:6835/3428181968":"2023-10-07T02:26:33.108528+0000","172.21.15.6:6835/1123398769":"2023-10-07T02:27:33.969565+0000","172.21.15.6:6835/1713670870":"2023-10-07T02:29:07.007752+0000","172.21.15.6:6833/2420647508":"2023-10-07T02:27:38.002295+0000","172.21.15.6:6833/4129427704":"2023-10-07T02:27:53.927529+0000","172.21.15.6:6835/4129427704":"2023-10-07T02:27:53.927529+0000","172.21.15.6:6833/788286408":"2023-10-07T02:25:31.922453+0000","172.21.15.6:6833/3592673283":"2023-10-07T02:27:56.096324+0000","172.21.15.6:6835/3592673283":"2023-10-07T02:27:56.096324+0000","172.21.15.6:6833/3396709104":"2023-10-07T02:27:59.847878+0000","172.21.15.6:6835/1461010014":"2023-10-07T02:28:04.154595+0000","172.21.15.6:6835/2274292833":"2023-10-07T02:28:08.189815+0000","172.21.15.6:6833/3458727123":"2023-10-07T02:28:33.945993+0000","172.21.15.6:6833/3364863394":"2023-10-07T02:26:17.923309+0000","172.21.15.6:6833/1486243669":"2023-10-07T02:29:27.961813+0000","172.21.15.6:6835/2361875445":"2023-10-07T02:27:17.854084+0000","172.21.15.6:6835/1486243669":"2023-10-07T02:29:27.961813+0000","172.21.15.6:6833/3944398775":"2023-10-07T02:29:32.871108+0000","172.21.15.6:6835/3944398775":"2023-10-07T02:29:32.871108+0000","172.21.15.6:6835/862419044":"2023-10-07T02:29:39.146227+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:29:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.650+0000 7f49dc01c700 1 -- 172.21.15.6:0/3783654912 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f49b8066f30 msgr2=0x7f49b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.650+0000 7f49dc01c700 1 --2- 172.21.15.6:0/3783654912 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f49b8066f30 0x7f49b80693e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f49d0008b20 tx=0x7f49d0008040 comp rx=0 tx=0).stop 2023-10-06T02:29:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.650+0000 7f49dc01c700 1 -- 172.21.15.6:0/3783654912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d40af1d0 msgr2=0x7f49d41552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.650+0000 7f49dc01c700 1 --2- 172.21.15.6:0/3783654912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d40af1d0 0x7f49d41552b0 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00cbf0 tx=0x7f49cc0019b0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.650+0000 7f49dc01c700 1 -- 172.21.15.6:0/3783654912 shutdown_connections 2023-10-06T02:29:50.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.650+0000 7f49dc01c700 1 --2- 172.21.15.6:0/3783654912 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f49b8066f30 0x7f49b80693e0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.650+0000 7f49dc01c700 1 --2- 172.21.15.6:0/3783654912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d40af1d0 0x7f49d41552b0 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.650+0000 7f49dc01c700 1 --2- 172.21.15.6:0/3783654912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49d4068bc0 0x7f49d40a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.650+0000 7f49dc01c700 1 --2- 172.21.15.6:0/3783654912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49d406da40 0x7f49d40c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.650+0000 7f49dc01c700 1 -- 172.21.15.6:0/3783654912 >> 172.21.15.6:0/3783654912 conn(0x7f49d406a220 msgr2=0x7f49d40cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:50.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.650+0000 7f49dc01c700 1 -- 172.21.15.6:0/3783654912 shutdown_connections 2023-10-06T02:29:50.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.650+0000 7f49dc01c700 1 -- 172.21.15.6:0/3783654912 wait complete. 2023-10-06T02:29:50.664 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:24:38.117438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:24:39.346545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:29:50.664 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:29:50.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.784+0000 7f9f0186e700 1 Processor -- start 2023-10-06T02:29:50.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.784+0000 7f9f0186e700 1 -- start start 2023-10-06T02:29:50.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.785+0000 7f9f0186e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9efc0cc3d0 0x7f9efc0c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.785+0000 7f9f0186e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9efc0c3b40 con 0x7f9efc1574b0 2023-10-06T02:29:50.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.785+0000 7f9f0186e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9efc0c2f30 con 0x7f9efc0c3fd0 2023-10-06T02:29:50.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.785+0000 7f9f0186e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9efc0c4980 con 0x7f9efc0cc3d0 2023-10-06T02:29:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.785+0000 7f9efaffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9efc1574b0 0x7f9efc0b0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42506/0 (socket says 172.21.15.6:42506) 2023-10-06T02:29:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.785+0000 7f9efaffd700 1 -- 172.21.15.6:0/4259476142 learned_addr learned my addr 172.21.15.6:0/4259476142 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9ef9ffb700 1 -- 172.21.15.6:0/4259476142 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080247705 0 0) 0x7f9efc0c3b40 con 0x7f9efc1574b0 2023-10-06T02:29:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9efb7fe700 1 --2- 172.21.15.6:0/4259476142 >> v2:172.21.15.175:3300/0 conn(0x7f9efc0cc3d0 0x7f9efc0c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9ef9ffb700 1 -- 172.21.15.6:0/4259476142 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ee8003570 con 0x7f9efc1574b0 2023-10-06T02:29:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9ef9ffb700 1 -- 172.21.15.6:0/4259476142 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1733109262 0 0) 0x7f9ee8003570 con 0x7f9efc1574b0 2023-10-06T02:29:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9ef9ffb700 1 -- 172.21.15.6:0/4259476142 >> v2:172.21.15.175:3300/0 conn(0x7f9efc0cc3d0 msgr2=0x7f9efc0c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9ef9ffb700 1 --2- 172.21.15.6:0/4259476142 >> v2:172.21.15.175:3300/0 conn(0x7f9efc0cc3d0 0x7f9efc0c4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9ef9ffb700 1 -- 172.21.15.6:0/4259476142 >> v1:172.21.15.175:6789/0 conn(0x7f9efc0c3fd0 legacy=0x7f9efc0cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9ef9ffb700 1 -- 172.21.15.6:0/4259476142 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc0c3210 con 0x7f9efc1574b0 2023-10-06T02:29:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9ef9ffb700 1 -- 172.21.15.6:0/4259476142 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f9ef40015f0 con 0x7f9efc1574b0 2023-10-06T02:29:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9ef9ffb700 1 -- 172.21.15.6:0/4259476142 >> v1:172.21.15.6:6789/0 conn(0x7f9efc1574b0 legacy=0x7f9efc0b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9ef9ffb700 1 --2- 172.21.15.6:0/4259476142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee8003a60 0x7f9ee8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9ef9ffb700 1 --2- 172.21.15.6:0/4259476142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee8004810 0x7f9ee8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9ef9ffb700 1 --2- 172.21.15.6:0/4259476142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee80051c0 0x7f9ee800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9ef9ffb700 1 -- 172.21.15.6:0/4259476142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc0c4980 con 0x7f9ee80051c0 2023-10-06T02:29:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9ef9ffb700 1 -- 172.21.15.6:0/4259476142 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee800c0d0 con 0x7f9ee8004810 2023-10-06T02:29:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9ef9ffb700 1 -- 172.21.15.6:0/4259476142 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee800c290 con 0x7f9ee8003a60 2023-10-06T02:29:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9efb7fe700 1 --2- 172.21.15.6:0/4259476142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee80051c0 0x7f9ee800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9efaffd700 1 --2- 172.21.15.6:0/4259476142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee8003a60 0x7f9ee8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9efa7fc700 1 --2- 172.21.15.6:0/4259476142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee8004810 0x7f9ee8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9efb7fe700 1 -- 172.21.15.6:0/4259476142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee8003a60 msgr2=0x7f9ee8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9efb7fe700 1 --2- 172.21.15.6:0/4259476142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee8003a60 0x7f9ee8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9efb7fe700 1 -- 172.21.15.6:0/4259476142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee8004810 msgr2=0x7f9ee8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9efb7fe700 1 --2- 172.21.15.6:0/4259476142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee8004810 0x7f9ee8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9efb7fe700 1 -- 172.21.15.6:0/4259476142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee8003570 con 0x7f9ee80051c0 2023-10-06T02:29:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9efa7fc700 1 --2- 172.21.15.6:0/4259476142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee8004810 0x7f9ee8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.786+0000 7f9efb7fe700 1 -- 172.21.15.6:0/4259476142 reap_dead start 2023-10-06T02:29:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.787+0000 7f9efb7fe700 1 --2- 172.21.15.6:0/4259476142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee80051c0 0x7f9ee800ba60 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0cc7d0 tx=0x7f9eec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262d2fa228705549 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.787+0000 7f9ef9ffb700 1 -- 172.21.15.6:0/4259476142 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec00ea60 con 0x7f9ee80051c0 2023-10-06T02:29:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.787+0000 7f9ef9ffb700 1 -- 172.21.15.6:0/4259476142 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eec00f040 con 0x7f9ee80051c0 2023-10-06T02:29:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.787+0000 7f9ef9ffb700 1 -- 172.21.15.6:0/4259476142 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec00ee30 con 0x7f9ee80051c0 2023-10-06T02:29:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.787+0000 7f9f0186e700 1 -- 172.21.15.6:0/4259476142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee80051c0 msgr2=0x7f9ee800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.787+0000 7f9f0186e700 1 --2- 172.21.15.6:0/4259476142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee80051c0 0x7f9ee800ba60 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0cc7d0 tx=0x7f9eec00b040 comp rx=0 tx=0).stop 2023-10-06T02:29:50.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.787+0000 7f9f0186e700 1 -- 172.21.15.6:0/4259476142 shutdown_connections 2023-10-06T02:29:50.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.787+0000 7f9f0186e700 1 --2- 172.21.15.6:0/4259476142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee80051c0 0x7f9ee800ba60 unknown :-1 s=CLOSED pgs=2324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.787+0000 7f9f0186e700 1 -- 172.21.15.6:0/4259476142 >> 172.21.15.6:0/4259476142 conn(0x7f9efc067910 msgr2=0x7f9efc0ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:50.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.787+0000 7f9f0186e700 1 -- 172.21.15.6:0/4259476142 shutdown_connections 2023-10-06T02:29:50.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.787+0000 7f9f0186e700 1 -- 172.21.15.6:0/4259476142 wait complete. 2023-10-06T02:29:50.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.789+0000 7f9f0186e700 1 Processor -- start 2023-10-06T02:29:50.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.789+0000 7f9f0186e700 1 -- start start 2023-10-06T02:29:50.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.789+0000 7f9f0186e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee80051c0 0x7f9efc14c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.789+0000 7f9f0186e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9efc16ac70 0x7f9efc158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.789+0000 7f9f0186e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9efc15bf90 0x7f9efc15c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.789+0000 7f9f0186e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc15c940 con 0x7f9ee80051c0 2023-10-06T02:29:50.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.789+0000 7f9f0186e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc15a150 con 0x7f9efc16ac70 2023-10-06T02:29:50.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.789+0000 7f9f0186e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc159540 con 0x7f9efc15bf90 2023-10-06T02:29:50.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.789+0000 7f9efaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee80051c0 0x7f9efc14c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.789+0000 7f9efaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee80051c0 0x7f9efc14c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41434/0 (socket says 172.21.15.6:41434) 2023-10-06T02:29:50.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.789+0000 7f9efaffd700 1 -- 172.21.15.6:0/743691971 learned_addr learned my addr 172.21.15.6:0/743691971 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:50.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.790+0000 7f9efa7fc700 1 --2- 172.21.15.6:0/743691971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9efc16ac70 0x7f9efc158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.790+0000 7f9efb7fe700 1 --2- 172.21.15.6:0/743691971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9efc15bf90 0x7f9efc15c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.790+0000 7f9efaffd700 1 -- 172.21.15.6:0/743691971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9efc15bf90 msgr2=0x7f9efc15c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.790+0000 7f9efaffd700 1 --2- 172.21.15.6:0/743691971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9efc15bf90 0x7f9efc15c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.790+0000 7f9efaffd700 1 -- 172.21.15.6:0/743691971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9efc16ac70 msgr2=0x7f9efc158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.790+0000 7f9efaffd700 1 --2- 172.21.15.6:0/743691971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9efc16ac70 0x7f9efc158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.790+0000 7f9efaffd700 1 -- 172.21.15.6:0/743691971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc159820 con 0x7f9ee80051c0 2023-10-06T02:29:50.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.790+0000 7f9efaffd700 1 --2- 172.21.15.6:0/743691971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee80051c0 0x7f9efc14c830 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4007a30 tx=0x7f9ef4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:50.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.790+0000 7f9ef2ffd700 1 -- 172.21.15.6:0/743691971 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef40072e0 con 0x7f9ee80051c0 2023-10-06T02:29:50.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.790+0000 7f9ef2ffd700 1 -- 172.21.15.6:0/743691971 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef4007440 con 0x7f9ee80051c0 2023-10-06T02:29:50.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.790+0000 7f9f0186e700 1 -- 172.21.15.6:0/743691971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9efc159b00 con 0x7f9ee80051c0 2023-10-06T02:29:50.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.790+0000 7f9ef2ffd700 1 -- 172.21.15.6:0/743691971 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef40057f0 con 0x7f9ee80051c0 2023-10-06T02:29:50.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.790+0000 7f9f0186e700 1 -- 172.21.15.6:0/743691971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9efc15a5e0 con 0x7f9ee80051c0 2023-10-06T02:29:50.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.791+0000 7f9f0186e700 1 -- 172.21.15.6:0/743691971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9efc159fa0 con 0x7f9ee80051c0 2023-10-06T02:29:50.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.791+0000 7f9ef2ffd700 1 -- 172.21.15.6:0/743691971 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ef4005b80 con 0x7f9ee80051c0 2023-10-06T02:29:50.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.792+0000 7f9ef2ffd700 1 --2- 172.21.15.6:0/743691971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9edc066f30 0x7f9edc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:50.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.792+0000 7f9ef2ffd700 1 -- 172.21.15.6:0/743691971 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 9818+0+0 (secure 0 0 0) 0x7f9ef40857b0 con 0x7f9ee80051c0 2023-10-06T02:29:50.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.792+0000 7f9efa7fc700 1 --2- 172.21.15.6:0/743691971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9edc066f30 0x7f9edc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:50.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.792+0000 7f9efa7fc700 1 --2- 172.21.15.6:0/743691971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9edc066f30 0x7f9edc0693e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4000c00 tx=0x7f9ee4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:50.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.796+0000 7f9ef2ffd700 1 -- 172.21.15.6:0/743691971 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ef4055460 con 0x7f9ee80051c0 2023-10-06T02:29:50.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.989+0000 7f9f0186e700 1 -- 172.21.15.6:0/743691971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9efc15a430 con 0x7f9ee80051c0 2023-10-06T02:29:50.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.989+0000 7f9ef2ffd700 1 -- 172.21.15.6:0/743691971 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v135) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9ef4054ff0 con 0x7f9ee80051c0 2023-10-06T02:29:50.991 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:29:50.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.991+0000 7f9f0186e700 1 -- 172.21.15.6:0/743691971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9edc066f30 msgr2=0x7f9edc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.991+0000 7f9f0186e700 1 --2- 172.21.15.6:0/743691971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9edc066f30 0x7f9edc0693e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4000c00 tx=0x7f9ee4009040 comp rx=0 tx=0).stop 2023-10-06T02:29:50.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.991+0000 7f9f0186e700 1 -- 172.21.15.6:0/743691971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee80051c0 msgr2=0x7f9efc14c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:50.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.991+0000 7f9f0186e700 1 --2- 172.21.15.6:0/743691971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee80051c0 0x7f9efc14c830 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4007a30 tx=0x7f9ef4009040 comp rx=0 tx=0).stop 2023-10-06T02:29:50.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.991+0000 7f9f0186e700 1 -- 172.21.15.6:0/743691971 shutdown_connections 2023-10-06T02:29:50.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.991+0000 7f9f0186e700 1 --2- 172.21.15.6:0/743691971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9efc15bf90 0x7f9efc15c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.991+0000 7f9f0186e700 1 --2- 172.21.15.6:0/743691971 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9edc066f30 0x7f9edc0693e0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.991+0000 7f9f0186e700 1 --2- 172.21.15.6:0/743691971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ee80051c0 0x7f9efc14c830 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.991+0000 7f9f0186e700 1 --2- 172.21.15.6:0/743691971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9efc16ac70 0x7f9efc158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:50.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.991+0000 7f9f0186e700 1 -- 172.21.15.6:0/743691971 >> 172.21.15.6:0/743691971 conn(0x7f9efc067910 msgr2=0x7f9efc15d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:50.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.991+0000 7f9f0186e700 1 -- 172.21.15.6:0/743691971 shutdown_connections 2023-10-06T02:29:50.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:50.991+0000 7f9f0186e700 1 -- 172.21.15.6:0/743691971 wait complete. 2023-10-06T02:29:51.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:29:51.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.125+0000 7fb5422bb700 1 Processor -- start 2023-10-06T02:29:51.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.125+0000 7fb5422bb700 1 -- start start 2023-10-06T02:29:51.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.125+0000 7fb5422bb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb53c06a750 0x7fb53c15d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:51.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.125+0000 7fb5422bb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb53c15d770 0x7fb53c159170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:51.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.125+0000 7fb5422bb700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53c0cae80 con 0x7fb53c06a380 2023-10-06T02:29:51.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.125+0000 7fb5422bb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb53c0cba20 con 0x7fb53c15d770 2023-10-06T02:29:51.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.125+0000 7fb5422bb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0cc3d0 con 0x7fb53c06a750 2023-10-06T02:29:51.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.126+0000 7fb540858700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb53c15d770 0x7fb53c159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:51.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.126+0000 7fb540858700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb53c15d770 0x7fb53c159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41450/0 (socket says 172.21.15.6:41450) 2023-10-06T02:29:51.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.126+0000 7fb540858700 1 -- 172.21.15.6:0/2456111264 learned_addr learned my addr 172.21.15.6:0/2456111264 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:51.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.126+0000 7fb53b7fe700 1 --2- 172.21.15.6:0/2456111264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb53c06a750 0x7fb53c15d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:51.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.126+0000 7fb540858700 1 -- 172.21.15.6:0/2456111264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb53c06a750 msgr2=0x7fb53c15d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:51.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.126+0000 7fb540858700 1 --2- 172.21.15.6:0/2456111264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb53c06a750 0x7fb53c15d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.126+0000 7fb540858700 1 -- 172.21.15.6:0/2456111264 >> v1:172.21.15.175:6789/0 conn(0x7fb53c06a380 legacy=0x7fb53c0cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.126+0000 7fb540858700 1 -- 172.21.15.6:0/2456111264 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c15dcd0 con 0x7fb53c15d770 2023-10-06T02:29:51.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.126+0000 7fb540858700 1 --2- 172.21.15.6:0/2456111264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb53c15d770 0x7fb53c159170 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7fb534009f20 tx=0x7fb534009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd29cd0b1215a24 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:51.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.126+0000 7fb53affd700 1 -- 172.21.15.6:0/2456111264 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53400e070 con 0x7fb53c15d770 2023-10-06T02:29:51.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.126+0000 7fb53affd700 1 -- 172.21.15.6:0/2456111264 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53400ba80 con 0x7fb53c15d770 2023-10-06T02:29:51.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.126+0000 7fb53affd700 1 -- 172.21.15.6:0/2456111264 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5340092e0 con 0x7fb53c15d770 2023-10-06T02:29:51.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.127+0000 7fb5422bb700 1 -- 172.21.15.6:0/2456111264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb53c15d770 msgr2=0x7fb53c159170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.127+0000 7fb5422bb700 1 --2- 172.21.15.6:0/2456111264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb53c15d770 0x7fb53c159170 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7fb534009f20 tx=0x7fb534009840 comp rx=0 tx=0).stop 2023-10-06T02:29:51.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.127+0000 7fb5422bb700 1 -- 172.21.15.6:0/2456111264 shutdown_connections 2023-10-06T02:29:51.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.127+0000 7fb5422bb700 1 --2- 172.21.15.6:0/2456111264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb53c15d770 0x7fb53c159170 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.127+0000 7fb5422bb700 1 --2- 172.21.15.6:0/2456111264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb53c06a750 0x7fb53c15d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.127+0000 7fb5422bb700 1 -- 172.21.15.6:0/2456111264 >> 172.21.15.6:0/2456111264 conn(0x7fb53c0d0350 msgr2=0x7fb53c0d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:51.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.127+0000 7fb5422bb700 1 -- 172.21.15.6:0/2456111264 shutdown_connections 2023-10-06T02:29:51.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.127+0000 7fb5422bb700 1 -- 172.21.15.6:0/2456111264 wait complete. 2023-10-06T02:29:51.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.128+0000 7fb5422bb700 1 Processor -- start 2023-10-06T02:29:51.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.128+0000 7fb5422bb700 1 -- start start 2023-10-06T02:29:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb5422bb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb53c06a380 0x7fb53c154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb5422bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb53c06a750 0x7fb53c16b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb5422bb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb53c15d770 0x7fb53c0b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb5422bb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0b59a0 con 0x7fb53c06a750 2023-10-06T02:29:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb5422bb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0c8c00 con 0x7fb53c06a380 2023-10-06T02:29:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb5422bb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0b4fc0 con 0x7fb53c15d770 2023-10-06T02:29:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb53b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb53c06a750 0x7fb53c16b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb53b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb53c06a750 0x7fb53c16b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41464/0 (socket says 172.21.15.6:41464) 2023-10-06T02:29:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb53b7fe700 1 -- 172.21.15.6:0/3537958882 learned_addr learned my addr 172.21.15.6:0/3537958882 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb53bfff700 1 --2- 172.21.15.6:0/3537958882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb53c06a380 0x7fb53c154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb540858700 1 --2- 172.21.15.6:0/3537958882 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb53c15d770 0x7fb53c0b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb53b7fe700 1 -- 172.21.15.6:0/3537958882 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb53c15d770 msgr2=0x7fb53c0b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb53b7fe700 1 --2- 172.21.15.6:0/3537958882 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb53c15d770 0x7fb53c0b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb53b7fe700 1 -- 172.21.15.6:0/3537958882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb53c06a380 msgr2=0x7fb53c154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb53b7fe700 1 --2- 172.21.15.6:0/3537958882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb53c06a380 0x7fb53c154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb53b7fe700 1 -- 172.21.15.6:0/3537958882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb534009ae0 con 0x7fb53c06a750 2023-10-06T02:29:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb53b7fe700 1 --2- 172.21.15.6:0/3537958882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb53c06a750 0x7fb53c16b210 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fb53000d890 tx=0x7fb530008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.129+0000 7fb523fff700 1 -- 172.21.15.6:0/3537958882 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5300125f0 con 0x7fb53c06a750 2023-10-06T02:29:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.130+0000 7fb523fff700 1 -- 172.21.15.6:0/3537958882 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb530012750 con 0x7fb53c06a750 2023-10-06T02:29:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.130+0000 7fb5422bb700 1 -- 172.21.15.6:0/3537958882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53c16a5b0 con 0x7fb53c06a750 2023-10-06T02:29:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.130+0000 7fb523fff700 1 -- 172.21.15.6:0/3537958882 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530012af0 con 0x7fb53c06a750 2023-10-06T02:29:51.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.130+0000 7fb5422bb700 1 -- 172.21.15.6:0/3537958882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c16ab70 con 0x7fb53c06a750 2023-10-06T02:29:51.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.131+0000 7fb5422bb700 1 -- 172.21.15.6:0/3537958882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c088a40 con 0x7fb53c06a750 2023-10-06T02:29:51.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.131+0000 7fb523fff700 1 -- 172.21.15.6:0/3537958882 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb53001e460 con 0x7fb53c06a750 2023-10-06T02:29:51.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.131+0000 7fb523fff700 1 --2- 172.21.15.6:0/3537958882 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb528066f30 0x7fb5280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:51.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.132+0000 7fb523fff700 1 -- 172.21.15.6:0/3537958882 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 9818+0+0 (secure 0 0 0) 0x7fb530085a70 con 0x7fb53c06a750 2023-10-06T02:29:51.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.132+0000 7fb53bfff700 1 --2- 172.21.15.6:0/3537958882 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb528066f30 0x7fb5280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:51.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.132+0000 7fb53bfff700 1 --2- 172.21.15.6:0/3537958882 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb528066f30 0x7fb5280693e0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0c5440 tx=0x7fb52c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:51.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.136+0000 7fb523fff700 1 -- 172.21.15.6:0/3537958882 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb530051c90 con 0x7fb53c06a750 2023-10-06T02:29:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.330+0000 7fb5422bb700 1 -- 172.21.15.6:0/3537958882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb53c15dfb0 con 0x7fb53c06a750 2023-10-06T02:29:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.331+0000 7fb523fff700 1 -- 172.21.15.6:0/3537958882 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb5300552b0 con 0x7fb53c06a750 2023-10-06T02:29:51.333 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:29:51.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.333+0000 7fb5422bb700 1 -- 172.21.15.6:0/3537958882 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb528066f30 msgr2=0x7fb5280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.333+0000 7fb5422bb700 1 --2- 172.21.15.6:0/3537958882 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb528066f30 0x7fb5280693e0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0c5440 tx=0x7fb52c009040 comp rx=0 tx=0).stop 2023-10-06T02:29:51.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.333+0000 7fb5422bb700 1 -- 172.21.15.6:0/3537958882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb53c06a750 msgr2=0x7fb53c16b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.333+0000 7fb5422bb700 1 --2- 172.21.15.6:0/3537958882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb53c06a750 0x7fb53c16b210 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fb53000d890 tx=0x7fb530008040 comp rx=0 tx=0).stop 2023-10-06T02:29:51.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.333+0000 7fb5422bb700 1 -- 172.21.15.6:0/3537958882 shutdown_connections 2023-10-06T02:29:51.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.333+0000 7fb5422bb700 1 --2- 172.21.15.6:0/3537958882 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb53c15d770 0x7fb53c0b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.333+0000 7fb5422bb700 1 --2- 172.21.15.6:0/3537958882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb53c06a380 0x7fb53c154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.333+0000 7fb5422bb700 1 --2- 172.21.15.6:0/3537958882 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb528066f30 0x7fb5280693e0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.333+0000 7fb5422bb700 1 --2- 172.21.15.6:0/3537958882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb53c06a750 0x7fb53c16b210 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.333+0000 7fb5422bb700 1 -- 172.21.15.6:0/3537958882 >> 172.21.15.6:0/3537958882 conn(0x7fb53c0d0350 msgr2=0x7fb53c155140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:51.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.333+0000 7fb5422bb700 1 -- 172.21.15.6:0/3537958882 shutdown_connections 2023-10-06T02:29:51.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.333+0000 7fb5422bb700 1 -- 172.21.15.6:0/3537958882 wait complete. 2023-10-06T02:29:51.346 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:29:51.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.467+0000 7fe3da8b8700 1 Processor -- start 2023-10-06T02:29:51.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.467+0000 7fe3da8b8700 1 -- start start 2023-10-06T02:29:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.468+0000 7fe3da8b8700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe3d40b28c0 0x7fe3d4087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.468+0000 7fe3da8b8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d40afc50 con 0x7fe3d4086ff0 2023-10-06T02:29:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.468+0000 7fe3da8b8700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d40aff30 con 0x7fe3d415a030 2023-10-06T02:29:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.468+0000 7fe3da8b8700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d40b0cf0 con 0x7fe3d40b28c0 2023-10-06T02:29:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.468+0000 7fe3d37fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe3d4086ff0 0x7fe3d40b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42522/0 (socket says 172.21.15.6:42522) 2023-10-06T02:29:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.468+0000 7fe3d37fe700 1 -- 172.21.15.6:0/1429300799 learned_addr learned my addr 172.21.15.6:0/1429300799 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.468+0000 7fe3d8e55700 1 --2- 172.21.15.6:0/1429300799 >> v2:172.21.15.175:3300/0 conn(0x7fe3d40b28c0 0x7fe3d4087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.468+0000 7fe3d2ffd700 1 -- 172.21.15.6:0/1429300799 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481926873 0 0) 0x7fe3d40afc50 con 0x7fe3d4086ff0 2023-10-06T02:29:51.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.468+0000 7fe3d2ffd700 1 -- 172.21.15.6:0/1429300799 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3bc003570 con 0x7fe3d4086ff0 2023-10-06T02:29:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.468+0000 7fe3d8e55700 1 -- 172.21.15.6:0/1429300799 >> v1:172.21.15.175:6789/0 conn(0x7fe3d415a030 legacy=0x7fe3d415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.468+0000 7fe3d8e55700 1 -- 172.21.15.6:0/1429300799 >> v1:172.21.15.6:6789/0 conn(0x7fe3d4086ff0 legacy=0x7fe3d40b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.468+0000 7fe3d8e55700 1 -- 172.21.15.6:0/1429300799 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d40b0210 con 0x7fe3d40b28c0 2023-10-06T02:29:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.468+0000 7fe3d8e55700 1 --2- 172.21.15.6:0/1429300799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3d40b28c0 0x7fe3d4087470 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009e60 tx=0x7fe3cc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec981238b54bf2a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.469+0000 7fe3d2ffd700 1 -- 172.21.15.6:0/1429300799 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00e070 con 0x7fe3d40b28c0 2023-10-06T02:29:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.469+0000 7fe3d2ffd700 1 -- 172.21.15.6:0/1429300799 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc00bb60 con 0x7fe3d40b28c0 2023-10-06T02:29:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.469+0000 7fe3d2ffd700 1 -- 172.21.15.6:0/1429300799 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc012430 con 0x7fe3d40b28c0 2023-10-06T02:29:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.469+0000 7fe3da8b8700 1 -- 172.21.15.6:0/1429300799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3d40b28c0 msgr2=0x7fe3d4087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.469+0000 7fe3da8b8700 1 --2- 172.21.15.6:0/1429300799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3d40b28c0 0x7fe3d4087470 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009e60 tx=0x7fe3cc009780 comp rx=0 tx=0).stop 2023-10-06T02:29:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.469+0000 7fe3da8b8700 1 -- 172.21.15.6:0/1429300799 shutdown_connections 2023-10-06T02:29:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.469+0000 7fe3da8b8700 1 --2- 172.21.15.6:0/1429300799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3d40b28c0 0x7fe3d4087470 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.469+0000 7fe3da8b8700 1 -- 172.21.15.6:0/1429300799 >> 172.21.15.6:0/1429300799 conn(0x7fe3d4068680 msgr2=0x7fe3d4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:51.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.469+0000 7fe3da8b8700 1 -- 172.21.15.6:0/1429300799 shutdown_connections 2023-10-06T02:29:51.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.469+0000 7fe3da8b8700 1 -- 172.21.15.6:0/1429300799 wait complete. 2023-10-06T02:29:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.470+0000 7fe3da8b8700 1 Processor -- start 2023-10-06T02:29:51.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.470+0000 7fe3da8b8700 1 -- start start 2023-10-06T02:29:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.471+0000 7fe3da8b8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3d4086ff0 0x7fe3d40c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.471+0000 7fe3da8b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d40b28c0 0x7fe3d41559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.471+0000 7fe3da8b8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3d415a030 0x7fe3d40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.471+0000 7fe3da8b8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40c9300 con 0x7fe3d40b28c0 2023-10-06T02:29:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.471+0000 7fe3da8b8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40c5a30 con 0x7fe3d415a030 2023-10-06T02:29:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.471+0000 7fe3da8b8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d4169740 con 0x7fe3d4086ff0 2023-10-06T02:29:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.471+0000 7fe3d37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d40b28c0 0x7fe3d41559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.471+0000 7fe3d37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d40b28c0 0x7fe3d41559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41474/0 (socket says 172.21.15.6:41474) 2023-10-06T02:29:51.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.471+0000 7fe3d37fe700 1 -- 172.21.15.6:0/104586085 learned_addr learned my addr 172.21.15.6:0/104586085 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.471+0000 7fe3d8e55700 1 --2- 172.21.15.6:0/104586085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3d415a030 0x7fe3d40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.471+0000 7fe3d3fff700 1 --2- 172.21.15.6:0/104586085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3d4086ff0 0x7fe3d40c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.472+0000 7fe3d37fe700 1 -- 172.21.15.6:0/104586085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3d4086ff0 msgr2=0x7fe3d40c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.472+0000 7fe3d37fe700 1 --2- 172.21.15.6:0/104586085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3d4086ff0 0x7fe3d40c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.472+0000 7fe3d37fe700 1 -- 172.21.15.6:0/104586085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3d415a030 msgr2=0x7fe3d40cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.472+0000 7fe3d37fe700 1 --2- 172.21.15.6:0/104586085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3d415a030 0x7fe3d40cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.472+0000 7fe3d37fe700 1 -- 172.21.15.6:0/104586085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc009a20 con 0x7fe3d40b28c0 2023-10-06T02:29:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.472+0000 7fe3d8e55700 1 --2- 172.21.15.6:0/104586085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3d415a030 0x7fe3d40cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.472+0000 7fe3d3fff700 1 --2- 172.21.15.6:0/104586085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3d4086ff0 0x7fe3d40c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.472+0000 7fe3d37fe700 1 --2- 172.21.15.6:0/104586085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d40b28c0 0x7fe3d41559c0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800c590 tx=0x7fe3c8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.472+0000 7fe3bbfff700 1 -- 172.21.15.6:0/104586085 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8005b30 con 0x7fe3d40b28c0 2023-10-06T02:29:51.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.472+0000 7fe3bbfff700 1 -- 172.21.15.6:0/104586085 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c8005cb0 con 0x7fe3d40b28c0 2023-10-06T02:29:51.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.472+0000 7fe3bbfff700 1 -- 172.21.15.6:0/104586085 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8007320 con 0x7fe3d40b28c0 2023-10-06T02:29:51.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.472+0000 7fe3da8b8700 1 -- 172.21.15.6:0/104586085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d40c41e0 con 0x7fe3d40b28c0 2023-10-06T02:29:51.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.472+0000 7fe3da8b8700 1 -- 172.21.15.6:0/104586085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d40c47a0 con 0x7fe3d40b28c0 2023-10-06T02:29:51.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.473+0000 7fe3da8b8700 1 -- 172.21.15.6:0/104586085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d4169960 con 0x7fe3d40b28c0 2023-10-06T02:29:51.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.473+0000 7fe3bbfff700 1 -- 172.21.15.6:0/104586085 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3c801b3b0 con 0x7fe3d40b28c0 2023-10-06T02:29:51.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.474+0000 7fe3bbfff700 1 --2- 172.21.15.6:0/104586085 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe3c0066f30 0x7fe3c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:51.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.474+0000 7fe3bbfff700 1 -- 172.21.15.6:0/104586085 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 9818+0+0 (secure 0 0 0) 0x7fe3c8084c00 con 0x7fe3d40b28c0 2023-10-06T02:29:51.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.474+0000 7fe3d3fff700 1 --2- 172.21.15.6:0/104586085 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe3c0066f30 0x7fe3c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:51.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.474+0000 7fe3d3fff700 1 --2- 172.21.15.6:0/104586085 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe3c0066f30 0x7fe3c00693e0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4001840 tx=0x7fe3c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:51.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.478+0000 7fe3bbfff700 1 -- 172.21.15.6:0/104586085 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3d4169960 con 0x7fe3d40b28c0 2023-10-06T02:29:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.669+0000 7fe3da8b8700 1 -- 172.21.15.6:0/104586085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe3d4169960 con 0x7fe3d40b28c0 2023-10-06T02:29:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.669+0000 7fe3bbfff700 1 -- 172.21.15.6:0/104586085 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v135) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe3d4169960 con 0x7fe3d40b28c0 2023-10-06T02:29:51.671 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:29:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.671+0000 7fe3da8b8700 1 -- 172.21.15.6:0/104586085 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe3c0066f30 msgr2=0x7fe3c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.671+0000 7fe3da8b8700 1 --2- 172.21.15.6:0/104586085 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe3c0066f30 0x7fe3c00693e0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4001840 tx=0x7fe3c4009040 comp rx=0 tx=0).stop 2023-10-06T02:29:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.672+0000 7fe3da8b8700 1 -- 172.21.15.6:0/104586085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d40b28c0 msgr2=0x7fe3d41559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.672+0000 7fe3da8b8700 1 --2- 172.21.15.6:0/104586085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d40b28c0 0x7fe3d41559c0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800c590 tx=0x7fe3c8007e00 comp rx=0 tx=0).stop 2023-10-06T02:29:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.672+0000 7fe3da8b8700 1 -- 172.21.15.6:0/104586085 shutdown_connections 2023-10-06T02:29:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.672+0000 7fe3da8b8700 1 --2- 172.21.15.6:0/104586085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3d415a030 0x7fe3d40cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.672+0000 7fe3da8b8700 1 --2- 172.21.15.6:0/104586085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3d4086ff0 0x7fe3d40c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.672+0000 7fe3da8b8700 1 --2- 172.21.15.6:0/104586085 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe3c0066f30 0x7fe3c00693e0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.672+0000 7fe3da8b8700 1 --2- 172.21.15.6:0/104586085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d40b28c0 0x7fe3d41559c0 unknown :-1 s=CLOSED pgs=2329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.672+0000 7fe3da8b8700 1 -- 172.21.15.6:0/104586085 >> 172.21.15.6:0/104586085 conn(0x7fe3d4068680 msgr2=0x7fe3d4159070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.672+0000 7fe3da8b8700 1 -- 172.21.15.6:0/104586085 shutdown_connections 2023-10-06T02:29:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.672+0000 7fe3da8b8700 1 -- 172.21.15.6:0/104586085 wait complete. 2023-10-06T02:29:51.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:29:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.805+0000 7fb8ef109700 1 Processor -- start 2023-10-06T02:29:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.805+0000 7fb8ef109700 1 -- start start 2023-10-06T02:29:51.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.806+0000 7fb8ef109700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e815a030 0x7fb8e815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:51.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.806+0000 7fb8ef109700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e80afc50 con 0x7fb8e815a940 2023-10-06T02:29:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.806+0000 7fb8ef109700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e80aff30 con 0x7fb8e8087700 2023-10-06T02:29:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.806+0000 7fb8ef109700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80b0cf0 con 0x7fb8e815a030 2023-10-06T02:29:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.806+0000 7fb8e7fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb8e815a940 0x7fb8e8086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42526/0 (socket says 172.21.15.6:42526) 2023-10-06T02:29:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.806+0000 7fb8e7fff700 1 -- 172.21.15.6:0/3174591118 learned_addr learned my addr 172.21.15.6:0/3174591118 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.806+0000 7fb8ecea5700 1 --2- 172.21.15.6:0/3174591118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e815a030 0x7fb8e815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.806+0000 7fb8e77fe700 1 -- 172.21.15.6:0/3174591118 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403223482 0 0) 0x7fb8e80afc50 con 0x7fb8e815a940 2023-10-06T02:29:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.806+0000 7fb8e77fe700 1 -- 172.21.15.6:0/3174591118 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8d4003570 con 0x7fb8e815a940 2023-10-06T02:29:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.807+0000 7fb8e77fe700 1 -- 172.21.15.6:0/3174591118 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194546544 0 0) 0x7fb8e80aff30 con 0x7fb8e8087700 2023-10-06T02:29:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.807+0000 7fb8e77fe700 1 -- 172.21.15.6:0/3174591118 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8e80afc50 con 0x7fb8e8087700 2023-10-06T02:29:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.807+0000 7fb8ecea5700 1 -- 172.21.15.6:0/3174591118 >> v1:172.21.15.175:6789/0 conn(0x7fb8e8087700 legacy=0x7fb8e80b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.807+0000 7fb8ecea5700 1 -- 172.21.15.6:0/3174591118 >> v1:172.21.15.6:6789/0 conn(0x7fb8e815a940 legacy=0x7fb8e8086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.807+0000 7fb8ecea5700 1 -- 172.21.15.6:0/3174591118 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e80b0210 con 0x7fb8e815a030 2023-10-06T02:29:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.807+0000 7fb8ecea5700 1 --2- 172.21.15.6:0/3174591118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e815a030 0x7fb8e815a400 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009910 tx=0x7fb8e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a176afda6865ad8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.807+0000 7fb8e77fe700 1 -- 172.21.15.6:0/3174591118 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0011630 con 0x7fb8e815a030 2023-10-06T02:29:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.807+0000 7fb8e77fe700 1 -- 172.21.15.6:0/3174591118 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e0011790 con 0x7fb8e815a030 2023-10-06T02:29:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.807+0000 7fb8e77fe700 1 -- 172.21.15.6:0/3174591118 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0011b30 con 0x7fb8e815a030 2023-10-06T02:29:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.807+0000 7fb8ef109700 1 -- 172.21.15.6:0/3174591118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e815a030 msgr2=0x7fb8e815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.807+0000 7fb8ef109700 1 --2- 172.21.15.6:0/3174591118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e815a030 0x7fb8e815a400 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009910 tx=0x7fb8e00091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.808+0000 7fb8ef109700 1 -- 172.21.15.6:0/3174591118 shutdown_connections 2023-10-06T02:29:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.808+0000 7fb8ef109700 1 --2- 172.21.15.6:0/3174591118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e815a030 0x7fb8e815a400 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.808+0000 7fb8ef109700 1 -- 172.21.15.6:0/3174591118 >> 172.21.15.6:0/3174591118 conn(0x7fb8e8068680 msgr2=0x7fb8e8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.808+0000 7fb8ef109700 1 -- 172.21.15.6:0/3174591118 shutdown_connections 2023-10-06T02:29:51.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.808+0000 7fb8ef109700 1 -- 172.21.15.6:0/3174591118 wait complete. 2023-10-06T02:29:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.809+0000 7fb8ef109700 1 Processor -- start 2023-10-06T02:29:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.809+0000 7fb8ef109700 1 -- start start 2023-10-06T02:29:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ef109700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e8087700 0x7fb8e815ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ef109700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e815a030 0x7fb8e80c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ef109700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8e815a940 0x7fb8e80c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ef109700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e815c3c0 con 0x7fb8e815a940 2023-10-06T02:29:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ef109700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e815b7b0 con 0x7fb8e815a030 2023-10-06T02:29:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ef109700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e815ba90 con 0x7fb8e8087700 2023-10-06T02:29:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ed6a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8e815a940 0x7fb8e80c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ed6a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8e815a940 0x7fb8e80c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41480/0 (socket says 172.21.15.6:41480) 2023-10-06T02:29:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ed6a6700 1 -- 172.21.15.6:0/2619502522 learned_addr learned my addr 172.21.15.6:0/2619502522 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ecea5700 1 --2- 172.21.15.6:0/2619502522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e8087700 0x7fb8e815ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8e7fff700 1 --2- 172.21.15.6:0/2619502522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e815a030 0x7fb8e80c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ed6a6700 1 -- 172.21.15.6:0/2619502522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e8087700 msgr2=0x7fb8e815ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ed6a6700 1 --2- 172.21.15.6:0/2619502522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e8087700 0x7fb8e815ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ed6a6700 1 -- 172.21.15.6:0/2619502522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e815a030 msgr2=0x7fb8e80c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ed6a6700 1 --2- 172.21.15.6:0/2619502522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e815a030 0x7fb8e80c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ed6a6700 1 -- 172.21.15.6:0/2619502522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e0009420 con 0x7fb8e815a940 2023-10-06T02:29:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ed6a6700 1 --2- 172.21.15.6:0/2619502522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8e815a940 0x7fb8e80c8870 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000c590 tx=0x7fb8d0007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8e4ff9700 1 -- 172.21.15.6:0/2619502522 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0016070 con 0x7fb8e815a940 2023-10-06T02:29:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8e4ff9700 1 -- 172.21.15.6:0/2619502522 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d0011590 con 0x7fb8e815a940 2023-10-06T02:29:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ef109700 1 -- 172.21.15.6:0/2619502522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e815bd70 con 0x7fb8e815a940 2023-10-06T02:29:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8e4ff9700 1 -- 172.21.15.6:0/2619502522 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0011970 con 0x7fb8e815a940 2023-10-06T02:29:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.810+0000 7fb8ef109700 1 -- 172.21.15.6:0/2619502522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e815c850 con 0x7fb8e815a940 2023-10-06T02:29:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.811+0000 7fb8ef109700 1 -- 172.21.15.6:0/2619502522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e815c530 con 0x7fb8e815a940 2023-10-06T02:29:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.812+0000 7fb8e4ff9700 1 -- 172.21.15.6:0/2619502522 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8d0012420 con 0x7fb8e815a940 2023-10-06T02:29:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.812+0000 7fb8e4ff9700 1 --2- 172.21.15.6:0/2619502522 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb8c8066f30 0x7fb8c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.812+0000 7fb8e4ff9700 1 -- 172.21.15.6:0/2619502522 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 9818+0+0 (secure 0 0 0) 0x7fb8d0084f30 con 0x7fb8e815a940 2023-10-06T02:29:51.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.812+0000 7fb8ecea5700 1 --2- 172.21.15.6:0/2619502522 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb8c8066f30 0x7fb8c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:51.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.813+0000 7fb8ecea5700 1 --2- 172.21.15.6:0/2619502522 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb8c8066f30 0x7fb8c80693e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb8e815cec0 tx=0x7fb8e0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:51.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:51.816+0000 7fb8e4ff9700 1 -- 172.21.15.6:0/2619502522 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8d0051150 con 0x7fb8e815a940 2023-10-06T02:29:52.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.008+0000 7fb8ef109700 1 -- 172.21.15.6:0/2619502522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8e80b04f0 con 0x7fb8e815a940 2023-10-06T02:29:52.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.009+0000 7fb8e4ff9700 1 -- 172.21.15.6:0/2619502522 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v135) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8d0054770 con 0x7fb8e815a940 2023-10-06T02:29:52.011 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-06T02:29:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.011+0000 7fb8ef109700 1 -- 172.21.15.6:0/2619502522 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb8c8066f30 msgr2=0x7fb8c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.011+0000 7fb8ef109700 1 --2- 172.21.15.6:0/2619502522 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb8c8066f30 0x7fb8c80693e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb8e815cec0 tx=0x7fb8e0017000 comp rx=0 tx=0).stop 2023-10-06T02:29:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.011+0000 7fb8ef109700 1 -- 172.21.15.6:0/2619502522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8e815a940 msgr2=0x7fb8e80c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.011+0000 7fb8ef109700 1 --2- 172.21.15.6:0/2619502522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8e815a940 0x7fb8e80c8870 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000c590 tx=0x7fb8d0007d80 comp rx=0 tx=0).stop 2023-10-06T02:29:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.011+0000 7fb8ef109700 1 -- 172.21.15.6:0/2619502522 shutdown_connections 2023-10-06T02:29:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.011+0000 7fb8ef109700 1 --2- 172.21.15.6:0/2619502522 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb8c8066f30 0x7fb8c80693e0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.011+0000 7fb8ef109700 1 --2- 172.21.15.6:0/2619502522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8e815a940 0x7fb8e80c8870 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.011+0000 7fb8ef109700 1 --2- 172.21.15.6:0/2619502522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e8087700 0x7fb8e815ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.011+0000 7fb8ef109700 1 --2- 172.21.15.6:0/2619502522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e815a030 0x7fb8e80c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.011+0000 7fb8ef109700 1 -- 172.21.15.6:0/2619502522 >> 172.21.15.6:0/2619502522 conn(0x7fb8e8068680 msgr2=0x7fb8e81588e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:52.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.011+0000 7fb8ef109700 1 -- 172.21.15.6:0/2619502522 shutdown_connections 2023-10-06T02:29:52.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.011+0000 7fb8ef109700 1 -- 172.21.15.6:0/2619502522 wait complete. 2023-10-06T02:29:52.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:52.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.141+0000 7f5648c2f700 1 Processor -- start 2023-10-06T02:29:52.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.141+0000 7f5648c2f700 1 -- start start 2023-10-06T02:29:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.142+0000 7f5648c2f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f564415b3c0 0x7f5644097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.142+0000 7f5648c2f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f564415a590 0x7f564415a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.142+0000 7f5648c2f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56440afb90 con 0x7f56440b3c50 2023-10-06T02:29:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.142+0000 7f5648c2f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564415aef0 con 0x7f564415a590 2023-10-06T02:29:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.142+0000 7f5648c2f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56440b2310 con 0x7f564415b3c0 2023-10-06T02:29:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.143+0000 7f5641d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f56440b3c50 0x7f564415b790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42538/0 (socket says 172.21.15.6:42538) 2023-10-06T02:29:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.143+0000 7f5641d9b700 1 -- 172.21.15.6:0/1027114473 learned_addr learned my addr 172.21.15.6:0/1027114473 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.143+0000 7f564259c700 1 --2- 172.21.15.6:0/1027114473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f564415b3c0 0x7f5644097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.143+0000 7f5642d9d700 1 --2- 172.21.15.6:0/1027114473 >> v2:172.21.15.175:3300/0 conn(0x7f564415a590 0x7f564415a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.143+0000 7f564159a700 1 -- 172.21.15.6:0/1027114473 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490633962 0 0) 0x7f56440afb90 con 0x7f56440b3c50 2023-10-06T02:29:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.143+0000 7f564159a700 1 -- 172.21.15.6:0/1027114473 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5630003570 con 0x7f56440b3c50 2023-10-06T02:29:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.143+0000 7f564259c700 1 -- 172.21.15.6:0/1027114473 >> v2:172.21.15.175:3300/0 conn(0x7f564415a590 msgr2=0x7f564415a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.143+0000 7f564259c700 1 --2- 172.21.15.6:0/1027114473 >> v2:172.21.15.175:3300/0 conn(0x7f564415a590 0x7f564415a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.143+0000 7f564259c700 1 -- 172.21.15.6:0/1027114473 >> v1:172.21.15.6:6789/0 conn(0x7f56440b3c50 legacy=0x7f564415b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.143+0000 7f564159a700 1 -- 172.21.15.6:0/1027114473 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3417937250 0 0) 0x7f5630003570 con 0x7f56440b3c50 2023-10-06T02:29:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.143+0000 7f564259c700 1 -- 172.21.15.6:0/1027114473 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440b25f0 con 0x7f564415b3c0 2023-10-06T02:29:52.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.143+0000 7f564259c700 1 --2- 172.21.15.6:0/1027114473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f564415b3c0 0x7f5644097d70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f563c009eb0 tx=0x7f563c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18d4d52c169d497 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:52.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.144+0000 7f564159a700 1 -- 172.21.15.6:0/1027114473 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c00e070 con 0x7f564415b3c0 2023-10-06T02:29:52.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.144+0000 7f564159a700 1 -- 172.21.15.6:0/1027114473 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563c00b870 con 0x7f564415b3c0 2023-10-06T02:29:52.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.144+0000 7f564159a700 1 -- 172.21.15.6:0/1027114473 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c001470 con 0x7f564415b3c0 2023-10-06T02:29:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.144+0000 7f5648c2f700 1 -- 172.21.15.6:0/1027114473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f564415b3c0 msgr2=0x7f5644097d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.144+0000 7f5648c2f700 1 --2- 172.21.15.6:0/1027114473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f564415b3c0 0x7f5644097d70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f563c009eb0 tx=0x7f563c009780 comp rx=0 tx=0).stop 2023-10-06T02:29:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.144+0000 7f5648c2f700 1 -- 172.21.15.6:0/1027114473 shutdown_connections 2023-10-06T02:29:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.144+0000 7f5648c2f700 1 --2- 172.21.15.6:0/1027114473 >> v2:172.21.15.175:3300/0 conn(0x7f564415a590 0x7f564415a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.144+0000 7f5648c2f700 1 --2- 172.21.15.6:0/1027114473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f564415b3c0 0x7f5644097d70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.144+0000 7f5648c2f700 1 -- 172.21.15.6:0/1027114473 >> 172.21.15.6:0/1027114473 conn(0x7f5644067910 msgr2=0x7f56440ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.144+0000 7f5648c2f700 1 -- 172.21.15.6:0/1027114473 shutdown_connections 2023-10-06T02:29:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.144+0000 7f5648c2f700 1 -- 172.21.15.6:0/1027114473 wait complete. 2023-10-06T02:29:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.145+0000 7f5648c2f700 1 Processor -- start 2023-10-06T02:29:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.145+0000 7f5648c2f700 1 -- start start 2023-10-06T02:29:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.146+0000 7f5648c2f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56440b3c50 0x7f564409b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.146+0000 7f5648c2f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f564415a590 0x7f56440a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.146+0000 7f5648c2f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f564415b3c0 0x7f56440997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.146+0000 7f5648c2f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56440aa3a0 con 0x7f56440b3c50 2023-10-06T02:29:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.146+0000 7f5648c2f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564409a170 con 0x7f564415b3c0 2023-10-06T02:29:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.146+0000 7f5648c2f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564409a450 con 0x7f564415a590 2023-10-06T02:29:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.146+0000 7f564259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56440b3c50 0x7f564409b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.146+0000 7f564259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56440b3c50 0x7f564409b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41486/0 (socket says 172.21.15.6:41486) 2023-10-06T02:29:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.146+0000 7f564259c700 1 -- 172.21.15.6:0/1602653164 learned_addr learned my addr 172.21.15.6:0/1602653164 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.146+0000 7f5641d9b700 1 --2- 172.21.15.6:0/1602653164 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f564415a590 0x7f56440a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.146+0000 7f5642d9d700 1 --2- 172.21.15.6:0/1602653164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f564415b3c0 0x7f56440997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.146+0000 7f564259c700 1 -- 172.21.15.6:0/1602653164 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f564415a590 msgr2=0x7f56440a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.147+0000 7f564259c700 1 --2- 172.21.15.6:0/1602653164 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f564415a590 0x7f56440a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.147+0000 7f564259c700 1 -- 172.21.15.6:0/1602653164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f564415b3c0 msgr2=0x7f56440997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.147+0000 7f564259c700 1 --2- 172.21.15.6:0/1602653164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f564415b3c0 0x7f56440997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.147+0000 7f564259c700 1 -- 172.21.15.6:0/1602653164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c009a20 con 0x7f56440b3c50 2023-10-06T02:29:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.147+0000 7f5642d9d700 1 --2- 172.21.15.6:0/1602653164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f564415b3c0 0x7f56440997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.147+0000 7f5641d9b700 1 --2- 172.21.15.6:0/1602653164 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f564415a590 0x7f56440a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.147+0000 7f564259c700 1 --2- 172.21.15.6:0/1602653164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56440b3c50 0x7f564409b210 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f56440647f0 tx=0x7f563c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.147+0000 7f563a7fc700 1 -- 172.21.15.6:0/1602653164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c012a20 con 0x7f56440b3c50 2023-10-06T02:29:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.147+0000 7f563a7fc700 1 -- 172.21.15.6:0/1602653164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563c012b80 con 0x7f56440b3c50 2023-10-06T02:29:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.147+0000 7f5648c2f700 1 -- 172.21.15.6:0/1602653164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564409a730 con 0x7f56440b3c50 2023-10-06T02:29:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.147+0000 7f563a7fc700 1 -- 172.21.15.6:0/1602653164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c012d30 con 0x7f56440b3c50 2023-10-06T02:29:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.147+0000 7f5648c2f700 1 -- 172.21.15.6:0/1602653164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564409acf0 con 0x7f56440b3c50 2023-10-06T02:29:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.148+0000 7f5648c2f700 1 -- 172.21.15.6:0/1602653164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564406e8d0 con 0x7f56440b3c50 2023-10-06T02:29:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.148+0000 7f563a7fc700 1 -- 172.21.15.6:0/1602653164 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f563c024020 con 0x7f56440b3c50 2023-10-06T02:29:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.149+0000 7f563a7fc700 1 --2- 172.21.15.6:0/1602653164 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5624066f30 0x7f56240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.149+0000 7f563a7fc700 1 -- 172.21.15.6:0/1602653164 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 9818+0+0 (secure 0 0 0) 0x7f563c087360 con 0x7f56440b3c50 2023-10-06T02:29:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.149+0000 7f5641d9b700 1 --2- 172.21.15.6:0/1602653164 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5624066f30 0x7f56240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.149+0000 7f5641d9b700 1 --2- 172.21.15.6:0/1602653164 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5624066f30 0x7f56240693e0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f562c0011e0 tx=0x7f562c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:52.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.153+0000 7f563a7fc700 1 -- 172.21.15.6:0/1602653164 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f563c053640 con 0x7f56440b3c50 2023-10-06T02:29:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.391+0000 7f5648c2f700 1 -- 172.21.15.6:0/1602653164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56440af820 con 0x7f56440b3c50 2023-10-06T02:29:52.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.391+0000 7f563a7fc700 1 -- 172.21.15.6:0/1602653164 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 351 v351) v1 ==== 95+0+4596 (secure 0 0 0) 0x7f563c056c60 con 0x7f56440b3c50 2023-10-06T02:29:52.393 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:52.393 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":351,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10713,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2434594072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2434594072},{"type":"v1","addr":"172.21.15.6:6835","nonce":2434594072}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":351}],"filesystems":[{"mdsmap":{"epoch":350,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:46.199267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.393+0000 7f5648c2f700 1 -- 172.21.15.6:0/1602653164 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5624066f30 msgr2=0x7f56240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.393+0000 7f5648c2f700 1 --2- 172.21.15.6:0/1602653164 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5624066f30 0x7f56240693e0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f562c0011e0 tx=0x7f562c009040 comp rx=0 tx=0).stop 2023-10-06T02:29:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.393+0000 7f5648c2f700 1 -- 172.21.15.6:0/1602653164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56440b3c50 msgr2=0x7f564409b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.393+0000 7f5648c2f700 1 --2- 172.21.15.6:0/1602653164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56440b3c50 0x7f564409b210 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f56440647f0 tx=0x7f563c018000 comp rx=0 tx=0).stop 2023-10-06T02:29:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.393+0000 7f5648c2f700 1 -- 172.21.15.6:0/1602653164 shutdown_connections 2023-10-06T02:29:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.393+0000 7f5648c2f700 1 --2- 172.21.15.6:0/1602653164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f564415b3c0 0x7f56440997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.393+0000 7f5648c2f700 1 --2- 172.21.15.6:0/1602653164 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5624066f30 0x7f56240693e0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.393+0000 7f5648c2f700 1 --2- 172.21.15.6:0/1602653164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56440b3c50 0x7f564409b210 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.393+0000 7f5648c2f700 1 --2- 172.21.15.6:0/1602653164 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f564415a590 0x7f56440a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.393+0000 7f5648c2f700 1 -- 172.21.15.6:0/1602653164 >> 172.21.15.6:0/1602653164 conn(0x7f5644067910 msgr2=0x7f5644159160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.393+0000 7f5648c2f700 1 -- 172.21.15.6:0/1602653164 shutdown_connections 2023-10-06T02:29:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.393+0000 7f5648c2f700 1 -- 172.21.15.6:0/1602653164 wait complete. 2023-10-06T02:29:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 351 2023-10-06T02:29:52.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:29:52.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.524+0000 7f9ecd7d9700 1 Processor -- start 2023-10-06T02:29:52.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.524+0000 7f9ecd7d9700 1 -- start start 2023-10-06T02:29:52.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.525+0000 7f9ecd7d9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ec8153b70 0x7f9ec815d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.525+0000 7f9ecd7d9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8153f40 0x7f9ec815a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.525+0000 7f9ecd7d9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ec80cb210 0x7f9ec80cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.525+0000 7f9ecd7d9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec815e350 con 0x7f9ec8153b70 2023-10-06T02:29:52.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.525+0000 7f9ecd7d9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec815adb0 con 0x7f9ec80cb210 2023-10-06T02:29:52.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.525+0000 7f9ecd7d9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80ce7b0 con 0x7f9ec8153f40 2023-10-06T02:29:52.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.525+0000 7f9ec6ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ec8153b70 0x7f9ec815d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.525+0000 7f9ec6ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ec8153b70 0x7f9ec815d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41488/0 (socket says 172.21.15.6:41488) 2023-10-06T02:29:52.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.525+0000 7f9ec6ffd700 1 -- 172.21.15.6:0/2296616781 learned_addr learned my addr 172.21.15.6:0/2296616781 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:52.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.525+0000 7f9ec67fc700 1 --2- 172.21.15.6:0/2296616781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8153f40 0x7f9ec815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.525+0000 7f9ec77fe700 1 --2- 172.21.15.6:0/2296616781 >> v2:172.21.15.175:3300/0 conn(0x7f9ec80cb210 0x7f9ec80cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.525+0000 7f9ec6ffd700 1 -- 172.21.15.6:0/2296616781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8153f40 msgr2=0x7f9ec815a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:52.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.525+0000 7f9ec6ffd700 1 --2- 172.21.15.6:0/2296616781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8153f40 0x7f9ec815a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.526+0000 7f9ec6ffd700 1 -- 172.21.15.6:0/2296616781 >> v2:172.21.15.175:3300/0 conn(0x7f9ec80cb210 msgr2=0x7f9ec80cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.526+0000 7f9ec6ffd700 1 --2- 172.21.15.6:0/2296616781 >> v2:172.21.15.175:3300/0 conn(0x7f9ec80cb210 0x7f9ec80cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.526+0000 7f9ec6ffd700 1 -- 172.21.15.6:0/2296616781 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec815dab0 con 0x7f9ec8153b70 2023-10-06T02:29:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.526+0000 7f9ec77fe700 1 --2- 172.21.15.6:0/2296616781 >> v2:172.21.15.175:3300/0 conn(0x7f9ec80cb210 0x7f9ec80cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.526+0000 7f9ec6ffd700 1 --2- 172.21.15.6:0/2296616781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec8153b70 0x7f9ec815d3b0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8089510 tx=0x7f9eb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca50886131146f0d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.526+0000 7f9ec5ffb700 1 -- 172.21.15.6:0/2296616781 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8009e70 con 0x7f9ec8153b70 2023-10-06T02:29:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.526+0000 7f9ec5ffb700 1 -- 172.21.15.6:0/2296616781 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb800b860 con 0x7f9ec8153b70 2023-10-06T02:29:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.526+0000 7f9ec5ffb700 1 -- 172.21.15.6:0/2296616781 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb800bc00 con 0x7f9ec8153b70 2023-10-06T02:29:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.526+0000 7f9ecd7d9700 1 -- 172.21.15.6:0/2296616781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec8153b70 msgr2=0x7f9ec815d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.526+0000 7f9ecd7d9700 1 --2- 172.21.15.6:0/2296616781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec8153b70 0x7f9ec815d3b0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8089510 tx=0x7f9eb8009250 comp rx=0 tx=0).stop 2023-10-06T02:29:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.526+0000 7f9ecd7d9700 1 -- 172.21.15.6:0/2296616781 shutdown_connections 2023-10-06T02:29:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.526+0000 7f9ecd7d9700 1 --2- 172.21.15.6:0/2296616781 >> v2:172.21.15.175:3300/0 conn(0x7f9ec80cb210 0x7f9ec80cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.526+0000 7f9ecd7d9700 1 --2- 172.21.15.6:0/2296616781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec8153b70 0x7f9ec815d3b0 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.526+0000 7f9ecd7d9700 1 --2- 172.21.15.6:0/2296616781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8153f40 0x7f9ec815a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.526+0000 7f9ecd7d9700 1 -- 172.21.15.6:0/2296616781 >> 172.21.15.6:0/2296616781 conn(0x7f9ec8068680 msgr2=0x7f9ec8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:52.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.526+0000 7f9ecd7d9700 1 -- 172.21.15.6:0/2296616781 shutdown_connections 2023-10-06T02:29:52.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.526+0000 7f9ecd7d9700 1 -- 172.21.15.6:0/2296616781 wait complete. 2023-10-06T02:29:52.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.528+0000 7f9ecd7d9700 1 Processor -- start 2023-10-06T02:29:52.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.528+0000 7f9ecd7d9700 1 -- start start 2023-10-06T02:29:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.528+0000 7f9ecd7d9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec80cb210 0x7f9ec80c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.528+0000 7f9ecd7d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec8153b70 0x7f9ec80c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.528+0000 7f9ecd7d9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8153f40 0x7f9ec815aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.528+0000 7f9ecd7d9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec8152450 con 0x7f9ec8153b70 2023-10-06T02:29:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.528+0000 7f9ecd7d9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80c8860 con 0x7f9ec80cb210 2023-10-06T02:29:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.528+0000 7f9ecd7d9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80c7c50 con 0x7f9ec8153f40 2023-10-06T02:29:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.528+0000 7f9ec67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec8153b70 0x7f9ec80c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.528+0000 7f9ec67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec8153b70 0x7f9ec80c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41502/0 (socket says 172.21.15.6:41502) 2023-10-06T02:29:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.528+0000 7f9ec67fc700 1 -- 172.21.15.6:0/2694693462 learned_addr learned my addr 172.21.15.6:0/2694693462 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.529+0000 7f9ec77fe700 1 --2- 172.21.15.6:0/2694693462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8153f40 0x7f9ec815aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.529+0000 7f9ec6ffd700 1 --2- 172.21.15.6:0/2694693462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec80cb210 0x7f9ec80c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.529+0000 7f9ec67fc700 1 -- 172.21.15.6:0/2694693462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8153f40 msgr2=0x7f9ec815aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:52.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.529+0000 7f9ec67fc700 1 --2- 172.21.15.6:0/2694693462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8153f40 0x7f9ec815aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.529+0000 7f9ec67fc700 1 -- 172.21.15.6:0/2694693462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec80cb210 msgr2=0x7f9ec80c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:52.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.529+0000 7f9ec67fc700 1 --2- 172.21.15.6:0/2694693462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec80cb210 0x7f9ec80c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.529+0000 7f9ec67fc700 1 -- 172.21.15.6:0/2694693462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb80094f0 con 0x7f9ec8153b70 2023-10-06T02:29:52.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.529+0000 7f9ec6ffd700 1 --2- 172.21.15.6:0/2694693462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec80cb210 0x7f9ec80c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:52.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.529+0000 7f9ec67fc700 1 --2- 172.21.15.6:0/2694693462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec8153b70 0x7f9ec80c7270 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000e950 tx=0x7f9eb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:52.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.529+0000 7f9ebeffd700 1 -- 172.21.15.6:0/2694693462 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb000c850 con 0x7f9ec8153b70 2023-10-06T02:29:52.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.529+0000 7f9ebeffd700 1 -- 172.21.15.6:0/2694693462 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb000c9b0 con 0x7f9ec8153b70 2023-10-06T02:29:52.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.529+0000 7f9ecd7d9700 1 -- 172.21.15.6:0/2694693462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec80c7f30 con 0x7f9ec8153b70 2023-10-06T02:29:52.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.529+0000 7f9ebeffd700 1 -- 172.21.15.6:0/2694693462 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb000cdb0 con 0x7f9ec8153b70 2023-10-06T02:29:52.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.529+0000 7f9ecd7d9700 1 -- 172.21.15.6:0/2694693462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec80c84f0 con 0x7f9ec8153b70 2023-10-06T02:29:52.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.530+0000 7f9ecd7d9700 1 -- 172.21.15.6:0/2694693462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec80c89f0 con 0x7f9ec8153b70 2023-10-06T02:29:52.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.530+0000 7f9ebeffd700 1 -- 172.21.15.6:0/2694693462 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9eb0013680 con 0x7f9ec8153b70 2023-10-06T02:29:52.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.531+0000 7f9ebeffd700 1 --2- 172.21.15.6:0/2694693462 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ea8066f30 0x7f9ea80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.531+0000 7f9ebeffd700 1 -- 172.21.15.6:0/2694693462 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 9818+0+0 (secure 0 0 0) 0x7f9eb00857b0 con 0x7f9ec8153b70 2023-10-06T02:29:52.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.531+0000 7f9ec6ffd700 1 --2- 172.21.15.6:0/2694693462 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ea8066f30 0x7f9ea80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.532+0000 7f9ec6ffd700 1 --2- 172.21.15.6:0/2694693462 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ea8066f30 0x7f9ea80693e0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8089510 tx=0x7f9eb8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:52.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.535+0000 7f9ebeffd700 1 -- 172.21.15.6:0/2694693462 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9eb00519d0 con 0x7f9ec8153b70 2023-10-06T02:29:52.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:29:52.561 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:29:52.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.732+0000 7f9ecd7d9700 1 -- 172.21.15.6:0/2694693462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ec8068420 con 0x7f9ec8153b70 2023-10-06T02:29:52.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.733+0000 7f9ebeffd700 1 -- 172.21.15.6:0/2694693462 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+22134 (secure 0 0 0) 0x7f9eb0054ff0 con 0x7f9ec8153b70 2023-10-06T02:29:52.735 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:52.735 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":135,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:29:46.199032+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:38.117438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:39.346545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/1827807239":"2023-10-07T02:29:46.199003+0000","172.21.15.6:6835/3743771475":"2023-10-07T02:26:52.896928+0000","172.21.15.6:6835/1318769254":"2023-10-07T02:26:41.158040+0000","172.21.15.6:6835/2869895689":"2023-10-07T02:25:23.853264+0000","172.21.15.6:6833/1045457090":"2023-10-07T02:25:56.200399+0000","172.21.15.6:6833/2361875445":"2023-10-07T02:27:17.854084+0000","172.21.15.6:6835/3364863394":"2023-10-07T02:26:17.923309+0000","172.21.15.6:6835/3306486265":"2023-10-07T02:26:03.842781+0000","172.21.15.6:6833/2951290545":"2023-10-07T02:25:45.052605+0000","172.21.15.6:6835/3458727123":"2023-10-07T02:28:33.945993+0000","172.21.15.6:6833/862419044":"2023-10-07T02:29:39.146227+0000","172.21.15.6:6833/216641974":"2023-10-07T02:26:47.857852+0000","172.21.15.6:6833/3743771475":"2023-10-07T02:26:52.896928+0000","172.21.15.6:6833/171345142":"2023-10-07T02:28:55.598562+0000","172.21.15.6:6833/1052086725":"2023-10-07T02:25:58.221425+0000","172.21.15.6:6833/2846199049":"2023-10-07T02:24:54.766539+0000","172.21.15.6:6833/1318769254":"2023-10-07T02:26:41.158040+0000","172.21.15.6:6835/3954180287":"2023-10-07T02:26:56.923442+0000","172.21.15.6:6833/1622379942":"2023-10-07T02:25:17.098229+0000","172.21.15.6:6833/1827807239":"2023-10-07T02:29:46.199003+0000","172.21.15.6:6833/4105967039":"2023-10-07T02:26:10.886741+0000","172.21.15.6:6835/2951290545":"2023-10-07T02:25:45.052605+0000","172.21.15.6:6835/2298587443":"2023-10-07T02:25:11.951806+0000","172.21.15.6:6833/2198441052":"2023-10-07T02:29:12.035908+0000","172.21.15.6:6833/2298587443":"2023-10-07T02:25:11.951806+0000","172.21.15.6:6835/3396709104":"2023-10-07T02:27:59.847878+0000","172.21.15.6:6835/1622379942":"2023-10-07T02:25:17.098229+0000","172.21.15.6:6835/216641974":"2023-10-07T02:26:47.857852+0000","172.21.15.6:6833/3428181968":"2023-10-07T02:26:33.108528+0000","172.21.15.6:6835/2846199049":"2023-10-07T02:24:54.766539+0000","172.21.15.6:6833/3306486265":"2023-10-07T02:26:03.842781+0000","172.21.15.6:6835/788286408":"2023-10-07T02:25:31.922453+0000","172.21.15.6:6835/1052086725":"2023-10-07T02:25:58.221425+0000","172.21.15.6:6835/3650321949":"2023-10-07T02:27:21.889165+0000","172.21.15.6:6833/172936756":"2023-10-07T02:27:29.845422+0000","172.21.15.6:6833/2220056807":"2023-10-07T02:25:27.888466+0000","172.21.15.6:6835/3081379602":"2023-10-07T02:26:31.089756+0000","172.21.15.6:6835/2220056807":"2023-10-07T02:25:27.888466+0000","172.21.15.6:6833/2869895689":"2023-10-07T02:25:23.853264+0000","172.21.15.6:6835/171345142":"2023-10-07T02:28:55.598562+0000","172.21.15.6:6835/4105967039":"2023-10-07T02:26:10.886741+0000","172.21.15.6:6835/2420647508":"2023-10-07T02:27:38.002295+0000","172.21.15.6:6833/3012609856":"2023-10-07T02:27:13.280610+0000","172.21.15.6:6835/1045457090":"2023-10-07T02:25:56.200399+0000","172.21.15.6:6835/2198441052":"2023-10-07T02:29:12.035908+0000","172.21.15.6:6833/3954180287":"2023-10-07T02:26:56.923442+0000","172.21.15.6:6833/2836519357":"2023-10-07T02:27:11.265755+0000","172.21.15.6:6833/2274292833":"2023-10-07T02:28:08.189815+0000","172.21.15.6:6833/1713670870":"2023-10-07T02:29:07.007752+0000","172.21.15.6:6835/2836519357":"2023-10-07T02:27:11.265755+0000","172.21.15.6:6835/3012609856":"2023-10-07T02:27:13.280610+0000","172.21.15.6:6833/4058600046":"2023-10-07T02:28:28.153959+0000","172.21.15.6:6833/3650321949":"2023-10-07T02:27:21.889165+0000","172.21.15.6:6833/829468452":"2023-10-07T02:27:25.919824+0000","172.21.15.6:6833/3081379602":"2023-10-07T02:26:31.089756+0000","172.21.15.6:6835/829468452":"2023-10-07T02:27:25.919824+0000","172.21.15.6:6835/172936756":"2023-10-07T02:27:29.845422+0000","172.21.15.6:6835/4058600046":"2023-10-07T02:28:28.153959+0000","172.21.15.6:6833/1123398769":"2023-10-07T02:27:33.969565+0000","172.21.15.6:6833/1461010014":"2023-10-07T02:28:04.154595+0000","172.21.15.6:6835/3428181968":"2023-10-07T02:26:33.108528+0000","172.21.15.6:6835/1123398769":"2023-10-07T02:27:33.969565+0000","172.21.15.6:6835/1713670870":"2023-10-07T02:29:07.007752+0000","172.21.15.6:6833/2420647508":"2023-10-07T02:27:38.002295+0000","172.21.15.6:6833/4129427704":"2023-10-07T02:27:53.927529+0000","172.21.15.6:6835/4129427704":"2023-10-07T02:27:53.927529+0000","172.21.15.6:6833/788286408":"2023-10-07T02:25:31.922453+0000","172.21.15.6:6833/3592673283":"2023-10-07T02:27:56.096324+0000","172.21.15.6:6835/3592673283":"2023-10-07T02:27:56.096324+0000","172.21.15.6:6833/3396709104":"2023-10-07T02:27:59.847878+0000","172.21.15.6:6835/1461010014":"2023-10-07T02:28:04.154595+0000","172.21.15.6:6835/2274292833":"2023-10-07T02:28:08.189815+0000","172.21.15.6:6833/3458727123":"2023-10-07T02:28:33.945993+0000","172.21.15.6:6833/3364863394":"2023-10-07T02:26:17.923309+0000","172.21.15.6:6833/1486243669":"2023-10-07T02:29:27.961813+0000","172.21.15.6:6835/2361875445":"2023-10-07T02:27:17.854084+0000","172.21.15.6:6835/1486243669":"2023-10-07T02:29:27.961813+0000","172.21.15.6:6833/3944398775":"2023-10-07T02:29:32.871108+0000","172.21.15.6:6835/3944398775":"2023-10-07T02:29:32.871108+0000","172.21.15.6:6835/862419044":"2023-10-07T02:29:39.146227+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:29:52.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.735+0000 7f9ecd7d9700 1 -- 172.21.15.6:0/2694693462 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ea8066f30 msgr2=0x7f9ea80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:52.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.735+0000 7f9ecd7d9700 1 --2- 172.21.15.6:0/2694693462 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ea8066f30 0x7f9ea80693e0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8089510 tx=0x7f9eb8017000 comp rx=0 tx=0).stop 2023-10-06T02:29:52.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.735+0000 7f9ecd7d9700 1 -- 172.21.15.6:0/2694693462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec8153b70 msgr2=0x7f9ec80c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:52.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.735+0000 7f9ecd7d9700 1 --2- 172.21.15.6:0/2694693462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec8153b70 0x7f9ec80c7270 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000e950 tx=0x7f9eb00091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.735+0000 7f9ecd7d9700 1 -- 172.21.15.6:0/2694693462 shutdown_connections 2023-10-06T02:29:52.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.735+0000 7f9ecd7d9700 1 --2- 172.21.15.6:0/2694693462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8153f40 0x7f9ec815aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.735+0000 7f9ecd7d9700 1 --2- 172.21.15.6:0/2694693462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec80cb210 0x7f9ec80c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.735+0000 7f9ecd7d9700 1 --2- 172.21.15.6:0/2694693462 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9ea8066f30 0x7f9ea80693e0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.735+0000 7f9ecd7d9700 1 --2- 172.21.15.6:0/2694693462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec8153b70 0x7f9ec80c7270 unknown :-1 s=CLOSED pgs=2335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.735+0000 7f9ecd7d9700 1 -- 172.21.15.6:0/2694693462 >> 172.21.15.6:0/2694693462 conn(0x7f9ec8068680 msgr2=0x7f9ec8152aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:52.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.735+0000 7f9ecd7d9700 1 -- 172.21.15.6:0/2694693462 shutdown_connections 2023-10-06T02:29:52.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.735+0000 7f9ecd7d9700 1 -- 172.21.15.6:0/2694693462 wait complete. 2023-10-06T02:29:52.749 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:29:52.750 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:52.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.868+0000 7fc20f59e700 1 Processor -- start 2023-10-06T02:29:52.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.868+0000 7fc20f59e700 1 -- start start 2023-10-06T02:29:52.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.869+0000 7fc20f59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc2100688d0 0x7fc2100afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.869+0000 7fc20f59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc210068ca0 0x7fc2101409a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.869+0000 7fc20f59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2100b0590 con 0x7fc2100b0ed0 2023-10-06T02:29:52.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.869+0000 7fc20f59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2100b0870 con 0x7fc2100688d0 2023-10-06T02:29:52.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.869+0000 7fc20f59e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2100b0b50 con 0x7fc210068ca0 2023-10-06T02:29:52.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.869+0000 7fc20e59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc2100688d0 0x7fc2100afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.869+0000 7fc20dd9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc2100b0ed0 0x7fc21013f3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42540/0 (socket says 172.21.15.6:42540) 2023-10-06T02:29:52.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.869+0000 7fc20dd9b700 1 -- 172.21.15.6:0/641170586 learned_addr learned my addr 172.21.15.6:0/641170586 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:52.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.869+0000 7fc20ed9d700 1 --2- 172.21.15.6:0/641170586 >> v2:172.21.15.175:3300/0 conn(0x7fc210068ca0 0x7fc2101409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.869+0000 7fc20e59c700 1 -- 172.21.15.6:0/641170586 >> v2:172.21.15.175:3300/0 conn(0x7fc210068ca0 msgr2=0x7fc2101409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:52.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.869+0000 7fc20e59c700 1 --2- 172.21.15.6:0/641170586 >> v2:172.21.15.175:3300/0 conn(0x7fc210068ca0 0x7fc2101409a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.869+0000 7fc20e59c700 1 -- 172.21.15.6:0/641170586 >> v1:172.21.15.6:6789/0 conn(0x7fc2100b0ed0 legacy=0x7fc21013f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:52.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.869+0000 7fc20e59c700 1 -- 172.21.15.6:0/641170586 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2101401a0 con 0x7fc2100688d0 2023-10-06T02:29:52.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.869+0000 7fc20d59a700 1 -- 172.21.15.6:0/641170586 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269879690 0 0) 0x7fc2100b0590 con 0x7fc2100b0ed0 2023-10-06T02:29:52.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.869+0000 7fc20e59c700 1 --2- 172.21.15.6:0/641170586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2100688d0 0x7fc2100afc40 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7fc21015ce50 tx=0x7fc208009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fdf55ceff82e27 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:52.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.870+0000 7fc20d59a700 1 -- 172.21.15.6:0/641170586 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20800e070 con 0x7fc2100688d0 2023-10-06T02:29:52.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.870+0000 7fc20d59a700 1 -- 172.21.15.6:0/641170586 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20800bc30 con 0x7fc2100688d0 2023-10-06T02:29:52.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.870+0000 7fc20d59a700 1 -- 172.21.15.6:0/641170586 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208012430 con 0x7fc2100688d0 2023-10-06T02:29:52.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.870+0000 7fc20f59e700 1 -- 172.21.15.6:0/641170586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2100688d0 msgr2=0x7fc2100afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:52.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.870+0000 7fc20f59e700 1 --2- 172.21.15.6:0/641170586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2100688d0 0x7fc2100afc40 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7fc21015ce50 tx=0x7fc208009780 comp rx=0 tx=0).stop 2023-10-06T02:29:52.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.870+0000 7fc20f59e700 1 -- 172.21.15.6:0/641170586 shutdown_connections 2023-10-06T02:29:52.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.870+0000 7fc20f59e700 1 --2- 172.21.15.6:0/641170586 >> v2:172.21.15.175:3300/0 conn(0x7fc210068ca0 0x7fc2101409a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.870+0000 7fc20f59e700 1 --2- 172.21.15.6:0/641170586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2100688d0 0x7fc2100afc40 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.870+0000 7fc20f59e700 1 -- 172.21.15.6:0/641170586 >> 172.21.15.6:0/641170586 conn(0x7fc21006b320 msgr2=0x7fc21006b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:52.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.870+0000 7fc20f59e700 1 -- 172.21.15.6:0/641170586 shutdown_connections 2023-10-06T02:29:52.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.870+0000 7fc20f59e700 1 -- 172.21.15.6:0/641170586 wait complete. 2023-10-06T02:29:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.871+0000 7fc20f59e700 1 Processor -- start 2023-10-06T02:29:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.871+0000 7fc20f59e700 1 -- start start 2023-10-06T02:29:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.872+0000 7fc20f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2100688d0 0x7fc2100ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.872+0000 7fc20f59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc210068ca0 0x7fc21016a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.872+0000 7fc20f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2100b0ed0 0x7fc2100cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.872+0000 7fc20f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2100cd020 con 0x7fc2100b0ed0 2023-10-06T02:29:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.872+0000 7fc20f59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2100cade0 con 0x7fc210068ca0 2023-10-06T02:29:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.872+0000 7fc20f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21016a9e0 con 0x7fc2100688d0 2023-10-06T02:29:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.872+0000 7fc20ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2100b0ed0 0x7fc2100cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.872+0000 7fc20ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2100b0ed0 0x7fc2100cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41524/0 (socket says 172.21.15.6:41524) 2023-10-06T02:29:52.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.872+0000 7fc20ed9d700 1 -- 172.21.15.6:0/3613949405 learned_addr learned my addr 172.21.15.6:0/3613949405 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:52.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.872+0000 7fc20dd9b700 1 --2- 172.21.15.6:0/3613949405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc210068ca0 0x7fc21016a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.872+0000 7fc20e59c700 1 --2- 172.21.15.6:0/3613949405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2100688d0 0x7fc2100ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.872+0000 7fc20ed9d700 1 -- 172.21.15.6:0/3613949405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2100688d0 msgr2=0x7fc2100ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:52.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.872+0000 7fc20ed9d700 1 --2- 172.21.15.6:0/3613949405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2100688d0 0x7fc2100ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.872+0000 7fc20ed9d700 1 -- 172.21.15.6:0/3613949405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc210068ca0 msgr2=0x7fc21016a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:52.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.872+0000 7fc20ed9d700 1 --2- 172.21.15.6:0/3613949405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc210068ca0 0x7fc21016a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:52.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.872+0000 7fc20ed9d700 1 -- 172.21.15.6:0/3613949405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc208009a20 con 0x7fc2100b0ed0 2023-10-06T02:29:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.872+0000 7fc20dd9b700 1 --2- 172.21.15.6:0/3613949405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc210068ca0 0x7fc21016a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.873+0000 7fc20ed9d700 1 --2- 172.21.15.6:0/3613949405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2100b0ed0 0x7fc2100cb270 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7fc20000d890 tx=0x7fc200008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.873+0000 7fc2067fc700 1 -- 172.21.15.6:0/3613949405 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2000125f0 con 0x7fc2100b0ed0 2023-10-06T02:29:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.873+0000 7fc2067fc700 1 -- 172.21.15.6:0/3613949405 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc200012770 con 0x7fc2100b0ed0 2023-10-06T02:29:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.873+0000 7fc20f59e700 1 -- 172.21.15.6:0/3613949405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21016acc0 con 0x7fc2100b0ed0 2023-10-06T02:29:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.873+0000 7fc2067fc700 1 -- 172.21.15.6:0/3613949405 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc200012b30 con 0x7fc2100b0ed0 2023-10-06T02:29:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.873+0000 7fc20f59e700 1 -- 172.21.15.6:0/3613949405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2100caa70 con 0x7fc2100b0ed0 2023-10-06T02:29:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.874+0000 7fc20f59e700 1 -- 172.21.15.6:0/3613949405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2100caf50 con 0x7fc2100b0ed0 2023-10-06T02:29:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.874+0000 7fc2067fc700 1 -- 172.21.15.6:0/3613949405 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc20001e460 con 0x7fc2100b0ed0 2023-10-06T02:29:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.874+0000 7fc2067fc700 1 --2- 172.21.15.6:0/3613949405 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc1f0066f30 0x7fc1f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.875+0000 7fc2067fc700 1 -- 172.21.15.6:0/3613949405 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 9818+0+0 (secure 0 0 0) 0x7fc200085ce0 con 0x7fc2100b0ed0 2023-10-06T02:29:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.875+0000 7fc20e59c700 1 --2- 172.21.15.6:0/3613949405 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc1f0066f30 0x7fc1f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.875+0000 7fc20e59c700 1 --2- 172.21.15.6:0/3613949405 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc1f0066f30 0x7fc1f00693e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc21015ce50 tx=0x7fc208019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:52.879+0000 7fc2067fc700 1 -- 172.21.15.6:0/3613949405 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc200051f00 con 0x7fc2100b0ed0 2023-10-06T02:29:53.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.117+0000 7fc20f59e700 1 -- 172.21.15.6:0/3613949405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc210140480 con 0x7fc2100b0ed0 2023-10-06T02:29:53.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.118+0000 7fc2067fc700 1 -- 172.21.15.6:0/3613949405 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 351 v351) v1 ==== 95+0+4596 (secure 0 0 0) 0x7fc200055520 con 0x7fc2100b0ed0 2023-10-06T02:29:53.120 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:53.120 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":351,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10713,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2434594072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2434594072},{"type":"v1","addr":"172.21.15.6:6835","nonce":2434594072}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":351}],"filesystems":[{"mdsmap":{"epoch":350,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:46.199267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:53.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.120+0000 7fc20f59e700 1 -- 172.21.15.6:0/3613949405 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc1f0066f30 msgr2=0x7fc1f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:53.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.120+0000 7fc20f59e700 1 --2- 172.21.15.6:0/3613949405 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc1f0066f30 0x7fc1f00693e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc21015ce50 tx=0x7fc208019000 comp rx=0 tx=0).stop 2023-10-06T02:29:53.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.120+0000 7fc20f59e700 1 -- 172.21.15.6:0/3613949405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2100b0ed0 msgr2=0x7fc2100cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:53.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.120+0000 7fc20f59e700 1 --2- 172.21.15.6:0/3613949405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2100b0ed0 0x7fc2100cb270 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7fc20000d890 tx=0x7fc200008040 comp rx=0 tx=0).stop 2023-10-06T02:29:53.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.120+0000 7fc20f59e700 1 -- 172.21.15.6:0/3613949405 shutdown_connections 2023-10-06T02:29:53.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.120+0000 7fc20f59e700 1 --2- 172.21.15.6:0/3613949405 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc1f0066f30 0x7fc1f00693e0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.120+0000 7fc20f59e700 1 --2- 172.21.15.6:0/3613949405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2100b0ed0 0x7fc2100cb270 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.120+0000 7fc20f59e700 1 --2- 172.21.15.6:0/3613949405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2100688d0 0x7fc2100ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.120+0000 7fc20f59e700 1 --2- 172.21.15.6:0/3613949405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc210068ca0 0x7fc21016a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.120+0000 7fc20f59e700 1 -- 172.21.15.6:0/3613949405 >> 172.21.15.6:0/3613949405 conn(0x7fc21006b320 msgr2=0x7fc21013e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:53.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.120+0000 7fc20f59e700 1 -- 172.21.15.6:0/3613949405 shutdown_connections 2023-10-06T02:29:53.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.120+0000 7fc20f59e700 1 -- 172.21.15.6:0/3613949405 wait complete. 2023-10-06T02:29:53.125 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 351 2023-10-06T02:29:53.134 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:53.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.251+0000 7f2fc3ab3700 1 Processor -- start 2023-10-06T02:29:53.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.252+0000 7f2fc3ab3700 1 -- start start 2023-10-06T02:29:53.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.252+0000 7f2fc3ab3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fbc15b3c0 0x7f2fbc097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.252+0000 7f2fc3ab3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2fbc15a590 0x7f2fbc15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.252+0000 7f2fc3ab3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc0afb90 con 0x7f2fbc0b3c50 2023-10-06T02:29:53.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.252+0000 7f2fc3ab3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc15aef0 con 0x7f2fbc15a590 2023-10-06T02:29:53.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.252+0000 7f2fc3ab3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0b2310 con 0x7f2fbc15b3c0 2023-10-06T02:29:53.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.253+0000 7f2fc2050700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2fbc15a590 0x7f2fbc15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.253+0000 7f2fc2050700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2fbc15a590 0x7f2fbc15a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41530/0 (socket says 172.21.15.6:41530) 2023-10-06T02:29:53.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.253+0000 7f2fc2050700 1 -- 172.21.15.6:0/1706985846 learned_addr learned my addr 172.21.15.6:0/1706985846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:53.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.253+0000 7f2fc184f700 1 --2- 172.21.15.6:0/1706985846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fbc15b3c0 0x7f2fbc097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.253+0000 7f2fc2050700 1 -- 172.21.15.6:0/1706985846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fbc15b3c0 msgr2=0x7f2fbc097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:53.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.253+0000 7f2fc2050700 1 --2- 172.21.15.6:0/1706985846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fbc15b3c0 0x7f2fbc097d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.253+0000 7f2fc2050700 1 -- 172.21.15.6:0/1706985846 >> v1:172.21.15.175:6789/0 conn(0x7f2fbc0b3c50 legacy=0x7f2fbc15b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.253+0000 7f2fc2050700 1 -- 172.21.15.6:0/1706985846 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc0b25f0 con 0x7f2fbc15a590 2023-10-06T02:29:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.253+0000 7f2fc2050700 1 --2- 172.21.15.6:0/1706985846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc15a590 0x7f2fbc15a9b0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009f20 tx=0x7f2fac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315939f66c749aac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.253+0000 7f2fc084d700 1 -- 172.21.15.6:0/1706985846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac00e070 con 0x7f2fbc15a590 2023-10-06T02:29:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.253+0000 7f2fc084d700 1 -- 172.21.15.6:0/1706985846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac00ba40 con 0x7f2fbc15a590 2023-10-06T02:29:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.253+0000 7f2fc084d700 1 -- 172.21.15.6:0/1706985846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0092e0 con 0x7f2fbc15a590 2023-10-06T02:29:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.254+0000 7f2fc3ab3700 1 -- 172.21.15.6:0/1706985846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc15a590 msgr2=0x7f2fbc15a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.254+0000 7f2fc3ab3700 1 --2- 172.21.15.6:0/1706985846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc15a590 0x7f2fbc15a9b0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009f20 tx=0x7f2fac009840 comp rx=0 tx=0).stop 2023-10-06T02:29:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.254+0000 7f2fc3ab3700 1 -- 172.21.15.6:0/1706985846 shutdown_connections 2023-10-06T02:29:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.254+0000 7f2fc3ab3700 1 --2- 172.21.15.6:0/1706985846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc15a590 0x7f2fbc15a9b0 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.254+0000 7f2fc3ab3700 1 --2- 172.21.15.6:0/1706985846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fbc15b3c0 0x7f2fbc097d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.254+0000 7f2fc3ab3700 1 -- 172.21.15.6:0/1706985846 >> 172.21.15.6:0/1706985846 conn(0x7f2fbc067910 msgr2=0x7f2fbc0ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:53.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.254+0000 7f2fc3ab3700 1 -- 172.21.15.6:0/1706985846 shutdown_connections 2023-10-06T02:29:53.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.254+0000 7f2fc3ab3700 1 -- 172.21.15.6:0/1706985846 wait complete. 2023-10-06T02:29:53.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.255+0000 7f2fc3ab3700 1 Processor -- start 2023-10-06T02:29:53.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.255+0000 7f2fc3ab3700 1 -- start start 2023-10-06T02:29:53.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc3ab3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fbc0b3c50 0x7f2fbc155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc3ab3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fbc15a590 0x7f2fbc06ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc3ab3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc15b3c0 0x7f2fbc06b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc3ab3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc155c40 con 0x7f2fbc15b3c0 2023-10-06T02:29:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc3ab3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc1695e0 con 0x7f2fbc15a590 2023-10-06T02:29:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc3ab3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc1698a0 con 0x7f2fbc0b3c50 2023-10-06T02:29:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc2050700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc15b3c0 0x7f2fbc06b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc2050700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc15b3c0 0x7f2fbc06b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41546/0 (socket says 172.21.15.6:41546) 2023-10-06T02:29:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc2050700 1 -- 172.21.15.6:0/2896404555 learned_addr learned my addr 172.21.15.6:0/2896404555 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc184f700 1 --2- 172.21.15.6:0/2896404555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fbc0b3c50 0x7f2fbc155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc104e700 1 --2- 172.21.15.6:0/2896404555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fbc15a590 0x7f2fbc06ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc2050700 1 -- 172.21.15.6:0/2896404555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fbc0b3c50 msgr2=0x7f2fbc155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc2050700 1 --2- 172.21.15.6:0/2896404555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fbc0b3c50 0x7f2fbc155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc2050700 1 -- 172.21.15.6:0/2896404555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fbc15a590 msgr2=0x7f2fbc06ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc2050700 1 --2- 172.21.15.6:0/2896404555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fbc15a590 0x7f2fbc06ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc2050700 1 -- 172.21.15.6:0/2896404555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac009ae0 con 0x7f2fbc15b3c0 2023-10-06T02:29:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc2050700 1 --2- 172.21.15.6:0/2896404555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc15b3c0 0x7f2fbc06b1d0 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc06f4d0 tx=0x7f2fac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fb9ffb700 1 -- 172.21.15.6:0/2896404555 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0094e0 con 0x7f2fbc15b3c0 2023-10-06T02:29:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fb9ffb700 1 -- 172.21.15.6:0/2896404555 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac0032f0 con 0x7f2fbc15b3c0 2023-10-06T02:29:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fb9ffb700 1 -- 172.21.15.6:0/2896404555 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac01d420 con 0x7f2fbc15b3c0 2023-10-06T02:29:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.256+0000 7f2fc3ab3700 1 -- 172.21.15.6:0/2896404555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc169b80 con 0x7f2fbc15b3c0 2023-10-06T02:29:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.257+0000 7f2fc3ab3700 1 -- 172.21.15.6:0/2896404555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc16a140 con 0x7f2fbc15b3c0 2023-10-06T02:29:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.258+0000 7f2fc3ab3700 1 -- 172.21.15.6:0/2896404555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc06e8d0 con 0x7f2fbc15b3c0 2023-10-06T02:29:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.258+0000 7f2fb9ffb700 1 -- 172.21.15.6:0/2896404555 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fac01d850 con 0x7f2fbc15b3c0 2023-10-06T02:29:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.258+0000 7f2fb9ffb700 1 --2- 172.21.15.6:0/2896404555 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2fa8066f30 0x7f2fa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.258+0000 7f2fb9ffb700 1 -- 172.21.15.6:0/2896404555 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 9818+0+0 (secure 0 0 0) 0x7f2fac086c10 con 0x7f2fbc15b3c0 2023-10-06T02:29:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.259+0000 7f2fc184f700 1 --2- 172.21.15.6:0/2896404555 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2fa8066f30 0x7f2fa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.259+0000 7f2fc184f700 1 --2- 172.21.15.6:0/2896404555 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2fa8066f30 0x7f2fa80693e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4006aa0 tx=0x7f2fb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:53.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.263+0000 7f2fb9ffb700 1 -- 172.21.15.6:0/2896404555 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fac052dd0 con 0x7f2fbc15b3c0 2023-10-06T02:29:53.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.503+0000 7f2fc3ab3700 1 -- 172.21.15.6:0/2896404555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fbc0af820 con 0x7f2fbc15b3c0 2023-10-06T02:29:53.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.504+0000 7f2fb9ffb700 1 -- 172.21.15.6:0/2896404555 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 351 v351) v1 ==== 95+0+4596 (secure 0 0 0) 0x7f2fac02a090 con 0x7f2fbc15b3c0 2023-10-06T02:29:53.506 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:53.506 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":351,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10713,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2434594072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2434594072},{"type":"v1","addr":"172.21.15.6:6835","nonce":2434594072}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":351}],"filesystems":[{"mdsmap":{"epoch":350,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:40.366191+0000","modified":"2023-10-06T02:29:46.199267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":135,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T02:29:53.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.506+0000 7f2fc3ab3700 1 -- 172.21.15.6:0/2896404555 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2fa8066f30 msgr2=0x7f2fa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:53.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.506+0000 7f2fc3ab3700 1 --2- 172.21.15.6:0/2896404555 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2fa8066f30 0x7f2fa80693e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4006aa0 tx=0x7f2fb4008040 comp rx=0 tx=0).stop 2023-10-06T02:29:53.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.506+0000 7f2fc3ab3700 1 -- 172.21.15.6:0/2896404555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc15b3c0 msgr2=0x7f2fbc06b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:53.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.506+0000 7f2fc3ab3700 1 --2- 172.21.15.6:0/2896404555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc15b3c0 0x7f2fbc06b1d0 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc06f4d0 tx=0x7f2fac017000 comp rx=0 tx=0).stop 2023-10-06T02:29:53.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.506+0000 7f2fc3ab3700 1 -- 172.21.15.6:0/2896404555 shutdown_connections 2023-10-06T02:29:53.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.506+0000 7f2fc3ab3700 1 --2- 172.21.15.6:0/2896404555 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2fa8066f30 0x7f2fa80693e0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.506+0000 7f2fc3ab3700 1 --2- 172.21.15.6:0/2896404555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc15b3c0 0x7f2fbc06b1d0 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.506+0000 7f2fc3ab3700 1 --2- 172.21.15.6:0/2896404555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fbc0b3c50 0x7f2fbc155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.506+0000 7f2fc3ab3700 1 --2- 172.21.15.6:0/2896404555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fbc15a590 0x7f2fbc06ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.506+0000 7f2fc3ab3700 1 -- 172.21.15.6:0/2896404555 >> 172.21.15.6:0/2896404555 conn(0x7f2fbc067910 msgr2=0x7f2fbc158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:53.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.506+0000 7f2fc3ab3700 1 -- 172.21.15.6:0/2896404555 shutdown_connections 2023-10-06T02:29:53.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.506+0000 7f2fc3ab3700 1 -- 172.21.15.6:0/2896404555 wait complete. 2023-10-06T02:29:53.509 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 351 2023-10-06T02:29:53.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:29:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.637+0000 7f9b24c2b700 1 Processor -- start 2023-10-06T02:29:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.637+0000 7f9b24c2b700 1 -- start start 2023-10-06T02:29:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.638+0000 7f9b24c2b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9b2006e520 0x7f9b20069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.638+0000 7f9b24c2b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b201597c0 0x7f9b2006a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.638+0000 7f9b24c2b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b20069950 con 0x7f9b201593f0 2023-10-06T02:29:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.638+0000 7f9b24c2b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b200b2850 con 0x7f9b2006e520 2023-10-06T02:29:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.638+0000 7f9b24c2b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b200b1fb0 con 0x7f9b201597c0 2023-10-06T02:29:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.639+0000 7f9b1dd9b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9b2006e520 0x7f9b20069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.639+0000 7f9b1ed9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b201597c0 0x7f9b2006a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.639+0000 7f9b1dd9b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9b2006e520 0x7f9b20069de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:34116/0 (socket says 172.21.15.6:34116) 2023-10-06T02:29:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.639+0000 7f9b1dd9b700 1 -- 172.21.15.6:0/3349269571 learned_addr learned my addr 172.21.15.6:0/3349269571 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.639+0000 7f9b1e59c700 1 --1- 172.21.15.6:0/3349269571 >> v1:172.21.15.175:6789/0 conn(0x7f9b201593f0 0x7f9b2006de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:46858/0 (socket says 172.21.15.6:46858) 2023-10-06T02:29:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.639+0000 7f9b1ed9d700 1 -- 172.21.15.6:0/3349269571 >> v2:172.21.15.175:3300/0 conn(0x7f9b2006e520 msgr2=0x7f9b20069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.639+0000 7f9b1ed9d700 1 --2- 172.21.15.6:0/3349269571 >> v2:172.21.15.175:3300/0 conn(0x7f9b2006e520 0x7f9b20069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.639+0000 7f9b1ed9d700 1 -- 172.21.15.6:0/3349269571 >> v1:172.21.15.175:6789/0 conn(0x7f9b201593f0 legacy=0x7f9b2006de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.639+0000 7f9b1d59a700 1 -- 172.21.15.6:0/3349269571 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608541612 0 0) 0x7f9b20069950 con 0x7f9b201593f0 2023-10-06T02:29:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.639+0000 7f9b1ed9d700 1 -- 172.21.15.6:0/3349269571 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b200b2290 con 0x7f9b201597c0 2023-10-06T02:29:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.639+0000 7f9b1dd9b700 1 --2- 172.21.15.6:0/3349269571 >> v2:172.21.15.175:3300/0 conn(0x7f9b2006e520 0x7f9b20069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.639+0000 7f9b1ed9d700 1 --2- 172.21.15.6:0/3349269571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b201597c0 0x7f9b2006a320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9b100098e0 tx=0x7f9b100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e279928bad257944 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.640+0000 7f9b1d59a700 1 -- 172.21.15.6:0/3349269571 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1000b640 con 0x7f9b201597c0 2023-10-06T02:29:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.640+0000 7f9b1d59a700 1 -- 172.21.15.6:0/3349269571 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1000b7a0 con 0x7f9b201597c0 2023-10-06T02:29:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.640+0000 7f9b1d59a700 1 -- 172.21.15.6:0/3349269571 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1000bb40 con 0x7f9b201597c0 2023-10-06T02:29:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.640+0000 7f9b24c2b700 1 -- 172.21.15.6:0/3349269571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b201597c0 msgr2=0x7f9b2006a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.640+0000 7f9b24c2b700 1 --2- 172.21.15.6:0/3349269571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b201597c0 0x7f9b2006a320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9b100098e0 tx=0x7f9b100091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.640+0000 7f9b24c2b700 1 -- 172.21.15.6:0/3349269571 shutdown_connections 2023-10-06T02:29:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.640+0000 7f9b24c2b700 1 --2- 172.21.15.6:0/3349269571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b201597c0 0x7f9b2006a320 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.640+0000 7f9b24c2b700 1 --2- 172.21.15.6:0/3349269571 >> v2:172.21.15.175:3300/0 conn(0x7f9b2006e520 0x7f9b20069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.640+0000 7f9b24c2b700 1 -- 172.21.15.6:0/3349269571 >> 172.21.15.6:0/3349269571 conn(0x7f9b2006cff0 msgr2=0x7f9b200afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.640+0000 7f9b24c2b700 1 -- 172.21.15.6:0/3349269571 shutdown_connections 2023-10-06T02:29:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.640+0000 7f9b24c2b700 1 -- 172.21.15.6:0/3349269571 wait complete. 2023-10-06T02:29:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.641+0000 7f9b24c2b700 1 Processor -- start 2023-10-06T02:29:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.641+0000 7f9b24c2b700 1 -- start start 2023-10-06T02:29:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.642+0000 7f9b24c2b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b2006e520 0x7f9b20157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.642+0000 7f9b24c2b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b201593f0 0x7f9b200c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.642+0000 7f9b24c2b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b201597c0 0x7f9b200a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.642+0000 7f9b24c2b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b20157aa0 con 0x7f9b2006e520 2023-10-06T02:29:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.642+0000 7f9b24c2b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b20169ea0 con 0x7f9b201597c0 2023-10-06T02:29:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.642+0000 7f9b24c2b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b200ca6f0 con 0x7f9b201593f0 2023-10-06T02:29:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.642+0000 7f9b1e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b2006e520 0x7f9b20157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.642+0000 7f9b1e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b2006e520 0x7f9b20157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41548/0 (socket says 172.21.15.6:41548) 2023-10-06T02:29:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.642+0000 7f9b1e59c700 1 -- 172.21.15.6:0/3902358 learned_addr learned my addr 172.21.15.6:0/3902358 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.642+0000 7f9b1ed9d700 1 --2- 172.21.15.6:0/3902358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b201597c0 0x7f9b200a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.642+0000 7f9b1dd9b700 1 --2- 172.21.15.6:0/3902358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b201593f0 0x7f9b200c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.642+0000 7f9b1e59c700 1 -- 172.21.15.6:0/3902358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b201593f0 msgr2=0x7f9b200c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.642+0000 7f9b1e59c700 1 --2- 172.21.15.6:0/3902358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b201593f0 0x7f9b200c9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.643+0000 7f9b1e59c700 1 -- 172.21.15.6:0/3902358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b201597c0 msgr2=0x7f9b200a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.643+0000 7f9b1e59c700 1 --2- 172.21.15.6:0/3902358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b201597c0 0x7f9b200a56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.643+0000 7f9b1e59c700 1 -- 172.21.15.6:0/3902358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b08009480 con 0x7f9b2006e520 2023-10-06T02:29:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.643+0000 7f9b1e59c700 1 --2- 172.21.15.6:0/3902358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b2006e520 0x7f9b20157560 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800cdd0 tx=0x7f9b18001bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.643+0000 7f9b167fc700 1 -- 172.21.15.6:0/3902358 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18005df0 con 0x7f9b2006e520 2023-10-06T02:29:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.643+0000 7f9b167fc700 1 -- 172.21.15.6:0/3902358 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1800a960 con 0x7f9b2006e520 2023-10-06T02:29:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.643+0000 7f9b24c2b700 1 -- 172.21.15.6:0/3902358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b10009420 con 0x7f9b2006e520 2023-10-06T02:29:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.643+0000 7f9b167fc700 1 -- 172.21.15.6:0/3902358 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1800ad20 con 0x7f9b2006e520 2023-10-06T02:29:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.643+0000 7f9b24c2b700 1 -- 172.21.15.6:0/3902358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b200cacb0 con 0x7f9b2006e520 2023-10-06T02:29:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.644+0000 7f9b24c2b700 1 -- 172.21.15.6:0/3902358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b200afad0 con 0x7f9b2006e520 2023-10-06T02:29:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.644+0000 7f9b167fc700 1 -- 172.21.15.6:0/3902358 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b18007300 con 0x7f9b2006e520 2023-10-06T02:29:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.645+0000 7f9b167fc700 1 --2- 172.21.15.6:0/3902358 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9b00066f30 0x7f9b000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.645+0000 7f9b167fc700 1 -- 172.21.15.6:0/3902358 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 9818+0+0 (secure 0 0 0) 0x7f9b18085860 con 0x7f9b2006e520 2023-10-06T02:29:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.645+0000 7f9b1dd9b700 1 --2- 172.21.15.6:0/3902358 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9b00066f30 0x7f9b000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.645+0000 7f9b1dd9b700 1 --2- 172.21.15.6:0/3902358 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9b00066f30 0x7f9b000693e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f9b200a5360 tx=0x7f9b08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.649+0000 7f9b167fc700 1 -- 172.21.15.6:0/3902358 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b18051b00 con 0x7f9b2006e520 2023-10-06T02:29:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.844+0000 7f9b24c2b700 1 -- 172.21.15.6:0/3902358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b2006d3f0 con 0x7f9b2006e520 2023-10-06T02:29:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.845+0000 7f9b167fc700 1 -- 172.21.15.6:0/3902358 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+22134 (secure 0 0 0) 0x7f9b18055120 con 0x7f9b2006e520 2023-10-06T02:29:53.847 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:29:53.847 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":135,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:29:46.199032+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:38.117438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:39.346545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/1827807239":"2023-10-07T02:29:46.199003+0000","172.21.15.6:6835/3743771475":"2023-10-07T02:26:52.896928+0000","172.21.15.6:6835/1318769254":"2023-10-07T02:26:41.158040+0000","172.21.15.6:6835/2869895689":"2023-10-07T02:25:23.853264+0000","172.21.15.6:6833/1045457090":"2023-10-07T02:25:56.200399+0000","172.21.15.6:6833/2361875445":"2023-10-07T02:27:17.854084+0000","172.21.15.6:6835/3364863394":"2023-10-07T02:26:17.923309+0000","172.21.15.6:6835/3306486265":"2023-10-07T02:26:03.842781+0000","172.21.15.6:6833/2951290545":"2023-10-07T02:25:45.052605+0000","172.21.15.6:6835/3458727123":"2023-10-07T02:28:33.945993+0000","172.21.15.6:6833/862419044":"2023-10-07T02:29:39.146227+0000","172.21.15.6:6833/216641974":"2023-10-07T02:26:47.857852+0000","172.21.15.6:6833/3743771475":"2023-10-07T02:26:52.896928+0000","172.21.15.6:6833/171345142":"2023-10-07T02:28:55.598562+0000","172.21.15.6:6833/1052086725":"2023-10-07T02:25:58.221425+0000","172.21.15.6:6833/2846199049":"2023-10-07T02:24:54.766539+0000","172.21.15.6:6833/1318769254":"2023-10-07T02:26:41.158040+0000","172.21.15.6:6835/3954180287":"2023-10-07T02:26:56.923442+0000","172.21.15.6:6833/1622379942":"2023-10-07T02:25:17.098229+0000","172.21.15.6:6833/1827807239":"2023-10-07T02:29:46.199003+0000","172.21.15.6:6833/4105967039":"2023-10-07T02:26:10.886741+0000","172.21.15.6:6835/2951290545":"2023-10-07T02:25:45.052605+0000","172.21.15.6:6835/2298587443":"2023-10-07T02:25:11.951806+0000","172.21.15.6:6833/2198441052":"2023-10-07T02:29:12.035908+0000","172.21.15.6:6833/2298587443":"2023-10-07T02:25:11.951806+0000","172.21.15.6:6835/3396709104":"2023-10-07T02:27:59.847878+0000","172.21.15.6:6835/1622379942":"2023-10-07T02:25:17.098229+0000","172.21.15.6:6835/216641974":"2023-10-07T02:26:47.857852+0000","172.21.15.6:6833/3428181968":"2023-10-07T02:26:33.108528+0000","172.21.15.6:6835/2846199049":"2023-10-07T02:24:54.766539+0000","172.21.15.6:6833/3306486265":"2023-10-07T02:26:03.842781+0000","172.21.15.6:6835/788286408":"2023-10-07T02:25:31.922453+0000","172.21.15.6:6835/1052086725":"2023-10-07T02:25:58.221425+0000","172.21.15.6:6835/3650321949":"2023-10-07T02:27:21.889165+0000","172.21.15.6:6833/172936756":"2023-10-07T02:27:29.845422+0000","172.21.15.6:6833/2220056807":"2023-10-07T02:25:27.888466+0000","172.21.15.6:6835/3081379602":"2023-10-07T02:26:31.089756+0000","172.21.15.6:6835/2220056807":"2023-10-07T02:25:27.888466+0000","172.21.15.6:6833/2869895689":"2023-10-07T02:25:23.853264+0000","172.21.15.6:6835/171345142":"2023-10-07T02:28:55.598562+0000","172.21.15.6:6835/4105967039":"2023-10-07T02:26:10.886741+0000","172.21.15.6:6835/2420647508":"2023-10-07T02:27:38.002295+0000","172.21.15.6:6833/3012609856":"2023-10-07T02:27:13.280610+0000","172.21.15.6:6835/1045457090":"2023-10-07T02:25:56.200399+0000","172.21.15.6:6835/2198441052":"2023-10-07T02:29:12.035908+0000","172.21.15.6:6833/3954180287":"2023-10-07T02:26:56.923442+0000","172.21.15.6:6833/2836519357":"2023-10-07T02:27:11.265755+0000","172.21.15.6:6833/2274292833":"2023-10-07T02:28:08.189815+0000","172.21.15.6:6833/1713670870":"2023-10-07T02:29:07.007752+0000","172.21.15.6:6835/2836519357":"2023-10-07T02:27:11.265755+0000","172.21.15.6:6835/3012609856":"2023-10-07T02:27:13.280610+0000","172.21.15.6:6833/4058600046":"2023-10-07T02:28:28.153959+0000","172.21.15.6:6833/3650321949":"2023-10-07T02:27:21.889165+0000","172.21.15.6:6833/829468452":"2023-10-07T02:27:25.919824+0000","172.21.15.6:6833/3081379602":"2023-10-07T02:26:31.089756+0000","172.21.15.6:6835/829468452":"2023-10-07T02:27:25.919824+0000","172.21.15.6:6835/172936756":"2023-10-07T02:27:29.845422+0000","172.21.15.6:6835/4058600046":"2023-10-07T02:28:28.153959+0000","172.21.15.6:6833/1123398769":"2023-10-07T02:27:33.969565+0000","172.21.15.6:6833/1461010014":"2023-10-07T02:28:04.154595+0000","172.21.15.6:6835/3428181968":"2023-10-07T02:26:33.108528+0000","172.21.15.6:6835/1123398769":"2023-10-07T02:27:33.969565+0000","172.21.15.6:6835/1713670870":"2023-10-07T02:29:07.007752+0000","172.21.15.6:6833/2420647508":"2023-10-07T02:27:38.002295+0000","172.21.15.6:6833/4129427704":"2023-10-07T02:27:53.927529+0000","172.21.15.6:6835/4129427704":"2023-10-07T02:27:53.927529+0000","172.21.15.6:6833/788286408":"2023-10-07T02:25:31.922453+0000","172.21.15.6:6833/3592673283":"2023-10-07T02:27:56.096324+0000","172.21.15.6:6835/3592673283":"2023-10-07T02:27:56.096324+0000","172.21.15.6:6833/3396709104":"2023-10-07T02:27:59.847878+0000","172.21.15.6:6835/1461010014":"2023-10-07T02:28:04.154595+0000","172.21.15.6:6835/2274292833":"2023-10-07T02:28:08.189815+0000","172.21.15.6:6833/3458727123":"2023-10-07T02:28:33.945993+0000","172.21.15.6:6833/3364863394":"2023-10-07T02:26:17.923309+0000","172.21.15.6:6833/1486243669":"2023-10-07T02:29:27.961813+0000","172.21.15.6:6835/2361875445":"2023-10-07T02:27:17.854084+0000","172.21.15.6:6835/1486243669":"2023-10-07T02:29:27.961813+0000","172.21.15.6:6833/3944398775":"2023-10-07T02:29:32.871108+0000","172.21.15.6:6835/3944398775":"2023-10-07T02:29:32.871108+0000","172.21.15.6:6835/862419044":"2023-10-07T02:29:39.146227+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:29:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.847+0000 7f9b24c2b700 1 -- 172.21.15.6:0/3902358 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9b00066f30 msgr2=0x7f9b000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.847+0000 7f9b24c2b700 1 --2- 172.21.15.6:0/3902358 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9b00066f30 0x7f9b000693e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f9b200a5360 tx=0x7f9b08008040 comp rx=0 tx=0).stop 2023-10-06T02:29:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.847+0000 7f9b24c2b700 1 -- 172.21.15.6:0/3902358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b2006e520 msgr2=0x7f9b20157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.847+0000 7f9b24c2b700 1 --2- 172.21.15.6:0/3902358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b2006e520 0x7f9b20157560 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800cdd0 tx=0x7f9b18001bc0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.847+0000 7f9b24c2b700 1 -- 172.21.15.6:0/3902358 shutdown_connections 2023-10-06T02:29:53.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.847+0000 7f9b24c2b700 1 --2- 172.21.15.6:0/3902358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b201597c0 0x7f9b200a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.847+0000 7f9b24c2b700 1 --2- 172.21.15.6:0/3902358 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9b00066f30 0x7f9b000693e0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.847+0000 7f9b24c2b700 1 --2- 172.21.15.6:0/3902358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b2006e520 0x7f9b20157560 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.847+0000 7f9b24c2b700 1 --2- 172.21.15.6:0/3902358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b201593f0 0x7f9b200c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.847+0000 7f9b24c2b700 1 -- 172.21.15.6:0/3902358 >> 172.21.15.6:0/3902358 conn(0x7f9b2006cff0 msgr2=0x7f9b20159f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:53.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.847+0000 7f9b24c2b700 1 -- 172.21.15.6:0/3902358 shutdown_connections 2023-10-06T02:29:53.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.847+0000 7f9b24c2b700 1 -- 172.21.15.6:0/3902358 wait complete. 2023-10-06T02:29:53.861 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:29:53.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.980+0000 7f8bd2849700 1 Processor -- start 2023-10-06T02:29:53.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.980+0000 7f8bd2849700 1 -- start start 2023-10-06T02:29:53.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.981+0000 7f8bd2849700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8bcc086ff0 0x7f8bcc087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.981+0000 7f8bd2849700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8bcc0b21b0 0x7f8bcc0b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.981+0000 7f8bd2849700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bcc0b2b70 con 0x7f8bcc15a030 2023-10-06T02:29:53.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.981+0000 7f8bd2849700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bcc0b0cf0 con 0x7f8bcc0b21b0 2023-10-06T02:29:53.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.981+0000 7f8bd2849700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bcc0879b0 con 0x7f8bcc086ff0 2023-10-06T02:29:53.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.981+0000 7f8bd0de6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8bcc0b21b0 0x7f8bcc0b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.981+0000 7f8bd0de6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8bcc0b21b0 0x7f8bcc0b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41550/0 (socket says 172.21.15.6:41550) 2023-10-06T02:29:53.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.981+0000 7f8bd0de6700 1 -- 172.21.15.6:0/2923523444 learned_addr learned my addr 172.21.15.6:0/2923523444 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:53.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.981+0000 7f8bcb7fe700 1 --2- 172.21.15.6:0/2923523444 >> v2:172.21.15.175:3300/0 conn(0x7f8bcc086ff0 0x7f8bcc087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.981+0000 7f8bd0de6700 1 -- 172.21.15.6:0/2923523444 >> v2:172.21.15.175:3300/0 conn(0x7f8bcc086ff0 msgr2=0x7f8bcc087470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:53.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.981+0000 7f8bd0de6700 1 --2- 172.21.15.6:0/2923523444 >> v2:172.21.15.175:3300/0 conn(0x7f8bcc086ff0 0x7f8bcc087470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.981+0000 7f8bd0de6700 1 -- 172.21.15.6:0/2923523444 >> v1:172.21.15.175:6789/0 conn(0x7f8bcc15a030 legacy=0x7f8bcc15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:53.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.981+0000 7f8bd0de6700 1 -- 172.21.15.6:0/2923523444 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc0afc50 con 0x7f8bcc0b21b0 2023-10-06T02:29:53.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.982+0000 7f8bd0de6700 1 --2- 172.21.15.6:0/2923523444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc0b21b0 0x7f8bcc0b2630 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0b1fa0 tx=0x7f8bc4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e4ab6a6dd36025 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:53.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.982+0000 7f8bcaffd700 1 -- 172.21.15.6:0/2923523444 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc400e070 con 0x7f8bcc0b21b0 2023-10-06T02:29:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.982+0000 7f8bcaffd700 1 -- 172.21.15.6:0/2923523444 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc400ba00 con 0x7f8bcc0b21b0 2023-10-06T02:29:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.982+0000 7f8bcaffd700 1 -- 172.21.15.6:0/2923523444 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40092e0 con 0x7f8bcc0b21b0 2023-10-06T02:29:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.982+0000 7f8bd2849700 1 -- 172.21.15.6:0/2923523444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc0b21b0 msgr2=0x7f8bcc0b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.982+0000 7f8bd2849700 1 --2- 172.21.15.6:0/2923523444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc0b21b0 0x7f8bcc0b2630 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0b1fa0 tx=0x7f8bc4009840 comp rx=0 tx=0).stop 2023-10-06T02:29:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.982+0000 7f8bd2849700 1 -- 172.21.15.6:0/2923523444 shutdown_connections 2023-10-06T02:29:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.982+0000 7f8bd2849700 1 --2- 172.21.15.6:0/2923523444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc0b21b0 0x7f8bcc0b2630 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.982+0000 7f8bd2849700 1 --2- 172.21.15.6:0/2923523444 >> v2:172.21.15.175:3300/0 conn(0x7f8bcc086ff0 0x7f8bcc087470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.982+0000 7f8bd2849700 1 -- 172.21.15.6:0/2923523444 >> 172.21.15.6:0/2923523444 conn(0x7f8bcc068680 msgr2=0x7f8bcc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.982+0000 7f8bd2849700 1 -- 172.21.15.6:0/2923523444 shutdown_connections 2023-10-06T02:29:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.982+0000 7f8bd2849700 1 -- 172.21.15.6:0/2923523444 wait complete. 2023-10-06T02:29:53.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.983+0000 7f8bd2849700 1 Processor -- start 2023-10-06T02:29:53.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.984+0000 7f8bd2849700 1 -- start start 2023-10-06T02:29:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.984+0000 7f8bd2849700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bcc086ff0 0x7f8bcc16d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.984+0000 7f8bd2849700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc0b21b0 0x7f8bcc16db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.984+0000 7f8bd2849700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bcc15a030 0x7f8bcc0c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.984+0000 7f8bd2849700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc0c7490 con 0x7f8bcc0b21b0 2023-10-06T02:29:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.984+0000 7f8bd2849700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc0c7770 con 0x7f8bcc15a030 2023-10-06T02:29:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.984+0000 7f8bd2849700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc0c7a50 con 0x7f8bcc086ff0 2023-10-06T02:29:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.985+0000 7f8bcb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc0b21b0 0x7f8bcc16db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.985+0000 7f8bcb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc0b21b0 0x7f8bcc16db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41552/0 (socket says 172.21.15.6:41552) 2023-10-06T02:29:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.985+0000 7f8bcb7fe700 1 -- 172.21.15.6:0/1104393618 learned_addr learned my addr 172.21.15.6:0/1104393618 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.985+0000 7f8bd0de6700 1 --2- 172.21.15.6:0/1104393618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bcc15a030 0x7f8bcc0c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.985+0000 7f8bcbfff700 1 --2- 172.21.15.6:0/1104393618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bcc086ff0 0x7f8bcc16d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.985+0000 7f8bcb7fe700 1 -- 172.21.15.6:0/1104393618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bcc086ff0 msgr2=0x7f8bcc16d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.985+0000 7f8bcb7fe700 1 --2- 172.21.15.6:0/1104393618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bcc086ff0 0x7f8bcc16d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.985+0000 7f8bcb7fe700 1 -- 172.21.15.6:0/1104393618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bcc15a030 msgr2=0x7f8bcc0c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.985+0000 7f8bcb7fe700 1 --2- 172.21.15.6:0/1104393618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bcc15a030 0x7f8bcc0c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.985+0000 7f8bcb7fe700 1 -- 172.21.15.6:0/1104393618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc4009ae0 con 0x7f8bcc0b21b0 2023-10-06T02:29:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.985+0000 7f8bcbfff700 1 --2- 172.21.15.6:0/1104393618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bcc086ff0 0x7f8bcc16d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.985+0000 7f8bcb7fe700 1 --2- 172.21.15.6:0/1104393618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc0b21b0 0x7f8bcc16db30 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400d890 tx=0x7f8bb4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.985+0000 7f8bc3fff700 1 -- 172.21.15.6:0/1104393618 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb40125f0 con 0x7f8bcc0b21b0 2023-10-06T02:29:53.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.985+0000 7f8bc3fff700 1 -- 172.21.15.6:0/1104393618 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb4012750 con 0x7f8bcc0b21b0 2023-10-06T02:29:53.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.985+0000 7f8bd2849700 1 -- 172.21.15.6:0/1104393618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bcc0c7d30 con 0x7f8bcc0b21b0 2023-10-06T02:29:53.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.985+0000 7f8bc3fff700 1 -- 172.21.15.6:0/1104393618 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4012ad0 con 0x7f8bcc0b21b0 2023-10-06T02:29:53.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.985+0000 7f8bd2849700 1 -- 172.21.15.6:0/1104393618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bcc0c6580 con 0x7f8bcc0b21b0 2023-10-06T02:29:53.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.986+0000 7f8bd2849700 1 -- 172.21.15.6:0/1104393618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bcc088700 con 0x7f8bcc0b21b0 2023-10-06T02:29:53.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.987+0000 7f8bc3fff700 1 -- 172.21.15.6:0/1104393618 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8bb401e460 con 0x7f8bcc0b21b0 2023-10-06T02:29:53.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.987+0000 7f8bc3fff700 1 --2- 172.21.15.6:0/1104393618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8bac066f30 0x7f8bac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:53.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.987+0000 7f8bc3fff700 1 -- 172.21.15.6:0/1104393618 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 9818+0+0 (secure 0 0 0) 0x7f8bb4085ba0 con 0x7f8bcc0b21b0 2023-10-06T02:29:53.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.987+0000 7f8bcbfff700 1 --2- 172.21.15.6:0/1104393618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8bac066f30 0x7f8bac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:53.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.988+0000 7f8bcbfff700 1 --2- 172.21.15.6:0/1104393618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8bac066f30 0x7f8bac0693e0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0cf970 tx=0x7f8bbc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:53.991+0000 7f8bc3fff700 1 -- 172.21.15.6:0/1104393618 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8bb4051dc0 con 0x7f8bcc0b21b0 2023-10-06T02:29:54.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:54.233+0000 7f8bd2849700 1 -- 172.21.15.6:0/1104393618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8bcc0aff30 con 0x7f8bcc0b21b0 2023-10-06T02:29:55.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.235+0000 7f8bc3fff700 1 -- 172.21.15.6:0/1104393618 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v352) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8bb40553e0 con 0x7f8bcc0b21b0 2023-10-06T02:29:55.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.237+0000 7f8bd2849700 1 -- 172.21.15.6:0/1104393618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8bac066f30 msgr2=0x7f8bac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:55.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.237+0000 7f8bd2849700 1 --2- 172.21.15.6:0/1104393618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8bac066f30 0x7f8bac0693e0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0cf970 tx=0x7f8bbc008040 comp rx=0 tx=0).stop 2023-10-06T02:29:55.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.237+0000 7f8bd2849700 1 -- 172.21.15.6:0/1104393618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc0b21b0 msgr2=0x7f8bcc16db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:55.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.237+0000 7f8bd2849700 1 --2- 172.21.15.6:0/1104393618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc0b21b0 0x7f8bcc16db30 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400d890 tx=0x7f8bb4008040 comp rx=0 tx=0).stop 2023-10-06T02:29:55.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.237+0000 7f8bd2849700 1 -- 172.21.15.6:0/1104393618 shutdown_connections 2023-10-06T02:29:55.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.238+0000 7f8bd2849700 1 --2- 172.21.15.6:0/1104393618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bcc15a030 0x7f8bcc0c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:55.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.238+0000 7f8bd2849700 1 --2- 172.21.15.6:0/1104393618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bcc086ff0 0x7f8bcc16d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:55.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.238+0000 7f8bd2849700 1 --2- 172.21.15.6:0/1104393618 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8bac066f30 0x7f8bac0693e0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:55.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.238+0000 7f8bd2849700 1 --2- 172.21.15.6:0/1104393618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc0b21b0 0x7f8bcc16db30 unknown :-1 s=CLOSED pgs=2343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:55.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.238+0000 7f8bd2849700 1 -- 172.21.15.6:0/1104393618 >> 172.21.15.6:0/1104393618 conn(0x7f8bcc068680 msgr2=0x7f8bcc0cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:55.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.238+0000 7f8bd2849700 1 -- 172.21.15.6:0/1104393618 shutdown_connections 2023-10-06T02:29:55.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.238+0000 7f8bd2849700 1 -- 172.21.15.6:0/1104393618 wait complete. 2023-10-06T02:29:55.241 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:29:55.254 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:29:55.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.380+0000 7fb616de8700 1 Processor -- start 2023-10-06T02:29:55.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.380+0000 7fb616de8700 1 -- start start 2023-10-06T02:29:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.381+0000 7fb616de8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb61006dc60 0x7fb610159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.381+0000 7fb616de8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb610159ff0 0x7fb610156a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.381+0000 7fb616de8700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb61006cf40 0x7fb610156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.381+0000 7fb616de8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb610069790 con 0x7fb61006dc60 2023-10-06T02:29:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.381+0000 7fb616de8700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6100c8c00 con 0x7fb61006cf40 2023-10-06T02:29:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.381+0000 7fb616de8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61015aa50 con 0x7fb610159ff0 2023-10-06T02:29:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.381+0000 7fb615de6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb61006dc60 0x7fb610159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.381+0000 7fb615de6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb61006dc60 0x7fb610159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41554/0 (socket says 172.21.15.6:41554) 2023-10-06T02:29:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.381+0000 7fb615de6700 1 -- 172.21.15.6:0/3013012323 learned_addr learned my addr 172.21.15.6:0/3013012323 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.382+0000 7fb6155e5700 1 --2- 172.21.15.6:0/3013012323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb610159ff0 0x7fb610156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.382+0000 7fb615de6700 1 -- 172.21.15.6:0/3013012323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb610159ff0 msgr2=0x7fb610156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.382+0000 7fb615de6700 1 --2- 172.21.15.6:0/3013012323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb610159ff0 0x7fb610156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.382+0000 7fb615de6700 1 -- 172.21.15.6:0/3013012323 >> v2:172.21.15.175:3300/0 conn(0x7fb61006cf40 msgr2=0x7fb610156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.382+0000 7fb615de6700 1 --2- 172.21.15.6:0/3013012323 >> v2:172.21.15.175:3300/0 conn(0x7fb61006cf40 0x7fb610156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.382+0000 7fb615de6700 1 -- 172.21.15.6:0/3013012323 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6101574f0 con 0x7fb61006dc60 2023-10-06T02:29:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.382+0000 7fb6155e5700 1 --2- 172.21.15.6:0/3013012323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb610159ff0 0x7fb610156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.382+0000 7fb615de6700 1 --2- 172.21.15.6:0/3013012323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb61006dc60 0x7fb610159ab0 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7fb6100cddf0 tx=0x7fb608009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e516fa727ad0b9b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.382+0000 7fb614de4700 1 -- 172.21.15.6:0/3013012323 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60800b820 con 0x7fb61006dc60 2023-10-06T02:29:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.382+0000 7fb614de4700 1 -- 172.21.15.6:0/3013012323 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60800b980 con 0x7fb61006dc60 2023-10-06T02:29:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.382+0000 7fb614de4700 1 -- 172.21.15.6:0/3013012323 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60800bd20 con 0x7fb61006dc60 2023-10-06T02:29:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.383+0000 7fb616de8700 1 -- 172.21.15.6:0/3013012323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb61006dc60 msgr2=0x7fb610159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.383+0000 7fb616de8700 1 --2- 172.21.15.6:0/3013012323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb61006dc60 0x7fb610159ab0 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7fb6100cddf0 tx=0x7fb608009250 comp rx=0 tx=0).stop 2023-10-06T02:29:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.383+0000 7fb616de8700 1 -- 172.21.15.6:0/3013012323 shutdown_connections 2023-10-06T02:29:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.383+0000 7fb616de8700 1 --2- 172.21.15.6:0/3013012323 >> v2:172.21.15.175:3300/0 conn(0x7fb61006cf40 0x7fb610156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.383+0000 7fb616de8700 1 --2- 172.21.15.6:0/3013012323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb61006dc60 0x7fb610159ab0 unknown :-1 s=CLOSED pgs=2344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.383+0000 7fb616de8700 1 --2- 172.21.15.6:0/3013012323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb610159ff0 0x7fb610156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.383+0000 7fb616de8700 1 -- 172.21.15.6:0/3013012323 >> 172.21.15.6:0/3013012323 conn(0x7fb6100cea20 msgr2=0x7fb61006c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.383+0000 7fb616de8700 1 -- 172.21.15.6:0/3013012323 shutdown_connections 2023-10-06T02:29:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.383+0000 7fb616de8700 1 -- 172.21.15.6:0/3013012323 wait complete. 2023-10-06T02:29:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.384+0000 7fb616de8700 1 Processor -- start 2023-10-06T02:29:55.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.384+0000 7fb616de8700 1 -- start start 2023-10-06T02:29:55.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb616de8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb61006cf40 0x7fb61006af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:55.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb616de8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb61006dc60 0x7fb6100b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:55.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb616de8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb610159ff0 0x7fb610146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:55.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb616de8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb610144700 con 0x7fb61006dc60 2023-10-06T02:29:55.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb616de8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100c7930 con 0x7fb61006cf40 2023-10-06T02:29:55.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb616de8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100c6d20 con 0x7fb610159ff0 2023-10-06T02:29:55.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb6155e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb61006dc60 0x7fb6100b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:55.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb6155e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb61006dc60 0x7fb6100b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41556/0 (socket says 172.21.15.6:41556) 2023-10-06T02:29:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb6155e5700 1 -- 172.21.15.6:0/3324300431 learned_addr learned my addr 172.21.15.6:0/3324300431 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb615de6700 1 --2- 172.21.15.6:0/3324300431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb61006cf40 0x7fb61006af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb6165e7700 1 --2- 172.21.15.6:0/3324300431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb610159ff0 0x7fb610146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb6155e5700 1 -- 172.21.15.6:0/3324300431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb610159ff0 msgr2=0x7fb610146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb6155e5700 1 --2- 172.21.15.6:0/3324300431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb610159ff0 0x7fb610146bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb6155e5700 1 -- 172.21.15.6:0/3324300431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb61006cf40 msgr2=0x7fb61006af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb6155e5700 1 --2- 172.21.15.6:0/3324300431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb61006cf40 0x7fb61006af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb6155e5700 1 -- 172.21.15.6:0/3324300431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6080094f0 con 0x7fb61006dc60 2023-10-06T02:29:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb6155e5700 1 --2- 172.21.15.6:0/3324300431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb61006dc60 0x7fb6100b1f80 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7fb60400c800 tx=0x7fb604008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb60dffb700 1 -- 172.21.15.6:0/3324300431 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb604011600 con 0x7fb61006dc60 2023-10-06T02:29:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb60dffb700 1 -- 172.21.15.6:0/3324300431 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb604011760 con 0x7fb61006dc60 2023-10-06T02:29:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb616de8700 1 -- 172.21.15.6:0/3324300431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6100c7000 con 0x7fb61006dc60 2023-10-06T02:29:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.385+0000 7fb60dffb700 1 -- 172.21.15.6:0/3324300431 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb604011b20 con 0x7fb61006dc60 2023-10-06T02:29:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.386+0000 7fb616de8700 1 -- 172.21.15.6:0/3324300431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6100c75c0 con 0x7fb61006dc60 2023-10-06T02:29:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.387+0000 7fb616de8700 1 -- 172.21.15.6:0/3324300431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb610064ee0 con 0x7fb61006dc60 2023-10-06T02:29:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.387+0000 7fb60dffb700 1 -- 172.21.15.6:0/3324300431 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb604018350 con 0x7fb61006dc60 2023-10-06T02:29:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.387+0000 7fb60dffb700 1 --2- 172.21.15.6:0/3324300431 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5fc066f30 0x7fb5fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.387+0000 7fb60dffb700 1 -- 172.21.15.6:0/3324300431 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 9818+0+0 (secure 0 0 0) 0x7fb6040853f0 con 0x7fb61006dc60 2023-10-06T02:29:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.387+0000 7fb615de6700 1 --2- 172.21.15.6:0/3324300431 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5fc066f30 0x7fb5fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.388+0000 7fb615de6700 1 --2- 172.21.15.6:0/3324300431 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5fc066f30 0x7fb5fc0693e0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fb6100cddf0 tx=0x7fb608017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:55.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.392+0000 7fb60dffb700 1 -- 172.21.15.6:0/3324300431 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6040550a0 con 0x7fb61006dc60 2023-10-06T02:29:55.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:55.629+0000 7fb616de8700 1 -- 172.21.15.6:0/3324300431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb610064aa0 con 0x7fb61006dc60 2023-10-06T02:29:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.247+0000 7fb60dffb700 1 -- 172.21.15.6:0/3324300431 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v353) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb604054c30 con 0x7fb61006dc60 2023-10-06T02:29:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.250+0000 7fb616de8700 1 -- 172.21.15.6:0/3324300431 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5fc066f30 msgr2=0x7fb5fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.250+0000 7fb616de8700 1 --2- 172.21.15.6:0/3324300431 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5fc066f30 0x7fb5fc0693e0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fb6100cddf0 tx=0x7fb608017000 comp rx=0 tx=0).stop 2023-10-06T02:29:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.250+0000 7fb616de8700 1 -- 172.21.15.6:0/3324300431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb61006dc60 msgr2=0x7fb6100b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.250+0000 7fb616de8700 1 --2- 172.21.15.6:0/3324300431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb61006dc60 0x7fb6100b1f80 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7fb60400c800 tx=0x7fb604008040 comp rx=0 tx=0).stop 2023-10-06T02:29:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.250+0000 7fb616de8700 1 -- 172.21.15.6:0/3324300431 shutdown_connections 2023-10-06T02:29:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.250+0000 7fb616de8700 1 --2- 172.21.15.6:0/3324300431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb610159ff0 0x7fb610146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.250+0000 7fb616de8700 1 --2- 172.21.15.6:0/3324300431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb61006cf40 0x7fb61006af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.250+0000 7fb616de8700 1 --2- 172.21.15.6:0/3324300431 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb5fc066f30 0x7fb5fc0693e0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.250+0000 7fb616de8700 1 --2- 172.21.15.6:0/3324300431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb61006dc60 0x7fb6100b1f80 unknown :-1 s=CLOSED pgs=2345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.250+0000 7fb616de8700 1 -- 172.21.15.6:0/3324300431 >> 172.21.15.6:0/3324300431 conn(0x7fb6100cea20 msgr2=0x7fb6100cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.250+0000 7fb616de8700 1 -- 172.21.15.6:0/3324300431 shutdown_connections 2023-10-06T02:29:56.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.250+0000 7fb616de8700 1 -- 172.21.15.6:0/3324300431 wait complete. 2023-10-06T02:29:56.266 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:29:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.394+0000 7fcf48ff1700 1 Processor -- start 2023-10-06T02:29:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.394+0000 7fcf48ff1700 1 -- start start 2023-10-06T02:29:56.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.395+0000 7fcf48ff1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf44069c30 0x7fcf44068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:56.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.395+0000 7fcf48ff1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf440cc1d0 0x7fcf4415dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:56.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.395+0000 7fcf48ff1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf440c09c0 con 0x7fcf44069860 2023-10-06T02:29:56.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.395+0000 7fcf48ff1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf44068c60 con 0x7fcf44069c30 2023-10-06T02:29:56.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.395+0000 7fcf48ff1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440c0370 con 0x7fcf440cc1d0 2023-10-06T02:29:56.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.395+0000 7fcf41d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf44069c30 0x7fcf44068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:56.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.395+0000 7fcf41d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf44069c30 0x7fcf44068680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41558/0 (socket says 172.21.15.6:41558) 2023-10-06T02:29:56.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.395+0000 7fcf41d9b700 1 -- 172.21.15.6:0/1747561989 learned_addr learned my addr 172.21.15.6:0/1747561989 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:56.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.395+0000 7fcf4259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcf44069860 0x7fcf4415d670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42550/0 (socket says 172.21.15.6:42550) 2023-10-06T02:29:56.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.395+0000 7fcf41d9b700 1 -- 172.21.15.6:0/1747561989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf440cc1d0 msgr2=0x7fcf4415dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:56.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.395+0000 7fcf42d9d700 1 --2- 172.21.15.6:0/1747561989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf440cc1d0 0x7fcf4415dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:56.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.395+0000 7fcf41d9b700 1 --2- 172.21.15.6:0/1747561989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf440cc1d0 0x7fcf4415dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:56.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.395+0000 7fcf41d9b700 1 -- 172.21.15.6:0/1747561989 >> v1:172.21.15.6:6789/0 conn(0x7fcf44069860 legacy=0x7fcf4415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:56.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.395+0000 7fcf41d9b700 1 -- 172.21.15.6:0/1747561989 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf440c0650 con 0x7fcf44069c30 2023-10-06T02:29:56.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.395+0000 7fcf4159a700 1 -- 172.21.15.6:0/1747561989 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248896133 0 0) 0x7fcf440c09c0 con 0x7fcf44069860 2023-10-06T02:29:56.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.396+0000 7fcf41d9b700 1 --2- 172.21.15.6:0/1747561989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf44069c30 0x7fcf44068680 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0099b0 tx=0x7fcf2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2af641a86efd759 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.396+0000 7fcf4159a700 1 -- 172.21.15.6:0/1747561989 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c00b860 con 0x7fcf44069c30 2023-10-06T02:29:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.396+0000 7fcf4159a700 1 -- 172.21.15.6:0/1747561989 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c00b9c0 con 0x7fcf44069c30 2023-10-06T02:29:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.396+0000 7fcf4159a700 1 -- 172.21.15.6:0/1747561989 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c00bd60 con 0x7fcf44069c30 2023-10-06T02:29:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.396+0000 7fcf48ff1700 1 -- 172.21.15.6:0/1747561989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf44069c30 msgr2=0x7fcf44068680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.396+0000 7fcf48ff1700 1 --2- 172.21.15.6:0/1747561989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf44069c30 0x7fcf44068680 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0099b0 tx=0x7fcf2c009250 comp rx=0 tx=0).stop 2023-10-06T02:29:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.396+0000 7fcf48ff1700 1 -- 172.21.15.6:0/1747561989 shutdown_connections 2023-10-06T02:29:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.396+0000 7fcf48ff1700 1 --2- 172.21.15.6:0/1747561989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf440cc1d0 0x7fcf4415dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.396+0000 7fcf48ff1700 1 --2- 172.21.15.6:0/1747561989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf44069c30 0x7fcf44068680 unknown :-1 s=CLOSED pgs=2347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.396+0000 7fcf48ff1700 1 -- 172.21.15.6:0/1747561989 >> 172.21.15.6:0/1747561989 conn(0x7fcf440af620 msgr2=0x7fcf440afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.396+0000 7fcf48ff1700 1 -- 172.21.15.6:0/1747561989 shutdown_connections 2023-10-06T02:29:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.397+0000 7fcf48ff1700 1 -- 172.21.15.6:0/1747561989 wait complete. 2023-10-06T02:29:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.398+0000 7fcf48ff1700 1 Processor -- start 2023-10-06T02:29:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.398+0000 7fcf48ff1700 1 -- start start 2023-10-06T02:29:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.398+0000 7fcf48ff1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf44069860 0x7fcf44169be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.398+0000 7fcf48ff1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf44069c30 0x7fcf441448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.398+0000 7fcf48ff1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf440cc1d0 0x7fcf440c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.398+0000 7fcf48ff1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44144df0 con 0x7fcf44069860 2023-10-06T02:29:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.398+0000 7fcf48ff1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440c6680 con 0x7fcf440cc1d0 2023-10-06T02:29:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.398+0000 7fcf48ff1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440c7ca0 con 0x7fcf44069c30 2023-10-06T02:29:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.398+0000 7fcf4259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf44069860 0x7fcf44169be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.398+0000 7fcf4259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf44069860 0x7fcf44169be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41562/0 (socket says 172.21.15.6:41562) 2023-10-06T02:29:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.399+0000 7fcf4259c700 1 -- 172.21.15.6:0/1046516341 learned_addr learned my addr 172.21.15.6:0/1046516341 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.399+0000 7fcf41d9b700 1 --2- 172.21.15.6:0/1046516341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf44069c30 0x7fcf441448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.399+0000 7fcf4259c700 1 -- 172.21.15.6:0/1046516341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf44069c30 msgr2=0x7fcf441448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.399+0000 7fcf4259c700 1 --2- 172.21.15.6:0/1046516341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf44069c30 0x7fcf441448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.399+0000 7fcf4259c700 1 -- 172.21.15.6:0/1046516341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf440cc1d0 msgr2=0x7fcf440c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.399+0000 7fcf4259c700 1 --2- 172.21.15.6:0/1046516341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf440cc1d0 0x7fcf440c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.399+0000 7fcf4259c700 1 -- 172.21.15.6:0/1046516341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c0094f0 con 0x7fcf44069860 2023-10-06T02:29:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.399+0000 7fcf4259c700 1 --2- 172.21.15.6:0/1046516341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf44069860 0x7fcf44169be0 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00cdd0 tx=0x7fcf3c001bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.399+0000 7fcf3a7fc700 1 -- 172.21.15.6:0/1046516341 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c005df0 con 0x7fcf44069860 2023-10-06T02:29:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.399+0000 7fcf3a7fc700 1 -- 172.21.15.6:0/1046516341 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c00a960 con 0x7fcf44069860 2023-10-06T02:29:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.399+0000 7fcf48ff1700 1 -- 172.21.15.6:0/1046516341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf440c8540 con 0x7fcf44069860 2023-10-06T02:29:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.399+0000 7fcf3a7fc700 1 -- 172.21.15.6:0/1046516341 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c00ad20 con 0x7fcf44069860 2023-10-06T02:29:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.399+0000 7fcf48ff1700 1 -- 172.21.15.6:0/1046516341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf440c7ef0 con 0x7fcf44069860 2023-10-06T02:29:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.400+0000 7fcf48ff1700 1 -- 172.21.15.6:0/1046516341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4406cf10 con 0x7fcf44069860 2023-10-06T02:29:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.400+0000 7fcf3a7fc700 1 -- 172.21.15.6:0/1046516341 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf3c007300 con 0x7fcf44069860 2023-10-06T02:29:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.401+0000 7fcf3a7fc700 1 --2- 172.21.15.6:0/1046516341 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf24066f30 0x7fcf240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.401+0000 7fcf3a7fc700 1 -- 172.21.15.6:0/1046516341 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 9818+0+0 (secure 0 0 0) 0x7fcf3c085790 con 0x7fcf44069860 2023-10-06T02:29:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.401+0000 7fcf41d9b700 1 --2- 172.21.15.6:0/1046516341 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf24066f30 0x7fcf240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.402+0000 7fcf41d9b700 1 --2- 172.21.15.6:0/1046516341 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf24066f30 0x7fcf240693e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0099b0 tx=0x7fcf2c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:56.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.405+0000 7fcf3a7fc700 1 -- 172.21.15.6:0/1046516341 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf3c0519d0 con 0x7fcf44069860 2023-10-06T02:29:56.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:56.596+0000 7fcf48ff1700 1 -- 172.21.15.6:0/1046516341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcf44069270 con 0x7fcf44069860 2023-10-06T02:29:57.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.250+0000 7fcf3a7fc700 1 -- 172.21.15.6:0/1046516341 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v136) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcf3c054ff0 con 0x7fcf44069860 2023-10-06T02:29:57.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.257+0000 7fcf48ff1700 1 -- 172.21.15.6:0/1046516341 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf24066f30 msgr2=0x7fcf240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.257+0000 7fcf48ff1700 1 --2- 172.21.15.6:0/1046516341 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf24066f30 0x7fcf240693e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0099b0 tx=0x7fcf2c017000 comp rx=0 tx=0).stop 2023-10-06T02:29:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.257+0000 7fcf48ff1700 1 -- 172.21.15.6:0/1046516341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf44069860 msgr2=0x7fcf44169be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.257+0000 7fcf48ff1700 1 --2- 172.21.15.6:0/1046516341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf44069860 0x7fcf44169be0 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00cdd0 tx=0x7fcf3c001bc0 comp rx=0 tx=0).stop 2023-10-06T02:29:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.258+0000 7fcf48ff1700 1 -- 172.21.15.6:0/1046516341 shutdown_connections 2023-10-06T02:29:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.258+0000 7fcf48ff1700 1 --2- 172.21.15.6:0/1046516341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf440cc1d0 0x7fcf440c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.258+0000 7fcf48ff1700 1 --2- 172.21.15.6:0/1046516341 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcf24066f30 0x7fcf240693e0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.258+0000 7fcf48ff1700 1 --2- 172.21.15.6:0/1046516341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf44069860 0x7fcf44169be0 unknown :-1 s=CLOSED pgs=2348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.258+0000 7fcf48ff1700 1 --2- 172.21.15.6:0/1046516341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf44069c30 0x7fcf441448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.258+0000 7fcf48ff1700 1 -- 172.21.15.6:0/1046516341 >> 172.21.15.6:0/1046516341 conn(0x7fcf440af620 msgr2=0x7fcf440afc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:57.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.258+0000 7fcf48ff1700 1 -- 172.21.15.6:0/1046516341 shutdown_connections 2023-10-06T02:29:57.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.259+0000 7fcf48ff1700 1 -- 172.21.15.6:0/1046516341 wait complete. 2023-10-06T02:29:57.263 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:29:57.279 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:29:57.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.406+0000 7f8204a2a700 1 Processor -- start 2023-10-06T02:29:57.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.406+0000 7f8204a2a700 1 -- start start 2023-10-06T02:29:57.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f8204a2a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f82000b59a0 0x7f8200158c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:57.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f8204a2a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f82000b5d70 0x7f82001591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:57.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f8204a2a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82000ce5d0 0x7f82000ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:57.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f8204a2a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8200159710 con 0x7f82000b5d70 2023-10-06T02:29:57.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f8204a2a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82000cf400 con 0x7f82000b59a0 2023-10-06T02:29:57.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f8204a2a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82000cf6e0 con 0x7f82000ce5d0 2023-10-06T02:29:57.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f81feffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f82000b5d70 0x7f82001591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:57.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f81feffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f82000b5d70 0x7f82001591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41572/0 (socket says 172.21.15.6:41572) 2023-10-06T02:29:57.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f81feffd700 1 -- 172.21.15.6:0/1178279222 learned_addr learned my addr 172.21.15.6:0/1178279222 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:57.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f81ff7fe700 1 --2- 172.21.15.6:0/1178279222 >> v2:172.21.15.175:3300/0 conn(0x7f82000b59a0 0x7f8200158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:57.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f81fffff700 1 --2- 172.21.15.6:0/1178279222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82000ce5d0 0x7f82000ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:57.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f81feffd700 1 -- 172.21.15.6:0/1178279222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82000ce5d0 msgr2=0x7f82000ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:57.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f81feffd700 1 --2- 172.21.15.6:0/1178279222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82000ce5d0 0x7f82000ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:57.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f81feffd700 1 -- 172.21.15.6:0/1178279222 >> v2:172.21.15.175:3300/0 conn(0x7f82000b59a0 msgr2=0x7f8200158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:57.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f81feffd700 1 --2- 172.21.15.6:0/1178279222 >> v2:172.21.15.175:3300/0 conn(0x7f82000b59a0 0x7f8200158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:57.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f81feffd700 1 -- 172.21.15.6:0/1178279222 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82000cf9c0 con 0x7f82000b5d70 2023-10-06T02:29:57.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f81ff7fe700 1 --2- 172.21.15.6:0/1178279222 >> v2:172.21.15.175:3300/0 conn(0x7f82000b59a0 0x7f8200158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:57.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.407+0000 7f81fffff700 1 --2- 172.21.15.6:0/1178279222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82000ce5d0 0x7f82000ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:57.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.408+0000 7f81feffd700 1 --2- 172.21.15.6:0/1178279222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82000b5d70 0x7f82001591d0 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f82000d11a0 tx=0x7f81f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59bd4317ca41668 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:57.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.408+0000 7f81fe7fc700 1 -- 172.21.15.6:0/1178279222 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f400b860 con 0x7f82000b5d70 2023-10-06T02:29:57.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.408+0000 7f81fe7fc700 1 -- 172.21.15.6:0/1178279222 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f400b9c0 con 0x7f82000b5d70 2023-10-06T02:29:57.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.408+0000 7f81fe7fc700 1 -- 172.21.15.6:0/1178279222 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f400bd60 con 0x7f82000b5d70 2023-10-06T02:29:57.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.408+0000 7f8204a2a700 1 -- 172.21.15.6:0/1178279222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82000b5d70 msgr2=0x7f82001591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:57.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.408+0000 7f8204a2a700 1 --2- 172.21.15.6:0/1178279222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82000b5d70 0x7f82001591d0 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f82000d11a0 tx=0x7f81f4009250 comp rx=0 tx=0).stop 2023-10-06T02:29:57.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.408+0000 7f8204a2a700 1 -- 172.21.15.6:0/1178279222 shutdown_connections 2023-10-06T02:29:57.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.408+0000 7f8204a2a700 1 --2- 172.21.15.6:0/1178279222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82000ce5d0 0x7f82000ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:57.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.408+0000 7f8204a2a700 1 --2- 172.21.15.6:0/1178279222 >> v2:172.21.15.175:3300/0 conn(0x7f82000b59a0 0x7f8200158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:57.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.408+0000 7f8204a2a700 1 --2- 172.21.15.6:0/1178279222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82000b5d70 0x7f82001591d0 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:57.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.408+0000 7f8204a2a700 1 -- 172.21.15.6:0/1178279222 >> 172.21.15.6:0/1178279222 conn(0x7f8200069150 msgr2=0x7f82000b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:57.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.408+0000 7f8204a2a700 1 -- 172.21.15.6:0/1178279222 shutdown_connections 2023-10-06T02:29:57.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.408+0000 7f8204a2a700 1 -- 172.21.15.6:0/1178279222 wait complete. 2023-10-06T02:29:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.410+0000 7f8204a2a700 1 Processor -- start 2023-10-06T02:29:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.410+0000 7f8204a2a700 1 -- start start 2023-10-06T02:29:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.410+0000 7f8204a2a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82000b59a0 0x7f82000c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.410+0000 7f8204a2a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82000b5d70 0x7f82000c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.410+0000 7f8204a2a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82000ce5d0 0x7f8200155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.410+0000 7f8204a2a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82000c6cb0 con 0x7f82000b5d70 2023-10-06T02:29:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.410+0000 7f8204a2a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82000c90f0 con 0x7f82000ce5d0 2023-10-06T02:29:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.410+0000 7f8204a2a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82000c93d0 con 0x7f82000b59a0 2023-10-06T02:29:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.410+0000 7f81feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82000b5d70 0x7f82000c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.411+0000 7f81feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82000b5d70 0x7f82000c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41578/0 (socket says 172.21.15.6:41578) 2023-10-06T02:29:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.411+0000 7f81feffd700 1 -- 172.21.15.6:0/1854061238 learned_addr learned my addr 172.21.15.6:0/1854061238 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.411+0000 7f81ff7fe700 1 --2- 172.21.15.6:0/1854061238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82000b59a0 0x7f82000c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.411+0000 7f81fffff700 1 --2- 172.21.15.6:0/1854061238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82000ce5d0 0x7f8200155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.411+0000 7f81feffd700 1 -- 172.21.15.6:0/1854061238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82000b59a0 msgr2=0x7f82000c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.411+0000 7f81feffd700 1 --2- 172.21.15.6:0/1854061238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82000b59a0 0x7f82000c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.411+0000 7f81feffd700 1 -- 172.21.15.6:0/1854061238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82000ce5d0 msgr2=0x7f8200155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.411+0000 7f81feffd700 1 --2- 172.21.15.6:0/1854061238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82000ce5d0 0x7f8200155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.411+0000 7f81feffd700 1 -- 172.21.15.6:0/1854061238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f40094f0 con 0x7f82000b5d70 2023-10-06T02:29:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.411+0000 7f81ff7fe700 1 --2- 172.21.15.6:0/1854061238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82000b59a0 0x7f82000c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.411+0000 7f81fffff700 1 --2- 172.21.15.6:0/1854061238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82000ce5d0 0x7f8200155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.411+0000 7f81feffd700 1 --2- 172.21.15.6:0/1854061238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82000b5d70 0x7f82000c88a0 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7f8200063bb0 tx=0x7f81f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.411+0000 7f81e77fe700 1 -- 172.21.15.6:0/1854061238 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4024440 con 0x7f82000b5d70 2023-10-06T02:29:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.411+0000 7f81e77fe700 1 -- 172.21.15.6:0/1854061238 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f40245a0 con 0x7f82000b5d70 2023-10-06T02:29:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.411+0000 7f8204a2a700 1 -- 172.21.15.6:0/1854061238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82000c96b0 con 0x7f82000b5d70 2023-10-06T02:29:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.411+0000 7f81e77fe700 1 -- 172.21.15.6:0/1854061238 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4024960 con 0x7f82000b5d70 2023-10-06T02:29:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.411+0000 7f8204a2a700 1 -- 172.21.15.6:0/1854061238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8200155670 con 0x7f82000b5d70 2023-10-06T02:29:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.412+0000 7f8204a2a700 1 -- 172.21.15.6:0/1854061238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8200088650 con 0x7f82000b5d70 2023-10-06T02:29:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.413+0000 7f81e77fe700 1 -- 172.21.15.6:0/1854061238 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81f401a420 con 0x7f82000b5d70 2023-10-06T02:29:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.413+0000 7f81e77fe700 1 --2- 172.21.15.6:0/1854061238 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81ec066f30 0x7f81ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.413+0000 7f81e77fe700 1 -- 172.21.15.6:0/1854061238 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 9380+0+0 (secure 0 0 0) 0x7f81f4087240 con 0x7f82000b5d70 2023-10-06T02:29:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.413+0000 7f81ff7fe700 1 --2- 172.21.15.6:0/1854061238 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81ec066f30 0x7f81ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.414+0000 7f81ff7fe700 1 --2- 172.21.15.6:0/1854061238 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81ec066f30 0x7f81ec0693e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f81f0006fd0 tx=0x7f81f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.417+0000 7f81e77fe700 1 -- 172.21.15.6:0/1854061238 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81f4053610 con 0x7f82000b5d70 2023-10-06T02:29:57.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:57.613+0000 7f8204a2a700 1 -- 172.21.15.6:0/1854061238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8200068420 con 0x7f82000b5d70 2023-10-06T02:29:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.253+0000 7f81e77fe700 1 -- 172.21.15.6:0/1854061238 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v137) v1 ==== 169+0+0 (secure 0 0 0) 0x7f81f4056c30 con 0x7f82000b5d70 2023-10-06T02:29:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.260+0000 7f8204a2a700 1 -- 172.21.15.6:0/1854061238 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81ec066f30 msgr2=0x7f81ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.260+0000 7f8204a2a700 1 --2- 172.21.15.6:0/1854061238 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81ec066f30 0x7f81ec0693e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f81f0006fd0 tx=0x7f81f0008040 comp rx=0 tx=0).stop 2023-10-06T02:29:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.260+0000 7f8204a2a700 1 -- 172.21.15.6:0/1854061238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82000b5d70 msgr2=0x7f82000c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.260+0000 7f8204a2a700 1 --2- 172.21.15.6:0/1854061238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82000b5d70 0x7f82000c88a0 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7f8200063bb0 tx=0x7f81f4017000 comp rx=0 tx=0).stop 2023-10-06T02:29:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.260+0000 7f8204a2a700 1 -- 172.21.15.6:0/1854061238 shutdown_connections 2023-10-06T02:29:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.260+0000 7f8204a2a700 1 --2- 172.21.15.6:0/1854061238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82000ce5d0 0x7f8200155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.260+0000 7f8204a2a700 1 --2- 172.21.15.6:0/1854061238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82000b59a0 0x7f82000c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.260+0000 7f8204a2a700 1 --2- 172.21.15.6:0/1854061238 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f81ec066f30 0x7f81ec0693e0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.260+0000 7f8204a2a700 1 --2- 172.21.15.6:0/1854061238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82000b5d70 0x7f82000c88a0 unknown :-1 s=CLOSED pgs=2350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.260+0000 7f8204a2a700 1 -- 172.21.15.6:0/1854061238 >> 172.21.15.6:0/1854061238 conn(0x7f8200069150 msgr2=0x7f8200155f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.261+0000 7f8204a2a700 1 -- 172.21.15.6:0/1854061238 shutdown_connections 2023-10-06T02:29:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.261+0000 7f8204a2a700 1 -- 172.21.15.6:0/1854061238 wait complete. 2023-10-06T02:29:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-06T02:29:58.278 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:29:58.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.400+0000 7f793f6e9700 1 Processor -- start 2023-10-06T02:29:58.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.400+0000 7f793f6e9700 1 -- start start 2023-10-06T02:29:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.401+0000 7f793f6e9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79380ccd40 0x7f79380cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.401+0000 7f793f6e9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79380cf7e0 0x7f79380b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.401+0000 7f793f6e9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f793815dd40 con 0x7f79380d0400 2023-10-06T02:29:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.401+0000 7f793f6e9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f793815e020 con 0x7f79380ccd40 2023-10-06T02:29:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.401+0000 7f793f6e9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79380ceaa0 con 0x7f79380cf7e0 2023-10-06T02:29:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.401+0000 7f793cc84700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79380ccd40 0x7f79380cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.401+0000 7f793d485700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f79380d0400 0x7f79380b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42554/0 (socket says 172.21.15.6:42554) 2023-10-06T02:29:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.402+0000 7f793cc84700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79380ccd40 0x7f79380cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41588/0 (socket says 172.21.15.6:41588) 2023-10-06T02:29:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.402+0000 7f793d485700 1 -- 172.21.15.6:0/3885328667 learned_addr learned my addr 172.21.15.6:0/3885328667 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:29:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.402+0000 7f793dc86700 1 --2- 172.21.15.6:0/3885328667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79380cf7e0 0x7f79380b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.402+0000 7f793cc84700 1 -- 172.21.15.6:0/3885328667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79380cf7e0 msgr2=0x7f79380b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.402+0000 7f793cc84700 1 --2- 172.21.15.6:0/3885328667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79380cf7e0 0x7f79380b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.402+0000 7f793cc84700 1 -- 172.21.15.6:0/3885328667 >> v1:172.21.15.6:6789/0 conn(0x7f79380d0400 legacy=0x7f79380b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.402+0000 7f793cc84700 1 -- 172.21.15.6:0/3885328667 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79380ced80 con 0x7f79380ccd40 2023-10-06T02:29:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.402+0000 7f7937fff700 1 -- 172.21.15.6:0/3885328667 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338555170 0 0) 0x7f793815dd40 con 0x7f79380d0400 2023-10-06T02:29:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.402+0000 7f793cc84700 1 --2- 172.21.15.6:0/3885328667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79380ccd40 0x7f79380cf2a0 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7f792c0098e0 tx=0x7f792c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c9114c45fb37b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.402+0000 7f7937fff700 1 -- 172.21.15.6:0/3885328667 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c00b640 con 0x7f79380ccd40 2023-10-06T02:29:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.402+0000 7f7937fff700 1 -- 172.21.15.6:0/3885328667 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c00b7a0 con 0x7f79380ccd40 2023-10-06T02:29:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.402+0000 7f7937fff700 1 -- 172.21.15.6:0/3885328667 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c00bb40 con 0x7f79380ccd40 2023-10-06T02:29:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.403+0000 7f793f6e9700 1 -- 172.21.15.6:0/3885328667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79380ccd40 msgr2=0x7f79380cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.403+0000 7f793f6e9700 1 --2- 172.21.15.6:0/3885328667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79380ccd40 0x7f79380cf2a0 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7f792c0098e0 tx=0x7f792c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.403+0000 7f793f6e9700 1 -- 172.21.15.6:0/3885328667 shutdown_connections 2023-10-06T02:29:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.403+0000 7f793f6e9700 1 --2- 172.21.15.6:0/3885328667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79380cf7e0 0x7f79380b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.403+0000 7f793f6e9700 1 --2- 172.21.15.6:0/3885328667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79380ccd40 0x7f79380cf2a0 unknown :-1 s=CLOSED pgs=2352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.403+0000 7f793f6e9700 1 -- 172.21.15.6:0/3885328667 >> 172.21.15.6:0/3885328667 conn(0x7f793806a220 msgr2=0x7f793806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.403+0000 7f793f6e9700 1 -- 172.21.15.6:0/3885328667 shutdown_connections 2023-10-06T02:29:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.403+0000 7f793f6e9700 1 -- 172.21.15.6:0/3885328667 wait complete. 2023-10-06T02:29:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.404+0000 7f793f6e9700 1 Processor -- start 2023-10-06T02:29:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.404+0000 7f793f6e9700 1 -- start start 2023-10-06T02:29:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.405+0000 7f793f6e9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79380ccd40 0x7f793816ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.405+0000 7f793f6e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79380cf7e0 0x7f79381518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.405+0000 7f793f6e9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79380d0400 0x7f7938157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.405+0000 7f793f6e9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793816a880 con 0x7f79380cf7e0 2023-10-06T02:29:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.405+0000 7f793f6e9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7938169c70 con 0x7f79380d0400 2023-10-06T02:29:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.405+0000 7f793f6e9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7938169f50 con 0x7f79380ccd40 2023-10-06T02:29:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.405+0000 7f793cc84700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79380cf7e0 0x7f79381518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.405+0000 7f793cc84700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79380cf7e0 0x7f79381518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41592/0 (socket says 172.21.15.6:41592) 2023-10-06T02:29:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.405+0000 7f793cc84700 1 -- 172.21.15.6:0/3211468083 learned_addr learned my addr 172.21.15.6:0/3211468083 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.405+0000 7f793d485700 1 --2- 172.21.15.6:0/3211468083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79380ccd40 0x7f793816ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.405+0000 7f793dc86700 1 --2- 172.21.15.6:0/3211468083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79380d0400 0x7f7938157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.405+0000 7f793cc84700 1 -- 172.21.15.6:0/3211468083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79380ccd40 msgr2=0x7f793816ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.405+0000 7f793cc84700 1 --2- 172.21.15.6:0/3211468083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79380ccd40 0x7f793816ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.405+0000 7f793cc84700 1 -- 172.21.15.6:0/3211468083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79380d0400 msgr2=0x7f7938157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.405+0000 7f793cc84700 1 --2- 172.21.15.6:0/3211468083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79380d0400 0x7f7938157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.405+0000 7f793cc84700 1 -- 172.21.15.6:0/3211468083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c009420 con 0x7f79380cf7e0 2023-10-06T02:29:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.405+0000 7f793cc84700 1 --2- 172.21.15.6:0/3211468083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79380cf7e0 0x7f79381518e0 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7f79380883f0 tx=0x7f792c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.406+0000 7f79357fa700 1 -- 172.21.15.6:0/3211468083 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c00bb20 con 0x7f79380cf7e0 2023-10-06T02:29:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.406+0000 7f79357fa700 1 -- 172.21.15.6:0/3211468083 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c000c90 con 0x7f79380cf7e0 2023-10-06T02:29:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.406+0000 7f79357fa700 1 -- 172.21.15.6:0/3211468083 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c011650 con 0x7f79380cf7e0 2023-10-06T02:29:58.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.406+0000 7f793f6e9700 1 -- 172.21.15.6:0/3211468083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793816a230 con 0x7f79380cf7e0 2023-10-06T02:29:58.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.406+0000 7f793f6e9700 1 -- 172.21.15.6:0/3211468083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7938159000 con 0x7f79380cf7e0 2023-10-06T02:29:58.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.407+0000 7f793f6e9700 1 -- 172.21.15.6:0/3211468083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79381591f0 con 0x7f79380cf7e0 2023-10-06T02:29:58.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.407+0000 7f79357fa700 1 -- 172.21.15.6:0/3211468083 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f792c011a00 con 0x7f79380cf7e0 2023-10-06T02:29:58.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.408+0000 7f79357fa700 1 --2- 172.21.15.6:0/3211468083 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7924066f30 0x7f79240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:58.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.408+0000 7f79357fa700 1 -- 172.21.15.6:0/3211468083 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 8966+0+0 (secure 0 0 0) 0x7f792c086820 con 0x7f79380cf7e0 2023-10-06T02:29:58.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.408+0000 7f793d485700 1 --2- 172.21.15.6:0/3211468083 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7924066f30 0x7f79240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:58.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.408+0000 7f793d485700 1 --2- 172.21.15.6:0/3211468083 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7924066f30 0x7f79240693e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f79380d00b0 tx=0x7f7930009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:58.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.414+0000 7f79357fa700 1 -- 172.21.15.6:0/3211468083 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f792c052e10 con 0x7f79380cf7e0 2023-10-06T02:29:58.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.612+0000 7f793f6e9700 1 -- 172.21.15.6:0/3211468083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f79380ce6c0 con 0x7f79380cf7e0 2023-10-06T02:29:58.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.615+0000 7f79357fa700 1 -- 172.21.15.6:0/3211468083 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f792c0150a0 con 0x7f79380cf7e0 2023-10-06T02:29:58.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.618+0000 7f793f6e9700 1 -- 172.21.15.6:0/3211468083 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7924066f30 msgr2=0x7f79240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.618+0000 7f793f6e9700 1 --2- 172.21.15.6:0/3211468083 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7924066f30 0x7f79240693e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f79380d00b0 tx=0x7f7930009040 comp rx=0 tx=0).stop 2023-10-06T02:29:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.618+0000 7f793f6e9700 1 -- 172.21.15.6:0/3211468083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79380cf7e0 msgr2=0x7f79381518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.618+0000 7f793f6e9700 1 --2- 172.21.15.6:0/3211468083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79380cf7e0 0x7f79381518e0 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7f79380883f0 tx=0x7f792c017000 comp rx=0 tx=0).stop 2023-10-06T02:29:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.618+0000 7f793f6e9700 1 -- 172.21.15.6:0/3211468083 shutdown_connections 2023-10-06T02:29:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.618+0000 7f793f6e9700 1 --2- 172.21.15.6:0/3211468083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79380d0400 0x7f7938157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.618+0000 7f793f6e9700 1 --2- 172.21.15.6:0/3211468083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79380ccd40 0x7f793816ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.618+0000 7f793f6e9700 1 --2- 172.21.15.6:0/3211468083 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7924066f30 0x7f79240693e0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.618+0000 7f793f6e9700 1 --2- 172.21.15.6:0/3211468083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79380cf7e0 0x7f79381518e0 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.618+0000 7f793f6e9700 1 -- 172.21.15.6:0/3211468083 >> 172.21.15.6:0/3211468083 conn(0x7f793806a220 msgr2=0x7f79380b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.618+0000 7f793f6e9700 1 -- 172.21.15.6:0/3211468083 shutdown_connections 2023-10-06T02:29:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.618+0000 7f793f6e9700 1 -- 172.21.15.6:0/3211468083 wait complete. 2023-10-06T02:29:58.631 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_object_deletion' 2023-10-06T02:29:58.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.748+0000 7fa842044700 1 Processor -- start 2023-10-06T02:29:58.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.749+0000 7fa842044700 1 -- start start 2023-10-06T02:29:58.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.749+0000 7fa842044700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa83c153ad0 0x7fa83c0cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:58.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.749+0000 7fa842044700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa83c0cd350 0x7fa83c1566a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:58.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.749+0000 7fa842044700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa83c156be0 0x7fa83c06cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:58.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.749+0000 7fa842044700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c0cd7c0 con 0x7fa83c153ad0 2023-10-06T02:29:58.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.749+0000 7fa842044700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c158070 con 0x7fa83c0cd350 2023-10-06T02:29:58.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.749+0000 7fa842044700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c157780 con 0x7fa83c156be0 2023-10-06T02:29:58.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.749+0000 7fa841042700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa83c153ad0 0x7fa83c0cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:58.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.750+0000 7fa841042700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa83c153ad0 0x7fa83c0cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42394/0 (socket says 172.21.15.6:42394) 2023-10-06T02:29:58.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.750+0000 7fa841042700 1 -- 172.21.15.6:0/1586268052 learned_addr learned my addr 172.21.15.6:0/1586268052 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:58.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.750+0000 7fa840841700 1 --2- 172.21.15.6:0/1586268052 >> v2:172.21.15.175:3300/0 conn(0x7fa83c0cd350 0x7fa83c1566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:58.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.750+0000 7fa841843700 1 --2- 172.21.15.6:0/1586268052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa83c156be0 0x7fa83c06cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:58.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.750+0000 7fa841042700 1 -- 172.21.15.6:0/1586268052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa83c156be0 msgr2=0x7fa83c06cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:58.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.750+0000 7fa841042700 1 --2- 172.21.15.6:0/1586268052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa83c156be0 0x7fa83c06cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.750+0000 7fa841042700 1 -- 172.21.15.6:0/1586268052 >> v2:172.21.15.175:3300/0 conn(0x7fa83c0cd350 msgr2=0x7fa83c1566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:58.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.750+0000 7fa841042700 1 --2- 172.21.15.6:0/1586268052 >> v2:172.21.15.175:3300/0 conn(0x7fa83c0cd350 0x7fa83c1566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.750+0000 7fa841042700 1 -- 172.21.15.6:0/1586268052 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c157a20 con 0x7fa83c153ad0 2023-10-06T02:29:58.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.750+0000 7fa841042700 1 --2- 172.21.15.6:0/1586268052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa83c153ad0 0x7fa83c0cce10 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7fa83c068140 tx=0x7fa834009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad28faa0861b52b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:58.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.750+0000 7fa83bfff700 1 -- 172.21.15.6:0/1586268052 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83400b860 con 0x7fa83c153ad0 2023-10-06T02:29:58.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.750+0000 7fa83bfff700 1 -- 172.21.15.6:0/1586268052 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83400b9c0 con 0x7fa83c153ad0 2023-10-06T02:29:58.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.750+0000 7fa83bfff700 1 -- 172.21.15.6:0/1586268052 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83400bd60 con 0x7fa83c153ad0 2023-10-06T02:29:58.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.751+0000 7fa842044700 1 -- 172.21.15.6:0/1586268052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa83c153ad0 msgr2=0x7fa83c0cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:58.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.751+0000 7fa842044700 1 --2- 172.21.15.6:0/1586268052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa83c153ad0 0x7fa83c0cce10 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7fa83c068140 tx=0x7fa834009250 comp rx=0 tx=0).stop 2023-10-06T02:29:58.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.751+0000 7fa842044700 1 -- 172.21.15.6:0/1586268052 shutdown_connections 2023-10-06T02:29:58.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.751+0000 7fa842044700 1 --2- 172.21.15.6:0/1586268052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa83c156be0 0x7fa83c06cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.751+0000 7fa842044700 1 --2- 172.21.15.6:0/1586268052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa83c153ad0 0x7fa83c0cce10 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.751+0000 7fa842044700 1 --2- 172.21.15.6:0/1586268052 >> v2:172.21.15.175:3300/0 conn(0x7fa83c0cd350 0x7fa83c1566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.751+0000 7fa842044700 1 -- 172.21.15.6:0/1586268052 >> 172.21.15.6:0/1586268052 conn(0x7fa83c06b320 msgr2=0x7fa83c06b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:58.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.751+0000 7fa842044700 1 -- 172.21.15.6:0/1586268052 shutdown_connections 2023-10-06T02:29:58.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.751+0000 7fa842044700 1 -- 172.21.15.6:0/1586268052 wait complete. 2023-10-06T02:29:58.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.752+0000 7fa842044700 1 Processor -- start 2023-10-06T02:29:58.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.752+0000 7fa842044700 1 -- start start 2023-10-06T02:29:58.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa842044700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83c0cd350 0x7fa83c0c2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:58.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa842044700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa83c153ad0 0x7fa83c151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:58.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa842044700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa83c156be0 0x7fa83c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:58.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa842044700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c1522a0 con 0x7fa83c153ad0 2023-10-06T02:29:58.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa842044700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c13a460 con 0x7fa83c0cd350 2023-10-06T02:29:58.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa842044700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0c23a0 con 0x7fa83c156be0 2023-10-06T02:29:58.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa840841700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa83c153ad0 0x7fa83c151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:58.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa840841700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa83c153ad0 0x7fa83c151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42406/0 (socket says 172.21.15.6:42406) 2023-10-06T02:29:58.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa840841700 1 -- 172.21.15.6:0/3787178475 learned_addr learned my addr 172.21.15.6:0/3787178475 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:58.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa841042700 1 --2- 172.21.15.6:0/3787178475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83c0cd350 0x7fa83c0c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:58.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa841843700 1 --2- 172.21.15.6:0/3787178475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa83c156be0 0x7fa83c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:58.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa840841700 1 -- 172.21.15.6:0/3787178475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa83c156be0 msgr2=0x7fa83c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:58.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa840841700 1 --2- 172.21.15.6:0/3787178475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa83c156be0 0x7fa83c0ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa840841700 1 -- 172.21.15.6:0/3787178475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83c0cd350 msgr2=0x7fa83c0c2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa840841700 1 --2- 172.21.15.6:0/3787178475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83c0cd350 0x7fa83c0c2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa840841700 1 -- 172.21.15.6:0/3787178475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8340094f0 con 0x7fa83c153ad0 2023-10-06T02:29:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa840841700 1 --2- 172.21.15.6:0/3787178475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa83c153ad0 0x7fa83c151d60 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7fa83000d890 tx=0x7fa830008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa8397fa700 1 -- 172.21.15.6:0/3787178475 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8300125f0 con 0x7fa83c153ad0 2023-10-06T02:29:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.753+0000 7fa8397fa700 1 -- 172.21.15.6:0/3787178475 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa830012750 con 0x7fa83c153ad0 2023-10-06T02:29:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.754+0000 7fa842044700 1 -- 172.21.15.6:0/3787178475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83c13a180 con 0x7fa83c153ad0 2023-10-06T02:29:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.754+0000 7fa8397fa700 1 -- 172.21.15.6:0/3787178475 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830012af0 con 0x7fa83c153ad0 2023-10-06T02:29:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.754+0000 7fa842044700 1 -- 172.21.15.6:0/3787178475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83c0c2030 con 0x7fa83c153ad0 2023-10-06T02:29:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.755+0000 7fa842044700 1 -- 172.21.15.6:0/3787178475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83c06e820 con 0x7fa83c153ad0 2023-10-06T02:29:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.755+0000 7fa8397fa700 1 -- 172.21.15.6:0/3787178475 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa83001e460 con 0x7fa83c153ad0 2023-10-06T02:29:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.755+0000 7fa8397fa700 1 --2- 172.21.15.6:0/3787178475 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa828066f30 0x7fa8280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:58.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.755+0000 7fa8397fa700 1 -- 172.21.15.6:0/3787178475 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 8966+0+0 (secure 0 0 0) 0x7fa8300856d0 con 0x7fa83c153ad0 2023-10-06T02:29:58.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.756+0000 7fa841042700 1 --2- 172.21.15.6:0/3787178475 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa828066f30 0x7fa8280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:58.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.756+0000 7fa841042700 1 --2- 172.21.15.6:0/3787178475 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa828066f30 0x7fa8280693e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fa83c068140 tx=0x7fa834017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:58.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:58.759+0000 7fa8397fa700 1 -- 172.21.15.6:0/3787178475 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa830051c40 con 0x7fa83c153ad0 2023-10-06T02:29:59.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.031+0000 7fa842044700 1 -- 172.21.15.6:0/3787178475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_object_deletion"]} v 0) v1 -- 0x7fa83c0c24e0 con 0x7fa83c153ad0 2023-10-06T02:29:59.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.261+0000 7fa8397fa700 1 -- 172.21.15.6:0/3787178475 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_object_deletion"]}]=0 v614) v1 ==== 135+0+0 (secure 0 0 0) 0x7fa830055260 con 0x7fa83c153ad0 2023-10-06T02:29:59.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.263+0000 7fa842044700 1 -- 172.21.15.6:0/3787178475 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa828066f30 msgr2=0x7fa8280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:59.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.263+0000 7fa842044700 1 --2- 172.21.15.6:0/3787178475 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa828066f30 0x7fa8280693e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fa83c068140 tx=0x7fa834017000 comp rx=0 tx=0).stop 2023-10-06T02:29:59.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.263+0000 7fa842044700 1 -- 172.21.15.6:0/3787178475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa83c153ad0 msgr2=0x7fa83c151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:59.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.263+0000 7fa842044700 1 --2- 172.21.15.6:0/3787178475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa83c153ad0 0x7fa83c151d60 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7fa83000d890 tx=0x7fa830008040 comp rx=0 tx=0).stop 2023-10-06T02:29:59.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.263+0000 7fa842044700 1 -- 172.21.15.6:0/3787178475 shutdown_connections 2023-10-06T02:29:59.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.263+0000 7fa842044700 1 --2- 172.21.15.6:0/3787178475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa83c156be0 0x7fa83c0ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:59.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.263+0000 7fa842044700 1 --2- 172.21.15.6:0/3787178475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83c0cd350 0x7fa83c0c2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:59.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.263+0000 7fa842044700 1 --2- 172.21.15.6:0/3787178475 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa828066f30 0x7fa8280693e0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:59.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.263+0000 7fa842044700 1 --2- 172.21.15.6:0/3787178475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa83c153ad0 0x7fa83c151d60 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:59.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.263+0000 7fa842044700 1 -- 172.21.15.6:0/3787178475 >> 172.21.15.6:0/3787178475 conn(0x7fa83c06b320 msgr2=0x7fa83c0ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:59.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.263+0000 7fa842044700 1 -- 172.21.15.6:0/3787178475 shutdown_connections 2023-10-06T02:29:59.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.263+0000 7fa842044700 1 -- 172.21.15.6:0/3787178475 wait complete. 2023-10-06T02:29:59.278 INFO:tasks.cephfs_test_runner:That the MDS has a clean 'damaged' response to loss of any single metadata object ... ok 2023-10-06T02:29:59.278 INFO:tasks.cephfs_test_runner:Starting test: test_open_ino_errors (tasks.cephfs.test_damage.TestDamage) That errors encountered during opening inos are properly propagated 2023-10-06T02:29:59.278 INFO:tasks.cephfs_test_runner:test_open_ino_errors (tasks.cephfs.test_damage.TestDamage) 2023-10-06T02:29:59.279 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors' 2023-10-06T02:29:59.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.396+0000 7f147a279700 1 Processor -- start 2023-10-06T02:29:59.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.396+0000 7f147a279700 1 -- start start 2023-10-06T02:29:59.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.397+0000 7f147a279700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1474159400 0x7f14740ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:59.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.397+0000 7f147a279700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14740cd030 0x7f14740cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:59.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.397+0000 7f147a279700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14740b3560 con 0x7f14740cf1a0 2023-10-06T02:29:59.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.397+0000 7f147a279700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14740cf6f0 con 0x7f14740cd030 2023-10-06T02:29:59.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.397+0000 7f147a279700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14740cf9d0 con 0x7f1474159400 2023-10-06T02:29:59.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.397+0000 7f1478a76700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14740cd030 0x7f14740cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:59.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.397+0000 7f1478a76700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14740cd030 0x7f14740cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42422/0 (socket says 172.21.15.6:42422) 2023-10-06T02:29:59.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.397+0000 7f1478a76700 1 -- 172.21.15.6:0/1047665164 learned_addr learned my addr 172.21.15.6:0/1047665164 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:59.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.397+0000 7f1479277700 1 --2- 172.21.15.6:0/1047665164 >> v2:172.21.15.175:3300/0 conn(0x7f1474159400 0x7f14740ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.398+0000 7f1478a76700 1 -- 172.21.15.6:0/1047665164 >> v2:172.21.15.175:3300/0 conn(0x7f1474159400 msgr2=0x7f14740ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.398+0000 7f1478a76700 1 --2- 172.21.15.6:0/1047665164 >> v2:172.21.15.175:3300/0 conn(0x7f1474159400 0x7f14740ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.398+0000 7f1478a76700 1 -- 172.21.15.6:0/1047665164 >> v1:172.21.15.175:6789/0 conn(0x7f14740cf1a0 legacy=0x7f14740b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.398+0000 7f1478a76700 1 -- 172.21.15.6:0/1047665164 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14740b2f10 con 0x7f14740cd030 2023-10-06T02:29:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.398+0000 7f1478a76700 1 --2- 172.21.15.6:0/1047665164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14740cd030 0x7f14740cfec0 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7f1474067fc0 tx=0x7f1468009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a34c75075a774 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.398+0000 7f1473fff700 1 -- 172.21.15.6:0/1047665164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146800b820 con 0x7f14740cd030 2023-10-06T02:29:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.398+0000 7f1473fff700 1 -- 172.21.15.6:0/1047665164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146800b980 con 0x7f14740cd030 2023-10-06T02:29:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.398+0000 7f1473fff700 1 -- 172.21.15.6:0/1047665164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146800bd20 con 0x7f14740cd030 2023-10-06T02:29:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.398+0000 7f147a279700 1 -- 172.21.15.6:0/1047665164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14740cd030 msgr2=0x7f14740cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.398+0000 7f147a279700 1 --2- 172.21.15.6:0/1047665164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14740cd030 0x7f14740cfec0 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7f1474067fc0 tx=0x7f1468009250 comp rx=0 tx=0).stop 2023-10-06T02:29:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.398+0000 7f147a279700 1 -- 172.21.15.6:0/1047665164 shutdown_connections 2023-10-06T02:29:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.398+0000 7f147a279700 1 --2- 172.21.15.6:0/1047665164 >> v2:172.21.15.175:3300/0 conn(0x7f1474159400 0x7f14740ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.398+0000 7f147a279700 1 --2- 172.21.15.6:0/1047665164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14740cd030 0x7f14740cfec0 unknown :-1 s=CLOSED pgs=2356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.398+0000 7f147a279700 1 -- 172.21.15.6:0/1047665164 >> 172.21.15.6:0/1047665164 conn(0x7f147406ac10 msgr2=0x7f1474068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.399+0000 7f147a279700 1 -- 172.21.15.6:0/1047665164 shutdown_connections 2023-10-06T02:29:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.399+0000 7f147a279700 1 -- 172.21.15.6:0/1047665164 wait complete. 2023-10-06T02:29:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.400+0000 7f147a279700 1 Processor -- start 2023-10-06T02:29:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.400+0000 7f147a279700 1 -- start start 2023-10-06T02:29:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.400+0000 7f147a279700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14740cd030 0x7f147415a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.400+0000 7f147a279700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14740cf1a0 0x7f1474154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.400+0000 7f147a279700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1474159400 0x7f14740c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f147a279700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147415aa10 con 0x7f14740cd030 2023-10-06T02:29:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f147a279700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14740c9980 con 0x7f14740cf1a0 2023-10-06T02:29:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f147a279700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14740ca500 con 0x7f1474159400 2023-10-06T02:29:59.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f1479277700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14740cd030 0x7f147415a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:59.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f1479277700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14740cd030 0x7f147415a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42426/0 (socket says 172.21.15.6:42426) 2023-10-06T02:29:59.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f1479277700 1 -- 172.21.15.6:0/2187653875 learned_addr learned my addr 172.21.15.6:0/2187653875 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:29:59.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f1478a76700 1 --2- 172.21.15.6:0/2187653875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14740cf1a0 0x7f1474154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:59.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f1479a78700 1 --2- 172.21.15.6:0/2187653875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1474159400 0x7f14740c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:59.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f1479277700 1 -- 172.21.15.6:0/2187653875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1474159400 msgr2=0x7f14740c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:59.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f1479277700 1 --2- 172.21.15.6:0/2187653875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1474159400 0x7f14740c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:59.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f1479277700 1 -- 172.21.15.6:0/2187653875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14740cf1a0 msgr2=0x7f1474154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:59.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f1479277700 1 --2- 172.21.15.6:0/2187653875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14740cf1a0 0x7f1474154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:59.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f1479277700 1 -- 172.21.15.6:0/2187653875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14680094f0 con 0x7f14740cd030 2023-10-06T02:29:59.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f1479a78700 1 --2- 172.21.15.6:0/2187653875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1474159400 0x7f14740c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:59.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f1479277700 1 --2- 172.21.15.6:0/2187653875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14740cd030 0x7f147415a390 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f146c00c880 tx=0x7f146c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:59.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f14717fa700 1 -- 172.21.15.6:0/2187653875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c011600 con 0x7f14740cd030 2023-10-06T02:29:59.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f147a279700 1 -- 172.21.15.6:0/2187653875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14740c9bd0 con 0x7f14740cd030 2023-10-06T02:29:59.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f14717fa700 1 -- 172.21.15.6:0/2187653875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c011760 con 0x7f14740cd030 2023-10-06T02:29:59.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f14717fa700 1 -- 172.21.15.6:0/2187653875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c011b60 con 0x7f14740cd030 2023-10-06T02:29:59.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.401+0000 7f147a279700 1 -- 172.21.15.6:0/2187653875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14740ca190 con 0x7f14740cd030 2023-10-06T02:29:59.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.402+0000 7f147a279700 1 -- 172.21.15.6:0/2187653875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1474159850 con 0x7f14740cd030 2023-10-06T02:29:59.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.403+0000 7f14717fa700 1 -- 172.21.15.6:0/2187653875 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f146c0223a0 con 0x7f14740cd030 2023-10-06T02:29:59.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.403+0000 7f14717fa700 1 --2- 172.21.15.6:0/2187653875 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1460066f30 0x7f14600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:59.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.403+0000 7f14717fa700 1 -- 172.21.15.6:0/2187653875 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 8966+0+0 (secure 0 0 0) 0x7f146c085300 con 0x7f14740cd030 2023-10-06T02:29:59.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.403+0000 7f1478a76700 1 --2- 172.21.15.6:0/2187653875 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1460066f30 0x7f14600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:59.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.404+0000 7f1478a76700 1 --2- 172.21.15.6:0/2187653875 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1460066f30 0x7f14600693e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1474067fc0 tx=0x7f1468016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:59.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.407+0000 7f14717fa700 1 -- 172.21.15.6:0/2187653875 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f146c051810 con 0x7f14740cd030 2023-10-06T02:29:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:29:59.682+0000 7f147a279700 1 -- 172.21.15.6:0/2187653875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors"]} v 0) v1 -- 0x7f14740b31f0 con 0x7f14740cd030 2023-10-06T02:30:00.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.262+0000 7f14717fa700 1 -- 172.21.15.6:0/2187653875 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors"]}]=0 v615) v1 ==== 138+0+0 (secure 0 0 0) 0x7f146c01e0d0 con 0x7f14740cd030 2023-10-06T02:30:00.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.265+0000 7f147a279700 1 -- 172.21.15.6:0/2187653875 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1460066f30 msgr2=0x7f14600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:00.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.265+0000 7f147a279700 1 --2- 172.21.15.6:0/2187653875 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1460066f30 0x7f14600693e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1474067fc0 tx=0x7f1468016000 comp rx=0 tx=0).stop 2023-10-06T02:30:00.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.265+0000 7f147a279700 1 -- 172.21.15.6:0/2187653875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14740cd030 msgr2=0x7f147415a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:00.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.265+0000 7f147a279700 1 --2- 172.21.15.6:0/2187653875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14740cd030 0x7f147415a390 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f146c00c880 tx=0x7f146c008040 comp rx=0 tx=0).stop 2023-10-06T02:30:00.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.265+0000 7f147a279700 1 -- 172.21.15.6:0/2187653875 shutdown_connections 2023-10-06T02:30:00.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.265+0000 7f147a279700 1 --2- 172.21.15.6:0/2187653875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1474159400 0x7f14740c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.265+0000 7f147a279700 1 --2- 172.21.15.6:0/2187653875 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1460066f30 0x7f14600693e0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.265+0000 7f147a279700 1 --2- 172.21.15.6:0/2187653875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14740cd030 0x7f147415a390 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.265+0000 7f147a279700 1 --2- 172.21.15.6:0/2187653875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14740cf1a0 0x7f1474154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.265+0000 7f147a279700 1 -- 172.21.15.6:0/2187653875 >> 172.21.15.6:0/2187653875 conn(0x7f147406ac10 msgr2=0x7f14740af060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:00.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.265+0000 7f147a279700 1 -- 172.21.15.6:0/2187653875 shutdown_connections 2023-10-06T02:30:00.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.265+0000 7f147a279700 1 -- 172.21.15.6:0/2187653875 wait complete. 2023-10-06T02:30:00.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:30:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.408+0000 7f6552597700 1 Processor -- start 2023-10-06T02:30:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.408+0000 7f6552597700 1 -- start start 2023-10-06T02:30:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.409+0000 7f6552597700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f654c0cd400 0x7f654c0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.409+0000 7f6552597700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f654c0b0810 0x7f654c0b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.409+0000 7f6552597700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654c0b29a0 con 0x7f654c0cd7d0 2023-10-06T02:30:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.409+0000 7f6552597700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654c0af770 con 0x7f654c0b0810 2023-10-06T02:30:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.409+0000 7f6552597700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0afa50 con 0x7f654c0cd400 2023-10-06T02:30:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.409+0000 7f6551d96700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f654c0b0810 0x7f654c0b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:00.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.409+0000 7f6551d96700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f654c0b0810 0x7f654c0b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42428/0 (socket says 172.21.15.6:42428) 2023-10-06T02:30:00.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.409+0000 7f6551d96700 1 -- 172.21.15.6:0/2151948981 learned_addr learned my addr 172.21.15.6:0/2151948981 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:00.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.409+0000 7f6551595700 1 --2- 172.21.15.6:0/2151948981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f654c0cd400 0x7f654c0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:00.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.409+0000 7f6551d96700 1 -- 172.21.15.6:0/2151948981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f654c0cd400 msgr2=0x7f654c0b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:00.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.409+0000 7f6551d96700 1 --2- 172.21.15.6:0/2151948981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f654c0cd400 0x7f654c0b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.409+0000 7f6551d96700 1 -- 172.21.15.6:0/2151948981 >> v1:172.21.15.175:6789/0 conn(0x7f654c0cd7d0 legacy=0x7f654c0d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:00.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.409+0000 7f6551d96700 1 -- 172.21.15.6:0/2151948981 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c0afd30 con 0x7f654c0b0810 2023-10-06T02:30:00.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.410+0000 7f6551d96700 1 --2- 172.21.15.6:0/2151948981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f654c0b0810 0x7f654c0b2460 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f6544009f20 tx=0x7f6544009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909f1361b4e8de92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:00.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.410+0000 7f6543fff700 1 -- 172.21.15.6:0/2151948981 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654400e070 con 0x7f654c0b0810 2023-10-06T02:30:00.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.410+0000 7f6543fff700 1 -- 172.21.15.6:0/2151948981 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654400b9d0 con 0x7f654c0b0810 2023-10-06T02:30:00.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.410+0000 7f6543fff700 1 -- 172.21.15.6:0/2151948981 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65440092e0 con 0x7f654c0b0810 2023-10-06T02:30:00.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.410+0000 7f6552597700 1 -- 172.21.15.6:0/2151948981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f654c0b0810 msgr2=0x7f654c0b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:00.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.410+0000 7f6552597700 1 --2- 172.21.15.6:0/2151948981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f654c0b0810 0x7f654c0b2460 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f6544009f20 tx=0x7f6544009840 comp rx=0 tx=0).stop 2023-10-06T02:30:00.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.410+0000 7f6552597700 1 -- 172.21.15.6:0/2151948981 shutdown_connections 2023-10-06T02:30:00.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.410+0000 7f6552597700 1 --2- 172.21.15.6:0/2151948981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f654c0b0810 0x7f654c0b2460 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.410+0000 7f6552597700 1 --2- 172.21.15.6:0/2151948981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f654c0cd400 0x7f654c0b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.410+0000 7f6552597700 1 -- 172.21.15.6:0/2151948981 >> 172.21.15.6:0/2151948981 conn(0x7f654c06a110 msgr2=0x7f654c06a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:00.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.410+0000 7f6552597700 1 -- 172.21.15.6:0/2151948981 shutdown_connections 2023-10-06T02:30:00.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.410+0000 7f6552597700 1 -- 172.21.15.6:0/2151948981 wait complete. 2023-10-06T02:30:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.411+0000 7f6552597700 1 Processor -- start 2023-10-06T02:30:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.411+0000 7f6552597700 1 -- start start 2023-10-06T02:30:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.412+0000 7f6552597700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f654c0b0810 0x7f654c159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.412+0000 7f6552597700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f654c0cd400 0x7f654c0c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.412+0000 7f6552597700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f654c154940 0x7f654c0b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.412+0000 7f6552597700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0c4140 con 0x7f654c0cd400 2023-10-06T02:30:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.412+0000 7f6552597700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c15a650 con 0x7f654c154940 2023-10-06T02:30:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.412+0000 7f6552597700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654c15a930 con 0x7f654c0b0810 2023-10-06T02:30:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.412+0000 7f6550d94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f654c0cd400 0x7f654c0c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.412+0000 7f6550d94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f654c0cd400 0x7f654c0c3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42438/0 (socket says 172.21.15.6:42438) 2023-10-06T02:30:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.412+0000 7f6550d94700 1 -- 172.21.15.6:0/2859654204 learned_addr learned my addr 172.21.15.6:0/2859654204 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.412+0000 7f6551595700 1 --2- 172.21.15.6:0/2859654204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f654c0b0810 0x7f654c159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.413+0000 7f6551d96700 1 --2- 172.21.15.6:0/2859654204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f654c154940 0x7f654c0b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.413+0000 7f6550d94700 1 -- 172.21.15.6:0/2859654204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f654c0b0810 msgr2=0x7f654c159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.413+0000 7f6550d94700 1 --2- 172.21.15.6:0/2859654204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f654c0b0810 0x7f654c159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.413+0000 7f6550d94700 1 -- 172.21.15.6:0/2859654204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f654c154940 msgr2=0x7f654c0b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.413+0000 7f6550d94700 1 --2- 172.21.15.6:0/2859654204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f654c154940 0x7f654c0b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.413+0000 7f6550d94700 1 -- 172.21.15.6:0/2859654204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6544009ae0 con 0x7f654c0cd400 2023-10-06T02:30:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.413+0000 7f6550d94700 1 --2- 172.21.15.6:0/2859654204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f654c0cd400 0x7f654c0c3c00 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7f654800c590 tx=0x7f654800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.413+0000 7f65417fa700 1 -- 172.21.15.6:0/2859654204 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548011590 con 0x7f654c0cd400 2023-10-06T02:30:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.413+0000 7f65417fa700 1 -- 172.21.15.6:0/2859654204 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6548011710 con 0x7f654c0cd400 2023-10-06T02:30:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.413+0000 7f6552597700 1 -- 172.21.15.6:0/2859654204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654c15ac10 con 0x7f654c0cd400 2023-10-06T02:30:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.413+0000 7f65417fa700 1 -- 172.21.15.6:0/2859654204 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548011ad0 con 0x7f654c0cd400 2023-10-06T02:30:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.413+0000 7f6552597700 1 -- 172.21.15.6:0/2859654204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654c15b1d0 con 0x7f654c0cd400 2023-10-06T02:30:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.414+0000 7f6552597700 1 -- 172.21.15.6:0/2859654204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654c064aa0 con 0x7f654c0cd400 2023-10-06T02:30:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.414+0000 7f65417fa700 1 -- 172.21.15.6:0/2859654204 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f654801b3b0 con 0x7f654c0cd400 2023-10-06T02:30:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.415+0000 7f65417fa700 1 --2- 172.21.15.6:0/2859654204 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6530066f30 0x7f65300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.415+0000 7f65417fa700 1 -- 172.21.15.6:0/2859654204 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 8966+0+0 (secure 0 0 0) 0x7f65480844f0 con 0x7f654c0cd400 2023-10-06T02:30:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.415+0000 7f6551595700 1 --2- 172.21.15.6:0/2859654204 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6530066f30 0x7f65300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.416+0000 7f6551595700 1 --2- 172.21.15.6:0/2859654204 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6530066f30 0x7f65300693e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f653c009da0 tx=0x7f653c009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.419+0000 7f65417fa700 1 -- 172.21.15.6:0/2859654204 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6548050a60 con 0x7f654c0cd400 2023-10-06T02:30:00.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.611+0000 7f6552597700 1 -- 172.21.15.6:0/2859654204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f654c0b29a0 con 0x7f654c0cd400 2023-10-06T02:30:00.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.615+0000 7f65417fa700 1 -- 172.21.15.6:0/2859654204 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f654c0b29a0 con 0x7f654c0cd400 2023-10-06T02:30:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.617+0000 7f6552597700 1 -- 172.21.15.6:0/2859654204 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6530066f30 msgr2=0x7f65300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.617+0000 7f6552597700 1 --2- 172.21.15.6:0/2859654204 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6530066f30 0x7f65300693e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f653c009da0 tx=0x7f653c009120 comp rx=0 tx=0).stop 2023-10-06T02:30:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.617+0000 7f6552597700 1 -- 172.21.15.6:0/2859654204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f654c0cd400 msgr2=0x7f654c0c3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.617+0000 7f6552597700 1 --2- 172.21.15.6:0/2859654204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f654c0cd400 0x7f654c0c3c00 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7f654800c590 tx=0x7f654800c8a0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.617+0000 7f6552597700 1 -- 172.21.15.6:0/2859654204 shutdown_connections 2023-10-06T02:30:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.617+0000 7f6552597700 1 --2- 172.21.15.6:0/2859654204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f654c154940 0x7f654c0b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.617+0000 7f6552597700 1 --2- 172.21.15.6:0/2859654204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f654c0b0810 0x7f654c159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.617+0000 7f6552597700 1 --2- 172.21.15.6:0/2859654204 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6530066f30 0x7f65300693e0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.617+0000 7f6552597700 1 --2- 172.21.15.6:0/2859654204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f654c0cd400 0x7f654c0c3c00 unknown :-1 s=CLOSED pgs=2359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.617+0000 7f6552597700 1 -- 172.21.15.6:0/2859654204 >> 172.21.15.6:0/2859654204 conn(0x7f654c06a110 msgr2=0x7f654c0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.617+0000 7f6552597700 1 -- 172.21.15.6:0/2859654204 shutdown_connections 2023-10-06T02:30:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.617+0000 7f6552597700 1 -- 172.21.15.6:0/2859654204 wait complete. 2023-10-06T02:30:00.631 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:30:00.631 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:30:00.676 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:30:00.725 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:30:00.725 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:30:00.725 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:30:00.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.843+0000 7f193745c700 1 Processor -- start 2023-10-06T02:30:00.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.843+0000 7f193745c700 1 -- start start 2023-10-06T02:30:00.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.844+0000 7f193745c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1930159400 0x7f19300ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:00.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.844+0000 7f193745c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19300cd030 0x7f19300cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:00.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.844+0000 7f193745c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19300b3560 con 0x7f19300cf1a0 2023-10-06T02:30:00.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.844+0000 7f193745c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19300cf6f0 con 0x7f1930159400 2023-10-06T02:30:00.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.844+0000 7f193745c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19300cf9d0 con 0x7f19300cd030 2023-10-06T02:30:00.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.844+0000 7f193645a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1930159400 0x7f19300ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:00.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.844+0000 7f193645a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1930159400 0x7f19300ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42450/0 (socket says 172.21.15.6:42450) 2023-10-06T02:30:00.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.844+0000 7f193645a700 1 -- 172.21.15.6:0/393203629 learned_addr learned my addr 172.21.15.6:0/393203629 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:00.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.844+0000 7f1935c59700 1 --2- 172.21.15.6:0/393203629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19300cd030 0x7f19300cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:00.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.844+0000 7f193645a700 1 -- 172.21.15.6:0/393203629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19300cd030 msgr2=0x7f19300cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:00.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.844+0000 7f193645a700 1 --2- 172.21.15.6:0/393203629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19300cd030 0x7f19300cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.844+0000 7f193645a700 1 -- 172.21.15.6:0/393203629 >> v1:172.21.15.175:6789/0 conn(0x7f19300cf1a0 legacy=0x7f19300b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:00.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.844+0000 7f193645a700 1 -- 172.21.15.6:0/393203629 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19300b2f10 con 0x7f1930159400 2023-10-06T02:30:00.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.845+0000 7f193645a700 1 --2- 172.21.15.6:0/393203629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1930159400 0x7f19300ccaf0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f1928009990 tx=0x7f1928009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e9f013097ad25a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:00.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.845+0000 7f1935458700 1 -- 172.21.15.6:0/393203629 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1928005c10 con 0x7f1930159400 2023-10-06T02:30:00.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.845+0000 7f1935458700 1 -- 172.21.15.6:0/393203629 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1928005d70 con 0x7f1930159400 2023-10-06T02:30:00.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.845+0000 7f1935458700 1 -- 172.21.15.6:0/393203629 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192800b840 con 0x7f1930159400 2023-10-06T02:30:00.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.845+0000 7f193745c700 1 -- 172.21.15.6:0/393203629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1930159400 msgr2=0x7f19300ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:00.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.845+0000 7f193745c700 1 --2- 172.21.15.6:0/393203629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1930159400 0x7f19300ccaf0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f1928009990 tx=0x7f1928009220 comp rx=0 tx=0).stop 2023-10-06T02:30:00.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.845+0000 7f193745c700 1 -- 172.21.15.6:0/393203629 shutdown_connections 2023-10-06T02:30:00.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.845+0000 7f193745c700 1 --2- 172.21.15.6:0/393203629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1930159400 0x7f19300ccaf0 unknown :-1 s=CLOSED pgs=2360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.845+0000 7f193745c700 1 --2- 172.21.15.6:0/393203629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19300cd030 0x7f19300cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.845+0000 7f193745c700 1 -- 172.21.15.6:0/393203629 >> 172.21.15.6:0/393203629 conn(0x7f193006ac10 msgr2=0x7f1930068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:00.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.845+0000 7f193745c700 1 -- 172.21.15.6:0/393203629 shutdown_connections 2023-10-06T02:30:00.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.845+0000 7f193745c700 1 -- 172.21.15.6:0/393203629 wait complete. 2023-10-06T02:30:00.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.847+0000 7f193745c700 1 Processor -- start 2023-10-06T02:30:00.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.847+0000 7f193745c700 1 -- start start 2023-10-06T02:30:00.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.847+0000 7f193745c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19300cd030 0x7f1930141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:00.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.847+0000 7f193745c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19300cf1a0 0x7f19301507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:00.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.847+0000 7f193745c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1930159400 0x7f1930154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:00.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.847+0000 7f193745c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1930151010 con 0x7f19300cd030 2023-10-06T02:30:00.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.847+0000 7f193745c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19301512f0 con 0x7f19300cf1a0 2023-10-06T02:30:00.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.847+0000 7f193745c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19301515d0 con 0x7f1930159400 2023-10-06T02:30:00.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.847+0000 7f193645a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19300cd030 0x7f1930141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:00.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.847+0000 7f193645a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19300cd030 0x7f1930141d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42456/0 (socket says 172.21.15.6:42456) 2023-10-06T02:30:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.847+0000 7f193645a700 1 -- 172.21.15.6:0/789982720 learned_addr learned my addr 172.21.15.6:0/789982720 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.848+0000 7f193645a700 1 -- 172.21.15.6:0/789982720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1930159400 msgr2=0x7f1930154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.848+0000 7f193645a700 1 --2- 172.21.15.6:0/789982720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1930159400 0x7f1930154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.848+0000 7f193645a700 1 -- 172.21.15.6:0/789982720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19300cf1a0 msgr2=0x7f19301507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.848+0000 7f1935c59700 1 --2- 172.21.15.6:0/789982720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19300cf1a0 0x7f19301507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.848+0000 7f193645a700 1 --2- 172.21.15.6:0/789982720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19300cf1a0 0x7f19301507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.848+0000 7f193645a700 1 -- 172.21.15.6:0/789982720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1928009480 con 0x7f19300cd030 2023-10-06T02:30:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.848+0000 7f193645a700 1 --2- 172.21.15.6:0/789982720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19300cd030 0x7f1930141d30 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f19280030c0 tx=0x7f1928015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.848+0000 7f192e7fc700 1 -- 172.21.15.6:0/789982720 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1928000cf0 con 0x7f19300cd030 2023-10-06T02:30:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.848+0000 7f192e7fc700 1 -- 172.21.15.6:0/789982720 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1928011cc0 con 0x7f19300cd030 2023-10-06T02:30:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.848+0000 7f193745c700 1 -- 172.21.15.6:0/789982720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19301518b0 con 0x7f19300cd030 2023-10-06T02:30:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.848+0000 7f192e7fc700 1 -- 172.21.15.6:0/789982720 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192801c690 con 0x7f19300cd030 2023-10-06T02:30:00.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.848+0000 7f193745c700 1 -- 172.21.15.6:0/789982720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1930150d00 con 0x7f19300cd030 2023-10-06T02:30:00.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.849+0000 7f193745c700 1 -- 172.21.15.6:0/789982720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1930159860 con 0x7f19300cd030 2023-10-06T02:30:00.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.849+0000 7f192e7fc700 1 -- 172.21.15.6:0/789982720 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f192801ca80 con 0x7f19300cd030 2023-10-06T02:30:00.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.850+0000 7f192e7fc700 1 --2- 172.21.15.6:0/789982720 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f191c066f30 0x7f191c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:00.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.850+0000 7f192e7fc700 1 -- 172.21.15.6:0/789982720 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 8966+0+0 (secure 0 0 0) 0x7f1928087130 con 0x7f19300cd030 2023-10-06T02:30:00.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.850+0000 7f1935c59700 1 --2- 172.21.15.6:0/789982720 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f191c066f30 0x7f191c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:00.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.850+0000 7f1935c59700 1 --2- 172.21.15.6:0/789982720 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f191c066f30 0x7f191c0693e0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f193015e960 tx=0x7f1924008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:00.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:00.854+0000 7f192e7fc700 1 -- 172.21.15.6:0/789982720 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19280536a0 con 0x7f19300cd030 2023-10-06T02:30:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.095+0000 7f193745c700 1 -- 172.21.15.6:0/789982720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19300b31f0 con 0x7f19300cd030 2023-10-06T02:30:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.095+0000 7f192e7fc700 1 -- 172.21.15.6:0/789982720 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 353 v353) v1 ==== 95+0+3532 (secure 0 0 0) 0x7f1928056cc0 con 0x7f19300cd030 2023-10-06T02:30:01.097 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:01.097 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":353,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2295758531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2295758531},{"type":"v1","addr":"172.21.15.175:6835","nonce":2295758531}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1921175819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1921175819},{"type":"v1","addr":"172.21.15.175:6837","nonce":1921175819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1895260060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1895260060},{"type":"v1","addr":"172.21.15.6:6834","nonce":1895260060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":10713,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2434594072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2434594072},{"type":"v1","addr":"172.21.15.6:6835","nonce":2434594072}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":351}],"filesystems":[]} 2023-10-06T02:30:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.098+0000 7f193745c700 1 -- 172.21.15.6:0/789982720 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f191c066f30 msgr2=0x7f191c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.098+0000 7f193745c700 1 --2- 172.21.15.6:0/789982720 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f191c066f30 0x7f191c0693e0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f193015e960 tx=0x7f1924008040 comp rx=0 tx=0).stop 2023-10-06T02:30:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.098+0000 7f193745c700 1 -- 172.21.15.6:0/789982720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19300cd030 msgr2=0x7f1930141d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.098+0000 7f193745c700 1 --2- 172.21.15.6:0/789982720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19300cd030 0x7f1930141d30 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f19280030c0 tx=0x7f1928015000 comp rx=0 tx=0).stop 2023-10-06T02:30:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.098+0000 7f193745c700 1 -- 172.21.15.6:0/789982720 shutdown_connections 2023-10-06T02:30:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.098+0000 7f193745c700 1 --2- 172.21.15.6:0/789982720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1930159400 0x7f1930154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.098+0000 7f193745c700 1 --2- 172.21.15.6:0/789982720 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f191c066f30 0x7f191c0693e0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.098+0000 7f193745c700 1 --2- 172.21.15.6:0/789982720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19300cd030 0x7f1930141d30 unknown :-1 s=CLOSED pgs=2361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.098+0000 7f193745c700 1 --2- 172.21.15.6:0/789982720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19300cf1a0 0x7f19301507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.098+0000 7f193745c700 1 -- 172.21.15.6:0/789982720 >> 172.21.15.6:0/789982720 conn(0x7f193006ac10 msgr2=0x7f19300b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.098+0000 7f193745c700 1 -- 172.21.15.6:0/789982720 shutdown_connections 2023-10-06T02:30:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.098+0000 7f193745c700 1 -- 172.21.15.6:0/789982720 wait complete. 2023-10-06T02:30:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 353 2023-10-06T02:30:01.112 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:30:01.112 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:30:01.112 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:30:01.112 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:30:01.112 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:30:01.112 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:30:01.113 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:30:01.113 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:30:01.113 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:30:01.113 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:30:01.113 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:30:01.113 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:30:01.114 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:30:01.114 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:30:01.114 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:30:01.114 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:30:01.121 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:30:01.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:30:01.122 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:30:01.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:30:01.125 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:30:01.125 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:30:01.125 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:30:01.126 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:30:01.164 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:30:01.164 DEBUG:teuthology.parallel:result is None 2023-10-06T02:30:01.164 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:30:01.165 DEBUG:teuthology.parallel:result is None 2023-10-06T02:30:01.167 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:30:01.167 DEBUG:teuthology.parallel:result is None 2023-10-06T02:30:01.168 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:30:01.168 DEBUG:teuthology.parallel:result is None 2023-10-06T02:30:01.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:30:01.239 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-06T02:30:01.239 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-06T02:30:01.251 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-10-06T02:30:01.251 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-10-06T02:30:01.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.299+0000 7efd4e017700 1 Processor -- start 2023-10-06T02:30:01.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.299+0000 7efd4e017700 1 -- start start 2023-10-06T02:30:01.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd4e017700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd48086ff0 0x7efd48087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:01.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd4e017700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efd480b21b0 0x7efd480b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:01.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd4e017700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd480b2b70 con 0x7efd4815a030 2023-10-06T02:30:01.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd4e017700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd480b0cf0 con 0x7efd480b21b0 2023-10-06T02:30:01.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd4e017700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd480879b0 con 0x7efd48086ff0 2023-10-06T02:30:01.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd477fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efd4815a030 0x7efd4815a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46528/0 (socket says 172.21.15.6:46528) 2023-10-06T02:30:01.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd477fe700 1 -- 172.21.15.6:0/961358860 learned_addr learned my addr 172.21.15.6:0/961358860 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:01.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd47fff700 1 --2- 172.21.15.6:0/961358860 >> v2:172.21.15.6:3300/0 conn(0x7efd480b21b0 0x7efd480b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:01.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd46ffd700 1 --2- 172.21.15.6:0/961358860 >> v2:172.21.15.175:3300/0 conn(0x7efd48086ff0 0x7efd48087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:01.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd47fff700 1 -- 172.21.15.6:0/961358860 >> v2:172.21.15.175:3300/0 conn(0x7efd48086ff0 msgr2=0x7efd48087470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:01.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd47fff700 1 --2- 172.21.15.6:0/961358860 >> v2:172.21.15.175:3300/0 conn(0x7efd48086ff0 0x7efd48087470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:01.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd47fff700 1 -- 172.21.15.6:0/961358860 >> v1:172.21.15.6:6789/0 conn(0x7efd4815a030 legacy=0x7efd4815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:01.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd47fff700 1 -- 172.21.15.6:0/961358860 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd480afc50 con 0x7efd480b21b0 2023-10-06T02:30:01.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd467fc700 1 -- 172.21.15.6:0/961358860 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674870323 0 0) 0x7efd480b2b70 con 0x7efd4815a030 2023-10-06T02:30:01.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd47fff700 1 --2- 172.21.15.6:0/961358860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd480b21b0 0x7efd480b2630 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7efd480b1fa0 tx=0x7efd40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42babfa6da4b281 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:01.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd467fc700 1 -- 172.21.15.6:0/961358860 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4000e070 con 0x7efd480b21b0 2023-10-06T02:30:01.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd467fc700 1 -- 172.21.15.6:0/961358860 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4000bbf0 con 0x7efd480b21b0 2023-10-06T02:30:01.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.300+0000 7efd467fc700 1 -- 172.21.15.6:0/961358860 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40012430 con 0x7efd480b21b0 2023-10-06T02:30:01.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.301+0000 7efd4e017700 1 -- 172.21.15.6:0/961358860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd480b21b0 msgr2=0x7efd480b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:01.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.301+0000 7efd4e017700 1 --2- 172.21.15.6:0/961358860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd480b21b0 0x7efd480b2630 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7efd480b1fa0 tx=0x7efd40009780 comp rx=0 tx=0).stop 2023-10-06T02:30:01.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.301+0000 7efd4e017700 1 -- 172.21.15.6:0/961358860 shutdown_connections 2023-10-06T02:30:01.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.301+0000 7efd4e017700 1 --2- 172.21.15.6:0/961358860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd480b21b0 0x7efd480b2630 unknown :-1 s=CLOSED pgs=2370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:01.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.301+0000 7efd4e017700 1 --2- 172.21.15.6:0/961358860 >> v2:172.21.15.175:3300/0 conn(0x7efd48086ff0 0x7efd48087470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:01.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.301+0000 7efd4e017700 1 -- 172.21.15.6:0/961358860 >> 172.21.15.6:0/961358860 conn(0x7efd48068680 msgr2=0x7efd48068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:01.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.301+0000 7efd4e017700 1 -- 172.21.15.6:0/961358860 shutdown_connections 2023-10-06T02:30:01.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.301+0000 7efd4e017700 1 -- 172.21.15.6:0/961358860 wait complete. 2023-10-06T02:30:01.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.302+0000 7efd4e017700 1 Processor -- start 2023-10-06T02:30:01.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.302+0000 7efd4e017700 1 -- start start 2023-10-06T02:30:01.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.303+0000 7efd4e017700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd48086ff0 0x7efd480b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:01.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.303+0000 7efd4e017700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd480b21b0 0x7efd481559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:01.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.303+0000 7efd4e017700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd4815a030 0x7efd480c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:01.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.303+0000 7efd4e017700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd480c4c50 con 0x7efd480b21b0 2023-10-06T02:30:01.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.303+0000 7efd4e017700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd480b55d0 con 0x7efd4815a030 2023-10-06T02:30:01.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.303+0000 7efd4e017700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd480c4040 con 0x7efd48086ff0 2023-10-06T02:30:01.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.303+0000 7efd46ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd480b21b0 0x7efd481559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:01.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.303+0000 7efd46ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd480b21b0 0x7efd481559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42510/0 (socket says 172.21.15.6:42510) 2023-10-06T02:30:01.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.303+0000 7efd46ffd700 1 -- 172.21.15.6:0/3911147575 learned_addr learned my addr 172.21.15.6:0/3911147575 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:01.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.303+0000 7efd477fe700 1 --2- 172.21.15.6:0/3911147575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd48086ff0 0x7efd480b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:01.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.303+0000 7efd47fff700 1 --2- 172.21.15.6:0/3911147575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd4815a030 0x7efd480c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:01.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.303+0000 7efd46ffd700 1 -- 172.21.15.6:0/3911147575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd48086ff0 msgr2=0x7efd480b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:01.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.303+0000 7efd46ffd700 1 --2- 172.21.15.6:0/3911147575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd48086ff0 0x7efd480b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:01.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.303+0000 7efd46ffd700 1 -- 172.21.15.6:0/3911147575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd4815a030 msgr2=0x7efd480c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.303+0000 7efd46ffd700 1 --2- 172.21.15.6:0/3911147575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd4815a030 0x7efd480c50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.303+0000 7efd46ffd700 1 -- 172.21.15.6:0/3911147575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd40009a20 con 0x7efd480b21b0 2023-10-06T02:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.304+0000 7efd46ffd700 1 --2- 172.21.15.6:0/3911147575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd480b21b0 0x7efd481559f0 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7efd3000d890 tx=0x7efd30008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.304+0000 7efd3f7fe700 1 -- 172.21.15.6:0/3911147575 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd300125f0 con 0x7efd480b21b0 2023-10-06T02:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.304+0000 7efd3f7fe700 1 -- 172.21.15.6:0/3911147575 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd30012750 con 0x7efd480b21b0 2023-10-06T02:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.304+0000 7efd4e017700 1 -- 172.21.15.6:0/3911147575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd480c4320 con 0x7efd480b21b0 2023-10-06T02:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.304+0000 7efd3f7fe700 1 -- 172.21.15.6:0/3911147575 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30012af0 con 0x7efd480b21b0 2023-10-06T02:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.304+0000 7efd4e017700 1 -- 172.21.15.6:0/3911147575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd480c48e0 con 0x7efd480b21b0 2023-10-06T02:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.305+0000 7efd4e017700 1 -- 172.21.15.6:0/3911147575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd480c4e00 con 0x7efd480b21b0 2023-10-06T02:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.305+0000 7efd3f7fe700 1 -- 172.21.15.6:0/3911147575 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd3001e460 con 0x7efd480b21b0 2023-10-06T02:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.306+0000 7efd3f7fe700 1 --2- 172.21.15.6:0/3911147575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efd28066f30 0x7efd280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.306+0000 7efd3f7fe700 1 -- 172.21.15.6:0/3911147575 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8966+0+0 (secure 0 0 0) 0x7efd30085760 con 0x7efd480b21b0 2023-10-06T02:30:01.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.306+0000 7efd477fe700 1 --2- 172.21.15.6:0/3911147575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efd28066f30 0x7efd280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:01.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.306+0000 7efd477fe700 1 --2- 172.21.15.6:0/3911147575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efd28066f30 0x7efd280693e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7efd38007160 tx=0x7efd38007f50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:01.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.310+0000 7efd3f7fe700 1 -- 172.21.15.6:0/3911147575 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd480c4e00 con 0x7efd480b21b0 2023-10-06T02:30:01.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:01.522+0000 7efd4e017700 1 -- 172.21.15.6:0/3911147575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7efd48155f90 con 0x7efd480b21b0 2023-10-06T02:30:02.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.291+0000 7efd3f7fe700 1 -- 172.21.15.6:0/3911147575 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v142) v1 ==== 97+0+0 (secure 0 0 0) 0x7efd30055760 con 0x7efd480b21b0 2023-10-06T02:30:02.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.293+0000 7efd4e017700 1 -- 172.21.15.6:0/3911147575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efd28066f30 msgr2=0x7efd280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:02.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.293+0000 7efd4e017700 1 --2- 172.21.15.6:0/3911147575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efd28066f30 0x7efd280693e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7efd38007160 tx=0x7efd38007f50 comp rx=0 tx=0).stop 2023-10-06T02:30:02.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.293+0000 7efd4e017700 1 -- 172.21.15.6:0/3911147575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd480b21b0 msgr2=0x7efd481559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:02.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.293+0000 7efd4e017700 1 --2- 172.21.15.6:0/3911147575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd480b21b0 0x7efd481559f0 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7efd3000d890 tx=0x7efd30008040 comp rx=0 tx=0).stop 2023-10-06T02:30:02.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.293+0000 7efd4e017700 1 -- 172.21.15.6:0/3911147575 shutdown_connections 2023-10-06T02:30:02.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.293+0000 7efd4e017700 1 --2- 172.21.15.6:0/3911147575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd4815a030 0x7efd480c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.293+0000 7efd4e017700 1 --2- 172.21.15.6:0/3911147575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd48086ff0 0x7efd480b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.293+0000 7efd4e017700 1 --2- 172.21.15.6:0/3911147575 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7efd28066f30 0x7efd280693e0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.293+0000 7efd4e017700 1 --2- 172.21.15.6:0/3911147575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd480b21b0 0x7efd481559f0 unknown :-1 s=CLOSED pgs=2371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.293+0000 7efd4e017700 1 -- 172.21.15.6:0/3911147575 >> 172.21.15.6:0/3911147575 conn(0x7efd48068680 msgr2=0x7efd481565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.293+0000 7efd4e017700 1 -- 172.21.15.6:0/3911147575 shutdown_connections 2023-10-06T02:30:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.293+0000 7efd4e017700 1 -- 172.21.15.6:0/3911147575 wait complete. 2023-10-06T02:30:02.297 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-10-06T02:30:02.309 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:30:02.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.431+0000 7f088de4b700 1 Processor -- start 2023-10-06T02:30:02.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.431+0000 7f088de4b700 1 -- start start 2023-10-06T02:30:02.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.432+0000 7f088de4b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08880af4e0 0x7f08880b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:02.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.432+0000 7f088de4b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f08880af8b0 0x7f08880b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:02.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.432+0000 7f088de4b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088815e190 con 0x7f088815d460 2023-10-06T02:30:02.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.432+0000 7f088de4b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08880b1910 con 0x7f08880af8b0 2023-10-06T02:30:02.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.432+0000 7f088de4b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088815dfb0 con 0x7f08880af4e0 2023-10-06T02:30:02.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.432+0000 7f08877fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08880af4e0 0x7f08880b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:02.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.432+0000 7f08877fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08880af4e0 0x7f08880b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:41830/0 (socket says 172.21.15.6:41830) 2023-10-06T02:30:02.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.432+0000 7f08877fe700 1 -- 172.21.15.6:0/2160064140 learned_addr learned my addr 172.21.15.6:0/2160064140 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:02.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.432+0000 7f0886ffd700 1 --2- 172.21.15.6:0/2160064140 >> v2:172.21.15.175:3300/0 conn(0x7f08880af8b0 0x7f08880b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:02.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.432+0000 7f08867fc700 1 -- 172.21.15.6:0/2160064140 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524942985 0 0) 0x7f088815e190 con 0x7f088815d460 2023-10-06T02:30:02.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.432+0000 7f08867fc700 1 -- 172.21.15.6:0/2160064140 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0874003570 con 0x7f088815d460 2023-10-06T02:30:02.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.432+0000 7f08877fe700 1 -- 172.21.15.6:0/2160064140 >> v2:172.21.15.175:3300/0 conn(0x7f08880af8b0 msgr2=0x7f08880b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:02.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.432+0000 7f08877fe700 1 --2- 172.21.15.6:0/2160064140 >> v2:172.21.15.175:3300/0 conn(0x7f08880af8b0 0x7f08880b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.432+0000 7f08877fe700 1 -- 172.21.15.6:0/2160064140 >> v1:172.21.15.175:6789/0 conn(0x7f088815d460 legacy=0x7f088815d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:02.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.432+0000 7f08877fe700 1 -- 172.21.15.6:0/2160064140 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08880cb650 con 0x7f08880af4e0 2023-10-06T02:30:02.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.432+0000 7f0886ffd700 1 --2- 172.21.15.6:0/2160064140 >> v2:172.21.15.175:3300/0 conn(0x7f08880af8b0 0x7f08880b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:30:02.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.433+0000 7f08877fe700 1 --2- 172.21.15.6:0/2160064140 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08880af4e0 0x7f08880b20e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f08780099b0 tx=0x7f0878009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85f7259fb1b3d390 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:02.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.433+0000 7f08867fc700 1 -- 172.21.15.6:0/2160064140 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087800b680 con 0x7f08880af4e0 2023-10-06T02:30:02.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.433+0000 7f08867fc700 1 -- 172.21.15.6:0/2160064140 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087800b7e0 con 0x7f08880af4e0 2023-10-06T02:30:02.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.433+0000 7f08867fc700 1 -- 172.21.15.6:0/2160064140 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087800bb80 con 0x7f08880af4e0 2023-10-06T02:30:02.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.433+0000 7f088de4b700 1 -- 172.21.15.6:0/2160064140 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08880af4e0 msgr2=0x7f08880b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:02.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.433+0000 7f088de4b700 1 --2- 172.21.15.6:0/2160064140 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08880af4e0 0x7f08880b20e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f08780099b0 tx=0x7f0878009250 comp rx=0 tx=0).stop 2023-10-06T02:30:02.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.433+0000 7f088de4b700 1 -- 172.21.15.6:0/2160064140 shutdown_connections 2023-10-06T02:30:02.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.433+0000 7f088de4b700 1 --2- 172.21.15.6:0/2160064140 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08880af4e0 0x7f08880b20e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.433+0000 7f088de4b700 1 --2- 172.21.15.6:0/2160064140 >> v2:172.21.15.175:3300/0 conn(0x7f08880af8b0 0x7f08880b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.433+0000 7f088de4b700 1 -- 172.21.15.6:0/2160064140 >> 172.21.15.6:0/2160064140 conn(0x7f0888068680 msgr2=0x7f0888068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:02.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.434+0000 7f088de4b700 1 -- 172.21.15.6:0/2160064140 shutdown_connections 2023-10-06T02:30:02.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.434+0000 7f088de4b700 1 -- 172.21.15.6:0/2160064140 wait complete. 2023-10-06T02:30:02.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.435+0000 7f088de4b700 1 Processor -- start 2023-10-06T02:30:02.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.435+0000 7f088de4b700 1 -- start start 2023-10-06T02:30:02.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.435+0000 7f088de4b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08880af4e0 0x7f088814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:02.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.435+0000 7f088de4b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08880af8b0 0x7f08880b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:02.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f088de4b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f088815d460 0x7f08881504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:02.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f088de4b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08880c8aa0 con 0x7f08880af8b0 2023-10-06T02:30:02.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f088de4b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088814f160 con 0x7f088815d460 2023-10-06T02:30:02.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f088de4b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08880b4840 con 0x7f08880af4e0 2023-10-06T02:30:02.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f0886ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08880af8b0 0x7f08880b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:02.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f0886ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08880af8b0 0x7f08880b3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42516/0 (socket says 172.21.15.6:42516) 2023-10-06T02:30:02.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f0886ffd700 1 -- 172.21.15.6:0/2003613912 learned_addr learned my addr 172.21.15.6:0/2003613912 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:02.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f08877fe700 1 --2- 172.21.15.6:0/2003613912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08880af4e0 0x7f088814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:02.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f0887fff700 1 --2- 172.21.15.6:0/2003613912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f088815d460 0x7f08881504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:02.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f0886ffd700 1 -- 172.21.15.6:0/2003613912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08880af4e0 msgr2=0x7f088814ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:02.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f0886ffd700 1 --2- 172.21.15.6:0/2003613912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08880af4e0 0x7f088814ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f0886ffd700 1 -- 172.21.15.6:0/2003613912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f088815d460 msgr2=0x7f08881504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:02.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f0886ffd700 1 --2- 172.21.15.6:0/2003613912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f088815d460 0x7f08881504d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f0886ffd700 1 -- 172.21.15.6:0/2003613912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0870009420 con 0x7f08880af8b0 2023-10-06T02:30:02.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f0886ffd700 1 --2- 172.21.15.6:0/2003613912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08880af8b0 0x7f08880b3780 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f087000ec80 tx=0x7f08700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:02.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f087f7fe700 1 -- 172.21.15.6:0/2003613912 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087000c920 con 0x7f08880af8b0 2023-10-06T02:30:02.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f087f7fe700 1 -- 172.21.15.6:0/2003613912 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087000ca80 con 0x7f08880af8b0 2023-10-06T02:30:02.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f087f7fe700 1 -- 172.21.15.6:0/2003613912 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087000ce00 con 0x7f08880af8b0 2023-10-06T02:30:02.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f088de4b700 1 -- 172.21.15.6:0/2003613912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08780094f0 con 0x7f08880af8b0 2023-10-06T02:30:02.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.436+0000 7f088de4b700 1 -- 172.21.15.6:0/2003613912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08880b4560 con 0x7f08880af8b0 2023-10-06T02:30:02.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.437+0000 7f088de4b700 1 -- 172.21.15.6:0/2003613912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08880c8c50 con 0x7f08880af8b0 2023-10-06T02:30:02.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.438+0000 7f087f7fe700 1 -- 172.21.15.6:0/2003613912 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0870013680 con 0x7f08880af8b0 2023-10-06T02:30:02.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.438+0000 7f087f7fe700 1 --2- 172.21.15.6:0/2003613912 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0868066f30 0x7f08680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:02.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.438+0000 7f087f7fe700 1 -- 172.21.15.6:0/2003613912 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f0870084860 con 0x7f08880af8b0 2023-10-06T02:30:02.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.438+0000 7f08877fe700 1 --2- 172.21.15.6:0/2003613912 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0868066f30 0x7f08680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:02.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.439+0000 7f08877fe700 1 --2- 172.21.15.6:0/2003613912 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0868066f30 0x7f08680693e0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f08780099b0 tx=0x7f0878017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:02.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.442+0000 7f087f7fe700 1 -- 172.21.15.6:0/2003613912 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08880c8c50 con 0x7f08880af8b0 2023-10-06T02:30:02.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.713+0000 7f088de4b700 1 -- 172.21.15.6:0/2003613912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f08880c8be0 con 0x7f08880af8b0 2023-10-06T02:30:02.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.714+0000 7f087f7fe700 1 -- 172.21.15.6:0/2003613912 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f0870017090 con 0x7f08880af8b0 2023-10-06T02:30:02.716 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:02.716 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:30:02.716 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-10-06T02:30:02.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.717 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-10-06T02:30:02.717 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9l3UdFFRAAahVHXJW+fzPcTwa/MxOW7A==", 2023-10-06T02:30:02.717 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.717 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:30:02.717 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:30:02.718 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:30:02.718 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:30:02.718 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.718 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-10-06T02:30:02.719 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lcq7HIBAA/3Gaa7gNbUHq176zcCFgjA==", 2023-10-06T02:30:02.719 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.719 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:30:02.719 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:30:02.719 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:30:02.719 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:30:02.720 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.720 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.720 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-10-06T02:30:02.720 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9ls7FDHBAA746JdAc0gr6+qLK9tuWCZg==", 2023-10-06T02:30:02.720 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.721 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:30:02.721 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:30:02.721 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:30:02.721 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:30:02.721 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.722 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-10-06T02:30:02.722 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9llEyZJxAAKXcHXIywnLQVZlbOGKdTTg==", 2023-10-06T02:30:02.722 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.722 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:30:02.723 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:30:02.723 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:30:02.723 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:30:02.723 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.724 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-10-06T02:30:02.724 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAXbh9lLVWHERAAoYIaMicUCppJKlSwl1K8UQ==", 2023-10-06T02:30:02.724 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.724 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:30:02.725 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:30:02.725 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:30:02.725 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.725 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.726 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-10-06T02:30:02.726 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAabh9lgpbHDxAAXOwtusarMKccKIu9+SmmHg==", 2023-10-06T02:30:02.726 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.726 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:30:02.726 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:30:02.726 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:30:02.726 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.727 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.727 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-10-06T02:30:02.727 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAdbh9lG/ZcFBAA3WpHCcm2R2+IyFMK460CYw==", 2023-10-06T02:30:02.727 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.727 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:30:02.727 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:30:02.727 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:30:02.727 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.728 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.728 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.728 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-10-06T02:30:02.728 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAgbh9lz8J4ExAAggyFHpD2wvM/b+WKLvVneA==", 2023-10-06T02:30:02.728 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.728 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:30:02.728 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:30:02.728 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:30:02.729 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.729 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-10-06T02:30:02.729 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAmbh9lpSX1ERAA1vkI0SvrJb6mAciDTIGZtA==", 2023-10-06T02:30:02.729 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.729 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:30:02.730 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:30:02.730 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:30:02.730 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.730 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-10-06T02:30:02.731 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQApbh9ljSxwDxAACjsHigTRkZIY+lHrr9/17g==", 2023-10-06T02:30:02.731 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.731 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:30:02.731 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:30:02.731 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:30:02.731 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.731 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-10-06T02:30:02.731 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAsbh9l6vlZDxAAfff29OvnP+8zxQFDDt8SFA==", 2023-10-06T02:30:02.731 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.731 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:30:02.732 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:30:02.732 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:30:02.732 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.732 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-10-06T02:30:02.732 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAvbh9lz+1sDBAANCvbv4nJUuaVde42koP8fA==", 2023-10-06T02:30:02.732 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.732 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-06T02:30:02.732 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-06T02:30:02.732 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:30:02.732 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.733 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-10-06T02:30:02.733 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lO6GJKxAASfNnkG3FXno1BWm5XiqIMA==", 2023-10-06T02:30:02.733 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.733 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:30:02.733 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-10-06T02:30:02.733 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:30:02.733 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.733 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-10-06T02:30:02.733 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lpRgFNBAAYE7yue5MPAzdm5k3EOcvcg==", 2023-10-06T02:30:02.734 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.734 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:30:02.734 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:30:02.734 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:30:02.734 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:30:02.734 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.735 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-10-06T02:30:02.735 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9l1hsHMRAANI0CeqE+ZB7uQ9ZB4cF/Ig==", 2023-10-06T02:30:02.735 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.735 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:30:02.735 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:30:02.735 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:30:02.735 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:30:02.735 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.735 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-10-06T02:30:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lAV9fORAAXCO4NdIb62PH2IX0y1siCw==", 2023-10-06T02:30:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-06T02:30:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-06T02:30:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-06T02:30:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-06T02:30:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-10-06T02:30:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQASbh9lIiB6NBAAvHP4z7yHub2TXCgRAAFy5A==", 2023-10-06T02:30:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:30:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-06T02:30:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-06T02:30:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:30:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-10-06T02:30:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lMk4mEhAAbIAiSwyo+ygZRqxKBKRxuQ==", 2023-10-06T02:30:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:30:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-06T02:30:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:30:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-10-06T02:30:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQATbh9lxXZSDRAALw3s8FP+gOrz+VIDN7tkuw==", 2023-10-06T02:30:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-06T02:30:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-06T02:30:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-06T02:30:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-06T02:30:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-06T02:30:02.739 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:30:02.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.716+0000 7f088de4b700 1 -- 172.21.15.6:0/2003613912 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0868066f30 msgr2=0x7f08680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:02.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.716+0000 7f088de4b700 1 --2- 172.21.15.6:0/2003613912 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0868066f30 0x7f08680693e0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f08780099b0 tx=0x7f0878017000 comp rx=0 tx=0).stop 2023-10-06T02:30:02.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.716+0000 7f088de4b700 1 -- 172.21.15.6:0/2003613912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08880af8b0 msgr2=0x7f08880b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.716+0000 7f088de4b700 1 --2- 172.21.15.6:0/2003613912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08880af8b0 0x7f08880b3780 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f087000ec80 tx=0x7f08700091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.716+0000 7f088de4b700 1 -- 172.21.15.6:0/2003613912 shutdown_connections 2023-10-06T02:30:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.716+0000 7f088de4b700 1 --2- 172.21.15.6:0/2003613912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f088815d460 0x7f08881504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.716+0000 7f088de4b700 1 --2- 172.21.15.6:0/2003613912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08880af4e0 0x7f088814ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.716+0000 7f088de4b700 1 --2- 172.21.15.6:0/2003613912 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0868066f30 0x7f08680693e0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.716+0000 7f088de4b700 1 --2- 172.21.15.6:0/2003613912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08880af8b0 0x7f08880b3780 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.716+0000 7f088de4b700 1 -- 172.21.15.6:0/2003613912 >> 172.21.15.6:0/2003613912 conn(0x7f0888068680 msgr2=0x7f08880d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.716+0000 7f088de4b700 1 -- 172.21.15.6:0/2003613912 shutdown_connections 2023-10-06T02:30:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.716+0000 7f088de4b700 1 -- 172.21.15.6:0/2003613912 wait complete. 2023-10-06T02:30:02.742 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:30:02.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.858+0000 7fda973e6700 1 Processor -- start 2023-10-06T02:30:02.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.859+0000 7fda973e6700 1 -- start start 2023-10-06T02:30:02.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.859+0000 7fda973e6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900af4e0 0x7fda900b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:02.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.859+0000 7fda973e6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fda900af8b0 0x7fda900b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:02.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.859+0000 7fda973e6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9015e190 con 0x7fda9015d460 2023-10-06T02:30:02.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.859+0000 7fda973e6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda900b1910 con 0x7fda900af8b0 2023-10-06T02:30:02.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.859+0000 7fda973e6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9015dfb0 con 0x7fda900af4e0 2023-10-06T02:30:02.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.860+0000 7fda95182700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900af4e0 0x7fda900b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:02.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.860+0000 7fda94981700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fda900af8b0 0x7fda900b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:02.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.860+0000 7fda95182700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900af4e0 0x7fda900b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.6:41852/0 (socket says 172.21.15.6:41852) 2023-10-06T02:30:02.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.860+0000 7fda94981700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fda900af8b0 0x7fda900b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.6:46044/0 (socket says 172.21.15.6:46044) 2023-10-06T02:30:02.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.860+0000 7fda95182700 1 -- 172.21.15.6:0/1233405230 learned_addr learned my addr 172.21.15.6:0/1233405230 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:02.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.860+0000 7fda95182700 1 -- 172.21.15.6:0/1233405230 >> v2:172.21.15.175:3300/0 conn(0x7fda900af8b0 msgr2=0x7fda900b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:02.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.860+0000 7fda95182700 1 --2- 172.21.15.6:0/1233405230 >> v2:172.21.15.175:3300/0 conn(0x7fda900af8b0 0x7fda900b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.860+0000 7fda95182700 1 -- 172.21.15.6:0/1233405230 >> v1:172.21.15.175:6789/0 conn(0x7fda9015d460 legacy=0x7fda9015d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:02.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.860+0000 7fda95182700 1 -- 172.21.15.6:0/1233405230 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda900cb650 con 0x7fda900af4e0 2023-10-06T02:30:02.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.860+0000 7fda8ffff700 1 -- 172.21.15.6:0/1233405230 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415249688 0 0) 0x7fda9015e190 con 0x7fda9015d460 2023-10-06T02:30:02.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.860+0000 7fda94981700 1 --2- 172.21.15.6:0/1233405230 >> v2:172.21.15.175:3300/0 conn(0x7fda900af8b0 0x7fda900b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:30:02.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.860+0000 7fda95182700 1 --2- 172.21.15.6:0/1233405230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900af4e0 0x7fda900b20e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fda880099b0 tx=0x7fda88009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef83a38318bd14af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:02.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.860+0000 7fda8ffff700 1 -- 172.21.15.6:0/1233405230 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88009ea0 con 0x7fda900af4e0 2023-10-06T02:30:02.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.860+0000 7fda8ffff700 1 -- 172.21.15.6:0/1233405230 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8800b860 con 0x7fda900af4e0 2023-10-06T02:30:02.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.861+0000 7fda8ffff700 1 -- 172.21.15.6:0/1233405230 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8800bc00 con 0x7fda900af4e0 2023-10-06T02:30:02.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.861+0000 7fda973e6700 1 -- 172.21.15.6:0/1233405230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900af4e0 msgr2=0x7fda900b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:02.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.861+0000 7fda973e6700 1 --2- 172.21.15.6:0/1233405230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900af4e0 0x7fda900b20e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fda880099b0 tx=0x7fda88009250 comp rx=0 tx=0).stop 2023-10-06T02:30:02.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.861+0000 7fda973e6700 1 -- 172.21.15.6:0/1233405230 shutdown_connections 2023-10-06T02:30:02.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.861+0000 7fda973e6700 1 --2- 172.21.15.6:0/1233405230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900af4e0 0x7fda900b20e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.861+0000 7fda973e6700 1 --2- 172.21.15.6:0/1233405230 >> v2:172.21.15.175:3300/0 conn(0x7fda900af8b0 0x7fda900b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.861+0000 7fda973e6700 1 -- 172.21.15.6:0/1233405230 >> 172.21.15.6:0/1233405230 conn(0x7fda90068680 msgr2=0x7fda90068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:02.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.861+0000 7fda973e6700 1 -- 172.21.15.6:0/1233405230 shutdown_connections 2023-10-06T02:30:02.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.861+0000 7fda973e6700 1 -- 172.21.15.6:0/1233405230 wait complete. 2023-10-06T02:30:02.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.862+0000 7fda973e6700 1 Processor -- start 2023-10-06T02:30:02.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.862+0000 7fda973e6700 1 -- start start 2023-10-06T02:30:02.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.863+0000 7fda973e6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda900af4e0 0x7fda90151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:02.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.863+0000 7fda973e6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900af8b0 0x7fda900b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:02.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.863+0000 7fda973e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda9015d460 0x7fda9015b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:02.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.863+0000 7fda973e6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900b5e40 con 0x7fda9015d460 2023-10-06T02:30:02.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.863+0000 7fda973e6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900b5230 con 0x7fda900af4e0 2023-10-06T02:30:02.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.863+0000 7fda973e6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda900b5510 con 0x7fda900af8b0 2023-10-06T02:30:02.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.863+0000 7fda95983700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda9015d460 0x7fda9015b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:02.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.863+0000 7fda95983700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda9015d460 0x7fda9015b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42524/0 (socket says 172.21.15.6:42524) 2023-10-06T02:30:02.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.863+0000 7fda95983700 1 -- 172.21.15.6:0/1931727088 learned_addr learned my addr 172.21.15.6:0/1931727088 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:02.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.863+0000 7fda94981700 1 --2- 172.21.15.6:0/1931727088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900af8b0 0x7fda900b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:02.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.863+0000 7fda95182700 1 --2- 172.21.15.6:0/1931727088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda900af4e0 0x7fda90151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:02.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.864+0000 7fda95983700 1 -- 172.21.15.6:0/1931727088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900af8b0 msgr2=0x7fda900b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:02.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.864+0000 7fda95983700 1 --2- 172.21.15.6:0/1931727088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900af8b0 0x7fda900b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.864+0000 7fda95983700 1 -- 172.21.15.6:0/1931727088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda900af4e0 msgr2=0x7fda90151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:02.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.864+0000 7fda95983700 1 --2- 172.21.15.6:0/1931727088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda900af4e0 0x7fda90151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:02.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.864+0000 7fda95983700 1 -- 172.21.15.6:0/1931727088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda84009420 con 0x7fda9015d460 2023-10-06T02:30:02.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.864+0000 7fda95182700 1 --2- 172.21.15.6:0/1931727088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda900af4e0 0x7fda90151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:02.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.864+0000 7fda94981700 1 --2- 172.21.15.6:0/1931727088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900af8b0 0x7fda900b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:02.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.864+0000 7fda95983700 1 --2- 172.21.15.6:0/1931727088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda9015d460 0x7fda9015b210 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7fda80001560 tx=0x7fda80001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:02.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.864+0000 7fda8d7fa700 1 -- 172.21.15.6:0/1931727088 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000a780 con 0x7fda9015d460 2023-10-06T02:30:02.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.864+0000 7fda8d7fa700 1 -- 172.21.15.6:0/1931727088 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8000a8e0 con 0x7fda9015d460 2023-10-06T02:30:02.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.864+0000 7fda8d7fa700 1 -- 172.21.15.6:0/1931727088 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000aca0 con 0x7fda9015d460 2023-10-06T02:30:02.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.864+0000 7fda973e6700 1 -- 172.21.15.6:0/1931727088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda880094f0 con 0x7fda9015d460 2023-10-06T02:30:02.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.864+0000 7fda973e6700 1 -- 172.21.15.6:0/1931727088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda900b5ad0 con 0x7fda9015d460 2023-10-06T02:30:02.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.865+0000 7fda973e6700 1 -- 172.21.15.6:0/1931727088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda900b5ff0 con 0x7fda9015d460 2023-10-06T02:30:02.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.865+0000 7fda8d7fa700 1 -- 172.21.15.6:0/1931727088 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda80012630 con 0x7fda9015d460 2023-10-06T02:30:02.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.866+0000 7fda8d7fa700 1 --2- 172.21.15.6:0/1931727088 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda7c066f30 0x7fda7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:02.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.866+0000 7fda8d7fa700 1 -- 172.21.15.6:0/1931727088 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fda80084770 con 0x7fda9015d460 2023-10-06T02:30:02.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.866+0000 7fda95182700 1 --2- 172.21.15.6:0/1931727088 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda7c066f30 0x7fda7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:02.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.867+0000 7fda95182700 1 --2- 172.21.15.6:0/1931727088 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda7c066f30 0x7fda7c0693e0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fda880099b0 tx=0x7fda88017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:02.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:02.870+0000 7fda8d7fa700 1 -- 172.21.15.6:0/1931727088 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda900b5ff0 con 0x7fda9015d460 2023-10-06T02:30:03.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.063+0000 7fda973e6700 1 -- 172.21.15.6:0/1931727088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda900b5f80 con 0x7fda9015d460 2023-10-06T02:30:03.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.064+0000 7fda8d7fa700 1 -- 172.21.15.6:0/1931727088 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+13809 (secure 0 0 0) 0x7fda80051a90 con 0x7fda9015d460 2023-10-06T02:30:03.066 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:03.066 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":142,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:30:02.285374+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:30:03.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.066+0000 7fda973e6700 1 -- 172.21.15.6:0/1931727088 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda7c066f30 msgr2=0x7fda7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.066+0000 7fda973e6700 1 --2- 172.21.15.6:0/1931727088 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda7c066f30 0x7fda7c0693e0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fda880099b0 tx=0x7fda88017000 comp rx=0 tx=0).stop 2023-10-06T02:30:03.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.066+0000 7fda973e6700 1 -- 172.21.15.6:0/1931727088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda9015d460 msgr2=0x7fda9015b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.066+0000 7fda973e6700 1 --2- 172.21.15.6:0/1931727088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda9015d460 0x7fda9015b210 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7fda80001560 tx=0x7fda80001770 comp rx=0 tx=0).stop 2023-10-06T02:30:03.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.066+0000 7fda973e6700 1 -- 172.21.15.6:0/1931727088 shutdown_connections 2023-10-06T02:30:03.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.066+0000 7fda973e6700 1 --2- 172.21.15.6:0/1931727088 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fda7c066f30 0x7fda7c0693e0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.066+0000 7fda973e6700 1 --2- 172.21.15.6:0/1931727088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda9015d460 0x7fda9015b210 unknown :-1 s=CLOSED pgs=2373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.066+0000 7fda973e6700 1 --2- 172.21.15.6:0/1931727088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda900af4e0 0x7fda90151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.066+0000 7fda973e6700 1 --2- 172.21.15.6:0/1931727088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900af8b0 0x7fda900b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.066+0000 7fda973e6700 1 -- 172.21.15.6:0/1931727088 >> 172.21.15.6:0/1931727088 conn(0x7fda90068680 msgr2=0x7fda9015a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:03.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.066+0000 7fda973e6700 1 -- 172.21.15.6:0/1931727088 shutdown_connections 2023-10-06T02:30:03.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.066+0000 7fda973e6700 1 -- 172.21.15.6:0/1931727088 wait complete. 2023-10-06T02:30:03.080 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T02:30:03.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:30:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.201+0000 7f943a7ef700 1 Processor -- start 2023-10-06T02:30:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.201+0000 7f943a7ef700 1 -- start start 2023-10-06T02:30:03.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.201+0000 7f943a7ef700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94340af460 0x7f9434159990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.201+0000 7f943a7ef700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94340cd180 0x7f943415d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.201+0000 7f943a7ef700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94340ce870 con 0x7f94340af830 2023-10-06T02:30:03.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.201+0000 7f943a7ef700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943415dec0 con 0x7f94340cd180 2023-10-06T02:30:03.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.201+0000 7f943a7ef700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94340cfd10 con 0x7f94340af460 2023-10-06T02:30:03.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.202+0000 7f9438d8c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94340cd180 0x7f943415d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.202+0000 7f9438d8c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94340cd180 0x7f943415d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42528/0 (socket says 172.21.15.6:42528) 2023-10-06T02:30:03.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.202+0000 7f9438d8c700 1 -- 172.21.15.6:0/3567388940 learned_addr learned my addr 172.21.15.6:0/3567388940 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:03.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.202+0000 7f9433fff700 1 --2- 172.21.15.6:0/3567388940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94340af460 0x7f9434159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.202+0000 7f9438d8c700 1 -- 172.21.15.6:0/3567388940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94340af460 msgr2=0x7f9434159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:03.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.202+0000 7f9438d8c700 1 --2- 172.21.15.6:0/3567388940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94340af460 0x7f9434159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.202+0000 7f9438d8c700 1 -- 172.21.15.6:0/3567388940 >> v1:172.21.15.175:6789/0 conn(0x7f94340af830 legacy=0x7f94340cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.202+0000 7f9438d8c700 1 -- 172.21.15.6:0/3567388940 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94340cffb0 con 0x7f94340cd180 2023-10-06T02:30:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.202+0000 7f9438d8c700 1 --2- 172.21.15.6:0/3567388940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94340cd180 0x7f943415d980 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f942c009f20 tx=0x7f942c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733bc99ae7745640 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.202+0000 7f94337fe700 1 -- 172.21.15.6:0/3567388940 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c00e070 con 0x7f94340cd180 2023-10-06T02:30:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.202+0000 7f94337fe700 1 -- 172.21.15.6:0/3567388940 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c00ba80 con 0x7f94340cd180 2023-10-06T02:30:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.202+0000 7f94337fe700 1 -- 172.21.15.6:0/3567388940 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0092e0 con 0x7f94340cd180 2023-10-06T02:30:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.203+0000 7f943a7ef700 1 -- 172.21.15.6:0/3567388940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94340cd180 msgr2=0x7f943415d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.203+0000 7f943a7ef700 1 --2- 172.21.15.6:0/3567388940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94340cd180 0x7f943415d980 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f942c009f20 tx=0x7f942c009840 comp rx=0 tx=0).stop 2023-10-06T02:30:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.203+0000 7f943a7ef700 1 -- 172.21.15.6:0/3567388940 shutdown_connections 2023-10-06T02:30:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.203+0000 7f943a7ef700 1 --2- 172.21.15.6:0/3567388940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94340cd180 0x7f943415d980 unknown :-1 s=CLOSED pgs=2374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.203+0000 7f943a7ef700 1 --2- 172.21.15.6:0/3567388940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94340af460 0x7f9434159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.203+0000 7f943a7ef700 1 -- 172.21.15.6:0/3567388940 >> 172.21.15.6:0/3567388940 conn(0x7f9434068680 msgr2=0x7f9434068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:03.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.203+0000 7f943a7ef700 1 -- 172.21.15.6:0/3567388940 shutdown_connections 2023-10-06T02:30:03.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.203+0000 7f943a7ef700 1 -- 172.21.15.6:0/3567388940 wait complete. 2023-10-06T02:30:03.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.204+0000 7f943a7ef700 1 Processor -- start 2023-10-06T02:30:03.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.204+0000 7f943a7ef700 1 -- start start 2023-10-06T02:30:03.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.205+0000 7f943a7ef700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94340af460 0x7f94340b5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.205+0000 7f943a7ef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94340af830 0x7f94340c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.205+0000 7f943a7ef700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94340cd180 0x7f94340b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.205+0000 7f943a7ef700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94341578b0 con 0x7f94340af830 2023-10-06T02:30:03.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.205+0000 7f943a7ef700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94340c8870 con 0x7f94340cd180 2023-10-06T02:30:03.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.205+0000 7f943a7ef700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94340c8b50 con 0x7f94340af460 2023-10-06T02:30:03.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.205+0000 7f942bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94340af830 0x7f94340c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.205+0000 7f942bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94340af830 0x7f94340c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42536/0 (socket says 172.21.15.6:42536) 2023-10-06T02:30:03.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.205+0000 7f942bfff700 1 -- 172.21.15.6:0/2966269285 learned_addr learned my addr 172.21.15.6:0/2966269285 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.205+0000 7f9433fff700 1 --2- 172.21.15.6:0/2966269285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94340af460 0x7f94340b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.205+0000 7f9438d8c700 1 --2- 172.21.15.6:0/2966269285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94340cd180 0x7f94340b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.205+0000 7f942bfff700 1 -- 172.21.15.6:0/2966269285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94340af460 msgr2=0x7f94340b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.205+0000 7f942bfff700 1 --2- 172.21.15.6:0/2966269285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94340af460 0x7f94340b5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.205+0000 7f942bfff700 1 -- 172.21.15.6:0/2966269285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94340cd180 msgr2=0x7f94340b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.205+0000 7f942bfff700 1 --2- 172.21.15.6:0/2966269285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94340cd180 0x7f94340b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.205+0000 7f942bfff700 1 -- 172.21.15.6:0/2966269285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c009ae0 con 0x7f94340af830 2023-10-06T02:30:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.205+0000 7f942bfff700 1 --2- 172.21.15.6:0/2966269285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94340af830 0x7f94340c8190 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7f942400c590 tx=0x7f942400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.206+0000 7f9430ff9700 1 -- 172.21.15.6:0/2966269285 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424011590 con 0x7f94340af830 2023-10-06T02:30:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.206+0000 7f9430ff9700 1 -- 172.21.15.6:0/2966269285 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9424011710 con 0x7f94340af830 2023-10-06T02:30:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.206+0000 7f943a7ef700 1 -- 172.21.15.6:0/2966269285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94340c8e30 con 0x7f94340af830 2023-10-06T02:30:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.206+0000 7f9430ff9700 1 -- 172.21.15.6:0/2966269285 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424011ad0 con 0x7f94340af830 2023-10-06T02:30:03.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.206+0000 7f943a7ef700 1 -- 172.21.15.6:0/2966269285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94340c91c0 con 0x7f94340af830 2023-10-06T02:30:03.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.207+0000 7f943a7ef700 1 -- 172.21.15.6:0/2966269285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9434088d10 con 0x7f94340af830 2023-10-06T02:30:03.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.207+0000 7f9430ff9700 1 -- 172.21.15.6:0/2966269285 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f942401b3b0 con 0x7f94340af830 2023-10-06T02:30:03.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.207+0000 7f9430ff9700 1 --2- 172.21.15.6:0/2966269285 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9414066f30 0x7f94140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.207+0000 7f9430ff9700 1 -- 172.21.15.6:0/2966269285 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f94240838b0 con 0x7f94340af830 2023-10-06T02:30:03.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.208+0000 7f9433fff700 1 --2- 172.21.15.6:0/2966269285 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9414066f30 0x7f94140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.208+0000 7f9433fff700 1 --2- 172.21.15.6:0/2966269285 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9414066f30 0x7f94140693e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f941c006fd0 tx=0x7f941c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:03.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.211+0000 7f9430ff9700 1 -- 172.21.15.6:0/2966269285 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9424050bd0 con 0x7f94340af830 2023-10-06T02:30:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.404+0000 7f943a7ef700 1 -- 172.21.15.6:0/2966269285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f943415a010 con 0x7f94340af830 2023-10-06T02:30:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.405+0000 7f9430ff9700 1 -- 172.21.15.6:0/2966269285 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v142) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9424017070 con 0x7f94340af830 2023-10-06T02:30:03.407 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:30:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.407+0000 7f943a7ef700 1 -- 172.21.15.6:0/2966269285 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9414066f30 msgr2=0x7f94140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.407+0000 7f943a7ef700 1 --2- 172.21.15.6:0/2966269285 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9414066f30 0x7f94140693e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f941c006fd0 tx=0x7f941c008040 comp rx=0 tx=0).stop 2023-10-06T02:30:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.407+0000 7f943a7ef700 1 -- 172.21.15.6:0/2966269285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94340af830 msgr2=0x7f94340c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.407+0000 7f943a7ef700 1 --2- 172.21.15.6:0/2966269285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94340af830 0x7f94340c8190 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7f942400c590 tx=0x7f942400c8a0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.407+0000 7f943a7ef700 1 -- 172.21.15.6:0/2966269285 shutdown_connections 2023-10-06T02:30:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.407+0000 7f943a7ef700 1 --2- 172.21.15.6:0/2966269285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94340cd180 0x7f94340b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.407+0000 7f943a7ef700 1 --2- 172.21.15.6:0/2966269285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94340af460 0x7f94340b5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.407+0000 7f943a7ef700 1 --2- 172.21.15.6:0/2966269285 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9414066f30 0x7f94140693e0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.407+0000 7f943a7ef700 1 --2- 172.21.15.6:0/2966269285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94340af830 0x7f94340c8190 unknown :-1 s=CLOSED pgs=2375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.407+0000 7f943a7ef700 1 -- 172.21.15.6:0/2966269285 >> 172.21.15.6:0/2966269285 conn(0x7f9434068680 msgr2=0x7f94340c69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:03.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.407+0000 7f943a7ef700 1 -- 172.21.15.6:0/2966269285 shutdown_connections 2023-10-06T02:30:03.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.407+0000 7f943a7ef700 1 -- 172.21.15.6:0/2966269285 wait complete. 2023-10-06T02:30:03.421 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:30:03.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.541+0000 7f2faa6a5700 1 Processor -- start 2023-10-06T02:30:03.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.541+0000 7f2faa6a5700 1 -- start start 2023-10-06T02:30:03.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.542+0000 7f2faa6a5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2fa40d0400 0x7f2fa40b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.542+0000 7f2faa6a5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fa40d07d0 0x7f2fa40b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.542+0000 7f2faa6a5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa40b6170 con 0x7f2fa40ccd40 2023-10-06T02:30:03.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.542+0000 7f2faa6a5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa415dd40 con 0x7f2fa40d0400 2023-10-06T02:30:03.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.542+0000 7f2faa6a5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa415e020 con 0x7f2fa40d07d0 2023-10-06T02:30:03.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.542+0000 7f2fa8c42700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fa40d07d0 0x7f2fa40b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.542+0000 7f2fa3fff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2fa40d0400 0x7f2fa40b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.542+0000 7f2fa37fe700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f2fa40ccd40 0x7f2fa40cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:37432/0 (socket says 172.21.15.6:37432) 2023-10-06T02:30:03.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.542+0000 7f2fa37fe700 1 -- 172.21.15.6:0/1136010591 learned_addr learned my addr 172.21.15.6:0/1136010591 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:03.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.543+0000 7f2fa8c42700 1 -- 172.21.15.6:0/1136010591 >> v2:172.21.15.175:3300/0 conn(0x7f2fa40d0400 msgr2=0x7f2fa40b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:03.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.543+0000 7f2fa8c42700 1 --2- 172.21.15.6:0/1136010591 >> v2:172.21.15.175:3300/0 conn(0x7f2fa40d0400 0x7f2fa40b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.543+0000 7f2fa8c42700 1 -- 172.21.15.6:0/1136010591 >> v1:172.21.15.175:6789/0 conn(0x7f2fa40ccd40 legacy=0x7f2fa40cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.543+0000 7f2fa8c42700 1 -- 172.21.15.6:0/1136010591 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa40ceaa0 con 0x7f2fa40d07d0 2023-10-06T02:30:03.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.543+0000 7f2fa3fff700 1 --2- 172.21.15.6:0/1136010591 >> v2:172.21.15.175:3300/0 conn(0x7f2fa40d0400 0x7f2fa40b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:30:03.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.543+0000 7f2fa2ffd700 1 -- 172.21.15.6:0/1136010591 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037670571 0 0) 0x7f2fa40b6170 con 0x7f2fa40ccd40 2023-10-06T02:30:03.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.543+0000 7f2fa8c42700 1 --2- 172.21.15.6:0/1136010591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fa40d07d0 0x7f2fa40b3aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009e60 tx=0x7f2f9c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebab0f62a8559dd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:03.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.543+0000 7f2fa2ffd700 1 -- 172.21.15.6:0/1136010591 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c00e070 con 0x7f2fa40d07d0 2023-10-06T02:30:03.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.543+0000 7f2fa2ffd700 1 -- 172.21.15.6:0/1136010591 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c00bb60 con 0x7f2fa40d07d0 2023-10-06T02:30:03.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.543+0000 7f2fa2ffd700 1 -- 172.21.15.6:0/1136010591 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c012430 con 0x7f2fa40d07d0 2023-10-06T02:30:03.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.544+0000 7f2faa6a5700 1 -- 172.21.15.6:0/1136010591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fa40d07d0 msgr2=0x7f2fa40b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.544+0000 7f2faa6a5700 1 --2- 172.21.15.6:0/1136010591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fa40d07d0 0x7f2fa40b3aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009e60 tx=0x7f2f9c009780 comp rx=0 tx=0).stop 2023-10-06T02:30:03.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.544+0000 7f2faa6a5700 1 -- 172.21.15.6:0/1136010591 shutdown_connections 2023-10-06T02:30:03.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.544+0000 7f2faa6a5700 1 --2- 172.21.15.6:0/1136010591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fa40d07d0 0x7f2fa40b3aa0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.544+0000 7f2faa6a5700 1 --2- 172.21.15.6:0/1136010591 >> v2:172.21.15.175:3300/0 conn(0x7f2fa40d0400 0x7f2fa40b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.544+0000 7f2faa6a5700 1 -- 172.21.15.6:0/1136010591 >> 172.21.15.6:0/1136010591 conn(0x7f2fa406a220 msgr2=0x7f2fa406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:03.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.544+0000 7f2faa6a5700 1 -- 172.21.15.6:0/1136010591 shutdown_connections 2023-10-06T02:30:03.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.544+0000 7f2faa6a5700 1 -- 172.21.15.6:0/1136010591 wait complete. 2023-10-06T02:30:03.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.545+0000 7f2faa6a5700 1 Processor -- start 2023-10-06T02:30:03.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.545+0000 7f2faa6a5700 1 -- start start 2023-10-06T02:30:03.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.546+0000 7f2faa6a5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fa40ccd40 0x7f2fa414e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.546+0000 7f2faa6a5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fa40d0400 0x7f2fa413d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.546+0000 7f2faa6a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fa40d07d0 0x7f2fa4087200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.546+0000 7f2faa6a5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa414c3d0 con 0x7f2fa40d07d0 2023-10-06T02:30:03.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.546+0000 7f2faa6a5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa413a990 con 0x7f2fa40ccd40 2023-10-06T02:30:03.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.546+0000 7f2faa6a5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa414c0f0 con 0x7f2fa40d0400 2023-10-06T02:30:03.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.546+0000 7f2fa8c42700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fa40d07d0 0x7f2fa4087200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.546+0000 7f2fa8c42700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fa40d07d0 0x7f2fa4087200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42546/0 (socket says 172.21.15.6:42546) 2023-10-06T02:30:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.546+0000 7f2fa8c42700 1 -- 172.21.15.6:0/2353412698 learned_addr learned my addr 172.21.15.6:0/2353412698 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.546+0000 7f2fa37fe700 1 --2- 172.21.15.6:0/2353412698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fa40d0400 0x7f2fa413d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.546+0000 7f2fa3fff700 1 --2- 172.21.15.6:0/2353412698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fa40ccd40 0x7f2fa414e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.546+0000 7f2fa8c42700 1 -- 172.21.15.6:0/2353412698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fa40d0400 msgr2=0x7f2fa413d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.546+0000 7f2fa8c42700 1 --2- 172.21.15.6:0/2353412698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fa40d0400 0x7f2fa413d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.546+0000 7f2fa8c42700 1 -- 172.21.15.6:0/2353412698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fa40ccd40 msgr2=0x7f2fa414e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.546+0000 7f2fa8c42700 1 --2- 172.21.15.6:0/2353412698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fa40ccd40 0x7f2fa414e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.546+0000 7f2fa8c42700 1 -- 172.21.15.6:0/2353412698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0093c0 con 0x7f2fa40d07d0 2023-10-06T02:30:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.546+0000 7f2fa8c42700 1 --2- 172.21.15.6:0/2353412698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fa40d07d0 0x7f2fa4087200 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f2fa415e160 tx=0x7f2f9c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.547+0000 7f2f9bfff700 1 -- 172.21.15.6:0/2353412698 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c012ea0 con 0x7f2fa40d07d0 2023-10-06T02:30:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.547+0000 7f2f9bfff700 1 -- 172.21.15.6:0/2353412698 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c027470 con 0x7f2fa40d07d0 2023-10-06T02:30:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.547+0000 7f2faa6a5700 1 -- 172.21.15.6:0/2353412698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9c009a20 con 0x7f2fa40d07d0 2023-10-06T02:30:03.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.547+0000 7f2f9bfff700 1 -- 172.21.15.6:0/2353412698 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c027830 con 0x7f2fa40d07d0 2023-10-06T02:30:03.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.547+0000 7f2faa6a5700 1 -- 172.21.15.6:0/2353412698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa413ae80 con 0x7f2fa40d07d0 2023-10-06T02:30:03.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.548+0000 7f2faa6a5700 1 -- 172.21.15.6:0/2353412698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa4088760 con 0x7f2fa40d07d0 2023-10-06T02:30:03.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.548+0000 7f2f9bfff700 1 -- 172.21.15.6:0/2353412698 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f9c024070 con 0x7f2fa40d07d0 2023-10-06T02:30:03.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.548+0000 7f2f9bfff700 1 --2- 172.21.15.6:0/2353412698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f84066f30 0x7f2f840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.548+0000 7f2f9bfff700 1 -- 172.21.15.6:0/2353412698 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f2f9c086c00 con 0x7f2fa40d07d0 2023-10-06T02:30:03.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.549+0000 7f2fa3fff700 1 --2- 172.21.15.6:0/2353412698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f84066f30 0x7f2f840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.549+0000 7f2fa3fff700 1 --2- 172.21.15.6:0/2353412698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f84066f30 0x7f2f840693e0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009f30 tx=0x7f2f8c009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:03.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.553+0000 7f2f9bfff700 1 -- 172.21.15.6:0/2353412698 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f9c053e80 con 0x7f2fa40d07d0 2023-10-06T02:30:03.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.746+0000 7f2faa6a5700 1 -- 172.21.15.6:0/2353412698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fa40ced80 con 0x7f2fa40d07d0 2023-10-06T02:30:03.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.747+0000 7f2f9bfff700 1 -- 172.21.15.6:0/2353412698 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v142) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f9c02c0a0 con 0x7f2fa40d07d0 2023-10-06T02:30:03.749 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:30:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.749+0000 7f2faa6a5700 1 -- 172.21.15.6:0/2353412698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f84066f30 msgr2=0x7f2f840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.749+0000 7f2faa6a5700 1 --2- 172.21.15.6:0/2353412698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f84066f30 0x7f2f840693e0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009f30 tx=0x7f2f8c009120 comp rx=0 tx=0).stop 2023-10-06T02:30:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.749+0000 7f2faa6a5700 1 -- 172.21.15.6:0/2353412698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fa40d07d0 msgr2=0x7f2fa4087200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.749+0000 7f2faa6a5700 1 --2- 172.21.15.6:0/2353412698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fa40d07d0 0x7f2fa4087200 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f2fa415e160 tx=0x7f2f9c019000 comp rx=0 tx=0).stop 2023-10-06T02:30:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.749+0000 7f2faa6a5700 1 -- 172.21.15.6:0/2353412698 shutdown_connections 2023-10-06T02:30:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.749+0000 7f2faa6a5700 1 --2- 172.21.15.6:0/2353412698 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2f84066f30 0x7f2f840693e0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.749+0000 7f2faa6a5700 1 --2- 172.21.15.6:0/2353412698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fa40d07d0 0x7f2fa4087200 unknown :-1 s=CLOSED pgs=2376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.749+0000 7f2faa6a5700 1 --2- 172.21.15.6:0/2353412698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fa40ccd40 0x7f2fa414e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.749+0000 7f2faa6a5700 1 --2- 172.21.15.6:0/2353412698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fa40d0400 0x7f2fa413d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.749+0000 7f2faa6a5700 1 -- 172.21.15.6:0/2353412698 >> 172.21.15.6:0/2353412698 conn(0x7f2fa406a220 msgr2=0x7f2fa4155400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:03.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.749+0000 7f2faa6a5700 1 -- 172.21.15.6:0/2353412698 shutdown_connections 2023-10-06T02:30:03.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.749+0000 7f2faa6a5700 1 -- 172.21.15.6:0/2353412698 wait complete. 2023-10-06T02:30:03.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:30:03.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.880+0000 7ff85b8bd700 1 Processor -- start 2023-10-06T02:30:03.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.881+0000 7ff85b8bd700 1 -- start start 2023-10-06T02:30:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.881+0000 7ff85b8bd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff8540af1d0 0x7ff8540af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.881+0000 7ff85b8bd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85406d5b0 con 0x7ff854068d90 2023-10-06T02:30:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.881+0000 7ff85b8bd700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85406de90 con 0x7ff85406da40 2023-10-06T02:30:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.881+0000 7ff85b8bd700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8540caf90 con 0x7ff8540af1d0 2023-10-06T02:30:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.881+0000 7ff859e5a700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff854068d90 0x7ff854159a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46534/0 (socket says 172.21.15.6:46534) 2023-10-06T02:30:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff859e5a700 1 -- 172.21.15.6:0/3360030646 learned_addr learned my addr 172.21.15.6:0/3360030646 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff859659700 1 --2- 172.21.15.6:0/3360030646 >> v2:172.21.15.175:3300/0 conn(0x7ff8540af1d0 0x7ff8540af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff853fff700 1 -- 172.21.15.6:0/3360030646 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554142960 0 0) 0x7ff85406d5b0 con 0x7ff854068d90 2023-10-06T02:30:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff853fff700 1 -- 172.21.15.6:0/3360030646 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff83c003570 con 0x7ff854068d90 2023-10-06T02:30:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff853fff700 1 -- 172.21.15.6:0/3360030646 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3239322962 0 0) 0x7ff83c003570 con 0x7ff854068d90 2023-10-06T02:30:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff853fff700 1 -- 172.21.15.6:0/3360030646 >> v2:172.21.15.175:3300/0 conn(0x7ff8540af1d0 msgr2=0x7ff8540af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff853fff700 1 --2- 172.21.15.6:0/3360030646 >> v2:172.21.15.175:3300/0 conn(0x7ff8540af1d0 0x7ff8540af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff853fff700 1 -- 172.21.15.6:0/3360030646 >> v1:172.21.15.175:6789/0 conn(0x7ff85406da40 legacy=0x7ff854068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff853fff700 1 -- 172.21.15.6:0/3360030646 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85415a9a0 con 0x7ff854068d90 2023-10-06T02:30:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff853fff700 1 -- 172.21.15.6:0/3360030646 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7ff844001470 con 0x7ff854068d90 2023-10-06T02:30:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff853fff700 1 -- 172.21.15.6:0/3360030646 >> v1:172.21.15.6:6789/0 conn(0x7ff854068d90 legacy=0x7ff854159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff853fff700 1 --2- 172.21.15.6:0/3360030646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff83c003a60 0x7ff83c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff853fff700 1 --2- 172.21.15.6:0/3360030646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff83c004810 0x7ff83c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff853fff700 1 --2- 172.21.15.6:0/3360030646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff83c0051c0 0x7ff83c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff853fff700 1 -- 172.21.15.6:0/3360030646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8540caf90 con 0x7ff83c0051c0 2023-10-06T02:30:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff853fff700 1 -- 172.21.15.6:0/3360030646 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c00c0d0 con 0x7ff83c003a60 2023-10-06T02:30:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff853fff700 1 -- 172.21.15.6:0/3360030646 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c00c290 con 0x7ff83c004810 2023-10-06T02:30:03.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff859e5a700 1 --2- 172.21.15.6:0/3360030646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff83c0051c0 0x7ff83c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff859659700 1 --2- 172.21.15.6:0/3360030646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff83c003a60 0x7ff83c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.882+0000 7ff858e58700 1 --2- 172.21.15.6:0/3360030646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff83c004810 0x7ff83c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.883+0000 7ff859e5a700 1 -- 172.21.15.6:0/3360030646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff83c004810 msgr2=0x7ff83c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:03.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.883+0000 7ff859e5a700 1 --2- 172.21.15.6:0/3360030646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff83c004810 0x7ff83c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.883+0000 7ff859e5a700 1 -- 172.21.15.6:0/3360030646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff83c003a60 msgr2=0x7ff83c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:03.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.883+0000 7ff859e5a700 1 --2- 172.21.15.6:0/3360030646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff83c003a60 0x7ff83c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.883+0000 7ff859e5a700 1 -- 172.21.15.6:0/3360030646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c003570 con 0x7ff83c0051c0 2023-10-06T02:30:03.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.883+0000 7ff859659700 1 --2- 172.21.15.6:0/3360030646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff83c003a60 0x7ff83c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:30:03.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.883+0000 7ff859e5a700 1 -- 172.21.15.6:0/3360030646 reap_dead start 2023-10-06T02:30:03.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.883+0000 7ff859e5a700 1 --2- 172.21.15.6:0/3360030646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff83c0051c0 0x7ff83c00ba60 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7ff84400c390 tx=0x7ff844001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ad54f236935ff5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:03.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.883+0000 7ff853fff700 1 -- 172.21.15.6:0/3360030646 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84400cc60 con 0x7ff83c0051c0 2023-10-06T02:30:03.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.883+0000 7ff853fff700 1 -- 172.21.15.6:0/3360030646 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84400cdc0 con 0x7ff83c0051c0 2023-10-06T02:30:03.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.883+0000 7ff853fff700 1 -- 172.21.15.6:0/3360030646 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff844005b50 con 0x7ff83c0051c0 2023-10-06T02:30:03.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.883+0000 7ff85b8bd700 1 -- 172.21.15.6:0/3360030646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff83c0051c0 msgr2=0x7ff83c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.883+0000 7ff85b8bd700 1 --2- 172.21.15.6:0/3360030646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff83c0051c0 0x7ff83c00ba60 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7ff84400c390 tx=0x7ff844001e50 comp rx=0 tx=0).stop 2023-10-06T02:30:03.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.883+0000 7ff85b8bd700 1 -- 172.21.15.6:0/3360030646 shutdown_connections 2023-10-06T02:30:03.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.883+0000 7ff85b8bd700 1 --2- 172.21.15.6:0/3360030646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff83c0051c0 0x7ff83c00ba60 unknown :-1 s=CLOSED pgs=2378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.883+0000 7ff85b8bd700 1 -- 172.21.15.6:0/3360030646 >> 172.21.15.6:0/3360030646 conn(0x7ff85406a220 msgr2=0x7ff85406b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:03.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.884+0000 7ff85b8bd700 1 -- 172.21.15.6:0/3360030646 shutdown_connections 2023-10-06T02:30:03.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.884+0000 7ff85b8bd700 1 -- 172.21.15.6:0/3360030646 wait complete. 2023-10-06T02:30:03.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.885+0000 7ff85b8bd700 1 Processor -- start 2023-10-06T02:30:03.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.885+0000 7ff85b8bd700 1 -- start start 2023-10-06T02:30:03.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff85b8bd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff83c0051c0 0x7ff854150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff85b8bd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8540c4b10 0x7ff8540b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff85b8bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8540c4f80 0x7ff854158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff85b8bd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8540c40c0 con 0x7ff8540c4f80 2023-10-06T02:30:03.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff85b8bd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8540c4680 con 0x7ff8540c4b10 2023-10-06T02:30:03.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff85b8bd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8540b1840 con 0x7ff83c0051c0 2023-10-06T02:30:03.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff859e5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8540c4f80 0x7ff854158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff859e5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8540c4f80 0x7ff854158a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42568/0 (socket says 172.21.15.6:42568) 2023-10-06T02:30:03.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff859e5a700 1 -- 172.21.15.6:0/3412780306 learned_addr learned my addr 172.21.15.6:0/3412780306 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:03.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff859659700 1 --2- 172.21.15.6:0/3412780306 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff83c0051c0 0x7ff854150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff858e58700 1 --2- 172.21.15.6:0/3412780306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8540c4b10 0x7ff8540b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff859e5a700 1 -- 172.21.15.6:0/3412780306 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff83c0051c0 msgr2=0x7ff854150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff859e5a700 1 --2- 172.21.15.6:0/3412780306 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff83c0051c0 0x7ff854150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff859e5a700 1 -- 172.21.15.6:0/3412780306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8540c4b10 msgr2=0x7ff8540b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:03.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff859e5a700 1 --2- 172.21.15.6:0/3412780306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8540c4b10 0x7ff8540b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:03.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff859e5a700 1 -- 172.21.15.6:0/3412780306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8540b1b20 con 0x7ff8540c4f80 2023-10-06T02:30:03.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff859659700 1 --2- 172.21.15.6:0/3412780306 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff83c0051c0 0x7ff854150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:03.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff859e5a700 1 --2- 172.21.15.6:0/3412780306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8540c4f80 0x7ff854158a80 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7ff84400c390 tx=0x7ff844013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:03.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff8517fa700 1 -- 172.21.15.6:0/3412780306 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84400cc60 con 0x7ff8540c4f80 2023-10-06T02:30:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff8517fa700 1 -- 172.21.15.6:0/3412780306 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff844000ed0 con 0x7ff8540c4f80 2023-10-06T02:30:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff85b8bd700 1 -- 172.21.15.6:0/3412780306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8540c4310 con 0x7ff8540c4f80 2023-10-06T02:30:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff8517fa700 1 -- 172.21.15.6:0/3412780306 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff844012610 con 0x7ff8540c4f80 2023-10-06T02:30:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.886+0000 7ff85b8bd700 1 -- 172.21.15.6:0/3412780306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff854155510 con 0x7ff8540c4f80 2023-10-06T02:30:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.887+0000 7ff85b8bd700 1 -- 172.21.15.6:0/3412780306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8540c4810 con 0x7ff8540c4f80 2023-10-06T02:30:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.888+0000 7ff8517fa700 1 -- 172.21.15.6:0/3412780306 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff844012a00 con 0x7ff8540c4f80 2023-10-06T02:30:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.888+0000 7ff8517fa700 1 --2- 172.21.15.6:0/3412780306 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff840066f30 0x7ff8400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.888+0000 7ff8517fa700 1 -- 172.21.15.6:0/3412780306 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5526+0+0 (secure 0 0 0) 0x7ff844085cf0 con 0x7ff8540c4f80 2023-10-06T02:30:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.888+0000 7ff859659700 1 --2- 172.21.15.6:0/3412780306 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff840066f30 0x7ff8400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.889+0000 7ff859659700 1 --2- 172.21.15.6:0/3412780306 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff840066f30 0x7ff8400693e0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009750 tx=0x7ff84c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:03.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:03.893+0000 7ff8517fa700 1 -- 172.21.15.6:0/3412780306 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff844053010 con 0x7ff8540c4f80 2023-10-06T02:30:04.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.086+0000 7ff85b8bd700 1 -- 172.21.15.6:0/3412780306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff8540c4810 con 0x7ff8540c4f80 2023-10-06T02:30:04.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.086+0000 7ff8517fa700 1 -- 172.21.15.6:0/3412780306 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v142) v1 ==== 84+0+126 (secure 0 0 0) 0x7ff844056630 con 0x7ff8540c4f80 2023-10-06T02:30:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:04.088 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-06T02:30:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-06T02:30:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-10-06T02:30:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-10-06T02:30:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-06T02:30:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:04.089 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-06T02:30:04.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.089+0000 7ff85b8bd700 1 -- 172.21.15.6:0/3412780306 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff840066f30 msgr2=0x7ff8400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:04.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.089+0000 7ff85b8bd700 1 --2- 172.21.15.6:0/3412780306 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff840066f30 0x7ff8400693e0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009750 tx=0x7ff84c00b040 comp rx=0 tx=0).stop 2023-10-06T02:30:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.089+0000 7ff85b8bd700 1 -- 172.21.15.6:0/3412780306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8540c4f80 msgr2=0x7ff854158a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.089+0000 7ff85b8bd700 1 --2- 172.21.15.6:0/3412780306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8540c4f80 0x7ff854158a80 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7ff84400c390 tx=0x7ff844013000 comp rx=0 tx=0).stop 2023-10-06T02:30:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.089+0000 7ff85b8bd700 1 -- 172.21.15.6:0/3412780306 shutdown_connections 2023-10-06T02:30:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.089+0000 7ff85b8bd700 1 --2- 172.21.15.6:0/3412780306 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff840066f30 0x7ff8400693e0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.089+0000 7ff85b8bd700 1 --2- 172.21.15.6:0/3412780306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8540c4f80 0x7ff854158a80 unknown :-1 s=CLOSED pgs=2379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.089+0000 7ff85b8bd700 1 --2- 172.21.15.6:0/3412780306 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff83c0051c0 0x7ff854150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.089+0000 7ff85b8bd700 1 --2- 172.21.15.6:0/3412780306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8540c4b10 0x7ff8540b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.089+0000 7ff85b8bd700 1 -- 172.21.15.6:0/3412780306 >> 172.21.15.6:0/3412780306 conn(0x7ff85406a220 msgr2=0x7ff85415c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.089+0000 7ff85b8bd700 1 -- 172.21.15.6:0/3412780306 shutdown_connections 2023-10-06T02:30:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.089+0000 7ff85b8bd700 1 -- 172.21.15.6:0/3412780306 wait complete. 2023-10-06T02:30:04.102 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:30:04.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:30:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.224+0000 7fad34405700 1 Processor -- start 2023-10-06T02:30:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.224+0000 7fad34405700 1 -- start start 2023-10-06T02:30:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.225+0000 7fad34405700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fad2c06a8f0 0x7fad2c0b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.225+0000 7fad34405700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2c0b2350 con 0x7fad2c159910 2023-10-06T02:30:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.225+0000 7fad34405700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2c0b0510 con 0x7fad2c159540 2023-10-06T02:30:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.225+0000 7fad34405700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2c067fa0 con 0x7fad2c06a8f0 2023-10-06T02:30:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.225+0000 7fad319a0700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fad2c159910 0x7fad2c0b27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46544/0 (socket says 172.21.15.6:46544) 2023-10-06T02:30:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.225+0000 7fad319a0700 1 -- 172.21.15.6:0/2028953894 learned_addr learned my addr 172.21.15.6:0/2028953894 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.226+0000 7fad329a2700 1 --2- 172.21.15.6:0/2028953894 >> v2:172.21.15.175:3300/0 conn(0x7fad2c06a8f0 0x7fad2c0b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.226+0000 7fad3119f700 1 -- 172.21.15.6:0/2028953894 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518095323 0 0) 0x7fad2c0b2350 con 0x7fad2c159910 2023-10-06T02:30:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.226+0000 7fad3119f700 1 -- 172.21.15.6:0/2028953894 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad14003570 con 0x7fad2c159910 2023-10-06T02:30:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.226+0000 7fad329a2700 1 -- 172.21.15.6:0/2028953894 >> v1:172.21.15.175:6789/0 conn(0x7fad2c159540 legacy=0x7fad2c06a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.226+0000 7fad3119f700 1 -- 172.21.15.6:0/2028953894 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216023998 0 0) 0x7fad2c0b0510 con 0x7fad2c159540 2023-10-06T02:30:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.226+0000 7fad329a2700 1 -- 172.21.15.6:0/2028953894 >> v1:172.21.15.6:6789/0 conn(0x7fad2c159910 legacy=0x7fad2c0b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.226+0000 7fad329a2700 1 -- 172.21.15.6:0/2028953894 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c0b07f0 con 0x7fad2c06a8f0 2023-10-06T02:30:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.226+0000 7fad329a2700 1 --2- 172.21.15.6:0/2028953894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad2c06a8f0 0x7fad2c0b2ef0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009e60 tx=0x7fad1c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=698a678d5500ca42 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.226+0000 7fad3119f700 1 -- 172.21.15.6:0/2028953894 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c00e070 con 0x7fad2c06a8f0 2023-10-06T02:30:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.226+0000 7fad3119f700 1 -- 172.21.15.6:0/2028953894 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c00bb60 con 0x7fad2c06a8f0 2023-10-06T02:30:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.226+0000 7fad3119f700 1 -- 172.21.15.6:0/2028953894 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c012430 con 0x7fad2c06a8f0 2023-10-06T02:30:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.227+0000 7fad34405700 1 -- 172.21.15.6:0/2028953894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad2c06a8f0 msgr2=0x7fad2c0b2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.227+0000 7fad34405700 1 --2- 172.21.15.6:0/2028953894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad2c06a8f0 0x7fad2c0b2ef0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009e60 tx=0x7fad1c009780 comp rx=0 tx=0).stop 2023-10-06T02:30:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.227+0000 7fad34405700 1 -- 172.21.15.6:0/2028953894 shutdown_connections 2023-10-06T02:30:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.227+0000 7fad34405700 1 --2- 172.21.15.6:0/2028953894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad2c06a8f0 0x7fad2c0b2ef0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.227+0000 7fad34405700 1 -- 172.21.15.6:0/2028953894 >> 172.21.15.6:0/2028953894 conn(0x7fad2c067910 msgr2=0x7fad2c0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.227+0000 7fad34405700 1 -- 172.21.15.6:0/2028953894 shutdown_connections 2023-10-06T02:30:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.227+0000 7fad34405700 1 -- 172.21.15.6:0/2028953894 wait complete. 2023-10-06T02:30:04.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.228+0000 7fad34405700 1 Processor -- start 2023-10-06T02:30:04.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.228+0000 7fad34405700 1 -- start start 2023-10-06T02:30:04.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad34405700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad2c06a8f0 0x7fad2c169b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:04.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad34405700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad2c159540 0x7fad2c15ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:04.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad34405700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad2c159910 0x7fad2c15b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:04.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad34405700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c16b0e0 con 0x7fad2c159540 2023-10-06T02:30:04.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad34405700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c16a4d0 con 0x7fad2c06a8f0 2023-10-06T02:30:04.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad34405700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c16a7b0 con 0x7fad2c159910 2023-10-06T02:30:04.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad319a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad2c159540 0x7fad2c15ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad319a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad2c159540 0x7fad2c15ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42572/0 (socket says 172.21.15.6:42572) 2023-10-06T02:30:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad319a0700 1 -- 172.21.15.6:0/1037403729 learned_addr learned my addr 172.21.15.6:0/1037403729 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad321a1700 1 --2- 172.21.15.6:0/1037403729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad2c06a8f0 0x7fad2c169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad329a2700 1 --2- 172.21.15.6:0/1037403729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad2c159910 0x7fad2c15b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad319a0700 1 -- 172.21.15.6:0/1037403729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad2c159910 msgr2=0x7fad2c15b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad319a0700 1 --2- 172.21.15.6:0/1037403729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad2c159910 0x7fad2c15b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad319a0700 1 -- 172.21.15.6:0/1037403729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad2c06a8f0 msgr2=0x7fad2c169b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad319a0700 1 --2- 172.21.15.6:0/1037403729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad2c06a8f0 0x7fad2c169b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad319a0700 1 -- 172.21.15.6:0/1037403729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c009a20 con 0x7fad2c159540 2023-10-06T02:30:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad321a1700 1 --2- 172.21.15.6:0/1037403729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad2c06a8f0 0x7fad2c169b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad319a0700 1 --2- 172.21.15.6:0/1037403729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad2c159540 0x7fad2c15ace0 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7fad200011e0 tx=0x7fad20007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:04.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.229+0000 7fad2a7fc700 1 -- 172.21.15.6:0/1037403729 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20005b30 con 0x7fad2c159540 2023-10-06T02:30:04.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.230+0000 7fad2a7fc700 1 -- 172.21.15.6:0/1037403729 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad20005c90 con 0x7fad2c159540 2023-10-06T02:30:04.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.230+0000 7fad2a7fc700 1 -- 172.21.15.6:0/1037403729 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20007320 con 0x7fad2c159540 2023-10-06T02:30:04.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.230+0000 7fad34405700 1 -- 172.21.15.6:0/1037403729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2c16aa90 con 0x7fad2c159540 2023-10-06T02:30:04.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.230+0000 7fad34405700 1 -- 172.21.15.6:0/1037403729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2c157000 con 0x7fad2c159540 2023-10-06T02:30:04.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.230+0000 7fad34405700 1 -- 172.21.15.6:0/1037403729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2c16b250 con 0x7fad2c159540 2023-10-06T02:30:04.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.231+0000 7fad2a7fc700 1 -- 172.21.15.6:0/1037403729 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad20007690 con 0x7fad2c159540 2023-10-06T02:30:04.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.231+0000 7fad2a7fc700 1 --2- 172.21.15.6:0/1037403729 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad18066f30 0x7fad180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:04.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.231+0000 7fad2a7fc700 1 -- 172.21.15.6:0/1037403729 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fad20083a00 con 0x7fad2c159540 2023-10-06T02:30:04.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.232+0000 7fad321a1700 1 --2- 172.21.15.6:0/1037403729 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad18066f30 0x7fad180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:04.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.232+0000 7fad321a1700 1 --2- 172.21.15.6:0/1037403729 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad18066f30 0x7fad180693e0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fad24007fd0 tx=0x7fad24009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:04.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.236+0000 7fad2a7fc700 1 -- 172.21.15.6:0/1037403729 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad20050d20 con 0x7fad2c159540 2023-10-06T02:30:04.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:04.430+0000 7fad34405700 1 -- 172.21.15.6:0/1037403729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fad2c06e660 con 0x7fad2c159540 2023-10-06T02:30:05.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.301+0000 7fad2a7fc700 1 -- 172.21.15.6:0/1037403729 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v143) v1 ==== 138+0+0 (secure 0 0 0) 0x7fad20017020 con 0x7fad2c159540 2023-10-06T02:30:05.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.307+0000 7fad34405700 1 -- 172.21.15.6:0/1037403729 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad18066f30 msgr2=0x7fad180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:05.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.307+0000 7fad34405700 1 --2- 172.21.15.6:0/1037403729 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad18066f30 0x7fad180693e0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fad24007fd0 tx=0x7fad24009040 comp rx=0 tx=0).stop 2023-10-06T02:30:05.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.307+0000 7fad34405700 1 -- 172.21.15.6:0/1037403729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad2c159540 msgr2=0x7fad2c15ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:05.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.307+0000 7fad34405700 1 --2- 172.21.15.6:0/1037403729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad2c159540 0x7fad2c15ace0 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7fad200011e0 tx=0x7fad20007df0 comp rx=0 tx=0).stop 2023-10-06T02:30:05.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.308+0000 7fad34405700 1 -- 172.21.15.6:0/1037403729 shutdown_connections 2023-10-06T02:30:05.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.308+0000 7fad34405700 1 --2- 172.21.15.6:0/1037403729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad2c159910 0x7fad2c15b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:05.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.308+0000 7fad34405700 1 --2- 172.21.15.6:0/1037403729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad2c06a8f0 0x7fad2c169b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:05.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.308+0000 7fad34405700 1 --2- 172.21.15.6:0/1037403729 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fad18066f30 0x7fad180693e0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:05.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.308+0000 7fad34405700 1 --2- 172.21.15.6:0/1037403729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad2c159540 0x7fad2c15ace0 unknown :-1 s=CLOSED pgs=2381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:05.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.308+0000 7fad34405700 1 -- 172.21.15.6:0/1037403729 >> 172.21.15.6:0/1037403729 conn(0x7fad2c067910 msgr2=0x7fad2c06dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:05.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.308+0000 7fad34405700 1 -- 172.21.15.6:0/1037403729 shutdown_connections 2023-10-06T02:30:05.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.308+0000 7fad34405700 1 -- 172.21.15.6:0/1037403729 wait complete. 2023-10-06T02:30:05.311 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-06T02:30:05.325 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:30:05.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.456+0000 7fba655b2700 1 Processor -- start 2023-10-06T02:30:05.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.456+0000 7fba655b2700 1 -- start start 2023-10-06T02:30:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.457+0000 7fba655b2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fba600b2820 0x7fba600b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.457+0000 7fba655b2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba60158e70 0x7fba601592b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.457+0000 7fba655b2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba60069120 con 0x7fba600b2450 2023-10-06T02:30:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.457+0000 7fba655b2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba600cb120 con 0x7fba60158e70 2023-10-06T02:30:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.457+0000 7fba655b2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba6015de80 con 0x7fba600b2820 2023-10-06T02:30:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.457+0000 7fba5f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba60158e70 0x7fba601592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.458+0000 7fba5effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fba600b2450 0x7fba60068680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46554/0 (socket says 172.21.15.6:46554) 2023-10-06T02:30:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.458+0000 7fba5effd700 1 -- 172.21.15.6:0/4227721716 learned_addr learned my addr 172.21.15.6:0/4227721716 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.458+0000 7fba5e7fc700 1 --2- 172.21.15.6:0/4227721716 >> v2:172.21.15.175:3300/0 conn(0x7fba600b2820 0x7fba600b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.458+0000 7fba5dffb700 1 -- 172.21.15.6:0/4227721716 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150785495 0 0) 0x7fba60069120 con 0x7fba600b2450 2023-10-06T02:30:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.458+0000 7fba5dffb700 1 -- 172.21.15.6:0/4227721716 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba4c003570 con 0x7fba600b2450 2023-10-06T02:30:05.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.458+0000 7fba5f7fe700 1 -- 172.21.15.6:0/4227721716 >> v2:172.21.15.175:3300/0 conn(0x7fba600b2820 msgr2=0x7fba600b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:05.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.458+0000 7fba5f7fe700 1 --2- 172.21.15.6:0/4227721716 >> v2:172.21.15.175:3300/0 conn(0x7fba600b2820 0x7fba600b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:05.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.458+0000 7fba5f7fe700 1 -- 172.21.15.6:0/4227721716 >> v1:172.21.15.6:6789/0 conn(0x7fba600b2450 legacy=0x7fba60068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:05.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.458+0000 7fba5f7fe700 1 -- 172.21.15.6:0/4227721716 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba600cb3c0 con 0x7fba60158e70 2023-10-06T02:30:05.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.458+0000 7fba5e7fc700 1 --2- 172.21.15.6:0/4227721716 >> v2:172.21.15.175:3300/0 conn(0x7fba600b2820 0x7fba600b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:05.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.458+0000 7fba5f7fe700 1 --2- 172.21.15.6:0/4227721716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba60158e70 0x7fba601592b0 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7fba600c72d0 tx=0x7fba50009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341fad65c6e40a40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:05.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.458+0000 7fba5dffb700 1 -- 172.21.15.6:0/4227721716 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5000e070 con 0x7fba60158e70 2023-10-06T02:30:05.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.458+0000 7fba5dffb700 1 -- 172.21.15.6:0/4227721716 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5000bb60 con 0x7fba60158e70 2023-10-06T02:30:05.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.458+0000 7fba5dffb700 1 -- 172.21.15.6:0/4227721716 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50012430 con 0x7fba60158e70 2023-10-06T02:30:05.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.459+0000 7fba655b2700 1 -- 172.21.15.6:0/4227721716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba60158e70 msgr2=0x7fba601592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:05.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.459+0000 7fba655b2700 1 --2- 172.21.15.6:0/4227721716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba60158e70 0x7fba601592b0 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7fba600c72d0 tx=0x7fba50009780 comp rx=0 tx=0).stop 2023-10-06T02:30:05.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.459+0000 7fba655b2700 1 -- 172.21.15.6:0/4227721716 shutdown_connections 2023-10-06T02:30:05.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.459+0000 7fba655b2700 1 --2- 172.21.15.6:0/4227721716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba60158e70 0x7fba601592b0 unknown :-1 s=CLOSED pgs=2383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:05.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.459+0000 7fba655b2700 1 --2- 172.21.15.6:0/4227721716 >> v2:172.21.15.175:3300/0 conn(0x7fba600b2820 0x7fba600b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:05.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.459+0000 7fba655b2700 1 -- 172.21.15.6:0/4227721716 >> 172.21.15.6:0/4227721716 conn(0x7fba600d0310 msgr2=0x7fba600d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:05.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.459+0000 7fba655b2700 1 -- 172.21.15.6:0/4227721716 shutdown_connections 2023-10-06T02:30:05.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.459+0000 7fba655b2700 1 -- 172.21.15.6:0/4227721716 wait complete. 2023-10-06T02:30:05.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.460+0000 7fba655b2700 1 Processor -- start 2023-10-06T02:30:05.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.460+0000 7fba655b2700 1 -- start start 2023-10-06T02:30:05.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.461+0000 7fba655b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba600b2450 0x7fba60154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:05.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.461+0000 7fba655b2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba600b2820 0x7fba60155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:05.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.461+0000 7fba655b2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba60158e70 0x7fba600c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:05.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.461+0000 7fba655b2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba60157620 con 0x7fba600b2450 2023-10-06T02:30:05.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.461+0000 7fba655b2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba60154dc0 con 0x7fba60158e70 2023-10-06T02:30:05.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.461+0000 7fba655b2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba60156760 con 0x7fba600b2820 2023-10-06T02:30:05.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.461+0000 7fba5effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba600b2450 0x7fba60154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:05.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.461+0000 7fba5effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba600b2450 0x7fba60154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42592/0 (socket says 172.21.15.6:42592) 2023-10-06T02:30:05.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.461+0000 7fba5effd700 1 -- 172.21.15.6:0/2222729189 learned_addr learned my addr 172.21.15.6:0/2222729189 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:05.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.461+0000 7fba5effd700 1 -- 172.21.15.6:0/2222729189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba600b2820 msgr2=0x7fba60155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:05.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.461+0000 7fba5effd700 1 --2- 172.21.15.6:0/2222729189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba600b2820 0x7fba60155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:05.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.461+0000 7fba5effd700 1 -- 172.21.15.6:0/2222729189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba60158e70 msgr2=0x7fba600c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:05.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.461+0000 7fba5effd700 1 --2- 172.21.15.6:0/2222729189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba60158e70 0x7fba600c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:05.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.461+0000 7fba5effd700 1 -- 172.21.15.6:0/2222729189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba50009a20 con 0x7fba600b2450 2023-10-06T02:30:05.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.462+0000 7fba5effd700 1 --2- 172.21.15.6:0/2222729189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba600b2450 0x7fba60154880 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7fba5800c7f0 tx=0x7fba58007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:05.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.462+0000 7fba56ffd700 1 -- 172.21.15.6:0/2222729189 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba58005b30 con 0x7fba600b2450 2023-10-06T02:30:05.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.462+0000 7fba56ffd700 1 -- 172.21.15.6:0/2222729189 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba58005c90 con 0x7fba600b2450 2023-10-06T02:30:05.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.462+0000 7fba655b2700 1 -- 172.21.15.6:0/2222729189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba60156a40 con 0x7fba600b2450 2023-10-06T02:30:05.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.462+0000 7fba56ffd700 1 -- 172.21.15.6:0/2222729189 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba58007340 con 0x7fba600b2450 2023-10-06T02:30:05.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.462+0000 7fba655b2700 1 -- 172.21.15.6:0/2222729189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba601572b0 con 0x7fba600b2450 2023-10-06T02:30:05.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.463+0000 7fba655b2700 1 -- 172.21.15.6:0/2222729189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba60088d10 con 0x7fba600b2450 2023-10-06T02:30:05.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.463+0000 7fba56ffd700 1 -- 172.21.15.6:0/2222729189 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba5801b400 con 0x7fba600b2450 2023-10-06T02:30:05.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.464+0000 7fba56ffd700 1 --2- 172.21.15.6:0/2222729189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba40066f30 0x7fba400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:05.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.464+0000 7fba56ffd700 1 -- 172.21.15.6:0/2222729189 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5896+0+0 (secure 0 0 0) 0x7fba58084090 con 0x7fba600b2450 2023-10-06T02:30:05.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.464+0000 7fba5e7fc700 1 --2- 172.21.15.6:0/2222729189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba40066f30 0x7fba400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:05.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.465+0000 7fba5e7fc700 1 --2- 172.21.15.6:0/2222729189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba40066f30 0x7fba400693e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fba48006fd0 tx=0x7fba48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:05.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.468+0000 7fba56ffd700 1 -- 172.21.15.6:0/2222729189 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba58051370 con 0x7fba600b2450 2023-10-06T02:30:05.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:05.662+0000 7fba655b2700 1 -- 172.21.15.6:0/2222729189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fba600cb6a0 con 0x7fba600b2450 2023-10-06T02:30:06.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.305+0000 7fba56ffd700 1 -- 172.21.15.6:0/2222729189 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v144) v1 ==== 170+0+0 (secure 0 0 0) 0x7fba580076f0 con 0x7fba600b2450 2023-10-06T02:30:06.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.316+0000 7fba655b2700 1 -- 172.21.15.6:0/2222729189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba40066f30 msgr2=0x7fba400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:06.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.316+0000 7fba655b2700 1 --2- 172.21.15.6:0/2222729189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba40066f30 0x7fba400693e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fba48006fd0 tx=0x7fba48008040 comp rx=0 tx=0).stop 2023-10-06T02:30:06.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.316+0000 7fba655b2700 1 -- 172.21.15.6:0/2222729189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba600b2450 msgr2=0x7fba60154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:06.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.316+0000 7fba655b2700 1 --2- 172.21.15.6:0/2222729189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba600b2450 0x7fba60154880 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7fba5800c7f0 tx=0x7fba58007e00 comp rx=0 tx=0).stop 2023-10-06T02:30:06.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.317+0000 7fba655b2700 1 -- 172.21.15.6:0/2222729189 shutdown_connections 2023-10-06T02:30:06.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.317+0000 7fba655b2700 1 --2- 172.21.15.6:0/2222729189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba60158e70 0x7fba600c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:06.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.317+0000 7fba655b2700 1 --2- 172.21.15.6:0/2222729189 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fba40066f30 0x7fba400693e0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:06.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.317+0000 7fba655b2700 1 --2- 172.21.15.6:0/2222729189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba600b2450 0x7fba60154880 secure :-1 s=CLOSED pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7fba5800c7f0 tx=0x7fba58007e00 comp rx=0 tx=0).stop 2023-10-06T02:30:06.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.317+0000 7fba655b2700 1 --2- 172.21.15.6:0/2222729189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba600b2820 0x7fba60155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:06.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.317+0000 7fba655b2700 1 -- 172.21.15.6:0/2222729189 >> 172.21.15.6:0/2222729189 conn(0x7fba600d0310 msgr2=0x7fba6015c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:06.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.318+0000 7fba655b2700 1 -- 172.21.15.6:0/2222729189 shutdown_connections 2023-10-06T02:30:06.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.320+0000 7fba655b2700 1 -- 172.21.15.6:0/2222729189 wait complete. 2023-10-06T02:30:06.328 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-06T02:30:06.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:30:06.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.462+0000 7f46f605a700 1 Processor -- start 2023-10-06T02:30:06.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.462+0000 7f46f605a700 1 -- start start 2023-10-06T02:30:06.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.463+0000 7f46f605a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f46f013f5e0 0x7f46f00c9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:06.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.463+0000 7f46f605a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f46f00b1370 0x7f46f006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:06.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.463+0000 7f46f605a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f00af750 con 0x7f46f013f9b0 2023-10-06T02:30:06.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.463+0000 7f46f605a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f00aeea0 con 0x7f46f013f5e0 2023-10-06T02:30:06.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.463+0000 7f46f605a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f006b6b0 con 0x7f46f00b1370 2023-10-06T02:30:06.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.463+0000 7f46f5058700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f46f013f5e0 0x7f46f00c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:06.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.463+0000 7f46f5058700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f46f013f5e0 0x7f46f00c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42596/0 (socket says 172.21.15.6:42596) 2023-10-06T02:30:06.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.463+0000 7f46f5058700 1 -- 172.21.15.6:0/1643455102 learned_addr learned my addr 172.21.15.6:0/1643455102 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:06.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.463+0000 7f46f5859700 1 --2- 172.21.15.6:0/1643455102 >> v2:172.21.15.175:3300/0 conn(0x7f46f00b1370 0x7f46f006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:06.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.463+0000 7f46f5058700 1 -- 172.21.15.6:0/1643455102 >> v2:172.21.15.175:3300/0 conn(0x7f46f00b1370 msgr2=0x7f46f006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:06.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.463+0000 7f46f5058700 1 --2- 172.21.15.6:0/1643455102 >> v2:172.21.15.175:3300/0 conn(0x7f46f00b1370 0x7f46f006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:06.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.463+0000 7f46f5058700 1 -- 172.21.15.6:0/1643455102 >> v1:172.21.15.175:6789/0 conn(0x7f46f013f9b0 legacy=0x7f46f00b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:06.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.463+0000 7f46f5058700 1 -- 172.21.15.6:0/1643455102 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f00af100 con 0x7f46f013f5e0 2023-10-06T02:30:06.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.464+0000 7f46f5058700 1 --2- 172.21.15.6:0/1643455102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46f013f5e0 0x7f46f00c9640 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7f46f013fe50 tx=0x7f46ec00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb1c5d803a5d61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:06.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.464+0000 7f46e7fff700 1 -- 172.21.15.6:0/1643455102 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec00dc50 con 0x7f46f013f5e0 2023-10-06T02:30:06.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.464+0000 7f46e7fff700 1 -- 172.21.15.6:0/1643455102 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec00ddb0 con 0x7f46f013f5e0 2023-10-06T02:30:06.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.464+0000 7f46e7fff700 1 -- 172.21.15.6:0/1643455102 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0196d0 con 0x7f46f013f5e0 2023-10-06T02:30:06.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.464+0000 7f46f605a700 1 -- 172.21.15.6:0/1643455102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46f013f5e0 msgr2=0x7f46f00c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:06.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.464+0000 7f46f605a700 1 --2- 172.21.15.6:0/1643455102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46f013f5e0 0x7f46f00c9640 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7f46f013fe50 tx=0x7f46ec00b4f0 comp rx=0 tx=0).stop 2023-10-06T02:30:06.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.464+0000 7f46f605a700 1 -- 172.21.15.6:0/1643455102 shutdown_connections 2023-10-06T02:30:06.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.464+0000 7f46f605a700 1 --2- 172.21.15.6:0/1643455102 >> v2:172.21.15.175:3300/0 conn(0x7f46f00b1370 0x7f46f006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:06.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.464+0000 7f46f605a700 1 --2- 172.21.15.6:0/1643455102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46f013f5e0 0x7f46f00c9640 unknown :-1 s=CLOSED pgs=2385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:06.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.464+0000 7f46f605a700 1 -- 172.21.15.6:0/1643455102 >> 172.21.15.6:0/1643455102 conn(0x7f46f0069150 msgr2=0x7f46f00ad720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:06.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.464+0000 7f46f605a700 1 -- 172.21.15.6:0/1643455102 shutdown_connections 2023-10-06T02:30:06.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.464+0000 7f46f605a700 1 -- 172.21.15.6:0/1643455102 wait complete. 2023-10-06T02:30:06.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.465+0000 7f46f605a700 1 Processor -- start 2023-10-06T02:30:06.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.465+0000 7f46f605a700 1 -- start start 2023-10-06T02:30:06.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.466+0000 7f46f605a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46f00b1370 0x7f46f00c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:06.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.466+0000 7f46f605a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46f013f5e0 0x7f46f0159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:06.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.466+0000 7f46f605a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46f013f9b0 0x7f46f00aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:06.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.466+0000 7f46f605a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f016aea0 con 0x7f46f013f5e0 2023-10-06T02:30:06.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.466+0000 7f46f605a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f01598e0 con 0x7f46f013f9b0 2023-10-06T02:30:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.466+0000 7f46f605a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f0156fc0 con 0x7f46f00b1370 2023-10-06T02:30:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.466+0000 7f46f4857700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46f013f5e0 0x7f46f0159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.466+0000 7f46f4857700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46f013f5e0 0x7f46f0159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42610/0 (socket says 172.21.15.6:42610) 2023-10-06T02:30:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.466+0000 7f46f4857700 1 -- 172.21.15.6:0/1177084447 learned_addr learned my addr 172.21.15.6:0/1177084447 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.467+0000 7f46f5058700 1 --2- 172.21.15.6:0/1177084447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46f00b1370 0x7f46f00c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.467+0000 7f46f5859700 1 --2- 172.21.15.6:0/1177084447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46f013f9b0 0x7f46f00aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.467+0000 7f46f4857700 1 -- 172.21.15.6:0/1177084447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46f00b1370 msgr2=0x7f46f00c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.467+0000 7f46f4857700 1 --2- 172.21.15.6:0/1177084447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46f00b1370 0x7f46f00c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.467+0000 7f46f4857700 1 -- 172.21.15.6:0/1177084447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46f013f9b0 msgr2=0x7f46f00aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.467+0000 7f46f4857700 1 --2- 172.21.15.6:0/1177084447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46f013f9b0 0x7f46f00aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.467+0000 7f46f4857700 1 -- 172.21.15.6:0/1177084447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec00b790 con 0x7f46f013f5e0 2023-10-06T02:30:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.467+0000 7f46f4857700 1 --2- 172.21.15.6:0/1177084447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46f013f5e0 0x7f46f0159d00 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7f46e000c4e0 tx=0x7f46e000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:06.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.467+0000 7f46e57fa700 1 -- 172.21.15.6:0/1177084447 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0011590 con 0x7f46f013f5e0 2023-10-06T02:30:06.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.467+0000 7f46e57fa700 1 -- 172.21.15.6:0/1177084447 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e0011710 con 0x7f46f013f5e0 2023-10-06T02:30:06.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.467+0000 7f46e57fa700 1 -- 172.21.15.6:0/1177084447 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0011ad0 con 0x7f46f013f5e0 2023-10-06T02:30:06.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.467+0000 7f46f605a700 1 -- 172.21.15.6:0/1177084447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f0158fa0 con 0x7f46f013f5e0 2023-10-06T02:30:06.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.467+0000 7f46f605a700 1 -- 172.21.15.6:0/1177084447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f0159220 con 0x7f46f013f5e0 2023-10-06T02:30:06.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.468+0000 7f46f605a700 1 -- 172.21.15.6:0/1177084447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f0159a20 con 0x7f46f013f5e0 2023-10-06T02:30:06.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.469+0000 7f46e57fa700 1 -- 172.21.15.6:0/1177084447 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46e001b3b0 con 0x7f46f013f5e0 2023-10-06T02:30:06.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.469+0000 7f46e57fa700 1 --2- 172.21.15.6:0/1177084447 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f46d4066f30 0x7f46d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:06.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.469+0000 7f46e57fa700 1 -- 172.21.15.6:0/1177084447 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f46e0083bf0 con 0x7f46f013f5e0 2023-10-06T02:30:06.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.469+0000 7f46f5058700 1 --2- 172.21.15.6:0/1177084447 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f46d4066f30 0x7f46d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:06.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.470+0000 7f46f5058700 1 --2- 172.21.15.6:0/1177084447 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f46d4066f30 0x7f46d40693e0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f46f013fe50 tx=0x7f46ec01b000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:06.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.474+0000 7f46e57fa700 1 -- 172.21.15.6:0/1177084447 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46f0159a20 con 0x7f46f013f5e0 2023-10-06T02:30:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:06.712+0000 7f46f605a700 1 -- 172.21.15.6:0/1177084447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f46f0159a20 con 0x7f46f013f5e0 2023-10-06T02:30:07.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.343+0000 7f46e57fa700 1 -- 172.21.15.6:0/1177084447 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v355) v1 ==== 174+0+0 (secure 0 0 0) 0x7f46f0159a20 con 0x7f46f013f5e0 2023-10-06T02:30:07.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.350+0000 7f46f605a700 1 -- 172.21.15.6:0/1177084447 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f46d4066f30 msgr2=0x7f46d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:07.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.350+0000 7f46f605a700 1 --2- 172.21.15.6:0/1177084447 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f46d4066f30 0x7f46d40693e0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f46f013fe50 tx=0x7f46ec01b000 comp rx=0 tx=0).stop 2023-10-06T02:30:07.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.350+0000 7f46f605a700 1 -- 172.21.15.6:0/1177084447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46f013f5e0 msgr2=0x7f46f0159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:07.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.350+0000 7f46f605a700 1 --2- 172.21.15.6:0/1177084447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46f013f5e0 0x7f46f0159d00 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7f46e000c4e0 tx=0x7f46e000c8a0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.351+0000 7f46f605a700 1 -- 172.21.15.6:0/1177084447 shutdown_connections 2023-10-06T02:30:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.351+0000 7f46f605a700 1 --2- 172.21.15.6:0/1177084447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46f013f9b0 0x7f46f00aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.352+0000 7f46f605a700 1 --2- 172.21.15.6:0/1177084447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46f00b1370 0x7f46f00c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.352+0000 7f46f605a700 1 --2- 172.21.15.6:0/1177084447 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f46d4066f30 0x7f46d40693e0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.352+0000 7f46f605a700 1 --2- 172.21.15.6:0/1177084447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46f013f5e0 0x7f46f0159d00 unknown :-1 s=CLOSED pgs=2386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.352+0000 7f46f605a700 1 -- 172.21.15.6:0/1177084447 >> 172.21.15.6:0/1177084447 conn(0x7f46f0069150 msgr2=0x7f46f006a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.352+0000 7f46f605a700 1 -- 172.21.15.6:0/1177084447 shutdown_connections 2023-10-06T02:30:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.352+0000 7f46f605a700 1 -- 172.21.15.6:0/1177084447 wait complete. 2023-10-06T02:30:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 16 and data pool 17 2023-10-06T02:30:07.372 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:30:07.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.494+0000 7fd961adf700 1 Processor -- start 2023-10-06T02:30:07.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.494+0000 7fd961adf700 1 -- start start 2023-10-06T02:30:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.495+0000 7fd961adf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd95c0af8b0 0x7fd95c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.495+0000 7fd961adf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd95c0b27f0 0x7fd95c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.495+0000 7fd961adf700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95c15e190 con 0x7fd95c0af4e0 2023-10-06T02:30:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.495+0000 7fd961adf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95c0b1910 con 0x7fd95c0b27f0 2023-10-06T02:30:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.495+0000 7fd961adf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0cb650 con 0x7fd95c0af8b0 2023-10-06T02:30:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.495+0000 7fd95bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd95c0b27f0 0x7fd95c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.495+0000 7fd95bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd95c0b27f0 0x7fd95c15d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42614/0 (socket says 172.21.15.6:42614) 2023-10-06T02:30:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.495+0000 7fd95bfff700 1 -- 172.21.15.6:0/2851756235 learned_addr learned my addr 172.21.15.6:0/2851756235 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.495+0000 7fd95affd700 1 --2- 172.21.15.6:0/2851756235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd95c0af8b0 0x7fd95c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.496+0000 7fd95bfff700 1 -- 172.21.15.6:0/2851756235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd95c0af8b0 msgr2=0x7fd95c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.496+0000 7fd95bfff700 1 --2- 172.21.15.6:0/2851756235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd95c0af8b0 0x7fd95c15d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.496+0000 7fd95bfff700 1 -- 172.21.15.6:0/2851756235 >> v1:172.21.15.175:6789/0 conn(0x7fd95c0af4e0 legacy=0x7fd95c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.496+0000 7fd95bfff700 1 -- 172.21.15.6:0/2851756235 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c0ccaf0 con 0x7fd95c0b27f0 2023-10-06T02:30:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.496+0000 7fd95bfff700 1 --2- 172.21.15.6:0/2851756235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd95c0b27f0 0x7fd95c15d9a0 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7fd954009f20 tx=0x7fd954009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a486b2b0fc62f01e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.496+0000 7fd95a7fc700 1 -- 172.21.15.6:0/2851756235 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95400e070 con 0x7fd95c0b27f0 2023-10-06T02:30:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.496+0000 7fd95a7fc700 1 -- 172.21.15.6:0/2851756235 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95400b9d0 con 0x7fd95c0b27f0 2023-10-06T02:30:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.496+0000 7fd95a7fc700 1 -- 172.21.15.6:0/2851756235 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540092e0 con 0x7fd95c0b27f0 2023-10-06T02:30:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.497+0000 7fd961adf700 1 -- 172.21.15.6:0/2851756235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd95c0b27f0 msgr2=0x7fd95c15d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:07.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.497+0000 7fd961adf700 1 --2- 172.21.15.6:0/2851756235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd95c0b27f0 0x7fd95c15d9a0 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7fd954009f20 tx=0x7fd954009840 comp rx=0 tx=0).stop 2023-10-06T02:30:07.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.497+0000 7fd961adf700 1 -- 172.21.15.6:0/2851756235 shutdown_connections 2023-10-06T02:30:07.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.497+0000 7fd961adf700 1 --2- 172.21.15.6:0/2851756235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd95c0b27f0 0x7fd95c15d9a0 unknown :-1 s=CLOSED pgs=2387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.497+0000 7fd961adf700 1 --2- 172.21.15.6:0/2851756235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd95c0af8b0 0x7fd95c15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.497+0000 7fd961adf700 1 -- 172.21.15.6:0/2851756235 >> 172.21.15.6:0/2851756235 conn(0x7fd95c068680 msgr2=0x7fd95c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:07.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.497+0000 7fd961adf700 1 -- 172.21.15.6:0/2851756235 shutdown_connections 2023-10-06T02:30:07.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.497+0000 7fd961adf700 1 -- 172.21.15.6:0/2851756235 wait complete. 2023-10-06T02:30:07.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.498+0000 7fd961adf700 1 Processor -- start 2023-10-06T02:30:07.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.498+0000 7fd961adf700 1 -- start start 2023-10-06T02:30:07.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd961adf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd95c0af4e0 0x7fd95c0c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:07.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd961adf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd95c0af8b0 0x7fd95c0d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:07.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd961adf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd95c0b27f0 0x7fd95c0ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd961adf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0cfe30 con 0x7fd95c0b27f0 2023-10-06T02:30:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd961adf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0d06d0 con 0x7fd95c0af4e0 2023-10-06T02:30:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd961adf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0cf810 con 0x7fd95c0af8b0 2023-10-06T02:30:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd95bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd95c0b27f0 0x7fd95c0ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd95bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd95c0b27f0 0x7fd95c0ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42624/0 (socket says 172.21.15.6:42624) 2023-10-06T02:30:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd95bfff700 1 -- 172.21.15.6:0/3750469827 learned_addr learned my addr 172.21.15.6:0/3750469827 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd95b7fe700 1 --2- 172.21.15.6:0/3750469827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd95c0af4e0 0x7fd95c0c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd95affd700 1 --2- 172.21.15.6:0/3750469827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd95c0af8b0 0x7fd95c0d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd95bfff700 1 -- 172.21.15.6:0/3750469827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd95c0af8b0 msgr2=0x7fd95c0d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd95bfff700 1 --2- 172.21.15.6:0/3750469827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd95c0af8b0 0x7fd95c0d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd95bfff700 1 -- 172.21.15.6:0/3750469827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd95c0af4e0 msgr2=0x7fd95c0c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd95bfff700 1 --2- 172.21.15.6:0/3750469827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd95c0af4e0 0x7fd95c0c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd95bfff700 1 -- 172.21.15.6:0/3750469827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd954009ae0 con 0x7fd95c0b27f0 2023-10-06T02:30:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd95bfff700 1 --2- 172.21.15.6:0/3750469827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd95c0b27f0 0x7fd95c0ce010 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7fd95400b610 tx=0x7fd954018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd9437fe700 1 -- 172.21.15.6:0/3750469827 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954008c30 con 0x7fd95c0b27f0 2023-10-06T02:30:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd9437fe700 1 -- 172.21.15.6:0/3750469827 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd954008d90 con 0x7fd95c0b27f0 2023-10-06T02:30:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd961adf700 1 -- 172.21.15.6:0/3750469827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95c0d0080 con 0x7fd95c0b27f0 2023-10-06T02:30:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd9437fe700 1 -- 172.21.15.6:0/3750469827 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954025690 con 0x7fd95c0b27f0 2023-10-06T02:30:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.499+0000 7fd961adf700 1 -- 172.21.15.6:0/3750469827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95c0d10a0 con 0x7fd95c0b27f0 2023-10-06T02:30:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.500+0000 7fd961adf700 1 -- 172.21.15.6:0/3750469827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95c0d0880 con 0x7fd95c0b27f0 2023-10-06T02:30:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.501+0000 7fd9437fe700 1 -- 172.21.15.6:0/3750469827 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd954003040 con 0x7fd95c0b27f0 2023-10-06T02:30:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.501+0000 7fd9437fe700 1 --2- 172.21.15.6:0/3750469827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd948066f30 0x7fd9480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.501+0000 7fd9437fe700 1 -- 172.21.15.6:0/3750469827 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd9540863f0 con 0x7fd95c0b27f0 2023-10-06T02:30:07.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.501+0000 7fd95b7fe700 1 --2- 172.21.15.6:0/3750469827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd948066f30 0x7fd9480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:07.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.502+0000 7fd95b7fe700 1 --2- 172.21.15.6:0/3750469827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd948066f30 0x7fd9480693e0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fd94c003860 tx=0x7fd94c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:07.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.506+0000 7fd9437fe700 1 -- 172.21.15.6:0/3750469827 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd95c0d0880 con 0x7fd95c0b27f0 2023-10-06T02:30:07.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.700+0000 7fd961adf700 1 -- 172.21.15.6:0/3750469827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd95c0d0840 con 0x7fd95c0b27f0 2023-10-06T02:30:07.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.701+0000 7fd9437fe700 1 -- 172.21.15.6:0/3750469827 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+17050 (secure 0 0 0) 0x7fd9540533c0 con 0x7fd95c0b27f0 2023-10-06T02:30:07.703 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:07.703 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":145,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:30:06.714949+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:30:04.464332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T02:30:05.694424+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:30:07.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.703+0000 7fd961adf700 1 -- 172.21.15.6:0/3750469827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd948066f30 msgr2=0x7fd9480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:07.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.703+0000 7fd961adf700 1 --2- 172.21.15.6:0/3750469827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd948066f30 0x7fd9480693e0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fd94c003860 tx=0x7fd94c009040 comp rx=0 tx=0).stop 2023-10-06T02:30:07.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.703+0000 7fd961adf700 1 -- 172.21.15.6:0/3750469827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd95c0b27f0 msgr2=0x7fd95c0ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:07.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.703+0000 7fd961adf700 1 --2- 172.21.15.6:0/3750469827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd95c0b27f0 0x7fd95c0ce010 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7fd95400b610 tx=0x7fd954018000 comp rx=0 tx=0).stop 2023-10-06T02:30:07.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.703+0000 7fd961adf700 1 -- 172.21.15.6:0/3750469827 shutdown_connections 2023-10-06T02:30:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.703+0000 7fd961adf700 1 --2- 172.21.15.6:0/3750469827 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd948066f30 0x7fd9480693e0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.703+0000 7fd961adf700 1 --2- 172.21.15.6:0/3750469827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd95c0b27f0 0x7fd95c0ce010 unknown :-1 s=CLOSED pgs=2388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.703+0000 7fd961adf700 1 --2- 172.21.15.6:0/3750469827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd95c0af4e0 0x7fd95c0c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.703+0000 7fd961adf700 1 --2- 172.21.15.6:0/3750469827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd95c0af8b0 0x7fd95c0d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.703+0000 7fd961adf700 1 -- 172.21.15.6:0/3750469827 >> 172.21.15.6:0/3750469827 conn(0x7fd95c068680 msgr2=0x7fd95c0afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.703+0000 7fd961adf700 1 -- 172.21.15.6:0/3750469827 shutdown_connections 2023-10-06T02:30:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.703+0000 7fd961adf700 1 -- 172.21.15.6:0/3750469827 wait complete. 2023-10-06T02:30:07.717 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:30:07.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.834+0000 7f660c4cb700 1 Processor -- start 2023-10-06T02:30:07.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.834+0000 7f660c4cb700 1 -- start start 2023-10-06T02:30:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.835+0000 7f660c4cb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f66040b27f0 0x7f660415db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.835+0000 7f660c4cb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660415e190 con 0x7f66040af4e0 2023-10-06T02:30:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.835+0000 7f660c4cb700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66040cb650 con 0x7f66040af8b0 2023-10-06T02:30:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.835+0000 7f660c4cb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66040b1910 con 0x7f66040b27f0 2023-10-06T02:30:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f660a267700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f66040af4e0 0x7f66040b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46564/0 (socket says 172.21.15.6:46564) 2023-10-06T02:30:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f660a267700 1 -- 172.21.15.6:0/1504860018 learned_addr learned my addr 172.21.15.6:0/1504860018 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f660aa68700 1 --2- 172.21.15.6:0/1504860018 >> v2:172.21.15.175:3300/0 conn(0x7f66040b27f0 0x7f660415db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f6609265700 1 -- 172.21.15.6:0/1504860018 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765950174 0 0) 0x7f660415e190 con 0x7f66040af4e0 2023-10-06T02:30:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f6609265700 1 -- 172.21.15.6:0/1504860018 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65ec003570 con 0x7f66040af4e0 2023-10-06T02:30:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f6609265700 1 -- 172.21.15.6:0/1504860018 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2863414982 0 0) 0x7f65ec003570 con 0x7f66040af4e0 2023-10-06T02:30:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f6609265700 1 -- 172.21.15.6:0/1504860018 >> v2:172.21.15.175:3300/0 conn(0x7f66040b27f0 msgr2=0x7f660415db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f6609265700 1 --2- 172.21.15.6:0/1504860018 >> v2:172.21.15.175:3300/0 conn(0x7f66040b27f0 0x7f660415db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f6609265700 1 -- 172.21.15.6:0/1504860018 >> v1:172.21.15.175:6789/0 conn(0x7f66040af8b0 legacy=0x7f660415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f6609265700 1 -- 172.21.15.6:0/1504860018 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66040ccaf0 con 0x7f66040af4e0 2023-10-06T02:30:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f6609265700 1 -- 172.21.15.6:0/1504860018 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f65fc0017f0 con 0x7f66040af4e0 2023-10-06T02:30:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f6609265700 1 -- 172.21.15.6:0/1504860018 >> v1:172.21.15.6:6789/0 conn(0x7f66040af4e0 legacy=0x7f66040b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f6609265700 1 --2- 172.21.15.6:0/1504860018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec003a60 0x7f65ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f6609265700 1 --2- 172.21.15.6:0/1504860018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec004810 0x7f65ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f6609265700 1 --2- 172.21.15.6:0/1504860018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec0051c0 0x7f65ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f6609265700 1 -- 172.21.15.6:0/1504860018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66040b1910 con 0x7f65ec003a60 2023-10-06T02:30:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f6609265700 1 -- 172.21.15.6:0/1504860018 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec00c160 con 0x7f65ec004810 2023-10-06T02:30:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f6609265700 1 -- 172.21.15.6:0/1504860018 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec00c320 con 0x7f65ec0051c0 2023-10-06T02:30:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f660a267700 1 --2- 172.21.15.6:0/1504860018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec003a60 0x7f65ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f6609a66700 1 --2- 172.21.15.6:0/1504860018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec004810 0x7f65ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.836+0000 7f660aa68700 1 --2- 172.21.15.6:0/1504860018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec0051c0 0x7f65ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.837+0000 7f660a267700 1 -- 172.21.15.6:0/1504860018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec0051c0 msgr2=0x7f65ec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.837+0000 7f660a267700 1 --2- 172.21.15.6:0/1504860018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec0051c0 0x7f65ec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.837+0000 7f660a267700 1 -- 172.21.15.6:0/1504860018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec004810 msgr2=0x7f65ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.837+0000 7f660a267700 1 --2- 172.21.15.6:0/1504860018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec004810 0x7f65ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.837+0000 7f660a267700 1 -- 172.21.15.6:0/1504860018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec003570 con 0x7f65ec003a60 2023-10-06T02:30:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.837+0000 7f660aa68700 1 -- 172.21.15.6:0/1504860018 reap_dead start 2023-10-06T02:30:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.837+0000 7f660a267700 1 --2- 172.21.15.6:0/1504860018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec003a60 0x7f65ec003e70 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00a900 tx=0x7f66040ccc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0741f17ad8f9eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.837+0000 7f6609265700 1 -- 172.21.15.6:0/1504860018 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0070d0 con 0x7f65ec003a60 2023-10-06T02:30:07.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.837+0000 7f6609265700 1 -- 172.21.15.6:0/1504860018 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65fc007230 con 0x7f65ec003a60 2023-10-06T02:30:07.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.837+0000 7f6609265700 1 -- 172.21.15.6:0/1504860018 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0075f0 con 0x7f65ec003a60 2023-10-06T02:30:07.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.837+0000 7f660c4cb700 1 -- 172.21.15.6:0/1504860018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec003a60 msgr2=0x7f65ec003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:07.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.837+0000 7f660c4cb700 1 --2- 172.21.15.6:0/1504860018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec003a60 0x7f65ec003e70 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00a900 tx=0x7f66040ccc80 comp rx=0 tx=0).stop 2023-10-06T02:30:07.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.837+0000 7f660c4cb700 1 -- 172.21.15.6:0/1504860018 shutdown_connections 2023-10-06T02:30:07.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.837+0000 7f660c4cb700 1 --2- 172.21.15.6:0/1504860018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec003a60 0x7f65ec003e70 unknown :-1 s=CLOSED pgs=2390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.837+0000 7f660c4cb700 1 -- 172.21.15.6:0/1504860018 >> 172.21.15.6:0/1504860018 conn(0x7f6604068680 msgr2=0x7f6604068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:07.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.838+0000 7f660c4cb700 1 -- 172.21.15.6:0/1504860018 shutdown_connections 2023-10-06T02:30:07.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.838+0000 7f660c4cb700 1 -- 172.21.15.6:0/1504860018 wait complete. 2023-10-06T02:30:07.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.839+0000 7f660c4cb700 1 Processor -- start 2023-10-06T02:30:07.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.839+0000 7f660c4cb700 1 -- start start 2023-10-06T02:30:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.839+0000 7f660c4cb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec003a60 0x7f660416aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.839+0000 7f660c4cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66040b5c20 0x7f6604169870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.839+0000 7f660c4cb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66040a8e80 0x7f66040a9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.839+0000 7f660c4cb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66040a9840 con 0x7f66040b5c20 2023-10-06T02:30:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.839+0000 7f660c4cb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660415a530 con 0x7f65ec003a60 2023-10-06T02:30:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.839+0000 7f660c4cb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66040a7f10 con 0x7f66040a8e80 2023-10-06T02:30:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.839+0000 7f6609a66700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66040b5c20 0x7f6604169870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.839+0000 7f6609a66700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66040b5c20 0x7f6604169870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42630/0 (socket says 172.21.15.6:42630) 2023-10-06T02:30:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.839+0000 7f6609a66700 1 -- 172.21.15.6:0/3205114064 learned_addr learned my addr 172.21.15.6:0/3205114064 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:07.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.840+0000 7f660aa68700 1 --2- 172.21.15.6:0/3205114064 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66040a8e80 0x7f66040a9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:07.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.840+0000 7f660a267700 1 --2- 172.21.15.6:0/3205114064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec003a60 0x7f660416aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:07.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.840+0000 7f6609a66700 1 -- 172.21.15.6:0/3205114064 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66040a8e80 msgr2=0x7f66040a9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:07.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.840+0000 7f6609a66700 1 --2- 172.21.15.6:0/3205114064 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66040a8e80 0x7f66040a9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.840+0000 7f6609a66700 1 -- 172.21.15.6:0/3205114064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec003a60 msgr2=0x7f660416aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:07.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.840+0000 7f6609a66700 1 --2- 172.21.15.6:0/3205114064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec003a60 0x7f660416aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:07.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.840+0000 7f6609a66700 1 -- 172.21.15.6:0/3205114064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660416af80 con 0x7f66040b5c20 2023-10-06T02:30:07.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.840+0000 7f660aa68700 1 --2- 172.21.15.6:0/3205114064 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66040a8e80 0x7f66040a9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:07.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.840+0000 7f660a267700 1 --2- 172.21.15.6:0/3205114064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec003a60 0x7f660416aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:07.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.840+0000 7f6609a66700 1 --2- 172.21.15.6:0/3205114064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66040b5c20 0x7f6604169870 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f65f8002950 tx=0x7f65f8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:07.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.840+0000 7f66027fc700 1 -- 172.21.15.6:0/3205114064 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8006820 con 0x7f66040b5c20 2023-10-06T02:30:07.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.840+0000 7f66027fc700 1 -- 172.21.15.6:0/3205114064 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f8006980 con 0x7f66040b5c20 2023-10-06T02:30:07.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.840+0000 7f660c4cb700 1 -- 172.21.15.6:0/3205114064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66040a7300 con 0x7f66040b5c20 2023-10-06T02:30:07.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.840+0000 7f66027fc700 1 -- 172.21.15.6:0/3205114064 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8006d20 con 0x7f66040b5c20 2023-10-06T02:30:07.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.840+0000 7f660c4cb700 1 -- 172.21.15.6:0/3205114064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66040a78c0 con 0x7f66040b5c20 2023-10-06T02:30:07.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.841+0000 7f660c4cb700 1 -- 172.21.15.6:0/3205114064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66040a8080 con 0x7f66040b5c20 2023-10-06T02:30:07.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.842+0000 7f66027fc700 1 -- 172.21.15.6:0/3205114064 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65f8007260 con 0x7f66040b5c20 2023-10-06T02:30:07.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.842+0000 7f66027fc700 1 --2- 172.21.15.6:0/3205114064 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f65f0066f30 0x7f65f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:07.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.842+0000 7f66027fc700 1 -- 172.21.15.6:0/3205114064 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f65f8084920 con 0x7f66040b5c20 2023-10-06T02:30:07.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.842+0000 7f660a267700 1 --2- 172.21.15.6:0/3205114064 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f65f0066f30 0x7f65f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:07.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.843+0000 7f660a267700 1 --2- 172.21.15.6:0/3205114064 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f65f0066f30 0x7f65f00693e0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f66040aaf80 tx=0x7f65fc015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:07.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:07.846+0000 7f66027fc700 1 -- 172.21.15.6:0/3205114064 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65f8055380 con 0x7f66040b5c20 2023-10-06T02:30:08.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.043+0000 7f660c4cb700 1 -- 172.21.15.6:0/3205114064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66040cad20 con 0x7f66040b5c20 2023-10-06T02:30:08.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.044+0000 7f66027fc700 1 -- 172.21.15.6:0/3205114064 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+17050 (secure 0 0 0) 0x7f65f8054f10 con 0x7f66040b5c20 2023-10-06T02:30:08.045 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:08.046 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":145,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:30:06.714949+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:30:04.464332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T02:30:05.694424+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:30:08.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.046+0000 7f660c4cb700 1 -- 172.21.15.6:0/3205114064 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f65f0066f30 msgr2=0x7f65f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:08.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.046+0000 7f660c4cb700 1 --2- 172.21.15.6:0/3205114064 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f65f0066f30 0x7f65f00693e0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f66040aaf80 tx=0x7f65fc015000 comp rx=0 tx=0).stop 2023-10-06T02:30:08.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.046+0000 7f660c4cb700 1 -- 172.21.15.6:0/3205114064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66040b5c20 msgr2=0x7f6604169870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:08.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.046+0000 7f660c4cb700 1 --2- 172.21.15.6:0/3205114064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66040b5c20 0x7f6604169870 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f65f8002950 tx=0x7f65f8007d30 comp rx=0 tx=0).stop 2023-10-06T02:30:08.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.046+0000 7f660c4cb700 1 -- 172.21.15.6:0/3205114064 shutdown_connections 2023-10-06T02:30:08.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.046+0000 7f660c4cb700 1 --2- 172.21.15.6:0/3205114064 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66040a8e80 0x7f66040a9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:08.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.046+0000 7f660c4cb700 1 --2- 172.21.15.6:0/3205114064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec003a60 0x7f660416aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:08.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.046+0000 7f660c4cb700 1 --2- 172.21.15.6:0/3205114064 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f65f0066f30 0x7f65f00693e0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:08.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.046+0000 7f660c4cb700 1 --2- 172.21.15.6:0/3205114064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66040b5c20 0x7f6604169870 unknown :-1 s=CLOSED pgs=2391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:08.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.046+0000 7f660c4cb700 1 -- 172.21.15.6:0/3205114064 >> 172.21.15.6:0/3205114064 conn(0x7f6604068680 msgr2=0x7f660415d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:08.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.046+0000 7f660c4cb700 1 -- 172.21.15.6:0/3205114064 shutdown_connections 2023-10-06T02:30:08.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.046+0000 7f660c4cb700 1 -- 172.21.15.6:0/3205114064 wait complete. 2023-10-06T02:30:08.060 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:30:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.180+0000 7f0a60175700 1 Processor -- start 2023-10-06T02:30:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.180+0000 7f0a60175700 1 -- start start 2023-10-06T02:30:08.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.181+0000 7f0a60175700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a5815a030 0x7f0a5815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:08.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.181+0000 7f0a60175700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0a5815a940 0x7f0a58086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:08.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.181+0000 7f0a60175700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a580afc50 con 0x7f0a58087530 2023-10-06T02:30:08.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.181+0000 7f0a60175700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a580879d0 con 0x7f0a5815a030 2023-10-06T02:30:08.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.181+0000 7f0a60175700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a580b0cf0 con 0x7f0a5815a940 2023-10-06T02:30:08.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.181+0000 7f0a5e712700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0a58087530 0x7f0a580b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46578/0 (socket says 172.21.15.6:46578) 2023-10-06T02:30:08.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.181+0000 7f0a5e712700 1 -- 172.21.15.6:0/3011284887 learned_addr learned my addr 172.21.15.6:0/3011284887 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:08.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.181+0000 7f0a5df11700 1 --2- 172.21.15.6:0/3011284887 >> v2:172.21.15.6:3300/0 conn(0x7f0a5815a030 0x7f0a5815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:08.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.181+0000 7f0a5d710700 1 --2- 172.21.15.6:0/3011284887 >> v2:172.21.15.175:3300/0 conn(0x7f0a5815a940 0x7f0a58086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:08.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.182+0000 7f0a5cf0f700 1 -- 172.21.15.6:0/3011284887 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236292597 0 0) 0x7f0a580afc50 con 0x7f0a58087530 2023-10-06T02:30:08.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.182+0000 7f0a5cf0f700 1 -- 172.21.15.6:0/3011284887 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a40003570 con 0x7f0a58087530 2023-10-06T02:30:08.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.182+0000 7f0a5df11700 1 -- 172.21.15.6:0/3011284887 >> v2:172.21.15.175:3300/0 conn(0x7f0a5815a940 msgr2=0x7f0a58086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:08.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.182+0000 7f0a5df11700 1 --2- 172.21.15.6:0/3011284887 >> v2:172.21.15.175:3300/0 conn(0x7f0a5815a940 0x7f0a58086ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:08.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.182+0000 7f0a5df11700 1 -- 172.21.15.6:0/3011284887 >> v1:172.21.15.6:6789/0 conn(0x7f0a58087530 legacy=0x7f0a580b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:08.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.182+0000 7f0a5df11700 1 -- 172.21.15.6:0/3011284887 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a580aff30 con 0x7f0a5815a030 2023-10-06T02:30:08.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.182+0000 7f0a5df11700 1 --2- 172.21.15.6:0/3011284887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a5815a030 0x7f0a5815a400 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f0a58157800 tx=0x7f0a480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e30ad5c82cacfa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:08.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.182+0000 7f0a5cf0f700 1 -- 172.21.15.6:0/3011284887 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a48011630 con 0x7f0a5815a030 2023-10-06T02:30:08.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.182+0000 7f0a5cf0f700 1 -- 172.21.15.6:0/3011284887 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a48011790 con 0x7f0a5815a030 2023-10-06T02:30:08.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.182+0000 7f0a5cf0f700 1 -- 172.21.15.6:0/3011284887 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a48011b30 con 0x7f0a5815a030 2023-10-06T02:30:08.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.182+0000 7f0a60175700 1 -- 172.21.15.6:0/3011284887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a5815a030 msgr2=0x7f0a5815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:08.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.182+0000 7f0a60175700 1 --2- 172.21.15.6:0/3011284887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a5815a030 0x7f0a5815a400 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f0a58157800 tx=0x7f0a480091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:08.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.182+0000 7f0a60175700 1 -- 172.21.15.6:0/3011284887 shutdown_connections 2023-10-06T02:30:08.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.182+0000 7f0a60175700 1 --2- 172.21.15.6:0/3011284887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a5815a030 0x7f0a5815a400 unknown :-1 s=CLOSED pgs=2393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:08.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.182+0000 7f0a60175700 1 --2- 172.21.15.6:0/3011284887 >> v2:172.21.15.175:3300/0 conn(0x7f0a5815a940 0x7f0a58086ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:08.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.182+0000 7f0a60175700 1 -- 172.21.15.6:0/3011284887 >> 172.21.15.6:0/3011284887 conn(0x7f0a58068680 msgr2=0x7f0a58068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:08.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.183+0000 7f0a60175700 1 -- 172.21.15.6:0/3011284887 shutdown_connections 2023-10-06T02:30:08.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.183+0000 7f0a60175700 1 -- 172.21.15.6:0/3011284887 wait complete. 2023-10-06T02:30:08.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.184+0000 7f0a60175700 1 Processor -- start 2023-10-06T02:30:08.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.184+0000 7f0a60175700 1 -- start start 2023-10-06T02:30:08.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.184+0000 7f0a60175700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a58087530 0x7f0a58148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:08.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.184+0000 7f0a60175700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a5815a030 0x7f0a5816d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:08.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.184+0000 7f0a60175700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a5815a940 0x7f0a5816d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:08.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.184+0000 7f0a60175700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580c79a0 con 0x7f0a58087530 2023-10-06T02:30:08.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.184+0000 7f0a60175700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580c6990 con 0x7f0a5815a940 2023-10-06T02:30:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.184+0000 7f0a60175700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a58148e50 con 0x7f0a5815a030 2023-10-06T02:30:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.185+0000 7f0a5df11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a58087530 0x7f0a58148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.185+0000 7f0a5df11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a58087530 0x7f0a58148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42644/0 (socket says 172.21.15.6:42644) 2023-10-06T02:30:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.185+0000 7f0a5df11700 1 -- 172.21.15.6:0/4252734440 learned_addr learned my addr 172.21.15.6:0/4252734440 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.185+0000 7f0a5d710700 1 --2- 172.21.15.6:0/4252734440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a5815a030 0x7f0a5816d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.185+0000 7f0a5e712700 1 --2- 172.21.15.6:0/4252734440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a5815a940 0x7f0a5816d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.185+0000 7f0a5df11700 1 -- 172.21.15.6:0/4252734440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a5815a030 msgr2=0x7f0a5816d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.185+0000 7f0a5df11700 1 --2- 172.21.15.6:0/4252734440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a5815a030 0x7f0a5816d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.185+0000 7f0a5df11700 1 -- 172.21.15.6:0/4252734440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a5815a940 msgr2=0x7f0a5816d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.185+0000 7f0a5df11700 1 --2- 172.21.15.6:0/4252734440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a5815a940 0x7f0a5816d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.185+0000 7f0a5df11700 1 -- 172.21.15.6:0/4252734440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a48009420 con 0x7f0a58087530 2023-10-06T02:30:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.185+0000 7f0a5d710700 1 --2- 172.21.15.6:0/4252734440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a5815a030 0x7f0a5816d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.185+0000 7f0a5df11700 1 --2- 172.21.15.6:0/4252734440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a58087530 0x7f0a58148910 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7f0a580891b0 tx=0x7f0a48017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.185+0000 7f0a55ffb700 1 -- 172.21.15.6:0/4252734440 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4801bca0 con 0x7f0a58087530 2023-10-06T02:30:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.185+0000 7f0a55ffb700 1 -- 172.21.15.6:0/4252734440 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4801be20 con 0x7f0a58087530 2023-10-06T02:30:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.185+0000 7f0a60175700 1 -- 172.21.15.6:0/4252734440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a580c7390 con 0x7f0a58087530 2023-10-06T02:30:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.185+0000 7f0a55ffb700 1 -- 172.21.15.6:0/4252734440 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a48025670 con 0x7f0a58087530 2023-10-06T02:30:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.185+0000 7f0a60175700 1 -- 172.21.15.6:0/4252734440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a580c7630 con 0x7f0a58087530 2023-10-06T02:30:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.186+0000 7f0a60175700 1 -- 172.21.15.6:0/4252734440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a58088700 con 0x7f0a58087530 2023-10-06T02:30:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.187+0000 7f0a55ffb700 1 -- 172.21.15.6:0/4252734440 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a48023070 con 0x7f0a58087530 2023-10-06T02:30:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.187+0000 7f0a55ffb700 1 --2- 172.21.15.6:0/4252734440 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a44066f30 0x7f0a440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.187+0000 7f0a55ffb700 1 -- 172.21.15.6:0/4252734440 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0a48085e70 con 0x7f0a58087530 2023-10-06T02:30:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.187+0000 7f0a5d710700 1 --2- 172.21.15.6:0/4252734440 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a44066f30 0x7f0a440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:08.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.188+0000 7f0a5d710700 1 --2- 172.21.15.6:0/4252734440 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a44066f30 0x7f0a440693e0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0a580ca6a0 tx=0x7f0a4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:08.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.191+0000 7f0a55ffb700 1 -- 172.21.15.6:0/4252734440 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a48052da0 con 0x7f0a58087530 2023-10-06T02:30:08.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:08.433+0000 7f0a60175700 1 -- 172.21.15.6:0/4252734440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0a580b0210 con 0x7f0a58087530 2023-10-06T02:30:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.342+0000 7f0a55ffb700 1 -- 172.21.15.6:0/4252734440 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v358) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0a480150b0 con 0x7f0a58087530 2023-10-06T02:30:09.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.345+0000 7f0a60175700 1 -- 172.21.15.6:0/4252734440 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a44066f30 msgr2=0x7f0a440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:09.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.345+0000 7f0a60175700 1 --2- 172.21.15.6:0/4252734440 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a44066f30 0x7f0a440693e0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0a580ca6a0 tx=0x7f0a4c008040 comp rx=0 tx=0).stop 2023-10-06T02:30:09.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.345+0000 7f0a60175700 1 -- 172.21.15.6:0/4252734440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a58087530 msgr2=0x7f0a58148910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:09.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.345+0000 7f0a60175700 1 --2- 172.21.15.6:0/4252734440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a58087530 0x7f0a58148910 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7f0a580891b0 tx=0x7f0a48017000 comp rx=0 tx=0).stop 2023-10-06T02:30:09.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.345+0000 7f0a60175700 1 -- 172.21.15.6:0/4252734440 shutdown_connections 2023-10-06T02:30:09.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.345+0000 7f0a60175700 1 --2- 172.21.15.6:0/4252734440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a5815a940 0x7f0a5816d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:09.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.345+0000 7f0a60175700 1 --2- 172.21.15.6:0/4252734440 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a44066f30 0x7f0a440693e0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:09.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.345+0000 7f0a60175700 1 --2- 172.21.15.6:0/4252734440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a58087530 0x7f0a58148910 unknown :-1 s=CLOSED pgs=2394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:09.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.345+0000 7f0a60175700 1 --2- 172.21.15.6:0/4252734440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a5815a030 0x7f0a5816d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:09.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.345+0000 7f0a60175700 1 -- 172.21.15.6:0/4252734440 >> 172.21.15.6:0/4252734440 conn(0x7f0a58068680 msgr2=0x7f0a580b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:09.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.345+0000 7f0a60175700 1 -- 172.21.15.6:0/4252734440 shutdown_connections 2023-10-06T02:30:09.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.345+0000 7f0a60175700 1 -- 172.21.15.6:0/4252734440 wait complete. 2023-10-06T02:30:09.361 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:30:09.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.489+0000 7f39071b6700 1 Processor -- start 2023-10-06T02:30:09.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.489+0000 7f39071b6700 1 -- start start 2023-10-06T02:30:09.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.489+0000 7f39071b6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f390015a030 0x7f390015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:09.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f39071b6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3900087700 0x7f39000b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:09.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f39071b6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39000afc50 con 0x7f390015a940 2023-10-06T02:30:09.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f39071b6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39000b0cf0 con 0x7f390015a030 2023-10-06T02:30:09.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f39071b6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39000aff30 con 0x7f3900087700 2023-10-06T02:30:09.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38fffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f390015a940 0x7f3900086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56290/0 (socket says 172.21.15.6:56290) 2023-10-06T02:30:09.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38fffff700 1 -- 172.21.15.6:0/1004881495 learned_addr learned my addr 172.21.15.6:0/1004881495 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:09.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f3905753700 1 --2- 172.21.15.6:0/1004881495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3900087700 0x7f39000b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:09.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f3904f52700 1 --2- 172.21.15.6:0/1004881495 >> v2:172.21.15.175:3300/0 conn(0x7f390015a030 0x7f390015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:09.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38ff7fe700 1 -- 172.21.15.6:0/1004881495 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879029666 0 0) 0x7f39000afc50 con 0x7f390015a940 2023-10-06T02:30:09.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38ff7fe700 1 -- 172.21.15.6:0/1004881495 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38ec003570 con 0x7f390015a940 2023-10-06T02:30:09.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38ff7fe700 1 -- 172.21.15.6:0/1004881495 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1810160669 0 0) 0x7f38ec003570 con 0x7f390015a940 2023-10-06T02:30:09.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38ff7fe700 1 -- 172.21.15.6:0/1004881495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3900087700 msgr2=0x7f39000b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:09.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38ff7fe700 1 --2- 172.21.15.6:0/1004881495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3900087700 0x7f39000b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:09.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38ff7fe700 1 -- 172.21.15.6:0/1004881495 >> v2:172.21.15.175:3300/0 conn(0x7f390015a030 msgr2=0x7f390015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:09.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38ff7fe700 1 --2- 172.21.15.6:0/1004881495 >> v2:172.21.15.175:3300/0 conn(0x7f390015a030 0x7f390015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:09.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38ff7fe700 1 -- 172.21.15.6:0/1004881495 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39000b0210 con 0x7f390015a940 2023-10-06T02:30:09.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38ff7fe700 1 -- 172.21.15.6:0/1004881495 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f38e8001470 con 0x7f390015a940 2023-10-06T02:30:09.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f3904f52700 1 --2- 172.21.15.6:0/1004881495 >> v2:172.21.15.175:3300/0 conn(0x7f390015a030 0x7f390015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:30:09.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38ff7fe700 1 -- 172.21.15.6:0/1004881495 >> v1:172.21.15.6:6789/0 conn(0x7f390015a940 legacy=0x7f3900086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:09.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38ff7fe700 1 --2- 172.21.15.6:0/1004881495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3900087700 0x7f38ec003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:09.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38ff7fe700 1 --2- 172.21.15.6:0/1004881495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ec003fe0 0x7f38ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:09.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38ff7fe700 1 --2- 172.21.15.6:0/1004881495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38ec004d50 0x7f38ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:09.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38ff7fe700 1 -- 172.21.15.6:0/1004881495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39000b0cf0 con 0x7f38ec003fe0 2023-10-06T02:30:09.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38ff7fe700 1 -- 172.21.15.6:0/1004881495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39000aff30 con 0x7f38ec004d50 2023-10-06T02:30:09.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38ff7fe700 1 -- 172.21.15.6:0/1004881495 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec00ba90 con 0x7f3900087700 2023-10-06T02:30:09.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.490+0000 7f38fffff700 1 --2- 172.21.15.6:0/1004881495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ec003fe0 0x7f38ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:09.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.491+0000 7f3904f52700 1 --2- 172.21.15.6:0/1004881495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3900087700 0x7f38ec003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:09.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.491+0000 7f3905753700 1 --2- 172.21.15.6:0/1004881495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38ec004d50 0x7f38ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:09.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.491+0000 7f38fffff700 1 -- 172.21.15.6:0/1004881495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3900087700 msgr2=0x7f38ec003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:09.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.491+0000 7f38fffff700 1 --2- 172.21.15.6:0/1004881495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3900087700 0x7f38ec003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:09.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.491+0000 7f38fffff700 1 -- 172.21.15.6:0/1004881495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38ec004d50 msgr2=0x7f38ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:09.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.491+0000 7f38fffff700 1 --2- 172.21.15.6:0/1004881495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38ec004d50 0x7f38ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:09.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.491+0000 7f38fffff700 1 -- 172.21.15.6:0/1004881495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ec003570 con 0x7f38ec003fe0 2023-10-06T02:30:09.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.491+0000 7f38fffff700 1 --2- 172.21.15.6:0/1004881495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ec003fe0 0x7f38ec004810 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f390015ad30 tx=0x7f38e8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81757b648a1c68e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:09.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.491+0000 7f38ff7fe700 1 -- 172.21.15.6:0/1004881495 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e800cbd0 con 0x7f38ec003fe0 2023-10-06T02:30:09.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.491+0000 7f38ff7fe700 1 -- 172.21.15.6:0/1004881495 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e800cd30 con 0x7f38ec003fe0 2023-10-06T02:30:09.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.491+0000 7f38ff7fe700 1 -- 172.21.15.6:0/1004881495 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e800cea0 con 0x7f38ec003fe0 2023-10-06T02:30:09.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.492+0000 7f39071b6700 1 -- 172.21.15.6:0/1004881495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ec003fe0 msgr2=0x7f38ec004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:09.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.492+0000 7f39071b6700 1 --2- 172.21.15.6:0/1004881495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ec003fe0 0x7f38ec004810 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f390015ad30 tx=0x7f38e8001e90 comp rx=0 tx=0).stop 2023-10-06T02:30:09.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.492+0000 7f3905753700 1 -- 172.21.15.6:0/1004881495 reap_dead start 2023-10-06T02:30:09.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.492+0000 7f39071b6700 1 -- 172.21.15.6:0/1004881495 shutdown_connections 2023-10-06T02:30:09.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.492+0000 7f39071b6700 1 -- 172.21.15.6:0/1004881495 >> 172.21.15.6:0/1004881495 conn(0x7f3900068680 msgr2=0x7f3900068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:09.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.492+0000 7f39071b6700 1 -- 172.21.15.6:0/1004881495 shutdown_connections 2023-10-06T02:30:09.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.492+0000 7f39071b6700 1 -- 172.21.15.6:0/1004881495 wait complete. 2023-10-06T02:30:09.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.493+0000 7f39071b6700 1 Processor -- start 2023-10-06T02:30:09.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.493+0000 7f39071b6700 1 -- start start 2023-10-06T02:30:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f39071b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39000c5a40 0x7f390015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f39071b6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390015ad60 0x7f39000b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f39071b6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39000c5e10 0x7f39000b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f39071b6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390015dad0 con 0x7f39000c5a40 2023-10-06T02:30:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f39071b6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390015d460 con 0x7f39000c5e10 2023-10-06T02:30:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f39071b6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39000c7ae0 con 0x7f390015ad60 2023-10-06T02:30:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f3904f52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39000c5a40 0x7f390015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f3904f52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39000c5a40 0x7f390015cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40206/0 (socket says 172.21.15.6:40206) 2023-10-06T02:30:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f3904f52700 1 -- 172.21.15.6:0/2713710100 learned_addr learned my addr 172.21.15.6:0/2713710100 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f38fffff700 1 --2- 172.21.15.6:0/2713710100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390015ad60 0x7f39000b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f3905753700 1 --2- 172.21.15.6:0/2713710100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39000c5e10 0x7f39000b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:09.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f3904f52700 1 -- 172.21.15.6:0/2713710100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390015ad60 msgr2=0x7f39000b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:09.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f3904f52700 1 --2- 172.21.15.6:0/2713710100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390015ad60 0x7f39000b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:09.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f3904f52700 1 -- 172.21.15.6:0/2713710100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39000c5e10 msgr2=0x7f39000b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:09.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f3904f52700 1 --2- 172.21.15.6:0/2713710100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39000c5e10 0x7f39000b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:09.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f3904f52700 1 -- 172.21.15.6:0/2713710100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390015bb70 con 0x7f39000c5a40 2023-10-06T02:30:09.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f3904f52700 1 --2- 172.21.15.6:0/2713710100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39000c5a40 0x7f390015cf20 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f38f800f340 tx=0x7f38f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:09.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.494+0000 7f38fcff9700 1 -- 172.21.15.6:0/2713710100 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f800e040 con 0x7f39000c5a40 2023-10-06T02:30:09.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.495+0000 7f38fcff9700 1 -- 172.21.15.6:0/2713710100 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f800f040 con 0x7f39000c5a40 2023-10-06T02:30:09.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.495+0000 7f38fcff9700 1 -- 172.21.15.6:0/2713710100 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f8015680 con 0x7f39000c5a40 2023-10-06T02:30:09.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.495+0000 7f39071b6700 1 -- 172.21.15.6:0/2713710100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390015b2d0 con 0x7f39000c5a40 2023-10-06T02:30:09.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.495+0000 7f39071b6700 1 -- 172.21.15.6:0/2713710100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390015b910 con 0x7f39000c5a40 2023-10-06T02:30:09.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.495+0000 7f39071b6700 1 -- 172.21.15.6:0/2713710100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3900088700 con 0x7f39000c5a40 2023-10-06T02:30:09.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.496+0000 7f38fcff9700 1 -- 172.21.15.6:0/2713710100 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f38f8015a30 con 0x7f39000c5a40 2023-10-06T02:30:09.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.496+0000 7f38fcff9700 1 --2- 172.21.15.6:0/2713710100 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38e0066f30 0x7f38e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:09.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.496+0000 7f38fcff9700 1 -- 172.21.15.6:0/2713710100 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f38f8085690 con 0x7f39000c5a40 2023-10-06T02:30:09.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.497+0000 7f38fffff700 1 --2- 172.21.15.6:0/2713710100 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38e0066f30 0x7f38e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:09.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.497+0000 7f38fffff700 1 --2- 172.21.15.6:0/2713710100 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38e0066f30 0x7f38e00693e0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f3900061160 tx=0x7f38e8015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:09.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.502+0000 7f38fcff9700 1 -- 172.21.15.6:0/2713710100 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38f80560f0 con 0x7f39000c5a40 2023-10-06T02:30:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:09.740+0000 7f39071b6700 1 -- 172.21.15.6:0/2713710100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f39000b04f0 con 0x7f39000c5a40 2023-10-06T02:30:10.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.343+0000 7f38fcff9700 1 -- 172.21.15.6:0/2713710100 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v359) v1 ==== 122+0+0 (secure 0 0 0) 0x7f38f8055c80 con 0x7f39000c5a40 2023-10-06T02:30:10.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.346+0000 7f39071b6700 1 -- 172.21.15.6:0/2713710100 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38e0066f30 msgr2=0x7f38e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.346+0000 7f39071b6700 1 --2- 172.21.15.6:0/2713710100 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38e0066f30 0x7f38e00693e0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f3900061160 tx=0x7f38e8015000 comp rx=0 tx=0).stop 2023-10-06T02:30:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.346+0000 7f39071b6700 1 -- 172.21.15.6:0/2713710100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39000c5a40 msgr2=0x7f390015cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.346+0000 7f39071b6700 1 --2- 172.21.15.6:0/2713710100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39000c5a40 0x7f390015cf20 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f38f800f340 tx=0x7f38f800b040 comp rx=0 tx=0).stop 2023-10-06T02:30:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.346+0000 7f39071b6700 1 -- 172.21.15.6:0/2713710100 shutdown_connections 2023-10-06T02:30:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.346+0000 7f39071b6700 1 --2- 172.21.15.6:0/2713710100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39000c5e10 0x7f39000b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.346+0000 7f39071b6700 1 --2- 172.21.15.6:0/2713710100 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38e0066f30 0x7f38e00693e0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.346+0000 7f39071b6700 1 --2- 172.21.15.6:0/2713710100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39000c5a40 0x7f390015cf20 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.346+0000 7f39071b6700 1 --2- 172.21.15.6:0/2713710100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390015ad60 0x7f39000b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.346+0000 7f39071b6700 1 -- 172.21.15.6:0/2713710100 >> 172.21.15.6:0/2713710100 conn(0x7f3900068680 msgr2=0x7f3900157800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.346+0000 7f39071b6700 1 -- 172.21.15.6:0/2713710100 shutdown_connections 2023-10-06T02:30:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.346+0000 7f39071b6700 1 -- 172.21.15.6:0/2713710100 wait complete. 2023-10-06T02:30:10.362 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:30:10.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.488+0000 7ff7edab6700 1 Processor -- start 2023-10-06T02:30:10.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.488+0000 7ff7edab6700 1 -- start start 2023-10-06T02:30:10.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.489+0000 7ff7edab6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7e81597c0 0x7ff7e806a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:10.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.489+0000 7ff7edab6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e8069950 con 0x7ff7e81593f0 2023-10-06T02:30:10.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.489+0000 7ff7edab6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e80b1fb0 con 0x7ff7e806e520 2023-10-06T02:30:10.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.489+0000 7ff7edab6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e80b2850 con 0x7ff7e81597c0 2023-10-06T02:30:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.489+0000 7ff7e77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff7e81593f0 0x7ff7e806de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56298/0 (socket says 172.21.15.6:56298) 2023-10-06T02:30:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.489+0000 7ff7e77fe700 1 -- 172.21.15.6:0/2149501698 learned_addr learned my addr 172.21.15.6:0/2149501698 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.489+0000 7ff7e7fff700 1 --2- 172.21.15.6:0/2149501698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7e81597c0 0x7ff7e806a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.489+0000 7ff7e6ffd700 1 -- 172.21.15.6:0/2149501698 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3404102738 0 0) 0x7ff7e8069950 con 0x7ff7e81593f0 2023-10-06T02:30:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.489+0000 7ff7e6ffd700 1 -- 172.21.15.6:0/2149501698 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7d4003570 con 0x7ff7e81593f0 2023-10-06T02:30:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.489+0000 7ff7e6ffd700 1 -- 172.21.15.6:0/2149501698 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3979999858 0 0) 0x7ff7d4003570 con 0x7ff7e81593f0 2023-10-06T02:30:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.489+0000 7ff7e6ffd700 1 -- 172.21.15.6:0/2149501698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7e81597c0 msgr2=0x7ff7e806a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.489+0000 7ff7e6ffd700 1 --2- 172.21.15.6:0/2149501698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7e81597c0 0x7ff7e806a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.489+0000 7ff7e6ffd700 1 -- 172.21.15.6:0/2149501698 >> v1:172.21.15.175:6789/0 conn(0x7ff7e806e520 legacy=0x7ff7e8069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e6ffd700 1 -- 172.21.15.6:0/2149501698 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e80b2290 con 0x7ff7e81593f0 2023-10-06T02:30:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e6ffd700 1 -- 172.21.15.6:0/2149501698 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7ff7d8001470 con 0x7ff7e81593f0 2023-10-06T02:30:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e6ffd700 1 -- 172.21.15.6:0/2149501698 >> v1:172.21.15.6:6789/0 conn(0x7ff7e81593f0 legacy=0x7ff7e806de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e6ffd700 1 --2- 172.21.15.6:0/2149501698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7d4003a90 0x7ff7d4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e6ffd700 1 --2- 172.21.15.6:0/2149501698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7e81597c0 0x7ff7d4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e6ffd700 1 --2- 172.21.15.6:0/2149501698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7d4004d50 0x7ff7d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e6ffd700 1 -- 172.21.15.6:0/2149501698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e80b2850 con 0x7ff7d4004d50 2023-10-06T02:30:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e6ffd700 1 -- 172.21.15.6:0/2149501698 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d400bb70 con 0x7ff7d4003a90 2023-10-06T02:30:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e6ffd700 1 -- 172.21.15.6:0/2149501698 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d400bd30 con 0x7ff7e81597c0 2023-10-06T02:30:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e7fff700 1 --2- 172.21.15.6:0/2149501698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7d4004d50 0x7ff7d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e77fe700 1 --2- 172.21.15.6:0/2149501698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7d4003a90 0x7ff7d4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7dffff700 1 --2- 172.21.15.6:0/2149501698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7e81597c0 0x7ff7d4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e7fff700 1 -- 172.21.15.6:0/2149501698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7e81597c0 msgr2=0x7ff7d4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e7fff700 1 --2- 172.21.15.6:0/2149501698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7e81597c0 0x7ff7d4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e7fff700 1 -- 172.21.15.6:0/2149501698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7d4003a90 msgr2=0x7ff7d4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e7fff700 1 --2- 172.21.15.6:0/2149501698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7d4003a90 0x7ff7d4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e7fff700 1 -- 172.21.15.6:0/2149501698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d4003570 con 0x7ff7d4004d50 2023-10-06T02:30:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e77fe700 1 --2- 172.21.15.6:0/2149501698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7d4003a90 0x7ff7d4003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:30:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e7fff700 1 --2- 172.21.15.6:0/2149501698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7d4004d50 0x7ff7d40051c0 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000e210 tx=0x7ff7e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89467f32c179f473 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e6ffd700 1 -- 172.21.15.6:0/2149501698 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e000eac0 con 0x7ff7d4004d50 2023-10-06T02:30:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e6ffd700 1 -- 172.21.15.6:0/2149501698 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e000f040 con 0x7ff7d4004d50 2023-10-06T02:30:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.490+0000 7ff7e6ffd700 1 -- 172.21.15.6:0/2149501698 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e000ee70 con 0x7ff7d4004d50 2023-10-06T02:30:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.491+0000 7ff7edab6700 1 -- 172.21.15.6:0/2149501698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7d4004d50 msgr2=0x7ff7d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.491+0000 7ff7edab6700 1 --2- 172.21.15.6:0/2149501698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7d4004d50 0x7ff7d40051c0 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000e210 tx=0x7ff7e000b040 comp rx=0 tx=0).stop 2023-10-06T02:30:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.491+0000 7ff7e7fff700 1 -- 172.21.15.6:0/2149501698 reap_dead start 2023-10-06T02:30:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.491+0000 7ff7edab6700 1 -- 172.21.15.6:0/2149501698 shutdown_connections 2023-10-06T02:30:10.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.491+0000 7ff7edab6700 1 -- 172.21.15.6:0/2149501698 >> 172.21.15.6:0/2149501698 conn(0x7ff7e806cff0 msgr2=0x7ff7e80afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:10.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.491+0000 7ff7edab6700 1 -- 172.21.15.6:0/2149501698 shutdown_connections 2023-10-06T02:30:10.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.491+0000 7ff7edab6700 1 -- 172.21.15.6:0/2149501698 wait complete. 2023-10-06T02:30:10.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.492+0000 7ff7edab6700 1 Processor -- start 2023-10-06T02:30:10.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.492+0000 7ff7edab6700 1 -- start start 2023-10-06T02:30:10.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.493+0000 7ff7edab6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8143c10 0x7ff7e81534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:10.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.493+0000 7ff7edab6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7e80c72d0 0x7ff7e815f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.493+0000 7ff7edab6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7e80c7740 0x7ff7e815fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.493+0000 7ff7edab6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e81521f0 con 0x7ff7e8143c10 2023-10-06T02:30:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.493+0000 7ff7edab6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e8153010 con 0x7ff7e80c7740 2023-10-06T02:30:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.493+0000 7ff7edab6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e8152400 con 0x7ff7e80c72d0 2023-10-06T02:30:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.493+0000 7ff7e77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8143c10 0x7ff7e81534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.493+0000 7ff7e77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8143c10 0x7ff7e81534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40214/0 (socket says 172.21.15.6:40214) 2023-10-06T02:30:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.493+0000 7ff7e77fe700 1 -- 172.21.15.6:0/3264191868 learned_addr learned my addr 172.21.15.6:0/3264191868 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.493+0000 7ff7dffff700 1 --2- 172.21.15.6:0/3264191868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7e80c72d0 0x7ff7e815f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.493+0000 7ff7e7fff700 1 --2- 172.21.15.6:0/3264191868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7e80c7740 0x7ff7e815fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.493+0000 7ff7e77fe700 1 -- 172.21.15.6:0/3264191868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7e80c72d0 msgr2=0x7ff7e815f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.493+0000 7ff7e77fe700 1 --2- 172.21.15.6:0/3264191868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7e80c72d0 0x7ff7e815f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.493+0000 7ff7e77fe700 1 -- 172.21.15.6:0/3264191868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7e80c7740 msgr2=0x7ff7e815fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.493+0000 7ff7e77fe700 1 --2- 172.21.15.6:0/3264191868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7e80c7740 0x7ff7e815fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.493+0000 7ff7e77fe700 1 -- 172.21.15.6:0/3264191868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e81526e0 con 0x7ff7e8143c10 2023-10-06T02:30:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.493+0000 7ff7e77fe700 1 --2- 172.21.15.6:0/3264191868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8143c10 0x7ff7e81534a0 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8000fd0 tx=0x7ff7d8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.494+0000 7ff7df7fe700 1 -- 172.21.15.6:0/3264191868 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8018030 con 0x7ff7e8143c10 2023-10-06T02:30:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.494+0000 7ff7df7fe700 1 -- 172.21.15.6:0/3264191868 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d800f9a0 con 0x7ff7e8143c10 2023-10-06T02:30:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.494+0000 7ff7edab6700 1 -- 172.21.15.6:0/3264191868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e81529c0 con 0x7ff7e8143c10 2023-10-06T02:30:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.494+0000 7ff7df7fe700 1 -- 172.21.15.6:0/3264191868 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d800fd40 con 0x7ff7e8143c10 2023-10-06T02:30:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.494+0000 7ff7edab6700 1 -- 172.21.15.6:0/3264191868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e81539e0 con 0x7ff7e8143c10 2023-10-06T02:30:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.494+0000 7ff7edab6700 1 -- 172.21.15.6:0/3264191868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e81532f0 con 0x7ff7e8143c10 2023-10-06T02:30:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.495+0000 7ff7df7fe700 1 -- 172.21.15.6:0/3264191868 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7d801b070 con 0x7ff7e8143c10 2023-10-06T02:30:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.495+0000 7ff7df7fe700 1 --2- 172.21.15.6:0/3264191868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff7c8066f30 0x7ff7c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:10.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.495+0000 7ff7df7fe700 1 -- 172.21.15.6:0/3264191868 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff7d8019070 con 0x7ff7e8143c10 2023-10-06T02:30:10.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.496+0000 7ff7dffff700 1 --2- 172.21.15.6:0/3264191868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff7c8066f30 0x7ff7c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:10.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.496+0000 7ff7dffff700 1 --2- 172.21.15.6:0/3264191868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff7c8066f30 0x7ff7c80693e0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff7e81588b0 tx=0x7ff7d0007d80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:10.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.500+0000 7ff7df7fe700 1 -- 172.21.15.6:0/3264191868 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7d8051820 con 0x7ff7e8143c10 2023-10-06T02:30:10.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.737+0000 7ff7edab6700 1 -- 172.21.15.6:0/3264191868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7e806d3f0 con 0x7ff7e8143c10 2023-10-06T02:30:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.737+0000 7ff7df7fe700 1 -- 172.21.15.6:0/3264191868 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 359 v359) v1 ==== 95+0+4606 (secure 0 0 0) 0x7ff7d800fea0 con 0x7ff7e8143c10 2023-10-06T02:30:10.739 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:10.739 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":359,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3603762205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3603762205},{"type":"v1","addr":"172.21.15.175:6836","nonce":3603762205}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":9820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3292446255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3292446255},{"type":"v1","addr":"172.21.15.175:6837","nonce":3292446255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":10869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/759655214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":759655214},{"type":"v1","addr":"172.21.15.6:6834","nonce":759655214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354}],"filesystems":[{"mdsmap":{"epoch":359,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:30:06.715272+0000","modified":"2023-10-06T02:30:10.342009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10872},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10872":{"gid":10872,"name":"c","rank":0,"incarnation":355,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1108543434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1108543434},{"type":"v1","addr":"172.21.15.6:6835","nonce":1108543434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:30:10.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.739+0000 7ff7edab6700 1 -- 172.21.15.6:0/3264191868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff7c8066f30 msgr2=0x7ff7c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:10.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.739+0000 7ff7edab6700 1 --2- 172.21.15.6:0/3264191868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff7c8066f30 0x7ff7c80693e0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff7e81588b0 tx=0x7ff7d0007d80 comp rx=0 tx=0).stop 2023-10-06T02:30:10.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.739+0000 7ff7edab6700 1 -- 172.21.15.6:0/3264191868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8143c10 msgr2=0x7ff7e81534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.739+0000 7ff7edab6700 1 --2- 172.21.15.6:0/3264191868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8143c10 0x7ff7e81534a0 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8000fd0 tx=0x7ff7d8001e50 comp rx=0 tx=0).stop 2023-10-06T02:30:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.739+0000 7ff7edab6700 1 -- 172.21.15.6:0/3264191868 shutdown_connections 2023-10-06T02:30:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.739+0000 7ff7edab6700 1 --2- 172.21.15.6:0/3264191868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7e80c7740 0x7ff7e815fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.739+0000 7ff7edab6700 1 --2- 172.21.15.6:0/3264191868 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff7c8066f30 0x7ff7c80693e0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.739+0000 7ff7edab6700 1 --2- 172.21.15.6:0/3264191868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8143c10 0x7ff7e81534a0 unknown :-1 s=CLOSED pgs=2400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.739+0000 7ff7edab6700 1 --2- 172.21.15.6:0/3264191868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7e80c72d0 0x7ff7e815f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.740+0000 7ff7edab6700 1 -- 172.21.15.6:0/3264191868 >> 172.21.15.6:0/3264191868 conn(0x7ff7e806cff0 msgr2=0x7ff7e8153e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.740+0000 7ff7edab6700 1 -- 172.21.15.6:0/3264191868 shutdown_connections 2023-10-06T02:30:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.740+0000 7ff7edab6700 1 -- 172.21.15.6:0/3264191868 wait complete. 2023-10-06T02:30:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 359 2023-10-06T02:30:10.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:30:10.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.871+0000 7f7a65f03700 1 Processor -- start 2023-10-06T02:30:10.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.871+0000 7f7a65f03700 1 -- start start 2023-10-06T02:30:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.871+0000 7f7a65f03700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7a600af4e0 0x7f7a600b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.872+0000 7f7a65f03700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a6015e190 con 0x7f7a6015db70 2023-10-06T02:30:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.872+0000 7f7a65f03700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a600cb650 con 0x7f7a600af8b0 2023-10-06T02:30:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.872+0000 7f7a65f03700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a600b1910 con 0x7f7a600af4e0 2023-10-06T02:30:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.872+0000 7f7a5ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7a6015db70 0x7f7a600cbae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56308/0 (socket says 172.21.15.6:56308) 2023-10-06T02:30:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.872+0000 7f7a5ffff700 1 -- 172.21.15.6:0/2092420195 learned_addr learned my addr 172.21.15.6:0/2092420195 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.872+0000 7f7a5f7fe700 1 --2- 172.21.15.6:0/2092420195 >> v2:172.21.15.6:3300/0 conn(0x7f7a600af4e0 0x7f7a600b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.872+0000 7f7a5e7fc700 1 -- 172.21.15.6:0/2092420195 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931472687 0 0) 0x7f7a6015e190 con 0x7f7a6015db70 2023-10-06T02:30:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.872+0000 7f7a5e7fc700 1 -- 172.21.15.6:0/2092420195 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a48003570 con 0x7f7a6015db70 2023-10-06T02:30:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.872+0000 7f7a5f7fe700 1 -- 172.21.15.6:0/2092420195 >> v1:172.21.15.175:6789/0 conn(0x7f7a600af8b0 legacy=0x7f7a6015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.872+0000 7f7a5f7fe700 1 -- 172.21.15.6:0/2092420195 >> v1:172.21.15.6:6789/0 conn(0x7f7a6015db70 legacy=0x7f7a600cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.872+0000 7f7a5f7fe700 1 -- 172.21.15.6:0/2092420195 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a600cad20 con 0x7f7a600af4e0 2023-10-06T02:30:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.872+0000 7f7a5f7fe700 1 --2- 172.21.15.6:0/2092420195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a600af4e0 0x7f7a600b20e0 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7f7a500098e0 tx=0x7f7a500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8176cc6436f0913f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.872+0000 7f7a5e7fc700 1 -- 172.21.15.6:0/2092420195 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5000b640 con 0x7f7a600af4e0 2023-10-06T02:30:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.872+0000 7f7a5e7fc700 1 -- 172.21.15.6:0/2092420195 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5000b7a0 con 0x7f7a600af4e0 2023-10-06T02:30:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.872+0000 7f7a5e7fc700 1 -- 172.21.15.6:0/2092420195 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5000bb40 con 0x7f7a600af4e0 2023-10-06T02:30:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.873+0000 7f7a65f03700 1 -- 172.21.15.6:0/2092420195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a600af4e0 msgr2=0x7f7a600b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.873+0000 7f7a65f03700 1 --2- 172.21.15.6:0/2092420195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a600af4e0 0x7f7a600b20e0 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7f7a500098e0 tx=0x7f7a500091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.873+0000 7f7a65f03700 1 -- 172.21.15.6:0/2092420195 shutdown_connections 2023-10-06T02:30:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.873+0000 7f7a65f03700 1 --2- 172.21.15.6:0/2092420195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a600af4e0 0x7f7a600b20e0 unknown :-1 s=CLOSED pgs=2402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.873+0000 7f7a65f03700 1 -- 172.21.15.6:0/2092420195 >> 172.21.15.6:0/2092420195 conn(0x7f7a60068680 msgr2=0x7f7a60068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.873+0000 7f7a65f03700 1 -- 172.21.15.6:0/2092420195 shutdown_connections 2023-10-06T02:30:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.873+0000 7f7a65f03700 1 -- 172.21.15.6:0/2092420195 wait complete. 2023-10-06T02:30:10.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.874+0000 7f7a65f03700 1 Processor -- start 2023-10-06T02:30:10.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.874+0000 7f7a65f03700 1 -- start start 2023-10-06T02:30:10.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.875+0000 7f7a65f03700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a600af4e0 0x7f7a601467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:10.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.875+0000 7f7a65f03700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a600af8b0 0x7f7a600b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:10.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.875+0000 7f7a65f03700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a6015db70 0x7f7a600c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:10.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.875+0000 7f7a65f03700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a600b58b0 con 0x7f7a600af4e0 2023-10-06T02:30:10.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.875+0000 7f7a65f03700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a600b5420 con 0x7f7a6015db70 2023-10-06T02:30:10.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.875+0000 7f7a65f03700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a600b4810 con 0x7f7a600af8b0 2023-10-06T02:30:10.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.875+0000 7f7a5f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a600af4e0 0x7f7a601467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:10.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.875+0000 7f7a5f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a600af4e0 0x7f7a601467d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40238/0 (socket says 172.21.15.6:40238) 2023-10-06T02:30:10.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.875+0000 7f7a5f7fe700 1 -- 172.21.15.6:0/116642802 learned_addr learned my addr 172.21.15.6:0/116642802 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:10.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.875+0000 7f7a5effd700 1 --2- 172.21.15.6:0/116642802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a600af8b0 0x7f7a600b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:10.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.875+0000 7f7a5ffff700 1 --2- 172.21.15.6:0/116642802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a6015db70 0x7f7a600c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:10.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.875+0000 7f7a5f7fe700 1 -- 172.21.15.6:0/116642802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a600af8b0 msgr2=0x7f7a600b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:10.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.875+0000 7f7a5f7fe700 1 --2- 172.21.15.6:0/116642802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a600af8b0 0x7f7a600b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:10.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.875+0000 7f7a5f7fe700 1 -- 172.21.15.6:0/116642802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a6015db70 msgr2=0x7f7a600c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:10.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.875+0000 7f7a5f7fe700 1 --2- 172.21.15.6:0/116642802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a6015db70 0x7f7a600c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:10.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.875+0000 7f7a5f7fe700 1 -- 172.21.15.6:0/116642802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a50009420 con 0x7f7a600af4e0 2023-10-06T02:30:10.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.875+0000 7f7a5effd700 1 --2- 172.21.15.6:0/116642802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a600af8b0 0x7f7a600b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:10.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.876+0000 7f7a5f7fe700 1 --2- 172.21.15.6:0/116642802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a600af4e0 0x7f7a601467d0 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f7a60089520 tx=0x7f7a50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:10.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.876+0000 7f7a477fe700 1 -- 172.21.15.6:0/116642802 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5000bb20 con 0x7f7a600af4e0 2023-10-06T02:30:10.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.876+0000 7f7a477fe700 1 -- 172.21.15.6:0/116642802 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a50011420 con 0x7f7a600af4e0 2023-10-06T02:30:10.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.876+0000 7f7a65f03700 1 -- 172.21.15.6:0/116642802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a600b4af0 con 0x7f7a600af4e0 2023-10-06T02:30:10.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.876+0000 7f7a477fe700 1 -- 172.21.15.6:0/116642802 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a500117a0 con 0x7f7a600af4e0 2023-10-06T02:30:10.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.876+0000 7f7a65f03700 1 -- 172.21.15.6:0/116642802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a600b50b0 con 0x7f7a600af4e0 2023-10-06T02:30:10.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.877+0000 7f7a65f03700 1 -- 172.21.15.6:0/116642802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a600b5700 con 0x7f7a600af4e0 2023-10-06T02:30:10.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.877+0000 7f7a477fe700 1 -- 172.21.15.6:0/116642802 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a50011b10 con 0x7f7a600af4e0 2023-10-06T02:30:10.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.877+0000 7f7a477fe700 1 --2- 172.21.15.6:0/116642802 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7a4c066f30 0x7f7a4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:10.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.878+0000 7f7a477fe700 1 -- 172.21.15.6:0/116642802 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7a50085b60 con 0x7f7a600af4e0 2023-10-06T02:30:10.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.878+0000 7f7a5effd700 1 --2- 172.21.15.6:0/116642802 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7a4c066f30 0x7f7a4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:10.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.878+0000 7f7a5effd700 1 --2- 172.21.15.6:0/116642802 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7a4c066f30 0x7f7a4c0693e0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f7a54007fd0 tx=0x7f7a54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:10.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:10.882+0000 7f7a477fe700 1 -- 172.21.15.6:0/116642802 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a50052bb0 con 0x7f7a600af4e0 2023-10-06T02:30:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.075+0000 7f7a65f03700 1 -- 172.21.15.6:0/116642802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a600b0f90 con 0x7f7a600af4e0 2023-10-06T02:30:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.076+0000 7f7a477fe700 1 -- 172.21.15.6:0/116642802 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+17037 (secure 0 0 0) 0x7f7a500561d0 con 0x7f7a600af4e0 2023-10-06T02:30:11.077 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:11.078 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":146,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:30:08.327994+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:30:04.464332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T02:30:05.694424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:30:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.078+0000 7f7a65f03700 1 -- 172.21.15.6:0/116642802 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7a4c066f30 msgr2=0x7f7a4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.078+0000 7f7a65f03700 1 --2- 172.21.15.6:0/116642802 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7a4c066f30 0x7f7a4c0693e0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f7a54007fd0 tx=0x7f7a54009040 comp rx=0 tx=0).stop 2023-10-06T02:30:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.078+0000 7f7a65f03700 1 -- 172.21.15.6:0/116642802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a600af4e0 msgr2=0x7f7a601467d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.078+0000 7f7a65f03700 1 --2- 172.21.15.6:0/116642802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a600af4e0 0x7f7a601467d0 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f7a60089520 tx=0x7f7a50017000 comp rx=0 tx=0).stop 2023-10-06T02:30:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.078+0000 7f7a65f03700 1 -- 172.21.15.6:0/116642802 shutdown_connections 2023-10-06T02:30:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.078+0000 7f7a65f03700 1 --2- 172.21.15.6:0/116642802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a6015db70 0x7f7a600c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.078+0000 7f7a65f03700 1 --2- 172.21.15.6:0/116642802 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7a4c066f30 0x7f7a4c0693e0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.078+0000 7f7a65f03700 1 --2- 172.21.15.6:0/116642802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a600af4e0 0x7f7a601467d0 unknown :-1 s=CLOSED pgs=2403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.078+0000 7f7a65f03700 1 --2- 172.21.15.6:0/116642802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a600af8b0 0x7f7a600b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.078+0000 7f7a65f03700 1 -- 172.21.15.6:0/116642802 >> 172.21.15.6:0/116642802 conn(0x7f7a60068680 msgr2=0x7f7a6015c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.078+0000 7f7a65f03700 1 -- 172.21.15.6:0/116642802 shutdown_connections 2023-10-06T02:30:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.078+0000 7f7a65f03700 1 -- 172.21.15.6:0/116642802 wait complete. 2023-10-06T02:30:11.092 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:30:11.092 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:30:11.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.210+0000 7f4b46f90700 1 Processor -- start 2023-10-06T02:30:11.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.210+0000 7f4b46f90700 1 -- start start 2023-10-06T02:30:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.210+0000 7f4b46f90700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b400af4e0 0x7f4b400b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.210+0000 7f4b46f90700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4015db70 0x7f4b400b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.210+0000 7f4b46f90700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4015e190 con 0x7f4b400af8b0 2023-10-06T02:30:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.210+0000 7f4b46f90700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b400b1910 con 0x7f4b400af4e0 2023-10-06T02:30:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.210+0000 7f4b46f90700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4015dfa0 con 0x7f4b4015db70 2023-10-06T02:30:11.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.210+0000 7f4b44d2c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b400af4e0 0x7f4b400b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.211+0000 7f4b44d2c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b400af4e0 0x7f4b400b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40244/0 (socket says 172.21.15.6:40244) 2023-10-06T02:30:11.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.211+0000 7f4b44d2c700 1 -- 172.21.15.6:0/3924036244 learned_addr learned my addr 172.21.15.6:0/3924036244 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:11.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.211+0000 7f4b4552d700 1 --2- 172.21.15.6:0/3924036244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4015db70 0x7f4b400b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.211+0000 7f4b44d2c700 1 -- 172.21.15.6:0/3924036244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4015db70 msgr2=0x7f4b400b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:11.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.211+0000 7f4b44d2c700 1 --2- 172.21.15.6:0/3924036244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4015db70 0x7f4b400b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.211+0000 7f4b44d2c700 1 -- 172.21.15.6:0/3924036244 >> v1:172.21.15.175:6789/0 conn(0x7f4b400af8b0 legacy=0x7f4b4015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:11.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.211+0000 7f4b44d2c700 1 -- 172.21.15.6:0/3924036244 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b400cb650 con 0x7f4b400af4e0 2023-10-06T02:30:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.211+0000 7f4b44d2c700 1 --2- 172.21.15.6:0/3924036244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b400af4e0 0x7f4b400b20e0 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f4b380099b0 tx=0x7f4b38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae48ee69b34a2bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.211+0000 7f4b3f7fe700 1 -- 172.21.15.6:0/3924036244 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3800b820 con 0x7f4b400af4e0 2023-10-06T02:30:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.211+0000 7f4b3f7fe700 1 -- 172.21.15.6:0/3924036244 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3800b980 con 0x7f4b400af4e0 2023-10-06T02:30:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.211+0000 7f4b3f7fe700 1 -- 172.21.15.6:0/3924036244 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3800bd20 con 0x7f4b400af4e0 2023-10-06T02:30:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.212+0000 7f4b46f90700 1 -- 172.21.15.6:0/3924036244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b400af4e0 msgr2=0x7f4b400b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.212+0000 7f4b46f90700 1 --2- 172.21.15.6:0/3924036244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b400af4e0 0x7f4b400b20e0 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f4b380099b0 tx=0x7f4b38009250 comp rx=0 tx=0).stop 2023-10-06T02:30:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.212+0000 7f4b46f90700 1 -- 172.21.15.6:0/3924036244 shutdown_connections 2023-10-06T02:30:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.212+0000 7f4b46f90700 1 --2- 172.21.15.6:0/3924036244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4015db70 0x7f4b400b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.212+0000 7f4b46f90700 1 --2- 172.21.15.6:0/3924036244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b400af4e0 0x7f4b400b20e0 unknown :-1 s=CLOSED pgs=2404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.212+0000 7f4b46f90700 1 -- 172.21.15.6:0/3924036244 >> 172.21.15.6:0/3924036244 conn(0x7f4b40068680 msgr2=0x7f4b40068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.212+0000 7f4b46f90700 1 -- 172.21.15.6:0/3924036244 shutdown_connections 2023-10-06T02:30:11.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.212+0000 7f4b46f90700 1 -- 172.21.15.6:0/3924036244 wait complete. 2023-10-06T02:30:11.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.213+0000 7f4b46f90700 1 Processor -- start 2023-10-06T02:30:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.213+0000 7f4b46f90700 1 -- start start 2023-10-06T02:30:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b46f90700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b400af4e0 0x7f4b400c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b46f90700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b400af8b0 0x7f4b40159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b46f90700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4015db70 0x7f4b40159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b46f90700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b40155720 con 0x7f4b400af8b0 2023-10-06T02:30:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b46f90700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b400c7b40 con 0x7f4b400af4e0 2023-10-06T02:30:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b46f90700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b400c7e20 con 0x7f4b4015db70 2023-10-06T02:30:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b3ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b400af8b0 0x7f4b40159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b3ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b400af8b0 0x7f4b40159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40260/0 (socket says 172.21.15.6:40260) 2023-10-06T02:30:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b3ffff700 1 -- 172.21.15.6:0/3071302624 learned_addr learned my addr 172.21.15.6:0/3071302624 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:11.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b4552d700 1 --2- 172.21.15.6:0/3071302624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4015db70 0x7f4b40159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b44d2c700 1 --2- 172.21.15.6:0/3071302624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b400af4e0 0x7f4b400c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b3ffff700 1 -- 172.21.15.6:0/3071302624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4015db70 msgr2=0x7f4b40159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:11.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b3ffff700 1 --2- 172.21.15.6:0/3071302624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4015db70 0x7f4b40159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b3ffff700 1 -- 172.21.15.6:0/3071302624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b400af4e0 msgr2=0x7f4b400c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:11.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b3ffff700 1 --2- 172.21.15.6:0/3071302624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b400af4e0 0x7f4b400c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b3ffff700 1 -- 172.21.15.6:0/3071302624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b380094f0 con 0x7f4b400af8b0 2023-10-06T02:30:11.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b44d2c700 1 --2- 172.21.15.6:0/3071302624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b400af4e0 0x7f4b400c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:11.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b3ffff700 1 --2- 172.21.15.6:0/3071302624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b400af8b0 0x7f4b40159580 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000c910 tx=0x7f4b30002720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:11.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b3cff9700 1 -- 172.21.15.6:0/3071302624 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30012630 con 0x7f4b400af8b0 2023-10-06T02:30:11.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b3cff9700 1 -- 172.21.15.6:0/3071302624 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b30012790 con 0x7f4b400af8b0 2023-10-06T02:30:11.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b46f90700 1 -- 172.21.15.6:0/3071302624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b400c8100 con 0x7f4b400af8b0 2023-10-06T02:30:11.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.214+0000 7f4b3cff9700 1 -- 172.21.15.6:0/3071302624 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30012b50 con 0x7f4b400af8b0 2023-10-06T02:30:11.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.215+0000 7f4b46f90700 1 -- 172.21.15.6:0/3071302624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4016aa50 con 0x7f4b400af8b0 2023-10-06T02:30:11.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.216+0000 7f4b46f90700 1 -- 172.21.15.6:0/3071302624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b401558d0 con 0x7f4b400af8b0 2023-10-06T02:30:11.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.216+0000 7f4b3cff9700 1 -- 172.21.15.6:0/3071302624 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b3001b400 con 0x7f4b400af8b0 2023-10-06T02:30:11.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.216+0000 7f4b3cff9700 1 --2- 172.21.15.6:0/3071302624 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b20066f60 0x7f4b20069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.216+0000 7f4b3cff9700 1 -- 172.21.15.6:0/3071302624 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4b30084b60 con 0x7f4b400af8b0 2023-10-06T02:30:11.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.217+0000 7f4b44d2c700 1 --2- 172.21.15.6:0/3071302624 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b20066f60 0x7f4b20069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.217+0000 7f4b44d2c700 1 --2- 172.21.15.6:0/3071302624 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b20066f60 0x7f4b20069410 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f4b380099b0 tx=0x7f4b38016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:11.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.220+0000 7f4b3cff9700 1 -- 172.21.15.6:0/3071302624 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b401558d0 con 0x7f4b400af8b0 2023-10-06T02:30:11.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.413+0000 7f4b46f90700 1 -- 172.21.15.6:0/3071302624 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b401558d0 con 0x7f4b20066f60 2023-10-06T02:30:11.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.422+0000 7f4b3cff9700 1 -- 172.21.15.6:0/3071302624 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+301264 (secure 0 0 0) 0x7f4b401558d0 con 0x7f4b20066f60 2023-10-06T02:30:11.427 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.425+0000 7f4b46f90700 1 -- 172.21.15.6:0/3071302624 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b20066f60 msgr2=0x7f4b20069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.425+0000 7f4b46f90700 1 --2- 172.21.15.6:0/3071302624 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b20066f60 0x7f4b20069410 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f4b380099b0 tx=0x7f4b38016000 comp rx=0 tx=0).stop 2023-10-06T02:30:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.425+0000 7f4b46f90700 1 -- 172.21.15.6:0/3071302624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b400af8b0 msgr2=0x7f4b40159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.425+0000 7f4b46f90700 1 --2- 172.21.15.6:0/3071302624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b400af8b0 0x7f4b40159580 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000c910 tx=0x7f4b30002720 comp rx=0 tx=0).stop 2023-10-06T02:30:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.425+0000 7f4b46f90700 1 -- 172.21.15.6:0/3071302624 shutdown_connections 2023-10-06T02:30:11.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.425+0000 7f4b46f90700 1 --2- 172.21.15.6:0/3071302624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4015db70 0x7f4b40159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.425+0000 7f4b46f90700 1 --2- 172.21.15.6:0/3071302624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b400af4e0 0x7f4b400c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.425+0000 7f4b46f90700 1 --2- 172.21.15.6:0/3071302624 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4b20066f60 0x7f4b20069410 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.425+0000 7f4b46f90700 1 --2- 172.21.15.6:0/3071302624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b400af8b0 0x7f4b40159580 unknown :-1 s=CLOSED pgs=2405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.425+0000 7f4b46f90700 1 -- 172.21.15.6:0/3071302624 >> 172.21.15.6:0/3071302624 conn(0x7f4b40068680 msgr2=0x7f4b400b5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:11.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.426+0000 7f4b46f90700 1 -- 172.21.15.6:0/3071302624 shutdown_connections 2023-10-06T02:30:11.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.426+0000 7f4b46f90700 1 -- 172.21.15.6:0/3071302624 wait complete. 2023-10-06T02:30:11.431 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:30:11.439 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":517,"stamp":"2023-10-06T02:30:10.748708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2451372,"kb_used_data":15724,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752523348,"statfs":{"total":773094113280,"available":770583908352,"internally_reserved":0,"allocated":16101376,"data_stored":8944189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.449340"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303974+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:39:42.529611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.306360+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:13.669731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.302103+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:52.673861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301771+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:16.722186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.304653+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:42.612928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.307922+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:21.991317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.304978+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:11.948877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303413+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:14.411465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301247+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:41.905031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301704+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:42:47.738000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.306792+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:46:29.783186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303857+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:22.229209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303527+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:35.270132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301153+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:04.088711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303158+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:43.892133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.302939+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:54.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.308251+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:24.926397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.306579+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:57.041002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301291+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:00:03.528417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.307890+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:51.970976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303958+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:23.435148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.304980+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:56.676109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301445+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:54.862008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301237+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:17.722040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.302698+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:54.339486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":125,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.319918+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:30:02.319918+0000","last_peered":"2023-10-06T02:30:02.319918+0000","last_clean":"2023-10-06T02:30:02.319918+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:30:02.319918+0000","last_undegraded":"2023-10-06T02:30:02.319918+0000","last_fullsized":"2023-10-06T02:30:02.319918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.302835+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:03.664238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":127,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.292390+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:30:02.292390+0000","last_peered":"2023-10-06T02:30:02.292390+0000","last_clean":"2023-10-06T02:30:02.292390+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:30:02.292390+0000","last_undegraded":"2023-10-06T02:30:02.292390+0000","last_fullsized":"2023-10-06T02:30:02.292390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.306528+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:54:44.819568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":127,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.319479+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:30:02.319479+0000","last_peered":"2023-10-06T02:30:02.319479+0000","last_clean":"2023-10-06T02:30:02.319479+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:30:02.319479+0000","last_undegraded":"2023-10-06T02:30:02.319479+0000","last_fullsized":"2023-10-06T02:30:02.319479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":274,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.292493+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:30:02.292493+0000","last_peered":"2023-10-06T02:30:02.292493+0000","last_clean":"2023-10-06T02:30:02.292493+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:30:02.292493+0000","last_undegraded":"2023-10-06T02:30:02.292493+0000","last_fullsized":"2023-10-06T02:30:02.292493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.304141+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:59.044474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":124,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.292483+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:30:02.292483+0000","last_peered":"2023-10-06T02:30:02.292483+0000","last_clean":"2023-10-06T02:30:02.292483+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:30:02.292483+0000","last_undegraded":"2023-10-06T02:30:02.292483+0000","last_fullsized":"2023-10-06T02:30:02.292483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303954+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:42.979418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.292483+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:30:02.292483+0000","last_peered":"2023-10-06T02:30:02.292483+0000","last_clean":"2023-10-06T02:30:02.292483+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:30:02.292483+0000","last_undegraded":"2023-10-06T02:30:02.292483+0000","last_fullsized":"2023-10-06T02:30:02.292483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301465+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:25.291289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":123,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.319920+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:30:02.319920+0000","last_peered":"2023-10-06T02:30:02.319920+0000","last_clean":"2023-10-06T02:30:02.319920+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:30:02.319920+0000","last_undegraded":"2023-10-06T02:30:02.319920+0000","last_fullsized":"2023-10-06T02:30:02.319920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301157+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:42.480213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":122,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.319938+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:30:02.319938+0000","last_peered":"2023-10-06T02:30:02.319938+0000","last_clean":"2023-10-06T02:30:02.319938+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:30:02.319938+0000","last_undegraded":"2023-10-06T02:30:02.319938+0000","last_fullsized":"2023-10-06T02:30:02.319938+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.307904+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:28.450309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":122,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.319940+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:30:02.319940+0000","last_peered":"2023-10-06T02:30:02.319940+0000","last_clean":"2023-10-06T02:30:02.319940+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:30:02.319940+0000","last_undegraded":"2023-10-06T02:30:02.319940+0000","last_fullsized":"2023-10-06T02:30:02.319940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575001,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2408,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2465792,"data_stored":1564396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.79700000000000004,"15min":1.111},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71099999999999997,"5min":0.77900000000000003,"15min":0.97899999999999998},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":1.008},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.629,"5min":0.72599999999999998,"15min":1.075},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.76000000000000001,"5min":0.80200000000000005,"15min":1.149},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":0.96999999999999997,"15min":1.048},"last":0.499}]},{"osd":3,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69899999999999995,"5min":0.84399999999999997,"15min":1.175},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73599999999999999,"5min":0.91000000000000003,"15min":1.03},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.48199999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63900000000000001,"5min":0.79400000000000004,"15min":0.873},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80800000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44500000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.78600000000000003,"5min":0.81299999999999994,"15min":0.81899999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.76000000000000001,"15min":0.84899999999999998},"last":0.46600000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72699999999999998,"5min":0.79300000000000004,"15min":0.91700000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.38900000000000001,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.55100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575002,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303208,"kb_used_data":1824,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068632,"statfs":{"total":96636764160,"available":96326279168,"internally_reserved":0,"allocated":1867776,"data_stored":973075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53400000000000003,"15min":0.64000000000000001},"min":{"1min":0.30299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.68899999999999995,"5min":0.79000000000000004,"15min":5.6929999999999996},"last":0.439},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56100000000000005,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.29799999999999999},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":5.7060000000000004},"last":0.48299999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53200000000000003,"15min":0.54100000000000004},"min":{"1min":0.32300000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67100000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53100000000000003,"15min":0.69999999999999996},"min":{"1min":0.372,"5min":0.318,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":0.872,"15min":8.8659999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":0.77500000000000002,"15min":0.80800000000000005},"last":0.38600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55500000000000005,"15min":0.75},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":10.659000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.76800000000000002,"15min":0.85499999999999998},"last":0.501}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47499999999999998,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.27400000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.79600000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67700000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.371}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.49099999999999999,"15min":0.51600000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71099999999999997,"5min":0.751,"15min":0.84399999999999997},"last":0.56399999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.312},"max":{"1min":0.68300000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73899999999999999,"5min":0.86799999999999999,"15min":0.88100000000000001},"last":0.59299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307884,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063956,"statfs":{"total":96636764160,"available":96321490944,"internally_reserved":0,"allocated":2461696,"data_stored":1563443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.36799999999999999,"15min":0.36099999999999999},"min":{"1min":0.26000000000000001,"5min":0.20799999999999999,"15min":0.19},"max":{"1min":0.60399999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.39300000000000002,"15min":0.378},"min":{"1min":0.30599999999999999,"5min":0.27100000000000002,"15min":0.26100000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.32600000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33600000000000002},"min":{"1min":0.253,"5min":0.223,"15min":0.22},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.39600000000000002,"15min":0.39400000000000002},"min":{"1min":0.29599999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.38100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.41299999999999998,"15min":0.40400000000000003},"min":{"1min":0.33200000000000002,"5min":0.28100000000000003,"15min":0.253},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.442},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.39500000000000002,"15min":0.39300000000000002},"min":{"1min":0.26400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.97999999999999998,"5min":0.998,"15min":0.998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63,"15min":0.61699999999999999},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.37},"max":{"1min":0.88300000000000001,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63600000000000001,"15min":0.63700000000000001},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.95499999999999996},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.36499999999999999},"max":{"1min":0.88700000000000001,"5min":0.94499999999999995,"15min":1.0009999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61599999999999999,"15min":0.61099999999999999},"min":{"1min":0.45700000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95999999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67900000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.622,"15min":0.63},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.378},"max":{"1min":0.83799999999999997,"5min":0.89500000000000002,"15min":0.94199999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.98199999999999998},"last":0.61499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575001,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307296,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064544,"statfs":{"total":96636764160,"available":96322093056,"internally_reserved":0,"allocated":1859584,"data_stored":967550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34599999999999997,"15min":0.33500000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.183},"max":{"1min":0.56899999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.374},"min":{"1min":0.223,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.66500000000000004,"5min":0.876,"15min":0.876},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.39400000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.20599999999999999},"max":{"1min":0.56399999999999995,"5min":0.65600000000000003,"15min":0.745},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.372,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.22600000000000001,"15min":0.215},"max":{"1min":0.63600000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52000000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.438,"15min":0.434},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.24399999999999999},"max":{"1min":0.629,"5min":0.71599999999999997,"15min":0.78000000000000003},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.371},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.369},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.99399999999999999},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.32300000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.3320000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.622},"min":{"1min":0.44,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.84899999999999998,"5min":0.88700000000000001,"15min":1.0780000000000001},"last":0.75900000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63700000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.91200000000000003,"15min":1.3999999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.45500000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.0469999999999999},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.78000000000000003},"min":{"1min":0.46200000000000002,"5min":0.41699999999999998,"15min":0.39400000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":11.138},"last":0.746},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.46600000000000003,"5min":0.432,"15min":0.41599999999999998},"max":{"1min":0.86599999999999999,"5min":1.024,"15min":1.429},"last":0.69899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307292,"kb_used_data":1812,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064548,"statfs":{"total":96636764160,"available":96322097152,"internally_reserved":0,"allocated":1855488,"data_stored":966597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34699999999999998,"15min":0.36199999999999999},"min":{"1min":0.218,"5min":0.182,"15min":0.182},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.80300000000000005},"last":0.371},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.38800000000000001},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.58199999999999996,"5min":0.68000000000000005,"15min":0.98999999999999999},"last":0.435}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.375,"15min":0.39200000000000002},"min":{"1min":0.25700000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":3.1230000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":3.0129999999999999},"last":0.35499999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.375,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.23499999999999999},"max":{"1min":0.56899999999999995,"5min":0.59299999999999997,"15min":1.423},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.33500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.77400000000000002},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.443,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.41799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.304},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.439,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.80700000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.45100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0980000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.41799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96499999999999997,"5min":0.97999999999999998,"15min":1.347},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64900000000000002,"15min":0.66200000000000003},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.206},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63800000000000001,"15min":0.66500000000000004},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.385},"last":0.72899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303212,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068628,"statfs":{"total":96636764160,"available":96326275072,"internally_reserved":0,"allocated":1871872,"data_stored":974028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47299999999999998,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.375,"15min":0.38200000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.78100000000000003},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.24099999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.66700000000000004},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.40300000000000002},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59599999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54500000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.246},"max":{"1min":0.57399999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.0049999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.83899999999999997,"5min":0.92700000000000005,"15min":1.1539999999999999},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.37,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84899999999999998,"5min":0.95399999999999996,"15min":1.2110000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.874,"5min":0.89600000000000002,"15min":1.0429999999999999},"last":0.60299999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81999999999999995,"5min":0.90800000000000003,"15min":1.0700000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.47699999999999998,"5min":0.39500000000000002,"15min":0.38600000000000001},"max":{"1min":0.85999999999999999,"5min":0.98499999999999999,"15min":1.391},"last":0.628}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.48299999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80300000000000005,"5min":0.94099999999999995,"15min":1.121},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.63700000000000001,"15min":0.63400000000000001},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88800000000000001,"5min":0.89900000000000002,"15min":0.95099999999999996},"last":0.54000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311392,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060448,"statfs":{"total":96636764160,"available":96317898752,"internally_reserved":0,"allocated":1859584,"data_stored":967550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.252,"5min":0.252,"15min":0.217},"max":{"1min":0.71799999999999997,"5min":0.78900000000000003,"15min":0.86399999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.88900000000000001,"15min":1.7290000000000001},"last":0.59199999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.77300000000000002},"min":{"1min":0.41599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.71999999999999997,"5min":0.749,"15min":17.879999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.76300000000000001},"min":{"1min":0.377,"5min":0.33100000000000002,"15min":0.32700000000000001},"max":{"1min":0.69899999999999995,"5min":0.76500000000000001,"15min":18.010999999999999},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.55100000000000005},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.309},"max":{"1min":0.73299999999999998,"5min":0.84699999999999998,"15min":1.619},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.42599999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":1.6639999999999999},"last":0.439}]},{"osd":3,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.29899999999999999},"max":{"1min":0.76200000000000001,"5min":0.76500000000000001,"15min":1.2729999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44500000000000001,"5min":0.32700000000000001,"15min":0.32200000000000001},"max":{"1min":0.80000000000000004,"5min":0.81999999999999995,"15min":0.84899999999999998},"last":0.45300000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48999999999999999,"15min":0.51200000000000001},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69799999999999995,"5min":0.78900000000000003,"15min":1.532},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.80700000000000005},"last":0.498}]},{"osd":6,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.501,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.64300000000000002,"5min":0.90400000000000003,"15min":1.5700000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76000000000000001,"5min":0.84099999999999997,"15min":1.4319999999999999},"last":0.47899999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.40400000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73899999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72999999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.57899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303200,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068640,"statfs":{"total":96636764160,"available":96326287360,"internally_reserved":0,"allocated":1859584,"data_stored":967550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.34599999999999997,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.78800000000000003,"5min":1.034,"15min":1.103},"last":0.433},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.312},"max":{"1min":0.81799999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.29699999999999999},"max":{"1min":0.91400000000000003,"5min":1.02,"15min":1.1679999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.33900000000000002},"max":{"1min":0.89200000000000002,"5min":0.99399999999999999,"15min":1.0620000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.30399999999999999},"max":{"1min":0.74299999999999999,"5min":1.1870000000000001,"15min":1.2070000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":1.1140000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.84299999999999997,"15min":1.1799999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78900000000000003,"5min":1.1040000000000001,"15min":1.1830000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72399999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.50900000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26500000000000001},"max":{"1min":0.72199999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.29699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79700000000000004,"5min":0.872,"15min":0.872},"last":0.505},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.66300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:30:11.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:30:11.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.597+0000 7fbf05bb7700 1 Processor -- start 2023-10-06T02:30:11.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.597+0000 7fbf05bb7700 1 -- start start 2023-10-06T02:30:11.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbf05bb7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbf000af4e0 0x7fbf000b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbf05bb7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf000af8b0 0x7fbf000b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbf05bb7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbf0015d460 0x7fbf0015d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbf05bb7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf000b1910 con 0x7fbf0015d460 2023-10-06T02:30:11.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbf05bb7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0015e190 con 0x7fbf000af4e0 2023-10-06T02:30:11.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbf05bb7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000cb650 con 0x7fbf000af8b0 2023-10-06T02:30:11.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbefffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbf0015d460 0x7fbf0015d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbefffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbf0015d460 0x7fbf0015d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40262/0 (socket says 172.21.15.6:40262) 2023-10-06T02:30:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbefffff700 1 -- 172.21.15.6:0/201783125 learned_addr learned my addr 172.21.15.6:0/201783125 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbefeffd700 1 --2- 172.21.15.6:0/201783125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf000af8b0 0x7fbf000b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbeff7fe700 1 --2- 172.21.15.6:0/201783125 >> v2:172.21.15.175:3300/0 conn(0x7fbf000af4e0 0x7fbf000b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbefffff700 1 -- 172.21.15.6:0/201783125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf000af8b0 msgr2=0x7fbf000b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbefffff700 1 --2- 172.21.15.6:0/201783125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf000af8b0 0x7fbf000b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbefffff700 1 -- 172.21.15.6:0/201783125 >> v2:172.21.15.175:3300/0 conn(0x7fbf000af4e0 msgr2=0x7fbf000b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbefffff700 1 --2- 172.21.15.6:0/201783125 >> v2:172.21.15.175:3300/0 conn(0x7fbf000af4e0 0x7fbf000b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbefffff700 1 -- 172.21.15.6:0/201783125 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf000b2b60 con 0x7fbf0015d460 2023-10-06T02:30:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbefffff700 1 --2- 172.21.15.6:0/201783125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf0015d460 0x7fbf0015d8a0 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7fbf000d1360 tx=0x7fbef8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b895cbe8036952 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.598+0000 7fbefe7fc700 1 -- 172.21.15.6:0/201783125 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef800e070 con 0x7fbf0015d460 2023-10-06T02:30:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.599+0000 7fbefe7fc700 1 -- 172.21.15.6:0/201783125 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef800ba50 con 0x7fbf0015d460 2023-10-06T02:30:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.599+0000 7fbefe7fc700 1 -- 172.21.15.6:0/201783125 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef80092e0 con 0x7fbf0015d460 2023-10-06T02:30:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.599+0000 7fbf05bb7700 1 -- 172.21.15.6:0/201783125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf0015d460 msgr2=0x7fbf0015d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.599+0000 7fbf05bb7700 1 --2- 172.21.15.6:0/201783125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf0015d460 0x7fbf0015d8a0 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7fbf000d1360 tx=0x7fbef8009840 comp rx=0 tx=0).stop 2023-10-06T02:30:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.599+0000 7fbf05bb7700 1 -- 172.21.15.6:0/201783125 shutdown_connections 2023-10-06T02:30:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.599+0000 7fbf05bb7700 1 --2- 172.21.15.6:0/201783125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf0015d460 0x7fbf0015d8a0 unknown :-1 s=CLOSED pgs=2406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.599+0000 7fbf05bb7700 1 --2- 172.21.15.6:0/201783125 >> v2:172.21.15.175:3300/0 conn(0x7fbf000af4e0 0x7fbf000b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.599+0000 7fbf05bb7700 1 --2- 172.21.15.6:0/201783125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf000af8b0 0x7fbf000b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.599+0000 7fbf05bb7700 1 -- 172.21.15.6:0/201783125 >> 172.21.15.6:0/201783125 conn(0x7fbf00068680 msgr2=0x7fbf00068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.599+0000 7fbf05bb7700 1 -- 172.21.15.6:0/201783125 shutdown_connections 2023-10-06T02:30:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.599+0000 7fbf05bb7700 1 -- 172.21.15.6:0/201783125 wait complete. 2023-10-06T02:30:11.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.600+0000 7fbf05bb7700 1 Processor -- start 2023-10-06T02:30:11.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.600+0000 7fbf05bb7700 1 -- start start 2023-10-06T02:30:11.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbf05bb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf000af4e0 0x7fbf000c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbf05bb7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf000af8b0 0x7fbf0016aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbf05bb7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf0015d460 0x7fbf000a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbf05bb7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000c8cd0 con 0x7fbf000af4e0 2023-10-06T02:30:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbf05bb7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000ca1b0 con 0x7fbf0015d460 2023-10-06T02:30:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbf05bb7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000a89c0 con 0x7fbf000af8b0 2023-10-06T02:30:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbeff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf000af4e0 0x7fbf000c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbeff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf000af4e0 0x7fbf000c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40274/0 (socket says 172.21.15.6:40274) 2023-10-06T02:30:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbeff7fe700 1 -- 172.21.15.6:0/2912581554 learned_addr learned my addr 172.21.15.6:0/2912581554 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbefeffd700 1 --2- 172.21.15.6:0/2912581554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf000af8b0 0x7fbf0016aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbeff7fe700 1 -- 172.21.15.6:0/2912581554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf000af8b0 msgr2=0x7fbf0016aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbeff7fe700 1 --2- 172.21.15.6:0/2912581554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf000af8b0 0x7fbf0016aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbeff7fe700 1 -- 172.21.15.6:0/2912581554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf0015d460 msgr2=0x7fbf000a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbefffff700 1 --2- 172.21.15.6:0/2912581554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf0015d460 0x7fbf000a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbeff7fe700 1 --2- 172.21.15.6:0/2912581554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf0015d460 0x7fbf000a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbeff7fe700 1 -- 172.21.15.6:0/2912581554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef8009ae0 con 0x7fbf000af4e0 2023-10-06T02:30:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbefeffd700 1 --2- 172.21.15.6:0/2912581554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf000af8b0 0x7fbf0016aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.601+0000 7fbefffff700 1 --2- 172.21.15.6:0/2912581554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf0015d460 0x7fbf000a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.602+0000 7fbeff7fe700 1 --2- 172.21.15.6:0/2912581554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf000af4e0 0x7fbf000c8790 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7fbef000d890 tx=0x7fbef0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.602+0000 7fbee77fe700 1 -- 172.21.15.6:0/2912581554 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef000b600 con 0x7fbf000af4e0 2023-10-06T02:30:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.602+0000 7fbee77fe700 1 -- 172.21.15.6:0/2912581554 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef000b760 con 0x7fbf000af4e0 2023-10-06T02:30:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.602+0000 7fbf05bb7700 1 -- 172.21.15.6:0/2912581554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf000a8ca0 con 0x7fbf000af4e0 2023-10-06T02:30:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.602+0000 7fbee77fe700 1 -- 172.21.15.6:0/2912581554 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef000bae0 con 0x7fbf000af4e0 2023-10-06T02:30:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.602+0000 7fbf05bb7700 1 -- 172.21.15.6:0/2912581554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf000a9260 con 0x7fbf000af4e0 2023-10-06T02:30:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.603+0000 7fbf05bb7700 1 -- 172.21.15.6:0/2912581554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf000a9420 con 0x7fbf000af4e0 2023-10-06T02:30:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.603+0000 7fbee77fe700 1 -- 172.21.15.6:0/2912581554 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbef001e460 con 0x7fbf000af4e0 2023-10-06T02:30:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.604+0000 7fbee77fe700 1 --2- 172.21.15.6:0/2912581554 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbeec066f30 0x7fbeec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.604+0000 7fbee77fe700 1 -- 172.21.15.6:0/2912581554 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbef0084f20 con 0x7fbf000af4e0 2023-10-06T02:30:11.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.604+0000 7fbefeffd700 1 --2- 172.21.15.6:0/2912581554 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbeec066f30 0x7fbeec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.604+0000 7fbefeffd700 1 --2- 172.21.15.6:0/2912581554 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbeec066f30 0x7fbeec0693e0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fbef4006fd0 tx=0x7fbef4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:11.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.608+0000 7fbee77fe700 1 -- 172.21.15.6:0/2912581554 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbef0051e50 con 0x7fbf000af4e0 2023-10-06T02:30:11.625 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-06T02:30:11.624+0000 7fb4ad8eb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:30:11.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.796+0000 7fbf05bb7700 1 -- 172.21.15.6:0/2912581554 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf000a95d0 con 0x7fbeec066f30 2023-10-06T02:30:11.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.806+0000 7fbee77fe700 1 -- 172.21.15.6:0/2912581554 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+301264 (secure 0 0 0) 0x7fbf000a95d0 con 0x7fbeec066f30 2023-10-06T02:30:11.810 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:11.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.808+0000 7fbf05bb7700 1 -- 172.21.15.6:0/2912581554 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbeec066f30 msgr2=0x7fbeec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.808+0000 7fbf05bb7700 1 --2- 172.21.15.6:0/2912581554 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbeec066f30 0x7fbeec0693e0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fbef4006fd0 tx=0x7fbef4008040 comp rx=0 tx=0).stop 2023-10-06T02:30:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.808+0000 7fbf05bb7700 1 -- 172.21.15.6:0/2912581554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf000af4e0 msgr2=0x7fbf000c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.808+0000 7fbf05bb7700 1 --2- 172.21.15.6:0/2912581554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf000af4e0 0x7fbf000c8790 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7fbef000d890 tx=0x7fbef0008040 comp rx=0 tx=0).stop 2023-10-06T02:30:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.808+0000 7fbf05bb7700 1 -- 172.21.15.6:0/2912581554 shutdown_connections 2023-10-06T02:30:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.808+0000 7fbf05bb7700 1 --2- 172.21.15.6:0/2912581554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf0015d460 0x7fbf000a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.809+0000 7fbf05bb7700 1 --2- 172.21.15.6:0/2912581554 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fbeec066f30 0x7fbeec0693e0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.809+0000 7fbf05bb7700 1 --2- 172.21.15.6:0/2912581554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf000af4e0 0x7fbf000c8790 unknown :-1 s=CLOSED pgs=2407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.809+0000 7fbf05bb7700 1 --2- 172.21.15.6:0/2912581554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf000af8b0 0x7fbf0016aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.809+0000 7fbf05bb7700 1 -- 172.21.15.6:0/2912581554 >> 172.21.15.6:0/2912581554 conn(0x7fbf00068680 msgr2=0x7fbf000b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.809+0000 7fbf05bb7700 1 -- 172.21.15.6:0/2912581554 shutdown_connections 2023-10-06T02:30:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.809+0000 7fbf05bb7700 1 -- 172.21.15.6:0/2912581554 wait complete. 2023-10-06T02:30:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:30:11.822 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":517,"stamp":"2023-10-06T02:30:10.748708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2451372,"kb_used_data":15724,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752523348,"statfs":{"total":773094113280,"available":770583908352,"internally_reserved":0,"allocated":16101376,"data_stored":8944189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.449340"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303974+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:39:42.529611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.306360+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:13.669731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.302103+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:52.673861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301771+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:16.722186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.304653+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:42.612928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.307922+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:21.991317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.304978+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:11.948877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303413+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:14.411465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301247+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:41.905031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301704+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:42:47.738000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.306792+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:46:29.783186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303857+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:22.229209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303527+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:35.270132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301153+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:04.088711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303158+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:43.892133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.302939+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:54.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.308251+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:24.926397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.306579+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:57.041002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301291+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:00:03.528417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.307890+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:51.970976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303958+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:23.435148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.304980+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:56.676109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301445+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:54.862008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301237+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:17.722040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.302698+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:54.339486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":125,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.319918+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:30:02.319918+0000","last_peered":"2023-10-06T02:30:02.319918+0000","last_clean":"2023-10-06T02:30:02.319918+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:30:02.319918+0000","last_undegraded":"2023-10-06T02:30:02.319918+0000","last_fullsized":"2023-10-06T02:30:02.319918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.302835+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:03.664238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":127,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.292390+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:30:02.292390+0000","last_peered":"2023-10-06T02:30:02.292390+0000","last_clean":"2023-10-06T02:30:02.292390+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:30:02.292390+0000","last_undegraded":"2023-10-06T02:30:02.292390+0000","last_fullsized":"2023-10-06T02:30:02.292390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.306528+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:54:44.819568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":127,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.319479+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:30:02.319479+0000","last_peered":"2023-10-06T02:30:02.319479+0000","last_clean":"2023-10-06T02:30:02.319479+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:30:02.319479+0000","last_undegraded":"2023-10-06T02:30:02.319479+0000","last_fullsized":"2023-10-06T02:30:02.319479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":274,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.292493+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:30:02.292493+0000","last_peered":"2023-10-06T02:30:02.292493+0000","last_clean":"2023-10-06T02:30:02.292493+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:30:02.292493+0000","last_undegraded":"2023-10-06T02:30:02.292493+0000","last_fullsized":"2023-10-06T02:30:02.292493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.304141+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:59.044474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":124,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.292483+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:30:02.292483+0000","last_peered":"2023-10-06T02:30:02.292483+0000","last_clean":"2023-10-06T02:30:02.292483+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:30:02.292483+0000","last_undegraded":"2023-10-06T02:30:02.292483+0000","last_fullsized":"2023-10-06T02:30:02.292483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303954+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:42.979418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.292483+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:30:02.292483+0000","last_peered":"2023-10-06T02:30:02.292483+0000","last_clean":"2023-10-06T02:30:02.292483+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:30:02.292483+0000","last_undegraded":"2023-10-06T02:30:02.292483+0000","last_fullsized":"2023-10-06T02:30:02.292483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301465+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:25.291289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":123,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.319920+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:30:02.319920+0000","last_peered":"2023-10-06T02:30:02.319920+0000","last_clean":"2023-10-06T02:30:02.319920+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:30:02.319920+0000","last_undegraded":"2023-10-06T02:30:02.319920+0000","last_fullsized":"2023-10-06T02:30:02.319920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301157+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:42.480213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":122,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.319938+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:30:02.319938+0000","last_peered":"2023-10-06T02:30:02.319938+0000","last_clean":"2023-10-06T02:30:02.319938+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:30:02.319938+0000","last_undegraded":"2023-10-06T02:30:02.319938+0000","last_fullsized":"2023-10-06T02:30:02.319938+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.307904+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:28.450309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":122,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.319940+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:30:02.319940+0000","last_peered":"2023-10-06T02:30:02.319940+0000","last_clean":"2023-10-06T02:30:02.319940+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:30:02.319940+0000","last_undegraded":"2023-10-06T02:30:02.319940+0000","last_fullsized":"2023-10-06T02:30:02.319940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575001,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2408,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2465792,"data_stored":1564396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.79700000000000004,"15min":1.111},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71099999999999997,"5min":0.77900000000000003,"15min":0.97899999999999998},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":1.008},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.629,"5min":0.72599999999999998,"15min":1.075},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.76000000000000001,"5min":0.80200000000000005,"15min":1.149},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":0.96999999999999997,"15min":1.048},"last":0.499}]},{"osd":3,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69899999999999995,"5min":0.84399999999999997,"15min":1.175},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73599999999999999,"5min":0.91000000000000003,"15min":1.03},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.48199999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63900000000000001,"5min":0.79400000000000004,"15min":0.873},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80800000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44500000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.78600000000000003,"5min":0.81299999999999994,"15min":0.81899999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.76000000000000001,"15min":0.84899999999999998},"last":0.46600000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72699999999999998,"5min":0.79300000000000004,"15min":0.91700000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.38900000000000001,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.55100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575002,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303208,"kb_used_data":1824,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068632,"statfs":{"total":96636764160,"available":96326279168,"internally_reserved":0,"allocated":1867776,"data_stored":973075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53400000000000003,"15min":0.64000000000000001},"min":{"1min":0.30299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.68899999999999995,"5min":0.79000000000000004,"15min":5.6929999999999996},"last":0.439},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56100000000000005,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.29799999999999999},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":5.7060000000000004},"last":0.48299999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53200000000000003,"15min":0.54100000000000004},"min":{"1min":0.32300000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67100000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53100000000000003,"15min":0.69999999999999996},"min":{"1min":0.372,"5min":0.318,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":0.872,"15min":8.8659999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":0.77500000000000002,"15min":0.80800000000000005},"last":0.38600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55500000000000005,"15min":0.75},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":10.659000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.76800000000000002,"15min":0.85499999999999998},"last":0.501}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47499999999999998,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.27400000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.79600000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67700000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.371}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.49099999999999999,"15min":0.51600000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71099999999999997,"5min":0.751,"15min":0.84399999999999997},"last":0.56399999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.312},"max":{"1min":0.68300000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73899999999999999,"5min":0.86799999999999999,"15min":0.88100000000000001},"last":0.59299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307884,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063956,"statfs":{"total":96636764160,"available":96321490944,"internally_reserved":0,"allocated":2461696,"data_stored":1563443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.36799999999999999,"15min":0.36099999999999999},"min":{"1min":0.26000000000000001,"5min":0.20799999999999999,"15min":0.19},"max":{"1min":0.60399999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.39300000000000002,"15min":0.378},"min":{"1min":0.30599999999999999,"5min":0.27100000000000002,"15min":0.26100000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.32600000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33600000000000002},"min":{"1min":0.253,"5min":0.223,"15min":0.22},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.39600000000000002,"15min":0.39400000000000002},"min":{"1min":0.29599999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.38100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.41299999999999998,"15min":0.40400000000000003},"min":{"1min":0.33200000000000002,"5min":0.28100000000000003,"15min":0.253},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.442},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.39500000000000002,"15min":0.39300000000000002},"min":{"1min":0.26400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.97999999999999998,"5min":0.998,"15min":0.998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63,"15min":0.61699999999999999},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.37},"max":{"1min":0.88300000000000001,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63600000000000001,"15min":0.63700000000000001},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.95499999999999996},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.36499999999999999},"max":{"1min":0.88700000000000001,"5min":0.94499999999999995,"15min":1.0009999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61599999999999999,"15min":0.61099999999999999},"min":{"1min":0.45700000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95999999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67900000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.622,"15min":0.63},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.378},"max":{"1min":0.83799999999999997,"5min":0.89500000000000002,"15min":0.94199999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.98199999999999998},"last":0.61499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575001,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307296,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064544,"statfs":{"total":96636764160,"available":96322093056,"internally_reserved":0,"allocated":1859584,"data_stored":967550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34599999999999997,"15min":0.33500000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.183},"max":{"1min":0.56899999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.374},"min":{"1min":0.223,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.66500000000000004,"5min":0.876,"15min":0.876},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.39400000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.20599999999999999},"max":{"1min":0.56399999999999995,"5min":0.65600000000000003,"15min":0.745},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.372,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.22600000000000001,"15min":0.215},"max":{"1min":0.63600000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52000000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.438,"15min":0.434},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.24399999999999999},"max":{"1min":0.629,"5min":0.71599999999999997,"15min":0.78000000000000003},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.371},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.369},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.99399999999999999},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.32300000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.3320000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.622},"min":{"1min":0.44,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.84899999999999998,"5min":0.88700000000000001,"15min":1.0780000000000001},"last":0.75900000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63700000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.91200000000000003,"15min":1.3999999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.45500000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.0469999999999999},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.78000000000000003},"min":{"1min":0.46200000000000002,"5min":0.41699999999999998,"15min":0.39400000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":11.138},"last":0.746},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.46600000000000003,"5min":0.432,"15min":0.41599999999999998},"max":{"1min":0.86599999999999999,"5min":1.024,"15min":1.429},"last":0.69899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307292,"kb_used_data":1812,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064548,"statfs":{"total":96636764160,"available":96322097152,"internally_reserved":0,"allocated":1855488,"data_stored":966597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34699999999999998,"15min":0.36199999999999999},"min":{"1min":0.218,"5min":0.182,"15min":0.182},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.80300000000000005},"last":0.371},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.38800000000000001},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.58199999999999996,"5min":0.68000000000000005,"15min":0.98999999999999999},"last":0.435}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.375,"15min":0.39200000000000002},"min":{"1min":0.25700000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":3.1230000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":3.0129999999999999},"last":0.35499999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.375,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.23499999999999999},"max":{"1min":0.56899999999999995,"5min":0.59299999999999997,"15min":1.423},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.33500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.77400000000000002},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.443,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.41799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.304},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.439,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.80700000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.45100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0980000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.41799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96499999999999997,"5min":0.97999999999999998,"15min":1.347},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64900000000000002,"15min":0.66200000000000003},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.206},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63800000000000001,"15min":0.66500000000000004},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.385},"last":0.72899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303212,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068628,"statfs":{"total":96636764160,"available":96326275072,"internally_reserved":0,"allocated":1871872,"data_stored":974028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47299999999999998,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.375,"15min":0.38200000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.78100000000000003},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.24099999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.66700000000000004},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.40300000000000002},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59599999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54500000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.246},"max":{"1min":0.57399999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.0049999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.83899999999999997,"5min":0.92700000000000005,"15min":1.1539999999999999},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.37,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84899999999999998,"5min":0.95399999999999996,"15min":1.2110000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.874,"5min":0.89600000000000002,"15min":1.0429999999999999},"last":0.60299999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81999999999999995,"5min":0.90800000000000003,"15min":1.0700000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.47699999999999998,"5min":0.39500000000000002,"15min":0.38600000000000001},"max":{"1min":0.85999999999999999,"5min":0.98499999999999999,"15min":1.391},"last":0.628}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.48299999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80300000000000005,"5min":0.94099999999999995,"15min":1.121},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.63700000000000001,"15min":0.63400000000000001},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88800000000000001,"5min":0.89900000000000002,"15min":0.95099999999999996},"last":0.54000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311392,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060448,"statfs":{"total":96636764160,"available":96317898752,"internally_reserved":0,"allocated":1859584,"data_stored":967550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.252,"5min":0.252,"15min":0.217},"max":{"1min":0.71799999999999997,"5min":0.78900000000000003,"15min":0.86399999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.88900000000000001,"15min":1.7290000000000001},"last":0.59199999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.77300000000000002},"min":{"1min":0.41599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.71999999999999997,"5min":0.749,"15min":17.879999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.76300000000000001},"min":{"1min":0.377,"5min":0.33100000000000002,"15min":0.32700000000000001},"max":{"1min":0.69899999999999995,"5min":0.76500000000000001,"15min":18.010999999999999},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.55100000000000005},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.309},"max":{"1min":0.73299999999999998,"5min":0.84699999999999998,"15min":1.619},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.42599999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":1.6639999999999999},"last":0.439}]},{"osd":3,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.29899999999999999},"max":{"1min":0.76200000000000001,"5min":0.76500000000000001,"15min":1.2729999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44500000000000001,"5min":0.32700000000000001,"15min":0.32200000000000001},"max":{"1min":0.80000000000000004,"5min":0.81999999999999995,"15min":0.84899999999999998},"last":0.45300000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48999999999999999,"15min":0.51200000000000001},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69799999999999995,"5min":0.78900000000000003,"15min":1.532},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.80700000000000005},"last":0.498}]},{"osd":6,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.501,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.64300000000000002,"5min":0.90400000000000003,"15min":1.5700000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76000000000000001,"5min":0.84099999999999997,"15min":1.4319999999999999},"last":0.47899999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.40400000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73899999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72999999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.57899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303200,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068640,"statfs":{"total":96636764160,"available":96326287360,"internally_reserved":0,"allocated":1859584,"data_stored":967550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.34599999999999997,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.78800000000000003,"5min":1.034,"15min":1.103},"last":0.433},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.312},"max":{"1min":0.81799999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.29699999999999999},"max":{"1min":0.91400000000000003,"5min":1.02,"15min":1.1679999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.33900000000000002},"max":{"1min":0.89200000000000002,"5min":0.99399999999999999,"15min":1.0620000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.30399999999999999},"max":{"1min":0.74299999999999999,"5min":1.1870000000000001,"15min":1.2070000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":1.1140000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.84299999999999997,"15min":1.1799999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78900000000000003,"5min":1.1040000000000001,"15min":1.1830000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72399999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.50900000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26500000000000001},"max":{"1min":0.72199999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.29699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79700000000000004,"5min":0.872,"15min":0.872},"last":0.505},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.66300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:30:11.829 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:30:11.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.980+0000 7ff7a359e700 1 Processor -- start 2023-10-06T02:30:11.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.980+0000 7ff7a359e700 1 -- start start 2023-10-06T02:30:11.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.981+0000 7ff7a359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7a4159400 0x7ff7a40ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.981+0000 7ff7a359e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff7a40d05d0 0x7ff7a40b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.981+0000 7ff7a359e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a40b3560 con 0x7ff7a40cd030 2023-10-06T02:30:11.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.981+0000 7ff7a359e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a40cf6f0 con 0x7ff7a40d05d0 2023-10-06T02:30:11.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.981+0000 7ff7a359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40cf9d0 con 0x7ff7a4159400 2023-10-06T02:30:11.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.981+0000 7ff7a2d9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff7a40d05d0 0x7ff7a40b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.981+0000 7ff7a259c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7a4159400 0x7ff7a40ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.981+0000 7ff79bfff700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff7a40cd030 0x7ff7a40cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:50542/0 (socket says 172.21.15.6:50542) 2023-10-06T02:30:11.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.981+0000 7ff79bfff700 1 -- 172.21.15.6:0/2528245842 learned_addr learned my addr 172.21.15.6:0/2528245842 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:11.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.982+0000 7ff7a259c700 1 -- 172.21.15.6:0/2528245842 >> v2:172.21.15.175:3300/0 conn(0x7ff7a40d05d0 msgr2=0x7ff7a40b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:11.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.982+0000 7ff7a259c700 1 --2- 172.21.15.6:0/2528245842 >> v2:172.21.15.175:3300/0 conn(0x7ff7a40d05d0 0x7ff7a40b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.982+0000 7ff7a259c700 1 -- 172.21.15.6:0/2528245842 >> v1:172.21.15.175:6789/0 conn(0x7ff7a40cd030 legacy=0x7ff7a40cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:11.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.982+0000 7ff7a259c700 1 -- 172.21.15.6:0/2528245842 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a40b2f10 con 0x7ff7a4159400 2023-10-06T02:30:11.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.982+0000 7ff7a2d9d700 1 --2- 172.21.15.6:0/2528245842 >> v2:172.21.15.175:3300/0 conn(0x7ff7a40d05d0 0x7ff7a40b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:30:11.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.982+0000 7ff7a1d9b700 1 -- 172.21.15.6:0/2528245842 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065294866 0 0) 0x7ff7a40b3560 con 0x7ff7a40cd030 2023-10-06T02:30:11.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.982+0000 7ff7a259c700 1 --2- 172.21.15.6:0/2528245842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7a4159400 0x7ff7a40ccaf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff7940098d0 tx=0x7ff794009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=652c4b3ae94fe86 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.982+0000 7ff7a1d9b700 1 -- 172.21.15.6:0/2528245842 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794005c10 con 0x7ff7a4159400 2023-10-06T02:30:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.982+0000 7ff7a1d9b700 1 -- 172.21.15.6:0/2528245842 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff794005d70 con 0x7ff7a4159400 2023-10-06T02:30:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.982+0000 7ff7a1d9b700 1 -- 172.21.15.6:0/2528245842 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794006280 con 0x7ff7a4159400 2023-10-06T02:30:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.982+0000 7ff7a359e700 1 -- 172.21.15.6:0/2528245842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7a4159400 msgr2=0x7ff7a40ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.982+0000 7ff7a359e700 1 --2- 172.21.15.6:0/2528245842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7a4159400 0x7ff7a40ccaf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff7940098d0 tx=0x7ff794009120 comp rx=0 tx=0).stop 2023-10-06T02:30:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.982+0000 7ff7a359e700 1 -- 172.21.15.6:0/2528245842 shutdown_connections 2023-10-06T02:30:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.982+0000 7ff7a359e700 1 --2- 172.21.15.6:0/2528245842 >> v2:172.21.15.175:3300/0 conn(0x7ff7a40d05d0 0x7ff7a40b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.983+0000 7ff7a359e700 1 --2- 172.21.15.6:0/2528245842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7a4159400 0x7ff7a40ccaf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.983+0000 7ff7a359e700 1 -- 172.21.15.6:0/2528245842 >> 172.21.15.6:0/2528245842 conn(0x7ff7a406ac10 msgr2=0x7ff7a4068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.983+0000 7ff7a359e700 1 -- 172.21.15.6:0/2528245842 shutdown_connections 2023-10-06T02:30:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.983+0000 7ff7a359e700 1 -- 172.21.15.6:0/2528245842 wait complete. 2023-10-06T02:30:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.984+0000 7ff7a359e700 1 Processor -- start 2023-10-06T02:30:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.984+0000 7ff7a359e700 1 -- start start 2023-10-06T02:30:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.984+0000 7ff7a359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a40cd030 0x7ff7a40c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.984+0000 7ff7a359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7a40d05d0 0x7ff7a40c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.984+0000 7ff7a359e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a4159400 0x7ff7a4169dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.984+0000 7ff7a359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40c68e0 con 0x7ff7a40cd030 2023-10-06T02:30:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.984+0000 7ff7a359e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40c5cd0 con 0x7ff7a4159400 2023-10-06T02:30:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.984+0000 7ff7a359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40c5fb0 con 0x7ff7a40d05d0 2023-10-06T02:30:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.985+0000 7ff7a259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a40cd030 0x7ff7a40c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.985+0000 7ff7a259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a40cd030 0x7ff7a40c4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40286/0 (socket says 172.21.15.6:40286) 2023-10-06T02:30:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.985+0000 7ff7a259c700 1 -- 172.21.15.6:0/3316874932 learned_addr learned my addr 172.21.15.6:0/3316874932 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.985+0000 7ff79bfff700 1 --2- 172.21.15.6:0/3316874932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7a40d05d0 0x7ff7a40c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.985+0000 7ff7a2d9d700 1 --2- 172.21.15.6:0/3316874932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a4159400 0x7ff7a4169dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.985+0000 7ff7a259c700 1 -- 172.21.15.6:0/3316874932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7a40d05d0 msgr2=0x7ff7a40c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.985+0000 7ff7a259c700 1 --2- 172.21.15.6:0/3316874932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7a40d05d0 0x7ff7a40c54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.985+0000 7ff7a259c700 1 -- 172.21.15.6:0/3316874932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a4159400 msgr2=0x7ff7a4169dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.985+0000 7ff7a259c700 1 --2- 172.21.15.6:0/3316874932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a4159400 0x7ff7a4169dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.985+0000 7ff7a259c700 1 -- 172.21.15.6:0/3316874932 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79c009a20 con 0x7ff7a40cd030 2023-10-06T02:30:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.985+0000 7ff7a259c700 1 --2- 172.21.15.6:0/3316874932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a40cd030 0x7ff7a40c4f60 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7ff794009f70 tx=0x7ff794016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.985+0000 7ff79a7fc700 1 -- 172.21.15.6:0/3316874932 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79401d880 con 0x7ff7a40cd030 2023-10-06T02:30:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.985+0000 7ff79a7fc700 1 -- 172.21.15.6:0/3316874932 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79401da00 con 0x7ff7a40cd030 2023-10-06T02:30:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.985+0000 7ff79a7fc700 1 -- 172.21.15.6:0/3316874932 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79401ddc0 con 0x7ff7a40cd030 2023-10-06T02:30:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.985+0000 7ff7a359e700 1 -- 172.21.15.6:0/3316874932 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7940093c0 con 0x7ff7a40cd030 2023-10-06T02:30:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.985+0000 7ff7a359e700 1 -- 172.21.15.6:0/3316874932 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a40c6570 con 0x7ff7a40cd030 2023-10-06T02:30:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.986+0000 7ff7a359e700 1 -- 172.21.15.6:0/3316874932 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a40cf230 con 0x7ff7a40cd030 2023-10-06T02:30:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.987+0000 7ff79a7fc700 1 -- 172.21.15.6:0/3316874932 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff79401b690 con 0x7ff7a40cd030 2023-10-06T02:30:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.987+0000 7ff79a7fc700 1 --2- 172.21.15.6:0/3316874932 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff784066f30 0x7ff7840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.987+0000 7ff79a7fc700 1 -- 172.21.15.6:0/3316874932 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff7940867f0 con 0x7ff7a40cd030 2023-10-06T02:30:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.987+0000 7ff79bfff700 1 --2- 172.21.15.6:0/3316874932 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff784066f30 0x7ff7840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.988+0000 7ff79bfff700 1 --2- 172.21.15.6:0/3316874932 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff784066f30 0x7ff7840693e0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40aea40 tx=0x7ff78c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:11.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:11.991+0000 7ff79a7fc700 1 -- 172.21.15.6:0/3316874932 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7940537c0 con 0x7ff7a40cd030 2023-10-06T02:30:12.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.180+0000 7ff7a359e700 1 -- 172.21.15.6:0/3316874932 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7a40b31f0 con 0x7ff784066f30 2023-10-06T02:30:12.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.189+0000 7ff79a7fc700 1 -- 172.21.15.6:0/3316874932 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+301264 (secure 0 0 0) 0x7ff7a40b31f0 con 0x7ff784066f30 2023-10-06T02:30:12.194 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:12.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.192+0000 7ff7a359e700 1 -- 172.21.15.6:0/3316874932 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff784066f30 msgr2=0x7ff7840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:12.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.192+0000 7ff7a359e700 1 --2- 172.21.15.6:0/3316874932 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff784066f30 0x7ff7840693e0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40aea40 tx=0x7ff78c009040 comp rx=0 tx=0).stop 2023-10-06T02:30:12.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.192+0000 7ff7a359e700 1 -- 172.21.15.6:0/3316874932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a40cd030 msgr2=0x7ff7a40c4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:12.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.192+0000 7ff7a359e700 1 --2- 172.21.15.6:0/3316874932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a40cd030 0x7ff7a40c4f60 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7ff794009f70 tx=0x7ff794016000 comp rx=0 tx=0).stop 2023-10-06T02:30:12.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.192+0000 7ff7a359e700 1 -- 172.21.15.6:0/3316874932 shutdown_connections 2023-10-06T02:30:12.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.192+0000 7ff7a359e700 1 --2- 172.21.15.6:0/3316874932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a4159400 0x7ff7a4169dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.192+0000 7ff7a359e700 1 --2- 172.21.15.6:0/3316874932 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff784066f30 0x7ff7840693e0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.192+0000 7ff7a359e700 1 --2- 172.21.15.6:0/3316874932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a40cd030 0x7ff7a40c4f60 unknown :-1 s=CLOSED pgs=2408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.192+0000 7ff7a359e700 1 --2- 172.21.15.6:0/3316874932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7a40d05d0 0x7ff7a40c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.192+0000 7ff7a359e700 1 -- 172.21.15.6:0/3316874932 >> 172.21.15.6:0/3316874932 conn(0x7ff7a406ac10 msgr2=0x7ff7a4158630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:12.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.192+0000 7ff7a359e700 1 -- 172.21.15.6:0/3316874932 shutdown_connections 2023-10-06T02:30:12.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.192+0000 7ff7a359e700 1 -- 172.21.15.6:0/3316874932 wait complete. 2023-10-06T02:30:12.198 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:30:12.205 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":517,"stamp":"2023-10-06T02:30:10.748708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2451372,"kb_used_data":15724,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752523348,"statfs":{"total":773094113280,"available":770583908352,"internally_reserved":0,"allocated":16101376,"data_stored":8944189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.449340"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303974+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:39:42.529611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.306360+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:13.669731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.302103+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:52.673861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301771+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:16.722186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.304653+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:42.612928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.307922+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:21.991317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.304978+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:11.948877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303413+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:14.411465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301247+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:41.905031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301704+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:42:47.738000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.306792+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:46:29.783186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303857+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:22.229209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303527+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:35.270132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301153+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:04.088711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303158+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:43.892133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.302939+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:54.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.308251+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:24.926397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.306579+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:57.041002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301291+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:00:03.528417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.307890+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:51.970976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303958+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:23.435148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.304980+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:56.676109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301445+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:54.862008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301237+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:17.722040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.302698+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:54.339486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":125,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.319918+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:30:02.319918+0000","last_peered":"2023-10-06T02:30:02.319918+0000","last_clean":"2023-10-06T02:30:02.319918+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:30:02.319918+0000","last_undegraded":"2023-10-06T02:30:02.319918+0000","last_fullsized":"2023-10-06T02:30:02.319918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.302835+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:03.664238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":127,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.292390+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:30:02.292390+0000","last_peered":"2023-10-06T02:30:02.292390+0000","last_clean":"2023-10-06T02:30:02.292390+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:30:02.292390+0000","last_undegraded":"2023-10-06T02:30:02.292390+0000","last_fullsized":"2023-10-06T02:30:02.292390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.306528+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:54:44.819568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":127,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.319479+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:30:02.319479+0000","last_peered":"2023-10-06T02:30:02.319479+0000","last_clean":"2023-10-06T02:30:02.319479+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:30:02.319479+0000","last_undegraded":"2023-10-06T02:30:02.319479+0000","last_fullsized":"2023-10-06T02:30:02.319479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":274,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.292493+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:30:02.292493+0000","last_peered":"2023-10-06T02:30:02.292493+0000","last_clean":"2023-10-06T02:30:02.292493+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:30:02.292493+0000","last_undegraded":"2023-10-06T02:30:02.292493+0000","last_fullsized":"2023-10-06T02:30:02.292493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.304141+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:59.044474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":124,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.292483+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:30:02.292483+0000","last_peered":"2023-10-06T02:30:02.292483+0000","last_clean":"2023-10-06T02:30:02.292483+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:30:02.292483+0000","last_undegraded":"2023-10-06T02:30:02.292483+0000","last_fullsized":"2023-10-06T02:30:02.292483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.303954+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:42.979418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.292483+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:30:02.292483+0000","last_peered":"2023-10-06T02:30:02.292483+0000","last_clean":"2023-10-06T02:30:02.292483+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:30:02.292483+0000","last_undegraded":"2023-10-06T02:30:02.292483+0000","last_fullsized":"2023-10-06T02:30:02.292483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301465+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:25.291289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":123,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.319920+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:30:02.319920+0000","last_peered":"2023-10-06T02:30:02.319920+0000","last_clean":"2023-10-06T02:30:02.319920+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:30:02.319920+0000","last_undegraded":"2023-10-06T02:30:02.319920+0000","last_fullsized":"2023-10-06T02:30:02.319920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.301157+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:42.480213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":122,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.319938+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:30:02.319938+0000","last_peered":"2023-10-06T02:30:02.319938+0000","last_clean":"2023-10-06T02:30:02.319938+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:30:02.319938+0000","last_undegraded":"2023-10-06T02:30:02.319938+0000","last_fullsized":"2023-10-06T02:30:02.319938+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:30:06.298531+0000","last_change":"2023-10-06T02:30:06.298531+0000","last_active":"2023-10-06T02:30:06.298531+0000","last_peered":"2023-10-06T02:30:06.298531+0000","last_clean":"2023-10-06T02:30:06.298531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:06.298531+0000","last_undegraded":"2023-10-06T02:30:06.298531+0000","last_fullsized":"2023-10-06T02:30:06.298531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:30:05.294400+0000","last_change":"2023-10-06T02:30:05.307904+0000","last_active":"2023-10-06T02:30:05.294400+0000","last_peered":"2023-10-06T02:30:05.294400+0000","last_clean":"2023-10-06T02:30:05.294400+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:30:05.294400+0000","last_undegraded":"2023-10-06T02:30:05.294400+0000","last_fullsized":"2023-10-06T02:30:05.294400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:28.450309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":122,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-06T02:30:02.319940+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:30:02.319940+0000","last_peered":"2023-10-06T02:30:02.319940+0000","last_clean":"2023-10-06T02:30:02.319940+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:30:02.319940+0000","last_undegraded":"2023-10-06T02:30:02.319940+0000","last_fullsized":"2023-10-06T02:30:02.319940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575001,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2408,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2465792,"data_stored":1564396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.79700000000000004,"15min":1.111},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71099999999999997,"5min":0.77900000000000003,"15min":0.97899999999999998},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":1.008},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.629,"5min":0.72599999999999998,"15min":1.075},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.76000000000000001,"5min":0.80200000000000005,"15min":1.149},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":0.96999999999999997,"15min":1.048},"last":0.499}]},{"osd":3,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69899999999999995,"5min":0.84399999999999997,"15min":1.175},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73599999999999999,"5min":0.91000000000000003,"15min":1.03},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.48199999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63900000000000001,"5min":0.79400000000000004,"15min":0.873},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80800000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44500000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.78600000000000003,"5min":0.81299999999999994,"15min":0.81899999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.76000000000000001,"15min":0.84899999999999998},"last":0.46600000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72699999999999998,"5min":0.79300000000000004,"15min":0.91700000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.38900000000000001,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.55100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575002,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303208,"kb_used_data":1824,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068632,"statfs":{"total":96636764160,"available":96326279168,"internally_reserved":0,"allocated":1867776,"data_stored":973075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53400000000000003,"15min":0.64000000000000001},"min":{"1min":0.30299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.68899999999999995,"5min":0.79000000000000004,"15min":5.6929999999999996},"last":0.439},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56100000000000005,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.29799999999999999},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":5.7060000000000004},"last":0.48299999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53200000000000003,"15min":0.54100000000000004},"min":{"1min":0.32300000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67100000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53100000000000003,"15min":0.69999999999999996},"min":{"1min":0.372,"5min":0.318,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":0.872,"15min":8.8659999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":0.77500000000000002,"15min":0.80800000000000005},"last":0.38600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55500000000000005,"15min":0.75},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":10.659000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.76800000000000002,"15min":0.85499999999999998},"last":0.501}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47499999999999998,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.27400000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.79600000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67700000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.371}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.49099999999999999,"15min":0.51600000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71099999999999997,"5min":0.751,"15min":0.84399999999999997},"last":0.56399999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.312},"max":{"1min":0.68300000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73899999999999999,"5min":0.86799999999999999,"15min":0.88100000000000001},"last":0.59299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307884,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063956,"statfs":{"total":96636764160,"available":96321490944,"internally_reserved":0,"allocated":2461696,"data_stored":1563443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.36799999999999999,"15min":0.36099999999999999},"min":{"1min":0.26000000000000001,"5min":0.20799999999999999,"15min":0.19},"max":{"1min":0.60399999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.39300000000000002,"15min":0.378},"min":{"1min":0.30599999999999999,"5min":0.27100000000000002,"15min":0.26100000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.32600000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33600000000000002},"min":{"1min":0.253,"5min":0.223,"15min":0.22},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.39600000000000002,"15min":0.39400000000000002},"min":{"1min":0.29599999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.38100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.41299999999999998,"15min":0.40400000000000003},"min":{"1min":0.33200000000000002,"5min":0.28100000000000003,"15min":0.253},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.442},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.39500000000000002,"15min":0.39300000000000002},"min":{"1min":0.26400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.97999999999999998,"5min":0.998,"15min":0.998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63,"15min":0.61699999999999999},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.37},"max":{"1min":0.88300000000000001,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63600000000000001,"15min":0.63700000000000001},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.95499999999999996},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.36499999999999999},"max":{"1min":0.88700000000000001,"5min":0.94499999999999995,"15min":1.0009999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61599999999999999,"15min":0.61099999999999999},"min":{"1min":0.45700000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95999999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67900000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.622,"15min":0.63},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.378},"max":{"1min":0.83799999999999997,"5min":0.89500000000000002,"15min":0.94199999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.98199999999999998},"last":0.61499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575001,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307296,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064544,"statfs":{"total":96636764160,"available":96322093056,"internally_reserved":0,"allocated":1859584,"data_stored":967550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34599999999999997,"15min":0.33500000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.183},"max":{"1min":0.56899999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.374},"min":{"1min":0.223,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.66500000000000004,"5min":0.876,"15min":0.876},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.39400000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.20599999999999999},"max":{"1min":0.56399999999999995,"5min":0.65600000000000003,"15min":0.745},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.372,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.22600000000000001,"15min":0.215},"max":{"1min":0.63600000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52000000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.438,"15min":0.434},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.24399999999999999},"max":{"1min":0.629,"5min":0.71599999999999997,"15min":0.78000000000000003},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.371},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.369},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.99399999999999999},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.32300000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.3320000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.622},"min":{"1min":0.44,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.84899999999999998,"5min":0.88700000000000001,"15min":1.0780000000000001},"last":0.75900000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63700000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.91200000000000003,"15min":1.3999999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.45500000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.0469999999999999},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.78000000000000003},"min":{"1min":0.46200000000000002,"5min":0.41699999999999998,"15min":0.39400000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":11.138},"last":0.746},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.46600000000000003,"5min":0.432,"15min":0.41599999999999998},"max":{"1min":0.86599999999999999,"5min":1.024,"15min":1.429},"last":0.69899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307292,"kb_used_data":1812,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064548,"statfs":{"total":96636764160,"available":96322097152,"internally_reserved":0,"allocated":1855488,"data_stored":966597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34699999999999998,"15min":0.36199999999999999},"min":{"1min":0.218,"5min":0.182,"15min":0.182},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.80300000000000005},"last":0.371},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.38800000000000001},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.58199999999999996,"5min":0.68000000000000005,"15min":0.98999999999999999},"last":0.435}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.375,"15min":0.39200000000000002},"min":{"1min":0.25700000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":3.1230000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":3.0129999999999999},"last":0.35499999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.375,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.23499999999999999},"max":{"1min":0.56899999999999995,"5min":0.59299999999999997,"15min":1.423},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.33500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.77400000000000002},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.443,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.41799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.304},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.439,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.80700000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.45100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0980000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.41799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96499999999999997,"5min":0.97999999999999998,"15min":1.347},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64900000000000002,"15min":0.66200000000000003},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.206},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63800000000000001,"15min":0.66500000000000004},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.385},"last":0.72899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303212,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068628,"statfs":{"total":96636764160,"available":96326275072,"internally_reserved":0,"allocated":1871872,"data_stored":974028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47299999999999998,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.375,"15min":0.38200000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.78100000000000003},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.24099999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.66700000000000004},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.40300000000000002},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59599999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54500000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.246},"max":{"1min":0.57399999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.0049999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.83899999999999997,"5min":0.92700000000000005,"15min":1.1539999999999999},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.37,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84899999999999998,"5min":0.95399999999999996,"15min":1.2110000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.874,"5min":0.89600000000000002,"15min":1.0429999999999999},"last":0.60299999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81999999999999995,"5min":0.90800000000000003,"15min":1.0700000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.47699999999999998,"5min":0.39500000000000002,"15min":0.38600000000000001},"max":{"1min":0.85999999999999999,"5min":0.98499999999999999,"15min":1.391},"last":0.628}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.48299999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80300000000000005,"5min":0.94099999999999995,"15min":1.121},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.63700000000000001,"15min":0.63400000000000001},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88800000000000001,"5min":0.89900000000000002,"15min":0.95099999999999996},"last":0.54000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311392,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060448,"statfs":{"total":96636764160,"available":96317898752,"internally_reserved":0,"allocated":1859584,"data_stored":967550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.252,"5min":0.252,"15min":0.217},"max":{"1min":0.71799999999999997,"5min":0.78900000000000003,"15min":0.86399999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.88900000000000001,"15min":1.7290000000000001},"last":0.59199999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.77300000000000002},"min":{"1min":0.41599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.71999999999999997,"5min":0.749,"15min":17.879999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.76300000000000001},"min":{"1min":0.377,"5min":0.33100000000000002,"15min":0.32700000000000001},"max":{"1min":0.69899999999999995,"5min":0.76500000000000001,"15min":18.010999999999999},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.55100000000000005},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.309},"max":{"1min":0.73299999999999998,"5min":0.84699999999999998,"15min":1.619},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.42599999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":1.6639999999999999},"last":0.439}]},{"osd":3,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.29899999999999999},"max":{"1min":0.76200000000000001,"5min":0.76500000000000001,"15min":1.2729999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44500000000000001,"5min":0.32700000000000001,"15min":0.32200000000000001},"max":{"1min":0.80000000000000004,"5min":0.81999999999999995,"15min":0.84899999999999998},"last":0.45300000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48999999999999999,"15min":0.51200000000000001},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69799999999999995,"5min":0.78900000000000003,"15min":1.532},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.80700000000000005},"last":0.498}]},{"osd":6,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.501,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.64300000000000002,"5min":0.90400000000000003,"15min":1.5700000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76000000000000001,"5min":0.84099999999999997,"15min":1.4319999999999999},"last":0.47899999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.40400000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73899999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72999999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.57899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303200,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068640,"statfs":{"total":96636764160,"available":96326287360,"internally_reserved":0,"allocated":1859584,"data_stored":967550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.34599999999999997,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.78800000000000003,"5min":1.034,"15min":1.103},"last":0.433},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.312},"max":{"1min":0.81799999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.29699999999999999},"max":{"1min":0.91400000000000003,"5min":1.02,"15min":1.1679999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.33900000000000002},"max":{"1min":0.89200000000000002,"5min":0.99399999999999999,"15min":1.0620000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.30399999999999999},"max":{"1min":0.74299999999999999,"5min":1.1870000000000001,"15min":1.2070000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":1.1140000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.84299999999999997,"15min":1.1799999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78900000000000003,"5min":1.1040000000000001,"15min":1.1830000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72399999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.50900000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26500000000000001},"max":{"1min":0.72199999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.29699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79700000000000004,"5min":0.872,"15min":0.872},"last":0.505},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.66300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:30:12.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3f is not active+clean 2023-10-06T02:30:12.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3e is not active+clean 2023-10-06T02:30:12.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3d is not active+clean 2023-10-06T02:30:12.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3c is not active+clean 2023-10-06T02:30:12.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3b is not active+clean 2023-10-06T02:30:12.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3a is not active+clean 2023-10-06T02:30:12.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.39 is not active+clean 2023-10-06T02:30:12.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.38 is not active+clean 2023-10-06T02:30:12.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.37 is not active+clean 2023-10-06T02:30:12.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.36 is not active+clean 2023-10-06T02:30:12.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.35 is not active+clean 2023-10-06T02:30:12.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.34 is not active+clean 2023-10-06T02:30:12.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.33 is not active+clean 2023-10-06T02:30:12.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.32 is not active+clean 2023-10-06T02:30:12.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.31 is not active+clean 2023-10-06T02:30:12.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.30 is not active+clean 2023-10-06T02:30:12.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2f is not active+clean 2023-10-06T02:30:12.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2e is not active+clean 2023-10-06T02:30:12.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2d is not active+clean 2023-10-06T02:30:12.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2c is not active+clean 2023-10-06T02:30:12.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2b is not active+clean 2023-10-06T02:30:12.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2a is not active+clean 2023-10-06T02:30:12.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.29 is not active+clean 2023-10-06T02:30:12.251 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.28 is not active+clean 2023-10-06T02:30:12.251 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.27 is not active+clean 2023-10-06T02:30:12.251 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.26 is not active+clean 2023-10-06T02:30:12.251 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.25 is not active+clean 2023-10-06T02:30:12.251 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.24 is not active+clean 2023-10-06T02:30:12.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.23 is not active+clean 2023-10-06T02:30:12.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.22 is not active+clean 2023-10-06T02:30:12.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.21 is not active+clean 2023-10-06T02:30:12.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.20 is not active+clean 2023-10-06T02:30:12.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.253 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1e is not active+clean 2023-10-06T02:30:12.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.253 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2023-10-06T02:30:12.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.303974+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:39:42.529611+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:30:12.253 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1f is not active+clean 2023-10-06T02:30:12.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.253 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2023-10-06T02:30:12.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.306360+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:17:13.669731+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:30:12.253 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1c is not active+clean 2023-10-06T02:30:12.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2023-10-06T02:30:12.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.302103+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:41:52.673861+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:30:12.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1d is not active+clean 2023-10-06T02:30:12.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2023-10-06T02:30:12.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.301771+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:28:16.722186+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:30:12.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1a is not active+clean 2023-10-06T02:30:12.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2023-10-06T02:30:12.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.304653+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:02:42.612928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:30:12.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1b is not active+clean 2023-10-06T02:30:12.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2023-10-06T02:30:12.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.307922+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:37:21.991317+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:30:12.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.18 is not active+clean 2023-10-06T02:30:12.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2023-10-06T02:30:12.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.304978+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:27:11.948877+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:30:12.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.19 is not active+clean 2023-10-06T02:30:12.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2023-10-06T02:30:12.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.303413+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:35:14.411465+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:30:12.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.e is not active+clean 2023-10-06T02:30:12.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2023-10-06T02:30:12.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.301247+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:01:41.905031+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:30:12.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.f is not active+clean 2023-10-06T02:30:12.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2023-10-06T02:30:12.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.301704+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:42:47.738000+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:30:12.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.c is not active+clean 2023-10-06T02:30:12.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2023-10-06T02:30:12.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.306792+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:46:29.783186+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:30:12.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.d is not active+clean 2023-10-06T02:30:12.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2023-10-06T02:30:12.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.303857+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:59:22.229209+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:30:12.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.a is not active+clean 2023-10-06T02:30:12.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2023-10-06T02:30:12.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.303527+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:03:35.270132+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:30:12.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.b is not active+clean 2023-10-06T02:30:12.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2023-10-06T02:30:12.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.301153+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:22:04.088711+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:30:12.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.8 is not active+clean 2023-10-06T02:30:12.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2023-10-06T02:30:12.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.303158+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:50:43.892133+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:30:12.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.9 is not active+clean 2023-10-06T02:30:12.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2023-10-06T02:30:12.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.302939+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:57:54.745737+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:30:12.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.6 is not active+clean 2023-10-06T02:30:12.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2023-10-06T02:30:12.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.308251+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:52:24.926397+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:30:12.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.7 is not active+clean 2023-10-06T02:30:12.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2023-10-06T02:30:12.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.306579+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:24:57.041002+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:30:12.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.4 is not active+clean 2023-10-06T02:30:12.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2023-10-06T02:30:12.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.301291+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:00:03.528417+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:30:12.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.5 is not active+clean 2023-10-06T02:30:12.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2023-10-06T02:30:12.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.307890+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:54:51.970976+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:30:12.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2 is not active+clean 2023-10-06T02:30:12.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2023-10-06T02:30:12.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.303958+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:24:23.435148+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:30:12.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3 is not active+clean 2023-10-06T02:30:12.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2023-10-06T02:30:12.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.304980+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:41:56.676109+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:30:12.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.0 is not active+clean 2023-10-06T02:30:12.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2023-10-06T02:30:12.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.301445+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:04:54.862008+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:30:12.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1 is not active+clean 2023-10-06T02:30:12.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2023-10-06T02:30:12.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.301237+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:12:17.722040+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:30:12.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.15 is not active+clean 2023-10-06T02:30:12.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2023-10-06T02:30:12.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.302698+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:22:54.339486+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:30:12.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.14 is not active+clean 2023-10-06T02:30:12.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2023-10-06T02:30:12.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.302835+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:13:03.664238+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:30:12.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.13 is not active+clean 2023-10-06T02:30:12.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2023-10-06T02:30:12.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.306528+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:54:44.819568+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:30:12.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.12 is not active+clean 2023-10-06T02:30:12.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2023-10-06T02:30:12.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.304141+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:54:59.044474+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:30:12.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.10 is not active+clean 2023-10-06T02:30:12.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2023-10-06T02:30:12.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.303954+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:46:42.979418+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:30:12.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.11 is not active+clean 2023-10-06T02:30:12.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2023-10-06T02:30:12.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.301465+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:35:25.291289+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:30:12.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.16 is not active+clean 2023-10-06T02:30:12.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2023-10-06T02:30:12.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.301157+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:56:42.480213+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:30:12.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.17 is not active+clean 2023-10-06T02:30:12.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T02:30:06.298531+0000', 'last_change': '2023-10-06T02:30:06.298531+0000', 'last_active': '2023-10-06T02:30:06.298531+0000', 'last_peered': '2023-10-06T02:30:06.298531+0000', 'last_clean': '2023-10-06T02:30:06.298531+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:06.298531+0000', 'last_undegraded': '2023-10-06T02:30:06.298531+0000', 'last_fullsized': '2023-10-06T02:30:06.298531+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:06.298531+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T02:30:12.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2023-10-06T02:30:12.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:30:05.294400+0000', 'last_change': '2023-10-06T02:30:05.307904+0000', 'last_active': '2023-10-06T02:30:05.294400+0000', 'last_peered': '2023-10-06T02:30:05.294400+0000', 'last_clean': '2023-10-06T02:30:05.294400+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:30:05.294400+0000', 'last_undegraded': '2023-10-06T02:30:05.294400+0000', 'last_fullsized': '2023-10-06T02:30:05.294400+0000', 'mapping_epoch': 143, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 143, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'last_clean_scrub_stamp': '2023-10-06T02:30:05.294400+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:22:28.450309+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:30:12.267 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:30:12.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.384+0000 7f64cb59e700 1 Processor -- start 2023-10-06T02:30:12.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.384+0000 7f64cb59e700 1 -- start start 2023-10-06T02:30:12.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.385+0000 7f64cb59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64cc0cf7f0 0x7f64cc158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.385+0000 7f64cb59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f64cc06a1e0 0x7f64cc159110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.385+0000 7f64cb59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64cc0cf360 con 0x7f64cc069e10 2023-10-06T02:30:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.385+0000 7f64cb59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64cc0cb7c0 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.385+0000 7f64cb59e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64cc0ce750 con 0x7f64cc06a1e0 2023-10-06T02:30:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.385+0000 7f64c9d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64cc0cf7f0 0x7f64cc158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.385+0000 7f64c9d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64cc0cf7f0 0x7f64cc158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40290/0 (socket says 172.21.15.6:40290) 2023-10-06T02:30:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.385+0000 7f64ca59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f64cc069e10 0x7f64cc0cb0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56318/0 (socket says 172.21.15.6:56318) 2023-10-06T02:30:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.385+0000 7f64c9d9b700 1 -- 172.21.15.6:0/4020298369 learned_addr learned my addr 172.21.15.6:0/4020298369 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.385+0000 7f64c9d9b700 1 -- 172.21.15.6:0/4020298369 >> v2:172.21.15.175:3300/0 conn(0x7f64cc06a1e0 msgr2=0x7f64cc159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.385+0000 7f64c9d9b700 1 --2- 172.21.15.6:0/4020298369 >> v2:172.21.15.175:3300/0 conn(0x7f64cc06a1e0 0x7f64cc159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.385+0000 7f64c9d9b700 1 -- 172.21.15.6:0/4020298369 >> v1:172.21.15.6:6789/0 conn(0x7f64cc069e10 legacy=0x7f64cc0cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.385+0000 7f64c9d9b700 1 -- 172.21.15.6:0/4020298369 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc0cea30 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.385+0000 7f64c959a700 1 -- 172.21.15.6:0/4020298369 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342234099 0 0) 0x7f64cc0cf360 con 0x7f64cc069e10 2023-10-06T02:30:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.386+0000 7f64c9d9b700 1 --2- 172.21.15.6:0/4020298369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64cc0cf7f0 0x7f64cc158bd0 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7f64cc0cf2d0 tx=0x7f64b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e05ff025f3cffa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.386+0000 7f64c959a700 1 -- 172.21.15.6:0/4020298369 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b400b860 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.386+0000 7f64c959a700 1 -- 172.21.15.6:0/4020298369 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b400b9c0 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.386+0000 7f64c959a700 1 -- 172.21.15.6:0/4020298369 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b400bd60 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.386+0000 7f64cb59e700 1 -- 172.21.15.6:0/4020298369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64cc0cf7f0 msgr2=0x7f64cc158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:12.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.386+0000 7f64cb59e700 1 --2- 172.21.15.6:0/4020298369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64cc0cf7f0 0x7f64cc158bd0 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7f64cc0cf2d0 tx=0x7f64b4009250 comp rx=0 tx=0).stop 2023-10-06T02:30:12.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.386+0000 7f64cb59e700 1 -- 172.21.15.6:0/4020298369 shutdown_connections 2023-10-06T02:30:12.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.386+0000 7f64cb59e700 1 --2- 172.21.15.6:0/4020298369 >> v2:172.21.15.175:3300/0 conn(0x7f64cc06a1e0 0x7f64cc159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.386+0000 7f64cb59e700 1 --2- 172.21.15.6:0/4020298369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64cc0cf7f0 0x7f64cc158bd0 unknown :-1 s=CLOSED pgs=2410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.386+0000 7f64cb59e700 1 -- 172.21.15.6:0/4020298369 >> 172.21.15.6:0/4020298369 conn(0x7f64cc0d0ba0 msgr2=0x7f64cc0ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.386+0000 7f64cb59e700 1 -- 172.21.15.6:0/4020298369 shutdown_connections 2023-10-06T02:30:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.386+0000 7f64cb59e700 1 -- 172.21.15.6:0/4020298369 wait complete. 2023-10-06T02:30:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.387+0000 7f64cb59e700 1 Processor -- start 2023-10-06T02:30:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.387+0000 7f64cb59e700 1 -- start start 2023-10-06T02:30:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.388+0000 7f64cb59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64cc069e10 0x7f64cc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.388+0000 7f64cb59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64cc06a1e0 0x7f64cc1454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.388+0000 7f64cb59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64cc0cf7f0 0x7f64cc0c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.388+0000 7f64cb59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc171c50 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.388+0000 7f64cb59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc1717c0 con 0x7f64cc069e10 2023-10-06T02:30:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.388+0000 7f64cb59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc170ed0 con 0x7f64cc06a1e0 2023-10-06T02:30:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.388+0000 7f64cad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64cc0cf7f0 0x7f64cc0c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.388+0000 7f64cad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64cc0cf7f0 0x7f64cc0c4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40300/0 (socket says 172.21.15.6:40300) 2023-10-06T02:30:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.388+0000 7f64cad9d700 1 -- 172.21.15.6:0/775558818 learned_addr learned my addr 172.21.15.6:0/775558818 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.389+0000 7f64c9d9b700 1 --2- 172.21.15.6:0/775558818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64cc06a1e0 0x7f64cc1454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.389+0000 7f64ca59c700 1 --2- 172.21.15.6:0/775558818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64cc069e10 0x7f64cc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.389+0000 7f64cad9d700 1 -- 172.21.15.6:0/775558818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64cc06a1e0 msgr2=0x7f64cc1454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.389+0000 7f64cad9d700 1 --2- 172.21.15.6:0/775558818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64cc06a1e0 0x7f64cc1454c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.389+0000 7f64cad9d700 1 -- 172.21.15.6:0/775558818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64cc069e10 msgr2=0x7f64cc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.389+0000 7f64cad9d700 1 --2- 172.21.15.6:0/775558818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64cc069e10 0x7f64cc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.389+0000 7f64cad9d700 1 -- 172.21.15.6:0/775558818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b40094f0 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.389+0000 7f64cad9d700 1 --2- 172.21.15.6:0/775558818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64cc0cf7f0 0x7f64cc0c4e70 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00bc60 tx=0x7f64bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.389+0000 7f64c27fc700 1 -- 172.21.15.6:0/775558818 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc0092e0 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.389+0000 7f64c27fc700 1 -- 172.21.15.6:0/775558818 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64bc00c7b0 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.389+0000 7f64cb59e700 1 -- 172.21.15.6:0/775558818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64cc06bff0 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.389+0000 7f64c27fc700 1 -- 172.21.15.6:0/775558818 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc00cb90 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.389+0000 7f64cb59e700 1 -- 172.21.15.6:0/775558818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64cc171450 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.390+0000 7f64cb59e700 1 -- 172.21.15.6:0/775558818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64cc064aa0 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.390+0000 7f64c27fc700 1 -- 172.21.15.6:0/775558818 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64bc012070 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.391+0000 7f64c27fc700 1 --2- 172.21.15.6:0/775558818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f64ac066f30 0x7f64ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.391+0000 7f64c27fc700 1 -- 172.21.15.6:0/775558818 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f64bc0843d0 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.391+0000 7f64ca59c700 1 --2- 172.21.15.6:0/775558818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f64ac066f30 0x7f64ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.391+0000 7f64ca59c700 1 --2- 172.21.15.6:0/775558818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f64ac066f30 0x7f64ac0693e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f64cc14c400 tx=0x7f64c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.395+0000 7f64c27fc700 1 -- 172.21.15.6:0/775558818 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64bc0513a0 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.668+0000 7f64cb59e700 1 -- 172.21.15.6:0/775558818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f64cc171900 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.668+0000 7f64c27fc700 1 -- 172.21.15.6:0/775558818 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1116 (secure 0 0 0) 0x7f64bc01a470 con 0x7f64cc0cf7f0 2023-10-06T02:30:12.670 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:12.670 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"c557bd13-0401-4965-a08f-5579f545617e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":767,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":146,"num_osds":8,"num_up_osds":8,"osd_up_since":1696558654,"num_in_osds":8,"osd_in_since":1696558647,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":2510204928,"bytes_avail":770583908352,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":359,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":10872}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":42,"modified":"2023-10-06T02:29:46.743085+0000","services":{}},"progress_events":{}} 2023-10-06T02:30:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.670+0000 7f64cb59e700 1 -- 172.21.15.6:0/775558818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f64ac066f30 msgr2=0x7f64ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.670+0000 7f64cb59e700 1 --2- 172.21.15.6:0/775558818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f64ac066f30 0x7f64ac0693e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f64cc14c400 tx=0x7f64c4009040 comp rx=0 tx=0).stop 2023-10-06T02:30:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.670+0000 7f64cb59e700 1 -- 172.21.15.6:0/775558818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64cc0cf7f0 msgr2=0x7f64cc0c4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.670+0000 7f64cb59e700 1 --2- 172.21.15.6:0/775558818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64cc0cf7f0 0x7f64cc0c4e70 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00bc60 tx=0x7f64bc009840 comp rx=0 tx=0).stop 2023-10-06T02:30:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.670+0000 7f64cb59e700 1 -- 172.21.15.6:0/775558818 shutdown_connections 2023-10-06T02:30:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.670+0000 7f64cb59e700 1 --2- 172.21.15.6:0/775558818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f64ac066f30 0x7f64ac0693e0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.670+0000 7f64cb59e700 1 --2- 172.21.15.6:0/775558818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64cc0cf7f0 0x7f64cc0c4e70 unknown :-1 s=CLOSED pgs=2411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.670+0000 7f64cb59e700 1 --2- 172.21.15.6:0/775558818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64cc069e10 0x7f64cc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.670+0000 7f64cb59e700 1 --2- 172.21.15.6:0/775558818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64cc06a1e0 0x7f64cc1454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.670+0000 7f64cb59e700 1 -- 172.21.15.6:0/775558818 >> 172.21.15.6:0/775558818 conn(0x7f64cc0d0ba0 msgr2=0x7f64cc157cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.670+0000 7f64cb59e700 1 -- 172.21.15.6:0/775558818 shutdown_connections 2023-10-06T02:30:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.670+0000 7f64cb59e700 1 -- 172.21.15.6:0/775558818 wait complete. 2023-10-06T02:30:12.684 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T02:30:12.684 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:30:12.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.801+0000 7f7f74030700 1 Processor -- start 2023-10-06T02:30:12.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.801+0000 7f7f74030700 1 -- start start 2023-10-06T02:30:12.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.802+0000 7f7f74030700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7f6c0af4e0 0x7f7f6c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:12.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.802+0000 7f7f74030700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7f6c15db70 0x7f7f6c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:12.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.802+0000 7f7f74030700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6c15e190 con 0x7f7f6c0af8b0 2023-10-06T02:30:12.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.802+0000 7f7f74030700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6c0b1910 con 0x7f7f6c0af4e0 2023-10-06T02:30:12.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.802+0000 7f7f74030700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6c15dfa0 con 0x7f7f6c15db70 2023-10-06T02:30:12.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.802+0000 7f7f71dcc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7f6c0af4e0 0x7f7f6c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:12.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.802+0000 7f7f71dcc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7f6c0af4e0 0x7f7f6c0b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40306/0 (socket says 172.21.15.6:40306) 2023-10-06T02:30:12.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.802+0000 7f7f71dcc700 1 -- 172.21.15.6:0/3265001526 learned_addr learned my addr 172.21.15.6:0/3265001526 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:12.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.803+0000 7f7f725cd700 1 --2- 172.21.15.6:0/3265001526 >> v2:172.21.15.175:3300/0 conn(0x7f7f6c15db70 0x7f7f6c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:12.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.803+0000 7f7f71dcc700 1 -- 172.21.15.6:0/3265001526 >> v2:172.21.15.175:3300/0 conn(0x7f7f6c15db70 msgr2=0x7f7f6c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:12.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.803+0000 7f7f71dcc700 1 --2- 172.21.15.6:0/3265001526 >> v2:172.21.15.175:3300/0 conn(0x7f7f6c15db70 0x7f7f6c0b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.803+0000 7f7f71dcc700 1 -- 172.21.15.6:0/3265001526 >> v1:172.21.15.175:6789/0 conn(0x7f7f6c0af8b0 legacy=0x7f7f6c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:12.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.803+0000 7f7f71dcc700 1 -- 172.21.15.6:0/3265001526 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c0cb650 con 0x7f7f6c0af4e0 2023-10-06T02:30:12.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.803+0000 7f7f71dcc700 1 --2- 172.21.15.6:0/3265001526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f6c0af4e0 0x7f7f6c0b20e0 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0c7280 tx=0x7f7f64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9b6dcaae1db136 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:12.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.803+0000 7f7f70dca700 1 -- 172.21.15.6:0/3265001526 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400b820 con 0x7f7f6c0af4e0 2023-10-06T02:30:12.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.803+0000 7f7f70dca700 1 -- 172.21.15.6:0/3265001526 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6400b980 con 0x7f7f6c0af4e0 2023-10-06T02:30:12.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.803+0000 7f7f70dca700 1 -- 172.21.15.6:0/3265001526 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400bd20 con 0x7f7f6c0af4e0 2023-10-06T02:30:12.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.803+0000 7f7f74030700 1 -- 172.21.15.6:0/3265001526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f6c0af4e0 msgr2=0x7f7f6c0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:12.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.803+0000 7f7f74030700 1 --2- 172.21.15.6:0/3265001526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f6c0af4e0 0x7f7f6c0b20e0 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0c7280 tx=0x7f7f64009250 comp rx=0 tx=0).stop 2023-10-06T02:30:12.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.803+0000 7f7f74030700 1 -- 172.21.15.6:0/3265001526 shutdown_connections 2023-10-06T02:30:12.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.803+0000 7f7f74030700 1 --2- 172.21.15.6:0/3265001526 >> v2:172.21.15.175:3300/0 conn(0x7f7f6c15db70 0x7f7f6c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.803+0000 7f7f74030700 1 --2- 172.21.15.6:0/3265001526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f6c0af4e0 0x7f7f6c0b20e0 unknown :-1 s=CLOSED pgs=2412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.803+0000 7f7f74030700 1 -- 172.21.15.6:0/3265001526 >> 172.21.15.6:0/3265001526 conn(0x7f7f6c068680 msgr2=0x7f7f6c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:12.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.804+0000 7f7f74030700 1 -- 172.21.15.6:0/3265001526 shutdown_connections 2023-10-06T02:30:12.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.804+0000 7f7f74030700 1 -- 172.21.15.6:0/3265001526 wait complete. 2023-10-06T02:30:12.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.805+0000 7f7f74030700 1 Processor -- start 2023-10-06T02:30:12.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.805+0000 7f7f74030700 1 -- start start 2023-10-06T02:30:12.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.805+0000 7f7f74030700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f6c0af4e0 0x7f7f6c0a76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:12.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f74030700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f6c0af8b0 0x7f7f6c0ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:12.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f74030700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f6c15db70 0x7f7f6c0a8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:12.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f74030700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0ceb60 con 0x7f7f6c0af4e0 2023-10-06T02:30:12.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f74030700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0cdf50 con 0x7f7f6c15db70 2023-10-06T02:30:12.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f74030700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0ce230 con 0x7f7f6c0af8b0 2023-10-06T02:30:12.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f71dcc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f6c0af4e0 0x7f7f6c0a76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:12.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f71dcc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f6c0af4e0 0x7f7f6c0a76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40318/0 (socket says 172.21.15.6:40318) 2023-10-06T02:30:12.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f71dcc700 1 -- 172.21.15.6:0/1474087159 learned_addr learned my addr 172.21.15.6:0/1474087159 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:12.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f725cd700 1 --2- 172.21.15.6:0/1474087159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f6c15db70 0x7f7f6c0a8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:12.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f715cb700 1 --2- 172.21.15.6:0/1474087159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f6c0af8b0 0x7f7f6c0ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:12.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f71dcc700 1 -- 172.21.15.6:0/1474087159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f6c0af8b0 msgr2=0x7f7f6c0ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:12.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f71dcc700 1 --2- 172.21.15.6:0/1474087159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f6c0af8b0 0x7f7f6c0ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f71dcc700 1 -- 172.21.15.6:0/1474087159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f6c15db70 msgr2=0x7f7f6c0a8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:12.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f71dcc700 1 --2- 172.21.15.6:0/1474087159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f6c15db70 0x7f7f6c0a8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:12.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f71dcc700 1 -- 172.21.15.6:0/1474087159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f640094f0 con 0x7f7f6c0af4e0 2023-10-06T02:30:12.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f725cd700 1 --2- 172.21.15.6:0/1474087159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f6c15db70 0x7f7f6c0a8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:12.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f715cb700 1 --2- 172.21.15.6:0/1474087159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f6c0af8b0 0x7f7f6c0ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:12.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f71dcc700 1 --2- 172.21.15.6:0/1474087159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f6c0af4e0 0x7f7f6c0a76e0 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7f7f64003080 tx=0x7f7f64016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:12.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f69ffb700 1 -- 172.21.15.6:0/1474087159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64011e20 con 0x7f7f6c0af4e0 2023-10-06T02:30:12.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f69ffb700 1 -- 172.21.15.6:0/1474087159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6401b680 con 0x7f7f6c0af4e0 2023-10-06T02:30:12.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f69ffb700 1 -- 172.21.15.6:0/1474087159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6401ba40 con 0x7f7f6c0af4e0 2023-10-06T02:30:12.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.806+0000 7f7f74030700 1 -- 172.21.15.6:0/1474087159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f6c0ce510 con 0x7f7f6c0af4e0 2023-10-06T02:30:12.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.807+0000 7f7f74030700 1 -- 172.21.15.6:0/1474087159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6c0a9500 con 0x7f7f6c0af4e0 2023-10-06T02:30:12.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.808+0000 7f7f74030700 1 -- 172.21.15.6:0/1474087159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6c0cee40 con 0x7f7f6c0af4e0 2023-10-06T02:30:12.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.808+0000 7f7f69ffb700 1 -- 172.21.15.6:0/1474087159 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f6401c450 con 0x7f7f6c0af4e0 2023-10-06T02:30:12.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.808+0000 7f7f69ffb700 1 --2- 172.21.15.6:0/1474087159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f58066f30 0x7f7f580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:12.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.808+0000 7f7f69ffb700 1 -- 172.21.15.6:0/1474087159 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7f64086460 con 0x7f7f6c0af4e0 2023-10-06T02:30:12.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.809+0000 7f7f715cb700 1 --2- 172.21.15.6:0/1474087159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f58066f30 0x7f7f580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:12.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.809+0000 7f7f715cb700 1 --2- 172.21.15.6:0/1474087159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f58066f30 0x7f7f580693e0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f7f60006fd0 tx=0x7f7f60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:12.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:12.813+0000 7f7f69ffb700 1 -- 172.21.15.6:0/1474087159 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f64053430 con 0x7f7f6c0af4e0 2023-10-06T02:30:13.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:13.000+0000 7f7f74030700 1 -- 172.21.15.6:0/1474087159 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7f6c0ceca0 con 0x7f7f58066f30 2023-10-06T02:30:13.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:13.010+0000 7f7f69ffb700 1 -- 172.21.15.6:0/1474087159 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312277 (secure 0 0 0) 0x7f7f60007df0 con 0x7f7f58066f30 2023-10-06T02:30:13.015 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:13.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:13.013+0000 7f7f74030700 1 -- 172.21.15.6:0/1474087159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f58066f30 msgr2=0x7f7f580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:13.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:13.013+0000 7f7f74030700 1 --2- 172.21.15.6:0/1474087159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f58066f30 0x7f7f580693e0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f7f60006fd0 tx=0x7f7f60008040 comp rx=0 tx=0).stop 2023-10-06T02:30:13.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:13.013+0000 7f7f74030700 1 -- 172.21.15.6:0/1474087159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f6c0af4e0 msgr2=0x7f7f6c0a76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:13.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:13.013+0000 7f7f74030700 1 --2- 172.21.15.6:0/1474087159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f6c0af4e0 0x7f7f6c0a76e0 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7f7f64003080 tx=0x7f7f64016000 comp rx=0 tx=0).stop 2023-10-06T02:30:13.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:13.013+0000 7f7f74030700 1 -- 172.21.15.6:0/1474087159 shutdown_connections 2023-10-06T02:30:13.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:13.013+0000 7f7f74030700 1 --2- 172.21.15.6:0/1474087159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f6c15db70 0x7f7f6c0a8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:13.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:13.013+0000 7f7f74030700 1 --2- 172.21.15.6:0/1474087159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7f58066f30 0x7f7f580693e0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:13.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:13.013+0000 7f7f74030700 1 --2- 172.21.15.6:0/1474087159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f6c0af4e0 0x7f7f6c0a76e0 unknown :-1 s=CLOSED pgs=2413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:13.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:13.013+0000 7f7f74030700 1 --2- 172.21.15.6:0/1474087159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f6c0af8b0 0x7f7f6c0ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:13.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:13.013+0000 7f7f74030700 1 -- 172.21.15.6:0/1474087159 >> 172.21.15.6:0/1474087159 conn(0x7f7f6c068680 msgr2=0x7f7f6c0c9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:13.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:13.013+0000 7f7f74030700 1 -- 172.21.15.6:0/1474087159 shutdown_connections 2023-10-06T02:30:13.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:13.013+0000 7f7f74030700 1 -- 172.21.15.6:0/1474087159 wait complete. 2023-10-06T02:30:13.018 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:30:13.027 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":518,"stamp":"2023-10-06T02:30:12.749175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2451772,"kb_used_data":16124,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752522948,"statfs":{"total":773094113280,"available":770583498752,"internally_reserved":0,"allocated":16510976,"data_stored":9145377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.446507"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.355970+0000","last_change":"2023-10-06T02:30:07.351954+0000","last_active":"2023-10-06T02:30:07.355970+0000","last_peered":"2023-10-06T02:30:07.355970+0000","last_clean":"2023-10-06T02:30:07.355970+0000","last_became_active":"2023-10-06T02:30:07.351515+0000","last_became_peered":"2023-10-06T02:30:07.351515+0000","last_unstale":"2023-10-06T02:30:07.355970+0000","last_undegraded":"2023-10-06T02:30:07.355970+0000","last_fullsized":"2023-10-06T02:30:07.355970+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:11.816588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.350933+0000","last_change":"2023-10-06T02:30:07.346725+0000","last_active":"2023-10-06T02:30:07.350933+0000","last_peered":"2023-10-06T02:30:07.350933+0000","last_clean":"2023-10-06T02:30:07.350933+0000","last_became_active":"2023-10-06T02:30:07.346391+0000","last_became_peered":"2023-10-06T02:30:07.346391+0000","last_unstale":"2023-10-06T02:30:07.350933+0000","last_undegraded":"2023-10-06T02:30:07.350933+0000","last_fullsized":"2023-10-06T02:30:07.350933+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:42.909162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346843+0000","last_change":"2023-10-06T02:30:07.341016+0000","last_active":"2023-10-06T02:30:07.346843+0000","last_peered":"2023-10-06T02:30:07.346843+0000","last_clean":"2023-10-06T02:30:07.346843+0000","last_became_active":"2023-10-06T02:30:07.340758+0000","last_became_peered":"2023-10-06T02:30:07.340758+0000","last_unstale":"2023-10-06T02:30:07.346843+0000","last_undegraded":"2023-10-06T02:30:07.346843+0000","last_fullsized":"2023-10-06T02:30:07.346843+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:49.426843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353017+0000","last_change":"2023-10-06T02:30:07.347836+0000","last_active":"2023-10-06T02:30:07.353017+0000","last_peered":"2023-10-06T02:30:07.353017+0000","last_clean":"2023-10-06T02:30:07.353017+0000","last_became_active":"2023-10-06T02:30:07.345084+0000","last_became_peered":"2023-10-06T02:30:07.345084+0000","last_unstale":"2023-10-06T02:30:07.353017+0000","last_undegraded":"2023-10-06T02:30:07.353017+0000","last_fullsized":"2023-10-06T02:30:07.353017+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:20.252454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.342549+0000","last_change":"2023-10-06T02:30:07.338827+0000","last_active":"2023-10-06T02:30:07.342549+0000","last_peered":"2023-10-06T02:30:07.342549+0000","last_clean":"2023-10-06T02:30:07.342549+0000","last_became_active":"2023-10-06T02:30:07.338490+0000","last_became_peered":"2023-10-06T02:30:07.338490+0000","last_unstale":"2023-10-06T02:30:07.342549+0000","last_undegraded":"2023-10-06T02:30:07.342549+0000","last_fullsized":"2023-10-06T02:30:07.342549+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:59.085453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354969+0000","last_change":"2023-10-06T02:30:07.342419+0000","last_active":"2023-10-06T02:30:07.354969+0000","last_peered":"2023-10-06T02:30:07.354969+0000","last_clean":"2023-10-06T02:30:07.354969+0000","last_became_active":"2023-10-06T02:30:07.342131+0000","last_became_peered":"2023-10-06T02:30:07.342131+0000","last_unstale":"2023-10-06T02:30:07.354969+0000","last_undegraded":"2023-10-06T02:30:07.354969+0000","last_fullsized":"2023-10-06T02:30:07.354969+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:42.173757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.344921+0000","last_change":"2023-10-06T02:30:07.342991+0000","last_active":"2023-10-06T02:30:07.344921+0000","last_peered":"2023-10-06T02:30:07.344921+0000","last_clean":"2023-10-06T02:30:07.344921+0000","last_became_active":"2023-10-06T02:30:07.342674+0000","last_became_peered":"2023-10-06T02:30:07.342674+0000","last_unstale":"2023-10-06T02:30:07.344921+0000","last_undegraded":"2023-10-06T02:30:07.344921+0000","last_fullsized":"2023-10-06T02:30:07.344921+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:47.896372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346607+0000","last_change":"2023-10-06T02:30:07.339901+0000","last_active":"2023-10-06T02:30:07.346607+0000","last_peered":"2023-10-06T02:30:07.346607+0000","last_clean":"2023-10-06T02:30:07.346607+0000","last_became_active":"2023-10-06T02:30:07.339183+0000","last_became_peered":"2023-10-06T02:30:07.339183+0000","last_unstale":"2023-10-06T02:30:07.346607+0000","last_undegraded":"2023-10-06T02:30:07.346607+0000","last_fullsized":"2023-10-06T02:30:07.346607+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:28.552907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.351762+0000","last_change":"2023-10-06T02:30:07.345766+0000","last_active":"2023-10-06T02:30:07.351762+0000","last_peered":"2023-10-06T02:30:07.351762+0000","last_clean":"2023-10-06T02:30:07.351762+0000","last_became_active":"2023-10-06T02:30:07.345460+0000","last_became_peered":"2023-10-06T02:30:07.345460+0000","last_unstale":"2023-10-06T02:30:07.351762+0000","last_undegraded":"2023-10-06T02:30:07.351762+0000","last_fullsized":"2023-10-06T02:30:07.351762+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:10.625993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.352845+0000","last_change":"2023-10-06T02:30:07.347117+0000","last_active":"2023-10-06T02:30:07.352845+0000","last_peered":"2023-10-06T02:30:07.352845+0000","last_clean":"2023-10-06T02:30:07.352845+0000","last_became_active":"2023-10-06T02:30:07.346732+0000","last_became_peered":"2023-10-06T02:30:07.346732+0000","last_unstale":"2023-10-06T02:30:07.352845+0000","last_undegraded":"2023-10-06T02:30:07.352845+0000","last_fullsized":"2023-10-06T02:30:07.352845+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:22.819771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354256+0000","last_change":"2023-10-06T02:30:07.350349+0000","last_active":"2023-10-06T02:30:07.354256+0000","last_peered":"2023-10-06T02:30:07.354256+0000","last_clean":"2023-10-06T02:30:07.354256+0000","last_became_active":"2023-10-06T02:30:07.350090+0000","last_became_peered":"2023-10-06T02:30:07.350090+0000","last_unstale":"2023-10-06T02:30:07.354256+0000","last_undegraded":"2023-10-06T02:30:07.354256+0000","last_fullsized":"2023-10-06T02:30:07.354256+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:18.726171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353036+0000","last_change":"2023-10-06T02:30:07.347427+0000","last_active":"2023-10-06T02:30:07.353036+0000","last_peered":"2023-10-06T02:30:07.353036+0000","last_clean":"2023-10-06T02:30:07.353036+0000","last_became_active":"2023-10-06T02:30:07.340357+0000","last_became_peered":"2023-10-06T02:30:07.340357+0000","last_unstale":"2023-10-06T02:30:07.353036+0000","last_undegraded":"2023-10-06T02:30:07.353036+0000","last_fullsized":"2023-10-06T02:30:07.353036+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:09.297561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346787+0000","last_change":"2023-10-06T02:30:07.336990+0000","last_active":"2023-10-06T02:30:07.346787+0000","last_peered":"2023-10-06T02:30:07.346787+0000","last_clean":"2023-10-06T02:30:07.346787+0000","last_became_active":"2023-10-06T02:30:07.336584+0000","last_became_peered":"2023-10-06T02:30:07.336584+0000","last_unstale":"2023-10-06T02:30:07.346787+0000","last_undegraded":"2023-10-06T02:30:07.346787+0000","last_fullsized":"2023-10-06T02:30:07.346787+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:05.329646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346475+0000","last_change":"2023-10-06T02:30:07.338334+0000","last_active":"2023-10-06T02:30:07.346475+0000","last_peered":"2023-10-06T02:30:07.346475+0000","last_clean":"2023-10-06T02:30:07.346475+0000","last_became_active":"2023-10-06T02:30:07.338035+0000","last_became_peered":"2023-10-06T02:30:07.338035+0000","last_unstale":"2023-10-06T02:30:07.346475+0000","last_undegraded":"2023-10-06T02:30:07.346475+0000","last_fullsized":"2023-10-06T02:30:07.346475+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:24.477294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.347927+0000","last_change":"2023-10-06T02:30:07.340152+0000","last_active":"2023-10-06T02:30:07.347927+0000","last_peered":"2023-10-06T02:30:07.347927+0000","last_clean":"2023-10-06T02:30:07.347927+0000","last_became_active":"2023-10-06T02:30:07.339841+0000","last_became_peered":"2023-10-06T02:30:07.339841+0000","last_unstale":"2023-10-06T02:30:07.347927+0000","last_undegraded":"2023-10-06T02:30:07.347927+0000","last_fullsized":"2023-10-06T02:30:07.347927+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:38.048243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354716+0000","last_change":"2023-10-06T02:30:07.351986+0000","last_active":"2023-10-06T02:30:07.354716+0000","last_peered":"2023-10-06T02:30:07.354716+0000","last_clean":"2023-10-06T02:30:07.354716+0000","last_became_active":"2023-10-06T02:30:07.351662+0000","last_became_peered":"2023-10-06T02:30:07.351662+0000","last_unstale":"2023-10-06T02:30:07.354716+0000","last_undegraded":"2023-10-06T02:30:07.354716+0000","last_fullsized":"2023-10-06T02:30:07.354716+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:56.111995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354027+0000","last_change":"2023-10-06T02:30:07.349420+0000","last_active":"2023-10-06T02:30:07.354027+0000","last_peered":"2023-10-06T02:30:07.354027+0000","last_clean":"2023-10-06T02:30:07.354027+0000","last_became_active":"2023-10-06T02:30:07.349060+0000","last_became_peered":"2023-10-06T02:30:07.349060+0000","last_unstale":"2023-10-06T02:30:07.354027+0000","last_undegraded":"2023-10-06T02:30:07.354027+0000","last_fullsized":"2023-10-06T02:30:07.354027+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:00:04.532549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353884+0000","last_change":"2023-10-06T02:30:07.348912+0000","last_active":"2023-10-06T02:30:07.353884+0000","last_peered":"2023-10-06T02:30:07.353884+0000","last_clean":"2023-10-06T02:30:07.353884+0000","last_became_active":"2023-10-06T02:30:07.348628+0000","last_became_peered":"2023-10-06T02:30:07.348628+0000","last_unstale":"2023-10-06T02:30:07.353884+0000","last_undegraded":"2023-10-06T02:30:07.353884+0000","last_fullsized":"2023-10-06T02:30:07.353884+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:33.896435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346306+0000","last_change":"2023-10-06T02:30:07.336164+0000","last_active":"2023-10-06T02:30:07.346306+0000","last_peered":"2023-10-06T02:30:07.346306+0000","last_clean":"2023-10-06T02:30:07.346306+0000","last_became_active":"2023-10-06T02:30:07.335860+0000","last_became_peered":"2023-10-06T02:30:07.335860+0000","last_unstale":"2023-10-06T02:30:07.346306+0000","last_undegraded":"2023-10-06T02:30:07.346306+0000","last_fullsized":"2023-10-06T02:30:07.346306+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:57.680241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346139+0000","last_change":"2023-10-06T02:30:07.333044+0000","last_active":"2023-10-06T02:30:07.346139+0000","last_peered":"2023-10-06T02:30:07.346139+0000","last_clean":"2023-10-06T02:30:07.346139+0000","last_became_active":"2023-10-06T02:30:07.332771+0000","last_became_peered":"2023-10-06T02:30:07.332771+0000","last_unstale":"2023-10-06T02:30:07.346139+0000","last_undegraded":"2023-10-06T02:30:07.346139+0000","last_fullsized":"2023-10-06T02:30:07.346139+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:15.415596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.350771+0000","last_change":"2023-10-06T02:30:07.346691+0000","last_active":"2023-10-06T02:30:07.350771+0000","last_peered":"2023-10-06T02:30:07.350771+0000","last_clean":"2023-10-06T02:30:07.350771+0000","last_became_active":"2023-10-06T02:30:07.346402+0000","last_became_peered":"2023-10-06T02:30:07.346402+0000","last_unstale":"2023-10-06T02:30:07.350771+0000","last_undegraded":"2023-10-06T02:30:07.350771+0000","last_fullsized":"2023-10-06T02:30:07.350771+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:51.784533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.350248+0000","last_change":"2023-10-06T02:30:07.339506+0000","last_active":"2023-10-06T02:30:07.350248+0000","last_peered":"2023-10-06T02:30:07.350248+0000","last_clean":"2023-10-06T02:30:07.350248+0000","last_became_active":"2023-10-06T02:30:07.339225+0000","last_became_peered":"2023-10-06T02:30:07.339225+0000","last_unstale":"2023-10-06T02:30:07.350248+0000","last_undegraded":"2023-10-06T02:30:07.350248+0000","last_fullsized":"2023-10-06T02:30:07.350248+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:15.415596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346914+0000","last_change":"2023-10-06T02:30:07.333524+0000","last_active":"2023-10-06T02:30:07.346914+0000","last_peered":"2023-10-06T02:30:07.346914+0000","last_clean":"2023-10-06T02:30:07.346914+0000","last_became_active":"2023-10-06T02:30:07.333281+0000","last_became_peered":"2023-10-06T02:30:07.333281+0000","last_unstale":"2023-10-06T02:30:07.346914+0000","last_undegraded":"2023-10-06T02:30:07.346914+0000","last_fullsized":"2023-10-06T02:30:07.346914+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:13.172573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.357163+0000","last_change":"2023-10-06T02:30:07.350082+0000","last_active":"2023-10-06T02:30:07.357163+0000","last_peered":"2023-10-06T02:30:07.357163+0000","last_clean":"2023-10-06T02:30:07.357163+0000","last_became_active":"2023-10-06T02:30:07.349296+0000","last_became_peered":"2023-10-06T02:30:07.349296+0000","last_unstale":"2023-10-06T02:30:07.357163+0000","last_undegraded":"2023-10-06T02:30:07.357163+0000","last_fullsized":"2023-10-06T02:30:07.357163+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:06.102151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354008+0000","last_change":"2023-10-06T02:30:07.349045+0000","last_active":"2023-10-06T02:30:07.354008+0000","last_peered":"2023-10-06T02:30:07.354008+0000","last_clean":"2023-10-06T02:30:07.354008+0000","last_became_active":"2023-10-06T02:30:07.348713+0000","last_became_peered":"2023-10-06T02:30:07.348713+0000","last_unstale":"2023-10-06T02:30:07.354008+0000","last_undegraded":"2023-10-06T02:30:07.354008+0000","last_fullsized":"2023-10-06T02:30:07.354008+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:06.102151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.352868+0000","last_change":"2023-10-06T02:30:07.347431+0000","last_active":"2023-10-06T02:30:07.352868+0000","last_peered":"2023-10-06T02:30:07.352868+0000","last_clean":"2023-10-06T02:30:07.352868+0000","last_became_active":"2023-10-06T02:30:07.347126+0000","last_became_peered":"2023-10-06T02:30:07.347126+0000","last_unstale":"2023-10-06T02:30:07.352868+0000","last_undegraded":"2023-10-06T02:30:07.352868+0000","last_fullsized":"2023-10-06T02:30:07.352868+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:24.131233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353542+0000","last_change":"2023-10-06T02:30:07.341797+0000","last_active":"2023-10-06T02:30:07.353542+0000","last_peered":"2023-10-06T02:30:07.353542+0000","last_clean":"2023-10-06T02:30:07.353542+0000","last_became_active":"2023-10-06T02:30:07.341508+0000","last_became_peered":"2023-10-06T02:30:07.341508+0000","last_unstale":"2023-10-06T02:30:07.353542+0000","last_undegraded":"2023-10-06T02:30:07.353542+0000","last_fullsized":"2023-10-06T02:30:07.353542+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:31.697463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.357140+0000","last_change":"2023-10-06T02:30:07.353989+0000","last_active":"2023-10-06T02:30:07.357140+0000","last_peered":"2023-10-06T02:30:07.357140+0000","last_clean":"2023-10-06T02:30:07.357140+0000","last_became_active":"2023-10-06T02:30:07.353717+0000","last_became_peered":"2023-10-06T02:30:07.353717+0000","last_unstale":"2023-10-06T02:30:07.357140+0000","last_undegraded":"2023-10-06T02:30:07.357140+0000","last_fullsized":"2023-10-06T02:30:07.357140+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:55.749868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.348681+0000","last_change":"2023-10-06T02:30:07.341632+0000","last_active":"2023-10-06T02:30:07.348681+0000","last_peered":"2023-10-06T02:30:07.348681+0000","last_clean":"2023-10-06T02:30:07.348681+0000","last_became_active":"2023-10-06T02:30:07.341381+0000","last_became_peered":"2023-10-06T02:30:07.341381+0000","last_unstale":"2023-10-06T02:30:07.348681+0000","last_undegraded":"2023-10-06T02:30:07.348681+0000","last_fullsized":"2023-10-06T02:30:07.348681+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:05.107956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353859+0000","last_change":"2023-10-06T02:30:07.351070+0000","last_active":"2023-10-06T02:30:07.353859+0000","last_peered":"2023-10-06T02:30:07.353859+0000","last_clean":"2023-10-06T02:30:07.353859+0000","last_became_active":"2023-10-06T02:30:07.350833+0000","last_became_peered":"2023-10-06T02:30:07.350833+0000","last_unstale":"2023-10-06T02:30:07.353859+0000","last_undegraded":"2023-10-06T02:30:07.353859+0000","last_fullsized":"2023-10-06T02:30:07.353859+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:30.235922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.352523+0000","last_change":"2023-10-06T02:30:07.345769+0000","last_active":"2023-10-06T02:30:07.352523+0000","last_peered":"2023-10-06T02:30:07.352523+0000","last_clean":"2023-10-06T02:30:07.352523+0000","last_became_active":"2023-10-06T02:30:07.345497+0000","last_became_peered":"2023-10-06T02:30:07.345497+0000","last_unstale":"2023-10-06T02:30:07.352523+0000","last_undegraded":"2023-10-06T02:30:07.352523+0000","last_fullsized":"2023-10-06T02:30:07.352523+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:22.365250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.348148+0000","last_change":"2023-10-06T02:30:07.338069+0000","last_active":"2023-10-06T02:30:07.348148+0000","last_peered":"2023-10-06T02:30:07.348148+0000","last_clean":"2023-10-06T02:30:07.348148+0000","last_became_active":"2023-10-06T02:30:07.337095+0000","last_became_peered":"2023-10-06T02:30:07.337095+0000","last_unstale":"2023-10-06T02:30:07.348148+0000","last_undegraded":"2023-10-06T02:30:07.348148+0000","last_fullsized":"2023-10-06T02:30:07.348148+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:39.253952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.338974+0000","last_change":"2023-10-06T02:30:07.336240+0000","last_active":"2023-10-06T02:30:07.338974+0000","last_peered":"2023-10-06T02:30:07.338974+0000","last_clean":"2023-10-06T02:30:07.338974+0000","last_became_active":"2023-10-06T02:30:07.335919+0000","last_became_peered":"2023-10-06T02:30:07.335919+0000","last_unstale":"2023-10-06T02:30:07.338974+0000","last_undegraded":"2023-10-06T02:30:07.338974+0000","last_fullsized":"2023-10-06T02:30:07.338974+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:43.617059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"145'4","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353771+0000","last_change":"2023-10-06T02:30:06.315389+0000","last_active":"2023-10-06T02:30:07.353771+0000","last_peered":"2023-10-06T02:30:07.353771+0000","last_clean":"2023-10-06T02:30:07.353771+0000","last_became_active":"2023-10-06T02:30:06.315083+0000","last_became_peered":"2023-10-06T02:30:06.315083+0000","last_unstale":"2023-10-06T02:30:07.353771+0000","last_undegraded":"2023-10-06T02:30:07.353771+0000","last_fullsized":"2023-10-06T02:30:07.353771+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:55.251959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.351193+0000","last_change":"2023-10-06T02:30:07.347762+0000","last_active":"2023-10-06T02:30:07.351193+0000","last_peered":"2023-10-06T02:30:07.351193+0000","last_clean":"2023-10-06T02:30:07.351193+0000","last_became_active":"2023-10-06T02:30:07.347399+0000","last_became_peered":"2023-10-06T02:30:07.347399+0000","last_unstale":"2023-10-06T02:30:07.351193+0000","last_undegraded":"2023-10-06T02:30:07.351193+0000","last_fullsized":"2023-10-06T02:30:07.351193+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:14.673862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354121+0000","last_change":"2023-10-06T02:30:06.317388+0000","last_active":"2023-10-06T02:30:07.354121+0000","last_peered":"2023-10-06T02:30:07.354121+0000","last_clean":"2023-10-06T02:30:07.354121+0000","last_became_active":"2023-10-06T02:30:06.317084+0000","last_became_peered":"2023-10-06T02:30:06.317084+0000","last_unstale":"2023-10-06T02:30:07.354121+0000","last_undegraded":"2023-10-06T02:30:07.354121+0000","last_fullsized":"2023-10-06T02:30:07.354121+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:32.892304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354852+0000","last_change":"2023-10-06T02:30:07.342426+0000","last_active":"2023-10-06T02:30:07.354852+0000","last_peered":"2023-10-06T02:30:07.354852+0000","last_clean":"2023-10-06T02:30:07.354852+0000","last_became_active":"2023-10-06T02:30:07.342149+0000","last_became_peered":"2023-10-06T02:30:07.342149+0000","last_unstale":"2023-10-06T02:30:07.354852+0000","last_undegraded":"2023-10-06T02:30:07.354852+0000","last_fullsized":"2023-10-06T02:30:07.354852+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:56.256091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.360053+0000","last_change":"2023-10-06T02:30:06.318483+0000","last_active":"2023-10-06T02:30:07.360053+0000","last_peered":"2023-10-06T02:30:07.360053+0000","last_clean":"2023-10-06T02:30:07.360053+0000","last_became_active":"2023-10-06T02:30:06.318231+0000","last_became_peered":"2023-10-06T02:30:06.318231+0000","last_unstale":"2023-10-06T02:30:07.360053+0000","last_undegraded":"2023-10-06T02:30:07.360053+0000","last_fullsized":"2023-10-06T02:30:07.360053+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:35.270132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346566+0000","last_change":"2023-10-06T02:30:07.338423+0000","last_active":"2023-10-06T02:30:07.346566+0000","last_peered":"2023-10-06T02:30:07.346566+0000","last_clean":"2023-10-06T02:30:07.346566+0000","last_became_active":"2023-10-06T02:30:07.338129+0000","last_became_peered":"2023-10-06T02:30:07.338129+0000","last_unstale":"2023-10-06T02:30:07.346566+0000","last_undegraded":"2023-10-06T02:30:07.346566+0000","last_fullsized":"2023-10-06T02:30:07.346566+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:12.953008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.356622+0000","last_change":"2023-10-06T02:30:06.310720+0000","last_active":"2023-10-06T02:30:07.356622+0000","last_peered":"2023-10-06T02:30:07.356622+0000","last_clean":"2023-10-06T02:30:07.356622+0000","last_became_active":"2023-10-06T02:30:06.310435+0000","last_became_peered":"2023-10-06T02:30:06.310435+0000","last_unstale":"2023-10-06T02:30:07.356622+0000","last_undegraded":"2023-10-06T02:30:07.356622+0000","last_fullsized":"2023-10-06T02:30:07.356622+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:34.559685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.349869+0000","last_change":"2023-10-06T02:30:07.344599+0000","last_active":"2023-10-06T02:30:07.349869+0000","last_peered":"2023-10-06T02:30:07.349869+0000","last_clean":"2023-10-06T02:30:07.349869+0000","last_became_active":"2023-10-06T02:30:07.340256+0000","last_became_peered":"2023-10-06T02:30:07.340256+0000","last_unstale":"2023-10-06T02:30:07.349869+0000","last_undegraded":"2023-10-06T02:30:07.349869+0000","last_fullsized":"2023-10-06T02:30:07.349869+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:59.883607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.355285+0000","last_change":"2023-10-06T02:30:06.320599+0000","last_active":"2023-10-06T02:30:07.355285+0000","last_peered":"2023-10-06T02:30:07.355285+0000","last_clean":"2023-10-06T02:30:07.355285+0000","last_became_active":"2023-10-06T02:30:06.320238+0000","last_became_peered":"2023-10-06T02:30:06.320238+0000","last_unstale":"2023-10-06T02:30:07.355285+0000","last_undegraded":"2023-10-06T02:30:07.355285+0000","last_fullsized":"2023-10-06T02:30:07.355285+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:30.693332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.348306+0000","last_change":"2023-10-06T02:30:07.336779+0000","last_active":"2023-10-06T02:30:07.348306+0000","last_peered":"2023-10-06T02:30:07.348306+0000","last_clean":"2023-10-06T02:30:07.348306+0000","last_became_active":"2023-10-06T02:30:07.336532+0000","last_became_peered":"2023-10-06T02:30:07.336532+0000","last_unstale":"2023-10-06T02:30:07.348306+0000","last_undegraded":"2023-10-06T02:30:07.348306+0000","last_fullsized":"2023-10-06T02:30:07.348306+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:59.291596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.357127+0000","last_change":"2023-10-06T02:30:06.320691+0000","last_active":"2023-10-06T02:30:07.357127+0000","last_peered":"2023-10-06T02:30:07.357127+0000","last_clean":"2023-10-06T02:30:07.357127+0000","last_became_active":"2023-10-06T02:30:06.320418+0000","last_became_peered":"2023-10-06T02:30:06.320418+0000","last_unstale":"2023-10-06T02:30:07.357127+0000","last_undegraded":"2023-10-06T02:30:07.357127+0000","last_fullsized":"2023-10-06T02:30:07.357127+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:04.325515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.349576+0000","last_change":"2023-10-06T02:30:07.340489+0000","last_active":"2023-10-06T02:30:07.349576+0000","last_peered":"2023-10-06T02:30:07.349576+0000","last_clean":"2023-10-06T02:30:07.349576+0000","last_became_active":"2023-10-06T02:30:07.340067+0000","last_became_peered":"2023-10-06T02:30:07.340067+0000","last_unstale":"2023-10-06T02:30:07.349576+0000","last_undegraded":"2023-10-06T02:30:07.349576+0000","last_fullsized":"2023-10-06T02:30:07.349576+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:07.824834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.330143+0000","last_change":"2023-10-06T02:30:06.322246+0000","last_active":"2023-10-06T02:30:07.330143+0000","last_peered":"2023-10-06T02:30:07.330143+0000","last_clean":"2023-10-06T02:30:07.330143+0000","last_became_active":"2023-10-06T02:30:06.321895+0000","last_became_peered":"2023-10-06T02:30:06.321895+0000","last_unstale":"2023-10-06T02:30:07.330143+0000","last_undegraded":"2023-10-06T02:30:07.330143+0000","last_fullsized":"2023-10-06T02:30:07.330143+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:51.474045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.351742+0000","last_change":"2023-10-06T02:30:07.344027+0000","last_active":"2023-10-06T02:30:07.351742+0000","last_peered":"2023-10-06T02:30:07.351742+0000","last_clean":"2023-10-06T02:30:07.351742+0000","last_became_active":"2023-10-06T02:30:07.342669+0000","last_became_peered":"2023-10-06T02:30:07.342669+0000","last_unstale":"2023-10-06T02:30:07.351742+0000","last_undegraded":"2023-10-06T02:30:07.351742+0000","last_fullsized":"2023-10-06T02:30:07.351742+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:45.424595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.328792+0000","last_change":"2023-10-06T02:30:06.322938+0000","last_active":"2023-10-06T02:30:07.328792+0000","last_peered":"2023-10-06T02:30:07.328792+0000","last_clean":"2023-10-06T02:30:07.328792+0000","last_became_active":"2023-10-06T02:30:06.322609+0000","last_became_peered":"2023-10-06T02:30:06.322609+0000","last_unstale":"2023-10-06T02:30:07.328792+0000","last_undegraded":"2023-10-06T02:30:07.328792+0000","last_fullsized":"2023-10-06T02:30:07.328792+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:35.324371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.347057+0000","last_change":"2023-10-06T02:30:07.342256+0000","last_active":"2023-10-06T02:30:07.347057+0000","last_peered":"2023-10-06T02:30:07.347057+0000","last_clean":"2023-10-06T02:30:07.347057+0000","last_became_active":"2023-10-06T02:30:07.341975+0000","last_became_peered":"2023-10-06T02:30:07.341975+0000","last_unstale":"2023-10-06T02:30:07.347057+0000","last_undegraded":"2023-10-06T02:30:07.347057+0000","last_fullsized":"2023-10-06T02:30:07.347057+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:00.459854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.362861+0000","last_change":"2023-10-06T02:30:06.317870+0000","last_active":"2023-10-06T02:30:07.362861+0000","last_peered":"2023-10-06T02:30:07.362861+0000","last_clean":"2023-10-06T02:30:07.362861+0000","last_became_active":"2023-10-06T02:30:06.317571+0000","last_became_peered":"2023-10-06T02:30:06.317571+0000","last_unstale":"2023-10-06T02:30:07.362861+0000","last_undegraded":"2023-10-06T02:30:07.362861+0000","last_fullsized":"2023-10-06T02:30:07.362861+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:04.103825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.348107+0000","last_change":"2023-10-06T02:30:07.341410+0000","last_active":"2023-10-06T02:30:07.348107+0000","last_peered":"2023-10-06T02:30:07.348107+0000","last_clean":"2023-10-06T02:30:07.348107+0000","last_became_active":"2023-10-06T02:30:07.341111+0000","last_became_peered":"2023-10-06T02:30:07.341111+0000","last_unstale":"2023-10-06T02:30:07.348107+0000","last_undegraded":"2023-10-06T02:30:07.348107+0000","last_fullsized":"2023-10-06T02:30:07.348107+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:07.066199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354345+0000","last_change":"2023-10-06T02:30:06.317085+0000","last_active":"2023-10-06T02:30:07.354345+0000","last_peered":"2023-10-06T02:30:07.354345+0000","last_clean":"2023-10-06T02:30:07.354345+0000","last_became_active":"2023-10-06T02:30:06.316815+0000","last_became_peered":"2023-10-06T02:30:06.316815+0000","last_unstale":"2023-10-06T02:30:07.354345+0000","last_undegraded":"2023-10-06T02:30:07.354345+0000","last_fullsized":"2023-10-06T02:30:07.354345+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:43.892133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354072+0000","last_change":"2023-10-06T02:30:07.351496+0000","last_active":"2023-10-06T02:30:07.354072+0000","last_peered":"2023-10-06T02:30:07.354072+0000","last_clean":"2023-10-06T02:30:07.354072+0000","last_became_active":"2023-10-06T02:30:07.351192+0000","last_became_peered":"2023-10-06T02:30:07.351192+0000","last_unstale":"2023-10-06T02:30:07.354072+0000","last_undegraded":"2023-10-06T02:30:07.354072+0000","last_fullsized":"2023-10-06T02:30:07.354072+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:14.446924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.358259+0000","last_change":"2023-10-06T02:30:06.321479+0000","last_active":"2023-10-06T02:30:07.358259+0000","last_peered":"2023-10-06T02:30:07.358259+0000","last_clean":"2023-10-06T02:30:07.358259+0000","last_became_active":"2023-10-06T02:30:06.321178+0000","last_became_peered":"2023-10-06T02:30:06.321178+0000","last_unstale":"2023-10-06T02:30:07.358259+0000","last_undegraded":"2023-10-06T02:30:07.358259+0000","last_fullsized":"2023-10-06T02:30:07.358259+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:46.892240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.347523+0000","last_change":"2023-10-06T02:30:07.343382+0000","last_active":"2023-10-06T02:30:07.347523+0000","last_peered":"2023-10-06T02:30:07.347523+0000","last_clean":"2023-10-06T02:30:07.347523+0000","last_became_active":"2023-10-06T02:30:07.342962+0000","last_became_peered":"2023-10-06T02:30:07.342962+0000","last_unstale":"2023-10-06T02:30:07.347523+0000","last_undegraded":"2023-10-06T02:30:07.347523+0000","last_fullsized":"2023-10-06T02:30:07.347523+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:22.227760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.336000+0000","last_change":"2023-10-06T02:30:06.322665+0000","last_active":"2023-10-06T02:30:07.336000+0000","last_peered":"2023-10-06T02:30:07.336000+0000","last_clean":"2023-10-06T02:30:07.336000+0000","last_became_active":"2023-10-06T02:30:06.322399+0000","last_became_peered":"2023-10-06T02:30:06.322399+0000","last_unstale":"2023-10-06T02:30:07.336000+0000","last_undegraded":"2023-10-06T02:30:07.336000+0000","last_fullsized":"2023-10-06T02:30:07.336000+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:06.062068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.351675+0000","last_change":"2023-10-06T02:30:07.348144+0000","last_active":"2023-10-06T02:30:07.351675+0000","last_peered":"2023-10-06T02:30:07.351675+0000","last_clean":"2023-10-06T02:30:07.351675+0000","last_became_active":"2023-10-06T02:30:07.347881+0000","last_became_peered":"2023-10-06T02:30:07.347881+0000","last_unstale":"2023-10-06T02:30:07.351675+0000","last_undegraded":"2023-10-06T02:30:07.351675+0000","last_fullsized":"2023-10-06T02:30:07.351675+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:52.478176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.356313+0000","last_change":"2023-10-06T02:30:06.316899+0000","last_active":"2023-10-06T02:30:07.356313+0000","last_peered":"2023-10-06T02:30:07.356313+0000","last_clean":"2023-10-06T02:30:07.356313+0000","last_became_active":"2023-10-06T02:30:06.316605+0000","last_became_peered":"2023-10-06T02:30:06.316605+0000","last_unstale":"2023-10-06T02:30:07.356313+0000","last_undegraded":"2023-10-06T02:30:07.356313+0000","last_fullsized":"2023-10-06T02:30:07.356313+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:56.418916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353950+0000","last_change":"2023-10-06T02:30:07.350759+0000","last_active":"2023-10-06T02:30:07.353950+0000","last_peered":"2023-10-06T02:30:07.353950+0000","last_clean":"2023-10-06T02:30:07.353950+0000","last_became_active":"2023-10-06T02:30:07.350420+0000","last_became_peered":"2023-10-06T02:30:07.350420+0000","last_unstale":"2023-10-06T02:30:07.353950+0000","last_undegraded":"2023-10-06T02:30:07.353950+0000","last_fullsized":"2023-10-06T02:30:07.353950+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:52.876691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.328427+0000","last_change":"2023-10-06T02:30:06.318603+0000","last_active":"2023-10-06T02:30:07.328427+0000","last_peered":"2023-10-06T02:30:07.328427+0000","last_clean":"2023-10-06T02:30:07.328427+0000","last_became_active":"2023-10-06T02:30:06.318333+0000","last_became_peered":"2023-10-06T02:30:06.318333+0000","last_unstale":"2023-10-06T02:30:07.328427+0000","last_undegraded":"2023-10-06T02:30:07.328427+0000","last_fullsized":"2023-10-06T02:30:07.328427+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:21.978753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346455+0000","last_change":"2023-10-06T02:30:07.334998+0000","last_active":"2023-10-06T02:30:07.346455+0000","last_peered":"2023-10-06T02:30:07.346455+0000","last_clean":"2023-10-06T02:30:07.346455+0000","last_became_active":"2023-10-06T02:30:07.334739+0000","last_became_peered":"2023-10-06T02:30:07.334739+0000","last_unstale":"2023-10-06T02:30:07.346455+0000","last_undegraded":"2023-10-06T02:30:07.346455+0000","last_fullsized":"2023-10-06T02:30:07.346455+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:18.390686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.324057+0000","last_change":"2023-10-06T02:30:06.317729+0000","last_active":"2023-10-06T02:30:07.324057+0000","last_peered":"2023-10-06T02:30:07.324057+0000","last_clean":"2023-10-06T02:30:07.324057+0000","last_became_active":"2023-10-06T02:30:06.317463+0000","last_became_peered":"2023-10-06T02:30:06.317463+0000","last_unstale":"2023-10-06T02:30:07.324057+0000","last_undegraded":"2023-10-06T02:30:07.324057+0000","last_fullsized":"2023-10-06T02:30:07.324057+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:54.525262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.357076+0000","last_change":"2023-10-06T02:30:07.353550+0000","last_active":"2023-10-06T02:30:07.357076+0000","last_peered":"2023-10-06T02:30:07.357076+0000","last_clean":"2023-10-06T02:30:07.357076+0000","last_became_active":"2023-10-06T02:30:07.353281+0000","last_became_peered":"2023-10-06T02:30:07.353281+0000","last_unstale":"2023-10-06T02:30:07.357076+0000","last_undegraded":"2023-10-06T02:30:07.357076+0000","last_fullsized":"2023-10-06T02:30:07.357076+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:00:04.532549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.328898+0000","last_change":"2023-10-06T02:30:06.322813+0000","last_active":"2023-10-06T02:30:07.328898+0000","last_peered":"2023-10-06T02:30:07.328898+0000","last_clean":"2023-10-06T02:30:07.328898+0000","last_became_active":"2023-10-06T02:30:06.322512+0000","last_became_peered":"2023-10-06T02:30:06.322512+0000","last_unstale":"2023-10-06T02:30:07.328898+0000","last_undegraded":"2023-10-06T02:30:07.328898+0000","last_fullsized":"2023-10-06T02:30:07.328898+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:58.287464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.359102+0000","last_change":"2023-10-06T02:30:07.355278+0000","last_active":"2023-10-06T02:30:07.359102+0000","last_peered":"2023-10-06T02:30:07.359102+0000","last_clean":"2023-10-06T02:30:07.359102+0000","last_became_active":"2023-10-06T02:30:07.355035+0000","last_became_peered":"2023-10-06T02:30:07.355035+0000","last_unstale":"2023-10-06T02:30:07.359102+0000","last_undegraded":"2023-10-06T02:30:07.359102+0000","last_fullsized":"2023-10-06T02:30:07.359102+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:40:42.915998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.355076+0000","last_change":"2023-10-06T02:30:06.326522+0000","last_active":"2023-10-06T02:30:07.355076+0000","last_peered":"2023-10-06T02:30:07.355076+0000","last_clean":"2023-10-06T02:30:07.355076+0000","last_became_active":"2023-10-06T02:30:06.326204+0000","last_became_peered":"2023-10-06T02:30:06.326204+0000","last_unstale":"2023-10-06T02:30:07.355076+0000","last_undegraded":"2023-10-06T02:30:07.355076+0000","last_fullsized":"2023-10-06T02:30:07.355076+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:17.386555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353589+0000","last_change":"2023-10-06T02:30:07.349113+0000","last_active":"2023-10-06T02:30:07.353589+0000","last_peered":"2023-10-06T02:30:07.353589+0000","last_clean":"2023-10-06T02:30:07.353589+0000","last_became_active":"2023-10-06T02:30:07.348345+0000","last_became_peered":"2023-10-06T02:30:07.348345+0000","last_unstale":"2023-10-06T02:30:07.353589+0000","last_undegraded":"2023-10-06T02:30:07.353589+0000","last_fullsized":"2023-10-06T02:30:07.353589+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:24.449932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.338337+0000","last_change":"2023-10-06T02:30:06.316388+0000","last_active":"2023-10-06T02:30:07.338337+0000","last_peered":"2023-10-06T02:30:07.338337+0000","last_clean":"2023-10-06T02:30:07.338337+0000","last_became_active":"2023-10-06T02:30:06.316124+0000","last_became_peered":"2023-10-06T02:30:06.316124+0000","last_unstale":"2023-10-06T02:30:07.338337+0000","last_undegraded":"2023-10-06T02:30:07.338337+0000","last_fullsized":"2023-10-06T02:30:07.338337+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:44.420464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.352996+0000","last_change":"2023-10-06T02:30:07.347600+0000","last_active":"2023-10-06T02:30:07.352996+0000","last_peered":"2023-10-06T02:30:07.352996+0000","last_clean":"2023-10-06T02:30:07.352996+0000","last_became_active":"2023-10-06T02:30:07.339492+0000","last_became_peered":"2023-10-06T02:30:07.339492+0000","last_unstale":"2023-10-06T02:30:07.352996+0000","last_undegraded":"2023-10-06T02:30:07.352996+0000","last_fullsized":"2023-10-06T02:30:07.352996+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:18.414606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.328252+0000","last_change":"2023-10-06T02:30:06.322647+0000","last_active":"2023-10-06T02:30:07.328252+0000","last_peered":"2023-10-06T02:30:07.328252+0000","last_clean":"2023-10-06T02:30:07.328252+0000","last_became_active":"2023-10-06T02:30:06.322364+0000","last_became_peered":"2023-10-06T02:30:06.322364+0000","last_unstale":"2023-10-06T02:30:07.328252+0000","last_undegraded":"2023-10-06T02:30:07.328252+0000","last_fullsized":"2023-10-06T02:30:07.328252+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:50.780401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353920+0000","last_change":"2023-10-06T02:30:07.350700+0000","last_active":"2023-10-06T02:30:07.353920+0000","last_peered":"2023-10-06T02:30:07.353920+0000","last_clean":"2023-10-06T02:30:07.353920+0000","last_became_active":"2023-10-06T02:30:07.350425+0000","last_became_peered":"2023-10-06T02:30:07.350425+0000","last_unstale":"2023-10-06T02:30:07.353920+0000","last_undegraded":"2023-10-06T02:30:07.353920+0000","last_fullsized":"2023-10-06T02:30:07.353920+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:41:28.057738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.334071+0000","last_change":"2023-10-06T02:30:06.320841+0000","last_active":"2023-10-06T02:30:07.334071+0000","last_peered":"2023-10-06T02:30:07.334071+0000","last_clean":"2023-10-06T02:30:07.334071+0000","last_became_active":"2023-10-06T02:30:06.320611+0000","last_became_peered":"2023-10-06T02:30:06.320611+0000","last_unstale":"2023-10-06T02:30:07.334071+0000","last_undegraded":"2023-10-06T02:30:07.334071+0000","last_fullsized":"2023-10-06T02:30:07.334071+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:56.676109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.348653+0000","last_change":"2023-10-06T02:30:07.340988+0000","last_active":"2023-10-06T02:30:07.348653+0000","last_peered":"2023-10-06T02:30:07.348653+0000","last_clean":"2023-10-06T02:30:07.348653+0000","last_became_active":"2023-10-06T02:30:07.340688+0000","last_became_peered":"2023-10-06T02:30:07.340688+0000","last_unstale":"2023-10-06T02:30:07.348653+0000","last_undegraded":"2023-10-06T02:30:07.348653+0000","last_fullsized":"2023-10-06T02:30:07.348653+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:43.362387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.333709+0000","last_change":"2023-10-06T02:30:06.321110+0000","last_active":"2023-10-06T02:30:07.333709+0000","last_peered":"2023-10-06T02:30:07.333709+0000","last_clean":"2023-10-06T02:30:07.333709+0000","last_became_active":"2023-10-06T02:30:06.320817+0000","last_became_peered":"2023-10-06T02:30:06.320817+0000","last_unstale":"2023-10-06T02:30:07.333709+0000","last_undegraded":"2023-10-06T02:30:07.333709+0000","last_fullsized":"2023-10-06T02:30:07.333709+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:41.169626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.348326+0000","last_change":"2023-10-06T02:30:07.340511+0000","last_active":"2023-10-06T02:30:07.348326+0000","last_peered":"2023-10-06T02:30:07.348326+0000","last_clean":"2023-10-06T02:30:07.348326+0000","last_became_active":"2023-10-06T02:30:07.340244+0000","last_became_peered":"2023-10-06T02:30:07.340244+0000","last_unstale":"2023-10-06T02:30:07.348326+0000","last_undegraded":"2023-10-06T02:30:07.348326+0000","last_fullsized":"2023-10-06T02:30:07.348326+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:55.749868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.330338+0000","last_change":"2023-10-06T02:30:06.315604+0000","last_active":"2023-10-06T02:30:07.330338+0000","last_peered":"2023-10-06T02:30:07.330338+0000","last_clean":"2023-10-06T02:30:07.330338+0000","last_became_active":"2023-10-06T02:30:06.315302+0000","last_became_peered":"2023-10-06T02:30:06.315302+0000","last_unstale":"2023-10-06T02:30:07.330338+0000","last_undegraded":"2023-10-06T02:30:07.330338+0000","last_fullsized":"2023-10-06T02:30:07.330338+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:17.386555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346587+0000","last_change":"2023-10-06T02:30:07.339811+0000","last_active":"2023-10-06T02:30:07.346587+0000","last_peered":"2023-10-06T02:30:07.346587+0000","last_clean":"2023-10-06T02:30:07.346587+0000","last_became_active":"2023-10-06T02:30:07.338909+0000","last_became_peered":"2023-10-06T02:30:07.338909+0000","last_unstale":"2023-10-06T02:30:07.346587+0000","last_undegraded":"2023-10-06T02:30:07.346587+0000","last_fullsized":"2023-10-06T02:30:07.346587+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:48:42.879473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.328292+0000","last_change":"2023-10-06T02:30:06.311109+0000","last_active":"2023-10-06T02:30:07.328292+0000","last_peered":"2023-10-06T02:30:07.328292+0000","last_clean":"2023-10-06T02:30:07.328292+0000","last_became_active":"2023-10-06T02:30:06.310837+0000","last_became_peered":"2023-10-06T02:30:06.310837+0000","last_unstale":"2023-10-06T02:30:07.328292+0000","last_undegraded":"2023-10-06T02:30:07.328292+0000","last_fullsized":"2023-10-06T02:30:07.328292+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:22.403434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.349046+0000","last_change":"2023-10-06T02:30:07.340183+0000","last_active":"2023-10-06T02:30:07.349046+0000","last_peered":"2023-10-06T02:30:07.349046+0000","last_clean":"2023-10-06T02:30:07.349046+0000","last_became_active":"2023-10-06T02:30:07.339889+0000","last_became_peered":"2023-10-06T02:30:07.339889+0000","last_unstale":"2023-10-06T02:30:07.349046+0000","last_undegraded":"2023-10-06T02:30:07.349046+0000","last_fullsized":"2023-10-06T02:30:07.349046+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:25.288649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.329018+0000","last_change":"2023-10-06T02:30:06.316355+0000","last_active":"2023-10-06T02:30:07.329018+0000","last_peered":"2023-10-06T02:30:07.329018+0000","last_clean":"2023-10-06T02:30:07.329018+0000","last_became_active":"2023-10-06T02:30:06.316084+0000","last_became_peered":"2023-10-06T02:30:06.316084+0000","last_unstale":"2023-10-06T02:30:07.329018+0000","last_undegraded":"2023-10-06T02:30:07.329018+0000","last_fullsized":"2023-10-06T02:30:07.329018+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:12.168442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353843+0000","last_change":"2023-10-06T02:30:07.347442+0000","last_active":"2023-10-06T02:30:07.353843+0000","last_peered":"2023-10-06T02:30:07.353843+0000","last_clean":"2023-10-06T02:30:07.353843+0000","last_became_active":"2023-10-06T02:30:07.347157+0000","last_became_peered":"2023-10-06T02:30:07.347157+0000","last_unstale":"2023-10-06T02:30:07.353843+0000","last_undegraded":"2023-10-06T02:30:07.353843+0000","last_fullsized":"2023-10-06T02:30:07.353843+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:44.951632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"145'6","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.365337+0000","last_change":"2023-10-06T02:30:06.323791+0000","last_active":"2023-10-06T02:30:07.365337+0000","last_peered":"2023-10-06T02:30:07.365337+0000","last_clean":"2023-10-06T02:30:07.365337+0000","last_became_active":"2023-10-06T02:30:06.323243+0000","last_became_peered":"2023-10-06T02:30:06.323243+0000","last_unstale":"2023-10-06T02:30:07.365337+0000","last_undegraded":"2023-10-06T02:30:07.365337+0000","last_fullsized":"2023-10-06T02:30:07.365337+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:14.984382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":128,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.330267+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:30:07.330267+0000","last_peered":"2023-10-06T02:30:07.330267+0000","last_clean":"2023-10-06T02:30:07.330267+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:30:07.330267+0000","last_undegraded":"2023-10-06T02:30:07.330267+0000","last_fullsized":"2023-10-06T02:30:07.330267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.357115+0000","last_change":"2023-10-06T02:30:07.350189+0000","last_active":"2023-10-06T02:30:07.357115+0000","last_peered":"2023-10-06T02:30:07.357115+0000","last_clean":"2023-10-06T02:30:07.357115+0000","last_became_active":"2023-10-06T02:30:07.349858+0000","last_became_peered":"2023-10-06T02:30:07.349858+0000","last_unstale":"2023-10-06T02:30:07.357115+0000","last_undegraded":"2023-10-06T02:30:07.357115+0000","last_fullsized":"2023-10-06T02:30:07.357115+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:04.668370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"145'3","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.360765+0000","last_change":"2023-10-06T02:30:06.316658+0000","last_active":"2023-10-06T02:30:07.360765+0000","last_peered":"2023-10-06T02:30:07.360765+0000","last_clean":"2023-10-06T02:30:07.360765+0000","last_became_active":"2023-10-06T02:30:06.316370+0000","last_became_peered":"2023-10-06T02:30:06.316370+0000","last_unstale":"2023-10-06T02:30:07.360765+0000","last_undegraded":"2023-10-06T02:30:07.360765+0000","last_fullsized":"2023-10-06T02:30:07.360765+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:42.358256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":130,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.334238+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:30:07.334238+0000","last_peered":"2023-10-06T02:30:07.334238+0000","last_clean":"2023-10-06T02:30:07.334238+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:30:07.334238+0000","last_undegraded":"2023-10-06T02:30:07.334238+0000","last_fullsized":"2023-10-06T02:30:07.334238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.355609+0000","last_change":"2023-10-06T02:30:07.349432+0000","last_active":"2023-10-06T02:30:07.355609+0000","last_peered":"2023-10-06T02:30:07.355609+0000","last_clean":"2023-10-06T02:30:07.355609+0000","last_became_active":"2023-10-06T02:30:07.349141+0000","last_became_peered":"2023-10-06T02:30:07.349141+0000","last_unstale":"2023-10-06T02:30:07.355609+0000","last_undegraded":"2023-10-06T02:30:07.355609+0000","last_fullsized":"2023-10-06T02:30:07.355609+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:42.909162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.338102+0000","last_change":"2023-10-06T02:30:06.325263+0000","last_active":"2023-10-06T02:30:07.338102+0000","last_peered":"2023-10-06T02:30:07.338102+0000","last_clean":"2023-10-06T02:30:07.338102+0000","last_became_active":"2023-10-06T02:30:06.325058+0000","last_became_peered":"2023-10-06T02:30:06.325058+0000","last_unstale":"2023-10-06T02:30:07.338102+0000","last_undegraded":"2023-10-06T02:30:07.338102+0000","last_fullsized":"2023-10-06T02:30:07.338102+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:27.263168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":130,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.324302+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:30:07.324302+0000","last_peered":"2023-10-06T02:30:07.324302+0000","last_clean":"2023-10-06T02:30:07.324302+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:30:07.324302+0000","last_undegraded":"2023-10-06T02:30:07.324302+0000","last_fullsized":"2023-10-06T02:30:07.324302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":277,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.328054+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:30:07.328054+0000","last_peered":"2023-10-06T02:30:07.328054+0000","last_clean":"2023-10-06T02:30:07.328054+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:30:07.328054+0000","last_undegraded":"2023-10-06T02:30:07.328054+0000","last_fullsized":"2023-10-06T02:30:07.328054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353177+0000","last_change":"2023-10-06T02:30:07.341531+0000","last_active":"2023-10-06T02:30:07.353177+0000","last_peered":"2023-10-06T02:30:07.353177+0000","last_clean":"2023-10-06T02:30:07.353177+0000","last_became_active":"2023-10-06T02:30:07.341215+0000","last_became_peered":"2023-10-06T02:30:07.341215+0000","last_unstale":"2023-10-06T02:30:07.353177+0000","last_undegraded":"2023-10-06T02:30:07.353177+0000","last_fullsized":"2023-10-06T02:30:07.353177+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:18.726171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.358829+0000","last_change":"2023-10-06T02:30:06.319538+0000","last_active":"2023-10-06T02:30:07.358829+0000","last_peered":"2023-10-06T02:30:07.358829+0000","last_clean":"2023-10-06T02:30:07.358829+0000","last_became_active":"2023-10-06T02:30:06.319199+0000","last_became_peered":"2023-10-06T02:30:06.319199+0000","last_unstale":"2023-10-06T02:30:07.358829+0000","last_undegraded":"2023-10-06T02:30:07.358829+0000","last_fullsized":"2023-10-06T02:30:07.358829+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:46.037331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":127,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.330713+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:30:07.330713+0000","last_peered":"2023-10-06T02:30:07.330713+0000","last_clean":"2023-10-06T02:30:07.330713+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:30:07.330713+0000","last_undegraded":"2023-10-06T02:30:07.330713+0000","last_fullsized":"2023-10-06T02:30:07.330713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.356893+0000","last_change":"2023-10-06T02:30:07.349549+0000","last_active":"2023-10-06T02:30:07.356893+0000","last_peered":"2023-10-06T02:30:07.356893+0000","last_clean":"2023-10-06T02:30:07.356893+0000","last_became_active":"2023-10-06T02:30:07.348960+0000","last_became_peered":"2023-10-06T02:30:07.348960+0000","last_unstale":"2023-10-06T02:30:07.356893+0000","last_undegraded":"2023-10-06T02:30:07.356893+0000","last_fullsized":"2023-10-06T02:30:07.356893+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:15.311278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.334511+0000","last_change":"2023-10-06T02:30:06.322756+0000","last_active":"2023-10-06T02:30:07.334511+0000","last_peered":"2023-10-06T02:30:07.334511+0000","last_clean":"2023-10-06T02:30:07.334511+0000","last_became_active":"2023-10-06T02:30:06.322451+0000","last_became_peered":"2023-10-06T02:30:06.322451+0000","last_unstale":"2023-10-06T02:30:07.334511+0000","last_undegraded":"2023-10-06T02:30:07.334511+0000","last_fullsized":"2023-10-06T02:30:07.334511+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:38.249821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":127,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.328151+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:30:07.328151+0000","last_peered":"2023-10-06T02:30:07.328151+0000","last_clean":"2023-10-06T02:30:07.328151+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:30:07.328151+0000","last_undegraded":"2023-10-06T02:30:07.328151+0000","last_fullsized":"2023-10-06T02:30:07.328151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.355501+0000","last_change":"2023-10-06T02:30:07.347685+0000","last_active":"2023-10-06T02:30:07.355501+0000","last_peered":"2023-10-06T02:30:07.355501+0000","last_clean":"2023-10-06T02:30:07.355501+0000","last_became_active":"2023-10-06T02:30:07.347387+0000","last_became_peered":"2023-10-06T02:30:07.347387+0000","last_unstale":"2023-10-06T02:30:07.355501+0000","last_undegraded":"2023-10-06T02:30:07.355501+0000","last_fullsized":"2023-10-06T02:30:07.355501+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:55.343618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"145'8","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.356162+0000","last_change":"2023-10-06T02:30:06.322812+0000","last_active":"2023-10-06T02:30:07.356162+0000","last_peered":"2023-10-06T02:30:07.356162+0000","last_clean":"2023-10-06T02:30:07.356162+0000","last_became_active":"2023-10-06T02:30:06.322535+0000","last_became_peered":"2023-10-06T02:30:06.322535+0000","last_unstale":"2023-10-06T02:30:07.356162+0000","last_undegraded":"2023-10-06T02:30:07.356162+0000","last_fullsized":"2023-10-06T02:30:07.356162+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:59.044474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":126,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.334594+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:30:07.334594+0000","last_peered":"2023-10-06T02:30:07.334594+0000","last_clean":"2023-10-06T02:30:07.334594+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:30:07.334594+0000","last_undegraded":"2023-10-06T02:30:07.334594+0000","last_fullsized":"2023-10-06T02:30:07.334594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.351585+0000","last_change":"2023-10-06T02:30:07.344116+0000","last_active":"2023-10-06T02:30:07.351585+0000","last_peered":"2023-10-06T02:30:07.351585+0000","last_clean":"2023-10-06T02:30:07.351585+0000","last_became_active":"2023-10-06T02:30:07.343821+0000","last_became_peered":"2023-10-06T02:30:07.343821+0000","last_unstale":"2023-10-06T02:30:07.351585+0000","last_undegraded":"2023-10-06T02:30:07.351585+0000","last_fullsized":"2023-10-06T02:30:07.351585+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:31:14.689860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.328564+0000","last_change":"2023-10-06T02:30:06.315567+0000","last_active":"2023-10-06T02:30:07.328564+0000","last_peered":"2023-10-06T02:30:07.328564+0000","last_clean":"2023-10-06T02:30:07.328564+0000","last_became_active":"2023-10-06T02:30:06.315261+0000","last_became_peered":"2023-10-06T02:30:06.315261+0000","last_unstale":"2023-10-06T02:30:07.328564+0000","last_undegraded":"2023-10-06T02:30:07.328564+0000","last_fullsized":"2023-10-06T02:30:07.328564+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:47.633970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":125,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.338598+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:30:07.338598+0000","last_peered":"2023-10-06T02:30:07.338598+0000","last_clean":"2023-10-06T02:30:07.338598+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:30:07.338598+0000","last_undegraded":"2023-10-06T02:30:07.338598+0000","last_fullsized":"2023-10-06T02:30:07.338598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353913+0000","last_change":"2023-10-06T02:30:07.350797+0000","last_active":"2023-10-06T02:30:07.353913+0000","last_peered":"2023-10-06T02:30:07.353913+0000","last_clean":"2023-10-06T02:30:07.353913+0000","last_became_active":"2023-10-06T02:30:07.350522+0000","last_became_peered":"2023-10-06T02:30:07.350522+0000","last_unstale":"2023-10-06T02:30:07.353913+0000","last_undegraded":"2023-10-06T02:30:07.353913+0000","last_fullsized":"2023-10-06T02:30:07.353913+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:04.728949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.331078+0000","last_change":"2023-10-06T02:30:06.319899+0000","last_active":"2023-10-06T02:30:07.331078+0000","last_peered":"2023-10-06T02:30:07.331078+0000","last_clean":"2023-10-06T02:30:07.331078+0000","last_became_active":"2023-10-06T02:30:06.319504+0000","last_became_peered":"2023-10-06T02:30:06.319504+0000","last_unstale":"2023-10-06T02:30:07.331078+0000","last_undegraded":"2023-10-06T02:30:07.331078+0000","last_fullsized":"2023-10-06T02:30:07.331078+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:11.948877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":125,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.347186+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:30:07.347186+0000","last_peered":"2023-10-06T02:30:07.347186+0000","last_clean":"2023-10-06T02:30:07.347186+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:30:07.347186+0000","last_undegraded":"2023-10-06T02:30:07.347186+0000","last_fullsized":"2023-10-06T02:30:07.347186+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575002,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307932,"kb_used_data":2452,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063908,"statfs":{"total":96636764160,"available":96321441792,"internally_reserved":0,"allocated":2510848,"data_stored":1586317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.79700000000000004,"15min":1.111},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71099999999999997,"5min":0.77900000000000003,"15min":0.97899999999999998},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":1.008},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.629,"5min":0.72599999999999998,"15min":1.075},"last":0.33600000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.76000000000000001,"5min":0.80200000000000005,"15min":1.149},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":0.96999999999999997,"15min":1.048},"last":0.50900000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69899999999999995,"5min":0.84399999999999997,"15min":1.175},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73599999999999999,"5min":0.91000000000000003,"15min":1.03},"last":0.41099999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.48199999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63900000000000001,"5min":0.79400000000000004,"15min":0.873},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80800000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.78600000000000003,"5min":0.81299999999999994,"15min":0.81899999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.76000000000000001,"15min":0.84899999999999998},"last":0.49199999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72699999999999998,"5min":0.79300000000000004,"15min":0.91700000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.38900000000000001,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.55900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575003,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303248,"kb_used_data":1864,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068592,"statfs":{"total":96636764160,"available":96326238208,"internally_reserved":0,"allocated":1908736,"data_stored":994478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53400000000000003,"15min":0.64000000000000001},"min":{"1min":0.30299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.68899999999999995,"5min":0.79000000000000004,"15min":5.6929999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56100000000000005,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.29799999999999999},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":5.7060000000000004},"last":0.441}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53200000000000003,"15min":0.54100000000000004},"min":{"1min":0.32300000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67100000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53100000000000003,"15min":0.69999999999999996},"min":{"1min":0.372,"5min":0.318,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":0.872,"15min":8.8659999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":0.77500000000000002,"15min":0.80800000000000005},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55500000000000005,"15min":0.75},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":10.659000000000001},"last":0.622},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.76800000000000002,"15min":0.85499999999999998},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47499999999999998,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.27400000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.79600000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67700000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.49099999999999999,"15min":0.51600000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71099999999999997,"5min":0.751,"15min":0.84399999999999997},"last":0.52600000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.312},"max":{"1min":0.68300000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73899999999999999,"5min":0.86799999999999999,"15min":0.88100000000000001},"last":0.68300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575002,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307928,"kb_used_data":2448,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063912,"statfs":{"total":96636764160,"available":96321445888,"internally_reserved":0,"allocated":2506752,"data_stored":1584900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.36899999999999999,"15min":0.36499999999999999},"min":{"1min":0.25600000000000001,"5min":0.20799999999999999,"15min":0.19},"max":{"1min":0.59699999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.38200000000000001},"min":{"1min":0.316,"5min":0.27100000000000002,"15min":0.26100000000000001},"max":{"1min":0.56499999999999995,"5min":0.754,"15min":0.754},"last":0.38800000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.33900000000000002,"15min":0.33800000000000002},"min":{"1min":0.26900000000000002,"5min":0.223,"15min":0.22},"max":{"1min":0.56699999999999995,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.39300000000000002,"15min":0.39500000000000002},"min":{"1min":0.29399999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52400000000000002,"5min":0.64300000000000002,"15min":0.65300000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.31,"5min":0.28100000000000003,"15min":0.253},"max":{"1min":0.621,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.59799999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.432}]},{"osd":4,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86899999999999999,"5min":0.998,"15min":0.998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.378,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56899999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.625,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.37},"max":{"1min":0.90100000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.46300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92100000000000004,"5min":0.93799999999999994,"15min":0.95499999999999996},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.36499999999999999},"max":{"1min":0.75,"5min":0.94499999999999995,"15min":1.0009999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.45500000000000002,"5min":0.41599999999999998,"15min":0.41099999999999998},"max":{"1min":0.90600000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.52000000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.378},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.94199999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.61899999999999999,"15min":0.62},"min":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.42499999999999999},"max":{"1min":0.84999999999999998,"5min":0.92000000000000004,"15min":0.98199999999999998},"last":0.59199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575002,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307364,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064476,"statfs":{"total":96636764160,"available":96322023424,"internally_reserved":0,"allocated":1929216,"data_stored":997009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34599999999999997,"15min":0.33500000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.183},"max":{"1min":0.56899999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.374},"min":{"1min":0.223,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.66500000000000004,"5min":0.876,"15min":0.876},"last":0.34699999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.39400000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.20599999999999999},"max":{"1min":0.56399999999999995,"5min":0.65600000000000003,"15min":0.745},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.372,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.22600000000000001,"15min":0.215},"max":{"1min":0.63600000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52000000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.438,"15min":0.434},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.24399999999999999},"max":{"1min":0.629,"5min":0.71599999999999997,"15min":0.78000000000000003},"last":0.379}]},{"osd":4,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.371},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.369},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.99399999999999999},"last":0.59199999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.32300000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.3320000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.622},"min":{"1min":0.44,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.84899999999999998,"5min":0.88700000000000001,"15min":1.0780000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63700000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.91200000000000003,"15min":1.3999999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.45500000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.0469999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.78000000000000003},"min":{"1min":0.46200000000000002,"5min":0.41699999999999998,"15min":0.39400000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":11.138},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.46600000000000003,"5min":0.432,"15min":0.41599999999999998},"max":{"1min":0.86599999999999999,"5min":1.024,"15min":1.429},"last":0.73299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575002,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307340,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064500,"statfs":{"total":96636764160,"available":96322048000,"internally_reserved":0,"allocated":1904640,"data_stored":994408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34699999999999998,"15min":0.36199999999999999},"min":{"1min":0.218,"5min":0.182,"15min":0.182},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.80300000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.38800000000000001},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.58199999999999996,"5min":0.68000000000000005,"15min":0.98999999999999999},"last":0.26300000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.375,"15min":0.39200000000000002},"min":{"1min":0.25700000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":3.1230000000000002},"last":0.44},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":3.0129999999999999},"last":0.374}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.375,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.23499999999999999},"max":{"1min":0.56899999999999995,"5min":0.59299999999999997,"15min":1.423},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.33500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.77400000000000002},"last":0.34999999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.498},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.443,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.47199999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.41799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.304},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.439,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.45100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0980000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.41799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96499999999999997,"5min":0.97999999999999998,"15min":1.347},"last":0.40899999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64900000000000002,"15min":0.66200000000000003},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.206},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63800000000000001,"15min":0.66500000000000004},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.385},"last":0.51200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575002,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":996967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47299999999999998,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.317},{"interface":"front","average":{"1min":0.377,"5min":0.375,"15min":0.38200000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.78100000000000003},"last":0.27200000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.24099999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.66700000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.40300000000000002},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59599999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.36299999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54500000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.246},"max":{"1min":0.57399999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.375}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.0049999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.83899999999999997,"5min":0.92700000000000005,"15min":1.1539999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.37,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84899999999999998,"5min":0.95399999999999996,"15min":1.2110000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.874,"5min":0.89600000000000002,"15min":1.0429999999999999},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81999999999999995,"5min":0.90800000000000003,"15min":1.0700000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.47699999999999998,"5min":0.39500000000000002,"15min":0.38600000000000001},"max":{"1min":0.85999999999999999,"5min":0.98499999999999999,"15min":1.391},"last":0.61399999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.48299999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80300000000000005,"5min":0.94099999999999995,"15min":1.121},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.63700000000000001,"15min":0.63400000000000001},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88800000000000001,"5min":0.89900000000000002,"15min":0.95099999999999996},"last":0.57699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311440,"kb_used_data":1864,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060400,"statfs":{"total":96636764160,"available":96317849600,"internally_reserved":0,"allocated":1908736,"data_stored":995361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.252,"5min":0.252,"15min":0.217},"max":{"1min":0.71799999999999997,"5min":0.78900000000000003,"15min":0.86399999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.88900000000000001,"15min":1.7290000000000001},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.77300000000000002},"min":{"1min":0.41599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.71999999999999997,"5min":0.749,"15min":17.879999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.76300000000000001},"min":{"1min":0.377,"5min":0.33100000000000002,"15min":0.32700000000000001},"max":{"1min":0.69899999999999995,"5min":0.76500000000000001,"15min":18.010999999999999},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.55100000000000005},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.309},"max":{"1min":0.73299999999999998,"5min":0.84699999999999998,"15min":1.619},"last":0.38},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.42599999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":1.6639999999999999},"last":0.39400000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.29899999999999999},"max":{"1min":0.76200000000000001,"5min":0.76500000000000001,"15min":1.2729999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44500000000000001,"5min":0.32700000000000001,"15min":0.32200000000000001},"max":{"1min":0.80000000000000004,"5min":0.81999999999999995,"15min":0.84899999999999998},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48999999999999999,"15min":0.51200000000000001},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69799999999999995,"5min":0.78900000000000003,"15min":1.532},"last":0.503},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.80700000000000005},"last":0.31900000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.501,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.64300000000000002,"5min":0.90400000000000003,"15min":1.5700000000000001},"last":0.436},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76000000000000001,"5min":0.84099999999999997,"15min":1.4319999999999999},"last":0.35099999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.40400000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73899999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72999999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.53900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575001,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303256,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068584,"statfs":{"total":96636764160,"available":96326230016,"internally_reserved":0,"allocated":1916928,"data_stored":995937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.34599999999999997,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.78800000000000003,"5min":1.034,"15min":1.103},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.312},"max":{"1min":0.81799999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.29699999999999999},"max":{"1min":0.91400000000000003,"5min":1.02,"15min":1.1679999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.33900000000000002},"max":{"1min":0.89200000000000002,"5min":0.99399999999999999,"15min":1.0620000000000001},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.30399999999999999},"max":{"1min":0.74299999999999999,"5min":1.1870000000000001,"15min":1.2070000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":1.1140000000000001},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.84299999999999997,"15min":1.1799999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78900000000000003,"5min":1.1040000000000001,"15min":1.1830000000000001},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72399999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.50900000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26500000000000001},"max":{"1min":0.72199999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.29699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79700000000000004,"5min":0.872,"15min":0.872},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.65200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:30:16.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:30:16.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.166+0000 7f5db6cb7700 1 Processor -- start 2023-10-06T02:30:16.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.166+0000 7f5db6cb7700 1 -- start start 2023-10-06T02:30:16.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.167+0000 7f5db6cb7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5db00cf1a0 0x7f5db00cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.167+0000 7f5db6cb7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db01597d0 0x7f5db00d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.167+0000 7f5db6cb7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db00b3560 con 0x7f5db0159400 2023-10-06T02:30:16.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.167+0000 7f5db6cb7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db00cf6f0 con 0x7f5db00cf1a0 2023-10-06T02:30:16.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.167+0000 7f5db6cb7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db00cf9d0 con 0x7f5db01597d0 2023-10-06T02:30:16.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.167+0000 7f5db5cb5700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5db0159400 0x7f5db00ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56328/0 (socket says 172.21.15.6:56328) 2023-10-06T02:30:16.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.167+0000 7f5db5cb5700 1 -- 172.21.15.6:0/4214836329 learned_addr learned my addr 172.21.15.6:0/4214836329 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:16.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.167+0000 7f5db64b6700 1 --2- 172.21.15.6:0/4214836329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db01597d0 0x7f5db00d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.167+0000 7f5db4cb3700 1 -- 172.21.15.6:0/4214836329 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556982461 0 0) 0x7f5db00b3560 con 0x7f5db0159400 2023-10-06T02:30:16.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.167+0000 7f5db54b4700 1 --2- 172.21.15.6:0/4214836329 >> v2:172.21.15.175:3300/0 conn(0x7f5db00cf1a0 0x7f5db00cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.167+0000 7f5db4cb3700 1 -- 172.21.15.6:0/4214836329 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d98003570 con 0x7f5db0159400 2023-10-06T02:30:16.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db4cb3700 1 -- 172.21.15.6:0/4214836329 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2304509539 0 0) 0x7f5d98003570 con 0x7f5db0159400 2023-10-06T02:30:16.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db4cb3700 1 -- 172.21.15.6:0/4214836329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db01597d0 msgr2=0x7f5db00d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:16.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db4cb3700 1 --2- 172.21.15.6:0/4214836329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db01597d0 0x7f5db00d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db4cb3700 1 -- 172.21.15.6:0/4214836329 >> v2:172.21.15.175:3300/0 conn(0x7f5db00cf1a0 msgr2=0x7f5db00cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:16.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db4cb3700 1 --2- 172.21.15.6:0/4214836329 >> v2:172.21.15.175:3300/0 conn(0x7f5db00cf1a0 0x7f5db00cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db4cb3700 1 -- 172.21.15.6:0/4214836329 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db00b2f10 con 0x7f5db0159400 2023-10-06T02:30:16.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db4cb3700 1 -- 172.21.15.6:0/4214836329 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f5da80015f0 con 0x7f5db0159400 2023-10-06T02:30:16.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db4cb3700 1 -- 172.21.15.6:0/4214836329 >> v1:172.21.15.6:6789/0 conn(0x7f5db0159400 legacy=0x7f5db00ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:16.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db4cb3700 1 --2- 172.21.15.6:0/4214836329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d98003a60 0x7f5d98003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db4cb3700 1 --2- 172.21.15.6:0/4214836329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db01597d0 0x7f5d98004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db4cb3700 1 --2- 172.21.15.6:0/4214836329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d98004d50 0x7f5d980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db4cb3700 1 -- 172.21.15.6:0/4214836329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db00cf6f0 con 0x7f5d98004d50 2023-10-06T02:30:16.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db4cb3700 1 -- 172.21.15.6:0/4214836329 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db00cf9d0 con 0x7f5d98003a60 2023-10-06T02:30:16.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db4cb3700 1 -- 172.21.15.6:0/4214836329 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9800ba60 con 0x7f5db01597d0 2023-10-06T02:30:16.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db64b6700 1 --2- 172.21.15.6:0/4214836329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d98004d50 0x7f5d980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db5cb5700 1 --2- 172.21.15.6:0/4214836329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d98003a60 0x7f5d98003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db54b4700 1 --2- 172.21.15.6:0/4214836329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db01597d0 0x7f5d98004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db64b6700 1 -- 172.21.15.6:0/4214836329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db01597d0 msgr2=0x7f5d98004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:16.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db64b6700 1 --2- 172.21.15.6:0/4214836329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db01597d0 0x7f5d98004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db64b6700 1 -- 172.21.15.6:0/4214836329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d98003a60 msgr2=0x7f5d98003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:16.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db64b6700 1 --2- 172.21.15.6:0/4214836329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d98003a60 0x7f5d98003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db64b6700 1 -- 172.21.15.6:0/4214836329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d98003570 con 0x7f5d98004d50 2023-10-06T02:30:16.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.168+0000 7f5db5cb5700 1 --2- 172.21.15.6:0/4214836329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d98003a60 0x7f5d98003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:30:16.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.169+0000 7f5db64b6700 1 --2- 172.21.15.6:0/4214836329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d98004d50 0x7f5d980051c0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7f5da000e210 tx=0x7f5da000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92dc480eac8ea1e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:16.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.169+0000 7f5db4cb3700 1 -- 172.21.15.6:0/4214836329 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da000ea60 con 0x7f5d98004d50 2023-10-06T02:30:16.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.169+0000 7f5db4cb3700 1 -- 172.21.15.6:0/4214836329 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da000f040 con 0x7f5d98004d50 2023-10-06T02:30:16.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.169+0000 7f5db4cb3700 1 -- 172.21.15.6:0/4214836329 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da000ee10 con 0x7f5d98004d50 2023-10-06T02:30:16.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.169+0000 7f5db6cb7700 1 -- 172.21.15.6:0/4214836329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d98004d50 msgr2=0x7f5d980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:16.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.169+0000 7f5db6cb7700 1 --2- 172.21.15.6:0/4214836329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d98004d50 0x7f5d980051c0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7f5da000e210 tx=0x7f5da000b040 comp rx=0 tx=0).stop 2023-10-06T02:30:16.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.169+0000 7f5db64b6700 1 -- 172.21.15.6:0/4214836329 reap_dead start 2023-10-06T02:30:16.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.169+0000 7f5db6cb7700 1 -- 172.21.15.6:0/4214836329 shutdown_connections 2023-10-06T02:30:16.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.169+0000 7f5db6cb7700 1 -- 172.21.15.6:0/4214836329 >> 172.21.15.6:0/4214836329 conn(0x7f5db006ac10 msgr2=0x7f5db0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:16.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.169+0000 7f5db6cb7700 1 -- 172.21.15.6:0/4214836329 shutdown_connections 2023-10-06T02:30:16.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.169+0000 7f5db6cb7700 1 -- 172.21.15.6:0/4214836329 wait complete. 2023-10-06T02:30:16.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.170+0000 7f5db6cb7700 1 Processor -- start 2023-10-06T02:30:16.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.170+0000 7f5db6cb7700 1 -- start start 2023-10-06T02:30:16.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.171+0000 7f5db6cb7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db0147c60 0x7f5db00c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.171+0000 7f5db6cb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5db0169b20 0x7f5db00c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.171+0000 7f5db6cb7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5db015de70 0x7f5db015e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.171+0000 7f5db6cb7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db015d110 con 0x7f5db0169b20 2023-10-06T02:30:16.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.171+0000 7f5db6cb7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db015ed90 con 0x7f5db015de70 2023-10-06T02:30:16.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.171+0000 7f5db6cb7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db00b0a50 con 0x7f5db0147c60 2023-10-06T02:30:16.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.171+0000 7f5db54b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5db0169b20 0x7f5db00c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.171+0000 7f5db54b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5db0169b20 0x7f5db00c5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40344/0 (socket says 172.21.15.6:40344) 2023-10-06T02:30:16.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.171+0000 7f5db54b4700 1 -- 172.21.15.6:0/2119969671 learned_addr learned my addr 172.21.15.6:0/2119969671 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:16.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.171+0000 7f5db5cb5700 1 --2- 172.21.15.6:0/2119969671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db0147c60 0x7f5db00c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.172+0000 7f5db64b6700 1 --2- 172.21.15.6:0/2119969671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5db015de70 0x7f5db015e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.172+0000 7f5db54b4700 1 -- 172.21.15.6:0/2119969671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db0147c60 msgr2=0x7f5db00c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:16.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.172+0000 7f5db54b4700 1 --2- 172.21.15.6:0/2119969671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db0147c60 0x7f5db00c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.172+0000 7f5db54b4700 1 -- 172.21.15.6:0/2119969671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5db015de70 msgr2=0x7f5db015e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:16.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.172+0000 7f5db54b4700 1 --2- 172.21.15.6:0/2119969671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5db015de70 0x7f5db015e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.172+0000 7f5db54b4700 1 -- 172.21.15.6:0/2119969671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db015e850 con 0x7f5db0169b20 2023-10-06T02:30:16.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.172+0000 7f5db5cb5700 1 --2- 172.21.15.6:0/2119969671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db0147c60 0x7f5db00c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:16.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.172+0000 7f5db54b4700 1 --2- 172.21.15.6:0/2119969671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5db0169b20 0x7f5db00c5cd0 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7f5da4006ac0 tx=0x7f5da40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.172+0000 7f5dadffb700 1 -- 172.21.15.6:0/2119969671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da400fa10 con 0x7f5db0169b20 2023-10-06T02:30:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.172+0000 7f5dadffb700 1 -- 172.21.15.6:0/2119969671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da400fb70 con 0x7f5db0169b20 2023-10-06T02:30:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.172+0000 7f5db6cb7700 1 -- 172.21.15.6:0/2119969671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db015eab0 con 0x7f5db0169b20 2023-10-06T02:30:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.172+0000 7f5dadffb700 1 -- 172.21.15.6:0/2119969671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da4014440 con 0x7f5db0169b20 2023-10-06T02:30:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.172+0000 7f5db6cb7700 1 -- 172.21.15.6:0/2119969671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db00b06e0 con 0x7f5db0169b20 2023-10-06T02:30:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.173+0000 7f5db6cb7700 1 -- 172.21.15.6:0/2119969671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db00b0bc0 con 0x7f5db0169b20 2023-10-06T02:30:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.174+0000 7f5dadffb700 1 -- 172.21.15.6:0/2119969671 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5da4014830 con 0x7f5db0169b20 2023-10-06T02:30:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.174+0000 7f5dadffb700 1 --2- 172.21.15.6:0/2119969671 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5d9c066f30 0x7f5d9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.174+0000 7f5dadffb700 1 -- 172.21.15.6:0/2119969671 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5da4018030 con 0x7f5db0169b20 2023-10-06T02:30:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.174+0000 7f5db5cb5700 1 --2- 172.21.15.6:0/2119969671 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5d9c066f30 0x7f5d9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.175+0000 7f5db5cb5700 1 --2- 172.21.15.6:0/2119969671 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5d9c066f30 0x7f5d9c0693e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f5da8007d00 tx=0x7f5da8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:16.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.178+0000 7f5dadffb700 1 -- 172.21.15.6:0/2119969671 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5da4052210 con 0x7f5db0169b20 2023-10-06T02:30:16.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.367+0000 7f5db6cb7700 1 -- 172.21.15.6:0/2119969671 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5db00b31f0 con 0x7f5d9c066f30 2023-10-06T02:30:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.377+0000 7f5dadffb700 1 -- 172.21.15.6:0/2119969671 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312277 (secure 0 0 0) 0x7f5db00b31f0 con 0x7f5d9c066f30 2023-10-06T02:30:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.380+0000 7f5db6cb7700 1 -- 172.21.15.6:0/2119969671 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5d9c066f30 msgr2=0x7f5d9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.380+0000 7f5db6cb7700 1 --2- 172.21.15.6:0/2119969671 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5d9c066f30 0x7f5d9c0693e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f5da8007d00 tx=0x7f5da8009040 comp rx=0 tx=0).stop 2023-10-06T02:30:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.380+0000 7f5db6cb7700 1 -- 172.21.15.6:0/2119969671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5db0169b20 msgr2=0x7f5db00c5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.380+0000 7f5db6cb7700 1 --2- 172.21.15.6:0/2119969671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5db0169b20 0x7f5db00c5cd0 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7f5da4006ac0 tx=0x7f5da40091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.380+0000 7f5db6cb7700 1 -- 172.21.15.6:0/2119969671 shutdown_connections 2023-10-06T02:30:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.380+0000 7f5db6cb7700 1 --2- 172.21.15.6:0/2119969671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5db015de70 0x7f5db015e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.380+0000 7f5db6cb7700 1 --2- 172.21.15.6:0/2119969671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db0147c60 0x7f5db00c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.380+0000 7f5db6cb7700 1 --2- 172.21.15.6:0/2119969671 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5d9c066f30 0x7f5d9c0693e0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.380+0000 7f5db6cb7700 1 --2- 172.21.15.6:0/2119969671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5db0169b20 0x7f5db00c5cd0 unknown :-1 s=CLOSED pgs=2416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.380+0000 7f5db6cb7700 1 -- 172.21.15.6:0/2119969671 >> 172.21.15.6:0/2119969671 conn(0x7f5db006ac10 msgr2=0x7f5db0156860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.380+0000 7f5db6cb7700 1 -- 172.21.15.6:0/2119969671 shutdown_connections 2023-10-06T02:30:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.380+0000 7f5db6cb7700 1 -- 172.21.15.6:0/2119969671 wait complete. 2023-10-06T02:30:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:30:16.394 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":519,"stamp":"2023-10-06T02:30:14.749780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2451772,"kb_used_data":16124,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752522948,"statfs":{"total":773094113280,"available":770583498752,"internally_reserved":0,"allocated":16510976,"data_stored":9145377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001970"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.355970+0000","last_change":"2023-10-06T02:30:07.351954+0000","last_active":"2023-10-06T02:30:07.355970+0000","last_peered":"2023-10-06T02:30:07.355970+0000","last_clean":"2023-10-06T02:30:07.355970+0000","last_became_active":"2023-10-06T02:30:07.351515+0000","last_became_peered":"2023-10-06T02:30:07.351515+0000","last_unstale":"2023-10-06T02:30:07.355970+0000","last_undegraded":"2023-10-06T02:30:07.355970+0000","last_fullsized":"2023-10-06T02:30:07.355970+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:11.816588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.350933+0000","last_change":"2023-10-06T02:30:07.346725+0000","last_active":"2023-10-06T02:30:07.350933+0000","last_peered":"2023-10-06T02:30:07.350933+0000","last_clean":"2023-10-06T02:30:07.350933+0000","last_became_active":"2023-10-06T02:30:07.346391+0000","last_became_peered":"2023-10-06T02:30:07.346391+0000","last_unstale":"2023-10-06T02:30:07.350933+0000","last_undegraded":"2023-10-06T02:30:07.350933+0000","last_fullsized":"2023-10-06T02:30:07.350933+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:42.909162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346843+0000","last_change":"2023-10-06T02:30:07.341016+0000","last_active":"2023-10-06T02:30:07.346843+0000","last_peered":"2023-10-06T02:30:07.346843+0000","last_clean":"2023-10-06T02:30:07.346843+0000","last_became_active":"2023-10-06T02:30:07.340758+0000","last_became_peered":"2023-10-06T02:30:07.340758+0000","last_unstale":"2023-10-06T02:30:07.346843+0000","last_undegraded":"2023-10-06T02:30:07.346843+0000","last_fullsized":"2023-10-06T02:30:07.346843+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:49.426843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353017+0000","last_change":"2023-10-06T02:30:07.347836+0000","last_active":"2023-10-06T02:30:07.353017+0000","last_peered":"2023-10-06T02:30:07.353017+0000","last_clean":"2023-10-06T02:30:07.353017+0000","last_became_active":"2023-10-06T02:30:07.345084+0000","last_became_peered":"2023-10-06T02:30:07.345084+0000","last_unstale":"2023-10-06T02:30:07.353017+0000","last_undegraded":"2023-10-06T02:30:07.353017+0000","last_fullsized":"2023-10-06T02:30:07.353017+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:20.252454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.342549+0000","last_change":"2023-10-06T02:30:07.338827+0000","last_active":"2023-10-06T02:30:07.342549+0000","last_peered":"2023-10-06T02:30:07.342549+0000","last_clean":"2023-10-06T02:30:07.342549+0000","last_became_active":"2023-10-06T02:30:07.338490+0000","last_became_peered":"2023-10-06T02:30:07.338490+0000","last_unstale":"2023-10-06T02:30:07.342549+0000","last_undegraded":"2023-10-06T02:30:07.342549+0000","last_fullsized":"2023-10-06T02:30:07.342549+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:50:59.085453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354969+0000","last_change":"2023-10-06T02:30:07.342419+0000","last_active":"2023-10-06T02:30:07.354969+0000","last_peered":"2023-10-06T02:30:07.354969+0000","last_clean":"2023-10-06T02:30:07.354969+0000","last_became_active":"2023-10-06T02:30:07.342131+0000","last_became_peered":"2023-10-06T02:30:07.342131+0000","last_unstale":"2023-10-06T02:30:07.354969+0000","last_undegraded":"2023-10-06T02:30:07.354969+0000","last_fullsized":"2023-10-06T02:30:07.354969+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:42.173757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.344921+0000","last_change":"2023-10-06T02:30:07.342991+0000","last_active":"2023-10-06T02:30:07.344921+0000","last_peered":"2023-10-06T02:30:07.344921+0000","last_clean":"2023-10-06T02:30:07.344921+0000","last_became_active":"2023-10-06T02:30:07.342674+0000","last_became_peered":"2023-10-06T02:30:07.342674+0000","last_unstale":"2023-10-06T02:30:07.344921+0000","last_undegraded":"2023-10-06T02:30:07.344921+0000","last_fullsized":"2023-10-06T02:30:07.344921+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:47.896372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346607+0000","last_change":"2023-10-06T02:30:07.339901+0000","last_active":"2023-10-06T02:30:07.346607+0000","last_peered":"2023-10-06T02:30:07.346607+0000","last_clean":"2023-10-06T02:30:07.346607+0000","last_became_active":"2023-10-06T02:30:07.339183+0000","last_became_peered":"2023-10-06T02:30:07.339183+0000","last_unstale":"2023-10-06T02:30:07.346607+0000","last_undegraded":"2023-10-06T02:30:07.346607+0000","last_fullsized":"2023-10-06T02:30:07.346607+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:28.552907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.351762+0000","last_change":"2023-10-06T02:30:07.345766+0000","last_active":"2023-10-06T02:30:07.351762+0000","last_peered":"2023-10-06T02:30:07.351762+0000","last_clean":"2023-10-06T02:30:07.351762+0000","last_became_active":"2023-10-06T02:30:07.345460+0000","last_became_peered":"2023-10-06T02:30:07.345460+0000","last_unstale":"2023-10-06T02:30:07.351762+0000","last_undegraded":"2023-10-06T02:30:07.351762+0000","last_fullsized":"2023-10-06T02:30:07.351762+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:10.625993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.352845+0000","last_change":"2023-10-06T02:30:07.347117+0000","last_active":"2023-10-06T02:30:07.352845+0000","last_peered":"2023-10-06T02:30:07.352845+0000","last_clean":"2023-10-06T02:30:07.352845+0000","last_became_active":"2023-10-06T02:30:07.346732+0000","last_became_peered":"2023-10-06T02:30:07.346732+0000","last_unstale":"2023-10-06T02:30:07.352845+0000","last_undegraded":"2023-10-06T02:30:07.352845+0000","last_fullsized":"2023-10-06T02:30:07.352845+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:22.819771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354256+0000","last_change":"2023-10-06T02:30:07.350349+0000","last_active":"2023-10-06T02:30:07.354256+0000","last_peered":"2023-10-06T02:30:07.354256+0000","last_clean":"2023-10-06T02:30:07.354256+0000","last_became_active":"2023-10-06T02:30:07.350090+0000","last_became_peered":"2023-10-06T02:30:07.350090+0000","last_unstale":"2023-10-06T02:30:07.354256+0000","last_undegraded":"2023-10-06T02:30:07.354256+0000","last_fullsized":"2023-10-06T02:30:07.354256+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:18.726171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353036+0000","last_change":"2023-10-06T02:30:07.347427+0000","last_active":"2023-10-06T02:30:07.353036+0000","last_peered":"2023-10-06T02:30:07.353036+0000","last_clean":"2023-10-06T02:30:07.353036+0000","last_became_active":"2023-10-06T02:30:07.340357+0000","last_became_peered":"2023-10-06T02:30:07.340357+0000","last_unstale":"2023-10-06T02:30:07.353036+0000","last_undegraded":"2023-10-06T02:30:07.353036+0000","last_fullsized":"2023-10-06T02:30:07.353036+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:09.297561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346787+0000","last_change":"2023-10-06T02:30:07.336990+0000","last_active":"2023-10-06T02:30:07.346787+0000","last_peered":"2023-10-06T02:30:07.346787+0000","last_clean":"2023-10-06T02:30:07.346787+0000","last_became_active":"2023-10-06T02:30:07.336584+0000","last_became_peered":"2023-10-06T02:30:07.336584+0000","last_unstale":"2023-10-06T02:30:07.346787+0000","last_undegraded":"2023-10-06T02:30:07.346787+0000","last_fullsized":"2023-10-06T02:30:07.346787+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:05.329646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346475+0000","last_change":"2023-10-06T02:30:07.338334+0000","last_active":"2023-10-06T02:30:07.346475+0000","last_peered":"2023-10-06T02:30:07.346475+0000","last_clean":"2023-10-06T02:30:07.346475+0000","last_became_active":"2023-10-06T02:30:07.338035+0000","last_became_peered":"2023-10-06T02:30:07.338035+0000","last_unstale":"2023-10-06T02:30:07.346475+0000","last_undegraded":"2023-10-06T02:30:07.346475+0000","last_fullsized":"2023-10-06T02:30:07.346475+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:24.477294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.347927+0000","last_change":"2023-10-06T02:30:07.340152+0000","last_active":"2023-10-06T02:30:07.347927+0000","last_peered":"2023-10-06T02:30:07.347927+0000","last_clean":"2023-10-06T02:30:07.347927+0000","last_became_active":"2023-10-06T02:30:07.339841+0000","last_became_peered":"2023-10-06T02:30:07.339841+0000","last_unstale":"2023-10-06T02:30:07.347927+0000","last_undegraded":"2023-10-06T02:30:07.347927+0000","last_fullsized":"2023-10-06T02:30:07.347927+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:38.048243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354716+0000","last_change":"2023-10-06T02:30:07.351986+0000","last_active":"2023-10-06T02:30:07.354716+0000","last_peered":"2023-10-06T02:30:07.354716+0000","last_clean":"2023-10-06T02:30:07.354716+0000","last_became_active":"2023-10-06T02:30:07.351662+0000","last_became_peered":"2023-10-06T02:30:07.351662+0000","last_unstale":"2023-10-06T02:30:07.354716+0000","last_undegraded":"2023-10-06T02:30:07.354716+0000","last_fullsized":"2023-10-06T02:30:07.354716+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:56.111995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354027+0000","last_change":"2023-10-06T02:30:07.349420+0000","last_active":"2023-10-06T02:30:07.354027+0000","last_peered":"2023-10-06T02:30:07.354027+0000","last_clean":"2023-10-06T02:30:07.354027+0000","last_became_active":"2023-10-06T02:30:07.349060+0000","last_became_peered":"2023-10-06T02:30:07.349060+0000","last_unstale":"2023-10-06T02:30:07.354027+0000","last_undegraded":"2023-10-06T02:30:07.354027+0000","last_fullsized":"2023-10-06T02:30:07.354027+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:00:04.532549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353884+0000","last_change":"2023-10-06T02:30:07.348912+0000","last_active":"2023-10-06T02:30:07.353884+0000","last_peered":"2023-10-06T02:30:07.353884+0000","last_clean":"2023-10-06T02:30:07.353884+0000","last_became_active":"2023-10-06T02:30:07.348628+0000","last_became_peered":"2023-10-06T02:30:07.348628+0000","last_unstale":"2023-10-06T02:30:07.353884+0000","last_undegraded":"2023-10-06T02:30:07.353884+0000","last_fullsized":"2023-10-06T02:30:07.353884+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:33.896435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346306+0000","last_change":"2023-10-06T02:30:07.336164+0000","last_active":"2023-10-06T02:30:07.346306+0000","last_peered":"2023-10-06T02:30:07.346306+0000","last_clean":"2023-10-06T02:30:07.346306+0000","last_became_active":"2023-10-06T02:30:07.335860+0000","last_became_peered":"2023-10-06T02:30:07.335860+0000","last_unstale":"2023-10-06T02:30:07.346306+0000","last_undegraded":"2023-10-06T02:30:07.346306+0000","last_fullsized":"2023-10-06T02:30:07.346306+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:57.680241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346139+0000","last_change":"2023-10-06T02:30:07.333044+0000","last_active":"2023-10-06T02:30:07.346139+0000","last_peered":"2023-10-06T02:30:07.346139+0000","last_clean":"2023-10-06T02:30:07.346139+0000","last_became_active":"2023-10-06T02:30:07.332771+0000","last_became_peered":"2023-10-06T02:30:07.332771+0000","last_unstale":"2023-10-06T02:30:07.346139+0000","last_undegraded":"2023-10-06T02:30:07.346139+0000","last_fullsized":"2023-10-06T02:30:07.346139+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:15.415596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.350771+0000","last_change":"2023-10-06T02:30:07.346691+0000","last_active":"2023-10-06T02:30:07.350771+0000","last_peered":"2023-10-06T02:30:07.350771+0000","last_clean":"2023-10-06T02:30:07.350771+0000","last_became_active":"2023-10-06T02:30:07.346402+0000","last_became_peered":"2023-10-06T02:30:07.346402+0000","last_unstale":"2023-10-06T02:30:07.350771+0000","last_undegraded":"2023-10-06T02:30:07.350771+0000","last_fullsized":"2023-10-06T02:30:07.350771+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:51.784533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.350248+0000","last_change":"2023-10-06T02:30:07.339506+0000","last_active":"2023-10-06T02:30:07.350248+0000","last_peered":"2023-10-06T02:30:07.350248+0000","last_clean":"2023-10-06T02:30:07.350248+0000","last_became_active":"2023-10-06T02:30:07.339225+0000","last_became_peered":"2023-10-06T02:30:07.339225+0000","last_unstale":"2023-10-06T02:30:07.350248+0000","last_undegraded":"2023-10-06T02:30:07.350248+0000","last_fullsized":"2023-10-06T02:30:07.350248+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:15.415596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346914+0000","last_change":"2023-10-06T02:30:07.333524+0000","last_active":"2023-10-06T02:30:07.346914+0000","last_peered":"2023-10-06T02:30:07.346914+0000","last_clean":"2023-10-06T02:30:07.346914+0000","last_became_active":"2023-10-06T02:30:07.333281+0000","last_became_peered":"2023-10-06T02:30:07.333281+0000","last_unstale":"2023-10-06T02:30:07.346914+0000","last_undegraded":"2023-10-06T02:30:07.346914+0000","last_fullsized":"2023-10-06T02:30:07.346914+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:13.172573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.357163+0000","last_change":"2023-10-06T02:30:07.350082+0000","last_active":"2023-10-06T02:30:07.357163+0000","last_peered":"2023-10-06T02:30:07.357163+0000","last_clean":"2023-10-06T02:30:07.357163+0000","last_became_active":"2023-10-06T02:30:07.349296+0000","last_became_peered":"2023-10-06T02:30:07.349296+0000","last_unstale":"2023-10-06T02:30:07.357163+0000","last_undegraded":"2023-10-06T02:30:07.357163+0000","last_fullsized":"2023-10-06T02:30:07.357163+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:06.102151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354008+0000","last_change":"2023-10-06T02:30:07.349045+0000","last_active":"2023-10-06T02:30:07.354008+0000","last_peered":"2023-10-06T02:30:07.354008+0000","last_clean":"2023-10-06T02:30:07.354008+0000","last_became_active":"2023-10-06T02:30:07.348713+0000","last_became_peered":"2023-10-06T02:30:07.348713+0000","last_unstale":"2023-10-06T02:30:07.354008+0000","last_undegraded":"2023-10-06T02:30:07.354008+0000","last_fullsized":"2023-10-06T02:30:07.354008+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:06.102151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.352868+0000","last_change":"2023-10-06T02:30:07.347431+0000","last_active":"2023-10-06T02:30:07.352868+0000","last_peered":"2023-10-06T02:30:07.352868+0000","last_clean":"2023-10-06T02:30:07.352868+0000","last_became_active":"2023-10-06T02:30:07.347126+0000","last_became_peered":"2023-10-06T02:30:07.347126+0000","last_unstale":"2023-10-06T02:30:07.352868+0000","last_undegraded":"2023-10-06T02:30:07.352868+0000","last_fullsized":"2023-10-06T02:30:07.352868+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:24.131233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353542+0000","last_change":"2023-10-06T02:30:07.341797+0000","last_active":"2023-10-06T02:30:07.353542+0000","last_peered":"2023-10-06T02:30:07.353542+0000","last_clean":"2023-10-06T02:30:07.353542+0000","last_became_active":"2023-10-06T02:30:07.341508+0000","last_became_peered":"2023-10-06T02:30:07.341508+0000","last_unstale":"2023-10-06T02:30:07.353542+0000","last_undegraded":"2023-10-06T02:30:07.353542+0000","last_fullsized":"2023-10-06T02:30:07.353542+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:31.697463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.357140+0000","last_change":"2023-10-06T02:30:07.353989+0000","last_active":"2023-10-06T02:30:07.357140+0000","last_peered":"2023-10-06T02:30:07.357140+0000","last_clean":"2023-10-06T02:30:07.357140+0000","last_became_active":"2023-10-06T02:30:07.353717+0000","last_became_peered":"2023-10-06T02:30:07.353717+0000","last_unstale":"2023-10-06T02:30:07.357140+0000","last_undegraded":"2023-10-06T02:30:07.357140+0000","last_fullsized":"2023-10-06T02:30:07.357140+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:55.749868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.348681+0000","last_change":"2023-10-06T02:30:07.341632+0000","last_active":"2023-10-06T02:30:07.348681+0000","last_peered":"2023-10-06T02:30:07.348681+0000","last_clean":"2023-10-06T02:30:07.348681+0000","last_became_active":"2023-10-06T02:30:07.341381+0000","last_became_peered":"2023-10-06T02:30:07.341381+0000","last_unstale":"2023-10-06T02:30:07.348681+0000","last_undegraded":"2023-10-06T02:30:07.348681+0000","last_fullsized":"2023-10-06T02:30:07.348681+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:05.107956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353859+0000","last_change":"2023-10-06T02:30:07.351070+0000","last_active":"2023-10-06T02:30:07.353859+0000","last_peered":"2023-10-06T02:30:07.353859+0000","last_clean":"2023-10-06T02:30:07.353859+0000","last_became_active":"2023-10-06T02:30:07.350833+0000","last_became_peered":"2023-10-06T02:30:07.350833+0000","last_unstale":"2023-10-06T02:30:07.353859+0000","last_undegraded":"2023-10-06T02:30:07.353859+0000","last_fullsized":"2023-10-06T02:30:07.353859+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:30.235922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.352523+0000","last_change":"2023-10-06T02:30:07.345769+0000","last_active":"2023-10-06T02:30:07.352523+0000","last_peered":"2023-10-06T02:30:07.352523+0000","last_clean":"2023-10-06T02:30:07.352523+0000","last_became_active":"2023-10-06T02:30:07.345497+0000","last_became_peered":"2023-10-06T02:30:07.345497+0000","last_unstale":"2023-10-06T02:30:07.352523+0000","last_undegraded":"2023-10-06T02:30:07.352523+0000","last_fullsized":"2023-10-06T02:30:07.352523+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:22.365250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.348148+0000","last_change":"2023-10-06T02:30:07.338069+0000","last_active":"2023-10-06T02:30:07.348148+0000","last_peered":"2023-10-06T02:30:07.348148+0000","last_clean":"2023-10-06T02:30:07.348148+0000","last_became_active":"2023-10-06T02:30:07.337095+0000","last_became_peered":"2023-10-06T02:30:07.337095+0000","last_unstale":"2023-10-06T02:30:07.348148+0000","last_undegraded":"2023-10-06T02:30:07.348148+0000","last_fullsized":"2023-10-06T02:30:07.348148+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:39.253952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.338974+0000","last_change":"2023-10-06T02:30:07.336240+0000","last_active":"2023-10-06T02:30:07.338974+0000","last_peered":"2023-10-06T02:30:07.338974+0000","last_clean":"2023-10-06T02:30:07.338974+0000","last_became_active":"2023-10-06T02:30:07.335919+0000","last_became_peered":"2023-10-06T02:30:07.335919+0000","last_unstale":"2023-10-06T02:30:07.338974+0000","last_undegraded":"2023-10-06T02:30:07.338974+0000","last_fullsized":"2023-10-06T02:30:07.338974+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:43.617059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"145'4","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353771+0000","last_change":"2023-10-06T02:30:06.315389+0000","last_active":"2023-10-06T02:30:07.353771+0000","last_peered":"2023-10-06T02:30:07.353771+0000","last_clean":"2023-10-06T02:30:07.353771+0000","last_became_active":"2023-10-06T02:30:06.315083+0000","last_became_peered":"2023-10-06T02:30:06.315083+0000","last_unstale":"2023-10-06T02:30:07.353771+0000","last_undegraded":"2023-10-06T02:30:07.353771+0000","last_fullsized":"2023-10-06T02:30:07.353771+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:55.251959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.351193+0000","last_change":"2023-10-06T02:30:07.347762+0000","last_active":"2023-10-06T02:30:07.351193+0000","last_peered":"2023-10-06T02:30:07.351193+0000","last_clean":"2023-10-06T02:30:07.351193+0000","last_became_active":"2023-10-06T02:30:07.347399+0000","last_became_peered":"2023-10-06T02:30:07.347399+0000","last_unstale":"2023-10-06T02:30:07.351193+0000","last_undegraded":"2023-10-06T02:30:07.351193+0000","last_fullsized":"2023-10-06T02:30:07.351193+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:14.673862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354121+0000","last_change":"2023-10-06T02:30:06.317388+0000","last_active":"2023-10-06T02:30:07.354121+0000","last_peered":"2023-10-06T02:30:07.354121+0000","last_clean":"2023-10-06T02:30:07.354121+0000","last_became_active":"2023-10-06T02:30:06.317084+0000","last_became_peered":"2023-10-06T02:30:06.317084+0000","last_unstale":"2023-10-06T02:30:07.354121+0000","last_undegraded":"2023-10-06T02:30:07.354121+0000","last_fullsized":"2023-10-06T02:30:07.354121+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:32.892304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354852+0000","last_change":"2023-10-06T02:30:07.342426+0000","last_active":"2023-10-06T02:30:07.354852+0000","last_peered":"2023-10-06T02:30:07.354852+0000","last_clean":"2023-10-06T02:30:07.354852+0000","last_became_active":"2023-10-06T02:30:07.342149+0000","last_became_peered":"2023-10-06T02:30:07.342149+0000","last_unstale":"2023-10-06T02:30:07.354852+0000","last_undegraded":"2023-10-06T02:30:07.354852+0000","last_fullsized":"2023-10-06T02:30:07.354852+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:56.256091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.360053+0000","last_change":"2023-10-06T02:30:06.318483+0000","last_active":"2023-10-06T02:30:07.360053+0000","last_peered":"2023-10-06T02:30:07.360053+0000","last_clean":"2023-10-06T02:30:07.360053+0000","last_became_active":"2023-10-06T02:30:06.318231+0000","last_became_peered":"2023-10-06T02:30:06.318231+0000","last_unstale":"2023-10-06T02:30:07.360053+0000","last_undegraded":"2023-10-06T02:30:07.360053+0000","last_fullsized":"2023-10-06T02:30:07.360053+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:35.270132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346566+0000","last_change":"2023-10-06T02:30:07.338423+0000","last_active":"2023-10-06T02:30:07.346566+0000","last_peered":"2023-10-06T02:30:07.346566+0000","last_clean":"2023-10-06T02:30:07.346566+0000","last_became_active":"2023-10-06T02:30:07.338129+0000","last_became_peered":"2023-10-06T02:30:07.338129+0000","last_unstale":"2023-10-06T02:30:07.346566+0000","last_undegraded":"2023-10-06T02:30:07.346566+0000","last_fullsized":"2023-10-06T02:30:07.346566+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:12.953008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.356622+0000","last_change":"2023-10-06T02:30:06.310720+0000","last_active":"2023-10-06T02:30:07.356622+0000","last_peered":"2023-10-06T02:30:07.356622+0000","last_clean":"2023-10-06T02:30:07.356622+0000","last_became_active":"2023-10-06T02:30:06.310435+0000","last_became_peered":"2023-10-06T02:30:06.310435+0000","last_unstale":"2023-10-06T02:30:07.356622+0000","last_undegraded":"2023-10-06T02:30:07.356622+0000","last_fullsized":"2023-10-06T02:30:07.356622+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:34.559685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.349869+0000","last_change":"2023-10-06T02:30:07.344599+0000","last_active":"2023-10-06T02:30:07.349869+0000","last_peered":"2023-10-06T02:30:07.349869+0000","last_clean":"2023-10-06T02:30:07.349869+0000","last_became_active":"2023-10-06T02:30:07.340256+0000","last_became_peered":"2023-10-06T02:30:07.340256+0000","last_unstale":"2023-10-06T02:30:07.349869+0000","last_undegraded":"2023-10-06T02:30:07.349869+0000","last_fullsized":"2023-10-06T02:30:07.349869+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:59.883607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.355285+0000","last_change":"2023-10-06T02:30:06.320599+0000","last_active":"2023-10-06T02:30:07.355285+0000","last_peered":"2023-10-06T02:30:07.355285+0000","last_clean":"2023-10-06T02:30:07.355285+0000","last_became_active":"2023-10-06T02:30:06.320238+0000","last_became_peered":"2023-10-06T02:30:06.320238+0000","last_unstale":"2023-10-06T02:30:07.355285+0000","last_undegraded":"2023-10-06T02:30:07.355285+0000","last_fullsized":"2023-10-06T02:30:07.355285+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:30.693332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.348306+0000","last_change":"2023-10-06T02:30:07.336779+0000","last_active":"2023-10-06T02:30:07.348306+0000","last_peered":"2023-10-06T02:30:07.348306+0000","last_clean":"2023-10-06T02:30:07.348306+0000","last_became_active":"2023-10-06T02:30:07.336532+0000","last_became_peered":"2023-10-06T02:30:07.336532+0000","last_unstale":"2023-10-06T02:30:07.348306+0000","last_undegraded":"2023-10-06T02:30:07.348306+0000","last_fullsized":"2023-10-06T02:30:07.348306+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:59.291596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.357127+0000","last_change":"2023-10-06T02:30:06.320691+0000","last_active":"2023-10-06T02:30:07.357127+0000","last_peered":"2023-10-06T02:30:07.357127+0000","last_clean":"2023-10-06T02:30:07.357127+0000","last_became_active":"2023-10-06T02:30:06.320418+0000","last_became_peered":"2023-10-06T02:30:06.320418+0000","last_unstale":"2023-10-06T02:30:07.357127+0000","last_undegraded":"2023-10-06T02:30:07.357127+0000","last_fullsized":"2023-10-06T02:30:07.357127+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:04.325515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.349576+0000","last_change":"2023-10-06T02:30:07.340489+0000","last_active":"2023-10-06T02:30:07.349576+0000","last_peered":"2023-10-06T02:30:07.349576+0000","last_clean":"2023-10-06T02:30:07.349576+0000","last_became_active":"2023-10-06T02:30:07.340067+0000","last_became_peered":"2023-10-06T02:30:07.340067+0000","last_unstale":"2023-10-06T02:30:07.349576+0000","last_undegraded":"2023-10-06T02:30:07.349576+0000","last_fullsized":"2023-10-06T02:30:07.349576+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:07.824834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.330143+0000","last_change":"2023-10-06T02:30:06.322246+0000","last_active":"2023-10-06T02:30:07.330143+0000","last_peered":"2023-10-06T02:30:07.330143+0000","last_clean":"2023-10-06T02:30:07.330143+0000","last_became_active":"2023-10-06T02:30:06.321895+0000","last_became_peered":"2023-10-06T02:30:06.321895+0000","last_unstale":"2023-10-06T02:30:07.330143+0000","last_undegraded":"2023-10-06T02:30:07.330143+0000","last_fullsized":"2023-10-06T02:30:07.330143+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:51.474045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.351742+0000","last_change":"2023-10-06T02:30:07.344027+0000","last_active":"2023-10-06T02:30:07.351742+0000","last_peered":"2023-10-06T02:30:07.351742+0000","last_clean":"2023-10-06T02:30:07.351742+0000","last_became_active":"2023-10-06T02:30:07.342669+0000","last_became_peered":"2023-10-06T02:30:07.342669+0000","last_unstale":"2023-10-06T02:30:07.351742+0000","last_undegraded":"2023-10-06T02:30:07.351742+0000","last_fullsized":"2023-10-06T02:30:07.351742+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:45.424595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.328792+0000","last_change":"2023-10-06T02:30:06.322938+0000","last_active":"2023-10-06T02:30:07.328792+0000","last_peered":"2023-10-06T02:30:07.328792+0000","last_clean":"2023-10-06T02:30:07.328792+0000","last_became_active":"2023-10-06T02:30:06.322609+0000","last_became_peered":"2023-10-06T02:30:06.322609+0000","last_unstale":"2023-10-06T02:30:07.328792+0000","last_undegraded":"2023-10-06T02:30:07.328792+0000","last_fullsized":"2023-10-06T02:30:07.328792+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:35.324371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.347057+0000","last_change":"2023-10-06T02:30:07.342256+0000","last_active":"2023-10-06T02:30:07.347057+0000","last_peered":"2023-10-06T02:30:07.347057+0000","last_clean":"2023-10-06T02:30:07.347057+0000","last_became_active":"2023-10-06T02:30:07.341975+0000","last_became_peered":"2023-10-06T02:30:07.341975+0000","last_unstale":"2023-10-06T02:30:07.347057+0000","last_undegraded":"2023-10-06T02:30:07.347057+0000","last_fullsized":"2023-10-06T02:30:07.347057+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:00.459854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.362861+0000","last_change":"2023-10-06T02:30:06.317870+0000","last_active":"2023-10-06T02:30:07.362861+0000","last_peered":"2023-10-06T02:30:07.362861+0000","last_clean":"2023-10-06T02:30:07.362861+0000","last_became_active":"2023-10-06T02:30:06.317571+0000","last_became_peered":"2023-10-06T02:30:06.317571+0000","last_unstale":"2023-10-06T02:30:07.362861+0000","last_undegraded":"2023-10-06T02:30:07.362861+0000","last_fullsized":"2023-10-06T02:30:07.362861+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:04.103825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.348107+0000","last_change":"2023-10-06T02:30:07.341410+0000","last_active":"2023-10-06T02:30:07.348107+0000","last_peered":"2023-10-06T02:30:07.348107+0000","last_clean":"2023-10-06T02:30:07.348107+0000","last_became_active":"2023-10-06T02:30:07.341111+0000","last_became_peered":"2023-10-06T02:30:07.341111+0000","last_unstale":"2023-10-06T02:30:07.348107+0000","last_undegraded":"2023-10-06T02:30:07.348107+0000","last_fullsized":"2023-10-06T02:30:07.348107+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:07.066199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354345+0000","last_change":"2023-10-06T02:30:06.317085+0000","last_active":"2023-10-06T02:30:07.354345+0000","last_peered":"2023-10-06T02:30:07.354345+0000","last_clean":"2023-10-06T02:30:07.354345+0000","last_became_active":"2023-10-06T02:30:06.316815+0000","last_became_peered":"2023-10-06T02:30:06.316815+0000","last_unstale":"2023-10-06T02:30:07.354345+0000","last_undegraded":"2023-10-06T02:30:07.354345+0000","last_fullsized":"2023-10-06T02:30:07.354345+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:43.892133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.354072+0000","last_change":"2023-10-06T02:30:07.351496+0000","last_active":"2023-10-06T02:30:07.354072+0000","last_peered":"2023-10-06T02:30:07.354072+0000","last_clean":"2023-10-06T02:30:07.354072+0000","last_became_active":"2023-10-06T02:30:07.351192+0000","last_became_peered":"2023-10-06T02:30:07.351192+0000","last_unstale":"2023-10-06T02:30:07.354072+0000","last_undegraded":"2023-10-06T02:30:07.354072+0000","last_fullsized":"2023-10-06T02:30:07.354072+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:14.446924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.358259+0000","last_change":"2023-10-06T02:30:06.321479+0000","last_active":"2023-10-06T02:30:07.358259+0000","last_peered":"2023-10-06T02:30:07.358259+0000","last_clean":"2023-10-06T02:30:07.358259+0000","last_became_active":"2023-10-06T02:30:06.321178+0000","last_became_peered":"2023-10-06T02:30:06.321178+0000","last_unstale":"2023-10-06T02:30:07.358259+0000","last_undegraded":"2023-10-06T02:30:07.358259+0000","last_fullsized":"2023-10-06T02:30:07.358259+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:46.892240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.347523+0000","last_change":"2023-10-06T02:30:07.343382+0000","last_active":"2023-10-06T02:30:07.347523+0000","last_peered":"2023-10-06T02:30:07.347523+0000","last_clean":"2023-10-06T02:30:07.347523+0000","last_became_active":"2023-10-06T02:30:07.342962+0000","last_became_peered":"2023-10-06T02:30:07.342962+0000","last_unstale":"2023-10-06T02:30:07.347523+0000","last_undegraded":"2023-10-06T02:30:07.347523+0000","last_fullsized":"2023-10-06T02:30:07.347523+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:22.227760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.336000+0000","last_change":"2023-10-06T02:30:06.322665+0000","last_active":"2023-10-06T02:30:07.336000+0000","last_peered":"2023-10-06T02:30:07.336000+0000","last_clean":"2023-10-06T02:30:07.336000+0000","last_became_active":"2023-10-06T02:30:06.322399+0000","last_became_peered":"2023-10-06T02:30:06.322399+0000","last_unstale":"2023-10-06T02:30:07.336000+0000","last_undegraded":"2023-10-06T02:30:07.336000+0000","last_fullsized":"2023-10-06T02:30:07.336000+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:06.062068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.351675+0000","last_change":"2023-10-06T02:30:07.348144+0000","last_active":"2023-10-06T02:30:07.351675+0000","last_peered":"2023-10-06T02:30:07.351675+0000","last_clean":"2023-10-06T02:30:07.351675+0000","last_became_active":"2023-10-06T02:30:07.347881+0000","last_became_peered":"2023-10-06T02:30:07.347881+0000","last_unstale":"2023-10-06T02:30:07.351675+0000","last_undegraded":"2023-10-06T02:30:07.351675+0000","last_fullsized":"2023-10-06T02:30:07.351675+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:52.478176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.356313+0000","last_change":"2023-10-06T02:30:06.316899+0000","last_active":"2023-10-06T02:30:07.356313+0000","last_peered":"2023-10-06T02:30:07.356313+0000","last_clean":"2023-10-06T02:30:07.356313+0000","last_became_active":"2023-10-06T02:30:06.316605+0000","last_became_peered":"2023-10-06T02:30:06.316605+0000","last_unstale":"2023-10-06T02:30:07.356313+0000","last_undegraded":"2023-10-06T02:30:07.356313+0000","last_fullsized":"2023-10-06T02:30:07.356313+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:56.418916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353950+0000","last_change":"2023-10-06T02:30:07.350759+0000","last_active":"2023-10-06T02:30:07.353950+0000","last_peered":"2023-10-06T02:30:07.353950+0000","last_clean":"2023-10-06T02:30:07.353950+0000","last_became_active":"2023-10-06T02:30:07.350420+0000","last_became_peered":"2023-10-06T02:30:07.350420+0000","last_unstale":"2023-10-06T02:30:07.353950+0000","last_undegraded":"2023-10-06T02:30:07.353950+0000","last_fullsized":"2023-10-06T02:30:07.353950+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:52.876691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.328427+0000","last_change":"2023-10-06T02:30:06.318603+0000","last_active":"2023-10-06T02:30:07.328427+0000","last_peered":"2023-10-06T02:30:07.328427+0000","last_clean":"2023-10-06T02:30:07.328427+0000","last_became_active":"2023-10-06T02:30:06.318333+0000","last_became_peered":"2023-10-06T02:30:06.318333+0000","last_unstale":"2023-10-06T02:30:07.328427+0000","last_undegraded":"2023-10-06T02:30:07.328427+0000","last_fullsized":"2023-10-06T02:30:07.328427+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:21.978753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346455+0000","last_change":"2023-10-06T02:30:07.334998+0000","last_active":"2023-10-06T02:30:07.346455+0000","last_peered":"2023-10-06T02:30:07.346455+0000","last_clean":"2023-10-06T02:30:07.346455+0000","last_became_active":"2023-10-06T02:30:07.334739+0000","last_became_peered":"2023-10-06T02:30:07.334739+0000","last_unstale":"2023-10-06T02:30:07.346455+0000","last_undegraded":"2023-10-06T02:30:07.346455+0000","last_fullsized":"2023-10-06T02:30:07.346455+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:18.390686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.324057+0000","last_change":"2023-10-06T02:30:06.317729+0000","last_active":"2023-10-06T02:30:07.324057+0000","last_peered":"2023-10-06T02:30:07.324057+0000","last_clean":"2023-10-06T02:30:07.324057+0000","last_became_active":"2023-10-06T02:30:06.317463+0000","last_became_peered":"2023-10-06T02:30:06.317463+0000","last_unstale":"2023-10-06T02:30:07.324057+0000","last_undegraded":"2023-10-06T02:30:07.324057+0000","last_fullsized":"2023-10-06T02:30:07.324057+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:54.525262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.357076+0000","last_change":"2023-10-06T02:30:07.353550+0000","last_active":"2023-10-06T02:30:07.357076+0000","last_peered":"2023-10-06T02:30:07.357076+0000","last_clean":"2023-10-06T02:30:07.357076+0000","last_became_active":"2023-10-06T02:30:07.353281+0000","last_became_peered":"2023-10-06T02:30:07.353281+0000","last_unstale":"2023-10-06T02:30:07.357076+0000","last_undegraded":"2023-10-06T02:30:07.357076+0000","last_fullsized":"2023-10-06T02:30:07.357076+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:00:04.532549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.328898+0000","last_change":"2023-10-06T02:30:06.322813+0000","last_active":"2023-10-06T02:30:07.328898+0000","last_peered":"2023-10-06T02:30:07.328898+0000","last_clean":"2023-10-06T02:30:07.328898+0000","last_became_active":"2023-10-06T02:30:06.322512+0000","last_became_peered":"2023-10-06T02:30:06.322512+0000","last_unstale":"2023-10-06T02:30:07.328898+0000","last_undegraded":"2023-10-06T02:30:07.328898+0000","last_fullsized":"2023-10-06T02:30:07.328898+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:58.287464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.359102+0000","last_change":"2023-10-06T02:30:07.355278+0000","last_active":"2023-10-06T02:30:07.359102+0000","last_peered":"2023-10-06T02:30:07.359102+0000","last_clean":"2023-10-06T02:30:07.359102+0000","last_became_active":"2023-10-06T02:30:07.355035+0000","last_became_peered":"2023-10-06T02:30:07.355035+0000","last_unstale":"2023-10-06T02:30:07.359102+0000","last_undegraded":"2023-10-06T02:30:07.359102+0000","last_fullsized":"2023-10-06T02:30:07.359102+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:40:42.915998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.355076+0000","last_change":"2023-10-06T02:30:06.326522+0000","last_active":"2023-10-06T02:30:07.355076+0000","last_peered":"2023-10-06T02:30:07.355076+0000","last_clean":"2023-10-06T02:30:07.355076+0000","last_became_active":"2023-10-06T02:30:06.326204+0000","last_became_peered":"2023-10-06T02:30:06.326204+0000","last_unstale":"2023-10-06T02:30:07.355076+0000","last_undegraded":"2023-10-06T02:30:07.355076+0000","last_fullsized":"2023-10-06T02:30:07.355076+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:17.386555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353589+0000","last_change":"2023-10-06T02:30:07.349113+0000","last_active":"2023-10-06T02:30:07.353589+0000","last_peered":"2023-10-06T02:30:07.353589+0000","last_clean":"2023-10-06T02:30:07.353589+0000","last_became_active":"2023-10-06T02:30:07.348345+0000","last_became_peered":"2023-10-06T02:30:07.348345+0000","last_unstale":"2023-10-06T02:30:07.353589+0000","last_undegraded":"2023-10-06T02:30:07.353589+0000","last_fullsized":"2023-10-06T02:30:07.353589+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:24.449932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.338337+0000","last_change":"2023-10-06T02:30:06.316388+0000","last_active":"2023-10-06T02:30:07.338337+0000","last_peered":"2023-10-06T02:30:07.338337+0000","last_clean":"2023-10-06T02:30:07.338337+0000","last_became_active":"2023-10-06T02:30:06.316124+0000","last_became_peered":"2023-10-06T02:30:06.316124+0000","last_unstale":"2023-10-06T02:30:07.338337+0000","last_undegraded":"2023-10-06T02:30:07.338337+0000","last_fullsized":"2023-10-06T02:30:07.338337+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:44.420464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.352996+0000","last_change":"2023-10-06T02:30:07.347600+0000","last_active":"2023-10-06T02:30:07.352996+0000","last_peered":"2023-10-06T02:30:07.352996+0000","last_clean":"2023-10-06T02:30:07.352996+0000","last_became_active":"2023-10-06T02:30:07.339492+0000","last_became_peered":"2023-10-06T02:30:07.339492+0000","last_unstale":"2023-10-06T02:30:07.352996+0000","last_undegraded":"2023-10-06T02:30:07.352996+0000","last_fullsized":"2023-10-06T02:30:07.352996+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:18.414606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.328252+0000","last_change":"2023-10-06T02:30:06.322647+0000","last_active":"2023-10-06T02:30:07.328252+0000","last_peered":"2023-10-06T02:30:07.328252+0000","last_clean":"2023-10-06T02:30:07.328252+0000","last_became_active":"2023-10-06T02:30:06.322364+0000","last_became_peered":"2023-10-06T02:30:06.322364+0000","last_unstale":"2023-10-06T02:30:07.328252+0000","last_undegraded":"2023-10-06T02:30:07.328252+0000","last_fullsized":"2023-10-06T02:30:07.328252+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:50.780401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353920+0000","last_change":"2023-10-06T02:30:07.350700+0000","last_active":"2023-10-06T02:30:07.353920+0000","last_peered":"2023-10-06T02:30:07.353920+0000","last_clean":"2023-10-06T02:30:07.353920+0000","last_became_active":"2023-10-06T02:30:07.350425+0000","last_became_peered":"2023-10-06T02:30:07.350425+0000","last_unstale":"2023-10-06T02:30:07.353920+0000","last_undegraded":"2023-10-06T02:30:07.353920+0000","last_fullsized":"2023-10-06T02:30:07.353920+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:41:28.057738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.334071+0000","last_change":"2023-10-06T02:30:06.320841+0000","last_active":"2023-10-06T02:30:07.334071+0000","last_peered":"2023-10-06T02:30:07.334071+0000","last_clean":"2023-10-06T02:30:07.334071+0000","last_became_active":"2023-10-06T02:30:06.320611+0000","last_became_peered":"2023-10-06T02:30:06.320611+0000","last_unstale":"2023-10-06T02:30:07.334071+0000","last_undegraded":"2023-10-06T02:30:07.334071+0000","last_fullsized":"2023-10-06T02:30:07.334071+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:56.676109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.348653+0000","last_change":"2023-10-06T02:30:07.340988+0000","last_active":"2023-10-06T02:30:07.348653+0000","last_peered":"2023-10-06T02:30:07.348653+0000","last_clean":"2023-10-06T02:30:07.348653+0000","last_became_active":"2023-10-06T02:30:07.340688+0000","last_became_peered":"2023-10-06T02:30:07.340688+0000","last_unstale":"2023-10-06T02:30:07.348653+0000","last_undegraded":"2023-10-06T02:30:07.348653+0000","last_fullsized":"2023-10-06T02:30:07.348653+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:43.362387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.333709+0000","last_change":"2023-10-06T02:30:06.321110+0000","last_active":"2023-10-06T02:30:07.333709+0000","last_peered":"2023-10-06T02:30:07.333709+0000","last_clean":"2023-10-06T02:30:07.333709+0000","last_became_active":"2023-10-06T02:30:06.320817+0000","last_became_peered":"2023-10-06T02:30:06.320817+0000","last_unstale":"2023-10-06T02:30:07.333709+0000","last_undegraded":"2023-10-06T02:30:07.333709+0000","last_fullsized":"2023-10-06T02:30:07.333709+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:41.169626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.348326+0000","last_change":"2023-10-06T02:30:07.340511+0000","last_active":"2023-10-06T02:30:07.348326+0000","last_peered":"2023-10-06T02:30:07.348326+0000","last_clean":"2023-10-06T02:30:07.348326+0000","last_became_active":"2023-10-06T02:30:07.340244+0000","last_became_peered":"2023-10-06T02:30:07.340244+0000","last_unstale":"2023-10-06T02:30:07.348326+0000","last_undegraded":"2023-10-06T02:30:07.348326+0000","last_fullsized":"2023-10-06T02:30:07.348326+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:55.749868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.330338+0000","last_change":"2023-10-06T02:30:06.315604+0000","last_active":"2023-10-06T02:30:07.330338+0000","last_peered":"2023-10-06T02:30:07.330338+0000","last_clean":"2023-10-06T02:30:07.330338+0000","last_became_active":"2023-10-06T02:30:06.315302+0000","last_became_peered":"2023-10-06T02:30:06.315302+0000","last_unstale":"2023-10-06T02:30:07.330338+0000","last_undegraded":"2023-10-06T02:30:07.330338+0000","last_fullsized":"2023-10-06T02:30:07.330338+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:17.386555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.346587+0000","last_change":"2023-10-06T02:30:07.339811+0000","last_active":"2023-10-06T02:30:07.346587+0000","last_peered":"2023-10-06T02:30:07.346587+0000","last_clean":"2023-10-06T02:30:07.346587+0000","last_became_active":"2023-10-06T02:30:07.338909+0000","last_became_peered":"2023-10-06T02:30:07.338909+0000","last_unstale":"2023-10-06T02:30:07.346587+0000","last_undegraded":"2023-10-06T02:30:07.346587+0000","last_fullsized":"2023-10-06T02:30:07.346587+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:48:42.879473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.328292+0000","last_change":"2023-10-06T02:30:06.311109+0000","last_active":"2023-10-06T02:30:07.328292+0000","last_peered":"2023-10-06T02:30:07.328292+0000","last_clean":"2023-10-06T02:30:07.328292+0000","last_became_active":"2023-10-06T02:30:06.310837+0000","last_became_peered":"2023-10-06T02:30:06.310837+0000","last_unstale":"2023-10-06T02:30:07.328292+0000","last_undegraded":"2023-10-06T02:30:07.328292+0000","last_fullsized":"2023-10-06T02:30:07.328292+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:22.403434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.349046+0000","last_change":"2023-10-06T02:30:07.340183+0000","last_active":"2023-10-06T02:30:07.349046+0000","last_peered":"2023-10-06T02:30:07.349046+0000","last_clean":"2023-10-06T02:30:07.349046+0000","last_became_active":"2023-10-06T02:30:07.339889+0000","last_became_peered":"2023-10-06T02:30:07.339889+0000","last_unstale":"2023-10-06T02:30:07.349046+0000","last_undegraded":"2023-10-06T02:30:07.349046+0000","last_fullsized":"2023-10-06T02:30:07.349046+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:25.288649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.329018+0000","last_change":"2023-10-06T02:30:06.316355+0000","last_active":"2023-10-06T02:30:07.329018+0000","last_peered":"2023-10-06T02:30:07.329018+0000","last_clean":"2023-10-06T02:30:07.329018+0000","last_became_active":"2023-10-06T02:30:06.316084+0000","last_became_peered":"2023-10-06T02:30:06.316084+0000","last_unstale":"2023-10-06T02:30:07.329018+0000","last_undegraded":"2023-10-06T02:30:07.329018+0000","last_fullsized":"2023-10-06T02:30:07.329018+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:12.168442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353843+0000","last_change":"2023-10-06T02:30:07.347442+0000","last_active":"2023-10-06T02:30:07.353843+0000","last_peered":"2023-10-06T02:30:07.353843+0000","last_clean":"2023-10-06T02:30:07.353843+0000","last_became_active":"2023-10-06T02:30:07.347157+0000","last_became_peered":"2023-10-06T02:30:07.347157+0000","last_unstale":"2023-10-06T02:30:07.353843+0000","last_undegraded":"2023-10-06T02:30:07.353843+0000","last_fullsized":"2023-10-06T02:30:07.353843+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:44.951632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"145'6","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.365337+0000","last_change":"2023-10-06T02:30:06.323791+0000","last_active":"2023-10-06T02:30:07.365337+0000","last_peered":"2023-10-06T02:30:07.365337+0000","last_clean":"2023-10-06T02:30:07.365337+0000","last_became_active":"2023-10-06T02:30:06.323243+0000","last_became_peered":"2023-10-06T02:30:06.323243+0000","last_unstale":"2023-10-06T02:30:07.365337+0000","last_undegraded":"2023-10-06T02:30:07.365337+0000","last_fullsized":"2023-10-06T02:30:07.365337+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:14.984382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":128,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.330267+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:30:07.330267+0000","last_peered":"2023-10-06T02:30:07.330267+0000","last_clean":"2023-10-06T02:30:07.330267+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:30:07.330267+0000","last_undegraded":"2023-10-06T02:30:07.330267+0000","last_fullsized":"2023-10-06T02:30:07.330267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.357115+0000","last_change":"2023-10-06T02:30:07.350189+0000","last_active":"2023-10-06T02:30:07.357115+0000","last_peered":"2023-10-06T02:30:07.357115+0000","last_clean":"2023-10-06T02:30:07.357115+0000","last_became_active":"2023-10-06T02:30:07.349858+0000","last_became_peered":"2023-10-06T02:30:07.349858+0000","last_unstale":"2023-10-06T02:30:07.357115+0000","last_undegraded":"2023-10-06T02:30:07.357115+0000","last_fullsized":"2023-10-06T02:30:07.357115+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:04.668370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"145'3","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.360765+0000","last_change":"2023-10-06T02:30:06.316658+0000","last_active":"2023-10-06T02:30:07.360765+0000","last_peered":"2023-10-06T02:30:07.360765+0000","last_clean":"2023-10-06T02:30:07.360765+0000","last_became_active":"2023-10-06T02:30:06.316370+0000","last_became_peered":"2023-10-06T02:30:06.316370+0000","last_unstale":"2023-10-06T02:30:07.360765+0000","last_undegraded":"2023-10-06T02:30:07.360765+0000","last_fullsized":"2023-10-06T02:30:07.360765+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:42.358256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":130,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.334238+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:30:07.334238+0000","last_peered":"2023-10-06T02:30:07.334238+0000","last_clean":"2023-10-06T02:30:07.334238+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:30:07.334238+0000","last_undegraded":"2023-10-06T02:30:07.334238+0000","last_fullsized":"2023-10-06T02:30:07.334238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.355609+0000","last_change":"2023-10-06T02:30:07.349432+0000","last_active":"2023-10-06T02:30:07.355609+0000","last_peered":"2023-10-06T02:30:07.355609+0000","last_clean":"2023-10-06T02:30:07.355609+0000","last_became_active":"2023-10-06T02:30:07.349141+0000","last_became_peered":"2023-10-06T02:30:07.349141+0000","last_unstale":"2023-10-06T02:30:07.355609+0000","last_undegraded":"2023-10-06T02:30:07.355609+0000","last_fullsized":"2023-10-06T02:30:07.355609+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:42.909162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.338102+0000","last_change":"2023-10-06T02:30:06.325263+0000","last_active":"2023-10-06T02:30:07.338102+0000","last_peered":"2023-10-06T02:30:07.338102+0000","last_clean":"2023-10-06T02:30:07.338102+0000","last_became_active":"2023-10-06T02:30:06.325058+0000","last_became_peered":"2023-10-06T02:30:06.325058+0000","last_unstale":"2023-10-06T02:30:07.338102+0000","last_undegraded":"2023-10-06T02:30:07.338102+0000","last_fullsized":"2023-10-06T02:30:07.338102+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:27.263168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":130,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.324302+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:30:07.324302+0000","last_peered":"2023-10-06T02:30:07.324302+0000","last_clean":"2023-10-06T02:30:07.324302+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:30:07.324302+0000","last_undegraded":"2023-10-06T02:30:07.324302+0000","last_fullsized":"2023-10-06T02:30:07.324302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":277,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.328054+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:30:07.328054+0000","last_peered":"2023-10-06T02:30:07.328054+0000","last_clean":"2023-10-06T02:30:07.328054+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:30:07.328054+0000","last_undegraded":"2023-10-06T02:30:07.328054+0000","last_fullsized":"2023-10-06T02:30:07.328054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353177+0000","last_change":"2023-10-06T02:30:07.341531+0000","last_active":"2023-10-06T02:30:07.353177+0000","last_peered":"2023-10-06T02:30:07.353177+0000","last_clean":"2023-10-06T02:30:07.353177+0000","last_became_active":"2023-10-06T02:30:07.341215+0000","last_became_peered":"2023-10-06T02:30:07.341215+0000","last_unstale":"2023-10-06T02:30:07.353177+0000","last_undegraded":"2023-10-06T02:30:07.353177+0000","last_fullsized":"2023-10-06T02:30:07.353177+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:18.726171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.358829+0000","last_change":"2023-10-06T02:30:06.319538+0000","last_active":"2023-10-06T02:30:07.358829+0000","last_peered":"2023-10-06T02:30:07.358829+0000","last_clean":"2023-10-06T02:30:07.358829+0000","last_became_active":"2023-10-06T02:30:06.319199+0000","last_became_peered":"2023-10-06T02:30:06.319199+0000","last_unstale":"2023-10-06T02:30:07.358829+0000","last_undegraded":"2023-10-06T02:30:07.358829+0000","last_fullsized":"2023-10-06T02:30:07.358829+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:46.037331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":127,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.330713+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:30:07.330713+0000","last_peered":"2023-10-06T02:30:07.330713+0000","last_clean":"2023-10-06T02:30:07.330713+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:30:07.330713+0000","last_undegraded":"2023-10-06T02:30:07.330713+0000","last_fullsized":"2023-10-06T02:30:07.330713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.356893+0000","last_change":"2023-10-06T02:30:07.349549+0000","last_active":"2023-10-06T02:30:07.356893+0000","last_peered":"2023-10-06T02:30:07.356893+0000","last_clean":"2023-10-06T02:30:07.356893+0000","last_became_active":"2023-10-06T02:30:07.348960+0000","last_became_peered":"2023-10-06T02:30:07.348960+0000","last_unstale":"2023-10-06T02:30:07.356893+0000","last_undegraded":"2023-10-06T02:30:07.356893+0000","last_fullsized":"2023-10-06T02:30:07.356893+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:15.311278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.334511+0000","last_change":"2023-10-06T02:30:06.322756+0000","last_active":"2023-10-06T02:30:07.334511+0000","last_peered":"2023-10-06T02:30:07.334511+0000","last_clean":"2023-10-06T02:30:07.334511+0000","last_became_active":"2023-10-06T02:30:06.322451+0000","last_became_peered":"2023-10-06T02:30:06.322451+0000","last_unstale":"2023-10-06T02:30:07.334511+0000","last_undegraded":"2023-10-06T02:30:07.334511+0000","last_fullsized":"2023-10-06T02:30:07.334511+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:38.249821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":127,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.328151+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:30:07.328151+0000","last_peered":"2023-10-06T02:30:07.328151+0000","last_clean":"2023-10-06T02:30:07.328151+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:30:07.328151+0000","last_undegraded":"2023-10-06T02:30:07.328151+0000","last_fullsized":"2023-10-06T02:30:07.328151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.355501+0000","last_change":"2023-10-06T02:30:07.347685+0000","last_active":"2023-10-06T02:30:07.355501+0000","last_peered":"2023-10-06T02:30:07.355501+0000","last_clean":"2023-10-06T02:30:07.355501+0000","last_became_active":"2023-10-06T02:30:07.347387+0000","last_became_peered":"2023-10-06T02:30:07.347387+0000","last_unstale":"2023-10-06T02:30:07.355501+0000","last_undegraded":"2023-10-06T02:30:07.355501+0000","last_fullsized":"2023-10-06T02:30:07.355501+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:55.343618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"145'8","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.356162+0000","last_change":"2023-10-06T02:30:06.322812+0000","last_active":"2023-10-06T02:30:07.356162+0000","last_peered":"2023-10-06T02:30:07.356162+0000","last_clean":"2023-10-06T02:30:07.356162+0000","last_became_active":"2023-10-06T02:30:06.322535+0000","last_became_peered":"2023-10-06T02:30:06.322535+0000","last_unstale":"2023-10-06T02:30:07.356162+0000","last_undegraded":"2023-10-06T02:30:07.356162+0000","last_fullsized":"2023-10-06T02:30:07.356162+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:59.044474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":126,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.334594+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:30:07.334594+0000","last_peered":"2023-10-06T02:30:07.334594+0000","last_clean":"2023-10-06T02:30:07.334594+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:30:07.334594+0000","last_undegraded":"2023-10-06T02:30:07.334594+0000","last_fullsized":"2023-10-06T02:30:07.334594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.351585+0000","last_change":"2023-10-06T02:30:07.344116+0000","last_active":"2023-10-06T02:30:07.351585+0000","last_peered":"2023-10-06T02:30:07.351585+0000","last_clean":"2023-10-06T02:30:07.351585+0000","last_became_active":"2023-10-06T02:30:07.343821+0000","last_became_peered":"2023-10-06T02:30:07.343821+0000","last_unstale":"2023-10-06T02:30:07.351585+0000","last_undegraded":"2023-10-06T02:30:07.351585+0000","last_fullsized":"2023-10-06T02:30:07.351585+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:31:14.689860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.328564+0000","last_change":"2023-10-06T02:30:06.315567+0000","last_active":"2023-10-06T02:30:07.328564+0000","last_peered":"2023-10-06T02:30:07.328564+0000","last_clean":"2023-10-06T02:30:07.328564+0000","last_became_active":"2023-10-06T02:30:06.315261+0000","last_became_peered":"2023-10-06T02:30:06.315261+0000","last_unstale":"2023-10-06T02:30:07.328564+0000","last_undegraded":"2023-10-06T02:30:07.328564+0000","last_fullsized":"2023-10-06T02:30:07.328564+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:47.633970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":125,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.338598+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:30:07.338598+0000","last_peered":"2023-10-06T02:30:07.338598+0000","last_clean":"2023-10-06T02:30:07.338598+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:30:07.338598+0000","last_undegraded":"2023-10-06T02:30:07.338598+0000","last_fullsized":"2023-10-06T02:30:07.338598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.353913+0000","last_change":"2023-10-06T02:30:07.350797+0000","last_active":"2023-10-06T02:30:07.353913+0000","last_peered":"2023-10-06T02:30:07.353913+0000","last_clean":"2023-10-06T02:30:07.353913+0000","last_became_active":"2023-10-06T02:30:07.350522+0000","last_became_peered":"2023-10-06T02:30:07.350522+0000","last_unstale":"2023-10-06T02:30:07.353913+0000","last_undegraded":"2023-10-06T02:30:07.353913+0000","last_fullsized":"2023-10-06T02:30:07.353913+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:06.298531+0000","last_clean_scrub_stamp":"2023-10-06T02:30:06.298531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:04.728949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.331078+0000","last_change":"2023-10-06T02:30:06.319899+0000","last_active":"2023-10-06T02:30:07.331078+0000","last_peered":"2023-10-06T02:30:07.331078+0000","last_clean":"2023-10-06T02:30:07.331078+0000","last_became_active":"2023-10-06T02:30:06.319504+0000","last_became_peered":"2023-10-06T02:30:06.319504+0000","last_unstale":"2023-10-06T02:30:07.331078+0000","last_undegraded":"2023-10-06T02:30:07.331078+0000","last_fullsized":"2023-10-06T02:30:07.331078+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:05.294400+0000","last_clean_scrub_stamp":"2023-10-06T02:30:05.294400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:11.948877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":125,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-06T02:30:07.347186+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:30:07.347186+0000","last_peered":"2023-10-06T02:30:07.347186+0000","last_clean":"2023-10-06T02:30:07.347186+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:30:07.347186+0000","last_undegraded":"2023-10-06T02:30:07.347186+0000","last_fullsized":"2023-10-06T02:30:07.347186+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575002,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307932,"kb_used_data":2452,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063908,"statfs":{"total":96636764160,"available":96321441792,"internally_reserved":0,"allocated":2510848,"data_stored":1586317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.79700000000000004,"15min":1.111},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71099999999999997,"5min":0.77900000000000003,"15min":0.97899999999999998},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":1.008},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.629,"5min":0.72599999999999998,"15min":1.075},"last":0.33600000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.76000000000000001,"5min":0.80200000000000005,"15min":1.149},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":0.96999999999999997,"15min":1.048},"last":0.50900000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69899999999999995,"5min":0.84399999999999997,"15min":1.175},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73599999999999999,"5min":0.91000000000000003,"15min":1.03},"last":0.41099999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.48199999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63900000000000001,"5min":0.79400000000000004,"15min":0.873},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80800000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.78600000000000003,"5min":0.81299999999999994,"15min":0.81899999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.76000000000000001,"15min":0.84899999999999998},"last":0.49199999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72699999999999998,"5min":0.79300000000000004,"15min":0.91700000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.38900000000000001,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.55900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575003,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303248,"kb_used_data":1864,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068592,"statfs":{"total":96636764160,"available":96326238208,"internally_reserved":0,"allocated":1908736,"data_stored":994478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53400000000000003,"15min":0.64000000000000001},"min":{"1min":0.30299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.68899999999999995,"5min":0.79000000000000004,"15min":5.6929999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56100000000000005,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.29799999999999999},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":5.7060000000000004},"last":0.441}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53200000000000003,"15min":0.54100000000000004},"min":{"1min":0.32300000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67100000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53100000000000003,"15min":0.69999999999999996},"min":{"1min":0.372,"5min":0.318,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":0.872,"15min":8.8659999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":0.77500000000000002,"15min":0.80800000000000005},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55500000000000005,"15min":0.75},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":10.659000000000001},"last":0.622},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.76800000000000002,"15min":0.85499999999999998},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47499999999999998,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.27400000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.79600000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67700000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.49099999999999999,"15min":0.51600000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71099999999999997,"5min":0.751,"15min":0.84399999999999997},"last":0.52600000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.312},"max":{"1min":0.68300000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73899999999999999,"5min":0.86799999999999999,"15min":0.88100000000000001},"last":0.68300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575002,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307928,"kb_used_data":2448,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063912,"statfs":{"total":96636764160,"available":96321445888,"internally_reserved":0,"allocated":2506752,"data_stored":1584900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.36899999999999999,"15min":0.36499999999999999},"min":{"1min":0.25600000000000001,"5min":0.20799999999999999,"15min":0.19},"max":{"1min":0.59699999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.38200000000000001},"min":{"1min":0.316,"5min":0.27100000000000002,"15min":0.26100000000000001},"max":{"1min":0.56499999999999995,"5min":0.754,"15min":0.754},"last":0.38800000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.33900000000000002,"15min":0.33800000000000002},"min":{"1min":0.26900000000000002,"5min":0.223,"15min":0.22},"max":{"1min":0.56699999999999995,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.39300000000000002,"15min":0.39500000000000002},"min":{"1min":0.29399999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52400000000000002,"5min":0.64300000000000002,"15min":0.65300000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.31,"5min":0.28100000000000003,"15min":0.253},"max":{"1min":0.621,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.59799999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.432}]},{"osd":4,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86899999999999999,"5min":0.998,"15min":0.998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.378,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56899999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.625,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.37},"max":{"1min":0.90100000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.46300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92100000000000004,"5min":0.93799999999999994,"15min":0.95499999999999996},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.36499999999999999},"max":{"1min":0.75,"5min":0.94499999999999995,"15min":1.0009999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.45500000000000002,"5min":0.41599999999999998,"15min":0.41099999999999998},"max":{"1min":0.90600000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.52000000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.378},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.94199999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.61899999999999999,"15min":0.62},"min":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.42499999999999999},"max":{"1min":0.84999999999999998,"5min":0.92000000000000004,"15min":0.98199999999999998},"last":0.59199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575002,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307364,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064476,"statfs":{"total":96636764160,"available":96322023424,"internally_reserved":0,"allocated":1929216,"data_stored":997009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34599999999999997,"15min":0.33500000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.183},"max":{"1min":0.56899999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.374},"min":{"1min":0.223,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.66500000000000004,"5min":0.876,"15min":0.876},"last":0.34699999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.39400000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.20599999999999999},"max":{"1min":0.56399999999999995,"5min":0.65600000000000003,"15min":0.745},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.372,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.22600000000000001,"15min":0.215},"max":{"1min":0.63600000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52000000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.438,"15min":0.434},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.24399999999999999},"max":{"1min":0.629,"5min":0.71599999999999997,"15min":0.78000000000000003},"last":0.379}]},{"osd":4,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.371},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.369},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.99399999999999999},"last":0.59199999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.32300000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.3320000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.622},"min":{"1min":0.44,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.84899999999999998,"5min":0.88700000000000001,"15min":1.0780000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63700000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.91200000000000003,"15min":1.3999999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.45500000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.0469999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.78000000000000003},"min":{"1min":0.46200000000000002,"5min":0.41699999999999998,"15min":0.39400000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":11.138},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.46600000000000003,"5min":0.432,"15min":0.41599999999999998},"max":{"1min":0.86599999999999999,"5min":1.024,"15min":1.429},"last":0.73299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575002,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307340,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064500,"statfs":{"total":96636764160,"available":96322048000,"internally_reserved":0,"allocated":1904640,"data_stored":994408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34699999999999998,"15min":0.36199999999999999},"min":{"1min":0.218,"5min":0.182,"15min":0.182},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.80300000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.38800000000000001},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.58199999999999996,"5min":0.68000000000000005,"15min":0.98999999999999999},"last":0.26300000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.375,"15min":0.39200000000000002},"min":{"1min":0.25700000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":3.1230000000000002},"last":0.44},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":3.0129999999999999},"last":0.374}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.375,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.23499999999999999},"max":{"1min":0.56899999999999995,"5min":0.59299999999999997,"15min":1.423},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.33500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.77400000000000002},"last":0.34999999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.498},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.443,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.47199999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.41799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.304},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.439,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.45100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0980000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.41799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96499999999999997,"5min":0.97999999999999998,"15min":1.347},"last":0.40899999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64900000000000002,"15min":0.66200000000000003},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.206},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63800000000000001,"15min":0.66500000000000004},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.385},"last":0.51200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575002,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":996967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47299999999999998,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.317},{"interface":"front","average":{"1min":0.377,"5min":0.375,"15min":0.38200000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.78100000000000003},"last":0.27200000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.24099999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.66700000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.40300000000000002},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59599999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.36299999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54500000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.246},"max":{"1min":0.57399999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.375}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.0049999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.83899999999999997,"5min":0.92700000000000005,"15min":1.1539999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.37,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84899999999999998,"5min":0.95399999999999996,"15min":1.2110000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.874,"5min":0.89600000000000002,"15min":1.0429999999999999},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81999999999999995,"5min":0.90800000000000003,"15min":1.0700000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.47699999999999998,"5min":0.39500000000000002,"15min":0.38600000000000001},"max":{"1min":0.85999999999999999,"5min":0.98499999999999999,"15min":1.391},"last":0.61399999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.48299999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80300000000000005,"5min":0.94099999999999995,"15min":1.121},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.63700000000000001,"15min":0.63400000000000001},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88800000000000001,"5min":0.89900000000000002,"15min":0.95099999999999996},"last":0.57699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311440,"kb_used_data":1864,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060400,"statfs":{"total":96636764160,"available":96317849600,"internally_reserved":0,"allocated":1908736,"data_stored":995361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.252,"5min":0.252,"15min":0.217},"max":{"1min":0.71799999999999997,"5min":0.78900000000000003,"15min":0.86399999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.88900000000000001,"15min":1.7290000000000001},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.77300000000000002},"min":{"1min":0.41599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.71999999999999997,"5min":0.749,"15min":17.879999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.76300000000000001},"min":{"1min":0.377,"5min":0.33100000000000002,"15min":0.32700000000000001},"max":{"1min":0.69899999999999995,"5min":0.76500000000000001,"15min":18.010999999999999},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.55100000000000005},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.309},"max":{"1min":0.73299999999999998,"5min":0.84699999999999998,"15min":1.619},"last":0.38},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.42599999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":1.6639999999999999},"last":0.39400000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.29899999999999999},"max":{"1min":0.76200000000000001,"5min":0.76500000000000001,"15min":1.2729999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44500000000000001,"5min":0.32700000000000001,"15min":0.32200000000000001},"max":{"1min":0.80000000000000004,"5min":0.81999999999999995,"15min":0.84899999999999998},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48999999999999999,"15min":0.51200000000000001},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69799999999999995,"5min":0.78900000000000003,"15min":1.532},"last":0.503},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.80700000000000005},"last":0.31900000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.501,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.64300000000000002,"5min":0.90400000000000003,"15min":1.5700000000000001},"last":0.436},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76000000000000001,"5min":0.84099999999999997,"15min":1.4319999999999999},"last":0.35099999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.40400000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73899999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72999999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.53900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575001,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303256,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068584,"statfs":{"total":96636764160,"available":96326230016,"internally_reserved":0,"allocated":1916928,"data_stored":995937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.34599999999999997,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.78800000000000003,"5min":1.034,"15min":1.103},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.312},"max":{"1min":0.81799999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.29699999999999999},"max":{"1min":0.91400000000000003,"5min":1.02,"15min":1.1679999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.33900000000000002},"max":{"1min":0.89200000000000002,"5min":0.99399999999999999,"15min":1.0620000000000001},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.30399999999999999},"max":{"1min":0.74299999999999999,"5min":1.1870000000000001,"15min":1.2070000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":1.1140000000000001},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.84299999999999997,"15min":1.1799999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78900000000000003,"5min":1.1040000000000001,"15min":1.1830000000000001},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72399999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.50900000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26500000000000001},"max":{"1min":0.72199999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.29699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79700000000000004,"5min":0.872,"15min":0.872},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.65200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:30:16.400 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:30:16.400 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:30:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.559+0000 7f5cb0b1b700 1 Processor -- start 2023-10-06T02:30:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.559+0000 7f5cb0b1b700 1 -- start start 2023-10-06T02:30:16.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5cb0b1b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5cac0b2820 0x7f5cac0b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5cb0b1b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5cac158e70 0x7f5cac1592b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5cb0b1b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cac069120 con 0x7f5cac0b2450 2023-10-06T02:30:16.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5cb0b1b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cac0cb120 con 0x7f5cac158e70 2023-10-06T02:30:16.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5cb0b1b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cac15de80 con 0x7f5cac0b2820 2023-10-06T02:30:16.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5caad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5cac158e70 0x7f5cac1592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5caad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5cac158e70 0x7f5cac1592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40348/0 (socket says 172.21.15.6:40348) 2023-10-06T02:30:16.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5caad9d700 1 -- 172.21.15.6:0/2760988551 learned_addr learned my addr 172.21.15.6:0/2760988551 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:16.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5caa59c700 1 --1- 172.21.15.6:0/2760988551 >> v1:172.21.15.6:6789/0 conn(0x7f5cac0b2450 0x7f5cac068680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56336/0 (socket says 172.21.15.6:56336) 2023-10-06T02:30:16.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5ca9d9b700 1 --2- 172.21.15.6:0/2760988551 >> v2:172.21.15.175:3300/0 conn(0x7f5cac0b2820 0x7f5cac0b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5caad9d700 1 -- 172.21.15.6:0/2760988551 >> v2:172.21.15.175:3300/0 conn(0x7f5cac0b2820 msgr2=0x7f5cac0b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:16.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5caad9d700 1 --2- 172.21.15.6:0/2760988551 >> v2:172.21.15.175:3300/0 conn(0x7f5cac0b2820 0x7f5cac0b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5caad9d700 1 -- 172.21.15.6:0/2760988551 >> v1:172.21.15.6:6789/0 conn(0x7f5cac0b2450 legacy=0x7f5cac068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:16.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5caad9d700 1 -- 172.21.15.6:0/2760988551 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac0cb3c0 con 0x7f5cac158e70 2023-10-06T02:30:16.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5ca959a700 1 -- 172.21.15.6:0/2760988551 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162311302 0 0) 0x7f5cac069120 con 0x7f5cac0b2450 2023-10-06T02:30:16.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5caad9d700 1 --2- 172.21.15.6:0/2760988551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cac158e70 0x7f5cac1592b0 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0c72d0 tx=0x7f5ca4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ffff7fcfc07066 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:16.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5ca959a700 1 -- 172.21.15.6:0/2760988551 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca400e070 con 0x7f5cac158e70 2023-10-06T02:30:16.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5ca959a700 1 -- 172.21.15.6:0/2760988551 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca400ba20 con 0x7f5cac158e70 2023-10-06T02:30:16.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.560+0000 7f5ca959a700 1 -- 172.21.15.6:0/2760988551 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca40092e0 con 0x7f5cac158e70 2023-10-06T02:30:16.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.561+0000 7f5cb0b1b700 1 -- 172.21.15.6:0/2760988551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cac158e70 msgr2=0x7f5cac1592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.561+0000 7f5cb0b1b700 1 --2- 172.21.15.6:0/2760988551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cac158e70 0x7f5cac1592b0 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0c72d0 tx=0x7f5ca4009840 comp rx=0 tx=0).stop 2023-10-06T02:30:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.561+0000 7f5cb0b1b700 1 -- 172.21.15.6:0/2760988551 shutdown_connections 2023-10-06T02:30:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.561+0000 7f5cb0b1b700 1 --2- 172.21.15.6:0/2760988551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cac158e70 0x7f5cac1592b0 unknown :-1 s=CLOSED pgs=2418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.561+0000 7f5cb0b1b700 1 --2- 172.21.15.6:0/2760988551 >> v2:172.21.15.175:3300/0 conn(0x7f5cac0b2820 0x7f5cac0b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.561+0000 7f5cb0b1b700 1 -- 172.21.15.6:0/2760988551 >> 172.21.15.6:0/2760988551 conn(0x7f5cac0d0310 msgr2=0x7f5cac0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.561+0000 7f5cb0b1b700 1 -- 172.21.15.6:0/2760988551 shutdown_connections 2023-10-06T02:30:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.561+0000 7f5cb0b1b700 1 -- 172.21.15.6:0/2760988551 wait complete. 2023-10-06T02:30:16.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.562+0000 7f5cb0b1b700 1 Processor -- start 2023-10-06T02:30:16.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.562+0000 7f5cb0b1b700 1 -- start start 2023-10-06T02:30:16.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.563+0000 7f5cb0b1b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cac0b2450 0x7f5cac0ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.563+0000 7f5cb0b1b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cac0b2820 0x7f5cac153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.563+0000 7f5cb0b1b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5cac158e70 0x7f5cac0ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.563+0000 7f5cb0b1b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0ca810 con 0x7f5cac0b2450 2023-10-06T02:30:16.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.563+0000 7f5cb0b1b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac1550c0 con 0x7f5cac0b2820 2023-10-06T02:30:16.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.563+0000 7f5cb0b1b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac1531d0 con 0x7f5cac158e70 2023-10-06T02:30:16.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.563+0000 7f5caa59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cac0b2450 0x7f5cac0ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.563+0000 7f5caa59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cac0b2450 0x7f5cac0ca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40362/0 (socket says 172.21.15.6:40362) 2023-10-06T02:30:16.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.563+0000 7f5caa59c700 1 -- 172.21.15.6:0/689499231 learned_addr learned my addr 172.21.15.6:0/689499231 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:16.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.563+0000 7f5caad9d700 1 --2- 172.21.15.6:0/689499231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5cac158e70 0x7f5cac0ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.563+0000 7f5ca9d9b700 1 --2- 172.21.15.6:0/689499231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cac0b2820 0x7f5cac153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.563+0000 7f5caa59c700 1 -- 172.21.15.6:0/689499231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5cac158e70 msgr2=0x7f5cac0ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:16.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.563+0000 7f5caa59c700 1 --2- 172.21.15.6:0/689499231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5cac158e70 0x7f5cac0ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.563+0000 7f5caa59c700 1 -- 172.21.15.6:0/689499231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cac0b2820 msgr2=0x7f5cac153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:16.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.563+0000 7f5caa59c700 1 --2- 172.21.15.6:0/689499231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cac0b2820 0x7f5cac153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.563+0000 7f5caa59c700 1 -- 172.21.15.6:0/689499231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca4009ae0 con 0x7f5cac0b2450 2023-10-06T02:30:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.564+0000 7f5caa59c700 1 --2- 172.21.15.6:0/689499231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cac0b2450 0x7f5cac0ca2d0 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c0011e0 tx=0x7f5c9c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.564+0000 7f5c9a7fc700 1 -- 172.21.15.6:0/689499231 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c005a70 con 0x7f5cac0b2450 2023-10-06T02:30:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.564+0000 7f5c9a7fc700 1 -- 172.21.15.6:0/689499231 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c005bd0 con 0x7f5cac0b2450 2023-10-06T02:30:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.564+0000 7f5cb0b1b700 1 -- 172.21.15.6:0/689499231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cac16a5f0 con 0x7f5cac0b2450 2023-10-06T02:30:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.564+0000 7f5c9a7fc700 1 -- 172.21.15.6:0/689499231 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0070d0 con 0x7f5cac0b2450 2023-10-06T02:30:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.564+0000 7f5cb0b1b700 1 -- 172.21.15.6:0/689499231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cac153750 con 0x7f5cac0b2450 2023-10-06T02:30:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.565+0000 7f5cb0b1b700 1 -- 172.21.15.6:0/689499231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cac153970 con 0x7f5cac0b2450 2023-10-06T02:30:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.565+0000 7f5c9a7fc700 1 -- 172.21.15.6:0/689499231 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c9c007480 con 0x7f5cac0b2450 2023-10-06T02:30:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.566+0000 7f5c9a7fc700 1 --2- 172.21.15.6:0/689499231 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c8c066f30 0x7f5c8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.566+0000 7f5c9a7fc700 1 -- 172.21.15.6:0/689499231 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5c9c083c20 con 0x7f5cac0b2450 2023-10-06T02:30:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.566+0000 7f5ca9d9b700 1 --2- 172.21.15.6:0/689499231 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c8c066f30 0x7f5c8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.566+0000 7f5ca9d9b700 1 --2- 172.21.15.6:0/689499231 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c8c066f30 0x7f5c8c0693e0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0b11c0 tx=0x7f5ca0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:16.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.570+0000 7f5c9a7fc700 1 -- 172.21.15.6:0/689499231 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c9c04b5a0 con 0x7f5cac0b2450 2023-10-06T02:30:16.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.843+0000 7f5cb0b1b700 1 -- 172.21.15.6:0/689499231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5cac0cb6a0 con 0x7f5cac0b2450 2023-10-06T02:30:16.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.846+0000 7f5c9a7fc700 1 -- 172.21.15.6:0/689499231 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5c9c017070 con 0x7f5cac0b2450 2023-10-06T02:30:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.848+0000 7f5cb0b1b700 1 -- 172.21.15.6:0/689499231 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c8c066f30 msgr2=0x7f5c8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.848+0000 7f5cb0b1b700 1 --2- 172.21.15.6:0/689499231 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c8c066f30 0x7f5c8c0693e0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0b11c0 tx=0x7f5ca0008040 comp rx=0 tx=0).stop 2023-10-06T02:30:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.848+0000 7f5cb0b1b700 1 -- 172.21.15.6:0/689499231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cac0b2450 msgr2=0x7f5cac0ca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.848+0000 7f5cb0b1b700 1 --2- 172.21.15.6:0/689499231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cac0b2450 0x7f5cac0ca2d0 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c0011e0 tx=0x7f5c9c007e10 comp rx=0 tx=0).stop 2023-10-06T02:30:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.848+0000 7f5cb0b1b700 1 -- 172.21.15.6:0/689499231 shutdown_connections 2023-10-06T02:30:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.848+0000 7f5cb0b1b700 1 --2- 172.21.15.6:0/689499231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5cac158e70 0x7f5cac0ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.848+0000 7f5cb0b1b700 1 --2- 172.21.15.6:0/689499231 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5c8c066f30 0x7f5c8c0693e0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.848+0000 7f5cb0b1b700 1 --2- 172.21.15.6:0/689499231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cac0b2450 0x7f5cac0ca2d0 unknown :-1 s=CLOSED pgs=2419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.848+0000 7f5cb0b1b700 1 --2- 172.21.15.6:0/689499231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cac0b2820 0x7f5cac153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.848+0000 7f5cb0b1b700 1 -- 172.21.15.6:0/689499231 >> 172.21.15.6:0/689499231 conn(0x7f5cac0d0310 msgr2=0x7f5cac151830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.848+0000 7f5cb0b1b700 1 -- 172.21.15.6:0/689499231 shutdown_connections 2023-10-06T02:30:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.848+0000 7f5cb0b1b700 1 -- 172.21.15.6:0/689499231 wait complete. 2023-10-06T02:30:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-10-06T02:30:16.862 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:30:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.980+0000 7f0a49a70700 1 Processor -- start 2023-10-06T02:30:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.980+0000 7f0a49a70700 1 -- start start 2023-10-06T02:30:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.980+0000 7f0a49a70700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a440b27f0 0x7f0a4415db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.980+0000 7f0a49a70700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a4415e190 con 0x7f0a440af8b0 2023-10-06T02:30:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.980+0000 7f0a49a70700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a440cb650 con 0x7f0a440af4e0 2023-10-06T02:30:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.980+0000 7f0a49a70700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a440b1910 con 0x7f0a440b27f0 2023-10-06T02:30:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.980+0000 7f0a42ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0a440af8b0 0x7f0a4415d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56340/0 (socket says 172.21.15.6:56340) 2023-10-06T02:30:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.980+0000 7f0a42ffd700 1 -- 172.21.15.6:0/2709610145 learned_addr learned my addr 172.21.15.6:0/2709610145 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a43fff700 1 --2- 172.21.15.6:0/2709610145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a440b27f0 0x7f0a4415db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a427fc700 1 -- 172.21.15.6:0/2709610145 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316893974 0 0) 0x7f0a4415e190 con 0x7f0a440af8b0 2023-10-06T02:30:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a427fc700 1 -- 172.21.15.6:0/2709610145 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a2c003570 con 0x7f0a440af8b0 2023-10-06T02:30:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a427fc700 1 -- 172.21.15.6:0/2709610145 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3443412275 0 0) 0x7f0a2c003570 con 0x7f0a440af8b0 2023-10-06T02:30:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a427fc700 1 -- 172.21.15.6:0/2709610145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a440b27f0 msgr2=0x7f0a4415db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a427fc700 1 --2- 172.21.15.6:0/2709610145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a440b27f0 0x7f0a4415db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a427fc700 1 -- 172.21.15.6:0/2709610145 >> v1:172.21.15.175:6789/0 conn(0x7f0a440af4e0 legacy=0x7f0a440b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a427fc700 1 -- 172.21.15.6:0/2709610145 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a440ccaf0 con 0x7f0a440af8b0 2023-10-06T02:30:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a427fc700 1 -- 172.21.15.6:0/2709610145 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f0a38001470 con 0x7f0a440af8b0 2023-10-06T02:30:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a427fc700 1 -- 172.21.15.6:0/2709610145 >> v1:172.21.15.6:6789/0 conn(0x7f0a440af8b0 legacy=0x7f0a4415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a427fc700 1 --2- 172.21.15.6:0/2709610145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a440b27f0 0x7f0a2c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a427fc700 1 --2- 172.21.15.6:0/2709610145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a2c003fd0 0x7f0a2c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a427fc700 1 --2- 172.21.15.6:0/2709610145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a2c004d50 0x7f0a2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a427fc700 1 -- 172.21.15.6:0/2709610145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a440b1910 con 0x7f0a2c004d50 2023-10-06T02:30:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a427fc700 1 -- 172.21.15.6:0/2709610145 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c00bba0 con 0x7f0a2c003fd0 2023-10-06T02:30:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a427fc700 1 -- 172.21.15.6:0/2709610145 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c00bd60 con 0x7f0a440b27f0 2023-10-06T02:30:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a43fff700 1 --2- 172.21.15.6:0/2709610145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a2c004d50 0x7f0a2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a437fe700 1 --2- 172.21.15.6:0/2709610145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a440b27f0 0x7f0a2c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.981+0000 7f0a42ffd700 1 --2- 172.21.15.6:0/2709610145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a2c003fd0 0x7f0a2c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.982+0000 7f0a43fff700 1 -- 172.21.15.6:0/2709610145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a440b27f0 msgr2=0x7f0a2c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:16.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.982+0000 7f0a43fff700 1 --2- 172.21.15.6:0/2709610145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a440b27f0 0x7f0a2c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.982+0000 7f0a43fff700 1 -- 172.21.15.6:0/2709610145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a2c003fd0 msgr2=0x7f0a2c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:16.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.982+0000 7f0a43fff700 1 --2- 172.21.15.6:0/2709610145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a2c003fd0 0x7f0a2c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.982+0000 7f0a43fff700 1 -- 172.21.15.6:0/2709610145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c003570 con 0x7f0a2c004d50 2023-10-06T02:30:16.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.982+0000 7f0a43fff700 1 --2- 172.21.15.6:0/2709610145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a2c004d50 0x7f0a2c0051c0 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00e210 tx=0x7f0a3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63a5c17ea03abe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:16.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.982+0000 7f0a427fc700 1 -- 172.21.15.6:0/2709610145 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c00eac0 con 0x7f0a2c004d50 2023-10-06T02:30:16.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.982+0000 7f0a427fc700 1 -- 172.21.15.6:0/2709610145 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c00f040 con 0x7f0a2c004d50 2023-10-06T02:30:16.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.982+0000 7f0a427fc700 1 -- 172.21.15.6:0/2709610145 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c00ee70 con 0x7f0a2c004d50 2023-10-06T02:30:16.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.982+0000 7f0a49a70700 1 -- 172.21.15.6:0/2709610145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a2c004d50 msgr2=0x7f0a2c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.982+0000 7f0a49a70700 1 --2- 172.21.15.6:0/2709610145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a2c004d50 0x7f0a2c0051c0 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00e210 tx=0x7f0a3c00b040 comp rx=0 tx=0).stop 2023-10-06T02:30:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.982+0000 7f0a43fff700 1 -- 172.21.15.6:0/2709610145 reap_dead start 2023-10-06T02:30:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.982+0000 7f0a49a70700 1 -- 172.21.15.6:0/2709610145 shutdown_connections 2023-10-06T02:30:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.982+0000 7f0a49a70700 1 -- 172.21.15.6:0/2709610145 >> 172.21.15.6:0/2709610145 conn(0x7f0a44068680 msgr2=0x7f0a44068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.983+0000 7f0a49a70700 1 -- 172.21.15.6:0/2709610145 shutdown_connections 2023-10-06T02:30:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.983+0000 7f0a49a70700 1 -- 172.21.15.6:0/2709610145 wait complete. 2023-10-06T02:30:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.984+0000 7f0a49a70700 1 Processor -- start 2023-10-06T02:30:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.984+0000 7f0a49a70700 1 -- start start 2023-10-06T02:30:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.984+0000 7f0a49a70700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a44159870 0x7f0a4415b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.984+0000 7f0a49a70700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a44159c40 0x7f0a4415b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.984+0000 7f0a49a70700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a440d06f0 0x7f0a440d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.984+0000 7f0a49a70700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a440d1370 con 0x7f0a44159870 2023-10-06T02:30:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.984+0000 7f0a49a70700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a44169d90 con 0x7f0a44159c40 2023-10-06T02:30:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.984+0000 7f0a49a70700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4416a8d0 con 0x7f0a440d06f0 2023-10-06T02:30:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.985+0000 7f0a437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a44159870 0x7f0a4415b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.985+0000 7f0a437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a44159870 0x7f0a4415b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40384/0 (socket says 172.21.15.6:40384) 2023-10-06T02:30:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.985+0000 7f0a437fe700 1 -- 172.21.15.6:0/3058293112 learned_addr learned my addr 172.21.15.6:0/3058293112 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.985+0000 7f0a43fff700 1 --2- 172.21.15.6:0/3058293112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a440d06f0 0x7f0a440d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.985+0000 7f0a42ffd700 1 --2- 172.21.15.6:0/3058293112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a44159c40 0x7f0a4415b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.985+0000 7f0a437fe700 1 -- 172.21.15.6:0/3058293112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a440d06f0 msgr2=0x7f0a440d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.985+0000 7f0a437fe700 1 --2- 172.21.15.6:0/3058293112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a440d06f0 0x7f0a440d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.985+0000 7f0a437fe700 1 -- 172.21.15.6:0/3058293112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a44159c40 msgr2=0x7f0a4415b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.985+0000 7f0a437fe700 1 --2- 172.21.15.6:0/3058293112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a44159c40 0x7f0a4415b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.985+0000 7f0a437fe700 1 -- 172.21.15.6:0/3058293112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a44169fa0 con 0x7f0a44159870 2023-10-06T02:30:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.985+0000 7f0a437fe700 1 --2- 172.21.15.6:0/3058293112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a44159870 0x7f0a4415b400 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7f0a340029e0 tx=0x7f0a34007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.985+0000 7f0a2b7fe700 1 -- 172.21.15.6:0/3058293112 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3400f8d0 con 0x7f0a44159870 2023-10-06T02:30:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.985+0000 7f0a2b7fe700 1 -- 172.21.15.6:0/3058293112 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3400fa30 con 0x7f0a44159870 2023-10-06T02:30:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.985+0000 7f0a49a70700 1 -- 172.21.15.6:0/3058293112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4416a280 con 0x7f0a44159870 2023-10-06T02:30:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.985+0000 7f0a2b7fe700 1 -- 172.21.15.6:0/3058293112 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3400fdf0 con 0x7f0a44159870 2023-10-06T02:30:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.985+0000 7f0a49a70700 1 -- 172.21.15.6:0/3058293112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a440d1090 con 0x7f0a44159870 2023-10-06T02:30:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.986+0000 7f0a49a70700 1 -- 172.21.15.6:0/3058293112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a44088aa0 con 0x7f0a44159870 2023-10-06T02:30:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.987+0000 7f0a2b7fe700 1 -- 172.21.15.6:0/3058293112 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a34013600 con 0x7f0a44159870 2023-10-06T02:30:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.987+0000 7f0a2b7fe700 1 --2- 172.21.15.6:0/3058293112 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a30066f30 0x7f0a300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.987+0000 7f0a2b7fe700 1 -- 172.21.15.6:0/3058293112 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0a34084dd0 con 0x7f0a44159870 2023-10-06T02:30:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.987+0000 7f0a42ffd700 1 --2- 172.21.15.6:0/3058293112 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a30066f30 0x7f0a300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.988+0000 7f0a42ffd700 1 --2- 172.21.15.6:0/3058293112 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a30066f30 0x7f0a300693e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f0a38001b50 tx=0x7f0a38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:16.991+0000 7f0a2b7fe700 1 -- 172.21.15.6:0/3058293112 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a34051da0 con 0x7f0a44159870 2023-10-06T02:30:17.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.230+0000 7f0a49a70700 1 -- 172.21.15.6:0/3058293112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a4416ac60 con 0x7f0a44159870 2023-10-06T02:30:17.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.231+0000 7f0a2b7fe700 1 -- 172.21.15.6:0/3058293112 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 359 v359) v1 ==== 95+0+4606 (secure 0 0 0) 0x7f0a34017090 con 0x7f0a44159870 2023-10-06T02:30:17.233 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:17.233 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":359,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3603762205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3603762205},{"type":"v1","addr":"172.21.15.175:6836","nonce":3603762205}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":9820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3292446255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3292446255},{"type":"v1","addr":"172.21.15.175:6837","nonce":3292446255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":10869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/759655214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":759655214},{"type":"v1","addr":"172.21.15.6:6834","nonce":759655214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354}],"filesystems":[{"mdsmap":{"epoch":359,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:30:06.715272+0000","modified":"2023-10-06T02:30:10.342009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10872},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10872":{"gid":10872,"name":"c","rank":0,"incarnation":355,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1108543434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1108543434},{"type":"v1","addr":"172.21.15.6:6835","nonce":1108543434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:30:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.233+0000 7f0a49a70700 1 -- 172.21.15.6:0/3058293112 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a30066f30 msgr2=0x7f0a300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.233+0000 7f0a49a70700 1 --2- 172.21.15.6:0/3058293112 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a30066f30 0x7f0a300693e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f0a38001b50 tx=0x7f0a38009040 comp rx=0 tx=0).stop 2023-10-06T02:30:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.233+0000 7f0a49a70700 1 -- 172.21.15.6:0/3058293112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a44159870 msgr2=0x7f0a4415b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.233+0000 7f0a49a70700 1 --2- 172.21.15.6:0/3058293112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a44159870 0x7f0a4415b400 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7f0a340029e0 tx=0x7f0a34007d10 comp rx=0 tx=0).stop 2023-10-06T02:30:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.233+0000 7f0a49a70700 1 -- 172.21.15.6:0/3058293112 shutdown_connections 2023-10-06T02:30:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.233+0000 7f0a49a70700 1 --2- 172.21.15.6:0/3058293112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a440d06f0 0x7f0a440d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.233+0000 7f0a49a70700 1 --2- 172.21.15.6:0/3058293112 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0a30066f30 0x7f0a300693e0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.233+0000 7f0a49a70700 1 --2- 172.21.15.6:0/3058293112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a44159870 0x7f0a4415b400 unknown :-1 s=CLOSED pgs=2422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.233+0000 7f0a49a70700 1 --2- 172.21.15.6:0/3058293112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a44159c40 0x7f0a4415b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.233+0000 7f0a49a70700 1 -- 172.21.15.6:0/3058293112 >> 172.21.15.6:0/3058293112 conn(0x7f0a44068680 msgr2=0x7f0a4415a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:17.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.233+0000 7f0a49a70700 1 -- 172.21.15.6:0/3058293112 shutdown_connections 2023-10-06T02:30:17.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.233+0000 7f0a49a70700 1 -- 172.21.15.6:0/3058293112 wait complete. 2023-10-06T02:30:17.236 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 359 2023-10-06T02:30:17.649 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 359, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:30:06.715272+0000', 'modified': '2023-10-06T02:30:10.342009+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10872}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10872': {'gid': 10872, 'name': 'c', 'rank': 0, 'incarnation': 355, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/1108543434', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 1108543434}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 1108543434}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:30:17.649 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:30:17.649 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:30:17.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.774+0000 7f587e205700 1 Processor -- start 2023-10-06T02:30:17.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.774+0000 7f587e205700 1 -- start start 2023-10-06T02:30:17.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.775+0000 7f587e205700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5878086ff0 0x7f5878087440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.775+0000 7f587e205700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5878087980 con 0x7f58780b21b0 2023-10-06T02:30:17.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.775+0000 7f587e205700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58780afc50 con 0x7f587815a030 2023-10-06T02:30:17.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.775+0000 7f587e205700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58780b0cf0 con 0x7f5878086ff0 2023-10-06T02:30:17.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.775+0000 7f5877fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f58780b21b0 0x7f58780b25f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56354/0 (socket says 172.21.15.6:56354) 2023-10-06T02:30:17.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.775+0000 7f5877fff700 1 -- 172.21.15.6:0/2933305975 learned_addr learned my addr 172.21.15.6:0/2933305975 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:17.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.775+0000 7f5876ffd700 1 --2- 172.21.15.6:0/2933305975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5878086ff0 0x7f5878087440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.775+0000 7f58767fc700 1 -- 172.21.15.6:0/2933305975 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190924702 0 0) 0x7f5878087980 con 0x7f58780b21b0 2023-10-06T02:30:17.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.775+0000 7f58767fc700 1 -- 172.21.15.6:0/2933305975 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5860003570 con 0x7f58780b21b0 2023-10-06T02:30:17.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.775+0000 7f58767fc700 1 -- 172.21.15.6:0/2933305975 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864139420 0 0) 0x7f58780afc50 con 0x7f587815a030 2023-10-06T02:30:17.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.775+0000 7f58767fc700 1 -- 172.21.15.6:0/2933305975 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5878087980 con 0x7f587815a030 2023-10-06T02:30:17.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.775+0000 7f5876ffd700 1 -- 172.21.15.6:0/2933305975 >> v1:172.21.15.175:6789/0 conn(0x7f587815a030 legacy=0x7f587815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.775+0000 7f5876ffd700 1 -- 172.21.15.6:0/2933305975 >> v1:172.21.15.6:6789/0 conn(0x7f58780b21b0 legacy=0x7f58780b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.775+0000 7f5876ffd700 1 -- 172.21.15.6:0/2933305975 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58780aff30 con 0x7f5878086ff0 2023-10-06T02:30:17.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.775+0000 7f5876ffd700 1 --2- 172.21.15.6:0/2933305975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5878086ff0 0x7f5878087440 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f586c009910 tx=0x7f586c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cbd40cc46ded6c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:17.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.776+0000 7f58767fc700 1 -- 172.21.15.6:0/2933305975 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c011630 con 0x7f5878086ff0 2023-10-06T02:30:17.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.776+0000 7f58767fc700 1 -- 172.21.15.6:0/2933305975 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c011790 con 0x7f5878086ff0 2023-10-06T02:30:17.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.776+0000 7f58767fc700 1 -- 172.21.15.6:0/2933305975 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c011b10 con 0x7f5878086ff0 2023-10-06T02:30:17.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.776+0000 7f587e205700 1 -- 172.21.15.6:0/2933305975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5878086ff0 msgr2=0x7f5878087440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.776+0000 7f587e205700 1 --2- 172.21.15.6:0/2933305975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5878086ff0 0x7f5878087440 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f586c009910 tx=0x7f586c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.776+0000 7f587e205700 1 -- 172.21.15.6:0/2933305975 shutdown_connections 2023-10-06T02:30:17.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.776+0000 7f587e205700 1 --2- 172.21.15.6:0/2933305975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5878086ff0 0x7f5878087440 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.776+0000 7f587e205700 1 -- 172.21.15.6:0/2933305975 >> 172.21.15.6:0/2933305975 conn(0x7f5878068680 msgr2=0x7f5878068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:17.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.776+0000 7f587e205700 1 -- 172.21.15.6:0/2933305975 shutdown_connections 2023-10-06T02:30:17.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.776+0000 7f587e205700 1 -- 172.21.15.6:0/2933305975 wait complete. 2023-10-06T02:30:17.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.777+0000 7f587e205700 1 Processor -- start 2023-10-06T02:30:17.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.777+0000 7f587e205700 1 -- start start 2023-10-06T02:30:17.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.778+0000 7f587e205700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5878086ff0 0x7f587816aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.778+0000 7f587e205700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58780b21b0 0x7f58780cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.778+0000 7f587e205700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f587815a030 0x7f58780cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.778+0000 7f587e205700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587815d340 con 0x7f587815a030 2023-10-06T02:30:17.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.778+0000 7f587e205700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587815c6c0 con 0x7f5878086ff0 2023-10-06T02:30:17.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.778+0000 7f587e205700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587815c9a0 con 0x7f58780b21b0 2023-10-06T02:30:17.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.778+0000 7f5877fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f587815a030 0x7f58780cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.778+0000 7f5877fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f587815a030 0x7f58780cc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40390/0 (socket says 172.21.15.6:40390) 2023-10-06T02:30:17.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.778+0000 7f5877fff700 1 -- 172.21.15.6:0/2297109818 learned_addr learned my addr 172.21.15.6:0/2297109818 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:17.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.779+0000 7f5876ffd700 1 --2- 172.21.15.6:0/2297109818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58780b21b0 0x7f58780cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.779+0000 7f58777fe700 1 --2- 172.21.15.6:0/2297109818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5878086ff0 0x7f587816aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.779+0000 7f5877fff700 1 -- 172.21.15.6:0/2297109818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58780b21b0 msgr2=0x7f58780cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.779+0000 7f5877fff700 1 --2- 172.21.15.6:0/2297109818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58780b21b0 0x7f58780cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.779+0000 7f5877fff700 1 -- 172.21.15.6:0/2297109818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5878086ff0 msgr2=0x7f587816aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.779+0000 7f5877fff700 1 --2- 172.21.15.6:0/2297109818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5878086ff0 0x7f587816aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.779+0000 7f5877fff700 1 -- 172.21.15.6:0/2297109818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c009420 con 0x7f587815a030 2023-10-06T02:30:17.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.779+0000 7f5877fff700 1 --2- 172.21.15.6:0/2297109818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f587815a030 0x7f58780cc460 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 crypto rx=0x7f587000cc60 tx=0x7f5870001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:17.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.779+0000 7f585f7fe700 1 -- 172.21.15.6:0/2297109818 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587000ce70 con 0x7f587815a030 2023-10-06T02:30:17.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.779+0000 7f585f7fe700 1 -- 172.21.15.6:0/2297109818 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587000ab70 con 0x7f587815a030 2023-10-06T02:30:17.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.779+0000 7f587e205700 1 -- 172.21.15.6:0/2297109818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587815cc80 con 0x7f587815a030 2023-10-06T02:30:17.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.779+0000 7f585f7fe700 1 -- 172.21.15.6:0/2297109818 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58700070f0 con 0x7f587815a030 2023-10-06T02:30:17.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.779+0000 7f587e205700 1 -- 172.21.15.6:0/2297109818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587816b030 con 0x7f587815a030 2023-10-06T02:30:17.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.780+0000 7f585f7fe700 1 -- 172.21.15.6:0/2297109818 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58700074a0 con 0x7f587815a030 2023-10-06T02:30:17.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.781+0000 7f585f7fe700 1 --2- 172.21.15.6:0/2297109818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5864066f30 0x7f58640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.781+0000 7f585f7fe700 1 -- 172.21.15.6:0/2297109818 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5870084c70 con 0x7f587815a030 2023-10-06T02:30:17.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.781+0000 7f58777fe700 1 --2- 172.21.15.6:0/2297109818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5864066f30 0x7f58640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.782+0000 7f58777fe700 1 --2- 172.21.15.6:0/2297109818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5864066f30 0x7f58640693e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f58680037e0 tx=0x7f5868009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:17.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.783+0000 7f58874fdb80 1 Processor -- start 2023-10-06T02:30:17.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.783+0000 7f58874fdb80 1 -- start start 2023-10-06T02:30:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f58874fdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b2dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f58874fdb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 0x55b988b7d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f58874fdb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b7dc00 0x55b988b7e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f58874fdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b988a84a70 con 0x55b988b2d840 2023-10-06T02:30:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f58874fdb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b988a82270 con 0x55b988b7dc00 2023-10-06T02:30:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f58874fdb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b988a7e060 con 0x55b988b2ecc0 2023-10-06T02:30:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f58777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b2dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f58777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b2dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40406/0 (socket says 172.21.15.6:40406) 2023-10-06T02:30:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f58777fe700 1 -- 172.21.15.6:0/372754131 learned_addr learned my addr 172.21.15.6:0/372754131 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f5876ffd700 1 --2- 172.21.15.6:0/372754131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 0x55b988b7d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f5877fff700 1 --2- 172.21.15.6:0/372754131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b7dc00 0x55b988b7e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f58777fe700 1 -- 172.21.15.6:0/372754131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 msgr2=0x55b988b7d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f58777fe700 1 --2- 172.21.15.6:0/372754131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 0x55b988b7d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f58777fe700 1 -- 172.21.15.6:0/372754131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b7dc00 msgr2=0x55b988b7e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f58777fe700 1 --2- 172.21.15.6:0/372754131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b7dc00 0x55b988b7e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f58777fe700 1 -- 172.21.15.6:0/372754131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b988918270 con 0x55b988b2d840 2023-10-06T02:30:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f58777fe700 1 --2- 172.21.15.6:0/372754131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b2dc10 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7f5868013730 tx=0x7f5868014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dcd109cecc98161 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f585cff9700 1 -- 172.21.15.6:0/372754131 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586800e670 con 0x55b988b2d840 2023-10-06T02:30:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f585cff9700 1 -- 172.21.15.6:0/372754131 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586800e7d0 con 0x55b988b2d840 2023-10-06T02:30:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.784+0000 7f585cff9700 1 -- 172.21.15.6:0/372754131 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586800eb50 con 0x55b988b2d840 2023-10-06T02:30:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.785+0000 7f58874fdb80 1 -- 172.21.15.6:0/372754131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 msgr2=0x55b988b2dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.785+0000 7f58874fdb80 1 --2- 172.21.15.6:0/372754131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b2dc10 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7f5868013730 tx=0x7f5868014000 comp rx=0 tx=0).stop 2023-10-06T02:30:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.785+0000 7f58874fdb80 1 -- 172.21.15.6:0/372754131 shutdown_connections 2023-10-06T02:30:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.785+0000 7f58874fdb80 1 --2- 172.21.15.6:0/372754131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b7dc00 0x55b988b7e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.785+0000 7f58874fdb80 1 --2- 172.21.15.6:0/372754131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b2dc10 unknown :-1 s=CLOSED pgs=2425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.785+0000 7f58874fdb80 1 --2- 172.21.15.6:0/372754131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 0x55b988b7d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.785+0000 7f58874fdb80 1 -- 172.21.15.6:0/372754131 >> 172.21.15.6:0/372754131 conn(0x55b988b2f160 msgr2=0x55b988b2f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.785+0000 7f58874fdb80 1 -- 172.21.15.6:0/372754131 shutdown_connections 2023-10-06T02:30:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.785+0000 7f58874fdb80 1 -- 172.21.15.6:0/372754131 wait complete. 2023-10-06T02:30:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.786+0000 7f58874fdb80 1 -- start start 2023-10-06T02:30:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.786+0000 7f58874fdb80 1 Processor -- start 2023-10-06T02:30:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f58874fdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b75270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f58874fdb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 0x55b988b6dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f58874fdb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b7dc00 0x55b988b6e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f58874fdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b988a29890 con 0x55b988b2d840 2023-10-06T02:30:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f58874fdb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b988a44ea0 con 0x55b988b7dc00 2023-10-06T02:30:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f58874fdb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b988900e30 con 0x55b988b2ecc0 2023-10-06T02:30:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f58874fdb80 10 client.0 _ll_register_callbacks cb 0x55b988af0e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:30:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f58777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b75270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f58777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b75270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40420/0 (socket says 172.21.15.6:40420) 2023-10-06T02:30:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f58777fe700 1 -- 172.21.15.6:0/1069831905 learned_addr learned my addr 172.21.15.6:0/1069831905 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f5876ffd700 1 --2- 172.21.15.6:0/1069831905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 0x55b988b6dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f5877fff700 1 --2- 172.21.15.6:0/1069831905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b7dc00 0x55b988b6e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f58777fe700 1 -- 172.21.15.6:0/1069831905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 msgr2=0x55b988b6dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f58777fe700 1 --2- 172.21.15.6:0/1069831905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 0x55b988b6dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f58777fe700 1 -- 172.21.15.6:0/1069831905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b7dc00 msgr2=0x55b988b6e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f58777fe700 1 --2- 172.21.15.6:0/1069831905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b7dc00 0x55b988b6e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f58777fe700 1 -- 172.21.15.6:0/1069831905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586800f040 con 0x55b988b2d840 2023-10-06T02:30:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f58777fe700 1 --2- 172.21.15.6:0/1069831905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b75270 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7f5868013e80 tx=0x7f5868019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d618159636196c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f5855ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:30:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f5855ffb700 1 -- 172.21.15.6:0/1069831905 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586802c630 con 0x55b988b2d840 2023-10-06T02:30:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f58874fdb80 1 -- 172.21.15.6:0/1069831905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b988b22940 con 0x55b988b2d840 2023-10-06T02:30:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.787+0000 7f5855ffb700 1 -- 172.21.15.6:0/1069831905 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f586801b050 con 0x55b988b2d840 2023-10-06T02:30:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.788+0000 7f5855ffb700 1 -- 172.21.15.6:0/1069831905 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=359) v2 ==== 24+0+0 (secure 0 0 0) 0x7f586802c9a0 con 0x55b988b2d840 2023-10-06T02:30:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.788+0000 7f58874fdb80 10 client.11046 fetch_fsmap learned FSMap version 359 2023-10-06T02:30:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.788+0000 7f58874fdb80 1 -- 172.21.15.6:0/1069831905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=359,monmap=2+}) v3 -- 0x55b9888bafe0 con 0x55b988b2d840 2023-10-06T02:30:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.788+0000 7f5855ffb700 1 -- 172.21.15.6:0/1069831905 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b988b22940 con 0x55b988b2d840 2023-10-06T02:30:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.788+0000 7f5855ffb700 1 -- 172.21.15.6:0/1069831905 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 359) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f586802cb00 con 0x55b988b2d840 2023-10-06T02:30:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.788+0000 7f58874fdb80 10 client.11046 fetch_fsmap finished waiting for FSMap version 359 2023-10-06T02:30:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.788+0000 7f58874fdb80 10 client.11046 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:30:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.788+0000 7f58874fdb80 20 client.11046 populate_metadata read hostname 'smithi006' 2023-10-06T02:30:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.788+0000 7f58874fdb80 1 --2- 172.21.15.6:0/1069831905 >> [v2:172.21.15.6:6833/1108543434,v1:172.21.15.6:6835/1108543434] conn(0x55b988b70410 0x55b988b6bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.788+0000 7f58874fdb80 4 client.11046 mds_command: new command op to 10872 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:30:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.788+0000 7f58874fdb80 1 -- 172.21.15.6:0/1069831905 --> [v2:172.21.15.6:6833/1108543434,v1:172.21.15.6:6835/1108543434] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b988aff870 con 0x55b988b70410 2023-10-06T02:30:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.788+0000 7f5876ffd700 1 --2- 172.21.15.6:0/1069831905 >> [v2:172.21.15.6:6833/1108543434,v1:172.21.15.6:6835/1108543434] conn(0x55b988b70410 0x55b988b6bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.788+0000 7f5855ffb700 10 client.11046 ms_handle_connect on v2:172.21.15.6:6833/1108543434 2023-10-06T02:30:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.788+0000 7f5876ffd700 1 --2- 172.21.15.6:0/1069831905 >> [v2:172.21.15.6:6833/1108543434,v1:172.21.15.6:6835/1108543434] conn(0x55b988b70410 0x55b988b6bec0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac97c9fc103f1512 server_cookie=9f844a824e60c064 in_seq=0 out_seq=0 2023-10-06T02:30:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.789+0000 7f5855ffb700 1 -- 172.21.15.6:0/1069831905 <== mds.0 v2:172.21.15.6:6833/1108543434 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b988aff870 con 0x55b988b70410 2023-10-06T02:30:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.789+0000 7f5855ffb700 10 client.11046 handle_command_reply: tid=0 2023-10-06T02:30:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.789+0000 7f58874fdb80 1 client.11046 shutdown 2023-10-06T02:30:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.789+0000 7f58874fdb80 1 -- 172.21.15.6:0/1069831905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 msgr2=0x55b988b75270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.789+0000 7f58874fdb80 1 --2- 172.21.15.6:0/1069831905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b75270 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7f5868013e80 tx=0x7f5868019000 comp rx=0 tx=0).stop 2023-10-06T02:30:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.789+0000 7f58874fdb80 1 -- 172.21.15.6:0/1069831905 shutdown_connections 2023-10-06T02:30:17.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.789+0000 7f58874fdb80 1 --2- 172.21.15.6:0/1069831905 >> [v2:172.21.15.6:6833/1108543434,v1:172.21.15.6:6835/1108543434] conn(0x55b988b70410 0x55b988b6bec0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.789+0000 7f58874fdb80 1 --2- 172.21.15.6:0/1069831905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b7dc00 0x55b988b6e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.789+0000 7f58874fdb80 1 --2- 172.21.15.6:0/1069831905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b75270 unknown :-1 s=CLOSED pgs=2426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.789+0000 7f5855ffb700 0 client.11046 ms_handle_reset on v2:172.21.15.6:6833/1108543434 2023-10-06T02:30:17.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.789+0000 7f58874fdb80 1 --2- 172.21.15.6:0/1069831905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 0x55b988b6dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.789+0000 7f58874fdb80 1 -- 172.21.15.6:0/1069831905 >> 172.21.15.6:0/1069831905 conn(0x55b988b2f160 msgr2=0x55b988b2e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:17.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.789+0000 7f58874fdb80 1 -- 172.21.15.6:0/1069831905 shutdown_connections 2023-10-06T02:30:17.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.789+0000 7f58874fdb80 1 -- 172.21.15.6:0/1069831905 wait complete. 2023-10-06T02:30:17.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.789+0000 7f58874fdb80 20 client.11046 trim_cache size 0 max 16384 2023-10-06T02:30:17.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.806+0000 7f58874fdb80 1 Processor -- start 2023-10-06T02:30:17.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.806+0000 7f58874fdb80 1 -- start start 2023-10-06T02:30:17.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.807+0000 7f58874fdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b73810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.807+0000 7f58874fdb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 0x55b988b866d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.807+0000 7f58874fdb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b7dc00 0x55b988b86c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.807+0000 7f58874fdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b988b70980 con 0x55b988b2d840 2023-10-06T02:30:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.807+0000 7f58874fdb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b988b2b420 con 0x55b988b7dc00 2023-10-06T02:30:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.807+0000 7f58874fdb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b988b72fb0 con 0x55b988b2ecc0 2023-10-06T02:30:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.807+0000 7f58777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b73810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.807+0000 7f58777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b73810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40430/0 (socket says 172.21.15.6:40430) 2023-10-06T02:30:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.807+0000 7f58777fe700 1 -- 172.21.15.6:0/2158726182 learned_addr learned my addr 172.21.15.6:0/2158726182 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.807+0000 7f5876ffd700 1 --2- 172.21.15.6:0/2158726182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 0x55b988b866d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.807+0000 7f5877fff700 1 --2- 172.21.15.6:0/2158726182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b7dc00 0x55b988b86c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.807+0000 7f58777fe700 1 -- 172.21.15.6:0/2158726182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 msgr2=0x55b988b866d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.807+0000 7f58777fe700 1 --2- 172.21.15.6:0/2158726182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 0x55b988b866d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.807+0000 7f58777fe700 1 -- 172.21.15.6:0/2158726182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b7dc00 msgr2=0x55b988b86c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.807+0000 7f58777fe700 1 --2- 172.21.15.6:0/2158726182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b7dc00 0x55b988b86c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.807+0000 7f58777fe700 1 -- 172.21.15.6:0/2158726182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b988a4c780 con 0x55b988b2d840 2023-10-06T02:30:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.807+0000 7f5876ffd700 1 --2- 172.21.15.6:0/2158726182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 0x55b988b866d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.808+0000 7f58777fe700 1 --2- 172.21.15.6:0/2158726182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b73810 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7f586800e160 tx=0x7f586802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aec4ef134b6d0c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.808+0000 7f585d7fa700 1 -- 172.21.15.6:0/2158726182 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868003600 con 0x55b988b2d840 2023-10-06T02:30:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.808+0000 7f585d7fa700 1 -- 172.21.15.6:0/2158726182 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586800e3e0 con 0x55b988b2d840 2023-10-06T02:30:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.808+0000 7f585d7fa700 1 -- 172.21.15.6:0/2158726182 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586802cbd0 con 0x55b988b2d840 2023-10-06T02:30:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.808+0000 7f58874fdb80 1 -- 172.21.15.6:0/2158726182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 msgr2=0x55b988b73810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.808+0000 7f58874fdb80 1 --2- 172.21.15.6:0/2158726182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b73810 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7f586800e160 tx=0x7f586802c000 comp rx=0 tx=0).stop 2023-10-06T02:30:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.808+0000 7f58874fdb80 1 -- 172.21.15.6:0/2158726182 shutdown_connections 2023-10-06T02:30:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.808+0000 7f58874fdb80 1 --2- 172.21.15.6:0/2158726182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b7dc00 0x55b988b86c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.808+0000 7f58874fdb80 1 --2- 172.21.15.6:0/2158726182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b2d840 0x55b988b73810 unknown :-1 s=CLOSED pgs=2427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.808+0000 7f58874fdb80 1 --2- 172.21.15.6:0/2158726182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 0x55b988b866d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.808+0000 7f58874fdb80 1 -- 172.21.15.6:0/2158726182 >> 172.21.15.6:0/2158726182 conn(0x55b988b2f160 msgr2=0x55b988b56b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:17.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.808+0000 7f58874fdb80 1 -- 172.21.15.6:0/2158726182 shutdown_connections 2023-10-06T02:30:17.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.808+0000 7f58874fdb80 1 -- 172.21.15.6:0/2158726182 wait complete. 2023-10-06T02:30:17.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.809+0000 7f58874fdb80 1 -- start start 2023-10-06T02:30:17.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.809+0000 7f58874fdb80 1 Processor -- start 2023-10-06T02:30:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f58874fdb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b2d840 0x55b988bd6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f58874fdb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 0x55b988b86400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f58874fdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b7dc00 0x55b988b86940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f58874fdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b988b75db0 con 0x55b988b7dc00 2023-10-06T02:30:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f58874fdb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b988b790e0 con 0x55b988b2d840 2023-10-06T02:30:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f58874fdb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b988b784d0 con 0x55b988b2ecc0 2023-10-06T02:30:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f58874fdb80 10 client.0 _ll_register_callbacks cb 0x55b988af0e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:30:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f5877fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b7dc00 0x55b988b86940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f5877fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b7dc00 0x55b988b86940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40446/0 (socket says 172.21.15.6:40446) 2023-10-06T02:30:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f5877fff700 1 -- 172.21.15.6:0/1653032611 learned_addr learned my addr 172.21.15.6:0/1653032611 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f5876ffd700 1 --2- 172.21.15.6:0/1653032611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 0x55b988b86400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f58777fe700 1 --2- 172.21.15.6:0/1653032611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b2d840 0x55b988bd6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f5877fff700 1 -- 172.21.15.6:0/1653032611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 msgr2=0x55b988b86400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f5877fff700 1 --2- 172.21.15.6:0/1653032611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 0x55b988b86400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f5877fff700 1 -- 172.21.15.6:0/1653032611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b2d840 msgr2=0x55b988bd6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f5877fff700 1 --2- 172.21.15.6:0/1653032611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b2d840 0x55b988bd6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f5877fff700 1 -- 172.21.15.6:0/1653032611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b9888bafe0 con 0x55b988b7dc00 2023-10-06T02:30:17.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f5877fff700 1 --2- 172.21.15.6:0/1653032611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b7dc00 0x55b988b86940 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7f587000a6d0 tx=0x7f5870014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402ad50c776801e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:17.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f5855ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:30:17.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f5855ffb700 1 -- 172.21.15.6:0/1653032611 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587005c920 con 0x55b988b7dc00 2023-10-06T02:30:17.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f5855ffb700 1 -- 172.21.15.6:0/1653032611 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5870053d20 con 0x55b988b7dc00 2023-10-06T02:30:17.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f58874fdb80 1 -- 172.21.15.6:0/1653032611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f586800e7d0 con 0x55b988b7dc00 2023-10-06T02:30:17.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f5855ffb700 1 -- 172.21.15.6:0/1653032611 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=359) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5870055080 con 0x55b988b7dc00 2023-10-06T02:30:17.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f58874fdb80 10 client.11052 fetch_fsmap learned FSMap version 359 2023-10-06T02:30:17.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.810+0000 7f58874fdb80 1 -- 172.21.15.6:0/1653032611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=359,monmap=2+}) v3 -- 0x55b988a33470 con 0x55b988b7dc00 2023-10-06T02:30:17.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.811+0000 7f5855ffb700 1 -- 172.21.15.6:0/1653032611 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586800e7d0 con 0x55b988b7dc00 2023-10-06T02:30:17.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.811+0000 7f5855ffb700 1 -- 172.21.15.6:0/1653032611 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 359) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f587005c490 con 0x55b988b7dc00 2023-10-06T02:30:17.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.811+0000 7f58874fdb80 10 client.11052 fetch_fsmap finished waiting for FSMap version 359 2023-10-06T02:30:17.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.811+0000 7f58874fdb80 10 client.11052 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:30:17.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.811+0000 7f58874fdb80 20 client.11052 populate_metadata read hostname 'smithi006' 2023-10-06T02:30:17.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.811+0000 7f58874fdb80 1 --2- 172.21.15.6:0/1653032611 >> [v2:172.21.15.6:6833/1108543434,v1:172.21.15.6:6835/1108543434] conn(0x55b988bd9b80 0x55b988bd9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.811+0000 7f58874fdb80 4 client.11052 mds_command: new command op to 10872 tid=0[{"prefix": "status"}] 2023-10-06T02:30:17.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.811+0000 7f58874fdb80 1 -- 172.21.15.6:0/1653032611 --> [v2:172.21.15.6:6833/1108543434,v1:172.21.15.6:6835/1108543434] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b988a20e00 con 0x55b988bd9b80 2023-10-06T02:30:17.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.811+0000 7f58777fe700 1 --2- 172.21.15.6:0/1653032611 >> [v2:172.21.15.6:6833/1108543434,v1:172.21.15.6:6835/1108543434] conn(0x55b988bd9b80 0x55b988bd9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.811+0000 7f5855ffb700 10 client.11052 ms_handle_connect on v2:172.21.15.6:6833/1108543434 2023-10-06T02:30:17.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.811+0000 7f58777fe700 1 --2- 172.21.15.6:0/1653032611 >> [v2:172.21.15.6:6833/1108543434,v1:172.21.15.6:6835/1108543434] conn(0x55b988bd9b80 0x55b988bd9f50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b844e8988716ae6 server_cookie=978752018c16dfe8 in_seq=0 out_seq=0 2023-10-06T02:30:17.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.811+0000 7f5855ffb700 1 -- 172.21.15.6:0/1653032611 <== mds.0 v2:172.21.15.6:6833/1108543434 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+329 (crc 0 0 0) 0x55b988a20e00 con 0x55b988bd9b80 2023-10-06T02:30:17.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.811+0000 7f5855ffb700 10 client.11052 handle_command_reply: tid=0 2023-10-06T02:30:17.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.811+0000 7f58874fdb80 1 client.11052 shutdown 2023-10-06T02:30:17.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.811+0000 7f58874fdb80 1 -- 172.21.15.6:0/1653032611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b7dc00 msgr2=0x55b988b86940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f58874fdb80 1 --2- 172.21.15.6:0/1653032611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b7dc00 0x55b988b86940 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7f587000a6d0 tx=0x7f5870014040 comp rx=0 tx=0).stop 2023-10-06T02:30:17.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f58874fdb80 1 -- 172.21.15.6:0/1653032611 shutdown_connections 2023-10-06T02:30:17.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f58874fdb80 1 --2- 172.21.15.6:0/1653032611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b988b7dc00 0x55b988b86940 unknown :-1 s=CLOSED pgs=2428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f58874fdb80 1 --2- 172.21.15.6:0/1653032611 >> [v2:172.21.15.6:6833/1108543434,v1:172.21.15.6:6835/1108543434] conn(0x55b988bd9b80 0x55b988bd9f50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f58874fdb80 1 --2- 172.21.15.6:0/1653032611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b988b2d840 0x55b988bd6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f5855ffb700 0 client.11052 ms_handle_reset on v2:172.21.15.6:6833/1108543434 2023-10-06T02:30:17.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f58874fdb80 1 --2- 172.21.15.6:0/1653032611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b988b2ecc0 0x55b988b86400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f58874fdb80 1 -- 172.21.15.6:0/1653032611 >> 172.21.15.6:0/1653032611 conn(0x55b988b2f160 msgr2=0x55b988b739d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:17.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f58874fdb80 1 -- 172.21.15.6:0/1653032611 shutdown_connections 2023-10-06T02:30:17.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f58874fdb80 1 -- 172.21.15.6:0/1653032611 wait complete. 2023-10-06T02:30:17.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f58874fdb80 20 client.11052 trim_cache size 0 max 16384 2023-10-06T02:30:17.820 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:30:17.820 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:30:17.820 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:30:17.820 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 10872, 2023-10-06T02:30:17.820 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:30:17.820 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:30:17.820 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:30:17.820 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.482985349, 2023-10-06T02:30:17.820 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 359, 2023-10-06T02:30:17.820 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 146, 2023-10-06T02:30:17.820 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 146, 2023-10-06T02:30:17.821 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 16.570907250000001 2023-10-06T02:30:17.821 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:30:17.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f587e205700 1 -- 172.21.15.6:0/2297109818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5864066f30 msgr2=0x7f58640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f587e205700 1 --2- 172.21.15.6:0/2297109818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5864066f30 0x7f58640693e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f58680037e0 tx=0x7f5868009040 comp rx=0 tx=0).stop 2023-10-06T02:30:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f587e205700 1 -- 172.21.15.6:0/2297109818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f587815a030 msgr2=0x7f58780cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f587e205700 1 --2- 172.21.15.6:0/2297109818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f587815a030 0x7f58780cc460 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 crypto rx=0x7f587000cc60 tx=0x7f5870001ae0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f587e205700 1 -- 172.21.15.6:0/2297109818 shutdown_connections 2023-10-06T02:30:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f587e205700 1 --2- 172.21.15.6:0/2297109818 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5864066f30 0x7f58640693e0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f587e205700 1 --2- 172.21.15.6:0/2297109818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f587815a030 0x7f58780cc460 unknown :-1 s=CLOSED pgs=2424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f587e205700 1 --2- 172.21.15.6:0/2297109818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5878086ff0 0x7f587816aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f587e205700 1 --2- 172.21.15.6:0/2297109818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58780b21b0 0x7f58780cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f587e205700 1 -- 172.21.15.6:0/2297109818 >> 172.21.15.6:0/2297109818 conn(0x7f5878068680 msgr2=0x7f58780cafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f587e205700 1 -- 172.21.15.6:0/2297109818 shutdown_connections 2023-10-06T02:30:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.812+0000 7f587e205700 1 -- 172.21.15.6:0/2297109818 wait complete. 2023-10-06T02:30:17.825 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:30:17.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.944+0000 7f246ae21700 1 Processor -- start 2023-10-06T02:30:17.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.944+0000 7f246ae21700 1 -- start start 2023-10-06T02:30:17.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.945+0000 7f246ae21700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f24640af8b0 0x7f246415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.945+0000 7f246ae21700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246415e190 con 0x7f24640af4e0 2023-10-06T02:30:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.945+0000 7f246ae21700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24640cb650 con 0x7f24640b27f0 2023-10-06T02:30:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.945+0000 7f246ae21700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24640b1910 con 0x7f24640af8b0 2023-10-06T02:30:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.945+0000 7f2468bbd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f24640af4e0 0x7f24640b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56366/0 (socket says 172.21.15.6:56366) 2023-10-06T02:30:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.945+0000 7f2468bbd700 1 -- 172.21.15.6:0/1351107746 learned_addr learned my addr 172.21.15.6:0/1351107746 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.945+0000 7f24637fe700 1 -- 172.21.15.6:0/1351107746 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97532909 0 0) 0x7f246415e190 con 0x7f24640af4e0 2023-10-06T02:30:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.945+0000 7f2463fff700 1 --2- 172.21.15.6:0/1351107746 >> v2:172.21.15.175:3300/0 conn(0x7f24640af8b0 0x7f246415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.945+0000 7f24637fe700 1 -- 172.21.15.6:0/1351107746 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2450003570 con 0x7f24640af4e0 2023-10-06T02:30:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24637fe700 1 -- 172.21.15.6:0/1351107746 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3842135628 0 0) 0x7f2450003570 con 0x7f24640af4e0 2023-10-06T02:30:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24637fe700 1 -- 172.21.15.6:0/1351107746 >> v2:172.21.15.175:3300/0 conn(0x7f24640af8b0 msgr2=0x7f246415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24637fe700 1 --2- 172.21.15.6:0/1351107746 >> v2:172.21.15.175:3300/0 conn(0x7f24640af8b0 0x7f246415d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24637fe700 1 -- 172.21.15.6:0/1351107746 >> v1:172.21.15.175:6789/0 conn(0x7f24640b27f0 legacy=0x7f246415d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24637fe700 1 -- 172.21.15.6:0/1351107746 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24640ccaf0 con 0x7f24640af4e0 2023-10-06T02:30:17.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24637fe700 1 -- 172.21.15.6:0/1351107746 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f244c001470 con 0x7f24640af4e0 2023-10-06T02:30:17.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24637fe700 1 -- 172.21.15.6:0/1351107746 >> v1:172.21.15.6:6789/0 conn(0x7f24640af4e0 legacy=0x7f24640b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24637fe700 1 --2- 172.21.15.6:0/1351107746 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2450003a60 0x7f2450003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24637fe700 1 --2- 172.21.15.6:0/1351107746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2450004810 0x7f2450004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24637fe700 1 --2- 172.21.15.6:0/1351107746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24500051c0 0x7f245000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24637fe700 1 -- 172.21.15.6:0/1351107746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24640b1910 con 0x7f2450004810 2023-10-06T02:30:17.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24637fe700 1 -- 172.21.15.6:0/1351107746 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245000c160 con 0x7f24500051c0 2023-10-06T02:30:17.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24637fe700 1 -- 172.21.15.6:0/1351107746 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245000c320 con 0x7f2450003a60 2023-10-06T02:30:17.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f2463fff700 1 --2- 172.21.15.6:0/1351107746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2450004810 0x7f2450004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f2468bbd700 1 --2- 172.21.15.6:0/1351107746 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2450003a60 0x7f2450003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24693be700 1 --2- 172.21.15.6:0/1351107746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24500051c0 0x7f245000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f2463fff700 1 -- 172.21.15.6:0/1351107746 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2450003a60 msgr2=0x7f2450003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:17.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f2463fff700 1 --2- 172.21.15.6:0/1351107746 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2450003a60 0x7f2450003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f2463fff700 1 -- 172.21.15.6:0/1351107746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24500051c0 msgr2=0x7f245000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:17.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f2463fff700 1 --2- 172.21.15.6:0/1351107746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24500051c0 0x7f245000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24693be700 1 -- 172.21.15.6:0/1351107746 reap_dead start 2023-10-06T02:30:17.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f2463fff700 1 -- 172.21.15.6:0/1351107746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2450003570 con 0x7f2450004810 2023-10-06T02:30:17.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f2463fff700 1 --2- 172.21.15.6:0/1351107746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2450004810 0x7f2450004c80 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 crypto rx=0x7f2464089810 tx=0x7f245400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fbd0c880a46077 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:17.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24637fe700 1 -- 172.21.15.6:0/1351107746 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400ea30 con 0x7f2450004810 2023-10-06T02:30:17.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24637fe700 1 -- 172.21.15.6:0/1351107746 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245400f040 con 0x7f2450004810 2023-10-06T02:30:17.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.946+0000 7f24637fe700 1 -- 172.21.15.6:0/1351107746 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400ede0 con 0x7f2450004810 2023-10-06T02:30:17.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.947+0000 7f246ae21700 1 -- 172.21.15.6:0/1351107746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2450004810 msgr2=0x7f2450004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.947+0000 7f246ae21700 1 --2- 172.21.15.6:0/1351107746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2450004810 0x7f2450004c80 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 crypto rx=0x7f2464089810 tx=0x7f245400b040 comp rx=0 tx=0).stop 2023-10-06T02:30:17.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.947+0000 7f246ae21700 1 -- 172.21.15.6:0/1351107746 shutdown_connections 2023-10-06T02:30:17.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.947+0000 7f246ae21700 1 --2- 172.21.15.6:0/1351107746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2450004810 0x7f2450004c80 unknown :-1 s=CLOSED pgs=2430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.947+0000 7f246ae21700 1 -- 172.21.15.6:0/1351107746 >> 172.21.15.6:0/1351107746 conn(0x7f2464068680 msgr2=0x7f2464068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:17.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.947+0000 7f246ae21700 1 -- 172.21.15.6:0/1351107746 shutdown_connections 2023-10-06T02:30:17.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.947+0000 7f246ae21700 1 -- 172.21.15.6:0/1351107746 wait complete. 2023-10-06T02:30:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.948+0000 7f246ae21700 1 Processor -- start 2023-10-06T02:30:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.948+0000 7f246ae21700 1 -- start start 2023-10-06T02:30:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.949+0000 7f246ae21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2450004810 0x7f2464152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.949+0000 7f246ae21700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24640b3e90 0x7f24640c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.949+0000 7f246ae21700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2464157f30 0x7f24641583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.949+0000 7f246ae21700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2464153250 con 0x7f2450004810 2023-10-06T02:30:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.949+0000 7f246ae21700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2464158910 con 0x7f24640b3e90 2023-10-06T02:30:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.949+0000 7f246ae21700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246416a7b0 con 0x7f2464157f30 2023-10-06T02:30:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.949+0000 7f2468bbd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2450004810 0x7f2464152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.949+0000 7f2468bbd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2450004810 0x7f2464152a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40464/0 (socket says 172.21.15.6:40464) 2023-10-06T02:30:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.949+0000 7f2468bbd700 1 -- 172.21.15.6:0/2535065566 learned_addr learned my addr 172.21.15.6:0/2535065566 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.950+0000 7f24693be700 1 --2- 172.21.15.6:0/2535065566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2464157f30 0x7f24641583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.950+0000 7f2463fff700 1 --2- 172.21.15.6:0/2535065566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24640b3e90 0x7f24640c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.950+0000 7f2468bbd700 1 -- 172.21.15.6:0/2535065566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2464157f30 msgr2=0x7f24641583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.950+0000 7f2468bbd700 1 --2- 172.21.15.6:0/2535065566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2464157f30 0x7f24641583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.950+0000 7f2468bbd700 1 -- 172.21.15.6:0/2535065566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24640b3e90 msgr2=0x7f24640c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.950+0000 7f2468bbd700 1 --2- 172.21.15.6:0/2535065566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24640b3e90 0x7f24640c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.950+0000 7f2468bbd700 1 -- 172.21.15.6:0/2535065566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246416a9c0 con 0x7f2450004810 2023-10-06T02:30:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.950+0000 7f2463fff700 1 --2- 172.21.15.6:0/2535065566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24640b3e90 0x7f24640c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.950+0000 7f24693be700 1 --2- 172.21.15.6:0/2535065566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2464157f30 0x7f24641583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.950+0000 7f2468bbd700 1 --2- 172.21.15.6:0/2535065566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2450004810 0x7f2464152a00 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7f244c001c00 tx=0x7f24640ccc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.950+0000 7f2460ff9700 1 -- 172.21.15.6:0/2535065566 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c018030 con 0x7f2450004810 2023-10-06T02:30:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.950+0000 7f2460ff9700 1 -- 172.21.15.6:0/2535065566 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c00f8a0 con 0x7f2450004810 2023-10-06T02:30:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.950+0000 7f246ae21700 1 -- 172.21.15.6:0/2535065566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f246416aca0 con 0x7f2450004810 2023-10-06T02:30:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.950+0000 7f2460ff9700 1 -- 172.21.15.6:0/2535065566 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c00fc60 con 0x7f2450004810 2023-10-06T02:30:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.950+0000 7f246ae21700 1 -- 172.21.15.6:0/2535065566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246416b260 con 0x7f2450004810 2023-10-06T02:30:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.951+0000 7f246ae21700 1 -- 172.21.15.6:0/2535065566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246416b480 con 0x7f2450004810 2023-10-06T02:30:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.951+0000 7f2460ff9700 1 -- 172.21.15.6:0/2535065566 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f244c01b070 con 0x7f2450004810 2023-10-06T02:30:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.952+0000 7f2460ff9700 1 --2- 172.21.15.6:0/2535065566 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2444066f30 0x7f24440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.952+0000 7f2460ff9700 1 -- 172.21.15.6:0/2535065566 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f244c019070 con 0x7f2450004810 2023-10-06T02:30:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.952+0000 7f2463fff700 1 --2- 172.21.15.6:0/2535065566 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2444066f30 0x7f24440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.953+0000 7f2463fff700 1 --2- 172.21.15.6:0/2535065566 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2444066f30 0x7f24440693e0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f246415c130 tx=0x7f245401a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:17.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:17.956+0000 7f2460ff9700 1 -- 172.21.15.6:0/2535065566 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f244c051850 con 0x7f2450004810 2023-10-06T02:30:18.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:18.195+0000 7f246ae21700 1 -- 172.21.15.6:0/2535065566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f24640cad20 con 0x7f2450004810 2023-10-06T02:30:18.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:18.195+0000 7f2460ff9700 1 -- 172.21.15.6:0/2535065566 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v359) v1 ==== 53+0+73 (secure 0 0 0) 0x7f244c054e70 con 0x7f2450004810 2023-10-06T02:30:18.196 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:30:18.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:18.197+0000 7f246ae21700 1 -- 172.21.15.6:0/2535065566 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2444066f30 msgr2=0x7f24440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:18.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:18.197+0000 7f246ae21700 1 --2- 172.21.15.6:0/2535065566 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2444066f30 0x7f24440693e0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f246415c130 tx=0x7f245401a000 comp rx=0 tx=0).stop 2023-10-06T02:30:18.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:18.197+0000 7f246ae21700 1 -- 172.21.15.6:0/2535065566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2450004810 msgr2=0x7f2464152a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:18.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:18.197+0000 7f246ae21700 1 --2- 172.21.15.6:0/2535065566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2450004810 0x7f2464152a00 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7f244c001c00 tx=0x7f24640ccc80 comp rx=0 tx=0).stop 2023-10-06T02:30:18.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:18.197+0000 7f246ae21700 1 -- 172.21.15.6:0/2535065566 shutdown_connections 2023-10-06T02:30:18.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:18.197+0000 7f246ae21700 1 --2- 172.21.15.6:0/2535065566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2464157f30 0x7f24641583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:18.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:18.197+0000 7f246ae21700 1 --2- 172.21.15.6:0/2535065566 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2444066f30 0x7f24440693e0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:18.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:18.197+0000 7f246ae21700 1 --2- 172.21.15.6:0/2535065566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2450004810 0x7f2464152a00 unknown :-1 s=CLOSED pgs=2431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:18.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:18.197+0000 7f246ae21700 1 --2- 172.21.15.6:0/2535065566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24640b3e90 0x7f24640c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:18.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:18.197+0000 7f246ae21700 1 -- 172.21.15.6:0/2535065566 >> 172.21.15.6:0/2535065566 conn(0x7f2464068680 msgr2=0x7f24640cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:18.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:18.198+0000 7f246ae21700 1 -- 172.21.15.6:0/2535065566 shutdown_connections 2023-10-06T02:30:18.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:18.198+0000 7f246ae21700 1 -- 172.21.15.6:0/2535065566 wait complete. 2023-10-06T02:30:18.210 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:30:18.210 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:30:18.210 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:30:18.210 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:30:18.211 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:30:18.211 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:30:18.211 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:30:18.211 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:30:18.211 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:30:18.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:18.211 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:30:18.227 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:30:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:30:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:30:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:30:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:30:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:30:18.227 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:30:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:30:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:30:18.228 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:30:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:30:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:30:18.228 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:30:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:30:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:30:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:30:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41728sec preferred_lft 41728sec 2023-10-06T02:30:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:30:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:30:18.229 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:30:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:30:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:30:18.229 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:30:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:30:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:30:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:30:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:30:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:30:18.229 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:30:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:30:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:30:18.230 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:30:18.230 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:30:18.230 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:30:18.230 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:30:18.230 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:30:18.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:18.230 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:30:18.291 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:30:18.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:18.293 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:30:18.349 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:30:18.349 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:30:18.349 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:30:18.349 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:30:18.349 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:30:18.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:18.350 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:30:18.350 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:30:18.350 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:30:18.350 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:30:18.350 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:30:18.350 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:30:18.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:18.452 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:30:18.466 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:30:18.467 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:30:18.467 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:30:18.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:18.467 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:30:18.533 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:30:18.534 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:30:18.534 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:30:18.588 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:30:18.588 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:30:18.589 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:30:18.643 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:30:18.709 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:30:18.709 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:30:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:30:18.775 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:30:18.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:18.776 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:30:18.830 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:30:18.830 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:30:18.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:30:18.898 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:30:18.898 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:30:18.959 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:30:18.958+0000 7fe95d2dc540 -1 init, newargv = 0x555ce17e2950 newargc=15 2023-10-06T02:30:18.959 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[146350]: starting ceph client 2023-10-06T02:30:18.963 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[146350]: starting fuse 2023-10-06T02:30:18.967 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:30:18.968 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:30:18.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:18.969 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:30:19.024 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:30:19.025 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:30:19.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:30:19.025 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:30:19.025 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:30:19.025 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:30:19.025 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:30:19.025 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:30:19.026 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:30:19.026 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:30:19.026 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:30:19.026 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:30:19.026 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:30:19.026 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:30:19.026 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:30:19.026 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:30:19.026 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:30:19.026 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:30:19.026 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:30:19.027 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:30:19.027 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:30:19.027 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:30:19.027 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:30:19.027 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:30:19.027 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:30:19.027 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:30:19.027 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:30:19.027 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:30:19.027 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:30:19.149 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.146350.asok 2023-10-06T02:30:19.331 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.146350.asok 2023-10-06T02:30:19.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:19.331 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.146350.asok status 2023-10-06T02:30:19.486 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:30:19.487 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:30:19.487 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:30:19.487 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:30:19.487 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:30:19.487 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:30:19.487 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:30:19.487 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "146350", 2023-10-06T02:30:19.487 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:30:19.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:19.487 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:30:19.488 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:30:19.488 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 11064, 2023-10-06T02:30:19.488 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:30:19.488 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:30:19.488 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:30:19.488 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 11064 2023-10-06T02:30:19.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:19.488 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:30:19.488 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:30:19.488 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:30:19.488 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 143827741 2023-10-06T02:30:19.488 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:19.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:19.489 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:30:19.489 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:30:19.489 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:30:19.489 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 143827741 2023-10-06T02:30:19.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:19.489 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.11064 192.168.0.1:0/143827741", 2023-10-06T02:30:19.489 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/143827741", 2023-10-06T02:30:19.489 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:30:19.489 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 359, 2023-10-06T02:30:19.489 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 146, 2023-10-06T02:30:19.489 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:30:19.489 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:30:19.490 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:30:19.490 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:30:19.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:19.496 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:30:19.497 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:30:19.512 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:30:19.512 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:30:19.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:19.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:30:19.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:19.578 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir1) 2023-10-06T02:30:19.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:19.639 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir1/file1) 2023-10-06T02:30:19.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:19.697 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir2) 2023-10-06T02:30:19.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:19.755 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir2/file2) 2023-10-06T02:30:19.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:19.815 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2023-10-06T02:30:19.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:19.873 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir1/file1 testdir/hardlink1) 2023-10-06T02:30:19.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:19.934 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir2/file2 testdir/hardlink2) 2023-10-06T02:30:19.993 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:30:19.993 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:30:19.993 DEBUG:teuthology.orchestra.run.smithi006:> import stat 2023-10-06T02:30:19.993 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:30:19.993 DEBUG:teuthology.orchestra.run.smithi006:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir1/file1").st_ino) 2023-10-06T02:30:19.993 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:30:20.098 INFO:teuthology.orchestra.run.smithi006.stdout:1099511627777 2023-10-06T02:30:20.287 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:30:20.287 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:30:20.287 DEBUG:teuthology.orchestra.run.smithi006:> import stat 2023-10-06T02:30:20.287 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:30:20.287 DEBUG:teuthology.orchestra.run.smithi006:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir2/file2").st_ino) 2023-10-06T02:30:20.287 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:30:20.394 INFO:teuthology.orchestra.run.smithi006.stdout:1099511628279 2023-10-06T02:30:20.583 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:30:20.583 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:30:20.583 DEBUG:teuthology.orchestra.run.smithi006:> import stat 2023-10-06T02:30:20.583 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:30:20.583 DEBUG:teuthology.orchestra.run.smithi006:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir2").st_ino) 2023-10-06T02:30:20.583 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:30:20.689 INFO:teuthology.orchestra.run.smithi006.stdout:1099511628278 2023-10-06T02:30:20.878 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:30:20.878 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:30:20.878 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:30:20.958 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[146350]: fuse finished with error 0 and tester_r 0 2023-10-06T02:30:20.960 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:30:22.644 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:30:22.646 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:30:27.061 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:30:27.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:27.062 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:30:27.081 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:30:27.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.253+0000 7fd79f556700 1 Processor -- start 2023-10-06T02:30:27.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.253+0000 7fd79f556700 1 -- start start 2023-10-06T02:30:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.254+0000 7fd79f556700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd7980af8b0 0x7fd79815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.254+0000 7fd79f556700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79815e190 con 0x7fd7980b27f0 2023-10-06T02:30:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.254+0000 7fd79f556700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7980cb650 con 0x7fd7980af4e0 2023-10-06T02:30:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.254+0000 7fd79f556700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7980b1910 con 0x7fd7980af8b0 2023-10-06T02:30:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.254+0000 7fd79daf3700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd7980b27f0 0x7fd79815d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38002/0 (socket says 172.21.15.6:38002) 2023-10-06T02:30:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.254+0000 7fd79daf3700 1 -- 172.21.15.6:0/2551834254 learned_addr learned my addr 172.21.15.6:0/2551834254 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.254+0000 7fd79caf1700 1 --2- 172.21.15.6:0/2551834254 >> v2:172.21.15.175:3300/0 conn(0x7fd7980af8b0 0x7fd79815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.254+0000 7fd797fff700 1 -- 172.21.15.6:0/2551834254 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622782842 0 0) 0x7fd79815e190 con 0x7fd7980b27f0 2023-10-06T02:30:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.255+0000 7fd797fff700 1 -- 172.21.15.6:0/2551834254 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd780003570 con 0x7fd7980b27f0 2023-10-06T02:30:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.255+0000 7fd79caf1700 1 -- 172.21.15.6:0/2551834254 >> v1:172.21.15.175:6789/0 conn(0x7fd7980af4e0 legacy=0x7fd7980b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.255+0000 7fd79caf1700 1 -- 172.21.15.6:0/2551834254 >> v1:172.21.15.6:6789/0 conn(0x7fd7980b27f0 legacy=0x7fd79815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.255+0000 7fd79caf1700 1 -- 172.21.15.6:0/2551834254 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7980ccaf0 con 0x7fd7980af8b0 2023-10-06T02:30:27.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.255+0000 7fd79caf1700 1 --2- 172.21.15.6:0/2551834254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7980af8b0 0x7fd79815d460 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0098e0 tx=0x7fd78c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e5b5e0cc78a9a05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:27.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.255+0000 7fd797fff700 1 -- 172.21.15.6:0/2551834254 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c00b640 con 0x7fd7980af8b0 2023-10-06T02:30:27.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.255+0000 7fd797fff700 1 -- 172.21.15.6:0/2551834254 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c00b7a0 con 0x7fd7980af8b0 2023-10-06T02:30:27.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.255+0000 7fd797fff700 1 -- 172.21.15.6:0/2551834254 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c00bb40 con 0x7fd7980af8b0 2023-10-06T02:30:27.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.256+0000 7fd79f556700 1 -- 172.21.15.6:0/2551834254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7980af8b0 msgr2=0x7fd79815d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:27.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.256+0000 7fd79f556700 1 --2- 172.21.15.6:0/2551834254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7980af8b0 0x7fd79815d460 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0098e0 tx=0x7fd78c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:27.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.256+0000 7fd79f556700 1 -- 172.21.15.6:0/2551834254 shutdown_connections 2023-10-06T02:30:27.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.256+0000 7fd79f556700 1 --2- 172.21.15.6:0/2551834254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7980af8b0 0x7fd79815d460 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:27.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.256+0000 7fd79f556700 1 -- 172.21.15.6:0/2551834254 >> 172.21.15.6:0/2551834254 conn(0x7fd798068680 msgr2=0x7fd798068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:27.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.256+0000 7fd79f556700 1 -- 172.21.15.6:0/2551834254 shutdown_connections 2023-10-06T02:30:27.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.256+0000 7fd79f556700 1 -- 172.21.15.6:0/2551834254 wait complete. 2023-10-06T02:30:27.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.257+0000 7fd79f556700 1 Processor -- start 2023-10-06T02:30:27.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.257+0000 7fd79f556700 1 -- start start 2023-10-06T02:30:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.258+0000 7fd79f556700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7980af4e0 0x7fd7981526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.258+0000 7fd79f556700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7980af8b0 0x7fd798157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.258+0000 7fd79f556700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7980b27f0 0x7fd798159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.258+0000 7fd79f556700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7980cf250 con 0x7fd7980af4e0 2023-10-06T02:30:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.258+0000 7fd79f556700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd798152ed0 con 0x7fd7980b27f0 2023-10-06T02:30:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.258+0000 7fd79f556700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7981531b0 con 0x7fd7980af8b0 2023-10-06T02:30:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.258+0000 7fd79d2f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7980af4e0 0x7fd7981526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:27.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.258+0000 7fd79d2f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7980af4e0 0x7fd7981526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41176/0 (socket says 172.21.15.6:41176) 2023-10-06T02:30:27.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.258+0000 7fd79d2f2700 1 -- 172.21.15.6:0/513295888 learned_addr learned my addr 172.21.15.6:0/513295888 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:27.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.258+0000 7fd79daf3700 1 --2- 172.21.15.6:0/513295888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7980b27f0 0x7fd798159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:27.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.258+0000 7fd79caf1700 1 --2- 172.21.15.6:0/513295888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7980af8b0 0x7fd798157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:27.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.258+0000 7fd79d2f2700 1 -- 172.21.15.6:0/513295888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7980af8b0 msgr2=0x7fd798157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:27.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.258+0000 7fd79d2f2700 1 --2- 172.21.15.6:0/513295888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7980af8b0 0x7fd798157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:27.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.258+0000 7fd79d2f2700 1 -- 172.21.15.6:0/513295888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7980b27f0 msgr2=0x7fd798159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:27.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.258+0000 7fd79d2f2700 1 --2- 172.21.15.6:0/513295888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7980b27f0 0x7fd798159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:27.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.258+0000 7fd79d2f2700 1 -- 172.21.15.6:0/513295888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c009420 con 0x7fd7980af4e0 2023-10-06T02:30:27.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.258+0000 7fd79d2f2700 1 --2- 172.21.15.6:0/513295888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7980af4e0 0x7fd7981526a0 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 crypto rx=0x7fd78800cb10 tx=0x7fd7880017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:27.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.259+0000 7fd7957fa700 1 -- 172.21.15.6:0/513295888 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78800ce20 con 0x7fd7980af4e0 2023-10-06T02:30:27.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.259+0000 7fd7957fa700 1 -- 172.21.15.6:0/513295888 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78800a7e0 con 0x7fd7980af4e0 2023-10-06T02:30:27.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.259+0000 7fd79f556700 1 -- 172.21.15.6:0/513295888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd798153490 con 0x7fd7980af4e0 2023-10-06T02:30:27.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.259+0000 7fd7957fa700 1 -- 172.21.15.6:0/513295888 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78800aba0 con 0x7fd7980af4e0 2023-10-06T02:30:27.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.259+0000 7fd79f556700 1 -- 172.21.15.6:0/513295888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd798152be0 con 0x7fd7980af4e0 2023-10-06T02:30:27.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.260+0000 7fd79f556700 1 -- 172.21.15.6:0/513295888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd798088aa0 con 0x7fd7980af4e0 2023-10-06T02:30:27.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.260+0000 7fd7957fa700 1 -- 172.21.15.6:0/513295888 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd788003030 con 0x7fd7980af4e0 2023-10-06T02:30:27.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.260+0000 7fd7957fa700 1 --2- 172.21.15.6:0/513295888 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd784066f30 0x7fd7840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:27.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.261+0000 7fd7957fa700 1 -- 172.21.15.6:0/513295888 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd788084760 con 0x7fd7980af4e0 2023-10-06T02:30:27.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.261+0000 7fd79caf1700 1 --2- 172.21.15.6:0/513295888 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd784066f30 0x7fd7840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:27.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.261+0000 7fd79caf1700 1 --2- 172.21.15.6:0/513295888 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd784066f30 0x7fd7840693e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0098e0 tx=0x7fd78c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:27.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.265+0000 7fd7957fa700 1 -- 172.21.15.6:0/513295888 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd788051730 con 0x7fd7980af4e0 2023-10-06T02:30:27.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.507+0000 7fd79f556700 1 -- 172.21.15.6:0/513295888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7980cad20 con 0x7fd7980af4e0 2023-10-06T02:30:27.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.508+0000 7fd7957fa700 1 -- 172.21.15.6:0/513295888 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 359 v359) v1 ==== 95+0+4606 (secure 0 0 0) 0x7fd788054d50 con 0x7fd7980af4e0 2023-10-06T02:30:27.509 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:27.509 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":359,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3603762205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3603762205},{"type":"v1","addr":"172.21.15.175:6836","nonce":3603762205}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":9820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3292446255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3292446255},{"type":"v1","addr":"172.21.15.175:6837","nonce":3292446255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":10869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/759655214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":759655214},{"type":"v1","addr":"172.21.15.6:6834","nonce":759655214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354}],"filesystems":[{"mdsmap":{"epoch":359,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:30:06.715272+0000","modified":"2023-10-06T02:30:10.342009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10872},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10872":{"gid":10872,"name":"c","rank":0,"incarnation":355,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1108543434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1108543434},{"type":"v1","addr":"172.21.15.6:6835","nonce":1108543434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:30:27.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.510+0000 7fd79f556700 1 -- 172.21.15.6:0/513295888 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd784066f30 msgr2=0x7fd7840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:27.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.510+0000 7fd79f556700 1 --2- 172.21.15.6:0/513295888 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd784066f30 0x7fd7840693e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0098e0 tx=0x7fd78c017000 comp rx=0 tx=0).stop 2023-10-06T02:30:27.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.510+0000 7fd79f556700 1 -- 172.21.15.6:0/513295888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7980af4e0 msgr2=0x7fd7981526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:27.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.510+0000 7fd79f556700 1 --2- 172.21.15.6:0/513295888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7980af4e0 0x7fd7981526a0 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 crypto rx=0x7fd78800cb10 tx=0x7fd7880017b0 comp rx=0 tx=0).stop 2023-10-06T02:30:27.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.510+0000 7fd79f556700 1 -- 172.21.15.6:0/513295888 shutdown_connections 2023-10-06T02:30:27.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.510+0000 7fd79f556700 1 --2- 172.21.15.6:0/513295888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7980b27f0 0x7fd798159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:27.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.510+0000 7fd79f556700 1 --2- 172.21.15.6:0/513295888 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd784066f30 0x7fd7840693e0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:27.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.510+0000 7fd79f556700 1 --2- 172.21.15.6:0/513295888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7980af4e0 0x7fd7981526a0 unknown :-1 s=CLOSED pgs=2436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:27.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.510+0000 7fd79f556700 1 --2- 172.21.15.6:0/513295888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7980af8b0 0x7fd798157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:27.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.510+0000 7fd79f556700 1 -- 172.21.15.6:0/513295888 >> 172.21.15.6:0/513295888 conn(0x7fd798068680 msgr2=0x7fd7980cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:27.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.510+0000 7fd79f556700 1 -- 172.21.15.6:0/513295888 shutdown_connections 2023-10-06T02:30:27.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.510+0000 7fd79f556700 1 -- 172.21.15.6:0/513295888 wait complete. 2023-10-06T02:30:27.512 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 359 2023-10-06T02:30:27.523 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-10-06T02:30:27.667 INFO:teuthology.orchestra.run.smithi006.stdout:{"message":"","return_code":0} 2023-10-06T02:30:27.668 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T02:30:27.668 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:30:27.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.787+0000 7f9c9d9e7700 1 Processor -- start 2023-10-06T02:30:27.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.787+0000 7f9c9d9e7700 1 -- start start 2023-10-06T02:30:27.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.788+0000 7f9c9d9e7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c98086ff0 0x7f9c98087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:27.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.788+0000 7f9c9d9e7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c980afc50 con 0x7f9c980b21b0 2023-10-06T02:30:27.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.788+0000 7f9c9d9e7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c980aff30 con 0x7f9c9815a030 2023-10-06T02:30:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.788+0000 7f9c9d9e7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c980b0cf0 con 0x7f9c98086ff0 2023-10-06T02:30:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.788+0000 7f9c967fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c98086ff0 0x7f9c98087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.788+0000 7f9c977fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9c980b21b0 0x7f9c980b2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38014/0 (socket says 172.21.15.6:38014) 2023-10-06T02:30:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.788+0000 7f9c967fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c98086ff0 0x7f9c98087470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41188/0 (socket says 172.21.15.6:41188) 2023-10-06T02:30:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.788+0000 7f9c977fe700 1 -- 172.21.15.6:0/355418827 learned_addr learned my addr 172.21.15.6:0/355418827 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.789+0000 7f9c967fc700 1 -- 172.21.15.6:0/355418827 >> v1:172.21.15.175:6789/0 conn(0x7f9c9815a030 legacy=0x7f9c9815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.789+0000 7f9c967fc700 1 -- 172.21.15.6:0/355418827 >> v1:172.21.15.6:6789/0 conn(0x7f9c980b21b0 legacy=0x7f9c980b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.789+0000 7f9c967fc700 1 -- 172.21.15.6:0/355418827 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c980b0210 con 0x7f9c98086ff0 2023-10-06T02:30:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.789+0000 7f9c967fc700 1 --2- 172.21.15.6:0/355418827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c98086ff0 0x7f9c98087470 secure :-1 s=READY pgs=2438 cs=0 l=1 rev1=1 crypto rx=0x7f9c800098e0 tx=0x7f9c800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffb681964f28cec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.789+0000 7f9c95ffb700 1 -- 172.21.15.6:0/355418827 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80009e80 con 0x7f9c98086ff0 2023-10-06T02:30:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.789+0000 7f9c95ffb700 1 -- 172.21.15.6:0/355418827 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8000b820 con 0x7f9c98086ff0 2023-10-06T02:30:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.789+0000 7f9c95ffb700 1 -- 172.21.15.6:0/355418827 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8000bba0 con 0x7f9c98086ff0 2023-10-06T02:30:27.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.789+0000 7f9c9d9e7700 1 -- 172.21.15.6:0/355418827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c98086ff0 msgr2=0x7f9c98087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:27.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.789+0000 7f9c9d9e7700 1 --2- 172.21.15.6:0/355418827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c98086ff0 0x7f9c98087470 secure :-1 s=READY pgs=2438 cs=0 l=1 rev1=1 crypto rx=0x7f9c800098e0 tx=0x7f9c800091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:27.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.789+0000 7f9c9d9e7700 1 -- 172.21.15.6:0/355418827 shutdown_connections 2023-10-06T02:30:27.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.789+0000 7f9c9d9e7700 1 --2- 172.21.15.6:0/355418827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c98086ff0 0x7f9c98087470 unknown :-1 s=CLOSED pgs=2438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:27.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.790+0000 7f9c9d9e7700 1 -- 172.21.15.6:0/355418827 >> 172.21.15.6:0/355418827 conn(0x7f9c98068680 msgr2=0x7f9c98068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:27.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.790+0000 7f9c9d9e7700 1 -- 172.21.15.6:0/355418827 shutdown_connections 2023-10-06T02:30:27.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.790+0000 7f9c9d9e7700 1 -- 172.21.15.6:0/355418827 wait complete. 2023-10-06T02:30:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.791+0000 7f9c9d9e7700 1 Processor -- start 2023-10-06T02:30:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.791+0000 7f9c9d9e7700 1 -- start start 2023-10-06T02:30:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.791+0000 7f9c9d9e7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c98086ff0 0x7f9c980c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.791+0000 7f9c9d9e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c980b21b0 0x7f9c9816a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c9d9e7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9815a030 0x7f9c980c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c9d9e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980c76b0 con 0x7f9c980b21b0 2023-10-06T02:30:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c9d9e7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980c7990 con 0x7f9c98086ff0 2023-10-06T02:30:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c9d9e7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980c7c70 con 0x7f9c9815a030 2023-10-06T02:30:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c967fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c980b21b0 0x7f9c9816a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c967fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c980b21b0 0x7f9c9816a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41204/0 (socket says 172.21.15.6:41204) 2023-10-06T02:30:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c967fc700 1 -- 172.21.15.6:0/3722582493 learned_addr learned my addr 172.21.15.6:0/3722582493 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c96ffd700 1 --2- 172.21.15.6:0/3722582493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c98086ff0 0x7f9c980c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c977fe700 1 --2- 172.21.15.6:0/3722582493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9815a030 0x7f9c980c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c967fc700 1 -- 172.21.15.6:0/3722582493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9815a030 msgr2=0x7f9c980c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c967fc700 1 --2- 172.21.15.6:0/3722582493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9815a030 0x7f9c980c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c967fc700 1 -- 172.21.15.6:0/3722582493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c98086ff0 msgr2=0x7f9c980c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c967fc700 1 --2- 172.21.15.6:0/3722582493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c98086ff0 0x7f9c980c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c967fc700 1 -- 172.21.15.6:0/3722582493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c80009420 con 0x7f9c980b21b0 2023-10-06T02:30:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c977fe700 1 --2- 172.21.15.6:0/3722582493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9815a030 0x7f9c980c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c967fc700 1 --2- 172.21.15.6:0/3722582493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c980b21b0 0x7f9c9816a8e0 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 crypto rx=0x7f9c800030c0 tx=0x7f9c80016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c8effd700 1 -- 172.21.15.6:0/3722582493 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8000ba60 con 0x7f9c980b21b0 2023-10-06T02:30:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c8effd700 1 -- 172.21.15.6:0/3722582493 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c80020070 con 0x7f9c980b21b0 2023-10-06T02:30:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c9d9e7700 1 -- 172.21.15.6:0/3722582493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c980c7f50 con 0x7f9c980b21b0 2023-10-06T02:30:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c8effd700 1 -- 172.21.15.6:0/3722582493 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8000bbe0 con 0x7f9c980b21b0 2023-10-06T02:30:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.792+0000 7f9c9d9e7700 1 -- 172.21.15.6:0/3722582493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c980c8750 con 0x7f9c980b21b0 2023-10-06T02:30:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.793+0000 7f9c9d9e7700 1 -- 172.21.15.6:0/3722582493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c98087470 con 0x7f9c980b21b0 2023-10-06T02:30:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.794+0000 7f9c8effd700 1 -- 172.21.15.6:0/3722582493 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c80022030 con 0x7f9c980b21b0 2023-10-06T02:30:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.794+0000 7f9c8effd700 1 --2- 172.21.15.6:0/3722582493 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c78066f30 0x7f9c780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.794+0000 7f9c8effd700 1 -- 172.21.15.6:0/3722582493 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9c800866e0 con 0x7f9c980b21b0 2023-10-06T02:30:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.795+0000 7f9c96ffd700 1 --2- 172.21.15.6:0/3722582493 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c78066f30 0x7f9c780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:27.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.795+0000 7f9c96ffd700 1 --2- 172.21.15.6:0/3722582493 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c78066f30 0x7f9c780693e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f9c90003a30 tx=0x7f9c90007ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:27.799+0000 7f9c8effd700 1 -- 172.21.15.6:0/3722582493 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c800536b0 con 0x7f9c980b21b0 2023-10-06T02:30:28.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.038+0000 7f9c9d9e7700 1 -- 172.21.15.6:0/3722582493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9c98087470 con 0x7f9c980b21b0 2023-10-06T02:30:28.040 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:30:28.039+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:30:28.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.046+0000 7f9c8effd700 1 -- 172.21.15.6:0/3722582493 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v360) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9c80056cd0 con 0x7f9c980b21b0 2023-10-06T02:30:28.048 INFO:tasks.ceph.mds.c.smithi006.stderr: -5049> 2023-10-06T02:30:11.624+0000 7fb4ad8eb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:30:28.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.048+0000 7f9c9d9e7700 1 -- 172.21.15.6:0/3722582493 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c78066f30 msgr2=0x7f9c780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.048+0000 7f9c9d9e7700 1 --2- 172.21.15.6:0/3722582493 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c78066f30 0x7f9c780693e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f9c90003a30 tx=0x7f9c90007ea0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.048+0000 7f9c9d9e7700 1 -- 172.21.15.6:0/3722582493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c980b21b0 msgr2=0x7f9c9816a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.048+0000 7f9c9d9e7700 1 --2- 172.21.15.6:0/3722582493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c980b21b0 0x7f9c9816a8e0 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 crypto rx=0x7f9c800030c0 tx=0x7f9c80016000 comp rx=0 tx=0).stop 2023-10-06T02:30:28.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.048+0000 7f9c9d9e7700 1 -- 172.21.15.6:0/3722582493 shutdown_connections 2023-10-06T02:30:28.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.048+0000 7f9c9d9e7700 1 --2- 172.21.15.6:0/3722582493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9815a030 0x7f9c980c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.048+0000 7f9c9d9e7700 1 --2- 172.21.15.6:0/3722582493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c98086ff0 0x7f9c980c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.048+0000 7f9c9d9e7700 1 --2- 172.21.15.6:0/3722582493 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c78066f30 0x7f9c780693e0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.048+0000 7f9c9d9e7700 1 --2- 172.21.15.6:0/3722582493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c980b21b0 0x7f9c9816a8e0 unknown :-1 s=CLOSED pgs=2439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.048+0000 7f9c9d9e7700 1 -- 172.21.15.6:0/3722582493 >> 172.21.15.6:0/3722582493 conn(0x7f9c98068680 msgr2=0x7f9c980cb450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:28.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.048+0000 7f9c9d9e7700 1 -- 172.21.15.6:0/3722582493 shutdown_connections 2023-10-06T02:30:28.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.048+0000 7f9c9d9e7700 1 -- 172.21.15.6:0/3722582493 wait complete. 2023-10-06T02:30:28.050 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:30:28.061 DEBUG:teuthology.orchestra.run.smithi006:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2023-10-06T02:30:28.074 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-06T02:30:28.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.097+0000 7f18f45d9240 1 -- start start 2023-10-06T02:30:28.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.097+0000 7f18f45d9240 1 Processor -- start 2023-10-06T02:30:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.098+0000 7f18f45d9240 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2be400 0x555acef00580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.098+0000 7f18f45d9240 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ace2be800 0x555acef00b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.098+0000 7f18f45d9240 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555ace2bec00 0x555acef01080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.098+0000 7f18f45d9240 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ace189cc0 con 0x555ace2be400 2023-10-06T02:30:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.098+0000 7f18f45d9240 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ace189540 con 0x555ace2be800 2023-10-06T02:30:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.098+0000 7f18f45d9240 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x555ace189b80 con 0x555ace2bec00 2023-10-06T02:30:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.098+0000 7f18edaa7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2be400 0x555acef00580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.098+0000 7f18edaa7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2be400 0x555acef00580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41232/0 (socket says 172.21.15.6:41232) 2023-10-06T02:30:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.098+0000 7f18edaa7700 1 -- 172.21.15.6:0/3214023156 learned_addr learned my addr 172.21.15.6:0/3214023156 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.098+0000 7f18ed2a6700 1 --2- 172.21.15.6:0/3214023156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ace2be800 0x555acef00b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.098+0000 7f18ee2a8700 1 --2- 172.21.15.6:0/3214023156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555ace2bec00 0x555acef01080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.098+0000 7f18edaa7700 1 -- 172.21.15.6:0/3214023156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555ace2bec00 msgr2=0x555acef01080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.098+0000 7f18edaa7700 1 --2- 172.21.15.6:0/3214023156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555ace2bec00 0x555acef01080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.098+0000 7f18edaa7700 1 -- 172.21.15.6:0/3214023156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ace2be800 msgr2=0x555acef00b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.098+0000 7f18edaa7700 1 --2- 172.21.15.6:0/3214023156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ace2be800 0x555acef00b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.098+0000 7f18edaa7700 1 -- 172.21.15.6:0/3214023156 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ace16c340 con 0x555ace2be400 2023-10-06T02:30:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.099+0000 7f18edaa7700 1 --2- 172.21.15.6:0/3214023156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2be400 0x555acef00580 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 crypto rx=0x555ace2c0030 tx=0x555acef0c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e42609f56de82c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.099+0000 7f18eb2a2700 1 -- 172.21.15.6:0/3214023156 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555ace181080 con 0x555ace2be400 2023-10-06T02:30:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.099+0000 7f18eb2a2700 1 -- 172.21.15.6:0/3214023156 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ace19e480 con 0x555ace2be400 2023-10-06T02:30:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.099+0000 7f18eb2a2700 1 -- 172.21.15.6:0/3214023156 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555ace181600 con 0x555ace2be400 2023-10-06T02:30:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.099+0000 7f18f45d9240 1 -- 172.21.15.6:0/3214023156 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ace16c000 con 0x555ace2be400 2023-10-06T02:30:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.099+0000 7f18f45d9240 1 -- 172.21.15.6:0/3214023156 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x555ace16cea0 con 0x555ace2be400 2023-10-06T02:30:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.099+0000 7f18f45d9240 4 waiting for MDS map... 2023-10-06T02:30:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.099+0000 7f18eb2a2700 1 -- 172.21.15.6:0/3214023156 <== mon.0 v2:172.21.15.6:3300/0 4 ==== osd_map(147..147 src has 1..147) v4 ==== 6464+0+0 (secure 0 0 0) 0x555ace18cc40 con 0x555ace2be400 2023-10-06T02:30:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.099+0000 7f18eb2a2700 1 -- 172.21.15.6:0/3214023156 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 360) v1 ==== 2559+0+0 (secure 0 0 0) 0x555acef44900 con 0x555ace2be400 2023-10-06T02:30:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.099+0000 7f18f45d9240 4 Got MDS map 360 2023-10-06T02:30:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.099+0000 7f18f45d9240 10 main: JournalTool::main 2023-10-06T02:30:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.099+0000 7f18f45d9240 4 main: JournalTool: connecting to RADOS... 2023-10-06T02:30:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.100+0000 7f18f45d9240 1 Processor -- start 2023-10-06T02:30:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.100+0000 7f18f45d9240 1 -- start start 2023-10-06T02:30:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.100+0000 7f18f45d9240 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555ace2bf800 0x555acef01600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.100+0000 7f18f45d9240 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2bfc00 0x555acef01b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.100+0000 7f18f45d9240 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555acef9c000 0x555acef02100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.100+0000 7f18f45d9240 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ace188dc0 con 0x555ace2bfc00 2023-10-06T02:30:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.100+0000 7f18f45d9240 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ace189b80 con 0x555acef9c000 2023-10-06T02:30:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.100+0000 7f18f45d9240 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x555ace189540 con 0x555ace2bf800 2023-10-06T02:30:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.100+0000 7f18edaa7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2bfc00 0x555acef01b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.100+0000 7f18edaa7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2bfc00 0x555acef01b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41234/0 (socket says 172.21.15.6:41234) 2023-10-06T02:30:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.100+0000 7f18edaa7700 1 -- 172.21.15.6:0/3885555630 learned_addr learned my addr 172.21.15.6:0/3885555630 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.100+0000 7f18ee2a8700 1 --2- 172.21.15.6:0/3885555630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555ace2bf800 0x555acef01600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.100+0000 7f18ed2a6700 1 --2- 172.21.15.6:0/3885555630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555acef9c000 0x555acef02100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18edaa7700 1 -- 172.21.15.6:0/3885555630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555ace2bf800 msgr2=0x555acef01600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18edaa7700 1 --2- 172.21.15.6:0/3885555630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555ace2bf800 0x555acef01600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18edaa7700 1 -- 172.21.15.6:0/3885555630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555acef9c000 msgr2=0x555acef02100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18edaa7700 1 --2- 172.21.15.6:0/3885555630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555acef9c000 0x555acef02100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18edaa7700 1 -- 172.21.15.6:0/3885555630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ace16d860 con 0x555ace2bfc00 2023-10-06T02:30:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18ee2a8700 1 --2- 172.21.15.6:0/3885555630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555ace2bf800 0x555acef01600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18ed2a6700 1 --2- 172.21.15.6:0/3885555630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555acef9c000 0x555acef02100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18edaa7700 1 --2- 172.21.15.6:0/3885555630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2bfc00 0x555acef01b80 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x555ace2c14a0 tx=0x555acef0c060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5632d946efe3828a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18e929e700 1 -- 172.21.15.6:0/3885555630 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555ace1811e0 con 0x555ace2bfc00 2023-10-06T02:30:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18e929e700 1 -- 172.21.15.6:0/3885555630 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ace19ec00 con 0x555ace2bfc00 2023-10-06T02:30:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18e929e700 1 -- 172.21.15.6:0/3885555630 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555ace180f20 con 0x555ace2bfc00 2023-10-06T02:30:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18f45d9240 1 -- 172.21.15.6:0/3885555630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2bfc00 msgr2=0x555acef01b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3885555630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2bfc00 0x555acef01b80 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x555ace2c14a0 tx=0x555acef0c060 comp rx=0 tx=0).stop 2023-10-06T02:30:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18f45d9240 1 -- 172.21.15.6:0/3885555630 shutdown_connections 2023-10-06T02:30:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3885555630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555acef9c000 0x555acef02100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3885555630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555ace2bf800 0x555acef01600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3885555630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2bfc00 0x555acef01b80 unknown :-1 s=CLOSED pgs=2445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18f45d9240 1 -- 172.21.15.6:0/3885555630 >> 172.21.15.6:0/3885555630 conn(0x555ace2bf000 msgr2=0x555ace239800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18f45d9240 1 -- 172.21.15.6:0/3885555630 shutdown_connections 2023-10-06T02:30:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.101+0000 7f18f45d9240 1 -- 172.21.15.6:0/3885555630 wait complete. 2023-10-06T02:30:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.102+0000 7f18f45d9240 1 Processor -- start 2023-10-06T02:30:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.102+0000 7f18f45d9240 1 -- start start 2023-10-06T02:30:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.103+0000 7f18f45d9240 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ace2bfc00 0x555acef02c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.103+0000 7f18f45d9240 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2bf800 0x555acef02680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.103+0000 7f18f45d9240 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555acefc6000 0x555acef02100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.103+0000 7f18f45d9240 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ace1883c0 con 0x555ace2bf800 2023-10-06T02:30:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.103+0000 7f18f45d9240 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ace188000 con 0x555ace2bfc00 2023-10-06T02:30:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.103+0000 7f18f45d9240 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x555ace189180 con 0x555acefc6000 2023-10-06T02:30:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.103+0000 7f18edaa7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2bf800 0x555acef02680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.103+0000 7f18edaa7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2bf800 0x555acef02680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41250/0 (socket says 172.21.15.6:41250) 2023-10-06T02:30:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.103+0000 7f18edaa7700 1 -- 172.21.15.6:0/1338290689 learned_addr learned my addr 172.21.15.6:0/1338290689 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.103+0000 7f18ee2a8700 1 --2- 172.21.15.6:0/1338290689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ace2bfc00 0x555acef02c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.103+0000 7f18ed2a6700 1 --2- 172.21.15.6:0/1338290689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555acefc6000 0x555acef02100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.103+0000 7f18edaa7700 1 -- 172.21.15.6:0/1338290689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555acefc6000 msgr2=0x555acef02100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.103+0000 7f18edaa7700 1 --2- 172.21.15.6:0/1338290689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555acefc6000 0x555acef02100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.103+0000 7f18edaa7700 1 -- 172.21.15.6:0/1338290689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ace2bfc00 msgr2=0x555acef02c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.103+0000 7f18edaa7700 1 --2- 172.21.15.6:0/1338290689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ace2bfc00 0x555acef02c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.103+0000 7f18edaa7700 1 -- 172.21.15.6:0/1338290689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ace16cea0 con 0x555ace2bf800 2023-10-06T02:30:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.103+0000 7f18edaa7700 1 --2- 172.21.15.6:0/1338290689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2bf800 0x555acef02680 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x555ace2c1740 tx=0x555acef58cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.104+0000 7f18e7a9b700 1 -- 172.21.15.6:0/1338290689 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555ace1811e0 con 0x555ace2bf800 2023-10-06T02:30:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.104+0000 7f18e7a9b700 1 -- 172.21.15.6:0/1338290689 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555acef52300 con 0x555ace2bf800 2023-10-06T02:30:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.104+0000 7f18f45d9240 1 -- 172.21.15.6:0/1338290689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555ace16da00 con 0x555ace2bf800 2023-10-06T02:30:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.104+0000 7f18e7a9b700 1 -- 172.21.15.6:0/1338290689 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555ace180f20 con 0x555ace2bf800 2023-10-06T02:30:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.104+0000 7f18f45d9240 1 -- 172.21.15.6:0/1338290689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ace16c9c0 con 0x555ace2bf800 2023-10-06T02:30:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.104+0000 7f18f45d9240 4 main: JournalTool: resolving pool 16 2023-10-06T02:30:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.105+0000 7f18e7a9b700 1 -- 172.21.15.6:0/1338290689 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x555aceebf080 con 0x555ace2bf800 2023-10-06T02:30:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.106+0000 7f18e7a9b700 1 --2- 172.21.15.6:0/1338290689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x555acefc8800 0x555acef03700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.106+0000 7f18e7a9b700 1 -- 172.21.15.6:0/1338290689 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6464+0+0 (secure 0 0 0) 0x555ace18ca80 con 0x555ace2bf800 2023-10-06T02:30:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.106+0000 7f18f45d9240 4 main: JournalTool: creating IoCtx.. 2023-10-06T02:30:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.106+0000 7f18f45d9240 4 main: Executing for rank 0 2023-10-06T02:30:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.106+0000 7f18ee2a8700 1 --2- 172.21.15.6:0/1338290689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x555acefc8800 0x555acef03700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.106+0000 7f18ee2a8700 1 --2- 172.21.15.6:0/1338290689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x555acefc8800 0x555acef03700 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x555aceec9680 tx=0x555acf0b4c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.107+0000 7f18f45d9240 1 -- start start 2023-10-06T02:30:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.107+0000 7f18f45d9240 1 Processor -- start 2023-10-06T02:30:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.107+0000 7f18f45d9240 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555acefc6800 0x555acef01600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.107+0000 7f18f45d9240 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555acefc6c00 0x555acf104000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.107+0000 7f18f45d9240 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555acefc7000 0x555acf104580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.107+0000 7f18f45d9240 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ace210dc0 con 0x555acefc6c00 2023-10-06T02:30:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.107+0000 7f18f45d9240 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ace189540 con 0x555acefc7000 2023-10-06T02:30:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.107+0000 7f18f45d9240 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x555ace189b80 con 0x555acefc6800 2023-10-06T02:30:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.107+0000 7f18edaa7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555acefc6c00 0x555acf104000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.107+0000 7f18edaa7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555acefc6c00 0x555acf104000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41264/0 (socket says 172.21.15.6:41264) 2023-10-06T02:30:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.107+0000 7f18edaa7700 1 -- 172.21.15.6:0/3594852205 learned_addr learned my addr 172.21.15.6:0/3594852205 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.107+0000 7f18ee2a8700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555acefc6800 0x555acef01600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18ed2a6700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555acefc7000 0x555acf104580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18edaa7700 1 -- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555acefc6800 msgr2=0x555acef01600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18edaa7700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555acefc6800 0x555acef01600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18edaa7700 1 -- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555acefc7000 msgr2=0x555acf104580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18edaa7700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555acefc7000 0x555acf104580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18edaa7700 1 -- 172.21.15.6:0/3594852205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ace16c000 con 0x555acefc6c00 2023-10-06T02:30:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18edaa7700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555acefc6c00 0x555acf104000 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 crypto rx=0x555acf046240 tx=0x555acf0b4d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60c336dbddba442 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18e4a95700 1 -- 172.21.15.6:0/3594852205 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555ace181080 con 0x555acefc6c00 2023-10-06T02:30:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18e4a95700 1 -- 172.21.15.6:0/3594852205 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ace19ed80 con 0x555acefc6c00 2023-10-06T02:30:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18e4a95700 1 -- 172.21.15.6:0/3594852205 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555ace181600 con 0x555acefc6c00 2023-10-06T02:30:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ace16dba0 con 0x555acefc6c00 2023-10-06T02:30:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x555aceffed00 con 0x555acefc6c00 2023-10-06T02:30:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18f45d9240 4 waiting for MDS map... 2023-10-06T02:30:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18e4a95700 1 -- 172.21.15.6:0/3594852205 <== mon.0 v2:172.21.15.6:3300/0 4 ==== osd_map(147..147 src has 1..147) v4 ==== 6464+0+0 (secure 0 0 0) 0x555ace18c8c0 con 0x555acefc6c00 2023-10-06T02:30:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18e4a95700 1 -- 172.21.15.6:0/3594852205 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 360) v1 ==== 2559+0+0 (secure 0 0 0) 0x555acefb4900 con 0x555acefc6c00 2023-10-06T02:30:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18f45d9240 4 Got MDS map 360 2023-10-06T02:30:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x555acefc7400 0x555acf104b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.108+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 16.f 16:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e147) v8 -- 0x555acefc7800 con 0x555acefc7400 2023-10-06T02:30:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.109+0000 7f18ee2a8700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x555acefc7400 0x555acf104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.109+0000 7f18ee2a8700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x555acefc7400 0x555acf104b00 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=a9087c91b4353122 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.109+0000 7f18ee2a8700 1 -- 172.21.15.6:0/3594852205 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x555acef2f200 con 0x555acefc7400 2023-10-06T02:30:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.109+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:2 16.14 16:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e147) v8 -- 0x555acefc7c00 con 0x555acefc7400 2023-10-06T02:30:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.110+0000 7f18ee2a8700 1 -- 172.21.15.6:0/3594852205 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv21 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x555acef2f200 con 0x555acefc7400 2023-10-06T02:30:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.110+0000 7f18e3292700 1 -- 172.21.15.6:0/3594852205 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:3 16.14 16:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e147) v8 -- 0x555acefc7800 con 0x555acefc7400 2023-10-06T02:30:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.110+0000 7f18e3292700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x555acefc8c00 0x555acf106680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.110+0000 7f18e3292700 1 -- 172.21.15.6:0/3594852205 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:4 16.1b 16:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e147) v8 -- 0x555acefc7c00 con 0x555acefc8c00 2023-10-06T02:30:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.110+0000 7f18ed2a6700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x555acefc8c00 0x555acf106680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.110+0000 7f18ee2a8700 1 -- 172.21.15.6:0/3594852205 <== osd.0 v2:172.21.15.6:6816/90679 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv18 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x555acef2f200 con 0x555acefc7400 2023-10-06T02:30:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.110+0000 7f18ed2a6700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x555acefc8c00 0x555acf106680 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=ab4c729122bc0dd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.111+0000 7f18ed2a6700 1 -- 172.21.15.6:0/3594852205 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x555acef2f440 con 0x555acefc8c00 2023-10-06T02:30:28.121 INFO:teuthology.orchestra.run.smithi006.stdout:old journal was 4219291~892 2023-10-06T02:30:28.121 INFO:teuthology.orchestra.run.smithi006.stdout:new journal start will be 8388608 (4168425 bytes past old end) 2023-10-06T02:30:28.121 INFO:teuthology.orchestra.run.smithi006.stdout:writing journal head 2023-10-06T02:30:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.111+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:5 16.14 16:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147) v8 -- 0x555acefc9000 con 0x555acefc7400 2023-10-06T02:30:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.112+0000 7f18ee2a8700 1 -- 172.21.15.6:0/3594852205 <== osd.0 v2:172.21.15.6:6816/90679 4 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v147'22 uv22 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x555acef2f200 con 0x555acefc7400 2023-10-06T02:30:28.122 INFO:teuthology.orchestra.run.smithi006.stdout:writing EResetJournal entry 2023-10-06T02:30:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.112+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:6 16.1b 16:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147) v8 -- 0x555acefc9400 con 0x555acefc8c00 2023-10-06T02:30:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.112+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x555acefc9800 0x555acf105080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.112+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- osd_op(unknown.0.0:7 16.b 16:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147) v8 -- 0x555acefc9c00 con 0x555acefc9800 2023-10-06T02:30:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.112+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:8 16.1f 16:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147) v8 -- 0x555acefc9400 con 0x555acefc8c00 2023-10-06T02:30:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.112+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x555acefc7c00 0x555acf105600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.112+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 --> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] -- osd_op(unknown.0.0:9 16.1a 16:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147) v8 -- 0x555acf136000 con 0x555acefc7c00 2023-10-06T02:30:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.112+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x555acf136400 0x555acf105b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.112+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- osd_op(unknown.0.0:10 16.1e 16:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147) v8 -- 0x555acf136800 con 0x555acf136400 2023-10-06T02:30:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.112+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x555acf136c00 0x555acf106100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.112+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:11 16.1d 16:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147) v8 -- 0x555acf137000 con 0x555acf136c00 2023-10-06T02:30:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.112+0000 7f18edaa7700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x555acefc7c00 0x555acf105600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.112+0000 7f18ee2a8700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x555acefc9800 0x555acf105080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.112+0000 7f18ee2a8700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x555acf136c00 0x555acf106100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.112+0000 7f18ee2a8700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x555acf136c00 0x555acf106100 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=9a7d7889dcf5dfe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.113+0000 7f18edaa7700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x555acefc7c00 0x555acf105600 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=87f1232630b2f1f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.113+0000 7f18ee2a8700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x555acefc9800 0x555acf105080 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=733c8c59cb545e77 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.113+0000 7f18ed2a6700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x555acf136400 0x555acf105b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.113+0000 7f18ed2a6700 1 -- 172.21.15.6:0/3594852205 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== osd_op_reply(8 200.00000004 [delete] v147'7 uv6 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x555acef2f440 con 0x555acefc8c00 2023-10-06T02:30:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.113+0000 7f18ed2a6700 1 -- 172.21.15.6:0/3594852205 <== osd.5 v2:172.21.15.175:6800/90866 3 ==== osd_op_reply(6 200.00000002 [delete] v147'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x555acef2f440 con 0x555acefc8c00 2023-10-06T02:30:28.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.114+0000 7f18ee2a8700 1 -- 172.21.15.6:0/3594852205 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(11 200.00000007 [delete] v147'3 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x555acef2f200 con 0x555acf136c00 2023-10-06T02:30:28.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.114+0000 7f18ee2a8700 1 -- 172.21.15.6:0/3594852205 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== osd_op_reply(7 200.00000003 [delete] v147'4 uv3 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x555acef2f200 con 0x555acefc9800 2023-10-06T02:30:28.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.114+0000 7f18e3292700 1 -- 172.21.15.6:0/3594852205 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- osd_op(unknown.0.0:12 16.1b 16:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147) v8 -- 0x555acf137000 con 0x555acefc8c00 2023-10-06T02:30:28.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.115+0000 7f18edaa7700 1 -- 172.21.15.6:0/3594852205 <== osd.3 v2:172.21.15.6:6824/90683 1 ==== osd_op_reply(9 200.00000005 [delete] v147'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x555acf14c000 con 0x555acefc7c00 2023-10-06T02:30:28.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.115+0000 7f18ed2a6700 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x555acf136400 0x555acf105b80 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=1abb60d99cb9ea17 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:28.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.115+0000 7f18ed2a6700 1 -- 172.21.15.6:0/3594852205 <== osd.5 v2:172.21.15.175:6800/90866 4 ==== osd_op_reply(12 200.00000002 [write 0~48] v147'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x555acef2f440 con 0x555acefc8c00 2023-10-06T02:30:28.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18ed2a6700 1 -- 172.21.15.6:0/3594852205 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== osd_op_reply(10 200.00000006 [delete] v147'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x555acef2f440 con 0x555acf136400 2023-10-06T02:30:28.126 INFO:teuthology.orchestra.run.smithi006.stdout:done 2023-10-06T02:30:28.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x555acefc7400 msgr2=0x555acf104b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x555acefc7400 0x555acf104b00 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x555acefc9800 msgr2=0x555acf105080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x555acefc9800 0x555acf105080 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x555acf136c00 msgr2=0x555acf106100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x555acf136c00 0x555acf106100 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x555acefc7c00 msgr2=0x555acf105600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x555acefc7c00 0x555acf105600 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x555acefc8c00 msgr2=0x555acf106680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18ed2a6700 1 -- 172.21.15.6:0/3594852205 reap_dead start 2023-10-06T02:30:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x555acefc8c00 0x555acf106680 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x555acf136400 msgr2=0x555acf105b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x555acf136400 0x555acf105b80 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555acefc6c00 msgr2=0x555acf104000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555acefc6c00 0x555acf104000 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 crypto rx=0x555acf046240 tx=0x555acf0b4d20 comp rx=0 tx=0).stop 2023-10-06T02:30:28.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 shutdown_connections 2023-10-06T02:30:28.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555acefc6c00 0x555acf104000 unknown :-1 s=CLOSED pgs=2447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x555acf136400 0x555acf105b80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3594852205 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x555acefc8c00 0x555acf106680 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 >> 172.21.15.6:0/3594852205 conn(0x555acefc6400 msgr2=0x555ace23a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:28.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 shutdown_connections 2023-10-06T02:30:28.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.116+0000 7f18f45d9240 1 -- 172.21.15.6:0/3594852205 wait complete. 2023-10-06T02:30:28.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 -- 172.21.15.6:0/1338290689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x555acefc8800 msgr2=0x555acef03700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 --2- 172.21.15.6:0/1338290689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x555acefc8800 0x555acef03700 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x555aceec9680 tx=0x555acf0b4c00 comp rx=0 tx=0).stop 2023-10-06T02:30:28.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 -- 172.21.15.6:0/1338290689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2bf800 msgr2=0x555acef02680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 --2- 172.21.15.6:0/1338290689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2bf800 0x555acef02680 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x555ace2c1740 tx=0x555acef58cc0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 -- 172.21.15.6:0/1338290689 shutdown_connections 2023-10-06T02:30:28.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 --2- 172.21.15.6:0/1338290689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555acefc6000 0x555acef02100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 --2- 172.21.15.6:0/1338290689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ace2bfc00 0x555acef02c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 --2- 172.21.15.6:0/1338290689 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x555acefc8800 0x555acef03700 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 --2- 172.21.15.6:0/1338290689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2bf800 0x555acef02680 unknown :-1 s=CLOSED pgs=2446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 -- 172.21.15.6:0/1338290689 >> 172.21.15.6:0/1338290689 conn(0x555ace2bf000 msgr2=0x555ace239800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:28.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 -- 172.21.15.6:0/1338290689 shutdown_connections 2023-10-06T02:30:28.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 -- 172.21.15.6:0/1338290689 wait complete. 2023-10-06T02:30:28.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 -- 172.21.15.6:0/3214023156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2be400 msgr2=0x555acef00580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3214023156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2be400 0x555acef00580 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 crypto rx=0x555ace2c0030 tx=0x555acef0c420 comp rx=0 tx=0).stop 2023-10-06T02:30:28.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 -- 172.21.15.6:0/3214023156 shutdown_connections 2023-10-06T02:30:28.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3214023156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x555ace2bec00 0x555acef01080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3214023156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555ace2be400 0x555acef00580 unknown :-1 s=CLOSED pgs=2444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 --2- 172.21.15.6:0/3214023156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ace2be800 0x555acef00b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 -- 172.21.15.6:0/3214023156 >> 172.21.15.6:0/3214023156 conn(0x555ace2be000 msgr2=0x555ace239000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:28.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 -- 172.21.15.6:0/3214023156 shutdown_connections 2023-10-06T02:30:28.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.117+0000 7f18f45d9240 1 -- 172.21.15.6:0/3214023156 wait complete. 2023-10-06T02:30:28.133 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.071675, result: old journal was 4219291~892 new journal start will be 8388608 (4168425 bytes past old end) writing journal head writing EResetJournal entry done 2023-10-06T02:30:28.133 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:30:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.291+0000 7f957b8a9700 1 Processor -- start 2023-10-06T02:30:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.291+0000 7f957b8a9700 1 -- start start 2023-10-06T02:30:28.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.292+0000 7f957b8a9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f95740d0400 0x7f95740b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.292+0000 7f957b8a9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95740ccd40 0x7f95740cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.292+0000 7f957b8a9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95740b6170 con 0x7f95740cf7e0 2023-10-06T02:30:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.292+0000 7f957b8a9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f957415dd40 con 0x7f95740d0400 2023-10-06T02:30:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.292+0000 7f957b8a9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957415e020 con 0x7f95740ccd40 2023-10-06T02:30:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.292+0000 7f9579645700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f95740d0400 0x7f95740b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.292+0000 7f9579e46700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f95740cf7e0 0x7f95740b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38028/0 (socket says 172.21.15.6:38028) 2023-10-06T02:30:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.292+0000 7f9579645700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f95740d0400 0x7f95740b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41268/0 (socket says 172.21.15.6:41268) 2023-10-06T02:30:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.292+0000 7f9579e46700 1 -- 172.21.15.6:0/2491306067 learned_addr learned my addr 172.21.15.6:0/2491306067 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.293+0000 7f9578e44700 1 --2- 172.21.15.6:0/2491306067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95740ccd40 0x7f95740cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.293+0000 7f9579645700 1 -- 172.21.15.6:0/2491306067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95740ccd40 msgr2=0x7f95740cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.293+0000 7f9579645700 1 --2- 172.21.15.6:0/2491306067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95740ccd40 0x7f95740cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.293+0000 7f9579645700 1 -- 172.21.15.6:0/2491306067 >> v1:172.21.15.6:6789/0 conn(0x7f95740cf7e0 legacy=0x7f95740b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.293+0000 7f9579645700 1 -- 172.21.15.6:0/2491306067 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95740ceaa0 con 0x7f95740d0400 2023-10-06T02:30:28.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.293+0000 7f9573fff700 1 -- 172.21.15.6:0/2491306067 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829677506 0 0) 0x7f95740b6170 con 0x7f95740cf7e0 2023-10-06T02:30:28.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.293+0000 7f9578e44700 1 --2- 172.21.15.6:0/2491306067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95740ccd40 0x7f95740cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:28.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.293+0000 7f9579645700 1 --2- 172.21.15.6:0/2491306067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95740d0400 0x7f95740b5c30 secure :-1 s=READY pgs=2449 cs=0 l=1 rev1=1 crypto rx=0x7f956c0098d0 tx=0x7f956c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18694c7cf0c6f2a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:28.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.293+0000 7f9573fff700 1 -- 172.21.15.6:0/2491306067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c009e70 con 0x7f95740d0400 2023-10-06T02:30:28.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.293+0000 7f9573fff700 1 -- 172.21.15.6:0/2491306067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956c005c10 con 0x7f95740d0400 2023-10-06T02:30:28.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.293+0000 7f9573fff700 1 -- 172.21.15.6:0/2491306067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c00b650 con 0x7f95740d0400 2023-10-06T02:30:28.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.293+0000 7f957b8a9700 1 -- 172.21.15.6:0/2491306067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95740d0400 msgr2=0x7f95740b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.293+0000 7f957b8a9700 1 --2- 172.21.15.6:0/2491306067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95740d0400 0x7f95740b5c30 secure :-1 s=READY pgs=2449 cs=0 l=1 rev1=1 crypto rx=0x7f956c0098d0 tx=0x7f956c009120 comp rx=0 tx=0).stop 2023-10-06T02:30:28.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.294+0000 7f957b8a9700 1 -- 172.21.15.6:0/2491306067 shutdown_connections 2023-10-06T02:30:28.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.294+0000 7f957b8a9700 1 --2- 172.21.15.6:0/2491306067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95740d0400 0x7f95740b5c30 unknown :-1 s=CLOSED pgs=2449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.294+0000 7f957b8a9700 1 --2- 172.21.15.6:0/2491306067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95740ccd40 0x7f95740cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.294+0000 7f957b8a9700 1 -- 172.21.15.6:0/2491306067 >> 172.21.15.6:0/2491306067 conn(0x7f957406a220 msgr2=0x7f957406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:28.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.294+0000 7f957b8a9700 1 -- 172.21.15.6:0/2491306067 shutdown_connections 2023-10-06T02:30:28.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.294+0000 7f957b8a9700 1 -- 172.21.15.6:0/2491306067 wait complete. 2023-10-06T02:30:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.295+0000 7f957b8a9700 1 Processor -- start 2023-10-06T02:30:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.295+0000 7f957b8a9700 1 -- start start 2023-10-06T02:30:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f957b8a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95740ccd40 0x7f957415b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f957b8a9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95740cf7e0 0x7f957416a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f957b8a9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95740d0400 0x7f9574146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f957b8a9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957415bd50 con 0x7f95740ccd40 2023-10-06T02:30:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f957b8a9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957416a6f0 con 0x7f95740d0400 2023-10-06T02:30:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f957b8a9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957415b380 con 0x7f95740cf7e0 2023-10-06T02:30:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f9579645700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95740ccd40 0x7f957415b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f9579645700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95740ccd40 0x7f957415b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41280/0 (socket says 172.21.15.6:41280) 2023-10-06T02:30:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f9579645700 1 -- 172.21.15.6:0/1950654109 learned_addr learned my addr 172.21.15.6:0/1950654109 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f9578e44700 1 --2- 172.21.15.6:0/1950654109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95740cf7e0 0x7f957416a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f9579e46700 1 --2- 172.21.15.6:0/1950654109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95740d0400 0x7f9574146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f9579645700 1 -- 172.21.15.6:0/1950654109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95740cf7e0 msgr2=0x7f957416a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f9579645700 1 --2- 172.21.15.6:0/1950654109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95740cf7e0 0x7f957416a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f9579645700 1 -- 172.21.15.6:0/1950654109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95740d0400 msgr2=0x7f9574146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f9579645700 1 --2- 172.21.15.6:0/1950654109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95740d0400 0x7f9574146f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f9579645700 1 -- 172.21.15.6:0/1950654109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956c0093c0 con 0x7f95740ccd40 2023-10-06T02:30:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f9578e44700 1 --2- 172.21.15.6:0/1950654109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95740cf7e0 0x7f957416a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f9579e46700 1 --2- 172.21.15.6:0/1950654109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95740d0400 0x7f9574146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f9579645700 1 --2- 172.21.15.6:0/1950654109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95740ccd40 0x7f957415b810 secure :-1 s=READY pgs=2450 cs=0 l=1 rev1=1 crypto rx=0x7f956c009fd0 tx=0x7f956c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f95717fa700 1 -- 172.21.15.6:0/1950654109 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c006460 con 0x7f95740ccd40 2023-10-06T02:30:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f95717fa700 1 -- 172.21.15.6:0/1950654109 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956c0065e0 con 0x7f95740ccd40 2023-10-06T02:30:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f957b8a9700 1 -- 172.21.15.6:0/1950654109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957415a770 con 0x7f95740ccd40 2023-10-06T02:30:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f95717fa700 1 -- 172.21.15.6:0/1950654109 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c01b480 con 0x7f95740ccd40 2023-10-06T02:30:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.296+0000 7f957b8a9700 1 -- 172.21.15.6:0/1950654109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957415ad30 con 0x7f95740ccd40 2023-10-06T02:30:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.297+0000 7f957b8a9700 1 -- 172.21.15.6:0/1950654109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f957415b660 con 0x7f95740ccd40 2023-10-06T02:30:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.298+0000 7f95717fa700 1 -- 172.21.15.6:0/1950654109 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f956c01b8b0 con 0x7f95740ccd40 2023-10-06T02:30:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.298+0000 7f95717fa700 1 --2- 172.21.15.6:0/1950654109 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9560066f30 0x7f95600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.298+0000 7f95717fa700 1 -- 172.21.15.6:0/1950654109 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f956c086b20 con 0x7f95740ccd40 2023-10-06T02:30:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.298+0000 7f9578e44700 1 --2- 172.21.15.6:0/1950654109 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9560066f30 0x7f95600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.299+0000 7f9578e44700 1 --2- 172.21.15.6:0/1950654109 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9560066f30 0x7f95600693e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f957406a0e0 tx=0x7f9568008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.303+0000 7f95717fa700 1 -- 172.21.15.6:0/1950654109 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f956c053aa0 con 0x7f95740ccd40 2023-10-06T02:30:28.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:28.541+0000 7f957b8a9700 1 -- 172.21.15.6:0/1950654109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f95740ced80 con 0x7f95740ccd40 2023-10-06T02:30:29.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.051+0000 7f95717fa700 1 -- 172.21.15.6:0/1950654109 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v361) v1 ==== 162+0+0 (secure 0 0 0) 0x7f956c086030 con 0x7f95740ccd40 2023-10-06T02:30:29.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.053+0000 7f957b8a9700 1 -- 172.21.15.6:0/1950654109 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9560066f30 msgr2=0x7f95600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:29.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.053+0000 7f957b8a9700 1 --2- 172.21.15.6:0/1950654109 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9560066f30 0x7f95600693e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f957406a0e0 tx=0x7f9568008040 comp rx=0 tx=0).stop 2023-10-06T02:30:29.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.053+0000 7f957b8a9700 1 -- 172.21.15.6:0/1950654109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95740ccd40 msgr2=0x7f957415b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:29.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.053+0000 7f957b8a9700 1 --2- 172.21.15.6:0/1950654109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95740ccd40 0x7f957415b810 secure :-1 s=READY pgs=2450 cs=0 l=1 rev1=1 crypto rx=0x7f956c009fd0 tx=0x7f956c016000 comp rx=0 tx=0).stop 2023-10-06T02:30:29.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.053+0000 7f957b8a9700 1 -- 172.21.15.6:0/1950654109 shutdown_connections 2023-10-06T02:30:29.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.053+0000 7f957b8a9700 1 --2- 172.21.15.6:0/1950654109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95740d0400 0x7f9574146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:29.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.053+0000 7f957b8a9700 1 --2- 172.21.15.6:0/1950654109 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9560066f30 0x7f95600693e0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:29.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.053+0000 7f957b8a9700 1 --2- 172.21.15.6:0/1950654109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95740ccd40 0x7f957415b810 unknown :-1 s=CLOSED pgs=2450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:29.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.053+0000 7f957b8a9700 1 --2- 172.21.15.6:0/1950654109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95740cf7e0 0x7f957416a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:29.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.053+0000 7f957b8a9700 1 -- 172.21.15.6:0/1950654109 >> 172.21.15.6:0/1950654109 conn(0x7f957406a220 msgr2=0x7f95740b5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:29.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.053+0000 7f957b8a9700 1 -- 172.21.15.6:0/1950654109 shutdown_connections 2023-10-06T02:30:29.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.054+0000 7f957b8a9700 1 -- 172.21.15.6:0/1950654109 wait complete. 2023-10-06T02:30:29.055 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:30:29.069 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:30:29.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.188+0000 7fd9903d4700 1 Processor -- start 2023-10-06T02:30:29.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.188+0000 7fd9903d4700 1 -- start start 2023-10-06T02:30:29.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.189+0000 7fd9903d4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd988142cf0 0x7fd9880ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:29.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.189+0000 7fd9903d4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd9881430c0 0x7fd988163080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:29.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.189+0000 7fd9903d4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9880cee60 con 0x7fd9880ce9f0 2023-10-06T02:30:29.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.189+0000 7fd9903d4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9880cf140 con 0x7fd988142cf0 2023-10-06T02:30:29.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.189+0000 7fd9903d4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9880cf420 con 0x7fd9881430c0 2023-10-06T02:30:29.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.189+0000 7fd98e170700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd988142cf0 0x7fd9880ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:29.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.189+0000 7fd98d96f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd9880ce9f0 0x7fd9880d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58992/0 (socket says 172.21.15.6:58992) 2023-10-06T02:30:29.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.189+0000 7fd98e170700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd988142cf0 0x7fd9880ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53760/0 (socket says 172.21.15.6:53760) 2023-10-06T02:30:29.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.189+0000 7fd98d96f700 1 -- 172.21.15.6:0/1819822972 learned_addr learned my addr 172.21.15.6:0/1819822972 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:29.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.189+0000 7fd98e170700 1 -- 172.21.15.6:0/1819822972 >> v2:172.21.15.175:3300/0 conn(0x7fd9881430c0 msgr2=0x7fd988163080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:29.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.189+0000 7fd98e971700 1 --2- 172.21.15.6:0/1819822972 >> v2:172.21.15.175:3300/0 conn(0x7fd9881430c0 0x7fd988163080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:29.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.189+0000 7fd98d16e700 1 -- 172.21.15.6:0/1819822972 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119793248 0 0) 0x7fd9880cee60 con 0x7fd9880ce9f0 2023-10-06T02:30:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.189+0000 7fd98e170700 1 --2- 172.21.15.6:0/1819822972 >> v2:172.21.15.175:3300/0 conn(0x7fd9881430c0 0x7fd988163080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.189+0000 7fd98e170700 1 -- 172.21.15.6:0/1819822972 >> v1:172.21.15.6:6789/0 conn(0x7fd9880ce9f0 legacy=0x7fd9880d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.189+0000 7fd98e170700 1 -- 172.21.15.6:0/1819822972 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9880cf700 con 0x7fd988142cf0 2023-10-06T02:30:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.190+0000 7fd98e170700 1 --2- 172.21.15.6:0/1819822972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd988142cf0 0x7fd9880ccd30 secure :-1 s=READY pgs=2452 cs=0 l=1 rev1=1 crypto rx=0x7fd9880cd9e0 tx=0x7fd9840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c5c2b945d2b667 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.190+0000 7fd98d16e700 1 -- 172.21.15.6:0/1819822972 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98400b6b0 con 0x7fd988142cf0 2023-10-06T02:30:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.190+0000 7fd98d16e700 1 -- 172.21.15.6:0/1819822972 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98400b810 con 0x7fd988142cf0 2023-10-06T02:30:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.190+0000 7fd98d16e700 1 -- 172.21.15.6:0/1819822972 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98400bbb0 con 0x7fd988142cf0 2023-10-06T02:30:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.190+0000 7fd9903d4700 1 -- 172.21.15.6:0/1819822972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd988142cf0 msgr2=0x7fd9880ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.190+0000 7fd9903d4700 1 --2- 172.21.15.6:0/1819822972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd988142cf0 0x7fd9880ccd30 secure :-1 s=READY pgs=2452 cs=0 l=1 rev1=1 crypto rx=0x7fd9880cd9e0 tx=0x7fd9840091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.190+0000 7fd9903d4700 1 -- 172.21.15.6:0/1819822972 shutdown_connections 2023-10-06T02:30:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.190+0000 7fd9903d4700 1 --2- 172.21.15.6:0/1819822972 >> v2:172.21.15.175:3300/0 conn(0x7fd9881430c0 0x7fd988163080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.190+0000 7fd9903d4700 1 --2- 172.21.15.6:0/1819822972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd988142cf0 0x7fd9880ccd30 unknown :-1 s=CLOSED pgs=2452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.190+0000 7fd9903d4700 1 -- 172.21.15.6:0/1819822972 >> 172.21.15.6:0/1819822972 conn(0x7fd9880690f0 msgr2=0x7fd98806a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.190+0000 7fd9903d4700 1 -- 172.21.15.6:0/1819822972 shutdown_connections 2023-10-06T02:30:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.190+0000 7fd9903d4700 1 -- 172.21.15.6:0/1819822972 wait complete. 2023-10-06T02:30:29.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.192+0000 7fd9903d4700 1 Processor -- start 2023-10-06T02:30:29.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.192+0000 7fd9903d4700 1 -- start start 2023-10-06T02:30:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.192+0000 7fd9903d4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9880ce9f0 0x7fd98813f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.192+0000 7fd9903d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd988142cf0 0x7fd98813cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.192+0000 7fd9903d4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9881430c0 0x7fd98813d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.192+0000 7fd9903d4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd988138b20 con 0x7fd988142cf0 2023-10-06T02:30:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.192+0000 7fd9903d4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd988159530 con 0x7fd9881430c0 2023-10-06T02:30:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.192+0000 7fd9903d4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd988140030 con 0x7fd9880ce9f0 2023-10-06T02:30:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.192+0000 7fd98d96f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd988142cf0 0x7fd98813cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.192+0000 7fd98d96f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd988142cf0 0x7fd98813cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53766/0 (socket says 172.21.15.6:53766) 2023-10-06T02:30:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.192+0000 7fd98d96f700 1 -- 172.21.15.6:0/2523379099 learned_addr learned my addr 172.21.15.6:0/2523379099 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.193+0000 7fd98e170700 1 --2- 172.21.15.6:0/2523379099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9880ce9f0 0x7fd98813f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.193+0000 7fd98e971700 1 --2- 172.21.15.6:0/2523379099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9881430c0 0x7fd98813d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.193+0000 7fd98d96f700 1 -- 172.21.15.6:0/2523379099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9880ce9f0 msgr2=0x7fd98813f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.193+0000 7fd98d96f700 1 --2- 172.21.15.6:0/2523379099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9880ce9f0 0x7fd98813f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.193+0000 7fd98d96f700 1 -- 172.21.15.6:0/2523379099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9881430c0 msgr2=0x7fd98813d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.193+0000 7fd98d96f700 1 --2- 172.21.15.6:0/2523379099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9881430c0 0x7fd98813d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.193+0000 7fd98d96f700 1 -- 172.21.15.6:0/2523379099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd984009420 con 0x7fd988142cf0 2023-10-06T02:30:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.193+0000 7fd98e971700 1 --2- 172.21.15.6:0/2523379099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9881430c0 0x7fd98813d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.193+0000 7fd98d96f700 1 --2- 172.21.15.6:0/2523379099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd988142cf0 0x7fd98813cba0 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7fd97800c7e0 tx=0x7fd978007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.193+0000 7fd97e7fc700 1 -- 172.21.15.6:0/2523379099 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd978005b30 con 0x7fd988142cf0 2023-10-06T02:30:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.193+0000 7fd97e7fc700 1 -- 172.21.15.6:0/2523379099 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd978005c90 con 0x7fd988142cf0 2023-10-06T02:30:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.193+0000 7fd9903d4700 1 -- 172.21.15.6:0/2523379099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd988140310 con 0x7fd988142cf0 2023-10-06T02:30:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.193+0000 7fd97e7fc700 1 -- 172.21.15.6:0/2523379099 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd978007300 con 0x7fd988142cf0 2023-10-06T02:30:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.193+0000 7fd9903d4700 1 -- 172.21.15.6:0/2523379099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd988138d70 con 0x7fd988142cf0 2023-10-06T02:30:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.194+0000 7fd9903d4700 1 -- 172.21.15.6:0/2523379099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd988088ad0 con 0x7fd988142cf0 2023-10-06T02:30:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.194+0000 7fd97e7fc700 1 -- 172.21.15.6:0/2523379099 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9780076b0 con 0x7fd988142cf0 2023-10-06T02:30:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.195+0000 7fd97e7fc700 1 --2- 172.21.15.6:0/2523379099 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd96c066f30 0x7fd96c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.195+0000 7fd97e7fc700 1 -- 172.21.15.6:0/2523379099 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fd978083d80 con 0x7fd988142cf0 2023-10-06T02:30:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.195+0000 7fd98e170700 1 --2- 172.21.15.6:0/2523379099 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd96c066f30 0x7fd96c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.196+0000 7fd98e170700 1 --2- 172.21.15.6:0/2523379099 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd96c066f30 0x7fd96c0693e0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fd9840093f0 tx=0x7fd984017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.199+0000 7fd97e7fc700 1 -- 172.21.15.6:0/2523379099 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd978050d00 con 0x7fd988142cf0 2023-10-06T02:30:29.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.436+0000 7fd9903d4700 1 -- 172.21.15.6:0/2523379099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd988159790 con 0x7fd988142cf0 2023-10-06T02:30:29.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.436+0000 7fd97e7fc700 1 -- 172.21.15.6:0/2523379099 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 362 v362) v1 ==== 95+0+4608 (secure 0 0 0) 0x7fd978017090 con 0x7fd988142cf0 2023-10-06T02:30:29.437 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:29.437 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":362,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3603762205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3603762205},{"type":"v1","addr":"172.21.15.175:6836","nonce":3603762205}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":9820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3292446255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3292446255},{"type":"v1","addr":"172.21.15.175:6837","nonce":3292446255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":10869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/759655214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":759655214},{"type":"v1","addr":"172.21.15.6:6834","nonce":759655214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354}],"filesystems":[{"mdsmap":{"epoch":362,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:30:06.715272+0000","modified":"2023-10-06T02:30:29.051999+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11088":{"gid":11088,"name":"c","rank":0,"incarnation":362,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6835/3837760829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3837760829},{"type":"v1","addr":"172.21.15.6:6835","nonce":3837760829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:30:29.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.438+0000 7fd9903d4700 1 -- 172.21.15.6:0/2523379099 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd96c066f30 msgr2=0x7fd96c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:29.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.438+0000 7fd9903d4700 1 --2- 172.21.15.6:0/2523379099 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd96c066f30 0x7fd96c0693e0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fd9840093f0 tx=0x7fd984017000 comp rx=0 tx=0).stop 2023-10-06T02:30:29.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.438+0000 7fd9903d4700 1 -- 172.21.15.6:0/2523379099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd988142cf0 msgr2=0x7fd98813cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:29.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.438+0000 7fd9903d4700 1 --2- 172.21.15.6:0/2523379099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd988142cf0 0x7fd98813cba0 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7fd97800c7e0 tx=0x7fd978007df0 comp rx=0 tx=0).stop 2023-10-06T02:30:29.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.438+0000 7fd9903d4700 1 -- 172.21.15.6:0/2523379099 shutdown_connections 2023-10-06T02:30:29.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.438+0000 7fd9903d4700 1 --2- 172.21.15.6:0/2523379099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9881430c0 0x7fd98813d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:29.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.438+0000 7fd9903d4700 1 --2- 172.21.15.6:0/2523379099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9880ce9f0 0x7fd98813f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:29.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.438+0000 7fd9903d4700 1 --2- 172.21.15.6:0/2523379099 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd96c066f30 0x7fd96c0693e0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:29.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.438+0000 7fd9903d4700 1 --2- 172.21.15.6:0/2523379099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd988142cf0 0x7fd98813cba0 unknown :-1 s=CLOSED pgs=2453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:29.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.438+0000 7fd9903d4700 1 -- 172.21.15.6:0/2523379099 >> 172.21.15.6:0/2523379099 conn(0x7fd9880690f0 msgr2=0x7fd98815f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:29.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.438+0000 7fd9903d4700 1 -- 172.21.15.6:0/2523379099 shutdown_connections 2023-10-06T02:30:29.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:29.438+0000 7fd9903d4700 1 -- 172.21.15.6:0/2523379099 wait complete. 2023-10-06T02:30:29.441 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 362 2023-10-06T02:30:29.853 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 362, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:30:06.715272+0000', 'modified': '2023-10-06T02:30:29.051999+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 147, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11088}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11088': {'gid': 11088, 'name': 'c', 'rank': 0, 'incarnation': 362, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.6:6835/3837760829', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 3837760829}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 3837760829}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:30:29.853 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_11088:up:replay 2023-10-06T02:30:30.854 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:30:30.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.989+0000 7f5cca262700 1 Processor -- start 2023-10-06T02:30:30.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.989+0000 7f5cca262700 1 -- start start 2023-10-06T02:30:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.990+0000 7f5cca262700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5cc40b27f0 0x7f5cc4159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.990+0000 7f5cca262700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5cc415d4d0 0x7f5cc415d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.990+0000 7f5cca262700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc40cb6c0 con 0x7f5cc4159380 2023-10-06T02:30:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.990+0000 7f5cca262700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc415e200 con 0x7f5cc40b27f0 2023-10-06T02:30:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.990+0000 7f5cca262700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc40ccb60 con 0x7f5cc415d4d0 2023-10-06T02:30:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.990+0000 7f5cc2ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5cc40b27f0 0x7f5cc4159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.990+0000 7f5cc37fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5cc4159380 0x7f5cc40b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58996/0 (socket says 172.21.15.6:58996) 2023-10-06T02:30:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.990+0000 7f5cc2ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5cc40b27f0 0x7f5cc4159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53780/0 (socket says 172.21.15.6:53780) 2023-10-06T02:30:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.990+0000 7f5cc37fe700 1 -- 172.21.15.6:0/2164897798 learned_addr learned my addr 172.21.15.6:0/2164897798 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.991+0000 7f5cc3fff700 1 --2- 172.21.15.6:0/2164897798 >> v2:172.21.15.175:3300/0 conn(0x7f5cc415d4d0 0x7f5cc415d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.991+0000 7f5cc2ffd700 1 -- 172.21.15.6:0/2164897798 >> v2:172.21.15.175:3300/0 conn(0x7f5cc415d4d0 msgr2=0x7f5cc415d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.991+0000 7f5cc2ffd700 1 --2- 172.21.15.6:0/2164897798 >> v2:172.21.15.175:3300/0 conn(0x7f5cc415d4d0 0x7f5cc415d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.991+0000 7f5cc2ffd700 1 -- 172.21.15.6:0/2164897798 >> v1:172.21.15.6:6789/0 conn(0x7f5cc4159380 legacy=0x7f5cc40b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.991+0000 7f5cc2ffd700 1 -- 172.21.15.6:0/2164897798 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc40c3ef0 con 0x7f5cc40b27f0 2023-10-06T02:30:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.991+0000 7f5cc2ffd700 1 --2- 172.21.15.6:0/2164897798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cc40b27f0 0x7f5cc4159750 secure :-1 s=READY pgs=2455 cs=0 l=1 rev1=1 crypto rx=0x7f5cc40c72b0 tx=0x7f5cac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cacecd3d72d12ccc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.991+0000 7f5cc27fc700 1 -- 172.21.15.6:0/2164897798 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac009e80 con 0x7f5cc40b27f0 2023-10-06T02:30:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.991+0000 7f5cc27fc700 1 -- 172.21.15.6:0/2164897798 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac00b820 con 0x7f5cc40b27f0 2023-10-06T02:30:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.991+0000 7f5cc27fc700 1 -- 172.21.15.6:0/2164897798 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac00bba0 con 0x7f5cc40b27f0 2023-10-06T02:30:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.992+0000 7f5cca262700 1 -- 172.21.15.6:0/2164897798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cc40b27f0 msgr2=0x7f5cc4159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.992+0000 7f5cca262700 1 --2- 172.21.15.6:0/2164897798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cc40b27f0 0x7f5cc4159750 secure :-1 s=READY pgs=2455 cs=0 l=1 rev1=1 crypto rx=0x7f5cc40c72b0 tx=0x7f5cac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.992+0000 7f5cca262700 1 -- 172.21.15.6:0/2164897798 shutdown_connections 2023-10-06T02:30:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.992+0000 7f5cca262700 1 --2- 172.21.15.6:0/2164897798 >> v2:172.21.15.175:3300/0 conn(0x7f5cc415d4d0 0x7f5cc415d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.992+0000 7f5cca262700 1 --2- 172.21.15.6:0/2164897798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cc40b27f0 0x7f5cc4159750 unknown :-1 s=CLOSED pgs=2455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.992+0000 7f5cca262700 1 -- 172.21.15.6:0/2164897798 >> 172.21.15.6:0/2164897798 conn(0x7f5cc4068680 msgr2=0x7f5cc4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.992+0000 7f5cca262700 1 -- 172.21.15.6:0/2164897798 shutdown_connections 2023-10-06T02:30:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.992+0000 7f5cca262700 1 -- 172.21.15.6:0/2164897798 wait complete. 2023-10-06T02:30:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.993+0000 7f5cca262700 1 Processor -- start 2023-10-06T02:30:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.993+0000 7f5cca262700 1 -- start start 2023-10-06T02:30:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cca262700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5cc40b27f0 0x7f5cc4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cca262700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cc4159380 0x7f5cc40c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cca262700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc415d4d0 0x7f5cc40c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cca262700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40c4ec0 con 0x7f5cc4159380 2023-10-06T02:30:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cca262700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40c51a0 con 0x7f5cc415d4d0 2023-10-06T02:30:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cca262700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40c5480 con 0x7f5cc40b27f0 2023-10-06T02:30:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cc2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cc4159380 0x7f5cc40c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cc2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cc4159380 0x7f5cc40c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53784/0 (socket says 172.21.15.6:53784) 2023-10-06T02:30:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cc2ffd700 1 -- 172.21.15.6:0/4006022131 learned_addr learned my addr 172.21.15.6:0/4006022131 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cc3fff700 1 --2- 172.21.15.6:0/4006022131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc415d4d0 0x7f5cc40c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cc37fe700 1 --2- 172.21.15.6:0/4006022131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5cc40b27f0 0x7f5cc4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cc2ffd700 1 -- 172.21.15.6:0/4006022131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5cc40b27f0 msgr2=0x7f5cc4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cc2ffd700 1 --2- 172.21.15.6:0/4006022131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5cc40b27f0 0x7f5cc4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cc2ffd700 1 -- 172.21.15.6:0/4006022131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc415d4d0 msgr2=0x7f5cc40c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cc2ffd700 1 --2- 172.21.15.6:0/4006022131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc415d4d0 0x7f5cc40c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cc2ffd700 1 -- 172.21.15.6:0/4006022131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac009420 con 0x7f5cc4159380 2023-10-06T02:30:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cc37fe700 1 --2- 172.21.15.6:0/4006022131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5cc40b27f0 0x7f5cc4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cc3fff700 1 --2- 172.21.15.6:0/4006022131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc415d4d0 0x7f5cc40c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.994+0000 7f5cc2ffd700 1 --2- 172.21.15.6:0/4006022131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cc4159380 0x7f5cc40c7300 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4089520 tx=0x7f5cac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.995+0000 7f5cbb7fe700 1 -- 172.21.15.6:0/4006022131 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac00bba0 con 0x7f5cc4159380 2023-10-06T02:30:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.995+0000 7f5cbb7fe700 1 -- 172.21.15.6:0/4006022131 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac011420 con 0x7f5cc4159380 2023-10-06T02:30:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.995+0000 7f5cbb7fe700 1 -- 172.21.15.6:0/4006022131 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac0117e0 con 0x7f5cc4159380 2023-10-06T02:30:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.995+0000 7f5cca262700 1 -- 172.21.15.6:0/4006022131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc40c5760 con 0x7f5cc4159380 2023-10-06T02:30:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.995+0000 7f5cca262700 1 -- 172.21.15.6:0/4006022131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc40c4190 con 0x7f5cc4159380 2023-10-06T02:30:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.996+0000 7f5cca262700 1 -- 172.21.15.6:0/4006022131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc416adb0 con 0x7f5cc4159380 2023-10-06T02:30:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.996+0000 7f5cbb7fe700 1 -- 172.21.15.6:0/4006022131 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cac011c10 con 0x7f5cc4159380 2023-10-06T02:30:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.996+0000 7f5cbb7fe700 1 --2- 172.21.15.6:0/4006022131 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ca4066f30 0x7f5ca40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.997+0000 7f5cbb7fe700 1 -- 172.21.15.6:0/4006022131 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f5cac0860d0 con 0x7f5cc4159380 2023-10-06T02:30:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.997+0000 7f5cc37fe700 1 --2- 172.21.15.6:0/4006022131 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ca4066f30 0x7f5ca40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:30.997+0000 7f5cc37fe700 1 --2- 172.21.15.6:0/4006022131 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ca4066f30 0x7f5ca40693e0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4159050 tx=0x7f5cbc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:31.001+0000 7f5cbb7fe700 1 -- 172.21.15.6:0/4006022131 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cc416adb0 con 0x7f5cc4159380 2023-10-06T02:30:31.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:31.240+0000 7f5cca262700 1 -- 172.21.15.6:0/4006022131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cc416adb0 con 0x7f5cc4159380 2023-10-06T02:30:31.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:31.241+0000 7f5cbb7fe700 1 -- 172.21.15.6:0/4006022131 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 364 v364) v1 ==== 95+0+4608 (secure 0 0 0) 0x7f5cc416adb0 con 0x7f5cc4159380 2023-10-06T02:30:31.242 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:31.242 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":364,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3603762205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3603762205},{"type":"v1","addr":"172.21.15.175:6836","nonce":3603762205}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":9820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3292446255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3292446255},{"type":"v1","addr":"172.21.15.175:6837","nonce":3292446255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":10869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/759655214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":759655214},{"type":"v1","addr":"172.21.15.6:6834","nonce":759655214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354}],"filesystems":[{"mdsmap":{"epoch":364,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:30:06.715272+0000","modified":"2023-10-06T02:30:31.057250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11088":{"gid":11088,"name":"c","rank":0,"incarnation":362,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.6:6835/3837760829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3837760829},{"type":"v1","addr":"172.21.15.6:6835","nonce":3837760829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:30:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:31.243+0000 7f5cca262700 1 -- 172.21.15.6:0/4006022131 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ca4066f30 msgr2=0x7f5ca40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:31.243+0000 7f5cca262700 1 --2- 172.21.15.6:0/4006022131 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ca4066f30 0x7f5ca40693e0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4159050 tx=0x7f5cbc009040 comp rx=0 tx=0).stop 2023-10-06T02:30:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:31.243+0000 7f5cca262700 1 -- 172.21.15.6:0/4006022131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cc4159380 msgr2=0x7f5cc40c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:31.243+0000 7f5cca262700 1 --2- 172.21.15.6:0/4006022131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cc4159380 0x7f5cc40c7300 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4089520 tx=0x7f5cac017000 comp rx=0 tx=0).stop 2023-10-06T02:30:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:31.243+0000 7f5cca262700 1 -- 172.21.15.6:0/4006022131 shutdown_connections 2023-10-06T02:30:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:31.243+0000 7f5cca262700 1 --2- 172.21.15.6:0/4006022131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc415d4d0 0x7f5cc40c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:31.243+0000 7f5cca262700 1 --2- 172.21.15.6:0/4006022131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5cc40b27f0 0x7f5cc4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:31.243+0000 7f5cca262700 1 --2- 172.21.15.6:0/4006022131 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5ca4066f30 0x7f5ca40693e0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:31.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:31.243+0000 7f5cca262700 1 --2- 172.21.15.6:0/4006022131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cc4159380 0x7f5cc40c7300 unknown :-1 s=CLOSED pgs=2456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:31.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:31.243+0000 7f5cca262700 1 -- 172.21.15.6:0/4006022131 >> 172.21.15.6:0/4006022131 conn(0x7f5cc4068680 msgr2=0x7f5cc40cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:31.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:31.243+0000 7f5cca262700 1 -- 172.21.15.6:0/4006022131 shutdown_connections 2023-10-06T02:30:31.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:31.243+0000 7f5cca262700 1 -- 172.21.15.6:0/4006022131 wait complete. 2023-10-06T02:30:31.245 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 364 2023-10-06T02:30:31.658 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 364, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:30:06.715272+0000', 'modified': '2023-10-06T02:30:31.057250+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 147, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11088}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11088': {'gid': 11088, 'name': 'c', 'rank': 0, 'incarnation': 362, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.6:6835/3837760829', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 3837760829}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 3837760829}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:30:31.658 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_11088:up:rejoin 2023-10-06T02:30:32.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:30:32.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.792+0000 7f9403542700 1 Processor -- start 2023-10-06T02:30:32.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.792+0000 7f9403542700 1 -- start start 2023-10-06T02:30:32.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.793+0000 7f9403542700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f93fc0af4e0 0x7f93fc0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:32.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.793+0000 7f9403542700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93fc0af8b0 0x7f93fc0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:32.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.793+0000 7f9403542700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93fc15d460 0x7f93fc15d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:32.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.793+0000 7f9403542700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93fc0b1910 con 0x7f93fc0af4e0 2023-10-06T02:30:32.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.793+0000 7f9403542700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93fc15e190 con 0x7f93fc0af8b0 2023-10-06T02:30:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.793+0000 7f9403542700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc0cb650 con 0x7f93fc15d460 2023-10-06T02:30:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.793+0000 7f94012de700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f93fc0af4e0 0x7f93fc0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.793+0000 7f94012de700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f93fc0af4e0 0x7f93fc0b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53800/0 (socket says 172.21.15.6:53800) 2023-10-06T02:30:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.793+0000 7f94012de700 1 -- 172.21.15.6:0/3436480309 learned_addr learned my addr 172.21.15.6:0/3436480309 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.793+0000 7f9401adf700 1 --2- 172.21.15.6:0/3436480309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93fc15d460 0x7f93fc15d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.793+0000 7f9400add700 1 --2- 172.21.15.6:0/3436480309 >> v2:172.21.15.175:3300/0 conn(0x7f93fc0af8b0 0x7f93fc0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f94012de700 1 -- 172.21.15.6:0/3436480309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93fc15d460 msgr2=0x7f93fc15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f94012de700 1 --2- 172.21.15.6:0/3436480309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93fc15d460 0x7f93fc15d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f94012de700 1 -- 172.21.15.6:0/3436480309 >> v2:172.21.15.175:3300/0 conn(0x7f93fc0af8b0 msgr2=0x7f93fc0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f94012de700 1 --2- 172.21.15.6:0/3436480309 >> v2:172.21.15.175:3300/0 conn(0x7f93fc0af8b0 0x7f93fc0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f94012de700 1 -- 172.21.15.6:0/3436480309 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc0b2b60 con 0x7f93fc0af4e0 2023-10-06T02:30:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f9401adf700 1 --2- 172.21.15.6:0/3436480309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93fc15d460 0x7f93fc15d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f9400add700 1 --2- 172.21.15.6:0/3436480309 >> v2:172.21.15.175:3300/0 conn(0x7f93fc0af8b0 0x7f93fc0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f94012de700 1 --2- 172.21.15.6:0/3436480309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93fc0af4e0 0x7f93fc0b20e0 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0cdd50 tx=0x7f93f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f49024e474b34b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f93f3fff700 1 -- 172.21.15.6:0/3436480309 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f800e070 con 0x7f93fc0af4e0 2023-10-06T02:30:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f93f3fff700 1 -- 172.21.15.6:0/3436480309 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f800ba50 con 0x7f93fc0af4e0 2023-10-06T02:30:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f93f3fff700 1 -- 172.21.15.6:0/3436480309 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f80092e0 con 0x7f93fc0af4e0 2023-10-06T02:30:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f9403542700 1 -- 172.21.15.6:0/3436480309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93fc0af4e0 msgr2=0x7f93fc0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f9403542700 1 --2- 172.21.15.6:0/3436480309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93fc0af4e0 0x7f93fc0b20e0 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0cdd50 tx=0x7f93f8009840 comp rx=0 tx=0).stop 2023-10-06T02:30:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f9403542700 1 -- 172.21.15.6:0/3436480309 shutdown_connections 2023-10-06T02:30:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f9403542700 1 --2- 172.21.15.6:0/3436480309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93fc15d460 0x7f93fc15d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f9403542700 1 --2- 172.21.15.6:0/3436480309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93fc0af4e0 0x7f93fc0b20e0 unknown :-1 s=CLOSED pgs=2457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f9403542700 1 --2- 172.21.15.6:0/3436480309 >> v2:172.21.15.175:3300/0 conn(0x7f93fc0af8b0 0x7f93fc0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f9403542700 1 -- 172.21.15.6:0/3436480309 >> 172.21.15.6:0/3436480309 conn(0x7f93fc068680 msgr2=0x7f93fc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:32.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.794+0000 7f9403542700 1 -- 172.21.15.6:0/3436480309 shutdown_connections 2023-10-06T02:30:32.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.795+0000 7f9403542700 1 -- 172.21.15.6:0/3436480309 wait complete. 2023-10-06T02:30:32.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.796+0000 7f9403542700 1 Processor -- start 2023-10-06T02:30:32.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.796+0000 7f9403542700 1 -- start start 2023-10-06T02:30:32.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f9403542700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93fc0af4e0 0x7f93fc150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:32.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f9403542700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93fc0af8b0 0x7f93fc0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:32.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f9403542700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93fc15d460 0x7f93fc0d0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:32.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f9403542700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc0d0fc0 con 0x7f93fc15d460 2023-10-06T02:30:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f9403542700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc153980 con 0x7f93fc0af8b0 2023-10-06T02:30:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f9403542700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc153c60 con 0x7f93fc0af4e0 2023-10-06T02:30:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f9401adf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93fc15d460 0x7f93fc0d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f9401adf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93fc15d460 0x7f93fc0d0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53802/0 (socket says 172.21.15.6:53802) 2023-10-06T02:30:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f9401adf700 1 -- 172.21.15.6:0/3789777166 learned_addr learned my addr 172.21.15.6:0/3789777166 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f94012de700 1 --2- 172.21.15.6:0/3789777166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93fc0af4e0 0x7f93fc150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f9400add700 1 --2- 172.21.15.6:0/3789777166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93fc0af8b0 0x7f93fc0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f9401adf700 1 -- 172.21.15.6:0/3789777166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93fc0af4e0 msgr2=0x7f93fc150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f9401adf700 1 --2- 172.21.15.6:0/3789777166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93fc0af4e0 0x7f93fc150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f9401adf700 1 -- 172.21.15.6:0/3789777166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93fc0af8b0 msgr2=0x7f93fc0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f9401adf700 1 --2- 172.21.15.6:0/3789777166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93fc0af8b0 0x7f93fc0ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f9401adf700 1 -- 172.21.15.6:0/3789777166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f8009ae0 con 0x7f93fc15d460 2023-10-06T02:30:32.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f9401adf700 1 --2- 172.21.15.6:0/3789777166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93fc15d460 0x7f93fc0d0790 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7f93f400d890 tx=0x7f93f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:32.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f93f17fa700 1 -- 172.21.15.6:0/3789777166 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f40125f0 con 0x7f93fc15d460 2023-10-06T02:30:32.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f93f17fa700 1 -- 172.21.15.6:0/3789777166 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f4012750 con 0x7f93fc15d460 2023-10-06T02:30:32.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f93f17fa700 1 -- 172.21.15.6:0/3789777166 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4012ad0 con 0x7f93fc15d460 2023-10-06T02:30:32.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.797+0000 7f9403542700 1 -- 172.21.15.6:0/3789777166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93fc153f40 con 0x7f93fc15d460 2023-10-06T02:30:32.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.798+0000 7f9403542700 1 -- 172.21.15.6:0/3789777166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93fc153630 con 0x7f93fc15d460 2023-10-06T02:30:32.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.799+0000 7f9403542700 1 -- 172.21.15.6:0/3789777166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93fc088aa0 con 0x7f93fc15d460 2023-10-06T02:30:32.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.799+0000 7f93f17fa700 1 -- 172.21.15.6:0/3789777166 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93f4013480 con 0x7f93fc15d460 2023-10-06T02:30:32.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.799+0000 7f93f17fa700 1 --2- 172.21.15.6:0/3789777166 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f93e0066f30 0x7f93e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:32.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.799+0000 7f93f17fa700 1 -- 172.21.15.6:0/3789777166 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f93f4084880 con 0x7f93fc15d460 2023-10-06T02:30:32.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.800+0000 7f94012de700 1 --2- 172.21.15.6:0/3789777166 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f93e0066f30 0x7f93e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:32.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.800+0000 7f94012de700 1 --2- 172.21.15.6:0/3789777166 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f93e0066f30 0x7f93e00693e0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009880 tx=0x7f93f8018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:32.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:32.804+0000 7f93f17fa700 1 -- 172.21.15.6:0/3789777166 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93f4055250 con 0x7f93fc15d460 2023-10-06T02:30:33.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.039+0000 7f9403542700 1 -- 172.21.15.6:0/3789777166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93fc0cad20 con 0x7f93fc15d460 2023-10-06T02:30:33.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.040+0000 7f93f17fa700 1 -- 172.21.15.6:0/3789777166 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 365 v365) v1 ==== 95+0+4608 (secure 0 0 0) 0x7f93f4054de0 con 0x7f93fc15d460 2023-10-06T02:30:33.041 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:33.042 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":365,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3603762205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3603762205},{"type":"v1","addr":"172.21.15.175:6836","nonce":3603762205}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":9820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3292446255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3292446255},{"type":"v1","addr":"172.21.15.175:6837","nonce":3292446255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":10869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/759655214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":759655214},{"type":"v1","addr":"172.21.15.6:6834","nonce":759655214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354}],"filesystems":[{"mdsmap":{"epoch":365,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:30:06.715272+0000","modified":"2023-10-06T02:30:32.062334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11088":{"gid":11088,"name":"c","rank":0,"incarnation":362,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/3837760829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3837760829},{"type":"v1","addr":"172.21.15.6:6835","nonce":3837760829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:30:33.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.042+0000 7f9403542700 1 -- 172.21.15.6:0/3789777166 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f93e0066f30 msgr2=0x7f93e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:33.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.042+0000 7f9403542700 1 --2- 172.21.15.6:0/3789777166 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f93e0066f30 0x7f93e00693e0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009880 tx=0x7f93f8018000 comp rx=0 tx=0).stop 2023-10-06T02:30:33.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.042+0000 7f9403542700 1 -- 172.21.15.6:0/3789777166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93fc15d460 msgr2=0x7f93fc0d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:33.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.042+0000 7f9403542700 1 --2- 172.21.15.6:0/3789777166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93fc15d460 0x7f93fc0d0790 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7f93f400d890 tx=0x7f93f4008040 comp rx=0 tx=0).stop 2023-10-06T02:30:33.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.042+0000 7f9403542700 1 -- 172.21.15.6:0/3789777166 shutdown_connections 2023-10-06T02:30:33.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.042+0000 7f9403542700 1 --2- 172.21.15.6:0/3789777166 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f93e0066f30 0x7f93e00693e0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.042+0000 7f9403542700 1 --2- 172.21.15.6:0/3789777166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93fc15d460 0x7f93fc0d0790 unknown :-1 s=CLOSED pgs=2458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.042+0000 7f9403542700 1 --2- 172.21.15.6:0/3789777166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93fc0af4e0 0x7f93fc150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.042+0000 7f9403542700 1 --2- 172.21.15.6:0/3789777166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93fc0af8b0 0x7f93fc0ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.042+0000 7f9403542700 1 -- 172.21.15.6:0/3789777166 >> 172.21.15.6:0/3789777166 conn(0x7f93fc068680 msgr2=0x7f93fc0b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:33.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.042+0000 7f9403542700 1 -- 172.21.15.6:0/3789777166 shutdown_connections 2023-10-06T02:30:33.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.042+0000 7f9403542700 1 -- 172.21.15.6:0/3789777166 wait complete. 2023-10-06T02:30:33.046 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 365 2023-10-06T02:30:33.458 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 365, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:30:06.715272+0000', 'modified': '2023-10-06T02:30:32.062334+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 147, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11088}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11088': {'gid': 11088, 'name': 'c', 'rank': 0, 'incarnation': 362, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.6:6835/3837760829', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 3837760829}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 3837760829}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:30:33.458 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:30:33.458 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:30:33.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.581+0000 7f0b4e845700 1 Processor -- start 2023-10-06T02:30:33.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.581+0000 7f0b4e845700 1 -- start start 2023-10-06T02:30:33.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.582+0000 7f0b4e845700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b481574b0 0x7f0b480b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.582+0000 7f0b4e845700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b480b13f0 0x7f0b480c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.582+0000 7f0b4e845700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b480c3b40 con 0x7f0b480c4510 2023-10-06T02:30:33.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.582+0000 7f0b4e845700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b480c4990 con 0x7f0b481574b0 2023-10-06T02:30:33.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.582+0000 7f0b4e845700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b480c2f30 con 0x7f0b480b13f0 2023-10-06T02:30:33.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.582+0000 7f0b47fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b481574b0 0x7f0b480b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.582+0000 7f0b4cde2700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0b480c4510 0x7f0b480cbcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59004/0 (socket says 172.21.15.6:59004) 2023-10-06T02:30:33.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.582+0000 7f0b4cde2700 1 -- 172.21.15.6:0/2754524899 learned_addr learned my addr 172.21.15.6:0/2754524899 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:33.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.582+0000 7f0b47fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b481574b0 0x7f0b480b0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53812/0 (socket says 172.21.15.6:53812) 2023-10-06T02:30:33.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.583+0000 7f0b477fe700 1 --2- 172.21.15.6:0/2754524899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b480b13f0 0x7f0b480c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.583+0000 7f0b47fff700 1 -- 172.21.15.6:0/2754524899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b480b13f0 msgr2=0x7f0b480c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:33.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.583+0000 7f0b47fff700 1 --2- 172.21.15.6:0/2754524899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b480b13f0 0x7f0b480c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.583+0000 7f0b47fff700 1 -- 172.21.15.6:0/2754524899 >> v1:172.21.15.6:6789/0 conn(0x7f0b480c4510 legacy=0x7f0b480cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:33.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.583+0000 7f0b46ffd700 1 -- 172.21.15.6:0/2754524899 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907382662 0 0) 0x7f0b480c3b40 con 0x7f0b480c4510 2023-10-06T02:30:33.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.583+0000 7f0b47fff700 1 -- 172.21.15.6:0/2754524899 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b480c3210 con 0x7f0b481574b0 2023-10-06T02:30:33.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.583+0000 7f0b47fff700 1 --2- 172.21.15.6:0/2754524899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b481574b0 0x7f0b480b0eb0 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7f0b380098d0 tx=0x7f0b38009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abdf2b7ee1c74d33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:33.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.583+0000 7f0b46ffd700 1 -- 172.21.15.6:0/2754524899 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38009e70 con 0x7f0b481574b0 2023-10-06T02:30:33.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.583+0000 7f0b46ffd700 1 -- 172.21.15.6:0/2754524899 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b38005c10 con 0x7f0b481574b0 2023-10-06T02:30:33.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.583+0000 7f0b46ffd700 1 -- 172.21.15.6:0/2754524899 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3800b650 con 0x7f0b481574b0 2023-10-06T02:30:33.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.584+0000 7f0b4e845700 1 -- 172.21.15.6:0/2754524899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b481574b0 msgr2=0x7f0b480b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:33.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.584+0000 7f0b4e845700 1 --2- 172.21.15.6:0/2754524899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b481574b0 0x7f0b480b0eb0 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7f0b380098d0 tx=0x7f0b38009120 comp rx=0 tx=0).stop 2023-10-06T02:30:33.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.584+0000 7f0b4e845700 1 -- 172.21.15.6:0/2754524899 shutdown_connections 2023-10-06T02:30:33.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.584+0000 7f0b4e845700 1 --2- 172.21.15.6:0/2754524899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b481574b0 0x7f0b480b0eb0 unknown :-1 s=CLOSED pgs=2460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.584+0000 7f0b4e845700 1 --2- 172.21.15.6:0/2754524899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b480b13f0 0x7f0b480c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.584+0000 7f0b4e845700 1 -- 172.21.15.6:0/2754524899 >> 172.21.15.6:0/2754524899 conn(0x7f0b48067910 msgr2=0x7f0b480ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:33.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.584+0000 7f0b4e845700 1 -- 172.21.15.6:0/2754524899 shutdown_connections 2023-10-06T02:30:33.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.584+0000 7f0b4e845700 1 -- 172.21.15.6:0/2754524899 wait complete. 2023-10-06T02:30:33.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.585+0000 7f0b4e845700 1 Processor -- start 2023-10-06T02:30:33.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.585+0000 7f0b4e845700 1 -- start start 2023-10-06T02:30:33.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b4e845700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b480b13f0 0x7f0b4816a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b4e845700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b480c4510 0x7f0b48151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b4e845700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b481574b0 0x7f0b48069790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b4e845700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b48158530 con 0x7f0b481574b0 2023-10-06T02:30:33.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b4e845700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4816ac10 con 0x7f0b480c4510 2023-10-06T02:30:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b4e845700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b481523b0 con 0x7f0b480b13f0 2023-10-06T02:30:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b4cde2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b481574b0 0x7f0b48069790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b4cde2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b481574b0 0x7f0b48069790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53828/0 (socket says 172.21.15.6:53828) 2023-10-06T02:30:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b4cde2700 1 -- 172.21.15.6:0/482457657 learned_addr learned my addr 172.21.15.6:0/482457657 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b47fff700 1 --2- 172.21.15.6:0/482457657 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b480b13f0 0x7f0b4816a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b477fe700 1 --2- 172.21.15.6:0/482457657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b480c4510 0x7f0b48151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b4cde2700 1 -- 172.21.15.6:0/482457657 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b480b13f0 msgr2=0x7f0b4816a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b4cde2700 1 --2- 172.21.15.6:0/482457657 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b480b13f0 0x7f0b4816a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b4cde2700 1 -- 172.21.15.6:0/482457657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b480c4510 msgr2=0x7f0b48151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b4cde2700 1 --2- 172.21.15.6:0/482457657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b480c4510 0x7f0b48151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b4cde2700 1 -- 172.21.15.6:0/482457657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b380093c0 con 0x7f0b481574b0 2023-10-06T02:30:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b477fe700 1 --2- 172.21.15.6:0/482457657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b480c4510 0x7f0b48151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b4cde2700 1 --2- 172.21.15.6:0/482457657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b481574b0 0x7f0b48069790 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000cc90 tx=0x7f0b40001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b2ffff700 1 -- 172.21.15.6:0/482457657 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000cea0 con 0x7f0b481574b0 2023-10-06T02:30:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b2ffff700 1 -- 172.21.15.6:0/482457657 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4000ab70 con 0x7f0b481574b0 2023-10-06T02:30:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.586+0000 7f0b4e845700 1 -- 172.21.15.6:0/482457657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b48157920 con 0x7f0b481574b0 2023-10-06T02:30:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.587+0000 7f0b2ffff700 1 -- 172.21.15.6:0/482457657 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b400070f0 con 0x7f0b481574b0 2023-10-06T02:30:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.587+0000 7f0b4e845700 1 -- 172.21.15.6:0/482457657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b48157ee0 con 0x7f0b481574b0 2023-10-06T02:30:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.588+0000 7f0b2ffff700 1 -- 172.21.15.6:0/482457657 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b400074a0 con 0x7f0b481574b0 2023-10-06T02:30:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.588+0000 7f0b2ffff700 1 --2- 172.21.15.6:0/482457657 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0b34066f30 0x7f0b340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.588+0000 7f0b2ffff700 1 -- 172.21.15.6:0/482457657 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f0b40084d40 con 0x7f0b481574b0 2023-10-06T02:30:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.589+0000 7f0b47fff700 1 --2- 172.21.15.6:0/482457657 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0b34066f30 0x7f0b340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.589+0000 7f0b47fff700 1 --2- 172.21.15.6:0/482457657 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0b34066f30 0x7f0b340693e0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009160 tx=0x7f0b38016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:33.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.590+0000 7f0b57b3db80 1 Processor -- start 2023-10-06T02:30:33.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.590+0000 7f0b57b3db80 1 -- start start 2023-10-06T02:30:33.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.591+0000 7f0b57b3db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc500840 0x55e8bc500c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.591+0000 7f0b57b3db80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc501cc0 0x55e8bc5506c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.591+0000 7f0b57b3db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc550c00 0x55e8bc551050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.591+0000 7f0b57b3db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8bc457a70 con 0x55e8bc500840 2023-10-06T02:30:33.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.591+0000 7f0b57b3db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8bc455270 con 0x55e8bc550c00 2023-10-06T02:30:33.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.591+0000 7f0b57b3db80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e8bc451060 con 0x55e8bc501cc0 2023-10-06T02:30:33.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.591+0000 7f0b47fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc500840 0x55e8bc500c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.591+0000 7f0b47fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc500840 0x55e8bc500c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53838/0 (socket says 172.21.15.6:53838) 2023-10-06T02:30:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.591+0000 7f0b47fff700 1 -- 172.21.15.6:0/1906918433 learned_addr learned my addr 172.21.15.6:0/1906918433 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.592+0000 7f0b477fe700 1 --2- 172.21.15.6:0/1906918433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc501cc0 0x55e8bc5506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.592+0000 7f0b4cde2700 1 --2- 172.21.15.6:0/1906918433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc550c00 0x55e8bc551050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.592+0000 7f0b47fff700 1 -- 172.21.15.6:0/1906918433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc501cc0 msgr2=0x55e8bc5506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.592+0000 7f0b47fff700 1 --2- 172.21.15.6:0/1906918433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc501cc0 0x55e8bc5506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.592+0000 7f0b47fff700 1 -- 172.21.15.6:0/1906918433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc550c00 msgr2=0x55e8bc551050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.592+0000 7f0b47fff700 1 --2- 172.21.15.6:0/1906918433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc550c00 0x55e8bc551050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.592+0000 7f0b47fff700 1 -- 172.21.15.6:0/1906918433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8bc2eb270 con 0x55e8bc500840 2023-10-06T02:30:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.592+0000 7f0b4cde2700 1 --2- 172.21.15.6:0/1906918433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc550c00 0x55e8bc551050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.592+0000 7f0b47fff700 1 --2- 172.21.15.6:0/1906918433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc500840 0x55e8bc500c10 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7f0b4806f5e0 tx=0x7f0b38022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101b9216c3ba51d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.592+0000 7f0b2d7fa700 1 -- 172.21.15.6:0/1906918433 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38022070 con 0x55e8bc500840 2023-10-06T02:30:33.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.592+0000 7f0b2d7fa700 1 -- 172.21.15.6:0/1906918433 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b38006250 con 0x55e8bc500840 2023-10-06T02:30:33.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.592+0000 7f0b2d7fa700 1 -- 172.21.15.6:0/1906918433 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b380063c0 con 0x55e8bc500840 2023-10-06T02:30:33.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.593+0000 7f0b57b3db80 1 -- 172.21.15.6:0/1906918433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc500840 msgr2=0x55e8bc500c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:33.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.593+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/1906918433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc500840 0x55e8bc500c10 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7f0b4806f5e0 tx=0x7f0b38022000 comp rx=0 tx=0).stop 2023-10-06T02:30:33.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.593+0000 7f0b57b3db80 1 -- 172.21.15.6:0/1906918433 shutdown_connections 2023-10-06T02:30:33.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.593+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/1906918433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc550c00 0x55e8bc551050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.593+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/1906918433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc500840 0x55e8bc500c10 unknown :-1 s=CLOSED pgs=2462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.593+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/1906918433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc501cc0 0x55e8bc5506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.593+0000 7f0b57b3db80 1 -- 172.21.15.6:0/1906918433 >> 172.21.15.6:0/1906918433 conn(0x55e8bc502160 msgr2=0x55e8bc502530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:33.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.593+0000 7f0b57b3db80 1 -- 172.21.15.6:0/1906918433 shutdown_connections 2023-10-06T02:30:33.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.593+0000 7f0b57b3db80 1 -- 172.21.15.6:0/1906918433 wait complete. 2023-10-06T02:30:33.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.593+0000 7f0b57b3db80 1 -- start start 2023-10-06T02:30:33.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.593+0000 7f0b57b3db80 1 Processor -- start 2023-10-06T02:30:33.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.594+0000 7f0b57b3db80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc500840 0x55e8bc540ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.594+0000 7f0b57b3db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 0x55e8bc5411e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.594+0000 7f0b57b3db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc550c00 0x55e8bc542e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.594+0000 7f0b57b3db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8bc3fc890 con 0x55e8bc550c00 2023-10-06T02:30:33.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.594+0000 7f0b57b3db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8bc417ea0 con 0x55e8bc501cc0 2023-10-06T02:30:33.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.594+0000 7f0b57b3db80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e8bc2d3e30 con 0x55e8bc500840 2023-10-06T02:30:33.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.594+0000 7f0b57b3db80 10 client.0 _ll_register_callbacks cb 0x55e8bc4c3e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:30:33.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.594+0000 7f0b4cde2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc550c00 0x55e8bc542e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.594+0000 7f0b4cde2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc550c00 0x55e8bc542e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53852/0 (socket says 172.21.15.6:53852) 2023-10-06T02:30:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.594+0000 7f0b4cde2700 1 -- 172.21.15.6:0/2600618935 learned_addr learned my addr 172.21.15.6:0/2600618935 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.594+0000 7f0b477fe700 1 --2- 172.21.15.6:0/2600618935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 0x55e8bc5411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.594+0000 7f0b47fff700 1 --2- 172.21.15.6:0/2600618935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc500840 0x55e8bc540ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b4cde2700 1 -- 172.21.15.6:0/2600618935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc500840 msgr2=0x55e8bc540ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b4cde2700 1 --2- 172.21.15.6:0/2600618935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc500840 0x55e8bc540ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b4cde2700 1 -- 172.21.15.6:0/2600618935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 msgr2=0x55e8bc5411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b4cde2700 1 --2- 172.21.15.6:0/2600618935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 0x55e8bc5411e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b4cde2700 1 -- 172.21.15.6:0/2600618935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b480c3210 con 0x55e8bc550c00 2023-10-06T02:30:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b477fe700 1 --2- 172.21.15.6:0/2600618935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 0x55e8bc5411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b47fff700 1 --2- 172.21.15.6:0/2600618935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc500840 0x55e8bc540ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b4cde2700 1 --2- 172.21.15.6:0/2600618935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc550c00 0x55e8bc542e20 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000a6d0 tx=0x7f0b40082e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d021da657c914a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b267fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:30:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b267fc700 1 -- 172.21.15.6:0/2600618935 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40081070 con 0x55e8bc550c00 2023-10-06T02:30:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b267fc700 1 -- 172.21.15.6:0/2600618935 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f0b40054eb0 con 0x55e8bc550c00 2023-10-06T02:30:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b57b3db80 1 -- 172.21.15.6:0/2600618935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e8bc4f5940 con 0x55e8bc550c00 2023-10-06T02:30:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b267fc700 1 -- 172.21.15.6:0/2600618935 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=365) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b4005c9c0 con 0x55e8bc550c00 2023-10-06T02:30:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b57b3db80 10 client.11151 fetch_fsmap learned FSMap version 365 2023-10-06T02:30:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b57b3db80 1 -- 172.21.15.6:0/2600618935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=365,monmap=2+}) v3 -- 0x55e8bc28dfe0 con 0x55e8bc550c00 2023-10-06T02:30:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b267fc700 1 -- 172.21.15.6:0/2600618935 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e8bc4f5940 con 0x55e8bc550c00 2023-10-06T02:30:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b267fc700 1 -- 172.21.15.6:0/2600618935 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 365) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0b4005c4d0 con 0x55e8bc550c00 2023-10-06T02:30:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b57b3db80 10 client.11151 fetch_fsmap finished waiting for FSMap version 365 2023-10-06T02:30:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b57b3db80 10 client.11151 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:30:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b57b3db80 20 client.11151 populate_metadata read hostname 'smithi006' 2023-10-06T02:30:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/2600618935 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55e8bc53f0d0 0x55e8bc53f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b57b3db80 4 client.11151 mds_command: new command op to 11088 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:30:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.595+0000 7f0b57b3db80 1 -- 172.21.15.6:0/2600618935 --> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e8bc4d2870 con 0x55e8bc53f0d0 2023-10-06T02:30:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.596+0000 7f0b47fff700 1 --2- 172.21.15.6:0/2600618935 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55e8bc53f0d0 0x55e8bc53f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.596+0000 7f0b267fc700 10 client.11151 ms_handle_connect on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.596+0000 7f0b47fff700 1 --2- 172.21.15.6:0/2600618935 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55e8bc53f0d0 0x55e8bc53f4a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=387eeaa6c6c40686 server_cookie=8f48d8ad31f18786 in_seq=0 out_seq=0 2023-10-06T02:30:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.596+0000 7f0b267fc700 1 -- 172.21.15.6:0/2600618935 <== mds.0 v2:172.21.15.6:6833/3837760829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e8bc4d2870 con 0x55e8bc53f0d0 2023-10-06T02:30:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.596+0000 7f0b267fc700 10 client.11151 handle_command_reply: tid=0 2023-10-06T02:30:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.596+0000 7f0b57b3db80 1 client.11151 shutdown 2023-10-06T02:30:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.597+0000 7f0b57b3db80 1 -- 172.21.15.6:0/2600618935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc550c00 msgr2=0x55e8bc542e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.597+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/2600618935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc550c00 0x55e8bc542e20 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000a6d0 tx=0x7f0b40082e90 comp rx=0 tx=0).stop 2023-10-06T02:30:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.597+0000 7f0b57b3db80 1 -- 172.21.15.6:0/2600618935 shutdown_connections 2023-10-06T02:30:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.597+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/2600618935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc550c00 0x55e8bc542e20 unknown :-1 s=CLOSED pgs=2463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.597+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/2600618935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc500840 0x55e8bc540ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.597+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/2600618935 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55e8bc53f0d0 0x55e8bc53f4a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.597+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/2600618935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 0x55e8bc5411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.597+0000 7f0b267fc700 0 client.11151 ms_handle_reset on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:33.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.597+0000 7f0b57b3db80 1 -- 172.21.15.6:0/2600618935 >> 172.21.15.6:0/2600618935 conn(0x55e8bc502160 msgr2=0x55e8bc5011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:33.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.597+0000 7f0b57b3db80 1 -- 172.21.15.6:0/2600618935 shutdown_connections 2023-10-06T02:30:33.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.597+0000 7f0b57b3db80 1 -- 172.21.15.6:0/2600618935 wait complete. 2023-10-06T02:30:33.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.597+0000 7f0b57b3db80 20 client.11151 trim_cache size 0 max 16384 2023-10-06T02:30:33.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.614+0000 7f0b57b3db80 1 Processor -- start 2023-10-06T02:30:33.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.614+0000 7f0b57b3db80 1 -- start start 2023-10-06T02:30:33.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b57b3db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc500840 0x55e8bc550570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b57b3db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 0x55e8bc53fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b57b3db80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc550c00 0x55e8bc540170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b57b3db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8bc4fc680 con 0x55e8bc500840 2023-10-06T02:30:33.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b57b3db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8bc550ab0 con 0x55e8bc501cc0 2023-10-06T02:30:33.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b57b3db80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e8bc4ff750 con 0x55e8bc550c00 2023-10-06T02:30:33.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b47fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc500840 0x55e8bc550570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b47fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc500840 0x55e8bc550570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53854/0 (socket says 172.21.15.6:53854) 2023-10-06T02:30:33.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b47fff700 1 -- 172.21.15.6:0/568563239 learned_addr learned my addr 172.21.15.6:0/568563239 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:33.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b477fe700 1 --2- 172.21.15.6:0/568563239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 0x55e8bc53fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b4cde2700 1 --2- 172.21.15.6:0/568563239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc550c00 0x55e8bc540170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b47fff700 1 -- 172.21.15.6:0/568563239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc550c00 msgr2=0x55e8bc540170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:33.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b47fff700 1 --2- 172.21.15.6:0/568563239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc550c00 0x55e8bc540170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b47fff700 1 -- 172.21.15.6:0/568563239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 msgr2=0x55e8bc53fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:33.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b47fff700 1 --2- 172.21.15.6:0/568563239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 0x55e8bc53fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b47fff700 1 -- 172.21.15.6:0/568563239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8bc41f780 con 0x55e8bc500840 2023-10-06T02:30:33.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b4cde2700 1 --2- 172.21.15.6:0/568563239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc550c00 0x55e8bc540170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:33.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b477fe700 1 --2- 172.21.15.6:0/568563239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 0x55e8bc53fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:33.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b47fff700 1 --2- 172.21.15.6:0/568563239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc500840 0x55e8bc550570 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 crypto rx=0x7f0b380098d0 tx=0x7f0b3802b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63492d15253a7528 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:33.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b2dffb700 1 -- 172.21.15.6:0/568563239 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38039040 con 0x55e8bc500840 2023-10-06T02:30:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b2dffb700 1 -- 172.21.15.6:0/568563239 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b380063c0 con 0x55e8bc500840 2023-10-06T02:30:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.615+0000 7f0b2dffb700 1 -- 172.21.15.6:0/568563239 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3803d250 con 0x55e8bc500840 2023-10-06T02:30:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.616+0000 7f0b57b3db80 1 -- 172.21.15.6:0/568563239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc500840 msgr2=0x55e8bc550570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.616+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/568563239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc500840 0x55e8bc550570 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 crypto rx=0x7f0b380098d0 tx=0x7f0b3802b040 comp rx=0 tx=0).stop 2023-10-06T02:30:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.616+0000 7f0b57b3db80 1 -- 172.21.15.6:0/568563239 shutdown_connections 2023-10-06T02:30:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.616+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/568563239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc550c00 0x55e8bc540170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.616+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/568563239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc500840 0x55e8bc550570 unknown :-1 s=CLOSED pgs=2464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.616+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/568563239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 0x55e8bc53fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.616+0000 7f0b57b3db80 1 -- 172.21.15.6:0/568563239 >> 172.21.15.6:0/568563239 conn(0x55e8bc502160 msgr2=0x55e8bc559650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:33.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.616+0000 7f0b57b3db80 1 -- 172.21.15.6:0/568563239 shutdown_connections 2023-10-06T02:30:33.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.616+0000 7f0b57b3db80 1 -- 172.21.15.6:0/568563239 wait complete. 2023-10-06T02:30:33.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.617+0000 7f0b57b3db80 1 -- start start 2023-10-06T02:30:33.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.617+0000 7f0b57b3db80 1 Processor -- start 2023-10-06T02:30:33.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.617+0000 7f0b57b3db80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc500840 0x55e8bc5463d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.617+0000 7f0b57b3db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 0x55e8bc546910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.617+0000 7f0b57b3db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc550c00 0x55e8bc53fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.617+0000 7f0b57b3db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8bc54f030 con 0x55e8bc550c00 2023-10-06T02:30:33.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.617+0000 7f0b57b3db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8bc5444c0 con 0x55e8bc501cc0 2023-10-06T02:30:33.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.617+0000 7f0b57b3db80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e8bc4fda40 con 0x55e8bc500840 2023-10-06T02:30:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.617+0000 7f0b57b3db80 10 client.0 _ll_register_callbacks cb 0x55e8bc4c3e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:30:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.617+0000 7f0b4cde2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc550c00 0x55e8bc53fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.617+0000 7f0b4cde2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc550c00 0x55e8bc53fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53856/0 (socket says 172.21.15.6:53856) 2023-10-06T02:30:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.617+0000 7f0b4cde2700 1 -- 172.21.15.6:0/2321833847 learned_addr learned my addr 172.21.15.6:0/2321833847 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b47fff700 1 --2- 172.21.15.6:0/2321833847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc500840 0x55e8bc5463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b477fe700 1 --2- 172.21.15.6:0/2321833847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 0x55e8bc546910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b4cde2700 1 -- 172.21.15.6:0/2321833847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc500840 msgr2=0x55e8bc5463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b4cde2700 1 --2- 172.21.15.6:0/2321833847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc500840 0x55e8bc5463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b4cde2700 1 -- 172.21.15.6:0/2321833847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 msgr2=0x55e8bc546910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b4cde2700 1 --2- 172.21.15.6:0/2321833847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 0x55e8bc546910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b4cde2700 1 -- 172.21.15.6:0/2321833847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e8bc2eb270 con 0x55e8bc550c00 2023-10-06T02:30:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b477fe700 1 --2- 172.21.15.6:0/2321833847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 0x55e8bc546910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b4cde2700 1 --2- 172.21.15.6:0/2321833847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc550c00 0x55e8bc53fc30 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7f0b400556c0 tx=0x7f0b40081000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45bfd6615452744 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b267fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:30:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b267fc700 1 -- 172.21.15.6:0/2321833847 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4001ac10 con 0x55e8bc550c00 2023-10-06T02:30:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b267fc700 1 -- 172.21.15.6:0/2321833847 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f0b40054eb0 con 0x55e8bc550c00 2023-10-06T02:30:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b57b3db80 1 -- 172.21.15.6:0/2321833847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b38006250 con 0x55e8bc550c00 2023-10-06T02:30:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b267fc700 1 -- 172.21.15.6:0/2321833847 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=365) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b4005c960 con 0x55e8bc550c00 2023-10-06T02:30:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b57b3db80 10 client.11157 fetch_fsmap learned FSMap version 365 2023-10-06T02:30:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b57b3db80 1 -- 172.21.15.6:0/2321833847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=365,monmap=2+}) v3 -- 0x55e8bc406470 con 0x55e8bc550c00 2023-10-06T02:30:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b267fc700 1 -- 172.21.15.6:0/2321833847 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b38006250 con 0x55e8bc550c00 2023-10-06T02:30:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b267fc700 1 -- 172.21.15.6:0/2321833847 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 365) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0b4005c4d0 con 0x55e8bc550c00 2023-10-06T02:30:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b57b3db80 10 client.11157 fetch_fsmap finished waiting for FSMap version 365 2023-10-06T02:30:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b57b3db80 10 client.11157 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:30:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b57b3db80 20 client.11157 populate_metadata read hostname 'smithi006' 2023-10-06T02:30:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/2321833847 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55e8bc5afa00 0x55e8bc540170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b57b3db80 4 client.11157 mds_command: new command op to 11088 tid=0[{"prefix": "status"}] 2023-10-06T02:30:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.618+0000 7f0b57b3db80 1 -- 172.21.15.6:0/2321833847 --> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e8bc3f3e00 con 0x55e8bc5afa00 2023-10-06T02:30:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b47fff700 1 --2- 172.21.15.6:0/2321833847 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55e8bc5afa00 0x55e8bc540170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b47fff700 1 --2- 172.21.15.6:0/2321833847 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55e8bc5afa00 0x55e8bc540170 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57db9058405663cd server_cookie=a8c601bf1c23f885 in_seq=0 out_seq=0 2023-10-06T02:30:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b267fc700 10 client.11157 ms_handle_connect on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b267fc700 1 -- 172.21.15.6:0/2321833847 <== mds.0 v2:172.21.15.6:6833/3837760829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x55e8bc3f3e00 con 0x55e8bc5afa00 2023-10-06T02:30:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b267fc700 10 client.11157 handle_command_reply: tid=0 2023-10-06T02:30:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b57b3db80 1 client.11157 shutdown 2023-10-06T02:30:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b57b3db80 1 -- 172.21.15.6:0/2321833847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc550c00 msgr2=0x55e8bc53fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/2321833847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc550c00 0x55e8bc53fc30 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7f0b400556c0 tx=0x7f0b40081000 comp rx=0 tx=0).stop 2023-10-06T02:30:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b57b3db80 1 -- 172.21.15.6:0/2321833847 shutdown_connections 2023-10-06T02:30:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/2321833847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e8bc550c00 0x55e8bc53fc30 unknown :-1 s=CLOSED pgs=2465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/2321833847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e8bc500840 0x55e8bc5463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/2321833847 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55e8bc5afa00 0x55e8bc540170 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b57b3db80 1 --2- 172.21.15.6:0/2321833847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bc501cc0 0x55e8bc546910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b267fc700 0 client.11157 ms_handle_reset on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b57b3db80 1 -- 172.21.15.6:0/2321833847 >> 172.21.15.6:0/2321833847 conn(0x55e8bc502160 msgr2=0x55e8bc559650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b57b3db80 1 -- 172.21.15.6:0/2321833847 shutdown_connections 2023-10-06T02:30:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b57b3db80 1 -- 172.21.15.6:0/2321833847 wait complete. 2023-10-06T02:30:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.619+0000 7f0b57b3db80 20 client.11157 trim_cache size 0 max 16384 2023-10-06T02:30:33.630 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:30:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c557bd13-0401-4965-a08f-5579f545617e", 2023-10-06T02:30:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-06T02:30:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 11088, 2023-10-06T02:30:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-06T02:30:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-06T02:30:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-06T02:30:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 4.564058717, 2023-10-06T02:30:33.631 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 365, 2023-10-06T02:30:33.631 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 149, 2023-10-06T02:30:33.631 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 148, 2023-10-06T02:30:33.631 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 5.5439692450000004 2023-10-06T02:30:33.631 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:30:33.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.620+0000 7f0b4e845700 1 -- 172.21.15.6:0/482457657 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0b34066f30 msgr2=0x7f0b340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:33.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.620+0000 7f0b4e845700 1 --2- 172.21.15.6:0/482457657 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0b34066f30 0x7f0b340693e0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009160 tx=0x7f0b38016000 comp rx=0 tx=0).stop 2023-10-06T02:30:33.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.620+0000 7f0b4e845700 1 -- 172.21.15.6:0/482457657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b481574b0 msgr2=0x7f0b48069790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:33.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.620+0000 7f0b4e845700 1 --2- 172.21.15.6:0/482457657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b481574b0 0x7f0b48069790 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000cc90 tx=0x7f0b40001a80 comp rx=0 tx=0).stop 2023-10-06T02:30:33.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.620+0000 7f0b4e845700 1 -- 172.21.15.6:0/482457657 shutdown_connections 2023-10-06T02:30:33.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.620+0000 7f0b4e845700 1 --2- 172.21.15.6:0/482457657 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0b34066f30 0x7f0b340693e0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.620+0000 7f0b4e845700 1 --2- 172.21.15.6:0/482457657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b481574b0 0x7f0b48069790 unknown :-1 s=CLOSED pgs=2461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.620+0000 7f0b4e845700 1 --2- 172.21.15.6:0/482457657 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b480b13f0 0x7f0b4816a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.620+0000 7f0b4e845700 1 --2- 172.21.15.6:0/482457657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b480c4510 0x7f0b48151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.620+0000 7f0b4e845700 1 -- 172.21.15.6:0/482457657 >> 172.21.15.6:0/482457657 conn(0x7f0b48067910 msgr2=0x7f0b481528f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:33.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.620+0000 7f0b4e845700 1 -- 172.21.15.6:0/482457657 shutdown_connections 2023-10-06T02:30:33.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.620+0000 7f0b4e845700 1 -- 172.21.15.6:0/482457657 wait complete. 2023-10-06T02:30:33.634 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:30:33.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.753+0000 7f9d9cec6700 1 Processor -- start 2023-10-06T02:30:33.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.753+0000 7f9d9cec6700 1 -- start start 2023-10-06T02:30:33.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.754+0000 7f9d9cec6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d980cf1a0 0x7f9d980cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.754+0000 7f9d9cec6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d981597d0 0x7f9d980d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.754+0000 7f9d9cec6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d980b3560 con 0x7f9d98159400 2023-10-06T02:30:33.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.754+0000 7f9d9cec6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d980cf6f0 con 0x7f9d981597d0 2023-10-06T02:30:33.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.754+0000 7f9d9cec6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d980cf9d0 con 0x7f9d980cf1a0 2023-10-06T02:30:33.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.754+0000 7f9d97fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d981597d0 0x7f9d980d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.754+0000 7f9d977fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9d98159400 0x7f9d980ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59014/0 (socket says 172.21.15.6:59014) 2023-10-06T02:30:33.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.754+0000 7f9d977fe700 1 -- 172.21.15.6:0/3197492601 learned_addr learned my addr 172.21.15.6:0/3197492601 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:33.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.754+0000 7f9d96ffd700 1 --2- 172.21.15.6:0/3197492601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d980cf1a0 0x7f9d980cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.754+0000 7f9d97fff700 1 -- 172.21.15.6:0/3197492601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d980cf1a0 msgr2=0x7f9d980cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:33.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.754+0000 7f9d97fff700 1 --2- 172.21.15.6:0/3197492601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d980cf1a0 0x7f9d980cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.754+0000 7f9d97fff700 1 -- 172.21.15.6:0/3197492601 >> v1:172.21.15.6:6789/0 conn(0x7f9d98159400 legacy=0x7f9d980ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:33.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.754+0000 7f9d97fff700 1 -- 172.21.15.6:0/3197492601 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d980b2f10 con 0x7f9d981597d0 2023-10-06T02:30:33.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.754+0000 7f9d967fc700 1 -- 172.21.15.6:0/3197492601 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850719409 0 0) 0x7f9d980b3560 con 0x7f9d98159400 2023-10-06T02:30:33.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.755+0000 7f9d97fff700 1 --2- 172.21.15.6:0/3197492601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d981597d0 0x7f9d980d0400 secure :-1 s=READY pgs=2467 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009e60 tx=0x7f9d90009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43d4b10f7253294 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:33.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.755+0000 7f9d967fc700 1 -- 172.21.15.6:0/3197492601 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9000e070 con 0x7f9d981597d0 2023-10-06T02:30:33.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.755+0000 7f9d967fc700 1 -- 172.21.15.6:0/3197492601 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9000bc30 con 0x7f9d981597d0 2023-10-06T02:30:33.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.755+0000 7f9d967fc700 1 -- 172.21.15.6:0/3197492601 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90012430 con 0x7f9d981597d0 2023-10-06T02:30:33.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.755+0000 7f9d9cec6700 1 -- 172.21.15.6:0/3197492601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d981597d0 msgr2=0x7f9d980d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:33.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.755+0000 7f9d9cec6700 1 --2- 172.21.15.6:0/3197492601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d981597d0 0x7f9d980d0400 secure :-1 s=READY pgs=2467 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009e60 tx=0x7f9d90009780 comp rx=0 tx=0).stop 2023-10-06T02:30:33.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.755+0000 7f9d9cec6700 1 -- 172.21.15.6:0/3197492601 shutdown_connections 2023-10-06T02:30:33.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.755+0000 7f9d9cec6700 1 --2- 172.21.15.6:0/3197492601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d981597d0 0x7f9d980d0400 unknown :-1 s=CLOSED pgs=2467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.755+0000 7f9d9cec6700 1 --2- 172.21.15.6:0/3197492601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d980cf1a0 0x7f9d980cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.755+0000 7f9d9cec6700 1 -- 172.21.15.6:0/3197492601 >> 172.21.15.6:0/3197492601 conn(0x7f9d9806ac10 msgr2=0x7f9d98068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:33.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.755+0000 7f9d9cec6700 1 -- 172.21.15.6:0/3197492601 shutdown_connections 2023-10-06T02:30:33.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.755+0000 7f9d9cec6700 1 -- 172.21.15.6:0/3197492601 wait complete. 2023-10-06T02:30:33.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.757+0000 7f9d9cec6700 1 Processor -- start 2023-10-06T02:30:33.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.757+0000 7f9d9cec6700 1 -- start start 2023-10-06T02:30:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.757+0000 7f9d9cec6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d980cf1a0 0x7f9d9815ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.757+0000 7f9d9cec6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d98159400 0x7f9d98153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.757+0000 7f9d9cec6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d981597d0 0x7f9d980c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.757+0000 7f9d9cec6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9815c160 con 0x7f9d98159400 2023-10-06T02:30:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.757+0000 7f9d9cec6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9815b550 con 0x7f9d980cf1a0 2023-10-06T02:30:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.757+0000 7f9d9cec6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9815b830 con 0x7f9d981597d0 2023-10-06T02:30:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.757+0000 7f9d96ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d98159400 0x7f9d98153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.757+0000 7f9d96ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d98159400 0x7f9d98153d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53884/0 (socket says 172.21.15.6:53884) 2023-10-06T02:30:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.757+0000 7f9d96ffd700 1 -- 172.21.15.6:0/1515269985 learned_addr learned my addr 172.21.15.6:0/1515269985 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.758+0000 7f9d97fff700 1 --2- 172.21.15.6:0/1515269985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d981597d0 0x7f9d980c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.758+0000 7f9d977fe700 1 --2- 172.21.15.6:0/1515269985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d980cf1a0 0x7f9d9815ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.758+0000 7f9d96ffd700 1 -- 172.21.15.6:0/1515269985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d981597d0 msgr2=0x7f9d980c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.758+0000 7f9d96ffd700 1 --2- 172.21.15.6:0/1515269985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d981597d0 0x7f9d980c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.758+0000 7f9d96ffd700 1 -- 172.21.15.6:0/1515269985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d980cf1a0 msgr2=0x7f9d9815ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.758+0000 7f9d96ffd700 1 --2- 172.21.15.6:0/1515269985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d980cf1a0 0x7f9d9815ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.758+0000 7f9d96ffd700 1 -- 172.21.15.6:0/1515269985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d90009a20 con 0x7f9d98159400 2023-10-06T02:30:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.758+0000 7f9d96ffd700 1 --2- 172.21.15.6:0/1515269985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d98159400 0x7f9d98153d40 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00c880 tx=0x7f9d8c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.758+0000 7f9d7f7fe700 1 -- 172.21.15.6:0/1515269985 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c011600 con 0x7f9d98159400 2023-10-06T02:30:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.758+0000 7f9d7f7fe700 1 -- 172.21.15.6:0/1515269985 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c0117a0 con 0x7f9d98159400 2023-10-06T02:30:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.758+0000 7f9d9cec6700 1 -- 172.21.15.6:0/1515269985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9815bb10 con 0x7f9d98159400 2023-10-06T02:30:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.758+0000 7f9d7f7fe700 1 -- 172.21.15.6:0/1515269985 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c011b60 con 0x7f9d98159400 2023-10-06T02:30:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.758+0000 7f9d9cec6700 1 -- 172.21.15.6:0/1515269985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9815b190 con 0x7f9d98159400 2023-10-06T02:30:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.759+0000 7f9d9cec6700 1 -- 172.21.15.6:0/1515269985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d980b31f0 con 0x7f9d98159400 2023-10-06T02:30:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.759+0000 7f9d7f7fe700 1 -- 172.21.15.6:0/1515269985 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d8c018360 con 0x7f9d98159400 2023-10-06T02:30:33.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.760+0000 7f9d7f7fe700 1 --2- 172.21.15.6:0/1515269985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9d84066f30 0x7f9d840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:33.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.760+0000 7f9d7f7fe700 1 -- 172.21.15.6:0/1515269985 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f9d8c0846a0 con 0x7f9d98159400 2023-10-06T02:30:33.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.760+0000 7f9d977fe700 1 --2- 172.21.15.6:0/1515269985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9d84066f30 0x7f9d840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:33.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.760+0000 7f9d977fe700 1 --2- 172.21.15.6:0/1515269985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9d84066f30 0x7f9d840693e0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9d88001360 tx=0x7f9d88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:33.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:33.764+0000 7f9d7f7fe700 1 -- 172.21.15.6:0/1515269985 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d8c0515e0 con 0x7f9d98159400 2023-10-06T02:30:34.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:34.003+0000 7f9d9cec6700 1 -- 172.21.15.6:0/1515269985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9d98068420 con 0x7f9d98159400 2023-10-06T02:30:34.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:34.003+0000 7f9d7f7fe700 1 -- 172.21.15.6:0/1515269985 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v365) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9d8c054c00 con 0x7f9d98159400 2023-10-06T02:30:34.004 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:30:34.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:34.005+0000 7f9d9cec6700 1 -- 172.21.15.6:0/1515269985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9d84066f30 msgr2=0x7f9d840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:34.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:34.005+0000 7f9d9cec6700 1 --2- 172.21.15.6:0/1515269985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9d84066f30 0x7f9d840693e0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9d88001360 tx=0x7f9d88009040 comp rx=0 tx=0).stop 2023-10-06T02:30:34.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:34.005+0000 7f9d9cec6700 1 -- 172.21.15.6:0/1515269985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d98159400 msgr2=0x7f9d98153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:34.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:34.005+0000 7f9d9cec6700 1 --2- 172.21.15.6:0/1515269985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d98159400 0x7f9d98153d40 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00c880 tx=0x7f9d8c008040 comp rx=0 tx=0).stop 2023-10-06T02:30:34.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:34.005+0000 7f9d9cec6700 1 -- 172.21.15.6:0/1515269985 shutdown_connections 2023-10-06T02:30:34.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:34.005+0000 7f9d9cec6700 1 --2- 172.21.15.6:0/1515269985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d981597d0 0x7f9d980c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:34.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:34.005+0000 7f9d9cec6700 1 --2- 172.21.15.6:0/1515269985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d980cf1a0 0x7f9d9815ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:34.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:34.005+0000 7f9d9cec6700 1 --2- 172.21.15.6:0/1515269985 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9d84066f30 0x7f9d840693e0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:34.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:34.005+0000 7f9d9cec6700 1 --2- 172.21.15.6:0/1515269985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d98159400 0x7f9d98153d40 unknown :-1 s=CLOSED pgs=2468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:34.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:34.005+0000 7f9d9cec6700 1 -- 172.21.15.6:0/1515269985 >> 172.21.15.6:0/1515269985 conn(0x7f9d9806ac10 msgr2=0x7f9d980b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:34.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:34.005+0000 7f9d9cec6700 1 -- 172.21.15.6:0/1515269985 shutdown_connections 2023-10-06T02:30:34.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:34.005+0000 7f9d9cec6700 1 -- 172.21.15.6:0/1515269985 wait complete. 2023-10-06T02:30:34.018 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:30:34.018 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:30:34.018 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-06T02:30:34.018 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:30:34.018 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:30:34.018 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:30:34.018 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:30:34.018 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:30:34.018 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:30:34.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:34.019 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-06T02:30:34.034 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:30:34.034 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:30:34.034 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:30:34.034 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:30:34.034 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-06T02:30:34.034 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:30:34.034 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:30:34.035 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:30:34.035 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-06T02:30:34.035 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:30:34.035 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:30:34.035 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-06T02:30:34.035 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:30:34.035 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:30:34.035 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-06T02:30:34.035 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:30:34.035 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41712sec preferred_lft 41712sec 2023-10-06T02:30:34.035 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-06T02:30:34.035 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:30:34.036 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:30:34.036 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:30:34.036 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-06T02:30:34.036 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:30:34.036 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:30:34.036 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:30:34.036 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:30:34.036 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::149d:e8ff:febf:65ee/64 scope link 2023-10-06T02:30:34.036 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:30:34.036 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:30:34.036 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether d2:db:3e:20:25:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:30:34.036 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::d0db:3eff:fe20:25b7/64 scope link 2023-10-06T02:30:34.036 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:30:34.037 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:30:34.037 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:a8:e4:5f:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:30:34.037 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a8:e4ff:fe5f:d710/64 scope link 2023-10-06T02:30:34.037 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:30:34.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:34.037 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:30:34.098 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-06T02:30:34.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:34.099 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-06T02:30:34.155 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-06T02:30:34.156 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:30:34.156 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:30:34.156 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:30:34.156 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:30:34.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:34.156 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-06T02:30:34.156 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-06T02:30:34.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:30:34.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:30:34.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:30:34.157 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-06T02:30:34.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:34.259 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:30:34.273 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:30:34.273 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:30:34.273 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:30:34.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:34.274 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-06T02:30:34.339 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:30:34.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:30:34.339 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:30:34.394 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:30:34.395 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:30:34.395 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:30:34.449 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:30:34.515 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:30:34.515 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:30:34.580 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:30:34.581 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:30:34.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:34.581 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:30:34.636 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:30:34.637 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:30:34.679 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-10-06T02:30:34.704 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:30:34.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:30:34.760 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-10-06T02:30:34.760+0000 7f6a9122b540 -1 init, newargv = 0x55f6b517d950 newargc=15 2023-10-06T02:30:34.761 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[147393]: starting ceph client 2023-10-06T02:30:34.765 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[147393]: starting fuse 2023-10-06T02:30:34.771 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:30:34.772 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:30:34.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:34.773 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-10-06T02:30:34.828 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-10-06T02:30:34.828 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-06T02:30:34.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:30:34.828 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-10-06T02:30:34.828 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-10-06T02:30:34.828 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-06T02:30:34.828 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-06T02:30:34.829 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:30:34.829 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-10-06T02:30:34.829 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:30:34.829 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-10-06T02:30:34.829 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:30:34.829 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:30:34.829 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-10-06T02:30:34.829 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-10-06T02:30:34.829 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-10-06T02:30:34.829 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-10-06T02:30:34.829 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:30:34.829 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-10-06T02:30:34.830 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:30:34.830 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:30:34.830 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:30:34.830 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-10-06T02:30:34.830 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-10-06T02:30:34.830 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-10-06T02:30:34.830 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:30:34.830 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-06T02:30:34.830 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-10-06T02:30:34.830 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-06T02:30:34.952 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.147393.asok 2023-10-06T02:30:35.055 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-06T02:30:35.055+0000 7f2f8e057700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:30:35.134 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.147393.asok 2023-10-06T02:30:35.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:35.134 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.147393.asok status 2023-10-06T02:30:35.289 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:30:35.289 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-10-06T02:30:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:30:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:30:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-10-06T02:30:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-10-06T02:30:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:30:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "147393", 2023-10-06T02:30:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-10-06T02:30:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-10-06T02:30:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-10-06T02:30:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 11175, 2023-10-06T02:30:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-10-06T02:30:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-10-06T02:30:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-10-06T02:30:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 11175 2023-10-06T02:30:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:30:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:30:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:30:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1483561493 2023-10-06T02:30:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-10-06T02:30:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-06T02:30:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:30:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1483561493 2023-10-06T02:30:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.11175 192.168.0.1:0/1483561493", 2023-10-06T02:30:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/1483561493", 2023-10-06T02:30:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-10-06T02:30:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 365, 2023-10-06T02:30:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 149, 2023-10-06T02:30:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:30:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-10-06T02:30:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-10-06T02:30:35.292 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:30:35.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:35.299 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-10-06T02:30:35.299 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:30:35.315 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-10-06T02:30:35.315 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:30:35.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:35.315 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:30:35.382 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-10-06T02:30:35.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.461+0000 7f03e4040000 1 Processor -- start 2023-10-06T02:30:35.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.461+0000 7f03e4040000 1 -- start start 2023-10-06T02:30:35.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.461+0000 7f03e4040000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03c8002300 0x564f2bec5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03e4040000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f2bf926d0 0x564f2bfa91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03e4040000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f2bf0ffe0 0x564f2bfa96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03e4040000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f2be12980 con 0x7f03c8002300 2023-10-06T02:30:35.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03e4040000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f2be12620 con 0x564f2bf0ffe0 2023-10-06T02:30:35.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03e4040000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564f2be09400 con 0x564f2bf926d0 2023-10-06T02:30:35.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03dd27b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03c8002300 0x564f2bec5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03dd27b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03c8002300 0x564f2bec5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53900/0 (socket says 172.21.15.6:53900) 2023-10-06T02:30:35.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03dd27b700 1 -- 172.21.15.6:0/2881689967 learned_addr learned my addr 172.21.15.6:0/2881689967 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:35.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03dca7a700 1 --2- 172.21.15.6:0/2881689967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f2bf926d0 0x564f2bfa91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03dda7c700 1 --2- 172.21.15.6:0/2881689967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f2bf0ffe0 0x564f2bfa96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03dd27b700 1 -- 172.21.15.6:0/2881689967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f2bf926d0 msgr2=0x564f2bfa91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:35.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03dd27b700 1 --2- 172.21.15.6:0/2881689967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f2bf926d0 0x564f2bfa91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03dd27b700 1 -- 172.21.15.6:0/2881689967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f2bf0ffe0 msgr2=0x564f2bfa96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03dd27b700 1 --2- 172.21.15.6:0/2881689967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f2bf0ffe0 0x564f2bfa96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03dd27b700 1 -- 172.21.15.6:0/2881689967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f2be213d0 con 0x7f03c8002300 2023-10-06T02:30:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03dd27b700 1 --2- 172.21.15.6:0/2881689967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03c8002300 0x564f2bec5e90 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009e30 tx=0x7f03d8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af33bb681df6c9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03cf7fe700 1 -- 172.21.15.6:0/2881689967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d800e070 con 0x7f03c8002300 2023-10-06T02:30:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03cf7fe700 1 -- 172.21.15.6:0/2881689967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d800f040 con 0x7f03c8002300 2023-10-06T02:30:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.462+0000 7f03cf7fe700 1 -- 172.21.15.6:0/2881689967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d80088b0 con 0x7f03c8002300 2023-10-06T02:30:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.463+0000 7f03e4040000 1 -- 172.21.15.6:0/2881689967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03c8002300 msgr2=0x564f2bec5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.463+0000 7f03e4040000 1 --2- 172.21.15.6:0/2881689967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03c8002300 0x564f2bec5e90 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009e30 tx=0x7f03d8018000 comp rx=0 tx=0).stop 2023-10-06T02:30:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.463+0000 7f03e4040000 1 -- 172.21.15.6:0/2881689967 shutdown_connections 2023-10-06T02:30:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.463+0000 7f03e4040000 1 --2- 172.21.15.6:0/2881689967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f2bf0ffe0 0x564f2bfa96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.463+0000 7f03e4040000 1 --2- 172.21.15.6:0/2881689967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03c8002300 0x564f2bec5e90 unknown :-1 s=CLOSED pgs=2474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.463+0000 7f03e4040000 1 --2- 172.21.15.6:0/2881689967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564f2bf926d0 0x564f2bfa91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.463+0000 7f03e4040000 1 -- 172.21.15.6:0/2881689967 >> 172.21.15.6:0/2881689967 conn(0x564f2bf0ebd0 msgr2=0x564f2bec92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.463+0000 7f03e4040000 1 -- 172.21.15.6:0/2881689967 shutdown_connections 2023-10-06T02:30:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.463+0000 7f03e4040000 1 -- 172.21.15.6:0/2881689967 wait complete. 2023-10-06T02:30:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.463+0000 7f03e4040000 1 Processor -- start 2023-10-06T02:30:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.463+0000 7f03e4040000 1 -- start start 2023-10-06T02:30:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.464+0000 7f03e4040000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f2bf0ffe0 0x564f2bf91580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.464+0000 7f03e4040000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f2bf926d0 0x564f2bf8f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.464+0000 7f03e4040000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03c8002300 0x564f2bf10ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.464+0000 7f03e4040000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f2bf91e50 con 0x564f2bf926d0 2023-10-06T02:30:35.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.464+0000 7f03e4040000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f2bf91bb0 con 0x564f2bf0ffe0 2023-10-06T02:30:35.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.464+0000 7f03e4040000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564f2bf8b6c0 con 0x7f03c8002300 2023-10-06T02:30:35.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.464+0000 7f03dca7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f2bf926d0 0x564f2bf8f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.464+0000 7f03dca7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f2bf926d0 0x564f2bf8f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53910/0 (socket says 172.21.15.6:53910) 2023-10-06T02:30:35.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.464+0000 7f03dd27b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f2bf0ffe0 0x564f2bf91580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.464+0000 7f03dca7a700 1 -- 172.21.15.6:0/3156841821 learned_addr learned my addr 172.21.15.6:0/3156841821 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:35.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.464+0000 7f03dda7c700 1 --2- 172.21.15.6:0/3156841821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03c8002300 0x564f2bf10ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.464+0000 7f03dca7a700 1 -- 172.21.15.6:0/3156841821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03c8002300 msgr2=0x564f2bf10ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:35.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.464+0000 7f03dca7a700 1 --2- 172.21.15.6:0/3156841821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03c8002300 0x564f2bf10ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.464+0000 7f03dca7a700 1 -- 172.21.15.6:0/3156841821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f2bf0ffe0 msgr2=0x564f2bf91580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:35.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.464+0000 7f03dca7a700 1 --2- 172.21.15.6:0/3156841821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f2bf0ffe0 0x564f2bf91580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.464+0000 7f03dca7a700 1 -- 172.21.15.6:0/3156841821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c8001e10 con 0x564f2bf926d0 2023-10-06T02:30:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.465+0000 7f03dca7a700 1 --2- 172.21.15.6:0/3156841821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f2bf926d0 0x564f2bf8f1b0 secure :-1 s=READY pgs=2475 cs=0 l=1 rev1=1 crypto rx=0x7f03d4005cc0 tx=0x7f03d400c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.465+0000 7f03cdffb700 1 -- 172.21.15.6:0/3156841821 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400f030 con 0x564f2bf926d0 2023-10-06T02:30:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.465+0000 7f03cdffb700 1 -- 172.21.15.6:0/3156841821 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d4010040 con 0x564f2bf926d0 2023-10-06T02:30:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.465+0000 7f03e4040000 1 -- 172.21.15.6:0/3156841821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f2be14ae0 con 0x564f2bf926d0 2023-10-06T02:30:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.465+0000 7f03cdffb700 1 -- 172.21.15.6:0/3156841821 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d4006cd0 con 0x564f2bf926d0 2023-10-06T02:30:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.465+0000 7f03e4040000 1 -- 172.21.15.6:0/3156841821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f2be14540 con 0x564f2bf926d0 2023-10-06T02:30:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.466+0000 7f03cdffb700 1 -- 172.21.15.6:0/3156841821 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03d4016690 con 0x564f2bf926d0 2023-10-06T02:30:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.466+0000 7f03cdffb700 1 --2- 172.21.15.6:0/3156841821 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f03c00658c0 0x7f03c0067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.467+0000 7f03cdffb700 1 -- 172.21.15.6:0/3156841821 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f03d40836f0 con 0x564f2bf926d0 2023-10-06T02:30:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.467+0000 7f03e4040000 1 --2- 172.21.15.6:0/3156841821 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x564f2bf11400 0x564f2bf8a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.467+0000 7f03e4040000 1 -- 172.21.15.6:0/3156841821 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 17.7 17:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e149) v8 -- 0x564f2bf8d0b0 con 0x564f2bf11400 2023-10-06T02:30:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.467+0000 7f03dd27b700 1 --2- 172.21.15.6:0/3156841821 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f03c00658c0 0x7f03c0067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.467+0000 7f03dda7c700 1 --2- 172.21.15.6:0/3156841821 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x564f2bf11400 0x564f2bf8a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.467+0000 7f03dda7c700 1 --2- 172.21.15.6:0/3156841821 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x564f2bf11400 0x564f2bf8a360 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.467+0000 7f03dd27b700 1 --2- 172.21.15.6:0/3156841821 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f03c00658c0 0x7f03c0067d70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f03d80096e0 tx=0x7f03d801e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.467+0000 7f03dda7c700 1 -- 172.21.15.6:0/3156841821 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (91) out=91b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+91 (crc 0 0 0) 0x7f03d0005a30 con 0x564f2bf11400 2023-10-06T02:30:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.467+0000 7f03e4040000 1 -- 172.21.15.6:0/3156841821 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x564f2bf11400 msgr2=0x564f2bf8a360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.467+0000 7f03e4040000 1 --2- 172.21.15.6:0/3156841821 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x564f2bf11400 0x564f2bf8a360 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.468+0000 7f03e4040000 1 -- 172.21.15.6:0/3156841821 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f03c00658c0 msgr2=0x7f03c0067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.468+0000 7f03e4040000 1 --2- 172.21.15.6:0/3156841821 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f03c00658c0 0x7f03c0067d70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f03d80096e0 tx=0x7f03d801e000 comp rx=0 tx=0).stop 2023-10-06T02:30:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.468+0000 7f03e4040000 1 -- 172.21.15.6:0/3156841821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f2bf926d0 msgr2=0x564f2bf8f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.468+0000 7f03e4040000 1 --2- 172.21.15.6:0/3156841821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f2bf926d0 0x564f2bf8f1b0 secure :-1 s=READY pgs=2475 cs=0 l=1 rev1=1 crypto rx=0x7f03d4005cc0 tx=0x7f03d400c040 comp rx=0 tx=0).stop 2023-10-06T02:30:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.468+0000 7f03dda7c700 1 -- 172.21.15.6:0/3156841821 reap_dead start 2023-10-06T02:30:35.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.468+0000 7f03e4040000 1 -- 172.21.15.6:0/3156841821 shutdown_connections 2023-10-06T02:30:35.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.468+0000 7f03e4040000 1 -- 172.21.15.6:0/3156841821 >> 172.21.15.6:0/3156841821 conn(0x564f2bf0ebd0 msgr2=0x564f2bec92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:35.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.468+0000 7f03e4040000 1 -- 172.21.15.6:0/3156841821 shutdown_connections 2023-10-06T02:30:35.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.468+0000 7f03e4040000 1 -- 172.21.15.6:0/3156841821 wait complete. 2023-10-06T02:30:35.476 INFO:teuthology.orchestra.run.smithi006.stdout:Ufile1dir1 2023-10-06T02:30:35.476 DEBUG:teuthology.orchestra.run.smithi006:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-10-06T02:30:35.635 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:30:35.635 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 1099511627777, 2023-10-06T02:30:35.636 INFO:teuthology.orchestra.run.smithi006.stdout: "ancestors": [ 2023-10-06T02:30:35.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:35.636 INFO:teuthology.orchestra.run.smithi006.stdout: "dirino": 1099511627776, 2023-10-06T02:30:35.636 INFO:teuthology.orchestra.run.smithi006.stdout: "dname": "file1", 2023-10-06T02:30:35.636 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 6 2023-10-06T02:30:35.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:35.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:35.636 INFO:teuthology.orchestra.run.smithi006.stdout: "dirino": 1, 2023-10-06T02:30:35.636 INFO:teuthology.orchestra.run.smithi006.stdout: "dname": "dir1", 2023-10-06T02:30:35.636 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 18 2023-10-06T02:30:35.636 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:35.636 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-06T02:30:35.636 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 17, 2023-10-06T02:30:35.637 INFO:teuthology.orchestra.run.smithi006.stdout: "old_pools": [] 2023-10-06T02:30:35.637 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:30:35.637 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:35.638 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent rhubarb 2023-10-06T02:30:35.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.677+0000 7f884d13e000 1 Processor -- start 2023-10-06T02:30:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.677+0000 7f884d13e000 1 -- start start 2023-10-06T02:30:35.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f884d13e000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5653541275c0 0x5653541ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f884d13e000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653541b2ed0 0x5653541aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f884d13e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653541b6a90 0x56535410baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f884d13e000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535402a980 con 0x5653541b2ed0 2023-10-06T02:30:35.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f884d13e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535402a620 con 0x5653541b6a90 2023-10-06T02:30:35.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f884d13e000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x565354021400 con 0x5653541275c0 2023-10-06T02:30:35.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f8845b78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653541b2ed0 0x5653541aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f8845b78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653541b2ed0 0x5653541aa200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53932/0 (socket says 172.21.15.6:53932) 2023-10-06T02:30:35.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f8845b78700 1 -- 172.21.15.6:0/234384924 learned_addr learned my addr 172.21.15.6:0/234384924 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:35.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f8846b7a700 1 --2- 172.21.15.6:0/234384924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653541b6a90 0x56535410baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f8846379700 1 --2- 172.21.15.6:0/234384924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5653541275c0 0x5653541ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f8845b78700 1 -- 172.21.15.6:0/234384924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5653541275c0 msgr2=0x5653541ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:35.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f8845b78700 1 --2- 172.21.15.6:0/234384924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5653541275c0 0x5653541ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f8845b78700 1 -- 172.21.15.6:0/234384924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653541b6a90 msgr2=0x56535410baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:35.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f8845b78700 1 --2- 172.21.15.6:0/234384924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653541b6a90 0x56535410baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f8845b78700 1 -- 172.21.15.6:0/234384924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8840005db0 con 0x5653541b2ed0 2023-10-06T02:30:35.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f8846b7a700 1 --2- 172.21.15.6:0/234384924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653541b6a90 0x56535410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:35.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f8845b78700 1 --2- 172.21.15.6:0/234384924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653541b2ed0 0x5653541aa200 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 crypto rx=0x7f88300096a0 tx=0x7f8830005b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db396017bad87a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:35.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f8844b76700 1 -- 172.21.15.6:0/234384924 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883000e070 con 0x5653541b2ed0 2023-10-06T02:30:35.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f8844b76700 1 -- 172.21.15.6:0/234384924 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8830006500 con 0x5653541b2ed0 2023-10-06T02:30:35.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.678+0000 7f8844b76700 1 -- 172.21.15.6:0/234384924 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830006880 con 0x5653541b2ed0 2023-10-06T02:30:35.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.679+0000 7f884d13e000 1 -- 172.21.15.6:0/234384924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653541b2ed0 msgr2=0x5653541aa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:35.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.679+0000 7f884d13e000 1 --2- 172.21.15.6:0/234384924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653541b2ed0 0x5653541aa200 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 crypto rx=0x7f88300096a0 tx=0x7f8830005b60 comp rx=0 tx=0).stop 2023-10-06T02:30:35.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.679+0000 7f884d13e000 1 -- 172.21.15.6:0/234384924 shutdown_connections 2023-10-06T02:30:35.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.679+0000 7f884d13e000 1 --2- 172.21.15.6:0/234384924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653541b6a90 0x56535410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.679+0000 7f884d13e000 1 --2- 172.21.15.6:0/234384924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5653541275c0 0x5653541ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.679+0000 7f884d13e000 1 --2- 172.21.15.6:0/234384924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653541b2ed0 0x5653541aa200 unknown :-1 s=CLOSED pgs=2477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.679+0000 7f884d13e000 1 -- 172.21.15.6:0/234384924 >> 172.21.15.6:0/234384924 conn(0x5653540dfd40 msgr2=0x5653540e2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:35.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.679+0000 7f884d13e000 1 -- 172.21.15.6:0/234384924 shutdown_connections 2023-10-06T02:30:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.679+0000 7f884d13e000 1 -- 172.21.15.6:0/234384924 wait complete. 2023-10-06T02:30:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.679+0000 7f884d13e000 1 Processor -- start 2023-10-06T02:30:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.679+0000 7f884d13e000 1 -- start start 2023-10-06T02:30:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.680+0000 7f884d13e000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5653541275c0 0x5653541b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.680+0000 7f884d13e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653541b2ed0 0x5653541a90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.680+0000 7f884d13e000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653541b6a90 0x5653541a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.680+0000 7f884d13e000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653541acb20 con 0x5653541b6a90 2023-10-06T02:30:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.680+0000 7f884d13e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653541acdc0 con 0x5653541b2ed0 2023-10-06T02:30:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.680+0000 7f884d13e000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653541ad060 con 0x5653541275c0 2023-10-06T02:30:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.680+0000 7f8846b7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653541b6a90 0x5653541a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.680+0000 7f8846b7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653541b6a90 0x5653541a95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53938/0 (socket says 172.21.15.6:53938) 2023-10-06T02:30:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.680+0000 7f8846b7a700 1 -- 172.21.15.6:0/2659984417 learned_addr learned my addr 172.21.15.6:0/2659984417 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:35.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.680+0000 7f8846379700 1 --2- 172.21.15.6:0/2659984417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5653541275c0 0x5653541b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.680+0000 7f8845b78700 1 --2- 172.21.15.6:0/2659984417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653541b2ed0 0x5653541a90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.680+0000 7f8846b7a700 1 -- 172.21.15.6:0/2659984417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5653541275c0 msgr2=0x5653541b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:35.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.680+0000 7f8846b7a700 1 --2- 172.21.15.6:0/2659984417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5653541275c0 0x5653541b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.680+0000 7f8846b7a700 1 -- 172.21.15.6:0/2659984417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653541b2ed0 msgr2=0x5653541a90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:35.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.680+0000 7f8846b7a700 1 --2- 172.21.15.6:0/2659984417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653541b2ed0 0x5653541a90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.680+0000 7f8846b7a700 1 -- 172.21.15.6:0/2659984417 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830005e40 con 0x5653541b6a90 2023-10-06T02:30:35.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.680+0000 7f8845b78700 1 --2- 172.21.15.6:0/2659984417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653541b2ed0 0x5653541a90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:35.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.681+0000 7f8846b7a700 1 --2- 172.21.15.6:0/2659984417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653541b6a90 0x5653541a95f0 secure :-1 s=READY pgs=2478 cs=0 l=1 rev1=1 crypto rx=0x7f88380027a0 tx=0x7f8838008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:35.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.681+0000 7f883effd700 1 -- 172.21.15.6:0/2659984417 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838013480 con 0x5653541b6a90 2023-10-06T02:30:35.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.681+0000 7f883effd700 1 -- 172.21.15.6:0/2659984417 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88380135e0 con 0x5653541b6a90 2023-10-06T02:30:35.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.681+0000 7f884d13e000 1 -- 172.21.15.6:0/2659984417 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5653540393d0 con 0x5653541b6a90 2023-10-06T02:30:35.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.681+0000 7f883effd700 1 -- 172.21.15.6:0/2659984417 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88380139a0 con 0x5653541b6a90 2023-10-06T02:30:35.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.681+0000 7f884d13e000 1 -- 172.21.15.6:0/2659984417 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56535402cae0 con 0x5653541b6a90 2023-10-06T02:30:35.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.682+0000 7f883effd700 1 -- 172.21.15.6:0/2659984417 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f883801c400 con 0x5653541b6a90 2023-10-06T02:30:35.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.682+0000 7f883effd700 1 --2- 172.21.15.6:0/2659984417 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f88280658c0 0x7f8828067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.683+0000 7f883effd700 1 -- 172.21.15.6:0/2659984417 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f88380835c0 con 0x5653541b6a90 2023-10-06T02:30:35.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.683+0000 7f8846379700 1 --2- 172.21.15.6:0/2659984417 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f88280658c0 0x7f8828067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.683+0000 7f884d13e000 1 --2- 172.21.15.6:0/2659984417 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56535410c0d0 0x5653541d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.683+0000 7f884d13e000 1 -- 172.21.15.6:0/2659984417 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- osd_op(unknown.0.0:1 17.7 17:e2e07930:::10000000001.00000000:head [setxattr parent (7) in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e149) v8 -- 0x56535410dba0 con 0x56535410c0d0 2023-10-06T02:30:35.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.683+0000 7f8845b78700 1 --2- 172.21.15.6:0/2659984417 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56535410c0d0 0x5653541d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.683+0000 7f8846379700 1 --2- 172.21.15.6:0/2659984417 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f88280658c0 0x7f8828067d70 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f884000a650 tx=0x7f8840015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:35.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.683+0000 7f8845b78700 1 --2- 172.21.15.6:0/2659984417 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56535410c0d0 0x5653541d2f50 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:35.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.684+0000 7f8845b78700 1 -- 172.21.15.6:0/2659984417 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (7)] v149'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f8830006cb0 con 0x56535410c0d0 2023-10-06T02:30:35.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.685+0000 7f884d13e000 1 -- 172.21.15.6:0/2659984417 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56535410c0d0 msgr2=0x5653541d2f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:35.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.685+0000 7f884d13e000 1 --2- 172.21.15.6:0/2659984417 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x56535410c0d0 0x5653541d2f50 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.685+0000 7f884d13e000 1 -- 172.21.15.6:0/2659984417 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f88280658c0 msgr2=0x7f8828067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:35.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.685+0000 7f884d13e000 1 --2- 172.21.15.6:0/2659984417 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f88280658c0 0x7f8828067d70 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f884000a650 tx=0x7f8840015000 comp rx=0 tx=0).stop 2023-10-06T02:30:35.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.685+0000 7f884d13e000 1 -- 172.21.15.6:0/2659984417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653541b6a90 msgr2=0x5653541a95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:35.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.685+0000 7f884d13e000 1 --2- 172.21.15.6:0/2659984417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653541b6a90 0x5653541a95f0 secure :-1 s=READY pgs=2478 cs=0 l=1 rev1=1 crypto rx=0x7f88380027a0 tx=0x7f8838008040 comp rx=0 tx=0).stop 2023-10-06T02:30:35.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.685+0000 7f8846b7a700 1 -- 172.21.15.6:0/2659984417 reap_dead start 2023-10-06T02:30:35.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.685+0000 7f884d13e000 1 -- 172.21.15.6:0/2659984417 shutdown_connections 2023-10-06T02:30:35.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.685+0000 7f884d13e000 1 -- 172.21.15.6:0/2659984417 >> 172.21.15.6:0/2659984417 conn(0x5653540dfd40 msgr2=0x5653541b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:35.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.685+0000 7f884d13e000 1 -- 172.21.15.6:0/2659984417 shutdown_connections 2023-10-06T02:30:35.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.685+0000 7f884d13e000 1 -- 172.21.15.6:0/2659984417 wait complete. 2023-10-06T02:30:35.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:35.691 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat testdir/hardlink1) 2023-10-06T02:30:35.748 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-06T02:30:35.747+0000 7f2f8a850700 -1 mds.0.cache corrupt backtrace on ino x00x10000000001: void inode_backtrace_t::decode(ceph::buffer::v15_2_0::list::const_iterator&) no longer understand old encoding version 5 < 104: Malformed input 2023-10-06T02:30:35.749 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:30:35.749 INFO:teuthology.orchestra.run.smithi006.stderr:stat: cannot stat 'testdir/hardlink1': Input/output error 2023-10-06T02:30:35.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:30:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.907+0000 7fa19736a700 1 Processor -- start 2023-10-06T02:30:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.908+0000 7fa19736a700 1 -- start start 2023-10-06T02:30:35.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.908+0000 7fa19736a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa190159380 0x7fa190159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.908+0000 7fa19736a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa19015d4d0 0x7fa19015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.908+0000 7fa19736a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1900cb6c0 con 0x7fa1900b20e0 2023-10-06T02:30:35.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.908+0000 7fa19736a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa19015e200 con 0x7fa19015d4d0 2023-10-06T02:30:35.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.908+0000 7fa19736a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900ccb60 con 0x7fa190159380 2023-10-06T02:30:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.909+0000 7fa195907700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa19015d4d0 0x7fa19015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.909+0000 7fa195106700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa190159380 0x7fa190159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.909+0000 7fa194905700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa1900b20e0 0x7fa1900b2530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:47432/0 (socket says 172.21.15.6:47432) 2023-10-06T02:30:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.909+0000 7fa194905700 1 -- 172.21.15.6:0/1212326194 learned_addr learned my addr 172.21.15.6:0/1212326194 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.909+0000 7fa18ffff700 1 -- 172.21.15.6:0/1212326194 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992494205 0 0) 0x7fa1900cb6c0 con 0x7fa1900b20e0 2023-10-06T02:30:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.909+0000 7fa18ffff700 1 -- 172.21.15.6:0/1212326194 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa178003570 con 0x7fa1900b20e0 2023-10-06T02:30:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.909+0000 7fa195106700 1 -- 172.21.15.6:0/1212326194 >> v2:172.21.15.175:3300/0 conn(0x7fa19015d4d0 msgr2=0x7fa19015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.909+0000 7fa195106700 1 --2- 172.21.15.6:0/1212326194 >> v2:172.21.15.175:3300/0 conn(0x7fa19015d4d0 0x7fa19015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.909+0000 7fa195106700 1 -- 172.21.15.6:0/1212326194 >> v1:172.21.15.175:6789/0 conn(0x7fa1900b20e0 legacy=0x7fa1900b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.909+0000 7fa195106700 1 -- 172.21.15.6:0/1212326194 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1900c3ef0 con 0x7fa190159380 2023-10-06T02:30:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.909+0000 7fa195907700 1 --2- 172.21.15.6:0/1212326194 >> v2:172.21.15.175:3300/0 conn(0x7fa19015d4d0 0x7fa19015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:30:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.910+0000 7fa195106700 1 --2- 172.21.15.6:0/1212326194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa190159380 0x7fa190159750 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa1880098e0 tx=0x7fa1880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b307556580d464ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.910+0000 7fa18ffff700 1 -- 172.21.15.6:0/1212326194 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188011630 con 0x7fa190159380 2023-10-06T02:30:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.910+0000 7fa18ffff700 1 -- 172.21.15.6:0/1212326194 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa188011790 con 0x7fa190159380 2023-10-06T02:30:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.910+0000 7fa18ffff700 1 -- 172.21.15.6:0/1212326194 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188011b30 con 0x7fa190159380 2023-10-06T02:30:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.910+0000 7fa19736a700 1 -- 172.21.15.6:0/1212326194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa190159380 msgr2=0x7fa190159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:35.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.910+0000 7fa19736a700 1 --2- 172.21.15.6:0/1212326194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa190159380 0x7fa190159750 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa1880098e0 tx=0x7fa1880091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.910+0000 7fa19736a700 1 -- 172.21.15.6:0/1212326194 shutdown_connections 2023-10-06T02:30:35.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.910+0000 7fa19736a700 1 --2- 172.21.15.6:0/1212326194 >> v2:172.21.15.175:3300/0 conn(0x7fa19015d4d0 0x7fa19015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.910+0000 7fa19736a700 1 --2- 172.21.15.6:0/1212326194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa190159380 0x7fa190159750 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.910+0000 7fa19736a700 1 -- 172.21.15.6:0/1212326194 >> 172.21.15.6:0/1212326194 conn(0x7fa190068680 msgr2=0x7fa190068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:35.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.910+0000 7fa19736a700 1 -- 172.21.15.6:0/1212326194 shutdown_connections 2023-10-06T02:30:35.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.910+0000 7fa19736a700 1 -- 172.21.15.6:0/1212326194 wait complete. 2023-10-06T02:30:35.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.911+0000 7fa19736a700 1 Processor -- start 2023-10-06T02:30:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.911+0000 7fa19736a700 1 -- start start 2023-10-06T02:30:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.912+0000 7fa19736a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1900b20e0 0x7fa19016dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.912+0000 7fa19736a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa190159380 0x7fa19015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.912+0000 7fa19736a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa19015d4d0 0x7fa1900b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.912+0000 7fa19736a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900ca620 con 0x7fa190159380 2023-10-06T02:30:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.912+0000 7fa19736a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900af9a0 con 0x7fa1900b20e0 2023-10-06T02:30:35.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.912+0000 7fa19736a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900afc80 con 0x7fa19015d4d0 2023-10-06T02:30:35.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.912+0000 7fa194905700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa190159380 0x7fa19015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.912+0000 7fa194905700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa190159380 0x7fa19015a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53944/0 (socket says 172.21.15.6:53944) 2023-10-06T02:30:35.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.912+0000 7fa194905700 1 -- 172.21.15.6:0/335077011 learned_addr learned my addr 172.21.15.6:0/335077011 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:35.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.912+0000 7fa195907700 1 --2- 172.21.15.6:0/335077011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa19015d4d0 0x7fa1900b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.913+0000 7fa195106700 1 --2- 172.21.15.6:0/335077011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1900b20e0 0x7fa19016dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.913+0000 7fa194905700 1 -- 172.21.15.6:0/335077011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa19015d4d0 msgr2=0x7fa1900b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:35.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.913+0000 7fa194905700 1 --2- 172.21.15.6:0/335077011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa19015d4d0 0x7fa1900b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.913+0000 7fa194905700 1 -- 172.21.15.6:0/335077011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1900b20e0 msgr2=0x7fa19016dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:35.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.913+0000 7fa194905700 1 --2- 172.21.15.6:0/335077011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1900b20e0 0x7fa19016dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:35.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.913+0000 7fa194905700 1 -- 172.21.15.6:0/335077011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa180009a20 con 0x7fa190159380 2023-10-06T02:30:35.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.913+0000 7fa195907700 1 --2- 172.21.15.6:0/335077011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa19015d4d0 0x7fa1900b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:35.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.913+0000 7fa194905700 1 --2- 172.21.15.6:0/335077011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa190159380 0x7fa19015a1a0 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7fa18400c590 tx=0x7fa184007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:35.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.913+0000 7fa18d7fa700 1 -- 172.21.15.6:0/335077011 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184005b30 con 0x7fa190159380 2023-10-06T02:30:35.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.913+0000 7fa18d7fa700 1 -- 172.21.15.6:0/335077011 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa184005cb0 con 0x7fa190159380 2023-10-06T02:30:35.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.913+0000 7fa19736a700 1 -- 172.21.15.6:0/335077011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa188009420 con 0x7fa190159380 2023-10-06T02:30:35.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.913+0000 7fa18d7fa700 1 -- 172.21.15.6:0/335077011 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184007320 con 0x7fa190159380 2023-10-06T02:30:35.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.913+0000 7fa19736a700 1 -- 172.21.15.6:0/335077011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19016d450 con 0x7fa190159380 2023-10-06T02:30:35.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.914+0000 7fa19736a700 1 -- 172.21.15.6:0/335077011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa190088aa0 con 0x7fa190159380 2023-10-06T02:30:35.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.914+0000 7fa18d7fa700 1 -- 172.21.15.6:0/335077011 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa18401b3b0 con 0x7fa190159380 2023-10-06T02:30:35.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.915+0000 7fa18d7fa700 1 --2- 172.21.15.6:0/335077011 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa17c066f30 0x7fa17c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:35.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.915+0000 7fa18d7fa700 1 -- 172.21.15.6:0/335077011 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fa184083e20 con 0x7fa190159380 2023-10-06T02:30:35.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.915+0000 7fa195106700 1 --2- 172.21.15.6:0/335077011 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa17c066f30 0x7fa17c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:35.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.915+0000 7fa195106700 1 --2- 172.21.15.6:0/335077011 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa17c066f30 0x7fa17c0693e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fa188003080 tx=0x7fa188017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:35.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:35.919+0000 7fa18d7fa700 1 -- 172.21.15.6:0/335077011 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa184050d60 con 0x7fa190159380 2023-10-06T02:30:36.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.158+0000 7fa19736a700 1 -- 172.21.15.6:0/335077011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1900cad90 con 0x7fa190159380 2023-10-06T02:30:36.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.158+0000 7fa18d7fa700 1 -- 172.21.15.6:0/335077011 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 365 v365) v1 ==== 95+0+4608 (secure 0 0 0) 0x7fa184017020 con 0x7fa190159380 2023-10-06T02:30:36.237 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:36.237 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":365,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3603762205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3603762205},{"type":"v1","addr":"172.21.15.175:6836","nonce":3603762205}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":9820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3292446255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3292446255},{"type":"v1","addr":"172.21.15.175:6837","nonce":3292446255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":10869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/759655214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":759655214},{"type":"v1","addr":"172.21.15.6:6834","nonce":759655214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354}],"filesystems":[{"mdsmap":{"epoch":365,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:30:06.715272+0000","modified":"2023-10-06T02:30:32.062334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11088":{"gid":11088,"name":"c","rank":0,"incarnation":362,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/3837760829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3837760829},{"type":"v1","addr":"172.21.15.6:6835","nonce":3837760829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:30:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.160+0000 7fa19736a700 1 -- 172.21.15.6:0/335077011 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa17c066f30 msgr2=0x7fa17c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.160+0000 7fa19736a700 1 --2- 172.21.15.6:0/335077011 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa17c066f30 0x7fa17c0693e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fa188003080 tx=0x7fa188017000 comp rx=0 tx=0).stop 2023-10-06T02:30:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.160+0000 7fa19736a700 1 -- 172.21.15.6:0/335077011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa190159380 msgr2=0x7fa19015a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.160+0000 7fa19736a700 1 --2- 172.21.15.6:0/335077011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa190159380 0x7fa19015a1a0 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7fa18400c590 tx=0x7fa184007e00 comp rx=0 tx=0).stop 2023-10-06T02:30:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.160+0000 7fa19736a700 1 -- 172.21.15.6:0/335077011 shutdown_connections 2023-10-06T02:30:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.160+0000 7fa19736a700 1 --2- 172.21.15.6:0/335077011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa19015d4d0 0x7fa1900b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.160+0000 7fa19736a700 1 --2- 172.21.15.6:0/335077011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1900b20e0 0x7fa19016dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.160+0000 7fa19736a700 1 --2- 172.21.15.6:0/335077011 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa17c066f30 0x7fa17c0693e0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.160+0000 7fa19736a700 1 --2- 172.21.15.6:0/335077011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa190159380 0x7fa19015a1a0 unknown :-1 s=CLOSED pgs=2479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.160+0000 7fa19736a700 1 -- 172.21.15.6:0/335077011 >> 172.21.15.6:0/335077011 conn(0x7fa190068680 msgr2=0x7fa190158720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.160+0000 7fa19736a700 1 -- 172.21.15.6:0/335077011 shutdown_connections 2023-10-06T02:30:36.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.160+0000 7fa19736a700 1 -- 172.21.15.6:0/335077011 wait complete. 2023-10-06T02:30:36.240 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 365 2023-10-06T02:30:36.240 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2023-10-06T02:30:36.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.360+0000 7f64700a4700 1 Processor -- start 2023-10-06T02:30:36.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.360+0000 7f64700a4700 1 -- start start 2023-10-06T02:30:36.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.361+0000 7f64700a4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f646806c210 0x7f64680c8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.361+0000 7f64700a4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f64680c8550 0x7f6468068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.361+0000 7f64700a4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64680c8ad0 con 0x7f6468157d40 2023-10-06T02:30:36.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.361+0000 7f64700a4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646806b730 con 0x7f646806c210 2023-10-06T02:30:36.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.361+0000 7f64700a4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646806ba10 con 0x7f64680c8550 2023-10-06T02:30:36.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.361+0000 7f646d63f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f646806c210 0x7f64680c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.361+0000 7f646de40700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6468157d40 0x7f6468158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59018/0 (socket says 172.21.15.6:59018) 2023-10-06T02:30:36.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.361+0000 7f646de40700 1 -- 172.21.15.6:0/2597555150 learned_addr learned my addr 172.21.15.6:0/2597555150 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:36.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.362+0000 7f646e641700 1 --2- 172.21.15.6:0/2597555150 >> v2:172.21.15.175:3300/0 conn(0x7f64680c8550 0x7f6468068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.362+0000 7f646d63f700 1 -- 172.21.15.6:0/2597555150 >> v2:172.21.15.175:3300/0 conn(0x7f64680c8550 msgr2=0x7f6468068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:36.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.362+0000 7f646d63f700 1 --2- 172.21.15.6:0/2597555150 >> v2:172.21.15.175:3300/0 conn(0x7f64680c8550 0x7f6468068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.362+0000 7f646ce3e700 1 -- 172.21.15.6:0/2597555150 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760986550 0 0) 0x7f64680c8ad0 con 0x7f6468157d40 2023-10-06T02:30:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.362+0000 7f646d63f700 1 -- 172.21.15.6:0/2597555150 >> v1:172.21.15.6:6789/0 conn(0x7f6468157d40 legacy=0x7f6468158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.362+0000 7f646d63f700 1 -- 172.21.15.6:0/2597555150 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646806bcf0 con 0x7f646806c210 2023-10-06T02:30:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.362+0000 7f646e641700 1 --2- 172.21.15.6:0/2597555150 >> v2:172.21.15.175:3300/0 conn(0x7f64680c8550 0x7f6468068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.362+0000 7f646d63f700 1 --2- 172.21.15.6:0/2597555150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646806c210 0x7f64680c8010 secure :-1 s=READY pgs=2481 cs=0 l=1 rev1=1 crypto rx=0x7f64680c8ee0 tx=0x7f645c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796b56778647e9d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.362+0000 7f646ce3e700 1 -- 172.21.15.6:0/2597555150 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c00b6b0 con 0x7f646806c210 2023-10-06T02:30:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.362+0000 7f646ce3e700 1 -- 172.21.15.6:0/2597555150 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c00b810 con 0x7f646806c210 2023-10-06T02:30:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.362+0000 7f646ce3e700 1 -- 172.21.15.6:0/2597555150 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c00bbb0 con 0x7f646806c210 2023-10-06T02:30:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.363+0000 7f64700a4700 1 -- 172.21.15.6:0/2597555150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646806c210 msgr2=0x7f64680c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.363+0000 7f64700a4700 1 --2- 172.21.15.6:0/2597555150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646806c210 0x7f64680c8010 secure :-1 s=READY pgs=2481 cs=0 l=1 rev1=1 crypto rx=0x7f64680c8ee0 tx=0x7f645c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.363+0000 7f64700a4700 1 -- 172.21.15.6:0/2597555150 shutdown_connections 2023-10-06T02:30:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.363+0000 7f64700a4700 1 --2- 172.21.15.6:0/2597555150 >> v2:172.21.15.175:3300/0 conn(0x7f64680c8550 0x7f6468068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.363+0000 7f64700a4700 1 --2- 172.21.15.6:0/2597555150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646806c210 0x7f64680c8010 unknown :-1 s=CLOSED pgs=2481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.363+0000 7f64700a4700 1 -- 172.21.15.6:0/2597555150 >> 172.21.15.6:0/2597555150 conn(0x7f646806a260 msgr2=0x7f64680cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.363+0000 7f64700a4700 1 -- 172.21.15.6:0/2597555150 shutdown_connections 2023-10-06T02:30:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.363+0000 7f64700a4700 1 -- 172.21.15.6:0/2597555150 wait complete. 2023-10-06T02:30:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.364+0000 7f64700a4700 1 Processor -- start 2023-10-06T02:30:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.364+0000 7f64700a4700 1 -- start start 2023-10-06T02:30:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f64700a4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f646806c210 0x7f6468150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f64700a4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64680c8550 0x7f64680b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f64700a4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6468157d40 0x7f6468169f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f64700a4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64680b18c0 con 0x7f64680c8550 2023-10-06T02:30:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f64700a4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646814ff80 con 0x7f6468157d40 2023-10-06T02:30:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f64700a4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646816aa90 con 0x7f646806c210 2023-10-06T02:30:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f646d63f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64680c8550 0x7f64680b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f646d63f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64680c8550 0x7f64680b1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53952/0 (socket says 172.21.15.6:53952) 2023-10-06T02:30:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f646d63f700 1 -- 172.21.15.6:0/3652951366 learned_addr learned my addr 172.21.15.6:0/3652951366 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f646de40700 1 --2- 172.21.15.6:0/3652951366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f646806c210 0x7f6468150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f646e641700 1 --2- 172.21.15.6:0/3652951366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6468157d40 0x7f6468169f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f646d63f700 1 -- 172.21.15.6:0/3652951366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f646806c210 msgr2=0x7f6468150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f646d63f700 1 --2- 172.21.15.6:0/3652951366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f646806c210 0x7f6468150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f646d63f700 1 -- 172.21.15.6:0/3652951366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6468157d40 msgr2=0x7f6468169f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f646d63f700 1 --2- 172.21.15.6:0/3652951366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6468157d40 0x7f6468169f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f646d63f700 1 -- 172.21.15.6:0/3652951366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c009420 con 0x7f64680c8550 2023-10-06T02:30:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f646e641700 1 --2- 172.21.15.6:0/3652951366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6468157d40 0x7f6468169f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f646d63f700 1 --2- 172.21.15.6:0/3652951366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64680c8550 0x7f64680b1380 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7f645c013000 tx=0x7f645c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.365+0000 7f6465ffb700 1 -- 172.21.15.6:0/3652951366 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c011420 con 0x7f64680c8550 2023-10-06T02:30:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.366+0000 7f6465ffb700 1 -- 172.21.15.6:0/3652951366 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c0115a0 con 0x7f64680c8550 2023-10-06T02:30:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.366+0000 7f64700a4700 1 -- 172.21.15.6:0/3652951366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646816ad70 con 0x7f64680c8550 2023-10-06T02:30:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.366+0000 7f6465ffb700 1 -- 172.21.15.6:0/3652951366 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c011960 con 0x7f64680c8550 2023-10-06T02:30:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.366+0000 7f64700a4700 1 -- 172.21.15.6:0/3652951366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6468150520 con 0x7f64680c8550 2023-10-06T02:30:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.367+0000 7f6465ffb700 1 -- 172.21.15.6:0/3652951366 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f645c011d50 con 0x7f64680c8550 2023-10-06T02:30:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.367+0000 7f6465ffb700 1 --2- 172.21.15.6:0/3652951366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6454066f30 0x7f64540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.368+0000 7f6465ffb700 1 -- 172.21.15.6:0/3652951366 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f645c086260 con 0x7f64680c8550 2023-10-06T02:30:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.368+0000 7f646de40700 1 --2- 172.21.15.6:0/3652951366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6454066f30 0x7f64540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.368+0000 7f646de40700 1 --2- 172.21.15.6:0/3652951366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6454066f30 0x7f64540693e0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f6460007160 tx=0x7f6460007f50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.369+0000 7f647939cb80 1 Processor -- start 2023-10-06T02:30:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.369+0000 7f647939cb80 1 -- start start 2023-10-06T02:30:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.370+0000 7f647939cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126753dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.370+0000 7f647939cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126753ed60 0x56126758d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.370+0000 7f647939cb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126758dca0 0x56126758e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.370+0000 7f647939cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561267494b10 con 0x56126753d8e0 2023-10-06T02:30:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.370+0000 7f647939cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561267492310 con 0x56126753ed60 2023-10-06T02:30:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.370+0000 7f647939cb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56126748e100 con 0x56126758dca0 2023-10-06T02:30:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.370+0000 7f646de40700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126753dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.370+0000 7f646de40700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126753dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53968/0 (socket says 172.21.15.6:53968) 2023-10-06T02:30:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.370+0000 7f646de40700 1 -- 172.21.15.6:0/226218888 learned_addr learned my addr 172.21.15.6:0/226218888 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.370+0000 7f646d63f700 1 --2- 172.21.15.6:0/226218888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126753ed60 0x56126758d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.370+0000 7f646e641700 1 --2- 172.21.15.6:0/226218888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126758dca0 0x56126758e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.371+0000 7f646de40700 1 -- 172.21.15.6:0/226218888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126758dca0 msgr2=0x56126758e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.371+0000 7f646de40700 1 --2- 172.21.15.6:0/226218888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126758dca0 0x56126758e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.371+0000 7f646de40700 1 -- 172.21.15.6:0/226218888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126753ed60 msgr2=0x56126758d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.371+0000 7f646de40700 1 --2- 172.21.15.6:0/226218888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126753ed60 0x56126758d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.371+0000 7f646de40700 1 -- 172.21.15.6:0/226218888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561267328310 con 0x56126753d8e0 2023-10-06T02:30:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.371+0000 7f646de40700 1 --2- 172.21.15.6:0/226218888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126753dcb0 secure :-1 s=READY pgs=2483 cs=0 l=1 rev1=1 crypto rx=0x7f6460005db0 tx=0x7f6460014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38246352d98c35a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.371+0000 7f644effd700 1 -- 172.21.15.6:0/226218888 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64600066d0 con 0x56126753d8e0 2023-10-06T02:30:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.371+0000 7f644effd700 1 -- 172.21.15.6:0/226218888 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6460001360 con 0x56126753d8e0 2023-10-06T02:30:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.371+0000 7f644effd700 1 -- 172.21.15.6:0/226218888 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64600016e0 con 0x56126753d8e0 2023-10-06T02:30:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.371+0000 7f647939cb80 1 -- 172.21.15.6:0/226218888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 msgr2=0x56126753dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.371+0000 7f647939cb80 1 --2- 172.21.15.6:0/226218888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126753dcb0 secure :-1 s=READY pgs=2483 cs=0 l=1 rev1=1 crypto rx=0x7f6460005db0 tx=0x7f6460014000 comp rx=0 tx=0).stop 2023-10-06T02:30:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.371+0000 7f647939cb80 1 -- 172.21.15.6:0/226218888 shutdown_connections 2023-10-06T02:30:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.371+0000 7f647939cb80 1 --2- 172.21.15.6:0/226218888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126758dca0 0x56126758e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.372+0000 7f647939cb80 1 --2- 172.21.15.6:0/226218888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126753dcb0 unknown :-1 s=CLOSED pgs=2483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.372+0000 7f647939cb80 1 --2- 172.21.15.6:0/226218888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126753ed60 0x56126758d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.372+0000 7f647939cb80 1 -- 172.21.15.6:0/226218888 >> 172.21.15.6:0/226218888 conn(0x56126753f200 msgr2=0x56126753f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.372+0000 7f647939cb80 1 -- 172.21.15.6:0/226218888 shutdown_connections 2023-10-06T02:30:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.372+0000 7f647939cb80 1 -- 172.21.15.6:0/226218888 wait complete. 2023-10-06T02:30:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.372+0000 7f647939cb80 1 -- start start 2023-10-06T02:30:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.372+0000 7f647939cb80 1 Processor -- start 2023-10-06T02:30:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.373+0000 7f647939cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126757d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.373+0000 7f647939cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126753ed60 0x56126757d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.373+0000 7f647939cb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126758dca0 0x56126757f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.373+0000 7f647939cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561267439930 con 0x56126753d8e0 2023-10-06T02:30:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.373+0000 7f647939cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561267454f40 con 0x56126753ed60 2023-10-06T02:30:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.373+0000 7f647939cb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x561267310ed0 con 0x56126758dca0 2023-10-06T02:30:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.373+0000 7f647939cb80 10 client.0 _ll_register_callbacks cb 0x561267500f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:30:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.373+0000 7f646de40700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126757d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.373+0000 7f646de40700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126757d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53982/0 (socket says 172.21.15.6:53982) 2023-10-06T02:30:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.373+0000 7f646de40700 1 -- 172.21.15.6:0/521047166 learned_addr learned my addr 172.21.15.6:0/521047166 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.373+0000 7f646e641700 1 --2- 172.21.15.6:0/521047166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126758dca0 0x56126757f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.373+0000 7f646d63f700 1 --2- 172.21.15.6:0/521047166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126753ed60 0x56126757d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.373+0000 7f646de40700 1 -- 172.21.15.6:0/521047166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126758dca0 msgr2=0x56126757f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:36.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f646de40700 1 --2- 172.21.15.6:0/521047166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126758dca0 0x56126757f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f646de40700 1 -- 172.21.15.6:0/521047166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126753ed60 msgr2=0x56126757d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:36.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f646de40700 1 --2- 172.21.15.6:0/521047166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126753ed60 0x56126757d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f646de40700 1 -- 172.21.15.6:0/521047166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6460005a50 con 0x56126753d8e0 2023-10-06T02:30:36.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f646d63f700 1 --2- 172.21.15.6:0/521047166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126753ed60 0x56126757d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:36.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f646de40700 1 --2- 172.21.15.6:0/521047166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126757d130 secure :-1 s=READY pgs=2484 cs=0 l=1 rev1=1 crypto rx=0x7f6460006310 tx=0x7f6460019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905bd7cf39fdae74 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:36.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f6447fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:30:36.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f6447fff700 1 -- 172.21.15.6:0/521047166 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6460006e80 con 0x56126753d8e0 2023-10-06T02:30:36.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f647939cb80 1 -- 172.21.15.6:0/521047166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5612675329e0 con 0x56126753d8e0 2023-10-06T02:30:36.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f6447fff700 1 -- 172.21.15.6:0/521047166 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f646001b050 con 0x56126753d8e0 2023-10-06T02:30:36.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f6447fff700 1 -- 172.21.15.6:0/521047166 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=365) v2 ==== 24+0+0 (secure 0 0 0) 0x7f646002d430 con 0x56126753d8e0 2023-10-06T02:30:36.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f647939cb80 10 client.11211 fetch_fsmap learned FSMap version 365 2023-10-06T02:30:36.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f647939cb80 1 -- 172.21.15.6:0/521047166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=365,monmap=2+}) v3 -- 0x5612672cb080 con 0x56126753d8e0 2023-10-06T02:30:36.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f6447fff700 1 -- 172.21.15.6:0/521047166 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5612675329e0 con 0x56126753d8e0 2023-10-06T02:30:36.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f6447fff700 1 -- 172.21.15.6:0/521047166 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 365) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6460012070 con 0x56126753d8e0 2023-10-06T02:30:36.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f647939cb80 10 client.11211 fetch_fsmap finished waiting for FSMap version 365 2023-10-06T02:30:36.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f647939cb80 10 client.11211 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:30:36.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f647939cb80 20 client.11211 populate_metadata read hostname 'smithi006' 2023-10-06T02:30:36.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f647939cb80 1 --2- 172.21.15.6:0/521047166 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x561267584690 0x561267584a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f647939cb80 4 client.11211 mds_command: new command op to 11088 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:30:36.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f647939cb80 1 -- 172.21.15.6:0/521047166 --> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56126750f910 con 0x561267584690 2023-10-06T02:30:36.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.374+0000 7f646d63f700 1 --2- 172.21.15.6:0/521047166 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x561267584690 0x561267584a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.375+0000 7f6447fff700 10 client.11211 ms_handle_connect on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.375+0000 7f646d63f700 1 --2- 172.21.15.6:0/521047166 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x561267584690 0x561267584a60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cf16ec7a97c2638 server_cookie=63c9fba7342ae1e0 in_seq=0 out_seq=0 2023-10-06T02:30:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.375+0000 7f6447fff700 1 -- 172.21.15.6:0/521047166 <== mds.0 v2:172.21.15.6:6833/3837760829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56126750f910 con 0x561267584690 2023-10-06T02:30:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.375+0000 7f6447fff700 10 client.11211 handle_command_reply: tid=0 2023-10-06T02:30:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.375+0000 7f647939cb80 1 client.11211 shutdown 2023-10-06T02:30:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.375+0000 7f647939cb80 1 -- 172.21.15.6:0/521047166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 msgr2=0x56126757d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.375+0000 7f647939cb80 1 --2- 172.21.15.6:0/521047166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126757d130 secure :-1 s=READY pgs=2484 cs=0 l=1 rev1=1 crypto rx=0x7f6460006310 tx=0x7f6460019000 comp rx=0 tx=0).stop 2023-10-06T02:30:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.375+0000 7f647939cb80 1 -- 172.21.15.6:0/521047166 shutdown_connections 2023-10-06T02:30:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.375+0000 7f647939cb80 1 --2- 172.21.15.6:0/521047166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126758dca0 0x56126757f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.375+0000 7f647939cb80 1 --2- 172.21.15.6:0/521047166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126757d130 unknown :-1 s=CLOSED pgs=2484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.375+0000 7f647939cb80 1 --2- 172.21.15.6:0/521047166 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x561267584690 0x561267584a60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.375+0000 7f647939cb80 1 --2- 172.21.15.6:0/521047166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126753ed60 0x56126757d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.375+0000 7f6447fff700 0 client.11211 ms_handle_reset on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.375+0000 7f647939cb80 1 -- 172.21.15.6:0/521047166 >> 172.21.15.6:0/521047166 conn(0x56126753f200 msgr2=0x56126753e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.376+0000 7f647939cb80 1 -- 172.21.15.6:0/521047166 shutdown_connections 2023-10-06T02:30:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.376+0000 7f647939cb80 1 -- 172.21.15.6:0/521047166 wait complete. 2023-10-06T02:30:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.376+0000 7f647939cb80 20 client.11211 trim_cache size 0 max 16384 2023-10-06T02:30:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.388+0000 7f647939cb80 1 Processor -- start 2023-10-06T02:30:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.388+0000 7f647939cb80 1 -- start start 2023-10-06T02:30:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f647939cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126757d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f647939cb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126753ed60 0x561267593870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f647939cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126758dca0 0x561267587420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f647939cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56126757ea70 con 0x56126753d8e0 2023-10-06T02:30:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f647939cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561267586960 con 0x56126758dca0 2023-10-06T02:30:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f647939cb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x56126753ace0 con 0x56126753ed60 2023-10-06T02:30:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f646de40700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126757d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f646de40700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126757d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53984/0 (socket says 172.21.15.6:53984) 2023-10-06T02:30:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f646de40700 1 -- 172.21.15.6:0/452275152 learned_addr learned my addr 172.21.15.6:0/452275152 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f646d63f700 1 --2- 172.21.15.6:0/452275152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126753ed60 0x561267593870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f646e641700 1 --2- 172.21.15.6:0/452275152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126758dca0 0x561267587420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f646de40700 1 -- 172.21.15.6:0/452275152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126753ed60 msgr2=0x561267593870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f646de40700 1 --2- 172.21.15.6:0/452275152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126753ed60 0x561267593870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f646de40700 1 -- 172.21.15.6:0/452275152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126758dca0 msgr2=0x561267587420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f646de40700 1 --2- 172.21.15.6:0/452275152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126758dca0 0x561267587420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f646de40700 1 -- 172.21.15.6:0/452275152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56126745c820 con 0x56126753d8e0 2023-10-06T02:30:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f646de40700 1 --2- 172.21.15.6:0/452275152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126757d650 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f6460013470 tx=0x7f646002d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de030deb3d04fccb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.389+0000 7f644f7fe700 1 -- 172.21.15.6:0/452275152 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64600339f0 con 0x56126753d8e0 2023-10-06T02:30:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.390+0000 7f644f7fe700 1 -- 172.21.15.6:0/452275152 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6460006dc0 con 0x56126753d8e0 2023-10-06T02:30:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.390+0000 7f644f7fe700 1 -- 172.21.15.6:0/452275152 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64600334b0 con 0x56126753d8e0 2023-10-06T02:30:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.390+0000 7f647939cb80 1 -- 172.21.15.6:0/452275152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 msgr2=0x56126757d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.390+0000 7f647939cb80 1 --2- 172.21.15.6:0/452275152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126757d650 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f6460013470 tx=0x7f646002d000 comp rx=0 tx=0).stop 2023-10-06T02:30:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.390+0000 7f647939cb80 1 -- 172.21.15.6:0/452275152 shutdown_connections 2023-10-06T02:30:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.390+0000 7f647939cb80 1 --2- 172.21.15.6:0/452275152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126758dca0 0x561267587420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.390+0000 7f647939cb80 1 --2- 172.21.15.6:0/452275152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753d8e0 0x56126757d650 unknown :-1 s=CLOSED pgs=2485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.390+0000 7f647939cb80 1 --2- 172.21.15.6:0/452275152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126753ed60 0x561267593870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.390+0000 7f647939cb80 1 -- 172.21.15.6:0/452275152 >> 172.21.15.6:0/452275152 conn(0x56126753f200 msgr2=0x561267584a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.390+0000 7f647939cb80 1 -- 172.21.15.6:0/452275152 shutdown_connections 2023-10-06T02:30:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.390+0000 7f647939cb80 1 -- 172.21.15.6:0/452275152 wait complete. 2023-10-06T02:30:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.391+0000 7f647939cb80 1 -- start start 2023-10-06T02:30:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.391+0000 7f647939cb80 1 Processor -- start 2023-10-06T02:30:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.391+0000 7f647939cb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126753d8e0 0x5612675cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.391+0000 7f647939cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753ed60 0x56126753f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.391+0000 7f647939cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126758dca0 0x56126753fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f647939cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612675d0b70 con 0x56126753ed60 2023-10-06T02:30:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f647939cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561267595f90 con 0x56126758dca0 2023-10-06T02:30:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f647939cb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5612675cffb0 con 0x56126753d8e0 2023-10-06T02:30:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f647939cb80 10 client.0 _ll_register_callbacks cb 0x561267500f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:30:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f646d63f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753ed60 0x56126753f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f646d63f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753ed60 0x56126753f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53986/0 (socket says 172.21.15.6:53986) 2023-10-06T02:30:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f646d63f700 1 -- 172.21.15.6:0/2560149055 learned_addr learned my addr 172.21.15.6:0/2560149055 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f646e641700 1 --2- 172.21.15.6:0/2560149055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126758dca0 0x56126753fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f646de40700 1 --2- 172.21.15.6:0/2560149055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126753d8e0 0x5612675cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f646d63f700 1 -- 172.21.15.6:0/2560149055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126753d8e0 msgr2=0x5612675cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f646d63f700 1 --2- 172.21.15.6:0/2560149055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126753d8e0 0x5612675cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f646d63f700 1 -- 172.21.15.6:0/2560149055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126758dca0 msgr2=0x56126753fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f646d63f700 1 --2- 172.21.15.6:0/2560149055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126758dca0 0x56126753fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f646d63f700 1 -- 172.21.15.6:0/2560149055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612672cb080 con 0x56126753ed60 2023-10-06T02:30:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f646d63f700 1 --2- 172.21.15.6:0/2560149055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753ed60 0x56126753f5d0 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 crypto rx=0x7f645c00b7e0 tx=0x7f645c030040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11804f4fb81697 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f6447fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:30:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f6447fff700 1 -- 172.21.15.6:0/2560149055 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c05a0b0 con 0x56126753ed60 2023-10-06T02:30:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f6447fff700 1 -- 172.21.15.6:0/2560149055 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f645c05de00 con 0x56126753ed60 2023-10-06T02:30:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f647939cb80 1 -- 172.21.15.6:0/2560149055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6460001360 con 0x56126753ed60 2023-10-06T02:30:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f6447fff700 1 -- 172.21.15.6:0/2560149055 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=365) v2 ==== 24+0+0 (secure 0 0 0) 0x7f645c06d1d0 con 0x56126753ed60 2023-10-06T02:30:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f647939cb80 10 client.11217 fetch_fsmap learned FSMap version 365 2023-10-06T02:30:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f647939cb80 1 -- 172.21.15.6:0/2560149055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=365,monmap=2+}) v3 -- 0x561267443510 con 0x56126753ed60 2023-10-06T02:30:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.392+0000 7f6447fff700 1 -- 172.21.15.6:0/2560149055 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6460001360 con 0x56126753ed60 2023-10-06T02:30:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f6447fff700 1 -- 172.21.15.6:0/2560149055 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 365) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f645c056350 con 0x56126753ed60 2023-10-06T02:30:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f647939cb80 10 client.11217 fetch_fsmap finished waiting for FSMap version 365 2023-10-06T02:30:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f647939cb80 10 client.11217 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:30:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f647939cb80 20 client.11217 populate_metadata read hostname 'smithi006' 2023-10-06T02:30:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f647939cb80 1 --2- 172.21.15.6:0/2560149055 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x561267581120 0x5612675814f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f647939cb80 4 client.11217 mds_command: new command op to 11088 tid=0[{"prefix": "damage ls", "format": "json-pretty"}] 2023-10-06T02:30:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f647939cb80 1 -- 172.21.15.6:0/2560149055 --> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x561267430ea0 con 0x561267581120 2023-10-06T02:30:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f646de40700 1 --2- 172.21.15.6:0/2560149055 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x561267581120 0x5612675814f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f6447fff700 10 client.11217 ms_handle_connect on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f646de40700 1 --2- 172.21.15.6:0/2560149055 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x561267581120 0x5612675814f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fd45a7b7db11527 server_cookie=b61386a29f8cda6d in_seq=0 out_seq=0 2023-10-06T02:30:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f6447fff700 1 -- 172.21.15.6:0/2560149055 <== mds.0 v2:172.21.15.6:6833/3837760829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+145 (crc 0 0 0) 0x561267430ea0 con 0x561267581120 2023-10-06T02:30:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f6447fff700 10 client.11217 handle_command_reply: tid=0 2023-10-06T02:30:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f647939cb80 1 client.11217 shutdown 2023-10-06T02:30:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f647939cb80 1 -- 172.21.15.6:0/2560149055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753ed60 msgr2=0x56126753f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f647939cb80 1 --2- 172.21.15.6:0/2560149055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753ed60 0x56126753f5d0 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 crypto rx=0x7f645c00b7e0 tx=0x7f645c030040 comp rx=0 tx=0).stop 2023-10-06T02:30:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f647939cb80 1 -- 172.21.15.6:0/2560149055 shutdown_connections 2023-10-06T02:30:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f647939cb80 1 --2- 172.21.15.6:0/2560149055 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x561267581120 0x5612675814f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f647939cb80 1 --2- 172.21.15.6:0/2560149055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56126758dca0 0x56126753fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f647939cb80 1 --2- 172.21.15.6:0/2560149055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56126753d8e0 0x5612675cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f647939cb80 1 --2- 172.21.15.6:0/2560149055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56126753ed60 0x56126753f5d0 unknown :-1 s=CLOSED pgs=2486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f6447fff700 0 client.11217 ms_handle_reset on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f647939cb80 1 -- 172.21.15.6:0/2560149055 >> 172.21.15.6:0/2560149055 conn(0x56126753f200 msgr2=0x561267587270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f647939cb80 1 -- 172.21.15.6:0/2560149055 shutdown_connections 2023-10-06T02:30:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.393+0000 7f647939cb80 1 -- 172.21.15.6:0/2560149055 wait complete. 2023-10-06T02:30:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.394+0000 7f647939cb80 20 client.11217 trim_cache size 0 max 16384 2023-10-06T02:30:36.881 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:36.881 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-06T02:30:36.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:36.881 INFO:teuthology.orchestra.run.smithi006.stdout: "damage_type": "backtrace", 2023-10-06T02:30:36.881 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 2717285144, 2023-10-06T02:30:36.881 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 1099511627777, 2023-10-06T02:30:36.881 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/testdir/hardlink1" 2023-10-06T02:30:36.881 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:36.881 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-06T02:30:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.394+0000 7f64700a4700 1 -- 172.21.15.6:0/3652951366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6454066f30 msgr2=0x7f64540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.394+0000 7f64700a4700 1 --2- 172.21.15.6:0/3652951366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6454066f30 0x7f64540693e0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f6460007160 tx=0x7f6460007f50 comp rx=0 tx=0).stop 2023-10-06T02:30:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.394+0000 7f64700a4700 1 -- 172.21.15.6:0/3652951366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64680c8550 msgr2=0x7f64680b1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.394+0000 7f64700a4700 1 --2- 172.21.15.6:0/3652951366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64680c8550 0x7f64680b1380 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7f645c013000 tx=0x7f645c017000 comp rx=0 tx=0).stop 2023-10-06T02:30:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.394+0000 7f64700a4700 1 -- 172.21.15.6:0/3652951366 shutdown_connections 2023-10-06T02:30:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.394+0000 7f64700a4700 1 --2- 172.21.15.6:0/3652951366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6468157d40 0x7f6468169f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.394+0000 7f64700a4700 1 --2- 172.21.15.6:0/3652951366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f646806c210 0x7f6468150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.394+0000 7f64700a4700 1 --2- 172.21.15.6:0/3652951366 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6454066f30 0x7f64540693e0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.394+0000 7f64700a4700 1 --2- 172.21.15.6:0/3652951366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64680c8550 0x7f64680b1380 unknown :-1 s=CLOSED pgs=2482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.394+0000 7f64700a4700 1 -- 172.21.15.6:0/3652951366 >> 172.21.15.6:0/3652951366 conn(0x7f646806a260 msgr2=0x7f64680c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:36.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.394+0000 7f64700a4700 1 -- 172.21.15.6:0/3652951366 shutdown_connections 2023-10-06T02:30:36.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:36.394+0000 7f64700a4700 1 -- 172.21.15.6:0/3652951366 wait complete. 2023-10-06T02:30:36.884 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:30:37.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.006+0000 7f161087f700 1 Processor -- start 2023-10-06T02:30:37.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.006+0000 7f161087f700 1 -- start start 2023-10-06T02:30:37.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.007+0000 7f161087f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f160c0af4e0 0x7f160c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.007+0000 7f161087f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f160c0af8b0 0x7f160c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.007+0000 7f161087f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160c15e190 con 0x7f160c15d460 2023-10-06T02:30:37.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.007+0000 7f161087f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160c0b1910 con 0x7f160c0af8b0 2023-10-06T02:30:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.007+0000 7f161087f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160c15dfa0 con 0x7f160c0af4e0 2023-10-06T02:30:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.007+0000 7f1609d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f160c0af8b0 0x7f160c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.008+0000 7f1609d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f160c0af8b0 0x7f160c0b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54002/0 (socket says 172.21.15.6:54002) 2023-10-06T02:30:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.008+0000 7f1609d9b700 1 -- 172.21.15.6:0/2280628847 learned_addr learned my addr 172.21.15.6:0/2280628847 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.008+0000 7f1609d9b700 1 -- 172.21.15.6:0/2280628847 >> v2:172.21.15.175:3300/0 conn(0x7f160c0af4e0 msgr2=0x7f160c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.008+0000 7f1609d9b700 1 --2- 172.21.15.6:0/2280628847 >> v2:172.21.15.175:3300/0 conn(0x7f160c0af4e0 0x7f160c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.008+0000 7f1609d9b700 1 -- 172.21.15.6:0/2280628847 >> v1:172.21.15.175:6789/0 conn(0x7f160c15d460 legacy=0x7f160c15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.008+0000 7f1609d9b700 1 -- 172.21.15.6:0/2280628847 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c0cb650 con 0x7f160c0af8b0 2023-10-06T02:30:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.008+0000 7f1609d9b700 1 --2- 172.21.15.6:0/2280628847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160c0af8b0 0x7f160c0b2620 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 crypto rx=0x7f160c0d1360 tx=0x7f15f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6707ac24b58d2a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.008+0000 7f160959a700 1 -- 172.21.15.6:0/2280628847 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f400b820 con 0x7f160c0af8b0 2023-10-06T02:30:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.008+0000 7f160959a700 1 -- 172.21.15.6:0/2280628847 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f400b980 con 0x7f160c0af8b0 2023-10-06T02:30:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.008+0000 7f160959a700 1 -- 172.21.15.6:0/2280628847 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f400bd20 con 0x7f160c0af8b0 2023-10-06T02:30:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.009+0000 7f161087f700 1 -- 172.21.15.6:0/2280628847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160c0af8b0 msgr2=0x7f160c0b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.009+0000 7f161087f700 1 --2- 172.21.15.6:0/2280628847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160c0af8b0 0x7f160c0b2620 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 crypto rx=0x7f160c0d1360 tx=0x7f15f4009250 comp rx=0 tx=0).stop 2023-10-06T02:30:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.009+0000 7f161087f700 1 -- 172.21.15.6:0/2280628847 shutdown_connections 2023-10-06T02:30:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.009+0000 7f161087f700 1 --2- 172.21.15.6:0/2280628847 >> v2:172.21.15.175:3300/0 conn(0x7f160c0af4e0 0x7f160c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.009+0000 7f161087f700 1 --2- 172.21.15.6:0/2280628847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160c0af8b0 0x7f160c0b2620 unknown :-1 s=CLOSED pgs=2487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.009+0000 7f161087f700 1 -- 172.21.15.6:0/2280628847 >> 172.21.15.6:0/2280628847 conn(0x7f160c068680 msgr2=0x7f160c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.009+0000 7f161087f700 1 -- 172.21.15.6:0/2280628847 shutdown_connections 2023-10-06T02:30:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.009+0000 7f161087f700 1 -- 172.21.15.6:0/2280628847 wait complete. 2023-10-06T02:30:37.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.010+0000 7f161087f700 1 Processor -- start 2023-10-06T02:30:37.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.010+0000 7f161087f700 1 -- start start 2023-10-06T02:30:37.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f161087f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f160c0af4e0 0x7f160c16d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f161087f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160c0af8b0 0x7f160c154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f161087f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f160c15d460 0x7f160c169620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f161087f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c0c9d40 con 0x7f160c0af8b0 2023-10-06T02:30:37.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f161087f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c0c9130 con 0x7f160c15d460 2023-10-06T02:30:37.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f161087f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c0c9410 con 0x7f160c0af4e0 2023-10-06T02:30:37.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f1609d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160c0af8b0 0x7f160c154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f1609d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160c0af8b0 0x7f160c154df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54018/0 (socket says 172.21.15.6:54018) 2023-10-06T02:30:37.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f1609d9b700 1 -- 172.21.15.6:0/2538513222 learned_addr learned my addr 172.21.15.6:0/2538513222 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:37.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f160ad9d700 1 --2- 172.21.15.6:0/2538513222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f160c15d460 0x7f160c169620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f160a59c700 1 --2- 172.21.15.6:0/2538513222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f160c0af4e0 0x7f160c16d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f1609d9b700 1 -- 172.21.15.6:0/2538513222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f160c0af4e0 msgr2=0x7f160c16d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f1609d9b700 1 --2- 172.21.15.6:0/2538513222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f160c0af4e0 0x7f160c16d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f1609d9b700 1 -- 172.21.15.6:0/2538513222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f160c15d460 msgr2=0x7f160c169620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f1609d9b700 1 --2- 172.21.15.6:0/2538513222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f160c15d460 0x7f160c169620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f1609d9b700 1 -- 172.21.15.6:0/2538513222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f40094f0 con 0x7f160c0af8b0 2023-10-06T02:30:37.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f160a59c700 1 --2- 172.21.15.6:0/2538513222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f160c0af4e0 0x7f160c16d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f1609d9b700 1 --2- 172.21.15.6:0/2538513222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160c0af8b0 0x7f160c154df0 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f15f40090b0 tx=0x7f15f4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f16027fc700 1 -- 172.21.15.6:0/2538513222 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4026480 con 0x7f160c0af8b0 2023-10-06T02:30:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f16027fc700 1 -- 172.21.15.6:0/2538513222 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f401f070 con 0x7f160c0af8b0 2023-10-06T02:30:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f161087f700 1 -- 172.21.15.6:0/2538513222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160c0c96f0 con 0x7f160c0af8b0 2023-10-06T02:30:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f16027fc700 1 -- 172.21.15.6:0/2538513222 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4026850 con 0x7f160c0af8b0 2023-10-06T02:30:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.011+0000 7f161087f700 1 -- 172.21.15.6:0/2538513222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160c0c8dc0 con 0x7f160c0af8b0 2023-10-06T02:30:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.012+0000 7f161087f700 1 -- 172.21.15.6:0/2538513222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160c088aa0 con 0x7f160c0af8b0 2023-10-06T02:30:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.013+0000 7f16027fc700 1 -- 172.21.15.6:0/2538513222 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f15f401a440 con 0x7f160c0af8b0 2023-10-06T02:30:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.013+0000 7f16027fc700 1 --2- 172.21.15.6:0/2538513222 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f15ec066f30 0x7f15ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.013+0000 7f16027fc700 1 -- 172.21.15.6:0/2538513222 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f15f4021070 con 0x7f160c0af8b0 2023-10-06T02:30:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.013+0000 7f160a59c700 1 --2- 172.21.15.6:0/2538513222 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f15ec066f30 0x7f15ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.014+0000 7f160a59c700 1 --2- 172.21.15.6:0/2538513222 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f15ec066f30 0x7f15ec0693e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f1604007fd0 tx=0x7f16040074f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:37.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.018+0000 7f16027fc700 1 -- 172.21.15.6:0/2538513222 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15f4053a00 con 0x7f160c0af8b0 2023-10-06T02:30:37.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.261+0000 7f161087f700 1 -- 172.21.15.6:0/2538513222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f160c0b0910 con 0x7f160c0af8b0 2023-10-06T02:30:37.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.261+0000 7f16027fc700 1 -- 172.21.15.6:0/2538513222 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 365 v365) v1 ==== 95+0+4608 (secure 0 0 0) 0x7f15f4057020 con 0x7f160c0af8b0 2023-10-06T02:30:37.262 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:37.262 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":365,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3603762205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3603762205},{"type":"v1","addr":"172.21.15.175:6836","nonce":3603762205}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":9820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3292446255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3292446255},{"type":"v1","addr":"172.21.15.175:6837","nonce":3292446255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":10869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/759655214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":759655214},{"type":"v1","addr":"172.21.15.6:6834","nonce":759655214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354}],"filesystems":[{"mdsmap":{"epoch":365,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:30:06.715272+0000","modified":"2023-10-06T02:30:32.062334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11088":{"gid":11088,"name":"c","rank":0,"incarnation":362,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/3837760829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3837760829},{"type":"v1","addr":"172.21.15.6:6835","nonce":3837760829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:30:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.263+0000 7f161087f700 1 -- 172.21.15.6:0/2538513222 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f15ec066f30 msgr2=0x7f15ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.263+0000 7f161087f700 1 --2- 172.21.15.6:0/2538513222 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f15ec066f30 0x7f15ec0693e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f1604007fd0 tx=0x7f16040074f0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.263+0000 7f161087f700 1 -- 172.21.15.6:0/2538513222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160c0af8b0 msgr2=0x7f160c154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.263+0000 7f161087f700 1 --2- 172.21.15.6:0/2538513222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160c0af8b0 0x7f160c154df0 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f15f40090b0 tx=0x7f15f4016000 comp rx=0 tx=0).stop 2023-10-06T02:30:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.263+0000 7f161087f700 1 -- 172.21.15.6:0/2538513222 shutdown_connections 2023-10-06T02:30:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.263+0000 7f161087f700 1 --2- 172.21.15.6:0/2538513222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f160c15d460 0x7f160c169620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.263+0000 7f161087f700 1 --2- 172.21.15.6:0/2538513222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f160c0af4e0 0x7f160c16d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.263+0000 7f161087f700 1 --2- 172.21.15.6:0/2538513222 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f15ec066f30 0x7f15ec0693e0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.263+0000 7f161087f700 1 --2- 172.21.15.6:0/2538513222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160c0af8b0 0x7f160c154df0 unknown :-1 s=CLOSED pgs=2488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.263+0000 7f161087f700 1 -- 172.21.15.6:0/2538513222 >> 172.21.15.6:0/2538513222 conn(0x7f160c068680 msgr2=0x7f160c15b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.263+0000 7f161087f700 1 -- 172.21.15.6:0/2538513222 shutdown_connections 2023-10-06T02:30:37.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.263+0000 7f161087f700 1 -- 172.21.15.6:0/2538513222 wait complete. 2023-10-06T02:30:37.266 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 365 2023-10-06T02:30:37.276 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 2717285144 2023-10-06T02:30:37.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.397+0000 7f765f59e700 1 Processor -- start 2023-10-06T02:30:37.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.397+0000 7f765f59e700 1 -- start start 2023-10-06T02:30:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.398+0000 7f765f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76600cd400 0x7f76600b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.398+0000 7f765f59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f76600b0810 0x7f76600b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.398+0000 7f765f59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76600b29a0 con 0x7f76600cd7d0 2023-10-06T02:30:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.398+0000 7f765f59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76600af770 con 0x7f76600b0810 2023-10-06T02:30:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.398+0000 7f765f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76600afa50 con 0x7f76600cd400 2023-10-06T02:30:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.398+0000 7f765ed9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f76600b0810 0x7f76600b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.398+0000 7f765ed9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f76600b0810 0x7f76600b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54020/0 (socket says 172.21.15.6:54020) 2023-10-06T02:30:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.398+0000 7f765ed9d700 1 -- 172.21.15.6:0/2872125428 learned_addr learned my addr 172.21.15.6:0/2872125428 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.398+0000 7f765e59c700 1 --2- 172.21.15.6:0/2872125428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76600cd400 0x7f76600b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.398+0000 7f765ed9d700 1 -- 172.21.15.6:0/2872125428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76600cd400 msgr2=0x7f76600b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.398+0000 7f765ed9d700 1 --2- 172.21.15.6:0/2872125428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76600cd400 0x7f76600b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.398+0000 7f765ed9d700 1 -- 172.21.15.6:0/2872125428 >> v1:172.21.15.175:6789/0 conn(0x7f76600cd7d0 legacy=0x7f76600d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.398+0000 7f765ed9d700 1 -- 172.21.15.6:0/2872125428 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600afd30 con 0x7f76600b0810 2023-10-06T02:30:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.399+0000 7f765ed9d700 1 --2- 172.21.15.6:0/2872125428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76600b0810 0x7f76600b2460 secure :-1 s=READY pgs=2489 cs=0 l=1 rev1=1 crypto rx=0x7f7650009f20 tx=0x7f7650009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aad0ee5c4a86ab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.399+0000 7f765d59a700 1 -- 172.21.15.6:0/2872125428 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765000e070 con 0x7f76600b0810 2023-10-06T02:30:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.399+0000 7f765d59a700 1 -- 172.21.15.6:0/2872125428 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765000ba80 con 0x7f76600b0810 2023-10-06T02:30:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.399+0000 7f765d59a700 1 -- 172.21.15.6:0/2872125428 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500092e0 con 0x7f76600b0810 2023-10-06T02:30:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.399+0000 7f765f59e700 1 -- 172.21.15.6:0/2872125428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76600b0810 msgr2=0x7f76600b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.399+0000 7f765f59e700 1 --2- 172.21.15.6:0/2872125428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76600b0810 0x7f76600b2460 secure :-1 s=READY pgs=2489 cs=0 l=1 rev1=1 crypto rx=0x7f7650009f20 tx=0x7f7650009840 comp rx=0 tx=0).stop 2023-10-06T02:30:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.399+0000 7f765f59e700 1 -- 172.21.15.6:0/2872125428 shutdown_connections 2023-10-06T02:30:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.399+0000 7f765f59e700 1 --2- 172.21.15.6:0/2872125428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76600b0810 0x7f76600b2460 unknown :-1 s=CLOSED pgs=2489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.399+0000 7f765f59e700 1 --2- 172.21.15.6:0/2872125428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76600cd400 0x7f76600b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.399+0000 7f765f59e700 1 -- 172.21.15.6:0/2872125428 >> 172.21.15.6:0/2872125428 conn(0x7f766006a110 msgr2=0x7f766006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.399+0000 7f765f59e700 1 -- 172.21.15.6:0/2872125428 shutdown_connections 2023-10-06T02:30:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.399+0000 7f765f59e700 1 -- 172.21.15.6:0/2872125428 wait complete. 2023-10-06T02:30:37.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.400+0000 7f765f59e700 1 Processor -- start 2023-10-06T02:30:37.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.400+0000 7f765f59e700 1 -- start start 2023-10-06T02:30:37.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.401+0000 7f765f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76600b0810 0x7f7660159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.401+0000 7f765f59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76600cd400 0x7f76600c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.401+0000 7f765f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7660154940 0x7f76600b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.401+0000 7f765f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76600c4140 con 0x7f76600b0810 2023-10-06T02:30:37.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.401+0000 7f765f59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766015a650 con 0x7f76600cd400 2023-10-06T02:30:37.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.401+0000 7f765f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766015a930 con 0x7f7660154940 2023-10-06T02:30:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.401+0000 7f765e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76600b0810 0x7f7660159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.401+0000 7f765e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76600b0810 0x7f7660159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54026/0 (socket says 172.21.15.6:54026) 2023-10-06T02:30:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.401+0000 7f765e59c700 1 -- 172.21.15.6:0/2530814688 learned_addr learned my addr 172.21.15.6:0/2530814688 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.401+0000 7f765dd9b700 1 --2- 172.21.15.6:0/2530814688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76600cd400 0x7f76600c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.401+0000 7f765ed9d700 1 --2- 172.21.15.6:0/2530814688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7660154940 0x7f76600b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.402+0000 7f765e59c700 1 -- 172.21.15.6:0/2530814688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7660154940 msgr2=0x7f76600b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.402+0000 7f765e59c700 1 --2- 172.21.15.6:0/2530814688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7660154940 0x7f76600b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.402+0000 7f765e59c700 1 -- 172.21.15.6:0/2530814688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76600cd400 msgr2=0x7f76600c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.402+0000 7f765e59c700 1 --2- 172.21.15.6:0/2530814688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76600cd400 0x7f76600c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.402+0000 7f765e59c700 1 -- 172.21.15.6:0/2530814688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7650009ae0 con 0x7f76600b0810 2023-10-06T02:30:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.402+0000 7f765e59c700 1 --2- 172.21.15.6:0/2530814688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76600b0810 0x7f7660159fc0 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7f765800d810 tx=0x7f7658008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.402+0000 7f76567fc700 1 -- 172.21.15.6:0/2530814688 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76580125f0 con 0x7f76600b0810 2023-10-06T02:30:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.402+0000 7f76567fc700 1 -- 172.21.15.6:0/2530814688 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7658012750 con 0x7f76600b0810 2023-10-06T02:30:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.402+0000 7f765f59e700 1 -- 172.21.15.6:0/2530814688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766015ac10 con 0x7f76600b0810 2023-10-06T02:30:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.402+0000 7f76567fc700 1 -- 172.21.15.6:0/2530814688 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658012b10 con 0x7f76600b0810 2023-10-06T02:30:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.402+0000 7f765f59e700 1 -- 172.21.15.6:0/2530814688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766015b1d0 con 0x7f76600b0810 2023-10-06T02:30:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.403+0000 7f76567fc700 1 -- 172.21.15.6:0/2530814688 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f765801e460 con 0x7f76600b0810 2023-10-06T02:30:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.404+0000 7f76567fc700 1 --2- 172.21.15.6:0/2530814688 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7640066f30 0x7f76400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.404+0000 7f76567fc700 1 -- 172.21.15.6:0/2530814688 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f7658084ea0 con 0x7f76600b0810 2023-10-06T02:30:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.404+0000 7f765dd9b700 1 --2- 172.21.15.6:0/2530814688 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7640066f30 0x7f76400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.404+0000 7f765dd9b700 1 --2- 172.21.15.6:0/2530814688 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7640066f30 0x7f76400693e0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f7660159750 tx=0x7f7648007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:37.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.406+0000 7f766dbb6b80 1 Processor -- start 2023-10-06T02:30:37.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.406+0000 7f766dbb6b80 1 -- start start 2023-10-06T02:30:37.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.406+0000 7f766dbb6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14feed0 0x55a4a14d9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.406+0000 7f766dbb6b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14df340 0x55a4a14da280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.406+0000 7f766dbb6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14e0a90 0x55a4a14da7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.406+0000 7f766dbb6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a1434af0 con 0x55a4a14e0a90 2023-10-06T02:30:37.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.406+0000 7f766dbb6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a14322f0 con 0x55a4a14feed0 2023-10-06T02:30:37.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.406+0000 7f766dbb6b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a4a142e0e0 con 0x55a4a14df340 2023-10-06T02:30:37.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.407+0000 7f765ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14e0a90 0x55a4a14da7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.407+0000 7f765ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14e0a90 0x55a4a14da7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54034/0 (socket says 172.21.15.6:54034) 2023-10-06T02:30:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.407+0000 7f765ed9d700 1 -- 172.21.15.6:0/1971644355 learned_addr learned my addr 172.21.15.6:0/1971644355 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.407+0000 7f765e59c700 1 --2- 172.21.15.6:0/1971644355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14feed0 0x55a4a14d9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.407+0000 7f765dd9b700 1 --2- 172.21.15.6:0/1971644355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14df340 0x55a4a14da280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.407+0000 7f765ed9d700 1 -- 172.21.15.6:0/1971644355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14df340 msgr2=0x55a4a14da280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.407+0000 7f765ed9d700 1 --2- 172.21.15.6:0/1971644355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14df340 0x55a4a14da280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.407+0000 7f765ed9d700 1 -- 172.21.15.6:0/1971644355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14feed0 msgr2=0x55a4a14d9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.407+0000 7f765ed9d700 1 --2- 172.21.15.6:0/1971644355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14feed0 0x55a4a14d9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.407+0000 7f765ed9d700 1 -- 172.21.15.6:0/1971644355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4a12c82f0 con 0x55a4a14e0a90 2023-10-06T02:30:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.407+0000 7f765dd9b700 1 --2- 172.21.15.6:0/1971644355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14df340 0x55a4a14da280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.407+0000 7f765ed9d700 1 --2- 172.21.15.6:0/1971644355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14e0a90 0x55a4a14da7c0 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7f765000b6c0 tx=0x7f7650018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13f58e026cd13c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.407+0000 7f763f7fe700 1 -- 172.21.15.6:0/1971644355 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500097b0 con 0x55a4a14e0a90 2023-10-06T02:30:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.407+0000 7f763f7fe700 1 -- 172.21.15.6:0/1971644355 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7650009910 con 0x55a4a14e0a90 2023-10-06T02:30:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.407+0000 7f763f7fe700 1 -- 172.21.15.6:0/1971644355 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765000be00 con 0x55a4a14e0a90 2023-10-06T02:30:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.408+0000 7f766dbb6b80 1 -- 172.21.15.6:0/1971644355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14e0a90 msgr2=0x55a4a14da7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.408+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/1971644355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14e0a90 0x55a4a14da7c0 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7f765000b6c0 tx=0x7f7650018000 comp rx=0 tx=0).stop 2023-10-06T02:30:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.408+0000 7f766dbb6b80 1 -- 172.21.15.6:0/1971644355 shutdown_connections 2023-10-06T02:30:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.408+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/1971644355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14e0a90 0x55a4a14da7c0 unknown :-1 s=CLOSED pgs=2491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.408+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/1971644355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14feed0 0x55a4a14d9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.408+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/1971644355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14df340 0x55a4a14da280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.408+0000 7f766dbb6b80 1 -- 172.21.15.6:0/1971644355 >> 172.21.15.6:0/1971644355 conn(0x55a4a14def00 msgr2=0x55a4a14df730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.408+0000 7f766dbb6b80 1 -- 172.21.15.6:0/1971644355 shutdown_connections 2023-10-06T02:30:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.408+0000 7f766dbb6b80 1 -- 172.21.15.6:0/1971644355 wait complete. 2023-10-06T02:30:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.409+0000 7f766dbb6b80 1 -- start start 2023-10-06T02:30:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.409+0000 7f766dbb6b80 1 Processor -- start 2023-10-06T02:30:37.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f766dbb6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14df340 0x55a4a1506af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f766dbb6b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14e0a90 0x55a4a15249c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f766dbb6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14feed0 0x55a4a1537640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f766dbb6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a13d9910 con 0x55a4a14df340 2023-10-06T02:30:37.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f766dbb6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a13f4f20 con 0x55a4a14feed0 2023-10-06T02:30:37.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f766dbb6b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a4a12b0eb0 con 0x55a4a14e0a90 2023-10-06T02:30:37.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f766dbb6b80 10 client.0 _ll_register_callbacks cb 0x55a4a14a10a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:30:37.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f765e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14df340 0x55a4a1506af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f765e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14df340 0x55a4a1506af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54042/0 (socket says 172.21.15.6:54042) 2023-10-06T02:30:37.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f765e59c700 1 -- 172.21.15.6:0/3918204644 learned_addr learned my addr 172.21.15.6:0/3918204644 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:37.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f765dd9b700 1 --2- 172.21.15.6:0/3918204644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14e0a90 0x55a4a15249c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f765ed9d700 1 --2- 172.21.15.6:0/3918204644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14feed0 0x55a4a1537640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f765e59c700 1 -- 172.21.15.6:0/3918204644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14e0a90 msgr2=0x55a4a15249c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:37.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f765e59c700 1 --2- 172.21.15.6:0/3918204644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14e0a90 0x55a4a15249c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f765e59c700 1 -- 172.21.15.6:0/3918204644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14feed0 msgr2=0x55a4a1537640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:37.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f765e59c700 1 --2- 172.21.15.6:0/3918204644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14feed0 0x55a4a1537640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f765e59c700 1 -- 172.21.15.6:0/3918204644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76600afd30 con 0x55a4a14df340 2023-10-06T02:30:37.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f765e59c700 1 --2- 172.21.15.6:0/3918204644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14df340 0x55a4a1506af0 secure :-1 s=READY pgs=2492 cs=0 l=1 rev1=1 crypto rx=0x7f765800d7e0 tx=0x7f7658082f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e276ae4d318383b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:37.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f763cff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:30:37.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f763cff9700 1 -- 172.21.15.6:0/3918204644 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658055c60 con 0x55a4a14df340 2023-10-06T02:30:37.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f763cff9700 1 -- 172.21.15.6:0/3918204644 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f7658055dc0 con 0x55a4a14df340 2023-10-06T02:30:37.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f766dbb6b80 1 -- 172.21.15.6:0/3918204644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4a14af8f0 con 0x55a4a14df340 2023-10-06T02:30:37.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f763cff9700 1 -- 172.21.15.6:0/3918204644 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=365) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7658055100 con 0x55a4a14df340 2023-10-06T02:30:37.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.410+0000 7f766dbb6b80 10 client.11235 fetch_fsmap learned FSMap version 365 2023-10-06T02:30:37.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.411+0000 7f766dbb6b80 1 -- 172.21.15.6:0/3918204644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=365,monmap=2+}) v3 -- 0x55a4a126b060 con 0x55a4a14df340 2023-10-06T02:30:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.411+0000 7f763cff9700 1 -- 172.21.15.6:0/3918204644 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a4a14af8f0 con 0x55a4a14df340 2023-10-06T02:30:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.411+0000 7f763cff9700 1 -- 172.21.15.6:0/3918204644 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 365) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f765805c510 con 0x55a4a14df340 2023-10-06T02:30:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.411+0000 7f766dbb6b80 10 client.11235 fetch_fsmap finished waiting for FSMap version 365 2023-10-06T02:30:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.411+0000 7f766dbb6b80 10 client.11235 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:30:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.411+0000 7f766dbb6b80 20 client.11235 populate_metadata read hostname 'smithi006' 2023-10-06T02:30:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.411+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/3918204644 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55a4a1535800 0x55a4a1535bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.411+0000 7f766dbb6b80 4 client.11235 mds_command: new command op to 11088 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:30:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.411+0000 7f766dbb6b80 1 -- 172.21.15.6:0/3918204644 --> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a4a13d0e80 con 0x55a4a1535800 2023-10-06T02:30:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.411+0000 7f765dd9b700 1 --2- 172.21.15.6:0/3918204644 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55a4a1535800 0x55a4a1535bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.411+0000 7f765dd9b700 1 --2- 172.21.15.6:0/3918204644 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55a4a1535800 0x55a4a1535bd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdcb9972ac6397e server_cookie=af9e6be45503dee2 in_seq=0 out_seq=0 2023-10-06T02:30:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.411+0000 7f763cff9700 10 client.11235 ms_handle_connect on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.412+0000 7f763cff9700 1 -- 172.21.15.6:0/3918204644 <== mds.0 v2:172.21.15.6:6833/3837760829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a4a13d0e80 con 0x55a4a1535800 2023-10-06T02:30:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.412+0000 7f763cff9700 10 client.11235 handle_command_reply: tid=0 2023-10-06T02:30:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.412+0000 7f766dbb6b80 1 client.11235 shutdown 2023-10-06T02:30:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.412+0000 7f766dbb6b80 1 -- 172.21.15.6:0/3918204644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14df340 msgr2=0x55a4a1506af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.412+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/3918204644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14df340 0x55a4a1506af0 secure :-1 s=READY pgs=2492 cs=0 l=1 rev1=1 crypto rx=0x7f765800d7e0 tx=0x7f7658082f50 comp rx=0 tx=0).stop 2023-10-06T02:30:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.412+0000 7f766dbb6b80 1 -- 172.21.15.6:0/3918204644 shutdown_connections 2023-10-06T02:30:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.412+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/3918204644 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55a4a1535800 0x55a4a1535bd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.412+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/3918204644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14feed0 0x55a4a1537640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.412+0000 7f763cff9700 0 client.11235 ms_handle_reset on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:37.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.412+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/3918204644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14df340 0x55a4a1506af0 unknown :-1 s=CLOSED pgs=2492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.412+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/3918204644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14e0a90 0x55a4a15249c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.412+0000 7f766dbb6b80 1 -- 172.21.15.6:0/3918204644 >> 172.21.15.6:0/3918204644 conn(0x55a4a14def00 msgr2=0x55a4a14ddbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:37.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.412+0000 7f766dbb6b80 1 -- 172.21.15.6:0/3918204644 shutdown_connections 2023-10-06T02:30:37.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.412+0000 7f766dbb6b80 1 -- 172.21.15.6:0/3918204644 wait complete. 2023-10-06T02:30:37.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.412+0000 7f766dbb6b80 20 client.11235 trim_cache size 0 max 16384 2023-10-06T02:30:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.425+0000 7f766dbb6b80 1 Processor -- start 2023-10-06T02:30:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.425+0000 7f766dbb6b80 1 -- start start 2023-10-06T02:30:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.425+0000 7f766dbb6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14df340 0x55a4a14daf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.425+0000 7f766dbb6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14e0a90 0x55a4a14ff2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.425+0000 7f766dbb6b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14feed0 0x55a4a14ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.425+0000 7f766dbb6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a1509d90 con 0x55a4a14e0a90 2023-10-06T02:30:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.425+0000 7f766dbb6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a14d2780 con 0x55a4a14df340 2023-10-06T02:30:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.425+0000 7f766dbb6b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a4a14fe120 con 0x55a4a14feed0 2023-10-06T02:30:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.425+0000 7f765dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14e0a90 0x55a4a14ff2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.425+0000 7f765dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14e0a90 0x55a4a14ff2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54048/0 (socket says 172.21.15.6:54048) 2023-10-06T02:30:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.426+0000 7f765dd9b700 1 -- 172.21.15.6:0/2504949937 learned_addr learned my addr 172.21.15.6:0/2504949937 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.426+0000 7f765dd9b700 1 -- 172.21.15.6:0/2504949937 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14feed0 msgr2=0x55a4a14ff7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.426+0000 7f765dd9b700 1 --2- 172.21.15.6:0/2504949937 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14feed0 0x55a4a14ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.426+0000 7f765dd9b700 1 -- 172.21.15.6:0/2504949937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14df340 msgr2=0x55a4a14daf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.426+0000 7f765e59c700 1 --2- 172.21.15.6:0/2504949937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14df340 0x55a4a14daf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.426+0000 7f765dd9b700 1 --2- 172.21.15.6:0/2504949937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14df340 0x55a4a14daf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.426+0000 7f765dd9b700 1 -- 172.21.15.6:0/2504949937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4a13fc800 con 0x55a4a14e0a90 2023-10-06T02:30:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.426+0000 7f765e59c700 1 --2- 172.21.15.6:0/2504949937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14df340 0x55a4a14daf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.426+0000 7f765dd9b700 1 --2- 172.21.15.6:0/2504949937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14e0a90 0x55a4a14ff2a0 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 crypto rx=0x55a4a14dad50 tx=0x7f7648014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd96cdc0f91e010 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.426+0000 7f763ffff700 1 -- 172.21.15.6:0/2504949937 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648014730 con 0x55a4a14e0a90 2023-10-06T02:30:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.426+0000 7f763ffff700 1 -- 172.21.15.6:0/2504949937 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764802b070 con 0x55a4a14e0a90 2023-10-06T02:30:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.426+0000 7f763ffff700 1 -- 172.21.15.6:0/2504949937 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648027660 con 0x55a4a14e0a90 2023-10-06T02:30:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.427+0000 7f766dbb6b80 1 -- 172.21.15.6:0/2504949937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14e0a90 msgr2=0x55a4a14ff2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.427+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/2504949937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14e0a90 0x55a4a14ff2a0 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 crypto rx=0x55a4a14dad50 tx=0x7f7648014000 comp rx=0 tx=0).stop 2023-10-06T02:30:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.427+0000 7f766dbb6b80 1 -- 172.21.15.6:0/2504949937 shutdown_connections 2023-10-06T02:30:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.427+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/2504949937 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14feed0 0x55a4a14ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.427+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/2504949937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14df340 0x55a4a14daf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.427+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/2504949937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14e0a90 0x55a4a14ff2a0 unknown :-1 s=CLOSED pgs=2493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.427+0000 7f766dbb6b80 1 -- 172.21.15.6:0/2504949937 >> 172.21.15.6:0/2504949937 conn(0x55a4a14def00 msgr2=0x55a4a1535bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.427+0000 7f766dbb6b80 1 -- 172.21.15.6:0/2504949937 shutdown_connections 2023-10-06T02:30:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.427+0000 7f766dbb6b80 1 -- 172.21.15.6:0/2504949937 wait complete. 2023-10-06T02:30:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.427+0000 7f766dbb6b80 1 -- start start 2023-10-06T02:30:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.427+0000 7f766dbb6b80 1 Processor -- start 2023-10-06T02:30:37.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.428+0000 7f766dbb6b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14df340 0x55a4a1583d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.428+0000 7f766dbb6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14e0a90 0x55a4a1534620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.428+0000 7f766dbb6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14feed0 0x55a4a15245e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.428+0000 7f766dbb6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a1536d50 con 0x55a4a14feed0 2023-10-06T02:30:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.428+0000 7f766dbb6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a1535120 con 0x55a4a14e0a90 2023-10-06T02:30:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.428+0000 7f766dbb6b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a4a158b7f0 con 0x55a4a14df340 2023-10-06T02:30:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.428+0000 7f766dbb6b80 10 client.0 _ll_register_callbacks cb 0x55a4a14a10a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:30:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.428+0000 7f765ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14feed0 0x55a4a15245e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.428+0000 7f765ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14feed0 0x55a4a15245e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54064/0 (socket says 172.21.15.6:54064) 2023-10-06T02:30:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.428+0000 7f765ed9d700 1 -- 172.21.15.6:0/3283801929 learned_addr learned my addr 172.21.15.6:0/3283801929 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.428+0000 7f765dd9b700 1 --2- 172.21.15.6:0/3283801929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14e0a90 0x55a4a1534620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.428+0000 7f765e59c700 1 --2- 172.21.15.6:0/3283801929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14df340 0x55a4a1583d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f765ed9d700 1 -- 172.21.15.6:0/3283801929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14df340 msgr2=0x55a4a1583d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f765ed9d700 1 --2- 172.21.15.6:0/3283801929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14df340 0x55a4a1583d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f765ed9d700 1 -- 172.21.15.6:0/3283801929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14e0a90 msgr2=0x55a4a1534620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f765ed9d700 1 --2- 172.21.15.6:0/3283801929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14e0a90 0x55a4a1534620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f765ed9d700 1 -- 172.21.15.6:0/3283801929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7648019040 con 0x55a4a14feed0 2023-10-06T02:30:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f765ed9d700 1 --2- 172.21.15.6:0/3283801929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14feed0 0x55a4a15245e0 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7f765001e000 tx=0x7f765001f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b41ef1a3e6b21c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f763cff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:30:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f763cff9700 1 -- 172.21.15.6:0/3283801929 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765002b070 con 0x55a4a14feed0 2023-10-06T02:30:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f763cff9700 1 -- 172.21.15.6:0/3283801929 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f7650030e00 con 0x55a4a14feed0 2023-10-06T02:30:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f766dbb6b80 1 -- 172.21.15.6:0/3283801929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4a14d29c0 con 0x55a4a14feed0 2023-10-06T02:30:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f763cff9700 1 -- 172.21.15.6:0/3283801929 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=365) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76500097b0 con 0x55a4a14feed0 2023-10-06T02:30:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f766dbb6b80 10 client.11241 fetch_fsmap learned FSMap version 365 2023-10-06T02:30:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f766dbb6b80 1 -- 172.21.15.6:0/3283801929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=365,monmap=2+}) v3 -- 0x55a4a13e34f0 con 0x55a4a14feed0 2023-10-06T02:30:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f763cff9700 1 -- 172.21.15.6:0/3283801929 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a4a14d29c0 con 0x55a4a14feed0 2023-10-06T02:30:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f763cff9700 1 -- 172.21.15.6:0/3283801929 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 365) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f765000b050 con 0x55a4a14feed0 2023-10-06T02:30:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f766dbb6b80 10 client.11241 fetch_fsmap finished waiting for FSMap version 365 2023-10-06T02:30:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f766dbb6b80 10 client.11241 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:30:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f766dbb6b80 20 client.11241 populate_metadata read hostname 'smithi006' 2023-10-06T02:30:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/3283801929 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55a4a158a660 0x55a4a158aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f766dbb6b80 4 client.11241 mds_command: new command op to 11088 tid=0[{"prefix": "damage rm", "damage_id": 2717285144}] 2023-10-06T02:30:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f766dbb6b80 1 -- 172.21.15.6:0/3283801929 --> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] -- command(tid 0: {"prefix": "damage rm", "damage_id": 2717285144}) v1 -- 0x55a4a13d0ba0 con 0x55a4a158a660 2023-10-06T02:30:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.429+0000 7f765e59c700 1 --2- 172.21.15.6:0/3283801929 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55a4a158a660 0x55a4a158aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.430+0000 7f763cff9700 10 client.11241 ms_handle_connect on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.430+0000 7f765e59c700 1 --2- 172.21.15.6:0/3283801929 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55a4a158a660 0x55a4a158aa30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4aaf8837e9735b65 server_cookie=25b000a7753690e0 in_seq=0 out_seq=0 2023-10-06T02:30:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.430+0000 7f763cff9700 1 -- 172.21.15.6:0/3283801929 <== mds.0 v2:172.21.15.6:6833/3837760829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+0 (crc 0 0 0) 0x55a4a13d0ba0 con 0x55a4a158a660 2023-10-06T02:30:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.430+0000 7f763cff9700 10 client.11241 handle_command_reply: tid=0 2023-10-06T02:30:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.430+0000 7f766dbb6b80 1 client.11241 shutdown 2023-10-06T02:30:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.430+0000 7f766dbb6b80 1 -- 172.21.15.6:0/3283801929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14feed0 msgr2=0x55a4a15245e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.430+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/3283801929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14feed0 0x55a4a15245e0 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7f765001e000 tx=0x7f765001f040 comp rx=0 tx=0).stop 2023-10-06T02:30:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.430+0000 7f766dbb6b80 1 -- 172.21.15.6:0/3283801929 shutdown_connections 2023-10-06T02:30:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.430+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/3283801929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a14feed0 0x55a4a15245e0 unknown :-1 s=CLOSED pgs=2494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.430+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/3283801929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a4a14df340 0x55a4a1583d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.430+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/3283801929 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55a4a158a660 0x55a4a158aa30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.430+0000 7f766dbb6b80 1 --2- 172.21.15.6:0/3283801929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4a14e0a90 0x55a4a1534620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.430+0000 7f763cff9700 0 client.11241 ms_handle_reset on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.430+0000 7f766dbb6b80 1 -- 172.21.15.6:0/3283801929 >> 172.21.15.6:0/3283801929 conn(0x55a4a14def00 msgr2=0x55a4a14fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.430+0000 7f766dbb6b80 1 -- 172.21.15.6:0/3283801929 shutdown_connections 2023-10-06T02:30:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.430+0000 7f766dbb6b80 1 -- 172.21.15.6:0/3283801929 wait complete. 2023-10-06T02:30:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.430+0000 7f766dbb6b80 20 client.11241 trim_cache size 0 max 16384 2023-10-06T02:30:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.431+0000 7f765f59e700 1 -- 172.21.15.6:0/2530814688 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7640066f30 msgr2=0x7f76400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.431+0000 7f765f59e700 1 --2- 172.21.15.6:0/2530814688 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7640066f30 0x7f76400693e0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f7660159750 tx=0x7f7648007ec0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.431+0000 7f765f59e700 1 -- 172.21.15.6:0/2530814688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76600b0810 msgr2=0x7f7660159fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.431+0000 7f765f59e700 1 --2- 172.21.15.6:0/2530814688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76600b0810 0x7f7660159fc0 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7f765800d810 tx=0x7f7658008040 comp rx=0 tx=0).stop 2023-10-06T02:30:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.431+0000 7f765f59e700 1 -- 172.21.15.6:0/2530814688 shutdown_connections 2023-10-06T02:30:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.431+0000 7f765f59e700 1 --2- 172.21.15.6:0/2530814688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7660154940 0x7f76600b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.431+0000 7f765f59e700 1 --2- 172.21.15.6:0/2530814688 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f7640066f30 0x7f76400693e0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.431+0000 7f765f59e700 1 --2- 172.21.15.6:0/2530814688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76600b0810 0x7f7660159fc0 unknown :-1 s=CLOSED pgs=2490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.431+0000 7f765f59e700 1 --2- 172.21.15.6:0/2530814688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76600cd400 0x7f76600c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.431+0000 7f765f59e700 1 -- 172.21.15.6:0/2530814688 >> 172.21.15.6:0/2530814688 conn(0x7f766006a110 msgr2=0x7f76600b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.431+0000 7f765f59e700 1 -- 172.21.15.6:0/2530814688 shutdown_connections 2023-10-06T02:30:37.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.431+0000 7f765f59e700 1 -- 172.21.15.6:0/2530814688 wait complete. 2023-10-06T02:30:37.443 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 100000001f6.00000000 2023-10-06T02:30:37.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.480+0000 7f3e7e2f0000 1 Processor -- start 2023-10-06T02:30:37.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.480+0000 7f3e7e2f0000 1 -- start start 2023-10-06T02:30:37.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.480+0000 7f3e7e2f0000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ce55c6cc0 0x560ce55f3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.480+0000 7f3e7e2f0000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ce560c130 0x560ce569bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.480+0000 7f3e7e2f0000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ce5681cc0 0x560ce569c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e7e2f0000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ce550e980 con 0x560ce5681cc0 2023-10-06T02:30:37.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e7e2f0000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ce550e620 con 0x560ce560c130 2023-10-06T02:30:37.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e7e2f0000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560ce5505400 con 0x560ce55c6cc0 2023-10-06T02:30:37.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e77d2c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ce5681cc0 0x560ce569c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e77d2c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ce5681cc0 0x560ce569c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54068/0 (socket says 172.21.15.6:54068) 2023-10-06T02:30:37.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e77d2c700 1 -- 172.21.15.6:0/1686883917 learned_addr learned my addr 172.21.15.6:0/1686883917 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:37.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e7752b700 1 --2- 172.21.15.6:0/1686883917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ce55c6cc0 0x560ce55f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e76d2a700 1 --2- 172.21.15.6:0/1686883917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ce560c130 0x560ce569bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e77d2c700 1 -- 172.21.15.6:0/1686883917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ce55c6cc0 msgr2=0x560ce55f3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e77d2c700 1 --2- 172.21.15.6:0/1686883917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ce55c6cc0 0x560ce55f3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e77d2c700 1 -- 172.21.15.6:0/1686883917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ce560c130 msgr2=0x560ce569bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e77d2c700 1 --2- 172.21.15.6:0/1686883917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ce560c130 0x560ce569bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e77d2c700 1 -- 172.21.15.6:0/1686883917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c005cf0 con 0x560ce5681cc0 2023-10-06T02:30:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e76d2a700 1 --2- 172.21.15.6:0/1686883917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ce560c130 0x560ce569bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e77d2c700 1 --2- 172.21.15.6:0/1686883917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ce5681cc0 0x560ce569c1a0 secure :-1 s=READY pgs=2496 cs=0 l=1 rev1=1 crypto rx=0x7f3e70006f40 tx=0x7f3e700069f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0e5fc80b2ba9f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e75d28700 1 -- 172.21.15.6:0/1686883917 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70006110 con 0x560ce5681cc0 2023-10-06T02:30:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e75d28700 1 -- 172.21.15.6:0/1686883917 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e70006270 con 0x560ce5681cc0 2023-10-06T02:30:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.481+0000 7f3e75d28700 1 -- 172.21.15.6:0/1686883917 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70004730 con 0x560ce5681cc0 2023-10-06T02:30:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.482+0000 7f3e7e2f0000 1 -- 172.21.15.6:0/1686883917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ce5681cc0 msgr2=0x560ce569c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.482+0000 7f3e7e2f0000 1 --2- 172.21.15.6:0/1686883917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ce5681cc0 0x560ce569c1a0 secure :-1 s=READY pgs=2496 cs=0 l=1 rev1=1 crypto rx=0x7f3e70006f40 tx=0x7f3e700069f0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.482+0000 7f3e7e2f0000 1 -- 172.21.15.6:0/1686883917 shutdown_connections 2023-10-06T02:30:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.482+0000 7f3e7e2f0000 1 --2- 172.21.15.6:0/1686883917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ce5681cc0 0x560ce569c1a0 unknown :-1 s=CLOSED pgs=2496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.482+0000 7f3e7e2f0000 1 --2- 172.21.15.6:0/1686883917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ce55c6cc0 0x560ce55f3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.482+0000 7f3e7e2f0000 1 --2- 172.21.15.6:0/1686883917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ce560c130 0x560ce569bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.482+0000 7f3e7e2f0000 1 -- 172.21.15.6:0/1686883917 >> 172.21.15.6:0/1686883917 conn(0x560ce55c26c0 msgr2=0x560ce569a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.482+0000 7f3e7e2f0000 1 -- 172.21.15.6:0/1686883917 shutdown_connections 2023-10-06T02:30:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.482+0000 7f3e7e2f0000 1 -- 172.21.15.6:0/1686883917 wait complete. 2023-10-06T02:30:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.482+0000 7f3e7e2f0000 1 Processor -- start 2023-10-06T02:30:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.482+0000 7f3e7e2f0000 1 -- start start 2023-10-06T02:30:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.483+0000 7f3e7e2f0000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ce55c6cc0 0x560ce56973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.483+0000 7f3e7e2f0000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ce560c130 0x560ce567c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.483+0000 7f3e7e2f0000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ce5681cc0 0x560ce569bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.483+0000 7f3e7e2f0000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ce569acc0 con 0x560ce5681cc0 2023-10-06T02:30:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.483+0000 7f3e7e2f0000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ce567e280 con 0x560ce55c6cc0 2023-10-06T02:30:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.483+0000 7f3e7e2f0000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x560ce55c4860 con 0x560ce560c130 2023-10-06T02:30:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.483+0000 7f3e77d2c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ce5681cc0 0x560ce569bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.483+0000 7f3e77d2c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ce5681cc0 0x560ce569bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54076/0 (socket says 172.21.15.6:54076) 2023-10-06T02:30:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.483+0000 7f3e77d2c700 1 -- 172.21.15.6:0/2885334819 learned_addr learned my addr 172.21.15.6:0/2885334819 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.483+0000 7f3e76d2a700 1 --2- 172.21.15.6:0/2885334819 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ce560c130 0x560ce567c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.483+0000 7f3e7752b700 1 --2- 172.21.15.6:0/2885334819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ce55c6cc0 0x560ce56973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.483+0000 7f3e77d2c700 1 -- 172.21.15.6:0/2885334819 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ce560c130 msgr2=0x560ce567c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.483+0000 7f3e77d2c700 1 --2- 172.21.15.6:0/2885334819 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x560ce560c130 0x560ce567c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.483+0000 7f3e77d2c700 1 -- 172.21.15.6:0/2885334819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ce55c6cc0 msgr2=0x560ce56973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.483+0000 7f3e77d2c700 1 --2- 172.21.15.6:0/2885334819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560ce55c6cc0 0x560ce56973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.483+0000 7f3e77d2c700 1 -- 172.21.15.6:0/2885334819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e60001e10 con 0x560ce5681cc0 2023-10-06T02:30:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.484+0000 7f3e77d2c700 1 --2- 172.21.15.6:0/2885334819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ce5681cc0 0x560ce569bc60 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 crypto rx=0x7f3e70006a30 tx=0x7f3e70014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.484+0000 7f3e5ffff700 1 -- 172.21.15.6:0/2885334819 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70013630 con 0x560ce5681cc0 2023-10-06T02:30:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.484+0000 7f3e5ffff700 1 -- 172.21.15.6:0/2885334819 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e700137b0 con 0x560ce5681cc0 2023-10-06T02:30:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.484+0000 7f3e7e2f0000 1 -- 172.21.15.6:0/2885334819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560ce551d3d0 con 0x560ce5681cc0 2023-10-06T02:30:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.484+0000 7f3e5ffff700 1 -- 172.21.15.6:0/2885334819 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70013b70 con 0x560ce5681cc0 2023-10-06T02:30:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.484+0000 7f3e7e2f0000 1 -- 172.21.15.6:0/2885334819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ce5510ae0 con 0x560ce5681cc0 2023-10-06T02:30:37.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.485+0000 7f3e5ffff700 1 -- 172.21.15.6:0/2885334819 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e70004020 con 0x560ce5681cc0 2023-10-06T02:30:37.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.486+0000 7f3e5ffff700 1 --2- 172.21.15.6:0/2885334819 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3e64065890 0x7f3e64067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.486+0000 7f3e5ffff700 1 -- 172.21.15.6:0/2885334819 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f3e70084410 con 0x560ce5681cc0 2023-10-06T02:30:37.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.486+0000 7f3e7e2f0000 1 --2- 172.21.15.6:0/2885334819 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x560ce569a740 0x560ce55c3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.486+0000 7f3e7e2f0000 1 -- 172.21.15.6:0/2885334819 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- osd_op(unknown.0.0:1 16.a 16:57fe7535:::100000001f6.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e149) v8 -- 0x560ce55c3780 con 0x560ce569a740 2023-10-06T02:30:37.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.486+0000 7f3e7752b700 1 --2- 172.21.15.6:0/2885334819 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3e64065890 0x7f3e64067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.486+0000 7f3e76d2a700 1 --2- 172.21.15.6:0/2885334819 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x560ce569a740 0x560ce55c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.486+0000 7f3e76d2a700 1 --2- 172.21.15.6:0/2885334819 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x560ce569a740 0x560ce55c3240 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:37.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.487+0000 7f3e7752b700 1 --2- 172.21.15.6:0/2885334819 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3e64065890 0x7f3e64067d40 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009b50 tx=0x7f3e6800c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:37.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.487+0000 7f3e76d2a700 1 -- 172.21.15.6:0/2885334819 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== osd_op_reply(1 100000001f6.00000000 [delete] v149'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f3e6c000bc0 con 0x560ce569a740 2023-10-06T02:30:37.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.487+0000 7f3e7e2f0000 1 -- 172.21.15.6:0/2885334819 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x560ce569a740 msgr2=0x560ce55c3240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.487+0000 7f3e7e2f0000 1 --2- 172.21.15.6:0/2885334819 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x560ce569a740 0x560ce55c3240 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.488+0000 7f3e7e2f0000 1 -- 172.21.15.6:0/2885334819 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3e64065890 msgr2=0x7f3e64067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.488+0000 7f3e7e2f0000 1 --2- 172.21.15.6:0/2885334819 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3e64065890 0x7f3e64067d40 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009b50 tx=0x7f3e6800c040 comp rx=0 tx=0).stop 2023-10-06T02:30:37.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.488+0000 7f3e7e2f0000 1 -- 172.21.15.6:0/2885334819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ce5681cc0 msgr2=0x560ce569bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.488+0000 7f3e7e2f0000 1 --2- 172.21.15.6:0/2885334819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560ce5681cc0 0x560ce569bc60 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 crypto rx=0x7f3e70006a30 tx=0x7f3e70014000 comp rx=0 tx=0).stop 2023-10-06T02:30:37.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.488+0000 7f3e77d2c700 1 -- 172.21.15.6:0/2885334819 reap_dead start 2023-10-06T02:30:37.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.488+0000 7f3e7e2f0000 1 -- 172.21.15.6:0/2885334819 shutdown_connections 2023-10-06T02:30:37.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.488+0000 7f3e7e2f0000 1 -- 172.21.15.6:0/2885334819 >> 172.21.15.6:0/2885334819 conn(0x560ce55c26c0 msgr2=0x560ce5680f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:37.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.488+0000 7f3e7e2f0000 1 -- 172.21.15.6:0/2885334819 shutdown_connections 2023-10-06T02:30:37.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.488+0000 7f3e7e2f0000 1 -- 172.21.15.6:0/2885334819 wait complete. 2023-10-06T02:30:37.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:30:37.494 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat testdir/hardlink2) 2023-10-06T02:30:37.548 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-06T02:30:37.548+0000 7f2f8a850700 -1 log_channel(cluster) log [ERR] : dir 0x100000001f6 object missing on disk; some files may be lost (/dir2) 2023-10-06T02:30:37.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:30:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:stat: cannot stat 'testdir/hardlink2': Input/output error 2023-10-06T02:30:37.550 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:30:37.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.707+0000 7f52c27e5700 1 Processor -- start 2023-10-06T02:30:37.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.707+0000 7f52c27e5700 1 -- start start 2023-10-06T02:30:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.708+0000 7f52c27e5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc1593f0 0x7f52bc06de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.708+0000 7f52c27e5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52bc06adf0 0x7f52bc06e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.708+0000 7f52c27e5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc069950 con 0x7f52bc1597c0 2023-10-06T02:30:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.708+0000 7f52c27e5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52bc0b2850 con 0x7f52bc06adf0 2023-10-06T02:30:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.708+0000 7f52c27e5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0b1fb0 con 0x7f52bc1593f0 2023-10-06T02:30:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.708+0000 7f52c0d82700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52bc06adf0 0x7f52bc06e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.708+0000 7f52c0d82700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52bc06adf0 0x7f52bc06e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54090/0 (socket says 172.21.15.6:54090) 2023-10-06T02:30:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.709+0000 7f52c0d82700 1 -- 172.21.15.6:0/3151781118 learned_addr learned my addr 172.21.15.6:0/3151781118 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.709+0000 7f52bbfff700 1 --2- 172.21.15.6:0/3151781118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc1593f0 0x7f52bc06de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.709+0000 7f52c0d82700 1 -- 172.21.15.6:0/3151781118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc1593f0 msgr2=0x7f52bc06de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.709+0000 7f52c0d82700 1 --2- 172.21.15.6:0/3151781118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc1593f0 0x7f52bc06de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.709+0000 7f52c0d82700 1 -- 172.21.15.6:0/3151781118 >> v1:172.21.15.175:6789/0 conn(0x7f52bc1597c0 legacy=0x7f52bc15d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.709+0000 7f52c0d82700 1 -- 172.21.15.6:0/3151781118 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc0b2290 con 0x7f52bc06adf0 2023-10-06T02:30:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.709+0000 7f52c0d82700 1 --2- 172.21.15.6:0/3151781118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52bc06adf0 0x7f52bc06e350 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009f20 tx=0x7f52b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d09277f73dcfef9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.709+0000 7f52baffd700 1 -- 172.21.15.6:0/3151781118 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b400e070 con 0x7f52bc06adf0 2023-10-06T02:30:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.709+0000 7f52baffd700 1 -- 172.21.15.6:0/3151781118 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b400ba40 con 0x7f52bc06adf0 2023-10-06T02:30:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.709+0000 7f52baffd700 1 -- 172.21.15.6:0/3151781118 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b40092e0 con 0x7f52bc06adf0 2023-10-06T02:30:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.710+0000 7f52c27e5700 1 -- 172.21.15.6:0/3151781118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52bc06adf0 msgr2=0x7f52bc06e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.710+0000 7f52c27e5700 1 --2- 172.21.15.6:0/3151781118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52bc06adf0 0x7f52bc06e350 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009f20 tx=0x7f52b4009840 comp rx=0 tx=0).stop 2023-10-06T02:30:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.710+0000 7f52c27e5700 1 -- 172.21.15.6:0/3151781118 shutdown_connections 2023-10-06T02:30:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.710+0000 7f52c27e5700 1 --2- 172.21.15.6:0/3151781118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52bc06adf0 0x7f52bc06e350 unknown :-1 s=CLOSED pgs=2498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.710+0000 7f52c27e5700 1 --2- 172.21.15.6:0/3151781118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc1593f0 0x7f52bc06de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.710+0000 7f52c27e5700 1 -- 172.21.15.6:0/3151781118 >> 172.21.15.6:0/3151781118 conn(0x7f52bc06cff0 msgr2=0x7f52bc0afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:37.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.710+0000 7f52c27e5700 1 -- 172.21.15.6:0/3151781118 shutdown_connections 2023-10-06T02:30:37.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.710+0000 7f52c27e5700 1 -- 172.21.15.6:0/3151781118 wait complete. 2023-10-06T02:30:37.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.711+0000 7f52c27e5700 1 Processor -- start 2023-10-06T02:30:37.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.711+0000 7f52c27e5700 1 -- start start 2023-10-06T02:30:37.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.712+0000 7f52c27e5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52bc06adf0 0x7f52bc0ac370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.712+0000 7f52c27e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52bc1593f0 0x7f52bc0cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.712+0000 7f52c27e5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc1597c0 0x7f52bc0cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.712+0000 7f52c27e5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0c8b60 con 0x7f52bc1593f0 2023-10-06T02:30:37.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.712+0000 7f52c27e5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0c7f50 con 0x7f52bc06adf0 2023-10-06T02:30:37.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.712+0000 7f52c27e5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0c8230 con 0x7f52bc1597c0 2023-10-06T02:30:37.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.712+0000 7f52bb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52bc1593f0 0x7f52bc0cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.712+0000 7f52bb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52bc1593f0 0x7f52bc0cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54098/0 (socket says 172.21.15.6:54098) 2023-10-06T02:30:37.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.712+0000 7f52c0d82700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc1597c0 0x7f52bc0cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.712+0000 7f52bb7fe700 1 -- 172.21.15.6:0/1858378206 learned_addr learned my addr 172.21.15.6:0/1858378206 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:37.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.712+0000 7f52bbfff700 1 --2- 172.21.15.6:0/1858378206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52bc06adf0 0x7f52bc0ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.712+0000 7f52bb7fe700 1 -- 172.21.15.6:0/1858378206 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc1597c0 msgr2=0x7f52bc0cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.712+0000 7f52bb7fe700 1 --2- 172.21.15.6:0/1858378206 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc1597c0 0x7f52bc0cbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.712+0000 7f52bb7fe700 1 -- 172.21.15.6:0/1858378206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52bc06adf0 msgr2=0x7f52bc0ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.712+0000 7f52bb7fe700 1 --2- 172.21.15.6:0/1858378206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52bc06adf0 0x7f52bc0ac370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.712+0000 7f52bb7fe700 1 -- 172.21.15.6:0/1858378206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b4009ae0 con 0x7f52bc1593f0 2023-10-06T02:30:37.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.712+0000 7f52bb7fe700 1 --2- 172.21.15.6:0/1858378206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52bc1593f0 0x7f52bc0cba20 secure :-1 s=READY pgs=2499 cs=0 l=1 rev1=1 crypto rx=0x7f52b000b5b0 tx=0x7f52b00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:37.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.713+0000 7f52a3fff700 1 -- 172.21.15.6:0/1858378206 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b000f510 con 0x7f52bc1593f0 2023-10-06T02:30:37.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.713+0000 7f52a3fff700 1 -- 172.21.15.6:0/1858378206 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b000f670 con 0x7f52bc1593f0 2023-10-06T02:30:37.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.713+0000 7f52c27e5700 1 -- 172.21.15.6:0/1858378206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52bc0c8510 con 0x7f52bc1593f0 2023-10-06T02:30:37.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.713+0000 7f52a3fff700 1 -- 172.21.15.6:0/1858378206 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b000fa10 con 0x7f52bc1593f0 2023-10-06T02:30:37.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.713+0000 7f52c27e5700 1 -- 172.21.15.6:0/1858378206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52bc0ac8b0 con 0x7f52bc1593f0 2023-10-06T02:30:37.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.714+0000 7f52c27e5700 1 -- 172.21.15.6:0/1858378206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52bc06d3f0 con 0x7f52bc1593f0 2023-10-06T02:30:37.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.714+0000 7f52a3fff700 1 -- 172.21.15.6:0/1858378206 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52b001a400 con 0x7f52bc1593f0 2023-10-06T02:30:37.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.715+0000 7f52a3fff700 1 --2- 172.21.15.6:0/1858378206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52a8066f30 0x7f52a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:37.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.715+0000 7f52a3fff700 1 -- 172.21.15.6:0/1858378206 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f52b00841d0 con 0x7f52bc1593f0 2023-10-06T02:30:37.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.715+0000 7f52bbfff700 1 --2- 172.21.15.6:0/1858378206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52a8066f30 0x7f52a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:37.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.715+0000 7f52bbfff700 1 --2- 172.21.15.6:0/1858378206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52a8066f30 0x7f52a80693e0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00acb0 tx=0x7f52ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:37.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.719+0000 7f52a3fff700 1 -- 172.21.15.6:0/1858378206 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52b0051190 con 0x7f52bc1593f0 2023-10-06T02:30:37.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.955+0000 7f52c27e5700 1 -- 172.21.15.6:0/1858378206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52bc0b2570 con 0x7f52bc1593f0 2023-10-06T02:30:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.955+0000 7f52a3fff700 1 -- 172.21.15.6:0/1858378206 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 365 v365) v1 ==== 95+0+4608 (secure 0 0 0) 0x7f52b00547b0 con 0x7f52bc1593f0 2023-10-06T02:30:37.956 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:37.956 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":365,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3603762205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3603762205},{"type":"v1","addr":"172.21.15.175:6836","nonce":3603762205}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":9820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3292446255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3292446255},{"type":"v1","addr":"172.21.15.175:6837","nonce":3292446255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":10869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/759655214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":759655214},{"type":"v1","addr":"172.21.15.6:6834","nonce":759655214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354}],"filesystems":[{"mdsmap":{"epoch":365,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:30:06.715272+0000","modified":"2023-10-06T02:30:32.062334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11088":{"gid":11088,"name":"c","rank":0,"incarnation":362,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/3837760829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3837760829},{"type":"v1","addr":"172.21.15.6:6835","nonce":3837760829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:30:37.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.957+0000 7f52c27e5700 1 -- 172.21.15.6:0/1858378206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52a8066f30 msgr2=0x7f52a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.958+0000 7f52c27e5700 1 --2- 172.21.15.6:0/1858378206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52a8066f30 0x7f52a80693e0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00acb0 tx=0x7f52ac008040 comp rx=0 tx=0).stop 2023-10-06T02:30:37.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.958+0000 7f52c27e5700 1 -- 172.21.15.6:0/1858378206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52bc1593f0 msgr2=0x7f52bc0cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:37.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.958+0000 7f52c27e5700 1 --2- 172.21.15.6:0/1858378206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52bc1593f0 0x7f52bc0cba20 secure :-1 s=READY pgs=2499 cs=0 l=1 rev1=1 crypto rx=0x7f52b000b5b0 tx=0x7f52b00090f0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.958+0000 7f52c27e5700 1 -- 172.21.15.6:0/1858378206 shutdown_connections 2023-10-06T02:30:37.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.958+0000 7f52c27e5700 1 --2- 172.21.15.6:0/1858378206 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52bc1597c0 0x7f52bc0cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.958+0000 7f52c27e5700 1 --2- 172.21.15.6:0/1858378206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52bc06adf0 0x7f52bc0ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.958+0000 7f52c27e5700 1 --2- 172.21.15.6:0/1858378206 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f52a8066f30 0x7f52a80693e0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.958+0000 7f52c27e5700 1 --2- 172.21.15.6:0/1858378206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52bc1593f0 0x7f52bc0cba20 unknown :-1 s=CLOSED pgs=2499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:37.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.958+0000 7f52c27e5700 1 -- 172.21.15.6:0/1858378206 >> 172.21.15.6:0/1858378206 conn(0x7f52bc06cff0 msgr2=0x7f52bc0cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:37.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.958+0000 7f52c27e5700 1 -- 172.21.15.6:0/1858378206 shutdown_connections 2023-10-06T02:30:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:37.958+0000 7f52c27e5700 1 -- 172.21.15.6:0/1858378206 wait complete. 2023-10-06T02:30:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 365 2023-10-06T02:30:37.970 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2023-10-06T02:30:38.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.090+0000 7f099759e700 1 Processor -- start 2023-10-06T02:30:38.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.090+0000 7f099759e700 1 -- start start 2023-10-06T02:30:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.091+0000 7f099759e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f09980afc10 0x7f09980aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.091+0000 7f099759e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0998157380 0x7f09980aef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.091+0000 7f099759e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09980c9940 con 0x7f0998156fb0 2023-10-06T02:30:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.091+0000 7f099759e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09980b0140 con 0x7f09980afc10 2023-10-06T02:30:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.091+0000 7f099759e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09980b0420 con 0x7f0998157380 2023-10-06T02:30:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.091+0000 7f0995d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f09980afc10 0x7f09980aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.091+0000 7f0995d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f09980afc10 0x7f09980aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54110/0 (socket says 172.21.15.6:54110) 2023-10-06T02:30:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.091+0000 7f0995d9b700 1 -- 172.21.15.6:0/3339667546 learned_addr learned my addr 172.21.15.6:0/3339667546 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.092+0000 7f0996d9d700 1 --2- 172.21.15.6:0/3339667546 >> v2:172.21.15.175:3300/0 conn(0x7f0998157380 0x7f09980aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.092+0000 7f0995d9b700 1 -- 172.21.15.6:0/3339667546 >> v2:172.21.15.175:3300/0 conn(0x7f0998157380 msgr2=0x7f09980aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.092+0000 7f0995d9b700 1 --2- 172.21.15.6:0/3339667546 >> v2:172.21.15.175:3300/0 conn(0x7f0998157380 0x7f09980aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.092+0000 7f0995d9b700 1 -- 172.21.15.6:0/3339667546 >> v1:172.21.15.175:6789/0 conn(0x7f0998156fb0 legacy=0x7f09980c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.092+0000 7f0995d9b700 1 -- 172.21.15.6:0/3339667546 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09980b0700 con 0x7f09980afc10 2023-10-06T02:30:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.092+0000 7f0995d9b700 1 --2- 172.21.15.6:0/3339667546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09980afc10 0x7f09980aea20 secure :-1 s=READY pgs=2500 cs=0 l=1 rev1=1 crypto rx=0x7f09980b27d0 tx=0x7f0980009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b1f6f564d108483 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.092+0000 7f099559a700 1 -- 172.21.15.6:0/3339667546 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098000b820 con 0x7f09980afc10 2023-10-06T02:30:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.092+0000 7f099559a700 1 -- 172.21.15.6:0/3339667546 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098000b980 con 0x7f09980afc10 2023-10-06T02:30:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.092+0000 7f099559a700 1 -- 172.21.15.6:0/3339667546 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098000bd20 con 0x7f09980afc10 2023-10-06T02:30:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.093+0000 7f099759e700 1 -- 172.21.15.6:0/3339667546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09980afc10 msgr2=0x7f09980aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.093+0000 7f099759e700 1 --2- 172.21.15.6:0/3339667546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09980afc10 0x7f09980aea20 secure :-1 s=READY pgs=2500 cs=0 l=1 rev1=1 crypto rx=0x7f09980b27d0 tx=0x7f0980009250 comp rx=0 tx=0).stop 2023-10-06T02:30:38.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.093+0000 7f099759e700 1 -- 172.21.15.6:0/3339667546 shutdown_connections 2023-10-06T02:30:38.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.093+0000 7f099759e700 1 --2- 172.21.15.6:0/3339667546 >> v2:172.21.15.175:3300/0 conn(0x7f0998157380 0x7f09980aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.093+0000 7f099759e700 1 --2- 172.21.15.6:0/3339667546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09980afc10 0x7f09980aea20 unknown :-1 s=CLOSED pgs=2500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.093+0000 7f099759e700 1 -- 172.21.15.6:0/3339667546 >> 172.21.15.6:0/3339667546 conn(0x7f0998096200 msgr2=0x7f0998069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:38.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.093+0000 7f099759e700 1 -- 172.21.15.6:0/3339667546 shutdown_connections 2023-10-06T02:30:38.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.093+0000 7f099759e700 1 -- 172.21.15.6:0/3339667546 wait complete. 2023-10-06T02:30:38.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.094+0000 7f099759e700 1 Processor -- start 2023-10-06T02:30:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.094+0000 7f099759e700 1 -- start start 2023-10-06T02:30:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f099759e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09980afc10 0x7f09981531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f099759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0998156fb0 0x7f0998147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f099759e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0998157380 0x7f099809a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f099759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09981477d0 con 0x7f0998156fb0 2023-10-06T02:30:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f099759e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099816ae50 con 0x7f0998157380 2023-10-06T02:30:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f099759e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099816b130 con 0x7f09980afc10 2023-10-06T02:30:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f0995d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0998156fb0 0x7f0998147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f0995d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0998156fb0 0x7f0998147290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54116/0 (socket says 172.21.15.6:54116) 2023-10-06T02:30:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f0995d9b700 1 -- 172.21.15.6:0/1783246147 learned_addr learned my addr 172.21.15.6:0/1783246147 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f0996d9d700 1 --2- 172.21.15.6:0/1783246147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0998157380 0x7f099809a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f099659c700 1 --2- 172.21.15.6:0/1783246147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09980afc10 0x7f09981531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f0995d9b700 1 -- 172.21.15.6:0/1783246147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09980afc10 msgr2=0x7f09981531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f0995d9b700 1 --2- 172.21.15.6:0/1783246147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09980afc10 0x7f09981531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f0995d9b700 1 -- 172.21.15.6:0/1783246147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0998157380 msgr2=0x7f099809a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f0995d9b700 1 --2- 172.21.15.6:0/1783246147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0998157380 0x7f099809a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f0995d9b700 1 -- 172.21.15.6:0/1783246147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09800094f0 con 0x7f0998156fb0 2023-10-06T02:30:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f099659c700 1 --2- 172.21.15.6:0/1783246147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09980afc10 0x7f09981531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f0996d9d700 1 --2- 172.21.15.6:0/1783246147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0998157380 0x7f099809a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f0995d9b700 1 --2- 172.21.15.6:0/1783246147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0998156fb0 0x7f0998147290 secure :-1 s=READY pgs=2501 cs=0 l=1 rev1=1 crypto rx=0x7f09800030c0 tx=0x7f0980016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f098e7fc700 1 -- 172.21.15.6:0/1783246147 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980011e60 con 0x7f0998156fb0 2023-10-06T02:30:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f098e7fc700 1 -- 172.21.15.6:0/1783246147 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0980020070 con 0x7f0998156fb0 2023-10-06T02:30:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f098e7fc700 1 -- 172.21.15.6:0/1783246147 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098001b6a0 con 0x7f0998156fb0 2023-10-06T02:30:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f099759e700 1 -- 172.21.15.6:0/1783246147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099816b410 con 0x7f0998156fb0 2023-10-06T02:30:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.095+0000 7f099759e700 1 -- 172.21.15.6:0/1783246147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099809a590 con 0x7f0998156fb0 2023-10-06T02:30:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.097+0000 7f098e7fc700 1 -- 172.21.15.6:0/1783246147 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0980022030 con 0x7f0998156fb0 2023-10-06T02:30:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.097+0000 7f098e7fc700 1 --2- 172.21.15.6:0/1783246147 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0978066f30 0x7f09780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.097+0000 7f098e7fc700 1 -- 172.21.15.6:0/1783246147 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f0980086880 con 0x7f0998156fb0 2023-10-06T02:30:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.097+0000 7f099659c700 1 --2- 172.21.15.6:0/1783246147 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0978066f30 0x7f09780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.098+0000 7f099659c700 1 --2- 172.21.15.6:0/1783246147 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0978066f30 0x7f09780693e0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f0988007fd0 tx=0x7f0988009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.099+0000 7f09a5ff7b80 1 Processor -- start 2023-10-06T02:30:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.099+0000 7f09a5ff7b80 1 -- start start 2023-10-06T02:30:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.100+0000 7f09a5ff7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cada3ef0 0x5637cad7ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.100+0000 7f09a5ff7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad84360 0x5637cad7f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.100+0000 7f09a5ff7b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cad85ab0 0x5637cad7f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.100+0000 7f09a5ff7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cacd9b10 con 0x5637cad84360 2023-10-06T02:30:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.100+0000 7f09a5ff7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cacd7310 con 0x5637cada3ef0 2023-10-06T02:30:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.100+0000 7f09a5ff7b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5637cacd3100 con 0x5637cad85ab0 2023-10-06T02:30:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.100+0000 7f0995d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad84360 0x5637cad7f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.100+0000 7f0995d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad84360 0x5637cad7f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54130/0 (socket says 172.21.15.6:54130) 2023-10-06T02:30:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.100+0000 7f0995d9b700 1 -- 172.21.15.6:0/1956345976 learned_addr learned my addr 172.21.15.6:0/1956345976 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.100+0000 7f099659c700 1 --2- 172.21.15.6:0/1956345976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cada3ef0 0x5637cad7ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.100+0000 7f0996d9d700 1 --2- 172.21.15.6:0/1956345976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cad85ab0 0x5637cad7f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.100+0000 7f0995d9b700 1 -- 172.21.15.6:0/1956345976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cad85ab0 msgr2=0x5637cad7f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.100+0000 7f0995d9b700 1 --2- 172.21.15.6:0/1956345976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cad85ab0 0x5637cad7f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.100+0000 7f0995d9b700 1 -- 172.21.15.6:0/1956345976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cada3ef0 msgr2=0x5637cad7ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.100+0000 7f0995d9b700 1 --2- 172.21.15.6:0/1956345976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cada3ef0 0x5637cad7ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.100+0000 7f0995d9b700 1 -- 172.21.15.6:0/1956345976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637cab6d310 con 0x5637cad84360 2023-10-06T02:30:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.100+0000 7f0996d9d700 1 --2- 172.21.15.6:0/1956345976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cad85ab0 0x5637cad7f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.101+0000 7f0995d9b700 1 --2- 172.21.15.6:0/1956345976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad84360 0x5637cad7f2a0 secure :-1 s=READY pgs=2502 cs=0 l=1 rev1=1 crypto rx=0x7f0980053980 tx=0x7f09800849d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b25a7d2fdc4cfac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.101+0000 7f09777fe700 1 -- 172.21.15.6:0/1956345976 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980057250 con 0x5637cad84360 2023-10-06T02:30:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.101+0000 7f09777fe700 1 -- 172.21.15.6:0/1956345976 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0980084e90 con 0x5637cad84360 2023-10-06T02:30:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.101+0000 7f09777fe700 1 -- 172.21.15.6:0/1956345976 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09800730d0 con 0x5637cad84360 2023-10-06T02:30:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.101+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/1956345976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad84360 msgr2=0x5637cad7f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.101+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/1956345976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad84360 0x5637cad7f2a0 secure :-1 s=READY pgs=2502 cs=0 l=1 rev1=1 crypto rx=0x7f0980053980 tx=0x7f09800849d0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.101+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/1956345976 shutdown_connections 2023-10-06T02:30:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.101+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/1956345976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cad85ab0 0x5637cad7f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.101+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/1956345976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cada3ef0 0x5637cad7ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.101+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/1956345976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad84360 0x5637cad7f2a0 unknown :-1 s=CLOSED pgs=2502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.102+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/1956345976 >> 172.21.15.6:0/1956345976 conn(0x5637cad83f20 msgr2=0x5637cad84750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.102+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/1956345976 shutdown_connections 2023-10-06T02:30:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.102+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/1956345976 wait complete. 2023-10-06T02:30:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.102+0000 7f09a5ff7b80 1 -- start start 2023-10-06T02:30:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.102+0000 7f09a5ff7b80 1 Processor -- start 2023-10-06T02:30:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.103+0000 7f09a5ff7b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cad84360 0x5637cadcc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.103+0000 7f09a5ff7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad85ab0 0x5637cadb1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.103+0000 7f09a5ff7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cada3ef0 0x5637cadb18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.103+0000 7f09a5ff7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cac7e930 con 0x5637cada3ef0 2023-10-06T02:30:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.103+0000 7f09a5ff7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cac99f40 con 0x5637cad85ab0 2023-10-06T02:30:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.103+0000 7f09a5ff7b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5637cab55ed0 con 0x5637cad84360 2023-10-06T02:30:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.103+0000 7f09a5ff7b80 10 client.0 _ll_register_callbacks cb 0x5637cad460c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:30:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.103+0000 7f0996d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cada3ef0 0x5637cadb18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.103+0000 7f0996d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cada3ef0 0x5637cadb18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54142/0 (socket says 172.21.15.6:54142) 2023-10-06T02:30:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.103+0000 7f0996d9d700 1 -- 172.21.15.6:0/448347770 learned_addr learned my addr 172.21.15.6:0/448347770 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.103+0000 7f0995d9b700 1 --2- 172.21.15.6:0/448347770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad85ab0 0x5637cadb1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.103+0000 7f099659c700 1 --2- 172.21.15.6:0/448347770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cad84360 0x5637cadcc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.103+0000 7f0996d9d700 1 -- 172.21.15.6:0/448347770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cad84360 msgr2=0x5637cadcc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.103+0000 7f0996d9d700 1 --2- 172.21.15.6:0/448347770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cad84360 0x5637cadcc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.103+0000 7f0996d9d700 1 -- 172.21.15.6:0/448347770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad85ab0 msgr2=0x5637cadb1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.103+0000 7f0996d9d700 1 --2- 172.21.15.6:0/448347770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad85ab0 0x5637cadb1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f0996d9d700 1 -- 172.21.15.6:0/448347770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099809a590 con 0x5637cada3ef0 2023-10-06T02:30:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f0995d9b700 1 --2- 172.21.15.6:0/448347770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad85ab0 0x5637cadb1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f0996d9d700 1 --2- 172.21.15.6:0/448347770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cada3ef0 0x5637cadb18a0 secure :-1 s=READY pgs=2503 cs=0 l=1 rev1=1 crypto rx=0x7f0990010630 tx=0x7f0990008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55ae05a6d16f778 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f0974ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:30:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f0974ff9700 1 -- 172.21.15.6:0/448347770 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990014640 con 0x5637cada3ef0 2023-10-06T02:30:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f0974ff9700 1 -- 172.21.15.6:0/448347770 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f09900147a0 con 0x5637cada3ef0 2023-10-06T02:30:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/448347770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5637cad779e0 con 0x5637cada3ef0 2023-10-06T02:30:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f0974ff9700 1 -- 172.21.15.6:0/448347770 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=365) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0990014b70 con 0x5637cada3ef0 2023-10-06T02:30:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f09a5ff7b80 10 client.11268 fetch_fsmap learned FSMap version 365 2023-10-06T02:30:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/448347770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=365,monmap=2+}) v3 -- 0x5637cab10080 con 0x5637cada3ef0 2023-10-06T02:30:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f0974ff9700 1 -- 172.21.15.6:0/448347770 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5637cad779e0 con 0x5637cada3ef0 2023-10-06T02:30:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f0974ff9700 1 -- 172.21.15.6:0/448347770 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 365) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0990014cd0 con 0x5637cada3ef0 2023-10-06T02:30:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f09a5ff7b80 10 client.11268 fetch_fsmap finished waiting for FSMap version 365 2023-10-06T02:30:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f09a5ff7b80 10 client.11268 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:30:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f09a5ff7b80 20 client.11268 populate_metadata read hostname 'smithi006' 2023-10-06T02:30:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/448347770 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x5637cad92de0 0x5637cad931b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f09a5ff7b80 4 client.11268 mds_command: new command op to 11088 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:30:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/448347770 --> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5637cad54910 con 0x5637cad92de0 2023-10-06T02:30:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.104+0000 7f099659c700 1 --2- 172.21.15.6:0/448347770 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x5637cad92de0 0x5637cad931b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.105+0000 7f0974ff9700 10 client.11268 ms_handle_connect on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.105+0000 7f099659c700 1 --2- 172.21.15.6:0/448347770 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x5637cad92de0 0x5637cad931b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb3fd5c42adada19 server_cookie=aa2d6ccd6fd157a7 in_seq=0 out_seq=0 2023-10-06T02:30:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.105+0000 7f0974ff9700 1 -- 172.21.15.6:0/448347770 <== mds.0 v2:172.21.15.6:6833/3837760829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5637cad54910 con 0x5637cad92de0 2023-10-06T02:30:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.105+0000 7f0974ff9700 10 client.11268 handle_command_reply: tid=0 2023-10-06T02:30:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.105+0000 7f09a5ff7b80 1 client.11268 shutdown 2023-10-06T02:30:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.105+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/448347770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cada3ef0 msgr2=0x5637cadb18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.105+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/448347770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cada3ef0 0x5637cadb18a0 secure :-1 s=READY pgs=2503 cs=0 l=1 rev1=1 crypto rx=0x7f0990010630 tx=0x7f0990008040 comp rx=0 tx=0).stop 2023-10-06T02:30:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.105+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/448347770 shutdown_connections 2023-10-06T02:30:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.105+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/448347770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cada3ef0 0x5637cadb18a0 unknown :-1 s=CLOSED pgs=2503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.105+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/448347770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cad84360 0x5637cadcc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.105+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/448347770 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x5637cad92de0 0x5637cad931b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.105+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/448347770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad85ab0 0x5637cadb1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.105+0000 7f0974ff9700 0 client.11268 ms_handle_reset on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.105+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/448347770 >> 172.21.15.6:0/448347770 conn(0x5637cad83f20 msgr2=0x5637cada3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.106+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/448347770 shutdown_connections 2023-10-06T02:30:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.106+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/448347770 wait complete. 2023-10-06T02:30:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.106+0000 7f09a5ff7b80 20 client.11268 trim_cache size 0 max 16384 2023-10-06T02:30:38.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.118+0000 7f09a5ff7b80 1 Processor -- start 2023-10-06T02:30:38.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.118+0000 7f09a5ff7b80 1 -- start start 2023-10-06T02:30:38.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.119+0000 7f09a5ff7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad84360 0x5637cad802b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.119+0000 7f09a5ff7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad85ab0 0x5637cada4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.119+0000 7f09a5ff7b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cada3ef0 0x5637cadabdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.119+0000 7f09a5ff7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cad62380 con 0x5637cad84360 2023-10-06T02:30:38.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.119+0000 7f09a5ff7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cad5b280 con 0x5637cad85ab0 2023-10-06T02:30:38.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.119+0000 7f09a5ff7b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5637cadcccd0 con 0x5637cada3ef0 2023-10-06T02:30:38.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.119+0000 7f099659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad84360 0x5637cad802b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.119+0000 7f099659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad84360 0x5637cad802b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54144/0 (socket says 172.21.15.6:54144) 2023-10-06T02:30:38.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.119+0000 7f099659c700 1 -- 172.21.15.6:0/1444489250 learned_addr learned my addr 172.21.15.6:0/1444489250 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:38.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.119+0000 7f0996d9d700 1 --2- 172.21.15.6:0/1444489250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cada3ef0 0x5637cadabdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.119+0000 7f0995d9b700 1 --2- 172.21.15.6:0/1444489250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad85ab0 0x5637cada4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.119+0000 7f099659c700 1 -- 172.21.15.6:0/1444489250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cada3ef0 msgr2=0x5637cadabdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.119+0000 7f099659c700 1 --2- 172.21.15.6:0/1444489250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cada3ef0 0x5637cadabdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.119+0000 7f099659c700 1 -- 172.21.15.6:0/1444489250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad85ab0 msgr2=0x5637cada4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.119+0000 7f099659c700 1 --2- 172.21.15.6:0/1444489250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad85ab0 0x5637cada4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.119+0000 7f099659c700 1 -- 172.21.15.6:0/1444489250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637caca1820 con 0x5637cad84360 2023-10-06T02:30:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.119+0000 7f0995d9b700 1 --2- 172.21.15.6:0/1444489250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad85ab0 0x5637cada4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.120+0000 7f099659c700 1 --2- 172.21.15.6:0/1444489250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad84360 0x5637cad802b0 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 crypto rx=0x7f0988009010 tx=0x7f0988015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26282c4596450707 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.120+0000 7f0977fff700 1 -- 172.21.15.6:0/1444489250 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988027070 con 0x5637cad84360 2023-10-06T02:30:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.120+0000 7f0977fff700 1 -- 172.21.15.6:0/1444489250 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0988015770 con 0x5637cad84360 2023-10-06T02:30:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.120+0000 7f0977fff700 1 -- 172.21.15.6:0/1444489250 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988015af0 con 0x5637cad84360 2023-10-06T02:30:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.120+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/1444489250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad84360 msgr2=0x5637cad802b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.120+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/1444489250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad84360 0x5637cad802b0 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 crypto rx=0x7f0988009010 tx=0x7f0988015000 comp rx=0 tx=0).stop 2023-10-06T02:30:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.120+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/1444489250 shutdown_connections 2023-10-06T02:30:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.120+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/1444489250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cada3ef0 0x5637cadabdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.120+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/1444489250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad84360 0x5637cad802b0 unknown :-1 s=CLOSED pgs=2504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.120+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/1444489250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad85ab0 0x5637cada4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.120+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/1444489250 >> 172.21.15.6:0/1444489250 conn(0x5637cad83f20 msgr2=0x5637cad92110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.120+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/1444489250 shutdown_connections 2023-10-06T02:30:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.120+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/1444489250 wait complete. 2023-10-06T02:30:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.121+0000 7f09a5ff7b80 1 -- start start 2023-10-06T02:30:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.121+0000 7f09a5ff7b80 1 Processor -- start 2023-10-06T02:30:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f09a5ff7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad84360 0x5637cae31610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f09a5ff7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad85ab0 0x5637cad84960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f09a5ff7b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cada3ef0 0x5637cad84ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f09a5ff7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cae31b50 con 0x5637cad85ab0 2023-10-06T02:30:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f09a5ff7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cae2fbb0 con 0x5637cad84360 2023-10-06T02:30:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f09a5ff7b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5637cae2eab0 con 0x5637cada3ef0 2023-10-06T02:30:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f09a5ff7b80 10 client.0 _ll_register_callbacks cb 0x5637cad460c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:30:38.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f0995d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad85ab0 0x5637cad84960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f0995d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad85ab0 0x5637cad84960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54156/0 (socket says 172.21.15.6:54156) 2023-10-06T02:30:38.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f0995d9b700 1 -- 172.21.15.6:0/3430516404 learned_addr learned my addr 172.21.15.6:0/3430516404 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:38.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f099659c700 1 --2- 172.21.15.6:0/3430516404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad84360 0x5637cae31610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f0996d9d700 1 --2- 172.21.15.6:0/3430516404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cada3ef0 0x5637cad84ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f0995d9b700 1 -- 172.21.15.6:0/3430516404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cada3ef0 msgr2=0x5637cad84ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f0995d9b700 1 --2- 172.21.15.6:0/3430516404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cada3ef0 0x5637cad84ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f0995d9b700 1 -- 172.21.15.6:0/3430516404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad84360 msgr2=0x5637cae31610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f0995d9b700 1 --2- 172.21.15.6:0/3430516404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad84360 0x5637cae31610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f0995d9b700 1 -- 172.21.15.6:0/3430516404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098800f040 con 0x5637cad85ab0 2023-10-06T02:30:38.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f099659c700 1 --2- 172.21.15.6:0/3430516404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad84360 0x5637cae31610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f0995d9b700 1 --2- 172.21.15.6:0/3430516404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad85ab0 0x5637cad84960 secure :-1 s=READY pgs=2505 cs=0 l=1 rev1=1 crypto rx=0x7f0980008010 tx=0x7f098001e020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c8c34d5ffc8494 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f0974ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:30:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.122+0000 7f0974ff9700 1 -- 172.21.15.6:0/3430516404 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09800730d0 con 0x5637cad85ab0 2023-10-06T02:30:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.123+0000 7f0974ff9700 1 -- 172.21.15.6:0/3430516404 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f0980062030 con 0x5637cad85ab0 2023-10-06T02:30:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.123+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/3430516404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0980084e90 con 0x5637cad85ab0 2023-10-06T02:30:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.123+0000 7f0974ff9700 1 -- 172.21.15.6:0/3430516404 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=365) v2 ==== 24+0+0 (secure 0 0 0) 0x7f098005a6d0 con 0x5637cad85ab0 2023-10-06T02:30:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.123+0000 7f09a5ff7b80 10 client.11274 fetch_fsmap learned FSMap version 365 2023-10-06T02:30:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.123+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/3430516404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=365,monmap=2+}) v3 -- 0x5637cac88510 con 0x5637cad85ab0 2023-10-06T02:30:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.123+0000 7f0974ff9700 1 -- 172.21.15.6:0/3430516404 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0980084e90 con 0x5637cad85ab0 2023-10-06T02:30:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.123+0000 7f0974ff9700 1 -- 172.21.15.6:0/3430516404 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 365) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0980056970 con 0x5637cad85ab0 2023-10-06T02:30:38.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.123+0000 7f09a5ff7b80 10 client.11274 fetch_fsmap finished waiting for FSMap version 365 2023-10-06T02:30:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.123+0000 7f09a5ff7b80 10 client.11274 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:30:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.123+0000 7f09a5ff7b80 20 client.11274 populate_metadata read hostname 'smithi006' 2023-10-06T02:30:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.123+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/3430516404 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x5637cadda3e0 0x5637cadda7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.123+0000 7f09a5ff7b80 4 client.11274 mds_command: new command op to 11088 tid=0[{"prefix": "damage ls", "format": "json-pretty"}] 2023-10-06T02:30:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.123+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/3430516404 --> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x5637cac75ea0 con 0x5637cadda3e0 2023-10-06T02:30:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.123+0000 7f099659c700 1 --2- 172.21.15.6:0/3430516404 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x5637cadda3e0 0x5637cadda7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.123+0000 7f0974ff9700 10 client.11274 ms_handle_connect on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.123+0000 7f099659c700 1 --2- 172.21.15.6:0/3430516404 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x5637cadda3e0 0x5637cadda7b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40a080b3d0425746 server_cookie=9ff6c3ed8399dc6d in_seq=0 out_seq=0 2023-10-06T02:30:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f0974ff9700 1 -- 172.21.15.6:0/3430516404 <== mds.0 v2:172.21.15.6:6833/3837760829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+294 (crc 0 0 0) 0x5637cac75ea0 con 0x5637cadda3e0 2023-10-06T02:30:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f0974ff9700 10 client.11274 handle_command_reply: tid=0 2023-10-06T02:30:38.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f09a5ff7b80 1 client.11274 shutdown 2023-10-06T02:30:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/3430516404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad85ab0 msgr2=0x5637cad84960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/3430516404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad85ab0 0x5637cad84960 secure :-1 s=READY pgs=2505 cs=0 l=1 rev1=1 crypto rx=0x7f0980008010 tx=0x7f098001e020 comp rx=0 tx=0).stop 2023-10-06T02:30:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/3430516404 shutdown_connections 2023-10-06T02:30:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/3430516404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5637cada3ef0 0x5637cad84ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/3430516404 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x5637cadda3e0 0x5637cadda7b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/3430516404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637cad84360 0x5637cae31610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f0974ff9700 0 client.11274 ms_handle_reset on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f09a5ff7b80 1 --2- 172.21.15.6:0/3430516404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637cad85ab0 0x5637cad84960 unknown :-1 s=CLOSED pgs=2505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/3430516404 >> 172.21.15.6:0/3430516404 conn(0x5637cad83f20 msgr2=0x5637cada49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/3430516404 shutdown_connections 2023-10-06T02:30:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f09a5ff7b80 1 -- 172.21.15.6:0/3430516404 wait complete. 2023-10-06T02:30:38.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f09a5ff7b80 20 client.11274 trim_cache size 0 max 16384 2023-10-06T02:30:38.133 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:38.133 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-06T02:30:38.133 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:38.133 INFO:teuthology.orchestra.run.smithi006.stdout: "damage_type": "backtrace", 2023-10-06T02:30:38.133 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 1474310137, 2023-10-06T02:30:38.133 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 1099511628279, 2023-10-06T02:30:38.134 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/testdir/hardlink2" 2023-10-06T02:30:38.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-06T02:30:38.134 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-06T02:30:38.134 INFO:teuthology.orchestra.run.smithi006.stdout: "damage_type": "dir_frag", 2023-10-06T02:30:38.134 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 3992430980, 2023-10-06T02:30:38.134 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 1099511628278, 2023-10-06T02:30:38.134 INFO:teuthology.orchestra.run.smithi006.stdout: "frag": "*", 2023-10-06T02:30:38.134 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/dir2" 2023-10-06T02:30:38.134 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-06T02:30:38.134 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-06T02:30:38.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f099759e700 1 -- 172.21.15.6:0/1783246147 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0978066f30 msgr2=0x7f09780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f099759e700 1 --2- 172.21.15.6:0/1783246147 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0978066f30 0x7f09780693e0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f0988007fd0 tx=0x7f0988009040 comp rx=0 tx=0).stop 2023-10-06T02:30:38.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f099759e700 1 -- 172.21.15.6:0/1783246147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0998156fb0 msgr2=0x7f0998147290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f099759e700 1 --2- 172.21.15.6:0/1783246147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0998156fb0 0x7f0998147290 secure :-1 s=READY pgs=2501 cs=0 l=1 rev1=1 crypto rx=0x7f09800030c0 tx=0x7f0980016000 comp rx=0 tx=0).stop 2023-10-06T02:30:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f099759e700 1 -- 172.21.15.6:0/1783246147 shutdown_connections 2023-10-06T02:30:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f099759e700 1 --2- 172.21.15.6:0/1783246147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0998157380 0x7f099809a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f099759e700 1 --2- 172.21.15.6:0/1783246147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09980afc10 0x7f09981531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f099759e700 1 --2- 172.21.15.6:0/1783246147 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f0978066f30 0x7f09780693e0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f099759e700 1 --2- 172.21.15.6:0/1783246147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0998156fb0 0x7f0998147290 unknown :-1 s=CLOSED pgs=2501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.124+0000 7f099759e700 1 -- 172.21.15.6:0/1783246147 >> 172.21.15.6:0/1783246147 conn(0x7f0998096200 msgr2=0x7f0998158b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.125+0000 7f099759e700 1 -- 172.21.15.6:0/1783246147 shutdown_connections 2023-10-06T02:30:38.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.125+0000 7f099759e700 1 -- 172.21.15.6:0/1783246147 wait complete. 2023-10-06T02:30:38.137 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:30:38.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.256+0000 7f01d359e700 1 Processor -- start 2023-10-06T02:30:38.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.256+0000 7f01d359e700 1 -- start start 2023-10-06T02:30:38.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.257+0000 7f01d359e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f01d4159400 0x7f01d40ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.257+0000 7f01d359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f01d40d05d0 0x7f01d40b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.257+0000 7f01d359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d40b3560 con 0x7f01d40cd030 2023-10-06T02:30:38.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.257+0000 7f01d359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d40cf6f0 con 0x7f01d40d05d0 2023-10-06T02:30:38.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.257+0000 7f01d359e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d40cf9d0 con 0x7f01d4159400 2023-10-06T02:30:38.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.257+0000 7f01d2d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f01d40d05d0 0x7f01d40b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.257+0000 7f01d1d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f01d40cd030 0x7f01d40cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59036/0 (socket says 172.21.15.6:59036) 2023-10-06T02:30:38.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.257+0000 7f01d1d9b700 1 -- 172.21.15.6:0/3548504863 learned_addr learned my addr 172.21.15.6:0/3548504863 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:38.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.257+0000 7f01d259c700 1 --2- 172.21.15.6:0/3548504863 >> v2:172.21.15.175:3300/0 conn(0x7f01d4159400 0x7f01d40ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.257+0000 7f01d2d9d700 1 -- 172.21.15.6:0/3548504863 >> v2:172.21.15.175:3300/0 conn(0x7f01d4159400 msgr2=0x7f01d40ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.257+0000 7f01d2d9d700 1 --2- 172.21.15.6:0/3548504863 >> v2:172.21.15.175:3300/0 conn(0x7f01d4159400 0x7f01d40ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.257+0000 7f01d2d9d700 1 -- 172.21.15.6:0/3548504863 >> v1:172.21.15.6:6789/0 conn(0x7f01d40cd030 legacy=0x7f01d40cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.257+0000 7f01d159a700 1 -- 172.21.15.6:0/3548504863 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848775167 0 0) 0x7f01d40b3560 con 0x7f01d40cd030 2023-10-06T02:30:38.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.257+0000 7f01d2d9d700 1 -- 172.21.15.6:0/3548504863 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d40b2f10 con 0x7f01d40d05d0 2023-10-06T02:30:38.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.257+0000 7f01d2d9d700 1 --2- 172.21.15.6:0/3548504863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01d40d05d0 0x7f01d40b39f0 secure :-1 s=READY pgs=2507 cs=0 l=1 rev1=1 crypto rx=0x7f01d4067fc0 tx=0x7f01cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8949ce0b73c7ca31 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.258+0000 7f01d159a700 1 -- 172.21.15.6:0/3548504863 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00e070 con 0x7f01d40d05d0 2023-10-06T02:30:38.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.258+0000 7f01d159a700 1 -- 172.21.15.6:0/3548504863 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc00bc30 con 0x7f01d40d05d0 2023-10-06T02:30:38.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.258+0000 7f01d159a700 1 -- 172.21.15.6:0/3548504863 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc012430 con 0x7f01d40d05d0 2023-10-06T02:30:38.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.258+0000 7f01d359e700 1 -- 172.21.15.6:0/3548504863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01d40d05d0 msgr2=0x7f01d40b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.258+0000 7f01d359e700 1 --2- 172.21.15.6:0/3548504863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01d40d05d0 0x7f01d40b39f0 secure :-1 s=READY pgs=2507 cs=0 l=1 rev1=1 crypto rx=0x7f01d4067fc0 tx=0x7f01cc009780 comp rx=0 tx=0).stop 2023-10-06T02:30:38.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.258+0000 7f01d359e700 1 -- 172.21.15.6:0/3548504863 shutdown_connections 2023-10-06T02:30:38.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.258+0000 7f01d359e700 1 --2- 172.21.15.6:0/3548504863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01d40d05d0 0x7f01d40b39f0 unknown :-1 s=CLOSED pgs=2507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.258+0000 7f01d359e700 1 --2- 172.21.15.6:0/3548504863 >> v2:172.21.15.175:3300/0 conn(0x7f01d4159400 0x7f01d40ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.258+0000 7f01d359e700 1 -- 172.21.15.6:0/3548504863 >> 172.21.15.6:0/3548504863 conn(0x7f01d406ac10 msgr2=0x7f01d4068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:38.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.258+0000 7f01d359e700 1 -- 172.21.15.6:0/3548504863 shutdown_connections 2023-10-06T02:30:38.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.258+0000 7f01d359e700 1 -- 172.21.15.6:0/3548504863 wait complete. 2023-10-06T02:30:38.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.259+0000 7f01d359e700 1 Processor -- start 2023-10-06T02:30:38.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.259+0000 7f01d359e700 1 -- start start 2023-10-06T02:30:38.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.260+0000 7f01d359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01d40cd030 0x7f01d41540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.260+0000 7f01d359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01d40d05d0 0x7f01d40c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.260+0000 7f01d359e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01d4159400 0x7f01d40b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.260+0000 7f01d359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d4154620 con 0x7f01d40d05d0 2023-10-06T02:30:38.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.260+0000 7f01d359e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d40c6640 con 0x7f01d4159400 2023-10-06T02:30:38.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.260+0000 7f01d359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d40c5a30 con 0x7f01d40cd030 2023-10-06T02:30:38.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.260+0000 7f01d1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01d40d05d0 0x7f01d40c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.260+0000 7f01d1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01d40d05d0 0x7f01d40c5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54168/0 (socket says 172.21.15.6:54168) 2023-10-06T02:30:38.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.260+0000 7f01d1d9b700 1 -- 172.21.15.6:0/2112431159 learned_addr learned my addr 172.21.15.6:0/2112431159 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:38.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.260+0000 7f01d259c700 1 --2- 172.21.15.6:0/2112431159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01d40cd030 0x7f01d41540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.260+0000 7f01d2d9d700 1 --2- 172.21.15.6:0/2112431159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01d4159400 0x7f01d40b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.260+0000 7f01d1d9b700 1 -- 172.21.15.6:0/2112431159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01d40cd030 msgr2=0x7f01d41540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.260+0000 7f01d1d9b700 1 --2- 172.21.15.6:0/2112431159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01d40cd030 0x7f01d41540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.260+0000 7f01d1d9b700 1 -- 172.21.15.6:0/2112431159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01d4159400 msgr2=0x7f01d40b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.260+0000 7f01d1d9b700 1 --2- 172.21.15.6:0/2112431159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01d4159400 0x7f01d40b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.260+0000 7f01d1d9b700 1 -- 172.21.15.6:0/2112431159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc009a20 con 0x7f01d40d05d0 2023-10-06T02:30:38.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.260+0000 7f01d259c700 1 --2- 172.21.15.6:0/2112431159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01d40cd030 0x7f01d41540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:38.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.261+0000 7f01d2d9d700 1 --2- 172.21.15.6:0/2112431159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01d4159400 0x7f01d40b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:38.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.261+0000 7f01d1d9b700 1 --2- 172.21.15.6:0/2112431159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01d40d05d0 0x7f01d40c5100 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 crypto rx=0x7f01c800c7e0 tx=0x7f01c8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.261+0000 7f01c27fc700 1 -- 172.21.15.6:0/2112431159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8005b30 con 0x7f01d40d05d0 2023-10-06T02:30:38.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.261+0000 7f01c27fc700 1 -- 172.21.15.6:0/2112431159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c8005c90 con 0x7f01d40d05d0 2023-10-06T02:30:38.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.261+0000 7f01d359e700 1 -- 172.21.15.6:0/2112431159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d40c5d10 con 0x7f01d40d05d0 2023-10-06T02:30:38.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.261+0000 7f01c27fc700 1 -- 172.21.15.6:0/2112431159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8007300 con 0x7f01d40d05d0 2023-10-06T02:30:38.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.261+0000 7f01d359e700 1 -- 172.21.15.6:0/2112431159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d40c62d0 con 0x7f01d40d05d0 2023-10-06T02:30:38.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.262+0000 7f01d359e700 1 -- 172.21.15.6:0/2112431159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d40c6780 con 0x7f01d40d05d0 2023-10-06T02:30:38.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.262+0000 7f01c27fc700 1 -- 172.21.15.6:0/2112431159 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f01c801b400 con 0x7f01d40d05d0 2023-10-06T02:30:38.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.263+0000 7f01c27fc700 1 --2- 172.21.15.6:0/2112431159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f01b4066f30 0x7f01b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.263+0000 7f01c27fc700 1 -- 172.21.15.6:0/2112431159 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f01c80843e0 con 0x7f01d40d05d0 2023-10-06T02:30:38.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.263+0000 7f01d259c700 1 --2- 172.21.15.6:0/2112431159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f01b4066f30 0x7f01b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.263+0000 7f01d259c700 1 --2- 172.21.15.6:0/2112431159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f01b4066f30 0x7f01b40693e0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f01c4006aa0 tx=0x7f01c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.267+0000 7f01c27fc700 1 -- 172.21.15.6:0/2112431159 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01c8051320 con 0x7f01d40d05d0 2023-10-06T02:30:38.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.508+0000 7f01d359e700 1 -- 172.21.15.6:0/2112431159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01d40b3280 con 0x7f01d40d05d0 2023-10-06T02:30:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.508+0000 7f01c27fc700 1 -- 172.21.15.6:0/2112431159 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 365 v365) v1 ==== 95+0+4608 (secure 0 0 0) 0x7f01c8054940 con 0x7f01d40d05d0 2023-10-06T02:30:38.509 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:38.509 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":365,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3603762205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3603762205},{"type":"v1","addr":"172.21.15.175:6836","nonce":3603762205}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":9820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3292446255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3292446255},{"type":"v1","addr":"172.21.15.175:6837","nonce":3292446255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":10869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/759655214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":759655214},{"type":"v1","addr":"172.21.15.6:6834","nonce":759655214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354}],"filesystems":[{"mdsmap":{"epoch":365,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:30:06.715272+0000","modified":"2023-10-06T02:30:32.062334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11088":{"gid":11088,"name":"c","rank":0,"incarnation":362,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/3837760829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3837760829},{"type":"v1","addr":"172.21.15.6:6835","nonce":3837760829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:30:38.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.510+0000 7f01d359e700 1 -- 172.21.15.6:0/2112431159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f01b4066f30 msgr2=0x7f01b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.510+0000 7f01d359e700 1 --2- 172.21.15.6:0/2112431159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f01b4066f30 0x7f01b40693e0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f01c4006aa0 tx=0x7f01c4008040 comp rx=0 tx=0).stop 2023-10-06T02:30:38.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.510+0000 7f01d359e700 1 -- 172.21.15.6:0/2112431159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01d40d05d0 msgr2=0x7f01d40c5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.510+0000 7f01d359e700 1 --2- 172.21.15.6:0/2112431159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01d40d05d0 0x7f01d40c5100 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 crypto rx=0x7f01c800c7e0 tx=0x7f01c8007df0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.510+0000 7f01d359e700 1 -- 172.21.15.6:0/2112431159 shutdown_connections 2023-10-06T02:30:38.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.510+0000 7f01d359e700 1 --2- 172.21.15.6:0/2112431159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01d4159400 0x7f01d40b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.510+0000 7f01d359e700 1 --2- 172.21.15.6:0/2112431159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01d40cd030 0x7f01d41540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.510+0000 7f01d359e700 1 --2- 172.21.15.6:0/2112431159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f01b4066f30 0x7f01b40693e0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.510+0000 7f01d359e700 1 --2- 172.21.15.6:0/2112431159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01d40d05d0 0x7f01d40c5100 unknown :-1 s=CLOSED pgs=2508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.510+0000 7f01d359e700 1 -- 172.21.15.6:0/2112431159 >> 172.21.15.6:0/2112431159 conn(0x7f01d406ac10 msgr2=0x7f01d40b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:38.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.511+0000 7f01d359e700 1 -- 172.21.15.6:0/2112431159 shutdown_connections 2023-10-06T02:30:38.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.511+0000 7f01d359e700 1 -- 172.21.15.6:0/2112431159 wait complete. 2023-10-06T02:30:38.513 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 365 2023-10-06T02:30:38.524 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 1474310137 2023-10-06T02:30:38.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.645+0000 7f57eb56b700 1 Processor -- start 2023-10-06T02:30:38.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.646+0000 7f57eb56b700 1 -- start start 2023-10-06T02:30:38.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.646+0000 7f57eb56b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57e415a030 0x7f57e415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.646+0000 7f57eb56b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f57e415a940 0x7f57e4086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.646+0000 7f57eb56b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e4087960 con 0x7f57e4087530 2023-10-06T02:30:38.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.646+0000 7f57eb56b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e40b0cf0 con 0x7f57e415a940 2023-10-06T02:30:38.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.646+0000 7f57eb56b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e40afc50 con 0x7f57e415a030 2023-10-06T02:30:38.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.646+0000 7f57e8b06700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f57e415a940 0x7f57e4086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.647+0000 7f57e9b08700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f57e4087530 0x7f57e40b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51480/0 (socket says 172.21.15.6:51480) 2023-10-06T02:30:38.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.647+0000 7f57e9b08700 1 -- 172.21.15.6:0/2164955656 learned_addr learned my addr 172.21.15.6:0/2164955656 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:38.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.647+0000 7f57e9307700 1 --2- 172.21.15.6:0/2164955656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57e415a030 0x7f57e415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.647+0000 7f57e8b06700 1 -- 172.21.15.6:0/2164955656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57e415a030 msgr2=0x7f57e415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.647+0000 7f57e8b06700 1 --2- 172.21.15.6:0/2164955656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57e415a030 0x7f57e415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.647+0000 7f57e8b06700 1 -- 172.21.15.6:0/2164955656 >> v1:172.21.15.6:6789/0 conn(0x7f57e4087530 legacy=0x7f57e40b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.647+0000 7f57e8b06700 1 -- 172.21.15.6:0/2164955656 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e40aff30 con 0x7f57e415a940 2023-10-06T02:30:38.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.647+0000 7f57e3fff700 1 -- 172.21.15.6:0/2164955656 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006150730 0 0) 0x7f57e4087960 con 0x7f57e4087530 2023-10-06T02:30:38.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.647+0000 7f57e9307700 1 --2- 172.21.15.6:0/2164955656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57e415a030 0x7f57e415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:38.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.647+0000 7f57e8b06700 1 --2- 172.21.15.6:0/2164955656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e415a940 0x7f57e4086ff0 secure :-1 s=READY pgs=2510 cs=0 l=1 rev1=1 crypto rx=0x7f57d80098e0 tx=0x7f57d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff7eb731b289985 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.647+0000 7f57e3fff700 1 -- 172.21.15.6:0/2164955656 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8009e80 con 0x7f57e415a940 2023-10-06T02:30:38.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.647+0000 7f57e3fff700 1 -- 172.21.15.6:0/2164955656 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d800b860 con 0x7f57e415a940 2023-10-06T02:30:38.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.647+0000 7f57e3fff700 1 -- 172.21.15.6:0/2164955656 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d800bbe0 con 0x7f57e415a940 2023-10-06T02:30:38.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.648+0000 7f57eb56b700 1 -- 172.21.15.6:0/2164955656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e415a940 msgr2=0x7f57e4086ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.648+0000 7f57eb56b700 1 --2- 172.21.15.6:0/2164955656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e415a940 0x7f57e4086ff0 secure :-1 s=READY pgs=2510 cs=0 l=1 rev1=1 crypto rx=0x7f57d80098e0 tx=0x7f57d80091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.648+0000 7f57eb56b700 1 -- 172.21.15.6:0/2164955656 shutdown_connections 2023-10-06T02:30:38.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.648+0000 7f57eb56b700 1 --2- 172.21.15.6:0/2164955656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57e415a030 0x7f57e415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.648+0000 7f57eb56b700 1 --2- 172.21.15.6:0/2164955656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e415a940 0x7f57e4086ff0 unknown :-1 s=CLOSED pgs=2510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.648+0000 7f57eb56b700 1 -- 172.21.15.6:0/2164955656 >> 172.21.15.6:0/2164955656 conn(0x7f57e4068680 msgr2=0x7f57e4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:38.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.648+0000 7f57eb56b700 1 -- 172.21.15.6:0/2164955656 shutdown_connections 2023-10-06T02:30:38.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.648+0000 7f57eb56b700 1 -- 172.21.15.6:0/2164955656 wait complete. 2023-10-06T02:30:38.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.649+0000 7f57eb56b700 1 Processor -- start 2023-10-06T02:30:38.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.649+0000 7f57eb56b700 1 -- start start 2023-10-06T02:30:38.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57eb56b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57e4087530 0x7f57e416a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57eb56b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e415a030 0x7f57e41558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57eb56b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57e415a940 0x7f57e40c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57eb56b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e4155e20 con 0x7f57e415a030 2023-10-06T02:30:38.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57eb56b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e40c6570 con 0x7f57e4087530 2023-10-06T02:30:38.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57eb56b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e40c6850 con 0x7f57e415a940 2023-10-06T02:30:38.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57e8b06700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e415a030 0x7f57e41558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57e8b06700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e415a030 0x7f57e41558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37360/0 (socket says 172.21.15.6:37360) 2023-10-06T02:30:38.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57e8b06700 1 -- 172.21.15.6:0/3030883289 learned_addr learned my addr 172.21.15.6:0/3030883289 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:38.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57e9b08700 1 --2- 172.21.15.6:0/3030883289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57e415a940 0x7f57e40c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57e9307700 1 --2- 172.21.15.6:0/3030883289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57e4087530 0x7f57e416a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57e8b06700 1 -- 172.21.15.6:0/3030883289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57e415a940 msgr2=0x7f57e40c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57e8b06700 1 --2- 172.21.15.6:0/3030883289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57e415a940 0x7f57e40c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57e8b06700 1 -- 172.21.15.6:0/3030883289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57e4087530 msgr2=0x7f57e416a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57e8b06700 1 --2- 172.21.15.6:0/3030883289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57e4087530 0x7f57e416a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57e8b06700 1 -- 172.21.15.6:0/3030883289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d8009420 con 0x7f57e415a030 2023-10-06T02:30:38.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57e9b08700 1 --2- 172.21.15.6:0/3030883289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57e415a940 0x7f57e40c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:38.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57e9307700 1 --2- 172.21.15.6:0/3030883289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57e4087530 0x7f57e416a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:38.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57e8b06700 1 --2- 172.21.15.6:0/3030883289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e415a030 0x7f57e41558e0 secure :-1 s=READY pgs=2511 cs=0 l=1 rev1=1 crypto rx=0x7f57d8013000 tx=0x7f57d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57e17fa700 1 -- 172.21.15.6:0/3030883289 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d800b9d0 con 0x7f57e415a030 2023-10-06T02:30:38.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57e17fa700 1 -- 172.21.15.6:0/3030883289 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d800bb50 con 0x7f57e415a030 2023-10-06T02:30:38.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.650+0000 7f57eb56b700 1 -- 172.21.15.6:0/3030883289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e416a060 con 0x7f57e415a030 2023-10-06T02:30:38.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.651+0000 7f57e17fa700 1 -- 172.21.15.6:0/3030883289 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8025670 con 0x7f57e415a030 2023-10-06T02:30:38.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.651+0000 7f57eb56b700 1 -- 172.21.15.6:0/3030883289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e4169d10 con 0x7f57e415a030 2023-10-06T02:30:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.652+0000 7f57e17fa700 1 -- 172.21.15.6:0/3030883289 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57d8023070 con 0x7f57e415a030 2023-10-06T02:30:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.653+0000 7f57e17fa700 1 --2- 172.21.15.6:0/3030883289 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f57d0066f30 0x7f57d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.653+0000 7f57e17fa700 1 -- 172.21.15.6:0/3030883289 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f57d8085f30 con 0x7f57e415a030 2023-10-06T02:30:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.653+0000 7f57e9307700 1 --2- 172.21.15.6:0/3030883289 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f57d0066f30 0x7f57d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.653+0000 7f57e9307700 1 --2- 172.21.15.6:0/3030883289 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f57d0066f30 0x7f57d00693e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f57dc008b20 tx=0x7f57dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.654+0000 7f57f4863b80 1 Processor -- start 2023-10-06T02:30:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.654+0000 7f57f4863b80 1 -- start start 2023-10-06T02:30:38.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.655+0000 7f57f4863b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b548c0 0x55a704b54c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.655+0000 7f57f4863b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704b55d40 0x55a704ba4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.655+0000 7f57f4863b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704ba4c80 0x55a704ba50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.655+0000 7f57f4863b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a704aabaf0 con 0x55a704b548c0 2023-10-06T02:30:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.655+0000 7f57f4863b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a704aa92f0 con 0x55a704b55d40 2023-10-06T02:30:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.655+0000 7f57f4863b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a704aa50e0 con 0x55a704ba4c80 2023-10-06T02:30:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.655+0000 7f57e9307700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b548c0 0x55a704b54c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.655+0000 7f57e9307700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b548c0 0x55a704b54c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37374/0 (socket says 172.21.15.6:37374) 2023-10-06T02:30:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.655+0000 7f57e9307700 1 -- 172.21.15.6:0/3314723133 learned_addr learned my addr 172.21.15.6:0/3314723133 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.655+0000 7f57e8b06700 1 --2- 172.21.15.6:0/3314723133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704b55d40 0x55a704ba4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.655+0000 7f57e9b08700 1 --2- 172.21.15.6:0/3314723133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704ba4c80 0x55a704ba50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.655+0000 7f57e9307700 1 -- 172.21.15.6:0/3314723133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704ba4c80 msgr2=0x55a704ba50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.655+0000 7f57e9307700 1 --2- 172.21.15.6:0/3314723133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704ba4c80 0x55a704ba50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.655+0000 7f57e9307700 1 -- 172.21.15.6:0/3314723133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704b55d40 msgr2=0x55a704ba4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.655+0000 7f57e9307700 1 --2- 172.21.15.6:0/3314723133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704b55d40 0x55a704ba4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.656+0000 7f57e9307700 1 -- 172.21.15.6:0/3314723133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a70493f2f0 con 0x55a704b548c0 2023-10-06T02:30:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.656+0000 7f57e8b06700 1 --2- 172.21.15.6:0/3314723133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704b55d40 0x55a704ba4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.656+0000 7f57e9307700 1 --2- 172.21.15.6:0/3314723133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b548c0 0x55a704b54c90 secure :-1 s=READY pgs=2512 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00dbf0 tx=0x7f57dc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96fe9ffdf17b9fd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.656+0000 7f57ca7fc700 1 -- 172.21.15.6:0/3314723133 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc00b050 con 0x55a704b548c0 2023-10-06T02:30:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.656+0000 7f57ca7fc700 1 -- 172.21.15.6:0/3314723133 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57dc017070 con 0x55a704b548c0 2023-10-06T02:30:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.656+0000 7f57ca7fc700 1 -- 172.21.15.6:0/3314723133 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc012da0 con 0x55a704b548c0 2023-10-06T02:30:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.656+0000 7f57f4863b80 1 -- 172.21.15.6:0/3314723133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b548c0 msgr2=0x55a704b54c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.656+0000 7f57f4863b80 1 --2- 172.21.15.6:0/3314723133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b548c0 0x55a704b54c90 secure :-1 s=READY pgs=2512 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00dbf0 tx=0x7f57dc014000 comp rx=0 tx=0).stop 2023-10-06T02:30:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.656+0000 7f57f4863b80 1 -- 172.21.15.6:0/3314723133 shutdown_connections 2023-10-06T02:30:38.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.656+0000 7f57f4863b80 1 --2- 172.21.15.6:0/3314723133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704ba4c80 0x55a704ba50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.656+0000 7f57f4863b80 1 --2- 172.21.15.6:0/3314723133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b548c0 0x55a704b54c90 unknown :-1 s=CLOSED pgs=2512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.656+0000 7f57f4863b80 1 --2- 172.21.15.6:0/3314723133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704b55d40 0x55a704ba4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.656+0000 7f57f4863b80 1 -- 172.21.15.6:0/3314723133 >> 172.21.15.6:0/3314723133 conn(0x55a704b561e0 msgr2=0x55a704b565b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:38.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.656+0000 7f57f4863b80 1 -- 172.21.15.6:0/3314723133 shutdown_connections 2023-10-06T02:30:38.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.656+0000 7f57f4863b80 1 -- 172.21.15.6:0/3314723133 wait complete. 2023-10-06T02:30:38.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.657+0000 7f57f4863b80 1 -- start start 2023-10-06T02:30:38.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.657+0000 7f57f4863b80 1 Processor -- start 2023-10-06T02:30:38.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.658+0000 7f57f4863b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704b548c0 0x55a704b7dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.658+0000 7f57f4863b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704b55d40 0x55a704b81a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.658+0000 7f57f4863b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704ba4c80 0x55a704b983d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.658+0000 7f57f4863b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a704a50910 con 0x55a704ba4c80 2023-10-06T02:30:38.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.658+0000 7f57f4863b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a704a6bf20 con 0x55a704b55d40 2023-10-06T02:30:38.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.658+0000 7f57f4863b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a704927eb0 con 0x55a704b548c0 2023-10-06T02:30:38.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.658+0000 7f57f4863b80 10 client.0 _ll_register_callbacks cb 0x55a704b17ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:30:38.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.658+0000 7f57e9b08700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704ba4c80 0x55a704b983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.658+0000 7f57e9b08700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704ba4c80 0x55a704b983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37378/0 (socket says 172.21.15.6:37378) 2023-10-06T02:30:38.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.658+0000 7f57e9b08700 1 -- 172.21.15.6:0/2881368486 learned_addr learned my addr 172.21.15.6:0/2881368486 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:38.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.658+0000 7f57e9307700 1 --2- 172.21.15.6:0/2881368486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704b548c0 0x55a704b7dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.658+0000 7f57e8b06700 1 --2- 172.21.15.6:0/2881368486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704b55d40 0x55a704b81a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.658+0000 7f57e9b08700 1 -- 172.21.15.6:0/2881368486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704b548c0 msgr2=0x55a704b7dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.658+0000 7f57e9b08700 1 --2- 172.21.15.6:0/2881368486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704b548c0 0x55a704b7dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.658+0000 7f57e9b08700 1 -- 172.21.15.6:0/2881368486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704b55d40 msgr2=0x55a704b81a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.658+0000 7f57e9b08700 1 --2- 172.21.15.6:0/2881368486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704b55d40 0x55a704b81a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.658+0000 7f57e9b08700 1 -- 172.21.15.6:0/2881368486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc00d7f0 con 0x55a704ba4c80 2023-10-06T02:30:38.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.659+0000 7f57e9b08700 1 --2- 172.21.15.6:0/2881368486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704ba4c80 0x55a704b983d0 secure :-1 s=READY pgs=2513 cs=0 l=1 rev1=1 crypto rx=0x7f57d40077b0 tx=0x7f57d4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28adbfeeaba7d2a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.659+0000 7f57c37fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:30:38.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.659+0000 7f57c37fe700 1 -- 172.21.15.6:0/2881368486 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d400f8d0 con 0x55a704ba4c80 2023-10-06T02:30:38.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.659+0000 7f57c37fe700 1 -- 172.21.15.6:0/2881368486 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f57d400fa30 con 0x55a704ba4c80 2023-10-06T02:30:38.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.659+0000 7f57f4863b80 1 -- 172.21.15.6:0/2881368486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a704b499c0 con 0x55a704ba4c80 2023-10-06T02:30:38.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.659+0000 7f57c37fe700 1 -- 172.21.15.6:0/2881368486 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=365) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57d400fe00 con 0x55a704ba4c80 2023-10-06T02:30:38.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.659+0000 7f57f4863b80 10 client.11298 fetch_fsmap learned FSMap version 365 2023-10-06T02:30:38.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.659+0000 7f57f4863b80 1 -- 172.21.15.6:0/2881368486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=365,monmap=2+}) v3 -- 0x55a7048e2060 con 0x55a704ba4c80 2023-10-06T02:30:38.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.659+0000 7f57c37fe700 1 -- 172.21.15.6:0/2881368486 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a704b499c0 con 0x55a704ba4c80 2023-10-06T02:30:38.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.659+0000 7f57c37fe700 1 -- 172.21.15.6:0/2881368486 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 365) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f57d4012070 con 0x55a704ba4c80 2023-10-06T02:30:38.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.659+0000 7f57f4863b80 10 client.11298 fetch_fsmap finished waiting for FSMap version 365 2023-10-06T02:30:38.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.659+0000 7f57f4863b80 10 client.11298 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:30:38.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.659+0000 7f57f4863b80 20 client.11298 populate_metadata read hostname 'smithi006' 2023-10-06T02:30:38.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.659+0000 7f57f4863b80 1 --2- 172.21.15.6:0/2881368486 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55a704b94030 0x55a704b94400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.659+0000 7f57f4863b80 4 client.11298 mds_command: new command op to 11088 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:30:38.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.659+0000 7f57f4863b80 1 -- 172.21.15.6:0/2881368486 --> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a704b268f0 con 0x55a704b94030 2023-10-06T02:30:38.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.659+0000 7f57e9307700 1 --2- 172.21.15.6:0/2881368486 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55a704b94030 0x55a704b94400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.660+0000 7f57c37fe700 10 client.11298 ms_handle_connect on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:38.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.660+0000 7f57e9307700 1 --2- 172.21.15.6:0/2881368486 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55a704b94030 0x55a704b94400 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3480c735132a6d79 server_cookie=9dd3dd0309591af3 in_seq=0 out_seq=0 2023-10-06T02:30:38.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.660+0000 7f57c37fe700 1 -- 172.21.15.6:0/2881368486 <== mds.0 v2:172.21.15.6:6833/3837760829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a704b268f0 con 0x55a704b94030 2023-10-06T02:30:38.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.660+0000 7f57c37fe700 10 client.11298 handle_command_reply: tid=0 2023-10-06T02:30:38.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.660+0000 7f57f4863b80 1 client.11298 shutdown 2023-10-06T02:30:38.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.660+0000 7f57f4863b80 1 -- 172.21.15.6:0/2881368486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704ba4c80 msgr2=0x55a704b983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.660+0000 7f57f4863b80 1 --2- 172.21.15.6:0/2881368486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704ba4c80 0x55a704b983d0 secure :-1 s=READY pgs=2513 cs=0 l=1 rev1=1 crypto rx=0x7f57d40077b0 tx=0x7f57d4009040 comp rx=0 tx=0).stop 2023-10-06T02:30:38.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.660+0000 7f57f4863b80 1 -- 172.21.15.6:0/2881368486 shutdown_connections 2023-10-06T02:30:38.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.660+0000 7f57f4863b80 1 --2- 172.21.15.6:0/2881368486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704ba4c80 0x55a704b983d0 unknown :-1 s=CLOSED pgs=2513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.660+0000 7f57f4863b80 1 --2- 172.21.15.6:0/2881368486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704b548c0 0x55a704b7dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.660+0000 7f57f4863b80 1 --2- 172.21.15.6:0/2881368486 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55a704b94030 0x55a704b94400 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.660+0000 7f57f4863b80 1 --2- 172.21.15.6:0/2881368486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704b55d40 0x55a704b81a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.660+0000 7f57c37fe700 0 client.11298 ms_handle_reset on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:38.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.660+0000 7f57f4863b80 1 -- 172.21.15.6:0/2881368486 >> 172.21.15.6:0/2881368486 conn(0x55a704b561e0 msgr2=0x55a704b55230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:38.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.661+0000 7f57f4863b80 1 -- 172.21.15.6:0/2881368486 shutdown_connections 2023-10-06T02:30:38.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.661+0000 7f57f4863b80 1 -- 172.21.15.6:0/2881368486 wait complete. 2023-10-06T02:30:38.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.661+0000 7f57f4863b80 20 client.11298 trim_cache size 0 max 16384 2023-10-06T02:30:38.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.673+0000 7f57f4863b80 1 Processor -- start 2023-10-06T02:30:38.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.673+0000 7f57f4863b80 1 -- start start 2023-10-06T02:30:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.674+0000 7f57f4863b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704b548c0 0x55a704b80e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.674+0000 7f57f4863b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b55d40 0x55a704b81360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.674+0000 7f57f4863b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704ba4c80 0x55a704b55230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.674+0000 7f57f4863b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a704b7dc50 con 0x55a704b55d40 2023-10-06T02:30:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.674+0000 7f57f4863b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a704b840e0 con 0x55a704ba4c80 2023-10-06T02:30:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.674+0000 7f57f4863b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a704b4f6a0 con 0x55a704b548c0 2023-10-06T02:30:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.674+0000 7f57e8b06700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b55d40 0x55a704b81360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.674+0000 7f57e8b06700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b55d40 0x55a704b81360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37380/0 (socket says 172.21.15.6:37380) 2023-10-06T02:30:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.674+0000 7f57e8b06700 1 -- 172.21.15.6:0/1964918648 learned_addr learned my addr 172.21.15.6:0/1964918648 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:38.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.674+0000 7f57e8b06700 1 -- 172.21.15.6:0/1964918648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704b548c0 msgr2=0x55a704b80e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.674+0000 7f57e8b06700 1 --2- 172.21.15.6:0/1964918648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704b548c0 0x55a704b80e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57e9b08700 1 --2- 172.21.15.6:0/1964918648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704ba4c80 0x55a704b55230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57e8b06700 1 -- 172.21.15.6:0/1964918648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704ba4c80 msgr2=0x55a704b55230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57e8b06700 1 --2- 172.21.15.6:0/1964918648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704ba4c80 0x55a704b55230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57e8b06700 1 -- 172.21.15.6:0/1964918648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a704ba4a70 con 0x55a704b55d40 2023-10-06T02:30:38.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57e9b08700 1 --2- 172.21.15.6:0/1964918648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704ba4c80 0x55a704b55230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:38.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57e8b06700 1 --2- 172.21.15.6:0/1964918648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b55d40 0x55a704b81360 secure :-1 s=READY pgs=2514 cs=0 l=1 rev1=1 crypto rx=0x7f57d8056830 tx=0x7f57d8059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4bc36090e1e144 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57caffd700 1 -- 172.21.15.6:0/1964918648 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8056b30 con 0x55a704b55d40 2023-10-06T02:30:38.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57caffd700 1 -- 172.21.15.6:0/1964918648 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d8059d80 con 0x55a704b55d40 2023-10-06T02:30:38.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57caffd700 1 -- 172.21.15.6:0/1964918648 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d805dad0 con 0x55a704b55d40 2023-10-06T02:30:38.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57f4863b80 1 -- 172.21.15.6:0/1964918648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b55d40 msgr2=0x55a704b81360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57f4863b80 1 --2- 172.21.15.6:0/1964918648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b55d40 0x55a704b81360 secure :-1 s=READY pgs=2514 cs=0 l=1 rev1=1 crypto rx=0x7f57d8056830 tx=0x7f57d8059040 comp rx=0 tx=0).stop 2023-10-06T02:30:38.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57f4863b80 1 -- 172.21.15.6:0/1964918648 shutdown_connections 2023-10-06T02:30:38.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57f4863b80 1 --2- 172.21.15.6:0/1964918648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704ba4c80 0x55a704b55230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57f4863b80 1 --2- 172.21.15.6:0/1964918648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704b548c0 0x55a704b80e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57f4863b80 1 --2- 172.21.15.6:0/1964918648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b55d40 0x55a704b81360 unknown :-1 s=CLOSED pgs=2514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57f4863b80 1 -- 172.21.15.6:0/1964918648 >> 172.21.15.6:0/1964918648 conn(0x55a704b561e0 msgr2=0x55a704b4d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:38.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57f4863b80 1 -- 172.21.15.6:0/1964918648 shutdown_connections 2023-10-06T02:30:38.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.675+0000 7f57f4863b80 1 -- 172.21.15.6:0/1964918648 wait complete. 2023-10-06T02:30:38.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.676+0000 7f57f4863b80 1 -- start start 2023-10-06T02:30:38.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.676+0000 7f57f4863b80 1 Processor -- start 2023-10-06T02:30:38.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57f4863b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b548c0 0x55a704b7c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57f4863b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704b55d40 0x55a704b9e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57f4863b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704ba4c80 0x55a704c00570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57f4863b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a704b9e980 con 0x55a704b548c0 2023-10-06T02:30:38.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57f4863b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a704c025b0 con 0x55a704b55d40 2023-10-06T02:30:38.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57f4863b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a704b83e30 con 0x55a704ba4c80 2023-10-06T02:30:38.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57f4863b80 10 client.0 _ll_register_callbacks cb 0x55a704b17ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:30:38.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57e9307700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b548c0 0x55a704b7c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57e9307700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b548c0 0x55a704b7c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37396/0 (socket says 172.21.15.6:37396) 2023-10-06T02:30:38.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57e9307700 1 -- 172.21.15.6:0/1712426103 learned_addr learned my addr 172.21.15.6:0/1712426103 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:38.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57e8b06700 1 --2- 172.21.15.6:0/1712426103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704b55d40 0x55a704b9e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57e9b08700 1 --2- 172.21.15.6:0/1712426103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704ba4c80 0x55a704c00570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57e9307700 1 -- 172.21.15.6:0/1712426103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704ba4c80 msgr2=0x55a704c00570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57e9307700 1 --2- 172.21.15.6:0/1712426103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704ba4c80 0x55a704c00570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57e9307700 1 -- 172.21.15.6:0/1712426103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704b55d40 msgr2=0x55a704b9e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57e9307700 1 --2- 172.21.15.6:0/1712426103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704b55d40 0x55a704b9e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57e9307700 1 -- 172.21.15.6:0/1712426103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e4169d10 con 0x55a704b548c0 2023-10-06T02:30:38.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57e8b06700 1 --2- 172.21.15.6:0/1712426103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704b55d40 0x55a704b9e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:38.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57e9307700 1 --2- 172.21.15.6:0/1712426103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b548c0 0x55a704b7c540 secure :-1 s=READY pgs=2515 cs=0 l=1 rev1=1 crypto rx=0x7f57dc020040 tx=0x7f57dc02b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d02998817524ee7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57c37fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:30:38.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.677+0000 7f57c37fe700 1 -- 172.21.15.6:0/1712426103 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc00b040 con 0x55a704b548c0 2023-10-06T02:30:38.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.678+0000 7f57c37fe700 1 -- 172.21.15.6:0/1712426103 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f57dc01e650 con 0x55a704b548c0 2023-10-06T02:30:38.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.678+0000 7f57f4863b80 1 -- 172.21.15.6:0/1712426103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f57dc017070 con 0x55a704b548c0 2023-10-06T02:30:38.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.678+0000 7f57c37fe700 1 -- 172.21.15.6:0/1712426103 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=365) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57dc01ea60 con 0x55a704b548c0 2023-10-06T02:30:38.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.678+0000 7f57f4863b80 10 client.11304 fetch_fsmap learned FSMap version 365 2023-10-06T02:30:38.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.678+0000 7f57f4863b80 1 -- 172.21.15.6:0/1712426103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=365,monmap=2+}) v3 -- 0x55a704a73800 con 0x55a704b548c0 2023-10-06T02:30:38.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.678+0000 7f57c37fe700 1 -- 172.21.15.6:0/1712426103 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57dc017070 con 0x55a704b548c0 2023-10-06T02:30:38.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.678+0000 7f57c37fe700 1 -- 172.21.15.6:0/1712426103 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 365) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f57dc01ebc0 con 0x55a704b548c0 2023-10-06T02:30:38.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.678+0000 7f57f4863b80 10 client.11304 fetch_fsmap finished waiting for FSMap version 365 2023-10-06T02:30:38.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.678+0000 7f57f4863b80 10 client.11304 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:30:38.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.678+0000 7f57f4863b80 20 client.11304 populate_metadata read hostname 'smithi006' 2023-10-06T02:30:38.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.678+0000 7f57f4863b80 1 --2- 172.21.15.6:0/1712426103 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55a704b800c0 0x55a704b80490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.678+0000 7f57f4863b80 4 client.11304 mds_command: new command op to 11088 tid=0[{"prefix": "damage rm", "damage_id": 1474310137}] 2023-10-06T02:30:38.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.678+0000 7f57f4863b80 1 -- 172.21.15.6:0/1712426103 --> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] -- command(tid 0: {"prefix": "damage rm", "damage_id": 1474310137}) v1 -- 0x55a704a47e80 con 0x55a704b800c0 2023-10-06T02:30:38.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.678+0000 7f57e8b06700 1 --2- 172.21.15.6:0/1712426103 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55a704b800c0 0x55a704b80490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.678+0000 7f57c37fe700 10 client.11304 ms_handle_connect on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:38.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.678+0000 7f57e8b06700 1 --2- 172.21.15.6:0/1712426103 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55a704b800c0 0x55a704b80490 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c9f1b4ab0f7b0e1 server_cookie=b8596eb60d83ece5 in_seq=0 out_seq=0 2023-10-06T02:30:38.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57c37fe700 1 -- 172.21.15.6:0/1712426103 <== mds.0 v2:172.21.15.6:6833/3837760829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+0 (crc 0 0 0) 0x55a704a47e80 con 0x55a704b800c0 2023-10-06T02:30:38.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57c37fe700 10 client.11304 handle_command_reply: tid=0 2023-10-06T02:30:38.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57f4863b80 1 client.11304 shutdown 2023-10-06T02:30:38.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57f4863b80 1 -- 172.21.15.6:0/1712426103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b548c0 msgr2=0x55a704b7c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57f4863b80 1 --2- 172.21.15.6:0/1712426103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b548c0 0x55a704b7c540 secure :-1 s=READY pgs=2515 cs=0 l=1 rev1=1 crypto rx=0x7f57dc020040 tx=0x7f57dc02b040 comp rx=0 tx=0).stop 2023-10-06T02:30:38.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57f4863b80 1 -- 172.21.15.6:0/1712426103 shutdown_connections 2023-10-06T02:30:38.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57f4863b80 1 --2- 172.21.15.6:0/1712426103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a704ba4c80 0x55a704c00570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57f4863b80 1 --2- 172.21.15.6:0/1712426103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a704b548c0 0x55a704b7c540 unknown :-1 s=CLOSED pgs=2515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57f4863b80 1 --2- 172.21.15.6:0/1712426103 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x55a704b800c0 0x55a704b80490 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57f4863b80 1 --2- 172.21.15.6:0/1712426103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a704b55d40 0x55a704b9e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57c37fe700 0 client.11304 ms_handle_reset on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:38.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57f4863b80 1 -- 172.21.15.6:0/1712426103 >> 172.21.15.6:0/1712426103 conn(0x55a704b561e0 msgr2=0x55a704b981e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:38.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57f4863b80 1 -- 172.21.15.6:0/1712426103 shutdown_connections 2023-10-06T02:30:38.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57f4863b80 1 -- 172.21.15.6:0/1712426103 wait complete. 2023-10-06T02:30:38.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57f4863b80 20 client.11304 trim_cache size 0 max 16384 2023-10-06T02:30:38.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57eb56b700 1 -- 172.21.15.6:0/3030883289 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f57d0066f30 msgr2=0x7f57d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57eb56b700 1 --2- 172.21.15.6:0/3030883289 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f57d0066f30 0x7f57d00693e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f57dc008b20 tx=0x7f57dc008040 comp rx=0 tx=0).stop 2023-10-06T02:30:38.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57eb56b700 1 -- 172.21.15.6:0/3030883289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e415a030 msgr2=0x7f57e41558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.679+0000 7f57eb56b700 1 --2- 172.21.15.6:0/3030883289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e415a030 0x7f57e41558e0 secure :-1 s=READY pgs=2511 cs=0 l=1 rev1=1 crypto rx=0x7f57d8013000 tx=0x7f57d8017000 comp rx=0 tx=0).stop 2023-10-06T02:30:38.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.680+0000 7f57eb56b700 1 -- 172.21.15.6:0/3030883289 shutdown_connections 2023-10-06T02:30:38.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.680+0000 7f57eb56b700 1 --2- 172.21.15.6:0/3030883289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57e415a940 0x7f57e40c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.680+0000 7f57eb56b700 1 --2- 172.21.15.6:0/3030883289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57e4087530 0x7f57e416a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.680+0000 7f57eb56b700 1 --2- 172.21.15.6:0/3030883289 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f57d0066f30 0x7f57d00693e0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.680+0000 7f57eb56b700 1 --2- 172.21.15.6:0/3030883289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e415a030 0x7f57e41558e0 unknown :-1 s=CLOSED pgs=2511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.680+0000 7f57eb56b700 1 -- 172.21.15.6:0/3030883289 >> 172.21.15.6:0/3030883289 conn(0x7f57e4068680 msgr2=0x7f57e4158f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:38.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.680+0000 7f57eb56b700 1 -- 172.21.15.6:0/3030883289 shutdown_connections 2023-10-06T02:30:38.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.680+0000 7f57eb56b700 1 -- 172.21.15.6:0/3030883289 wait complete. 2023-10-06T02:30:38.692 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:30:38.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.810+0000 7f2a14efe700 1 Processor -- start 2023-10-06T02:30:38.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.810+0000 7f2a14efe700 1 -- start start 2023-10-06T02:30:38.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.811+0000 7f2a14efe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2a100af4e0 0x7f2a100b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.811+0000 7f2a14efe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2a100af8b0 0x7f2a100b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.811+0000 7f2a14efe700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a1015e190 con 0x7f2a1015d460 2023-10-06T02:30:38.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.811+0000 7f2a14efe700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a100b1910 con 0x7f2a100af4e0 2023-10-06T02:30:38.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.811+0000 7f2a14efe700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a1015dfa0 con 0x7f2a100af8b0 2023-10-06T02:30:38.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.811+0000 7f2a0e59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2a100af4e0 0x7f2a100b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.811+0000 7f2a0ed9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2a1015d460 0x7f2a1015d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51484/0 (socket says 172.21.15.6:51484) 2023-10-06T02:30:38.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.811+0000 7f2a0ed9d700 1 -- 172.21.15.6:0/2441982866 learned_addr learned my addr 172.21.15.6:0/2441982866 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:38.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.812+0000 7f2a0dd9b700 1 --2- 172.21.15.6:0/2441982866 >> v2:172.21.15.175:3300/0 conn(0x7f2a100af8b0 0x7f2a100b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.812+0000 7f2a0e59c700 1 -- 172.21.15.6:0/2441982866 >> v2:172.21.15.175:3300/0 conn(0x7f2a100af8b0 msgr2=0x7f2a100b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:38.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.812+0000 7f2a0e59c700 1 --2- 172.21.15.6:0/2441982866 >> v2:172.21.15.175:3300/0 conn(0x7f2a100af8b0 0x7f2a100b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.812+0000 7f2a0e59c700 1 -- 172.21.15.6:0/2441982866 >> v1:172.21.15.6:6789/0 conn(0x7f2a1015d460 legacy=0x7f2a1015d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.812+0000 7f2a0d59a700 1 -- 172.21.15.6:0/2441982866 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790183303 0 0) 0x7f2a1015e190 con 0x7f2a1015d460 2023-10-06T02:30:38.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.812+0000 7f2a0e59c700 1 -- 172.21.15.6:0/2441982866 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a100cb650 con 0x7f2a100af4e0 2023-10-06T02:30:38.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.812+0000 7f2a0dd9b700 1 --2- 172.21.15.6:0/2441982866 >> v2:172.21.15.175:3300/0 conn(0x7f2a100af8b0 0x7f2a100b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:38.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.812+0000 7f2a0e59c700 1 --2- 172.21.15.6:0/2441982866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a100af4e0 0x7f2a100b20e0 secure :-1 s=READY pgs=2517 cs=0 l=1 rev1=1 crypto rx=0x7f2a100cdd50 tx=0x7f2a080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c999213ca248f044 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.812+0000 7f2a0d59a700 1 -- 172.21.15.6:0/2441982866 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0800b6b0 con 0x7f2a100af4e0 2023-10-06T02:30:38.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.812+0000 7f2a0d59a700 1 -- 172.21.15.6:0/2441982866 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0800b810 con 0x7f2a100af4e0 2023-10-06T02:30:38.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.812+0000 7f2a0d59a700 1 -- 172.21.15.6:0/2441982866 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0800bbb0 con 0x7f2a100af4e0 2023-10-06T02:30:38.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.812+0000 7f2a14efe700 1 -- 172.21.15.6:0/2441982866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a100af4e0 msgr2=0x7f2a100b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.812+0000 7f2a14efe700 1 --2- 172.21.15.6:0/2441982866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a100af4e0 0x7f2a100b20e0 secure :-1 s=READY pgs=2517 cs=0 l=1 rev1=1 crypto rx=0x7f2a100cdd50 tx=0x7f2a080091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.813+0000 7f2a14efe700 1 -- 172.21.15.6:0/2441982866 shutdown_connections 2023-10-06T02:30:38.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.813+0000 7f2a14efe700 1 --2- 172.21.15.6:0/2441982866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a100af4e0 0x7f2a100b20e0 unknown :-1 s=CLOSED pgs=2517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.813+0000 7f2a14efe700 1 --2- 172.21.15.6:0/2441982866 >> v2:172.21.15.175:3300/0 conn(0x7f2a100af8b0 0x7f2a100b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.813+0000 7f2a14efe700 1 -- 172.21.15.6:0/2441982866 >> 172.21.15.6:0/2441982866 conn(0x7f2a10068680 msgr2=0x7f2a10068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:38.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.813+0000 7f2a14efe700 1 -- 172.21.15.6:0/2441982866 shutdown_connections 2023-10-06T02:30:38.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.813+0000 7f2a14efe700 1 -- 172.21.15.6:0/2441982866 wait complete. 2023-10-06T02:30:38.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.814+0000 7f2a14efe700 1 Processor -- start 2023-10-06T02:30:38.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.814+0000 7f2a14efe700 1 -- start start 2023-10-06T02:30:38.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.814+0000 7f2a14efe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a100af4e0 0x7f2a10152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.814+0000 7f2a14efe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a100af8b0 0x7f2a10150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.814+0000 7f2a14efe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a1015d460 0x7f2a10154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.814+0000 7f2a14efe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a10152750 con 0x7f2a1015d460 2023-10-06T02:30:38.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.814+0000 7f2a14efe700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a100c9840 con 0x7f2a100af8b0 2023-10-06T02:30:38.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.814+0000 7f2a14efe700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a10154630 con 0x7f2a100af4e0 2023-10-06T02:30:38.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.815+0000 7f2a0ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a1015d460 0x7f2a10154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.815+0000 7f2a0ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a1015d460 0x7f2a10154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37404/0 (socket says 172.21.15.6:37404) 2023-10-06T02:30:38.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.815+0000 7f2a0ed9d700 1 -- 172.21.15.6:0/1605179630 learned_addr learned my addr 172.21.15.6:0/1605179630 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:38.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.815+0000 7f2a0e59c700 1 --2- 172.21.15.6:0/1605179630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a100af4e0 0x7f2a10152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.815+0000 7f2a0dd9b700 1 --2- 172.21.15.6:0/1605179630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a100af8b0 0x7f2a10150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.815+0000 7f2a0ed9d700 1 -- 172.21.15.6:0/1605179630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a100af4e0 msgr2=0x7f2a10152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.815+0000 7f2a0ed9d700 1 --2- 172.21.15.6:0/1605179630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a100af4e0 0x7f2a10152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.815+0000 7f2a0ed9d700 1 -- 172.21.15.6:0/1605179630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a100af8b0 msgr2=0x7f2a10150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:38.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.815+0000 7f2a0ed9d700 1 --2- 172.21.15.6:0/1605179630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a100af8b0 0x7f2a10150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:38.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.815+0000 7f2a0ed9d700 1 -- 172.21.15.6:0/1605179630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a08009420 con 0x7f2a1015d460 2023-10-06T02:30:38.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.815+0000 7f2a0dd9b700 1 --2- 172.21.15.6:0/1605179630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a100af8b0 0x7f2a10150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:38.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.815+0000 7f2a0ed9d700 1 --2- 172.21.15.6:0/1605179630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a1015d460 0x7f2a10154b10 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000ccc0 tx=0x7f2a00001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.815+0000 7f2a067fc700 1 -- 172.21.15.6:0/1605179630 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0000a8f0 con 0x7f2a1015d460 2023-10-06T02:30:38.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.815+0000 7f2a067fc700 1 -- 172.21.15.6:0/1605179630 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0000aa50 con 0x7f2a1015d460 2023-10-06T02:30:38.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.815+0000 7f2a14efe700 1 -- 172.21.15.6:0/1605179630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a101514b0 con 0x7f2a1015d460 2023-10-06T02:30:38.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.815+0000 7f2a067fc700 1 -- 172.21.15.6:0/1605179630 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0000ae10 con 0x7f2a1015d460 2023-10-06T02:30:38.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.815+0000 7f2a14efe700 1 -- 172.21.15.6:0/1605179630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a100ca3f0 con 0x7f2a1015d460 2023-10-06T02:30:38.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.816+0000 7f2a14efe700 1 -- 172.21.15.6:0/1605179630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a10154830 con 0x7f2a1015d460 2023-10-06T02:30:38.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.817+0000 7f2a067fc700 1 -- 172.21.15.6:0/1605179630 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a00007300 con 0x7f2a1015d460 2023-10-06T02:30:38.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.817+0000 7f2a067fc700 1 --2- 172.21.15.6:0/1605179630 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f29f0066f30 0x7f29f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:38.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.817+0000 7f2a067fc700 1 -- 172.21.15.6:0/1605179630 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f2a00084bd0 con 0x7f2a1015d460 2023-10-06T02:30:38.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.817+0000 7f2a0e59c700 1 --2- 172.21.15.6:0/1605179630 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f29f0066f30 0x7f29f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:38.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.818+0000 7f2a0e59c700 1 --2- 172.21.15.6:0/1605179630 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f29f0066f30 0x7f29f00693e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f2a080093f0 tx=0x7f2a08017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:38.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:38.821+0000 7f2a067fc700 1 -- 172.21.15.6:0/1605179630 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a00051b90 con 0x7f2a1015d460 2023-10-06T02:30:39.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.059+0000 7f2a14efe700 1 -- 172.21.15.6:0/1605179630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a100b0910 con 0x7f2a1015d460 2023-10-06T02:30:39.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.060+0000 7f2a067fc700 1 -- 172.21.15.6:0/1605179630 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 365 v365) v1 ==== 95+0+4608 (secure 0 0 0) 0x7f2a000551b0 con 0x7f2a1015d460 2023-10-06T02:30:39.061 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:39.061 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":365,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3603762205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3603762205},{"type":"v1","addr":"172.21.15.175:6836","nonce":3603762205}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":9820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3292446255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3292446255},{"type":"v1","addr":"172.21.15.175:6837","nonce":3292446255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":10869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/759655214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":759655214},{"type":"v1","addr":"172.21.15.6:6834","nonce":759655214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354}],"filesystems":[{"mdsmap":{"epoch":365,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:30:06.715272+0000","modified":"2023-10-06T02:30:32.062334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11088":{"gid":11088,"name":"c","rank":0,"incarnation":362,"state":"up:active","state_seq":4,"addr":"172.21.15.6:6835/3837760829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3837760829},{"type":"v1","addr":"172.21.15.6:6835","nonce":3837760829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:30:39.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.062+0000 7f2a14efe700 1 -- 172.21.15.6:0/1605179630 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f29f0066f30 msgr2=0x7f29f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:39.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.062+0000 7f2a14efe700 1 --2- 172.21.15.6:0/1605179630 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f29f0066f30 0x7f29f00693e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f2a080093f0 tx=0x7f2a08017000 comp rx=0 tx=0).stop 2023-10-06T02:30:39.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.062+0000 7f2a14efe700 1 -- 172.21.15.6:0/1605179630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a1015d460 msgr2=0x7f2a10154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:39.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.062+0000 7f2a14efe700 1 --2- 172.21.15.6:0/1605179630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a1015d460 0x7f2a10154b10 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000ccc0 tx=0x7f2a00001a80 comp rx=0 tx=0).stop 2023-10-06T02:30:39.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.062+0000 7f2a14efe700 1 -- 172.21.15.6:0/1605179630 shutdown_connections 2023-10-06T02:30:39.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.062+0000 7f2a14efe700 1 --2- 172.21.15.6:0/1605179630 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f29f0066f30 0x7f29f00693e0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.062+0000 7f2a14efe700 1 --2- 172.21.15.6:0/1605179630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a1015d460 0x7f2a10154b10 unknown :-1 s=CLOSED pgs=2518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.062+0000 7f2a14efe700 1 --2- 172.21.15.6:0/1605179630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a100af4e0 0x7f2a10152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.062+0000 7f2a14efe700 1 --2- 172.21.15.6:0/1605179630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a100af8b0 0x7f2a10150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.062+0000 7f2a14efe700 1 -- 172.21.15.6:0/1605179630 >> 172.21.15.6:0/1605179630 conn(0x7f2a10068680 msgr2=0x7f2a100b5630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:39.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.062+0000 7f2a14efe700 1 -- 172.21.15.6:0/1605179630 shutdown_connections 2023-10-06T02:30:39.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.062+0000 7f2a14efe700 1 -- 172.21.15.6:0/1605179630 wait complete. 2023-10-06T02:30:39.064 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 365 2023-10-06T02:30:39.075 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 3992430980 2023-10-06T02:30:39.086 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:30:39.085+0000 7fc34f931700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-06T02:30:39.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.196+0000 7ff3e889f700 1 Processor -- start 2023-10-06T02:30:39.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.196+0000 7ff3e889f700 1 -- start start 2023-10-06T02:30:39.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.197+0000 7ff3e889f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff3e415a030 0x7ff3e415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.197+0000 7ff3e889f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3e415a940 0x7ff3e4086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.197+0000 7ff3e889f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e40afc50 con 0x7ff3e4087530 2023-10-06T02:30:39.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.197+0000 7ff3e889f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e40b0cf0 con 0x7ff3e415a030 2023-10-06T02:30:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.197+0000 7ff3e889f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e40879b0 con 0x7ff3e415a940 2023-10-06T02:30:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.197+0000 7ff3e259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff3e415a030 0x7ff3e415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.197+0000 7ff3e259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff3e415a030 0x7ff3e415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37414/0 (socket says 172.21.15.6:37414) 2023-10-06T02:30:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.197+0000 7ff3e259c700 1 -- 172.21.15.6:0/1546016824 learned_addr learned my addr 172.21.15.6:0/1546016824 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.197+0000 7ff3e1d9b700 1 --2- 172.21.15.6:0/1546016824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3e415a940 0x7ff3e4086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.197+0000 7ff3e259c700 1 -- 172.21.15.6:0/1546016824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3e415a940 msgr2=0x7ff3e4086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.197+0000 7ff3e259c700 1 --2- 172.21.15.6:0/1546016824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3e415a940 0x7ff3e4086ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.197+0000 7ff3e259c700 1 -- 172.21.15.6:0/1546016824 >> v1:172.21.15.175:6789/0 conn(0x7ff3e4087530 legacy=0x7ff3e40b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.197+0000 7ff3e259c700 1 -- 172.21.15.6:0/1546016824 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e40aff30 con 0x7ff3e415a030 2023-10-06T02:30:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.197+0000 7ff3e259c700 1 --2- 172.21.15.6:0/1546016824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e415a030 0x7ff3e415a400 secure :-1 s=READY pgs=2519 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40099e0 tx=0x7ff3d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d933bbebc2218581 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.197+0000 7ff3e159a700 1 -- 172.21.15.6:0/1546016824 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d400b7e0 con 0x7ff3e415a030 2023-10-06T02:30:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.197+0000 7ff3e159a700 1 -- 172.21.15.6:0/1546016824 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d400b940 con 0x7ff3e415a030 2023-10-06T02:30:39.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.198+0000 7ff3e159a700 1 -- 172.21.15.6:0/1546016824 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d400bce0 con 0x7ff3e415a030 2023-10-06T02:30:39.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.198+0000 7ff3e889f700 1 -- 172.21.15.6:0/1546016824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e415a030 msgr2=0x7ff3e415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:39.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.198+0000 7ff3e889f700 1 --2- 172.21.15.6:0/1546016824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e415a030 0x7ff3e415a400 secure :-1 s=READY pgs=2519 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40099e0 tx=0x7ff3d4009250 comp rx=0 tx=0).stop 2023-10-06T02:30:39.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.198+0000 7ff3e889f700 1 -- 172.21.15.6:0/1546016824 shutdown_connections 2023-10-06T02:30:39.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.198+0000 7ff3e889f700 1 --2- 172.21.15.6:0/1546016824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e415a030 0x7ff3e415a400 unknown :-1 s=CLOSED pgs=2519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.198+0000 7ff3e889f700 1 --2- 172.21.15.6:0/1546016824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3e415a940 0x7ff3e4086ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.198+0000 7ff3e889f700 1 -- 172.21.15.6:0/1546016824 >> 172.21.15.6:0/1546016824 conn(0x7ff3e4068680 msgr2=0x7ff3e4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:39.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.198+0000 7ff3e889f700 1 -- 172.21.15.6:0/1546016824 shutdown_connections 2023-10-06T02:30:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.198+0000 7ff3e889f700 1 -- 172.21.15.6:0/1546016824 wait complete. 2023-10-06T02:30:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.199+0000 7ff3e889f700 1 Processor -- start 2023-10-06T02:30:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.199+0000 7ff3e889f700 1 -- start start 2023-10-06T02:30:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.200+0000 7ff3e889f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e4087530 0x7ff3e415ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.200+0000 7ff3e889f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3e415a030 0x7ff3e415ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.200+0000 7ff3e889f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e415a940 0x7ff3e415d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.200+0000 7ff3e889f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e41566c0 con 0x7ff3e415a940 2023-10-06T02:30:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.200+0000 7ff3e889f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e415b2a0 con 0x7ff3e4087530 2023-10-06T02:30:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.200+0000 7ff3e889f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e415c050 con 0x7ff3e415a030 2023-10-06T02:30:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.200+0000 7ff3e2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e415a940 0x7ff3e415d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.200+0000 7ff3e2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e415a940 0x7ff3e415d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37424/0 (socket says 172.21.15.6:37424) 2023-10-06T02:30:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.200+0000 7ff3e2d9d700 1 -- 172.21.15.6:0/2422844159 learned_addr learned my addr 172.21.15.6:0/2422844159 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.200+0000 7ff3e259c700 1 --2- 172.21.15.6:0/2422844159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e4087530 0x7ff3e415ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.200+0000 7ff3e1d9b700 1 --2- 172.21.15.6:0/2422844159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3e415a030 0x7ff3e415ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.200+0000 7ff3e2d9d700 1 -- 172.21.15.6:0/2422844159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3e415a030 msgr2=0x7ff3e415ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.200+0000 7ff3e2d9d700 1 --2- 172.21.15.6:0/2422844159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3e415a030 0x7ff3e415ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.200+0000 7ff3e2d9d700 1 -- 172.21.15.6:0/2422844159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e4087530 msgr2=0x7ff3e415ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.200+0000 7ff3e2d9d700 1 --2- 172.21.15.6:0/2422844159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e4087530 0x7ff3e415ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.200+0000 7ff3e2d9d700 1 -- 172.21.15.6:0/2422844159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d40094f0 con 0x7ff3e415a940 2023-10-06T02:30:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.201+0000 7ff3e2d9d700 1 --2- 172.21.15.6:0/2422844159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e415a940 0x7ff3e415d210 secure :-1 s=READY pgs=2520 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c940 tx=0x7ff3dc002720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.201+0000 7ff3d27fc700 1 -- 172.21.15.6:0/2422844159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc012630 con 0x7ff3e415a940 2023-10-06T02:30:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.201+0000 7ff3d27fc700 1 -- 172.21.15.6:0/2422844159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc0127b0 con 0x7ff3e415a940 2023-10-06T02:30:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.201+0000 7ff3e889f700 1 -- 172.21.15.6:0/2422844159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e415b4d0 con 0x7ff3e415a940 2023-10-06T02:30:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.201+0000 7ff3d27fc700 1 -- 172.21.15.6:0/2422844159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc012b70 con 0x7ff3e415a940 2023-10-06T02:30:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.201+0000 7ff3e889f700 1 -- 172.21.15.6:0/2422844159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e415ba90 con 0x7ff3e415a940 2023-10-06T02:30:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.202+0000 7ff3d27fc700 1 -- 172.21.15.6:0/2422844159 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff3dc01b400 con 0x7ff3e415a940 2023-10-06T02:30:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.203+0000 7ff3d27fc700 1 --2- 172.21.15.6:0/2422844159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff3c4066f30 0x7ff3c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.203+0000 7ff3d27fc700 1 -- 172.21.15.6:0/2422844159 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7ff3dc084a80 con 0x7ff3e415a940 2023-10-06T02:30:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.203+0000 7ff3e259c700 1 --2- 172.21.15.6:0/2422844159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff3c4066f30 0x7ff3c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.204+0000 7ff3e259c700 1 --2- 172.21.15.6:0/2422844159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff3c4066f30 0x7ff3c40693e0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40099e0 tx=0x7ff3d4016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.205+0000 7ff3f1b97b80 1 Processor -- start 2023-10-06T02:30:39.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.205+0000 7ff3f1b97b80 1 -- start start 2023-10-06T02:30:39.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3f1b97b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c298c0 0x5571b4c29c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3f1b97b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c2ad40 0x5571b4c79740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3f1b97b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c79c80 0x5571b4c7a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3f1b97b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b4b80af0 con 0x5571b4c298c0 2023-10-06T02:30:39.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3f1b97b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b4b7e2f0 con 0x5571b4c79c80 2023-10-06T02:30:39.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3f1b97b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571b4b7a0e0 con 0x5571b4c2ad40 2023-10-06T02:30:39.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3e259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c298c0 0x5571b4c29c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3e259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c298c0 0x5571b4c29c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37436/0 (socket says 172.21.15.6:37436) 2023-10-06T02:30:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3e259c700 1 -- 172.21.15.6:0/4263079781 learned_addr learned my addr 172.21.15.6:0/4263079781 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3e1d9b700 1 --2- 172.21.15.6:0/4263079781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c2ad40 0x5571b4c79740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3e2d9d700 1 --2- 172.21.15.6:0/4263079781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c79c80 0x5571b4c7a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3e259c700 1 -- 172.21.15.6:0/4263079781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c2ad40 msgr2=0x5571b4c79740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3e259c700 1 --2- 172.21.15.6:0/4263079781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c2ad40 0x5571b4c79740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3e259c700 1 -- 172.21.15.6:0/4263079781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c79c80 msgr2=0x5571b4c7a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3e259c700 1 --2- 172.21.15.6:0/4263079781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c79c80 0x5571b4c7a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3e259c700 1 -- 172.21.15.6:0/4263079781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571b4a142f0 con 0x5571b4c298c0 2023-10-06T02:30:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3e1d9b700 1 --2- 172.21.15.6:0/4263079781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c2ad40 0x5571b4c79740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3e259c700 1 --2- 172.21.15.6:0/4263079781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c298c0 0x5571b4c29c90 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400b3c0 tx=0x7ff3d4021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8950d4da0e4b6d69 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3c37fe700 1 -- 172.21.15.6:0/4263079781 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4021070 con 0x5571b4c298c0 2023-10-06T02:30:39.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3c37fe700 1 -- 172.21.15.6:0/4263079781 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d4011ac0 con 0x5571b4c298c0 2023-10-06T02:30:39.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.206+0000 7ff3c37fe700 1 -- 172.21.15.6:0/4263079781 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4011c30 con 0x5571b4c298c0 2023-10-06T02:30:39.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.207+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/4263079781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c298c0 msgr2=0x5571b4c29c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:39.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.207+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/4263079781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c298c0 0x5571b4c29c90 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400b3c0 tx=0x7ff3d4021000 comp rx=0 tx=0).stop 2023-10-06T02:30:39.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.207+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/4263079781 shutdown_connections 2023-10-06T02:30:39.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.207+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/4263079781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c79c80 0x5571b4c7a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.207+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/4263079781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c298c0 0x5571b4c29c90 unknown :-1 s=CLOSED pgs=2521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.207+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/4263079781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c2ad40 0x5571b4c79740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.207+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/4263079781 >> 172.21.15.6:0/4263079781 conn(0x5571b4c2b1e0 msgr2=0x5571b4c2b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.207+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/4263079781 shutdown_connections 2023-10-06T02:30:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.207+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/4263079781 wait complete. 2023-10-06T02:30:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.208+0000 7ff3f1b97b80 1 -- start start 2023-10-06T02:30:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.208+0000 7ff3f1b97b80 1 Processor -- start 2023-10-06T02:30:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3f1b97b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c298c0 0x5571b4c6db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3f1b97b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c2ad40 0x5571b4c6b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3f1b97b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c79c80 0x5571b4c54d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3f1b97b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b4b25910 con 0x5571b4c298c0 2023-10-06T02:30:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3f1b97b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b4b40f20 con 0x5571b4c79c80 2023-10-06T02:30:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3f1b97b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571b49fceb0 con 0x5571b4c2ad40 2023-10-06T02:30:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3f1b97b80 10 client.0 _ll_register_callbacks cb 0x5571b4becef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:30:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3e259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c298c0 0x5571b4c6db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3e259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c298c0 0x5571b4c6db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37448/0 (socket says 172.21.15.6:37448) 2023-10-06T02:30:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3e259c700 1 -- 172.21.15.6:0/378814909 learned_addr learned my addr 172.21.15.6:0/378814909 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3e1d9b700 1 --2- 172.21.15.6:0/378814909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c2ad40 0x5571b4c6b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3e2d9d700 1 --2- 172.21.15.6:0/378814909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c79c80 0x5571b4c54d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3e259c700 1 -- 172.21.15.6:0/378814909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c2ad40 msgr2=0x5571b4c6b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3e259c700 1 --2- 172.21.15.6:0/378814909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c2ad40 0x5571b4c6b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3e259c700 1 -- 172.21.15.6:0/378814909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c79c80 msgr2=0x5571b4c54d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3e259c700 1 --2- 172.21.15.6:0/378814909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c79c80 0x5571b4c54d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3e259c700 1 -- 172.21.15.6:0/378814909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e40aff30 con 0x5571b4c298c0 2023-10-06T02:30:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3e259c700 1 --2- 172.21.15.6:0/378814909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c298c0 0x5571b4c6db60 secure :-1 s=READY pgs=2522 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4011910 tx=0x7ff3d402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1acf5155d6b9c28 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.209+0000 7ff3c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:30:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.210+0000 7ff3c0ff9700 1 -- 172.21.15.6:0/378814909 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4021040 con 0x5571b4c298c0 2023-10-06T02:30:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.210+0000 7ff3c0ff9700 1 -- 172.21.15.6:0/378814909 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7ff3d401b860 con 0x5571b4c298c0 2023-10-06T02:30:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.210+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/378814909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571b4c1e9c0 con 0x5571b4c298c0 2023-10-06T02:30:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.210+0000 7ff3c0ff9700 1 -- 172.21.15.6:0/378814909 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=366) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3d401bc70 con 0x5571b4c298c0 2023-10-06T02:30:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.210+0000 7ff3f1b97b80 10 client.11325 fetch_fsmap learned FSMap version 366 2023-10-06T02:30:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.210+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/378814909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=366,monmap=2+}) v3 -- 0x5571b49b7060 con 0x5571b4c298c0 2023-10-06T02:30:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.210+0000 7ff3c0ff9700 1 -- 172.21.15.6:0/378814909 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5571b4c1e9c0 con 0x5571b4c298c0 2023-10-06T02:30:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.210+0000 7ff3c0ff9700 1 -- 172.21.15.6:0/378814909 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 366) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff3d4041250 con 0x5571b4c298c0 2023-10-06T02:30:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.210+0000 7ff3f1b97b80 10 client.11325 fetch_fsmap finished waiting for FSMap version 366 2023-10-06T02:30:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.210+0000 7ff3f1b97b80 10 client.11325 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:30:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.210+0000 7ff3f1b97b80 20 client.11325 populate_metadata read hostname 'smithi006' 2023-10-06T02:30:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.210+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/378814909 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x5571b4c69dc0 0x5571b4c6a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.210+0000 7ff3f1b97b80 4 client.11325 mds_command: new command op to 11088 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:30:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.210+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/378814909 --> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571b4bfb8f0 con 0x5571b4c69dc0 2023-10-06T02:30:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.210+0000 7ff3e1d9b700 1 --2- 172.21.15.6:0/378814909 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x5571b4c69dc0 0x5571b4c6a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.210+0000 7ff3c0ff9700 10 client.11325 ms_handle_connect on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.210+0000 7ff3e1d9b700 1 --2- 172.21.15.6:0/378814909 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x5571b4c69dc0 0x5571b4c6a190 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aed74893b46135ab server_cookie=4c756f8132029350 in_seq=0 out_seq=0 2023-10-06T02:30:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.211+0000 7ff3c0ff9700 1 -- 172.21.15.6:0/378814909 <== mds.0 v2:172.21.15.6:6833/3837760829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5571b4bfb8f0 con 0x5571b4c69dc0 2023-10-06T02:30:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.211+0000 7ff3c0ff9700 10 client.11325 handle_command_reply: tid=0 2023-10-06T02:30:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.211+0000 7ff3f1b97b80 1 client.11325 shutdown 2023-10-06T02:30:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.211+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/378814909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c298c0 msgr2=0x5571b4c6db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.211+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/378814909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c298c0 0x5571b4c6db60 secure :-1 s=READY pgs=2522 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4011910 tx=0x7ff3d402c040 comp rx=0 tx=0).stop 2023-10-06T02:30:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.211+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/378814909 shutdown_connections 2023-10-06T02:30:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.211+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/378814909 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x5571b4c69dc0 0x5571b4c6a190 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.211+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/378814909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c79c80 0x5571b4c54d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.211+0000 7ff3c0ff9700 0 client.11325 ms_handle_reset on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.211+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/378814909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c298c0 0x5571b4c6db60 unknown :-1 s=CLOSED pgs=2522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.211+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/378814909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c2ad40 0x5571b4c6b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.211+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/378814909 >> 172.21.15.6:0/378814909 conn(0x5571b4c2b1e0 msgr2=0x5571b4c2a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.211+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/378814909 shutdown_connections 2023-10-06T02:30:39.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.211+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/378814909 wait complete. 2023-10-06T02:30:39.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.212+0000 7ff3f1b97b80 20 client.11325 trim_cache size 0 max 16384 2023-10-06T02:30:39.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.224+0000 7ff3f1b97b80 1 Processor -- start 2023-10-06T02:30:39.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.224+0000 7ff3f1b97b80 1 -- start start 2023-10-06T02:30:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3f1b97b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c298c0 0x5571b4c2a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3f1b97b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c2ad40 0x5571b4c6d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3f1b97b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c79c80 0x5571b4c26aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3f1b97b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b4c2d210 con 0x5571b4c2ad40 2023-10-06T02:30:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3f1b97b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b4c7fe10 con 0x5571b4c298c0 2023-10-06T02:30:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3f1b97b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571b4c73920 con 0x5571b4c79c80 2023-10-06T02:30:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3e1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c2ad40 0x5571b4c6d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3e1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c2ad40 0x5571b4c6d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37462/0 (socket says 172.21.15.6:37462) 2023-10-06T02:30:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3e1d9b700 1 -- 172.21.15.6:0/1217149271 learned_addr learned my addr 172.21.15.6:0/1217149271 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3e2d9d700 1 --2- 172.21.15.6:0/1217149271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c79c80 0x5571b4c26aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3e259c700 1 --2- 172.21.15.6:0/1217149271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c298c0 0x5571b4c2a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3e1d9b700 1 -- 172.21.15.6:0/1217149271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c79c80 msgr2=0x5571b4c26aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3e1d9b700 1 --2- 172.21.15.6:0/1217149271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c79c80 0x5571b4c26aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3e1d9b700 1 -- 172.21.15.6:0/1217149271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c298c0 msgr2=0x5571b4c2a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3e1d9b700 1 --2- 172.21.15.6:0/1217149271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c298c0 0x5571b4c2a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3e1d9b700 1 -- 172.21.15.6:0/1217149271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571b4b48800 con 0x5571b4c2ad40 2023-10-06T02:30:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3e259c700 1 --2- 172.21.15.6:0/1217149271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c298c0 0x5571b4c2a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.225+0000 7ff3e1d9b700 1 --2- 172.21.15.6:0/1217149271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c2ad40 0x5571b4c6d9b0 secure :-1 s=READY pgs=2523 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8000c00 tx=0x7ff3d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d72e2600d436df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.226+0000 7ff3c3fff700 1 -- 172.21.15.6:0/1217149271 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d801b040 con 0x5571b4c2ad40 2023-10-06T02:30:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.226+0000 7ff3c3fff700 1 -- 172.21.15.6:0/1217149271 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d8015c20 con 0x5571b4c2ad40 2023-10-06T02:30:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.226+0000 7ff3c3fff700 1 -- 172.21.15.6:0/1217149271 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8016430 con 0x5571b4c2ad40 2023-10-06T02:30:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.226+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/1217149271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c2ad40 msgr2=0x5571b4c6d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.226+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/1217149271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c2ad40 0x5571b4c6d9b0 secure :-1 s=READY pgs=2523 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8000c00 tx=0x7ff3d8008040 comp rx=0 tx=0).stop 2023-10-06T02:30:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.226+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/1217149271 shutdown_connections 2023-10-06T02:30:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.226+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/1217149271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c79c80 0x5571b4c26aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.226+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/1217149271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c298c0 0x5571b4c2a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.226+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/1217149271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c2ad40 0x5571b4c6d9b0 unknown :-1 s=CLOSED pgs=2523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.226+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/1217149271 >> 172.21.15.6:0/1217149271 conn(0x5571b4c2b1e0 msgr2=0x5571b4c52db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.226+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/1217149271 shutdown_connections 2023-10-06T02:30:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.226+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/1217149271 wait complete. 2023-10-06T02:30:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.227+0000 7ff3f1b97b80 1 -- start start 2023-10-06T02:30:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.227+0000 7ff3f1b97b80 1 Processor -- start 2023-10-06T02:30:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3f1b97b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c298c0 0x5571b4cd6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3f1b97b80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c2ad40 0x5571b4cd5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3f1b97b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c79c80 0x5571b4c82040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3f1b97b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b4c82dd0 con 0x5571b4c79c80 2023-10-06T02:30:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3f1b97b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b4c7f0d0 con 0x5571b4c298c0 2023-10-06T02:30:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3f1b97b80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571b4cd5db0 con 0x5571b4c2ad40 2023-10-06T02:30:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3f1b97b80 10 client.0 _ll_register_callbacks cb 0x5571b4becef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:30:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3e2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c79c80 0x5571b4c82040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3e2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c79c80 0x5571b4c82040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37464/0 (socket says 172.21.15.6:37464) 2023-10-06T02:30:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3e2d9d700 1 -- 172.21.15.6:0/586170519 learned_addr learned my addr 172.21.15.6:0/586170519 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3e1d9b700 1 --2- 172.21.15.6:0/586170519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c2ad40 0x5571b4cd5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3e259c700 1 --2- 172.21.15.6:0/586170519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c298c0 0x5571b4cd6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3e2d9d700 1 -- 172.21.15.6:0/586170519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c2ad40 msgr2=0x5571b4cd5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3e2d9d700 1 --2- 172.21.15.6:0/586170519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c2ad40 0x5571b4cd5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3e2d9d700 1 -- 172.21.15.6:0/586170519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c298c0 msgr2=0x5571b4cd6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3e2d9d700 1 --2- 172.21.15.6:0/586170519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c298c0 0x5571b4cd6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3e2d9d700 1 -- 172.21.15.6:0/586170519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d800e040 con 0x5571b4c79c80 2023-10-06T02:30:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3e2d9d700 1 --2- 172.21.15.6:0/586170519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c79c80 0x5571b4c82040 secure :-1 s=READY pgs=2524 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc055360 tx=0x7ff3dc014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0ea30d39ae8d07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-06T02:30:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3c0ff9700 1 -- 172.21.15.6:0/586170519 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc054b50 con 0x5571b4c79c80 2023-10-06T02:30:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3c0ff9700 1 -- 172.21.15.6:0/586170519 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7ff3dc054cb0 con 0x5571b4c79c80 2023-10-06T02:30:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.228+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/586170519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff3d4011ac0 con 0x5571b4c79c80 2023-10-06T02:30:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.229+0000 7ff3c0ff9700 1 -- 172.21.15.6:0/586170519 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=366) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3dc002230 con 0x5571b4c79c80 2023-10-06T02:30:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.229+0000 7ff3f1b97b80 10 client.11331 fetch_fsmap learned FSMap version 366 2023-10-06T02:30:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.229+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/586170519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=366,monmap=2+}) v3 -- 0x5571b4b2f4f0 con 0x5571b4c79c80 2023-10-06T02:30:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.229+0000 7ff3c0ff9700 1 -- 172.21.15.6:0/586170519 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc060070 con 0x5571b4c79c80 2023-10-06T02:30:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.229+0000 7ff3c0ff9700 1 -- 172.21.15.6:0/586170519 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 366) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff3dc05c170 con 0x5571b4c79c80 2023-10-06T02:30:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.229+0000 7ff3f1b97b80 10 client.11331 fetch_fsmap finished waiting for FSMap version 366 2023-10-06T02:30:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.229+0000 7ff3f1b97b80 10 client.11331 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:30:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.229+0000 7ff3f1b97b80 20 client.11331 populate_metadata read hostname 'smithi006' 2023-10-06T02:30:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.229+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/586170519 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x5571b4c2b790 0x5571b4c2bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.229+0000 7ff3f1b97b80 4 client.11331 mds_command: new command op to 11088 tid=0[{"prefix": "damage rm", "damage_id": 3992430980}] 2023-10-06T02:30:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.229+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/586170519 --> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] -- command(tid 0: {"prefix": "damage rm", "damage_id": 3992430980}) v1 -- 0x5571b4b1ce80 con 0x5571b4c2b790 2023-10-06T02:30:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.229+0000 7ff3e259c700 1 --2- 172.21.15.6:0/586170519 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x5571b4c2b790 0x5571b4c2bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.229+0000 7ff3c0ff9700 10 client.11331 ms_handle_connect on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.229+0000 7ff3e259c700 1 --2- 172.21.15.6:0/586170519 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x5571b4c2b790 0x5571b4c2bb60 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bc411a4dbb4e6d4 server_cookie=6e254d24ed4436a in_seq=0 out_seq=0 2023-10-06T02:30:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.229+0000 7ff3c0ff9700 1 -- 172.21.15.6:0/586170519 <== mds.0 v2:172.21.15.6:6833/3837760829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+0 (crc 0 0 0) 0x5571b4b1ce80 con 0x5571b4c2b790 2023-10-06T02:30:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.229+0000 7ff3c0ff9700 10 client.11331 handle_command_reply: tid=0 2023-10-06T02:30:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.229+0000 7ff3f1b97b80 1 client.11331 shutdown 2023-10-06T02:30:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/586170519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c79c80 msgr2=0x5571b4c82040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/586170519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c79c80 0x5571b4c82040 secure :-1 s=READY pgs=2524 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc055360 tx=0x7ff3dc014040 comp rx=0 tx=0).stop 2023-10-06T02:30:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/586170519 shutdown_connections 2023-10-06T02:30:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/586170519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571b4c79c80 0x5571b4c82040 unknown :-1 s=CLOSED pgs=2524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/586170519 >> [v2:172.21.15.6:6833/3837760829,v1:172.21.15.6:6835/3837760829] conn(0x5571b4c2b790 0x5571b4c2bb60 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/586170519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571b4c298c0 0x5571b4cd6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3f1b97b80 1 --2- 172.21.15.6:0/586170519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5571b4c2ad40 0x5571b4cd5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3c0ff9700 0 client.11331 ms_handle_reset on v2:172.21.15.6:6833/3837760829 2023-10-06T02:30:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/586170519 >> 172.21.15.6:0/586170519 conn(0x5571b4c2b1e0 msgr2=0x5571b4c6d960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/586170519 shutdown_connections 2023-10-06T02:30:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3f1b97b80 1 -- 172.21.15.6:0/586170519 wait complete. 2023-10-06T02:30:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3f1b97b80 20 client.11331 trim_cache size 0 max 16384 2023-10-06T02:30:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3e889f700 1 -- 172.21.15.6:0/2422844159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff3c4066f30 msgr2=0x7ff3c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3e889f700 1 --2- 172.21.15.6:0/2422844159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff3c4066f30 0x7ff3c40693e0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40099e0 tx=0x7ff3d4016000 comp rx=0 tx=0).stop 2023-10-06T02:30:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3e889f700 1 -- 172.21.15.6:0/2422844159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e415a940 msgr2=0x7ff3e415d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3e889f700 1 --2- 172.21.15.6:0/2422844159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e415a940 0x7ff3e415d210 secure :-1 s=READY pgs=2520 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c940 tx=0x7ff3dc002720 comp rx=0 tx=0).stop 2023-10-06T02:30:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3e889f700 1 -- 172.21.15.6:0/2422844159 shutdown_connections 2023-10-06T02:30:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3e889f700 1 --2- 172.21.15.6:0/2422844159 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7ff3c4066f30 0x7ff3c40693e0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3e889f700 1 --2- 172.21.15.6:0/2422844159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e415a940 0x7ff3e415d210 unknown :-1 s=CLOSED pgs=2520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3e889f700 1 --2- 172.21.15.6:0/2422844159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e4087530 0x7ff3e415ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3e889f700 1 --2- 172.21.15.6:0/2422844159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3e415a030 0x7ff3e415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3e889f700 1 -- 172.21.15.6:0/2422844159 >> 172.21.15.6:0/2422844159 conn(0x7ff3e4068680 msgr2=0x7ff3e4158ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3e889f700 1 -- 172.21.15.6:0/2422844159 shutdown_connections 2023-10-06T02:30:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.230+0000 7ff3e889f700 1 -- 172.21.15.6:0/2422844159 wait complete. 2023-10-06T02:30:39.243 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:30:39.243 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:30:39.326 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:30:39.374 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:30:39.374 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-10-06T02:30:39.375 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:30:39.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:30:39.412 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[147393]: fuse finished with error 0 and tester_r 0 2023-10-06T02:30:39.413 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:30:39.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:39.414 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:30:39.558 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:30:39.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:39.559 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:30:39.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:30:39.577 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T02:30:39.577 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:30:39.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:39.578 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T02:30:39.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:30:39.593 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T02:30:39.593 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:30:39.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:39.593 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T02:30:39.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:30:39.635 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T02:30:39.635 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:30:39.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.753+0000 7f8ce6665700 1 Processor -- start 2023-10-06T02:30:39.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.753+0000 7f8ce6665700 1 -- start start 2023-10-06T02:30:39.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.754+0000 7f8ce6665700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00ac150 0x7f8ce0157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.754+0000 7f8ce6665700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce00c3220 con 0x7f8ce00c1de0 2023-10-06T02:30:39.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.754+0000 7f8ce6665700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce0159dd0 con 0x7f8ce00abd80 2023-10-06T02:30:39.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.754+0000 7f8ce6665700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00ccfd0 con 0x7f8ce00ac150 2023-10-06T02:30:39.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.754+0000 7f8ce4c02700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8ce00c1de0 0x7f8ce0068680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51498/0 (socket says 172.21.15.6:51498) 2023-10-06T02:30:39.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.754+0000 7f8ce4c02700 1 -- 172.21.15.6:0/276247424 learned_addr learned my addr 172.21.15.6:0/276247424 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:39.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.754+0000 7f8cdf7fe700 1 --2- 172.21.15.6:0/276247424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00ac150 0x7f8ce0157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.754+0000 7f8cdeffd700 1 -- 172.21.15.6:0/276247424 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192970021 0 0) 0x7f8ce00c3220 con 0x7f8ce00c1de0 2023-10-06T02:30:39.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.754+0000 7f8cdeffd700 1 -- 172.21.15.6:0/276247424 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cc8003570 con 0x7f8ce00c1de0 2023-10-06T02:30:39.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdeffd700 1 -- 172.21.15.6:0/276247424 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1870984894 0 0) 0x7f8cc8003570 con 0x7f8ce00c1de0 2023-10-06T02:30:39.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdeffd700 1 -- 172.21.15.6:0/276247424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00ac150 msgr2=0x7f8ce0157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:39.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdeffd700 1 --2- 172.21.15.6:0/276247424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00ac150 0x7f8ce0157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdeffd700 1 -- 172.21.15.6:0/276247424 >> v1:172.21.15.175:6789/0 conn(0x7f8ce00abd80 legacy=0x7f8ce015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:39.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdeffd700 1 -- 172.21.15.6:0/276247424 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce00c2330 con 0x7f8ce00c1de0 2023-10-06T02:30:39.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdeffd700 1 -- 172.21.15.6:0/276247424 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f8cd80017f0 con 0x7f8ce00c1de0 2023-10-06T02:30:39.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdeffd700 1 -- 172.21.15.6:0/276247424 >> v1:172.21.15.6:6789/0 conn(0x7f8ce00c1de0 legacy=0x7f8ce0068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:39.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdeffd700 1 --2- 172.21.15.6:0/276247424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cc8003a90 0x7f8cc8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdeffd700 1 --2- 172.21.15.6:0/276247424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00ac150 0x7f8cc8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdeffd700 1 --2- 172.21.15.6:0/276247424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc8004d50 0x7f8cc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdeffd700 1 -- 172.21.15.6:0/276247424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00ccfd0 con 0x7f8cc8003a90 2023-10-06T02:30:39.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdeffd700 1 -- 172.21.15.6:0/276247424 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc800bb10 con 0x7f8cc8004d50 2023-10-06T02:30:39.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdeffd700 1 -- 172.21.15.6:0/276247424 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc800bcd0 con 0x7f8ce00ac150 2023-10-06T02:30:39.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdffff700 1 --2- 172.21.15.6:0/276247424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cc8003a90 0x7f8cc8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdf7fe700 1 --2- 172.21.15.6:0/276247424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00ac150 0x7f8cc8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8ce4c02700 1 --2- 172.21.15.6:0/276247424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc8004d50 0x7f8cc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdffff700 1 -- 172.21.15.6:0/276247424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00ac150 msgr2=0x7f8cc8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:39.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdffff700 1 --2- 172.21.15.6:0/276247424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00ac150 0x7f8cc8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdffff700 1 -- 172.21.15.6:0/276247424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc8004d50 msgr2=0x7f8cc80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdffff700 1 --2- 172.21.15.6:0/276247424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc8004d50 0x7f8cc80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdffff700 1 -- 172.21.15.6:0/276247424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc8003570 con 0x7f8cc8003a90 2023-10-06T02:30:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdffff700 1 --2- 172.21.15.6:0/276247424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cc8003a90 0x7f8cc8003e60 secure :-1 s=READY pgs=2526 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00019a0 tx=0x7f8cd0007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f14e2220bfc51c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdeffd700 1 -- 172.21.15.6:0/276247424 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd000c5d0 con 0x7f8cc8003a90 2023-10-06T02:30:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdeffd700 1 -- 172.21.15.6:0/276247424 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd000c730 con 0x7f8cc8003a90 2023-10-06T02:30:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.755+0000 7f8cdeffd700 1 -- 172.21.15.6:0/276247424 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd000cad0 con 0x7f8cc8003a90 2023-10-06T02:30:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.756+0000 7f8ce6665700 1 -- 172.21.15.6:0/276247424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cc8003a90 msgr2=0x7f8cc8003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.756+0000 7f8ce6665700 1 --2- 172.21.15.6:0/276247424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cc8003a90 0x7f8cc8003e60 secure :-1 s=READY pgs=2526 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00019a0 tx=0x7f8cd0007d10 comp rx=0 tx=0).stop 2023-10-06T02:30:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.756+0000 7f8ce4c02700 1 -- 172.21.15.6:0/276247424 reap_dead start 2023-10-06T02:30:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.756+0000 7f8ce6665700 1 -- 172.21.15.6:0/276247424 shutdown_connections 2023-10-06T02:30:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.756+0000 7f8ce6665700 1 -- 172.21.15.6:0/276247424 >> 172.21.15.6:0/276247424 conn(0x7f8ce0069790 msgr2=0x7f8ce0069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.756+0000 7f8ce6665700 1 -- 172.21.15.6:0/276247424 shutdown_connections 2023-10-06T02:30:39.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.756+0000 7f8ce6665700 1 -- 172.21.15.6:0/276247424 wait complete. 2023-10-06T02:30:39.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.757+0000 7f8ce6665700 1 Processor -- start 2023-10-06T02:30:39.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.757+0000 7f8ce6665700 1 -- start start 2023-10-06T02:30:39.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.758+0000 7f8ce6665700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cc8003a90 0x7f8ce0153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.758+0000 7f8ce6665700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce00b22d0 0x7f8ce00c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.758+0000 7f8ce6665700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ce00a88d0 0x7f8ce00a8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.758+0000 7f8ce6665700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00b0710 con 0x7f8ce00b22d0 2023-10-06T02:30:39.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.758+0000 7f8ce6665700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce0153640 con 0x7f8ce00a88d0 2023-10-06T02:30:39.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.758+0000 7f8ce6665700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00c6f70 con 0x7f8cc8003a90 2023-10-06T02:30:39.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.758+0000 7f8cdf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce00b22d0 0x7f8ce00c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.758+0000 7f8cdf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce00b22d0 0x7f8ce00c66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37482/0 (socket says 172.21.15.6:37482) 2023-10-06T02:30:39.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.758+0000 7f8cdf7fe700 1 -- 172.21.15.6:0/131990007 learned_addr learned my addr 172.21.15.6:0/131990007 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:39.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.758+0000 7f8cdffff700 1 --2- 172.21.15.6:0/131990007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cc8003a90 0x7f8ce0153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.758+0000 7f8ce4c02700 1 --2- 172.21.15.6:0/131990007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ce00a88d0 0x7f8ce00a8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.758+0000 7f8cdf7fe700 1 -- 172.21.15.6:0/131990007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cc8003a90 msgr2=0x7f8ce0153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:39.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.758+0000 7f8cdf7fe700 1 --2- 172.21.15.6:0/131990007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cc8003a90 0x7f8ce0153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.758+0000 7f8cdf7fe700 1 -- 172.21.15.6:0/131990007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ce00a88d0 msgr2=0x7f8ce00a8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:39.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.758+0000 7f8cdf7fe700 1 --2- 172.21.15.6:0/131990007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ce00a88d0 0x7f8ce00a8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:39.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.758+0000 7f8cdf7fe700 1 -- 172.21.15.6:0/131990007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce00afde0 con 0x7f8ce00b22d0 2023-10-06T02:30:39.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.758+0000 7f8cdffff700 1 --2- 172.21.15.6:0/131990007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cc8003a90 0x7f8ce0153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.759+0000 7f8cdf7fe700 1 --2- 172.21.15.6:0/131990007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce00b22d0 0x7f8ce00c66d0 secure :-1 s=READY pgs=2527 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4011d70 tx=0x7f8cd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.759+0000 7f8cc7fff700 1 -- 172.21.15.6:0/131990007 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd400fac0 con 0x7f8ce00b22d0 2023-10-06T02:30:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.759+0000 7f8cc7fff700 1 -- 172.21.15.6:0/131990007 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd400fc20 con 0x7f8ce00b22d0 2023-10-06T02:30:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.759+0000 7f8cc7fff700 1 -- 172.21.15.6:0/131990007 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4014440 con 0x7f8ce00b22d0 2023-10-06T02:30:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.759+0000 7f8ce6665700 1 -- 172.21.15.6:0/131990007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce00b00c0 con 0x7f8ce00b22d0 2023-10-06T02:30:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.759+0000 7f8ce6665700 1 -- 172.21.15.6:0/131990007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce00c6c10 con 0x7f8ce00b22d0 2023-10-06T02:30:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.760+0000 7f8ce6665700 1 -- 172.21.15.6:0/131990007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce00b0850 con 0x7f8ce00b22d0 2023-10-06T02:30:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.760+0000 7f8cc7fff700 1 -- 172.21.15.6:0/131990007 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8cd4014870 con 0x7f8ce00b22d0 2023-10-06T02:30:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.761+0000 7f8cc7fff700 1 --2- 172.21.15.6:0/131990007 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8ccc066f30 0x7f8ccc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.761+0000 7f8cc7fff700 1 -- 172.21.15.6:0/131990007 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f8cd4018030 con 0x7f8ce00b22d0 2023-10-06T02:30:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.761+0000 7f8cdffff700 1 --2- 172.21.15.6:0/131990007 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8ccc066f30 0x7f8ccc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.762+0000 7f8cdffff700 1 --2- 172.21.15.6:0/131990007 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8ccc066f30 0x7f8ccc0693e0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0160640 tx=0x7f8cd0015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:39.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:39.765+0000 7f8cc7fff700 1 -- 172.21.15.6:0/131990007 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8cd4052170 con 0x7f8ce00b22d0 2023-10-06T02:30:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.005+0000 7f8ce6665700 1 -- 172.21.15.6:0/131990007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ce004bb80 con 0x7f8ce00b22d0 2023-10-06T02:30:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.005+0000 7f8cc7fff700 1 -- 172.21.15.6:0/131990007 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 366 v366) v1 ==== 95+0+4608 (secure 0 0 0) 0x7f8cd4055790 con 0x7f8ce00b22d0 2023-10-06T02:30:40.006 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:40.006 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":366,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3603762205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3603762205},{"type":"v1","addr":"172.21.15.175:6836","nonce":3603762205}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":9820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3292446255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3292446255},{"type":"v1","addr":"172.21.15.175:6837","nonce":3292446255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":10869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/759655214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":759655214},{"type":"v1","addr":"172.21.15.6:6834","nonce":759655214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354}],"filesystems":[{"mdsmap":{"epoch":366,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:30:06.715272+0000","modified":"2023-10-06T02:30:39.086477+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11088":{"gid":11088,"name":"c","rank":0,"incarnation":362,"state":"up:active","state_seq":6,"addr":"172.21.15.6:6835/3837760829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3837760829},{"type":"v1","addr":"172.21.15.6:6835","nonce":3837760829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:30:40.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.007+0000 7f8ce6665700 1 -- 172.21.15.6:0/131990007 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8ccc066f30 msgr2=0x7f8ccc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.007+0000 7f8ce6665700 1 --2- 172.21.15.6:0/131990007 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8ccc066f30 0x7f8ccc0693e0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0160640 tx=0x7f8cd0015000 comp rx=0 tx=0).stop 2023-10-06T02:30:40.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.007+0000 7f8ce6665700 1 -- 172.21.15.6:0/131990007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce00b22d0 msgr2=0x7f8ce00c66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.007+0000 7f8ce6665700 1 --2- 172.21.15.6:0/131990007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce00b22d0 0x7f8ce00c66d0 secure :-1 s=READY pgs=2527 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4011d70 tx=0x7f8cd40091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.007+0000 7f8ce6665700 1 -- 172.21.15.6:0/131990007 shutdown_connections 2023-10-06T02:30:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.007+0000 7f8ce6665700 1 --2- 172.21.15.6:0/131990007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ce00a88d0 0x7f8ce00a8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.007+0000 7f8ce6665700 1 --2- 172.21.15.6:0/131990007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cc8003a90 0x7f8ce0153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.007+0000 7f8ce6665700 1 --2- 172.21.15.6:0/131990007 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8ccc066f30 0x7f8ccc0693e0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.007+0000 7f8ce6665700 1 --2- 172.21.15.6:0/131990007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce00b22d0 0x7f8ce00c66d0 unknown :-1 s=CLOSED pgs=2527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.007+0000 7f8ce6665700 1 -- 172.21.15.6:0/131990007 >> 172.21.15.6:0/131990007 conn(0x7f8ce0069790 msgr2=0x7f8ce0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.007+0000 7f8ce6665700 1 -- 172.21.15.6:0/131990007 shutdown_connections 2023-10-06T02:30:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.007+0000 7f8ce6665700 1 -- 172.21.15.6:0/131990007 wait complete. 2023-10-06T02:30:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 366 2023-10-06T02:30:40.020 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:30:40.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.139+0000 7fcc24504700 1 Processor -- start 2023-10-06T02:30:40.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.139+0000 7fcc24504700 1 -- start start 2023-10-06T02:30:40.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.139+0000 7fcc24504700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcc1c1569e0 0x7fcc1c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.140+0000 7fcc24504700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1c0c87a0 con 0x7fcc1c0b0800 2023-10-06T02:30:40.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.140+0000 7fcc24504700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1c1596c0 con 0x7fcc1c14fda0 2023-10-06T02:30:40.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.140+0000 7fcc24504700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1c0c89d0 con 0x7fcc1c1569e0 2023-10-06T02:30:40.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.140+0000 7fcc222a0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcc1c1569e0 0x7fcc1c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.140+0000 7fcc22aa1700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcc1c0b0800 0x7fcc1c0b0bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51502/0 (socket says 172.21.15.6:51502) 2023-10-06T02:30:40.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.140+0000 7fcc22aa1700 1 -- 172.21.15.6:0/328225131 learned_addr learned my addr 172.21.15.6:0/328225131 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:40.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.140+0000 7fcc222a0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcc1c1569e0 0x7fcc1c0c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37484/0 (socket says 172.21.15.6:37484) 2023-10-06T02:30:40.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.140+0000 7fcc222a0700 1 -- 172.21.15.6:0/328225131 >> v1:172.21.15.175:6789/0 conn(0x7fcc1c14fda0 legacy=0x7fcc1c0ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.140+0000 7fcc222a0700 1 -- 172.21.15.6:0/328225131 >> v1:172.21.15.6:6789/0 conn(0x7fcc1c0b0800 legacy=0x7fcc1c0b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.140+0000 7fcc222a0700 1 -- 172.21.15.6:0/328225131 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c1599a0 con 0x7fcc1c1569e0 2023-10-06T02:30:40.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.140+0000 7fcc2129e700 1 -- 172.21.15.6:0/328225131 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540601502 0 0) 0x7fcc1c0c87a0 con 0x7fcc1c0b0800 2023-10-06T02:30:40.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.140+0000 7fcc222a0700 1 --2- 172.21.15.6:0/328225131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc1c1569e0 0x7fcc1c0c8260 secure :-1 s=READY pgs=2529 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400bb90 tx=0x7fcc1400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1110bf728104156 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:40.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.140+0000 7fcc2129e700 1 -- 172.21.15.6:0/328225131 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1400dba0 con 0x7fcc1c1569e0 2023-10-06T02:30:40.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.140+0000 7fcc2129e700 1 -- 172.21.15.6:0/328225131 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1400dd00 con 0x7fcc1c1569e0 2023-10-06T02:30:40.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.140+0000 7fcc2129e700 1 -- 172.21.15.6:0/328225131 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc140196b0 con 0x7fcc1c1569e0 2023-10-06T02:30:40.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.141+0000 7fcc24504700 1 -- 172.21.15.6:0/328225131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc1c1569e0 msgr2=0x7fcc1c0c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.141+0000 7fcc24504700 1 --2- 172.21.15.6:0/328225131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc1c1569e0 0x7fcc1c0c8260 secure :-1 s=READY pgs=2529 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400bb90 tx=0x7fcc1400b430 comp rx=0 tx=0).stop 2023-10-06T02:30:40.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.141+0000 7fcc24504700 1 -- 172.21.15.6:0/328225131 shutdown_connections 2023-10-06T02:30:40.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.141+0000 7fcc24504700 1 --2- 172.21.15.6:0/328225131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc1c1569e0 0x7fcc1c0c8260 unknown :-1 s=CLOSED pgs=2529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.141+0000 7fcc24504700 1 -- 172.21.15.6:0/328225131 >> 172.21.15.6:0/328225131 conn(0x7fcc1c069100 msgr2=0x7fcc1c0ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:40.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.141+0000 7fcc24504700 1 -- 172.21.15.6:0/328225131 shutdown_connections 2023-10-06T02:30:40.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.141+0000 7fcc24504700 1 -- 172.21.15.6:0/328225131 wait complete. 2023-10-06T02:30:40.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.142+0000 7fcc24504700 1 Processor -- start 2023-10-06T02:30:40.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.142+0000 7fcc24504700 1 -- start start 2023-10-06T02:30:40.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc24504700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc1c0b0800 0x7fcc1c0ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc24504700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc1c14fda0 0x7fcc1c0abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc24504700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc1c1569e0 0x7fcc1c154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc24504700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c169b50 con 0x7fcc1c14fda0 2023-10-06T02:30:40.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc24504700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0acca0 con 0x7fcc1c1569e0 2023-10-06T02:30:40.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc24504700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0a4660 con 0x7fcc1c0b0800 2023-10-06T02:30:40.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc21a9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc1c14fda0 0x7fcc1c0abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc21a9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc1c14fda0 0x7fcc1c0abc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37500/0 (socket says 172.21.15.6:37500) 2023-10-06T02:30:40.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc21a9f700 1 -- 172.21.15.6:0/3496707172 learned_addr learned my addr 172.21.15.6:0/3496707172 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:40.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc222a0700 1 --2- 172.21.15.6:0/3496707172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc1c0b0800 0x7fcc1c0ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc22aa1700 1 --2- 172.21.15.6:0/3496707172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc1c1569e0 0x7fcc1c154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc21a9f700 1 -- 172.21.15.6:0/3496707172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc1c0b0800 msgr2=0x7fcc1c0ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc21a9f700 1 --2- 172.21.15.6:0/3496707172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc1c0b0800 0x7fcc1c0ada60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc21a9f700 1 -- 172.21.15.6:0/3496707172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc1c1569e0 msgr2=0x7fcc1c154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc21a9f700 1 --2- 172.21.15.6:0/3496707172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc1c1569e0 0x7fcc1c154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc21a9f700 1 -- 172.21.15.6:0/3496707172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1400b6d0 con 0x7fcc1c14fda0 2023-10-06T02:30:40.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc21a9f700 1 --2- 172.21.15.6:0/3496707172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc1c14fda0 0x7fcc1c0abc20 secure :-1 s=READY pgs=2530 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000c5c0 tx=0x7fcc1000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:40.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.143+0000 7fcc1a7fc700 1 -- 172.21.15.6:0/3496707172 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10012630 con 0x7fcc1c14fda0 2023-10-06T02:30:40.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.144+0000 7fcc1a7fc700 1 -- 172.21.15.6:0/3496707172 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc100127b0 con 0x7fcc1c14fda0 2023-10-06T02:30:40.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.144+0000 7fcc24504700 1 -- 172.21.15.6:0/3496707172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c169d30 con 0x7fcc1c14fda0 2023-10-06T02:30:40.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.144+0000 7fcc1a7fc700 1 -- 172.21.15.6:0/3496707172 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10012b70 con 0x7fcc1c14fda0 2023-10-06T02:30:40.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.144+0000 7fcc24504700 1 -- 172.21.15.6:0/3496707172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c0ac1c0 con 0x7fcc1c14fda0 2023-10-06T02:30:40.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.144+0000 7fcc24504700 1 -- 172.21.15.6:0/3496707172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1c06d580 con 0x7fcc1c14fda0 2023-10-06T02:30:40.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.145+0000 7fcc1a7fc700 1 -- 172.21.15.6:0/3496707172 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc1001b400 con 0x7fcc1c14fda0 2023-10-06T02:30:40.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.145+0000 7fcc1a7fc700 1 --2- 172.21.15.6:0/3496707172 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcc08066f30 0x7fcc080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.145+0000 7fcc1a7fc700 1 -- 172.21.15.6:0/3496707172 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fcc100842b0 con 0x7fcc1c14fda0 2023-10-06T02:30:40.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.146+0000 7fcc222a0700 1 --2- 172.21.15.6:0/3496707172 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcc08066f30 0x7fcc080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.146+0000 7fcc222a0700 1 --2- 172.21.15.6:0/3496707172 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcc08066f30 0x7fcc080693e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400b6a0 tx=0x7fcc1401b000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:40.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.150+0000 7fcc1a7fc700 1 -- 172.21.15.6:0/3496707172 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc100511f0 con 0x7fcc1c14fda0 2023-10-06T02:30:40.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.345+0000 7fcc24504700 1 -- 172.21.15.6:0/3496707172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc1c0ac160 con 0x7fcc1c14fda0 2023-10-06T02:30:40.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.346+0000 7fcc1a7fc700 1 -- 172.21.15.6:0/3496707172 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+17261 (secure 0 0 0) 0x7fcc10054810 con 0x7fcc1c14fda0 2023-10-06T02:30:40.347 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:40.347 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":149,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:30:33.070801+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:30:04.464332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T02:30:05.694424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.b","mappings":[{"from":0,"to":2}]},{"pgid":"17.37","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/1108543434":"2023-10-07T02:30:28.039955+0000","172.21.15.6:6833/1108543434":"2023-10-07T02:30:28.039955+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:30:40.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.348+0000 7fcc24504700 1 -- 172.21.15.6:0/3496707172 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcc08066f30 msgr2=0x7fcc080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.348+0000 7fcc24504700 1 --2- 172.21.15.6:0/3496707172 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcc08066f30 0x7fcc080693e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400b6a0 tx=0x7fcc1401b000 comp rx=0 tx=0).stop 2023-10-06T02:30:40.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.348+0000 7fcc24504700 1 -- 172.21.15.6:0/3496707172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc1c14fda0 msgr2=0x7fcc1c0abc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.348+0000 7fcc24504700 1 --2- 172.21.15.6:0/3496707172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc1c14fda0 0x7fcc1c0abc20 secure :-1 s=READY pgs=2530 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000c5c0 tx=0x7fcc1000c980 comp rx=0 tx=0).stop 2023-10-06T02:30:40.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.348+0000 7fcc24504700 1 -- 172.21.15.6:0/3496707172 shutdown_connections 2023-10-06T02:30:40.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.348+0000 7fcc24504700 1 --2- 172.21.15.6:0/3496707172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc1c1569e0 0x7fcc1c154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.348+0000 7fcc24504700 1 --2- 172.21.15.6:0/3496707172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc1c0b0800 0x7fcc1c0ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.348+0000 7fcc24504700 1 --2- 172.21.15.6:0/3496707172 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fcc08066f30 0x7fcc080693e0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.348+0000 7fcc24504700 1 --2- 172.21.15.6:0/3496707172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc1c14fda0 0x7fcc1c0abc20 unknown :-1 s=CLOSED pgs=2530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.348+0000 7fcc24504700 1 -- 172.21.15.6:0/3496707172 >> 172.21.15.6:0/3496707172 conn(0x7fcc1c069100 msgr2=0x7fcc1c1576d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:40.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.348+0000 7fcc24504700 1 -- 172.21.15.6:0/3496707172 shutdown_connections 2023-10-06T02:30:40.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.348+0000 7fcc24504700 1 -- 172.21.15.6:0/3496707172 wait complete. 2023-10-06T02:30:40.361 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:17:36.253879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:17:36.611849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:30:04.464332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:30:05.694424+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:30:40.362 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:30:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.482+0000 7f31ec084700 1 Processor -- start 2023-10-06T02:30:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.482+0000 7f31ec084700 1 -- start start 2023-10-06T02:30:40.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.483+0000 7f31ec084700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31e40d0400 0x7f31e40b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.483+0000 7f31ec084700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f31e40ccd40 0x7f31e40cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.483+0000 7f31ec084700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e40cf7e0 0x7f31e40b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.483+0000 7f31ec084700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e40b6170 con 0x7f31e40d0400 2023-10-06T02:30:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.483+0000 7f31ec084700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e415dd40 con 0x7f31e40ccd40 2023-10-06T02:30:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.483+0000 7f31ec084700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e415e020 con 0x7f31e40cf7e0 2023-10-06T02:30:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.483+0000 7f31e9e20700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31e40d0400 0x7f31e40b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.483+0000 7f31e9e20700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31e40d0400 0x7f31e40b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37502/0 (socket says 172.21.15.6:37502) 2023-10-06T02:30:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.483+0000 7f31e9e20700 1 -- 172.21.15.6:0/2385643126 learned_addr learned my addr 172.21.15.6:0/2385643126 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.484+0000 7f31ea621700 1 --2- 172.21.15.6:0/2385643126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e40cf7e0 0x7f31e40b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.484+0000 7f31e9e20700 1 -- 172.21.15.6:0/2385643126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e40cf7e0 msgr2=0x7f31e40b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.484+0000 7f31e9e20700 1 --2- 172.21.15.6:0/2385643126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e40cf7e0 0x7f31e40b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.484+0000 7f31e9e20700 1 -- 172.21.15.6:0/2385643126 >> v2:172.21.15.175:3300/0 conn(0x7f31e40ccd40 msgr2=0x7f31e40cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.484+0000 7f31e9e20700 1 --2- 172.21.15.6:0/2385643126 >> v2:172.21.15.175:3300/0 conn(0x7f31e40ccd40 0x7f31e40cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.484+0000 7f31e9e20700 1 -- 172.21.15.6:0/2385643126 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e40ceaa0 con 0x7f31e40d0400 2023-10-06T02:30:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.484+0000 7f31e9e20700 1 --2- 172.21.15.6:0/2385643126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31e40d0400 0x7f31e40b5c30 secure :-1 s=READY pgs=2531 cs=0 l=1 rev1=1 crypto rx=0x7f31e40cd1c0 tx=0x7f31dc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1541914eb250070 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.484+0000 7f31e8e1e700 1 -- 172.21.15.6:0/2385643126 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc005c10 con 0x7f31e40d0400 2023-10-06T02:30:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.484+0000 7f31e8e1e700 1 -- 172.21.15.6:0/2385643126 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31dc005d70 con 0x7f31e40d0400 2023-10-06T02:30:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.484+0000 7f31e8e1e700 1 -- 172.21.15.6:0/2385643126 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc00b880 con 0x7f31e40d0400 2023-10-06T02:30:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.484+0000 7f31ec084700 1 -- 172.21.15.6:0/2385643126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31e40d0400 msgr2=0x7f31e40b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.484+0000 7f31ec084700 1 --2- 172.21.15.6:0/2385643126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31e40d0400 0x7f31e40b5c30 secure :-1 s=READY pgs=2531 cs=0 l=1 rev1=1 crypto rx=0x7f31e40cd1c0 tx=0x7f31dc009220 comp rx=0 tx=0).stop 2023-10-06T02:30:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.484+0000 7f31ec084700 1 -- 172.21.15.6:0/2385643126 shutdown_connections 2023-10-06T02:30:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.484+0000 7f31ec084700 1 --2- 172.21.15.6:0/2385643126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e40cf7e0 0x7f31e40b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.484+0000 7f31ec084700 1 --2- 172.21.15.6:0/2385643126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31e40d0400 0x7f31e40b5c30 unknown :-1 s=CLOSED pgs=2531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.484+0000 7f31ec084700 1 --2- 172.21.15.6:0/2385643126 >> v2:172.21.15.175:3300/0 conn(0x7f31e40ccd40 0x7f31e40cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.484+0000 7f31ec084700 1 -- 172.21.15.6:0/2385643126 >> 172.21.15.6:0/2385643126 conn(0x7f31e406a220 msgr2=0x7f31e406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.485+0000 7f31ec084700 1 -- 172.21.15.6:0/2385643126 shutdown_connections 2023-10-06T02:30:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.485+0000 7f31ec084700 1 -- 172.21.15.6:0/2385643126 wait complete. 2023-10-06T02:30:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.486+0000 7f31ec084700 1 Processor -- start 2023-10-06T02:30:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.486+0000 7f31ec084700 1 -- start start 2023-10-06T02:30:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.486+0000 7f31ec084700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e40ccd40 0x7f31e415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.486+0000 7f31ec084700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e40cf7e0 0x7f31e40caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.486+0000 7f31ec084700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31e40d0400 0x7f31e40cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.486+0000 7f31ec084700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e40caa80 con 0x7f31e40d0400 2023-10-06T02:30:40.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.486+0000 7f31ec084700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e4155f10 con 0x7f31e40ccd40 2023-10-06T02:30:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.486+0000 7f31ec084700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e415d470 con 0x7f31e40cf7e0 2023-10-06T02:30:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.486+0000 7f31ea621700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31e40d0400 0x7f31e40cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.487+0000 7f31ea621700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31e40d0400 0x7f31e40cb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37510/0 (socket says 172.21.15.6:37510) 2023-10-06T02:30:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.487+0000 7f31ea621700 1 -- 172.21.15.6:0/2807927281 learned_addr learned my addr 172.21.15.6:0/2807927281 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.487+0000 7f31e961f700 1 --2- 172.21.15.6:0/2807927281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e40cf7e0 0x7f31e40caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.487+0000 7f31e9e20700 1 --2- 172.21.15.6:0/2807927281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e40ccd40 0x7f31e415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.487+0000 7f31ea621700 1 -- 172.21.15.6:0/2807927281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e40cf7e0 msgr2=0x7f31e40caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.487+0000 7f31ea621700 1 --2- 172.21.15.6:0/2807927281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e40cf7e0 0x7f31e40caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.487+0000 7f31ea621700 1 -- 172.21.15.6:0/2807927281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e40ccd40 msgr2=0x7f31e415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.487+0000 7f31ea621700 1 --2- 172.21.15.6:0/2807927281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e40ccd40 0x7f31e415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.487+0000 7f31ea621700 1 -- 172.21.15.6:0/2807927281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31dc009480 con 0x7f31e40d0400 2023-10-06T02:30:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.487+0000 7f31e961f700 1 --2- 172.21.15.6:0/2807927281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e40cf7e0 0x7f31e40caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.487+0000 7f31e9e20700 1 --2- 172.21.15.6:0/2807927281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e40ccd40 0x7f31e415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.487+0000 7f31ea621700 1 --2- 172.21.15.6:0/2807927281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31e40d0400 0x7f31e40cb450 secure :-1 s=READY pgs=2532 cs=0 l=1 rev1=1 crypto rx=0x7f31d400ceb0 tx=0x7f31d4007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.487+0000 7f31e1ffb700 1 -- 172.21.15.6:0/2807927281 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d400ae40 con 0x7f31e40d0400 2023-10-06T02:30:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.487+0000 7f31e1ffb700 1 -- 172.21.15.6:0/2807927281 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d4016430 con 0x7f31e40d0400 2023-10-06T02:30:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.487+0000 7f31ec084700 1 -- 172.21.15.6:0/2807927281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e415d750 con 0x7f31e40d0400 2023-10-06T02:30:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.487+0000 7f31e1ffb700 1 -- 172.21.15.6:0/2807927281 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d40167d0 con 0x7f31e40d0400 2023-10-06T02:30:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.487+0000 7f31ec084700 1 -- 172.21.15.6:0/2807927281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e40ca3c0 con 0x7f31e40d0400 2023-10-06T02:30:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.488+0000 7f31ec084700 1 -- 172.21.15.6:0/2807927281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e4088760 con 0x7f31e40d0400 2023-10-06T02:30:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.488+0000 7f31e1ffb700 1 -- 172.21.15.6:0/2807927281 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31d4003020 con 0x7f31e40d0400 2023-10-06T02:30:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.489+0000 7f31e1ffb700 1 --2- 172.21.15.6:0/2807927281 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f31d0066f30 0x7f31d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.489+0000 7f31e1ffb700 1 -- 172.21.15.6:0/2807927281 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f31d4012070 con 0x7f31e40d0400 2023-10-06T02:30:40.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.489+0000 7f31e9e20700 1 --2- 172.21.15.6:0/2807927281 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f31d0066f30 0x7f31d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.490+0000 7f31e9e20700 1 --2- 172.21.15.6:0/2807927281 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f31d0066f30 0x7f31d00693e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009260 tx=0x7f31dc016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:40.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.493+0000 7f31e1ffb700 1 -- 172.21.15.6:0/2807927281 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31d4056100 con 0x7f31e40d0400 2023-10-06T02:30:40.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.684+0000 7f31ec084700 1 -- 172.21.15.6:0/2807927281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f31e415d940 con 0x7f31e40d0400 2023-10-06T02:30:40.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.684+0000 7f31e1ffb700 1 -- 172.21.15.6:0/2807927281 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v149) v1 ==== 92+0+10 (secure 0 0 0) 0x7f31d4055c90 con 0x7f31e40d0400 2023-10-06T02:30:40.685 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-10-06T02:30:40.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.687+0000 7f31ec084700 1 -- 172.21.15.6:0/2807927281 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f31d0066f30 msgr2=0x7f31d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.687+0000 7f31ec084700 1 --2- 172.21.15.6:0/2807927281 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f31d0066f30 0x7f31d00693e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009260 tx=0x7f31dc016000 comp rx=0 tx=0).stop 2023-10-06T02:30:40.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.687+0000 7f31ec084700 1 -- 172.21.15.6:0/2807927281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31e40d0400 msgr2=0x7f31e40cb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.687+0000 7f31ec084700 1 --2- 172.21.15.6:0/2807927281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31e40d0400 0x7f31e40cb450 secure :-1 s=READY pgs=2532 cs=0 l=1 rev1=1 crypto rx=0x7f31d400ceb0 tx=0x7f31d4007870 comp rx=0 tx=0).stop 2023-10-06T02:30:40.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.687+0000 7f31ec084700 1 -- 172.21.15.6:0/2807927281 shutdown_connections 2023-10-06T02:30:40.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.687+0000 7f31ec084700 1 --2- 172.21.15.6:0/2807927281 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f31d0066f30 0x7f31d00693e0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.687+0000 7f31ec084700 1 --2- 172.21.15.6:0/2807927281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31e40d0400 0x7f31e40cb450 unknown :-1 s=CLOSED pgs=2532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.687+0000 7f31ec084700 1 --2- 172.21.15.6:0/2807927281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e40ccd40 0x7f31e415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.687+0000 7f31ec084700 1 --2- 172.21.15.6:0/2807927281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e40cf7e0 0x7f31e40caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.687+0000 7f31ec084700 1 -- 172.21.15.6:0/2807927281 >> 172.21.15.6:0/2807927281 conn(0x7f31e406a220 msgr2=0x7f31e406a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:40.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.687+0000 7f31ec084700 1 -- 172.21.15.6:0/2807927281 shutdown_connections 2023-10-06T02:30:40.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.687+0000 7f31ec084700 1 -- 172.21.15.6:0/2807927281 wait complete. 2023-10-06T02:30:40.699 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:30:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.820+0000 7f30768b1700 1 Processor -- start 2023-10-06T02:30:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.820+0000 7f30768b1700 1 -- start start 2023-10-06T02:30:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.821+0000 7f30768b1700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f307006b7e0 0x7f30700cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.821+0000 7f30768b1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30700c90d0 con 0x7f307006bbb0 2023-10-06T02:30:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.821+0000 7f30768b1700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30700c7c60 con 0x7f307006d1c0 2023-10-06T02:30:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.821+0000 7f30768b1700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3070157600 con 0x7f307006b7e0 2023-10-06T02:30:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.821+0000 7f306f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f307006bbb0 0x7f307006cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51508/0 (socket says 172.21.15.6:51508) 2023-10-06T02:30:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.821+0000 7f306f7fe700 1 -- 172.21.15.6:0/2997299162 learned_addr learned my addr 172.21.15.6:0/2997299162 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306ffff700 1 --2- 172.21.15.6:0/2997299162 >> v2:172.21.15.175:3300/0 conn(0x7f307006b7e0 0x7f30700cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306effd700 1 -- 172.21.15.6:0/2997299162 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127794681 0 0) 0x7f30700c90d0 con 0x7f307006bbb0 2023-10-06T02:30:40.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306effd700 1 -- 172.21.15.6:0/2997299162 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3058003570 con 0x7f307006bbb0 2023-10-06T02:30:40.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306effd700 1 -- 172.21.15.6:0/2997299162 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 602993356 0 0) 0x7f3058003570 con 0x7f307006bbb0 2023-10-06T02:30:40.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306effd700 1 -- 172.21.15.6:0/2997299162 >> v2:172.21.15.175:3300/0 conn(0x7f307006b7e0 msgr2=0x7f30700cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:40.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306effd700 1 --2- 172.21.15.6:0/2997299162 >> v2:172.21.15.175:3300/0 conn(0x7f307006b7e0 0x7f30700cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306effd700 1 -- 172.21.15.6:0/2997299162 >> v1:172.21.15.175:6789/0 conn(0x7f307006d1c0 legacy=0x7f30701600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306effd700 1 -- 172.21.15.6:0/2997299162 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30700c7980 con 0x7f307006bbb0 2023-10-06T02:30:40.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306effd700 1 -- 172.21.15.6:0/2997299162 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f3064001470 con 0x7f307006bbb0 2023-10-06T02:30:40.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306effd700 1 -- 172.21.15.6:0/2997299162 >> v1:172.21.15.6:6789/0 conn(0x7f307006bbb0 legacy=0x7f307006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306effd700 1 --2- 172.21.15.6:0/2997299162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3058003a60 0x7f3058003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306effd700 1 --2- 172.21.15.6:0/2997299162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3058004810 0x7f3058004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306effd700 1 --2- 172.21.15.6:0/2997299162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580051c0 0x7f305800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306effd700 1 -- 172.21.15.6:0/2997299162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3070157600 con 0x7f30580051c0 2023-10-06T02:30:40.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306effd700 1 -- 172.21.15.6:0/2997299162 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305800c050 con 0x7f3058003a60 2023-10-06T02:30:40.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306effd700 1 -- 172.21.15.6:0/2997299162 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305800c210 con 0x7f3058004810 2023-10-06T02:30:40.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306ffff700 1 --2- 172.21.15.6:0/2997299162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3058003a60 0x7f3058003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f3074e4e700 1 --2- 172.21.15.6:0/2997299162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580051c0 0x7f305800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.822+0000 7f306f7fe700 1 --2- 172.21.15.6:0/2997299162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3058004810 0x7f3058004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f3074e4e700 1 -- 172.21.15.6:0/2997299162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3058004810 msgr2=0x7f3058004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:40.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f3074e4e700 1 --2- 172.21.15.6:0/2997299162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3058004810 0x7f3058004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f3074e4e700 1 -- 172.21.15.6:0/2997299162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3058003a60 msgr2=0x7f3058003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:40.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f3074e4e700 1 --2- 172.21.15.6:0/2997299162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3058003a60 0x7f3058003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f3074e4e700 1 -- 172.21.15.6:0/2997299162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3058003570 con 0x7f30580051c0 2023-10-06T02:30:40.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f306ffff700 1 --2- 172.21.15.6:0/2997299162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3058003a60 0x7f3058003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:30:40.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f3074e4e700 1 -- 172.21.15.6:0/2997299162 reap_dead start 2023-10-06T02:30:40.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f3074e4e700 1 --2- 172.21.15.6:0/2997299162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580051c0 0x7f305800ba60 secure :-1 s=READY pgs=2534 cs=0 l=1 rev1=1 crypto rx=0x7f30680020a0 tx=0x7f30680016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c26ee4a0f66333 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:40.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f306effd700 1 -- 172.21.15.6:0/2997299162 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30680019e0 con 0x7f30580051c0 2023-10-06T02:30:40.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f306effd700 1 -- 172.21.15.6:0/2997299162 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306800c8b0 con 0x7f30580051c0 2023-10-06T02:30:40.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f306effd700 1 -- 172.21.15.6:0/2997299162 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800cc70 con 0x7f30580051c0 2023-10-06T02:30:40.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f30768b1700 1 -- 172.21.15.6:0/2997299162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580051c0 msgr2=0x7f305800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f30768b1700 1 --2- 172.21.15.6:0/2997299162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580051c0 0x7f305800ba60 secure :-1 s=READY pgs=2534 cs=0 l=1 rev1=1 crypto rx=0x7f30680020a0 tx=0x7f30680016d0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f30768b1700 1 -- 172.21.15.6:0/2997299162 shutdown_connections 2023-10-06T02:30:40.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f30768b1700 1 --2- 172.21.15.6:0/2997299162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580051c0 0x7f305800ba60 unknown :-1 s=CLOSED pgs=2534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f30768b1700 1 -- 172.21.15.6:0/2997299162 >> 172.21.15.6:0/2997299162 conn(0x7f307006a260 msgr2=0x7f30700cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:40.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f30768b1700 1 -- 172.21.15.6:0/2997299162 shutdown_connections 2023-10-06T02:30:40.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.823+0000 7f30768b1700 1 -- 172.21.15.6:0/2997299162 wait complete. 2023-10-06T02:30:40.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.825+0000 7f30768b1700 1 Processor -- start 2023-10-06T02:30:40.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.825+0000 7f30768b1700 1 -- start start 2023-10-06T02:30:40.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.825+0000 7f30768b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580051c0 0x7f3070169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.825+0000 7f30768b1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f307015a210 0x7f307015c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.825+0000 7f30768b1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30700afdd0 0x7f3070068680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f30768b1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307015af60 con 0x7f30580051c0 2023-10-06T02:30:40.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f30768b1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307015b240 con 0x7f307015a210 2023-10-06T02:30:40.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f30768b1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307015b520 con 0x7f30700afdd0 2023-10-06T02:30:40.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f306ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580051c0 0x7f3070169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f306ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580051c0 0x7f3070169ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37516/0 (socket says 172.21.15.6:37516) 2023-10-06T02:30:40.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f306ffff700 1 -- 172.21.15.6:0/1039985880 learned_addr learned my addr 172.21.15.6:0/1039985880 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:40.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f306f7fe700 1 --2- 172.21.15.6:0/1039985880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f307015a210 0x7f307015c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f3074e4e700 1 --2- 172.21.15.6:0/1039985880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30700afdd0 0x7f3070068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f306ffff700 1 -- 172.21.15.6:0/1039985880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30700afdd0 msgr2=0x7f3070068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f306ffff700 1 --2- 172.21.15.6:0/1039985880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30700afdd0 0x7f3070068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f306ffff700 1 -- 172.21.15.6:0/1039985880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f307015a210 msgr2=0x7f307015c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:40.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f306ffff700 1 --2- 172.21.15.6:0/1039985880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f307015a210 0x7f307015c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:40.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f306ffff700 1 -- 172.21.15.6:0/1039985880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307015b800 con 0x7f30580051c0 2023-10-06T02:30:40.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f306ffff700 1 --2- 172.21.15.6:0/1039985880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580051c0 0x7f3070169ae0 secure :-1 s=READY pgs=2535 cs=0 l=1 rev1=1 crypto rx=0x7f3060011d70 tx=0x7f30600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:40.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f3057fff700 1 -- 172.21.15.6:0/1039985880 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060011e50 con 0x7f30580051c0 2023-10-06T02:30:40.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f3057fff700 1 -- 172.21.15.6:0/1039985880 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306000fcd0 con 0x7f30580051c0 2023-10-06T02:30:40.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f3057fff700 1 -- 172.21.15.6:0/1039985880 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060014690 con 0x7f30580051c0 2023-10-06T02:30:40.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f30768b1700 1 -- 172.21.15.6:0/1039985880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f307016a020 con 0x7f30580051c0 2023-10-06T02:30:40.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.826+0000 7f30768b1700 1 -- 172.21.15.6:0/1039985880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307015cd20 con 0x7f30580051c0 2023-10-06T02:30:40.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.827+0000 7f30768b1700 1 -- 172.21.15.6:0/1039985880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f307016d320 con 0x7f30580051c0 2023-10-06T02:30:40.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.827+0000 7f3057fff700 1 -- 172.21.15.6:0/1039985880 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3060014a40 con 0x7f30580051c0 2023-10-06T02:30:40.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.828+0000 7f3057fff700 1 --2- 172.21.15.6:0/1039985880 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f305c066f30 0x7f305c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:40.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.828+0000 7f3057fff700 1 -- 172.21.15.6:0/1039985880 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f3060018070 con 0x7f30580051c0 2023-10-06T02:30:40.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.828+0000 7f306f7fe700 1 --2- 172.21.15.6:0/1039985880 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f305c066f30 0x7f305c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:40.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.829+0000 7f306f7fe700 1 --2- 172.21.15.6:0/1039985880 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f305c066f30 0x7f305c0693e0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f3064001d00 tx=0x7f3064009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:40.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:40.832+0000 7f3057fff700 1 -- 172.21.15.6:0/1039985880 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3060052320 con 0x7f30580051c0 2023-10-06T02:30:41.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.025+0000 7f30768b1700 1 -- 172.21.15.6:0/1039985880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f307016d110 con 0x7f30580051c0 2023-10-06T02:30:41.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.025+0000 7f3057fff700 1 -- 172.21.15.6:0/1039985880 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v149) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3060055940 con 0x7f30580051c0 2023-10-06T02:30:41.026 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-06T02:30:41.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.027+0000 7f30768b1700 1 -- 172.21.15.6:0/1039985880 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f305c066f30 msgr2=0x7f305c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.027+0000 7f30768b1700 1 --2- 172.21.15.6:0/1039985880 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f305c066f30 0x7f305c0693e0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f3064001d00 tx=0x7f3064009040 comp rx=0 tx=0).stop 2023-10-06T02:30:41.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.027+0000 7f30768b1700 1 -- 172.21.15.6:0/1039985880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580051c0 msgr2=0x7f3070169ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.027+0000 7f30768b1700 1 --2- 172.21.15.6:0/1039985880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580051c0 0x7f3070169ae0 secure :-1 s=READY pgs=2535 cs=0 l=1 rev1=1 crypto rx=0x7f3060011d70 tx=0x7f30600091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.027+0000 7f30768b1700 1 -- 172.21.15.6:0/1039985880 shutdown_connections 2023-10-06T02:30:41.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.027+0000 7f30768b1700 1 --2- 172.21.15.6:0/1039985880 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30700afdd0 0x7f3070068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.027+0000 7f30768b1700 1 --2- 172.21.15.6:0/1039985880 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f305c066f30 0x7f305c0693e0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.027+0000 7f30768b1700 1 --2- 172.21.15.6:0/1039985880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30580051c0 0x7f3070169ae0 unknown :-1 s=CLOSED pgs=2535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.027+0000 7f30768b1700 1 --2- 172.21.15.6:0/1039985880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f307015a210 0x7f307015c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.027+0000 7f30768b1700 1 -- 172.21.15.6:0/1039985880 >> 172.21.15.6:0/1039985880 conn(0x7f307006a260 msgr2=0x7f30700c3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:41.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.028+0000 7f30768b1700 1 -- 172.21.15.6:0/1039985880 shutdown_connections 2023-10-06T02:30:41.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.028+0000 7f30768b1700 1 -- 172.21.15.6:0/1039985880 wait complete. 2023-10-06T02:30:41.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:30:41.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.163+0000 7f3c00f0f700 1 Processor -- start 2023-10-06T02:30:41.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.163+0000 7f3c00f0f700 1 -- start start 2023-10-06T02:30:41.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.164+0000 7f3c00f0f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bfc0af400 0x7f3bfc0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.164+0000 7f3c00f0f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3bfc069d10 0x7f3bfc06a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.164+0000 7f3c00f0f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bfc0b06b0 con 0x7f3bfc0b0b40 2023-10-06T02:30:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.164+0000 7f3c00f0f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bfc06a6f0 con 0x7f3bfc069d10 2023-10-06T02:30:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.164+0000 7f3c00f0f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc0b2970 con 0x7f3bfc0af400 2023-10-06T02:30:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.164+0000 7f3bfbfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3bfc069d10 0x7f3bfc06a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.164+0000 7f3bfaffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3bfc0b0b40 0x7f3bfc15a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51524/0 (socket says 172.21.15.6:51524) 2023-10-06T02:30:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.164+0000 7f3bfaffd700 1 -- 172.21.15.6:0/64284226 learned_addr learned my addr 172.21.15.6:0/64284226 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.164+0000 7f3bfb7fe700 1 --2- 172.21.15.6:0/64284226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bfc0af400 0x7f3bfc0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.164+0000 7f3bfbfff700 1 -- 172.21.15.6:0/64284226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bfc0af400 msgr2=0x7f3bfc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.164+0000 7f3bfbfff700 1 --2- 172.21.15.6:0/64284226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bfc0af400 0x7f3bfc0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.164+0000 7f3bfbfff700 1 -- 172.21.15.6:0/64284226 >> v1:172.21.15.6:6789/0 conn(0x7f3bfc0b0b40 legacy=0x7f3bfc15a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.164+0000 7f3bfa7fc700 1 -- 172.21.15.6:0/64284226 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974667749 0 0) 0x7f3bfc0b06b0 con 0x7f3bfc0b0b40 2023-10-06T02:30:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.164+0000 7f3bfbfff700 1 -- 172.21.15.6:0/64284226 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc0afd80 con 0x7f3bfc069d10 2023-10-06T02:30:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.164+0000 7f3bfb7fe700 1 --2- 172.21.15.6:0/64284226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bfc0af400 0x7f3bfc0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.165+0000 7f3bfbfff700 1 --2- 172.21.15.6:0/64284226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bfc069d10 0x7f3bfc06a1b0 secure :-1 s=READY pgs=2537 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009e60 tx=0x7f3bf4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3cfed30a08f7d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.165+0000 7f3bfa7fc700 1 -- 172.21.15.6:0/64284226 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf400e070 con 0x7f3bfc069d10 2023-10-06T02:30:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.165+0000 7f3bfa7fc700 1 -- 172.21.15.6:0/64284226 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf400bc30 con 0x7f3bfc069d10 2023-10-06T02:30:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.165+0000 7f3bfa7fc700 1 -- 172.21.15.6:0/64284226 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4012430 con 0x7f3bfc069d10 2023-10-06T02:30:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.165+0000 7f3c00f0f700 1 -- 172.21.15.6:0/64284226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bfc069d10 msgr2=0x7f3bfc06a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.165+0000 7f3c00f0f700 1 --2- 172.21.15.6:0/64284226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bfc069d10 0x7f3bfc06a1b0 secure :-1 s=READY pgs=2537 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009e60 tx=0x7f3bf4009780 comp rx=0 tx=0).stop 2023-10-06T02:30:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.165+0000 7f3c00f0f700 1 -- 172.21.15.6:0/64284226 shutdown_connections 2023-10-06T02:30:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.165+0000 7f3c00f0f700 1 --2- 172.21.15.6:0/64284226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bfc069d10 0x7f3bfc06a1b0 unknown :-1 s=CLOSED pgs=2537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.165+0000 7f3c00f0f700 1 --2- 172.21.15.6:0/64284226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bfc0af400 0x7f3bfc0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.165+0000 7f3c00f0f700 1 -- 172.21.15.6:0/64284226 >> 172.21.15.6:0/64284226 conn(0x7f3bfc0d0c10 msgr2=0x7f3bfc0ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.165+0000 7f3c00f0f700 1 -- 172.21.15.6:0/64284226 shutdown_connections 2023-10-06T02:30:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.165+0000 7f3c00f0f700 1 -- 172.21.15.6:0/64284226 wait complete. 2023-10-06T02:30:41.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.167+0000 7f3c00f0f700 1 Processor -- start 2023-10-06T02:30:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.167+0000 7f3c00f0f700 1 -- start start 2023-10-06T02:30:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.167+0000 7f3c00f0f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bfc069d10 0x7f3bfc14f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.167+0000 7f3c00f0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bfc0af400 0x7f3bfc0c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.167+0000 7f3c00f0f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bfc0b0b40 0x7f3bfc0c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.167+0000 7f3c00f0f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc0cf4e0 con 0x7f3bfc0af400 2023-10-06T02:30:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.167+0000 7f3c00f0f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc15b8a0 con 0x7f3bfc069d10 2023-10-06T02:30:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.167+0000 7f3c00f0f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc0c4680 con 0x7f3bfc0b0b40 2023-10-06T02:30:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.167+0000 7f3bfaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bfc0af400 0x7f3bfc0c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.167+0000 7f3bfaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bfc0af400 0x7f3bfc0c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37536/0 (socket says 172.21.15.6:37536) 2023-10-06T02:30:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.167+0000 7f3bfaffd700 1 -- 172.21.15.6:0/3651354440 learned_addr learned my addr 172.21.15.6:0/3651354440 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.168+0000 7f3bfbfff700 1 --2- 172.21.15.6:0/3651354440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bfc0b0b40 0x7f3bfc0c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.168+0000 7f3bfb7fe700 1 --2- 172.21.15.6:0/3651354440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bfc069d10 0x7f3bfc14f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.168+0000 7f3bfaffd700 1 -- 172.21.15.6:0/3651354440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bfc0b0b40 msgr2=0x7f3bfc0c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.168+0000 7f3bfaffd700 1 --2- 172.21.15.6:0/3651354440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bfc0b0b40 0x7f3bfc0c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.168+0000 7f3bfaffd700 1 -- 172.21.15.6:0/3651354440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bfc069d10 msgr2=0x7f3bfc14f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.168+0000 7f3bfaffd700 1 --2- 172.21.15.6:0/3651354440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bfc069d10 0x7f3bfc14f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.168+0000 7f3bfaffd700 1 -- 172.21.15.6:0/3651354440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf4009a20 con 0x7f3bfc0af400 2023-10-06T02:30:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.168+0000 7f3bfaffd700 1 --2- 172.21.15.6:0/3651354440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bfc0af400 0x7f3bfc0c3ac0 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000c5e0 tx=0x7f3bf0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.168+0000 7f3be37fe700 1 -- 172.21.15.6:0/3651354440 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0005b30 con 0x7f3bfc0af400 2023-10-06T02:30:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.168+0000 7f3be37fe700 1 -- 172.21.15.6:0/3651354440 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf0005c90 con 0x7f3bfc0af400 2023-10-06T02:30:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.168+0000 7f3c00f0f700 1 -- 172.21.15.6:0/3651354440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bfc0c4960 con 0x7f3bfc0af400 2023-10-06T02:30:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.168+0000 7f3be37fe700 1 -- 172.21.15.6:0/3651354440 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0007300 con 0x7f3bfc0af400 2023-10-06T02:30:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.168+0000 7f3c00f0f700 1 -- 172.21.15.6:0/3651354440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bfc0c4f20 con 0x7f3bfc0af400 2023-10-06T02:30:41.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.169+0000 7f3c00f0f700 1 -- 172.21.15.6:0/3651354440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bfc064ee0 con 0x7f3bfc0af400 2023-10-06T02:30:41.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.170+0000 7f3be37fe700 1 -- 172.21.15.6:0/3651354440 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bf001b3b0 con 0x7f3bfc0af400 2023-10-06T02:30:41.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.170+0000 7f3be37fe700 1 --2- 172.21.15.6:0/3651354440 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3be8066f30 0x7f3be80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.170+0000 7f3be37fe700 1 -- 172.21.15.6:0/3651354440 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f3bf0083f20 con 0x7f3bfc0af400 2023-10-06T02:30:41.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.170+0000 7f3bfb7fe700 1 --2- 172.21.15.6:0/3651354440 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3be8066f30 0x7f3be80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.171+0000 7f3bfb7fe700 1 --2- 172.21.15.6:0/3651354440 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3be8066f30 0x7f3be80693e0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00ac00 tx=0x7f3bec006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:41.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.174+0000 7f3be37fe700 1 -- 172.21.15.6:0/3651354440 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bf0050dd0 con 0x7f3bfc0af400 2023-10-06T02:30:41.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.366+0000 7f3c00f0f700 1 -- 172.21.15.6:0/3651354440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3bfc064aa0 con 0x7f3bfc0af400 2023-10-06T02:30:41.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.367+0000 7f3be37fe700 1 -- 172.21.15.6:0/3651354440 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v149) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3bf0017020 con 0x7f3bfc0af400 2023-10-06T02:30:41.368 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-06T02:30:41.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.369+0000 7f3c00f0f700 1 -- 172.21.15.6:0/3651354440 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3be8066f30 msgr2=0x7f3be80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.369+0000 7f3c00f0f700 1 --2- 172.21.15.6:0/3651354440 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3be8066f30 0x7f3be80693e0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00ac00 tx=0x7f3bec006f90 comp rx=0 tx=0).stop 2023-10-06T02:30:41.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.369+0000 7f3c00f0f700 1 -- 172.21.15.6:0/3651354440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bfc0af400 msgr2=0x7f3bfc0c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.369+0000 7f3c00f0f700 1 --2- 172.21.15.6:0/3651354440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bfc0af400 0x7f3bfc0c3ac0 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000c5e0 tx=0x7f3bf0000fe0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.369+0000 7f3c00f0f700 1 -- 172.21.15.6:0/3651354440 shutdown_connections 2023-10-06T02:30:41.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.369+0000 7f3c00f0f700 1 --2- 172.21.15.6:0/3651354440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bfc0b0b40 0x7f3bfc0c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.369+0000 7f3c00f0f700 1 --2- 172.21.15.6:0/3651354440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bfc069d10 0x7f3bfc14f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.369+0000 7f3c00f0f700 1 --2- 172.21.15.6:0/3651354440 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3be8066f30 0x7f3be80693e0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.369+0000 7f3c00f0f700 1 --2- 172.21.15.6:0/3651354440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bfc0af400 0x7f3bfc0c3ac0 unknown :-1 s=CLOSED pgs=2538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.369+0000 7f3c00f0f700 1 -- 172.21.15.6:0/3651354440 >> 172.21.15.6:0/3651354440 conn(0x7f3bfc0d0c10 msgr2=0x7f3bfc1589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:41.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.369+0000 7f3c00f0f700 1 -- 172.21.15.6:0/3651354440 shutdown_connections 2023-10-06T02:30:41.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.369+0000 7f3c00f0f700 1 -- 172.21.15.6:0/3651354440 wait complete. 2023-10-06T02:30:41.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:30:41.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.503+0000 7fc4a0e34700 1 Processor -- start 2023-10-06T02:30:41.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.503+0000 7fc4a0e34700 1 -- start start 2023-10-06T02:30:41.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc4a0e34700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc49c15a030 0x7fc49c15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc4a0e34700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc49c087700 0x7fc49c0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc4a0e34700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc49c0afc50 con 0x7fc49c15a940 2023-10-06T02:30:41.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc4a0e34700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49c0b0cf0 con 0x7fc49c15a030 2023-10-06T02:30:41.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc4a0e34700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c0aff30 con 0x7fc49c087700 2023-10-06T02:30:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc49a59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc49c15a030 0x7fc49c15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc499d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc49c15a940 0x7fc49c086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51536/0 (socket says 172.21.15.6:51536) 2023-10-06T02:30:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc499d9b700 1 -- 172.21.15.6:0/2089323518 learned_addr learned my addr 172.21.15.6:0/2089323518 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc49ad9d700 1 --2- 172.21.15.6:0/2089323518 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc49c087700 0x7fc49c0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc49a59c700 1 -- 172.21.15.6:0/2089323518 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc49c087700 msgr2=0x7fc49c0b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc49a59c700 1 --2- 172.21.15.6:0/2089323518 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc49c087700 0x7fc49c0b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc49a59c700 1 -- 172.21.15.6:0/2089323518 >> v1:172.21.15.6:6789/0 conn(0x7fc49c15a940 legacy=0x7fc49c086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc49959a700 1 -- 172.21.15.6:0/2089323518 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890176671 0 0) 0x7fc49c0afc50 con 0x7fc49c15a940 2023-10-06T02:30:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc49a59c700 1 -- 172.21.15.6:0/2089323518 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c0b0210 con 0x7fc49c15a030 2023-10-06T02:30:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc49ad9d700 1 --2- 172.21.15.6:0/2089323518 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc49c087700 0x7fc49c0b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc49a59c700 1 --2- 172.21.15.6:0/2089323518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c15a030 0x7fc49c15a400 secure :-1 s=READY pgs=2540 cs=0 l=1 rev1=1 crypto rx=0x7fc4940098e0 tx=0x7fc4940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e9315789aa5eb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc49959a700 1 -- 172.21.15.6:0/2089323518 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494009e80 con 0x7fc49c15a030 2023-10-06T02:30:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc49959a700 1 -- 172.21.15.6:0/2089323518 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49400b860 con 0x7fc49c15a030 2023-10-06T02:30:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.504+0000 7fc49959a700 1 -- 172.21.15.6:0/2089323518 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49400bbe0 con 0x7fc49c15a030 2023-10-06T02:30:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.505+0000 7fc4a0e34700 1 -- 172.21.15.6:0/2089323518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c15a030 msgr2=0x7fc49c15a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.505+0000 7fc4a0e34700 1 --2- 172.21.15.6:0/2089323518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c15a030 0x7fc49c15a400 secure :-1 s=READY pgs=2540 cs=0 l=1 rev1=1 crypto rx=0x7fc4940098e0 tx=0x7fc4940091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.505+0000 7fc4a0e34700 1 -- 172.21.15.6:0/2089323518 shutdown_connections 2023-10-06T02:30:41.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.505+0000 7fc4a0e34700 1 --2- 172.21.15.6:0/2089323518 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc49c087700 0x7fc49c0b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.505+0000 7fc4a0e34700 1 --2- 172.21.15.6:0/2089323518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c15a030 0x7fc49c15a400 unknown :-1 s=CLOSED pgs=2540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.505+0000 7fc4a0e34700 1 -- 172.21.15.6:0/2089323518 >> 172.21.15.6:0/2089323518 conn(0x7fc49c068680 msgr2=0x7fc49c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:41.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.505+0000 7fc4a0e34700 1 -- 172.21.15.6:0/2089323518 shutdown_connections 2023-10-06T02:30:41.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.505+0000 7fc4a0e34700 1 -- 172.21.15.6:0/2089323518 wait complete. 2023-10-06T02:30:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.506+0000 7fc4a0e34700 1 Processor -- start 2023-10-06T02:30:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.506+0000 7fc4a0e34700 1 -- start start 2023-10-06T02:30:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc4a0e34700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc49c087700 0x7fc49c0c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc4a0e34700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc49c15a030 0x7fc49c16a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc4a0e34700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c15a940 0x7fc49c0c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc4a0e34700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c16b160 con 0x7fc49c15a940 2023-10-06T02:30:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc4a0e34700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c1566a0 con 0x7fc49c15a030 2023-10-06T02:30:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc4a0e34700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c16a5f0 con 0x7fc49c087700 2023-10-06T02:30:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc49ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c15a940 0x7fc49c0c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc49ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c15a940 0x7fc49c0c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37554/0 (socket says 172.21.15.6:37554) 2023-10-06T02:30:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc49ad9d700 1 -- 172.21.15.6:0/1024005374 learned_addr learned my addr 172.21.15.6:0/1024005374 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc49a59c700 1 --2- 172.21.15.6:0/1024005374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc49c087700 0x7fc49c0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc49ad9d700 1 -- 172.21.15.6:0/1024005374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc49c087700 msgr2=0x7fc49c0c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc49ad9d700 1 --2- 172.21.15.6:0/1024005374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc49c087700 0x7fc49c0c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc49ad9d700 1 -- 172.21.15.6:0/1024005374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc49c15a030 msgr2=0x7fc49c16a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc499d9b700 1 --2- 172.21.15.6:0/1024005374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc49c15a030 0x7fc49c16a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc49ad9d700 1 --2- 172.21.15.6:0/1024005374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc49c15a030 0x7fc49c16a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc49ad9d700 1 -- 172.21.15.6:0/1024005374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc494009420 con 0x7fc49c15a940 2023-10-06T02:30:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc49a59c700 1 --2- 172.21.15.6:0/1024005374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc49c087700 0x7fc49c0c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.507+0000 7fc49ad9d700 1 --2- 172.21.15.6:0/1024005374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c15a940 0x7fc49c0c9550 secure :-1 s=READY pgs=2541 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00d150 tx=0x7fc48c009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.508+0000 7fc4927fc700 1 -- 172.21.15.6:0/1024005374 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c00ddf0 con 0x7fc49c15a940 2023-10-06T02:30:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.508+0000 7fc4927fc700 1 -- 172.21.15.6:0/1024005374 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48c00f040 con 0x7fc49c15a940 2023-10-06T02:30:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.508+0000 7fc4a0e34700 1 -- 172.21.15.6:0/1024005374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49c16a8c0 con 0x7fc49c15a940 2023-10-06T02:30:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.508+0000 7fc4927fc700 1 -- 172.21.15.6:0/1024005374 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c015690 con 0x7fc49c15a940 2023-10-06T02:30:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.508+0000 7fc4a0e34700 1 -- 172.21.15.6:0/1024005374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49c16ae80 con 0x7fc49c15a940 2023-10-06T02:30:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.508+0000 7fc4a0e34700 1 -- 172.21.15.6:0/1024005374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49c0c4b90 con 0x7fc49c15a940 2023-10-06T02:30:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.509+0000 7fc4927fc700 1 -- 172.21.15.6:0/1024005374 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc48c01e3b0 con 0x7fc49c15a940 2023-10-06T02:30:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.509+0000 7fc4927fc700 1 --2- 172.21.15.6:0/1024005374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc47c066f30 0x7fc47c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.509+0000 7fc4927fc700 1 -- 172.21.15.6:0/1024005374 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fc48c084ec0 con 0x7fc49c15a940 2023-10-06T02:30:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.510+0000 7fc49a59c700 1 --2- 172.21.15.6:0/1024005374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc47c066f30 0x7fc47c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.510+0000 7fc49a59c700 1 --2- 172.21.15.6:0/1024005374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc47c066f30 0x7fc47c0693e0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0c87b0 tx=0x7fc494017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.513+0000 7fc4927fc700 1 -- 172.21.15.6:0/1024005374 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc49c0c4b90 con 0x7fc49c15a940 2023-10-06T02:30:41.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.705+0000 7fc4a0e34700 1 -- 172.21.15.6:0/1024005374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc49c0c4b90 con 0x7fc49c15a940 2023-10-06T02:30:41.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.705+0000 7fc4927fc700 1 -- 172.21.15.6:0/1024005374 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v149) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc49c0c4b90 con 0x7fc49c15a940 2023-10-06T02:30:41.706 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-06T02:30:41.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.707+0000 7fc4a0e34700 1 -- 172.21.15.6:0/1024005374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc47c066f30 msgr2=0x7fc47c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.707+0000 7fc4a0e34700 1 --2- 172.21.15.6:0/1024005374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc47c066f30 0x7fc47c0693e0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0c87b0 tx=0x7fc494017000 comp rx=0 tx=0).stop 2023-10-06T02:30:41.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.707+0000 7fc4a0e34700 1 -- 172.21.15.6:0/1024005374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c15a940 msgr2=0x7fc49c0c9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.707+0000 7fc4a0e34700 1 --2- 172.21.15.6:0/1024005374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c15a940 0x7fc49c0c9550 secure :-1 s=READY pgs=2541 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00d150 tx=0x7fc48c009a50 comp rx=0 tx=0).stop 2023-10-06T02:30:41.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.707+0000 7fc4a0e34700 1 -- 172.21.15.6:0/1024005374 shutdown_connections 2023-10-06T02:30:41.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.707+0000 7fc4a0e34700 1 --2- 172.21.15.6:0/1024005374 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc47c066f30 0x7fc47c0693e0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.707+0000 7fc4a0e34700 1 --2- 172.21.15.6:0/1024005374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c15a940 0x7fc49c0c9550 unknown :-1 s=CLOSED pgs=2541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.707+0000 7fc4a0e34700 1 --2- 172.21.15.6:0/1024005374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc49c087700 0x7fc49c0c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.707+0000 7fc4a0e34700 1 --2- 172.21.15.6:0/1024005374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc49c15a030 0x7fc49c16a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.707+0000 7fc4a0e34700 1 -- 172.21.15.6:0/1024005374 >> 172.21.15.6:0/1024005374 conn(0x7fc49c068680 msgr2=0x7fc49c0cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:41.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.707+0000 7fc4a0e34700 1 -- 172.21.15.6:0/1024005374 shutdown_connections 2023-10-06T02:30:41.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.707+0000 7fc4a0e34700 1 -- 172.21.15.6:0/1024005374 wait complete. 2023-10-06T02:30:41.720 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:30:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.838+0000 7f523c988700 1 Processor -- start 2023-10-06T02:30:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.839+0000 7f523c988700 1 -- start start 2023-10-06T02:30:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.839+0000 7f523c988700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52380af4e0 0x7f52380b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.839+0000 7f523c988700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523815e190 con 0x7f52380af8b0 2023-10-06T02:30:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.839+0000 7f523c988700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52380cb650 con 0x7f523815db70 2023-10-06T02:30:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.839+0000 7f523c988700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52380b1910 con 0x7f52380af4e0 2023-10-06T02:30:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f5235d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f52380af8b0 0x7f523815d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51544/0 (socket says 172.21.15.6:51544) 2023-10-06T02:30:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f5235d9b700 1 -- 172.21.15.6:0/3812073909 learned_addr learned my addr 172.21.15.6:0/3812073909 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f523659c700 1 --2- 172.21.15.6:0/3812073909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52380af4e0 0x7f52380b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f523559a700 1 -- 172.21.15.6:0/3812073909 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024525170 0 0) 0x7f523815e190 con 0x7f52380af8b0 2023-10-06T02:30:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f523559a700 1 -- 172.21.15.6:0/3812073909 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5224003570 con 0x7f52380af8b0 2023-10-06T02:30:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f523559a700 1 -- 172.21.15.6:0/3812073909 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2711286863 0 0) 0x7f5224003570 con 0x7f52380af8b0 2023-10-06T02:30:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f523559a700 1 -- 172.21.15.6:0/3812073909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52380af4e0 msgr2=0x7f52380b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f523559a700 1 --2- 172.21.15.6:0/3812073909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52380af4e0 0x7f52380b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f523559a700 1 -- 172.21.15.6:0/3812073909 >> v1:172.21.15.175:6789/0 conn(0x7f523815db70 legacy=0x7f52380cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f523559a700 1 -- 172.21.15.6:0/3812073909 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52380cad20 con 0x7f52380af8b0 2023-10-06T02:30:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f523559a700 1 -- 172.21.15.6:0/3812073909 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f5220001470 con 0x7f52380af8b0 2023-10-06T02:30:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f523559a700 1 -- 172.21.15.6:0/3812073909 >> v1:172.21.15.6:6789/0 conn(0x7f52380af8b0 legacy=0x7f523815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f523559a700 1 --2- 172.21.15.6:0/3812073909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5224003a90 0x7f5224003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f523559a700 1 --2- 172.21.15.6:0/3812073909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5224004810 0x7f5224004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f523559a700 1 --2- 172.21.15.6:0/3812073909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52380af4e0 0x7f52240051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f523559a700 1 -- 172.21.15.6:0/3812073909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52380b1910 con 0x7f5224004810 2023-10-06T02:30:41.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f523559a700 1 -- 172.21.15.6:0/3812073909 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522400bb60 con 0x7f5224003a90 2023-10-06T02:30:41.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f523559a700 1 -- 172.21.15.6:0/3812073909 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522400bd20 con 0x7f52380af4e0 2023-10-06T02:30:41.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f5235d9b700 1 --2- 172.21.15.6:0/3812073909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5224004810 0x7f5224004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f523659c700 1 --2- 172.21.15.6:0/3812073909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5224003a90 0x7f5224003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.840+0000 7f5236d9d700 1 --2- 172.21.15.6:0/3812073909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52380af4e0 0x7f52240051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.841+0000 7f5235d9b700 1 -- 172.21.15.6:0/3812073909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52380af4e0 msgr2=0x7f52240051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:41.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.841+0000 7f5235d9b700 1 --2- 172.21.15.6:0/3812073909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52380af4e0 0x7f52240051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.841+0000 7f5235d9b700 1 -- 172.21.15.6:0/3812073909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5224003a90 msgr2=0x7f5224003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:41.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.841+0000 7f5235d9b700 1 --2- 172.21.15.6:0/3812073909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5224003a90 0x7f5224003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.841+0000 7f5235d9b700 1 -- 172.21.15.6:0/3812073909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5224003570 con 0x7f5224004810 2023-10-06T02:30:41.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.841+0000 7f5235d9b700 1 --2- 172.21.15.6:0/3812073909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5224004810 0x7f5224004c80 secure :-1 s=READY pgs=2543 cs=0 l=1 rev1=1 crypto rx=0x7f522000c3c0 tx=0x7f5220001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b003a182c100a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:41.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.841+0000 7f523559a700 1 -- 172.21.15.6:0/3812073909 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522000cc90 con 0x7f5224004810 2023-10-06T02:30:41.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.841+0000 7f523559a700 1 -- 172.21.15.6:0/3812073909 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522000cdf0 con 0x7f5224004810 2023-10-06T02:30:41.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.841+0000 7f523559a700 1 -- 172.21.15.6:0/3812073909 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220005b50 con 0x7f5224004810 2023-10-06T02:30:41.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.842+0000 7f523c988700 1 -- 172.21.15.6:0/3812073909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5224004810 msgr2=0x7f5224004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.842+0000 7f523c988700 1 --2- 172.21.15.6:0/3812073909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5224004810 0x7f5224004c80 secure :-1 s=READY pgs=2543 cs=0 l=1 rev1=1 crypto rx=0x7f522000c3c0 tx=0x7f5220001e50 comp rx=0 tx=0).stop 2023-10-06T02:30:41.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.842+0000 7f5236d9d700 1 -- 172.21.15.6:0/3812073909 reap_dead start 2023-10-06T02:30:41.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.842+0000 7f523c988700 1 -- 172.21.15.6:0/3812073909 shutdown_connections 2023-10-06T02:30:41.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.842+0000 7f523c988700 1 -- 172.21.15.6:0/3812073909 >> 172.21.15.6:0/3812073909 conn(0x7f5238068680 msgr2=0x7f5238068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:41.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.842+0000 7f523c988700 1 -- 172.21.15.6:0/3812073909 shutdown_connections 2023-10-06T02:30:41.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.842+0000 7f523c988700 1 -- 172.21.15.6:0/3812073909 wait complete. 2023-10-06T02:30:41.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.843+0000 7f523c988700 1 Processor -- start 2023-10-06T02:30:41.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.843+0000 7f523c988700 1 -- start start 2023-10-06T02:30:41.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.843+0000 7f523c988700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5224004810 0x7f5238152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.843+0000 7f523c988700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5238158240 0x7f52381537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.843+0000 7f523c988700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5238169910 0x7f52380b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.843+0000 7f523c988700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523815dfb0 con 0x7f5238158240 2023-10-06T02:30:41.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.843+0000 7f523c988700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5238153320 con 0x7f5224004810 2023-10-06T02:30:41.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.843+0000 7f523c988700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5238152390 con 0x7f5238169910 2023-10-06T02:30:41.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.844+0000 7f5235d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5238158240 0x7f52381537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.844+0000 7f5235d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5238158240 0x7f52381537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37574/0 (socket says 172.21.15.6:37574) 2023-10-06T02:30:41.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.844+0000 7f5235d9b700 1 -- 172.21.15.6:0/4095562586 learned_addr learned my addr 172.21.15.6:0/4095562586 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:41.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.844+0000 7f523659c700 1 --2- 172.21.15.6:0/4095562586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5224004810 0x7f5238152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.844+0000 7f5236d9d700 1 --2- 172.21.15.6:0/4095562586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5238169910 0x7f52380b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.844+0000 7f5235d9b700 1 -- 172.21.15.6:0/4095562586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5238169910 msgr2=0x7f52380b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.844+0000 7f5235d9b700 1 --2- 172.21.15.6:0/4095562586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5238169910 0x7f52380b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.844+0000 7f5235d9b700 1 -- 172.21.15.6:0/4095562586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5224004810 msgr2=0x7f5238152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:41.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.844+0000 7f5235d9b700 1 --2- 172.21.15.6:0/4095562586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5224004810 0x7f5238152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:41.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.844+0000 7f5235d9b700 1 -- 172.21.15.6:0/4095562586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52381586b0 con 0x7f5238158240 2023-10-06T02:30:41.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.844+0000 7f5235d9b700 1 --2- 172.21.15.6:0/4095562586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5238158240 0x7f52381537d0 secure :-1 s=READY pgs=2544 cs=0 l=1 rev1=1 crypto rx=0x7f522000c9b0 tx=0x7f5220015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:41.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.844+0000 7f522e7fc700 1 -- 172.21.15.6:0/4095562586 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52200070d0 con 0x7f5238158240 2023-10-06T02:30:41.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.844+0000 7f522e7fc700 1 -- 172.21.15.6:0/4095562586 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5220007250 con 0x7f5238158240 2023-10-06T02:30:41.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.844+0000 7f523c988700 1 -- 172.21.15.6:0/4095562586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5238158990 con 0x7f5238158240 2023-10-06T02:30:41.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.844+0000 7f522e7fc700 1 -- 172.21.15.6:0/4095562586 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220007610 con 0x7f5238158240 2023-10-06T02:30:41.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.844+0000 7f523c988700 1 -- 172.21.15.6:0/4095562586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52381528c0 con 0x7f5238158240 2023-10-06T02:30:41.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.845+0000 7f523c988700 1 -- 172.21.15.6:0/4095562586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5238088aa0 con 0x7f5238158240 2023-10-06T02:30:41.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.846+0000 7f522e7fc700 1 -- 172.21.15.6:0/4095562586 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5220019030 con 0x7f5238158240 2023-10-06T02:30:41.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.846+0000 7f522e7fc700 1 --2- 172.21.15.6:0/4095562586 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5218066f30 0x7f52180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:41.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.846+0000 7f522e7fc700 1 -- 172.21.15.6:0/4095562586 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f5220085b40 con 0x7f5238158240 2023-10-06T02:30:41.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.846+0000 7f523659c700 1 --2- 172.21.15.6:0/4095562586 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5218066f30 0x7f52180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:41.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.847+0000 7f523659c700 1 --2- 172.21.15.6:0/4095562586 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5218066f30 0x7f52180693e0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f5230006f00 tx=0x7f52300091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:41.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:41.850+0000 7f522e7fc700 1 -- 172.21.15.6:0/4095562586 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5220052a80 con 0x7f5238158240 2023-10-06T02:30:42.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.091+0000 7f523c988700 1 -- 172.21.15.6:0/4095562586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52380cb000 con 0x7f5238158240 2023-10-06T02:30:42.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.091+0000 7f522e7fc700 1 -- 172.21.15.6:0/4095562586 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 366 v366) v1 ==== 95+0+4608 (secure 0 0 0) 0x7f5220017090 con 0x7f5238158240 2023-10-06T02:30:42.092 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:42.092 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":366,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3603762205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3603762205},{"type":"v1","addr":"172.21.15.175:6836","nonce":3603762205}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":9820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3292446255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3292446255},{"type":"v1","addr":"172.21.15.175:6837","nonce":3292446255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":10869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/759655214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":759655214},{"type":"v1","addr":"172.21.15.6:6834","nonce":759655214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354}],"filesystems":[{"mdsmap":{"epoch":366,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:30:06.715272+0000","modified":"2023-10-06T02:30:39.086477+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11088":{"gid":11088,"name":"c","rank":0,"incarnation":362,"state":"up:active","state_seq":6,"addr":"172.21.15.6:6835/3837760829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3837760829},{"type":"v1","addr":"172.21.15.6:6835","nonce":3837760829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:30:42.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.094+0000 7f523c988700 1 -- 172.21.15.6:0/4095562586 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5218066f30 msgr2=0x7f52180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.094+0000 7f523c988700 1 --2- 172.21.15.6:0/4095562586 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5218066f30 0x7f52180693e0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f5230006f00 tx=0x7f52300091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.094+0000 7f523c988700 1 -- 172.21.15.6:0/4095562586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5238158240 msgr2=0x7f52381537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.094+0000 7f523c988700 1 --2- 172.21.15.6:0/4095562586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5238158240 0x7f52381537d0 secure :-1 s=READY pgs=2544 cs=0 l=1 rev1=1 crypto rx=0x7f522000c9b0 tx=0x7f5220015000 comp rx=0 tx=0).stop 2023-10-06T02:30:42.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.094+0000 7f523c988700 1 -- 172.21.15.6:0/4095562586 shutdown_connections 2023-10-06T02:30:42.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.094+0000 7f523c988700 1 --2- 172.21.15.6:0/4095562586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5238169910 0x7f52380b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.094+0000 7f523c988700 1 --2- 172.21.15.6:0/4095562586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5224004810 0x7f5238152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.094+0000 7f523c988700 1 --2- 172.21.15.6:0/4095562586 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5218066f30 0x7f52180693e0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.094+0000 7f523c988700 1 --2- 172.21.15.6:0/4095562586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5238158240 0x7f52381537d0 unknown :-1 s=CLOSED pgs=2544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.094+0000 7f523c988700 1 -- 172.21.15.6:0/4095562586 >> 172.21.15.6:0/4095562586 conn(0x7f5238068680 msgr2=0x7f52380b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:42.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.094+0000 7f523c988700 1 -- 172.21.15.6:0/4095562586 shutdown_connections 2023-10-06T02:30:42.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.094+0000 7f523c988700 1 -- 172.21.15.6:0/4095562586 wait complete. 2023-10-06T02:30:42.096 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 366 2023-10-06T02:30:42.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:30:42.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.225+0000 7fa0645e8700 1 Processor -- start 2023-10-06T02:30:42.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.225+0000 7fa0645e8700 1 -- start start 2023-10-06T02:30:42.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.226+0000 7fa0645e8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa05c0b27f0 0x7fa05c15db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:42.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.226+0000 7fa0645e8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05c15e190 con 0x7fa05c0af4e0 2023-10-06T02:30:42.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.226+0000 7fa0645e8700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05c0cb650 con 0x7fa05c0af8b0 2023-10-06T02:30:42.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.226+0000 7fa0645e8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa05c0b1910 con 0x7fa05c0b27f0 2023-10-06T02:30:42.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.226+0000 7fa062b85700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa05c0b27f0 0x7fa05c15db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:42.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.226+0000 7fa062384700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa05c0af4e0 0x7fa05c0b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51554/0 (socket says 172.21.15.6:51554) 2023-10-06T02:30:42.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.226+0000 7fa062b85700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa05c0b27f0 0x7fa05c15db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37588/0 (socket says 172.21.15.6:37588) 2023-10-06T02:30:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.226+0000 7fa062384700 1 -- 172.21.15.6:0/3801065124 learned_addr learned my addr 172.21.15.6:0/3801065124 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.226+0000 7fa062b85700 1 -- 172.21.15.6:0/3801065124 >> v1:172.21.15.175:6789/0 conn(0x7fa05c0af8b0 legacy=0x7fa05c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.226+0000 7fa062b85700 1 -- 172.21.15.6:0/3801065124 >> v1:172.21.15.6:6789/0 conn(0x7fa05c0af4e0 legacy=0x7fa05c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.226+0000 7fa062b85700 1 -- 172.21.15.6:0/3801065124 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c0ccaf0 con 0x7fa05c0b27f0 2023-10-06T02:30:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.226+0000 7fa061382700 1 -- 172.21.15.6:0/3801065124 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232601867 0 0) 0x7fa05c15e190 con 0x7fa05c0af4e0 2023-10-06T02:30:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.226+0000 7fa062b85700 1 --2- 172.21.15.6:0/3801065124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa05c0b27f0 0x7fa05c15db70 secure :-1 s=READY pgs=2546 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009e60 tx=0x7fa04c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e209610e2377b10 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.226+0000 7fa061382700 1 -- 172.21.15.6:0/3801065124 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c00e070 con 0x7fa05c0b27f0 2023-10-06T02:30:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.226+0000 7fa061382700 1 -- 172.21.15.6:0/3801065124 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04c00bbf0 con 0x7fa05c0b27f0 2023-10-06T02:30:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.226+0000 7fa061382700 1 -- 172.21.15.6:0/3801065124 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c012430 con 0x7fa05c0b27f0 2023-10-06T02:30:42.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.227+0000 7fa0645e8700 1 -- 172.21.15.6:0/3801065124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa05c0b27f0 msgr2=0x7fa05c15db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.227+0000 7fa0645e8700 1 --2- 172.21.15.6:0/3801065124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa05c0b27f0 0x7fa05c15db70 secure :-1 s=READY pgs=2546 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009e60 tx=0x7fa04c009780 comp rx=0 tx=0).stop 2023-10-06T02:30:42.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.227+0000 7fa0645e8700 1 -- 172.21.15.6:0/3801065124 shutdown_connections 2023-10-06T02:30:42.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.227+0000 7fa0645e8700 1 --2- 172.21.15.6:0/3801065124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa05c0b27f0 0x7fa05c15db70 unknown :-1 s=CLOSED pgs=2546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.227+0000 7fa0645e8700 1 -- 172.21.15.6:0/3801065124 >> 172.21.15.6:0/3801065124 conn(0x7fa05c068680 msgr2=0x7fa05c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:42.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.227+0000 7fa0645e8700 1 -- 172.21.15.6:0/3801065124 shutdown_connections 2023-10-06T02:30:42.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.227+0000 7fa0645e8700 1 -- 172.21.15.6:0/3801065124 wait complete. 2023-10-06T02:30:42.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.228+0000 7fa0645e8700 1 Processor -- start 2023-10-06T02:30:42.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.228+0000 7fa0645e8700 1 -- start start 2023-10-06T02:30:42.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa0645e8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa05c0af4e0 0x7fa05c0c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:42.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa0645e8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa05c0af8b0 0x7fa05c151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:42.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa0645e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa05c0b27f0 0x7fa05c152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:42.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa0645e8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0c8480 con 0x7fa05c0b27f0 2023-10-06T02:30:42.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa0645e8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0c8a40 con 0x7fa05c0af4e0 2023-10-06T02:30:42.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa0645e8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c154c90 con 0x7fa05c0af8b0 2023-10-06T02:30:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa062b85700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa05c0b27f0 0x7fa05c152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa062b85700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa05c0b27f0 0x7fa05c152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37602/0 (socket says 172.21.15.6:37602) 2023-10-06T02:30:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa062b85700 1 -- 172.21.15.6:0/795093141 learned_addr learned my addr 172.21.15.6:0/795093141 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa061b83700 1 --2- 172.21.15.6:0/795093141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa05c0af8b0 0x7fa05c151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa062384700 1 --2- 172.21.15.6:0/795093141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa05c0af4e0 0x7fa05c0c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa062b85700 1 -- 172.21.15.6:0/795093141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa05c0af8b0 msgr2=0x7fa05c151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa062b85700 1 --2- 172.21.15.6:0/795093141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa05c0af8b0 0x7fa05c151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa062b85700 1 -- 172.21.15.6:0/795093141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa05c0af4e0 msgr2=0x7fa05c0c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa062b85700 1 --2- 172.21.15.6:0/795093141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa05c0af4e0 0x7fa05c0c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa062b85700 1 -- 172.21.15.6:0/795093141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c009a20 con 0x7fa05c0b27f0 2023-10-06T02:30:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa062384700 1 --2- 172.21.15.6:0/795093141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa05c0af4e0 0x7fa05c0c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.229+0000 7fa062b85700 1 --2- 172.21.15.6:0/795093141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa05c0b27f0 0x7fa05c152300 secure :-1 s=READY pgs=2547 cs=0 l=1 rev1=1 crypto rx=0x7fa04c012e50 tx=0x7fa04c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.230+0000 7fa05a7fc700 1 -- 172.21.15.6:0/795093141 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c01e640 con 0x7fa05c0b27f0 2023-10-06T02:30:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.230+0000 7fa05a7fc700 1 -- 172.21.15.6:0/795093141 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04c01e7c0 con 0x7fa05c0b27f0 2023-10-06T02:30:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.230+0000 7fa0645e8700 1 -- 172.21.15.6:0/795093141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05c154f70 con 0x7fa05c0b27f0 2023-10-06T02:30:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.230+0000 7fa05a7fc700 1 -- 172.21.15.6:0/795093141 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c01eb80 con 0x7fa05c0b27f0 2023-10-06T02:30:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.230+0000 7fa0645e8700 1 -- 172.21.15.6:0/795093141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05c0c6970 con 0x7fa05c0b27f0 2023-10-06T02:30:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.231+0000 7fa0645e8700 1 -- 172.21.15.6:0/795093141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05c155180 con 0x7fa05c0b27f0 2023-10-06T02:30:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.231+0000 7fa05a7fc700 1 -- 172.21.15.6:0/795093141 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa04c024070 con 0x7fa05c0b27f0 2023-10-06T02:30:42.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.231+0000 7fa05a7fc700 1 --2- 172.21.15.6:0/795093141 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa048066f30 0x7fa0480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:42.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.231+0000 7fa05a7fc700 1 -- 172.21.15.6:0/795093141 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fa04c087240 con 0x7fa05c0b27f0 2023-10-06T02:30:42.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.232+0000 7fa062384700 1 --2- 172.21.15.6:0/795093141 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa048066f30 0x7fa0480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:42.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.232+0000 7fa062384700 1 --2- 172.21.15.6:0/795093141 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa048066f30 0x7fa0480693e0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0ca7d0 tx=0x7fa054009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:42.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.236+0000 7fa05a7fc700 1 -- 172.21.15.6:0/795093141 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa04c054180 con 0x7fa05c0b27f0 2023-10-06T02:30:42.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.433+0000 7fa0645e8700 1 -- 172.21.15.6:0/795093141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa05c068a50 con 0x7fa05c0b27f0 2023-10-06T02:30:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.434+0000 7fa05a7fc700 1 -- 172.21.15.6:0/795093141 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+17261 (secure 0 0 0) 0x7fa04c0577a0 con 0x7fa05c0b27f0 2023-10-06T02:30:42.435 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:42.435 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":149,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:30:33.070801+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:30:04.464332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T02:30:05.694424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.b","mappings":[{"from":0,"to":2}]},{"pgid":"17.37","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/1108543434":"2023-10-07T02:30:28.039955+0000","172.21.15.6:6833/1108543434":"2023-10-07T02:30:28.039955+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:30:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.436+0000 7fa0645e8700 1 -- 172.21.15.6:0/795093141 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa048066f30 msgr2=0x7fa0480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.436+0000 7fa0645e8700 1 --2- 172.21.15.6:0/795093141 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa048066f30 0x7fa0480693e0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0ca7d0 tx=0x7fa054009040 comp rx=0 tx=0).stop 2023-10-06T02:30:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.436+0000 7fa0645e8700 1 -- 172.21.15.6:0/795093141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa05c0b27f0 msgr2=0x7fa05c152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.436+0000 7fa0645e8700 1 --2- 172.21.15.6:0/795093141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa05c0b27f0 0x7fa05c152300 secure :-1 s=READY pgs=2547 cs=0 l=1 rev1=1 crypto rx=0x7fa04c012e50 tx=0x7fa04c018000 comp rx=0 tx=0).stop 2023-10-06T02:30:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.436+0000 7fa0645e8700 1 -- 172.21.15.6:0/795093141 shutdown_connections 2023-10-06T02:30:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.436+0000 7fa0645e8700 1 --2- 172.21.15.6:0/795093141 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa048066f30 0x7fa0480693e0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.436+0000 7fa0645e8700 1 --2- 172.21.15.6:0/795093141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa05c0b27f0 0x7fa05c152300 unknown :-1 s=CLOSED pgs=2547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.436+0000 7fa0645e8700 1 --2- 172.21.15.6:0/795093141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa05c0af4e0 0x7fa05c0c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.436+0000 7fa0645e8700 1 --2- 172.21.15.6:0/795093141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa05c0af8b0 0x7fa05c151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.436+0000 7fa0645e8700 1 -- 172.21.15.6:0/795093141 >> 172.21.15.6:0/795093141 conn(0x7fa05c068680 msgr2=0x7fa05c0afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.436+0000 7fa0645e8700 1 -- 172.21.15.6:0/795093141 shutdown_connections 2023-10-06T02:30:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.436+0000 7fa0645e8700 1 -- 172.21.15.6:0/795093141 wait complete. 2023-10-06T02:30:42.449 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:30:42.449 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:30:42.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.566+0000 7fe34c8b9700 1 Processor -- start 2023-10-06T02:30:42.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.566+0000 7fe34c8b9700 1 -- start start 2023-10-06T02:30:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.567+0000 7fe34c8b9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe3480af4e0 0x7fe3480b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.567+0000 7fe34c8b9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe34815db70 0x7fe3480b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.567+0000 7fe34c8b9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe34815e190 con 0x7fe3480af8b0 2023-10-06T02:30:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.567+0000 7fe34c8b9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3480b1910 con 0x7fe34815db70 2023-10-06T02:30:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.567+0000 7fe34c8b9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34815dfa0 con 0x7fe3480af4e0 2023-10-06T02:30:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.567+0000 7fe346d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe34815db70 0x7fe3480b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.567+0000 7fe345d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe3480af8b0 0x7fe34815d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51556/0 (socket says 172.21.15.6:51556) 2023-10-06T02:30:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.567+0000 7fe345d9b700 1 -- 172.21.15.6:0/1103550876 learned_addr learned my addr 172.21.15.6:0/1103550876 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.568+0000 7fe34659c700 1 --2- 172.21.15.6:0/1103550876 >> v2:172.21.15.175:3300/0 conn(0x7fe3480af4e0 0x7fe3480b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.568+0000 7fe346d9d700 1 -- 172.21.15.6:0/1103550876 >> v2:172.21.15.175:3300/0 conn(0x7fe3480af4e0 msgr2=0x7fe3480b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.568+0000 7fe346d9d700 1 --2- 172.21.15.6:0/1103550876 >> v2:172.21.15.175:3300/0 conn(0x7fe3480af4e0 0x7fe3480b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.568+0000 7fe346d9d700 1 -- 172.21.15.6:0/1103550876 >> v1:172.21.15.6:6789/0 conn(0x7fe3480af8b0 legacy=0x7fe34815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.568+0000 7fe346d9d700 1 -- 172.21.15.6:0/1103550876 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3480cb650 con 0x7fe34815db70 2023-10-06T02:30:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.568+0000 7fe34559a700 1 -- 172.21.15.6:0/1103550876 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108786417 0 0) 0x7fe34815e190 con 0x7fe3480af8b0 2023-10-06T02:30:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.568+0000 7fe346d9d700 1 --2- 172.21.15.6:0/1103550876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe34815db70 0x7fe3480b2620 secure :-1 s=READY pgs=2549 cs=0 l=1 rev1=1 crypto rx=0x7fe3480d1360 tx=0x7fe3380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f866470e23f0c6a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.568+0000 7fe34559a700 1 -- 172.21.15.6:0/1103550876 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33800b6b0 con 0x7fe34815db70 2023-10-06T02:30:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.568+0000 7fe34559a700 1 -- 172.21.15.6:0/1103550876 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33800b810 con 0x7fe34815db70 2023-10-06T02:30:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.568+0000 7fe34559a700 1 -- 172.21.15.6:0/1103550876 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33800bbb0 con 0x7fe34815db70 2023-10-06T02:30:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.569+0000 7fe34c8b9700 1 -- 172.21.15.6:0/1103550876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe34815db70 msgr2=0x7fe3480b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.569+0000 7fe34c8b9700 1 --2- 172.21.15.6:0/1103550876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe34815db70 0x7fe3480b2620 secure :-1 s=READY pgs=2549 cs=0 l=1 rev1=1 crypto rx=0x7fe3480d1360 tx=0x7fe3380091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.569+0000 7fe34c8b9700 1 -- 172.21.15.6:0/1103550876 shutdown_connections 2023-10-06T02:30:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.569+0000 7fe34c8b9700 1 --2- 172.21.15.6:0/1103550876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe34815db70 0x7fe3480b2620 unknown :-1 s=CLOSED pgs=2549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.569+0000 7fe34c8b9700 1 --2- 172.21.15.6:0/1103550876 >> v2:172.21.15.175:3300/0 conn(0x7fe3480af4e0 0x7fe3480b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.569+0000 7fe34c8b9700 1 -- 172.21.15.6:0/1103550876 >> 172.21.15.6:0/1103550876 conn(0x7fe348068680 msgr2=0x7fe348068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.569+0000 7fe34c8b9700 1 -- 172.21.15.6:0/1103550876 shutdown_connections 2023-10-06T02:30:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.569+0000 7fe34c8b9700 1 -- 172.21.15.6:0/1103550876 wait complete. 2023-10-06T02:30:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.570+0000 7fe34c8b9700 1 Processor -- start 2023-10-06T02:30:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.570+0000 7fe34c8b9700 1 -- start start 2023-10-06T02:30:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe34c8b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3480af4e0 0x7fe3480c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe34c8b9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3480af8b0 0x7fe34816d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe34c8b9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe34815db70 0x7fe34816d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe34c8b9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480d07a0 con 0x7fe3480af4e0 2023-10-06T02:30:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe34c8b9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe348156860 con 0x7fe34815db70 2023-10-06T02:30:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe34c8b9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480d04c0 con 0x7fe3480af8b0 2023-10-06T02:30:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe34659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3480af4e0 0x7fe3480c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe34659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3480af4e0 0x7fe3480c63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37616/0 (socket says 172.21.15.6:37616) 2023-10-06T02:30:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe34659c700 1 -- 172.21.15.6:0/897955829 learned_addr learned my addr 172.21.15.6:0/897955829 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe346d9d700 1 --2- 172.21.15.6:0/897955829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe34815db70 0x7fe34816d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe345d9b700 1 --2- 172.21.15.6:0/897955829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3480af8b0 0x7fe34816d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe34659c700 1 -- 172.21.15.6:0/897955829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3480af8b0 msgr2=0x7fe34816d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe34659c700 1 --2- 172.21.15.6:0/897955829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3480af8b0 0x7fe34816d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe34659c700 1 -- 172.21.15.6:0/897955829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe34815db70 msgr2=0x7fe34816d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe34659c700 1 --2- 172.21.15.6:0/897955829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe34815db70 0x7fe34816d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe34659c700 1 -- 172.21.15.6:0/897955829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe338009420 con 0x7fe3480af4e0 2023-10-06T02:30:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe34659c700 1 --2- 172.21.15.6:0/897955829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3480af4e0 0x7fe3480c63a0 secure :-1 s=READY pgs=2550 cs=0 l=1 rev1=1 crypto rx=0x7fe340007f60 tx=0x7fe340009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe33e7fc700 1 -- 172.21.15.6:0/897955829 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34000ecf0 con 0x7fe3480af4e0 2023-10-06T02:30:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe33e7fc700 1 -- 172.21.15.6:0/897955829 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34000ee70 con 0x7fe3480af4e0 2023-10-06T02:30:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe34c8b9700 1 -- 172.21.15.6:0/897955829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe348156a70 con 0x7fe3480af4e0 2023-10-06T02:30:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe33e7fc700 1 -- 172.21.15.6:0/897955829 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340014650 con 0x7fe3480af4e0 2023-10-06T02:30:42.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.571+0000 7fe34c8b9700 1 -- 172.21.15.6:0/897955829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe348157030 con 0x7fe3480af4e0 2023-10-06T02:30:42.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.572+0000 7fe34c8b9700 1 -- 172.21.15.6:0/897955829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe348088aa0 con 0x7fe3480af4e0 2023-10-06T02:30:42.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.573+0000 7fe33e7fc700 1 -- 172.21.15.6:0/897955829 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3400149c0 con 0x7fe3480af4e0 2023-10-06T02:30:42.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.573+0000 7fe33e7fc700 1 --2- 172.21.15.6:0/897955829 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe328066f30 0x7fe3280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:42.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.573+0000 7fe33e7fc700 1 -- 172.21.15.6:0/897955829 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fe340085010 con 0x7fe3480af4e0 2023-10-06T02:30:42.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.573+0000 7fe345d9b700 1 --2- 172.21.15.6:0/897955829 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe328066f30 0x7fe3280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:42.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.574+0000 7fe345d9b700 1 --2- 172.21.15.6:0/897955829 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe328066f30 0x7fe3280693e0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe3481679d0 tx=0x7fe330009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:42.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.577+0000 7fe33e7fc700 1 -- 172.21.15.6:0/897955829 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe340051f50 con 0x7fe3480af4e0 2023-10-06T02:30:42.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.816+0000 7fe34c8b9700 1 -- 172.21.15.6:0/897955829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3480b0910 con 0x7fe3480af4e0 2023-10-06T02:30:42.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.817+0000 7fe33e7fc700 1 -- 172.21.15.6:0/897955829 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 366 v366) v1 ==== 95+0+4608 (secure 0 0 0) 0x7fe340055570 con 0x7fe3480af4e0 2023-10-06T02:30:42.818 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:42.818 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":366,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3603762205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3603762205},{"type":"v1","addr":"172.21.15.175:6836","nonce":3603762205}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":9820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3292446255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3292446255},{"type":"v1","addr":"172.21.15.175:6837","nonce":3292446255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":10869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/759655214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":759655214},{"type":"v1","addr":"172.21.15.6:6834","nonce":759655214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354}],"filesystems":[{"mdsmap":{"epoch":366,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:30:06.715272+0000","modified":"2023-10-06T02:30:39.086477+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11088":{"gid":11088,"name":"c","rank":0,"incarnation":362,"state":"up:active","state_seq":6,"addr":"172.21.15.6:6835/3837760829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3837760829},{"type":"v1","addr":"172.21.15.6:6835","nonce":3837760829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:30:42.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.819+0000 7fe34c8b9700 1 -- 172.21.15.6:0/897955829 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe328066f30 msgr2=0x7fe3280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.819+0000 7fe34c8b9700 1 --2- 172.21.15.6:0/897955829 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe328066f30 0x7fe3280693e0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe3481679d0 tx=0x7fe330009040 comp rx=0 tx=0).stop 2023-10-06T02:30:42.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.819+0000 7fe34c8b9700 1 -- 172.21.15.6:0/897955829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3480af4e0 msgr2=0x7fe3480c63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.819+0000 7fe34c8b9700 1 --2- 172.21.15.6:0/897955829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3480af4e0 0x7fe3480c63a0 secure :-1 s=READY pgs=2550 cs=0 l=1 rev1=1 crypto rx=0x7fe340007f60 tx=0x7fe340009860 comp rx=0 tx=0).stop 2023-10-06T02:30:42.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.819+0000 7fe34c8b9700 1 -- 172.21.15.6:0/897955829 shutdown_connections 2023-10-06T02:30:42.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.819+0000 7fe34c8b9700 1 --2- 172.21.15.6:0/897955829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe34815db70 0x7fe34816d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.819+0000 7fe34c8b9700 1 --2- 172.21.15.6:0/897955829 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fe328066f30 0x7fe3280693e0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.819+0000 7fe34c8b9700 1 --2- 172.21.15.6:0/897955829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3480af4e0 0x7fe3480c63a0 unknown :-1 s=CLOSED pgs=2550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.819+0000 7fe34c8b9700 1 --2- 172.21.15.6:0/897955829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3480af8b0 0x7fe34816d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.819+0000 7fe34c8b9700 1 -- 172.21.15.6:0/897955829 >> 172.21.15.6:0/897955829 conn(0x7fe348068680 msgr2=0x7fe3481549c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:42.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.819+0000 7fe34c8b9700 1 -- 172.21.15.6:0/897955829 shutdown_connections 2023-10-06T02:30:42.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.819+0000 7fe34c8b9700 1 -- 172.21.15.6:0/897955829 wait complete. 2023-10-06T02:30:42.822 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 366 2023-10-06T02:30:42.832 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:30:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.950+0000 7f1eea0d7700 1 Processor -- start 2023-10-06T02:30:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.950+0000 7f1eea0d7700 1 -- start start 2023-10-06T02:30:42.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.951+0000 7f1eea0d7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ee40af4e0 0x7f1ee40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:42.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.951+0000 7f1eea0d7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ee415db70 0x7f1ee40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:42.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.951+0000 7f1eea0d7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee415e190 con 0x7f1ee40af8b0 2023-10-06T02:30:42.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.951+0000 7f1eea0d7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee40b1910 con 0x7f1ee40af4e0 2023-10-06T02:30:42.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.951+0000 7f1eea0d7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee415dfa0 con 0x7f1ee415db70 2023-10-06T02:30:42.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.951+0000 7f1ee37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ee40af4e0 0x7f1ee40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:42.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.951+0000 7f1ee2ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1ee40af8b0 0x7f1ee415d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51566/0 (socket says 172.21.15.6:51566) 2023-10-06T02:30:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.951+0000 7f1ee37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ee40af4e0 0x7f1ee40b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37624/0 (socket says 172.21.15.6:37624) 2023-10-06T02:30:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.951+0000 7f1ee2ffd700 1 -- 172.21.15.6:0/3237775207 learned_addr learned my addr 172.21.15.6:0/3237775207 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.951+0000 7f1ee3fff700 1 --2- 172.21.15.6:0/3237775207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ee415db70 0x7f1ee40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.951+0000 7f1ee37fe700 1 -- 172.21.15.6:0/3237775207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ee415db70 msgr2=0x7f1ee40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.951+0000 7f1ee37fe700 1 --2- 172.21.15.6:0/3237775207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ee415db70 0x7f1ee40b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.951+0000 7f1ee37fe700 1 -- 172.21.15.6:0/3237775207 >> v1:172.21.15.6:6789/0 conn(0x7f1ee40af8b0 legacy=0x7f1ee415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.951+0000 7f1ee37fe700 1 -- 172.21.15.6:0/3237775207 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee40cb650 con 0x7f1ee40af4e0 2023-10-06T02:30:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.951+0000 7f1ee27fc700 1 -- 172.21.15.6:0/3237775207 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914270341 0 0) 0x7f1ee415e190 con 0x7f1ee40af8b0 2023-10-06T02:30:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.951+0000 7f1ee37fe700 1 --2- 172.21.15.6:0/3237775207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ee40af4e0 0x7f1ee40b20e0 secure :-1 s=READY pgs=2552 cs=0 l=1 rev1=1 crypto rx=0x7f1ed40098e0 tx=0x7f1ed40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2facb88baa5d6f06 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.951+0000 7f1ee27fc700 1 -- 172.21.15.6:0/3237775207 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4009e80 con 0x7f1ee40af4e0 2023-10-06T02:30:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.952+0000 7f1ee27fc700 1 -- 172.21.15.6:0/3237775207 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed400b860 con 0x7f1ee40af4e0 2023-10-06T02:30:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.952+0000 7f1ee27fc700 1 -- 172.21.15.6:0/3237775207 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed400bbe0 con 0x7f1ee40af4e0 2023-10-06T02:30:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.952+0000 7f1eea0d7700 1 -- 172.21.15.6:0/3237775207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ee40af4e0 msgr2=0x7f1ee40b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.952+0000 7f1eea0d7700 1 --2- 172.21.15.6:0/3237775207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ee40af4e0 0x7f1ee40b20e0 secure :-1 s=READY pgs=2552 cs=0 l=1 rev1=1 crypto rx=0x7f1ed40098e0 tx=0x7f1ed40091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.952+0000 7f1eea0d7700 1 -- 172.21.15.6:0/3237775207 shutdown_connections 2023-10-06T02:30:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.952+0000 7f1eea0d7700 1 --2- 172.21.15.6:0/3237775207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ee415db70 0x7f1ee40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.952+0000 7f1eea0d7700 1 --2- 172.21.15.6:0/3237775207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ee40af4e0 0x7f1ee40b20e0 unknown :-1 s=CLOSED pgs=2552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.952+0000 7f1eea0d7700 1 -- 172.21.15.6:0/3237775207 >> 172.21.15.6:0/3237775207 conn(0x7f1ee4068680 msgr2=0x7f1ee4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.952+0000 7f1eea0d7700 1 -- 172.21.15.6:0/3237775207 shutdown_connections 2023-10-06T02:30:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.952+0000 7f1eea0d7700 1 -- 172.21.15.6:0/3237775207 wait complete. 2023-10-06T02:30:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.953+0000 7f1eea0d7700 1 Processor -- start 2023-10-06T02:30:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.953+0000 7f1eea0d7700 1 -- start start 2023-10-06T02:30:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.954+0000 7f1eea0d7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ee40af4e0 0x7f1ee416d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.954+0000 7f1eea0d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ee40af8b0 0x7f1ee416abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.954+0000 7f1eea0d7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ee415db70 0x7f1ee416b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.954+0000 7f1eea0d7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee40d0e80 con 0x7f1ee40af8b0 2023-10-06T02:30:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.954+0000 7f1eea0d7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee40ce880 con 0x7f1ee40af4e0 2023-10-06T02:30:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.954+0000 7f1eea0d7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee416b120 con 0x7f1ee415db70 2023-10-06T02:30:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.954+0000 7f1ee2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ee40af8b0 0x7f1ee416abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.954+0000 7f1ee2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ee40af8b0 0x7f1ee416abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37628/0 (socket says 172.21.15.6:37628) 2023-10-06T02:30:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.954+0000 7f1ee2ffd700 1 -- 172.21.15.6:0/935192253 learned_addr learned my addr 172.21.15.6:0/935192253 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.954+0000 7f1ee2ffd700 1 -- 172.21.15.6:0/935192253 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ee415db70 msgr2=0x7f1ee416b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.954+0000 7f1ee2ffd700 1 --2- 172.21.15.6:0/935192253 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ee415db70 0x7f1ee416b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.954+0000 7f1ee2ffd700 1 -- 172.21.15.6:0/935192253 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ee40af4e0 msgr2=0x7f1ee416d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.954+0000 7f1ee2ffd700 1 --2- 172.21.15.6:0/935192253 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ee40af4e0 0x7f1ee416d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.954+0000 7f1ee2ffd700 1 -- 172.21.15.6:0/935192253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed4009420 con 0x7f1ee40af8b0 2023-10-06T02:30:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.955+0000 7f1ee2ffd700 1 --2- 172.21.15.6:0/935192253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ee40af8b0 0x7f1ee416abe0 secure :-1 s=READY pgs=2553 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800c810 tx=0x7f1ed8007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.955+0000 7f1ecb7fe700 1 -- 172.21.15.6:0/935192253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8005c00 con 0x7f1ee40af8b0 2023-10-06T02:30:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.955+0000 7f1ecb7fe700 1 -- 172.21.15.6:0/935192253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed8005d60 con 0x7f1ee40af8b0 2023-10-06T02:30:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.955+0000 7f1eea0d7700 1 -- 172.21.15.6:0/935192253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee40cdf50 con 0x7f1ee40af8b0 2023-10-06T02:30:42.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.955+0000 7f1ecb7fe700 1 -- 172.21.15.6:0/935192253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8007320 con 0x7f1ee40af8b0 2023-10-06T02:30:42.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.955+0000 7f1eea0d7700 1 -- 172.21.15.6:0/935192253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee40ce510 con 0x7f1ee40af8b0 2023-10-06T02:30:42.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.956+0000 7f1eea0d7700 1 -- 172.21.15.6:0/935192253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee4088aa0 con 0x7f1ee40af8b0 2023-10-06T02:30:42.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.956+0000 7f1ecb7fe700 1 -- 172.21.15.6:0/935192253 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ed801b400 con 0x7f1ee40af8b0 2023-10-06T02:30:42.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.956+0000 7f1ecb7fe700 1 --2- 172.21.15.6:0/935192253 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ed0066f30 0x7f1ed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:42.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.957+0000 7f1ecb7fe700 1 -- 172.21.15.6:0/935192253 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f1ed8084340 con 0x7f1ee40af8b0 2023-10-06T02:30:42.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.957+0000 7f1ee37fe700 1 --2- 172.21.15.6:0/935192253 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ed0066f30 0x7f1ed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:42.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.957+0000 7f1ee37fe700 1 --2- 172.21.15.6:0/935192253 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ed0066f30 0x7f1ed00693e0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1ee415a850 tx=0x7f1ed4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:42.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:42.961+0000 7f1ecb7fe700 1 -- 172.21.15.6:0/935192253 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ed8051300 con 0x7f1ee40af8b0 2023-10-06T02:30:43.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.200+0000 7f1eea0d7700 1 -- 172.21.15.6:0/935192253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ee40ce9f0 con 0x7f1ee40af8b0 2023-10-06T02:30:43.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.200+0000 7f1ecb7fe700 1 -- 172.21.15.6:0/935192253 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 366 v366) v1 ==== 95+0+4608 (secure 0 0 0) 0x7f1ed8054920 con 0x7f1ee40af8b0 2023-10-06T02:30:43.201 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:43.202 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":366,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3603762205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3603762205},{"type":"v1","addr":"172.21.15.175:6836","nonce":3603762205}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":9820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3292446255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3292446255},{"type":"v1","addr":"172.21.15.175:6837","nonce":3292446255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":10869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/759655214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":759655214},{"type":"v1","addr":"172.21.15.6:6834","nonce":759655214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354}],"filesystems":[{"mdsmap":{"epoch":366,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:30:06.715272+0000","modified":"2023-10-06T02:30:39.086477+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11088":{"gid":11088,"name":"c","rank":0,"incarnation":362,"state":"up:active","state_seq":6,"addr":"172.21.15.6:6835/3837760829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3837760829},{"type":"v1","addr":"172.21.15.6:6835","nonce":3837760829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T02:30:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.202+0000 7f1eea0d7700 1 -- 172.21.15.6:0/935192253 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ed0066f30 msgr2=0x7f1ed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.202+0000 7f1eea0d7700 1 --2- 172.21.15.6:0/935192253 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ed0066f30 0x7f1ed00693e0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1ee415a850 tx=0x7f1ed4017000 comp rx=0 tx=0).stop 2023-10-06T02:30:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.202+0000 7f1eea0d7700 1 -- 172.21.15.6:0/935192253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ee40af8b0 msgr2=0x7f1ee416abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.202+0000 7f1eea0d7700 1 --2- 172.21.15.6:0/935192253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ee40af8b0 0x7f1ee416abe0 secure :-1 s=READY pgs=2553 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800c810 tx=0x7f1ed8007db0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.203+0000 7f1eea0d7700 1 -- 172.21.15.6:0/935192253 shutdown_connections 2023-10-06T02:30:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.203+0000 7f1eea0d7700 1 --2- 172.21.15.6:0/935192253 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ee415db70 0x7f1ee416b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.203+0000 7f1eea0d7700 1 --2- 172.21.15.6:0/935192253 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ee40af4e0 0x7f1ee416d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.203+0000 7f1eea0d7700 1 --2- 172.21.15.6:0/935192253 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1ed0066f30 0x7f1ed00693e0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.203+0000 7f1eea0d7700 1 --2- 172.21.15.6:0/935192253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ee40af8b0 0x7f1ee416abe0 unknown :-1 s=CLOSED pgs=2553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.203+0000 7f1eea0d7700 1 -- 172.21.15.6:0/935192253 >> 172.21.15.6:0/935192253 conn(0x7f1ee4068680 msgr2=0x7f1ee4068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:43.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.203+0000 7f1eea0d7700 1 -- 172.21.15.6:0/935192253 shutdown_connections 2023-10-06T02:30:43.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.203+0000 7f1eea0d7700 1 -- 172.21.15.6:0/935192253 wait complete. 2023-10-06T02:30:43.205 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 366 2023-10-06T02:30:43.215 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:30:43.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.334+0000 7f6fc27df700 1 Processor -- start 2023-10-06T02:30:43.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.334+0000 7f6fc27df700 1 -- start start 2023-10-06T02:30:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.335+0000 7f6fc27df700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6fbc153a10 0x7f6fbc0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.335+0000 7f6fc27df700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6fbc0d05a0 0x7f6fbc15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.335+0000 7f6fc27df700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fbc0ceea0 con 0x7f6fbc0cf870 2023-10-06T02:30:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.335+0000 7f6fc27df700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fbc069140 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.335+0000 7f6fc27df700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fbc15a690 con 0x7f6fbc153a10 2023-10-06T02:30:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.335+0000 7f6fc1fde700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6fbc0d05a0 0x7f6fbc15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.335+0000 7f6fc0fdc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6fbc0cf870 0x7f6fbc0cfe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51580/0 (socket says 172.21.15.6:51580) 2023-10-06T02:30:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.335+0000 7f6fc0fdc700 1 -- 172.21.15.6:0/993661937 learned_addr learned my addr 172.21.15.6:0/993661937 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.335+0000 7f6fc17dd700 1 --2- 172.21.15.6:0/993661937 >> v2:172.21.15.175:3300/0 conn(0x7f6fbc153a10 0x7f6fbc0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.335+0000 7f6fc1fde700 1 -- 172.21.15.6:0/993661937 >> v2:172.21.15.175:3300/0 conn(0x7f6fbc153a10 msgr2=0x7f6fbc0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.335+0000 7f6fc1fde700 1 --2- 172.21.15.6:0/993661937 >> v2:172.21.15.175:3300/0 conn(0x7f6fbc153a10 0x7f6fbc0cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.335+0000 7f6fc1fde700 1 -- 172.21.15.6:0/993661937 >> v1:172.21.15.6:6789/0 conn(0x7f6fbc0cf870 legacy=0x7f6fbc0cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.335+0000 7f6fc1fde700 1 -- 172.21.15.6:0/993661937 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc0ce850 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.335+0000 7f6fbbfff700 1 -- 172.21.15.6:0/993661937 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203500146 0 0) 0x7f6fbc0ceea0 con 0x7f6fbc0cf870 2023-10-06T02:30:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.336+0000 7f6fc1fde700 1 --2- 172.21.15.6:0/993661937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc0d05a0 0x7f6fbc15abe0 secure :-1 s=READY pgs=2555 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc089360 tx=0x7f6fac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b47c194facf8e7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:43.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.336+0000 7f6fbbfff700 1 -- 172.21.15.6:0/993661937 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac00e070 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.336+0000 7f6fbbfff700 1 -- 172.21.15.6:0/993661937 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac00bc30 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.336+0000 7f6fbbfff700 1 -- 172.21.15.6:0/993661937 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac012430 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.336+0000 7f6fc27df700 1 -- 172.21.15.6:0/993661937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc0d05a0 msgr2=0x7f6fbc15abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:43.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.336+0000 7f6fc27df700 1 --2- 172.21.15.6:0/993661937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc0d05a0 0x7f6fbc15abe0 secure :-1 s=READY pgs=2555 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc089360 tx=0x7f6fac009780 comp rx=0 tx=0).stop 2023-10-06T02:30:43.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.336+0000 7f6fc27df700 1 -- 172.21.15.6:0/993661937 shutdown_connections 2023-10-06T02:30:43.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.336+0000 7f6fc27df700 1 --2- 172.21.15.6:0/993661937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc0d05a0 0x7f6fbc15abe0 unknown :-1 s=CLOSED pgs=2555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.336+0000 7f6fc27df700 1 --2- 172.21.15.6:0/993661937 >> v2:172.21.15.175:3300/0 conn(0x7f6fbc153a10 0x7f6fbc0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.336+0000 7f6fc27df700 1 -- 172.21.15.6:0/993661937 >> 172.21.15.6:0/993661937 conn(0x7f6fbc06ac00 msgr2=0x7f6fbc068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:43.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.336+0000 7f6fc27df700 1 -- 172.21.15.6:0/993661937 shutdown_connections 2023-10-06T02:30:43.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.336+0000 7f6fc27df700 1 -- 172.21.15.6:0/993661937 wait complete. 2023-10-06T02:30:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.338+0000 7f6fc27df700 1 Processor -- start 2023-10-06T02:30:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.338+0000 7f6fc27df700 1 -- start start 2023-10-06T02:30:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.338+0000 7f6fc27df700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fbc0cf870 0x7f6fbc158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.338+0000 7f6fc27df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc0d05a0 0x7f6fbc1568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc27df700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fbc153a10 0x7f6fbc150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc27df700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc169cb0 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc27df700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc156e20 con 0x7f6fbc153a10 2023-10-06T02:30:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc27df700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc1514f0 con 0x7f6fbc0cf870 2023-10-06T02:30:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc0fdc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc0d05a0 0x7f6fbc1568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc0fdc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc0d05a0 0x7f6fbc1568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37650/0 (socket says 172.21.15.6:37650) 2023-10-06T02:30:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc0fdc700 1 -- 172.21.15.6:0/740812561 learned_addr learned my addr 172.21.15.6:0/740812561 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc1fde700 1 --2- 172.21.15.6:0/740812561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fbc153a10 0x7f6fbc150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc17dd700 1 --2- 172.21.15.6:0/740812561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fbc0cf870 0x7f6fbc158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc0fdc700 1 -- 172.21.15.6:0/740812561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fbc0cf870 msgr2=0x7f6fbc158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc0fdc700 1 --2- 172.21.15.6:0/740812561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fbc0cf870 0x7f6fbc158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc0fdc700 1 -- 172.21.15.6:0/740812561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fbc153a10 msgr2=0x7f6fbc150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc0fdc700 1 --2- 172.21.15.6:0/740812561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fbc153a10 0x7f6fbc150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc0fdc700 1 -- 172.21.15.6:0/740812561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac009a20 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc1fde700 1 --2- 172.21.15.6:0/740812561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fbc153a10 0x7f6fbc150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:43.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc17dd700 1 --2- 172.21.15.6:0/740812561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fbc0cf870 0x7f6fbc158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:43.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc0fdc700 1 --2- 172.21.15.6:0/740812561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc0d05a0 0x7f6fbc1568e0 secure :-1 s=READY pgs=2556 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000c810 tx=0x7f6fb0007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:43.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fb97fa700 1 -- 172.21.15.6:0/740812561 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0005b30 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fb97fa700 1 -- 172.21.15.6:0/740812561 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb0005cb0 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc27df700 1 -- 172.21.15.6:0/740812561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fbc159df0 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fb97fa700 1 -- 172.21.15.6:0/740812561 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0007340 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.339+0000 7f6fc27df700 1 -- 172.21.15.6:0/740812561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fbc159550 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.340+0000 7f6fc27df700 1 -- 172.21.15.6:0/740812561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fbc169e00 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.341+0000 7f6fb97fa700 1 -- 172.21.15.6:0/740812561 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fb001b400 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.341+0000 7f6fb97fa700 1 --2- 172.21.15.6:0/740812561 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6fa8066f30 0x7f6fa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:43.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.341+0000 7f6fb97fa700 1 -- 172.21.15.6:0/740812561 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f6fb0084270 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.341+0000 7f6fc17dd700 1 --2- 172.21.15.6:0/740812561 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6fa8066f30 0x7f6fa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:43.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.342+0000 7f6fc17dd700 1 --2- 172.21.15.6:0/740812561 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6fa8066f30 0x7f6fa80693e0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4006fd0 tx=0x7f6fb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:43.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.346+0000 7f6fb97fa700 1 -- 172.21.15.6:0/740812561 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fb0051230 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.541+0000 7f6fc27df700 1 -- 172.21.15.6:0/740812561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fbc0ceb90 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.542+0000 7f6fb97fa700 1 -- 172.21.15.6:0/740812561 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+17261 (secure 0 0 0) 0x7f6fb00076f0 con 0x7f6fbc0d05a0 2023-10-06T02:30:43.543 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:43.543 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":149,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:30:33.070801+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:30:04.464332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T02:30:05.694424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.b","mappings":[{"from":0,"to":2}]},{"pgid":"17.37","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/1108543434":"2023-10-07T02:30:28.039955+0000","172.21.15.6:6833/1108543434":"2023-10-07T02:30:28.039955+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:30:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.544+0000 7f6fc27df700 1 -- 172.21.15.6:0/740812561 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6fa8066f30 msgr2=0x7f6fa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.544+0000 7f6fc27df700 1 --2- 172.21.15.6:0/740812561 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6fa8066f30 0x7f6fa80693e0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4006fd0 tx=0x7f6fb4008040 comp rx=0 tx=0).stop 2023-10-06T02:30:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.544+0000 7f6fc27df700 1 -- 172.21.15.6:0/740812561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc0d05a0 msgr2=0x7f6fbc1568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.544+0000 7f6fc27df700 1 --2- 172.21.15.6:0/740812561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc0d05a0 0x7f6fbc1568e0 secure :-1 s=READY pgs=2556 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000c810 tx=0x7f6fb0007db0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.544+0000 7f6fc27df700 1 -- 172.21.15.6:0/740812561 shutdown_connections 2023-10-06T02:30:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.544+0000 7f6fc27df700 1 --2- 172.21.15.6:0/740812561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fbc153a10 0x7f6fbc150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.544+0000 7f6fc27df700 1 --2- 172.21.15.6:0/740812561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fbc0cf870 0x7f6fbc158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.544+0000 7f6fc27df700 1 --2- 172.21.15.6:0/740812561 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6fa8066f30 0x7f6fa80693e0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.544+0000 7f6fc27df700 1 --2- 172.21.15.6:0/740812561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc0d05a0 0x7f6fbc1568e0 unknown :-1 s=CLOSED pgs=2556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.544+0000 7f6fc27df700 1 -- 172.21.15.6:0/740812561 >> 172.21.15.6:0/740812561 conn(0x7f6fbc06ac00 msgr2=0x7f6fbc15a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.544+0000 7f6fc27df700 1 -- 172.21.15.6:0/740812561 shutdown_connections 2023-10-06T02:30:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.544+0000 7f6fc27df700 1 -- 172.21.15.6:0/740812561 wait complete. 2023-10-06T02:30:43.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:30:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.676+0000 7f626bcab700 1 Processor -- start 2023-10-06T02:30:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.676+0000 7f626bcab700 1 -- start start 2023-10-06T02:30:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.677+0000 7f626bcab700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f62640b2490 0x7f62640cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.677+0000 7f626bcab700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f62640b2860 0x7f62640b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.677+0000 7f626bcab700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6264159150 0x7f6264159590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.677+0000 7f626bcab700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62640b0bb0 con 0x7f62640b2860 2023-10-06T02:30:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.677+0000 7f626bcab700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62640cb630 con 0x7f62640b2490 2023-10-06T02:30:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.677+0000 7f626bcab700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62640cb910 con 0x7f6264159150 2023-10-06T02:30:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.677+0000 7f6269246700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f62640b2860 0x7f62640b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.677+0000 7f6269246700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f62640b2860 0x7f62640b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37654/0 (socket says 172.21.15.6:37654) 2023-10-06T02:30:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.677+0000 7f6269246700 1 -- 172.21.15.6:0/3450279482 learned_addr learned my addr 172.21.15.6:0/3450279482 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.678+0000 7f6269246700 1 -- 172.21.15.6:0/3450279482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6264159150 msgr2=0x7f6264159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.678+0000 7f6269246700 1 --2- 172.21.15.6:0/3450279482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6264159150 0x7f6264159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.678+0000 7f6269246700 1 -- 172.21.15.6:0/3450279482 >> v2:172.21.15.175:3300/0 conn(0x7f62640b2490 msgr2=0x7f62640cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.678+0000 7f6269246700 1 --2- 172.21.15.6:0/3450279482 >> v2:172.21.15.175:3300/0 conn(0x7f62640b2490 0x7f62640cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.678+0000 7f6269246700 1 -- 172.21.15.6:0/3450279482 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62640cbbf0 con 0x7f62640b2860 2023-10-06T02:30:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.678+0000 7f6269246700 1 --2- 172.21.15.6:0/3450279482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62640b2860 0x7f62640b0670 secure :-1 s=READY pgs=2557 cs=0 l=1 rev1=1 crypto rx=0x7f6264088070 tx=0x7f6258009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5958af5035957dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.678+0000 7f6268a45700 1 -- 172.21.15.6:0/3450279482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625800b860 con 0x7f62640b2860 2023-10-06T02:30:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.678+0000 7f6268a45700 1 -- 172.21.15.6:0/3450279482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625800b9c0 con 0x7f62640b2860 2023-10-06T02:30:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.678+0000 7f6268a45700 1 -- 172.21.15.6:0/3450279482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625800bd60 con 0x7f62640b2860 2023-10-06T02:30:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.678+0000 7f626bcab700 1 -- 172.21.15.6:0/3450279482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62640b2860 msgr2=0x7f62640b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.678+0000 7f626bcab700 1 --2- 172.21.15.6:0/3450279482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62640b2860 0x7f62640b0670 secure :-1 s=READY pgs=2557 cs=0 l=1 rev1=1 crypto rx=0x7f6264088070 tx=0x7f6258009250 comp rx=0 tx=0).stop 2023-10-06T02:30:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.678+0000 7f626bcab700 1 -- 172.21.15.6:0/3450279482 shutdown_connections 2023-10-06T02:30:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.678+0000 7f626bcab700 1 --2- 172.21.15.6:0/3450279482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6264159150 0x7f6264159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.678+0000 7f626bcab700 1 --2- 172.21.15.6:0/3450279482 >> v2:172.21.15.175:3300/0 conn(0x7f62640b2490 0x7f62640cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.678+0000 7f626bcab700 1 --2- 172.21.15.6:0/3450279482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62640b2860 0x7f62640b0670 unknown :-1 s=CLOSED pgs=2557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.678+0000 7f626bcab700 1 -- 172.21.15.6:0/3450279482 >> 172.21.15.6:0/3450279482 conn(0x7f6264068680 msgr2=0x7f6264068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.679+0000 7f626bcab700 1 -- 172.21.15.6:0/3450279482 shutdown_connections 2023-10-06T02:30:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.679+0000 7f626bcab700 1 -- 172.21.15.6:0/3450279482 wait complete. 2023-10-06T02:30:43.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.680+0000 7f626bcab700 1 Processor -- start 2023-10-06T02:30:43.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.680+0000 7f626bcab700 1 -- start start 2023-10-06T02:30:43.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.680+0000 7f626bcab700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62640b2490 0x7f62641539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:43.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.680+0000 7f626bcab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62640b2860 0x7f62640c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:43.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.680+0000 7f626bcab700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6264159150 0x7f62640c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.680+0000 7f626bcab700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62640c4a10 con 0x7f62640b2860 2023-10-06T02:30:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.680+0000 7f626bcab700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62640c4cf0 con 0x7f6264159150 2023-10-06T02:30:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.680+0000 7f626bcab700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62640c4fd0 con 0x7f62640b2490 2023-10-06T02:30:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.681+0000 7f6269246700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62640b2860 0x7f62640c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.681+0000 7f6269246700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62640b2860 0x7f62640c99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37656/0 (socket says 172.21.15.6:37656) 2023-10-06T02:30:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.681+0000 7f6269246700 1 -- 172.21.15.6:0/1368164109 learned_addr learned my addr 172.21.15.6:0/1368164109 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.681+0000 7f6269a47700 1 --2- 172.21.15.6:0/1368164109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62640b2490 0x7f62641539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.681+0000 7f626a248700 1 --2- 172.21.15.6:0/1368164109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6264159150 0x7f62640c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.681+0000 7f6269246700 1 -- 172.21.15.6:0/1368164109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62640b2490 msgr2=0x7f62641539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.681+0000 7f6269246700 1 --2- 172.21.15.6:0/1368164109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62640b2490 0x7f62641539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.681+0000 7f6269246700 1 -- 172.21.15.6:0/1368164109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6264159150 msgr2=0x7f62640c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.681+0000 7f6269246700 1 --2- 172.21.15.6:0/1368164109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6264159150 0x7f62640c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.681+0000 7f6269246700 1 -- 172.21.15.6:0/1368164109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62580094f0 con 0x7f62640b2860 2023-10-06T02:30:43.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.681+0000 7f6269246700 1 --2- 172.21.15.6:0/1368164109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62640b2860 0x7f62640c99a0 secure :-1 s=READY pgs=2558 cs=0 l=1 rev1=1 crypto rx=0x7f6258009290 tx=0x7f6258017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:43.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.681+0000 7f6261ffb700 1 -- 172.21.15.6:0/1368164109 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258026480 con 0x7f62640b2860 2023-10-06T02:30:43.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.681+0000 7f6261ffb700 1 -- 172.21.15.6:0/1368164109 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625801f070 con 0x7f62640b2860 2023-10-06T02:30:43.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.681+0000 7f6261ffb700 1 -- 172.21.15.6:0/1368164109 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258026830 con 0x7f62640b2860 2023-10-06T02:30:43.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.681+0000 7f626bcab700 1 -- 172.21.15.6:0/1368164109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62640c52b0 con 0x7f62640b2860 2023-10-06T02:30:43.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.682+0000 7f626bcab700 1 -- 172.21.15.6:0/1368164109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62640ca520 con 0x7f62640b2860 2023-10-06T02:30:43.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.682+0000 7f626bcab700 1 -- 172.21.15.6:0/1368164109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6264088700 con 0x7f62640b2860 2023-10-06T02:30:43.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.683+0000 7f6261ffb700 1 -- 172.21.15.6:0/1368164109 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f625801a430 con 0x7f62640b2860 2023-10-06T02:30:43.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.683+0000 7f6261ffb700 1 --2- 172.21.15.6:0/1368164109 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6250066f30 0x7f62500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:43.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.683+0000 7f6261ffb700 1 -- 172.21.15.6:0/1368164109 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f6258021070 con 0x7f62640b2860 2023-10-06T02:30:43.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.684+0000 7f6269a47700 1 --2- 172.21.15.6:0/1368164109 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6250066f30 0x7f62500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:43.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.684+0000 7f6269a47700 1 --2- 172.21.15.6:0/1368164109 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6250066f30 0x7f62500693e0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f625c009bf0 tx=0x7f625c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:43.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.688+0000 7f6261ffb700 1 -- 172.21.15.6:0/1368164109 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62580536b0 con 0x7f62640b2860 2023-10-06T02:30:43.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.923+0000 7f626bcab700 1 -- 172.21.15.6:0/1368164109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f62640c4b50 con 0x7f62640b2860 2023-10-06T02:30:43.924 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-06T02:30:43.924+0000 7fc34d12c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:30:43.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.928+0000 7f6261ffb700 1 -- 172.21.15.6:0/1368164109 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v367) v1 ==== 161+0+0 (secure 0 0 0) 0x7f62640c4b50 con 0x7f62640b2860 2023-10-06T02:30:43.931 INFO:tasks.ceph.mds.c.smithi006.stderr: -833> 2023-10-06T02:30:35.055+0000 7f2f8e057700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:30:43.932 INFO:tasks.ceph.mds.c.smithi006.stderr: -648> 2023-10-06T02:30:35.747+0000 7f2f8a850700 -1 mds.0.cache corrupt backtrace on ino x00x10000000001: void inode_backtrace_t::decode(ceph::buffer::v15_2_0::list::const_iterator&) no longer understand old encoding version 5 < 104: Malformed input 2023-10-06T02:30:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.931+0000 7f626bcab700 1 -- 172.21.15.6:0/1368164109 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6250066f30 msgr2=0x7f62500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.931+0000 7f626bcab700 1 --2- 172.21.15.6:0/1368164109 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6250066f30 0x7f62500693e0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f625c009bf0 tx=0x7f625c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.931+0000 7f626bcab700 1 -- 172.21.15.6:0/1368164109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62640b2860 msgr2=0x7f62640c99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.931+0000 7f626bcab700 1 --2- 172.21.15.6:0/1368164109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62640b2860 0x7f62640c99a0 secure :-1 s=READY pgs=2558 cs=0 l=1 rev1=1 crypto rx=0x7f6258009290 tx=0x7f6258017000 comp rx=0 tx=0).stop 2023-10-06T02:30:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.931+0000 7f626bcab700 1 -- 172.21.15.6:0/1368164109 shutdown_connections 2023-10-06T02:30:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.931+0000 7f626bcab700 1 --2- 172.21.15.6:0/1368164109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6264159150 0x7f62640c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.931+0000 7f626bcab700 1 --2- 172.21.15.6:0/1368164109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62640b2490 0x7f62641539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.931+0000 7f626bcab700 1 --2- 172.21.15.6:0/1368164109 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6250066f30 0x7f62500693e0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.931+0000 7f626bcab700 1 --2- 172.21.15.6:0/1368164109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62640b2860 0x7f62640c99a0 unknown :-1 s=CLOSED pgs=2558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:43.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.931+0000 7f626bcab700 1 -- 172.21.15.6:0/1368164109 >> 172.21.15.6:0/1368164109 conn(0x7f6264068680 msgr2=0x7f62640afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:43.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.932+0000 7f626bcab700 1 -- 172.21.15.6:0/1368164109 shutdown_connections 2023-10-06T02:30:43.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:43.932+0000 7f626bcab700 1 -- 172.21.15.6:0/1368164109 wait complete. 2023-10-06T02:30:43.934 INFO:tasks.ceph.mds.c.smithi006.stderr: -419> 2023-10-06T02:30:37.548+0000 7f2f8a850700 -1 log_channel(cluster) log [ERR] : dir 0x100000001f6 object missing on disk; some files may be lost (/dir2) 2023-10-06T02:30:43.936 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:30:43.945 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:30:43.952 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-06T02:30:44.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.066+0000 7f8aaf6e2700 1 Processor -- start 2023-10-06T02:30:44.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.066+0000 7f8aaf6e2700 1 -- start start 2023-10-06T02:30:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8aaf6e2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aa806a380 0x7f8aa80cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8aaf6e2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8aa8159170 0x7f8aa81595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8aaf6e2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa80cae80 con 0x7f8aa806a750 2023-10-06T02:30:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8aaf6e2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa80cc3d0 con 0x7f8aa8159170 2023-10-06T02:30:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8aaf6e2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa8159b30 con 0x7f8aa806a380 2023-10-06T02:30:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8aadc7f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8aa8159170 0x7f8aa81595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8aadc7f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8aa8159170 0x7f8aa81595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37690/0 (socket says 172.21.15.6:37690) 2023-10-06T02:30:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8aacc7d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8aa806a750 0x7f8aa815d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51594/0 (socket says 172.21.15.6:51594) 2023-10-06T02:30:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8aadc7f700 1 -- 172.21.15.6:0/1561749870 learned_addr learned my addr 172.21.15.6:0/1561749870 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8aad47e700 1 --2- 172.21.15.6:0/1561749870 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aa806a380 0x7f8aa80cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8aadc7f700 1 -- 172.21.15.6:0/1561749870 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aa806a380 msgr2=0x7f8aa80cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8aadc7f700 1 --2- 172.21.15.6:0/1561749870 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aa806a380 0x7f8aa80cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8aadc7f700 1 -- 172.21.15.6:0/1561749870 >> v1:172.21.15.6:6789/0 conn(0x7f8aa806a750 legacy=0x7f8aa815d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8a9ffff700 1 -- 172.21.15.6:0/1561749870 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885433733 0 0) 0x7f8aa80cae80 con 0x7f8aa806a750 2023-10-06T02:30:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8aadc7f700 1 -- 172.21.15.6:0/1561749870 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa815dcd0 con 0x7f8aa8159170 2023-10-06T02:30:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8aad47e700 1 --2- 172.21.15.6:0/1561749870 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aa806a380 0x7f8aa80cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8aadc7f700 1 --2- 172.21.15.6:0/1561749870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa8159170 0x7f8aa81595f0 secure :-1 s=READY pgs=2563 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009f20 tx=0x7f8aa0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0583941bed06738 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8a9ffff700 1 -- 172.21.15.6:0/1561749870 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa000e070 con 0x7f8aa8159170 2023-10-06T02:30:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8a9ffff700 1 -- 172.21.15.6:0/1561749870 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa000ba80 con 0x7f8aa8159170 2023-10-06T02:30:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.067+0000 7f8a9ffff700 1 -- 172.21.15.6:0/1561749870 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00092e0 con 0x7f8aa8159170 2023-10-06T02:30:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.068+0000 7f8aaf6e2700 1 -- 172.21.15.6:0/1561749870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa8159170 msgr2=0x7f8aa81595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.068+0000 7f8aaf6e2700 1 --2- 172.21.15.6:0/1561749870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa8159170 0x7f8aa81595f0 secure :-1 s=READY pgs=2563 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009f20 tx=0x7f8aa0009840 comp rx=0 tx=0).stop 2023-10-06T02:30:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.068+0000 7f8aaf6e2700 1 -- 172.21.15.6:0/1561749870 shutdown_connections 2023-10-06T02:30:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.068+0000 7f8aaf6e2700 1 --2- 172.21.15.6:0/1561749870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa8159170 0x7f8aa81595f0 unknown :-1 s=CLOSED pgs=2563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.068+0000 7f8aaf6e2700 1 --2- 172.21.15.6:0/1561749870 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aa806a380 0x7f8aa80cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.068+0000 7f8aaf6e2700 1 -- 172.21.15.6:0/1561749870 >> 172.21.15.6:0/1561749870 conn(0x7f8aa80d0350 msgr2=0x7f8aa80d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.068+0000 7f8aaf6e2700 1 -- 172.21.15.6:0/1561749870 shutdown_connections 2023-10-06T02:30:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.068+0000 7f8aaf6e2700 1 -- 172.21.15.6:0/1561749870 wait complete. 2023-10-06T02:30:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.069+0000 7f8aaf6e2700 1 Processor -- start 2023-10-06T02:30:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.069+0000 7f8aaf6e2700 1 -- start start 2023-10-06T02:30:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.070+0000 7f8aaf6e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa806a380 0x7f8aa81551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.070+0000 7f8aaf6e2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aa806a750 0x7f8aa80af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.070+0000 7f8aaf6e2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8aa8159170 0x7f8aa80af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.070+0000 7f8aaf6e2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa815bc30 con 0x7f8aa806a380 2023-10-06T02:30:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.070+0000 7f8aaf6e2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa80c9f10 con 0x7f8aa8159170 2023-10-06T02:30:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.070+0000 7f8aaf6e2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa815b7a0 con 0x7f8aa806a750 2023-10-06T02:30:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.070+0000 7f8aad47e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa806a380 0x7f8aa81551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.070+0000 7f8aad47e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa806a380 0x7f8aa81551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37704/0 (socket says 172.21.15.6:37704) 2023-10-06T02:30:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.070+0000 7f8aad47e700 1 -- 172.21.15.6:0/2953480279 learned_addr learned my addr 172.21.15.6:0/2953480279 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.070+0000 7f8aacc7d700 1 --2- 172.21.15.6:0/2953480279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aa806a750 0x7f8aa80af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.071+0000 7f8aad47e700 1 -- 172.21.15.6:0/2953480279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aa806a750 msgr2=0x7f8aa80af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.071+0000 7f8aad47e700 1 --2- 172.21.15.6:0/2953480279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aa806a750 0x7f8aa80af120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.071+0000 7f8aad47e700 1 -- 172.21.15.6:0/2953480279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8aa8159170 msgr2=0x7f8aa80af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.071+0000 7f8aad47e700 1 --2- 172.21.15.6:0/2953480279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8aa8159170 0x7f8aa80af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.071+0000 7f8aad47e700 1 -- 172.21.15.6:0/2953480279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa0009ae0 con 0x7f8aa806a380 2023-10-06T02:30:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.071+0000 7f8aacc7d700 1 --2- 172.21.15.6:0/2953480279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aa806a750 0x7f8aa80af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:44.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.071+0000 7f8aad47e700 1 --2- 172.21.15.6:0/2953480279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa806a380 0x7f8aa81551d0 secure :-1 s=READY pgs=2564 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400c830 tx=0x7f8aa4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:44.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.071+0000 7f8a9d7fa700 1 -- 172.21.15.6:0/2953480279 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4011600 con 0x7f8aa806a380 2023-10-06T02:30:44.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.071+0000 7f8a9d7fa700 1 -- 172.21.15.6:0/2953480279 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa4011760 con 0x7f8aa806a380 2023-10-06T02:30:44.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.071+0000 7f8aaf6e2700 1 -- 172.21.15.6:0/2953480279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa80b5970 con 0x7f8aa806a380 2023-10-06T02:30:44.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.071+0000 7f8a9d7fa700 1 -- 172.21.15.6:0/2953480279 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4011b20 con 0x7f8aa806a380 2023-10-06T02:30:44.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.071+0000 7f8aaf6e2700 1 -- 172.21.15.6:0/2953480279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa815ae70 con 0x7f8aa806a380 2023-10-06T02:30:44.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.072+0000 7f8aaf6e2700 1 -- 172.21.15.6:0/2953480279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa8088a40 con 0x7f8aa806a380 2023-10-06T02:30:44.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.073+0000 7f8a9d7fa700 1 -- 172.21.15.6:0/2953480279 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8aa400a3e0 con 0x7f8aa806a380 2023-10-06T02:30:44.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.073+0000 7f8a9d7fa700 1 --2- 172.21.15.6:0/2953480279 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a8c066f30 0x7f8a8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:44.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.073+0000 7f8a9d7fa700 1 -- 172.21.15.6:0/2953480279 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f8aa40849a0 con 0x7f8aa806a380 2023-10-06T02:30:44.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.074+0000 7f8aacc7d700 1 --2- 172.21.15.6:0/2953480279 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a8c066f30 0x7f8a8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.074+0000 7f8aacc7d700 1 --2- 172.21.15.6:0/2953480279 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a8c066f30 0x7f8a8c0693e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80ca470 tx=0x7f8a98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.077+0000 7f8a9d7fa700 1 -- 172.21.15.6:0/2953480279 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8aa4051890 con 0x7f8aa806a380 2023-10-06T02:30:44.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.314+0000 7f8aaf6e2700 1 -- 172.21.15.6:0/2953480279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8aa815dfb0 con 0x7f8aa806a380 2023-10-06T02:30:44.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.928+0000 7f8a9d7fa700 1 -- 172.21.15.6:0/2953480279 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v368) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8aa4054eb0 con 0x7f8aa806a380 2023-10-06T02:30:44.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.931+0000 7f8aaf6e2700 1 -- 172.21.15.6:0/2953480279 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a8c066f30 msgr2=0x7f8a8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:44.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.931+0000 7f8aaf6e2700 1 --2- 172.21.15.6:0/2953480279 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a8c066f30 0x7f8a8c0693e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80ca470 tx=0x7f8a98009040 comp rx=0 tx=0).stop 2023-10-06T02:30:44.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.931+0000 7f8aaf6e2700 1 -- 172.21.15.6:0/2953480279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa806a380 msgr2=0x7f8aa81551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:44.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.931+0000 7f8aaf6e2700 1 --2- 172.21.15.6:0/2953480279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa806a380 0x7f8aa81551d0 secure :-1 s=READY pgs=2564 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400c830 tx=0x7f8aa4008040 comp rx=0 tx=0).stop 2023-10-06T02:30:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.932+0000 7f8aaf6e2700 1 -- 172.21.15.6:0/2953480279 shutdown_connections 2023-10-06T02:30:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.932+0000 7f8aaf6e2700 1 --2- 172.21.15.6:0/2953480279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8aa8159170 0x7f8aa80af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.932+0000 7f8aaf6e2700 1 --2- 172.21.15.6:0/2953480279 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8a8c066f30 0x7f8a8c0693e0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.932+0000 7f8aaf6e2700 1 --2- 172.21.15.6:0/2953480279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa806a380 0x7f8aa81551d0 unknown :-1 s=CLOSED pgs=2564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.932+0000 7f8aaf6e2700 1 --2- 172.21.15.6:0/2953480279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aa806a750 0x7f8aa80af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.932+0000 7f8aaf6e2700 1 -- 172.21.15.6:0/2953480279 >> 172.21.15.6:0/2953480279 conn(0x7f8aa80d0350 msgr2=0x7f8aa8155e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.932+0000 7f8aaf6e2700 1 -- 172.21.15.6:0/2953480279 shutdown_connections 2023-10-06T02:30:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:44.932+0000 7f8aaf6e2700 1 -- 172.21.15.6:0/2953480279 wait complete. 2023-10-06T02:30:44.947 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:30:45.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.115+0000 7fec5f44e700 1 Processor -- start 2023-10-06T02:30:45.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.116+0000 7fec5f44e700 1 -- start start 2023-10-06T02:30:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.116+0000 7fec5f44e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec5815a020 0x7fec580ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.117+0000 7fec5f44e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fec580b1450 0x7fec580a7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.117+0000 7fec5f44e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec580ae810 con 0x7fec5815a3f0 2023-10-06T02:30:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.117+0000 7fec5f44e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec58156c90 con 0x7fec580b1450 2023-10-06T02:30:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.117+0000 7fec5f44e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec580adc00 con 0x7fec5815a020 2023-10-06T02:30:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.117+0000 7fec5c9e9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fec580b1450 0x7fec580a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.117+0000 7fec5d9eb700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fec5815a3f0 0x7fec580a76d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51596/0 (socket says 172.21.15.6:51596) 2023-10-06T02:30:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.117+0000 7fec5d9eb700 1 -- 172.21.15.6:0/1058671703 learned_addr learned my addr 172.21.15.6:0/1058671703 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.117+0000 7fec5d1ea700 1 --2- 172.21.15.6:0/1058671703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec5815a020 0x7fec580ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.117+0000 7fec5c9e9700 1 -- 172.21.15.6:0/1058671703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec5815a020 msgr2=0x7fec580ad2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.117+0000 7fec5c9e9700 1 --2- 172.21.15.6:0/1058671703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec5815a020 0x7fec580ad2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.117+0000 7fec5c9e9700 1 -- 172.21.15.6:0/1058671703 >> v1:172.21.15.6:6789/0 conn(0x7fec5815a3f0 legacy=0x7fec580a76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.117+0000 7fec5c9e9700 1 -- 172.21.15.6:0/1058671703 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec580adee0 con 0x7fec580b1450 2023-10-06T02:30:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.117+0000 7fec5d1ea700 1 --2- 172.21.15.6:0/1058671703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec5815a020 0x7fec580ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.117+0000 7fec5c9e9700 1 --2- 172.21.15.6:0/1058671703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec580b1450 0x7fec580a7190 secure :-1 s=READY pgs=2566 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0098e0 tx=0x7fec4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5449ae721248b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:45.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.119+0000 7fec57fff700 1 -- 172.21.15.6:0/1058671703 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c009e80 con 0x7fec580b1450 2023-10-06T02:30:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.119+0000 7fec57fff700 1 -- 172.21.15.6:0/1058671703 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c00b860 con 0x7fec580b1450 2023-10-06T02:30:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.119+0000 7fec57fff700 1 -- 172.21.15.6:0/1058671703 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c00bbe0 con 0x7fec580b1450 2023-10-06T02:30:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.119+0000 7fec5f44e700 1 -- 172.21.15.6:0/1058671703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec580b1450 msgr2=0x7fec580a7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.119+0000 7fec5f44e700 1 --2- 172.21.15.6:0/1058671703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec580b1450 0x7fec580a7190 secure :-1 s=READY pgs=2566 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0098e0 tx=0x7fec4c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.119+0000 7fec5f44e700 1 -- 172.21.15.6:0/1058671703 shutdown_connections 2023-10-06T02:30:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.119+0000 7fec5f44e700 1 --2- 172.21.15.6:0/1058671703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec5815a020 0x7fec580ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.119+0000 7fec5f44e700 1 --2- 172.21.15.6:0/1058671703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec580b1450 0x7fec580a7190 unknown :-1 s=CLOSED pgs=2566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.119+0000 7fec5f44e700 1 -- 172.21.15.6:0/1058671703 >> 172.21.15.6:0/1058671703 conn(0x7fec580963e0 msgr2=0x7fec58069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.120+0000 7fec5f44e700 1 -- 172.21.15.6:0/1058671703 shutdown_connections 2023-10-06T02:30:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.120+0000 7fec5f44e700 1 -- 172.21.15.6:0/1058671703 wait complete. 2023-10-06T02:30:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.121+0000 7fec5f44e700 1 Processor -- start 2023-10-06T02:30:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.121+0000 7fec5f44e700 1 -- start start 2023-10-06T02:30:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.121+0000 7fec5f44e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec580b1450 0x7fec58168450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.121+0000 7fec5f44e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec5815a020 0x7fec58151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5f44e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5815a3f0 0x7fec5816af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5f44e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5816ba20 con 0x7fec580b1450 2023-10-06T02:30:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5f44e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5816bd00 con 0x7fec5815a3f0 2023-10-06T02:30:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5f44e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec58167c70 con 0x7fec5815a020 2023-10-06T02:30:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5d1ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec580b1450 0x7fec58168450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5d1ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec580b1450 0x7fec58168450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37724/0 (socket says 172.21.15.6:37724) 2023-10-06T02:30:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5d1ea700 1 -- 172.21.15.6:0/3148324661 learned_addr learned my addr 172.21.15.6:0/3148324661 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5c9e9700 1 --2- 172.21.15.6:0/3148324661 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec5815a020 0x7fec58151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5d9eb700 1 --2- 172.21.15.6:0/3148324661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5815a3f0 0x7fec5816af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5d1ea700 1 -- 172.21.15.6:0/3148324661 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec5815a020 msgr2=0x7fec58151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5d1ea700 1 --2- 172.21.15.6:0/3148324661 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec5815a020 0x7fec58151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5d1ea700 1 -- 172.21.15.6:0/3148324661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5815a3f0 msgr2=0x7fec5816af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5d1ea700 1 --2- 172.21.15.6:0/3148324661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5815a3f0 0x7fec5816af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5d1ea700 1 -- 172.21.15.6:0/3148324661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c009420 con 0x7fec580b1450 2023-10-06T02:30:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5d9eb700 1 --2- 172.21.15.6:0/3148324661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5815a3f0 0x7fec5816af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:45.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5d1ea700 1 --2- 172.21.15.6:0/3148324661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec580b1450 0x7fec58168450 secure :-1 s=READY pgs=2567 cs=0 l=1 rev1=1 crypto rx=0x7fec5000c830 tx=0x7fec50008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:45.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec557fa700 1 -- 172.21.15.6:0/3148324661 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50011600 con 0x7fec580b1450 2023-10-06T02:30:45.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec557fa700 1 -- 172.21.15.6:0/3148324661 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec50011760 con 0x7fec580b1450 2023-10-06T02:30:45.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5f44e700 1 -- 172.21.15.6:0/3148324661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec58167f50 con 0x7fec580b1450 2023-10-06T02:30:45.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec557fa700 1 -- 172.21.15.6:0/3148324661 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50011b20 con 0x7fec580b1450 2023-10-06T02:30:45.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.122+0000 7fec5f44e700 1 -- 172.21.15.6:0/3148324661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec581515b0 con 0x7fec580b1450 2023-10-06T02:30:45.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.123+0000 7fec5f44e700 1 -- 172.21.15.6:0/3148324661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec581682c0 con 0x7fec580b1450 2023-10-06T02:30:45.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.124+0000 7fec557fa700 1 -- 172.21.15.6:0/3148324661 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec500193b0 con 0x7fec580b1450 2023-10-06T02:30:45.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.124+0000 7fec557fa700 1 --2- 172.21.15.6:0/3148324661 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec44066f30 0x7fec440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:45.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.124+0000 7fec557fa700 1 -- 172.21.15.6:0/3148324661 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fec50084980 con 0x7fec580b1450 2023-10-06T02:30:45.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.124+0000 7fec5c9e9700 1 --2- 172.21.15.6:0/3148324661 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec44066f30 0x7fec440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:45.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.125+0000 7fec5c9e9700 1 --2- 172.21.15.6:0/3148324661 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec44066f30 0x7fec440693e0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0091e0 tx=0x7fec4c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:45.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.128+0000 7fec557fa700 1 -- 172.21.15.6:0/3148324661 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec500517f0 con 0x7fec580b1450 2023-10-06T02:30:45.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:45.321+0000 7fec5f44e700 1 -- 172.21.15.6:0/3148324661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fec581680e0 con 0x7fec580b1450 2023-10-06T02:30:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.122+0000 7fec557fa700 1 -- 172.21.15.6:0/3148324661 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v151) v1 ==== 181+0+0 (secure 0 0 0) 0x7fec50054e10 con 0x7fec580b1450 2023-10-06T02:30:46.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.129+0000 7fec5f44e700 1 -- 172.21.15.6:0/3148324661 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec44066f30 msgr2=0x7fec440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:46.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.129+0000 7fec5f44e700 1 --2- 172.21.15.6:0/3148324661 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec44066f30 0x7fec440693e0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0091e0 tx=0x7fec4c017000 comp rx=0 tx=0).stop 2023-10-06T02:30:46.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.129+0000 7fec5f44e700 1 -- 172.21.15.6:0/3148324661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec580b1450 msgr2=0x7fec58168450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:46.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.129+0000 7fec5f44e700 1 --2- 172.21.15.6:0/3148324661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec580b1450 0x7fec58168450 secure :-1 s=READY pgs=2567 cs=0 l=1 rev1=1 crypto rx=0x7fec5000c830 tx=0x7fec50008040 comp rx=0 tx=0).stop 2023-10-06T02:30:46.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.129+0000 7fec5f44e700 1 -- 172.21.15.6:0/3148324661 shutdown_connections 2023-10-06T02:30:46.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.129+0000 7fec5f44e700 1 --2- 172.21.15.6:0/3148324661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5815a3f0 0x7fec5816af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.129+0000 7fec5f44e700 1 --2- 172.21.15.6:0/3148324661 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fec44066f30 0x7fec440693e0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.129+0000 7fec5f44e700 1 --2- 172.21.15.6:0/3148324661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec580b1450 0x7fec58168450 secure :-1 s=CLOSED pgs=2567 cs=0 l=1 rev1=1 crypto rx=0x7fec5000c830 tx=0x7fec50008040 comp rx=0 tx=0).stop 2023-10-06T02:30:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.129+0000 7fec5f44e700 1 --2- 172.21.15.6:0/3148324661 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec5815a020 0x7fec58151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.130+0000 7fec5f44e700 1 -- 172.21.15.6:0/3148324661 >> 172.21.15.6:0/3148324661 conn(0x7fec580963e0 msgr2=0x7fec58155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.130+0000 7fec5f44e700 1 -- 172.21.15.6:0/3148324661 shutdown_connections 2023-10-06T02:30:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.132+0000 7fec5f44e700 1 -- 172.21.15.6:0/3148324661 wait complete. 2023-10-06T02:30:46.136 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:30:46.149 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:30:46.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.278+0000 7fa6504ea700 1 Processor -- start 2023-10-06T02:30:46.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.278+0000 7fa6504ea700 1 -- start start 2023-10-06T02:30:46.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.279+0000 7fa6504ea700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa648156350 0x7fa6480b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:46.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.279+0000 7fa6504ea700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa6480b0fe0 0x7fa6480b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:46.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.279+0000 7fa6504ea700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6480af770 con 0x7fa648155f80 2023-10-06T02:30:46.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.279+0000 7fa6504ea700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6480b19c0 con 0x7fa648156350 2023-10-06T02:30:46.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.279+0000 7fa6504ea700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6480afa50 con 0x7fa6480b0fe0 2023-10-06T02:30:46.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.279+0000 7fa64da85700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa648156350 0x7fa6480b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:46.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.280+0000 7fa64e286700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa648155f80 0x7fa6480aecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51598/0 (socket says 172.21.15.6:51598) 2023-10-06T02:30:46.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.280+0000 7fa64e286700 1 -- 172.21.15.6:0/4002504768 learned_addr learned my addr 172.21.15.6:0/4002504768 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:46.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.280+0000 7fa64da85700 1 --2- 172.21.15.6:0/4002504768 >> v2:172.21.15.6:3300/0 conn(0x7fa648156350 0x7fa6480b0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37726/0 (socket says 172.21.15.6:37726) 2023-10-06T02:30:46.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.280+0000 7fa64ea87700 1 --2- 172.21.15.6:0/4002504768 >> v2:172.21.15.175:3300/0 conn(0x7fa6480b0fe0 0x7fa6480b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:46.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.280+0000 7fa64da85700 1 -- 172.21.15.6:0/4002504768 >> v2:172.21.15.175:3300/0 conn(0x7fa6480b0fe0 msgr2=0x7fa6480b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:46.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.280+0000 7fa64da85700 1 --2- 172.21.15.6:0/4002504768 >> v2:172.21.15.175:3300/0 conn(0x7fa6480b0fe0 0x7fa6480b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:46.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.280+0000 7fa64da85700 1 -- 172.21.15.6:0/4002504768 >> v1:172.21.15.6:6789/0 conn(0x7fa648155f80 legacy=0x7fa6480aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:46.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.280+0000 7fa64da85700 1 -- 172.21.15.6:0/4002504768 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6480afd30 con 0x7fa648156350 2023-10-06T02:30:46.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.280+0000 7fa64ea87700 1 --2- 172.21.15.6:0/4002504768 >> v2:172.21.15.175:3300/0 conn(0x7fa6480b0fe0 0x7fa6480b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:46.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.280+0000 7fa64d284700 1 -- 172.21.15.6:0/4002504768 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937446667 0 0) 0x7fa6480af770 con 0x7fa648155f80 2023-10-06T02:30:46.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.280+0000 7fa64da85700 1 --2- 172.21.15.6:0/4002504768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa648156350 0x7fa6480b0810 secure :-1 s=READY pgs=2569 cs=0 l=1 rev1=1 crypto rx=0x7fa64806c7c0 tx=0x7fa63c00b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6325f135138ec28 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:46.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.280+0000 7fa64d284700 1 -- 172.21.15.6:0/4002504768 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00db70 con 0x7fa648156350 2023-10-06T02:30:46.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.280+0000 7fa64d284700 1 -- 172.21.15.6:0/4002504768 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c00dcd0 con 0x7fa648156350 2023-10-06T02:30:46.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.280+0000 7fa64d284700 1 -- 172.21.15.6:0/4002504768 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c0196d0 con 0x7fa648156350 2023-10-06T02:30:46.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.281+0000 7fa6504ea700 1 -- 172.21.15.6:0/4002504768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa648156350 msgr2=0x7fa6480b0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:46.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.281+0000 7fa6504ea700 1 --2- 172.21.15.6:0/4002504768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa648156350 0x7fa6480b0810 secure :-1 s=READY pgs=2569 cs=0 l=1 rev1=1 crypto rx=0x7fa64806c7c0 tx=0x7fa63c00b430 comp rx=0 tx=0).stop 2023-10-06T02:30:46.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.281+0000 7fa6504ea700 1 -- 172.21.15.6:0/4002504768 shutdown_connections 2023-10-06T02:30:46.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.281+0000 7fa6504ea700 1 --2- 172.21.15.6:0/4002504768 >> v2:172.21.15.175:3300/0 conn(0x7fa6480b0fe0 0x7fa6480b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:46.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.281+0000 7fa6504ea700 1 --2- 172.21.15.6:0/4002504768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa648156350 0x7fa6480b0810 unknown :-1 s=CLOSED pgs=2569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:46.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.281+0000 7fa6504ea700 1 -- 172.21.15.6:0/4002504768 >> 172.21.15.6:0/4002504768 conn(0x7fa6480cbef0 msgr2=0x7fa6480cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:46.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.281+0000 7fa6504ea700 1 -- 172.21.15.6:0/4002504768 shutdown_connections 2023-10-06T02:30:46.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.281+0000 7fa6504ea700 1 -- 172.21.15.6:0/4002504768 wait complete. 2023-10-06T02:30:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.282+0000 7fa6504ea700 1 Processor -- start 2023-10-06T02:30:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.282+0000 7fa6504ea700 1 -- start start 2023-10-06T02:30:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa6504ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6480b0fe0 0x7fa648140b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa6504ea700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa648155f80 0x7fa6480c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa6504ea700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa648156350 0x7fa6480c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa6504ea700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6481410d0 con 0x7fa6480b0fe0 2023-10-06T02:30:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa6504ea700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa648152940 con 0x7fa648155f80 2023-10-06T02:30:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa6504ea700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa648152c20 con 0x7fa648156350 2023-10-06T02:30:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa64e286700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6480b0fe0 0x7fa648140b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:46.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa64e286700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6480b0fe0 0x7fa648140b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37740/0 (socket says 172.21.15.6:37740) 2023-10-06T02:30:46.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa64e286700 1 -- 172.21.15.6:0/3698206430 learned_addr learned my addr 172.21.15.6:0/3698206430 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:46.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa64da85700 1 --2- 172.21.15.6:0/3698206430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa648155f80 0x7fa6480c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:46.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa64ea87700 1 --2- 172.21.15.6:0/3698206430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa648156350 0x7fa6480c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:46.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa64e286700 1 -- 172.21.15.6:0/3698206430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa648156350 msgr2=0x7fa6480c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:46.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa64e286700 1 --2- 172.21.15.6:0/3698206430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa648156350 0x7fa6480c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:46.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa64e286700 1 -- 172.21.15.6:0/3698206430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa648155f80 msgr2=0x7fa6480c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:46.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa64e286700 1 --2- 172.21.15.6:0/3698206430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa648155f80 0x7fa6480c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:46.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa64e286700 1 -- 172.21.15.6:0/3698206430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c00b6d0 con 0x7fa6480b0fe0 2023-10-06T02:30:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa64ea87700 1 --2- 172.21.15.6:0/3698206430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa648156350 0x7fa6480c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa64e286700 1 --2- 172.21.15.6:0/3698206430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6480b0fe0 0x7fa648140b90 secure :-1 s=READY pgs=2570 cs=0 l=1 rev1=1 crypto rx=0x7fa64000c7e0 tx=0x7fa640007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa6467fc700 1 -- 172.21.15.6:0/3698206430 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640005b30 con 0x7fa6480b0fe0 2023-10-06T02:30:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa6467fc700 1 -- 172.21.15.6:0/3698206430 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa640005c90 con 0x7fa6480b0fe0 2023-10-06T02:30:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa6504ea700 1 -- 172.21.15.6:0/3698206430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa648152f00 con 0x7fa6480b0fe0 2023-10-06T02:30:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa6467fc700 1 -- 172.21.15.6:0/3698206430 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640007300 con 0x7fa6480b0fe0 2023-10-06T02:30:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.283+0000 7fa6504ea700 1 -- 172.21.15.6:0/3698206430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6480c5ff0 con 0x7fa6480b0fe0 2023-10-06T02:30:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.284+0000 7fa6504ea700 1 -- 172.21.15.6:0/3698206430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6480c5e50 con 0x7fa6480b0fe0 2023-10-06T02:30:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.285+0000 7fa6467fc700 1 -- 172.21.15.6:0/3698206430 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa64001b400 con 0x7fa6480b0fe0 2023-10-06T02:30:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.285+0000 7fa6467fc700 1 --2- 172.21.15.6:0/3698206430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa634066f30 0x7fa6340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.285+0000 7fa6467fc700 1 -- 172.21.15.6:0/3698206430 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6170+0+0 (secure 0 0 0) 0x7fa640084200 con 0x7fa6480b0fe0 2023-10-06T02:30:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.285+0000 7fa64da85700 1 --2- 172.21.15.6:0/3698206430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa634066f30 0x7fa6340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:46.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.286+0000 7fa64da85700 1 --2- 172.21.15.6:0/3698206430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa634066f30 0x7fa6340693e0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fa6480ab690 tx=0x7fa63c01b000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:46.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.289+0000 7fa6467fc700 1 -- 172.21.15.6:0/3698206430 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6480c5e50 con 0x7fa6480b0fe0 2023-10-06T02:30:46.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:46.484+0000 7fa6504ea700 1 -- 172.21.15.6:0/3698206430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa6480c5e50 con 0x7fa6480b0fe0 2023-10-06T02:30:47.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.138+0000 7fa6467fc700 1 -- 172.21.15.6:0/3698206430 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v152) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa6480c5e50 con 0x7fa6480b0fe0 2023-10-06T02:30:47.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.148+0000 7fa6504ea700 1 -- 172.21.15.6:0/3698206430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa634066f30 msgr2=0x7fa6340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.148+0000 7fa6504ea700 1 --2- 172.21.15.6:0/3698206430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa634066f30 0x7fa6340693e0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fa6480ab690 tx=0x7fa63c01b000 comp rx=0 tx=0).stop 2023-10-06T02:30:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.148+0000 7fa6504ea700 1 -- 172.21.15.6:0/3698206430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6480b0fe0 msgr2=0x7fa648140b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.148+0000 7fa6504ea700 1 --2- 172.21.15.6:0/3698206430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6480b0fe0 0x7fa648140b90 secure :-1 s=READY pgs=2570 cs=0 l=1 rev1=1 crypto rx=0x7fa64000c7e0 tx=0x7fa640007df0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.148+0000 7fa6504ea700 1 -- 172.21.15.6:0/3698206430 shutdown_connections 2023-10-06T02:30:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.148+0000 7fa6504ea700 1 --2- 172.21.15.6:0/3698206430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa648156350 0x7fa6480c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.148+0000 7fa6504ea700 1 --2- 172.21.15.6:0/3698206430 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa634066f30 0x7fa6340693e0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.148+0000 7fa6504ea700 1 --2- 172.21.15.6:0/3698206430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6480b0fe0 0x7fa648140b90 secure :-1 s=CLOSED pgs=2570 cs=0 l=1 rev1=1 crypto rx=0x7fa64000c7e0 tx=0x7fa640007df0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.148+0000 7fa6504ea700 1 --2- 172.21.15.6:0/3698206430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa648155f80 0x7fa6480c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.148+0000 7fa6504ea700 1 -- 172.21.15.6:0/3698206430 >> 172.21.15.6:0/3698206430 conn(0x7fa6480cbef0 msgr2=0x7fa64806a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:47.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.150+0000 7fa6504ea700 1 -- 172.21.15.6:0/3698206430 shutdown_connections 2023-10-06T02:30:47.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.150+0000 7fa6504ea700 1 -- 172.21.15.6:0/3698206430 wait complete. 2023-10-06T02:30:47.153 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-06T02:30:47.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:30:47.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.294+0000 7fee702e6700 1 Processor -- start 2023-10-06T02:30:47.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.294+0000 7fee702e6700 1 -- start start 2023-10-06T02:30:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.294+0000 7fee702e6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee680d0400 0x7fee680b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee702e6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680ccd40 0x7fee680cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee702e6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fee680cf7e0 0x7fee680b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee702e6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee680b6170 con 0x7fee680d0400 2023-10-06T02:30:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee702e6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6815dd40 con 0x7fee680cf7e0 2023-10-06T02:30:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee702e6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6815e020 con 0x7fee680ccd40 2023-10-06T02:30:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee6e082700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee680d0400 0x7fee680b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee6e082700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee680d0400 0x7fee680b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37744/0 (socket says 172.21.15.6:37744) 2023-10-06T02:30:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee6e082700 1 -- 172.21.15.6:0/1732928919 learned_addr learned my addr 172.21.15.6:0/1732928919 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee6d881700 1 --2- 172.21.15.6:0/1732928919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680ccd40 0x7fee680cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee6e883700 1 --2- 172.21.15.6:0/1732928919 >> v2:172.21.15.175:3300/0 conn(0x7fee680cf7e0 0x7fee680b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee6e082700 1 -- 172.21.15.6:0/1732928919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680ccd40 msgr2=0x7fee680cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee6e082700 1 --2- 172.21.15.6:0/1732928919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680ccd40 0x7fee680cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee6e082700 1 -- 172.21.15.6:0/1732928919 >> v2:172.21.15.175:3300/0 conn(0x7fee680cf7e0 msgr2=0x7fee680b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee6e082700 1 --2- 172.21.15.6:0/1732928919 >> v2:172.21.15.175:3300/0 conn(0x7fee680cf7e0 0x7fee680b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee6e082700 1 -- 172.21.15.6:0/1732928919 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee680ceaa0 con 0x7fee680d0400 2023-10-06T02:30:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee6d881700 1 --2- 172.21.15.6:0/1732928919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680ccd40 0x7fee680cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee6e883700 1 --2- 172.21.15.6:0/1732928919 >> v2:172.21.15.175:3300/0 conn(0x7fee680cf7e0 0x7fee680b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee6e082700 1 --2- 172.21.15.6:0/1732928919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680d0400 0x7fee680b5c30 secure :-1 s=READY pgs=2571 cs=0 l=1 rev1=1 crypto rx=0x7fee680b3830 tx=0x7fee60009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b5cf66c5b06224 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:47.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee6d080700 1 -- 172.21.15.6:0/1732928919 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60005c10 con 0x7fee680d0400 2023-10-06T02:30:47.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee6d080700 1 -- 172.21.15.6:0/1732928919 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee60005d70 con 0x7fee680d0400 2023-10-06T02:30:47.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.295+0000 7fee6d080700 1 -- 172.21.15.6:0/1732928919 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000b880 con 0x7fee680d0400 2023-10-06T02:30:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.296+0000 7fee702e6700 1 -- 172.21.15.6:0/1732928919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680d0400 msgr2=0x7fee680b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.296+0000 7fee702e6700 1 --2- 172.21.15.6:0/1732928919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680d0400 0x7fee680b5c30 secure :-1 s=READY pgs=2571 cs=0 l=1 rev1=1 crypto rx=0x7fee680b3830 tx=0x7fee60009220 comp rx=0 tx=0).stop 2023-10-06T02:30:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.296+0000 7fee702e6700 1 -- 172.21.15.6:0/1732928919 shutdown_connections 2023-10-06T02:30:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.296+0000 7fee702e6700 1 --2- 172.21.15.6:0/1732928919 >> v2:172.21.15.175:3300/0 conn(0x7fee680cf7e0 0x7fee680b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.296+0000 7fee702e6700 1 --2- 172.21.15.6:0/1732928919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680d0400 0x7fee680b5c30 unknown :-1 s=CLOSED pgs=2571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.296+0000 7fee702e6700 1 --2- 172.21.15.6:0/1732928919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680ccd40 0x7fee680cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.296+0000 7fee702e6700 1 -- 172.21.15.6:0/1732928919 >> 172.21.15.6:0/1732928919 conn(0x7fee6806a220 msgr2=0x7fee6806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.296+0000 7fee702e6700 1 -- 172.21.15.6:0/1732928919 shutdown_connections 2023-10-06T02:30:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.296+0000 7fee702e6700 1 -- 172.21.15.6:0/1732928919 wait complete. 2023-10-06T02:30:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.297+0000 7fee702e6700 1 Processor -- start 2023-10-06T02:30:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.297+0000 7fee702e6700 1 -- start start 2023-10-06T02:30:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.298+0000 7fee702e6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680ccd40 0x7fee6816d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.298+0000 7fee702e6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee680cf7e0 0x7fee6816d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.298+0000 7fee702e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680d0400 0x7fee68151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.298+0000 7fee702e6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee68153fb0 con 0x7fee680d0400 2023-10-06T02:30:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.298+0000 7fee702e6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee68152f10 con 0x7fee680cf7e0 2023-10-06T02:30:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.298+0000 7fee702e6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee681531f0 con 0x7fee680ccd40 2023-10-06T02:30:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.298+0000 7fee6e883700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680d0400 0x7fee68151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.298+0000 7fee6e883700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680d0400 0x7fee68151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37750/0 (socket says 172.21.15.6:37750) 2023-10-06T02:30:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.298+0000 7fee6e883700 1 -- 172.21.15.6:0/1821078612 learned_addr learned my addr 172.21.15.6:0/1821078612 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.298+0000 7fee6e082700 1 --2- 172.21.15.6:0/1821078612 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680ccd40 0x7fee6816d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.298+0000 7fee6d881700 1 --2- 172.21.15.6:0/1821078612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee680cf7e0 0x7fee6816d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.298+0000 7fee6e883700 1 -- 172.21.15.6:0/1821078612 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680ccd40 msgr2=0x7fee6816d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.298+0000 7fee6e883700 1 --2- 172.21.15.6:0/1821078612 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680ccd40 0x7fee6816d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.298+0000 7fee6e883700 1 -- 172.21.15.6:0/1821078612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee680cf7e0 msgr2=0x7fee6816d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.298+0000 7fee6e883700 1 --2- 172.21.15.6:0/1821078612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee680cf7e0 0x7fee6816d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.298+0000 7fee6e883700 1 -- 172.21.15.6:0/1821078612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee60009480 con 0x7fee680d0400 2023-10-06T02:30:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.298+0000 7fee6e883700 1 --2- 172.21.15.6:0/1821078612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680d0400 0x7fee68151af0 secure :-1 s=READY pgs=2572 cs=0 l=1 rev1=1 crypto rx=0x7fee5800a380 tx=0x7fee58007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.299+0000 7fee667fc700 1 -- 172.21.15.6:0/1821078612 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58015440 con 0x7fee680d0400 2023-10-06T02:30:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.299+0000 7fee667fc700 1 -- 172.21.15.6:0/1821078612 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee580155a0 con 0x7fee680d0400 2023-10-06T02:30:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.299+0000 7fee702e6700 1 -- 172.21.15.6:0/1821078612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee681534d0 con 0x7fee680d0400 2023-10-06T02:30:47.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.299+0000 7fee667fc700 1 -- 172.21.15.6:0/1821078612 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58015960 con 0x7fee680d0400 2023-10-06T02:30:47.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.299+0000 7fee702e6700 1 -- 172.21.15.6:0/1821078612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee68153a90 con 0x7fee680d0400 2023-10-06T02:30:47.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.299+0000 7fee702e6700 1 -- 172.21.15.6:0/1821078612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee68153cb0 con 0x7fee680d0400 2023-10-06T02:30:47.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.300+0000 7fee667fc700 1 -- 172.21.15.6:0/1821078612 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee58015d50 con 0x7fee680d0400 2023-10-06T02:30:47.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.300+0000 7fee667fc700 1 --2- 172.21.15.6:0/1821078612 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fee54066f30 0x7fee540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:47.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.301+0000 7fee667fc700 1 -- 172.21.15.6:0/1821078612 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fee58084d80 con 0x7fee680d0400 2023-10-06T02:30:47.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.301+0000 7fee6e082700 1 --2- 172.21.15.6:0/1821078612 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fee54066f30 0x7fee540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:47.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.301+0000 7fee6e082700 1 --2- 172.21.15.6:0/1821078612 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fee54066f30 0x7fee540693e0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fee60009260 tx=0x7fee60016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:47.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.305+0000 7fee667fc700 1 -- 172.21.15.6:0/1821078612 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee58051ff0 con 0x7fee680d0400 2023-10-06T02:30:47.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.501+0000 7fee702e6700 1 -- 172.21.15.6:0/1821078612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fee680ced80 con 0x7fee680d0400 2023-10-06T02:30:47.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.505+0000 7fee667fc700 1 -- 172.21.15.6:0/1821078612 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7fee58055610 con 0x7fee680d0400 2023-10-06T02:30:47.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.507+0000 7fee702e6700 1 -- 172.21.15.6:0/1821078612 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fee54066f30 msgr2=0x7fee540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:47.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.507+0000 7fee702e6700 1 --2- 172.21.15.6:0/1821078612 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fee54066f30 0x7fee540693e0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fee60009260 tx=0x7fee60016000 comp rx=0 tx=0).stop 2023-10-06T02:30:47.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.507+0000 7fee702e6700 1 -- 172.21.15.6:0/1821078612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680d0400 msgr2=0x7fee68151af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:47.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.507+0000 7fee702e6700 1 --2- 172.21.15.6:0/1821078612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680d0400 0x7fee68151af0 secure :-1 s=READY pgs=2572 cs=0 l=1 rev1=1 crypto rx=0x7fee5800a380 tx=0x7fee58007900 comp rx=0 tx=0).stop 2023-10-06T02:30:47.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.507+0000 7fee702e6700 1 -- 172.21.15.6:0/1821078612 shutdown_connections 2023-10-06T02:30:47.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.507+0000 7fee702e6700 1 --2- 172.21.15.6:0/1821078612 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fee54066f30 0x7fee540693e0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.507+0000 7fee702e6700 1 --2- 172.21.15.6:0/1821078612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680d0400 0x7fee68151af0 unknown :-1 s=CLOSED pgs=2572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.507+0000 7fee702e6700 1 --2- 172.21.15.6:0/1821078612 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680ccd40 0x7fee6816d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.507+0000 7fee702e6700 1 --2- 172.21.15.6:0/1821078612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee680cf7e0 0x7fee6816d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.507+0000 7fee702e6700 1 -- 172.21.15.6:0/1821078612 >> 172.21.15.6:0/1821078612 conn(0x7fee6806a220 msgr2=0x7fee68156b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:47.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.507+0000 7fee702e6700 1 -- 172.21.15.6:0/1821078612 shutdown_connections 2023-10-06T02:30:47.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.507+0000 7fee702e6700 1 -- 172.21.15.6:0/1821078612 wait complete. 2023-10-06T02:30:47.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors' 2023-10-06T02:30:47.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.638+0000 7f72de042700 1 Processor -- start 2023-10-06T02:30:47.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.638+0000 7f72de042700 1 -- start start 2023-10-06T02:30:47.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.639+0000 7f72de042700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f72d80cf1a0 0x7f72d80cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:47.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.639+0000 7f72de042700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72d81597d0 0x7f72d80d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:47.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.639+0000 7f72de042700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d80b3560 con 0x7f72d8159400 2023-10-06T02:30:47.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.639+0000 7f72de042700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d80cf6f0 con 0x7f72d81597d0 2023-10-06T02:30:47.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.639+0000 7f72de042700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d80cf9d0 con 0x7f72d80cf1a0 2023-10-06T02:30:47.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.639+0000 7f72dd841700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72d81597d0 0x7f72d80d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:47.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.639+0000 7f72dd040700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f72d8159400 0x7f72d80ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51600/0 (socket says 172.21.15.6:51600) 2023-10-06T02:30:47.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.639+0000 7f72dd040700 1 -- 172.21.15.6:0/2072230087 learned_addr learned my addr 172.21.15.6:0/2072230087 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:47.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.639+0000 7f72dd841700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72d81597d0 0x7f72d80d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37760/0 (socket says 172.21.15.6:37760) 2023-10-06T02:30:47.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.640+0000 7f72dc83f700 1 --2- 172.21.15.6:0/2072230087 >> v2:172.21.15.175:3300/0 conn(0x7f72d80cf1a0 0x7f72d80cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:47.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.640+0000 7f72dd841700 1 -- 172.21.15.6:0/2072230087 >> v2:172.21.15.175:3300/0 conn(0x7f72d80cf1a0 msgr2=0x7f72d80cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:47.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.640+0000 7f72dd841700 1 --2- 172.21.15.6:0/2072230087 >> v2:172.21.15.175:3300/0 conn(0x7f72d80cf1a0 0x7f72d80cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.640+0000 7f72d7fff700 1 -- 172.21.15.6:0/2072230087 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869938083 0 0) 0x7f72d80b3560 con 0x7f72d8159400 2023-10-06T02:30:47.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.640+0000 7f72dd841700 1 -- 172.21.15.6:0/2072230087 >> v1:172.21.15.6:6789/0 conn(0x7f72d8159400 legacy=0x7f72d80ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:47.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.640+0000 7f72dd841700 1 -- 172.21.15.6:0/2072230087 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d80b2f10 con 0x7f72d81597d0 2023-10-06T02:30:47.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.640+0000 7f72dd841700 1 --2- 172.21.15.6:0/2072230087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d81597d0 0x7f72d80d0400 secure :-1 s=READY pgs=2574 cs=0 l=1 rev1=1 crypto rx=0x7f72d815d0f0 tx=0x7f72c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25e46860d5a5d02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:47.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.640+0000 7f72d7fff700 1 -- 172.21.15.6:0/2072230087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c800e070 con 0x7f72d81597d0 2023-10-06T02:30:47.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.640+0000 7f72d7fff700 1 -- 172.21.15.6:0/2072230087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c800bc30 con 0x7f72d81597d0 2023-10-06T02:30:47.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.640+0000 7f72d7fff700 1 -- 172.21.15.6:0/2072230087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c8012430 con 0x7f72d81597d0 2023-10-06T02:30:47.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.640+0000 7f72de042700 1 -- 172.21.15.6:0/2072230087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d81597d0 msgr2=0x7f72d80d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:47.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.640+0000 7f72de042700 1 --2- 172.21.15.6:0/2072230087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d81597d0 0x7f72d80d0400 secure :-1 s=READY pgs=2574 cs=0 l=1 rev1=1 crypto rx=0x7f72d815d0f0 tx=0x7f72c8009780 comp rx=0 tx=0).stop 2023-10-06T02:30:47.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.640+0000 7f72de042700 1 -- 172.21.15.6:0/2072230087 shutdown_connections 2023-10-06T02:30:47.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.640+0000 7f72de042700 1 --2- 172.21.15.6:0/2072230087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d81597d0 0x7f72d80d0400 unknown :-1 s=CLOSED pgs=2574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.640+0000 7f72de042700 1 --2- 172.21.15.6:0/2072230087 >> v2:172.21.15.175:3300/0 conn(0x7f72d80cf1a0 0x7f72d80cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.640+0000 7f72de042700 1 -- 172.21.15.6:0/2072230087 >> 172.21.15.6:0/2072230087 conn(0x7f72d806ac10 msgr2=0x7f72d8068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:47.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.641+0000 7f72de042700 1 -- 172.21.15.6:0/2072230087 shutdown_connections 2023-10-06T02:30:47.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.641+0000 7f72de042700 1 -- 172.21.15.6:0/2072230087 wait complete. 2023-10-06T02:30:47.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.642+0000 7f72de042700 1 Processor -- start 2023-10-06T02:30:47.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.642+0000 7f72de042700 1 -- start start 2023-10-06T02:30:47.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72de042700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d80cf1a0 0x7f72d8153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:47.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72de042700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d8159400 0x7f72d8169e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:47.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72de042700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72d81597d0 0x7f72d80cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:47.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72de042700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d80c6a50 con 0x7f72d8159400 2023-10-06T02:30:47.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72de042700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d80c4ef0 con 0x7f72d80cf1a0 2023-10-06T02:30:47.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72de042700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d816a3d0 con 0x7f72d81597d0 2023-10-06T02:30:47.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72dc83f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d8159400 0x7f72d8169e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:47.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72dc83f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d8159400 0x7f72d8169e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37764/0 (socket says 172.21.15.6:37764) 2023-10-06T02:30:47.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72dc83f700 1 -- 172.21.15.6:0/4233554055 learned_addr learned my addr 172.21.15.6:0/4233554055 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:47.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72dd841700 1 --2- 172.21.15.6:0/4233554055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72d81597d0 0x7f72d80cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:47.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72dd040700 1 --2- 172.21.15.6:0/4233554055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d80cf1a0 0x7f72d8153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:47.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72dc83f700 1 -- 172.21.15.6:0/4233554055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72d81597d0 msgr2=0x7f72d80cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:47.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72dc83f700 1 --2- 172.21.15.6:0/4233554055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72d81597d0 0x7f72d80cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72dc83f700 1 -- 172.21.15.6:0/4233554055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d80cf1a0 msgr2=0x7f72d8153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:47.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72dc83f700 1 --2- 172.21.15.6:0/4233554055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d80cf1a0 0x7f72d8153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:47.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72dc83f700 1 -- 172.21.15.6:0/4233554055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c8009a20 con 0x7f72d8159400 2023-10-06T02:30:47.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72dc83f700 1 --2- 172.21.15.6:0/4233554055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d8159400 0x7f72d8169e90 secure :-1 s=READY pgs=2575 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00c880 tx=0x7f72cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:47.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72d57fa700 1 -- 172.21.15.6:0/4233554055 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc011600 con 0x7f72d8159400 2023-10-06T02:30:47.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72d57fa700 1 -- 172.21.15.6:0/4233554055 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc0117a0 con 0x7f72d8159400 2023-10-06T02:30:47.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72de042700 1 -- 172.21.15.6:0/4233554055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d815b700 con 0x7f72d8159400 2023-10-06T02:30:47.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72d57fa700 1 -- 172.21.15.6:0/4233554055 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc011b60 con 0x7f72d8159400 2023-10-06T02:30:47.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.643+0000 7f72de042700 1 -- 172.21.15.6:0/4233554055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d816d290 con 0x7f72d8159400 2023-10-06T02:30:47.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.644+0000 7f72de042700 1 -- 172.21.15.6:0/4233554055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d815b890 con 0x7f72d8159400 2023-10-06T02:30:47.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.645+0000 7f72d57fa700 1 -- 172.21.15.6:0/4233554055 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72cc018360 con 0x7f72d8159400 2023-10-06T02:30:47.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.645+0000 7f72d57fa700 1 --2- 172.21.15.6:0/4233554055 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f72c4066f30 0x7f72c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:47.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.645+0000 7f72d57fa700 1 -- 172.21.15.6:0/4233554055 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f72cc084340 con 0x7f72d8159400 2023-10-06T02:30:47.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.645+0000 7f72dd040700 1 --2- 172.21.15.6:0/4233554055 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f72c4066f30 0x7f72c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:47.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.646+0000 7f72dd040700 1 --2- 172.21.15.6:0/4233554055 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f72c4066f30 0x7f72c40693e0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f72d0001360 tx=0x7f72d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:47.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.649+0000 7f72d57fa700 1 -- 172.21.15.6:0/4233554055 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72cc0515b0 con 0x7f72d8159400 2023-10-06T02:30:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:47.923+0000 7f72de042700 1 -- 172.21.15.6:0/4233554055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors"]} v 0) v1 -- 0x7f72d80cbd40 con 0x7f72d8159400 2023-10-06T02:30:48.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.139+0000 7f72d57fa700 1 -- 172.21.15.6:0/4233554055 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_damage.TestDamage.test_open_ino_errors"]}]=0 v656) v1 ==== 135+0+0 (secure 0 0 0) 0x7f72cc054bd0 con 0x7f72d8159400 2023-10-06T02:30:48.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.141+0000 7f72de042700 1 -- 172.21.15.6:0/4233554055 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f72c4066f30 msgr2=0x7f72c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:48.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.141+0000 7f72de042700 1 --2- 172.21.15.6:0/4233554055 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f72c4066f30 0x7f72c40693e0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f72d0001360 tx=0x7f72d0009040 comp rx=0 tx=0).stop 2023-10-06T02:30:48.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.141+0000 7f72de042700 1 -- 172.21.15.6:0/4233554055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d8159400 msgr2=0x7f72d8169e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:48.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.141+0000 7f72de042700 1 --2- 172.21.15.6:0/4233554055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d8159400 0x7f72d8169e90 secure :-1 s=READY pgs=2575 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00c880 tx=0x7f72cc008040 comp rx=0 tx=0).stop 2023-10-06T02:30:48.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.141+0000 7f72de042700 1 -- 172.21.15.6:0/4233554055 shutdown_connections 2023-10-06T02:30:48.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.141+0000 7f72de042700 1 --2- 172.21.15.6:0/4233554055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72d81597d0 0x7f72d80cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:48.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.141+0000 7f72de042700 1 --2- 172.21.15.6:0/4233554055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d80cf1a0 0x7f72d8153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:48.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.141+0000 7f72de042700 1 --2- 172.21.15.6:0/4233554055 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f72c4066f30 0x7f72c40693e0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:48.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.141+0000 7f72de042700 1 --2- 172.21.15.6:0/4233554055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d8159400 0x7f72d8169e90 unknown :-1 s=CLOSED pgs=2575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:48.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.141+0000 7f72de042700 1 -- 172.21.15.6:0/4233554055 >> 172.21.15.6:0/4233554055 conn(0x7f72d806ac10 msgr2=0x7f72d80b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:48.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.141+0000 7f72de042700 1 -- 172.21.15.6:0/4233554055 shutdown_connections 2023-10-06T02:30:48.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.141+0000 7f72de042700 1 -- 172.21.15.6:0/4233554055 wait complete. 2023-10-06T02:30:48.154 INFO:tasks.cephfs_test_runner:That errors encountered during opening inos are properly propagated ... ok 2023-10-06T02:30:48.155 INFO:tasks.cephfs_test_runner: 2023-10-06T02:30:48.155 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T02:30:48.155 INFO:tasks.cephfs_test_runner:Ran 6 tests in 740.859s 2023-10-06T02:30:48.155 INFO:tasks.cephfs_test_runner: 2023-10-06T02:30:48.155 INFO:tasks.cephfs_test_runner:OK 2023-10-06T02:30:48.155 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T02:30:48.164 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-06T02:30:48.190 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-06T02:30:48.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:48.190 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-10-06T02:30:48.208 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T02:30:48.208 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T02:30:48.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:48.208 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T02:30:48.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:48.289 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:30:48.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:48.370 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2023-10-06T02:30:48.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:48.470 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-06T02:30:48.487 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:30:48.487 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:30:48.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:48.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:30:48.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:48.567 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:30:48.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:30:48.649 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-10-06T02:30:48.753 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T02:30:48.762 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T02:30:48.762 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:30:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.883+0000 7f2b47c76700 1 Processor -- start 2023-10-06T02:30:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.883+0000 7f2b47c76700 1 -- start start 2023-10-06T02:30:48.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.883+0000 7f2b47c76700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2b400b27f0 0x7f2b40159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:48.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.883+0000 7f2b47c76700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b4015d4d0 0x7f2b4015d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:48.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.883+0000 7f2b47c76700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b400cb6c0 con 0x7f2b40159380 2023-10-06T02:30:48.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.883+0000 7f2b47c76700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4015e200 con 0x7f2b400b27f0 2023-10-06T02:30:48.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.884+0000 7f2b47c76700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b400ccb60 con 0x7f2b4015d4d0 2023-10-06T02:30:48.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.884+0000 7f2b45211700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2b400b27f0 0x7f2b40159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:48.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.884+0000 7f2b45211700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2b400b27f0 0x7f2b40159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44604/0 (socket says 172.21.15.6:44604) 2023-10-06T02:30:48.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.884+0000 7f2b45211700 1 -- 172.21.15.6:0/1324433214 learned_addr learned my addr 172.21.15.6:0/1324433214 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:48.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.884+0000 7f2b46213700 1 --2- 172.21.15.6:0/1324433214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b4015d4d0 0x7f2b4015d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:48.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.884+0000 7f2b45211700 1 -- 172.21.15.6:0/1324433214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b4015d4d0 msgr2=0x7f2b4015d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:48.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.884+0000 7f2b45211700 1 --2- 172.21.15.6:0/1324433214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b4015d4d0 0x7f2b4015d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:48.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.884+0000 7f2b45211700 1 -- 172.21.15.6:0/1324433214 >> v1:172.21.15.175:6789/0 conn(0x7f2b40159380 legacy=0x7f2b400b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:48.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.884+0000 7f2b45211700 1 -- 172.21.15.6:0/1324433214 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b400c3ef0 con 0x7f2b400b27f0 2023-10-06T02:30:48.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.884+0000 7f2b45211700 1 --2- 172.21.15.6:0/1324433214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b400b27f0 0x7f2b40159750 secure :-1 s=READY pgs=2576 cs=0 l=1 rev1=1 crypto rx=0x7f2b340099b0 tx=0x7f2b34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a4bbeb8fcb2cb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:48.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.884+0000 7f2b44a10700 1 -- 172.21.15.6:0/1324433214 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3400b860 con 0x7f2b400b27f0 2023-10-06T02:30:48.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.884+0000 7f2b44a10700 1 -- 172.21.15.6:0/1324433214 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3400b9c0 con 0x7f2b400b27f0 2023-10-06T02:30:48.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.884+0000 7f2b44a10700 1 -- 172.21.15.6:0/1324433214 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3400bd80 con 0x7f2b400b27f0 2023-10-06T02:30:48.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.885+0000 7f2b47c76700 1 -- 172.21.15.6:0/1324433214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b400b27f0 msgr2=0x7f2b40159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:48.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.885+0000 7f2b47c76700 1 --2- 172.21.15.6:0/1324433214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b400b27f0 0x7f2b40159750 secure :-1 s=READY pgs=2576 cs=0 l=1 rev1=1 crypto rx=0x7f2b340099b0 tx=0x7f2b34009250 comp rx=0 tx=0).stop 2023-10-06T02:30:48.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.885+0000 7f2b47c76700 1 -- 172.21.15.6:0/1324433214 shutdown_connections 2023-10-06T02:30:48.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.885+0000 7f2b47c76700 1 --2- 172.21.15.6:0/1324433214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b4015d4d0 0x7f2b4015d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:48.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.885+0000 7f2b47c76700 1 --2- 172.21.15.6:0/1324433214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b400b27f0 0x7f2b40159750 unknown :-1 s=CLOSED pgs=2576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:48.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.885+0000 7f2b47c76700 1 -- 172.21.15.6:0/1324433214 >> 172.21.15.6:0/1324433214 conn(0x7f2b40068680 msgr2=0x7f2b40068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:48.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.885+0000 7f2b47c76700 1 -- 172.21.15.6:0/1324433214 shutdown_connections 2023-10-06T02:30:48.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.885+0000 7f2b47c76700 1 -- 172.21.15.6:0/1324433214 wait complete. 2023-10-06T02:30:48.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.886+0000 7f2b47c76700 1 Processor -- start 2023-10-06T02:30:48.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.886+0000 7f2b47c76700 1 -- start start 2023-10-06T02:30:48.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b47c76700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b400b27f0 0x7f2b400c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:48.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b47c76700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b40159380 0x7f2b400c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:48.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b47c76700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b4015d4d0 0x7f2b400c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:48.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b47c76700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b40159750 con 0x7f2b40159380 2023-10-06T02:30:48.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b47c76700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4015a2d0 con 0x7f2b4015d4d0 2023-10-06T02:30:48.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b47c76700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b401599a0 con 0x7f2b400b27f0 2023-10-06T02:30:48.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b45211700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b40159380 0x7f2b400c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:48.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b45211700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b40159380 0x7f2b400c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44608/0 (socket says 172.21.15.6:44608) 2023-10-06T02:30:48.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b45211700 1 -- 172.21.15.6:0/2316307757 learned_addr learned my addr 172.21.15.6:0/2316307757 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:48.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b46213700 1 --2- 172.21.15.6:0/2316307757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b4015d4d0 0x7f2b400c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:48.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b45a12700 1 --2- 172.21.15.6:0/2316307757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b400b27f0 0x7f2b400c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:48.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b45211700 1 -- 172.21.15.6:0/2316307757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b400b27f0 msgr2=0x7f2b400c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:48.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b45211700 1 --2- 172.21.15.6:0/2316307757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b400b27f0 0x7f2b400c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:48.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b45211700 1 -- 172.21.15.6:0/2316307757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b4015d4d0 msgr2=0x7f2b400c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:48.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b45211700 1 --2- 172.21.15.6:0/2316307757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b4015d4d0 0x7f2b400c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:48.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b45211700 1 -- 172.21.15.6:0/2316307757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b340094f0 con 0x7f2b40159380 2023-10-06T02:30:48.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b45a12700 1 --2- 172.21.15.6:0/2316307757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b400b27f0 0x7f2b400c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:48.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.887+0000 7f2b46213700 1 --2- 172.21.15.6:0/2316307757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b4015d4d0 0x7f2b400c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:48.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.888+0000 7f2b45211700 1 --2- 172.21.15.6:0/2316307757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b40159380 0x7f2b400c7e00 secure :-1 s=READY pgs=2577 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400b3c0 tx=0x7f2b34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:48.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.888+0000 7f2b3dffb700 1 -- 172.21.15.6:0/2316307757 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3401f070 con 0x7f2b40159380 2023-10-06T02:30:48.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.888+0000 7f2b3dffb700 1 -- 172.21.15.6:0/2316307757 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b34006b10 con 0x7f2b40159380 2023-10-06T02:30:48.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.888+0000 7f2b47c76700 1 -- 172.21.15.6:0/2316307757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b40159c80 con 0x7f2b40159380 2023-10-06T02:30:48.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.888+0000 7f2b3dffb700 1 -- 172.21.15.6:0/2316307757 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3401a650 con 0x7f2b40159380 2023-10-06T02:30:48.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.888+0000 7f2b47c76700 1 -- 172.21.15.6:0/2316307757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4015a760 con 0x7f2b40159380 2023-10-06T02:30:48.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.889+0000 7f2b47c76700 1 -- 172.21.15.6:0/2316307757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b40088aa0 con 0x7f2b40159380 2023-10-06T02:30:48.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.889+0000 7f2b3dffb700 1 -- 172.21.15.6:0/2316307757 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b3401aa40 con 0x7f2b40159380 2023-10-06T02:30:48.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.890+0000 7f2b3dffb700 1 --2- 172.21.15.6:0/2316307757 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2b2c066f30 0x7f2b2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:48.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.890+0000 7f2b3dffb700 1 -- 172.21.15.6:0/2316307757 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f2b34085940 con 0x7f2b40159380 2023-10-06T02:30:48.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.890+0000 7f2b45a12700 1 --2- 172.21.15.6:0/2316307757 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2b2c066f30 0x7f2b2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:48.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.891+0000 7f2b45a12700 1 --2- 172.21.15.6:0/2316307757 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2b2c066f30 0x7f2b2c0693e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f2b38007fd0 tx=0x7f2b38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:48.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:48.894+0000 7f2b3dffb700 1 -- 172.21.15.6:0/2316307757 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b34052c30 con 0x7f2b40159380 2023-10-06T02:30:49.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.092+0000 7f2b47c76700 1 -- 172.21.15.6:0/2316307757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b4015a410 con 0x7f2b40159380 2023-10-06T02:30:49.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.093+0000 7f2b3dffb700 1 -- 172.21.15.6:0/2316307757 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+14072 (secure 0 0 0) 0x7f2b34015090 con 0x7f2b40159380 2023-10-06T02:30:49.094 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:49.094 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":152,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:30:47.131199+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/3837760829":"2023-10-07T02:30:43.924847+0000","172.21.15.6:6833/3837760829":"2023-10-07T02:30:43.924847+0000","172.21.15.6:6835/1108543434":"2023-10-07T02:30:28.039955+0000","172.21.15.6:6833/1108543434":"2023-10-07T02:30:28.039955+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:30:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.095+0000 7f2b47c76700 1 -- 172.21.15.6:0/2316307757 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2b2c066f30 msgr2=0x7f2b2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.095+0000 7f2b47c76700 1 --2- 172.21.15.6:0/2316307757 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2b2c066f30 0x7f2b2c0693e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f2b38007fd0 tx=0x7f2b38009040 comp rx=0 tx=0).stop 2023-10-06T02:30:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.095+0000 7f2b47c76700 1 -- 172.21.15.6:0/2316307757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b40159380 msgr2=0x7f2b400c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.095+0000 7f2b47c76700 1 --2- 172.21.15.6:0/2316307757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b40159380 0x7f2b400c7e00 secure :-1 s=READY pgs=2577 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400b3c0 tx=0x7f2b34017000 comp rx=0 tx=0).stop 2023-10-06T02:30:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.095+0000 7f2b47c76700 1 -- 172.21.15.6:0/2316307757 shutdown_connections 2023-10-06T02:30:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.095+0000 7f2b47c76700 1 --2- 172.21.15.6:0/2316307757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b4015d4d0 0x7f2b400c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.095+0000 7f2b47c76700 1 --2- 172.21.15.6:0/2316307757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b400b27f0 0x7f2b400c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.095+0000 7f2b47c76700 1 --2- 172.21.15.6:0/2316307757 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f2b2c066f30 0x7f2b2c0693e0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.095+0000 7f2b47c76700 1 --2- 172.21.15.6:0/2316307757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b40159380 0x7f2b400c7e00 unknown :-1 s=CLOSED pgs=2577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.095+0000 7f2b47c76700 1 -- 172.21.15.6:0/2316307757 >> 172.21.15.6:0/2316307757 conn(0x7f2b40068680 msgr2=0x7f2b40157e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:49.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.095+0000 7f2b47c76700 1 -- 172.21.15.6:0/2316307757 shutdown_connections 2023-10-06T02:30:49.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.095+0000 7f2b47c76700 1 -- 172.21.15.6:0/2316307757 wait complete. 2023-10-06T02:30:49.108 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T02:30:49.108 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:30:49.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.227+0000 7f166cb5f700 1 Processor -- start 2023-10-06T02:30:49.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.227+0000 7f166cb5f700 1 -- start start 2023-10-06T02:30:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.228+0000 7f166cb5f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1668155fb0 0x7f1668159d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.228+0000 7f166cb5f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1668156380 0x7f166815a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.228+0000 7f166cb5f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f16680aed30 0x7f16680af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.228+0000 7f166cb5f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16680cb650 con 0x7f1668155fb0 2023-10-06T02:30:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.228+0000 7f166cb5f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16680caa40 con 0x7f16680aed30 2023-10-06T02:30:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.228+0000 7f166cb5f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16680cad20 con 0x7f1668156380 2023-10-06T02:30:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.228+0000 7f166659c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1668155fb0 0x7f1668159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.228+0000 7f166659c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1668155fb0 0x7f1668159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44614/0 (socket says 172.21.15.6:44614) 2023-10-06T02:30:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.228+0000 7f166659c700 1 -- 172.21.15.6:0/1767630094 learned_addr learned my addr 172.21.15.6:0/1767630094 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.229+0000 7f1666d9d700 1 --2- 172.21.15.6:0/1767630094 >> v2:172.21.15.175:3300/0 conn(0x7f16680aed30 0x7f16680af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.229+0000 7f1665d9b700 1 --2- 172.21.15.6:0/1767630094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1668156380 0x7f166815a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.229+0000 7f166659c700 1 -- 172.21.15.6:0/1767630094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1668156380 msgr2=0x7f166815a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.229+0000 7f166659c700 1 --2- 172.21.15.6:0/1767630094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1668156380 0x7f166815a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.229+0000 7f166659c700 1 -- 172.21.15.6:0/1767630094 >> v2:172.21.15.175:3300/0 conn(0x7f16680aed30 msgr2=0x7f16680af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.229+0000 7f166659c700 1 --2- 172.21.15.6:0/1767630094 >> v2:172.21.15.175:3300/0 conn(0x7f16680aed30 0x7f16680af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.229+0000 7f166659c700 1 -- 172.21.15.6:0/1767630094 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16680cb000 con 0x7f1668155fb0 2023-10-06T02:30:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.229+0000 7f166659c700 1 --2- 172.21.15.6:0/1767630094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1668155fb0 0x7f1668159d10 secure :-1 s=READY pgs=2578 cs=0 l=1 rev1=1 crypto rx=0x7f16680b1ed0 tx=0x7f1660009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6605a61a61a4ce0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.229+0000 7f166559a700 1 -- 172.21.15.6:0/1767630094 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166000b860 con 0x7f1668155fb0 2023-10-06T02:30:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.229+0000 7f166559a700 1 -- 172.21.15.6:0/1767630094 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166000b9c0 con 0x7f1668155fb0 2023-10-06T02:30:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.229+0000 7f166559a700 1 -- 172.21.15.6:0/1767630094 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166000bd60 con 0x7f1668155fb0 2023-10-06T02:30:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.230+0000 7f166cb5f700 1 -- 172.21.15.6:0/1767630094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1668155fb0 msgr2=0x7f1668159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.230+0000 7f166cb5f700 1 --2- 172.21.15.6:0/1767630094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1668155fb0 0x7f1668159d10 secure :-1 s=READY pgs=2578 cs=0 l=1 rev1=1 crypto rx=0x7f16680b1ed0 tx=0x7f1660009250 comp rx=0 tx=0).stop 2023-10-06T02:30:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.230+0000 7f166cb5f700 1 -- 172.21.15.6:0/1767630094 shutdown_connections 2023-10-06T02:30:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.230+0000 7f166cb5f700 1 --2- 172.21.15.6:0/1767630094 >> v2:172.21.15.175:3300/0 conn(0x7f16680aed30 0x7f16680af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.230+0000 7f166cb5f700 1 --2- 172.21.15.6:0/1767630094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1668155fb0 0x7f1668159d10 unknown :-1 s=CLOSED pgs=2578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.230+0000 7f166cb5f700 1 --2- 172.21.15.6:0/1767630094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1668156380 0x7f166815a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.230+0000 7f166cb5f700 1 -- 172.21.15.6:0/1767630094 >> 172.21.15.6:0/1767630094 conn(0x7f1668069100 msgr2=0x7f16680ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.230+0000 7f166cb5f700 1 -- 172.21.15.6:0/1767630094 shutdown_connections 2023-10-06T02:30:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.230+0000 7f166cb5f700 1 -- 172.21.15.6:0/1767630094 wait complete. 2023-10-06T02:30:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.231+0000 7f166cb5f700 1 Processor -- start 2023-10-06T02:30:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.231+0000 7f166cb5f700 1 -- start start 2023-10-06T02:30:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f166cb5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16680aed30 0x7f1668156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f166cb5f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1668155fb0 0x7f1668146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f166cb5f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1668156380 0x7f16681458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f166cb5f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1668156d60 con 0x7f16680aed30 2023-10-06T02:30:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f166cb5f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1668157040 con 0x7f1668156380 2023-10-06T02:30:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f166cb5f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1668157320 con 0x7f1668155fb0 2023-10-06T02:30:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f166659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16680aed30 0x7f1668156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f166659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16680aed30 0x7f1668156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44620/0 (socket says 172.21.15.6:44620) 2023-10-06T02:30:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f166659c700 1 -- 172.21.15.6:0/2333355639 learned_addr learned my addr 172.21.15.6:0/2333355639 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f1666d9d700 1 --2- 172.21.15.6:0/2333355639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1668156380 0x7f16681458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f1665d9b700 1 --2- 172.21.15.6:0/2333355639 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1668155fb0 0x7f1668146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f166659c700 1 -- 172.21.15.6:0/2333355639 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1668155fb0 msgr2=0x7f1668146de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f166659c700 1 --2- 172.21.15.6:0/2333355639 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1668155fb0 0x7f1668146de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f166659c700 1 -- 172.21.15.6:0/2333355639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1668156380 msgr2=0x7f16681458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f166659c700 1 --2- 172.21.15.6:0/2333355639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1668156380 0x7f16681458a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f166659c700 1 -- 172.21.15.6:0/2333355639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16600094f0 con 0x7f16680aed30 2023-10-06T02:30:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f1666d9d700 1 --2- 172.21.15.6:0/2333355639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1668156380 0x7f16681458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f166659c700 1 --2- 172.21.15.6:0/2333355639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16680aed30 0x7f1668156780 secure :-1 s=READY pgs=2579 cs=0 l=1 rev1=1 crypto rx=0x7f16680695a0 tx=0x7f1660017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f165e7fc700 1 -- 172.21.15.6:0/2333355639 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660011e70 con 0x7f16680aed30 2023-10-06T02:30:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f165e7fc700 1 -- 172.21.15.6:0/2333355639 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1660024440 con 0x7f16680aed30 2023-10-06T02:30:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f165e7fc700 1 -- 172.21.15.6:0/2333355639 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660024800 con 0x7f16680aed30 2023-10-06T02:30:49.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f166cb5f700 1 -- 172.21.15.6:0/2333355639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1668157600 con 0x7f16680aed30 2023-10-06T02:30:49.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.232+0000 7f166cb5f700 1 -- 172.21.15.6:0/2333355639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1668147320 con 0x7f16680aed30 2023-10-06T02:30:49.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.233+0000 7f166cb5f700 1 -- 172.21.15.6:0/2333355639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166806d580 con 0x7f16680aed30 2023-10-06T02:30:49.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.234+0000 7f165e7fc700 1 -- 172.21.15.6:0/2333355639 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f166001a420 con 0x7f16680aed30 2023-10-06T02:30:49.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.234+0000 7f165e7fc700 1 --2- 172.21.15.6:0/2333355639 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1648066f30 0x7f16480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.234+0000 7f165e7fc700 1 -- 172.21.15.6:0/2333355639 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f16600863c0 con 0x7f16680aed30 2023-10-06T02:30:49.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.235+0000 7f1665d9b700 1 --2- 172.21.15.6:0/2333355639 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1648066f30 0x7f16480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.235+0000 7f1665d9b700 1 --2- 172.21.15.6:0/2333355639 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1648066f30 0x7f16480693e0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f1668151030 tx=0x7f1650008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:49.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.239+0000 7f165e7fc700 1 -- 172.21.15.6:0/2333355639 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16600536b0 con 0x7f16680aed30 2023-10-06T02:30:49.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.428+0000 7f166cb5f700 1 -- 172.21.15.6:0/2333355639 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1668157490 con 0x7f1648066f30 2023-10-06T02:30:49.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.431+0000 7f165e7fc700 1 -- 172.21.15.6:0/2333355639 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73296 (secure 0 0 0) 0x7f1668157490 con 0x7f1648066f30 2023-10-06T02:30:49.433 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.433+0000 7f166cb5f700 1 -- 172.21.15.6:0/2333355639 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1648066f30 msgr2=0x7f16480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.433+0000 7f166cb5f700 1 --2- 172.21.15.6:0/2333355639 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1648066f30 0x7f16480693e0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f1668151030 tx=0x7f1650008040 comp rx=0 tx=0).stop 2023-10-06T02:30:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.433+0000 7f166cb5f700 1 -- 172.21.15.6:0/2333355639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16680aed30 msgr2=0x7f1668156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.433+0000 7f166cb5f700 1 --2- 172.21.15.6:0/2333355639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16680aed30 0x7f1668156780 secure :-1 s=READY pgs=2579 cs=0 l=1 rev1=1 crypto rx=0x7f16680695a0 tx=0x7f1660017000 comp rx=0 tx=0).stop 2023-10-06T02:30:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.433+0000 7f166cb5f700 1 -- 172.21.15.6:0/2333355639 shutdown_connections 2023-10-06T02:30:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.433+0000 7f166cb5f700 1 --2- 172.21.15.6:0/2333355639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1668156380 0x7f16681458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.433+0000 7f166cb5f700 1 --2- 172.21.15.6:0/2333355639 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1648066f30 0x7f16480693e0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.433+0000 7f166cb5f700 1 --2- 172.21.15.6:0/2333355639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16680aed30 0x7f1668156780 unknown :-1 s=CLOSED pgs=2579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.433+0000 7f166cb5f700 1 --2- 172.21.15.6:0/2333355639 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1668155fb0 0x7f1668146de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.433+0000 7f166cb5f700 1 -- 172.21.15.6:0/2333355639 >> 172.21.15.6:0/2333355639 conn(0x7f1668069100 msgr2=0x7f16680b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:49.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.433+0000 7f166cb5f700 1 -- 172.21.15.6:0/2333355639 shutdown_connections 2023-10-06T02:30:49.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.433+0000 7f166cb5f700 1 -- 172.21.15.6:0/2333355639 wait complete. 2023-10-06T02:30:49.435 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:30:49.445 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":542,"stamp":"2023-10-06T02:30:48.758477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2456308,"kb_used_data":16564,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752518412,"statfs":{"total":773094113280,"available":770578853888,"internally_reserved":0,"allocated":16961536,"data_stored":9413693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27944,"num_objects":-27,"num_object_clones":0,"num_object_copies":-54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-27,"num_whiteouts":0,"num_read":-60,"num_read_kb":-61,"num_write":-94,"num_write_kb":-60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001434"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":132,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.078612+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:30:33.078612+0000","last_peered":"2023-10-06T02:30:33.078612+0000","last_clean":"2023-10-06T02:30:33.078612+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:30:33.078612+0000","last_undegraded":"2023-10-06T02:30:33.078612+0000","last_fullsized":"2023-10-06T02:30:33.078612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":134,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.076700+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:30:33.076700+0000","last_peered":"2023-10-06T02:30:33.076700+0000","last_clean":"2023-10-06T02:30:33.076700+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:30:33.076700+0000","last_undegraded":"2023-10-06T02:30:33.076700+0000","last_fullsized":"2023-10-06T02:30:33.076700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":134,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.223200+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:30:33.223200+0000","last_peered":"2023-10-06T02:30:33.223200+0000","last_clean":"2023-10-06T02:30:33.223200+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:30:33.223200+0000","last_undegraded":"2023-10-06T02:30:33.223200+0000","last_fullsized":"2023-10-06T02:30:33.223200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":281,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.080583+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:30:33.080583+0000","last_peered":"2023-10-06T02:30:33.080583+0000","last_clean":"2023-10-06T02:30:33.080583+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:30:33.080583+0000","last_undegraded":"2023-10-06T02:30:33.080583+0000","last_fullsized":"2023-10-06T02:30:33.080583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":131,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.080875+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:30:33.080875+0000","last_peered":"2023-10-06T02:30:33.080875+0000","last_clean":"2023-10-06T02:30:33.080875+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:30:33.080875+0000","last_undegraded":"2023-10-06T02:30:33.080875+0000","last_fullsized":"2023-10-06T02:30:33.080875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":131,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.080739+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:30:33.080739+0000","last_peered":"2023-10-06T02:30:33.080739+0000","last_clean":"2023-10-06T02:30:33.080739+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:30:33.080739+0000","last_undegraded":"2023-10-06T02:30:33.080739+0000","last_fullsized":"2023-10-06T02:30:33.080739+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":130,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.078245+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:30:33.078245+0000","last_peered":"2023-10-06T02:30:33.078245+0000","last_clean":"2023-10-06T02:30:33.078245+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:30:33.078245+0000","last_undegraded":"2023-10-06T02:30:33.078245+0000","last_fullsized":"2023-10-06T02:30:33.078245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":129,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.081957+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:30:33.081957+0000","last_peered":"2023-10-06T02:30:33.081957+0000","last_clean":"2023-10-06T02:30:33.081957+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:30:33.081957+0000","last_undegraded":"2023-10-06T02:30:33.081957+0000","last_fullsized":"2023-10-06T02:30:33.081957+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":129,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.081877+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:30:33.081877+0000","last_peered":"2023-10-06T02:30:33.081877+0000","last_clean":"2023-10-06T02:30:33.081877+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:30:33.081877+0000","last_undegraded":"2023-10-06T02:30:33.081877+0000","last_fullsized":"2023-10-06T02:30:33.081877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575009,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307980,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063860,"statfs":{"total":96636764160,"available":96321392640,"internally_reserved":0,"allocated":2560000,"data_stored":1613463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.79700000000000004,"15min":1.111},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71099999999999997,"5min":0.77900000000000003,"15min":0.97899999999999998},"last":0.63900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":1.008},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.629,"5min":0.72599999999999998,"15min":1.075},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.76000000000000001,"5min":0.80200000000000005,"15min":1.149},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":0.96999999999999997,"15min":1.048},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69899999999999995,"5min":0.84399999999999997,"15min":1.175},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73599999999999999,"5min":0.91000000000000003,"15min":1.03},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.48199999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63900000000000001,"5min":0.79400000000000004,"15min":0.873},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80800000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.78600000000000003,"5min":0.81299999999999994,"15min":0.81899999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.76000000000000001,"15min":0.84899999999999998},"last":0.58499999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72699999999999998,"5min":0.79300000000000004,"15min":0.91700000000000004},"last":0.623},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.38900000000000001,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.55700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575010,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303296,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068544,"statfs":{"total":96636764160,"available":96326189056,"internally_reserved":0,"allocated":1957888,"data_stored":1021608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53400000000000003,"15min":0.64000000000000001},"min":{"1min":0.30299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.68899999999999995,"5min":0.79000000000000004,"15min":5.6929999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56100000000000005,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.29799999999999999},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":5.7060000000000004},"last":0.54200000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53200000000000003,"15min":0.54100000000000004},"min":{"1min":0.32300000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67100000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56899999999999995}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53100000000000003,"15min":0.69999999999999996},"min":{"1min":0.372,"5min":0.318,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":0.872,"15min":8.8659999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":0.77500000000000002,"15min":0.80800000000000005},"last":0.47999999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55500000000000005,"15min":0.75},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":10.659000000000001},"last":0.442},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.76800000000000002,"15min":0.85499999999999998},"last":0.45700000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47499999999999998,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.27400000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.79600000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67700000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.49199999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.49099999999999999,"15min":0.51600000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71099999999999997,"5min":0.751,"15min":0.84399999999999997},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.312},"max":{"1min":0.68300000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73899999999999999,"5min":0.86799999999999999,"15min":0.88100000000000001},"last":0.55400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575009,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307980,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063860,"statfs":{"total":96636764160,"available":96321392640,"internally_reserved":0,"allocated":2560000,"data_stored":1612681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.36899999999999999,"15min":0.36499999999999999},"min":{"1min":0.25600000000000001,"5min":0.20799999999999999,"15min":0.19},"max":{"1min":0.59699999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.38200000000000001},"min":{"1min":0.316,"5min":0.27100000000000002,"15min":0.26100000000000001},"max":{"1min":0.56499999999999995,"5min":0.754,"15min":0.754},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.33900000000000002,"15min":0.33800000000000002},"min":{"1min":0.26900000000000002,"5min":0.223,"15min":0.22},"max":{"1min":0.56699999999999995,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.372},{"interface":"front","average":{"1min":0.38,"5min":0.39300000000000002,"15min":0.39500000000000002},"min":{"1min":0.29399999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52400000000000002,"5min":0.64300000000000002,"15min":0.65300000000000002},"last":0.32100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.31,"5min":0.28100000000000003,"15min":0.253},"max":{"1min":0.621,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.59799999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.313}]},{"osd":4,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86899999999999999,"5min":0.998,"15min":0.998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.378,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.625,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.37},"max":{"1min":0.90100000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.46300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92100000000000004,"5min":0.93799999999999994,"15min":0.95499999999999996},"last":0.56299999999999994}]},{"osd":6,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.36499999999999999},"max":{"1min":0.75,"5min":0.94499999999999995,"15min":1.0009999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.45500000000000002,"5min":0.41599999999999998,"15min":0.41099999999999998},"max":{"1min":0.90600000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.378},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.94199999999999995},"last":0.5},{"interface":"front","average":{"1min":0.63,"5min":0.61899999999999999,"15min":0.62},"min":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.42499999999999999},"max":{"1min":0.84999999999999998,"5min":0.92000000000000004,"15min":0.98199999999999998},"last":0.55400000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575009,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307436,"kb_used_data":1956,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064404,"statfs":{"total":96636764160,"available":96321949696,"internally_reserved":0,"allocated":2002944,"data_stored":1049126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34599999999999997,"15min":0.33500000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.183},"max":{"1min":0.56899999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.374},"min":{"1min":0.223,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.66500000000000004,"5min":0.876,"15min":0.876},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.39400000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.20599999999999999},"max":{"1min":0.56399999999999995,"5min":0.65600000000000003,"15min":0.745},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.372,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.22600000000000001,"15min":0.215},"max":{"1min":0.63600000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.32100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52000000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.438,"15min":0.434},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.24399999999999999},"max":{"1min":0.629,"5min":0.71599999999999997,"15min":0.78000000000000003},"last":0.436}]},{"osd":4,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.371},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.369},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.99399999999999999},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.32300000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.3320000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.622},"min":{"1min":0.44,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.84899999999999998,"5min":0.88700000000000001,"15min":1.0780000000000001},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63700000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.91200000000000003,"15min":1.3999999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.45500000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.0469999999999999},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.78000000000000003},"min":{"1min":0.46200000000000002,"5min":0.41699999999999998,"15min":0.39400000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":11.138},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.46600000000000003,"5min":0.432,"15min":0.41599999999999998},"max":{"1min":0.86599999999999999,"5min":1.024,"15min":1.429},"last":0.57499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575009,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307388,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064452,"statfs":{"total":96636764160,"available":96321998848,"internally_reserved":0,"allocated":1953792,"data_stored":1021538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34699999999999998,"15min":0.36199999999999999},"min":{"1min":0.218,"5min":0.182,"15min":0.182},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.80300000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.38800000000000001},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.58199999999999996,"5min":0.68000000000000005,"15min":0.98999999999999999},"last":0.22800000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.375,"15min":0.39200000000000002},"min":{"1min":0.25700000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":3.1230000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":3.0129999999999999},"last":0.32800000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.375,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.23499999999999999},"max":{"1min":0.56899999999999995,"5min":0.59299999999999997,"15min":1.423},"last":0.253},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.33500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.77400000000000002},"last":0.34000000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.443,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.41799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.304},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.439,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.629}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.45100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0980000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.41799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96499999999999997,"5min":0.97999999999999998,"15min":1.347},"last":0.50700000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64900000000000002,"15min":0.66200000000000003},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.206},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63800000000000001,"15min":0.66500000000000004},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.385},"last":0.58399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575009,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307432,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064408,"statfs":{"total":96636764160,"available":96321953792,"internally_reserved":0,"allocated":1998848,"data_stored":1049084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47299999999999998,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.375,"15min":0.38200000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.78100000000000003},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.24099999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.66700000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.40300000000000002},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59599999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54500000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.246},"max":{"1min":0.57399999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.59899999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.0049999999999999},"last":0.754},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.83899999999999997,"5min":0.92700000000000005,"15min":1.1539999999999999},"last":0.89400000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.37,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84899999999999998,"5min":0.95399999999999996,"15min":1.2110000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.874,"5min":0.89600000000000002,"15min":1.0429999999999999},"last":0.80500000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81999999999999995,"5min":0.90800000000000003,"15min":1.0700000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.47699999999999998,"5min":0.39500000000000002,"15min":0.38600000000000001},"max":{"1min":0.85999999999999999,"5min":0.98499999999999999,"15min":1.391},"last":0.93899999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.48299999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80300000000000005,"5min":0.94099999999999995,"15min":1.121},"last":0.878},{"interface":"front","average":{"1min":0.626,"5min":0.63700000000000001,"15min":0.63400000000000001},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88800000000000001,"5min":0.89900000000000002,"15min":0.95099999999999996},"last":0.82499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575009,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311488,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060352,"statfs":{"total":96636764160,"available":96317800448,"internally_reserved":0,"allocated":1957888,"data_stored":1022491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.252,"5min":0.252,"15min":0.217},"max":{"1min":0.71799999999999997,"5min":0.78900000000000003,"15min":0.86399999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.88900000000000001,"15min":1.7290000000000001},"last":0.56200000000000006}]},{"osd":1,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.77300000000000002},"min":{"1min":0.41599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.71999999999999997,"5min":0.749,"15min":17.879999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.76300000000000001},"min":{"1min":0.377,"5min":0.33100000000000002,"15min":0.32700000000000001},"max":{"1min":0.69899999999999995,"5min":0.76500000000000001,"15min":18.010999999999999},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.55100000000000005},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.309},"max":{"1min":0.73299999999999998,"5min":0.84699999999999998,"15min":1.619},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.42599999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":1.6639999999999999},"last":0.61699999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.29899999999999999},"max":{"1min":0.76200000000000001,"5min":0.76500000000000001,"15min":1.2729999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44500000000000001,"5min":0.32700000000000001,"15min":0.32200000000000001},"max":{"1min":0.80000000000000004,"5min":0.81999999999999995,"15min":0.84899999999999998},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48999999999999999,"15min":0.51200000000000001},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69799999999999995,"5min":0.78900000000000003,"15min":1.532},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.80700000000000005},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.501,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.64300000000000002,"5min":0.90400000000000003,"15min":1.5700000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76000000000000001,"5min":0.84099999999999997,"15min":1.4319999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.40400000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73899999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72999999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.76100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575008,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303308,"kb_used_data":1924,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068532,"statfs":{"total":96636764160,"available":96326176768,"internally_reserved":0,"allocated":1970176,"data_stored":1023702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.34599999999999997,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.78800000000000003,"5min":1.034,"15min":1.103},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.312},"max":{"1min":0.81799999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.29699999999999999},"max":{"1min":0.91400000000000003,"5min":1.02,"15min":1.1679999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.33900000000000002},"max":{"1min":0.89200000000000002,"5min":0.99399999999999999,"15min":1.0620000000000001},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.30399999999999999},"max":{"1min":0.74299999999999999,"5min":1.1870000000000001,"15min":1.2070000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":1.1140000000000001},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.84299999999999997,"15min":1.1799999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78900000000000003,"5min":1.1040000000000001,"15min":1.1830000000000001},"last":0.60399999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72399999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.50900000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26500000000000001},"max":{"1min":0.72199999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65900000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.29699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79700000000000004,"5min":0.872,"15min":0.872},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:30:49.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:30:49.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.565+0000 7f3bb20cd700 1 Processor -- start 2023-10-06T02:30:49.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.566+0000 7f3bb20cd700 1 -- start start 2023-10-06T02:30:49.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.566+0000 7f3bb20cd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3bac0d0950 0x7f3bac1645c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.566+0000 7f3bb20cd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bac0cf8a0 con 0x7f3bac1431b0 2023-10-06T02:30:49.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.566+0000 7f3bb20cd700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bac0b4100 con 0x7f3bac142de0 2023-10-06T02:30:49.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.566+0000 7f3bb20cd700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bac0cec90 con 0x7f3bac0d0950 2023-10-06T02:30:49.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.566+0000 7f3baaffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3bac1431b0 0x7f3bac0d0240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44590/0 (socket says 172.21.15.6:44590) 2023-10-06T02:30:49.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.566+0000 7f3baaffd700 1 -- 172.21.15.6:0/1781919506 learned_addr learned my addr 172.21.15.6:0/1781919506 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:49.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3babfff700 1 --2- 172.21.15.6:0/1781919506 >> v2:172.21.15.175:3300/0 conn(0x7f3bac0d0950 0x7f3bac1645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baa7fc700 1 -- 172.21.15.6:0/1781919506 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921874299 0 0) 0x7f3bac0cf8a0 con 0x7f3bac1431b0 2023-10-06T02:30:49.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baa7fc700 1 -- 172.21.15.6:0/1781919506 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b94003570 con 0x7f3bac1431b0 2023-10-06T02:30:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baa7fc700 1 -- 172.21.15.6:0/1781919506 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134126819 0 0) 0x7f3bac0b4100 con 0x7f3bac142de0 2023-10-06T02:30:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baa7fc700 1 -- 172.21.15.6:0/1781919506 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bac0cf8a0 con 0x7f3bac142de0 2023-10-06T02:30:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baa7fc700 1 -- 172.21.15.6:0/1781919506 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3311859728 0 0) 0x7f3b94003570 con 0x7f3bac1431b0 2023-10-06T02:30:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baa7fc700 1 -- 172.21.15.6:0/1781919506 >> v2:172.21.15.175:3300/0 conn(0x7f3bac0d0950 msgr2=0x7f3bac1645c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baa7fc700 1 --2- 172.21.15.6:0/1781919506 >> v2:172.21.15.175:3300/0 conn(0x7f3bac0d0950 0x7f3bac1645c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baa7fc700 1 -- 172.21.15.6:0/1781919506 >> v1:172.21.15.175:6789/0 conn(0x7f3bac142de0 legacy=0x7f3bac0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baa7fc700 1 -- 172.21.15.6:0/1781919506 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac0cef70 con 0x7f3bac1431b0 2023-10-06T02:30:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baa7fc700 1 -- 172.21.15.6:0/1781919506 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f3ba0001470 con 0x7f3bac1431b0 2023-10-06T02:30:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3babfff700 1 --2- 172.21.15.6:0/1781919506 >> v2:172.21.15.175:3300/0 conn(0x7f3bac0d0950 0x7f3bac1645c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:30:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baa7fc700 1 -- 172.21.15.6:0/1781919506 >> v1:172.21.15.6:6789/0 conn(0x7f3bac1431b0 legacy=0x7f3bac0d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baa7fc700 1 --2- 172.21.15.6:0/1781919506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b94003bf0 0x7f3b94003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baa7fc700 1 --2- 172.21.15.6:0/1781919506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b94004810 0x7f3b94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baa7fc700 1 --2- 172.21.15.6:0/1781919506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940051c0 0x7f3b9400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baa7fc700 1 -- 172.21.15.6:0/1781919506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0cec90 con 0x7f3b940051c0 2023-10-06T02:30:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baa7fc700 1 -- 172.21.15.6:0/1781919506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9400c0b0 con 0x7f3b94004810 2023-10-06T02:30:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baa7fc700 1 -- 172.21.15.6:0/1781919506 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9400c270 con 0x7f3b94003bf0 2023-10-06T02:30:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3babfff700 1 --2- 172.21.15.6:0/1781919506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940051c0 0x7f3b9400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3baaffd700 1 --2- 172.21.15.6:0/1781919506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b94004810 0x7f3b94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3bab7fe700 1 --2- 172.21.15.6:0/1781919506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b94003bf0 0x7f3b94003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.567+0000 7f3babfff700 1 -- 172.21.15.6:0/1781919506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b94003bf0 msgr2=0x7f3b94003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.568+0000 7f3babfff700 1 --2- 172.21.15.6:0/1781919506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b94003bf0 0x7f3b94003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.568+0000 7f3babfff700 1 -- 172.21.15.6:0/1781919506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b94004810 msgr2=0x7f3b94004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.568+0000 7f3babfff700 1 --2- 172.21.15.6:0/1781919506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b94004810 0x7f3b94004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.568+0000 7f3babfff700 1 -- 172.21.15.6:0/1781919506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b94003570 con 0x7f3b940051c0 2023-10-06T02:30:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.568+0000 7f3babfff700 1 -- 172.21.15.6:0/1781919506 reap_dead start 2023-10-06T02:30:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.568+0000 7f3babfff700 1 --2- 172.21.15.6:0/1781919506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940051c0 0x7f3b9400ba60 secure :-1 s=READY pgs=2581 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400e3c0 tx=0x7f3ba400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e227083e5883d608 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.568+0000 7f3baa7fc700 1 -- 172.21.15.6:0/1781919506 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4009c50 con 0x7f3b940051c0 2023-10-06T02:30:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.568+0000 7f3baa7fc700 1 -- 172.21.15.6:0/1781919506 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba400f040 con 0x7f3b940051c0 2023-10-06T02:30:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.568+0000 7f3baa7fc700 1 -- 172.21.15.6:0/1781919506 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba400eec0 con 0x7f3b940051c0 2023-10-06T02:30:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.568+0000 7f3bb20cd700 1 -- 172.21.15.6:0/1781919506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940051c0 msgr2=0x7f3b9400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.568+0000 7f3bb20cd700 1 --2- 172.21.15.6:0/1781919506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940051c0 0x7f3b9400ba60 secure :-1 s=READY pgs=2581 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400e3c0 tx=0x7f3ba400b040 comp rx=0 tx=0).stop 2023-10-06T02:30:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.568+0000 7f3bb20cd700 1 -- 172.21.15.6:0/1781919506 shutdown_connections 2023-10-06T02:30:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.568+0000 7f3bb20cd700 1 --2- 172.21.15.6:0/1781919506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940051c0 0x7f3b9400ba60 unknown :-1 s=CLOSED pgs=2581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.568+0000 7f3bb20cd700 1 -- 172.21.15.6:0/1781919506 >> 172.21.15.6:0/1781919506 conn(0x7f3bac069110 msgr2=0x7f3bac06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.569+0000 7f3bb20cd700 1 -- 172.21.15.6:0/1781919506 shutdown_connections 2023-10-06T02:30:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.569+0000 7f3bb20cd700 1 -- 172.21.15.6:0/1781919506 wait complete. 2023-10-06T02:30:49.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.570+0000 7f3bb20cd700 1 Processor -- start 2023-10-06T02:30:49.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.570+0000 7f3bb20cd700 1 -- start start 2023-10-06T02:30:49.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.570+0000 7f3bb20cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940051c0 0x7f3bac132dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.570+0000 7f3bb20cd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bac16a130 0x7f3bac158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.570+0000 7f3bb20cd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac1586c0 0x7f3bac1567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.570+0000 7f3bb20cd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac157800 con 0x7f3b940051c0 2023-10-06T02:30:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.570+0000 7f3bb20cd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac158b60 con 0x7f3bac16a130 2023-10-06T02:30:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.570+0000 7f3bb20cd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac153900 con 0x7f3bac1586c0 2023-10-06T02:30:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.571+0000 7f3bab7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940051c0 0x7f3bac132dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.571+0000 7f3bab7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940051c0 0x7f3bac132dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44632/0 (socket says 172.21.15.6:44632) 2023-10-06T02:30:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.571+0000 7f3bab7fe700 1 -- 172.21.15.6:0/2030518387 learned_addr learned my addr 172.21.15.6:0/2030518387 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.571+0000 7f3babfff700 1 --2- 172.21.15.6:0/2030518387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac1586c0 0x7f3bac1567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.571+0000 7f3baaffd700 1 --2- 172.21.15.6:0/2030518387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bac16a130 0x7f3bac158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.571+0000 7f3bab7fe700 1 -- 172.21.15.6:0/2030518387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac1586c0 msgr2=0x7f3bac1567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.571+0000 7f3bab7fe700 1 --2- 172.21.15.6:0/2030518387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac1586c0 0x7f3bac1567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.571+0000 7f3bab7fe700 1 -- 172.21.15.6:0/2030518387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bac16a130 msgr2=0x7f3bac158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.571+0000 7f3bab7fe700 1 --2- 172.21.15.6:0/2030518387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bac16a130 0x7f3bac158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.571+0000 7f3bab7fe700 1 -- 172.21.15.6:0/2030518387 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac157520 con 0x7f3b940051c0 2023-10-06T02:30:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.571+0000 7f3baaffd700 1 --2- 172.21.15.6:0/2030518387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bac16a130 0x7f3bac158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.571+0000 7f3bab7fe700 1 --2- 172.21.15.6:0/2030518387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940051c0 0x7f3bac132dd0 secure :-1 s=READY pgs=2582 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0078a0 tx=0x7f3b9c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.571+0000 7f3b937fe700 1 -- 172.21.15.6:0/2030518387 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c00f9a0 con 0x7f3b940051c0 2023-10-06T02:30:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.571+0000 7f3b937fe700 1 -- 172.21.15.6:0/2030518387 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c00fb20 con 0x7f3b940051c0 2023-10-06T02:30:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.571+0000 7f3bb20cd700 1 -- 172.21.15.6:0/2030518387 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bac1532b0 con 0x7f3b940051c0 2023-10-06T02:30:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.571+0000 7f3b937fe700 1 -- 172.21.15.6:0/2030518387 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c00fee0 con 0x7f3b940051c0 2023-10-06T02:30:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.571+0000 7f3bb20cd700 1 -- 172.21.15.6:0/2030518387 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bac133310 con 0x7f3b940051c0 2023-10-06T02:30:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.572+0000 7f3bb20cd700 1 -- 172.21.15.6:0/2030518387 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bac153110 con 0x7f3b940051c0 2023-10-06T02:30:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.573+0000 7f3b937fe700 1 -- 172.21.15.6:0/2030518387 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b9c013600 con 0x7f3b940051c0 2023-10-06T02:30:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.573+0000 7f3b937fe700 1 --2- 172.21.15.6:0/2030518387 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3b98066f30 0x7f3b980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.573+0000 7f3b937fe700 1 -- 172.21.15.6:0/2030518387 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f3b9c084660 con 0x7f3b940051c0 2023-10-06T02:30:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.573+0000 7f3baaffd700 1 --2- 172.21.15.6:0/2030518387 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3b98066f30 0x7f3b980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.574+0000 7f3baaffd700 1 --2- 172.21.15.6:0/2030518387 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3b98066f30 0x7f3b980693e0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0001ca0 tx=0x7f3ba0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:49.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.577+0000 7f3b937fe700 1 -- 172.21.15.6:0/2030518387 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bac153110 con 0x7f3b940051c0 2023-10-06T02:30:49.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.766+0000 7f3bb20cd700 1 -- 172.21.15.6:0/2030518387 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3bac153a40 con 0x7f3b98066f30 2023-10-06T02:30:49.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.769+0000 7f3b937fe700 1 -- 172.21.15.6:0/2030518387 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73296 (secure 0 0 0) 0x7f3ba00070b0 con 0x7f3b98066f30 2023-10-06T02:30:49.771 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:49.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.771+0000 7f3bb20cd700 1 -- 172.21.15.6:0/2030518387 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3b98066f30 msgr2=0x7f3b980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.771+0000 7f3bb20cd700 1 --2- 172.21.15.6:0/2030518387 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3b98066f30 0x7f3b980693e0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0001ca0 tx=0x7f3ba0009040 comp rx=0 tx=0).stop 2023-10-06T02:30:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.771+0000 7f3bb20cd700 1 -- 172.21.15.6:0/2030518387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940051c0 msgr2=0x7f3bac132dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.771+0000 7f3bb20cd700 1 --2- 172.21.15.6:0/2030518387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940051c0 0x7f3bac132dd0 secure :-1 s=READY pgs=2582 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0078a0 tx=0x7f3b9c007d30 comp rx=0 tx=0).stop 2023-10-06T02:30:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.771+0000 7f3bb20cd700 1 -- 172.21.15.6:0/2030518387 shutdown_connections 2023-10-06T02:30:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.771+0000 7f3bb20cd700 1 --2- 172.21.15.6:0/2030518387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac1586c0 0x7f3bac1567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.771+0000 7f3bb20cd700 1 --2- 172.21.15.6:0/2030518387 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3b98066f30 0x7f3b980693e0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.771+0000 7f3bb20cd700 1 --2- 172.21.15.6:0/2030518387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940051c0 0x7f3bac132dd0 unknown :-1 s=CLOSED pgs=2582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.771+0000 7f3bb20cd700 1 --2- 172.21.15.6:0/2030518387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bac16a130 0x7f3bac158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.771+0000 7f3bb20cd700 1 -- 172.21.15.6:0/2030518387 >> 172.21.15.6:0/2030518387 conn(0x7f3bac069110 msgr2=0x7f3bac0d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.771+0000 7f3bb20cd700 1 -- 172.21.15.6:0/2030518387 shutdown_connections 2023-10-06T02:30:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.772+0000 7f3bb20cd700 1 -- 172.21.15.6:0/2030518387 wait complete. 2023-10-06T02:30:49.774 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:30:49.784 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":542,"stamp":"2023-10-06T02:30:48.758477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2456308,"kb_used_data":16564,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752518412,"statfs":{"total":773094113280,"available":770578853888,"internally_reserved":0,"allocated":16961536,"data_stored":9413693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27944,"num_objects":-27,"num_object_clones":0,"num_object_copies":-54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-27,"num_whiteouts":0,"num_read":-60,"num_read_kb":-61,"num_write":-94,"num_write_kb":-60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001434"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":132,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.078612+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:30:33.078612+0000","last_peered":"2023-10-06T02:30:33.078612+0000","last_clean":"2023-10-06T02:30:33.078612+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:30:33.078612+0000","last_undegraded":"2023-10-06T02:30:33.078612+0000","last_fullsized":"2023-10-06T02:30:33.078612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":134,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.076700+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:30:33.076700+0000","last_peered":"2023-10-06T02:30:33.076700+0000","last_clean":"2023-10-06T02:30:33.076700+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:30:33.076700+0000","last_undegraded":"2023-10-06T02:30:33.076700+0000","last_fullsized":"2023-10-06T02:30:33.076700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":134,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.223200+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:30:33.223200+0000","last_peered":"2023-10-06T02:30:33.223200+0000","last_clean":"2023-10-06T02:30:33.223200+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:30:33.223200+0000","last_undegraded":"2023-10-06T02:30:33.223200+0000","last_fullsized":"2023-10-06T02:30:33.223200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":281,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.080583+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:30:33.080583+0000","last_peered":"2023-10-06T02:30:33.080583+0000","last_clean":"2023-10-06T02:30:33.080583+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:30:33.080583+0000","last_undegraded":"2023-10-06T02:30:33.080583+0000","last_fullsized":"2023-10-06T02:30:33.080583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":131,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.080875+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:30:33.080875+0000","last_peered":"2023-10-06T02:30:33.080875+0000","last_clean":"2023-10-06T02:30:33.080875+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:30:33.080875+0000","last_undegraded":"2023-10-06T02:30:33.080875+0000","last_fullsized":"2023-10-06T02:30:33.080875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":131,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.080739+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:30:33.080739+0000","last_peered":"2023-10-06T02:30:33.080739+0000","last_clean":"2023-10-06T02:30:33.080739+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:30:33.080739+0000","last_undegraded":"2023-10-06T02:30:33.080739+0000","last_fullsized":"2023-10-06T02:30:33.080739+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":130,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.078245+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:30:33.078245+0000","last_peered":"2023-10-06T02:30:33.078245+0000","last_clean":"2023-10-06T02:30:33.078245+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:30:33.078245+0000","last_undegraded":"2023-10-06T02:30:33.078245+0000","last_fullsized":"2023-10-06T02:30:33.078245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":129,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.081957+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:30:33.081957+0000","last_peered":"2023-10-06T02:30:33.081957+0000","last_clean":"2023-10-06T02:30:33.081957+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:30:33.081957+0000","last_undegraded":"2023-10-06T02:30:33.081957+0000","last_fullsized":"2023-10-06T02:30:33.081957+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":129,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.081877+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:30:33.081877+0000","last_peered":"2023-10-06T02:30:33.081877+0000","last_clean":"2023-10-06T02:30:33.081877+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:30:33.081877+0000","last_undegraded":"2023-10-06T02:30:33.081877+0000","last_fullsized":"2023-10-06T02:30:33.081877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575009,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307980,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063860,"statfs":{"total":96636764160,"available":96321392640,"internally_reserved":0,"allocated":2560000,"data_stored":1613463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.79700000000000004,"15min":1.111},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71099999999999997,"5min":0.77900000000000003,"15min":0.97899999999999998},"last":0.63900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":1.008},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.629,"5min":0.72599999999999998,"15min":1.075},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.76000000000000001,"5min":0.80200000000000005,"15min":1.149},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":0.96999999999999997,"15min":1.048},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69899999999999995,"5min":0.84399999999999997,"15min":1.175},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73599999999999999,"5min":0.91000000000000003,"15min":1.03},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.48199999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63900000000000001,"5min":0.79400000000000004,"15min":0.873},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80800000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.78600000000000003,"5min":0.81299999999999994,"15min":0.81899999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.76000000000000001,"15min":0.84899999999999998},"last":0.58499999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72699999999999998,"5min":0.79300000000000004,"15min":0.91700000000000004},"last":0.623},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.38900000000000001,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.55700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575010,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303296,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068544,"statfs":{"total":96636764160,"available":96326189056,"internally_reserved":0,"allocated":1957888,"data_stored":1021608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53400000000000003,"15min":0.64000000000000001},"min":{"1min":0.30299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.68899999999999995,"5min":0.79000000000000004,"15min":5.6929999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56100000000000005,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.29799999999999999},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":5.7060000000000004},"last":0.54200000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53200000000000003,"15min":0.54100000000000004},"min":{"1min":0.32300000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67100000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56899999999999995}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53100000000000003,"15min":0.69999999999999996},"min":{"1min":0.372,"5min":0.318,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":0.872,"15min":8.8659999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":0.77500000000000002,"15min":0.80800000000000005},"last":0.47999999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55500000000000005,"15min":0.75},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":10.659000000000001},"last":0.442},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.76800000000000002,"15min":0.85499999999999998},"last":0.45700000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47499999999999998,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.27400000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.79600000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67700000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.49199999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.49099999999999999,"15min":0.51600000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71099999999999997,"5min":0.751,"15min":0.84399999999999997},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.312},"max":{"1min":0.68300000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73899999999999999,"5min":0.86799999999999999,"15min":0.88100000000000001},"last":0.55400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575009,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307980,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063860,"statfs":{"total":96636764160,"available":96321392640,"internally_reserved":0,"allocated":2560000,"data_stored":1612681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.36899999999999999,"15min":0.36499999999999999},"min":{"1min":0.25600000000000001,"5min":0.20799999999999999,"15min":0.19},"max":{"1min":0.59699999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.38200000000000001},"min":{"1min":0.316,"5min":0.27100000000000002,"15min":0.26100000000000001},"max":{"1min":0.56499999999999995,"5min":0.754,"15min":0.754},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.33900000000000002,"15min":0.33800000000000002},"min":{"1min":0.26900000000000002,"5min":0.223,"15min":0.22},"max":{"1min":0.56699999999999995,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.372},{"interface":"front","average":{"1min":0.38,"5min":0.39300000000000002,"15min":0.39500000000000002},"min":{"1min":0.29399999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52400000000000002,"5min":0.64300000000000002,"15min":0.65300000000000002},"last":0.32100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.31,"5min":0.28100000000000003,"15min":0.253},"max":{"1min":0.621,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.59799999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.313}]},{"osd":4,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86899999999999999,"5min":0.998,"15min":0.998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.378,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.625,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.37},"max":{"1min":0.90100000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.46300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92100000000000004,"5min":0.93799999999999994,"15min":0.95499999999999996},"last":0.56299999999999994}]},{"osd":6,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.36499999999999999},"max":{"1min":0.75,"5min":0.94499999999999995,"15min":1.0009999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.45500000000000002,"5min":0.41599999999999998,"15min":0.41099999999999998},"max":{"1min":0.90600000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.378},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.94199999999999995},"last":0.5},{"interface":"front","average":{"1min":0.63,"5min":0.61899999999999999,"15min":0.62},"min":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.42499999999999999},"max":{"1min":0.84999999999999998,"5min":0.92000000000000004,"15min":0.98199999999999998},"last":0.55400000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575009,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307436,"kb_used_data":1956,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064404,"statfs":{"total":96636764160,"available":96321949696,"internally_reserved":0,"allocated":2002944,"data_stored":1049126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34599999999999997,"15min":0.33500000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.183},"max":{"1min":0.56899999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.374},"min":{"1min":0.223,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.66500000000000004,"5min":0.876,"15min":0.876},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.39400000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.20599999999999999},"max":{"1min":0.56399999999999995,"5min":0.65600000000000003,"15min":0.745},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.372,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.22600000000000001,"15min":0.215},"max":{"1min":0.63600000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.32100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52000000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.438,"15min":0.434},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.24399999999999999},"max":{"1min":0.629,"5min":0.71599999999999997,"15min":0.78000000000000003},"last":0.436}]},{"osd":4,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.371},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.369},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.99399999999999999},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.32300000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.3320000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.622},"min":{"1min":0.44,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.84899999999999998,"5min":0.88700000000000001,"15min":1.0780000000000001},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63700000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.91200000000000003,"15min":1.3999999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.45500000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.0469999999999999},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.78000000000000003},"min":{"1min":0.46200000000000002,"5min":0.41699999999999998,"15min":0.39400000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":11.138},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.46600000000000003,"5min":0.432,"15min":0.41599999999999998},"max":{"1min":0.86599999999999999,"5min":1.024,"15min":1.429},"last":0.57499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575009,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307388,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064452,"statfs":{"total":96636764160,"available":96321998848,"internally_reserved":0,"allocated":1953792,"data_stored":1021538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34699999999999998,"15min":0.36199999999999999},"min":{"1min":0.218,"5min":0.182,"15min":0.182},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.80300000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.38800000000000001},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.58199999999999996,"5min":0.68000000000000005,"15min":0.98999999999999999},"last":0.22800000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.375,"15min":0.39200000000000002},"min":{"1min":0.25700000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":3.1230000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":3.0129999999999999},"last":0.32800000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.375,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.23499999999999999},"max":{"1min":0.56899999999999995,"5min":0.59299999999999997,"15min":1.423},"last":0.253},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.33500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.77400000000000002},"last":0.34000000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.443,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.41799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.304},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.439,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.629}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.45100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0980000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.41799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96499999999999997,"5min":0.97999999999999998,"15min":1.347},"last":0.50700000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64900000000000002,"15min":0.66200000000000003},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.206},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63800000000000001,"15min":0.66500000000000004},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.385},"last":0.58399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575009,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307432,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064408,"statfs":{"total":96636764160,"available":96321953792,"internally_reserved":0,"allocated":1998848,"data_stored":1049084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47299999999999998,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.375,"15min":0.38200000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.78100000000000003},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.24099999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.66700000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.40300000000000002},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59599999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54500000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.246},"max":{"1min":0.57399999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.59899999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.0049999999999999},"last":0.754},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.83899999999999997,"5min":0.92700000000000005,"15min":1.1539999999999999},"last":0.89400000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.37,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84899999999999998,"5min":0.95399999999999996,"15min":1.2110000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.874,"5min":0.89600000000000002,"15min":1.0429999999999999},"last":0.80500000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81999999999999995,"5min":0.90800000000000003,"15min":1.0700000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.47699999999999998,"5min":0.39500000000000002,"15min":0.38600000000000001},"max":{"1min":0.85999999999999999,"5min":0.98499999999999999,"15min":1.391},"last":0.93899999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.48299999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80300000000000005,"5min":0.94099999999999995,"15min":1.121},"last":0.878},{"interface":"front","average":{"1min":0.626,"5min":0.63700000000000001,"15min":0.63400000000000001},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88800000000000001,"5min":0.89900000000000002,"15min":0.95099999999999996},"last":0.82499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575009,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311488,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060352,"statfs":{"total":96636764160,"available":96317800448,"internally_reserved":0,"allocated":1957888,"data_stored":1022491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.252,"5min":0.252,"15min":0.217},"max":{"1min":0.71799999999999997,"5min":0.78900000000000003,"15min":0.86399999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.88900000000000001,"15min":1.7290000000000001},"last":0.56200000000000006}]},{"osd":1,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.77300000000000002},"min":{"1min":0.41599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.71999999999999997,"5min":0.749,"15min":17.879999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.76300000000000001},"min":{"1min":0.377,"5min":0.33100000000000002,"15min":0.32700000000000001},"max":{"1min":0.69899999999999995,"5min":0.76500000000000001,"15min":18.010999999999999},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.55100000000000005},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.309},"max":{"1min":0.73299999999999998,"5min":0.84699999999999998,"15min":1.619},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.42599999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":1.6639999999999999},"last":0.61699999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.29899999999999999},"max":{"1min":0.76200000000000001,"5min":0.76500000000000001,"15min":1.2729999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44500000000000001,"5min":0.32700000000000001,"15min":0.32200000000000001},"max":{"1min":0.80000000000000004,"5min":0.81999999999999995,"15min":0.84899999999999998},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48999999999999999,"15min":0.51200000000000001},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69799999999999995,"5min":0.78900000000000003,"15min":1.532},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.80700000000000005},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.501,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.64300000000000002,"5min":0.90400000000000003,"15min":1.5700000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76000000000000001,"5min":0.84099999999999997,"15min":1.4319999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.40400000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73899999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72999999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.76100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575008,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303308,"kb_used_data":1924,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068532,"statfs":{"total":96636764160,"available":96326176768,"internally_reserved":0,"allocated":1970176,"data_stored":1023702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.34599999999999997,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.78800000000000003,"5min":1.034,"15min":1.103},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.312},"max":{"1min":0.81799999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.29699999999999999},"max":{"1min":0.91400000000000003,"5min":1.02,"15min":1.1679999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.33900000000000002},"max":{"1min":0.89200000000000002,"5min":0.99399999999999999,"15min":1.0620000000000001},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.30399999999999999},"max":{"1min":0.74299999999999999,"5min":1.1870000000000001,"15min":1.2070000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":1.1140000000000001},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.84299999999999997,"15min":1.1799999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78900000000000003,"5min":1.1040000000000001,"15min":1.1830000000000001},"last":0.60399999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72399999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.50900000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26500000000000001},"max":{"1min":0.72199999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65900000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.29699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79700000000000004,"5min":0.872,"15min":0.872},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:30:49.786 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T02:30:49.787 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:30:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.906+0000 7f7151185700 1 Processor -- start 2023-10-06T02:30:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.906+0000 7f7151185700 1 -- start start 2023-10-06T02:30:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.906+0000 7f7151185700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f714c0af1d0 0x7f714c0af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.906+0000 7f7151185700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714c06d5b0 con 0x7f714c068d90 2023-10-06T02:30:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.906+0000 7f7151185700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714c06de90 con 0x7f714c06da40 2023-10-06T02:30:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.906+0000 7f7151185700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714c0caf90 con 0x7f714c0af1d0 2023-10-06T02:30:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.907+0000 7f714ad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f714c0af1d0 0x7f714c0af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.907+0000 7f714ad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f714c0af1d0 0x7f714c0af5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44634/0 (socket says 172.21.15.6:44634) 2023-10-06T02:30:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.907+0000 7f714ad9d700 1 -- 172.21.15.6:0/353747182 learned_addr learned my addr 172.21.15.6:0/353747182 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.907+0000 7f714b59e700 1 --1- 172.21.15.6:0/353747182 >> v1:172.21.15.6:6789/0 conn(0x7f714c068d90 0x7f714c159a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44604/0 (socket says 172.21.15.6:44604) 2023-10-06T02:30:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.907+0000 7f714ad9d700 1 -- 172.21.15.6:0/353747182 >> v1:172.21.15.175:6789/0 conn(0x7f714c06da40 legacy=0x7f714c068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.907+0000 7f714ad9d700 1 -- 172.21.15.6:0/353747182 >> v1:172.21.15.6:6789/0 conn(0x7f714c068d90 legacy=0x7f714c159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.907+0000 7f714ad9d700 1 -- 172.21.15.6:0/353747182 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c15a9a0 con 0x7f714c0af1d0 2023-10-06T02:30:49.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.907+0000 7f714ad9d700 1 --2- 172.21.15.6:0/353747182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f714c0af1d0 0x7f714c0af5a0 secure :-1 s=READY pgs=2584 cs=0 l=1 rev1=1 crypto rx=0x7f7144009f20 tx=0x7f7144009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41194b3cc30820d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:49.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.907+0000 7f7149d9b700 1 -- 172.21.15.6:0/353747182 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714400e070 con 0x7f714c0af1d0 2023-10-06T02:30:49.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.907+0000 7f7149d9b700 1 -- 172.21.15.6:0/353747182 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714400ba40 con 0x7f714c0af1d0 2023-10-06T02:30:49.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.907+0000 7f7149d9b700 1 -- 172.21.15.6:0/353747182 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71440092e0 con 0x7f714c0af1d0 2023-10-06T02:30:49.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.908+0000 7f7151185700 1 -- 172.21.15.6:0/353747182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f714c0af1d0 msgr2=0x7f714c0af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.908+0000 7f7151185700 1 --2- 172.21.15.6:0/353747182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f714c0af1d0 0x7f714c0af5a0 secure :-1 s=READY pgs=2584 cs=0 l=1 rev1=1 crypto rx=0x7f7144009f20 tx=0x7f7144009840 comp rx=0 tx=0).stop 2023-10-06T02:30:49.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.908+0000 7f7151185700 1 -- 172.21.15.6:0/353747182 shutdown_connections 2023-10-06T02:30:49.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.908+0000 7f7151185700 1 --2- 172.21.15.6:0/353747182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f714c0af1d0 0x7f714c0af5a0 unknown :-1 s=CLOSED pgs=2584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.908+0000 7f7151185700 1 -- 172.21.15.6:0/353747182 >> 172.21.15.6:0/353747182 conn(0x7f714c06a220 msgr2=0x7f714c06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:49.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.908+0000 7f7151185700 1 -- 172.21.15.6:0/353747182 shutdown_connections 2023-10-06T02:30:49.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.908+0000 7f7151185700 1 -- 172.21.15.6:0/353747182 wait complete. 2023-10-06T02:30:49.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.909+0000 7f7151185700 1 Processor -- start 2023-10-06T02:30:49.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.909+0000 7f7151185700 1 -- start start 2023-10-06T02:30:49.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f7151185700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f714c068d90 0x7f714c147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f7151185700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f714c06da40 0x7f714c0b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f7151185700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f714c0af1d0 0x7f714c0c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f7151185700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c0afdb0 con 0x7f714c068d90 2023-10-06T02:30:49.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f7151185700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c0b0090 con 0x7f714c0af1d0 2023-10-06T02:30:49.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f7151185700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714c16d030 con 0x7f714c06da40 2023-10-06T02:30:49.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f714ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f714c068d90 0x7f714c147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f714ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f714c068d90 0x7f714c147920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44640/0 (socket says 172.21.15.6:44640) 2023-10-06T02:30:49.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f714ad9d700 1 -- 172.21.15.6:0/1449744183 learned_addr learned my addr 172.21.15.6:0/1449744183 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:49.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f714b59e700 1 --2- 172.21.15.6:0/1449744183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f714c0af1d0 0x7f714c0c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f714a59c700 1 --2- 172.21.15.6:0/1449744183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f714c06da40 0x7f714c0b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f714ad9d700 1 -- 172.21.15.6:0/1449744183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f714c06da40 msgr2=0x7f714c0b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f714ad9d700 1 --2- 172.21.15.6:0/1449744183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f714c06da40 0x7f714c0b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f714ad9d700 1 -- 172.21.15.6:0/1449744183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f714c0af1d0 msgr2=0x7f714c0c2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:49.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f714ad9d700 1 --2- 172.21.15.6:0/1449744183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f714c0af1d0 0x7f714c0c2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:49.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f714ad9d700 1 -- 172.21.15.6:0/1449744183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7144009ae0 con 0x7f714c068d90 2023-10-06T02:30:49.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f714b59e700 1 --2- 172.21.15.6:0/1449744183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f714c0af1d0 0x7f714c0c2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:49.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f714a59c700 1 --2- 172.21.15.6:0/1449744183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f714c06da40 0x7f714c0b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:49.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f714ad9d700 1 --2- 172.21.15.6:0/1449744183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f714c068d90 0x7f714c147920 secure :-1 s=READY pgs=2585 cs=0 l=1 rev1=1 crypto rx=0x7f714c06a6c0 tx=0x7f7144017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:49.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f7142ffd700 1 -- 172.21.15.6:0/1449744183 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144012ae0 con 0x7f714c068d90 2023-10-06T02:30:49.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f7142ffd700 1 -- 172.21.15.6:0/1449744183 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7144012c60 con 0x7f714c068d90 2023-10-06T02:30:49.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f7151185700 1 -- 172.21.15.6:0/1449744183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714c16d310 con 0x7f714c068d90 2023-10-06T02:30:49.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.910+0000 7f7142ffd700 1 -- 172.21.15.6:0/1449744183 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714401d420 con 0x7f714c068d90 2023-10-06T02:30:49.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.911+0000 7f7151185700 1 -- 172.21.15.6:0/1449744183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714c147e60 con 0x7f714c068d90 2023-10-06T02:30:49.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.911+0000 7f7151185700 1 -- 172.21.15.6:0/1449744183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714c06e720 con 0x7f714c068d90 2023-10-06T02:30:49.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.912+0000 7f7142ffd700 1 -- 172.21.15.6:0/1449744183 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f714401d850 con 0x7f714c068d90 2023-10-06T02:30:49.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.912+0000 7f7142ffd700 1 --2- 172.21.15.6:0/1449744183 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f712c066f30 0x7f712c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:49.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.912+0000 7f7142ffd700 1 -- 172.21.15.6:0/1449744183 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f7144085c80 con 0x7f714c068d90 2023-10-06T02:30:49.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.912+0000 7f714a59c700 1 --2- 172.21.15.6:0/1449744183 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f712c066f30 0x7f712c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:49.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.913+0000 7f714a59c700 1 --2- 172.21.15.6:0/1449744183 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f712c066f30 0x7f712c0693e0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f7134007fd0 tx=0x7f7134009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:49.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:49.917+0000 7f7142ffd700 1 -- 172.21.15.6:0/1449744183 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7144052ef0 con 0x7f714c068d90 2023-10-06T02:30:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.110+0000 7f7151185700 1 -- 172.21.15.6:0/1449744183 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f714c15a6c0 con 0x7f712c066f30 2023-10-06T02:30:50.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.113+0000 7f7142ffd700 1 -- 172.21.15.6:0/1449744183 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73296 (secure 0 0 0) 0x7f714c15a6c0 con 0x7f712c066f30 2023-10-06T02:30:50.114 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.115+0000 7f7151185700 1 -- 172.21.15.6:0/1449744183 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f712c066f30 msgr2=0x7f712c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.115+0000 7f7151185700 1 --2- 172.21.15.6:0/1449744183 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f712c066f30 0x7f712c0693e0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f7134007fd0 tx=0x7f7134009040 comp rx=0 tx=0).stop 2023-10-06T02:30:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.115+0000 7f7151185700 1 -- 172.21.15.6:0/1449744183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f714c068d90 msgr2=0x7f714c147920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.115+0000 7f7151185700 1 --2- 172.21.15.6:0/1449744183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f714c068d90 0x7f714c147920 secure :-1 s=READY pgs=2585 cs=0 l=1 rev1=1 crypto rx=0x7f714c06a6c0 tx=0x7f7144017000 comp rx=0 tx=0).stop 2023-10-06T02:30:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.115+0000 7f7151185700 1 -- 172.21.15.6:0/1449744183 shutdown_connections 2023-10-06T02:30:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.115+0000 7f7151185700 1 --2- 172.21.15.6:0/1449744183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f714c0af1d0 0x7f714c0c2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.115+0000 7f7151185700 1 --2- 172.21.15.6:0/1449744183 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f712c066f30 0x7f712c0693e0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.115+0000 7f7151185700 1 --2- 172.21.15.6:0/1449744183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f714c068d90 0x7f714c147920 unknown :-1 s=CLOSED pgs=2585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.115+0000 7f7151185700 1 --2- 172.21.15.6:0/1449744183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f714c06da40 0x7f714c0b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.115+0000 7f7151185700 1 -- 172.21.15.6:0/1449744183 >> 172.21.15.6:0/1449744183 conn(0x7f714c06a220 msgr2=0x7f714c15fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.115+0000 7f7151185700 1 -- 172.21.15.6:0/1449744183 shutdown_connections 2023-10-06T02:30:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.115+0000 7f7151185700 1 -- 172.21.15.6:0/1449744183 wait complete. 2023-10-06T02:30:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:30:50.127 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":542,"stamp":"2023-10-06T02:30:48.758477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2456308,"kb_used_data":16564,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752518412,"statfs":{"total":773094113280,"available":770578853888,"internally_reserved":0,"allocated":16961536,"data_stored":9413693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27944,"num_objects":-27,"num_object_clones":0,"num_object_copies":-54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-27,"num_whiteouts":0,"num_read":-60,"num_read_kb":-61,"num_write":-94,"num_write_kb":-60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001434"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":132,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.078612+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:30:33.078612+0000","last_peered":"2023-10-06T02:30:33.078612+0000","last_clean":"2023-10-06T02:30:33.078612+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:30:33.078612+0000","last_undegraded":"2023-10-06T02:30:33.078612+0000","last_fullsized":"2023-10-06T02:30:33.078612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":134,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.076700+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:30:33.076700+0000","last_peered":"2023-10-06T02:30:33.076700+0000","last_clean":"2023-10-06T02:30:33.076700+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:30:33.076700+0000","last_undegraded":"2023-10-06T02:30:33.076700+0000","last_fullsized":"2023-10-06T02:30:33.076700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":134,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.223200+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:30:33.223200+0000","last_peered":"2023-10-06T02:30:33.223200+0000","last_clean":"2023-10-06T02:30:33.223200+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:30:33.223200+0000","last_undegraded":"2023-10-06T02:30:33.223200+0000","last_fullsized":"2023-10-06T02:30:33.223200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":281,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.080583+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:30:33.080583+0000","last_peered":"2023-10-06T02:30:33.080583+0000","last_clean":"2023-10-06T02:30:33.080583+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:30:33.080583+0000","last_undegraded":"2023-10-06T02:30:33.080583+0000","last_fullsized":"2023-10-06T02:30:33.080583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":131,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.080875+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:30:33.080875+0000","last_peered":"2023-10-06T02:30:33.080875+0000","last_clean":"2023-10-06T02:30:33.080875+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:30:33.080875+0000","last_undegraded":"2023-10-06T02:30:33.080875+0000","last_fullsized":"2023-10-06T02:30:33.080875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":131,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.080739+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:30:33.080739+0000","last_peered":"2023-10-06T02:30:33.080739+0000","last_clean":"2023-10-06T02:30:33.080739+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:30:33.080739+0000","last_undegraded":"2023-10-06T02:30:33.080739+0000","last_fullsized":"2023-10-06T02:30:33.080739+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":130,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.078245+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:30:33.078245+0000","last_peered":"2023-10-06T02:30:33.078245+0000","last_clean":"2023-10-06T02:30:33.078245+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:30:33.078245+0000","last_undegraded":"2023-10-06T02:30:33.078245+0000","last_fullsized":"2023-10-06T02:30:33.078245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":129,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.081957+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:30:33.081957+0000","last_peered":"2023-10-06T02:30:33.081957+0000","last_clean":"2023-10-06T02:30:33.081957+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:30:33.081957+0000","last_undegraded":"2023-10-06T02:30:33.081957+0000","last_fullsized":"2023-10-06T02:30:33.081957+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":129,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-06T02:30:33.081877+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:30:33.081877+0000","last_peered":"2023-10-06T02:30:33.081877+0000","last_clean":"2023-10-06T02:30:33.081877+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:30:33.081877+0000","last_undegraded":"2023-10-06T02:30:33.081877+0000","last_fullsized":"2023-10-06T02:30:33.081877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575009,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307980,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063860,"statfs":{"total":96636764160,"available":96321392640,"internally_reserved":0,"allocated":2560000,"data_stored":1613463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.79700000000000004,"15min":1.111},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71099999999999997,"5min":0.77900000000000003,"15min":0.97899999999999998},"last":0.63900000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":1.008},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.629,"5min":0.72599999999999998,"15min":1.075},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.76000000000000001,"5min":0.80200000000000005,"15min":1.149},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":0.96999999999999997,"15min":1.048},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69899999999999995,"5min":0.84399999999999997,"15min":1.175},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73599999999999999,"5min":0.91000000000000003,"15min":1.03},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.48199999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63900000000000001,"5min":0.79400000000000004,"15min":0.873},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80800000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.78600000000000003,"5min":0.81299999999999994,"15min":0.81899999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.76000000000000001,"15min":0.84899999999999998},"last":0.58499999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72699999999999998,"5min":0.79300000000000004,"15min":0.91700000000000004},"last":0.623},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.38900000000000001,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.55700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575010,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303296,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068544,"statfs":{"total":96636764160,"available":96326189056,"internally_reserved":0,"allocated":1957888,"data_stored":1021608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53400000000000003,"15min":0.64000000000000001},"min":{"1min":0.30299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.68899999999999995,"5min":0.79000000000000004,"15min":5.6929999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56100000000000005,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.29799999999999999},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":5.7060000000000004},"last":0.54200000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53200000000000003,"15min":0.54100000000000004},"min":{"1min":0.32300000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67100000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56899999999999995}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53100000000000003,"15min":0.69999999999999996},"min":{"1min":0.372,"5min":0.318,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":0.872,"15min":8.8659999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":0.77500000000000002,"15min":0.80800000000000005},"last":0.47999999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55500000000000005,"15min":0.75},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":10.659000000000001},"last":0.442},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.76800000000000002,"15min":0.85499999999999998},"last":0.45700000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47499999999999998,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.27400000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.79600000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67700000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.49199999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.49099999999999999,"15min":0.51600000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71099999999999997,"5min":0.751,"15min":0.84399999999999997},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.312},"max":{"1min":0.68300000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73899999999999999,"5min":0.86799999999999999,"15min":0.88100000000000001},"last":0.55400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575009,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307980,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063860,"statfs":{"total":96636764160,"available":96321392640,"internally_reserved":0,"allocated":2560000,"data_stored":1612681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.36899999999999999,"15min":0.36499999999999999},"min":{"1min":0.25600000000000001,"5min":0.20799999999999999,"15min":0.19},"max":{"1min":0.59699999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.38200000000000001},"min":{"1min":0.316,"5min":0.27100000000000002,"15min":0.26100000000000001},"max":{"1min":0.56499999999999995,"5min":0.754,"15min":0.754},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.33900000000000002,"15min":0.33800000000000002},"min":{"1min":0.26900000000000002,"5min":0.223,"15min":0.22},"max":{"1min":0.56699999999999995,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.372},{"interface":"front","average":{"1min":0.38,"5min":0.39300000000000002,"15min":0.39500000000000002},"min":{"1min":0.29399999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52400000000000002,"5min":0.64300000000000002,"15min":0.65300000000000002},"last":0.32100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.31,"5min":0.28100000000000003,"15min":0.253},"max":{"1min":0.621,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.59799999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.313}]},{"osd":4,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86899999999999999,"5min":0.998,"15min":0.998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.378,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.625,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.37},"max":{"1min":0.90100000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.46300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92100000000000004,"5min":0.93799999999999994,"15min":0.95499999999999996},"last":0.56299999999999994}]},{"osd":6,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.36499999999999999},"max":{"1min":0.75,"5min":0.94499999999999995,"15min":1.0009999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.45500000000000002,"5min":0.41599999999999998,"15min":0.41099999999999998},"max":{"1min":0.90600000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.378},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.94199999999999995},"last":0.5},{"interface":"front","average":{"1min":0.63,"5min":0.61899999999999999,"15min":0.62},"min":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.42499999999999999},"max":{"1min":0.84999999999999998,"5min":0.92000000000000004,"15min":0.98199999999999998},"last":0.55400000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575009,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307436,"kb_used_data":1956,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064404,"statfs":{"total":96636764160,"available":96321949696,"internally_reserved":0,"allocated":2002944,"data_stored":1049126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34599999999999997,"15min":0.33500000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.183},"max":{"1min":0.56899999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.374},"min":{"1min":0.223,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.66500000000000004,"5min":0.876,"15min":0.876},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.39400000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.20599999999999999},"max":{"1min":0.56399999999999995,"5min":0.65600000000000003,"15min":0.745},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.372,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.22600000000000001,"15min":0.215},"max":{"1min":0.63600000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.32100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52000000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.438,"15min":0.434},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.24399999999999999},"max":{"1min":0.629,"5min":0.71599999999999997,"15min":0.78000000000000003},"last":0.436}]},{"osd":4,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.371},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.369},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.99399999999999999},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.32300000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.3320000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.622},"min":{"1min":0.44,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.84899999999999998,"5min":0.88700000000000001,"15min":1.0780000000000001},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63700000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.91200000000000003,"15min":1.3999999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.45500000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.0469999999999999},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.78000000000000003},"min":{"1min":0.46200000000000002,"5min":0.41699999999999998,"15min":0.39400000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":11.138},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.46600000000000003,"5min":0.432,"15min":0.41599999999999998},"max":{"1min":0.86599999999999999,"5min":1.024,"15min":1.429},"last":0.57499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575009,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307388,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064452,"statfs":{"total":96636764160,"available":96321998848,"internally_reserved":0,"allocated":1953792,"data_stored":1021538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34699999999999998,"15min":0.36199999999999999},"min":{"1min":0.218,"5min":0.182,"15min":0.182},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.80300000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.38800000000000001},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.58199999999999996,"5min":0.68000000000000005,"15min":0.98999999999999999},"last":0.22800000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.375,"15min":0.39200000000000002},"min":{"1min":0.25700000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":3.1230000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":3.0129999999999999},"last":0.32800000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.375,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.23499999999999999},"max":{"1min":0.56899999999999995,"5min":0.59299999999999997,"15min":1.423},"last":0.253},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.33500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.77400000000000002},"last":0.34000000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.443,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.41799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.304},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.439,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.629}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.45100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0980000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.41799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96499999999999997,"5min":0.97999999999999998,"15min":1.347},"last":0.50700000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64900000000000002,"15min":0.66200000000000003},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.206},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63800000000000001,"15min":0.66500000000000004},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.385},"last":0.58399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575009,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307432,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064408,"statfs":{"total":96636764160,"available":96321953792,"internally_reserved":0,"allocated":1998848,"data_stored":1049084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47299999999999998,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.375,"15min":0.38200000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.78100000000000003},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.24099999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.66700000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.40300000000000002},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59599999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54500000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.246},"max":{"1min":0.57399999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.59899999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.0049999999999999},"last":0.754},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.83899999999999997,"5min":0.92700000000000005,"15min":1.1539999999999999},"last":0.89400000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.37,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84899999999999998,"5min":0.95399999999999996,"15min":1.2110000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.874,"5min":0.89600000000000002,"15min":1.0429999999999999},"last":0.80500000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81999999999999995,"5min":0.90800000000000003,"15min":1.0700000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.47699999999999998,"5min":0.39500000000000002,"15min":0.38600000000000001},"max":{"1min":0.85999999999999999,"5min":0.98499999999999999,"15min":1.391},"last":0.93899999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.48299999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80300000000000005,"5min":0.94099999999999995,"15min":1.121},"last":0.878},{"interface":"front","average":{"1min":0.626,"5min":0.63700000000000001,"15min":0.63400000000000001},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88800000000000001,"5min":0.89900000000000002,"15min":0.95099999999999996},"last":0.82499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575009,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311488,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060352,"statfs":{"total":96636764160,"available":96317800448,"internally_reserved":0,"allocated":1957888,"data_stored":1022491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.252,"5min":0.252,"15min":0.217},"max":{"1min":0.71799999999999997,"5min":0.78900000000000003,"15min":0.86399999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.88900000000000001,"15min":1.7290000000000001},"last":0.56200000000000006}]},{"osd":1,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.77300000000000002},"min":{"1min":0.41599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.71999999999999997,"5min":0.749,"15min":17.879999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.76300000000000001},"min":{"1min":0.377,"5min":0.33100000000000002,"15min":0.32700000000000001},"max":{"1min":0.69899999999999995,"5min":0.76500000000000001,"15min":18.010999999999999},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.55100000000000005},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.309},"max":{"1min":0.73299999999999998,"5min":0.84699999999999998,"15min":1.619},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.42599999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":1.6639999999999999},"last":0.61699999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.29899999999999999},"max":{"1min":0.76200000000000001,"5min":0.76500000000000001,"15min":1.2729999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44500000000000001,"5min":0.32700000000000001,"15min":0.32200000000000001},"max":{"1min":0.80000000000000004,"5min":0.81999999999999995,"15min":0.84899999999999998},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48999999999999999,"15min":0.51200000000000001},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69799999999999995,"5min":0.78900000000000003,"15min":1.532},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.80700000000000005},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.501,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.64300000000000002,"5min":0.90400000000000003,"15min":1.5700000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76000000000000001,"5min":0.84099999999999997,"15min":1.4319999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.40400000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73899999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72999999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.76100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575008,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303308,"kb_used_data":1924,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068532,"statfs":{"total":96636764160,"available":96326176768,"internally_reserved":0,"allocated":1970176,"data_stored":1023702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.34599999999999997,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.78800000000000003,"5min":1.034,"15min":1.103},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.312},"max":{"1min":0.81799999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.29699999999999999},"max":{"1min":0.91400000000000003,"5min":1.02,"15min":1.1679999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.33900000000000002},"max":{"1min":0.89200000000000002,"5min":0.99399999999999999,"15min":1.0620000000000001},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.30399999999999999},"max":{"1min":0.74299999999999999,"5min":1.1870000000000001,"15min":1.2070000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":1.1140000000000001},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.84299999999999997,"15min":1.1799999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78900000000000003,"5min":1.1040000000000001,"15min":1.1830000000000001},"last":0.60399999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72399999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.50900000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26500000000000001},"max":{"1min":0.72199999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65900000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.29699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79700000000000004,"5min":0.872,"15min":0.872},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:30:50.130 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:30:50.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.251+0000 7f44fefa8700 1 Processor -- start 2023-10-06T02:30:50.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.251+0000 7f44fefa8700 1 -- start start 2023-10-06T02:30:50.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.252+0000 7f44fefa8700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f44f8159380 0x7f44f8159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:50.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.252+0000 7f44fefa8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44f815d4d0 0x7f44f815d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:50.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.252+0000 7f44fefa8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f80cb6c0 con 0x7f44f80b20e0 2023-10-06T02:30:50.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.252+0000 7f44fefa8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f815e200 con 0x7f44f815d4d0 2023-10-06T02:30:50.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.252+0000 7f44fefa8700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f80ccb60 con 0x7f44f8159380 2023-10-06T02:30:50.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.252+0000 7f44fd545700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44f815d4d0 0x7f44f815d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:50.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.252+0000 7f44f7fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f44f80b20e0 0x7f44f80b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44608/0 (socket says 172.21.15.6:44608) 2023-10-06T02:30:50.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.252+0000 7f44f7fff700 1 -- 172.21.15.6:0/3199493347 learned_addr learned my addr 172.21.15.6:0/3199493347 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:50.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.252+0000 7f44fcd44700 1 --2- 172.21.15.6:0/3199493347 >> v2:172.21.15.175:3300/0 conn(0x7f44f8159380 0x7f44f8159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:50.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.253+0000 7f44fd545700 1 -- 172.21.15.6:0/3199493347 >> v2:172.21.15.175:3300/0 conn(0x7f44f8159380 msgr2=0x7f44f8159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:50.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.253+0000 7f44fd545700 1 --2- 172.21.15.6:0/3199493347 >> v2:172.21.15.175:3300/0 conn(0x7f44f8159380 0x7f44f8159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:50.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.253+0000 7f44fd545700 1 -- 172.21.15.6:0/3199493347 >> v1:172.21.15.6:6789/0 conn(0x7f44f80b20e0 legacy=0x7f44f80b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:50.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.253+0000 7f44fd545700 1 -- 172.21.15.6:0/3199493347 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f80c3ef0 con 0x7f44f815d4d0 2023-10-06T02:30:50.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.253+0000 7f44f77fe700 1 -- 172.21.15.6:0/3199493347 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005662847 0 0) 0x7f44f80cb6c0 con 0x7f44f80b20e0 2023-10-06T02:30:50.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.253+0000 7f44fd545700 1 --2- 172.21.15.6:0/3199493347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f815d4d0 0x7f44f815d930 secure :-1 s=READY pgs=2587 cs=0 l=1 rev1=1 crypto rx=0x7f44f8089550 tx=0x7f44e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19838c6fb11a601 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:50.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.253+0000 7f44f77fe700 1 -- 172.21.15.6:0/3199493347 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0009e80 con 0x7f44f815d4d0 2023-10-06T02:30:50.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.253+0000 7f44f77fe700 1 -- 172.21.15.6:0/3199493347 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e000b820 con 0x7f44f815d4d0 2023-10-06T02:30:50.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.253+0000 7f44f77fe700 1 -- 172.21.15.6:0/3199493347 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e000bba0 con 0x7f44f815d4d0 2023-10-06T02:30:50.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.253+0000 7f44fefa8700 1 -- 172.21.15.6:0/3199493347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f815d4d0 msgr2=0x7f44f815d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:50.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.253+0000 7f44fefa8700 1 --2- 172.21.15.6:0/3199493347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f815d4d0 0x7f44f815d930 secure :-1 s=READY pgs=2587 cs=0 l=1 rev1=1 crypto rx=0x7f44f8089550 tx=0x7f44e00091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:50.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.253+0000 7f44fefa8700 1 -- 172.21.15.6:0/3199493347 shutdown_connections 2023-10-06T02:30:50.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.253+0000 7f44fefa8700 1 --2- 172.21.15.6:0/3199493347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f815d4d0 0x7f44f815d930 unknown :-1 s=CLOSED pgs=2587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:50.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.253+0000 7f44fefa8700 1 --2- 172.21.15.6:0/3199493347 >> v2:172.21.15.175:3300/0 conn(0x7f44f8159380 0x7f44f8159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:50.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.253+0000 7f44fefa8700 1 -- 172.21.15.6:0/3199493347 >> 172.21.15.6:0/3199493347 conn(0x7f44f8068680 msgr2=0x7f44f8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:50.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.254+0000 7f44fefa8700 1 -- 172.21.15.6:0/3199493347 shutdown_connections 2023-10-06T02:30:50.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.254+0000 7f44fefa8700 1 -- 172.21.15.6:0/3199493347 wait complete. 2023-10-06T02:30:50.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.255+0000 7f44fefa8700 1 Processor -- start 2023-10-06T02:30:50.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.255+0000 7f44fefa8700 1 -- start start 2023-10-06T02:30:50.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.255+0000 7f44fefa8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f80b20e0 0x7f44f81695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:50.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.255+0000 7f44fefa8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44f8159380 0x7f44f80c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:50.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.255+0000 7f44fefa8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44f815d4d0 0x7f44f815b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:50.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.255+0000 7f44fefa8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f815a5b0 con 0x7f44f80b20e0 2023-10-06T02:30:50.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.255+0000 7f44fefa8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f8159750 con 0x7f44f8159380 2023-10-06T02:30:50.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.255+0000 7f44fefa8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f8159a30 con 0x7f44f815d4d0 2023-10-06T02:30:50.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.256+0000 7f44fcd44700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f80b20e0 0x7f44f81695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:50.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.256+0000 7f44fcd44700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f80b20e0 0x7f44f81695f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44660/0 (socket says 172.21.15.6:44660) 2023-10-06T02:30:50.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.256+0000 7f44fcd44700 1 -- 172.21.15.6:0/1594132386 learned_addr learned my addr 172.21.15.6:0/1594132386 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:50.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.256+0000 7f44fd545700 1 --2- 172.21.15.6:0/1594132386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44f815d4d0 0x7f44f815b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:50.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.256+0000 7f44f7fff700 1 --2- 172.21.15.6:0/1594132386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44f8159380 0x7f44f80c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:50.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.256+0000 7f44fcd44700 1 -- 172.21.15.6:0/1594132386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44f815d4d0 msgr2=0x7f44f815b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:50.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.256+0000 7f44fcd44700 1 --2- 172.21.15.6:0/1594132386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44f815d4d0 0x7f44f815b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:50.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.256+0000 7f44fcd44700 1 -- 172.21.15.6:0/1594132386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44f8159380 msgr2=0x7f44f80c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:50.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.256+0000 7f44fcd44700 1 --2- 172.21.15.6:0/1594132386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44f8159380 0x7f44f80c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:50.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.256+0000 7f44fcd44700 1 -- 172.21.15.6:0/1594132386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e0009420 con 0x7f44f80b20e0 2023-10-06T02:30:50.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.256+0000 7f44fd545700 1 --2- 172.21.15.6:0/1594132386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44f815d4d0 0x7f44f815b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:50.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.256+0000 7f44fcd44700 1 --2- 172.21.15.6:0/1594132386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f80b20e0 0x7f44f81695f0 secure :-1 s=READY pgs=2588 cs=0 l=1 rev1=1 crypto rx=0x7f44f000e190 tx=0x7f44f0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:50.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.256+0000 7f44f4ff9700 1 -- 172.21.15.6:0/1594132386 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f000ee30 con 0x7f44f80b20e0 2023-10-06T02:30:50.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.256+0000 7f44f4ff9700 1 -- 172.21.15.6:0/1594132386 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f0014420 con 0x7f44f80b20e0 2023-10-06T02:30:50.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.256+0000 7f44fefa8700 1 -- 172.21.15.6:0/1594132386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f8159d10 con 0x7f44f80b20e0 2023-10-06T02:30:50.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.256+0000 7f44f4ff9700 1 -- 172.21.15.6:0/1594132386 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f00147e0 con 0x7f44f80b20e0 2023-10-06T02:30:50.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.256+0000 7f44fefa8700 1 -- 172.21.15.6:0/1594132386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f815a2d0 con 0x7f44f80b20e0 2023-10-06T02:30:50.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.257+0000 7f44fefa8700 1 -- 172.21.15.6:0/1594132386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f816cdb0 con 0x7f44f80b20e0 2023-10-06T02:30:50.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.258+0000 7f44f4ff9700 1 -- 172.21.15.6:0/1594132386 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44f0014b90 con 0x7f44f80b20e0 2023-10-06T02:30:50.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.258+0000 7f44f4ff9700 1 --2- 172.21.15.6:0/1594132386 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44d8066f30 0x7f44d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:50.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.258+0000 7f44f4ff9700 1 -- 172.21.15.6:0/1594132386 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f44f0084d60 con 0x7f44f80b20e0 2023-10-06T02:30:50.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.258+0000 7f44f7fff700 1 --2- 172.21.15.6:0/1594132386 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44d8066f30 0x7f44d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:50.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.259+0000 7f44f7fff700 1 --2- 172.21.15.6:0/1594132386 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44d8066f30 0x7f44d80693e0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f44f815b3b0 tx=0x7f44e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:50.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.262+0000 7f44f4ff9700 1 -- 172.21.15.6:0/1594132386 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44f0051fd0 con 0x7f44f80b20e0 2023-10-06T02:30:50.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.456+0000 7f44fefa8700 1 -- 172.21.15.6:0/1594132386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44f80cad90 con 0x7f44f80b20e0 2023-10-06T02:30:50.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.457+0000 7f44f4ff9700 1 -- 172.21.15.6:0/1594132386 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+14072 (secure 0 0 0) 0x7f44f0009a60 con 0x7f44f80b20e0 2023-10-06T02:30:50.458 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:50.458 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":152,"fsid":"c557bd13-0401-4965-a08f-5579f545617e","created":"2023-10-06T02:17:24.948943+0000","modified":"2023-10-06T02:30:47.131199+0000","last_up_change":"2023-10-06T02:17:34.901956+0000","last_in_change":"2023-10-06T02:17:27.345038+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:17:36.253879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:17:36.611849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4805a88b-858b-4389-87ba-2b19c52161fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":90679},{"type":"v1","addr":"172.21.15.6:6817","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":90679},{"type":"v1","addr":"172.21.15.6:6819","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":90679},{"type":"v1","addr":"172.21.15.6:6823","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":90679},{"type":"v1","addr":"172.21.15.6:6821","nonce":90679}]},"public_addr":"172.21.15.6:6817/90679","cluster_addr":"172.21.15.6:6819/90679","heartbeat_back_addr":"172.21.15.6:6823/90679","heartbeat_front_addr":"172.21.15.6:6821/90679","state":["exists","up"]},{"osd":1,"uuid":"350f60b6-7772-43a2-b25c-7d49920c7bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":90678},{"type":"v1","addr":"172.21.15.6:6801","nonce":90678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":90678},{"type":"v1","addr":"172.21.15.6:6803","nonce":90678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":90678},{"type":"v1","addr":"172.21.15.6:6807","nonce":90678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":90678},{"type":"v1","addr":"172.21.15.6:6805","nonce":90678}]},"public_addr":"172.21.15.6:6801/90678","cluster_addr":"172.21.15.6:6803/90678","heartbeat_back_addr":"172.21.15.6:6807/90678","heartbeat_front_addr":"172.21.15.6:6805/90678","state":["exists","up"]},{"osd":2,"uuid":"92d3458b-f56f-4d6e-b928-c1b9e61cd9ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":90680},{"type":"v1","addr":"172.21.15.6:6809","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":90680},{"type":"v1","addr":"172.21.15.6:6811","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":90680},{"type":"v1","addr":"172.21.15.6:6815","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":90680},{"type":"v1","addr":"172.21.15.6:6813","nonce":90680}]},"public_addr":"172.21.15.6:6809/90680","cluster_addr":"172.21.15.6:6811/90680","heartbeat_back_addr":"172.21.15.6:6815/90680","heartbeat_front_addr":"172.21.15.6:6813/90680","state":["exists","up"]},{"osd":3,"uuid":"62d5d34d-f6f8-424d-889e-676fae270ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":90683},{"type":"v1","addr":"172.21.15.6:6825","nonce":90683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":90683},{"type":"v1","addr":"172.21.15.6:6827","nonce":90683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":90683},{"type":"v1","addr":"172.21.15.6:6831","nonce":90683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":90683},{"type":"v1","addr":"172.21.15.6:6829","nonce":90683}]},"public_addr":"172.21.15.6:6825/90683","cluster_addr":"172.21.15.6:6827/90683","heartbeat_back_addr":"172.21.15.6:6831/90683","heartbeat_front_addr":"172.21.15.6:6829/90683","state":["exists","up"]},{"osd":4,"uuid":"cfc25148-d4c5-46f3-b224-df03a90efcad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":90865},{"type":"v1","addr":"172.21.15.175:6809","nonce":90865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":90865},{"type":"v1","addr":"172.21.15.175:6811","nonce":90865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":90865},{"type":"v1","addr":"172.21.15.175:6818","nonce":90865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":90865},{"type":"v1","addr":"172.21.15.175:6814","nonce":90865}]},"public_addr":"172.21.15.175:6809/90865","cluster_addr":"172.21.15.175:6811/90865","heartbeat_back_addr":"172.21.15.175:6818/90865","heartbeat_front_addr":"172.21.15.175:6814/90865","state":["exists","up"]},{"osd":5,"uuid":"3bf97848-ae01-464c-b917-16e3c79a5b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":90866},{"type":"v1","addr":"172.21.15.175:6801","nonce":90866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":90866},{"type":"v1","addr":"172.21.15.175:6803","nonce":90866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":90866},{"type":"v1","addr":"172.21.15.175:6807","nonce":90866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":90866},{"type":"v1","addr":"172.21.15.175:6805","nonce":90866}]},"public_addr":"172.21.15.175:6801/90866","cluster_addr":"172.21.15.175:6803/90866","heartbeat_back_addr":"172.21.15.175:6807/90866","heartbeat_front_addr":"172.21.15.175:6805/90866","state":["exists","up"]},{"osd":6,"uuid":"3c10208f-a53c-4e01-adc8-88d62cdc60a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":90867},{"type":"v1","addr":"172.21.15.175:6815","nonce":90867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":90867},{"type":"v1","addr":"172.21.15.175:6819","nonce":90867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":90867},{"type":"v1","addr":"172.21.15.175:6823","nonce":90867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":90867},{"type":"v1","addr":"172.21.15.175:6821","nonce":90867}]},"public_addr":"172.21.15.175:6815/90867","cluster_addr":"172.21.15.175:6819/90867","heartbeat_back_addr":"172.21.15.175:6823/90867","heartbeat_front_addr":"172.21.15.175:6821/90867","state":["exists","up"]},{"osd":7,"uuid":"95f66d89-d412-4721-b9b4-5ae33fb762e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":90910},{"type":"v1","addr":"172.21.15.175:6825","nonce":90910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":90910},{"type":"v1","addr":"172.21.15.175:6827","nonce":90910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":90910},{"type":"v1","addr":"172.21.15.175:6831","nonce":90910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":90910},{"type":"v1","addr":"172.21.15.175:6829","nonce":90910}]},"public_addr":"172.21.15.175:6825/90910","cluster_addr":"172.21.15.175:6827/90910","heartbeat_back_addr":"172.21.15.175:6831/90910","heartbeat_front_addr":"172.21.15.175:6829/90910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.483542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.416794+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.512457+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.501504+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.289076+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.189990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.505667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:17:32.555807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/3837760829":"2023-10-07T02:30:43.924847+0000","172.21.15.6:6833/3837760829":"2023-10-07T02:30:43.924847+0000","172.21.15.6:6835/1108543434":"2023-10-07T02:30:28.039955+0000","172.21.15.6:6833/1108543434":"2023-10-07T02:30:28.039955+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:30:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.459+0000 7f44fefa8700 1 -- 172.21.15.6:0/1594132386 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44d8066f30 msgr2=0x7f44d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.459+0000 7f44fefa8700 1 --2- 172.21.15.6:0/1594132386 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44d8066f30 0x7f44d80693e0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f44f815b3b0 tx=0x7f44e8009040 comp rx=0 tx=0).stop 2023-10-06T02:30:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.459+0000 7f44fefa8700 1 -- 172.21.15.6:0/1594132386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f80b20e0 msgr2=0x7f44f81695f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.459+0000 7f44fefa8700 1 --2- 172.21.15.6:0/1594132386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f80b20e0 0x7f44f81695f0 secure :-1 s=READY pgs=2588 cs=0 l=1 rev1=1 crypto rx=0x7f44f000e190 tx=0x7f44f0009920 comp rx=0 tx=0).stop 2023-10-06T02:30:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.459+0000 7f44fefa8700 1 -- 172.21.15.6:0/1594132386 shutdown_connections 2023-10-06T02:30:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.459+0000 7f44fefa8700 1 --2- 172.21.15.6:0/1594132386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44f815d4d0 0x7f44f815b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:50.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.459+0000 7f44fefa8700 1 --2- 172.21.15.6:0/1594132386 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f44d8066f30 0x7f44d80693e0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:50.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.459+0000 7f44fefa8700 1 --2- 172.21.15.6:0/1594132386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f80b20e0 0x7f44f81695f0 unknown :-1 s=CLOSED pgs=2588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:50.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.459+0000 7f44fefa8700 1 --2- 172.21.15.6:0/1594132386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44f8159380 0x7f44f80c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:50.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.459+0000 7f44fefa8700 1 -- 172.21.15.6:0/1594132386 >> 172.21.15.6:0/1594132386 conn(0x7f44f8068680 msgr2=0x7f44f80c4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:50.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.459+0000 7f44fefa8700 1 -- 172.21.15.6:0/1594132386 shutdown_connections 2023-10-06T02:30:50.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:50.459+0000 7f44fefa8700 1 -- 172.21.15.6:0/1594132386 wait complete. 2023-10-06T02:30:51.473 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T02:30:51.473 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:30:51.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.610+0000 7fc9142ae700 1 Processor -- start 2023-10-06T02:30:51.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.610+0000 7fc9142ae700 1 -- start start 2023-10-06T02:30:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.611+0000 7fc9142ae700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc90c1598b0 0x7fc90c0afef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.611+0000 7fc9142ae700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc90c0b0430 0x7fc90c15b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.611+0000 7fc9142ae700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90c0afa60 con 0x7fc90c15b770 2023-10-06T02:30:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.611+0000 7fc9142ae700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc90c15bbf0 con 0x7fc90c0b0430 2023-10-06T02:30:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.611+0000 7fc9142ae700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0af440 con 0x7fc90c1598b0 2023-10-06T02:30:51.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.611+0000 7fc911849700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc90c0b0430 0x7fc90c15b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:51.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.611+0000 7fc911849700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc90c0b0430 0x7fc90c15b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44666/0 (socket says 172.21.15.6:44666) 2023-10-06T02:30:51.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.611+0000 7fc911849700 1 -- 172.21.15.6:0/179658595 learned_addr learned my addr 172.21.15.6:0/179658595 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:51.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.611+0000 7fc91204a700 1 --2- 172.21.15.6:0/179658595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc90c1598b0 0x7fc90c0afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:51.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.611+0000 7fc911849700 1 -- 172.21.15.6:0/179658595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc90c1598b0 msgr2=0x7fc90c0afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:51.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.611+0000 7fc911849700 1 --2- 172.21.15.6:0/179658595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc90c1598b0 0x7fc90c0afef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.611+0000 7fc911849700 1 -- 172.21.15.6:0/179658595 >> v1:172.21.15.175:6789/0 conn(0x7fc90c15b770 legacy=0x7fc90c159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.611+0000 7fc911849700 1 -- 172.21.15.6:0/179658595 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c15ab00 con 0x7fc90c0b0430 2023-10-06T02:30:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.611+0000 7fc911849700 1 --2- 172.21.15.6:0/179658595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc90c0b0430 0x7fc90c15b230 secure :-1 s=READY pgs=2589 cs=0 l=1 rev1=1 crypto rx=0x7fc9000099b0 tx=0x7fc900009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2fd6eb94d1835 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.612+0000 7fc911048700 1 -- 172.21.15.6:0/179658595 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90000b820 con 0x7fc90c0b0430 2023-10-06T02:30:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.612+0000 7fc911048700 1 -- 172.21.15.6:0/179658595 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90000b980 con 0x7fc90c0b0430 2023-10-06T02:30:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.612+0000 7fc911048700 1 -- 172.21.15.6:0/179658595 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90000bd20 con 0x7fc90c0b0430 2023-10-06T02:30:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.612+0000 7fc9142ae700 1 -- 172.21.15.6:0/179658595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc90c0b0430 msgr2=0x7fc90c15b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:51.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.612+0000 7fc9142ae700 1 --2- 172.21.15.6:0/179658595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc90c0b0430 0x7fc90c15b230 secure :-1 s=READY pgs=2589 cs=0 l=1 rev1=1 crypto rx=0x7fc9000099b0 tx=0x7fc900009250 comp rx=0 tx=0).stop 2023-10-06T02:30:51.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.612+0000 7fc9142ae700 1 -- 172.21.15.6:0/179658595 shutdown_connections 2023-10-06T02:30:51.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.612+0000 7fc9142ae700 1 --2- 172.21.15.6:0/179658595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc90c1598b0 0x7fc90c0afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:51.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.612+0000 7fc9142ae700 1 --2- 172.21.15.6:0/179658595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc90c0b0430 0x7fc90c15b230 unknown :-1 s=CLOSED pgs=2589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:51.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.612+0000 7fc9142ae700 1 -- 172.21.15.6:0/179658595 >> 172.21.15.6:0/179658595 conn(0x7fc90c067910 msgr2=0x7fc90c0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:51.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.612+0000 7fc9142ae700 1 -- 172.21.15.6:0/179658595 shutdown_connections 2023-10-06T02:30:51.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.612+0000 7fc9142ae700 1 -- 172.21.15.6:0/179658595 wait complete. 2023-10-06T02:30:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.613+0000 7fc9142ae700 1 Processor -- start 2023-10-06T02:30:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.613+0000 7fc9142ae700 1 -- start start 2023-10-06T02:30:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.614+0000 7fc9142ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc90c0b0430 0x7fc90c148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.614+0000 7fc9142ae700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc90c1598b0 0x7fc90c0c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.614+0000 7fc9142ae700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc90c15b770 0x7fc90c0c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.614+0000 7fc9142ae700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c149290 con 0x7fc90c0b0430 2023-10-06T02:30:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.614+0000 7fc9142ae700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c14b390 con 0x7fc90c1598b0 2023-10-06T02:30:51.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.614+0000 7fc9142ae700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c14b670 con 0x7fc90c15b770 2023-10-06T02:30:51.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.614+0000 7fc91204a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc90c0b0430 0x7fc90c148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:51.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.614+0000 7fc91204a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc90c0b0430 0x7fc90c148d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44674/0 (socket says 172.21.15.6:44674) 2023-10-06T02:30:51.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.614+0000 7fc91204a700 1 -- 172.21.15.6:0/56801061 learned_addr learned my addr 172.21.15.6:0/56801061 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:51.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.614+0000 7fc911849700 1 --2- 172.21.15.6:0/56801061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc90c1598b0 0x7fc90c0c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:51.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.614+0000 7fc91284b700 1 --2- 172.21.15.6:0/56801061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc90c15b770 0x7fc90c0c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:51.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.614+0000 7fc91204a700 1 -- 172.21.15.6:0/56801061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc90c15b770 msgr2=0x7fc90c0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:51.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.614+0000 7fc91204a700 1 --2- 172.21.15.6:0/56801061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc90c15b770 0x7fc90c0c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:51.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.614+0000 7fc91204a700 1 -- 172.21.15.6:0/56801061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc90c1598b0 msgr2=0x7fc90c0c2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:51.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.615+0000 7fc91204a700 1 --2- 172.21.15.6:0/56801061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc90c1598b0 0x7fc90c0c2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:51.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.615+0000 7fc91204a700 1 -- 172.21.15.6:0/56801061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9000094f0 con 0x7fc90c0b0430 2023-10-06T02:30:51.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.615+0000 7fc91204a700 1 --2- 172.21.15.6:0/56801061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc90c0b0430 0x7fc90c148d50 secure :-1 s=READY pgs=2590 cs=0 l=1 rev1=1 crypto rx=0x7fc90400ceb0 tx=0x7fc904007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:51.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.615+0000 7fc90a7fc700 1 -- 172.21.15.6:0/56801061 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90400adf0 con 0x7fc90c0b0430 2023-10-06T02:30:51.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.615+0000 7fc90a7fc700 1 -- 172.21.15.6:0/56801061 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90400f450 con 0x7fc90c0b0430 2023-10-06T02:30:51.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.615+0000 7fc9142ae700 1 -- 172.21.15.6:0/56801061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90c14b950 con 0x7fc90c0b0430 2023-10-06T02:30:51.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.615+0000 7fc90a7fc700 1 -- 172.21.15.6:0/56801061 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90400f7f0 con 0x7fc90c0b0430 2023-10-06T02:30:51.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.615+0000 7fc9142ae700 1 -- 172.21.15.6:0/56801061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc90c14bf10 con 0x7fc90c0b0430 2023-10-06T02:30:51.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.616+0000 7fc9142ae700 1 -- 172.21.15.6:0/56801061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc90c14c790 con 0x7fc90c0b0430 2023-10-06T02:30:51.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.616+0000 7fc90a7fc700 1 -- 172.21.15.6:0/56801061 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc904003020 con 0x7fc90c0b0430 2023-10-06T02:30:51.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.617+0000 7fc90a7fc700 1 --2- 172.21.15.6:0/56801061 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc8f8066f30 0x7fc8f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:51.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.617+0000 7fc90a7fc700 1 -- 172.21.15.6:0/56801061 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fc904013070 con 0x7fc90c0b0430 2023-10-06T02:30:51.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.617+0000 7fc911849700 1 --2- 172.21.15.6:0/56801061 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc8f8066f30 0x7fc8f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.617+0000 7fc90a7fc700 1 --2- 172.21.15.6:0/56801061 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7fc8f806d8f0 0x7fc8f806fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.617+0000 7fc90a7fc700 1 -- 172.21.15.6:0/56801061 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8f80703f0 con 0x7fc8f806d8f0 2023-10-06T02:30:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.617+0000 7fc90a7fc700 1 -- 172.21.15.6:0/56801061 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=152) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9040872f0 con 0x7fc90c0b0430 2023-10-06T02:30:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.617+0000 7fc91284b700 1 --2- 172.21.15.6:0/56801061 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7fc8f806d8f0 0x7fc8f806fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.617+0000 7fc91284b700 1 --2- 172.21.15.6:0/56801061 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7fc8f806d8f0 0x7fc8f806fd20 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.617+0000 7fc911849700 1 --2- 172.21.15.6:0/56801061 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc8f8066f30 0x7fc8f80693e0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fc9000099b0 tx=0x7fc900016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.618+0000 7fc90a7fc700 1 -- 172.21.15.6:0/56801061 <== osd.0 v2:172.21.15.6:6816/90679 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc8f80703f0 con 0x7fc8f806d8f0 2023-10-06T02:30:51.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.632+0000 7fc9142ae700 1 -- 172.21.15.6:0/56801061 --> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc90c04bb80 con 0x7fc8f806d8f0 2023-10-06T02:30:51.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.632+0000 7fc90a7fc700 1 -- 172.21.15.6:0/56801061 <== osd.0 v2:172.21.15.6:6816/90679 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc90c04bb80 con 0x7fc8f806d8f0 2023-10-06T02:30:51.633 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:30:51.633 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T02:30:51.633 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:30:51.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.632+0000 7fc9142ae700 1 -- 172.21.15.6:0/56801061 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7fc8f806d8f0 msgr2=0x7fc8f806fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:51.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.632+0000 7fc9142ae700 1 --2- 172.21.15.6:0/56801061 >> [v2:172.21.15.6:6816/90679,v1:172.21.15.6:6817/90679] conn(0x7fc8f806d8f0 0x7fc8f806fd20 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:51.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.633+0000 7fc9142ae700 1 -- 172.21.15.6:0/56801061 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc8f8066f30 msgr2=0x7fc8f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:51.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.633+0000 7fc9142ae700 1 --2- 172.21.15.6:0/56801061 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc8f8066f30 0x7fc8f80693e0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fc9000099b0 tx=0x7fc900016000 comp rx=0 tx=0).stop 2023-10-06T02:30:51.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.633+0000 7fc9142ae700 1 -- 172.21.15.6:0/56801061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc90c0b0430 msgr2=0x7fc90c148d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:51.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.633+0000 7fc9142ae700 1 --2- 172.21.15.6:0/56801061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc90c0b0430 0x7fc90c148d50 secure :-1 s=READY pgs=2590 cs=0 l=1 rev1=1 crypto rx=0x7fc90400ceb0 tx=0x7fc904007860 comp rx=0 tx=0).stop 2023-10-06T02:30:51.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.633+0000 7fc91284b700 1 -- 172.21.15.6:0/56801061 reap_dead start 2023-10-06T02:30:51.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.633+0000 7fc9142ae700 1 -- 172.21.15.6:0/56801061 shutdown_connections 2023-10-06T02:30:51.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.633+0000 7fc9142ae700 1 -- 172.21.15.6:0/56801061 >> 172.21.15.6:0/56801061 conn(0x7fc90c067910 msgr2=0x7fc90c0b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:51.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.633+0000 7fc9142ae700 1 -- 172.21.15.6:0/56801061 shutdown_connections 2023-10-06T02:30:51.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.633+0000 7fc9142ae700 1 -- 172.21.15.6:0/56801061 wait complete. 2023-10-06T02:30:51.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T02:30:51.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.765+0000 7fb39359e700 1 Processor -- start 2023-10-06T02:30:51.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.765+0000 7fb39359e700 1 -- start start 2023-10-06T02:30:51.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.766+0000 7fb39359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb39413f5f0 0x7fb39406eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:51.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.766+0000 7fb39359e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb3940c2310 0x7fb3940c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:51.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.766+0000 7fb39359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3940cba90 con 0x7fb3940aeaf0 2023-10-06T02:30:51.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.766+0000 7fb39359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3940c7e90 con 0x7fb39413f5f0 2023-10-06T02:30:51.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.766+0000 7fb39359e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3940c8170 con 0x7fb3940c2310 2023-10-06T02:30:51.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.766+0000 7fb39259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb39413f5f0 0x7fb39406eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:51.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.766+0000 7fb39259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb39413f5f0 0x7fb39406eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44682/0 (socket says 172.21.15.6:44682) 2023-10-06T02:30:51.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.766+0000 7fb39259c700 1 -- 172.21.15.6:0/2880595726 learned_addr learned my addr 172.21.15.6:0/2880595726 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:51.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.766+0000 7fb391d9b700 1 --1- 172.21.15.6:0/2880595726 >> v1:172.21.15.6:6789/0 conn(0x7fb3940aeaf0 0x7fb3940c1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44620/0 (socket says 172.21.15.6:44620) 2023-10-06T02:30:51.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.766+0000 7fb39259c700 1 -- 172.21.15.6:0/2880595726 >> v2:172.21.15.175:3300/0 conn(0x7fb3940c2310 msgr2=0x7fb3940c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:51.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.766+0000 7fb392d9d700 1 --2- 172.21.15.6:0/2880595726 >> v2:172.21.15.175:3300/0 conn(0x7fb3940c2310 0x7fb3940c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:51.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.766+0000 7fb39259c700 1 --2- 172.21.15.6:0/2880595726 >> v2:172.21.15.175:3300/0 conn(0x7fb3940c2310 0x7fb3940c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:51.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.766+0000 7fb39259c700 1 -- 172.21.15.6:0/2880595726 >> v1:172.21.15.6:6789/0 conn(0x7fb3940aeaf0 legacy=0x7fb3940c1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:51.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.766+0000 7fb39259c700 1 -- 172.21.15.6:0/2880595726 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3940c8450 con 0x7fb39413f5f0 2023-10-06T02:30:51.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.766+0000 7fb39159a700 1 -- 172.21.15.6:0/2880595726 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968357141 0 0) 0x7fb3940cba90 con 0x7fb3940aeaf0 2023-10-06T02:30:51.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.767+0000 7fb39259c700 1 --2- 172.21.15.6:0/2880595726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39413f5f0 0x7fb39406eb70 secure :-1 s=READY pgs=2592 cs=0 l=1 rev1=1 crypto rx=0x7fb3940cce30 tx=0x7fb384009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c765480a7b4e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:51.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.767+0000 7fb39159a700 1 -- 172.21.15.6:0/2880595726 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38400b860 con 0x7fb39413f5f0 2023-10-06T02:30:51.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.767+0000 7fb39159a700 1 -- 172.21.15.6:0/2880595726 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38400b9c0 con 0x7fb39413f5f0 2023-10-06T02:30:51.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.767+0000 7fb39159a700 1 -- 172.21.15.6:0/2880595726 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38400bd60 con 0x7fb39413f5f0 2023-10-06T02:30:51.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.767+0000 7fb39359e700 1 -- 172.21.15.6:0/2880595726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39413f5f0 msgr2=0x7fb39406eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:51.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.767+0000 7fb39359e700 1 --2- 172.21.15.6:0/2880595726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39413f5f0 0x7fb39406eb70 secure :-1 s=READY pgs=2592 cs=0 l=1 rev1=1 crypto rx=0x7fb3940cce30 tx=0x7fb384009250 comp rx=0 tx=0).stop 2023-10-06T02:30:51.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.767+0000 7fb39359e700 1 -- 172.21.15.6:0/2880595726 shutdown_connections 2023-10-06T02:30:51.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.767+0000 7fb39359e700 1 --2- 172.21.15.6:0/2880595726 >> v2:172.21.15.175:3300/0 conn(0x7fb3940c2310 0x7fb3940c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:51.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.767+0000 7fb39359e700 1 --2- 172.21.15.6:0/2880595726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39413f5f0 0x7fb39406eb70 unknown :-1 s=CLOSED pgs=2592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:51.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.767+0000 7fb39359e700 1 -- 172.21.15.6:0/2880595726 >> 172.21.15.6:0/2880595726 conn(0x7fb3940cbd50 msgr2=0x7fb3940cc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:51.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.767+0000 7fb39359e700 1 -- 172.21.15.6:0/2880595726 shutdown_connections 2023-10-06T02:30:51.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.767+0000 7fb39359e700 1 -- 172.21.15.6:0/2880595726 wait complete. 2023-10-06T02:30:51.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.769+0000 7fb39359e700 1 Processor -- start 2023-10-06T02:30:51.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.769+0000 7fb39359e700 1 -- start start 2023-10-06T02:30:51.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.769+0000 7fb39359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3940aeaf0 0x7fb394169010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:51.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.769+0000 7fb39359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3940c2310 0x7fb39416cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:51.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.769+0000 7fb39359e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb39413f5f0 0x7fb3940c0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:51.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.769+0000 7fb39359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb394139710 con 0x7fb3940c2310 2023-10-06T02:30:51.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.769+0000 7fb39359e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39416d880 con 0x7fb39413f5f0 2023-10-06T02:30:51.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.769+0000 7fb39359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39416db60 con 0x7fb3940aeaf0 2023-10-06T02:30:51.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.769+0000 7fb391d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3940c2310 0x7fb39416cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:51.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.769+0000 7fb391d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3940c2310 0x7fb39416cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44698/0 (socket says 172.21.15.6:44698) 2023-10-06T02:30:51.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.769+0000 7fb391d9b700 1 -- 172.21.15.6:0/1675432508 learned_addr learned my addr 172.21.15.6:0/1675432508 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:51.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.770+0000 7fb392d9d700 1 --2- 172.21.15.6:0/1675432508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb39413f5f0 0x7fb3940c0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:51.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.770+0000 7fb39259c700 1 --2- 172.21.15.6:0/1675432508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3940aeaf0 0x7fb394169010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:51.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.770+0000 7fb391d9b700 1 -- 172.21.15.6:0/1675432508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3940aeaf0 msgr2=0x7fb394169010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:51.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.770+0000 7fb391d9b700 1 --2- 172.21.15.6:0/1675432508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3940aeaf0 0x7fb394169010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:51.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.770+0000 7fb391d9b700 1 -- 172.21.15.6:0/1675432508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb39413f5f0 msgr2=0x7fb3940c0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:51.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.770+0000 7fb391d9b700 1 --2- 172.21.15.6:0/1675432508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb39413f5f0 0x7fb3940c0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:51.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.770+0000 7fb391d9b700 1 -- 172.21.15.6:0/1675432508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3840094f0 con 0x7fb3940c2310 2023-10-06T02:30:51.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.770+0000 7fb39259c700 1 --2- 172.21.15.6:0/1675432508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3940aeaf0 0x7fb394169010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:51.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.770+0000 7fb392d9d700 1 --2- 172.21.15.6:0/1675432508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb39413f5f0 0x7fb3940c0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:51.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.770+0000 7fb391d9b700 1 --2- 172.21.15.6:0/1675432508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3940c2310 0x7fb39416cdc0 secure :-1 s=READY pgs=2593 cs=0 l=1 rev1=1 crypto rx=0x7fb3880011e0 tx=0x7fb388007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:51.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.770+0000 7fb3827fc700 1 -- 172.21.15.6:0/1675432508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388007300 con 0x7fb3940c2310 2023-10-06T02:30:51.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.770+0000 7fb3827fc700 1 -- 172.21.15.6:0/1675432508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb388007460 con 0x7fb3940c2310 2023-10-06T02:30:51.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.770+0000 7fb3827fc700 1 -- 172.21.15.6:0/1675432508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388004830 con 0x7fb3940c2310 2023-10-06T02:30:51.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.770+0000 7fb39359e700 1 -- 172.21.15.6:0/1675432508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3941393a0 con 0x7fb3940c2310 2023-10-06T02:30:51.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.770+0000 7fb39359e700 1 -- 172.21.15.6:0/1675432508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3940add80 con 0x7fb3940c2310 2023-10-06T02:30:51.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.771+0000 7fb39359e700 1 -- 172.21.15.6:0/1675432508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb394139210 con 0x7fb3940c2310 2023-10-06T02:30:51.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.772+0000 7fb3827fc700 1 -- 172.21.15.6:0/1675432508 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb388004be0 con 0x7fb3940c2310 2023-10-06T02:30:51.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.772+0000 7fb3827fc700 1 --2- 172.21.15.6:0/1675432508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb374066f30 0x7fb3740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:51.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.772+0000 7fb3827fc700 1 -- 172.21.15.6:0/1675432508 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fb388083a40 con 0x7fb3940c2310 2023-10-06T02:30:51.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.772+0000 7fb39259c700 1 --2- 172.21.15.6:0/1675432508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb374066f30 0x7fb3740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:51.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.773+0000 7fb39259c700 1 --2- 172.21.15.6:0/1675432508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb374066f30 0x7fb3740693e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fb3940cce30 tx=0x7fb384017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:51.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.776+0000 7fb3827fc700 1 -- 172.21.15.6:0/1675432508 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb388085e60 con 0x7fb3940c2310 2023-10-06T02:30:51.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.970+0000 7fb39359e700 1 -- 172.21.15.6:0/1675432508 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb394139850 con 0x7fb374066f30 2023-10-06T02:30:51.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.970+0000 7fb3827fc700 1 -- 172.21.15.6:0/1675432508 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb394139850 con 0x7fb374066f30 2023-10-06T02:30:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.972+0000 7fb39359e700 1 -- 172.21.15.6:0/1675432508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb374066f30 msgr2=0x7fb3740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.972+0000 7fb39359e700 1 --2- 172.21.15.6:0/1675432508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb374066f30 0x7fb3740693e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fb3940cce30 tx=0x7fb384017000 comp rx=0 tx=0).stop 2023-10-06T02:30:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.972+0000 7fb39359e700 1 -- 172.21.15.6:0/1675432508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3940c2310 msgr2=0x7fb39416cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.972+0000 7fb39359e700 1 --2- 172.21.15.6:0/1675432508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3940c2310 0x7fb39416cdc0 secure :-1 s=READY pgs=2593 cs=0 l=1 rev1=1 crypto rx=0x7fb3880011e0 tx=0x7fb388007e10 comp rx=0 tx=0).stop 2023-10-06T02:30:51.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.972+0000 7fb39359e700 1 -- 172.21.15.6:0/1675432508 shutdown_connections 2023-10-06T02:30:51.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.972+0000 7fb39359e700 1 --2- 172.21.15.6:0/1675432508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb39413f5f0 0x7fb3940c0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:51.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.972+0000 7fb39359e700 1 --2- 172.21.15.6:0/1675432508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3940aeaf0 0x7fb394169010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:51.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.972+0000 7fb39359e700 1 --2- 172.21.15.6:0/1675432508 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fb374066f30 0x7fb3740693e0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:51.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.972+0000 7fb39359e700 1 --2- 172.21.15.6:0/1675432508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3940c2310 0x7fb39416cdc0 unknown :-1 s=CLOSED pgs=2593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:51.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.972+0000 7fb39359e700 1 -- 172.21.15.6:0/1675432508 >> 172.21.15.6:0/1675432508 conn(0x7fb3940cbd50 msgr2=0x7fb3940af0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:51.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.972+0000 7fb39359e700 1 -- 172.21.15.6:0/1675432508 shutdown_connections 2023-10-06T02:30:51.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:51.972+0000 7fb39359e700 1 -- 172.21.15.6:0/1675432508 wait complete. 2023-10-06T02:30:51.975 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T02:30:51.985 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T02:30:51.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:30:52.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.107+0000 7f6668ba4700 1 Processor -- start 2023-10-06T02:30:52.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.107+0000 7f6668ba4700 1 -- start start 2023-10-06T02:30:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.108+0000 7f6668ba4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66640cfa90 0x7f66640d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.108+0000 7f6668ba4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f66640d07a0 0x7f6664163060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.108+0000 7f6668ba4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f666415a710 con 0x7f6664142df0 2023-10-06T02:30:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.108+0000 7f6668ba4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66640d0c20 con 0x7f66640d07a0 2023-10-06T02:30:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.108+0000 7f6668ba4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6664159b40 con 0x7f66640cfa90 2023-10-06T02:30:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.108+0000 7f6662d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f66640d07a0 0x7f6664163060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.109+0000 7f666259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6664142df0 0x7f66640cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44622/0 (socket says 172.21.15.6:44622) 2023-10-06T02:30:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.109+0000 7f666259c700 1 -- 172.21.15.6:0/2860916235 learned_addr learned my addr 172.21.15.6:0/2860916235 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.109+0000 7f6662d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f66640d07a0 0x7f6664163060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44708/0 (socket says 172.21.15.6:44708) 2023-10-06T02:30:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.109+0000 7f6661d9b700 1 --2- 172.21.15.6:0/2860916235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66640cfa90 0x7f66640d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.109+0000 7f6662d9d700 1 -- 172.21.15.6:0/2860916235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66640cfa90 msgr2=0x7f66640d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.109+0000 7f6662d9d700 1 --2- 172.21.15.6:0/2860916235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66640cfa90 0x7f66640d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.109+0000 7f6662d9d700 1 -- 172.21.15.6:0/2860916235 >> v1:172.21.15.6:6789/0 conn(0x7f6664142df0 legacy=0x7f66640cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.109+0000 7f6662d9d700 1 -- 172.21.15.6:0/2860916235 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6664159de0 con 0x7f66640d07a0 2023-10-06T02:30:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.109+0000 7f666159a700 1 -- 172.21.15.6:0/2860916235 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212612530 0 0) 0x7f666415a710 con 0x7f6664142df0 2023-10-06T02:30:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.109+0000 7f6662d9d700 1 --2- 172.21.15.6:0/2860916235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66640d07a0 0x7f6664163060 secure :-1 s=READY pgs=2595 cs=0 l=1 rev1=1 crypto rx=0x7f6654009e60 tx=0x7f6654009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90c64749500164d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:52.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.109+0000 7f666159a700 1 -- 172.21.15.6:0/2860916235 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665400e070 con 0x7f66640d07a0 2023-10-06T02:30:52.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.109+0000 7f666159a700 1 -- 172.21.15.6:0/2860916235 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665400bb60 con 0x7f66640d07a0 2023-10-06T02:30:52.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.109+0000 7f666159a700 1 -- 172.21.15.6:0/2860916235 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6654012430 con 0x7f66640d07a0 2023-10-06T02:30:52.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.110+0000 7f6668ba4700 1 -- 172.21.15.6:0/2860916235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66640d07a0 msgr2=0x7f6664163060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.110+0000 7f6668ba4700 1 --2- 172.21.15.6:0/2860916235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66640d07a0 0x7f6664163060 secure :-1 s=READY pgs=2595 cs=0 l=1 rev1=1 crypto rx=0x7f6654009e60 tx=0x7f6654009780 comp rx=0 tx=0).stop 2023-10-06T02:30:52.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.110+0000 7f6668ba4700 1 -- 172.21.15.6:0/2860916235 shutdown_connections 2023-10-06T02:30:52.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.110+0000 7f6668ba4700 1 --2- 172.21.15.6:0/2860916235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66640d07a0 0x7f6664163060 unknown :-1 s=CLOSED pgs=2595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.110+0000 7f6668ba4700 1 --2- 172.21.15.6:0/2860916235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66640cfa90 0x7f66640d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.110+0000 7f6668ba4700 1 -- 172.21.15.6:0/2860916235 >> 172.21.15.6:0/2860916235 conn(0x7f66640690f0 msgr2=0x7f666406a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:52.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.110+0000 7f6668ba4700 1 -- 172.21.15.6:0/2860916235 shutdown_connections 2023-10-06T02:30:52.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.110+0000 7f6668ba4700 1 -- 172.21.15.6:0/2860916235 wait complete. 2023-10-06T02:30:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.111+0000 7f6668ba4700 1 Processor -- start 2023-10-06T02:30:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.111+0000 7f6668ba4700 1 -- start start 2023-10-06T02:30:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f6668ba4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66640cfa90 0x7f6664155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f6668ba4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66640d07a0 0x7f6664154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f6668ba4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6664142df0 0x7f6664141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f6668ba4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6664155410 con 0x7f6664142df0 2023-10-06T02:30:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f6668ba4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6664155e60 con 0x7f66640d07a0 2023-10-06T02:30:52.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f6668ba4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6664156140 con 0x7f66640cfa90 2023-10-06T02:30:52.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f6662d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6664142df0 0x7f6664141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f6662d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6664142df0 0x7f6664141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44720/0 (socket says 172.21.15.6:44720) 2023-10-06T02:30:52.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f6662d9d700 1 -- 172.21.15.6:0/2691571033 learned_addr learned my addr 172.21.15.6:0/2691571033 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:52.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f666259c700 1 --2- 172.21.15.6:0/2691571033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66640cfa90 0x7f6664155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f6661d9b700 1 --2- 172.21.15.6:0/2691571033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66640d07a0 0x7f6664154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f6662d9d700 1 -- 172.21.15.6:0/2691571033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66640cfa90 msgr2=0x7f6664155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f6662d9d700 1 --2- 172.21.15.6:0/2691571033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66640cfa90 0x7f6664155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f6662d9d700 1 -- 172.21.15.6:0/2691571033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66640d07a0 msgr2=0x7f6664154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f6662d9d700 1 --2- 172.21.15.6:0/2691571033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66640d07a0 0x7f6664154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f6662d9d700 1 -- 172.21.15.6:0/2691571033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6654009a20 con 0x7f6664142df0 2023-10-06T02:30:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f6662d9d700 1 --2- 172.21.15.6:0/2691571033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6664142df0 0x7f6664141fa0 secure :-1 s=READY pgs=2596 cs=0 l=1 rev1=1 crypto rx=0x7f665400b6c0 tx=0x7f6654019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f665a7fc700 1 -- 172.21.15.6:0/2691571033 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665401d630 con 0x7f6664142df0 2023-10-06T02:30:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f665a7fc700 1 -- 172.21.15.6:0/2691571033 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665401d7b0 con 0x7f6664142df0 2023-10-06T02:30:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.112+0000 7f6668ba4700 1 -- 172.21.15.6:0/2691571033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6664156420 con 0x7f6664142df0 2023-10-06T02:30:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.113+0000 7f665a7fc700 1 -- 172.21.15.6:0/2691571033 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665401db70 con 0x7f6664142df0 2023-10-06T02:30:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.113+0000 7f6668ba4700 1 -- 172.21.15.6:0/2691571033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66641569e0 con 0x7f6664142df0 2023-10-06T02:30:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.113+0000 7f6668ba4700 1 -- 172.21.15.6:0/2691571033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6664088ad0 con 0x7f6664142df0 2023-10-06T02:30:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.114+0000 7f665a7fc700 1 -- 172.21.15.6:0/2691571033 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6654024070 con 0x7f6664142df0 2023-10-06T02:30:52.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.114+0000 7f665a7fc700 1 --2- 172.21.15.6:0/2691571033 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6644066f30 0x7f66440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.114+0000 7f665a7fc700 1 -- 172.21.15.6:0/2691571033 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f6654086e10 con 0x7f6664142df0 2023-10-06T02:30:52.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.114+0000 7f665a7fc700 1 --2- 172.21.15.6:0/2691571033 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7f664406d8f0 0x7f664406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.114+0000 7f665a7fc700 1 -- 172.21.15.6:0/2691571033 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66440703f0 con 0x7f664406d8f0 2023-10-06T02:30:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.114+0000 7f665a7fc700 1 -- 172.21.15.6:0/2691571033 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=152) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66540893f0 con 0x7f6664142df0 2023-10-06T02:30:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.115+0000 7f666259c700 1 --2- 172.21.15.6:0/2691571033 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6644066f30 0x7f66440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.115+0000 7f6661d9b700 1 --2- 172.21.15.6:0/2691571033 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7f664406d8f0 0x7f664406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.115+0000 7f6661d9b700 1 --2- 172.21.15.6:0/2691571033 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7f664406d8f0 0x7f664406fd20 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.115+0000 7f666259c700 1 --2- 172.21.15.6:0/2691571033 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6644066f30 0x7f66440693e0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f665c0011e0 tx=0x7f665c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:52.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.115+0000 7f665a7fc700 1 -- 172.21.15.6:0/2691571033 <== osd.1 v2:172.21.15.6:6800/90678 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f66440703f0 con 0x7f664406d8f0 2023-10-06T02:30:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.129+0000 7f6668ba4700 1 -- 172.21.15.6:0/2691571033 --> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6664087440 con 0x7f664406d8f0 2023-10-06T02:30:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.130+0000 7f665a7fc700 1 -- 172.21.15.6:0/2691571033 <== osd.1 v2:172.21.15.6:6800/90678 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6664087440 con 0x7f664406d8f0 2023-10-06T02:30:52.131 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:30:52.131 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T02:30:52.131 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:30:52.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.130+0000 7f6668ba4700 1 -- 172.21.15.6:0/2691571033 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7f664406d8f0 msgr2=0x7f664406fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.130+0000 7f6668ba4700 1 --2- 172.21.15.6:0/2691571033 >> [v2:172.21.15.6:6800/90678,v1:172.21.15.6:6801/90678] conn(0x7f664406d8f0 0x7f664406fd20 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.130+0000 7f6668ba4700 1 -- 172.21.15.6:0/2691571033 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6644066f30 msgr2=0x7f66440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.130+0000 7f6668ba4700 1 --2- 172.21.15.6:0/2691571033 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6644066f30 0x7f66440693e0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f665c0011e0 tx=0x7f665c009040 comp rx=0 tx=0).stop 2023-10-06T02:30:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.130+0000 7f6668ba4700 1 -- 172.21.15.6:0/2691571033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6664142df0 msgr2=0x7f6664141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.130+0000 7f6668ba4700 1 --2- 172.21.15.6:0/2691571033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6664142df0 0x7f6664141fa0 secure :-1 s=READY pgs=2596 cs=0 l=1 rev1=1 crypto rx=0x7f665400b6c0 tx=0x7f6654019000 comp rx=0 tx=0).stop 2023-10-06T02:30:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.130+0000 7f6662d9d700 1 -- 172.21.15.6:0/2691571033 reap_dead start 2023-10-06T02:30:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.130+0000 7f6668ba4700 1 -- 172.21.15.6:0/2691571033 shutdown_connections 2023-10-06T02:30:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.130+0000 7f6668ba4700 1 -- 172.21.15.6:0/2691571033 >> 172.21.15.6:0/2691571033 conn(0x7f66640690f0 msgr2=0x7f6664153680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.130+0000 7f6668ba4700 1 -- 172.21.15.6:0/2691571033 shutdown_connections 2023-10-06T02:30:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.130+0000 7f6668ba4700 1 -- 172.21.15.6:0/2691571033 wait complete. 2023-10-06T02:30:52.143 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T02:30:52.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.262+0000 7f67901c3700 1 Processor -- start 2023-10-06T02:30:52.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.263+0000 7f67901c3700 1 -- start start 2023-10-06T02:30:52.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.263+0000 7f67901c3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f678815a030 0x7f678815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.263+0000 7f67901c3700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6788087700 0x7f67880b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.263+0000 7f67901c3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67880afc50 con 0x7f678815a940 2023-10-06T02:30:52.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.263+0000 7f67901c3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67880b0cf0 con 0x7f678815a030 2023-10-06T02:30:52.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.263+0000 7f67901c3700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67880aff30 con 0x7f6788087700 2023-10-06T02:30:52.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.264+0000 7f678df5f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f678815a030 0x7f678815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.264+0000 7f678d75e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f678815a940 0x7f6788086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44626/0 (socket says 172.21.15.6:44626) 2023-10-06T02:30:52.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.264+0000 7f678d75e700 1 -- 172.21.15.6:0/3823948178 learned_addr learned my addr 172.21.15.6:0/3823948178 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:52.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.264+0000 7f678e760700 1 --2- 172.21.15.6:0/3823948178 >> v2:172.21.15.175:3300/0 conn(0x7f6788087700 0x7f67880b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.264+0000 7f678df5f700 1 -- 172.21.15.6:0/3823948178 >> v2:172.21.15.175:3300/0 conn(0x7f6788087700 msgr2=0x7f67880b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:52.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.264+0000 7f678df5f700 1 --2- 172.21.15.6:0/3823948178 >> v2:172.21.15.175:3300/0 conn(0x7f6788087700 0x7f67880b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.264+0000 7f678df5f700 1 -- 172.21.15.6:0/3823948178 >> v1:172.21.15.6:6789/0 conn(0x7f678815a940 legacy=0x7f6788086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.264+0000 7f678df5f700 1 -- 172.21.15.6:0/3823948178 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67880b0210 con 0x7f678815a030 2023-10-06T02:30:52.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.264+0000 7f678cf5d700 1 -- 172.21.15.6:0/3823948178 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491177543 0 0) 0x7f67880afc50 con 0x7f678815a940 2023-10-06T02:30:52.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.264+0000 7f678df5f700 1 --2- 172.21.15.6:0/3823948178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f678815a030 0x7f678815a400 secure :-1 s=READY pgs=2598 cs=0 l=1 rev1=1 crypto rx=0x7f67880cdd90 tx=0x7f6780009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2897b2b15c7f377 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:52.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.264+0000 7f678cf5d700 1 -- 172.21.15.6:0/3823948178 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678000e070 con 0x7f678815a030 2023-10-06T02:30:52.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.264+0000 7f678cf5d700 1 -- 172.21.15.6:0/3823948178 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678000bb60 con 0x7f678815a030 2023-10-06T02:30:52.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.264+0000 7f678cf5d700 1 -- 172.21.15.6:0/3823948178 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780012430 con 0x7f678815a030 2023-10-06T02:30:52.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.265+0000 7f67901c3700 1 -- 172.21.15.6:0/3823948178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f678815a030 msgr2=0x7f678815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.265+0000 7f67901c3700 1 --2- 172.21.15.6:0/3823948178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f678815a030 0x7f678815a400 secure :-1 s=READY pgs=2598 cs=0 l=1 rev1=1 crypto rx=0x7f67880cdd90 tx=0x7f6780009780 comp rx=0 tx=0).stop 2023-10-06T02:30:52.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.265+0000 7f67901c3700 1 -- 172.21.15.6:0/3823948178 shutdown_connections 2023-10-06T02:30:52.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.265+0000 7f67901c3700 1 --2- 172.21.15.6:0/3823948178 >> v2:172.21.15.175:3300/0 conn(0x7f6788087700 0x7f67880b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.265+0000 7f67901c3700 1 --2- 172.21.15.6:0/3823948178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f678815a030 0x7f678815a400 unknown :-1 s=CLOSED pgs=2598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.265+0000 7f67901c3700 1 -- 172.21.15.6:0/3823948178 >> 172.21.15.6:0/3823948178 conn(0x7f6788068680 msgr2=0x7f6788068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:52.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.265+0000 7f67901c3700 1 -- 172.21.15.6:0/3823948178 shutdown_connections 2023-10-06T02:30:52.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.265+0000 7f67901c3700 1 -- 172.21.15.6:0/3823948178 wait complete. 2023-10-06T02:30:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.266+0000 7f67901c3700 1 Processor -- start 2023-10-06T02:30:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.266+0000 7f67901c3700 1 -- start start 2023-10-06T02:30:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f67901c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6788087700 0x7f67880c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f67901c3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f678815a030 0x7f678816d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f67901c3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f678815a940 0x7f678816db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f67901c3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67880c5140 con 0x7f6788087700 2023-10-06T02:30:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f67901c3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67880c4530 con 0x7f678815a030 2023-10-06T02:30:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f67901c3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67880c4810 con 0x7f678815a940 2023-10-06T02:30:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f678df5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6788087700 0x7f67880c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f678df5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6788087700 0x7f67880c3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44740/0 (socket says 172.21.15.6:44740) 2023-10-06T02:30:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f678df5f700 1 -- 172.21.15.6:0/1155818711 learned_addr learned my addr 172.21.15.6:0/1155818711 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f678e760700 1 --2- 172.21.15.6:0/1155818711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f678815a940 0x7f678816db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f678d75e700 1 --2- 172.21.15.6:0/1155818711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f678815a030 0x7f678816d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f678df5f700 1 -- 172.21.15.6:0/1155818711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f678815a940 msgr2=0x7f678816db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f678df5f700 1 --2- 172.21.15.6:0/1155818711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f678815a940 0x7f678816db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f678df5f700 1 -- 172.21.15.6:0/1155818711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f678815a030 msgr2=0x7f678816d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f678df5f700 1 --2- 172.21.15.6:0/1155818711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f678815a030 0x7f678816d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f678df5f700 1 -- 172.21.15.6:0/1155818711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6780009a20 con 0x7f6788087700 2023-10-06T02:30:52.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f678d75e700 1 --2- 172.21.15.6:0/1155818711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f678815a030 0x7f678816d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:52.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f678df5f700 1 --2- 172.21.15.6:0/1155818711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6788087700 0x7f67880c3bc0 secure :-1 s=READY pgs=2599 cs=0 l=1 rev1=1 crypto rx=0x7f67800099f0 tx=0x7f6780019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:52.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.267+0000 7f6785ffb700 1 -- 172.21.15.6:0/1155818711 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780012d40 con 0x7f6788087700 2023-10-06T02:30:52.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.268+0000 7f6785ffb700 1 -- 172.21.15.6:0/1155818711 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6780027470 con 0x7f6788087700 2023-10-06T02:30:52.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.268+0000 7f67901c3700 1 -- 172.21.15.6:0/1155818711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67880c4af0 con 0x7f6788087700 2023-10-06T02:30:52.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.268+0000 7f6785ffb700 1 -- 172.21.15.6:0/1155818711 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780012ea0 con 0x7f6788087700 2023-10-06T02:30:52.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.268+0000 7f67901c3700 1 -- 172.21.15.6:0/1155818711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67880c4100 con 0x7f6788087700 2023-10-06T02:30:52.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.269+0000 7f67901c3700 1 -- 172.21.15.6:0/1155818711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6788088700 con 0x7f6788087700 2023-10-06T02:30:52.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.269+0000 7f6785ffb700 1 -- 172.21.15.6:0/1155818711 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6780024070 con 0x7f6788087700 2023-10-06T02:30:52.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.269+0000 7f6785ffb700 1 --2- 172.21.15.6:0/1155818711 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6774066f30 0x7f67740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.270+0000 7f6785ffb700 1 -- 172.21.15.6:0/1155818711 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f6780086bd0 con 0x7f6788087700 2023-10-06T02:30:52.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.270+0000 7f678d75e700 1 --2- 172.21.15.6:0/1155818711 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6774066f30 0x7f67740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.270+0000 7f678d75e700 1 --2- 172.21.15.6:0/1155818711 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6774066f30 0x7f67740693e0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f6788167c10 tx=0x7f677c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:52.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.274+0000 7f6785ffb700 1 -- 172.21.15.6:0/1155818711 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6780053da0 con 0x7f6788087700 2023-10-06T02:30:52.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.468+0000 7f67901c3700 1 -- 172.21.15.6:0/1155818711 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f67880c5280 con 0x7f6774066f30 2023-10-06T02:30:52.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.469+0000 7f6785ffb700 1 -- 172.21.15.6:0/1155818711 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f677c001470 con 0x7f6774066f30 2023-10-06T02:30:52.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.471+0000 7f67901c3700 1 -- 172.21.15.6:0/1155818711 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6774066f30 msgr2=0x7f67740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.471+0000 7f67901c3700 1 --2- 172.21.15.6:0/1155818711 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6774066f30 0x7f67740693e0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f6788167c10 tx=0x7f677c009040 comp rx=0 tx=0).stop 2023-10-06T02:30:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.471+0000 7f67901c3700 1 -- 172.21.15.6:0/1155818711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6788087700 msgr2=0x7f67880c3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.471+0000 7f67901c3700 1 --2- 172.21.15.6:0/1155818711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6788087700 0x7f67880c3bc0 secure :-1 s=READY pgs=2599 cs=0 l=1 rev1=1 crypto rx=0x7f67800099f0 tx=0x7f6780019000 comp rx=0 tx=0).stop 2023-10-06T02:30:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.471+0000 7f67901c3700 1 -- 172.21.15.6:0/1155818711 shutdown_connections 2023-10-06T02:30:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.471+0000 7f67901c3700 1 --2- 172.21.15.6:0/1155818711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f678815a940 0x7f678816db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.471+0000 7f67901c3700 1 --2- 172.21.15.6:0/1155818711 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6774066f30 0x7f67740693e0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.471+0000 7f67901c3700 1 --2- 172.21.15.6:0/1155818711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6788087700 0x7f67880c3bc0 unknown :-1 s=CLOSED pgs=2599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.471+0000 7f67901c3700 1 --2- 172.21.15.6:0/1155818711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f678815a030 0x7f678816d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.471+0000 7f67901c3700 1 -- 172.21.15.6:0/1155818711 >> 172.21.15.6:0/1155818711 conn(0x7f6788068680 msgr2=0x7f67880b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.471+0000 7f67901c3700 1 -- 172.21.15.6:0/1155818711 shutdown_connections 2023-10-06T02:30:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.471+0000 7f67901c3700 1 -- 172.21.15.6:0/1155818711 wait complete. 2023-10-06T02:30:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T02:30:52.484 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T02:30:52.484 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:30:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.605+0000 7f9cad747700 1 Processor -- start 2023-10-06T02:30:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.605+0000 7f9cad747700 1 -- start start 2023-10-06T02:30:52.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.606+0000 7f9cad747700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ca81598b0 0x7f9ca80afef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.606+0000 7f9cad747700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ca80b0430 0x7f9ca815b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.606+0000 7f9cad747700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca80afa60 con 0x7f9ca815b770 2023-10-06T02:30:52.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.606+0000 7f9cad747700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca815bbf0 con 0x7f9ca81598b0 2023-10-06T02:30:52.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.606+0000 7f9cad747700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca80af440 con 0x7f9ca80b0430 2023-10-06T02:30:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.607+0000 7f9ca6ffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ca81598b0 0x7f9ca80afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.607+0000 7f9ca67fc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ca80b0430 0x7f9ca815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.607+0000 7f9ca77fe700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f9ca815b770 0x7f9ca8159c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:37860/0 (socket says 172.21.15.6:37860) 2023-10-06T02:30:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.607+0000 7f9ca77fe700 1 -- 172.21.15.6:0/2853656240 learned_addr learned my addr 172.21.15.6:0/2853656240 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.607+0000 7f9ca6ffd700 1 -- 172.21.15.6:0/2853656240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ca80b0430 msgr2=0x7f9ca815b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.607+0000 7f9ca6ffd700 1 --2- 172.21.15.6:0/2853656240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ca80b0430 0x7f9ca815b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.607+0000 7f9ca6ffd700 1 -- 172.21.15.6:0/2853656240 >> v1:172.21.15.175:6789/0 conn(0x7f9ca815b770 legacy=0x7f9ca8159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.607+0000 7f9ca6ffd700 1 -- 172.21.15.6:0/2853656240 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca815ab00 con 0x7f9ca81598b0 2023-10-06T02:30:52.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.607+0000 7f9ca5ffb700 1 -- 172.21.15.6:0/2853656240 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922326908 0 0) 0x7f9ca80afa60 con 0x7f9ca815b770 2023-10-06T02:30:52.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.607+0000 7f9ca6ffd700 1 --2- 172.21.15.6:0/2853656240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ca81598b0 0x7f9ca80afef0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009eb0 tx=0x7f9c98009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebdf44876e9ee9c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:52.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.607+0000 7f9ca5ffb700 1 -- 172.21.15.6:0/2853656240 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9800e070 con 0x7f9ca81598b0 2023-10-06T02:30:52.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.607+0000 7f9ca5ffb700 1 -- 172.21.15.6:0/2853656240 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9800bc30 con 0x7f9ca81598b0 2023-10-06T02:30:52.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.607+0000 7f9ca5ffb700 1 -- 172.21.15.6:0/2853656240 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c98012430 con 0x7f9ca81598b0 2023-10-06T02:30:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.608+0000 7f9cad747700 1 -- 172.21.15.6:0/2853656240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ca81598b0 msgr2=0x7f9ca80afef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.608+0000 7f9cad747700 1 --2- 172.21.15.6:0/2853656240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ca81598b0 0x7f9ca80afef0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009eb0 tx=0x7f9c98009780 comp rx=0 tx=0).stop 2023-10-06T02:30:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.608+0000 7f9cad747700 1 -- 172.21.15.6:0/2853656240 shutdown_connections 2023-10-06T02:30:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.608+0000 7f9cad747700 1 --2- 172.21.15.6:0/2853656240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ca81598b0 0x7f9ca80afef0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.608+0000 7f9cad747700 1 --2- 172.21.15.6:0/2853656240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ca80b0430 0x7f9ca815b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.608+0000 7f9cad747700 1 -- 172.21.15.6:0/2853656240 >> 172.21.15.6:0/2853656240 conn(0x7f9ca8067910 msgr2=0x7f9ca80ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.608+0000 7f9cad747700 1 -- 172.21.15.6:0/2853656240 shutdown_connections 2023-10-06T02:30:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.608+0000 7f9cad747700 1 -- 172.21.15.6:0/2853656240 wait complete. 2023-10-06T02:30:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.609+0000 7f9cad747700 1 Processor -- start 2023-10-06T02:30:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.609+0000 7f9cad747700 1 -- start start 2023-10-06T02:30:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.610+0000 7f9cad747700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ca80b0430 0x7f9ca809abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.610+0000 7f9cad747700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ca81598b0 0x7f9ca80c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.610+0000 7f9cad747700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca815b770 0x7f9ca80c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.610+0000 7f9cad747700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca80c4170 con 0x7f9ca815b770 2023-10-06T02:30:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.610+0000 7f9cad747700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca80c3560 con 0x7f9ca80b0430 2023-10-06T02:30:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.610+0000 7f9cad747700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca80c3840 con 0x7f9ca81598b0 2023-10-06T02:30:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.610+0000 7f9ca77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca815b770 0x7f9ca80c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.610+0000 7f9ca77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca815b770 0x7f9ca80c4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44756/0 (socket says 172.21.15.6:44756) 2023-10-06T02:30:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.610+0000 7f9ca77fe700 1 -- 172.21.15.6:0/2395714075 learned_addr learned my addr 172.21.15.6:0/2395714075 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.610+0000 7f9ca6ffd700 1 --2- 172.21.15.6:0/2395714075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ca80b0430 0x7f9ca809abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.610+0000 7f9ca67fc700 1 --2- 172.21.15.6:0/2395714075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ca81598b0 0x7f9ca80c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.611+0000 7f9ca77fe700 1 -- 172.21.15.6:0/2395714075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ca81598b0 msgr2=0x7f9ca80c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.611+0000 7f9ca77fe700 1 --2- 172.21.15.6:0/2395714075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ca81598b0 0x7f9ca80c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.611+0000 7f9ca77fe700 1 -- 172.21.15.6:0/2395714075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ca80b0430 msgr2=0x7f9ca809abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.611+0000 7f9ca77fe700 1 --2- 172.21.15.6:0/2395714075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ca80b0430 0x7f9ca809abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.611+0000 7f9ca77fe700 1 -- 172.21.15.6:0/2395714075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c98009a20 con 0x7f9ca815b770 2023-10-06T02:30:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.611+0000 7f9ca67fc700 1 --2- 172.21.15.6:0/2395714075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ca81598b0 0x7f9ca80c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.611+0000 7f9ca6ffd700 1 --2- 172.21.15.6:0/2395714075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ca80b0430 0x7f9ca809abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.611+0000 7f9ca77fe700 1 --2- 172.21.15.6:0/2395714075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca815b770 0x7f9ca80c4600 secure :-1 s=READY pgs=2600 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000c530 tx=0x7f9ca0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.611+0000 7f9c9effd700 1 -- 172.21.15.6:0/2395714075 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0005b30 con 0x7f9ca815b770 2023-10-06T02:30:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.611+0000 7f9c9effd700 1 -- 172.21.15.6:0/2395714075 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca0005c90 con 0x7f9ca815b770 2023-10-06T02:30:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.611+0000 7f9cad747700 1 -- 172.21.15.6:0/2395714075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca80c3b20 con 0x7f9ca815b770 2023-10-06T02:30:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.611+0000 7f9c9effd700 1 -- 172.21.15.6:0/2395714075 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0007320 con 0x7f9ca815b770 2023-10-06T02:30:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.611+0000 7f9cad747700 1 -- 172.21.15.6:0/2395714075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca80c4b40 con 0x7f9ca815b770 2023-10-06T02:30:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.612+0000 7f9cad747700 1 -- 172.21.15.6:0/2395714075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ca8068420 con 0x7f9ca815b770 2023-10-06T02:30:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.612+0000 7f9c9effd700 1 -- 172.21.15.6:0/2395714075 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ca001b3b0 con 0x7f9ca815b770 2023-10-06T02:30:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.613+0000 7f9c9effd700 1 --2- 172.21.15.6:0/2395714075 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c88066f30 0x7f9c880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.613+0000 7f9c9effd700 1 -- 172.21.15.6:0/2395714075 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f9ca0083ab0 con 0x7f9ca815b770 2023-10-06T02:30:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.613+0000 7f9c9effd700 1 --2- 172.21.15.6:0/2395714075 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x7f9c8806d870 0x7f9c8806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.613+0000 7f9c9effd700 1 -- 172.21.15.6:0/2395714075 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c88070370 con 0x7f9c8806d870 2023-10-06T02:30:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.613+0000 7f9c9effd700 1 -- 172.21.15.6:0/2395714075 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=152) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ca0088240 con 0x7f9ca815b770 2023-10-06T02:30:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.613+0000 7f9ca6ffd700 1 --2- 172.21.15.6:0/2395714075 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c88066f30 0x7f9c880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.613+0000 7f9ca67fc700 1 --2- 172.21.15.6:0/2395714075 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x7f9c8806d870 0x7f9c8806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.614+0000 7f9ca67fc700 1 --2- 172.21.15.6:0/2395714075 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x7f9c8806d870 0x7f9c8806fca0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:52.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.614+0000 7f9ca6ffd700 1 --2- 172.21.15.6:0/2395714075 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c88066f30 0x7f9c880693e0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009eb0 tx=0x7f9c98019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:52.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.614+0000 7f9c9effd700 1 -- 172.21.15.6:0/2395714075 <== osd.2 v2:172.21.15.6:6808/90680 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9c88070370 con 0x7f9c8806d870 2023-10-06T02:30:52.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.628+0000 7f9cad747700 1 -- 172.21.15.6:0/2395714075 --> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9ca80c39b0 con 0x7f9c8806d870 2023-10-06T02:30:52.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.629+0000 7f9c9effd700 1 -- 172.21.15.6:0/2395714075 <== osd.2 v2:172.21.15.6:6808/90680 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9ca80c39b0 con 0x7f9c8806d870 2023-10-06T02:30:52.629 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:30:52.629 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T02:30:52.630 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:30:52.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.629+0000 7f9cad747700 1 -- 172.21.15.6:0/2395714075 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x7f9c8806d870 msgr2=0x7f9c8806fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.629+0000 7f9cad747700 1 --2- 172.21.15.6:0/2395714075 >> [v2:172.21.15.6:6808/90680,v1:172.21.15.6:6809/90680] conn(0x7f9c8806d870 0x7f9c8806fca0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.629+0000 7f9cad747700 1 -- 172.21.15.6:0/2395714075 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c88066f30 msgr2=0x7f9c880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.629+0000 7f9cad747700 1 --2- 172.21.15.6:0/2395714075 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9c88066f30 0x7f9c880693e0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009eb0 tx=0x7f9c98019000 comp rx=0 tx=0).stop 2023-10-06T02:30:52.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.629+0000 7f9cad747700 1 -- 172.21.15.6:0/2395714075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca815b770 msgr2=0x7f9ca80c4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.629+0000 7f9cad747700 1 --2- 172.21.15.6:0/2395714075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca815b770 0x7f9ca80c4600 secure :-1 s=READY pgs=2600 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000c530 tx=0x7f9ca0007f90 comp rx=0 tx=0).stop 2023-10-06T02:30:52.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.629+0000 7f9ca77fe700 1 -- 172.21.15.6:0/2395714075 reap_dead start 2023-10-06T02:30:52.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.629+0000 7f9cad747700 1 -- 172.21.15.6:0/2395714075 shutdown_connections 2023-10-06T02:30:52.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.629+0000 7f9cad747700 1 -- 172.21.15.6:0/2395714075 >> 172.21.15.6:0/2395714075 conn(0x7f9ca8067910 msgr2=0x7f9ca80b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:52.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.629+0000 7f9cad747700 1 -- 172.21.15.6:0/2395714075 shutdown_connections 2023-10-06T02:30:52.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.629+0000 7f9cad747700 1 -- 172.21.15.6:0/2395714075 wait complete. 2023-10-06T02:30:52.641 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T02:30:52.714 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:30:52.717 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:30:52.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.762+0000 7f948f07e700 1 Processor -- start 2023-10-06T02:30:52.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.762+0000 7f948f07e700 1 -- start start 2023-10-06T02:30:52.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.763+0000 7f948f07e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f94880b28c0 0x7f9488087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.763+0000 7f948f07e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94880afc50 con 0x7f948815a030 2023-10-06T02:30:52.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.763+0000 7f948f07e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94880aff30 con 0x7f9488086ff0 2023-10-06T02:30:52.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.763+0000 7f948f07e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94880b0cf0 con 0x7f94880b28c0 2023-10-06T02:30:52.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.763+0000 7f948ce1a700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f948815a030 0x7f948815a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44628/0 (socket says 172.21.15.6:44628) 2023-10-06T02:30:52.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.763+0000 7f948ce1a700 1 -- 172.21.15.6:0/3258808372 learned_addr learned my addr 172.21.15.6:0/3258808372 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.763+0000 7f948d61b700 1 --2- 172.21.15.6:0/3258808372 >> v2:172.21.15.175:3300/0 conn(0x7f94880b28c0 0x7f9488087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.763+0000 7f94877fe700 1 -- 172.21.15.6:0/3258808372 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782312401 0 0) 0x7f94880afc50 con 0x7f948815a030 2023-10-06T02:30:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.763+0000 7f94877fe700 1 -- 172.21.15.6:0/3258808372 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9478003570 con 0x7f948815a030 2023-10-06T02:30:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.763+0000 7f94877fe700 1 -- 172.21.15.6:0/3258808372 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385888563 0 0) 0x7f94880aff30 con 0x7f9488086ff0 2023-10-06T02:30:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.763+0000 7f94877fe700 1 -- 172.21.15.6:0/3258808372 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94880afc50 con 0x7f9488086ff0 2023-10-06T02:30:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.763+0000 7f94877fe700 1 -- 172.21.15.6:0/3258808372 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3562098778 0 0) 0x7f9478003570 con 0x7f948815a030 2023-10-06T02:30:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.763+0000 7f948d61b700 1 -- 172.21.15.6:0/3258808372 >> v1:172.21.15.175:6789/0 conn(0x7f9488086ff0 legacy=0x7f94880b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.763+0000 7f948d61b700 1 -- 172.21.15.6:0/3258808372 >> v1:172.21.15.6:6789/0 conn(0x7f948815a030 legacy=0x7f948815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.763+0000 7f948d61b700 1 -- 172.21.15.6:0/3258808372 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94880b0210 con 0x7f94880b28c0 2023-10-06T02:30:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.763+0000 7f948d61b700 1 --2- 172.21.15.6:0/3258808372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94880b28c0 0x7f9488087470 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9480009e60 tx=0x7f9480009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac8fe11001c4fcd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:52.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.764+0000 7f94877fe700 1 -- 172.21.15.6:0/3258808372 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948000e070 con 0x7f94880b28c0 2023-10-06T02:30:52.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.764+0000 7f94877fe700 1 -- 172.21.15.6:0/3258808372 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948000b7a0 con 0x7f94880b28c0 2023-10-06T02:30:52.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.764+0000 7f94877fe700 1 -- 172.21.15.6:0/3258808372 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c001470 con 0x7f94880b28c0 2023-10-06T02:30:52.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.764+0000 7f948f07e700 1 -- 172.21.15.6:0/3258808372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94880b28c0 msgr2=0x7f9488087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.764+0000 7f948f07e700 1 --2- 172.21.15.6:0/3258808372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94880b28c0 0x7f9488087470 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9480009e60 tx=0x7f9480009780 comp rx=0 tx=0).stop 2023-10-06T02:30:52.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.764+0000 7f948f07e700 1 -- 172.21.15.6:0/3258808372 shutdown_connections 2023-10-06T02:30:52.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.764+0000 7f948f07e700 1 --2- 172.21.15.6:0/3258808372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94880b28c0 0x7f9488087470 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.764+0000 7f948f07e700 1 -- 172.21.15.6:0/3258808372 >> 172.21.15.6:0/3258808372 conn(0x7f9488068680 msgr2=0x7f9488068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:52.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.764+0000 7f948f07e700 1 -- 172.21.15.6:0/3258808372 shutdown_connections 2023-10-06T02:30:52.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.764+0000 7f948f07e700 1 -- 172.21.15.6:0/3258808372 wait complete. 2023-10-06T02:30:52.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.765+0000 7f948f07e700 1 Processor -- start 2023-10-06T02:30:52.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.766+0000 7f948f07e700 1 -- start start 2023-10-06T02:30:52.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.766+0000 7f948f07e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9488086ff0 0x7f948816d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.766+0000 7f948f07e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94880b28c0 0x7f948816da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.766+0000 7f948f07e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948815a030 0x7f94880c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.766+0000 7f948f07e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948816b840 con 0x7f948815a030 2023-10-06T02:30:52.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.766+0000 7f948f07e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948816b4f0 con 0x7f94880b28c0 2023-10-06T02:30:52.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.766+0000 7f948f07e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94880c5f90 con 0x7f9488086ff0 2023-10-06T02:30:52.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.766+0000 7f948d61b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948815a030 0x7f94880c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.766+0000 7f948d61b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948815a030 0x7f94880c5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44766/0 (socket says 172.21.15.6:44766) 2023-10-06T02:30:52.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.766+0000 7f948d61b700 1 -- 172.21.15.6:0/3929181759 learned_addr learned my addr 172.21.15.6:0/3929181759 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:52.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.767+0000 7f948ce1a700 1 --2- 172.21.15.6:0/3929181759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9488086ff0 0x7f948816d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.767+0000 7f9487fff700 1 --2- 172.21.15.6:0/3929181759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94880b28c0 0x7f948816da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.767+0000 7f948d61b700 1 -- 172.21.15.6:0/3929181759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9488086ff0 msgr2=0x7f948816d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.767+0000 7f948d61b700 1 --2- 172.21.15.6:0/3929181759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9488086ff0 0x7f948816d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.767+0000 7f948d61b700 1 -- 172.21.15.6:0/3929181759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94880b28c0 msgr2=0x7f948816da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.767+0000 7f948d61b700 1 --2- 172.21.15.6:0/3929181759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94880b28c0 0x7f948816da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.767+0000 7f948d61b700 1 -- 172.21.15.6:0/3929181759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9480009a20 con 0x7f948815a030 2023-10-06T02:30:52.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.767+0000 7f948ce1a700 1 --2- 172.21.15.6:0/3929181759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9488086ff0 0x7f948816d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:52.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.767+0000 7f9487fff700 1 --2- 172.21.15.6:0/3929181759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94880b28c0 0x7f948816da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:52.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.767+0000 7f948d61b700 1 --2- 172.21.15.6:0/3929181759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948815a030 0x7f94880c5090 secure :-1 s=READY pgs=2602 cs=0 l=1 rev1=1 crypto rx=0x7f94800099f0 tx=0x7f9480017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:52.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.767+0000 7f9484ff9700 1 -- 172.21.15.6:0/3929181759 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480012d60 con 0x7f948815a030 2023-10-06T02:30:52.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.767+0000 7f9484ff9700 1 -- 172.21.15.6:0/3929181759 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948001e450 con 0x7f948815a030 2023-10-06T02:30:52.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.767+0000 7f948f07e700 1 -- 172.21.15.6:0/3929181759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94880c6270 con 0x7f948815a030 2023-10-06T02:30:52.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.767+0000 7f9484ff9700 1 -- 172.21.15.6:0/3929181759 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948001e810 con 0x7f948815a030 2023-10-06T02:30:52.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.767+0000 7f948f07e700 1 -- 172.21.15.6:0/3929181759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94880c55d0 con 0x7f948815a030 2023-10-06T02:30:52.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.768+0000 7f948f07e700 1 -- 172.21.15.6:0/3929181759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948816b9b0 con 0x7f948815a030 2023-10-06T02:30:52.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.768+0000 7f9484ff9700 1 -- 172.21.15.6:0/3929181759 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f948001ebc0 con 0x7f948815a030 2023-10-06T02:30:52.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.769+0000 7f9484ff9700 1 --2- 172.21.15.6:0/3929181759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f946c066f30 0x7f946c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:52.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.769+0000 7f9484ff9700 1 -- 172.21.15.6:0/3929181759 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f9480086440 con 0x7f948815a030 2023-10-06T02:30:52.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.769+0000 7f948ce1a700 1 --2- 172.21.15.6:0/3929181759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f946c066f30 0x7f946c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:52.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.770+0000 7f948ce1a700 1 --2- 172.21.15.6:0/3929181759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f946c066f30 0x7f946c0693e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f947c007ca0 tx=0x7f947c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:52.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.773+0000 7f9484ff9700 1 -- 172.21.15.6:0/3929181759 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94800536b0 con 0x7f948815a030 2023-10-06T02:30:52.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.969+0000 7f948f07e700 1 -- 172.21.15.6:0/3929181759 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f94880cafc0 con 0x7f946c066f30 2023-10-06T02:30:52.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.970+0000 7f9484ff9700 1 -- 172.21.15.6:0/3929181759 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f94880cafc0 con 0x7f946c066f30 2023-10-06T02:30:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.972+0000 7f948f07e700 1 -- 172.21.15.6:0/3929181759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f946c066f30 msgr2=0x7f946c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.972+0000 7f948f07e700 1 --2- 172.21.15.6:0/3929181759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f946c066f30 0x7f946c0693e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f947c007ca0 tx=0x7f947c009040 comp rx=0 tx=0).stop 2023-10-06T02:30:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.972+0000 7f948f07e700 1 -- 172.21.15.6:0/3929181759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948815a030 msgr2=0x7f94880c5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.972+0000 7f948f07e700 1 --2- 172.21.15.6:0/3929181759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948815a030 0x7f94880c5090 secure :-1 s=READY pgs=2602 cs=0 l=1 rev1=1 crypto rx=0x7f94800099f0 tx=0x7f9480017000 comp rx=0 tx=0).stop 2023-10-06T02:30:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.972+0000 7f948f07e700 1 -- 172.21.15.6:0/3929181759 shutdown_connections 2023-10-06T02:30:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.972+0000 7f948f07e700 1 --2- 172.21.15.6:0/3929181759 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f946c066f30 0x7f946c0693e0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.972+0000 7f948f07e700 1 --2- 172.21.15.6:0/3929181759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948815a030 0x7f94880c5090 unknown :-1 s=CLOSED pgs=2602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.972+0000 7f948f07e700 1 --2- 172.21.15.6:0/3929181759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9488086ff0 0x7f948816d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.972+0000 7f948f07e700 1 --2- 172.21.15.6:0/3929181759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94880b28c0 0x7f948816da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:52.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.972+0000 7f948f07e700 1 -- 172.21.15.6:0/3929181759 >> 172.21.15.6:0/3929181759 conn(0x7f9488068680 msgr2=0x7f94880cc600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:52.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.972+0000 7f948f07e700 1 -- 172.21.15.6:0/3929181759 shutdown_connections 2023-10-06T02:30:52.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:52.972+0000 7f948f07e700 1 -- 172.21.15.6:0/3929181759 wait complete. 2023-10-06T02:30:52.974 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T02:30:52.985 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T02:30:52.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:30:53.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.106+0000 7f979d412700 1 Processor -- start 2023-10-06T02:30:53.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.106+0000 7f979d412700 1 -- start start 2023-10-06T02:30:53.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.107+0000 7f979d412700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97980cfa90 0x7f97980d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.107+0000 7f979d412700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f97980d07a0 0x7f9798163060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.107+0000 7f979d412700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979815a710 con 0x7f9798142df0 2023-10-06T02:30:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.107+0000 7f979d412700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97980d0be0 con 0x7f97980cfa90 2023-10-06T02:30:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.107+0000 7f979d412700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9798159b40 con 0x7f97980d07a0 2023-10-06T02:30:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.107+0000 7f97967fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97980cfa90 0x7f97980d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.107+0000 7f97967fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97980cfa90 0x7f97980d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44778/0 (socket says 172.21.15.6:44778) 2023-10-06T02:30:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.107+0000 7f97967fc700 1 -- 172.21.15.6:0/2132937167 learned_addr learned my addr 172.21.15.6:0/2132937167 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.108+0000 7f97977fe700 1 --2- 172.21.15.6:0/2132937167 >> v2:172.21.15.175:3300/0 conn(0x7f97980d07a0 0x7f9798163060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.108+0000 7f97967fc700 1 -- 172.21.15.6:0/2132937167 >> v2:172.21.15.175:3300/0 conn(0x7f97980d07a0 msgr2=0x7f9798163060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.108+0000 7f97967fc700 1 --2- 172.21.15.6:0/2132937167 >> v2:172.21.15.175:3300/0 conn(0x7f97980d07a0 0x7f9798163060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.108+0000 7f97967fc700 1 -- 172.21.15.6:0/2132937167 >> v1:172.21.15.175:6789/0 conn(0x7f9798142df0 legacy=0x7f97980cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.108+0000 7f97967fc700 1 -- 172.21.15.6:0/2132937167 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9798159de0 con 0x7f97980cfa90 2023-10-06T02:30:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.108+0000 7f97977fe700 1 --2- 172.21.15.6:0/2132937167 >> v2:172.21.15.175:3300/0 conn(0x7f97980d07a0 0x7f9798163060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.108+0000 7f97967fc700 1 --2- 172.21.15.6:0/2132937167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97980cfa90 0x7f97980d0260 secure :-1 s=READY pgs=2603 cs=0 l=1 rev1=1 crypto rx=0x7f97800099b0 tx=0x7f9780009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a426a11f3b3de5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.108+0000 7f9795ffb700 1 -- 172.21.15.6:0/2132937167 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978000b7e0 con 0x7f97980cfa90 2023-10-06T02:30:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.108+0000 7f9795ffb700 1 -- 172.21.15.6:0/2132937167 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978000b940 con 0x7f97980cfa90 2023-10-06T02:30:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.108+0000 7f9795ffb700 1 -- 172.21.15.6:0/2132937167 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978000bce0 con 0x7f97980cfa90 2023-10-06T02:30:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.109+0000 7f979d412700 1 -- 172.21.15.6:0/2132937167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97980cfa90 msgr2=0x7f97980d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.109+0000 7f979d412700 1 --2- 172.21.15.6:0/2132937167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97980cfa90 0x7f97980d0260 secure :-1 s=READY pgs=2603 cs=0 l=1 rev1=1 crypto rx=0x7f97800099b0 tx=0x7f9780009250 comp rx=0 tx=0).stop 2023-10-06T02:30:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.109+0000 7f979d412700 1 -- 172.21.15.6:0/2132937167 shutdown_connections 2023-10-06T02:30:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.109+0000 7f979d412700 1 --2- 172.21.15.6:0/2132937167 >> v2:172.21.15.175:3300/0 conn(0x7f97980d07a0 0x7f9798163060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.109+0000 7f979d412700 1 --2- 172.21.15.6:0/2132937167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97980cfa90 0x7f97980d0260 unknown :-1 s=CLOSED pgs=2603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.109+0000 7f979d412700 1 -- 172.21.15.6:0/2132937167 >> 172.21.15.6:0/2132937167 conn(0x7f97980690f0 msgr2=0x7f979806a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:53.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.109+0000 7f979d412700 1 -- 172.21.15.6:0/2132937167 shutdown_connections 2023-10-06T02:30:53.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.109+0000 7f979d412700 1 -- 172.21.15.6:0/2132937167 wait complete. 2023-10-06T02:30:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.110+0000 7f979d412700 1 Processor -- start 2023-10-06T02:30:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.110+0000 7f979d412700 1 -- start start 2023-10-06T02:30:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f979d412700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97980cfa90 0x7f9798156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f979d412700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97980d07a0 0x7f97980b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f979d412700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9798142df0 0x7f97980b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f979d412700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97981399b0 con 0x7f97980cfa90 2023-10-06T02:30:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f979d412700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97980b23e0 con 0x7f9798142df0 2023-10-06T02:30:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f979d412700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97980b26c0 con 0x7f97980d07a0 2023-10-06T02:30:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f9796ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97980cfa90 0x7f9798156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f9796ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97980cfa90 0x7f9798156d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44788/0 (socket says 172.21.15.6:44788) 2023-10-06T02:30:53.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f9796ffd700 1 -- 172.21.15.6:0/4206311785 learned_addr learned my addr 172.21.15.6:0/4206311785 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:53.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f97977fe700 1 --2- 172.21.15.6:0/4206311785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9798142df0 0x7f97980b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f97967fc700 1 --2- 172.21.15.6:0/4206311785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97980d07a0 0x7f97980b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f9796ffd700 1 -- 172.21.15.6:0/4206311785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97980d07a0 msgr2=0x7f97980b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f9796ffd700 1 --2- 172.21.15.6:0/4206311785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97980d07a0 0x7f97980b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f9796ffd700 1 -- 172.21.15.6:0/4206311785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9798142df0 msgr2=0x7f97980b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f9796ffd700 1 --2- 172.21.15.6:0/4206311785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9798142df0 0x7f97980b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f9796ffd700 1 -- 172.21.15.6:0/4206311785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97800094f0 con 0x7f97980cfa90 2023-10-06T02:30:53.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f9796ffd700 1 --2- 172.21.15.6:0/4206311785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97980cfa90 0x7f9798156d70 secure :-1 s=READY pgs=2604 cs=0 l=1 rev1=1 crypto rx=0x7f979000c950 tx=0x7f9790002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:53.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f978effd700 1 -- 172.21.15.6:0/4206311785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790012630 con 0x7f97980cfa90 2023-10-06T02:30:53.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f978effd700 1 -- 172.21.15.6:0/4206311785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9790012790 con 0x7f97980cfa90 2023-10-06T02:30:53.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f979d412700 1 -- 172.21.15.6:0/4206311785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9798139bc0 con 0x7f97980cfa90 2023-10-06T02:30:53.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.111+0000 7f978effd700 1 -- 172.21.15.6:0/4206311785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790012b50 con 0x7f97980cfa90 2023-10-06T02:30:53.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.112+0000 7f979d412700 1 -- 172.21.15.6:0/4206311785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97980b29a0 con 0x7f97980cfa90 2023-10-06T02:30:53.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.112+0000 7f979d412700 1 -- 172.21.15.6:0/4206311785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9798088ad0 con 0x7f97980cfa90 2023-10-06T02:30:53.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.113+0000 7f978effd700 1 -- 172.21.15.6:0/4206311785 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f979001b400 con 0x7f97980cfa90 2023-10-06T02:30:53.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.113+0000 7f978effd700 1 --2- 172.21.15.6:0/4206311785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9778066f30 0x7f97780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.113+0000 7f978effd700 1 -- 172.21.15.6:0/4206311785 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f9790084f00 con 0x7f97980cfa90 2023-10-06T02:30:53.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.113+0000 7f978effd700 1 --2- 172.21.15.6:0/4206311785 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7f977806d8f0 0x7f977806fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.113+0000 7f978effd700 1 -- 172.21.15.6:0/4206311785 --> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97780703f0 con 0x7f977806d8f0 2023-10-06T02:30:53.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.113+0000 7f978effd700 1 -- 172.21.15.6:0/4206311785 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=152) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97900852d0 con 0x7f97980cfa90 2023-10-06T02:30:53.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.114+0000 7f97967fc700 1 --2- 172.21.15.6:0/4206311785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9778066f30 0x7f97780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.114+0000 7f97977fe700 1 --2- 172.21.15.6:0/4206311785 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7f977806d8f0 0x7f977806fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.114+0000 7f97977fe700 1 --2- 172.21.15.6:0/4206311785 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7f977806d8f0 0x7f977806fd20 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:53.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.114+0000 7f97967fc700 1 --2- 172.21.15.6:0/4206311785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9778066f30 0x7f97780693e0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f97800099b0 tx=0x7f9780016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:53.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.115+0000 7f978effd700 1 -- 172.21.15.6:0/4206311785 <== osd.3 v2:172.21.15.6:6824/90683 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f97780703f0 con 0x7f977806d8f0 2023-10-06T02:30:53.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.128+0000 7f979d412700 1 -- 172.21.15.6:0/4206311785 --> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f979815a0c0 con 0x7f977806d8f0 2023-10-06T02:30:53.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.129+0000 7f978effd700 1 -- 172.21.15.6:0/4206311785 <== osd.3 v2:172.21.15.6:6824/90683 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f979815a0c0 con 0x7f977806d8f0 2023-10-06T02:30:53.130 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:30:53.130 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T02:30:53.130 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:30:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.129+0000 7f979d412700 1 -- 172.21.15.6:0/4206311785 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7f977806d8f0 msgr2=0x7f977806fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.129+0000 7f979d412700 1 --2- 172.21.15.6:0/4206311785 >> [v2:172.21.15.6:6824/90683,v1:172.21.15.6:6825/90683] conn(0x7f977806d8f0 0x7f977806fd20 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.129+0000 7f979d412700 1 -- 172.21.15.6:0/4206311785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9778066f30 msgr2=0x7f97780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.129+0000 7f979d412700 1 --2- 172.21.15.6:0/4206311785 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9778066f30 0x7f97780693e0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f97800099b0 tx=0x7f9780016000 comp rx=0 tx=0).stop 2023-10-06T02:30:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.129+0000 7f979d412700 1 -- 172.21.15.6:0/4206311785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97980cfa90 msgr2=0x7f9798156d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.129+0000 7f979d412700 1 --2- 172.21.15.6:0/4206311785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97980cfa90 0x7f9798156d70 secure :-1 s=READY pgs=2604 cs=0 l=1 rev1=1 crypto rx=0x7f979000c950 tx=0x7f9790002760 comp rx=0 tx=0).stop 2023-10-06T02:30:53.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.129+0000 7f97977fe700 1 -- 172.21.15.6:0/4206311785 reap_dead start 2023-10-06T02:30:53.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.129+0000 7f979d412700 1 -- 172.21.15.6:0/4206311785 shutdown_connections 2023-10-06T02:30:53.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.129+0000 7f979d412700 1 -- 172.21.15.6:0/4206311785 >> 172.21.15.6:0/4206311785 conn(0x7f97980690f0 msgr2=0x7f97981582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:53.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.129+0000 7f979d412700 1 -- 172.21.15.6:0/4206311785 shutdown_connections 2023-10-06T02:30:53.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.129+0000 7f979d412700 1 -- 172.21.15.6:0/4206311785 wait complete. 2023-10-06T02:30:53.141 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T02:30:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.261+0000 7f390b59e700 1 Processor -- start 2023-10-06T02:30:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.261+0000 7f390b59e700 1 -- start start 2023-10-06T02:30:53.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.262+0000 7f390b59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c153a10 0x7f390c0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.262+0000 7f390b59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f390c0d05a0 0x7f390c15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.262+0000 7f390b59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c0ceea0 con 0x7f390c0cf870 2023-10-06T02:30:53.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.262+0000 7f390b59e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390c069140 con 0x7f390c0d05a0 2023-10-06T02:30:53.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.262+0000 7f390b59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c15a690 con 0x7f390c153a10 2023-10-06T02:30:53.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.262+0000 7f390a59c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c153a10 0x7f390c0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.262+0000 7f390ad9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f390c0d05a0 0x7f390c15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.262+0000 7f3909d9b700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f390c0cf870 0x7f390c0cfe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.6:37888/0 (socket says 172.21.15.6:37888) 2023-10-06T02:30:53.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.262+0000 7f3909d9b700 1 -- 172.21.15.6:0/929326301 learned_addr learned my addr 172.21.15.6:0/929326301 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:53.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.263+0000 7f390a59c700 1 -- 172.21.15.6:0/929326301 >> v2:172.21.15.175:3300/0 conn(0x7f390c0d05a0 msgr2=0x7f390c15abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:53.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.263+0000 7f390a59c700 1 --2- 172.21.15.6:0/929326301 >> v2:172.21.15.175:3300/0 conn(0x7f390c0d05a0 0x7f390c15abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.263+0000 7f390a59c700 1 -- 172.21.15.6:0/929326301 >> v1:172.21.15.175:6789/0 conn(0x7f390c0cf870 legacy=0x7f390c0cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.263+0000 7f390a59c700 1 -- 172.21.15.6:0/929326301 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c0ce850 con 0x7f390c153a10 2023-10-06T02:30:53.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.263+0000 7f390a59c700 1 --2- 172.21.15.6:0/929326301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c153a10 0x7f390c0cf330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3904009e60 tx=0x7f3904009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3048bc032d3c96b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:53.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.263+0000 7f390959a700 1 -- 172.21.15.6:0/929326301 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390400e070 con 0x7f390c153a10 2023-10-06T02:30:53.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.263+0000 7f390959a700 1 -- 172.21.15.6:0/929326301 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390400bb60 con 0x7f390c153a10 2023-10-06T02:30:53.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.263+0000 7f390959a700 1 -- 172.21.15.6:0/929326301 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904012430 con 0x7f390c153a10 2023-10-06T02:30:53.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.264+0000 7f390b59e700 1 -- 172.21.15.6:0/929326301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c153a10 msgr2=0x7f390c0cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.264+0000 7f390b59e700 1 --2- 172.21.15.6:0/929326301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c153a10 0x7f390c0cf330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3904009e60 tx=0x7f3904009780 comp rx=0 tx=0).stop 2023-10-06T02:30:53.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.264+0000 7f390b59e700 1 -- 172.21.15.6:0/929326301 shutdown_connections 2023-10-06T02:30:53.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.264+0000 7f390b59e700 1 --2- 172.21.15.6:0/929326301 >> v2:172.21.15.175:3300/0 conn(0x7f390c0d05a0 0x7f390c15abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.264+0000 7f390b59e700 1 --2- 172.21.15.6:0/929326301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c153a10 0x7f390c0cf330 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.264+0000 7f390b59e700 1 -- 172.21.15.6:0/929326301 >> 172.21.15.6:0/929326301 conn(0x7f390c06ac00 msgr2=0x7f390c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:53.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.264+0000 7f390b59e700 1 -- 172.21.15.6:0/929326301 shutdown_connections 2023-10-06T02:30:53.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.264+0000 7f390b59e700 1 -- 172.21.15.6:0/929326301 wait complete. 2023-10-06T02:30:53.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.265+0000 7f390b59e700 1 Processor -- start 2023-10-06T02:30:53.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.265+0000 7f390b59e700 1 -- start start 2023-10-06T02:30:53.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.265+0000 7f390b59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c0cf870 0x7f390c1505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.265+0000 7f390b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c0d05a0 0x7f390c156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.265+0000 7f390b59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f390c153a10 0x7f390c169a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.265+0000 7f390b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c154a90 con 0x7f390c0d05a0 2023-10-06T02:30:53.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.265+0000 7f390b59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c153e80 con 0x7f390c153a10 2023-10-06T02:30:53.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.265+0000 7f390b59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c154160 con 0x7f390c0cf870 2023-10-06T02:30:53.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.266+0000 7f3909d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c0d05a0 0x7f390c156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.266+0000 7f3909d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c0d05a0 0x7f390c156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44790/0 (socket says 172.21.15.6:44790) 2023-10-06T02:30:53.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.266+0000 7f3909d9b700 1 -- 172.21.15.6:0/3822015998 learned_addr learned my addr 172.21.15.6:0/3822015998 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:53.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.266+0000 7f390a59c700 1 --2- 172.21.15.6:0/3822015998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c0cf870 0x7f390c1505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.266+0000 7f390ad9d700 1 --2- 172.21.15.6:0/3822015998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f390c153a10 0x7f390c169a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.266+0000 7f3909d9b700 1 -- 172.21.15.6:0/3822015998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c0cf870 msgr2=0x7f390c1505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.266+0000 7f3909d9b700 1 --2- 172.21.15.6:0/3822015998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c0cf870 0x7f390c1505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.266+0000 7f3909d9b700 1 -- 172.21.15.6:0/3822015998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f390c153a10 msgr2=0x7f390c169a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.266+0000 7f3909d9b700 1 --2- 172.21.15.6:0/3822015998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f390c153a10 0x7f390c169a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.266+0000 7f3909d9b700 1 -- 172.21.15.6:0/3822015998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3904009a20 con 0x7f390c0d05a0 2023-10-06T02:30:53.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.266+0000 7f390a59c700 1 --2- 172.21.15.6:0/3822015998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c0cf870 0x7f390c1505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:53.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.266+0000 7f3909d9b700 1 --2- 172.21.15.6:0/3822015998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c0d05a0 0x7f390c156f20 secure :-1 s=READY pgs=2605 cs=0 l=1 rev1=1 crypto rx=0x7f38f400c7c0 tx=0x7f38f4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:53.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.266+0000 7f39027fc700 1 -- 172.21.15.6:0/3822015998 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4005b30 con 0x7f390c0d05a0 2023-10-06T02:30:53.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.266+0000 7f39027fc700 1 -- 172.21.15.6:0/3822015998 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f4005cb0 con 0x7f390c0d05a0 2023-10-06T02:30:53.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.266+0000 7f390b59e700 1 -- 172.21.15.6:0/3822015998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c154440 con 0x7f390c0d05a0 2023-10-06T02:30:53.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.266+0000 7f39027fc700 1 -- 172.21.15.6:0/3822015998 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4004a80 con 0x7f390c0d05a0 2023-10-06T02:30:53.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.266+0000 7f390b59e700 1 -- 172.21.15.6:0/3822015998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c1590f0 con 0x7f390c0d05a0 2023-10-06T02:30:53.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.267+0000 7f390b59e700 1 -- 172.21.15.6:0/3822015998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390c154c00 con 0x7f390c0d05a0 2023-10-06T02:30:53.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.268+0000 7f39027fc700 1 -- 172.21.15.6:0/3822015998 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f38f40070f0 con 0x7f390c0d05a0 2023-10-06T02:30:53.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.268+0000 7f39027fc700 1 --2- 172.21.15.6:0/3822015998 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38ec066f00 0x7f38ec0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.268+0000 7f39027fc700 1 -- 172.21.15.6:0/3822015998 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f38f4083940 con 0x7f390c0d05a0 2023-10-06T02:30:53.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.268+0000 7f390a59c700 1 --2- 172.21.15.6:0/3822015998 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38ec066f00 0x7f38ec0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.269+0000 7f390a59c700 1 --2- 172.21.15.6:0/3822015998 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38ec066f00 0x7f38ec0693b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f3904009e60 tx=0x7f3904019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:53.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.273+0000 7f39027fc700 1 -- 172.21.15.6:0/3822015998 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38f4050c30 con 0x7f390c0d05a0 2023-10-06T02:30:53.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.467+0000 7f390b59e700 1 -- 172.21.15.6:0/3822015998 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f390c15a970 con 0x7f38ec066f00 2023-10-06T02:30:53.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.468+0000 7f39027fc700 1 -- 172.21.15.6:0/3822015998 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f390c15a970 con 0x7f38ec066f00 2023-10-06T02:30:53.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.469+0000 7f390b59e700 1 -- 172.21.15.6:0/3822015998 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38ec066f00 msgr2=0x7f38ec0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.469+0000 7f390b59e700 1 --2- 172.21.15.6:0/3822015998 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38ec066f00 0x7f38ec0693b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f3904009e60 tx=0x7f3904019000 comp rx=0 tx=0).stop 2023-10-06T02:30:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.469+0000 7f390b59e700 1 -- 172.21.15.6:0/3822015998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c0d05a0 msgr2=0x7f390c156f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.469+0000 7f390b59e700 1 --2- 172.21.15.6:0/3822015998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c0d05a0 0x7f390c156f20 secure :-1 s=READY pgs=2605 cs=0 l=1 rev1=1 crypto rx=0x7f38f400c7c0 tx=0x7f38f4007f70 comp rx=0 tx=0).stop 2023-10-06T02:30:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.469+0000 7f390b59e700 1 -- 172.21.15.6:0/3822015998 shutdown_connections 2023-10-06T02:30:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.469+0000 7f390b59e700 1 --2- 172.21.15.6:0/3822015998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f390c153a10 0x7f390c169a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.469+0000 7f390b59e700 1 --2- 172.21.15.6:0/3822015998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c0cf870 0x7f390c1505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.469+0000 7f390b59e700 1 --2- 172.21.15.6:0/3822015998 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f38ec066f00 0x7f38ec0693b0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.469+0000 7f390b59e700 1 --2- 172.21.15.6:0/3822015998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c0d05a0 0x7f390c156f20 unknown :-1 s=CLOSED pgs=2605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.470+0000 7f390b59e700 1 -- 172.21.15.6:0/3822015998 >> 172.21.15.6:0/3822015998 conn(0x7f390c06ac00 msgr2=0x7f390c0b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.470+0000 7f390b59e700 1 -- 172.21.15.6:0/3822015998 shutdown_connections 2023-10-06T02:30:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.470+0000 7f390b59e700 1 -- 172.21.15.6:0/3822015998 wait complete. 2023-10-06T02:30:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T02:30:53.482 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T02:30:53.482 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:30:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.606+0000 7f467f59e700 1 Processor -- start 2023-10-06T02:30:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.606+0000 7f467f59e700 1 -- start start 2023-10-06T02:30:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.607+0000 7f467f59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4680158ff0 0x7f46800b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.607+0000 7f467f59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46800cfeb0 con 0x7f46801593c0 2023-10-06T02:30:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.607+0000 7f467f59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46800b6000 con 0x7f4680087700 2023-10-06T02:30:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.607+0000 7f467f59e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46800cf2a0 con 0x7f4680158ff0 2023-10-06T02:30:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.607+0000 7f467dd9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f46801593c0 0x7f4680086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44630/0 (socket says 172.21.15.6:44630) 2023-10-06T02:30:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.607+0000 7f467dd9b700 1 -- 172.21.15.6:0/834037342 learned_addr learned my addr 172.21.15.6:0/834037342 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.607+0000 7f467d59a700 1 -- 172.21.15.6:0/834037342 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690146321 0 0) 0x7f46800cfeb0 con 0x7f46801593c0 2023-10-06T02:30:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.607+0000 7f467e59c700 1 --2- 172.21.15.6:0/834037342 >> v2:172.21.15.175:3300/0 conn(0x7f4680158ff0 0x7f46800b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.607+0000 7f467d59a700 1 -- 172.21.15.6:0/834037342 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f466c003570 con 0x7f46801593c0 2023-10-06T02:30:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467d59a700 1 -- 172.21.15.6:0/834037342 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2037297067 0 0) 0x7f466c003570 con 0x7f46801593c0 2023-10-06T02:30:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467d59a700 1 -- 172.21.15.6:0/834037342 >> v2:172.21.15.175:3300/0 conn(0x7f4680158ff0 msgr2=0x7f46800b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467d59a700 1 --2- 172.21.15.6:0/834037342 >> v2:172.21.15.175:3300/0 conn(0x7f4680158ff0 0x7f46800b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467d59a700 1 -- 172.21.15.6:0/834037342 >> v1:172.21.15.175:6789/0 conn(0x7f4680087700 legacy=0x7f46800b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467d59a700 1 -- 172.21.15.6:0/834037342 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46800cf580 con 0x7f46801593c0 2023-10-06T02:30:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467d59a700 1 -- 172.21.15.6:0/834037342 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f4668001470 con 0x7f46801593c0 2023-10-06T02:30:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467d59a700 1 -- 172.21.15.6:0/834037342 >> v1:172.21.15.6:6789/0 conn(0x7f46801593c0 legacy=0x7f4680086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467d59a700 1 --2- 172.21.15.6:0/834037342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c003a60 0x7f466c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467d59a700 1 --2- 172.21.15.6:0/834037342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f466c004810 0x7f466c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467d59a700 1 --2- 172.21.15.6:0/834037342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f466c0051c0 0x7f466c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467d59a700 1 -- 172.21.15.6:0/834037342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46800cf2a0 con 0x7f466c003a60 2023-10-06T02:30:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467d59a700 1 -- 172.21.15.6:0/834037342 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c00c160 con 0x7f466c0051c0 2023-10-06T02:30:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467d59a700 1 -- 172.21.15.6:0/834037342 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c00c320 con 0x7f466c004810 2023-10-06T02:30:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467e59c700 1 --2- 172.21.15.6:0/834037342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c003a60 0x7f466c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467ed9d700 1 --2- 172.21.15.6:0/834037342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f466c0051c0 0x7f466c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467dd9b700 1 --2- 172.21.15.6:0/834037342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f466c004810 0x7f466c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467e59c700 1 -- 172.21.15.6:0/834037342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f466c004810 msgr2=0x7f466c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467e59c700 1 --2- 172.21.15.6:0/834037342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f466c004810 0x7f466c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467e59c700 1 -- 172.21.15.6:0/834037342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f466c0051c0 msgr2=0x7f466c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467e59c700 1 --2- 172.21.15.6:0/834037342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f466c0051c0 0x7f466c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467e59c700 1 -- 172.21.15.6:0/834037342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c003570 con 0x7f466c003a60 2023-10-06T02:30:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467ed9d700 1 --2- 172.21.15.6:0/834037342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f466c0051c0 0x7f466c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467ed9d700 1 -- 172.21.15.6:0/834037342 reap_dead start 2023-10-06T02:30:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.608+0000 7f467e59c700 1 --2- 172.21.15.6:0/834037342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c003a60 0x7f466c003e70 secure :-1 s=READY pgs=2607 cs=0 l=1 rev1=1 crypto rx=0x7f4678009c00 tx=0x7f46780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc728cf9174aaaf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.609+0000 7f467d59a700 1 -- 172.21.15.6:0/834037342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467800e710 con 0x7f466c003a60 2023-10-06T02:30:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.609+0000 7f467d59a700 1 -- 172.21.15.6:0/834037342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467800e870 con 0x7f466c003a60 2023-10-06T02:30:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.609+0000 7f467d59a700 1 -- 172.21.15.6:0/834037342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467800ec30 con 0x7f466c003a60 2023-10-06T02:30:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.609+0000 7f467f59e700 1 -- 172.21.15.6:0/834037342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c003a60 msgr2=0x7f466c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.609+0000 7f467f59e700 1 --2- 172.21.15.6:0/834037342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c003a60 0x7f466c003e70 secure :-1 s=READY pgs=2607 cs=0 l=1 rev1=1 crypto rx=0x7f4678009c00 tx=0x7f46780091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.609+0000 7f467f59e700 1 -- 172.21.15.6:0/834037342 shutdown_connections 2023-10-06T02:30:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.609+0000 7f467f59e700 1 --2- 172.21.15.6:0/834037342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c003a60 0x7f466c003e70 unknown :-1 s=CLOSED pgs=2607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.609+0000 7f467f59e700 1 -- 172.21.15.6:0/834037342 >> 172.21.15.6:0/834037342 conn(0x7f46800690f0 msgr2=0x7f46800b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.609+0000 7f467f59e700 1 -- 172.21.15.6:0/834037342 shutdown_connections 2023-10-06T02:30:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.609+0000 7f467f59e700 1 -- 172.21.15.6:0/834037342 wait complete. 2023-10-06T02:30:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.610+0000 7f467f59e700 1 Processor -- start 2023-10-06T02:30:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.610+0000 7f467f59e700 1 -- start start 2023-10-06T02:30:53.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.611+0000 7f467f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c003a60 0x7f4680151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.611+0000 7f467f59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46800afc70 0x7f46800b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.611+0000 7f467f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46800c5ba0 0x7f46800c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.611+0000 7f467f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46800b0620 con 0x7f466c003a60 2023-10-06T02:30:53.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.611+0000 7f467f59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468016df60 con 0x7f46800afc70 2023-10-06T02:30:53.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.611+0000 7f467f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468016d370 con 0x7f46800c5ba0 2023-10-06T02:30:53.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.611+0000 7f467e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c003a60 0x7f4680151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.611+0000 7f467e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c003a60 0x7f4680151d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44806/0 (socket says 172.21.15.6:44806) 2023-10-06T02:30:53.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.611+0000 7f467e59c700 1 -- 172.21.15.6:0/3654437200 learned_addr learned my addr 172.21.15.6:0/3654437200 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:53.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.611+0000 7f467ed9d700 1 --2- 172.21.15.6:0/3654437200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46800c5ba0 0x7f46800c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.611+0000 7f467dd9b700 1 --2- 172.21.15.6:0/3654437200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46800afc70 0x7f46800b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.611+0000 7f467e59c700 1 -- 172.21.15.6:0/3654437200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46800c5ba0 msgr2=0x7f46800c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.611+0000 7f467e59c700 1 --2- 172.21.15.6:0/3654437200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46800c5ba0 0x7f46800c6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.611+0000 7f467e59c700 1 -- 172.21.15.6:0/3654437200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46800afc70 msgr2=0x7f46800b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.611+0000 7f467e59c700 1 --2- 172.21.15.6:0/3654437200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46800afc70 0x7f46800b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.611+0000 7f467e59c700 1 -- 172.21.15.6:0/3654437200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468016d630 con 0x7f466c003a60 2023-10-06T02:30:53.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.612+0000 7f467e59c700 1 --2- 172.21.15.6:0/3654437200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c003a60 0x7f4680151d40 secure :-1 s=READY pgs=2608 cs=0 l=1 rev1=1 crypto rx=0x7f466c00c130 tx=0x7f467801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:53.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.612+0000 7f46767fc700 1 -- 172.21.15.6:0/3654437200 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678022070 con 0x7f466c003a60 2023-10-06T02:30:53.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.612+0000 7f46767fc700 1 -- 172.21.15.6:0/3654437200 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467800e9e0 con 0x7f466c003a60 2023-10-06T02:30:53.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.612+0000 7f46767fc700 1 -- 172.21.15.6:0/3654437200 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678027470 con 0x7f466c003a60 2023-10-06T02:30:53.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.612+0000 7f467f59e700 1 -- 172.21.15.6:0/3654437200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468016d910 con 0x7f466c003a60 2023-10-06T02:30:53.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.612+0000 7f467f59e700 1 -- 172.21.15.6:0/3654437200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46800c6550 con 0x7f466c003a60 2023-10-06T02:30:53.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.612+0000 7f467f59e700 1 -- 172.21.15.6:0/3654437200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46800af820 con 0x7f466c003a60 2023-10-06T02:30:53.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.613+0000 7f46767fc700 1 -- 172.21.15.6:0/3654437200 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46780123d0 con 0x7f466c003a60 2023-10-06T02:30:53.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.614+0000 7f46767fc700 1 --2- 172.21.15.6:0/3654437200 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4660066f30 0x7f46600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.614+0000 7f46767fc700 1 -- 172.21.15.6:0/3654437200 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f46780867f0 con 0x7f466c003a60 2023-10-06T02:30:53.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.614+0000 7f46767fc700 1 --2- 172.21.15.6:0/3654437200 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7f466006d8f0 0x7f466006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.614+0000 7f46767fc700 1 -- 172.21.15.6:0/3654437200 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46600703f0 con 0x7f466006d8f0 2023-10-06T02:30:53.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.614+0000 7f46767fc700 1 -- 172.21.15.6:0/3654437200 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=152) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4678086ae0 con 0x7f466c003a60 2023-10-06T02:30:53.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.614+0000 7f467dd9b700 1 --2- 172.21.15.6:0/3654437200 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4660066f30 0x7f46600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.614+0000 7f467ed9d700 1 --2- 172.21.15.6:0/3654437200 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7f466006d8f0 0x7f466006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.614+0000 7f467dd9b700 1 --2- 172.21.15.6:0/3654437200 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4660066f30 0x7f46600693e0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f46680010e0 tx=0x7f4668000f60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:53.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.614+0000 7f467ed9d700 1 --2- 172.21.15.6:0/3654437200 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7f466006d8f0 0x7f466006fd20 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:53.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.615+0000 7f46767fc700 1 -- 172.21.15.6:0/3654437200 <== osd.4 v2:172.21.15.175:6808/90865 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f46600703f0 con 0x7f466006d8f0 2023-10-06T02:30:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.629+0000 7f467f59e700 1 -- 172.21.15.6:0/3654437200 --> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f46800b0620 con 0x7f466006d8f0 2023-10-06T02:30:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.630+0000 7f46767fc700 1 -- 172.21.15.6:0/3654437200 <== osd.4 v2:172.21.15.175:6808/90865 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f467000d080 con 0x7f466006d8f0 2023-10-06T02:30:53.631 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:30:53.631 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T02:30:53.631 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:30:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.630+0000 7f467f59e700 1 -- 172.21.15.6:0/3654437200 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7f466006d8f0 msgr2=0x7f466006fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.630+0000 7f467f59e700 1 --2- 172.21.15.6:0/3654437200 >> [v2:172.21.15.175:6808/90865,v1:172.21.15.175:6809/90865] conn(0x7f466006d8f0 0x7f466006fd20 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.630+0000 7f467f59e700 1 -- 172.21.15.6:0/3654437200 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4660066f30 msgr2=0x7f46600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.630+0000 7f467f59e700 1 --2- 172.21.15.6:0/3654437200 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f4660066f30 0x7f46600693e0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f46680010e0 tx=0x7f4668000f60 comp rx=0 tx=0).stop 2023-10-06T02:30:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.630+0000 7f467f59e700 1 -- 172.21.15.6:0/3654437200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c003a60 msgr2=0x7f4680151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.630+0000 7f467f59e700 1 --2- 172.21.15.6:0/3654437200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c003a60 0x7f4680151d40 secure :-1 s=READY pgs=2608 cs=0 l=1 rev1=1 crypto rx=0x7f466c00c130 tx=0x7f467801a000 comp rx=0 tx=0).stop 2023-10-06T02:30:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.630+0000 7f467ed9d700 1 -- 172.21.15.6:0/3654437200 reap_dead start 2023-10-06T02:30:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.630+0000 7f467f59e700 1 -- 172.21.15.6:0/3654437200 shutdown_connections 2023-10-06T02:30:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.630+0000 7f467f59e700 1 -- 172.21.15.6:0/3654437200 >> 172.21.15.6:0/3654437200 conn(0x7f46800690f0 msgr2=0x7f4680152c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.630+0000 7f467f59e700 1 -- 172.21.15.6:0/3654437200 shutdown_connections 2023-10-06T02:30:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.630+0000 7f467f59e700 1 -- 172.21.15.6:0/3654437200 wait complete. 2023-10-06T02:30:53.643 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T02:30:53.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.762+0000 7fd34d6e0700 1 Processor -- start 2023-10-06T02:30:53.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.762+0000 7fd34d6e0700 1 -- start start 2023-10-06T02:30:53.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.762+0000 7fd34d6e0700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd34815a030 0x7fd34815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.762+0000 7fd34d6e0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34815a940 0x7fd348086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.762+0000 7fd34d6e0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd348087530 0x7fd3480b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.762+0000 7fd34d6e0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3480b0cf0 con 0x7fd348087530 2023-10-06T02:30:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.762+0000 7fd34d6e0700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3480879b0 con 0x7fd34815a030 2023-10-06T02:30:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.762+0000 7fd34d6e0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3480afc50 con 0x7fd34815a940 2023-10-06T02:30:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.763+0000 7fd3477fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd348087530 0x7fd3480b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.763+0000 7fd3477fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd348087530 0x7fd3480b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44818/0 (socket says 172.21.15.6:44818) 2023-10-06T02:30:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.763+0000 7fd3477fe700 1 -- 172.21.15.6:0/2539593059 learned_addr learned my addr 172.21.15.6:0/2539593059 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.763+0000 7fd3467fc700 1 --2- 172.21.15.6:0/2539593059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34815a940 0x7fd348086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.763+0000 7fd346ffd700 1 --2- 172.21.15.6:0/2539593059 >> v2:172.21.15.175:3300/0 conn(0x7fd34815a030 0x7fd34815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.763+0000 7fd3477fe700 1 -- 172.21.15.6:0/2539593059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34815a940 msgr2=0x7fd348086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.763+0000 7fd3477fe700 1 --2- 172.21.15.6:0/2539593059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34815a940 0x7fd348086ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.763+0000 7fd3477fe700 1 -- 172.21.15.6:0/2539593059 >> v2:172.21.15.175:3300/0 conn(0x7fd34815a030 msgr2=0x7fd34815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.763+0000 7fd3477fe700 1 --2- 172.21.15.6:0/2539593059 >> v2:172.21.15.175:3300/0 conn(0x7fd34815a030 0x7fd34815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.763+0000 7fd3477fe700 1 -- 172.21.15.6:0/2539593059 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3480aff30 con 0x7fd348087530 2023-10-06T02:30:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.763+0000 7fd346ffd700 1 --2- 172.21.15.6:0/2539593059 >> v2:172.21.15.175:3300/0 conn(0x7fd34815a030 0x7fd34815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.763+0000 7fd3477fe700 1 --2- 172.21.15.6:0/2539593059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd348087530 0x7fd3480b21b0 secure :-1 s=READY pgs=2609 cs=0 l=1 rev1=1 crypto rx=0x7fd3480cddc0 tx=0x7fd338009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e82ba52175cdbc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.763+0000 7fd345ffb700 1 -- 172.21.15.6:0/2539593059 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33800b820 con 0x7fd348087530 2023-10-06T02:30:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.763+0000 7fd345ffb700 1 -- 172.21.15.6:0/2539593059 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33800b980 con 0x7fd348087530 2023-10-06T02:30:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.763+0000 7fd345ffb700 1 -- 172.21.15.6:0/2539593059 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33800bd20 con 0x7fd348087530 2023-10-06T02:30:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.764+0000 7fd34d6e0700 1 -- 172.21.15.6:0/2539593059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd348087530 msgr2=0x7fd3480b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.764+0000 7fd34d6e0700 1 --2- 172.21.15.6:0/2539593059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd348087530 0x7fd3480b21b0 secure :-1 s=READY pgs=2609 cs=0 l=1 rev1=1 crypto rx=0x7fd3480cddc0 tx=0x7fd338009250 comp rx=0 tx=0).stop 2023-10-06T02:30:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.764+0000 7fd34d6e0700 1 -- 172.21.15.6:0/2539593059 shutdown_connections 2023-10-06T02:30:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.764+0000 7fd34d6e0700 1 --2- 172.21.15.6:0/2539593059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd348087530 0x7fd3480b21b0 unknown :-1 s=CLOSED pgs=2609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.764+0000 7fd34d6e0700 1 --2- 172.21.15.6:0/2539593059 >> v2:172.21.15.175:3300/0 conn(0x7fd34815a030 0x7fd34815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.764+0000 7fd34d6e0700 1 --2- 172.21.15.6:0/2539593059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34815a940 0x7fd348086ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.764+0000 7fd34d6e0700 1 -- 172.21.15.6:0/2539593059 >> 172.21.15.6:0/2539593059 conn(0x7fd348068680 msgr2=0x7fd348068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.764+0000 7fd34d6e0700 1 -- 172.21.15.6:0/2539593059 shutdown_connections 2023-10-06T02:30:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.764+0000 7fd34d6e0700 1 -- 172.21.15.6:0/2539593059 wait complete. 2023-10-06T02:30:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.765+0000 7fd34d6e0700 1 Processor -- start 2023-10-06T02:30:53.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.765+0000 7fd34d6e0700 1 -- start start 2023-10-06T02:30:53.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.766+0000 7fd34d6e0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd348087530 0x7fd34816d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.766+0000 7fd34d6e0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34815a030 0x7fd348155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.766+0000 7fd34d6e0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd34815a940 0x7fd3480cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.766+0000 7fd34d6e0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3480b4840 con 0x7fd34815a940 2023-10-06T02:30:53.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.766+0000 7fd34d6e0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34816de20 con 0x7fd348087530 2023-10-06T02:30:53.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.766+0000 7fd34d6e0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3480b5390 con 0x7fd34815a030 2023-10-06T02:30:53.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.766+0000 7fd3477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd34815a940 0x7fd3480cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.766+0000 7fd3477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd34815a940 0x7fd3480cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44820/0 (socket says 172.21.15.6:44820) 2023-10-06T02:30:53.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.766+0000 7fd3477fe700 1 -- 172.21.15.6:0/3269975847 learned_addr learned my addr 172.21.15.6:0/3269975847 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:53.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.766+0000 7fd346ffd700 1 --2- 172.21.15.6:0/3269975847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd348087530 0x7fd34816d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.766+0000 7fd3467fc700 1 --2- 172.21.15.6:0/3269975847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34815a030 0x7fd348155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.766+0000 7fd3477fe700 1 -- 172.21.15.6:0/3269975847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34815a030 msgr2=0x7fd348155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.766+0000 7fd3477fe700 1 --2- 172.21.15.6:0/3269975847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34815a030 0x7fd348155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.766+0000 7fd3477fe700 1 -- 172.21.15.6:0/3269975847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd348087530 msgr2=0x7fd34816d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.766+0000 7fd3477fe700 1 --2- 172.21.15.6:0/3269975847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd348087530 0x7fd34816d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.766+0000 7fd3477fe700 1 -- 172.21.15.6:0/3269975847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3380094f0 con 0x7fd34815a940 2023-10-06T02:30:53.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.767+0000 7fd3477fe700 1 --2- 172.21.15.6:0/3269975847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd34815a940 0x7fd3480cccc0 secure :-1 s=READY pgs=2610 cs=0 l=1 rev1=1 crypto rx=0x7fd338009290 tx=0x7fd338017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:53.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.767+0000 7fd33effd700 1 -- 172.21.15.6:0/3269975847 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33800b820 con 0x7fd34815a940 2023-10-06T02:30:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.767+0000 7fd33effd700 1 -- 172.21.15.6:0/3269975847 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33801a630 con 0x7fd34815a940 2023-10-06T02:30:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.767+0000 7fd34d6e0700 1 -- 172.21.15.6:0/3269975847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3480b5670 con 0x7fd34815a940 2023-10-06T02:30:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.767+0000 7fd33effd700 1 -- 172.21.15.6:0/3269975847 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd338011ea0 con 0x7fd34815a940 2023-10-06T02:30:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.767+0000 7fd34d6e0700 1 -- 172.21.15.6:0/3269975847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3480b5c30 con 0x7fd34815a940 2023-10-06T02:30:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.768+0000 7fd34d6e0700 1 -- 172.21.15.6:0/3269975847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3480c3ee0 con 0x7fd34815a940 2023-10-06T02:30:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.769+0000 7fd33effd700 1 -- 172.21.15.6:0/3269975847 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd33801ace0 con 0x7fd34815a940 2023-10-06T02:30:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.769+0000 7fd33effd700 1 --2- 172.21.15.6:0/3269975847 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd328066f30 0x7fd3280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.769+0000 7fd33effd700 1 -- 172.21.15.6:0/3269975847 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fd338086270 con 0x7fd34815a940 2023-10-06T02:30:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.770+0000 7fd346ffd700 1 --2- 172.21.15.6:0/3269975847 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd328066f30 0x7fd3280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.770+0000 7fd346ffd700 1 --2- 172.21.15.6:0/3269975847 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd328066f30 0x7fd3280693e0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fd34000d6e0 tx=0x7fd340007850 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:53.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.772+0000 7fd33effd700 1 -- 172.21.15.6:0/3269975847 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd338053560 con 0x7fd34815a940 2023-10-06T02:30:53.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.967+0000 7fd34d6e0700 1 -- 172.21.15.6:0/3269975847 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3480c3ee0 con 0x7fd328066f30 2023-10-06T02:30:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.968+0000 7fd33effd700 1 -- 172.21.15.6:0/3269975847 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd3480c3ee0 con 0x7fd328066f30 2023-10-06T02:30:53.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.970+0000 7fd34d6e0700 1 -- 172.21.15.6:0/3269975847 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd328066f30 msgr2=0x7fd3280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.970+0000 7fd34d6e0700 1 --2- 172.21.15.6:0/3269975847 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd328066f30 0x7fd3280693e0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fd34000d6e0 tx=0x7fd340007850 comp rx=0 tx=0).stop 2023-10-06T02:30:53.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.970+0000 7fd34d6e0700 1 -- 172.21.15.6:0/3269975847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd34815a940 msgr2=0x7fd3480cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:53.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.970+0000 7fd34d6e0700 1 --2- 172.21.15.6:0/3269975847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd34815a940 0x7fd3480cccc0 secure :-1 s=READY pgs=2610 cs=0 l=1 rev1=1 crypto rx=0x7fd338009290 tx=0x7fd338017000 comp rx=0 tx=0).stop 2023-10-06T02:30:53.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.970+0000 7fd34d6e0700 1 -- 172.21.15.6:0/3269975847 shutdown_connections 2023-10-06T02:30:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.970+0000 7fd34d6e0700 1 --2- 172.21.15.6:0/3269975847 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd328066f30 0x7fd3280693e0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.970+0000 7fd34d6e0700 1 --2- 172.21.15.6:0/3269975847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd34815a940 0x7fd3480cccc0 unknown :-1 s=CLOSED pgs=2610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.970+0000 7fd34d6e0700 1 --2- 172.21.15.6:0/3269975847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd348087530 0x7fd34816d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.970+0000 7fd34d6e0700 1 --2- 172.21.15.6:0/3269975847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd34815a030 0x7fd348155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.970+0000 7fd34d6e0700 1 -- 172.21.15.6:0/3269975847 >> 172.21.15.6:0/3269975847 conn(0x7fd348068680 msgr2=0x7fd3481577f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.970+0000 7fd34d6e0700 1 -- 172.21.15.6:0/3269975847 shutdown_connections 2023-10-06T02:30:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:53.970+0000 7fd34d6e0700 1 -- 172.21.15.6:0/3269975847 wait complete. 2023-10-06T02:30:53.972 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T02:30:53.983 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T02:30:53.983 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:30:54.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.105+0000 7f9e06bb2700 1 Processor -- start 2023-10-06T02:30:54.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.105+0000 7f9e06bb2700 1 -- start start 2023-10-06T02:30:54.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.106+0000 7f9e06bb2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e00142f20 0x7f9e0015a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.106+0000 7f9e06bb2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e000d0260 0x7f9e000d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.106+0000 7f9e06bb2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e000d0c10 con 0x7f9e000cea80 2023-10-06T02:30:54.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.106+0000 7f9e06bb2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e000cd2d0 con 0x7f9e00142f20 2023-10-06T02:30:54.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.106+0000 7f9e06bb2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e001432f0 con 0x7f9e000d0260 2023-10-06T02:30:54.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.106+0000 7f9e0494e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e00142f20 0x7f9e0015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.106+0000 7f9e0494e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e00142f20 0x7f9e0015a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44830/0 (socket says 172.21.15.6:44830) 2023-10-06T02:30:54.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.106+0000 7f9e0514f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9e000cea80 0x7f9e000cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44634/0 (socket says 172.21.15.6:44634) 2023-10-06T02:30:54.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.106+0000 7f9e0494e700 1 -- 172.21.15.6:0/3030363702 learned_addr learned my addr 172.21.15.6:0/3030363702 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:54.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.107+0000 7f9dfffff700 1 --2- 172.21.15.6:0/3030363702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e000d0260 0x7f9e000d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.107+0000 7f9e0494e700 1 -- 172.21.15.6:0/3030363702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e000d0260 msgr2=0x7f9e000d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.107+0000 7f9e0494e700 1 --2- 172.21.15.6:0/3030363702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e000d0260 0x7f9e000d06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.107+0000 7f9e0494e700 1 -- 172.21.15.6:0/3030363702 >> v1:172.21.15.6:6789/0 conn(0x7f9e000cea80 legacy=0x7f9e000cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.107+0000 7f9dff7fe700 1 -- 172.21.15.6:0/3030363702 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191337450 0 0) 0x7f9e000d0c10 con 0x7f9e000cea80 2023-10-06T02:30:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.107+0000 7f9e0494e700 1 -- 172.21.15.6:0/3030363702 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0015a9d0 con 0x7f9e00142f20 2023-10-06T02:30:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.107+0000 7f9dfffff700 1 --2- 172.21.15.6:0/3030363702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e000d0260 0x7f9e000d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.107+0000 7f9e0494e700 1 --2- 172.21.15.6:0/3030363702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e00142f20 0x7f9e0015a490 secure :-1 s=READY pgs=2612 cs=0 l=1 rev1=1 crypto rx=0x7f9df80099b0 tx=0x7f9df8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0f92d332a68367 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.107+0000 7f9dff7fe700 1 -- 172.21.15.6:0/3030363702 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df800b860 con 0x7f9e00142f20 2023-10-06T02:30:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.107+0000 7f9dff7fe700 1 -- 172.21.15.6:0/3030363702 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df800b9c0 con 0x7f9e00142f20 2023-10-06T02:30:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.107+0000 7f9dff7fe700 1 -- 172.21.15.6:0/3030363702 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df800bd60 con 0x7f9e00142f20 2023-10-06T02:30:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.107+0000 7f9e06bb2700 1 -- 172.21.15.6:0/3030363702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e00142f20 msgr2=0x7f9e0015a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.107+0000 7f9e06bb2700 1 --2- 172.21.15.6:0/3030363702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e00142f20 0x7f9e0015a490 secure :-1 s=READY pgs=2612 cs=0 l=1 rev1=1 crypto rx=0x7f9df80099b0 tx=0x7f9df8009250 comp rx=0 tx=0).stop 2023-10-06T02:30:54.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.108+0000 7f9e06bb2700 1 -- 172.21.15.6:0/3030363702 shutdown_connections 2023-10-06T02:30:54.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.108+0000 7f9e06bb2700 1 --2- 172.21.15.6:0/3030363702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e00142f20 0x7f9e0015a490 unknown :-1 s=CLOSED pgs=2612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.108+0000 7f9e06bb2700 1 --2- 172.21.15.6:0/3030363702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e000d0260 0x7f9e000d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.108+0000 7f9e06bb2700 1 -- 172.21.15.6:0/3030363702 >> 172.21.15.6:0/3030363702 conn(0x7f9e00069150 msgr2=0x7f9e0006a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:54.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.108+0000 7f9e06bb2700 1 -- 172.21.15.6:0/3030363702 shutdown_connections 2023-10-06T02:30:54.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.108+0000 7f9e06bb2700 1 -- 172.21.15.6:0/3030363702 wait complete. 2023-10-06T02:30:54.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.109+0000 7f9e06bb2700 1 Processor -- start 2023-10-06T02:30:54.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.109+0000 7f9e06bb2700 1 -- start start 2023-10-06T02:30:54.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.109+0000 7f9e06bb2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e000cea80 0x7f9e00141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.109+0000 7f9e06bb2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e000d0260 0x7f9e001560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.109+0000 7f9e06bb2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e00142f20 0x7f9e000b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9e06bb2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e00155c60 con 0x7f9e00142f20 2023-10-06T02:30:54.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9e06bb2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e00155050 con 0x7f9e000d0260 2023-10-06T02:30:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9e06bb2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e00155330 con 0x7f9e000cea80 2023-10-06T02:30:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9e0514f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e00142f20 0x7f9e000b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9e0514f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e00142f20 0x7f9e000b52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44834/0 (socket says 172.21.15.6:44834) 2023-10-06T02:30:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9e0514f700 1 -- 172.21.15.6:0/3950015175 learned_addr learned my addr 172.21.15.6:0/3950015175 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9e0494e700 1 --2- 172.21.15.6:0/3950015175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e000cea80 0x7f9e00141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9dfffff700 1 --2- 172.21.15.6:0/3950015175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e000d0260 0x7f9e001560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9e0514f700 1 -- 172.21.15.6:0/3950015175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e000cea80 msgr2=0x7f9e00141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9e0514f700 1 --2- 172.21.15.6:0/3950015175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e000cea80 0x7f9e00141e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9e0514f700 1 -- 172.21.15.6:0/3950015175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e000d0260 msgr2=0x7f9e001560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9e0514f700 1 --2- 172.21.15.6:0/3950015175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e000d0260 0x7f9e001560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9e0514f700 1 -- 172.21.15.6:0/3950015175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df80094f0 con 0x7f9e00142f20 2023-10-06T02:30:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9dfffff700 1 --2- 172.21.15.6:0/3950015175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e000d0260 0x7f9e001560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9e0514f700 1 --2- 172.21.15.6:0/3950015175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e00142f20 0x7f9e000b52d0 secure :-1 s=READY pgs=2613 cs=0 l=1 rev1=1 crypto rx=0x7f9de800c530 tx=0x7f9de8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:54.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9dfcff9700 1 -- 172.21.15.6:0/3950015175 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de8005a70 con 0x7f9e00142f20 2023-10-06T02:30:54.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9dfcff9700 1 -- 172.21.15.6:0/3950015175 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de8005bd0 con 0x7f9e00142f20 2023-10-06T02:30:54.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9e06bb2700 1 -- 172.21.15.6:0/3950015175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e00155610 con 0x7f9e00142f20 2023-10-06T02:30:54.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9dfcff9700 1 -- 172.21.15.6:0/3950015175 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de80070d0 con 0x7f9e00142f20 2023-10-06T02:30:54.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.110+0000 7f9e06bb2700 1 -- 172.21.15.6:0/3950015175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e00156630 con 0x7f9e00142f20 2023-10-06T02:30:54.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.111+0000 7f9e06bb2700 1 -- 172.21.15.6:0/3950015175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e00088ad0 con 0x7f9e00142f20 2023-10-06T02:30:54.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.112+0000 7f9dfcff9700 1 -- 172.21.15.6:0/3950015175 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9de8007480 con 0x7f9e00142f20 2023-10-06T02:30:54.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.112+0000 7f9dfcff9700 1 --2- 172.21.15.6:0/3950015175 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9de0066f30 0x7f9de00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.112+0000 7f9dfcff9700 1 -- 172.21.15.6:0/3950015175 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f9de80839f0 con 0x7f9e00142f20 2023-10-06T02:30:54.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.112+0000 7f9dfcff9700 1 --2- 172.21.15.6:0/3950015175 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7f9de006d8f0 0x7f9de006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.112+0000 7f9dfcff9700 1 -- 172.21.15.6:0/3950015175 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9de00703f0 con 0x7f9de006d8f0 2023-10-06T02:30:54.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.112+0000 7f9dfcff9700 1 -- 172.21.15.6:0/3950015175 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=152) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9de8088240 con 0x7f9e00142f20 2023-10-06T02:30:54.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.112+0000 7f9e0494e700 1 --2- 172.21.15.6:0/3950015175 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9de0066f30 0x7f9de00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.112+0000 7f9dfffff700 1 --2- 172.21.15.6:0/3950015175 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7f9de006d8f0 0x7f9de006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.113+0000 7f9e0494e700 1 --2- 172.21.15.6:0/3950015175 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9de0066f30 0x7f9de00693e0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f9df80099b0 tx=0x7f9df8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:54.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.113+0000 7f9dfffff700 1 --2- 172.21.15.6:0/3950015175 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7f9de006d8f0 0x7f9de006fd20 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:54.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.114+0000 7f9dfcff9700 1 -- 172.21.15.6:0/3950015175 <== osd.5 v2:172.21.15.175:6800/90866 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9de00703f0 con 0x7f9de006d8f0 2023-10-06T02:30:54.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.127+0000 7f9e06bb2700 1 -- 172.21.15.6:0/3950015175 --> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9e000cc6c0 con 0x7f9de006d8f0 2023-10-06T02:30:54.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.128+0000 7f9dfcff9700 1 -- 172.21.15.6:0/3950015175 <== osd.5 v2:172.21.15.175:6800/90866 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9e000cc6c0 con 0x7f9de006d8f0 2023-10-06T02:30:54.129 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:30:54.129 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T02:30:54.129 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:30:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.128+0000 7f9e06bb2700 1 -- 172.21.15.6:0/3950015175 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7f9de006d8f0 msgr2=0x7f9de006fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.128+0000 7f9e06bb2700 1 --2- 172.21.15.6:0/3950015175 >> [v2:172.21.15.175:6800/90866,v1:172.21.15.175:6801/90866] conn(0x7f9de006d8f0 0x7f9de006fd20 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.128+0000 7f9e06bb2700 1 -- 172.21.15.6:0/3950015175 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9de0066f30 msgr2=0x7f9de00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.128+0000 7f9e06bb2700 1 --2- 172.21.15.6:0/3950015175 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f9de0066f30 0x7f9de00693e0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f9df80099b0 tx=0x7f9df8017000 comp rx=0 tx=0).stop 2023-10-06T02:30:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.128+0000 7f9e06bb2700 1 -- 172.21.15.6:0/3950015175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e00142f20 msgr2=0x7f9e000b52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.128+0000 7f9e06bb2700 1 --2- 172.21.15.6:0/3950015175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e00142f20 0x7f9e000b52d0 secure :-1 s=READY pgs=2613 cs=0 l=1 rev1=1 crypto rx=0x7f9de800c530 tx=0x7f9de8007f90 comp rx=0 tx=0).stop 2023-10-06T02:30:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.128+0000 7f9e0514f700 1 -- 172.21.15.6:0/3950015175 reap_dead start 2023-10-06T02:30:54.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.128+0000 7f9e06bb2700 1 -- 172.21.15.6:0/3950015175 shutdown_connections 2023-10-06T02:30:54.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.128+0000 7f9e06bb2700 1 -- 172.21.15.6:0/3950015175 >> 172.21.15.6:0/3950015175 conn(0x7f9e00069150 msgr2=0x7f9e001590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:54.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.129+0000 7f9e06bb2700 1 -- 172.21.15.6:0/3950015175 shutdown_connections 2023-10-06T02:30:54.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.129+0000 7f9e06bb2700 1 -- 172.21.15.6:0/3950015175 wait complete. 2023-10-06T02:30:54.141 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T02:30:54.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.261+0000 7fc3bfbb2700 1 Processor -- start 2023-10-06T02:30:54.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.261+0000 7fc3bfbb2700 1 -- start start 2023-10-06T02:30:54.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.262+0000 7fc3bfbb2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b8086ff0 0x7fc3b8087440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.262+0000 7fc3bfbb2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3b80b21b0 0x7fc3b80b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.262+0000 7fc3bfbb2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b8087980 con 0x7fc3b815a030 2023-10-06T02:30:54.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.262+0000 7fc3bfbb2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b80b0cf0 con 0x7fc3b80b21b0 2023-10-06T02:30:54.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.262+0000 7fc3bfbb2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b80b2b30 con 0x7fc3b8086ff0 2023-10-06T02:30:54.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.262+0000 7fc3be14f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3b80b21b0 0x7fc3b80b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.262+0000 7fc3be14f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3b80b21b0 0x7fc3b80b25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44850/0 (socket says 172.21.15.6:44850) 2023-10-06T02:30:54.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.262+0000 7fc3be14f700 1 -- 172.21.15.6:0/4101840447 learned_addr learned my addr 172.21.15.6:0/4101840447 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:54.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.262+0000 7fc3bd14d700 1 --2- 172.21.15.6:0/4101840447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b8086ff0 0x7fc3b8087440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.262+0000 7fc3be14f700 1 -- 172.21.15.6:0/4101840447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b8086ff0 msgr2=0x7fc3b8087440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:54.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.262+0000 7fc3be14f700 1 --2- 172.21.15.6:0/4101840447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b8086ff0 0x7fc3b8087440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.262+0000 7fc3be14f700 1 -- 172.21.15.6:0/4101840447 >> v1:172.21.15.175:6789/0 conn(0x7fc3b815a030 legacy=0x7fc3b815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.262+0000 7fc3be14f700 1 -- 172.21.15.6:0/4101840447 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b80afc50 con 0x7fc3b80b21b0 2023-10-06T02:30:54.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.262+0000 7fc3be14f700 1 --2- 172.21.15.6:0/4101840447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b80b21b0 0x7fc3b80b25f0 secure :-1 s=READY pgs=2614 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8009f20 tx=0x7fc3a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583b2b7b485c254d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:54.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.262+0000 7fc3bc94c700 1 -- 172.21.15.6:0/4101840447 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a800e070 con 0x7fc3b80b21b0 2023-10-06T02:30:54.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.263+0000 7fc3bc94c700 1 -- 172.21.15.6:0/4101840447 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a800b9d0 con 0x7fc3b80b21b0 2023-10-06T02:30:54.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.263+0000 7fc3bc94c700 1 -- 172.21.15.6:0/4101840447 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a80092e0 con 0x7fc3b80b21b0 2023-10-06T02:30:54.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.263+0000 7fc3bfbb2700 1 -- 172.21.15.6:0/4101840447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b80b21b0 msgr2=0x7fc3b80b25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.263+0000 7fc3bfbb2700 1 --2- 172.21.15.6:0/4101840447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b80b21b0 0x7fc3b80b25f0 secure :-1 s=READY pgs=2614 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8009f20 tx=0x7fc3a8009840 comp rx=0 tx=0).stop 2023-10-06T02:30:54.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.263+0000 7fc3bfbb2700 1 -- 172.21.15.6:0/4101840447 shutdown_connections 2023-10-06T02:30:54.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.263+0000 7fc3bfbb2700 1 --2- 172.21.15.6:0/4101840447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b80b21b0 0x7fc3b80b25f0 unknown :-1 s=CLOSED pgs=2614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.263+0000 7fc3bfbb2700 1 --2- 172.21.15.6:0/4101840447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b8086ff0 0x7fc3b8087440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.263+0000 7fc3bfbb2700 1 -- 172.21.15.6:0/4101840447 >> 172.21.15.6:0/4101840447 conn(0x7fc3b8068680 msgr2=0x7fc3b8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:54.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.263+0000 7fc3bfbb2700 1 -- 172.21.15.6:0/4101840447 shutdown_connections 2023-10-06T02:30:54.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.263+0000 7fc3bfbb2700 1 -- 172.21.15.6:0/4101840447 wait complete. 2023-10-06T02:30:54.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.264+0000 7fc3bfbb2700 1 Processor -- start 2023-10-06T02:30:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.264+0000 7fc3bfbb2700 1 -- start start 2023-10-06T02:30:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3bfbb2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b8086ff0 0x7fc3b80ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3bfbb2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3b80b21b0 0x7fc3b80c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3bfbb2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b815a030 0x7fc3b8155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3bfbb2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b815a400 con 0x7fc3b815a030 2023-10-06T02:30:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3bfbb2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b815a670 con 0x7fc3b80b21b0 2023-10-06T02:30:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3bfbb2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b80c4180 con 0x7fc3b8086ff0 2023-10-06T02:30:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3be14f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b815a030 0x7fc3b8155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3be14f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b815a030 0x7fc3b8155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44856/0 (socket says 172.21.15.6:44856) 2023-10-06T02:30:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3be14f700 1 -- 172.21.15.6:0/2130305703 learned_addr learned my addr 172.21.15.6:0/2130305703 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3bd94e700 1 --2- 172.21.15.6:0/2130305703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b8086ff0 0x7fc3b80ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3be14f700 1 -- 172.21.15.6:0/2130305703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b8086ff0 msgr2=0x7fc3b80ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3bd14d700 1 --2- 172.21.15.6:0/2130305703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3b80b21b0 0x7fc3b80c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3be14f700 1 --2- 172.21.15.6:0/2130305703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b8086ff0 0x7fc3b80ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3be14f700 1 -- 172.21.15.6:0/2130305703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3b80b21b0 msgr2=0x7fc3b80c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3be14f700 1 --2- 172.21.15.6:0/2130305703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3b80b21b0 0x7fc3b80c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3be14f700 1 -- 172.21.15.6:0/2130305703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a8009ae0 con 0x7fc3b815a030 2023-10-06T02:30:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3bd94e700 1 --2- 172.21.15.6:0/2130305703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b8086ff0 0x7fc3b80ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3bd14d700 1 --2- 172.21.15.6:0/2130305703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3b80b21b0 0x7fc3b80c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.265+0000 7fc3be14f700 1 --2- 172.21.15.6:0/2130305703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b815a030 0x7fc3b8155c80 secure :-1 s=READY pgs=2615 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800b610 tx=0x7fc3a8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.266+0000 7fc3b5ffb700 1 -- 172.21.15.6:0/2130305703 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8008c30 con 0x7fc3b815a030 2023-10-06T02:30:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.266+0000 7fc3b5ffb700 1 -- 172.21.15.6:0/2130305703 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a8008d90 con 0x7fc3b815a030 2023-10-06T02:30:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.266+0000 7fc3bfbb2700 1 -- 172.21.15.6:0/2130305703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b80c4400 con 0x7fc3b815a030 2023-10-06T02:30:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.266+0000 7fc3b5ffb700 1 -- 172.21.15.6:0/2130305703 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8026690 con 0x7fc3b815a030 2023-10-06T02:30:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.266+0000 7fc3bfbb2700 1 -- 172.21.15.6:0/2130305703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b80c49c0 con 0x7fc3b815a030 2023-10-06T02:30:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.267+0000 7fc3bfbb2700 1 -- 172.21.15.6:0/2130305703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b815a800 con 0x7fc3b815a030 2023-10-06T02:30:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.267+0000 7fc3b5ffb700 1 -- 172.21.15.6:0/2130305703 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc3a8003040 con 0x7fc3b815a030 2023-10-06T02:30:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.268+0000 7fc3b5ffb700 1 --2- 172.21.15.6:0/2130305703 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3a4066f30 0x7fc3a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.268+0000 7fc3b5ffb700 1 -- 172.21.15.6:0/2130305703 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fc3a8086550 con 0x7fc3b815a030 2023-10-06T02:30:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.268+0000 7fc3bd94e700 1 --2- 172.21.15.6:0/2130305703 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3a4066f30 0x7fc3a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.268+0000 7fc3bd94e700 1 --2- 172.21.15.6:0/2130305703 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3a4066f30 0x7fc3a40693e0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80c6750 tx=0x7fc3b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:54.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.272+0000 7fc3b5ffb700 1 -- 172.21.15.6:0/2130305703 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3a80537c0 con 0x7fc3b815a030 2023-10-06T02:30:54.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.465+0000 7fc3bfbb2700 1 -- 172.21.15.6:0/2130305703 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3b80c4bb0 con 0x7fc3a4066f30 2023-10-06T02:30:54.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.466+0000 7fc3b5ffb700 1 -- 172.21.15.6:0/2130305703 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc3b80c4bb0 con 0x7fc3a4066f30 2023-10-06T02:30:54.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.468+0000 7fc3bfbb2700 1 -- 172.21.15.6:0/2130305703 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3a4066f30 msgr2=0x7fc3a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.468+0000 7fc3bfbb2700 1 --2- 172.21.15.6:0/2130305703 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3a4066f30 0x7fc3a40693e0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80c6750 tx=0x7fc3b0009040 comp rx=0 tx=0).stop 2023-10-06T02:30:54.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.468+0000 7fc3bfbb2700 1 -- 172.21.15.6:0/2130305703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b815a030 msgr2=0x7fc3b8155c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.468+0000 7fc3bfbb2700 1 --2- 172.21.15.6:0/2130305703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b815a030 0x7fc3b8155c80 secure :-1 s=READY pgs=2615 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800b610 tx=0x7fc3a8018000 comp rx=0 tx=0).stop 2023-10-06T02:30:54.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.468+0000 7fc3bfbb2700 1 -- 172.21.15.6:0/2130305703 shutdown_connections 2023-10-06T02:30:54.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.468+0000 7fc3bfbb2700 1 --2- 172.21.15.6:0/2130305703 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fc3a4066f30 0x7fc3a40693e0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.468+0000 7fc3bfbb2700 1 --2- 172.21.15.6:0/2130305703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b815a030 0x7fc3b8155c80 unknown :-1 s=CLOSED pgs=2615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.468+0000 7fc3bfbb2700 1 --2- 172.21.15.6:0/2130305703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b8086ff0 0x7fc3b80ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.468+0000 7fc3bfbb2700 1 --2- 172.21.15.6:0/2130305703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3b80b21b0 0x7fc3b80c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.468+0000 7fc3bfbb2700 1 -- 172.21.15.6:0/2130305703 >> 172.21.15.6:0/2130305703 conn(0x7fc3b8068680 msgr2=0x7fc3b80cafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:54.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.468+0000 7fc3bfbb2700 1 -- 172.21.15.6:0/2130305703 shutdown_connections 2023-10-06T02:30:54.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.468+0000 7fc3bfbb2700 1 -- 172.21.15.6:0/2130305703 wait complete. 2023-10-06T02:30:54.471 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T02:30:54.481 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T02:30:54.481 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:30:54.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.603+0000 7f3d36c4b700 1 Processor -- start 2023-10-06T02:30:54.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.603+0000 7f3d36c4b700 1 -- start start 2023-10-06T02:30:54.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.604+0000 7f3d36c4b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d30157240 0x7f3d30157610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.604+0000 7f3d2ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3d300b11b0 0x7f3d300ce870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44650/0 (socket says 172.21.15.6:44650) 2023-10-06T02:30:54.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.604+0000 7f3d36c4b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d300ad960 con 0x7f3d300b11b0 2023-10-06T02:30:54.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.604+0000 7f3d2ffff700 1 -- 172.21.15.6:0/1563877891 learned_addr learned my addr 172.21.15.6:0/1563877891 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:54.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.604+0000 7f3d36c4b700 1 -- 172.21.15.6:0/1563877891 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d300adc40 con 0x7f3d3015b0f0 2023-10-06T02:30:54.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.604+0000 7f3d36c4b700 1 -- 172.21.15.6:0/1563877891 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d300adf20 con 0x7f3d30157240 2023-10-06T02:30:54.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d349e7700 1 --2- 172.21.15.6:0/1563877891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d30157240 0x7f3d30157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d2f7fe700 1 -- 172.21.15.6:0/1563877891 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271253702 0 0) 0x7f3d300ad960 con 0x7f3d300b11b0 2023-10-06T02:30:54.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d2f7fe700 1 -- 172.21.15.6:0/1563877891 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d1c003570 con 0x7f3d300b11b0 2023-10-06T02:30:54.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d2f7fe700 1 -- 172.21.15.6:0/1563877891 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4086977626 0 0) 0x7f3d1c003570 con 0x7f3d300b11b0 2023-10-06T02:30:54.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d2f7fe700 1 -- 172.21.15.6:0/1563877891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d30157240 msgr2=0x7f3d30157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:54.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d2f7fe700 1 --2- 172.21.15.6:0/1563877891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d30157240 0x7f3d30157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d2f7fe700 1 -- 172.21.15.6:0/1563877891 >> v1:172.21.15.175:6789/0 conn(0x7f3d3015b0f0 legacy=0x7f3d3015b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d2f7fe700 1 -- 172.21.15.6:0/1563877891 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d300ae200 con 0x7f3d300b11b0 2023-10-06T02:30:54.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d2f7fe700 1 -- 172.21.15.6:0/1563877891 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3060668455 0 0) 0x7f3d200017f0 con 0x7f3d300b11b0 2023-10-06T02:30:54.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d2f7fe700 1 -- 172.21.15.6:0/1563877891 >> v1:172.21.15.6:6789/0 conn(0x7f3d300b11b0 legacy=0x7f3d300ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d2f7fe700 1 --2- 172.21.15.6:0/1563877891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d30157240 0x7f3d1c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d2f7fe700 1 --2- 172.21.15.6:0/1563877891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d1c004010 0x7f3d1c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d2f7fe700 1 --2- 172.21.15.6:0/1563877891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d1c004d50 0x7f3d1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d2f7fe700 1 -- 172.21.15.6:0/1563877891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d300adf20 con 0x7f3d1c004d50 2023-10-06T02:30:54.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d2f7fe700 1 -- 172.21.15.6:0/1563877891 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c00bbf0 con 0x7f3d1c004010 2023-10-06T02:30:54.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d2f7fe700 1 -- 172.21.15.6:0/1563877891 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c00bdb0 con 0x7f3d30157240 2023-10-06T02:30:54.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d351e8700 1 --2- 172.21.15.6:0/1563877891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d1c004d50 0x7f3d1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d2ffff700 1 --2- 172.21.15.6:0/1563877891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d1c004010 0x7f3d1c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.605+0000 7f3d349e7700 1 --2- 172.21.15.6:0/1563877891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d30157240 0x7f3d1c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.606+0000 7f3d351e8700 1 -- 172.21.15.6:0/1563877891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d30157240 msgr2=0x7f3d1c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:54.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.606+0000 7f3d351e8700 1 --2- 172.21.15.6:0/1563877891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d30157240 0x7f3d1c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.606+0000 7f3d351e8700 1 -- 172.21.15.6:0/1563877891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d1c004010 msgr2=0x7f3d1c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:54.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.606+0000 7f3d351e8700 1 --2- 172.21.15.6:0/1563877891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d1c004010 0x7f3d1c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.606+0000 7f3d351e8700 1 -- 172.21.15.6:0/1563877891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c003570 con 0x7f3d1c004d50 2023-10-06T02:30:54.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.606+0000 7f3d351e8700 1 --2- 172.21.15.6:0/1563877891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d1c004d50 0x7f3d1c0051c0 secure :-1 s=READY pgs=2617 cs=0 l=1 rev1=1 crypto rx=0x7f3d18001880 tx=0x7f3d18007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ab550286092dda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:54.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.606+0000 7f3d2f7fe700 1 -- 172.21.15.6:0/1563877891 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d18012420 con 0x7f3d1c004d50 2023-10-06T02:30:54.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.606+0000 7f3d2f7fe700 1 -- 172.21.15.6:0/1563877891 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d18012580 con 0x7f3d1c004d50 2023-10-06T02:30:54.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.606+0000 7f3d2f7fe700 1 -- 172.21.15.6:0/1563877891 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d18012920 con 0x7f3d1c004d50 2023-10-06T02:30:54.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.606+0000 7f3d36c4b700 1 -- 172.21.15.6:0/1563877891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d1c004d50 msgr2=0x7f3d1c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.606+0000 7f3d36c4b700 1 --2- 172.21.15.6:0/1563877891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d1c004d50 0x7f3d1c0051c0 secure :-1 s=READY pgs=2617 cs=0 l=1 rev1=1 crypto rx=0x7f3d18001880 tx=0x7f3d18007d30 comp rx=0 tx=0).stop 2023-10-06T02:30:54.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.606+0000 7f3d351e8700 1 -- 172.21.15.6:0/1563877891 reap_dead start 2023-10-06T02:30:54.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.606+0000 7f3d36c4b700 1 -- 172.21.15.6:0/1563877891 shutdown_connections 2023-10-06T02:30:54.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.606+0000 7f3d36c4b700 1 -- 172.21.15.6:0/1563877891 >> 172.21.15.6:0/1563877891 conn(0x7f3d30067910 msgr2=0x7f3d300ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:54.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.607+0000 7f3d36c4b700 1 -- 172.21.15.6:0/1563877891 shutdown_connections 2023-10-06T02:30:54.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.607+0000 7f3d36c4b700 1 -- 172.21.15.6:0/1563877891 wait complete. 2023-10-06T02:30:54.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.608+0000 7f3d36c4b700 1 Processor -- start 2023-10-06T02:30:54.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.608+0000 7f3d36c4b700 1 -- start start 2023-10-06T02:30:54.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.608+0000 7f3d36c4b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d1c004d50 0x7f3d3014bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.608+0000 7f3d36c4b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d300ac380 0x7f3d300ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.608+0000 7f3d36c4b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d3014b1d0 0x7f3d30150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.608+0000 7f3d36c4b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d300abad0 con 0x7f3d3014b1d0 2023-10-06T02:30:54.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.608+0000 7f3d36c4b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3014c390 con 0x7f3d300ac380 2023-10-06T02:30:54.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.608+0000 7f3d36c4b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d300ac7f0 con 0x7f3d1c004d50 2023-10-06T02:30:54.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.609+0000 7f3d351e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d3014b1d0 0x7f3d30150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.609+0000 7f3d351e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d3014b1d0 0x7f3d30150cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44866/0 (socket says 172.21.15.6:44866) 2023-10-06T02:30:54.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.609+0000 7f3d351e8700 1 -- 172.21.15.6:0/936148454 learned_addr learned my addr 172.21.15.6:0/936148454 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:54.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.609+0000 7f3d349e7700 1 --2- 172.21.15.6:0/936148454 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d1c004d50 0x7f3d3014bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.609+0000 7f3d2ffff700 1 --2- 172.21.15.6:0/936148454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d300ac380 0x7f3d300ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.609+0000 7f3d351e8700 1 -- 172.21.15.6:0/936148454 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d1c004d50 msgr2=0x7f3d3014bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.609+0000 7f3d351e8700 1 --2- 172.21.15.6:0/936148454 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d1c004d50 0x7f3d3014bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.609+0000 7f3d351e8700 1 -- 172.21.15.6:0/936148454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d300ac380 msgr2=0x7f3d300ab590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.609+0000 7f3d351e8700 1 --2- 172.21.15.6:0/936148454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d300ac380 0x7f3d300ab590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.609+0000 7f3d351e8700 1 -- 172.21.15.6:0/936148454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d300aca80 con 0x7f3d3014b1d0 2023-10-06T02:30:54.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.609+0000 7f3d349e7700 1 --2- 172.21.15.6:0/936148454 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d1c004d50 0x7f3d3014bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:30:54.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.609+0000 7f3d351e8700 1 --2- 172.21.15.6:0/936148454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d3014b1d0 0x7f3d30150cb0 secure :-1 s=READY pgs=2618 cs=0 l=1 rev1=1 crypto rx=0x7f3d18000ea0 tx=0x7f3d18015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:54.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.609+0000 7f3d2cff9700 1 -- 172.21.15.6:0/936148454 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d18023070 con 0x7f3d3014b1d0 2023-10-06T02:30:54.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.609+0000 7f3d2cff9700 1 -- 172.21.15.6:0/936148454 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d18001200 con 0x7f3d3014b1d0 2023-10-06T02:30:54.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.609+0000 7f3d36c4b700 1 -- 172.21.15.6:0/936148454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d300acd60 con 0x7f3d3014b1d0 2023-10-06T02:30:54.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.609+0000 7f3d2cff9700 1 -- 172.21.15.6:0/936148454 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d18012420 con 0x7f3d3014b1d0 2023-10-06T02:30:54.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.609+0000 7f3d36c4b700 1 -- 172.21.15.6:0/936148454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d300ab070 con 0x7f3d3014b1d0 2023-10-06T02:30:54.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.610+0000 7f3d36c4b700 1 -- 172.21.15.6:0/936148454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d300aabf0 con 0x7f3d3014b1d0 2023-10-06T02:30:54.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.611+0000 7f3d2cff9700 1 -- 172.21.15.6:0/936148454 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d18019070 con 0x7f3d3014b1d0 2023-10-06T02:30:54.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.611+0000 7f3d2cff9700 1 --2- 172.21.15.6:0/936148454 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3d10066f30 0x7f3d100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.611+0000 7f3d2cff9700 1 -- 172.21.15.6:0/936148454 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f3d18085110 con 0x7f3d3014b1d0 2023-10-06T02:30:54.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.611+0000 7f3d2cff9700 1 --2- 172.21.15.6:0/936148454 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7f3d1006d8f0 0x7f3d1006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.611+0000 7f3d2cff9700 1 -- 172.21.15.6:0/936148454 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d100703f0 con 0x7f3d1006d8f0 2023-10-06T02:30:54.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.611+0000 7f3d2cff9700 1 -- 172.21.15.6:0/936148454 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=152) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d18087750 con 0x7f3d3014b1d0 2023-10-06T02:30:54.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.611+0000 7f3d349e7700 1 --2- 172.21.15.6:0/936148454 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3d10066f30 0x7f3d100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.611+0000 7f3d2ffff700 1 --2- 172.21.15.6:0/936148454 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7f3d1006d8f0 0x7f3d1006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.612+0000 7f3d349e7700 1 --2- 172.21.15.6:0/936148454 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3d10066f30 0x7f3d100693e0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f3d28006f00 tx=0x7f3d280091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:54.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.612+0000 7f3d2ffff700 1 --2- 172.21.15.6:0/936148454 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7f3d1006d8f0 0x7f3d1006fd20 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:54.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.613+0000 7f3d2cff9700 1 -- 172.21.15.6:0/936148454 <== osd.6 v2:172.21.15.175:6813/90867 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f3d100703f0 con 0x7f3d1006d8f0 2023-10-06T02:30:54.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.626+0000 7f3d36c4b700 1 -- 172.21.15.6:0/936148454 --> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3d3006e940 con 0x7f3d1006d8f0 2023-10-06T02:30:54.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.627+0000 7f3d2cff9700 1 -- 172.21.15.6:0/936148454 <== osd.6 v2:172.21.15.175:6813/90867 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3d3006e940 con 0x7f3d1006d8f0 2023-10-06T02:30:54.628 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:30:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T02:30:54.628 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:30:54.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.627+0000 7f3d36c4b700 1 -- 172.21.15.6:0/936148454 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7f3d1006d8f0 msgr2=0x7f3d1006fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.627+0000 7f3d36c4b700 1 --2- 172.21.15.6:0/936148454 >> [v2:172.21.15.175:6813/90867,v1:172.21.15.175:6815/90867] conn(0x7f3d1006d8f0 0x7f3d1006fd20 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.627+0000 7f3d36c4b700 1 -- 172.21.15.6:0/936148454 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3d10066f30 msgr2=0x7f3d100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.627+0000 7f3d36c4b700 1 --2- 172.21.15.6:0/936148454 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f3d10066f30 0x7f3d100693e0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f3d28006f00 tx=0x7f3d280091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.627+0000 7f3d36c4b700 1 -- 172.21.15.6:0/936148454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d3014b1d0 msgr2=0x7f3d30150cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.627+0000 7f3d36c4b700 1 --2- 172.21.15.6:0/936148454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d3014b1d0 0x7f3d30150cb0 secure :-1 s=READY pgs=2618 cs=0 l=1 rev1=1 crypto rx=0x7f3d18000ea0 tx=0x7f3d18015000 comp rx=0 tx=0).stop 2023-10-06T02:30:54.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.627+0000 7f3d351e8700 1 -- 172.21.15.6:0/936148454 reap_dead start 2023-10-06T02:30:54.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.628+0000 7f3d36c4b700 1 -- 172.21.15.6:0/936148454 shutdown_connections 2023-10-06T02:30:54.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.628+0000 7f3d36c4b700 1 -- 172.21.15.6:0/936148454 >> 172.21.15.6:0/936148454 conn(0x7f3d30067910 msgr2=0x7f3d30154c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:54.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.628+0000 7f3d36c4b700 1 -- 172.21.15.6:0/936148454 shutdown_connections 2023-10-06T02:30:54.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.628+0000 7f3d36c4b700 1 -- 172.21.15.6:0/936148454 wait complete. 2023-10-06T02:30:54.640 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T02:30:54.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.759+0000 7f5fb759e700 1 Processor -- start 2023-10-06T02:30:54.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.759+0000 7f5fb759e700 1 -- start start 2023-10-06T02:30:54.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.760+0000 7f5fb759e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fb813f5f0 0x7f5fb806eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.760+0000 7f5fb759e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5fb80c2310 0x7f5fb80c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.760+0000 7f5fb759e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb80cba90 con 0x7f5fb80aeaf0 2023-10-06T02:30:54.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.760+0000 7f5fb759e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb80c7e90 con 0x7f5fb80c2310 2023-10-06T02:30:54.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.760+0000 7f5fb759e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb80c8170 con 0x7f5fb813f5f0 2023-10-06T02:30:54.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.760+0000 7f5fb5d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5fb80aeaf0 0x7f5fb80c1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44666/0 (socket says 172.21.15.6:44666) 2023-10-06T02:30:54.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.760+0000 7f5fb5d9b700 1 -- 172.21.15.6:0/3502126614 learned_addr learned my addr 172.21.15.6:0/3502126614 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:54.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.760+0000 7f5fb6d9d700 1 --2- 172.21.15.6:0/3502126614 >> v2:172.21.15.175:3300/0 conn(0x7f5fb80c2310 0x7f5fb80c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.760+0000 7f5fb659c700 1 --2- 172.21.15.6:0/3502126614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fb813f5f0 0x7f5fb806eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.760+0000 7f5fb559a700 1 -- 172.21.15.6:0/3502126614 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105133947 0 0) 0x7f5fb80cba90 con 0x7f5fb80aeaf0 2023-10-06T02:30:54.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.761+0000 7f5fb559a700 1 -- 172.21.15.6:0/3502126614 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fa0003570 con 0x7f5fb80aeaf0 2023-10-06T02:30:54.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.761+0000 7f5fb659c700 1 -- 172.21.15.6:0/3502126614 >> v2:172.21.15.175:3300/0 conn(0x7f5fb80c2310 msgr2=0x7f5fb80c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:54.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.761+0000 7f5fb659c700 1 --2- 172.21.15.6:0/3502126614 >> v2:172.21.15.175:3300/0 conn(0x7f5fb80c2310 0x7f5fb80c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.761+0000 7f5fb659c700 1 -- 172.21.15.6:0/3502126614 >> v1:172.21.15.6:6789/0 conn(0x7f5fb80aeaf0 legacy=0x7f5fb80c1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.761+0000 7f5fb559a700 1 -- 172.21.15.6:0/3502126614 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2356084561 0 0) 0x7f5fa0003570 con 0x7f5fb80aeaf0 2023-10-06T02:30:54.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.761+0000 7f5fb659c700 1 -- 172.21.15.6:0/3502126614 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb80c8450 con 0x7f5fb813f5f0 2023-10-06T02:30:54.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.761+0000 7f5fb6d9d700 1 --2- 172.21.15.6:0/3502126614 >> v2:172.21.15.175:3300/0 conn(0x7f5fb80c2310 0x7f5fb80c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:30:54.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.761+0000 7f5fb659c700 1 --2- 172.21.15.6:0/3502126614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fb813f5f0 0x7f5fb806eb70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80098e0 tx=0x7f5fa80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2e6c6e4ae7f1fd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:54.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.761+0000 7f5fb559a700 1 -- 172.21.15.6:0/3502126614 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac001470 con 0x7f5fb813f5f0 2023-10-06T02:30:54.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.761+0000 7f5fb559a700 1 -- 172.21.15.6:0/3502126614 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa8011420 con 0x7f5fb813f5f0 2023-10-06T02:30:54.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.761+0000 7f5fb559a700 1 -- 172.21.15.6:0/3502126614 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa80117c0 con 0x7f5fb813f5f0 2023-10-06T02:30:54.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.762+0000 7f5fb759e700 1 -- 172.21.15.6:0/3502126614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fb813f5f0 msgr2=0x7f5fb806eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.762+0000 7f5fb759e700 1 --2- 172.21.15.6:0/3502126614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fb813f5f0 0x7f5fb806eb70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80098e0 tx=0x7f5fa80091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.762+0000 7f5fb759e700 1 -- 172.21.15.6:0/3502126614 shutdown_connections 2023-10-06T02:30:54.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.762+0000 7f5fb759e700 1 --2- 172.21.15.6:0/3502126614 >> v2:172.21.15.175:3300/0 conn(0x7f5fb80c2310 0x7f5fb80c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.762+0000 7f5fb759e700 1 --2- 172.21.15.6:0/3502126614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fb813f5f0 0x7f5fb806eb70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.762+0000 7f5fb759e700 1 -- 172.21.15.6:0/3502126614 >> 172.21.15.6:0/3502126614 conn(0x7f5fb80cbd50 msgr2=0x7f5fb80cc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:54.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.762+0000 7f5fb759e700 1 -- 172.21.15.6:0/3502126614 shutdown_connections 2023-10-06T02:30:54.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.762+0000 7f5fb759e700 1 -- 172.21.15.6:0/3502126614 wait complete. 2023-10-06T02:30:54.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.763+0000 7f5fb759e700 1 Processor -- start 2023-10-06T02:30:54.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.763+0000 7f5fb759e700 1 -- start start 2023-10-06T02:30:54.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.763+0000 7f5fb759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fb80aeaf0 0x7f5fb80a5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.763+0000 7f5fb759e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fb80c2310 0x7f5fb80adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb759e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb813f5f0 0x7f5fb80a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb81679f0 con 0x7f5fb80aeaf0 2023-10-06T02:30:54.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb759e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb80a6320 con 0x7f5fb813f5f0 2023-10-06T02:30:54.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb759e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb80a65a0 con 0x7f5fb80c2310 2023-10-06T02:30:54.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fb80aeaf0 0x7f5fb80a5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fb80aeaf0 0x7f5fb80a5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44878/0 (socket says 172.21.15.6:44878) 2023-10-06T02:30:54.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb659c700 1 -- 172.21.15.6:0/4258927255 learned_addr learned my addr 172.21.15.6:0/4258927255 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:54.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb5d9b700 1 --2- 172.21.15.6:0/4258927255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fb80c2310 0x7f5fb80adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb6d9d700 1 --2- 172.21.15.6:0/4258927255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb813f5f0 0x7f5fb80a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb659c700 1 -- 172.21.15.6:0/4258927255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fb80c2310 msgr2=0x7f5fb80adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb659c700 1 --2- 172.21.15.6:0/4258927255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fb80c2310 0x7f5fb80adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb659c700 1 -- 172.21.15.6:0/4258927255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb813f5f0 msgr2=0x7f5fb80a5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb659c700 1 --2- 172.21.15.6:0/4258927255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb813f5f0 0x7f5fb80a5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb659c700 1 -- 172.21.15.6:0/4258927255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb0009a20 con 0x7f5fb80aeaf0 2023-10-06T02:30:54.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb5d9b700 1 --2- 172.21.15.6:0/4258927255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fb80c2310 0x7f5fb80adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:54.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb6d9d700 1 --2- 172.21.15.6:0/4258927255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb813f5f0 0x7f5fb80a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:54.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb659c700 1 --2- 172.21.15.6:0/4258927255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fb80aeaf0 0x7f5fb80a5020 secure :-1 s=READY pgs=2620 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80030c0 tx=0x7f5fa8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:54.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fa67fc700 1 -- 172.21.15.6:0/4258927255 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa801cc90 con 0x7f5fb80aeaf0 2023-10-06T02:30:54.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fa67fc700 1 -- 172.21.15.6:0/4258927255 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa801cdf0 con 0x7f5fb80aeaf0 2023-10-06T02:30:54.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb759e700 1 -- 172.21.15.6:0/4258927255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa8009420 con 0x7f5fb80aeaf0 2023-10-06T02:30:54.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fa67fc700 1 -- 172.21.15.6:0/4258927255 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa801a6a0 con 0x7f5fb80aeaf0 2023-10-06T02:30:54.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.764+0000 7f5fb759e700 1 -- 172.21.15.6:0/4258927255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb80a6b60 con 0x7f5fb80aeaf0 2023-10-06T02:30:54.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.765+0000 7f5fb759e700 1 -- 172.21.15.6:0/4258927255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb80ae380 con 0x7f5fb80aeaf0 2023-10-06T02:30:54.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.766+0000 7f5fa67fc700 1 -- 172.21.15.6:0/4258927255 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fa801aad0 con 0x7f5fb80aeaf0 2023-10-06T02:30:54.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.766+0000 7f5fa67fc700 1 --2- 172.21.15.6:0/4258927255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f98066f30 0x7f5f980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:54.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.766+0000 7f5fa67fc700 1 -- 172.21.15.6:0/4258927255 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f5fa8085f10 con 0x7f5fb80aeaf0 2023-10-06T02:30:54.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.766+0000 7f5fb5d9b700 1 --2- 172.21.15.6:0/4258927255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f98066f30 0x7f5f980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:54.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.767+0000 7f5fb5d9b700 1 --2- 172.21.15.6:0/4258927255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f98066f30 0x7f5f980693e0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0011e0 tx=0x7f5fac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:54.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.770+0000 7f5fa67fc700 1 -- 172.21.15.6:0/4258927255 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fa8053180 con 0x7f5fb80aeaf0 2023-10-06T02:30:54.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.965+0000 7f5fb759e700 1 -- 172.21.15.6:0/4258927255 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fb80c6640 con 0x7f5f98066f30 2023-10-06T02:30:54.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.966+0000 7f5fa67fc700 1 -- 172.21.15.6:0/4258927255 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5fb80c6640 con 0x7f5f98066f30 2023-10-06T02:30:54.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.968+0000 7f5fb759e700 1 -- 172.21.15.6:0/4258927255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f98066f30 msgr2=0x7f5f980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.968+0000 7f5fb759e700 1 --2- 172.21.15.6:0/4258927255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f98066f30 0x7f5f980693e0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0011e0 tx=0x7f5fac009040 comp rx=0 tx=0).stop 2023-10-06T02:30:54.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.968+0000 7f5fb759e700 1 -- 172.21.15.6:0/4258927255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fb80aeaf0 msgr2=0x7f5fb80a5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:54.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.968+0000 7f5fb759e700 1 --2- 172.21.15.6:0/4258927255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fb80aeaf0 0x7f5fb80a5020 secure :-1 s=READY pgs=2620 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80030c0 tx=0x7f5fa8016000 comp rx=0 tx=0).stop 2023-10-06T02:30:54.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.968+0000 7f5fb759e700 1 -- 172.21.15.6:0/4258927255 shutdown_connections 2023-10-06T02:30:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.968+0000 7f5fb759e700 1 --2- 172.21.15.6:0/4258927255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb813f5f0 0x7f5fb80a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.968+0000 7f5fb759e700 1 --2- 172.21.15.6:0/4258927255 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f5f98066f30 0x7f5f980693e0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.968+0000 7f5fb759e700 1 --2- 172.21.15.6:0/4258927255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fb80aeaf0 0x7f5fb80a5020 unknown :-1 s=CLOSED pgs=2620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.968+0000 7f5fb759e700 1 --2- 172.21.15.6:0/4258927255 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fb80c2310 0x7f5fb80adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.968+0000 7f5fb759e700 1 -- 172.21.15.6:0/4258927255 >> 172.21.15.6:0/4258927255 conn(0x7f5fb80cbd50 msgr2=0x7f5fb806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.968+0000 7f5fb759e700 1 -- 172.21.15.6:0/4258927255 shutdown_connections 2023-10-06T02:30:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:54.968+0000 7f5fb759e700 1 -- 172.21.15.6:0/4258927255 wait complete. 2023-10-06T02:30:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T02:30:54.980 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T02:30:54.980 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:30:55.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.102+0000 7f8585313700 1 Processor -- start 2023-10-06T02:30:55.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.102+0000 7f8585313700 1 -- start start 2023-10-06T02:30:55.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.103+0000 7f8585313700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8580142df0 0x7f85800cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.103+0000 7f8585313700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85800cc890 0x7f85800d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.103+0000 7f8585313700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858015a710 con 0x7f85800d07a0 2023-10-06T02:30:55.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.103+0000 7f8585313700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85800d0c40 con 0x7f8580142df0 2023-10-06T02:30:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.103+0000 7f8585313700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8580159b40 con 0x7f85800cc890 2023-10-06T02:30:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.103+0000 7f857effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8580142df0 0x7f85800cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.103+0000 7f857effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8580142df0 0x7f85800cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44888/0 (socket says 172.21.15.6:44888) 2023-10-06T02:30:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.103+0000 7f857effd700 1 -- 172.21.15.6:0/585313498 learned_addr learned my addr 172.21.15.6:0/585313498 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.103+0000 7f857e7fc700 1 --2- 172.21.15.6:0/585313498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85800cc890 0x7f85800d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.103+0000 7f857effd700 1 -- 172.21.15.6:0/585313498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85800cc890 msgr2=0x7f85800d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.103+0000 7f857effd700 1 --2- 172.21.15.6:0/585313498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85800cc890 0x7f85800d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.103+0000 7f857effd700 1 -- 172.21.15.6:0/585313498 >> v1:172.21.15.175:6789/0 conn(0x7f85800d07a0 legacy=0x7f85800cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.103+0000 7f857effd700 1 -- 172.21.15.6:0/585313498 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8580159de0 con 0x7f8580142df0 2023-10-06T02:30:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.103+0000 7f857e7fc700 1 --2- 172.21.15.6:0/585313498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85800cc890 0x7f85800d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.103+0000 7f857effd700 1 --2- 172.21.15.6:0/585313498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8580142df0 0x7f85800cc350 secure :-1 s=READY pgs=2621 cs=0 l=1 rev1=1 crypto rx=0x7f8578009f20 tx=0x7f8578009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef87fb5bd308509 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.104+0000 7f857dffb700 1 -- 172.21.15.6:0/585313498 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857800e070 con 0x7f8580142df0 2023-10-06T02:30:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.104+0000 7f857dffb700 1 -- 172.21.15.6:0/585313498 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857800ba40 con 0x7f8580142df0 2023-10-06T02:30:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.104+0000 7f857dffb700 1 -- 172.21.15.6:0/585313498 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85780092e0 con 0x7f8580142df0 2023-10-06T02:30:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.104+0000 7f8585313700 1 -- 172.21.15.6:0/585313498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8580142df0 msgr2=0x7f85800cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.104+0000 7f8585313700 1 --2- 172.21.15.6:0/585313498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8580142df0 0x7f85800cc350 secure :-1 s=READY pgs=2621 cs=0 l=1 rev1=1 crypto rx=0x7f8578009f20 tx=0x7f8578009840 comp rx=0 tx=0).stop 2023-10-06T02:30:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.104+0000 7f8585313700 1 -- 172.21.15.6:0/585313498 shutdown_connections 2023-10-06T02:30:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.104+0000 7f8585313700 1 --2- 172.21.15.6:0/585313498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8580142df0 0x7f85800cc350 unknown :-1 s=CLOSED pgs=2621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.104+0000 7f8585313700 1 --2- 172.21.15.6:0/585313498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85800cc890 0x7f85800d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.104+0000 7f8585313700 1 -- 172.21.15.6:0/585313498 >> 172.21.15.6:0/585313498 conn(0x7f85800690f0 msgr2=0x7f858006a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.104+0000 7f8585313700 1 -- 172.21.15.6:0/585313498 shutdown_connections 2023-10-06T02:30:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.104+0000 7f8585313700 1 -- 172.21.15.6:0/585313498 wait complete. 2023-10-06T02:30:55.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.106+0000 7f8585313700 1 Processor -- start 2023-10-06T02:30:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.106+0000 7f8585313700 1 -- start start 2023-10-06T02:30:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.106+0000 7f8585313700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85800cc890 0x7f8580140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.106+0000 7f8585313700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85800d07a0 0x7f85801540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.106+0000 7f8585313700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8580142df0 0x7f85800b4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.106+0000 7f8585313700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85801555f0 con 0x7f8580142df0 2023-10-06T02:30:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.106+0000 7f8585313700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85801549e0 con 0x7f85800d07a0 2023-10-06T02:30:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.106+0000 7f8585313700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8580154cc0 con 0x7f85800cc890 2023-10-06T02:30:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.106+0000 7f857f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8580142df0 0x7f85800b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.107+0000 7f857f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8580142df0 0x7f85800b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44894/0 (socket says 172.21.15.6:44894) 2023-10-06T02:30:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.107+0000 7f857f7fe700 1 -- 172.21.15.6:0/3619237341 learned_addr learned my addr 172.21.15.6:0/3619237341 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.107+0000 7f857effd700 1 --2- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85800cc890 0x7f8580140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.107+0000 7f857e7fc700 1 --2- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85800d07a0 0x7f85801540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.107+0000 7f857f7fe700 1 -- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85800cc890 msgr2=0x7f8580140cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:55.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.107+0000 7f857f7fe700 1 --2- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85800cc890 0x7f8580140cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.107+0000 7f857f7fe700 1 -- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85800d07a0 msgr2=0x7f85801540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:55.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.107+0000 7f857f7fe700 1 --2- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85800d07a0 0x7f85801540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.107+0000 7f857f7fe700 1 -- 172.21.15.6:0/3619237341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8578009ae0 con 0x7f8580142df0 2023-10-06T02:30:55.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.107+0000 7f857effd700 1 --2- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85800cc890 0x7f8580140cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:55.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.107+0000 7f857e7fc700 1 --2- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85800d07a0 0x7f85801540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:55.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.107+0000 7f857f7fe700 1 --2- 172.21.15.6:0/3619237341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8580142df0 0x7f85800b4550 secure :-1 s=READY pgs=2622 cs=0 l=1 rev1=1 crypto rx=0x7f857000b4e0 tx=0x7f8570006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:55.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.107+0000 7f8576ffd700 1 -- 172.21.15.6:0/3619237341 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857000f5e0 con 0x7f8580142df0 2023-10-06T02:30:55.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.107+0000 7f8576ffd700 1 -- 172.21.15.6:0/3619237341 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857000f740 con 0x7f8580142df0 2023-10-06T02:30:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.107+0000 7f8585313700 1 -- 172.21.15.6:0/3619237341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8580154fa0 con 0x7f8580142df0 2023-10-06T02:30:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.107+0000 7f8576ffd700 1 -- 172.21.15.6:0/3619237341 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857000fb00 con 0x7f8580142df0 2023-10-06T02:30:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.107+0000 7f8585313700 1 -- 172.21.15.6:0/3619237341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8580141210 con 0x7f8580142df0 2023-10-06T02:30:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.108+0000 7f8585313700 1 -- 172.21.15.6:0/3619237341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8580088ad0 con 0x7f8580142df0 2023-10-06T02:30:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.109+0000 7f8576ffd700 1 -- 172.21.15.6:0/3619237341 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f857001a400 con 0x7f8580142df0 2023-10-06T02:30:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.109+0000 7f8576ffd700 1 --2- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8560066f30 0x7f85600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.109+0000 7f8576ffd700 1 -- 172.21.15.6:0/3619237341 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f85700840f0 con 0x7f8580142df0 2023-10-06T02:30:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.109+0000 7f8576ffd700 1 --2- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7f856006d8f0 0x7f856006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.109+0000 7f8576ffd700 1 -- 172.21.15.6:0/3619237341 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85600703f0 con 0x7f856006d8f0 2023-10-06T02:30:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.109+0000 7f8576ffd700 1 -- 172.21.15.6:0/3619237341 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=152) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8570086730 con 0x7f8580142df0 2023-10-06T02:30:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.109+0000 7f857effd700 1 --2- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8560066f30 0x7f85600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.109+0000 7f857e7fc700 1 --2- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7f856006d8f0 0x7f856006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.110+0000 7f857e7fc700 1 --2- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7f856006d8f0 0x7f856006fd20 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.110+0000 7f857effd700 1 --2- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8560066f30 0x7f85600693e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f8578009ab0 tx=0x7f8578017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.110+0000 7f8576ffd700 1 -- 172.21.15.6:0/3619237341 <== osd.7 v2:172.21.15.175:6824/90910 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f85600703f0 con 0x7f856006d8f0 2023-10-06T02:30:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.124+0000 7f8585313700 1 -- 172.21.15.6:0/3619237341 --> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f858015a0c0 con 0x7f856006d8f0 2023-10-06T02:30:55.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.125+0000 7f8576ffd700 1 -- 172.21.15.6:0/3619237341 <== osd.7 v2:172.21.15.175:6824/90910 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f858015a0c0 con 0x7f856006d8f0 2023-10-06T02:30:55.126 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-06T02:30:55.126 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T02:30:55.126 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-06T02:30:55.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.125+0000 7f8585313700 1 -- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7f856006d8f0 msgr2=0x7f856006fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:55.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.125+0000 7f8585313700 1 --2- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:6824/90910,v1:172.21.15.175:6825/90910] conn(0x7f856006d8f0 0x7f856006fd20 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.125+0000 7f8585313700 1 -- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8560066f30 msgr2=0x7f85600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:55.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.125+0000 7f8585313700 1 --2- 172.21.15.6:0/3619237341 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f8560066f30 0x7f85600693e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f8578009ab0 tx=0x7f8578017000 comp rx=0 tx=0).stop 2023-10-06T02:30:55.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.126+0000 7f8585313700 1 -- 172.21.15.6:0/3619237341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8580142df0 msgr2=0x7f85800b4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:55.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.126+0000 7f8585313700 1 --2- 172.21.15.6:0/3619237341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8580142df0 0x7f85800b4550 secure :-1 s=READY pgs=2622 cs=0 l=1 rev1=1 crypto rx=0x7f857000b4e0 tx=0x7f8570006f90 comp rx=0 tx=0).stop 2023-10-06T02:30:55.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.126+0000 7f857f7fe700 1 -- 172.21.15.6:0/3619237341 reap_dead start 2023-10-06T02:30:55.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.126+0000 7f8585313700 1 -- 172.21.15.6:0/3619237341 shutdown_connections 2023-10-06T02:30:55.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.126+0000 7f8585313700 1 -- 172.21.15.6:0/3619237341 >> 172.21.15.6:0/3619237341 conn(0x7f85800690f0 msgr2=0x7f858015cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:55.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.126+0000 7f8585313700 1 -- 172.21.15.6:0/3619237341 shutdown_connections 2023-10-06T02:30:55.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.126+0000 7f8585313700 1 -- 172.21.15.6:0/3619237341 wait complete. 2023-10-06T02:30:55.138 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T02:30:55.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.257+0000 7fd9f923a700 1 Processor -- start 2023-10-06T02:30:55.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.257+0000 7fd9f923a700 1 -- start start 2023-10-06T02:30:55.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.258+0000 7fd9f923a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd9f4155b70 0x7fd9f40ad510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.258+0000 7fd9f923a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9f4155f40 0x7fd9f40ada50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.258+0000 7fd9f923a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd9f40c8970 0x7fd9f40c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.258+0000 7fd9f923a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f40abd90 con 0x7fd9f40c8970 2023-10-06T02:30:55.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.258+0000 7fd9f923a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f40c96e0 con 0x7fd9f4155b70 2023-10-06T02:30:55.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.258+0000 7fd9f923a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40c99c0 con 0x7fd9f4155f40 2023-10-06T02:30:55.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.258+0000 7fd9f359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd9f40c8970 0x7fd9f40c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.258+0000 7fd9f359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd9f40c8970 0x7fd9f40c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44898/0 (socket says 172.21.15.6:44898) 2023-10-06T02:30:55.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.258+0000 7fd9f359e700 1 -- 172.21.15.6:0/358784148 learned_addr learned my addr 172.21.15.6:0/358784148 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:55.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.258+0000 7fd9f259c700 1 --2- 172.21.15.6:0/358784148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9f4155f40 0x7fd9f40ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.258+0000 7fd9f2d9d700 1 --2- 172.21.15.6:0/358784148 >> v2:172.21.15.175:3300/0 conn(0x7fd9f4155b70 0x7fd9f40ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.258+0000 7fd9f359e700 1 -- 172.21.15.6:0/358784148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9f4155f40 msgr2=0x7fd9f40ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:55.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.258+0000 7fd9f359e700 1 --2- 172.21.15.6:0/358784148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9f4155f40 0x7fd9f40ada50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.258+0000 7fd9f359e700 1 -- 172.21.15.6:0/358784148 >> v2:172.21.15.175:3300/0 conn(0x7fd9f4155b70 msgr2=0x7fd9f40ad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:55.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.258+0000 7fd9f359e700 1 --2- 172.21.15.6:0/358784148 >> v2:172.21.15.175:3300/0 conn(0x7fd9f4155b70 0x7fd9f40ad510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.258+0000 7fd9f359e700 1 -- 172.21.15.6:0/358784148 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f40ab740 con 0x7fd9f40c8970 2023-10-06T02:30:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.259+0000 7fd9f359e700 1 --2- 172.21.15.6:0/358784148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9f40c8970 0x7fd9f40c8e10 secure :-1 s=READY pgs=2623 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4065ff0 tx=0x7fd9e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0352895e325e36b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.259+0000 7fd9f1d9b700 1 -- 172.21.15.6:0/358784148 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e400e070 con 0x7fd9f40c8970 2023-10-06T02:30:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.259+0000 7fd9f1d9b700 1 -- 172.21.15.6:0/358784148 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e400bae0 con 0x7fd9f40c8970 2023-10-06T02:30:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.259+0000 7fd9f1d9b700 1 -- 172.21.15.6:0/358784148 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e40092e0 con 0x7fd9f40c8970 2023-10-06T02:30:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.259+0000 7fd9f923a700 1 -- 172.21.15.6:0/358784148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9f40c8970 msgr2=0x7fd9f40c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.259+0000 7fd9f923a700 1 --2- 172.21.15.6:0/358784148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9f40c8970 0x7fd9f40c8e10 secure :-1 s=READY pgs=2623 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4065ff0 tx=0x7fd9e4009840 comp rx=0 tx=0).stop 2023-10-06T02:30:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.259+0000 7fd9f923a700 1 -- 172.21.15.6:0/358784148 shutdown_connections 2023-10-06T02:30:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.259+0000 7fd9f923a700 1 --2- 172.21.15.6:0/358784148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9f40c8970 0x7fd9f40c8e10 unknown :-1 s=CLOSED pgs=2623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.259+0000 7fd9f923a700 1 --2- 172.21.15.6:0/358784148 >> v2:172.21.15.175:3300/0 conn(0x7fd9f4155b70 0x7fd9f40ad510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.259+0000 7fd9f923a700 1 --2- 172.21.15.6:0/358784148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9f4155f40 0x7fd9f40ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.259+0000 7fd9f923a700 1 -- 172.21.15.6:0/358784148 >> 172.21.15.6:0/358784148 conn(0x7fd9f4069110 msgr2=0x7fd9f40cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.259+0000 7fd9f923a700 1 -- 172.21.15.6:0/358784148 shutdown_connections 2023-10-06T02:30:55.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.259+0000 7fd9f923a700 1 -- 172.21.15.6:0/358784148 wait complete. 2023-10-06T02:30:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.261+0000 7fd9f923a700 1 Processor -- start 2023-10-06T02:30:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.261+0000 7fd9f923a700 1 -- start start 2023-10-06T02:30:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.261+0000 7fd9f923a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9f40c8970 0x7fd9f413d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.261+0000 7fd9f923a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9f4155b70 0x7fd9f40ac220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.261+0000 7fd9f923a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9f4155f40 0x7fd9f40ac760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.261+0000 7fd9f923a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f414c8d0 con 0x7fd9f4155b70 2023-10-06T02:30:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.261+0000 7fd9f923a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f416b430 con 0x7fd9f40c8970 2023-10-06T02:30:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.261+0000 7fd9f923a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f416c1b0 con 0x7fd9f4155f40 2023-10-06T02:30:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.261+0000 7fd9f259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9f4155b70 0x7fd9f40ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.261+0000 7fd9f259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9f4155b70 0x7fd9f40ac220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44906/0 (socket says 172.21.15.6:44906) 2023-10-06T02:30:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.261+0000 7fd9f259c700 1 -- 172.21.15.6:0/412225092 learned_addr learned my addr 172.21.15.6:0/412225092 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.262+0000 7fd9f259c700 1 -- 172.21.15.6:0/412225092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9f4155f40 msgr2=0x7fd9f40ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.262+0000 7fd9f259c700 1 --2- 172.21.15.6:0/412225092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9f4155f40 0x7fd9f40ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.262+0000 7fd9f259c700 1 -- 172.21.15.6:0/412225092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9f40c8970 msgr2=0x7fd9f413d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.262+0000 7fd9f2d9d700 1 --2- 172.21.15.6:0/412225092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9f40c8970 0x7fd9f413d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.262+0000 7fd9f259c700 1 --2- 172.21.15.6:0/412225092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9f40c8970 0x7fd9f413d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.262+0000 7fd9f259c700 1 -- 172.21.15.6:0/412225092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e4009ae0 con 0x7fd9f4155b70 2023-10-06T02:30:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.262+0000 7fd9f2d9d700 1 --2- 172.21.15.6:0/412225092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9f40c8970 0x7fd9f413d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:30:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.262+0000 7fd9f259c700 1 --2- 172.21.15.6:0/412225092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9f4155b70 0x7fd9f40ac220 secure :-1 s=READY pgs=2624 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00c880 tx=0x7fd9dc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.262+0000 7fd9eaffd700 1 -- 172.21.15.6:0/412225092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc011600 con 0x7fd9f4155b70 2023-10-06T02:30:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.262+0000 7fd9eaffd700 1 -- 172.21.15.6:0/412225092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc011780 con 0x7fd9f4155b70 2023-10-06T02:30:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.262+0000 7fd9f923a700 1 -- 172.21.15.6:0/412225092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f416b6d0 con 0x7fd9f4155b70 2023-10-06T02:30:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.262+0000 7fd9eaffd700 1 -- 172.21.15.6:0/412225092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc011b40 con 0x7fd9f4155b70 2023-10-06T02:30:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.262+0000 7fd9f923a700 1 -- 172.21.15.6:0/412225092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f416bc90 con 0x7fd9f4155b70 2023-10-06T02:30:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.263+0000 7fd9f923a700 1 -- 172.21.15.6:0/412225092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f406fcb0 con 0x7fd9f4155b70 2023-10-06T02:30:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.264+0000 7fd9eaffd700 1 -- 172.21.15.6:0/412225092 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9dc018360 con 0x7fd9f4155b70 2023-10-06T02:30:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.264+0000 7fd9eaffd700 1 --2- 172.21.15.6:0/412225092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd9d4066f30 0x7fd9d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.264+0000 7fd9eaffd700 1 -- 172.21.15.6:0/412225092 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fd9dc084230 con 0x7fd9f4155b70 2023-10-06T02:30:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.264+0000 7fd9f2d9d700 1 --2- 172.21.15.6:0/412225092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd9d4066f30 0x7fd9d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.265+0000 7fd9f2d9d700 1 --2- 172.21.15.6:0/412225092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd9d4066f30 0x7fd9d40693e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec008a80 tx=0x7fd9ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.269+0000 7fd9eaffd700 1 -- 172.21.15.6:0/412225092 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9dc054f30 con 0x7fd9f4155b70 2023-10-06T02:30:55.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.465+0000 7fd9f923a700 1 -- 172.21.15.6:0/412225092 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9f416beb0 con 0x7fd9d4066f30 2023-10-06T02:30:55.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.466+0000 7fd9eaffd700 1 -- 172.21.15.6:0/412225092 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd9f416beb0 con 0x7fd9d4066f30 2023-10-06T02:30:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.468+0000 7fd9f923a700 1 -- 172.21.15.6:0/412225092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd9d4066f30 msgr2=0x7fd9d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.468+0000 7fd9f923a700 1 --2- 172.21.15.6:0/412225092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd9d4066f30 0x7fd9d40693e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec008a80 tx=0x7fd9ec008040 comp rx=0 tx=0).stop 2023-10-06T02:30:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.468+0000 7fd9f923a700 1 -- 172.21.15.6:0/412225092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9f4155b70 msgr2=0x7fd9f40ac220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.468+0000 7fd9f923a700 1 --2- 172.21.15.6:0/412225092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9f4155b70 0x7fd9f40ac220 secure :-1 s=READY pgs=2624 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00c880 tx=0x7fd9dc008040 comp rx=0 tx=0).stop 2023-10-06T02:30:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.468+0000 7fd9f923a700 1 -- 172.21.15.6:0/412225092 shutdown_connections 2023-10-06T02:30:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.468+0000 7fd9f923a700 1 --2- 172.21.15.6:0/412225092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9f4155f40 0x7fd9f40ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.468+0000 7fd9f923a700 1 --2- 172.21.15.6:0/412225092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9f40c8970 0x7fd9f413d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.468+0000 7fd9f923a700 1 --2- 172.21.15.6:0/412225092 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd9d4066f30 0x7fd9d40693e0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.468+0000 7fd9f923a700 1 --2- 172.21.15.6:0/412225092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9f4155b70 0x7fd9f40ac220 unknown :-1 s=CLOSED pgs=2624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.468+0000 7fd9f923a700 1 -- 172.21.15.6:0/412225092 >> 172.21.15.6:0/412225092 conn(0x7fd9f4069110 msgr2=0x7fd9f40c7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.468+0000 7fd9f923a700 1 -- 172.21.15.6:0/412225092 shutdown_connections 2023-10-06T02:30:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.468+0000 7fd9f923a700 1 -- 172.21.15.6:0/412225092 wait complete. 2023-10-06T02:30:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T02:30:55.481 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:30:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.599+0000 7f6fc3f17700 1 Processor -- start 2023-10-06T02:30:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.599+0000 7f6fc3f17700 1 -- start start 2023-10-06T02:30:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.600+0000 7f6fc3f17700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6fbc156380 0x7f6fbc06a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.600+0000 7f6fc3f17700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fbc15a420 0x7f6fbc06a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.600+0000 7f6fc3f17700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fbc0cb650 con 0x7f6fbc155fb0 2023-10-06T02:30:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.600+0000 7f6fc3f17700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fbc0caa40 con 0x7f6fbc156380 2023-10-06T02:30:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.600+0000 7f6fc3f17700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc0cad20 con 0x7f6fbc15a420 2023-10-06T02:30:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.600+0000 7f6fc14b2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6fbc156380 0x7f6fbc06a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.601+0000 7f6fc1cb3700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6fbc155fb0 0x7f6fbc159d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44670/0 (socket says 172.21.15.6:44670) 2023-10-06T02:30:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.601+0000 7f6fc1cb3700 1 -- 172.21.15.6:0/4198013124 learned_addr learned my addr 172.21.15.6:0/4198013124 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:30:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.601+0000 7f6fc24b4700 1 --2- 172.21.15.6:0/4198013124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fbc15a420 0x7f6fbc06a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.601+0000 7f6fc14b2700 1 -- 172.21.15.6:0/4198013124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fbc15a420 msgr2=0x7f6fbc06a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:30:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.601+0000 7f6fc14b2700 1 --2- 172.21.15.6:0/4198013124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fbc15a420 0x7f6fbc06a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.601+0000 7f6fc14b2700 1 -- 172.21.15.6:0/4198013124 >> v1:172.21.15.6:6789/0 conn(0x7f6fbc155fb0 legacy=0x7f6fbc159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.601+0000 7f6fc14b2700 1 -- 172.21.15.6:0/4198013124 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc0cb000 con 0x7f6fbc156380 2023-10-06T02:30:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.601+0000 7f6fc0cb1700 1 -- 172.21.15.6:0/4198013124 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192576878 0 0) 0x7f6fbc0cb650 con 0x7f6fbc155fb0 2023-10-06T02:30:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.601+0000 7f6fc14b2700 1 --2- 172.21.15.6:0/4198013124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc156380 0x7f6fbc06a360 secure :-1 s=READY pgs=2626 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00098e0 tx=0x7f6fb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07fd7319015dec1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.601+0000 7f6fc0cb1700 1 -- 172.21.15.6:0/4198013124 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0009e80 con 0x7f6fbc156380 2023-10-06T02:30:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.601+0000 7f6fc0cb1700 1 -- 172.21.15.6:0/4198013124 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb000b860 con 0x7f6fbc156380 2023-10-06T02:30:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.601+0000 7f6fc0cb1700 1 -- 172.21.15.6:0/4198013124 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb000bbe0 con 0x7f6fbc156380 2023-10-06T02:30:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.602+0000 7f6fc3f17700 1 -- 172.21.15.6:0/4198013124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc156380 msgr2=0x7f6fbc06a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.602+0000 7f6fc3f17700 1 --2- 172.21.15.6:0/4198013124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc156380 0x7f6fbc06a360 secure :-1 s=READY pgs=2626 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00098e0 tx=0x7f6fb00091a0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.602+0000 7f6fc3f17700 1 -- 172.21.15.6:0/4198013124 shutdown_connections 2023-10-06T02:30:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.602+0000 7f6fc3f17700 1 --2- 172.21.15.6:0/4198013124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fbc15a420 0x7f6fbc06a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.602+0000 7f6fc3f17700 1 --2- 172.21.15.6:0/4198013124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc156380 0x7f6fbc06a360 unknown :-1 s=CLOSED pgs=2626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.602+0000 7f6fc3f17700 1 -- 172.21.15.6:0/4198013124 >> 172.21.15.6:0/4198013124 conn(0x7f6fbc069100 msgr2=0x7f6fbc0ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.602+0000 7f6fc3f17700 1 -- 172.21.15.6:0/4198013124 shutdown_connections 2023-10-06T02:30:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.602+0000 7f6fc3f17700 1 -- 172.21.15.6:0/4198013124 wait complete. 2023-10-06T02:30:55.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.603+0000 7f6fc3f17700 1 Processor -- start 2023-10-06T02:30:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.603+0000 7f6fc3f17700 1 -- start start 2023-10-06T02:30:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc3f17700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fbc155fb0 0x7f6fbc0ab990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc3f17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc156380 0x7f6fbc169c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc3f17700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fbc15a420 0x7f6fbc0aae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc3f17700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc0acb80 con 0x7f6fbc156380 2023-10-06T02:30:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc3f17700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc0abf70 con 0x7f6fbc155fb0 2023-10-06T02:30:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc3f17700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc0ac250 con 0x7f6fbc15a420 2023-10-06T02:30:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc14b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc156380 0x7f6fbc169c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc14b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc156380 0x7f6fbc169c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44914/0 (socket says 172.21.15.6:44914) 2023-10-06T02:30:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc14b2700 1 -- 172.21.15.6:0/250346537 learned_addr learned my addr 172.21.15.6:0/250346537 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:30:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc1cb3700 1 --2- 172.21.15.6:0/250346537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fbc155fb0 0x7f6fbc0ab990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc24b4700 1 --2- 172.21.15.6:0/250346537 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fbc15a420 0x7f6fbc0aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc14b2700 1 -- 172.21.15.6:0/250346537 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fbc15a420 msgr2=0x7f6fbc0aae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc14b2700 1 --2- 172.21.15.6:0/250346537 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fbc15a420 0x7f6fbc0aae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc14b2700 1 -- 172.21.15.6:0/250346537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fbc155fb0 msgr2=0x7f6fbc0ab990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc14b2700 1 --2- 172.21.15.6:0/250346537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fbc155fb0 0x7f6fbc0ab990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc14b2700 1 -- 172.21.15.6:0/250346537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb0009420 con 0x7f6fbc156380 2023-10-06T02:30:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc1cb3700 1 --2- 172.21.15.6:0/250346537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fbc155fb0 0x7f6fbc0ab990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc24b4700 1 --2- 172.21.15.6:0/250346537 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fbc15a420 0x7f6fbc0aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:30:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.604+0000 7f6fc14b2700 1 --2- 172.21.15.6:0/250346537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc156380 0x7f6fbc169c00 secure :-1 s=READY pgs=2627 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0013000 tx=0x7f6fb0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.605+0000 7f6fb9ffb700 1 -- 172.21.15.6:0/250346537 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb000b9d0 con 0x7f6fbc156380 2023-10-06T02:30:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.605+0000 7f6fb9ffb700 1 -- 172.21.15.6:0/250346537 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb000bb50 con 0x7f6fbc156380 2023-10-06T02:30:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.605+0000 7f6fb9ffb700 1 -- 172.21.15.6:0/250346537 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0026680 con 0x7f6fbc156380 2023-10-06T02:30:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.605+0000 7f6fc3f17700 1 -- 172.21.15.6:0/250346537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fbc0ac530 con 0x7f6fbc156380 2023-10-06T02:30:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.605+0000 7f6fc3f17700 1 -- 172.21.15.6:0/250346537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fbc0ab370 con 0x7f6fbc156380 2023-10-06T02:30:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.606+0000 7f6fc3f17700 1 -- 172.21.15.6:0/250346537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fbc0accf0 con 0x7f6fbc156380 2023-10-06T02:30:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.606+0000 7f6fb9ffb700 1 -- 172.21.15.6:0/250346537 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fb0023030 con 0x7f6fbc156380 2023-10-06T02:30:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.607+0000 7f6fb9ffb700 1 --2- 172.21.15.6:0/250346537 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6fa8066f30 0x7f6fa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:30:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.607+0000 7f6fb9ffb700 1 -- 172.21.15.6:0/250346537 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f6fb0085ec0 con 0x7f6fbc156380 2023-10-06T02:30:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.607+0000 7f6fc1cb3700 1 --2- 172.21.15.6:0/250346537 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6fa8066f30 0x7f6fa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:30:55.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.607+0000 7f6fc1cb3700 1 --2- 172.21.15.6:0/250346537 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6fa8066f30 0x7f6fa80693e0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0ad620 tx=0x7f6fb4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:30:55.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.611+0000 7f6fb9ffb700 1 -- 172.21.15.6:0/250346537 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fb00531b0 con 0x7f6fbc156380 2023-10-06T02:30:55.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.800+0000 7f6fc3f17700 1 -- 172.21.15.6:0/250346537 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6fbc0cb2e0 con 0x7f6fa8066f30 2023-10-06T02:30:55.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.803+0000 7f6fb9ffb700 1 -- 172.21.15.6:0/250346537 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73334 (secure 0 0 0) 0x7f6fbc0cb2e0 con 0x7f6fa8066f30 2023-10-06T02:30:55.804 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:30:55.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.805+0000 7f6fc3f17700 1 -- 172.21.15.6:0/250346537 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6fa8066f30 msgr2=0x7f6fa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:55.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.805+0000 7f6fc3f17700 1 --2- 172.21.15.6:0/250346537 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6fa8066f30 0x7f6fa80693e0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0ad620 tx=0x7f6fb4009040 comp rx=0 tx=0).stop 2023-10-06T02:30:55.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.805+0000 7f6fc3f17700 1 -- 172.21.15.6:0/250346537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc156380 msgr2=0x7f6fbc169c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:30:55.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.805+0000 7f6fc3f17700 1 --2- 172.21.15.6:0/250346537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc156380 0x7f6fbc169c00 secure :-1 s=READY pgs=2627 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0013000 tx=0x7f6fb0017000 comp rx=0 tx=0).stop 2023-10-06T02:30:55.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.805+0000 7f6fc3f17700 1 -- 172.21.15.6:0/250346537 shutdown_connections 2023-10-06T02:30:55.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.805+0000 7f6fc3f17700 1 --2- 172.21.15.6:0/250346537 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fbc15a420 0x7f6fbc0aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.805+0000 7f6fc3f17700 1 --2- 172.21.15.6:0/250346537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fbc155fb0 0x7f6fbc0ab990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.805+0000 7f6fc3f17700 1 --2- 172.21.15.6:0/250346537 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f6fa8066f30 0x7f6fa80693e0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.805+0000 7f6fc3f17700 1 --2- 172.21.15.6:0/250346537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fbc156380 0x7f6fbc169c00 unknown :-1 s=CLOSED pgs=2627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:30:55.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.805+0000 7f6fc3f17700 1 -- 172.21.15.6:0/250346537 >> 172.21.15.6:0/250346537 conn(0x7f6fbc069100 msgr2=0x7f6fbc0b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:30:55.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.806+0000 7f6fc3f17700 1 -- 172.21.15.6:0/250346537 shutdown_connections 2023-10-06T02:30:55.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:30:55.806+0000 7f6fc3f17700 1 -- 172.21.15.6:0/250346537 wait complete. 2023-10-06T02:30:55.809 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:30:55.818 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":545,"stamp":"2023-10-06T02:30:54.759567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2456444,"kb_used_data":16700,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752518276,"statfs":{"total":773094113280,"available":770578714624,"internally_reserved":0,"allocated":17100800,"data_stored":9463037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":-4,"num_read_kb":-4,"num_write":-5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.636684"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":134,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-06T02:30:46.270761+0000","last_change":"2023-10-06T02:17:37.934743+0000","last_active":"2023-10-06T02:30:46.270761+0000","last_peered":"2023-10-06T02:30:46.270761+0000","last_clean":"2023-10-06T02:30:46.270761+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:30:46.270761+0000","last_undegraded":"2023-10-06T02:30:46.270761+0000","last_fullsized":"2023-10-06T02:30:46.270761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":136,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-06T02:30:46.626028+0000","last_change":"2023-10-06T02:17:37.932273+0000","last_active":"2023-10-06T02:30:46.626028+0000","last_peered":"2023-10-06T02:30:46.626028+0000","last_clean":"2023-10-06T02:30:46.626028+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:30:46.626028+0000","last_undegraded":"2023-10-06T02:30:46.626028+0000","last_fullsized":"2023-10-06T02:30:46.626028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":136,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-06T02:30:46.123547+0000","last_change":"2023-10-06T02:17:37.932133+0000","last_active":"2023-10-06T02:30:46.123547+0000","last_peered":"2023-10-06T02:30:46.123547+0000","last_clean":"2023-10-06T02:30:46.123547+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:30:46.123547+0000","last_undegraded":"2023-10-06T02:30:46.123547+0000","last_fullsized":"2023-10-06T02:30:46.123547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":283,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-06T02:30:46.820357+0000","last_change":"2023-10-06T02:17:37.934978+0000","last_active":"2023-10-06T02:30:46.820357+0000","last_peered":"2023-10-06T02:30:46.820357+0000","last_clean":"2023-10-06T02:30:46.820357+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:30:46.820357+0000","last_undegraded":"2023-10-06T02:30:46.820357+0000","last_fullsized":"2023-10-06T02:30:46.820357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:20:53.704635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":133,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-06T02:30:46.820402+0000","last_change":"2023-10-06T02:17:37.932022+0000","last_active":"2023-10-06T02:30:46.820402+0000","last_peered":"2023-10-06T02:30:46.820402+0000","last_clean":"2023-10-06T02:30:46.820402+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:30:46.820402+0000","last_undegraded":"2023-10-06T02:30:46.820402+0000","last_fullsized":"2023-10-06T02:30:46.820402+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:31.380412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":133,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-06T02:30:46.820506+0000","last_change":"2023-10-06T02:17:37.934787+0000","last_active":"2023-10-06T02:30:46.820506+0000","last_peered":"2023-10-06T02:30:46.820506+0000","last_clean":"2023-10-06T02:30:46.820506+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:30:46.820506+0000","last_undegraded":"2023-10-06T02:30:46.820506+0000","last_fullsized":"2023-10-06T02:30:46.820506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:15.316979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":132,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-06T02:30:46.820118+0000","last_change":"2023-10-06T02:17:37.937050+0000","last_active":"2023-10-06T02:30:46.820118+0000","last_peered":"2023-10-06T02:30:46.820118+0000","last_clean":"2023-10-06T02:30:46.820118+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:30:46.820118+0000","last_undegraded":"2023-10-06T02:30:46.820118+0000","last_fullsized":"2023-10-06T02:30:46.820118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:57.865609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":131,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-06T02:30:46.809489+0000","last_change":"2023-10-06T02:17:37.932053+0000","last_active":"2023-10-06T02:30:46.809489+0000","last_peered":"2023-10-06T02:30:46.809489+0000","last_clean":"2023-10-06T02:30:46.809489+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:30:46.809489+0000","last_undegraded":"2023-10-06T02:30:46.809489+0000","last_fullsized":"2023-10-06T02:30:46.809489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:45.045258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":131,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-06T02:30:46.809186+0000","last_change":"2023-10-06T02:17:37.934326+0000","last_active":"2023-10-06T02:30:46.809186+0000","last_peered":"2023-10-06T02:30:46.809186+0000","last_clean":"2023-10-06T02:30:46.809186+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:30:46.809186+0000","last_undegraded":"2023-10-06T02:30:46.809186+0000","last_fullsized":"2023-10-06T02:30:46.809186+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:17:36.914497+0000","last_clean_scrub_stamp":"2023-10-06T02:17:36.914497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:48.748418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575010,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308004,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063836,"statfs":{"total":96636764160,"available":96321368064,"internally_reserved":0,"allocated":2584576,"data_stored":1626013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.79700000000000004,"15min":1.111},"last":0.497},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71099999999999997,"5min":0.77900000000000003,"15min":0.97899999999999998},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":1.008},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.629,"5min":0.72599999999999998,"15min":1.075},"last":0.68700000000000006}]},{"osd":2,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.76000000000000001,"5min":0.80200000000000005,"15min":1.149},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.75800000000000001,"5min":0.96999999999999997,"15min":1.048},"last":0.72199999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69899999999999995,"5min":0.84399999999999997,"15min":1.175},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73599999999999999,"5min":0.91000000000000003,"15min":1.03},"last":0.54300000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.48199999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63900000000000001,"5min":0.79400000000000004,"15min":0.873},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80800000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.78600000000000003,"5min":0.81299999999999994,"15min":0.81899999999999995},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.76000000000000001,"15min":0.84899999999999998},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:30:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72699999999999998,"5min":0.79300000000000004,"15min":0.91700000000000004},"last":0.621},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.38900000000000001,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.76300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575011,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303324,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068516,"statfs":{"total":96636764160,"available":96326160384,"internally_reserved":0,"allocated":1986560,"data_stored":1034692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53400000000000003,"15min":0.64000000000000001},"min":{"1min":0.30299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.68899999999999995,"5min":0.79000000000000004,"15min":5.6929999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56100000000000005,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.29799999999999999},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":5.7060000000000004},"last":0.80000000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53200000000000003,"15min":0.54100000000000004},"min":{"1min":0.32300000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67100000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.629},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.73299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53100000000000003,"15min":0.69999999999999996},"min":{"1min":0.372,"5min":0.318,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":0.872,"15min":8.8659999999999997},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":0.77500000000000002,"15min":0.80800000000000005},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.55500000000000005,"15min":0.75},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":10.659000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.76800000000000002,"15min":0.85499999999999998},"last":0.71699999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47499999999999998,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.27400000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.79600000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67700000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.49099999999999999,"15min":0.51600000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.499},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71099999999999997,"5min":0.751,"15min":0.84399999999999997},"last":0.52000000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.312},"max":{"1min":0.68300000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73899999999999999,"5min":0.86799999999999999,"15min":0.88100000000000001},"last":0.76900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308000,"kb_used_data":2520,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063840,"statfs":{"total":96636764160,"available":96321372160,"internally_reserved":0,"allocated":2580480,"data_stored":1625060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.36899999999999999,"15min":0.36499999999999999},"min":{"1min":0.25600000000000001,"5min":0.20799999999999999,"15min":0.19},"max":{"1min":0.59699999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.38200000000000001},"min":{"1min":0.316,"5min":0.27100000000000002,"15min":0.26100000000000001},"max":{"1min":0.56499999999999995,"5min":0.754,"15min":0.754},"last":0.46100000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.33900000000000002,"15min":0.33800000000000002},"min":{"1min":0.26900000000000002,"5min":0.223,"15min":0.22},"max":{"1min":0.56699999999999995,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.39300000000000002,"15min":0.39500000000000002},"min":{"1min":0.29399999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52400000000000002,"5min":0.64300000000000002,"15min":0.65300000000000002},"last":0.44900000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.31,"5min":0.28100000000000003,"15min":0.253},"max":{"1min":0.621,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.59799999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86899999999999999,"5min":0.998,"15min":0.998},"last":0.747},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.378,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83899999999999997,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.625,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.37},"max":{"1min":0.90100000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.46300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92100000000000004,"5min":0.93799999999999994,"15min":0.95499999999999996},"last":0.75900000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.36499999999999999},"max":{"1min":0.75,"5min":0.94499999999999995,"15min":1.0009999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.45500000000000002,"5min":0.41599999999999998,"15min":0.41099999999999998},"max":{"1min":0.90600000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.76700000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.378},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.94199999999999995},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.61899999999999999,"15min":0.62},"min":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.42499999999999999},"max":{"1min":0.84999999999999998,"5min":0.92000000000000004,"15min":0.98199999999999998},"last":0.78100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575010,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307424,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064416,"statfs":{"total":96636764160,"available":96321961984,"internally_reserved":0,"allocated":1990656,"data_stored":1035645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34599999999999997,"15min":0.33500000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.183},"max":{"1min":0.56899999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.317},{"interface":"front","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.374},"min":{"1min":0.223,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.66500000000000004,"5min":0.876,"15min":0.876},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.39400000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.20599999999999999},"max":{"1min":0.56399999999999995,"5min":0.65600000000000003,"15min":0.745},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.372,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.22600000000000001,"15min":0.215},"max":{"1min":0.63600000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.29099999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52000000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.438,"15min":0.434},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.24399999999999999},"max":{"1min":0.629,"5min":0.71599999999999997,"15min":0.78000000000000003},"last":0.38}]},{"osd":4,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.371},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.369},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.99399999999999999},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.32300000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.3320000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.622},"min":{"1min":0.44,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.84899999999999998,"5min":0.88700000000000001,"15min":1.0780000000000001},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63700000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.91200000000000003,"15min":1.3999999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.45500000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.0469999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.78000000000000003},"min":{"1min":0.46200000000000002,"5min":0.41699999999999998,"15min":0.39400000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":11.138},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.46600000000000003,"5min":0.432,"15min":0.41599999999999998},"max":{"1min":0.86599999999999999,"5min":1.024,"15min":1.429},"last":0.65400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575010,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307420,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064420,"statfs":{"total":96636764160,"available":96321966080,"internally_reserved":0,"allocated":1986560,"data_stored":1034692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34699999999999998,"15min":0.36199999999999999},"min":{"1min":0.218,"5min":0.182,"15min":0.182},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.80300000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.38800000000000001},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.58199999999999996,"5min":0.68000000000000005,"15min":0.98999999999999999},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.375,"15min":0.39200000000000002},"min":{"1min":0.25700000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":3.1230000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":3.0129999999999999},"last":0.497}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.375,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.23499999999999999},"max":{"1min":0.56899999999999995,"5min":0.59299999999999997,"15min":1.423},"last":0.376},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.33500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.77400000000000002},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.443,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.41799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.304},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.439,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.77400000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.45100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0980000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.41799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96499999999999997,"5min":0.97999999999999998,"15min":1.347},"last":0.79000000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64900000000000002,"15min":0.66200000000000003},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.206},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63800000000000001,"15min":0.66500000000000004},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.385},"last":0.82499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307424,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064416,"statfs":{"total":96636764160,"available":96321961984,"internally_reserved":0,"allocated":1990656,"data_stored":1035645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47299999999999998,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.375},{"interface":"front","average":{"1min":0.377,"5min":0.375,"15min":0.38200000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.78100000000000003},"last":0.46000000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.24099999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.66700000000000004},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.40300000000000002},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59599999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54500000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.246},"max":{"1min":0.57399999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.32600000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":1.0049999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.83899999999999997,"5min":0.92700000000000005,"15min":1.1539999999999999},"last":0.432}]},{"osd":5,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.37,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84899999999999998,"5min":0.95399999999999996,"15min":1.2110000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.874,"5min":0.89600000000000002,"15min":1.0429999999999999},"last":0.52800000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81999999999999995,"5min":0.90800000000000003,"15min":1.0700000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.47699999999999998,"5min":0.39500000000000002,"15min":0.38600000000000001},"max":{"1min":0.85999999999999999,"5min":0.98499999999999999,"15min":1.391},"last":0.47499999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.48299999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80300000000000005,"5min":0.94099999999999995,"15min":1.121},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.63700000000000001,"15min":0.63400000000000001},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88800000000000001,"5min":0.89900000000000002,"15min":0.95099999999999996},"last":0.50800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575010,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311520,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060320,"statfs":{"total":96636764160,"available":96317767680,"internally_reserved":0,"allocated":1990656,"data_stored":1035645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.252,"5min":0.252,"15min":0.217},"max":{"1min":0.71799999999999997,"5min":0.78900000000000003,"15min":0.86399999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.88900000000000001,"15min":1.7290000000000001},"last":0.67100000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.77300000000000002},"min":{"1min":0.41599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.71999999999999997,"5min":0.749,"15min":17.879999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.76300000000000001},"min":{"1min":0.377,"5min":0.33100000000000002,"15min":0.32700000000000001},"max":{"1min":0.69899999999999995,"5min":0.76500000000000001,"15min":18.010999999999999},"last":0.83899999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.55100000000000005},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.309},"max":{"1min":0.73299999999999998,"5min":0.84699999999999998,"15min":1.619},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.42599999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":1.6639999999999999},"last":0.622}]},{"osd":3,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.29899999999999999},"max":{"1min":0.76200000000000001,"5min":0.76500000000000001,"15min":1.2729999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44500000000000001,"5min":0.32700000000000001,"15min":0.32200000000000001},"max":{"1min":0.80000000000000004,"5min":0.81999999999999995,"15min":0.84899999999999998},"last":0.65000000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48999999999999999,"15min":0.51200000000000001},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69799999999999995,"5min":0.78900000000000003,"15min":1.532},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.80700000000000005},"last":0.746}]},{"osd":6,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.501,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.64300000000000002,"5min":0.90400000000000003,"15min":1.5700000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76000000000000001,"5min":0.84099999999999997,"15min":1.4319999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.40400000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73899999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72999999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.81100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575009,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303328,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068512,"statfs":{"total":96636764160,"available":96326156288,"internally_reserved":0,"allocated":1990656,"data_stored":1035645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.34599999999999997,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.78800000000000003,"5min":1.034,"15min":1.103},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.312},"max":{"1min":0.81799999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.29699999999999999},"max":{"1min":0.91400000000000003,"5min":1.02,"15min":1.1679999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.33900000000000002},"max":{"1min":0.89200000000000002,"5min":0.99399999999999999,"15min":1.0620000000000001},"last":0.626}]},{"osd":2,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.30399999999999999},"max":{"1min":0.74299999999999999,"5min":1.1870000000000001,"15min":1.2070000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":1.1140000000000001},"last":0.47499999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.84299999999999997,"15min":1.1799999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78900000000000003,"5min":1.1040000000000001,"15min":1.1830000000000001},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72399999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52900000000000003,"15min":0.50900000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26500000000000001},"max":{"1min":0.72199999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.29699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79700000000000004,"5min":0.872,"15min":0.872},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:30:55.823 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-10-06T02:17:36.914497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=17, tm_sec=36, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=30, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:30:55.823 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-10-06T02:17:36.914497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=17, tm_sec=36, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=30, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:30:55.824 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-10-06T02:17:36.914497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=17, tm_sec=36, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=30, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:30:55.824 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T02:17:36.914497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=17, tm_sec=36, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=30, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:30:55.824 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-10-06T02:17:36.914497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=17, tm_sec=36, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=30, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:30:55.824 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T02:17:36.914497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=17, tm_sec=36, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=30, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:30:55.824 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-10-06T02:17:36.914497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=17, tm_sec=36, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=30, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:30:55.824 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-10-06T02:17:36.914497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=17, tm_sec=36, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=30, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:30:55.825 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-10-06T02:17:36.914497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=17, tm_sec=36, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=30, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:30:55.825 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T02:31:15.826 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:31:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.959+0000 7fd6919ef700 1 Processor -- start 2023-10-06T02:31:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.959+0000 7fd6919ef700 1 -- start start 2023-10-06T02:31:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.959+0000 7fd6919ef700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd68c159380 0x7fd68c159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.959+0000 7fd6919ef700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd68c15d4d0 0x7fd68c15d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.959+0000 7fd6919ef700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68c0cb6c0 con 0x7fd68c0b20e0 2023-10-06T02:31:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.959+0000 7fd6919ef700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68c15e200 con 0x7fd68c159380 2023-10-06T02:31:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.959+0000 7fd6919ef700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c0ccb60 con 0x7fd68c15d4d0 2023-10-06T02:31:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.960+0000 7fd68a7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd68c0b20e0 0x7fd68c0b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37902/0 (socket says 172.21.15.6:37902) 2023-10-06T02:31:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.960+0000 7fd68a7fc700 1 -- 172.21.15.6:0/2595194734 learned_addr learned my addr 172.21.15.6:0/2595194734 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:31:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.960+0000 7fd68b7fe700 1 --2- 172.21.15.6:0/2595194734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd68c15d4d0 0x7fd68c15d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:31:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.960+0000 7fd68affd700 1 --2- 172.21.15.6:0/2595194734 >> v2:172.21.15.175:3300/0 conn(0x7fd68c159380 0x7fd68c159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:31:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.960+0000 7fd689ffb700 1 -- 172.21.15.6:0/2595194734 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170792713 0 0) 0x7fd68c0cb6c0 con 0x7fd68c0b20e0 2023-10-06T02:31:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.960+0000 7fd689ffb700 1 -- 172.21.15.6:0/2595194734 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd678003570 con 0x7fd68c0b20e0 2023-10-06T02:31:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.960+0000 7fd68b7fe700 1 -- 172.21.15.6:0/2595194734 >> v2:172.21.15.175:3300/0 conn(0x7fd68c159380 msgr2=0x7fd68c159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:31:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.960+0000 7fd68b7fe700 1 --2- 172.21.15.6:0/2595194734 >> v2:172.21.15.175:3300/0 conn(0x7fd68c159380 0x7fd68c159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.960+0000 7fd68b7fe700 1 -- 172.21.15.6:0/2595194734 >> v1:172.21.15.6:6789/0 conn(0x7fd68c0b20e0 legacy=0x7fd68c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.960+0000 7fd689ffb700 1 -- 172.21.15.6:0/2595194734 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2366322652 0 0) 0x7fd678003570 con 0x7fd68c0b20e0 2023-10-06T02:31:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.960+0000 7fd68b7fe700 1 -- 172.21.15.6:0/2595194734 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c0c3ef0 con 0x7fd68c15d4d0 2023-10-06T02:31:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.960+0000 7fd68affd700 1 --2- 172.21.15.6:0/2595194734 >> v2:172.21.15.175:3300/0 conn(0x7fd68c159380 0x7fd68c159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:31:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.960+0000 7fd68b7fe700 1 --2- 172.21.15.6:0/2595194734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd68c15d4d0 0x7fd68c15d930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd684009e60 tx=0x7fd684009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe35fdc41c7abf32 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:31:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.961+0000 7fd689ffb700 1 -- 172.21.15.6:0/2595194734 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68400e070 con 0x7fd68c15d4d0 2023-10-06T02:31:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.961+0000 7fd689ffb700 1 -- 172.21.15.6:0/2595194734 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68400b7a0 con 0x7fd68c15d4d0 2023-10-06T02:31:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.961+0000 7fd689ffb700 1 -- 172.21.15.6:0/2595194734 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674001470 con 0x7fd68c15d4d0 2023-10-06T02:31:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.961+0000 7fd6919ef700 1 -- 172.21.15.6:0/2595194734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd68c15d4d0 msgr2=0x7fd68c15d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.961+0000 7fd6919ef700 1 --2- 172.21.15.6:0/2595194734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd68c15d4d0 0x7fd68c15d930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd684009e60 tx=0x7fd684009780 comp rx=0 tx=0).stop 2023-10-06T02:31:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.961+0000 7fd6919ef700 1 -- 172.21.15.6:0/2595194734 shutdown_connections 2023-10-06T02:31:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.961+0000 7fd6919ef700 1 --2- 172.21.15.6:0/2595194734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd68c15d4d0 0x7fd68c15d930 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.961+0000 7fd6919ef700 1 --2- 172.21.15.6:0/2595194734 >> v2:172.21.15.175:3300/0 conn(0x7fd68c159380 0x7fd68c159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.961+0000 7fd6919ef700 1 -- 172.21.15.6:0/2595194734 >> 172.21.15.6:0/2595194734 conn(0x7fd68c068680 msgr2=0x7fd68c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:31:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.961+0000 7fd6919ef700 1 -- 172.21.15.6:0/2595194734 shutdown_connections 2023-10-06T02:31:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.961+0000 7fd6919ef700 1 -- 172.21.15.6:0/2595194734 wait complete. 2023-10-06T02:31:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.963+0000 7fd6919ef700 1 Processor -- start 2023-10-06T02:31:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.963+0000 7fd6919ef700 1 -- start start 2023-10-06T02:31:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.963+0000 7fd6919ef700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd68c0b20e0 0x7fd68c0c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.963+0000 7fd6919ef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68c159380 0x7fd68c157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.963+0000 7fd6919ef700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd68c15d4d0 0x7fd68c0ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:15.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.963+0000 7fd6919ef700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c0a6e30 con 0x7fd68c159380 2023-10-06T02:31:15.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.963+0000 7fd6919ef700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c0c7cd0 con 0x7fd68c0b20e0 2023-10-06T02:31:15.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.963+0000 7fd6919ef700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c0cf080 con 0x7fd68c15d4d0 2023-10-06T02:31:15.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.963+0000 7fd68a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68c159380 0x7fd68c157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:31:15.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.963+0000 7fd68a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68c159380 0x7fd68c157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53876/0 (socket says 172.21.15.6:53876) 2023-10-06T02:31:15.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.963+0000 7fd68a7fc700 1 -- 172.21.15.6:0/2309961588 learned_addr learned my addr 172.21.15.6:0/2309961588 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:31:15.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.964+0000 7fd68affd700 1 --2- 172.21.15.6:0/2309961588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd68c0b20e0 0x7fd68c0c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:31:15.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.964+0000 7fd68a7fc700 1 -- 172.21.15.6:0/2309961588 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd68c15d4d0 msgr2=0x7fd68c0ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:15.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.964+0000 7fd68a7fc700 1 --2- 172.21.15.6:0/2309961588 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd68c15d4d0 0x7fd68c0ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:15.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.964+0000 7fd68a7fc700 1 -- 172.21.15.6:0/2309961588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd68c0b20e0 msgr2=0x7fd68c0c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:15.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.964+0000 7fd68a7fc700 1 --2- 172.21.15.6:0/2309961588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd68c0b20e0 0x7fd68c0c9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:15.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.964+0000 7fd68a7fc700 1 -- 172.21.15.6:0/2309961588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c009420 con 0x7fd68c159380 2023-10-06T02:31:15.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.964+0000 7fd68a7fc700 1 --2- 172.21.15.6:0/2309961588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68c159380 0x7fd68c157cb0 secure :-1 s=READY pgs=2629 cs=0 l=1 rev1=1 crypto rx=0x7fd67400cb90 tx=0x7fd674001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:31:15.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.964+0000 7fd682ffd700 1 -- 172.21.15.6:0/2309961588 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674001d40 con 0x7fd68c159380 2023-10-06T02:31:15.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.964+0000 7fd682ffd700 1 -- 172.21.15.6:0/2309961588 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd674007360 con 0x7fd68c159380 2023-10-06T02:31:15.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.964+0000 7fd6919ef700 1 -- 172.21.15.6:0/2309961588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd684009a20 con 0x7fd68c159380 2023-10-06T02:31:15.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.964+0000 7fd682ffd700 1 -- 172.21.15.6:0/2309961588 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674004830 con 0x7fd68c159380 2023-10-06T02:31:15.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.964+0000 7fd6919ef700 1 -- 172.21.15.6:0/2309961588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68c0c7680 con 0x7fd68c159380 2023-10-06T02:31:15.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.965+0000 7fd6919ef700 1 -- 172.21.15.6:0/2309961588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68c0c7e80 con 0x7fd68c159380 2023-10-06T02:31:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.965+0000 7fd682ffd700 1 -- 172.21.15.6:0/2309961588 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd674004ba0 con 0x7fd68c159380 2023-10-06T02:31:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.966+0000 7fd682ffd700 1 --2- 172.21.15.6:0/2309961588 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd66c066f30 0x7fd66c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.966+0000 7fd682ffd700 1 -- 172.21.15.6:0/2309961588 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fd674083dd0 con 0x7fd68c159380 2023-10-06T02:31:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.966+0000 7fd68affd700 1 --2- 172.21.15.6:0/2309961588 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd66c066f30 0x7fd66c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:31:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.967+0000 7fd68affd700 1 --2- 172.21.15.6:0/2309961588 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd66c066f30 0x7fd66c0693e0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd67c006f00 tx=0x7fd67c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:31:15.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:15.970+0000 7fd682ffd700 1 -- 172.21.15.6:0/2309961588 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd68c0c7e80 con 0x7fd68c159380 2023-10-06T02:31:16.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.158+0000 7fd6919ef700 1 -- 172.21.15.6:0/2309961588 --> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd68c0c7e40 con 0x7fd66c066f30 2023-10-06T02:31:16.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.162+0000 7fd682ffd700 1 -- 172.21.15.6:0/2309961588 <== mgr.4105 v2:172.21.15.175:6832/90280 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73597 (secure 0 0 0) 0x7fd68c0c7e40 con 0x7fd66c066f30 2023-10-06T02:31:16.164 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:31:16.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.163+0000 7fd6919ef700 1 -- 172.21.15.6:0/2309961588 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd66c066f30 msgr2=0x7fd66c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:16.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.163+0000 7fd6919ef700 1 --2- 172.21.15.6:0/2309961588 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd66c066f30 0x7fd66c0693e0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd67c006f00 tx=0x7fd67c008040 comp rx=0 tx=0).stop 2023-10-06T02:31:16.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.163+0000 7fd6919ef700 1 -- 172.21.15.6:0/2309961588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68c159380 msgr2=0x7fd68c157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:16.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.163+0000 7fd6919ef700 1 --2- 172.21.15.6:0/2309961588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68c159380 0x7fd68c157cb0 secure :-1 s=READY pgs=2629 cs=0 l=1 rev1=1 crypto rx=0x7fd67400cb90 tx=0x7fd674001ab0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.163+0000 7fd6919ef700 1 -- 172.21.15.6:0/2309961588 shutdown_connections 2023-10-06T02:31:16.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.163+0000 7fd6919ef700 1 --2- 172.21.15.6:0/2309961588 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd68c15d4d0 0x7fd68c0ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.163+0000 7fd6919ef700 1 --2- 172.21.15.6:0/2309961588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd68c0b20e0 0x7fd68c0c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.163+0000 7fd6919ef700 1 --2- 172.21.15.6:0/2309961588 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fd66c066f30 0x7fd66c0693e0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.163+0000 7fd6919ef700 1 --2- 172.21.15.6:0/2309961588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68c159380 0x7fd68c157cb0 unknown :-1 s=CLOSED pgs=2629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.163+0000 7fd6919ef700 1 -- 172.21.15.6:0/2309961588 >> 172.21.15.6:0/2309961588 conn(0x7fd68c068680 msgr2=0x7fd68c158940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:31:16.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.163+0000 7fd6919ef700 1 -- 172.21.15.6:0/2309961588 shutdown_connections 2023-10-06T02:31:16.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.163+0000 7fd6919ef700 1 -- 172.21.15.6:0/2309961588 wait complete. 2023-10-06T02:31:16.167 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-06T02:31:16.176 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":555,"stamp":"2023-10-06T02:31:14.763991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2456444,"kb_used_data":16700,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752518276,"statfs":{"total":773094113280,"available":770578714624,"internally_reserved":0,"allocated":17100800,"data_stored":9463037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002803"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":145,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-06T02:30:54.344349+0000","last_change":"2023-10-06T02:30:54.344320+0000","last_active":"2023-10-06T02:30:54.344349+0000","last_peered":"2023-10-06T02:30:54.344349+0000","last_clean":"2023-10-06T02:30:54.344349+0000","last_became_active":"2023-10-06T02:17:37.934405+0000","last_became_peered":"2023-10-06T02:17:37.934405+0000","last_unstale":"2023-10-06T02:30:54.344349+0000","last_undegraded":"2023-10-06T02:30:54.344349+0000","last_fullsized":"2023-10-06T02:30:54.344349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:54.344223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:54.344223+0000","last_clean_scrub_stamp":"2023-10-06T02:30:54.344223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:56.232859+0000","scrub_duration":0.0017488040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":147,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-06T02:30:53.501508+0000","last_change":"2023-10-06T02:30:53.501476+0000","last_active":"2023-10-06T02:30:53.501508+0000","last_peered":"2023-10-06T02:30:53.501508+0000","last_clean":"2023-10-06T02:30:53.501508+0000","last_became_active":"2023-10-06T02:17:37.932080+0000","last_became_peered":"2023-10-06T02:17:37.932080+0000","last_unstale":"2023-10-06T02:30:53.501508+0000","last_undegraded":"2023-10-06T02:30:53.501508+0000","last_fullsized":"2023-10-06T02:30:53.501508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:53.501397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:53.501397+0000","last_clean_scrub_stamp":"2023-10-06T02:30:53.501397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:47.379847+0000","scrub_duration":0.0020281219999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":147,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-06T02:30:54.491497+0000","last_change":"2023-10-06T02:30:54.491477+0000","last_active":"2023-10-06T02:30:54.491497+0000","last_peered":"2023-10-06T02:30:54.491497+0000","last_clean":"2023-10-06T02:30:54.491497+0000","last_became_active":"2023-10-06T02:17:37.931845+0000","last_became_peered":"2023-10-06T02:17:37.931845+0000","last_unstale":"2023-10-06T02:30:54.491497+0000","last_undegraded":"2023-10-06T02:30:54.491497+0000","last_fullsized":"2023-10-06T02:30:54.491497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:54.491405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:54.491405+0000","last_clean_scrub_stamp":"2023-10-06T02:30:54.491405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:05.163903+0000","scrub_duration":0.0017620649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"152'119","reported_seq":296,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-06T02:31:09.517188+0000","last_change":"2023-10-06T02:31:09.517146+0000","last_active":"2023-10-06T02:31:09.517188+0000","last_peered":"2023-10-06T02:31:09.517188+0000","last_clean":"2023-10-06T02:31:09.517188+0000","last_became_active":"2023-10-06T02:17:37.934532+0000","last_became_peered":"2023-10-06T02:17:37.934532+0000","last_unstale":"2023-10-06T02:31:09.517188+0000","last_undegraded":"2023-10-06T02:31:09.517188+0000","last_fullsized":"2023-10-06T02:31:09.517188+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'119","last_scrub_stamp":"2023-10-06T02:31:09.517055+0000","last_deep_scrub":"152'119","last_deep_scrub_stamp":"2023-10-06T02:31:09.517055+0000","last_clean_scrub_stamp":"2023-10-06T02:31:09.517055+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:20.243916+0000","scrub_duration":0.0050199909999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":144,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-06T02:31:07.520601+0000","last_change":"2023-10-06T02:31:07.520561+0000","last_active":"2023-10-06T02:31:07.520601+0000","last_peered":"2023-10-06T02:31:07.520601+0000","last_clean":"2023-10-06T02:31:07.520601+0000","last_became_active":"2023-10-06T02:17:37.931654+0000","last_became_peered":"2023-10-06T02:17:37.931654+0000","last_unstale":"2023-10-06T02:31:07.520601+0000","last_undegraded":"2023-10-06T02:31:07.520601+0000","last_fullsized":"2023-10-06T02:31:07.520601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:31:07.520458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:31:07.520458+0000","last_clean_scrub_stamp":"2023-10-06T02:31:07.520458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:09.409094+0000","scrub_duration":0.0024403329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":144,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-06T02:30:58.592315+0000","last_change":"2023-10-06T02:30:58.592289+0000","last_active":"2023-10-06T02:30:58.592315+0000","last_peered":"2023-10-06T02:30:58.592315+0000","last_clean":"2023-10-06T02:30:58.592315+0000","last_became_active":"2023-10-06T02:17:37.934197+0000","last_became_peered":"2023-10-06T02:17:37.934197+0000","last_unstale":"2023-10-06T02:30:58.592315+0000","last_undegraded":"2023-10-06T02:30:58.592315+0000","last_fullsized":"2023-10-06T02:30:58.592315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:58.592177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:58.592177+0000","last_clean_scrub_stamp":"2023-10-06T02:30:58.592177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:24:37.355542+0000","scrub_duration":0.002436597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":143,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-06T02:30:54.723793+0000","last_change":"2023-10-06T02:30:54.723747+0000","last_active":"2023-10-06T02:30:54.723793+0000","last_peered":"2023-10-06T02:30:54.723793+0000","last_clean":"2023-10-06T02:30:54.723793+0000","last_became_active":"2023-10-06T02:17:37.936749+0000","last_became_peered":"2023-10-06T02:17:37.936749+0000","last_unstale":"2023-10-06T02:30:54.723793+0000","last_undegraded":"2023-10-06T02:30:54.723793+0000","last_fullsized":"2023-10-06T02:30:54.723793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:54.723641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:54.723641+0000","last_clean_scrub_stamp":"2023-10-06T02:30:54.723641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:02:06.839716+0000","scrub_duration":0.0017850450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":142,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-06T02:30:55.703356+0000","last_change":"2023-10-06T02:30:55.703329+0000","last_active":"2023-10-06T02:30:55.703356+0000","last_peered":"2023-10-06T02:30:55.703356+0000","last_clean":"2023-10-06T02:30:55.703356+0000","last_became_active":"2023-10-06T02:17:37.931708+0000","last_became_peered":"2023-10-06T02:17:37.931708+0000","last_unstale":"2023-10-06T02:30:55.703356+0000","last_undegraded":"2023-10-06T02:30:55.703356+0000","last_fullsized":"2023-10-06T02:30:55.703356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:55.703227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:55.703227+0000","last_clean_scrub_stamp":"2023-10-06T02:30:55.703227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:28:12.224467+0000","scrub_duration":0.0016103370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":142,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-06T02:30:56.679756+0000","last_change":"2023-10-06T02:30:56.679714+0000","last_active":"2023-10-06T02:30:56.679756+0000","last_peered":"2023-10-06T02:30:56.679756+0000","last_clean":"2023-10-06T02:30:56.679756+0000","last_became_active":"2023-10-06T02:17:37.933986+0000","last_became_peered":"2023-10-06T02:17:37.933986+0000","last_unstale":"2023-10-06T02:30:56.679756+0000","last_undegraded":"2023-10-06T02:30:56.679756+0000","last_fullsized":"2023-10-06T02:30:56.679756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:30:56.679603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:30:56.679603+0000","last_clean_scrub_stamp":"2023-10-06T02:30:56.679603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:02:08.795678+0000","scrub_duration":0.0021618140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575014,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308004,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063836,"statfs":{"total":96636764160,"available":96321368064,"internally_reserved":0,"allocated":2584576,"data_stored":1626013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51300000000000001,"15min":0.51800000000000002},"min":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":0.29899999999999999},"max":{"1min":0.64400000000000002,"5min":0.79700000000000004,"15min":1.111},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.76300000000000001,"5min":0.77900000000000003,"15min":0.97899999999999998},"last":0.55300000000000005}]},{"osd":1,"last update":"Fri Oct 6 02:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.73199999999999998,"5min":0.79400000000000004,"15min":1.008},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.312},"max":{"1min":0.68700000000000006,"5min":0.72199999999999998,"15min":1.075},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.42699999999999999,"5min":0.27400000000000002,"15min":0.25900000000000001},"max":{"1min":0.71799999999999997,"5min":0.80200000000000005,"15min":1.149},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60699999999999998,"15min":0.60399999999999998},"min":{"1min":0.501,"5min":0.372,"15min":0.372},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":1.048},"last":0.501}]},{"osd":3,"last update":"Fri Oct 6 02:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55300000000000005,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.34499999999999997},"max":{"1min":0.73899999999999999,"5min":0.77200000000000002,"15min":1.175},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.39500000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70199999999999996,"5min":0.77800000000000002,"15min":1.03},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Oct 6 02:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.48099999999999998},"min":{"1min":0.36699999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":0.873},"last":0.433},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.35799999999999998,"5min":0.30299999999999999,"15min":0.27600000000000002},"max":{"1min":0.72499999999999998,"5min":0.80800000000000005,"15min":0.89000000000000001},"last":0.35799999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79500000000000004,"5min":0.81299999999999994,"15min":0.81899999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52800000000000002,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.84899999999999998},"last":0.56899999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.46100000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.74199999999999999,"5min":0.79300000000000004,"15min":0.91700000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.40699999999999997,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":0.77000000000000002,"5min":0.83799999999999997,"15min":0.93899999999999995},"last":0.53200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575015,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303324,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068516,"statfs":{"total":96636764160,"available":96326160384,"internally_reserved":0,"allocated":1986560,"data_stored":1034692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52900000000000003,"15min":0.61499999999999999},"min":{"1min":0.41199999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.66400000000000003,"5min":0.79000000000000004,"15min":5.6929999999999996},"last":0.626},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54800000000000004,"15min":0.63100000000000001},"min":{"1min":0.38400000000000001,"5min":0.30399999999999999,"15min":0.29799999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":5.7060000000000004},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.36699999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.629,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.33500000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73299999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53300000000000003,"15min":0.66100000000000003},"min":{"1min":0.35999999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.82999999999999996,"5min":0.872,"15min":8.8659999999999997},"last":0.496},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66200000000000003,"5min":0.77500000000000002,"15min":0.80800000000000005},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54600000000000004,"15min":0.70399999999999996},"min":{"1min":0.41699999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":10.659000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56699999999999995,"15min":0.58399999999999996},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.72899999999999998,"5min":0.76800000000000002,"15min":0.85499999999999998},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.27400000000000002},"max":{"1min":0.60099999999999998,"5min":0.66900000000000004,"15min":0.79600000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.502,"15min":0.51700000000000002},"min":{"1min":0.371,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.61299999999999999,"5min":0.70599999999999996,"15min":0.89400000000000002},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49299999999999999,"15min":0.51100000000000001},"min":{"1min":0.33300000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.69699999999999995,"5min":0.70199999999999996,"15min":0.82899999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52300000000000002,"15min":0.53000000000000003},"min":{"1min":0.40600000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.70999999999999996,"5min":0.751,"15min":0.84399999999999997},"last":0.75}]},{"osd":7,"last update":"Fri Oct 6 02:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54600000000000004,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.312},"max":{"1min":0.68600000000000005,"5min":0.73899999999999999,"15min":0.93500000000000005},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.48099999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.88100000000000001},"last":0.76600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575014,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308000,"kb_used_data":2520,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063840,"statfs":{"total":96636764160,"available":96321372160,"internally_reserved":0,"allocated":2580480,"data_stored":1625060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.23499999999999999,"5min":0.20799999999999999,"15min":0.19},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.68500000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39100000000000001,"15min":0.38500000000000001},"min":{"1min":0.29599999999999999,"5min":0.27100000000000002,"15min":0.26100000000000001},"max":{"1min":0.48899999999999999,"5min":0.754,"15min":0.754},"last":0.375}]},{"osd":2,"last update":"Fri Oct 6 02:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33800000000000002,"15min":0.34100000000000003},"min":{"1min":0.27100000000000002,"5min":0.223,"15min":0.22},"max":{"1min":0.497,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.39800000000000002},"min":{"1min":0.25700000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.61599999999999999,"5min":0.64300000000000002,"15min":0.65300000000000002},"last":0.35399999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40999999999999998,"15min":0.41199999999999998},"min":{"1min":0.34799999999999998,"5min":0.28100000000000003,"15min":0.253},"max":{"1min":0.68200000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.29199999999999998,"5min":0.26400000000000001,"15min":0.248},"max":{"1min":0.59999999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.499}]},{"osd":4,"last update":"Fri Oct 6 02:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.42599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.747,"5min":0.97999999999999998,"15min":0.998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.58899999999999997,"15min":0.59399999999999997},"min":{"1min":0.44700000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82499999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.51400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.47199999999999998,"5min":0.40200000000000002,"15min":0.37},"max":{"1min":0.75800000000000001,"5min":0.90100000000000002,"15min":0.97599999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63600000000000001,"15min":0.64400000000000002},"min":{"1min":0.47799999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91200000000000003,"5min":0.93799999999999994,"15min":0.95499999999999996},"last":0.55100000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.499,"5min":0.42099999999999999,"15min":0.36499999999999999},"max":{"1min":0.72799999999999998,"5min":0.88700000000000001,"15min":1.0009999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.627,"15min":0.622},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86399999999999999,"5min":0.95999999999999996,"15min":1.0269999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.622,"15min":0.63400000000000001},"min":{"1min":0.48599999999999999,"5min":0.41599999999999998,"15min":0.378},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.48699999999999999,"5min":0.46600000000000003,"15min":0.42499999999999999},"max":{"1min":0.78100000000000003,"5min":0.92000000000000004,"15min":0.98199999999999998},"last":0.627}]}]},{"osd":0,"up_from":13,"seq":55834575014,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307424,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064416,"statfs":{"total":96636764160,"available":96321961984,"internally_reserved":0,"allocated":1990656,"data_stored":1035645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.33900000000000002},"min":{"1min":0.22600000000000001,"5min":0.20499999999999999,"15min":0.183},"max":{"1min":0.48499999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"min":{"1min":0.29599999999999999,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.59499999999999997,"5min":0.66500000000000004,"15min":0.876},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39000000000000001,"15min":0.39600000000000002},"min":{"1min":0.23699999999999999,"5min":0.22800000000000001,"15min":0.20599999999999999},"max":{"1min":0.59699999999999998,"5min":0.65600000000000003,"15min":0.745},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.35999999999999999},"min":{"1min":0.25800000000000001,"5min":0.22600000000000001,"15min":0.215},"max":{"1min":0.497,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.29199999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.39200000000000002,"15min":0.39700000000000002},"min":{"1min":0.28299999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56999999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.314},{"interface":"front","average":{"1min":0.438,"5min":0.433,"15min":0.436},"min":{"1min":0.34200000000000003,"5min":0.30199999999999999,"15min":0.24399999999999999},"max":{"1min":0.58899999999999997,"5min":0.68100000000000005,"15min":0.78000000000000003},"last":0.45200000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84699999999999998,"5min":0.93600000000000005,"15min":1.369},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60599999999999998,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86399999999999999,"5min":0.95199999999999996,"15min":0.99399999999999999},"last":0.82399999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.38,"5min":0.38,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":0.98699999999999999,"15min":1.3320000000000001},"last":0.625},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.625,"15min":0.627},"min":{"1min":0.47599999999999998,"5min":0.44,"15min":0.36399999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.0780000000000001},"last":0.70299999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88700000000000001,"5min":0.91200000000000003,"15min":1.3999999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.52300000000000002,"5min":0.38400000000000001,"15min":0.38100000000000001},"max":{"1min":0.99199999999999999,"5min":1.008,"15min":1.0469999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.74299999999999999},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.39400000000000002},"max":{"1min":0.78500000000000003,"5min":0.96799999999999997,"15min":11.138},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.52800000000000002,"5min":0.432,"15min":0.41599999999999998},"max":{"1min":0.97099999999999997,"5min":1.024,"15min":1.429},"last":0.77400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307420,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064420,"statfs":{"total":96636764160,"available":96321966080,"internally_reserved":0,"allocated":1986560,"data_stored":1034692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35299999999999998,"15min":0.36199999999999999},"min":{"1min":0.222,"5min":0.182,"15min":0.182},"max":{"1min":0.48899999999999999,"5min":0.69099999999999995,"15min":0.80300000000000005},"last":0.379},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.39200000000000002,"15min":0.38800000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60599999999999998,"5min":0.68000000000000005,"15min":0.98999999999999999},"last":0.43099999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.372,"15min":0.39200000000000002},"min":{"1min":0.27300000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.58399999999999996,"5min":0.63800000000000001,"15min":3.1230000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39900000000000002,"15min":0.41299999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.52800000000000002,"5min":0.68300000000000005,"15min":3.0129999999999999},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.373,"15min":0.38400000000000001},"min":{"1min":0.253,"5min":0.246,"15min":0.23499999999999999},"max":{"1min":0.56399999999999995,"5min":0.59299999999999997,"15min":1.423},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.437,"15min":0.438},"min":{"1min":0.27400000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63300000000000001,"5min":0.76200000000000001,"15min":0.77400000000000002},"last":0.45200000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84699999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.629},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61099999999999999,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86699999999999999,"5min":1.095,"15min":1.095},"last":0.753}]},{"osd":5,"last update":"Fri Oct 6 02:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.49199999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84599999999999997,"5min":1.0349999999999999,"15min":1.304},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.47299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81200000000000006,"5min":1.052,"15min":1.052},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63200000000000001,"15min":0.64500000000000002},"min":{"1min":0.48199999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79900000000000004,"5min":0.98699999999999999,"15min":1.0980000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61099999999999999,"15min":0.63600000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79000000000000004,"5min":0.96499999999999997,"15min":1.347},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.45300000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.85999999999999999,"5min":1.0349999999999999,"15min":1.206},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.63200000000000001,"15min":0.66200000000000003},"min":{"1min":0.50700000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83699999999999997,"5min":1.0760000000000001,"15min":1.385},"last":0.77300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575014,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307424,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064416,"statfs":{"total":96636764160,"available":96321961984,"internally_reserved":0,"allocated":1990656,"data_stored":1035645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35299999999999998,"15min":0.35599999999999998},"min":{"1min":0.22,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.55800000000000005,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38700000000000001,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.78100000000000003},"last":0.70399999999999996}]},{"osd":1,"last update":"Fri Oct 6 02:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.37},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.66700000000000004},"last":0.625},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40699999999999997,"15min":0.40500000000000003},"min":{"1min":0.28100000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61399999999999999,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.40300000000000002},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.69999999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.42099999999999999},"min":{"1min":0.308,"5min":0.28899999999999998,"15min":0.246},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.68500000000000005}]},{"osd":4,"last update":"Fri Oct 6 02:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.60399999999999998},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.39400000000000002},"max":{"1min":0.81399999999999995,"5min":0.84899999999999998,"15min":1.0049999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.432,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.89400000000000002,"5min":0.92700000000000005,"15min":1.1539999999999999},"last":0.748}]},{"osd":5,"last update":"Fri Oct 6 02:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85599999999999998,"5min":0.95399999999999996,"15min":1.2110000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.42599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80500000000000005,"5min":0.89600000000000002,"15min":1.0429999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.42699999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84999999999999998,"5min":0.90800000000000003,"15min":1.0700000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64300000000000002},"min":{"1min":0.47499999999999998,"5min":0.39500000000000002,"15min":0.38600000000000001},"max":{"1min":0.93899999999999995,"5min":0.98499999999999999,"15min":1.391},"last":0.77300000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.47799999999999998,"5min":0.47199999999999998,"15min":0.35999999999999999},"max":{"1min":0.878,"5min":0.94099999999999995,"15min":1.121},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.63600000000000001},"min":{"1min":0.44500000000000001,"5min":0.43099999999999999,"15min":0.42299999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.95099999999999996},"last":0.82199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311520,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060320,"statfs":{"total":96636764160,"available":96317767680,"internally_reserved":0,"allocated":1990656,"data_stored":1035645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56699999999999995,"15min":0.56999999999999995},"min":{"1min":0.29399999999999998,"5min":0.252,"15min":0.217},"max":{"1min":0.755,"5min":0.77800000000000002,"15min":0.86399999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60099999999999998,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.76300000000000001,"15min":1.7290000000000001},"last":0.61299999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.72199999999999998},"min":{"1min":0.34999999999999998,"5min":0.32900000000000001,"15min":0.309},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":17.879999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.71299999999999997},"min":{"1min":0.36499999999999999,"5min":0.33100000000000002,"15min":0.32700000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":18.010999999999999},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.38,"5min":0.35999999999999999,"15min":0.309},"max":{"1min":0.77000000000000002,"5min":0.84699999999999998,"15min":1.619},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56499999999999995,"15min":0.57599999999999996},"min":{"1min":0.38500000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72099999999999997,"5min":0.77500000000000002,"15min":1.6639999999999999},"last":0.65500000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.29899999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":1.2729999999999999},"last":0.628},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.32200000000000001},"max":{"1min":0.72199999999999998,"5min":0.81999999999999995,"15min":0.84899999999999998},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.50700000000000001,"15min":0.51400000000000001},"min":{"1min":0.39800000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72999999999999998,"5min":0.78900000000000003,"15min":1.532},"last":0.434},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.31900000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.746,"5min":0.77900000000000003,"15min":0.80700000000000005},"last":0.45200000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52000000000000002,"15min":0.53200000000000003},"min":{"1min":0.36499999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72999999999999998,"5min":0.90400000000000003,"15min":1.5700000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78400000000000003,"5min":0.84099999999999997,"15min":1.4319999999999999},"last":0.48899999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.41899999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69899999999999995,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.46899999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81100000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575013,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303328,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068512,"statfs":{"total":96636764160,"available":96326156288,"internally_reserved":0,"allocated":1990656,"data_stored":1035645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.379,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.73499999999999999,"5min":0.78800000000000003,"15min":1.103},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52400000000000002,"15min":0.53600000000000003},"min":{"1min":0.40899999999999997,"5min":0.34100000000000003,"15min":0.312},"max":{"1min":0.68700000000000006,"5min":0.86099999999999999,"15min":1.1299999999999999},"last":0.48299999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.29699999999999999},"max":{"1min":0.82299999999999995,"5min":0.91400000000000003,"15min":1.1679999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.58499999999999996},"min":{"1min":0.43099999999999999,"5min":0.377,"15min":0.33900000000000002},"max":{"1min":0.74099999999999999,"5min":0.89200000000000002,"15min":1.0620000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Oct 6 02:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.38200000000000001,"5min":0.35299999999999998,"15min":0.30399999999999999},"max":{"1min":0.78500000000000003,"5min":0.81299999999999994,"15min":1.2070000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56100000000000005,"15min":0.55000000000000004},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":0.76200000000000001,"5min":0.80000000000000004,"15min":1.1140000000000001},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77800000000000002,"15min":1.1799999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.34699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.752,"5min":0.81499999999999995,"15min":1.1830000000000001},"last":0.70499999999999996}]},{"osd":4,"last update":"Fri Oct 6 02:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.50700000000000001,"15min":0.502},"min":{"1min":0.314,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70799999999999996,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.27400000000000002,"15min":0.26500000000000001},"max":{"1min":0.63300000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53200000000000003,"15min":0.51900000000000002},"min":{"1min":0.38100000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68700000000000006,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.746},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.433,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73399999999999999,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.41699999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.746,"5min":0.872,"15min":0.872},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.60799999999999998,"15min":0.59899999999999998},"min":{"1min":0.44800000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.76100000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.78200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:31:16.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T02:31:16.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.299+0000 7f1e2d301700 1 Processor -- start 2023-10-06T02:31:16.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.299+0000 7f1e2d301700 1 -- start start 2023-10-06T02:31:16.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.300+0000 7f1e2d301700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1e2806d930 0x7f1e2806ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.300+0000 7f1e2d301700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1e280699f0 0x7f1e28069df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.300+0000 7f1e2d301700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2806ec30 con 0x7f1e280ad140 2023-10-06T02:31:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.300+0000 7f1e2d301700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2806e310 con 0x7f1e2806d930 2023-10-06T02:31:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.300+0000 7f1e2d301700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e280b3e40 con 0x7f1e280699f0 2023-10-06T02:31:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.300+0000 7f1e277fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1e2806d930 0x7f1e2806ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:31:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.300+0000 7f1e277fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1e2806d930 0x7f1e2806ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53892/0 (socket says 172.21.15.6:53892) 2023-10-06T02:31:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.300+0000 7f1e277fe700 1 -- 172.21.15.6:0/440195232 learned_addr learned my addr 172.21.15.6:0/440195232 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:31:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.300+0000 7f1e2cb00700 1 --2- 172.21.15.6:0/440195232 >> v2:172.21.15.175:3300/0 conn(0x7f1e280699f0 0x7f1e28069df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:31:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.300+0000 7f1e277fe700 1 -- 172.21.15.6:0/440195232 >> v2:172.21.15.175:3300/0 conn(0x7f1e280699f0 msgr2=0x7f1e28069df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:31:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.300+0000 7f1e277fe700 1 --2- 172.21.15.6:0/440195232 >> v2:172.21.15.175:3300/0 conn(0x7f1e280699f0 0x7f1e28069df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.300+0000 7f1e277fe700 1 -- 172.21.15.6:0/440195232 >> v1:172.21.15.175:6789/0 conn(0x7f1e280ad140 legacy=0x7f1e280b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.300+0000 7f1e277fe700 1 -- 172.21.15.6:0/440195232 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e28159c10 con 0x7f1e2806d930 2023-10-06T02:31:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.301+0000 7f1e277fe700 1 --2- 172.21.15.6:0/440195232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e2806d930 0x7f1e2806ddd0 secure :-1 s=READY pgs=2630 cs=0 l=1 rev1=1 crypto rx=0x7f1e280b1270 tx=0x7f1e1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b8a1ac901dca6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:31:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.301+0000 7f1e26ffd700 1 -- 172.21.15.6:0/440195232 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c009e70 con 0x7f1e2806d930 2023-10-06T02:31:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.301+0000 7f1e26ffd700 1 -- 172.21.15.6:0/440195232 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c00b860 con 0x7f1e2806d930 2023-10-06T02:31:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.301+0000 7f1e26ffd700 1 -- 172.21.15.6:0/440195232 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00bc00 con 0x7f1e2806d930 2023-10-06T02:31:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.301+0000 7f1e2d301700 1 -- 172.21.15.6:0/440195232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e2806d930 msgr2=0x7f1e2806ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.301+0000 7f1e2d301700 1 --2- 172.21.15.6:0/440195232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e2806d930 0x7f1e2806ddd0 secure :-1 s=READY pgs=2630 cs=0 l=1 rev1=1 crypto rx=0x7f1e280b1270 tx=0x7f1e1c009250 comp rx=0 tx=0).stop 2023-10-06T02:31:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.301+0000 7f1e2d301700 1 -- 172.21.15.6:0/440195232 shutdown_connections 2023-10-06T02:31:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.301+0000 7f1e2d301700 1 --2- 172.21.15.6:0/440195232 >> v2:172.21.15.175:3300/0 conn(0x7f1e280699f0 0x7f1e28069df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.301+0000 7f1e2d301700 1 --2- 172.21.15.6:0/440195232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e2806d930 0x7f1e2806ddd0 unknown :-1 s=CLOSED pgs=2630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.301+0000 7f1e2d301700 1 -- 172.21.15.6:0/440195232 >> 172.21.15.6:0/440195232 conn(0x7f1e280ce9d0 msgr2=0x7f1e2806c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:31:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.301+0000 7f1e2d301700 1 -- 172.21.15.6:0/440195232 shutdown_connections 2023-10-06T02:31:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.301+0000 7f1e2d301700 1 -- 172.21.15.6:0/440195232 wait complete. 2023-10-06T02:31:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.302+0000 7f1e2d301700 1 Processor -- start 2023-10-06T02:31:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.303+0000 7f1e2d301700 1 -- start start 2023-10-06T02:31:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.303+0000 7f1e2d301700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e280699f0 0x7f1e280ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.303+0000 7f1e2d301700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e2806d930 0x7f1e2815a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.303+0000 7f1e2d301700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e280ad140 0x7f1e281559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.303+0000 7f1e2d301700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e28169d70 con 0x7f1e280699f0 2023-10-06T02:31:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.303+0000 7f1e2d301700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2815b300 con 0x7f1e280ad140 2023-10-06T02:31:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.303+0000 7f1e2d301700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2815b5e0 con 0x7f1e2806d930 2023-10-06T02:31:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.303+0000 7f1e27fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e280699f0 0x7f1e280ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:31:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.304+0000 7f1e27fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e280699f0 0x7f1e280ae320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53902/0 (socket says 172.21.15.6:53902) 2023-10-06T02:31:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.304+0000 7f1e27fff700 1 -- 172.21.15.6:0/1798005244 learned_addr learned my addr 172.21.15.6:0/1798005244 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:31:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.304+0000 7f1e2cb00700 1 --2- 172.21.15.6:0/1798005244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e280ad140 0x7f1e281559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:31:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.304+0000 7f1e27fff700 1 -- 172.21.15.6:0/1798005244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e2806d930 msgr2=0x7f1e2815a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.304+0000 7f1e277fe700 1 --2- 172.21.15.6:0/1798005244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e2806d930 0x7f1e2815a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:31:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.304+0000 7f1e27fff700 1 --2- 172.21.15.6:0/1798005244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e2806d930 0x7f1e2815a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.304+0000 7f1e27fff700 1 -- 172.21.15.6:0/1798005244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e280ad140 msgr2=0x7f1e281559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.304+0000 7f1e27fff700 1 --2- 172.21.15.6:0/1798005244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e280ad140 0x7f1e281559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.304+0000 7f1e27fff700 1 -- 172.21.15.6:0/1798005244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c0094f0 con 0x7f1e280699f0 2023-10-06T02:31:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.304+0000 7f1e2cb00700 1 --2- 172.21.15.6:0/1798005244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e280ad140 0x7f1e281559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:31:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.304+0000 7f1e277fe700 1 --2- 172.21.15.6:0/1798005244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e2806d930 0x7f1e2815a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:31:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.304+0000 7f1e27fff700 1 --2- 172.21.15.6:0/1798005244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e280699f0 0x7f1e280ae320 secure :-1 s=READY pgs=2631 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800c4e0 tx=0x7f1e1800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:31:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.304+0000 7f1e0ffff700 1 -- 172.21.15.6:0/1798005244 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18011590 con 0x7f1e280699f0 2023-10-06T02:31:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.304+0000 7f1e0ffff700 1 -- 172.21.15.6:0/1798005244 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e18011710 con 0x7f1e280699f0 2023-10-06T02:31:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.304+0000 7f1e2d301700 1 -- 172.21.15.6:0/1798005244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2815b8c0 con 0x7f1e280699f0 2023-10-06T02:31:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.304+0000 7f1e0ffff700 1 -- 172.21.15.6:0/1798005244 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18011ad0 con 0x7f1e280699f0 2023-10-06T02:31:16.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.304+0000 7f1e2d301700 1 -- 172.21.15.6:0/1798005244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e280cdb50 con 0x7f1e280699f0 2023-10-06T02:31:16.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.305+0000 7f1e2d301700 1 -- 172.21.15.6:0/1798005244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e28064aa0 con 0x7f1e280699f0 2023-10-06T02:31:16.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.306+0000 7f1e0ffff700 1 -- 172.21.15.6:0/1798005244 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e1801b3b0 con 0x7f1e280699f0 2023-10-06T02:31:16.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.306+0000 7f1e0ffff700 1 --2- 172.21.15.6:0/1798005244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1e14066f30 0x7f1e140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:16.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.306+0000 7f1e0ffff700 1 -- 172.21.15.6:0/1798005244 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f1e18083a60 con 0x7f1e280699f0 2023-10-06T02:31:16.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.306+0000 7f1e277fe700 1 --2- 172.21.15.6:0/1798005244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1e14066f30 0x7f1e140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:31:16.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.307+0000 7f1e277fe700 1 --2- 172.21.15.6:0/1798005244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1e14066f30 0x7f1e140693e0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1e280b1270 tx=0x7f1e1c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:31:16.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.310+0000 7f1e0ffff700 1 -- 172.21.15.6:0/1798005244 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e18050cd0 con 0x7f1e280699f0 2023-10-06T02:31:16.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.504+0000 7f1e2d301700 1 -- 172.21.15.6:0/1798005244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f1e28159ef0 con 0x7f1e280699f0 2023-10-06T02:31:16.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.507+0000 7f1e0ffff700 1 -- 172.21.15.6:0/1798005244 <== mon.0 v2:172.21.15.6:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1e18001150 con 0x7f1e280699f0 2023-10-06T02:31:16.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.508+0000 7f1e0ffff700 1 -- 172.21.15.6:0/1798005244 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v30)=0 v30) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1e18017070 con 0x7f1e280699f0 2023-10-06T02:31:16.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.510+0000 7f1e2d301700 1 -- 172.21.15.6:0/1798005244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1e14066f30 msgr2=0x7f1e140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:16.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.510+0000 7f1e2d301700 1 --2- 172.21.15.6:0/1798005244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1e14066f30 0x7f1e140693e0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1e280b1270 tx=0x7f1e1c017000 comp rx=0 tx=0).stop 2023-10-06T02:31:16.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.510+0000 7f1e2d301700 1 -- 172.21.15.6:0/1798005244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e280699f0 msgr2=0x7f1e280ae320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:16.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.510+0000 7f1e2d301700 1 --2- 172.21.15.6:0/1798005244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e280699f0 0x7f1e280ae320 secure :-1 s=READY pgs=2631 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800c4e0 tx=0x7f1e1800c8a0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.510+0000 7f1e2d301700 1 -- 172.21.15.6:0/1798005244 shutdown_connections 2023-10-06T02:31:16.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.510+0000 7f1e2d301700 1 --2- 172.21.15.6:0/1798005244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e280ad140 0x7f1e281559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.510+0000 7f1e2d301700 1 --2- 172.21.15.6:0/1798005244 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7f1e14066f30 0x7f1e140693e0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.510+0000 7f1e2d301700 1 --2- 172.21.15.6:0/1798005244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e280699f0 0x7f1e280ae320 unknown :-1 s=CLOSED pgs=2631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.510+0000 7f1e2d301700 1 --2- 172.21.15.6:0/1798005244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e2806d930 0x7f1e2815a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.510+0000 7f1e2d301700 1 -- 172.21.15.6:0/1798005244 >> 172.21.15.6:0/1798005244 conn(0x7f1e280ce9d0 msgr2=0x7f1e280c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:31:16.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.511+0000 7f1e2d301700 1 -- 172.21.15.6:0/1798005244 shutdown_connections 2023-10-06T02:31:16.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.511+0000 7f1e2d301700 1 -- 172.21.15.6:0/1798005244 wait complete. 2023-10-06T02:31:16.523 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:31:16.523 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:31:16.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.641+0000 7fa40b0ef700 1 Processor -- start 2023-10-06T02:31:16.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.641+0000 7fa40b0ef700 1 -- start start 2023-10-06T02:31:16.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.642+0000 7fa40b0ef700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa4040cd6e0 0x7fa40413f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.642+0000 7fa40b0ef700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa4040c7ca0 0x7fa40413fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.642+0000 7fa40b0ef700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4040ca3e0 con 0x7fa4040c78d0 2023-10-06T02:31:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.642+0000 7fa40b0ef700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4040c95c0 con 0x7fa4040c7ca0 2023-10-06T02:31:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.642+0000 7fa40b0ef700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4040c3140 con 0x7fa4040cd6e0 2023-10-06T02:31:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.642+0000 7fa408e8b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa4040c78d0 0x7fa4040ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37918/0 (socket says 172.21.15.6:37918) 2023-10-06T02:31:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.642+0000 7fa40968c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa4040c7ca0 0x7fa40413fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:31:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.642+0000 7fa408e8b700 1 -- 172.21.15.6:0/18051213 learned_addr learned my addr 172.21.15.6:0/18051213 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-06T02:31:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.643+0000 7fa4037fe700 1 -- 172.21.15.6:0/18051213 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189414470 0 0) 0x7fa4040ca3e0 con 0x7fa4040c78d0 2023-10-06T02:31:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.643+0000 7fa403fff700 1 --2- 172.21.15.6:0/18051213 >> v2:172.21.15.175:3300/0 conn(0x7fa4040cd6e0 0x7fa40413f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:31:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.643+0000 7fa4037fe700 1 -- 172.21.15.6:0/18051213 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3f4003570 con 0x7fa4040c78d0 2023-10-06T02:31:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.643+0000 7fa40968c700 1 -- 172.21.15.6:0/18051213 >> v2:172.21.15.175:3300/0 conn(0x7fa4040cd6e0 msgr2=0x7fa40413f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:31:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.643+0000 7fa40968c700 1 --2- 172.21.15.6:0/18051213 >> v2:172.21.15.175:3300/0 conn(0x7fa4040cd6e0 0x7fa40413f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.643+0000 7fa40968c700 1 -- 172.21.15.6:0/18051213 >> v1:172.21.15.6:6789/0 conn(0x7fa4040c78d0 legacy=0x7fa4040ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.643+0000 7fa40968c700 1 -- 172.21.15.6:0/18051213 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4040c97d0 con 0x7fa4040c7ca0 2023-10-06T02:31:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.643+0000 7fa403fff700 1 --2- 172.21.15.6:0/18051213 >> v2:172.21.15.175:3300/0 conn(0x7fa4040cd6e0 0x7fa40413f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:31:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.643+0000 7fa40968c700 1 --2- 172.21.15.6:0/18051213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4040c7ca0 0x7fa40413fe70 secure :-1 s=READY pgs=2633 cs=0 l=1 rev1=1 crypto rx=0x7fa4040afad0 tx=0x7fa3fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c773d21becab2a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:31:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.643+0000 7fa4037fe700 1 -- 172.21.15.6:0/18051213 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc00e070 con 0x7fa4040c7ca0 2023-10-06T02:31:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.643+0000 7fa4037fe700 1 -- 172.21.15.6:0/18051213 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa3fc00bb60 con 0x7fa4040c7ca0 2023-10-06T02:31:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.643+0000 7fa4037fe700 1 -- 172.21.15.6:0/18051213 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc012430 con 0x7fa4040c7ca0 2023-10-06T02:31:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.643+0000 7fa40b0ef700 1 -- 172.21.15.6:0/18051213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4040c7ca0 msgr2=0x7fa40413fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.643+0000 7fa40b0ef700 1 --2- 172.21.15.6:0/18051213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4040c7ca0 0x7fa40413fe70 secure :-1 s=READY pgs=2633 cs=0 l=1 rev1=1 crypto rx=0x7fa4040afad0 tx=0x7fa3fc009780 comp rx=0 tx=0).stop 2023-10-06T02:31:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.644+0000 7fa40b0ef700 1 -- 172.21.15.6:0/18051213 shutdown_connections 2023-10-06T02:31:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.644+0000 7fa40b0ef700 1 --2- 172.21.15.6:0/18051213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4040c7ca0 0x7fa40413fe70 unknown :-1 s=CLOSED pgs=2633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.644+0000 7fa40b0ef700 1 --2- 172.21.15.6:0/18051213 >> v2:172.21.15.175:3300/0 conn(0x7fa4040cd6e0 0x7fa40413f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.644+0000 7fa40b0ef700 1 -- 172.21.15.6:0/18051213 >> 172.21.15.6:0/18051213 conn(0x7fa404069790 msgr2=0x7fa404069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:31:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.644+0000 7fa40b0ef700 1 -- 172.21.15.6:0/18051213 shutdown_connections 2023-10-06T02:31:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.644+0000 7fa40b0ef700 1 -- 172.21.15.6:0/18051213 wait complete. 2023-10-06T02:31:16.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.645+0000 7fa40b0ef700 1 Processor -- start 2023-10-06T02:31:16.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.645+0000 7fa40b0ef700 1 -- start start 2023-10-06T02:31:16.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa40b0ef700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4040c78d0 0x7fa40416cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:16.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa40b0ef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4040c7ca0 0x7fa4040aac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:16.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa40b0ef700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4040cd6e0 0x7fa4041559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:16.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa40b0ef700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4040a5200 con 0x7fa4040c7ca0 2023-10-06T02:31:16.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa40b0ef700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4040a45f0 con 0x7fa4040c78d0 2023-10-06T02:31:16.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa40b0ef700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4040a48d0 con 0x7fa4040cd6e0 2023-10-06T02:31:16.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa403fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4040c7ca0 0x7fa4040aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:31:16.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa403fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4040c7ca0 0x7fa4040aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53912/0 (socket says 172.21.15.6:53912) 2023-10-06T02:31:16.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa403fff700 1 -- 172.21.15.6:0/78171979 learned_addr learned my addr 172.21.15.6:0/78171979 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-06T02:31:16.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa40968c700 1 --2- 172.21.15.6:0/78171979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4040cd6e0 0x7fa4041559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:31:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa408e8b700 1 --2- 172.21.15.6:0/78171979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4040c78d0 0x7fa40416cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:31:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa403fff700 1 -- 172.21.15.6:0/78171979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4040cd6e0 msgr2=0x7fa4041559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa403fff700 1 --2- 172.21.15.6:0/78171979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4040cd6e0 0x7fa4041559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa403fff700 1 -- 172.21.15.6:0/78171979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4040c78d0 msgr2=0x7fa40416cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa403fff700 1 --2- 172.21.15.6:0/78171979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4040c78d0 0x7fa40416cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa403fff700 1 -- 172.21.15.6:0/78171979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc009a20 con 0x7fa4040c7ca0 2023-10-06T02:31:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa40968c700 1 --2- 172.21.15.6:0/78171979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4040cd6e0 0x7fa4041559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:31:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa408e8b700 1 --2- 172.21.15.6:0/78171979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4040c78d0 0x7fa40416cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:31:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa403fff700 1 --2- 172.21.15.6:0/78171979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4040c7ca0 0x7fa4040aac90 secure :-1 s=READY pgs=2634 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000c830 tx=0x7fa3f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:31:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa400ff9700 1 -- 172.21.15.6:0/78171979 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0011600 con 0x7fa4040c7ca0 2023-10-06T02:31:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa400ff9700 1 -- 172.21.15.6:0/78171979 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa3f0011760 con 0x7fa4040c7ca0 2023-10-06T02:31:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa40b0ef700 1 -- 172.21.15.6:0/78171979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4040a4bb0 con 0x7fa4040c7ca0 2023-10-06T02:31:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.646+0000 7fa400ff9700 1 -- 172.21.15.6:0/78171979 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0011b40 con 0x7fa4040c7ca0 2023-10-06T02:31:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.647+0000 7fa40b0ef700 1 -- 172.21.15.6:0/78171979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4040c6c10 con 0x7fa4040c7ca0 2023-10-06T02:31:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.647+0000 7fa40b0ef700 1 -- 172.21.15.6:0/78171979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4040a5340 con 0x7fa4040c7ca0 2023-10-06T02:31:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.648+0000 7fa400ff9700 1 -- 172.21.15.6:0/78171979 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3f000a3e0 con 0x7fa4040c7ca0 2023-10-06T02:31:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.648+0000 7fa400ff9700 1 --2- 172.21.15.6:0/78171979 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa3e8066f30 0x7fa3e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:31:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.648+0000 7fa400ff9700 1 -- 172.21.15.6:0/78171979 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fa3f00849c0 con 0x7fa4040c7ca0 2023-10-06T02:31:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.649+0000 7fa408e8b700 1 --2- 172.21.15.6:0/78171979 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa3e8066f30 0x7fa3e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:31:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.649+0000 7fa408e8b700 1 --2- 172.21.15.6:0/78171979 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa3e8066f30 0x7fa3e80693e0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80058d0 tx=0x7fa3f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:31:16.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.652+0000 7fa400ff9700 1 -- 172.21.15.6:0/78171979 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3f0051cb0 con 0x7fa4040c7ca0 2023-10-06T02:31:16.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.890+0000 7fa40b0ef700 1 -- 172.21.15.6:0/78171979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4040cdf60 con 0x7fa4040c7ca0 2023-10-06T02:31:16.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.891+0000 7fa400ff9700 1 -- 172.21.15.6:0/78171979 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 368 v368) v1 ==== 95+0+3533 (secure 0 0 0) 0x7fa3f001fde0 con 0x7fa4040c7ca0 2023-10-06T02:31:16.892 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-06T02:31:16.892 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":368,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9817,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3603762205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3603762205},{"type":"v1","addr":"172.21.15.175:6836","nonce":3603762205}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":9820,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3292446255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3292446255},{"type":"v1","addr":"172.21.15.175:6837","nonce":3292446255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":10869,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/759655214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":759655214},{"type":"v1","addr":"172.21.15.6:6834","nonce":759655214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":354},{"gid":11433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/4017659393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":4017659393},{"type":"v1","addr":"172.21.15.6:6835","nonce":4017659393}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":368}],"filesystems":[]} 2023-10-06T02:31:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.893+0000 7fa40b0ef700 1 -- 172.21.15.6:0/78171979 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa3e8066f30 msgr2=0x7fa3e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.893+0000 7fa40b0ef700 1 --2- 172.21.15.6:0/78171979 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa3e8066f30 0x7fa3e80693e0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80058d0 tx=0x7fa3f8009040 comp rx=0 tx=0).stop 2023-10-06T02:31:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.893+0000 7fa40b0ef700 1 -- 172.21.15.6:0/78171979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4040c7ca0 msgr2=0x7fa4040aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:31:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.893+0000 7fa40b0ef700 1 --2- 172.21.15.6:0/78171979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4040c7ca0 0x7fa4040aac90 secure :-1 s=READY pgs=2634 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000c830 tx=0x7fa3f0008040 comp rx=0 tx=0).stop 2023-10-06T02:31:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.893+0000 7fa40b0ef700 1 -- 172.21.15.6:0/78171979 shutdown_connections 2023-10-06T02:31:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.893+0000 7fa40b0ef700 1 --2- 172.21.15.6:0/78171979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4040cd6e0 0x7fa4041559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.893+0000 7fa40b0ef700 1 --2- 172.21.15.6:0/78171979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4040c78d0 0x7fa40416cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.893+0000 7fa40b0ef700 1 --2- 172.21.15.6:0/78171979 >> [v2:172.21.15.175:6832/90280,v1:172.21.15.175:6833/90280] conn(0x7fa3e8066f30 0x7fa3e80693e0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.893+0000 7fa40b0ef700 1 --2- 172.21.15.6:0/78171979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4040c7ca0 0x7fa4040aac90 unknown :-1 s=CLOSED pgs=2634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:31:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.893+0000 7fa40b0ef700 1 -- 172.21.15.6:0/78171979 >> 172.21.15.6:0/78171979 conn(0x7fa404069790 msgr2=0x7fa4040ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:31:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.893+0000 7fa40b0ef700 1 -- 172.21.15.6:0/78171979 shutdown_connections 2023-10-06T02:31:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-06T02:31:16.893+0000 7fa40b0ef700 1 -- 172.21.15.6:0/78171979 wait complete. 2023-10-06T02:31:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 368 2023-10-06T02:31:16.906 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T02:31:16.906 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T02:31:16.906 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:31:16.906 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:31:16.914 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:31:16.914 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:31:16.915 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:31:16.963 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:31:16.963 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:31:16.963 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:31:16.974 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:31:16.974 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:31:16.974 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:31:17.024 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:31:17.024 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T02:31:17.025 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T02:31:17.025 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:31:17.052 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T02:31:17.053 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T02:31:17.053 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:31:17.120 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T02:31:17.120 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T02:31:17.120 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:31:17.192 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T02:31:17.193 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T02:31:17.193 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:31:17.258 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T02:31:17.259 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T02:31:17.259 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:31:17.293 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T02:31:17.294 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T02:31:17.294 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:31:17.366 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T02:31:17.366 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T02:31:17.367 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:31:17.434 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T02:31:17.434 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T02:31:17.434 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:31:17.502 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T02:31:17.502 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T02:31:17.502 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T02:31:17.503 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:31:17.526 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T02:31:17.527 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T02:31:17.527 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:31:17.571 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T02:31:17.571 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T02:31:17.571 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T02:31:17.571 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:31:17.582 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T02:31:17.583 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T02:31:17.583 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:31:17.624 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T02:31:17.624 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T02:31:17.624 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:31:17.676 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T02:31:17.676 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T02:31:17.676 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'Error loading MDS rank' | egrep -v 'missing journal object' | egrep -v 'Error recovering journal' | egrep -v 'error decoding table object' | egrep -v 'failed to read JournalPointer' | egrep -v 'Corrupt directory entry' | egrep -v 'Corrupt fnode header' | egrep -v 'corrupt sessionmap header' | egrep -v 'Corrupt dentry' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v MDS_READ_ONLY | egrep -v 'force file system read-only' | egrep -v 'with standby daemon mds' | head -n 1 2023-10-06T02:31:17.710 INFO:teuthology.orchestra.run.smithi006.stdout:1696558662.987008 mon.a (mon.0) 137 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T02:31:17.710 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T02:31:17.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'Error loading MDS rank' | egrep -v 'missing journal object' | egrep -v 'Error recovering journal' | egrep -v 'error decoding table object' | egrep -v 'failed to read JournalPointer' | egrep -v 'Corrupt directory entry' | egrep -v 'Corrupt fnode header' | egrep -v 'corrupt sessionmap header' | egrep -v 'Corrupt dentry' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v MDS_READ_ONLY | egrep -v 'force file system read-only' | egrep -v 'with standby daemon mds' | head -n 1 2023-10-06T02:31:17.783 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'Error loading MDS rank' | egrep -v 'missing journal object' | egrep -v 'Error recovering journal' | egrep -v 'error decoding table object' | egrep -v 'failed to read JournalPointer' | egrep -v 'Corrupt directory entry' | egrep -v 'Corrupt fnode header' | egrep -v 'corrupt sessionmap header' | egrep -v 'Corrupt dentry' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v MDS_READ_ONLY | egrep -v 'force file system read-only' | egrep -v 'with standby daemon mds' | head -n 1 2023-10-06T02:31:17.857 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'Error loading MDS rank' | egrep -v 'missing journal object' | egrep -v 'Error recovering journal' | egrep -v 'error decoding table object' | egrep -v 'failed to read JournalPointer' | egrep -v 'Corrupt directory entry' | egrep -v 'Corrupt fnode header' | egrep -v 'corrupt sessionmap header' | egrep -v 'Corrupt dentry' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v MDS_READ_ONLY | egrep -v 'force file system read-only' | egrep -v 'with standby daemon mds' | head -n 1 2023-10-06T02:31:17.929 INFO:teuthology.orchestra.run.smithi006.stdout:1696558662.987008 mon.a (mon.0) 137 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T02:31:17.930 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:31:17.930 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T02:31:18.199 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:31:18.200 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T02:31:18.408 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:31:18.409 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T02:31:18.478 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:31:18.478 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T02:31:18.593 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:31:18.593 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T02:31:18.776 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:31:18.776 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T02:31:18.845 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:31:18.845 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T02:31:18.941 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:31:18.942 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T02:31:19.028 INFO:tasks.ceph:Archiving mon data... 2023-10-06T02:31:19.030 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412131/data/mon.a.tgz 2023-10-06T02:31:19.030 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2023-10-06T02:31:19.046 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.O9b4iTGSgA 2023-10-06T02:31:19.047 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.O9b4iTGSgA 2023-10-06T02:31:19.306 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.O9b4iTGSgA 2023-10-06T02:31:19.402 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.O9b4iTGSgA is 690KB 2023-10-06T02:31:19.502 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.O9b4iTGSgA 2023-10-06T02:31:19.518 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412131/data/mon.b.tgz 2023-10-06T02:31:19.519 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2023-10-06T02:31:19.541 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.klCeQlgH3j 2023-10-06T02:31:19.542 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.klCeQlgH3j 2023-10-06T02:31:19.759 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.klCeQlgH3j 2023-10-06T02:31:19.845 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.klCeQlgH3j is 742KB 2023-10-06T02:31:19.922 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.klCeQlgH3j 2023-10-06T02:31:19.936 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412131/data/mon.c.tgz 2023-10-06T02:31:19.937 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2023-10-06T02:31:19.990 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.7Yso5iZLDx 2023-10-06T02:31:19.991 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.7Yso5iZLDx 2023-10-06T02:31:20.193 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.7Yso5iZLDx 2023-10-06T02:31:20.275 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.7Yso5iZLDx is 743KB 2023-10-06T02:31:20.375 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.7Yso5iZLDx 2023-10-06T02:31:20.389 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T02:31:20.389 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T02:31:20.391 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T02:31:20.454 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T02:31:20.455 DEBUG:teuthology.orchestra.run.smithi006:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T02:31:20.457 DEBUG:teuthology.orchestra.run.smithi175:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T02:31:20.481 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T02:31:20.519 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T02:31:20.525 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T02:31:20.527 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412131/remote/smithi006/crash 2023-10-06T02:31:20.528 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T02:31:20.581 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412131/remote/smithi175/crash 2023-10-06T02:31:20.581 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T02:31:20.605 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T02:31:20.606 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:31:20.609 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:31:20.700 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T02:31:20.725 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T02:31:20.749 INFO:tasks.ceph:Compressing logs... 2023-10-06T02:31:20.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T02:31:20.768 DEBUG:teuthology.orchestra.run.smithi175:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T02:31:29.925 INFO:tasks.ceph:Archiving logs... 2023-10-06T02:31:29.925 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412131/remote/smithi006/log 2023-10-06T02:31:29.926 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T02:31:31.638 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412131/remote/smithi175/log 2023-10-06T02:31:31.639 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T02:31:32.550 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T02:31:32.559 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T02:31:32.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T02:31:32.561 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T02:31:32.641 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T02:31:32.650 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T02:31:32.650 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:31:32.652 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:31:32.667 INFO:teuthology.orchestra.run.smithi006.stderr:bash: ntpq: command not found 2023-10-06T02:31:32.668 INFO:teuthology.orchestra.run.smithi175.stderr:bash: ntpq: command not found 2023-10-06T02:31:32.670 INFO:teuthology.orchestra.run.smithi006.stdout:210 Number of sources = 4 2023-10-06T02:31:32.670 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T02:31:32.670 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2023-10-06T02:31:32.670 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 35 -233us[ -234us] +/- 90ms 2023-10-06T02:31:32.670 INFO:teuthology.orchestra.run.smithi006.stdout:^* hv02.front.sepia.ceph.com 3 6 377 35 -398us[ -399us] +/- 77ms 2023-10-06T02:31:32.670 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +636us[ +635us] +/- 83ms 2023-10-06T02:31:32.670 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:31:32.672 INFO:teuthology.orchestra.run.smithi175.stdout:210 Number of sources = 4 2023-10-06T02:31:32.672 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T02:31:32.672 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2023-10-06T02:31:32.672 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 36 -225us[ -217us] +/- 90ms 2023-10-06T02:31:32.672 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv02.front.sepia.ceph.com 3 6 377 35 -388us[ -381us] +/- 77ms 2023-10-06T02:31:32.672 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +636us[ +636us] +/- 83ms 2023-10-06T02:31:32.672 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:31:32.673 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T02:31:32.681 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T02:31:32.682 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T02:31:32.702 DEBUG:teuthology.orchestra.run.smithi006:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T02:31:32.767 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T02:31:32.862 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T02:31:32.892 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:31:32.893 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T02:31:32.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:31:32.923 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T02:31:32.932 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T02:31:32.943 INFO:teuthology.task.internal:Duration was 1514.506076 seconds 2023-10-06T02:31:32.943 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T02:31:32.960 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T02:31:32.960 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T02:31:32.963 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T02:31:33.007 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T02:31:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T02:31:33.232 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T02:31:33.232 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2023-10-06T02:31:33.232 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T02:31:33.254 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2023-10-06T02:31:33.254 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T02:31:33.273 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T02:31:33.273 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T02:31:33.297 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T02:31:33.350 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T02:31:33.350 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T02:31:33.353 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T02:31:33.463 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T02:31:33.473 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T02:31:33.473 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T02:31:33.498 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T02:31:33.522 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T02:31:33.532 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T02:31:33.540 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T02:31:33.563 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2023-10-06T02:31:33.586 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2023-10-06T02:31:33.599 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T02:31:33.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:31:33.632 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T02:31:33.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:31:33.653 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T02:31:33.663 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T02:31:33.664 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412131/remote/smithi006 2023-10-06T02:31:33.664 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T02:31:33.710 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412131/remote/smithi175 2023-10-06T02:31:33.710 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T02:31:33.752 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T02:31:33.752 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T02:31:33.756 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T02:31:33.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T02:31:33.817 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T02:31:33.818 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T02:31:33.835 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T02:31:33.835 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T02:31:33.838 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T02:31:33.850 INFO:teuthology.orchestra.run.smithi006.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 02:31 /home/ubuntu/cephtest 2023-10-06T02:31:33.854 INFO:teuthology.orchestra.run.smithi175.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 02:31 /home/ubuntu/cephtest 2023-10-06T02:31:33.855 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T02:31:33.873 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T02:31:33.911 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T02:31:33.941 DEBUG:teuthology.nuke:shortname: smithi006 2023-10-06T02:31:33.941 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T02:31:33.965 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412131', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 01:58:53.242942', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCSFSdiZKcLmyGO0r296YGrht1THF1fBW73f3MsIa+MU/HIO1DrrFx2l/eDdgLmxb+srEPoasttona7m0Rn3HQM='} 2023-10-06T02:31:33.970 DEBUG:teuthology.nuke:shortname: smithi175 2023-10-06T02:31:33.970 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T02:31:33.994 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412131', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 01:58:53.244356', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLYCW+Bineqy7fYATmxxFptUdHyHPy9Dx0sRKEZSHpKp64Um7RUy20PZtLf6QTL/lmWCndY+bmPXbO76XS726Wg='} 2023-10-06T02:31:34.017 INFO:teuthology.orchestra.console.smithi006:Power off 2023-10-06T02:31:34.018 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T02:31:34.042 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2023-10-06T02:31:34.042 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:31:34.056 INFO:teuthology.orchestra.console.smithi175:Power off 2023-10-06T02:31:34.057 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T02:31:34.067 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-10-06T02:31:34.079 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-10-06T02:31:34.079 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:31:34.101 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-10-06T02:31:38.068 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:31:38.103 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:31:38.180 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-10-06T02:31:38.212 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-10-06T02:31:42.182 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:31:42.212 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:31:42.292 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-10-06T02:31:42.322 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-06T02:31:42.422 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-10-06T02:31:46.294 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:31:46.404 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-10-06T02:31:46.505 INFO:teuthology.orchestra.console.smithi006:Power off completed 2023-10-06T02:31:46.611 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage} duration: 1514.5060760974884 failure_reason: '"1696558662.987008 mon.a (mon.0) 137 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T02:31:46.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T02:31:46.703 INFO:teuthology.run:FAIL